-- Logs begin at Wed 2022-08-10 21:55:31 UTC, end at Thu 2022-08-11 00:39:06 UTC. -- Aug 10 22:45:03.695015 n-d-850468-14 systemd[1]: Starting Devstack devstack@n-api.service... Aug 10 22:45:03.704061 n-d-850468-14 devstack@n-api.service[106657]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 10 22:45:03.706052 n-d-850468-14 devstack@n-api.service[106657]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 10 22:45:03 2022] *** Aug 10 22:45:03.706052 n-d-850468-14 devstack@n-api.service[106657]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 10 22:45:03.706052 n-d-850468-14 devstack@n-api.service[106657]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 10 22:45:03.706052 n-d-850468-14 devstack@n-api.service[106657]: nodename: n-d-850468-14 Aug 10 22:45:03.706052 n-d-850468-14 devstack@n-api.service[106657]: machine: x86_64 Aug 10 22:45:03.706052 n-d-850468-14 devstack@n-api.service[106657]: clock source: unix Aug 10 22:45:03.706052 n-d-850468-14 devstack@n-api.service[106657]: pcre jit disabled Aug 10 22:45:03.706052 n-d-850468-14 devstack@n-api.service[106657]: detected number of CPU cores: 4 Aug 10 22:45:03.706052 n-d-850468-14 devstack@n-api.service[106657]: current working directory: / Aug 10 22:45:03.706052 n-d-850468-14 devstack@n-api.service[106657]: detected binary path: /usr/bin/uwsgi-core Aug 10 22:45:03.706725 n-d-850468-14 devstack@n-api.service[106657]: your processes number limit is 47680 Aug 10 22:45:03.706725 n-d-850468-14 devstack@n-api.service[106657]: your memory page size is 4096 bytes Aug 10 22:45:03.706725 n-d-850468-14 devstack@n-api.service[106657]: detected max file descriptor number: 2048 Aug 10 22:45:03.706725 n-d-850468-14 devstack@n-api.service[106657]: lock engine: pthread robust mutexes Aug 10 22:45:03.706725 n-d-850468-14 devstack@n-api.service[106657]: thunder lock: enabled Aug 10 22:45:03.706725 n-d-850468-14 devstack@n-api.service[106657]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 10 22:45:03.706725 n-d-850468-14 devstack@n-api.service[106657]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 10 22:45:03.746474 n-d-850468-14 devstack@n-api.service[106657]: Python main interpreter initialized at 0x56242b4449c0 Aug 10 22:45:03.746474 n-d-850468-14 devstack@n-api.service[106657]: python threads support enabled Aug 10 22:45:03.746474 n-d-850468-14 devstack@n-api.service[106657]: your server socket listen backlog is limited to 100 connections Aug 10 22:45:03.746474 n-d-850468-14 devstack@n-api.service[106657]: your mercy for graceful operations on workers is 90 seconds Aug 10 22:45:03.746844 n-d-850468-14 devstack@n-api.service[106657]: mapped 403077 bytes (393 KB) for 2 cores Aug 10 22:45:03.746921 n-d-850468-14 devstack@n-api.service[106657]: *** Operational MODE: preforking *** Aug 10 22:45:03.747179 n-d-850468-14 devstack@n-api.service[106657]: *** uWSGI is running in multiple interpreter mode *** Aug 10 22:45:03.747179 n-d-850468-14 devstack@n-api.service[106657]: spawned uWSGI master process (pid: 106657) Aug 10 22:45:03.747377 n-d-850468-14 systemd[1]: Started Devstack devstack@n-api.service. Aug 10 22:45:03.748754 n-d-850468-14 devstack@n-api.service[106657]: spawned uWSGI worker 1 (pid: 106658, cores: 1) Aug 10 22:45:03.748754 n-d-850468-14 devstack@n-api.service[106657]: spawned uWSGI worker 2 (pid: 106659, cores: 1) Aug 10 22:45:03.748754 n-d-850468-14 devstack@n-api.service[106657]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 10 22:45:04.416846 n-d-850468-14 devstack@n-api.service[106658]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 10 22:45:04.428678 n-d-850468-14 devstack@n-api.service[106659]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 10 22:45:05.503985 n-d-850468-14 devstack@n-api.service[106658]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 22:45:05.503985 n-d-850468-14 devstack@n-api.service[106658]: from cryptography.utils import int_from_bytes Aug 10 22:45:05.504579 n-d-850468-14 devstack@n-api.service[106658]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 22:45:05.504579 n-d-850468-14 devstack@n-api.service[106658]: from cryptography.utils import int_from_bytes Aug 10 22:45:05.508865 n-d-850468-14 devstack@n-api.service[106659]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 22:45:05.508865 n-d-850468-14 devstack@n-api.service[106659]: from cryptography.utils import int_from_bytes Aug 10 22:45:05.509321 n-d-850468-14 devstack@n-api.service[106659]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 22:45:05.509321 n-d-850468-14 devstack@n-api.service[106659]: from cryptography.utils import int_from_bytes Aug 10 22:45:08.018906 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 10 22:45:08.019561 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 10 22:45:08.019916 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 10 22:45:08.020020 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 10 22:45:08.020104 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 10 22:45:08.020192 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 10 22:45:08.020272 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 10 22:45:08.020358 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 10 22:45:08.020445 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 10 22:45:08.020532 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 10 22:45:08.020649 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.020794 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.020981 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.021083 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.021309 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.021400 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.021630 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.021724 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.021964 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.022059 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.022275 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.022366 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.022597 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.022681 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.022938 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.023027 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.023272 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.023358 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.023529 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.023614 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.023845 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.023930 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.024168 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-850468-14 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.024253 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-850468-14 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.024493 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.024594 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.024803 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.024887 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.025113 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.025209 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.025438 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.025545 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.025740 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.025839 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.026065 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.026646 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.026978 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.027103 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.027480 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.027817 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.027925 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.028196 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.028302 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.028517 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.028607 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.028837 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.028924 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.029153 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.029249 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.029642 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.029711 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.029870 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.029949 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.030107 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.030240 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.030401 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.030491 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.030717 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.030879 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.031064 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.031230 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-850468-14 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.031467 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-850468-14 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.031557 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.031790 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.031892 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.032108 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.032209 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.032431 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.032555 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.032853 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.032952 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.033172 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.033258 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.033486 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.033583 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.033810 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.033908 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.034124 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.034217 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.034437 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.034528 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.034760 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.034893 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.035106 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.035193 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.035428 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.035535 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.035734 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.035841 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.036046 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.036138 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.036356 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.036447 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.036669 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.036764 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.036975 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.037067 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.037285 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.037370 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.037538 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.037635 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.037829 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.037915 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.038151 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.038237 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.038471 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.038594 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.038814 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.038912 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.039068 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.039167 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.039347 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.039489 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.039613 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.039696 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.039926 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.040044 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.040248 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.040335 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.040559 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.040643 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.040870 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.040967 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.041440 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.041531 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.041753 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.042493 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.045121 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.045244 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.045401 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.045546 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.045634 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.045740 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.046758 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.046881 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.046979 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.046979 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.047174 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.047262 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.047353 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.047443 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.048837 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.048939 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.051274 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.051405 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.58 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.051653 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.58 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.051740 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.58 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.051819 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.58 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.051897 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.051975 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.052138 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.052221 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.052305 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.052385 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.052468 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.052547 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.052636 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.052716 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.052793 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.052873 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.052949 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.053026 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.053112 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.053191 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.053268 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.053344 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.053420 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.053505 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.053583 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.053668 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.053746 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.053823 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.053899 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.053992 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.054071 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.054155 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.054233 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.054309 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.054385 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.054471 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.054549 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.054626 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.054702 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.054797 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.054879 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.054971 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.055051 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.055127 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.055211 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.055290 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.055377 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.055464 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.055542 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.055619 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.055702 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.055786 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.055876 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.056012 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.056095 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.056172 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.056248 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.056324 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.056411 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.056496 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.056582 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.056667 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.056745 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.056832 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.056920 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.057005 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.057084 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.057168 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.057288 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.057374 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.057530 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.057619 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.057707 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.057795 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.057875 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.057952 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.058038 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.058124 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.058202 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.058279 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.058355 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.058432 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.058518 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.058518 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.058660 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.058737 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.058862 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.058952 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.059041 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.059130 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.059336 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.059424 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.059651 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.059737 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.059979 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.060067 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.060289 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.060376 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.060601 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.060695 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.060908 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.060994 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.061214 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.061350 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.061525 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.061620 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.061830 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.061915 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.062135 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.062219 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.062441 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.062538 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.062752 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.062906 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.063085 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.063192 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.063395 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.063495 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.063699 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.063786 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.064019 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.064103 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.064336 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.064450 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.064648 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.064803 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.064951 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.065059 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.065244 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.065339 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.065567 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:45:08.065661 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.065909 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.065994 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.066246 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.066345 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.066579 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.066665 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.066931 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.067035 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.067263 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.067387 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.067579 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.067666 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.067896 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.067991 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.068212 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.068297 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.068531 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.068623 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.068846 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.068941 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.069167 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.069260 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.069486 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.069573 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.069804 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.069897 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.070125 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.070300 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.070448 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.070536 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.070763 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.070926 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.071108 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.071203 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.071430 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.071565 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.071751 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.071846 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.072067 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.072154 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.072387 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.072479 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.072709 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.072797 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.073060 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.073203 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.073526 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.073684 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.073843 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.073945 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.074155 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.074243 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.074478 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.074565 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.074804 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.074907 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.075135 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.075235 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.075451 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.075589 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.075777 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.075915 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.076114 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.076249 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.076429 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.076547 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.076751 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.076887 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.077068 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.077204 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.077383 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.077520 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.077698 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.077830 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.078012 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.078146 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.078325 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.078462 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.078661 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.078776 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.079007 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.079116 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.079325 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.079455 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.079641 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.079775 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.079961 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.080092 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.080275 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.080405 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.080590 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.080724 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.080902 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.081037 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.081206 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.081357 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.081514 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.081671 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.081819 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.081976 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.082133 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.082284 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.082442 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.082593 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.082765 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.082932 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.083115 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.083239 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.083424 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.083563 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.083759 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.083891 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.084068 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.084200 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.084383 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.084535 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.084696 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.084844 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.085009 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.085158 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.085317 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.085472 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.085632 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.085785 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.085946 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.086091 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.086254 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.086404 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.086578 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.086719 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.086917 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.087052 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.087229 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.087380 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.087553 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.087694 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.087860 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.088002 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.088167 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.088326 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.088485 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.089152 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.089344 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.089579 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.089713 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.089902 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.090055 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.090223 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.090375 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.090542 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.090703 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.090896 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.091052 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.091187 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.091371 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.091517 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.091712 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.091842 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.092048 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.092160 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.092357 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.092498 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.092686 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.092833 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.093025 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.093143 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.093348 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.093474 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.093658 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.093807 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.093974 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.094131 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.094284 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.094442 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.094591 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.094760 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.094924 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.095093 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.095245 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.095405 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.095553 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.095714 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.095862 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.096030 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.096169 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.096340 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.096492 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.096651 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.096769 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.096960 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.097092 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.097270 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.097433 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.097581 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.097706 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.097909 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.097996 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.098225 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.098321 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.098536 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.098631 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.098872 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.098966 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.099184 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.099285 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.099534 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.099630 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.099844 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.099931 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.100190 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.100278 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.100506 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.100591 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.100826 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.100913 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.101140 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.101228 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.101454 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.101540 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.101770 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.101856 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.102084 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.102172 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.102399 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.102490 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.102710 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.102816 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.103050 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.103137 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.103375 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.103462 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.103692 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.103785 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.104005 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.104091 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.104402 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.105029 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.105369 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.105519 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.105695 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.105781 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.106040 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.106128 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.106380 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.106475 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.106709 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.106842 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.107063 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.107162 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.107383 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.107480 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.107704 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.107841 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.108021 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.108108 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.108337 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.108439 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.108655 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.108741 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.108970 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.109057 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.109290 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.109378 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.109609 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.109695 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.109923 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.110010 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.110236 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.110330 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.110552 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.110638 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.110889 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.110977 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.111206 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.111293 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.111521 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.111605 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.111845 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.111993 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.112172 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.112261 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.112483 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.112575 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.112801 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.112894 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.113122 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.113216 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.113453 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.113546 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.113766 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.113860 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.114084 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.114169 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.114399 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.114487 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.114708 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.114819 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.115045 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.115133 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.115360 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.115447 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.115672 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.115768 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.115981 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.116076 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.116292 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.116377 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.116608 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.116701 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.116923 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.117009 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.117233 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.117319 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.117537 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.117623 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.117848 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.117984 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.118158 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.118242 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.118466 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.118554 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.118775 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.118876 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.119111 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.119197 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.119432 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.119519 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.119740 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.119835 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.120101 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.120238 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.120421 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.120512 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.120811 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.120938 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.121122 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.121275 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.121454 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.121627 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.121773 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.121957 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.122082 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.122305 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.122394 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.122623 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.122709 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.122957 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.123046 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.123285 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.123373 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.123611 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.123705 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.123925 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.124021 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.124242 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.124336 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.124552 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.124637 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.124863 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.124962 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.125175 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.125261 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.125488 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.125573 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.125800 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.125895 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.126114 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.126200 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.126425 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.126521 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.126745 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.126958 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.127080 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.127175 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.127406 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.127493 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.127719 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.127883 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.128017 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.128109 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.128333 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.128422 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.128638 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.128727 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.128951 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.129045 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.129257 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.129342 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.129571 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.129834 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.129920 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.130171 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.130450 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.130537 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.130810 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.130900 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.131130 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.131215 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.131448 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.131545 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.131769 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.131856 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.132092 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.132189 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.132427 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.132526 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.132733 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.132829 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.133045 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.133131 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.133361 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.133460 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.133667 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.133761 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.133973 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.134059 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.134280 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.134366 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.134586 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.134671 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.134916 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.135006 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.135225 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.135322 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.136067 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.136169 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.136391 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.136538 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.136703 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.136869 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.137012 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.137149 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.137323 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.137467 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.137633 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.137774 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.137951 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.138092 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.138259 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.138408 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.138576 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.138734 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.138908 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.139077 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.139235 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.139388 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.139549 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.139705 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.139859 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.140020 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.140166 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.140367 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.140493 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.140681 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.140808 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.141020 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.141108 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.141352 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.141437 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.141697 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.141792 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.142009 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.142103 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.142319 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.142405 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.142647 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.142797 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.142985 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.143073 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.143295 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.143394 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.143602 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.143690 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.143916 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.144001 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.144229 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.144315 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.144535 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.144621 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.144838 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.144929 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.145154 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.145241 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.145464 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.145594 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.145774 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.145859 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.146087 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.146172 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.146391 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.146477 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.146694 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.146796 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.147023 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.147125 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.147342 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.147434 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.147650 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.147735 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.147953 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.148046 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.148259 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.148345 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.148570 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.148654 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.148875 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.148975 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.149179 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.149264 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.149491 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.149575 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.149796 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.149888 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.150101 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.150186 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.150410 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.150495 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.150715 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.150819 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.151050 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.151145 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.151432 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.152069 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.152269 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.152411 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.152598 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.152687 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.152916 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.153010 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.153228 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.153307 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.153537 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.153624 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.153856 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.153942 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.154164 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.154259 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.154471 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.154566 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.154802 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.154910 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.155124 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.155210 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.155443 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.155537 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.155750 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.155845 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.156052 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.156137 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.156358 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.156442 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.156664 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.156759 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.156965 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.157098 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.157269 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.157363 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.157570 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.157669 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.157875 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.157960 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.158175 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.158260 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.158480 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.158566 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.158800 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.158889 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.159109 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.159206 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.159433 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.159522 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.159737 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.159822 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.160041 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.160128 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.160344 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.160442 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.160646 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.160731 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.160989 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.161073 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.161300 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.161401 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.161650 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.161736 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.161957 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.162058 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.162276 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.162362 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.162591 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.162685 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.162933 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.163037 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.163248 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.163337 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.163553 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.163639 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.163858 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.163957 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.164176 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.164263 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.164488 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.164572 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.164795 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.164891 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.165101 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.165186 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.165408 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.165503 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.165724 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.165810 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.166039 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.166383 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.166621 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.166708 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.166999 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.167108 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.167324 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.167420 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.167654 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.167740 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.167963 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.168051 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.168280 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.168375 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.168597 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.168695 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.168910 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.169044 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.169223 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.169311 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.169537 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.169624 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.169851 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.169937 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.170162 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.170248 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.170475 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.170574 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.170827 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.170929 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.171120 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.171207 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.171437 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.171531 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.171748 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.171840 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.172056 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.172142 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.172361 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.172455 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.172684 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.172772 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.172990 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.173135 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.173302 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.173397 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.173703 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.173802 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.173922 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.174007 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.174231 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.174317 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.174536 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.174664 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.174997 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.175088 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.175317 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.175404 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.175625 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.175721 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.175930 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.176024 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.176242 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.176335 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.176561 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.176648 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.176876 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.176962 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.177183 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.177318 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.177547 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.177633 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.177902 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.177997 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.178216 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.178302 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.178529 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.178615 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.178861 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.178964 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.179171 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.179259 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.179486 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.179573 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.179798 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.179893 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.180107 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.180192 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.180412 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.180498 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.180719 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.180815 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.181042 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.181136 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.181347 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.181433 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.181669 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.181757 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.182044 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.182129 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.182439 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.182564 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.182818 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.182911 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.183152 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.183340 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.183545 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.183633 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.183863 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.183960 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.184179 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.184265 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.184506 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.184601 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.184832 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.184926 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.185157 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.185243 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.185462 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.185558 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.185776 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.185861 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.186086 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.186180 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.186415 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.186502 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.186726 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.186854 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.187071 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.187166 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.187379 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.187466 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.187690 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.187786 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.188017 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.188109 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.188334 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.188421 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.188648 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.188750 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.188975 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.189062 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.189372 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.189457 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.189687 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.189776 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.190006 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.190091 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.190330 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.190415 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.190642 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.190730 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.190977 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.191067 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.191293 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.191392 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.191602 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.191698 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.191909 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.191996 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.192233 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.192319 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.192538 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.192628 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.192851 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.192937 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.193160 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.193359 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.193458 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.193550 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.193768 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.193857 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.194073 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.194172 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.194377 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.194463 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.194689 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.194775 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.195020 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.195120 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.195346 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.195435 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.195663 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.195752 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.195985 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.196080 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.196294 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.196381 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.196604 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.196689 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.196919 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.197014 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.197226 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.197313 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.197532 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.197625 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.197835 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.197921 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.198771 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.199004 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.199096 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.199215 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.199418 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.199627 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.199829 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.199961 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.200166 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.200303 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.200483 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.200641 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.200823 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.200959 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.201159 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.201300 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.201486 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.201642 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.201811 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.201969 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.202142 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.202281 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.202455 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.202608 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.202763 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.202946 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.203104 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.203257 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.203416 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.203573 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.203728 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.203883 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.204037 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.204192 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.204359 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.204501 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.204666 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.204817 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.204974 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.205123 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.205282 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.205430 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.205608 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.205737 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.205917 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.206062 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.206241 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.206369 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.206555 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.206695 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.206888 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.207033 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.207197 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.207342 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.207504 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.207649 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.207849 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.207958 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.208159 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.208304 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.208491 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.208613 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.208809 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.208947 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.209136 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.209262 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.209458 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.209589 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.209781 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.209911 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.210103 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.210230 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.210424 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.210550 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.210744 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.210893 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.211091 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.211215 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.211411 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.211535 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.211726 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.211858 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.212048 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.212172 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.212367 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.212497 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.212690 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.212817 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.213142 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.213227 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.213540 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.213734 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.214043 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.214176 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.214376 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.214502 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.214698 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.214853 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.215043 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.215177 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.215363 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.215498 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.215681 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.215819 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.215999 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.216136 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.216314 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.216452 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.216632 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.216770 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.216964 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.217087 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.217290 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.217419 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.217619 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.217744 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.217962 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.218072 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.218287 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.218414 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.218606 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.218735 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.218953 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.219082 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.219274 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.219403 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.219633 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.219727 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.219954 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.220069 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.220266 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.220391 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.220636 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.221155 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.221247 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.221332 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.221402 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.221481 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.221559 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.221798 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.221894 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.222118 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.222213 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.222434 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.222522 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.222754 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.222926 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.223095 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.223189 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.223411 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.223498 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.223729 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.223893 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.224045 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.224140 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.224363 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.224450 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.224692 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.224787 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.225006 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.225092 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.225326 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.225414 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.225646 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.225742 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.225961 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.226172 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.226279 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.226493 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.226827 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.226921 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.227152 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.227238 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.227484 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.227578 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.227808 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.227900 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.228127 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.228215 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.228446 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.228544 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.228756 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.228855 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.229066 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.229161 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.229920 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.230028 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.230234 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.230354 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.230538 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.230624 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.230878 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.230985 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.231189 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.231285 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.231495 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.231588 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.231815 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.231910 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.232127 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.232214 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.232446 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.232665 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.232755 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.233020 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.233284 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.233371 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.233635 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.233730 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.233957 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.234046 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.234308 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.234401 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.234623 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.234717 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.234983 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.235075 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.235294 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.235381 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.235600 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.235686 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.235918 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.236008 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.236226 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.236311 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.236532 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.236618 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.236841 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.236929 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.237148 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.237234 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.237458 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.237554 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.237762 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.237848 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.238076 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.238170 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.238381 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.238476 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.238695 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.238800 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.239028 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.239116 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.239335 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.239434 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.239645 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.239750 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.239950 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.240138 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.240238 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.240328 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.240549 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.240638 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.240854 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.240941 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.241158 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.241246 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.241466 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.241599 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.241769 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.241857 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.242083 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.242172 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.242389 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.242474 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.242702 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.242873 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.243033 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.243121 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.243344 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.243428 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.243650 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.243745 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.243965 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.244054 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.244268 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.244357 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.244589 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.244684 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.244925 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.245080 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.245339 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.245432 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.245659 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.245760 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.245971 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.246059 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.246287 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.246374 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.246700 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.246834 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.246922 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.247002 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.248232 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.248347 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.248448 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.248543 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.250186 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.250311 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.250400 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.250481 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.250571 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.250653 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.250732 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.250834 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.250917 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.251968 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.252217 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.252305 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.252375 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.252461 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.252551 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.252632 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.252737 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.252820 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.252889 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.252966 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.253044 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.253130 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.253211 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.253297 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.253385 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.253454 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.253533 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.253533 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.253695 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.253781 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.253857 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.253930 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.253997 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.254084 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.254165 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.254242 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.254331 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.254412 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.254490 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.254649 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.254738 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.254847 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.254941 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.254941 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.255084 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.255259 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.255378 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.255594 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.255691 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.255916 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.256019 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.256239 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.256332 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.256555 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.256653 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.256874 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.256973 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.257188 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.257288 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.257495 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.257585 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.257804 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.257902 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.258115 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.258207 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.258434 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.258525 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.258748 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.258859 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.259097 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.259188 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.259407 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.259566 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.259833 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.259933 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.260153 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.260243 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.260989 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.261164 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.261472 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.261627 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.261789 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.261887 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.262116 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.262214 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.262446 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.262534 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.262763 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.262906 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.263105 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.263206 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.263420 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.263506 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.263756 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.263842 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.264088 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.264174 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.264418 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.264505 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.264731 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.264824 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.265041 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.265129 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.265351 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.265455 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.265655 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.265748 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.265971 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.266065 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.266280 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.266371 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.266589 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.266690 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.266917 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.267008 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.267224 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.267316 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.267530 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.267630 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.267834 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.267932 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.268137 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.268227 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.268441 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.268540 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.268746 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.268845 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.269096 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.269188 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.269352 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.269463 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.269657 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.269765 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.269962 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.270050 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.270266 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.270355 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.270572 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.270660 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.270900 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.271024 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.271216 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.271367 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.271522 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.271743 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.271831 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.272093 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.272191 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.272412 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.272506 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.272717 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.272807 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.273050 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.273147 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.273387 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.273483 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.273708 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.273794 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.274038 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.274179 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.274355 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.274488 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.274681 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.274881 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.275039 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.275217 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.275365 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.275546 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.275691 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.275873 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.276011 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.276856 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.276959 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.277189 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.277277 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.277531 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.277634 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.277857 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.277945 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.278175 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.278263 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.278501 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.278590 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.278837 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.278928 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.279157 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.279255 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.279472 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.279562 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.279802 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.279889 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.280111 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.280196 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.280433 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.280520 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.280755 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.280850 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.281075 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.281170 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.281391 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.281477 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.281707 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.281793 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.282020 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.282127 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.282343 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.282437 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.282664 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.282751 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.283005 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.283105 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.283318 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.283411 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.283629 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.283715 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.283949 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.284036 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.284264 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.284351 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.284577 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.284664 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.284889 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.284977 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.285206 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.285299 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.285527 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.285662 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.285853 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.285941 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.286169 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.286259 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.286496 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.286581 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.286841 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.286932 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.287180 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.287265 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.287500 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.287596 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.287845 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.287933 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.288175 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.288263 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.288495 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.288590 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.288814 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.288899 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.289119 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.289204 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.289365 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106659) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 10 22:45:08.289466 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:45:08.289666 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106658) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 10 22:45:08.445434 n-d-850468-14 devstack@n-api.service[106658]: INFO dbcounter [None req-011ca06f-9a3c-42a6-8e4b-46960a518ddf None None] Registered counter for database nova_api Aug 10 22:45:08.451385 n-d-850468-14 devstack@n-api.service[106659]: INFO dbcounter [None req-1f7da8ac-09e7-4daf-93c6-80a729a90703 None None] Registered counter for database nova_api Aug 10 22:45:08.467513 n-d-850468-14 devstack@n-api.service[106658]: DEBUG oslo_db.sqlalchemy.engines [None req-011ca06f-9a3c-42a6-8e4b-46960a518ddf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106658) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 22:45:08.471481 n-d-850468-14 devstack@n-api.service[106659]: DEBUG oslo_db.sqlalchemy.engines [None req-1f7da8ac-09e7-4daf-93c6-80a729a90703 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106659) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 22:45:08.474126 n-d-850468-14 devstack@n-api.service[106658]: DEBUG dbcounter [-] [106658] Writer thread running {{(pid=106658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 22:45:08.478097 n-d-850468-14 devstack@n-api.service[106659]: DEBUG dbcounter [-] [106659] Writer thread running {{(pid=106659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 22:45:08.532259 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.context [None req-011ca06f-9a3c-42a6-8e4b-46960a518ddf None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c9127db4-59f9-48ac-9ab2-b5d6690bb85f(cell1) {{(pid=106658) load_cells /opt/stack/nova/nova/context.py:464}} Aug 10 22:45:08.535687 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.context [None req-1f7da8ac-09e7-4daf-93c6-80a729a90703 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c9127db4-59f9-48ac-9ab2-b5d6690bb85f(cell1) {{(pid=106659) load_cells /opt/stack/nova/nova/context.py:464}} Aug 10 22:45:08.536101 n-d-850468-14 devstack@n-api.service[106658]: DEBUG oslo_concurrency.lockutils [None req-011ca06f-9a3c-42a6-8e4b-46960a518ddf None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:45:08.536578 n-d-850468-14 devstack@n-api.service[106658]: DEBUG oslo_concurrency.lockutils [None req-011ca06f-9a3c-42a6-8e4b-46960a518ddf None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:45:08.538163 n-d-850468-14 devstack@n-api.service[106658]: DEBUG oslo_concurrency.lockutils [None req-011ca06f-9a3c-42a6-8e4b-46960a518ddf None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:45:08.538929 n-d-850468-14 devstack@n-api.service[106658]: DEBUG oslo_concurrency.lockutils [None req-011ca06f-9a3c-42a6-8e4b-46960a518ddf None None] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:45:08.539386 n-d-850468-14 devstack@n-api.service[106658]: DEBUG oslo_concurrency.lockutils [None req-011ca06f-9a3c-42a6-8e4b-46960a518ddf None None] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:45:08.539540 n-d-850468-14 devstack@n-api.service[106659]: DEBUG oslo_concurrency.lockutils [None req-1f7da8ac-09e7-4daf-93c6-80a729a90703 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:45:08.540015 n-d-850468-14 devstack@n-api.service[106659]: DEBUG oslo_concurrency.lockutils [None req-1f7da8ac-09e7-4daf-93c6-80a729a90703 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:45:08.541685 n-d-850468-14 devstack@n-api.service[106658]: DEBUG oslo_concurrency.lockutils [None req-011ca06f-9a3c-42a6-8e4b-46960a518ddf None None] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:45:08.541876 n-d-850468-14 devstack@n-api.service[106659]: DEBUG oslo_concurrency.lockutils [None req-1f7da8ac-09e7-4daf-93c6-80a729a90703 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:45:08.542937 n-d-850468-14 devstack@n-api.service[106659]: DEBUG oslo_concurrency.lockutils [None req-1f7da8ac-09e7-4daf-93c6-80a729a90703 None None] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:45:08.543381 n-d-850468-14 devstack@n-api.service[106659]: DEBUG oslo_concurrency.lockutils [None req-1f7da8ac-09e7-4daf-93c6-80a729a90703 None None] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:45:08.543761 n-d-850468-14 devstack@n-api.service[106658]: INFO dbcounter [None req-011ca06f-9a3c-42a6-8e4b-46960a518ddf None None] Registered counter for database nova_cell0 Aug 10 22:45:08.546305 n-d-850468-14 devstack@n-api.service[106659]: DEBUG oslo_concurrency.lockutils [None req-1f7da8ac-09e7-4daf-93c6-80a729a90703 None None] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=106659) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:45:08.548605 n-d-850468-14 devstack@n-api.service[106659]: INFO dbcounter [None req-1f7da8ac-09e7-4daf-93c6-80a729a90703 None None] Registered counter for database nova_cell0 Aug 10 22:45:08.549674 n-d-850468-14 devstack@n-api.service[106658]: INFO dbcounter [None req-011ca06f-9a3c-42a6-8e4b-46960a518ddf None None] Registered counter for database nova_cell1 Aug 10 22:45:08.554149 n-d-850468-14 devstack@n-api.service[106659]: INFO dbcounter [None req-1f7da8ac-09e7-4daf-93c6-80a729a90703 None None] Registered counter for database nova_cell1 Aug 10 22:45:08.558265 n-d-850468-14 devstack@n-api.service[106658]: DEBUG oslo_db.sqlalchemy.engines [None req-011ca06f-9a3c-42a6-8e4b-46960a518ddf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106658) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 22:45:08.559742 n-d-850468-14 devstack@n-api.service[106658]: DEBUG oslo_db.sqlalchemy.engines [None req-011ca06f-9a3c-42a6-8e4b-46960a518ddf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106658) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 22:45:08.562210 n-d-850468-14 devstack@n-api.service[106659]: DEBUG oslo_db.sqlalchemy.engines [None req-1f7da8ac-09e7-4daf-93c6-80a729a90703 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106659) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 22:45:08.566700 n-d-850468-14 devstack@n-api.service[106658]: DEBUG dbcounter [-] [106658] Writer thread running {{(pid=106658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 22:45:08.566857 n-d-850468-14 devstack@n-api.service[106659]: DEBUG dbcounter [-] [106659] Writer thread running {{(pid=106659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 22:45:08.567499 n-d-850468-14 devstack@n-api.service[106659]: DEBUG oslo_db.sqlalchemy.engines [None req-1f7da8ac-09e7-4daf-93c6-80a729a90703 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106659) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 22:45:08.568212 n-d-850468-14 devstack@n-api.service[106658]: DEBUG dbcounter [-] [106658] Writer thread running {{(pid=106658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 22:45:08.715653 n-d-850468-14 devstack@n-api.service[106658]: INFO dbcounter [None req-011ca06f-9a3c-42a6-8e4b-46960a518ddf None None] Registered counter for database nova_cell0 Aug 10 22:45:08.721689 n-d-850468-14 devstack@n-api.service[106659]: DEBUG dbcounter [-] [106659] Writer thread running {{(pid=106659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 22:45:08.724803 n-d-850468-14 devstack@n-api.service[106658]: DEBUG oslo_db.sqlalchemy.engines [None req-011ca06f-9a3c-42a6-8e4b-46960a518ddf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106658) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 22:45:08.729137 n-d-850468-14 devstack@n-api.service[106658]: DEBUG dbcounter [-] [106658] Writer thread running {{(pid=106658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 22:45:08.730854 n-d-850468-14 devstack@n-api.service[106659]: INFO dbcounter [None req-1f7da8ac-09e7-4daf-93c6-80a729a90703 None None] Registered counter for database nova_cell0 Aug 10 22:45:08.739862 n-d-850468-14 devstack@n-api.service[106659]: DEBUG oslo_db.sqlalchemy.engines [None req-1f7da8ac-09e7-4daf-93c6-80a729a90703 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106659) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 22:45:08.744144 n-d-850468-14 devstack@n-api.service[106659]: DEBUG dbcounter [-] [106659] Writer thread running {{(pid=106659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 22:45:09.078436 n-d-850468-14 devstack@n-api.service[106658]: WARNING keystonemiddleware.auth_token [None req-011ca06f-9a3c-42a6-8e4b-46960a518ddf None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 10 22:45:09.085816 n-d-850468-14 devstack@n-api.service[106658]: WARNING keystonemiddleware.auth_token [None req-011ca06f-9a3c-42a6-8e4b-46960a518ddf None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 10 22:45:09.091741 n-d-850468-14 devstack@n-api.service[106659]: WARNING keystonemiddleware.auth_token [None req-1f7da8ac-09e7-4daf-93c6-80a729a90703 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 10 22:45:09.099062 n-d-850468-14 devstack@n-api.service[106659]: WARNING keystonemiddleware.auth_token [None req-1f7da8ac-09e7-4daf-93c6-80a729a90703 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 10 22:45:09.438848 n-d-850468-14 devstack@n-api.service[106658]: WARNING keystonemiddleware.auth_token [None req-011ca06f-9a3c-42a6-8e4b-46960a518ddf None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 10 22:45:09.444810 n-d-850468-14 devstack@n-api.service[106658]: WARNING keystonemiddleware.auth_token [None req-011ca06f-9a3c-42a6-8e4b-46960a518ddf None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 10 22:45:09.450523 n-d-850468-14 devstack@n-api.service[106658]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56242b4449c0 pid: 106658 (default app) Aug 10 22:45:09.452633 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi [None req-011ca06f-9a3c-42a6-8e4b-46960a518ddf None None] Calling method '>' {{(pid=106658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:45:09.453803 n-d-850468-14 devstack@n-api.service[106658]: INFO nova.api.openstack.requestlog [None req-011ca06f-9a3c-42a6-8e4b-46960a518ddf None None] 10.222.0.58 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001724 Aug 10 22:45:09.454215 n-d-850468-14 devstack@n-api.service[106658]: [pid: 106658|app: 0|req: 1/1] 10.222.0.58 () {50 vars in 788 bytes} [Wed Aug 10 22:45:09 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:45:09.455902 n-d-850468-14 devstack@n-api.service[106659]: WARNING keystonemiddleware.auth_token [None req-1f7da8ac-09e7-4daf-93c6-80a729a90703 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 10 22:45:09.462046 n-d-850468-14 devstack@n-api.service[106659]: WARNING keystonemiddleware.auth_token [None req-1f7da8ac-09e7-4daf-93c6-80a729a90703 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 10 22:45:09.468058 n-d-850468-14 devstack@n-api.service[106659]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56242b4449c0 pid: 106659 (default app) Aug 10 22:46:27.398922 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi [None req-011ca06f-9a3c-42a6-8e4b-46960a518ddf None None] Calling method '>' {{(pid=106658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:46:27.399937 n-d-850468-14 devstack@n-api.service[106658]: INFO nova.api.openstack.requestlog [None req-011ca06f-9a3c-42a6-8e4b-46960a518ddf None None] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Aug 10 22:46:27.400343 n-d-850468-14 devstack@n-api.service[106658]: [pid: 106658|app: 0|req: 2/2] 10.222.0.58 () {54 vars in 931 bytes} [Wed Aug 10 22:46:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:46:27.419519 n-d-850468-14 devstack@n-api.service[106659]: DEBUG dbcounter [-] [106659] Writing DB stats nova_api:SELECT=3 {{(pid=106659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:46:27.421273 n-d-850468-14 devstack@n-api.service[106659]: DEBUG dbcounter [-] [106659] Writing DB stats nova_cell0:SELECT=3 {{(pid=106659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:46:27.422302 n-d-850468-14 devstack@n-api.service[106659]: DEBUG dbcounter [-] [106659] Writing DB stats nova_cell1:SELECT=3 {{(pid=106659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:46:27.423181 n-d-850468-14 devstack@n-api.service[106659]: DEBUG dbcounter [-] [106659] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:46:28.332723 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi [None req-81c93864-dd5c-438e-9808-2458fbaf3b42 admin admin] Calling method '>' {{(pid=106659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:46:28.366687 n-d-850468-14 devstack@n-api.service[106659]: INFO nova.api.openstack.requestlog [None req-81c93864-dd5c-438e-9808-2458fbaf3b42 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.958834 Aug 10 22:46:28.367476 n-d-850468-14 devstack@n-api.service[106659]: [pid: 106659|app: 0|req: 1/3] 10.222.0.58 () {60 vars in 1292 bytes} [Wed Aug 10 22:46:27 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:46:30.697747 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi [None req-011ca06f-9a3c-42a6-8e4b-46960a518ddf None None] Calling method '>' {{(pid=106658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:46:30.698817 n-d-850468-14 devstack@n-api.service[106658]: INFO nova.api.openstack.requestlog [None req-011ca06f-9a3c-42a6-8e4b-46960a518ddf None None] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001419 Aug 10 22:46:30.700016 n-d-850468-14 devstack@n-api.service[106658]: [pid: 106658|app: 0|req: 3/4] 10.222.0.58 () {54 vars in 931 bytes} [Wed Aug 10 22:46:30 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:46:31.191693 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi [None req-5c797a58-9f61-46f3-9257-4b33cce7806d admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "os-flavor-access:is_public": true, "id": "c1", "vcpus": 1, "name": "cirros256", "ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0}} {{(pid=106659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:46:31.212956 n-d-850468-14 devstack@n-api.service[106659]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:46:31.212956 n-d-850468-14 devstack@n-api.service[106659]: warnings.warn(msg) Aug 10 22:46:31.242466 n-d-850468-14 devstack@n-api.service[106659]: INFO nova.api.openstack.requestlog [None req-5c797a58-9f61-46f3-9257-4b33cce7806d admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.536498 Aug 10 22:46:31.243409 n-d-850468-14 devstack@n-api.service[106659]: [pid: 106659|app: 0|req: 2/5] 10.222.0.58 () {64 vars in 1283 bytes} [Wed Aug 10 22:46:30 2022] POST /compute/v2.1/flavors => generated 407 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 22:46:31.257413 n-d-850468-14 devstack@n-api.service[106658]: DEBUG dbcounter [-] [106658] Writing DB stats nova_api:SELECT=3 {{(pid=106658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:46:31.258651 n-d-850468-14 devstack@n-api.service[106658]: DEBUG dbcounter [-] [106658] Writing DB stats nova_cell0:SELECT=3 {{(pid=106658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:46:31.259777 n-d-850468-14 devstack@n-api.service[106658]: DEBUG dbcounter [-] [106658] Writing DB stats nova_cell1:SELECT=3 {{(pid=106658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:46:31.260790 n-d-850468-14 devstack@n-api.service[106658]: DEBUG dbcounter [-] [106658] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:46:31.468382 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi [None req-939dd108-5b9e-47bd-8414-ed55ff1adff7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:46:31.472880 n-d-850468-14 devstack@n-api.service[106658]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:46:31.472880 n-d-850468-14 devstack@n-api.service[106658]: warnings.warn(msg) Aug 10 22:46:31.544786 n-d-850468-14 devstack@n-api.service[106658]: INFO nova.api.openstack.requestlog [None req-939dd108-5b9e-47bd-8414-ed55ff1adff7 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.293076 Aug 10 22:46:31.554873 n-d-850468-14 devstack@n-api.service[106658]: [pid: 106658|app: 0|req: 4/6] 10.222.0.58 () {64 vars in 1336 bytes} [Wed Aug 10 22:46:31 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:46:33.873083 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi [None req-5c797a58-9f61-46f3-9257-4b33cce7806d admin admin] Calling method '>' {{(pid=106659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:46:33.874094 n-d-850468-14 devstack@n-api.service[106659]: INFO nova.api.openstack.requestlog [None req-5c797a58-9f61-46f3-9257-4b33cce7806d admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 Aug 10 22:46:33.874491 n-d-850468-14 devstack@n-api.service[106659]: [pid: 106659|app: 0|req: 3/7] 10.222.0.58 () {54 vars in 931 bytes} [Wed Aug 10 22:46:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:46:34.642276 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi [None req-ac55df0d-733c-4a73-a807-9215aee6437b admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "ram": 512, "vcpus": 1, "name": "ds512M", "os-flavor-access:is_public": true, "disk": 5, "rxtx_factor": 1.0, "id": "d1", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=106658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:46:34.661186 n-d-850468-14 devstack@n-api.service[106658]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:46:34.661186 n-d-850468-14 devstack@n-api.service[106658]: warnings.warn(msg) Aug 10 22:46:34.682254 n-d-850468-14 devstack@n-api.service[106658]: INFO nova.api.openstack.requestlog [None req-ac55df0d-733c-4a73-a807-9215aee6437b admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.799798 Aug 10 22:46:34.690847 n-d-850468-14 devstack@n-api.service[106658]: [pid: 106658|app: 0|req: 5/8] 10.222.0.58 () {64 vars in 1283 bytes} [Wed Aug 10 22:46:33 2022] POST /compute/v2.1/flavors => generated 404 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 22:46:34.706071 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi [None req-25ff3780-f799-4e24-9e89-ce3f5dc7abbe admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:46:34.708936 n-d-850468-14 devstack@n-api.service[106659]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:46:34.708936 n-d-850468-14 devstack@n-api.service[106659]: warnings.warn(msg) Aug 10 22:46:34.744961 n-d-850468-14 devstack@n-api.service[106659]: INFO nova.api.openstack.requestlog [None req-25ff3780-f799-4e24-9e89-ce3f5dc7abbe admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.045720 Aug 10 22:46:34.745982 n-d-850468-14 devstack@n-api.service[106659]: [pid: 106659|app: 0|req: 4/9] 10.222.0.58 () {64 vars in 1336 bytes} [Wed Aug 10 22:46:34 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:46:37.239524 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi [None req-ac55df0d-733c-4a73-a807-9215aee6437b admin admin] Calling method '>' {{(pid=106658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:46:37.240550 n-d-850468-14 devstack@n-api.service[106658]: INFO nova.api.openstack.requestlog [None req-ac55df0d-733c-4a73-a807-9215aee6437b admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001509 Aug 10 22:46:37.241003 n-d-850468-14 devstack@n-api.service[106658]: [pid: 106658|app: 0|req: 6/10] 10.222.0.58 () {54 vars in 931 bytes} [Wed Aug 10 22:46:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:46:37.844809 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi [None req-8aed47f9-e0d4-4bd8-8d91-e5adbde49236 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 1, "ram": 1024, "name": "ds1G", "disk": 10, "os-flavor-access:is_public": true, "swap": 0}} {{(pid=106659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:46:37.869870 n-d-850468-14 devstack@n-api.service[106659]: INFO nova.api.openstack.requestlog [None req-8aed47f9-e0d4-4bd8-8d91-e5adbde49236 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.622635 Aug 10 22:46:37.871150 n-d-850468-14 devstack@n-api.service[106659]: [pid: 106659|app: 0|req: 5/11] 10.222.0.58 () {64 vars in 1283 bytes} [Wed Aug 10 22:46:37 2022] POST /compute/v2.1/flavors => generated 404 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 22:46:37.883073 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi [None req-89e4b1bc-4d03-4e59-9c0e-db3f6899e0eb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:46:37.911053 n-d-850468-14 devstack@n-api.service[106658]: INFO nova.api.openstack.requestlog [None req-89e4b1bc-4d03-4e59-9c0e-db3f6899e0eb admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031908 Aug 10 22:46:37.919388 n-d-850468-14 devstack@n-api.service[106658]: [pid: 106658|app: 0|req: 7/12] 10.222.0.58 () {64 vars in 1336 bytes} [Wed Aug 10 22:46:37 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:46:40.337468 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi [None req-8aed47f9-e0d4-4bd8-8d91-e5adbde49236 admin admin] Calling method '>' {{(pid=106659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:46:40.338486 n-d-850468-14 devstack@n-api.service[106659]: INFO nova.api.openstack.requestlog [None req-8aed47f9-e0d4-4bd8-8d91-e5adbde49236 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Aug 10 22:46:40.343452 n-d-850468-14 devstack@n-api.service[106659]: [pid: 106659|app: 0|req: 6/13] 10.222.0.58 () {54 vars in 931 bytes} [Wed Aug 10 22:46:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:46:40.763560 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi [None req-5ecd033a-fb16-4c95-90cd-1e78708adc0c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "os-flavor-access:is_public": true, "ram": 2048, "vcpus": 2, "swap": 0, "id": "d3", "disk": 10, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=106658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:46:40.787451 n-d-850468-14 devstack@n-api.service[106658]: INFO nova.api.openstack.requestlog [None req-5ecd033a-fb16-4c95-90cd-1e78708adc0c admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.441636 Aug 10 22:46:40.789171 n-d-850468-14 devstack@n-api.service[106658]: [pid: 106658|app: 0|req: 8/14] 10.222.0.58 () {64 vars in 1283 bytes} [Wed Aug 10 22:46:40 2022] POST /compute/v2.1/flavors => generated 404 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 22:46:40.801419 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi [None req-436fd23f-1e50-4f31-81ed-4f73e54c2716 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:46:40.827411 n-d-850468-14 devstack@n-api.service[106659]: INFO nova.api.openstack.requestlog [None req-436fd23f-1e50-4f31-81ed-4f73e54c2716 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029624 Aug 10 22:46:40.830218 n-d-850468-14 devstack@n-api.service[106659]: [pid: 106659|app: 0|req: 7/15] 10.222.0.58 () {64 vars in 1336 bytes} [Wed Aug 10 22:46:40 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:46:43.138769 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi [None req-5ecd033a-fb16-4c95-90cd-1e78708adc0c admin admin] Calling method '>' {{(pid=106658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:46:43.139747 n-d-850468-14 devstack@n-api.service[106658]: INFO nova.api.openstack.requestlog [None req-5ecd033a-fb16-4c95-90cd-1e78708adc0c admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001521 Aug 10 22:46:43.140141 n-d-850468-14 devstack@n-api.service[106658]: [pid: 106658|app: 0|req: 9/16] 10.222.0.58 () {54 vars in 931 bytes} [Wed Aug 10 22:46:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:46:43.664961 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi [None req-90140eb3-3f8b-49b3-a7ee-d7af3b4ceeca admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "id": "d4", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "name": "ds4G", "vcpus": 4, "rxtx_factor": 1.0, "ram": 4096}} {{(pid=106659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:46:43.685221 n-d-850468-14 devstack@n-api.service[106659]: INFO nova.api.openstack.requestlog [None req-90140eb3-3f8b-49b3-a7ee-d7af3b4ceeca admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.538936 Aug 10 22:46:43.692827 n-d-850468-14 devstack@n-api.service[106659]: [pid: 106659|app: 0|req: 8/17] 10.222.0.58 () {64 vars in 1283 bytes} [Wed Aug 10 22:46:43 2022] POST /compute/v2.1/flavors => generated 404 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 22:46:43.698775 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi [None req-122236de-ef55-499d-bb2a-ef499ad54b65 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:46:43.723383 n-d-850468-14 devstack@n-api.service[106658]: INFO nova.api.openstack.requestlog [None req-122236de-ef55-499d-bb2a-ef499ad54b65 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029122 Aug 10 22:46:43.723970 n-d-850468-14 devstack@n-api.service[106658]: [pid: 106658|app: 0|req: 10/18] 10.222.0.58 () {64 vars in 1336 bytes} [Wed Aug 10 22:46:43 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:46:46.065869 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi [None req-90140eb3-3f8b-49b3-a7ee-d7af3b4ceeca admin admin] Calling method '>' {{(pid=106659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:46:46.067544 n-d-850468-14 devstack@n-api.service[106659]: INFO nova.api.openstack.requestlog [None req-90140eb3-3f8b-49b3-a7ee-d7af3b4ceeca admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002162 Aug 10 22:46:46.067942 n-d-850468-14 devstack@n-api.service[106659]: [pid: 106659|app: 0|req: 9/19] 10.222.0.58 () {54 vars in 931 bytes} [Wed Aug 10 22:46:46 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:46:46.610914 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi [None req-0ad73a7c-31c4-41e9-9e89-5f453d83e45c admin admin] Calling method '>' {{(pid=106658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:46:46.645420 n-d-850468-14 devstack@n-api.service[106658]: INFO nova.api.openstack.requestlog [None req-0ad73a7c-31c4-41e9-9e89-5f453d83e45c admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.570159 Aug 10 22:46:46.661443 n-d-850468-14 devstack@n-api.service[106658]: [pid: 106658|app: 0|req: 11/20] 10.222.0.58 () {60 vars in 1292 bytes} [Wed Aug 10 22:46:46 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:46:48.960379 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi [None req-90140eb3-3f8b-49b3-a7ee-d7af3b4ceeca admin admin] Calling method '>' {{(pid=106659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:46:48.962711 n-d-850468-14 devstack@n-api.service[106659]: INFO nova.api.openstack.requestlog [None req-90140eb3-3f8b-49b3-a7ee-d7af3b4ceeca admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001602 Aug 10 22:46:48.962711 n-d-850468-14 devstack@n-api.service[106659]: [pid: 106659|app: 0|req: 10/21] 10.222.0.58 () {54 vars in 931 bytes} [Wed Aug 10 22:46:48 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 22:46:49.402058 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi [None req-5ff5aafa-f63d-4d75-a9ee-b6adf20274b6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "disk": 1, "name": "m1.tiny", "rxtx_factor": 1.0, "id": "1", "os-flavor-access:is_public": true, "ram": 512, "swap": 0}} {{(pid=106658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:46:49.422346 n-d-850468-14 devstack@n-api.service[106658]: INFO nova.api.openstack.requestlog [None req-5ff5aafa-f63d-4d75-a9ee-b6adf20274b6 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.450112 Aug 10 22:46:49.422937 n-d-850468-14 devstack@n-api.service[106658]: [pid: 106658|app: 0|req: 12/22] 10.222.0.58 () {64 vars in 1283 bytes} [Wed Aug 10 22:46:48 2022] POST /compute/v2.1/flavors => generated 402 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 22:46:49.435736 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi [None req-116129da-73ce-4b67-9f5c-51d2ab610b59 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:46:49.461592 n-d-850468-14 devstack@n-api.service[106659]: INFO nova.api.openstack.requestlog [None req-116129da-73ce-4b67-9f5c-51d2ab610b59 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029075 Aug 10 22:46:49.462218 n-d-850468-14 devstack@n-api.service[106659]: [pid: 106659|app: 0|req: 11/23] 10.222.0.58 () {64 vars in 1333 bytes} [Wed Aug 10 22:46:49 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:46:51.911422 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi [None req-5ff5aafa-f63d-4d75-a9ee-b6adf20274b6 admin admin] Calling method '>' {{(pid=106658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:46:51.912438 n-d-850468-14 devstack@n-api.service[106658]: INFO nova.api.openstack.requestlog [None req-5ff5aafa-f63d-4d75-a9ee-b6adf20274b6 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001497 Aug 10 22:46:51.912840 n-d-850468-14 devstack@n-api.service[106658]: [pid: 106658|app: 0|req: 13/24] 10.222.0.58 () {54 vars in 931 bytes} [Wed Aug 10 22:46:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 22:46:52.375887 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi [None req-975d3a21-4c2d-4911-8ebc-c93c0c3156de admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "ram": 2048, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "rxtx_factor": 1.0, "id": "2", "os-flavor-access:is_public": true, "name": "m1.small"}} {{(pid=106659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:46:52.395559 n-d-850468-14 devstack@n-api.service[106659]: INFO nova.api.openstack.requestlog [None req-975d3a21-4c2d-4911-8ebc-c93c0c3156de admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.475284 Aug 10 22:46:52.396122 n-d-850468-14 devstack@n-api.service[106659]: [pid: 106659|app: 0|req: 12/25] 10.222.0.58 () {64 vars in 1283 bytes} [Wed Aug 10 22:46:51 2022] POST /compute/v2.1/flavors => generated 405 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 22:46:52.409976 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi [None req-af9b814a-e884-4094-ab70-ea17900eaa1d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:46:52.442589 n-d-850468-14 devstack@n-api.service[106658]: INFO nova.api.openstack.requestlog [None req-af9b814a-e884-4094-ab70-ea17900eaa1d admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037557 Aug 10 22:46:52.443466 n-d-850468-14 devstack@n-api.service[106658]: [pid: 106658|app: 0|req: 14/26] 10.222.0.58 () {64 vars in 1333 bytes} [Wed Aug 10 22:46:52 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:46:54.958176 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi [None req-975d3a21-4c2d-4911-8ebc-c93c0c3156de admin admin] Calling method '>' {{(pid=106659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:46:54.959224 n-d-850468-14 devstack@n-api.service[106659]: INFO nova.api.openstack.requestlog [None req-975d3a21-4c2d-4911-8ebc-c93c0c3156de admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Aug 10 22:46:54.960013 n-d-850468-14 devstack@n-api.service[106659]: [pid: 106659|app: 0|req: 13/27] 10.222.0.58 () {54 vars in 931 bytes} [Wed Aug 10 22:46:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:46:55.359783 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi [None req-39f6bb32-ecf5-4a80-a93b-7c8d0a0a47d9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "ram": 4096, "vcpus": 2, "rxtx_factor": 1.0, "name": "m1.medium", "id": "3", "disk": 40, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=106658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:46:55.379614 n-d-850468-14 devstack@n-api.service[106658]: INFO nova.api.openstack.requestlog [None req-39f6bb32-ecf5-4a80-a93b-7c8d0a0a47d9 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.412688 Aug 10 22:46:55.380183 n-d-850468-14 devstack@n-api.service[106658]: [pid: 106658|app: 0|req: 15/28] 10.222.0.58 () {64 vars in 1283 bytes} [Wed Aug 10 22:46:54 2022] POST /compute/v2.1/flavors => generated 406 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 22:46:55.392538 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi [None req-3e936906-8c3c-4762-8558-b8960cedc32b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:46:55.418341 n-d-850468-14 devstack@n-api.service[106659]: INFO nova.api.openstack.requestlog [None req-3e936906-8c3c-4762-8558-b8960cedc32b admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029292 Aug 10 22:46:55.418922 n-d-850468-14 devstack@n-api.service[106659]: [pid: 106659|app: 0|req: 14/29] 10.222.0.58 () {64 vars in 1333 bytes} [Wed Aug 10 22:46:55 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:46:57.728650 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi [None req-39f6bb32-ecf5-4a80-a93b-7c8d0a0a47d9 admin admin] Calling method '>' {{(pid=106658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:46:57.729232 n-d-850468-14 devstack@n-api.service[106658]: INFO nova.api.openstack.requestlog [None req-39f6bb32-ecf5-4a80-a93b-7c8d0a0a47d9 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002175 Aug 10 22:46:57.729632 n-d-850468-14 devstack@n-api.service[106658]: [pid: 106658|app: 0|req: 16/30] 10.222.0.58 () {54 vars in 931 bytes} [Wed Aug 10 22:46:57 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:46:58.159634 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi [None req-e3e5b379-120e-48bc-b424-017982fded07 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.large", "swap": 0, "id": "4", "ram": 8192, "disk": 80, "vcpus": 4, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:46:58.165877 n-d-850468-14 devstack@n-api.service[106659]: DEBUG dbcounter [-] [106659] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=106659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:46:58.181970 n-d-850468-14 devstack@n-api.service[106659]: INFO nova.api.openstack.requestlog [None req-e3e5b379-120e-48bc-b424-017982fded07 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.445606 Aug 10 22:46:58.182636 n-d-850468-14 devstack@n-api.service[106659]: [pid: 106659|app: 0|req: 15/31] 10.222.0.58 () {64 vars in 1283 bytes} [Wed Aug 10 22:46:57 2022] POST /compute/v2.1/flavors => generated 405 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 22:46:58.194967 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi [None req-61144b97-40c6-464d-92cb-1b8251b6e38c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:46:58.223874 n-d-850468-14 devstack@n-api.service[106658]: INFO nova.api.openstack.requestlog [None req-61144b97-40c6-464d-92cb-1b8251b6e38c admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032814 Aug 10 22:46:58.224463 n-d-850468-14 devstack@n-api.service[106658]: [pid: 106658|app: 0|req: 17/32] 10.222.0.58 () {64 vars in 1333 bytes} [Wed Aug 10 22:46:58 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:47:00.490193 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi [None req-e3e5b379-120e-48bc-b424-017982fded07 admin admin] Calling method '>' {{(pid=106659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:47:00.491239 n-d-850468-14 devstack@n-api.service[106659]: INFO nova.api.openstack.requestlog [None req-e3e5b379-120e-48bc-b424-017982fded07 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001489 Aug 10 22:47:00.491642 n-d-850468-14 devstack@n-api.service[106659]: [pid: 106659|app: 0|req: 16/33] 10.222.0.58 () {54 vars in 931 bytes} [Wed Aug 10 22:47:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:47:00.964798 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi [None req-9c7b1b07-97c1-4637-ac81-b6b61a523393 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 160, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 8, "swap": 0, "ram": 16384, "id": "5", "name": "m1.xlarge", "os-flavor-access:is_public": true}} {{(pid=106658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:47:00.985879 n-d-850468-14 devstack@n-api.service[106658]: INFO nova.api.openstack.requestlog [None req-9c7b1b07-97c1-4637-ac81-b6b61a523393 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.487589 Aug 10 22:47:00.986502 n-d-850468-14 devstack@n-api.service[106658]: [pid: 106658|app: 0|req: 18/34] 10.222.0.58 () {64 vars in 1283 bytes} [Wed Aug 10 22:47:00 2022] POST /compute/v2.1/flavors => generated 408 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 22:47:01.003319 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi [None req-f7c34920-34ae-41f5-8363-821e74394424 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:47:01.030838 n-d-850468-14 devstack@n-api.service[106659]: INFO nova.api.openstack.requestlog [None req-f7c34920-34ae-41f5-8363-821e74394424 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031005 Aug 10 22:47:01.046810 n-d-850468-14 devstack@n-api.service[106659]: [pid: 106659|app: 0|req: 17/35] 10.222.0.58 () {64 vars in 1333 bytes} [Wed Aug 10 22:47:00 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:47:25.259813 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi [None req-9c7b1b07-97c1-4637-ac81-b6b61a523393 admin admin] Calling method '>' {{(pid=106658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:47:25.260955 n-d-850468-14 devstack@n-api.service[106658]: INFO nova.api.openstack.requestlog [None req-9c7b1b07-97c1-4637-ac81-b6b61a523393 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001594 Aug 10 22:47:25.261346 n-d-850468-14 devstack@n-api.service[106658]: [pid: 106658|app: 0|req: 19/36] 10.222.0.58 () {54 vars in 931 bytes} [Wed Aug 10 22:47:25 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:47:25.271980 n-d-850468-14 devstack@n-api.service[106659]: DEBUG dbcounter [-] [106659] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=106659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:47:25.668251 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi [None req-8486bbf4-b682-4e2e-bb38-01e40646ea2f admin admin] Calling method '>' {{(pid=106659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:47:25.687733 n-d-850468-14 devstack@n-api.service[106659]: INFO nova.api.openstack.requestlog [None req-8486bbf4-b682-4e2e-bb38-01e40646ea2f admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.420068 Aug 10 22:47:25.688207 n-d-850468-14 devstack@n-api.service[106659]: [pid: 106659|app: 0|req: 18/37] 10.222.0.58 () {60 vars in 1292 bytes} [Wed Aug 10 22:47:25 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:47:26.774882 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi [None req-9c7b1b07-97c1-4637-ac81-b6b61a523393 admin admin] Calling method '>' {{(pid=106658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:47:26.776427 n-d-850468-14 devstack@n-api.service[106658]: INFO nova.api.openstack.requestlog [None req-9c7b1b07-97c1-4637-ac81-b6b61a523393 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Aug 10 22:47:26.776976 n-d-850468-14 devstack@n-api.service[106658]: [pid: 106658|app: 0|req: 20/38] 10.222.0.58 () {56 vars in 1074 bytes} [Wed Aug 10 22:47:26 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:47:27.330077 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi [None req-4c0017a3-962a-4fd1-992a-527aa9e02c13 admin admin] Calling method '>' {{(pid=106659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:47:27.336383 n-d-850468-14 devstack@n-api.service[106659]: INFO nova.api.openstack.wsgi [None req-4c0017a3-962a-4fd1-992a-527aa9e02c13 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 10 22:47:27.340006 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi [None req-4c0017a3-962a-4fd1-992a-527aa9e02c13 admin admin] Request method failure captured: Aug 10 22:47:27.340006 n-d-850468-14 devstack@n-api.service[106659]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 10 22:47:27.340006 n-d-850468-14 devstack@n-api.service[106659]: Accept: application/json Aug 10 22:47:27.340006 n-d-850468-14 devstack@n-api.service[106659]: Accept-Encoding: gzip, deflate Aug 10 22:47:27.340006 n-d-850468-14 devstack@n-api.service[106659]: Connection: keep-alive Aug 10 22:47:27.340006 n-d-850468-14 devstack@n-api.service[106659]: Content-Length: 0 Aug 10 22:47:27.340006 n-d-850468-14 devstack@n-api.service[106659]: Host: 10.222.0.58 Aug 10 22:47:27.340006 n-d-850468-14 devstack@n-api.service[106659]: Openstack-Api-Version: compute 2.90 Aug 10 22:47:27.340006 n-d-850468-14 devstack@n-api.service[106659]: Openstack-System-Scope: None Aug 10 22:47:27.340006 n-d-850468-14 devstack@n-api.service[106659]: User-Agent: python-novaclient Aug 10 22:47:27.340006 n-d-850468-14 devstack@n-api.service[106659]: X-Auth-Token: gAAAAABi9DV-MYJxCGo9lyc3bLFJaS3PcGu87CQuk7xVrpef5FWy7-AOiJZeo9j66fZMIn3JrRqtrL5pT-bn8yDXedQzGLVCdAcZ-AUhlw8E4urBCTjhwMFe9k4jK8kIe6tW4Rnx1LAjOlk-LlkpXkeh5Lk5HEbPGV_LgcqAcqzo6fpFFcWGu1I Aug 10 22:47:27.340006 n-d-850468-14 devstack@n-api.service[106659]: X-Domain-Id: None Aug 10 22:47:27.340006 n-d-850468-14 devstack@n-api.service[106659]: X-Domain-Name: None Aug 10 22:47:27.340006 n-d-850468-14 devstack@n-api.service[106659]: X-Identity-Status: Confirmed Aug 10 22:47:27.340006 n-d-850468-14 devstack@n-api.service[106659]: X-Is-Admin-Project: True Aug 10 22:47:27.340006 n-d-850468-14 devstack@n-api.service[106659]: X-Openstack-Nova-Api-Version: 2.90 Aug 10 22:47:27.340006 n-d-850468-14 devstack@n-api.service[106659]: X-Project-Domain-Id: default Aug 10 22:47:27.340006 n-d-850468-14 devstack@n-api.service[106659]: X-Project-Domain-Name: Default Aug 10 22:47:27.340006 n-d-850468-14 devstack@n-api.service[106659]: X-Project-Id: e8acc9bb8b864134a30aa7c461e1ca6a Aug 10 22:47:27.340006 n-d-850468-14 devstack@n-api.service[106659]: X-Project-Name: admin Aug 10 22:47:27.340006 n-d-850468-14 devstack@n-api.service[106659]: X-Role: admin,member,reader Aug 10 22:47:27.340006 n-d-850468-14 devstack@n-api.service[106659]: X-Roles: admin,member,reader Aug 10 22:47:27.341570 n-d-850468-14 devstack@n-api.service[106659]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e8acc9bb8b864134a30aa7c461e1ca6a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e8acc9bb8b864134a30aa7c461e1ca6a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/e8acc9bb8b864134a30aa7c461e1ca6a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_e8acc9bb8b864134a30aa7c461e1ca6a", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 22:47:27.341570 n-d-850468-14 devstack@n-api.service[106659]: X-Tenant: admin Aug 10 22:47:27.341570 n-d-850468-14 devstack@n-api.service[106659]: X-Tenant-Id: e8acc9bb8b864134a30aa7c461e1ca6a Aug 10 22:47:27.341570 n-d-850468-14 devstack@n-api.service[106659]: X-Tenant-Name: admin Aug 10 22:47:27.341570 n-d-850468-14 devstack@n-api.service[106659]: X-User: admin Aug 10 22:47:27.341570 n-d-850468-14 devstack@n-api.service[106659]: X-User-Domain-Id: default Aug 10 22:47:27.341570 n-d-850468-14 devstack@n-api.service[106659]: X-User-Domain-Name: Default Aug 10 22:47:27.341570 n-d-850468-14 devstack@n-api.service[106659]: X-User-Id: 9660d2d67a7e4daeafa7c00b8c9f29dc Aug 10 22:47:27.341570 n-d-850468-14 devstack@n-api.service[106659]: X-User-Name: admin Aug 10 22:47:27.341570 n-d-850468-14 devstack@n-api.service[106659]: method: > Aug 10 22:47:27.341570 n-d-850468-14 devstack@n-api.service[106659]: exception: Flavor 42 could not be found. Aug 10 22:47:27.341570 n-d-850468-14 devstack@n-api.service[106659]: action_args: {'id': '42'} Aug 10 22:47:27.341570 n-d-850468-14 devstack@n-api.service[106659]: {{(pid=106659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 22:47:27.341570 n-d-850468-14 devstack@n-api.service[106659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:47:27.342450 n-d-850468-14 devstack@n-api.service[106659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 10 22:47:27.342450 n-d-850468-14 devstack@n-api.service[106659]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 10 22:47:27.342450 n-d-850468-14 devstack@n-api.service[106659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 10 22:47:27.342450 n-d-850468-14 devstack@n-api.service[106659]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 10 22:47:27.342450 n-d-850468-14 devstack@n-api.service[106659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 10 22:47:27.342450 n-d-850468-14 devstack@n-api.service[106659]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 10 22:47:27.342450 n-d-850468-14 devstack@n-api.service[106659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 10 22:47:27.342450 n-d-850468-14 devstack@n-api.service[106659]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 10 22:47:27.342450 n-d-850468-14 devstack@n-api.service[106659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 10 22:47:27.342450 n-d-850468-14 devstack@n-api.service[106659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 22:47:27.342450 n-d-850468-14 devstack@n-api.service[106659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 10 22:47:27.342450 n-d-850468-14 devstack@n-api.service[106659]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 10 22:47:27.342450 n-d-850468-14 devstack@n-api.service[106659]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 10 22:47:27.342450 n-d-850468-14 devstack@n-api.service[106659]: ERROR nova.api.openstack.wsgi Aug 10 22:47:27.342450 n-d-850468-14 devstack@n-api.service[106659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:47:27.342450 n-d-850468-14 devstack@n-api.service[106659]: ERROR nova.api.openstack.wsgi Aug 10 22:47:27.342450 n-d-850468-14 devstack@n-api.service[106659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:47:27.342450 n-d-850468-14 devstack@n-api.service[106659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:47:27.342450 n-d-850468-14 devstack@n-api.service[106659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:47:27.343728 n-d-850468-14 devstack@n-api.service[106659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 22:47:27.343728 n-d-850468-14 devstack@n-api.service[106659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 22:47:27.343728 n-d-850468-14 devstack@n-api.service[106659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 22:47:27.343728 n-d-850468-14 devstack@n-api.service[106659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 22:47:27.343728 n-d-850468-14 devstack@n-api.service[106659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 10 22:47:27.343728 n-d-850468-14 devstack@n-api.service[106659]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 10 22:47:27.343728 n-d-850468-14 devstack@n-api.service[106659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 10 22:47:27.343728 n-d-850468-14 devstack@n-api.service[106659]: ERROR nova.api.openstack.wsgi Aug 10 22:47:27.343728 n-d-850468-14 devstack@n-api.service[106659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:47:27.343728 n-d-850468-14 devstack@n-api.service[106659]: ERROR nova.api.openstack.wsgi Aug 10 22:47:27.343728 n-d-850468-14 devstack@n-api.service[106659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:47:27.343728 n-d-850468-14 devstack@n-api.service[106659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:47:27.343728 n-d-850468-14 devstack@n-api.service[106659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:47:27.343728 n-d-850468-14 devstack@n-api.service[106659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 22:47:27.343728 n-d-850468-14 devstack@n-api.service[106659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 22:47:27.343728 n-d-850468-14 devstack@n-api.service[106659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 10 22:47:27.343728 n-d-850468-14 devstack@n-api.service[106659]: ERROR nova.api.openstack.wsgi Aug 10 22:47:27.343728 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi [None req-4c0017a3-962a-4fd1-992a-527aa9e02c13 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 22:47:27.345000 n-d-850468-14 devstack@n-api.service[106659]: INFO nova.api.openstack.requestlog [None req-4c0017a3-962a-4fd1-992a-527aa9e02c13 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.397397 Aug 10 22:47:27.345000 n-d-850468-14 devstack@n-api.service[106659]: [pid: 106659|app: 0|req: 19/39] 10.222.0.58 () {60 vars in 1190 bytes} [Wed Aug 10 22:47:26 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 398 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 10 22:47:27.351254 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi [None req-f0773285-0b10-4d89-98ec-1839e52a653b admin admin] Calling method '>' {{(pid=106658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:47:27.355493 n-d-850468-14 devstack@n-api.service[106658]: DEBUG dbcounter [-] [106658] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=106658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:47:27.374847 n-d-850468-14 devstack@n-api.service[106658]: INFO nova.api.openstack.requestlog [None req-f0773285-0b10-4d89-98ec-1839e52a653b admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027203 Aug 10 22:47:27.375398 n-d-850468-14 devstack@n-api.service[106658]: [pid: 106658|app: 0|req: 21/40] 10.222.0.58 () {60 vars in 1210 bytes} [Wed Aug 10 22:47:27 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:47:27.393282 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi [None req-7626b6f6-358c-4804-a1c1-40426b9ddb46 admin admin] Calling method '>' {{(pid=106659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:47:27.417063 n-d-850468-14 devstack@n-api.service[106659]: INFO nova.api.openstack.requestlog [None req-7626b6f6-358c-4804-a1c1-40426b9ddb46 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027491 Aug 10 22:47:27.417614 n-d-850468-14 devstack@n-api.service[106659]: [pid: 106659|app: 0|req: 20/41] 10.222.0.58 () {60 vars in 1210 bytes} [Wed Aug 10 22:47:27 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:47:27.427279 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi [None req-96a7cfae-60e0-4db4-8f36-5f59337df055 admin admin] Calling method '>' {{(pid=106658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:47:27.433811 n-d-850468-14 devstack@n-api.service[106658]: INFO nova.api.openstack.wsgi [None req-96a7cfae-60e0-4db4-8f36-5f59337df055 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 10 22:47:27.437097 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi [None req-96a7cfae-60e0-4db4-8f36-5f59337df055 admin admin] Request method failure captured: Aug 10 22:47:27.437097 n-d-850468-14 devstack@n-api.service[106658]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 10 22:47:27.437097 n-d-850468-14 devstack@n-api.service[106658]: Accept: application/json Aug 10 22:47:27.437097 n-d-850468-14 devstack@n-api.service[106658]: Accept-Encoding: gzip, deflate Aug 10 22:47:27.437097 n-d-850468-14 devstack@n-api.service[106658]: Connection: keep-alive Aug 10 22:47:27.437097 n-d-850468-14 devstack@n-api.service[106658]: Content-Length: 0 Aug 10 22:47:27.437097 n-d-850468-14 devstack@n-api.service[106658]: Host: 10.222.0.58 Aug 10 22:47:27.437097 n-d-850468-14 devstack@n-api.service[106658]: Openstack-Api-Version: compute 2.90 Aug 10 22:47:27.437097 n-d-850468-14 devstack@n-api.service[106658]: Openstack-System-Scope: None Aug 10 22:47:27.437097 n-d-850468-14 devstack@n-api.service[106658]: User-Agent: python-novaclient Aug 10 22:47:27.437097 n-d-850468-14 devstack@n-api.service[106658]: X-Auth-Token: gAAAAABi9DV-MYJxCGo9lyc3bLFJaS3PcGu87CQuk7xVrpef5FWy7-AOiJZeo9j66fZMIn3JrRqtrL5pT-bn8yDXedQzGLVCdAcZ-AUhlw8E4urBCTjhwMFe9k4jK8kIe6tW4Rnx1LAjOlk-LlkpXkeh5Lk5HEbPGV_LgcqAcqzo6fpFFcWGu1I Aug 10 22:47:27.437097 n-d-850468-14 devstack@n-api.service[106658]: X-Domain-Id: None Aug 10 22:47:27.437097 n-d-850468-14 devstack@n-api.service[106658]: X-Domain-Name: None Aug 10 22:47:27.437097 n-d-850468-14 devstack@n-api.service[106658]: X-Identity-Status: Confirmed Aug 10 22:47:27.437097 n-d-850468-14 devstack@n-api.service[106658]: X-Is-Admin-Project: True Aug 10 22:47:27.437097 n-d-850468-14 devstack@n-api.service[106658]: X-Openstack-Nova-Api-Version: 2.90 Aug 10 22:47:27.437097 n-d-850468-14 devstack@n-api.service[106658]: X-Project-Domain-Id: default Aug 10 22:47:27.437097 n-d-850468-14 devstack@n-api.service[106658]: X-Project-Domain-Name: Default Aug 10 22:47:27.437097 n-d-850468-14 devstack@n-api.service[106658]: X-Project-Id: e8acc9bb8b864134a30aa7c461e1ca6a Aug 10 22:47:27.437097 n-d-850468-14 devstack@n-api.service[106658]: X-Project-Name: admin Aug 10 22:47:27.437097 n-d-850468-14 devstack@n-api.service[106658]: X-Role: admin,member,reader Aug 10 22:47:27.437097 n-d-850468-14 devstack@n-api.service[106658]: X-Roles: admin,member,reader Aug 10 22:47:27.438689 n-d-850468-14 devstack@n-api.service[106658]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e8acc9bb8b864134a30aa7c461e1ca6a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e8acc9bb8b864134a30aa7c461e1ca6a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/e8acc9bb8b864134a30aa7c461e1ca6a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_e8acc9bb8b864134a30aa7c461e1ca6a", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 22:47:27.438689 n-d-850468-14 devstack@n-api.service[106658]: X-Tenant: admin Aug 10 22:47:27.438689 n-d-850468-14 devstack@n-api.service[106658]: X-Tenant-Id: e8acc9bb8b864134a30aa7c461e1ca6a Aug 10 22:47:27.438689 n-d-850468-14 devstack@n-api.service[106658]: X-Tenant-Name: admin Aug 10 22:47:27.438689 n-d-850468-14 devstack@n-api.service[106658]: X-User: admin Aug 10 22:47:27.438689 n-d-850468-14 devstack@n-api.service[106658]: X-User-Domain-Id: default Aug 10 22:47:27.438689 n-d-850468-14 devstack@n-api.service[106658]: X-User-Domain-Name: Default Aug 10 22:47:27.438689 n-d-850468-14 devstack@n-api.service[106658]: X-User-Id: 9660d2d67a7e4daeafa7c00b8c9f29dc Aug 10 22:47:27.438689 n-d-850468-14 devstack@n-api.service[106658]: X-User-Name: admin Aug 10 22:47:27.438689 n-d-850468-14 devstack@n-api.service[106658]: method: > Aug 10 22:47:27.438689 n-d-850468-14 devstack@n-api.service[106658]: exception: Flavor 42 could not be found. Aug 10 22:47:27.438689 n-d-850468-14 devstack@n-api.service[106658]: action_args: {'id': '42'} Aug 10 22:47:27.438689 n-d-850468-14 devstack@n-api.service[106658]: {{(pid=106658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 22:47:27.438689 n-d-850468-14 devstack@n-api.service[106658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:47:27.439698 n-d-850468-14 devstack@n-api.service[106658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 10 22:47:27.439698 n-d-850468-14 devstack@n-api.service[106658]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 10 22:47:27.439698 n-d-850468-14 devstack@n-api.service[106658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 10 22:47:27.439698 n-d-850468-14 devstack@n-api.service[106658]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 10 22:47:27.439698 n-d-850468-14 devstack@n-api.service[106658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 10 22:47:27.439698 n-d-850468-14 devstack@n-api.service[106658]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 10 22:47:27.439698 n-d-850468-14 devstack@n-api.service[106658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 10 22:47:27.439698 n-d-850468-14 devstack@n-api.service[106658]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 10 22:47:27.439698 n-d-850468-14 devstack@n-api.service[106658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 10 22:47:27.439698 n-d-850468-14 devstack@n-api.service[106658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 22:47:27.439698 n-d-850468-14 devstack@n-api.service[106658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 10 22:47:27.439698 n-d-850468-14 devstack@n-api.service[106658]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 10 22:47:27.439698 n-d-850468-14 devstack@n-api.service[106658]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 10 22:47:27.439698 n-d-850468-14 devstack@n-api.service[106658]: ERROR nova.api.openstack.wsgi Aug 10 22:47:27.439698 n-d-850468-14 devstack@n-api.service[106658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:47:27.439698 n-d-850468-14 devstack@n-api.service[106658]: ERROR nova.api.openstack.wsgi Aug 10 22:47:27.439698 n-d-850468-14 devstack@n-api.service[106658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:47:27.439698 n-d-850468-14 devstack@n-api.service[106658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:47:27.439698 n-d-850468-14 devstack@n-api.service[106658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:47:27.440940 n-d-850468-14 devstack@n-api.service[106658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 22:47:27.440940 n-d-850468-14 devstack@n-api.service[106658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 22:47:27.440940 n-d-850468-14 devstack@n-api.service[106658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 22:47:27.440940 n-d-850468-14 devstack@n-api.service[106658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 22:47:27.440940 n-d-850468-14 devstack@n-api.service[106658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 10 22:47:27.440940 n-d-850468-14 devstack@n-api.service[106658]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 10 22:47:27.440940 n-d-850468-14 devstack@n-api.service[106658]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 10 22:47:27.440940 n-d-850468-14 devstack@n-api.service[106658]: ERROR nova.api.openstack.wsgi Aug 10 22:47:27.440940 n-d-850468-14 devstack@n-api.service[106658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:47:27.440940 n-d-850468-14 devstack@n-api.service[106658]: ERROR nova.api.openstack.wsgi Aug 10 22:47:27.440940 n-d-850468-14 devstack@n-api.service[106658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:47:27.440940 n-d-850468-14 devstack@n-api.service[106658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:47:27.440940 n-d-850468-14 devstack@n-api.service[106658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:47:27.440940 n-d-850468-14 devstack@n-api.service[106658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 22:47:27.440940 n-d-850468-14 devstack@n-api.service[106658]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 22:47:27.440940 n-d-850468-14 devstack@n-api.service[106658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 10 22:47:27.440940 n-d-850468-14 devstack@n-api.service[106658]: ERROR nova.api.openstack.wsgi Aug 10 22:47:27.440940 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi [None req-96a7cfae-60e0-4db4-8f36-5f59337df055 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 22:47:27.442166 n-d-850468-14 devstack@n-api.service[106658]: INFO nova.api.openstack.requestlog [None req-96a7cfae-60e0-4db4-8f36-5f59337df055 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014802 Aug 10 22:47:27.442166 n-d-850468-14 devstack@n-api.service[106658]: [pid: 106658|app: 0|req: 22/42] 10.222.0.58 () {60 vars in 1190 bytes} [Wed Aug 10 22:47:27 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 10 22:47:28.428379 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi [None req-7626b6f6-358c-4804-a1c1-40426b9ddb46 admin admin] Calling method '>' {{(pid=106659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:47:28.429425 n-d-850468-14 devstack@n-api.service[106659]: INFO nova.api.openstack.requestlog [None req-7626b6f6-358c-4804-a1c1-40426b9ddb46 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001547 Aug 10 22:47:28.429847 n-d-850468-14 devstack@n-api.service[106659]: [pid: 106659|app: 0|req: 21/43] 10.222.0.58 () {56 vars in 1074 bytes} [Wed Aug 10 22:47:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:47:28.962972 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi [None req-a9f40692-3a84-449c-b800-f49bacfa06cb admin admin] Calling method '>' {{(pid=106658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:47:28.968351 n-d-850468-14 devstack@n-api.service[106658]: INFO nova.api.openstack.wsgi [None req-a9f40692-3a84-449c-b800-f49bacfa06cb admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 10 22:47:28.969862 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi [None req-a9f40692-3a84-449c-b800-f49bacfa06cb admin admin] Request method failure captured: Aug 10 22:47:28.969862 n-d-850468-14 devstack@n-api.service[106658]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 10 22:47:28.969862 n-d-850468-14 devstack@n-api.service[106658]: Accept: application/json Aug 10 22:47:28.969862 n-d-850468-14 devstack@n-api.service[106658]: Accept-Encoding: gzip, deflate Aug 10 22:47:28.969862 n-d-850468-14 devstack@n-api.service[106658]: Connection: keep-alive Aug 10 22:47:28.969862 n-d-850468-14 devstack@n-api.service[106658]: Content-Length: 0 Aug 10 22:47:28.969862 n-d-850468-14 devstack@n-api.service[106658]: Host: 10.222.0.58 Aug 10 22:47:28.969862 n-d-850468-14 devstack@n-api.service[106658]: Openstack-Api-Version: compute 2.90 Aug 10 22:47:28.969862 n-d-850468-14 devstack@n-api.service[106658]: Openstack-System-Scope: None Aug 10 22:47:28.969862 n-d-850468-14 devstack@n-api.service[106658]: User-Agent: python-novaclient Aug 10 22:47:28.969862 n-d-850468-14 devstack@n-api.service[106658]: X-Auth-Token: gAAAAABi9DWA-x1Ah7eDkvCRrsPNrVZc6fjKRCBF03GtdbB1siw1916b1IcGMOqnFXS1aDlNplnjvJXnDp5tiW8p184nj3ueyoTPD7zWY62WgnI0KEmEKI4YuZ7Ys6b9GuDQFTdu6Oxv6JqaapkCtkRYUd0zPe0ld9qNm9XemvvL1II7QzoebP0 Aug 10 22:47:28.969862 n-d-850468-14 devstack@n-api.service[106658]: X-Domain-Id: None Aug 10 22:47:28.969862 n-d-850468-14 devstack@n-api.service[106658]: X-Domain-Name: None Aug 10 22:47:28.969862 n-d-850468-14 devstack@n-api.service[106658]: X-Identity-Status: Confirmed Aug 10 22:47:28.969862 n-d-850468-14 devstack@n-api.service[106658]: X-Is-Admin-Project: True Aug 10 22:47:28.969862 n-d-850468-14 devstack@n-api.service[106658]: X-Openstack-Nova-Api-Version: 2.90 Aug 10 22:47:28.969862 n-d-850468-14 devstack@n-api.service[106658]: X-Project-Domain-Id: default Aug 10 22:47:28.969862 n-d-850468-14 devstack@n-api.service[106658]: X-Project-Domain-Name: Default Aug 10 22:47:28.969862 n-d-850468-14 devstack@n-api.service[106658]: X-Project-Id: e8acc9bb8b864134a30aa7c461e1ca6a Aug 10 22:47:28.969862 n-d-850468-14 devstack@n-api.service[106658]: X-Project-Name: admin Aug 10 22:47:28.969862 n-d-850468-14 devstack@n-api.service[106658]: X-Role: admin,member,reader Aug 10 22:47:28.969862 n-d-850468-14 devstack@n-api.service[106658]: X-Roles: admin,member,reader Aug 10 22:47:28.971168 n-d-850468-14 devstack@n-api.service[106658]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e8acc9bb8b864134a30aa7c461e1ca6a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e8acc9bb8b864134a30aa7c461e1ca6a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/e8acc9bb8b864134a30aa7c461e1ca6a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_e8acc9bb8b864134a30aa7c461e1ca6a", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 22:47:28.971168 n-d-850468-14 devstack@n-api.service[106658]: X-Tenant: admin Aug 10 22:47:28.971168 n-d-850468-14 devstack@n-api.service[106658]: X-Tenant-Id: e8acc9bb8b864134a30aa7c461e1ca6a Aug 10 22:47:28.971168 n-d-850468-14 devstack@n-api.service[106658]: X-Tenant-Name: admin Aug 10 22:47:28.971168 n-d-850468-14 devstack@n-api.service[106658]: X-User: admin Aug 10 22:47:28.971168 n-d-850468-14 devstack@n-api.service[106658]: X-User-Domain-Id: default Aug 10 22:47:28.971168 n-d-850468-14 devstack@n-api.service[106658]: X-User-Domain-Name: Default Aug 10 22:47:28.971168 n-d-850468-14 devstack@n-api.service[106658]: X-User-Id: 9660d2d67a7e4daeafa7c00b8c9f29dc Aug 10 22:47:28.971168 n-d-850468-14 devstack@n-api.service[106658]: X-User-Name: admin Aug 10 22:47:28.971168 n-d-850468-14 devstack@n-api.service[106658]: method: > Aug 10 22:47:28.971168 n-d-850468-14 devstack@n-api.service[106658]: exception: Flavor 84 could not be found. Aug 10 22:47:28.971168 n-d-850468-14 devstack@n-api.service[106658]: action_args: {'id': '84'} Aug 10 22:47:28.971168 n-d-850468-14 devstack@n-api.service[106658]: {{(pid=106658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 22:47:28.971168 n-d-850468-14 devstack@n-api.service[106658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:47:28.971965 n-d-850468-14 devstack@n-api.service[106658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 10 22:47:28.971965 n-d-850468-14 devstack@n-api.service[106658]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 10 22:47:28.971965 n-d-850468-14 devstack@n-api.service[106658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 10 22:47:28.971965 n-d-850468-14 devstack@n-api.service[106658]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 10 22:47:28.971965 n-d-850468-14 devstack@n-api.service[106658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 10 22:47:28.971965 n-d-850468-14 devstack@n-api.service[106658]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 10 22:47:28.971965 n-d-850468-14 devstack@n-api.service[106658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 10 22:47:28.971965 n-d-850468-14 devstack@n-api.service[106658]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 10 22:47:28.971965 n-d-850468-14 devstack@n-api.service[106658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 10 22:47:28.971965 n-d-850468-14 devstack@n-api.service[106658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 22:47:28.971965 n-d-850468-14 devstack@n-api.service[106658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 10 22:47:28.971965 n-d-850468-14 devstack@n-api.service[106658]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 10 22:47:28.971965 n-d-850468-14 devstack@n-api.service[106658]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 10 22:47:28.971965 n-d-850468-14 devstack@n-api.service[106658]: ERROR nova.api.openstack.wsgi Aug 10 22:47:28.971965 n-d-850468-14 devstack@n-api.service[106658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:47:28.971965 n-d-850468-14 devstack@n-api.service[106658]: ERROR nova.api.openstack.wsgi Aug 10 22:47:28.971965 n-d-850468-14 devstack@n-api.service[106658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:47:28.971965 n-d-850468-14 devstack@n-api.service[106658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:47:28.971965 n-d-850468-14 devstack@n-api.service[106658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:47:28.973185 n-d-850468-14 devstack@n-api.service[106658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 22:47:28.973185 n-d-850468-14 devstack@n-api.service[106658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 22:47:28.973185 n-d-850468-14 devstack@n-api.service[106658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 22:47:28.973185 n-d-850468-14 devstack@n-api.service[106658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 22:47:28.973185 n-d-850468-14 devstack@n-api.service[106658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 10 22:47:28.973185 n-d-850468-14 devstack@n-api.service[106658]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 10 22:47:28.973185 n-d-850468-14 devstack@n-api.service[106658]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 10 22:47:28.973185 n-d-850468-14 devstack@n-api.service[106658]: ERROR nova.api.openstack.wsgi Aug 10 22:47:28.973185 n-d-850468-14 devstack@n-api.service[106658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:47:28.973185 n-d-850468-14 devstack@n-api.service[106658]: ERROR nova.api.openstack.wsgi Aug 10 22:47:28.973185 n-d-850468-14 devstack@n-api.service[106658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:47:28.973185 n-d-850468-14 devstack@n-api.service[106658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:47:28.973185 n-d-850468-14 devstack@n-api.service[106658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:47:28.973185 n-d-850468-14 devstack@n-api.service[106658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 22:47:28.973185 n-d-850468-14 devstack@n-api.service[106658]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 22:47:28.973185 n-d-850468-14 devstack@n-api.service[106658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 10 22:47:28.973185 n-d-850468-14 devstack@n-api.service[106658]: ERROR nova.api.openstack.wsgi Aug 10 22:47:28.973185 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi [None req-a9f40692-3a84-449c-b800-f49bacfa06cb admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 22:47:28.974429 n-d-850468-14 devstack@n-api.service[106658]: INFO nova.api.openstack.requestlog [None req-a9f40692-3a84-449c-b800-f49bacfa06cb admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.401776 Aug 10 22:47:28.974429 n-d-850468-14 devstack@n-api.service[106658]: [pid: 106658|app: 0|req: 23/44] 10.222.0.58 () {60 vars in 1190 bytes} [Wed Aug 10 22:47:28 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 403 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 10 22:47:28.981593 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi [None req-35a8d956-abe0-4d50-ab73-e3ab8d722690 admin admin] Calling method '>' {{(pid=106659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:47:28.997034 n-d-850468-14 devstack@n-api.service[106659]: INFO nova.api.openstack.requestlog [None req-35a8d956-abe0-4d50-ab73-e3ab8d722690 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018998 Aug 10 22:47:28.997563 n-d-850468-14 devstack@n-api.service[106659]: [pid: 106659|app: 0|req: 22/45] 10.222.0.58 () {60 vars in 1210 bytes} [Wed Aug 10 22:47:28 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:47:29.007262 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi [None req-9c826188-d858-4620-ab81-eef4e6339b7e admin admin] Calling method '>' {{(pid=106658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:47:29.024002 n-d-850468-14 devstack@n-api.service[106658]: INFO nova.api.openstack.requestlog [None req-9c826188-d858-4620-ab81-eef4e6339b7e admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020246 Aug 10 22:47:29.024525 n-d-850468-14 devstack@n-api.service[106658]: [pid: 106658|app: 0|req: 24/46] 10.222.0.58 () {60 vars in 1210 bytes} [Wed Aug 10 22:47:29 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:47:29.033970 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi [None req-9359aa49-a5ac-4dee-8511-f4800a3e949a admin admin] Calling method '>' {{(pid=106659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:47:29.039308 n-d-850468-14 devstack@n-api.service[106659]: INFO nova.api.openstack.wsgi [None req-9359aa49-a5ac-4dee-8511-f4800a3e949a admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 10 22:47:29.040787 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi [None req-9359aa49-a5ac-4dee-8511-f4800a3e949a admin admin] Request method failure captured: Aug 10 22:47:29.040787 n-d-850468-14 devstack@n-api.service[106659]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 10 22:47:29.040787 n-d-850468-14 devstack@n-api.service[106659]: Accept: application/json Aug 10 22:47:29.040787 n-d-850468-14 devstack@n-api.service[106659]: Accept-Encoding: gzip, deflate Aug 10 22:47:29.040787 n-d-850468-14 devstack@n-api.service[106659]: Connection: keep-alive Aug 10 22:47:29.040787 n-d-850468-14 devstack@n-api.service[106659]: Content-Length: 0 Aug 10 22:47:29.040787 n-d-850468-14 devstack@n-api.service[106659]: Host: 10.222.0.58 Aug 10 22:47:29.040787 n-d-850468-14 devstack@n-api.service[106659]: Openstack-Api-Version: compute 2.90 Aug 10 22:47:29.040787 n-d-850468-14 devstack@n-api.service[106659]: Openstack-System-Scope: None Aug 10 22:47:29.040787 n-d-850468-14 devstack@n-api.service[106659]: User-Agent: python-novaclient Aug 10 22:47:29.040787 n-d-850468-14 devstack@n-api.service[106659]: X-Auth-Token: gAAAAABi9DWA-x1Ah7eDkvCRrsPNrVZc6fjKRCBF03GtdbB1siw1916b1IcGMOqnFXS1aDlNplnjvJXnDp5tiW8p184nj3ueyoTPD7zWY62WgnI0KEmEKI4YuZ7Ys6b9GuDQFTdu6Oxv6JqaapkCtkRYUd0zPe0ld9qNm9XemvvL1II7QzoebP0 Aug 10 22:47:29.040787 n-d-850468-14 devstack@n-api.service[106659]: X-Domain-Id: None Aug 10 22:47:29.040787 n-d-850468-14 devstack@n-api.service[106659]: X-Domain-Name: None Aug 10 22:47:29.040787 n-d-850468-14 devstack@n-api.service[106659]: X-Identity-Status: Confirmed Aug 10 22:47:29.040787 n-d-850468-14 devstack@n-api.service[106659]: X-Is-Admin-Project: True Aug 10 22:47:29.040787 n-d-850468-14 devstack@n-api.service[106659]: X-Openstack-Nova-Api-Version: 2.90 Aug 10 22:47:29.040787 n-d-850468-14 devstack@n-api.service[106659]: X-Project-Domain-Id: default Aug 10 22:47:29.040787 n-d-850468-14 devstack@n-api.service[106659]: X-Project-Domain-Name: Default Aug 10 22:47:29.040787 n-d-850468-14 devstack@n-api.service[106659]: X-Project-Id: e8acc9bb8b864134a30aa7c461e1ca6a Aug 10 22:47:29.040787 n-d-850468-14 devstack@n-api.service[106659]: X-Project-Name: admin Aug 10 22:47:29.040787 n-d-850468-14 devstack@n-api.service[106659]: X-Role: admin,member,reader Aug 10 22:47:29.040787 n-d-850468-14 devstack@n-api.service[106659]: X-Roles: admin,member,reader Aug 10 22:47:29.042329 n-d-850468-14 devstack@n-api.service[106659]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e8acc9bb8b864134a30aa7c461e1ca6a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e8acc9bb8b864134a30aa7c461e1ca6a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/e8acc9bb8b864134a30aa7c461e1ca6a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_e8acc9bb8b864134a30aa7c461e1ca6a", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 22:47:29.042329 n-d-850468-14 devstack@n-api.service[106659]: X-Tenant: admin Aug 10 22:47:29.042329 n-d-850468-14 devstack@n-api.service[106659]: X-Tenant-Id: e8acc9bb8b864134a30aa7c461e1ca6a Aug 10 22:47:29.042329 n-d-850468-14 devstack@n-api.service[106659]: X-Tenant-Name: admin Aug 10 22:47:29.042329 n-d-850468-14 devstack@n-api.service[106659]: X-User: admin Aug 10 22:47:29.042329 n-d-850468-14 devstack@n-api.service[106659]: X-User-Domain-Id: default Aug 10 22:47:29.042329 n-d-850468-14 devstack@n-api.service[106659]: X-User-Domain-Name: Default Aug 10 22:47:29.042329 n-d-850468-14 devstack@n-api.service[106659]: X-User-Id: 9660d2d67a7e4daeafa7c00b8c9f29dc Aug 10 22:47:29.042329 n-d-850468-14 devstack@n-api.service[106659]: X-User-Name: admin Aug 10 22:47:29.042329 n-d-850468-14 devstack@n-api.service[106659]: method: > Aug 10 22:47:29.042329 n-d-850468-14 devstack@n-api.service[106659]: exception: Flavor 84 could not be found. Aug 10 22:47:29.042329 n-d-850468-14 devstack@n-api.service[106659]: action_args: {'id': '84'} Aug 10 22:47:29.042329 n-d-850468-14 devstack@n-api.service[106659]: {{(pid=106659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 22:47:29.042329 n-d-850468-14 devstack@n-api.service[106659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:47:29.043324 n-d-850468-14 devstack@n-api.service[106659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 10 22:47:29.043324 n-d-850468-14 devstack@n-api.service[106659]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 10 22:47:29.043324 n-d-850468-14 devstack@n-api.service[106659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 10 22:47:29.043324 n-d-850468-14 devstack@n-api.service[106659]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 10 22:47:29.043324 n-d-850468-14 devstack@n-api.service[106659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 10 22:47:29.043324 n-d-850468-14 devstack@n-api.service[106659]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 10 22:47:29.043324 n-d-850468-14 devstack@n-api.service[106659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 10 22:47:29.043324 n-d-850468-14 devstack@n-api.service[106659]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 10 22:47:29.043324 n-d-850468-14 devstack@n-api.service[106659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 10 22:47:29.043324 n-d-850468-14 devstack@n-api.service[106659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 22:47:29.043324 n-d-850468-14 devstack@n-api.service[106659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 10 22:47:29.043324 n-d-850468-14 devstack@n-api.service[106659]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 10 22:47:29.043324 n-d-850468-14 devstack@n-api.service[106659]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 10 22:47:29.043324 n-d-850468-14 devstack@n-api.service[106659]: ERROR nova.api.openstack.wsgi Aug 10 22:47:29.043324 n-d-850468-14 devstack@n-api.service[106659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:47:29.043324 n-d-850468-14 devstack@n-api.service[106659]: ERROR nova.api.openstack.wsgi Aug 10 22:47:29.043324 n-d-850468-14 devstack@n-api.service[106659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:47:29.043324 n-d-850468-14 devstack@n-api.service[106659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:47:29.043324 n-d-850468-14 devstack@n-api.service[106659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:47:29.044428 n-d-850468-14 devstack@n-api.service[106659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 22:47:29.044428 n-d-850468-14 devstack@n-api.service[106659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 22:47:29.044428 n-d-850468-14 devstack@n-api.service[106659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 22:47:29.044428 n-d-850468-14 devstack@n-api.service[106659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 22:47:29.044428 n-d-850468-14 devstack@n-api.service[106659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 10 22:47:29.044428 n-d-850468-14 devstack@n-api.service[106659]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 10 22:47:29.044428 n-d-850468-14 devstack@n-api.service[106659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 10 22:47:29.044428 n-d-850468-14 devstack@n-api.service[106659]: ERROR nova.api.openstack.wsgi Aug 10 22:47:29.044428 n-d-850468-14 devstack@n-api.service[106659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:47:29.044428 n-d-850468-14 devstack@n-api.service[106659]: ERROR nova.api.openstack.wsgi Aug 10 22:47:29.044428 n-d-850468-14 devstack@n-api.service[106659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:47:29.044428 n-d-850468-14 devstack@n-api.service[106659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:47:29.044428 n-d-850468-14 devstack@n-api.service[106659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:47:29.044428 n-d-850468-14 devstack@n-api.service[106659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 22:47:29.044428 n-d-850468-14 devstack@n-api.service[106659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 22:47:29.044428 n-d-850468-14 devstack@n-api.service[106659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 10 22:47:29.044428 n-d-850468-14 devstack@n-api.service[106659]: ERROR nova.api.openstack.wsgi Aug 10 22:47:29.044428 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi [None req-9359aa49-a5ac-4dee-8511-f4800a3e949a admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 22:47:29.045730 n-d-850468-14 devstack@n-api.service[106659]: INFO nova.api.openstack.requestlog [None req-9359aa49-a5ac-4dee-8511-f4800a3e949a admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012232 Aug 10 22:47:29.045730 n-d-850468-14 devstack@n-api.service[106659]: [pid: 106659|app: 0|req: 23/47] 10.222.0.58 () {60 vars in 1190 bytes} [Wed Aug 10 22:47:29 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 10 22:47:30.081633 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi [None req-9c826188-d858-4620-ab81-eef4e6339b7e admin admin] Calling method '>' {{(pid=106658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:47:30.083038 n-d-850468-14 devstack@n-api.service[106658]: INFO nova.api.openstack.requestlog [None req-9c826188-d858-4620-ab81-eef4e6339b7e admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Aug 10 22:47:30.083442 n-d-850468-14 devstack@n-api.service[106658]: [pid: 106658|app: 0|req: 25/48] 10.222.0.58 () {56 vars in 1074 bytes} [Wed Aug 10 22:47:30 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:47:30.614231 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi [None req-92423523-1587-43cc-8db1-f0a6ca368346 admin admin] Calling method '>' {{(pid=106659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:47:30.620797 n-d-850468-14 devstack@n-api.service[106659]: INFO nova.api.openstack.wsgi [None req-92423523-1587-43cc-8db1-f0a6ca368346 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 10 22:47:30.622333 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi [None req-92423523-1587-43cc-8db1-f0a6ca368346 admin admin] Request method failure captured: Aug 10 22:47:30.622333 n-d-850468-14 devstack@n-api.service[106659]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 10 22:47:30.622333 n-d-850468-14 devstack@n-api.service[106659]: Accept: application/json Aug 10 22:47:30.622333 n-d-850468-14 devstack@n-api.service[106659]: Accept-Encoding: gzip, deflate Aug 10 22:47:30.622333 n-d-850468-14 devstack@n-api.service[106659]: Connection: keep-alive Aug 10 22:47:30.622333 n-d-850468-14 devstack@n-api.service[106659]: Content-Length: 0 Aug 10 22:47:30.622333 n-d-850468-14 devstack@n-api.service[106659]: Host: 10.222.0.58 Aug 10 22:47:30.622333 n-d-850468-14 devstack@n-api.service[106659]: Openstack-Api-Version: compute 2.90 Aug 10 22:47:30.622333 n-d-850468-14 devstack@n-api.service[106659]: Openstack-System-Scope: None Aug 10 22:47:30.622333 n-d-850468-14 devstack@n-api.service[106659]: User-Agent: python-novaclient Aug 10 22:47:30.622333 n-d-850468-14 devstack@n-api.service[106659]: X-Auth-Token: gAAAAABi9DWBCGLsfrpQDGQMzRzn_KVUeRy5ngtKKRTQdGrgcUOBOlXe1cCbSyRFClv8ZCz0QNvjPua8XcJxup6H1A8XdRtK240KQXPYUONwRy3Yo_ikxp5JcCsMEn_05NRMWPzkPMf2dJByITYjKyUlFqdVH8IF36PUR8dHmHHr8x1LJeBT4kg Aug 10 22:47:30.622333 n-d-850468-14 devstack@n-api.service[106659]: X-Domain-Id: None Aug 10 22:47:30.622333 n-d-850468-14 devstack@n-api.service[106659]: X-Domain-Name: None Aug 10 22:47:30.622333 n-d-850468-14 devstack@n-api.service[106659]: X-Identity-Status: Confirmed Aug 10 22:47:30.622333 n-d-850468-14 devstack@n-api.service[106659]: X-Is-Admin-Project: True Aug 10 22:47:30.622333 n-d-850468-14 devstack@n-api.service[106659]: X-Openstack-Nova-Api-Version: 2.90 Aug 10 22:47:30.622333 n-d-850468-14 devstack@n-api.service[106659]: X-Project-Domain-Id: default Aug 10 22:47:30.622333 n-d-850468-14 devstack@n-api.service[106659]: X-Project-Domain-Name: Default Aug 10 22:47:30.622333 n-d-850468-14 devstack@n-api.service[106659]: X-Project-Id: e8acc9bb8b864134a30aa7c461e1ca6a Aug 10 22:47:30.622333 n-d-850468-14 devstack@n-api.service[106659]: X-Project-Name: admin Aug 10 22:47:30.622333 n-d-850468-14 devstack@n-api.service[106659]: X-Role: admin,member,reader Aug 10 22:47:30.622333 n-d-850468-14 devstack@n-api.service[106659]: X-Roles: admin,member,reader Aug 10 22:47:30.623858 n-d-850468-14 devstack@n-api.service[106659]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e8acc9bb8b864134a30aa7c461e1ca6a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e8acc9bb8b864134a30aa7c461e1ca6a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/e8acc9bb8b864134a30aa7c461e1ca6a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_e8acc9bb8b864134a30aa7c461e1ca6a", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 22:47:30.623858 n-d-850468-14 devstack@n-api.service[106659]: X-Tenant: admin Aug 10 22:47:30.623858 n-d-850468-14 devstack@n-api.service[106659]: X-Tenant-Id: e8acc9bb8b864134a30aa7c461e1ca6a Aug 10 22:47:30.623858 n-d-850468-14 devstack@n-api.service[106659]: X-Tenant-Name: admin Aug 10 22:47:30.623858 n-d-850468-14 devstack@n-api.service[106659]: X-User: admin Aug 10 22:47:30.623858 n-d-850468-14 devstack@n-api.service[106659]: X-User-Domain-Id: default Aug 10 22:47:30.623858 n-d-850468-14 devstack@n-api.service[106659]: X-User-Domain-Name: Default Aug 10 22:47:30.623858 n-d-850468-14 devstack@n-api.service[106659]: X-User-Id: 9660d2d67a7e4daeafa7c00b8c9f29dc Aug 10 22:47:30.623858 n-d-850468-14 devstack@n-api.service[106659]: X-User-Name: admin Aug 10 22:47:30.623858 n-d-850468-14 devstack@n-api.service[106659]: method: > Aug 10 22:47:30.623858 n-d-850468-14 devstack@n-api.service[106659]: exception: Flavor 451 could not be found. Aug 10 22:47:30.623858 n-d-850468-14 devstack@n-api.service[106659]: action_args: {'id': '451'} Aug 10 22:47:30.623858 n-d-850468-14 devstack@n-api.service[106659]: {{(pid=106659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 22:47:30.623858 n-d-850468-14 devstack@n-api.service[106659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:47:30.624711 n-d-850468-14 devstack@n-api.service[106659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 10 22:47:30.624711 n-d-850468-14 devstack@n-api.service[106659]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 10 22:47:30.624711 n-d-850468-14 devstack@n-api.service[106659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 10 22:47:30.624711 n-d-850468-14 devstack@n-api.service[106659]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 10 22:47:30.624711 n-d-850468-14 devstack@n-api.service[106659]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 10 22:47:30.624711 n-d-850468-14 devstack@n-api.service[106659]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 10 22:47:30.624711 n-d-850468-14 devstack@n-api.service[106659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 10 22:47:30.624711 n-d-850468-14 devstack@n-api.service[106659]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 10 22:47:30.624711 n-d-850468-14 devstack@n-api.service[106659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 10 22:47:30.624711 n-d-850468-14 devstack@n-api.service[106659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 22:47:30.624711 n-d-850468-14 devstack@n-api.service[106659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 10 22:47:30.624711 n-d-850468-14 devstack@n-api.service[106659]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 10 22:47:30.624711 n-d-850468-14 devstack@n-api.service[106659]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 10 22:47:30.624711 n-d-850468-14 devstack@n-api.service[106659]: ERROR nova.api.openstack.wsgi Aug 10 22:47:30.624711 n-d-850468-14 devstack@n-api.service[106659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:47:30.624711 n-d-850468-14 devstack@n-api.service[106659]: ERROR nova.api.openstack.wsgi Aug 10 22:47:30.624711 n-d-850468-14 devstack@n-api.service[106659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:47:30.624711 n-d-850468-14 devstack@n-api.service[106659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:47:30.624711 n-d-850468-14 devstack@n-api.service[106659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:47:30.625849 n-d-850468-14 devstack@n-api.service[106659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 22:47:30.625849 n-d-850468-14 devstack@n-api.service[106659]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 22:47:30.625849 n-d-850468-14 devstack@n-api.service[106659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 22:47:30.625849 n-d-850468-14 devstack@n-api.service[106659]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 22:47:30.625849 n-d-850468-14 devstack@n-api.service[106659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 10 22:47:30.625849 n-d-850468-14 devstack@n-api.service[106659]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 10 22:47:30.625849 n-d-850468-14 devstack@n-api.service[106659]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 10 22:47:30.625849 n-d-850468-14 devstack@n-api.service[106659]: ERROR nova.api.openstack.wsgi Aug 10 22:47:30.625849 n-d-850468-14 devstack@n-api.service[106659]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:47:30.625849 n-d-850468-14 devstack@n-api.service[106659]: ERROR nova.api.openstack.wsgi Aug 10 22:47:30.625849 n-d-850468-14 devstack@n-api.service[106659]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:47:30.625849 n-d-850468-14 devstack@n-api.service[106659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:47:30.625849 n-d-850468-14 devstack@n-api.service[106659]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:47:30.625849 n-d-850468-14 devstack@n-api.service[106659]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 22:47:30.625849 n-d-850468-14 devstack@n-api.service[106659]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 22:47:30.625849 n-d-850468-14 devstack@n-api.service[106659]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 10 22:47:30.625849 n-d-850468-14 devstack@n-api.service[106659]: ERROR nova.api.openstack.wsgi Aug 10 22:47:30.625849 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi [None req-92423523-1587-43cc-8db1-f0a6ca368346 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106659) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 22:47:30.626944 n-d-850468-14 devstack@n-api.service[106659]: INFO nova.api.openstack.requestlog [None req-92423523-1587-43cc-8db1-f0a6ca368346 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.398396 Aug 10 22:47:30.626944 n-d-850468-14 devstack@n-api.service[106659]: [pid: 106659|app: 0|req: 24/49] 10.222.0.58 () {60 vars in 1193 bytes} [Wed Aug 10 22:47:30 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 399 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 10 22:47:30.633493 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi [None req-1fcb8f95-4c07-4a6a-9012-1f284e2ff23b admin admin] Calling method '>' {{(pid=106658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:47:30.648432 n-d-850468-14 devstack@n-api.service[106658]: INFO nova.api.openstack.requestlog [None req-1fcb8f95-4c07-4a6a-9012-1f284e2ff23b admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018498 Aug 10 22:47:30.648959 n-d-850468-14 devstack@n-api.service[106658]: [pid: 106658|app: 0|req: 26/50] 10.222.0.58 () {60 vars in 1210 bytes} [Wed Aug 10 22:47:30 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:47:30.658688 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi [None req-efcb645e-6b7a-4333-98de-4eea87100dbe admin admin] Calling method '>' {{(pid=106659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:47:30.674347 n-d-850468-14 devstack@n-api.service[106659]: INFO nova.api.openstack.requestlog [None req-efcb645e-6b7a-4333-98de-4eea87100dbe admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019283 Aug 10 22:47:30.674911 n-d-850468-14 devstack@n-api.service[106659]: [pid: 106659|app: 0|req: 25/51] 10.222.0.58 () {60 vars in 1210 bytes} [Wed Aug 10 22:47:30 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:47:30.685069 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi [None req-ee2c9651-7921-460f-9b44-8970390ee414 admin admin] Calling method '>' {{(pid=106658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:47:30.690493 n-d-850468-14 devstack@n-api.service[106658]: INFO nova.api.openstack.wsgi [None req-ee2c9651-7921-460f-9b44-8970390ee414 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 10 22:47:30.692026 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi [None req-ee2c9651-7921-460f-9b44-8970390ee414 admin admin] Request method failure captured: Aug 10 22:47:30.692026 n-d-850468-14 devstack@n-api.service[106658]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 10 22:47:30.692026 n-d-850468-14 devstack@n-api.service[106658]: Accept: application/json Aug 10 22:47:30.692026 n-d-850468-14 devstack@n-api.service[106658]: Accept-Encoding: gzip, deflate Aug 10 22:47:30.692026 n-d-850468-14 devstack@n-api.service[106658]: Connection: keep-alive Aug 10 22:47:30.692026 n-d-850468-14 devstack@n-api.service[106658]: Content-Length: 0 Aug 10 22:47:30.692026 n-d-850468-14 devstack@n-api.service[106658]: Host: 10.222.0.58 Aug 10 22:47:30.692026 n-d-850468-14 devstack@n-api.service[106658]: Openstack-Api-Version: compute 2.90 Aug 10 22:47:30.692026 n-d-850468-14 devstack@n-api.service[106658]: Openstack-System-Scope: None Aug 10 22:47:30.692026 n-d-850468-14 devstack@n-api.service[106658]: User-Agent: python-novaclient Aug 10 22:47:30.692026 n-d-850468-14 devstack@n-api.service[106658]: X-Auth-Token: gAAAAABi9DWBCGLsfrpQDGQMzRzn_KVUeRy5ngtKKRTQdGrgcUOBOlXe1cCbSyRFClv8ZCz0QNvjPua8XcJxup6H1A8XdRtK240KQXPYUONwRy3Yo_ikxp5JcCsMEn_05NRMWPzkPMf2dJByITYjKyUlFqdVH8IF36PUR8dHmHHr8x1LJeBT4kg Aug 10 22:47:30.692026 n-d-850468-14 devstack@n-api.service[106658]: X-Domain-Id: None Aug 10 22:47:30.692026 n-d-850468-14 devstack@n-api.service[106658]: X-Domain-Name: None Aug 10 22:47:30.692026 n-d-850468-14 devstack@n-api.service[106658]: X-Identity-Status: Confirmed Aug 10 22:47:30.692026 n-d-850468-14 devstack@n-api.service[106658]: X-Is-Admin-Project: True Aug 10 22:47:30.692026 n-d-850468-14 devstack@n-api.service[106658]: X-Openstack-Nova-Api-Version: 2.90 Aug 10 22:47:30.692026 n-d-850468-14 devstack@n-api.service[106658]: X-Project-Domain-Id: default Aug 10 22:47:30.692026 n-d-850468-14 devstack@n-api.service[106658]: X-Project-Domain-Name: Default Aug 10 22:47:30.692026 n-d-850468-14 devstack@n-api.service[106658]: X-Project-Id: e8acc9bb8b864134a30aa7c461e1ca6a Aug 10 22:47:30.692026 n-d-850468-14 devstack@n-api.service[106658]: X-Project-Name: admin Aug 10 22:47:30.692026 n-d-850468-14 devstack@n-api.service[106658]: X-Role: admin,member,reader Aug 10 22:47:30.692026 n-d-850468-14 devstack@n-api.service[106658]: X-Roles: admin,member,reader Aug 10 22:47:30.693581 n-d-850468-14 devstack@n-api.service[106658]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e8acc9bb8b864134a30aa7c461e1ca6a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e8acc9bb8b864134a30aa7c461e1ca6a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/e8acc9bb8b864134a30aa7c461e1ca6a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_e8acc9bb8b864134a30aa7c461e1ca6a", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 22:47:30.693581 n-d-850468-14 devstack@n-api.service[106658]: X-Tenant: admin Aug 10 22:47:30.693581 n-d-850468-14 devstack@n-api.service[106658]: X-Tenant-Id: e8acc9bb8b864134a30aa7c461e1ca6a Aug 10 22:47:30.693581 n-d-850468-14 devstack@n-api.service[106658]: X-Tenant-Name: admin Aug 10 22:47:30.693581 n-d-850468-14 devstack@n-api.service[106658]: X-User: admin Aug 10 22:47:30.693581 n-d-850468-14 devstack@n-api.service[106658]: X-User-Domain-Id: default Aug 10 22:47:30.693581 n-d-850468-14 devstack@n-api.service[106658]: X-User-Domain-Name: Default Aug 10 22:47:30.693581 n-d-850468-14 devstack@n-api.service[106658]: X-User-Id: 9660d2d67a7e4daeafa7c00b8c9f29dc Aug 10 22:47:30.693581 n-d-850468-14 devstack@n-api.service[106658]: X-User-Name: admin Aug 10 22:47:30.693581 n-d-850468-14 devstack@n-api.service[106658]: method: > Aug 10 22:47:30.693581 n-d-850468-14 devstack@n-api.service[106658]: exception: Flavor 451 could not be found. Aug 10 22:47:30.693581 n-d-850468-14 devstack@n-api.service[106658]: action_args: {'id': '451'} Aug 10 22:47:30.693581 n-d-850468-14 devstack@n-api.service[106658]: {{(pid=106658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 22:47:30.693581 n-d-850468-14 devstack@n-api.service[106658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:47:30.694494 n-d-850468-14 devstack@n-api.service[106658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 10 22:47:30.694494 n-d-850468-14 devstack@n-api.service[106658]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 10 22:47:30.694494 n-d-850468-14 devstack@n-api.service[106658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 10 22:47:30.694494 n-d-850468-14 devstack@n-api.service[106658]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 10 22:47:30.694494 n-d-850468-14 devstack@n-api.service[106658]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 10 22:47:30.694494 n-d-850468-14 devstack@n-api.service[106658]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 10 22:47:30.694494 n-d-850468-14 devstack@n-api.service[106658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 10 22:47:30.694494 n-d-850468-14 devstack@n-api.service[106658]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 10 22:47:30.694494 n-d-850468-14 devstack@n-api.service[106658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 10 22:47:30.694494 n-d-850468-14 devstack@n-api.service[106658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 22:47:30.694494 n-d-850468-14 devstack@n-api.service[106658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 10 22:47:30.694494 n-d-850468-14 devstack@n-api.service[106658]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 10 22:47:30.694494 n-d-850468-14 devstack@n-api.service[106658]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 10 22:47:30.694494 n-d-850468-14 devstack@n-api.service[106658]: ERROR nova.api.openstack.wsgi Aug 10 22:47:30.694494 n-d-850468-14 devstack@n-api.service[106658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:47:30.694494 n-d-850468-14 devstack@n-api.service[106658]: ERROR nova.api.openstack.wsgi Aug 10 22:47:30.694494 n-d-850468-14 devstack@n-api.service[106658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:47:30.694494 n-d-850468-14 devstack@n-api.service[106658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:47:30.694494 n-d-850468-14 devstack@n-api.service[106658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:47:30.696005 n-d-850468-14 devstack@n-api.service[106658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 22:47:30.696005 n-d-850468-14 devstack@n-api.service[106658]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 22:47:30.696005 n-d-850468-14 devstack@n-api.service[106658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 22:47:30.696005 n-d-850468-14 devstack@n-api.service[106658]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 22:47:30.696005 n-d-850468-14 devstack@n-api.service[106658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 10 22:47:30.696005 n-d-850468-14 devstack@n-api.service[106658]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 10 22:47:30.696005 n-d-850468-14 devstack@n-api.service[106658]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 10 22:47:30.696005 n-d-850468-14 devstack@n-api.service[106658]: ERROR nova.api.openstack.wsgi Aug 10 22:47:30.696005 n-d-850468-14 devstack@n-api.service[106658]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:47:30.696005 n-d-850468-14 devstack@n-api.service[106658]: ERROR nova.api.openstack.wsgi Aug 10 22:47:30.696005 n-d-850468-14 devstack@n-api.service[106658]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:47:30.696005 n-d-850468-14 devstack@n-api.service[106658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:47:30.696005 n-d-850468-14 devstack@n-api.service[106658]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:47:30.696005 n-d-850468-14 devstack@n-api.service[106658]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 22:47:30.696005 n-d-850468-14 devstack@n-api.service[106658]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 22:47:30.696005 n-d-850468-14 devstack@n-api.service[106658]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 10 22:47:30.696005 n-d-850468-14 devstack@n-api.service[106658]: ERROR nova.api.openstack.wsgi Aug 10 22:47:30.696005 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi [None req-ee2c9651-7921-460f-9b44-8970390ee414 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106658) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 22:47:30.697299 n-d-850468-14 devstack@n-api.service[106658]: INFO nova.api.openstack.requestlog [None req-ee2c9651-7921-460f-9b44-8970390ee414 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012727 Aug 10 22:47:30.697299 n-d-850468-14 devstack@n-api.service[106658]: [pid: 106658|app: 0|req: 27/52] 10.222.0.58 () {60 vars in 1193 bytes} [Wed Aug 10 22:47:30 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 10 22:47:31.692067 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi [None req-efcb645e-6b7a-4333-98de-4eea87100dbe admin admin] Calling method '>' {{(pid=106659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:47:31.693104 n-d-850468-14 devstack@n-api.service[106659]: INFO nova.api.openstack.requestlog [None req-efcb645e-6b7a-4333-98de-4eea87100dbe admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001478 Aug 10 22:47:31.693485 n-d-850468-14 devstack@n-api.service[106659]: [pid: 106659|app: 0|req: 26/53] 10.222.0.58 () {56 vars in 1074 bytes} [Wed Aug 10 22:47:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:47:32.226422 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi [None req-87908997-9ad7-4cb0-be7c-b2e008de2146 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:47:32.245093 n-d-850468-14 devstack@n-api.service[106658]: INFO nova.api.openstack.requestlog [None req-87908997-9ad7-4cb0-be7c-b2e008de2146 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.411749 Aug 10 22:47:32.245629 n-d-850468-14 devstack@n-api.service[106658]: [pid: 106658|app: 0|req: 28/54] 10.222.0.58 () {64 vars in 1235 bytes} [Wed Aug 10 22:47:31 2022] POST /compute/v2.1/flavors => generated 404 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 22:47:33.276700 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi [None req-efcb645e-6b7a-4333-98de-4eea87100dbe admin admin] Calling method '>' {{(pid=106659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:47:33.278038 n-d-850468-14 devstack@n-api.service[106659]: INFO nova.api.openstack.requestlog [None req-efcb645e-6b7a-4333-98de-4eea87100dbe admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002792 Aug 10 22:47:33.278431 n-d-850468-14 devstack@n-api.service[106659]: [pid: 106659|app: 0|req: 27/55] 10.222.0.58 () {56 vars in 1074 bytes} [Wed Aug 10 22:47:33 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:47:33.824034 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi [None req-aff02ebf-9242-400b-ba17-fb2ae4b0c279 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:47:33.849486 n-d-850468-14 devstack@n-api.service[106658]: INFO nova.api.openstack.requestlog [None req-aff02ebf-9242-400b-ba17-fb2ae4b0c279 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.420492 Aug 10 22:47:33.849963 n-d-850468-14 devstack@n-api.service[106658]: [pid: 106658|app: 0|req: 29/56] 10.222.0.58 () {64 vars in 1235 bytes} [Wed Aug 10 22:47:33 2022] POST /compute/v2.1/flavors => generated 405 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 22:47:34.846651 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi [None req-efcb645e-6b7a-4333-98de-4eea87100dbe admin admin] Calling method '>' {{(pid=106659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:47:34.847699 n-d-850468-14 devstack@n-api.service[106659]: INFO nova.api.openstack.requestlog [None req-efcb645e-6b7a-4333-98de-4eea87100dbe admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Aug 10 22:47:34.848094 n-d-850468-14 devstack@n-api.service[106659]: [pid: 106659|app: 0|req: 28/57] 10.222.0.58 () {56 vars in 1074 bytes} [Wed Aug 10 22:47:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:47:35.376180 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi [None req-eef8e9ac-ed25-4e79-8bc9-712265b31e2b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:47:35.396667 n-d-850468-14 devstack@n-api.service[106658]: INFO nova.api.openstack.requestlog [None req-eef8e9ac-ed25-4e79-8bc9-712265b31e2b admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.409109 Aug 10 22:47:35.397272 n-d-850468-14 devstack@n-api.service[106658]: [pid: 106658|app: 0|req: 30/58] 10.222.0.58 () {64 vars in 1235 bytes} [Wed Aug 10 22:47:34 2022] POST /compute/v2.1/flavors => generated 407 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 22:47:36.491860 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi [None req-efcb645e-6b7a-4333-98de-4eea87100dbe admin admin] Calling method '>' {{(pid=106659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:47:36.492868 n-d-850468-14 devstack@n-api.service[106659]: INFO nova.api.openstack.requestlog [None req-efcb645e-6b7a-4333-98de-4eea87100dbe admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 Aug 10 22:47:36.493258 n-d-850468-14 devstack@n-api.service[106659]: [pid: 106659|app: 0|req: 29/59] 10.222.0.58 () {56 vars in 1074 bytes} [Wed Aug 10 22:47:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:47:37.017451 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi [None req-94892828-a156-48ce-b61e-fcabb0123083 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:47:37.037878 n-d-850468-14 devstack@n-api.service[106658]: INFO nova.api.openstack.requestlog [None req-94892828-a156-48ce-b61e-fcabb0123083 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.407027 Aug 10 22:47:37.038376 n-d-850468-14 devstack@n-api.service[106658]: [pid: 106658|app: 0|req: 31/60] 10.222.0.58 () {64 vars in 1235 bytes} [Wed Aug 10 22:47:36 2022] POST /compute/v2.1/flavors => generated 409 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 22:47:38.127979 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi [None req-efcb645e-6b7a-4333-98de-4eea87100dbe admin admin] Calling method '>' {{(pid=106659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:47:38.128978 n-d-850468-14 devstack@n-api.service[106659]: INFO nova.api.openstack.requestlog [None req-efcb645e-6b7a-4333-98de-4eea87100dbe admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 Aug 10 22:47:38.129368 n-d-850468-14 devstack@n-api.service[106659]: [pid: 106659|app: 0|req: 30/61] 10.222.0.58 () {56 vars in 1074 bytes} [Wed Aug 10 22:47:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:47:38.663949 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi [None req-f01bb9b0-373b-4040-989d-8516f9a4c44a admin admin] Calling method '>' {{(pid=106658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:47:38.685639 n-d-850468-14 devstack@n-api.service[106658]: INFO nova.api.openstack.requestlog [None req-f01bb9b0-373b-4040-989d-8516f9a4c44a admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.416667 Aug 10 22:47:38.686116 n-d-850468-14 devstack@n-api.service[106658]: [pid: 106658|app: 0|req: 32/62] 10.222.0.58 () {60 vars in 1202 bytes} [Wed Aug 10 22:47:38 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:48:30.535510 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi [None req-efcb645e-6b7a-4333-98de-4eea87100dbe admin admin] Calling method '>' {{(pid=106659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:30.536510 n-d-850468-14 devstack@n-api.service[106659]: INFO nova.api.openstack.requestlog [None req-efcb645e-6b7a-4333-98de-4eea87100dbe admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 Aug 10 22:48:30.536906 n-d-850468-14 devstack@n-api.service[106659]: [pid: 106659|app: 0|req: 31/63] 10.222.0.58 () {54 vars in 931 bytes} [Wed Aug 10 22:48:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:48:30.548949 n-d-850468-14 devstack@n-api.service[106658]: DEBUG dbcounter [-] [106658] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=106658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:48:30.933108 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi [None req-7a759add-5579-4d96-83fa-0ce8605b0d72 admin admin] Calling method '>' {{(pid=106658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:30.954127 n-d-850468-14 devstack@n-api.service[106658]: INFO nova.api.openstack.requestlog [None req-7a759add-5579-4d96-83fa-0ce8605b0d72 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.410569 Aug 10 22:48:30.954595 n-d-850468-14 devstack@n-api.service[106658]: [pid: 106658|app: 0|req: 33/64] 10.222.0.58 () {60 vars in 1292 bytes} [Wed Aug 10 22:48:30 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:48:30.975433 n-d-850468-14 devstack@n-api.service[106659]: DEBUG dbcounter [-] [106659] Writing DB stats nova_api:SELECT=14 {{(pid=106659) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:48:30.979939 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi [None req-da7e9681-6a16-4ae1-afb2-480dd7e0f264 admin admin] Calling method '>' {{(pid=106659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:30.987536 n-d-850468-14 devstack@n-api.service[106659]: INFO nova.api.openstack.requestlog [None req-da7e9681-6a16-4ae1-afb2-480dd7e0f264 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013666 Aug 10 22:48:30.988060 n-d-850468-14 devstack@n-api.service[106659]: [pid: 106659|app: 0|req: 32/65] 10.222.0.58 () {60 vars in 1283 bytes} [Wed Aug 10 22:48:30 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:48:31.000485 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi [None req-fdebf7a4-3fbb-401a-9c2b-91b7c45fd923 admin admin] Calling method '>' {{(pid=106658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:31.008141 n-d-850468-14 devstack@n-api.service[106658]: INFO nova.api.openstack.requestlog [None req-fdebf7a4-3fbb-401a-9c2b-91b7c45fd923 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011351 Aug 10 22:48:31.008682 n-d-850468-14 devstack@n-api.service[106658]: [pid: 106658|app: 0|req: 34/66] 10.222.0.58 () {60 vars in 1286 bytes} [Wed Aug 10 22:48:30 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:48:31.020326 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi [None req-64b2c8b5-6e64-4e1e-b1fe-cdf638ccf58a admin admin] Calling method '>' {{(pid=106659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:31.028560 n-d-850468-14 devstack@n-api.service[106659]: INFO nova.api.openstack.requestlog [None req-64b2c8b5-6e64-4e1e-b1fe-cdf638ccf58a admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011972 Aug 10 22:48:31.029088 n-d-850468-14 devstack@n-api.service[106659]: [pid: 106659|app: 0|req: 33/67] 10.222.0.58 () {60 vars in 1286 bytes} [Wed Aug 10 22:48:31 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:48:31.040304 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi [None req-47728ba1-e58e-4377-a6f1-47d51639214b admin admin] Calling method '>' {{(pid=106658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:48:31.048819 n-d-850468-14 devstack@n-api.service[106658]: INFO nova.api.openstack.requestlog [None req-47728ba1-e58e-4377-a6f1-47d51639214b admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012026 Aug 10 22:48:31.049337 n-d-850468-14 devstack@n-api.service[106658]: [pid: 106658|app: 0|req: 35/68] 10.222.0.58 () {60 vars in 1283 bytes} [Wed Aug 10 22:48:31 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:53:51.524751 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi [None req-64b2c8b5-6e64-4e1e-b1fe-cdf638ccf58a admin admin] Calling method '>' {{(pid=106659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:53:51.525774 n-d-850468-14 devstack@n-api.service[106659]: INFO nova.api.openstack.requestlog [None req-64b2c8b5-6e64-4e1e-b1fe-cdf638ccf58a admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Aug 10 22:53:51.526168 n-d-850468-14 devstack@n-api.service[106659]: [pid: 106659|app: 0|req: 34/69] 10.222.0.58 () {56 vars in 1074 bytes} [Wed Aug 10 22:53:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:53:51.669629 n-d-850468-14 devstack@n-api.service[106658]: DEBUG dbcounter [-] [106658] Writing DB stats nova_api:SELECT=6 {{(pid=106658) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:53:51.810939 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi [None req-4b6fd0d0-562b-4ece-a64c-773849e35455 admin admin] Calling method '>' {{(pid=106658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:53:51.813451 n-d-850468-14 devstack@n-api.service[106658]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:53:51.813451 n-d-850468-14 devstack@n-api.service[106658]: warnings.warn(msg) Aug 10 22:53:51.814590 n-d-850468-14 devstack@n-api.service[106658]: DEBUG oslo_concurrency.lockutils [None req-4b6fd0d0-562b-4ece-a64c-773849e35455 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:53:51.815106 n-d-850468-14 devstack@n-api.service[106658]: DEBUG oslo_concurrency.lockutils [None req-4b6fd0d0-562b-4ece-a64c-773849e35455 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:53:51.815540 n-d-850468-14 devstack@n-api.service[106658]: DEBUG oslo_concurrency.lockutils [None req-4b6fd0d0-562b-4ece-a64c-773849e35455 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:53:51.816290 n-d-850468-14 devstack@n-api.service[106658]: DEBUG oslo_concurrency.lockutils [None req-4b6fd0d0-562b-4ece-a64c-773849e35455 admin admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:53:51.816738 n-d-850468-14 devstack@n-api.service[106658]: DEBUG oslo_concurrency.lockutils [None req-4b6fd0d0-562b-4ece-a64c-773849e35455 admin admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:53:51.817158 n-d-850468-14 devstack@n-api.service[106658]: DEBUG oslo_concurrency.lockutils [None req-4b6fd0d0-562b-4ece-a64c-773849e35455 admin admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:53:51.858624 n-d-850468-14 devstack@n-api.service[106658]: INFO nova.api.openstack.requestlog [None req-4b6fd0d0-562b-4ece-a64c-773849e35455 admin admin] 10.222.0.58 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.90 time: 0.191018 Aug 10 22:53:51.859217 n-d-850468-14 devstack@n-api.service[106658]: [pid: 106658|app: 0|req: 36/70] 10.222.0.58 () {60 vars in 1193 bytes} [Wed Aug 10 22:53:51 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:53:52.689039 n-d-850468-14 devstack@n-api.service[106659]: DEBUG nova.api.openstack.wsgi [None req-64b2c8b5-6e64-4e1e-b1fe-cdf638ccf58a admin admin] Calling method '>' {{(pid=106659) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:53:52.690074 n-d-850468-14 devstack@n-api.service[106659]: INFO nova.api.openstack.requestlog [None req-64b2c8b5-6e64-4e1e-b1fe-cdf638ccf58a admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001416 Aug 10 22:53:52.690465 n-d-850468-14 devstack@n-api.service[106659]: [pid: 106659|app: 0|req: 35/71] 10.222.0.58 () {56 vars in 1074 bytes} [Wed Aug 10 22:53:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:53:52.882383 n-d-850468-14 devstack@n-api.service[106658]: DEBUG nova.api.openstack.wsgi [None req-1b3108fc-b0bc-49f2-a352-b1dba6a24d31 admin admin] Calling method '>' {{(pid=106658) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:53:52.884872 n-d-850468-14 devstack@n-api.service[106658]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:53:52.884872 n-d-850468-14 devstack@n-api.service[106658]: warnings.warn(msg) Aug 10 22:53:52.886011 n-d-850468-14 devstack@n-api.service[106658]: DEBUG oslo_concurrency.lockutils [None req-1b3108fc-b0bc-49f2-a352-b1dba6a24d31 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:53:52.886682 n-d-850468-14 devstack@n-api.service[106658]: DEBUG oslo_concurrency.lockutils [None req-1b3108fc-b0bc-49f2-a352-b1dba6a24d31 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:53:52.887045 n-d-850468-14 devstack@n-api.service[106658]: DEBUG oslo_concurrency.lockutils [None req-1b3108fc-b0bc-49f2-a352-b1dba6a24d31 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:53:52.887768 n-d-850468-14 devstack@n-api.service[106658]: DEBUG oslo_concurrency.lockutils [None req-1b3108fc-b0bc-49f2-a352-b1dba6a24d31 admin admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:53:52.888218 n-d-850468-14 devstack@n-api.service[106658]: DEBUG oslo_concurrency.lockutils [None req-1b3108fc-b0bc-49f2-a352-b1dba6a24d31 admin admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:53:52.888640 n-d-850468-14 devstack@n-api.service[106658]: DEBUG oslo_concurrency.lockutils [None req-1b3108fc-b0bc-49f2-a352-b1dba6a24d31 admin admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106658) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:53:52.911823 n-d-850468-14 devstack@n-api.service[106658]: INFO nova.api.openstack.requestlog [None req-1b3108fc-b0bc-49f2-a352-b1dba6a24d31 admin admin] 10.222.0.58 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.90 time: 0.082130 Aug 10 22:53:52.912371 n-d-850468-14 devstack@n-api.service[106658]: [pid: 106658|app: 0|req: 37/72] 10.222.0.58 () {60 vars in 1193 bytes} [Wed Aug 10 22:53:52 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:54:38.779933 n-d-850468-14 devstack@n-api.service[106657]: Wed Aug 10 22:54:38 2022 - graceful shutdown triggered... Aug 10 22:54:38.780046 n-d-850468-14 systemd[1]: Stopping Devstack devstack@n-api.service... Aug 10 22:54:38.781076 n-d-850468-14 devstack@n-api.service[106659]: Gracefully killing worker 2 (pid: 106659)... Aug 10 22:54:38.781457 n-d-850468-14 devstack@n-api.service[106658]: Gracefully killing worker 1 (pid: 106658)... Aug 10 22:54:39.781531 n-d-850468-14 devstack@n-api.service[106657]: worker 1 buried after 1 seconds Aug 10 22:54:39.781531 n-d-850468-14 devstack@n-api.service[106657]: worker 2 buried after 1 seconds Aug 10 22:54:39.781531 n-d-850468-14 devstack@n-api.service[106657]: goodbye to uWSGI. Aug 10 22:54:39.783361 n-d-850468-14 systemd[1]: devstack@n-api.service: Succeeded. Aug 10 22:54:39.783968 n-d-850468-14 systemd[1]: Stopped Devstack devstack@n-api.service. Aug 10 22:54:39.786967 n-d-850468-14 systemd[1]: Starting Devstack devstack@n-api.service... Aug 10 22:54:39.802983 n-d-850468-14 devstack@n-api.service[122622]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 10 22:54:39.824086 n-d-850468-14 devstack@n-api.service[122622]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 10 22:54:39 2022] *** Aug 10 22:54:39.824086 n-d-850468-14 devstack@n-api.service[122622]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 10 22:54:39.824086 n-d-850468-14 devstack@n-api.service[122622]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 10 22:54:39.824086 n-d-850468-14 devstack@n-api.service[122622]: nodename: n-d-850468-14 Aug 10 22:54:39.824086 n-d-850468-14 devstack@n-api.service[122622]: machine: x86_64 Aug 10 22:54:39.824086 n-d-850468-14 devstack@n-api.service[122622]: clock source: unix Aug 10 22:54:39.824086 n-d-850468-14 devstack@n-api.service[122622]: pcre jit disabled Aug 10 22:54:39.824086 n-d-850468-14 devstack@n-api.service[122622]: detected number of CPU cores: 4 Aug 10 22:54:39.824086 n-d-850468-14 devstack@n-api.service[122622]: current working directory: / Aug 10 22:54:39.824086 n-d-850468-14 devstack@n-api.service[122622]: detected binary path: /usr/bin/uwsgi-core Aug 10 22:54:39.824086 n-d-850468-14 devstack@n-api.service[122622]: your processes number limit is 47680 Aug 10 22:54:39.824086 n-d-850468-14 devstack@n-api.service[122622]: your memory page size is 4096 bytes Aug 10 22:54:39.824086 n-d-850468-14 devstack@n-api.service[122622]: detected max file descriptor number: 2048 Aug 10 22:54:39.824086 n-d-850468-14 devstack@n-api.service[122622]: lock engine: pthread robust mutexes Aug 10 22:54:39.825030 n-d-850468-14 devstack@n-api.service[122622]: thunder lock: enabled Aug 10 22:54:39.825030 n-d-850468-14 devstack@n-api.service[122622]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 10 22:54:39.825030 n-d-850468-14 devstack@n-api.service[122622]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 10 22:54:39.867151 n-d-850468-14 devstack@n-api.service[122622]: Python main interpreter initialized at 0x560ec1d989c0 Aug 10 22:54:39.867151 n-d-850468-14 devstack@n-api.service[122622]: python threads support enabled Aug 10 22:54:39.867151 n-d-850468-14 devstack@n-api.service[122622]: your server socket listen backlog is limited to 100 connections Aug 10 22:54:39.867151 n-d-850468-14 devstack@n-api.service[122622]: your mercy for graceful operations on workers is 90 seconds Aug 10 22:54:39.867609 n-d-850468-14 devstack@n-api.service[122622]: mapped 403077 bytes (393 KB) for 2 cores Aug 10 22:54:39.867609 n-d-850468-14 devstack@n-api.service[122622]: *** Operational MODE: preforking *** Aug 10 22:54:39.867860 n-d-850468-14 devstack@n-api.service[122622]: *** uWSGI is running in multiple interpreter mode *** Aug 10 22:54:39.867860 n-d-850468-14 devstack@n-api.service[122622]: spawned uWSGI master process (pid: 122622) Aug 10 22:54:39.868066 n-d-850468-14 systemd[1]: Started Devstack devstack@n-api.service. Aug 10 22:54:39.868657 n-d-850468-14 devstack@n-api.service[122622]: spawned uWSGI worker 1 (pid: 122632, cores: 1) Aug 10 22:54:39.869164 n-d-850468-14 devstack@n-api.service[122622]: spawned uWSGI worker 2 (pid: 122633, cores: 1) Aug 10 22:54:39.869479 n-d-850468-14 devstack@n-api.service[122622]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 10 22:54:40.537367 n-d-850468-14 devstack@n-api.service[122633]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 10 22:54:40.545122 n-d-850468-14 devstack@n-api.service[122632]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 10 22:54:41.714740 n-d-850468-14 devstack@n-api.service[122632]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 22:54:41.714740 n-d-850468-14 devstack@n-api.service[122632]: from cryptography.utils import int_from_bytes Aug 10 22:54:41.715482 n-d-850468-14 devstack@n-api.service[122632]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 22:54:41.715482 n-d-850468-14 devstack@n-api.service[122632]: from cryptography.utils import int_from_bytes Aug 10 22:54:41.724096 n-d-850468-14 devstack@n-api.service[122633]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 22:54:41.724096 n-d-850468-14 devstack@n-api.service[122633]: from cryptography.utils import int_from_bytes Aug 10 22:54:41.724583 n-d-850468-14 devstack@n-api.service[122633]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 10 22:54:41.724583 n-d-850468-14 devstack@n-api.service[122633]: from cryptography.utils import int_from_bytes Aug 10 22:54:44.088399 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 10 22:54:44.089020 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 10 22:54:44.089109 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 10 22:54:44.089464 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 10 22:54:44.089721 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 10 22:54:44.090111 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.090441 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.090765 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.091107 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.091445 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.091756 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.092079 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.092398 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.092729 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.092989 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.093304 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.093626 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-850468-14 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.093950 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.094259 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.094567 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.094915 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.095224 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.095547 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.095855 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.096355 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.097752 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.097752 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.097752 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.098023 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.098269 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.098597 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.098949 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.099273 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.099591 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.099912 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.100961 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-850468-14 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.101294 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.101612 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.101926 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.102348 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.102659 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.102992 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.103313 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.103653 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.103963 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.104287 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.104608 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.104929 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.105208 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 10 22:54:44.105755 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.105912 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 10 22:54:44.106055 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.106209 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 10 22:54:44.106393 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.106393 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.106705 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 10 22:54:44.106705 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 10 22:54:44.107040 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.107040 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.107317 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.107473 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.107627 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.107873 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.108035 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.108186 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.108383 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.108625 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.108840 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.109053 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.109244 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.109424 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.109610 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.109764 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.109764 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.110053 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.110204 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.110383 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.110383 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.110668 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.110868 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.111026 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.111026 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.111347 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-850468-14 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.111494 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.111661 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.111808 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.111976 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.112131 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.112283 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.112433 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.112585 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.112726 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.112866 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.113014 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.113177 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.113329 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.113481 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.113629 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.113778 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.113947 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.114754 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.114955 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.115113 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.115256 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.115408 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.115576 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.58 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.115728 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.115881 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.58 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.116061 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.116214 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.116460 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.116621 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.116790 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.116947 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.117098 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.117302 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.117499 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.117644 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.117805 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.117993 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.117993 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.118285 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-850468-14 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.118436 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.118590 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.118743 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.118909 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.119065 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.119220 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.119369 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.119522 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.119683 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.119834 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.119977 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.120130 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.120272 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.120272 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.120545 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.120695 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.120851 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.121001 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.121151 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.121301 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.121443 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.121602 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.121756 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.121908 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.122050 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.122203 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.122352 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.122495 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.122645 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.122870 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.123588 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.123688 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.123782 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.123870 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.123957 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.124032 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.124115 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.124199 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.124278 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.124369 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.124461 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.124461 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.124631 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.124728 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.124815 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.124916 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.125003 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.125086 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.125171 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.125261 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.125355 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.125451 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.125537 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.125632 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.125728 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.125814 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.125909 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.126003 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.126096 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.126194 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.126281 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.126373 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.126458 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.126541 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.126624 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.126716 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.126835 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.126940 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.127035 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.127137 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.127292 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.127495 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.127649 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.127804 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.127952 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.128147 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.128291 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.128443 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.128587 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.128737 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.128892 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.129045 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.129201 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.129354 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.58 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.129497 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.129645 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.58 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.129788 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.129940 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.130093 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.130245 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.130395 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.130546 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.130688 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.130875 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.131037 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.131183 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.131342 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.131523 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.131721 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.131933 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.132160 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.132307 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.132457 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.132457 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.132726 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.132882 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.133035 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.133199 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.133349 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.133514 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.133663 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.133815 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.133957 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.134111 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.134255 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.134405 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.134547 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.134705 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.134887 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.135135 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.135387 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.135682 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.135843 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.136162 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.136341 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.136637 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.136780 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.137064 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.137314 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.137758 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.137928 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.138129 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.138288 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.138440 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.138603 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.138761 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.138927 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.139081 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.139232 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.139374 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.139530 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.139672 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.139824 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.139973 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.140123 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.140264 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.140414 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.140567 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.140724 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.140882 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.141032 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.141185 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.141328 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.141480 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.141630 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.141783 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.141936 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.142087 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.142230 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.142230 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.142523 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.142678 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.142873 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.143034 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.143177 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.143324 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.143480 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.143624 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.143772 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.143913 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.144054 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.144194 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.144362 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.144505 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.144653 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.144805 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.144948 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.145098 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.145361 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.145584 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.145888 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.146041 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.146345 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.146667 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.146855 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.147044 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.147945 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.148102 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.148288 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.148450 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.148593 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.148754 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.148915 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.149065 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.149216 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.149615 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.149776 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.149920 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.150082 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.150234 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.150388 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.150530 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.150530 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.150882 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.151033 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.151176 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.151330 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.151474 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.151624 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.151767 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.151918 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 10 22:54:44.152080 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.152229 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.152372 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.152372 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.152655 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.152804 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.152953 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.153105 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.153264 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.153407 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.153557 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.153709 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.153870 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.154013 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.154170 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.154314 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.154463 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.154612 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.154761 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.154928 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.155085 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.155239 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.155470 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.155983 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.156150 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.156472 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.156624 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.156947 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.157106 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.157249 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.157399 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.157552 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.157694 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.157863 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.158183 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.158394 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.158550 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.158708 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.158916 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.159063 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.159205 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.159353 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.159497 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.159652 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.159804 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.160064 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.160226 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.160380 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.160534 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.160677 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.160818 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.160983 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.161135 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.161278 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.161501 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.161647 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.161647 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.161924 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.162066 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.162207 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.162207 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.162491 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.162641 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.163460 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.163664 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.163883 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.164360 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.164589 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.164842 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.165028 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.165184 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.165339 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.165501 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.165739 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.166092 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.166243 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.166556 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.166728 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.167090 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.167257 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.167402 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.167543 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.167683 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.167838 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.167838 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.168143 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.168508 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.168664 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.168808 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.168973 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.168973 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.169253 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.169440 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.169587 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.169742 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.169886 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.170034 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.170185 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.170326 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.170467 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.170620 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.170799 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.170951 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.171104 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.171246 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.171388 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.171543 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.171686 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.171835 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.171979 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.172120 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.172267 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.172435 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.172663 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.172828 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.172971 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.173112 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.173267 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.173410 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.173558 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.173744 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.173893 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.174035 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.174186 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.174337 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.174479 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.174619 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.174829 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.174978 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.175138 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.175393 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.175565 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.175736 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.176164 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.176326 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.176481 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.176777 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.176926 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.177238 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.177387 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.177550 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.177708 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.177851 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.177992 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.178133 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.178284 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.180002 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.180166 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.180559 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.180722 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.180868 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.181022 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.181164 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.181313 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.181458 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.181609 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.181754 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.181906 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.182050 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.182192 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.182344 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.182490 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.182639 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.182812 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.182974 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.183117 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.183272 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.183416 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.183558 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.183708 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.183864 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.184015 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.184174 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.184318 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.184460 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.184602 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.184754 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.184905 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.185058 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.185202 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.185353 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.185508 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.185661 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.185813 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.185975 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.186423 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.186583 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.186953 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.187115 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.187479 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.187632 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.187785 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.187928 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.188070 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.188212 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.188368 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.188512 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.188665 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.188927 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.189144 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.189396 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.189627 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.189801 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.189954 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.190098 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.190241 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.190241 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.190520 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.190662 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.190842 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.191001 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.191145 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.191297 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.191440 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.191800 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.191968 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.192119 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.192269 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.192427 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.192578 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.192722 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.192870 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.193021 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.193324 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.193493 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.193646 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.193796 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.193948 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.194576 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.194741 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.194978 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.195081 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.195155 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.195226 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.195297 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.195444 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.195519 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.195596 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.195675 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.195755 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.195827 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.195912 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.195985 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.196055 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.196125 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.196213 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.196629 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.196740 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.196844 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.197108 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.197207 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.197300 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.197414 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.197522 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.197606 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.197699 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.197792 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.197886 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.197984 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.198077 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.198169 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.198253 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.198336 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.198425 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.198523 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.198523 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.198686 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.198770 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.198926 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.199012 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.199253 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.199380 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.199469 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.199560 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.199646 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.199729 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.199822 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.199907 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.199989 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.200071 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.200160 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.200254 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.200347 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.200439 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.200540 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.200624 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.200714 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.200812 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.200904 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.200988 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.201080 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.201080 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.201080 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.201325 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.201410 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.201492 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.201581 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.201665 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.201754 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.201850 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.201943 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.202033 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.202123 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.202214 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.202310 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.202395 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.202476 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.202565 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.202648 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.202730 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.202850 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.202950 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.203035 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.203125 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.203222 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.203313 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.203398 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.203487 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.203570 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.203675 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.203760 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.203849 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.203932 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.204028 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.204119 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.204217 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.204308 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.204400 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.204490 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.204573 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.204662 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.204755 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.204840 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.204930 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.205018 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.205102 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.205184 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.205279 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.205363 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.205446 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.205527 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.205616 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.205713 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.205805 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.205896 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.205986 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.206077 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.206167 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.206260 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.206351 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.206749 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.206901 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.207000 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.207141 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.207240 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.207334 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.207432 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.207528 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.207614 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.207706 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.207791 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.207873 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.207958 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.208038 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.208128 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.208225 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.208316 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.208437 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.208531 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.208615 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.208698 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.208794 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.208885 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.208977 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.209061 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.209143 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.209362 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.209464 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.209558 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.209678 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.210330 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.210449 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.210610 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.210709 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.210807 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.210883 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.210967 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.211220 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.211326 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.211660 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.211761 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.212063 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.212161 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.212562 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.212666 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.212969 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.213068 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.213300 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.213480 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.213615 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.213916 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.214008 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.214249 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.214346 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.214584 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.214764 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.215000 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.215263 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.215371 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.215572 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.215731 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.215885 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.216187 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.216336 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.216492 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.216641 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.216969 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.217100 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.217100 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.217337 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.217551 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.217680 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.217822 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.217958 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.218078 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.218187 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.218321 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.218446 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.218570 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.218705 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.218904 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.219041 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.219213 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.219419 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.219558 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.219678 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.219803 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.219932 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.220111 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.220249 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.220425 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.220578 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.220717 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.220855 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.221021 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.221153 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.221330 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.221657 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.221976 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.222282 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.222423 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.222591 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.222717 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.222959 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.223113 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.223314 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.223485 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.223612 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.223903 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.224046 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.224285 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.224439 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.224633 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.224767 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.225077 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.225214 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.225467 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.225710 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.225996 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.226283 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.226387 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.226635 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.226862 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.227225 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.227362 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.227495 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.227624 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.227749 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.227888 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.228026 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.228154 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.228274 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.228409 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.228546 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.228689 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.228825 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.228951 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.229083 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.229298 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.229502 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.229635 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.229761 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.229897 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.230027 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.230228 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.230354 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.230548 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.230706 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.230903 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.231048 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.231189 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.231321 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.231498 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.231620 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.231815 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.231936 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.232128 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.232261 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.232443 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.232597 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.232748 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.232913 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.233046 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.233234 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.233365 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.233543 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.233674 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.233851 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.233994 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.234158 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.234290 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.234470 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.234601 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.234814 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.234970 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.235099 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.235236 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.235426 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.235557 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.235740 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.235884 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.236049 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.236181 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.236358 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.236490 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.236670 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.236822 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.236979 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.237301 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.237301 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.237554 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.237684 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.237820 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.237948 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.238094 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.238231 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.238362 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.238515 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.238644 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.238768 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.239064 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.239196 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.239332 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.239526 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.239669 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.239808 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.239964 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.240112 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.240259 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.241463 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.241631 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.241631 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.241920 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.242056 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.242222 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.242377 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.242377 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.242656 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.242835 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.243002 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.243170 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.243170 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.243461 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.243619 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.243774 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.243933 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.244088 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.244231 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.244389 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.244532 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.244686 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.244686 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.244974 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.245123 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.245264 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.245432 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.245591 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.245752 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.245903 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.245903 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.246216 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.246377 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.246535 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.246668 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.246757 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.246864 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.246937 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.247007 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.247089 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.247175 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.247266 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.247520 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.247606 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.247687 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.247759 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.247844 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.247926 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.248005 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.248085 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.248239 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.248342 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.248552 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.248645 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.248883 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.248974 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.249211 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.249319 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.249553 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.249651 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.249848 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.249930 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.250163 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.250268 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.250477 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.250640 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.250810 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.250984 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.251126 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.251301 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.251503 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.251630 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.251731 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.251958 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.252059 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.252284 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.252385 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.252594 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.252693 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.252913 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.253014 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.253227 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.253320 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.253553 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.253651 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.253867 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.253967 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.254176 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.254279 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.254489 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.254580 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.254812 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.255014 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.255133 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.255225 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.255447 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.255547 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.255756 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.255864 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.256069 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.256177 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.256383 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.256542 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.257383 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.257799 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.257799 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.257973 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.258081 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.258326 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.258495 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.258662 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.258908 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.259068 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.259161 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.259283 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.259390 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.259604 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.259703 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.259943 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.260055 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.260252 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.260360 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.260562 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.260670 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.260873 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.260974 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.261188 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.261323 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.261503 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.261610 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.261815 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.261908 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.262125 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.262218 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.262433 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.262530 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.262744 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.262857 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.263080 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.263180 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.263387 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.263478 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.263708 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.263799 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.264015 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.264106 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.264341 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.264433 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.264648 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.264765 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.264972 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.265073 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.265284 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.265385 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.265590 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.265787 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.265898 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.266106 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.266206 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.266421 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.266536 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.266749 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.266931 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.267115 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.267208 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.267445 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.267538 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.267760 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.267902 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.268080 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.268196 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.268393 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.268495 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.268727 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.268824 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.269054 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.269155 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.269370 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.269513 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.269687 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.269786 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.269992 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.270091 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.270300 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.270391 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.270610 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.270744 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.270953 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.271066 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.271263 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.271363 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.271569 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.271674 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.271879 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.271990 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.272206 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.272356 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.273040 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.273187 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.273352 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.273605 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.273707 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.273921 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.274024 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.274234 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.274335 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.274829 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.274931 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.275136 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.275227 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.275449 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.275578 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.275745 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.275846 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.276062 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.276153 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.276378 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.276478 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.276693 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.276784 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.277005 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.277097 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.277316 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.277416 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.277625 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.277717 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.277940 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.278069 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.278240 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.278344 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.278561 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.278666 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.278894 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.278988 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.279214 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.279316 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.279536 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.279698 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.279862 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.280001 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.280217 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.280377 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.280523 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.280686 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.280824 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.280959 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.281127 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.281305 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.281448 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.281631 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.281846 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.281997 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.282133 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.282279 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.282422 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.282553 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.282686 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.282886 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.283020 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.283168 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.283343 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.283481 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.283682 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.283840 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.284014 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.284160 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.284337 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.284472 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.284658 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.284801 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.284978 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.285114 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.285287 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.285422 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.285597 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.285743 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.285911 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.286050 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.286220 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.286375 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.286526 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.286656 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.286920 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.287061 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.287273 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.287424 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.287561 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.287691 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.287904 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.288087 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.288223 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.288366 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.288692 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.288838 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.288984 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.289175 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.289310 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.289451 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.289581 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.289715 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.289840 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.289966 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.290113 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.290293 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.290430 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.290571 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.290715 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.290895 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.291108 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.291264 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.291397 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.291540 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.291671 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.291805 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.292000 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.292136 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.292277 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.292412 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.292557 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.292699 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.292839 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.292980 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.293120 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.293252 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.293421 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.293568 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.293740 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.293871 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.294060 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.294368 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.294467 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.294684 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.294870 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.295031 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.295181 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.295350 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.295485 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.295727 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.295913 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.296049 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.296244 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.296390 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.296551 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.296682 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.296861 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.296999 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.297173 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.297307 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.297490 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.297626 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.297804 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.297940 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.298130 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.298276 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.298420 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.298564 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.298948 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.299102 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.299244 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.299377 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.299519 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.299670 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.299813 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.299954 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.300157 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.300311 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.300442 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.300582 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.300724 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.300856 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.300998 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.301198 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.301335 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.301475 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.301609 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.301784 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.301932 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.302137 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.302280 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.302421 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.302554 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.302694 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.302870 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.303008 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.303140 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.303313 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.303470 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.303647 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.303800 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.303968 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.304103 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.304281 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.304417 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.304586 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.304744 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.304888 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.305021 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.305191 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.305328 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.305519 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.305665 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.305826 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.305972 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.306121 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.306264 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.306477 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.306592 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.306880 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.307041 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.307202 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.307347 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.307589 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.307730 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.307861 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.308050 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.308241 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.308390 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.308523 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.308654 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.308816 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.308983 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.309103 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.309291 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.309399 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.309610 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.309763 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.309909 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.310041 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.310244 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.310392 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.310562 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.310670 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.310891 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.311040 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.311212 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.311310 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.311528 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.311743 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.311836 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.312139 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.312259 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.312468 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.312635 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.312783 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.313096 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.313246 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.313447 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.313583 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.313766 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.313903 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.314118 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.314352 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.314507 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.314742 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.314992 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.315127 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.315332 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.315480 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.315657 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.315789 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.315992 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.316137 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.316334 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.316503 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.316673 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.316838 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.316969 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.317095 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.317240 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.317378 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.317511 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.317641 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.317822 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.317956 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.318153 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.318332 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.318472 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.318623 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.318773 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.319613 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.319763 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.319916 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.320083 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.320251 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.320554 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.320672 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.320885 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.320994 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.321216 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.321392 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.344547 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.344756 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.344861 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.344949 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.345014 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.345104 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.345175 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.345257 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.345257 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.345387 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.345463 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.345533 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.345533 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.345678 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.345749 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.345829 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.345911 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.345977 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.346037 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.346103 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.346167 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.346254 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.346254 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.346367 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.346446 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.346528 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.346674 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.346759 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.346875 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.346955 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.347034 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.347128 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.347192 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.347192 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.347324 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.347403 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.347460 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.347460 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.347602 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.347703 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.347771 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.347851 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.347851 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.348001 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.348075 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.348144 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.348221 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.348296 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.348377 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.348511 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.348606 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.348756 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.348756 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.348910 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.348994 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.349078 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.349141 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.349207 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.349276 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.349344 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.349497 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.349587 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.349659 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.349734 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.349809 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.349897 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.349981 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.350050 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.350119 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.350190 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.350256 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.350391 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.350582 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.350582 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.350850 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.350919 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.350989 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.351050 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.351105 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.351160 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.351218 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.351300 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.351359 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.351414 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.351468 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.351536 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.351594 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.351649 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.351649 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.351744 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.351806 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.351863 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.351918 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.351972 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.352085 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.352161 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.352238 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.352307 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.352374 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.352440 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.352507 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.352574 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.352649 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.352756 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.352832 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.352889 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.352956 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.352956 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.353086 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.353153 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.353219 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.353285 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.353357 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.353430 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.353488 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.353543 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.353597 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.353694 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.353764 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.353821 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.353895 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.353963 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.354030 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.354097 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.354164 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.354232 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.354306 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.354376 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.354376 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.354376 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.354376 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.354376 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.354376 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.354376 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.354376 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.354797 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.354797 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.354797 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.354797 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.354797 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.354797 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.354797 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.354797 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.355206 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.355206 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.355206 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.355206 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.355206 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.355206 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.355206 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.355206 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.355620 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.355687 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.355754 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.355829 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.355899 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.355966 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.355966 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.356071 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.356127 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.356191 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.356248 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.356303 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.356357 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.356411 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.356478 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.356553 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.356623 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.356689 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.356756 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.356824 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.356899 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.356968 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.357036 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.357103 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.357169 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.357236 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.357310 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.357379 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.357446 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.357515 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.357582 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.357648 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.357723 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.357791 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.357859 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.357926 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.357993 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.358131 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.358203 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 10 22:54:44.358271 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.358271 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.358271 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.359081 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.359081 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.359257 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.359504 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.359817 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.360584 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.360584 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.360738 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.361161 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.361346 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.361655 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.361965 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.362275 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.362590 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.367272 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.367778 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.368405 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.370470 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.370470 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.370470 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.370763 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.371146 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.371495 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.371838 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.372186 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.372587 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.373006 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.373417 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.373734 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.374219 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.374637 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.375094 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.375422 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.375891 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.376218 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.376541 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.376863 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.377215 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.377551 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.377872 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.378229 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.378579 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.378934 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.379263 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.379582 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.379919 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.380237 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.380558 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.380875 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.381191 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.381509 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.382480 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.383019 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.383420 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.383747 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.384156 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.384410 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.384746 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.385065 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.385400 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.385735 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.386096 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.386417 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.386768 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.387138 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.387458 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.387778 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.388090 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 10 22:54:44.388339 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=122632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 10 22:54:44.511255 n-d-850468-14 devstack@n-api.service[122633]: INFO dbcounter [None req-c327f61b-c850-4206-b76f-2680b04621e5 None None] Registered counter for database nova_api Aug 10 22:54:44.532688 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_db.sqlalchemy.engines [None req-c327f61b-c850-4206-b76f-2680b04621e5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122633) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 22:54:44.539678 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writer thread running {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 22:54:44.540920 n-d-850468-14 devstack@n-api.service[122632]: INFO dbcounter [None req-38c74c41-c09d-4621-8267-80a9a5379f1c None None] Registered counter for database nova_api Aug 10 22:54:44.561369 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_db.sqlalchemy.engines [None req-38c74c41-c09d-4621-8267-80a9a5379f1c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122632) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 22:54:44.567951 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writer thread running {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 22:54:44.597069 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.context [None req-c327f61b-c850-4206-b76f-2680b04621e5 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c9127db4-59f9-48ac-9ab2-b5d6690bb85f(cell1) {{(pid=122633) load_cells /opt/stack/nova/nova/context.py:464}} Aug 10 22:54:44.601361 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c327f61b-c850-4206-b76f-2680b04621e5 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:54:44.602028 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c327f61b-c850-4206-b76f-2680b04621e5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:54:44.603710 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c327f61b-c850-4206-b76f-2680b04621e5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:54:44.604477 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c327f61b-c850-4206-b76f-2680b04621e5 None None] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:54:44.604951 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c327f61b-c850-4206-b76f-2680b04621e5 None None] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:54:44.607617 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c327f61b-c850-4206-b76f-2680b04621e5 None None] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:54:44.609662 n-d-850468-14 devstack@n-api.service[122633]: INFO dbcounter [None req-c327f61b-c850-4206-b76f-2680b04621e5 None None] Registered counter for database nova_cell0 Aug 10 22:54:44.613771 n-d-850468-14 devstack@n-api.service[122633]: INFO dbcounter [None req-c327f61b-c850-4206-b76f-2680b04621e5 None None] Registered counter for database nova_cell1 Aug 10 22:54:44.621885 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_db.sqlalchemy.engines [None req-c327f61b-c850-4206-b76f-2680b04621e5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122633) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 22:54:44.623577 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_db.sqlalchemy.engines [None req-c327f61b-c850-4206-b76f-2680b04621e5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122633) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 22:54:44.630457 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writer thread running {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 22:54:44.630971 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writer thread running {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 22:54:44.638322 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.context [None req-38c74c41-c09d-4621-8267-80a9a5379f1c None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c9127db4-59f9-48ac-9ab2-b5d6690bb85f(cell1) {{(pid=122632) load_cells /opt/stack/nova/nova/context.py:464}} Aug 10 22:54:44.642577 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-38c74c41-c09d-4621-8267-80a9a5379f1c None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:54:44.643100 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-38c74c41-c09d-4621-8267-80a9a5379f1c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:54:44.645531 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-38c74c41-c09d-4621-8267-80a9a5379f1c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:54:44.646731 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-38c74c41-c09d-4621-8267-80a9a5379f1c None None] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:54:44.647370 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-38c74c41-c09d-4621-8267-80a9a5379f1c None None] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:54:44.650518 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-38c74c41-c09d-4621-8267-80a9a5379f1c None None] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:54:44.652622 n-d-850468-14 devstack@n-api.service[122632]: INFO dbcounter [None req-38c74c41-c09d-4621-8267-80a9a5379f1c None None] Registered counter for database nova_cell0 Aug 10 22:54:44.656803 n-d-850468-14 devstack@n-api.service[122632]: INFO dbcounter [None req-38c74c41-c09d-4621-8267-80a9a5379f1c None None] Registered counter for database nova_cell1 Aug 10 22:54:44.664749 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_db.sqlalchemy.engines [None req-38c74c41-c09d-4621-8267-80a9a5379f1c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122632) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 22:54:44.666499 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_db.sqlalchemy.engines [None req-38c74c41-c09d-4621-8267-80a9a5379f1c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122632) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 22:54:44.673444 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writer thread running {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 22:54:44.674721 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writer thread running {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 22:54:44.778379 n-d-850468-14 devstack@n-api.service[122633]: INFO dbcounter [None req-c327f61b-c850-4206-b76f-2680b04621e5 None None] Registered counter for database nova_cell0 Aug 10 22:54:44.785026 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_db.sqlalchemy.engines [None req-c327f61b-c850-4206-b76f-2680b04621e5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122633) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 22:54:44.789525 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writer thread running {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 22:54:44.821764 n-d-850468-14 devstack@n-api.service[122632]: INFO dbcounter [None req-38c74c41-c09d-4621-8267-80a9a5379f1c None None] Registered counter for database nova_cell0 Aug 10 22:54:44.830445 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_db.sqlalchemy.engines [None req-38c74c41-c09d-4621-8267-80a9a5379f1c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=122632) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 10 22:54:44.834910 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writer thread running {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 10 22:54:45.109623 n-d-850468-14 devstack@n-api.service[122633]: WARNING keystonemiddleware.auth_token [None req-c327f61b-c850-4206-b76f-2680b04621e5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 10 22:54:45.116958 n-d-850468-14 devstack@n-api.service[122633]: WARNING keystonemiddleware.auth_token [None req-c327f61b-c850-4206-b76f-2680b04621e5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 10 22:54:45.163394 n-d-850468-14 devstack@n-api.service[122632]: WARNING keystonemiddleware.auth_token [None req-38c74c41-c09d-4621-8267-80a9a5379f1c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 10 22:54:45.171335 n-d-850468-14 devstack@n-api.service[122632]: WARNING keystonemiddleware.auth_token [None req-38c74c41-c09d-4621-8267-80a9a5379f1c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 10 22:54:45.464457 n-d-850468-14 devstack@n-api.service[122633]: WARNING keystonemiddleware.auth_token [None req-c327f61b-c850-4206-b76f-2680b04621e5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 10 22:54:45.470496 n-d-850468-14 devstack@n-api.service[122633]: WARNING keystonemiddleware.auth_token [None req-c327f61b-c850-4206-b76f-2680b04621e5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 10 22:54:45.477196 n-d-850468-14 devstack@n-api.service[122633]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x560ec1d989c0 pid: 122633 (default app) Aug 10 22:54:45.521413 n-d-850468-14 devstack@n-api.service[122632]: WARNING keystonemiddleware.auth_token [None req-38c74c41-c09d-4621-8267-80a9a5379f1c None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 10 22:54:45.528041 n-d-850468-14 devstack@n-api.service[122632]: WARNING keystonemiddleware.auth_token [None req-38c74c41-c09d-4621-8267-80a9a5379f1c None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 10 22:54:45.534283 n-d-850468-14 devstack@n-api.service[122632]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x560ec1d989c0 pid: 122632 (default app) Aug 10 22:55:26.213142 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_api:SELECT=3 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:55:26.214240 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=3 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:55:26.215030 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=3 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:55:26.215790 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=3 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:55:26.580084 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_api:SELECT=3 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:55:26.581274 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=3 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:55:26.582157 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=3 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:55:26.583143 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=3 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:55:27.306232 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-f810d0c4-6ad2-4e95-8fbd-dcaae2e6ac9a tempest-FlavorMetadataValidation-1148524462 tempest-FlavorMetadataValidation-1148524462-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-1257884333", "id": 2064824360, "os-flavor-access:is_public": "True"}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:55:27.326075 n-d-850468-14 devstack@n-api.service[122633]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:55:27.326075 n-d-850468-14 devstack@n-api.service[122633]: warnings.warn(msg) Aug 10 22:55:27.360203 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-f810d0c4-6ad2-4e95-8fbd-dcaae2e6ac9a tempest-FlavorMetadataValidation-1148524462 tempest-FlavorMetadataValidation-1148524462-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 471 microversion: 2.86 time: 1.152301 Aug 10 22:55:27.361001 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1/1] 10.222.0.58 () {62 vars in 1188 bytes} [Wed Aug 10 22:55:26 2022] POST /compute/v2.1/flavors => generated 471 bytes in 1155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 22:55:27.705238 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-bfc50e3e-a924-4339-9ab5-905941c90036 tempest-FlavorsAdminTestJSON-2084737028 tempest-FlavorsAdminTestJSON-2084737028-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1404131701", "id": 800854003, "os-flavor-access:is_public": "True"}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:55:27.730062 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-bfc50e3e-a924-4339-9ab5-905941c90036 tempest-FlavorsAdminTestJSON-2084737028 tempest-FlavorsAdminTestJSON-2084737028-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.361686 Aug 10 22:55:27.731275 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2/2] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 22:55:27 2022] POST /compute/v2.1/flavors => generated 427 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:55:27.885368 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-ece44b07-8166-41f3-901b-00db24d7c31b tempest-AggregatesAdminTestV241-1312098695 tempest-AggregatesAdminTestV241-1312098695-project-admin] Calling method '.version_select at 0x7f847fd00dc0>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:27.889568 n-d-850468-14 devstack@n-api.service[122632]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:55:27.889568 n-d-850468-14 devstack@n-api.service[122632]: warnings.warn(msg) Aug 10 22:55:27.895831 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-ece44b07-8166-41f3-901b-00db24d7c31b tempest-AggregatesAdminTestV241-1312098695 tempest-AggregatesAdminTestV241-1312098695-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c9127db4-59f9-48ac-9ab2-b5d6690bb85f(cell1) {{(pid=122632) load_cells /opt/stack/nova/nova/compute/api.py:306}} Aug 10 22:55:27.896553 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ece44b07-8166-41f3-901b-00db24d7c31b tempest-AggregatesAdminTestV241-1312098695 tempest-AggregatesAdminTestV241-1312098695-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:27.897012 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ece44b07-8166-41f3-901b-00db24d7c31b tempest-AggregatesAdminTestV241-1312098695 tempest-AggregatesAdminTestV241-1312098695-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:27.897434 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ece44b07-8166-41f3-901b-00db24d7c31b tempest-AggregatesAdminTestV241-1312098695 tempest-AggregatesAdminTestV241-1312098695-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:27.904949 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-f1889a27-5b24-4c88-90bb-cc01a78e5447 tempest-FlavorsAccessTestJSON-347302866 tempest-FlavorsAccessTestJSON-347302866-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-137874580", "id": 810778326, "os-flavor-access:is_public": "False"}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:55:27.924900 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-f1889a27-5b24-4c88-90bb-cc01a78e5447 tempest-FlavorsAccessTestJSON-347302866 tempest-FlavorsAccessTestJSON-347302866-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.192098 Aug 10 22:55:27.926294 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3/3] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 22:55:27 2022] POST /compute/v2.1/flavors => generated 427 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:55:27.927352 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ece44b07-8166-41f3-901b-00db24d7c31b tempest-AggregatesAdminTestV241-1312098695 tempest-AggregatesAdminTestV241-1312098695-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:27.927896 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ece44b07-8166-41f3-901b-00db24d7c31b tempest-AggregatesAdminTestV241-1312098695 tempest-AggregatesAdminTestV241-1312098695-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:27.928500 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ece44b07-8166-41f3-901b-00db24d7c31b tempest-AggregatesAdminTestV241-1312098695 tempest-AggregatesAdminTestV241-1312098695-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:27.931784 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-ca13f3e8-fd7b-47b2-b398-44d47b1e62f0 tempest-FlavorMetadataValidation-1148524462 tempest-FlavorMetadataValidation-1148524462-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:55:27.934646 n-d-850468-14 devstack@n-api.service[122633]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:55:27.934646 n-d-850468-14 devstack@n-api.service[122633]: warnings.warn(msg) Aug 10 22:55:27.943081 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ece44b07-8166-41f3-901b-00db24d7c31b tempest-AggregatesAdminTestV241-1312098695 tempest-AggregatesAdminTestV241-1312098695-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:27.943557 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ece44b07-8166-41f3-901b-00db24d7c31b tempest-AggregatesAdminTestV241-1312098695 tempest-AggregatesAdminTestV241-1312098695-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:27.943981 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ece44b07-8166-41f3-901b-00db24d7c31b tempest-AggregatesAdminTestV241-1312098695 tempest-AggregatesAdminTestV241-1312098695-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:27.950548 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-ece44b07-8166-41f3-901b-00db24d7c31b tempest-AggregatesAdminTestV241-1312098695 tempest-AggregatesAdminTestV241-1312098695-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1427 microversion: 2.41 time: 1.377143 Aug 10 22:55:27.951400 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1/4] 10.222.0.58 () {60 vars in 1208 bytes} [Wed Aug 10 22:55:26 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1427 bytes in 1379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:55:28.138072 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-ca13f3e8-fd7b-47b2-b398-44d47b1e62f0 tempest-FlavorMetadataValidation-1148524462 tempest-FlavorMetadataValidation-1148524462-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors/2064824360/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.210171 Aug 10 22:55:28.138663 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 4/5] 10.222.0.58 () {62 vars in 1265 bytes} [Wed Aug 10 22:55:27 2022] POST /compute/v2.1/flavors/2064824360/os-extra_specs => generated 62 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:55:28.169053 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-d41c4ebc-ac4b-47cd-b67f-dff179e702b6 tempest-AZAdminV2TestJSON-1169971359 tempest-AZAdminV2TestJSON-1169971359-project-admin] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:28.170815 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d41c4ebc-ac4b-47cd-b67f-dff179e702b6 tempest-AZAdminV2TestJSON-1169971359 tempest-AZAdminV2TestJSON-1169971359-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:28.171311 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d41c4ebc-ac4b-47cd-b67f-dff179e702b6 tempest-AZAdminV2TestJSON-1169971359 tempest-AZAdminV2TestJSON-1169971359-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:28.172255 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d41c4ebc-ac4b-47cd-b67f-dff179e702b6 tempest-AZAdminV2TestJSON-1169971359 tempest-AZAdminV2TestJSON-1169971359-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:28.172990 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d41c4ebc-ac4b-47cd-b67f-dff179e702b6 tempest-AZAdminV2TestJSON-1169971359 tempest-AZAdminV2TestJSON-1169971359-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:28.173469 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d41c4ebc-ac4b-47cd-b67f-dff179e702b6 tempest-AZAdminV2TestJSON-1169971359 tempest-AZAdminV2TestJSON-1169971359-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:28.174194 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d41c4ebc-ac4b-47cd-b67f-dff179e702b6 tempest-AZAdminV2TestJSON-1169971359 tempest-AZAdminV2TestJSON-1169971359-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:28.215578 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-d41c4ebc-ac4b-47cd-b67f-dff179e702b6 tempest-AZAdminV2TestJSON-1169971359 tempest-AZAdminV2TestJSON-1169971359-project-admin] 10.222.0.58 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.262780 Aug 10 22:55:28.217050 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2/6] 10.222.0.58 () {58 vars in 1164 bytes} [Wed Aug 10 22:55:27 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 22:55:28.221801 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-fa3f82db-577a-459c-a056-c5c13db24baa tempest-FlavorsAdminTestJSON-2084737028 tempest-FlavorsAdminTestJSON-2084737028-project-admin] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:28.222943 n-d-850468-14 devstack@n-api.service[122632]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:55:28.222943 n-d-850468-14 devstack@n-api.service[122632]: warnings.warn(msg) Aug 10 22:55:28.262120 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-fa3f82db-577a-459c-a056-c5c13db24baa tempest-FlavorsAdminTestJSON-2084737028 tempest-FlavorsAdminTestJSON-2084737028-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/800854003" status: 202 len: 0 microversion: 2.1 time: 0.043796 Aug 10 22:55:28.263048 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3/7] 10.222.0.58 () {58 vars in 1158 bytes} [Wed Aug 10 22:55:28 2022] DELETE /compute/v2.1/flavors/800854003 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 22:55:28.338935 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-2e9957da-70f1-4374-9359-4b80c4af03ff tempest-AggregatesAdminTestJSON-1841140741 tempest-AggregatesAdminTestJSON-1841140741-project-admin] Calling method '.version_select at 0x7f847fb73550>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:28.339873 n-d-850468-14 devstack@n-api.service[122633]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:55:28.339873 n-d-850468-14 devstack@n-api.service[122633]: warnings.warn(msg) Aug 10 22:55:28.346008 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-2e9957da-70f1-4374-9359-4b80c4af03ff tempest-AggregatesAdminTestJSON-1841140741 tempest-AggregatesAdminTestJSON-1841140741-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c9127db4-59f9-48ac-9ab2-b5d6690bb85f(cell1) {{(pid=122633) load_cells /opt/stack/nova/nova/compute/api.py:306}} Aug 10 22:55:28.346726 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2e9957da-70f1-4374-9359-4b80c4af03ff tempest-AggregatesAdminTestJSON-1841140741 tempest-AggregatesAdminTestJSON-1841140741-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:28.347746 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2e9957da-70f1-4374-9359-4b80c4af03ff tempest-AggregatesAdminTestJSON-1841140741 tempest-AggregatesAdminTestJSON-1841140741-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:28.348178 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2e9957da-70f1-4374-9359-4b80c4af03ff tempest-AggregatesAdminTestJSON-1841140741 tempest-AggregatesAdminTestJSON-1841140741-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:28.374234 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-53846b4a-0337-4b14-be9b-054591c88b4e tempest-AZAdminNegativeTestJSON-1809423921 tempest-AZAdminNegativeTestJSON-1809423921-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:28.375118 n-d-850468-14 devstack@n-api.service[122632]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:55:28.375118 n-d-850468-14 devstack@n-api.service[122632]: warnings.warn(msg) Aug 10 22:55:28.375356 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2e9957da-70f1-4374-9359-4b80c4af03ff tempest-AggregatesAdminTestJSON-1841140741 tempest-AggregatesAdminTestJSON-1841140741-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:28.375838 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2e9957da-70f1-4374-9359-4b80c4af03ff tempest-AggregatesAdminTestJSON-1841140741 tempest-AggregatesAdminTestJSON-1841140741-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:28.376166 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-53846b4a-0337-4b14-be9b-054591c88b4e tempest-AZAdminNegativeTestJSON-1809423921 tempest-AZAdminNegativeTestJSON-1809423921-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': 'df035bf79e1c4e6d9364fa4248935f3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6264de1af0f4007997e99927159a25d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:55:28.376429 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2e9957da-70f1-4374-9359-4b80c4af03ff tempest-AggregatesAdminTestJSON-1841140741 tempest-AggregatesAdminTestJSON-1841140741-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:28.379360 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-53846b4a-0337-4b14-be9b-054591c88b4e tempest-AZAdminNegativeTestJSON-1809423921 tempest-AZAdminNegativeTestJSON-1809423921-project] Request method failure captured: Aug 10 22:55:28.379360 n-d-850468-14 devstack@n-api.service[122632]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Aug 10 22:55:28.379360 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 22:55:28.379360 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 22:55:28.379360 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 22:55:28.379360 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 22:55:28.379360 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 22:55:28.379360 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 22:55:28.379360 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 22:55:28.379360 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 22:55:28.379360 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9DddH4jEWXohEkuKLgOsyg-S4YZVCHz9UcTW8mQhAtjo3luQ0SMc1A-YtWohF8BaW4LiJLFdzAJktj1i_CDEBwBMibM1RChxplKrVG3cFYqdYOvy4bnz7ka1lopd0d0Qm023C48nY1U62kzj4bRGgC2jIAx5XFGDCcRD6CMcLOPKY4U Aug 10 22:55:28.379360 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 22:55:28.379360 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 22:55:28.379360 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 22:55:28.379360 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 22:55:28.379360 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 22:55:28.379360 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 22:55:28.379360 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: c6264de1af0f4007997e99927159a25d Aug 10 22:55:28.379360 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-AZAdminNegativeTestJSON-1809423921 Aug 10 22:55:28.379360 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 22:55:28.379360 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 22:55:28.380707 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c6264de1af0f4007997e99927159a25d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c6264de1af0f4007997e99927159a25d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/c6264de1af0f4007997e99927159a25d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_c6264de1af0f4007997e99927159a25d", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 22:55:28.380707 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-AZAdminNegativeTestJSON-1809423921 Aug 10 22:55:28.380707 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: c6264de1af0f4007997e99927159a25d Aug 10 22:55:28.380707 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-1809423921 Aug 10 22:55:28.380707 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-AZAdminNegativeTestJSON-1809423921-project Aug 10 22:55:28.380707 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 22:55:28.380707 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 22:55:28.380707 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: df035bf79e1c4e6d9364fa4248935f3b Aug 10 22:55:28.380707 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-AZAdminNegativeTestJSON-1809423921-project Aug 10 22:55:28.380707 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 22:55:28.380707 n-d-850468-14 devstack@n-api.service[122632]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Aug 10 22:55:28.380707 n-d-850468-14 devstack@n-api.service[122632]: action_args: {} Aug 10 22:55:28.381413 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 22:55:28.381413 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:55:28.381413 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:55:28.381413 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:55:28.381413 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 22:55:28.381413 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 22:55:28.381413 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 22:55:28.381413 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 22:55:28.381413 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Aug 10 22:55:28.381413 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Aug 10 22:55:28.381413 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 10 22:55:28.381413 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 10 22:55:28.381413 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 10 22:55:28.381413 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 10 22:55:28.381413 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 10 22:55:28.381413 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 10 22:55:28.381413 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 10 22:55:28.381413 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise self.value Aug 10 22:55:28.381413 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 10 22:55:28.382544 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 10 22:55:28.382544 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 10 22:55:28.382544 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 10 22:55:28.382544 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 10 22:55:28.382544 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 10 22:55:28.382544 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Aug 10 22:55:28.382544 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:55:28.382544 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:55:28.382544 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:55:28.382544 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:55:28.382544 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:55:28.382544 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:55:28.382544 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 10 22:55:28.382544 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 10 22:55:28.382544 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Aug 10 22:55:28.382544 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:55:28.382544 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-53846b4a-0337-4b14-be9b-054591c88b4e tempest-AZAdminNegativeTestJSON-1809423921 tempest-AZAdminNegativeTestJSON-1809423921-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 22:55:28.383555 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-53846b4a-0337-4b14-be9b-054591c88b4e tempest-AZAdminNegativeTestJSON-1809423921 tempest-AZAdminNegativeTestJSON-1809423921-project] 10.222.0.58 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.116573 Aug 10 22:55:28.383555 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 4/8] 10.222.0.58 () {58 vars in 1185 bytes} [Wed Aug 10 22:55:28 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 117 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 10 22:55:28.386378 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c3494eb7-afa2-4f94-bc80-e1ab5822de90 tempest-FlavorsAccessTestJSON-347302866 tempest-FlavorsAccessTestJSON-347302866-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "6555a567726944ad978867c8ffee218b"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:55:28.388885 n-d-850468-14 devstack@n-api.service[122632]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:55:28.388885 n-d-850468-14 devstack@n-api.service[122632]: warnings.warn(msg) Aug 10 22:55:28.394872 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2e9957da-70f1-4374-9359-4b80c4af03ff tempest-AggregatesAdminTestJSON-1841140741 tempest-AggregatesAdminTestJSON-1841140741-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:28.396249 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2e9957da-70f1-4374-9359-4b80c4af03ff tempest-AggregatesAdminTestJSON-1841140741 tempest-AggregatesAdminTestJSON-1841140741-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:28.396858 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2e9957da-70f1-4374-9359-4b80c4af03ff tempest-AggregatesAdminTestJSON-1841140741 tempest-AggregatesAdminTestJSON-1841140741-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:28.405377 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-2e9957da-70f1-4374-9359-4b80c4af03ff tempest-AggregatesAdminTestJSON-1841140741 tempest-AggregatesAdminTestJSON-1841140741-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1507 microversion: 2.1 time: 0.265080 Aug 10 22:55:28.405992 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 5/9] 10.222.0.58 () {58 vars in 1167 bytes} [Wed Aug 10 22:55:28 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1507 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:55:28.410897 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-593299be-be01-4bc0-bc71-cf22ab64328d tempest-AggregatesAdminTestV241-1312098695 tempest-AggregatesAdminTestV241-1312098695-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1341605791"}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:55:28.413666 n-d-850468-14 devstack@n-api.service[122633]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:55:28.413666 n-d-850468-14 devstack@n-api.service[122633]: warnings.warn(msg) Aug 10 22:55:28.414723 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.objects.aggregate [None req-593299be-be01-4bc0-bc71-cf22ab64328d tempest-AggregatesAdminTestV241-1312098695 tempest-AggregatesAdminTestV241-1312098695-project-admin] Generated uuid d1a88d4b-0d87-430f-8e84-491a33bc95d3 for aggregate {{(pid=122633) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 10 22:55:28.483860 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-593299be-be01-4bc0-bc71-cf22ab64328d tempest-AggregatesAdminTestV241-1312098695 tempest-AggregatesAdminTestV241-1312098695-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates" status: 200 len: 246 microversion: 2.41 time: 0.076517 Aug 10 22:55:28.484657 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 6/10] 10.222.0.58 () {62 vars in 1205 bytes} [Wed Aug 10 22:55:28 2022] POST /compute/v2.1/os-aggregates => generated 246 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 22:55:28.490700 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-8d752ae4-1f0c-479c-beb6-cdc60055ce5b tempest-FlavorMetadataValidation-1148524462 tempest-FlavorMetadataValidation-1148524462-project-admin] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:28.492433 n-d-850468-14 devstack@n-api.service[122633]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:55:28.492433 n-d-850468-14 devstack@n-api.service[122633]: warnings.warn(msg) Aug 10 22:55:28.523892 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-8d752ae4-1f0c-479c-beb6-cdc60055ce5b tempest-FlavorMetadataValidation-1148524462 tempest-FlavorMetadataValidation-1148524462-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/2064824360" status: 202 len: 0 microversion: 2.86 time: 0.037638 Aug 10 22:55:28.524482 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 7/11] 10.222.0.58 () {60 vars in 1202 bytes} [Wed Aug 10 22:55:28 2022] DELETE /compute/v2.1/flavors/2064824360 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 10 22:55:28.530217 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-f065f0cc-697b-4886-808d-cab0345230e3 tempest-AZAdminV2TestJSON-1169971359 tempest-AZAdminV2TestJSON-1169971359-project-admin] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:28.532036 n-d-850468-14 devstack@n-api.service[122633]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:55:28.532036 n-d-850468-14 devstack@n-api.service[122633]: warnings.warn(msg) Aug 10 22:55:28.536263 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f065f0cc-697b-4886-808d-cab0345230e3 tempest-AZAdminV2TestJSON-1169971359 tempest-AZAdminV2TestJSON-1169971359-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:28.536877 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f065f0cc-697b-4886-808d-cab0345230e3 tempest-AZAdminV2TestJSON-1169971359 tempest-AZAdminV2TestJSON-1169971359-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:28.537383 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f065f0cc-697b-4886-808d-cab0345230e3 tempest-AZAdminV2TestJSON-1169971359 tempest-AZAdminV2TestJSON-1169971359-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:28.538487 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f065f0cc-697b-4886-808d-cab0345230e3 tempest-AZAdminV2TestJSON-1169971359 tempest-AZAdminV2TestJSON-1169971359-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:28.540160 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f065f0cc-697b-4886-808d-cab0345230e3 tempest-AZAdminV2TestJSON-1169971359 tempest-AZAdminV2TestJSON-1169971359-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:28.540933 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f065f0cc-697b-4886-808d-cab0345230e3 tempest-AZAdminV2TestJSON-1169971359 tempest-AZAdminV2TestJSON-1169971359-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:28.574987 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-c3494eb7-afa2-4f94-bc80-e1ab5822de90 tempest-FlavorsAccessTestJSON-347302866 tempest-FlavorsAccessTestJSON-347302866-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors/810778326/action" status: 200 len: 96 microversion: 2.1 time: 0.192510 Aug 10 22:55:28.576202 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 5/12] 10.222.0.58 () {60 vars in 1197 bytes} [Wed Aug 10 22:55:28 2022] POST /compute/v2.1/flavors/810778326/action => generated 96 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 22:55:28.586823 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-f065f0cc-697b-4886-808d-cab0345230e3 tempest-AZAdminV2TestJSON-1169971359 tempest-AZAdminV2TestJSON-1169971359-project-admin] 10.222.0.58 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 615 microversion: 2.1 time: 0.060995 Aug 10 22:55:28.587527 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 8/13] 10.222.0.58 () {58 vars in 1185 bytes} [Wed Aug 10 22:55:28 2022] GET /compute/v2.1/os-availability-zone/detail => generated 615 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:55:28.592618 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-545764ff-48fe-48a7-8327-7ce633921a42 tempest-FlavorsAdminTestJSON-2084737028 tempest-FlavorsAdminTestJSON-2084737028-project-admin] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:28.625612 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-545764ff-48fe-48a7-8327-7ce633921a42 tempest-FlavorsAdminTestJSON-2084737028 tempest-FlavorsAdminTestJSON-2084737028-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.036880 Aug 10 22:55:28.626203 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 9/14] 10.222.0.58 () {58 vars in 1146 bytes} [Wed Aug 10 22:55:28 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:55:28.631194 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c86018d1-1522-410e-87f7-376933bae20d tempest-AggregatesAdminTestV241-1312098695 tempest-AggregatesAdminTestV241-1312098695-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1656046370"}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:55:28.708590 n-d-850468-14 devstack@n-api.service[122633]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:55:28.708590 n-d-850468-14 devstack@n-api.service[122633]: warnings.warn(msg) Aug 10 22:55:28.716924 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-0f232b06-a4fa-4eeb-9c40-eb156d317bd6 tempest-FlavorsAccessNegativeTestJSON-2101776700 tempest-FlavorsAccessNegativeTestJSON-2101776700-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-430252841", "id": 1024054528, "os-flavor-access:is_public": "False"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:55:28.744840 n-d-850468-14 devstack@n-api.service[122632]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:55:28.744840 n-d-850468-14 devstack@n-api.service[122632]: warnings.warn(msg) Aug 10 22:55:28.754874 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-c86018d1-1522-410e-87f7-376933bae20d tempest-AggregatesAdminTestV241-1312098695 tempest-AggregatesAdminTestV241-1312098695-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-aggregates/1" status: 200 len: 299 microversion: 2.41 time: 0.126590 Aug 10 22:55:28.762713 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 10/15] 10.222.0.58 () {62 vars in 1210 bytes} [Wed Aug 10 22:55:28 2022] PUT /compute/v2.1/os-aggregates/1 => generated 299 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 22:55:28.766492 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-0f232b06-a4fa-4eeb-9c40-eb156d317bd6 tempest-FlavorsAccessNegativeTestJSON-2101776700 tempest-FlavorsAccessNegativeTestJSON-2101776700-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.189111 Aug 10 22:55:28.767855 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 6/16] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 22:55:28 2022] POST /compute/v2.1/flavors => generated 438 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:55:28.779989 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-80754698-0219-437b-bb4b-d1433f5e42a0 tempest-FlavorMetadataValidation-1148524462 tempest-FlavorMetadataValidation-1148524462-project-admin] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:28.807052 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-80754698-0219-437b-bb4b-d1433f5e42a0 tempest-FlavorMetadataValidation-1148524462 tempest-FlavorMetadataValidation-1148524462-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.86 time: 0.044893 Aug 10 22:55:28.807785 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 11/17] 10.222.0.58 () {60 vars in 1187 bytes} [Wed Aug 10 22:55:28 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:55:28.812391 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c3080066-8b4b-4872-aaa2-44786d9a078c tempest-FlavorsAdminTestJSON-2084737028 tempest-FlavorsAdminTestJSON-2084737028-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-660660302", "id": 526360801, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:55:28.834313 n-d-850468-14 devstack@n-api.service[122633]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:55:28.834313 n-d-850468-14 devstack@n-api.service[122633]: warnings.warn(msg) Aug 10 22:55:28.848272 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-c3080066-8b4b-4872-aaa2-44786d9a078c tempest-FlavorsAdminTestJSON-2084737028 tempest-FlavorsAdminTestJSON-2084737028-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.038762 Aug 10 22:55:28.849162 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 12/18] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 22:55:28 2022] POST /compute/v2.1/flavors => generated 413 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:55:28.854684 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-41b96a62-0e7a-457a-a6e6-5d1c0223f91e tempest-AggregatesAdminTestV241-1312098695 tempest-AggregatesAdminTestV241-1312098695-project-admin] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:28.855625 n-d-850468-14 devstack@n-api.service[122633]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:55:28.855625 n-d-850468-14 devstack@n-api.service[122633]: warnings.warn(msg) Aug 10 22:55:28.862809 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-41b96a62-0e7a-457a-a6e6-5d1c0223f91e tempest-AggregatesAdminTestV241-1312098695 tempest-AggregatesAdminTestV241-1312098695-project-admin] 10.222.0.58 "GET /compute/v2.1/os-aggregates/1" status: 200 len: 299 microversion: 2.41 time: 0.012505 Aug 10 22:55:28.863575 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 13/19] 10.222.0.58 () {60 vars in 1190 bytes} [Wed Aug 10 22:55:28 2022] GET /compute/v2.1/os-aggregates/1 => generated 299 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 22:55:28.873124 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-deb24191-85ee-4f03-abd0-71a6f2fdaeaa tempest-FlavorsAccessNegativeTestJSON-2101776700 tempest-FlavorsAccessNegativeTestJSON-2101776700-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "9702a48666bb496c977ec770eb01ee37"}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:55:28.875854 n-d-850468-14 devstack@n-api.service[122633]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:55:28.875854 n-d-850468-14 devstack@n-api.service[122633]: warnings.warn(msg) Aug 10 22:55:29.018937 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-4bbec447-3c29-40c5-bc37-99bd3a04378b tempest-FlavorsAccessTestJSON-1031383304 tempest-FlavorsAccessTestJSON-1031383304-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:29.057933 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-4bbec447-3c29-40c5-bc37-99bd3a04378b tempest-FlavorsAccessTestJSON-1031383304 tempest-FlavorsAccessTestJSON-1031383304-project] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 5811 microversion: 2.1 time: 0.288096 Aug 10 22:55:29.059369 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 7/20] 10.222.0.58 () {58 vars in 1146 bytes} [Wed Aug 10 22:55:28 2022] GET /compute/v2.1/flavors/detail => generated 5811 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:55:29.070369 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-1196493c-ff7c-440b-84a3-dc72a053ab00 tempest-FlavorsAdminTestJSON-2084737028 tempest-FlavorsAdminTestJSON-2084737028-project-admin] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:29.104098 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-1196493c-ff7c-440b-84a3-dc72a053ab00 tempest-FlavorsAdminTestJSON-2084737028 tempest-FlavorsAdminTestJSON-2084737028-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 5394 microversion: 2.1 time: 0.041585 Aug 10 22:55:29.104098 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 8/21] 10.222.0.58 () {58 vars in 1146 bytes} [Wed Aug 10 22:55:29 2022] GET /compute/v2.1/flavors/detail => generated 5394 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:55:29.118607 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-afe24502-40af-45c8-a591-1341163311d8 tempest-AggregatesAdminTestV241-1312098695 tempest-AggregatesAdminTestV241-1312098695-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-850468-14"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:55:29.124686 n-d-850468-14 devstack@n-api.service[122632]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:55:29.124686 n-d-850468-14 devstack@n-api.service[122632]: warnings.warn(msg) Aug 10 22:55:29.166696 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-afe24502-40af-45c8-a591-1341163311d8 tempest-AggregatesAdminTestV241-1312098695 tempest-AggregatesAdminTestV241-1312098695-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:29.167447 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-afe24502-40af-45c8-a591-1341163311d8 tempest-AggregatesAdminTestV241-1312098695 tempest-AggregatesAdminTestV241-1312098695-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:29.168016 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-afe24502-40af-45c8-a591-1341163311d8 tempest-AggregatesAdminTestV241-1312098695 tempest-AggregatesAdminTestV241-1312098695-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:29.345524 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-deb24191-85ee-4f03-abd0-71a6f2fdaeaa tempest-FlavorsAccessNegativeTestJSON-2101776700 tempest-FlavorsAccessNegativeTestJSON-2101776700-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors/1024054528/action" status: 200 len: 97 microversion: 2.1 time: 0.476919 Aug 10 22:55:29.353169 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 14/22] 10.222.0.58 () {60 vars in 1200 bytes} [Wed Aug 10 22:55:28 2022] POST /compute/v2.1/flavors/1024054528/action => generated 97 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 22:55:29.358850 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-85f8f658-0eb5-4f88-b934-3cfdf4e159d6 tempest-FlavorsAccessTestJSON-347302866 tempest-FlavorsAccessTestJSON-347302866-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "6555a567726944ad978867c8ffee218b"}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:55:29.361642 n-d-850468-14 devstack@n-api.service[122633]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:55:29.361642 n-d-850468-14 devstack@n-api.service[122633]: warnings.warn(msg) Aug 10 22:55:29.834394 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-85f8f658-0eb5-4f88-b934-3cfdf4e159d6 tempest-FlavorsAccessTestJSON-347302866 tempest-FlavorsAccessTestJSON-347302866-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors/810778326/action" status: 200 len: 21 microversion: 2.1 time: 0.479458 Aug 10 22:55:29.840413 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 15/23] 10.222.0.58 () {60 vars in 1197 bytes} [Wed Aug 10 22:55:29 2022] POST /compute/v2.1/flavors/810778326/action => generated 21 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 22:55:29.846800 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-140007d6-e5d9-44a7-8415-9d5df0ced035 tempest-FlavorsAdminTestJSON-2084737028 tempest-FlavorsAdminTestJSON-2084737028-project-admin] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:29.848378 n-d-850468-14 devstack@n-api.service[122633]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:55:29.848378 n-d-850468-14 devstack@n-api.service[122633]: warnings.warn(msg) Aug 10 22:55:29.875751 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-140007d6-e5d9-44a7-8415-9d5df0ced035 tempest-FlavorsAdminTestJSON-2084737028 tempest-FlavorsAdminTestJSON-2084737028-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/526360801" status: 202 len: 0 microversion: 2.1 time: 0.033646 Aug 10 22:55:29.877671 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 16/24] 10.222.0.58 () {58 vars in 1158 bytes} [Wed Aug 10 22:55:29 2022] DELETE /compute/v2.1/flavors/526360801 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 22:55:29.886838 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-32bc28d4-2fb6-4a92-a48a-b33f1fdbf5c0 tempest-FlavorsAccessNegativeTestJSON-2101776700 tempest-FlavorsAccessNegativeTestJSON-2101776700-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "9702a48666bb496c977ec770eb01ee37"}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:55:30.163204 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-afe24502-40af-45c8-a591-1341163311d8 tempest-AggregatesAdminTestV241-1312098695 tempest-AggregatesAdminTestV241-1312098695-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 315 microversion: 2.41 time: 1.058137 Aug 10 22:55:30.164335 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 9/25] 10.222.0.58 () {62 vars in 1232 bytes} [Wed Aug 10 22:55:29 2022] POST /compute/v2.1/os-aggregates/1/action => generated 315 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 22:55:30.171036 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-f0e7cb39-603c-469f-b7be-47884eb110bc tempest-FlavorsAccessTestJSON-1031383304 tempest-FlavorsAccessTestJSON-1031383304-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:30.210648 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-f0e7cb39-603c-469f-b7be-47884eb110bc tempest-FlavorsAccessTestJSON-1031383304 tempest-FlavorsAccessTestJSON-1031383304-project] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.045034 Aug 10 22:55:30.213783 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 10/26] 10.222.0.58 () {58 vars in 1146 bytes} [Wed Aug 10 22:55:30 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:55:30.242291 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-7b31cd2c-813e-4f3f-bd80-f16eb5a44de8 tempest-FlavorsAdminTestJSON-2084737028 tempest-FlavorsAdminTestJSON-2084737028-project-admin] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:30.278064 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-7b31cd2c-813e-4f3f-bd80-f16eb5a44de8 tempest-FlavorsAdminTestJSON-2084737028 tempest-FlavorsAdminTestJSON-2084737028-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.062164 Aug 10 22:55:30.292346 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 11/27] 10.222.0.58 () {58 vars in 1146 bytes} [Wed Aug 10 22:55:30 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:55:30.305940 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-7e6946e7-899d-4b66-be8b-820707307b4f tempest-AggregatesAdminTestV241-1312098695 tempest-AggregatesAdminTestV241-1312098695-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-850468-14"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:55:30.308702 n-d-850468-14 devstack@n-api.service[122632]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:55:30.308702 n-d-850468-14 devstack@n-api.service[122632]: warnings.warn(msg) Aug 10 22:55:30.320336 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7e6946e7-899d-4b66-be8b-820707307b4f tempest-AggregatesAdminTestV241-1312098695 tempest-AggregatesAdminTestV241-1312098695-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:30.321061 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7e6946e7-899d-4b66-be8b-820707307b4f tempest-AggregatesAdminTestV241-1312098695 tempest-AggregatesAdminTestV241-1312098695-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:30.322016 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7e6946e7-899d-4b66-be8b-820707307b4f tempest-AggregatesAdminTestV241-1312098695 tempest-AggregatesAdminTestV241-1312098695-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:30.504693 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-7e6946e7-899d-4b66-be8b-820707307b4f tempest-AggregatesAdminTestV241-1312098695 tempest-AggregatesAdminTestV241-1312098695-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 299 microversion: 2.41 time: 0.210783 Aug 10 22:55:30.507485 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 12/28] 10.222.0.58 () {62 vars in 1232 bytes} [Wed Aug 10 22:55:30 2022] POST /compute/v2.1/os-aggregates/1/action => generated 299 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 22:55:30.513200 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-cd1a2734-2f76-41ff-b40a-35d25fc7e458 tempest-FlavorsAccessTestJSON-347302866 tempest-FlavorsAccessTestJSON-347302866-project-admin] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:30.516584 n-d-850468-14 devstack@n-api.service[122632]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:55:30.516584 n-d-850468-14 devstack@n-api.service[122632]: warnings.warn(msg) Aug 10 22:55:30.533339 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-32bc28d4-2fb6-4a92-a48a-b33f1fdbf5c0 tempest-FlavorsAccessNegativeTestJSON-2101776700 tempest-FlavorsAccessNegativeTestJSON-2101776700-project-admin] HTTP exception thrown: Flavor access already exists for flavor 18 and project 9702a48666bb496c977ec770eb01ee37 combination. Aug 10 22:55:30.542956 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-cd1a2734-2f76-41ff-b40a-35d25fc7e458 tempest-FlavorsAccessTestJSON-347302866 tempest-FlavorsAccessTestJSON-347302866-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/810778326" status: 202 len: 0 microversion: 2.1 time: 0.033015 Aug 10 22:55:30.544144 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 13/29] 10.222.0.58 () {58 vars in 1158 bytes} [Wed Aug 10 22:55:30 2022] DELETE /compute/v2.1/flavors/810778326 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 22:55:30.550648 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-f5694a15-bf8e-492d-8cb7-4fe265b0f527 tempest-FlavorsAdminTestJSON-2084737028 tempest-FlavorsAdminTestJSON-2084737028-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1158645260", "id": 1857662796, "os-flavor-access:is_public": "True"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:55:30.555136 n-d-850468-14 devstack@n-api.service[122632]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:55:30.555136 n-d-850468-14 devstack@n-api.service[122632]: warnings.warn(msg) Aug 10 22:55:30.572714 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-32bc28d4-2fb6-4a92-a48a-b33f1fdbf5c0 tempest-FlavorsAccessNegativeTestJSON-2101776700 tempest-FlavorsAccessNegativeTestJSON-2101776700-project-admin] Request method failure captured: Aug 10 22:55:30.572714 n-d-850468-14 devstack@n-api.service[122633]: request: POST /compute/v2.1/flavors/1024054528/action HTTP/1.1 Aug 10 22:55:30.572714 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 22:55:30.572714 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 22:55:30.572714 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 22:55:30.572714 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 67 Aug 10 22:55:30.572714 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 22:55:30.572714 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 22:55:30.572714 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 22:55:30.572714 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 22:55:30.572714 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9DdfYHiKPXWYwfuSwEDCxdduSYcLHsYg1OdYX0ztjhmojps9A0n22G-5hzn7aJUfNIo_u7nuKJQLCnQeZ4rWzCUyY9XEIjOy6zG7V2j9LtKGZzx2m6NC-KM-C4ol2lPbi20VKktc6oeCRPw5jkHAU6LHWgKX2mq-hZ92c4bRezIVLFE Aug 10 22:55:30.572714 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 22:55:30.572714 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 22:55:30.572714 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 22:55:30.572714 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 22:55:30.572714 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 22:55:30.572714 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 22:55:30.572714 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 0d047d750da4464db980821faf029f59 Aug 10 22:55:30.572714 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-2101776700 Aug 10 22:55:30.572714 n-d-850468-14 devstack@n-api.service[122633]: X-Role: admin,member,reader Aug 10 22:55:30.572714 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: admin,member,reader Aug 10 22:55:30.573697 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0d047d750da4464db980821faf029f59"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0d047d750da4464db980821faf029f59"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/0d047d750da4464db980821faf029f59"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_0d047d750da4464db980821faf029f59", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 22:55:30.573697 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-2101776700 Aug 10 22:55:30.573697 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 0d047d750da4464db980821faf029f59 Aug 10 22:55:30.573697 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-2101776700 Aug 10 22:55:30.573697 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-FlavorsAccessNegativeTestJSON-2101776700-project-admin Aug 10 22:55:30.573697 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 22:55:30.573697 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 22:55:30.573697 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 2bd3c52aca524d20aa8797a3c27f4c08 Aug 10 22:55:30.573697 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-2101776700-project-admin Aug 10 22:55:30.573697 n-d-850468-14 devstack@n-api.service[122633]: Aug 10 22:55:30.573697 n-d-850468-14 devstack@n-api.service[122633]: {"addTenantAccess": {"tenant": "9702a48666bb496c977ec770eb01ee37"}} Aug 10 22:55:30.573697 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 22:55:30.574263 n-d-850468-14 devstack@n-api.service[122633]: exception: Flavor access already exists for flavor 18 and project 9702a48666bb496c977ec770eb01ee37 combination. Aug 10 22:55:30.574263 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': '1024054528', 'body': {'addTenantAccess': {'tenant': '9702a48666bb496c977ec770eb01ee37'}}} Aug 10 22:55:30.574263 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 22:55:30.574263 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:55:30.574263 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 10 22:55:30.574263 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 10 22:55:30.574263 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 10 22:55:30.574263 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 10 22:55:30.574263 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 10 22:55:30.574263 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 10 22:55:30.574263 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 10 22:55:30.574263 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 10 22:55:30.574263 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 10 22:55:30.574263 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 10 22:55:30.574263 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 10 22:55:30.574263 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi result.read() Aug 10 22:55:30.574263 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 10 22:55:30.574263 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 10 22:55:30.575125 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 10 22:55:30.575125 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 10 22:55:30.575125 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 10 22:55:30.575125 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 10 22:55:30.575125 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 10 22:55:30.575125 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 10 22:55:30.575125 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '18-9702a48666bb496c977ec770eb01ee37' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Aug 10 22:55:30.575125 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:55:30.575125 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 10 22:55:30.575125 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:55:30.575125 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:55:30.575125 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Aug 10 22:55:30.575125 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi project.save(context.session) Aug 10 22:55:30.575125 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Aug 10 22:55:30.575125 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi session.flush() Aug 10 22:55:30.575125 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 10 22:55:30.575125 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi self._flush(objects) Aug 10 22:55:30.575125 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 10 22:55:30.575125 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Aug 10 22:55:30.575977 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 10 22:55:30.575977 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi compat.raise_( Aug 10 22:55:30.575977 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 10 22:55:30.575977 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception Aug 10 22:55:30.575977 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 10 22:55:30.575977 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi flush_context.execute() Aug 10 22:55:30.575977 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 10 22:55:30.575977 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi rec.execute(self) Aug 10 22:55:30.575977 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 10 22:55:30.575977 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Aug 10 22:55:30.575977 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 10 22:55:30.575977 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Aug 10 22:55:30.575977 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 10 22:55:30.575977 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Aug 10 22:55:30.575977 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 10 22:55:30.575977 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Aug 10 22:55:30.575977 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 10 22:55:30.575977 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Aug 10 22:55:30.576933 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 10 22:55:30.576933 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Aug 10 22:55:30.576933 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 10 22:55:30.576933 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Aug 10 22:55:30.576933 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 10 22:55:30.576933 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 10 22:55:30.576933 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 10 22:55:30.576933 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception Aug 10 22:55:30.576933 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 10 22:55:30.576933 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 10 22:55:30.576933 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 10 22:55:30.576933 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 10 22:55:30.576933 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 10 22:55:30.576933 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 10 22:55:30.576933 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 10 22:55:30.576933 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 10 22:55:30.576933 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 10 22:55:30.576933 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 10 22:55:30.577756 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 10 22:55:30.577756 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi result.read() Aug 10 22:55:30.577756 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 10 22:55:30.577756 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 10 22:55:30.577756 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 10 22:55:30.577756 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 10 22:55:30.577756 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 10 22:55:30.577756 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 10 22:55:30.577756 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 10 22:55:30.577756 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 10 22:55:30.577756 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '18-9702a48666bb496c977ec770eb01ee37' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Aug 10 22:55:30.577756 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Aug 10 22:55:30.577756 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 8, 10, 22, 55, 30, 508698), 'updated_at': None, 'flavor_id': 18, 'project_id': '9702a48666bb496c977ec770eb01ee37'}] Aug 10 22:55:30.577756 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 10 22:55:30.577756 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:55:30.577756 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:55:30.577756 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:55:30.578544 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:55:30.578544 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Aug 10 22:55:30.578544 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Aug 10 22:55:30.578544 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 10 22:55:30.578544 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 10 22:55:30.578544 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Aug 10 22:55:30.578544 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Aug 10 22:55:30.578544 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Aug 10 22:55:30.578544 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Aug 10 22:55:30.578544 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Aug 10 22:55:30.578544 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Aug 10 22:55:30.578544 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 10 22:55:30.578544 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 10 22:55:30.578544 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Aug 10 22:55:30.578544 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Aug 10 22:55:30.578544 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 18 and project 9702a48666bb496c977ec770eb01ee37 combination. Aug 10 22:55:30.578544 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:55:30.578544 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:55:30.578544 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:55:30.582330 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:55:30.582330 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:55:30.582330 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:55:30.582330 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 22:55:30.582330 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 22:55:30.582330 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 22:55:30.582330 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 22:55:30.582330 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 22:55:30.582330 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 22:55:30.582330 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Aug 10 22:55:30.582330 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Aug 10 22:55:30.582330 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 18 and project 9702a48666bb496c977ec770eb01ee37 combination. Aug 10 22:55:30.582330 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:55:30.582330 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:55:30.582330 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:55:30.582330 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:55:30.582330 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:55:30.582330 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:55:30.582330 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 22:55:30.582330 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 22:55:30.585492 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 18 and project 9702a48666bb496c977ec770eb01ee37 combination. Aug 10 22:55:30.585492 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:55:30.585492 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-32bc28d4-2fb6-4a92-a48a-b33f1fdbf5c0 tempest-FlavorsAccessNegativeTestJSON-2101776700 tempest-FlavorsAccessNegativeTestJSON-2101776700-project-admin] Returning 409 to user: Flavor access already exists for flavor 18 and project 9702a48666bb496c977ec770eb01ee37 combination. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 22:55:30.585492 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-32bc28d4-2fb6-4a92-a48a-b33f1fdbf5c0 tempest-FlavorsAccessNegativeTestJSON-2101776700 tempest-FlavorsAccessNegativeTestJSON-2101776700-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors/1024054528/action" status: 409 len: 152 microversion: 2.1 time: 0.694080 Aug 10 22:55:30.585492 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 17/30] 10.222.0.58 () {60 vars in 1200 bytes} [Wed Aug 10 22:55:29 2022] POST /compute/v2.1/flavors/1024054528/action => generated 152 bytes in 699 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 10 22:55:30.602450 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-f7a382d2-a8d7-4d03-8b49-9c27a2429167 tempest-AggregatesAdminTestV241-1312098695 tempest-AggregatesAdminTestV241-1312098695-project-admin] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:30.603319 n-d-850468-14 devstack@n-api.service[122633]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:55:30.603319 n-d-850468-14 devstack@n-api.service[122633]: warnings.warn(msg) Aug 10 22:55:30.616880 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-f5694a15-bf8e-492d-8cb7-4fe265b0f527 tempest-FlavorsAdminTestJSON-2084737028 tempest-FlavorsAdminTestJSON-2084737028-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 0.070365 Aug 10 22:55:30.617932 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 14/31] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 22:55:30 2022] POST /compute/v2.1/flavors => generated 429 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:55:30.624967 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-0b8879c9-a2c8-41bf-9b3f-9ca67965ee1c tempest-FlavorsAccessTestJSON-347302866 tempest-FlavorsAccessTestJSON-347302866-project-admin] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:30.635044 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-f7a382d2-a8d7-4d03-8b49-9c27a2429167 tempest-AggregatesAdminTestV241-1312098695 tempest-AggregatesAdminTestV241-1312098695-project-admin] 10.222.0.58 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.41 time: 0.054499 Aug 10 22:55:30.636436 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 18/32] 10.222.0.58 () {60 vars in 1193 bytes} [Wed Aug 10 22:55:30 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:55:30.644244 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-8a9a7787-1d85-44e5-b937-2054b8ed2c23 tempest-FlavorsAccessNegativeTestJSON-2101776700 tempest-FlavorsAccessNegativeTestJSON-2101776700-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "9702a48666bb496c977ec770eb01ee37"}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:55:30.647237 n-d-850468-14 devstack@n-api.service[122633]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:55:30.647237 n-d-850468-14 devstack@n-api.service[122633]: warnings.warn(msg) Aug 10 22:55:30.655800 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-0b8879c9-a2c8-41bf-9b3f-9ca67965ee1c tempest-FlavorsAccessTestJSON-347302866 tempest-FlavorsAccessTestJSON-347302866-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 5410 microversion: 2.1 time: 0.036371 Aug 10 22:55:30.656804 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 15/33] 10.222.0.58 () {58 vars in 1146 bytes} [Wed Aug 10 22:55:30 2022] GET /compute/v2.1/flavors/detail => generated 5410 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:55:30.662259 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-a58cb7b5-0820-4e9d-80c7-3f8e72d4d529 tempest-FlavorsAdminTestJSON-2084737028 tempest-FlavorsAdminTestJSON-2084737028-project-admin] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:30.686200 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-a58cb7b5-0820-4e9d-80c7-3f8e72d4d529 tempest-FlavorsAdminTestJSON-2084737028 tempest-FlavorsAdminTestJSON-2084737028-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/1857662796" status: 202 len: 0 microversion: 2.1 time: 0.027590 Aug 10 22:55:30.686428 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 16/34] 10.222.0.58 () {58 vars in 1161 bytes} [Wed Aug 10 22:55:30 2022] DELETE /compute/v2.1/flavors/1857662796 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 22:55:30.696945 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-ea74338c-563f-48dc-b1b5-5f8c5c838b1d tempest-AggregatesAdminTestJSON-1841140741 tempest-AggregatesAdminTestJSON-1841140741-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1567140817", "name": "tempest-test_aggregate-529064533"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:55:30.718419 n-d-850468-14 devstack@n-api.service[122632]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:55:30.718419 n-d-850468-14 devstack@n-api.service[122632]: warnings.warn(msg) Aug 10 22:55:30.719608 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.objects.aggregate [None req-ea74338c-563f-48dc-b1b5-5f8c5c838b1d tempest-AggregatesAdminTestJSON-1841140741 tempest-AggregatesAdminTestJSON-1841140741-project-admin] Generated uuid 3f21c349-1d53-4092-8c8b-3283a2e46375 for aggregate {{(pid=122632) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 10 22:55:30.758812 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-ea74338c-563f-48dc-b1b5-5f8c5c838b1d tempest-AggregatesAdminTestJSON-1841140741 tempest-AggregatesAdminTestJSON-1841140741-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.066963 Aug 10 22:55:30.765903 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 17/35] 10.222.0.58 () {60 vars in 1165 bytes} [Wed Aug 10 22:55:30 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:55:30.771679 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c210e447-58fb-43fc-a4b5-777005f83247 tempest-FlavorsAccessTestJSON-347302866 tempest-FlavorsAccessTestJSON-347302866-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-443190589", "id": 1026620967, "os-flavor-access:is_public": "False"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:55:30.774682 n-d-850468-14 devstack@n-api.service[122632]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:55:30.774682 n-d-850468-14 devstack@n-api.service[122632]: warnings.warn(msg) Aug 10 22:55:30.799779 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-c210e447-58fb-43fc-a4b5-777005f83247 tempest-FlavorsAccessTestJSON-347302866 tempest-FlavorsAccessTestJSON-347302866-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.032664 Aug 10 22:55:30.800744 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 18/36] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 22:55:30 2022] POST /compute/v2.1/flavors => generated 430 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:55:30.806643 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-d5c93bb0-1545-47c9-a285-6814ba48bad3 tempest-FlavorsAdminTestJSON-2084737028 tempest-FlavorsAdminTestJSON-2084737028-project-admin] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:30.833912 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-d5c93bb0-1545-47c9-a285-6814ba48bad3 tempest-FlavorsAdminTestJSON-2084737028 tempest-FlavorsAdminTestJSON-2084737028-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.031385 Aug 10 22:55:30.834588 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 19/37] 10.222.0.58 () {58 vars in 1146 bytes} [Wed Aug 10 22:55:30 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:55:30.839044 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-1f45fec2-964a-49cb-b5ee-2cb413dc59de tempest-AggregatesAdminTestJSON-1841140741 tempest-AggregatesAdminTestJSON-1841140741-project-admin] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:30.839801 n-d-850468-14 devstack@n-api.service[122632]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:55:30.839801 n-d-850468-14 devstack@n-api.service[122632]: warnings.warn(msg) Aug 10 22:55:30.850582 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-1f45fec2-964a-49cb-b5ee-2cb413dc59de tempest-AggregatesAdminTestJSON-1841140741 tempest-AggregatesAdminTestJSON-1841140741-project-admin] 10.222.0.58 "GET /compute/v2.1/os-aggregates" status: 200 len: 302 microversion: 2.1 time: 0.014850 Aug 10 22:55:30.851320 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 20/38] 10.222.0.58 () {58 vars in 1143 bytes} [Wed Aug 10 22:55:30 2022] GET /compute/v2.1/os-aggregates => generated 302 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:55:30.855733 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-6f2466d0-c1ea-441c-8894-148b45b28334 tempest-FlavorsAccessTestJSON-347302866 tempest-FlavorsAccessTestJSON-347302866-project-admin] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:30.856523 n-d-850468-14 devstack@n-api.service[122632]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:55:30.856523 n-d-850468-14 devstack@n-api.service[122632]: warnings.warn(msg) Aug 10 22:55:30.872602 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-6f2466d0-c1ea-441c-8894-148b45b28334 tempest-FlavorsAccessTestJSON-347302866 tempest-FlavorsAccessTestJSON-347302866-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/1026620967/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.020445 Aug 10 22:55:30.873466 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 21/39] 10.222.0.58 () {58 vars in 1209 bytes} [Wed Aug 10 22:55:30 2022] GET /compute/v2.1/flavors/1026620967/os-flavor-access => generated 21 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 22:55:30.877836 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-deed0a4f-1542-49a4-8be8-5eb3d7fc0741 tempest-FlavorsAdminTestJSON-2084737028 tempest-FlavorsAdminTestJSON-2084737028-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1523637923", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:55:30.882050 n-d-850468-14 devstack@n-api.service[122632]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:55:30.882050 n-d-850468-14 devstack@n-api.service[122632]: warnings.warn(msg) Aug 10 22:55:30.904610 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-deed0a4f-1542-49a4-8be8-5eb3d7fc0741 tempest-FlavorsAdminTestJSON-2084737028 tempest-FlavorsAdminTestJSON-2084737028-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.029918 Aug 10 22:55:30.906026 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 22/40] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 22:55:30 2022] POST /compute/v2.1/flavors => generated 507 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:55:30.912737 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-4fdb1656-4e14-4c69-bc74-6820d797952e tempest-AggregatesAdminTestJSON-1841140741 tempest-AggregatesAdminTestJSON-1841140741-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-850468-14"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:55:30.916966 n-d-850468-14 devstack@n-api.service[122632]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:55:30.916966 n-d-850468-14 devstack@n-api.service[122632]: warnings.warn(msg) Aug 10 22:55:30.924705 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4fdb1656-4e14-4c69-bc74-6820d797952e tempest-AggregatesAdminTestJSON-1841140741 tempest-AggregatesAdminTestJSON-1841140741-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:30.925234 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4fdb1656-4e14-4c69-bc74-6820d797952e tempest-AggregatesAdminTestJSON-1841140741 tempest-AggregatesAdminTestJSON-1841140741-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:30.927401 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4fdb1656-4e14-4c69-bc74-6820d797952e tempest-AggregatesAdminTestJSON-1841140741 tempest-AggregatesAdminTestJSON-1841140741-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:30.954262 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_api:SELECT=82,nova_api:DELETE=10,nova_api:INSERT=8 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:55:31.115397 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-4fdb1656-4e14-4c69-bc74-6820d797952e tempest-AggregatesAdminTestJSON-1841140741 tempest-AggregatesAdminTestJSON-1841140741-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 315 microversion: 2.1 time: 0.208007 Aug 10 22:55:31.116376 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 23/41] 10.222.0.58 () {60 vars in 1191 bytes} [Wed Aug 10 22:55:30 2022] POST /compute/v2.1/os-aggregates/2/action => generated 315 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:55:31.121594 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-11bd892d-8ef7-45ab-8149-2aa724c448fb tempest-FlavorsAccessTestJSON-347302866 tempest-FlavorsAccessTestJSON-347302866-project-admin] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:31.122370 n-d-850468-14 devstack@n-api.service[122632]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:55:31.122370 n-d-850468-14 devstack@n-api.service[122632]: warnings.warn(msg) Aug 10 22:55:31.142919 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-11bd892d-8ef7-45ab-8149-2aa724c448fb tempest-FlavorsAccessTestJSON-347302866 tempest-FlavorsAccessTestJSON-347302866-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/1026620967" status: 202 len: 0 microversion: 2.1 time: 0.024182 Aug 10 22:55:31.142919 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 24/42] 10.222.0.58 () {58 vars in 1161 bytes} [Wed Aug 10 22:55:31 2022] DELETE /compute/v2.1/flavors/1026620967 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 22:55:31.148512 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-d7fd1e0a-49d7-48b9-b6a1-e06907ffaa26 tempest-FlavorsAdminTestJSON-2084737028 tempest-FlavorsAdminTestJSON-2084737028-project-admin] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:31.176747 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-d7fd1e0a-49d7-48b9-b6a1-e06907ffaa26 tempest-FlavorsAdminTestJSON-2084737028 tempest-FlavorsAdminTestJSON-2084737028-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/ceae29e3-1179-4a70-a0e2-2f939bab5d2a" status: 202 len: 0 microversion: 2.1 time: 0.032127 Aug 10 22:55:31.178910 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 25/43] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 22:55:31 2022] DELETE /compute/v2.1/flavors/ceae29e3-1179-4a70-a0e2-2f939bab5d2a => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 22:55:31.184325 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-f544ab13-fccb-4752-a547-db07b206bb19 tempest-FlavorsAccessTestJSON-347302866 tempest-FlavorsAccessTestJSON-347302866-project-admin] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:31.205769 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-f544ab13-fccb-4752-a547-db07b206bb19 tempest-FlavorsAccessTestJSON-347302866 tempest-FlavorsAccessTestJSON-347302866-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.025338 Aug 10 22:55:31.219640 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 26/44] 10.222.0.58 () {58 vars in 1146 bytes} [Wed Aug 10 22:55:31 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:55:31.219640 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c21a7046-86cc-4d60-800e-1896a5caa305 tempest-FlavorsAdminTestJSON-2084737028 tempest-FlavorsAdminTestJSON-2084737028-project-admin] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:31.240019 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-c21a7046-86cc-4d60-800e-1896a5caa305 tempest-FlavorsAdminTestJSON-2084737028 tempest-FlavorsAdminTestJSON-2084737028-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.030839 Aug 10 22:55:31.248569 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 27/45] 10.222.0.58 () {58 vars in 1146 bytes} [Wed Aug 10 22:55:31 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:55:31.259691 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-bf4529ff-d994-463c-8c39-a8ad2c9d73cf tempest-FlavorsAdminTestJSON-2084737028 tempest-FlavorsAdminTestJSON-2084737028-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1379511339", "id": "c80e6c54-5ceb-4b74-a24e-2e0bd92a74bf", "os-flavor-access:is_public": "True"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:55:31.262812 n-d-850468-14 devstack@n-api.service[122632]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:55:31.262812 n-d-850468-14 devstack@n-api.service[122632]: warnings.warn(msg) Aug 10 22:55:31.280396 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-bf4529ff-d994-463c-8c39-a8ad2c9d73cf tempest-FlavorsAdminTestJSON-2084737028 tempest-FlavorsAdminTestJSON-2084737028-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.024251 Aug 10 22:55:31.281129 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 28/46] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 22:55:31 2022] POST /compute/v2.1/flavors => generated 507 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:55:31.295312 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-3cb19024-5934-4ebd-8187-fdc9d1c12a54 tempest-FlavorsAdminTestJSON-2084737028 tempest-FlavorsAdminTestJSON-2084737028-project-admin] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:31.319298 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-3cb19024-5934-4ebd-8187-fdc9d1c12a54 tempest-FlavorsAdminTestJSON-2084737028 tempest-FlavorsAdminTestJSON-2084737028-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/c80e6c54-5ceb-4b74-a24e-2e0bd92a74bf" status: 202 len: 0 microversion: 2.1 time: 0.029137 Aug 10 22:55:31.319990 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 29/47] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 22:55:31 2022] DELETE /compute/v2.1/flavors/c80e6c54-5ceb-4b74-a24e-2e0bd92a74bf => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 10 22:55:31.329629 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-36d65ad6-7908-4c7b-b2ea-8c1aed12745b tempest-FlavorsAdminTestJSON-2084737028 tempest-FlavorsAdminTestJSON-2084737028-project-admin] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:31.356213 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-36d65ad6-7908-4c7b-b2ea-8c1aed12745b tempest-FlavorsAdminTestJSON-2084737028 tempest-FlavorsAdminTestJSON-2084737028-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.031024 Aug 10 22:55:31.357409 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 30/48] 10.222.0.58 () {58 vars in 1146 bytes} [Wed Aug 10 22:55:31 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:55:31.376364 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-96bef493-1365-43b3-925a-ad719c9adb56 tempest-FlavorsAdminTestJSON-2084737028 tempest-FlavorsAdminTestJSON-2084737028-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-2065210612", "id": 1065732958, "os-flavor-access:is_public": "True"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:55:31.405137 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-96bef493-1365-43b3-925a-ad719c9adb56 tempest-FlavorsAdminTestJSON-2084737028 tempest-FlavorsAdminTestJSON-2084737028-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.033030 Aug 10 22:55:31.412908 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 31/49] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 22:55:31 2022] POST /compute/v2.1/flavors => generated 414 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:55:31.430704 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-24eac47d-9733-474c-92d4-5841c62a72da tempest-FlavorsAdminTestJSON-2084737028 tempest-FlavorsAdminTestJSON-2084737028-project-admin] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:31.440942 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-24eac47d-9733-474c-92d4-5841c62a72da tempest-FlavorsAdminTestJSON-2084737028 tempest-FlavorsAdminTestJSON-2084737028-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/1065732958" status: 200 len: 414 microversion: 2.1 time: 0.021991 Aug 10 22:55:31.441739 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 32/50] 10.222.0.58 () {58 vars in 1158 bytes} [Wed Aug 10 22:55:31 2022] GET /compute/v2.1/flavors/1065732958 => generated 414 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 22:55:31.588430 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-8a9a7787-1d85-44e5-b937-2054b8ed2c23 tempest-FlavorsAccessNegativeTestJSON-2101776700 tempest-FlavorsAccessNegativeTestJSON-2101776700-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors/1024054528/action" status: 200 len: 21 microversion: 2.1 time: 0.950394 Aug 10 22:55:31.589160 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 19/51] 10.222.0.58 () {60 vars in 1200 bytes} [Wed Aug 10 22:55:30 2022] POST /compute/v2.1/flavors/1024054528/action => generated 21 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 22:55:31.601059 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-5b4b535a-ad4d-4b2d-a914-2f3d7ee20aab tempest-FlavorsAccessNegativeTestJSON-2101776700 tempest-FlavorsAccessNegativeTestJSON-2101776700-project-admin] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:31.602084 n-d-850468-14 devstack@n-api.service[122633]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:55:31.602084 n-d-850468-14 devstack@n-api.service[122633]: warnings.warn(msg) Aug 10 22:55:31.610886 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=9,nova_api:SAVEPOINT=2,nova_api:RELEASE=2,nova_api:DELETE=12,nova_api:UPDATE=1 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:55:31.630310 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-5b4b535a-ad4d-4b2d-a914-2f3d7ee20aab tempest-FlavorsAccessNegativeTestJSON-2101776700 tempest-FlavorsAccessNegativeTestJSON-2101776700-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/1024054528" status: 202 len: 0 microversion: 2.1 time: 0.033526 Aug 10 22:55:31.630933 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 20/52] 10.222.0.58 () {58 vars in 1161 bytes} [Wed Aug 10 22:55:31 2022] DELETE /compute/v2.1/flavors/1024054528 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 22:55:31.897158 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-8362cc7f-1019-467c-8972-7dce52cc0978 tempest-FlavorsAdminTestJSON-1958744410 tempest-FlavorsAdminTestJSON-1958744410-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:31.929742 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-8362cc7f-1019-467c-8972-7dce52cc0978 tempest-FlavorsAdminTestJSON-1958744410 tempest-FlavorsAdminTestJSON-1958744410-project] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 5395 microversion: 2.1 time: 0.478823 Aug 10 22:55:31.930772 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 33/53] 10.222.0.58 () {58 vars in 1146 bytes} [Wed Aug 10 22:55:31 2022] GET /compute/v2.1/flavors/detail => generated 5395 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:55:31.936109 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-5dcb58ea-ceb7-41a6-b6ed-8ecdd37ec84b tempest-FlavorsAccessNegativeTestJSON-2101776700 tempest-FlavorsAccessNegativeTestJSON-2101776700-project-admin] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:31.961217 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-5dcb58ea-ceb7-41a6-b6ed-8ecdd37ec84b tempest-FlavorsAccessNegativeTestJSON-2101776700 tempest-FlavorsAccessNegativeTestJSON-2101776700-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 5395 microversion: 2.1 time: 0.028207 Aug 10 22:55:31.962633 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 34/54] 10.222.0.58 () {58 vars in 1146 bytes} [Wed Aug 10 22:55:31 2022] GET /compute/v2.1/flavors/detail => generated 5395 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:55:31.967145 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-f27e9edd-2e75-47d3-bc92-739751d8cdb7 tempest-FlavorsAdminTestJSON-2084737028 tempest-FlavorsAdminTestJSON-2084737028-project-admin] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:32.001780 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-f27e9edd-2e75-47d3-bc92-739751d8cdb7 tempest-FlavorsAdminTestJSON-2084737028 tempest-FlavorsAdminTestJSON-2084737028-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/1065732958" status: 202 len: 0 microversion: 2.1 time: 0.037850 Aug 10 22:55:32.004773 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 35/55] 10.222.0.58 () {58 vars in 1161 bytes} [Wed Aug 10 22:55:31 2022] DELETE /compute/v2.1/flavors/1065732958 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 22:55:32.016151 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-4128ddcf-aea6-44f4-9769-ed4d81e43a44 tempest-FlavorsAccessNegativeTestJSON-2101776700 tempest-FlavorsAccessNegativeTestJSON-2101776700-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1857804061", "id": 44000011, "os-flavor-access:is_public": "True"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:55:32.048863 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-4128ddcf-aea6-44f4-9769-ed4d81e43a44 tempest-FlavorsAccessNegativeTestJSON-2101776700 tempest-FlavorsAccessNegativeTestJSON-2101776700-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 432 microversion: 2.1 time: 0.042721 Aug 10 22:55:32.049848 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 36/56] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 22:55:32 2022] POST /compute/v2.1/flavors => generated 432 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:55:32.054925 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-1d819526-c643-481b-9587-656905354d96 tempest-FlavorsAdminTestJSON-2084737028 tempest-FlavorsAdminTestJSON-2084737028-project-admin] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:32.079894 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-1d819526-c643-481b-9587-656905354d96 tempest-FlavorsAdminTestJSON-2084737028 tempest-FlavorsAdminTestJSON-2084737028-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 5413 microversion: 2.1 time: 0.028835 Aug 10 22:55:32.080721 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 37/57] 10.222.0.58 () {58 vars in 1146 bytes} [Wed Aug 10 22:55:32 2022] GET /compute/v2.1/flavors/detail => generated 5413 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:55:32.099180 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-3ed8a50e-0729-467e-9c65-ada8f0d53a75 tempest-FlavorsAccessNegativeTestJSON-2101776700 tempest-FlavorsAccessNegativeTestJSON-2101776700-project-admin] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:32.101071 n-d-850468-14 devstack@n-api.service[122632]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:55:32.101071 n-d-850468-14 devstack@n-api.service[122632]: warnings.warn(msg) Aug 10 22:55:32.111301 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-3ed8a50e-0729-467e-9c65-ada8f0d53a75 tempest-FlavorsAccessNegativeTestJSON-2101776700 tempest-FlavorsAccessNegativeTestJSON-2101776700-project-admin] HTTP exception thrown: Access list not available for public flavors. Aug 10 22:55:32.114432 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-3ed8a50e-0729-467e-9c65-ada8f0d53a75 tempest-FlavorsAccessNegativeTestJSON-2101776700 tempest-FlavorsAccessNegativeTestJSON-2101776700-project-admin] Request method failure captured: Aug 10 22:55:32.114432 n-d-850468-14 devstack@n-api.service[122632]: request: GET /compute/v2.1/flavors/44000011/os-flavor-access HTTP/1.1 Aug 10 22:55:32.114432 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 22:55:32.114432 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 22:55:32.114432 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 22:55:32.114432 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 22:55:32.114432 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 22:55:32.114432 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 22:55:32.114432 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 22:55:32.114432 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 22:55:32.114432 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9DdfYHiKPXWYwfuSwEDCxdduSYcLHsYg1OdYX0ztjhmojps9A0n22G-5hzn7aJUfNIo_u7nuKJQLCnQeZ4rWzCUyY9XEIjOy6zG7V2j9LtKGZzx2m6NC-KM-C4ol2lPbi20VKktc6oeCRPw5jkHAU6LHWgKX2mq-hZ92c4bRezIVLFE Aug 10 22:55:32.114432 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 22:55:32.114432 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 22:55:32.114432 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 22:55:32.114432 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 22:55:32.114432 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 22:55:32.114432 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 22:55:32.114432 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 0d047d750da4464db980821faf029f59 Aug 10 22:55:32.114432 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-2101776700 Aug 10 22:55:32.114432 n-d-850468-14 devstack@n-api.service[122632]: X-Role: admin,member,reader Aug 10 22:55:32.114432 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: admin,member,reader Aug 10 22:55:32.115753 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0d047d750da4464db980821faf029f59"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0d047d750da4464db980821faf029f59"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/0d047d750da4464db980821faf029f59"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_0d047d750da4464db980821faf029f59", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 22:55:32.115753 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-2101776700 Aug 10 22:55:32.115753 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 0d047d750da4464db980821faf029f59 Aug 10 22:55:32.115753 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-2101776700 Aug 10 22:55:32.115753 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-FlavorsAccessNegativeTestJSON-2101776700-project-admin Aug 10 22:55:32.115753 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 22:55:32.115753 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 22:55:32.115753 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: 2bd3c52aca524d20aa8797a3c27f4c08 Aug 10 22:55:32.115753 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-2101776700-project-admin Aug 10 22:55:32.115753 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 22:55:32.115753 n-d-850468-14 devstack@n-api.service[122632]: exception: Access list not available for public flavors. Aug 10 22:55:32.115753 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'flavor_id': '44000011'} Aug 10 22:55:32.116466 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 22:55:32.116466 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:55:32.116466 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:55:32.116466 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:55:32.116466 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 22:55:32.116466 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 22:55:32.116466 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 22:55:32.116466 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 22:55:32.116466 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Aug 10 22:55:32.116466 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 10 22:55:32.116466 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Aug 10 22:55:32.116466 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:55:32.116466 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:55:32.116466 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:55:32.116466 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:55:32.116466 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:55:32.116466 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:55:32.116466 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 22:55:32.116466 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 22:55:32.116466 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Aug 10 22:55:32.116466 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:55:32.118856 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-3ed8a50e-0729-467e-9c65-ada8f0d53a75 tempest-FlavorsAccessNegativeTestJSON-2101776700 tempest-FlavorsAccessNegativeTestJSON-2101776700-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 22:55:32.119928 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-3ed8a50e-0729-467e-9c65-ada8f0d53a75 tempest-FlavorsAccessNegativeTestJSON-2101776700 tempest-FlavorsAccessNegativeTestJSON-2101776700-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/44000011/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.038104 Aug 10 22:55:32.120852 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 38/58] 10.222.0.58 () {58 vars in 1203 bytes} [Wed Aug 10 22:55:32 2022] GET /compute/v2.1/flavors/44000011/os-flavor-access => generated 91 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 10 22:55:32.127216 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-8278b5a1-6eef-4d45-9460-5b9d06e953cf tempest-FlavorsAdminTestJSON-2084737028 tempest-FlavorsAdminTestJSON-2084737028-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1798909383", "id": 1997384189, "os-flavor-access:is_public": "False"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:55:32.150777 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-8278b5a1-6eef-4d45-9460-5b9d06e953cf tempest-FlavorsAdminTestJSON-2084737028 tempest-FlavorsAdminTestJSON-2084737028-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.028611 Aug 10 22:55:32.151751 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 39/59] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 22:55:32 2022] POST /compute/v2.1/flavors => generated 430 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:55:32.165265 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-7512c790-8b34-4e46-a907-fbe324bf5d32 tempest-FlavorsAccessNegativeTestJSON-2101776700 tempest-FlavorsAccessNegativeTestJSON-2101776700-project-admin] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:32.189006 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-7512c790-8b34-4e46-a907-fbe324bf5d32 tempest-FlavorsAccessNegativeTestJSON-2101776700 tempest-FlavorsAccessNegativeTestJSON-2101776700-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/44000011" status: 202 len: 0 microversion: 2.1 time: 0.035630 Aug 10 22:55:32.191188 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 40/60] 10.222.0.58 () {58 vars in 1155 bytes} [Wed Aug 10 22:55:32 2022] DELETE /compute/v2.1/flavors/44000011 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 22:55:32.198024 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-abe601ca-7ed3-4d37-91e9-fc40d92b5717 tempest-FlavorsAdminTestJSON-1958744410 tempest-FlavorsAdminTestJSON-1958744410-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "1997384189"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:55:32.226956 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-abe601ca-7ed3-4d37-91e9-fc40d92b5717 tempest-FlavorsAdminTestJSON-1958744410 tempest-FlavorsAdminTestJSON-1958744410-project] HTTP exception thrown: Flavor 1997384189 could not be found. Aug 10 22:55:32.232573 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-abe601ca-7ed3-4d37-91e9-fc40d92b5717 tempest-FlavorsAdminTestJSON-1958744410 tempest-FlavorsAdminTestJSON-1958744410-project] Request method failure captured: Aug 10 22:55:32.232573 n-d-850468-14 devstack@n-api.service[122632]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 10 22:55:32.232573 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 22:55:32.232573 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 22:55:32.232573 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 22:55:32.232573 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 107 Aug 10 22:55:32.232573 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 22:55:32.232573 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 22:55:32.232573 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 22:55:32.232573 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 22:55:32.232573 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9DdcyXfC8K-8X9PZ5ONjP799EVdIdEFCC4dPDDDE6HHqOrWRkrLDUeIsFwg_FvJ6X1pSruz4XYYmE7xXydAMgU4x_bGBswF0Jv1wFdfwH5M9LW3idYi_TyFkA21vRHq2utx_py4E4v-Bqvma70Jqlz8PrOWV-ZKj3cFSXcHQHhd26xQ Aug 10 22:55:32.232573 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 22:55:32.232573 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 22:55:32.232573 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 22:55:32.232573 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 22:55:32.232573 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 22:55:32.232573 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 22:55:32.232573 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 144266a7a9764f1883ba50267105aee0 Aug 10 22:55:32.232573 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-FlavorsAdminTestJSON-1958744410 Aug 10 22:55:32.232573 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 22:55:32.232573 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 22:55:32.233897 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/144266a7a9764f1883ba50267105aee0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/144266a7a9764f1883ba50267105aee0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/144266a7a9764f1883ba50267105aee0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_144266a7a9764f1883ba50267105aee0", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 22:55:32.233897 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-FlavorsAdminTestJSON-1958744410 Aug 10 22:55:32.233897 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 144266a7a9764f1883ba50267105aee0 Aug 10 22:55:32.233897 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-1958744410 Aug 10 22:55:32.233897 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-FlavorsAdminTestJSON-1958744410-project Aug 10 22:55:32.233897 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 22:55:32.233897 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 22:55:32.233897 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: 9e381c1efc3747cdb830ed27fcd35c1c Aug 10 22:55:32.233897 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-FlavorsAdminTestJSON-1958744410-project Aug 10 22:55:32.233897 n-d-850468-14 devstack@n-api.service[122632]: Aug 10 22:55:32.233897 n-d-850468-14 devstack@n-api.service[122632]: {"server": {"name": "test", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "1997384189"}} Aug 10 22:55:32.233897 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 22:55:32.233897 n-d-850468-14 devstack@n-api.service[122632]: exception: Flavor 1997384189 could not be found. Aug 10 22:55:32.234707 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'body': {'server': {'name': 'test', 'imageRef': '78ad8905-f66f-4733-8be9-2b260f1fabed', 'flavorRef': '1997384189'}}} Aug 10 22:55:32.234707 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 22:55:32.234707 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:55:32.234707 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Aug 10 22:55:32.234707 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Aug 10 22:55:32.234707 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 10 22:55:32.234707 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 10 22:55:32.234707 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 10 22:55:32.234707 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 10 22:55:32.234707 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 10 22:55:32.234707 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 10 22:55:32.234707 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 10 22:55:32.234707 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 22:55:32.234707 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 10 22:55:32.234707 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 10 22:55:32.234707 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 1997384189 could not be found. Aug 10 22:55:32.234707 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:55:32.234707 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:55:32.234707 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:55:32.234707 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:55:32.235879 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:55:32.235879 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:55:32.235879 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 22:55:32.235879 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 22:55:32.235879 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 22:55:32.235879 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 22:55:32.235879 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 22:55:32.235879 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 22:55:32.235879 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 22:55:32.235879 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 22:55:32.235879 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 22:55:32.235879 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 22:55:32.235879 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 22:55:32.235879 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Aug 10 22:55:32.235879 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 10 22:55:32.235879 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 1997384189 could not be found. Aug 10 22:55:32.235879 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:55:32.235879 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:55:32.235879 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:55:32.235879 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:55:32.235879 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:55:32.237063 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:55:32.237063 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 22:55:32.237063 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 22:55:32.237063 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1997384189 could not be found. Aug 10 22:55:32.237063 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:55:32.237063 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-abe601ca-7ed3-4d37-91e9-fc40d92b5717 tempest-FlavorsAdminTestJSON-1958744410 tempest-FlavorsAdminTestJSON-1958744410-project] Returning 400 to user: Flavor 1997384189 could not be found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 22:55:32.237063 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-abe601ca-7ed3-4d37-91e9-fc40d92b5717 tempest-FlavorsAdminTestJSON-1958744410 tempest-FlavorsAdminTestJSON-1958744410-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 400 len: 81 microversion: 2.1 time: 0.044201 Aug 10 22:55:32.237488 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 41/61] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 22:55:32 2022] POST /compute/v2.1/servers => generated 81 bytes in 46 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 10 22:55:32.242346 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-f61b408a-de4c-4f4b-a336-dfa480b28338 tempest-FlavorsAccessNegativeTestJSON-2101776700 tempest-FlavorsAccessNegativeTestJSON-2101776700-project-admin] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:32.251505 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-3c1fa435-4e20-4804-b595-d07ca1cd7cd1 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-1519550508", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452", "availability_zone": "tempest-test_az-1567140817"}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:55:32.292042 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3c1fa435-4e20-4804-b595-d07ca1cd7cd1 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:32.292541 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3c1fa435-4e20-4804-b595-d07ca1cd7cd1 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:32.292972 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3c1fa435-4e20-4804-b595-d07ca1cd7cd1 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:32.293701 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3c1fa435-4e20-4804-b595-d07ca1cd7cd1 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:32.294162 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3c1fa435-4e20-4804-b595-d07ca1cd7cd1 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:32.294590 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3c1fa435-4e20-4804-b595-d07ca1cd7cd1 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:32.296183 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-f61b408a-de4c-4f4b-a336-dfa480b28338 tempest-FlavorsAccessNegativeTestJSON-2101776700 tempest-FlavorsAccessNegativeTestJSON-2101776700-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.057411 Aug 10 22:55:32.306890 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 42/62] 10.222.0.58 () {58 vars in 1146 bytes} [Wed Aug 10 22:55:32 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:55:32.313089 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-f313b9f3-6bc4-46dc-be39-f46c0ce57aa3 tempest-FlavorsAdminTestJSON-2084737028 tempest-FlavorsAdminTestJSON-2084737028-project-admin] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:32.353563 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-f313b9f3-6bc4-46dc-be39-f46c0ce57aa3 tempest-FlavorsAdminTestJSON-2084737028 tempest-FlavorsAdminTestJSON-2084737028-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/1997384189" status: 202 len: 0 microversion: 2.1 time: 0.055105 Aug 10 22:55:32.354146 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 43/63] 10.222.0.58 () {58 vars in 1161 bytes} [Wed Aug 10 22:55:32 2022] DELETE /compute/v2.1/flavors/1997384189 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 22:55:32.359851 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-5b7a33a6-7d72-4157-9dd5-7569fc0a858a tempest-FlavorsAccessNegativeTestJSON-2101776700 tempest-FlavorsAccessNegativeTestJSON-2101776700-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1389018601", "id": 548799182, "os-flavor-access:is_public": "False"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:55:32.394004 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-5b7a33a6-7d72-4157-9dd5-7569fc0a858a tempest-FlavorsAccessNegativeTestJSON-2101776700 tempest-FlavorsAccessNegativeTestJSON-2101776700-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.038619 Aug 10 22:55:32.396056 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 44/64] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 22:55:32 2022] POST /compute/v2.1/flavors => generated 436 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:55:32.407130 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-fe8592c8-c728-452a-ac01-dac42afac048 tempest-FlavorsAdminTestJSON-2084737028 tempest-FlavorsAdminTestJSON-2084737028-project-admin] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:32.434271 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-fe8592c8-c728-452a-ac01-dac42afac048 tempest-FlavorsAdminTestJSON-2084737028 tempest-FlavorsAdminTestJSON-2084737028-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.036877 Aug 10 22:55:32.447619 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 45/65] 10.222.0.58 () {58 vars in 1146 bytes} [Wed Aug 10 22:55:32 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:55:32.715387 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-93f6da2a-0b00-40ea-8e18-8d3dfbaf60eb tempest-FlavorsAccessNegativeTestJSON-1634752972 tempest-FlavorsAccessNegativeTestJSON-1634752972-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "9702a48666bb496c977ec770eb01ee37"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:55:32.725198 n-d-850468-14 devstack@n-api.service[122632]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:55:32.725198 n-d-850468-14 devstack@n-api.service[122632]: warnings.warn(msg) Aug 10 22:55:32.731070 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-93f6da2a-0b00-40ea-8e18-8d3dfbaf60eb tempest-FlavorsAccessNegativeTestJSON-1634752972 tempest-FlavorsAccessNegativeTestJSON-1634752972-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': '32f534b3cccb4d428e85288468ccea8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9702a48666bb496c977ec770eb01ee37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:55:32.732869 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-93f6da2a-0b00-40ea-8e18-8d3dfbaf60eb tempest-FlavorsAccessNegativeTestJSON-1634752972 tempest-FlavorsAccessNegativeTestJSON-1634752972-project] Request method failure captured: Aug 10 22:55:32.732869 n-d-850468-14 devstack@n-api.service[122632]: request: POST /compute/v2.1/flavors/548799182/action HTTP/1.1 Aug 10 22:55:32.732869 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 22:55:32.732869 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 22:55:32.732869 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 22:55:32.732869 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 67 Aug 10 22:55:32.732869 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 22:55:32.732869 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 22:55:32.732869 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 22:55:32.732869 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 22:55:32.732869 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9Ddd9GnrnTCG1TrqRMU14oa__r81JD6awHWTouEsYcqXFIrUpwAm4WWyA6i7Pi0nigkbayfhodKh0ViT6OK5e3MPzB-04W-4oHs9G_ARh1UI1zYIsMvCkN63pXeWLi_nCbIzWMHQzRL7fj3KVDYnR-8FKcj3YirLoD-XgZT7HQl5XNA Aug 10 22:55:32.732869 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 22:55:32.732869 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 22:55:32.732869 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 22:55:32.732869 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 22:55:32.732869 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 22:55:32.732869 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 22:55:32.732869 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 9702a48666bb496c977ec770eb01ee37 Aug 10 22:55:32.732869 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1634752972 Aug 10 22:55:32.732869 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 22:55:32.732869 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 22:55:32.734130 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9702a48666bb496c977ec770eb01ee37"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9702a48666bb496c977ec770eb01ee37"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/9702a48666bb496c977ec770eb01ee37"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_9702a48666bb496c977ec770eb01ee37", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 22:55:32.734130 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1634752972 Aug 10 22:55:32.734130 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 9702a48666bb496c977ec770eb01ee37 Aug 10 22:55:32.734130 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1634752972 Aug 10 22:55:32.734130 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-FlavorsAccessNegativeTestJSON-1634752972-project Aug 10 22:55:32.734130 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 22:55:32.734130 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 22:55:32.734130 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: 32f534b3cccb4d428e85288468ccea8a Aug 10 22:55:32.734130 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1634752972-project Aug 10 22:55:32.734130 n-d-850468-14 devstack@n-api.service[122632]: Aug 10 22:55:32.734130 n-d-850468-14 devstack@n-api.service[122632]: {"addTenantAccess": {"tenant": "9702a48666bb496c977ec770eb01ee37"}} Aug 10 22:55:32.734130 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 22:55:32.735011 n-d-850468-14 devstack@n-api.service[122632]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Aug 10 22:55:32.735011 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': '548799182', 'body': {'addTenantAccess': {'tenant': '9702a48666bb496c977ec770eb01ee37'}}} Aug 10 22:55:32.735011 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 22:55:32.735011 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:55:32.735011 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:55:32.735011 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:55:32.735011 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 22:55:32.735011 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 22:55:32.735011 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 22:55:32.735011 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 22:55:32.735011 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 22:55:32.735011 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 22:55:32.735011 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Aug 10 22:55:32.735011 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Aug 10 22:55:32.735011 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 10 22:55:32.735011 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 10 22:55:32.735011 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 10 22:55:32.735011 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 10 22:55:32.735011 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 10 22:55:32.736264 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 10 22:55:32.736264 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 10 22:55:32.736264 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise self.value Aug 10 22:55:32.736264 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 10 22:55:32.736264 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 10 22:55:32.736264 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 10 22:55:32.736264 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 10 22:55:32.736264 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 10 22:55:32.736264 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 10 22:55:32.736264 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Aug 10 22:55:32.736264 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:55:32.736264 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:55:32.736264 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:55:32.736264 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:55:32.736264 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:55:32.736264 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:55:32.736264 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 10 22:55:32.736264 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 10 22:55:32.736264 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Aug 10 22:55:32.736264 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:55:32.741794 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-93f6da2a-0b00-40ea-8e18-8d3dfbaf60eb tempest-FlavorsAccessNegativeTestJSON-1634752972 tempest-FlavorsAccessNegativeTestJSON-1634752972-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 22:55:32.744758 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-93f6da2a-0b00-40ea-8e18-8d3dfbaf60eb tempest-FlavorsAccessNegativeTestJSON-1634752972 tempest-FlavorsAccessNegativeTestJSON-1634752972-project] 10.222.0.58 "POST /compute/v2.1/flavors/548799182/action" status: 403 len: 130 microversion: 2.1 time: 0.303028 Aug 10 22:55:32.748408 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 46/66] 10.222.0.58 () {60 vars in 1197 bytes} [Wed Aug 10 22:55:32 2022] POST /compute/v2.1/flavors/548799182/action => generated 130 bytes in 308 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 10 22:55:32.761840 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-633eabcc-d4e5-4ad8-a1e2-b696fe7d3879 tempest-FlavorsAdminTestJSON-2084737028 tempest-FlavorsAdminTestJSON-2084737028-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1094511000", "id": 170982321, "os-flavor-access:is_public": "False"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:55:32.796017 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-633eabcc-d4e5-4ad8-a1e2-b696fe7d3879 tempest-FlavorsAdminTestJSON-2084737028 tempest-FlavorsAdminTestJSON-2084737028-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.042713 Aug 10 22:55:32.797966 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 47/67] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 22:55:32 2022] POST /compute/v2.1/flavors => generated 412 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:55:32.803398 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-7a919e5b-0af6-401f-be93-d70f3dd71748 tempest-FlavorsAccessNegativeTestJSON-2101776700 tempest-FlavorsAccessNegativeTestJSON-2101776700-project-admin] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:32.825709 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-7a919e5b-0af6-401f-be93-d70f3dd71748 tempest-FlavorsAccessNegativeTestJSON-2101776700 tempest-FlavorsAccessNegativeTestJSON-2101776700-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/548799182" status: 202 len: 0 microversion: 2.1 time: 0.026451 Aug 10 22:55:32.826472 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 48/68] 10.222.0.58 () {58 vars in 1158 bytes} [Wed Aug 10 22:55:32 2022] DELETE /compute/v2.1/flavors/548799182 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 22:55:32.839755 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-5756fb69-7742-450d-a4fd-045bfdbc750e tempest-FlavorsAdminTestJSON-2084737028 tempest-FlavorsAdminTestJSON-2084737028-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-592254719", "id": 2131044423, "os-flavor-access:is_public": "True"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:55:32.851096 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=7,nova_api:DELETE=21 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:55:32.899034 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-5756fb69-7742-450d-a4fd-045bfdbc750e tempest-FlavorsAdminTestJSON-2084737028 tempest-FlavorsAdminTestJSON-2084737028-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.067211 Aug 10 22:55:32.899789 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 49/69] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 22:55:32 2022] POST /compute/v2.1/flavors => generated 413 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:55:32.913660 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-b49ab567-f61f-4dfe-b3d3-c8861dc73f70 tempest-FlavorsAccessNegativeTestJSON-2101776700 tempest-FlavorsAccessNegativeTestJSON-2101776700-project-admin] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:32.969282 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-b49ab567-f61f-4dfe-b3d3-c8861dc73f70 tempest-FlavorsAccessNegativeTestJSON-2101776700 tempest-FlavorsAccessNegativeTestJSON-2101776700-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 5394 microversion: 2.1 time: 0.062984 Aug 10 22:55:32.995126 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 50/70] 10.222.0.58 () {58 vars in 1146 bytes} [Wed Aug 10 22:55:32 2022] GET /compute/v2.1/flavors/detail => generated 5394 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:55:33.007982 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-27b911dd-dde6-40d3-9ba6-c7acadc378a4 tempest-FlavorsAdminTestJSON-2084737028 tempest-FlavorsAdminTestJSON-2084737028-project-admin] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:33.047523 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-27b911dd-dde6-40d3-9ba6-c7acadc378a4 tempest-FlavorsAdminTestJSON-2084737028 tempest-FlavorsAdminTestJSON-2084737028-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 415 microversion: 2.1 time: 0.050230 Aug 10 22:55:33.048036 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 51/71] 10.222.0.58 () {58 vars in 1169 bytes} [Wed Aug 10 22:55:32 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 415 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:55:33.054112 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-15923ae9-c8a0-4724-bb28-6d367dd00d4c tempest-FlavorsAccessNegativeTestJSON-2101776700 tempest-FlavorsAccessNegativeTestJSON-2101776700-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-2651241", "id": 819536308, "os-flavor-access:is_public": "False"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:55:33.091405 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-15923ae9-c8a0-4724-bb28-6d367dd00d4c tempest-FlavorsAccessNegativeTestJSON-2101776700 tempest-FlavorsAccessNegativeTestJSON-2101776700-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 433 microversion: 2.1 time: 0.028682 Aug 10 22:55:33.102480 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 52/72] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 22:55:33 2022] POST /compute/v2.1/flavors => generated 433 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:55:33.108744 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-bfbf03bc-7c62-44ff-ab58-1e173b974f2b tempest-FlavorsAdminTestJSON-2084737028 tempest-FlavorsAdminTestJSON-2084737028-project-admin] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:33.123437 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-bfbf03bc-7c62-44ff-ab58-1e173b974f2b tempest-FlavorsAdminTestJSON-2084737028 tempest-FlavorsAdminTestJSON-2084737028-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 838 microversion: 2.1 time: 0.019556 Aug 10 22:55:33.124251 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 53/73] 10.222.0.58 () {58 vars in 1177 bytes} [Wed Aug 10 22:55:33 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 838 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:55:33.131054 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-7b010949-e755-4cd5-a5c9-3d0aef09ce78 tempest-FlavorsAccessNegativeTestJSON-2101776700 tempest-FlavorsAccessNegativeTestJSON-2101776700-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "9702a48666bb496c977ec770eb01ee37"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:55:33.383502 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.network.neutron [None req-3c1fa435-4e20-4804-b595-d07ca1cd7cd1 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] validate_networks() for None {{(pid=122633) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 22:55:33.878902 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-3c1fa435-4e20-4804-b595-d07ca1cd7cd1 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Flavor limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 22:55:33.879883 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-3c1fa435-4e20-4804-b595-d07ca1cd7cd1 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Image limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 22:55:33.880434 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-3c1fa435-4e20-4804-b595-d07ca1cd7cd1 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Flavor pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 22:55:33.881146 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-3c1fa435-4e20-4804-b595-d07ca1cd7cd1 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Image pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 22:55:33.881566 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-3c1fa435-4e20-4804-b595-d07ca1cd7cd1 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 22:55:33.921808 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3c1fa435-4e20-4804-b595-d07ca1cd7cd1 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:33.923803 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3c1fa435-4e20-4804-b595-d07ca1cd7cd1 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:33.926268 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3c1fa435-4e20-4804-b595-d07ca1cd7cd1 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:33.928504 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3c1fa435-4e20-4804-b595-d07ca1cd7cd1 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:33.929261 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3c1fa435-4e20-4804-b595-d07ca1cd7cd1 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:33.929710 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3c1fa435-4e20-4804-b595-d07ca1cd7cd1 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:33.997655 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-3c1fa435-4e20-4804-b595-d07ca1cd7cd1 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Getting quotas for project a9a37b95a10245b796d26c1b35036827. Resources: {'instances', 'cores', 'ram'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 22:55:34.008768 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-3c1fa435-4e20-4804-b595-d07ca1cd7cd1 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Getting quotas for user cfd644627ab14e55803c1d5981b9859a and project a9a37b95a10245b796d26c1b35036827. Resources: {'instances', 'cores', 'ram'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 22:55:34.028379 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-3c1fa435-4e20-4804-b595-d07ca1cd7cd1 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Going to run 1 instances... {{(pid=122633) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 22:55:34.032190 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-3c1fa435-4e20-4804-b595-d07ca1cd7cd1 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] [instance: 155e0037-0bdb-4a93-af44-de6903bc2891] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78ad8905-f66f-4733-8be9-2b260f1fabed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122633) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 22:55:34.127102 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-3c1fa435-4e20-4804-b595-d07ca1cd7cd1 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.494636 Aug 10 22:55:34.127810 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 21/74] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 22:55:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 2496 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 22:55:34.141802 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-b406836a-842a-4381-9eae-ba67171c6df0 tempest-FlavorsAdminTestJSON-2084737028 tempest-FlavorsAdminTestJSON-2084737028-project-admin] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:34.166192 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-b406836a-842a-4381-9eae-ba67171c6df0 tempest-FlavorsAdminTestJSON-2084737028 tempest-FlavorsAdminTestJSON-2084737028-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 838 microversion: 2.1 time: 0.028137 Aug 10 22:55:34.167353 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 22/75] 10.222.0.58 () {58 vars in 1171 bytes} [Wed Aug 10 22:55:34 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 838 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:55:34.172073 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-f8c61fe2-fb99-4b14-9bee-1b38c300d4f4 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:34.172974 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-f8c61fe2-fb99-4b14-9bee-1b38c300d4f4 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] [instance: 155e0037-0bdb-4a93-af44-de6903bc2891] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:55:34.291558 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-7b010949-e755-4cd5-a5c9-3d0aef09ce78 tempest-FlavorsAccessNegativeTestJSON-2101776700 tempest-FlavorsAccessNegativeTestJSON-2101776700-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors/819536308/action" status: 200 len: 96 microversion: 2.1 time: 1.165431 Aug 10 22:55:34.299497 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 54/76] 10.222.0.58 () {60 vars in 1197 bytes} [Wed Aug 10 22:55:33 2022] POST /compute/v2.1/flavors/819536308/action => generated 96 bytes in 1174 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 22:55:34.305670 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-49faba33-5eec-4569-ad81-f03a743654ae tempest-FlavorsAdminTestJSON-2084737028 tempest-FlavorsAdminTestJSON-2084737028-project-admin] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:34.312331 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-f8c61fe2-fb99-4b14-9bee-1b38c300d4f4 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd644627ab14e55803c1d5981b9859a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a37b95a10245b796d26c1b35036827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:55:34.318749 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-49faba33-5eec-4569-ad81-f03a743654ae tempest-FlavorsAdminTestJSON-2084737028 tempest-FlavorsAdminTestJSON-2084737028-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 838 microversion: 2.1 time: 0.017854 Aug 10 22:55:34.319382 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 55/77] 10.222.0.58 () {58 vars in 1169 bytes} [Wed Aug 10 22:55:34 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 838 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:55:34.333620 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-60f33083-3184-4c2e-aff2-7125fac5b69d tempest-FlavorsAccessNegativeTestJSON-1634752972 tempest-FlavorsAccessNegativeTestJSON-1634752972-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "9702a48666bb496c977ec770eb01ee37"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:55:34.337765 n-d-850468-14 devstack@n-api.service[122632]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:55:34.337765 n-d-850468-14 devstack@n-api.service[122632]: warnings.warn(msg) Aug 10 22:55:34.338246 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-f8c61fe2-fb99-4b14-9bee-1b38c300d4f4 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] 10.222.0.58 "GET /compute/v2.1/servers/155e0037-0bdb-4a93-af44-de6903bc2891" status: 200 len: 1243 microversion: 2.1 time: 0.169414 Aug 10 22:55:34.339530 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-60f33083-3184-4c2e-aff2-7125fac5b69d tempest-FlavorsAccessNegativeTestJSON-1634752972 tempest-FlavorsAccessNegativeTestJSON-1634752972-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': '32f534b3cccb4d428e85288468ccea8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9702a48666bb496c977ec770eb01ee37', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:55:34.343203 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 23/78] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:55:34 2022] GET /compute/v2.1/servers/155e0037-0bdb-4a93-af44-de6903bc2891 => generated 1243 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:55:34.347857 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-60f33083-3184-4c2e-aff2-7125fac5b69d tempest-FlavorsAccessNegativeTestJSON-1634752972 tempest-FlavorsAccessNegativeTestJSON-1634752972-project] Request method failure captured: Aug 10 22:55:34.347857 n-d-850468-14 devstack@n-api.service[122632]: request: POST /compute/v2.1/flavors/819536308/action HTTP/1.1 Aug 10 22:55:34.347857 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 22:55:34.347857 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 22:55:34.347857 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 22:55:34.347857 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 70 Aug 10 22:55:34.347857 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 22:55:34.347857 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 22:55:34.347857 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 22:55:34.347857 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 22:55:34.347857 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9Ddd9GnrnTCG1TrqRMU14oa__r81JD6awHWTouEsYcqXFIrUpwAm4WWyA6i7Pi0nigkbayfhodKh0ViT6OK5e3MPzB-04W-4oHs9G_ARh1UI1zYIsMvCkN63pXeWLi_nCbIzWMHQzRL7fj3KVDYnR-8FKcj3YirLoD-XgZT7HQl5XNA Aug 10 22:55:34.347857 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 22:55:34.347857 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 22:55:34.347857 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 22:55:34.347857 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 22:55:34.347857 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 22:55:34.347857 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 22:55:34.347857 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 9702a48666bb496c977ec770eb01ee37 Aug 10 22:55:34.347857 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1634752972 Aug 10 22:55:34.347857 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 22:55:34.347857 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 22:55:34.349845 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9702a48666bb496c977ec770eb01ee37"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9702a48666bb496c977ec770eb01ee37"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/9702a48666bb496c977ec770eb01ee37"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_9702a48666bb496c977ec770eb01ee37", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 22:55:34.349845 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1634752972 Aug 10 22:55:34.349845 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 9702a48666bb496c977ec770eb01ee37 Aug 10 22:55:34.349845 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1634752972 Aug 10 22:55:34.349845 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-FlavorsAccessNegativeTestJSON-1634752972-project Aug 10 22:55:34.349845 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 22:55:34.349845 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 22:55:34.349845 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: 32f534b3cccb4d428e85288468ccea8a Aug 10 22:55:34.349845 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1634752972-project Aug 10 22:55:34.349845 n-d-850468-14 devstack@n-api.service[122632]: Aug 10 22:55:34.349845 n-d-850468-14 devstack@n-api.service[122632]: {"removeTenantAccess": {"tenant": "9702a48666bb496c977ec770eb01ee37"}} Aug 10 22:55:34.349845 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 22:55:34.350736 n-d-850468-14 devstack@n-api.service[122632]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Aug 10 22:55:34.350736 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': '819536308', 'body': {'removeTenantAccess': {'tenant': '9702a48666bb496c977ec770eb01ee37'}}} Aug 10 22:55:34.350736 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 22:55:34.350736 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:55:34.350736 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:55:34.350736 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:55:34.350736 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 22:55:34.350736 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 22:55:34.350736 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 22:55:34.350736 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 22:55:34.350736 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 22:55:34.350736 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 22:55:34.350736 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Aug 10 22:55:34.350736 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi context.can( Aug 10 22:55:34.350736 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 10 22:55:34.350736 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 10 22:55:34.350736 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 10 22:55:34.350736 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 10 22:55:34.350736 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 10 22:55:34.350736 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 10 22:55:34.351979 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 10 22:55:34.351979 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise self.value Aug 10 22:55:34.351979 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 10 22:55:34.351979 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 10 22:55:34.351979 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 10 22:55:34.351979 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 10 22:55:34.351979 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 10 22:55:34.351979 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 10 22:55:34.351979 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Aug 10 22:55:34.351979 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:55:34.351979 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:55:34.351979 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:55:34.351979 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:55:34.351979 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:55:34.351979 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:55:34.351979 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 10 22:55:34.351979 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 10 22:55:34.351979 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Aug 10 22:55:34.351979 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:55:34.361496 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-60f33083-3184-4c2e-aff2-7125fac5b69d tempest-FlavorsAccessNegativeTestJSON-1634752972 tempest-FlavorsAccessNegativeTestJSON-1634752972-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 22:55:34.364405 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-60f33083-3184-4c2e-aff2-7125fac5b69d tempest-FlavorsAccessNegativeTestJSON-1634752972 tempest-FlavorsAccessNegativeTestJSON-1634752972-project] 10.222.0.58 "POST /compute/v2.1/flavors/819536308/action" status: 403 len: 133 microversion: 2.1 time: 0.041924 Aug 10 22:55:34.368767 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-0f94f60e-0742-453d-b5c2-639972b169c8 tempest-FlavorsAdminTestJSON-2084737028 tempest-FlavorsAdminTestJSON-2084737028-project-admin] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:34.368868 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 56/79] 10.222.0.58 () {60 vars in 1197 bytes} [Wed Aug 10 22:55:34 2022] POST /compute/v2.1/flavors/819536308/action => generated 133 bytes in 47 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 10 22:55:34.382449 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-167499e4-0425-4249-9ec3-09df121f5c3d tempest-FlavorsAccessNegativeTestJSON-2101776700 tempest-FlavorsAccessNegativeTestJSON-2101776700-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "9702a48666bb496c977ec770eb01ee37"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:55:34.392129 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-0f94f60e-0742-453d-b5c2-639972b169c8 tempest-FlavorsAdminTestJSON-2084737028 tempest-FlavorsAdminTestJSON-2084737028-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 5394 microversion: 2.1 time: 0.051374 Aug 10 22:55:34.393118 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 24/80] 10.222.0.58 () {58 vars in 1169 bytes} [Wed Aug 10 22:55:34 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 5394 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:55:34.412275 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-f6a6d354-1aa3-40ef-b6be-37110043cabf tempest-FlavorsAdminTestJSON-2084737028 tempest-FlavorsAdminTestJSON-2084737028-project-admin] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:34.436168 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-f6a6d354-1aa3-40ef-b6be-37110043cabf tempest-FlavorsAdminTestJSON-2084737028 tempest-FlavorsAdminTestJSON-2084737028-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 5394 microversion: 2.1 time: 0.028569 Aug 10 22:55:34.436675 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 25/81] 10.222.0.58 () {58 vars in 1175 bytes} [Wed Aug 10 22:55:34 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 5394 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:55:34.454005 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-0468941b-761d-48c5-b344-0e17f7fbe55c tempest-FlavorsAdminTestJSON-2084737028 tempest-FlavorsAdminTestJSON-2084737028-project-admin] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:34.475461 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-0468941b-761d-48c5-b344-0e17f7fbe55c tempest-FlavorsAdminTestJSON-2084737028 tempest-FlavorsAdminTestJSON-2084737028-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 5394 microversion: 2.1 time: 0.024946 Aug 10 22:55:34.476069 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 26/82] 10.222.0.58 () {58 vars in 1173 bytes} [Wed Aug 10 22:55:34 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 5394 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:55:34.493124 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-e3ae7311-c23d-4360-baf3-a443d4012086 tempest-FlavorsAdminTestJSON-2084737028 tempest-FlavorsAdminTestJSON-2084737028-project-admin] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:34.515022 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-e3ae7311-c23d-4360-baf3-a443d4012086 tempest-FlavorsAdminTestJSON-2084737028 tempest-FlavorsAdminTestJSON-2084737028-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 5394 microversion: 2.1 time: 0.025512 Aug 10 22:55:34.515760 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 27/83] 10.222.0.58 () {58 vars in 1169 bytes} [Wed Aug 10 22:55:34 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 5394 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:55:34.534126 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-36891a0e-4148-47d2-844d-e66fc94a7e25 tempest-FlavorsAdminTestJSON-2084737028 tempest-FlavorsAdminTestJSON-2084737028-project-admin] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:34.534997 n-d-850468-14 devstack@n-api.service[122633]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:55:34.534997 n-d-850468-14 devstack@n-api.service[122633]: warnings.warn(msg) Aug 10 22:55:34.555543 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-36891a0e-4148-47d2-844d-e66fc94a7e25 tempest-FlavorsAdminTestJSON-2084737028 tempest-FlavorsAdminTestJSON-2084737028-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/2131044423" status: 202 len: 0 microversion: 2.1 time: 0.024594 Aug 10 22:55:34.556132 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 28/84] 10.222.0.58 () {58 vars in 1161 bytes} [Wed Aug 10 22:55:34 2022] DELETE /compute/v2.1/flavors/2131044423 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 10 22:55:34.564671 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-03bea7ad-627c-4b60-919e-b9c3ee8dbe74 tempest-FlavorsAdminTestJSON-2084737028 tempest-FlavorsAdminTestJSON-2084737028-project-admin] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:34.586030 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-03bea7ad-627c-4b60-919e-b9c3ee8dbe74 tempest-FlavorsAdminTestJSON-2084737028 tempest-FlavorsAdminTestJSON-2084737028-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024709 Aug 10 22:55:34.587116 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 29/85] 10.222.0.58 () {58 vars in 1146 bytes} [Wed Aug 10 22:55:34 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:55:34.604093 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-f9eb9d40-7cf4-41cf-9d81-76f37f7a2a1a tempest-FlavorsAdminTestJSON-2084737028 tempest-FlavorsAdminTestJSON-2084737028-project-admin] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:34.623102 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-f9eb9d40-7cf4-41cf-9d81-76f37f7a2a1a tempest-FlavorsAdminTestJSON-2084737028 tempest-FlavorsAdminTestJSON-2084737028-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/170982321" status: 202 len: 0 microversion: 2.1 time: 0.022452 Aug 10 22:55:34.624046 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 30/86] 10.222.0.58 () {58 vars in 1158 bytes} [Wed Aug 10 22:55:34 2022] DELETE /compute/v2.1/flavors/170982321 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 10 22:55:34.632865 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-b7641fd6-48eb-4dc9-a8e1-3fa204c573dd tempest-FlavorsAdminTestJSON-2084737028 tempest-FlavorsAdminTestJSON-2084737028-project-admin] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:34.654379 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-b7641fd6-48eb-4dc9-a8e1-3fa204c573dd tempest-FlavorsAdminTestJSON-2084737028 tempest-FlavorsAdminTestJSON-2084737028-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.026274 Aug 10 22:55:34.655009 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 31/87] 10.222.0.58 () {58 vars in 1146 bytes} [Wed Aug 10 22:55:34 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:55:34.676488 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-2c937a6e-f384-4ca4-85fa-0660d019b1e1 tempest-FlavorsAdminTestJSON-2084737028 tempest-FlavorsAdminTestJSON-2084737028-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1972468669", "id": 633926615, "os-flavor-access:is_public": "False"}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:55:34.679350 n-d-850468-14 devstack@n-api.service[122633]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:55:34.679350 n-d-850468-14 devstack@n-api.service[122633]: warnings.warn(msg) Aug 10 22:55:34.704137 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-2c937a6e-f384-4ca4-85fa-0660d019b1e1 tempest-FlavorsAdminTestJSON-2084737028 tempest-FlavorsAdminTestJSON-2084737028-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.030988 Aug 10 22:55:34.706397 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 32/88] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 22:55:34 2022] POST /compute/v2.1/flavors => generated 412 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 22:55:34.720216 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-90dac4c4-d1d3-480f-b30e-3967c37f61b2 tempest-FlavorsAdminTestJSON-2084737028 tempest-FlavorsAdminTestJSON-2084737028-project-admin] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:34.746606 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-90dac4c4-d1d3-480f-b30e-3967c37f61b2 tempest-FlavorsAdminTestJSON-2084737028 tempest-FlavorsAdminTestJSON-2084737028-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.032552 Aug 10 22:55:34.758811 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 33/89] 10.222.0.58 () {58 vars in 1146 bytes} [Wed Aug 10 22:55:34 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:55:34.767250 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-ae8804f2-09f9-4c20-a261-025e050bd1e8 tempest-FlavorsAdminTestJSON-1958744410 tempest-FlavorsAdminTestJSON-1958744410-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:34.801010 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-ae8804f2-09f9-4c20-a261-025e050bd1e8 tempest-FlavorsAdminTestJSON-1958744410 tempest-FlavorsAdminTestJSON-1958744410-project] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.037400 Aug 10 22:55:34.807237 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 34/90] 10.222.0.58 () {58 vars in 1146 bytes} [Wed Aug 10 22:55:34 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:55:34.832328 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-e75dc53b-027c-4510-9cf3-fb804c915c92 tempest-FlavorsAdminTestJSON-2084737028 tempest-FlavorsAdminTestJSON-2084737028-project-admin] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:34.853278 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-e75dc53b-027c-4510-9cf3-fb804c915c92 tempest-FlavorsAdminTestJSON-2084737028 tempest-FlavorsAdminTestJSON-2084737028-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/633926615" status: 202 len: 0 microversion: 2.1 time: 0.037729 Aug 10 22:55:34.853727 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 35/91] 10.222.0.58 () {58 vars in 1158 bytes} [Wed Aug 10 22:55:34 2022] DELETE /compute/v2.1/flavors/633926615 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 22:55:34.862212 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-369b7dd0-c88c-4939-b32d-041ad8bb84d9 tempest-FlavorsAdminTestJSON-2084737028 tempest-FlavorsAdminTestJSON-2084737028-project-admin] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:34.883875 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-369b7dd0-c88c-4939-b32d-041ad8bb84d9 tempest-FlavorsAdminTestJSON-2084737028 tempest-FlavorsAdminTestJSON-2084737028-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024881 Aug 10 22:55:34.885012 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 36/92] 10.222.0.58 () {58 vars in 1146 bytes} [Wed Aug 10 22:55:34 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:55:34.912598 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-88ada299-f1ee-40d0-b03f-e8c30ade6aba tempest-FlavorsAdminTestJSON-2084737028 tempest-FlavorsAdminTestJSON-2084737028-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1334042220", "id": 15389961, "os-flavor-access:is_public": "True"}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:55:34.949098 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-88ada299-f1ee-40d0-b03f-e8c30ade6aba tempest-FlavorsAdminTestJSON-2084737028 tempest-FlavorsAdminTestJSON-2084737028-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.1 time: 0.045643 Aug 10 22:55:34.949735 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 37/93] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 22:55:34 2022] POST /compute/v2.1/flavors => generated 408 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:55:34.966432 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-27258afc-141a-402c-b4ac-5cbf7e51a6c7 tempest-FlavorsAdminTestJSON-1958744410 tempest-FlavorsAdminTestJSON-1958744410-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:35.002185 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-27258afc-141a-402c-b4ac-5cbf7e51a6c7 tempest-FlavorsAdminTestJSON-1958744410 tempest-FlavorsAdminTestJSON-1958744410-project] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 5389 microversion: 2.1 time: 0.043170 Aug 10 22:55:35.004257 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 38/94] 10.222.0.58 () {58 vars in 1146 bytes} [Wed Aug 10 22:55:34 2022] GET /compute/v2.1/flavors/detail => generated 5389 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:55:35.023418 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-cfdf628c-e1a1-418b-b1b9-ecb9825d3726 tempest-FlavorsAdminTestJSON-2084737028 tempest-FlavorsAdminTestJSON-2084737028-project-admin] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:35.042745 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-cfdf628c-e1a1-418b-b1b9-ecb9825d3726 tempest-FlavorsAdminTestJSON-2084737028 tempest-FlavorsAdminTestJSON-2084737028-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/15389961" status: 202 len: 0 microversion: 2.1 time: 0.024182 Aug 10 22:55:35.047578 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 39/95] 10.222.0.58 () {58 vars in 1155 bytes} [Wed Aug 10 22:55:35 2022] DELETE /compute/v2.1/flavors/15389961 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 22:55:35.056327 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c61eb580-c3bb-4395-8241-ca6c418cc3be tempest-FlavorsAdminTestJSON-2084737028 tempest-FlavorsAdminTestJSON-2084737028-project-admin] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:35.084422 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-c61eb580-c3bb-4395-8241-ca6c418cc3be tempest-FlavorsAdminTestJSON-2084737028 tempest-FlavorsAdminTestJSON-2084737028-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.034076 Aug 10 22:55:35.085393 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 40/96] 10.222.0.58 () {58 vars in 1146 bytes} [Wed Aug 10 22:55:35 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:55:35.311312 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-167499e4-0425-4249-9ec3-09df121f5c3d tempest-FlavorsAccessNegativeTestJSON-2101776700 tempest-FlavorsAccessNegativeTestJSON-2101776700-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors/819536308/action" status: 200 len: 21 microversion: 2.1 time: 0.939455 Aug 10 22:55:35.313940 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 57/97] 10.222.0.58 () {60 vars in 1197 bytes} [Wed Aug 10 22:55:34 2022] POST /compute/v2.1/flavors/819536308/action => generated 21 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 22:55:35.325072 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-eede5564-269e-44e3-b57c-e979051a11cf tempest-FlavorsAccessNegativeTestJSON-2101776700 tempest-FlavorsAccessNegativeTestJSON-2101776700-project-admin] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:35.367631 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-2b7219ac-2668-4af4-a5c6-aa3f082845db tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:35.368792 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-eede5564-269e-44e3-b57c-e979051a11cf tempest-FlavorsAccessNegativeTestJSON-2101776700 tempest-FlavorsAccessNegativeTestJSON-2101776700-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/819536308" status: 202 len: 0 microversion: 2.1 time: 0.048420 Aug 10 22:55:35.369308 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-2b7219ac-2668-4af4-a5c6-aa3f082845db tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] [instance: 155e0037-0bdb-4a93-af44-de6903bc2891] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:55:35.369760 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 41/98] 10.222.0.58 () {58 vars in 1158 bytes} [Wed Aug 10 22:55:35 2022] DELETE /compute/v2.1/flavors/819536308 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 10 22:55:35.377385 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-3d7ba4b1-2adc-4408-903d-eb4f5f2b8a89 tempest-FlavorsAccessNegativeTestJSON-2101776700 tempest-FlavorsAccessNegativeTestJSON-2101776700-project-admin] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:35.422927 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-3d7ba4b1-2adc-4408-903d-eb4f5f2b8a89 tempest-FlavorsAccessNegativeTestJSON-2101776700 tempest-FlavorsAccessNegativeTestJSON-2101776700-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.048790 Aug 10 22:55:35.425710 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 42/99] 10.222.0.58 () {58 vars in 1146 bytes} [Wed Aug 10 22:55:35 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:55:35.446468 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-9b11e087-5340-4b8d-844f-87d2499379c8 tempest-FlavorsAccessNegativeTestJSON-2101776700 tempest-FlavorsAccessNegativeTestJSON-2101776700-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-99345605", "id": 654787758, "os-flavor-access:is_public": "False"}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:55:35.468137 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_api:SELECT=78,nova_api:DELETE=16,nova_api:INSERT=6 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:55:35.481091 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-9b11e087-5340-4b8d-844f-87d2499379c8 tempest-FlavorsAccessNegativeTestJSON-2101776700 tempest-FlavorsAccessNegativeTestJSON-2101776700-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 434 microversion: 2.1 time: 0.040342 Aug 10 22:55:35.485701 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 43/100] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 22:55:35 2022] POST /compute/v2.1/flavors => generated 434 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:55:35.498964 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-ed50ebe4-716b-4f37-ab23-b7de6c4b2006 tempest-FlavorsAccessNegativeTestJSON-2101776700 tempest-FlavorsAccessNegativeTestJSON-2101776700-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "eb148ccc217e4bb0a2cb2c0fdd09c8d3"}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:55:35.501872 n-d-850468-14 devstack@n-api.service[122633]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:55:35.501872 n-d-850468-14 devstack@n-api.service[122633]: warnings.warn(msg) Aug 10 22:55:36.447453 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-ed50ebe4-716b-4f37-ab23-b7de6c4b2006 tempest-FlavorsAccessNegativeTestJSON-2101776700 tempest-FlavorsAccessNegativeTestJSON-2101776700-project-admin] HTTP exception thrown: Flavor access not found for 33 / eb148ccc217e4bb0a2cb2c0fdd09c8d3 combination. Aug 10 22:55:36.455538 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-ed50ebe4-716b-4f37-ab23-b7de6c4b2006 tempest-FlavorsAccessNegativeTestJSON-2101776700 tempest-FlavorsAccessNegativeTestJSON-2101776700-project-admin] Request method failure captured: Aug 10 22:55:36.455538 n-d-850468-14 devstack@n-api.service[122633]: request: POST /compute/v2.1/flavors/654787758/action HTTP/1.1 Aug 10 22:55:36.455538 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 22:55:36.455538 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 22:55:36.455538 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 22:55:36.455538 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 70 Aug 10 22:55:36.455538 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 22:55:36.455538 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 22:55:36.455538 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 22:55:36.455538 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 22:55:36.455538 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9DdfYHiKPXWYwfuSwEDCxdduSYcLHsYg1OdYX0ztjhmojps9A0n22G-5hzn7aJUfNIo_u7nuKJQLCnQeZ4rWzCUyY9XEIjOy6zG7V2j9LtKGZzx2m6NC-KM-C4ol2lPbi20VKktc6oeCRPw5jkHAU6LHWgKX2mq-hZ92c4bRezIVLFE Aug 10 22:55:36.455538 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 22:55:36.455538 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 22:55:36.455538 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 22:55:36.455538 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 22:55:36.455538 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 22:55:36.455538 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 22:55:36.455538 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 0d047d750da4464db980821faf029f59 Aug 10 22:55:36.455538 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-2101776700 Aug 10 22:55:36.455538 n-d-850468-14 devstack@n-api.service[122633]: X-Role: admin,member,reader Aug 10 22:55:36.455538 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: admin,member,reader Aug 10 22:55:36.456830 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0d047d750da4464db980821faf029f59"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0d047d750da4464db980821faf029f59"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/0d047d750da4464db980821faf029f59"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_0d047d750da4464db980821faf029f59", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 22:55:36.456830 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-2101776700 Aug 10 22:55:36.456830 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 0d047d750da4464db980821faf029f59 Aug 10 22:55:36.456830 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-2101776700 Aug 10 22:55:36.456830 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-FlavorsAccessNegativeTestJSON-2101776700-project-admin Aug 10 22:55:36.456830 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 22:55:36.456830 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 22:55:36.456830 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 2bd3c52aca524d20aa8797a3c27f4c08 Aug 10 22:55:36.456830 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-2101776700-project-admin Aug 10 22:55:36.456830 n-d-850468-14 devstack@n-api.service[122633]: Aug 10 22:55:36.456830 n-d-850468-14 devstack@n-api.service[122633]: {"removeTenantAccess": {"tenant": "eb148ccc217e4bb0a2cb2c0fdd09c8d3"}} Aug 10 22:55:36.456830 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 22:55:36.457492 n-d-850468-14 devstack@n-api.service[122633]: exception: Flavor access not found for 33 / eb148ccc217e4bb0a2cb2c0fdd09c8d3 combination. Aug 10 22:55:36.457492 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': '654787758', 'body': {'removeTenantAccess': {'tenant': 'eb148ccc217e4bb0a2cb2c0fdd09c8d3'}}} Aug 10 22:55:36.457492 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 22:55:36.457492 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:55:36.457492 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Aug 10 22:55:36.457492 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Aug 10 22:55:36.457492 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 10 22:55:36.457492 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 10 22:55:36.457492 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Aug 10 22:55:36.457492 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Aug 10 22:55:36.457492 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Aug 10 22:55:36.457492 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Aug 10 22:55:36.457492 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Aug 10 22:55:36.457492 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Aug 10 22:55:36.457492 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 10 22:55:36.457492 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 10 22:55:36.457492 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Aug 10 22:55:36.457492 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Aug 10 22:55:36.458591 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 33 / eb148ccc217e4bb0a2cb2c0fdd09c8d3 combination. Aug 10 22:55:36.458591 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:55:36.458591 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:55:36.458591 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:55:36.458591 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:55:36.458591 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:55:36.458591 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:55:36.458591 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 22:55:36.458591 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 22:55:36.458591 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 22:55:36.458591 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 22:55:36.458591 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 22:55:36.458591 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 22:55:36.458591 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Aug 10 22:55:36.458591 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 10 22:55:36.458591 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 33 / eb148ccc217e4bb0a2cb2c0fdd09c8d3 combination. Aug 10 22:55:36.458591 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:55:36.458591 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:55:36.458591 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:55:36.458591 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:55:36.459654 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:55:36.459654 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:55:36.459654 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 22:55:36.459654 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 22:55:36.459654 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 33 / eb148ccc217e4bb0a2cb2c0fdd09c8d3 combination. Aug 10 22:55:36.459654 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:55:36.461266 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-ed50ebe4-716b-4f37-ab23-b7de6c4b2006 tempest-FlavorsAccessNegativeTestJSON-2101776700 tempest-FlavorsAccessNegativeTestJSON-2101776700-project-admin] Returning 404 to user: Flavor access not found for 33 / eb148ccc217e4bb0a2cb2c0fdd09c8d3 combination. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 22:55:36.463856 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-ed50ebe4-716b-4f37-ab23-b7de6c4b2006 tempest-FlavorsAccessNegativeTestJSON-2101776700 tempest-FlavorsAccessNegativeTestJSON-2101776700-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors/654787758/action" status: 404 len: 124 microversion: 2.1 time: 0.968482 Aug 10 22:55:36.467178 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 44/101] 10.222.0.58 () {60 vars in 1197 bytes} [Wed Aug 10 22:55:35 2022] POST /compute/v2.1/flavors/654787758/action => generated 124 bytes in 973 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 22:55:36.481408 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-b516bfc0-7e86-418b-a1ad-fb1bb9536a31 tempest-FlavorsAccessNegativeTestJSON-2101776700 tempest-FlavorsAccessNegativeTestJSON-2101776700-project-admin] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:36.535694 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-b516bfc0-7e86-418b-a1ad-fb1bb9536a31 tempest-FlavorsAccessNegativeTestJSON-2101776700 tempest-FlavorsAccessNegativeTestJSON-2101776700-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/654787758" status: 202 len: 0 microversion: 2.1 time: 0.063956 Aug 10 22:55:36.537021 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 45/102] 10.222.0.58 () {58 vars in 1158 bytes} [Wed Aug 10 22:55:36 2022] DELETE /compute/v2.1/flavors/654787758 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 22:55:36.546264 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-7ea635ad-acc6-4670-a112-9905a9cf9b72 tempest-FlavorsAccessNegativeTestJSON-2101776700 tempest-FlavorsAccessNegativeTestJSON-2101776700-project-admin] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:36.597522 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-7ea635ad-acc6-4670-a112-9905a9cf9b72 tempest-FlavorsAccessNegativeTestJSON-2101776700 tempest-FlavorsAccessNegativeTestJSON-2101776700-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.049911 Aug 10 22:55:36.612522 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 46/103] 10.222.0.58 () {58 vars in 1146 bytes} [Wed Aug 10 22:55:36 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:55:37.251962 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-2b7219ac-2668-4af4-a5c6-aa3f082845db tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd644627ab14e55803c1d5981b9859a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a37b95a10245b796d26c1b35036827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:55:37.277517 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-2b7219ac-2668-4af4-a5c6-aa3f082845db tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] 10.222.0.58 "GET /compute/v2.1/servers/155e0037-0bdb-4a93-af44-de6903bc2891" status: 200 len: 1243 microversion: 2.1 time: 1.915468 Aug 10 22:55:37.287281 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 58/104] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:55:35 2022] GET /compute/v2.1/servers/155e0037-0bdb-4a93-af44-de6903bc2891 => generated 1243 bytes in 1920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:55:38.297893 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=2 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:55:38.302408 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-220a09f8-3cfa-4ee1-af21-059033971ec2 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:38.303625 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-220a09f8-3cfa-4ee1-af21-059033971ec2 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] [instance: 155e0037-0bdb-4a93-af44-de6903bc2891] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:55:38.316154 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-220a09f8-3cfa-4ee1-af21-059033971ec2 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:38.316652 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-220a09f8-3cfa-4ee1-af21-059033971ec2 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:38.321595 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-220a09f8-3cfa-4ee1-af21-059033971ec2 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:38.322600 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-220a09f8-3cfa-4ee1-af21-059033971ec2 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:38.329752 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-220a09f8-3cfa-4ee1-af21-059033971ec2 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:38.330688 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-220a09f8-3cfa-4ee1-af21-059033971ec2 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:38.603815 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-212cd981-6d33-4c36-9e00-6437a0054ae3 tempest-FlavorsV261TestJSON-946941766 tempest-FlavorsV261TestJSON-946941766-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-587157300", "id": 932788223, "os-flavor-access:is_public": "True"}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:55:38.646115 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-212cd981-6d33-4c36-9e00-6437a0054ae3 tempest-FlavorsV261TestJSON-946941766 tempest-FlavorsV261TestJSON-946941766-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 464 microversion: 2.61 time: 0.848259 Aug 10 22:55:38.657437 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 47/105] 10.222.0.58 () {62 vars in 1188 bytes} [Wed Aug 10 22:55:37 2022] POST /compute/v2.1/flavors => generated 464 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 22:55:38.672210 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-220a09f8-3cfa-4ee1-af21-059033971ec2 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd644627ab14e55803c1d5981b9859a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a37b95a10245b796d26c1b35036827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:55:38.689758 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-220a09f8-3cfa-4ee1-af21-059033971ec2 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] 10.222.0.58 "GET /compute/v2.1/servers/155e0037-0bdb-4a93-af44-de6903bc2891" status: 200 len: 1297 microversion: 2.1 time: 0.392776 Aug 10 22:55:38.695180 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 59/106] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:55:38 2022] GET /compute/v2.1/servers/155e0037-0bdb-4a93-af44-de6903bc2891 => generated 1297 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:55:39.883583 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-f59426a4-13d9-4a28-b68d-37a6e5c94c9b tempest-FlavorsV261TestJSON-1068319358 tempest-FlavorsV261TestJSON-1068319358-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:39.912121 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-f59426a4-13d9-4a28-b68d-37a6e5c94c9b tempest-FlavorsV261TestJSON-1068319358 tempest-FlavorsV261TestJSON-1068319358-project] 10.222.0.58 "GET /compute/v2.1/flavors/932788223" status: 200 len: 464 microversion: 2.61 time: 1.250597 Aug 10 22:55:39.932126 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 48/107] 10.222.0.58 () {60 vars in 1196 bytes} [Wed Aug 10 22:55:38 2022] GET /compute/v2.1/flavors/932788223 => generated 464 bytes in 1271 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 22:55:39.941982 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-94c66bb3-bf0a-491d-b268-e184cf300180 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:39.942658 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-94c66bb3-bf0a-491d-b268-e184cf300180 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] [instance: 155e0037-0bdb-4a93-af44-de6903bc2891] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:55:39.984221 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-94c66bb3-bf0a-491d-b268-e184cf300180 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:39.987779 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-94c66bb3-bf0a-491d-b268-e184cf300180 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:39.993432 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-94c66bb3-bf0a-491d-b268-e184cf300180 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:39.998600 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-94c66bb3-bf0a-491d-b268-e184cf300180 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:39.999226 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-94c66bb3-bf0a-491d-b268-e184cf300180 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:40.000838 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-94c66bb3-bf0a-491d-b268-e184cf300180 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:40.380409 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-94c66bb3-bf0a-491d-b268-e184cf300180 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd644627ab14e55803c1d5981b9859a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a37b95a10245b796d26c1b35036827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:55:40.408602 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-94c66bb3-bf0a-491d-b268-e184cf300180 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] 10.222.0.58 "GET /compute/v2.1/servers/155e0037-0bdb-4a93-af44-de6903bc2891" status: 200 len: 1297 microversion: 2.1 time: 0.472600 Aug 10 22:55:40.424609 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 49/108] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:55:39 2022] GET /compute/v2.1/servers/155e0037-0bdb-4a93-af44-de6903bc2891 => generated 1297 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:55:40.450848 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-6f4b7d42-a21d-4ff1-92c8-de0e82107353 tempest-FlavorsV261TestJSON-946941766 tempest-FlavorsV261TestJSON-946941766-project-admin] Action: 'update', calling method: .version_select at 0x7f84800c2dc0>, body: {"flavor": {"description": "new"}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:55:40.503928 n-d-850468-14 devstack@n-api.service[122633]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:55:40.503928 n-d-850468-14 devstack@n-api.service[122633]: warnings.warn(msg) Aug 10 22:55:40.607303 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-6f4b7d42-a21d-4ff1-92c8-de0e82107353 tempest-FlavorsV261TestJSON-946941766 tempest-FlavorsV261TestJSON-946941766-project-admin] 10.222.0.58 "PUT /compute/v2.1/flavors/932788223" status: 200 len: 465 microversion: 2.61 time: 0.179094 Aug 10 22:55:40.616372 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 50/109] 10.222.0.58 () {62 vars in 1216 bytes} [Wed Aug 10 22:55:40 2022] PUT /compute/v2.1/flavors/932788223 => generated 465 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 22:55:40.632189 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-20806cce-fa08-42ff-adb0-82d94ff587a9 tempest-FlavorsV261TestJSON-1068319358 tempest-FlavorsV261TestJSON-1068319358-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:40.660487 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-b67ceeea-2cce-48fe-ac16-f1b7c1e990a0 tempest-HypervisorAdminV253TestBase-767045737 tempest-HypervisorAdminV253TestBase-767045737-project-admin] Calling method '.version_select at 0x7f8485845d30>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:40.664141 n-d-850468-14 devstack@n-api.service[122632]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:55:40.664141 n-d-850468-14 devstack@n-api.service[122632]: warnings.warn(msg) Aug 10 22:55:40.665374 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b67ceeea-2cce-48fe-ac16-f1b7c1e990a0 tempest-HypervisorAdminV253TestBase-767045737 tempest-HypervisorAdminV253TestBase-767045737-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:40.665870 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b67ceeea-2cce-48fe-ac16-f1b7c1e990a0 tempest-HypervisorAdminV253TestBase-767045737 tempest-HypervisorAdminV253TestBase-767045737-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:40.666584 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b67ceeea-2cce-48fe-ac16-f1b7c1e990a0 tempest-HypervisorAdminV253TestBase-767045737 tempest-HypervisorAdminV253TestBase-767045737-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:40.718272 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-20806cce-fa08-42ff-adb0-82d94ff587a9 tempest-FlavorsV261TestJSON-1068319358 tempest-FlavorsV261TestJSON-1068319358-project] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 6246 microversion: 2.61 time: 0.100064 Aug 10 22:55:40.734875 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 51/110] 10.222.0.58 () {60 vars in 1187 bytes} [Wed Aug 10 22:55:40 2022] GET /compute/v2.1/flavors/detail => generated 6246 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:55:40.742059 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-855571e1-180a-4eaa-8b4b-43fb770fdb80 tempest-FlavorsV261TestJSON-1068319358 tempest-FlavorsV261TestJSON-1068319358-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:40.753317 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b67ceeea-2cce-48fe-ac16-f1b7c1e990a0 tempest-HypervisorAdminV253TestBase-767045737 tempest-HypervisorAdminV253TestBase-767045737-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:40.755637 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b67ceeea-2cce-48fe-ac16-f1b7c1e990a0 tempest-HypervisorAdminV253TestBase-767045737 tempest-HypervisorAdminV253TestBase-767045737-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:40.758725 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b67ceeea-2cce-48fe-ac16-f1b7c1e990a0 tempest-HypervisorAdminV253TestBase-767045737 tempest-HypervisorAdminV253TestBase-767045737-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:40.801840 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-855571e1-180a-4eaa-8b4b-43fb770fdb80 tempest-FlavorsV261TestJSON-1068319358 tempest-FlavorsV261TestJSON-1068319358-project] 10.222.0.58 "GET /compute/v2.1/flavors" status: 200 len: 3153 microversion: 2.61 time: 0.065438 Aug 10 22:55:40.805566 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 52/111] 10.222.0.58 () {60 vars in 1166 bytes} [Wed Aug 10 22:55:40 2022] GET /compute/v2.1/flavors => generated 3153 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:55:40.825244 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-89ba883d-8626-4d96-bf41-676aec9a50c7 tempest-FlavorsV261TestJSON-946941766 tempest-FlavorsV261TestJSON-946941766-project-admin] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:40.826049 n-d-850468-14 devstack@n-api.service[122633]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:55:40.826049 n-d-850468-14 devstack@n-api.service[122633]: warnings.warn(msg) Aug 10 22:55:40.876130 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-89ba883d-8626-4d96-bf41-676aec9a50c7 tempest-FlavorsV261TestJSON-946941766 tempest-FlavorsV261TestJSON-946941766-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/932788223" status: 202 len: 0 microversion: 2.61 time: 0.054305 Aug 10 22:55:40.882749 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 53/112] 10.222.0.58 () {60 vars in 1199 bytes} [Wed Aug 10 22:55:40 2022] DELETE /compute/v2.1/flavors/932788223 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 10 22:55:40.899144 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-4d7c2f1c-76f5-4cbc-a34f-741dc1f734d9 tempest-FlavorsV261TestJSON-946941766 tempest-FlavorsV261TestJSON-946941766-project-admin] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:40.976807 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b67ceeea-2cce-48fe-ac16-f1b7c1e990a0 tempest-HypervisorAdminV253TestBase-767045737 tempest-HypervisorAdminV253TestBase-767045737-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:40.979717 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b67ceeea-2cce-48fe-ac16-f1b7c1e990a0 tempest-HypervisorAdminV253TestBase-767045737 tempest-HypervisorAdminV253TestBase-767045737-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:40.985676 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b67ceeea-2cce-48fe-ac16-f1b7c1e990a0 tempest-HypervisorAdminV253TestBase-767045737 tempest-HypervisorAdminV253TestBase-767045737-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:40.991812 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-4d7c2f1c-76f5-4cbc-a34f-741dc1f734d9 tempest-FlavorsV261TestJSON-946941766 tempest-FlavorsV261TestJSON-946941766-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 5791 microversion: 2.61 time: 0.090060 Aug 10 22:55:40.992897 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 54/113] 10.222.0.58 () {60 vars in 1187 bytes} [Wed Aug 10 22:55:40 2022] GET /compute/v2.1/flavors/detail => generated 5791 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:55:41.050068 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b67ceeea-2cce-48fe-ac16-f1b7c1e990a0 tempest-HypervisorAdminV253TestBase-767045737 tempest-HypervisorAdminV253TestBase-767045737-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:41.058748 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b67ceeea-2cce-48fe-ac16-f1b7c1e990a0 tempest-HypervisorAdminV253TestBase-767045737 tempest-HypervisorAdminV253TestBase-767045737-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:41.064037 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b67ceeea-2cce-48fe-ac16-f1b7c1e990a0 tempest-HypervisorAdminV253TestBase-767045737 tempest-HypervisorAdminV253TestBase-767045737-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:41.145119 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b67ceeea-2cce-48fe-ac16-f1b7c1e990a0 tempest-HypervisorAdminV253TestBase-767045737 tempest-HypervisorAdminV253TestBase-767045737-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:41.149230 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b67ceeea-2cce-48fe-ac16-f1b7c1e990a0 tempest-HypervisorAdminV253TestBase-767045737 tempest-HypervisorAdminV253TestBase-767045737-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:41.151814 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b67ceeea-2cce-48fe-ac16-f1b7c1e990a0 tempest-HypervisorAdminV253TestBase-767045737 tempest-HypervisorAdminV253TestBase-767045737-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:41.183119 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-b67ceeea-2cce-48fe-ac16-f1b7c1e990a0 tempest-HypervisorAdminV253TestBase-767045737 tempest-HypervisorAdminV253TestBase-767045737-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 1668 microversion: 2.53 time: 1.902542 Aug 10 22:55:41.188319 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 60/114] 10.222.0.58 () {60 vars in 1243 bytes} [Wed Aug 10 22:55:39 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 1668 bytes in 1908 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:55:41.208361 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-885fd2d9-db4e-4656-a507-84164b8c9805 tempest-HypervisorAdminV253TestBase-767045737 tempest-HypervisorAdminV253TestBase-767045737-project-admin] Calling method '.version_select at 0x7f847ddd5310>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:41.217124 n-d-850468-14 devstack@n-api.service[122633]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:55:41.217124 n-d-850468-14 devstack@n-api.service[122633]: warnings.warn(msg) Aug 10 22:55:41.219904 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-885fd2d9-db4e-4656-a507-84164b8c9805 tempest-HypervisorAdminV253TestBase-767045737 tempest-HypervisorAdminV253TestBase-767045737-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:41.224176 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-885fd2d9-db4e-4656-a507-84164b8c9805 tempest-HypervisorAdminV253TestBase-767045737 tempest-HypervisorAdminV253TestBase-767045737-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:41.227213 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-885fd2d9-db4e-4656-a507-84164b8c9805 tempest-HypervisorAdminV253TestBase-767045737 tempest-HypervisorAdminV253TestBase-767045737-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:41.300095 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-885fd2d9-db4e-4656-a507-84164b8c9805 tempest-HypervisorAdminV253TestBase-767045737 tempest-HypervisorAdminV253TestBase-767045737-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:41.306666 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-885fd2d9-db4e-4656-a507-84164b8c9805 tempest-HypervisorAdminV253TestBase-767045737 tempest-HypervisorAdminV253TestBase-767045737-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:41.311144 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-885fd2d9-db4e-4656-a507-84164b8c9805 tempest-HypervisorAdminV253TestBase-767045737 tempest-HypervisorAdminV253TestBase-767045737-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:41.424352 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-885fd2d9-db4e-4656-a507-84164b8c9805 tempest-HypervisorAdminV253TestBase-767045737 tempest-HypervisorAdminV253TestBase-767045737-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:41.424352 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-885fd2d9-db4e-4656-a507-84164b8c9805 tempest-HypervisorAdminV253TestBase-767045737 tempest-HypervisorAdminV253TestBase-767045737-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:41.424352 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-885fd2d9-db4e-4656-a507-84164b8c9805 tempest-HypervisorAdminV253TestBase-767045737 tempest-HypervisorAdminV253TestBase-767045737-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:41.431527 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-0b46d7aa-bc9b-42df-af09-72de19cd6895 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:41.432138 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-0b46d7aa-bc9b-42df-af09-72de19cd6895 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] [instance: 155e0037-0bdb-4a93-af44-de6903bc2891] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:55:41.439485 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0b46d7aa-bc9b-42df-af09-72de19cd6895 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:41.446859 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0b46d7aa-bc9b-42df-af09-72de19cd6895 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:41.449354 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0b46d7aa-bc9b-42df-af09-72de19cd6895 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:41.451337 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0b46d7aa-bc9b-42df-af09-72de19cd6895 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:41.453219 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0b46d7aa-bc9b-42df-af09-72de19cd6895 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:41.455621 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0b46d7aa-bc9b-42df-af09-72de19cd6895 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:41.482070 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-885fd2d9-db4e-4656-a507-84164b8c9805 tempest-HypervisorAdminV253TestBase-767045737 tempest-HypervisorAdminV253TestBase-767045737-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:41.482550 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-885fd2d9-db4e-4656-a507-84164b8c9805 tempest-HypervisorAdminV253TestBase-767045737 tempest-HypervisorAdminV253TestBase-767045737-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:41.491932 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-885fd2d9-db4e-4656-a507-84164b8c9805 tempest-HypervisorAdminV253TestBase-767045737 tempest-HypervisorAdminV253TestBase-767045737-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:41.535093 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-885fd2d9-db4e-4656-a507-84164b8c9805 tempest-HypervisorAdminV253TestBase-767045737 tempest-HypervisorAdminV253TestBase-767045737-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:41.536017 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-885fd2d9-db4e-4656-a507-84164b8c9805 tempest-HypervisorAdminV253TestBase-767045737 tempest-HypervisorAdminV253TestBase-767045737-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:41.536715 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-885fd2d9-db4e-4656-a507-84164b8c9805 tempest-HypervisorAdminV253TestBase-767045737 tempest-HypervisorAdminV253TestBase-767045737-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:41.558499 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-885fd2d9-db4e-4656-a507-84164b8c9805 tempest-HypervisorAdminV253TestBase-767045737 tempest-HypervisorAdminV253TestBase-767045737-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 359 microversion: 2.53 time: 0.355482 Aug 10 22:55:41.566873 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 55/115] 10.222.0.58 () {60 vars in 1222 bytes} [Wed Aug 10 22:55:41 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 359 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 22:55:41.577552 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-3dc0c349-9e80-44d4-85fe-4c52e017804f tempest-HypervisorAdminV253TestBase-767045737 tempest-HypervisorAdminV253TestBase-767045737-project-admin] Calling method '.version_select at 0x7f847de23040>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:41.589352 n-d-850468-14 devstack@n-api.service[122633]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:55:41.589352 n-d-850468-14 devstack@n-api.service[122633]: warnings.warn(msg) Aug 10 22:55:41.590749 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3dc0c349-9e80-44d4-85fe-4c52e017804f tempest-HypervisorAdminV253TestBase-767045737 tempest-HypervisorAdminV253TestBase-767045737-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:41.591258 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3dc0c349-9e80-44d4-85fe-4c52e017804f tempest-HypervisorAdminV253TestBase-767045737 tempest-HypervisorAdminV253TestBase-767045737-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:41.591683 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3dc0c349-9e80-44d4-85fe-4c52e017804f tempest-HypervisorAdminV253TestBase-767045737 tempest-HypervisorAdminV253TestBase-767045737-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:41.676869 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3dc0c349-9e80-44d4-85fe-4c52e017804f tempest-HypervisorAdminV253TestBase-767045737 tempest-HypervisorAdminV253TestBase-767045737-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:41.677355 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3dc0c349-9e80-44d4-85fe-4c52e017804f tempest-HypervisorAdminV253TestBase-767045737 tempest-HypervisorAdminV253TestBase-767045737-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:41.677782 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3dc0c349-9e80-44d4-85fe-4c52e017804f tempest-HypervisorAdminV253TestBase-767045737 tempest-HypervisorAdminV253TestBase-767045737-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:41.707603 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-3dc0c349-9e80-44d4-85fe-4c52e017804f tempest-HypervisorAdminV253TestBase-767045737 tempest-HypervisorAdminV253TestBase-767045737-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors/0bfe6936-8981-4ceb-9bba-df505d0dcf67" status: 200 len: 794 microversion: 2.53 time: 0.134938 Aug 10 22:55:41.709466 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 56/116] 10.222.0.58 () {60 vars in 1298 bytes} [Wed Aug 10 22:55:41 2022] GET /compute/v2.1/os-hypervisors/0bfe6936-8981-4ceb-9bba-df505d0dcf67 => generated 794 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 22:55:42.311649 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-0b46d7aa-bc9b-42df-af09-72de19cd6895 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd644627ab14e55803c1d5981b9859a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a37b95a10245b796d26c1b35036827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:55:42.325657 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-0b46d7aa-bc9b-42df-af09-72de19cd6895 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] 10.222.0.58 "GET /compute/v2.1/servers/155e0037-0bdb-4a93-af44-de6903bc2891" status: 200 len: 1339 microversion: 2.1 time: 0.899860 Aug 10 22:55:42.328583 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 61/117] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:55:41 2022] GET /compute/v2.1/servers/155e0037-0bdb-4a93-af44-de6903bc2891 => generated 1339 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:55:43.349119 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-a1378eaf-6367-4f18-9f3e-e029ea89de3e tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:43.351293 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-a1378eaf-6367-4f18-9f3e-e029ea89de3e tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] [instance: 155e0037-0bdb-4a93-af44-de6903bc2891] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:55:43.364876 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a1378eaf-6367-4f18-9f3e-e029ea89de3e tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:43.370635 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a1378eaf-6367-4f18-9f3e-e029ea89de3e tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:43.372058 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a1378eaf-6367-4f18-9f3e-e029ea89de3e tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:43.375093 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a1378eaf-6367-4f18-9f3e-e029ea89de3e tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:43.376067 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a1378eaf-6367-4f18-9f3e-e029ea89de3e tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:43.378208 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a1378eaf-6367-4f18-9f3e-e029ea89de3e tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:43.853155 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-a1378eaf-6367-4f18-9f3e-e029ea89de3e tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd644627ab14e55803c1d5981b9859a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a37b95a10245b796d26c1b35036827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:55:43.874683 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-a1378eaf-6367-4f18-9f3e-e029ea89de3e tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] 10.222.0.58 "GET /compute/v2.1/servers/155e0037-0bdb-4a93-af44-de6903bc2891" status: 200 len: 1339 microversion: 2.1 time: 0.521066 Aug 10 22:55:43.875592 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 57/118] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:55:43 2022] GET /compute/v2.1/servers/155e0037-0bdb-4a93-af44-de6903bc2891 => generated 1339 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:55:44.590227 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=6 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:55:44.592324 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=8 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:55:44.895121 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-26d286bb-1f31-48ce-9e27-1df7baac67cd tempest-HostsAdminNegativeTestJSON-644990204 tempest-HostsAdminNegativeTestJSON-644990204-project-admin] Calling method '.version_select at 0x7f847e02bc10>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:44.901085 n-d-850468-14 devstack@n-api.service[122632]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:55:44.901085 n-d-850468-14 devstack@n-api.service[122632]: warnings.warn(msg) Aug 10 22:55:44.904615 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-26d286bb-1f31-48ce-9e27-1df7baac67cd tempest-HostsAdminNegativeTestJSON-644990204 tempest-HostsAdminNegativeTestJSON-644990204-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:44.906688 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-26d286bb-1f31-48ce-9e27-1df7baac67cd tempest-HostsAdminNegativeTestJSON-644990204 tempest-HostsAdminNegativeTestJSON-644990204-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:44.908113 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-26d286bb-1f31-48ce-9e27-1df7baac67cd tempest-HostsAdminNegativeTestJSON-644990204 tempest-HostsAdminNegativeTestJSON-644990204-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:44.911814 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-26d286bb-1f31-48ce-9e27-1df7baac67cd tempest-HostsAdminNegativeTestJSON-644990204 tempest-HostsAdminNegativeTestJSON-644990204-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:44.912581 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-26d286bb-1f31-48ce-9e27-1df7baac67cd tempest-HostsAdminNegativeTestJSON-644990204 tempest-HostsAdminNegativeTestJSON-644990204-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:44.915544 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-26d286bb-1f31-48ce-9e27-1df7baac67cd tempest-HostsAdminNegativeTestJSON-644990204 tempest-HostsAdminNegativeTestJSON-644990204-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:45.035718 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-26d286bb-1f31-48ce-9e27-1df7baac67cd tempest-HostsAdminNegativeTestJSON-644990204 tempest-HostsAdminNegativeTestJSON-644990204-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hosts" status: 200 len: 403 microversion: 2.1 time: 0.718192 Aug 10 22:55:45.038965 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 62/119] 10.222.0.58 () {58 vars in 1128 bytes} [Wed Aug 10 22:55:44 2022] GET /compute/v2.1/os-hosts => generated 403 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:55:45.058618 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-db9ff1ae-2f41-49ec-98f2-e1abdb1c76a4 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:45.061468 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-db9ff1ae-2f41-49ec-98f2-e1abdb1c76a4 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] [instance: 155e0037-0bdb-4a93-af44-de6903bc2891] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:55:45.086747 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-db9ff1ae-2f41-49ec-98f2-e1abdb1c76a4 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:45.088231 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-db9ff1ae-2f41-49ec-98f2-e1abdb1c76a4 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:45.090046 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-db9ff1ae-2f41-49ec-98f2-e1abdb1c76a4 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:45.091036 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-db9ff1ae-2f41-49ec-98f2-e1abdb1c76a4 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:45.093543 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-db9ff1ae-2f41-49ec-98f2-e1abdb1c76a4 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:45.094795 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-db9ff1ae-2f41-49ec-98f2-e1abdb1c76a4 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:45.304390 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-91135f90-e592-49c8-b69f-8d6306769d0d tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1699192083", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452"}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:55:45.422562 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.network.neutron [None req-91135f90-e592-49c8-b69f-8d6306769d0d tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] validate_networks() for None {{(pid=122633) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 22:55:45.863981 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-db9ff1ae-2f41-49ec-98f2-e1abdb1c76a4 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd644627ab14e55803c1d5981b9859a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a37b95a10245b796d26c1b35036827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:55:45.896309 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-db9ff1ae-2f41-49ec-98f2-e1abdb1c76a4 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] 10.222.0.58 "GET /compute/v2.1/servers/155e0037-0bdb-4a93-af44-de6903bc2891" status: 200 len: 1339 microversion: 2.1 time: 0.855161 Aug 10 22:55:45.896993 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 63/120] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:55:45 2022] GET /compute/v2.1/servers/155e0037-0bdb-4a93-af44-de6903bc2891 => generated 1339 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:55:46.058494 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-91135f90-e592-49c8-b69f-8d6306769d0d tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Flavor limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 22:55:46.059427 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-91135f90-e592-49c8-b69f-8d6306769d0d tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Image limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 22:55:46.060045 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-91135f90-e592-49c8-b69f-8d6306769d0d tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Flavor pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 22:55:46.060516 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-91135f90-e592-49c8-b69f-8d6306769d0d tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Image pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 22:55:46.060875 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-91135f90-e592-49c8-b69f-8d6306769d0d tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 22:55:46.082824 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-91135f90-e592-49c8-b69f-8d6306769d0d tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:46.092642 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-91135f90-e592-49c8-b69f-8d6306769d0d tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:46.093432 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-91135f90-e592-49c8-b69f-8d6306769d0d tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:46.094324 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-91135f90-e592-49c8-b69f-8d6306769d0d tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:46.094917 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-91135f90-e592-49c8-b69f-8d6306769d0d tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:46.095556 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-91135f90-e592-49c8-b69f-8d6306769d0d tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:46.137449 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-91135f90-e592-49c8-b69f-8d6306769d0d tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Getting quotas for project 434532ba922f406d8d8c197d3a57ffc2. Resources: {'instances', 'cores', 'ram'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 22:55:46.149956 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-91135f90-e592-49c8-b69f-8d6306769d0d tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Getting quotas for user 64648d3c6f5c423e83ff023e7bf6550a and project 434532ba922f406d8d8c197d3a57ffc2. Resources: {'instances', 'cores', 'ram'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 22:55:46.172418 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-91135f90-e592-49c8-b69f-8d6306769d0d tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Going to run 1 instances... {{(pid=122633) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 22:55:46.174828 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-91135f90-e592-49c8-b69f-8d6306769d0d tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] [instance: 37093f4d-0663-4b69-a48f-5fd757acd9c0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78ad8905-f66f-4733-8be9-2b260f1fabed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122633) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 22:55:46.268279 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-91135f90-e592-49c8-b69f-8d6306769d0d tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.679522 Aug 10 22:55:46.269002 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 58/121] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 22:55:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 1684 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 10 22:55:46.281316 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c9826c7b-26c2-48a0-9b5d-a0b5a189f633 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:46.284294 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-c9826c7b-26c2-48a0-9b5d-a0b5a189f633 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] [instance: 37093f4d-0663-4b69-a48f-5fd757acd9c0] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:55:46.590766 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-c9826c7b-26c2-48a0-9b5d-a0b5a189f633 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64648d3c6f5c423e83ff023e7bf6550a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434532ba922f406d8d8c197d3a57ffc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:55:46.601478 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-c9826c7b-26c2-48a0-9b5d-a0b5a189f633 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] 10.222.0.58 "GET /compute/v2.1/servers/37093f4d-0663-4b69-a48f-5fd757acd9c0" status: 200 len: 1220 microversion: 2.1 time: 0.324199 Aug 10 22:55:46.618826 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 59/122] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:55:46 2022] GET /compute/v2.1/servers/37093f4d-0663-4b69-a48f-5fd757acd9c0 => generated 1220 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:55:46.765916 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-337d2df8-d4d3-4efa-bc85-fb1938f48c37 tempest-HostsAdminNegativeTestJSON-536073032 tempest-HostsAdminNegativeTestJSON-536073032-project] Calling method '.version_select at 0x7f847e013ca0>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:46.769029 n-d-850468-14 devstack@n-api.service[122632]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:55:46.769029 n-d-850468-14 devstack@n-api.service[122632]: warnings.warn(msg) Aug 10 22:55:46.773328 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-337d2df8-d4d3-4efa-bc85-fb1938f48c37 tempest-HostsAdminNegativeTestJSON-536073032 tempest-HostsAdminNegativeTestJSON-536073032-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': '08bdcbf86eeb481a9852cfcdb8904f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41448baa694d402a859e1fca25ae9fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:55:46.775653 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-337d2df8-d4d3-4efa-bc85-fb1938f48c37 tempest-HostsAdminNegativeTestJSON-536073032 tempest-HostsAdminNegativeTestJSON-536073032-project] Request method failure captured: Aug 10 22:55:46.775653 n-d-850468-14 devstack@n-api.service[122632]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Aug 10 22:55:46.775653 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 22:55:46.775653 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 22:55:46.775653 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 22:55:46.775653 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 22:55:46.775653 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 22:55:46.775653 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 22:55:46.775653 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 22:55:46.775653 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 22:55:46.775653 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9DdqsN1jYjN7UDcf1AG9d86o_tc1NbbTzb-IKOLPsanIWV52yu59eTnUduq8PPHFvhlQ6aXU6Z-Y12hDH3BQhSfM543EGFiFpi91HXqYOQtAZuW-2Powm1ZoHOU7GUXQCj-QBToh64y88KJPJ9ZVDgUm5NDHiZCBXz_BYCYaG1DDWNw Aug 10 22:55:46.775653 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 22:55:46.775653 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 22:55:46.775653 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 22:55:46.775653 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 22:55:46.775653 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 22:55:46.775653 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 22:55:46.775653 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 41448baa694d402a859e1fca25ae9fc6 Aug 10 22:55:46.775653 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-536073032 Aug 10 22:55:46.775653 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 22:55:46.775653 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 22:55:46.777459 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/41448baa694d402a859e1fca25ae9fc6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/41448baa694d402a859e1fca25ae9fc6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/41448baa694d402a859e1fca25ae9fc6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_41448baa694d402a859e1fca25ae9fc6", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 22:55:46.777459 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-HostsAdminNegativeTestJSON-536073032 Aug 10 22:55:46.777459 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 41448baa694d402a859e1fca25ae9fc6 Aug 10 22:55:46.777459 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-536073032 Aug 10 22:55:46.777459 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-HostsAdminNegativeTestJSON-536073032-project Aug 10 22:55:46.777459 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 22:55:46.777459 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 22:55:46.777459 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: 08bdcbf86eeb481a9852cfcdb8904f9f Aug 10 22:55:46.777459 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-HostsAdminNegativeTestJSON-536073032-project Aug 10 22:55:46.777459 n-d-850468-14 devstack@n-api.service[122632]: method: Aug 10 22:55:46.777459 n-d-850468-14 devstack@n-api.service[122632]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Aug 10 22:55:46.777459 n-d-850468-14 devstack@n-api.service[122632]: action_args: {} Aug 10 22:55:46.777459 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 22:55:46.778774 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:55:46.778774 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:55:46.778774 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:55:46.778774 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 22:55:46.778774 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 22:55:46.778774 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 22:55:46.778774 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 22:55:46.778774 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 10 22:55:46.778774 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 22:55:46.778774 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 22:55:46.778774 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 22:55:46.778774 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Aug 10 22:55:46.778774 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Aug 10 22:55:46.778774 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 10 22:55:46.778774 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 10 22:55:46.778774 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 10 22:55:46.778774 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 10 22:55:46.778774 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 10 22:55:46.778774 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 10 22:55:46.782102 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 10 22:55:46.782102 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise self.value Aug 10 22:55:46.782102 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 10 22:55:46.782102 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 10 22:55:46.782102 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 10 22:55:46.782102 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 10 22:55:46.782102 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 10 22:55:46.782102 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 10 22:55:46.782102 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Aug 10 22:55:46.782102 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:55:46.782102 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:55:46.782102 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:55:46.782102 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:55:46.782102 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:55:46.782102 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:55:46.782102 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 10 22:55:46.782102 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 10 22:55:46.782102 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Aug 10 22:55:46.782102 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:55:46.800991 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-337d2df8-d4d3-4efa-bc85-fb1938f48c37 tempest-HostsAdminNegativeTestJSON-536073032 tempest-HostsAdminNegativeTestJSON-536073032-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 22:55:46.802840 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-337d2df8-d4d3-4efa-bc85-fb1938f48c37 tempest-HostsAdminNegativeTestJSON-536073032 tempest-HostsAdminNegativeTestJSON-536073032-project] 10.222.0.58 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.904771 Aug 10 22:55:46.805994 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 64/123] 10.222.0.58 () {58 vars in 1128 bytes} [Wed Aug 10 22:55:45 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 908 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 10 22:55:46.816425 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-7a442d50-ef71-43ee-864d-0f262056b368 tempest-HostsAdminNegativeTestJSON-536073032 tempest-HostsAdminNegativeTestJSON-536073032-project] Calling method '.version_select at 0x7f847ddb9700>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:46.818497 n-d-850468-14 devstack@n-api.service[122633]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:reboot": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:55:46.818497 n-d-850468-14 devstack@n-api.service[122633]: warnings.warn(msg) Aug 10 22:55:46.820388 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-7a442d50-ef71-43ee-864d-0f262056b368 tempest-HostsAdminNegativeTestJSON-536073032 tempest-HostsAdminNegativeTestJSON-536073032-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': '08bdcbf86eeb481a9852cfcdb8904f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41448baa694d402a859e1fca25ae9fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:55:46.827110 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-7a442d50-ef71-43ee-864d-0f262056b368 tempest-HostsAdminNegativeTestJSON-536073032 tempest-HostsAdminNegativeTestJSON-536073032-project] Request method failure captured: Aug 10 22:55:46.827110 n-d-850468-14 devstack@n-api.service[122633]: request: GET /compute/v2.1/os-hosts/n-d-850468-14/reboot HTTP/1.1 Aug 10 22:55:46.827110 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 22:55:46.827110 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 22:55:46.827110 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 22:55:46.827110 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 22:55:46.827110 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 22:55:46.827110 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 22:55:46.827110 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 22:55:46.827110 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 22:55:46.827110 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9DdqsN1jYjN7UDcf1AG9d86o_tc1NbbTzb-IKOLPsanIWV52yu59eTnUduq8PPHFvhlQ6aXU6Z-Y12hDH3BQhSfM543EGFiFpi91HXqYOQtAZuW-2Powm1ZoHOU7GUXQCj-QBToh64y88KJPJ9ZVDgUm5NDHiZCBXz_BYCYaG1DDWNw Aug 10 22:55:46.827110 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 22:55:46.827110 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 22:55:46.827110 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 22:55:46.827110 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 22:55:46.827110 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 22:55:46.827110 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 22:55:46.827110 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 41448baa694d402a859e1fca25ae9fc6 Aug 10 22:55:46.827110 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-536073032 Aug 10 22:55:46.827110 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 22:55:46.827110 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 22:55:46.828225 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/41448baa694d402a859e1fca25ae9fc6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/41448baa694d402a859e1fca25ae9fc6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/41448baa694d402a859e1fca25ae9fc6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_41448baa694d402a859e1fca25ae9fc6", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 22:55:46.828225 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-HostsAdminNegativeTestJSON-536073032 Aug 10 22:55:46.828225 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 41448baa694d402a859e1fca25ae9fc6 Aug 10 22:55:46.828225 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-536073032 Aug 10 22:55:46.828225 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-HostsAdminNegativeTestJSON-536073032-project Aug 10 22:55:46.828225 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 22:55:46.828225 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 22:55:46.828225 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 08bdcbf86eeb481a9852cfcdb8904f9f Aug 10 22:55:46.828225 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-HostsAdminNegativeTestJSON-536073032-project Aug 10 22:55:46.828225 n-d-850468-14 devstack@n-api.service[122633]: method: Aug 10 22:55:46.828225 n-d-850468-14 devstack@n-api.service[122633]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Aug 10 22:55:46.828225 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': 'n-d-850468-14'} Aug 10 22:55:46.828225 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 22:55:46.828866 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:55:46.828866 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:55:46.828866 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:55:46.828866 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 22:55:46.828866 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 22:55:46.828866 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 22:55:46.828866 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 22:55:46.828866 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 22:55:46.828866 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 22:55:46.828866 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Aug 10 22:55:46.828866 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Aug 10 22:55:46.828866 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 10 22:55:46.828866 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 10 22:55:46.828866 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 10 22:55:46.828866 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 10 22:55:46.828866 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 10 22:55:46.828866 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 10 22:55:46.828866 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 10 22:55:46.828866 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise self.value Aug 10 22:55:46.829776 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 10 22:55:46.829776 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 10 22:55:46.829776 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 10 22:55:46.829776 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 10 22:55:46.829776 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 10 22:55:46.829776 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 10 22:55:46.829776 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Aug 10 22:55:46.829776 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:55:46.829776 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:55:46.829776 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:55:46.829776 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:55:46.829776 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:55:46.829776 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:55:46.829776 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 10 22:55:46.829776 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 10 22:55:46.829776 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Aug 10 22:55:46.829776 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:55:46.830631 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-7a442d50-ef71-43ee-864d-0f262056b368 tempest-HostsAdminNegativeTestJSON-536073032 tempest-HostsAdminNegativeTestJSON-536073032-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 22:55:46.830631 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-7a442d50-ef71-43ee-864d-0f262056b368 tempest-HostsAdminNegativeTestJSON-536073032 tempest-HostsAdminNegativeTestJSON-536073032-project] 10.222.0.58 "GET /compute/v2.1/os-hosts/n-d-850468-14/reboot" status: 403 len: 111 microversion: 2.1 time: 0.017704 Aug 10 22:55:46.840945 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-0d47611b-5c54-4a7d-bb01-b16899dbe1bf tempest-HostsAdminNegativeTestJSON-644990204 tempest-HostsAdminNegativeTestJSON-644990204-project-admin] Calling method '.version_select at 0x7f847e06b8b0>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:46.846865 n-d-850468-14 devstack@n-api.service[122632]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:reboot": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:55:46.846865 n-d-850468-14 devstack@n-api.service[122632]: warnings.warn(msg) Aug 10 22:55:46.853711 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 60/124] 10.222.0.58 () {58 vars in 1191 bytes} [Wed Aug 10 22:55:46 2022] GET /compute/v2.1/os-hosts/n-d-850468-14/reboot => generated 111 bytes in 43 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 10 22:55:46.892179 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-0d47611b-5c54-4a7d-bb01-b16899dbe1bf tempest-HostsAdminNegativeTestJSON-644990204 tempest-HostsAdminNegativeTestJSON-644990204-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 10 22:55:46.916559 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-0d47611b-5c54-4a7d-bb01-b16899dbe1bf tempest-HostsAdminNegativeTestJSON-644990204 tempest-HostsAdminNegativeTestJSON-644990204-project-admin] Request method failure captured: Aug 10 22:55:46.916559 n-d-850468-14 devstack@n-api.service[122632]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Aug 10 22:55:46.916559 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 22:55:46.916559 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 22:55:46.916559 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 22:55:46.916559 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 22:55:46.916559 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 22:55:46.916559 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 22:55:46.916559 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 22:55:46.916559 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 22:55:46.916559 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9Ddw3Hk7XsLqPjXqP9i2RILW6csrlBLxKme5I8Inu8thyEIhbpxTNuUDmQn6cEdlRC2z8DKCtRK1h6BXCKJKLHmj05LY_Sreq31uUkywiIHoJ1RG7QQRQGzFHBC6g_AgZR7KQLziEULqFfiRu3ZTvgIg3WrQKzp1KvgjZeeyk4T2ukQ Aug 10 22:55:46.916559 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 22:55:46.916559 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 22:55:46.916559 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 22:55:46.916559 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 22:55:46.916559 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 22:55:46.916559 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 22:55:46.916559 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 4535c97acd1d40bbaafd11a58888c29c Aug 10 22:55:46.916559 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-644990204 Aug 10 22:55:46.916559 n-d-850468-14 devstack@n-api.service[122632]: X-Role: admin,member,reader Aug 10 22:55:46.916559 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: admin,member,reader Aug 10 22:55:46.918461 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4535c97acd1d40bbaafd11a58888c29c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4535c97acd1d40bbaafd11a58888c29c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/4535c97acd1d40bbaafd11a58888c29c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_4535c97acd1d40bbaafd11a58888c29c", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 22:55:46.918461 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-HostsAdminNegativeTestJSON-644990204 Aug 10 22:55:46.918461 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 4535c97acd1d40bbaafd11a58888c29c Aug 10 22:55:46.918461 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-644990204 Aug 10 22:55:46.918461 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-HostsAdminNegativeTestJSON-644990204-project-admin Aug 10 22:55:46.918461 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 22:55:46.918461 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 22:55:46.918461 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: 5ea13468e1d64f0ab65e6b8a3479b91c Aug 10 22:55:46.918461 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-HostsAdminNegativeTestJSON-644990204-project-admin Aug 10 22:55:46.918461 n-d-850468-14 devstack@n-api.service[122632]: method: Aug 10 22:55:46.918461 n-d-850468-14 devstack@n-api.service[122632]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 10 22:55:46.918461 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': 'nonexistent_hostname'} Aug 10 22:55:46.918461 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 22:55:46.921405 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:55:46.921405 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Aug 10 22:55:46.921405 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Aug 10 22:55:46.921405 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 10 22:55:46.921405 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 10 22:55:46.921405 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 10 22:55:46.921405 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 10 22:55:46.921405 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 10 22:55:46.921405 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise self.value Aug 10 22:55:46.921405 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 10 22:55:46.921405 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 10 22:55:46.921405 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5953, in targeted Aug 10 22:55:46.921405 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Aug 10 22:55:46.921405 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 10 22:55:46.921405 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 10 22:55:46.921405 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 10 22:55:46.921405 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 10 22:55:46.921405 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 10 22:55:46.921405 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 10 22:55:46.922523 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 10 22:55:46.922523 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 10 22:55:46.922523 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 10 22:55:46.922523 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:55:46.922523 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:55:46.922523 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:55:46.922523 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:55:46.922523 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:55:46.922523 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:55:46.922523 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 22:55:46.922523 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 22:55:46.922523 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 22:55:46.922523 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 22:55:46.922523 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 22:55:46.922523 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 22:55:46.922523 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Aug 10 22:55:46.922523 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Aug 10 22:55:46.922523 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Aug 10 22:55:46.922523 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 10 22:55:46.925208 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 10 22:55:46.925208 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:55:46.925208 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:55:46.925208 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:55:46.925208 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:55:46.925208 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:55:46.925208 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:55:46.925208 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 22:55:46.925208 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 22:55:46.925208 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 10 22:55:46.925208 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:55:46.927500 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-34601dc6-2565-4ad1-9c43-b3130c4eb9f3 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:46.927500 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-34601dc6-2565-4ad1-9c43-b3130c4eb9f3 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] [instance: 155e0037-0bdb-4a93-af44-de6903bc2891] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:55:46.928230 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-0d47611b-5c54-4a7d-bb01-b16899dbe1bf tempest-HostsAdminNegativeTestJSON-644990204 tempest-HostsAdminNegativeTestJSON-644990204-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 22:55:46.931102 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-0d47611b-5c54-4a7d-bb01-b16899dbe1bf tempest-HostsAdminNegativeTestJSON-644990204 tempest-HostsAdminNegativeTestJSON-644990204-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.096316 Aug 10 22:55:46.943408 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 65/125] 10.222.0.58 () {58 vars in 1212 bytes} [Wed Aug 10 22:55:46 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 10 22:55:46.953919 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-a15330d7-b640-4989-9012-685404e8ca2c tempest-HostsAdminNegativeTestJSON-536073032 tempest-HostsAdminNegativeTestJSON-536073032-project] Calling method '.version_select at 0x7f847ded59d0>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:46.954508 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-34601dc6-2565-4ad1-9c43-b3130c4eb9f3 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:46.955022 n-d-850468-14 devstack@n-api.service[122632]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:55:46.955022 n-d-850468-14 devstack@n-api.service[122632]: warnings.warn(msg) Aug 10 22:55:46.955380 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-34601dc6-2565-4ad1-9c43-b3130c4eb9f3 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:46.955827 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-34601dc6-2565-4ad1-9c43-b3130c4eb9f3 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:46.957495 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-a15330d7-b640-4989-9012-685404e8ca2c tempest-HostsAdminNegativeTestJSON-536073032 tempest-HostsAdminNegativeTestJSON-536073032-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': '08bdcbf86eeb481a9852cfcdb8904f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41448baa694d402a859e1fca25ae9fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:55:46.959508 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-a15330d7-b640-4989-9012-685404e8ca2c tempest-HostsAdminNegativeTestJSON-536073032 tempest-HostsAdminNegativeTestJSON-536073032-project] Request method failure captured: Aug 10 22:55:46.959508 n-d-850468-14 devstack@n-api.service[122632]: request: GET /compute/v2.1/os-hosts/n-d-850468-14 HTTP/1.1 Aug 10 22:55:46.959508 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 22:55:46.959508 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 22:55:46.959508 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 22:55:46.959508 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 22:55:46.959508 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 22:55:46.959508 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 22:55:46.959508 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 22:55:46.959508 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 22:55:46.959508 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9DdqsN1jYjN7UDcf1AG9d86o_tc1NbbTzb-IKOLPsanIWV52yu59eTnUduq8PPHFvhlQ6aXU6Z-Y12hDH3BQhSfM543EGFiFpi91HXqYOQtAZuW-2Powm1ZoHOU7GUXQCj-QBToh64y88KJPJ9ZVDgUm5NDHiZCBXz_BYCYaG1DDWNw Aug 10 22:55:46.959508 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 22:55:46.959508 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 22:55:46.959508 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 22:55:46.959508 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 22:55:46.959508 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 22:55:46.959508 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 22:55:46.959508 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 41448baa694d402a859e1fca25ae9fc6 Aug 10 22:55:46.959508 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-536073032 Aug 10 22:55:46.959508 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 22:55:46.959508 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 22:55:46.961490 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/41448baa694d402a859e1fca25ae9fc6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/41448baa694d402a859e1fca25ae9fc6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/41448baa694d402a859e1fca25ae9fc6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_41448baa694d402a859e1fca25ae9fc6", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 22:55:46.961490 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-HostsAdminNegativeTestJSON-536073032 Aug 10 22:55:46.961490 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 41448baa694d402a859e1fca25ae9fc6 Aug 10 22:55:46.961490 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-536073032 Aug 10 22:55:46.961490 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-HostsAdminNegativeTestJSON-536073032-project Aug 10 22:55:46.961490 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 22:55:46.961490 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 22:55:46.961490 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: 08bdcbf86eeb481a9852cfcdb8904f9f Aug 10 22:55:46.961490 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-HostsAdminNegativeTestJSON-536073032-project Aug 10 22:55:46.961490 n-d-850468-14 devstack@n-api.service[122632]: method: Aug 10 22:55:46.961490 n-d-850468-14 devstack@n-api.service[122632]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Aug 10 22:55:46.961490 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': 'n-d-850468-14'} Aug 10 22:55:46.961490 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 22:55:46.962442 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:55:46.962442 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:55:46.962442 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:55:46.962442 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 22:55:46.962442 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 22:55:46.962442 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 22:55:46.962442 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 22:55:46.962442 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 22:55:46.962442 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 22:55:46.962442 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Aug 10 22:55:46.962442 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Aug 10 22:55:46.962442 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 10 22:55:46.962442 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 10 22:55:46.962442 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 10 22:55:46.962442 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 10 22:55:46.962442 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 10 22:55:46.962442 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 10 22:55:46.962442 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 10 22:55:46.962442 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise self.value Aug 10 22:55:46.964141 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 10 22:55:46.964141 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 10 22:55:46.964141 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 10 22:55:46.964141 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 10 22:55:46.964141 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 10 22:55:46.964141 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 10 22:55:46.964141 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Aug 10 22:55:46.964141 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:55:46.964141 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:55:46.964141 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:55:46.964141 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:55:46.964141 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:55:46.964141 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:55:46.964141 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 10 22:55:46.964141 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 10 22:55:46.964141 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Aug 10 22:55:46.964141 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:55:46.967559 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-34601dc6-2565-4ad1-9c43-b3130c4eb9f3 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:46.967559 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-34601dc6-2565-4ad1-9c43-b3130c4eb9f3 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:46.967559 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-34601dc6-2565-4ad1-9c43-b3130c4eb9f3 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:46.969254 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-a15330d7-b640-4989-9012-685404e8ca2c tempest-HostsAdminNegativeTestJSON-536073032 tempest-HostsAdminNegativeTestJSON-536073032-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 22:55:46.970528 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-a15330d7-b640-4989-9012-685404e8ca2c tempest-HostsAdminNegativeTestJSON-536073032 tempest-HostsAdminNegativeTestJSON-536073032-project] 10.222.0.58 "GET /compute/v2.1/os-hosts/n-d-850468-14" status: 403 len: 109 microversion: 2.1 time: 0.026018 Aug 10 22:55:46.971332 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 66/126] 10.222.0.58 () {58 vars in 1170 bytes} [Wed Aug 10 22:55:46 2022] GET /compute/v2.1/os-hosts/n-d-850468-14 => generated 109 bytes in 27 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 10 22:55:47.008031 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-f2ee5749-0d8d-4ad7-97a4-7cc97135cb61 tempest-HostsAdminNegativeTestJSON-644990204 tempest-HostsAdminNegativeTestJSON-644990204-project-admin] Calling method '.version_select at 0x7f847deee550>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:47.041754 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-f2ee5749-0d8d-4ad7-97a4-7cc97135cb61 tempest-HostsAdminNegativeTestJSON-644990204 tempest-HostsAdminNegativeTestJSON-644990204-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 10 22:55:47.046698 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-f2ee5749-0d8d-4ad7-97a4-7cc97135cb61 tempest-HostsAdminNegativeTestJSON-644990204 tempest-HostsAdminNegativeTestJSON-644990204-project-admin] Request method failure captured: Aug 10 22:55:47.046698 n-d-850468-14 devstack@n-api.service[122632]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Aug 10 22:55:47.046698 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 22:55:47.046698 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 22:55:47.046698 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 22:55:47.046698 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 22:55:47.046698 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 22:55:47.046698 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 22:55:47.046698 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 22:55:47.046698 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 22:55:47.046698 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9Ddw3Hk7XsLqPjXqP9i2RILW6csrlBLxKme5I8Inu8thyEIhbpxTNuUDmQn6cEdlRC2z8DKCtRK1h6BXCKJKLHmj05LY_Sreq31uUkywiIHoJ1RG7QQRQGzFHBC6g_AgZR7KQLziEULqFfiRu3ZTvgIg3WrQKzp1KvgjZeeyk4T2ukQ Aug 10 22:55:47.046698 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 22:55:47.046698 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 22:55:47.046698 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 22:55:47.046698 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 22:55:47.046698 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 22:55:47.046698 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 22:55:47.046698 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 4535c97acd1d40bbaafd11a58888c29c Aug 10 22:55:47.046698 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-644990204 Aug 10 22:55:47.046698 n-d-850468-14 devstack@n-api.service[122632]: X-Role: admin,member,reader Aug 10 22:55:47.046698 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: admin,member,reader Aug 10 22:55:47.048320 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4535c97acd1d40bbaafd11a58888c29c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4535c97acd1d40bbaafd11a58888c29c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/4535c97acd1d40bbaafd11a58888c29c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_4535c97acd1d40bbaafd11a58888c29c", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 22:55:47.048320 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-HostsAdminNegativeTestJSON-644990204 Aug 10 22:55:47.048320 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 4535c97acd1d40bbaafd11a58888c29c Aug 10 22:55:47.048320 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-644990204 Aug 10 22:55:47.048320 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-HostsAdminNegativeTestJSON-644990204-project-admin Aug 10 22:55:47.048320 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 22:55:47.048320 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 22:55:47.048320 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: 5ea13468e1d64f0ab65e6b8a3479b91c Aug 10 22:55:47.048320 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-HostsAdminNegativeTestJSON-644990204-project-admin Aug 10 22:55:47.048320 n-d-850468-14 devstack@n-api.service[122632]: method: Aug 10 22:55:47.048320 n-d-850468-14 devstack@n-api.service[122632]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 10 22:55:47.048320 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': 'nonexistent_hostname'} Aug 10 22:55:47.048320 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 22:55:47.049170 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:55:47.049170 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Aug 10 22:55:47.049170 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Aug 10 22:55:47.049170 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 10 22:55:47.049170 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 10 22:55:47.049170 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 10 22:55:47.049170 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 10 22:55:47.049170 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 10 22:55:47.049170 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 10 22:55:47.049170 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 10 22:55:47.049170 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 10 22:55:47.049170 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 10 22:55:47.049170 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:55:47.049170 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:55:47.049170 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:55:47.049170 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:55:47.049170 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:55:47.049170 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:55:47.049170 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 22:55:47.050555 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 22:55:47.050555 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 22:55:47.050555 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 22:55:47.050555 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 22:55:47.050555 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 22:55:47.050555 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Aug 10 22:55:47.050555 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 10 22:55:47.050555 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 10 22:55:47.050555 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:55:47.050555 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:55:47.050555 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:55:47.050555 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:55:47.050555 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:55:47.050555 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:55:47.050555 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 22:55:47.050555 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 22:55:47.050555 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 10 22:55:47.050555 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:55:47.051877 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-f2ee5749-0d8d-4ad7-97a4-7cc97135cb61 tempest-HostsAdminNegativeTestJSON-644990204 tempest-HostsAdminNegativeTestJSON-644990204-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 22:55:47.055093 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-f2ee5749-0d8d-4ad7-97a4-7cc97135cb61 tempest-HostsAdminNegativeTestJSON-644990204 tempest-HostsAdminNegativeTestJSON-644990204-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.073767 Aug 10 22:55:47.061054 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 67/127] 10.222.0.58 () {58 vars in 1191 bytes} [Wed Aug 10 22:55:46 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 10 22:55:47.074961 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-bc27d576-40bb-4b5a-997e-21b6e5973190 tempest-HostsAdminNegativeTestJSON-536073032 tempest-HostsAdminNegativeTestJSON-536073032-project] Calling method '.version_select at 0x7f847ded5af0>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:47.075930 n-d-850468-14 devstack@n-api.service[122632]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:shutdown": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:55:47.075930 n-d-850468-14 devstack@n-api.service[122632]: warnings.warn(msg) Aug 10 22:55:47.080603 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-bc27d576-40bb-4b5a-997e-21b6e5973190 tempest-HostsAdminNegativeTestJSON-536073032 tempest-HostsAdminNegativeTestJSON-536073032-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': '08bdcbf86eeb481a9852cfcdb8904f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41448baa694d402a859e1fca25ae9fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:55:47.084258 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-bc27d576-40bb-4b5a-997e-21b6e5973190 tempest-HostsAdminNegativeTestJSON-536073032 tempest-HostsAdminNegativeTestJSON-536073032-project] Request method failure captured: Aug 10 22:55:47.084258 n-d-850468-14 devstack@n-api.service[122632]: request: GET /compute/v2.1/os-hosts/n-d-850468-14/shutdown HTTP/1.1 Aug 10 22:55:47.084258 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 22:55:47.084258 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 22:55:47.084258 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 22:55:47.084258 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 22:55:47.084258 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 22:55:47.084258 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 22:55:47.084258 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 22:55:47.084258 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 22:55:47.084258 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9DdqsN1jYjN7UDcf1AG9d86o_tc1NbbTzb-IKOLPsanIWV52yu59eTnUduq8PPHFvhlQ6aXU6Z-Y12hDH3BQhSfM543EGFiFpi91HXqYOQtAZuW-2Powm1ZoHOU7GUXQCj-QBToh64y88KJPJ9ZVDgUm5NDHiZCBXz_BYCYaG1DDWNw Aug 10 22:55:47.084258 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 22:55:47.084258 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 22:55:47.084258 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 22:55:47.084258 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 22:55:47.084258 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 22:55:47.084258 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 22:55:47.084258 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 41448baa694d402a859e1fca25ae9fc6 Aug 10 22:55:47.084258 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-536073032 Aug 10 22:55:47.084258 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 22:55:47.084258 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 22:55:47.085666 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/41448baa694d402a859e1fca25ae9fc6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/41448baa694d402a859e1fca25ae9fc6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/41448baa694d402a859e1fca25ae9fc6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_41448baa694d402a859e1fca25ae9fc6", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 22:55:47.085666 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-HostsAdminNegativeTestJSON-536073032 Aug 10 22:55:47.085666 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 41448baa694d402a859e1fca25ae9fc6 Aug 10 22:55:47.085666 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-536073032 Aug 10 22:55:47.085666 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-HostsAdminNegativeTestJSON-536073032-project Aug 10 22:55:47.085666 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 22:55:47.085666 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 22:55:47.085666 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: 08bdcbf86eeb481a9852cfcdb8904f9f Aug 10 22:55:47.085666 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-HostsAdminNegativeTestJSON-536073032-project Aug 10 22:55:47.085666 n-d-850468-14 devstack@n-api.service[122632]: method: Aug 10 22:55:47.085666 n-d-850468-14 devstack@n-api.service[122632]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Aug 10 22:55:47.085666 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': 'n-d-850468-14'} Aug 10 22:55:47.085666 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 22:55:47.087038 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:55:47.087038 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:55:47.087038 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:55:47.087038 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 22:55:47.087038 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 22:55:47.087038 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 22:55:47.087038 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 22:55:47.087038 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 22:55:47.087038 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 22:55:47.087038 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Aug 10 22:55:47.087038 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Aug 10 22:55:47.087038 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 10 22:55:47.087038 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 10 22:55:47.087038 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 10 22:55:47.087038 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 10 22:55:47.087038 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 10 22:55:47.087038 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 10 22:55:47.087038 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 10 22:55:47.087038 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise self.value Aug 10 22:55:47.088233 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 10 22:55:47.088233 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 10 22:55:47.088233 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 10 22:55:47.088233 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 10 22:55:47.088233 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 10 22:55:47.088233 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 10 22:55:47.088233 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Aug 10 22:55:47.088233 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:55:47.088233 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:55:47.088233 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:55:47.088233 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:55:47.088233 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:55:47.088233 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:55:47.088233 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 10 22:55:47.088233 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 10 22:55:47.088233 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Aug 10 22:55:47.088233 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:55:47.089314 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-bc27d576-40bb-4b5a-997e-21b6e5973190 tempest-HostsAdminNegativeTestJSON-536073032 tempest-HostsAdminNegativeTestJSON-536073032-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 22:55:47.090527 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-bc27d576-40bb-4b5a-997e-21b6e5973190 tempest-HostsAdminNegativeTestJSON-536073032 tempest-HostsAdminNegativeTestJSON-536073032-project] 10.222.0.58 "GET /compute/v2.1/os-hosts/n-d-850468-14/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.024311 Aug 10 22:55:47.097327 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 68/128] 10.222.0.58 () {58 vars in 1197 bytes} [Wed Aug 10 22:55:47 2022] GET /compute/v2.1/os-hosts/n-d-850468-14/shutdown => generated 113 bytes in 27 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 10 22:55:47.108161 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-f5c95904-d4a4-40ac-b06f-352059278223 tempest-HostsAdminNegativeTestJSON-644990204 tempest-HostsAdminNegativeTestJSON-644990204-project-admin] Calling method '.version_select at 0x7f847e041f70>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:47.152235 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-f5c95904-d4a4-40ac-b06f-352059278223 tempest-HostsAdminNegativeTestJSON-644990204 tempest-HostsAdminNegativeTestJSON-644990204-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 10 22:55:47.158758 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-f5c95904-d4a4-40ac-b06f-352059278223 tempest-HostsAdminNegativeTestJSON-644990204 tempest-HostsAdminNegativeTestJSON-644990204-project-admin] Request method failure captured: Aug 10 22:55:47.158758 n-d-850468-14 devstack@n-api.service[122632]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Aug 10 22:55:47.158758 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 22:55:47.158758 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 22:55:47.158758 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 22:55:47.158758 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 22:55:47.158758 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 22:55:47.158758 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 22:55:47.158758 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 22:55:47.158758 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 22:55:47.158758 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9Ddw3Hk7XsLqPjXqP9i2RILW6csrlBLxKme5I8Inu8thyEIhbpxTNuUDmQn6cEdlRC2z8DKCtRK1h6BXCKJKLHmj05LY_Sreq31uUkywiIHoJ1RG7QQRQGzFHBC6g_AgZR7KQLziEULqFfiRu3ZTvgIg3WrQKzp1KvgjZeeyk4T2ukQ Aug 10 22:55:47.158758 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 22:55:47.158758 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 22:55:47.158758 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 22:55:47.158758 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 22:55:47.158758 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 22:55:47.158758 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 22:55:47.158758 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 4535c97acd1d40bbaafd11a58888c29c Aug 10 22:55:47.158758 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-644990204 Aug 10 22:55:47.158758 n-d-850468-14 devstack@n-api.service[122632]: X-Role: admin,member,reader Aug 10 22:55:47.158758 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: admin,member,reader Aug 10 22:55:47.160284 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4535c97acd1d40bbaafd11a58888c29c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4535c97acd1d40bbaafd11a58888c29c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/4535c97acd1d40bbaafd11a58888c29c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_4535c97acd1d40bbaafd11a58888c29c", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 22:55:47.160284 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-HostsAdminNegativeTestJSON-644990204 Aug 10 22:55:47.160284 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 4535c97acd1d40bbaafd11a58888c29c Aug 10 22:55:47.160284 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-644990204 Aug 10 22:55:47.160284 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-HostsAdminNegativeTestJSON-644990204-project-admin Aug 10 22:55:47.160284 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 22:55:47.160284 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 22:55:47.160284 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: 5ea13468e1d64f0ab65e6b8a3479b91c Aug 10 22:55:47.160284 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-HostsAdminNegativeTestJSON-644990204-project-admin Aug 10 22:55:47.160284 n-d-850468-14 devstack@n-api.service[122632]: method: Aug 10 22:55:47.160284 n-d-850468-14 devstack@n-api.service[122632]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 10 22:55:47.160284 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': 'nonexistent_hostname'} Aug 10 22:55:47.160284 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 22:55:47.161235 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:55:47.161235 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Aug 10 22:55:47.161235 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Aug 10 22:55:47.161235 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 10 22:55:47.161235 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 10 22:55:47.161235 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 10 22:55:47.161235 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 10 22:55:47.161235 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 10 22:55:47.161235 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise self.value Aug 10 22:55:47.161235 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 10 22:55:47.161235 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 10 22:55:47.161235 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5953, in targeted Aug 10 22:55:47.161235 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Aug 10 22:55:47.161235 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 10 22:55:47.161235 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 10 22:55:47.161235 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 10 22:55:47.161235 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 10 22:55:47.161235 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 10 22:55:47.161235 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 10 22:55:47.162389 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 10 22:55:47.162389 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 10 22:55:47.162389 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 10 22:55:47.162389 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:55:47.162389 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:55:47.162389 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:55:47.162389 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:55:47.162389 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:55:47.162389 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:55:47.162389 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 22:55:47.162389 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 22:55:47.162389 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 22:55:47.162389 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 22:55:47.162389 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 22:55:47.162389 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 22:55:47.162389 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Aug 10 22:55:47.162389 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Aug 10 22:55:47.162389 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Aug 10 22:55:47.162389 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 10 22:55:47.165194 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 10 22:55:47.165194 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:55:47.165194 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:55:47.165194 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:55:47.165194 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:55:47.165194 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:55:47.165194 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:55:47.165194 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 22:55:47.165194 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 22:55:47.165194 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 10 22:55:47.165194 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:55:47.170971 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-f5c95904-d4a4-40ac-b06f-352059278223 tempest-HostsAdminNegativeTestJSON-644990204 tempest-HostsAdminNegativeTestJSON-644990204-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 22:55:47.175251 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-f5c95904-d4a4-40ac-b06f-352059278223 tempest-HostsAdminNegativeTestJSON-644990204 tempest-HostsAdminNegativeTestJSON-644990204-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.073901 Aug 10 22:55:47.178716 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 69/129] 10.222.0.58 () {58 vars in 1218 bytes} [Wed Aug 10 22:55:47 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 10 22:55:47.199690 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c1088d72-022a-44a9-9c83-edc03ffe42b0 tempest-HostsAdminNegativeTestJSON-536073032 tempest-HostsAdminNegativeTestJSON-536073032-project] Calling method '.version_select at 0x7f847ded5b80>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:47.202570 n-d-850468-14 devstack@n-api.service[122632]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:start": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:55:47.202570 n-d-850468-14 devstack@n-api.service[122632]: warnings.warn(msg) Aug 10 22:55:47.207728 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-c1088d72-022a-44a9-9c83-edc03ffe42b0 tempest-HostsAdminNegativeTestJSON-536073032 tempest-HostsAdminNegativeTestJSON-536073032-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': '08bdcbf86eeb481a9852cfcdb8904f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41448baa694d402a859e1fca25ae9fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:55:47.209841 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c1088d72-022a-44a9-9c83-edc03ffe42b0 tempest-HostsAdminNegativeTestJSON-536073032 tempest-HostsAdminNegativeTestJSON-536073032-project] Request method failure captured: Aug 10 22:55:47.209841 n-d-850468-14 devstack@n-api.service[122632]: request: GET /compute/v2.1/os-hosts/n-d-850468-14/startup HTTP/1.1 Aug 10 22:55:47.209841 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 22:55:47.209841 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 22:55:47.209841 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 22:55:47.209841 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 22:55:47.209841 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 22:55:47.209841 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 22:55:47.209841 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 22:55:47.209841 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 22:55:47.209841 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9DdqsN1jYjN7UDcf1AG9d86o_tc1NbbTzb-IKOLPsanIWV52yu59eTnUduq8PPHFvhlQ6aXU6Z-Y12hDH3BQhSfM543EGFiFpi91HXqYOQtAZuW-2Powm1ZoHOU7GUXQCj-QBToh64y88KJPJ9ZVDgUm5NDHiZCBXz_BYCYaG1DDWNw Aug 10 22:55:47.209841 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 22:55:47.209841 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 22:55:47.209841 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 22:55:47.209841 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 22:55:47.209841 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 22:55:47.209841 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 22:55:47.209841 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 41448baa694d402a859e1fca25ae9fc6 Aug 10 22:55:47.209841 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-536073032 Aug 10 22:55:47.209841 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 22:55:47.209841 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 22:55:47.211697 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/41448baa694d402a859e1fca25ae9fc6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/41448baa694d402a859e1fca25ae9fc6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/41448baa694d402a859e1fca25ae9fc6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_41448baa694d402a859e1fca25ae9fc6", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 22:55:47.211697 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-HostsAdminNegativeTestJSON-536073032 Aug 10 22:55:47.211697 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 41448baa694d402a859e1fca25ae9fc6 Aug 10 22:55:47.211697 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-536073032 Aug 10 22:55:47.211697 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-HostsAdminNegativeTestJSON-536073032-project Aug 10 22:55:47.211697 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 22:55:47.211697 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 22:55:47.211697 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: 08bdcbf86eeb481a9852cfcdb8904f9f Aug 10 22:55:47.211697 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-HostsAdminNegativeTestJSON-536073032-project Aug 10 22:55:47.211697 n-d-850468-14 devstack@n-api.service[122632]: method: Aug 10 22:55:47.211697 n-d-850468-14 devstack@n-api.service[122632]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Aug 10 22:55:47.211697 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': 'n-d-850468-14'} Aug 10 22:55:47.211697 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 22:55:47.212594 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:55:47.212594 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:55:47.212594 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:55:47.212594 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 22:55:47.212594 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 22:55:47.212594 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 22:55:47.212594 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 22:55:47.212594 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 22:55:47.212594 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 22:55:47.212594 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Aug 10 22:55:47.212594 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Aug 10 22:55:47.212594 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 10 22:55:47.212594 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 10 22:55:47.212594 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 10 22:55:47.212594 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 10 22:55:47.212594 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 10 22:55:47.212594 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 10 22:55:47.212594 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 10 22:55:47.212594 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise self.value Aug 10 22:55:47.213731 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 10 22:55:47.213731 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 10 22:55:47.213731 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 10 22:55:47.213731 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 10 22:55:47.213731 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 10 22:55:47.213731 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 10 22:55:47.213731 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Aug 10 22:55:47.213731 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:55:47.213731 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:55:47.213731 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:55:47.213731 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:55:47.213731 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:55:47.213731 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:55:47.213731 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 10 22:55:47.213731 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 10 22:55:47.213731 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Aug 10 22:55:47.213731 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:55:47.214656 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c1088d72-022a-44a9-9c83-edc03ffe42b0 tempest-HostsAdminNegativeTestJSON-536073032 tempest-HostsAdminNegativeTestJSON-536073032-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 22:55:47.217359 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-c1088d72-022a-44a9-9c83-edc03ffe42b0 tempest-HostsAdminNegativeTestJSON-536073032 tempest-HostsAdminNegativeTestJSON-536073032-project] 10.222.0.58 "GET /compute/v2.1/os-hosts/n-d-850468-14/startup" status: 403 len: 110 microversion: 2.1 time: 0.032808 Aug 10 22:55:47.229333 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 70/130] 10.222.0.58 () {58 vars in 1194 bytes} [Wed Aug 10 22:55:47 2022] GET /compute/v2.1/os-hosts/n-d-850468-14/startup => generated 110 bytes in 45 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 10 22:55:47.241207 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-d6ae70d3-24ad-4bae-a31f-4f4bd59c4130 tempest-HostsAdminNegativeTestJSON-644990204 tempest-HostsAdminNegativeTestJSON-644990204-project-admin] Calling method '.version_select at 0x7f847deee1f0>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:47.266528 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=2 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:55:47.271761 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-d6ae70d3-24ad-4bae-a31f-4f4bd59c4130 tempest-HostsAdminNegativeTestJSON-644990204 tempest-HostsAdminNegativeTestJSON-644990204-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 10 22:55:47.275518 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-d6ae70d3-24ad-4bae-a31f-4f4bd59c4130 tempest-HostsAdminNegativeTestJSON-644990204 tempest-HostsAdminNegativeTestJSON-644990204-project-admin] Request method failure captured: Aug 10 22:55:47.275518 n-d-850468-14 devstack@n-api.service[122632]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Aug 10 22:55:47.275518 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 22:55:47.275518 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 22:55:47.275518 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 22:55:47.275518 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 22:55:47.275518 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 22:55:47.275518 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 22:55:47.275518 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 22:55:47.275518 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 22:55:47.275518 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9Ddw3Hk7XsLqPjXqP9i2RILW6csrlBLxKme5I8Inu8thyEIhbpxTNuUDmQn6cEdlRC2z8DKCtRK1h6BXCKJKLHmj05LY_Sreq31uUkywiIHoJ1RG7QQRQGzFHBC6g_AgZR7KQLziEULqFfiRu3ZTvgIg3WrQKzp1KvgjZeeyk4T2ukQ Aug 10 22:55:47.275518 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 22:55:47.275518 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 22:55:47.275518 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 22:55:47.275518 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 22:55:47.275518 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 22:55:47.275518 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 22:55:47.275518 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 4535c97acd1d40bbaafd11a58888c29c Aug 10 22:55:47.275518 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-644990204 Aug 10 22:55:47.275518 n-d-850468-14 devstack@n-api.service[122632]: X-Role: admin,member,reader Aug 10 22:55:47.275518 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: admin,member,reader Aug 10 22:55:47.276771 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4535c97acd1d40bbaafd11a58888c29c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4535c97acd1d40bbaafd11a58888c29c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/4535c97acd1d40bbaafd11a58888c29c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_4535c97acd1d40bbaafd11a58888c29c", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 22:55:47.276771 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-HostsAdminNegativeTestJSON-644990204 Aug 10 22:55:47.276771 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 4535c97acd1d40bbaafd11a58888c29c Aug 10 22:55:47.276771 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-644990204 Aug 10 22:55:47.276771 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-HostsAdminNegativeTestJSON-644990204-project-admin Aug 10 22:55:47.276771 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 22:55:47.276771 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 22:55:47.276771 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: 5ea13468e1d64f0ab65e6b8a3479b91c Aug 10 22:55:47.276771 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-HostsAdminNegativeTestJSON-644990204-project-admin Aug 10 22:55:47.276771 n-d-850468-14 devstack@n-api.service[122632]: method: Aug 10 22:55:47.276771 n-d-850468-14 devstack@n-api.service[122632]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 10 22:55:47.276771 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': 'nonexistent_hostname'} Aug 10 22:55:47.276771 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 22:55:47.277592 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:55:47.277592 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Aug 10 22:55:47.277592 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Aug 10 22:55:47.277592 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 10 22:55:47.277592 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 10 22:55:47.277592 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 10 22:55:47.277592 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 10 22:55:47.277592 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 10 22:55:47.277592 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise self.value Aug 10 22:55:47.277592 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 10 22:55:47.277592 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 10 22:55:47.277592 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5953, in targeted Aug 10 22:55:47.277592 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Aug 10 22:55:47.277592 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 10 22:55:47.277592 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 10 22:55:47.277592 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 10 22:55:47.277592 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 10 22:55:47.277592 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 10 22:55:47.277592 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 10 22:55:47.278735 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 10 22:55:47.278735 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 10 22:55:47.278735 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 10 22:55:47.278735 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:55:47.278735 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:55:47.278735 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:55:47.278735 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:55:47.278735 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:55:47.278735 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:55:47.278735 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 22:55:47.278735 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 22:55:47.278735 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 22:55:47.278735 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 22:55:47.278735 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 22:55:47.278735 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 22:55:47.278735 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Aug 10 22:55:47.278735 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Aug 10 22:55:47.278735 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Aug 10 22:55:47.278735 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 10 22:55:47.279672 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 10 22:55:47.279672 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:55:47.279672 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:55:47.279672 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:55:47.279672 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:55:47.279672 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:55:47.279672 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:55:47.279672 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 22:55:47.279672 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 22:55:47.279672 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 10 22:55:47.279672 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:55:47.279672 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-d6ae70d3-24ad-4bae-a31f-4f4bd59c4130 tempest-HostsAdminNegativeTestJSON-644990204 tempest-HostsAdminNegativeTestJSON-644990204-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 22:55:47.279672 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-d6ae70d3-24ad-4bae-a31f-4f4bd59c4130 tempest-HostsAdminNegativeTestJSON-644990204 tempest-HostsAdminNegativeTestJSON-644990204-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.044085 Aug 10 22:55:47.280725 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 71/131] 10.222.0.58 () {58 vars in 1215 bytes} [Wed Aug 10 22:55:47 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 10 22:55:47.298430 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-4391ec4e-2081-4ce0-8e26-1d885795ba91 tempest-HostsAdminNegativeTestJSON-644990204 tempest-HostsAdminNegativeTestJSON-644990204-project-admin] Action: 'update', calling method: .version_select at 0x7f847ded54c0>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:55:47.323846 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-4391ec4e-2081-4ce0-8e26-1d885795ba91 tempest-HostsAdminNegativeTestJSON-644990204 tempest-HostsAdminNegativeTestJSON-644990204-project-admin] Request method failure captured: Aug 10 22:55:47.323846 n-d-850468-14 devstack@n-api.service[122632]: request: PUT /compute/v2.1/os-hosts/n-d-850468-14 HTTP/1.1 Aug 10 22:55:47.323846 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 22:55:47.323846 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 22:55:47.323846 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 22:55:47.323846 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 51 Aug 10 22:55:47.323846 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 22:55:47.323846 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 22:55:47.323846 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 22:55:47.323846 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 22:55:47.323846 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9Ddw3Hk7XsLqPjXqP9i2RILW6csrlBLxKme5I8Inu8thyEIhbpxTNuUDmQn6cEdlRC2z8DKCtRK1h6BXCKJKLHmj05LY_Sreq31uUkywiIHoJ1RG7QQRQGzFHBC6g_AgZR7KQLziEULqFfiRu3ZTvgIg3WrQKzp1KvgjZeeyk4T2ukQ Aug 10 22:55:47.323846 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 22:55:47.323846 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 22:55:47.323846 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 22:55:47.323846 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 22:55:47.323846 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 22:55:47.323846 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 22:55:47.323846 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 4535c97acd1d40bbaafd11a58888c29c Aug 10 22:55:47.323846 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-644990204 Aug 10 22:55:47.323846 n-d-850468-14 devstack@n-api.service[122632]: X-Role: admin,member,reader Aug 10 22:55:47.323846 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: admin,member,reader Aug 10 22:55:47.325150 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4535c97acd1d40bbaafd11a58888c29c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4535c97acd1d40bbaafd11a58888c29c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/4535c97acd1d40bbaafd11a58888c29c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_4535c97acd1d40bbaafd11a58888c29c", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 22:55:47.325150 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-HostsAdminNegativeTestJSON-644990204 Aug 10 22:55:47.325150 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 4535c97acd1d40bbaafd11a58888c29c Aug 10 22:55:47.325150 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-644990204 Aug 10 22:55:47.325150 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-HostsAdminNegativeTestJSON-644990204-project-admin Aug 10 22:55:47.325150 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 22:55:47.325150 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 22:55:47.325150 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: 5ea13468e1d64f0ab65e6b8a3479b91c Aug 10 22:55:47.325150 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-HostsAdminNegativeTestJSON-644990204-project-admin Aug 10 22:55:47.325150 n-d-850468-14 devstack@n-api.service[122632]: Aug 10 22:55:47.325150 n-d-850468-14 devstack@n-api.service[122632]: {"status": "enable", "maintenance_mode": "invalid"} Aug 10 22:55:47.325150 n-d-850468-14 devstack@n-api.service[122632]: method: Aug 10 22:55:47.325150 n-d-850468-14 devstack@n-api.service[122632]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 10 22:55:47.325895 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': 'n-d-850468-14', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Aug 10 22:55:47.325895 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 22:55:47.325895 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:55:47.325895 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 10 22:55:47.325895 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 10 22:55:47.325895 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 10 22:55:47.325895 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise error Aug 10 22:55:47.325895 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 10 22:55:47.325895 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:55:47.325895 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Aug 10 22:55:47.325895 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Aug 10 22:55:47.325895 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi 'disable', Aug 10 22:55:47.325895 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi 'Enable', Aug 10 22:55:47.325895 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi 'Disable', Aug 10 22:55:47.325895 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi 'ENABLE', Aug 10 22:55:47.325895 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi 'DISABLE'], Aug 10 22:55:47.325895 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi 'type': 'string'} Aug 10 22:55:47.325895 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:55:47.325895 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi On instance: Aug 10 22:55:47.325895 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi 'invalid' Aug 10 22:55:47.325895 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:55:47.325895 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:55:47.325895 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:55:47.325895 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:55:47.325895 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:55:47.327130 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:55:47.327130 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 22:55:47.327130 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 22:55:47.327130 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 22:55:47.327130 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 22:55:47.327130 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 22:55:47.327130 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 22:55:47.327130 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 10 22:55:47.327130 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 10 22:55:47.327130 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 10 22:55:47.327130 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 10 22:55:47.327130 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 10 22:55:47.327130 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 10 22:55:47.327130 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 10 22:55:47.327130 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:55:47.327130 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:55:47.327130 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:55:47.327130 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:55:47.327130 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:55:47.328153 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:55:47.328153 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 10 22:55:47.328153 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 10 22:55:47.328153 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 10 22:55:47.328153 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:55:47.329520 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-4391ec4e-2081-4ce0-8e26-1d885795ba91 tempest-HostsAdminNegativeTestJSON-644990204 tempest-HostsAdminNegativeTestJSON-644990204-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 22:55:47.330741 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-4391ec4e-2081-4ce0-8e26-1d885795ba91 tempest-HostsAdminNegativeTestJSON-644990204 tempest-HostsAdminNegativeTestJSON-644990204-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-hosts/n-d-850468-14" status: 400 len: 199 microversion: 2.1 time: 0.044758 Aug 10 22:55:47.335061 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 72/132] 10.222.0.58 () {60 vars in 1190 bytes} [Wed Aug 10 22:55:47 2022] PUT /compute/v2.1/os-hosts/n-d-850468-14 => generated 199 bytes in 50 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 10 22:55:47.344947 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-95ca27bf-8920-4b89-b193-e1d995cb9b11 tempest-HostsAdminNegativeTestJSON-644990204 tempest-HostsAdminNegativeTestJSON-644990204-project-admin] Action: 'update', calling method: .version_select at 0x7f847deeeee0>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:55:47.349427 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-95ca27bf-8920-4b89-b193-e1d995cb9b11 tempest-HostsAdminNegativeTestJSON-644990204 tempest-HostsAdminNegativeTestJSON-644990204-project-admin] Request method failure captured: Aug 10 22:55:47.349427 n-d-850468-14 devstack@n-api.service[122632]: request: PUT /compute/v2.1/os-hosts/n-d-850468-14 HTTP/1.1 Aug 10 22:55:47.349427 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 22:55:47.349427 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 22:55:47.349427 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 22:55:47.349427 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 51 Aug 10 22:55:47.349427 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 22:55:47.349427 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 22:55:47.349427 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 22:55:47.349427 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 22:55:47.349427 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9Ddw3Hk7XsLqPjXqP9i2RILW6csrlBLxKme5I8Inu8thyEIhbpxTNuUDmQn6cEdlRC2z8DKCtRK1h6BXCKJKLHmj05LY_Sreq31uUkywiIHoJ1RG7QQRQGzFHBC6g_AgZR7KQLziEULqFfiRu3ZTvgIg3WrQKzp1KvgjZeeyk4T2ukQ Aug 10 22:55:47.349427 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 22:55:47.349427 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 22:55:47.349427 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 22:55:47.349427 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 22:55:47.349427 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 22:55:47.349427 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 22:55:47.349427 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 4535c97acd1d40bbaafd11a58888c29c Aug 10 22:55:47.349427 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-644990204 Aug 10 22:55:47.349427 n-d-850468-14 devstack@n-api.service[122632]: X-Role: admin,member,reader Aug 10 22:55:47.349427 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: admin,member,reader Aug 10 22:55:47.350623 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4535c97acd1d40bbaafd11a58888c29c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4535c97acd1d40bbaafd11a58888c29c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/4535c97acd1d40bbaafd11a58888c29c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_4535c97acd1d40bbaafd11a58888c29c", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 22:55:47.350623 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-HostsAdminNegativeTestJSON-644990204 Aug 10 22:55:47.350623 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 4535c97acd1d40bbaafd11a58888c29c Aug 10 22:55:47.350623 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-644990204 Aug 10 22:55:47.350623 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-HostsAdminNegativeTestJSON-644990204-project-admin Aug 10 22:55:47.350623 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 22:55:47.350623 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 22:55:47.350623 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: 5ea13468e1d64f0ab65e6b8a3479b91c Aug 10 22:55:47.350623 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-HostsAdminNegativeTestJSON-644990204-project-admin Aug 10 22:55:47.350623 n-d-850468-14 devstack@n-api.service[122632]: Aug 10 22:55:47.350623 n-d-850468-14 devstack@n-api.service[122632]: {"status": "invalid", "maintenance_mode": "enable"} Aug 10 22:55:47.350623 n-d-850468-14 devstack@n-api.service[122632]: method: Aug 10 22:55:47.350623 n-d-850468-14 devstack@n-api.service[122632]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 10 22:55:47.351389 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': 'n-d-850468-14', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Aug 10 22:55:47.351389 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 22:55:47.351389 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:55:47.351389 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 10 22:55:47.351389 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 10 22:55:47.351389 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 10 22:55:47.351389 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise error Aug 10 22:55:47.351389 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 10 22:55:47.351389 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:55:47.351389 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Aug 10 22:55:47.351389 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Aug 10 22:55:47.351389 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi 'disable', Aug 10 22:55:47.351389 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi 'Enable', Aug 10 22:55:47.351389 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi 'Disable', Aug 10 22:55:47.351389 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi 'ENABLE', Aug 10 22:55:47.351389 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi 'DISABLE'], Aug 10 22:55:47.351389 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi 'type': 'string'} Aug 10 22:55:47.351389 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:55:47.351389 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi On instance: Aug 10 22:55:47.351389 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi 'invalid' Aug 10 22:55:47.351389 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:55:47.351389 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:55:47.351389 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:55:47.351389 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:55:47.351389 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:55:47.352555 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:55:47.352555 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 22:55:47.352555 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 22:55:47.352555 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 22:55:47.352555 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 22:55:47.352555 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 22:55:47.352555 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 22:55:47.352555 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 10 22:55:47.352555 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 10 22:55:47.352555 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 10 22:55:47.352555 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 10 22:55:47.352555 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 10 22:55:47.352555 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 10 22:55:47.352555 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 10 22:55:47.352555 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:55:47.352555 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:55:47.352555 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:55:47.352555 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:55:47.352555 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:55:47.353486 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:55:47.353486 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 10 22:55:47.353486 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 10 22:55:47.353486 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 10 22:55:47.353486 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:55:47.361320 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-95ca27bf-8920-4b89-b193-e1d995cb9b11 tempest-HostsAdminNegativeTestJSON-644990204 tempest-HostsAdminNegativeTestJSON-644990204-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 22:55:47.365046 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-95ca27bf-8920-4b89-b193-e1d995cb9b11 tempest-HostsAdminNegativeTestJSON-644990204 tempest-HostsAdminNegativeTestJSON-644990204-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-hosts/n-d-850468-14" status: 400 len: 189 microversion: 2.1 time: 0.024566 Aug 10 22:55:47.374658 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 73/133] 10.222.0.58 () {60 vars in 1190 bytes} [Wed Aug 10 22:55:47 2022] PUT /compute/v2.1/os-hosts/n-d-850468-14 => generated 189 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 10 22:55:47.387181 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-65a74655-d058-4531-a3eb-3b0d3b651172 tempest-HostsAdminNegativeTestJSON-536073032 tempest-HostsAdminNegativeTestJSON-536073032-project] Action: 'update', calling method: .version_select at 0x7f847ded5550>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:55:47.393939 n-d-850468-14 devstack@n-api.service[122632]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:55:47.393939 n-d-850468-14 devstack@n-api.service[122632]: warnings.warn(msg) Aug 10 22:55:47.396905 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-65a74655-d058-4531-a3eb-3b0d3b651172 tempest-HostsAdminNegativeTestJSON-536073032 tempest-HostsAdminNegativeTestJSON-536073032-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': '08bdcbf86eeb481a9852cfcdb8904f9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41448baa694d402a859e1fca25ae9fc6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:55:47.402970 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-65a74655-d058-4531-a3eb-3b0d3b651172 tempest-HostsAdminNegativeTestJSON-536073032 tempest-HostsAdminNegativeTestJSON-536073032-project] Request method failure captured: Aug 10 22:55:47.402970 n-d-850468-14 devstack@n-api.service[122632]: request: PUT /compute/v2.1/os-hosts/n-d-850468-14 HTTP/1.1 Aug 10 22:55:47.402970 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 22:55:47.402970 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 22:55:47.402970 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 22:55:47.402970 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 50 Aug 10 22:55:47.402970 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 22:55:47.402970 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 22:55:47.402970 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 22:55:47.402970 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 22:55:47.402970 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9DdqsN1jYjN7UDcf1AG9d86o_tc1NbbTzb-IKOLPsanIWV52yu59eTnUduq8PPHFvhlQ6aXU6Z-Y12hDH3BQhSfM543EGFiFpi91HXqYOQtAZuW-2Powm1ZoHOU7GUXQCj-QBToh64y88KJPJ9ZVDgUm5NDHiZCBXz_BYCYaG1DDWNw Aug 10 22:55:47.402970 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 22:55:47.402970 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 22:55:47.402970 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 22:55:47.402970 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 22:55:47.402970 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 22:55:47.402970 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 22:55:47.402970 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 41448baa694d402a859e1fca25ae9fc6 Aug 10 22:55:47.402970 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-536073032 Aug 10 22:55:47.402970 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 22:55:47.402970 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 22:55:47.404153 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/41448baa694d402a859e1fca25ae9fc6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/41448baa694d402a859e1fca25ae9fc6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/41448baa694d402a859e1fca25ae9fc6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_41448baa694d402a859e1fca25ae9fc6", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 22:55:47.404153 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-HostsAdminNegativeTestJSON-536073032 Aug 10 22:55:47.404153 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 41448baa694d402a859e1fca25ae9fc6 Aug 10 22:55:47.404153 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-536073032 Aug 10 22:55:47.404153 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-HostsAdminNegativeTestJSON-536073032-project Aug 10 22:55:47.404153 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 22:55:47.404153 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 22:55:47.404153 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: 08bdcbf86eeb481a9852cfcdb8904f9f Aug 10 22:55:47.404153 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-HostsAdminNegativeTestJSON-536073032-project Aug 10 22:55:47.404153 n-d-850468-14 devstack@n-api.service[122632]: Aug 10 22:55:47.404153 n-d-850468-14 devstack@n-api.service[122632]: {"status": "enable", "maintenance_mode": "enable"} Aug 10 22:55:47.404153 n-d-850468-14 devstack@n-api.service[122632]: method: Aug 10 22:55:47.404153 n-d-850468-14 devstack@n-api.service[122632]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Aug 10 22:55:47.404153 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': 'n-d-850468-14', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Aug 10 22:55:47.404836 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 22:55:47.404836 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:55:47.404836 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:55:47.404836 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:55:47.404836 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 22:55:47.404836 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 22:55:47.404836 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 22:55:47.404836 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 22:55:47.404836 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 22:55:47.404836 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 22:55:47.404836 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 22:55:47.404836 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 22:55:47.404836 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Aug 10 22:55:47.404836 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Aug 10 22:55:47.404836 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 10 22:55:47.404836 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 10 22:55:47.404836 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 10 22:55:47.404836 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 10 22:55:47.404836 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 10 22:55:47.404836 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 10 22:55:47.405794 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 10 22:55:47.405794 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise self.value Aug 10 22:55:47.405794 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 10 22:55:47.405794 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 10 22:55:47.405794 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 10 22:55:47.405794 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 10 22:55:47.405794 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 10 22:55:47.405794 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 10 22:55:47.405794 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Aug 10 22:55:47.405794 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:55:47.405794 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:55:47.405794 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:55:47.405794 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:55:47.405794 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:55:47.405794 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:55:47.405794 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 10 22:55:47.405794 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 10 22:55:47.405794 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Aug 10 22:55:47.405794 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:55:47.406736 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-65a74655-d058-4531-a3eb-3b0d3b651172 tempest-HostsAdminNegativeTestJSON-536073032 tempest-HostsAdminNegativeTestJSON-536073032-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 22:55:47.408651 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-65a74655-d058-4531-a3eb-3b0d3b651172 tempest-HostsAdminNegativeTestJSON-536073032 tempest-HostsAdminNegativeTestJSON-536073032-project] 10.222.0.58 "PUT /compute/v2.1/os-hosts/n-d-850468-14" status: 403 len: 111 microversion: 2.1 time: 0.030374 Aug 10 22:55:47.415416 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 74/134] 10.222.0.58 () {60 vars in 1190 bytes} [Wed Aug 10 22:55:47 2022] PUT /compute/v2.1/os-hosts/n-d-850468-14 => generated 111 bytes in 39 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 10 22:55:47.430525 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-9004de24-f8c8-47ba-880b-b549b35f4c0e tempest-HostsAdminNegativeTestJSON-644990204 tempest-HostsAdminNegativeTestJSON-644990204-project-admin] Action: 'update', calling method: .version_select at 0x7f847e041ee0>, body: {"status": null, "maintenance_mode": null} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:55:47.450840 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-9004de24-f8c8-47ba-880b-b549b35f4c0e tempest-HostsAdminNegativeTestJSON-644990204 tempest-HostsAdminNegativeTestJSON-644990204-project-admin] Request method failure captured: Aug 10 22:55:47.450840 n-d-850468-14 devstack@n-api.service[122632]: request: PUT /compute/v2.1/os-hosts/n-d-850468-14 HTTP/1.1 Aug 10 22:55:47.450840 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 22:55:47.450840 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 22:55:47.450840 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 22:55:47.450840 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 42 Aug 10 22:55:47.450840 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 22:55:47.450840 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 22:55:47.450840 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 22:55:47.450840 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 22:55:47.450840 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9Ddw3Hk7XsLqPjXqP9i2RILW6csrlBLxKme5I8Inu8thyEIhbpxTNuUDmQn6cEdlRC2z8DKCtRK1h6BXCKJKLHmj05LY_Sreq31uUkywiIHoJ1RG7QQRQGzFHBC6g_AgZR7KQLziEULqFfiRu3ZTvgIg3WrQKzp1KvgjZeeyk4T2ukQ Aug 10 22:55:47.450840 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 22:55:47.450840 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 22:55:47.450840 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 22:55:47.450840 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 22:55:47.450840 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 22:55:47.450840 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 22:55:47.450840 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 4535c97acd1d40bbaafd11a58888c29c Aug 10 22:55:47.450840 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-644990204 Aug 10 22:55:47.450840 n-d-850468-14 devstack@n-api.service[122632]: X-Role: admin,member,reader Aug 10 22:55:47.450840 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: admin,member,reader Aug 10 22:55:47.452169 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4535c97acd1d40bbaafd11a58888c29c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4535c97acd1d40bbaafd11a58888c29c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/4535c97acd1d40bbaafd11a58888c29c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_4535c97acd1d40bbaafd11a58888c29c", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 22:55:47.452169 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-HostsAdminNegativeTestJSON-644990204 Aug 10 22:55:47.452169 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 4535c97acd1d40bbaafd11a58888c29c Aug 10 22:55:47.452169 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-644990204 Aug 10 22:55:47.452169 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-HostsAdminNegativeTestJSON-644990204-project-admin Aug 10 22:55:47.452169 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 22:55:47.452169 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 22:55:47.452169 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: 5ea13468e1d64f0ab65e6b8a3479b91c Aug 10 22:55:47.452169 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-HostsAdminNegativeTestJSON-644990204-project-admin Aug 10 22:55:47.452169 n-d-850468-14 devstack@n-api.service[122632]: Aug 10 22:55:47.452169 n-d-850468-14 devstack@n-api.service[122632]: {"status": null, "maintenance_mode": null} Aug 10 22:55:47.452169 n-d-850468-14 devstack@n-api.service[122632]: method: Aug 10 22:55:47.452169 n-d-850468-14 devstack@n-api.service[122632]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Aug 10 22:55:47.452169 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': 'n-d-850468-14', 'body': {'status': None, 'maintenance_mode': None}} Aug 10 22:55:47.453082 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 22:55:47.453082 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:55:47.453082 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 10 22:55:47.453082 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 10 22:55:47.453082 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 10 22:55:47.453082 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise error Aug 10 22:55:47.453082 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Aug 10 22:55:47.453082 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:55:47.453082 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Aug 10 22:55:47.453082 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Aug 10 22:55:47.453082 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi 'disable', Aug 10 22:55:47.453082 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi 'Enable', Aug 10 22:55:47.453082 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi 'Disable', Aug 10 22:55:47.453082 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi 'ENABLE', Aug 10 22:55:47.453082 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi 'DISABLE'], Aug 10 22:55:47.453082 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi 'type': 'string'} Aug 10 22:55:47.453082 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:55:47.453082 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi On instance: Aug 10 22:55:47.453082 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi None Aug 10 22:55:47.453082 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:55:47.453082 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:55:47.453082 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:55:47.453082 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:55:47.453082 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:55:47.453082 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:55:47.454536 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 22:55:47.454536 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 22:55:47.454536 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 22:55:47.454536 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 22:55:47.454536 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 22:55:47.454536 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 22:55:47.454536 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 10 22:55:47.454536 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 10 22:55:47.454536 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 10 22:55:47.454536 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 10 22:55:47.454536 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 10 22:55:47.454536 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 10 22:55:47.454536 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Aug 10 22:55:47.454536 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:55:47.454536 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:55:47.454536 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:55:47.454536 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:55:47.454536 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:55:47.454536 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:55:47.456481 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 10 22:55:47.456481 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 10 22:55:47.456481 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Aug 10 22:55:47.456481 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:55:47.459397 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-9004de24-f8c8-47ba-880b-b549b35f4c0e tempest-HostsAdminNegativeTestJSON-644990204 tempest-HostsAdminNegativeTestJSON-644990204-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 22:55:47.467356 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-9004de24-f8c8-47ba-880b-b549b35f4c0e tempest-HostsAdminNegativeTestJSON-644990204 tempest-HostsAdminNegativeTestJSON-644990204-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-hosts/n-d-850468-14" status: 400 len: 127 microversion: 2.1 time: 0.045753 Aug 10 22:55:47.474725 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 75/135] 10.222.0.58 () {60 vars in 1190 bytes} [Wed Aug 10 22:55:47 2022] PUT /compute/v2.1/os-hosts/n-d-850468-14 => generated 127 bytes in 59 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 10 22:55:47.483255 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-34601dc6-2565-4ad1-9c43-b3130c4eb9f3 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd644627ab14e55803c1d5981b9859a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a37b95a10245b796d26c1b35036827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:55:47.491573 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-4306138c-c1b8-467e-bb94-3d5e4ea9ab06 tempest-HostsAdminNegativeTestJSON-644990204 tempest-HostsAdminNegativeTestJSON-644990204-project-admin] Action: 'update', calling method: .version_select at 0x7f847e02bb80>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:55:47.496789 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-34601dc6-2565-4ad1-9c43-b3130c4eb9f3 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] 10.222.0.58 "GET /compute/v2.1/servers/155e0037-0bdb-4a93-af44-de6903bc2891" status: 200 len: 1339 microversion: 2.1 time: 0.580289 Aug 10 22:55:47.502962 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 61/136] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:55:46 2022] GET /compute/v2.1/servers/155e0037-0bdb-4a93-af44-de6903bc2891 => generated 1339 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:55:47.503387 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.hosts [None req-4306138c-c1b8-467e-bb94-3d5e4ea9ab06 tempest-HostsAdminNegativeTestJSON-644990204 tempest-HostsAdminNegativeTestJSON-644990204-project-admin] Enabling host nonexistent_hostname. Aug 10 22:55:47.525972 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-4306138c-c1b8-467e-bb94-3d5e4ea9ab06 tempest-HostsAdminNegativeTestJSON-644990204 tempest-HostsAdminNegativeTestJSON-644990204-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 10 22:55:47.530606 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-4306138c-c1b8-467e-bb94-3d5e4ea9ab06 tempest-HostsAdminNegativeTestJSON-644990204 tempest-HostsAdminNegativeTestJSON-644990204-project-admin] Request method failure captured: Aug 10 22:55:47.530606 n-d-850468-14 devstack@n-api.service[122632]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Aug 10 22:55:47.530606 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 22:55:47.530606 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 22:55:47.530606 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 22:55:47.530606 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 50 Aug 10 22:55:47.530606 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 22:55:47.530606 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 22:55:47.530606 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 22:55:47.530606 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 22:55:47.530606 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9Ddw3Hk7XsLqPjXqP9i2RILW6csrlBLxKme5I8Inu8thyEIhbpxTNuUDmQn6cEdlRC2z8DKCtRK1h6BXCKJKLHmj05LY_Sreq31uUkywiIHoJ1RG7QQRQGzFHBC6g_AgZR7KQLziEULqFfiRu3ZTvgIg3WrQKzp1KvgjZeeyk4T2ukQ Aug 10 22:55:47.530606 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 22:55:47.530606 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 22:55:47.530606 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 22:55:47.530606 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 22:55:47.530606 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 22:55:47.530606 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 22:55:47.530606 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 4535c97acd1d40bbaafd11a58888c29c Aug 10 22:55:47.530606 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-644990204 Aug 10 22:55:47.530606 n-d-850468-14 devstack@n-api.service[122632]: X-Role: admin,member,reader Aug 10 22:55:47.530606 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: admin,member,reader Aug 10 22:55:47.533656 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4535c97acd1d40bbaafd11a58888c29c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/4535c97acd1d40bbaafd11a58888c29c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/4535c97acd1d40bbaafd11a58888c29c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_4535c97acd1d40bbaafd11a58888c29c", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 22:55:47.533656 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-HostsAdminNegativeTestJSON-644990204 Aug 10 22:55:47.533656 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 4535c97acd1d40bbaafd11a58888c29c Aug 10 22:55:47.533656 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-644990204 Aug 10 22:55:47.533656 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-HostsAdminNegativeTestJSON-644990204-project-admin Aug 10 22:55:47.533656 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 22:55:47.533656 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 22:55:47.533656 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: 5ea13468e1d64f0ab65e6b8a3479b91c Aug 10 22:55:47.533656 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-HostsAdminNegativeTestJSON-644990204-project-admin Aug 10 22:55:47.533656 n-d-850468-14 devstack@n-api.service[122632]: Aug 10 22:55:47.533656 n-d-850468-14 devstack@n-api.service[122632]: {"status": "enable", "maintenance_mode": "enable"} Aug 10 22:55:47.533656 n-d-850468-14 devstack@n-api.service[122632]: method: Aug 10 22:55:47.533656 n-d-850468-14 devstack@n-api.service[122632]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 10 22:55:47.533656 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Aug 10 22:55:47.534503 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 22:55:47.534503 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:55:47.534503 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Aug 10 22:55:47.534503 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Aug 10 22:55:47.534503 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 10 22:55:47.534503 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 10 22:55:47.534503 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 10 22:55:47.534503 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 10 22:55:47.534503 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 10 22:55:47.534503 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise self.value Aug 10 22:55:47.534503 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 10 22:55:47.534503 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 10 22:55:47.534503 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5953, in targeted Aug 10 22:55:47.534503 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Aug 10 22:55:47.534503 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 10 22:55:47.534503 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 10 22:55:47.534503 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 10 22:55:47.534503 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 10 22:55:47.535914 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 10 22:55:47.535914 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 10 22:55:47.535914 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 10 22:55:47.535914 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 10 22:55:47.535914 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 10 22:55:47.535914 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:55:47.535914 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:55:47.535914 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:55:47.535914 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:55:47.535914 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:55:47.535914 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:55:47.535914 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 22:55:47.535914 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 22:55:47.535914 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 22:55:47.535914 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 22:55:47.535914 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 22:55:47.535914 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 22:55:47.535914 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 22:55:47.535914 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 22:55:47.535914 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Aug 10 22:55:47.537853 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Aug 10 22:55:47.537853 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Aug 10 22:55:47.537853 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 10 22:55:47.537853 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 10 22:55:47.537853 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:55:47.537853 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:55:47.537853 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:55:47.537853 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:55:47.537853 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:55:47.537853 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:55:47.537853 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 22:55:47.537853 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 22:55:47.537853 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 10 22:55:47.537853 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:55:47.537853 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-4306138c-c1b8-467e-bb94-3d5e4ea9ab06 tempest-HostsAdminNegativeTestJSON-644990204 tempest-HostsAdminNegativeTestJSON-644990204-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 22:55:47.542122 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-4306138c-c1b8-467e-bb94-3d5e4ea9ab06 tempest-HostsAdminNegativeTestJSON-644990204 tempest-HostsAdminNegativeTestJSON-644990204-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.058975 Aug 10 22:55:47.547917 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 76/137] 10.222.0.58 () {60 vars in 1211 bytes} [Wed Aug 10 22:55:47 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 10 22:55:47.633413 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-fe91b4fc-eeb0-4e8b-9961-15f9e24cb7af tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:47.635371 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-fe91b4fc-eeb0-4e8b-9961-15f9e24cb7af tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] [instance: 37093f4d-0663-4b69-a48f-5fd757acd9c0] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:55:47.815739 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-fe91b4fc-eeb0-4e8b-9961-15f9e24cb7af tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64648d3c6f5c423e83ff023e7bf6550a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434532ba922f406d8d8c197d3a57ffc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:55:47.833070 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-fe91b4fc-eeb0-4e8b-9961-15f9e24cb7af tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] 10.222.0.58 "GET /compute/v2.1/servers/37093f4d-0663-4b69-a48f-5fd757acd9c0" status: 200 len: 1220 microversion: 2.1 time: 0.205615 Aug 10 22:55:47.836897 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 62/138] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:55:47 2022] GET /compute/v2.1/servers/37093f4d-0663-4b69-a48f-5fd757acd9c0 => generated 1220 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:55:48.473663 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-f10191ca-2e4e-405b-adff-7121e4b7f397 req-4ba1432a-afa7-4a55-8450-81bf1e2700d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "155e0037-0bdb-4a93-af44-de6903bc2891", "tag": "d7b21e9c-cec7-4ec0-be49-df050e213b01"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:55:48.519659 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-f10191ca-2e4e-405b-adff-7121e4b7f397 req-4ba1432a-afa7-4a55-8450-81bf1e2700d7 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:48.520695 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-f10191ca-2e4e-405b-adff-7121e4b7f397 req-4ba1432a-afa7-4a55-8450-81bf1e2700d7 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:48.522430 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-947a4d3b-b1f0-4fed-91da-6690f0c55e55 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:48.523624 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-f10191ca-2e4e-405b-adff-7121e4b7f397 req-4ba1432a-afa7-4a55-8450-81bf1e2700d7 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:48.523980 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-947a4d3b-b1f0-4fed-91da-6690f0c55e55 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] [instance: 155e0037-0bdb-4a93-af44-de6903bc2891] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:55:48.541168 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-947a4d3b-b1f0-4fed-91da-6690f0c55e55 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:48.551046 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-947a4d3b-b1f0-4fed-91da-6690f0c55e55 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:48.552035 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-947a4d3b-b1f0-4fed-91da-6690f0c55e55 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:48.559236 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-947a4d3b-b1f0-4fed-91da-6690f0c55e55 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:48.560200 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-947a4d3b-b1f0-4fed-91da-6690f0c55e55 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:48.562401 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-947a4d3b-b1f0-4fed-91da-6690f0c55e55 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:48.573216 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-f10191ca-2e4e-405b-adff-7121e4b7f397 req-4ba1432a-afa7-4a55-8450-81bf1e2700d7 service nova] Creating event network-changed:d7b21e9c-cec7-4ec0-be49-df050e213b01 for instance 155e0037-0bdb-4a93-af44-de6903bc2891 on n-h1-850468-14 Aug 10 22:55:48.586450 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-f10191ca-2e4e-405b-adff-7121e4b7f397 req-4ba1432a-afa7-4a55-8450-81bf1e2700d7 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=122632) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 10 22:55:48.586893 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-f10191ca-2e4e-405b-adff-7121e4b7f397 req-4ba1432a-afa7-4a55-8450-81bf1e2700d7 service nova] Acquired lock "compute-rpcapi-router" {{(pid=122632) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 10 22:55:48.588015 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8c5b6677-2e5b-4d06-8e39-ccbd0615e777 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:48.588483 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8c5b6677-2e5b-4d06-8e39-ccbd0615e777 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:48.589156 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8c5b6677-2e5b-4d06-8e39-ccbd0615e777 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:48.589639 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8c5b6677-2e5b-4d06-8e39-ccbd0615e777 None None] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:48.590091 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8c5b6677-2e5b-4d06-8e39-ccbd0615e777 None None] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:48.590515 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8c5b6677-2e5b-4d06-8e39-ccbd0615e777 None None] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:48.659549 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.compute.rpcapi [None req-8c5b6677-2e5b-4d06-8e39-ccbd0615e777 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 10 22:55:48.662363 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8c5b6677-2e5b-4d06-8e39-ccbd0615e777 None None] Releasing lock "compute-rpcapi-router" {{(pid=122632) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 10 22:55:48.734438 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-8c5b6677-2e5b-4d06-8e39-ccbd0615e777 None None] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.020183 Aug 10 22:55:48.735593 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 77/139] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 22:55:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 22:55:48.862142 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-4ba03a0d-1cb3-48fa-85cc-2a881f582888 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:48.873711 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-4ba03a0d-1cb3-48fa-85cc-2a881f582888 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] [instance: 37093f4d-0663-4b69-a48f-5fd757acd9c0] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:55:48.907553 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4ba03a0d-1cb3-48fa-85cc-2a881f582888 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:48.908770 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4ba03a0d-1cb3-48fa-85cc-2a881f582888 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:48.909851 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4ba03a0d-1cb3-48fa-85cc-2a881f582888 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:48.912574 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4ba03a0d-1cb3-48fa-85cc-2a881f582888 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:48.912889 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4ba03a0d-1cb3-48fa-85cc-2a881f582888 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:48.913321 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4ba03a0d-1cb3-48fa-85cc-2a881f582888 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:49.082344 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-947a4d3b-b1f0-4fed-91da-6690f0c55e55 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd644627ab14e55803c1d5981b9859a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a37b95a10245b796d26c1b35036827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:55:49.095218 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-947a4d3b-b1f0-4fed-91da-6690f0c55e55 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] 10.222.0.58 "GET /compute/v2.1/servers/155e0037-0bdb-4a93-af44-de6903bc2891" status: 200 len: 1339 microversion: 2.1 time: 0.577459 Aug 10 22:55:49.096399 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 63/140] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:55:48 2022] GET /compute/v2.1/servers/155e0037-0bdb-4a93-af44-de6903bc2891 => generated 1339 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:55:49.175025 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-4ba03a0d-1cb3-48fa-85cc-2a881f582888 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64648d3c6f5c423e83ff023e7bf6550a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434532ba922f406d8d8c197d3a57ffc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:55:49.190500 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-4ba03a0d-1cb3-48fa-85cc-2a881f582888 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] 10.222.0.58 "GET /compute/v2.1/servers/37093f4d-0663-4b69-a48f-5fd757acd9c0" status: 200 len: 1216 microversion: 2.1 time: 0.335079 Aug 10 22:55:49.207085 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 78/141] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:55:48 2022] GET /compute/v2.1/servers/37093f4d-0663-4b69-a48f-5fd757acd9c0 => generated 1216 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:55:50.119968 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-0e089827-1469-478f-8d10-4fa8cd4bb95d tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:50.122528 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-0e089827-1469-478f-8d10-4fa8cd4bb95d tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] [instance: 155e0037-0bdb-4a93-af44-de6903bc2891] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:55:50.133614 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0e089827-1469-478f-8d10-4fa8cd4bb95d tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:50.143229 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0e089827-1469-478f-8d10-4fa8cd4bb95d tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:50.144362 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0e089827-1469-478f-8d10-4fa8cd4bb95d tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:50.146905 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0e089827-1469-478f-8d10-4fa8cd4bb95d tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:50.149156 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0e089827-1469-478f-8d10-4fa8cd4bb95d tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:50.150651 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0e089827-1469-478f-8d10-4fa8cd4bb95d tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:50.217065 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-cb085478-2508-431d-a737-e0438888f95b tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:50.217750 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-cb085478-2508-431d-a737-e0438888f95b tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] [instance: 37093f4d-0663-4b69-a48f-5fd757acd9c0] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:55:50.238657 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cb085478-2508-431d-a737-e0438888f95b tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:50.239479 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cb085478-2508-431d-a737-e0438888f95b tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:50.240155 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cb085478-2508-431d-a737-e0438888f95b tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:50.241175 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cb085478-2508-431d-a737-e0438888f95b tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:50.243195 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cb085478-2508-431d-a737-e0438888f95b tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:50.245100 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cb085478-2508-431d-a737-e0438888f95b tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:50.542190 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-cb085478-2508-431d-a737-e0438888f95b tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64648d3c6f5c423e83ff023e7bf6550a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434532ba922f406d8d8c197d3a57ffc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:55:50.562910 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-cb085478-2508-431d-a737-e0438888f95b tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] 10.222.0.58 "GET /compute/v2.1/servers/37093f4d-0663-4b69-a48f-5fd757acd9c0" status: 200 len: 1278 microversion: 2.1 time: 0.352127 Aug 10 22:55:50.575531 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 79/142] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:55:50 2022] GET /compute/v2.1/servers/37093f4d-0663-4b69-a48f-5fd757acd9c0 => generated 1278 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:55:51.175314 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-0e089827-1469-478f-8d10-4fa8cd4bb95d tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd644627ab14e55803c1d5981b9859a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a37b95a10245b796d26c1b35036827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:55:51.185456 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-0e089827-1469-478f-8d10-4fa8cd4bb95d tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] 10.222.0.58 "GET /compute/v2.1/servers/155e0037-0bdb-4a93-af44-de6903bc2891" status: 200 len: 1339 microversion: 2.1 time: 1.069711 Aug 10 22:55:51.186140 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 64/143] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:55:50 2022] GET /compute/v2.1/servers/155e0037-0bdb-4a93-af44-de6903bc2891 => generated 1339 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:55:51.591984 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-cc5c9c0f-8d76-4385-a714-13dc472a31bc tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:51.592582 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-cc5c9c0f-8d76-4385-a714-13dc472a31bc tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] [instance: 37093f4d-0663-4b69-a48f-5fd757acd9c0] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:55:51.600788 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cc5c9c0f-8d76-4385-a714-13dc472a31bc tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:51.601268 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cc5c9c0f-8d76-4385-a714-13dc472a31bc tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:51.601695 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cc5c9c0f-8d76-4385-a714-13dc472a31bc tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:51.602927 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cc5c9c0f-8d76-4385-a714-13dc472a31bc tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:51.606930 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cc5c9c0f-8d76-4385-a714-13dc472a31bc tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:51.606930 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cc5c9c0f-8d76-4385-a714-13dc472a31bc tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:51.740367 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-cc5c9c0f-8d76-4385-a714-13dc472a31bc tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64648d3c6f5c423e83ff023e7bf6550a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434532ba922f406d8d8c197d3a57ffc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:55:51.750279 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-cc5c9c0f-8d76-4385-a714-13dc472a31bc tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] 10.222.0.58 "GET /compute/v2.1/servers/37093f4d-0663-4b69-a48f-5fd757acd9c0" status: 200 len: 1278 microversion: 2.1 time: 0.162310 Aug 10 22:55:51.751405 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 80/144] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:55:51 2022] GET /compute/v2.1/servers/37093f4d-0663-4b69-a48f-5fd757acd9c0 => generated 1278 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:55:51.817511 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-0e089827-1469-478f-8d10-4fa8cd4bb95d tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:51.818848 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-0e089827-1469-478f-8d10-4fa8cd4bb95d tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] 10.222.0.58 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001971 Aug 10 22:55:51.819656 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 65/145] 10.222.0.58 () {56 vars in 886 bytes} [Wed Aug 10 22:55:51 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 10 22:55:52.211551 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-9bdf4355-ca0a-49ab-8f2c-36653c912d05 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:52.212486 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-9bdf4355-ca0a-49ab-8f2c-36653c912d05 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] [instance: 155e0037-0bdb-4a93-af44-de6903bc2891] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:55:52.221000 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9bdf4355-ca0a-49ab-8f2c-36653c912d05 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:52.221481 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9bdf4355-ca0a-49ab-8f2c-36653c912d05 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:52.221927 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9bdf4355-ca0a-49ab-8f2c-36653c912d05 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:52.222603 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9bdf4355-ca0a-49ab-8f2c-36653c912d05 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:52.240064 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9bdf4355-ca0a-49ab-8f2c-36653c912d05 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:52.242296 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9bdf4355-ca0a-49ab-8f2c-36653c912d05 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:52.773375 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-b1aeffbd-e938-4de8-a254-67e5ab6969bc tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:52.775055 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-b1aeffbd-e938-4de8-a254-67e5ab6969bc tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] [instance: 37093f4d-0663-4b69-a48f-5fd757acd9c0] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:55:52.798687 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b1aeffbd-e938-4de8-a254-67e5ab6969bc tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:52.800916 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b1aeffbd-e938-4de8-a254-67e5ab6969bc tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:52.802513 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b1aeffbd-e938-4de8-a254-67e5ab6969bc tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:52.807912 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b1aeffbd-e938-4de8-a254-67e5ab6969bc tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:52.810372 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b1aeffbd-e938-4de8-a254-67e5ab6969bc tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:52.811143 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b1aeffbd-e938-4de8-a254-67e5ab6969bc tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:53.018854 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-b1aeffbd-e938-4de8-a254-67e5ab6969bc tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64648d3c6f5c423e83ff023e7bf6550a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434532ba922f406d8d8c197d3a57ffc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:55:53.037798 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-b1aeffbd-e938-4de8-a254-67e5ab6969bc tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] 10.222.0.58 "GET /compute/v2.1/servers/37093f4d-0663-4b69-a48f-5fd757acd9c0" status: 200 len: 1278 microversion: 2.1 time: 0.267273 Aug 10 22:55:53.039261 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 66/146] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:55:52 2022] GET /compute/v2.1/servers/37093f4d-0663-4b69-a48f-5fd757acd9c0 => generated 1278 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:55:53.161300 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-9bdf4355-ca0a-49ab-8f2c-36653c912d05 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd644627ab14e55803c1d5981b9859a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a37b95a10245b796d26c1b35036827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:55:53.173189 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-9bdf4355-ca0a-49ab-8f2c-36653c912d05 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] 10.222.0.58 "GET /compute/v2.1/servers/155e0037-0bdb-4a93-af44-de6903bc2891" status: 200 len: 1339 microversion: 2.1 time: 0.965682 Aug 10 22:55:53.187027 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 81/147] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:55:52 2022] GET /compute/v2.1/servers/155e0037-0bdb-4a93-af44-de6903bc2891 => generated 1339 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:55:54.063383 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-1aa3a69e-d40e-4da3-870e-04bd3b6b76fe tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:54.064653 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-1aa3a69e-d40e-4da3-870e-04bd3b6b76fe tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] [instance: 37093f4d-0663-4b69-a48f-5fd757acd9c0] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:55:54.094254 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1aa3a69e-d40e-4da3-870e-04bd3b6b76fe tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:54.099658 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1aa3a69e-d40e-4da3-870e-04bd3b6b76fe tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:54.101821 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1aa3a69e-d40e-4da3-870e-04bd3b6b76fe tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:54.105951 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1aa3a69e-d40e-4da3-870e-04bd3b6b76fe tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:54.112280 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1aa3a69e-d40e-4da3-870e-04bd3b6b76fe tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:54.117412 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1aa3a69e-d40e-4da3-870e-04bd3b6b76fe tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:54.207431 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-7b107925-f37d-4e11-8ff5-01c4c26fc643 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:54.209376 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-7b107925-f37d-4e11-8ff5-01c4c26fc643 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] [instance: 155e0037-0bdb-4a93-af44-de6903bc2891] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:55:54.228389 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7b107925-f37d-4e11-8ff5-01c4c26fc643 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:54.240421 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7b107925-f37d-4e11-8ff5-01c4c26fc643 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:54.241236 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7b107925-f37d-4e11-8ff5-01c4c26fc643 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:54.246891 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7b107925-f37d-4e11-8ff5-01c4c26fc643 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:54.250171 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7b107925-f37d-4e11-8ff5-01c4c26fc643 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:54.251108 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7b107925-f37d-4e11-8ff5-01c4c26fc643 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:54.578716 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-1aa3a69e-d40e-4da3-870e-04bd3b6b76fe tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64648d3c6f5c423e83ff023e7bf6550a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434532ba922f406d8d8c197d3a57ffc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:55:54.594331 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-1aa3a69e-d40e-4da3-870e-04bd3b6b76fe tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] 10.222.0.58 "GET /compute/v2.1/servers/37093f4d-0663-4b69-a48f-5fd757acd9c0" status: 200 len: 1320 microversion: 2.1 time: 0.535418 Aug 10 22:55:54.596719 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 67/148] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:55:54 2022] GET /compute/v2.1/servers/37093f4d-0663-4b69-a48f-5fd757acd9c0 => generated 1320 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:55:54.997219 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-7b107925-f37d-4e11-8ff5-01c4c26fc643 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd644627ab14e55803c1d5981b9859a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a37b95a10245b796d26c1b35036827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:55:55.022534 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-7b107925-f37d-4e11-8ff5-01c4c26fc643 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] 10.222.0.58 "GET /compute/v2.1/servers/155e0037-0bdb-4a93-af44-de6903bc2891" status: 200 len: 1339 microversion: 2.1 time: 0.819291 Aug 10 22:55:55.029320 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 82/149] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:55:54 2022] GET /compute/v2.1/servers/155e0037-0bdb-4a93-af44-de6903bc2891 => generated 1339 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:55:55.617375 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-5b85c671-e7c3-431b-abe4-da087a788b7b tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:55.617969 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-5b85c671-e7c3-431b-abe4-da087a788b7b tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] [instance: 37093f4d-0663-4b69-a48f-5fd757acd9c0] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:55:55.632596 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5b85c671-e7c3-431b-abe4-da087a788b7b tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:55.634044 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5b85c671-e7c3-431b-abe4-da087a788b7b tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:55.634581 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5b85c671-e7c3-431b-abe4-da087a788b7b tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:55.641930 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5b85c671-e7c3-431b-abe4-da087a788b7b tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:55.643966 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5b85c671-e7c3-431b-abe4-da087a788b7b tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:55.644675 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5b85c671-e7c3-431b-abe4-da087a788b7b tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:56.019143 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-5b85c671-e7c3-431b-abe4-da087a788b7b tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64648d3c6f5c423e83ff023e7bf6550a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434532ba922f406d8d8c197d3a57ffc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:55:56.038684 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-5b85c671-e7c3-431b-abe4-da087a788b7b tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] 10.222.0.58 "GET /compute/v2.1/servers/37093f4d-0663-4b69-a48f-5fd757acd9c0" status: 200 len: 1320 microversion: 2.1 time: 0.425099 Aug 10 22:55:56.047150 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 83/150] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:55:55 2022] GET /compute/v2.1/servers/37093f4d-0663-4b69-a48f-5fd757acd9c0 => generated 1320 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:55:56.065186 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-681cc24c-293c-43ee-a9a0-777a4ed493d3 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:56.066602 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-681cc24c-293c-43ee-a9a0-777a4ed493d3 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] [instance: 155e0037-0bdb-4a93-af44-de6903bc2891] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:55:56.085769 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-681cc24c-293c-43ee-a9a0-777a4ed493d3 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:56.093546 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-681cc24c-293c-43ee-a9a0-777a4ed493d3 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:56.095373 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-681cc24c-293c-43ee-a9a0-777a4ed493d3 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:56.097591 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-681cc24c-293c-43ee-a9a0-777a4ed493d3 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:56.099431 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-681cc24c-293c-43ee-a9a0-777a4ed493d3 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:56.100322 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-62e0eae4-caa0-4702-88fa-137762e4c450 tempest-HypervisorAdminUnderV252Test-1989975869 tempest-HypervisorAdminUnderV252Test-1989975869-project-admin] Calling method '.version_select at 0x7f847dd22310>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:56.101235 n-d-850468-14 devstack@n-api.service[122633]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:55:56.101235 n-d-850468-14 devstack@n-api.service[122633]: warnings.warn(msg) Aug 10 22:55:56.103086 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-62e0eae4-caa0-4702-88fa-137762e4c450 tempest-HypervisorAdminUnderV252Test-1989975869 tempest-HypervisorAdminUnderV252Test-1989975869-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:56.104184 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-681cc24c-293c-43ee-a9a0-777a4ed493d3 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:56.106201 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-62e0eae4-caa0-4702-88fa-137762e4c450 tempest-HypervisorAdminUnderV252Test-1989975869 tempest-HypervisorAdminUnderV252Test-1989975869-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:56.106718 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-62e0eae4-caa0-4702-88fa-137762e4c450 tempest-HypervisorAdminUnderV252Test-1989975869 tempest-HypervisorAdminUnderV252Test-1989975869-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:56.124418 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=2 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:55:56.189532 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-62e0eae4-caa0-4702-88fa-137762e4c450 tempest-HypervisorAdminUnderV252Test-1989975869 tempest-HypervisorAdminUnderV252Test-1989975869-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:56.190116 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-62e0eae4-caa0-4702-88fa-137762e4c450 tempest-HypervisorAdminUnderV252Test-1989975869 tempest-HypervisorAdminUnderV252Test-1989975869-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:56.190576 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-62e0eae4-caa0-4702-88fa-137762e4c450 tempest-HypervisorAdminUnderV252Test-1989975869 tempest-HypervisorAdminUnderV252Test-1989975869-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:56.254530 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-62e0eae4-caa0-4702-88fa-137762e4c450 tempest-HypervisorAdminUnderV252Test-1989975869 tempest-HypervisorAdminUnderV252Test-1989975869-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:56.260485 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-62e0eae4-caa0-4702-88fa-137762e4c450 tempest-HypervisorAdminUnderV252Test-1989975869 tempest-HypervisorAdminUnderV252Test-1989975869-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:56.261026 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-62e0eae4-caa0-4702-88fa-137762e4c450 tempest-HypervisorAdminUnderV252Test-1989975869 tempest-HypervisorAdminUnderV252Test-1989975869-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:56.289026 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=77 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:55:56.298135 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-62e0eae4-caa0-4702-88fa-137762e4c450 tempest-HypervisorAdminUnderV252Test-1989975869 tempest-HypervisorAdminUnderV252Test-1989975869-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.760229 Aug 10 22:55:56.303689 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 68/151] 10.222.0.58 () {58 vars in 1146 bytes} [Wed Aug 10 22:55:55 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:55:56.329100 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-4732ebb6-fc0e-4633-a112-92979cdcbd62 tempest-HypervisorAdminUnderV252Test-1989975869 tempest-HypervisorAdminUnderV252Test-1989975869-project-admin] Calling method '.version_select at 0x7f847dd22670>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:56.330266 n-d-850468-14 devstack@n-api.service[122633]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:55:56.330266 n-d-850468-14 devstack@n-api.service[122633]: warnings.warn(msg) Aug 10 22:55:56.337001 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4732ebb6-fc0e-4633-a112-92979cdcbd62 tempest-HypervisorAdminUnderV252Test-1989975869 tempest-HypervisorAdminUnderV252Test-1989975869-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:56.337839 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4732ebb6-fc0e-4633-a112-92979cdcbd62 tempest-HypervisorAdminUnderV252Test-1989975869 tempest-HypervisorAdminUnderV252Test-1989975869-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:56.344538 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4732ebb6-fc0e-4633-a112-92979cdcbd62 tempest-HypervisorAdminUnderV252Test-1989975869 tempest-HypervisorAdminUnderV252Test-1989975869-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:56.445520 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4732ebb6-fc0e-4633-a112-92979cdcbd62 tempest-HypervisorAdminUnderV252Test-1989975869 tempest-HypervisorAdminUnderV252Test-1989975869-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:56.452016 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4732ebb6-fc0e-4633-a112-92979cdcbd62 tempest-HypervisorAdminUnderV252Test-1989975869 tempest-HypervisorAdminUnderV252Test-1989975869-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:56.456199 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4732ebb6-fc0e-4633-a112-92979cdcbd62 tempest-HypervisorAdminUnderV252Test-1989975869 tempest-HypervisorAdminUnderV252Test-1989975869-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:56.557004 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4732ebb6-fc0e-4633-a112-92979cdcbd62 tempest-HypervisorAdminUnderV252Test-1989975869 tempest-HypervisorAdminUnderV252Test-1989975869-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:56.566009 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4732ebb6-fc0e-4633-a112-92979cdcbd62 tempest-HypervisorAdminUnderV252Test-1989975869 tempest-HypervisorAdminUnderV252Test-1989975869-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:56.568566 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4732ebb6-fc0e-4633-a112-92979cdcbd62 tempest-HypervisorAdminUnderV252Test-1989975869 tempest-HypervisorAdminUnderV252Test-1989975869-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:56.588343 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-4732ebb6-fc0e-4633-a112-92979cdcbd62 tempest-HypervisorAdminUnderV252Test-1989975869 tempest-HypervisorAdminUnderV252Test-1989975869-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors/n-h1-850468-14/servers" status: 200 len: 197 microversion: 2.1 time: 0.271732 Aug 10 22:55:56.588931 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 69/152] 10.222.0.58 () {58 vars in 1215 bytes} [Wed Aug 10 22:55:56 2022] GET /compute/v2.1/os-hypervisors/n-h1-850468-14/servers => generated 197 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 22:55:56.604279 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-75ec1301-8b3c-424d-a591-5ad816feb3c4 tempest-HypervisorAdminUnderV252Test-1989975869 tempest-HypervisorAdminUnderV252Test-1989975869-project-admin] Calling method '.version_select at 0x7f847dde7dc0>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:56.605099 n-d-850468-14 devstack@n-api.service[122633]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:55:56.605099 n-d-850468-14 devstack@n-api.service[122633]: warnings.warn(msg) Aug 10 22:55:56.621522 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-75ec1301-8b3c-424d-a591-5ad816feb3c4 tempest-HypervisorAdminUnderV252Test-1989975869 tempest-HypervisorAdminUnderV252Test-1989975869-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:56.623422 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-75ec1301-8b3c-424d-a591-5ad816feb3c4 tempest-HypervisorAdminUnderV252Test-1989975869 tempest-HypervisorAdminUnderV252Test-1989975869-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:56.624232 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-75ec1301-8b3c-424d-a591-5ad816feb3c4 tempest-HypervisorAdminUnderV252Test-1989975869 tempest-HypervisorAdminUnderV252Test-1989975869-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:56.685101 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-75ec1301-8b3c-424d-a591-5ad816feb3c4 tempest-HypervisorAdminUnderV252Test-1989975869 tempest-HypervisorAdminUnderV252Test-1989975869-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:56.685812 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-75ec1301-8b3c-424d-a591-5ad816feb3c4 tempest-HypervisorAdminUnderV252Test-1989975869 tempest-HypervisorAdminUnderV252Test-1989975869-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:56.688504 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-75ec1301-8b3c-424d-a591-5ad816feb3c4 tempest-HypervisorAdminUnderV252Test-1989975869 tempest-HypervisorAdminUnderV252Test-1989975869-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:56.721932 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-75ec1301-8b3c-424d-a591-5ad816feb3c4 tempest-HypervisorAdminUnderV252Test-1989975869 tempest-HypervisorAdminUnderV252Test-1989975869-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:56.723141 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-75ec1301-8b3c-424d-a591-5ad816feb3c4 tempest-HypervisorAdminUnderV252Test-1989975869 tempest-HypervisorAdminUnderV252Test-1989975869-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:56.723827 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-75ec1301-8b3c-424d-a591-5ad816feb3c4 tempest-HypervisorAdminUnderV252Test-1989975869 tempest-HypervisorAdminUnderV252Test-1989975869-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:56.733548 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-75ec1301-8b3c-424d-a591-5ad816feb3c4 tempest-HypervisorAdminUnderV252Test-1989975869 tempest-HypervisorAdminUnderV252Test-1989975869-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.133503 Aug 10 22:55:56.746377 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 70/153] 10.222.0.58 () {58 vars in 1146 bytes} [Wed Aug 10 22:55:56 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:55:56.763349 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-e9191364-7e16-41a2-962a-cdbb03c1cb5d tempest-HypervisorAdminUnderV252Test-1989975869 tempest-HypervisorAdminUnderV252Test-1989975869-project-admin] Calling method '.version_select at 0x7f847dde7430>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:56.766540 n-d-850468-14 devstack@n-api.service[122633]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:55:56.766540 n-d-850468-14 devstack@n-api.service[122633]: warnings.warn(msg) Aug 10 22:55:56.772359 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e9191364-7e16-41a2-962a-cdbb03c1cb5d tempest-HypervisorAdminUnderV252Test-1989975869 tempest-HypervisorAdminUnderV252Test-1989975869-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:56.777243 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e9191364-7e16-41a2-962a-cdbb03c1cb5d tempest-HypervisorAdminUnderV252Test-1989975869 tempest-HypervisorAdminUnderV252Test-1989975869-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:56.777686 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e9191364-7e16-41a2-962a-cdbb03c1cb5d tempest-HypervisorAdminUnderV252Test-1989975869 tempest-HypervisorAdminUnderV252Test-1989975869-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:56.815373 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_api:SELECT=88,nova_api:DELETE=7,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:55:56.820667 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e9191364-7e16-41a2-962a-cdbb03c1cb5d tempest-HypervisorAdminUnderV252Test-1989975869 tempest-HypervisorAdminUnderV252Test-1989975869-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:56.822005 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e9191364-7e16-41a2-962a-cdbb03c1cb5d tempest-HypervisorAdminUnderV252Test-1989975869 tempest-HypervisorAdminUnderV252Test-1989975869-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:56.824510 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e9191364-7e16-41a2-962a-cdbb03c1cb5d tempest-HypervisorAdminUnderV252Test-1989975869 tempest-HypervisorAdminUnderV252Test-1989975869-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:56.835506 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-e9191364-7e16-41a2-962a-cdbb03c1cb5d tempest-HypervisorAdminUnderV252Test-1989975869 tempest-HypervisorAdminUnderV252Test-1989975869-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors/n-h1-850468-14/search" status: 200 len: 105 microversion: 2.1 time: 0.081342 Aug 10 22:55:56.836711 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 71/154] 10.222.0.58 () {58 vars in 1212 bytes} [Wed Aug 10 22:55:56 2022] GET /compute/v2.1/os-hypervisors/n-h1-850468-14/search => generated 105 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:55:57.076882 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-0f40bd55-a3a4-4ccd-8c06-f8d867cd9bb8 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:57.078483 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-0f40bd55-a3a4-4ccd-8c06-f8d867cd9bb8 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] [instance: 37093f4d-0663-4b69-a48f-5fd757acd9c0] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:55:57.123096 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0f40bd55-a3a4-4ccd-8c06-f8d867cd9bb8 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:57.133808 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0f40bd55-a3a4-4ccd-8c06-f8d867cd9bb8 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:57.136372 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0f40bd55-a3a4-4ccd-8c06-f8d867cd9bb8 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:57.140820 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0f40bd55-a3a4-4ccd-8c06-f8d867cd9bb8 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:57.146237 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0f40bd55-a3a4-4ccd-8c06-f8d867cd9bb8 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:57.148533 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0f40bd55-a3a4-4ccd-8c06-f8d867cd9bb8 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:57.756301 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-681cc24c-293c-43ee-a9a0-777a4ed493d3 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd644627ab14e55803c1d5981b9859a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a37b95a10245b796d26c1b35036827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:55:57.783130 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=97 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:55:57.799554 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-681cc24c-293c-43ee-a9a0-777a4ed493d3 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] 10.222.0.58 "GET /compute/v2.1/servers/155e0037-0bdb-4a93-af44-de6903bc2891" status: 200 len: 1339 microversion: 2.1 time: 1.746255 Aug 10 22:55:57.803149 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 84/155] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:55:56 2022] GET /compute/v2.1/servers/155e0037-0bdb-4a93-af44-de6903bc2891 => generated 1339 bytes in 1755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:55:57.824122 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=10 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:55:58.199500 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-0f40bd55-a3a4-4ccd-8c06-f8d867cd9bb8 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64648d3c6f5c423e83ff023e7bf6550a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434532ba922f406d8d8c197d3a57ffc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:55:58.221755 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-0f40bd55-a3a4-4ccd-8c06-f8d867cd9bb8 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] 10.222.0.58 "GET /compute/v2.1/servers/37093f4d-0663-4b69-a48f-5fd757acd9c0" status: 200 len: 1320 microversion: 2.1 time: 1.154441 Aug 10 22:55:58.226161 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 72/156] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:55:57 2022] GET /compute/v2.1/servers/37093f4d-0663-4b69-a48f-5fd757acd9c0 => generated 1320 bytes in 1161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:55:58.799897 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=4 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:55:58.835774 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-2311ef50-6bd2-4c64-bf67-75d3c957e8cd tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:58.836654 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-2311ef50-6bd2-4c64-bf67-75d3c957e8cd tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] [instance: 155e0037-0bdb-4a93-af44-de6903bc2891] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:55:58.855338 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2311ef50-6bd2-4c64-bf67-75d3c957e8cd tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:58.860147 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2311ef50-6bd2-4c64-bf67-75d3c957e8cd tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:58.865594 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2311ef50-6bd2-4c64-bf67-75d3c957e8cd tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:58.869914 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2311ef50-6bd2-4c64-bf67-75d3c957e8cd tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:58.879549 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2311ef50-6bd2-4c64-bf67-75d3c957e8cd tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:58.883832 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2311ef50-6bd2-4c64-bf67-75d3c957e8cd tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:59.699133 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-15ea816c-0e7e-44ac-867f-dc5075bb2316 tempest-HypervisorAdminV228Test-1488382725 tempest-HypervisorAdminV228Test-1488382725-project-admin] Calling method '.version_select at 0x7f847debf4c0>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:59.702111 n-d-850468-14 devstack@n-api.service[122632]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:55:59.702111 n-d-850468-14 devstack@n-api.service[122632]: warnings.warn(msg) Aug 10 22:55:59.705228 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-15ea816c-0e7e-44ac-867f-dc5075bb2316 tempest-HypervisorAdminV228Test-1488382725 tempest-HypervisorAdminV228Test-1488382725-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:59.706267 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-15ea816c-0e7e-44ac-867f-dc5075bb2316 tempest-HypervisorAdminV228Test-1488382725 tempest-HypervisorAdminV228Test-1488382725-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:59.706961 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-15ea816c-0e7e-44ac-867f-dc5075bb2316 tempest-HypervisorAdminV228Test-1488382725 tempest-HypervisorAdminV228Test-1488382725-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:59.734292 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-15ea816c-0e7e-44ac-867f-dc5075bb2316 tempest-HypervisorAdminV228Test-1488382725 tempest-HypervisorAdminV228Test-1488382725-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:59.735610 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-15ea816c-0e7e-44ac-867f-dc5075bb2316 tempest-HypervisorAdminV228Test-1488382725 tempest-HypervisorAdminV228Test-1488382725-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:59.736348 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-15ea816c-0e7e-44ac-867f-dc5075bb2316 tempest-HypervisorAdminV228Test-1488382725 tempest-HypervisorAdminV228Test-1488382725-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:59.754940 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-15ea816c-0e7e-44ac-867f-dc5075bb2316 tempest-HypervisorAdminV228Test-1488382725 tempest-HypervisorAdminV228Test-1488382725-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:59.760384 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-15ea816c-0e7e-44ac-867f-dc5075bb2316 tempest-HypervisorAdminV228Test-1488382725 tempest-HypervisorAdminV228Test-1488382725-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:59.761433 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-15ea816c-0e7e-44ac-867f-dc5075bb2316 tempest-HypervisorAdminV228Test-1488382725 tempest-HypervisorAdminV228Test-1488382725-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:59.772833 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-15ea816c-0e7e-44ac-867f-dc5075bb2316 tempest-HypervisorAdminV228Test-1488382725 tempest-HypervisorAdminV228Test-1488382725-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.28 time: 0.978725 Aug 10 22:55:59.774332 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 85/157] 10.222.0.58 () {60 vars in 1187 bytes} [Wed Aug 10 22:55:58 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 22:55:59.791676 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-dc7996f7-7c4b-4d8b-a17c-36f7ac598bde tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:55:59.793227 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-dc7996f7-7c4b-4d8b-a17c-36f7ac598bde tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] [instance: 37093f4d-0663-4b69-a48f-5fd757acd9c0] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:55:59.801484 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dc7996f7-7c4b-4d8b-a17c-36f7ac598bde tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:59.803865 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dc7996f7-7c4b-4d8b-a17c-36f7ac598bde tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:59.804942 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dc7996f7-7c4b-4d8b-a17c-36f7ac598bde tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:55:59.806150 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dc7996f7-7c4b-4d8b-a17c-36f7ac598bde tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:55:59.807599 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dc7996f7-7c4b-4d8b-a17c-36f7ac598bde tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:55:59.808377 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dc7996f7-7c4b-4d8b-a17c-36f7ac598bde tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:00.305731 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-dc7996f7-7c4b-4d8b-a17c-36f7ac598bde tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64648d3c6f5c423e83ff023e7bf6550a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434532ba922f406d8d8c197d3a57ffc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:00.317770 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-dc7996f7-7c4b-4d8b-a17c-36f7ac598bde tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] 10.222.0.58 "GET /compute/v2.1/servers/37093f4d-0663-4b69-a48f-5fd757acd9c0" status: 200 len: 1320 microversion: 2.1 time: 0.541591 Aug 10 22:56:00.318364 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 86/158] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:55:59 2022] GET /compute/v2.1/servers/37093f4d-0663-4b69-a48f-5fd757acd9c0 => generated 1320 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:56:00.430612 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-2311ef50-6bd2-4c64-bf67-75d3c957e8cd tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd644627ab14e55803c1d5981b9859a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a37b95a10245b796d26c1b35036827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:00.447830 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-2311ef50-6bd2-4c64-bf67-75d3c957e8cd tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] 10.222.0.58 "GET /compute/v2.1/servers/155e0037-0bdb-4a93-af44-de6903bc2891" status: 200 len: 1339 microversion: 2.1 time: 1.619202 Aug 10 22:56:00.457035 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 73/159] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:55:58 2022] GET /compute/v2.1/servers/155e0037-0bdb-4a93-af44-de6903bc2891 => generated 1339 bytes in 1629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:56:00.472509 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-062ce5ea-c37c-4f89-b15a-9b88cafd2d7c tempest-HypervisorAdminV228Test-1488382725 tempest-HypervisorAdminV228Test-1488382725-project-admin] Calling method '.version_select at 0x7f847dde7af0>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:00.478813 n-d-850468-14 devstack@n-api.service[122633]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:56:00.478813 n-d-850468-14 devstack@n-api.service[122633]: warnings.warn(msg) Aug 10 22:56:00.482562 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-062ce5ea-c37c-4f89-b15a-9b88cafd2d7c tempest-HypervisorAdminV228Test-1488382725 tempest-HypervisorAdminV228Test-1488382725-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:00.485877 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-062ce5ea-c37c-4f89-b15a-9b88cafd2d7c tempest-HypervisorAdminV228Test-1488382725 tempest-HypervisorAdminV228Test-1488382725-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:00.488806 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-062ce5ea-c37c-4f89-b15a-9b88cafd2d7c tempest-HypervisorAdminV228Test-1488382725 tempest-HypervisorAdminV228Test-1488382725-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:00.553320 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-062ce5ea-c37c-4f89-b15a-9b88cafd2d7c tempest-HypervisorAdminV228Test-1488382725 tempest-HypervisorAdminV228Test-1488382725-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:00.554170 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-062ce5ea-c37c-4f89-b15a-9b88cafd2d7c tempest-HypervisorAdminV228Test-1488382725 tempest-HypervisorAdminV228Test-1488382725-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:00.555366 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-062ce5ea-c37c-4f89-b15a-9b88cafd2d7c tempest-HypervisorAdminV228Test-1488382725 tempest-HypervisorAdminV228Test-1488382725-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:00.566717 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-062ce5ea-c37c-4f89-b15a-9b88cafd2d7c tempest-HypervisorAdminV228Test-1488382725 tempest-HypervisorAdminV228Test-1488382725-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 720 microversion: 2.28 time: 0.108181 Aug 10 22:56:00.568509 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 74/160] 10.222.0.58 () {60 vars in 1193 bytes} [Wed Aug 10 22:56:00 2022] GET /compute/v2.1/os-hypervisors/1 => generated 720 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 22:56:00.633210 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-2ba92069-51d2-46ff-8613-941b97cf9b4c req-ecd3d9c3-99e4-4a7d-9ae7-57ed798075ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37093f4d-0663-4b69-a48f-5fd757acd9c0", "tag": "9668aa85-ea99-41cb-95a0-d2a4cafadd33"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:56:00.667635 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-2ba92069-51d2-46ff-8613-941b97cf9b4c req-ecd3d9c3-99e4-4a7d-9ae7-57ed798075ae service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:00.671153 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-2ba92069-51d2-46ff-8613-941b97cf9b4c req-ecd3d9c3-99e4-4a7d-9ae7-57ed798075ae service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:00.671153 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-2ba92069-51d2-46ff-8613-941b97cf9b4c req-ecd3d9c3-99e4-4a7d-9ae7-57ed798075ae service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:00.720542 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-2ba92069-51d2-46ff-8613-941b97cf9b4c req-ecd3d9c3-99e4-4a7d-9ae7-57ed798075ae service nova] Creating event network-changed:9668aa85-ea99-41cb-95a0-d2a4cafadd33 for instance 37093f4d-0663-4b69-a48f-5fd757acd9c0 on n-h2-850468-14 Aug 10 22:56:00.752336 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-2ba92069-51d2-46ff-8613-941b97cf9b4c req-ecd3d9c3-99e4-4a7d-9ae7-57ed798075ae service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.429740 Aug 10 22:56:00.753025 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 87/161] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 22:56:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:56:01.354021 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-312cef60-730d-4d2a-8f4f-e384411ff7f6 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:01.357297 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-312cef60-730d-4d2a-8f4f-e384411ff7f6 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] [instance: 37093f4d-0663-4b69-a48f-5fd757acd9c0] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:56:01.373470 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-312cef60-730d-4d2a-8f4f-e384411ff7f6 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:01.375481 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-312cef60-730d-4d2a-8f4f-e384411ff7f6 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:01.376303 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-312cef60-730d-4d2a-8f4f-e384411ff7f6 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:01.377528 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-312cef60-730d-4d2a-8f4f-e384411ff7f6 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:01.378296 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-312cef60-730d-4d2a-8f4f-e384411ff7f6 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:01.379002 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-312cef60-730d-4d2a-8f4f-e384411ff7f6 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:01.695401 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-4429e8e4-8e16-4650-a594-f7a05d9f7ab2 tempest-QuotasAdminTestV236-443236289 tempest-QuotasAdminTestV236-443236289-project-admin] Action: 'update', calling method: .version_select at 0x7f847dd79f70>, body: {"quota_set": {"ram": "5120"}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:56:02.003258 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-312cef60-730d-4d2a-8f4f-e384411ff7f6 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64648d3c6f5c423e83ff023e7bf6550a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434532ba922f406d8d8c197d3a57ffc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:02.029876 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-312cef60-730d-4d2a-8f4f-e384411ff7f6 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] 10.222.0.58 "GET /compute/v2.1/servers/37093f4d-0663-4b69-a48f-5fd757acd9c0" status: 200 len: 1320 microversion: 2.1 time: 0.687641 Aug 10 22:56:02.032951 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 88/162] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:56:01 2022] GET /compute/v2.1/servers/37093f4d-0663-4b69-a48f-5fd757acd9c0 => generated 1320 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:56:02.046120 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-4ccefaf1-db26-4863-88fc-2d7c4c8ef2c6 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:02.046993 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-4ccefaf1-db26-4863-88fc-2d7c4c8ef2c6 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] [instance: 155e0037-0bdb-4a93-af44-de6903bc2891] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:56:02.064132 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4ccefaf1-db26-4863-88fc-2d7c4c8ef2c6 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:02.074943 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4ccefaf1-db26-4863-88fc-2d7c4c8ef2c6 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:02.075755 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4ccefaf1-db26-4863-88fc-2d7c4c8ef2c6 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:02.076879 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4ccefaf1-db26-4863-88fc-2d7c4c8ef2c6 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:02.078549 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4ccefaf1-db26-4863-88fc-2d7c4c8ef2c6 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:02.080067 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4ccefaf1-db26-4863-88fc-2d7c4c8ef2c6 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:02.974295 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-4ccefaf1-db26-4863-88fc-2d7c4c8ef2c6 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd644627ab14e55803c1d5981b9859a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a37b95a10245b796d26c1b35036827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:02.994395 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-4ccefaf1-db26-4863-88fc-2d7c4c8ef2c6 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] 10.222.0.58 "GET /compute/v2.1/servers/155e0037-0bdb-4a93-af44-de6903bc2891" status: 200 len: 1339 microversion: 2.1 time: 0.959983 Aug 10 22:56:02.996173 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 89/163] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:56:02 2022] GET /compute/v2.1/servers/155e0037-0bdb-4a93-af44-de6903bc2891 => generated 1339 bytes in 962 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:56:03.133237 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4429e8e4-8e16-4650-a594-f7a05d9f7ab2 tempest-QuotasAdminTestV236-443236289 tempest-QuotasAdminTestV236-443236289-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:03.133237 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4429e8e4-8e16-4650-a594-f7a05d9f7ab2 tempest-QuotasAdminTestV236-443236289 tempest-QuotasAdminTestV236-443236289-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:03.133868 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4429e8e4-8e16-4650-a594-f7a05d9f7ab2 tempest-QuotasAdminTestV236-443236289 tempest-QuotasAdminTestV236-443236289-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:03.134401 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4429e8e4-8e16-4650-a594-f7a05d9f7ab2 tempest-QuotasAdminTestV236-443236289 tempest-QuotasAdminTestV236-443236289-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:03.134876 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4429e8e4-8e16-4650-a594-f7a05d9f7ab2 tempest-QuotasAdminTestV236-443236289 tempest-QuotasAdminTestV236-443236289-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:03.135544 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4429e8e4-8e16-4650-a594-f7a05d9f7ab2 tempest-QuotasAdminTestV236-443236289 tempest-QuotasAdminTestV236-443236289-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:03.279190 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-4429e8e4-8e16-4650-a594-f7a05d9f7ab2 tempest-QuotasAdminTestV236-443236289 tempest-QuotasAdminTestV236-443236289-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-quota-sets/d7342e070fe34f55b91f33ba77e25b38" status: 200 len: 240 microversion: 2.36 time: 2.709396 Aug 10 22:56:03.287061 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 75/164] 10.222.0.58 () {62 vars in 1303 bytes} [Wed Aug 10 22:56:00 2022] PUT /compute/v2.1/os-quota-sets/d7342e070fe34f55b91f33ba77e25b38 => generated 240 bytes in 2718 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 22:56:03.298819 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-5aca15c1-e3ed-4637-a61c-9f883151907e tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:03.299499 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-5aca15c1-e3ed-4637-a61c-9f883151907e tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] [instance: 37093f4d-0663-4b69-a48f-5fd757acd9c0] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:56:03.319676 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5aca15c1-e3ed-4637-a61c-9f883151907e tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:03.320186 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5aca15c1-e3ed-4637-a61c-9f883151907e tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:03.320729 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5aca15c1-e3ed-4637-a61c-9f883151907e tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:03.321445 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5aca15c1-e3ed-4637-a61c-9f883151907e tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:03.321894 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5aca15c1-e3ed-4637-a61c-9f883151907e tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:03.322317 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5aca15c1-e3ed-4637-a61c-9f883151907e tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:03.540161 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-7f57aa99-becb-4b26-b800-ab65a6cbca0f req-549f1658-21b4-4a99-92ec-0f061af04973 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "155e0037-0bdb-4a93-af44-de6903bc2891", "name": "network-vif-plugged", "status": "completed", "tag": "d7b21e9c-cec7-4ec0-be49-df050e213b01"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:56:03.559877 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=84,nova_api:DELETE=1 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:56:03.562461 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-7f57aa99-becb-4b26-b800-ab65a6cbca0f req-549f1658-21b4-4a99-92ec-0f061af04973 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:03.563211 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-7f57aa99-becb-4b26-b800-ab65a6cbca0f req-549f1658-21b4-4a99-92ec-0f061af04973 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:03.563635 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-7f57aa99-becb-4b26-b800-ab65a6cbca0f req-549f1658-21b4-4a99-92ec-0f061af04973 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:03.587639 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-7f57aa99-becb-4b26-b800-ab65a6cbca0f req-549f1658-21b4-4a99-92ec-0f061af04973 service nova] Creating event network-vif-plugged:d7b21e9c-cec7-4ec0-be49-df050e213b01 for instance 155e0037-0bdb-4a93-af44-de6903bc2891 on n-h1-850468-14 Aug 10 22:56:03.605478 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-7f57aa99-becb-4b26-b800-ab65a6cbca0f req-549f1658-21b4-4a99-92ec-0f061af04973 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.607819 Aug 10 22:56:03.608997 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 90/165] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 22:56:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:56:03.624910 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-0429700a-167d-42f5-8368-60f25fe6fe96 tempest-QuotasAdminTestV236-443236289 tempest-QuotasAdminTestV236-443236289-project-admin] Calling method '.version_select at 0x7f847e041430>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:03.729588 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-5aca15c1-e3ed-4637-a61c-9f883151907e tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64648d3c6f5c423e83ff023e7bf6550a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434532ba922f406d8d8c197d3a57ffc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:03.744780 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-5aca15c1-e3ed-4637-a61c-9f883151907e tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] 10.222.0.58 "GET /compute/v2.1/servers/37093f4d-0663-4b69-a48f-5fd757acd9c0" status: 200 len: 1320 microversion: 2.1 time: 0.456507 Aug 10 22:56:03.746619 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 76/166] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:56:03 2022] GET /compute/v2.1/servers/37093f4d-0663-4b69-a48f-5fd757acd9c0 => generated 1320 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:56:04.128208 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0429700a-167d-42f5-8368-60f25fe6fe96 tempest-QuotasAdminTestV236-443236289 tempest-QuotasAdminTestV236-443236289-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:04.129733 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0429700a-167d-42f5-8368-60f25fe6fe96 tempest-QuotasAdminTestV236-443236289 tempest-QuotasAdminTestV236-443236289-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:04.130850 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0429700a-167d-42f5-8368-60f25fe6fe96 tempest-QuotasAdminTestV236-443236289 tempest-QuotasAdminTestV236-443236289-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:04.132548 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0429700a-167d-42f5-8368-60f25fe6fe96 tempest-QuotasAdminTestV236-443236289 tempest-QuotasAdminTestV236-443236289-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:04.133020 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0429700a-167d-42f5-8368-60f25fe6fe96 tempest-QuotasAdminTestV236-443236289 tempest-QuotasAdminTestV236-443236289-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:04.133762 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0429700a-167d-42f5-8368-60f25fe6fe96 tempest-QuotasAdminTestV236-443236289 tempest-QuotasAdminTestV236-443236289-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:04.148178 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-31f2bd50-8b96-4fa8-aee4-d71e51e085e3 tempest-InstanceUsageAuditLogNegativeTestJSON-1767545139 tempest-InstanceUsageAuditLogNegativeTestJSON-1767545139-project-admin] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:04.149239 n-d-850468-14 devstack@n-api.service[122633]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:56:04.149239 n-d-850468-14 devstack@n-api.service[122633]: warnings.warn(msg) Aug 10 22:56:04.155471 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-31f2bd50-8b96-4fa8-aee4-d71e51e085e3 tempest-InstanceUsageAuditLogNegativeTestJSON-1767545139 tempest-InstanceUsageAuditLogNegativeTestJSON-1767545139-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Aug 10 22:56:04.163984 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-31f2bd50-8b96-4fa8-aee4-d71e51e085e3 tempest-InstanceUsageAuditLogNegativeTestJSON-1767545139 tempest-InstanceUsageAuditLogNegativeTestJSON-1767545139-project-admin] Request method failure captured: Aug 10 22:56:04.163984 n-d-850468-14 devstack@n-api.service[122633]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Aug 10 22:56:04.163984 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 22:56:04.163984 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 22:56:04.163984 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 22:56:04.163984 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 22:56:04.163984 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 22:56:04.163984 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 22:56:04.163984 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 22:56:04.163984 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 22:56:04.163984 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9DeDES4UYSZnHOA4Iac62Yf_GSFi10fhIcoyj0DGlPS2sVHjckcx9pP00A2aGmntWK_cfgAH8ol0DUS28IkUi5n4NeanpPY5ku2e_L2-xSa-g7CmMoiQSlg0M91cla9mAZfoAxdUhIz-C9LEVmKVQ_9GudwXoyZUnOL4ZzE_-DdlhKA Aug 10 22:56:04.163984 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 22:56:04.163984 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 22:56:04.163984 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 22:56:04.163984 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 22:56:04.163984 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 22:56:04.163984 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 22:56:04.163984 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 9867dba3f2b1446cb7472911889f101d Aug 10 22:56:04.163984 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1767545139 Aug 10 22:56:04.163984 n-d-850468-14 devstack@n-api.service[122633]: X-Role: admin,member,reader Aug 10 22:56:04.163984 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: admin,member,reader Aug 10 22:56:04.165487 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9867dba3f2b1446cb7472911889f101d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9867dba3f2b1446cb7472911889f101d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/9867dba3f2b1446cb7472911889f101d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_9867dba3f2b1446cb7472911889f101d", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 22:56:04.165487 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1767545139 Aug 10 22:56:04.165487 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 9867dba3f2b1446cb7472911889f101d Aug 10 22:56:04.165487 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1767545139 Aug 10 22:56:04.165487 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1767545139-project-admin Aug 10 22:56:04.165487 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 22:56:04.165487 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 22:56:04.165487 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 79d7755f67f948b3a73c0a42b354ff0c Aug 10 22:56:04.165487 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1767545139-project-admin Aug 10 22:56:04.165487 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 22:56:04.165487 n-d-850468-14 devstack@n-api.service[122633]: exception: Invalid timestamp for date invalid_time Aug 10 22:56:04.166283 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': 'invalid_time'} Aug 10 22:56:04.166283 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 22:56:04.166283 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:56:04.166283 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Aug 10 22:56:04.166283 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Aug 10 22:56:04.166283 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Aug 10 22:56:04.166283 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Aug 10 22:56:04.166283 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Aug 10 22:56:04.166283 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Aug 10 22:56:04.166283 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Aug 10 22:56:04.166283 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:56:04.166283 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:56:04.166283 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:56:04.166283 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:56:04.166283 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:56:04.166283 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:56:04.166283 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 22:56:04.166283 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 22:56:04.166283 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 22:56:04.166283 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 22:56:04.167924 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Aug 10 22:56:04.167924 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Aug 10 22:56:04.167924 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Aug 10 22:56:04.167924 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:56:04.167924 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:56:04.167924 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:56:04.167924 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:56:04.167924 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:56:04.167924 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:56:04.167924 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 22:56:04.167924 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 22:56:04.167924 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Aug 10 22:56:04.167924 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:56:04.167924 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-31f2bd50-8b96-4fa8-aee4-d71e51e085e3 tempest-InstanceUsageAuditLogNegativeTestJSON-1767545139 tempest-InstanceUsageAuditLogNegativeTestJSON-1767545139-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 22:56:04.169252 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-31f2bd50-8b96-4fa8-aee4-d71e51e085e3 tempest-InstanceUsageAuditLogNegativeTestJSON-1767545139 tempest-InstanceUsageAuditLogNegativeTestJSON-1767545139-project-admin] 10.222.0.58 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.419367 Aug 10 22:56:04.175432 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-0429700a-167d-42f5-8368-60f25fe6fe96 tempest-QuotasAdminTestV236-443236289 tempest-QuotasAdminTestV236-443236289-project-admin] 10.222.0.58 "GET /compute/v2.1/os-quota-sets/d7342e070fe34f55b91f33ba77e25b38/detail" status: 200 len: 672 microversion: 2.36 time: 0.564968 Aug 10 22:56:04.176391 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 91/167] 10.222.0.58 () {60 vars in 1304 bytes} [Wed Aug 10 22:56:03 2022] GET /compute/v2.1/os-quota-sets/d7342e070fe34f55b91f33ba77e25b38/detail => generated 672 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 22:56:04.182854 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-932473db-68e9-400c-b760-391d616d347d tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:04.184065 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-932473db-68e9-400c-b760-391d616d347d tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] [instance: 155e0037-0bdb-4a93-af44-de6903bc2891] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:56:04.188788 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 77/168] 10.222.0.58 () {58 vars in 1224 bytes} [Wed Aug 10 22:56:03 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 441 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 10 22:56:04.193044 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-932473db-68e9-400c-b760-391d616d347d tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:04.193773 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-932473db-68e9-400c-b760-391d616d347d tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:04.194366 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-932473db-68e9-400c-b760-391d616d347d tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:04.195142 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-932473db-68e9-400c-b760-391d616d347d tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:04.195931 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-932473db-68e9-400c-b760-391d616d347d tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:04.196648 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-932473db-68e9-400c-b760-391d616d347d tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:04.400591 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-932473db-68e9-400c-b760-391d616d347d tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd644627ab14e55803c1d5981b9859a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a37b95a10245b796d26c1b35036827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:04.409406 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-932473db-68e9-400c-b760-391d616d347d tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] 10.222.0.58 "GET /compute/v2.1/servers/155e0037-0bdb-4a93-af44-de6903bc2891" status: 200 len: 1339 microversion: 2.1 time: 0.231781 Aug 10 22:56:04.409976 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 92/169] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:56:04 2022] GET /compute/v2.1/servers/155e0037-0bdb-4a93-af44-de6903bc2891 => generated 1339 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:56:04.653572 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-11e912c5-31e3-4686-9a1a-1e7738b26e7f tempest-InstanceUsageAuditLogNegativeTestJSON-294293282 tempest-InstanceUsageAuditLogNegativeTestJSON-294293282-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:04.654711 n-d-850468-14 devstack@n-api.service[122633]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:56:04.654711 n-d-850468-14 devstack@n-api.service[122633]: warnings.warn(msg) Aug 10 22:56:04.656055 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-11e912c5-31e3-4686-9a1a-1e7738b26e7f tempest-InstanceUsageAuditLogNegativeTestJSON-294293282 tempest-InstanceUsageAuditLogNegativeTestJSON-294293282-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': 'f43dd8c606be497a85e0693e7485c71f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '310aedc7488b42f1b7ce55bac8741b01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:04.658048 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-11e912c5-31e3-4686-9a1a-1e7738b26e7f tempest-InstanceUsageAuditLogNegativeTestJSON-294293282 tempest-InstanceUsageAuditLogNegativeTestJSON-294293282-project] Request method failure captured: Aug 10 22:56:04.658048 n-d-850468-14 devstack@n-api.service[122633]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Aug 10 22:56:04.658048 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 22:56:04.658048 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 22:56:04.658048 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 22:56:04.658048 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 22:56:04.658048 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 22:56:04.658048 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 22:56:04.658048 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 22:56:04.658048 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 22:56:04.658048 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9Dd_mW0nyYluS2sfWtNkP1-OVqOm3vx8Q-WyGfqva8xkPlFmZbbWcuFxm3bui1WoerZXTyWLSewRCeC0Yk8N1gDS1Im-Y2hC2KqMU_stA8AFZ1GxdgOKVLPGCO5c3TwdVxwG3xFG1VB4cgc5HuAOgOXNKIq-olraxezxL8ohjbqgB5A Aug 10 22:56:04.658048 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 22:56:04.658048 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 22:56:04.658048 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 22:56:04.658048 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 22:56:04.658048 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 22:56:04.658048 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 22:56:04.658048 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 310aedc7488b42f1b7ce55bac8741b01 Aug 10 22:56:04.658048 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-294293282 Aug 10 22:56:04.658048 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 22:56:04.658048 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 22:56:04.659645 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/310aedc7488b42f1b7ce55bac8741b01"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/310aedc7488b42f1b7ce55bac8741b01"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/310aedc7488b42f1b7ce55bac8741b01"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_310aedc7488b42f1b7ce55bac8741b01", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 22:56:04.659645 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-294293282 Aug 10 22:56:04.659645 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 310aedc7488b42f1b7ce55bac8741b01 Aug 10 22:56:04.659645 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-294293282 Aug 10 22:56:04.659645 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-294293282-project Aug 10 22:56:04.659645 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 22:56:04.659645 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 22:56:04.659645 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: f43dd8c606be497a85e0693e7485c71f Aug 10 22:56:04.659645 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-294293282-project Aug 10 22:56:04.659645 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 22:56:04.660603 n-d-850468-14 devstack@n-api.service[122633]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Aug 10 22:56:04.660603 n-d-850468-14 devstack@n-api.service[122633]: action_args: {} Aug 10 22:56:04.660603 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 22:56:04.660603 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:56:04.660603 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:56:04.660603 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:56:04.660603 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 22:56:04.660603 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 22:56:04.660603 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 22:56:04.660603 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 22:56:04.660603 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Aug 10 22:56:04.660603 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Aug 10 22:56:04.660603 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 10 22:56:04.660603 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 10 22:56:04.660603 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 10 22:56:04.660603 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 10 22:56:04.660603 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 10 22:56:04.660603 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 10 22:56:04.660603 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 10 22:56:04.660603 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise self.value Aug 10 22:56:04.661663 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 10 22:56:04.661663 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 10 22:56:04.661663 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 10 22:56:04.661663 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 10 22:56:04.661663 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 10 22:56:04.661663 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 10 22:56:04.661663 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Aug 10 22:56:04.661663 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:56:04.661663 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:56:04.661663 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:56:04.661663 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:56:04.661663 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:56:04.661663 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:56:04.661663 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 10 22:56:04.661663 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 10 22:56:04.661663 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Aug 10 22:56:04.661663 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:56:04.665141 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-11e912c5-31e3-4686-9a1a-1e7738b26e7f tempest-InstanceUsageAuditLogNegativeTestJSON-294293282 tempest-InstanceUsageAuditLogNegativeTestJSON-294293282-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 22:56:04.666200 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-11e912c5-31e3-4686-9a1a-1e7738b26e7f tempest-InstanceUsageAuditLogNegativeTestJSON-294293282 tempest-InstanceUsageAuditLogNegativeTestJSON-294293282-project] 10.222.0.58 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.475528 Aug 10 22:56:04.667202 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 78/170] 10.222.0.58 () {58 vars in 1185 bytes} [Wed Aug 10 22:56:04 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 478 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 10 22:56:04.686006 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-ea406edc-6450-4a5c-ae5e-b985b331c32b tempest-InstanceUsageAuditLogNegativeTestJSON-294293282 tempest-InstanceUsageAuditLogNegativeTestJSON-294293282-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:04.689071 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-ea406edc-6450-4a5c-ae5e-b985b331c32b tempest-InstanceUsageAuditLogNegativeTestJSON-294293282 tempest-InstanceUsageAuditLogNegativeTestJSON-294293282-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': 'f43dd8c606be497a85e0693e7485c71f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '310aedc7488b42f1b7ce55bac8741b01', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:04.691610 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-ea406edc-6450-4a5c-ae5e-b985b331c32b tempest-InstanceUsageAuditLogNegativeTestJSON-294293282 tempest-InstanceUsageAuditLogNegativeTestJSON-294293282-project] Request method failure captured: Aug 10 22:56:04.691610 n-d-850468-14 devstack@n-api.service[122633]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-08-10%2022:56:04 HTTP/1.1 Aug 10 22:56:04.691610 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 22:56:04.691610 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 22:56:04.691610 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 22:56:04.691610 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 22:56:04.691610 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 22:56:04.691610 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 22:56:04.691610 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 22:56:04.691610 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 22:56:04.691610 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9Dd_mW0nyYluS2sfWtNkP1-OVqOm3vx8Q-WyGfqva8xkPlFmZbbWcuFxm3bui1WoerZXTyWLSewRCeC0Yk8N1gDS1Im-Y2hC2KqMU_stA8AFZ1GxdgOKVLPGCO5c3TwdVxwG3xFG1VB4cgc5HuAOgOXNKIq-olraxezxL8ohjbqgB5A Aug 10 22:56:04.691610 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 22:56:04.691610 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 22:56:04.691610 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 22:56:04.691610 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 22:56:04.691610 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 22:56:04.691610 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 22:56:04.691610 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 310aedc7488b42f1b7ce55bac8741b01 Aug 10 22:56:04.691610 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-294293282 Aug 10 22:56:04.691610 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 22:56:04.691610 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 22:56:04.692785 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/310aedc7488b42f1b7ce55bac8741b01"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/310aedc7488b42f1b7ce55bac8741b01"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/310aedc7488b42f1b7ce55bac8741b01"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_310aedc7488b42f1b7ce55bac8741b01", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 22:56:04.692785 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-294293282 Aug 10 22:56:04.692785 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 310aedc7488b42f1b7ce55bac8741b01 Aug 10 22:56:04.692785 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-294293282 Aug 10 22:56:04.692785 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-294293282-project Aug 10 22:56:04.692785 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 22:56:04.692785 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 22:56:04.692785 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: f43dd8c606be497a85e0693e7485c71f Aug 10 22:56:04.692785 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-294293282-project Aug 10 22:56:04.692785 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 22:56:04.693422 n-d-850468-14 devstack@n-api.service[122633]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Aug 10 22:56:04.693422 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': '2022-08-10 22:56:04'} Aug 10 22:56:04.693422 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 22:56:04.693422 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:56:04.693422 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:56:04.693422 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:56:04.693422 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 22:56:04.693422 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 22:56:04.693422 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 22:56:04.693422 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 22:56:04.693422 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Aug 10 22:56:04.693422 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Aug 10 22:56:04.693422 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 10 22:56:04.693422 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 10 22:56:04.693422 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 10 22:56:04.693422 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 10 22:56:04.693422 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 10 22:56:04.693422 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 10 22:56:04.693422 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 10 22:56:04.693422 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise self.value Aug 10 22:56:04.694469 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 10 22:56:04.694469 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 10 22:56:04.694469 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 10 22:56:04.694469 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 10 22:56:04.694469 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 10 22:56:04.694469 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 10 22:56:04.694469 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Aug 10 22:56:04.694469 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:56:04.694469 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:56:04.694469 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:56:04.694469 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:56:04.694469 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:56:04.694469 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:56:04.694469 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 10 22:56:04.694469 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 10 22:56:04.694469 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Aug 10 22:56:04.694469 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:56:04.696021 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-ea406edc-6450-4a5c-ae5e-b985b331c32b tempest-InstanceUsageAuditLogNegativeTestJSON-294293282 tempest-InstanceUsageAuditLogNegativeTestJSON-294293282-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 22:56:04.696021 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-ea406edc-6450-4a5c-ae5e-b985b331c32b tempest-InstanceUsageAuditLogNegativeTestJSON-294293282 tempest-InstanceUsageAuditLogNegativeTestJSON-294293282-project] 10.222.0.58 "GET /compute/v2.1/os-instance_usage_audit_log/2022-08-10 22:56:04" status: 403 len: 128 microversion: 2.1 time: 0.020713 Aug 10 22:56:04.696021 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 79/171] 10.222.0.58 () {58 vars in 1251 bytes} [Wed Aug 10 22:56:04 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-08-10%2022%3A56%3A04 => generated 128 bytes in 23 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 10 22:56:04.775077 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-6d269270-7dd8-4779-be13-215ac8882b1f tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:04.775920 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-6d269270-7dd8-4779-be13-215ac8882b1f tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] [instance: 37093f4d-0663-4b69-a48f-5fd757acd9c0] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:56:04.782294 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6d269270-7dd8-4779-be13-215ac8882b1f tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:04.782772 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6d269270-7dd8-4779-be13-215ac8882b1f tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:04.784409 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6d269270-7dd8-4779-be13-215ac8882b1f tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:04.785941 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6d269270-7dd8-4779-be13-215ac8882b1f tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:04.786392 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6d269270-7dd8-4779-be13-215ac8882b1f tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:04.786829 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6d269270-7dd8-4779-be13-215ac8882b1f tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:04.820078 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-5a1a060e-5422-4797-b3ec-7047c6956062 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:04.834735 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-5a1a060e-5422-4797-b3ec-7047c6956062 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] 10.222.0.58 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.423447 Aug 10 22:56:04.835666 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 93/172] 10.222.0.58 () {58 vars in 1137 bytes} [Wed Aug 10 22:56:04 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:56:05.052210 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-6d269270-7dd8-4779-be13-215ac8882b1f tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64648d3c6f5c423e83ff023e7bf6550a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434532ba922f406d8d8c197d3a57ffc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:05.064571 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-6d269270-7dd8-4779-be13-215ac8882b1f tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] 10.222.0.58 "GET /compute/v2.1/servers/37093f4d-0663-4b69-a48f-5fd757acd9c0" status: 200 len: 1320 microversion: 2.1 time: 0.294816 Aug 10 22:56:05.066633 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 80/173] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:56:04 2022] GET /compute/v2.1/servers/37093f4d-0663-4b69-a48f-5fd757acd9c0 => generated 1320 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:56:05.388841 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-aff5af45-47e1-4267-87ef-8e562db1b132 tempest-QuotasAdminTestV236-443236289 tempest-QuotasAdminTestV236-443236289-project-admin] Action: 'update', calling method: .version_select at 0x7f847dd2fe50>, body: {"quota_set": {"ram": "2048"}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:56:05.515954 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-660f5f6b-0fe7-4598-a32f-3965f0bb014e tempest-ServersWithSpecificFlavorTestJSON-1697787177 tempest-ServersWithSpecificFlavorTestJSON-1697787177-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-230270271", "id": 9698657, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:56:05.533033 n-d-850468-14 devstack@n-api.service[122632]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:56:05.533033 n-d-850468-14 devstack@n-api.service[122632]: warnings.warn(msg) Aug 10 22:56:05.591940 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-660f5f6b-0fe7-4598-a32f-3965f0bb014e tempest-ServersWithSpecificFlavorTestJSON-1697787177 tempest-ServersWithSpecificFlavorTestJSON-1697787177-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.733059 Aug 10 22:56:05.593932 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 94/174] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 22:56:04 2022] POST /compute/v2.1/flavors => generated 415 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:56:05.599973 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-8e011f36-f45e-4285-a112-e6730e091e4a tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:05.600888 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-8e011f36-f45e-4285-a112-e6730e091e4a tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] [instance: 155e0037-0bdb-4a93-af44-de6903bc2891] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:56:05.614390 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8e011f36-f45e-4285-a112-e6730e091e4a tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:05.614919 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8e011f36-f45e-4285-a112-e6730e091e4a tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:05.615355 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8e011f36-f45e-4285-a112-e6730e091e4a tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:05.616057 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8e011f36-f45e-4285-a112-e6730e091e4a tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:05.616500 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8e011f36-f45e-4285-a112-e6730e091e4a tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:05.616928 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8e011f36-f45e-4285-a112-e6730e091e4a tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:05.800569 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-8e011f36-f45e-4285-a112-e6730e091e4a tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd644627ab14e55803c1d5981b9859a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a37b95a10245b796d26c1b35036827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:05.809440 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-8e011f36-f45e-4285-a112-e6730e091e4a tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] 10.222.0.58 "GET /compute/v2.1/servers/155e0037-0bdb-4a93-af44-de6903bc2891" status: 200 len: 1339 microversion: 2.1 time: 0.214032 Aug 10 22:56:05.817724 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 95/175] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:56:05 2022] GET /compute/v2.1/servers/155e0037-0bdb-4a93-af44-de6903bc2891 => generated 1339 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:56:05.822608 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c5e20b84-96d3-4b61-9f31-26189da5e26a tempest-ServersWithSpecificFlavorTestJSON-1697787177 tempest-ServersWithSpecificFlavorTestJSON-1697787177-project-admin] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:05.839986 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-c5e20b84-96d3-4b61-9f31-26189da5e26a tempest-ServersWithSpecificFlavorTestJSON-1697787177 tempest-ServersWithSpecificFlavorTestJSON-1697787177-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.020871 Aug 10 22:56:05.845310 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 96/176] 10.222.0.58 () {58 vars in 1182 bytes} [Wed Aug 10 22:56:05 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 22:56:05.858701 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-73d39f50-cd52-4761-b941-403e0fd6fb74 tempest-ServersWithSpecificFlavorTestJSON-1697787177 tempest-ServersWithSpecificFlavorTestJSON-1697787177-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-1217805846", "id": 1169490990, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:56:05.862450 n-d-850468-14 devstack@n-api.service[122632]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:56:05.862450 n-d-850468-14 devstack@n-api.service[122632]: warnings.warn(msg) Aug 10 22:56:05.881669 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-73d39f50-cd52-4761-b941-403e0fd6fb74 tempest-ServersWithSpecificFlavorTestJSON-1697787177 tempest-ServersWithSpecificFlavorTestJSON-1697787177-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 0.034452 Aug 10 22:56:05.883106 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 97/177] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 22:56:05 2022] POST /compute/v2.1/flavors => generated 425 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:56:05.902267 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-eb74c0d1-a187-4c58-9d72-620a6b0910e3 tempest-ServersWithSpecificFlavorTestJSON-1697787177 tempest-ServersWithSpecificFlavorTestJSON-1697787177-project-admin] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:05.927234 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-eb74c0d1-a187-4c58-9d72-620a6b0910e3 tempest-ServersWithSpecificFlavorTestJSON-1697787177 tempest-ServersWithSpecificFlavorTestJSON-1697787177-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.029839 Aug 10 22:56:05.929648 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 98/178] 10.222.0.58 () {58 vars in 1182 bytes} [Wed Aug 10 22:56:05 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 22:56:05.941880 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-611aad55-ce4c-466d-baae-456361a7d4dd tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Action: 'create', calling method: .version_select at 0x7f847de17ee0>, body: {"keypair": {"name": "tempest-keypair-1466905669", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFBr6qdBxJIDyr9A0lt2Qhim636sterpb89hN4aA6369I0C44ndy7zXNyrQXVwaTv+GtjrlBFHsFKhn4z9Kht+SEyNvE075wN242VJOJtb2wujn1NuqtNHIzhmgu5SnUoA=="}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:56:05.972300 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-611aad55-ce4c-466d-baae-456361a7d4dd tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Getting quotas for project deaba512051743deb45881d76eb206ed. Resources: {'key_pairs'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 22:56:05.977139 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-611aad55-ce4c-466d-baae-456361a7d4dd tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Getting quotas for user eaed2a2e56f749a88c340aaccb15d2d9 and project deaba512051743deb45881d76eb206ed. Resources: {'key_pairs'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 22:56:06.011958 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-611aad55-ce4c-466d-baae-456361a7d4dd tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.074062 Aug 10 22:56:06.013412 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 99/179] 10.222.0.58 () {60 vars in 1159 bytes} [Wed Aug 10 22:56:05 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 22:56:06.087269 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-f7a1dcf5-3867-460c-9278-e4ea7c7b983c tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:06.088119 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-f7a1dcf5-3867-460c-9278-e4ea7c7b983c tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] [instance: 37093f4d-0663-4b69-a48f-5fd757acd9c0] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:56:06.098315 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f7a1dcf5-3867-460c-9278-e4ea7c7b983c tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:06.101326 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f7a1dcf5-3867-460c-9278-e4ea7c7b983c tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:06.102026 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f7a1dcf5-3867-460c-9278-e4ea7c7b983c tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:06.103693 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f7a1dcf5-3867-460c-9278-e4ea7c7b983c tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:06.106392 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f7a1dcf5-3867-460c-9278-e4ea7c7b983c tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:06.107347 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f7a1dcf5-3867-460c-9278-e4ea7c7b983c tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:06.182039 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-aff5af45-47e1-4267-87ef-8e562db1b132 tempest-QuotasAdminTestV236-443236289 tempest-QuotasAdminTestV236-443236289-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:06.186545 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-aff5af45-47e1-4267-87ef-8e562db1b132 tempest-QuotasAdminTestV236-443236289 tempest-QuotasAdminTestV236-443236289-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:06.188380 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-aff5af45-47e1-4267-87ef-8e562db1b132 tempest-QuotasAdminTestV236-443236289 tempest-QuotasAdminTestV236-443236289-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:06.190972 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-aff5af45-47e1-4267-87ef-8e562db1b132 tempest-QuotasAdminTestV236-443236289 tempest-QuotasAdminTestV236-443236289-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:06.193157 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-aff5af45-47e1-4267-87ef-8e562db1b132 tempest-QuotasAdminTestV236-443236289 tempest-QuotasAdminTestV236-443236289-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:06.193799 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-aff5af45-47e1-4267-87ef-8e562db1b132 tempest-QuotasAdminTestV236-443236289 tempest-QuotasAdminTestV236-443236289-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:06.312749 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-aff5af45-47e1-4267-87ef-8e562db1b132 tempest-QuotasAdminTestV236-443236289 tempest-QuotasAdminTestV236-443236289-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:06.313765 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-aff5af45-47e1-4267-87ef-8e562db1b132 tempest-QuotasAdminTestV236-443236289 tempest-QuotasAdminTestV236-443236289-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:06.314230 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-aff5af45-47e1-4267-87ef-8e562db1b132 tempest-QuotasAdminTestV236-443236289 tempest-QuotasAdminTestV236-443236289-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:06.315330 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-aff5af45-47e1-4267-87ef-8e562db1b132 tempest-QuotasAdminTestV236-443236289 tempest-QuotasAdminTestV236-443236289-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:06.315859 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-aff5af45-47e1-4267-87ef-8e562db1b132 tempest-QuotasAdminTestV236-443236289 tempest-QuotasAdminTestV236-443236289-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:06.316366 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-aff5af45-47e1-4267-87ef-8e562db1b132 tempest-QuotasAdminTestV236-443236289 tempest-QuotasAdminTestV236-443236289-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:06.438462 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-f7a1dcf5-3867-460c-9278-e4ea7c7b983c tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64648d3c6f5c423e83ff023e7bf6550a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434532ba922f406d8d8c197d3a57ffc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:06.447745 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-f7a1dcf5-3867-460c-9278-e4ea7c7b983c tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] 10.222.0.58 "GET /compute/v2.1/servers/37093f4d-0663-4b69-a48f-5fd757acd9c0" status: 200 len: 1320 microversion: 2.1 time: 0.364432 Aug 10 22:56:06.449614 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 100/180] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:56:06 2022] GET /compute/v2.1/servers/37093f4d-0663-4b69-a48f-5fd757acd9c0 => generated 1320 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:56:06.508038 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-aff5af45-47e1-4267-87ef-8e562db1b132 tempest-QuotasAdminTestV236-443236289 tempest-QuotasAdminTestV236-443236289-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-quota-sets/d7342e070fe34f55b91f33ba77e25b38?user_id=44bacfd2d8d5409ebf986ce938d5bce5" status: 200 len: 240 microversion: 2.36 time: 1.123265 Aug 10 22:56:06.509013 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 81/181] 10.222.0.58 () {62 vars in 1384 bytes} [Wed Aug 10 22:56:05 2022] PUT /compute/v2.1/os-quota-sets/d7342e070fe34f55b91f33ba77e25b38?user_id=44bacfd2d8d5409ebf986ce938d5bce5 => generated 240 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 22:56:06.537900 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-a351a84f-0705-43b7-bb49-68ba0e793244 tempest-QuotasAdminTestV236-443236289 tempest-QuotasAdminTestV236-443236289-project-admin] Calling method '.version_select at 0x7f847de485e0>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:06.833239 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c195f14a-6bde-4c76-a1c8-41aad69eda18 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:06.834350 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-c195f14a-6bde-4c76-a1c8-41aad69eda18 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] [instance: 155e0037-0bdb-4a93-af44-de6903bc2891] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:56:06.851469 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c195f14a-6bde-4c76-a1c8-41aad69eda18 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:06.853271 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c195f14a-6bde-4c76-a1c8-41aad69eda18 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:06.853708 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c195f14a-6bde-4c76-a1c8-41aad69eda18 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:06.856217 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c195f14a-6bde-4c76-a1c8-41aad69eda18 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:06.856891 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c195f14a-6bde-4c76-a1c8-41aad69eda18 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:06.857316 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c195f14a-6bde-4c76-a1c8-41aad69eda18 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:07.190760 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-c195f14a-6bde-4c76-a1c8-41aad69eda18 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd644627ab14e55803c1d5981b9859a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a37b95a10245b796d26c1b35036827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:07.202669 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-c195f14a-6bde-4c76-a1c8-41aad69eda18 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] 10.222.0.58 "GET /compute/v2.1/servers/155e0037-0bdb-4a93-af44-de6903bc2891" status: 200 len: 1488 microversion: 2.1 time: 0.375206 Aug 10 22:56:07.207307 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 82/182] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:56:06 2022] GET /compute/v2.1/servers/155e0037-0bdb-4a93-af44-de6903bc2891 => generated 1488 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:56:07.234664 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-1eca68f5-c317-4803-8776-94a8984ae722 tempest-AggregatesAdminTestJSON-1841140741 tempest-AggregatesAdminTestJSON-1841140741-project-admin] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:07.235579 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-1eca68f5-c317-4803-8776-94a8984ae722 tempest-AggregatesAdminTestJSON-1841140741 tempest-AggregatesAdminTestJSON-1841140741-project-admin] [instance: 155e0037-0bdb-4a93-af44-de6903bc2891] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:56:07.249768 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1eca68f5-c317-4803-8776-94a8984ae722 tempest-AggregatesAdminTestJSON-1841140741 tempest-AggregatesAdminTestJSON-1841140741-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:07.250272 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1eca68f5-c317-4803-8776-94a8984ae722 tempest-AggregatesAdminTestJSON-1841140741 tempest-AggregatesAdminTestJSON-1841140741-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:07.250719 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1eca68f5-c317-4803-8776-94a8984ae722 tempest-AggregatesAdminTestJSON-1841140741 tempest-AggregatesAdminTestJSON-1841140741-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:07.251475 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1eca68f5-c317-4803-8776-94a8984ae722 tempest-AggregatesAdminTestJSON-1841140741 tempest-AggregatesAdminTestJSON-1841140741-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:07.251935 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1eca68f5-c317-4803-8776-94a8984ae722 tempest-AggregatesAdminTestJSON-1841140741 tempest-AggregatesAdminTestJSON-1841140741-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:07.252381 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1eca68f5-c317-4803-8776-94a8984ae722 tempest-AggregatesAdminTestJSON-1841140741 tempest-AggregatesAdminTestJSON-1841140741-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:07.300223 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-a351a84f-0705-43b7-bb49-68ba0e793244 tempest-QuotasAdminTestV236-443236289 tempest-QuotasAdminTestV236-443236289-project-admin] 10.222.0.58 "GET /compute/v2.1/os-quota-sets/d7342e070fe34f55b91f33ba77e25b38?user_id=44bacfd2d8d5409ebf986ce938d5bce5" status: 200 len: 282 microversion: 2.36 time: 0.768167 Aug 10 22:56:07.301706 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 101/183] 10.222.0.58 () {60 vars in 1364 bytes} [Wed Aug 10 22:56:06 2022] GET /compute/v2.1/os-quota-sets/d7342e070fe34f55b91f33ba77e25b38?user_id=44bacfd2d8d5409ebf986ce938d5bce5 => generated 282 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 22:56:08.138455 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-1eca68f5-c317-4803-8776-94a8984ae722 tempest-AggregatesAdminTestJSON-1841140741 tempest-AggregatesAdminTestJSON-1841140741-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/155e0037-0bdb-4a93-af44-de6903bc2891" status: 200 len: 1641 microversion: 2.1 time: 0.907964 Aug 10 22:56:08.140203 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-41e2f346-164d-4a38-aba7-49e8a1796ec9 tempest-HypervisorAdminTestJSON-2127193285 tempest-HypervisorAdminTestJSON-2127193285-project-admin] Calling method '.version_select at 0x7f847deee8b0>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:08.140920 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 83/184] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:56:07 2022] GET /compute/v2.1/servers/155e0037-0bdb-4a93-af44-de6903bc2891 => generated 1641 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:56:08.157066 n-d-850468-14 devstack@n-api.service[122632]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:56:08.157066 n-d-850468-14 devstack@n-api.service[122632]: warnings.warn(msg) Aug 10 22:56:08.158452 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-41e2f346-164d-4a38-aba7-49e8a1796ec9 tempest-HypervisorAdminTestJSON-2127193285 tempest-HypervisorAdminTestJSON-2127193285-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:08.159067 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-41e2f346-164d-4a38-aba7-49e8a1796ec9 tempest-HypervisorAdminTestJSON-2127193285 tempest-HypervisorAdminTestJSON-2127193285-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:08.160493 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-41e2f346-164d-4a38-aba7-49e8a1796ec9 tempest-HypervisorAdminTestJSON-2127193285 tempest-HypervisorAdminTestJSON-2127193285-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:08.166698 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-d45dd7ff-bf44-469a-8044-bb3b7dfd108c tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:08.171469 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-d45dd7ff-bf44-469a-8044-bb3b7dfd108c tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] [instance: 37093f4d-0663-4b69-a48f-5fd757acd9c0] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:56:08.199305 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d45dd7ff-bf44-469a-8044-bb3b7dfd108c tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:08.201297 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d45dd7ff-bf44-469a-8044-bb3b7dfd108c tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:08.202051 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d45dd7ff-bf44-469a-8044-bb3b7dfd108c tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:08.205045 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d45dd7ff-bf44-469a-8044-bb3b7dfd108c tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:08.207130 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d45dd7ff-bf44-469a-8044-bb3b7dfd108c tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:08.210990 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d45dd7ff-bf44-469a-8044-bb3b7dfd108c tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:08.216673 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-41e2f346-164d-4a38-aba7-49e8a1796ec9 tempest-HypervisorAdminTestJSON-2127193285 tempest-HypervisorAdminTestJSON-2127193285-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:08.217996 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-41e2f346-164d-4a38-aba7-49e8a1796ec9 tempest-HypervisorAdminTestJSON-2127193285 tempest-HypervisorAdminTestJSON-2127193285-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:08.219063 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-41e2f346-164d-4a38-aba7-49e8a1796ec9 tempest-HypervisorAdminTestJSON-2127193285 tempest-HypervisorAdminTestJSON-2127193285-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:08.249835 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-41e2f346-164d-4a38-aba7-49e8a1796ec9 tempest-HypervisorAdminTestJSON-2127193285 tempest-HypervisorAdminTestJSON-2127193285-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:08.250336 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-41e2f346-164d-4a38-aba7-49e8a1796ec9 tempest-HypervisorAdminTestJSON-2127193285 tempest-HypervisorAdminTestJSON-2127193285-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:08.251664 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-41e2f346-164d-4a38-aba7-49e8a1796ec9 tempest-HypervisorAdminTestJSON-2127193285 tempest-HypervisorAdminTestJSON-2127193285-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:08.263000 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-41e2f346-164d-4a38-aba7-49e8a1796ec9 tempest-HypervisorAdminTestJSON-2127193285 tempest-HypervisorAdminTestJSON-2127193285-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.926427 Aug 10 22:56:08.264374 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 102/185] 10.222.0.58 () {58 vars in 1146 bytes} [Wed Aug 10 22:56:07 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 22:56:08.271446 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-eb1761d8-0dfb-4bda-b2e3-09dc9e250894 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:08.272622 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-eb1761d8-0dfb-4bda-b2e3-09dc9e250894 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] [instance: 155e0037-0bdb-4a93-af44-de6903bc2891] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:56:08.279910 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-eb1761d8-0dfb-4bda-b2e3-09dc9e250894 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:08.280732 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-eb1761d8-0dfb-4bda-b2e3-09dc9e250894 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:08.281609 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-eb1761d8-0dfb-4bda-b2e3-09dc9e250894 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:08.282550 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-eb1761d8-0dfb-4bda-b2e3-09dc9e250894 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:08.283247 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-eb1761d8-0dfb-4bda-b2e3-09dc9e250894 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:08.284402 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-eb1761d8-0dfb-4bda-b2e3-09dc9e250894 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:08.324062 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-eb1761d8-0dfb-4bda-b2e3-09dc9e250894 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] [instance: 155e0037-0bdb-4a93-af44-de6903bc2891] Going to try to terminate instance {{(pid=122632) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 22:56:08.624547 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-eb1761d8-0dfb-4bda-b2e3-09dc9e250894 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] 10.222.0.58 "DELETE /compute/v2.1/servers/155e0037-0bdb-4a93-af44-de6903bc2891" status: 204 len: 0 microversion: 2.1 time: 0.357363 Aug 10 22:56:08.631025 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 103/186] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 22:56:08 2022] DELETE /compute/v2.1/servers/155e0037-0bdb-4a93-af44-de6903bc2891 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 22:56:08.640025 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-516d4c92-f61d-4e15-b655-edb551ec96a7 tempest-HypervisorAdminTestJSON-2127193285 tempest-HypervisorAdminTestJSON-2127193285-project-admin] Calling method '.version_select at 0x7f847ddd4670>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:08.641341 n-d-850468-14 devstack@n-api.service[122632]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:56:08.641341 n-d-850468-14 devstack@n-api.service[122632]: warnings.warn(msg) Aug 10 22:56:08.644250 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-516d4c92-f61d-4e15-b655-edb551ec96a7 tempest-HypervisorAdminTestJSON-2127193285 tempest-HypervisorAdminTestJSON-2127193285-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:08.645896 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-516d4c92-f61d-4e15-b655-edb551ec96a7 tempest-HypervisorAdminTestJSON-2127193285 tempest-HypervisorAdminTestJSON-2127193285-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:08.648943 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-516d4c92-f61d-4e15-b655-edb551ec96a7 tempest-HypervisorAdminTestJSON-2127193285 tempest-HypervisorAdminTestJSON-2127193285-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:08.669896 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-516d4c92-f61d-4e15-b655-edb551ec96a7 tempest-HypervisorAdminTestJSON-2127193285 tempest-HypervisorAdminTestJSON-2127193285-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:08.670985 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-516d4c92-f61d-4e15-b655-edb551ec96a7 tempest-HypervisorAdminTestJSON-2127193285 tempest-HypervisorAdminTestJSON-2127193285-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:08.671690 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-516d4c92-f61d-4e15-b655-edb551ec96a7 tempest-HypervisorAdminTestJSON-2127193285 tempest-HypervisorAdminTestJSON-2127193285-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:08.692443 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-516d4c92-f61d-4e15-b655-edb551ec96a7 tempest-HypervisorAdminTestJSON-2127193285 tempest-HypervisorAdminTestJSON-2127193285-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:08.693784 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-516d4c92-f61d-4e15-b655-edb551ec96a7 tempest-HypervisorAdminTestJSON-2127193285 tempest-HypervisorAdminTestJSON-2127193285-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:08.694418 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-516d4c92-f61d-4e15-b655-edb551ec96a7 tempest-HypervisorAdminTestJSON-2127193285 tempest-HypervisorAdminTestJSON-2127193285-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:08.707477 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-516d4c92-f61d-4e15-b655-edb551ec96a7 tempest-HypervisorAdminTestJSON-2127193285 tempest-HypervisorAdminTestJSON-2127193285-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1509 microversion: 2.1 time: 0.073941 Aug 10 22:56:08.710112 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 104/187] 10.222.0.58 () {58 vars in 1167 bytes} [Wed Aug 10 22:56:08 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1509 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:56:08.717903 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-643abe5d-53fe-486c-bcc3-12d06101e648 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:08.719020 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-643abe5d-53fe-486c-bcc3-12d06101e648 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] [instance: 155e0037-0bdb-4a93-af44-de6903bc2891] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:56:08.737135 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-643abe5d-53fe-486c-bcc3-12d06101e648 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:08.742532 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-643abe5d-53fe-486c-bcc3-12d06101e648 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:08.743407 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-643abe5d-53fe-486c-bcc3-12d06101e648 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:08.745070 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-643abe5d-53fe-486c-bcc3-12d06101e648 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:08.748360 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-643abe5d-53fe-486c-bcc3-12d06101e648 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:08.752367 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-643abe5d-53fe-486c-bcc3-12d06101e648 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:09.178679 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-d45dd7ff-bf44-469a-8044-bb3b7dfd108c tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64648d3c6f5c423e83ff023e7bf6550a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434532ba922f406d8d8c197d3a57ffc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:09.191731 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-d45dd7ff-bf44-469a-8044-bb3b7dfd108c tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] 10.222.0.58 "GET /compute/v2.1/servers/37093f4d-0663-4b69-a48f-5fd757acd9c0" status: 200 len: 1320 microversion: 2.1 time: 1.047139 Aug 10 22:56:09.204241 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 84/188] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:56:08 2022] GET /compute/v2.1/servers/37093f4d-0663-4b69-a48f-5fd757acd9c0 => generated 1320 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:56:09.213555 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-26d51f2c-2988-402f-a5a4-d176426cba61 tempest-HypervisorAdminTestJSON-2127193285 tempest-HypervisorAdminTestJSON-2127193285-project-admin] Calling method '.version_select at 0x7f847dc9ddc0>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:09.215238 n-d-850468-14 devstack@n-api.service[122633]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:56:09.215238 n-d-850468-14 devstack@n-api.service[122633]: warnings.warn(msg) Aug 10 22:56:09.219415 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-26d51f2c-2988-402f-a5a4-d176426cba61 tempest-HypervisorAdminTestJSON-2127193285 tempest-HypervisorAdminTestJSON-2127193285-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:09.221802 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-26d51f2c-2988-402f-a5a4-d176426cba61 tempest-HypervisorAdminTestJSON-2127193285 tempest-HypervisorAdminTestJSON-2127193285-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:09.223136 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-26d51f2c-2988-402f-a5a4-d176426cba61 tempest-HypervisorAdminTestJSON-2127193285 tempest-HypervisorAdminTestJSON-2127193285-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:09.251952 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-26d51f2c-2988-402f-a5a4-d176426cba61 tempest-HypervisorAdminTestJSON-2127193285 tempest-HypervisorAdminTestJSON-2127193285-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:09.254968 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-26d51f2c-2988-402f-a5a4-d176426cba61 tempest-HypervisorAdminTestJSON-2127193285 tempest-HypervisorAdminTestJSON-2127193285-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:09.255522 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-26d51f2c-2988-402f-a5a4-d176426cba61 tempest-HypervisorAdminTestJSON-2127193285 tempest-HypervisorAdminTestJSON-2127193285-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:09.282878 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-26d51f2c-2988-402f-a5a4-d176426cba61 tempest-HypervisorAdminTestJSON-2127193285 tempest-HypervisorAdminTestJSON-2127193285-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:09.283476 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-26d51f2c-2988-402f-a5a4-d176426cba61 tempest-HypervisorAdminTestJSON-2127193285 tempest-HypervisorAdminTestJSON-2127193285-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:09.284916 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-26d51f2c-2988-402f-a5a4-d176426cba61 tempest-HypervisorAdminTestJSON-2127193285 tempest-HypervisorAdminTestJSON-2127193285-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:09.296477 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-26d51f2c-2988-402f-a5a4-d176426cba61 tempest-HypervisorAdminTestJSON-2127193285 tempest-HypervisorAdminTestJSON-2127193285-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.086912 Aug 10 22:56:09.306913 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 85/189] 10.222.0.58 () {58 vars in 1146 bytes} [Wed Aug 10 22:56:09 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:56:09.313610 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-e56a24cd-405e-48cb-8816-2e6e711ea73a tempest-HypervisorAdminTestJSON-2127193285 tempest-HypervisorAdminTestJSON-2127193285-project-admin] Calling method '.version_select at 0x7f847dc67040>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:09.318641 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-643abe5d-53fe-486c-bcc3-12d06101e648 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd644627ab14e55803c1d5981b9859a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a37b95a10245b796d26c1b35036827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:09.330884 n-d-850468-14 devstack@n-api.service[122633]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:56:09.330884 n-d-850468-14 devstack@n-api.service[122633]: warnings.warn(msg) Aug 10 22:56:09.333812 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e56a24cd-405e-48cb-8816-2e6e711ea73a tempest-HypervisorAdminTestJSON-2127193285 tempest-HypervisorAdminTestJSON-2127193285-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:09.335678 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e56a24cd-405e-48cb-8816-2e6e711ea73a tempest-HypervisorAdminTestJSON-2127193285 tempest-HypervisorAdminTestJSON-2127193285-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:09.337469 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e56a24cd-405e-48cb-8816-2e6e711ea73a tempest-HypervisorAdminTestJSON-2127193285 tempest-HypervisorAdminTestJSON-2127193285-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:09.339463 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-643abe5d-53fe-486c-bcc3-12d06101e648 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] 10.222.0.58 "GET /compute/v2.1/servers/155e0037-0bdb-4a93-af44-de6903bc2891" status: 200 len: 1494 microversion: 2.1 time: 0.625449 Aug 10 22:56:09.340541 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 105/190] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:56:08 2022] GET /compute/v2.1/servers/155e0037-0bdb-4a93-af44-de6903bc2891 => generated 1494 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:56:09.358292 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e56a24cd-405e-48cb-8816-2e6e711ea73a tempest-HypervisorAdminTestJSON-2127193285 tempest-HypervisorAdminTestJSON-2127193285-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:09.359031 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e56a24cd-405e-48cb-8816-2e6e711ea73a tempest-HypervisorAdminTestJSON-2127193285 tempest-HypervisorAdminTestJSON-2127193285-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:09.360380 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e56a24cd-405e-48cb-8816-2e6e711ea73a tempest-HypervisorAdminTestJSON-2127193285 tempest-HypervisorAdminTestJSON-2127193285-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:09.373086 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-e56a24cd-405e-48cb-8816-2e6e711ea73a tempest-HypervisorAdminTestJSON-2127193285 tempest-HypervisorAdminTestJSON-2127193285-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 760 microversion: 2.1 time: 0.064833 Aug 10 22:56:09.390054 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 86/191] 10.222.0.58 () {58 vars in 1152 bytes} [Wed Aug 10 22:56:09 2022] GET /compute/v2.1/os-hypervisors/1 => generated 760 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:56:09.398072 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-7add65fc-a981-4ff7-9baf-42e7da577026 tempest-HypervisorAdminTestJSON-2127193285 tempest-HypervisorAdminTestJSON-2127193285-project-admin] Calling method '.version_select at 0x7f847ddf23a0>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:09.399648 n-d-850468-14 devstack@n-api.service[122632]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:statistics": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:56:09.399648 n-d-850468-14 devstack@n-api.service[122632]: warnings.warn(msg) Aug 10 22:56:09.401159 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7add65fc-a981-4ff7-9baf-42e7da577026 tempest-HypervisorAdminTestJSON-2127193285 tempest-HypervisorAdminTestJSON-2127193285-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:09.401963 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7add65fc-a981-4ff7-9baf-42e7da577026 tempest-HypervisorAdminTestJSON-2127193285 tempest-HypervisorAdminTestJSON-2127193285-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:09.402879 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7add65fc-a981-4ff7-9baf-42e7da577026 tempest-HypervisorAdminTestJSON-2127193285 tempest-HypervisorAdminTestJSON-2127193285-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:09.420252 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-1da3e4b5-3432-4cfc-9216-adbe46a4e004 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-651322857", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "1169490990", "adminPass": "***", "networks": [{"uuid": "e735bdfc-e561-47ce-9a70-437a9b0a31f9"}], "security_groups": [{"name": "tempest-securitygroup--2109682698"}], "key_name": "tempest-keypair-1466905669", "user_data": "}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:56:09.472372 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-7add65fc-a981-4ff7-9baf-42e7da577026 tempest-HypervisorAdminTestJSON-2127193285 tempest-HypervisorAdminTestJSON-2127193285-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.076516 Aug 10 22:56:09.473410 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 106/192] 10.222.0.58 () {58 vars in 1179 bytes} [Wed Aug 10 22:56:09 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:56:09.508622 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-b761d48b-525e-4196-b720-977307a6f864 req-5f243898-6a3d-480f-8af7-752579f68715 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37093f4d-0663-4b69-a48f-5fd757acd9c0", "name": "network-vif-plugged", "status": "completed", "tag": "9668aa85-ea99-41cb-95a0-d2a4cafadd33"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:56:09.540504 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-b761d48b-525e-4196-b720-977307a6f864 req-5f243898-6a3d-480f-8af7-752579f68715 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:09.554191 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-b761d48b-525e-4196-b720-977307a6f864 req-5f243898-6a3d-480f-8af7-752579f68715 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:09.556245 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-b761d48b-525e-4196-b720-977307a6f864 req-5f243898-6a3d-480f-8af7-752579f68715 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:09.570893 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-b761d48b-525e-4196-b720-977307a6f864 req-5f243898-6a3d-480f-8af7-752579f68715 service nova] Creating event network-vif-plugged:9668aa85-ea99-41cb-95a0-d2a4cafadd33 for instance 37093f4d-0663-4b69-a48f-5fd757acd9c0 on n-h2-850468-14 Aug 10 22:56:09.577750 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-b761d48b-525e-4196-b720-977307a6f864 req-5f243898-6a3d-480f-8af7-752579f68715 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085898 Aug 10 22:56:09.578992 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 107/193] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 22:56:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:56:09.584509 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-ea4cece4-aa7a-4bcb-850b-d7d199262785 tempest-HypervisorAdminTestJSON-2127193285 tempest-HypervisorAdminTestJSON-2127193285-project-admin] Calling method '.version_select at 0x7f847de485e0>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:09.585962 n-d-850468-14 devstack@n-api.service[122632]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:56:09.585962 n-d-850468-14 devstack@n-api.service[122632]: warnings.warn(msg) Aug 10 22:56:09.598219 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ea4cece4-aa7a-4bcb-850b-d7d199262785 tempest-HypervisorAdminTestJSON-2127193285 tempest-HypervisorAdminTestJSON-2127193285-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:09.600630 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ea4cece4-aa7a-4bcb-850b-d7d199262785 tempest-HypervisorAdminTestJSON-2127193285 tempest-HypervisorAdminTestJSON-2127193285-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:09.613726 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ea4cece4-aa7a-4bcb-850b-d7d199262785 tempest-HypervisorAdminTestJSON-2127193285 tempest-HypervisorAdminTestJSON-2127193285-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:09.645968 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ea4cece4-aa7a-4bcb-850b-d7d199262785 tempest-HypervisorAdminTestJSON-2127193285 tempest-HypervisorAdminTestJSON-2127193285-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:09.646903 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ea4cece4-aa7a-4bcb-850b-d7d199262785 tempest-HypervisorAdminTestJSON-2127193285 tempest-HypervisorAdminTestJSON-2127193285-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:09.647512 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ea4cece4-aa7a-4bcb-850b-d7d199262785 tempest-HypervisorAdminTestJSON-2127193285 tempest-HypervisorAdminTestJSON-2127193285-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:09.663388 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ea4cece4-aa7a-4bcb-850b-d7d199262785 tempest-HypervisorAdminTestJSON-2127193285 tempest-HypervisorAdminTestJSON-2127193285-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:09.664040 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ea4cece4-aa7a-4bcb-850b-d7d199262785 tempest-HypervisorAdminTestJSON-2127193285 tempest-HypervisorAdminTestJSON-2127193285-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:09.664622 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ea4cece4-aa7a-4bcb-850b-d7d199262785 tempest-HypervisorAdminTestJSON-2127193285 tempest-HypervisorAdminTestJSON-2127193285-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:09.674867 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-ea4cece4-aa7a-4bcb-850b-d7d199262785 tempest-HypervisorAdminTestJSON-2127193285 tempest-HypervisorAdminTestJSON-2127193285-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.094185 Aug 10 22:56:09.676213 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 108/194] 10.222.0.58 () {58 vars in 1146 bytes} [Wed Aug 10 22:56:09 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:56:09.689606 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-032e418f-a785-44b3-b2c8-ded0568d55db tempest-HypervisorAdminTestJSON-2127193285 tempest-HypervisorAdminTestJSON-2127193285-project-admin] Calling method '.version_select at 0x7f847de17b80>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:09.689606 n-d-850468-14 devstack@n-api.service[122632]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:56:09.689606 n-d-850468-14 devstack@n-api.service[122632]: warnings.warn(msg) Aug 10 22:56:09.691387 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-032e418f-a785-44b3-b2c8-ded0568d55db tempest-HypervisorAdminTestJSON-2127193285 tempest-HypervisorAdminTestJSON-2127193285-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:09.692106 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-032e418f-a785-44b3-b2c8-ded0568d55db tempest-HypervisorAdminTestJSON-2127193285 tempest-HypervisorAdminTestJSON-2127193285-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:09.692816 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-032e418f-a785-44b3-b2c8-ded0568d55db tempest-HypervisorAdminTestJSON-2127193285 tempest-HypervisorAdminTestJSON-2127193285-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:09.712024 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-032e418f-a785-44b3-b2c8-ded0568d55db tempest-HypervisorAdminTestJSON-2127193285 tempest-HypervisorAdminTestJSON-2127193285-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:09.712682 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-032e418f-a785-44b3-b2c8-ded0568d55db tempest-HypervisorAdminTestJSON-2127193285 tempest-HypervisorAdminTestJSON-2127193285-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:09.713264 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-032e418f-a785-44b3-b2c8-ded0568d55db tempest-HypervisorAdminTestJSON-2127193285 tempest-HypervisorAdminTestJSON-2127193285-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:09.723017 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.network.neutron [None req-1da3e4b5-3432-4cfc-9216-adbe46a4e004 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] validate_networks() for [('e735bdfc-e561-47ce-9a70-437a9b0a31f9', None, None, None, None, None)] {{(pid=122633) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 22:56:09.726418 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-032e418f-a785-44b3-b2c8-ded0568d55db tempest-HypervisorAdminTestJSON-2127193285 tempest-HypervisorAdminTestJSON-2127193285-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 760 microversion: 2.1 time: 0.042845 Aug 10 22:56:09.727433 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 109/195] 10.222.0.58 () {58 vars in 1152 bytes} [Wed Aug 10 22:56:09 2022] GET /compute/v2.1/os-hypervisors/1 => generated 760 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 22:56:09.740937 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-688cd6e6-f20a-43af-91ce-0a02a4ddcd70 tempest-HypervisorAdminTestJSON-2127193285 tempest-HypervisorAdminTestJSON-2127193285-project-admin] Calling method '.version_select at 0x7f847de17430>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:09.741746 n-d-850468-14 devstack@n-api.service[122632]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:56:09.741746 n-d-850468-14 devstack@n-api.service[122632]: warnings.warn(msg) Aug 10 22:56:09.742854 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-688cd6e6-f20a-43af-91ce-0a02a4ddcd70 tempest-HypervisorAdminTestJSON-2127193285 tempest-HypervisorAdminTestJSON-2127193285-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:09.743341 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-688cd6e6-f20a-43af-91ce-0a02a4ddcd70 tempest-HypervisorAdminTestJSON-2127193285 tempest-HypervisorAdminTestJSON-2127193285-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:09.743921 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-688cd6e6-f20a-43af-91ce-0a02a4ddcd70 tempest-HypervisorAdminTestJSON-2127193285 tempest-HypervisorAdminTestJSON-2127193285-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:09.770879 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-688cd6e6-f20a-43af-91ce-0a02a4ddcd70 tempest-HypervisorAdminTestJSON-2127193285 tempest-HypervisorAdminTestJSON-2127193285-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:09.771743 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-688cd6e6-f20a-43af-91ce-0a02a4ddcd70 tempest-HypervisorAdminTestJSON-2127193285 tempest-HypervisorAdminTestJSON-2127193285-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:09.776270 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-688cd6e6-f20a-43af-91ce-0a02a4ddcd70 tempest-HypervisorAdminTestJSON-2127193285 tempest-HypervisorAdminTestJSON-2127193285-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:09.785112 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:56:09.794253 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-688cd6e6-f20a-43af-91ce-0a02a4ddcd70 tempest-HypervisorAdminTestJSON-2127193285 tempest-HypervisorAdminTestJSON-2127193285-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 760 microversion: 2.1 time: 0.056960 Aug 10 22:56:09.796380 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 110/196] 10.222.0.58 () {58 vars in 1152 bytes} [Wed Aug 10 22:56:09 2022] GET /compute/v2.1/os-hypervisors/2 => generated 760 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 22:56:09.830342 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-bb833633-067e-4492-99f3-6d202c209d5f tempest-HypervisorAdminTestJSON-2127193285 tempest-HypervisorAdminTestJSON-2127193285-project-admin] Calling method '.version_select at 0x7f847de17160>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:09.831390 n-d-850468-14 devstack@n-api.service[122632]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:56:09.831390 n-d-850468-14 devstack@n-api.service[122632]: warnings.warn(msg) Aug 10 22:56:09.833315 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bb833633-067e-4492-99f3-6d202c209d5f tempest-HypervisorAdminTestJSON-2127193285 tempest-HypervisorAdminTestJSON-2127193285-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:09.834038 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bb833633-067e-4492-99f3-6d202c209d5f tempest-HypervisorAdminTestJSON-2127193285 tempest-HypervisorAdminTestJSON-2127193285-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:09.834665 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bb833633-067e-4492-99f3-6d202c209d5f tempest-HypervisorAdminTestJSON-2127193285 tempest-HypervisorAdminTestJSON-2127193285-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:09.851035 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bb833633-067e-4492-99f3-6d202c209d5f tempest-HypervisorAdminTestJSON-2127193285 tempest-HypervisorAdminTestJSON-2127193285-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:09.851841 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bb833633-067e-4492-99f3-6d202c209d5f tempest-HypervisorAdminTestJSON-2127193285 tempest-HypervisorAdminTestJSON-2127193285-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:09.852449 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bb833633-067e-4492-99f3-6d202c209d5f tempest-HypervisorAdminTestJSON-2127193285 tempest-HypervisorAdminTestJSON-2127193285-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:09.870132 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bb833633-067e-4492-99f3-6d202c209d5f tempest-HypervisorAdminTestJSON-2127193285 tempest-HypervisorAdminTestJSON-2127193285-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:09.872363 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bb833633-067e-4492-99f3-6d202c209d5f tempest-HypervisorAdminTestJSON-2127193285 tempest-HypervisorAdminTestJSON-2127193285-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:09.873023 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bb833633-067e-4492-99f3-6d202c209d5f tempest-HypervisorAdminTestJSON-2127193285 tempest-HypervisorAdminTestJSON-2127193285-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:09.914490 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-bb833633-067e-4492-99f3-6d202c209d5f tempest-HypervisorAdminTestJSON-2127193285 tempest-HypervisorAdminTestJSON-2127193285-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 176 microversion: 2.1 time: 0.088616 Aug 10 22:56:09.915825 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 111/197] 10.222.0.58 () {58 vars in 1173 bytes} [Wed Aug 10 22:56:09 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 176 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:56:10.219005 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-a4092dae-d139-4aa6-a928-64208ae53448 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:10.220588 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-a4092dae-d139-4aa6-a928-64208ae53448 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] [instance: 37093f4d-0663-4b69-a48f-5fd757acd9c0] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:56:10.552285 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a4092dae-d139-4aa6-a928-64208ae53448 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:10.553138 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a4092dae-d139-4aa6-a928-64208ae53448 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:10.554144 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a4092dae-d139-4aa6-a928-64208ae53448 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:10.555685 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a4092dae-d139-4aa6-a928-64208ae53448 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:10.556734 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a4092dae-d139-4aa6-a928-64208ae53448 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:10.557809 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a4092dae-d139-4aa6-a928-64208ae53448 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:11.347415 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-1da3e4b5-3432-4cfc-9216-adbe46a4e004 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Flavor limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 22:56:11.348254 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-1da3e4b5-3432-4cfc-9216-adbe46a4e004 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Image limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 22:56:11.348391 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-1da3e4b5-3432-4cfc-9216-adbe46a4e004 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Flavor pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 22:56:11.348705 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-1da3e4b5-3432-4cfc-9216-adbe46a4e004 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Image pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 22:56:11.349627 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-1da3e4b5-3432-4cfc-9216-adbe46a4e004 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 22:56:11.371658 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1da3e4b5-3432-4cfc-9216-adbe46a4e004 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:11.373009 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1da3e4b5-3432-4cfc-9216-adbe46a4e004 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:11.373815 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1da3e4b5-3432-4cfc-9216-adbe46a4e004 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:11.375254 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1da3e4b5-3432-4cfc-9216-adbe46a4e004 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:11.376650 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1da3e4b5-3432-4cfc-9216-adbe46a4e004 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:11.377221 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1da3e4b5-3432-4cfc-9216-adbe46a4e004 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:11.423958 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-1da3e4b5-3432-4cfc-9216-adbe46a4e004 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Getting quotas for project deaba512051743deb45881d76eb206ed. Resources: {'instances', 'cores', 'ram'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 22:56:11.436295 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-1da3e4b5-3432-4cfc-9216-adbe46a4e004 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Getting quotas for user eaed2a2e56f749a88c340aaccb15d2d9 and project deaba512051743deb45881d76eb206ed. Resources: {'instances', 'cores', 'ram'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 22:56:11.470398 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-a4092dae-d139-4aa6-a928-64208ae53448 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64648d3c6f5c423e83ff023e7bf6550a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434532ba922f406d8d8c197d3a57ffc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:11.474134 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-1da3e4b5-3432-4cfc-9216-adbe46a4e004 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Going to run 1 instances... {{(pid=122633) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 22:56:11.479657 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-1da3e4b5-3432-4cfc-9216-adbe46a4e004 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] [instance: ef725aca-9cd8-49a0-81cd-d23710041306] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78ad8905-f66f-4733-8be9-2b260f1fabed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122633) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 22:56:11.484150 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-a4092dae-d139-4aa6-a928-64208ae53448 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] 10.222.0.58 "GET /compute/v2.1/servers/37093f4d-0663-4b69-a48f-5fd757acd9c0" status: 200 len: 1320 microversion: 2.1 time: 1.268120 Aug 10 22:56:11.484993 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 112/198] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:56:10 2022] GET /compute/v2.1/servers/37093f4d-0663-4b69-a48f-5fd757acd9c0 => generated 1320 bytes in 1274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:56:11.497533 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-eb674dee-6727-40ad-879e-c0a745a4fb52 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:11.502396 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-eb674dee-6727-40ad-879e-c0a745a4fb52 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] [instance: 155e0037-0bdb-4a93-af44-de6903bc2891] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:56:11.515220 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-eb674dee-6727-40ad-879e-c0a745a4fb52 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:11.519924 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-eb674dee-6727-40ad-879e-c0a745a4fb52 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:11.520474 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-eb674dee-6727-40ad-879e-c0a745a4fb52 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:11.522641 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-eb674dee-6727-40ad-879e-c0a745a4fb52 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:11.530169 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-eb674dee-6727-40ad-879e-c0a745a4fb52 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:11.530742 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-eb674dee-6727-40ad-879e-c0a745a4fb52 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:11.619254 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-1da3e4b5-3432-4cfc-9216-adbe46a4e004 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.214806 Aug 10 22:56:11.619933 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 87/199] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 22:56:09 2022] POST /compute/v2.1/servers => generated 402 bytes in 2216 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 22:56:12.051064 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-4d80a452-b4f6-479e-ba8f-87e4b6cc9f7c tempest-HypervisorAdminNegativeTestJSON-2101085801 tempest-HypervisorAdminNegativeTestJSON-2101085801-project] Calling method '.version_select at 0x7f847dc67af0>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:12.051964 n-d-850468-14 devstack@n-api.service[122633]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:56:12.051964 n-d-850468-14 devstack@n-api.service[122633]: warnings.warn(msg) Aug 10 22:56:12.053077 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-4d80a452-b4f6-479e-ba8f-87e4b6cc9f7c tempest-HypervisorAdminNegativeTestJSON-2101085801 tempest-HypervisorAdminNegativeTestJSON-2101085801-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': '881a24426bfd4e31a35166c91662cf6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e47d42bb27a47edb428482a1b349cea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:12.062254 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-4d80a452-b4f6-479e-ba8f-87e4b6cc9f7c tempest-HypervisorAdminNegativeTestJSON-2101085801 tempest-HypervisorAdminNegativeTestJSON-2101085801-project] Request method failure captured: Aug 10 22:56:12.062254 n-d-850468-14 devstack@n-api.service[122633]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Aug 10 22:56:12.062254 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 22:56:12.062254 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 22:56:12.062254 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 22:56:12.062254 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 22:56:12.062254 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 22:56:12.062254 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 22:56:12.062254 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 22:56:12.062254 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 22:56:12.062254 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9DeJKjNIfJcPL2Ika2B46EAZOHon43eBsAHqY7Apc6KvJAfsPmN3WmJw1yROrj313DV7pTXwXCYpIoKhXI_fBW-BuozgGYSfX-fZKDkeFYwxT7mXmg2WdFNLlTDSnUwR1G6in2-MLptedzBxxHuFaVMpeGwfN_Kfdf3nh-RN1ZnzPbE Aug 10 22:56:12.062254 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 22:56:12.062254 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 22:56:12.062254 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 22:56:12.062254 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 22:56:12.062254 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 22:56:12.062254 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 22:56:12.062254 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 5e47d42bb27a47edb428482a1b349cea Aug 10 22:56:12.062254 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-2101085801 Aug 10 22:56:12.062254 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 22:56:12.062254 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 22:56:12.063488 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5e47d42bb27a47edb428482a1b349cea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5e47d42bb27a47edb428482a1b349cea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/5e47d42bb27a47edb428482a1b349cea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_5e47d42bb27a47edb428482a1b349cea", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 22:56:12.063488 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-2101085801 Aug 10 22:56:12.063488 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 5e47d42bb27a47edb428482a1b349cea Aug 10 22:56:12.063488 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-2101085801 Aug 10 22:56:12.063488 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-HypervisorAdminNegativeTestJSON-2101085801-project Aug 10 22:56:12.063488 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 22:56:12.063488 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 22:56:12.063488 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 881a24426bfd4e31a35166c91662cf6c Aug 10 22:56:12.063488 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-2101085801-project Aug 10 22:56:12.063488 n-d-850468-14 devstack@n-api.service[122633]: method: Aug 10 22:56:12.063488 n-d-850468-14 devstack@n-api.service[122633]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Aug 10 22:56:12.063488 n-d-850468-14 devstack@n-api.service[122633]: action_args: {} Aug 10 22:56:12.063488 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 22:56:12.064185 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:56:12.064185 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:56:12.064185 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:56:12.064185 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 22:56:12.064185 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 22:56:12.064185 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 22:56:12.064185 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 22:56:12.064185 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 22:56:12.064185 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 22:56:12.064185 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Aug 10 22:56:12.064185 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return self._detail(req) Aug 10 22:56:12.064185 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Aug 10 22:56:12.064185 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Aug 10 22:56:12.064185 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 10 22:56:12.064185 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 10 22:56:12.064185 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 10 22:56:12.064185 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 10 22:56:12.064185 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 10 22:56:12.064185 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 10 22:56:12.065933 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 10 22:56:12.065933 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise self.value Aug 10 22:56:12.065933 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 10 22:56:12.065933 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 10 22:56:12.065933 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 10 22:56:12.065933 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 10 22:56:12.065933 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 10 22:56:12.065933 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 10 22:56:12.065933 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Aug 10 22:56:12.065933 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:56:12.065933 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:56:12.065933 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:56:12.065933 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:56:12.065933 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:56:12.065933 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:56:12.065933 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 10 22:56:12.065933 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 10 22:56:12.065933 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Aug 10 22:56:12.065933 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:56:12.067330 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-4d80a452-b4f6-479e-ba8f-87e4b6cc9f7c tempest-HypervisorAdminNegativeTestJSON-2101085801 tempest-HypervisorAdminNegativeTestJSON-2101085801-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 22:56:12.067330 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-4d80a452-b4f6-479e-ba8f-87e4b6cc9f7c tempest-HypervisorAdminNegativeTestJSON-2101085801 tempest-HypervisorAdminNegativeTestJSON-2101085801-project] 10.222.0.58 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.435715 Aug 10 22:56:12.068098 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 88/200] 10.222.0.58 () {58 vars in 1167 bytes} [Wed Aug 10 22:56:11 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 440 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 10 22:56:12.074086 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-44c95ff1-b2ae-4c39-a3be-ea600710763f tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:12.074867 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-44c95ff1-b2ae-4c39-a3be-ea600710763f tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] [instance: ef725aca-9cd8-49a0-81cd-d23710041306] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:56:12.202676 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-44c95ff1-b2ae-4c39-a3be-ea600710763f tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaed2a2e56f749a88c340aaccb15d2d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deaba512051743deb45881d76eb206ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:12.213751 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-44c95ff1-b2ae-4c39-a3be-ea600710763f tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] 10.222.0.58 "GET /compute/v2.1/servers/ef725aca-9cd8-49a0-81cd-d23710041306" status: 200 len: 1264 microversion: 2.1 time: 0.144285 Aug 10 22:56:12.215213 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 89/201] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:56:12 2022] GET /compute/v2.1/servers/ef725aca-9cd8-49a0-81cd-d23710041306 => generated 1264 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:56:12.223088 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-af355ba5-1fda-493c-8f0e-e3c861b60a66 tempest-HypervisorAdminNegativeTestJSON-2101085801 tempest-HypervisorAdminNegativeTestJSON-2101085801-project] Calling method '.version_select at 0x7f847dd79790>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:12.225562 n-d-850468-14 devstack@n-api.service[122633]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:56:12.225562 n-d-850468-14 devstack@n-api.service[122633]: warnings.warn(msg) Aug 10 22:56:12.247325 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-af355ba5-1fda-493c-8f0e-e3c861b60a66 tempest-HypervisorAdminNegativeTestJSON-2101085801 tempest-HypervisorAdminNegativeTestJSON-2101085801-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': '881a24426bfd4e31a35166c91662cf6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e47d42bb27a47edb428482a1b349cea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:12.251173 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-af355ba5-1fda-493c-8f0e-e3c861b60a66 tempest-HypervisorAdminNegativeTestJSON-2101085801 tempest-HypervisorAdminNegativeTestJSON-2101085801-project] Request method failure captured: Aug 10 22:56:12.251173 n-d-850468-14 devstack@n-api.service[122633]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Aug 10 22:56:12.251173 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 22:56:12.251173 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 22:56:12.251173 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 22:56:12.251173 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 22:56:12.251173 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 22:56:12.251173 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 22:56:12.251173 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 22:56:12.251173 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 22:56:12.251173 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9DeJKjNIfJcPL2Ika2B46EAZOHon43eBsAHqY7Apc6KvJAfsPmN3WmJw1yROrj313DV7pTXwXCYpIoKhXI_fBW-BuozgGYSfX-fZKDkeFYwxT7mXmg2WdFNLlTDSnUwR1G6in2-MLptedzBxxHuFaVMpeGwfN_Kfdf3nh-RN1ZnzPbE Aug 10 22:56:12.251173 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 22:56:12.251173 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 22:56:12.251173 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 22:56:12.251173 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 22:56:12.251173 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 22:56:12.251173 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 22:56:12.251173 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 5e47d42bb27a47edb428482a1b349cea Aug 10 22:56:12.251173 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-2101085801 Aug 10 22:56:12.251173 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 22:56:12.251173 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 22:56:12.252561 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5e47d42bb27a47edb428482a1b349cea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5e47d42bb27a47edb428482a1b349cea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/5e47d42bb27a47edb428482a1b349cea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_5e47d42bb27a47edb428482a1b349cea", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 22:56:12.252561 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-2101085801 Aug 10 22:56:12.252561 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 5e47d42bb27a47edb428482a1b349cea Aug 10 22:56:12.252561 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-2101085801 Aug 10 22:56:12.252561 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-HypervisorAdminNegativeTestJSON-2101085801-project Aug 10 22:56:12.252561 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 22:56:12.252561 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 22:56:12.252561 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 881a24426bfd4e31a35166c91662cf6c Aug 10 22:56:12.252561 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-2101085801-project Aug 10 22:56:12.252561 n-d-850468-14 devstack@n-api.service[122633]: method: Aug 10 22:56:12.252561 n-d-850468-14 devstack@n-api.service[122633]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Aug 10 22:56:12.252561 n-d-850468-14 devstack@n-api.service[122633]: action_args: {} Aug 10 22:56:12.252561 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 22:56:12.253371 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:56:12.253371 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:56:12.253371 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:56:12.253371 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 22:56:12.253371 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 22:56:12.253371 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 22:56:12.253371 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 22:56:12.253371 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 22:56:12.253371 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 22:56:12.253371 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Aug 10 22:56:12.253371 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return self._index(req) Aug 10 22:56:12.253371 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Aug 10 22:56:12.253371 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Aug 10 22:56:12.253371 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 10 22:56:12.253371 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 10 22:56:12.253371 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 10 22:56:12.253371 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 10 22:56:12.253371 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 10 22:56:12.253371 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 10 22:56:12.254435 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 10 22:56:12.254435 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise self.value Aug 10 22:56:12.254435 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 10 22:56:12.254435 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 10 22:56:12.254435 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 10 22:56:12.254435 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 10 22:56:12.254435 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 10 22:56:12.254435 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 10 22:56:12.254435 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Aug 10 22:56:12.254435 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:56:12.254435 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:56:12.254435 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:56:12.254435 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:56:12.254435 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:56:12.254435 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:56:12.254435 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 10 22:56:12.254435 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 10 22:56:12.254435 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Aug 10 22:56:12.254435 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:56:12.257434 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-af355ba5-1fda-493c-8f0e-e3c861b60a66 tempest-HypervisorAdminNegativeTestJSON-2101085801 tempest-HypervisorAdminNegativeTestJSON-2101085801-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 22:56:12.257434 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-af355ba5-1fda-493c-8f0e-e3c861b60a66 tempest-HypervisorAdminNegativeTestJSON-2101085801 tempest-HypervisorAdminNegativeTestJSON-2101085801-project] 10.222.0.58 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.037383 Aug 10 22:56:12.257434 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 90/202] 10.222.0.58 () {58 vars in 1146 bytes} [Wed Aug 10 22:56:12 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 39 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 10 22:56:12.266142 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-5cf33bbc-e5dc-4a33-a9f3-9ddbce5228dd tempest-HypervisorAdminNegativeTestJSON-2101085801 tempest-HypervisorAdminNegativeTestJSON-2101085801-project] Calling method '.version_select at 0x7f847dc7d0d0>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:12.268429 n-d-850468-14 devstack@n-api.service[122633]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:statistics": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:56:12.268429 n-d-850468-14 devstack@n-api.service[122633]: warnings.warn(msg) Aug 10 22:56:12.270050 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-5cf33bbc-e5dc-4a33-a9f3-9ddbce5228dd tempest-HypervisorAdminNegativeTestJSON-2101085801 tempest-HypervisorAdminNegativeTestJSON-2101085801-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': '881a24426bfd4e31a35166c91662cf6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e47d42bb27a47edb428482a1b349cea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:12.272589 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-5cf33bbc-e5dc-4a33-a9f3-9ddbce5228dd tempest-HypervisorAdminNegativeTestJSON-2101085801 tempest-HypervisorAdminNegativeTestJSON-2101085801-project] Request method failure captured: Aug 10 22:56:12.272589 n-d-850468-14 devstack@n-api.service[122633]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Aug 10 22:56:12.272589 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 22:56:12.272589 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 22:56:12.272589 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 22:56:12.272589 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 22:56:12.272589 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 22:56:12.272589 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 22:56:12.272589 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 22:56:12.272589 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 22:56:12.272589 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9DeJKjNIfJcPL2Ika2B46EAZOHon43eBsAHqY7Apc6KvJAfsPmN3WmJw1yROrj313DV7pTXwXCYpIoKhXI_fBW-BuozgGYSfX-fZKDkeFYwxT7mXmg2WdFNLlTDSnUwR1G6in2-MLptedzBxxHuFaVMpeGwfN_Kfdf3nh-RN1ZnzPbE Aug 10 22:56:12.272589 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 22:56:12.272589 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 22:56:12.272589 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 22:56:12.272589 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 22:56:12.272589 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 22:56:12.272589 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 22:56:12.272589 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 5e47d42bb27a47edb428482a1b349cea Aug 10 22:56:12.272589 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-2101085801 Aug 10 22:56:12.272589 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 22:56:12.272589 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 22:56:12.273974 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5e47d42bb27a47edb428482a1b349cea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5e47d42bb27a47edb428482a1b349cea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/5e47d42bb27a47edb428482a1b349cea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_5e47d42bb27a47edb428482a1b349cea", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 22:56:12.273974 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-2101085801 Aug 10 22:56:12.273974 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 5e47d42bb27a47edb428482a1b349cea Aug 10 22:56:12.273974 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-2101085801 Aug 10 22:56:12.273974 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-HypervisorAdminNegativeTestJSON-2101085801-project Aug 10 22:56:12.273974 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 22:56:12.273974 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 22:56:12.273974 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 881a24426bfd4e31a35166c91662cf6c Aug 10 22:56:12.273974 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-2101085801-project Aug 10 22:56:12.273974 n-d-850468-14 devstack@n-api.service[122633]: method: Aug 10 22:56:12.273974 n-d-850468-14 devstack@n-api.service[122633]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Aug 10 22:56:12.273974 n-d-850468-14 devstack@n-api.service[122633]: action_args: {} Aug 10 22:56:12.273974 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 22:56:12.274808 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:56:12.274808 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:56:12.274808 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:56:12.274808 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 22:56:12.274808 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 22:56:12.274808 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 22:56:12.274808 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 22:56:12.274808 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 22:56:12.274808 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 22:56:12.274808 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Aug 10 22:56:12.274808 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Aug 10 22:56:12.274808 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 10 22:56:12.274808 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 10 22:56:12.274808 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 10 22:56:12.274808 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 10 22:56:12.274808 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 10 22:56:12.274808 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 10 22:56:12.274808 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 10 22:56:12.274808 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise self.value Aug 10 22:56:12.275990 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 10 22:56:12.275990 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 10 22:56:12.275990 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 10 22:56:12.275990 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 10 22:56:12.275990 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 10 22:56:12.275990 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 10 22:56:12.275990 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Aug 10 22:56:12.275990 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:56:12.275990 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:56:12.275990 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:56:12.275990 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:56:12.275990 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:56:12.275990 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:56:12.275990 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 10 22:56:12.275990 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 10 22:56:12.275990 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Aug 10 22:56:12.275990 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:56:12.287098 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-5cf33bbc-e5dc-4a33-a9f3-9ddbce5228dd tempest-HypervisorAdminNegativeTestJSON-2101085801 tempest-HypervisorAdminNegativeTestJSON-2101085801-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 22:56:12.288519 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-5cf33bbc-e5dc-4a33-a9f3-9ddbce5228dd tempest-HypervisorAdminNegativeTestJSON-2101085801 tempest-HypervisorAdminNegativeTestJSON-2101085801-project] 10.222.0.58 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.028354 Aug 10 22:56:12.290055 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 91/203] 10.222.0.58 () {58 vars in 1179 bytes} [Wed Aug 10 22:56:12 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 31 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 10 22:56:12.296378 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-eb674dee-6727-40ad-879e-c0a745a4fb52 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd644627ab14e55803c1d5981b9859a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9a37b95a10245b796d26c1b35036827', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:12.312551 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-eb674dee-6727-40ad-879e-c0a745a4fb52 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] 10.222.0.58 "GET /compute/v2.1/servers/155e0037-0bdb-4a93-af44-de6903bc2891" status: 200 len: 1452 microversion: 2.1 time: 0.821363 Aug 10 22:56:12.313916 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 113/204] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:56:11 2022] GET /compute/v2.1/servers/155e0037-0bdb-4a93-af44-de6903bc2891 => generated 1452 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:56:12.401853 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-ee99b621-38fc-4729-bc23-afa7efe8ca4e req-8d241450-fd10-459d-8231-2324aac78c3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "155e0037-0bdb-4a93-af44-de6903bc2891", "name": "network-vif-deleted", "tag": "d7b21e9c-cec7-4ec0-be49-df050e213b01"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:56:12.429741 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-ee99b621-38fc-4729-bc23-afa7efe8ca4e req-8d241450-fd10-459d-8231-2324aac78c3d service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:12.430729 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-ee99b621-38fc-4729-bc23-afa7efe8ca4e req-8d241450-fd10-459d-8231-2324aac78c3d service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:12.431421 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-ee99b621-38fc-4729-bc23-afa7efe8ca4e req-8d241450-fd10-459d-8231-2324aac78c3d service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:12.447599 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-ee99b621-38fc-4729-bc23-afa7efe8ca4e req-8d241450-fd10-459d-8231-2324aac78c3d service nova] Creating event network-vif-deleted:d7b21e9c-cec7-4ec0-be49-df050e213b01 for instance 155e0037-0bdb-4a93-af44-de6903bc2891 on n-h1-850468-14 Aug 10 22:56:12.454198 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-ee99b621-38fc-4729-bc23-afa7efe8ca4e req-8d241450-fd10-459d-8231-2324aac78c3d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055571 Aug 10 22:56:12.455443 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 114/205] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 22:56:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:56:12.509593 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-86ff0964-3c3b-425a-86a9-bb6b04768c6b tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:12.510437 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-86ff0964-3c3b-425a-86a9-bb6b04768c6b tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] [instance: 37093f4d-0663-4b69-a48f-5fd757acd9c0] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:56:12.530259 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-86ff0964-3c3b-425a-86a9-bb6b04768c6b tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:12.530810 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-86ff0964-3c3b-425a-86a9-bb6b04768c6b tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:12.533389 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-86ff0964-3c3b-425a-86a9-bb6b04768c6b tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:12.534901 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-86ff0964-3c3b-425a-86a9-bb6b04768c6b tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:12.538175 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-86ff0964-3c3b-425a-86a9-bb6b04768c6b tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:12.539608 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-86ff0964-3c3b-425a-86a9-bb6b04768c6b tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:12.842435 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-d5e7eea4-ca40-40ce-ad41-2aebf13a5d31 tempest-HypervisorAdminNegativeTestJSON-111897723 tempest-HypervisorAdminNegativeTestJSON-111897723-project-admin] Calling method '.version_select at 0x7f847dc7d8b0>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:12.844584 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d5e7eea4-ca40-40ce-ad41-2aebf13a5d31 tempest-HypervisorAdminNegativeTestJSON-111897723 tempest-HypervisorAdminNegativeTestJSON-111897723-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:12.845069 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d5e7eea4-ca40-40ce-ad41-2aebf13a5d31 tempest-HypervisorAdminNegativeTestJSON-111897723 tempest-HypervisorAdminNegativeTestJSON-111897723-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:12.847343 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d5e7eea4-ca40-40ce-ad41-2aebf13a5d31 tempest-HypervisorAdminNegativeTestJSON-111897723 tempest-HypervisorAdminNegativeTestJSON-111897723-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:12.931274 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d5e7eea4-ca40-40ce-ad41-2aebf13a5d31 tempest-HypervisorAdminNegativeTestJSON-111897723 tempest-HypervisorAdminNegativeTestJSON-111897723-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:12.931833 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d5e7eea4-ca40-40ce-ad41-2aebf13a5d31 tempest-HypervisorAdminNegativeTestJSON-111897723 tempest-HypervisorAdminNegativeTestJSON-111897723-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:12.932276 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d5e7eea4-ca40-40ce-ad41-2aebf13a5d31 tempest-HypervisorAdminNegativeTestJSON-111897723 tempest-HypervisorAdminNegativeTestJSON-111897723-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:12.972129 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d5e7eea4-ca40-40ce-ad41-2aebf13a5d31 tempest-HypervisorAdminNegativeTestJSON-111897723 tempest-HypervisorAdminNegativeTestJSON-111897723-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:12.972792 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d5e7eea4-ca40-40ce-ad41-2aebf13a5d31 tempest-HypervisorAdminNegativeTestJSON-111897723 tempest-HypervisorAdminNegativeTestJSON-111897723-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:12.973816 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d5e7eea4-ca40-40ce-ad41-2aebf13a5d31 tempest-HypervisorAdminNegativeTestJSON-111897723 tempest-HypervisorAdminNegativeTestJSON-111897723-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:12.981017 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-d5e7eea4-ca40-40ce-ad41-2aebf13a5d31 tempest-HypervisorAdminNegativeTestJSON-111897723 tempest-HypervisorAdminNegativeTestJSON-111897723-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.680425 Aug 10 22:56:12.982416 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 92/206] 10.222.0.58 () {58 vars in 1146 bytes} [Wed Aug 10 22:56:12 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:56:12.996473 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-40772351-a1d2-4ce4-b91c-bbb7c84229c7 tempest-HypervisorAdminNegativeTestJSON-2101085801 tempest-HypervisorAdminNegativeTestJSON-2101085801-project] Calling method '.version_select at 0x7f847dd4c8b0>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:12.997574 n-d-850468-14 devstack@n-api.service[122633]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:56:12.997574 n-d-850468-14 devstack@n-api.service[122633]: warnings.warn(msg) Aug 10 22:56:13.000334 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-40772351-a1d2-4ce4-b91c-bbb7c84229c7 tempest-HypervisorAdminNegativeTestJSON-2101085801 tempest-HypervisorAdminNegativeTestJSON-2101085801-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': '881a24426bfd4e31a35166c91662cf6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e47d42bb27a47edb428482a1b349cea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:13.002182 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-40772351-a1d2-4ce4-b91c-bbb7c84229c7 tempest-HypervisorAdminNegativeTestJSON-2101085801 tempest-HypervisorAdminNegativeTestJSON-2101085801-project] Request method failure captured: Aug 10 22:56:13.002182 n-d-850468-14 devstack@n-api.service[122633]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Aug 10 22:56:13.002182 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 22:56:13.002182 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 22:56:13.002182 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 22:56:13.002182 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 22:56:13.002182 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 22:56:13.002182 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 22:56:13.002182 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 22:56:13.002182 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 22:56:13.002182 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9DeJKjNIfJcPL2Ika2B46EAZOHon43eBsAHqY7Apc6KvJAfsPmN3WmJw1yROrj313DV7pTXwXCYpIoKhXI_fBW-BuozgGYSfX-fZKDkeFYwxT7mXmg2WdFNLlTDSnUwR1G6in2-MLptedzBxxHuFaVMpeGwfN_Kfdf3nh-RN1ZnzPbE Aug 10 22:56:13.002182 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 22:56:13.002182 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 22:56:13.002182 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 22:56:13.002182 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 22:56:13.002182 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 22:56:13.002182 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 22:56:13.002182 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 5e47d42bb27a47edb428482a1b349cea Aug 10 22:56:13.002182 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-2101085801 Aug 10 22:56:13.002182 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 22:56:13.002182 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 22:56:13.003502 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5e47d42bb27a47edb428482a1b349cea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5e47d42bb27a47edb428482a1b349cea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/5e47d42bb27a47edb428482a1b349cea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_5e47d42bb27a47edb428482a1b349cea", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 22:56:13.003502 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-2101085801 Aug 10 22:56:13.003502 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 5e47d42bb27a47edb428482a1b349cea Aug 10 22:56:13.003502 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-2101085801 Aug 10 22:56:13.003502 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-HypervisorAdminNegativeTestJSON-2101085801-project Aug 10 22:56:13.003502 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 22:56:13.003502 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 22:56:13.003502 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 881a24426bfd4e31a35166c91662cf6c Aug 10 22:56:13.003502 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-2101085801-project Aug 10 22:56:13.003502 n-d-850468-14 devstack@n-api.service[122633]: method: Aug 10 22:56:13.003502 n-d-850468-14 devstack@n-api.service[122633]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Aug 10 22:56:13.003502 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': '1'} Aug 10 22:56:13.003502 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 22:56:13.004241 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:56:13.004241 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:56:13.004241 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:56:13.004241 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 22:56:13.004241 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 22:56:13.004241 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 22:56:13.004241 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 22:56:13.004241 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 22:56:13.004241 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 22:56:13.004241 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Aug 10 22:56:13.004241 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Aug 10 22:56:13.004241 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 10 22:56:13.004241 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 10 22:56:13.004241 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 10 22:56:13.004241 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 10 22:56:13.004241 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 10 22:56:13.004241 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 10 22:56:13.004241 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 10 22:56:13.004241 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise self.value Aug 10 22:56:13.005223 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 10 22:56:13.005223 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 10 22:56:13.005223 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 10 22:56:13.005223 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 10 22:56:13.005223 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 10 22:56:13.005223 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 10 22:56:13.005223 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Aug 10 22:56:13.005223 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:56:13.005223 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:56:13.005223 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:56:13.005223 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:56:13.005223 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:56:13.005223 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:56:13.005223 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 10 22:56:13.005223 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 10 22:56:13.005223 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Aug 10 22:56:13.005223 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:56:13.007783 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-40772351-a1d2-4ce4-b91c-bbb7c84229c7 tempest-HypervisorAdminNegativeTestJSON-2101085801 tempest-HypervisorAdminNegativeTestJSON-2101085801-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 22:56:13.008793 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-40772351-a1d2-4ce4-b91c-bbb7c84229c7 tempest-HypervisorAdminNegativeTestJSON-2101085801 tempest-HypervisorAdminNegativeTestJSON-2101085801-project] 10.222.0.58 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.019909 Aug 10 22:56:13.011087 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 93/207] 10.222.0.58 () {58 vars in 1173 bytes} [Wed Aug 10 22:56:12 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 23 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 10 22:56:13.022212 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-cf6c9916-09cb-4ea7-9d4d-cef30915a9ef tempest-HypervisorAdminNegativeTestJSON-111897723 tempest-HypervisorAdminNegativeTestJSON-111897723-project-admin] Calling method '.version_select at 0x7f847dde7af0>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:13.025170 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-cf6c9916-09cb-4ea7-9d4d-cef30915a9ef tempest-HypervisorAdminNegativeTestJSON-111897723 tempest-HypervisorAdminNegativeTestJSON-111897723-project-admin] HTTP exception thrown: Hypervisor with ID 'dfcc2e33-1a21-4e6b-8e01-e3cc64a03815' could not be found. Aug 10 22:56:13.049405 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-cf6c9916-09cb-4ea7-9d4d-cef30915a9ef tempest-HypervisorAdminNegativeTestJSON-111897723 tempest-HypervisorAdminNegativeTestJSON-111897723-project-admin] Request method failure captured: Aug 10 22:56:13.049405 n-d-850468-14 devstack@n-api.service[122633]: request: GET /compute/v2.1/os-hypervisors/dfcc2e33-1a21-4e6b-8e01-e3cc64a03815/uptime HTTP/1.1 Aug 10 22:56:13.049405 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 22:56:13.049405 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 22:56:13.049405 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 22:56:13.049405 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 22:56:13.049405 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 22:56:13.049405 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 22:56:13.049405 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 22:56:13.049405 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 22:56:13.049405 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9DeKcwmPE3Hy0G3QC4-lJ0kV3oKNQFaRJOAx2XjJ5pg_-yLvh8Rv2gYNeQLKpqhTwYTYII-NqLlA3w8g7HqOOAT81MB2aU-Nxvl4GEqkjZ7lq7Pf94rSG2tIzVxsfnohp7-WA6ZaWnX6A6KxZvKLW-IW_tCiTHYo0zEvc0CFBn7EmCI Aug 10 22:56:13.049405 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 22:56:13.049405 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 22:56:13.049405 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 22:56:13.049405 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 22:56:13.049405 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 22:56:13.049405 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 22:56:13.049405 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: ec90cc3c8bdf4b138aa663aa538ea453 Aug 10 22:56:13.049405 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-111897723 Aug 10 22:56:13.049405 n-d-850468-14 devstack@n-api.service[122633]: X-Role: admin,member,reader Aug 10 22:56:13.049405 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: admin,member,reader Aug 10 22:56:13.050726 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ec90cc3c8bdf4b138aa663aa538ea453"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ec90cc3c8bdf4b138aa663aa538ea453"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ec90cc3c8bdf4b138aa663aa538ea453"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ec90cc3c8bdf4b138aa663aa538ea453", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 22:56:13.050726 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-111897723 Aug 10 22:56:13.050726 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: ec90cc3c8bdf4b138aa663aa538ea453 Aug 10 22:56:13.050726 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-111897723 Aug 10 22:56:13.050726 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-HypervisorAdminNegativeTestJSON-111897723-project-admin Aug 10 22:56:13.050726 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 22:56:13.050726 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 22:56:13.050726 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 3b2daf5e92fd4df796458d706809896c Aug 10 22:56:13.050726 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-111897723-project-admin Aug 10 22:56:13.050726 n-d-850468-14 devstack@n-api.service[122633]: method: Aug 10 22:56:13.050726 n-d-850468-14 devstack@n-api.service[122633]: exception: Hypervisor with ID 'dfcc2e33-1a21-4e6b-8e01-e3cc64a03815' could not be found. Aug 10 22:56:13.050726 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': 'dfcc2e33-1a21-4e6b-8e01-e3cc64a03815'} Aug 10 22:56:13.051541 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 22:56:13.051541 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:56:13.051541 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Aug 10 22:56:13.051541 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi value = int(str(value)) Aug 10 22:56:13.051541 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: 'dfcc2e33-1a21-4e6b-8e01-e3cc64a03815' Aug 10 22:56:13.051541 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:56:13.051541 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:56:13.051541 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:56:13.051541 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:56:13.051541 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Aug 10 22:56:13.051541 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Aug 10 22:56:13.051541 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Aug 10 22:56:13.051541 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Aug 10 22:56:13.051541 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Aug 10 22:56:13.051541 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:56:13.051541 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:56:13.051541 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:56:13.051541 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:56:13.051541 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Aug 10 22:56:13.051541 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Aug 10 22:56:13.051541 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Aug 10 22:56:13.051541 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Aug 10 22:56:13.052659 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Aug 10 22:56:13.052659 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:56:13.052659 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:56:13.052659 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:56:13.052659 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:56:13.052659 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:56:13.052659 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:56:13.052659 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 22:56:13.052659 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 22:56:13.052659 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 22:56:13.052659 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 22:56:13.052659 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 22:56:13.052659 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 22:56:13.052659 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Aug 10 22:56:13.052659 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Aug 10 22:56:13.052659 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Aug 10 22:56:13.052659 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 10 22:56:13.052659 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID 'dfcc2e33-1a21-4e6b-8e01-e3cc64a03815' could not be found. Aug 10 22:56:13.052659 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:56:13.052659 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:56:13.052659 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:56:13.054071 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:56:13.054071 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:56:13.054071 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:56:13.054071 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 22:56:13.054071 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 22:56:13.054071 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID 'dfcc2e33-1a21-4e6b-8e01-e3cc64a03815' could not be found. Aug 10 22:56:13.054071 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:56:13.056498 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-cf6c9916-09cb-4ea7-9d4d-cef30915a9ef tempest-HypervisorAdminNegativeTestJSON-111897723 tempest-HypervisorAdminNegativeTestJSON-111897723-project-admin] Returning 404 to user: Hypervisor with ID 'dfcc2e33-1a21-4e6b-8e01-e3cc64a03815' could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 22:56:13.057868 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-cf6c9916-09cb-4ea7-9d4d-cef30915a9ef tempest-HypervisorAdminNegativeTestJSON-111897723 tempest-HypervisorAdminNegativeTestJSON-111897723-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors/dfcc2e33-1a21-4e6b-8e01-e3cc64a03815/uptime" status: 404 len: 123 microversion: 2.1 time: 0.041483 Aug 10 22:56:13.059835 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 94/208] 10.222.0.58 () {58 vars in 1278 bytes} [Wed Aug 10 22:56:13 2022] GET /compute/v2.1/os-hypervisors/dfcc2e33-1a21-4e6b-8e01-e3cc64a03815/uptime => generated 123 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 22:56:13.063544 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-86ff0964-3c3b-425a-86a9-bb6b04768c6b tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64648d3c6f5c423e83ff023e7bf6550a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434532ba922f406d8d8c197d3a57ffc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:13.077632 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-83c7a8d3-ad2d-4fef-a493-6480295ac38c tempest-HypervisorAdminNegativeTestJSON-111897723 tempest-HypervisorAdminNegativeTestJSON-111897723-project-admin] Calling method '.version_select at 0x7f847dd4caf0>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:13.080655 n-d-850468-14 devstack@n-api.service[122633]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:56:13.080655 n-d-850468-14 devstack@n-api.service[122633]: warnings.warn(msg) Aug 10 22:56:13.089643 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-83c7a8d3-ad2d-4fef-a493-6480295ac38c tempest-HypervisorAdminNegativeTestJSON-111897723 tempest-HypervisorAdminNegativeTestJSON-111897723-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:13.090886 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-83c7a8d3-ad2d-4fef-a493-6480295ac38c tempest-HypervisorAdminNegativeTestJSON-111897723 tempest-HypervisorAdminNegativeTestJSON-111897723-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:13.091337 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-86ff0964-3c3b-425a-86a9-bb6b04768c6b tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] 10.222.0.58 "GET /compute/v2.1/servers/37093f4d-0663-4b69-a48f-5fd757acd9c0" status: 200 len: 1469 microversion: 2.1 time: 0.580896 Aug 10 22:56:13.092127 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-83c7a8d3-ad2d-4fef-a493-6480295ac38c tempest-HypervisorAdminNegativeTestJSON-111897723 tempest-HypervisorAdminNegativeTestJSON-111897723-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:13.093395 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 115/209] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:56:12 2022] GET /compute/v2.1/servers/37093f4d-0663-4b69-a48f-5fd757acd9c0 => generated 1469 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:56:13.154935 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-83c7a8d3-ad2d-4fef-a493-6480295ac38c tempest-HypervisorAdminNegativeTestJSON-111897723 tempest-HypervisorAdminNegativeTestJSON-111897723-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:13.157030 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-83c7a8d3-ad2d-4fef-a493-6480295ac38c tempest-HypervisorAdminNegativeTestJSON-111897723 tempest-HypervisorAdminNegativeTestJSON-111897723-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:13.159127 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-83c7a8d3-ad2d-4fef-a493-6480295ac38c tempest-HypervisorAdminNegativeTestJSON-111897723 tempest-HypervisorAdminNegativeTestJSON-111897723-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:13.188531 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-83c7a8d3-ad2d-4fef-a493-6480295ac38c tempest-HypervisorAdminNegativeTestJSON-111897723 tempest-HypervisorAdminNegativeTestJSON-111897723-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:13.190006 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-83c7a8d3-ad2d-4fef-a493-6480295ac38c tempest-HypervisorAdminNegativeTestJSON-111897723 tempest-HypervisorAdminNegativeTestJSON-111897723-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:13.191295 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-83c7a8d3-ad2d-4fef-a493-6480295ac38c tempest-HypervisorAdminNegativeTestJSON-111897723 tempest-HypervisorAdminNegativeTestJSON-111897723-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:13.203662 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-83c7a8d3-ad2d-4fef-a493-6480295ac38c tempest-HypervisorAdminNegativeTestJSON-111897723 tempest-HypervisorAdminNegativeTestJSON-111897723-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.136066 Aug 10 22:56:13.205443 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 95/210] 10.222.0.58 () {58 vars in 1146 bytes} [Wed Aug 10 22:56:13 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:56:13.218317 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-ffd0b782-cd68-4baf-b5a5-88e2364c01a9 tempest-HypervisorAdminNegativeTestJSON-2101085801 tempest-HypervisorAdminNegativeTestJSON-2101085801-project] Calling method '.version_select at 0x7f847dc7dca0>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:13.223038 n-d-850468-14 devstack@n-api.service[122633]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:56:13.223038 n-d-850468-14 devstack@n-api.service[122633]: warnings.warn(msg) Aug 10 22:56:13.226213 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-ffd0b782-cd68-4baf-b5a5-88e2364c01a9 tempest-HypervisorAdminNegativeTestJSON-2101085801 tempest-HypervisorAdminNegativeTestJSON-2101085801-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': '881a24426bfd4e31a35166c91662cf6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e47d42bb27a47edb428482a1b349cea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:13.235260 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-ffd0b782-cd68-4baf-b5a5-88e2364c01a9 tempest-HypervisorAdminNegativeTestJSON-2101085801 tempest-HypervisorAdminNegativeTestJSON-2101085801-project] Request method failure captured: Aug 10 22:56:13.235260 n-d-850468-14 devstack@n-api.service[122633]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Aug 10 22:56:13.235260 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 22:56:13.235260 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 22:56:13.235260 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 22:56:13.235260 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 22:56:13.235260 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 22:56:13.235260 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 22:56:13.235260 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 22:56:13.235260 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 22:56:13.235260 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9DeJKjNIfJcPL2Ika2B46EAZOHon43eBsAHqY7Apc6KvJAfsPmN3WmJw1yROrj313DV7pTXwXCYpIoKhXI_fBW-BuozgGYSfX-fZKDkeFYwxT7mXmg2WdFNLlTDSnUwR1G6in2-MLptedzBxxHuFaVMpeGwfN_Kfdf3nh-RN1ZnzPbE Aug 10 22:56:13.235260 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 22:56:13.235260 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 22:56:13.235260 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 22:56:13.235260 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 22:56:13.235260 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 22:56:13.235260 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 22:56:13.235260 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 5e47d42bb27a47edb428482a1b349cea Aug 10 22:56:13.235260 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-2101085801 Aug 10 22:56:13.235260 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 22:56:13.235260 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 22:56:13.236794 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5e47d42bb27a47edb428482a1b349cea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5e47d42bb27a47edb428482a1b349cea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/5e47d42bb27a47edb428482a1b349cea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_5e47d42bb27a47edb428482a1b349cea", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 22:56:13.236794 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-2101085801 Aug 10 22:56:13.236794 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 5e47d42bb27a47edb428482a1b349cea Aug 10 22:56:13.236794 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-2101085801 Aug 10 22:56:13.236794 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-HypervisorAdminNegativeTestJSON-2101085801-project Aug 10 22:56:13.236794 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 22:56:13.236794 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 22:56:13.236794 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 881a24426bfd4e31a35166c91662cf6c Aug 10 22:56:13.236794 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-2101085801-project Aug 10 22:56:13.236794 n-d-850468-14 devstack@n-api.service[122633]: method: Aug 10 22:56:13.236794 n-d-850468-14 devstack@n-api.service[122633]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Aug 10 22:56:13.236794 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': '1'} Aug 10 22:56:13.236794 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 22:56:13.237614 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:56:13.237614 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:56:13.237614 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:56:13.237614 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 22:56:13.237614 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 22:56:13.237614 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 22:56:13.237614 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 22:56:13.237614 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 22:56:13.237614 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 22:56:13.237614 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Aug 10 22:56:13.237614 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return self._show(req, id) Aug 10 22:56:13.237614 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Aug 10 22:56:13.237614 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Aug 10 22:56:13.237614 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 10 22:56:13.237614 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 10 22:56:13.237614 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 10 22:56:13.237614 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 10 22:56:13.237614 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 10 22:56:13.237614 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 10 22:56:13.238972 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 10 22:56:13.238972 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise self.value Aug 10 22:56:13.238972 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 10 22:56:13.238972 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 10 22:56:13.238972 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 10 22:56:13.238972 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 10 22:56:13.238972 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 10 22:56:13.238972 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 10 22:56:13.238972 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Aug 10 22:56:13.238972 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:56:13.238972 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:56:13.238972 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:56:13.238972 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:56:13.238972 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:56:13.238972 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:56:13.238972 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 10 22:56:13.238972 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 10 22:56:13.238972 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Aug 10 22:56:13.238972 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:56:13.242014 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-ffd0b782-cd68-4baf-b5a5-88e2364c01a9 tempest-HypervisorAdminNegativeTestJSON-2101085801 tempest-HypervisorAdminNegativeTestJSON-2101085801-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 22:56:13.243057 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-ffd0b782-cd68-4baf-b5a5-88e2364c01a9 tempest-HypervisorAdminNegativeTestJSON-2101085801 tempest-HypervisorAdminNegativeTestJSON-2101085801-project] 10.222.0.58 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.030177 Aug 10 22:56:13.248825 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 96/211] 10.222.0.58 () {58 vars in 1152 bytes} [Wed Aug 10 22:56:13 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 34 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 10 22:56:13.286702 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-91850ecc-aedb-4c23-aae9-adddf9ac1e1c tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:13.287647 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-91850ecc-aedb-4c23-aae9-adddf9ac1e1c tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] [instance: ef725aca-9cd8-49a0-81cd-d23710041306] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:56:13.319934 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-91850ecc-aedb-4c23-aae9-adddf9ac1e1c tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:13.321576 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-91850ecc-aedb-4c23-aae9-adddf9ac1e1c tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:13.322035 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-91850ecc-aedb-4c23-aae9-adddf9ac1e1c tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:13.330196 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-91850ecc-aedb-4c23-aae9-adddf9ac1e1c tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:13.331303 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-91850ecc-aedb-4c23-aae9-adddf9ac1e1c tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:13.332094 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-91850ecc-aedb-4c23-aae9-adddf9ac1e1c tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:13.384896 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=100 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:56:13.546141 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-91850ecc-aedb-4c23-aae9-adddf9ac1e1c tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaed2a2e56f749a88c340aaccb15d2d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deaba512051743deb45881d76eb206ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:13.560213 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-91850ecc-aedb-4c23-aae9-adddf9ac1e1c tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] 10.222.0.58 "GET /compute/v2.1/servers/ef725aca-9cd8-49a0-81cd-d23710041306" status: 200 len: 1338 microversion: 2.1 time: 0.307555 Aug 10 22:56:13.562294 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 97/212] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:56:13 2022] GET /compute/v2.1/servers/ef725aca-9cd8-49a0-81cd-d23710041306 => generated 1338 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:56:13.583103 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-679098c8-76ba-44d9-9158-5c2408a5f3be tempest-HypervisorAdminNegativeTestJSON-111897723 tempest-HypervisorAdminNegativeTestJSON-111897723-project-admin] Calling method '.version_select at 0x7f847dc7d700>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:13.585470 n-d-850468-14 devstack@n-api.service[122633]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:56:13.585470 n-d-850468-14 devstack@n-api.service[122633]: warnings.warn(msg) Aug 10 22:56:13.595680 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-679098c8-76ba-44d9-9158-5c2408a5f3be tempest-HypervisorAdminNegativeTestJSON-111897723 tempest-HypervisorAdminNegativeTestJSON-111897723-project-admin] HTTP exception thrown: Hypervisor with ID 'ea6b53a6-0c4e-44af-b897-f0cfb696b4a4' could not be found. Aug 10 22:56:13.606489 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-679098c8-76ba-44d9-9158-5c2408a5f3be tempest-HypervisorAdminNegativeTestJSON-111897723 tempest-HypervisorAdminNegativeTestJSON-111897723-project-admin] Request method failure captured: Aug 10 22:56:13.606489 n-d-850468-14 devstack@n-api.service[122633]: request: GET /compute/v2.1/os-hypervisors/ea6b53a6-0c4e-44af-b897-f0cfb696b4a4 HTTP/1.1 Aug 10 22:56:13.606489 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 22:56:13.606489 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 22:56:13.606489 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 22:56:13.606489 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 22:56:13.606489 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 22:56:13.606489 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 22:56:13.606489 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 22:56:13.606489 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 22:56:13.606489 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9DeKcwmPE3Hy0G3QC4-lJ0kV3oKNQFaRJOAx2XjJ5pg_-yLvh8Rv2gYNeQLKpqhTwYTYII-NqLlA3w8g7HqOOAT81MB2aU-Nxvl4GEqkjZ7lq7Pf94rSG2tIzVxsfnohp7-WA6ZaWnX6A6KxZvKLW-IW_tCiTHYo0zEvc0CFBn7EmCI Aug 10 22:56:13.606489 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 22:56:13.606489 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 22:56:13.606489 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 22:56:13.606489 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 22:56:13.606489 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 22:56:13.606489 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 22:56:13.606489 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: ec90cc3c8bdf4b138aa663aa538ea453 Aug 10 22:56:13.606489 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-111897723 Aug 10 22:56:13.606489 n-d-850468-14 devstack@n-api.service[122633]: X-Role: admin,member,reader Aug 10 22:56:13.606489 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: admin,member,reader Aug 10 22:56:13.608129 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ec90cc3c8bdf4b138aa663aa538ea453"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ec90cc3c8bdf4b138aa663aa538ea453"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ec90cc3c8bdf4b138aa663aa538ea453"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ec90cc3c8bdf4b138aa663aa538ea453", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 22:56:13.608129 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-111897723 Aug 10 22:56:13.608129 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: ec90cc3c8bdf4b138aa663aa538ea453 Aug 10 22:56:13.608129 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-111897723 Aug 10 22:56:13.608129 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-HypervisorAdminNegativeTestJSON-111897723-project-admin Aug 10 22:56:13.608129 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 22:56:13.608129 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 22:56:13.608129 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 3b2daf5e92fd4df796458d706809896c Aug 10 22:56:13.608129 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-111897723-project-admin Aug 10 22:56:13.608129 n-d-850468-14 devstack@n-api.service[122633]: method: Aug 10 22:56:13.608129 n-d-850468-14 devstack@n-api.service[122633]: exception: Hypervisor with ID 'ea6b53a6-0c4e-44af-b897-f0cfb696b4a4' could not be found. Aug 10 22:56:13.608129 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': 'ea6b53a6-0c4e-44af-b897-f0cfb696b4a4'} Aug 10 22:56:13.608981 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 22:56:13.608981 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:56:13.608981 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Aug 10 22:56:13.608981 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi value = int(str(value)) Aug 10 22:56:13.608981 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: 'ea6b53a6-0c4e-44af-b897-f0cfb696b4a4' Aug 10 22:56:13.608981 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:56:13.608981 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:56:13.608981 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:56:13.608981 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:56:13.608981 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Aug 10 22:56:13.608981 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Aug 10 22:56:13.608981 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Aug 10 22:56:13.608981 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Aug 10 22:56:13.608981 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Aug 10 22:56:13.608981 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:56:13.608981 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:56:13.608981 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:56:13.608981 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:56:13.608981 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Aug 10 22:56:13.608981 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Aug 10 22:56:13.608981 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Aug 10 22:56:13.608981 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Aug 10 22:56:13.610811 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Aug 10 22:56:13.610811 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:56:13.610811 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:56:13.610811 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:56:13.610811 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:56:13.610811 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:56:13.610811 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:56:13.610811 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 22:56:13.610811 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 22:56:13.610811 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 22:56:13.610811 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 22:56:13.610811 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 22:56:13.610811 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 22:56:13.610811 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Aug 10 22:56:13.610811 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return self._show(req, id) Aug 10 22:56:13.610811 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Aug 10 22:56:13.610811 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Aug 10 22:56:13.610811 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Aug 10 22:56:13.610811 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 10 22:56:13.610811 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID 'ea6b53a6-0c4e-44af-b897-f0cfb696b4a4' could not be found. Aug 10 22:56:13.612052 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:56:13.612052 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:56:13.612052 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:56:13.612052 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:56:13.612052 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:56:13.612052 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:56:13.612052 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 22:56:13.612052 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 22:56:13.612052 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID 'ea6b53a6-0c4e-44af-b897-f0cfb696b4a4' could not be found. Aug 10 22:56:13.612052 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:56:13.617542 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-679098c8-76ba-44d9-9158-5c2408a5f3be tempest-HypervisorAdminNegativeTestJSON-111897723 tempest-HypervisorAdminNegativeTestJSON-111897723-project-admin] Returning 404 to user: Hypervisor with ID 'ea6b53a6-0c4e-44af-b897-f0cfb696b4a4' could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 22:56:13.619049 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-679098c8-76ba-44d9-9158-5c2408a5f3be tempest-HypervisorAdminNegativeTestJSON-111897723 tempest-HypervisorAdminNegativeTestJSON-111897723-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors/ea6b53a6-0c4e-44af-b897-f0cfb696b4a4" status: 404 len: 123 microversion: 2.1 time: 0.055718 Aug 10 22:56:13.628687 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 98/213] 10.222.0.58 () {58 vars in 1257 bytes} [Wed Aug 10 22:56:13 2022] GET /compute/v2.1/os-hypervisors/ea6b53a6-0c4e-44af-b897-f0cfb696b4a4 => generated 123 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 22:56:13.642436 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-b9435fbe-6480-4c45-96ed-8393a8857485 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:13.644854 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-b9435fbe-6480-4c45-96ed-8393a8857485 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] [instance: 155e0037-0bdb-4a93-af44-de6903bc2891] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:56:13.662620 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b9435fbe-6480-4c45-96ed-8393a8857485 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:13.663147 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b9435fbe-6480-4c45-96ed-8393a8857485 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:13.663573 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b9435fbe-6480-4c45-96ed-8393a8857485 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:13.664268 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b9435fbe-6480-4c45-96ed-8393a8857485 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:13.664713 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b9435fbe-6480-4c45-96ed-8393a8857485 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:13.667811 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b9435fbe-6480-4c45-96ed-8393a8857485 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:13.711529 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-b9435fbe-6480-4c45-96ed-8393a8857485 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] HTTP exception thrown: Instance 155e0037-0bdb-4a93-af44-de6903bc2891 could not be found. Aug 10 22:56:13.723386 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-b9435fbe-6480-4c45-96ed-8393a8857485 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Request method failure captured: Aug 10 22:56:13.723386 n-d-850468-14 devstack@n-api.service[122633]: request: GET /compute/v2.1/servers/155e0037-0bdb-4a93-af44-de6903bc2891 HTTP/1.1 Aug 10 22:56:13.723386 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 22:56:13.723386 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 22:56:13.723386 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 22:56:13.723386 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 22:56:13.723386 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 22:56:13.723386 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 22:56:13.723386 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 22:56:13.723386 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 22:56:13.723386 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9DddKgov0XD1fS0tp0Ul1mjN_zTuUOC2SxwrUNcPhwPNxxHQNT41AEzpH9ZhsJiU__QZMsOY9V3rG3TxdneUTP8TO4aPUC8kkdS2qBw4iqbruolmAdVp0DQbmHmD51udz-Urx7Ssvy0gl2mmkEHSXdQsFuWxPCC0JKQpS8961PCH3_c Aug 10 22:56:13.723386 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 22:56:13.723386 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 22:56:13.723386 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 22:56:13.723386 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 22:56:13.723386 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 22:56:13.723386 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 22:56:13.723386 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: a9a37b95a10245b796d26c1b35036827 Aug 10 22:56:13.723386 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-AggregatesAdminTestJSON-108305639 Aug 10 22:56:13.723386 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 22:56:13.723386 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 22:56:13.724630 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a9a37b95a10245b796d26c1b35036827"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a9a37b95a10245b796d26c1b35036827"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a9a37b95a10245b796d26c1b35036827"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a9a37b95a10245b796d26c1b35036827", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 22:56:13.724630 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-AggregatesAdminTestJSON-108305639 Aug 10 22:56:13.724630 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: a9a37b95a10245b796d26c1b35036827 Aug 10 22:56:13.724630 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-108305639 Aug 10 22:56:13.724630 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-AggregatesAdminTestJSON-108305639-project Aug 10 22:56:13.724630 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 22:56:13.724630 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 22:56:13.724630 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: cfd644627ab14e55803c1d5981b9859a Aug 10 22:56:13.724630 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-AggregatesAdminTestJSON-108305639-project Aug 10 22:56:13.724630 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 22:56:13.724630 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance 155e0037-0bdb-4a93-af44-de6903bc2891 could not be found. Aug 10 22:56:13.724630 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': '155e0037-0bdb-4a93-af44-de6903bc2891'} Aug 10 22:56:13.725279 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 22:56:13.725279 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:56:13.725279 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 22:56:13.725279 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 22:56:13.725279 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 22:56:13.725279 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 22:56:13.725279 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 22:56:13.725279 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 22:56:13.725279 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 22:56:13.725279 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 22:56:13.725279 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 155e0037-0bdb-4a93-af44-de6903bc2891 could not be found. Aug 10 22:56:13.725279 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:56:13.725279 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:56:13.725279 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:56:13.725279 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:56:13.725279 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:56:13.725279 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:56:13.725279 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 22:56:13.725279 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 22:56:13.725279 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 22:56:13.726416 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 22:56:13.726416 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 22:56:13.726416 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 22:56:13.726416 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 22:56:13.726416 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 22:56:13.726416 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 22:56:13.726416 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 22:56:13.726416 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 155e0037-0bdb-4a93-af44-de6903bc2891 could not be found. Aug 10 22:56:13.726416 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:56:13.726416 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:56:13.726416 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:56:13.726416 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:56:13.726416 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:56:13.726416 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:56:13.726416 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 22:56:13.726416 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 22:56:13.726416 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 155e0037-0bdb-4a93-af44-de6903bc2891 could not be found. Aug 10 22:56:13.726416 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:56:13.729095 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-b9435fbe-6480-4c45-96ed-8393a8857485 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Returning 404 to user: Instance 155e0037-0bdb-4a93-af44-de6903bc2891 could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 22:56:13.732309 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-b9435fbe-6480-4c45-96ed-8393a8857485 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] 10.222.0.58 "GET /compute/v2.1/servers/155e0037-0bdb-4a93-af44-de6903bc2891" status: 404 len: 111 microversion: 2.1 time: 0.102380 Aug 10 22:56:13.735520 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 99/214] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:56:13 2022] GET /compute/v2.1/servers/155e0037-0bdb-4a93-af44-de6903bc2891 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 22:56:13.744993 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-ea151fea-56ce-4055-9898-19dbfd0e0d0c tempest-AggregatesAdminTestJSON-1841140741 tempest-AggregatesAdminTestJSON-1841140741-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-850468-14"}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:56:13.755483 n-d-850468-14 devstack@n-api.service[122633]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:56:13.755483 n-d-850468-14 devstack@n-api.service[122633]: warnings.warn(msg) Aug 10 22:56:13.775413 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ea151fea-56ce-4055-9898-19dbfd0e0d0c tempest-AggregatesAdminTestJSON-1841140741 tempest-AggregatesAdminTestJSON-1841140741-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:13.775960 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ea151fea-56ce-4055-9898-19dbfd0e0d0c tempest-AggregatesAdminTestJSON-1841140741 tempest-AggregatesAdminTestJSON-1841140741-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:13.780741 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ea151fea-56ce-4055-9898-19dbfd0e0d0c tempest-AggregatesAdminTestJSON-1841140741 tempest-AggregatesAdminTestJSON-1841140741-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:14.062440 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-4eec6635-262f-4ae5-932a-c318d1f3d082 tempest-DeleteServersAdminTestJSON-541057853 tempest-DeleteServersAdminTestJSON-541057853-project-admin] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:14.063034 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-4eec6635-262f-4ae5-932a-c318d1f3d082 tempest-DeleteServersAdminTestJSON-541057853 tempest-DeleteServersAdminTestJSON-541057853-project-admin] [instance: 37093f4d-0663-4b69-a48f-5fd757acd9c0] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:56:14.073183 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4eec6635-262f-4ae5-932a-c318d1f3d082 tempest-DeleteServersAdminTestJSON-541057853 tempest-DeleteServersAdminTestJSON-541057853-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:14.077319 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4eec6635-262f-4ae5-932a-c318d1f3d082 tempest-DeleteServersAdminTestJSON-541057853 tempest-DeleteServersAdminTestJSON-541057853-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:14.079389 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4eec6635-262f-4ae5-932a-c318d1f3d082 tempest-DeleteServersAdminTestJSON-541057853 tempest-DeleteServersAdminTestJSON-541057853-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:14.080334 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4eec6635-262f-4ae5-932a-c318d1f3d082 tempest-DeleteServersAdminTestJSON-541057853 tempest-DeleteServersAdminTestJSON-541057853-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:14.082284 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4eec6635-262f-4ae5-932a-c318d1f3d082 tempest-DeleteServersAdminTestJSON-541057853 tempest-DeleteServersAdminTestJSON-541057853-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:14.083298 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4eec6635-262f-4ae5-932a-c318d1f3d082 tempest-DeleteServersAdminTestJSON-541057853 tempest-DeleteServersAdminTestJSON-541057853-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:14.157484 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=2 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:56:14.205325 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-4eec6635-262f-4ae5-932a-c318d1f3d082 tempest-DeleteServersAdminTestJSON-541057853 tempest-DeleteServersAdminTestJSON-541057853-project-admin] [instance: 37093f4d-0663-4b69-a48f-5fd757acd9c0] Going to try to terminate instance {{(pid=122632) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 22:56:14.378510 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-4eec6635-262f-4ae5-932a-c318d1f3d082 tempest-DeleteServersAdminTestJSON-541057853 tempest-DeleteServersAdminTestJSON-541057853-project-admin] 10.222.0.58 "DELETE /compute/v2.1/servers/37093f4d-0663-4b69-a48f-5fd757acd9c0" status: 204 len: 0 microversion: 2.1 time: 1.264585 Aug 10 22:56:14.379520 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 116/215] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 22:56:13 2022] DELETE /compute/v2.1/servers/37093f4d-0663-4b69-a48f-5fd757acd9c0 => generated 0 bytes in 1267 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 10 22:56:14.772521 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-81806579-03f8-461f-aad2-04b0c4b94854 tempest-KeyPairsV210TestJSON-761843193 tempest-KeyPairsV210TestJSON-761843193-project-admin] Action: 'create', calling method: .version_select at 0x7f847dd50310>, body: {"keypair": {"name": "tempest-keypair-1477403071", "type": "ssh", "user_id": "8a2c04565c2a4fb8bd825862c1634c82", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK3PDmCJdV0BE5qsqTeT1qMeLmwVpiQZmQ4qcmriQdNEGIhuSXqSs/isBbe/SyrYp9A+GXWjZYHI5OXLkAfq75qNYJOI4++KznWEtWW0HTjrJLrmSgefDfZTUpGHOS/NNw=="}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:56:14.791031 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-81806579-03f8-461f-aad2-04b0c4b94854 tempest-KeyPairsV210TestJSON-761843193 tempest-KeyPairsV210TestJSON-761843193-project-admin] Getting quotas for project c576b0e205e948bab675e5db5036749d. Resources: {'key_pairs'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 22:56:14.799357 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-81806579-03f8-461f-aad2-04b0c4b94854 tempest-KeyPairsV210TestJSON-761843193 tempest-KeyPairsV210TestJSON-761843193-project-admin] Getting quotas for user a797b462a87649e3bf0e37e9f867f3d9 and project c576b0e205e948bab675e5db5036749d. Resources: {'key_pairs'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 22:56:14.803013 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:56:14.837530 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-81806579-03f8-461f-aad2-04b0c4b94854 tempest-KeyPairsV210TestJSON-761843193 tempest-KeyPairsV210TestJSON-761843193-project-admin] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.455908 Aug 10 22:56:14.843501 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 117/216] 10.222.0.58 () {62 vars in 1200 bytes} [Wed Aug 10 22:56:14 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 463 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 10 22:56:14.852108 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-d88f70d1-22e3-4989-bc7c-faa02db078ad tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:14.853590 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-d88f70d1-22e3-4989-bc7c-faa02db078ad tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] [instance: 37093f4d-0663-4b69-a48f-5fd757acd9c0] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:56:14.868566 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d88f70d1-22e3-4989-bc7c-faa02db078ad tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:14.869284 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d88f70d1-22e3-4989-bc7c-faa02db078ad tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:14.869942 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d88f70d1-22e3-4989-bc7c-faa02db078ad tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:14.871161 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d88f70d1-22e3-4989-bc7c-faa02db078ad tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:14.871811 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d88f70d1-22e3-4989-bc7c-faa02db078ad tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:14.872423 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d88f70d1-22e3-4989-bc7c-faa02db078ad tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:15.025365 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:56:15.062499 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-ea151fea-56ce-4055-9898-19dbfd0e0d0c tempest-AggregatesAdminTestJSON-1841140741 tempest-AggregatesAdminTestJSON-1841140741-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 299 microversion: 2.1 time: 1.324122 Aug 10 22:56:15.064380 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 100/217] 10.222.0.58 () {60 vars in 1191 bytes} [Wed Aug 10 22:56:13 2022] POST /compute/v2.1/os-aggregates/2/action => generated 299 bytes in 1327 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:56:15.070540 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-62a326ad-2359-46fc-9b5e-7509d7255b3c tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:15.071615 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-62a326ad-2359-46fc-9b5e-7509d7255b3c tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] [instance: ef725aca-9cd8-49a0-81cd-d23710041306] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:56:15.079418 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-62a326ad-2359-46fc-9b5e-7509d7255b3c tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:15.080243 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-62a326ad-2359-46fc-9b5e-7509d7255b3c tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:15.081596 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-62a326ad-2359-46fc-9b5e-7509d7255b3c tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:15.082931 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-62a326ad-2359-46fc-9b5e-7509d7255b3c tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:15.083631 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-62a326ad-2359-46fc-9b5e-7509d7255b3c tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:15.084288 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-62a326ad-2359-46fc-9b5e-7509d7255b3c tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:15.252614 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-62a326ad-2359-46fc-9b5e-7509d7255b3c tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaed2a2e56f749a88c340aaccb15d2d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deaba512051743deb45881d76eb206ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:15.279298 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-62a326ad-2359-46fc-9b5e-7509d7255b3c tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] 10.222.0.58 "GET /compute/v2.1/servers/ef725aca-9cd8-49a0-81cd-d23710041306" status: 200 len: 1322 microversion: 2.1 time: 0.212953 Aug 10 22:56:15.283107 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 101/218] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:56:15 2022] GET /compute/v2.1/servers/ef725aca-9cd8-49a0-81cd-d23710041306 => generated 1322 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:56:15.288577 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-e9dee1d5-f359-44a8-af0c-0c38cfb9f6c6 tempest-KeyPairsV210TestJSON-761843193 tempest-KeyPairsV210TestJSON-761843193-project-admin] Action: 'create', calling method: .version_select at 0x7f847dc7d310>, body: {"keypair": {"name": "tempest-keypair-2071763248", "type": "ssh", "user_id": "8a2c04565c2a4fb8bd825862c1634c82", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOqE+PuLb94KF2fDqU0pUdemuqTBxpwove8PZa4cbFcy+IcfHQNQkvN+Tg1168uVuBxis7SwXfB0cVVcsJCGAlyiwPp4FbdAldKaey2O7ccoc3GPCo43lmCvig6jYgIThw=="}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:56:15.318598 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-e9dee1d5-f359-44a8-af0c-0c38cfb9f6c6 tempest-KeyPairsV210TestJSON-761843193 tempest-KeyPairsV210TestJSON-761843193-project-admin] Getting quotas for project c576b0e205e948bab675e5db5036749d. Resources: {'key_pairs'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 22:56:15.324854 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-e9dee1d5-f359-44a8-af0c-0c38cfb9f6c6 tempest-KeyPairsV210TestJSON-761843193 tempest-KeyPairsV210TestJSON-761843193-project-admin] Getting quotas for user a797b462a87649e3bf0e37e9f867f3d9 and project c576b0e205e948bab675e5db5036749d. Resources: {'key_pairs'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 22:56:15.365158 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-e9dee1d5-f359-44a8-af0c-0c38cfb9f6c6 tempest-KeyPairsV210TestJSON-761843193 tempest-KeyPairsV210TestJSON-761843193-project-admin] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.077935 Aug 10 22:56:15.373921 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 102/219] 10.222.0.58 () {62 vars in 1200 bytes} [Wed Aug 10 22:56:15 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 85 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 10 22:56:15.383395 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-a274f879-9f5e-4910-b610-cd2bfd4620c1 tempest-AggregatesAdminTestJSON-1841140741 tempest-AggregatesAdminTestJSON-1841140741-project-admin] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:15.391128 n-d-850468-14 devstack@n-api.service[122633]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:56:15.391128 n-d-850468-14 devstack@n-api.service[122633]: warnings.warn(msg) Aug 10 22:56:15.459508 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-a274f879-9f5e-4910-b610-cd2bfd4620c1 tempest-AggregatesAdminTestJSON-1841140741 tempest-AggregatesAdminTestJSON-1841140741-project-admin] 10.222.0.58 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.083234 Aug 10 22:56:15.477118 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 103/220] 10.222.0.58 () {58 vars in 1152 bytes} [Wed Aug 10 22:56:15 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 10 22:56:15.494616 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-7d277b7f-c939-45c7-83f0-e0b58ed80f14 tempest-KeyPairsV210TestJSON-761843193 tempest-KeyPairsV210TestJSON-761843193-project-admin] Calling method '.version_select at 0x7f847dc679d0>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:15.504605 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-7d277b7f-c939-45c7-83f0-e0b58ed80f14 tempest-KeyPairsV210TestJSON-761843193 tempest-KeyPairsV210TestJSON-761843193-project-admin] 10.222.0.58 "GET /compute/v2.1/os-keypairs/tempest-keypair-1477403071?user_id=8a2c04565c2a4fb8bd825862c1634c82" status: 200 len: 512 microversion: 2.10 time: 0.025487 Aug 10 22:56:15.505180 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 104/221] 10.222.0.58 () {60 vars in 1340 bytes} [Wed Aug 10 22:56:15 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1477403071?user_id=8a2c04565c2a4fb8bd825862c1634c82 => generated 512 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 22:56:15.509917 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-20a37c80-1572-468b-9dce-8e08dc6f1ad1 tempest-AggregatesAdminTestJSON-1841140741 tempest-AggregatesAdminTestJSON-1841140741-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-80376356"}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:56:15.512940 n-d-850468-14 devstack@n-api.service[122633]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:56:15.512940 n-d-850468-14 devstack@n-api.service[122633]: warnings.warn(msg) Aug 10 22:56:15.514645 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.objects.aggregate [None req-20a37c80-1572-468b-9dce-8e08dc6f1ad1 tempest-AggregatesAdminTestJSON-1841140741 tempest-AggregatesAdminTestJSON-1841140741-project-admin] Generated uuid 73a3cf20-aead-409d-8425-588dac060892 for aggregate {{(pid=122633) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 10 22:56:15.522109 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-d88f70d1-22e3-4989-bc7c-faa02db078ad tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64648d3c6f5c423e83ff023e7bf6550a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434532ba922f406d8d8c197d3a57ffc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:15.553804 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-20a37c80-1572-468b-9dce-8e08dc6f1ad1 tempest-AggregatesAdminTestJSON-1841140741 tempest-AggregatesAdminTestJSON-1841140741-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates" status: 200 len: 196 microversion: 2.1 time: 0.046443 Aug 10 22:56:15.554504 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-d88f70d1-22e3-4989-bc7c-faa02db078ad tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] 10.222.0.58 "GET /compute/v2.1/servers/37093f4d-0663-4b69-a48f-5fd757acd9c0" status: 200 len: 1475 microversion: 2.1 time: 0.706333 Aug 10 22:56:15.555282 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 105/222] 10.222.0.58 () {60 vars in 1164 bytes} [Wed Aug 10 22:56:15 2022] POST /compute/v2.1/os-aggregates => generated 196 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:56:15.565685 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 118/223] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:56:14 2022] GET /compute/v2.1/servers/37093f4d-0663-4b69-a48f-5fd757acd9c0 => generated 1475 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:56:15.577796 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-f897cfff-6a38-4158-a07a-bbf3f3618c08 tempest-KeyPairsV210TestJSON-761843193 tempest-KeyPairsV210TestJSON-761843193-project-admin] Action: 'create', calling method: .version_select at 0x7f847daf8af0>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-1156819001", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOtXCrw9jfc+GfKtdvoQpfncl2k0KspQmsBh1z1CQgvFCJXVO3FRadG2EZ3CWwpG55eshS23kflTkk3v5se4SMyZbJ+Z79erAO9WBe7lA/pckKxQF4f5rp2ASf7kALZAsQ=="}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:56:15.585976 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-bbbdfcdb-158b-44a1-a0de-07d8c5e9f7ec tempest-AggregatesAdminTestJSON-1841140741 tempest-AggregatesAdminTestJSON-1841140741-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-850468-14"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:56:15.589802 n-d-850468-14 devstack@n-api.service[122632]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:56:15.589802 n-d-850468-14 devstack@n-api.service[122632]: warnings.warn(msg) Aug 10 22:56:15.608163 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-f897cfff-6a38-4158-a07a-bbf3f3618c08 tempest-KeyPairsV210TestJSON-761843193 tempest-KeyPairsV210TestJSON-761843193-project-admin] Getting quotas for project c576b0e205e948bab675e5db5036749d. Resources: {'key_pairs'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 22:56:15.608163 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-f897cfff-6a38-4158-a07a-bbf3f3618c08 tempest-KeyPairsV210TestJSON-761843193 tempest-KeyPairsV210TestJSON-761843193-project-admin] Getting quotas for user a797b462a87649e3bf0e37e9f867f3d9 and project c576b0e205e948bab675e5db5036749d. Resources: {'key_pairs'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 22:56:15.626476 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bbbdfcdb-158b-44a1-a0de-07d8c5e9f7ec tempest-AggregatesAdminTestJSON-1841140741 tempest-AggregatesAdminTestJSON-1841140741-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:15.634078 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bbbdfcdb-158b-44a1-a0de-07d8c5e9f7ec tempest-AggregatesAdminTestJSON-1841140741 tempest-AggregatesAdminTestJSON-1841140741-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:15.634690 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bbbdfcdb-158b-44a1-a0de-07d8c5e9f7ec tempest-AggregatesAdminTestJSON-1841140741 tempest-AggregatesAdminTestJSON-1841140741-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:15.679893 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-f897cfff-6a38-4158-a07a-bbf3f3618c08 tempest-KeyPairsV210TestJSON-761843193 tempest-KeyPairsV210TestJSON-761843193-project-admin] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 201 len: 422 microversion: 2.10 time: 0.122938 Aug 10 22:56:15.693406 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 106/224] 10.222.0.58 () {62 vars in 1200 bytes} [Wed Aug 10 22:56:15 2022] POST /compute/v2.1/os-keypairs => generated 422 bytes in 137 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 10 22:56:15.703238 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-fdf23915-fe3c-46f7-8cc0-7cbb0a06132e tempest-KeyPairsV210TestJSON-761843193 tempest-KeyPairsV210TestJSON-761843193-project-admin] Calling method '.version_select at 0x7f847db4fdc0>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:15.709540 n-d-850468-14 devstack@n-api.service[122633]: WARNING oslo_db.sqlalchemy.utils [None req-fdf23915-fe3c-46f7-8cc0-7cbb0a06132e tempest-KeyPairsV210TestJSON-761843193 tempest-KeyPairsV210TestJSON-761843193-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Aug 10 22:56:15.720125 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-fdf23915-fe3c-46f7-8cc0-7cbb0a06132e tempest-KeyPairsV210TestJSON-761843193 tempest-KeyPairsV210TestJSON-761843193-project-admin] 10.222.0.58 "GET /compute/v2.1/os-keypairs?user_id=8a2c04565c2a4fb8bd825862c1634c82" status: 200 len: 726 microversion: 2.10 time: 0.024915 Aug 10 22:56:15.727750 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 107/225] 10.222.0.58 () {60 vars in 1259 bytes} [Wed Aug 10 22:56:15 2022] GET /compute/v2.1/os-keypairs?user_id=8a2c04565c2a4fb8bd825862c1634c82 => generated 726 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 22:56:15.732918 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-ecad1aad-6307-4a72-88cb-6719ba46c9d2 tempest-KeyPairsV210TestJSON-761843193 tempest-KeyPairsV210TestJSON-761843193-project-admin] Calling method '.version_select at 0x7f847dc7d9d0>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:15.777244 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-ecad1aad-6307-4a72-88cb-6719ba46c9d2 tempest-KeyPairsV210TestJSON-761843193 tempest-KeyPairsV210TestJSON-761843193-project-admin] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1156819001" status: 204 len: 0 microversion: 2.10 time: 0.048287 Aug 10 22:56:15.779446 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 108/226] 10.222.0.58 () {60 vars in 1325 bytes} [Wed Aug 10 22:56:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-1156819001 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 10 22:56:15.799579 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c70bc0ca-0143-477b-a7e1-aa79b7a96c7c tempest-KeyPairsV210TestJSON-761843193 tempest-KeyPairsV210TestJSON-761843193-project-admin] Calling method '.version_select at 0x7f847db4fee0>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:15.846254 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-bbbdfcdb-158b-44a1-a0de-07d8c5e9f7ec tempest-AggregatesAdminTestJSON-1841140741 tempest-AggregatesAdminTestJSON-1841140741-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 241 microversion: 2.1 time: 0.278219 Aug 10 22:56:15.847191 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 119/227] 10.222.0.58 () {60 vars in 1191 bytes} [Wed Aug 10 22:56:15 2022] POST /compute/v2.1/os-aggregates/3/action => generated 241 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:56:15.850259 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-c70bc0ca-0143-477b-a7e1-aa79b7a96c7c tempest-KeyPairsV210TestJSON-761843193 tempest-KeyPairsV210TestJSON-761843193-project-admin] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2071763248?user_id=8a2c04565c2a4fb8bd825862c1634c82" status: 204 len: 0 microversion: 2.10 time: 0.062554 Aug 10 22:56:15.851500 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 109/228] 10.222.0.58 () {60 vars in 1343 bytes} [Wed Aug 10 22:56:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2071763248?user_id=8a2c04565c2a4fb8bd825862c1634c82 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 10 22:56:15.858544 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-8259c2b0-6926-4b8d-834c-e0475d4b1cdb tempest-AggregatesAdminTestJSON-1841140741 tempest-AggregatesAdminTestJSON-1841140741-project-admin] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:15.859779 n-d-850468-14 devstack@n-api.service[122632]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:56:15.859779 n-d-850468-14 devstack@n-api.service[122632]: warnings.warn(msg) Aug 10 22:56:15.877539 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-8259c2b0-6926-4b8d-834c-e0475d4b1cdb tempest-AggregatesAdminTestJSON-1841140741 tempest-AggregatesAdminTestJSON-1841140741-project-admin] 10.222.0.58 "GET /compute/v2.1/os-aggregates/3" status: 200 len: 241 microversion: 2.1 time: 0.023214 Aug 10 22:56:15.880410 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-1df787b4-79ab-4c03-81db-1ea8f382bd40 tempest-KeyPairsV210TestJSON-761843193 tempest-KeyPairsV210TestJSON-761843193-project-admin] Calling method '.version_select at 0x7f847daf8c10>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:15.894134 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 120/229] 10.222.0.58 () {58 vars in 1149 bytes} [Wed Aug 10 22:56:15 2022] GET /compute/v2.1/os-aggregates/3 => generated 241 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 22:56:15.905886 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-564ee8b4-9073-4fcd-8a03-fcd6a59be786 tempest-AggregatesAdminTestJSON-1841140741 tempest-AggregatesAdminTestJSON-1841140741-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-850468-14"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:56:15.908157 n-d-850468-14 devstack@n-api.service[122632]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:56:15.908157 n-d-850468-14 devstack@n-api.service[122632]: warnings.warn(msg) Aug 10 22:56:15.920812 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-564ee8b4-9073-4fcd-8a03-fcd6a59be786 tempest-AggregatesAdminTestJSON-1841140741 tempest-AggregatesAdminTestJSON-1841140741-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:15.921370 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-564ee8b4-9073-4fcd-8a03-fcd6a59be786 tempest-AggregatesAdminTestJSON-1841140741 tempest-AggregatesAdminTestJSON-1841140741-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:15.922060 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-564ee8b4-9073-4fcd-8a03-fcd6a59be786 tempest-AggregatesAdminTestJSON-1841140741 tempest-AggregatesAdminTestJSON-1841140741-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:15.935995 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-1df787b4-79ab-4c03-81db-1ea8f382bd40 tempest-KeyPairsV210TestJSON-761843193 tempest-KeyPairsV210TestJSON-761843193-project-admin] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1477403071?user_id=8a2c04565c2a4fb8bd825862c1634c82" status: 204 len: 0 microversion: 2.10 time: 0.065909 Aug 10 22:56:15.944483 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 110/230] 10.222.0.58 () {60 vars in 1343 bytes} [Wed Aug 10 22:56:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1477403071?user_id=8a2c04565c2a4fb8bd825862c1634c82 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 10 22:56:16.239922 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-564ee8b4-9073-4fcd-8a03-fcd6a59be786 tempest-AggregatesAdminTestJSON-1841140741 tempest-AggregatesAdminTestJSON-1841140741-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 225 microversion: 2.1 time: 0.344105 Aug 10 22:56:16.256466 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 121/231] 10.222.0.58 () {60 vars in 1191 bytes} [Wed Aug 10 22:56:15 2022] POST /compute/v2.1/os-aggregates/3/action => generated 225 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:56:16.263224 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-02278042-a114-446b-a8f2-40b957de6e27 tempest-AggregatesAdminTestJSON-1841140741 tempest-AggregatesAdminTestJSON-1841140741-project-admin] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:16.265092 n-d-850468-14 devstack@n-api.service[122633]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:56:16.265092 n-d-850468-14 devstack@n-api.service[122633]: warnings.warn(msg) Aug 10 22:56:16.313746 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-abc3665d-3bc1-49ff-9c72-542b4b5d8f2c tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:16.314913 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-abc3665d-3bc1-49ff-9c72-542b4b5d8f2c tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] [instance: ef725aca-9cd8-49a0-81cd-d23710041306] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:56:16.331059 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-02278042-a114-446b-a8f2-40b957de6e27 tempest-AggregatesAdminTestJSON-1841140741 tempest-AggregatesAdminTestJSON-1841140741-project-admin] 10.222.0.58 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.073938 Aug 10 22:56:16.333930 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 111/232] 10.222.0.58 () {58 vars in 1152 bytes} [Wed Aug 10 22:56:16 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 10 22:56:16.360196 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-57286524-64f4-41ae-b6b3-4f3d4462f3b9 tempest-AggregatesAdminTestJSON-1841140741 tempest-AggregatesAdminTestJSON-1841140741-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1849534594"}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:56:16.362568 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-abc3665d-3bc1-49ff-9c72-542b4b5d8f2c tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:16.363548 n-d-850468-14 devstack@n-api.service[122633]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:56:16.363548 n-d-850468-14 devstack@n-api.service[122633]: warnings.warn(msg) Aug 10 22:56:16.364239 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-abc3665d-3bc1-49ff-9c72-542b4b5d8f2c tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:16.364487 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.objects.aggregate [None req-57286524-64f4-41ae-b6b3-4f3d4462f3b9 tempest-AggregatesAdminTestJSON-1841140741 tempest-AggregatesAdminTestJSON-1841140741-project-admin] Generated uuid 07d03a79-9394-4ea7-bd4e-5488010154d4 for aggregate {{(pid=122633) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 10 22:56:16.368833 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-abc3665d-3bc1-49ff-9c72-542b4b5d8f2c tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:16.370480 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-abc3665d-3bc1-49ff-9c72-542b4b5d8f2c tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:16.372485 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-abc3665d-3bc1-49ff-9c72-542b4b5d8f2c tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:16.373630 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-abc3665d-3bc1-49ff-9c72-542b4b5d8f2c tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:16.443951 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-57286524-64f4-41ae-b6b3-4f3d4462f3b9 tempest-AggregatesAdminTestJSON-1841140741 tempest-AggregatesAdminTestJSON-1841140741-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.099535 Aug 10 22:56:16.445836 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 112/233] 10.222.0.58 () {60 vars in 1164 bytes} [Wed Aug 10 22:56:16 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:56:16.461024 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-cf85b96a-82fe-41a4-8d48-b2bb6b46b3fa tempest-AggregatesAdminTestJSON-1841140741 tempest-AggregatesAdminTestJSON-1841140741-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-850468-14"}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:56:16.471676 n-d-850468-14 devstack@n-api.service[122633]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:56:16.471676 n-d-850468-14 devstack@n-api.service[122633]: warnings.warn(msg) Aug 10 22:56:16.498088 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cf85b96a-82fe-41a4-8d48-b2bb6b46b3fa tempest-AggregatesAdminTestJSON-1841140741 tempest-AggregatesAdminTestJSON-1841140741-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:16.499014 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cf85b96a-82fe-41a4-8d48-b2bb6b46b3fa tempest-AggregatesAdminTestJSON-1841140741 tempest-AggregatesAdminTestJSON-1841140741-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:16.500436 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cf85b96a-82fe-41a4-8d48-b2bb6b46b3fa tempest-AggregatesAdminTestJSON-1841140741 tempest-AggregatesAdminTestJSON-1841140741-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:16.733186 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-cf85b96a-82fe-41a4-8d48-b2bb6b46b3fa tempest-AggregatesAdminTestJSON-1841140741 tempest-AggregatesAdminTestJSON-1841140741-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 243 microversion: 2.1 time: 0.275953 Aug 10 22:56:16.739556 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 113/234] 10.222.0.58 () {60 vars in 1191 bytes} [Wed Aug 10 22:56:16 2022] POST /compute/v2.1/os-aggregates/4/action => generated 243 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:56:16.750639 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-0a6e07b7-5a79-49e6-9b3d-e6f77aa8e097 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:16.756662 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-0a6e07b7-5a79-49e6-9b3d-e6f77aa8e097 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] [instance: 37093f4d-0663-4b69-a48f-5fd757acd9c0] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:56:16.772097 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0a6e07b7-5a79-49e6-9b3d-e6f77aa8e097 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:16.774264 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0a6e07b7-5a79-49e6-9b3d-e6f77aa8e097 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:16.774726 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0a6e07b7-5a79-49e6-9b3d-e6f77aa8e097 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:16.775549 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0a6e07b7-5a79-49e6-9b3d-e6f77aa8e097 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:16.775964 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0a6e07b7-5a79-49e6-9b3d-e6f77aa8e097 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:16.776389 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0a6e07b7-5a79-49e6-9b3d-e6f77aa8e097 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:16.854161 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-abc3665d-3bc1-49ff-9c72-542b4b5d8f2c tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaed2a2e56f749a88c340aaccb15d2d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deaba512051743deb45881d76eb206ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:16.874322 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-abc3665d-3bc1-49ff-9c72-542b4b5d8f2c tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] 10.222.0.58 "GET /compute/v2.1/servers/ef725aca-9cd8-49a0-81cd-d23710041306" status: 200 len: 1322 microversion: 2.1 time: 0.572616 Aug 10 22:56:16.876554 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 122/235] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:56:16 2022] GET /compute/v2.1/servers/ef725aca-9cd8-49a0-81cd-d23710041306 => generated 1322 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:56:16.890941 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-4ba9dae0-b7ef-47bf-aad0-d9f692afecc1 tempest-AggregatesAdminTestJSON-1841140741 tempest-AggregatesAdminTestJSON-1841140741-project-admin] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:16.893508 n-d-850468-14 devstack@n-api.service[122632]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:56:16.893508 n-d-850468-14 devstack@n-api.service[122632]: warnings.warn(msg) Aug 10 22:56:16.911759 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-4ba9dae0-b7ef-47bf-aad0-d9f692afecc1 tempest-AggregatesAdminTestJSON-1841140741 tempest-AggregatesAdminTestJSON-1841140741-project-admin] 10.222.0.58 "GET /compute/v2.1/os-aggregates" status: 200 len: 246 microversion: 2.1 time: 0.033144 Aug 10 22:56:16.918691 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 123/236] 10.222.0.58 () {58 vars in 1143 bytes} [Wed Aug 10 22:56:16 2022] GET /compute/v2.1/os-aggregates => generated 246 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:56:16.931773 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-48ab4db0-616b-4813-8f64-1b9b0fce064c tempest-AggregatesAdminTestJSON-1841140741 tempest-AggregatesAdminTestJSON-1841140741-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-850468-14"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:56:16.935499 n-d-850468-14 devstack@n-api.service[122632]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:56:16.935499 n-d-850468-14 devstack@n-api.service[122632]: warnings.warn(msg) Aug 10 22:56:16.980078 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-48ab4db0-616b-4813-8f64-1b9b0fce064c tempest-AggregatesAdminTestJSON-1841140741 tempest-AggregatesAdminTestJSON-1841140741-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:16.980863 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-48ab4db0-616b-4813-8f64-1b9b0fce064c tempest-AggregatesAdminTestJSON-1841140741 tempest-AggregatesAdminTestJSON-1841140741-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:16.981399 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-48ab4db0-616b-4813-8f64-1b9b0fce064c tempest-AggregatesAdminTestJSON-1841140741 tempest-AggregatesAdminTestJSON-1841140741-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:17.033285 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-0a6e07b7-5a79-49e6-9b3d-e6f77aa8e097 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64648d3c6f5c423e83ff023e7bf6550a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434532ba922f406d8d8c197d3a57ffc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:17.046426 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-0a6e07b7-5a79-49e6-9b3d-e6f77aa8e097 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] 10.222.0.58 "GET /compute/v2.1/servers/37093f4d-0663-4b69-a48f-5fd757acd9c0" status: 200 len: 1433 microversion: 2.1 time: 0.307964 Aug 10 22:56:17.054310 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 114/237] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:56:16 2022] GET /compute/v2.1/servers/37093f4d-0663-4b69-a48f-5fd757acd9c0 => generated 1433 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:56:17.303339 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-2d6ef8ef-0ae4-4110-84f8-4b6830e83104 req-a271937c-9709-4fd5-91b2-694eab806332 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37093f4d-0663-4b69-a48f-5fd757acd9c0", "name": "network-vif-deleted", "tag": "9668aa85-ea99-41cb-95a0-d2a4cafadd33"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:56:17.311556 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-48ab4db0-616b-4813-8f64-1b9b0fce064c tempest-AggregatesAdminTestJSON-1841140741 tempest-AggregatesAdminTestJSON-1841140741-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 227 microversion: 2.1 time: 0.373987 Aug 10 22:56:17.323122 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 124/238] 10.222.0.58 () {60 vars in 1191 bytes} [Wed Aug 10 22:56:16 2022] POST /compute/v2.1/os-aggregates/4/action => generated 227 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:56:17.339916 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-7e8014b1-72de-422f-8cd7-371df001b129 tempest-AggregatesAdminTestJSON-1841140741 tempest-AggregatesAdminTestJSON-1841140741-project-admin] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:17.343787 n-d-850468-14 devstack@n-api.service[122632]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:56:17.343787 n-d-850468-14 devstack@n-api.service[122632]: warnings.warn(msg) Aug 10 22:56:17.352224 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-2d6ef8ef-0ae4-4110-84f8-4b6830e83104 req-a271937c-9709-4fd5-91b2-694eab806332 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:17.353368 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-2d6ef8ef-0ae4-4110-84f8-4b6830e83104 req-a271937c-9709-4fd5-91b2-694eab806332 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:17.354237 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-2d6ef8ef-0ae4-4110-84f8-4b6830e83104 req-a271937c-9709-4fd5-91b2-694eab806332 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:17.400123 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-7e8014b1-72de-422f-8cd7-371df001b129 tempest-AggregatesAdminTestJSON-1841140741 tempest-AggregatesAdminTestJSON-1841140741-project-admin] 10.222.0.58 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.075559 Aug 10 22:56:17.402313 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 125/239] 10.222.0.58 () {58 vars in 1152 bytes} [Wed Aug 10 22:56:17 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 10 22:56:17.415698 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-99a6fbb0-3ff5-4001-a7fa-eeff36ea9ff9 tempest-AggregatesAdminTestJSON-1841140741 tempest-AggregatesAdminTestJSON-1841140741-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1738911539"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:56:17.425342 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-2d6ef8ef-0ae4-4110-84f8-4b6830e83104 req-a271937c-9709-4fd5-91b2-694eab806332 service nova] Creating event network-vif-deleted:9668aa85-ea99-41cb-95a0-d2a4cafadd33 for instance 37093f4d-0663-4b69-a48f-5fd757acd9c0 on n-h2-850468-14 Aug 10 22:56:17.427765 n-d-850468-14 devstack@n-api.service[122632]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:56:17.427765 n-d-850468-14 devstack@n-api.service[122632]: warnings.warn(msg) Aug 10 22:56:17.428161 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-2d6ef8ef-0ae4-4110-84f8-4b6830e83104 req-a271937c-9709-4fd5-91b2-694eab806332 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=122633) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 10 22:56:17.429302 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-2d6ef8ef-0ae4-4110-84f8-4b6830e83104 req-a271937c-9709-4fd5-91b2-694eab806332 service nova] Acquired lock "compute-rpcapi-router" {{(pid=122633) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 10 22:56:17.431163 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b3b8461a-aa85-46b0-9d43-46e121e5d593 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:17.431945 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.objects.aggregate [None req-99a6fbb0-3ff5-4001-a7fa-eeff36ea9ff9 tempest-AggregatesAdminTestJSON-1841140741 tempest-AggregatesAdminTestJSON-1841140741-project-admin] Generated uuid 41b40606-60b1-4aa7-a0b9-09cb84d4a20c for aggregate {{(pid=122632) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 10 22:56:17.435419 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b3b8461a-aa85-46b0-9d43-46e121e5d593 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:17.437539 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b3b8461a-aa85-46b0-9d43-46e121e5d593 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:17.438560 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b3b8461a-aa85-46b0-9d43-46e121e5d593 None None] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:17.441604 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b3b8461a-aa85-46b0-9d43-46e121e5d593 None None] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:17.442661 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b3b8461a-aa85-46b0-9d43-46e121e5d593 None None] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:17.465325 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.compute.rpcapi [None req-b3b8461a-aa85-46b0-9d43-46e121e5d593 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 10 22:56:17.466678 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b3b8461a-aa85-46b0-9d43-46e121e5d593 None None] Releasing lock "compute-rpcapi-router" {{(pid=122633) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 10 22:56:17.484167 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-99a6fbb0-3ff5-4001-a7fa-eeff36ea9ff9 tempest-AggregatesAdminTestJSON-1841140741 tempest-AggregatesAdminTestJSON-1841140741-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.074363 Aug 10 22:56:17.494334 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 126/240] 10.222.0.58 () {60 vars in 1164 bytes} [Wed Aug 10 22:56:17 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:56:17.501114 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-7c6e5179-ce77-4986-8bfa-649c835eb119 tempest-AggregatesAdminTestJSON-1841140741 tempest-AggregatesAdminTestJSON-1841140741-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-850468-14"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:56:17.504903 n-d-850468-14 devstack@n-api.service[122632]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:56:17.504903 n-d-850468-14 devstack@n-api.service[122632]: warnings.warn(msg) Aug 10 22:56:17.543353 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7c6e5179-ce77-4986-8bfa-649c835eb119 tempest-AggregatesAdminTestJSON-1841140741 tempest-AggregatesAdminTestJSON-1841140741-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:17.544644 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-b3b8461a-aa85-46b0-9d43-46e121e5d593 None None] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.246648 Aug 10 22:56:17.545733 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 115/241] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 22:56:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 22:56:17.551083 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7c6e5179-ce77-4986-8bfa-649c835eb119 tempest-AggregatesAdminTestJSON-1841140741 tempest-AggregatesAdminTestJSON-1841140741-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:17.551848 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7c6e5179-ce77-4986-8bfa-649c835eb119 tempest-AggregatesAdminTestJSON-1841140741 tempest-AggregatesAdminTestJSON-1841140741-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:17.782773 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-7c6e5179-ce77-4986-8bfa-649c835eb119 tempest-AggregatesAdminTestJSON-1841140741 tempest-AggregatesAdminTestJSON-1841140741-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates/5/action" status: 200 len: 243 microversion: 2.1 time: 0.286872 Aug 10 22:56:17.788040 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 127/242] 10.222.0.58 () {60 vars in 1191 bytes} [Wed Aug 10 22:56:17 2022] POST /compute/v2.1/os-aggregates/5/action => generated 243 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:56:17.802319 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-e0185bd8-20ac-45af-b1e2-23ff1a52b343 tempest-AggregatesAdminTestJSON-1841140741 tempest-AggregatesAdminTestJSON-1841140741-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-850468-14"}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:56:17.807094 n-d-850468-14 devstack@n-api.service[122633]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:56:17.807094 n-d-850468-14 devstack@n-api.service[122633]: warnings.warn(msg) Aug 10 22:56:17.820779 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e0185bd8-20ac-45af-b1e2-23ff1a52b343 tempest-AggregatesAdminTestJSON-1841140741 tempest-AggregatesAdminTestJSON-1841140741-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:17.822993 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e0185bd8-20ac-45af-b1e2-23ff1a52b343 tempest-AggregatesAdminTestJSON-1841140741 tempest-AggregatesAdminTestJSON-1841140741-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:17.824177 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e0185bd8-20ac-45af-b1e2-23ff1a52b343 tempest-AggregatesAdminTestJSON-1841140741 tempest-AggregatesAdminTestJSON-1841140741-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:17.904421 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-4fa69508-73ce-4e5d-9823-480220b33ec7 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:17.905959 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-4fa69508-73ce-4e5d-9823-480220b33ec7 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] [instance: ef725aca-9cd8-49a0-81cd-d23710041306] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:56:17.915811 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4fa69508-73ce-4e5d-9823-480220b33ec7 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:17.921531 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4fa69508-73ce-4e5d-9823-480220b33ec7 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:17.922418 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4fa69508-73ce-4e5d-9823-480220b33ec7 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:17.931768 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4fa69508-73ce-4e5d-9823-480220b33ec7 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:17.932786 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4fa69508-73ce-4e5d-9823-480220b33ec7 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:17.933434 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4fa69508-73ce-4e5d-9823-480220b33ec7 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:18.362591 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-e0185bd8-20ac-45af-b1e2-23ff1a52b343 tempest-AggregatesAdminTestJSON-1841140741 tempest-AggregatesAdminTestJSON-1841140741-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates/5/action" status: 200 len: 227 microversion: 2.1 time: 0.571088 Aug 10 22:56:18.371275 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 116/243] 10.222.0.58 () {60 vars in 1191 bytes} [Wed Aug 10 22:56:17 2022] POST /compute/v2.1/os-aggregates/5/action => generated 227 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 22:56:18.381961 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-edaf1101-0081-4af8-b903-d25664cf8897 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:18.383268 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-edaf1101-0081-4af8-b903-d25664cf8897 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] [instance: 37093f4d-0663-4b69-a48f-5fd757acd9c0] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:56:18.394088 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-edaf1101-0081-4af8-b903-d25664cf8897 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:18.394960 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-edaf1101-0081-4af8-b903-d25664cf8897 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:18.396095 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-edaf1101-0081-4af8-b903-d25664cf8897 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:18.397128 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-edaf1101-0081-4af8-b903-d25664cf8897 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:18.397877 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-edaf1101-0081-4af8-b903-d25664cf8897 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:18.398512 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-edaf1101-0081-4af8-b903-d25664cf8897 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:18.420381 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-edaf1101-0081-4af8-b903-d25664cf8897 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] HTTP exception thrown: Instance 37093f4d-0663-4b69-a48f-5fd757acd9c0 could not be found. Aug 10 22:56:18.425024 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-edaf1101-0081-4af8-b903-d25664cf8897 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Request method failure captured: Aug 10 22:56:18.425024 n-d-850468-14 devstack@n-api.service[122633]: request: GET /compute/v2.1/servers/37093f4d-0663-4b69-a48f-5fd757acd9c0 HTTP/1.1 Aug 10 22:56:18.425024 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 22:56:18.425024 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 22:56:18.425024 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 22:56:18.425024 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 22:56:18.425024 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 22:56:18.425024 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 22:56:18.425024 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 22:56:18.425024 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 22:56:18.425024 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9DdqI6ADCrjNDcXrrpDiXvSSUEOh9NdPbsw158OiE7sPTsgjn73p_8mG-_cVwrv3uwkhCu1bReuRXLOk1fbrJynSTxlS3Bgd75LILRE-itZIeNvpjJ7RbU9jBDZ0rUJW4cmK6b6F7Cthv32NdJNOkkIl2teTw8IzEsUFKk1QcmAn7sQ Aug 10 22:56:18.425024 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 22:56:18.425024 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 22:56:18.425024 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 22:56:18.425024 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 22:56:18.425024 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 22:56:18.425024 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 22:56:18.425024 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 434532ba922f406d8d8c197d3a57ffc2 Aug 10 22:56:18.425024 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-DeleteServersAdminTestJSON-953196831 Aug 10 22:56:18.425024 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 22:56:18.425024 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 22:56:18.426290 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/434532ba922f406d8d8c197d3a57ffc2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/434532ba922f406d8d8c197d3a57ffc2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/434532ba922f406d8d8c197d3a57ffc2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_434532ba922f406d8d8c197d3a57ffc2", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 22:56:18.426290 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-DeleteServersAdminTestJSON-953196831 Aug 10 22:56:18.426290 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 434532ba922f406d8d8c197d3a57ffc2 Aug 10 22:56:18.426290 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-953196831 Aug 10 22:56:18.426290 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-DeleteServersAdminTestJSON-953196831-project Aug 10 22:56:18.426290 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 22:56:18.426290 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 22:56:18.426290 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 64648d3c6f5c423e83ff023e7bf6550a Aug 10 22:56:18.426290 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-DeleteServersAdminTestJSON-953196831-project Aug 10 22:56:18.426290 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 22:56:18.426290 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance 37093f4d-0663-4b69-a48f-5fd757acd9c0 could not be found. Aug 10 22:56:18.426290 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': '37093f4d-0663-4b69-a48f-5fd757acd9c0'} Aug 10 22:56:18.426982 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 22:56:18.426982 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:56:18.426982 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 22:56:18.426982 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 22:56:18.426982 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 22:56:18.426982 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 22:56:18.426982 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 22:56:18.426982 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 22:56:18.426982 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 22:56:18.426982 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 22:56:18.426982 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37093f4d-0663-4b69-a48f-5fd757acd9c0 could not be found. Aug 10 22:56:18.426982 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:56:18.426982 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:56:18.426982 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:56:18.426982 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:56:18.426982 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:56:18.426982 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:56:18.426982 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 22:56:18.426982 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 22:56:18.426982 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 22:56:18.428034 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 22:56:18.428034 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 22:56:18.428034 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 22:56:18.428034 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 22:56:18.428034 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 22:56:18.428034 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 22:56:18.428034 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 22:56:18.428034 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37093f4d-0663-4b69-a48f-5fd757acd9c0 could not be found. Aug 10 22:56:18.428034 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:56:18.428034 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:56:18.428034 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:56:18.428034 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:56:18.428034 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:56:18.428034 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:56:18.428034 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 22:56:18.428034 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 22:56:18.428034 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37093f4d-0663-4b69-a48f-5fd757acd9c0 could not be found. Aug 10 22:56:18.428034 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:56:18.431309 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-edaf1101-0081-4af8-b903-d25664cf8897 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Returning 404 to user: Instance 37093f4d-0663-4b69-a48f-5fd757acd9c0 could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 22:56:18.432247 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-edaf1101-0081-4af8-b903-d25664cf8897 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] 10.222.0.58 "GET /compute/v2.1/servers/37093f4d-0663-4b69-a48f-5fd757acd9c0" status: 404 len: 111 microversion: 2.1 time: 0.058972 Aug 10 22:56:18.433368 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 117/244] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:56:18 2022] GET /compute/v2.1/servers/37093f4d-0663-4b69-a48f-5fd757acd9c0 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 22:56:18.474004 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-4ecbb5bf-68eb-4c41-ba9e-5c1d4b060f0b tempest-AggregatesAdminTestJSON-1841140741 tempest-AggregatesAdminTestJSON-1841140741-project-admin] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:18.475335 n-d-850468-14 devstack@n-api.service[122633]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:56:18.475335 n-d-850468-14 devstack@n-api.service[122633]: warnings.warn(msg) Aug 10 22:56:18.535940 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-4ecbb5bf-68eb-4c41-ba9e-5c1d4b060f0b tempest-AggregatesAdminTestJSON-1841140741 tempest-AggregatesAdminTestJSON-1841140741-project-admin] 10.222.0.58 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.101216 Aug 10 22:56:18.537309 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 118/245] 10.222.0.58 () {58 vars in 1152 bytes} [Wed Aug 10 22:56:18 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 10 22:56:18.551317 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-7163453b-6322-4ddb-b424-5ca3e688e688 tempest-AggregatesAdminTestJSON-1841140741 tempest-AggregatesAdminTestJSON-1841140741-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1983127616"}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:56:18.559793 n-d-850468-14 devstack@n-api.service[122633]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:56:18.559793 n-d-850468-14 devstack@n-api.service[122633]: warnings.warn(msg) Aug 10 22:56:18.562561 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.objects.aggregate [None req-7163453b-6322-4ddb-b424-5ca3e688e688 tempest-AggregatesAdminTestJSON-1841140741 tempest-AggregatesAdminTestJSON-1841140741-project-admin] Generated uuid 81a0edd6-d196-442b-8365-469778d197bf for aggregate {{(pid=122633) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 10 22:56:18.603786 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-7163453b-6322-4ddb-b424-5ca3e688e688 tempest-AggregatesAdminTestJSON-1841140741 tempest-AggregatesAdminTestJSON-1841140741-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.058951 Aug 10 22:56:18.607155 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 119/246] 10.222.0.58 () {60 vars in 1164 bytes} [Wed Aug 10 22:56:18 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:56:18.625320 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-62b8babe-1064-4e3e-8fc0-82c60786bcf3 tempest-AggregatesAdminTestJSON-1841140741 tempest-AggregatesAdminTestJSON-1841140741-project-admin] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:18.625320 n-d-850468-14 devstack@n-api.service[122633]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:56:18.625320 n-d-850468-14 devstack@n-api.service[122633]: warnings.warn(msg) Aug 10 22:56:18.642179 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_api:DELETE=11,nova_api:SELECT=83,nova_api:INSERT=6 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:56:18.657187 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-62b8babe-1064-4e3e-8fc0-82c60786bcf3 tempest-AggregatesAdminTestJSON-1841140741 tempest-AggregatesAdminTestJSON-1841140741-project-admin] 10.222.0.58 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.044318 Aug 10 22:56:18.658859 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 120/247] 10.222.0.58 () {58 vars in 1152 bytes} [Wed Aug 10 22:56:18 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 10 22:56:18.672513 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-e4ed65ab-bf19-484d-b741-bfcbc5f2a128 tempest-AggregatesAdminTestJSON-1841140741 tempest-AggregatesAdminTestJSON-1841140741-project-admin] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:18.673888 n-d-850468-14 devstack@n-api.service[122633]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:56:18.673888 n-d-850468-14 devstack@n-api.service[122633]: warnings.warn(msg) Aug 10 22:56:18.681197 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-e4ed65ab-bf19-484d-b741-bfcbc5f2a128 tempest-AggregatesAdminTestJSON-1841140741 tempest-AggregatesAdminTestJSON-1841140741-project-admin] HTTP exception thrown: Aggregate 6 could not be found. Aug 10 22:56:18.694269 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-e4ed65ab-bf19-484d-b741-bfcbc5f2a128 tempest-AggregatesAdminTestJSON-1841140741 tempest-AggregatesAdminTestJSON-1841140741-project-admin] Request method failure captured: Aug 10 22:56:18.694269 n-d-850468-14 devstack@n-api.service[122633]: request: GET /compute/v2.1/os-aggregates/6 HTTP/1.1 Aug 10 22:56:18.694269 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 22:56:18.694269 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 22:56:18.694269 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 22:56:18.694269 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 22:56:18.694269 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 22:56:18.694269 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 22:56:18.694269 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 22:56:18.694269 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 22:56:18.694269 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9Ddf0PUhpduIlQ6MX6ZwI6WIRPMxdzUrxGxZ7sIZVg9OVUwz1OvnvrOzT4iolCsLPJkLPGvgExBlSa8KOta5siMgJoBtjPQn22AZoSFpxN8eOJX0Mh7oyL-uELWGi5auY8FyBZJYU_LeEQQmmN780UHS7Vvjw3XOu7A7wfMuB2yOjSA Aug 10 22:56:18.694269 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 22:56:18.694269 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 22:56:18.694269 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 22:56:18.694269 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 22:56:18.694269 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 22:56:18.694269 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 22:56:18.694269 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: def4b19bd0d9471390e0fe89ae8b3d40 Aug 10 22:56:18.694269 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-AggregatesAdminTestJSON-1841140741 Aug 10 22:56:18.694269 n-d-850468-14 devstack@n-api.service[122633]: X-Role: admin,member,reader Aug 10 22:56:18.694269 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: admin,member,reader Aug 10 22:56:18.695552 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/def4b19bd0d9471390e0fe89ae8b3d40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/def4b19bd0d9471390e0fe89ae8b3d40"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/def4b19bd0d9471390e0fe89ae8b3d40"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_def4b19bd0d9471390e0fe89ae8b3d40", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 22:56:18.695552 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-AggregatesAdminTestJSON-1841140741 Aug 10 22:56:18.695552 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: def4b19bd0d9471390e0fe89ae8b3d40 Aug 10 22:56:18.695552 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1841140741 Aug 10 22:56:18.695552 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-AggregatesAdminTestJSON-1841140741-project-admin Aug 10 22:56:18.695552 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 22:56:18.695552 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 22:56:18.695552 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 2536d217b8fb49df975f0eeb3471f3b4 Aug 10 22:56:18.695552 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-AggregatesAdminTestJSON-1841140741-project-admin Aug 10 22:56:18.695552 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 22:56:18.695552 n-d-850468-14 devstack@n-api.service[122633]: exception: Aggregate 6 could not be found. Aug 10 22:56:18.695552 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': '6'} Aug 10 22:56:18.695552 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 22:56:18.696233 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:56:18.696233 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Aug 10 22:56:18.696233 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Aug 10 22:56:18.696233 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6430, in get_aggregate Aug 10 22:56:18.696233 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Aug 10 22:56:18.696233 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 10 22:56:18.696233 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 10 22:56:18.696233 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 10 22:56:18.696233 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 10 22:56:18.696233 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 10 22:56:18.696233 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 10 22:56:18.696233 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 10 22:56:18.696233 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 10 22:56:18.696233 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 6 could not be found. Aug 10 22:56:18.696233 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:56:18.696233 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:56:18.696233 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:56:18.696233 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:56:18.696233 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:56:18.697234 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:56:18.697234 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 22:56:18.697234 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 22:56:18.697234 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 22:56:18.697234 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 22:56:18.697234 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Aug 10 22:56:18.697234 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 22:56:18.697234 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 6 could not be found. Aug 10 22:56:18.697234 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:56:18.697234 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:56:18.697234 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:56:18.697234 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:56:18.697234 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:56:18.697234 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:56:18.697234 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 22:56:18.697234 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 22:56:18.697234 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 6 could not be found. Aug 10 22:56:18.697234 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:56:18.699562 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-e4ed65ab-bf19-484d-b741-bfcbc5f2a128 tempest-AggregatesAdminTestJSON-1841140741 tempest-AggregatesAdminTestJSON-1841140741-project-admin] Returning 404 to user: Aggregate 6 could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 22:56:18.701368 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-e4ed65ab-bf19-484d-b741-bfcbc5f2a128 tempest-AggregatesAdminTestJSON-1841140741 tempest-AggregatesAdminTestJSON-1841140741-project-admin] 10.222.0.58 "GET /compute/v2.1/os-aggregates/6" status: 404 len: 77 microversion: 2.1 time: 0.037816 Aug 10 22:56:18.702538 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 121/248] 10.222.0.58 () {58 vars in 1149 bytes} [Wed Aug 10 22:56:18 2022] GET /compute/v2.1/os-aggregates/6 => generated 77 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 10 22:56:18.728378 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-780e37fe-851c-4604-8c9d-669ede71fde8 tempest-AggregatesAdminTestJSON-1841140741 tempest-AggregatesAdminTestJSON-1841140741-project-admin] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:18.730056 n-d-850468-14 devstack@n-api.service[122633]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:56:18.730056 n-d-850468-14 devstack@n-api.service[122633]: warnings.warn(msg) Aug 10 22:56:18.752652 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-780e37fe-851c-4604-8c9d-669ede71fde8 tempest-AggregatesAdminTestJSON-1841140741 tempest-AggregatesAdminTestJSON-1841140741-project-admin] HTTP exception thrown: Aggregate 6 could not be found. Aug 10 22:56:18.755363 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-780e37fe-851c-4604-8c9d-669ede71fde8 tempest-AggregatesAdminTestJSON-1841140741 tempest-AggregatesAdminTestJSON-1841140741-project-admin] Request method failure captured: Aug 10 22:56:18.755363 n-d-850468-14 devstack@n-api.service[122633]: request: DELETE /compute/v2.1/os-aggregates/6 HTTP/1.1 Aug 10 22:56:18.755363 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 22:56:18.755363 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 22:56:18.755363 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 22:56:18.755363 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 22:56:18.755363 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 22:56:18.755363 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 22:56:18.755363 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 22:56:18.755363 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 22:56:18.755363 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9Ddf0PUhpduIlQ6MX6ZwI6WIRPMxdzUrxGxZ7sIZVg9OVUwz1OvnvrOzT4iolCsLPJkLPGvgExBlSa8KOta5siMgJoBtjPQn22AZoSFpxN8eOJX0Mh7oyL-uELWGi5auY8FyBZJYU_LeEQQmmN780UHS7Vvjw3XOu7A7wfMuB2yOjSA Aug 10 22:56:18.755363 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 22:56:18.755363 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 22:56:18.755363 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 22:56:18.755363 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 22:56:18.755363 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 22:56:18.755363 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 22:56:18.755363 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: def4b19bd0d9471390e0fe89ae8b3d40 Aug 10 22:56:18.755363 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-AggregatesAdminTestJSON-1841140741 Aug 10 22:56:18.755363 n-d-850468-14 devstack@n-api.service[122633]: X-Role: admin,member,reader Aug 10 22:56:18.755363 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: admin,member,reader Aug 10 22:56:18.756660 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/def4b19bd0d9471390e0fe89ae8b3d40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/def4b19bd0d9471390e0fe89ae8b3d40"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/def4b19bd0d9471390e0fe89ae8b3d40"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_def4b19bd0d9471390e0fe89ae8b3d40", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 22:56:18.756660 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-AggregatesAdminTestJSON-1841140741 Aug 10 22:56:18.756660 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: def4b19bd0d9471390e0fe89ae8b3d40 Aug 10 22:56:18.756660 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1841140741 Aug 10 22:56:18.756660 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-AggregatesAdminTestJSON-1841140741-project-admin Aug 10 22:56:18.756660 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 22:56:18.756660 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 22:56:18.756660 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 2536d217b8fb49df975f0eeb3471f3b4 Aug 10 22:56:18.756660 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-AggregatesAdminTestJSON-1841140741-project-admin Aug 10 22:56:18.756660 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 22:56:18.756660 n-d-850468-14 devstack@n-api.service[122633]: exception: Aggregate 6 could not be found. Aug 10 22:56:18.756660 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': '6'} Aug 10 22:56:18.756660 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 22:56:18.757325 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:56:18.757325 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Aug 10 22:56:18.757325 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Aug 10 22:56:18.757325 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 10 22:56:18.757325 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 10 22:56:18.757325 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 10 22:56:18.757325 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 10 22:56:18.757325 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 10 22:56:18.757325 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise self.value Aug 10 22:56:18.757325 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 10 22:56:18.757325 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 10 22:56:18.757325 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6483, in delete_aggregate Aug 10 22:56:18.757325 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Aug 10 22:56:18.757325 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 10 22:56:18.757325 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 10 22:56:18.757325 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 10 22:56:18.757325 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 10 22:56:18.757325 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 10 22:56:18.757325 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 10 22:56:18.758311 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 10 22:56:18.758311 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 10 22:56:18.758311 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 6 could not be found. Aug 10 22:56:18.758311 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:56:18.758311 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:56:18.758311 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:56:18.758311 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:56:18.758311 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:56:18.758311 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:56:18.758311 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 22:56:18.758311 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 22:56:18.758311 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 22:56:18.758311 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 22:56:18.758311 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Aug 10 22:56:18.758311 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 22:56:18.758311 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 6 could not be found. Aug 10 22:56:18.758311 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:56:18.758311 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:56:18.758311 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:56:18.758311 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:56:18.758311 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:56:18.759412 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:56:18.759412 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 22:56:18.759412 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 22:56:18.759412 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 6 could not be found. Aug 10 22:56:18.759412 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:56:18.759412 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-780e37fe-851c-4604-8c9d-669ede71fde8 tempest-AggregatesAdminTestJSON-1841140741 tempest-AggregatesAdminTestJSON-1841140741-project-admin] Returning 404 to user: Aggregate 6 could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 22:56:18.765165 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-780e37fe-851c-4604-8c9d-669ede71fde8 tempest-AggregatesAdminTestJSON-1841140741 tempest-AggregatesAdminTestJSON-1841140741-project-admin] 10.222.0.58 "DELETE /compute/v2.1/os-aggregates/6" status: 404 len: 77 microversion: 2.1 time: 0.058684 Aug 10 22:56:18.765776 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 122/249] 10.222.0.58 () {58 vars in 1152 bytes} [Wed Aug 10 22:56:18 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 77 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 10 22:56:18.776327 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-127013ce-443f-4e00-ad2f-b9772da912ec tempest-AggregatesAdminTestJSON-1841140741 tempest-AggregatesAdminTestJSON-1841140741-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-522320998", "name": "tempest-test_aggregate-1180698743"}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:56:18.791659 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-4fa69508-73ce-4e5d-9823-480220b33ec7 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaed2a2e56f749a88c340aaccb15d2d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deaba512051743deb45881d76eb206ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:18.803165 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-4fa69508-73ce-4e5d-9823-480220b33ec7 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] 10.222.0.58 "GET /compute/v2.1/servers/ef725aca-9cd8-49a0-81cd-d23710041306" status: 200 len: 1390 microversion: 2.1 time: 0.903260 Aug 10 22:56:18.804080 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 128/250] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:56:17 2022] GET /compute/v2.1/servers/ef725aca-9cd8-49a0-81cd-d23710041306 => generated 1390 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:56:18.838319 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-4ad24775-489a-4c13-aca1-54c30ceff03b tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1013179449", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:56:18.845872 n-d-850468-14 devstack@n-api.service[122633]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:56:18.845872 n-d-850468-14 devstack@n-api.service[122633]: warnings.warn(msg) Aug 10 22:56:18.853183 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.objects.aggregate [None req-127013ce-443f-4e00-ad2f-b9772da912ec tempest-AggregatesAdminTestJSON-1841140741 tempest-AggregatesAdminTestJSON-1841140741-project-admin] Generated uuid 9d38bd83-9999-4cba-8b1e-464947b7ae73 for aggregate {{(pid=122633) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 10 22:56:18.918144 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-127013ce-443f-4e00-ad2f-b9772da912ec tempest-AggregatesAdminTestJSON-1841140741 tempest-AggregatesAdminTestJSON-1841140741-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.146015 Aug 10 22:56:18.923468 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 123/251] 10.222.0.58 () {60 vars in 1165 bytes} [Wed Aug 10 22:56:18 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:56:18.933366 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-07f59438-0c31-4cde-a86f-207cf7ab4571 tempest-AggregatesAdminTestJSON-1841140741 tempest-AggregatesAdminTestJSON-1841140741-project-admin] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:18.938364 n-d-850468-14 devstack@n-api.service[122633]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:56:18.938364 n-d-850468-14 devstack@n-api.service[122633]: warnings.warn(msg) Aug 10 22:56:18.979011 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.network.neutron [None req-4ad24775-489a-4c13-aca1-54c30ceff03b tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] validate_networks() for None {{(pid=122632) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 22:56:18.987573 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-07f59438-0c31-4cde-a86f-207cf7ab4571 tempest-AggregatesAdminTestJSON-1841140741 tempest-AggregatesAdminTestJSON-1841140741-project-admin] 10.222.0.58 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.059398 Aug 10 22:56:18.992019 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 124/252] 10.222.0.58 () {58 vars in 1152 bytes} [Wed Aug 10 22:56:18 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 10 22:56:19.001061 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-79e72863-c864-468e-a55a-c353fb160b74 tempest-AggregatesAdminTestJSON-1841140741 tempest-AggregatesAdminTestJSON-1841140741-project-admin] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:19.001825 n-d-850468-14 devstack@n-api.service[122633]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:56:19.001825 n-d-850468-14 devstack@n-api.service[122633]: warnings.warn(msg) Aug 10 22:56:19.021202 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-79e72863-c864-468e-a55a-c353fb160b74 tempest-AggregatesAdminTestJSON-1841140741 tempest-AggregatesAdminTestJSON-1841140741-project-admin] HTTP exception thrown: Aggregate 7 could not be found. Aug 10 22:56:19.023729 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-79e72863-c864-468e-a55a-c353fb160b74 tempest-AggregatesAdminTestJSON-1841140741 tempest-AggregatesAdminTestJSON-1841140741-project-admin] Request method failure captured: Aug 10 22:56:19.023729 n-d-850468-14 devstack@n-api.service[122633]: request: GET /compute/v2.1/os-aggregates/7 HTTP/1.1 Aug 10 22:56:19.023729 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 22:56:19.023729 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 22:56:19.023729 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 22:56:19.023729 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 22:56:19.023729 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 22:56:19.023729 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 22:56:19.023729 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 22:56:19.023729 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 22:56:19.023729 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9Ddf0PUhpduIlQ6MX6ZwI6WIRPMxdzUrxGxZ7sIZVg9OVUwz1OvnvrOzT4iolCsLPJkLPGvgExBlSa8KOta5siMgJoBtjPQn22AZoSFpxN8eOJX0Mh7oyL-uELWGi5auY8FyBZJYU_LeEQQmmN780UHS7Vvjw3XOu7A7wfMuB2yOjSA Aug 10 22:56:19.023729 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 22:56:19.023729 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 22:56:19.023729 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 22:56:19.023729 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 22:56:19.023729 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 22:56:19.023729 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 22:56:19.023729 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: def4b19bd0d9471390e0fe89ae8b3d40 Aug 10 22:56:19.023729 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-AggregatesAdminTestJSON-1841140741 Aug 10 22:56:19.023729 n-d-850468-14 devstack@n-api.service[122633]: X-Role: admin,member,reader Aug 10 22:56:19.023729 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: admin,member,reader Aug 10 22:56:19.024951 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/def4b19bd0d9471390e0fe89ae8b3d40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/def4b19bd0d9471390e0fe89ae8b3d40"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/def4b19bd0d9471390e0fe89ae8b3d40"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_def4b19bd0d9471390e0fe89ae8b3d40", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 22:56:19.024951 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-AggregatesAdminTestJSON-1841140741 Aug 10 22:56:19.024951 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: def4b19bd0d9471390e0fe89ae8b3d40 Aug 10 22:56:19.024951 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1841140741 Aug 10 22:56:19.024951 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-AggregatesAdminTestJSON-1841140741-project-admin Aug 10 22:56:19.024951 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 22:56:19.024951 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 22:56:19.024951 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 2536d217b8fb49df975f0eeb3471f3b4 Aug 10 22:56:19.024951 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-AggregatesAdminTestJSON-1841140741-project-admin Aug 10 22:56:19.024951 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 22:56:19.024951 n-d-850468-14 devstack@n-api.service[122633]: exception: Aggregate 7 could not be found. Aug 10 22:56:19.024951 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': '7'} Aug 10 22:56:19.024951 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 22:56:19.025647 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:56:19.025647 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Aug 10 22:56:19.025647 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Aug 10 22:56:19.025647 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6430, in get_aggregate Aug 10 22:56:19.025647 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Aug 10 22:56:19.025647 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 10 22:56:19.025647 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 10 22:56:19.025647 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 10 22:56:19.025647 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 10 22:56:19.025647 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 10 22:56:19.025647 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 10 22:56:19.025647 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 10 22:56:19.025647 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 10 22:56:19.025647 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 7 could not be found. Aug 10 22:56:19.025647 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:56:19.025647 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:56:19.025647 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:56:19.025647 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:56:19.025647 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:56:19.026602 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:56:19.026602 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 22:56:19.026602 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 22:56:19.026602 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 22:56:19.026602 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 22:56:19.026602 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Aug 10 22:56:19.026602 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 22:56:19.026602 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 7 could not be found. Aug 10 22:56:19.026602 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:56:19.026602 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:56:19.026602 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:56:19.026602 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:56:19.026602 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:56:19.026602 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:56:19.026602 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 22:56:19.026602 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 22:56:19.026602 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 7 could not be found. Aug 10 22:56:19.026602 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:56:19.027546 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-79e72863-c864-468e-a55a-c353fb160b74 tempest-AggregatesAdminTestJSON-1841140741 tempest-AggregatesAdminTestJSON-1841140741-project-admin] Returning 404 to user: Aggregate 7 could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 22:56:19.027546 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-79e72863-c864-468e-a55a-c353fb160b74 tempest-AggregatesAdminTestJSON-1841140741 tempest-AggregatesAdminTestJSON-1841140741-project-admin] 10.222.0.58 "GET /compute/v2.1/os-aggregates/7" status: 404 len: 77 microversion: 2.1 time: 0.029088 Aug 10 22:56:19.027546 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 125/253] 10.222.0.58 () {58 vars in 1149 bytes} [Wed Aug 10 22:56:18 2022] GET /compute/v2.1/os-aggregates/7 => generated 77 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 10 22:56:19.036641 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-a7a846a0-00c9-4c3e-9fa7-b6b8c8635590 tempest-AggregatesAdminTestJSON-1841140741 tempest-AggregatesAdminTestJSON-1841140741-project-admin] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:19.037782 n-d-850468-14 devstack@n-api.service[122633]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:56:19.037782 n-d-850468-14 devstack@n-api.service[122633]: warnings.warn(msg) Aug 10 22:56:19.052091 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-a7a846a0-00c9-4c3e-9fa7-b6b8c8635590 tempest-AggregatesAdminTestJSON-1841140741 tempest-AggregatesAdminTestJSON-1841140741-project-admin] HTTP exception thrown: Aggregate 7 could not be found. Aug 10 22:56:19.054226 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-a7a846a0-00c9-4c3e-9fa7-b6b8c8635590 tempest-AggregatesAdminTestJSON-1841140741 tempest-AggregatesAdminTestJSON-1841140741-project-admin] Request method failure captured: Aug 10 22:56:19.054226 n-d-850468-14 devstack@n-api.service[122633]: request: DELETE /compute/v2.1/os-aggregates/7 HTTP/1.1 Aug 10 22:56:19.054226 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 22:56:19.054226 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 22:56:19.054226 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 22:56:19.054226 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 22:56:19.054226 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 22:56:19.054226 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 22:56:19.054226 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 22:56:19.054226 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 22:56:19.054226 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9Ddf0PUhpduIlQ6MX6ZwI6WIRPMxdzUrxGxZ7sIZVg9OVUwz1OvnvrOzT4iolCsLPJkLPGvgExBlSa8KOta5siMgJoBtjPQn22AZoSFpxN8eOJX0Mh7oyL-uELWGi5auY8FyBZJYU_LeEQQmmN780UHS7Vvjw3XOu7A7wfMuB2yOjSA Aug 10 22:56:19.054226 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 22:56:19.054226 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 22:56:19.054226 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 22:56:19.054226 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 22:56:19.054226 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 22:56:19.054226 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 22:56:19.054226 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: def4b19bd0d9471390e0fe89ae8b3d40 Aug 10 22:56:19.054226 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-AggregatesAdminTestJSON-1841140741 Aug 10 22:56:19.054226 n-d-850468-14 devstack@n-api.service[122633]: X-Role: admin,member,reader Aug 10 22:56:19.054226 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: admin,member,reader Aug 10 22:56:19.055640 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/def4b19bd0d9471390e0fe89ae8b3d40"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/def4b19bd0d9471390e0fe89ae8b3d40"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/def4b19bd0d9471390e0fe89ae8b3d40"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_def4b19bd0d9471390e0fe89ae8b3d40", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 22:56:19.055640 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-AggregatesAdminTestJSON-1841140741 Aug 10 22:56:19.055640 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: def4b19bd0d9471390e0fe89ae8b3d40 Aug 10 22:56:19.055640 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1841140741 Aug 10 22:56:19.055640 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-AggregatesAdminTestJSON-1841140741-project-admin Aug 10 22:56:19.055640 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 22:56:19.055640 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 22:56:19.055640 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 2536d217b8fb49df975f0eeb3471f3b4 Aug 10 22:56:19.055640 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-AggregatesAdminTestJSON-1841140741-project-admin Aug 10 22:56:19.055640 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 22:56:19.055640 n-d-850468-14 devstack@n-api.service[122633]: exception: Aggregate 7 could not be found. Aug 10 22:56:19.055640 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': '7'} Aug 10 22:56:19.055640 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 22:56:19.056538 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:56:19.056538 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Aug 10 22:56:19.056538 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Aug 10 22:56:19.056538 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 10 22:56:19.056538 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 10 22:56:19.056538 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 10 22:56:19.056538 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 10 22:56:19.056538 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 10 22:56:19.056538 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise self.value Aug 10 22:56:19.056538 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 10 22:56:19.056538 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 10 22:56:19.056538 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6483, in delete_aggregate Aug 10 22:56:19.056538 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Aug 10 22:56:19.056538 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 10 22:56:19.056538 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 10 22:56:19.056538 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 10 22:56:19.056538 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 10 22:56:19.056538 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 10 22:56:19.056538 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 10 22:56:19.057747 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 10 22:56:19.057747 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 10 22:56:19.057747 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 7 could not be found. Aug 10 22:56:19.057747 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:56:19.057747 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:56:19.057747 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:56:19.057747 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:56:19.057747 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:56:19.057747 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:56:19.057747 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 22:56:19.057747 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 22:56:19.057747 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 22:56:19.057747 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 22:56:19.057747 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Aug 10 22:56:19.057747 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 22:56:19.057747 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 7 could not be found. Aug 10 22:56:19.057747 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:56:19.057747 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:56:19.057747 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:56:19.057747 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:56:19.057747 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:56:19.059151 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:56:19.059151 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 22:56:19.059151 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 22:56:19.059151 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 7 could not be found. Aug 10 22:56:19.059151 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:56:19.060019 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-a7a846a0-00c9-4c3e-9fa7-b6b8c8635590 tempest-AggregatesAdminTestJSON-1841140741 tempest-AggregatesAdminTestJSON-1841140741-project-admin] Returning 404 to user: Aggregate 7 could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 22:56:19.062280 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-a7a846a0-00c9-4c3e-9fa7-b6b8c8635590 tempest-AggregatesAdminTestJSON-1841140741 tempest-AggregatesAdminTestJSON-1841140741-project-admin] 10.222.0.58 "DELETE /compute/v2.1/os-aggregates/7" status: 404 len: 77 microversion: 2.1 time: 0.030837 Aug 10 22:56:19.063614 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 126/254] 10.222.0.58 () {58 vars in 1152 bytes} [Wed Aug 10 22:56:19 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 77 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 10 22:56:19.075589 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-99754e1d-b94a-402f-a426-c13f0a84172f tempest-AggregatesAdminTestJSON-1841140741 tempest-AggregatesAdminTestJSON-1841140741-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1811466754"}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:56:19.079232 n-d-850468-14 devstack@n-api.service[122633]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:56:19.079232 n-d-850468-14 devstack@n-api.service[122633]: warnings.warn(msg) Aug 10 22:56:19.080696 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.objects.aggregate [None req-99754e1d-b94a-402f-a426-c13f0a84172f tempest-AggregatesAdminTestJSON-1841140741 tempest-AggregatesAdminTestJSON-1841140741-project-admin] Generated uuid c7f56fcf-183b-41a1-b0d0-1e66de5bf6ca for aggregate {{(pid=122633) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 10 22:56:19.111004 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-99754e1d-b94a-402f-a426-c13f0a84172f tempest-AggregatesAdminTestJSON-1841140741 tempest-AggregatesAdminTestJSON-1841140741-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.039868 Aug 10 22:56:19.111004 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 127/255] 10.222.0.58 () {60 vars in 1164 bytes} [Wed Aug 10 22:56:19 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:56:19.138730 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-67466ae3-f3f4-47d5-913c-e1348acb3192 tempest-AggregatesAdminTestJSON-1841140741 tempest-AggregatesAdminTestJSON-1841140741-project-admin] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:19.139662 n-d-850468-14 devstack@n-api.service[122633]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:56:19.139662 n-d-850468-14 devstack@n-api.service[122633]: warnings.warn(msg) Aug 10 22:56:19.159454 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-67466ae3-f3f4-47d5-913c-e1348acb3192 tempest-AggregatesAdminTestJSON-1841140741 tempest-AggregatesAdminTestJSON-1841140741-project-admin] 10.222.0.58 "GET /compute/v2.1/os-aggregates/8" status: 200 len: 227 microversion: 2.1 time: 0.029753 Aug 10 22:56:19.160427 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 128/256] 10.222.0.58 () {58 vars in 1149 bytes} [Wed Aug 10 22:56:19 2022] GET /compute/v2.1/os-aggregates/8 => generated 227 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:56:19.950758 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-4ad24775-489a-4c13-aca1-54c30ceff03b tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Flavor limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 22:56:19.951827 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-4ad24775-489a-4c13-aca1-54c30ceff03b tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Image limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 22:56:19.952995 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-4ad24775-489a-4c13-aca1-54c30ceff03b tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Flavor pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 22:56:19.953861 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-4ad24775-489a-4c13-aca1-54c30ceff03b tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Image pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 22:56:19.955049 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-4ad24775-489a-4c13-aca1-54c30ceff03b tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 22:56:19.968860 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4ad24775-489a-4c13-aca1-54c30ceff03b tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:19.969656 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4ad24775-489a-4c13-aca1-54c30ceff03b tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:19.970413 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4ad24775-489a-4c13-aca1-54c30ceff03b tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:19.971485 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4ad24775-489a-4c13-aca1-54c30ceff03b tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:19.972180 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4ad24775-489a-4c13-aca1-54c30ceff03b tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:19.973832 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4ad24775-489a-4c13-aca1-54c30ceff03b tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:19.979708 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-eb18f4d8-2671-4c7f-a78b-39f3215df30a tempest-QuotasAdminNegativeTest-1725509051 tempest-QuotasAdminNegativeTest-1725509051-project-admin] Calling method '.version_select at 0x7f847fcb6820>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:20.000298 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-4ad24775-489a-4c13-aca1-54c30ceff03b tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Getting quotas for project 434532ba922f406d8d8c197d3a57ffc2. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 22:56:20.006995 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-4ad24775-489a-4c13-aca1-54c30ceff03b tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Getting quotas for user 64648d3c6f5c423e83ff023e7bf6550a and project 434532ba922f406d8d8c197d3a57ffc2. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 22:56:20.038674 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-4ad24775-489a-4c13-aca1-54c30ceff03b tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Going to run 1 instances... {{(pid=122632) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 22:56:20.041873 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-4ad24775-489a-4c13-aca1-54c30ceff03b tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] [instance: e1648ffb-5a43-4e48-940e-6fcff8db87e5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78ad8905-f66f-4733-8be9-2b260f1fabed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122632) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 22:56:20.125377 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-4ad24775-489a-4c13-aca1-54c30ceff03b tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.289201 Aug 10 22:56:20.126586 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 129/257] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 22:56:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 1293 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 22:56:20.655211 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-a590254c-8346-4cb9-b483-47a6b45e6f5d tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-653301424", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:56:20.746716 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.network.neutron [None req-a590254c-8346-4cb9-b483-47a6b45e6f5d tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] validate_networks() for None {{(pid=122632) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 22:56:20.854479 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-eb18f4d8-2671-4c7f-a78b-39f3215df30a tempest-QuotasAdminNegativeTest-1725509051 tempest-QuotasAdminNegativeTest-1725509051-project-admin] 10.222.0.58 "GET /compute/v2.1/os-quota-sets/70cf9c3d3f9d45ce9f7cdee1ff8f4061" status: 200 len: 371 microversion: 2.1 time: 1.693124 Aug 10 22:56:20.863976 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 129/258] 10.222.0.58 () {58 vars in 1242 bytes} [Wed Aug 10 22:56:19 2022] GET /compute/v2.1/os-quota-sets/70cf9c3d3f9d45ce9f7cdee1ff8f4061 => generated 371 bytes in 1703 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:56:20.873047 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-e57f683b-2f1f-4ec9-ab44-2beedbd6e0b8 tempest-AggregatesAdminTestJSON-1841140741 tempest-AggregatesAdminTestJSON-1841140741-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:56:20.877809 n-d-850468-14 devstack@n-api.service[122633]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:56:20.877809 n-d-850468-14 devstack@n-api.service[122633]: warnings.warn(msg) Aug 10 22:56:20.920998 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-e57f683b-2f1f-4ec9-ab44-2beedbd6e0b8 tempest-AggregatesAdminTestJSON-1841140741 tempest-AggregatesAdminTestJSON-1841140741-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates/8/action" status: 200 len: 265 microversion: 2.1 time: 0.052611 Aug 10 22:56:20.922902 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 130/259] 10.222.0.58 () {60 vars in 1191 bytes} [Wed Aug 10 22:56:20 2022] POST /compute/v2.1/os-aggregates/8/action => generated 265 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:56:20.930409 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-bf497ddc-a64a-4d2f-b29a-eac0851332e2 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:20.931150 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-bf497ddc-a64a-4d2f-b29a-eac0851332e2 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] [instance: ef725aca-9cd8-49a0-81cd-d23710041306] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:56:20.939434 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bf497ddc-a64a-4d2f-b29a-eac0851332e2 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:20.940316 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bf497ddc-a64a-4d2f-b29a-eac0851332e2 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:20.941043 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bf497ddc-a64a-4d2f-b29a-eac0851332e2 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:20.942907 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bf497ddc-a64a-4d2f-b29a-eac0851332e2 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:20.944279 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bf497ddc-a64a-4d2f-b29a-eac0851332e2 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:20.944855 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bf497ddc-a64a-4d2f-b29a-eac0851332e2 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:21.169079 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-bf497ddc-a64a-4d2f-b29a-eac0851332e2 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaed2a2e56f749a88c340aaccb15d2d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deaba512051743deb45881d76eb206ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:21.179152 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-bf497ddc-a64a-4d2f-b29a-eac0851332e2 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] 10.222.0.58 "GET /compute/v2.1/servers/ef725aca-9cd8-49a0-81cd-d23710041306" status: 200 len: 1390 microversion: 2.1 time: 0.254303 Aug 10 22:56:21.181305 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 131/260] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:56:20 2022] GET /compute/v2.1/servers/ef725aca-9cd8-49a0-81cd-d23710041306 => generated 1390 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:56:21.187721 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-39f038c2-7d05-4a67-81fe-5c96c630365c req-09718aef-80d5-4bb9-9e73-d1b200b71e70 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef725aca-9cd8-49a0-81cd-d23710041306", "tag": "eb7cb764-99eb-4a20-9e31-45d5acb040e2"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:56:21.201450 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-39f038c2-7d05-4a67-81fe-5c96c630365c req-09718aef-80d5-4bb9-9e73-d1b200b71e70 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:21.202456 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-39f038c2-7d05-4a67-81fe-5c96c630365c req-09718aef-80d5-4bb9-9e73-d1b200b71e70 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:21.203312 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-39f038c2-7d05-4a67-81fe-5c96c630365c req-09718aef-80d5-4bb9-9e73-d1b200b71e70 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:21.218953 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-39f038c2-7d05-4a67-81fe-5c96c630365c req-09718aef-80d5-4bb9-9e73-d1b200b71e70 service nova] Creating event network-changed:eb7cb764-99eb-4a20-9e31-45d5acb040e2 for instance ef725aca-9cd8-49a0-81cd-d23710041306 on n-h1-850468-14 Aug 10 22:56:21.226263 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-39f038c2-7d05-4a67-81fe-5c96c630365c req-09718aef-80d5-4bb9-9e73-d1b200b71e70 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043046 Aug 10 22:56:21.227698 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 132/261] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 22:56:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:56:21.235325 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-ff5c0157-399d-41f4-be45-89e82fc1c5b1 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:21.236646 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-ff5c0157-399d-41f4-be45-89e82fc1c5b1 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] [instance: e1648ffb-5a43-4e48-940e-6fcff8db87e5] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:56:21.244569 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ff5c0157-399d-41f4-be45-89e82fc1c5b1 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:21.245350 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ff5c0157-399d-41f4-be45-89e82fc1c5b1 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:21.246109 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ff5c0157-399d-41f4-be45-89e82fc1c5b1 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:21.248489 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ff5c0157-399d-41f4-be45-89e82fc1c5b1 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:21.249471 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ff5c0157-399d-41f4-be45-89e82fc1c5b1 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:21.250270 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ff5c0157-399d-41f4-be45-89e82fc1c5b1 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:21.348113 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-a590254c-8346-4cb9-b483-47a6b45e6f5d tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Flavor limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 22:56:21.348642 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-a590254c-8346-4cb9-b483-47a6b45e6f5d tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Image limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 22:56:21.348991 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-a590254c-8346-4cb9-b483-47a6b45e6f5d tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Flavor pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 22:56:21.349419 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-a590254c-8346-4cb9-b483-47a6b45e6f5d tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Image pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 22:56:21.350154 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-a590254c-8346-4cb9-b483-47a6b45e6f5d tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 22:56:21.366047 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a590254c-8346-4cb9-b483-47a6b45e6f5d tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:21.366556 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a590254c-8346-4cb9-b483-47a6b45e6f5d tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:21.367026 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a590254c-8346-4cb9-b483-47a6b45e6f5d tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:21.367766 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a590254c-8346-4cb9-b483-47a6b45e6f5d tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:21.370718 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a590254c-8346-4cb9-b483-47a6b45e6f5d tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:21.372865 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a590254c-8346-4cb9-b483-47a6b45e6f5d tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:21.379819 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-ff5c0157-399d-41f4-be45-89e82fc1c5b1 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64648d3c6f5c423e83ff023e7bf6550a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434532ba922f406d8d8c197d3a57ffc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:21.392592 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-ff5c0157-399d-41f4-be45-89e82fc1c5b1 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] 10.222.0.58 "GET /compute/v2.1/servers/e1648ffb-5a43-4e48-940e-6fcff8db87e5" status: 200 len: 1216 microversion: 2.1 time: 0.162977 Aug 10 22:56:21.393712 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 133/262] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:56:21 2022] GET /compute/v2.1/servers/e1648ffb-5a43-4e48-940e-6fcff8db87e5 => generated 1216 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:56:21.400177 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-102fc294-20a6-4f85-a977-2c4721e673a4 tempest-QuotasAdminNegativeTest-1725509051 tempest-QuotasAdminNegativeTest-1725509051-project-admin] Action: 'update', calling method: .version_select at 0x7f847dd68d30>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:56:21.426947 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-a590254c-8346-4cb9-b483-47a6b45e6f5d tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Getting quotas for project f9582683a1cf4e92b3bd3f10db0b497b. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 22:56:21.441162 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-a590254c-8346-4cb9-b483-47a6b45e6f5d tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Getting quotas for user 5c48fd7279544b1fae228500f5a1e46d and project f9582683a1cf4e92b3bd3f10db0b497b. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 22:56:21.464230 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-a590254c-8346-4cb9-b483-47a6b45e6f5d tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Going to run 1 instances... {{(pid=122632) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 22:56:21.472641 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-a590254c-8346-4cb9-b483-47a6b45e6f5d tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 9acba217-4a32-4650-a43e-9d998061323c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78ad8905-f66f-4733-8be9-2b260f1fabed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122632) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 22:56:21.544331 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-a590254c-8346-4cb9-b483-47a6b45e6f5d tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.414595 Aug 10 22:56:21.546118 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 130/263] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 22:56:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 1418 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 22:56:21.551842 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-f463a2e6-6c28-4923-8c99-32f369278539 tempest-AggregatesAdminTestJSON-1841140741 tempest-AggregatesAdminTestJSON-1841140741-project-admin] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:21.553297 n-d-850468-14 devstack@n-api.service[122632]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:56:21.553297 n-d-850468-14 devstack@n-api.service[122632]: warnings.warn(msg) Aug 10 22:56:21.585861 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-f463a2e6-6c28-4923-8c99-32f369278539 tempest-AggregatesAdminTestJSON-1841140741 tempest-AggregatesAdminTestJSON-1841140741-project-admin] 10.222.0.58 "GET /compute/v2.1/os-aggregates/8" status: 200 len: 241 microversion: 2.1 time: 0.036500 Aug 10 22:56:21.587987 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 131/264] 10.222.0.58 () {58 vars in 1149 bytes} [Wed Aug 10 22:56:21 2022] GET /compute/v2.1/os-aggregates/8 => generated 241 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:56:21.600794 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-1f0cd158-de4d-4ba6-ba32-8e8897ce62ff tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:21.601947 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-1f0cd158-de4d-4ba6-ba32-8e8897ce62ff tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 9acba217-4a32-4650-a43e-9d998061323c] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:56:21.688207 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-1f0cd158-de4d-4ba6-ba32-8e8897ce62ff tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:21.695325 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-1f0cd158-de4d-4ba6-ba32-8e8897ce62ff tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/9acba217-4a32-4650-a43e-9d998061323c" status: 200 len: 1212 microversion: 2.1 time: 0.104049 Aug 10 22:56:21.701065 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 132/265] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:56:21 2022] GET /compute/v2.1/servers/9acba217-4a32-4650-a43e-9d998061323c => generated 1212 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:56:21.712383 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-e2d9946e-a9e8-4bcb-9c21-3a46a27c468f tempest-AggregatesAdminTestJSON-1841140741 tempest-AggregatesAdminTestJSON-1841140741-project-admin] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:21.713592 n-d-850468-14 devstack@n-api.service[122632]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:56:21.713592 n-d-850468-14 devstack@n-api.service[122632]: warnings.warn(msg) Aug 10 22:56:21.750607 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=10,nova_api:DELETE=6 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:56:21.787617 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-e2d9946e-a9e8-4bcb-9c21-3a46a27c468f tempest-AggregatesAdminTestJSON-1841140741 tempest-AggregatesAdminTestJSON-1841140741-project-admin] 10.222.0.58 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.083548 Aug 10 22:56:21.788645 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 133/266] 10.222.0.58 () {58 vars in 1152 bytes} [Wed Aug 10 22:56:21 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 10 22:56:21.802110 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-07aad0a8-ff36-4b9e-a5f9-f814259f271a tempest-AggregatesAdminTestJSON-1841140741 tempest-AggregatesAdminTestJSON-1841140741-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1112664527", "availability_zone": "tempest-test_az-2116496326"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:56:21.813410 n-d-850468-14 devstack@n-api.service[122632]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:56:21.813410 n-d-850468-14 devstack@n-api.service[122632]: warnings.warn(msg) Aug 10 22:56:21.814471 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.objects.aggregate [None req-07aad0a8-ff36-4b9e-a5f9-f814259f271a tempest-AggregatesAdminTestJSON-1841140741 tempest-AggregatesAdminTestJSON-1841140741-project-admin] Generated uuid 3811a1b7-1917-4bb7-b1ba-896e5db9d31d for aggregate {{(pid=122632) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 10 22:56:21.861582 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-07aad0a8-ff36-4b9e-a5f9-f814259f271a tempest-AggregatesAdminTestJSON-1841140741 tempest-AggregatesAdminTestJSON-1841140741-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.065485 Aug 10 22:56:21.875357 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 134/267] 10.222.0.58 () {60 vars in 1165 bytes} [Wed Aug 10 22:56:21 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:56:21.883117 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-b4691a27-5f7f-4dd1-b988-c55c24348995 tempest-AggregatesAdminTestJSON-1841140741 tempest-AggregatesAdminTestJSON-1841140741-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1112664527_new", "availability_zone": "tempest-test_az-2116496326_new"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:56:21.980736 n-d-850468-14 devstack@n-api.service[122632]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:56:21.980736 n-d-850468-14 devstack@n-api.service[122632]: warnings.warn(msg) Aug 10 22:56:22.029508 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b4691a27-5f7f-4dd1-b988-c55c24348995 tempest-AggregatesAdminTestJSON-1841140741 tempest-AggregatesAdminTestJSON-1841140741-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:22.030286 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b4691a27-5f7f-4dd1-b988-c55c24348995 tempest-AggregatesAdminTestJSON-1841140741 tempest-AggregatesAdminTestJSON-1841140741-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:22.030913 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b4691a27-5f7f-4dd1-b988-c55c24348995 tempest-AggregatesAdminTestJSON-1841140741 tempest-AggregatesAdminTestJSON-1841140741-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:22.088323 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-b4691a27-5f7f-4dd1-b988-c55c24348995 tempest-AggregatesAdminTestJSON-1841140741 tempest-AggregatesAdminTestJSON-1841140741-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-aggregates/9" status: 200 len: 336 microversion: 2.1 time: 0.211594 Aug 10 22:56:22.094872 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 135/268] 10.222.0.58 () {60 vars in 1170 bytes} [Wed Aug 10 22:56:21 2022] PUT /compute/v2.1/os-aggregates/9 => generated 336 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:56:22.107982 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-975f84fb-8af4-4d8c-9d8b-6856c99dc3ac tempest-AggregatesAdminTestJSON-1841140741 tempest-AggregatesAdminTestJSON-1841140741-project-admin] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:22.109210 n-d-850468-14 devstack@n-api.service[122632]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:56:22.109210 n-d-850468-14 devstack@n-api.service[122632]: warnings.warn(msg) Aug 10 22:56:22.119648 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-975f84fb-8af4-4d8c-9d8b-6856c99dc3ac tempest-AggregatesAdminTestJSON-1841140741 tempest-AggregatesAdminTestJSON-1841140741-project-admin] 10.222.0.58 "GET /compute/v2.1/os-aggregates" status: 200 len: 339 microversion: 2.1 time: 0.021209 Aug 10 22:56:22.120485 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 136/269] 10.222.0.58 () {58 vars in 1143 bytes} [Wed Aug 10 22:56:22 2022] GET /compute/v2.1/os-aggregates => generated 339 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:56:22.133216 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-706a4b84-657b-4b68-92cc-747482bb1c42 tempest-AggregatesAdminTestJSON-1841140741 tempest-AggregatesAdminTestJSON-1841140741-project-admin] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:22.134431 n-d-850468-14 devstack@n-api.service[122632]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:56:22.134431 n-d-850468-14 devstack@n-api.service[122632]: warnings.warn(msg) Aug 10 22:56:22.177630 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-706a4b84-657b-4b68-92cc-747482bb1c42 tempest-AggregatesAdminTestJSON-1841140741 tempest-AggregatesAdminTestJSON-1841140741-project-admin] 10.222.0.58 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.048573 Aug 10 22:56:22.183823 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 137/270] 10.222.0.58 () {58 vars in 1152 bytes} [Wed Aug 10 22:56:22 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 10 22:56:22.194973 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-670dba36-b25f-4261-bbd9-069591aadda2 tempest-AggregatesAdminTestJSON-1841140741 tempest-AggregatesAdminTestJSON-1841140741-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-450258263"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:56:22.206478 n-d-850468-14 devstack@n-api.service[122632]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:56:22.206478 n-d-850468-14 devstack@n-api.service[122632]: warnings.warn(msg) Aug 10 22:56:22.209900 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.objects.aggregate [None req-670dba36-b25f-4261-bbd9-069591aadda2 tempest-AggregatesAdminTestJSON-1841140741 tempest-AggregatesAdminTestJSON-1841140741-project-admin] Generated uuid 8b61f523-b65c-434f-a9c8-105f752acc9d for aggregate {{(pid=122632) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 10 22:56:22.319235 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-670dba36-b25f-4261-bbd9-069591aadda2 tempest-AggregatesAdminTestJSON-1841140741 tempest-AggregatesAdminTestJSON-1841140741-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.130838 Aug 10 22:56:22.328528 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 138/271] 10.222.0.58 () {60 vars in 1164 bytes} [Wed Aug 10 22:56:22 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:56:22.354869 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-ac0cb65c-1cb4-4055-99eb-d287f7fd3c73 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:22.358621 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-ac0cb65c-1cb4-4055-99eb-d287f7fd3c73 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] [instance: ef725aca-9cd8-49a0-81cd-d23710041306] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:56:22.373110 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ac0cb65c-1cb4-4055-99eb-d287f7fd3c73 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:22.375893 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ac0cb65c-1cb4-4055-99eb-d287f7fd3c73 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:22.380533 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ac0cb65c-1cb4-4055-99eb-d287f7fd3c73 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:22.383310 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ac0cb65c-1cb4-4055-99eb-d287f7fd3c73 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:22.385872 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ac0cb65c-1cb4-4055-99eb-d287f7fd3c73 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:22.389248 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ac0cb65c-1cb4-4055-99eb-d287f7fd3c73 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:22.496830 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-102fc294-20a6-4f85-a977-2c4721e673a4 tempest-QuotasAdminNegativeTest-1725509051 tempest-QuotasAdminNegativeTest-1725509051-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:22.498229 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-102fc294-20a6-4f85-a977-2c4721e673a4 tempest-QuotasAdminNegativeTest-1725509051 tempest-QuotasAdminNegativeTest-1725509051-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:22.502965 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-102fc294-20a6-4f85-a977-2c4721e673a4 tempest-QuotasAdminNegativeTest-1725509051 tempest-QuotasAdminNegativeTest-1725509051-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:22.505232 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-102fc294-20a6-4f85-a977-2c4721e673a4 tempest-QuotasAdminNegativeTest-1725509051 tempest-QuotasAdminNegativeTest-1725509051-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:22.510483 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-102fc294-20a6-4f85-a977-2c4721e673a4 tempest-QuotasAdminNegativeTest-1725509051 tempest-QuotasAdminNegativeTest-1725509051-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:22.514953 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-102fc294-20a6-4f85-a977-2c4721e673a4 tempest-QuotasAdminNegativeTest-1725509051 tempest-QuotasAdminNegativeTest-1725509051-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:22.636303 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-102fc294-20a6-4f85-a977-2c4721e673a4 tempest-QuotasAdminNegativeTest-1725509051 tempest-QuotasAdminNegativeTest-1725509051-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-quota-sets/70cf9c3d3f9d45ce9f7cdee1ff8f4061" status: 200 len: 328 microversion: 2.1 time: 1.241085 Aug 10 22:56:22.637824 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 134/272] 10.222.0.58 () {60 vars in 1262 bytes} [Wed Aug 10 22:56:21 2022] PUT /compute/v2.1/os-quota-sets/70cf9c3d3f9d45ce9f7cdee1ff8f4061 => generated 328 bytes in 1243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:56:22.644499 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-df9b7578-c396-46e3-807b-f91f554a2325 tempest-AggregatesAdminTestJSON-1841140741 tempest-AggregatesAdminTestJSON-1841140741-project-admin] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:22.646543 n-d-850468-14 devstack@n-api.service[122633]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:56:22.646543 n-d-850468-14 devstack@n-api.service[122633]: warnings.warn(msg) Aug 10 22:56:22.673642 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-df9b7578-c396-46e3-807b-f91f554a2325 tempest-AggregatesAdminTestJSON-1841140741 tempest-AggregatesAdminTestJSON-1841140741-project-admin] 10.222.0.58 "GET /compute/v2.1/os-aggregates" status: 200 len: 230 microversion: 2.1 time: 0.026696 Aug 10 22:56:22.674582 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 135/273] 10.222.0.58 () {58 vars in 1143 bytes} [Wed Aug 10 22:56:22 2022] GET /compute/v2.1/os-aggregates => generated 230 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:56:22.702929 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-738808f5-a9d0-4eaf-8f03-8a9e9745233e tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:22.703761 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-738808f5-a9d0-4eaf-8f03-8a9e9745233e tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] [instance: e1648ffb-5a43-4e48-940e-6fcff8db87e5] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:56:22.723786 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-738808f5-a9d0-4eaf-8f03-8a9e9745233e tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:22.724760 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-738808f5-a9d0-4eaf-8f03-8a9e9745233e tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:22.725465 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-738808f5-a9d0-4eaf-8f03-8a9e9745233e tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:22.726345 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-738808f5-a9d0-4eaf-8f03-8a9e9745233e tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:22.727377 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-738808f5-a9d0-4eaf-8f03-8a9e9745233e tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:22.727999 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-738808f5-a9d0-4eaf-8f03-8a9e9745233e tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:22.890570 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-738808f5-a9d0-4eaf-8f03-8a9e9745233e tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64648d3c6f5c423e83ff023e7bf6550a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434532ba922f406d8d8c197d3a57ffc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:22.911463 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-738808f5-a9d0-4eaf-8f03-8a9e9745233e tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] 10.222.0.58 "GET /compute/v2.1/servers/e1648ffb-5a43-4e48-940e-6fcff8db87e5" status: 200 len: 1278 microversion: 2.1 time: 0.234440 Aug 10 22:56:22.912268 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 136/274] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:56:22 2022] GET /compute/v2.1/servers/e1648ffb-5a43-4e48-940e-6fcff8db87e5 => generated 1278 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:56:22.917834 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-6fcf58ab-c954-49d7-95bb-21a9338404d9 tempest-AggregatesAdminTestJSON-1841140741 tempest-AggregatesAdminTestJSON-1841140741-project-admin] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:22.919631 n-d-850468-14 devstack@n-api.service[122633]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:56:22.919631 n-d-850468-14 devstack@n-api.service[122633]: warnings.warn(msg) Aug 10 22:56:22.976230 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-6fcf58ab-c954-49d7-95bb-21a9338404d9 tempest-AggregatesAdminTestJSON-1841140741 tempest-AggregatesAdminTestJSON-1841140741-project-admin] 10.222.0.58 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.062214 Aug 10 22:56:22.977125 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 137/275] 10.222.0.58 () {58 vars in 1155 bytes} [Wed Aug 10 22:56:22 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 10 22:56:22.989259 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-1c30428a-56f1-46f8-9a85-08b2d97d05e2 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:22.990159 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-1c30428a-56f1-46f8-9a85-08b2d97d05e2 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 9acba217-4a32-4650-a43e-9d998061323c] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:56:23.006595 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1c30428a-56f1-46f8-9a85-08b2d97d05e2 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:23.007999 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1c30428a-56f1-46f8-9a85-08b2d97d05e2 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:23.011285 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1c30428a-56f1-46f8-9a85-08b2d97d05e2 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:23.017750 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1c30428a-56f1-46f8-9a85-08b2d97d05e2 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:23.018443 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1c30428a-56f1-46f8-9a85-08b2d97d05e2 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:23.022261 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1c30428a-56f1-46f8-9a85-08b2d97d05e2 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:23.101353 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-ac0cb65c-1cb4-4055-99eb-d287f7fd3c73 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaed2a2e56f749a88c340aaccb15d2d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deaba512051743deb45881d76eb206ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:23.117719 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-ac0cb65c-1cb4-4055-99eb-d287f7fd3c73 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] 10.222.0.58 "GET /compute/v2.1/servers/ef725aca-9cd8-49a0-81cd-d23710041306" status: 200 len: 1390 microversion: 2.1 time: 0.784598 Aug 10 22:56:23.120012 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 139/276] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:56:22 2022] GET /compute/v2.1/servers/ef725aca-9cd8-49a0-81cd-d23710041306 => generated 1390 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:56:23.294034 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-1c30428a-56f1-46f8-9a85-08b2d97d05e2 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:23.308237 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-1c30428a-56f1-46f8-9a85-08b2d97d05e2 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/9acba217-4a32-4650-a43e-9d998061323c" status: 200 len: 1216 microversion: 2.1 time: 0.327774 Aug 10 22:56:23.309304 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 138/277] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:56:22 2022] GET /compute/v2.1/servers/9acba217-4a32-4650-a43e-9d998061323c => generated 1216 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:56:23.324249 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-f0a21966-6655-47ac-a812-4de78e46fbf1 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:23.328576 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-f0a21966-6655-47ac-a812-4de78e46fbf1 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] [instance: 155e0037-0bdb-4a93-af44-de6903bc2891] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:56:23.348947 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f0a21966-6655-47ac-a812-4de78e46fbf1 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:23.350027 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f0a21966-6655-47ac-a812-4de78e46fbf1 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:23.350673 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f0a21966-6655-47ac-a812-4de78e46fbf1 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:23.352108 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f0a21966-6655-47ac-a812-4de78e46fbf1 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:23.352770 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f0a21966-6655-47ac-a812-4de78e46fbf1 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:23.354896 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f0a21966-6655-47ac-a812-4de78e46fbf1 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:23.376881 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-f0a21966-6655-47ac-a812-4de78e46fbf1 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] HTTP exception thrown: Instance 155e0037-0bdb-4a93-af44-de6903bc2891 could not be found. Aug 10 22:56:23.379865 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-f0a21966-6655-47ac-a812-4de78e46fbf1 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Request method failure captured: Aug 10 22:56:23.379865 n-d-850468-14 devstack@n-api.service[122633]: request: DELETE /compute/v2.1/servers/155e0037-0bdb-4a93-af44-de6903bc2891 HTTP/1.1 Aug 10 22:56:23.379865 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 22:56:23.379865 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 22:56:23.379865 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 22:56:23.379865 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 22:56:23.379865 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 22:56:23.379865 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 22:56:23.379865 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 22:56:23.379865 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 22:56:23.379865 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9DddKgov0XD1fS0tp0Ul1mjN_zTuUOC2SxwrUNcPhwPNxxHQNT41AEzpH9ZhsJiU__QZMsOY9V3rG3TxdneUTP8TO4aPUC8kkdS2qBw4iqbruolmAdVp0DQbmHmD51udz-Urx7Ssvy0gl2mmkEHSXdQsFuWxPCC0JKQpS8961PCH3_c Aug 10 22:56:23.379865 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 22:56:23.379865 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 22:56:23.379865 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 22:56:23.379865 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 22:56:23.379865 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 22:56:23.379865 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 22:56:23.379865 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: a9a37b95a10245b796d26c1b35036827 Aug 10 22:56:23.379865 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-AggregatesAdminTestJSON-108305639 Aug 10 22:56:23.379865 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 22:56:23.379865 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 22:56:23.381141 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a9a37b95a10245b796d26c1b35036827"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a9a37b95a10245b796d26c1b35036827"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a9a37b95a10245b796d26c1b35036827"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a9a37b95a10245b796d26c1b35036827", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 22:56:23.381141 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-AggregatesAdminTestJSON-108305639 Aug 10 22:56:23.381141 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: a9a37b95a10245b796d26c1b35036827 Aug 10 22:56:23.381141 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-108305639 Aug 10 22:56:23.381141 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-AggregatesAdminTestJSON-108305639-project Aug 10 22:56:23.381141 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 22:56:23.381141 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 22:56:23.381141 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: cfd644627ab14e55803c1d5981b9859a Aug 10 22:56:23.381141 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-AggregatesAdminTestJSON-108305639-project Aug 10 22:56:23.381141 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 22:56:23.381141 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance 155e0037-0bdb-4a93-af44-de6903bc2891 could not be found. Aug 10 22:56:23.381141 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': '155e0037-0bdb-4a93-af44-de6903bc2891'} Aug 10 22:56:23.381849 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 22:56:23.381849 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:56:23.381849 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 22:56:23.381849 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 22:56:23.381849 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 22:56:23.381849 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 22:56:23.381849 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 22:56:23.381849 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 22:56:23.381849 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 22:56:23.381849 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 22:56:23.381849 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 155e0037-0bdb-4a93-af44-de6903bc2891 could not be found. Aug 10 22:56:23.381849 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:56:23.381849 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:56:23.381849 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:56:23.381849 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:56:23.381849 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:56:23.381849 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:56:23.381849 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 22:56:23.381849 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 22:56:23.381849 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 22:56:23.383009 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 22:56:23.383009 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 22:56:23.383009 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 22:56:23.383009 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 22:56:23.383009 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 22:56:23.383009 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 22:56:23.383009 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 22:56:23.383009 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 22:56:23.383009 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 22:56:23.383009 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 155e0037-0bdb-4a93-af44-de6903bc2891 could not be found. Aug 10 22:56:23.383009 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:56:23.383009 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:56:23.383009 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:56:23.383009 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:56:23.383009 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:56:23.383009 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:56:23.383009 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 22:56:23.383009 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 22:56:23.383009 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 155e0037-0bdb-4a93-af44-de6903bc2891 could not be found. Aug 10 22:56:23.383009 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:56:23.387912 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-f0a21966-6655-47ac-a812-4de78e46fbf1 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Returning 404 to user: Instance 155e0037-0bdb-4a93-af44-de6903bc2891 could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 22:56:23.391792 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-f0a21966-6655-47ac-a812-4de78e46fbf1 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] 10.222.0.58 "DELETE /compute/v2.1/servers/155e0037-0bdb-4a93-af44-de6903bc2891" status: 404 len: 111 microversion: 2.1 time: 0.081906 Aug 10 22:56:23.392673 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 139/278] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 22:56:23 2022] DELETE /compute/v2.1/servers/155e0037-0bdb-4a93-af44-de6903bc2891 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 22:56:23.410003 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-49a53b25-92cc-45cb-9477-22069ced3cb3 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:23.417396 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-49a53b25-92cc-45cb-9477-22069ced3cb3 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] [instance: 155e0037-0bdb-4a93-af44-de6903bc2891] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:56:23.435246 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-49a53b25-92cc-45cb-9477-22069ced3cb3 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:23.436009 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-49a53b25-92cc-45cb-9477-22069ced3cb3 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:23.446979 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-49a53b25-92cc-45cb-9477-22069ced3cb3 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:23.448262 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-49a53b25-92cc-45cb-9477-22069ced3cb3 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:23.449186 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-49a53b25-92cc-45cb-9477-22069ced3cb3 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:23.449834 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-49a53b25-92cc-45cb-9477-22069ced3cb3 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:23.487803 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-49a53b25-92cc-45cb-9477-22069ced3cb3 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] HTTP exception thrown: Instance 155e0037-0bdb-4a93-af44-de6903bc2891 could not be found. Aug 10 22:56:23.489769 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-49a53b25-92cc-45cb-9477-22069ced3cb3 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Request method failure captured: Aug 10 22:56:23.489769 n-d-850468-14 devstack@n-api.service[122633]: request: GET /compute/v2.1/servers/155e0037-0bdb-4a93-af44-de6903bc2891 HTTP/1.1 Aug 10 22:56:23.489769 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 22:56:23.489769 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 22:56:23.489769 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 22:56:23.489769 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 22:56:23.489769 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 22:56:23.489769 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 22:56:23.489769 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 22:56:23.489769 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 22:56:23.489769 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9DddKgov0XD1fS0tp0Ul1mjN_zTuUOC2SxwrUNcPhwPNxxHQNT41AEzpH9ZhsJiU__QZMsOY9V3rG3TxdneUTP8TO4aPUC8kkdS2qBw4iqbruolmAdVp0DQbmHmD51udz-Urx7Ssvy0gl2mmkEHSXdQsFuWxPCC0JKQpS8961PCH3_c Aug 10 22:56:23.489769 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 22:56:23.489769 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 22:56:23.489769 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 22:56:23.489769 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 22:56:23.489769 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 22:56:23.489769 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 22:56:23.489769 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: a9a37b95a10245b796d26c1b35036827 Aug 10 22:56:23.489769 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-AggregatesAdminTestJSON-108305639 Aug 10 22:56:23.489769 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 22:56:23.489769 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 22:56:23.491179 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a9a37b95a10245b796d26c1b35036827"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a9a37b95a10245b796d26c1b35036827"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a9a37b95a10245b796d26c1b35036827"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a9a37b95a10245b796d26c1b35036827", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 22:56:23.491179 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-AggregatesAdminTestJSON-108305639 Aug 10 22:56:23.491179 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: a9a37b95a10245b796d26c1b35036827 Aug 10 22:56:23.491179 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-108305639 Aug 10 22:56:23.491179 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-AggregatesAdminTestJSON-108305639-project Aug 10 22:56:23.491179 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 22:56:23.491179 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 22:56:23.491179 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: cfd644627ab14e55803c1d5981b9859a Aug 10 22:56:23.491179 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-AggregatesAdminTestJSON-108305639-project Aug 10 22:56:23.491179 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 22:56:23.491179 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance 155e0037-0bdb-4a93-af44-de6903bc2891 could not be found. Aug 10 22:56:23.491179 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': '155e0037-0bdb-4a93-af44-de6903bc2891'} Aug 10 22:56:23.491869 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 22:56:23.491869 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:56:23.491869 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 22:56:23.491869 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 22:56:23.491869 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 22:56:23.491869 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 22:56:23.491869 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 22:56:23.491869 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 22:56:23.491869 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 22:56:23.491869 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 22:56:23.491869 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 155e0037-0bdb-4a93-af44-de6903bc2891 could not be found. Aug 10 22:56:23.491869 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:56:23.491869 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:56:23.491869 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:56:23.491869 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:56:23.491869 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:56:23.491869 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:56:23.491869 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 22:56:23.491869 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 22:56:23.491869 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 22:56:23.493149 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 22:56:23.493149 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 22:56:23.493149 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 22:56:23.493149 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 22:56:23.493149 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 22:56:23.493149 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 22:56:23.493149 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 22:56:23.493149 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 155e0037-0bdb-4a93-af44-de6903bc2891 could not be found. Aug 10 22:56:23.493149 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:56:23.493149 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:56:23.493149 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:56:23.493149 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:56:23.493149 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:56:23.493149 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:56:23.493149 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 22:56:23.493149 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 22:56:23.493149 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 155e0037-0bdb-4a93-af44-de6903bc2891 could not be found. Aug 10 22:56:23.493149 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:56:23.497087 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-49a53b25-92cc-45cb-9477-22069ced3cb3 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] Returning 404 to user: Instance 155e0037-0bdb-4a93-af44-de6903bc2891 could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 22:56:23.499302 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-49a53b25-92cc-45cb-9477-22069ced3cb3 tempest-AggregatesAdminTestJSON-108305639 tempest-AggregatesAdminTestJSON-108305639-project] 10.222.0.58 "GET /compute/v2.1/servers/155e0037-0bdb-4a93-af44-de6903bc2891" status: 404 len: 111 microversion: 2.1 time: 0.099240 Aug 10 22:56:23.500403 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 140/279] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:56:23 2022] GET /compute/v2.1/servers/155e0037-0bdb-4a93-af44-de6903bc2891 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 22:56:23.707305 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-7ac48d5d-3fcb-4cc4-bcdc-3ceec64ff3e2 tempest-QuotasAdminNegativeTest-517482210 tempest-QuotasAdminNegativeTest-517482210-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1710243922", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:56:23.789704 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.network.neutron [None req-7ac48d5d-3fcb-4cc4-bcdc-3ceec64ff3e2 tempest-QuotasAdminNegativeTest-517482210 tempest-QuotasAdminNegativeTest-517482210-project] validate_networks() for None {{(pid=122632) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 22:56:24.172776 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-f2c26e92-cb0b-4361-9f1c-e48b15f97d6d tempest-HypervisorAdminNegativeUnderV252Test-589972649 tempest-HypervisorAdminNegativeUnderV252Test-589972649-project-admin] Calling method '.version_select at 0x7f847daa1a60>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:24.174609 n-d-850468-14 devstack@n-api.service[122633]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:56:24.174609 n-d-850468-14 devstack@n-api.service[122633]: warnings.warn(msg) Aug 10 22:56:24.175794 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f2c26e92-cb0b-4361-9f1c-e48b15f97d6d tempest-HypervisorAdminNegativeUnderV252Test-589972649 tempest-HypervisorAdminNegativeUnderV252Test-589972649-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:24.176446 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f2c26e92-cb0b-4361-9f1c-e48b15f97d6d tempest-HypervisorAdminNegativeUnderV252Test-589972649 tempest-HypervisorAdminNegativeUnderV252Test-589972649-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:24.176711 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f2c26e92-cb0b-4361-9f1c-e48b15f97d6d tempest-HypervisorAdminNegativeUnderV252Test-589972649 tempest-HypervisorAdminNegativeUnderV252Test-589972649-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:24.228759 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f2c26e92-cb0b-4361-9f1c-e48b15f97d6d tempest-HypervisorAdminNegativeUnderV252Test-589972649 tempest-HypervisorAdminNegativeUnderV252Test-589972649-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:24.230066 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f2c26e92-cb0b-4361-9f1c-e48b15f97d6d tempest-HypervisorAdminNegativeUnderV252Test-589972649 tempest-HypervisorAdminNegativeUnderV252Test-589972649-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:24.230756 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f2c26e92-cb0b-4361-9f1c-e48b15f97d6d tempest-HypervisorAdminNegativeUnderV252Test-589972649 tempest-HypervisorAdminNegativeUnderV252Test-589972649-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:24.258529 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f2c26e92-cb0b-4361-9f1c-e48b15f97d6d tempest-HypervisorAdminNegativeUnderV252Test-589972649 tempest-HypervisorAdminNegativeUnderV252Test-589972649-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:24.259411 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f2c26e92-cb0b-4361-9f1c-e48b15f97d6d tempest-HypervisorAdminNegativeUnderV252Test-589972649 tempest-HypervisorAdminNegativeUnderV252Test-589972649-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:24.261723 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f2c26e92-cb0b-4361-9f1c-e48b15f97d6d tempest-HypervisorAdminNegativeUnderV252Test-589972649 tempest-HypervisorAdminNegativeUnderV252Test-589972649-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:24.271422 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-f2c26e92-cb0b-4361-9f1c-e48b15f97d6d tempest-HypervisorAdminNegativeUnderV252Test-589972649 tempest-HypervisorAdminNegativeUnderV252Test-589972649-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.769665 Aug 10 22:56:24.272660 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 141/280] 10.222.0.58 () {58 vars in 1146 bytes} [Wed Aug 10 22:56:23 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:56:24.280524 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-d731ae05-7dbd-4ec0-b14f-b304e6443939 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:24.281750 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-d731ae05-7dbd-4ec0-b14f-b304e6443939 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] [instance: e1648ffb-5a43-4e48-940e-6fcff8db87e5] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:56:24.294002 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d731ae05-7dbd-4ec0-b14f-b304e6443939 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:24.295782 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d731ae05-7dbd-4ec0-b14f-b304e6443939 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:24.296664 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d731ae05-7dbd-4ec0-b14f-b304e6443939 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:24.298711 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d731ae05-7dbd-4ec0-b14f-b304e6443939 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:24.300077 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d731ae05-7dbd-4ec0-b14f-b304e6443939 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:24.300708 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d731ae05-7dbd-4ec0-b14f-b304e6443939 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:24.577865 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-d731ae05-7dbd-4ec0-b14f-b304e6443939 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64648d3c6f5c423e83ff023e7bf6550a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434532ba922f406d8d8c197d3a57ffc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:24.591578 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-d731ae05-7dbd-4ec0-b14f-b304e6443939 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] 10.222.0.58 "GET /compute/v2.1/servers/e1648ffb-5a43-4e48-940e-6fcff8db87e5" status: 200 len: 1320 microversion: 2.1 time: 0.316335 Aug 10 22:56:24.592775 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 142/281] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:56:24 2022] GET /compute/v2.1/servers/e1648ffb-5a43-4e48-940e-6fcff8db87e5 => generated 1320 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:56:24.600509 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-bb162bf2-b2c2-4a70-a4f8-6a7c8250deb2 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:24.601616 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-bb162bf2-b2c2-4a70-a4f8-6a7c8250deb2 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] [instance: ef725aca-9cd8-49a0-81cd-d23710041306] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:56:24.609647 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bb162bf2-b2c2-4a70-a4f8-6a7c8250deb2 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:24.610857 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bb162bf2-b2c2-4a70-a4f8-6a7c8250deb2 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:24.612065 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bb162bf2-b2c2-4a70-a4f8-6a7c8250deb2 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:24.613579 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bb162bf2-b2c2-4a70-a4f8-6a7c8250deb2 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:24.614368 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bb162bf2-b2c2-4a70-a4f8-6a7c8250deb2 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:24.620493 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bb162bf2-b2c2-4a70-a4f8-6a7c8250deb2 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:24.698506 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-7ac48d5d-3fcb-4cc4-bcdc-3ceec64ff3e2 tempest-QuotasAdminNegativeTest-517482210 tempest-QuotasAdminNegativeTest-517482210-project] Flavor limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 22:56:24.699271 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-7ac48d5d-3fcb-4cc4-bcdc-3ceec64ff3e2 tempest-QuotasAdminNegativeTest-517482210 tempest-QuotasAdminNegativeTest-517482210-project] Image limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 22:56:24.700130 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-7ac48d5d-3fcb-4cc4-bcdc-3ceec64ff3e2 tempest-QuotasAdminNegativeTest-517482210 tempest-QuotasAdminNegativeTest-517482210-project] Flavor pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 22:56:24.700997 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-7ac48d5d-3fcb-4cc4-bcdc-3ceec64ff3e2 tempest-QuotasAdminNegativeTest-517482210 tempest-QuotasAdminNegativeTest-517482210-project] Image pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 22:56:24.701740 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-7ac48d5d-3fcb-4cc4-bcdc-3ceec64ff3e2 tempest-QuotasAdminNegativeTest-517482210 tempest-QuotasAdminNegativeTest-517482210-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 22:56:24.736139 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7ac48d5d-3fcb-4cc4-bcdc-3ceec64ff3e2 tempest-QuotasAdminNegativeTest-517482210 tempest-QuotasAdminNegativeTest-517482210-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:24.740719 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7ac48d5d-3fcb-4cc4-bcdc-3ceec64ff3e2 tempest-QuotasAdminNegativeTest-517482210 tempest-QuotasAdminNegativeTest-517482210-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:24.744805 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7ac48d5d-3fcb-4cc4-bcdc-3ceec64ff3e2 tempest-QuotasAdminNegativeTest-517482210 tempest-QuotasAdminNegativeTest-517482210-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:24.746611 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7ac48d5d-3fcb-4cc4-bcdc-3ceec64ff3e2 tempest-QuotasAdminNegativeTest-517482210 tempest-QuotasAdminNegativeTest-517482210-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:24.749026 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7ac48d5d-3fcb-4cc4-bcdc-3ceec64ff3e2 tempest-QuotasAdminNegativeTest-517482210 tempest-QuotasAdminNegativeTest-517482210-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:24.751849 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7ac48d5d-3fcb-4cc4-bcdc-3ceec64ff3e2 tempest-QuotasAdminNegativeTest-517482210 tempest-QuotasAdminNegativeTest-517482210-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:24.826518 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-7ac48d5d-3fcb-4cc4-bcdc-3ceec64ff3e2 tempest-QuotasAdminNegativeTest-517482210 tempest-QuotasAdminNegativeTest-517482210-project] Getting quotas for project 70cf9c3d3f9d45ce9f7cdee1ff8f4061. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 22:56:24.843561 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-7ac48d5d-3fcb-4cc4-bcdc-3ceec64ff3e2 tempest-QuotasAdminNegativeTest-517482210 tempest-QuotasAdminNegativeTest-517482210-project] Getting quotas for user f3db1fe4444a4b6d8fd52820b8cae527 and project 70cf9c3d3f9d45ce9f7cdee1ff8f4061. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 22:56:24.906010 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.utils [None req-7ac48d5d-3fcb-4cc4-bcdc-3ceec64ff3e2 tempest-QuotasAdminNegativeTest-517482210 tempest-QuotasAdminNegativeTest-517482210-project] cores quota exceeded for 70cf9c3d3f9d45ce9f7cdee1ff8f4061, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=122632) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Aug 10 22:56:24.912169 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-7ac48d5d-3fcb-4cc4-bcdc-3ceec64ff3e2 tempest-QuotasAdminNegativeTest-517482210 tempest-QuotasAdminNegativeTest-517482210-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 10 22:56:24.927997 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-7ac48d5d-3fcb-4cc4-bcdc-3ceec64ff3e2 tempest-QuotasAdminNegativeTest-517482210 tempest-QuotasAdminNegativeTest-517482210-project] Request method failure captured: Aug 10 22:56:24.927997 n-d-850468-14 devstack@n-api.service[122632]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 10 22:56:24.927997 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 22:56:24.927997 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 22:56:24.927997 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 22:56:24.927997 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 145 Aug 10 22:56:24.927997 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 22:56:24.927997 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 22:56:24.927997 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 22:56:24.927997 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 22:56:24.927997 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9DeQmJTfvikw7Bg0eUMFOxeHegamNQKW3oLiPyBxXtTXhzKWKgmjCIpIJF9in5wsd8eQhhBPR7h7SR06wYIuNLPWh0WTXgzVeo3LV1N8ON3Q_OgShavIwyBt1CDeW-5sm9RlFNXAb5LFJ80B0rZHeo85YxnPewgrawiln1IAigKK9Fk Aug 10 22:56:24.927997 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 22:56:24.927997 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 22:56:24.927997 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 22:56:24.927997 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 22:56:24.927997 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 22:56:24.927997 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 22:56:24.927997 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 70cf9c3d3f9d45ce9f7cdee1ff8f4061 Aug 10 22:56:24.927997 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-QuotasAdminNegativeTest-517482210 Aug 10 22:56:24.927997 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 22:56:24.927997 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 22:56:24.930811 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/70cf9c3d3f9d45ce9f7cdee1ff8f4061"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/70cf9c3d3f9d45ce9f7cdee1ff8f4061"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/70cf9c3d3f9d45ce9f7cdee1ff8f4061"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_70cf9c3d3f9d45ce9f7cdee1ff8f4061", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 22:56:24.930811 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-QuotasAdminNegativeTest-517482210 Aug 10 22:56:24.930811 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 70cf9c3d3f9d45ce9f7cdee1ff8f4061 Aug 10 22:56:24.930811 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-517482210 Aug 10 22:56:24.930811 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-QuotasAdminNegativeTest-517482210-project Aug 10 22:56:24.930811 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 22:56:24.930811 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 22:56:24.930811 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: f3db1fe4444a4b6d8fd52820b8cae527 Aug 10 22:56:24.930811 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-QuotasAdminNegativeTest-517482210-project Aug 10 22:56:24.930811 n-d-850468-14 devstack@n-api.service[122632]: Aug 10 22:56:24.930811 n-d-850468-14 devstack@n-api.service[122632]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1710243922", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452"}} Aug 10 22:56:24.930811 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 22:56:24.933829 n-d-850468-14 devstack@n-api.service[122632]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 10 22:56:24.933829 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1710243922', 'imageRef': '78ad8905-f66f-4733-8be9-2b260f1fabed', 'flavorRef': '452'}}} Aug 10 22:56:24.933829 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 22:56:24.933829 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:56:24.933829 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Aug 10 22:56:24.933829 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Aug 10 22:56:24.933829 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 10 22:56:24.933829 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 10 22:56:24.933829 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 10 22:56:24.933829 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc Aug 10 22:56:24.933829 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 10 22:56:24.933829 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 10 22:56:24.933829 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 10 22:56:24.933829 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 10 22:56:24.933829 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 10 22:56:24.933829 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 10 22:56:24.933829 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 10 22:56:24.933829 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 10 22:56:24.936763 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Aug 10 22:56:24.936763 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 10 22:56:24.936763 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Aug 10 22:56:24.936763 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:56:24.936763 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:56:24.936763 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:56:24.936763 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:56:24.936763 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 22:56:24.936763 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 22:56:24.936763 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 22:56:24.936763 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 22:56:24.936763 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1678, in _create_instance Aug 10 22:56:24.936763 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Aug 10 22:56:24.936763 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1350, in _provision_instances Aug 10 22:56:24.936763 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Aug 10 22:56:24.936763 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Aug 10 22:56:24.936763 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 10 22:56:24.936763 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 10 22:56:24.936763 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:56:24.936763 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:56:24.936763 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:56:24.939501 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:56:24.939501 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:56:24.939501 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:56:24.939501 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 22:56:24.939501 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 22:56:24.939501 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 22:56:24.939501 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 22:56:24.939501 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 22:56:24.939501 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 22:56:24.939501 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 22:56:24.939501 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 22:56:24.939501 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 22:56:24.939501 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 22:56:24.939501 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 22:56:24.939501 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Aug 10 22:56:24.939501 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 10 22:56:24.939501 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 10 22:56:24.939501 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:56:24.939501 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:56:24.939501 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:56:24.939501 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:56:24.942881 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:56:24.942881 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:56:24.942881 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 22:56:24.942881 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 22:56:24.942881 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 10 22:56:24.942881 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:56:24.950228 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-7ac48d5d-3fcb-4cc4-bcdc-3ceec64ff3e2 tempest-QuotasAdminNegativeTest-517482210 tempest-QuotasAdminNegativeTest-517482210-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 22:56:24.950228 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-7ac48d5d-3fcb-4cc4-bcdc-3ceec64ff3e2 tempest-QuotasAdminNegativeTest-517482210 tempest-QuotasAdminNegativeTest-517482210-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 1.827273 Aug 10 22:56:24.955150 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 140/282] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 22:56:23 2022] POST /compute/v2.1/servers => generated 111 bytes in 1834 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 10 22:56:25.289509 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-bb162bf2-b2c2-4a70-a4f8-6a7c8250deb2 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaed2a2e56f749a88c340aaccb15d2d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deaba512051743deb45881d76eb206ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:25.298364 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-bb162bf2-b2c2-4a70-a4f8-6a7c8250deb2 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] 10.222.0.58 "GET /compute/v2.1/servers/ef725aca-9cd8-49a0-81cd-d23710041306" status: 200 len: 1390 microversion: 2.1 time: 0.704220 Aug 10 22:56:25.303194 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 143/283] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:56:24 2022] GET /compute/v2.1/servers/ef725aca-9cd8-49a0-81cd-d23710041306 => generated 1390 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:56:25.313657 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-aab8ecbf-6bee-483c-90b7-dcce3dce7d79 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:25.319675 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-aab8ecbf-6bee-483c-90b7-dcce3dce7d79 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 9acba217-4a32-4650-a43e-9d998061323c] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:56:25.328585 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-aab8ecbf-6bee-483c-90b7-dcce3dce7d79 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:25.329268 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-aab8ecbf-6bee-483c-90b7-dcce3dce7d79 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:25.330151 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-aab8ecbf-6bee-483c-90b7-dcce3dce7d79 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:25.331047 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-aab8ecbf-6bee-483c-90b7-dcce3dce7d79 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:25.331939 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-aab8ecbf-6bee-483c-90b7-dcce3dce7d79 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:25.332649 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-aab8ecbf-6bee-483c-90b7-dcce3dce7d79 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:25.506467 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-aab8ecbf-6bee-483c-90b7-dcce3dce7d79 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:25.518210 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-aab8ecbf-6bee-483c-90b7-dcce3dce7d79 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/9acba217-4a32-4650-a43e-9d998061323c" status: 200 len: 1270 microversion: 2.1 time: 0.213267 Aug 10 22:56:25.520544 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 144/284] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:56:25 2022] GET /compute/v2.1/servers/9acba217-4a32-4650-a43e-9d998061323c => generated 1270 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:56:25.527937 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-1625e27f-d1a7-4ea0-8373-be64301ba739 tempest-QuotasAdminNegativeTest-1725509051 tempest-QuotasAdminNegativeTest-1725509051-project-admin] Action: 'update', calling method: .version_select at 0x7f847daa13a0>, body: {"quota_set": {"cores": 20}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:56:25.672229 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-1ef1bd51-b5ec-4c00-ae30-04d877d2ae99 tempest-HypervisorAdminNegativeUnderV252Test-1672519323 tempest-HypervisorAdminNegativeUnderV252Test-1672519323-project] Calling method '.version_select at 0x7f847dbb74c0>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:25.675216 n-d-850468-14 devstack@n-api.service[122632]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:56:25.675216 n-d-850468-14 devstack@n-api.service[122632]: warnings.warn(msg) Aug 10 22:56:25.677770 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-1ef1bd51-b5ec-4c00-ae30-04d877d2ae99 tempest-HypervisorAdminNegativeUnderV252Test-1672519323 tempest-HypervisorAdminNegativeUnderV252Test-1672519323-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': '752eca0774a0486eba3bec7e45e625a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0e06ea8454def928529c2e8ea46e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:25.687199 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-1ef1bd51-b5ec-4c00-ae30-04d877d2ae99 tempest-HypervisorAdminNegativeUnderV252Test-1672519323 tempest-HypervisorAdminNegativeUnderV252Test-1672519323-project] Request method failure captured: Aug 10 22:56:25.687199 n-d-850468-14 devstack@n-api.service[122632]: request: GET /compute/v2.1/os-hypervisors/n-h1-850468-14/search HTTP/1.1 Aug 10 22:56:25.687199 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 22:56:25.687199 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 22:56:25.687199 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 22:56:25.687199 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 22:56:25.687199 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 22:56:25.687199 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 22:56:25.687199 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 22:56:25.687199 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 22:56:25.687199 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9DeV1FbeM1n5q446UYtaggZWedYnrlypNDrD10i-BZpB527j3MAXRmo44CcfTNhUdbLzwVtVt1eh5Ne3v3OUErJXDYFo5Ko8DGJIgcfxo2q3bayDZoOl48rUPhKyTT7--gHWh2OO3_Cjf8R_bv655yMT-LmWLoUgn_wuXgbg7ru4IYw Aug 10 22:56:25.687199 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 22:56:25.687199 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 22:56:25.687199 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 22:56:25.687199 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 22:56:25.687199 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 22:56:25.687199 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 22:56:25.687199 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 7af0e06ea8454def928529c2e8ea46e3 Aug 10 22:56:25.687199 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1672519323 Aug 10 22:56:25.687199 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 22:56:25.687199 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 22:56:25.688489 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7af0e06ea8454def928529c2e8ea46e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7af0e06ea8454def928529c2e8ea46e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7af0e06ea8454def928529c2e8ea46e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7af0e06ea8454def928529c2e8ea46e3", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 22:56:25.688489 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1672519323 Aug 10 22:56:25.688489 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 7af0e06ea8454def928529c2e8ea46e3 Aug 10 22:56:25.688489 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1672519323 Aug 10 22:56:25.688489 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1672519323-project Aug 10 22:56:25.688489 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 22:56:25.688489 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 22:56:25.688489 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: 752eca0774a0486eba3bec7e45e625a5 Aug 10 22:56:25.688489 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1672519323-project Aug 10 22:56:25.688489 n-d-850468-14 devstack@n-api.service[122632]: method: Aug 10 22:56:25.688489 n-d-850468-14 devstack@n-api.service[122632]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Aug 10 22:56:25.688489 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': 'n-h1-850468-14'} Aug 10 22:56:25.689176 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 22:56:25.689176 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:56:25.689176 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:56:25.689176 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:56:25.689176 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 22:56:25.689176 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 22:56:25.689176 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 22:56:25.689176 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 22:56:25.689176 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 22:56:25.689176 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 22:56:25.689176 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Aug 10 22:56:25.689176 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Aug 10 22:56:25.689176 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 10 22:56:25.689176 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 10 22:56:25.689176 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 10 22:56:25.689176 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 10 22:56:25.689176 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 10 22:56:25.689176 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 10 22:56:25.689176 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 10 22:56:25.690172 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise self.value Aug 10 22:56:25.690172 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 10 22:56:25.690172 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 10 22:56:25.690172 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 10 22:56:25.690172 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 10 22:56:25.690172 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 10 22:56:25.690172 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 10 22:56:25.690172 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Aug 10 22:56:25.690172 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:56:25.690172 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:56:25.690172 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:56:25.690172 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:56:25.690172 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:56:25.690172 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:56:25.690172 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 10 22:56:25.690172 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 10 22:56:25.690172 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Aug 10 22:56:25.690172 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:56:25.691210 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-1ef1bd51-b5ec-4c00-ae30-04d877d2ae99 tempest-HypervisorAdminNegativeUnderV252Test-1672519323 tempest-HypervisorAdminNegativeUnderV252Test-1672519323-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 22:56:25.691210 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-1ef1bd51-b5ec-4c00-ae30-04d877d2ae99 tempest-HypervisorAdminNegativeUnderV252Test-1672519323 tempest-HypervisorAdminNegativeUnderV252Test-1672519323-project] 10.222.0.58 "GET /compute/v2.1/os-hypervisors/n-h1-850468-14/search" status: 403 len: 117 microversion: 2.1 time: 0.731332 Aug 10 22:56:25.703815 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 141/285] 10.222.0.58 () {58 vars in 1212 bytes} [Wed Aug 10 22:56:24 2022] GET /compute/v2.1/os-hypervisors/n-h1-850468-14/search => generated 117 bytes in 733 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 10 22:56:25.725449 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-a0883e5d-0a5c-4286-9f11-a9ac41e66661 req-cade8853-b361-41ae-a9b6-1435a98cfeab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1648ffb-5a43-4e48-940e-6fcff8db87e5", "tag": "04c15889-79d5-4063-bed9-3d39dc31e7df"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:56:25.758736 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-a0883e5d-0a5c-4286-9f11-a9ac41e66661 req-cade8853-b361-41ae-a9b6-1435a98cfeab service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:25.759930 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-a0883e5d-0a5c-4286-9f11-a9ac41e66661 req-cade8853-b361-41ae-a9b6-1435a98cfeab service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:25.761051 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-a0883e5d-0a5c-4286-9f11-a9ac41e66661 req-cade8853-b361-41ae-a9b6-1435a98cfeab service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:25.776619 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-a0883e5d-0a5c-4286-9f11-a9ac41e66661 req-cade8853-b361-41ae-a9b6-1435a98cfeab service nova] Creating event network-changed:04c15889-79d5-4063-bed9-3d39dc31e7df for instance e1648ffb-5a43-4e48-940e-6fcff8db87e5 on n-h2-850468-14 Aug 10 22:56:25.786068 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-a0883e5d-0a5c-4286-9f11-a9ac41e66661 req-cade8853-b361-41ae-a9b6-1435a98cfeab service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075774 Aug 10 22:56:25.787032 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 142/286] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 22:56:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:56:25.792543 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-d37b3a19-5734-49b7-ae0b-f4226e283ef1 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:25.793529 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-d37b3a19-5734-49b7-ae0b-f4226e283ef1 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] [instance: e1648ffb-5a43-4e48-940e-6fcff8db87e5] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:56:25.802067 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d37b3a19-5734-49b7-ae0b-f4226e283ef1 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:25.803966 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d37b3a19-5734-49b7-ae0b-f4226e283ef1 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:25.804686 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d37b3a19-5734-49b7-ae0b-f4226e283ef1 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:25.807608 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d37b3a19-5734-49b7-ae0b-f4226e283ef1 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:25.809114 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d37b3a19-5734-49b7-ae0b-f4226e283ef1 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:25.813706 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d37b3a19-5734-49b7-ae0b-f4226e283ef1 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:26.229284 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-d37b3a19-5734-49b7-ae0b-f4226e283ef1 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64648d3c6f5c423e83ff023e7bf6550a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434532ba922f406d8d8c197d3a57ffc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:26.246771 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-d37b3a19-5734-49b7-ae0b-f4226e283ef1 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] 10.222.0.58 "GET /compute/v2.1/servers/e1648ffb-5a43-4e48-940e-6fcff8db87e5" status: 200 len: 1320 microversion: 2.1 time: 0.458168 Aug 10 22:56:26.263136 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 143/287] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:56:25 2022] GET /compute/v2.1/servers/e1648ffb-5a43-4e48-940e-6fcff8db87e5 => generated 1320 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:56:26.268213 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-687fb69e-93cd-4036-9042-18f13cfc8658 tempest-HypervisorAdminNegativeUnderV252Test-589972649 tempest-HypervisorAdminNegativeUnderV252Test-589972649-project-admin] Calling method '.version_select at 0x7f847dbc0b80>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:26.269094 n-d-850468-14 devstack@n-api.service[122632]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:56:26.269094 n-d-850468-14 devstack@n-api.service[122632]: warnings.warn(msg) Aug 10 22:56:26.270152 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-687fb69e-93cd-4036-9042-18f13cfc8658 tempest-HypervisorAdminNegativeUnderV252Test-589972649 tempest-HypervisorAdminNegativeUnderV252Test-589972649-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:26.270633 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-687fb69e-93cd-4036-9042-18f13cfc8658 tempest-HypervisorAdminNegativeUnderV252Test-589972649 tempest-HypervisorAdminNegativeUnderV252Test-589972649-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:26.271145 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-687fb69e-93cd-4036-9042-18f13cfc8658 tempest-HypervisorAdminNegativeUnderV252Test-589972649 tempest-HypervisorAdminNegativeUnderV252Test-589972649-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:26.273847 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:56:26.305555 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-687fb69e-93cd-4036-9042-18f13cfc8658 tempest-HypervisorAdminNegativeUnderV252Test-589972649 tempest-HypervisorAdminNegativeUnderV252Test-589972649-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Aug 10 22:56:26.307228 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-687fb69e-93cd-4036-9042-18f13cfc8658 tempest-HypervisorAdminNegativeUnderV252Test-589972649 tempest-HypervisorAdminNegativeUnderV252Test-589972649-project-admin] Request method failure captured: Aug 10 22:56:26.307228 n-d-850468-14 devstack@n-api.service[122632]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Aug 10 22:56:26.307228 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 22:56:26.307228 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 22:56:26.307228 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 22:56:26.307228 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 22:56:26.307228 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 22:56:26.307228 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 22:56:26.307228 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 22:56:26.307228 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 22:56:26.307228 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9DeXmpGHPClIMv33VRgE9UfQeNCn_pduHDpTN8PbVgivCRHncAaE6BuvzrQc6BdWZSlDGOkc5B_um1Icr3pTpUFntliNuMQ8MGAxD_iyN60QQsRz7GnsutjPgjRdehaJTE2fqnJKHtIEfx1o-4WhXnC9rfkp1ZOk3w1SWl73652cOs8 Aug 10 22:56:26.307228 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 22:56:26.307228 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 22:56:26.307228 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 22:56:26.307228 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 22:56:26.307228 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 22:56:26.307228 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 22:56:26.307228 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 60b8d307ccba4177b4470db2072d87f5 Aug 10 22:56:26.307228 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-589972649 Aug 10 22:56:26.307228 n-d-850468-14 devstack@n-api.service[122632]: X-Role: admin,member,reader Aug 10 22:56:26.307228 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: admin,member,reader Aug 10 22:56:26.308617 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/60b8d307ccba4177b4470db2072d87f5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/60b8d307ccba4177b4470db2072d87f5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/60b8d307ccba4177b4470db2072d87f5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_60b8d307ccba4177b4470db2072d87f5", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 22:56:26.308617 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-589972649 Aug 10 22:56:26.308617 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 60b8d307ccba4177b4470db2072d87f5 Aug 10 22:56:26.308617 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-589972649 Aug 10 22:56:26.308617 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-589972649-project-admin Aug 10 22:56:26.308617 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 22:56:26.308617 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 22:56:26.308617 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: aafb3c61a6cb41fbafef15e45e90d3bd Aug 10 22:56:26.308617 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-589972649-project-admin Aug 10 22:56:26.308617 n-d-850468-14 devstack@n-api.service[122632]: method: Aug 10 22:56:26.308617 n-d-850468-14 devstack@n-api.service[122632]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Aug 10 22:56:26.308617 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': 'nonexistent_hypervisor_name'} Aug 10 22:56:26.309407 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 22:56:26.309407 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:56:26.309407 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:56:26.309407 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:56:26.309407 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 22:56:26.309407 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 22:56:26.309407 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 22:56:26.309407 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 22:56:26.309407 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 22:56:26.309407 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 22:56:26.309407 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Aug 10 22:56:26.309407 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Aug 10 22:56:26.309407 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Aug 10 22:56:26.309407 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 10 22:56:26.309407 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Aug 10 22:56:26.309407 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:56:26.309407 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:56:26.309407 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:56:26.309407 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:56:26.309407 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:56:26.310824 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:56:26.310824 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 22:56:26.310824 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 22:56:26.310824 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Aug 10 22:56:26.310824 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:56:26.310824 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-687fb69e-93cd-4036-9042-18f13cfc8658 tempest-HypervisorAdminNegativeUnderV252Test-589972649 tempest-HypervisorAdminNegativeUnderV252Test-589972649-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 22:56:26.310824 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-687fb69e-93cd-4036-9042-18f13cfc8658 tempest-HypervisorAdminNegativeUnderV252Test-589972649 tempest-HypervisorAdminNegativeUnderV252Test-589972649-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.044279 Aug 10 22:56:26.311276 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1625e27f-d1a7-4ea0-8373-be64301ba739 tempest-QuotasAdminNegativeTest-1725509051 tempest-QuotasAdminNegativeTest-1725509051-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:26.311276 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1625e27f-d1a7-4ea0-8373-be64301ba739 tempest-QuotasAdminNegativeTest-1725509051 tempest-QuotasAdminNegativeTest-1725509051-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:26.311276 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1625e27f-d1a7-4ea0-8373-be64301ba739 tempest-QuotasAdminNegativeTest-1725509051 tempest-QuotasAdminNegativeTest-1725509051-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:26.311849 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1625e27f-d1a7-4ea0-8373-be64301ba739 tempest-QuotasAdminNegativeTest-1725509051 tempest-QuotasAdminNegativeTest-1725509051-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:26.311849 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1625e27f-d1a7-4ea0-8373-be64301ba739 tempest-QuotasAdminNegativeTest-1725509051 tempest-QuotasAdminNegativeTest-1725509051-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:26.312279 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1625e27f-d1a7-4ea0-8373-be64301ba739 tempest-QuotasAdminNegativeTest-1725509051 tempest-QuotasAdminNegativeTest-1725509051-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:26.315185 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 144/288] 10.222.0.58 () {58 vars in 1251 bytes} [Wed Aug 10 22:56:26 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 22:56:26.329242 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=14 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:56:26.330052 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-74380c29-3f9d-4a06-bf15-7dee798001fb tempest-HypervisorAdminNegativeUnderV252Test-589972649 tempest-HypervisorAdminNegativeUnderV252Test-589972649-project-admin] Calling method '.version_select at 0x7f847dbc0e50>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:26.331265 n-d-850468-14 devstack@n-api.service[122632]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:56:26.331265 n-d-850468-14 devstack@n-api.service[122632]: warnings.warn(msg) Aug 10 22:56:26.332987 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-74380c29-3f9d-4a06-bf15-7dee798001fb tempest-HypervisorAdminNegativeUnderV252Test-589972649 tempest-HypervisorAdminNegativeUnderV252Test-589972649-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:26.334215 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-74380c29-3f9d-4a06-bf15-7dee798001fb tempest-HypervisorAdminNegativeUnderV252Test-589972649 tempest-HypervisorAdminNegativeUnderV252Test-589972649-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:26.335079 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-74380c29-3f9d-4a06-bf15-7dee798001fb tempest-HypervisorAdminNegativeUnderV252Test-589972649 tempest-HypervisorAdminNegativeUnderV252Test-589972649-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:26.367301 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-74380c29-3f9d-4a06-bf15-7dee798001fb tempest-HypervisorAdminNegativeUnderV252Test-589972649 tempest-HypervisorAdminNegativeUnderV252Test-589972649-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:26.375561 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-74380c29-3f9d-4a06-bf15-7dee798001fb tempest-HypervisorAdminNegativeUnderV252Test-589972649 tempest-HypervisorAdminNegativeUnderV252Test-589972649-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:26.377001 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-74380c29-3f9d-4a06-bf15-7dee798001fb tempest-HypervisorAdminNegativeUnderV252Test-589972649 tempest-HypervisorAdminNegativeUnderV252Test-589972649-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:26.411982 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-74380c29-3f9d-4a06-bf15-7dee798001fb tempest-HypervisorAdminNegativeUnderV252Test-589972649 tempest-HypervisorAdminNegativeUnderV252Test-589972649-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:26.412660 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-74380c29-3f9d-4a06-bf15-7dee798001fb tempest-HypervisorAdminNegativeUnderV252Test-589972649 tempest-HypervisorAdminNegativeUnderV252Test-589972649-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:26.413364 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-74380c29-3f9d-4a06-bf15-7dee798001fb tempest-HypervisorAdminNegativeUnderV252Test-589972649 tempest-HypervisorAdminNegativeUnderV252Test-589972649-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:26.433997 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-74380c29-3f9d-4a06-bf15-7dee798001fb tempest-HypervisorAdminNegativeUnderV252Test-589972649 tempest-HypervisorAdminNegativeUnderV252Test-589972649-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.113609 Aug 10 22:56:26.439315 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 145/289] 10.222.0.58 () {58 vars in 1146 bytes} [Wed Aug 10 22:56:26 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:56:26.443293 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_api:DELETE=6,nova_api:SELECT=87,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:56:26.456450 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-48fd5876-3ae2-4b3d-b146-aa42febacfd6 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:26.457272 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-48fd5876-3ae2-4b3d-b146-aa42febacfd6 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] [instance: ef725aca-9cd8-49a0-81cd-d23710041306] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:56:26.469029 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-48fd5876-3ae2-4b3d-b146-aa42febacfd6 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:26.469538 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-48fd5876-3ae2-4b3d-b146-aa42febacfd6 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:26.469974 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-48fd5876-3ae2-4b3d-b146-aa42febacfd6 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:26.473531 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-48fd5876-3ae2-4b3d-b146-aa42febacfd6 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:26.474191 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-48fd5876-3ae2-4b3d-b146-aa42febacfd6 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:26.477379 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-48fd5876-3ae2-4b3d-b146-aa42febacfd6 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:26.500617 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-1625e27f-d1a7-4ea0-8373-be64301ba739 tempest-QuotasAdminNegativeTest-1725509051 tempest-QuotasAdminNegativeTest-1725509051-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-quota-sets/70cf9c3d3f9d45ce9f7cdee1ff8f4061" status: 200 len: 329 microversion: 2.1 time: 0.977186 Aug 10 22:56:26.507177 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 145/290] 10.222.0.58 () {60 vars in 1262 bytes} [Wed Aug 10 22:56:25 2022] PUT /compute/v2.1/os-quota-sets/70cf9c3d3f9d45ce9f7cdee1ff8f4061 => generated 329 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:56:26.516863 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-ae408a56-d903-4474-b1f8-599af000e8c1 tempest-HypervisorAdminNegativeUnderV252Test-1672519323 tempest-HypervisorAdminNegativeUnderV252Test-1672519323-project] Calling method '.version_select at 0x7f847f2811f0>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:26.519978 n-d-850468-14 devstack@n-api.service[122633]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:56:26.519978 n-d-850468-14 devstack@n-api.service[122633]: warnings.warn(msg) Aug 10 22:56:26.523561 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-ae408a56-d903-4474-b1f8-599af000e8c1 tempest-HypervisorAdminNegativeUnderV252Test-1672519323 tempest-HypervisorAdminNegativeUnderV252Test-1672519323-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': '752eca0774a0486eba3bec7e45e625a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7af0e06ea8454def928529c2e8ea46e3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:26.526887 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-ae408a56-d903-4474-b1f8-599af000e8c1 tempest-HypervisorAdminNegativeUnderV252Test-1672519323 tempest-HypervisorAdminNegativeUnderV252Test-1672519323-project] Request method failure captured: Aug 10 22:56:26.526887 n-d-850468-14 devstack@n-api.service[122633]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Aug 10 22:56:26.526887 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 22:56:26.526887 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 22:56:26.526887 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 22:56:26.526887 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 22:56:26.526887 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 22:56:26.526887 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 22:56:26.526887 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 22:56:26.526887 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 22:56:26.526887 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9DeV1FbeM1n5q446UYtaggZWedYnrlypNDrD10i-BZpB527j3MAXRmo44CcfTNhUdbLzwVtVt1eh5Ne3v3OUErJXDYFo5Ko8DGJIgcfxo2q3bayDZoOl48rUPhKyTT7--gHWh2OO3_Cjf8R_bv655yMT-LmWLoUgn_wuXgbg7ru4IYw Aug 10 22:56:26.526887 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 22:56:26.526887 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 22:56:26.526887 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 22:56:26.526887 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 22:56:26.526887 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 22:56:26.526887 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 22:56:26.526887 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 7af0e06ea8454def928529c2e8ea46e3 Aug 10 22:56:26.526887 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1672519323 Aug 10 22:56:26.526887 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 22:56:26.526887 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 22:56:26.528425 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7af0e06ea8454def928529c2e8ea46e3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7af0e06ea8454def928529c2e8ea46e3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7af0e06ea8454def928529c2e8ea46e3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7af0e06ea8454def928529c2e8ea46e3", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 22:56:26.528425 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1672519323 Aug 10 22:56:26.528425 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 7af0e06ea8454def928529c2e8ea46e3 Aug 10 22:56:26.528425 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1672519323 Aug 10 22:56:26.528425 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1672519323-project Aug 10 22:56:26.528425 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 22:56:26.528425 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 22:56:26.528425 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 752eca0774a0486eba3bec7e45e625a5 Aug 10 22:56:26.528425 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1672519323-project Aug 10 22:56:26.528425 n-d-850468-14 devstack@n-api.service[122633]: method: Aug 10 22:56:26.528425 n-d-850468-14 devstack@n-api.service[122633]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Aug 10 22:56:26.528425 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': '1'} Aug 10 22:56:26.530247 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 22:56:26.530247 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:56:26.530247 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:56:26.530247 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:56:26.530247 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 22:56:26.530247 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 22:56:26.530247 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 22:56:26.530247 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 22:56:26.530247 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 22:56:26.530247 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 22:56:26.530247 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Aug 10 22:56:26.530247 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Aug 10 22:56:26.530247 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 10 22:56:26.530247 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 10 22:56:26.530247 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 10 22:56:26.530247 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 10 22:56:26.530247 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 10 22:56:26.530247 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 10 22:56:26.530247 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 10 22:56:26.531525 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise self.value Aug 10 22:56:26.531525 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 10 22:56:26.531525 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 10 22:56:26.531525 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 10 22:56:26.531525 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 10 22:56:26.531525 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 10 22:56:26.531525 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 10 22:56:26.531525 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Aug 10 22:56:26.531525 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:56:26.531525 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:56:26.531525 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:56:26.531525 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:56:26.531525 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:56:26.531525 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:56:26.531525 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 10 22:56:26.531525 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 10 22:56:26.531525 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Aug 10 22:56:26.531525 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:56:26.533675 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-ae408a56-d903-4474-b1f8-599af000e8c1 tempest-HypervisorAdminNegativeUnderV252Test-1672519323 tempest-HypervisorAdminNegativeUnderV252Test-1672519323-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 22:56:26.533675 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-ae408a56-d903-4474-b1f8-599af000e8c1 tempest-HypervisorAdminNegativeUnderV252Test-1672519323 tempest-HypervisorAdminNegativeUnderV252Test-1672519323-project] 10.222.0.58 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.024046 Aug 10 22:56:26.543195 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 146/291] 10.222.0.58 () {58 vars in 1176 bytes} [Wed Aug 10 22:56:26 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 35 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 10 22:56:26.549454 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-0cfba9db-ed1b-4b3f-b5d7-93e751fd9c3f tempest-QuotasAdminNegativeTest-1725509051 tempest-QuotasAdminNegativeTest-1725509051-project-admin] Calling method '.version_select at 0x7f847daa1310>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:26.984438 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-48fd5876-3ae2-4b3d-b146-aa42febacfd6 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaed2a2e56f749a88c340aaccb15d2d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deaba512051743deb45881d76eb206ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:27.000189 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-48fd5876-3ae2-4b3d-b146-aa42febacfd6 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] 10.222.0.58 "GET /compute/v2.1/servers/ef725aca-9cd8-49a0-81cd-d23710041306" status: 200 len: 1390 microversion: 2.1 time: 0.559475 Aug 10 22:56:27.001534 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 146/292] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:56:26 2022] GET /compute/v2.1/servers/ef725aca-9cd8-49a0-81cd-d23710041306 => generated 1390 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:56:27.024857 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-40b33bf9-f6ee-4109-afc3-93d0c087f13c tempest-HypervisorAdminNegativeUnderV252Test-589972649 tempest-HypervisorAdminNegativeUnderV252Test-589972649-project-admin] Calling method '.version_select at 0x7f847db55790>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:27.026039 n-d-850468-14 devstack@n-api.service[122632]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:56:27.026039 n-d-850468-14 devstack@n-api.service[122632]: warnings.warn(msg) Aug 10 22:56:27.031242 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-40b33bf9-f6ee-4109-afc3-93d0c087f13c tempest-HypervisorAdminNegativeUnderV252Test-589972649 tempest-HypervisorAdminNegativeUnderV252Test-589972649-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:27.032499 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-40b33bf9-f6ee-4109-afc3-93d0c087f13c tempest-HypervisorAdminNegativeUnderV252Test-589972649 tempest-HypervisorAdminNegativeUnderV252Test-589972649-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:27.033044 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-40b33bf9-f6ee-4109-afc3-93d0c087f13c tempest-HypervisorAdminNegativeUnderV252Test-589972649 tempest-HypervisorAdminNegativeUnderV252Test-589972649-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:27.048745 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-40b33bf9-f6ee-4109-afc3-93d0c087f13c tempest-HypervisorAdminNegativeUnderV252Test-589972649 tempest-HypervisorAdminNegativeUnderV252Test-589972649-project-admin] HTTP exception thrown: No hypervisor matching '12b2df19-392d-4d69-83be-df0dca20446f' could be found. Aug 10 22:56:27.052014 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-40b33bf9-f6ee-4109-afc3-93d0c087f13c tempest-HypervisorAdminNegativeUnderV252Test-589972649 tempest-HypervisorAdminNegativeUnderV252Test-589972649-project-admin] Request method failure captured: Aug 10 22:56:27.052014 n-d-850468-14 devstack@n-api.service[122632]: request: GET /compute/v2.1/os-hypervisors/12b2df19-392d-4d69-83be-df0dca20446f/servers HTTP/1.1 Aug 10 22:56:27.052014 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 22:56:27.052014 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 22:56:27.052014 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 22:56:27.052014 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 22:56:27.052014 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 22:56:27.052014 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 22:56:27.052014 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 22:56:27.052014 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 22:56:27.052014 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9DeXmpGHPClIMv33VRgE9UfQeNCn_pduHDpTN8PbVgivCRHncAaE6BuvzrQc6BdWZSlDGOkc5B_um1Icr3pTpUFntliNuMQ8MGAxD_iyN60QQsRz7GnsutjPgjRdehaJTE2fqnJKHtIEfx1o-4WhXnC9rfkp1ZOk3w1SWl73652cOs8 Aug 10 22:56:27.052014 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 22:56:27.052014 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 22:56:27.052014 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 22:56:27.052014 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 22:56:27.052014 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 22:56:27.052014 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 22:56:27.052014 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 60b8d307ccba4177b4470db2072d87f5 Aug 10 22:56:27.052014 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-589972649 Aug 10 22:56:27.052014 n-d-850468-14 devstack@n-api.service[122632]: X-Role: admin,member,reader Aug 10 22:56:27.052014 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: admin,member,reader Aug 10 22:56:27.053287 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/60b8d307ccba4177b4470db2072d87f5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/60b8d307ccba4177b4470db2072d87f5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/60b8d307ccba4177b4470db2072d87f5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_60b8d307ccba4177b4470db2072d87f5", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 22:56:27.053287 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-589972649 Aug 10 22:56:27.053287 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 60b8d307ccba4177b4470db2072d87f5 Aug 10 22:56:27.053287 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-589972649 Aug 10 22:56:27.053287 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-589972649-project-admin Aug 10 22:56:27.053287 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 22:56:27.053287 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 22:56:27.053287 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: aafb3c61a6cb41fbafef15e45e90d3bd Aug 10 22:56:27.053287 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-589972649-project-admin Aug 10 22:56:27.053287 n-d-850468-14 devstack@n-api.service[122632]: method: Aug 10 22:56:27.053287 n-d-850468-14 devstack@n-api.service[122632]: exception: No hypervisor matching '12b2df19-392d-4d69-83be-df0dca20446f' could be found. Aug 10 22:56:27.053287 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': '12b2df19-392d-4d69-83be-df0dca20446f'} Aug 10 22:56:27.053954 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 22:56:27.053954 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:56:27.053954 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:56:27.053954 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:56:27.053954 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 22:56:27.053954 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 22:56:27.053954 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 22:56:27.053954 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 22:56:27.053954 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 22:56:27.053954 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 22:56:27.053954 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Aug 10 22:56:27.053954 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Aug 10 22:56:27.053954 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Aug 10 22:56:27.053954 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 10 22:56:27.053954 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching '12b2df19-392d-4d69-83be-df0dca20446f' could be found. Aug 10 22:56:27.053954 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:56:27.053954 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:56:27.053954 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:56:27.053954 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:56:27.055002 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:56:27.055002 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:56:27.055002 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 22:56:27.055002 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 22:56:27.055002 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching '12b2df19-392d-4d69-83be-df0dca20446f' could be found. Aug 10 22:56:27.055002 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:56:27.055002 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-40b33bf9-f6ee-4109-afc3-93d0c087f13c tempest-HypervisorAdminNegativeUnderV252Test-589972649 tempest-HypervisorAdminNegativeUnderV252Test-589972649-project-admin] Returning 404 to user: No hypervisor matching '12b2df19-392d-4d69-83be-df0dca20446f' could be found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 22:56:27.056266 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-40b33bf9-f6ee-4109-afc3-93d0c087f13c tempest-HypervisorAdminNegativeUnderV252Test-589972649 tempest-HypervisorAdminNegativeUnderV252Test-589972649-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors/12b2df19-392d-4d69-83be-df0dca20446f/servers" status: 404 len: 123 microversion: 2.1 time: 0.052267 Aug 10 22:56:27.057381 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 147/293] 10.222.0.58 () {58 vars in 1281 bytes} [Wed Aug 10 22:56:27 2022] GET /compute/v2.1/os-hypervisors/12b2df19-392d-4d69-83be-df0dca20446f/servers => generated 123 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 22:56:27.071251 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-67dd520c-f367-445e-8593-666a33d03131 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:27.071879 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-67dd520c-f367-445e-8593-666a33d03131 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 9acba217-4a32-4650-a43e-9d998061323c] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:56:27.095188 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-67dd520c-f367-445e-8593-666a33d03131 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:27.095746 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-67dd520c-f367-445e-8593-666a33d03131 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:27.096261 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-67dd520c-f367-445e-8593-666a33d03131 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:27.097146 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-67dd520c-f367-445e-8593-666a33d03131 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:27.097612 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-67dd520c-f367-445e-8593-666a33d03131 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:27.098041 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-67dd520c-f367-445e-8593-666a33d03131 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:27.119509 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-0cfba9db-ed1b-4b3f-b5d7-93e751fd9c3f tempest-QuotasAdminNegativeTest-1725509051 tempest-QuotasAdminNegativeTest-1725509051-project-admin] 10.222.0.58 "GET /compute/v2.1/os-quota-sets/70cf9c3d3f9d45ce9f7cdee1ff8f4061" status: 200 len: 371 microversion: 2.1 time: 0.574722 Aug 10 22:56:27.120677 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 147/294] 10.222.0.58 () {58 vars in 1242 bytes} [Wed Aug 10 22:56:26 2022] GET /compute/v2.1/os-quota-sets/70cf9c3d3f9d45ce9f7cdee1ff8f4061 => generated 371 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:56:27.131732 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-47ed867c-35f4-40cf-9a0a-86bc159b466c req-a25a1e69-1045-4530-ae22-650354f5482c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef725aca-9cd8-49a0-81cd-d23710041306", "name": "network-vif-plugged", "status": "completed", "tag": "eb7cb764-99eb-4a20-9e31-45d5acb040e2"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:56:27.150932 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-47ed867c-35f4-40cf-9a0a-86bc159b466c req-a25a1e69-1045-4530-ae22-650354f5482c service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:27.155944 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-47ed867c-35f4-40cf-9a0a-86bc159b466c req-a25a1e69-1045-4530-ae22-650354f5482c service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:27.156965 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-47ed867c-35f4-40cf-9a0a-86bc159b466c req-a25a1e69-1045-4530-ae22-650354f5482c service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:27.173854 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-47ed867c-35f4-40cf-9a0a-86bc159b466c req-a25a1e69-1045-4530-ae22-650354f5482c service nova] Creating event network-vif-plugged:eb7cb764-99eb-4a20-9e31-45d5acb040e2 for instance ef725aca-9cd8-49a0-81cd-d23710041306 on n-h1-850468-14 Aug 10 22:56:27.184715 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-47ed867c-35f4-40cf-9a0a-86bc159b466c req-a25a1e69-1045-4530-ae22-650354f5482c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062479 Aug 10 22:56:27.187157 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 148/295] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 22:56:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:56:27.202402 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-85bae1f0-59c2-4ec6-a80a-d0765ff7a119 tempest-QuotasAdminNegativeTest-1725509051 tempest-QuotasAdminNegativeTest-1725509051-project-admin] Action: 'update', calling method: .version_select at 0x7f847dd225e0>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:56:27.431524 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-85bae1f0-59c2-4ec6-a80a-d0765ff7a119 tempest-QuotasAdminNegativeTest-1725509051 tempest-QuotasAdminNegativeTest-1725509051-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:27.433200 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-85bae1f0-59c2-4ec6-a80a-d0765ff7a119 tempest-QuotasAdminNegativeTest-1725509051 tempest-QuotasAdminNegativeTest-1725509051-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:27.433646 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-85bae1f0-59c2-4ec6-a80a-d0765ff7a119 tempest-QuotasAdminNegativeTest-1725509051 tempest-QuotasAdminNegativeTest-1725509051-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:27.437788 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-85bae1f0-59c2-4ec6-a80a-d0765ff7a119 tempest-QuotasAdminNegativeTest-1725509051 tempest-QuotasAdminNegativeTest-1725509051-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:27.438197 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-85bae1f0-59c2-4ec6-a80a-d0765ff7a119 tempest-QuotasAdminNegativeTest-1725509051 tempest-QuotasAdminNegativeTest-1725509051-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:27.438626 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-85bae1f0-59c2-4ec6-a80a-d0765ff7a119 tempest-QuotasAdminNegativeTest-1725509051 tempest-QuotasAdminNegativeTest-1725509051-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:27.551849 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-85bae1f0-59c2-4ec6-a80a-d0765ff7a119 tempest-QuotasAdminNegativeTest-1725509051 tempest-QuotasAdminNegativeTest-1725509051-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-quota-sets/70cf9c3d3f9d45ce9f7cdee1ff8f4061" status: 200 len: 328 microversion: 2.1 time: 0.358442 Aug 10 22:56:27.553448 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 149/296] 10.222.0.58 () {60 vars in 1262 bytes} [Wed Aug 10 22:56:27 2022] PUT /compute/v2.1/os-quota-sets/70cf9c3d3f9d45ce9f7cdee1ff8f4061 => generated 328 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:56:27.574848 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-a9d601bf-90b9-4b5d-8007-2457c8036d7e tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:27.580152 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-a9d601bf-90b9-4b5d-8007-2457c8036d7e tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] [instance: e1648ffb-5a43-4e48-940e-6fcff8db87e5] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:56:27.600718 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a9d601bf-90b9-4b5d-8007-2457c8036d7e tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:27.601741 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a9d601bf-90b9-4b5d-8007-2457c8036d7e tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:27.602548 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a9d601bf-90b9-4b5d-8007-2457c8036d7e tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:27.603539 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a9d601bf-90b9-4b5d-8007-2457c8036d7e tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:27.604290 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a9d601bf-90b9-4b5d-8007-2457c8036d7e tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:27.604928 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a9d601bf-90b9-4b5d-8007-2457c8036d7e tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:27.641643 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=100 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:56:27.727181 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-67dd520c-f367-445e-8593-666a33d03131 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:27.743350 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-67dd520c-f367-445e-8593-666a33d03131 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/9acba217-4a32-4650-a43e-9d998061323c" status: 200 len: 1312 microversion: 2.1 time: 0.684857 Aug 10 22:56:27.743930 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 148/297] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:56:27 2022] GET /compute/v2.1/servers/9acba217-4a32-4650-a43e-9d998061323c => generated 1312 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:56:27.777339 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-481765b1-40e8-406e-bf0f-5f1e418bfc72 tempest-QuotasAdminNegativeTest-517482210 tempest-QuotasAdminNegativeTest-517482210-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1912542323", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:56:27.900044 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.network.neutron [None req-481765b1-40e8-406e-bf0f-5f1e418bfc72 tempest-QuotasAdminNegativeTest-517482210 tempest-QuotasAdminNegativeTest-517482210-project] validate_networks() for None {{(pid=122632) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 22:56:28.025812 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-a9d601bf-90b9-4b5d-8007-2457c8036d7e tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64648d3c6f5c423e83ff023e7bf6550a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434532ba922f406d8d8c197d3a57ffc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:28.043749 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-a9d601bf-90b9-4b5d-8007-2457c8036d7e tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] 10.222.0.58 "GET /compute/v2.1/servers/e1648ffb-5a43-4e48-940e-6fcff8db87e5" status: 200 len: 1320 microversion: 2.1 time: 0.487878 Aug 10 22:56:28.049382 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 150/298] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:56:27 2022] GET /compute/v2.1/servers/e1648ffb-5a43-4e48-940e-6fcff8db87e5 => generated 1320 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:56:28.059968 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-9ca2aded-e53c-461f-ae3b-959bf54625ec tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:28.064136 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-9ca2aded-e53c-461f-ae3b-959bf54625ec tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] [instance: ef725aca-9cd8-49a0-81cd-d23710041306] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:56:28.084977 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9ca2aded-e53c-461f-ae3b-959bf54625ec tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:28.085598 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9ca2aded-e53c-461f-ae3b-959bf54625ec tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:28.086028 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9ca2aded-e53c-461f-ae3b-959bf54625ec tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:28.086749 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9ca2aded-e53c-461f-ae3b-959bf54625ec tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:28.088189 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9ca2aded-e53c-461f-ae3b-959bf54625ec tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:28.088960 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9ca2aded-e53c-461f-ae3b-959bf54625ec tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:28.571998 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-9ca2aded-e53c-461f-ae3b-959bf54625ec tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaed2a2e56f749a88c340aaccb15d2d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deaba512051743deb45881d76eb206ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:28.585665 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-9ca2aded-e53c-461f-ae3b-959bf54625ec tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] 10.222.0.58 "GET /compute/v2.1/servers/ef725aca-9cd8-49a0-81cd-d23710041306" status: 200 len: 1390 microversion: 2.1 time: 0.530834 Aug 10 22:56:28.586604 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 151/299] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:56:28 2022] GET /compute/v2.1/servers/ef725aca-9cd8-49a0-81cd-d23710041306 => generated 1390 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:56:28.600748 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-e683f146-7a03-4e77-aa7a-bcc5448c6ab7 req-5b5c3691-014f-493e-ad63-d97cac53e78c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9acba217-4a32-4650-a43e-9d998061323c", "tag": "7f752529-8509-4990-90aa-e93ad25cb8d1"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:56:28.620792 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-e683f146-7a03-4e77-aa7a-bcc5448c6ab7 req-5b5c3691-014f-493e-ad63-d97cac53e78c service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:28.621467 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-e683f146-7a03-4e77-aa7a-bcc5448c6ab7 req-5b5c3691-014f-493e-ad63-d97cac53e78c service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:28.622078 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-e683f146-7a03-4e77-aa7a-bcc5448c6ab7 req-5b5c3691-014f-493e-ad63-d97cac53e78c service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:28.670935 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-e683f146-7a03-4e77-aa7a-bcc5448c6ab7 req-5b5c3691-014f-493e-ad63-d97cac53e78c service nova] Creating event network-changed:7f752529-8509-4990-90aa-e93ad25cb8d1 for instance 9acba217-4a32-4650-a43e-9d998061323c on n-h2-850468-14 Aug 10 22:56:28.678380 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-e683f146-7a03-4e77-aa7a-bcc5448c6ab7 req-5b5c3691-014f-493e-ad63-d97cac53e78c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090504 Aug 10 22:56:28.679364 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 152/300] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 22:56:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:56:28.768915 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-6f73450b-84ae-4c59-a87f-0e08b972769b tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:28.770187 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-6f73450b-84ae-4c59-a87f-0e08b972769b tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 9acba217-4a32-4650-a43e-9d998061323c] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:56:28.792305 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6f73450b-84ae-4c59-a87f-0e08b972769b tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:28.794344 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6f73450b-84ae-4c59-a87f-0e08b972769b tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:28.806803 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6f73450b-84ae-4c59-a87f-0e08b972769b tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:28.809434 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6f73450b-84ae-4c59-a87f-0e08b972769b tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:28.812395 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6f73450b-84ae-4c59-a87f-0e08b972769b tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:28.815088 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6f73450b-84ae-4c59-a87f-0e08b972769b tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:28.964427 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-481765b1-40e8-406e-bf0f-5f1e418bfc72 tempest-QuotasAdminNegativeTest-517482210 tempest-QuotasAdminNegativeTest-517482210-project] Flavor limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 22:56:28.964980 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-481765b1-40e8-406e-bf0f-5f1e418bfc72 tempest-QuotasAdminNegativeTest-517482210 tempest-QuotasAdminNegativeTest-517482210-project] Image limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 22:56:28.965227 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-481765b1-40e8-406e-bf0f-5f1e418bfc72 tempest-QuotasAdminNegativeTest-517482210 tempest-QuotasAdminNegativeTest-517482210-project] Flavor pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 22:56:28.965618 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-481765b1-40e8-406e-bf0f-5f1e418bfc72 tempest-QuotasAdminNegativeTest-517482210 tempest-QuotasAdminNegativeTest-517482210-project] Image pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 22:56:28.967499 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-481765b1-40e8-406e-bf0f-5f1e418bfc72 tempest-QuotasAdminNegativeTest-517482210 tempest-QuotasAdminNegativeTest-517482210-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 22:56:28.980414 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=35 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:56:28.983470 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-481765b1-40e8-406e-bf0f-5f1e418bfc72 tempest-QuotasAdminNegativeTest-517482210 tempest-QuotasAdminNegativeTest-517482210-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:28.986013 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-481765b1-40e8-406e-bf0f-5f1e418bfc72 tempest-QuotasAdminNegativeTest-517482210 tempest-QuotasAdminNegativeTest-517482210-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:28.987285 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-481765b1-40e8-406e-bf0f-5f1e418bfc72 tempest-QuotasAdminNegativeTest-517482210 tempest-QuotasAdminNegativeTest-517482210-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:28.989861 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-481765b1-40e8-406e-bf0f-5f1e418bfc72 tempest-QuotasAdminNegativeTest-517482210 tempest-QuotasAdminNegativeTest-517482210-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:28.990715 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-481765b1-40e8-406e-bf0f-5f1e418bfc72 tempest-QuotasAdminNegativeTest-517482210 tempest-QuotasAdminNegativeTest-517482210-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:28.992899 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-481765b1-40e8-406e-bf0f-5f1e418bfc72 tempest-QuotasAdminNegativeTest-517482210 tempest-QuotasAdminNegativeTest-517482210-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:29.051622 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-481765b1-40e8-406e-bf0f-5f1e418bfc72 tempest-QuotasAdminNegativeTest-517482210 tempest-QuotasAdminNegativeTest-517482210-project] Getting quotas for project 70cf9c3d3f9d45ce9f7cdee1ff8f4061. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 22:56:29.062367 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-481765b1-40e8-406e-bf0f-5f1e418bfc72 tempest-QuotasAdminNegativeTest-517482210 tempest-QuotasAdminNegativeTest-517482210-project] Getting quotas for user f3db1fe4444a4b6d8fd52820b8cae527 and project 70cf9c3d3f9d45ce9f7cdee1ff8f4061. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 22:56:29.089325 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.utils [None req-481765b1-40e8-406e-bf0f-5f1e418bfc72 tempest-QuotasAdminNegativeTest-517482210 tempest-QuotasAdminNegativeTest-517482210-project] instances quota exceeded for 70cf9c3d3f9d45ce9f7cdee1ff8f4061, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=122632) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Aug 10 22:56:29.095438 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-481765b1-40e8-406e-bf0f-5f1e418bfc72 tempest-QuotasAdminNegativeTest-517482210 tempest-QuotasAdminNegativeTest-517482210-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 10 22:56:29.097521 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-481765b1-40e8-406e-bf0f-5f1e418bfc72 tempest-QuotasAdminNegativeTest-517482210 tempest-QuotasAdminNegativeTest-517482210-project] Request method failure captured: Aug 10 22:56:29.097521 n-d-850468-14 devstack@n-api.service[122632]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 10 22:56:29.097521 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 22:56:29.097521 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 22:56:29.097521 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 22:56:29.097521 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 145 Aug 10 22:56:29.097521 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 22:56:29.097521 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 22:56:29.097521 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 22:56:29.097521 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 22:56:29.097521 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9DeQmJTfvikw7Bg0eUMFOxeHegamNQKW3oLiPyBxXtTXhzKWKgmjCIpIJF9in5wsd8eQhhBPR7h7SR06wYIuNLPWh0WTXgzVeo3LV1N8ON3Q_OgShavIwyBt1CDeW-5sm9RlFNXAb5LFJ80B0rZHeo85YxnPewgrawiln1IAigKK9Fk Aug 10 22:56:29.097521 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 22:56:29.097521 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 22:56:29.097521 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 22:56:29.097521 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 22:56:29.097521 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 22:56:29.097521 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 22:56:29.097521 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 70cf9c3d3f9d45ce9f7cdee1ff8f4061 Aug 10 22:56:29.097521 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-QuotasAdminNegativeTest-517482210 Aug 10 22:56:29.097521 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 22:56:29.097521 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 22:56:29.098957 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/70cf9c3d3f9d45ce9f7cdee1ff8f4061"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/70cf9c3d3f9d45ce9f7cdee1ff8f4061"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/70cf9c3d3f9d45ce9f7cdee1ff8f4061"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_70cf9c3d3f9d45ce9f7cdee1ff8f4061", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 22:56:29.098957 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-QuotasAdminNegativeTest-517482210 Aug 10 22:56:29.098957 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 70cf9c3d3f9d45ce9f7cdee1ff8f4061 Aug 10 22:56:29.098957 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-517482210 Aug 10 22:56:29.098957 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-QuotasAdminNegativeTest-517482210-project Aug 10 22:56:29.098957 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 22:56:29.098957 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 22:56:29.098957 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: f3db1fe4444a4b6d8fd52820b8cae527 Aug 10 22:56:29.098957 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-QuotasAdminNegativeTest-517482210-project Aug 10 22:56:29.098957 n-d-850468-14 devstack@n-api.service[122632]: Aug 10 22:56:29.098957 n-d-850468-14 devstack@n-api.service[122632]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1912542323", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452"}} Aug 10 22:56:29.098957 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 22:56:29.099783 n-d-850468-14 devstack@n-api.service[122632]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 10 22:56:29.099783 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1912542323', 'imageRef': '78ad8905-f66f-4733-8be9-2b260f1fabed', 'flavorRef': '452'}}} Aug 10 22:56:29.099783 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 22:56:29.099783 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:56:29.099783 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Aug 10 22:56:29.099783 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Aug 10 22:56:29.099783 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 10 22:56:29.099783 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 10 22:56:29.099783 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 10 22:56:29.099783 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc Aug 10 22:56:29.099783 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 10 22:56:29.099783 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 10 22:56:29.099783 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 10 22:56:29.099783 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 10 22:56:29.099783 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 10 22:56:29.099783 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 10 22:56:29.099783 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 10 22:56:29.099783 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 10 22:56:29.101022 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Aug 10 22:56:29.101022 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 10 22:56:29.101022 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Aug 10 22:56:29.101022 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:56:29.101022 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:56:29.101022 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:56:29.101022 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:56:29.101022 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 22:56:29.101022 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 22:56:29.101022 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 22:56:29.101022 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 22:56:29.101022 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1678, in _create_instance Aug 10 22:56:29.101022 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Aug 10 22:56:29.101022 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1350, in _provision_instances Aug 10 22:56:29.101022 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Aug 10 22:56:29.101022 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Aug 10 22:56:29.101022 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 10 22:56:29.101022 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 10 22:56:29.101022 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:56:29.101022 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:56:29.101022 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:56:29.102769 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:56:29.102769 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:56:29.102769 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:56:29.102769 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 22:56:29.102769 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 22:56:29.102769 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 22:56:29.102769 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 22:56:29.102769 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 22:56:29.102769 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 22:56:29.102769 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 22:56:29.102769 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 22:56:29.102769 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 22:56:29.102769 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 22:56:29.102769 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 22:56:29.102769 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Aug 10 22:56:29.102769 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 10 22:56:29.102769 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 10 22:56:29.102769 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:56:29.102769 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:56:29.102769 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:56:29.102769 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:56:29.104352 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:56:29.104352 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:56:29.104352 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 22:56:29.104352 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 22:56:29.104352 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 10 22:56:29.104352 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:56:29.106000 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-481765b1-40e8-406e-bf0f-5f1e418bfc72 tempest-QuotasAdminNegativeTest-517482210 tempest-QuotasAdminNegativeTest-517482210-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 22:56:29.106721 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-481765b1-40e8-406e-bf0f-5f1e418bfc72 tempest-QuotasAdminNegativeTest-517482210 tempest-QuotasAdminNegativeTest-517482210-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 1.333522 Aug 10 22:56:29.111988 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 149/301] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 22:56:27 2022] POST /compute/v2.1/servers => generated 119 bytes in 1339 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 10 22:56:29.116903 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-f2d82dc1-baf3-42c4-8d8f-2c3c6dbe6615 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:29.117806 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-f2d82dc1-baf3-42c4-8d8f-2c3c6dbe6615 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] [instance: e1648ffb-5a43-4e48-940e-6fcff8db87e5] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:56:29.131119 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f2d82dc1-baf3-42c4-8d8f-2c3c6dbe6615 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:29.132114 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f2d82dc1-baf3-42c4-8d8f-2c3c6dbe6615 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:29.133168 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f2d82dc1-baf3-42c4-8d8f-2c3c6dbe6615 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:29.134097 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f2d82dc1-baf3-42c4-8d8f-2c3c6dbe6615 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:29.135077 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f2d82dc1-baf3-42c4-8d8f-2c3c6dbe6615 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:29.135714 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f2d82dc1-baf3-42c4-8d8f-2c3c6dbe6615 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:29.637026 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-f2d82dc1-baf3-42c4-8d8f-2c3c6dbe6615 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64648d3c6f5c423e83ff023e7bf6550a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434532ba922f406d8d8c197d3a57ffc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:29.651455 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-f2d82dc1-baf3-42c4-8d8f-2c3c6dbe6615 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] 10.222.0.58 "GET /compute/v2.1/servers/e1648ffb-5a43-4e48-940e-6fcff8db87e5" status: 200 len: 1320 microversion: 2.1 time: 0.536484 Aug 10 22:56:29.653371 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 150/302] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:56:29 2022] GET /compute/v2.1/servers/e1648ffb-5a43-4e48-940e-6fcff8db87e5 => generated 1320 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:56:29.663665 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-93faa23f-19a4-454a-b3c2-4acff11890cb tempest-QuotasAdminNegativeTest-1725509051 tempest-QuotasAdminNegativeTest-1725509051-project-admin] Action: 'update', calling method: .version_select at 0x7f847db55b80>, body: {"quota_set": {"instances": 10}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:56:29.675541 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-6f73450b-84ae-4c59-a87f-0e08b972769b tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:29.695122 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-6f73450b-84ae-4c59-a87f-0e08b972769b tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/9acba217-4a32-4650-a43e-9d998061323c" status: 200 len: 1312 microversion: 2.1 time: 0.933398 Aug 10 22:56:29.706808 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 153/303] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:56:28 2022] GET /compute/v2.1/servers/9acba217-4a32-4650-a43e-9d998061323c => generated 1312 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:56:29.706808 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-ee528632-1e3c-4917-9aa6-a5a306defb77 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:29.706808 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-ee528632-1e3c-4917-9aa6-a5a306defb77 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] [instance: ef725aca-9cd8-49a0-81cd-d23710041306] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:56:29.716827 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ee528632-1e3c-4917-9aa6-a5a306defb77 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:29.717667 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ee528632-1e3c-4917-9aa6-a5a306defb77 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:29.717823 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ee528632-1e3c-4917-9aa6-a5a306defb77 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:29.722688 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ee528632-1e3c-4917-9aa6-a5a306defb77 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:29.723194 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ee528632-1e3c-4917-9aa6-a5a306defb77 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:29.723617 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ee528632-1e3c-4917-9aa6-a5a306defb77 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:30.181202 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-93faa23f-19a4-454a-b3c2-4acff11890cb tempest-QuotasAdminNegativeTest-1725509051 tempest-QuotasAdminNegativeTest-1725509051-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:30.184038 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-93faa23f-19a4-454a-b3c2-4acff11890cb tempest-QuotasAdminNegativeTest-1725509051 tempest-QuotasAdminNegativeTest-1725509051-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:30.186307 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-93faa23f-19a4-454a-b3c2-4acff11890cb tempest-QuotasAdminNegativeTest-1725509051 tempest-QuotasAdminNegativeTest-1725509051-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:30.195361 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-93faa23f-19a4-454a-b3c2-4acff11890cb tempest-QuotasAdminNegativeTest-1725509051 tempest-QuotasAdminNegativeTest-1725509051-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:30.196320 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-93faa23f-19a4-454a-b3c2-4acff11890cb tempest-QuotasAdminNegativeTest-1725509051 tempest-QuotasAdminNegativeTest-1725509051-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:30.197013 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-93faa23f-19a4-454a-b3c2-4acff11890cb tempest-QuotasAdminNegativeTest-1725509051 tempest-QuotasAdminNegativeTest-1725509051-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:30.355961 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-93faa23f-19a4-454a-b3c2-4acff11890cb tempest-QuotasAdminNegativeTest-1725509051 tempest-QuotasAdminNegativeTest-1725509051-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-quota-sets/70cf9c3d3f9d45ce9f7cdee1ff8f4061" status: 200 len: 329 microversion: 2.1 time: 0.701274 Aug 10 22:56:30.366172 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 151/304] 10.222.0.58 () {60 vars in 1262 bytes} [Wed Aug 10 22:56:29 2022] PUT /compute/v2.1/os-quota-sets/70cf9c3d3f9d45ce9f7cdee1ff8f4061 => generated 329 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:56:30.378970 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-e8e1b1ab-ef49-466b-9b79-993a88d93844 tempest-QuotasAdminNegativeTest-1725509051 tempest-QuotasAdminNegativeTest-1725509051-project-admin] Calling method '.version_select at 0x7f847db6c310>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:30.676661 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-ee528632-1e3c-4917-9aa6-a5a306defb77 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaed2a2e56f749a88c340aaccb15d2d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deaba512051743deb45881d76eb206ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:30.697644 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-e8e1b1ab-ef49-466b-9b79-993a88d93844 tempest-QuotasAdminNegativeTest-1725509051 tempest-QuotasAdminNegativeTest-1725509051-project-admin] 10.222.0.58 "GET /compute/v2.1/os-quota-sets/70cf9c3d3f9d45ce9f7cdee1ff8f4061" status: 200 len: 371 microversion: 2.1 time: 0.323820 Aug 10 22:56:30.703004 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 152/305] 10.222.0.58 () {58 vars in 1242 bytes} [Wed Aug 10 22:56:30 2022] GET /compute/v2.1/os-quota-sets/70cf9c3d3f9d45ce9f7cdee1ff8f4061 => generated 371 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:56:30.712372 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-ee528632-1e3c-4917-9aa6-a5a306defb77 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] 10.222.0.58 "GET /compute/v2.1/servers/ef725aca-9cd8-49a0-81cd-d23710041306" status: 200 len: 1590 microversion: 2.1 time: 1.010653 Aug 10 22:56:30.715962 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 154/306] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:56:29 2022] GET /compute/v2.1/servers/ef725aca-9cd8-49a0-81cd-d23710041306 => generated 1590 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:56:30.728232 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-cb52ed7b-389a-446c-b90e-17a8ff56a4f5 tempest-QuotasAdminNegativeTest-1725509051 tempest-QuotasAdminNegativeTest-1725509051-project-admin] Action: 'update', calling method: .version_select at 0x7f847daa1790>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:56:30.729020 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-d00ab586-39c9-4b2b-a295-6f27bd118c50 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:30.729648 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-d00ab586-39c9-4b2b-a295-6f27bd118c50 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] [instance: e1648ffb-5a43-4e48-940e-6fcff8db87e5] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:56:30.760105 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d00ab586-39c9-4b2b-a295-6f27bd118c50 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:30.760622 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d00ab586-39c9-4b2b-a295-6f27bd118c50 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:30.763170 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d00ab586-39c9-4b2b-a295-6f27bd118c50 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:30.763999 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d00ab586-39c9-4b2b-a295-6f27bd118c50 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:30.764465 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d00ab586-39c9-4b2b-a295-6f27bd118c50 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:30.767268 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d00ab586-39c9-4b2b-a295-6f27bd118c50 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:31.124068 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-d00ab586-39c9-4b2b-a295-6f27bd118c50 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64648d3c6f5c423e83ff023e7bf6550a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434532ba922f406d8d8c197d3a57ffc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:31.148417 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-d00ab586-39c9-4b2b-a295-6f27bd118c50 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] 10.222.0.58 "GET /compute/v2.1/servers/e1648ffb-5a43-4e48-940e-6fcff8db87e5" status: 200 len: 1320 microversion: 2.1 time: 0.444115 Aug 10 22:56:31.149855 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 153/307] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:56:30 2022] GET /compute/v2.1/servers/e1648ffb-5a43-4e48-940e-6fcff8db87e5 => generated 1320 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:56:31.162380 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-b4246632-a8bf-4c00-b95f-7da38b0a5531 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:31.163424 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-b4246632-a8bf-4c00-b95f-7da38b0a5531 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 9acba217-4a32-4650-a43e-9d998061323c] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:56:31.199951 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b4246632-a8bf-4c00-b95f-7da38b0a5531 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:31.201847 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b4246632-a8bf-4c00-b95f-7da38b0a5531 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:31.202527 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b4246632-a8bf-4c00-b95f-7da38b0a5531 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:31.204505 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b4246632-a8bf-4c00-b95f-7da38b0a5531 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:31.205398 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b4246632-a8bf-4c00-b95f-7da38b0a5531 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:31.206045 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b4246632-a8bf-4c00-b95f-7da38b0a5531 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:31.486536 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-b4246632-a8bf-4c00-b95f-7da38b0a5531 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:31.499561 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-b4246632-a8bf-4c00-b95f-7da38b0a5531 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/9acba217-4a32-4650-a43e-9d998061323c" status: 200 len: 1312 microversion: 2.1 time: 0.346547 Aug 10 22:56:31.512744 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 154/308] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:56:31 2022] GET /compute/v2.1/servers/9acba217-4a32-4650-a43e-9d998061323c => generated 1312 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:56:31.521492 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-327b61fa-9c10-4760-9603-b18793f9b4ea tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:31.522072 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-327b61fa-9c10-4760-9603-b18793f9b4ea tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] [instance: ef725aca-9cd8-49a0-81cd-d23710041306] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:56:31.524619 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=4,nova_api:UPDATE=3,nova_api:DELETE=2 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:56:31.530413 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-327b61fa-9c10-4760-9603-b18793f9b4ea tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:31.531195 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-327b61fa-9c10-4760-9603-b18793f9b4ea tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:31.532190 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-327b61fa-9c10-4760-9603-b18793f9b4ea tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:31.533409 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-327b61fa-9c10-4760-9603-b18793f9b4ea tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:31.534104 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-327b61fa-9c10-4760-9603-b18793f9b4ea tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:31.539628 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-327b61fa-9c10-4760-9603-b18793f9b4ea tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:31.662730 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-327b61fa-9c10-4760-9603-b18793f9b4ea tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] 10.222.0.58 "GET /compute/v2.1/servers/ef725aca-9cd8-49a0-81cd-d23710041306/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.148143 Aug 10 22:56:31.663535 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 155/309] 10.222.0.58 () {58 vars in 1275 bytes} [Wed Aug 10 22:56:31 2022] GET /compute/v2.1/servers/ef725aca-9cd8-49a0-81cd-d23710041306/os-interface => generated 285 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:56:31.731169 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=65 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:56:31.752010 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cb52ed7b-389a-446c-b90e-17a8ff56a4f5 tempest-QuotasAdminNegativeTest-1725509051 tempest-QuotasAdminNegativeTest-1725509051-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:31.752795 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cb52ed7b-389a-446c-b90e-17a8ff56a4f5 tempest-QuotasAdminNegativeTest-1725509051 tempest-QuotasAdminNegativeTest-1725509051-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:31.754863 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cb52ed7b-389a-446c-b90e-17a8ff56a4f5 tempest-QuotasAdminNegativeTest-1725509051 tempest-QuotasAdminNegativeTest-1725509051-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:31.755993 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cb52ed7b-389a-446c-b90e-17a8ff56a4f5 tempest-QuotasAdminNegativeTest-1725509051 tempest-QuotasAdminNegativeTest-1725509051-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:31.758693 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cb52ed7b-389a-446c-b90e-17a8ff56a4f5 tempest-QuotasAdminNegativeTest-1725509051 tempest-QuotasAdminNegativeTest-1725509051-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:31.759339 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cb52ed7b-389a-446c-b90e-17a8ff56a4f5 tempest-QuotasAdminNegativeTest-1725509051 tempest-QuotasAdminNegativeTest-1725509051-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:31.938575 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-cb52ed7b-389a-446c-b90e-17a8ff56a4f5 tempest-QuotasAdminNegativeTest-1725509051 tempest-QuotasAdminNegativeTest-1725509051-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-quota-sets/70cf9c3d3f9d45ce9f7cdee1ff8f4061" status: 200 len: 325 microversion: 2.1 time: 1.220319 Aug 10 22:56:31.939332 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 155/310] 10.222.0.58 () {60 vars in 1262 bytes} [Wed Aug 10 22:56:30 2022] PUT /compute/v2.1/os-quota-sets/70cf9c3d3f9d45ce9f7cdee1ff8f4061 => generated 325 bytes in 1223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:56:32.171822 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-a04a6c62-cb66-4372-bac8-07101a15ae2b tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:32.172730 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-a04a6c62-cb66-4372-bac8-07101a15ae2b tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] [instance: e1648ffb-5a43-4e48-940e-6fcff8db87e5] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:56:32.190022 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a04a6c62-cb66-4372-bac8-07101a15ae2b tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:32.190531 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a04a6c62-cb66-4372-bac8-07101a15ae2b tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:32.191015 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a04a6c62-cb66-4372-bac8-07101a15ae2b tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:32.198077 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a04a6c62-cb66-4372-bac8-07101a15ae2b tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:32.200450 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a04a6c62-cb66-4372-bac8-07101a15ae2b tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:32.200680 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a04a6c62-cb66-4372-bac8-07101a15ae2b tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:32.594959 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-ccbf0317-e41d-49d3-90d5-ee63e1c15f60 tempest-AggregatesAdminNegativeTestJSON-25117975 tempest-AggregatesAdminNegativeTestJSON-25117975-project-admin] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:32.601918 n-d-850468-14 devstack@n-api.service[122632]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:56:32.601918 n-d-850468-14 devstack@n-api.service[122632]: warnings.warn(msg) Aug 10 22:56:32.612292 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ccbf0317-e41d-49d3-90d5-ee63e1c15f60 tempest-AggregatesAdminNegativeTestJSON-25117975 tempest-AggregatesAdminNegativeTestJSON-25117975-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:32.614625 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ccbf0317-e41d-49d3-90d5-ee63e1c15f60 tempest-AggregatesAdminNegativeTestJSON-25117975 tempest-AggregatesAdminNegativeTestJSON-25117975-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:32.617868 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ccbf0317-e41d-49d3-90d5-ee63e1c15f60 tempest-AggregatesAdminNegativeTestJSON-25117975 tempest-AggregatesAdminNegativeTestJSON-25117975-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:32.624615 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ccbf0317-e41d-49d3-90d5-ee63e1c15f60 tempest-AggregatesAdminNegativeTestJSON-25117975 tempest-AggregatesAdminNegativeTestJSON-25117975-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:32.626524 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ccbf0317-e41d-49d3-90d5-ee63e1c15f60 tempest-AggregatesAdminNegativeTestJSON-25117975 tempest-AggregatesAdminNegativeTestJSON-25117975-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:32.627383 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ccbf0317-e41d-49d3-90d5-ee63e1c15f60 tempest-AggregatesAdminNegativeTestJSON-25117975 tempest-AggregatesAdminNegativeTestJSON-25117975-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:32.698880 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-ccbf0317-e41d-49d3-90d5-ee63e1c15f60 tempest-AggregatesAdminNegativeTestJSON-25117975 tempest-AggregatesAdminNegativeTestJSON-25117975-project-admin] 10.222.0.58 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.565472 Aug 10 22:56:32.702624 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 156/311] 10.222.0.58 () {58 vars in 1176 bytes} [Wed Aug 10 22:56:32 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:56:32.721573 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-2c2c8dd7-c760-4b2a-8f21-bb889b48e4bc tempest-QuotasAdminNegativeTest-517482210 tempest-QuotasAdminNegativeTest-517482210-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1081208409", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:56:32.838234 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.network.neutron [None req-2c2c8dd7-c760-4b2a-8f21-bb889b48e4bc tempest-QuotasAdminNegativeTest-517482210 tempest-QuotasAdminNegativeTest-517482210-project] validate_networks() for None {{(pid=122632) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 22:56:32.841409 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-a04a6c62-cb66-4372-bac8-07101a15ae2b tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64648d3c6f5c423e83ff023e7bf6550a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434532ba922f406d8d8c197d3a57ffc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:32.853852 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-a04a6c62-cb66-4372-bac8-07101a15ae2b tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] 10.222.0.58 "GET /compute/v2.1/servers/e1648ffb-5a43-4e48-940e-6fcff8db87e5" status: 200 len: 1320 microversion: 2.1 time: 0.686428 Aug 10 22:56:32.856036 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 156/312] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:56:32 2022] GET /compute/v2.1/servers/e1648ffb-5a43-4e48-940e-6fcff8db87e5 => generated 1320 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:56:32.883664 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-804e7ad0-d312-4ab9-bf0f-bcb8738ed4f6 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:32.888229 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-804e7ad0-d312-4ab9-bf0f-bcb8738ed4f6 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 9acba217-4a32-4650-a43e-9d998061323c] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:56:32.921813 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-804e7ad0-d312-4ab9-bf0f-bcb8738ed4f6 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:32.923485 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-804e7ad0-d312-4ab9-bf0f-bcb8738ed4f6 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:32.924144 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-804e7ad0-d312-4ab9-bf0f-bcb8738ed4f6 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:32.925074 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-804e7ad0-d312-4ab9-bf0f-bcb8738ed4f6 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:32.927621 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-804e7ad0-d312-4ab9-bf0f-bcb8738ed4f6 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:32.928269 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-804e7ad0-d312-4ab9-bf0f-bcb8738ed4f6 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:33.677907 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-804e7ad0-d312-4ab9-bf0f-bcb8738ed4f6 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:33.690346 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-804e7ad0-d312-4ab9-bf0f-bcb8738ed4f6 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/9acba217-4a32-4650-a43e-9d998061323c" status: 200 len: 1312 microversion: 2.1 time: 0.829532 Aug 10 22:56:33.703956 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 157/313] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:56:32 2022] GET /compute/v2.1/servers/9acba217-4a32-4650-a43e-9d998061323c => generated 1312 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:56:33.707628 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-ce15be2a-b4c1-4df5-bc1c-384b393754c8 tempest-AggregatesAdminNegativeTestJSON-25117975 tempest-AggregatesAdminNegativeTestJSON-25117975-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-232694276"}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:56:33.719413 n-d-850468-14 devstack@n-api.service[122633]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:56:33.719413 n-d-850468-14 devstack@n-api.service[122633]: warnings.warn(msg) Aug 10 22:56:33.720759 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.objects.aggregate [None req-ce15be2a-b4c1-4df5-bc1c-384b393754c8 tempest-AggregatesAdminNegativeTestJSON-25117975 tempest-AggregatesAdminNegativeTestJSON-25117975-project-admin] Generated uuid 2418d04c-b6b8-47bf-bb46-03d4220bdb51 for aggregate {{(pid=122633) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 10 22:56:33.791414 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-ce15be2a-b4c1-4df5-bc1c-384b393754c8 tempest-AggregatesAdminNegativeTestJSON-25117975 tempest-AggregatesAdminNegativeTestJSON-25117975-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.095490 Aug 10 22:56:33.792018 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 158/314] 10.222.0.58 () {60 vars in 1164 bytes} [Wed Aug 10 22:56:33 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:56:33.815806 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-2f18b906-3a3a-43eb-8c44-979557973157 req-94ed11cf-cc1c-49fc-9473-dd7c087ba2a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1648ffb-5a43-4e48-940e-6fcff8db87e5", "name": "network-vif-plugged", "status": "completed", "tag": "04c15889-79d5-4063-bed9-3d39dc31e7df"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:56:33.853330 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-2f18b906-3a3a-43eb-8c44-979557973157 req-94ed11cf-cc1c-49fc-9473-dd7c087ba2a7 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:33.856926 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-2f18b906-3a3a-43eb-8c44-979557973157 req-94ed11cf-cc1c-49fc-9473-dd7c087ba2a7 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:33.857570 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-2f18b906-3a3a-43eb-8c44-979557973157 req-94ed11cf-cc1c-49fc-9473-dd7c087ba2a7 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:33.881444 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-2f18b906-3a3a-43eb-8c44-979557973157 req-94ed11cf-cc1c-49fc-9473-dd7c087ba2a7 service nova] Creating event network-vif-plugged:04c15889-79d5-4063-bed9-3d39dc31e7df for instance e1648ffb-5a43-4e48-940e-6fcff8db87e5 on n-h2-850468-14 Aug 10 22:56:33.887158 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-2f18b906-3a3a-43eb-8c44-979557973157 req-94ed11cf-cc1c-49fc-9473-dd7c087ba2a7 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087701 Aug 10 22:56:33.888263 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 159/315] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 22:56:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:56:33.897127 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-321f0d6d-ee5e-4ce5-b1d8-686de1835cce tempest-AggregatesAdminNegativeTestJSON-25117975 tempest-AggregatesAdminNegativeTestJSON-25117975-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-850468-14"}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:56:33.900863 n-d-850468-14 devstack@n-api.service[122633]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:56:33.900863 n-d-850468-14 devstack@n-api.service[122633]: warnings.warn(msg) Aug 10 22:56:33.914035 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-321f0d6d-ee5e-4ce5-b1d8-686de1835cce tempest-AggregatesAdminNegativeTestJSON-25117975 tempest-AggregatesAdminNegativeTestJSON-25117975-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:33.915215 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-321f0d6d-ee5e-4ce5-b1d8-686de1835cce tempest-AggregatesAdminNegativeTestJSON-25117975 tempest-AggregatesAdminNegativeTestJSON-25117975-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:33.917728 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-321f0d6d-ee5e-4ce5-b1d8-686de1835cce tempest-AggregatesAdminNegativeTestJSON-25117975 tempest-AggregatesAdminNegativeTestJSON-25117975-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:34.152511 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-321f0d6d-ee5e-4ce5-b1d8-686de1835cce tempest-AggregatesAdminNegativeTestJSON-25117975 tempest-AggregatesAdminNegativeTestJSON-25117975-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 243 microversion: 2.1 time: 0.262468 Aug 10 22:56:34.153543 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 160/316] 10.222.0.58 () {60 vars in 1194 bytes} [Wed Aug 10 22:56:33 2022] POST /compute/v2.1/os-aggregates/11/action => generated 243 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:56:34.163934 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-f5cf073a-64b7-4432-9cb8-efd67cbd7468 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:34.165727 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-f5cf073a-64b7-4432-9cb8-efd67cbd7468 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] [instance: e1648ffb-5a43-4e48-940e-6fcff8db87e5] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:56:34.190740 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f5cf073a-64b7-4432-9cb8-efd67cbd7468 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:34.198065 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f5cf073a-64b7-4432-9cb8-efd67cbd7468 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:34.198520 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f5cf073a-64b7-4432-9cb8-efd67cbd7468 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:34.199482 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f5cf073a-64b7-4432-9cb8-efd67cbd7468 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:34.199941 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f5cf073a-64b7-4432-9cb8-efd67cbd7468 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:34.200362 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f5cf073a-64b7-4432-9cb8-efd67cbd7468 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:34.453302 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-2c2c8dd7-c760-4b2a-8f21-bb889b48e4bc tempest-QuotasAdminNegativeTest-517482210 tempest-QuotasAdminNegativeTest-517482210-project] Flavor limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 22:56:34.454299 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-2c2c8dd7-c760-4b2a-8f21-bb889b48e4bc tempest-QuotasAdminNegativeTest-517482210 tempest-QuotasAdminNegativeTest-517482210-project] Image limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 22:56:34.455109 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-2c2c8dd7-c760-4b2a-8f21-bb889b48e4bc tempest-QuotasAdminNegativeTest-517482210 tempest-QuotasAdminNegativeTest-517482210-project] Flavor pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 22:56:34.455674 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-2c2c8dd7-c760-4b2a-8f21-bb889b48e4bc tempest-QuotasAdminNegativeTest-517482210 tempest-QuotasAdminNegativeTest-517482210-project] Image pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 22:56:34.456385 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-2c2c8dd7-c760-4b2a-8f21-bb889b48e4bc tempest-QuotasAdminNegativeTest-517482210 tempest-QuotasAdminNegativeTest-517482210-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 22:56:34.479043 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2c2c8dd7-c760-4b2a-8f21-bb889b48e4bc tempest-QuotasAdminNegativeTest-517482210 tempest-QuotasAdminNegativeTest-517482210-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:34.479930 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2c2c8dd7-c760-4b2a-8f21-bb889b48e4bc tempest-QuotasAdminNegativeTest-517482210 tempest-QuotasAdminNegativeTest-517482210-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:34.480580 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2c2c8dd7-c760-4b2a-8f21-bb889b48e4bc tempest-QuotasAdminNegativeTest-517482210 tempest-QuotasAdminNegativeTest-517482210-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:34.482032 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2c2c8dd7-c760-4b2a-8f21-bb889b48e4bc tempest-QuotasAdminNegativeTest-517482210 tempest-QuotasAdminNegativeTest-517482210-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:34.482947 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2c2c8dd7-c760-4b2a-8f21-bb889b48e4bc tempest-QuotasAdminNegativeTest-517482210 tempest-QuotasAdminNegativeTest-517482210-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:34.484654 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2c2c8dd7-c760-4b2a-8f21-bb889b48e4bc tempest-QuotasAdminNegativeTest-517482210 tempest-QuotasAdminNegativeTest-517482210-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:34.531768 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-2c2c8dd7-c760-4b2a-8f21-bb889b48e4bc tempest-QuotasAdminNegativeTest-517482210 tempest-QuotasAdminNegativeTest-517482210-project] Getting quotas for project 70cf9c3d3f9d45ce9f7cdee1ff8f4061. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 22:56:34.541049 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-2c2c8dd7-c760-4b2a-8f21-bb889b48e4bc tempest-QuotasAdminNegativeTest-517482210 tempest-QuotasAdminNegativeTest-517482210-project] Getting quotas for user f3db1fe4444a4b6d8fd52820b8cae527 and project 70cf9c3d3f9d45ce9f7cdee1ff8f4061. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 22:56:34.557837 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.utils [None req-2c2c8dd7-c760-4b2a-8f21-bb889b48e4bc tempest-QuotasAdminNegativeTest-517482210 tempest-QuotasAdminNegativeTest-517482210-project] ram quota exceeded for 70cf9c3d3f9d45ce9f7cdee1ff8f4061, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=122632) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Aug 10 22:56:34.558685 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-2c2c8dd7-c760-4b2a-8f21-bb889b48e4bc tempest-QuotasAdminNegativeTest-517482210 tempest-QuotasAdminNegativeTest-517482210-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 10 22:56:34.561935 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-2c2c8dd7-c760-4b2a-8f21-bb889b48e4bc tempest-QuotasAdminNegativeTest-517482210 tempest-QuotasAdminNegativeTest-517482210-project] Request method failure captured: Aug 10 22:56:34.561935 n-d-850468-14 devstack@n-api.service[122632]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 10 22:56:34.561935 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 22:56:34.561935 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 22:56:34.561935 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 22:56:34.561935 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 145 Aug 10 22:56:34.561935 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 22:56:34.561935 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 22:56:34.561935 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 22:56:34.561935 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 22:56:34.561935 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9DeQmJTfvikw7Bg0eUMFOxeHegamNQKW3oLiPyBxXtTXhzKWKgmjCIpIJF9in5wsd8eQhhBPR7h7SR06wYIuNLPWh0WTXgzVeo3LV1N8ON3Q_OgShavIwyBt1CDeW-5sm9RlFNXAb5LFJ80B0rZHeo85YxnPewgrawiln1IAigKK9Fk Aug 10 22:56:34.561935 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 22:56:34.561935 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 22:56:34.561935 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 22:56:34.561935 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 22:56:34.561935 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 22:56:34.561935 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 22:56:34.561935 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 70cf9c3d3f9d45ce9f7cdee1ff8f4061 Aug 10 22:56:34.561935 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-QuotasAdminNegativeTest-517482210 Aug 10 22:56:34.561935 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 22:56:34.561935 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 22:56:34.563499 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/70cf9c3d3f9d45ce9f7cdee1ff8f4061"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/70cf9c3d3f9d45ce9f7cdee1ff8f4061"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/70cf9c3d3f9d45ce9f7cdee1ff8f4061"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_70cf9c3d3f9d45ce9f7cdee1ff8f4061", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 22:56:34.563499 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-QuotasAdminNegativeTest-517482210 Aug 10 22:56:34.563499 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 70cf9c3d3f9d45ce9f7cdee1ff8f4061 Aug 10 22:56:34.563499 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-517482210 Aug 10 22:56:34.563499 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-QuotasAdminNegativeTest-517482210-project Aug 10 22:56:34.563499 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 22:56:34.563499 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 22:56:34.563499 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: f3db1fe4444a4b6d8fd52820b8cae527 Aug 10 22:56:34.563499 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-QuotasAdminNegativeTest-517482210-project Aug 10 22:56:34.563499 n-d-850468-14 devstack@n-api.service[122632]: Aug 10 22:56:34.563499 n-d-850468-14 devstack@n-api.service[122632]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1081208409", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452"}} Aug 10 22:56:34.563499 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 22:56:34.564308 n-d-850468-14 devstack@n-api.service[122632]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 10 22:56:34.564308 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1081208409', 'imageRef': '78ad8905-f66f-4733-8be9-2b260f1fabed', 'flavorRef': '452'}}} Aug 10 22:56:34.564308 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 22:56:34.564308 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:56:34.564308 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Aug 10 22:56:34.564308 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Aug 10 22:56:34.564308 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 10 22:56:34.564308 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 10 22:56:34.564308 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 10 22:56:34.564308 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc Aug 10 22:56:34.564308 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 10 22:56:34.564308 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 10 22:56:34.564308 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 10 22:56:34.564308 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 10 22:56:34.564308 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 10 22:56:34.564308 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 10 22:56:34.564308 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 10 22:56:34.564308 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 10 22:56:34.565289 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Aug 10 22:56:34.565289 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 10 22:56:34.565289 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Aug 10 22:56:34.565289 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:56:34.565289 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:56:34.565289 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:56:34.565289 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:56:34.565289 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 22:56:34.565289 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 22:56:34.565289 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 22:56:34.565289 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 22:56:34.565289 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1678, in _create_instance Aug 10 22:56:34.565289 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Aug 10 22:56:34.565289 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1350, in _provision_instances Aug 10 22:56:34.565289 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Aug 10 22:56:34.565289 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Aug 10 22:56:34.565289 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 10 22:56:34.565289 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 10 22:56:34.565289 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:56:34.565289 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:56:34.565289 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:56:34.566436 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:56:34.566436 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:56:34.566436 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:56:34.566436 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 22:56:34.566436 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 22:56:34.566436 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 22:56:34.566436 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 22:56:34.566436 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 22:56:34.566436 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 22:56:34.566436 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 22:56:34.566436 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 22:56:34.566436 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 22:56:34.566436 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 22:56:34.566436 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 22:56:34.566436 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Aug 10 22:56:34.566436 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 10 22:56:34.566436 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 10 22:56:34.566436 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:56:34.566436 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:56:34.566436 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:56:34.566436 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:56:34.569814 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:56:34.569814 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:56:34.569814 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 22:56:34.569814 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 22:56:34.569814 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 10 22:56:34.569814 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:56:34.572054 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-2c2c8dd7-c760-4b2a-8f21-bb889b48e4bc tempest-QuotasAdminNegativeTest-517482210 tempest-QuotasAdminNegativeTest-517482210-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 22:56:34.573192 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-2c2c8dd7-c760-4b2a-8f21-bb889b48e4bc tempest-QuotasAdminNegativeTest-517482210 tempest-QuotasAdminNegativeTest-517482210-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 1.869163 Aug 10 22:56:34.574320 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 157/317] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 22:56:32 2022] POST /compute/v2.1/servers => generated 110 bytes in 1871 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 10 22:56:34.579878 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-f275d238-5955-4068-b01a-5181456b605f tempest-AggregatesAdminNegativeTestJSON-25117975 tempest-AggregatesAdminNegativeTestJSON-25117975-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-850468-14"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:56:34.583451 n-d-850468-14 devstack@n-api.service[122632]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:56:34.583451 n-d-850468-14 devstack@n-api.service[122632]: warnings.warn(msg) Aug 10 22:56:34.593498 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f275d238-5955-4068-b01a-5181456b605f tempest-AggregatesAdminNegativeTestJSON-25117975 tempest-AggregatesAdminNegativeTestJSON-25117975-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:34.595109 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f275d238-5955-4068-b01a-5181456b605f tempest-AggregatesAdminNegativeTestJSON-25117975 tempest-AggregatesAdminNegativeTestJSON-25117975-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:34.595870 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f275d238-5955-4068-b01a-5181456b605f tempest-AggregatesAdminNegativeTestJSON-25117975 tempest-AggregatesAdminNegativeTestJSON-25117975-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:34.635502 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-f275d238-5955-4068-b01a-5181456b605f tempest-AggregatesAdminNegativeTestJSON-25117975 tempest-AggregatesAdminNegativeTestJSON-25117975-project-admin] HTTP exception thrown: Aggregate 11 already has host n-h1-850468-14. Aug 10 22:56:34.663716 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-f275d238-5955-4068-b01a-5181456b605f tempest-AggregatesAdminNegativeTestJSON-25117975 tempest-AggregatesAdminNegativeTestJSON-25117975-project-admin] Request method failure captured: Aug 10 22:56:34.663716 n-d-850468-14 devstack@n-api.service[122632]: request: POST /compute/v2.1/os-aggregates/11/action HTTP/1.1 Aug 10 22:56:34.663716 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 22:56:34.663716 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 22:56:34.663716 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 22:56:34.663716 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 40 Aug 10 22:56:34.663716 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 22:56:34.663716 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 22:56:34.663716 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 22:56:34.663716 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 22:56:34.663716 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9DefH3X3tmwb1oeFduipNgWv3uBO3Wb0wXTh6ItUKoFVAE_gKQpIVxlgNpPSC1wyNXxGQU5tCP12YDinY57KXzRrgbwnr5zqCUG1FiRI6feKj5CHlZ9YwmMLKMRfW0LX0giJbBH-5OsdHtXNOQRP8hvmXRLN9LXC6Pl393IYZmzf7dY Aug 10 22:56:34.663716 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 22:56:34.663716 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 22:56:34.663716 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 22:56:34.663716 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 22:56:34.663716 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 22:56:34.663716 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 22:56:34.663716 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 66d3db38c8d247acbdd6c2115a3dd394 Aug 10 22:56:34.663716 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-25117975 Aug 10 22:56:34.663716 n-d-850468-14 devstack@n-api.service[122632]: X-Role: admin,member,reader Aug 10 22:56:34.663716 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: admin,member,reader Aug 10 22:56:34.665052 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/66d3db38c8d247acbdd6c2115a3dd394"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/66d3db38c8d247acbdd6c2115a3dd394"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/66d3db38c8d247acbdd6c2115a3dd394"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_66d3db38c8d247acbdd6c2115a3dd394", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 22:56:34.665052 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-25117975 Aug 10 22:56:34.665052 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 66d3db38c8d247acbdd6c2115a3dd394 Aug 10 22:56:34.665052 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-25117975 Aug 10 22:56:34.665052 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-AggregatesAdminNegativeTestJSON-25117975-project-admin Aug 10 22:56:34.665052 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 22:56:34.665052 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 22:56:34.665052 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: 7e02dd5d42b24e5eb6d87cf92262e582 Aug 10 22:56:34.665052 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-25117975-project-admin Aug 10 22:56:34.665052 n-d-850468-14 devstack@n-api.service[122632]: Aug 10 22:56:34.665052 n-d-850468-14 devstack@n-api.service[122632]: {"add_host": {"host": "n-h1-850468-14"}} Aug 10 22:56:34.665052 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 22:56:34.665052 n-d-850468-14 devstack@n-api.service[122632]: exception: Aggregate 11 already has host n-h1-850468-14. Aug 10 22:56:34.665887 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': '11', 'body': {'add_host': {'host': 'n-h1-850468-14'}}} Aug 10 22:56:34.665887 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 22:56:34.665887 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:56:34.665887 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 10 22:56:34.665887 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 10 22:56:34.665887 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 10 22:56:34.665887 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 10 22:56:34.665887 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 10 22:56:34.665887 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 10 22:56:34.665887 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 10 22:56:34.665887 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 10 22:56:34.665887 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 10 22:56:34.665887 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 10 22:56:34.665887 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 10 22:56:34.665887 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi result.read() Aug 10 22:56:34.665887 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 10 22:56:34.665887 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 10 22:56:34.665887 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 10 22:56:34.665887 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 10 22:56:34.666978 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 10 22:56:34.666978 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 10 22:56:34.666978 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 10 22:56:34.666978 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 10 22:56:34.666978 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'n-h1-850468-14-11' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Aug 10 22:56:34.666978 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:56:34.666978 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 10 22:56:34.666978 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:56:34.666978 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:56:34.666978 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Aug 10 22:56:34.666978 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Aug 10 22:56:34.666978 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Aug 10 22:56:34.666978 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi session.flush() Aug 10 22:56:34.666978 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 10 22:56:34.666978 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi self._flush(objects) Aug 10 22:56:34.666978 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 10 22:56:34.666978 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Aug 10 22:56:34.666978 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 10 22:56:34.666978 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi compat.raise_( Aug 10 22:56:34.667980 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 10 22:56:34.667980 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception Aug 10 22:56:34.667980 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 10 22:56:34.667980 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi flush_context.execute() Aug 10 22:56:34.667980 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 10 22:56:34.667980 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi rec.execute(self) Aug 10 22:56:34.667980 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 10 22:56:34.667980 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Aug 10 22:56:34.667980 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 10 22:56:34.667980 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Aug 10 22:56:34.667980 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 10 22:56:34.667980 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Aug 10 22:56:34.667980 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 10 22:56:34.667980 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Aug 10 22:56:34.667980 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 10 22:56:34.667980 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Aug 10 22:56:34.667980 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 10 22:56:34.667980 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Aug 10 22:56:34.670065 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 10 22:56:34.670065 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Aug 10 22:56:34.670065 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 10 22:56:34.670065 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 10 22:56:34.670065 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 10 22:56:34.670065 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception Aug 10 22:56:34.670065 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 10 22:56:34.670065 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 10 22:56:34.670065 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 10 22:56:34.670065 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 10 22:56:34.670065 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 10 22:56:34.670065 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 10 22:56:34.670065 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 10 22:56:34.670065 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 10 22:56:34.670065 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 10 22:56:34.670065 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 10 22:56:34.670065 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 10 22:56:34.670065 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi result.read() Aug 10 22:56:34.672831 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 10 22:56:34.672831 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 10 22:56:34.672831 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 10 22:56:34.672831 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 10 22:56:34.672831 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 10 22:56:34.672831 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 10 22:56:34.672831 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 10 22:56:34.672831 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 10 22:56:34.672831 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'n-h1-850468-14-11' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Aug 10 22:56:34.672831 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Aug 10 22:56:34.672831 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 8, 10, 22, 56, 34, 614399), 'updated_at': None, 'host': 'n-h1-850468-14', 'aggregate_id': 11}] Aug 10 22:56:34.672831 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 10 22:56:34.672831 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:56:34.672831 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:56:34.672831 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:56:34.672831 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:56:34.672831 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Aug 10 22:56:34.675121 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Aug 10 22:56:34.675121 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 10 22:56:34.675121 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 10 22:56:34.675121 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 10 22:56:34.675121 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 10 22:56:34.675121 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 10 22:56:34.675121 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise self.value Aug 10 22:56:34.675121 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 10 22:56:34.675121 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 10 22:56:34.675121 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6607, in add_host_to_aggregate Aug 10 22:56:34.675121 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Aug 10 22:56:34.675121 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 10 22:56:34.675121 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 10 22:56:34.675121 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Aug 10 22:56:34.675121 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Aug 10 22:56:34.675121 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Aug 10 22:56:34.675121 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Aug 10 22:56:34.675121 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 11 already has host n-h1-850468-14. Aug 10 22:56:34.675121 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:56:34.675121 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:56:34.678423 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:56:34.678423 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:56:34.678423 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:56:34.678423 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:56:34.678423 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 22:56:34.678423 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 22:56:34.678423 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 22:56:34.678423 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 22:56:34.678423 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 22:56:34.678423 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 22:56:34.678423 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Aug 10 22:56:34.678423 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Aug 10 22:56:34.678423 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 11 already has host n-h1-850468-14. Aug 10 22:56:34.678423 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:56:34.678423 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:56:34.678423 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:56:34.678423 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:56:34.678423 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:56:34.678423 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:56:34.678423 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 22:56:34.678423 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 22:56:34.681185 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 11 already has host n-h1-850468-14. Aug 10 22:56:34.681185 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:56:34.681185 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-f275d238-5955-4068-b01a-5181456b605f tempest-AggregatesAdminNegativeTestJSON-25117975 tempest-AggregatesAdminNegativeTestJSON-25117975-project-admin] Returning 409 to user: Aggregate 11 already has host n-h1-850468-14. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 22:56:34.681185 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-f275d238-5955-4068-b01a-5181456b605f tempest-AggregatesAdminNegativeTestJSON-25117975 tempest-AggregatesAdminNegativeTestJSON-25117975-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates/11/action" status: 409 len: 97 microversion: 2.1 time: 0.089747 Aug 10 22:56:34.681185 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 158/318] 10.222.0.58 () {60 vars in 1194 bytes} [Wed Aug 10 22:56:34 2022] POST /compute/v2.1/os-aggregates/11/action => generated 97 bytes in 97 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Aug 10 22:56:34.681185 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-7fdd1ebe-ccd0-4211-a777-5afa75ea6a00 tempest-QuotasAdminNegativeTest-1725509051 tempest-QuotasAdminNegativeTest-1725509051-project-admin] Action: 'update', calling method: .version_select at 0x7f847d978a60>, body: {"quota_set": {"ram": 51200}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:56:34.793364 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-f5cf073a-64b7-4432-9cb8-efd67cbd7468 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64648d3c6f5c423e83ff023e7bf6550a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434532ba922f406d8d8c197d3a57ffc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:34.804361 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-f5cf073a-64b7-4432-9cb8-efd67cbd7468 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] 10.222.0.58 "GET /compute/v2.1/servers/e1648ffb-5a43-4e48-940e-6fcff8db87e5" status: 200 len: 1320 microversion: 2.1 time: 0.649490 Aug 10 22:56:34.812188 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 161/319] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:56:34 2022] GET /compute/v2.1/servers/e1648ffb-5a43-4e48-940e-6fcff8db87e5 => generated 1320 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:56:34.823585 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-6ec58b11-3c36-4421-96a3-77184f4be752 tempest-AggregatesAdminNegativeTestJSON-25117975 tempest-AggregatesAdminNegativeTestJSON-25117975-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-850468-14"}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:56:34.827809 n-d-850468-14 devstack@n-api.service[122633]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:56:34.827809 n-d-850468-14 devstack@n-api.service[122633]: warnings.warn(msg) Aug 10 22:56:34.848690 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6ec58b11-3c36-4421-96a3-77184f4be752 tempest-AggregatesAdminNegativeTestJSON-25117975 tempest-AggregatesAdminNegativeTestJSON-25117975-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:34.855113 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6ec58b11-3c36-4421-96a3-77184f4be752 tempest-AggregatesAdminNegativeTestJSON-25117975 tempest-AggregatesAdminNegativeTestJSON-25117975-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:34.855113 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6ec58b11-3c36-4421-96a3-77184f4be752 tempest-AggregatesAdminNegativeTestJSON-25117975 tempest-AggregatesAdminNegativeTestJSON-25117975-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:35.049045 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-6ec58b11-3c36-4421-96a3-77184f4be752 tempest-AggregatesAdminNegativeTestJSON-25117975 tempest-AggregatesAdminNegativeTestJSON-25117975-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 227 microversion: 2.1 time: 0.234313 Aug 10 22:56:35.049700 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 162/320] 10.222.0.58 () {60 vars in 1194 bytes} [Wed Aug 10 22:56:34 2022] POST /compute/v2.1/os-aggregates/11/action => generated 227 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:56:35.068940 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-66ac1e02-f2f4-4aff-ba95-74c50abfd3ac tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:35.070775 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-66ac1e02-f2f4-4aff-ba95-74c50abfd3ac tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 9acba217-4a32-4650-a43e-9d998061323c] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:56:35.090244 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-66ac1e02-f2f4-4aff-ba95-74c50abfd3ac tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:35.091026 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-66ac1e02-f2f4-4aff-ba95-74c50abfd3ac tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:35.091615 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-66ac1e02-f2f4-4aff-ba95-74c50abfd3ac tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:35.092871 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-66ac1e02-f2f4-4aff-ba95-74c50abfd3ac tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:35.093528 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-66ac1e02-f2f4-4aff-ba95-74c50abfd3ac tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:35.094825 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-66ac1e02-f2f4-4aff-ba95-74c50abfd3ac tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:35.144678 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7fdd1ebe-ccd0-4211-a777-5afa75ea6a00 tempest-QuotasAdminNegativeTest-1725509051 tempest-QuotasAdminNegativeTest-1725509051-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:35.145372 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7fdd1ebe-ccd0-4211-a777-5afa75ea6a00 tempest-QuotasAdminNegativeTest-1725509051 tempest-QuotasAdminNegativeTest-1725509051-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:35.145960 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7fdd1ebe-ccd0-4211-a777-5afa75ea6a00 tempest-QuotasAdminNegativeTest-1725509051 tempest-QuotasAdminNegativeTest-1725509051-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:35.148338 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7fdd1ebe-ccd0-4211-a777-5afa75ea6a00 tempest-QuotasAdminNegativeTest-1725509051 tempest-QuotasAdminNegativeTest-1725509051-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:35.149186 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7fdd1ebe-ccd0-4211-a777-5afa75ea6a00 tempest-QuotasAdminNegativeTest-1725509051 tempest-QuotasAdminNegativeTest-1725509051-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:35.149835 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7fdd1ebe-ccd0-4211-a777-5afa75ea6a00 tempest-QuotasAdminNegativeTest-1725509051 tempest-QuotasAdminNegativeTest-1725509051-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:35.225876 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-7fdd1ebe-ccd0-4211-a777-5afa75ea6a00 tempest-QuotasAdminNegativeTest-1725509051 tempest-QuotasAdminNegativeTest-1725509051-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-quota-sets/70cf9c3d3f9d45ce9f7cdee1ff8f4061" status: 200 len: 329 microversion: 2.1 time: 0.552172 Aug 10 22:56:35.236053 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 159/321] 10.222.0.58 () {60 vars in 1262 bytes} [Wed Aug 10 22:56:34 2022] PUT /compute/v2.1/os-quota-sets/70cf9c3d3f9d45ce9f7cdee1ff8f4061 => generated 329 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:56:35.362459 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-3bb480bb-01e9-4865-a50f-c1d24981b840 tempest-InstanceUsageAuditLogTestJSON-638103025 tempest-InstanceUsageAuditLogTestJSON-638103025-project-admin] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:35.363699 n-d-850468-14 devstack@n-api.service[122632]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:56:35.363699 n-d-850468-14 devstack@n-api.service[122632]: warnings.warn(msg) Aug 10 22:56:35.400820 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-3bb480bb-01e9-4865-a50f-c1d24981b840 tempest-InstanceUsageAuditLogTestJSON-638103025 tempest-InstanceUsageAuditLogTestJSON-638103025-project-admin] 10.222.0.58 "GET /compute/v2.1/os-instance_usage_audit_log/2022-08-10 22:56:34" status: 200 len: 318 microversion: 2.1 time: 0.162829 Aug 10 22:56:35.412664 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 160/322] 10.222.0.58 () {58 vars in 1251 bytes} [Wed Aug 10 22:56:35 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-08-10%2022%3A56%3A34 => generated 318 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:56:35.420064 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-e17dd71d-199c-457f-9caf-81602f4b71e2 tempest-AggregatesAdminNegativeTestJSON-25117975 tempest-AggregatesAdminNegativeTestJSON-25117975-project-admin] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:35.421223 n-d-850468-14 devstack@n-api.service[122632]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:56:35.421223 n-d-850468-14 devstack@n-api.service[122632]: warnings.warn(msg) Aug 10 22:56:35.458888 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-e17dd71d-199c-457f-9caf-81602f4b71e2 tempest-AggregatesAdminNegativeTestJSON-25117975 tempest-AggregatesAdminNegativeTestJSON-25117975-project-admin] 10.222.0.58 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.044097 Aug 10 22:56:35.462194 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 161/323] 10.222.0.58 () {58 vars in 1155 bytes} [Wed Aug 10 22:56:35 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 10 22:56:35.474575 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-cfdf1195-80ad-40e1-adb4-8497ba992b41 tempest-QuotasAdminNegativeTest-517482210 tempest-QuotasAdminNegativeTest-517482210-project] Action: 'update', calling method: .version_select at 0x7f847d986790>, body: {"quota_set": {"ram": 0}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:56:35.481902 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-cfdf1195-80ad-40e1-adb4-8497ba992b41 tempest-QuotasAdminNegativeTest-517482210 tempest-QuotasAdminNegativeTest-517482210-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': 'f3db1fe4444a4b6d8fd52820b8cae527', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70cf9c3d3f9d45ce9f7cdee1ff8f4061', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:35.485916 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-cfdf1195-80ad-40e1-adb4-8497ba992b41 tempest-QuotasAdminNegativeTest-517482210 tempest-QuotasAdminNegativeTest-517482210-project] Request method failure captured: Aug 10 22:56:35.485916 n-d-850468-14 devstack@n-api.service[122632]: request: PUT /compute/v2.1/os-quota-sets/70cf9c3d3f9d45ce9f7cdee1ff8f4061 HTTP/1.1 Aug 10 22:56:35.485916 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 22:56:35.485916 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 22:56:35.485916 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 22:56:35.485916 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 25 Aug 10 22:56:35.485916 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 22:56:35.485916 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 22:56:35.485916 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 22:56:35.485916 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 22:56:35.485916 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9DeQmJTfvikw7Bg0eUMFOxeHegamNQKW3oLiPyBxXtTXhzKWKgmjCIpIJF9in5wsd8eQhhBPR7h7SR06wYIuNLPWh0WTXgzVeo3LV1N8ON3Q_OgShavIwyBt1CDeW-5sm9RlFNXAb5LFJ80B0rZHeo85YxnPewgrawiln1IAigKK9Fk Aug 10 22:56:35.485916 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 22:56:35.485916 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 22:56:35.485916 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 22:56:35.485916 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 22:56:35.485916 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 22:56:35.485916 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 22:56:35.485916 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 70cf9c3d3f9d45ce9f7cdee1ff8f4061 Aug 10 22:56:35.485916 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-QuotasAdminNegativeTest-517482210 Aug 10 22:56:35.485916 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 22:56:35.485916 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 22:56:35.487477 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/70cf9c3d3f9d45ce9f7cdee1ff8f4061"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/70cf9c3d3f9d45ce9f7cdee1ff8f4061"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/70cf9c3d3f9d45ce9f7cdee1ff8f4061"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_70cf9c3d3f9d45ce9f7cdee1ff8f4061", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 22:56:35.487477 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-QuotasAdminNegativeTest-517482210 Aug 10 22:56:35.487477 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 70cf9c3d3f9d45ce9f7cdee1ff8f4061 Aug 10 22:56:35.487477 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-517482210 Aug 10 22:56:35.487477 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-QuotasAdminNegativeTest-517482210-project Aug 10 22:56:35.487477 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 22:56:35.487477 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 22:56:35.487477 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: f3db1fe4444a4b6d8fd52820b8cae527 Aug 10 22:56:35.487477 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-QuotasAdminNegativeTest-517482210-project Aug 10 22:56:35.487477 n-d-850468-14 devstack@n-api.service[122632]: Aug 10 22:56:35.487477 n-d-850468-14 devstack@n-api.service[122632]: {"quota_set": {"ram": 0}} Aug 10 22:56:35.487477 n-d-850468-14 devstack@n-api.service[122632]: method: Aug 10 22:56:35.487477 n-d-850468-14 devstack@n-api.service[122632]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Aug 10 22:56:35.487477 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': '70cf9c3d3f9d45ce9f7cdee1ff8f4061', 'body': {'quota_set': {'ram': 0}}} Aug 10 22:56:35.488423 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 22:56:35.488423 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:56:35.488423 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:56:35.488423 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:56:35.488423 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 22:56:35.488423 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 22:56:35.488423 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 22:56:35.488423 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 22:56:35.488423 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 22:56:35.488423 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 22:56:35.488423 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 22:56:35.488423 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 22:56:35.488423 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Aug 10 22:56:35.488423 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Aug 10 22:56:35.488423 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 10 22:56:35.488423 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 22:56:35.488423 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 10 22:56:35.488423 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 22:56:35.488423 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Aug 10 22:56:35.490238 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Aug 10 22:56:35.490238 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 10 22:56:35.490238 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 10 22:56:35.490238 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 10 22:56:35.490238 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 10 22:56:35.490238 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 10 22:56:35.490238 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 10 22:56:35.490238 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 10 22:56:35.490238 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise self.value Aug 10 22:56:35.490238 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 10 22:56:35.490238 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 10 22:56:35.490238 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 10 22:56:35.490238 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 10 22:56:35.490238 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 10 22:56:35.490238 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 10 22:56:35.490238 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Aug 10 22:56:35.490238 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:56:35.490238 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:56:35.490238 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:56:35.490238 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:56:35.491618 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:56:35.491618 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:56:35.491618 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 10 22:56:35.491618 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 10 22:56:35.491618 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Aug 10 22:56:35.491618 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:56:35.494524 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-cfdf1195-80ad-40e1-adb4-8497ba992b41 tempest-QuotasAdminNegativeTest-517482210 tempest-QuotasAdminNegativeTest-517482210-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 22:56:35.495630 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-cfdf1195-80ad-40e1-adb4-8497ba992b41 tempest-QuotasAdminNegativeTest-517482210 tempest-QuotasAdminNegativeTest-517482210-project] 10.222.0.58 "PUT /compute/v2.1/os-quota-sets/70cf9c3d3f9d45ce9f7cdee1ff8f4061" status: 403 len: 116 microversion: 2.1 time: 0.032198 Aug 10 22:56:35.510212 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 162/324] 10.222.0.58 () {60 vars in 1262 bytes} [Wed Aug 10 22:56:35 2022] PUT /compute/v2.1/os-quota-sets/70cf9c3d3f9d45ce9f7cdee1ff8f4061 => generated 116 bytes in 42 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 10 22:56:35.527997 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-57f78653-3a1a-4dad-98ea-faf95bbf7dc9 tempest-InstanceUsageAuditLogTestJSON-638103025 tempest-InstanceUsageAuditLogTestJSON-638103025-project-admin] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:35.531292 n-d-850468-14 devstack@n-api.service[122632]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:56:35.531292 n-d-850468-14 devstack@n-api.service[122632]: warnings.warn(msg) Aug 10 22:56:35.560143 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-57f78653-3a1a-4dad-98ea-faf95bbf7dc9 tempest-InstanceUsageAuditLogTestJSON-638103025 tempest-InstanceUsageAuditLogTestJSON-638103025-project-admin] 10.222.0.58 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.044000 Aug 10 22:56:35.582894 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 163/325] 10.222.0.58 () {58 vars in 1185 bytes} [Wed Aug 10 22:56:35 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:56:35.588302 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-3329ff29-81be-4a8b-88d3-232b7726d903 tempest-AggregatesAdminNegativeTestJSON-25117975 tempest-AggregatesAdminNegativeTestJSON-25117975-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1513328062"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:56:35.590906 n-d-850468-14 devstack@n-api.service[122632]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:56:35.590906 n-d-850468-14 devstack@n-api.service[122632]: warnings.warn(msg) Aug 10 22:56:35.591813 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.objects.aggregate [None req-3329ff29-81be-4a8b-88d3-232b7726d903 tempest-AggregatesAdminNegativeTestJSON-25117975 tempest-AggregatesAdminNegativeTestJSON-25117975-project-admin] Generated uuid 5d210dd7-767a-441e-9dec-9ab257f64a72 for aggregate {{(pid=122632) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 10 22:56:35.629256 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-3329ff29-81be-4a8b-88d3-232b7726d903 tempest-AggregatesAdminNegativeTestJSON-25117975 tempest-AggregatesAdminNegativeTestJSON-25117975-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.044695 Aug 10 22:56:35.631519 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 164/326] 10.222.0.58 () {60 vars in 1164 bytes} [Wed Aug 10 22:56:35 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:56:35.950954 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-66ac1e02-f2f4-4aff-ba95-74c50abfd3ac tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:35.960557 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-66ac1e02-f2f4-4aff-ba95-74c50abfd3ac tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/9acba217-4a32-4650-a43e-9d998061323c" status: 200 len: 1312 microversion: 2.1 time: 0.899937 Aug 10 22:56:35.971862 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 163/327] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:56:35 2022] GET /compute/v2.1/servers/9acba217-4a32-4650-a43e-9d998061323c => generated 1312 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:56:35.977712 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-1f959e32-6eb8-45af-8c8e-e41b3198c18c tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:35.978587 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-1f959e32-6eb8-45af-8c8e-e41b3198c18c tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] [instance: ef725aca-9cd8-49a0-81cd-d23710041306] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:56:36.005646 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1f959e32-6eb8-45af-8c8e-e41b3198c18c tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:36.006566 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1f959e32-6eb8-45af-8c8e-e41b3198c18c tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:36.007403 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1f959e32-6eb8-45af-8c8e-e41b3198c18c tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:36.008304 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1f959e32-6eb8-45af-8c8e-e41b3198c18c tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:36.008928 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1f959e32-6eb8-45af-8c8e-e41b3198c18c tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:36.009793 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1f959e32-6eb8-45af-8c8e-e41b3198c18c tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:36.153997 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-b4ecdf23-9db5-484d-9ba7-7aeee54849c5 tempest-AggregatesAdminNegativeTestJSON-1580251134 tempest-AggregatesAdminNegativeTestJSON-1580251134-project] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-850468-14"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:56:36.157718 n-d-850468-14 devstack@n-api.service[122632]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:56:36.157718 n-d-850468-14 devstack@n-api.service[122632]: warnings.warn(msg) Aug 10 22:56:36.162939 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-b4ecdf23-9db5-484d-9ba7-7aeee54849c5 tempest-AggregatesAdminNegativeTestJSON-1580251134 tempest-AggregatesAdminNegativeTestJSON-1580251134-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': '100383d494d7471484420fd7984af8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54fc98e1ba64668983dede0f2bec2ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:36.164884 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-b4ecdf23-9db5-484d-9ba7-7aeee54849c5 tempest-AggregatesAdminNegativeTestJSON-1580251134 tempest-AggregatesAdminNegativeTestJSON-1580251134-project] Request method failure captured: Aug 10 22:56:36.164884 n-d-850468-14 devstack@n-api.service[122632]: request: POST /compute/v2.1/os-aggregates/12/action HTTP/1.1 Aug 10 22:56:36.164884 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 22:56:36.164884 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 22:56:36.164884 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 22:56:36.164884 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 40 Aug 10 22:56:36.164884 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 22:56:36.164884 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 22:56:36.164884 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 22:56:36.164884 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 22:56:36.164884 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9Dedn6AzAE0pyf1OXcHRuapsup76OT1O_CyNeraLlb487YyoZzWR-4nldg2NNh5p44YzxybGvxMUl5zEl7k1dG5bkscmmfwMwVTA__TEX4hcMVPhEYCd-AADUSQYVDd4M6q5JziL_7R7gLry-BQ32r0ZwrxbZ6cjoDEnyYIqsGiGOsY Aug 10 22:56:36.164884 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 22:56:36.164884 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 22:56:36.164884 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 22:56:36.164884 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 22:56:36.164884 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 22:56:36.164884 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 22:56:36.164884 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: e54fc98e1ba64668983dede0f2bec2ea Aug 10 22:56:36.164884 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1580251134 Aug 10 22:56:36.164884 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 22:56:36.164884 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 22:56:36.166321 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e54fc98e1ba64668983dede0f2bec2ea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e54fc98e1ba64668983dede0f2bec2ea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/e54fc98e1ba64668983dede0f2bec2ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_e54fc98e1ba64668983dede0f2bec2ea", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 22:56:36.166321 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1580251134 Aug 10 22:56:36.166321 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: e54fc98e1ba64668983dede0f2bec2ea Aug 10 22:56:36.166321 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1580251134 Aug 10 22:56:36.166321 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-AggregatesAdminNegativeTestJSON-1580251134-project Aug 10 22:56:36.166321 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 22:56:36.166321 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 22:56:36.166321 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: 100383d494d7471484420fd7984af8d2 Aug 10 22:56:36.166321 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1580251134-project Aug 10 22:56:36.166321 n-d-850468-14 devstack@n-api.service[122632]: Aug 10 22:56:36.166321 n-d-850468-14 devstack@n-api.service[122632]: {"add_host": {"host": "n-h1-850468-14"}} Aug 10 22:56:36.166321 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 22:56:36.166321 n-d-850468-14 devstack@n-api.service[122632]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Aug 10 22:56:36.167193 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': '12', 'body': {'add_host': {'host': 'n-h1-850468-14'}}} Aug 10 22:56:36.167193 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 22:56:36.167193 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:56:36.167193 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:56:36.167193 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:56:36.167193 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 22:56:36.167193 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 22:56:36.167193 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 22:56:36.167193 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 22:56:36.167193 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 22:56:36.167193 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 22:56:36.167193 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Aug 10 22:56:36.167193 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Aug 10 22:56:36.167193 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 10 22:56:36.167193 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 10 22:56:36.167193 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 10 22:56:36.167193 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 10 22:56:36.167193 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 10 22:56:36.167193 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 10 22:56:36.168169 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 10 22:56:36.168169 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise self.value Aug 10 22:56:36.168169 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 10 22:56:36.168169 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 10 22:56:36.168169 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 10 22:56:36.168169 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 10 22:56:36.168169 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 10 22:56:36.168169 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 10 22:56:36.168169 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Aug 10 22:56:36.168169 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:56:36.168169 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:56:36.168169 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:56:36.168169 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:56:36.168169 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:56:36.168169 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:56:36.168169 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 10 22:56:36.168169 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 10 22:56:36.168169 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Aug 10 22:56:36.168169 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:56:36.170337 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-b4ecdf23-9db5-484d-9ba7-7aeee54849c5 tempest-AggregatesAdminNegativeTestJSON-1580251134 tempest-AggregatesAdminNegativeTestJSON-1580251134-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 22:56:36.171904 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-b4ecdf23-9db5-484d-9ba7-7aeee54849c5 tempest-AggregatesAdminNegativeTestJSON-1580251134 tempest-AggregatesAdminNegativeTestJSON-1580251134-project] 10.222.0.58 "POST /compute/v2.1/os-aggregates/12/action" status: 403 len: 118 microversion: 2.1 time: 0.534560 Aug 10 22:56:36.179754 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 165/328] 10.222.0.58 () {60 vars in 1194 bytes} [Wed Aug 10 22:56:35 2022] POST /compute/v2.1/os-aggregates/12/action => generated 118 bytes in 543 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 10 22:56:36.188577 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-b66be31b-4c16-4a6b-9593-b85e752724c2 req-a83f16e3-1630-4053-977b-2ed196ee810a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef725aca-9cd8-49a0-81cd-d23710041306", "tag": "eb7cb764-99eb-4a20-9e31-45d5acb040e2"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:56:36.214390 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-b66be31b-4c16-4a6b-9593-b85e752724c2 req-a83f16e3-1630-4053-977b-2ed196ee810a service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:36.214900 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-b66be31b-4c16-4a6b-9593-b85e752724c2 req-a83f16e3-1630-4053-977b-2ed196ee810a service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:36.215328 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-b66be31b-4c16-4a6b-9593-b85e752724c2 req-a83f16e3-1630-4053-977b-2ed196ee810a service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:36.240738 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-b66be31b-4c16-4a6b-9593-b85e752724c2 req-a83f16e3-1630-4053-977b-2ed196ee810a service nova] Creating event network-changed:eb7cb764-99eb-4a20-9e31-45d5acb040e2 for instance ef725aca-9cd8-49a0-81cd-d23710041306 on n-h1-850468-14 Aug 10 22:56:36.261251 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-b66be31b-4c16-4a6b-9593-b85e752724c2 req-a83f16e3-1630-4053-977b-2ed196ee810a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079870 Aug 10 22:56:36.264160 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 166/329] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 22:56:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:56:36.275377 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-b021b4bf-657b-4840-ac2c-4bbab4013171 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:36.276096 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-b021b4bf-657b-4840-ac2c-4bbab4013171 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] [instance: e1648ffb-5a43-4e48-940e-6fcff8db87e5] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:56:36.285185 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b021b4bf-657b-4840-ac2c-4bbab4013171 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:36.285671 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b021b4bf-657b-4840-ac2c-4bbab4013171 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:36.286108 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b021b4bf-657b-4840-ac2c-4bbab4013171 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:36.286955 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b021b4bf-657b-4840-ac2c-4bbab4013171 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:36.291925 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b021b4bf-657b-4840-ac2c-4bbab4013171 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:36.293398 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b021b4bf-657b-4840-ac2c-4bbab4013171 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:36.546756 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-1f959e32-6eb8-45af-8c8e-e41b3198c18c tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaed2a2e56f749a88c340aaccb15d2d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deaba512051743deb45881d76eb206ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:36.590260 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-1f959e32-6eb8-45af-8c8e-e41b3198c18c tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] 10.222.0.58 "GET /compute/v2.1/servers/ef725aca-9cd8-49a0-81cd-d23710041306" status: 200 len: 1590 microversion: 2.1 time: 0.611925 Aug 10 22:56:36.592378 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 164/330] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:56:35 2022] GET /compute/v2.1/servers/ef725aca-9cd8-49a0-81cd-d23710041306 => generated 1590 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:56:36.605163 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c4eafaa3-556a-42d8-996e-ea85e90b1825 tempest-AggregatesAdminNegativeTestJSON-25117975 tempest-AggregatesAdminNegativeTestJSON-25117975-project-admin] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:36.606420 n-d-850468-14 devstack@n-api.service[122633]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:56:36.606420 n-d-850468-14 devstack@n-api.service[122633]: warnings.warn(msg) Aug 10 22:56:36.655363 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-c4eafaa3-556a-42d8-996e-ea85e90b1825 tempest-AggregatesAdminNegativeTestJSON-25117975 tempest-AggregatesAdminNegativeTestJSON-25117975-project-admin] 10.222.0.58 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.057930 Aug 10 22:56:36.656112 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 165/331] 10.222.0.58 () {58 vars in 1155 bytes} [Wed Aug 10 22:56:36 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 10 22:56:36.672451 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-76e014dc-9d43-405f-8edd-662b88d6cfd5 tempest-AggregatesAdminNegativeTestJSON-25117975 tempest-AggregatesAdminNegativeTestJSON-25117975-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-87116182"}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:56:36.683726 n-d-850468-14 devstack@n-api.service[122633]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:56:36.683726 n-d-850468-14 devstack@n-api.service[122633]: warnings.warn(msg) Aug 10 22:56:36.685061 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.objects.aggregate [None req-76e014dc-9d43-405f-8edd-662b88d6cfd5 tempest-AggregatesAdminNegativeTestJSON-25117975 tempest-AggregatesAdminNegativeTestJSON-25117975-project-admin] Generated uuid d483c689-eff2-47b6-a26d-a42b6c390dea for aggregate {{(pid=122633) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 10 22:56:36.728849 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-76e014dc-9d43-405f-8edd-662b88d6cfd5 tempest-AggregatesAdminNegativeTestJSON-25117975 tempest-AggregatesAdminNegativeTestJSON-25117975-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.063107 Aug 10 22:56:36.731674 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 166/332] 10.222.0.58 () {60 vars in 1164 bytes} [Wed Aug 10 22:56:36 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:56:36.742254 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-0c90a2e6-cdd1-43a2-9381-398b5b404406 tempest-AggregatesAdminNegativeTestJSON-25117975 tempest-AggregatesAdminNegativeTestJSON-25117975-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-1674823099"}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:56:36.746606 n-d-850468-14 devstack@n-api.service[122633]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:56:36.746606 n-d-850468-14 devstack@n-api.service[122633]: warnings.warn(msg) Aug 10 22:56:36.764472 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0c90a2e6-cdd1-43a2-9381-398b5b404406 tempest-AggregatesAdminNegativeTestJSON-25117975 tempest-AggregatesAdminNegativeTestJSON-25117975-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:36.767380 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0c90a2e6-cdd1-43a2-9381-398b5b404406 tempest-AggregatesAdminNegativeTestJSON-25117975 tempest-AggregatesAdminNegativeTestJSON-25117975-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:36.769007 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0c90a2e6-cdd1-43a2-9381-398b5b404406 tempest-AggregatesAdminNegativeTestJSON-25117975 tempest-AggregatesAdminNegativeTestJSON-25117975-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:36.791835 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0c90a2e6-cdd1-43a2-9381-398b5b404406 tempest-AggregatesAdminNegativeTestJSON-25117975 tempest-AggregatesAdminNegativeTestJSON-25117975-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:36.792336 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0c90a2e6-cdd1-43a2-9381-398b5b404406 tempest-AggregatesAdminNegativeTestJSON-25117975 tempest-AggregatesAdminNegativeTestJSON-25117975-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:36.792980 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0c90a2e6-cdd1-43a2-9381-398b5b404406 tempest-AggregatesAdminNegativeTestJSON-25117975 tempest-AggregatesAdminNegativeTestJSON-25117975-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:36.810925 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-0c90a2e6-cdd1-43a2-9381-398b5b404406 tempest-AggregatesAdminNegativeTestJSON-25117975 tempest-AggregatesAdminNegativeTestJSON-25117975-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-1674823099 could not be found. Aug 10 22:56:36.814309 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-0c90a2e6-cdd1-43a2-9381-398b5b404406 tempest-AggregatesAdminNegativeTestJSON-25117975 tempest-AggregatesAdminNegativeTestJSON-25117975-project-admin] Request method failure captured: Aug 10 22:56:36.814309 n-d-850468-14 devstack@n-api.service[122633]: request: POST /compute/v2.1/os-aggregates/13/action HTTP/1.1 Aug 10 22:56:36.814309 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 22:56:36.814309 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 22:56:36.814309 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 22:56:36.814309 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 58 Aug 10 22:56:36.814309 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 22:56:36.814309 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 22:56:36.814309 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 22:56:36.814309 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 22:56:36.814309 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9DefH3X3tmwb1oeFduipNgWv3uBO3Wb0wXTh6ItUKoFVAE_gKQpIVxlgNpPSC1wyNXxGQU5tCP12YDinY57KXzRrgbwnr5zqCUG1FiRI6feKj5CHlZ9YwmMLKMRfW0LX0giJbBH-5OsdHtXNOQRP8hvmXRLN9LXC6Pl393IYZmzf7dY Aug 10 22:56:36.814309 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 22:56:36.814309 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 22:56:36.814309 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 22:56:36.814309 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 22:56:36.814309 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 22:56:36.814309 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 22:56:36.814309 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 66d3db38c8d247acbdd6c2115a3dd394 Aug 10 22:56:36.814309 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-25117975 Aug 10 22:56:36.814309 n-d-850468-14 devstack@n-api.service[122633]: X-Role: admin,member,reader Aug 10 22:56:36.814309 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: admin,member,reader Aug 10 22:56:36.815727 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/66d3db38c8d247acbdd6c2115a3dd394"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/66d3db38c8d247acbdd6c2115a3dd394"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/66d3db38c8d247acbdd6c2115a3dd394"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_66d3db38c8d247acbdd6c2115a3dd394", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 22:56:36.815727 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-25117975 Aug 10 22:56:36.815727 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 66d3db38c8d247acbdd6c2115a3dd394 Aug 10 22:56:36.815727 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-25117975 Aug 10 22:56:36.815727 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-AggregatesAdminNegativeTestJSON-25117975-project-admin Aug 10 22:56:36.815727 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 22:56:36.815727 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 22:56:36.815727 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 7e02dd5d42b24e5eb6d87cf92262e582 Aug 10 22:56:36.815727 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-25117975-project-admin Aug 10 22:56:36.815727 n-d-850468-14 devstack@n-api.service[122633]: Aug 10 22:56:36.815727 n-d-850468-14 devstack@n-api.service[122633]: {"add_host": {"host": "tempest-nonexist_host-1674823099"}} Aug 10 22:56:36.815727 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 22:56:36.815727 n-d-850468-14 devstack@n-api.service[122633]: exception: Compute host tempest-nonexist_host-1674823099 could not be found. Aug 10 22:56:36.816544 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': '13', 'body': {'add_host': {'host': 'tempest-nonexist_host-1674823099'}}} Aug 10 22:56:36.816544 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 22:56:36.816544 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:56:36.816544 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5962, in _get_service_in_cell_by_host Aug 10 22:56:36.816544 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Aug 10 22:56:36.816544 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 10 22:56:36.816544 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 10 22:56:36.816544 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 10 22:56:36.816544 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 10 22:56:36.816544 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 10 22:56:36.816544 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 10 22:56:36.816544 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 10 22:56:36.816544 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 10 22:56:36.816544 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-1674823099' is not mapped to any cell Aug 10 22:56:36.816544 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:56:36.816544 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:56:36.816544 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:56:36.816544 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:56:36.816544 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5968, in _get_service_in_cell_by_host Aug 10 22:56:36.817943 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Aug 10 22:56:36.817943 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6030, in _find_service_in_cell Aug 10 22:56:36.817943 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 10 22:56:36.817943 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 10 22:56:36.817943 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:56:36.817943 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:56:36.817943 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:56:36.817943 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:56:36.817943 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Aug 10 22:56:36.817943 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Aug 10 22:56:36.817943 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 10 22:56:36.817943 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 10 22:56:36.817943 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 10 22:56:36.817943 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 10 22:56:36.817943 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 10 22:56:36.817943 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise self.value Aug 10 22:56:36.817943 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 10 22:56:36.817943 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 10 22:56:36.817943 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6587, in add_host_to_aggregate Aug 10 22:56:36.817943 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Aug 10 22:56:36.819377 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5970, in _get_service_in_cell_by_host Aug 10 22:56:36.819377 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Aug 10 22:56:36.819377 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-1674823099 could not be found. Aug 10 22:56:36.819377 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:56:36.819377 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:56:36.819377 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:56:36.819377 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:56:36.819377 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:56:36.819377 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:56:36.819377 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 22:56:36.819377 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 22:56:36.819377 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 22:56:36.819377 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 22:56:36.819377 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 22:56:36.819377 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 22:56:36.819377 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Aug 10 22:56:36.819377 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 22:56:36.819377 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-1674823099 could not be found. Aug 10 22:56:36.819377 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:56:36.819377 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:56:36.819377 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:56:36.820809 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:56:36.820809 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:56:36.820809 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:56:36.820809 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 22:56:36.820809 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 22:56:36.820809 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-1674823099 could not be found. Aug 10 22:56:36.820809 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:56:36.820809 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-0c90a2e6-cdd1-43a2-9381-398b5b404406 tempest-AggregatesAdminNegativeTestJSON-25117975 tempest-AggregatesAdminNegativeTestJSON-25117975-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-1674823099 could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 22:56:36.820809 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-0c90a2e6-cdd1-43a2-9381-398b5b404406 tempest-AggregatesAdminNegativeTestJSON-25117975 tempest-AggregatesAdminNegativeTestJSON-25117975-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates/13/action" status: 404 len: 111 microversion: 2.1 time: 0.082886 Aug 10 22:56:36.822158 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 167/333] 10.222.0.58 () {60 vars in 1194 bytes} [Wed Aug 10 22:56:36 2022] POST /compute/v2.1/os-aggregates/13/action => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 10 22:56:36.831343 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-61f03d4f-78de-411a-9538-d9979d801774 tempest-AggregatesAdminNegativeTestJSON-25117975 tempest-AggregatesAdminNegativeTestJSON-25117975-project-admin] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:36.833309 n-d-850468-14 devstack@n-api.service[122633]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:56:36.833309 n-d-850468-14 devstack@n-api.service[122633]: warnings.warn(msg) Aug 10 22:56:36.849020 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=5,nova_api:DELETE=3 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:56:36.871789 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-61f03d4f-78de-411a-9538-d9979d801774 tempest-AggregatesAdminNegativeTestJSON-25117975 tempest-AggregatesAdminNegativeTestJSON-25117975-project-admin] 10.222.0.58 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.045561 Aug 10 22:56:36.872643 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 168/334] 10.222.0.58 () {58 vars in 1155 bytes} [Wed Aug 10 22:56:36 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Aug 10 22:56:36.883756 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-a1bdda07-22d6-47ad-8bf7-7732cf169141 tempest-AggregatesAdminNegativeTestJSON-25117975 tempest-AggregatesAdminNegativeTestJSON-25117975-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:56:36.902512 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-a1bdda07-22d6-47ad-8bf7-7732cf169141 tempest-AggregatesAdminNegativeTestJSON-25117975 tempest-AggregatesAdminNegativeTestJSON-25117975-project-admin] Request method failure captured: Aug 10 22:56:36.902512 n-d-850468-14 devstack@n-api.service[122633]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Aug 10 22:56:36.902512 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 22:56:36.902512 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 22:56:36.902512 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 22:56:36.902512 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 283 Aug 10 22:56:36.902512 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 22:56:36.902512 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 22:56:36.902512 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 22:56:36.902512 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 22:56:36.902512 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9DefH3X3tmwb1oeFduipNgWv3uBO3Wb0wXTh6ItUKoFVAE_gKQpIVxlgNpPSC1wyNXxGQU5tCP12YDinY57KXzRrgbwnr5zqCUG1FiRI6feKj5CHlZ9YwmMLKMRfW0LX0giJbBH-5OsdHtXNOQRP8hvmXRLN9LXC6Pl393IYZmzf7dY Aug 10 22:56:36.902512 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 22:56:36.902512 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 22:56:36.902512 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 22:56:36.902512 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 22:56:36.902512 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 22:56:36.902512 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 22:56:36.902512 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 66d3db38c8d247acbdd6c2115a3dd394 Aug 10 22:56:36.902512 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-25117975 Aug 10 22:56:36.902512 n-d-850468-14 devstack@n-api.service[122633]: X-Role: admin,member,reader Aug 10 22:56:36.902512 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: admin,member,reader Aug 10 22:56:36.903920 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/66d3db38c8d247acbdd6c2115a3dd394"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/66d3db38c8d247acbdd6c2115a3dd394"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/66d3db38c8d247acbdd6c2115a3dd394"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_66d3db38c8d247acbdd6c2115a3dd394", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 22:56:36.903920 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-25117975 Aug 10 22:56:36.903920 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 66d3db38c8d247acbdd6c2115a3dd394 Aug 10 22:56:36.903920 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-25117975 Aug 10 22:56:36.903920 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-AggregatesAdminNegativeTestJSON-25117975-project-admin Aug 10 22:56:36.903920 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 22:56:36.903920 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 22:56:36.903920 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 7e02dd5d42b24e5eb6d87cf92262e582 Aug 10 22:56:36.903920 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-25117975-project-admin Aug 10 22:56:36.903920 n-d-850468-14 devstack@n-api.service[122633]: Aug 10 22:56:36.903920 n-d-850468-14 devstack@n-api.service[122633]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Aug 10 22:56:36.904600 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 22:56:36.904600 n-d-850468-14 devstack@n-api.service[122633]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 10 22:56:36.904600 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Aug 10 22:56:36.904600 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 22:56:36.904600 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:56:36.904600 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 10 22:56:36.904600 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 10 22:56:36.904600 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 10 22:56:36.904600 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise error Aug 10 22:56:36.904600 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 10 22:56:36.904600 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:56:36.906375 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Aug 10 22:56:36.906375 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 10 22:56:36.906375 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:56:36.906375 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Aug 10 22:56:36.906375 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 10 22:56:36.906375 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:56:36.906375 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:56:36.906375 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:56:36.906375 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:56:36.906375 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:56:36.906375 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:56:36.906375 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 22:56:36.906375 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 22:56:36.906375 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 22:56:36.906375 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 22:56:36.906375 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 22:56:36.906375 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 22:56:36.906375 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 10 22:56:36.906375 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 10 22:56:36.907894 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 10 22:56:36.907894 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 10 22:56:36.907894 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 10 22:56:36.907894 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 10 22:56:36.907894 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 10 22:56:36.907894 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:56:36.907894 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:56:36.907894 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:56:36.907894 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:56:36.907894 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:56:36.907894 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:56:36.907894 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 10 22:56:36.907894 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 10 22:56:36.908775 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 10 22:56:36.908775 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:56:36.911941 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-a1bdda07-22d6-47ad-8bf7-7732cf169141 tempest-AggregatesAdminNegativeTestJSON-25117975 tempest-AggregatesAdminNegativeTestJSON-25117975-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 22:56:36.915226 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-a1bdda07-22d6-47ad-8bf7-7732cf169141 tempest-AggregatesAdminNegativeTestJSON-25117975 tempest-AggregatesAdminNegativeTestJSON-25117975-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.035985 Aug 10 22:56:36.932220 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 169/335] 10.222.0.58 () {60 vars in 1165 bytes} [Wed Aug 10 22:56:36 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 50 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 10 22:56:36.949418 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-eb968b82-2446-4657-89e9-7b089d1744c0 tempest-AggregatesAdminNegativeTestJSON-25117975 tempest-AggregatesAdminNegativeTestJSON-25117975-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:56:36.960338 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-eb968b82-2446-4657-89e9-7b089d1744c0 tempest-AggregatesAdminNegativeTestJSON-25117975 tempest-AggregatesAdminNegativeTestJSON-25117975-project-admin] Request method failure captured: Aug 10 22:56:36.960338 n-d-850468-14 devstack@n-api.service[122633]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Aug 10 22:56:36.960338 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 22:56:36.960338 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 22:56:36.960338 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 22:56:36.960338 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 27 Aug 10 22:56:36.960338 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 22:56:36.960338 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 22:56:36.960338 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 22:56:36.960338 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 22:56:36.960338 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9DefH3X3tmwb1oeFduipNgWv3uBO3Wb0wXTh6ItUKoFVAE_gKQpIVxlgNpPSC1wyNXxGQU5tCP12YDinY57KXzRrgbwnr5zqCUG1FiRI6feKj5CHlZ9YwmMLKMRfW0LX0giJbBH-5OsdHtXNOQRP8hvmXRLN9LXC6Pl393IYZmzf7dY Aug 10 22:56:36.960338 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 22:56:36.960338 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 22:56:36.960338 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 22:56:36.960338 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 22:56:36.960338 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 22:56:36.960338 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 22:56:36.960338 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 66d3db38c8d247acbdd6c2115a3dd394 Aug 10 22:56:36.960338 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-25117975 Aug 10 22:56:36.960338 n-d-850468-14 devstack@n-api.service[122633]: X-Role: admin,member,reader Aug 10 22:56:36.960338 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: admin,member,reader Aug 10 22:56:36.962129 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/66d3db38c8d247acbdd6c2115a3dd394"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/66d3db38c8d247acbdd6c2115a3dd394"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/66d3db38c8d247acbdd6c2115a3dd394"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_66d3db38c8d247acbdd6c2115a3dd394", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 22:56:36.962129 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-25117975 Aug 10 22:56:36.962129 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 66d3db38c8d247acbdd6c2115a3dd394 Aug 10 22:56:36.962129 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-25117975 Aug 10 22:56:36.962129 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-AggregatesAdminNegativeTestJSON-25117975-project-admin Aug 10 22:56:36.962129 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 22:56:36.962129 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 22:56:36.962129 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 7e02dd5d42b24e5eb6d87cf92262e582 Aug 10 22:56:36.962129 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-25117975-project-admin Aug 10 22:56:36.962129 n-d-850468-14 devstack@n-api.service[122633]: Aug 10 22:56:36.962129 n-d-850468-14 devstack@n-api.service[122633]: {"aggregate": {"name": ""}} Aug 10 22:56:36.962129 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 22:56:36.962129 n-d-850468-14 devstack@n-api.service[122633]: exception: Invalid input for field/attribute name. Value: . '' is too short Aug 10 22:56:36.962912 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'body': {'aggregate': {'name': ''}}} Aug 10 22:56:36.962912 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 22:56:36.962912 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:56:36.962912 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 10 22:56:36.962912 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 10 22:56:36.962912 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 10 22:56:36.962912 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise error Aug 10 22:56:36.962912 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 10 22:56:36.962912 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:56:36.962912 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Aug 10 22:56:36.962912 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 10 22:56:36.962912 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:56:36.962912 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Aug 10 22:56:36.962912 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi '' Aug 10 22:56:36.962912 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:56:36.962912 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:56:36.962912 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:56:36.962912 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:56:36.962912 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:56:36.962912 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:56:36.962912 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 22:56:36.962912 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 22:56:36.962912 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 22:56:36.964389 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 22:56:36.964389 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 22:56:36.964389 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 22:56:36.964389 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 10 22:56:36.964389 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 10 22:56:36.964389 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 10 22:56:36.964389 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 10 22:56:36.964389 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 10 22:56:36.964389 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 10 22:56:36.964389 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Aug 10 22:56:36.964389 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:56:36.964389 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:56:36.964389 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:56:36.964389 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:56:36.964389 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:56:36.964389 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:56:36.964389 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 10 22:56:36.964389 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 10 22:56:36.964389 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Aug 10 22:56:36.964389 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:56:36.965618 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-eb968b82-2446-4657-89e9-7b089d1744c0 tempest-AggregatesAdminNegativeTestJSON-25117975 tempest-AggregatesAdminNegativeTestJSON-25117975-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 22:56:36.965618 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-eb968b82-2446-4657-89e9-7b089d1744c0 tempest-AggregatesAdminNegativeTestJSON-25117975 tempest-AggregatesAdminNegativeTestJSON-25117975-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.030349 Aug 10 22:56:36.966225 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 170/336] 10.222.0.58 () {60 vars in 1164 bytes} [Wed Aug 10 22:56:36 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 10 22:56:36.986094 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-e898732a-4118-472e-bc2f-6b57aaca97a7 tempest-AggregatesAdminNegativeTestJSON-1580251134 tempest-AggregatesAdminNegativeTestJSON-1580251134-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1025038967"}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:56:36.993081 n-d-850468-14 devstack@n-api.service[122633]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:56:36.993081 n-d-850468-14 devstack@n-api.service[122633]: warnings.warn(msg) Aug 10 22:56:37.000661 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-e898732a-4118-472e-bc2f-6b57aaca97a7 tempest-AggregatesAdminNegativeTestJSON-1580251134 tempest-AggregatesAdminNegativeTestJSON-1580251134-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': '100383d494d7471484420fd7984af8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54fc98e1ba64668983dede0f2bec2ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:37.002371 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-e898732a-4118-472e-bc2f-6b57aaca97a7 tempest-AggregatesAdminNegativeTestJSON-1580251134 tempest-AggregatesAdminNegativeTestJSON-1580251134-project] Request method failure captured: Aug 10 22:56:37.002371 n-d-850468-14 devstack@n-api.service[122633]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Aug 10 22:56:37.002371 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 22:56:37.002371 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 22:56:37.002371 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 22:56:37.002371 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 60 Aug 10 22:56:37.002371 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 22:56:37.002371 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 22:56:37.002371 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 22:56:37.002371 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 22:56:37.002371 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9Dedn6AzAE0pyf1OXcHRuapsup76OT1O_CyNeraLlb487YyoZzWR-4nldg2NNh5p44YzxybGvxMUl5zEl7k1dG5bkscmmfwMwVTA__TEX4hcMVPhEYCd-AADUSQYVDd4M6q5JziL_7R7gLry-BQ32r0ZwrxbZ6cjoDEnyYIqsGiGOsY Aug 10 22:56:37.002371 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 22:56:37.002371 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 22:56:37.002371 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 22:56:37.002371 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 22:56:37.002371 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 22:56:37.002371 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 22:56:37.002371 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: e54fc98e1ba64668983dede0f2bec2ea Aug 10 22:56:37.002371 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1580251134 Aug 10 22:56:37.002371 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 22:56:37.002371 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 22:56:37.003674 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e54fc98e1ba64668983dede0f2bec2ea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e54fc98e1ba64668983dede0f2bec2ea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/e54fc98e1ba64668983dede0f2bec2ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_e54fc98e1ba64668983dede0f2bec2ea", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 22:56:37.003674 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1580251134 Aug 10 22:56:37.003674 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: e54fc98e1ba64668983dede0f2bec2ea Aug 10 22:56:37.003674 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1580251134 Aug 10 22:56:37.003674 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-AggregatesAdminNegativeTestJSON-1580251134-project Aug 10 22:56:37.003674 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 22:56:37.003674 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 22:56:37.003674 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 100383d494d7471484420fd7984af8d2 Aug 10 22:56:37.003674 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1580251134-project Aug 10 22:56:37.003674 n-d-850468-14 devstack@n-api.service[122633]: Aug 10 22:56:37.003674 n-d-850468-14 devstack@n-api.service[122633]: {"aggregate": {"name": "tempest-test_aggregate-1025038967"}} Aug 10 22:56:37.003674 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 22:56:37.003674 n-d-850468-14 devstack@n-api.service[122633]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Aug 10 22:56:37.004361 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1025038967'}}} Aug 10 22:56:37.004361 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 22:56:37.004361 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:56:37.004361 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:56:37.004361 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:56:37.004361 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 22:56:37.004361 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 22:56:37.004361 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 22:56:37.004361 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 22:56:37.004361 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 22:56:37.004361 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 22:56:37.004361 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 22:56:37.004361 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 22:56:37.004361 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Aug 10 22:56:37.004361 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Aug 10 22:56:37.004361 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 10 22:56:37.004361 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 10 22:56:37.004361 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 10 22:56:37.004361 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 10 22:56:37.005349 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 10 22:56:37.005349 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 10 22:56:37.005349 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 10 22:56:37.005349 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise self.value Aug 10 22:56:37.005349 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 10 22:56:37.005349 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 10 22:56:37.005349 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 10 22:56:37.005349 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 10 22:56:37.005349 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 10 22:56:37.005349 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 10 22:56:37.005349 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Aug 10 22:56:37.005349 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:56:37.005349 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:56:37.005349 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:56:37.005349 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:56:37.005349 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:56:37.005349 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:56:37.005349 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 10 22:56:37.005349 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 10 22:56:37.005349 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Aug 10 22:56:37.006564 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:56:37.007382 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-e898732a-4118-472e-bc2f-6b57aaca97a7 tempest-AggregatesAdminNegativeTestJSON-1580251134 tempest-AggregatesAdminNegativeTestJSON-1580251134-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 22:56:37.009147 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-e898732a-4118-472e-bc2f-6b57aaca97a7 tempest-AggregatesAdminNegativeTestJSON-1580251134 tempest-AggregatesAdminNegativeTestJSON-1580251134-project] 10.222.0.58 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.034817 Aug 10 22:56:37.016913 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 171/337] 10.222.0.58 () {60 vars in 1164 bytes} [Wed Aug 10 22:56:36 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 44 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 10 22:56:37.024704 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-9a2561f6-2ee5-4cb7-9794-31735d12bd47 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:37.025857 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-9a2561f6-2ee5-4cb7-9794-31735d12bd47 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 9acba217-4a32-4650-a43e-9d998061323c] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:56:37.034097 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9a2561f6-2ee5-4cb7-9794-31735d12bd47 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:37.035385 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9a2561f6-2ee5-4cb7-9794-31735d12bd47 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:37.035981 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9a2561f6-2ee5-4cb7-9794-31735d12bd47 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:37.036866 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9a2561f6-2ee5-4cb7-9794-31735d12bd47 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:37.038106 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9a2561f6-2ee5-4cb7-9794-31735d12bd47 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:37.038809 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9a2561f6-2ee5-4cb7-9794-31735d12bd47 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:37.178095 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-b021b4bf-657b-4840-ac2c-4bbab4013171 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64648d3c6f5c423e83ff023e7bf6550a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434532ba922f406d8d8c197d3a57ffc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:37.191359 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-b021b4bf-657b-4840-ac2c-4bbab4013171 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] 10.222.0.58 "GET /compute/v2.1/servers/e1648ffb-5a43-4e48-940e-6fcff8db87e5" status: 200 len: 1469 microversion: 2.1 time: 0.923118 Aug 10 22:56:37.206813 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 167/338] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:56:36 2022] GET /compute/v2.1/servers/e1648ffb-5a43-4e48-940e-6fcff8db87e5 => generated 1469 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:56:37.206813 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-96ed67c2-eafb-46d1-8754-f8ce3c1edb3f tempest-AggregatesAdminNegativeTestJSON-25117975 tempest-AggregatesAdminNegativeTestJSON-25117975-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1689823324"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:56:37.212014 n-d-850468-14 devstack@n-api.service[122632]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:56:37.212014 n-d-850468-14 devstack@n-api.service[122632]: warnings.warn(msg) Aug 10 22:56:37.214567 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.objects.aggregate [None req-96ed67c2-eafb-46d1-8754-f8ce3c1edb3f tempest-AggregatesAdminNegativeTestJSON-25117975 tempest-AggregatesAdminNegativeTestJSON-25117975-project-admin] Generated uuid acb2a9e8-1012-4f3b-aeef-f6edb79d8b8f for aggregate {{(pid=122632) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 10 22:56:37.256739 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-96ed67c2-eafb-46d1-8754-f8ce3c1edb3f tempest-AggregatesAdminNegativeTestJSON-25117975 tempest-AggregatesAdminNegativeTestJSON-25117975-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.060086 Aug 10 22:56:37.263666 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 168/339] 10.222.0.58 () {60 vars in 1164 bytes} [Wed Aug 10 22:56:37 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:56:37.275990 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-b6a8e300-9df4-4f4b-888f-c6d23140139e tempest-DeleteServersAdminTestJSON-541057853 tempest-DeleteServersAdminTestJSON-541057853-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:56:37.280086 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-b6a8e300-9df4-4f4b-888f-c6d23140139e tempest-DeleteServersAdminTestJSON-541057853 tempest-DeleteServersAdminTestJSON-541057853-project-admin] [instance: e1648ffb-5a43-4e48-940e-6fcff8db87e5] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:56:37.289080 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b6a8e300-9df4-4f4b-888f-c6d23140139e tempest-DeleteServersAdminTestJSON-541057853 tempest-DeleteServersAdminTestJSON-541057853-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:37.290652 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b6a8e300-9df4-4f4b-888f-c6d23140139e tempest-DeleteServersAdminTestJSON-541057853 tempest-DeleteServersAdminTestJSON-541057853-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:37.291290 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b6a8e300-9df4-4f4b-888f-c6d23140139e tempest-DeleteServersAdminTestJSON-541057853 tempest-DeleteServersAdminTestJSON-541057853-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:37.292733 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b6a8e300-9df4-4f4b-888f-c6d23140139e tempest-DeleteServersAdminTestJSON-541057853 tempest-DeleteServersAdminTestJSON-541057853-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:37.293339 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b6a8e300-9df4-4f4b-888f-c6d23140139e tempest-DeleteServersAdminTestJSON-541057853 tempest-DeleteServersAdminTestJSON-541057853-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:37.293918 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b6a8e300-9df4-4f4b-888f-c6d23140139e tempest-DeleteServersAdminTestJSON-541057853 tempest-DeleteServersAdminTestJSON-541057853-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:37.473204 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-b6a8e300-9df4-4f4b-888f-c6d23140139e tempest-DeleteServersAdminTestJSON-541057853 tempest-DeleteServersAdminTestJSON-541057853-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/e1648ffb-5a43-4e48-940e-6fcff8db87e5/action" status: 202 len: 0 microversion: 2.1 time: 0.208240 Aug 10 22:56:37.475621 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 169/340] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 22:56:37 2022] POST /compute/v2.1/servers/e1648ffb-5a43-4e48-940e-6fcff8db87e5/action => generated 0 bytes in 211 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 22:56:37.481519 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-09068fea-44df-4744-852d-1da618ca912c tempest-AggregatesAdminNegativeTestJSON-25117975 tempest-AggregatesAdminNegativeTestJSON-25117975-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1689823324"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:56:37.487164 n-d-850468-14 devstack@n-api.service[122632]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:56:37.487164 n-d-850468-14 devstack@n-api.service[122632]: warnings.warn(msg) Aug 10 22:56:37.488713 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.objects.aggregate [None req-09068fea-44df-4744-852d-1da618ca912c tempest-AggregatesAdminNegativeTestJSON-25117975 tempest-AggregatesAdminNegativeTestJSON-25117975-project-admin] Generated uuid 12ee5f42-fe27-40a2-bb0e-d9241ff34c8b for aggregate {{(pid=122632) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 10 22:56:37.529900 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-09068fea-44df-4744-852d-1da618ca912c tempest-AggregatesAdminNegativeTestJSON-25117975 tempest-AggregatesAdminNegativeTestJSON-25117975-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-1689823324 already exists. Aug 10 22:56:37.532486 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-09068fea-44df-4744-852d-1da618ca912c tempest-AggregatesAdminNegativeTestJSON-25117975 tempest-AggregatesAdminNegativeTestJSON-25117975-project-admin] Request method failure captured: Aug 10 22:56:37.532486 n-d-850468-14 devstack@n-api.service[122632]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Aug 10 22:56:37.532486 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 22:56:37.532486 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 22:56:37.532486 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 22:56:37.532486 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 60 Aug 10 22:56:37.532486 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 22:56:37.532486 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 22:56:37.532486 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 22:56:37.532486 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 22:56:37.532486 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9DefH3X3tmwb1oeFduipNgWv3uBO3Wb0wXTh6ItUKoFVAE_gKQpIVxlgNpPSC1wyNXxGQU5tCP12YDinY57KXzRrgbwnr5zqCUG1FiRI6feKj5CHlZ9YwmMLKMRfW0LX0giJbBH-5OsdHtXNOQRP8hvmXRLN9LXC6Pl393IYZmzf7dY Aug 10 22:56:37.532486 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 22:56:37.532486 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 22:56:37.532486 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 22:56:37.532486 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 22:56:37.532486 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 22:56:37.532486 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 22:56:37.532486 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 66d3db38c8d247acbdd6c2115a3dd394 Aug 10 22:56:37.532486 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-25117975 Aug 10 22:56:37.532486 n-d-850468-14 devstack@n-api.service[122632]: X-Role: admin,member,reader Aug 10 22:56:37.532486 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: admin,member,reader Aug 10 22:56:37.533918 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/66d3db38c8d247acbdd6c2115a3dd394"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/66d3db38c8d247acbdd6c2115a3dd394"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/66d3db38c8d247acbdd6c2115a3dd394"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_66d3db38c8d247acbdd6c2115a3dd394", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 22:56:37.533918 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-25117975 Aug 10 22:56:37.533918 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 66d3db38c8d247acbdd6c2115a3dd394 Aug 10 22:56:37.533918 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-25117975 Aug 10 22:56:37.533918 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-AggregatesAdminNegativeTestJSON-25117975-project-admin Aug 10 22:56:37.533918 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 22:56:37.533918 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 22:56:37.533918 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: 7e02dd5d42b24e5eb6d87cf92262e582 Aug 10 22:56:37.533918 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-25117975-project-admin Aug 10 22:56:37.533918 n-d-850468-14 devstack@n-api.service[122632]: Aug 10 22:56:37.533918 n-d-850468-14 devstack@n-api.service[122632]: {"aggregate": {"name": "tempest-test_aggregate-1689823324"}} Aug 10 22:56:37.533918 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 22:56:37.533918 n-d-850468-14 devstack@n-api.service[122632]: exception: Aggregate tempest-test_aggregate-1689823324 already exists. Aug 10 22:56:37.538623 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1689823324'}}} Aug 10 22:56:37.538623 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 22:56:37.538623 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:56:37.538623 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Aug 10 22:56:37.538623 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Aug 10 22:56:37.538623 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 10 22:56:37.538623 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 10 22:56:37.538623 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 10 22:56:37.538623 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 10 22:56:37.538623 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 10 22:56:37.538623 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise self.value Aug 10 22:56:37.538623 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 10 22:56:37.538623 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 10 22:56:37.538623 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6424, in create_aggregate Aug 10 22:56:37.538623 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi aggregate.create() Aug 10 22:56:37.538623 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 10 22:56:37.538623 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 10 22:56:37.538623 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Aug 10 22:56:37.538623 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Aug 10 22:56:37.540138 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 10 22:56:37.540138 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 10 22:56:37.540138 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Aug 10 22:56:37.540138 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Aug 10 22:56:37.540138 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-1689823324 already exists. Aug 10 22:56:37.540138 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:56:37.540138 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:56:37.540138 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:56:37.540138 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:56:37.540138 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:56:37.540138 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:56:37.540138 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 22:56:37.540138 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 22:56:37.540138 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 22:56:37.540138 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 22:56:37.540138 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 22:56:37.540138 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 22:56:37.540138 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 22:56:37.540138 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 22:56:37.540138 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Aug 10 22:56:37.541371 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Aug 10 22:56:37.541371 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-1689823324 already exists. Aug 10 22:56:37.541371 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:56:37.541371 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:56:37.541371 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:56:37.541371 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:56:37.541371 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:56:37.541371 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:56:37.541371 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 22:56:37.541371 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 22:56:37.541371 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-1689823324 already exists. Aug 10 22:56:37.541371 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:56:37.541371 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-09068fea-44df-4744-852d-1da618ca912c tempest-AggregatesAdminNegativeTestJSON-25117975 tempest-AggregatesAdminNegativeTestJSON-25117975-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-1689823324 already exists. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 22:56:37.541371 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-09068fea-44df-4744-852d-1da618ca912c tempest-AggregatesAdminNegativeTestJSON-25117975 tempest-AggregatesAdminNegativeTestJSON-25117975-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates" status: 409 len: 111 microversion: 2.1 time: 0.056970 Aug 10 22:56:37.542377 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 170/341] 10.222.0.58 () {60 vars in 1164 bytes} [Wed Aug 10 22:56:37 2022] POST /compute/v2.1/os-aggregates => generated 111 bytes in 62 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 10 22:56:37.543660 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-9e80b956-ac18-44ee-8e01-41b8b7d3c186 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:37.544351 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-9e80b956-ac18-44ee-8e01-41b8b7d3c186 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] [instance: e1648ffb-5a43-4e48-940e-6fcff8db87e5] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:56:37.557522 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9e80b956-ac18-44ee-8e01-41b8b7d3c186 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:37.558009 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9e80b956-ac18-44ee-8e01-41b8b7d3c186 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:37.558656 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9e80b956-ac18-44ee-8e01-41b8b7d3c186 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:37.559860 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9e80b956-ac18-44ee-8e01-41b8b7d3c186 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:37.560896 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9e80b956-ac18-44ee-8e01-41b8b7d3c186 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:37.562227 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9e80b956-ac18-44ee-8e01-41b8b7d3c186 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:37.611051 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9e80b956-ac18-44ee-8e01-41b8b7d3c186 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:37.611834 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9e80b956-ac18-44ee-8e01-41b8b7d3c186 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:37.612674 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9e80b956-ac18-44ee-8e01-41b8b7d3c186 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:37.613292 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.objects.instance [None req-9e80b956-ac18-44ee-8e01-41b8b7d3c186 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Lazy-loading 'fault' on Instance uuid e1648ffb-5a43-4e48-940e-6fcff8db87e5 {{(pid=122632) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 22:56:37.706583 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-9a2561f6-2ee5-4cb7-9794-31735d12bd47 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:37.714224 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-9a2561f6-2ee5-4cb7-9794-31735d12bd47 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/9acba217-4a32-4650-a43e-9d998061323c" status: 200 len: 1312 microversion: 2.1 time: 0.694955 Aug 10 22:56:37.714742 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 172/342] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:56:37 2022] GET /compute/v2.1/servers/9acba217-4a32-4650-a43e-9d998061323c => generated 1312 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:56:37.728208 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-60e5f351-ede2-4454-afbb-1d07bb271ef6 tempest-AggregatesAdminNegativeTestJSON-25117975 tempest-AggregatesAdminNegativeTestJSON-25117975-project-admin] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:37.728901 n-d-850468-14 devstack@n-api.service[122633]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:56:37.728901 n-d-850468-14 devstack@n-api.service[122633]: warnings.warn(msg) Aug 10 22:56:37.795893 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-60e5f351-ede2-4454-afbb-1d07bb271ef6 tempest-AggregatesAdminNegativeTestJSON-25117975 tempest-AggregatesAdminNegativeTestJSON-25117975-project-admin] 10.222.0.58 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.079975 Aug 10 22:56:37.798542 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 173/343] 10.222.0.58 () {58 vars in 1155 bytes} [Wed Aug 10 22:56:37 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 10 22:56:37.809528 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-8df4e757-8c3e-4410-a916-cfd6793abfa7 tempest-AggregatesAdminNegativeTestJSON-25117975 tempest-AggregatesAdminNegativeTestJSON-25117975-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1709279479"}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:56:37.824147 n-d-850468-14 devstack@n-api.service[122633]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:56:37.824147 n-d-850468-14 devstack@n-api.service[122633]: warnings.warn(msg) Aug 10 22:56:37.828801 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.objects.aggregate [None req-8df4e757-8c3e-4410-a916-cfd6793abfa7 tempest-AggregatesAdminNegativeTestJSON-25117975 tempest-AggregatesAdminNegativeTestJSON-25117975-project-admin] Generated uuid cd16a0fe-a5bb-4bff-9b74-2f47f4a0ed3d for aggregate {{(pid=122633) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 10 22:56:37.892676 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-8df4e757-8c3e-4410-a916-cfd6793abfa7 tempest-AggregatesAdminNegativeTestJSON-25117975 tempest-AggregatesAdminNegativeTestJSON-25117975-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.086514 Aug 10 22:56:37.900879 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 174/344] 10.222.0.58 () {60 vars in 1164 bytes} [Wed Aug 10 22:56:37 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:56:37.907271 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-e904fd3d-de66-4313-9aea-97f3c2141f15 tempest-AggregatesAdminNegativeTestJSON-1580251134 tempest-AggregatesAdminNegativeTestJSON-1580251134-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:37.908172 n-d-850468-14 devstack@n-api.service[122633]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:56:37.908172 n-d-850468-14 devstack@n-api.service[122633]: warnings.warn(msg) Aug 10 22:56:37.910749 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-e904fd3d-de66-4313-9aea-97f3c2141f15 tempest-AggregatesAdminNegativeTestJSON-1580251134 tempest-AggregatesAdminNegativeTestJSON-1580251134-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': '100383d494d7471484420fd7984af8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54fc98e1ba64668983dede0f2bec2ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:37.938714 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-e904fd3d-de66-4313-9aea-97f3c2141f15 tempest-AggregatesAdminNegativeTestJSON-1580251134 tempest-AggregatesAdminNegativeTestJSON-1580251134-project] Request method failure captured: Aug 10 22:56:37.938714 n-d-850468-14 devstack@n-api.service[122633]: request: DELETE /compute/v2.1/os-aggregates/15 HTTP/1.1 Aug 10 22:56:37.938714 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 22:56:37.938714 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 22:56:37.938714 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 22:56:37.938714 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 22:56:37.938714 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 22:56:37.938714 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 22:56:37.938714 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 22:56:37.938714 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 22:56:37.938714 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9Dedn6AzAE0pyf1OXcHRuapsup76OT1O_CyNeraLlb487YyoZzWR-4nldg2NNh5p44YzxybGvxMUl5zEl7k1dG5bkscmmfwMwVTA__TEX4hcMVPhEYCd-AADUSQYVDd4M6q5JziL_7R7gLry-BQ32r0ZwrxbZ6cjoDEnyYIqsGiGOsY Aug 10 22:56:37.938714 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 22:56:37.938714 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 22:56:37.938714 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 22:56:37.938714 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 22:56:37.938714 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 22:56:37.938714 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 22:56:37.938714 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: e54fc98e1ba64668983dede0f2bec2ea Aug 10 22:56:37.938714 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1580251134 Aug 10 22:56:37.938714 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 22:56:37.938714 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 22:56:37.940173 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e54fc98e1ba64668983dede0f2bec2ea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e54fc98e1ba64668983dede0f2bec2ea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/e54fc98e1ba64668983dede0f2bec2ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_e54fc98e1ba64668983dede0f2bec2ea", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 22:56:37.940173 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1580251134 Aug 10 22:56:37.940173 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: e54fc98e1ba64668983dede0f2bec2ea Aug 10 22:56:37.940173 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1580251134 Aug 10 22:56:37.940173 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-AggregatesAdminNegativeTestJSON-1580251134-project Aug 10 22:56:37.940173 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 22:56:37.940173 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 22:56:37.940173 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 100383d494d7471484420fd7984af8d2 Aug 10 22:56:37.940173 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1580251134-project Aug 10 22:56:37.940173 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 22:56:37.940173 n-d-850468-14 devstack@n-api.service[122633]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Aug 10 22:56:37.940173 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': '15'} Aug 10 22:56:37.940949 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 22:56:37.940949 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:56:37.940949 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:56:37.940949 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:56:37.940949 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 22:56:37.940949 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 22:56:37.940949 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 22:56:37.940949 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 22:56:37.940949 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Aug 10 22:56:37.940949 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Aug 10 22:56:37.940949 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 10 22:56:37.940949 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 10 22:56:37.940949 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 10 22:56:37.940949 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 10 22:56:37.940949 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 10 22:56:37.940949 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 10 22:56:37.940949 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 10 22:56:37.940949 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise self.value Aug 10 22:56:37.940949 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 10 22:56:37.942829 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 10 22:56:37.942829 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 10 22:56:37.942829 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 10 22:56:37.942829 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 10 22:56:37.942829 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 10 22:56:37.942829 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Aug 10 22:56:37.942829 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:56:37.942829 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:56:37.942829 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:56:37.942829 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:56:37.942829 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:56:37.942829 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:56:37.942829 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 10 22:56:37.942829 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 10 22:56:37.942829 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Aug 10 22:56:37.942829 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:56:37.945703 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-e904fd3d-de66-4313-9aea-97f3c2141f15 tempest-AggregatesAdminNegativeTestJSON-1580251134 tempest-AggregatesAdminNegativeTestJSON-1580251134-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 22:56:37.946767 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-e904fd3d-de66-4313-9aea-97f3c2141f15 tempest-AggregatesAdminNegativeTestJSON-1580251134 tempest-AggregatesAdminNegativeTestJSON-1580251134-project] 10.222.0.58 "DELETE /compute/v2.1/os-aggregates/15" status: 403 len: 116 microversion: 2.1 time: 0.044824 Aug 10 22:56:37.950764 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 175/345] 10.222.0.58 () {58 vars in 1155 bytes} [Wed Aug 10 22:56:37 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 116 bytes in 46 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 10 22:56:37.960261 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-be0d0208-ea28-4054-afac-55d8526d7188 tempest-AggregatesAdminNegativeTestJSON-25117975 tempest-AggregatesAdminNegativeTestJSON-25117975-project-admin] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:38.012032 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-be0d0208-ea28-4054-afac-55d8526d7188 tempest-AggregatesAdminNegativeTestJSON-25117975 tempest-AggregatesAdminNegativeTestJSON-25117975-project-admin] 10.222.0.58 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.057706 Aug 10 22:56:38.020065 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 176/346] 10.222.0.58 () {58 vars in 1155 bytes} [Wed Aug 10 22:56:37 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 10 22:56:38.032119 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-328bc6ca-a292-4458-8e3e-606a644e6b2b tempest-AggregatesAdminNegativeTestJSON-25117975 tempest-AggregatesAdminNegativeTestJSON-25117975-project-admin] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:38.032893 n-d-850468-14 devstack@n-api.service[122633]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:56:38.032893 n-d-850468-14 devstack@n-api.service[122633]: warnings.warn(msg) Aug 10 22:56:38.052267 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-328bc6ca-a292-4458-8e3e-606a644e6b2b tempest-AggregatesAdminNegativeTestJSON-25117975 tempest-AggregatesAdminNegativeTestJSON-25117975-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Aug 10 22:56:38.054075 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-328bc6ca-a292-4458-8e3e-606a644e6b2b tempest-AggregatesAdminNegativeTestJSON-25117975 tempest-AggregatesAdminNegativeTestJSON-25117975-project-admin] Request method failure captured: Aug 10 22:56:38.054075 n-d-850468-14 devstack@n-api.service[122633]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Aug 10 22:56:38.054075 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 22:56:38.054075 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 22:56:38.054075 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 22:56:38.054075 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 22:56:38.054075 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 22:56:38.054075 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 22:56:38.054075 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 22:56:38.054075 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 22:56:38.054075 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9DefH3X3tmwb1oeFduipNgWv3uBO3Wb0wXTh6ItUKoFVAE_gKQpIVxlgNpPSC1wyNXxGQU5tCP12YDinY57KXzRrgbwnr5zqCUG1FiRI6feKj5CHlZ9YwmMLKMRfW0LX0giJbBH-5OsdHtXNOQRP8hvmXRLN9LXC6Pl393IYZmzf7dY Aug 10 22:56:38.054075 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 22:56:38.054075 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 22:56:38.054075 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 22:56:38.054075 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 22:56:38.054075 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 22:56:38.054075 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 22:56:38.054075 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 66d3db38c8d247acbdd6c2115a3dd394 Aug 10 22:56:38.054075 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-25117975 Aug 10 22:56:38.054075 n-d-850468-14 devstack@n-api.service[122633]: X-Role: admin,member,reader Aug 10 22:56:38.054075 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: admin,member,reader Aug 10 22:56:38.055578 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/66d3db38c8d247acbdd6c2115a3dd394"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/66d3db38c8d247acbdd6c2115a3dd394"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/66d3db38c8d247acbdd6c2115a3dd394"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_66d3db38c8d247acbdd6c2115a3dd394", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 22:56:38.055578 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-25117975 Aug 10 22:56:38.055578 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 66d3db38c8d247acbdd6c2115a3dd394 Aug 10 22:56:38.055578 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-25117975 Aug 10 22:56:38.055578 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-AggregatesAdminNegativeTestJSON-25117975-project-admin Aug 10 22:56:38.055578 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 22:56:38.055578 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 22:56:38.055578 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 7e02dd5d42b24e5eb6d87cf92262e582 Aug 10 22:56:38.055578 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-25117975-project-admin Aug 10 22:56:38.055578 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 22:56:38.055578 n-d-850468-14 devstack@n-api.service[122633]: exception: Aggregate -1 could not be found. Aug 10 22:56:38.055578 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': '-1'} Aug 10 22:56:38.056383 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 22:56:38.056383 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:56:38.056383 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Aug 10 22:56:38.056383 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Aug 10 22:56:38.056383 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 10 22:56:38.056383 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 10 22:56:38.056383 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 10 22:56:38.056383 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 10 22:56:38.056383 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 10 22:56:38.056383 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise self.value Aug 10 22:56:38.056383 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 10 22:56:38.056383 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 10 22:56:38.056383 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6483, in delete_aggregate Aug 10 22:56:38.056383 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Aug 10 22:56:38.056383 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 10 22:56:38.056383 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 10 22:56:38.056383 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 10 22:56:38.056383 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 10 22:56:38.056383 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 10 22:56:38.057607 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 10 22:56:38.057607 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 10 22:56:38.057607 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 10 22:56:38.057607 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Aug 10 22:56:38.057607 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:56:38.057607 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:56:38.057607 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:56:38.057607 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:56:38.057607 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:56:38.057607 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:56:38.057607 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 22:56:38.057607 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 22:56:38.057607 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 22:56:38.057607 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 22:56:38.057607 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Aug 10 22:56:38.057607 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 22:56:38.057607 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Aug 10 22:56:38.057607 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:56:38.057607 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:56:38.057607 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:56:38.057607 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:56:38.060469 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:56:38.060469 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:56:38.060469 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 22:56:38.060469 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 22:56:38.060469 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Aug 10 22:56:38.060469 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:56:38.060469 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-328bc6ca-a292-4458-8e3e-606a644e6b2b tempest-AggregatesAdminNegativeTestJSON-25117975 tempest-AggregatesAdminNegativeTestJSON-25117975-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 22:56:38.060469 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-328bc6ca-a292-4458-8e3e-606a644e6b2b tempest-AggregatesAdminNegativeTestJSON-25117975 tempest-AggregatesAdminNegativeTestJSON-25117975-project-admin] 10.222.0.58 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.034933 Aug 10 22:56:38.064407 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 177/347] 10.222.0.58 () {58 vars in 1155 bytes} [Wed Aug 10 22:56:38 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 10 22:56:38.072012 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c02fe304-9011-4f24-adf7-193e8745d767 tempest-AggregatesAdminNegativeTestJSON-25117975 tempest-AggregatesAdminNegativeTestJSON-25117975-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-730152677"}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:56:38.077691 n-d-850468-14 devstack@n-api.service[122633]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:56:38.077691 n-d-850468-14 devstack@n-api.service[122633]: warnings.warn(msg) Aug 10 22:56:38.081450 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.objects.aggregate [None req-c02fe304-9011-4f24-adf7-193e8745d767 tempest-AggregatesAdminNegativeTestJSON-25117975 tempest-AggregatesAdminNegativeTestJSON-25117975-project-admin] Generated uuid 3aa996d1-bef9-49ed-9ee7-961289f7e04d for aggregate {{(pid=122633) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 10 22:56:38.117994 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-c02fe304-9011-4f24-adf7-193e8745d767 tempest-AggregatesAdminNegativeTestJSON-25117975 tempest-AggregatesAdminNegativeTestJSON-25117975-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.052244 Aug 10 22:56:38.127304 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 178/348] 10.222.0.58 () {60 vars in 1164 bytes} [Wed Aug 10 22:56:38 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:56:38.132826 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-2c6afae9-f2a0-4551-8262-b873494ff0f6 tempest-AggregatesAdminNegativeTestJSON-1580251134 tempest-AggregatesAdminNegativeTestJSON-1580251134-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:38.133817 n-d-850468-14 devstack@n-api.service[122633]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:56:38.133817 n-d-850468-14 devstack@n-api.service[122633]: warnings.warn(msg) Aug 10 22:56:38.136015 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-2c6afae9-f2a0-4551-8262-b873494ff0f6 tempest-AggregatesAdminNegativeTestJSON-1580251134 tempest-AggregatesAdminNegativeTestJSON-1580251134-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': '100383d494d7471484420fd7984af8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54fc98e1ba64668983dede0f2bec2ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:38.145311 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-2c6afae9-f2a0-4551-8262-b873494ff0f6 tempest-AggregatesAdminNegativeTestJSON-1580251134 tempest-AggregatesAdminNegativeTestJSON-1580251134-project] Request method failure captured: Aug 10 22:56:38.145311 n-d-850468-14 devstack@n-api.service[122633]: request: GET /compute/v2.1/os-aggregates/16 HTTP/1.1 Aug 10 22:56:38.145311 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 22:56:38.145311 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 22:56:38.145311 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 22:56:38.145311 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 22:56:38.145311 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 22:56:38.145311 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 22:56:38.145311 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 22:56:38.145311 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 22:56:38.145311 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9Dedn6AzAE0pyf1OXcHRuapsup76OT1O_CyNeraLlb487YyoZzWR-4nldg2NNh5p44YzxybGvxMUl5zEl7k1dG5bkscmmfwMwVTA__TEX4hcMVPhEYCd-AADUSQYVDd4M6q5JziL_7R7gLry-BQ32r0ZwrxbZ6cjoDEnyYIqsGiGOsY Aug 10 22:56:38.145311 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 22:56:38.145311 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 22:56:38.145311 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 22:56:38.145311 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 22:56:38.145311 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 22:56:38.145311 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 22:56:38.145311 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: e54fc98e1ba64668983dede0f2bec2ea Aug 10 22:56:38.145311 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1580251134 Aug 10 22:56:38.145311 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 22:56:38.145311 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 22:56:38.146734 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e54fc98e1ba64668983dede0f2bec2ea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e54fc98e1ba64668983dede0f2bec2ea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/e54fc98e1ba64668983dede0f2bec2ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_e54fc98e1ba64668983dede0f2bec2ea", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 22:56:38.146734 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1580251134 Aug 10 22:56:38.146734 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: e54fc98e1ba64668983dede0f2bec2ea Aug 10 22:56:38.146734 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1580251134 Aug 10 22:56:38.146734 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-AggregatesAdminNegativeTestJSON-1580251134-project Aug 10 22:56:38.146734 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 22:56:38.146734 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 22:56:38.146734 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 100383d494d7471484420fd7984af8d2 Aug 10 22:56:38.146734 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1580251134-project Aug 10 22:56:38.146734 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 22:56:38.146734 n-d-850468-14 devstack@n-api.service[122633]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Aug 10 22:56:38.146734 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': '16'} Aug 10 22:56:38.148170 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 22:56:38.148170 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:56:38.148170 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:56:38.148170 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:56:38.148170 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 22:56:38.148170 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 22:56:38.148170 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 22:56:38.148170 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 22:56:38.148170 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Aug 10 22:56:38.148170 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Aug 10 22:56:38.148170 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 10 22:56:38.148170 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 10 22:56:38.148170 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 10 22:56:38.148170 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 10 22:56:38.148170 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 10 22:56:38.148170 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 10 22:56:38.148170 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 10 22:56:38.148170 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise self.value Aug 10 22:56:38.148170 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 10 22:56:38.149425 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 10 22:56:38.149425 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 10 22:56:38.149425 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 10 22:56:38.149425 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 10 22:56:38.149425 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 10 22:56:38.149425 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Aug 10 22:56:38.149425 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:56:38.149425 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:56:38.149425 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:56:38.149425 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:56:38.149425 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:56:38.149425 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:56:38.149425 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 10 22:56:38.149425 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 10 22:56:38.149425 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Aug 10 22:56:38.149425 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:56:38.153615 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-2c6afae9-f2a0-4551-8262-b873494ff0f6 tempest-AggregatesAdminNegativeTestJSON-1580251134 tempest-AggregatesAdminNegativeTestJSON-1580251134-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 22:56:38.155588 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-2c6afae9-f2a0-4551-8262-b873494ff0f6 tempest-AggregatesAdminNegativeTestJSON-1580251134 tempest-AggregatesAdminNegativeTestJSON-1580251134-project] 10.222.0.58 "GET /compute/v2.1/os-aggregates/16" status: 403 len: 114 microversion: 2.1 time: 0.026087 Aug 10 22:56:38.161435 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 179/349] 10.222.0.58 () {58 vars in 1152 bytes} [Wed Aug 10 22:56:38 2022] GET /compute/v2.1/os-aggregates/16 => generated 114 bytes in 33 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 10 22:56:38.169298 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-3bc808f9-3371-4f49-81c1-e3740f915eef tempest-AggregatesAdminNegativeTestJSON-25117975 tempest-AggregatesAdminNegativeTestJSON-25117975-project-admin] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:38.172473 n-d-850468-14 devstack@n-api.service[122633]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:56:38.172473 n-d-850468-14 devstack@n-api.service[122633]: warnings.warn(msg) Aug 10 22:56:38.215039 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-3bc808f9-3371-4f49-81c1-e3740f915eef tempest-AggregatesAdminNegativeTestJSON-25117975 tempest-AggregatesAdminNegativeTestJSON-25117975-project-admin] 10.222.0.58 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.051654 Aug 10 22:56:38.221680 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 180/350] 10.222.0.58 () {58 vars in 1155 bytes} [Wed Aug 10 22:56:38 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 10 22:56:38.227382 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-f179985c-4cae-4159-bcb3-f01d837ee4ae tempest-AggregatesAdminNegativeTestJSON-25117975 tempest-AggregatesAdminNegativeTestJSON-25117975-project-admin] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:38.228357 n-d-850468-14 devstack@n-api.service[122633]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:56:38.228357 n-d-850468-14 devstack@n-api.service[122633]: warnings.warn(msg) Aug 10 22:56:38.247476 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-f179985c-4cae-4159-bcb3-f01d837ee4ae tempest-AggregatesAdminNegativeTestJSON-25117975 tempest-AggregatesAdminNegativeTestJSON-25117975-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Aug 10 22:56:38.249874 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-f179985c-4cae-4159-bcb3-f01d837ee4ae tempest-AggregatesAdminNegativeTestJSON-25117975 tempest-AggregatesAdminNegativeTestJSON-25117975-project-admin] Request method failure captured: Aug 10 22:56:38.249874 n-d-850468-14 devstack@n-api.service[122633]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Aug 10 22:56:38.249874 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 22:56:38.249874 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 22:56:38.249874 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 22:56:38.249874 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 22:56:38.249874 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 22:56:38.249874 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 22:56:38.249874 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 22:56:38.249874 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 22:56:38.249874 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9DefH3X3tmwb1oeFduipNgWv3uBO3Wb0wXTh6ItUKoFVAE_gKQpIVxlgNpPSC1wyNXxGQU5tCP12YDinY57KXzRrgbwnr5zqCUG1FiRI6feKj5CHlZ9YwmMLKMRfW0LX0giJbBH-5OsdHtXNOQRP8hvmXRLN9LXC6Pl393IYZmzf7dY Aug 10 22:56:38.249874 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 22:56:38.249874 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 22:56:38.249874 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 22:56:38.249874 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 22:56:38.249874 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 22:56:38.249874 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 22:56:38.249874 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 66d3db38c8d247acbdd6c2115a3dd394 Aug 10 22:56:38.249874 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-25117975 Aug 10 22:56:38.249874 n-d-850468-14 devstack@n-api.service[122633]: X-Role: admin,member,reader Aug 10 22:56:38.249874 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: admin,member,reader Aug 10 22:56:38.251249 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/66d3db38c8d247acbdd6c2115a3dd394"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/66d3db38c8d247acbdd6c2115a3dd394"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/66d3db38c8d247acbdd6c2115a3dd394"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_66d3db38c8d247acbdd6c2115a3dd394", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 22:56:38.251249 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-25117975 Aug 10 22:56:38.251249 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 66d3db38c8d247acbdd6c2115a3dd394 Aug 10 22:56:38.251249 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-25117975 Aug 10 22:56:38.251249 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-AggregatesAdminNegativeTestJSON-25117975-project-admin Aug 10 22:56:38.251249 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 22:56:38.251249 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 22:56:38.251249 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 7e02dd5d42b24e5eb6d87cf92262e582 Aug 10 22:56:38.251249 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-25117975-project-admin Aug 10 22:56:38.251249 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 22:56:38.251249 n-d-850468-14 devstack@n-api.service[122633]: exception: Aggregate -1 could not be found. Aug 10 22:56:38.251249 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': '-1'} Aug 10 22:56:38.252015 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 22:56:38.252015 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:56:38.252015 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Aug 10 22:56:38.252015 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Aug 10 22:56:38.252015 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6430, in get_aggregate Aug 10 22:56:38.252015 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Aug 10 22:56:38.252015 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 10 22:56:38.252015 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 10 22:56:38.252015 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 10 22:56:38.252015 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 10 22:56:38.252015 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 10 22:56:38.252015 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 10 22:56:38.252015 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 10 22:56:38.252015 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 10 22:56:38.252015 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Aug 10 22:56:38.252015 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:56:38.252015 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:56:38.252015 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:56:38.252015 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:56:38.252015 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:56:38.253337 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:56:38.253337 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 22:56:38.253337 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 22:56:38.253337 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 22:56:38.253337 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 22:56:38.253337 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Aug 10 22:56:38.253337 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 22:56:38.253337 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Aug 10 22:56:38.253337 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:56:38.253337 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:56:38.253337 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:56:38.253337 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:56:38.253337 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:56:38.253337 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:56:38.253337 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 22:56:38.253337 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 22:56:38.253337 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Aug 10 22:56:38.253337 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:56:38.256118 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-f179985c-4cae-4159-bcb3-f01d837ee4ae tempest-AggregatesAdminNegativeTestJSON-25117975 tempest-AggregatesAdminNegativeTestJSON-25117975-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 22:56:38.257928 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-f179985c-4cae-4159-bcb3-f01d837ee4ae tempest-AggregatesAdminNegativeTestJSON-25117975 tempest-AggregatesAdminNegativeTestJSON-25117975-project-admin] 10.222.0.58 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.034206 Aug 10 22:56:38.258986 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 181/351] 10.222.0.58 () {58 vars in 1152 bytes} [Wed Aug 10 22:56:38 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 10 22:56:38.276865 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-05b21005-d99a-423e-b2e1-ba1fd0344342 tempest-AggregatesAdminNegativeTestJSON-1580251134 tempest-AggregatesAdminNegativeTestJSON-1580251134-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:38.279591 n-d-850468-14 devstack@n-api.service[122633]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:56:38.279591 n-d-850468-14 devstack@n-api.service[122633]: warnings.warn(msg) Aug 10 22:56:38.279822 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-9e80b956-ac18-44ee-8e01-41b8b7d3c186 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64648d3c6f5c423e83ff023e7bf6550a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434532ba922f406d8d8c197d3a57ffc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:38.282107 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-05b21005-d99a-423e-b2e1-ba1fd0344342 tempest-AggregatesAdminNegativeTestJSON-1580251134 tempest-AggregatesAdminNegativeTestJSON-1580251134-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': '100383d494d7471484420fd7984af8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54fc98e1ba64668983dede0f2bec2ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:38.283930 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-05b21005-d99a-423e-b2e1-ba1fd0344342 tempest-AggregatesAdminNegativeTestJSON-1580251134 tempest-AggregatesAdminNegativeTestJSON-1580251134-project] Request method failure captured: Aug 10 22:56:38.283930 n-d-850468-14 devstack@n-api.service[122633]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Aug 10 22:56:38.283930 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 22:56:38.283930 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 22:56:38.283930 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 22:56:38.283930 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 22:56:38.283930 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 22:56:38.283930 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 22:56:38.283930 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 22:56:38.283930 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 22:56:38.283930 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9Dedn6AzAE0pyf1OXcHRuapsup76OT1O_CyNeraLlb487YyoZzWR-4nldg2NNh5p44YzxybGvxMUl5zEl7k1dG5bkscmmfwMwVTA__TEX4hcMVPhEYCd-AADUSQYVDd4M6q5JziL_7R7gLry-BQ32r0ZwrxbZ6cjoDEnyYIqsGiGOsY Aug 10 22:56:38.283930 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 22:56:38.283930 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 22:56:38.283930 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 22:56:38.283930 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 22:56:38.283930 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 22:56:38.283930 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 22:56:38.283930 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: e54fc98e1ba64668983dede0f2bec2ea Aug 10 22:56:38.283930 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1580251134 Aug 10 22:56:38.283930 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 22:56:38.283930 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 22:56:38.285296 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e54fc98e1ba64668983dede0f2bec2ea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e54fc98e1ba64668983dede0f2bec2ea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/e54fc98e1ba64668983dede0f2bec2ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_e54fc98e1ba64668983dede0f2bec2ea", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 22:56:38.285296 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1580251134 Aug 10 22:56:38.285296 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: e54fc98e1ba64668983dede0f2bec2ea Aug 10 22:56:38.285296 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1580251134 Aug 10 22:56:38.285296 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-AggregatesAdminNegativeTestJSON-1580251134-project Aug 10 22:56:38.285296 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 22:56:38.285296 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 22:56:38.285296 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 100383d494d7471484420fd7984af8d2 Aug 10 22:56:38.285296 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1580251134-project Aug 10 22:56:38.285296 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 22:56:38.285296 n-d-850468-14 devstack@n-api.service[122633]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Aug 10 22:56:38.285296 n-d-850468-14 devstack@n-api.service[122633]: action_args: {} Aug 10 22:56:38.286219 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 22:56:38.286219 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:56:38.286219 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:56:38.286219 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:56:38.286219 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 22:56:38.286219 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 22:56:38.286219 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 22:56:38.286219 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 22:56:38.286219 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Aug 10 22:56:38.286219 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Aug 10 22:56:38.286219 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 10 22:56:38.286219 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 10 22:56:38.286219 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 10 22:56:38.286219 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 10 22:56:38.286219 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 10 22:56:38.286219 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 10 22:56:38.286219 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 10 22:56:38.286219 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise self.value Aug 10 22:56:38.286219 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 10 22:56:38.288057 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 10 22:56:38.288057 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 10 22:56:38.288057 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 10 22:56:38.288057 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 10 22:56:38.288057 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 10 22:56:38.288057 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Aug 10 22:56:38.288057 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:56:38.288057 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:56:38.288057 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:56:38.288057 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:56:38.288057 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:56:38.288057 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:56:38.288057 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 10 22:56:38.288057 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 10 22:56:38.288057 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Aug 10 22:56:38.288057 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:56:38.291712 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-05b21005-d99a-423e-b2e1-ba1fd0344342 tempest-AggregatesAdminNegativeTestJSON-1580251134 tempest-AggregatesAdminNegativeTestJSON-1580251134-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 22:56:38.292567 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-9e80b956-ac18-44ee-8e01-41b8b7d3c186 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] 10.222.0.58 "GET /compute/v2.1/servers/e1648ffb-5a43-4e48-940e-6fcff8db87e5" status: 200 len: 1452 microversion: 2.1 time: 0.752300 Aug 10 22:56:38.292976 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-05b21005-d99a-423e-b2e1-ba1fd0344342 tempest-AggregatesAdminNegativeTestJSON-1580251134 tempest-AggregatesAdminNegativeTestJSON-1580251134-project] 10.222.0.58 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.025705 Aug 10 22:56:38.293651 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 171/352] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:56:37 2022] GET /compute/v2.1/servers/e1648ffb-5a43-4e48-940e-6fcff8db87e5 => generated 1452 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:56:38.302998 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 182/353] 10.222.0.58 () {58 vars in 1143 bytes} [Wed Aug 10 22:56:38 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 38 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 10 22:56:38.317117 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-087af771-db69-49d5-907a-637eb0a3ffca tempest-AggregatesAdminNegativeTestJSON-25117975 tempest-AggregatesAdminNegativeTestJSON-25117975-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1739461565"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:56:38.329882 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-5ab313d8-8694-486f-bf46-f6609f74bc3a tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:38.330388 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-5ab313d8-8694-486f-bf46-f6609f74bc3a tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] [instance: e1648ffb-5a43-4e48-940e-6fcff8db87e5] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:56:38.332953 n-d-850468-14 devstack@n-api.service[122632]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:56:38.332953 n-d-850468-14 devstack@n-api.service[122632]: warnings.warn(msg) Aug 10 22:56:38.333973 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.objects.aggregate [None req-087af771-db69-49d5-907a-637eb0a3ffca tempest-AggregatesAdminNegativeTestJSON-25117975 tempest-AggregatesAdminNegativeTestJSON-25117975-project-admin] Generated uuid e97f413c-7eef-4dd3-a6d5-fc42290ea957 for aggregate {{(pid=122632) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 10 22:56:38.355307 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5ab313d8-8694-486f-bf46-f6609f74bc3a tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:38.355802 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5ab313d8-8694-486f-bf46-f6609f74bc3a tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:38.356237 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5ab313d8-8694-486f-bf46-f6609f74bc3a tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:38.356958 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5ab313d8-8694-486f-bf46-f6609f74bc3a tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:38.357402 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5ab313d8-8694-486f-bf46-f6609f74bc3a tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:38.357820 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5ab313d8-8694-486f-bf46-f6609f74bc3a tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:38.400136 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-087af771-db69-49d5-907a-637eb0a3ffca tempest-AggregatesAdminNegativeTestJSON-25117975 tempest-AggregatesAdminNegativeTestJSON-25117975-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.093181 Aug 10 22:56:38.402037 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 172/354] 10.222.0.58 () {60 vars in 1164 bytes} [Wed Aug 10 22:56:38 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:56:38.418528 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-831a73af-c8e9-46da-ac61-16075ae6e160 tempest-AggregatesAdminNegativeTestJSON-25117975 tempest-AggregatesAdminNegativeTestJSON-25117975-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-850468-14"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:56:38.421878 n-d-850468-14 devstack@n-api.service[122632]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:56:38.421878 n-d-850468-14 devstack@n-api.service[122632]: warnings.warn(msg) Aug 10 22:56:38.445743 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-5ab313d8-8694-486f-bf46-f6609f74bc3a tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] [instance: e1648ffb-5a43-4e48-940e-6fcff8db87e5] Going to try to terminate instance {{(pid=122633) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 22:56:38.450693 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-831a73af-c8e9-46da-ac61-16075ae6e160 tempest-AggregatesAdminNegativeTestJSON-25117975 tempest-AggregatesAdminNegativeTestJSON-25117975-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:38.451213 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-831a73af-c8e9-46da-ac61-16075ae6e160 tempest-AggregatesAdminNegativeTestJSON-25117975 tempest-AggregatesAdminNegativeTestJSON-25117975-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:38.451638 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-831a73af-c8e9-46da-ac61-16075ae6e160 tempest-AggregatesAdminNegativeTestJSON-25117975 tempest-AggregatesAdminNegativeTestJSON-25117975-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:38.698189 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-831a73af-c8e9-46da-ac61-16075ae6e160 tempest-AggregatesAdminNegativeTestJSON-25117975 tempest-AggregatesAdminNegativeTestJSON-25117975-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 244 microversion: 2.1 time: 0.289756 Aug 10 22:56:38.699047 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 173/355] 10.222.0.58 () {60 vars in 1194 bytes} [Wed Aug 10 22:56:38 2022] POST /compute/v2.1/os-aggregates/17/action => generated 244 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 22:56:38.715744 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-77a646f2-40bb-4980-a92e-50e264ef681f tempest-AggregatesAdminNegativeTestJSON-1580251134 tempest-AggregatesAdminNegativeTestJSON-1580251134-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-850468-14"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:56:38.723965 n-d-850468-14 devstack@n-api.service[122632]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:56:38.723965 n-d-850468-14 devstack@n-api.service[122632]: warnings.warn(msg) Aug 10 22:56:38.727282 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-77a646f2-40bb-4980-a92e-50e264ef681f tempest-AggregatesAdminNegativeTestJSON-1580251134 tempest-AggregatesAdminNegativeTestJSON-1580251134-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': '100383d494d7471484420fd7984af8d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e54fc98e1ba64668983dede0f2bec2ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:38.735611 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-77a646f2-40bb-4980-a92e-50e264ef681f tempest-AggregatesAdminNegativeTestJSON-1580251134 tempest-AggregatesAdminNegativeTestJSON-1580251134-project] Request method failure captured: Aug 10 22:56:38.735611 n-d-850468-14 devstack@n-api.service[122632]: request: POST /compute/v2.1/os-aggregates/17/action HTTP/1.1 Aug 10 22:56:38.735611 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 22:56:38.735611 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 22:56:38.735611 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 22:56:38.735611 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 43 Aug 10 22:56:38.735611 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 22:56:38.735611 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 22:56:38.735611 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 22:56:38.735611 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 22:56:38.735611 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9Dedn6AzAE0pyf1OXcHRuapsup76OT1O_CyNeraLlb487YyoZzWR-4nldg2NNh5p44YzxybGvxMUl5zEl7k1dG5bkscmmfwMwVTA__TEX4hcMVPhEYCd-AADUSQYVDd4M6q5JziL_7R7gLry-BQ32r0ZwrxbZ6cjoDEnyYIqsGiGOsY Aug 10 22:56:38.735611 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 22:56:38.735611 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 22:56:38.735611 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 22:56:38.735611 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 22:56:38.735611 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 22:56:38.735611 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 22:56:38.735611 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: e54fc98e1ba64668983dede0f2bec2ea Aug 10 22:56:38.735611 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1580251134 Aug 10 22:56:38.735611 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 22:56:38.735611 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 22:56:38.737056 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e54fc98e1ba64668983dede0f2bec2ea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e54fc98e1ba64668983dede0f2bec2ea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/e54fc98e1ba64668983dede0f2bec2ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_e54fc98e1ba64668983dede0f2bec2ea", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 22:56:38.737056 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1580251134 Aug 10 22:56:38.737056 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: e54fc98e1ba64668983dede0f2bec2ea Aug 10 22:56:38.737056 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1580251134 Aug 10 22:56:38.737056 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-AggregatesAdminNegativeTestJSON-1580251134-project Aug 10 22:56:38.737056 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 22:56:38.737056 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 22:56:38.737056 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: 100383d494d7471484420fd7984af8d2 Aug 10 22:56:38.737056 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1580251134-project Aug 10 22:56:38.737056 n-d-850468-14 devstack@n-api.service[122632]: Aug 10 22:56:38.737056 n-d-850468-14 devstack@n-api.service[122632]: {"remove_host": {"host": "n-h1-850468-14"}} Aug 10 22:56:38.737056 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 22:56:38.737056 n-d-850468-14 devstack@n-api.service[122632]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Aug 10 22:56:38.737911 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': '17', 'body': {'remove_host': {'host': 'n-h1-850468-14'}}} Aug 10 22:56:38.737911 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 22:56:38.737911 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:56:38.737911 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:56:38.737911 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:56:38.737911 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 22:56:38.737911 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 22:56:38.737911 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 22:56:38.737911 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 22:56:38.737911 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 22:56:38.737911 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 22:56:38.737911 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Aug 10 22:56:38.737911 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Aug 10 22:56:38.737911 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 10 22:56:38.737911 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 10 22:56:38.737911 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 10 22:56:38.737911 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 10 22:56:38.737911 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 10 22:56:38.737911 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 10 22:56:38.739167 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 10 22:56:38.739167 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise self.value Aug 10 22:56:38.739167 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 10 22:56:38.739167 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 10 22:56:38.739167 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 10 22:56:38.739167 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 10 22:56:38.739167 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 10 22:56:38.739167 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 10 22:56:38.739167 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Aug 10 22:56:38.739167 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:56:38.739167 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:56:38.739167 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:56:38.739167 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:56:38.739167 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:56:38.739167 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:56:38.739167 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 10 22:56:38.739167 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 10 22:56:38.739167 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Aug 10 22:56:38.739167 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:56:38.744596 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-77a646f2-40bb-4980-a92e-50e264ef681f tempest-AggregatesAdminNegativeTestJSON-1580251134 tempest-AggregatesAdminNegativeTestJSON-1580251134-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 22:56:38.747505 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-77a646f2-40bb-4980-a92e-50e264ef681f tempest-AggregatesAdminNegativeTestJSON-1580251134 tempest-AggregatesAdminNegativeTestJSON-1580251134-project] 10.222.0.58 "POST /compute/v2.1/os-aggregates/17/action" status: 403 len: 121 microversion: 2.1 time: 0.039341 Aug 10 22:56:38.753192 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 174/356] 10.222.0.58 () {60 vars in 1194 bytes} [Wed Aug 10 22:56:38 2022] POST /compute/v2.1/os-aggregates/17/action => generated 121 bytes in 45 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 10 22:56:38.772172 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-8fec3697-fbb3-4ac5-9fd0-0ef878706415 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:38.776535 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-8fec3697-fbb3-4ac5-9fd0-0ef878706415 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 9acba217-4a32-4650-a43e-9d998061323c] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:56:38.792954 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-5ab313d8-8694-486f-bf46-f6609f74bc3a tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] 10.222.0.58 "DELETE /compute/v2.1/servers/e1648ffb-5a43-4e48-940e-6fcff8db87e5" status: 204 len: 0 microversion: 2.1 time: 0.479233 Aug 10 22:56:38.795308 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8fec3697-fbb3-4ac5-9fd0-0ef878706415 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:38.798688 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8fec3697-fbb3-4ac5-9fd0-0ef878706415 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:38.800076 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 183/357] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 22:56:38 2022] DELETE /compute/v2.1/servers/e1648ffb-5a43-4e48-940e-6fcff8db87e5 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 10 22:56:38.800916 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8fec3697-fbb3-4ac5-9fd0-0ef878706415 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:38.802111 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8fec3697-fbb3-4ac5-9fd0-0ef878706415 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:38.803519 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8fec3697-fbb3-4ac5-9fd0-0ef878706415 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:38.805129 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8fec3697-fbb3-4ac5-9fd0-0ef878706415 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:38.814046 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-4cf0cdcd-a6f4-4935-b23e-df1e847ede0c tempest-AggregatesAdminNegativeTestJSON-25117975 tempest-AggregatesAdminNegativeTestJSON-25117975-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-850468-14"}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:56:38.822513 n-d-850468-14 devstack@n-api.service[122633]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:56:38.822513 n-d-850468-14 devstack@n-api.service[122633]: warnings.warn(msg) Aug 10 22:56:38.847318 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4cf0cdcd-a6f4-4935-b23e-df1e847ede0c tempest-AggregatesAdminNegativeTestJSON-25117975 tempest-AggregatesAdminNegativeTestJSON-25117975-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:38.849726 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4cf0cdcd-a6f4-4935-b23e-df1e847ede0c tempest-AggregatesAdminNegativeTestJSON-25117975 tempest-AggregatesAdminNegativeTestJSON-25117975-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:38.850403 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4cf0cdcd-a6f4-4935-b23e-df1e847ede0c tempest-AggregatesAdminNegativeTestJSON-25117975 tempest-AggregatesAdminNegativeTestJSON-25117975-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:39.063721 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-4cf0cdcd-a6f4-4935-b23e-df1e847ede0c tempest-AggregatesAdminNegativeTestJSON-25117975 tempest-AggregatesAdminNegativeTestJSON-25117975-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 228 microversion: 2.1 time: 0.262067 Aug 10 22:56:39.065588 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 184/358] 10.222.0.58 () {60 vars in 1194 bytes} [Wed Aug 10 22:56:38 2022] POST /compute/v2.1/os-aggregates/17/action => generated 228 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:56:39.074217 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-125b5724-ae4b-4dfe-857f-df04cf4d6ee8 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:39.080013 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-125b5724-ae4b-4dfe-857f-df04cf4d6ee8 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] [instance: e1648ffb-5a43-4e48-940e-6fcff8db87e5] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:56:39.099476 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-125b5724-ae4b-4dfe-857f-df04cf4d6ee8 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:39.101405 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-125b5724-ae4b-4dfe-857f-df04cf4d6ee8 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:39.103333 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-125b5724-ae4b-4dfe-857f-df04cf4d6ee8 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:39.105578 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-125b5724-ae4b-4dfe-857f-df04cf4d6ee8 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:39.106403 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-125b5724-ae4b-4dfe-857f-df04cf4d6ee8 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:39.107584 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-125b5724-ae4b-4dfe-857f-df04cf4d6ee8 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:39.208009 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-125b5724-ae4b-4dfe-857f-df04cf4d6ee8 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:39.213081 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-125b5724-ae4b-4dfe-857f-df04cf4d6ee8 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:39.213650 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-125b5724-ae4b-4dfe-857f-df04cf4d6ee8 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:39.214249 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.objects.instance [None req-125b5724-ae4b-4dfe-857f-df04cf4d6ee8 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Lazy-loading 'fault' on Instance uuid e1648ffb-5a43-4e48-940e-6fcff8db87e5 {{(pid=122633) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 22:56:39.357473 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-8fec3697-fbb3-4ac5-9fd0-0ef878706415 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:39.384415 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-8fec3697-fbb3-4ac5-9fd0-0ef878706415 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/9acba217-4a32-4650-a43e-9d998061323c" status: 200 len: 1312 microversion: 2.1 time: 0.622834 Aug 10 22:56:39.387691 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 175/359] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:56:38 2022] GET /compute/v2.1/servers/9acba217-4a32-4650-a43e-9d998061323c => generated 1312 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:56:39.401490 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-22aacc3c-69cb-49a5-a00d-ce4ccc6eac80 tempest-AggregatesAdminNegativeTestJSON-25117975 tempest-AggregatesAdminNegativeTestJSON-25117975-project-admin] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:39.402929 n-d-850468-14 devstack@n-api.service[122632]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:56:39.402929 n-d-850468-14 devstack@n-api.service[122632]: warnings.warn(msg) Aug 10 22:56:39.471525 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-22aacc3c-69cb-49a5-a00d-ce4ccc6eac80 tempest-AggregatesAdminNegativeTestJSON-25117975 tempest-AggregatesAdminNegativeTestJSON-25117975-project-admin] 10.222.0.58 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.078169 Aug 10 22:56:39.472436 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 176/360] 10.222.0.58 () {58 vars in 1155 bytes} [Wed Aug 10 22:56:39 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 10 22:56:39.640699 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-125b5724-ae4b-4dfe-857f-df04cf4d6ee8 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64648d3c6f5c423e83ff023e7bf6550a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434532ba922f406d8d8c197d3a57ffc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:39.645987 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:56:39.665021 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-125b5724-ae4b-4dfe-857f-df04cf4d6ee8 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] 10.222.0.58 "GET /compute/v2.1/servers/e1648ffb-5a43-4e48-940e-6fcff8db87e5" status: 200 len: 1458 microversion: 2.1 time: 0.598092 Aug 10 22:56:39.667651 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 185/361] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:56:39 2022] GET /compute/v2.1/servers/e1648ffb-5a43-4e48-940e-6fcff8db87e5 => generated 1458 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:56:39.708165 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-d40eb8a9-9360-4b32-a3ad-71338ce5ce6c tempest-AggregatesAdminNegativeTestJSON-25117975 tempest-AggregatesAdminNegativeTestJSON-25117975-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1307185594"}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:56:39.718643 n-d-850468-14 devstack@n-api.service[122633]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:56:39.718643 n-d-850468-14 devstack@n-api.service[122633]: warnings.warn(msg) Aug 10 22:56:39.722528 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.objects.aggregate [None req-d40eb8a9-9360-4b32-a3ad-71338ce5ce6c tempest-AggregatesAdminNegativeTestJSON-25117975 tempest-AggregatesAdminNegativeTestJSON-25117975-project-admin] Generated uuid 79e26f6e-60cc-4d06-ac0f-1ec8727dabe9 for aggregate {{(pid=122633) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 10 22:56:39.800171 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-d40eb8a9-9360-4b32-a3ad-71338ce5ce6c tempest-AggregatesAdminNegativeTestJSON-25117975 tempest-AggregatesAdminNegativeTestJSON-25117975-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.111396 Aug 10 22:56:39.803129 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 186/362] 10.222.0.58 () {60 vars in 1164 bytes} [Wed Aug 10 22:56:39 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:56:39.817925 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-48fefd08-fa94-4887-8f8b-675817efa88c req-a3b96d34-c2af-448d-9d20-9590f596ccf0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9acba217-4a32-4650-a43e-9d998061323c", "name": "network-vif-plugged", "status": "completed", "tag": "7f752529-8509-4990-90aa-e93ad25cb8d1"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:56:39.861585 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-6fd138d5-5bea-4349-81e0-9d7b104b5c4f tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1422831949", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452", "networks": [{"uuid": "aa35c9d2-0c9d-4fce-b653-23b4074314a8"}]}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:56:39.880696 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-48fefd08-fa94-4887-8f8b-675817efa88c req-a3b96d34-c2af-448d-9d20-9590f596ccf0 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:39.885177 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-48fefd08-fa94-4887-8f8b-675817efa88c req-a3b96d34-c2af-448d-9d20-9590f596ccf0 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:39.885724 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-48fefd08-fa94-4887-8f8b-675817efa88c req-a3b96d34-c2af-448d-9d20-9590f596ccf0 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:39.902656 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-48fefd08-fa94-4887-8f8b-675817efa88c req-a3b96d34-c2af-448d-9d20-9590f596ccf0 service nova] Creating event network-vif-plugged:7f752529-8509-4990-90aa-e93ad25cb8d1 for instance 9acba217-4a32-4650-a43e-9d998061323c on n-h2-850468-14 Aug 10 22:56:39.909537 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-48fefd08-fa94-4887-8f8b-675817efa88c req-a3b96d34-c2af-448d-9d20-9590f596ccf0 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102145 Aug 10 22:56:39.910704 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 187/363] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 22:56:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:56:39.915995 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-1f32bcb0-328d-49c4-9d8f-5598d0e9346a tempest-AggregatesAdminNegativeTestJSON-25117975 tempest-AggregatesAdminNegativeTestJSON-25117975-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:56:39.919976 n-d-850468-14 devstack@n-api.service[122633]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:56:39.919976 n-d-850468-14 devstack@n-api.service[122633]: warnings.warn(msg) Aug 10 22:56:39.934537 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1f32bcb0-328d-49c4-9d8f-5598d0e9346a tempest-AggregatesAdminNegativeTestJSON-25117975 tempest-AggregatesAdminNegativeTestJSON-25117975-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:39.935652 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1f32bcb0-328d-49c4-9d8f-5598d0e9346a tempest-AggregatesAdminNegativeTestJSON-25117975 tempest-AggregatesAdminNegativeTestJSON-25117975-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:39.937193 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1f32bcb0-328d-49c4-9d8f-5598d0e9346a tempest-AggregatesAdminNegativeTestJSON-25117975 tempest-AggregatesAdminNegativeTestJSON-25117975-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:39.944177 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1f32bcb0-328d-49c4-9d8f-5598d0e9346a tempest-AggregatesAdminNegativeTestJSON-25117975 tempest-AggregatesAdminNegativeTestJSON-25117975-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:39.945057 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1f32bcb0-328d-49c4-9d8f-5598d0e9346a tempest-AggregatesAdminNegativeTestJSON-25117975 tempest-AggregatesAdminNegativeTestJSON-25117975-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:39.945709 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1f32bcb0-328d-49c4-9d8f-5598d0e9346a tempest-AggregatesAdminNegativeTestJSON-25117975 tempest-AggregatesAdminNegativeTestJSON-25117975-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:39.957406 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.compute.aggregates [None req-1f32bcb0-328d-49c4-9d8f-5598d0e9346a tempest-AggregatesAdminNegativeTestJSON-25117975 tempest-AggregatesAdminNegativeTestJSON-25117975-project-admin] Failed to remove host nonexist_host from aggregate 18. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Aug 10 22:56:39.958215 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-1f32bcb0-328d-49c4-9d8f-5598d0e9346a tempest-AggregatesAdminNegativeTestJSON-25117975 tempest-AggregatesAdminNegativeTestJSON-25117975-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 18 Aug 10 22:56:39.962580 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-1f32bcb0-328d-49c4-9d8f-5598d0e9346a tempest-AggregatesAdminNegativeTestJSON-25117975 tempest-AggregatesAdminNegativeTestJSON-25117975-project-admin] Request method failure captured: Aug 10 22:56:39.962580 n-d-850468-14 devstack@n-api.service[122633]: request: POST /compute/v2.1/os-aggregates/18/action HTTP/1.1 Aug 10 22:56:39.962580 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 22:56:39.962580 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 22:56:39.962580 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 22:56:39.962580 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 42 Aug 10 22:56:39.962580 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 22:56:39.962580 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 22:56:39.962580 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 22:56:39.962580 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 22:56:39.962580 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9DefH3X3tmwb1oeFduipNgWv3uBO3Wb0wXTh6ItUKoFVAE_gKQpIVxlgNpPSC1wyNXxGQU5tCP12YDinY57KXzRrgbwnr5zqCUG1FiRI6feKj5CHlZ9YwmMLKMRfW0LX0giJbBH-5OsdHtXNOQRP8hvmXRLN9LXC6Pl393IYZmzf7dY Aug 10 22:56:39.962580 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 22:56:39.962580 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 22:56:39.962580 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 22:56:39.962580 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 22:56:39.962580 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 22:56:39.962580 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 22:56:39.962580 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 66d3db38c8d247acbdd6c2115a3dd394 Aug 10 22:56:39.962580 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-25117975 Aug 10 22:56:39.962580 n-d-850468-14 devstack@n-api.service[122633]: X-Role: admin,member,reader Aug 10 22:56:39.962580 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: admin,member,reader Aug 10 22:56:39.963961 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/66d3db38c8d247acbdd6c2115a3dd394"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/66d3db38c8d247acbdd6c2115a3dd394"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/66d3db38c8d247acbdd6c2115a3dd394"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_66d3db38c8d247acbdd6c2115a3dd394", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 22:56:39.963961 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-25117975 Aug 10 22:56:39.963961 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 66d3db38c8d247acbdd6c2115a3dd394 Aug 10 22:56:39.963961 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-25117975 Aug 10 22:56:39.963961 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-AggregatesAdminNegativeTestJSON-25117975-project-admin Aug 10 22:56:39.963961 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 22:56:39.963961 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 22:56:39.963961 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 7e02dd5d42b24e5eb6d87cf92262e582 Aug 10 22:56:39.963961 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-25117975-project-admin Aug 10 22:56:39.963961 n-d-850468-14 devstack@n-api.service[122633]: Aug 10 22:56:39.963961 n-d-850468-14 devstack@n-api.service[122633]: {"remove_host": {"host": "nonexist_host"}} Aug 10 22:56:39.963961 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 22:56:39.963961 n-d-850468-14 devstack@n-api.service[122633]: exception: Cannot remove host nonexist_host in aggregate 18 Aug 10 22:56:39.964654 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': '18', 'body': {'remove_host': {'host': 'nonexist_host'}}} Aug 10 22:56:39.964654 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 22:56:39.964654 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:56:39.964654 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5962, in _get_service_in_cell_by_host Aug 10 22:56:39.964654 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Aug 10 22:56:39.964654 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 10 22:56:39.964654 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 10 22:56:39.964654 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 10 22:56:39.964654 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 10 22:56:39.964654 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 10 22:56:39.964654 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 10 22:56:39.964654 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 10 22:56:39.964654 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 10 22:56:39.964654 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Aug 10 22:56:39.964654 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:56:39.964654 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:56:39.964654 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:56:39.964654 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:56:39.964654 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5968, in _get_service_in_cell_by_host Aug 10 22:56:39.964654 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Aug 10 22:56:39.966480 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6030, in _find_service_in_cell Aug 10 22:56:39.966480 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 10 22:56:39.966480 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 10 22:56:39.966480 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:56:39.966480 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:56:39.966480 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:56:39.966480 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:56:39.966480 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Aug 10 22:56:39.966480 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Aug 10 22:56:39.966480 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 10 22:56:39.966480 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 10 22:56:39.966480 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 10 22:56:39.966480 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 10 22:56:39.966480 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 10 22:56:39.966480 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise self.value Aug 10 22:56:39.966480 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 10 22:56:39.966480 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 10 22:56:39.966480 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6649, in remove_host_from_aggregate Aug 10 22:56:39.966480 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Aug 10 22:56:39.966480 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5970, in _get_service_in_cell_by_host Aug 10 22:56:39.969929 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Aug 10 22:56:39.969929 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Aug 10 22:56:39.969929 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:56:39.969929 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:56:39.969929 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:56:39.969929 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:56:39.969929 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:56:39.969929 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:56:39.969929 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 22:56:39.969929 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 22:56:39.969929 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 22:56:39.969929 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 22:56:39.969929 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 22:56:39.969929 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 22:56:39.969929 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Aug 10 22:56:39.969929 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 10 22:56:39.969929 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 18 Aug 10 22:56:39.969929 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:56:39.969929 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:56:39.969929 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:56:39.969929 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:56:39.973117 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:56:39.973117 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:56:39.973117 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 22:56:39.973117 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 22:56:39.973117 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 18 Aug 10 22:56:39.973117 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:56:39.976765 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-1f32bcb0-328d-49c4-9d8f-5598d0e9346a tempest-AggregatesAdminNegativeTestJSON-25117975 tempest-AggregatesAdminNegativeTestJSON-25117975-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 18 {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 22:56:39.978353 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-1f32bcb0-328d-49c4-9d8f-5598d0e9346a tempest-AggregatesAdminNegativeTestJSON-25117975 tempest-AggregatesAdminNegativeTestJSON-25117975-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates/18/action" status: 404 len: 94 microversion: 2.1 time: 0.066234 Aug 10 22:56:39.979179 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 188/364] 10.222.0.58 () {60 vars in 1194 bytes} [Wed Aug 10 22:56:39 2022] POST /compute/v2.1/os-aggregates/18/action => generated 94 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 10 22:56:40.046466 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-05dfa910-a8e6-4297-89db-86bf96dfde6b tempest-AggregatesAdminNegativeTestJSON-25117975 tempest-AggregatesAdminNegativeTestJSON-25117975-project-admin] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:40.055782 n-d-850468-14 devstack@n-api.service[122633]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:56:40.055782 n-d-850468-14 devstack@n-api.service[122633]: warnings.warn(msg) Aug 10 22:56:40.080253 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.network.neutron [None req-6fd138d5-5bea-4349-81e0-9d7b104b5c4f tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] validate_networks() for [('aa35c9d2-0c9d-4fce-b653-23b4074314a8', None, None, None, None, None)] {{(pid=122632) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 22:56:40.113789 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-05dfa910-a8e6-4297-89db-86bf96dfde6b tempest-AggregatesAdminNegativeTestJSON-25117975 tempest-AggregatesAdminNegativeTestJSON-25117975-project-admin] 10.222.0.58 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.089781 Aug 10 22:56:40.115175 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 189/365] 10.222.0.58 () {58 vars in 1155 bytes} [Wed Aug 10 22:56:40 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 10 22:56:40.425460 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c230326d-f910-454a-ade9-349f8d53ccc1 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:40.427779 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-c230326d-f910-454a-ade9-349f8d53ccc1 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 9acba217-4a32-4650-a43e-9d998061323c] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:56:40.443090 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c230326d-f910-454a-ade9-349f8d53ccc1 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:40.444192 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c230326d-f910-454a-ade9-349f8d53ccc1 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:40.452058 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c230326d-f910-454a-ade9-349f8d53ccc1 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:40.453021 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c230326d-f910-454a-ade9-349f8d53ccc1 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:40.453503 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c230326d-f910-454a-ade9-349f8d53ccc1 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:40.454110 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c230326d-f910-454a-ade9-349f8d53ccc1 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:41.237560 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-c230326d-f910-454a-ade9-349f8d53ccc1 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:41.246690 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-c230326d-f910-454a-ade9-349f8d53ccc1 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/9acba217-4a32-4650-a43e-9d998061323c" status: 200 len: 1312 microversion: 2.1 time: 0.841955 Aug 10 22:56:41.251378 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 190/366] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:56:40 2022] GET /compute/v2.1/servers/9acba217-4a32-4650-a43e-9d998061323c => generated 1312 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:56:41.261478 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-8ec8e3f5-ecdc-4bd5-a446-c4c558ea2356 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:41.261850 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-8ec8e3f5-ecdc-4bd5-a446-c4c558ea2356 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] [instance: e1648ffb-5a43-4e48-940e-6fcff8db87e5] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:56:41.280037 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8ec8e3f5-ecdc-4bd5-a446-c4c558ea2356 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:41.281423 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8ec8e3f5-ecdc-4bd5-a446-c4c558ea2356 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:41.282551 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8ec8e3f5-ecdc-4bd5-a446-c4c558ea2356 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:41.284910 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8ec8e3f5-ecdc-4bd5-a446-c4c558ea2356 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:41.286667 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8ec8e3f5-ecdc-4bd5-a446-c4c558ea2356 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:41.287322 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8ec8e3f5-ecdc-4bd5-a446-c4c558ea2356 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:41.368423 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8ec8e3f5-ecdc-4bd5-a446-c4c558ea2356 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:41.369384 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8ec8e3f5-ecdc-4bd5-a446-c4c558ea2356 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:41.371652 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8ec8e3f5-ecdc-4bd5-a446-c4c558ea2356 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:41.375162 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.objects.instance [None req-8ec8e3f5-ecdc-4bd5-a446-c4c558ea2356 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Lazy-loading 'fault' on Instance uuid e1648ffb-5a43-4e48-940e-6fcff8db87e5 {{(pid=122633) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 22:56:41.860701 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-8ec8e3f5-ecdc-4bd5-a446-c4c558ea2356 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '64648d3c6f5c423e83ff023e7bf6550a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '434532ba922f406d8d8c197d3a57ffc2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:41.873524 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-8ec8e3f5-ecdc-4bd5-a446-c4c558ea2356 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] 10.222.0.58 "GET /compute/v2.1/servers/e1648ffb-5a43-4e48-940e-6fcff8db87e5" status: 200 len: 1458 microversion: 2.1 time: 0.620966 Aug 10 22:56:41.874177 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 191/367] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:56:41 2022] GET /compute/v2.1/servers/e1648ffb-5a43-4e48-940e-6fcff8db87e5 => generated 1458 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:56:42.182993 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-7ebbeb98-9e6b-44b7-9c0e-8f82403c5d2b req-7bad8183-a4fa-4a49-91a2-a6e250fbd65f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1648ffb-5a43-4e48-940e-6fcff8db87e5", "name": "network-vif-deleted", "tag": "04c15889-79d5-4063-bed9-3d39dc31e7df"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:56:42.199197 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=7 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:56:42.214443 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-7ebbeb98-9e6b-44b7-9c0e-8f82403c5d2b req-7bad8183-a4fa-4a49-91a2-a6e250fbd65f service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:42.226868 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-7ebbeb98-9e6b-44b7-9c0e-8f82403c5d2b req-7bad8183-a4fa-4a49-91a2-a6e250fbd65f service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:42.230435 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-7ebbeb98-9e6b-44b7-9c0e-8f82403c5d2b req-7bad8183-a4fa-4a49-91a2-a6e250fbd65f service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:42.286037 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-7ebbeb98-9e6b-44b7-9c0e-8f82403c5d2b req-7bad8183-a4fa-4a49-91a2-a6e250fbd65f service nova] Creating event network-vif-deleted:04c15889-79d5-4063-bed9-3d39dc31e7df for instance e1648ffb-5a43-4e48-940e-6fcff8db87e5 on n-h2-850468-14 Aug 10 22:56:42.297390 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-7ebbeb98-9e6b-44b7-9c0e-8f82403c5d2b req-7bad8183-a4fa-4a49-91a2-a6e250fbd65f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116872 Aug 10 22:56:42.304158 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 192/368] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 22:56:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 22:56:42.330570 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-f0e14a5e-6ed2-4ab9-ac59-48f880916aec tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:42.331663 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-f0e14a5e-6ed2-4ab9-ac59-48f880916aec tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 9acba217-4a32-4650-a43e-9d998061323c] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:56:42.340214 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f0e14a5e-6ed2-4ab9-ac59-48f880916aec tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:42.340939 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f0e14a5e-6ed2-4ab9-ac59-48f880916aec tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:42.341581 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f0e14a5e-6ed2-4ab9-ac59-48f880916aec tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:42.343688 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f0e14a5e-6ed2-4ab9-ac59-48f880916aec tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:42.344299 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f0e14a5e-6ed2-4ab9-ac59-48f880916aec tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:42.344873 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f0e14a5e-6ed2-4ab9-ac59-48f880916aec tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:42.502558 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-6fd138d5-5bea-4349-81e0-9d7b104b5c4f tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Flavor limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 22:56:42.504526 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-6fd138d5-5bea-4349-81e0-9d7b104b5c4f tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Image limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 22:56:42.514169 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-6fd138d5-5bea-4349-81e0-9d7b104b5c4f tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Flavor pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 22:56:42.518239 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-6fd138d5-5bea-4349-81e0-9d7b104b5c4f tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Image pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 22:56:42.520220 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-6fd138d5-5bea-4349-81e0-9d7b104b5c4f tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 22:56:42.550166 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6fd138d5-5bea-4349-81e0-9d7b104b5c4f tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:42.553624 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6fd138d5-5bea-4349-81e0-9d7b104b5c4f tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:42.555085 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6fd138d5-5bea-4349-81e0-9d7b104b5c4f tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:42.556300 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6fd138d5-5bea-4349-81e0-9d7b104b5c4f tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:42.559113 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6fd138d5-5bea-4349-81e0-9d7b104b5c4f tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:42.562812 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6fd138d5-5bea-4349-81e0-9d7b104b5c4f tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:42.671904 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-6fd138d5-5bea-4349-81e0-9d7b104b5c4f tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Getting quotas for project b4355fdc73c84fa2baf0d5c9a33e69d5. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 22:56:42.687158 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-6fd138d5-5bea-4349-81e0-9d7b104b5c4f tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Getting quotas for user 394f0e6843424c7b83d2dfff61f66ede and project b4355fdc73c84fa2baf0d5c9a33e69d5. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 22:56:42.736414 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-6fd138d5-5bea-4349-81e0-9d7b104b5c4f tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Going to run 1 instances... {{(pid=122632) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 22:56:42.739950 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-f0e14a5e-6ed2-4ab9-ac59-48f880916aec tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:42.744005 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-6fd138d5-5bea-4349-81e0-9d7b104b5c4f tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] [instance: baf47131-7a59-4588-9ce6-113709fa8480] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78ad8905-f66f-4733-8be9-2b260f1fabed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122632) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 22:56:42.750457 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-f0e14a5e-6ed2-4ab9-ac59-48f880916aec tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/9acba217-4a32-4650-a43e-9d998061323c" status: 200 len: 1462 microversion: 2.1 time: 0.443580 Aug 10 22:56:42.761030 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 193/369] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:56:42 2022] GET /compute/v2.1/servers/9acba217-4a32-4650-a43e-9d998061323c => generated 1462 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:56:42.854188 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=7,nova_api:UPDATE=1,nova_api:DELETE=4 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:56:42.933391 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-6fd138d5-5bea-4349-81e0-9d7b104b5c4f tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 3.456173 Aug 10 22:56:42.934470 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 177/370] 10.222.0.58 () {62 vars in 1188 bytes} [Wed Aug 10 22:56:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 3461 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 10 22:56:42.951367 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-30747f53-a234-45fa-b001-c9abb28f03ff tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:42.953109 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-30747f53-a234-45fa-b001-c9abb28f03ff tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] [instance: e1648ffb-5a43-4e48-940e-6fcff8db87e5] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:56:42.986205 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-30747f53-a234-45fa-b001-c9abb28f03ff tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:42.992593 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-30747f53-a234-45fa-b001-c9abb28f03ff tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:42.993049 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-30747f53-a234-45fa-b001-c9abb28f03ff tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:42.993789 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-30747f53-a234-45fa-b001-c9abb28f03ff tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:42.994263 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-30747f53-a234-45fa-b001-c9abb28f03ff tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:42.996350 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-30747f53-a234-45fa-b001-c9abb28f03ff tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:43.007966 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:56:43.032497 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-30747f53-a234-45fa-b001-c9abb28f03ff tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] HTTP exception thrown: Instance e1648ffb-5a43-4e48-940e-6fcff8db87e5 could not be found. Aug 10 22:56:43.038582 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-30747f53-a234-45fa-b001-c9abb28f03ff tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Request method failure captured: Aug 10 22:56:43.038582 n-d-850468-14 devstack@n-api.service[122632]: request: GET /compute/v2.1/servers/e1648ffb-5a43-4e48-940e-6fcff8db87e5 HTTP/1.1 Aug 10 22:56:43.038582 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 22:56:43.038582 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 22:56:43.038582 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 22:56:43.038582 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 22:56:43.038582 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 22:56:43.038582 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 22:56:43.038582 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 22:56:43.038582 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 22:56:43.038582 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9DdqI6ADCrjNDcXrrpDiXvSSUEOh9NdPbsw158OiE7sPTsgjn73p_8mG-_cVwrv3uwkhCu1bReuRXLOk1fbrJynSTxlS3Bgd75LILRE-itZIeNvpjJ7RbU9jBDZ0rUJW4cmK6b6F7Cthv32NdJNOkkIl2teTw8IzEsUFKk1QcmAn7sQ Aug 10 22:56:43.038582 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 22:56:43.038582 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 22:56:43.038582 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 22:56:43.038582 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 22:56:43.038582 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 22:56:43.038582 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 22:56:43.038582 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 434532ba922f406d8d8c197d3a57ffc2 Aug 10 22:56:43.038582 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-DeleteServersAdminTestJSON-953196831 Aug 10 22:56:43.038582 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 22:56:43.038582 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 22:56:43.040138 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/434532ba922f406d8d8c197d3a57ffc2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/434532ba922f406d8d8c197d3a57ffc2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/434532ba922f406d8d8c197d3a57ffc2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_434532ba922f406d8d8c197d3a57ffc2", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 22:56:43.040138 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-DeleteServersAdminTestJSON-953196831 Aug 10 22:56:43.040138 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 434532ba922f406d8d8c197d3a57ffc2 Aug 10 22:56:43.040138 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-953196831 Aug 10 22:56:43.040138 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-DeleteServersAdminTestJSON-953196831-project Aug 10 22:56:43.040138 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 22:56:43.040138 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 22:56:43.040138 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: 64648d3c6f5c423e83ff023e7bf6550a Aug 10 22:56:43.040138 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-DeleteServersAdminTestJSON-953196831-project Aug 10 22:56:43.040138 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 22:56:43.040138 n-d-850468-14 devstack@n-api.service[122632]: exception: Instance e1648ffb-5a43-4e48-940e-6fcff8db87e5 could not be found. Aug 10 22:56:43.040138 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': 'e1648ffb-5a43-4e48-940e-6fcff8db87e5'} Aug 10 22:56:43.040792 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 22:56:43.040792 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:56:43.040792 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 22:56:43.040792 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 22:56:43.040792 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 22:56:43.040792 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 22:56:43.040792 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 22:56:43.040792 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 22:56:43.040792 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 22:56:43.040792 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 22:56:43.040792 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1648ffb-5a43-4e48-940e-6fcff8db87e5 could not be found. Aug 10 22:56:43.040792 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:56:43.040792 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:56:43.040792 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:56:43.040792 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:56:43.040792 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:56:43.040792 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:56:43.040792 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 22:56:43.040792 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 22:56:43.040792 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 22:56:43.041916 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 22:56:43.041916 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 22:56:43.041916 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 22:56:43.041916 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 22:56:43.041916 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 22:56:43.041916 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 22:56:43.041916 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 22:56:43.041916 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1648ffb-5a43-4e48-940e-6fcff8db87e5 could not be found. Aug 10 22:56:43.041916 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:56:43.041916 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:56:43.041916 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:56:43.041916 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:56:43.041916 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:56:43.041916 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:56:43.041916 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 22:56:43.041916 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 22:56:43.041916 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1648ffb-5a43-4e48-940e-6fcff8db87e5 could not be found. Aug 10 22:56:43.041916 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:56:43.046861 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-30747f53-a234-45fa-b001-c9abb28f03ff tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Returning 404 to user: Instance e1648ffb-5a43-4e48-940e-6fcff8db87e5 could not be found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 22:56:43.047936 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-30747f53-a234-45fa-b001-c9abb28f03ff tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] 10.222.0.58 "GET /compute/v2.1/servers/e1648ffb-5a43-4e48-940e-6fcff8db87e5" status: 404 len: 111 microversion: 2.1 time: 0.111271 Aug 10 22:56:43.057552 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 178/371] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:56:42 2022] GET /compute/v2.1/servers/e1648ffb-5a43-4e48-940e-6fcff8db87e5 => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 22:56:43.063940 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-a80a3ca0-a4b8-4882-a12b-83d1527585e3 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:43.064778 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-a80a3ca0-a4b8-4882-a12b-83d1527585e3 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] [instance: baf47131-7a59-4588-9ce6-113709fa8480] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:56:43.177923 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-a80a3ca0-a4b8-4882-a12b-83d1527585e3 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:43.193848 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-a80a3ca0-a4b8-4882-a12b-83d1527585e3 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:43.199137 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-a80a3ca0-a4b8-4882-a12b-83d1527585e3 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:43.201359 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-a80a3ca0-a4b8-4882-a12b-83d1527585e3 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] 10.222.0.58 "GET /compute/v2.1/servers/baf47131-7a59-4588-9ce6-113709fa8480" status: 200 len: 1262 microversion: 2.25 time: 0.142497 Aug 10 22:56:43.204918 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 179/372] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 22:56:43 2022] GET /compute/v2.1/servers/baf47131-7a59-4588-9ce6-113709fa8480 => generated 1262 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:56:43.223243 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-ad4dbc46-7832-46f6-a294-5ac251834841 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:43.224087 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-ad4dbc46-7832-46f6-a294-5ac251834841 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] [instance: e1648ffb-5a43-4e48-940e-6fcff8db87e5] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:56:43.244004 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ad4dbc46-7832-46f6-a294-5ac251834841 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:43.246203 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ad4dbc46-7832-46f6-a294-5ac251834841 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:43.247527 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ad4dbc46-7832-46f6-a294-5ac251834841 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:43.250192 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ad4dbc46-7832-46f6-a294-5ac251834841 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:43.254775 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ad4dbc46-7832-46f6-a294-5ac251834841 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:43.256117 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ad4dbc46-7832-46f6-a294-5ac251834841 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:43.312559 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-ad4dbc46-7832-46f6-a294-5ac251834841 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] HTTP exception thrown: Instance e1648ffb-5a43-4e48-940e-6fcff8db87e5 could not be found. Aug 10 22:56:43.319155 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-ad4dbc46-7832-46f6-a294-5ac251834841 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Request method failure captured: Aug 10 22:56:43.319155 n-d-850468-14 devstack@n-api.service[122632]: request: DELETE /compute/v2.1/servers/e1648ffb-5a43-4e48-940e-6fcff8db87e5 HTTP/1.1 Aug 10 22:56:43.319155 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 22:56:43.319155 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 22:56:43.319155 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 22:56:43.319155 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 22:56:43.319155 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 22:56:43.319155 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 22:56:43.319155 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 22:56:43.319155 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 22:56:43.319155 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9DdqI6ADCrjNDcXrrpDiXvSSUEOh9NdPbsw158OiE7sPTsgjn73p_8mG-_cVwrv3uwkhCu1bReuRXLOk1fbrJynSTxlS3Bgd75LILRE-itZIeNvpjJ7RbU9jBDZ0rUJW4cmK6b6F7Cthv32NdJNOkkIl2teTw8IzEsUFKk1QcmAn7sQ Aug 10 22:56:43.319155 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 22:56:43.319155 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 22:56:43.319155 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 22:56:43.319155 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 22:56:43.319155 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 22:56:43.319155 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 22:56:43.319155 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 434532ba922f406d8d8c197d3a57ffc2 Aug 10 22:56:43.319155 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-DeleteServersAdminTestJSON-953196831 Aug 10 22:56:43.319155 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 22:56:43.319155 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 22:56:43.320632 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/434532ba922f406d8d8c197d3a57ffc2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/434532ba922f406d8d8c197d3a57ffc2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/434532ba922f406d8d8c197d3a57ffc2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_434532ba922f406d8d8c197d3a57ffc2", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 22:56:43.320632 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-DeleteServersAdminTestJSON-953196831 Aug 10 22:56:43.320632 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 434532ba922f406d8d8c197d3a57ffc2 Aug 10 22:56:43.320632 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-953196831 Aug 10 22:56:43.320632 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-DeleteServersAdminTestJSON-953196831-project Aug 10 22:56:43.320632 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 22:56:43.320632 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 22:56:43.320632 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: 64648d3c6f5c423e83ff023e7bf6550a Aug 10 22:56:43.320632 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-DeleteServersAdminTestJSON-953196831-project Aug 10 22:56:43.320632 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 22:56:43.320632 n-d-850468-14 devstack@n-api.service[122632]: exception: Instance e1648ffb-5a43-4e48-940e-6fcff8db87e5 could not be found. Aug 10 22:56:43.320632 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': 'e1648ffb-5a43-4e48-940e-6fcff8db87e5'} Aug 10 22:56:43.321421 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 22:56:43.321421 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:56:43.321421 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 22:56:43.321421 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 22:56:43.321421 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 22:56:43.321421 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 22:56:43.321421 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 22:56:43.321421 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 22:56:43.321421 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 22:56:43.321421 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 22:56:43.321421 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1648ffb-5a43-4e48-940e-6fcff8db87e5 could not be found. Aug 10 22:56:43.321421 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:56:43.321421 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:56:43.321421 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:56:43.321421 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:56:43.321421 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:56:43.321421 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:56:43.321421 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 22:56:43.321421 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 22:56:43.321421 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 22:56:43.322651 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 22:56:43.322651 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 22:56:43.322651 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 22:56:43.322651 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 22:56:43.322651 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 22:56:43.322651 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 22:56:43.322651 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 22:56:43.322651 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 22:56:43.322651 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 22:56:43.322651 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1648ffb-5a43-4e48-940e-6fcff8db87e5 could not be found. Aug 10 22:56:43.322651 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:56:43.322651 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:56:43.322651 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:56:43.322651 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:56:43.322651 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:56:43.322651 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:56:43.322651 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 22:56:43.322651 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 22:56:43.322651 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1648ffb-5a43-4e48-940e-6fcff8db87e5 could not be found. Aug 10 22:56:43.322651 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:56:43.326186 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-ad4dbc46-7832-46f6-a294-5ac251834841 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Returning 404 to user: Instance e1648ffb-5a43-4e48-940e-6fcff8db87e5 could not be found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 22:56:43.329635 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-ad4dbc46-7832-46f6-a294-5ac251834841 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] 10.222.0.58 "DELETE /compute/v2.1/servers/e1648ffb-5a43-4e48-940e-6fcff8db87e5" status: 404 len: 111 microversion: 2.1 time: 0.123167 Aug 10 22:56:43.335467 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 180/373] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 22:56:43 2022] DELETE /compute/v2.1/servers/e1648ffb-5a43-4e48-940e-6fcff8db87e5 => generated 111 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 22:56:43.346047 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-a1184170-a5d0-42e7-934d-926bad965e87 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:43.400301 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-a1184170-a5d0-42e7-934d-926bad965e87 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] [instance: e1648ffb-5a43-4e48-940e-6fcff8db87e5] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:56:43.411001 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a1184170-a5d0-42e7-934d-926bad965e87 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:43.416476 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a1184170-a5d0-42e7-934d-926bad965e87 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:43.418879 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a1184170-a5d0-42e7-934d-926bad965e87 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:43.419893 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a1184170-a5d0-42e7-934d-926bad965e87 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:43.420577 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a1184170-a5d0-42e7-934d-926bad965e87 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:43.425635 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a1184170-a5d0-42e7-934d-926bad965e87 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:43.482928 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-a1184170-a5d0-42e7-934d-926bad965e87 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] HTTP exception thrown: Instance e1648ffb-5a43-4e48-940e-6fcff8db87e5 could not be found. Aug 10 22:56:43.492298 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-a1184170-a5d0-42e7-934d-926bad965e87 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Request method failure captured: Aug 10 22:56:43.492298 n-d-850468-14 devstack@n-api.service[122632]: request: GET /compute/v2.1/servers/e1648ffb-5a43-4e48-940e-6fcff8db87e5 HTTP/1.1 Aug 10 22:56:43.492298 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 22:56:43.492298 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 22:56:43.492298 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 22:56:43.492298 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 22:56:43.492298 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 22:56:43.492298 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 22:56:43.492298 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 22:56:43.492298 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 22:56:43.492298 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9DdqI6ADCrjNDcXrrpDiXvSSUEOh9NdPbsw158OiE7sPTsgjn73p_8mG-_cVwrv3uwkhCu1bReuRXLOk1fbrJynSTxlS3Bgd75LILRE-itZIeNvpjJ7RbU9jBDZ0rUJW4cmK6b6F7Cthv32NdJNOkkIl2teTw8IzEsUFKk1QcmAn7sQ Aug 10 22:56:43.492298 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 22:56:43.492298 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 22:56:43.492298 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 22:56:43.492298 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 22:56:43.492298 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 22:56:43.492298 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 22:56:43.492298 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 434532ba922f406d8d8c197d3a57ffc2 Aug 10 22:56:43.492298 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-DeleteServersAdminTestJSON-953196831 Aug 10 22:56:43.492298 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 22:56:43.492298 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 22:56:43.493655 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/434532ba922f406d8d8c197d3a57ffc2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/434532ba922f406d8d8c197d3a57ffc2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/434532ba922f406d8d8c197d3a57ffc2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_434532ba922f406d8d8c197d3a57ffc2", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 22:56:43.493655 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-DeleteServersAdminTestJSON-953196831 Aug 10 22:56:43.493655 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 434532ba922f406d8d8c197d3a57ffc2 Aug 10 22:56:43.493655 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-953196831 Aug 10 22:56:43.493655 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-DeleteServersAdminTestJSON-953196831-project Aug 10 22:56:43.493655 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 22:56:43.493655 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 22:56:43.493655 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: 64648d3c6f5c423e83ff023e7bf6550a Aug 10 22:56:43.493655 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-DeleteServersAdminTestJSON-953196831-project Aug 10 22:56:43.493655 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 22:56:43.493655 n-d-850468-14 devstack@n-api.service[122632]: exception: Instance e1648ffb-5a43-4e48-940e-6fcff8db87e5 could not be found. Aug 10 22:56:43.493655 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': 'e1648ffb-5a43-4e48-940e-6fcff8db87e5'} Aug 10 22:56:43.494407 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 22:56:43.494407 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:56:43.494407 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 22:56:43.494407 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 22:56:43.494407 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 22:56:43.494407 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 22:56:43.494407 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 22:56:43.494407 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 22:56:43.494407 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 22:56:43.494407 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 22:56:43.494407 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1648ffb-5a43-4e48-940e-6fcff8db87e5 could not be found. Aug 10 22:56:43.494407 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:56:43.494407 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:56:43.494407 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:56:43.494407 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:56:43.494407 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:56:43.494407 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:56:43.494407 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 22:56:43.494407 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 22:56:43.494407 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 22:56:43.495741 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 22:56:43.495741 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 22:56:43.495741 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 22:56:43.495741 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 22:56:43.495741 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 22:56:43.495741 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 22:56:43.495741 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 22:56:43.495741 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1648ffb-5a43-4e48-940e-6fcff8db87e5 could not be found. Aug 10 22:56:43.495741 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:56:43.495741 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:56:43.495741 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:56:43.495741 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:56:43.495741 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:56:43.495741 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:56:43.495741 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 22:56:43.495741 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 22:56:43.495741 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1648ffb-5a43-4e48-940e-6fcff8db87e5 could not be found. Aug 10 22:56:43.495741 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:56:43.499047 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-a1184170-a5d0-42e7-934d-926bad965e87 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Returning 404 to user: Instance e1648ffb-5a43-4e48-940e-6fcff8db87e5 could not be found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 22:56:43.507684 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-a1184170-a5d0-42e7-934d-926bad965e87 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] 10.222.0.58 "GET /compute/v2.1/servers/e1648ffb-5a43-4e48-940e-6fcff8db87e5" status: 404 len: 111 microversion: 2.1 time: 0.171503 Aug 10 22:56:43.512047 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 181/374] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:56:43 2022] GET /compute/v2.1/servers/e1648ffb-5a43-4e48-940e-6fcff8db87e5 => generated 111 bytes in 176 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 22:56:43.522235 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-13170b54-3a01-4dac-b7eb-0ac3b5862725 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:43.525512 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-13170b54-3a01-4dac-b7eb-0ac3b5862725 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] [instance: 37093f4d-0663-4b69-a48f-5fd757acd9c0] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:56:43.556261 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-13170b54-3a01-4dac-b7eb-0ac3b5862725 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:43.556786 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-13170b54-3a01-4dac-b7eb-0ac3b5862725 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:43.557796 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-13170b54-3a01-4dac-b7eb-0ac3b5862725 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:43.558927 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-13170b54-3a01-4dac-b7eb-0ac3b5862725 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:43.563821 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-13170b54-3a01-4dac-b7eb-0ac3b5862725 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:43.564300 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-13170b54-3a01-4dac-b7eb-0ac3b5862725 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:43.606850 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-13170b54-3a01-4dac-b7eb-0ac3b5862725 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] HTTP exception thrown: Instance 37093f4d-0663-4b69-a48f-5fd757acd9c0 could not be found. Aug 10 22:56:43.608346 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-13170b54-3a01-4dac-b7eb-0ac3b5862725 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Request method failure captured: Aug 10 22:56:43.608346 n-d-850468-14 devstack@n-api.service[122632]: request: DELETE /compute/v2.1/servers/37093f4d-0663-4b69-a48f-5fd757acd9c0 HTTP/1.1 Aug 10 22:56:43.608346 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 22:56:43.608346 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 22:56:43.608346 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 22:56:43.608346 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 22:56:43.608346 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 22:56:43.608346 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 22:56:43.608346 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 22:56:43.608346 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 22:56:43.608346 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9DdqI6ADCrjNDcXrrpDiXvSSUEOh9NdPbsw158OiE7sPTsgjn73p_8mG-_cVwrv3uwkhCu1bReuRXLOk1fbrJynSTxlS3Bgd75LILRE-itZIeNvpjJ7RbU9jBDZ0rUJW4cmK6b6F7Cthv32NdJNOkkIl2teTw8IzEsUFKk1QcmAn7sQ Aug 10 22:56:43.608346 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 22:56:43.608346 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 22:56:43.608346 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 22:56:43.608346 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 22:56:43.608346 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 22:56:43.608346 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 22:56:43.608346 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 434532ba922f406d8d8c197d3a57ffc2 Aug 10 22:56:43.608346 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-DeleteServersAdminTestJSON-953196831 Aug 10 22:56:43.608346 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 22:56:43.608346 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 22:56:43.610069 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/434532ba922f406d8d8c197d3a57ffc2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/434532ba922f406d8d8c197d3a57ffc2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/434532ba922f406d8d8c197d3a57ffc2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_434532ba922f406d8d8c197d3a57ffc2", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 22:56:43.610069 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-DeleteServersAdminTestJSON-953196831 Aug 10 22:56:43.610069 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 434532ba922f406d8d8c197d3a57ffc2 Aug 10 22:56:43.610069 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-953196831 Aug 10 22:56:43.610069 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-DeleteServersAdminTestJSON-953196831-project Aug 10 22:56:43.610069 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 22:56:43.610069 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 22:56:43.610069 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: 64648d3c6f5c423e83ff023e7bf6550a Aug 10 22:56:43.610069 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-DeleteServersAdminTestJSON-953196831-project Aug 10 22:56:43.610069 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 22:56:43.610069 n-d-850468-14 devstack@n-api.service[122632]: exception: Instance 37093f4d-0663-4b69-a48f-5fd757acd9c0 could not be found. Aug 10 22:56:43.610069 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': '37093f4d-0663-4b69-a48f-5fd757acd9c0'} Aug 10 22:56:43.610699 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 22:56:43.610699 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:56:43.610699 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 22:56:43.610699 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 22:56:43.610699 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 22:56:43.610699 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 22:56:43.610699 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 22:56:43.610699 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 22:56:43.610699 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 22:56:43.610699 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 22:56:43.610699 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37093f4d-0663-4b69-a48f-5fd757acd9c0 could not be found. Aug 10 22:56:43.610699 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:56:43.610699 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:56:43.610699 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:56:43.610699 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:56:43.610699 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:56:43.610699 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:56:43.610699 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 22:56:43.610699 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 22:56:43.610699 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 22:56:43.611798 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 22:56:43.611798 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 22:56:43.611798 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 22:56:43.611798 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 22:56:43.611798 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 22:56:43.611798 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 22:56:43.611798 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 22:56:43.611798 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 22:56:43.611798 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 22:56:43.611798 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37093f4d-0663-4b69-a48f-5fd757acd9c0 could not be found. Aug 10 22:56:43.611798 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:56:43.611798 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:56:43.611798 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:56:43.611798 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:56:43.611798 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:56:43.611798 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:56:43.611798 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 22:56:43.611798 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 22:56:43.611798 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37093f4d-0663-4b69-a48f-5fd757acd9c0 could not be found. Aug 10 22:56:43.611798 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:56:43.613084 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-13170b54-3a01-4dac-b7eb-0ac3b5862725 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Returning 404 to user: Instance 37093f4d-0663-4b69-a48f-5fd757acd9c0 could not be found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 22:56:43.625699 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-13170b54-3a01-4dac-b7eb-0ac3b5862725 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] 10.222.0.58 "DELETE /compute/v2.1/servers/37093f4d-0663-4b69-a48f-5fd757acd9c0" status: 404 len: 111 microversion: 2.1 time: 0.097153 Aug 10 22:56:43.631856 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 182/375] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 22:56:43 2022] DELETE /compute/v2.1/servers/37093f4d-0663-4b69-a48f-5fd757acd9c0 => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 22:56:43.639663 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-8fa93b40-6329-4063-ba93-30f63778df94 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:43.642559 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-8fa93b40-6329-4063-ba93-30f63778df94 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] [instance: 37093f4d-0663-4b69-a48f-5fd757acd9c0] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:56:43.659331 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8fa93b40-6329-4063-ba93-30f63778df94 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:43.662338 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8fa93b40-6329-4063-ba93-30f63778df94 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:43.662849 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8fa93b40-6329-4063-ba93-30f63778df94 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:43.664028 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8fa93b40-6329-4063-ba93-30f63778df94 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:43.666757 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8fa93b40-6329-4063-ba93-30f63778df94 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:43.669115 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8fa93b40-6329-4063-ba93-30f63778df94 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:43.676273 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-ea88e18c-a0d4-4c14-8a59-a7f499a2b1f8 tempest-MigrationsAdminTest-974767625 tempest-MigrationsAdminTest-974767625-project-admin] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:43.677430 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-ea88e18c-a0d4-4c14-8a59-a7f499a2b1f8 tempest-MigrationsAdminTest-974767625 tempest-MigrationsAdminTest-974767625-project-admin] [instance: 9acba217-4a32-4650-a43e-9d998061323c] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:56:43.700511 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ea88e18c-a0d4-4c14-8a59-a7f499a2b1f8 tempest-MigrationsAdminTest-974767625 tempest-MigrationsAdminTest-974767625-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:43.701982 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ea88e18c-a0d4-4c14-8a59-a7f499a2b1f8 tempest-MigrationsAdminTest-974767625 tempest-MigrationsAdminTest-974767625-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:43.705426 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ea88e18c-a0d4-4c14-8a59-a7f499a2b1f8 tempest-MigrationsAdminTest-974767625 tempest-MigrationsAdminTest-974767625-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:43.706363 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ea88e18c-a0d4-4c14-8a59-a7f499a2b1f8 tempest-MigrationsAdminTest-974767625 tempest-MigrationsAdminTest-974767625-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:43.707972 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-8fa93b40-6329-4063-ba93-30f63778df94 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] HTTP exception thrown: Instance 37093f4d-0663-4b69-a48f-5fd757acd9c0 could not be found. Aug 10 22:56:43.708612 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ea88e18c-a0d4-4c14-8a59-a7f499a2b1f8 tempest-MigrationsAdminTest-974767625 tempest-MigrationsAdminTest-974767625-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:43.709525 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ea88e18c-a0d4-4c14-8a59-a7f499a2b1f8 tempest-MigrationsAdminTest-974767625 tempest-MigrationsAdminTest-974767625-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:43.712017 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-8fa93b40-6329-4063-ba93-30f63778df94 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Request method failure captured: Aug 10 22:56:43.712017 n-d-850468-14 devstack@n-api.service[122632]: request: GET /compute/v2.1/servers/37093f4d-0663-4b69-a48f-5fd757acd9c0 HTTP/1.1 Aug 10 22:56:43.712017 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 22:56:43.712017 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 22:56:43.712017 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 22:56:43.712017 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 22:56:43.712017 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 22:56:43.712017 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 22:56:43.712017 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 22:56:43.712017 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 22:56:43.712017 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9DdqI6ADCrjNDcXrrpDiXvSSUEOh9NdPbsw158OiE7sPTsgjn73p_8mG-_cVwrv3uwkhCu1bReuRXLOk1fbrJynSTxlS3Bgd75LILRE-itZIeNvpjJ7RbU9jBDZ0rUJW4cmK6b6F7Cthv32NdJNOkkIl2teTw8IzEsUFKk1QcmAn7sQ Aug 10 22:56:43.712017 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 22:56:43.712017 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 22:56:43.712017 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 22:56:43.712017 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 22:56:43.712017 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 22:56:43.712017 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 22:56:43.712017 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 434532ba922f406d8d8c197d3a57ffc2 Aug 10 22:56:43.712017 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-DeleteServersAdminTestJSON-953196831 Aug 10 22:56:43.712017 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 22:56:43.712017 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 22:56:43.713511 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/434532ba922f406d8d8c197d3a57ffc2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/434532ba922f406d8d8c197d3a57ffc2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/434532ba922f406d8d8c197d3a57ffc2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_434532ba922f406d8d8c197d3a57ffc2", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 22:56:43.713511 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-DeleteServersAdminTestJSON-953196831 Aug 10 22:56:43.713511 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 434532ba922f406d8d8c197d3a57ffc2 Aug 10 22:56:43.713511 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-953196831 Aug 10 22:56:43.713511 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-DeleteServersAdminTestJSON-953196831-project Aug 10 22:56:43.713511 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 22:56:43.713511 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 22:56:43.713511 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: 64648d3c6f5c423e83ff023e7bf6550a Aug 10 22:56:43.713511 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-DeleteServersAdminTestJSON-953196831-project Aug 10 22:56:43.713511 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 22:56:43.713511 n-d-850468-14 devstack@n-api.service[122632]: exception: Instance 37093f4d-0663-4b69-a48f-5fd757acd9c0 could not be found. Aug 10 22:56:43.713511 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': '37093f4d-0663-4b69-a48f-5fd757acd9c0'} Aug 10 22:56:43.714156 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 22:56:43.714156 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:56:43.714156 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 22:56:43.714156 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 22:56:43.714156 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 22:56:43.714156 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 22:56:43.714156 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 22:56:43.714156 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 22:56:43.714156 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 22:56:43.714156 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 22:56:43.714156 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 37093f4d-0663-4b69-a48f-5fd757acd9c0 could not be found. Aug 10 22:56:43.714156 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:56:43.714156 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:56:43.714156 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:56:43.714156 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:56:43.714156 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:56:43.714156 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:56:43.714156 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 22:56:43.714156 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 22:56:43.714156 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 22:56:43.715262 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 22:56:43.715262 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 22:56:43.715262 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 22:56:43.715262 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 22:56:43.715262 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 22:56:43.715262 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 22:56:43.715262 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 22:56:43.715262 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 37093f4d-0663-4b69-a48f-5fd757acd9c0 could not be found. Aug 10 22:56:43.715262 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:56:43.715262 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:56:43.715262 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:56:43.715262 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:56:43.715262 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:56:43.715262 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:56:43.715262 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 22:56:43.715262 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 22:56:43.715262 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 37093f4d-0663-4b69-a48f-5fd757acd9c0 could not be found. Aug 10 22:56:43.715262 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:56:43.720344 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-8fa93b40-6329-4063-ba93-30f63778df94 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] Returning 404 to user: Instance 37093f4d-0663-4b69-a48f-5fd757acd9c0 could not be found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 22:56:43.721462 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-8fa93b40-6329-4063-ba93-30f63778df94 tempest-DeleteServersAdminTestJSON-953196831 tempest-DeleteServersAdminTestJSON-953196831-project] 10.222.0.58 "GET /compute/v2.1/servers/37093f4d-0663-4b69-a48f-5fd757acd9c0" status: 404 len: 111 microversion: 2.1 time: 0.088385 Aug 10 22:56:43.731311 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 183/376] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:56:43 2022] GET /compute/v2.1/servers/37093f4d-0663-4b69-a48f-5fd757acd9c0 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 22:56:44.230606 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-a518527f-18ca-4c9f-9821-f900b1c26d62 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:44.231253 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-a518527f-18ca-4c9f-9821-f900b1c26d62 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] [instance: baf47131-7a59-4588-9ce6-113709fa8480] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:56:44.265365 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a518527f-18ca-4c9f-9821-f900b1c26d62 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:44.268916 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a518527f-18ca-4c9f-9821-f900b1c26d62 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:44.271275 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a518527f-18ca-4c9f-9821-f900b1c26d62 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:44.276146 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a518527f-18ca-4c9f-9821-f900b1c26d62 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:44.277549 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a518527f-18ca-4c9f-9821-f900b1c26d62 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:44.280099 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a518527f-18ca-4c9f-9821-f900b1c26d62 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:44.472180 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-ea88e18c-a0d4-4c14-8a59-a7f499a2b1f8 tempest-MigrationsAdminTest-974767625 tempest-MigrationsAdminTest-974767625-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/9acba217-4a32-4650-a43e-9d998061323c" status: 200 len: 1615 microversion: 2.1 time: 1.686956 Aug 10 22:56:44.474333 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 194/377] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:56:42 2022] GET /compute/v2.1/servers/9acba217-4a32-4650-a43e-9d998061323c => generated 1615 bytes in 1690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:56:44.497480 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-854c223b-659e-4888-99b3-e40108757e2b tempest-MigrationsAdminTest-974767625 tempest-MigrationsAdminTest-974767625-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:56:44.498950 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-854c223b-659e-4888-99b3-e40108757e2b tempest-MigrationsAdminTest-974767625 tempest-MigrationsAdminTest-974767625-project-admin] [instance: 9acba217-4a32-4650-a43e-9d998061323c] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:56:44.517107 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-854c223b-659e-4888-99b3-e40108757e2b tempest-MigrationsAdminTest-974767625 tempest-MigrationsAdminTest-974767625-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:44.517919 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-854c223b-659e-4888-99b3-e40108757e2b tempest-MigrationsAdminTest-974767625 tempest-MigrationsAdminTest-974767625-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:44.518530 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-854c223b-659e-4888-99b3-e40108757e2b tempest-MigrationsAdminTest-974767625 tempest-MigrationsAdminTest-974767625-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:44.519441 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-854c223b-659e-4888-99b3-e40108757e2b tempest-MigrationsAdminTest-974767625 tempest-MigrationsAdminTest-974767625-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:44.521062 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-854c223b-659e-4888-99b3-e40108757e2b tempest-MigrationsAdminTest-974767625 tempest-MigrationsAdminTest-974767625-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:44.522183 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-854c223b-659e-4888-99b3-e40108757e2b tempest-MigrationsAdminTest-974767625 tempest-MigrationsAdminTest-974767625-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:44.536174 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-a518527f-18ca-4c9f-9821-f900b1c26d62 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:44.548304 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-a518527f-18ca-4c9f-9821-f900b1c26d62 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:44.554576 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-a518527f-18ca-4c9f-9821-f900b1c26d62 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:44.559572 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-a518527f-18ca-4c9f-9821-f900b1c26d62 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] 10.222.0.58 "GET /compute/v2.1/servers/baf47131-7a59-4588-9ce6-113709fa8480" status: 200 len: 1258 microversion: 2.25 time: 0.333093 Aug 10 22:56:44.563093 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 184/378] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 22:56:44 2022] GET /compute/v2.1/servers/baf47131-7a59-4588-9ce6-113709fa8480 => generated 1258 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:56:44.676751 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-854c223b-659e-4888-99b3-e40108757e2b tempest-MigrationsAdminTest-974767625 tempest-MigrationsAdminTest-974767625-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '8226b7db08ce49328cb235804da6740d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb50f4a3b69e4d2da01cf4057a57e675', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:44.677676 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-854c223b-659e-4888-99b3-e40108757e2b tempest-MigrationsAdminTest-974767625 tempest-MigrationsAdminTest-974767625-project-admin] [instance: 9acba217-4a32-4650-a43e-9d998061323c] flavor_id is None. Assuming migration. {{(pid=122633) resize /opt/stack/nova/nova/compute/api.py:4144}} Aug 10 22:56:44.678214 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-854c223b-659e-4888-99b3-e40108757e2b tempest-MigrationsAdminTest-974767625 tempest-MigrationsAdminTest-974767625-project-admin] [instance: 9acba217-4a32-4650-a43e-9d998061323c] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=122633) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 10 22:56:45.588401 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c0518cd4-a474-43e4-9005-aa928fb8ca82 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:45.589067 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-c0518cd4-a474-43e4-9005-aa928fb8ca82 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] [instance: baf47131-7a59-4588-9ce6-113709fa8480] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:56:45.600687 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c0518cd4-a474-43e4-9005-aa928fb8ca82 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:45.602216 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c0518cd4-a474-43e4-9005-aa928fb8ca82 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:45.602736 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c0518cd4-a474-43e4-9005-aa928fb8ca82 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:45.609623 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c0518cd4-a474-43e4-9005-aa928fb8ca82 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:45.610264 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c0518cd4-a474-43e4-9005-aa928fb8ca82 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:45.610773 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c0518cd4-a474-43e4-9005-aa928fb8ca82 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:45.899966 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-c0518cd4-a474-43e4-9005-aa928fb8ca82 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:45.915425 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-c0518cd4-a474-43e4-9005-aa928fb8ca82 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:45.921329 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-c0518cd4-a474-43e4-9005-aa928fb8ca82 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:45.925042 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-c0518cd4-a474-43e4-9005-aa928fb8ca82 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] 10.222.0.58 "GET /compute/v2.1/servers/baf47131-7a59-4588-9ce6-113709fa8480" status: 200 len: 1320 microversion: 2.25 time: 0.338284 Aug 10 22:56:45.925828 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 185/379] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 22:56:45 2022] GET /compute/v2.1/servers/baf47131-7a59-4588-9ce6-113709fa8480 => generated 1320 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 22:56:46.152869 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-854c223b-659e-4888-99b3-e40108757e2b tempest-MigrationsAdminTest-974767625 tempest-MigrationsAdminTest-974767625-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/9acba217-4a32-4650-a43e-9d998061323c/action" status: 202 len: 0 microversion: 2.1 time: 1.658997 Aug 10 22:56:46.159773 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 195/380] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 22:56:44 2022] POST /compute/v2.1/servers/9acba217-4a32-4650-a43e-9d998061323c/action => generated 0 bytes in 1667 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 10 22:56:46.164102 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-b272d92c-c49d-4ce4-a253-36953e47f228 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:46.180313 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-b272d92c-c49d-4ce4-a253-36953e47f228 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 9acba217-4a32-4650-a43e-9d998061323c] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:56:46.227460 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b272d92c-c49d-4ce4-a253-36953e47f228 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:46.240131 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b272d92c-c49d-4ce4-a253-36953e47f228 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:46.241922 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b272d92c-c49d-4ce4-a253-36953e47f228 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:46.243537 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b272d92c-c49d-4ce4-a253-36953e47f228 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:46.247549 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b272d92c-c49d-4ce4-a253-36953e47f228 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:46.251582 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b272d92c-c49d-4ce4-a253-36953e47f228 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:46.750267 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-b272d92c-c49d-4ce4-a253-36953e47f228 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:46.759432 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-b272d92c-c49d-4ce4-a253-36953e47f228 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/9acba217-4a32-4650-a43e-9d998061323c" status: 200 len: 1471 microversion: 2.1 time: 0.600890 Aug 10 22:56:46.762332 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 186/381] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:56:46 2022] GET /compute/v2.1/servers/9acba217-4a32-4650-a43e-9d998061323c => generated 1471 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:56:46.956524 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-25847f0c-666c-4a7e-b939-bd77f6218fb5 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:46.957539 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-25847f0c-666c-4a7e-b939-bd77f6218fb5 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] [instance: baf47131-7a59-4588-9ce6-113709fa8480] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:56:46.967877 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-25847f0c-666c-4a7e-b939-bd77f6218fb5 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:46.971886 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-25847f0c-666c-4a7e-b939-bd77f6218fb5 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:46.972663 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-25847f0c-666c-4a7e-b939-bd77f6218fb5 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:46.973668 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-25847f0c-666c-4a7e-b939-bd77f6218fb5 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:46.974331 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-25847f0c-666c-4a7e-b939-bd77f6218fb5 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:46.975179 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-25847f0c-666c-4a7e-b939-bd77f6218fb5 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:47.118692 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-25847f0c-666c-4a7e-b939-bd77f6218fb5 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:47.131369 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-25847f0c-666c-4a7e-b939-bd77f6218fb5 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:47.134721 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-25847f0c-666c-4a7e-b939-bd77f6218fb5 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:47.138072 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-25847f0c-666c-4a7e-b939-bd77f6218fb5 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] 10.222.0.58 "GET /compute/v2.1/servers/baf47131-7a59-4588-9ce6-113709fa8480" status: 200 len: 1320 microversion: 2.25 time: 0.186739 Aug 10 22:56:47.145344 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 187/382] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 22:56:46 2022] GET /compute/v2.1/servers/baf47131-7a59-4588-9ce6-113709fa8480 => generated 1320 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 22:56:47.206733 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-0b4cdcb8-f082-42ff-9b40-0b8cdf653b51 tempest-NetworksTest-972309588 tempest-NetworksTest-972309588-project-admin] Calling method '.version_select at 0x7f847db4fd30>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:47.534293 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-0b4cdcb8-f082-42ff-9b40-0b8cdf653b51 tempest-NetworksTest-972309588 tempest-NetworksTest-972309588-project-admin] 10.222.0.58 "GET /compute/v2.1/os-networks" status: 200 len: 5395 microversion: 2.1 time: 0.929716 Aug 10 22:56:47.540044 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 196/383] 10.222.0.58 () {58 vars in 1137 bytes} [Wed Aug 10 22:56:46 2022] GET /compute/v2.1/os-networks => generated 5395 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:56:47.547391 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-e7ecab8d-f265-41a7-99f3-15792f0a8969 tempest-NetworksTest-972309588 tempest-NetworksTest-972309588-project-admin] Calling method '.version_select at 0x7f847d953820>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:47.665660 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-e7ecab8d-f265-41a7-99f3-15792f0a8969 tempest-NetworksTest-972309588 tempest-NetworksTest-972309588-project-admin] 10.222.0.58 "GET /compute/v2.1/os-networks/be521539-5d5d-4685-a1fe-5d99a84b809e" status: 200 len: 652 microversion: 2.1 time: 0.123297 Aug 10 22:56:47.667309 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 197/384] 10.222.0.58 () {58 vars in 1248 bytes} [Wed Aug 10 22:56:47 2022] GET /compute/v2.1/os-networks/be521539-5d5d-4685-a1fe-5d99a84b809e => generated 652 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:56:47.677244 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-999f6a56-eae8-497c-ac81-18216b691fb3 tempest-NetworksTest-972309588 tempest-NetworksTest-972309588-project-admin] Calling method '.version_select at 0x7f847d953550>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:47.717747 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-b481c3ee-6a31-46d1-8f49-cd5664bc22b6 tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-896412760", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:56:47.838971 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.network.neutron [None req-b481c3ee-6a31-46d1-8f49-cd5664bc22b6 tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] validate_networks() for None {{(pid=122632) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 22:56:48.041227 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-999f6a56-eae8-497c-ac81-18216b691fb3 tempest-NetworksTest-972309588 tempest-NetworksTest-972309588-project-admin] 10.222.0.58 "GET /compute/v2.1/os-networks" status: 200 len: 5395 microversion: 2.1 time: 0.368460 Aug 10 22:56:48.044198 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 198/385] 10.222.0.58 () {58 vars in 1137 bytes} [Wed Aug 10 22:56:47 2022] GET /compute/v2.1/os-networks => generated 5395 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:56:48.049908 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-e48f59e0-841b-4a02-be43-46575ac72662 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:48.050979 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-e48f59e0-841b-4a02-be43-46575ac72662 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 9acba217-4a32-4650-a43e-9d998061323c] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:56:48.080272 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e48f59e0-841b-4a02-be43-46575ac72662 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:48.083612 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e48f59e0-841b-4a02-be43-46575ac72662 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:48.086087 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e48f59e0-841b-4a02-be43-46575ac72662 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:48.087030 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e48f59e0-841b-4a02-be43-46575ac72662 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:48.087605 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e48f59e0-841b-4a02-be43-46575ac72662 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:48.089510 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e48f59e0-841b-4a02-be43-46575ac72662 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:48.368744 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-e48f59e0-841b-4a02-be43-46575ac72662 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:48.385172 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-e48f59e0-841b-4a02-be43-46575ac72662 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/9acba217-4a32-4650-a43e-9d998061323c" status: 200 len: 1471 microversion: 2.1 time: 0.338462 Aug 10 22:56:48.386689 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 199/386] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:56:48 2022] GET /compute/v2.1/servers/9acba217-4a32-4650-a43e-9d998061323c => generated 1471 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:56:48.396639 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-f23e5e4a-0089-4a58-b013-c1fca1371b36 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:48.397608 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-f23e5e4a-0089-4a58-b013-c1fca1371b36 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] [instance: baf47131-7a59-4588-9ce6-113709fa8480] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:56:48.405875 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f23e5e4a-0089-4a58-b013-c1fca1371b36 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:48.407234 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f23e5e4a-0089-4a58-b013-c1fca1371b36 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:48.408223 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f23e5e4a-0089-4a58-b013-c1fca1371b36 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:48.409929 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f23e5e4a-0089-4a58-b013-c1fca1371b36 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:48.411099 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f23e5e4a-0089-4a58-b013-c1fca1371b36 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:48.411715 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f23e5e4a-0089-4a58-b013-c1fca1371b36 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:48.622369 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-f23e5e4a-0089-4a58-b013-c1fca1371b36 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:48.635575 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-f23e5e4a-0089-4a58-b013-c1fca1371b36 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:48.640376 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-f23e5e4a-0089-4a58-b013-c1fca1371b36 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:48.645080 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-f23e5e4a-0089-4a58-b013-c1fca1371b36 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] 10.222.0.58 "GET /compute/v2.1/servers/baf47131-7a59-4588-9ce6-113709fa8480" status: 200 len: 1362 microversion: 2.25 time: 0.253610 Aug 10 22:56:48.647353 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 200/387] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 22:56:48 2022] GET /compute/v2.1/servers/baf47131-7a59-4588-9ce6-113709fa8480 => generated 1362 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:56:48.765270 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-b481c3ee-6a31-46d1-8f49-cd5664bc22b6 tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] Flavor limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 22:56:48.765836 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-b481c3ee-6a31-46d1-8f49-cd5664bc22b6 tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] Image limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 22:56:48.767237 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-b481c3ee-6a31-46d1-8f49-cd5664bc22b6 tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] Flavor pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 22:56:48.767645 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-b481c3ee-6a31-46d1-8f49-cd5664bc22b6 tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] Image pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 22:56:48.768053 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-b481c3ee-6a31-46d1-8f49-cd5664bc22b6 tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 22:56:48.792022 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b481c3ee-6a31-46d1-8f49-cd5664bc22b6 tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:48.792507 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b481c3ee-6a31-46d1-8f49-cd5664bc22b6 tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:48.792937 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b481c3ee-6a31-46d1-8f49-cd5664bc22b6 tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:48.793653 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b481c3ee-6a31-46d1-8f49-cd5664bc22b6 tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:48.794104 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b481c3ee-6a31-46d1-8f49-cd5664bc22b6 tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:48.794523 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b481c3ee-6a31-46d1-8f49-cd5664bc22b6 tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:48.832667 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=19 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:56:48.867086 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-b481c3ee-6a31-46d1-8f49-cd5664bc22b6 tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] Getting quotas for project d5c26b1fa1b7409e81790aba647a3049. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 22:56:48.871539 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-b481c3ee-6a31-46d1-8f49-cd5664bc22b6 tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] Getting quotas for user 0fc65c017e774af2829d5cd7a7170995 and project d5c26b1fa1b7409e81790aba647a3049. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 22:56:48.886937 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-b481c3ee-6a31-46d1-8f49-cd5664bc22b6 tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] Going to run 1 instances... {{(pid=122632) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 22:56:48.889809 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-b481c3ee-6a31-46d1-8f49-cd5664bc22b6 tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] [instance: ec0e154c-f1b0-4da5-ba56-b0eb6fa334a9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78ad8905-f66f-4733-8be9-2b260f1fabed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122632) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 22:56:48.956264 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-b481c3ee-6a31-46d1-8f49-cd5664bc22b6 tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.595641 Aug 10 22:56:48.957552 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 188/388] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 22:56:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 1598 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 22:56:48.973366 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-35c3f83a-176d-44cf-b370-6659e06ba4aa tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:48.974297 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-35c3f83a-176d-44cf-b370-6659e06ba4aa tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] [instance: ec0e154c-f1b0-4da5-ba56-b0eb6fa334a9] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:56:49.117816 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-35c3f83a-176d-44cf-b370-6659e06ba4aa tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fc65c017e774af2829d5cd7a7170995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5c26b1fa1b7409e81790aba647a3049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:49.125837 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-35c3f83a-176d-44cf-b370-6659e06ba4aa tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] 10.222.0.58 "GET /compute/v2.1/servers/ec0e154c-f1b0-4da5-ba56-b0eb6fa334a9" status: 200 len: 1213 microversion: 2.1 time: 0.160995 Aug 10 22:56:49.139223 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 201/389] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:56:48 2022] GET /compute/v2.1/servers/ec0e154c-f1b0-4da5-ba56-b0eb6fa334a9 => generated 1213 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:56:49.420068 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-7d10b342-4692-4175-bdb9-616c9f1fc0ab req-656515ad-d37b-4cd2-8f62-93df0734289c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "baf47131-7a59-4588-9ce6-113709fa8480", "tag": "2da43b40-f84d-4748-92ca-1bd0d92e6665"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:56:49.421699 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-ecfd843e-f6e4-4fa2-9897-77a79a35d15b tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:49.424873 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-ecfd843e-f6e4-4fa2-9897-77a79a35d15b tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 9acba217-4a32-4650-a43e-9d998061323c] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:56:49.456514 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-7d10b342-4692-4175-bdb9-616c9f1fc0ab req-656515ad-d37b-4cd2-8f62-93df0734289c service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:49.458110 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-7d10b342-4692-4175-bdb9-616c9f1fc0ab req-656515ad-d37b-4cd2-8f62-93df0734289c service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:49.460671 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-7d10b342-4692-4175-bdb9-616c9f1fc0ab req-656515ad-d37b-4cd2-8f62-93df0734289c service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:49.463758 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ecfd843e-f6e4-4fa2-9897-77a79a35d15b tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:49.466614 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ecfd843e-f6e4-4fa2-9897-77a79a35d15b tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:49.467310 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ecfd843e-f6e4-4fa2-9897-77a79a35d15b tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:49.468212 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ecfd843e-f6e4-4fa2-9897-77a79a35d15b tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:49.469827 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ecfd843e-f6e4-4fa2-9897-77a79a35d15b tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:49.472425 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ecfd843e-f6e4-4fa2-9897-77a79a35d15b tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:49.520769 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-7d10b342-4692-4175-bdb9-616c9f1fc0ab req-656515ad-d37b-4cd2-8f62-93df0734289c service nova] Creating event network-changed:2da43b40-f84d-4748-92ca-1bd0d92e6665 for instance baf47131-7a59-4588-9ce6-113709fa8480 on n-h1-850468-14 Aug 10 22:56:49.536040 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-7d10b342-4692-4175-bdb9-616c9f1fc0ab req-656515ad-d37b-4cd2-8f62-93df0734289c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123853 Aug 10 22:56:49.539456 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 202/390] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 22:56:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:56:49.672294 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-ef62fe7e-52de-49c0-a3b6-744bc43b1c14 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:49.673343 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-ef62fe7e-52de-49c0-a3b6-744bc43b1c14 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] [instance: baf47131-7a59-4588-9ce6-113709fa8480] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:56:49.689836 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ef62fe7e-52de-49c0-a3b6-744bc43b1c14 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:49.691980 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ef62fe7e-52de-49c0-a3b6-744bc43b1c14 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:49.692696 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ef62fe7e-52de-49c0-a3b6-744bc43b1c14 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:49.694834 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ef62fe7e-52de-49c0-a3b6-744bc43b1c14 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:49.695826 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ef62fe7e-52de-49c0-a3b6-744bc43b1c14 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:49.697079 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ef62fe7e-52de-49c0-a3b6-744bc43b1c14 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:49.944599 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=9 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:56:50.017480 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-ecfd843e-f6e4-4fa2-9897-77a79a35d15b tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:50.037067 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-ecfd843e-f6e4-4fa2-9897-77a79a35d15b tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/9acba217-4a32-4650-a43e-9d998061323c" status: 200 len: 1471 microversion: 2.1 time: 0.626224 Aug 10 22:56:50.038904 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 189/391] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:56:49 2022] GET /compute/v2.1/servers/9acba217-4a32-4650-a43e-9d998061323c => generated 1471 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:56:50.149314 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-53526a6f-67b6-49e3-a846-8af74ddd05dc tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:50.150115 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-53526a6f-67b6-49e3-a846-8af74ddd05dc tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] [instance: ec0e154c-f1b0-4da5-ba56-b0eb6fa334a9] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:56:50.169888 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-53526a6f-67b6-49e3-a846-8af74ddd05dc tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:50.170388 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-53526a6f-67b6-49e3-a846-8af74ddd05dc tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:50.175155 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-53526a6f-67b6-49e3-a846-8af74ddd05dc tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:50.182637 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-53526a6f-67b6-49e3-a846-8af74ddd05dc tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:50.183424 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-53526a6f-67b6-49e3-a846-8af74ddd05dc tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:50.184090 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-53526a6f-67b6-49e3-a846-8af74ddd05dc tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:50.384327 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-ef62fe7e-52de-49c0-a3b6-744bc43b1c14 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:50.400869 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-ef62fe7e-52de-49c0-a3b6-744bc43b1c14 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:50.402833 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-ef62fe7e-52de-49c0-a3b6-744bc43b1c14 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:50.403993 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-ef62fe7e-52de-49c0-a3b6-744bc43b1c14 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] 10.222.0.58 "GET /compute/v2.1/servers/baf47131-7a59-4588-9ce6-113709fa8480" status: 200 len: 1362 microversion: 2.25 time: 0.736895 Aug 10 22:56:50.408197 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 203/392] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 22:56:49 2022] GET /compute/v2.1/servers/baf47131-7a59-4588-9ce6-113709fa8480 => generated 1362 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 22:56:50.418945 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-53526a6f-67b6-49e3-a846-8af74ddd05dc tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fc65c017e774af2829d5cd7a7170995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5c26b1fa1b7409e81790aba647a3049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:50.431784 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-53526a6f-67b6-49e3-a846-8af74ddd05dc tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] 10.222.0.58 "GET /compute/v2.1/servers/ec0e154c-f1b0-4da5-ba56-b0eb6fa334a9" status: 200 len: 1217 microversion: 2.1 time: 0.287419 Aug 10 22:56:50.432546 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 190/393] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:56:50 2022] GET /compute/v2.1/servers/ec0e154c-f1b0-4da5-ba56-b0eb6fa334a9 => generated 1217 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:56:51.061460 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-8fb590f1-98ee-4924-bd7e-6c52a9ea8e0c tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:51.062077 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-8fb590f1-98ee-4924-bd7e-6c52a9ea8e0c tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 9acba217-4a32-4650-a43e-9d998061323c] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:56:51.081661 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8fb590f1-98ee-4924-bd7e-6c52a9ea8e0c tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:51.082281 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8fb590f1-98ee-4924-bd7e-6c52a9ea8e0c tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:51.084908 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8fb590f1-98ee-4924-bd7e-6c52a9ea8e0c tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:51.085682 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8fb590f1-98ee-4924-bd7e-6c52a9ea8e0c tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:51.089428 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8fb590f1-98ee-4924-bd7e-6c52a9ea8e0c tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:51.089910 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8fb590f1-98ee-4924-bd7e-6c52a9ea8e0c tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:51.432392 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-a824edc3-d3fa-4bb4-9e21-fdd31d54e313 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:51.433695 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-a824edc3-d3fa-4bb4-9e21-fdd31d54e313 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] [instance: baf47131-7a59-4588-9ce6-113709fa8480] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:56:51.444830 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a824edc3-d3fa-4bb4-9e21-fdd31d54e313 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:51.445884 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a824edc3-d3fa-4bb4-9e21-fdd31d54e313 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:51.447150 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a824edc3-d3fa-4bb4-9e21-fdd31d54e313 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:51.448563 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a824edc3-d3fa-4bb4-9e21-fdd31d54e313 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:51.449887 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a824edc3-d3fa-4bb4-9e21-fdd31d54e313 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:51.450637 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a824edc3-d3fa-4bb4-9e21-fdd31d54e313 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:51.528509 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-8fb590f1-98ee-4924-bd7e-6c52a9ea8e0c tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:51.551027 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-8fb590f1-98ee-4924-bd7e-6c52a9ea8e0c tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/9acba217-4a32-4650-a43e-9d998061323c" status: 200 len: 1471 microversion: 2.1 time: 0.493129 Aug 10 22:56:51.555033 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 204/394] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:56:51 2022] GET /compute/v2.1/servers/9acba217-4a32-4650-a43e-9d998061323c => generated 1471 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:56:51.573379 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-12e809f8-8288-4fee-bd23-ec3523349531 tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:51.574981 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-12e809f8-8288-4fee-bd23-ec3523349531 tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] [instance: ec0e154c-f1b0-4da5-ba56-b0eb6fa334a9] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:56:51.596955 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-12e809f8-8288-4fee-bd23-ec3523349531 tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:51.600938 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-12e809f8-8288-4fee-bd23-ec3523349531 tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:51.602157 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-12e809f8-8288-4fee-bd23-ec3523349531 tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:51.603671 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-12e809f8-8288-4fee-bd23-ec3523349531 tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:51.604701 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-12e809f8-8288-4fee-bd23-ec3523349531 tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:51.606305 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-12e809f8-8288-4fee-bd23-ec3523349531 tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:51.705970 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-12e809f8-8288-4fee-bd23-ec3523349531 tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fc65c017e774af2829d5cd7a7170995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5c26b1fa1b7409e81790aba647a3049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:51.717127 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-12e809f8-8288-4fee-bd23-ec3523349531 tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] 10.222.0.58 "GET /compute/v2.1/servers/ec0e154c-f1b0-4da5-ba56-b0eb6fa334a9" status: 200 len: 1271 microversion: 2.1 time: 0.158879 Aug 10 22:56:51.719300 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 205/395] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:56:51 2022] GET /compute/v2.1/servers/ec0e154c-f1b0-4da5-ba56-b0eb6fa334a9 => generated 1271 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:56:51.917302 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-a824edc3-d3fa-4bb4-9e21-fdd31d54e313 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:51.931066 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-a824edc3-d3fa-4bb4-9e21-fdd31d54e313 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:51.943115 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-a824edc3-d3fa-4bb4-9e21-fdd31d54e313 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:51.946297 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-a824edc3-d3fa-4bb4-9e21-fdd31d54e313 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] 10.222.0.58 "GET /compute/v2.1/servers/baf47131-7a59-4588-9ce6-113709fa8480" status: 200 len: 1362 microversion: 2.25 time: 0.518912 Aug 10 22:56:51.948430 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 191/396] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 22:56:51 2022] GET /compute/v2.1/servers/baf47131-7a59-4588-9ce6-113709fa8480 => generated 1362 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 22:56:52.111393 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c1a6b662-f498-4942-b930-ea3207b4a4a1 tempest-FlavorsExtraSpecsTestJSON-1793020659 tempest-FlavorsExtraSpecsTestJSON-1793020659-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1716282728", "ram": 512, "vcpus": 1, "disk": 10, "id": 1058824747, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:56:52.115103 n-d-850468-14 devstack@n-api.service[122633]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:56:52.115103 n-d-850468-14 devstack@n-api.service[122633]: warnings.warn(msg) Aug 10 22:56:52.127195 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_api:DELETE=11,nova_api:SELECT=84,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:56:52.154542 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-c1a6b662-f498-4942-b930-ea3207b4a4a1 tempest-FlavorsExtraSpecsTestJSON-1793020659 tempest-FlavorsExtraSpecsTestJSON-1793020659-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 0.433728 Aug 10 22:56:52.155516 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 206/397] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 22:56:51 2022] POST /compute/v2.1/flavors => generated 416 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:56:52.169600 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-e99a3cb9-ca36-4110-a60a-65801219babf tempest-FlavorsExtraSpecsTestJSON-1793020659 tempest-FlavorsExtraSpecsTestJSON-1793020659-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:56:52.173771 n-d-850468-14 devstack@n-api.service[122632]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:56:52.173771 n-d-850468-14 devstack@n-api.service[122632]: warnings.warn(msg) Aug 10 22:56:52.255239 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-e99a3cb9-ca36-4110-a60a-65801219babf tempest-FlavorsExtraSpecsTestJSON-1793020659 tempest-FlavorsExtraSpecsTestJSON-1793020659-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors/1058824747/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.089578 Aug 10 22:56:52.255859 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 192/398] 10.222.0.58 () {60 vars in 1224 bytes} [Wed Aug 10 22:56:52 2022] POST /compute/v2.1/flavors/1058824747/os-extra_specs => generated 66 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 22:56:52.578868 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-b36f9786-77b4-43bc-bb41-7d7305cc22f3 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:52.580244 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-b36f9786-77b4-43bc-bb41-7d7305cc22f3 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 9acba217-4a32-4650-a43e-9d998061323c] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:56:52.603162 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b36f9786-77b4-43bc-bb41-7d7305cc22f3 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:52.614159 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b36f9786-77b4-43bc-bb41-7d7305cc22f3 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:52.614651 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b36f9786-77b4-43bc-bb41-7d7305cc22f3 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:52.615447 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b36f9786-77b4-43bc-bb41-7d7305cc22f3 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:52.615923 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b36f9786-77b4-43bc-bb41-7d7305cc22f3 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:52.616373 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b36f9786-77b4-43bc-bb41-7d7305cc22f3 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:52.666964 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-7d4efbfe-13d7-416d-8828-0e66d227363c tempest-FlavorsExtraSpecsTestJSON-774021969 tempest-FlavorsExtraSpecsTestJSON-774021969-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:52.695954 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-7d4efbfe-13d7-416d-8828-0e66d227363c tempest-FlavorsExtraSpecsTestJSON-774021969 tempest-FlavorsExtraSpecsTestJSON-774021969-project] 10.222.0.58 "GET /compute/v2.1/flavors/1058824747/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.433741 Aug 10 22:56:52.698928 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 207/399] 10.222.0.58 () {58 vars in 1203 bytes} [Wed Aug 10 22:56:52 2022] GET /compute/v2.1/flavors/1058824747/os-extra_specs => generated 66 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 22:56:52.714414 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c6074e8b-0e84-40ac-ab0f-f562793f23a9 tempest-FlavorsExtraSpecsTestJSON-1793020659 tempest-FlavorsExtraSpecsTestJSON-1793020659-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:56:52.719937 n-d-850468-14 devstack@n-api.service[122633]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:56:52.719937 n-d-850468-14 devstack@n-api.service[122633]: warnings.warn(msg) Aug 10 22:56:52.751659 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-c6074e8b-0e84-40ac-ab0f-f562793f23a9 tempest-FlavorsExtraSpecsTestJSON-1793020659 tempest-FlavorsExtraSpecsTestJSON-1793020659-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors/1058824747/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.047049 Aug 10 22:56:52.753111 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 208/400] 10.222.0.58 () {60 vars in 1224 bytes} [Wed Aug 10 22:56:52 2022] POST /compute/v2.1/flavors/1058824747/os-extra_specs => generated 66 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 22:56:52.766158 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-fe30a2bf-4f55-4505-b730-3c89f07a9ec1 tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:52.766988 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-fe30a2bf-4f55-4505-b730-3c89f07a9ec1 tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] [instance: ec0e154c-f1b0-4da5-ba56-b0eb6fa334a9] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:56:52.778998 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fe30a2bf-4f55-4505-b730-3c89f07a9ec1 tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:52.780497 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fe30a2bf-4f55-4505-b730-3c89f07a9ec1 tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:52.782088 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fe30a2bf-4f55-4505-b730-3c89f07a9ec1 tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:52.783660 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fe30a2bf-4f55-4505-b730-3c89f07a9ec1 tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:52.788435 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fe30a2bf-4f55-4505-b730-3c89f07a9ec1 tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:52.788735 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fe30a2bf-4f55-4505-b730-3c89f07a9ec1 tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:52.921024 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-fe30a2bf-4f55-4505-b730-3c89f07a9ec1 tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fc65c017e774af2829d5cd7a7170995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5c26b1fa1b7409e81790aba647a3049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:52.931147 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-fe30a2bf-4f55-4505-b730-3c89f07a9ec1 tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] 10.222.0.58 "GET /compute/v2.1/servers/ec0e154c-f1b0-4da5-ba56-b0eb6fa334a9" status: 200 len: 1271 microversion: 2.1 time: 0.176655 Aug 10 22:56:52.931730 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 209/401] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:56:52 2022] GET /compute/v2.1/servers/ec0e154c-f1b0-4da5-ba56-b0eb6fa334a9 => generated 1271 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:56:52.949891 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-89717710-233d-42ec-aa1a-96df50336a40 tempest-FlavorsExtraSpecsTestJSON-774021969 tempest-FlavorsExtraSpecsTestJSON-774021969-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:52.973794 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-89717710-233d-42ec-aa1a-96df50336a40 tempest-FlavorsExtraSpecsTestJSON-774021969 tempest-FlavorsExtraSpecsTestJSON-774021969-project] 10.222.0.58 "GET /compute/v2.1/flavors/1058824747/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.037209 Aug 10 22:56:52.974463 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 210/402] 10.222.0.58 () {58 vars in 1245 bytes} [Wed Aug 10 22:56:52 2022] GET /compute/v2.1/flavors/1058824747/os-extra_specs/hw:numa_nodes => generated 22 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 22:56:52.983249 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-4f233a74-fc3c-49d9-8d8f-a376abe01e19 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:52.983856 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-4f233a74-fc3c-49d9-8d8f-a376abe01e19 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] [instance: baf47131-7a59-4588-9ce6-113709fa8480] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:56:53.000134 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4f233a74-fc3c-49d9-8d8f-a376abe01e19 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:53.003840 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4f233a74-fc3c-49d9-8d8f-a376abe01e19 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:53.004395 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4f233a74-fc3c-49d9-8d8f-a376abe01e19 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:53.005375 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4f233a74-fc3c-49d9-8d8f-a376abe01e19 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:53.005919 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4f233a74-fc3c-49d9-8d8f-a376abe01e19 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:53.009324 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4f233a74-fc3c-49d9-8d8f-a376abe01e19 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:53.269243 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-4f233a74-fc3c-49d9-8d8f-a376abe01e19 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:53.282230 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-4f233a74-fc3c-49d9-8d8f-a376abe01e19 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:53.284203 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-4f233a74-fc3c-49d9-8d8f-a376abe01e19 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:53.289323 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-4f233a74-fc3c-49d9-8d8f-a376abe01e19 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] 10.222.0.58 "GET /compute/v2.1/servers/baf47131-7a59-4588-9ce6-113709fa8480" status: 200 len: 1362 microversion: 2.25 time: 0.313783 Aug 10 22:56:53.290301 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 211/403] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 22:56:52 2022] GET /compute/v2.1/servers/baf47131-7a59-4588-9ce6-113709fa8480 => generated 1362 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:56:53.308262 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-e7301fc0-df7d-4bc9-b0f7-eb67e1506023 tempest-FlavorsExtraSpecsTestJSON-1793020659 tempest-FlavorsExtraSpecsTestJSON-1793020659-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:56:53.312544 n-d-850468-14 devstack@n-api.service[122633]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:56:53.312544 n-d-850468-14 devstack@n-api.service[122633]: warnings.warn(msg) Aug 10 22:56:53.366367 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-e7301fc0-df7d-4bc9-b0f7-eb67e1506023 tempest-FlavorsExtraSpecsTestJSON-1793020659 tempest-FlavorsExtraSpecsTestJSON-1793020659-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors/1058824747/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.074791 Aug 10 22:56:53.367630 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 212/404] 10.222.0.58 () {60 vars in 1224 bytes} [Wed Aug 10 22:56:53 2022] POST /compute/v2.1/flavors/1058824747/os-extra_specs => generated 66 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 22:56:53.380662 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-91ba526f-3690-48ab-9f04-67307e452679 tempest-FlavorsExtraSpecsTestJSON-1793020659 tempest-FlavorsExtraSpecsTestJSON-1793020659-project-admin] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:53.401236 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-91ba526f-3690-48ab-9f04-67307e452679 tempest-FlavorsExtraSpecsTestJSON-1793020659 tempest-FlavorsExtraSpecsTestJSON-1793020659-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/1058824747/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.027443 Aug 10 22:56:53.402124 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 213/405] 10.222.0.58 () {58 vars in 1203 bytes} [Wed Aug 10 22:56:53 2022] GET /compute/v2.1/flavors/1058824747/os-extra_specs => generated 66 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 10 22:56:53.415767 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-5313558d-df81-4a22-b744-89910383bf90 tempest-FlavorsExtraSpecsTestJSON-1793020659 tempest-FlavorsExtraSpecsTestJSON-1793020659-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:56:53.419767 n-d-850468-14 devstack@n-api.service[122633]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:56:53.419767 n-d-850468-14 devstack@n-api.service[122633]: warnings.warn(msg) Aug 10 22:56:53.465411 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-5313558d-df81-4a22-b744-89910383bf90 tempest-FlavorsExtraSpecsTestJSON-1793020659 tempest-FlavorsExtraSpecsTestJSON-1793020659-project-admin] 10.222.0.58 "PUT /compute/v2.1/flavors/1058824747/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.056225 Aug 10 22:56:53.471571 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 214/406] 10.222.0.58 () {60 vars in 1265 bytes} [Wed Aug 10 22:56:53 2022] PUT /compute/v2.1/flavors/1058824747/os-extra_specs/hw:numa_nodes => generated 22 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 22:56:53.486307 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-7c0d4559-6f78-4e40-95d2-e8321ef3016e tempest-FlavorsExtraSpecsTestJSON-1793020659 tempest-FlavorsExtraSpecsTestJSON-1793020659-project-admin] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:53.505311 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-7c0d4559-6f78-4e40-95d2-e8321ef3016e tempest-FlavorsExtraSpecsTestJSON-1793020659 tempest-FlavorsExtraSpecsTestJSON-1793020659-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/1058824747/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.030679 Aug 10 22:56:53.506703 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 215/407] 10.222.0.58 () {58 vars in 1203 bytes} [Wed Aug 10 22:56:53 2022] GET /compute/v2.1/flavors/1058824747/os-extra_specs => generated 66 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 22:56:53.521305 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-ecb453cd-16ca-42b4-a2f8-88554148c62b tempest-FlavorsExtraSpecsTestJSON-1793020659 tempest-FlavorsExtraSpecsTestJSON-1793020659-project-admin] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:53.522515 n-d-850468-14 devstack@n-api.service[122633]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:56:53.522515 n-d-850468-14 devstack@n-api.service[122633]: warnings.warn(msg) Aug 10 22:56:53.623007 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-ecb453cd-16ca-42b4-a2f8-88554148c62b tempest-FlavorsExtraSpecsTestJSON-1793020659 tempest-FlavorsExtraSpecsTestJSON-1793020659-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/1058824747/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.109846 Aug 10 22:56:53.638747 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 216/408] 10.222.0.58 () {58 vars in 1248 bytes} [Wed Aug 10 22:56:53 2022] DELETE /compute/v2.1/flavors/1058824747/os-extra_specs/hw:numa_nodes => generated 0 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 10 22:56:53.649974 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-bda04b77-043f-4c66-843b-08b352719d54 tempest-FlavorsExtraSpecsTestJSON-1793020659 tempest-FlavorsExtraSpecsTestJSON-1793020659-project-admin] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:53.702977 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-bda04b77-043f-4c66-843b-08b352719d54 tempest-FlavorsExtraSpecsTestJSON-1793020659 tempest-FlavorsExtraSpecsTestJSON-1793020659-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/1058824747/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.059827 Aug 10 22:56:53.705067 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 217/409] 10.222.0.58 () {58 vars in 1248 bytes} [Wed Aug 10 22:56:53 2022] DELETE /compute/v2.1/flavors/1058824747/os-extra_specs/hw:cpu_policy => generated 0 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 10 22:56:53.716409 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-dfce162c-042b-48e3-a84c-5f5653eac1d4 tempest-FlavorsExtraSpecsTestJSON-1793020659 tempest-FlavorsExtraSpecsTestJSON-1793020659-project-admin] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:53.731439 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-dfce162c-042b-48e3-a84c-5f5653eac1d4 tempest-FlavorsExtraSpecsTestJSON-1793020659 tempest-FlavorsExtraSpecsTestJSON-1793020659-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/1058824747/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.021394 Aug 10 22:56:53.739884 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 218/410] 10.222.0.58 () {58 vars in 1203 bytes} [Wed Aug 10 22:56:53 2022] GET /compute/v2.1/flavors/1058824747/os-extra_specs => generated 19 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 22:56:53.751741 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-dd5ffbe9-330f-4978-85cf-660b21036e8c tempest-FlavorsExtraSpecsTestJSON-1793020659 tempest-FlavorsExtraSpecsTestJSON-1793020659-project-admin] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:53.752877 n-d-850468-14 devstack@n-api.service[122633]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:56:53.752877 n-d-850468-14 devstack@n-api.service[122633]: warnings.warn(msg) Aug 10 22:56:53.773365 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-dd5ffbe9-330f-4978-85cf-660b21036e8c tempest-FlavorsExtraSpecsTestJSON-1793020659 tempest-FlavorsExtraSpecsTestJSON-1793020659-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/1058824747" status: 202 len: 0 microversion: 2.1 time: 0.031368 Aug 10 22:56:53.777554 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 219/411] 10.222.0.58 () {58 vars in 1161 bytes} [Wed Aug 10 22:56:53 2022] DELETE /compute/v2.1/flavors/1058824747 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 22:56:53.800302 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-471706cc-eb89-421c-ab62-76d7c3a08577 tempest-FlavorsExtraSpecsTestJSON-1793020659 tempest-FlavorsExtraSpecsTestJSON-1793020659-project-admin] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:53.840215 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-471706cc-eb89-421c-ab62-76d7c3a08577 tempest-FlavorsExtraSpecsTestJSON-1793020659 tempest-FlavorsExtraSpecsTestJSON-1793020659-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 5811 microversion: 2.1 time: 0.061108 Aug 10 22:56:53.841306 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 220/412] 10.222.0.58 () {58 vars in 1146 bytes} [Wed Aug 10 22:56:53 2022] GET /compute/v2.1/flavors/detail => generated 5811 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:56:53.953354 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-7b34341b-a653-4c6e-a970-7db792bb1e52 tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:53.954370 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-7b34341b-a653-4c6e-a970-7db792bb1e52 tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] [instance: ec0e154c-f1b0-4da5-ba56-b0eb6fa334a9] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:56:53.965351 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7b34341b-a653-4c6e-a970-7db792bb1e52 tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:53.966475 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7b34341b-a653-4c6e-a970-7db792bb1e52 tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:53.970970 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7b34341b-a653-4c6e-a970-7db792bb1e52 tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:53.973088 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7b34341b-a653-4c6e-a970-7db792bb1e52 tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:53.974410 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7b34341b-a653-4c6e-a970-7db792bb1e52 tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:53.975031 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7b34341b-a653-4c6e-a970-7db792bb1e52 tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:53.990703 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-b36f9786-77b4-43bc-bb41-7d7305cc22f3 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:54.002619 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-b36f9786-77b4-43bc-bb41-7d7305cc22f3 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/9acba217-4a32-4650-a43e-9d998061323c" status: 200 len: 1471 microversion: 2.1 time: 1.426531 Aug 10 22:56:54.016787 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 193/413] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:56:52 2022] GET /compute/v2.1/servers/9acba217-4a32-4650-a43e-9d998061323c => generated 1471 bytes in 1445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:56:54.318712 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-b4fe5d67-d80e-4be9-ae9b-17a8d2b754b9 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:54.321165 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-b4fe5d67-d80e-4be9-ae9b-17a8d2b754b9 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] [instance: baf47131-7a59-4588-9ce6-113709fa8480] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:56:54.342151 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b4fe5d67-d80e-4be9-ae9b-17a8d2b754b9 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:54.344451 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b4fe5d67-d80e-4be9-ae9b-17a8d2b754b9 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:54.346131 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b4fe5d67-d80e-4be9-ae9b-17a8d2b754b9 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:54.347875 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b4fe5d67-d80e-4be9-ae9b-17a8d2b754b9 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:54.349956 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b4fe5d67-d80e-4be9-ae9b-17a8d2b754b9 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:54.351766 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b4fe5d67-d80e-4be9-ae9b-17a8d2b754b9 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:54.654214 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-7b34341b-a653-4c6e-a970-7db792bb1e52 tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fc65c017e774af2829d5cd7a7170995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5c26b1fa1b7409e81790aba647a3049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:54.666133 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-7b34341b-a653-4c6e-a970-7db792bb1e52 tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] 10.222.0.58 "GET /compute/v2.1/servers/ec0e154c-f1b0-4da5-ba56-b0eb6fa334a9" status: 200 len: 1313 microversion: 2.1 time: 0.717717 Aug 10 22:56:54.667127 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 221/414] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:56:53 2022] GET /compute/v2.1/servers/ec0e154c-f1b0-4da5-ba56-b0eb6fa334a9 => generated 1313 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:56:54.958309 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-b4fe5d67-d80e-4be9-ae9b-17a8d2b754b9 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:54.973748 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-b4fe5d67-d80e-4be9-ae9b-17a8d2b754b9 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:54.975904 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-b4fe5d67-d80e-4be9-ae9b-17a8d2b754b9 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:54.977250 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-b4fe5d67-d80e-4be9-ae9b-17a8d2b754b9 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] 10.222.0.58 "GET /compute/v2.1/servers/baf47131-7a59-4588-9ce6-113709fa8480" status: 200 len: 1362 microversion: 2.25 time: 0.664623 Aug 10 22:56:54.982432 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 194/415] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 22:56:54 2022] GET /compute/v2.1/servers/baf47131-7a59-4588-9ce6-113709fa8480 => generated 1362 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:56:54.992257 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-4473fc04-9a94-4538-b4da-36771ba54b04 req-e1676902-5fb1-41e7-8897-0b3762ad739a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec0e154c-f1b0-4da5-ba56-b0eb6fa334a9", "tag": "ddba1774-9d47-4fef-ade3-804429989b56"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:56:55.022022 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-4473fc04-9a94-4538-b4da-36771ba54b04 req-e1676902-5fb1-41e7-8897-0b3762ad739a service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:55.022878 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-4473fc04-9a94-4538-b4da-36771ba54b04 req-e1676902-5fb1-41e7-8897-0b3762ad739a service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:55.023858 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-4473fc04-9a94-4538-b4da-36771ba54b04 req-e1676902-5fb1-41e7-8897-0b3762ad739a service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:55.024290 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-da8977a2-85bd-449c-8a45-349df6074699 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:55.025091 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-da8977a2-85bd-449c-8a45-349df6074699 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 9acba217-4a32-4650-a43e-9d998061323c] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:56:55.038211 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:56:55.039291 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-da8977a2-85bd-449c-8a45-349df6074699 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:55.040178 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-da8977a2-85bd-449c-8a45-349df6074699 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:55.040769 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-da8977a2-85bd-449c-8a45-349df6074699 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:55.041554 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-da8977a2-85bd-449c-8a45-349df6074699 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:55.042427 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-da8977a2-85bd-449c-8a45-349df6074699 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:55.045244 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-da8977a2-85bd-449c-8a45-349df6074699 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:55.065954 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-4473fc04-9a94-4538-b4da-36771ba54b04 req-e1676902-5fb1-41e7-8897-0b3762ad739a service nova] Creating event network-changed:ddba1774-9d47-4fef-ade3-804429989b56 for instance ec0e154c-f1b0-4da5-ba56-b0eb6fa334a9 on n-h2-850468-14 Aug 10 22:56:55.076992 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-4473fc04-9a94-4538-b4da-36771ba54b04 req-e1676902-5fb1-41e7-8897-0b3762ad739a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098952 Aug 10 22:56:55.082979 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 222/416] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 22:56:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:56:55.483218 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-da8977a2-85bd-449c-8a45-349df6074699 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:55.497149 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-da8977a2-85bd-449c-8a45-349df6074699 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/9acba217-4a32-4650-a43e-9d998061323c" status: 200 len: 1471 microversion: 2.1 time: 0.475486 Aug 10 22:56:55.503722 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 195/417] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:56:55 2022] GET /compute/v2.1/servers/9acba217-4a32-4650-a43e-9d998061323c => generated 1471 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:56:55.696703 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-caedb4cd-9592-4fde-8bec-3117acabf17c tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:55.697722 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-caedb4cd-9592-4fde-8bec-3117acabf17c tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] [instance: ec0e154c-f1b0-4da5-ba56-b0eb6fa334a9] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:56:55.709230 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-caedb4cd-9592-4fde-8bec-3117acabf17c tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:55.710709 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-caedb4cd-9592-4fde-8bec-3117acabf17c tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:55.713091 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-caedb4cd-9592-4fde-8bec-3117acabf17c tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:55.714028 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-caedb4cd-9592-4fde-8bec-3117acabf17c tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:55.715094 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-caedb4cd-9592-4fde-8bec-3117acabf17c tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:55.715860 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-caedb4cd-9592-4fde-8bec-3117acabf17c tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:56.009144 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-093faaef-e6a9-49c8-b56c-8dd702f9c13e tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:56.009687 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-093faaef-e6a9-49c8-b56c-8dd702f9c13e tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] [instance: baf47131-7a59-4588-9ce6-113709fa8480] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:56:56.021786 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-093faaef-e6a9-49c8-b56c-8dd702f9c13e tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:56.022292 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-093faaef-e6a9-49c8-b56c-8dd702f9c13e tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:56.022731 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-093faaef-e6a9-49c8-b56c-8dd702f9c13e tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:56.023505 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-093faaef-e6a9-49c8-b56c-8dd702f9c13e tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:56.033523 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-093faaef-e6a9-49c8-b56c-8dd702f9c13e tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:56.044345 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-093faaef-e6a9-49c8-b56c-8dd702f9c13e tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:56.272561 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-caedb4cd-9592-4fde-8bec-3117acabf17c tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fc65c017e774af2829d5cd7a7170995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5c26b1fa1b7409e81790aba647a3049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:56.286646 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-caedb4cd-9592-4fde-8bec-3117acabf17c tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] 10.222.0.58 "GET /compute/v2.1/servers/ec0e154c-f1b0-4da5-ba56-b0eb6fa334a9" status: 200 len: 1313 microversion: 2.1 time: 0.600296 Aug 10 22:56:56.300265 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 223/418] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:56:55 2022] GET /compute/v2.1/servers/ec0e154c-f1b0-4da5-ba56-b0eb6fa334a9 => generated 1313 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:56:56.505651 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-093faaef-e6a9-49c8-b56c-8dd702f9c13e tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:56.530483 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-e643e17b-f512-452f-a7ec-a700ab721b03 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:56.531482 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-e643e17b-f512-452f-a7ec-a700ab721b03 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 9acba217-4a32-4650-a43e-9d998061323c] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:56:56.539217 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-093faaef-e6a9-49c8-b56c-8dd702f9c13e tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:56.544749 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-093faaef-e6a9-49c8-b56c-8dd702f9c13e tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:56.545330 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e643e17b-f512-452f-a7ec-a700ab721b03 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:56.546058 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e643e17b-f512-452f-a7ec-a700ab721b03 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:56.547589 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-093faaef-e6a9-49c8-b56c-8dd702f9c13e tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] 10.222.0.58 "GET /compute/v2.1/servers/baf47131-7a59-4588-9ce6-113709fa8480" status: 200 len: 1362 microversion: 2.25 time: 0.542758 Aug 10 22:56:56.548306 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e643e17b-f512-452f-a7ec-a700ab721b03 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:56.549268 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e643e17b-f512-452f-a7ec-a700ab721b03 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:56.550049 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 196/419] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 22:56:56 2022] GET /compute/v2.1/servers/baf47131-7a59-4588-9ce6-113709fa8480 => generated 1362 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:56:56.550670 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e643e17b-f512-452f-a7ec-a700ab721b03 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:56.551419 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e643e17b-f512-452f-a7ec-a700ab721b03 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:56.787443 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-e643e17b-f512-452f-a7ec-a700ab721b03 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:56.801028 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-e643e17b-f512-452f-a7ec-a700ab721b03 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/9acba217-4a32-4650-a43e-9d998061323c" status: 200 len: 1476 microversion: 2.1 time: 0.275252 Aug 10 22:56:56.805182 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 224/420] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:56:56 2022] GET /compute/v2.1/servers/9acba217-4a32-4650-a43e-9d998061323c => generated 1476 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:56:57.178064 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-7b5ce279-3134-49bc-88d9-c802af151509 req-4040c936-f4c5-4f16-b64f-a6c8a4362b5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "baf47131-7a59-4588-9ce6-113709fa8480", "name": "network-vif-plugged", "status": "completed", "tag": "2da43b40-f84d-4748-92ca-1bd0d92e6665"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:56:57.197983 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-7b5ce279-3134-49bc-88d9-c802af151509 req-4040c936-f4c5-4f16-b64f-a6c8a4362b5a service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:57.198918 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-7b5ce279-3134-49bc-88d9-c802af151509 req-4040c936-f4c5-4f16-b64f-a6c8a4362b5a service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:57.199857 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-7b5ce279-3134-49bc-88d9-c802af151509 req-4040c936-f4c5-4f16-b64f-a6c8a4362b5a service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:57.228712 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-7b5ce279-3134-49bc-88d9-c802af151509 req-4040c936-f4c5-4f16-b64f-a6c8a4362b5a service nova] Creating event network-vif-plugged:2da43b40-f84d-4748-92ca-1bd0d92e6665 for instance baf47131-7a59-4588-9ce6-113709fa8480 on n-h1-850468-14 Aug 10 22:56:57.240216 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-7b5ce279-3134-49bc-88d9-c802af151509 req-4040c936-f4c5-4f16-b64f-a6c8a4362b5a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066346 Aug 10 22:56:57.242492 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 225/421] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 22:56:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:56:57.308748 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-b2c10e2b-2bc9-45f5-9475-96de6c6e58c0 tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:57.309603 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-b2c10e2b-2bc9-45f5-9475-96de6c6e58c0 tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] [instance: ec0e154c-f1b0-4da5-ba56-b0eb6fa334a9] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:56:57.319681 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b2c10e2b-2bc9-45f5-9475-96de6c6e58c0 tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:57.321669 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b2c10e2b-2bc9-45f5-9475-96de6c6e58c0 tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:57.323319 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b2c10e2b-2bc9-45f5-9475-96de6c6e58c0 tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:57.324607 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b2c10e2b-2bc9-45f5-9475-96de6c6e58c0 tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:57.325066 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b2c10e2b-2bc9-45f5-9475-96de6c6e58c0 tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:57.325179 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-3472425b-4c5f-44cf-81aa-33cca00438fb tempest-FlavorsExtraSpecsNegativeTestJSON-33285658 tempest-FlavorsExtraSpecsNegativeTestJSON-33285658-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-311785606", "ram": 512, "vcpus": 1, "disk": 10, "id": 1794450458, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:56:57.325601 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b2c10e2b-2bc9-45f5-9475-96de6c6e58c0 tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:57.329213 n-d-850468-14 devstack@n-api.service[122632]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:56:57.329213 n-d-850468-14 devstack@n-api.service[122632]: warnings.warn(msg) Aug 10 22:56:57.350019 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-3472425b-4c5f-44cf-81aa-33cca00438fb tempest-FlavorsExtraSpecsNegativeTestJSON-33285658 tempest-FlavorsExtraSpecsNegativeTestJSON-33285658-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.576944 Aug 10 22:56:57.352888 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 197/422] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 22:56:56 2022] POST /compute/v2.1/flavors => generated 415 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:56:57.714254 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-b2c10e2b-2bc9-45f5-9475-96de6c6e58c0 tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fc65c017e774af2829d5cd7a7170995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5c26b1fa1b7409e81790aba647a3049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:57.717394 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-b24e5e2f-ece0-45a4-88d2-51a356c258af tempest-FlavorsExtraSpecsNegativeTestJSON-1163806561 tempest-FlavorsExtraSpecsNegativeTestJSON-1163806561-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:57.725223 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-b2c10e2b-2bc9-45f5-9475-96de6c6e58c0 tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] 10.222.0.58 "GET /compute/v2.1/servers/ec0e154c-f1b0-4da5-ba56-b0eb6fa334a9" status: 200 len: 1313 microversion: 2.1 time: 0.420616 Aug 10 22:56:57.731183 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 226/423] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:56:57 2022] GET /compute/v2.1/servers/ec0e154c-f1b0-4da5-ba56-b0eb6fa334a9 => generated 1313 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:56:57.737077 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-b24e5e2f-ece0-45a4-88d2-51a356c258af tempest-FlavorsExtraSpecsNegativeTestJSON-1163806561 tempest-FlavorsExtraSpecsNegativeTestJSON-1163806561-project] HTTP exception thrown: Flavor 1794450458 has no extra specs with key hw:cpu_thread_policy. Aug 10 22:56:57.738347 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-4cd291ba-13b8-4b22-9072-00e3ffb0f5a2 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:57.739173 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-4cd291ba-13b8-4b22-9072-00e3ffb0f5a2 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] [instance: baf47131-7a59-4588-9ce6-113709fa8480] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:56:57.743602 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-b24e5e2f-ece0-45a4-88d2-51a356c258af tempest-FlavorsExtraSpecsNegativeTestJSON-1163806561 tempest-FlavorsExtraSpecsNegativeTestJSON-1163806561-project] Request method failure captured: Aug 10 22:56:57.743602 n-d-850468-14 devstack@n-api.service[122632]: request: GET /compute/v2.1/flavors/1794450458/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Aug 10 22:56:57.743602 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 22:56:57.743602 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 22:56:57.743602 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 22:56:57.743602 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 22:56:57.743602 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 22:56:57.743602 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 22:56:57.743602 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 22:56:57.743602 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 22:56:57.743602 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9De3pJpdbnt1peW719W9Kck9mIUcX1GDH5TxIJfZkXe6JLhHeZhp1F4-8_vdd9TjWyueJ8mm0tIbyvfCKAP5zdgjtQKPxNk73zS2LI56iWOukTDl_F7k9ZQr_TAaH-wiokNNZszZfdBTcDGthUJEmr8MMWojrMaBNn4gsPNvtBCoDpQ Aug 10 22:56:57.743602 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 22:56:57.743602 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 22:56:57.743602 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 22:56:57.743602 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 22:56:57.743602 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 22:56:57.743602 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 22:56:57.743602 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 98a0f117365d4688bc2296959a2b26d4 Aug 10 22:56:57.743602 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1163806561 Aug 10 22:56:57.743602 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 22:56:57.743602 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 22:56:57.746178 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/98a0f117365d4688bc2296959a2b26d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/98a0f117365d4688bc2296959a2b26d4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/98a0f117365d4688bc2296959a2b26d4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_98a0f117365d4688bc2296959a2b26d4", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 22:56:57.746178 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1163806561 Aug 10 22:56:57.746178 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 98a0f117365d4688bc2296959a2b26d4 Aug 10 22:56:57.746178 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1163806561 Aug 10 22:56:57.746178 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1163806561-project Aug 10 22:56:57.746178 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 22:56:57.746178 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 22:56:57.746178 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: 5a6f554de33242939b60f5c25c34c3af Aug 10 22:56:57.746178 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1163806561-project Aug 10 22:56:57.746178 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 22:56:57.746178 n-d-850468-14 devstack@n-api.service[122632]: exception: Flavor 1794450458 has no extra specs with key hw:cpu_thread_policy. Aug 10 22:56:57.747211 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'flavor_id': '1794450458', 'id': 'hw:cpu_thread_policy'} Aug 10 22:56:57.747211 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 22:56:57.747211 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:56:57.747211 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Aug 10 22:56:57.747211 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Aug 10 22:56:57.747211 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Aug 10 22:56:57.747211 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:56:57.747211 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:56:57.747211 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:56:57.747211 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:56:57.747211 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:56:57.747211 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:56:57.747211 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 22:56:57.747211 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 22:56:57.747211 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 22:56:57.747211 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 22:56:57.747211 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Aug 10 22:56:57.747211 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 10 22:56:57.747211 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1794450458 has no extra specs with key hw:cpu_thread_policy. Aug 10 22:56:57.747211 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:56:57.747211 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:56:57.747211 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:56:57.749291 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:56:57.749291 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:56:57.749291 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:56:57.749291 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 22:56:57.749291 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 22:56:57.749291 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1794450458 has no extra specs with key hw:cpu_thread_policy. Aug 10 22:56:57.749291 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:56:57.749291 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-b24e5e2f-ece0-45a4-88d2-51a356c258af tempest-FlavorsExtraSpecsNegativeTestJSON-1163806561 tempest-FlavorsExtraSpecsNegativeTestJSON-1163806561-project] Returning 404 to user: Flavor 1794450458 has no extra specs with key hw:cpu_thread_policy. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 22:56:57.749291 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-b24e5e2f-ece0-45a4-88d2-51a356c258af tempest-FlavorsExtraSpecsNegativeTestJSON-1163806561 tempest-FlavorsExtraSpecsNegativeTestJSON-1163806561-project] 10.222.0.58 "GET /compute/v2.1/flavors/1794450458/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.383409 Aug 10 22:56:57.750296 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4cd291ba-13b8-4b22-9072-00e3ffb0f5a2 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:57.750296 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4cd291ba-13b8-4b22-9072-00e3ffb0f5a2 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:57.750296 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4cd291ba-13b8-4b22-9072-00e3ffb0f5a2 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:57.751808 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4cd291ba-13b8-4b22-9072-00e3ffb0f5a2 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:57.751808 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4cd291ba-13b8-4b22-9072-00e3ffb0f5a2 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:57.751808 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4cd291ba-13b8-4b22-9072-00e3ffb0f5a2 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:57.754877 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 198/424] 10.222.0.58 () {58 vars in 1266 bytes} [Wed Aug 10 22:56:57 2022] GET /compute/v2.1/flavors/1794450458/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 387 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 22:56:58.012699 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-d6cf4e87-afa2-4c11-87b0-ab398c174991 tempest-QuotaClassesAdmin257Test-1288001643 tempest-QuotaClassesAdmin257Test-1288001643-project-admin] Calling method '.version_select at 0x7f847d9501f0>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:58.013896 n-d-850468-14 devstack@n-api.service[122632]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:56:58.013896 n-d-850468-14 devstack@n-api.service[122632]: warnings.warn(msg) Aug 10 22:56:58.022870 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-4cd291ba-13b8-4b22-9072-00e3ffb0f5a2 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:58.034602 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-d6cf4e87-afa2-4c11-87b0-ab398c174991 tempest-QuotaClassesAdmin257Test-1288001643 tempest-QuotaClassesAdmin257Test-1288001643-project-admin] 10.222.0.58 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.277715 Aug 10 22:56:58.035900 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 199/425] 10.222.0.58 () {60 vars in 1226 bytes} [Wed Aug 10 22:56:57 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 22:56:58.042347 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-4cd291ba-13b8-4b22-9072-00e3ffb0f5a2 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:58.043232 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-95962aa0-3577-41f3-9307-d4323c4a1944 tempest-FlavorsExtraSpecsNegativeTestJSON-1163806561 tempest-FlavorsExtraSpecsNegativeTestJSON-1163806561-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:56:58.044026 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-4cd291ba-13b8-4b22-9072-00e3ffb0f5a2 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:58.046874 n-d-850468-14 devstack@n-api.service[122632]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:56:58.046874 n-d-850468-14 devstack@n-api.service[122632]: warnings.warn(msg) Aug 10 22:56:58.049130 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-95962aa0-3577-41f3-9307-d4323c4a1944 tempest-FlavorsExtraSpecsNegativeTestJSON-1163806561 tempest-FlavorsExtraSpecsNegativeTestJSON-1163806561-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': '5a6f554de33242939b60f5c25c34c3af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98a0f117365d4688bc2296959a2b26d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:58.050672 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-4cd291ba-13b8-4b22-9072-00e3ffb0f5a2 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] 10.222.0.58 "GET /compute/v2.1/servers/baf47131-7a59-4588-9ce6-113709fa8480" status: 200 len: 1362 microversion: 2.25 time: 0.318667 Aug 10 22:56:58.051240 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-95962aa0-3577-41f3-9307-d4323c4a1944 tempest-FlavorsExtraSpecsNegativeTestJSON-1163806561 tempest-FlavorsExtraSpecsNegativeTestJSON-1163806561-project] Request method failure captured: Aug 10 22:56:58.051240 n-d-850468-14 devstack@n-api.service[122632]: request: POST /compute/v2.1/flavors/1794450458/os-extra_specs HTTP/1.1 Aug 10 22:56:58.051240 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 22:56:58.051240 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 22:56:58.051240 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 22:56:58.051240 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 66 Aug 10 22:56:58.051240 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 22:56:58.051240 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 22:56:58.051240 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 22:56:58.051240 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 22:56:58.051240 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9De3pJpdbnt1peW719W9Kck9mIUcX1GDH5TxIJfZkXe6JLhHeZhp1F4-8_vdd9TjWyueJ8mm0tIbyvfCKAP5zdgjtQKPxNk73zS2LI56iWOukTDl_F7k9ZQr_TAaH-wiokNNZszZfdBTcDGthUJEmr8MMWojrMaBNn4gsPNvtBCoDpQ Aug 10 22:56:58.051240 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 22:56:58.051240 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 22:56:58.051240 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 22:56:58.051240 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 22:56:58.051240 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 22:56:58.051240 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 22:56:58.051240 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 98a0f117365d4688bc2296959a2b26d4 Aug 10 22:56:58.051240 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1163806561 Aug 10 22:56:58.051240 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 22:56:58.051240 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 22:56:58.052780 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/98a0f117365d4688bc2296959a2b26d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/98a0f117365d4688bc2296959a2b26d4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/98a0f117365d4688bc2296959a2b26d4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_98a0f117365d4688bc2296959a2b26d4", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 22:56:58.052780 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1163806561 Aug 10 22:56:58.052780 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 98a0f117365d4688bc2296959a2b26d4 Aug 10 22:56:58.052780 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1163806561 Aug 10 22:56:58.052780 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1163806561-project Aug 10 22:56:58.052780 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 22:56:58.052780 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 22:56:58.052780 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: 5a6f554de33242939b60f5c25c34c3af Aug 10 22:56:58.052780 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1163806561-project Aug 10 22:56:58.052780 n-d-850468-14 devstack@n-api.service[122632]: Aug 10 22:56:58.052780 n-d-850468-14 devstack@n-api.service[122632]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Aug 10 22:56:58.052780 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 22:56:58.053883 n-d-850468-14 devstack@n-api.service[122632]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Aug 10 22:56:58.053883 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'flavor_id': '1794450458', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Aug 10 22:56:58.053883 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 22:56:58.053883 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:56:58.053883 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:56:58.053883 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:56:58.053883 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 22:56:58.053883 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 22:56:58.053883 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 22:56:58.053883 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 22:56:58.053883 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 22:56:58.053883 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 22:56:58.053883 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Aug 10 22:56:58.053883 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Aug 10 22:56:58.053883 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 10 22:56:58.053883 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 10 22:56:58.053883 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 10 22:56:58.053883 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 10 22:56:58.053883 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 10 22:56:58.055312 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 10 22:56:58.055312 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 10 22:56:58.055312 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise self.value Aug 10 22:56:58.055312 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 10 22:56:58.055312 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 10 22:56:58.055312 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 10 22:56:58.055312 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 10 22:56:58.055312 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 10 22:56:58.055312 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 10 22:56:58.055312 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Aug 10 22:56:58.055312 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:56:58.055312 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:56:58.055312 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:56:58.055312 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:56:58.055312 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:56:58.055312 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:56:58.055312 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 10 22:56:58.055312 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 10 22:56:58.055312 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Aug 10 22:56:58.055312 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:56:58.056982 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 227/426] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 22:56:57 2022] GET /compute/v2.1/servers/baf47131-7a59-4588-9ce6-113709fa8480 => generated 1362 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:56:58.058261 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-95962aa0-3577-41f3-9307-d4323c4a1944 tempest-FlavorsExtraSpecsNegativeTestJSON-1163806561 tempest-FlavorsExtraSpecsNegativeTestJSON-1163806561-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 22:56:58.059552 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-95962aa0-3577-41f3-9307-d4323c4a1944 tempest-FlavorsExtraSpecsNegativeTestJSON-1163806561 tempest-FlavorsExtraSpecsNegativeTestJSON-1163806561-project] 10.222.0.58 "POST /compute/v2.1/flavors/1794450458/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.022424 Aug 10 22:56:58.060763 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 200/427] 10.222.0.58 () {60 vars in 1224 bytes} [Wed Aug 10 22:56:58 2022] POST /compute/v2.1/flavors/1794450458/os-extra_specs => generated 124 bytes in 24 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 10 22:56:58.066561 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-76086f06-7caf-4ade-83c7-b99f23a31ead tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:58.067121 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-dbdf2e30-d92a-401e-a118-4b4d5330574b tempest-QuotaClassesAdmin257Test-1288001643 tempest-QuotaClassesAdmin257Test-1288001643-project-admin] Action: 'update', calling method: .version_select at 0x7f847d8bf4c0>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:56:58.069277 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-76086f06-7caf-4ade-83c7-b99f23a31ead tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 9acba217-4a32-4650-a43e-9d998061323c] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:56:58.071091 n-d-850468-14 devstack@n-api.service[122632]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:56:58.071091 n-d-850468-14 devstack@n-api.service[122632]: warnings.warn(msg) Aug 10 22:56:58.083948 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-76086f06-7caf-4ade-83c7-b99f23a31ead tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:58.084449 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-76086f06-7caf-4ade-83c7-b99f23a31ead tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:58.084890 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-76086f06-7caf-4ade-83c7-b99f23a31ead tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:58.087935 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-76086f06-7caf-4ade-83c7-b99f23a31ead tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:58.088422 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-76086f06-7caf-4ade-83c7-b99f23a31ead tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:58.088858 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-76086f06-7caf-4ade-83c7-b99f23a31ead tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:58.296266 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_api:INSERT=13,nova_api:SELECT=78,nova_api:SAVEPOINT=2,nova_api:RELEASE=2,nova_api:UPDATE=5 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:56:58.373573 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-76086f06-7caf-4ade-83c7-b99f23a31ead tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:58.379439 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-dbdf2e30-d92a-401e-a118-4b4d5330574b tempest-QuotaClassesAdmin257Test-1288001643 tempest-QuotaClassesAdmin257Test-1288001643-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.317324 Aug 10 22:56:58.381207 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 201/428] 10.222.0.58 () {62 vars in 1247 bytes} [Wed Aug 10 22:56:58 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 22:56:58.383746 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-76086f06-7caf-4ade-83c7-b99f23a31ead tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/9acba217-4a32-4650-a43e-9d998061323c" status: 200 len: 1476 microversion: 2.1 time: 0.331324 Aug 10 22:56:58.384454 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 228/429] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:56:58 2022] GET /compute/v2.1/servers/9acba217-4a32-4650-a43e-9d998061323c => generated 1476 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:56:58.399007 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-897250c2-ca8d-4b51-be3a-f613980d144c tempest-FlavorsExtraSpecsNegativeTestJSON-33285658 tempest-FlavorsExtraSpecsNegativeTestJSON-33285658-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:56:58.399254 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-d675f203-7bb8-45b6-a7cf-ab794efc082e tempest-QuotaClassesAdmin257Test-1288001643 tempest-QuotaClassesAdmin257Test-1288001643-project-admin] Calling method '.version_select at 0x7f847d857af0>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:58.402707 n-d-850468-14 devstack@n-api.service[122633]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:56:58.402707 n-d-850468-14 devstack@n-api.service[122633]: warnings.warn(msg) Aug 10 22:56:58.423300 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-d675f203-7bb8-45b6-a7cf-ab794efc082e tempest-QuotaClassesAdmin257Test-1288001643 tempest-QuotaClassesAdmin257Test-1288001643-project-admin] 10.222.0.58 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.033077 Aug 10 22:56:58.424693 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 229/430] 10.222.0.58 () {60 vars in 1226 bytes} [Wed Aug 10 22:56:58 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 22:56:58.457230 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-897250c2-ca8d-4b51-be3a-f613980d144c tempest-FlavorsExtraSpecsNegativeTestJSON-33285658 tempest-FlavorsExtraSpecsNegativeTestJSON-33285658-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors/1794450458/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.074560 Aug 10 22:56:58.457516 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-480863b5-802c-4ba3-bb60-152e89e0bd57 tempest-QuotaClassesAdmin257Test-1288001643 tempest-QuotaClassesAdmin257Test-1288001643-project-admin] Action: 'update', calling method: .version_select at 0x7f847d969a60>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:56:58.457681 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 202/431] 10.222.0.58 () {60 vars in 1224 bytes} [Wed Aug 10 22:56:58 2022] POST /compute/v2.1/flavors/1794450458/os-extra_specs => generated 66 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 22:56:58.461554 n-d-850468-14 devstack@n-api.service[122633]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:56:58.461554 n-d-850468-14 devstack@n-api.service[122633]: warnings.warn(msg) Aug 10 22:56:58.472097 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-56eace9a-5225-48a8-931a-6f8b1417c901 tempest-FlavorsExtraSpecsNegativeTestJSON-1163806561 tempest-FlavorsExtraSpecsNegativeTestJSON-1163806561-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:58.474510 n-d-850468-14 devstack@n-api.service[122632]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:56:58.474510 n-d-850468-14 devstack@n-api.service[122632]: warnings.warn(msg) Aug 10 22:56:58.475757 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-56eace9a-5225-48a8-931a-6f8b1417c901 tempest-FlavorsExtraSpecsNegativeTestJSON-1163806561 tempest-FlavorsExtraSpecsNegativeTestJSON-1163806561-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': '5a6f554de33242939b60f5c25c34c3af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98a0f117365d4688bc2296959a2b26d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:58.477543 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-56eace9a-5225-48a8-931a-6f8b1417c901 tempest-FlavorsExtraSpecsNegativeTestJSON-1163806561 tempest-FlavorsExtraSpecsNegativeTestJSON-1163806561-project] Request method failure captured: Aug 10 22:56:58.477543 n-d-850468-14 devstack@n-api.service[122632]: request: DELETE /compute/v2.1/flavors/1794450458/os-extra_specs/hw:numa_nodes HTTP/1.1 Aug 10 22:56:58.477543 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 22:56:58.477543 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 22:56:58.477543 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 22:56:58.477543 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 22:56:58.477543 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 22:56:58.477543 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 22:56:58.477543 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 22:56:58.477543 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 22:56:58.477543 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9De3pJpdbnt1peW719W9Kck9mIUcX1GDH5TxIJfZkXe6JLhHeZhp1F4-8_vdd9TjWyueJ8mm0tIbyvfCKAP5zdgjtQKPxNk73zS2LI56iWOukTDl_F7k9ZQr_TAaH-wiokNNZszZfdBTcDGthUJEmr8MMWojrMaBNn4gsPNvtBCoDpQ Aug 10 22:56:58.477543 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 22:56:58.477543 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 22:56:58.477543 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 22:56:58.477543 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 22:56:58.477543 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 22:56:58.477543 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 22:56:58.477543 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 98a0f117365d4688bc2296959a2b26d4 Aug 10 22:56:58.477543 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1163806561 Aug 10 22:56:58.477543 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 22:56:58.477543 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 22:56:58.479038 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/98a0f117365d4688bc2296959a2b26d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/98a0f117365d4688bc2296959a2b26d4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/98a0f117365d4688bc2296959a2b26d4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_98a0f117365d4688bc2296959a2b26d4", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 22:56:58.479038 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1163806561 Aug 10 22:56:58.479038 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 98a0f117365d4688bc2296959a2b26d4 Aug 10 22:56:58.479038 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1163806561 Aug 10 22:56:58.479038 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1163806561-project Aug 10 22:56:58.479038 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 22:56:58.479038 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 22:56:58.479038 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: 5a6f554de33242939b60f5c25c34c3af Aug 10 22:56:58.479038 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1163806561-project Aug 10 22:56:58.479038 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 22:56:58.479038 n-d-850468-14 devstack@n-api.service[122632]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Aug 10 22:56:58.479797 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'flavor_id': '1794450458', 'id': 'hw:numa_nodes'} Aug 10 22:56:58.479797 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 22:56:58.479797 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:56:58.479797 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:56:58.479797 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:56:58.479797 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 22:56:58.479797 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 22:56:58.479797 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 22:56:58.479797 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 22:56:58.479797 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Aug 10 22:56:58.479797 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Aug 10 22:56:58.479797 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 10 22:56:58.479797 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 10 22:56:58.479797 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 10 22:56:58.479797 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 10 22:56:58.479797 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 10 22:56:58.479797 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 10 22:56:58.479797 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 10 22:56:58.479797 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise self.value Aug 10 22:56:58.479797 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 10 22:56:58.481073 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 10 22:56:58.481073 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 10 22:56:58.481073 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 10 22:56:58.481073 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 10 22:56:58.481073 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 10 22:56:58.481073 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Aug 10 22:56:58.481073 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:56:58.481073 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:56:58.481073 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:56:58.481073 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:56:58.481073 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:56:58.481073 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:56:58.481073 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 10 22:56:58.481073 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 10 22:56:58.481073 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Aug 10 22:56:58.481073 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:56:58.483579 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-56eace9a-5225-48a8-931a-6f8b1417c901 tempest-FlavorsExtraSpecsNegativeTestJSON-1163806561 tempest-FlavorsExtraSpecsNegativeTestJSON-1163806561-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 22:56:58.485598 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-56eace9a-5225-48a8-931a-6f8b1417c901 tempest-FlavorsExtraSpecsNegativeTestJSON-1163806561 tempest-FlavorsExtraSpecsNegativeTestJSON-1163806561-project] 10.222.0.58 "DELETE /compute/v2.1/flavors/1794450458/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.020756 Aug 10 22:56:58.491908 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 203/432] 10.222.0.58 () {58 vars in 1248 bytes} [Wed Aug 10 22:56:58 2022] DELETE /compute/v2.1/flavors/1794450458/os-extra_specs/hw:numa_nodes => generated 124 bytes in 28 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 10 22:56:58.498377 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-f05725de-2f6a-4779-b007-ac0af14fe030 tempest-FlavorsExtraSpecsNegativeTestJSON-33285658 tempest-FlavorsExtraSpecsNegativeTestJSON-33285658-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:56:58.528335 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-f05725de-2f6a-4779-b007-ac0af14fe030 tempest-FlavorsExtraSpecsNegativeTestJSON-33285658 tempest-FlavorsExtraSpecsNegativeTestJSON-33285658-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors/1794450458/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.034649 Aug 10 22:56:58.536047 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 204/433] 10.222.0.58 () {60 vars in 1224 bytes} [Wed Aug 10 22:56:58 2022] POST /compute/v2.1/flavors/1794450458/os-extra_specs => generated 66 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 22:56:58.543077 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-650799fc-a526-4ff4-8c0d-5ae2f026295b tempest-FlavorsExtraSpecsNegativeTestJSON-1163806561 tempest-FlavorsExtraSpecsNegativeTestJSON-1163806561-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:56:58.546032 n-d-850468-14 devstack@n-api.service[122632]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:56:58.546032 n-d-850468-14 devstack@n-api.service[122632]: warnings.warn(msg) Aug 10 22:56:58.548482 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-650799fc-a526-4ff4-8c0d-5ae2f026295b tempest-FlavorsExtraSpecsNegativeTestJSON-1163806561 tempest-FlavorsExtraSpecsNegativeTestJSON-1163806561-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': '5a6f554de33242939b60f5c25c34c3af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98a0f117365d4688bc2296959a2b26d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:58.550832 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-650799fc-a526-4ff4-8c0d-5ae2f026295b tempest-FlavorsExtraSpecsNegativeTestJSON-1163806561 tempest-FlavorsExtraSpecsNegativeTestJSON-1163806561-project] Request method failure captured: Aug 10 22:56:58.550832 n-d-850468-14 devstack@n-api.service[122632]: request: PUT /compute/v2.1/flavors/1794450458/os-extra_specs/hw:numa_nodes HTTP/1.1 Aug 10 22:56:58.550832 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 22:56:58.550832 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 22:56:58.550832 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 22:56:58.550832 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 22 Aug 10 22:56:58.550832 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 22:56:58.550832 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 22:56:58.550832 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 22:56:58.550832 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 22:56:58.550832 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9De3pJpdbnt1peW719W9Kck9mIUcX1GDH5TxIJfZkXe6JLhHeZhp1F4-8_vdd9TjWyueJ8mm0tIbyvfCKAP5zdgjtQKPxNk73zS2LI56iWOukTDl_F7k9ZQr_TAaH-wiokNNZszZfdBTcDGthUJEmr8MMWojrMaBNn4gsPNvtBCoDpQ Aug 10 22:56:58.550832 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 22:56:58.550832 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 22:56:58.550832 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 22:56:58.550832 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 22:56:58.550832 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 22:56:58.550832 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 22:56:58.550832 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 98a0f117365d4688bc2296959a2b26d4 Aug 10 22:56:58.550832 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1163806561 Aug 10 22:56:58.550832 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 22:56:58.550832 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 22:56:58.552216 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/98a0f117365d4688bc2296959a2b26d4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/98a0f117365d4688bc2296959a2b26d4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/98a0f117365d4688bc2296959a2b26d4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_98a0f117365d4688bc2296959a2b26d4", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 22:56:58.552216 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1163806561 Aug 10 22:56:58.552216 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 98a0f117365d4688bc2296959a2b26d4 Aug 10 22:56:58.552216 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1163806561 Aug 10 22:56:58.552216 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1163806561-project Aug 10 22:56:58.552216 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 22:56:58.552216 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 22:56:58.552216 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: 5a6f554de33242939b60f5c25c34c3af Aug 10 22:56:58.552216 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1163806561-project Aug 10 22:56:58.552216 n-d-850468-14 devstack@n-api.service[122632]: Aug 10 22:56:58.552216 n-d-850468-14 devstack@n-api.service[122632]: {"hw:numa_nodes": "1"} Aug 10 22:56:58.552216 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 22:56:58.552216 n-d-850468-14 devstack@n-api.service[122632]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Aug 10 22:56:58.553228 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'flavor_id': '1794450458', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Aug 10 22:56:58.553228 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 22:56:58.553228 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:56:58.553228 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:56:58.553228 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:56:58.553228 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 22:56:58.553228 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 22:56:58.553228 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 22:56:58.553228 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 22:56:58.553228 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 22:56:58.553228 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 22:56:58.553228 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Aug 10 22:56:58.553228 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Aug 10 22:56:58.553228 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 10 22:56:58.553228 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 10 22:56:58.553228 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 10 22:56:58.553228 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 10 22:56:58.553228 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 10 22:56:58.553228 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 10 22:56:58.554723 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 10 22:56:58.554723 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise self.value Aug 10 22:56:58.554723 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 10 22:56:58.554723 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 10 22:56:58.554723 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 10 22:56:58.554723 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 10 22:56:58.554723 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 10 22:56:58.554723 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 10 22:56:58.554723 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Aug 10 22:56:58.554723 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:56:58.554723 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:56:58.554723 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:56:58.554723 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:56:58.554723 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:56:58.554723 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:56:58.554723 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 10 22:56:58.554723 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 10 22:56:58.554723 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Aug 10 22:56:58.554723 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:56:58.559829 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_api:SELECT=75,nova_api:SAVEPOINT=7,nova_api:RELEASE=7,nova_api:UPDATE=6,nova_api:DELETE=5 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:56:58.560390 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-650799fc-a526-4ff4-8c0d-5ae2f026295b tempest-FlavorsExtraSpecsNegativeTestJSON-1163806561 tempest-FlavorsExtraSpecsNegativeTestJSON-1163806561-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 22:56:58.561498 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-650799fc-a526-4ff4-8c0d-5ae2f026295b tempest-FlavorsExtraSpecsNegativeTestJSON-1163806561 tempest-FlavorsExtraSpecsNegativeTestJSON-1163806561-project] 10.222.0.58 "PUT /compute/v2.1/flavors/1794450458/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.024237 Aug 10 22:56:58.568241 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 205/434] 10.222.0.58 () {60 vars in 1265 bytes} [Wed Aug 10 22:56:58 2022] PUT /compute/v2.1/flavors/1794450458/os-extra_specs/hw:numa_nodes => generated 124 bytes in 31 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 10 22:56:58.573883 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-bc2f380d-617d-4582-8ffe-31d8b6994a95 tempest-FlavorsExtraSpecsNegativeTestJSON-33285658 tempest-FlavorsExtraSpecsNegativeTestJSON-33285658-project-admin] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:58.587429 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-bc2f380d-617d-4582-8ffe-31d8b6994a95 tempest-FlavorsExtraSpecsNegativeTestJSON-33285658 tempest-FlavorsExtraSpecsNegativeTestJSON-33285658-project-admin] HTTP exception thrown: Flavor 1794450458 has no extra specs with key hw:cpu_thread_policy. Aug 10 22:56:58.594205 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-bc2f380d-617d-4582-8ffe-31d8b6994a95 tempest-FlavorsExtraSpecsNegativeTestJSON-33285658 tempest-FlavorsExtraSpecsNegativeTestJSON-33285658-project-admin] Request method failure captured: Aug 10 22:56:58.594205 n-d-850468-14 devstack@n-api.service[122632]: request: DELETE /compute/v2.1/flavors/1794450458/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Aug 10 22:56:58.594205 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 22:56:58.594205 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 22:56:58.594205 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 22:56:58.594205 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 22:56:58.594205 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 22:56:58.594205 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 22:56:58.594205 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 22:56:58.594205 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 22:56:58.594205 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9De4atvtlZGf_HkJPuMOE1sgLc-hU6i8hJzFvffVt-6AX5wRBAZ418lci4h-C8Bb8sPNZm3JC-3PKsqmY21GGulkYWOgOlKQ0ik-oRaMVB-ShjwESGucqZeQq_6pywYjU2rRuiKMGX1U-xCPtamdpAdDkHkAFf3uJzavBARb_JvsPgE Aug 10 22:56:58.594205 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 22:56:58.594205 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 22:56:58.594205 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 22:56:58.594205 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 22:56:58.594205 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 22:56:58.594205 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 22:56:58.594205 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 226704868a3c4076a4cd0d6a4b32c91f Aug 10 22:56:58.594205 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-33285658 Aug 10 22:56:58.594205 n-d-850468-14 devstack@n-api.service[122632]: X-Role: admin,member,reader Aug 10 22:56:58.594205 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: admin,member,reader Aug 10 22:56:58.596418 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/226704868a3c4076a4cd0d6a4b32c91f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/226704868a3c4076a4cd0d6a4b32c91f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/226704868a3c4076a4cd0d6a4b32c91f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_226704868a3c4076a4cd0d6a4b32c91f", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 22:56:58.596418 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-33285658 Aug 10 22:56:58.596418 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 226704868a3c4076a4cd0d6a4b32c91f Aug 10 22:56:58.596418 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-33285658 Aug 10 22:56:58.596418 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-33285658-project-admin Aug 10 22:56:58.596418 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 22:56:58.596418 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 22:56:58.596418 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: f0272032fda3494bb402a3643ffcf4c2 Aug 10 22:56:58.596418 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-33285658-project-admin Aug 10 22:56:58.596418 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 22:56:58.596418 n-d-850468-14 devstack@n-api.service[122632]: exception: Flavor 1794450458 has no extra specs with key hw:cpu_thread_policy. Aug 10 22:56:58.597194 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'flavor_id': '1794450458', 'id': 'hw:cpu_thread_policy'} Aug 10 22:56:58.597194 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 22:56:58.597194 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:56:58.597194 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Aug 10 22:56:58.597194 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Aug 10 22:56:58.597194 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Aug 10 22:56:58.597194 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:56:58.597194 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:56:58.597194 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:56:58.597194 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:56:58.597194 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:56:58.597194 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:56:58.597194 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 22:56:58.597194 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 22:56:58.597194 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 22:56:58.597194 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 22:56:58.597194 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Aug 10 22:56:58.597194 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 10 22:56:58.597194 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1794450458 has no extra specs with key hw:cpu_thread_policy. Aug 10 22:56:58.597194 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:56:58.597194 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:56:58.597194 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:56:58.598515 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:56:58.598515 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:56:58.598515 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:56:58.598515 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 22:56:58.598515 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 22:56:58.598515 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1794450458 has no extra specs with key hw:cpu_thread_policy. Aug 10 22:56:58.598515 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:56:58.600659 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-bc2f380d-617d-4582-8ffe-31d8b6994a95 tempest-FlavorsExtraSpecsNegativeTestJSON-33285658 tempest-FlavorsExtraSpecsNegativeTestJSON-33285658-project-admin] Returning 404 to user: Flavor 1794450458 has no extra specs with key hw:cpu_thread_policy. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 22:56:58.602327 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-bc2f380d-617d-4582-8ffe-31d8b6994a95 tempest-FlavorsExtraSpecsNegativeTestJSON-33285658 tempest-FlavorsExtraSpecsNegativeTestJSON-33285658-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/1794450458/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.033234 Aug 10 22:56:58.604112 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 206/435] 10.222.0.58 () {58 vars in 1269 bytes} [Wed Aug 10 22:56:58 2022] DELETE /compute/v2.1/flavors/1794450458/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 22:56:58.610927 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-480863b5-802c-4ba3-bb60-152e89e0bd57 tempest-QuotaClassesAdmin257Test-1288001643 tempest-QuotaClassesAdmin257Test-1288001643-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.177796 Aug 10 22:56:58.619376 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 230/436] 10.222.0.58 () {62 vars in 1247 bytes} [Wed Aug 10 22:56:58 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 22:56:58.623879 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-3eee3f54-212e-40d6-a050-c036f7bddc47 tempest-FlavorsExtraSpecsNegativeTestJSON-33285658 tempest-FlavorsExtraSpecsNegativeTestJSON-33285658-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:56:58.627471 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-3eee3f54-212e-40d6-a050-c036f7bddc47 tempest-FlavorsExtraSpecsNegativeTestJSON-33285658 tempest-FlavorsExtraSpecsNegativeTestJSON-33285658-project-admin] HTTP exception thrown: Request body and URI mismatch Aug 10 22:56:58.632401 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-3eee3f54-212e-40d6-a050-c036f7bddc47 tempest-FlavorsExtraSpecsNegativeTestJSON-33285658 tempest-FlavorsExtraSpecsNegativeTestJSON-33285658-project-admin] Request method failure captured: Aug 10 22:56:58.632401 n-d-850468-14 devstack@n-api.service[122632]: request: PUT /compute/v2.1/flavors/1794450458/os-extra_specs/hw:numa_nodes HTTP/1.1 Aug 10 22:56:58.632401 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 22:56:58.632401 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 22:56:58.632401 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 22:56:58.632401 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 27 Aug 10 22:56:58.632401 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 22:56:58.632401 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 22:56:58.632401 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 22:56:58.632401 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 22:56:58.632401 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9De4atvtlZGf_HkJPuMOE1sgLc-hU6i8hJzFvffVt-6AX5wRBAZ418lci4h-C8Bb8sPNZm3JC-3PKsqmY21GGulkYWOgOlKQ0ik-oRaMVB-ShjwESGucqZeQq_6pywYjU2rRuiKMGX1U-xCPtamdpAdDkHkAFf3uJzavBARb_JvsPgE Aug 10 22:56:58.632401 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 22:56:58.632401 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 22:56:58.632401 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 22:56:58.632401 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 22:56:58.632401 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 22:56:58.632401 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 22:56:58.632401 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 226704868a3c4076a4cd0d6a4b32c91f Aug 10 22:56:58.632401 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-33285658 Aug 10 22:56:58.632401 n-d-850468-14 devstack@n-api.service[122632]: X-Role: admin,member,reader Aug 10 22:56:58.632401 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: admin,member,reader Aug 10 22:56:58.633635 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/226704868a3c4076a4cd0d6a4b32c91f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/226704868a3c4076a4cd0d6a4b32c91f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/226704868a3c4076a4cd0d6a4b32c91f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_226704868a3c4076a4cd0d6a4b32c91f", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 22:56:58.633635 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-33285658 Aug 10 22:56:58.633635 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 226704868a3c4076a4cd0d6a4b32c91f Aug 10 22:56:58.633635 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-33285658 Aug 10 22:56:58.633635 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-33285658-project-admin Aug 10 22:56:58.633635 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 22:56:58.633635 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 22:56:58.633635 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: f0272032fda3494bb402a3643ffcf4c2 Aug 10 22:56:58.633635 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-33285658-project-admin Aug 10 22:56:58.633635 n-d-850468-14 devstack@n-api.service[122632]: Aug 10 22:56:58.633635 n-d-850468-14 devstack@n-api.service[122632]: {"hw:cpu_policy": "shared"} Aug 10 22:56:58.633635 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 22:56:58.633635 n-d-850468-14 devstack@n-api.service[122632]: exception: Request body and URI mismatch Aug 10 22:56:58.634356 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'flavor_id': '1794450458', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Aug 10 22:56:58.634356 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 22:56:58.634356 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:56:58.634356 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:56:58.634356 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:56:58.634356 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 22:56:58.634356 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 22:56:58.634356 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 22:56:58.634356 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 22:56:58.634356 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 22:56:58.634356 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 22:56:58.634356 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Aug 10 22:56:58.634356 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Aug 10 22:56:58.634356 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Aug 10 22:56:58.634356 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:56:58.634356 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:56:58.634356 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:56:58.634356 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:56:58.634356 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:56:58.634356 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:56:58.635518 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 22:56:58.635518 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 22:56:58.635518 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Aug 10 22:56:58.635518 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:56:58.635518 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-3eee3f54-212e-40d6-a050-c036f7bddc47 tempest-FlavorsExtraSpecsNegativeTestJSON-33285658 tempest-FlavorsExtraSpecsNegativeTestJSON-33285658-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 22:56:58.635518 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-3eee3f54-212e-40d6-a050-c036f7bddc47 tempest-FlavorsExtraSpecsNegativeTestJSON-33285658 tempest-FlavorsExtraSpecsNegativeTestJSON-33285658-project-admin] 10.222.0.58 "PUT /compute/v2.1/flavors/1794450458/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.023515 Aug 10 22:56:58.638255 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 207/437] 10.222.0.58 () {60 vars in 1265 bytes} [Wed Aug 10 22:56:58 2022] PUT /compute/v2.1/flavors/1794450458/os-extra_specs/hw:numa_nodes => generated 73 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Aug 10 22:56:58.648273 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c6ca295b-8b4b-410d-bb03-445339ed4a67 tempest-FlavorsExtraSpecsNegativeTestJSON-33285658 tempest-FlavorsExtraSpecsNegativeTestJSON-33285658-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:56:58.656133 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c6ca295b-8b4b-410d-bb03-445339ed4a67 tempest-FlavorsExtraSpecsNegativeTestJSON-33285658 tempest-FlavorsExtraSpecsNegativeTestJSON-33285658-project-admin] Request method failure captured: Aug 10 22:56:58.656133 n-d-850468-14 devstack@n-api.service[122633]: request: PUT /compute/v2.1/flavors/1794450458/os-extra_specs/hw:numa_nodes HTTP/1.1 Aug 10 22:56:58.656133 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 22:56:58.656133 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 22:56:58.656133 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 22:56:58.656133 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 49 Aug 10 22:56:58.656133 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 22:56:58.656133 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 22:56:58.656133 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 22:56:58.656133 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 22:56:58.656133 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9De4atvtlZGf_HkJPuMOE1sgLc-hU6i8hJzFvffVt-6AX5wRBAZ418lci4h-C8Bb8sPNZm3JC-3PKsqmY21GGulkYWOgOlKQ0ik-oRaMVB-ShjwESGucqZeQq_6pywYjU2rRuiKMGX1U-xCPtamdpAdDkHkAFf3uJzavBARb_JvsPgE Aug 10 22:56:58.656133 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 22:56:58.656133 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 22:56:58.656133 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 22:56:58.656133 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 22:56:58.656133 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 22:56:58.656133 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 22:56:58.656133 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 226704868a3c4076a4cd0d6a4b32c91f Aug 10 22:56:58.656133 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-33285658 Aug 10 22:56:58.656133 n-d-850468-14 devstack@n-api.service[122633]: X-Role: admin,member,reader Aug 10 22:56:58.656133 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: admin,member,reader Aug 10 22:56:58.658427 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/226704868a3c4076a4cd0d6a4b32c91f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/226704868a3c4076a4cd0d6a4b32c91f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/226704868a3c4076a4cd0d6a4b32c91f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_226704868a3c4076a4cd0d6a4b32c91f", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 22:56:58.658427 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-33285658 Aug 10 22:56:58.658427 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 226704868a3c4076a4cd0d6a4b32c91f Aug 10 22:56:58.658427 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-33285658 Aug 10 22:56:58.658427 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-33285658-project-admin Aug 10 22:56:58.658427 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 22:56:58.658427 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 22:56:58.658427 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: f0272032fda3494bb402a3643ffcf4c2 Aug 10 22:56:58.658427 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-33285658-project-admin Aug 10 22:56:58.658427 n-d-850468-14 devstack@n-api.service[122633]: Aug 10 22:56:58.658427 n-d-850468-14 devstack@n-api.service[122633]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Aug 10 22:56:58.658427 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 22:56:58.659332 n-d-850468-14 devstack@n-api.service[122633]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Aug 10 22:56:58.659332 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'flavor_id': '1794450458', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Aug 10 22:56:58.659332 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 22:56:58.659332 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:56:58.659332 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 10 22:56:58.659332 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 10 22:56:58.659332 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 10 22:56:58.659332 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise error Aug 10 22:56:58.659332 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Aug 10 22:56:58.659332 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:56:58.659332 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Aug 10 22:56:58.659332 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 10 22:56:58.659332 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Aug 10 22:56:58.659332 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Aug 10 22:56:58.659332 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 10 22:56:58.659332 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi 'type': ['string', Aug 10 22:56:58.659332 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi 'number']}}, Aug 10 22:56:58.659332 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 10 22:56:58.659332 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:56:58.659332 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi On instance: Aug 10 22:56:58.659332 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Aug 10 22:56:58.659332 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:56:58.660747 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:56:58.660747 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:56:58.660747 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:56:58.660747 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:56:58.660747 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:56:58.660747 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 22:56:58.660747 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 22:56:58.660747 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 22:56:58.660747 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 22:56:58.660747 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 10 22:56:58.660747 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 10 22:56:58.660747 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 10 22:56:58.660747 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 10 22:56:58.660747 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 10 22:56:58.660747 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 10 22:56:58.660747 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Aug 10 22:56:58.660747 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:56:58.660747 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:56:58.660747 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:56:58.660747 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:56:58.662056 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:56:58.662056 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:56:58.662056 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 10 22:56:58.662056 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 10 22:56:58.662056 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Aug 10 22:56:58.662056 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:56:58.662056 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c6ca295b-8b4b-410d-bb03-445339ed4a67 tempest-FlavorsExtraSpecsNegativeTestJSON-33285658 tempest-FlavorsExtraSpecsNegativeTestJSON-33285658-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 22:56:58.662056 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-c6ca295b-8b4b-410d-bb03-445339ed4a67 tempest-FlavorsExtraSpecsNegativeTestJSON-33285658 tempest-FlavorsExtraSpecsNegativeTestJSON-33285658-project-admin] 10.222.0.58 "PUT /compute/v2.1/flavors/1794450458/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.018062 Aug 10 22:56:58.663295 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 231/438] 10.222.0.58 () {60 vars in 1265 bytes} [Wed Aug 10 22:56:58 2022] PUT /compute/v2.1/flavors/1794450458/os-extra_specs/hw:numa_nodes => generated 117 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 10 22:56:58.671703 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-acce531d-3868-43b6-8b15-602341ed8dab tempest-FlavorsExtraSpecsNegativeTestJSON-33285658 tempest-FlavorsExtraSpecsNegativeTestJSON-33285658-project-admin] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:58.672703 n-d-850468-14 devstack@n-api.service[122632]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:56:58.672703 n-d-850468-14 devstack@n-api.service[122632]: warnings.warn(msg) Aug 10 22:56:58.703056 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-acce531d-3868-43b6-8b15-602341ed8dab tempest-FlavorsExtraSpecsNegativeTestJSON-33285658 tempest-FlavorsExtraSpecsNegativeTestJSON-33285658-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/1794450458" status: 202 len: 0 microversion: 2.1 time: 0.035413 Aug 10 22:56:58.705070 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 208/439] 10.222.0.58 () {58 vars in 1161 bytes} [Wed Aug 10 22:56:58 2022] DELETE /compute/v2.1/flavors/1794450458 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 22:56:58.712103 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-3b20295d-c72a-46ee-9c64-61cb4904b0e0 tempest-FlavorsExtraSpecsNegativeTestJSON-33285658 tempest-FlavorsExtraSpecsNegativeTestJSON-33285658-project-admin] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:58.749892 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-8c18ea0d-a24c-40ae-8951-69239c51d507 tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:58.750510 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-8c18ea0d-a24c-40ae-8951-69239c51d507 tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] [instance: ec0e154c-f1b0-4da5-ba56-b0eb6fa334a9] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:56:58.762044 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8c18ea0d-a24c-40ae-8951-69239c51d507 tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:58.763770 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8c18ea0d-a24c-40ae-8951-69239c51d507 tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:58.764204 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8c18ea0d-a24c-40ae-8951-69239c51d507 tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:58.768852 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8c18ea0d-a24c-40ae-8951-69239c51d507 tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:58.769449 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8c18ea0d-a24c-40ae-8951-69239c51d507 tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:58.769892 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8c18ea0d-a24c-40ae-8951-69239c51d507 tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:58.774698 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-3b20295d-c72a-46ee-9c64-61cb4904b0e0 tempest-FlavorsExtraSpecsNegativeTestJSON-33285658 tempest-FlavorsExtraSpecsNegativeTestJSON-33285658-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 5811 microversion: 2.1 time: 0.066487 Aug 10 22:56:58.786876 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 232/440] 10.222.0.58 () {58 vars in 1146 bytes} [Wed Aug 10 22:56:58 2022] GET /compute/v2.1/flavors/detail => generated 5811 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:56:58.839636 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=1 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:56:59.012238 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-8c18ea0d-a24c-40ae-8951-69239c51d507 tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fc65c017e774af2829d5cd7a7170995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5c26b1fa1b7409e81790aba647a3049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:59.026136 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-8c18ea0d-a24c-40ae-8951-69239c51d507 tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] 10.222.0.58 "GET /compute/v2.1/servers/ec0e154c-f1b0-4da5-ba56-b0eb6fa334a9" status: 200 len: 1313 microversion: 2.1 time: 0.278249 Aug 10 22:56:59.028882 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 209/441] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:56:58 2022] GET /compute/v2.1/servers/ec0e154c-f1b0-4da5-ba56-b0eb6fa334a9 => generated 1313 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:56:59.078398 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-ffb427ac-c996-4e7b-b420-f1905e1e18dd tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:59.078398 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-ffb427ac-c996-4e7b-b420-f1905e1e18dd tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] [instance: baf47131-7a59-4588-9ce6-113709fa8480] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:56:59.084799 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ffb427ac-c996-4e7b-b420-f1905e1e18dd tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:59.085220 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ffb427ac-c996-4e7b-b420-f1905e1e18dd tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:59.085657 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ffb427ac-c996-4e7b-b420-f1905e1e18dd tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:59.086361 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ffb427ac-c996-4e7b-b420-f1905e1e18dd tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:59.087042 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ffb427ac-c996-4e7b-b420-f1905e1e18dd tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:59.087472 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ffb427ac-c996-4e7b-b420-f1905e1e18dd tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:59.325719 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-ffb427ac-c996-4e7b-b420-f1905e1e18dd tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:59.338372 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-ffb427ac-c996-4e7b-b420-f1905e1e18dd tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:59.339924 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-ffb427ac-c996-4e7b-b420-f1905e1e18dd tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:56:59.341105 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-ffb427ac-c996-4e7b-b420-f1905e1e18dd tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] 10.222.0.58 "GET /compute/v2.1/servers/baf47131-7a59-4588-9ce6-113709fa8480" status: 200 len: 1559 microversion: 2.25 time: 0.269186 Aug 10 22:56:59.347295 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 233/442] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 22:56:59 2022] GET /compute/v2.1/servers/baf47131-7a59-4588-9ce6-113709fa8480 => generated 1559 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:56:59.408962 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-883af722-aafa-46d7-9547-dff5fd3c3de0 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:56:59.409800 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-883af722-aafa-46d7-9547-dff5fd3c3de0 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 9acba217-4a32-4650-a43e-9d998061323c] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:56:59.418007 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-883af722-aafa-46d7-9547-dff5fd3c3de0 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:59.418504 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-883af722-aafa-46d7-9547-dff5fd3c3de0 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:59.419150 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-883af722-aafa-46d7-9547-dff5fd3c3de0 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:56:59.419695 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-883af722-aafa-46d7-9547-dff5fd3c3de0 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:56:59.420152 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-883af722-aafa-46d7-9547-dff5fd3c3de0 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:56:59.420577 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-883af722-aafa-46d7-9547-dff5fd3c3de0 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:00.001175 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-883af722-aafa-46d7-9547-dff5fd3c3de0 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:00.001533 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-b9cf9198-d15c-4ab8-b3b0-ad07819b7c71 tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:00.002013 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-b9cf9198-d15c-4ab8-b3b0-ad07819b7c71 tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] [instance: baf47131-7a59-4588-9ce6-113709fa8480] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:57:00.023526 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b9cf9198-d15c-4ab8-b3b0-ad07819b7c71 tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:00.024064 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b9cf9198-d15c-4ab8-b3b0-ad07819b7c71 tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:00.024515 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b9cf9198-d15c-4ab8-b3b0-ad07819b7c71 tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:00.025252 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b9cf9198-d15c-4ab8-b3b0-ad07819b7c71 tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:00.025715 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b9cf9198-d15c-4ab8-b3b0-ad07819b7c71 tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:00.026265 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b9cf9198-d15c-4ab8-b3b0-ad07819b7c71 tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:00.030337 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-883af722-aafa-46d7-9547-dff5fd3c3de0 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/9acba217-4a32-4650-a43e-9d998061323c" status: 200 len: 1476 microversion: 2.1 time: 0.608896 Aug 10 22:57:00.036862 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 234/443] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:56:59 2022] GET /compute/v2.1/servers/9acba217-4a32-4650-a43e-9d998061323c => generated 1476 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:57:00.051137 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-452e536e-33ef-4574-9778-c6423dc54258 tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:00.053264 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-452e536e-33ef-4574-9778-c6423dc54258 tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] [instance: ec0e154c-f1b0-4da5-ba56-b0eb6fa334a9] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:57:00.069651 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-452e536e-33ef-4574-9778-c6423dc54258 tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:00.070323 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-452e536e-33ef-4574-9778-c6423dc54258 tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:00.074927 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-452e536e-33ef-4574-9778-c6423dc54258 tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:00.076902 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-452e536e-33ef-4574-9778-c6423dc54258 tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:00.079747 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-452e536e-33ef-4574-9778-c6423dc54258 tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:00.083771 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-452e536e-33ef-4574-9778-c6423dc54258 tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:00.408961 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-452e536e-33ef-4574-9778-c6423dc54258 tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fc65c017e774af2829d5cd7a7170995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5c26b1fa1b7409e81790aba647a3049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:00.417427 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.objects.instance [None req-b9cf9198-d15c-4ab8-b3b0-ad07819b7c71 tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Lazy-loading 'services' on Instance uuid baf47131-7a59-4588-9ce6-113709fa8480 {{(pid=122632) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 22:57:00.424916 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-452e536e-33ef-4574-9778-c6423dc54258 tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] 10.222.0.58 "GET /compute/v2.1/servers/ec0e154c-f1b0-4da5-ba56-b0eb6fa334a9" status: 200 len: 1313 microversion: 2.1 time: 0.379243 Aug 10 22:57:00.431050 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 235/444] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:57:00 2022] GET /compute/v2.1/servers/ec0e154c-f1b0-4da5-ba56-b0eb6fa334a9 => generated 1313 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:57:00.524453 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-b9cf9198-d15c-4ab8-b3b0-ad07819b7c71 tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/baf47131-7a59-4588-9ce6-113709fa8480" status: 200 len: 2054 microversion: 2.25 time: 1.163271 Aug 10 22:57:00.525298 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 210/445] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 22:56:59 2022] GET /compute/v2.1/servers/baf47131-7a59-4588-9ce6-113709fa8480 => generated 2054 bytes in 1165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:57:00.550878 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-34aa3014-b083-4c21-9ade-ba644ab37799 tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:00.551774 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-34aa3014-b083-4c21-9ade-ba644ab37799 tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] [instance: baf47131-7a59-4588-9ce6-113709fa8480] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:57:00.605307 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-34aa3014-b083-4c21-9ade-ba644ab37799 tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:00.608004 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-34aa3014-b083-4c21-9ade-ba644ab37799 tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:00.609199 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-34aa3014-b083-4c21-9ade-ba644ab37799 tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:00.613404 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-34aa3014-b083-4c21-9ade-ba644ab37799 tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:00.614112 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-34aa3014-b083-4c21-9ade-ba644ab37799 tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:00.615083 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-34aa3014-b083-4c21-9ade-ba644ab37799 tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:00.849771 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.objects.instance [None req-34aa3014-b083-4c21-9ade-ba644ab37799 tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Lazy-loading 'services' on Instance uuid baf47131-7a59-4588-9ce6-113709fa8480 {{(pid=122633) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 22:57:00.935853 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-34aa3014-b083-4c21-9ade-ba644ab37799 tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/baf47131-7a59-4588-9ce6-113709fa8480" status: 200 len: 2054 microversion: 2.25 time: 0.389246 Aug 10 22:57:00.937136 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 236/446] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 22:57:00 2022] GET /compute/v2.1/servers/baf47131-7a59-4588-9ce6-113709fa8480 => generated 2054 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:57:00.960244 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-fe34f724-2e26-4cdd-8075-2fd40eeaae4b tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:00.963103 n-d-850468-14 devstack@n-api.service[122632]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:57:00.963103 n-d-850468-14 devstack@n-api.service[122632]: warnings.warn(msg) Aug 10 22:57:00.964491 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fe34f724-2e26-4cdd-8075-2fd40eeaae4b tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:00.966618 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fe34f724-2e26-4cdd-8075-2fd40eeaae4b tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:00.967435 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fe34f724-2e26-4cdd-8075-2fd40eeaae4b tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:00.973629 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fe34f724-2e26-4cdd-8075-2fd40eeaae4b tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:00.974308 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fe34f724-2e26-4cdd-8075-2fd40eeaae4b tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:00.974932 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fe34f724-2e26-4cdd-8075-2fd40eeaae4b tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:01.005427 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-fe34f724-2e26-4cdd-8075-2fd40eeaae4b tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] 10.222.0.58 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.049075 Aug 10 22:57:01.006340 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 211/447] 10.222.0.58 () {60 vars in 1217 bytes} [Wed Aug 10 22:57:00 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 22:57:01.020559 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-8d2da3f2-5735-47b2-914e-38ae8df67b14 tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-850468-14", "block_migration": "auto"}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:57:01.023091 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-8d2da3f2-5735-47b2-914e-38ae8df67b14 tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] [instance: baf47131-7a59-4588-9ce6-113709fa8480] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:57:01.040373 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8d2da3f2-5735-47b2-914e-38ae8df67b14 tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:01.040917 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8d2da3f2-5735-47b2-914e-38ae8df67b14 tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:01.041353 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8d2da3f2-5735-47b2-914e-38ae8df67b14 tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:01.042063 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8d2da3f2-5735-47b2-914e-38ae8df67b14 tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:01.042548 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8d2da3f2-5735-47b2-914e-38ae8df67b14 tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:01.042985 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8d2da3f2-5735-47b2-914e-38ae8df67b14 tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:01.058414 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-af6611c2-8dfa-41dc-bb8b-08158bbdf455 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:01.059123 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-af6611c2-8dfa-41dc-bb8b-08158bbdf455 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 9acba217-4a32-4650-a43e-9d998061323c] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:57:01.081911 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-af6611c2-8dfa-41dc-bb8b-08158bbdf455 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:01.082599 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-af6611c2-8dfa-41dc-bb8b-08158bbdf455 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:01.083084 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-af6611c2-8dfa-41dc-bb8b-08158bbdf455 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:01.086865 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-af6611c2-8dfa-41dc-bb8b-08158bbdf455 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:01.087549 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-af6611c2-8dfa-41dc-bb8b-08158bbdf455 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:01.088927 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-af6611c2-8dfa-41dc-bb8b-08158bbdf455 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:01.249689 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.objects.instance [None req-8d2da3f2-5735-47b2-914e-38ae8df67b14 tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Lazy-loading 'flavor' on Instance uuid baf47131-7a59-4588-9ce6-113709fa8480 {{(pid=122633) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 22:57:01.363940 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-8d2da3f2-5735-47b2-914e-38ae8df67b14 tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] [instance: baf47131-7a59-4588-9ce6-113709fa8480] Going to try to live migrate instance to n-h2-850468-14 {{(pid=122633) live_migrate /opt/stack/nova/nova/compute/api.py:5443}} Aug 10 22:57:01.634281 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-af6611c2-8dfa-41dc-bb8b-08158bbdf455 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:01.651103 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-af6611c2-8dfa-41dc-bb8b-08158bbdf455 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/9acba217-4a32-4650-a43e-9d998061323c" status: 200 len: 1476 microversion: 2.1 time: 0.596836 Aug 10 22:57:01.665253 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 212/448] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:57:01 2022] GET /compute/v2.1/servers/9acba217-4a32-4650-a43e-9d998061323c => generated 1476 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:57:01.674386 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-0caddb83-96fc-417a-9004-37a55a7dcb8f req-91dbb98d-dab4-491e-b712-d875bc80ea23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec0e154c-f1b0-4da5-ba56-b0eb6fa334a9", "name": "network-vif-plugged", "status": "completed", "tag": "ddba1774-9d47-4fef-ade3-804429989b56"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:57:01.701038 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-0caddb83-96fc-417a-9004-37a55a7dcb8f req-91dbb98d-dab4-491e-b712-d875bc80ea23 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:01.701550 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-0caddb83-96fc-417a-9004-37a55a7dcb8f req-91dbb98d-dab4-491e-b712-d875bc80ea23 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:01.702365 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-0caddb83-96fc-417a-9004-37a55a7dcb8f req-91dbb98d-dab4-491e-b712-d875bc80ea23 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:01.739586 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=100 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:57:01.742494 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-0caddb83-96fc-417a-9004-37a55a7dcb8f req-91dbb98d-dab4-491e-b712-d875bc80ea23 service nova] Creating event network-vif-plugged:ddba1774-9d47-4fef-ade3-804429989b56 for instance ec0e154c-f1b0-4da5-ba56-b0eb6fa334a9 on n-h2-850468-14 Aug 10 22:57:01.771555 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-0caddb83-96fc-417a-9004-37a55a7dcb8f req-91dbb98d-dab4-491e-b712-d875bc80ea23 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115795 Aug 10 22:57:01.772407 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 213/449] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 22:57:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:57:01.779724 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c0f8b32f-083f-4ad7-b699-00f5a0fee44b tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:01.781375 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-c0f8b32f-083f-4ad7-b699-00f5a0fee44b tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] [instance: ec0e154c-f1b0-4da5-ba56-b0eb6fa334a9] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:57:01.791716 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c0f8b32f-083f-4ad7-b699-00f5a0fee44b tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:01.792431 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c0f8b32f-083f-4ad7-b699-00f5a0fee44b tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:01.807515 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c0f8b32f-083f-4ad7-b699-00f5a0fee44b tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:01.809508 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c0f8b32f-083f-4ad7-b699-00f5a0fee44b tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:01.810387 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c0f8b32f-083f-4ad7-b699-00f5a0fee44b tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:01.817295 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c0f8b32f-083f-4ad7-b699-00f5a0fee44b tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:02.260070 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-c0f8b32f-083f-4ad7-b699-00f5a0fee44b tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fc65c017e774af2829d5cd7a7170995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5c26b1fa1b7409e81790aba647a3049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:02.279245 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-c0f8b32f-083f-4ad7-b699-00f5a0fee44b tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] 10.222.0.58 "GET /compute/v2.1/servers/ec0e154c-f1b0-4da5-ba56-b0eb6fa334a9" status: 200 len: 1313 microversion: 2.1 time: 0.505427 Aug 10 22:57:02.296358 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 214/450] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:57:01 2022] GET /compute/v2.1/servers/ec0e154c-f1b0-4da5-ba56-b0eb6fa334a9 => generated 1313 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:57:02.675025 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-89a0bbc9-7d56-482a-86aa-30a868595149 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:02.676022 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-89a0bbc9-7d56-482a-86aa-30a868595149 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 9acba217-4a32-4650-a43e-9d998061323c] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:57:02.691099 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-89a0bbc9-7d56-482a-86aa-30a868595149 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:02.699361 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-89a0bbc9-7d56-482a-86aa-30a868595149 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:02.699921 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-89a0bbc9-7d56-482a-86aa-30a868595149 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:02.700712 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-89a0bbc9-7d56-482a-86aa-30a868595149 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:02.701213 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-89a0bbc9-7d56-482a-86aa-30a868595149 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:02.704832 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-89a0bbc9-7d56-482a-86aa-30a868595149 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:03.088828 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-89a0bbc9-7d56-482a-86aa-30a868595149 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:03.126987 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-89a0bbc9-7d56-482a-86aa-30a868595149 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/9acba217-4a32-4650-a43e-9d998061323c" status: 200 len: 1476 microversion: 2.1 time: 0.449162 Aug 10 22:57:03.130272 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 215/451] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:57:02 2022] GET /compute/v2.1/servers/9acba217-4a32-4650-a43e-9d998061323c => generated 1476 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:57:03.677207 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-d50e364c-aaf2-4799-bacc-80c0a6b14022 tempest-SecurityGroupsTestAdminJSON-575839645 tempest-SecurityGroupsTestAdminJSON-575839645-project] Action: 'create', calling method: .version_select at 0x7f847d8c3670>, body: {"security_group": {"name": "tempest-securitygroup-1457101293", "description": "tempest-description-1231851859"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:57:04.531178 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-d50e364c-aaf2-4799-bacc-80c0a6b14022 tempest-SecurityGroupsTestAdminJSON-575839645 tempest-SecurityGroupsTestAdminJSON-575839645-project] 10.222.0.58 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 1.290651 Aug 10 22:57:04.531178 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 216/452] 10.222.0.58 () {60 vars in 1180 bytes} [Wed Aug 10 22:57:03 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 1293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:57:04.544019 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-67c7eb8c-e869-4cf1-8a76-af24a9576b4a tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:04.545986 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-67c7eb8c-e869-4cf1-8a76-af24a9576b4a tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] [instance: ec0e154c-f1b0-4da5-ba56-b0eb6fa334a9] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:57:04.559011 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-67c7eb8c-e869-4cf1-8a76-af24a9576b4a tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:04.561296 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-67c7eb8c-e869-4cf1-8a76-af24a9576b4a tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:04.562856 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-67c7eb8c-e869-4cf1-8a76-af24a9576b4a tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:04.564454 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-67c7eb8c-e869-4cf1-8a76-af24a9576b4a tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:04.565228 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-67c7eb8c-e869-4cf1-8a76-af24a9576b4a tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:04.565927 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-67c7eb8c-e869-4cf1-8a76-af24a9576b4a tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:04.802136 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-67c7eb8c-e869-4cf1-8a76-af24a9576b4a tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fc65c017e774af2829d5cd7a7170995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5c26b1fa1b7409e81790aba647a3049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:04.812383 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-67c7eb8c-e869-4cf1-8a76-af24a9576b4a tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] 10.222.0.58 "GET /compute/v2.1/servers/ec0e154c-f1b0-4da5-ba56-b0eb6fa334a9" status: 200 len: 1462 microversion: 2.1 time: 0.282857 Aug 10 22:57:04.827411 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 217/453] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:57:04 2022] GET /compute/v2.1/servers/ec0e154c-f1b0-4da5-ba56-b0eb6fa334a9 => generated 1462 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:57:04.836870 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-28f233d7-accd-4510-a674-7900455fd08e tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:04.837999 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-28f233d7-accd-4510-a674-7900455fd08e tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 9acba217-4a32-4650-a43e-9d998061323c] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:57:04.844351 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-28f233d7-accd-4510-a674-7900455fd08e tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:04.845154 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-28f233d7-accd-4510-a674-7900455fd08e tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:04.845779 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-28f233d7-accd-4510-a674-7900455fd08e tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:04.846653 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-28f233d7-accd-4510-a674-7900455fd08e tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:04.847562 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-28f233d7-accd-4510-a674-7900455fd08e tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:04.848147 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-28f233d7-accd-4510-a674-7900455fd08e tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:05.395287 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-28f233d7-accd-4510-a674-7900455fd08e tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:05.406146 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-28f233d7-accd-4510-a674-7900455fd08e tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/9acba217-4a32-4650-a43e-9d998061323c" status: 200 len: 1476 microversion: 2.1 time: 0.577340 Aug 10 22:57:05.428077 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 218/454] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:57:04 2022] GET /compute/v2.1/servers/9acba217-4a32-4650-a43e-9d998061323c => generated 1476 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:57:05.445064 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-fb979d67-485e-49cd-af9d-ff9788c5d515 tempest-SecurityGroupsTestAdminJSON-575839645 tempest-SecurityGroupsTestAdminJSON-575839645-project] Action: 'create', calling method: .version_select at 0x7f847d81c0d0>, body: {"security_group": {"name": "tempest-securitygroup-333376434", "description": "tempest-description-835483173"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:57:06.211737 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-8d2da3f2-5735-47b2-914e-38ae8df67b14 tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/baf47131-7a59-4588-9ce6-113709fa8480/action" status: 202 len: 0 microversion: 2.25 time: 5.196557 Aug 10 22:57:06.212484 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 237/455] 10.222.0.58 () {62 vars in 1319 bytes} [Wed Aug 10 22:57:01 2022] POST /compute/v2.1/servers/baf47131-7a59-4588-9ce6-113709fa8480/action => generated 0 bytes in 5198 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 10 22:57:06.230101 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-fb979d67-485e-49cd-af9d-ff9788c5d515 tempest-SecurityGroupsTestAdminJSON-575839645 tempest-SecurityGroupsTestAdminJSON-575839645-project] 10.222.0.58 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 0.800575 Aug 10 22:57:06.238586 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 219/456] 10.222.0.58 () {60 vars in 1180 bytes} [Wed Aug 10 22:57:05 2022] POST /compute/v2.1/os-security-groups => generated 219 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:57:06.243849 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-3a92c7c7-f447-461b-9760-2354b16ecf2f tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:06.244616 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-3a92c7c7-f447-461b-9760-2354b16ecf2f tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] [instance: ef725aca-9cd8-49a0-81cd-d23710041306] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:57:06.273131 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3a92c7c7-f447-461b-9760-2354b16ecf2f tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:06.273636 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3a92c7c7-f447-461b-9760-2354b16ecf2f tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:06.274076 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3a92c7c7-f447-461b-9760-2354b16ecf2f tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:06.274824 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3a92c7c7-f447-461b-9760-2354b16ecf2f tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:06.275351 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3a92c7c7-f447-461b-9760-2354b16ecf2f tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:06.275949 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3a92c7c7-f447-461b-9760-2354b16ecf2f tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:06.387142 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-3a92c7c7-f447-461b-9760-2354b16ecf2f tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] [instance: ef725aca-9cd8-49a0-81cd-d23710041306] Going to try to terminate instance {{(pid=122632) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 22:57:06.730957 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-3a92c7c7-f447-461b-9760-2354b16ecf2f tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] 10.222.0.58 "DELETE /compute/v2.1/servers/ef725aca-9cd8-49a0-81cd-d23710041306" status: 204 len: 0 microversion: 2.1 time: 0.490728 Aug 10 22:57:06.747316 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 220/457] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 22:57:06 2022] DELETE /compute/v2.1/servers/ef725aca-9cd8-49a0-81cd-d23710041306 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 22:57:06.768397 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-192a34dc-b1b2-4fbb-8947-1768e0af1ed8 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:06.771196 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-192a34dc-b1b2-4fbb-8947-1768e0af1ed8 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] [instance: baf47131-7a59-4588-9ce6-113709fa8480] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:57:06.799549 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-192a34dc-b1b2-4fbb-8947-1768e0af1ed8 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:06.800359 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-192a34dc-b1b2-4fbb-8947-1768e0af1ed8 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:06.800841 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-192a34dc-b1b2-4fbb-8947-1768e0af1ed8 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:06.801598 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-192a34dc-b1b2-4fbb-8947-1768e0af1ed8 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:06.802035 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-192a34dc-b1b2-4fbb-8947-1768e0af1ed8 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:06.802460 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-192a34dc-b1b2-4fbb-8947-1768e0af1ed8 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:06.840130 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-45e9b777-bfb5-458f-a62e-ec2420539d13 tempest-TenantUsagesTestJSON-80409989 tempest-TenantUsagesTestJSON-80409989-project-admin] Calling method '.version_select at 0x7f847d749430>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:06.892147 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-45e9b777-bfb5-458f-a62e-ec2420539d13 tempest-TenantUsagesTestJSON-80409989 tempest-TenantUsagesTestJSON-80409989-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:06.894529 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-45e9b777-bfb5-458f-a62e-ec2420539d13 tempest-TenantUsagesTestJSON-80409989 tempest-TenantUsagesTestJSON-80409989-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:06.897174 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-45e9b777-bfb5-458f-a62e-ec2420539d13 tempest-TenantUsagesTestJSON-80409989 tempest-TenantUsagesTestJSON-80409989-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:06.984119 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-45e9b777-bfb5-458f-a62e-ec2420539d13 tempest-TenantUsagesTestJSON-80409989 tempest-TenantUsagesTestJSON-80409989-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:06.986089 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-45e9b777-bfb5-458f-a62e-ec2420539d13 tempest-TenantUsagesTestJSON-80409989 tempest-TenantUsagesTestJSON-80409989-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:06.987035 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-45e9b777-bfb5-458f-a62e-ec2420539d13 tempest-TenantUsagesTestJSON-80409989 tempest-TenantUsagesTestJSON-80409989-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:07.016204 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-45e9b777-bfb5-458f-a62e-ec2420539d13 tempest-TenantUsagesTestJSON-80409989 tempest-TenantUsagesTestJSON-80409989-project-admin] 10.222.0.58 "GET /compute/v2.1/os-simple-tenant-usage/d5c26b1fa1b7409e81790aba647a3049?start=2022-08-09T22%3A57%3A04.832096&end=2022-08-11T22%3A57%3A04.832096" status: 200 len: 694 microversion: 2.1 time: 0.802627 Aug 10 22:57:07.026188 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 238/458] 10.222.0.58 () {58 vars in 1412 bytes} [Wed Aug 10 22:57:06 2022] GET /compute/v2.1/os-simple-tenant-usage/d5c26b1fa1b7409e81790aba647a3049?start=2022-08-09T22%3A57%3A04.832096&end=2022-08-11T22%3A57%3A04.832096 => generated 694 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:57:07.402298 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-10205228-277a-4190-b796-497674b993ad tempest-SecurityGroupsTestAdminJSON-611002203 tempest-SecurityGroupsTestAdminJSON-611002203-project-admin] Action: 'create', calling method: .version_select at 0x7f847d885e50>, body: {"security_group": {"name": "tempest-securitygroup-919754575", "description": "tempest-description-1366130779"}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:57:07.405211 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-192a34dc-b1b2-4fbb-8947-1768e0af1ed8 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:07.417464 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-192a34dc-b1b2-4fbb-8947-1768e0af1ed8 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:07.425476 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-192a34dc-b1b2-4fbb-8947-1768e0af1ed8 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:07.427082 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-192a34dc-b1b2-4fbb-8947-1768e0af1ed8 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] 10.222.0.58 "GET /compute/v2.1/servers/baf47131-7a59-4588-9ce6-113709fa8480" status: 200 len: 1569 microversion: 2.25 time: 0.678176 Aug 10 22:57:07.428133 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 221/459] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 22:57:06 2022] GET /compute/v2.1/servers/baf47131-7a59-4588-9ce6-113709fa8480 => generated 1569 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:57:07.439909 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c3521220-1d94-41f8-8865-5e559b309059 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:07.441380 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-c3521220-1d94-41f8-8865-5e559b309059 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 9acba217-4a32-4650-a43e-9d998061323c] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:57:07.454422 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c3521220-1d94-41f8-8865-5e559b309059 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:07.455256 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c3521220-1d94-41f8-8865-5e559b309059 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:07.455941 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c3521220-1d94-41f8-8865-5e559b309059 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:07.456816 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c3521220-1d94-41f8-8865-5e559b309059 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:07.457424 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c3521220-1d94-41f8-8865-5e559b309059 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:07.458043 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c3521220-1d94-41f8-8865-5e559b309059 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:07.726946 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-c3521220-1d94-41f8-8865-5e559b309059 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:07.740442 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-c3521220-1d94-41f8-8865-5e559b309059 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/9acba217-4a32-4650-a43e-9d998061323c" status: 200 len: 1476 microversion: 2.1 time: 0.309043 Aug 10 22:57:07.760347 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 222/460] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:57:07 2022] GET /compute/v2.1/servers/9acba217-4a32-4650-a43e-9d998061323c => generated 1476 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:57:07.891606 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-064d5a6e-e2b7-4b09-8cc1-1a6daa274396 tempest-QuotasAdminTestV257-1455520263 tempest-QuotasAdminTestV257-1455520263-project-admin] Action: 'update', calling method: .version_select at 0x7f847d98cf70>, body: {"quota_set": {"ram": "5120"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:57:08.059791 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-10205228-277a-4190-b796-497674b993ad tempest-SecurityGroupsTestAdminJSON-611002203 tempest-SecurityGroupsTestAdminJSON-611002203-project-admin] 10.222.0.58 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 1.032382 Aug 10 22:57:08.061432 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 239/461] 10.222.0.58 () {60 vars in 1180 bytes} [Wed Aug 10 22:57:07 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:57:08.068114 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-186553fb-068f-4d4d-9eec-2a6ec12c2d9d tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] Calling method '.version_select at 0x7f847d7491f0>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:08.087462 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=77,nova_cell0:UPDATE=7 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:57:08.096882 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-064d5a6e-e2b7-4b09-8cc1-1a6daa274396 tempest-QuotasAdminTestV257-1455520263 tempest-QuotasAdminTestV257-1455520263-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:08.097041 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-186553fb-068f-4d4d-9eec-2a6ec12c2d9d tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:08.097372 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-064d5a6e-e2b7-4b09-8cc1-1a6daa274396 tempest-QuotasAdminTestV257-1455520263 tempest-QuotasAdminTestV257-1455520263-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:08.097808 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-064d5a6e-e2b7-4b09-8cc1-1a6daa274396 tempest-QuotasAdminTestV257-1455520263 tempest-QuotasAdminTestV257-1455520263-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:08.099054 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-186553fb-068f-4d4d-9eec-2a6ec12c2d9d tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:08.099618 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-186553fb-068f-4d4d-9eec-2a6ec12c2d9d tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:08.103586 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-064d5a6e-e2b7-4b09-8cc1-1a6daa274396 tempest-QuotasAdminTestV257-1455520263 tempest-QuotasAdminTestV257-1455520263-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:08.104061 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-064d5a6e-e2b7-4b09-8cc1-1a6daa274396 tempest-QuotasAdminTestV257-1455520263 tempest-QuotasAdminTestV257-1455520263-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:08.104494 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-064d5a6e-e2b7-4b09-8cc1-1a6daa274396 tempest-QuotasAdminTestV257-1455520263 tempest-QuotasAdminTestV257-1455520263-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:08.120893 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-186553fb-068f-4d4d-9eec-2a6ec12c2d9d tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:08.124636 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-186553fb-068f-4d4d-9eec-2a6ec12c2d9d tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:08.125994 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-186553fb-068f-4d4d-9eec-2a6ec12c2d9d tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:08.177064 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-186553fb-068f-4d4d-9eec-2a6ec12c2d9d tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] 10.222.0.58 "GET /compute/v2.1/os-simple-tenant-usage/d5c26b1fa1b7409e81790aba647a3049?start=2022-08-09T22%3A57%3A04.832096&end=2022-08-11T22%3A57%3A04.832096" status: 200 len: 694 microversion: 2.1 time: 0.113372 Aug 10 22:57:08.182865 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 240/462] 10.222.0.58 () {58 vars in 1412 bytes} [Wed Aug 10 22:57:08 2022] GET /compute/v2.1/os-simple-tenant-usage/d5c26b1fa1b7409e81790aba647a3049?start=2022-08-09T22%3A57%3A04.832096&end=2022-08-11T22%3A57%3A04.832096 => generated 694 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:57:08.191985 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-886b4cf5-c57f-41f4-a665-5114c1e57cf9 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1411202305", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "9698657", "adminPass": "***", "networks": [{"uuid": "e735bdfc-e561-47ce-9a70-437a9b0a31f9"}], "security_groups": [{"name": "tempest-securitygroup--2109682698"}], "key_name": "tempest-keypair-1466905669", "user_data": "}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:57:08.246514 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-064d5a6e-e2b7-4b09-8cc1-1a6daa274396 tempest-QuotasAdminTestV257-1455520263 tempest-QuotasAdminTestV257-1455520263-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-quota-sets/8f688127d1d4491a8473ac04dc7c9837" status: 200 len: 148 microversion: 2.57 time: 0.484920 Aug 10 22:57:08.253295 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 223/463] 10.222.0.58 () {62 vars in 1303 bytes} [Wed Aug 10 22:57:07 2022] PUT /compute/v2.1/os-quota-sets/8f688127d1d4491a8473ac04dc7c9837 => generated 148 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 22:57:08.253295 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-d7794508-da98-48e4-81e0-2b11362912f0 tempest-SecurityGroupsTestAdminJSON-611002203 tempest-SecurityGroupsTestAdminJSON-611002203-project-admin] Action: 'create', calling method: .version_select at 0x7f847d8bf310>, body: {"security_group": {"name": "tempest-securitygroup-1978282129", "description": "tempest-description-1801737816"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:57:08.357240 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.network.neutron [None req-886b4cf5-c57f-41f4-a665-5114c1e57cf9 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] validate_networks() for [('e735bdfc-e561-47ce-9a70-437a9b0a31f9', None, None, None, None, None)] {{(pid=122633) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 22:57:08.608704 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=6 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:57:09.368585 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-886b4cf5-c57f-41f4-a665-5114c1e57cf9 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Flavor limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 22:57:09.369869 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-886b4cf5-c57f-41f4-a665-5114c1e57cf9 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Image limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 22:57:09.370551 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-886b4cf5-c57f-41f4-a665-5114c1e57cf9 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Flavor pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 22:57:09.376610 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-886b4cf5-c57f-41f4-a665-5114c1e57cf9 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Image pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 22:57:09.377258 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-886b4cf5-c57f-41f4-a665-5114c1e57cf9 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 22:57:09.443635 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-886b4cf5-c57f-41f4-a665-5114c1e57cf9 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:09.444346 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-886b4cf5-c57f-41f4-a665-5114c1e57cf9 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:09.444897 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-886b4cf5-c57f-41f4-a665-5114c1e57cf9 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:09.445760 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-886b4cf5-c57f-41f4-a665-5114c1e57cf9 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:09.446326 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-886b4cf5-c57f-41f4-a665-5114c1e57cf9 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:09.446975 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-886b4cf5-c57f-41f4-a665-5114c1e57cf9 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:09.479459 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-886b4cf5-c57f-41f4-a665-5114c1e57cf9 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Getting quotas for project deaba512051743deb45881d76eb206ed. Resources: {'instances', 'cores', 'ram'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 22:57:09.484428 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-d7794508-da98-48e4-81e0-2b11362912f0 tempest-SecurityGroupsTestAdminJSON-611002203 tempest-SecurityGroupsTestAdminJSON-611002203-project-admin] 10.222.0.58 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 1.235705 Aug 10 22:57:09.492486 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 224/464] 10.222.0.58 () {60 vars in 1180 bytes} [Wed Aug 10 22:57:08 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 1237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:57:09.492486 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-24e940fa-2be1-4a78-9ca2-cb0893827d6e tempest-TenantUsagesTestJSON-80409989 tempest-TenantUsagesTestJSON-80409989-project-admin] Calling method '.version_select at 0x7f847d8f9700>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:09.495532 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-886b4cf5-c57f-41f4-a665-5114c1e57cf9 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Getting quotas for user eaed2a2e56f749a88c340aaccb15d2d9 and project deaba512051743deb45881d76eb206ed. Resources: {'instances', 'cores', 'ram'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 22:57:09.507096 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-24e940fa-2be1-4a78-9ca2-cb0893827d6e tempest-TenantUsagesTestJSON-80409989 tempest-TenantUsagesTestJSON-80409989-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:09.507584 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-24e940fa-2be1-4a78-9ca2-cb0893827d6e tempest-TenantUsagesTestJSON-80409989 tempest-TenantUsagesTestJSON-80409989-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:09.508023 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-24e940fa-2be1-4a78-9ca2-cb0893827d6e tempest-TenantUsagesTestJSON-80409989 tempest-TenantUsagesTestJSON-80409989-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:09.527444 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-886b4cf5-c57f-41f4-a665-5114c1e57cf9 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Going to run 1 instances... {{(pid=122633) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 22:57:09.530951 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-886b4cf5-c57f-41f4-a665-5114c1e57cf9 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] [instance: e773ec0c-0cd0-4a08-b9f0-5c2d0a342751] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78ad8905-f66f-4733-8be9-2b260f1fabed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=122633) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 22:57:09.568163 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-24e940fa-2be1-4a78-9ca2-cb0893827d6e tempest-TenantUsagesTestJSON-80409989 tempest-TenantUsagesTestJSON-80409989-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:09.568656 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-24e940fa-2be1-4a78-9ca2-cb0893827d6e tempest-TenantUsagesTestJSON-80409989 tempest-TenantUsagesTestJSON-80409989-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:09.569143 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-24e940fa-2be1-4a78-9ca2-cb0893827d6e tempest-TenantUsagesTestJSON-80409989 tempest-TenantUsagesTestJSON-80409989-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:09.624846 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-24e940fa-2be1-4a78-9ca2-cb0893827d6e tempest-TenantUsagesTestJSON-80409989 tempest-TenantUsagesTestJSON-80409989-project-admin] 10.222.0.58 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-09T22%3A57%3A04.832096&end=2022-08-11T22%3A57%3A04.832096&detailed=1" status: 200 len: 4589 microversion: 2.1 time: 0.137885 Aug 10 22:57:09.643077 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 225/465] 10.222.0.58 () {58 vars in 1335 bytes} [Wed Aug 10 22:57:09 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-09T22%3A57%3A04.832096&end=2022-08-11T22%3A57%3A04.832096&detailed=1 => generated 4589 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:57:09.653182 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-886b4cf5-c57f-41f4-a665-5114c1e57cf9 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.463262 Aug 10 22:57:09.654030 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-941e4698-4bc5-4892-baf1-2ad9efeb4523 tempest-QuotasAdminTestV257-1455520263 tempest-QuotasAdminTestV257-1455520263-project-admin] Calling method '.version_select at 0x7f847d98f8b0>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:09.654681 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 241/466] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 22:57:08 2022] POST /compute/v2.1/servers => generated 402 bytes in 1476 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 22:57:09.676815 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-1d72e0c6-f7f6-4060-a711-a05d1d13a888 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:09.679633 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-1d72e0c6-f7f6-4060-a711-a05d1d13a888 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] [instance: baf47131-7a59-4588-9ce6-113709fa8480] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:57:09.706381 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1d72e0c6-f7f6-4060-a711-a05d1d13a888 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:09.708378 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1d72e0c6-f7f6-4060-a711-a05d1d13a888 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:09.710605 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1d72e0c6-f7f6-4060-a711-a05d1d13a888 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:09.713173 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1d72e0c6-f7f6-4060-a711-a05d1d13a888 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:09.713773 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1d72e0c6-f7f6-4060-a711-a05d1d13a888 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:09.714500 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1d72e0c6-f7f6-4060-a711-a05d1d13a888 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:09.826461 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-941e4698-4bc5-4892-baf1-2ad9efeb4523 tempest-QuotasAdminTestV257-1455520263 tempest-QuotasAdminTestV257-1455520263-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:09.827227 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-941e4698-4bc5-4892-baf1-2ad9efeb4523 tempest-QuotasAdminTestV257-1455520263 tempest-QuotasAdminTestV257-1455520263-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:09.827860 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-941e4698-4bc5-4892-baf1-2ad9efeb4523 tempest-QuotasAdminTestV257-1455520263 tempest-QuotasAdminTestV257-1455520263-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:09.829184 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-941e4698-4bc5-4892-baf1-2ad9efeb4523 tempest-QuotasAdminTestV257-1455520263 tempest-QuotasAdminTestV257-1455520263-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:09.829945 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-941e4698-4bc5-4892-baf1-2ad9efeb4523 tempest-QuotasAdminTestV257-1455520263 tempest-QuotasAdminTestV257-1455520263-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:09.830918 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-941e4698-4bc5-4892-baf1-2ad9efeb4523 tempest-QuotasAdminTestV257-1455520263 tempest-QuotasAdminTestV257-1455520263-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:09.881956 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-941e4698-4bc5-4892-baf1-2ad9efeb4523 tempest-QuotasAdminTestV257-1455520263 tempest-QuotasAdminTestV257-1455520263-project-admin] 10.222.0.58 "GET /compute/v2.1/os-quota-sets/8f688127d1d4491a8473ac04dc7c9837/detail" status: 200 len: 463 microversion: 2.57 time: 0.232829 Aug 10 22:57:09.884005 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 226/467] 10.222.0.58 () {60 vars in 1304 bytes} [Wed Aug 10 22:57:09 2022] GET /compute/v2.1/os-quota-sets/8f688127d1d4491a8473ac04dc7c9837/detail => generated 463 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 22:57:09.915578 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-39edbed4-8bbd-42b1-900e-6e6f6732ce9c tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:09.916337 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-39edbed4-8bbd-42b1-900e-6e6f6732ce9c tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 9acba217-4a32-4650-a43e-9d998061323c] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:57:09.937769 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-39edbed4-8bbd-42b1-900e-6e6f6732ce9c tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:09.939832 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-39edbed4-8bbd-42b1-900e-6e6f6732ce9c tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:09.941243 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-39edbed4-8bbd-42b1-900e-6e6f6732ce9c tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:09.942742 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-39edbed4-8bbd-42b1-900e-6e6f6732ce9c tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:09.945430 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-39edbed4-8bbd-42b1-900e-6e6f6732ce9c tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:09.951205 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-39edbed4-8bbd-42b1-900e-6e6f6732ce9c tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:10.057756 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-1d72e0c6-f7f6-4060-a711-a05d1d13a888 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:10.087502 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-1d72e0c6-f7f6-4060-a711-a05d1d13a888 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:10.090037 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-1d72e0c6-f7f6-4060-a711-a05d1d13a888 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:10.102486 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-1d72e0c6-f7f6-4060-a711-a05d1d13a888 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] 10.222.0.58 "GET /compute/v2.1/servers/baf47131-7a59-4588-9ce6-113709fa8480" status: 200 len: 1569 microversion: 2.25 time: 0.444954 Aug 10 22:57:10.116314 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 242/468] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 22:57:09 2022] GET /compute/v2.1/servers/baf47131-7a59-4588-9ce6-113709fa8480 => generated 1569 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:57:10.141273 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-cc2185eb-e7e2-4b74-ac92-870f59674748 tempest-SecurityGroupsTestAdminJSON-611002203 tempest-SecurityGroupsTestAdminJSON-611002203-project-admin] Calling method '.version_select at 0x7f847d707f70>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:10.400023 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-39edbed4-8bbd-42b1-900e-6e6f6732ce9c tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:10.409474 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-39edbed4-8bbd-42b1-900e-6e6f6732ce9c tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/9acba217-4a32-4650-a43e-9d998061323c" status: 200 len: 1476 microversion: 2.1 time: 0.523428 Aug 10 22:57:10.416156 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 227/469] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:57:09 2022] GET /compute/v2.1/servers/9acba217-4a32-4650-a43e-9d998061323c => generated 1476 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:57:10.428974 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-7eec8da2-1c65-4377-8528-b81acc4ce8e7 req-5b2afcff-5ad9-46c8-bab3-5e56ce6eef18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "baf47131-7a59-4588-9ce6-113709fa8480", "name": "network-vif-unplugged", "status": "completed", "tag": "2da43b40-f84d-4748-92ca-1bd0d92e6665"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:57:10.443687 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_api:UPDATE=3,nova_api:SELECT=81,nova_api:INSERT=5,nova_api:SAVEPOINT=4,nova_api:RELEASE=4,nova_api:DELETE=3 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:57:10.467754 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-7eec8da2-1c65-4377-8528-b81acc4ce8e7 req-5b2afcff-5ad9-46c8-bab3-5e56ce6eef18 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:10.468621 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-7eec8da2-1c65-4377-8528-b81acc4ce8e7 req-5b2afcff-5ad9-46c8-bab3-5e56ce6eef18 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:10.469302 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-7eec8da2-1c65-4377-8528-b81acc4ce8e7 req-5b2afcff-5ad9-46c8-bab3-5e56ce6eef18 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:10.501032 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-7eec8da2-1c65-4377-8528-b81acc4ce8e7 req-5b2afcff-5ad9-46c8-bab3-5e56ce6eef18 service nova] Creating event network-vif-unplugged:2da43b40-f84d-4748-92ca-1bd0d92e6665 for instance baf47131-7a59-4588-9ce6-113709fa8480 on n-h1-850468-14 Aug 10 22:57:10.511197 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-7eec8da2-1c65-4377-8528-b81acc4ce8e7 req-5b2afcff-5ad9-46c8-bab3-5e56ce6eef18 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.092586 Aug 10 22:57:10.514222 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 228/470] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 22:57:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:57:10.525845 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-6220706b-860a-4604-b7db-6d9d830a84cc tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:10.527731 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-6220706b-860a-4604-b7db-6d9d830a84cc tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] [instance: e773ec0c-0cd0-4a08-b9f0-5c2d0a342751] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:57:10.891717 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-6220706b-860a-4604-b7db-6d9d830a84cc tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaed2a2e56f749a88c340aaccb15d2d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deaba512051743deb45881d76eb206ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:10.918244 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-6220706b-860a-4604-b7db-6d9d830a84cc tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] 10.222.0.58 "GET /compute/v2.1/servers/e773ec0c-0cd0-4a08-b9f0-5c2d0a342751" status: 200 len: 1259 microversion: 2.1 time: 0.402375 Aug 10 22:57:10.926875 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 229/471] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:57:10 2022] GET /compute/v2.1/servers/e773ec0c-0cd0-4a08-b9f0-5c2d0a342751 => generated 1259 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:57:10.963878 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-3aa32628-b6c9-4d69-83c8-3f92b9d4cbdd tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:10.965246 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-3aa32628-b6c9-4d69-83c8-3f92b9d4cbdd tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] [instance: ec0e154c-f1b0-4da5-ba56-b0eb6fa334a9] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:57:10.990848 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3aa32628-b6c9-4d69-83c8-3f92b9d4cbdd tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:10.997391 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3aa32628-b6c9-4d69-83c8-3f92b9d4cbdd tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:10.997979 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3aa32628-b6c9-4d69-83c8-3f92b9d4cbdd tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:10.998751 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3aa32628-b6c9-4d69-83c8-3f92b9d4cbdd tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:10.999261 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3aa32628-b6c9-4d69-83c8-3f92b9d4cbdd tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:11.005199 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3aa32628-b6c9-4d69-83c8-3f92b9d4cbdd tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:11.117579 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-3aa32628-b6c9-4d69-83c8-3f92b9d4cbdd tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] [instance: ec0e154c-f1b0-4da5-ba56-b0eb6fa334a9] Going to try to terminate instance {{(pid=122632) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 22:57:11.378227 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-3aa32628-b6c9-4d69-83c8-3f92b9d4cbdd tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] 10.222.0.58 "DELETE /compute/v2.1/servers/ec0e154c-f1b0-4da5-ba56-b0eb6fa334a9" status: 204 len: 0 microversion: 2.1 time: 0.449179 Aug 10 22:57:11.382950 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 230/472] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 22:57:10 2022] DELETE /compute/v2.1/servers/ec0e154c-f1b0-4da5-ba56-b0eb6fa334a9 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 22:57:11.411273 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-ffc9e512-7a9b-40e8-a508-0d075e871245 tempest-QuotasAdminTestV257-1455520263 tempest-QuotasAdminTestV257-1455520263-project-admin] Action: 'update', calling method: .version_select at 0x7f847d927ca0>, body: {"quota_set": {"ram": "2048"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:57:11.572689 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ffc9e512-7a9b-40e8-a508-0d075e871245 tempest-QuotasAdminTestV257-1455520263 tempest-QuotasAdminTestV257-1455520263-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:11.576202 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ffc9e512-7a9b-40e8-a508-0d075e871245 tempest-QuotasAdminTestV257-1455520263 tempest-QuotasAdminTestV257-1455520263-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:11.578480 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ffc9e512-7a9b-40e8-a508-0d075e871245 tempest-QuotasAdminTestV257-1455520263 tempest-QuotasAdminTestV257-1455520263-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:11.586680 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ffc9e512-7a9b-40e8-a508-0d075e871245 tempest-QuotasAdminTestV257-1455520263 tempest-QuotasAdminTestV257-1455520263-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:11.587563 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ffc9e512-7a9b-40e8-a508-0d075e871245 tempest-QuotasAdminTestV257-1455520263 tempest-QuotasAdminTestV257-1455520263-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:11.588271 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ffc9e512-7a9b-40e8-a508-0d075e871245 tempest-QuotasAdminTestV257-1455520263 tempest-QuotasAdminTestV257-1455520263-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:11.663829 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ffc9e512-7a9b-40e8-a508-0d075e871245 tempest-QuotasAdminTestV257-1455520263 tempest-QuotasAdminTestV257-1455520263-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:11.666553 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ffc9e512-7a9b-40e8-a508-0d075e871245 tempest-QuotasAdminTestV257-1455520263 tempest-QuotasAdminTestV257-1455520263-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:11.667119 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ffc9e512-7a9b-40e8-a508-0d075e871245 tempest-QuotasAdminTestV257-1455520263 tempest-QuotasAdminTestV257-1455520263-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:11.667975 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ffc9e512-7a9b-40e8-a508-0d075e871245 tempest-QuotasAdminTestV257-1455520263 tempest-QuotasAdminTestV257-1455520263-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:11.670589 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ffc9e512-7a9b-40e8-a508-0d075e871245 tempest-QuotasAdminTestV257-1455520263 tempest-QuotasAdminTestV257-1455520263-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:11.672802 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ffc9e512-7a9b-40e8-a508-0d075e871245 tempest-QuotasAdminTestV257-1455520263 tempest-QuotasAdminTestV257-1455520263-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:11.897652 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-ffc9e512-7a9b-40e8-a508-0d075e871245 tempest-QuotasAdminTestV257-1455520263 tempest-QuotasAdminTestV257-1455520263-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-quota-sets/8f688127d1d4491a8473ac04dc7c9837?user_id=1a90bf4463ba43008712f8731b255ff9" status: 200 len: 148 microversion: 2.57 time: 0.512934 Aug 10 22:57:11.912728 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 231/473] 10.222.0.58 () {62 vars in 1384 bytes} [Wed Aug 10 22:57:11 2022] PUT /compute/v2.1/os-quota-sets/8f688127d1d4491a8473ac04dc7c9837?user_id=1a90bf4463ba43008712f8731b255ff9 => generated 148 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 22:57:11.929172 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-40de1d25-d4e1-49f2-aa1e-542d7988cdb1 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:11.929922 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-40de1d25-d4e1-49f2-aa1e-542d7988cdb1 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] [instance: baf47131-7a59-4588-9ce6-113709fa8480] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:57:11.965790 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-40de1d25-d4e1-49f2-aa1e-542d7988cdb1 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:11.966475 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-40de1d25-d4e1-49f2-aa1e-542d7988cdb1 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:11.974257 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-40de1d25-d4e1-49f2-aa1e-542d7988cdb1 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:11.982915 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-40de1d25-d4e1-49f2-aa1e-542d7988cdb1 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:11.983435 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-40de1d25-d4e1-49f2-aa1e-542d7988cdb1 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:11.991541 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-40de1d25-d4e1-49f2-aa1e-542d7988cdb1 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:13.057910 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-40de1d25-d4e1-49f2-aa1e-542d7988cdb1 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:13.071379 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-40de1d25-d4e1-49f2-aa1e-542d7988cdb1 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:13.076168 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-40de1d25-d4e1-49f2-aa1e-542d7988cdb1 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:13.077681 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-40de1d25-d4e1-49f2-aa1e-542d7988cdb1 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] 10.222.0.58 "GET /compute/v2.1/servers/baf47131-7a59-4588-9ce6-113709fa8480" status: 200 len: 1569 microversion: 2.25 time: 1.163869 Aug 10 22:57:13.081259 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 232/474] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 22:57:11 2022] GET /compute/v2.1/servers/baf47131-7a59-4588-9ce6-113709fa8480 => generated 1569 bytes in 1168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:57:13.092214 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-bb31d51f-b97e-46e3-bc22-210f6fa2ec4e tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:13.093203 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-bb31d51f-b97e-46e3-bc22-210f6fa2ec4e tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] [instance: ec0e154c-f1b0-4da5-ba56-b0eb6fa334a9] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:57:13.118703 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bb31d51f-b97e-46e3-bc22-210f6fa2ec4e tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:13.119635 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bb31d51f-b97e-46e3-bc22-210f6fa2ec4e tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:13.120927 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bb31d51f-b97e-46e3-bc22-210f6fa2ec4e tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:13.124422 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bb31d51f-b97e-46e3-bc22-210f6fa2ec4e tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:13.128796 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bb31d51f-b97e-46e3-bc22-210f6fa2ec4e tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:13.129640 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bb31d51f-b97e-46e3-bc22-210f6fa2ec4e tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:13.651120 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-bb31d51f-b97e-46e3-bc22-210f6fa2ec4e tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fc65c017e774af2829d5cd7a7170995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5c26b1fa1b7409e81790aba647a3049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:13.664893 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-bb31d51f-b97e-46e3-bc22-210f6fa2ec4e tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] 10.222.0.58 "GET /compute/v2.1/servers/ec0e154c-f1b0-4da5-ba56-b0eb6fa334a9" status: 200 len: 1468 microversion: 2.1 time: 0.581974 Aug 10 22:57:13.666263 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 233/475] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:57:13 2022] GET /compute/v2.1/servers/ec0e154c-f1b0-4da5-ba56-b0eb6fa334a9 => generated 1468 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:57:13.684570 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-a15e1e18-fa85-45c9-8d67-6bf13609b201 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:13.685441 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-a15e1e18-fa85-45c9-8d67-6bf13609b201 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 9acba217-4a32-4650-a43e-9d998061323c] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:57:13.697969 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a15e1e18-fa85-45c9-8d67-6bf13609b201 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:13.701047 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a15e1e18-fa85-45c9-8d67-6bf13609b201 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:13.701706 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a15e1e18-fa85-45c9-8d67-6bf13609b201 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:13.708707 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a15e1e18-fa85-45c9-8d67-6bf13609b201 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:13.709532 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a15e1e18-fa85-45c9-8d67-6bf13609b201 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:13.710155 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a15e1e18-fa85-45c9-8d67-6bf13609b201 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:13.714291 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:57:14.023782 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-a15e1e18-fa85-45c9-8d67-6bf13609b201 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:14.032869 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-a15e1e18-fa85-45c9-8d67-6bf13609b201 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/9acba217-4a32-4650-a43e-9d998061323c" status: 200 len: 1476 microversion: 2.1 time: 0.359257 Aug 10 22:57:14.036580 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 234/476] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:57:13 2022] GET /compute/v2.1/servers/9acba217-4a32-4650-a43e-9d998061323c => generated 1476 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:57:14.042389 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-2a63313a-e4e6-47d2-b2e0-344498c4ab26 tempest-QuotasAdminTestV257-1455520263 tempest-QuotasAdminTestV257-1455520263-project-admin] Calling method '.version_select at 0x7f847d81c550>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:14.277888 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-2a63313a-e4e6-47d2-b2e0-344498c4ab26 tempest-QuotasAdminTestV257-1455520263 tempest-QuotasAdminTestV257-1455520263-project-admin] 10.222.0.58 "GET /compute/v2.1/os-quota-sets/8f688127d1d4491a8473ac04dc7c9837?user_id=1a90bf4463ba43008712f8731b255ff9" status: 200 len: 190 microversion: 2.57 time: 0.239832 Aug 10 22:57:14.288768 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 235/477] 10.222.0.58 () {60 vars in 1364 bytes} [Wed Aug 10 22:57:14 2022] GET /compute/v2.1/os-quota-sets/8f688127d1d4491a8473ac04dc7c9837?user_id=1a90bf4463ba43008712f8731b255ff9 => generated 190 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 22:57:14.305726 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-5b5e0973-96d9-43a9-952e-2989ec3ff0c3 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:14.307172 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-5b5e0973-96d9-43a9-952e-2989ec3ff0c3 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] [instance: e773ec0c-0cd0-4a08-b9f0-5c2d0a342751] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:57:14.319113 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5b5e0973-96d9-43a9-952e-2989ec3ff0c3 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:14.321227 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5b5e0973-96d9-43a9-952e-2989ec3ff0c3 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:14.323449 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5b5e0973-96d9-43a9-952e-2989ec3ff0c3 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:14.325113 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5b5e0973-96d9-43a9-952e-2989ec3ff0c3 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:14.329004 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5b5e0973-96d9-43a9-952e-2989ec3ff0c3 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:14.330668 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5b5e0973-96d9-43a9-952e-2989ec3ff0c3 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:15.812686 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-5b5e0973-96d9-43a9-952e-2989ec3ff0c3 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaed2a2e56f749a88c340aaccb15d2d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deaba512051743deb45881d76eb206ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:15.826505 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-5b5e0973-96d9-43a9-952e-2989ec3ff0c3 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] 10.222.0.58 "GET /compute/v2.1/servers/e773ec0c-0cd0-4a08-b9f0-5c2d0a342751" status: 200 len: 1311 microversion: 2.1 time: 1.536226 Aug 10 22:57:15.844694 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 236/478] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:57:14 2022] GET /compute/v2.1/servers/e773ec0c-0cd0-4a08-b9f0-5c2d0a342751 => generated 1311 bytes in 1555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:57:15.880300 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-a6337ebb-a20a-4835-8f78-91126f74f730 req-337b3bbc-bb37-47b0-9284-a3f05d7a6d95 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "baf47131-7a59-4588-9ce6-113709fa8480", "tag": "2da43b40-f84d-4748-92ca-1bd0d92e6665"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:57:15.909329 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-a6337ebb-a20a-4835-8f78-91126f74f730 req-337b3bbc-bb37-47b0-9284-a3f05d7a6d95 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:15.909853 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-a6337ebb-a20a-4835-8f78-91126f74f730 req-337b3bbc-bb37-47b0-9284-a3f05d7a6d95 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:15.910293 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-a6337ebb-a20a-4835-8f78-91126f74f730 req-337b3bbc-bb37-47b0-9284-a3f05d7a6d95 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:15.946329 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-a6337ebb-a20a-4835-8f78-91126f74f730 req-337b3bbc-bb37-47b0-9284-a3f05d7a6d95 service nova] Creating event network-changed:2da43b40-f84d-4748-92ca-1bd0d92e6665 for instance baf47131-7a59-4588-9ce6-113709fa8480 on n-h1-850468-14 Aug 10 22:57:15.962218 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-a6337ebb-a20a-4835-8f78-91126f74f730 req-337b3bbc-bb37-47b0-9284-a3f05d7a6d95 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115647 Aug 10 22:57:15.963432 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 237/479] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 22:57:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:57:15.976008 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-63a2dd0d-8ac8-40e5-9f8e-9add4d369dda req-36133b8b-8115-46a3-a3a2-0d9f72fc8fd9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef725aca-9cd8-49a0-81cd-d23710041306", "name": "network-vif-deleted", "tag": "eb7cb764-99eb-4a20-9e31-45d5acb040e2"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:57:16.003085 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-63a2dd0d-8ac8-40e5-9f8e-9add4d369dda req-36133b8b-8115-46a3-a3a2-0d9f72fc8fd9 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:16.005560 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-63a2dd0d-8ac8-40e5-9f8e-9add4d369dda req-36133b8b-8115-46a3-a3a2-0d9f72fc8fd9 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:16.006180 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-63a2dd0d-8ac8-40e5-9f8e-9add4d369dda req-36133b8b-8115-46a3-a3a2-0d9f72fc8fd9 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:16.035908 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-63a2dd0d-8ac8-40e5-9f8e-9add4d369dda req-36133b8b-8115-46a3-a3a2-0d9f72fc8fd9 service nova] Creating event network-vif-deleted:eb7cb764-99eb-4a20-9e31-45d5acb040e2 for instance ef725aca-9cd8-49a0-81cd-d23710041306 on n-h1-850468-14 Aug 10 22:57:16.052822 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-63a2dd0d-8ac8-40e5-9f8e-9add4d369dda req-36133b8b-8115-46a3-a3a2-0d9f72fc8fd9 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086963 Aug 10 22:57:16.054555 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 238/480] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 22:57:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:57:16.060309 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-bfde21b6-d366-4f58-a329-7aa78effb489 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:16.061424 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-bfde21b6-d366-4f58-a329-7aa78effb489 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] [instance: baf47131-7a59-4588-9ce6-113709fa8480] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:57:16.068796 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bfde21b6-d366-4f58-a329-7aa78effb489 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:16.069726 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bfde21b6-d366-4f58-a329-7aa78effb489 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:16.070342 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bfde21b6-d366-4f58-a329-7aa78effb489 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:16.073223 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bfde21b6-d366-4f58-a329-7aa78effb489 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:16.073999 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bfde21b6-d366-4f58-a329-7aa78effb489 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:16.074633 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bfde21b6-d366-4f58-a329-7aa78effb489 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:16.757226 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-bfde21b6-d366-4f58-a329-7aa78effb489 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:16.770274 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-bfde21b6-d366-4f58-a329-7aa78effb489 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:16.777455 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-bfde21b6-d366-4f58-a329-7aa78effb489 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:16.788442 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-bfde21b6-d366-4f58-a329-7aa78effb489 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] 10.222.0.58 "GET /compute/v2.1/servers/baf47131-7a59-4588-9ce6-113709fa8480" status: 200 len: 1569 microversion: 2.25 time: 0.732189 Aug 10 22:57:16.789038 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 239/481] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 22:57:16 2022] GET /compute/v2.1/servers/baf47131-7a59-4588-9ce6-113709fa8480 => generated 1569 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:57:16.804749 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-aae307b9-97d8-442e-8cfe-b4cbcacdfc01 tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:16.805913 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-aae307b9-97d8-442e-8cfe-b4cbcacdfc01 tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] [instance: ec0e154c-f1b0-4da5-ba56-b0eb6fa334a9] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:57:16.819236 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-aae307b9-97d8-442e-8cfe-b4cbcacdfc01 tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:16.820617 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-aae307b9-97d8-442e-8cfe-b4cbcacdfc01 tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:16.821265 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-aae307b9-97d8-442e-8cfe-b4cbcacdfc01 tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:16.822257 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-aae307b9-97d8-442e-8cfe-b4cbcacdfc01 tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:16.823089 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-aae307b9-97d8-442e-8cfe-b4cbcacdfc01 tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:16.835078 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-aae307b9-97d8-442e-8cfe-b4cbcacdfc01 tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:17.530834 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-cc2185eb-e7e2-4b74-ac92-870f59674748 tempest-SecurityGroupsTestAdminJSON-611002203 tempest-SecurityGroupsTestAdminJSON-611002203-project-admin] 10.222.0.58 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 11741 microversion: 2.1 time: 7.411019 Aug 10 22:57:17.531991 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 243/482] 10.222.0.58 () {58 vars in 1191 bytes} [Wed Aug 10 22:57:10 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 11741 bytes in 7415 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 22:57:17.538064 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-0227cf21-1330-44b8-a6b8-5b59b81a2719 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:17.538681 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-0227cf21-1330-44b8-a6b8-5b59b81a2719 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 9acba217-4a32-4650-a43e-9d998061323c] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:57:17.559639 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0227cf21-1330-44b8-a6b8-5b59b81a2719 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:17.560565 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0227cf21-1330-44b8-a6b8-5b59b81a2719 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:17.561173 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0227cf21-1330-44b8-a6b8-5b59b81a2719 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:17.563352 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0227cf21-1330-44b8-a6b8-5b59b81a2719 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:17.564334 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0227cf21-1330-44b8-a6b8-5b59b81a2719 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:17.565033 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0227cf21-1330-44b8-a6b8-5b59b81a2719 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:17.895812 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-0227cf21-1330-44b8-a6b8-5b59b81a2719 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:17.910840 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-0227cf21-1330-44b8-a6b8-5b59b81a2719 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/9acba217-4a32-4650-a43e-9d998061323c" status: 200 len: 1475 microversion: 2.1 time: 0.376447 Aug 10 22:57:17.914722 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 244/483] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:57:17 2022] GET /compute/v2.1/servers/9acba217-4a32-4650-a43e-9d998061323c => generated 1475 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:57:17.927596 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-7df7cffd-a952-4d2c-add3-e742b77c3324 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:17.928223 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-7df7cffd-a952-4d2c-add3-e742b77c3324 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] [instance: e773ec0c-0cd0-4a08-b9f0-5c2d0a342751] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:57:17.940638 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7df7cffd-a952-4d2c-add3-e742b77c3324 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:17.942158 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7df7cffd-a952-4d2c-add3-e742b77c3324 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:17.942979 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7df7cffd-a952-4d2c-add3-e742b77c3324 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:17.943969 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7df7cffd-a952-4d2c-add3-e742b77c3324 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:17.944574 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7df7cffd-a952-4d2c-add3-e742b77c3324 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:17.946037 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7df7cffd-a952-4d2c-add3-e742b77c3324 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:18.175015 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-7df7cffd-a952-4d2c-add3-e742b77c3324 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaed2a2e56f749a88c340aaccb15d2d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deaba512051743deb45881d76eb206ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:18.180545 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:57:18.191670 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-7df7cffd-a952-4d2c-add3-e742b77c3324 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] 10.222.0.58 "GET /compute/v2.1/servers/e773ec0c-0cd0-4a08-b9f0-5c2d0a342751" status: 200 len: 1317 microversion: 2.1 time: 0.275660 Aug 10 22:57:18.194837 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 245/484] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:57:17 2022] GET /compute/v2.1/servers/e773ec0c-0cd0-4a08-b9f0-5c2d0a342751 => generated 1317 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:57:18.200856 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-bdeb9852-eb72-4170-bf09-ed06d16cdc7d tempest-SecurityGroupsTestAdminJSON-575839645 tempest-SecurityGroupsTestAdminJSON-575839645-project] Calling method '.version_select at 0x7f847d800940>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:18.476188 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-aae307b9-97d8-442e-8cfe-b4cbcacdfc01 tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fc65c017e774af2829d5cd7a7170995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5c26b1fa1b7409e81790aba647a3049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:18.485007 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-aae307b9-97d8-442e-8cfe-b4cbcacdfc01 tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] 10.222.0.58 "GET /compute/v2.1/servers/ec0e154c-f1b0-4da5-ba56-b0eb6fa334a9" status: 200 len: 1468 microversion: 2.1 time: 1.694729 Aug 10 22:57:18.485589 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 240/485] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:57:16 2022] GET /compute/v2.1/servers/ec0e154c-f1b0-4da5-ba56-b0eb6fa334a9 => generated 1468 bytes in 1696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:57:18.537394 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-860b1119-8b5c-4f93-be63-26393969182d tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:18.537921 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-860b1119-8b5c-4f93-be63-26393969182d tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] [instance: baf47131-7a59-4588-9ce6-113709fa8480] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:57:18.550833 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-860b1119-8b5c-4f93-be63-26393969182d tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:18.551617 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-860b1119-8b5c-4f93-be63-26393969182d tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:18.552214 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-860b1119-8b5c-4f93-be63-26393969182d tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:18.553420 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-860b1119-8b5c-4f93-be63-26393969182d tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:18.554035 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-860b1119-8b5c-4f93-be63-26393969182d tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:18.554605 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-860b1119-8b5c-4f93-be63-26393969182d tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:18.685539 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-bdeb9852-eb72-4170-bf09-ed06d16cdc7d tempest-SecurityGroupsTestAdminJSON-575839645 tempest-SecurityGroupsTestAdminJSON-575839645-project] 10.222.0.58 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1111 microversion: 2.1 time: 0.488526 Aug 10 22:57:18.695495 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 246/486] 10.222.0.58 () {58 vars in 1191 bytes} [Wed Aug 10 22:57:18 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1111 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:57:18.701225 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-afa7b3a9-a6cb-4c40-8458-a87c8e072b6d req-e5296691-7c7f-48ef-a440-c4b29d7e817f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9acba217-4a32-4650-a43e-9d998061323c", "name": "network-vif-unplugged", "status": "completed", "tag": "7f752529-8509-4990-90aa-e93ad25cb8d1"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:57:18.726714 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-afa7b3a9-a6cb-4c40-8458-a87c8e072b6d req-e5296691-7c7f-48ef-a440-c4b29d7e817f service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:18.727526 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-afa7b3a9-a6cb-4c40-8458-a87c8e072b6d req-e5296691-7c7f-48ef-a440-c4b29d7e817f service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:18.728147 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-afa7b3a9-a6cb-4c40-8458-a87c8e072b6d req-e5296691-7c7f-48ef-a440-c4b29d7e817f service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:18.747344 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-afa7b3a9-a6cb-4c40-8458-a87c8e072b6d req-e5296691-7c7f-48ef-a440-c4b29d7e817f service nova] Creating event network-vif-unplugged:7f752529-8509-4990-90aa-e93ad25cb8d1 for instance 9acba217-4a32-4650-a43e-9d998061323c on n-h1-850468-14 Aug 10 22:57:18.788670 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [req-afa7b3a9-a6cb-4c40-8458-a87c8e072b6d req-e5296691-7c7f-48ef-a440-c4b29d7e817f service nova] Instance 9acba217-4a32-4650-a43e-9d998061323c is migrating within the same cell, copying events to all relevant hosts: {'n-h1-850468-14', 'n-h2-850468-14'} {{(pid=122633) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5901}} Aug 10 22:57:18.828498 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-afa7b3a9-a6cb-4c40-8458-a87c8e072b6d req-e5296691-7c7f-48ef-a440-c4b29d7e817f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.130012 Aug 10 22:57:18.832294 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 247/487] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 22:57:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:57:18.837841 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-16de3fa4-4e5a-4c45-98cf-953170b368b3 tempest-SecurityGroupsTestAdminJSON-611002203 tempest-SecurityGroupsTestAdminJSON-611002203-project-admin] Calling method '.version_select at 0x7f847d6b4dc0>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:19.137179 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-16de3fa4-4e5a-4c45-98cf-953170b368b3 tempest-SecurityGroupsTestAdminJSON-611002203 tempest-SecurityGroupsTestAdminJSON-611002203-project-admin] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/caa93fed-c2c7-4783-aac2-8d2484454a49" status: 202 len: 0 microversion: 2.1 time: 0.303246 Aug 10 22:57:19.151276 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 248/488] 10.222.0.58 () {58 vars in 1272 bytes} [Wed Aug 10 22:57:18 2022] DELETE /compute/v2.1/os-security-groups/caa93fed-c2c7-4783-aac2-8d2484454a49 => generated 0 bytes in 318 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 22:57:19.161912 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-bebf2ee3-fe40-40a0-bf26-3f309b0affc0 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:19.175422 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-bebf2ee3-fe40-40a0-bf26-3f309b0affc0 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 9acba217-4a32-4650-a43e-9d998061323c] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:57:19.221711 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bebf2ee3-fe40-40a0-bf26-3f309b0affc0 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:19.222935 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bebf2ee3-fe40-40a0-bf26-3f309b0affc0 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:19.223860 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bebf2ee3-fe40-40a0-bf26-3f309b0affc0 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:19.224828 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bebf2ee3-fe40-40a0-bf26-3f309b0affc0 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:19.225683 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bebf2ee3-fe40-40a0-bf26-3f309b0affc0 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:19.226345 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bebf2ee3-fe40-40a0-bf26-3f309b0affc0 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:19.471363 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=6 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:57:19.511285 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=6 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:57:19.633208 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-bebf2ee3-fe40-40a0-bf26-3f309b0affc0 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:19.647184 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-bebf2ee3-fe40-40a0-bf26-3f309b0affc0 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/9acba217-4a32-4650-a43e-9d998061323c" status: 200 len: 1475 microversion: 2.1 time: 0.489936 Aug 10 22:57:19.666741 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 249/489] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:57:19 2022] GET /compute/v2.1/servers/9acba217-4a32-4650-a43e-9d998061323c => generated 1475 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:57:19.684236 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-68aee1be-7b46-4b3d-99af-b976f6fdb352 tempest-SecurityGroupsTestAdminJSON-611002203 tempest-SecurityGroupsTestAdminJSON-611002203-project-admin] Calling method '.version_select at 0x7f847d8003a0>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:20.189352 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-68aee1be-7b46-4b3d-99af-b976f6fdb352 tempest-SecurityGroupsTestAdminJSON-611002203 tempest-SecurityGroupsTestAdminJSON-611002203-project-admin] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/be2fed12-9dcf-42fc-898f-0c81c820f99f" status: 202 len: 0 microversion: 2.1 time: 0.519859 Aug 10 22:57:20.193210 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 250/490] 10.222.0.58 () {58 vars in 1272 bytes} [Wed Aug 10 22:57:19 2022] DELETE /compute/v2.1/os-security-groups/be2fed12-9dcf-42fc-898f-0c81c820f99f => generated 0 bytes in 525 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 22:57:20.203094 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-e3de9f39-754b-4021-846b-4f14c788165e tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:20.204027 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-e3de9f39-754b-4021-846b-4f14c788165e tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] [instance: e773ec0c-0cd0-4a08-b9f0-5c2d0a342751] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:57:20.232725 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e3de9f39-754b-4021-846b-4f14c788165e tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:20.233224 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e3de9f39-754b-4021-846b-4f14c788165e tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:20.233661 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e3de9f39-754b-4021-846b-4f14c788165e tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:20.243186 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e3de9f39-754b-4021-846b-4f14c788165e tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:20.243679 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e3de9f39-754b-4021-846b-4f14c788165e tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:20.248404 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e3de9f39-754b-4021-846b-4f14c788165e tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:20.365592 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-860b1119-8b5c-4f93-be63-26393969182d tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:20.394303 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-860b1119-8b5c-4f93-be63-26393969182d tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:20.404980 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-860b1119-8b5c-4f93-be63-26393969182d tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:20.413736 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-860b1119-8b5c-4f93-be63-26393969182d tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] 10.222.0.58 "GET /compute/v2.1/servers/baf47131-7a59-4588-9ce6-113709fa8480" status: 200 len: 1569 microversion: 2.25 time: 1.916095 Aug 10 22:57:20.417506 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 241/491] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 22:57:18 2022] GET /compute/v2.1/servers/baf47131-7a59-4588-9ce6-113709fa8480 => generated 1569 bytes in 1922 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:57:20.436809 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-cf6ef7b6-b7f9-4b03-9b12-f1f357bdcbb9 tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:20.441111 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-cf6ef7b6-b7f9-4b03-9b12-f1f357bdcbb9 tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] [instance: ec0e154c-f1b0-4da5-ba56-b0eb6fa334a9] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:57:20.462334 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cf6ef7b6-b7f9-4b03-9b12-f1f357bdcbb9 tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:20.463723 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-e3de9f39-754b-4021-846b-4f14c788165e tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaed2a2e56f749a88c340aaccb15d2d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deaba512051743deb45881d76eb206ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:20.465668 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cf6ef7b6-b7f9-4b03-9b12-f1f357bdcbb9 tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:20.466226 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cf6ef7b6-b7f9-4b03-9b12-f1f357bdcbb9 tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:20.467101 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cf6ef7b6-b7f9-4b03-9b12-f1f357bdcbb9 tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:20.469057 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cf6ef7b6-b7f9-4b03-9b12-f1f357bdcbb9 tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:20.471449 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cf6ef7b6-b7f9-4b03-9b12-f1f357bdcbb9 tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:20.481443 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-e3de9f39-754b-4021-846b-4f14c788165e tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] 10.222.0.58 "GET /compute/v2.1/servers/e773ec0c-0cd0-4a08-b9f0-5c2d0a342751" status: 200 len: 1317 microversion: 2.1 time: 0.283513 Aug 10 22:57:20.482944 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 251/492] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:57:20 2022] GET /compute/v2.1/servers/e773ec0c-0cd0-4a08-b9f0-5c2d0a342751 => generated 1317 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:57:20.499358 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-50f70ebc-697a-4d4d-ab9c-0bf5e4deb29c tempest-SecurityGroupsTestAdminJSON-575839645 tempest-SecurityGroupsTestAdminJSON-575839645-project] Calling method '.version_select at 0x7f847d6cb310>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:20.556572 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cf6ef7b6-b7f9-4b03-9b12-f1f357bdcbb9 tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:20.557300 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cf6ef7b6-b7f9-4b03-9b12-f1f357bdcbb9 tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:20.558171 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cf6ef7b6-b7f9-4b03-9b12-f1f357bdcbb9 tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:20.560392 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.objects.instance [None req-cf6ef7b6-b7f9-4b03-9b12-f1f357bdcbb9 tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] Lazy-loading 'fault' on Instance uuid ec0e154c-f1b0-4da5-ba56-b0eb6fa334a9 {{(pid=122632) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 22:57:20.886454 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-cf6ef7b6-b7f9-4b03-9b12-f1f357bdcbb9 tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fc65c017e774af2829d5cd7a7170995', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5c26b1fa1b7409e81790aba647a3049', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:20.906280 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-cf6ef7b6-b7f9-4b03-9b12-f1f357bdcbb9 tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] 10.222.0.58 "GET /compute/v2.1/servers/ec0e154c-f1b0-4da5-ba56-b0eb6fa334a9" status: 200 len: 1303 microversion: 2.1 time: 0.482802 Aug 10 22:57:20.911123 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 242/493] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:57:20 2022] GET /compute/v2.1/servers/ec0e154c-f1b0-4da5-ba56-b0eb6fa334a9 => generated 1303 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:57:20.932667 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-3d5312f7-6dc0-4ee6-82a4-d57ad20c48ca tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:20.934606 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-3d5312f7-6dc0-4ee6-82a4-d57ad20c48ca tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 9acba217-4a32-4650-a43e-9d998061323c] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:57:20.958167 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3d5312f7-6dc0-4ee6-82a4-d57ad20c48ca tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:20.964701 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3d5312f7-6dc0-4ee6-82a4-d57ad20c48ca tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:20.965310 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3d5312f7-6dc0-4ee6-82a4-d57ad20c48ca tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:20.966224 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3d5312f7-6dc0-4ee6-82a4-d57ad20c48ca tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:20.966828 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3d5312f7-6dc0-4ee6-82a4-d57ad20c48ca tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:20.967364 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3d5312f7-6dc0-4ee6-82a4-d57ad20c48ca tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:21.113027 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-50f70ebc-697a-4d4d-ab9c-0bf5e4deb29c tempest-SecurityGroupsTestAdminJSON-575839645 tempest-SecurityGroupsTestAdminJSON-575839645-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/c420b2ee-c63b-4b84-bbaf-9bea4b6c9d49" status: 202 len: 0 microversion: 2.1 time: 0.624479 Aug 10 22:57:21.113942 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 252/494] 10.222.0.58 () {58 vars in 1272 bytes} [Wed Aug 10 22:57:20 2022] DELETE /compute/v2.1/os-security-groups/c420b2ee-c63b-4b84-bbaf-9bea4b6c9d49 => generated 0 bytes in 626 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 22:57:21.122096 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-e81977c6-6204-4786-a2a8-3aa47b56346c req-3aa39084-b969-4da2-a758-f26ddc0bb46b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec0e154c-f1b0-4da5-ba56-b0eb6fa334a9", "name": "network-vif-deleted", "tag": "ddba1774-9d47-4fef-ade3-804429989b56"}, {"name": "network-changed", "server_uuid": "9acba217-4a32-4650-a43e-9d998061323c", "tag": "7f752529-8509-4990-90aa-e93ad25cb8d1"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:57:21.156121 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-e81977c6-6204-4786-a2a8-3aa47b56346c req-3aa39084-b969-4da2-a758-f26ddc0bb46b service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:21.162127 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-e81977c6-6204-4786-a2a8-3aa47b56346c req-3aa39084-b969-4da2-a758-f26ddc0bb46b service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:21.163206 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-e81977c6-6204-4786-a2a8-3aa47b56346c req-3aa39084-b969-4da2-a758-f26ddc0bb46b service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:21.212699 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-e81977c6-6204-4786-a2a8-3aa47b56346c req-3aa39084-b969-4da2-a758-f26ddc0bb46b service nova] Creating event network-vif-deleted:ddba1774-9d47-4fef-ade3-804429989b56 for instance ec0e154c-f1b0-4da5-ba56-b0eb6fa334a9 on n-h2-850468-14 Aug 10 22:57:21.215302 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-e81977c6-6204-4786-a2a8-3aa47b56346c req-3aa39084-b969-4da2-a758-f26ddc0bb46b service nova] Creating event network-changed:7f752529-8509-4990-90aa-e93ad25cb8d1 for instance 9acba217-4a32-4650-a43e-9d998061323c on n-h1-850468-14 Aug 10 22:57:21.225354 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [req-e81977c6-6204-4786-a2a8-3aa47b56346c req-3aa39084-b969-4da2-a758-f26ddc0bb46b service nova] Instance 9acba217-4a32-4650-a43e-9d998061323c is migrating within the same cell, copying events to all relevant hosts: {'n-h1-850468-14', 'n-h2-850468-14'} {{(pid=122633) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5901}} Aug 10 22:57:21.263296 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-e81977c6-6204-4786-a2a8-3aa47b56346c req-3aa39084-b969-4da2-a758-f26ddc0bb46b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.144822 Aug 10 22:57:21.266051 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 253/495] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 22:57:21 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:57:21.278866 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-59721365-5177-4690-90ed-ca480588053a tempest-SecurityGroupsTestAdminJSON-575839645 tempest-SecurityGroupsTestAdminJSON-575839645-project] Calling method '.version_select at 0x7f847d6cbaf0>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:21.723239 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=13 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:57:21.844231 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-59721365-5177-4690-90ed-ca480588053a tempest-SecurityGroupsTestAdminJSON-575839645 tempest-SecurityGroupsTestAdminJSON-575839645-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/6fd0b51f-b3bb-4f31-b176-7f86ff7e9aaa" status: 202 len: 0 microversion: 2.1 time: 0.576541 Aug 10 22:57:21.845531 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 254/496] 10.222.0.58 () {58 vars in 1272 bytes} [Wed Aug 10 22:57:21 2022] DELETE /compute/v2.1/os-security-groups/6fd0b51f-b3bb-4f31-b176-7f86ff7e9aaa => generated 0 bytes in 578 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 22:57:21.870510 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-14653f32-4141-41be-b1f0-8fb23417165e tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:21.877892 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-14653f32-4141-41be-b1f0-8fb23417165e tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] [instance: baf47131-7a59-4588-9ce6-113709fa8480] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:57:21.903573 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-14653f32-4141-41be-b1f0-8fb23417165e tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:21.906504 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-14653f32-4141-41be-b1f0-8fb23417165e tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:21.907820 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-14653f32-4141-41be-b1f0-8fb23417165e tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:21.909312 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-14653f32-4141-41be-b1f0-8fb23417165e tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:21.912743 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-14653f32-4141-41be-b1f0-8fb23417165e tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:21.913626 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-14653f32-4141-41be-b1f0-8fb23417165e tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:22.128774 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-3d5312f7-6dc0-4ee6-82a4-d57ad20c48ca tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:22.140877 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-3d5312f7-6dc0-4ee6-82a4-d57ad20c48ca tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/9acba217-4a32-4650-a43e-9d998061323c" status: 200 len: 1475 microversion: 2.1 time: 1.228332 Aug 10 22:57:22.144789 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 243/497] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:57:20 2022] GET /compute/v2.1/servers/9acba217-4a32-4650-a43e-9d998061323c => generated 1475 bytes in 1233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:57:22.164419 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-623f32c5-9ef4-4bfd-9360-be54f857fc69 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:22.171754 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-623f32c5-9ef4-4bfd-9360-be54f857fc69 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] [instance: e773ec0c-0cd0-4a08-b9f0-5c2d0a342751] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:57:22.208098 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-623f32c5-9ef4-4bfd-9360-be54f857fc69 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:22.209017 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-623f32c5-9ef4-4bfd-9360-be54f857fc69 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:22.210160 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-623f32c5-9ef4-4bfd-9360-be54f857fc69 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:22.216760 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-623f32c5-9ef4-4bfd-9360-be54f857fc69 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:22.217617 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-623f32c5-9ef4-4bfd-9360-be54f857fc69 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:22.219003 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-623f32c5-9ef4-4bfd-9360-be54f857fc69 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:22.441884 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-14653f32-4141-41be-b1f0-8fb23417165e tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:22.454940 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-14653f32-4141-41be-b1f0-8fb23417165e tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:22.461645 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-14653f32-4141-41be-b1f0-8fb23417165e tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:22.463122 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-14653f32-4141-41be-b1f0-8fb23417165e tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] 10.222.0.58 "GET /compute/v2.1/servers/baf47131-7a59-4588-9ce6-113709fa8480" status: 200 len: 1569 microversion: 2.25 time: 0.614653 Aug 10 22:57:22.464010 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 255/498] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 22:57:21 2022] GET /compute/v2.1/servers/baf47131-7a59-4588-9ce6-113709fa8480 => generated 1569 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:57:22.474511 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-735a698e-3fb5-4588-b14a-8a71f49610d8 tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:22.476736 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-735a698e-3fb5-4588-b14a-8a71f49610d8 tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] [instance: ec0e154c-f1b0-4da5-ba56-b0eb6fa334a9] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:57:22.493812 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-735a698e-3fb5-4588-b14a-8a71f49610d8 tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:22.495058 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-735a698e-3fb5-4588-b14a-8a71f49610d8 tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:22.495698 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-735a698e-3fb5-4588-b14a-8a71f49610d8 tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:22.496667 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-735a698e-3fb5-4588-b14a-8a71f49610d8 tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:22.497299 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-735a698e-3fb5-4588-b14a-8a71f49610d8 tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:22.498161 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-735a698e-3fb5-4588-b14a-8a71f49610d8 tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:22.549663 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-735a698e-3fb5-4588-b14a-8a71f49610d8 tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] HTTP exception thrown: Instance ec0e154c-f1b0-4da5-ba56-b0eb6fa334a9 could not be found. Aug 10 22:57:22.552328 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-735a698e-3fb5-4588-b14a-8a71f49610d8 tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] Request method failure captured: Aug 10 22:57:22.552328 n-d-850468-14 devstack@n-api.service[122633]: request: GET /compute/v2.1/servers/ec0e154c-f1b0-4da5-ba56-b0eb6fa334a9 HTTP/1.1 Aug 10 22:57:22.552328 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 22:57:22.552328 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 22:57:22.552328 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 22:57:22.552328 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 22:57:22.552328 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 22:57:22.552328 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 22:57:22.552328 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 22:57:22.552328 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 22:57:22.552328 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9DeqYQ38ovFwv5qsnaD_iHnPLz2BoLsgxOakpAZ-Yow3ScmT7yOGgQrdegs7JzrxJ-fauFnknlaN2E30SExK0BSDSspaiJNejPzRA9B6K4y69fWtMyC88h7Ow01vZ8dc-XEyzxgEiyBRqSHmAyYSE8-4q4SThp_itgNdE9yIPH_LO28 Aug 10 22:57:22.552328 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 22:57:22.552328 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 22:57:22.552328 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 22:57:22.552328 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 22:57:22.552328 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 22:57:22.552328 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 22:57:22.552328 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: d5c26b1fa1b7409e81790aba647a3049 Aug 10 22:57:22.552328 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-TenantUsagesTestJSON-539362731 Aug 10 22:57:22.552328 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 22:57:22.552328 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 22:57:22.553712 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d5c26b1fa1b7409e81790aba647a3049"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d5c26b1fa1b7409e81790aba647a3049"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d5c26b1fa1b7409e81790aba647a3049"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d5c26b1fa1b7409e81790aba647a3049", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 22:57:22.553712 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-TenantUsagesTestJSON-539362731 Aug 10 22:57:22.553712 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: d5c26b1fa1b7409e81790aba647a3049 Aug 10 22:57:22.553712 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-TenantUsagesTestJSON-539362731 Aug 10 22:57:22.553712 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-TenantUsagesTestJSON-539362731-project Aug 10 22:57:22.553712 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 22:57:22.553712 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 22:57:22.553712 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 0fc65c017e774af2829d5cd7a7170995 Aug 10 22:57:22.553712 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-TenantUsagesTestJSON-539362731-project Aug 10 22:57:22.553712 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 22:57:22.553712 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance ec0e154c-f1b0-4da5-ba56-b0eb6fa334a9 could not be found. Aug 10 22:57:22.553712 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': 'ec0e154c-f1b0-4da5-ba56-b0eb6fa334a9'} Aug 10 22:57:22.554524 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 22:57:22.554524 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:57:22.554524 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 22:57:22.554524 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 22:57:22.554524 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 22:57:22.554524 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 22:57:22.554524 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 22:57:22.554524 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 22:57:22.554524 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 22:57:22.554524 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 22:57:22.554524 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec0e154c-f1b0-4da5-ba56-b0eb6fa334a9 could not be found. Aug 10 22:57:22.554524 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:57:22.554524 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:57:22.554524 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:57:22.554524 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:57:22.554524 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:57:22.554524 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:57:22.554524 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 22:57:22.554524 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 22:57:22.554524 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 22:57:22.555803 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 22:57:22.555803 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 22:57:22.555803 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 22:57:22.555803 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 22:57:22.555803 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 22:57:22.555803 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 22:57:22.555803 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 22:57:22.555803 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec0e154c-f1b0-4da5-ba56-b0eb6fa334a9 could not be found. Aug 10 22:57:22.555803 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:57:22.555803 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:57:22.555803 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:57:22.555803 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:57:22.555803 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:57:22.555803 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:57:22.555803 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 22:57:22.555803 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 22:57:22.555803 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec0e154c-f1b0-4da5-ba56-b0eb6fa334a9 could not be found. Aug 10 22:57:22.555803 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:57:22.562993 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-735a698e-3fb5-4588-b14a-8a71f49610d8 tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] Returning 404 to user: Instance ec0e154c-f1b0-4da5-ba56-b0eb6fa334a9 could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 22:57:22.564183 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-735a698e-3fb5-4588-b14a-8a71f49610d8 tempest-TenantUsagesTestJSON-539362731 tempest-TenantUsagesTestJSON-539362731-project] 10.222.0.58 "GET /compute/v2.1/servers/ec0e154c-f1b0-4da5-ba56-b0eb6fa334a9" status: 404 len: 111 microversion: 2.1 time: 0.099027 Aug 10 22:57:22.569393 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 256/499] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:57:22 2022] GET /compute/v2.1/servers/ec0e154c-f1b0-4da5-ba56-b0eb6fa334a9 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 22:57:23.165058 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-6858c14d-82b9-4bd9-ba19-11edf5e5a14c tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:23.165630 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-6858c14d-82b9-4bd9-ba19-11edf5e5a14c tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 9acba217-4a32-4650-a43e-9d998061323c] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:57:23.220167 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6858c14d-82b9-4bd9-ba19-11edf5e5a14c tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:23.227655 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6858c14d-82b9-4bd9-ba19-11edf5e5a14c tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:23.229266 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6858c14d-82b9-4bd9-ba19-11edf5e5a14c tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:23.231723 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6858c14d-82b9-4bd9-ba19-11edf5e5a14c tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:23.237449 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6858c14d-82b9-4bd9-ba19-11edf5e5a14c tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:23.238138 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6858c14d-82b9-4bd9-ba19-11edf5e5a14c tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:23.657778 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-623f32c5-9ef4-4bfd-9360-be54f857fc69 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaed2a2e56f749a88c340aaccb15d2d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deaba512051743deb45881d76eb206ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:23.667489 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-623f32c5-9ef4-4bfd-9360-be54f857fc69 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] 10.222.0.58 "GET /compute/v2.1/servers/e773ec0c-0cd0-4a08-b9f0-5c2d0a342751" status: 200 len: 1385 microversion: 2.1 time: 1.520911 Aug 10 22:57:23.668790 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 244/500] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:57:22 2022] GET /compute/v2.1/servers/e773ec0c-0cd0-4a08-b9f0-5c2d0a342751 => generated 1385 bytes in 1523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:57:23.673724 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-0544b3bf-fd25-4e35-adc6-b2a1da584850 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:23.675444 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-0544b3bf-fd25-4e35-adc6-b2a1da584850 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] [instance: baf47131-7a59-4588-9ce6-113709fa8480] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:57:23.682855 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0544b3bf-fd25-4e35-adc6-b2a1da584850 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:23.683666 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0544b3bf-fd25-4e35-adc6-b2a1da584850 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:23.684257 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0544b3bf-fd25-4e35-adc6-b2a1da584850 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:23.685105 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0544b3bf-fd25-4e35-adc6-b2a1da584850 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:23.685713 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0544b3bf-fd25-4e35-adc6-b2a1da584850 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:23.686309 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0544b3bf-fd25-4e35-adc6-b2a1da584850 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:24.251077 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=27 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:57:24.425252 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-6858c14d-82b9-4bd9-ba19-11edf5e5a14c tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:24.438480 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-6858c14d-82b9-4bd9-ba19-11edf5e5a14c tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/9acba217-4a32-4650-a43e-9d998061323c" status: 200 len: 1475 microversion: 2.1 time: 1.277102 Aug 10 22:57:24.458082 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 257/501] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:57:23 2022] GET /compute/v2.1/servers/9acba217-4a32-4650-a43e-9d998061323c => generated 1475 bytes in 1297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:57:24.468500 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-0544b3bf-fd25-4e35-adc6-b2a1da584850 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:24.487681 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-0544b3bf-fd25-4e35-adc6-b2a1da584850 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:24.493468 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-0544b3bf-fd25-4e35-adc6-b2a1da584850 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:24.504756 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-0544b3bf-fd25-4e35-adc6-b2a1da584850 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] 10.222.0.58 "GET /compute/v2.1/servers/baf47131-7a59-4588-9ce6-113709fa8480" status: 200 len: 1569 microversion: 2.25 time: 0.831906 Aug 10 22:57:24.510390 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 245/502] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 22:57:23 2022] GET /compute/v2.1/servers/baf47131-7a59-4588-9ce6-113709fa8480 => generated 1569 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:57:24.692908 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-acb9d3f1-eec6-4577-a981-75e4841d4598 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:24.694087 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-acb9d3f1-eec6-4577-a981-75e4841d4598 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] [instance: e773ec0c-0cd0-4a08-b9f0-5c2d0a342751] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:57:24.703578 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-acb9d3f1-eec6-4577-a981-75e4841d4598 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:24.706249 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-acb9d3f1-eec6-4577-a981-75e4841d4598 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:24.708477 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-acb9d3f1-eec6-4577-a981-75e4841d4598 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:24.711723 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-acb9d3f1-eec6-4577-a981-75e4841d4598 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:24.716769 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-acb9d3f1-eec6-4577-a981-75e4841d4598 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:24.717497 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-acb9d3f1-eec6-4577-a981-75e4841d4598 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:25.291139 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-76082af2-9dcc-4621-93be-a99c43ce56ee tempest-TenantUsagesNegativeTestJSON-589325448 tempest-TenantUsagesNegativeTestJSON-589325448-project-admin] 10.222.0.58 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-08-09T22%3A57%3A24.962749&end=2022-08-11T22%3A57%3A24.962749" status: 404 len: 112 microversion: - time: 0.324268 Aug 10 22:57:25.294671 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 246/503] 10.222.0.58 () {58 vars in 1316 bytes} [Wed Aug 10 22:57:24 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-08-09T22%3A57%3A24.962749&end=2022-08-11T22%3A57%3A24.962749 => generated 112 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 10 22:57:25.307573 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-48c72130-f3b7-40b8-9a43-a190df06661a tempest-TenantUsagesNegativeTestJSON-589325448 tempest-TenantUsagesNegativeTestJSON-589325448-project-admin] Calling method '.version_select at 0x7f847d8bf3a0>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:25.321395 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-48c72130-f3b7-40b8-9a43-a190df06661a tempest-TenantUsagesNegativeTestJSON-589325448 tempest-TenantUsagesNegativeTestJSON-589325448-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Aug 10 22:57:25.332644 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-48c72130-f3b7-40b8-9a43-a190df06661a tempest-TenantUsagesNegativeTestJSON-589325448 tempest-TenantUsagesNegativeTestJSON-589325448-project-admin] Request method failure captured: Aug 10 22:57:25.332644 n-d-850468-14 devstack@n-api.service[122632]: request: GET /compute/v2.1/os-simple-tenant-usage/1908414b7d784b3ea74b19c586c703fc?start=2022-08-11T22%3A57%3A24.962749&end=2022-08-09T22%3A57%3A24.962749 HTTP/1.1 Aug 10 22:57:25.332644 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 22:57:25.332644 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 22:57:25.332644 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 22:57:25.332644 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 22:57:25.332644 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 22:57:25.332644 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 22:57:25.332644 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 22:57:25.332644 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 22:57:25.332644 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9DfUhKy_Xn01xm96Lur_vQlHYTNav5aEYl1zwfbOuj6hk9Ja_FrrNbrEBUi7x4Gug1etj0k3aCgk_rzwgb3PTje_54VOo1EBrd4Cn0TuENniV0ZYbDEORcSRjzk5Lv63PsHWXYETU8LkO8Z-7jZpfUNuOTSGuFIcGbyVQK-eBoQsuJU Aug 10 22:57:25.332644 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 22:57:25.332644 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 22:57:25.332644 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 22:57:25.332644 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 22:57:25.332644 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 22:57:25.332644 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 22:57:25.332644 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: f1a2a3c1c0a14fad8b312998e16d4761 Aug 10 22:57:25.332644 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-589325448 Aug 10 22:57:25.332644 n-d-850468-14 devstack@n-api.service[122632]: X-Role: admin,member,reader Aug 10 22:57:25.332644 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: admin,member,reader Aug 10 22:57:25.335258 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f1a2a3c1c0a14fad8b312998e16d4761"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f1a2a3c1c0a14fad8b312998e16d4761"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/f1a2a3c1c0a14fad8b312998e16d4761"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_f1a2a3c1c0a14fad8b312998e16d4761", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 22:57:25.335258 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-589325448 Aug 10 22:57:25.335258 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: f1a2a3c1c0a14fad8b312998e16d4761 Aug 10 22:57:25.335258 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-589325448 Aug 10 22:57:25.335258 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-TenantUsagesNegativeTestJSON-589325448-project-admin Aug 10 22:57:25.335258 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 22:57:25.335258 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 22:57:25.335258 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: 00fcbaed47344d8cb4de640e4c4b3f48 Aug 10 22:57:25.335258 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-589325448-project-admin Aug 10 22:57:25.335258 n-d-850468-14 devstack@n-api.service[122632]: method: Aug 10 22:57:25.335258 n-d-850468-14 devstack@n-api.service[122632]: exception: Invalid start time. The start time cannot occur after the end time. Aug 10 22:57:25.335258 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': '1908414b7d784b3ea74b19c586c703fc'} Aug 10 22:57:25.336548 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 22:57:25.336548 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:57:25.336548 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:57:25.336548 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:57:25.336548 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 22:57:25.336548 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 22:57:25.336548 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 22:57:25.336548 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 22:57:25.336548 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 10 22:57:25.336548 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 22:57:25.336548 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 22:57:25.336548 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 22:57:25.336548 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Aug 10 22:57:25.336548 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return self._show(req, id) Aug 10 22:57:25.336548 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Aug 10 22:57:25.336548 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Aug 10 22:57:25.336548 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Aug 10 22:57:25.336548 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Aug 10 22:57:25.336548 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Aug 10 22:57:25.337926 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:57:25.337926 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:57:25.337926 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:57:25.337926 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:57:25.337926 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:57:25.337926 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:57:25.337926 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 22:57:25.337926 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 22:57:25.337926 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Aug 10 22:57:25.337926 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:57:25.339149 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-48c72130-f3b7-40b8-9a43-a190df06661a tempest-TenantUsagesNegativeTestJSON-589325448 tempest-TenantUsagesNegativeTestJSON-589325448-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 22:57:25.341829 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-48c72130-f3b7-40b8-9a43-a190df06661a tempest-TenantUsagesNegativeTestJSON-589325448 tempest-TenantUsagesNegativeTestJSON-589325448-project-admin] 10.222.0.58 "GET /compute/v2.1/os-simple-tenant-usage/1908414b7d784b3ea74b19c586c703fc?start=2022-08-11T22%3A57%3A24.962749&end=2022-08-09T22%3A57%3A24.962749" status: 400 len: 111 microversion: 2.1 time: 0.039987 Aug 10 22:57:25.347264 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 247/504] 10.222.0.58 () {58 vars in 1412 bytes} [Wed Aug 10 22:57:25 2022] GET /compute/v2.1/os-simple-tenant-usage/1908414b7d784b3ea74b19c586c703fc?start=2022-08-11T22%3A57%3A24.962749&end=2022-08-09T22%3A57%3A24.962749 => generated 111 bytes in 45 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 10 22:57:25.485572 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-acb9d3f1-eec6-4577-a981-75e4841d4598 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaed2a2e56f749a88c340aaccb15d2d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deaba512051743deb45881d76eb206ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:25.537473 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-acb9d3f1-eec6-4577-a981-75e4841d4598 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] 10.222.0.58 "GET /compute/v2.1/servers/e773ec0c-0cd0-4a08-b9f0-5c2d0a342751" status: 200 len: 1385 microversion: 2.1 time: 0.843463 Aug 10 22:57:25.542327 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 258/505] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:57:24 2022] GET /compute/v2.1/servers/e773ec0c-0cd0-4a08-b9f0-5c2d0a342751 => generated 1385 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:57:25.557233 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-d3989dc0-d34e-45d2-a7c7-01f7461e9a0f tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:25.562133 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-d3989dc0-d34e-45d2-a7c7-01f7461e9a0f tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 9acba217-4a32-4650-a43e-9d998061323c] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:57:25.588730 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d3989dc0-d34e-45d2-a7c7-01f7461e9a0f tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:25.589702 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d3989dc0-d34e-45d2-a7c7-01f7461e9a0f tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:25.590720 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d3989dc0-d34e-45d2-a7c7-01f7461e9a0f tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:25.594001 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d3989dc0-d34e-45d2-a7c7-01f7461e9a0f tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:25.599936 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d3989dc0-d34e-45d2-a7c7-01f7461e9a0f tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:25.601858 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d3989dc0-d34e-45d2-a7c7-01f7461e9a0f tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:26.118340 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-98ab4e38-537d-4f99-b536-046d865af4b8 tempest-TenantUsagesNegativeTestJSON-583128760 tempest-TenantUsagesNegativeTestJSON-583128760-project] Calling method '.version_select at 0x7f847d986160>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:26.121992 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-98ab4e38-537d-4f99-b536-046d865af4b8 tempest-TenantUsagesNegativeTestJSON-583128760 tempest-TenantUsagesNegativeTestJSON-583128760-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': 'c8432b64794c4fa6bfde823af53e8864', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1908414b7d784b3ea74b19c586c703fc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:26.134233 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-98ab4e38-537d-4f99-b536-046d865af4b8 tempest-TenantUsagesNegativeTestJSON-583128760 tempest-TenantUsagesNegativeTestJSON-583128760-project] Request method failure captured: Aug 10 22:57:26.134233 n-d-850468-14 devstack@n-api.service[122632]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-09T22%3A57%3A24.962749&end=2022-08-11T22%3A57%3A24.962749&detailed=1 HTTP/1.1 Aug 10 22:57:26.134233 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 22:57:26.134233 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 22:57:26.134233 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 22:57:26.134233 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 22:57:26.134233 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 22:57:26.134233 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 22:57:26.134233 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 22:57:26.134233 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 22:57:26.134233 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9DfT1dmHmWWA2u3EJRRd5s2su2e6L8THzJs-dkGfv3FKoQPgPqtCN4VlRBKAXVMwxFh_4CmIwhPPZEugzbSVLT6vYfh8hwxXYMf_d7zVqc871_NEHh992iDOTrVdwKh27OHV-YB1W2bw9H5tvjVkjaDRCtGDjhisyA7ykvrAw1pFqJw Aug 10 22:57:26.134233 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 22:57:26.134233 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 22:57:26.134233 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 22:57:26.134233 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 22:57:26.134233 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 22:57:26.134233 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 22:57:26.134233 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 1908414b7d784b3ea74b19c586c703fc Aug 10 22:57:26.134233 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-583128760 Aug 10 22:57:26.134233 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 22:57:26.134233 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 22:57:26.135515 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1908414b7d784b3ea74b19c586c703fc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1908414b7d784b3ea74b19c586c703fc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/1908414b7d784b3ea74b19c586c703fc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_1908414b7d784b3ea74b19c586c703fc", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 22:57:26.135515 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-583128760 Aug 10 22:57:26.135515 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 1908414b7d784b3ea74b19c586c703fc Aug 10 22:57:26.135515 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-583128760 Aug 10 22:57:26.135515 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-TenantUsagesNegativeTestJSON-583128760-project Aug 10 22:57:26.135515 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 22:57:26.135515 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 22:57:26.135515 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: c8432b64794c4fa6bfde823af53e8864 Aug 10 22:57:26.135515 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-583128760-project Aug 10 22:57:26.135515 n-d-850468-14 devstack@n-api.service[122632]: method: Aug 10 22:57:26.135515 n-d-850468-14 devstack@n-api.service[122632]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Aug 10 22:57:26.135515 n-d-850468-14 devstack@n-api.service[122632]: action_args: {} Aug 10 22:57:26.135515 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 22:57:26.136311 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:57:26.136311 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:57:26.136311 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:57:26.136311 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 22:57:26.136311 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 22:57:26.136311 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 22:57:26.136311 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 22:57:26.136311 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 10 22:57:26.136311 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 22:57:26.136311 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 22:57:26.136311 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 22:57:26.136311 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Aug 10 22:57:26.136311 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return self._index(req) Aug 10 22:57:26.136311 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Aug 10 22:57:26.136311 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Aug 10 22:57:26.136311 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 10 22:57:26.136311 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 10 22:57:26.136311 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 10 22:57:26.136311 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 10 22:57:26.137373 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 10 22:57:26.137373 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 10 22:57:26.137373 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 10 22:57:26.137373 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise self.value Aug 10 22:57:26.137373 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 10 22:57:26.137373 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 10 22:57:26.137373 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 10 22:57:26.137373 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 10 22:57:26.137373 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 10 22:57:26.137373 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 10 22:57:26.137373 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Aug 10 22:57:26.137373 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:57:26.137373 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:57:26.137373 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:57:26.137373 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:57:26.137373 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:57:26.137373 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:57:26.137373 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 10 22:57:26.137373 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 10 22:57:26.138534 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Aug 10 22:57:26.138534 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:57:26.138534 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-98ab4e38-537d-4f99-b536-046d865af4b8 tempest-TenantUsagesNegativeTestJSON-583128760 tempest-TenantUsagesNegativeTestJSON-583128760-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 22:57:26.138534 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-98ab4e38-537d-4f99-b536-046d865af4b8 tempest-TenantUsagesNegativeTestJSON-583128760 tempest-TenantUsagesNegativeTestJSON-583128760-project] 10.222.0.58 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-09T22%3A57%3A24.962749&end=2022-08-11T22%3A57%3A24.962749&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.785433 Aug 10 22:57:26.138534 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 248/506] 10.222.0.58 () {58 vars in 1335 bytes} [Wed Aug 10 22:57:25 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-09T22%3A57%3A24.962749&end=2022-08-11T22%3A57%3A24.962749&detailed=1 => generated 123 bytes in 787 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 10 22:57:26.160725 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-195e84ba-ff44-4ff8-8e8b-0673c06308aa tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:26.161353 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-195e84ba-ff44-4ff8-8e8b-0673c06308aa tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] [instance: baf47131-7a59-4588-9ce6-113709fa8480] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:57:26.186562 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-195e84ba-ff44-4ff8-8e8b-0673c06308aa tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:26.187087 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-195e84ba-ff44-4ff8-8e8b-0673c06308aa tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:26.194880 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-195e84ba-ff44-4ff8-8e8b-0673c06308aa tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:26.200448 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-195e84ba-ff44-4ff8-8e8b-0673c06308aa tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:26.200990 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-195e84ba-ff44-4ff8-8e8b-0673c06308aa tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:26.203675 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-195e84ba-ff44-4ff8-8e8b-0673c06308aa tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:26.301871 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-d3989dc0-d34e-45d2-a7c7-01f7461e9a0f tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:26.314466 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-d3989dc0-d34e-45d2-a7c7-01f7461e9a0f tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/9acba217-4a32-4650-a43e-9d998061323c" status: 200 len: 1475 microversion: 2.1 time: 0.765509 Aug 10 22:57:26.317286 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 259/507] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:57:25 2022] GET /compute/v2.1/servers/9acba217-4a32-4650-a43e-9d998061323c => generated 1475 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:57:26.506537 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-e5c6bd2d-c708-42c1-aa4e-f79dd64568c1 req-7ef41cbe-ccbf-4c4f-84bf-7ce35533f688 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e773ec0c-0cd0-4a08-b9f0-5c2d0a342751", "tag": "4509aea6-eb69-433a-9c36-162726644a47"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:57:26.542813 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-e5c6bd2d-c708-42c1-aa4e-f79dd64568c1 req-7ef41cbe-ccbf-4c4f-84bf-7ce35533f688 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:26.547014 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-e5c6bd2d-c708-42c1-aa4e-f79dd64568c1 req-7ef41cbe-ccbf-4c4f-84bf-7ce35533f688 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:26.551279 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-e5c6bd2d-c708-42c1-aa4e-f79dd64568c1 req-7ef41cbe-ccbf-4c4f-84bf-7ce35533f688 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:26.606561 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-e5c6bd2d-c708-42c1-aa4e-f79dd64568c1 req-7ef41cbe-ccbf-4c4f-84bf-7ce35533f688 service nova] Creating event network-changed:4509aea6-eb69-433a-9c36-162726644a47 for instance e773ec0c-0cd0-4a08-b9f0-5c2d0a342751 on n-h2-850468-14 Aug 10 22:57:26.631850 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-e5c6bd2d-c708-42c1-aa4e-f79dd64568c1 req-7ef41cbe-ccbf-4c4f-84bf-7ce35533f688 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.129291 Aug 10 22:57:26.633164 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 260/508] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 22:57:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:57:26.648421 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-76fad299-38ee-41c7-9269-fb570aa3609e tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:26.651935 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-76fad299-38ee-41c7-9269-fb570aa3609e tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] [instance: e773ec0c-0cd0-4a08-b9f0-5c2d0a342751] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:57:26.669862 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-76fad299-38ee-41c7-9269-fb570aa3609e tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:26.672551 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-76fad299-38ee-41c7-9269-fb570aa3609e tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:26.673216 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-76fad299-38ee-41c7-9269-fb570aa3609e tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:26.677153 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-76fad299-38ee-41c7-9269-fb570aa3609e tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:26.679866 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-76fad299-38ee-41c7-9269-fb570aa3609e tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:26.680325 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-76fad299-38ee-41c7-9269-fb570aa3609e tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:26.924011 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-195e84ba-ff44-4ff8-8e8b-0673c06308aa tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:26.940754 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-195e84ba-ff44-4ff8-8e8b-0673c06308aa tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:26.947312 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-195e84ba-ff44-4ff8-8e8b-0673c06308aa tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:26.952458 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-195e84ba-ff44-4ff8-8e8b-0673c06308aa tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] 10.222.0.58 "GET /compute/v2.1/servers/baf47131-7a59-4588-9ce6-113709fa8480" status: 200 len: 1559 microversion: 2.25 time: 0.814710 Aug 10 22:57:26.953824 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 249/509] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 22:57:26 2022] GET /compute/v2.1/servers/baf47131-7a59-4588-9ce6-113709fa8480 => generated 1559 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:57:26.978003 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-ce5e491c-3586-4e30-aa88-2c1f07bcebdf tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Calling method '.version_select at 0x7f847dc66160>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:26.982369 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ce5e491c-3586-4e30-aa88-2c1f07bcebdf tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:26.983123 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ce5e491c-3586-4e30-aa88-2c1f07bcebdf tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:26.983773 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ce5e491c-3586-4e30-aa88-2c1f07bcebdf tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:27.001784 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-ce5e491c-3586-4e30-aa88-2c1f07bcebdf tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] 10.222.0.58 "GET /compute/v2.1/os-migrations" status: 200 len: 1117 microversion: 2.25 time: 0.027489 Aug 10 22:57:27.013056 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 250/510] 10.222.0.58 () {60 vars in 1184 bytes} [Wed Aug 10 22:57:26 2022] GET /compute/v2.1/os-migrations => generated 1117 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:57:27.018044 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-7b1e4349-6750-4ed1-813a-22f1697fff8f tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:27.019382 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-7b1e4349-6750-4ed1-813a-22f1697fff8f tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] [instance: baf47131-7a59-4588-9ce6-113709fa8480] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:57:27.026603 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7b1e4349-6750-4ed1-813a-22f1697fff8f tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:27.027473 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7b1e4349-6750-4ed1-813a-22f1697fff8f tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:27.028140 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7b1e4349-6750-4ed1-813a-22f1697fff8f tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:27.029122 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7b1e4349-6750-4ed1-813a-22f1697fff8f tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:27.029784 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7b1e4349-6750-4ed1-813a-22f1697fff8f tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:27.030414 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7b1e4349-6750-4ed1-813a-22f1697fff8f tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:27.620801 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-76fad299-38ee-41c7-9269-fb570aa3609e tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaed2a2e56f749a88c340aaccb15d2d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deaba512051743deb45881d76eb206ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:27.636360 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-76fad299-38ee-41c7-9269-fb570aa3609e tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] 10.222.0.58 "GET /compute/v2.1/servers/e773ec0c-0cd0-4a08-b9f0-5c2d0a342751" status: 200 len: 1385 microversion: 2.1 time: 0.997164 Aug 10 22:57:27.638651 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 261/511] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:57:26 2022] GET /compute/v2.1/servers/e773ec0c-0cd0-4a08-b9f0-5c2d0a342751 => generated 1385 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:57:27.645404 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-13d491b4-ce87-43a7-b4a2-9614bbb98d47 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:27.646340 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-13d491b4-ce87-43a7-b4a2-9614bbb98d47 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 9acba217-4a32-4650-a43e-9d998061323c] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:57:27.676216 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-13d491b4-ce87-43a7-b4a2-9614bbb98d47 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:27.679918 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-13d491b4-ce87-43a7-b4a2-9614bbb98d47 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:27.681153 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-13d491b4-ce87-43a7-b4a2-9614bbb98d47 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:27.684806 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-13d491b4-ce87-43a7-b4a2-9614bbb98d47 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:27.685446 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-13d491b4-ce87-43a7-b4a2-9614bbb98d47 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:27.687478 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-13d491b4-ce87-43a7-b4a2-9614bbb98d47 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:27.757251 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.objects.instance [None req-7b1e4349-6750-4ed1-813a-22f1697fff8f tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Lazy-loading 'services' on Instance uuid baf47131-7a59-4588-9ce6-113709fa8480 {{(pid=122632) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 22:57:27.827835 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-7b1e4349-6750-4ed1-813a-22f1697fff8f tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/baf47131-7a59-4588-9ce6-113709fa8480" status: 200 len: 2054 microversion: 2.25 time: 0.797337 Aug 10 22:57:27.849752 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 251/512] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 22:57:27 2022] GET /compute/v2.1/servers/baf47131-7a59-4588-9ce6-113709fa8480 => generated 2054 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:57:28.052335 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-261ab015-0004-435d-b13e-c85db6f0ac6f tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-190337878", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452", "networks": [{"uuid": "aa35c9d2-0c9d-4fce-b653-23b4074314a8"}]}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:57:28.112738 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-13d491b4-ce87-43a7-b4a2-9614bbb98d47 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:28.132143 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-13d491b4-ce87-43a7-b4a2-9614bbb98d47 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/9acba217-4a32-4650-a43e-9d998061323c" status: 200 len: 1470 microversion: 2.1 time: 0.488987 Aug 10 22:57:28.150494 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 262/513] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:57:27 2022] GET /compute/v2.1/servers/9acba217-4a32-4650-a43e-9d998061323c => generated 1470 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:57:28.166145 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-7820e2ac-b746-4837-8a4d-9e440745c78d tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:57:28.166923 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-7820e2ac-b746-4837-8a4d-9e440745c78d tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 9acba217-4a32-4650-a43e-9d998061323c] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:57:28.184352 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7820e2ac-b746-4837-8a4d-9e440745c78d tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:28.186455 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7820e2ac-b746-4837-8a4d-9e440745c78d tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:28.187809 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7820e2ac-b746-4837-8a4d-9e440745c78d tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:28.191205 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.network.neutron [None req-261ab015-0004-435d-b13e-c85db6f0ac6f tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] validate_networks() for [('aa35c9d2-0c9d-4fce-b653-23b4074314a8', None, None, None, None, None)] {{(pid=122632) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 22:57:28.192134 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7820e2ac-b746-4837-8a4d-9e440745c78d tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:28.193155 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7820e2ac-b746-4837-8a4d-9e440745c78d tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:28.195447 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7820e2ac-b746-4837-8a4d-9e440745c78d tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:28.367168 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-7820e2ac-b746-4837-8a4d-9e440745c78d tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "POST /compute/v2.1/servers/9acba217-4a32-4650-a43e-9d998061323c/action" status: 204 len: 0 microversion: 2.1 time: 0.211793 Aug 10 22:57:28.383430 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 263/514] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 22:57:28 2022] POST /compute/v2.1/servers/9acba217-4a32-4650-a43e-9d998061323c/action => generated 0 bytes in 217 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 22:57:28.431634 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-57ef15b9-7ab8-46a5-aef2-82c72934eae1 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:28.433778 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-57ef15b9-7ab8-46a5-aef2-82c72934eae1 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 9acba217-4a32-4650-a43e-9d998061323c] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:57:28.451975 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-57ef15b9-7ab8-46a5-aef2-82c72934eae1 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:28.452472 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-57ef15b9-7ab8-46a5-aef2-82c72934eae1 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:28.457817 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-57ef15b9-7ab8-46a5-aef2-82c72934eae1 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:28.459470 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-57ef15b9-7ab8-46a5-aef2-82c72934eae1 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:28.460692 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-57ef15b9-7ab8-46a5-aef2-82c72934eae1 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:28.461899 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-57ef15b9-7ab8-46a5-aef2-82c72934eae1 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:28.724189 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-57ef15b9-7ab8-46a5-aef2-82c72934eae1 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:28.735899 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-57ef15b9-7ab8-46a5-aef2-82c72934eae1 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/9acba217-4a32-4650-a43e-9d998061323c" status: 200 len: 1470 microversion: 2.1 time: 0.344437 Aug 10 22:57:28.736612 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 264/515] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:57:28 2022] GET /compute/v2.1/servers/9acba217-4a32-4650-a43e-9d998061323c => generated 1470 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:57:28.742466 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-6d446383-5cc2-4829-90e9-82c89f0aec18 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:28.756161 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-6d446383-5cc2-4829-90e9-82c89f0aec18 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] [instance: e773ec0c-0cd0-4a08-b9f0-5c2d0a342751] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:57:28.763982 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:57:28.766488 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6d446383-5cc2-4829-90e9-82c89f0aec18 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:28.771564 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6d446383-5cc2-4829-90e9-82c89f0aec18 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:28.772356 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6d446383-5cc2-4829-90e9-82c89f0aec18 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:28.773319 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6d446383-5cc2-4829-90e9-82c89f0aec18 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:28.773986 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6d446383-5cc2-4829-90e9-82c89f0aec18 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:28.774678 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6d446383-5cc2-4829-90e9-82c89f0aec18 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:29.518535 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-6d446383-5cc2-4829-90e9-82c89f0aec18 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaed2a2e56f749a88c340aaccb15d2d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deaba512051743deb45881d76eb206ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:29.540150 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-6d446383-5cc2-4829-90e9-82c89f0aec18 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] 10.222.0.58 "GET /compute/v2.1/servers/e773ec0c-0cd0-4a08-b9f0-5c2d0a342751" status: 200 len: 1385 microversion: 2.1 time: 0.798703 Aug 10 22:57:29.544466 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 265/516] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:57:28 2022] GET /compute/v2.1/servers/e773ec0c-0cd0-4a08-b9f0-5c2d0a342751 => generated 1385 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:57:29.757528 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c1920e69-e1cb-4ceb-ba4f-fa84f92596ee tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:29.758893 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-c1920e69-e1cb-4ceb-ba4f-fa84f92596ee tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 9acba217-4a32-4650-a43e-9d998061323c] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:57:29.770910 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c1920e69-e1cb-4ceb-ba4f-fa84f92596ee tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:29.771637 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c1920e69-e1cb-4ceb-ba4f-fa84f92596ee tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:29.772542 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c1920e69-e1cb-4ceb-ba4f-fa84f92596ee tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:29.774468 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c1920e69-e1cb-4ceb-ba4f-fa84f92596ee tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:29.776981 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c1920e69-e1cb-4ceb-ba4f-fa84f92596ee tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:29.777577 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c1920e69-e1cb-4ceb-ba4f-fa84f92596ee tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:30.390945 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-c1920e69-e1cb-4ceb-ba4f-fa84f92596ee tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:30.403768 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-c1920e69-e1cb-4ceb-ba4f-fa84f92596ee tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/9acba217-4a32-4650-a43e-9d998061323c" status: 200 len: 1470 microversion: 2.1 time: 0.650358 Aug 10 22:57:30.405540 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 266/517] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:57:29 2022] GET /compute/v2.1/servers/9acba217-4a32-4650-a43e-9d998061323c => generated 1470 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:57:30.565529 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c3061c5b-64eb-4781-8420-234a67959a90 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:30.566200 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-c3061c5b-64eb-4781-8420-234a67959a90 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] [instance: e773ec0c-0cd0-4a08-b9f0-5c2d0a342751] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:57:30.586576 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c3061c5b-64eb-4781-8420-234a67959a90 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:30.587119 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c3061c5b-64eb-4781-8420-234a67959a90 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:30.587555 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c3061c5b-64eb-4781-8420-234a67959a90 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:30.588261 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c3061c5b-64eb-4781-8420-234a67959a90 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:30.594370 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c3061c5b-64eb-4781-8420-234a67959a90 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:30.594890 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c3061c5b-64eb-4781-8420-234a67959a90 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:31.171499 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-261ab015-0004-435d-b13e-c85db6f0ac6f tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Flavor limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 22:57:31.172018 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-261ab015-0004-435d-b13e-c85db6f0ac6f tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Image limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 22:57:31.172486 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-261ab015-0004-435d-b13e-c85db6f0ac6f tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Flavor pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 22:57:31.172890 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-261ab015-0004-435d-b13e-c85db6f0ac6f tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Image pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 22:57:31.173295 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-261ab015-0004-435d-b13e-c85db6f0ac6f tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 22:57:31.197416 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-261ab015-0004-435d-b13e-c85db6f0ac6f tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:31.207702 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-261ab015-0004-435d-b13e-c85db6f0ac6f tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:31.207702 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-261ab015-0004-435d-b13e-c85db6f0ac6f tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:31.207702 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-261ab015-0004-435d-b13e-c85db6f0ac6f tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:31.207702 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-261ab015-0004-435d-b13e-c85db6f0ac6f tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:31.208166 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-261ab015-0004-435d-b13e-c85db6f0ac6f tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:31.262156 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-261ab015-0004-435d-b13e-c85db6f0ac6f tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Getting quotas for project b4355fdc73c84fa2baf0d5c9a33e69d5. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 22:57:31.276691 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-261ab015-0004-435d-b13e-c85db6f0ac6f tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Getting quotas for user 394f0e6843424c7b83d2dfff61f66ede and project b4355fdc73c84fa2baf0d5c9a33e69d5. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 22:57:31.305785 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-c3061c5b-64eb-4781-8420-234a67959a90 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaed2a2e56f749a88c340aaccb15d2d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deaba512051743deb45881d76eb206ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:31.318355 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-c3061c5b-64eb-4781-8420-234a67959a90 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] 10.222.0.58 "GET /compute/v2.1/servers/e773ec0c-0cd0-4a08-b9f0-5c2d0a342751" status: 200 len: 1385 microversion: 2.1 time: 0.756626 Aug 10 22:57:31.318994 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 267/518] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:57:30 2022] GET /compute/v2.1/servers/e773ec0c-0cd0-4a08-b9f0-5c2d0a342751 => generated 1385 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:57:31.321553 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-261ab015-0004-435d-b13e-c85db6f0ac6f tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Going to run 1 instances... {{(pid=122632) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 22:57:31.324419 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-261ab015-0004-435d-b13e-c85db6f0ac6f tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] [instance: eaea4cc7-b1b8-43a7-83a4-8cfc8a44f9c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78ad8905-f66f-4733-8be9-2b260f1fabed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122632) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 22:57:31.430118 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-dc601320-f641-48e5-8972-91b15bad9b28 req-b540591b-1265-4784-bbf2-60478b07e095 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9acba217-4a32-4650-a43e-9d998061323c", "name": "network-vif-plugged", "status": "completed", "tag": "7f752529-8509-4990-90aa-e93ad25cb8d1"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:57:31.457691 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-dc601320-f641-48e5-8972-91b15bad9b28 req-b540591b-1265-4784-bbf2-60478b07e095 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:31.458174 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-dc601320-f641-48e5-8972-91b15bad9b28 req-b540591b-1265-4784-bbf2-60478b07e095 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:31.458607 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-dc601320-f641-48e5-8972-91b15bad9b28 req-b540591b-1265-4784-bbf2-60478b07e095 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:31.471823 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-261ab015-0004-435d-b13e-c85db6f0ac6f tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 3.424857 Aug 10 22:57:31.472527 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 252/519] 10.222.0.58 () {62 vars in 1188 bytes} [Wed Aug 10 22:57:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 3427 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 10 22:57:31.504896 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-88fc799e-c9ac-4f1b-91ee-b4dab33f72ab tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:31.505504 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-88fc799e-c9ac-4f1b-91ee-b4dab33f72ab tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 9acba217-4a32-4650-a43e-9d998061323c] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:57:31.536661 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-dc601320-f641-48e5-8972-91b15bad9b28 req-b540591b-1265-4784-bbf2-60478b07e095 service nova] Creating event network-vif-plugged:7f752529-8509-4990-90aa-e93ad25cb8d1 for instance 9acba217-4a32-4650-a43e-9d998061323c on n-h1-850468-14 Aug 10 22:57:31.538808 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:57:31.545727 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-88fc799e-c9ac-4f1b-91ee-b4dab33f72ab tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:31.554765 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-88fc799e-c9ac-4f1b-91ee-b4dab33f72ab tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:31.555385 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-88fc799e-c9ac-4f1b-91ee-b4dab33f72ab tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:31.556164 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-88fc799e-c9ac-4f1b-91ee-b4dab33f72ab tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:31.559341 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-88fc799e-c9ac-4f1b-91ee-b4dab33f72ab tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:31.559788 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-88fc799e-c9ac-4f1b-91ee-b4dab33f72ab tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:31.582283 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [req-dc601320-f641-48e5-8972-91b15bad9b28 req-b540591b-1265-4784-bbf2-60478b07e095 service nova] Instance 9acba217-4a32-4650-a43e-9d998061323c is migrating within the same cell, copying events to all relevant hosts: {'n-h1-850468-14', 'n-h2-850468-14'} {{(pid=122633) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5901}} Aug 10 22:57:31.623454 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-dc601320-f641-48e5-8972-91b15bad9b28 req-b540591b-1265-4784-bbf2-60478b07e095 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.190214 Aug 10 22:57:31.624516 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 268/520] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 22:57:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:57:31.640014 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-888ec9a6-55e8-4b78-831d-f6f84afac71d tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:31.640715 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-888ec9a6-55e8-4b78-831d-f6f84afac71d tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] [instance: eaea4cc7-b1b8-43a7-83a4-8cfc8a44f9c1] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:57:31.773054 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-888ec9a6-55e8-4b78-831d-f6f84afac71d tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:31.784470 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-888ec9a6-55e8-4b78-831d-f6f84afac71d tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:31.801225 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-888ec9a6-55e8-4b78-831d-f6f84afac71d tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:31.810856 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-888ec9a6-55e8-4b78-831d-f6f84afac71d tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] 10.222.0.58 "GET /compute/v2.1/servers/eaea4cc7-b1b8-43a7-83a4-8cfc8a44f9c1" status: 200 len: 1261 microversion: 2.25 time: 0.176759 Aug 10 22:57:31.811495 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 269/521] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 22:57:31 2022] GET /compute/v2.1/servers/eaea4cc7-b1b8-43a7-83a4-8cfc8a44f9c1 => generated 1261 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:57:32.340034 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-731c6f02-fe82-4bc8-8eed-75f2d945c82d tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:32.340642 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-731c6f02-fe82-4bc8-8eed-75f2d945c82d tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] [instance: e773ec0c-0cd0-4a08-b9f0-5c2d0a342751] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:57:32.358257 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-731c6f02-fe82-4bc8-8eed-75f2d945c82d tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:32.360330 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-731c6f02-fe82-4bc8-8eed-75f2d945c82d tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:32.363493 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-731c6f02-fe82-4bc8-8eed-75f2d945c82d tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:32.365701 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-731c6f02-fe82-4bc8-8eed-75f2d945c82d tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:32.369632 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-731c6f02-fe82-4bc8-8eed-75f2d945c82d tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:32.370289 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-731c6f02-fe82-4bc8-8eed-75f2d945c82d tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:32.832366 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-88fc799e-c9ac-4f1b-91ee-b4dab33f72ab tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:32.846670 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-88fc799e-c9ac-4f1b-91ee-b4dab33f72ab tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/9acba217-4a32-4650-a43e-9d998061323c" status: 200 len: 1470 microversion: 2.1 time: 1.362527 Aug 10 22:57:32.861667 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 253/522] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:57:31 2022] GET /compute/v2.1/servers/9acba217-4a32-4650-a43e-9d998061323c => generated 1470 bytes in 1378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:57:32.877387 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-5f13f6b4-3e5d-49cc-a5b7-b0187ab90dee tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:32.880472 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-5f13f6b4-3e5d-49cc-a5b7-b0187ab90dee tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] [instance: eaea4cc7-b1b8-43a7-83a4-8cfc8a44f9c1] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:57:32.901582 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5f13f6b4-3e5d-49cc-a5b7-b0187ab90dee tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:32.902621 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5f13f6b4-3e5d-49cc-a5b7-b0187ab90dee tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:32.904987 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5f13f6b4-3e5d-49cc-a5b7-b0187ab90dee tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:32.907254 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5f13f6b4-3e5d-49cc-a5b7-b0187ab90dee tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:32.910390 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5f13f6b4-3e5d-49cc-a5b7-b0187ab90dee tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:32.911647 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5f13f6b4-3e5d-49cc-a5b7-b0187ab90dee tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:33.077513 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-731c6f02-fe82-4bc8-8eed-75f2d945c82d tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaed2a2e56f749a88c340aaccb15d2d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deaba512051743deb45881d76eb206ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:33.092909 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-731c6f02-fe82-4bc8-8eed-75f2d945c82d tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] 10.222.0.58 "GET /compute/v2.1/servers/e773ec0c-0cd0-4a08-b9f0-5c2d0a342751" status: 200 len: 1385 microversion: 2.1 time: 0.756476 Aug 10 22:57:33.093697 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 270/523] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:57:32 2022] GET /compute/v2.1/servers/e773ec0c-0cd0-4a08-b9f0-5c2d0a342751 => generated 1385 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:57:34.121145 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-5f13f6b4-3e5d-49cc-a5b7-b0187ab90dee tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:34.137250 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-5f13f6b4-3e5d-49cc-a5b7-b0187ab90dee tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:34.146814 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-5f13f6b4-3e5d-49cc-a5b7-b0187ab90dee tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:34.148368 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-5f13f6b4-3e5d-49cc-a5b7-b0187ab90dee tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] 10.222.0.58 "GET /compute/v2.1/servers/eaea4cc7-b1b8-43a7-83a4-8cfc8a44f9c1" status: 200 len: 1257 microversion: 2.25 time: 1.282804 Aug 10 22:57:34.163849 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 254/524] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 22:57:32 2022] GET /compute/v2.1/servers/eaea4cc7-b1b8-43a7-83a4-8cfc8a44f9c1 => generated 1257 bytes in 1301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:57:34.170934 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-31b7fd55-4a3e-4c03-8481-79e187e563c7 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:34.171918 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-31b7fd55-4a3e-4c03-8481-79e187e563c7 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 9acba217-4a32-4650-a43e-9d998061323c] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:57:34.180127 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-31b7fd55-4a3e-4c03-8481-79e187e563c7 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:34.180930 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-31b7fd55-4a3e-4c03-8481-79e187e563c7 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:34.181586 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-31b7fd55-4a3e-4c03-8481-79e187e563c7 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:34.182816 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-31b7fd55-4a3e-4c03-8481-79e187e563c7 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:34.183489 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-31b7fd55-4a3e-4c03-8481-79e187e563c7 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:34.184243 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-31b7fd55-4a3e-4c03-8481-79e187e563c7 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:34.514953 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-641008c6-5f5f-4968-8ff9-6d46064586d2 tempest-ServicesAdminTestJSON-1145784575 tempest-ServicesAdminTestJSON-1145784575-project-admin] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:34.518959 n-d-850468-14 devstack@n-api.service[122633]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:57:34.518959 n-d-850468-14 devstack@n-api.service[122633]: warnings.warn(msg) Aug 10 22:57:34.521152 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-641008c6-5f5f-4968-8ff9-6d46064586d2 tempest-ServicesAdminTestJSON-1145784575 tempest-ServicesAdminTestJSON-1145784575-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:34.524937 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-641008c6-5f5f-4968-8ff9-6d46064586d2 tempest-ServicesAdminTestJSON-1145784575 tempest-ServicesAdminTestJSON-1145784575-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:34.525594 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-641008c6-5f5f-4968-8ff9-6d46064586d2 tempest-ServicesAdminTestJSON-1145784575 tempest-ServicesAdminTestJSON-1145784575-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:34.526586 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-641008c6-5f5f-4968-8ff9-6d46064586d2 tempest-ServicesAdminTestJSON-1145784575 tempest-ServicesAdminTestJSON-1145784575-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:34.531067 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-641008c6-5f5f-4968-8ff9-6d46064586d2 tempest-ServicesAdminTestJSON-1145784575 tempest-ServicesAdminTestJSON-1145784575-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:34.532250 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-641008c6-5f5f-4968-8ff9-6d46064586d2 tempest-ServicesAdminTestJSON-1145784575 tempest-ServicesAdminTestJSON-1145784575-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:34.597330 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-641008c6-5f5f-4968-8ff9-6d46064586d2 tempest-ServicesAdminTestJSON-1145784575 tempest-ServicesAdminTestJSON-1145784575-project-admin] 10.222.0.58 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 1.018692 Aug 10 22:57:34.602112 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 271/525] 10.222.0.58 () {58 vars in 1137 bytes} [Wed Aug 10 22:57:33 2022] GET /compute/v2.1/os-services => generated 949 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:57:34.610632 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-1faa0d55-1960-43b6-8daa-46c234b1082e tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:34.614869 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-1faa0d55-1960-43b6-8daa-46c234b1082e tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] [instance: e773ec0c-0cd0-4a08-b9f0-5c2d0a342751] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:57:34.640696 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1faa0d55-1960-43b6-8daa-46c234b1082e tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:34.643508 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1faa0d55-1960-43b6-8daa-46c234b1082e tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:34.644215 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1faa0d55-1960-43b6-8daa-46c234b1082e tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:34.645846 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1faa0d55-1960-43b6-8daa-46c234b1082e tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:34.649765 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1faa0d55-1960-43b6-8daa-46c234b1082e tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:34.650213 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1faa0d55-1960-43b6-8daa-46c234b1082e tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:35.248213 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-1faa0d55-1960-43b6-8daa-46c234b1082e tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaed2a2e56f749a88c340aaccb15d2d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deaba512051743deb45881d76eb206ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:35.264762 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-1faa0d55-1960-43b6-8daa-46c234b1082e tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] 10.222.0.58 "GET /compute/v2.1/servers/e773ec0c-0cd0-4a08-b9f0-5c2d0a342751" status: 200 len: 1385 microversion: 2.1 time: 0.661354 Aug 10 22:57:35.265353 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 272/526] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:57:34 2022] GET /compute/v2.1/servers/e773ec0c-0cd0-4a08-b9f0-5c2d0a342751 => generated 1385 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:57:35.281147 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-211e6296-82fc-4d97-8f35-131cfa2e4691 tempest-ServicesAdminTestJSON-1145784575 tempest-ServicesAdminTestJSON-1145784575-project-admin] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:35.292047 n-d-850468-14 devstack@n-api.service[122633]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:57:35.292047 n-d-850468-14 devstack@n-api.service[122633]: warnings.warn(msg) Aug 10 22:57:35.293680 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-211e6296-82fc-4d97-8f35-131cfa2e4691 tempest-ServicesAdminTestJSON-1145784575 tempest-ServicesAdminTestJSON-1145784575-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:35.294326 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-211e6296-82fc-4d97-8f35-131cfa2e4691 tempest-ServicesAdminTestJSON-1145784575 tempest-ServicesAdminTestJSON-1145784575-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:35.294950 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-211e6296-82fc-4d97-8f35-131cfa2e4691 tempest-ServicesAdminTestJSON-1145784575 tempest-ServicesAdminTestJSON-1145784575-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:35.295864 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-211e6296-82fc-4d97-8f35-131cfa2e4691 tempest-ServicesAdminTestJSON-1145784575 tempest-ServicesAdminTestJSON-1145784575-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:35.296480 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-211e6296-82fc-4d97-8f35-131cfa2e4691 tempest-ServicesAdminTestJSON-1145784575 tempest-ServicesAdminTestJSON-1145784575-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:35.297052 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-211e6296-82fc-4d97-8f35-131cfa2e4691 tempest-ServicesAdminTestJSON-1145784575 tempest-ServicesAdminTestJSON-1145784575-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:35.388251 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-211e6296-82fc-4d97-8f35-131cfa2e4691 tempest-ServicesAdminTestJSON-1145784575 tempest-ServicesAdminTestJSON-1145784575-project-admin] 10.222.0.58 "GET /compute/v2.1/os-services?host=n-d-850468-14" status: 200 len: 581 microversion: 2.1 time: 0.117037 Aug 10 22:57:35.402482 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 273/527] 10.222.0.58 () {58 vars in 1174 bytes} [Wed Aug 10 22:57:35 2022] GET /compute/v2.1/os-services?host=n-d-850468-14 => generated 581 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:57:35.423464 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-9103a33e-627a-4210-a0c8-e0e2a3fa7cac tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:35.426322 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-9103a33e-627a-4210-a0c8-e0e2a3fa7cac tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] [instance: eaea4cc7-b1b8-43a7-83a4-8cfc8a44f9c1] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:57:35.433921 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9103a33e-627a-4210-a0c8-e0e2a3fa7cac tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:35.434926 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9103a33e-627a-4210-a0c8-e0e2a3fa7cac tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:35.435613 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9103a33e-627a-4210-a0c8-e0e2a3fa7cac tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:35.437398 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9103a33e-627a-4210-a0c8-e0e2a3fa7cac tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:35.438583 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9103a33e-627a-4210-a0c8-e0e2a3fa7cac tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:35.439341 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9103a33e-627a-4210-a0c8-e0e2a3fa7cac tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:35.685554 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-9103a33e-627a-4210-a0c8-e0e2a3fa7cac tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:35.705331 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-9103a33e-627a-4210-a0c8-e0e2a3fa7cac tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:35.709515 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-9103a33e-627a-4210-a0c8-e0e2a3fa7cac tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:35.719148 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-9103a33e-627a-4210-a0c8-e0e2a3fa7cac tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] 10.222.0.58 "GET /compute/v2.1/servers/eaea4cc7-b1b8-43a7-83a4-8cfc8a44f9c1" status: 200 len: 1319 microversion: 2.25 time: 0.315054 Aug 10 22:57:35.721082 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 274/528] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 22:57:35 2022] GET /compute/v2.1/servers/eaea4cc7-b1b8-43a7-83a4-8cfc8a44f9c1 => generated 1319 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:57:35.746565 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-1c74430b-b51a-49de-8408-ab361dc216ec tempest-ServicesAdminTestJSON-1145784575 tempest-ServicesAdminTestJSON-1145784575-project-admin] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:35.769054 n-d-850468-14 devstack@n-api.service[122633]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:57:35.769054 n-d-850468-14 devstack@n-api.service[122633]: warnings.warn(msg) Aug 10 22:57:35.777694 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1c74430b-b51a-49de-8408-ab361dc216ec tempest-ServicesAdminTestJSON-1145784575 tempest-ServicesAdminTestJSON-1145784575-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:35.778478 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1c74430b-b51a-49de-8408-ab361dc216ec tempest-ServicesAdminTestJSON-1145784575 tempest-ServicesAdminTestJSON-1145784575-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:35.779376 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1c74430b-b51a-49de-8408-ab361dc216ec tempest-ServicesAdminTestJSON-1145784575 tempest-ServicesAdminTestJSON-1145784575-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:35.781602 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1c74430b-b51a-49de-8408-ab361dc216ec tempest-ServicesAdminTestJSON-1145784575 tempest-ServicesAdminTestJSON-1145784575-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:35.782856 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-31b7fd55-4a3e-4c03-8481-79e187e563c7 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:35.784733 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1c74430b-b51a-49de-8408-ab361dc216ec tempest-ServicesAdminTestJSON-1145784575 tempest-ServicesAdminTestJSON-1145784575-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:35.786642 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1c74430b-b51a-49de-8408-ab361dc216ec tempest-ServicesAdminTestJSON-1145784575 tempest-ServicesAdminTestJSON-1145784575-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:35.803886 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-31b7fd55-4a3e-4c03-8481-79e187e563c7 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/9acba217-4a32-4650-a43e-9d998061323c" status: 200 len: 1470 microversion: 2.1 time: 1.631182 Aug 10 22:57:35.810045 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 255/529] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:57:34 2022] GET /compute/v2.1/servers/9acba217-4a32-4650-a43e-9d998061323c => generated 1470 bytes in 1644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:57:35.926982 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-1c74430b-b51a-49de-8408-ab361dc216ec tempest-ServicesAdminTestJSON-1145784575 tempest-ServicesAdminTestJSON-1145784575-project-admin] 10.222.0.58 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.203318 Aug 10 22:57:35.935899 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 275/530] 10.222.0.58 () {58 vars in 1176 bytes} [Wed Aug 10 22:57:35 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:57:35.951217 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-b4060c67-a8d1-43bb-95b0-810570630486 tempest-ServicesAdminTestJSON-1145784575 tempest-ServicesAdminTestJSON-1145784575-project-admin] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:35.954627 n-d-850468-14 devstack@n-api.service[122632]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:57:35.954627 n-d-850468-14 devstack@n-api.service[122632]: warnings.warn(msg) Aug 10 22:57:35.957268 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b4060c67-a8d1-43bb-95b0-810570630486 tempest-ServicesAdminTestJSON-1145784575 tempest-ServicesAdminTestJSON-1145784575-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:35.965919 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b4060c67-a8d1-43bb-95b0-810570630486 tempest-ServicesAdminTestJSON-1145784575 tempest-ServicesAdminTestJSON-1145784575-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:35.966746 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b4060c67-a8d1-43bb-95b0-810570630486 tempest-ServicesAdminTestJSON-1145784575 tempest-ServicesAdminTestJSON-1145784575-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:35.967999 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b4060c67-a8d1-43bb-95b0-810570630486 tempest-ServicesAdminTestJSON-1145784575 tempest-ServicesAdminTestJSON-1145784575-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:35.973020 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b4060c67-a8d1-43bb-95b0-810570630486 tempest-ServicesAdminTestJSON-1145784575 tempest-ServicesAdminTestJSON-1145784575-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:35.973816 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b4060c67-a8d1-43bb-95b0-810570630486 tempest-ServicesAdminTestJSON-1145784575 tempest-ServicesAdminTestJSON-1145784575-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:36.049226 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-b4060c67-a8d1-43bb-95b0-810570630486 tempest-ServicesAdminTestJSON-1145784575 tempest-ServicesAdminTestJSON-1145784575-project-admin] 10.222.0.58 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.100685 Aug 10 22:57:36.065664 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 256/531] 10.222.0.58 () {58 vars in 1137 bytes} [Wed Aug 10 22:57:35 2022] GET /compute/v2.1/os-services => generated 949 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:57:36.291923 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-f104abb8-192f-4772-977d-00d524666704 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:36.293050 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-f104abb8-192f-4772-977d-00d524666704 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] [instance: e773ec0c-0cd0-4a08-b9f0-5c2d0a342751] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:57:36.312182 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f104abb8-192f-4772-977d-00d524666704 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:36.315780 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f104abb8-192f-4772-977d-00d524666704 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:36.324400 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f104abb8-192f-4772-977d-00d524666704 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:36.326911 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f104abb8-192f-4772-977d-00d524666704 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:36.328033 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f104abb8-192f-4772-977d-00d524666704 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:36.332928 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f104abb8-192f-4772-977d-00d524666704 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:36.578514 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-85056e39-3c53-43b4-9e5c-ca88aea5ce51 req-2584ac86-8b05-49c7-b4ac-0eed9d76b4f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e773ec0c-0cd0-4a08-b9f0-5c2d0a342751", "name": "network-vif-plugged", "status": "completed", "tag": "4509aea6-eb69-433a-9c36-162726644a47"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:57:36.609007 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:57:36.628556 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-85056e39-3c53-43b4-9e5c-ca88aea5ce51 req-2584ac86-8b05-49c7-b4ac-0eed9d76b4f0 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:36.629559 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-85056e39-3c53-43b4-9e5c-ca88aea5ce51 req-2584ac86-8b05-49c7-b4ac-0eed9d76b4f0 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:36.630270 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-85056e39-3c53-43b4-9e5c-ca88aea5ce51 req-2584ac86-8b05-49c7-b4ac-0eed9d76b4f0 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:36.672070 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-85056e39-3c53-43b4-9e5c-ca88aea5ce51 req-2584ac86-8b05-49c7-b4ac-0eed9d76b4f0 service nova] Creating event network-vif-plugged:4509aea6-eb69-433a-9c36-162726644a47 for instance e773ec0c-0cd0-4a08-b9f0-5c2d0a342751 on n-h2-850468-14 Aug 10 22:57:36.680534 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-85056e39-3c53-43b4-9e5c-ca88aea5ce51 req-2584ac86-8b05-49c7-b4ac-0eed9d76b4f0 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111364 Aug 10 22:57:36.700006 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 257/532] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 22:57:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 22:57:36.749778 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-0feba0e8-5bc6-4e2c-acc3-89299418d96a tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:36.750872 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-0feba0e8-5bc6-4e2c-acc3-89299418d96a tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] [instance: eaea4cc7-b1b8-43a7-83a4-8cfc8a44f9c1] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:57:36.769320 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0feba0e8-5bc6-4e2c-acc3-89299418d96a tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:36.771582 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0feba0e8-5bc6-4e2c-acc3-89299418d96a tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:36.772971 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0feba0e8-5bc6-4e2c-acc3-89299418d96a tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:36.773886 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0feba0e8-5bc6-4e2c-acc3-89299418d96a tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:36.775899 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0feba0e8-5bc6-4e2c-acc3-89299418d96a tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:36.780786 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0feba0e8-5bc6-4e2c-acc3-89299418d96a tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:36.787020 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=100 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:57:37.062249 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-f104abb8-192f-4772-977d-00d524666704 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaed2a2e56f749a88c340aaccb15d2d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deaba512051743deb45881d76eb206ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:37.091638 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-f104abb8-192f-4772-977d-00d524666704 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] 10.222.0.58 "GET /compute/v2.1/servers/e773ec0c-0cd0-4a08-b9f0-5c2d0a342751" status: 200 len: 1385 microversion: 2.1 time: 0.797797 Aug 10 22:57:37.095678 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 276/533] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:57:36 2022] GET /compute/v2.1/servers/e773ec0c-0cd0-4a08-b9f0-5c2d0a342751 => generated 1385 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:57:37.114519 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-630b3eca-2c5f-47a5-8996-77d4e46da21b tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:37.115174 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-630b3eca-2c5f-47a5-8996-77d4e46da21b tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 9acba217-4a32-4650-a43e-9d998061323c] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:57:37.134684 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-630b3eca-2c5f-47a5-8996-77d4e46da21b tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:37.135274 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-630b3eca-2c5f-47a5-8996-77d4e46da21b tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:37.135723 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-630b3eca-2c5f-47a5-8996-77d4e46da21b tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:37.136471 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-630b3eca-2c5f-47a5-8996-77d4e46da21b tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:37.136921 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-630b3eca-2c5f-47a5-8996-77d4e46da21b tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:37.137371 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-630b3eca-2c5f-47a5-8996-77d4e46da21b tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:37.382255 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-0feba0e8-5bc6-4e2c-acc3-89299418d96a tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:37.398193 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-0feba0e8-5bc6-4e2c-acc3-89299418d96a tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:37.402359 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-0feba0e8-5bc6-4e2c-acc3-89299418d96a tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:37.406160 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-0feba0e8-5bc6-4e2c-acc3-89299418d96a tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] 10.222.0.58 "GET /compute/v2.1/servers/eaea4cc7-b1b8-43a7-83a4-8cfc8a44f9c1" status: 200 len: 1319 microversion: 2.25 time: 0.659374 Aug 10 22:57:37.407560 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 258/534] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 22:57:36 2022] GET /compute/v2.1/servers/eaea4cc7-b1b8-43a7-83a4-8cfc8a44f9c1 => generated 1319 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 22:57:37.715997 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-630b3eca-2c5f-47a5-8996-77d4e46da21b tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:37.734287 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-630b3eca-2c5f-47a5-8996-77d4e46da21b tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/9acba217-4a32-4650-a43e-9d998061323c" status: 200 len: 1462 microversion: 2.1 time: 0.636631 Aug 10 22:57:37.736958 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 277/535] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:57:37 2022] GET /compute/v2.1/servers/9acba217-4a32-4650-a43e-9d998061323c => generated 1462 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:57:37.757810 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-be7c9e07-be9c-46eb-aabe-8b8468d8df12 tempest-MigrationsAdminTest-974767625 tempest-MigrationsAdminTest-974767625-project-admin] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:37.758415 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-be7c9e07-be9c-46eb-aabe-8b8468d8df12 tempest-MigrationsAdminTest-974767625 tempest-MigrationsAdminTest-974767625-project-admin] [instance: 9acba217-4a32-4650-a43e-9d998061323c] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:57:37.770593 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-be7c9e07-be9c-46eb-aabe-8b8468d8df12 tempest-MigrationsAdminTest-974767625 tempest-MigrationsAdminTest-974767625-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:37.772548 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-be7c9e07-be9c-46eb-aabe-8b8468d8df12 tempest-MigrationsAdminTest-974767625 tempest-MigrationsAdminTest-974767625-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:37.774357 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-be7c9e07-be9c-46eb-aabe-8b8468d8df12 tempest-MigrationsAdminTest-974767625 tempest-MigrationsAdminTest-974767625-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:37.775625 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-be7c9e07-be9c-46eb-aabe-8b8468d8df12 tempest-MigrationsAdminTest-974767625 tempest-MigrationsAdminTest-974767625-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:37.779267 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-be7c9e07-be9c-46eb-aabe-8b8468d8df12 tempest-MigrationsAdminTest-974767625 tempest-MigrationsAdminTest-974767625-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:37.780154 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-be7c9e07-be9c-46eb-aabe-8b8468d8df12 tempest-MigrationsAdminTest-974767625 tempest-MigrationsAdminTest-974767625-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:38.112950 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-ff333d27-0228-4ad6-8136-d04979f6a00d tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:38.114454 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-ff333d27-0228-4ad6-8136-d04979f6a00d tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] [instance: e773ec0c-0cd0-4a08-b9f0-5c2d0a342751] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:57:38.124611 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ff333d27-0228-4ad6-8136-d04979f6a00d tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:38.132015 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ff333d27-0228-4ad6-8136-d04979f6a00d tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:38.137681 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ff333d27-0228-4ad6-8136-d04979f6a00d tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:38.138753 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ff333d27-0228-4ad6-8136-d04979f6a00d tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:38.139454 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ff333d27-0228-4ad6-8136-d04979f6a00d tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:38.140088 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ff333d27-0228-4ad6-8136-d04979f6a00d tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:38.695075 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-ff333d27-0228-4ad6-8136-d04979f6a00d tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaed2a2e56f749a88c340aaccb15d2d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deaba512051743deb45881d76eb206ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:38.705615 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-ff333d27-0228-4ad6-8136-d04979f6a00d tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] 10.222.0.58 "GET /compute/v2.1/servers/e773ec0c-0cd0-4a08-b9f0-5c2d0a342751" status: 200 len: 1385 microversion: 2.1 time: 0.596682 Aug 10 22:57:38.722090 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 278/536] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:57:38 2022] GET /compute/v2.1/servers/e773ec0c-0cd0-4a08-b9f0-5c2d0a342751 => generated 1385 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:57:38.734820 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-6442a2fa-86d1-4fb0-9cfb-0946fcbd44ce tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:38.735573 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-6442a2fa-86d1-4fb0-9cfb-0946fcbd44ce tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] [instance: eaea4cc7-b1b8-43a7-83a4-8cfc8a44f9c1] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:57:38.745200 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6442a2fa-86d1-4fb0-9cfb-0946fcbd44ce tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:38.755556 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6442a2fa-86d1-4fb0-9cfb-0946fcbd44ce tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:38.756484 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6442a2fa-86d1-4fb0-9cfb-0946fcbd44ce tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:38.757813 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6442a2fa-86d1-4fb0-9cfb-0946fcbd44ce tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:38.758509 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6442a2fa-86d1-4fb0-9cfb-0946fcbd44ce tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:38.760904 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6442a2fa-86d1-4fb0-9cfb-0946fcbd44ce tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:38.904982 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-be7c9e07-be9c-46eb-aabe-8b8468d8df12 tempest-MigrationsAdminTest-974767625 tempest-MigrationsAdminTest-974767625-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/9acba217-4a32-4650-a43e-9d998061323c" status: 200 len: 1615 microversion: 2.1 time: 1.151038 Aug 10 22:57:38.905577 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 259/537] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:57:37 2022] GET /compute/v2.1/servers/9acba217-4a32-4650-a43e-9d998061323c => generated 1615 bytes in 1153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:57:38.940088 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-2d288a69-04bc-4c0d-bf20-228ff286acff tempest-MigrationsAdminTest-974767625 tempest-MigrationsAdminTest-974767625-project-admin] Calling method '.version_select at 0x7f847d76d1f0>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:38.945166 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2d288a69-04bc-4c0d-bf20-228ff286acff tempest-MigrationsAdminTest-974767625 tempest-MigrationsAdminTest-974767625-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:38.945836 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2d288a69-04bc-4c0d-bf20-228ff286acff tempest-MigrationsAdminTest-974767625 tempest-MigrationsAdminTest-974767625-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:38.946689 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2d288a69-04bc-4c0d-bf20-228ff286acff tempest-MigrationsAdminTest-974767625 tempest-MigrationsAdminTest-974767625-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:38.974155 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-2d288a69-04bc-4c0d-bf20-228ff286acff tempest-MigrationsAdminTest-974767625 tempest-MigrationsAdminTest-974767625-project-admin] 10.222.0.58 "GET /compute/v2.1/os-migrations" status: 200 len: 801 microversion: 2.1 time: 0.037741 Aug 10 22:57:38.982111 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 260/538] 10.222.0.58 () {58 vars in 1143 bytes} [Wed Aug 10 22:57:38 2022] GET /compute/v2.1/os-migrations => generated 801 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:57:39.148282 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-bf99a33a-a92b-4557-9c2b-ceaa79ce9702 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1206589955", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:57:39.262729 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.network.neutron [None req-bf99a33a-a92b-4557-9c2b-ceaa79ce9702 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] validate_networks() for None {{(pid=122632) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 22:57:39.438302 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-6442a2fa-86d1-4fb0-9cfb-0946fcbd44ce tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:39.447499 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-6442a2fa-86d1-4fb0-9cfb-0946fcbd44ce tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:39.448974 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-6442a2fa-86d1-4fb0-9cfb-0946fcbd44ce tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:39.450154 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-6442a2fa-86d1-4fb0-9cfb-0946fcbd44ce tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] 10.222.0.58 "GET /compute/v2.1/servers/eaea4cc7-b1b8-43a7-83a4-8cfc8a44f9c1" status: 200 len: 1361 microversion: 2.25 time: 0.725616 Aug 10 22:57:39.477656 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 279/539] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 22:57:38 2022] GET /compute/v2.1/servers/eaea4cc7-b1b8-43a7-83a4-8cfc8a44f9c1 => generated 1361 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:57:39.730748 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-5e2c4017-8644-4c10-8e92-edbb9cadded6 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:39.731799 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-5e2c4017-8644-4c10-8e92-edbb9cadded6 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] [instance: e773ec0c-0cd0-4a08-b9f0-5c2d0a342751] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:57:39.746532 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5e2c4017-8644-4c10-8e92-edbb9cadded6 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:39.747463 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5e2c4017-8644-4c10-8e92-edbb9cadded6 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:39.748816 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5e2c4017-8644-4c10-8e92-edbb9cadded6 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:39.751318 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5e2c4017-8644-4c10-8e92-edbb9cadded6 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:39.752048 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5e2c4017-8644-4c10-8e92-edbb9cadded6 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:39.755620 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5e2c4017-8644-4c10-8e92-edbb9cadded6 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:40.126339 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-5e2c4017-8644-4c10-8e92-edbb9cadded6 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaed2a2e56f749a88c340aaccb15d2d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deaba512051743deb45881d76eb206ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:40.141061 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-5e2c4017-8644-4c10-8e92-edbb9cadded6 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] 10.222.0.58 "GET /compute/v2.1/servers/e773ec0c-0cd0-4a08-b9f0-5c2d0a342751" status: 200 len: 1585 microversion: 2.1 time: 0.415262 Aug 10 22:57:40.144334 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 280/540] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:57:39 2022] GET /compute/v2.1/servers/e773ec0c-0cd0-4a08-b9f0-5c2d0a342751 => generated 1585 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:57:40.168611 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-5b96d212-e9b2-489b-a0c6-e4b1e8bddef6 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:40.169226 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-5b96d212-e9b2-489b-a0c6-e4b1e8bddef6 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] [instance: e773ec0c-0cd0-4a08-b9f0-5c2d0a342751] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:57:40.178749 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5b96d212-e9b2-489b-a0c6-e4b1e8bddef6 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:40.179281 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5b96d212-e9b2-489b-a0c6-e4b1e8bddef6 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:40.179729 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5b96d212-e9b2-489b-a0c6-e4b1e8bddef6 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:40.180426 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5b96d212-e9b2-489b-a0c6-e4b1e8bddef6 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:40.180878 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5b96d212-e9b2-489b-a0c6-e4b1e8bddef6 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:40.181302 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5b96d212-e9b2-489b-a0c6-e4b1e8bddef6 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:40.706509 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-5b96d212-e9b2-489b-a0c6-e4b1e8bddef6 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] 10.222.0.58 "GET /compute/v2.1/servers/e773ec0c-0cd0-4a08-b9f0-5c2d0a342751/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.541440 Aug 10 22:57:40.707880 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 281/541] 10.222.0.58 () {58 vars in 1275 bytes} [Wed Aug 10 22:57:40 2022] GET /compute/v2.1/servers/e773ec0c-0cd0-4a08-b9f0-5c2d0a342751/os-interface => generated 285 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 22:57:40.713424 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-dd266227-0b0b-405b-aaed-bc80cd085b6b tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:40.714290 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-dd266227-0b0b-405b-aaed-bc80cd085b6b tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] [instance: eaea4cc7-b1b8-43a7-83a4-8cfc8a44f9c1] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:57:40.733854 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dd266227-0b0b-405b-aaed-bc80cd085b6b tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:40.741505 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dd266227-0b0b-405b-aaed-bc80cd085b6b tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:40.742660 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dd266227-0b0b-405b-aaed-bc80cd085b6b tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:40.745143 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dd266227-0b0b-405b-aaed-bc80cd085b6b tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:40.745880 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dd266227-0b0b-405b-aaed-bc80cd085b6b tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:40.746491 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dd266227-0b0b-405b-aaed-bc80cd085b6b tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:41.288439 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=6 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:57:41.757879 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-bf99a33a-a92b-4557-9c2b-ceaa79ce9702 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Flavor limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 22:57:41.758308 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-bf99a33a-a92b-4557-9c2b-ceaa79ce9702 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Image limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 22:57:41.758794 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-bf99a33a-a92b-4557-9c2b-ceaa79ce9702 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Flavor pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 22:57:41.759215 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-bf99a33a-a92b-4557-9c2b-ceaa79ce9702 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Image pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 22:57:41.759629 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-bf99a33a-a92b-4557-9c2b-ceaa79ce9702 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 22:57:41.777321 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=2 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:57:41.788756 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bf99a33a-a92b-4557-9c2b-ceaa79ce9702 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:41.789261 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bf99a33a-a92b-4557-9c2b-ceaa79ce9702 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:41.789706 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bf99a33a-a92b-4557-9c2b-ceaa79ce9702 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:41.790448 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bf99a33a-a92b-4557-9c2b-ceaa79ce9702 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:41.790944 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bf99a33a-a92b-4557-9c2b-ceaa79ce9702 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:41.791379 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bf99a33a-a92b-4557-9c2b-ceaa79ce9702 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:41.861853 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-dd266227-0b0b-405b-aaed-bc80cd085b6b tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:41.865950 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-bf99a33a-a92b-4557-9c2b-ceaa79ce9702 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Getting quotas for project f9582683a1cf4e92b3bd3f10db0b497b. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 22:57:41.880667 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-dd266227-0b0b-405b-aaed-bc80cd085b6b tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:41.890066 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-dd266227-0b0b-405b-aaed-bc80cd085b6b tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:41.891454 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-bf99a33a-a92b-4557-9c2b-ceaa79ce9702 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Getting quotas for user 5c48fd7279544b1fae228500f5a1e46d and project f9582683a1cf4e92b3bd3f10db0b497b. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 22:57:41.891730 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-dd266227-0b0b-405b-aaed-bc80cd085b6b tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] 10.222.0.58 "GET /compute/v2.1/servers/eaea4cc7-b1b8-43a7-83a4-8cfc8a44f9c1" status: 200 len: 1361 microversion: 2.25 time: 1.182555 Aug 10 22:57:41.892823 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 282/542] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 22:57:40 2022] GET /compute/v2.1/servers/eaea4cc7-b1b8-43a7-83a4-8cfc8a44f9c1 => generated 1361 bytes in 1184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:57:41.902450 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-95af73ad-ee49-4125-a5e7-07fa9655f6c7 req-2ce225ac-ff67-45aa-ac49-08841962d57a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eaea4cc7-b1b8-43a7-83a4-8cfc8a44f9c1", "tag": "736e341a-be60-4b0a-ac9e-ebacb140516d"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:57:41.946451 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-95af73ad-ee49-4125-a5e7-07fa9655f6c7 req-2ce225ac-ff67-45aa-ac49-08841962d57a service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:41.946972 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-95af73ad-ee49-4125-a5e7-07fa9655f6c7 req-2ce225ac-ff67-45aa-ac49-08841962d57a service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:41.953148 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-95af73ad-ee49-4125-a5e7-07fa9655f6c7 req-2ce225ac-ff67-45aa-ac49-08841962d57a service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:41.961967 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-bf99a33a-a92b-4557-9c2b-ceaa79ce9702 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Going to run 1 instances... {{(pid=122632) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 22:57:41.964550 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-bf99a33a-a92b-4557-9c2b-ceaa79ce9702 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 3e467caf-9d1e-4dc0-830d-585aeabc1e5a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78ad8905-f66f-4733-8be9-2b260f1fabed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122632) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 22:57:41.980492 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-95af73ad-ee49-4125-a5e7-07fa9655f6c7 req-2ce225ac-ff67-45aa-ac49-08841962d57a service nova] Creating event network-changed:736e341a-be60-4b0a-ac9e-ebacb140516d for instance eaea4cc7-b1b8-43a7-83a4-8cfc8a44f9c1 on n-h1-850468-14 Aug 10 22:57:41.999081 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-95af73ad-ee49-4125-a5e7-07fa9655f6c7 req-2ce225ac-ff67-45aa-ac49-08841962d57a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104158 Aug 10 22:57:42.000052 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 283/543] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 22:57:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:57:42.088753 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-bf99a33a-a92b-4557-9c2b-ceaa79ce9702 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.944301 Aug 10 22:57:42.097979 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 261/544] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 22:57:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 2954 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 10 22:57:42.103284 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-1137350b-3a55-436c-b26b-bf980eb4c79f tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:42.104015 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-1137350b-3a55-436c-b26b-bf980eb4c79f tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 3e467caf-9d1e-4dc0-830d-585aeabc1e5a] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:57:42.413514 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-1137350b-3a55-436c-b26b-bf980eb4c79f tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:42.421273 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-1137350b-3a55-436c-b26b-bf980eb4c79f tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/3e467caf-9d1e-4dc0-830d-585aeabc1e5a" status: 200 len: 1213 microversion: 2.1 time: 0.322057 Aug 10 22:57:42.423507 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 284/545] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:57:42 2022] GET /compute/v2.1/servers/3e467caf-9d1e-4dc0-830d-585aeabc1e5a => generated 1213 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:57:42.920133 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-b8d79a1e-d538-43e5-b730-afda1f77fda3 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:42.920665 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-b8d79a1e-d538-43e5-b730-afda1f77fda3 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] [instance: eaea4cc7-b1b8-43a7-83a4-8cfc8a44f9c1] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:57:42.938023 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b8d79a1e-d538-43e5-b730-afda1f77fda3 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:42.938524 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b8d79a1e-d538-43e5-b730-afda1f77fda3 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:42.938998 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b8d79a1e-d538-43e5-b730-afda1f77fda3 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:42.939724 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b8d79a1e-d538-43e5-b730-afda1f77fda3 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:42.940182 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b8d79a1e-d538-43e5-b730-afda1f77fda3 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:42.941163 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b8d79a1e-d538-43e5-b730-afda1f77fda3 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:43.448405 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-a79810fa-e269-428c-8396-29d9f967cb4b tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:43.449060 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-a79810fa-e269-428c-8396-29d9f967cb4b tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 3e467caf-9d1e-4dc0-830d-585aeabc1e5a] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:57:43.462509 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a79810fa-e269-428c-8396-29d9f967cb4b tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:43.487721 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a79810fa-e269-428c-8396-29d9f967cb4b tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:43.488182 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a79810fa-e269-428c-8396-29d9f967cb4b tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:43.490222 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a79810fa-e269-428c-8396-29d9f967cb4b tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:43.490902 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a79810fa-e269-428c-8396-29d9f967cb4b tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:43.491385 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a79810fa-e269-428c-8396-29d9f967cb4b tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:43.607668 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-a79810fa-e269-428c-8396-29d9f967cb4b tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:43.616075 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-a79810fa-e269-428c-8396-29d9f967cb4b tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/3e467caf-9d1e-4dc0-830d-585aeabc1e5a" status: 200 len: 1209 microversion: 2.1 time: 0.173634 Aug 10 22:57:43.627194 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 285/546] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:57:43 2022] GET /compute/v2.1/servers/3e467caf-9d1e-4dc0-830d-585aeabc1e5a => generated 1209 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:57:43.749063 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-b8d79a1e-d538-43e5-b730-afda1f77fda3 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:43.767757 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-b8d79a1e-d538-43e5-b730-afda1f77fda3 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:43.778553 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-b8d79a1e-d538-43e5-b730-afda1f77fda3 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:43.785546 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-b8d79a1e-d538-43e5-b730-afda1f77fda3 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] 10.222.0.58 "GET /compute/v2.1/servers/eaea4cc7-b1b8-43a7-83a4-8cfc8a44f9c1" status: 200 len: 1361 microversion: 2.25 time: 0.866844 Aug 10 22:57:43.788741 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 262/547] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 22:57:42 2022] GET /compute/v2.1/servers/eaea4cc7-b1b8-43a7-83a4-8cfc8a44f9c1 => generated 1361 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 22:57:44.176925 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-ae1f2984-cf07-478d-b7c5-fbf24e0d9d31 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Action: 'create', calling method: .version_select at 0x7f847d74e820>, body: {"keypair": {"name": "tempest-keypair-382485334", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBArROaycXx6qdjrT16YiR0a3iLO15UmldOpJu/FP6v8fHojP8z5H6mFHFe8FlRtFDt3LoAttDb+heBRWbT6kvR01I6icP6ZEVKVgCa7iUN/Ub8Rrg9HhhvLGfvQ/sIFNXg=="}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:57:44.236794 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-ae1f2984-cf07-478d-b7c5-fbf24e0d9d31 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Getting quotas for project 29083d61c29b43b4b47539a141b3d1fb. Resources: {'key_pairs'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 22:57:44.248716 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-ae1f2984-cf07-478d-b7c5-fbf24e0d9d31 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Getting quotas for user 0415b5bdb48249d6b9f1ef7c92aad597 and project 29083d61c29b43b4b47539a141b3d1fb. Resources: {'key_pairs'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 22:57:44.319724 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-ae1f2984-cf07-478d-b7c5-fbf24e0d9d31 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.608012 Aug 10 22:57:44.320353 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 286/548] 10.222.0.58 () {60 vars in 1159 bytes} [Wed Aug 10 22:57:43 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 22:57:44.642940 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-21670921-e5cd-45e4-8e43-b4ca561e6293 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:44.644783 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-21670921-e5cd-45e4-8e43-b4ca561e6293 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 3e467caf-9d1e-4dc0-830d-585aeabc1e5a] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:57:44.657838 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-21670921-e5cd-45e4-8e43-b4ca561e6293 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:44.662972 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-21670921-e5cd-45e4-8e43-b4ca561e6293 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:44.663775 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-21670921-e5cd-45e4-8e43-b4ca561e6293 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:44.666983 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-21670921-e5cd-45e4-8e43-b4ca561e6293 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:44.667673 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-21670921-e5cd-45e4-8e43-b4ca561e6293 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:44.669557 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-21670921-e5cd-45e4-8e43-b4ca561e6293 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:44.859465 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-21670921-e5cd-45e4-8e43-b4ca561e6293 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:44.875659 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-21670921-e5cd-45e4-8e43-b4ca561e6293 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/3e467caf-9d1e-4dc0-830d-585aeabc1e5a" status: 200 len: 1273 microversion: 2.1 time: 0.236125 Aug 10 22:57:44.879262 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 263/549] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:57:44 2022] GET /compute/v2.1/servers/3e467caf-9d1e-4dc0-830d-585aeabc1e5a => generated 1273 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:57:44.896319 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-0e6de9f2-0a44-4606-94c6-8d380565a58a tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:44.896964 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-0e6de9f2-0a44-4606-94c6-8d380565a58a tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] [instance: eaea4cc7-b1b8-43a7-83a4-8cfc8a44f9c1] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:57:44.911167 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0e6de9f2-0a44-4606-94c6-8d380565a58a tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:44.911663 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0e6de9f2-0a44-4606-94c6-8d380565a58a tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:44.912099 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0e6de9f2-0a44-4606-94c6-8d380565a58a tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:44.912811 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0e6de9f2-0a44-4606-94c6-8d380565a58a tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:44.915656 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0e6de9f2-0a44-4606-94c6-8d380565a58a tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:44.916403 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0e6de9f2-0a44-4606-94c6-8d380565a58a tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:45.066883 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c2c6e4f9-fef8-491b-83ba-2cf267f5add0 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-915198229", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452", "networks": [{"uuid": "cf6262ce-5add-4f6f-96db-0c1b276bc5f7"}]}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:57:45.140921 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.network.neutron [None req-c2c6e4f9-fef8-491b-83ba-2cf267f5add0 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] validate_networks() for [('cf6262ce-5add-4f6f-96db-0c1b276bc5f7', None, None, None, None, None)] {{(pid=122633) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 22:57:45.804274 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=6 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:57:46.124539 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-0e6de9f2-0a44-4606-94c6-8d380565a58a tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:46.143098 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-0e6de9f2-0a44-4606-94c6-8d380565a58a tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:46.152011 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-0e6de9f2-0a44-4606-94c6-8d380565a58a tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:46.156685 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-0e6de9f2-0a44-4606-94c6-8d380565a58a tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] 10.222.0.58 "GET /compute/v2.1/servers/eaea4cc7-b1b8-43a7-83a4-8cfc8a44f9c1" status: 200 len: 1361 microversion: 2.25 time: 1.274116 Aug 10 22:57:46.163480 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 264/550] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 22:57:44 2022] GET /compute/v2.1/servers/eaea4cc7-b1b8-43a7-83a4-8cfc8a44f9c1 => generated 1361 bytes in 1283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:57:46.303606 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-789b3a55-26c5-4ea5-9763-09806662c98f tempest-ServicesAdminNegativeV253TestJSON-1975357008 tempest-ServicesAdminNegativeV253TestJSON-1975357008-project-admin] Action: 'update', calling method: .version_select at 0x7f847d7c2ca0>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:57:46.315044 n-d-850468-14 devstack@n-api.service[122632]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:57:46.315044 n-d-850468-14 devstack@n-api.service[122632]: warnings.warn(msg) Aug 10 22:57:46.320618 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-789b3a55-26c5-4ea5-9763-09806662c98f tempest-ServicesAdminNegativeV253TestJSON-1975357008 tempest-ServicesAdminNegativeV253TestJSON-1975357008-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:46.321463 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-789b3a55-26c5-4ea5-9763-09806662c98f tempest-ServicesAdminNegativeV253TestJSON-1975357008 tempest-ServicesAdminNegativeV253TestJSON-1975357008-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:46.322597 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-789b3a55-26c5-4ea5-9763-09806662c98f tempest-ServicesAdminNegativeV253TestJSON-1975357008 tempest-ServicesAdminNegativeV253TestJSON-1975357008-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:46.362211 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-789b3a55-26c5-4ea5-9763-09806662c98f tempest-ServicesAdminNegativeV253TestJSON-1975357008 tempest-ServicesAdminNegativeV253TestJSON-1975357008-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:46.363609 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-789b3a55-26c5-4ea5-9763-09806662c98f tempest-ServicesAdminNegativeV253TestJSON-1975357008 tempest-ServicesAdminNegativeV253TestJSON-1975357008-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:46.364324 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-789b3a55-26c5-4ea5-9763-09806662c98f tempest-ServicesAdminNegativeV253TestJSON-1975357008 tempest-ServicesAdminNegativeV253TestJSON-1975357008-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:46.373826 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-789b3a55-26c5-4ea5-9763-09806662c98f tempest-ServicesAdminNegativeV253TestJSON-1975357008 tempest-ServicesAdminNegativeV253TestJSON-1975357008-project-admin] HTTP exception thrown: Service 29895e9c-c2ba-4c82-b6eb-2d3d459e195c could not be found. Aug 10 22:57:46.386146 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-789b3a55-26c5-4ea5-9763-09806662c98f tempest-ServicesAdminNegativeV253TestJSON-1975357008 tempest-ServicesAdminNegativeV253TestJSON-1975357008-project-admin] Request method failure captured: Aug 10 22:57:46.386146 n-d-850468-14 devstack@n-api.service[122632]: request: PUT /compute/v2.1/os-services/29895e9c-c2ba-4c82-b6eb-2d3d459e195c HTTP/1.1 Aug 10 22:57:46.386146 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 22:57:46.386146 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 22:57:46.386146 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 22:57:46.386146 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 56 Aug 10 22:57:46.386146 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 22:57:46.386146 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 22:57:46.386146 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 22:57:46.386146 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 22:57:46.386146 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9Dfo8vL4QExIiMGo2KTTObc_OA-sEiddWt2SI333ZWIB9fYHXxEt0V0XEEtxAULxzwoh4h6H9IAPJx8XUxgDj_GSR_taQA7ilVhG8ngtWsPz54ih8U9XIqb3PVqP3j81aAfDRfPEiHHjdbXy9iE-v6eWTAANJubHfVqTRTgdgR_PQdo Aug 10 22:57:46.386146 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 22:57:46.386146 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 22:57:46.386146 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 22:57:46.386146 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 22:57:46.386146 n-d-850468-14 devstack@n-api.service[122632]: X-Openstack-Nova-Api-Version: 2.53 Aug 10 22:57:46.386146 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 22:57:46.386146 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 22:57:46.386146 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 09210f0cdf2c4651a4c2069d53dd4b27 Aug 10 22:57:46.386146 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1975357008 Aug 10 22:57:46.386146 n-d-850468-14 devstack@n-api.service[122632]: X-Role: admin,member,reader Aug 10 22:57:46.386146 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: admin,member,reader Aug 10 22:57:46.393289 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/09210f0cdf2c4651a4c2069d53dd4b27"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/09210f0cdf2c4651a4c2069d53dd4b27"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/09210f0cdf2c4651a4c2069d53dd4b27"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_09210f0cdf2c4651a4c2069d53dd4b27", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 22:57:46.393289 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1975357008 Aug 10 22:57:46.393289 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 09210f0cdf2c4651a4c2069d53dd4b27 Aug 10 22:57:46.393289 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1975357008 Aug 10 22:57:46.393289 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1975357008-project-admin Aug 10 22:57:46.393289 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 22:57:46.393289 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 22:57:46.393289 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: ed711b80beb94313ad9027bc1ff7308c Aug 10 22:57:46.393289 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1975357008-project-admin Aug 10 22:57:46.393289 n-d-850468-14 devstack@n-api.service[122632]: Aug 10 22:57:46.393289 n-d-850468-14 devstack@n-api.service[122632]: {"status": "disabled", "disabled_reason": "maintenance"} Aug 10 22:57:46.393289 n-d-850468-14 devstack@n-api.service[122632]: method: Aug 10 22:57:46.393289 n-d-850468-14 devstack@n-api.service[122632]: exception: Service 29895e9c-c2ba-4c82-b6eb-2d3d459e195c could not be found. Aug 10 22:57:46.400276 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': '29895e9c-c2ba-4c82-b6eb-2d3d459e195c', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Aug 10 22:57:46.400276 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 22:57:46.400276 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:57:46.400276 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6170, in service_get_by_id Aug 10 22:57:46.400276 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Aug 10 22:57:46.400276 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6030, in _find_service_in_cell Aug 10 22:57:46.400276 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 10 22:57:46.400276 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 10 22:57:46.400276 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:57:46.400276 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:57:46.400276 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:57:46.400276 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:57:46.400276 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update Aug 10 22:57:46.400276 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Aug 10 22:57:46.400276 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6172, in service_get_by_id Aug 10 22:57:46.400276 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Aug 10 22:57:46.400276 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 29895e9c-c2ba-4c82-b6eb-2d3d459e195c could not be found. Aug 10 22:57:46.400276 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:57:46.400276 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:57:46.400276 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:57:46.400276 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:57:46.401598 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:57:46.401598 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:57:46.401598 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 22:57:46.401598 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 22:57:46.401598 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 22:57:46.401598 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 22:57:46.401598 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 22:57:46.401598 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 22:57:46.401598 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 22:57:46.401598 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 22:57:46.401598 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update Aug 10 22:57:46.401598 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 10 22:57:46.401598 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 29895e9c-c2ba-4c82-b6eb-2d3d459e195c could not be found. Aug 10 22:57:46.401598 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:57:46.401598 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:57:46.401598 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:57:46.401598 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:57:46.401598 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:57:46.401598 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:57:46.401598 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 22:57:46.403457 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 22:57:46.403457 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 29895e9c-c2ba-4c82-b6eb-2d3d459e195c could not be found. Aug 10 22:57:46.403457 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:57:46.403457 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-789b3a55-26c5-4ea5-9763-09806662c98f tempest-ServicesAdminNegativeV253TestJSON-1975357008 tempest-ServicesAdminNegativeV253TestJSON-1975357008-project-admin] Returning 404 to user: Service 29895e9c-c2ba-4c82-b6eb-2d3d459e195c could not be found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 22:57:46.403457 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-789b3a55-26c5-4ea5-9763-09806662c98f tempest-ServicesAdminNegativeV253TestJSON-1975357008 tempest-ServicesAdminNegativeV253TestJSON-1975357008-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-services/29895e9c-c2ba-4c82-b6eb-2d3d459e195c" status: 404 len: 110 microversion: 2.53 time: 0.231949 Aug 10 22:57:46.403457 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 265/551] 10.222.0.58 () {62 vars in 1309 bytes} [Wed Aug 10 22:57:46 2022] PUT /compute/v2.1/os-services/29895e9c-c2ba-4c82-b6eb-2d3d459e195c => generated 110 bytes in 233 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 10 22:57:46.410310 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-cb2db6bc-0677-4b01-9a5f-00b2db66a83b tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:46.413663 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-cb2db6bc-0677-4b01-9a5f-00b2db66a83b tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] [instance: e773ec0c-0cd0-4a08-b9f0-5c2d0a342751] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:57:46.428624 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cb2db6bc-0677-4b01-9a5f-00b2db66a83b tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:46.430217 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cb2db6bc-0677-4b01-9a5f-00b2db66a83b tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:46.433064 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cb2db6bc-0677-4b01-9a5f-00b2db66a83b tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:46.435982 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cb2db6bc-0677-4b01-9a5f-00b2db66a83b tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:46.436511 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cb2db6bc-0677-4b01-9a5f-00b2db66a83b tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:46.439887 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cb2db6bc-0677-4b01-9a5f-00b2db66a83b tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:46.594062 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-c2c6e4f9-fef8-491b-83ba-2cf267f5add0 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Flavor limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 22:57:46.594568 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-c2c6e4f9-fef8-491b-83ba-2cf267f5add0 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Image limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 22:57:46.594968 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-c2c6e4f9-fef8-491b-83ba-2cf267f5add0 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Flavor pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 22:57:46.595373 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-c2c6e4f9-fef8-491b-83ba-2cf267f5add0 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Image pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 22:57:46.595779 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-c2c6e4f9-fef8-491b-83ba-2cf267f5add0 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 22:57:46.617876 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c2c6e4f9-fef8-491b-83ba-2cf267f5add0 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:46.622210 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c2c6e4f9-fef8-491b-83ba-2cf267f5add0 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:46.625155 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c2c6e4f9-fef8-491b-83ba-2cf267f5add0 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:46.631326 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c2c6e4f9-fef8-491b-83ba-2cf267f5add0 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:46.633064 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c2c6e4f9-fef8-491b-83ba-2cf267f5add0 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:46.637807 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c2c6e4f9-fef8-491b-83ba-2cf267f5add0 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:46.690596 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-c2c6e4f9-fef8-491b-83ba-2cf267f5add0 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Getting quotas for project 56ed0bdee3aa4013bd9219069bda558c. Resources: {'instances', 'cores', 'ram'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 22:57:46.708575 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-c2c6e4f9-fef8-491b-83ba-2cf267f5add0 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Getting quotas for user 632904331d024d9b8e4d3660dff2cdf3 and project 56ed0bdee3aa4013bd9219069bda558c. Resources: {'instances', 'cores', 'ram'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 22:57:46.739944 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-c2c6e4f9-fef8-491b-83ba-2cf267f5add0 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Going to run 1 instances... {{(pid=122633) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 22:57:46.747026 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-c2c6e4f9-fef8-491b-83ba-2cf267f5add0 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] [instance: 47f49c52-08b0-469c-8969-c9655c6ee39b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78ad8905-f66f-4733-8be9-2b260f1fabed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122633) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 22:57:46.849672 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-c2c6e4f9-fef8-491b-83ba-2cf267f5add0 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.186988 Aug 10 22:57:46.856774 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 287/552] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 22:57:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 2195 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 22:57:46.862018 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-7bad0b81-e676-4960-8b3c-eb0d2aa5815f req-580f27f0-ef6d-4c74-94f9-137006b3327a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e773ec0c-0cd0-4a08-b9f0-5c2d0a342751", "tag": "4509aea6-eb69-433a-9c36-162726644a47"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:57:46.925702 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-7bad0b81-e676-4960-8b3c-eb0d2aa5815f req-580f27f0-ef6d-4c74-94f9-137006b3327a service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:46.926708 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-7bad0b81-e676-4960-8b3c-eb0d2aa5815f req-580f27f0-ef6d-4c74-94f9-137006b3327a service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:46.927183 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-7bad0b81-e676-4960-8b3c-eb0d2aa5815f req-580f27f0-ef6d-4c74-94f9-137006b3327a service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:46.986239 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-7bad0b81-e676-4960-8b3c-eb0d2aa5815f req-580f27f0-ef6d-4c74-94f9-137006b3327a service nova] Creating event network-changed:4509aea6-eb69-433a-9c36-162726644a47 for instance e773ec0c-0cd0-4a08-b9f0-5c2d0a342751 on n-h2-850468-14 Aug 10 22:57:47.023498 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-7bad0b81-e676-4960-8b3c-eb0d2aa5815f req-580f27f0-ef6d-4c74-94f9-137006b3327a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.164773 Aug 10 22:57:47.026558 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 288/553] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 22:57:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:57:47.061424 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-f9c407c4-c8ad-4327-9152-f91c07b6445a tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:47.062190 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-f9c407c4-c8ad-4327-9152-f91c07b6445a tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 3e467caf-9d1e-4dc0-830d-585aeabc1e5a] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:57:47.092817 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f9c407c4-c8ad-4327-9152-f91c07b6445a tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:47.093830 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f9c407c4-c8ad-4327-9152-f91c07b6445a tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:47.094282 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f9c407c4-c8ad-4327-9152-f91c07b6445a tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:47.095047 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f9c407c4-c8ad-4327-9152-f91c07b6445a tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:47.099116 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f9c407c4-c8ad-4327-9152-f91c07b6445a tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:47.104177 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f9c407c4-c8ad-4327-9152-f91c07b6445a tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:47.399047 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-cb2db6bc-0677-4b01-9a5f-00b2db66a83b tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaed2a2e56f749a88c340aaccb15d2d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deaba512051743deb45881d76eb206ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:47.412602 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-cb2db6bc-0677-4b01-9a5f-00b2db66a83b tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] 10.222.0.58 "GET /compute/v2.1/servers/e773ec0c-0cd0-4a08-b9f0-5c2d0a342751" status: 200 len: 1585 microversion: 2.1 time: 1.013108 Aug 10 22:57:47.416841 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 266/554] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:57:46 2022] GET /compute/v2.1/servers/e773ec0c-0cd0-4a08-b9f0-5c2d0a342751 => generated 1585 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:57:47.437059 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-ca059e9a-bb5f-4b23-b3aa-9ffb815e449e tempest-ServicesAdminNegativeV253TestJSON-1975357008 tempest-ServicesAdminNegativeV253TestJSON-1975357008-project-admin] Action: 'update', calling method: .version_select at 0x7f847d8483a0>, body: {"status": "disabled"} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:57:47.450989 n-d-850468-14 devstack@n-api.service[122632]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:57:47.450989 n-d-850468-14 devstack@n-api.service[122632]: warnings.warn(msg) Aug 10 22:57:47.456047 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ca059e9a-bb5f-4b23-b3aa-9ffb815e449e tempest-ServicesAdminNegativeV253TestJSON-1975357008 tempest-ServicesAdminNegativeV253TestJSON-1975357008-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:47.462229 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ca059e9a-bb5f-4b23-b3aa-9ffb815e449e tempest-ServicesAdminNegativeV253TestJSON-1975357008 tempest-ServicesAdminNegativeV253TestJSON-1975357008-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:47.464517 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ca059e9a-bb5f-4b23-b3aa-9ffb815e449e tempest-ServicesAdminNegativeV253TestJSON-1975357008 tempest-ServicesAdminNegativeV253TestJSON-1975357008-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:47.476514 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ca059e9a-bb5f-4b23-b3aa-9ffb815e449e tempest-ServicesAdminNegativeV253TestJSON-1975357008 tempest-ServicesAdminNegativeV253TestJSON-1975357008-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:47.477314 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ca059e9a-bb5f-4b23-b3aa-9ffb815e449e tempest-ServicesAdminNegativeV253TestJSON-1975357008 tempest-ServicesAdminNegativeV253TestJSON-1975357008-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:47.477939 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ca059e9a-bb5f-4b23-b3aa-9ffb815e449e tempest-ServicesAdminNegativeV253TestJSON-1975357008 tempest-ServicesAdminNegativeV253TestJSON-1975357008-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:47.492251 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-ca059e9a-bb5f-4b23-b3aa-9ffb815e449e tempest-ServicesAdminNegativeV253TestJSON-1975357008 tempest-ServicesAdminNegativeV253TestJSON-1975357008-project-admin] HTTP exception thrown: Service 29895e9c-c2ba-4c82-b6eb-2d3d459e195c could not be found. Aug 10 22:57:47.496437 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-ca059e9a-bb5f-4b23-b3aa-9ffb815e449e tempest-ServicesAdminNegativeV253TestJSON-1975357008 tempest-ServicesAdminNegativeV253TestJSON-1975357008-project-admin] Request method failure captured: Aug 10 22:57:47.496437 n-d-850468-14 devstack@n-api.service[122632]: request: PUT /compute/v2.1/os-services/29895e9c-c2ba-4c82-b6eb-2d3d459e195c HTTP/1.1 Aug 10 22:57:47.496437 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 22:57:47.496437 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 22:57:47.496437 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 22:57:47.496437 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 22 Aug 10 22:57:47.496437 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 22:57:47.496437 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 22:57:47.496437 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 22:57:47.496437 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 22:57:47.496437 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9Dfo8vL4QExIiMGo2KTTObc_OA-sEiddWt2SI333ZWIB9fYHXxEt0V0XEEtxAULxzwoh4h6H9IAPJx8XUxgDj_GSR_taQA7ilVhG8ngtWsPz54ih8U9XIqb3PVqP3j81aAfDRfPEiHHjdbXy9iE-v6eWTAANJubHfVqTRTgdgR_PQdo Aug 10 22:57:47.496437 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 22:57:47.496437 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 22:57:47.496437 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 22:57:47.496437 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 22:57:47.496437 n-d-850468-14 devstack@n-api.service[122632]: X-Openstack-Nova-Api-Version: 2.53 Aug 10 22:57:47.496437 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 22:57:47.496437 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 22:57:47.496437 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 09210f0cdf2c4651a4c2069d53dd4b27 Aug 10 22:57:47.496437 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1975357008 Aug 10 22:57:47.496437 n-d-850468-14 devstack@n-api.service[122632]: X-Role: admin,member,reader Aug 10 22:57:47.496437 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: admin,member,reader Aug 10 22:57:47.497964 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/09210f0cdf2c4651a4c2069d53dd4b27"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/09210f0cdf2c4651a4c2069d53dd4b27"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/09210f0cdf2c4651a4c2069d53dd4b27"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_09210f0cdf2c4651a4c2069d53dd4b27", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 22:57:47.497964 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1975357008 Aug 10 22:57:47.497964 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 09210f0cdf2c4651a4c2069d53dd4b27 Aug 10 22:57:47.497964 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1975357008 Aug 10 22:57:47.497964 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1975357008-project-admin Aug 10 22:57:47.497964 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 22:57:47.497964 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 22:57:47.497964 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: ed711b80beb94313ad9027bc1ff7308c Aug 10 22:57:47.497964 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1975357008-project-admin Aug 10 22:57:47.497964 n-d-850468-14 devstack@n-api.service[122632]: Aug 10 22:57:47.497964 n-d-850468-14 devstack@n-api.service[122632]: {"status": "disabled"} Aug 10 22:57:47.497964 n-d-850468-14 devstack@n-api.service[122632]: method: Aug 10 22:57:47.497964 n-d-850468-14 devstack@n-api.service[122632]: exception: Service 29895e9c-c2ba-4c82-b6eb-2d3d459e195c could not be found. Aug 10 22:57:47.497964 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': '29895e9c-c2ba-4c82-b6eb-2d3d459e195c', 'body': {'status': 'disabled'}} Aug 10 22:57:47.499031 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 22:57:47.499031 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:57:47.499031 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6170, in service_get_by_id Aug 10 22:57:47.499031 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Aug 10 22:57:47.499031 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6030, in _find_service_in_cell Aug 10 22:57:47.499031 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 10 22:57:47.499031 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 10 22:57:47.499031 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:57:47.499031 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:57:47.499031 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:57:47.499031 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:57:47.499031 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update Aug 10 22:57:47.499031 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Aug 10 22:57:47.499031 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6172, in service_get_by_id Aug 10 22:57:47.499031 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Aug 10 22:57:47.499031 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 29895e9c-c2ba-4c82-b6eb-2d3d459e195c could not be found. Aug 10 22:57:47.499031 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:57:47.499031 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:57:47.499031 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:57:47.499031 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:57:47.499031 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:57:47.500479 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:57:47.500479 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 22:57:47.500479 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 22:57:47.500479 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 22:57:47.500479 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 22:57:47.500479 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 22:57:47.500479 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 22:57:47.500479 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 22:57:47.500479 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 22:57:47.500479 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update Aug 10 22:57:47.500479 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 10 22:57:47.500479 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 29895e9c-c2ba-4c82-b6eb-2d3d459e195c could not be found. Aug 10 22:57:47.500479 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:57:47.500479 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:57:47.500479 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:57:47.500479 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:57:47.500479 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:57:47.500479 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:57:47.500479 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 22:57:47.500479 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 22:57:47.501984 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 29895e9c-c2ba-4c82-b6eb-2d3d459e195c could not be found. Aug 10 22:57:47.501984 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:57:47.504590 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-ca059e9a-bb5f-4b23-b3aa-9ffb815e449e tempest-ServicesAdminNegativeV253TestJSON-1975357008 tempest-ServicesAdminNegativeV253TestJSON-1975357008-project-admin] Returning 404 to user: Service 29895e9c-c2ba-4c82-b6eb-2d3d459e195c could not be found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 22:57:47.526166 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-ca059e9a-bb5f-4b23-b3aa-9ffb815e449e tempest-ServicesAdminNegativeV253TestJSON-1975357008 tempest-ServicesAdminNegativeV253TestJSON-1975357008-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-services/29895e9c-c2ba-4c82-b6eb-2d3d459e195c" status: 404 len: 110 microversion: 2.53 time: 0.087997 Aug 10 22:57:47.527362 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 267/555] 10.222.0.58 () {62 vars in 1309 bytes} [Wed Aug 10 22:57:47 2022] PUT /compute/v2.1/os-services/29895e9c-c2ba-4c82-b6eb-2d3d459e195c => generated 110 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 10 22:57:47.544412 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-413f0792-21c8-4d4d-a69f-a15da99ce73d tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:47.545411 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-413f0792-21c8-4d4d-a69f-a15da99ce73d tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] [instance: 47f49c52-08b0-469c-8969-c9655c6ee39b] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:57:47.596426 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-f9c407c4-c8ad-4327-9152-f91c07b6445a tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:47.632352 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-f9c407c4-c8ad-4327-9152-f91c07b6445a tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/3e467caf-9d1e-4dc0-830d-585aeabc1e5a" status: 200 len: 1271 microversion: 2.1 time: 0.601305 Aug 10 22:57:47.633201 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 289/556] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:57:47 2022] GET /compute/v2.1/servers/3e467caf-9d1e-4dc0-830d-585aeabc1e5a => generated 1271 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:57:47.651747 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-3a92b160-b528-4773-8137-fe1e8dc08629 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:47.663513 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-3a92b160-b528-4773-8137-fe1e8dc08629 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] [instance: eaea4cc7-b1b8-43a7-83a4-8cfc8a44f9c1] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:57:47.674663 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3a92b160-b528-4773-8137-fe1e8dc08629 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:47.677229 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3a92b160-b528-4773-8137-fe1e8dc08629 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:47.684325 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3a92b160-b528-4773-8137-fe1e8dc08629 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:47.685512 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3a92b160-b528-4773-8137-fe1e8dc08629 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:47.686127 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3a92b160-b528-4773-8137-fe1e8dc08629 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:47.687013 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3a92b160-b528-4773-8137-fe1e8dc08629 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:47.815118 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-413f0792-21c8-4d4d-a69f-a15da99ce73d tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632904331d024d9b8e4d3660dff2cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ed0bdee3aa4013bd9219069bda558c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:47.825664 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-413f0792-21c8-4d4d-a69f-a15da99ce73d tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] 10.222.0.58 "GET /compute/v2.1/servers/47f49c52-08b0-469c-8969-c9655c6ee39b" status: 200 len: 1210 microversion: 2.1 time: 0.296887 Aug 10 22:57:47.839646 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 268/557] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:57:47 2022] GET /compute/v2.1/servers/47f49c52-08b0-469c-8969-c9655c6ee39b => generated 1210 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:57:47.852816 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-96944d0b-aef8-4937-a92e-c14cf910ffba tempest-ServicesAdminNegativeV253TestJSON-1975357008 tempest-ServicesAdminNegativeV253TestJSON-1975357008-project-admin] Action: 'update', calling method: .version_select at 0x7f847d848ee0>, body: {"status": "enabled"} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:57:47.866554 n-d-850468-14 devstack@n-api.service[122632]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:57:47.866554 n-d-850468-14 devstack@n-api.service[122632]: warnings.warn(msg) Aug 10 22:57:47.868706 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-96944d0b-aef8-4937-a92e-c14cf910ffba tempest-ServicesAdminNegativeV253TestJSON-1975357008 tempest-ServicesAdminNegativeV253TestJSON-1975357008-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:47.869188 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-96944d0b-aef8-4937-a92e-c14cf910ffba tempest-ServicesAdminNegativeV253TestJSON-1975357008 tempest-ServicesAdminNegativeV253TestJSON-1975357008-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:47.869624 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-96944d0b-aef8-4937-a92e-c14cf910ffba tempest-ServicesAdminNegativeV253TestJSON-1975357008 tempest-ServicesAdminNegativeV253TestJSON-1975357008-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:47.905553 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-96944d0b-aef8-4937-a92e-c14cf910ffba tempest-ServicesAdminNegativeV253TestJSON-1975357008 tempest-ServicesAdminNegativeV253TestJSON-1975357008-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:47.906378 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-96944d0b-aef8-4937-a92e-c14cf910ffba tempest-ServicesAdminNegativeV253TestJSON-1975357008 tempest-ServicesAdminNegativeV253TestJSON-1975357008-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:47.907593 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-96944d0b-aef8-4937-a92e-c14cf910ffba tempest-ServicesAdminNegativeV253TestJSON-1975357008 tempest-ServicesAdminNegativeV253TestJSON-1975357008-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:47.922518 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-96944d0b-aef8-4937-a92e-c14cf910ffba tempest-ServicesAdminNegativeV253TestJSON-1975357008 tempest-ServicesAdminNegativeV253TestJSON-1975357008-project-admin] HTTP exception thrown: Service 29895e9c-c2ba-4c82-b6eb-2d3d459e195c could not be found. Aug 10 22:57:47.928328 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-96944d0b-aef8-4937-a92e-c14cf910ffba tempest-ServicesAdminNegativeV253TestJSON-1975357008 tempest-ServicesAdminNegativeV253TestJSON-1975357008-project-admin] Request method failure captured: Aug 10 22:57:47.928328 n-d-850468-14 devstack@n-api.service[122632]: request: PUT /compute/v2.1/os-services/29895e9c-c2ba-4c82-b6eb-2d3d459e195c HTTP/1.1 Aug 10 22:57:47.928328 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 22:57:47.928328 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 22:57:47.928328 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 22:57:47.928328 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 21 Aug 10 22:57:47.928328 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 22:57:47.928328 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 22:57:47.928328 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 22:57:47.928328 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 22:57:47.928328 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9Dfo8vL4QExIiMGo2KTTObc_OA-sEiddWt2SI333ZWIB9fYHXxEt0V0XEEtxAULxzwoh4h6H9IAPJx8XUxgDj_GSR_taQA7ilVhG8ngtWsPz54ih8U9XIqb3PVqP3j81aAfDRfPEiHHjdbXy9iE-v6eWTAANJubHfVqTRTgdgR_PQdo Aug 10 22:57:47.928328 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 22:57:47.928328 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 22:57:47.928328 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 22:57:47.928328 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 22:57:47.928328 n-d-850468-14 devstack@n-api.service[122632]: X-Openstack-Nova-Api-Version: 2.53 Aug 10 22:57:47.928328 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 22:57:47.928328 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 22:57:47.928328 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 09210f0cdf2c4651a4c2069d53dd4b27 Aug 10 22:57:47.928328 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1975357008 Aug 10 22:57:47.928328 n-d-850468-14 devstack@n-api.service[122632]: X-Role: admin,member,reader Aug 10 22:57:47.928328 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: admin,member,reader Aug 10 22:57:47.929697 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/09210f0cdf2c4651a4c2069d53dd4b27"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/09210f0cdf2c4651a4c2069d53dd4b27"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/09210f0cdf2c4651a4c2069d53dd4b27"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_09210f0cdf2c4651a4c2069d53dd4b27", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 22:57:47.929697 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1975357008 Aug 10 22:57:47.929697 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 09210f0cdf2c4651a4c2069d53dd4b27 Aug 10 22:57:47.929697 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1975357008 Aug 10 22:57:47.929697 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1975357008-project-admin Aug 10 22:57:47.929697 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 22:57:47.929697 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 22:57:47.929697 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: ed711b80beb94313ad9027bc1ff7308c Aug 10 22:57:47.929697 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1975357008-project-admin Aug 10 22:57:47.929697 n-d-850468-14 devstack@n-api.service[122632]: Aug 10 22:57:47.929697 n-d-850468-14 devstack@n-api.service[122632]: {"status": "enabled"} Aug 10 22:57:47.929697 n-d-850468-14 devstack@n-api.service[122632]: method: Aug 10 22:57:47.929697 n-d-850468-14 devstack@n-api.service[122632]: exception: Service 29895e9c-c2ba-4c82-b6eb-2d3d459e195c could not be found. Aug 10 22:57:47.929697 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': '29895e9c-c2ba-4c82-b6eb-2d3d459e195c', 'body': {'status': 'enabled'}} Aug 10 22:57:47.930497 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 22:57:47.930497 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:57:47.930497 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6170, in service_get_by_id Aug 10 22:57:47.930497 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Aug 10 22:57:47.930497 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6030, in _find_service_in_cell Aug 10 22:57:47.930497 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 10 22:57:47.930497 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 10 22:57:47.930497 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:57:47.930497 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:57:47.930497 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:57:47.930497 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:57:47.930497 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 439, in update Aug 10 22:57:47.930497 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Aug 10 22:57:47.930497 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6172, in service_get_by_id Aug 10 22:57:47.930497 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Aug 10 22:57:47.930497 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 29895e9c-c2ba-4c82-b6eb-2d3d459e195c could not be found. Aug 10 22:57:47.930497 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:57:47.930497 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:57:47.930497 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:57:47.930497 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:57:47.930497 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:57:47.931692 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:57:47.931692 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 22:57:47.931692 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 22:57:47.931692 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 22:57:47.931692 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 22:57:47.931692 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 22:57:47.931692 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 22:57:47.931692 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 22:57:47.931692 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 22:57:47.931692 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 444, in update Aug 10 22:57:47.931692 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 10 22:57:47.931692 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 29895e9c-c2ba-4c82-b6eb-2d3d459e195c could not be found. Aug 10 22:57:47.931692 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:57:47.931692 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:57:47.931692 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:57:47.931692 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:57:47.931692 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:57:47.931692 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:57:47.931692 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 22:57:47.931692 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 22:57:47.933260 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 29895e9c-c2ba-4c82-b6eb-2d3d459e195c could not be found. Aug 10 22:57:47.933260 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:57:47.938472 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-96944d0b-aef8-4937-a92e-c14cf910ffba tempest-ServicesAdminNegativeV253TestJSON-1975357008 tempest-ServicesAdminNegativeV253TestJSON-1975357008-project-admin] Returning 404 to user: Service 29895e9c-c2ba-4c82-b6eb-2d3d459e195c could not be found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 22:57:47.943022 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-96944d0b-aef8-4937-a92e-c14cf910ffba tempest-ServicesAdminNegativeV253TestJSON-1975357008 tempest-ServicesAdminNegativeV253TestJSON-1975357008-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-services/29895e9c-c2ba-4c82-b6eb-2d3d459e195c" status: 404 len: 110 microversion: 2.53 time: 0.102106 Aug 10 22:57:47.944229 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 269/558] 10.222.0.58 () {62 vars in 1309 bytes} [Wed Aug 10 22:57:47 2022] PUT /compute/v2.1/os-services/29895e9c-c2ba-4c82-b6eb-2d3d459e195c => generated 110 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 10 22:57:47.959270 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c5d39785-efee-421a-a439-278fc1659a85 tempest-ServicesAdminNegativeV253TestJSON-1975357008 tempest-ServicesAdminNegativeV253TestJSON-1975357008-project-admin] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:47.965217 n-d-850468-14 devstack@n-api.service[122632]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:57:47.965217 n-d-850468-14 devstack@n-api.service[122632]: warnings.warn(msg) Aug 10 22:57:47.978626 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c5d39785-efee-421a-a439-278fc1659a85 tempest-ServicesAdminNegativeV253TestJSON-1975357008 tempest-ServicesAdminNegativeV253TestJSON-1975357008-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:47.992626 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c5d39785-efee-421a-a439-278fc1659a85 tempest-ServicesAdminNegativeV253TestJSON-1975357008 tempest-ServicesAdminNegativeV253TestJSON-1975357008-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:47.994404 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c5d39785-efee-421a-a439-278fc1659a85 tempest-ServicesAdminNegativeV253TestJSON-1975357008 tempest-ServicesAdminNegativeV253TestJSON-1975357008-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:47.998116 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c5d39785-efee-421a-a439-278fc1659a85 tempest-ServicesAdminNegativeV253TestJSON-1975357008 tempest-ServicesAdminNegativeV253TestJSON-1975357008-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:47.999348 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c5d39785-efee-421a-a439-278fc1659a85 tempest-ServicesAdminNegativeV253TestJSON-1975357008 tempest-ServicesAdminNegativeV253TestJSON-1975357008-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:48.001047 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c5d39785-efee-421a-a439-278fc1659a85 tempest-ServicesAdminNegativeV253TestJSON-1975357008 tempest-ServicesAdminNegativeV253TestJSON-1975357008-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:48.091214 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-c5d39785-efee-421a-a439-278fc1659a85 tempest-ServicesAdminNegativeV253TestJSON-1975357008 tempest-ServicesAdminNegativeV253TestJSON-1975357008-project-admin] 10.222.0.58 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.141665 Aug 10 22:57:48.107207 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 270/559] 10.222.0.58 () {60 vars in 1178 bytes} [Wed Aug 10 22:57:47 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 22:57:48.122620 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-9dbaa317-f2a7-4190-813d-9de7b5acc8db tempest-ServicesAdminNegativeV253TestJSON-1975357008 tempest-ServicesAdminNegativeV253TestJSON-1975357008-project-admin] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:48.142521 n-d-850468-14 devstack@n-api.service[122632]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:57:48.142521 n-d-850468-14 devstack@n-api.service[122632]: warnings.warn(msg) Aug 10 22:57:48.143930 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9dbaa317-f2a7-4190-813d-9de7b5acc8db tempest-ServicesAdminNegativeV253TestJSON-1975357008 tempest-ServicesAdminNegativeV253TestJSON-1975357008-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:48.150534 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9dbaa317-f2a7-4190-813d-9de7b5acc8db tempest-ServicesAdminNegativeV253TestJSON-1975357008 tempest-ServicesAdminNegativeV253TestJSON-1975357008-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:48.160302 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9dbaa317-f2a7-4190-813d-9de7b5acc8db tempest-ServicesAdminNegativeV253TestJSON-1975357008 tempest-ServicesAdminNegativeV253TestJSON-1975357008-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:48.167511 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9dbaa317-f2a7-4190-813d-9de7b5acc8db tempest-ServicesAdminNegativeV253TestJSON-1975357008 tempest-ServicesAdminNegativeV253TestJSON-1975357008-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:48.168253 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9dbaa317-f2a7-4190-813d-9de7b5acc8db tempest-ServicesAdminNegativeV253TestJSON-1975357008 tempest-ServicesAdminNegativeV253TestJSON-1975357008-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:48.168851 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9dbaa317-f2a7-4190-813d-9de7b5acc8db tempest-ServicesAdminNegativeV253TestJSON-1975357008 tempest-ServicesAdminNegativeV253TestJSON-1975357008-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:48.231788 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-9dbaa317-f2a7-4190-813d-9de7b5acc8db tempest-ServicesAdminNegativeV253TestJSON-1975357008 tempest-ServicesAdminNegativeV253TestJSON-1975357008-project-admin] 10.222.0.58 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.123282 Aug 10 22:57:48.244719 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-3a92b160-b528-4773-8137-fe1e8dc08629 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:48.250474 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 271/560] 10.222.0.58 () {60 vars in 1211 bytes} [Wed Aug 10 22:57:48 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1244 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:57:48.262668 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-cb54cb96-6c96-4a1a-9aa9-fb3e767f634a tempest-ServicesAdminNegativeV253TestJSON-1975357008 tempest-ServicesAdminNegativeV253TestJSON-1975357008-project-admin] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:48.265814 n-d-850468-14 devstack@n-api.service[122632]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:57:48.265814 n-d-850468-14 devstack@n-api.service[122632]: warnings.warn(msg) Aug 10 22:57:48.269959 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cb54cb96-6c96-4a1a-9aa9-fb3e767f634a tempest-ServicesAdminNegativeV253TestJSON-1975357008 tempest-ServicesAdminNegativeV253TestJSON-1975357008-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:48.270524 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-3a92b160-b528-4773-8137-fe1e8dc08629 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:48.271346 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cb54cb96-6c96-4a1a-9aa9-fb3e767f634a tempest-ServicesAdminNegativeV253TestJSON-1975357008 tempest-ServicesAdminNegativeV253TestJSON-1975357008-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:48.272067 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cb54cb96-6c96-4a1a-9aa9-fb3e767f634a tempest-ServicesAdminNegativeV253TestJSON-1975357008 tempest-ServicesAdminNegativeV253TestJSON-1975357008-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:48.272557 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-3a92b160-b528-4773-8137-fe1e8dc08629 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:48.274381 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-3a92b160-b528-4773-8137-fe1e8dc08629 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] 10.222.0.58 "GET /compute/v2.1/servers/eaea4cc7-b1b8-43a7-83a4-8cfc8a44f9c1" status: 200 len: 1361 microversion: 2.25 time: 0.639853 Aug 10 22:57:48.274849 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cb54cb96-6c96-4a1a-9aa9-fb3e767f634a tempest-ServicesAdminNegativeV253TestJSON-1975357008 tempest-ServicesAdminNegativeV253TestJSON-1975357008-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:48.275558 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cb54cb96-6c96-4a1a-9aa9-fb3e767f634a tempest-ServicesAdminNegativeV253TestJSON-1975357008 tempest-ServicesAdminNegativeV253TestJSON-1975357008-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:48.276145 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cb54cb96-6c96-4a1a-9aa9-fb3e767f634a tempest-ServicesAdminNegativeV253TestJSON-1975357008 tempest-ServicesAdminNegativeV253TestJSON-1975357008-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:48.294321 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 290/561] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 22:57:47 2022] GET /compute/v2.1/servers/eaea4cc7-b1b8-43a7-83a4-8cfc8a44f9c1 => generated 1361 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:57:48.323776 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-cb54cb96-6c96-4a1a-9aa9-fb3e767f634a tempest-ServicesAdminNegativeV253TestJSON-1975357008 tempest-ServicesAdminNegativeV253TestJSON-1975357008-project-admin] 10.222.0.58 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.072109 Aug 10 22:57:48.328015 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 272/562] 10.222.0.58 () {60 vars in 1178 bytes} [Wed Aug 10 22:57:48 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:57:48.337754 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-83b940c6-de80-4ab5-b0c9-9f89708e814c tempest-ServicesAdminNegativeV253TestJSON-1975357008 tempest-ServicesAdminNegativeV253TestJSON-1975357008-project-admin] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:48.340628 n-d-850468-14 devstack@n-api.service[122633]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:57:48.340628 n-d-850468-14 devstack@n-api.service[122633]: warnings.warn(msg) Aug 10 22:57:48.344003 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-83b940c6-de80-4ab5-b0c9-9f89708e814c tempest-ServicesAdminNegativeV253TestJSON-1975357008 tempest-ServicesAdminNegativeV253TestJSON-1975357008-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:48.344883 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-83b940c6-de80-4ab5-b0c9-9f89708e814c tempest-ServicesAdminNegativeV253TestJSON-1975357008 tempest-ServicesAdminNegativeV253TestJSON-1975357008-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:48.345528 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-83b940c6-de80-4ab5-b0c9-9f89708e814c tempest-ServicesAdminNegativeV253TestJSON-1975357008 tempest-ServicesAdminNegativeV253TestJSON-1975357008-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:48.346457 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-83b940c6-de80-4ab5-b0c9-9f89708e814c tempest-ServicesAdminNegativeV253TestJSON-1975357008 tempest-ServicesAdminNegativeV253TestJSON-1975357008-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:48.347983 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-83b940c6-de80-4ab5-b0c9-9f89708e814c tempest-ServicesAdminNegativeV253TestJSON-1975357008 tempest-ServicesAdminNegativeV253TestJSON-1975357008-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:48.349080 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-83b940c6-de80-4ab5-b0c9-9f89708e814c tempest-ServicesAdminNegativeV253TestJSON-1975357008 tempest-ServicesAdminNegativeV253TestJSON-1975357008-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:48.394316 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-83b940c6-de80-4ab5-b0c9-9f89708e814c tempest-ServicesAdminNegativeV253TestJSON-1975357008 tempest-ServicesAdminNegativeV253TestJSON-1975357008-project-admin] 10.222.0.58 "GET /compute/v2.1/os-services?host=n-d-850468-14&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.059608 Aug 10 22:57:48.395876 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 291/563] 10.222.0.58 () {60 vars in 1237 bytes} [Wed Aug 10 22:57:48 2022] GET /compute/v2.1/os-services?host=n-d-850468-14&binary=xxx => generated 16 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:57:48.413930 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-576804bc-02db-4486-a56d-81a264a4c2a0 tempest-ServicesAdminNegativeV253TestJSON-1975357008 tempest-ServicesAdminNegativeV253TestJSON-1975357008-project-admin] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:48.417026 n-d-850468-14 devstack@n-api.service[122632]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:57:48.417026 n-d-850468-14 devstack@n-api.service[122632]: warnings.warn(msg) Aug 10 22:57:48.418464 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-576804bc-02db-4486-a56d-81a264a4c2a0 tempest-ServicesAdminNegativeV253TestJSON-1975357008 tempest-ServicesAdminNegativeV253TestJSON-1975357008-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:48.419085 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-576804bc-02db-4486-a56d-81a264a4c2a0 tempest-ServicesAdminNegativeV253TestJSON-1975357008 tempest-ServicesAdminNegativeV253TestJSON-1975357008-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:48.419752 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-576804bc-02db-4486-a56d-81a264a4c2a0 tempest-ServicesAdminNegativeV253TestJSON-1975357008 tempest-ServicesAdminNegativeV253TestJSON-1975357008-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:48.422548 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-576804bc-02db-4486-a56d-81a264a4c2a0 tempest-ServicesAdminNegativeV253TestJSON-1975357008 tempest-ServicesAdminNegativeV253TestJSON-1975357008-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:48.423150 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-576804bc-02db-4486-a56d-81a264a4c2a0 tempest-ServicesAdminNegativeV253TestJSON-1975357008 tempest-ServicesAdminNegativeV253TestJSON-1975357008-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:48.423752 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-576804bc-02db-4486-a56d-81a264a4c2a0 tempest-ServicesAdminNegativeV253TestJSON-1975357008 tempest-ServicesAdminNegativeV253TestJSON-1975357008-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:48.527308 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-576804bc-02db-4486-a56d-81a264a4c2a0 tempest-ServicesAdminNegativeV253TestJSON-1975357008 tempest-ServicesAdminNegativeV253TestJSON-1975357008-project-admin] 10.222.0.58 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.118008 Aug 10 22:57:48.528970 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 273/564] 10.222.0.58 () {60 vars in 1178 bytes} [Wed Aug 10 22:57:48 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:57:48.541885 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-f32be257-9c79-4323-b57e-b09284176937 tempest-ServicesAdminNegativeV253TestJSON-1975357008 tempest-ServicesAdminNegativeV253TestJSON-1975357008-project-admin] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:48.545113 n-d-850468-14 devstack@n-api.service[122633]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:57:48.545113 n-d-850468-14 devstack@n-api.service[122633]: warnings.warn(msg) Aug 10 22:57:48.547784 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f32be257-9c79-4323-b57e-b09284176937 tempest-ServicesAdminNegativeV253TestJSON-1975357008 tempest-ServicesAdminNegativeV253TestJSON-1975357008-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:48.548377 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f32be257-9c79-4323-b57e-b09284176937 tempest-ServicesAdminNegativeV253TestJSON-1975357008 tempest-ServicesAdminNegativeV253TestJSON-1975357008-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:48.551623 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f32be257-9c79-4323-b57e-b09284176937 tempest-ServicesAdminNegativeV253TestJSON-1975357008 tempest-ServicesAdminNegativeV253TestJSON-1975357008-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:48.552554 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f32be257-9c79-4323-b57e-b09284176937 tempest-ServicesAdminNegativeV253TestJSON-1975357008 tempest-ServicesAdminNegativeV253TestJSON-1975357008-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:48.553104 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f32be257-9c79-4323-b57e-b09284176937 tempest-ServicesAdminNegativeV253TestJSON-1975357008 tempest-ServicesAdminNegativeV253TestJSON-1975357008-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:48.554863 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f32be257-9c79-4323-b57e-b09284176937 tempest-ServicesAdminNegativeV253TestJSON-1975357008 tempest-ServicesAdminNegativeV253TestJSON-1975357008-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:48.626938 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-f32be257-9c79-4323-b57e-b09284176937 tempest-ServicesAdminNegativeV253TestJSON-1975357008 tempest-ServicesAdminNegativeV253TestJSON-1975357008-project-admin] 10.222.0.58 "GET /compute/v2.1/os-services?host=xxx&binary=nova-conductor" status: 200 len: 16 microversion: 2.53 time: 0.089411 Aug 10 22:57:48.632199 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 292/565] 10.222.0.58 () {60 vars in 1239 bytes} [Wed Aug 10 22:57:48 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-conductor => generated 16 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:57:48.667465 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-1aa26607-4218-4b63-847e-a35d5f82b5ce tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:48.668140 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-1aa26607-4218-4b63-847e-a35d5f82b5ce tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 3e467caf-9d1e-4dc0-830d-585aeabc1e5a] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:57:48.680339 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1aa26607-4218-4b63-847e-a35d5f82b5ce tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:48.680845 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1aa26607-4218-4b63-847e-a35d5f82b5ce tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:48.681286 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1aa26607-4218-4b63-847e-a35d5f82b5ce tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:48.682211 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1aa26607-4218-4b63-847e-a35d5f82b5ce tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:48.682673 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1aa26607-4218-4b63-847e-a35d5f82b5ce tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:48.683932 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1aa26607-4218-4b63-847e-a35d5f82b5ce tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:48.843784 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-dbe48413-2ff0-4486-977c-8493f051a63a tempest-ServicesAdminNegativeV253TestJSON-875771620 tempest-ServicesAdminNegativeV253TestJSON-875771620-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:48.849345 n-d-850468-14 devstack@n-api.service[122632]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:57:48.849345 n-d-850468-14 devstack@n-api.service[122632]: warnings.warn(msg) Aug 10 22:57:48.851564 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-dbe48413-2ff0-4486-977c-8493f051a63a tempest-ServicesAdminNegativeV253TestJSON-875771620 tempest-ServicesAdminNegativeV253TestJSON-875771620-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '53144678039c40dbb02e30eecef522eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbec341e12eb4653895d206d439f8c4f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:48.854251 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-dbe48413-2ff0-4486-977c-8493f051a63a tempest-ServicesAdminNegativeV253TestJSON-875771620 tempest-ServicesAdminNegativeV253TestJSON-875771620-project] Request method failure captured: Aug 10 22:57:48.854251 n-d-850468-14 devstack@n-api.service[122632]: request: GET /compute/v2.1/os-services HTTP/1.1 Aug 10 22:57:48.854251 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 22:57:48.854251 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 22:57:48.854251 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 22:57:48.854251 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 22:57:48.854251 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 22:57:48.854251 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 22:57:48.854251 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 22:57:48.854251 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 22:57:48.854251 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9DfnC8suJ-DE1fBCf1isrjcqoRYfJFvtwv_GIIxZth-ZMJ4H66tzMLrn9usSdv8sU5grCop_ir9GrF1_MoSj_1_aPGSXRCuJEn55qTvFeaI8zjV2phsPYHS9C45QcwdjxD3lC73TWpkovOledl9Zu455N6zNFvzaqHzJ5yzsz289Q-s Aug 10 22:57:48.854251 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 22:57:48.854251 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 22:57:48.854251 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 22:57:48.854251 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 22:57:48.854251 n-d-850468-14 devstack@n-api.service[122632]: X-Openstack-Nova-Api-Version: 2.53 Aug 10 22:57:48.854251 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 22:57:48.854251 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 22:57:48.854251 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: bbec341e12eb4653895d206d439f8c4f Aug 10 22:57:48.854251 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-875771620 Aug 10 22:57:48.854251 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 22:57:48.854251 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 22:57:48.855593 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/bbec341e12eb4653895d206d439f8c4f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/bbec341e12eb4653895d206d439f8c4f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/bbec341e12eb4653895d206d439f8c4f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_bbec341e12eb4653895d206d439f8c4f", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 22:57:48.855593 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-875771620 Aug 10 22:57:48.855593 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: bbec341e12eb4653895d206d439f8c4f Aug 10 22:57:48.855593 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-875771620 Aug 10 22:57:48.855593 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-ServicesAdminNegativeV253TestJSON-875771620-project Aug 10 22:57:48.855593 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 22:57:48.855593 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 22:57:48.855593 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: 53144678039c40dbb02e30eecef522eb Aug 10 22:57:48.855593 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-875771620-project Aug 10 22:57:48.855593 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 22:57:48.855593 n-d-850468-14 devstack@n-api.service[122632]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 10 22:57:48.855593 n-d-850468-14 devstack@n-api.service[122632]: action_args: {} Aug 10 22:57:48.856305 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 22:57:48.856305 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:57:48.856305 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:57:48.856305 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:57:48.856305 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 22:57:48.856305 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 22:57:48.856305 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 10 22:57:48.856305 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 22:57:48.856305 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 10 22:57:48.856305 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 22:57:48.856305 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 22:57:48.856305 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 22:57:48.856305 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 387, in index Aug 10 22:57:48.856305 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Aug 10 22:57:48.856305 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 10 22:57:48.856305 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 10 22:57:48.856305 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 10 22:57:48.856305 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 10 22:57:48.856305 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 10 22:57:48.857354 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 10 22:57:48.857354 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 10 22:57:48.857354 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise self.value Aug 10 22:57:48.857354 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 10 22:57:48.857354 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 10 22:57:48.857354 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 10 22:57:48.857354 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 10 22:57:48.857354 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 10 22:57:48.857354 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 10 22:57:48.857354 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 10 22:57:48.857354 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:57:48.857354 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:57:48.857354 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:57:48.857354 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:57:48.857354 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:57:48.857354 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:57:48.857354 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 10 22:57:48.857354 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 10 22:57:48.857354 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 10 22:57:48.857354 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:57:48.858457 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-dbe48413-2ff0-4486-977c-8493f051a63a tempest-ServicesAdminNegativeV253TestJSON-875771620 tempest-ServicesAdminNegativeV253TestJSON-875771620-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 22:57:48.858457 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-dbe48413-2ff0-4486-977c-8493f051a63a tempest-ServicesAdminNegativeV253TestJSON-875771620 tempest-ServicesAdminNegativeV253TestJSON-875771620-project] 10.222.0.58 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.213594 Aug 10 22:57:48.858457 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 274/566] 10.222.0.58 () {60 vars in 1178 bytes} [Wed Aug 10 22:57:48 2022] GET /compute/v2.1/os-services => generated 112 bytes in 217 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) Aug 10 22:57:48.864653 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-209bdeba-1072-4c17-8a28-63c02a5547de tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:48.865102 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-209bdeba-1072-4c17-8a28-63c02a5547de tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] [instance: 47f49c52-08b0-469c-8969-c9655c6ee39b] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:57:48.870618 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-1aa26607-4218-4b63-847e-a35d5f82b5ce tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:48.884551 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-1aa26607-4218-4b63-847e-a35d5f82b5ce tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/3e467caf-9d1e-4dc0-830d-585aeabc1e5a" status: 200 len: 1271 microversion: 2.1 time: 0.231213 Aug 10 22:57:48.887307 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 293/567] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:57:48 2022] GET /compute/v2.1/servers/3e467caf-9d1e-4dc0-830d-585aeabc1e5a => generated 1271 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:57:48.893856 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-209bdeba-1072-4c17-8a28-63c02a5547de tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:48.894612 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-209bdeba-1072-4c17-8a28-63c02a5547de tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:48.895000 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-209bdeba-1072-4c17-8a28-63c02a5547de tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:48.896523 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-209bdeba-1072-4c17-8a28-63c02a5547de tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:48.897311 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-209bdeba-1072-4c17-8a28-63c02a5547de tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:48.898543 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-209bdeba-1072-4c17-8a28-63c02a5547de tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:49.315194 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-f2af4d3c-1e9e-4034-9f67-357d29d6f87a tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:49.317321 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-f2af4d3c-1e9e-4034-9f67-357d29d6f87a tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] [instance: eaea4cc7-b1b8-43a7-83a4-8cfc8a44f9c1] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:57:49.330833 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f2af4d3c-1e9e-4034-9f67-357d29d6f87a tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:49.333879 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f2af4d3c-1e9e-4034-9f67-357d29d6f87a tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:49.336427 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f2af4d3c-1e9e-4034-9f67-357d29d6f87a tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:49.337469 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f2af4d3c-1e9e-4034-9f67-357d29d6f87a tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:49.339055 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f2af4d3c-1e9e-4034-9f67-357d29d6f87a tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:49.339816 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f2af4d3c-1e9e-4034-9f67-357d29d6f87a tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:49.402569 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=100 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:57:49.697942 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-209bdeba-1072-4c17-8a28-63c02a5547de tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632904331d024d9b8e4d3660dff2cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ed0bdee3aa4013bd9219069bda558c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:49.715103 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-209bdeba-1072-4c17-8a28-63c02a5547de tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] 10.222.0.58 "GET /compute/v2.1/servers/47f49c52-08b0-469c-8969-c9655c6ee39b" status: 200 len: 1270 microversion: 2.1 time: 0.855886 Aug 10 22:57:49.717167 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 275/568] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:57:48 2022] GET /compute/v2.1/servers/47f49c52-08b0-469c-8969-c9655c6ee39b => generated 1270 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:57:49.908263 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-48708b65-1115-4d1e-bd74-ca3b2ab6ccca tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:49.909124 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-48708b65-1115-4d1e-bd74-ca3b2ab6ccca tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 3e467caf-9d1e-4dc0-830d-585aeabc1e5a] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:57:49.924809 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-48708b65-1115-4d1e-bd74-ca3b2ab6ccca tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:49.928012 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-48708b65-1115-4d1e-bd74-ca3b2ab6ccca tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:49.930701 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-48708b65-1115-4d1e-bd74-ca3b2ab6ccca tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:49.931989 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-48708b65-1115-4d1e-bd74-ca3b2ab6ccca tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:49.932482 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-48708b65-1115-4d1e-bd74-ca3b2ab6ccca tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:49.937695 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-48708b65-1115-4d1e-bd74-ca3b2ab6ccca tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:50.203202 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-48708b65-1115-4d1e-bd74-ca3b2ab6ccca tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:50.216175 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-48708b65-1115-4d1e-bd74-ca3b2ab6ccca tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/3e467caf-9d1e-4dc0-830d-585aeabc1e5a" status: 200 len: 1313 microversion: 2.1 time: 0.313334 Aug 10 22:57:50.219017 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 276/569] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:57:49 2022] GET /compute/v2.1/servers/3e467caf-9d1e-4dc0-830d-585aeabc1e5a => generated 1313 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:57:50.389744 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-f2af4d3c-1e9e-4034-9f67-357d29d6f87a tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:50.399986 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-f2af4d3c-1e9e-4034-9f67-357d29d6f87a tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:50.404070 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-f2af4d3c-1e9e-4034-9f67-357d29d6f87a tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:50.405813 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-f2af4d3c-1e9e-4034-9f67-357d29d6f87a tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] 10.222.0.58 "GET /compute/v2.1/servers/eaea4cc7-b1b8-43a7-83a4-8cfc8a44f9c1" status: 200 len: 1361 microversion: 2.25 time: 1.099882 Aug 10 22:57:50.426805 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 294/570] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 22:57:49 2022] GET /compute/v2.1/servers/eaea4cc7-b1b8-43a7-83a4-8cfc8a44f9c1 => generated 1361 bytes in 1122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:57:50.564944 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-2227a72f-306a-4de4-88ba-75526ba0c004 tempest-FloatingIPsTestJSON-646876676 tempest-FloatingIPsTestJSON-646876676-project] Action: 'create', calling method: .version_select at 0x7f847d76db80>, body: {"pool": null} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:57:50.743080 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-b8bd89ea-a793-4981-bc93-26a91d5373f8 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:50.744293 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-b8bd89ea-a793-4981-bc93-26a91d5373f8 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] [instance: 47f49c52-08b0-469c-8969-c9655c6ee39b] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:57:50.757633 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b8bd89ea-a793-4981-bc93-26a91d5373f8 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:50.759186 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b8bd89ea-a793-4981-bc93-26a91d5373f8 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:50.760094 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b8bd89ea-a793-4981-bc93-26a91d5373f8 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:50.761724 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b8bd89ea-a793-4981-bc93-26a91d5373f8 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:50.770612 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b8bd89ea-a793-4981-bc93-26a91d5373f8 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:50.797259 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b8bd89ea-a793-4981-bc93-26a91d5373f8 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:50.966903 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-b8bd89ea-a793-4981-bc93-26a91d5373f8 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632904331d024d9b8e4d3660dff2cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ed0bdee3aa4013bd9219069bda558c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:50.977612 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-b8bd89ea-a793-4981-bc93-26a91d5373f8 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] 10.222.0.58 "GET /compute/v2.1/servers/47f49c52-08b0-469c-8969-c9655c6ee39b" status: 200 len: 1268 microversion: 2.1 time: 0.241998 Aug 10 22:57:50.978206 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 295/571] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:57:50 2022] GET /compute/v2.1/servers/47f49c52-08b0-469c-8969-c9655c6ee39b => generated 1268 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:57:51.248714 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-ca0afc56-397f-4563-9022-7f644c2f8972 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:51.250426 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-ca0afc56-397f-4563-9022-7f644c2f8972 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 3e467caf-9d1e-4dc0-830d-585aeabc1e5a] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:57:51.267602 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:57:51.275283 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ca0afc56-397f-4563-9022-7f644c2f8972 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:51.276052 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ca0afc56-397f-4563-9022-7f644c2f8972 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:51.277835 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ca0afc56-397f-4563-9022-7f644c2f8972 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:51.280899 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ca0afc56-397f-4563-9022-7f644c2f8972 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:51.281562 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ca0afc56-397f-4563-9022-7f644c2f8972 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:51.284054 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ca0afc56-397f-4563-9022-7f644c2f8972 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:51.598543 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-ca0afc56-397f-4563-9022-7f644c2f8972 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:51.612121 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-ca0afc56-397f-4563-9022-7f644c2f8972 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/3e467caf-9d1e-4dc0-830d-585aeabc1e5a" status: 200 len: 1313 microversion: 2.1 time: 0.371381 Aug 10 22:57:51.613225 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 296/572] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:57:51 2022] GET /compute/v2.1/servers/3e467caf-9d1e-4dc0-830d-585aeabc1e5a => generated 1313 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:57:51.639398 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-d5aa64a3-bec0-42fe-97a8-67d0d0a0b491 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-1898953312", "imageRef": "81de355f-3340-4fcf-8046-d9bece81a3e2", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "8be5e9ea-cd2c-4bb6-b7d6-8a3ca12803f1"}], "security_groups": [{"name": "tempest-securitygroup--1377442822"}], "key_name": "tempest-keypair-382485334", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:57:51.912276 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.network.neutron [None req-d5aa64a3-bec0-42fe-97a8-67d0d0a0b491 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] validate_networks() for [('8be5e9ea-cd2c-4bb6-b7d6-8a3ca12803f1', None, None, None, None, None)] {{(pid=122633) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 22:57:52.948103 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-d5aa64a3-bec0-42fe-97a8-67d0d0a0b491 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Flavor limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 22:57:52.948741 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-d5aa64a3-bec0-42fe-97a8-67d0d0a0b491 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Image limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 22:57:52.949063 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-d5aa64a3-bec0-42fe-97a8-67d0d0a0b491 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Flavor pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 22:57:52.949589 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-d5aa64a3-bec0-42fe-97a8-67d0d0a0b491 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Image pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 22:57:52.949922 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-d5aa64a3-bec0-42fe-97a8-67d0d0a0b491 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 22:57:52.974827 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d5aa64a3-bec0-42fe-97a8-67d0d0a0b491 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:52.975994 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d5aa64a3-bec0-42fe-97a8-67d0d0a0b491 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:52.977050 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d5aa64a3-bec0-42fe-97a8-67d0d0a0b491 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:52.978512 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d5aa64a3-bec0-42fe-97a8-67d0d0a0b491 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:52.979241 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d5aa64a3-bec0-42fe-97a8-67d0d0a0b491 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:52.983323 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d5aa64a3-bec0-42fe-97a8-67d0d0a0b491 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:53.030020 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-d5aa64a3-bec0-42fe-97a8-67d0d0a0b491 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Getting quotas for project 29083d61c29b43b4b47539a141b3d1fb. Resources: {'instances', 'cores', 'ram'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 22:57:53.038811 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-d5aa64a3-bec0-42fe-97a8-67d0d0a0b491 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Getting quotas for user 0415b5bdb48249d6b9f1ef7c92aad597 and project 29083d61c29b43b4b47539a141b3d1fb. Resources: {'instances', 'cores', 'ram'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 22:57:53.075221 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-d5aa64a3-bec0-42fe-97a8-67d0d0a0b491 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Going to run 1 instances... {{(pid=122633) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 22:57:53.078637 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-d5aa64a3-bec0-42fe-97a8-67d0d0a0b491 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] [instance: 7599a318-7a19-4f4a-bbb6-162f7a207060] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='81de355f-3340-4fcf-8046-d9bece81a3e2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122633) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 22:57:53.138378 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-d5aa64a3-bec0-42fe-97a8-67d0d0a0b491 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.514008 Aug 10 22:57:53.139688 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 297/573] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 22:57:51 2022] POST /compute/v2.1/servers => generated 406 bytes in 1526 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 22:57:53.149788 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-b2f59ede-3a4a-4844-b262-bc892d49a1ad req-909221e7-c20e-4257-a19c-62f8dd5e2bae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eaea4cc7-b1b8-43a7-83a4-8cfc8a44f9c1", "name": "network-vif-plugged", "status": "completed", "tag": "736e341a-be60-4b0a-ac9e-ebacb140516d"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:57:53.164563 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-b2f59ede-3a4a-4844-b262-bc892d49a1ad req-909221e7-c20e-4257-a19c-62f8dd5e2bae service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:53.165455 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-b2f59ede-3a4a-4844-b262-bc892d49a1ad req-909221e7-c20e-4257-a19c-62f8dd5e2bae service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:53.166110 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-b2f59ede-3a4a-4844-b262-bc892d49a1ad req-909221e7-c20e-4257-a19c-62f8dd5e2bae service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:53.180416 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-b2f59ede-3a4a-4844-b262-bc892d49a1ad req-909221e7-c20e-4257-a19c-62f8dd5e2bae service nova] Creating event network-vif-plugged:736e341a-be60-4b0a-ac9e-ebacb140516d for instance eaea4cc7-b1b8-43a7-83a4-8cfc8a44f9c1 on n-h1-850468-14 Aug 10 22:57:53.186660 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-b2f59ede-3a4a-4844-b262-bc892d49a1ad req-909221e7-c20e-4257-a19c-62f8dd5e2bae service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045583 Aug 10 22:57:53.192105 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 298/574] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 22:57:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:57:53.216046 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-bbe4eb62-4ffe-4adb-9711-dfae2aefb3c7 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:53.217393 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-bbe4eb62-4ffe-4adb-9711-dfae2aefb3c7 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] [instance: eaea4cc7-b1b8-43a7-83a4-8cfc8a44f9c1] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:57:53.232962 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bbe4eb62-4ffe-4adb-9711-dfae2aefb3c7 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:53.235940 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bbe4eb62-4ffe-4adb-9711-dfae2aefb3c7 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:53.236609 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bbe4eb62-4ffe-4adb-9711-dfae2aefb3c7 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:53.237592 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bbe4eb62-4ffe-4adb-9711-dfae2aefb3c7 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:53.239466 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bbe4eb62-4ffe-4adb-9711-dfae2aefb3c7 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:53.244404 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bbe4eb62-4ffe-4adb-9711-dfae2aefb3c7 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:53.574626 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-bbe4eb62-4ffe-4adb-9711-dfae2aefb3c7 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:53.590659 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-bbe4eb62-4ffe-4adb-9711-dfae2aefb3c7 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:53.601689 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-bbe4eb62-4ffe-4adb-9711-dfae2aefb3c7 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:53.606823 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-bbe4eb62-4ffe-4adb-9711-dfae2aefb3c7 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] 10.222.0.58 "GET /compute/v2.1/servers/eaea4cc7-b1b8-43a7-83a4-8cfc8a44f9c1" status: 200 len: 1361 microversion: 2.25 time: 0.411192 Aug 10 22:57:53.611959 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 299/575] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 22:57:53 2022] GET /compute/v2.1/servers/eaea4cc7-b1b8-43a7-83a4-8cfc8a44f9c1 => generated 1361 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:57:53.622147 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-7afe15d2-0f65-4769-b7e1-68800df503b5 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:53.622761 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-7afe15d2-0f65-4769-b7e1-68800df503b5 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] [instance: 47f49c52-08b0-469c-8969-c9655c6ee39b] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:57:53.648193 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7afe15d2-0f65-4769-b7e1-68800df503b5 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:53.648964 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7afe15d2-0f65-4769-b7e1-68800df503b5 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:53.649582 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7afe15d2-0f65-4769-b7e1-68800df503b5 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:53.650408 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7afe15d2-0f65-4769-b7e1-68800df503b5 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:53.650925 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7afe15d2-0f65-4769-b7e1-68800df503b5 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:53.651355 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7afe15d2-0f65-4769-b7e1-68800df503b5 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:54.300783 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-7afe15d2-0f65-4769-b7e1-68800df503b5 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632904331d024d9b8e4d3660dff2cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ed0bdee3aa4013bd9219069bda558c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:54.309571 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-7afe15d2-0f65-4769-b7e1-68800df503b5 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] 10.222.0.58 "GET /compute/v2.1/servers/47f49c52-08b0-469c-8969-c9655c6ee39b" status: 200 len: 1310 microversion: 2.1 time: 0.696528 Aug 10 22:57:54.310452 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 300/576] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:57:53 2022] GET /compute/v2.1/servers/47f49c52-08b0-469c-8969-c9655c6ee39b => generated 1310 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:57:54.315216 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-baea3b3c-fb1b-4a83-b9e0-86ed74b79fe8 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:54.321703 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-baea3b3c-fb1b-4a83-b9e0-86ed74b79fe8 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 3e467caf-9d1e-4dc0-830d-585aeabc1e5a] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:57:54.340554 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-baea3b3c-fb1b-4a83-b9e0-86ed74b79fe8 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:54.341052 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-baea3b3c-fb1b-4a83-b9e0-86ed74b79fe8 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:54.341725 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-baea3b3c-fb1b-4a83-b9e0-86ed74b79fe8 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:54.344043 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-baea3b3c-fb1b-4a83-b9e0-86ed74b79fe8 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:54.344690 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-baea3b3c-fb1b-4a83-b9e0-86ed74b79fe8 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:54.346598 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-baea3b3c-fb1b-4a83-b9e0-86ed74b79fe8 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:54.573862 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-2227a72f-306a-4de4-88ba-75526ba0c004 tempest-FloatingIPsTestJSON-646876676 tempest-FloatingIPsTestJSON-646876676-project] 10.222.0.58 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 4.248949 Aug 10 22:57:54.575408 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 277/577] 10.222.0.58 () {60 vars in 1170 bytes} [Wed Aug 10 22:57:50 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 4251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 22:57:54.580753 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-14293ab3-28e2-46c9-bb80-3bd0c6f62d3a tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:54.583264 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-14293ab3-28e2-46c9-bb80-3bd0c6f62d3a tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] [instance: 7599a318-7a19-4f4a-bbb6-162f7a207060] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:57:54.601907 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-14293ab3-28e2-46c9-bb80-3bd0c6f62d3a tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:54.604238 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-14293ab3-28e2-46c9-bb80-3bd0c6f62d3a tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:54.604889 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-14293ab3-28e2-46c9-bb80-3bd0c6f62d3a tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:54.606888 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-14293ab3-28e2-46c9-bb80-3bd0c6f62d3a tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:54.608076 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-14293ab3-28e2-46c9-bb80-3bd0c6f62d3a tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:54.610050 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-14293ab3-28e2-46c9-bb80-3bd0c6f62d3a tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:54.624255 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-baea3b3c-fb1b-4a83-b9e0-86ed74b79fe8 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:54.636574 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-baea3b3c-fb1b-4a83-b9e0-86ed74b79fe8 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/3e467caf-9d1e-4dc0-830d-585aeabc1e5a" status: 200 len: 1313 microversion: 2.1 time: 0.324857 Aug 10 22:57:54.639573 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 301/578] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:57:54 2022] GET /compute/v2.1/servers/3e467caf-9d1e-4dc0-830d-585aeabc1e5a => generated 1313 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:57:54.663035 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-852e54b1-36f3-41dd-92f3-cba5a16fae72 req-1bf0bdc1-1996-45a2-a7df-5efd66e3afd6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e467caf-9d1e-4dc0-830d-585aeabc1e5a", "tag": "4039e5dc-d9c0-4105-991d-a67f51743ea9"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:57:54.673709 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-852e54b1-36f3-41dd-92f3-cba5a16fae72 req-1bf0bdc1-1996-45a2-a7df-5efd66e3afd6 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:54.676418 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-852e54b1-36f3-41dd-92f3-cba5a16fae72 req-1bf0bdc1-1996-45a2-a7df-5efd66e3afd6 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:54.677537 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-852e54b1-36f3-41dd-92f3-cba5a16fae72 req-1bf0bdc1-1996-45a2-a7df-5efd66e3afd6 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:54.695282 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-852e54b1-36f3-41dd-92f3-cba5a16fae72 req-1bf0bdc1-1996-45a2-a7df-5efd66e3afd6 service nova] Creating event network-changed:4039e5dc-d9c0-4105-991d-a67f51743ea9 for instance 3e467caf-9d1e-4dc0-830d-585aeabc1e5a on n-h1-850468-14 Aug 10 22:57:54.703806 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-852e54b1-36f3-41dd-92f3-cba5a16fae72 req-1bf0bdc1-1996-45a2-a7df-5efd66e3afd6 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063087 Aug 10 22:57:54.705070 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 302/579] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 22:57:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:57:54.711002 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-5b4a141b-e5be-4831-95ee-d729e026993d tempest-FloatingIPsTestJSON-646876676 tempest-FloatingIPsTestJSON-646876676-project] Calling method '.version_select at 0x7f847d6aca60>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:54.844522 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-14293ab3-28e2-46c9-bb80-3bd0c6f62d3a tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0415b5bdb48249d6b9f1ef7c92aad597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29083d61c29b43b4b47539a141b3d1fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:54.868002 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-14293ab3-28e2-46c9-bb80-3bd0c6f62d3a tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] 10.222.0.58 "GET /compute/v2.1/servers/7599a318-7a19-4f4a-bbb6-162f7a207060" status: 200 len: 1297 microversion: 2.1 time: 0.290832 Aug 10 22:57:54.869887 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 278/580] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:57:54 2022] GET /compute/v2.1/servers/7599a318-7a19-4f4a-bbb6-162f7a207060 => generated 1297 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:57:54.882196 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-4c51beba-02d6-480d-b78a-12e3cb23403d tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:54.887294 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-4c51beba-02d6-480d-b78a-12e3cb23403d tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] [instance: eaea4cc7-b1b8-43a7-83a4-8cfc8a44f9c1] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:57:54.897356 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4c51beba-02d6-480d-b78a-12e3cb23403d tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:54.897953 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4c51beba-02d6-480d-b78a-12e3cb23403d tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:54.899275 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4c51beba-02d6-480d-b78a-12e3cb23403d tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:54.900386 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4c51beba-02d6-480d-b78a-12e3cb23403d tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:54.901584 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4c51beba-02d6-480d-b78a-12e3cb23403d tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:54.902086 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4c51beba-02d6-480d-b78a-12e3cb23403d tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:55.046045 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-5b4a141b-e5be-4831-95ee-d729e026993d tempest-FloatingIPsTestJSON-646876676 tempest-FloatingIPsTestJSON-646876676-project] 10.222.0.58 "GET /compute/v2.1/os-floating-ips/bc5b6686-ca11-4ccf-b493-2d8eb87017db" status: 200 len: 141 microversion: 2.1 time: 0.339305 Aug 10 22:57:55.047262 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 303/581] 10.222.0.58 () {58 vars in 1260 bytes} [Wed Aug 10 22:57:54 2022] GET /compute/v2.1/os-floating-ips/bc5b6686-ca11-4ccf-b493-2d8eb87017db => generated 141 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:57:55.061724 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-6ba99ed5-73c4-4aa0-9765-7c1c904e4c73 tempest-FloatingIPsTestJSON-646876676 tempest-FloatingIPsTestJSON-646876676-project] Calling method '.version_select at 0x7f847d74e3a0>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:55.336314 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-6ba99ed5-73c4-4aa0-9765-7c1c904e4c73 tempest-FloatingIPsTestJSON-646876676 tempest-FloatingIPsTestJSON-646876676-project] 10.222.0.58 "GET /compute/v2.1/os-floating-ips" status: 200 len: 144 microversion: 2.1 time: 0.281286 Aug 10 22:57:55.344666 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 304/582] 10.222.0.58 () {58 vars in 1149 bytes} [Wed Aug 10 22:57:55 2022] GET /compute/v2.1/os-floating-ips => generated 144 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 22:57:55.351255 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-5368a6b5-3c12-427c-b0ca-fa13de693bc3 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:55.352421 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-5368a6b5-3c12-427c-b0ca-fa13de693bc3 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] [instance: 47f49c52-08b0-469c-8969-c9655c6ee39b] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:57:55.362293 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5368a6b5-3c12-427c-b0ca-fa13de693bc3 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:55.364513 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5368a6b5-3c12-427c-b0ca-fa13de693bc3 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:55.365700 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5368a6b5-3c12-427c-b0ca-fa13de693bc3 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:55.366871 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5368a6b5-3c12-427c-b0ca-fa13de693bc3 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:55.367562 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5368a6b5-3c12-427c-b0ca-fa13de693bc3 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:55.368160 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5368a6b5-3c12-427c-b0ca-fa13de693bc3 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:55.435646 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-4c51beba-02d6-480d-b78a-12e3cb23403d tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:55.452773 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-4c51beba-02d6-480d-b78a-12e3cb23403d tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:55.454723 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-4c51beba-02d6-480d-b78a-12e3cb23403d tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:55.456238 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-4c51beba-02d6-480d-b78a-12e3cb23403d tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] 10.222.0.58 "GET /compute/v2.1/servers/eaea4cc7-b1b8-43a7-83a4-8cfc8a44f9c1" status: 200 len: 1361 microversion: 2.25 time: 0.585154 Aug 10 22:57:55.457009 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 279/583] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 22:57:54 2022] GET /compute/v2.1/servers/eaea4cc7-b1b8-43a7-83a4-8cfc8a44f9c1 => generated 1361 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:57:55.468633 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-2f335e95-d6d0-450d-a50d-efa8603876d0 tempest-FloatingIPsTestJSON-646876676 tempest-FloatingIPsTestJSON-646876676-project] Calling method '.version_select at 0x7f847d757310>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:55.583341 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-5368a6b5-3c12-427c-b0ca-fa13de693bc3 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632904331d024d9b8e4d3660dff2cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ed0bdee3aa4013bd9219069bda558c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:55.596214 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-5368a6b5-3c12-427c-b0ca-fa13de693bc3 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] 10.222.0.58 "GET /compute/v2.1/servers/47f49c52-08b0-469c-8969-c9655c6ee39b" status: 200 len: 1310 microversion: 2.1 time: 0.249361 Aug 10 22:57:55.597780 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 305/584] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:57:55 2022] GET /compute/v2.1/servers/47f49c52-08b0-469c-8969-c9655c6ee39b => generated 1310 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:57:55.661448 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-6d011e89-18c6-4149-90bb-a192da7b2287 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:55.662594 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-6d011e89-18c6-4149-90bb-a192da7b2287 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 3e467caf-9d1e-4dc0-830d-585aeabc1e5a] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:57:55.669389 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6d011e89-18c6-4149-90bb-a192da7b2287 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:55.670351 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6d011e89-18c6-4149-90bb-a192da7b2287 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:55.670989 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6d011e89-18c6-4149-90bb-a192da7b2287 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:55.671835 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6d011e89-18c6-4149-90bb-a192da7b2287 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:55.672316 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6d011e89-18c6-4149-90bb-a192da7b2287 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:55.672735 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6d011e89-18c6-4149-90bb-a192da7b2287 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:55.920329 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-6d011e89-18c6-4149-90bb-a192da7b2287 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:55.929016 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-6d011e89-18c6-4149-90bb-a192da7b2287 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/3e467caf-9d1e-4dc0-830d-585aeabc1e5a" status: 200 len: 1313 microversion: 2.1 time: 0.272698 Aug 10 22:57:55.939558 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 306/585] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:57:55 2022] GET /compute/v2.1/servers/3e467caf-9d1e-4dc0-830d-585aeabc1e5a => generated 1313 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:57:55.943390 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-b4437d68-2ddd-49a3-92ec-b9d6fffd863a tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:55.944012 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-b4437d68-2ddd-49a3-92ec-b9d6fffd863a tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] [instance: 7599a318-7a19-4f4a-bbb6-162f7a207060] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:57:55.950338 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b4437d68-2ddd-49a3-92ec-b9d6fffd863a tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:55.950845 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b4437d68-2ddd-49a3-92ec-b9d6fffd863a tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:55.951308 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b4437d68-2ddd-49a3-92ec-b9d6fffd863a tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:55.952055 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b4437d68-2ddd-49a3-92ec-b9d6fffd863a tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:55.952534 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b4437d68-2ddd-49a3-92ec-b9d6fffd863a tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:55.952980 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b4437d68-2ddd-49a3-92ec-b9d6fffd863a tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:56.058513 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-b4437d68-2ddd-49a3-92ec-b9d6fffd863a tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0415b5bdb48249d6b9f1ef7c92aad597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29083d61c29b43b4b47539a141b3d1fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:56.067725 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-b4437d68-2ddd-49a3-92ec-b9d6fffd863a tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] 10.222.0.58 "GET /compute/v2.1/servers/7599a318-7a19-4f4a-bbb6-162f7a207060" status: 200 len: 1303 microversion: 2.1 time: 0.129715 Aug 10 22:57:56.070380 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 307/586] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:57:55 2022] GET /compute/v2.1/servers/7599a318-7a19-4f4a-bbb6-162f7a207060 => generated 1303 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:57:56.483045 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-418211ac-581f-4080-93a4-ffd12d16f5e6 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:56.484660 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-418211ac-581f-4080-93a4-ffd12d16f5e6 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] [instance: eaea4cc7-b1b8-43a7-83a4-8cfc8a44f9c1] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:57:56.500167 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-418211ac-581f-4080-93a4-ffd12d16f5e6 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:56.502226 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-418211ac-581f-4080-93a4-ffd12d16f5e6 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:56.504147 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-418211ac-581f-4080-93a4-ffd12d16f5e6 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:56.507012 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-418211ac-581f-4080-93a4-ffd12d16f5e6 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:56.508730 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-418211ac-581f-4080-93a4-ffd12d16f5e6 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:56.510026 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-418211ac-581f-4080-93a4-ffd12d16f5e6 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:56.837328 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-418211ac-581f-4080-93a4-ffd12d16f5e6 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:56.866598 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-418211ac-581f-4080-93a4-ffd12d16f5e6 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:56.868227 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-418211ac-581f-4080-93a4-ffd12d16f5e6 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:56.869424 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-418211ac-581f-4080-93a4-ffd12d16f5e6 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] 10.222.0.58 "GET /compute/v2.1/servers/eaea4cc7-b1b8-43a7-83a4-8cfc8a44f9c1" status: 200 len: 1557 microversion: 2.25 time: 0.391432 Aug 10 22:57:56.870319 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 308/587] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 22:57:56 2022] GET /compute/v2.1/servers/eaea4cc7-b1b8-43a7-83a4-8cfc8a44f9c1 => generated 1557 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:57:56.874946 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-61510170-94e3-4a15-a9c2-e653d1761207 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:56.875741 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-61510170-94e3-4a15-a9c2-e653d1761207 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] [instance: 47f49c52-08b0-469c-8969-c9655c6ee39b] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:57:56.891027 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-61510170-94e3-4a15-a9c2-e653d1761207 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:56.891751 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-61510170-94e3-4a15-a9c2-e653d1761207 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:56.892343 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-61510170-94e3-4a15-a9c2-e653d1761207 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:56.893212 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-61510170-94e3-4a15-a9c2-e653d1761207 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:56.893810 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-61510170-94e3-4a15-a9c2-e653d1761207 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:56.895781 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-61510170-94e3-4a15-a9c2-e653d1761207 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:57.073289 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-61510170-94e3-4a15-a9c2-e653d1761207 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632904331d024d9b8e4d3660dff2cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ed0bdee3aa4013bd9219069bda558c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:57.085402 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-61510170-94e3-4a15-a9c2-e653d1761207 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] 10.222.0.58 "GET /compute/v2.1/servers/47f49c52-08b0-469c-8969-c9655c6ee39b" status: 200 len: 1310 microversion: 2.1 time: 0.213436 Aug 10 22:57:57.094804 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 309/588] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:57:56 2022] GET /compute/v2.1/servers/47f49c52-08b0-469c-8969-c9655c6ee39b => generated 1310 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:57:57.157433 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-db10e73d-7846-4db2-907d-b48f92222d2f tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:57.158346 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-db10e73d-7846-4db2-907d-b48f92222d2f tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] [instance: eaea4cc7-b1b8-43a7-83a4-8cfc8a44f9c1] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:57:57.166984 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-db10e73d-7846-4db2-907d-b48f92222d2f tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:57.167758 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-db10e73d-7846-4db2-907d-b48f92222d2f tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:57.168613 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-db10e73d-7846-4db2-907d-b48f92222d2f tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:57.169558 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-db10e73d-7846-4db2-907d-b48f92222d2f tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:57.170384 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-db10e73d-7846-4db2-907d-b48f92222d2f tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:57.171135 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-db10e73d-7846-4db2-907d-b48f92222d2f tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:57.367864 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.objects.instance [None req-db10e73d-7846-4db2-907d-b48f92222d2f tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Lazy-loading 'services' on Instance uuid eaea4cc7-b1b8-43a7-83a4-8cfc8a44f9c1 {{(pid=122633) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 22:57:57.393731 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-db10e73d-7846-4db2-907d-b48f92222d2f tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/eaea4cc7-b1b8-43a7-83a4-8cfc8a44f9c1" status: 200 len: 2051 microversion: 2.25 time: 0.296223 Aug 10 22:57:57.409550 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 310/589] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 22:57:57 2022] GET /compute/v2.1/servers/eaea4cc7-b1b8-43a7-83a4-8cfc8a44f9c1 => generated 2051 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:57:57.429369 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-511c4a4e-b5d0-4e43-a615-2fd3e20432e6 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:57.430358 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-511c4a4e-b5d0-4e43-a615-2fd3e20432e6 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 3e467caf-9d1e-4dc0-830d-585aeabc1e5a] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:57:57.453897 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-511c4a4e-b5d0-4e43-a615-2fd3e20432e6 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:57.454695 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-511c4a4e-b5d0-4e43-a615-2fd3e20432e6 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:57.455348 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-511c4a4e-b5d0-4e43-a615-2fd3e20432e6 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:57.456068 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-511c4a4e-b5d0-4e43-a615-2fd3e20432e6 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:57.457495 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-511c4a4e-b5d0-4e43-a615-2fd3e20432e6 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:57.458313 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-511c4a4e-b5d0-4e43-a615-2fd3e20432e6 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:57.735905 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-511c4a4e-b5d0-4e43-a615-2fd3e20432e6 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:57.755934 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-511c4a4e-b5d0-4e43-a615-2fd3e20432e6 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/3e467caf-9d1e-4dc0-830d-585aeabc1e5a" status: 200 len: 1313 microversion: 2.1 time: 0.338410 Aug 10 22:57:57.759254 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 311/590] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:57:57 2022] GET /compute/v2.1/servers/3e467caf-9d1e-4dc0-830d-585aeabc1e5a => generated 1313 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:57:57.776158 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-4af46668-6d3f-4e7d-a0c0-6ea76228fecb tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:57.779410 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-4af46668-6d3f-4e7d-a0c0-6ea76228fecb tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] [instance: 7599a318-7a19-4f4a-bbb6-162f7a207060] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:57:57.794148 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4af46668-6d3f-4e7d-a0c0-6ea76228fecb tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:57.794599 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4af46668-6d3f-4e7d-a0c0-6ea76228fecb tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:57.795058 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4af46668-6d3f-4e7d-a0c0-6ea76228fecb tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:57.795754 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4af46668-6d3f-4e7d-a0c0-6ea76228fecb tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:57.796194 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4af46668-6d3f-4e7d-a0c0-6ea76228fecb tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:57.796607 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4af46668-6d3f-4e7d-a0c0-6ea76228fecb tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:57.820379 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=8 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:57:57.926166 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-4af46668-6d3f-4e7d-a0c0-6ea76228fecb tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0415b5bdb48249d6b9f1ef7c92aad597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29083d61c29b43b4b47539a141b3d1fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:57.934041 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-4af46668-6d3f-4e7d-a0c0-6ea76228fecb tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] 10.222.0.58 "GET /compute/v2.1/servers/7599a318-7a19-4f4a-bbb6-162f7a207060" status: 200 len: 1303 microversion: 2.1 time: 0.173504 Aug 10 22:57:57.951214 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 312/591] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:57:57 2022] GET /compute/v2.1/servers/7599a318-7a19-4f4a-bbb6-162f7a207060 => generated 1303 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:57:57.961532 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-728fdcd9-90f2-4fe2-9bd5-adedba40ff39 req-b6bc67ac-1026-47b7-b9f6-b6444d1c8215 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47f49c52-08b0-469c-8969-c9655c6ee39b", "tag": "18b62a0a-3eba-4608-9dea-969a87874984"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:57:57.994217 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-728fdcd9-90f2-4fe2-9bd5-adedba40ff39 req-b6bc67ac-1026-47b7-b9f6-b6444d1c8215 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:57.996599 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-728fdcd9-90f2-4fe2-9bd5-adedba40ff39 req-b6bc67ac-1026-47b7-b9f6-b6444d1c8215 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:57.998425 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-728fdcd9-90f2-4fe2-9bd5-adedba40ff39 req-b6bc67ac-1026-47b7-b9f6-b6444d1c8215 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:58.027536 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-728fdcd9-90f2-4fe2-9bd5-adedba40ff39 req-b6bc67ac-1026-47b7-b9f6-b6444d1c8215 service nova] Creating event network-changed:18b62a0a-3eba-4608-9dea-969a87874984 for instance 47f49c52-08b0-469c-8969-c9655c6ee39b on n-h2-850468-14 Aug 10 22:57:58.048765 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-728fdcd9-90f2-4fe2-9bd5-adedba40ff39 req-b6bc67ac-1026-47b7-b9f6-b6444d1c8215 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096001 Aug 10 22:57:58.049659 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 313/592] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 22:57:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:57:58.060124 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-44b61761-e20d-4434-be31-59e5f0110031 tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:58.065557 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-44b61761-e20d-4434-be31-59e5f0110031 tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] [instance: eaea4cc7-b1b8-43a7-83a4-8cfc8a44f9c1] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:57:58.077258 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-44b61761-e20d-4434-be31-59e5f0110031 tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:58.078002 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-44b61761-e20d-4434-be31-59e5f0110031 tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:58.078638 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-44b61761-e20d-4434-be31-59e5f0110031 tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:58.079581 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-44b61761-e20d-4434-be31-59e5f0110031 tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:58.080224 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-44b61761-e20d-4434-be31-59e5f0110031 tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:58.080834 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-44b61761-e20d-4434-be31-59e5f0110031 tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:58.459418 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=20 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:57:58.759877 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.objects.instance [None req-44b61761-e20d-4434-be31-59e5f0110031 tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Lazy-loading 'services' on Instance uuid eaea4cc7-b1b8-43a7-83a4-8cfc8a44f9c1 {{(pid=122633) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 22:57:58.770949 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=100 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:57:58.816757 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-44b61761-e20d-4434-be31-59e5f0110031 tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/eaea4cc7-b1b8-43a7-83a4-8cfc8a44f9c1" status: 200 len: 2051 microversion: 2.25 time: 0.763566 Aug 10 22:57:58.820702 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 314/593] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 22:57:58 2022] GET /compute/v2.1/servers/eaea4cc7-b1b8-43a7-83a4-8cfc8a44f9c1 => generated 2051 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:57:58.834185 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-3c653537-e5d1-49e4-8232-e5989c6c0fb1 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:58.835349 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-3c653537-e5d1-49e4-8232-e5989c6c0fb1 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] [instance: 47f49c52-08b0-469c-8969-c9655c6ee39b] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:57:58.851296 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3c653537-e5d1-49e4-8232-e5989c6c0fb1 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:58.853002 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3c653537-e5d1-49e4-8232-e5989c6c0fb1 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:58.854269 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3c653537-e5d1-49e4-8232-e5989c6c0fb1 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:58.856611 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3c653537-e5d1-49e4-8232-e5989c6c0fb1 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:58.858478 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3c653537-e5d1-49e4-8232-e5989c6c0fb1 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:58.859602 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3c653537-e5d1-49e4-8232-e5989c6c0fb1 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:58.867626 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-2f335e95-d6d0-450d-a50d-efa8603876d0 tempest-FloatingIPsTestJSON-646876676 tempest-FloatingIPsTestJSON-646876676-project] 10.222.0.58 "DELETE /compute/v2.1/os-floating-ips/bc5b6686-ca11-4ccf-b493-2d8eb87017db" status: 202 len: 0 microversion: 2.1 time: 3.408997 Aug 10 22:57:58.868811 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 280/594] 10.222.0.58 () {58 vars in 1263 bytes} [Wed Aug 10 22:57:55 2022] DELETE /compute/v2.1/os-floating-ips/bc5b6686-ca11-4ccf-b493-2d8eb87017db => generated 0 bytes in 3411 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 22:57:58.877714 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-00da6c4d-4d54-40d8-8def-e1d9a43d008f tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:58.880448 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-00da6c4d-4d54-40d8-8def-e1d9a43d008f tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 3e467caf-9d1e-4dc0-830d-585aeabc1e5a] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:57:58.902766 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-00da6c4d-4d54-40d8-8def-e1d9a43d008f tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:58.903613 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-00da6c4d-4d54-40d8-8def-e1d9a43d008f tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:58.905892 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-00da6c4d-4d54-40d8-8def-e1d9a43d008f tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:58.908696 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-00da6c4d-4d54-40d8-8def-e1d9a43d008f tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:58.914203 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-00da6c4d-4d54-40d8-8def-e1d9a43d008f tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:58.915161 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-00da6c4d-4d54-40d8-8def-e1d9a43d008f tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:59.488799 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-00da6c4d-4d54-40d8-8def-e1d9a43d008f tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:57:59.503268 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-00da6c4d-4d54-40d8-8def-e1d9a43d008f tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/3e467caf-9d1e-4dc0-830d-585aeabc1e5a" status: 200 len: 1313 microversion: 2.1 time: 0.633068 Aug 10 22:57:59.505513 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 281/595] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:57:58 2022] GET /compute/v2.1/servers/3e467caf-9d1e-4dc0-830d-585aeabc1e5a => generated 1313 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:57:59.510224 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-a78fc553-6a6d-4644-af83-8e398d7b039e tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:57:59.515595 n-d-850468-14 devstack@n-api.service[122632]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:57:59.515595 n-d-850468-14 devstack@n-api.service[122632]: warnings.warn(msg) Aug 10 22:57:59.526589 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a78fc553-6a6d-4644-af83-8e398d7b039e tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:59.527385 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a78fc553-6a6d-4644-af83-8e398d7b039e tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:59.534465 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a78fc553-6a6d-4644-af83-8e398d7b039e tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:59.536497 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a78fc553-6a6d-4644-af83-8e398d7b039e tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:57:59.537190 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a78fc553-6a6d-4644-af83-8e398d7b039e tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:57:59.537853 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a78fc553-6a6d-4644-af83-8e398d7b039e tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:57:59.605602 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-a78fc553-6a6d-4644-af83-8e398d7b039e tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] 10.222.0.58 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.098813 Aug 10 22:57:59.614233 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 282/596] 10.222.0.58 () {60 vars in 1217 bytes} [Wed Aug 10 22:57:59 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 22:57:59.625509 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-bbf9a24b-3224-4410-985f-836e84906883 tempest-FloatingIPsTestJSON-646876676 tempest-FloatingIPsTestJSON-646876676-project] Action: 'create', calling method: .version_select at 0x7f847d98c5e0>, body: {"pool": null} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:58:00.073654 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-3c653537-e5d1-49e4-8232-e5989c6c0fb1 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632904331d024d9b8e4d3660dff2cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ed0bdee3aa4013bd9219069bda558c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:00.098696 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-3c653537-e5d1-49e4-8232-e5989c6c0fb1 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] 10.222.0.58 "GET /compute/v2.1/servers/47f49c52-08b0-469c-8969-c9655c6ee39b" status: 200 len: 1310 microversion: 2.1 time: 1.270814 Aug 10 22:58:00.099397 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 315/597] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:57:58 2022] GET /compute/v2.1/servers/47f49c52-08b0-469c-8969-c9655c6ee39b => generated 1310 bytes in 1278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:58:00.104540 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-ca091d40-14ba-4b10-bc75-d06c63f9d7c2 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:00.105152 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-ca091d40-14ba-4b10-bc75-d06c63f9d7c2 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] [instance: 7599a318-7a19-4f4a-bbb6-162f7a207060] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:00.122382 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ca091d40-14ba-4b10-bc75-d06c63f9d7c2 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:00.128225 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ca091d40-14ba-4b10-bc75-d06c63f9d7c2 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:00.129433 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ca091d40-14ba-4b10-bc75-d06c63f9d7c2 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:00.130193 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ca091d40-14ba-4b10-bc75-d06c63f9d7c2 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:00.130663 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ca091d40-14ba-4b10-bc75-d06c63f9d7c2 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:00.131117 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ca091d40-14ba-4b10-bc75-d06c63f9d7c2 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:00.439626 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-ca091d40-14ba-4b10-bc75-d06c63f9d7c2 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0415b5bdb48249d6b9f1ef7c92aad597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29083d61c29b43b4b47539a141b3d1fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:00.467982 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-ca091d40-14ba-4b10-bc75-d06c63f9d7c2 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] 10.222.0.58 "GET /compute/v2.1/servers/7599a318-7a19-4f4a-bbb6-162f7a207060" status: 200 len: 1371 microversion: 2.1 time: 0.367148 Aug 10 22:58:00.468648 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 316/598] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:58:00 2022] GET /compute/v2.1/servers/7599a318-7a19-4f4a-bbb6-162f7a207060 => generated 1371 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:58:00.493723 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-e36b8983-544d-487b-b791-13845b9731cf tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:58:00.494530 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-e36b8983-544d-487b-b791-13845b9731cf tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] [instance: eaea4cc7-b1b8-43a7-83a4-8cfc8a44f9c1] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:00.503012 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e36b8983-544d-487b-b791-13845b9731cf tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:00.503970 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e36b8983-544d-487b-b791-13845b9731cf tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:00.504753 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e36b8983-544d-487b-b791-13845b9731cf tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:00.507991 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e36b8983-544d-487b-b791-13845b9731cf tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:00.511349 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e36b8983-544d-487b-b791-13845b9731cf tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:00.512005 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e36b8983-544d-487b-b791-13845b9731cf tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:00.656359 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-e36b8983-544d-487b-b791-13845b9731cf tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/eaea4cc7-b1b8-43a7-83a4-8cfc8a44f9c1/action" status: 202 len: 0 microversion: 2.25 time: 0.170134 Aug 10 22:58:00.659498 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 317/599] 10.222.0.58 () {62 vars in 1319 bytes} [Wed Aug 10 22:58:00 2022] POST /compute/v2.1/servers/eaea4cc7-b1b8-43a7-83a4-8cfc8a44f9c1/action => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 10 22:58:00.681074 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-207198e1-6f91-4118-9df1-011f4cb83f5b tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:00.686028 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-207198e1-6f91-4118-9df1-011f4cb83f5b tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 3e467caf-9d1e-4dc0-830d-585aeabc1e5a] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:00.695332 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-207198e1-6f91-4118-9df1-011f4cb83f5b tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:00.696167 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-207198e1-6f91-4118-9df1-011f4cb83f5b tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:00.696758 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-207198e1-6f91-4118-9df1-011f4cb83f5b tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:00.697643 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-207198e1-6f91-4118-9df1-011f4cb83f5b tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:00.698249 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-207198e1-6f91-4118-9df1-011f4cb83f5b tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:00.699162 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-207198e1-6f91-4118-9df1-011f4cb83f5b tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:01.257560 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-207198e1-6f91-4118-9df1-011f4cb83f5b tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:01.270022 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-207198e1-6f91-4118-9df1-011f4cb83f5b tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/3e467caf-9d1e-4dc0-830d-585aeabc1e5a" status: 200 len: 1313 microversion: 2.1 time: 0.607005 Aug 10 22:58:01.291404 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 318/600] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:58:00 2022] GET /compute/v2.1/servers/3e467caf-9d1e-4dc0-830d-585aeabc1e5a => generated 1313 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:58:01.295093 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-50cf52e4-5027-442c-8d0c-b4dc658bcc6c tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:01.296097 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-50cf52e4-5027-442c-8d0c-b4dc658bcc6c tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] [instance: eaea4cc7-b1b8-43a7-83a4-8cfc8a44f9c1] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:01.305728 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-50cf52e4-5027-442c-8d0c-b4dc658bcc6c tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:01.307403 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-50cf52e4-5027-442c-8d0c-b4dc658bcc6c tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:01.311534 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-50cf52e4-5027-442c-8d0c-b4dc658bcc6c tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:01.312666 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-50cf52e4-5027-442c-8d0c-b4dc658bcc6c tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:01.314756 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-50cf52e4-5027-442c-8d0c-b4dc658bcc6c tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:01.315508 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-50cf52e4-5027-442c-8d0c-b4dc658bcc6c tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:02.615043 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.objects.instance [None req-50cf52e4-5027-442c-8d0c-b4dc658bcc6c tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Lazy-loading 'services' on Instance uuid eaea4cc7-b1b8-43a7-83a4-8cfc8a44f9c1 {{(pid=122633) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 22:58:02.647101 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-50cf52e4-5027-442c-8d0c-b4dc658bcc6c tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/eaea4cc7-b1b8-43a7-83a4-8cfc8a44f9c1" status: 200 len: 2036 microversion: 2.25 time: 1.367921 Aug 10 22:58:02.655660 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 319/601] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 22:58:01 2022] GET /compute/v2.1/servers/eaea4cc7-b1b8-43a7-83a4-8cfc8a44f9c1 => generated 2036 bytes in 1377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:58:02.681854 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-991e66c5-0488-4a4a-8252-aa844ba90204 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:02.682874 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-991e66c5-0488-4a4a-8252-aa844ba90204 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] [instance: 47f49c52-08b0-469c-8969-c9655c6ee39b] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:02.706254 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-991e66c5-0488-4a4a-8252-aa844ba90204 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:02.709165 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-991e66c5-0488-4a4a-8252-aa844ba90204 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:02.710523 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-991e66c5-0488-4a4a-8252-aa844ba90204 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:02.715789 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-991e66c5-0488-4a4a-8252-aa844ba90204 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:02.717684 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-991e66c5-0488-4a4a-8252-aa844ba90204 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:02.718316 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-991e66c5-0488-4a4a-8252-aa844ba90204 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:03.002875 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=8 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:58:03.051549 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=18 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:58:03.501942 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-991e66c5-0488-4a4a-8252-aa844ba90204 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632904331d024d9b8e4d3660dff2cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ed0bdee3aa4013bd9219069bda558c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:03.514876 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-991e66c5-0488-4a4a-8252-aa844ba90204 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] 10.222.0.58 "GET /compute/v2.1/servers/47f49c52-08b0-469c-8969-c9655c6ee39b" status: 200 len: 1310 microversion: 2.1 time: 0.856378 Aug 10 22:58:03.515457 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 320/602] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:58:02 2022] GET /compute/v2.1/servers/47f49c52-08b0-469c-8969-c9655c6ee39b => generated 1310 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:58:03.538295 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-1bf07c3f-2e44-444e-8ad1-92ba5c30f329 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:03.541789 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-1bf07c3f-2e44-444e-8ad1-92ba5c30f329 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] [instance: 7599a318-7a19-4f4a-bbb6-162f7a207060] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:03.554869 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1bf07c3f-2e44-444e-8ad1-92ba5c30f329 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:03.560760 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1bf07c3f-2e44-444e-8ad1-92ba5c30f329 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:03.561422 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1bf07c3f-2e44-444e-8ad1-92ba5c30f329 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:03.562327 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1bf07c3f-2e44-444e-8ad1-92ba5c30f329 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:03.562982 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1bf07c3f-2e44-444e-8ad1-92ba5c30f329 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:03.563551 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1bf07c3f-2e44-444e-8ad1-92ba5c30f329 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:04.083853 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-1bf07c3f-2e44-444e-8ad1-92ba5c30f329 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0415b5bdb48249d6b9f1ef7c92aad597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29083d61c29b43b4b47539a141b3d1fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:04.099067 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-1bf07c3f-2e44-444e-8ad1-92ba5c30f329 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] 10.222.0.58 "GET /compute/v2.1/servers/7599a318-7a19-4f4a-bbb6-162f7a207060" status: 200 len: 1371 microversion: 2.1 time: 0.572757 Aug 10 22:58:04.100511 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 321/603] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:58:03 2022] GET /compute/v2.1/servers/7599a318-7a19-4f4a-bbb6-162f7a207060 => generated 1371 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:58:04.116663 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-6d466a56-1cff-42d0-951b-4a9e9edae7b0 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:04.117576 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-6d466a56-1cff-42d0-951b-4a9e9edae7b0 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 3e467caf-9d1e-4dc0-830d-585aeabc1e5a] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:04.134287 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6d466a56-1cff-42d0-951b-4a9e9edae7b0 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:04.136445 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6d466a56-1cff-42d0-951b-4a9e9edae7b0 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:04.143525 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6d466a56-1cff-42d0-951b-4a9e9edae7b0 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:04.145220 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6d466a56-1cff-42d0-951b-4a9e9edae7b0 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:04.149788 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6d466a56-1cff-42d0-951b-4a9e9edae7b0 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:04.150678 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6d466a56-1cff-42d0-951b-4a9e9edae7b0 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:04.688734 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-6d466a56-1cff-42d0-951b-4a9e9edae7b0 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:04.703292 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-6d466a56-1cff-42d0-951b-4a9e9edae7b0 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/3e467caf-9d1e-4dc0-830d-585aeabc1e5a" status: 200 len: 1313 microversion: 2.1 time: 0.598807 Aug 10 22:58:04.718241 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 322/604] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:58:04 2022] GET /compute/v2.1/servers/3e467caf-9d1e-4dc0-830d-585aeabc1e5a => generated 1313 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:58:04.729889 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-ee70ea10-aac5-4c78-bec2-40abf5210e5d tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-850468-14", "block_migration": "auto"}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:58:04.743718 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-ee70ea10-aac5-4c78-bec2-40abf5210e5d tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] [instance: eaea4cc7-b1b8-43a7-83a4-8cfc8a44f9c1] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:04.756272 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ee70ea10-aac5-4c78-bec2-40abf5210e5d tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:04.761421 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ee70ea10-aac5-4c78-bec2-40abf5210e5d tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:04.762644 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ee70ea10-aac5-4c78-bec2-40abf5210e5d tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:04.763711 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ee70ea10-aac5-4c78-bec2-40abf5210e5d tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:04.764431 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ee70ea10-aac5-4c78-bec2-40abf5210e5d tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:04.767413 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ee70ea10-aac5-4c78-bec2-40abf5210e5d tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:04.820962 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.objects.instance [None req-ee70ea10-aac5-4c78-bec2-40abf5210e5d tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Lazy-loading 'flavor' on Instance uuid eaea4cc7-b1b8-43a7-83a4-8cfc8a44f9c1 {{(pid=122633) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 22:58:04.836288 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-ee70ea10-aac5-4c78-bec2-40abf5210e5d tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] [instance: eaea4cc7-b1b8-43a7-83a4-8cfc8a44f9c1] Going to try to live migrate instance to n-h2-850468-14 {{(pid=122633) live_migrate /opt/stack/nova/nova/compute/api.py:5443}} Aug 10 22:58:05.683549 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-bbf9a24b-3224-4410-985f-836e84906883 tempest-FloatingIPsTestJSON-646876676 tempest-FloatingIPsTestJSON-646876676-project] 10.222.0.58 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 6.067457 Aug 10 22:58:05.685007 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 283/605] 10.222.0.58 () {60 vars in 1170 bytes} [Wed Aug 10 22:57:59 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 6070 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:58:05.689948 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-d4b761f0-7ed9-4128-b349-1e2a6a566627 req-b5305396-345d-4841-95e4-fe4723a222d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7599a318-7a19-4f4a-bbb6-162f7a207060", "tag": "f22c5d16-4ab5-4e8c-987e-74d273711590"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:58:05.719927 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-d4b761f0-7ed9-4128-b349-1e2a6a566627 req-b5305396-345d-4841-95e4-fe4723a222d0 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:05.742304 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-d4b761f0-7ed9-4128-b349-1e2a6a566627 req-b5305396-345d-4841-95e4-fe4723a222d0 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:05.743222 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-d4b761f0-7ed9-4128-b349-1e2a6a566627 req-b5305396-345d-4841-95e4-fe4723a222d0 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:05.789855 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-d4b761f0-7ed9-4128-b349-1e2a6a566627 req-b5305396-345d-4841-95e4-fe4723a222d0 service nova] Creating event network-changed:f22c5d16-4ab5-4e8c-987e-74d273711590 for instance 7599a318-7a19-4f4a-bbb6-162f7a207060 on n-h1-850468-14 Aug 10 22:58:05.805146 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-d4b761f0-7ed9-4128-b349-1e2a6a566627 req-b5305396-345d-4841-95e4-fe4723a222d0 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118651 Aug 10 22:58:05.806241 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 284/606] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 22:58:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:58:05.820427 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-fea11a75-0378-44ef-adb9-cb89c89f7981 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:05.821360 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-fea11a75-0378-44ef-adb9-cb89c89f7981 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] [instance: 47f49c52-08b0-469c-8969-c9655c6ee39b] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:05.830039 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fea11a75-0378-44ef-adb9-cb89c89f7981 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:05.830806 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fea11a75-0378-44ef-adb9-cb89c89f7981 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:05.831480 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fea11a75-0378-44ef-adb9-cb89c89f7981 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:05.833376 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fea11a75-0378-44ef-adb9-cb89c89f7981 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:05.834336 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fea11a75-0378-44ef-adb9-cb89c89f7981 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:05.835069 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fea11a75-0378-44ef-adb9-cb89c89f7981 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:06.368304 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-fea11a75-0378-44ef-adb9-cb89c89f7981 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632904331d024d9b8e4d3660dff2cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ed0bdee3aa4013bd9219069bda558c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:06.384828 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-fea11a75-0378-44ef-adb9-cb89c89f7981 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] 10.222.0.58 "GET /compute/v2.1/servers/47f49c52-08b0-469c-8969-c9655c6ee39b" status: 200 len: 1310 microversion: 2.1 time: 0.569628 Aug 10 22:58:06.404886 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 285/607] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:58:05 2022] GET /compute/v2.1/servers/47f49c52-08b0-469c-8969-c9655c6ee39b => generated 1310 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:58:06.426214 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-a7fab874-3380-4bc7-9d0e-c22152fa97ea tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:06.428378 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-a7fab874-3380-4bc7-9d0e-c22152fa97ea tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] [instance: 7599a318-7a19-4f4a-bbb6-162f7a207060] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:06.452490 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a7fab874-3380-4bc7-9d0e-c22152fa97ea tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:06.454212 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a7fab874-3380-4bc7-9d0e-c22152fa97ea tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:06.456061 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a7fab874-3380-4bc7-9d0e-c22152fa97ea tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:06.459799 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a7fab874-3380-4bc7-9d0e-c22152fa97ea tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:06.460282 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a7fab874-3380-4bc7-9d0e-c22152fa97ea tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:06.460717 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a7fab874-3380-4bc7-9d0e-c22152fa97ea tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:07.292126 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-a7fab874-3380-4bc7-9d0e-c22152fa97ea tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0415b5bdb48249d6b9f1ef7c92aad597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29083d61c29b43b4b47539a141b3d1fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:07.294846 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=98 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:58:07.305068 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-a7fab874-3380-4bc7-9d0e-c22152fa97ea tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] 10.222.0.58 "GET /compute/v2.1/servers/7599a318-7a19-4f4a-bbb6-162f7a207060" status: 200 len: 1371 microversion: 2.1 time: 0.898830 Aug 10 22:58:07.311143 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 286/608] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:58:06 2022] GET /compute/v2.1/servers/7599a318-7a19-4f4a-bbb6-162f7a207060 => generated 1371 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:58:07.316762 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-cb523bf6-1d9e-4dcc-a57a-13fb0f1cb746 tempest-FloatingIPsTestJSON-646876676 tempest-FloatingIPsTestJSON-646876676-project] Calling method '.version_select at 0x7f847db349d0>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:07.905919 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-ee70ea10-aac5-4c78-bec2-40abf5210e5d tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/eaea4cc7-b1b8-43a7-83a4-8cfc8a44f9c1/action" status: 202 len: 0 microversion: 2.25 time: 3.181884 Aug 10 22:58:07.907670 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 323/609] 10.222.0.58 () {62 vars in 1319 bytes} [Wed Aug 10 22:58:04 2022] POST /compute/v2.1/servers/eaea4cc7-b1b8-43a7-83a4-8cfc8a44f9c1/action => generated 0 bytes in 3189 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 10 22:58:07.915732 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-8b44a46e-d5d7-40bf-8296-0c32a8712ef7 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:07.916346 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-8b44a46e-d5d7-40bf-8296-0c32a8712ef7 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 3e467caf-9d1e-4dc0-830d-585aeabc1e5a] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:07.960668 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8b44a46e-d5d7-40bf-8296-0c32a8712ef7 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:07.961556 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8b44a46e-d5d7-40bf-8296-0c32a8712ef7 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:07.962292 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8b44a46e-d5d7-40bf-8296-0c32a8712ef7 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:07.963433 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8b44a46e-d5d7-40bf-8296-0c32a8712ef7 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:07.965426 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8b44a46e-d5d7-40bf-8296-0c32a8712ef7 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:07.971721 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8b44a46e-d5d7-40bf-8296-0c32a8712ef7 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:08.937499 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-8b44a46e-d5d7-40bf-8296-0c32a8712ef7 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:08.955551 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-8b44a46e-d5d7-40bf-8296-0c32a8712ef7 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/3e467caf-9d1e-4dc0-830d-585aeabc1e5a" status: 200 len: 1313 microversion: 2.1 time: 1.039691 Aug 10 22:58:08.960811 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 324/610] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:58:07 2022] GET /compute/v2.1/servers/3e467caf-9d1e-4dc0-830d-585aeabc1e5a => generated 1313 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:58:08.975466 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-00e22f63-87be-46a1-9238-baf835b6a361 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:08.982172 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-00e22f63-87be-46a1-9238-baf835b6a361 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] [instance: 47f49c52-08b0-469c-8969-c9655c6ee39b] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:09.011674 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-00e22f63-87be-46a1-9238-baf835b6a361 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:09.013267 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-00e22f63-87be-46a1-9238-baf835b6a361 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:09.014856 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-00e22f63-87be-46a1-9238-baf835b6a361 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:09.020447 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-00e22f63-87be-46a1-9238-baf835b6a361 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:09.027859 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-00e22f63-87be-46a1-9238-baf835b6a361 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:09.028652 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-00e22f63-87be-46a1-9238-baf835b6a361 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:09.557642 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=2 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:58:09.664414 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-00e22f63-87be-46a1-9238-baf835b6a361 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632904331d024d9b8e4d3660dff2cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ed0bdee3aa4013bd9219069bda558c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:09.674403 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-00e22f63-87be-46a1-9238-baf835b6a361 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] 10.222.0.58 "GET /compute/v2.1/servers/47f49c52-08b0-469c-8969-c9655c6ee39b" status: 200 len: 1310 microversion: 2.1 time: 0.712121 Aug 10 22:58:09.692590 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 325/611] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:58:08 2022] GET /compute/v2.1/servers/47f49c52-08b0-469c-8969-c9655c6ee39b => generated 1310 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:58:09.701018 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-a3538dc4-6e97-41b4-bf8a-c05c7730a394 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:09.702019 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-a3538dc4-6e97-41b4-bf8a-c05c7730a394 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] [instance: eaea4cc7-b1b8-43a7-83a4-8cfc8a44f9c1] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:09.711226 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a3538dc4-6e97-41b4-bf8a-c05c7730a394 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:09.712056 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a3538dc4-6e97-41b4-bf8a-c05c7730a394 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:09.712647 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a3538dc4-6e97-41b4-bf8a-c05c7730a394 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:09.713526 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a3538dc4-6e97-41b4-bf8a-c05c7730a394 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:09.714212 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a3538dc4-6e97-41b4-bf8a-c05c7730a394 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:09.714820 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a3538dc4-6e97-41b4-bf8a-c05c7730a394 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:10.025750 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-a3538dc4-6e97-41b4-bf8a-c05c7730a394 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:10.037282 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-a3538dc4-6e97-41b4-bf8a-c05c7730a394 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:10.039580 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-a3538dc4-6e97-41b4-bf8a-c05c7730a394 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:10.041001 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-a3538dc4-6e97-41b4-bf8a-c05c7730a394 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] 10.222.0.58 "GET /compute/v2.1/servers/eaea4cc7-b1b8-43a7-83a4-8cfc8a44f9c1" status: 200 len: 1567 microversion: 2.25 time: 0.346907 Aug 10 22:58:10.041752 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 326/612] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 22:58:09 2022] GET /compute/v2.1/servers/eaea4cc7-b1b8-43a7-83a4-8cfc8a44f9c1 => generated 1567 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:58:10.054502 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-33c5324a-f4fc-4ed2-8e28-40297c5ffebd req-d2bad8d2-dba3-49f1-ba06-8df8aca8799a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e467caf-9d1e-4dc0-830d-585aeabc1e5a", "name": "network-vif-plugged", "status": "completed", "tag": "4039e5dc-d9c0-4105-991d-a67f51743ea9"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:58:10.070905 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-33c5324a-f4fc-4ed2-8e28-40297c5ffebd req-d2bad8d2-dba3-49f1-ba06-8df8aca8799a service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:10.071681 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-33c5324a-f4fc-4ed2-8e28-40297c5ffebd req-d2bad8d2-dba3-49f1-ba06-8df8aca8799a service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:10.072282 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-33c5324a-f4fc-4ed2-8e28-40297c5ffebd req-d2bad8d2-dba3-49f1-ba06-8df8aca8799a service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:10.091542 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-33c5324a-f4fc-4ed2-8e28-40297c5ffebd req-d2bad8d2-dba3-49f1-ba06-8df8aca8799a service nova] Creating event network-vif-plugged:4039e5dc-d9c0-4105-991d-a67f51743ea9 for instance 3e467caf-9d1e-4dc0-830d-585aeabc1e5a on n-h1-850468-14 Aug 10 22:58:10.102266 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-33c5324a-f4fc-4ed2-8e28-40297c5ffebd req-d2bad8d2-dba3-49f1-ba06-8df8aca8799a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059102 Aug 10 22:58:10.103450 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 327/613] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 22:58:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:58:10.108697 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-ea222963-33a7-42c5-b333-cd977c033024 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:10.110638 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-ea222963-33a7-42c5-b333-cd977c033024 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] [instance: 7599a318-7a19-4f4a-bbb6-162f7a207060] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:10.126341 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ea222963-33a7-42c5-b333-cd977c033024 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:10.129597 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ea222963-33a7-42c5-b333-cd977c033024 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:10.133212 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ea222963-33a7-42c5-b333-cd977c033024 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:10.134190 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ea222963-33a7-42c5-b333-cd977c033024 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:10.134840 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ea222963-33a7-42c5-b333-cd977c033024 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:10.136657 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ea222963-33a7-42c5-b333-cd977c033024 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:10.368827 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-ea222963-33a7-42c5-b333-cd977c033024 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0415b5bdb48249d6b9f1ef7c92aad597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29083d61c29b43b4b47539a141b3d1fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:10.375200 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:58:10.396586 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-ea222963-33a7-42c5-b333-cd977c033024 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] 10.222.0.58 "GET /compute/v2.1/servers/7599a318-7a19-4f4a-bbb6-162f7a207060" status: 200 len: 1371 microversion: 2.1 time: 0.289417 Aug 10 22:58:10.400715 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 328/614] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:58:10 2022] GET /compute/v2.1/servers/7599a318-7a19-4f4a-bbb6-162f7a207060 => generated 1371 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:58:10.413946 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-e8e4df08-b4cb-4fb4-b9d9-e0f70345d214 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:10.426549 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-e8e4df08-b4cb-4fb4-b9d9-e0f70345d214 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 3e467caf-9d1e-4dc0-830d-585aeabc1e5a] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:10.438079 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e8e4df08-b4cb-4fb4-b9d9-e0f70345d214 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:10.439124 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e8e4df08-b4cb-4fb4-b9d9-e0f70345d214 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:10.440493 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e8e4df08-b4cb-4fb4-b9d9-e0f70345d214 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:10.441785 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e8e4df08-b4cb-4fb4-b9d9-e0f70345d214 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:10.442475 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e8e4df08-b4cb-4fb4-b9d9-e0f70345d214 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:10.443090 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e8e4df08-b4cb-4fb4-b9d9-e0f70345d214 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:10.741398 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-cb523bf6-1d9e-4dcc-a57a-13fb0f1cb746 tempest-FloatingIPsTestJSON-646876676 tempest-FloatingIPsTestJSON-646876676-project] 10.222.0.58 "DELETE /compute/v2.1/os-floating-ips/81dcefde-0d84-4ea4-a0e0-de6384313e5d" status: 202 len: 0 microversion: 2.1 time: 3.428822 Aug 10 22:58:10.741990 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 287/615] 10.222.0.58 () {58 vars in 1263 bytes} [Wed Aug 10 22:58:07 2022] DELETE /compute/v2.1/os-floating-ips/81dcefde-0d84-4ea4-a0e0-de6384313e5d => generated 0 bytes in 3430 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 22:58:10.750204 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-bd1740e4-cf5c-443f-b1a2-4eb7f9b9daa8 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:10.752023 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-bd1740e4-cf5c-443f-b1a2-4eb7f9b9daa8 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] [instance: 47f49c52-08b0-469c-8969-c9655c6ee39b] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:10.774998 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=3 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:58:10.779523 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bd1740e4-cf5c-443f-b1a2-4eb7f9b9daa8 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:10.780353 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bd1740e4-cf5c-443f-b1a2-4eb7f9b9daa8 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:10.782909 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bd1740e4-cf5c-443f-b1a2-4eb7f9b9daa8 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:10.783921 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bd1740e4-cf5c-443f-b1a2-4eb7f9b9daa8 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:10.786256 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bd1740e4-cf5c-443f-b1a2-4eb7f9b9daa8 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:10.786971 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bd1740e4-cf5c-443f-b1a2-4eb7f9b9daa8 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:10.849486 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-e8e4df08-b4cb-4fb4-b9d9-e0f70345d214 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:10.866444 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-e8e4df08-b4cb-4fb4-b9d9-e0f70345d214 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/3e467caf-9d1e-4dc0-830d-585aeabc1e5a" status: 200 len: 1313 microversion: 2.1 time: 0.463537 Aug 10 22:58:10.868150 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 329/616] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:58:10 2022] GET /compute/v2.1/servers/3e467caf-9d1e-4dc0-830d-585aeabc1e5a => generated 1313 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:58:10.874331 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-9d137a36-9c90-4ce6-a94f-8320abd1c6d1 tempest-FloatingIPsTestJSON-646876676 tempest-FloatingIPsTestJSON-646876676-project] Calling method '.version_select at 0x7f847d647670>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:10.937303 n-d-850468-14 devstack@n-api.service[122633]: DEBUG neutronclient.v2_0.client [None req-9d137a36-9c90-4ce6-a94f-8320abd1c6d1 tempest-FloatingIPsTestJSON-646876676 tempest-FloatingIPsTestJSON-646876676-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 81dcefde-0d84-4ea4-a0e0-de6384313e5d could not be found", "detail": ""}} {{(pid=122633) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 10 22:58:10.938397 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-9d137a36-9c90-4ce6-a94f-8320abd1c6d1 tempest-FloatingIPsTestJSON-646876676 tempest-FloatingIPsTestJSON-646876676-project] HTTP exception thrown: Floating IP not found for ID 81dcefde-0d84-4ea4-a0e0-de6384313e5d Aug 10 22:58:10.969747 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-9d137a36-9c90-4ce6-a94f-8320abd1c6d1 tempest-FloatingIPsTestJSON-646876676 tempest-FloatingIPsTestJSON-646876676-project] Request method failure captured: Aug 10 22:58:10.969747 n-d-850468-14 devstack@n-api.service[122633]: request: GET /compute/v2.1/os-floating-ips/81dcefde-0d84-4ea4-a0e0-de6384313e5d HTTP/1.1 Aug 10 22:58:10.969747 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 22:58:10.969747 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 22:58:10.969747 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 22:58:10.969747 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 22:58:10.969747 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 22:58:10.969747 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 22:58:10.969747 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 22:58:10.969747 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 22:58:10.969747 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9DfuvtIRlypFYecu-0Oa3VYvOGSXkDJE5WgkHoerVGkuX8dqCAGcHLViOc7MAIEo3T5Jjk0GYKBUiZgVN-8kBjiXgpvV9XWPwOJnL9lzy_5GZDc0DBzJO0dvSN2XL59mvmX7AlCKnFWDYry8GPUyPZXgQF3eWHBPQBQxgVTpM-2UIOw Aug 10 22:58:10.969747 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 22:58:10.969747 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 22:58:10.969747 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 22:58:10.969747 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 22:58:10.969747 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 22:58:10.969747 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 22:58:10.969747 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 3e947c3222f04567965ca62a74be5c85 Aug 10 22:58:10.969747 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-FloatingIPsTestJSON-646876676 Aug 10 22:58:10.969747 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 22:58:10.969747 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 22:58:10.971453 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3e947c3222f04567965ca62a74be5c85"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3e947c3222f04567965ca62a74be5c85"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/3e947c3222f04567965ca62a74be5c85"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_3e947c3222f04567965ca62a74be5c85", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 22:58:10.971453 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-FloatingIPsTestJSON-646876676 Aug 10 22:58:10.971453 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 3e947c3222f04567965ca62a74be5c85 Aug 10 22:58:10.971453 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-FloatingIPsTestJSON-646876676 Aug 10 22:58:10.971453 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-FloatingIPsTestJSON-646876676-project Aug 10 22:58:10.971453 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 22:58:10.971453 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 22:58:10.971453 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 6d1607c4bab54a52b87fd531ecf285f5 Aug 10 22:58:10.971453 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-FloatingIPsTestJSON-646876676-project Aug 10 22:58:10.971453 n-d-850468-14 devstack@n-api.service[122633]: method: Aug 10 22:58:10.971453 n-d-850468-14 devstack@n-api.service[122633]: exception: Floating IP not found for ID 81dcefde-0d84-4ea4-a0e0-de6384313e5d Aug 10 22:58:10.971453 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': '81dcefde-0d84-4ea4-a0e0-de6384313e5d'} Aug 10 22:58:10.971453 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 22:58:10.972542 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:58:10.972542 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Aug 10 22:58:10.972542 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Aug 10 22:58:10.972542 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 22:58:10.972542 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 22:58:10.972542 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Aug 10 22:58:10.972542 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Aug 10 22:58:10.972542 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 22:58:10.972542 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 22:58:10.972542 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 22:58:10.972542 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 22:58:10.972542 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 22:58:10.972542 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 22:58:10.972542 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 22:58:10.972542 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 22:58:10.972542 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 22:58:10.972542 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 22:58:10.972542 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 10 22:58:10.972542 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 10 22:58:10.974079 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 22:58:10.974079 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 22:58:10.974079 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 10 22:58:10.974079 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 10 22:58:10.974079 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 10 22:58:10.974079 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 10 22:58:10.974079 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 81dcefde-0d84-4ea4-a0e0-de6384313e5d could not be found Aug 10 22:58:10.974079 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-68fa0f95-ed6d-4282-8c25-ddd0262ffa63'] Aug 10 22:58:10.974079 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:58:10.974079 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:58:10.974079 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:58:10.974079 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:58:10.974079 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Aug 10 22:58:10.974079 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Aug 10 22:58:10.974079 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Aug 10 22:58:10.974079 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Aug 10 22:58:10.974079 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 81dcefde-0d84-4ea4-a0e0-de6384313e5d. Aug 10 22:58:10.974079 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:58:10.974079 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:58:10.974079 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:58:10.975558 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:58:10.975558 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:58:10.975558 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:58:10.975558 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 22:58:10.975558 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 22:58:10.975558 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 22:58:10.975558 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 22:58:10.975558 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 22:58:10.975558 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 22:58:10.975558 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Aug 10 22:58:10.975558 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 10 22:58:10.975558 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 81dcefde-0d84-4ea4-a0e0-de6384313e5d Aug 10 22:58:10.975558 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:58:10.975558 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:58:10.975558 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:58:10.975558 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:58:10.975558 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:58:10.975558 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:58:10.975558 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 22:58:10.975558 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 22:58:10.977298 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 81dcefde-0d84-4ea4-a0e0-de6384313e5d Aug 10 22:58:10.977298 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:58:10.977298 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-9d137a36-9c90-4ce6-a94f-8320abd1c6d1 tempest-FloatingIPsTestJSON-646876676 tempest-FloatingIPsTestJSON-646876676-project] Returning 404 to user: Floating IP not found for ID 81dcefde-0d84-4ea4-a0e0-de6384313e5d {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 22:58:10.977298 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-9d137a36-9c90-4ce6-a94f-8320abd1c6d1 tempest-FloatingIPsTestJSON-646876676 tempest-FloatingIPsTestJSON-646876676-project] 10.222.0.58 "GET /compute/v2.1/os-floating-ips/81dcefde-0d84-4ea4-a0e0-de6384313e5d" status: 404 len: 111 microversion: 2.1 time: 0.101684 Aug 10 22:58:10.977298 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 330/617] 10.222.0.58 () {58 vars in 1260 bytes} [Wed Aug 10 22:58:10 2022] GET /compute/v2.1/os-floating-ips/81dcefde-0d84-4ea4-a0e0-de6384313e5d => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 22:58:10.983290 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-df0e0a46-cc82-4025-a124-d6697b50c8b6 tempest-FloatingIPsTestJSON-646876676 tempest-FloatingIPsTestJSON-646876676-project] Calling method '.version_select at 0x7f847d538c10>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:11.209553 n-d-850468-14 devstack@n-api.service[122633]: DEBUG neutronclient.v2_0.client [None req-df0e0a46-cc82-4025-a124-d6697b50c8b6 tempest-FloatingIPsTestJSON-646876676 tempest-FloatingIPsTestJSON-646876676-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 81dcefde-0d84-4ea4-a0e0-de6384313e5d could not be found", "detail": ""}} {{(pid=122633) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 10 22:58:11.211453 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-df0e0a46-cc82-4025-a124-d6697b50c8b6 tempest-FloatingIPsTestJSON-646876676 tempest-FloatingIPsTestJSON-646876676-project] HTTP exception thrown: Floating IP not found for ID 81dcefde-0d84-4ea4-a0e0-de6384313e5d Aug 10 22:58:11.213489 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-df0e0a46-cc82-4025-a124-d6697b50c8b6 tempest-FloatingIPsTestJSON-646876676 tempest-FloatingIPsTestJSON-646876676-project] Request method failure captured: Aug 10 22:58:11.213489 n-d-850468-14 devstack@n-api.service[122633]: request: DELETE /compute/v2.1/os-floating-ips/81dcefde-0d84-4ea4-a0e0-de6384313e5d HTTP/1.1 Aug 10 22:58:11.213489 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 22:58:11.213489 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 22:58:11.213489 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 22:58:11.213489 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 22:58:11.213489 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 22:58:11.213489 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 22:58:11.213489 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 22:58:11.213489 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 22:58:11.213489 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9DfuvtIRlypFYecu-0Oa3VYvOGSXkDJE5WgkHoerVGkuX8dqCAGcHLViOc7MAIEo3T5Jjk0GYKBUiZgVN-8kBjiXgpvV9XWPwOJnL9lzy_5GZDc0DBzJO0dvSN2XL59mvmX7AlCKnFWDYry8GPUyPZXgQF3eWHBPQBQxgVTpM-2UIOw Aug 10 22:58:11.213489 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 22:58:11.213489 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 22:58:11.213489 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 22:58:11.213489 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 22:58:11.213489 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 22:58:11.213489 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 22:58:11.213489 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 3e947c3222f04567965ca62a74be5c85 Aug 10 22:58:11.213489 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-FloatingIPsTestJSON-646876676 Aug 10 22:58:11.213489 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 22:58:11.213489 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 22:58:11.214759 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3e947c3222f04567965ca62a74be5c85"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3e947c3222f04567965ca62a74be5c85"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/3e947c3222f04567965ca62a74be5c85"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_3e947c3222f04567965ca62a74be5c85", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 22:58:11.214759 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-FloatingIPsTestJSON-646876676 Aug 10 22:58:11.214759 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 3e947c3222f04567965ca62a74be5c85 Aug 10 22:58:11.214759 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-FloatingIPsTestJSON-646876676 Aug 10 22:58:11.214759 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-FloatingIPsTestJSON-646876676-project Aug 10 22:58:11.214759 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 22:58:11.214759 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 22:58:11.214759 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 6d1607c4bab54a52b87fd531ecf285f5 Aug 10 22:58:11.214759 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-FloatingIPsTestJSON-646876676-project Aug 10 22:58:11.214759 n-d-850468-14 devstack@n-api.service[122633]: method: Aug 10 22:58:11.214759 n-d-850468-14 devstack@n-api.service[122633]: exception: Floating IP not found for ID 81dcefde-0d84-4ea4-a0e0-de6384313e5d Aug 10 22:58:11.214759 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': '81dcefde-0d84-4ea4-a0e0-de6384313e5d'} Aug 10 22:58:11.214759 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 22:58:11.215524 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:58:11.215524 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Aug 10 22:58:11.215524 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Aug 10 22:58:11.215524 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 22:58:11.215524 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 22:58:11.215524 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Aug 10 22:58:11.215524 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Aug 10 22:58:11.215524 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 22:58:11.215524 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 22:58:11.215524 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 22:58:11.215524 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 22:58:11.215524 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 22:58:11.215524 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 22:58:11.215524 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 22:58:11.215524 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 22:58:11.215524 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 22:58:11.215524 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 22:58:11.215524 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 10 22:58:11.215524 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 10 22:58:11.217371 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 22:58:11.217371 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 22:58:11.217371 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 10 22:58:11.217371 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 10 22:58:11.217371 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 10 22:58:11.217371 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 10 22:58:11.217371 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 81dcefde-0d84-4ea4-a0e0-de6384313e5d could not be found Aug 10 22:58:11.217371 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8e1336f6-eeed-4836-95b8-05757242d350'] Aug 10 22:58:11.217371 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:58:11.217371 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:58:11.217371 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:58:11.217371 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:58:11.217371 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Aug 10 22:58:11.217371 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Aug 10 22:58:11.217371 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Aug 10 22:58:11.217371 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Aug 10 22:58:11.217371 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 81dcefde-0d84-4ea4-a0e0-de6384313e5d. Aug 10 22:58:11.217371 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:58:11.217371 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:58:11.217371 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:58:11.218461 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:58:11.218461 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:58:11.218461 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:58:11.218461 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 22:58:11.218461 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 22:58:11.218461 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 22:58:11.218461 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 22:58:11.218461 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 22:58:11.218461 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 22:58:11.218461 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Aug 10 22:58:11.218461 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 10 22:58:11.218461 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 81dcefde-0d84-4ea4-a0e0-de6384313e5d Aug 10 22:58:11.218461 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:58:11.218461 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:58:11.218461 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:58:11.218461 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:58:11.218461 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:58:11.218461 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:58:11.218461 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 22:58:11.218461 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 22:58:11.219765 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 81dcefde-0d84-4ea4-a0e0-de6384313e5d Aug 10 22:58:11.219765 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:58:11.219765 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-df0e0a46-cc82-4025-a124-d6697b50c8b6 tempest-FloatingIPsTestJSON-646876676 tempest-FloatingIPsTestJSON-646876676-project] Returning 404 to user: Floating IP not found for ID 81dcefde-0d84-4ea4-a0e0-de6384313e5d {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 22:58:11.219765 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-df0e0a46-cc82-4025-a124-d6697b50c8b6 tempest-FloatingIPsTestJSON-646876676 tempest-FloatingIPsTestJSON-646876676-project] 10.222.0.58 "DELETE /compute/v2.1/os-floating-ips/81dcefde-0d84-4ea4-a0e0-de6384313e5d" status: 404 len: 111 microversion: 2.1 time: 0.237331 Aug 10 22:58:11.220329 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 331/618] 10.222.0.58 () {58 vars in 1263 bytes} [Wed Aug 10 22:58:10 2022] DELETE /compute/v2.1/os-floating-ips/81dcefde-0d84-4ea4-a0e0-de6384313e5d => generated 111 bytes in 243 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 22:58:11.225792 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-59988379-bb4f-4eb0-834f-cdcf8b98130f tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:11.226413 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-59988379-bb4f-4eb0-834f-cdcf8b98130f tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] [instance: eaea4cc7-b1b8-43a7-83a4-8cfc8a44f9c1] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:11.248410 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-59988379-bb4f-4eb0-834f-cdcf8b98130f tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:11.249130 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-59988379-bb4f-4eb0-834f-cdcf8b98130f tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:11.249832 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-59988379-bb4f-4eb0-834f-cdcf8b98130f tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:11.250752 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-59988379-bb4f-4eb0-834f-cdcf8b98130f tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:11.251437 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-59988379-bb4f-4eb0-834f-cdcf8b98130f tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:11.255449 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-59988379-bb4f-4eb0-834f-cdcf8b98130f tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:11.492048 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-bd1740e4-cf5c-443f-b1a2-4eb7f9b9daa8 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632904331d024d9b8e4d3660dff2cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ed0bdee3aa4013bd9219069bda558c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:11.504341 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-bd1740e4-cf5c-443f-b1a2-4eb7f9b9daa8 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] 10.222.0.58 "GET /compute/v2.1/servers/47f49c52-08b0-469c-8969-c9655c6ee39b" status: 200 len: 1310 microversion: 2.1 time: 0.755800 Aug 10 22:58:11.506858 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 288/619] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:58:10 2022] GET /compute/v2.1/servers/47f49c52-08b0-469c-8969-c9655c6ee39b => generated 1310 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:58:11.514263 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-470b06d9-305a-4725-afe0-6ac32cc207a4 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:11.515656 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-470b06d9-305a-4725-afe0-6ac32cc207a4 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] [instance: 7599a318-7a19-4f4a-bbb6-162f7a207060] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:11.524974 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-470b06d9-305a-4725-afe0-6ac32cc207a4 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:11.526286 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-470b06d9-305a-4725-afe0-6ac32cc207a4 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:11.527382 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-470b06d9-305a-4725-afe0-6ac32cc207a4 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:11.528202 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-470b06d9-305a-4725-afe0-6ac32cc207a4 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:11.529496 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-470b06d9-305a-4725-afe0-6ac32cc207a4 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:11.529939 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-470b06d9-305a-4725-afe0-6ac32cc207a4 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:11.678340 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-59988379-bb4f-4eb0-834f-cdcf8b98130f tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:11.694320 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-59988379-bb4f-4eb0-834f-cdcf8b98130f tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:11.696264 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-59988379-bb4f-4eb0-834f-cdcf8b98130f tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:11.697788 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-59988379-bb4f-4eb0-834f-cdcf8b98130f tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] 10.222.0.58 "GET /compute/v2.1/servers/eaea4cc7-b1b8-43a7-83a4-8cfc8a44f9c1" status: 200 len: 1567 microversion: 2.25 time: 0.476491 Aug 10 22:58:11.698645 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 332/620] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 22:58:11 2022] GET /compute/v2.1/servers/eaea4cc7-b1b8-43a7-83a4-8cfc8a44f9c1 => generated 1567 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:58:11.847765 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-26da862e-d8fb-4b3e-9dbf-d1a2d89ffe34 req-fa12a9a4-a7a0-4320-8ab4-67c170dac6ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eaea4cc7-b1b8-43a7-83a4-8cfc8a44f9c1", "name": "network-vif-unplugged", "status": "completed", "tag": "736e341a-be60-4b0a-ac9e-ebacb140516d"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:58:11.889555 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-26da862e-d8fb-4b3e-9dbf-d1a2d89ffe34 req-fa12a9a4-a7a0-4320-8ab4-67c170dac6ed service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:11.890345 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-26da862e-d8fb-4b3e-9dbf-d1a2d89ffe34 req-fa12a9a4-a7a0-4320-8ab4-67c170dac6ed service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:11.890969 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-26da862e-d8fb-4b3e-9dbf-d1a2d89ffe34 req-fa12a9a4-a7a0-4320-8ab4-67c170dac6ed service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:11.909467 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-26da862e-d8fb-4b3e-9dbf-d1a2d89ffe34 req-fa12a9a4-a7a0-4320-8ab4-67c170dac6ed service nova] Creating event network-vif-unplugged:736e341a-be60-4b0a-ac9e-ebacb140516d for instance eaea4cc7-b1b8-43a7-83a4-8cfc8a44f9c1 on n-h1-850468-14 Aug 10 22:58:11.915715 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-26da862e-d8fb-4b3e-9dbf-d1a2d89ffe34 req-fa12a9a4-a7a0-4320-8ab4-67c170dac6ed service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.073180 Aug 10 22:58:11.917447 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 333/621] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 22:58:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 22:58:11.923096 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-1b1ee4cc-5904-4221-b16e-054332b52cc0 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:11.924303 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-1b1ee4cc-5904-4221-b16e-054332b52cc0 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 3e467caf-9d1e-4dc0-830d-585aeabc1e5a] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:11.932226 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1b1ee4cc-5904-4221-b16e-054332b52cc0 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:11.934470 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1b1ee4cc-5904-4221-b16e-054332b52cc0 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:11.935858 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1b1ee4cc-5904-4221-b16e-054332b52cc0 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:11.936793 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1b1ee4cc-5904-4221-b16e-054332b52cc0 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:11.937421 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1b1ee4cc-5904-4221-b16e-054332b52cc0 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:11.942705 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1b1ee4cc-5904-4221-b16e-054332b52cc0 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:12.087378 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-470b06d9-305a-4725-afe0-6ac32cc207a4 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0415b5bdb48249d6b9f1ef7c92aad597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29083d61c29b43b4b47539a141b3d1fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:12.096687 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-470b06d9-305a-4725-afe0-6ac32cc207a4 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] 10.222.0.58 "GET /compute/v2.1/servers/7599a318-7a19-4f4a-bbb6-162f7a207060" status: 200 len: 1371 microversion: 2.1 time: 0.588537 Aug 10 22:58:12.112474 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 289/622] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:58:11 2022] GET /compute/v2.1/servers/7599a318-7a19-4f4a-bbb6-162f7a207060 => generated 1371 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:58:12.152435 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-1e51724f-6950-4b66-ab30-871f63b7497d req-a57f4f05-f5ea-47eb-b9b0-6d2da9ce4649 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47f49c52-08b0-469c-8969-c9655c6ee39b", "name": "network-vif-plugged", "status": "completed", "tag": "18b62a0a-3eba-4608-9dea-969a87874984"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:58:12.179753 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-1e51724f-6950-4b66-ab30-871f63b7497d req-a57f4f05-f5ea-47eb-b9b0-6d2da9ce4649 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:12.180264 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-1e51724f-6950-4b66-ab30-871f63b7497d req-a57f4f05-f5ea-47eb-b9b0-6d2da9ce4649 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:12.180703 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-1e51724f-6950-4b66-ab30-871f63b7497d req-a57f4f05-f5ea-47eb-b9b0-6d2da9ce4649 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:12.209364 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-1e51724f-6950-4b66-ab30-871f63b7497d req-a57f4f05-f5ea-47eb-b9b0-6d2da9ce4649 service nova] Creating event network-vif-plugged:18b62a0a-3eba-4608-9dea-969a87874984 for instance 47f49c52-08b0-469c-8969-c9655c6ee39b on n-h2-850468-14 Aug 10 22:58:12.215141 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-1e51724f-6950-4b66-ab30-871f63b7497d req-a57f4f05-f5ea-47eb-b9b0-6d2da9ce4649 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066417 Aug 10 22:58:12.219031 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 290/623] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 22:58:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 22:58:12.528287 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-24c2280e-e017-4fa8-8ee5-d26aa36d4b8e tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:12.529329 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-24c2280e-e017-4fa8-8ee5-d26aa36d4b8e tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] [instance: 47f49c52-08b0-469c-8969-c9655c6ee39b] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:12.541649 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-24c2280e-e017-4fa8-8ee5-d26aa36d4b8e tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:12.543334 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-24c2280e-e017-4fa8-8ee5-d26aa36d4b8e tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:12.544168 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-24c2280e-e017-4fa8-8ee5-d26aa36d4b8e tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:12.545116 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-24c2280e-e017-4fa8-8ee5-d26aa36d4b8e tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:12.547254 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-24c2280e-e017-4fa8-8ee5-d26aa36d4b8e tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:12.548172 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-24c2280e-e017-4fa8-8ee5-d26aa36d4b8e tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:12.796174 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-1b1ee4cc-5904-4221-b16e-054332b52cc0 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:12.832758 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-1b1ee4cc-5904-4221-b16e-054332b52cc0 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/3e467caf-9d1e-4dc0-830d-585aeabc1e5a" status: 200 len: 1313 microversion: 2.1 time: 0.910530 Aug 10 22:58:12.834532 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 334/624] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:58:11 2022] GET /compute/v2.1/servers/3e467caf-9d1e-4dc0-830d-585aeabc1e5a => generated 1313 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:58:12.845316 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-6ae38cdd-d815-4051-b471-e828f297eddb tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:12.846653 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-6ae38cdd-d815-4051-b471-e828f297eddb tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] [instance: eaea4cc7-b1b8-43a7-83a4-8cfc8a44f9c1] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:12.857851 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6ae38cdd-d815-4051-b471-e828f297eddb tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:12.859149 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6ae38cdd-d815-4051-b471-e828f297eddb tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:12.860022 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6ae38cdd-d815-4051-b471-e828f297eddb tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:12.867634 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6ae38cdd-d815-4051-b471-e828f297eddb tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:12.867795 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6ae38cdd-d815-4051-b471-e828f297eddb tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:12.868184 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6ae38cdd-d815-4051-b471-e828f297eddb tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:12.959703 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-24c2280e-e017-4fa8-8ee5-d26aa36d4b8e tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632904331d024d9b8e4d3660dff2cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ed0bdee3aa4013bd9219069bda558c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:12.976581 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-24c2280e-e017-4fa8-8ee5-d26aa36d4b8e tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] 10.222.0.58 "GET /compute/v2.1/servers/47f49c52-08b0-469c-8969-c9655c6ee39b" status: 200 len: 1310 microversion: 2.1 time: 0.453561 Aug 10 22:58:12.990626 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 291/625] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:58:12 2022] GET /compute/v2.1/servers/47f49c52-08b0-469c-8969-c9655c6ee39b => generated 1310 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:58:13.122263 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-0aa3c2b2-d630-45ef-bc9d-56bc5a9d2237 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:13.124579 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-0aa3c2b2-d630-45ef-bc9d-56bc5a9d2237 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] [instance: 7599a318-7a19-4f4a-bbb6-162f7a207060] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:13.135078 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0aa3c2b2-d630-45ef-bc9d-56bc5a9d2237 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:13.135881 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0aa3c2b2-d630-45ef-bc9d-56bc5a9d2237 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:13.137443 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0aa3c2b2-d630-45ef-bc9d-56bc5a9d2237 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:13.138370 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0aa3c2b2-d630-45ef-bc9d-56bc5a9d2237 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:13.139026 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0aa3c2b2-d630-45ef-bc9d-56bc5a9d2237 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:13.139591 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0aa3c2b2-d630-45ef-bc9d-56bc5a9d2237 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:13.388644 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-6ae38cdd-d815-4051-b471-e828f297eddb tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:13.397387 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-6ae38cdd-d815-4051-b471-e828f297eddb tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:13.399010 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-6ae38cdd-d815-4051-b471-e828f297eddb tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:13.407657 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-6ae38cdd-d815-4051-b471-e828f297eddb tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] 10.222.0.58 "GET /compute/v2.1/servers/eaea4cc7-b1b8-43a7-83a4-8cfc8a44f9c1" status: 200 len: 1567 microversion: 2.25 time: 0.567539 Aug 10 22:58:13.408524 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 335/626] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 22:58:12 2022] GET /compute/v2.1/servers/eaea4cc7-b1b8-43a7-83a4-8cfc8a44f9c1 => generated 1567 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:58:13.649332 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-0aa3c2b2-d630-45ef-bc9d-56bc5a9d2237 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0415b5bdb48249d6b9f1ef7c92aad597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29083d61c29b43b4b47539a141b3d1fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:13.658409 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-0aa3c2b2-d630-45ef-bc9d-56bc5a9d2237 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] 10.222.0.58 "GET /compute/v2.1/servers/7599a318-7a19-4f4a-bbb6-162f7a207060" status: 200 len: 1371 microversion: 2.1 time: 0.541291 Aug 10 22:58:13.679945 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 292/627] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:58:13 2022] GET /compute/v2.1/servers/7599a318-7a19-4f4a-bbb6-162f7a207060 => generated 1371 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:58:13.856114 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-261ade6c-c6f5-44a3-97fd-321a41863cd8 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:13.856729 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-261ade6c-c6f5-44a3-97fd-321a41863cd8 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 3e467caf-9d1e-4dc0-830d-585aeabc1e5a] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:13.867235 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-261ade6c-c6f5-44a3-97fd-321a41863cd8 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:13.867730 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-261ade6c-c6f5-44a3-97fd-321a41863cd8 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:13.868168 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-261ade6c-c6f5-44a3-97fd-321a41863cd8 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:13.868870 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-261ade6c-c6f5-44a3-97fd-321a41863cd8 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:13.869317 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-261ade6c-c6f5-44a3-97fd-321a41863cd8 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:13.869734 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-261ade6c-c6f5-44a3-97fd-321a41863cd8 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:14.068928 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c47c16e0-85d8-4196-bdaa-dbd74a587ef8 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Action: 'create', calling method: .version_select at 0x7f847d538ee0>, body: {"keypair": {"name": "tempest-keypair-1315665311", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBArQhUduydjrLE/DUrRZmqguQFmrJXZYio0QwgxyL9UbiujizPndZXJufjdXamP9DEEN4vOllAe/kuv7fHbb3aCJlV/k2hfxxzrxTloka8NvvMmvoSS6wPJlbTjeRenKRw=="}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:58:14.099354 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-c47c16e0-85d8-4196-bdaa-dbd74a587ef8 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Getting quotas for project eae334ad72ba421797a6d836edcbab0c. Resources: {'key_pairs'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 22:58:14.110060 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-c47c16e0-85d8-4196-bdaa-dbd74a587ef8 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Getting quotas for user 6e437f9eb7254dc98e2839656c053f2d and project eae334ad72ba421797a6d836edcbab0c. Resources: {'key_pairs'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 22:58:14.136855 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:58:14.168012 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-c47c16e0-85d8-4196-bdaa-dbd74a587ef8 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.492170 Aug 10 22:58:14.169489 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 336/628] 10.222.0.58 () {60 vars in 1159 bytes} [Wed Aug 10 22:58:13 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:58:14.177254 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-74a08294-b26f-43b5-b4c3-5c2d7c0ac92a tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:14.178317 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-74a08294-b26f-43b5-b4c3-5c2d7c0ac92a tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] [instance: 47f49c52-08b0-469c-8969-c9655c6ee39b] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:14.186859 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-74a08294-b26f-43b5-b4c3-5c2d7c0ac92a tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:14.187891 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-74a08294-b26f-43b5-b4c3-5c2d7c0ac92a tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:14.189110 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-74a08294-b26f-43b5-b4c3-5c2d7c0ac92a tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:14.190231 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-74a08294-b26f-43b5-b4c3-5c2d7c0ac92a tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:14.191198 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-74a08294-b26f-43b5-b4c3-5c2d7c0ac92a tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:14.192786 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-74a08294-b26f-43b5-b4c3-5c2d7c0ac92a tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:14.543900 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-74a08294-b26f-43b5-b4c3-5c2d7c0ac92a tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632904331d024d9b8e4d3660dff2cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ed0bdee3aa4013bd9219069bda558c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:14.556742 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-74a08294-b26f-43b5-b4c3-5c2d7c0ac92a tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] 10.222.0.58 "GET /compute/v2.1/servers/47f49c52-08b0-469c-8969-c9655c6ee39b" status: 200 len: 1494 microversion: 2.1 time: 0.385956 Aug 10 22:58:14.564271 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 337/629] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:58:14 2022] GET /compute/v2.1/servers/47f49c52-08b0-469c-8969-c9655c6ee39b => generated 1494 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:58:14.570342 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-6547418f-49c5-4544-8a25-1eb9dfc05b4c tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:14.580246 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-6547418f-49c5-4544-8a25-1eb9dfc05b4c tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] [instance: eaea4cc7-b1b8-43a7-83a4-8cfc8a44f9c1] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:14.592720 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6547418f-49c5-4544-8a25-1eb9dfc05b4c tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:14.595752 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6547418f-49c5-4544-8a25-1eb9dfc05b4c tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:14.601837 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6547418f-49c5-4544-8a25-1eb9dfc05b4c tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:14.602982 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6547418f-49c5-4544-8a25-1eb9dfc05b4c tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:14.603609 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6547418f-49c5-4544-8a25-1eb9dfc05b4c tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:14.604983 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6547418f-49c5-4544-8a25-1eb9dfc05b4c tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:14.704788 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-261ade6c-c6f5-44a3-97fd-321a41863cd8 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:14.717436 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-261ade6c-c6f5-44a3-97fd-321a41863cd8 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/3e467caf-9d1e-4dc0-830d-585aeabc1e5a" status: 200 len: 1463 microversion: 2.1 time: 0.866515 Aug 10 22:58:14.719017 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 293/630] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:58:13 2022] GET /compute/v2.1/servers/3e467caf-9d1e-4dc0-830d-585aeabc1e5a => generated 1463 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:58:14.747923 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-c7ff1f94-b476-45bc-82c9-13510906eae3 req-7a352932-c671-4374-80ee-af4dfb1ca267 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eaea4cc7-b1b8-43a7-83a4-8cfc8a44f9c1", "tag": "736e341a-be60-4b0a-ac9e-ebacb140516d"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:58:14.830344 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-c7ff1f94-b476-45bc-82c9-13510906eae3 req-7a352932-c671-4374-80ee-af4dfb1ca267 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:14.831155 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-c7ff1f94-b476-45bc-82c9-13510906eae3 req-7a352932-c671-4374-80ee-af4dfb1ca267 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:14.831608 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-c7ff1f94-b476-45bc-82c9-13510906eae3 req-7a352932-c671-4374-80ee-af4dfb1ca267 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:14.866665 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-c7ff1f94-b476-45bc-82c9-13510906eae3 req-7a352932-c671-4374-80ee-af4dfb1ca267 service nova] Creating event network-changed:736e341a-be60-4b0a-ac9e-ebacb140516d for instance eaea4cc7-b1b8-43a7-83a4-8cfc8a44f9c1 on n-h1-850468-14 Aug 10 22:58:14.875121 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-c7ff1f94-b476-45bc-82c9-13510906eae3 req-7a352932-c671-4374-80ee-af4dfb1ca267 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.154612 Aug 10 22:58:14.885822 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 294/631] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 22:58:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:58:15.043818 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-6547418f-49c5-4544-8a25-1eb9dfc05b4c tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:15.083058 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-6547418f-49c5-4544-8a25-1eb9dfc05b4c tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:15.085361 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-6547418f-49c5-4544-8a25-1eb9dfc05b4c tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:15.088735 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-6547418f-49c5-4544-8a25-1eb9dfc05b4c tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] 10.222.0.58 "GET /compute/v2.1/servers/eaea4cc7-b1b8-43a7-83a4-8cfc8a44f9c1" status: 200 len: 1567 microversion: 2.25 time: 0.521772 Aug 10 22:58:15.125348 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-66e3d661-9e1e-4d12-aa7d-082f5ff253ff tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:15.126235 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-66e3d661-9e1e-4d12-aa7d-082f5ff253ff tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] [instance: 47f49c52-08b0-469c-8969-c9655c6ee39b] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:15.131204 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 338/632] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 22:58:14 2022] GET /compute/v2.1/servers/eaea4cc7-b1b8-43a7-83a4-8cfc8a44f9c1 => generated 1567 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:58:15.143854 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-9e863d99-23a9-413f-8c6b-0e1d0a305050 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:15.144628 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-9e863d99-23a9-413f-8c6b-0e1d0a305050 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] [instance: 7599a318-7a19-4f4a-bbb6-162f7a207060] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:15.151423 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-66e3d661-9e1e-4d12-aa7d-082f5ff253ff tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:15.152153 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9e863d99-23a9-413f-8c6b-0e1d0a305050 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:15.152889 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9e863d99-23a9-413f-8c6b-0e1d0a305050 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:15.153658 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9e863d99-23a9-413f-8c6b-0e1d0a305050 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:15.154622 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9e863d99-23a9-413f-8c6b-0e1d0a305050 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:15.155025 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-66e3d661-9e1e-4d12-aa7d-082f5ff253ff tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:15.155470 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-66e3d661-9e1e-4d12-aa7d-082f5ff253ff tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:15.156120 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9e863d99-23a9-413f-8c6b-0e1d0a305050 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:15.156759 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9e863d99-23a9-413f-8c6b-0e1d0a305050 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:15.161823 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-66e3d661-9e1e-4d12-aa7d-082f5ff253ff tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:15.162310 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-66e3d661-9e1e-4d12-aa7d-082f5ff253ff tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:15.162747 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-66e3d661-9e1e-4d12-aa7d-082f5ff253ff tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:15.457995 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-66e3d661-9e1e-4d12-aa7d-082f5ff253ff tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/47f49c52-08b0-469c-8969-c9655c6ee39b" status: 200 len: 1647 microversion: 2.1 time: 0.566403 Aug 10 22:58:15.470990 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 295/633] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:58:14 2022] GET /compute/v2.1/servers/47f49c52-08b0-469c-8969-c9655c6ee39b => generated 1647 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:58:15.476911 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-68da448d-0865-41b5-bebc-da82d426b66b tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:58:15.479624 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-68da448d-0865-41b5-bebc-da82d426b66b tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 3e467caf-9d1e-4dc0-830d-585aeabc1e5a] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:15.494901 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-68da448d-0865-41b5-bebc-da82d426b66b tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:15.496101 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-68da448d-0865-41b5-bebc-da82d426b66b tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:15.496565 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-68da448d-0865-41b5-bebc-da82d426b66b tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:15.497649 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-68da448d-0865-41b5-bebc-da82d426b66b tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:15.498282 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-68da448d-0865-41b5-bebc-da82d426b66b tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:15.498725 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-68da448d-0865-41b5-bebc-da82d426b66b tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:15.700871 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-68da448d-0865-41b5-bebc-da82d426b66b tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:15.708353 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-68da448d-0865-41b5-bebc-da82d426b66b tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 3e467caf-9d1e-4dc0-830d-585aeabc1e5a] Old instance type m1.heat2, new instance type m1.heat {{(pid=122632) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 10 22:58:15.727879 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-68da448d-0865-41b5-bebc-da82d426b66b tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Flavor limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 22:58:15.728528 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-68da448d-0865-41b5-bebc-da82d426b66b tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Image limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 22:58:15.729214 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-68da448d-0865-41b5-bebc-da82d426b66b tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Flavor pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 22:58:15.729629 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-68da448d-0865-41b5-bebc-da82d426b66b tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Image pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 22:58:15.730038 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-68da448d-0865-41b5-bebc-da82d426b66b tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 22:58:15.761944 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-9e863d99-23a9-413f-8c6b-0e1d0a305050 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0415b5bdb48249d6b9f1ef7c92aad597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29083d61c29b43b4b47539a141b3d1fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:15.776304 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-9e863d99-23a9-413f-8c6b-0e1d0a305050 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] 10.222.0.58 "GET /compute/v2.1/servers/7599a318-7a19-4f4a-bbb6-162f7a207060" status: 200 len: 1371 microversion: 2.1 time: 0.639724 Aug 10 22:58:15.779224 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 339/634] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:58:15 2022] GET /compute/v2.1/servers/7599a318-7a19-4f4a-bbb6-162f7a207060 => generated 1371 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:58:15.878023 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-7dec9b7a-fd83-4a5c-aa1a-a60c5f3e8a21 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-613302405", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452", "networks": [{"uuid": "b7470d0a-cf37-4051-8236-4c65a5fc36b5"}]}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:58:15.961637 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.network.neutron [None req-7dec9b7a-fd83-4a5c-aa1a-a60c5f3e8a21 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] validate_networks() for [('b7470d0a-cf37-4051-8236-4c65a5fc36b5', None, None, None, None, None)] {{(pid=122633) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 22:58:16.021137 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-68da448d-0865-41b5-bebc-da82d426b66b tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "POST /compute/v2.1/servers/3e467caf-9d1e-4dc0-830d-585aeabc1e5a/action" status: 202 len: 0 microversion: 2.1 time: 0.557960 Aug 10 22:58:16.022579 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 296/635] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 22:58:15 2022] POST /compute/v2.1/servers/3e467caf-9d1e-4dc0-830d-585aeabc1e5a/action => generated 0 bytes in 561 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 22:58:16.030207 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-12e76f65-8177-4c5e-a5b0-6f1a24b9f8a3 tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:16.031367 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-12e76f65-8177-4c5e-a5b0-6f1a24b9f8a3 tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] [instance: 47f49c52-08b0-469c-8969-c9655c6ee39b] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:16.039302 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-12e76f65-8177-4c5e-a5b0-6f1a24b9f8a3 tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:16.040038 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-12e76f65-8177-4c5e-a5b0-6f1a24b9f8a3 tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:16.040745 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-12e76f65-8177-4c5e-a5b0-6f1a24b9f8a3 tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:16.041636 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-12e76f65-8177-4c5e-a5b0-6f1a24b9f8a3 tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:16.042479 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-12e76f65-8177-4c5e-a5b0-6f1a24b9f8a3 tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:16.043227 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-12e76f65-8177-4c5e-a5b0-6f1a24b9f8a3 tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:16.288791 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-12e76f65-8177-4c5e-a5b0-6f1a24b9f8a3 tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/47f49c52-08b0-469c-8969-c9655c6ee39b" status: 200 len: 1647 microversion: 2.1 time: 0.264813 Aug 10 22:58:16.290125 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 297/636] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:58:16 2022] GET /compute/v2.1/servers/47f49c52-08b0-469c-8969-c9655c6ee39b => generated 1647 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:58:16.303342 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-897bc159-72e7-445e-955d-c241c3c46c91 req-bfb1f343-6d88-4583-ae69-dd80baddf44e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7599a318-7a19-4f4a-bbb6-162f7a207060", "name": "network-vif-plugged", "status": "completed", "tag": "f22c5d16-4ab5-4e8c-987e-74d273711590"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:58:16.326448 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-897bc159-72e7-445e-955d-c241c3c46c91 req-bfb1f343-6d88-4583-ae69-dd80baddf44e service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:16.327239 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-897bc159-72e7-445e-955d-c241c3c46c91 req-bfb1f343-6d88-4583-ae69-dd80baddf44e service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:16.327825 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-897bc159-72e7-445e-955d-c241c3c46c91 req-bfb1f343-6d88-4583-ae69-dd80baddf44e service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:16.361125 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-897bc159-72e7-445e-955d-c241c3c46c91 req-bfb1f343-6d88-4583-ae69-dd80baddf44e service nova] Creating event network-vif-plugged:f22c5d16-4ab5-4e8c-987e-74d273711590 for instance 7599a318-7a19-4f4a-bbb6-162f7a207060 on n-h1-850468-14 Aug 10 22:58:16.376770 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-897bc159-72e7-445e-955d-c241c3c46c91 req-bfb1f343-6d88-4583-ae69-dd80baddf44e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083971 Aug 10 22:58:16.377683 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 298/637] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 22:58:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:58:16.385479 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-240dceb6-06a3-43b6-b6a8-13b4672a1901 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:16.392574 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-240dceb6-06a3-43b6-b6a8-13b4672a1901 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 3e467caf-9d1e-4dc0-830d-585aeabc1e5a] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:16.407357 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-240dceb6-06a3-43b6-b6a8-13b4672a1901 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:16.407939 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-240dceb6-06a3-43b6-b6a8-13b4672a1901 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:16.408280 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-240dceb6-06a3-43b6-b6a8-13b4672a1901 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:16.408995 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-240dceb6-06a3-43b6-b6a8-13b4672a1901 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:16.409449 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-240dceb6-06a3-43b6-b6a8-13b4672a1901 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:16.410021 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-240dceb6-06a3-43b6-b6a8-13b4672a1901 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:16.942382 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-240dceb6-06a3-43b6-b6a8-13b4672a1901 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:16.951562 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-240dceb6-06a3-43b6-b6a8-13b4672a1901 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/3e467caf-9d1e-4dc0-830d-585aeabc1e5a" status: 200 len: 1472 microversion: 2.1 time: 0.572518 Aug 10 22:58:16.954871 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 299/638] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:58:16 2022] GET /compute/v2.1/servers/3e467caf-9d1e-4dc0-830d-585aeabc1e5a => generated 1472 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:58:16.961214 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-991aba9a-854d-4cc6-8ab8-4427a2f0adb3 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:16.962051 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-991aba9a-854d-4cc6-8ab8-4427a2f0adb3 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] [instance: eaea4cc7-b1b8-43a7-83a4-8cfc8a44f9c1] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:16.989801 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-991aba9a-854d-4cc6-8ab8-4427a2f0adb3 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:16.992711 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-991aba9a-854d-4cc6-8ab8-4427a2f0adb3 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:16.993491 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-991aba9a-854d-4cc6-8ab8-4427a2f0adb3 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:17.000403 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-991aba9a-854d-4cc6-8ab8-4427a2f0adb3 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:17.000931 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-991aba9a-854d-4cc6-8ab8-4427a2f0adb3 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:17.001376 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-991aba9a-854d-4cc6-8ab8-4427a2f0adb3 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:17.503023 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-991aba9a-854d-4cc6-8ab8-4427a2f0adb3 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:17.516979 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-991aba9a-854d-4cc6-8ab8-4427a2f0adb3 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:17.525293 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-991aba9a-854d-4cc6-8ab8-4427a2f0adb3 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:17.532595 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-991aba9a-854d-4cc6-8ab8-4427a2f0adb3 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] 10.222.0.58 "GET /compute/v2.1/servers/eaea4cc7-b1b8-43a7-83a4-8cfc8a44f9c1" status: 200 len: 1567 microversion: 2.25 time: 0.576201 Aug 10 22:58:17.552290 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 300/639] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 22:58:16 2022] GET /compute/v2.1/servers/eaea4cc7-b1b8-43a7-83a4-8cfc8a44f9c1 => generated 1567 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:58:17.566991 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-6a6ac2a3-e534-48c6-89da-27cb07f31610 tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:17.573435 n-d-850468-14 devstack@n-api.service[122632]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:58:17.573435 n-d-850468-14 devstack@n-api.service[122632]: warnings.warn(msg) Aug 10 22:58:17.581261 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6a6ac2a3-e534-48c6-89da-27cb07f31610 tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:17.581769 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6a6ac2a3-e534-48c6-89da-27cb07f31610 tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:17.582560 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6a6ac2a3-e534-48c6-89da-27cb07f31610 tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:17.583379 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6a6ac2a3-e534-48c6-89da-27cb07f31610 tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:17.583826 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6a6ac2a3-e534-48c6-89da-27cb07f31610 tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:17.584249 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6a6ac2a3-e534-48c6-89da-27cb07f31610 tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:17.631026 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-7dec9b7a-fd83-4a5c-aa1a-a60c5f3e8a21 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Flavor limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 22:58:17.631633 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-7dec9b7a-fd83-4a5c-aa1a-a60c5f3e8a21 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Image limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 22:58:17.632172 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-7dec9b7a-fd83-4a5c-aa1a-a60c5f3e8a21 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Flavor pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 22:58:17.632668 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-7dec9b7a-fd83-4a5c-aa1a-a60c5f3e8a21 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Image pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 22:58:17.633104 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-7dec9b7a-fd83-4a5c-aa1a-a60c5f3e8a21 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 22:58:17.656690 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7dec9b7a-fd83-4a5c-aa1a-a60c5f3e8a21 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:17.658927 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7dec9b7a-fd83-4a5c-aa1a-a60c5f3e8a21 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:17.659403 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7dec9b7a-fd83-4a5c-aa1a-a60c5f3e8a21 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:17.660731 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7dec9b7a-fd83-4a5c-aa1a-a60c5f3e8a21 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:17.661200 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7dec9b7a-fd83-4a5c-aa1a-a60c5f3e8a21 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:17.661633 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7dec9b7a-fd83-4a5c-aa1a-a60c5f3e8a21 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:17.693032 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-6a6ac2a3-e534-48c6-89da-27cb07f31610 tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] 10.222.0.58 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.138337 Aug 10 22:58:17.696291 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 301/640] 10.222.0.58 () {58 vars in 1176 bytes} [Wed Aug 10 22:58:17 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:58:17.705771 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-3efd5b2d-b008-4afa-820a-84d21adbcaa4 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:17.716138 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-7dec9b7a-fd83-4a5c-aa1a-a60c5f3e8a21 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Getting quotas for project 307ab95daa034afbb31f90626885072b. Resources: {'instances', 'cores', 'ram'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 22:58:17.718106 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-3efd5b2d-b008-4afa-820a-84d21adbcaa4 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] [instance: 7599a318-7a19-4f4a-bbb6-162f7a207060] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:17.729922 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-7dec9b7a-fd83-4a5c-aa1a-a60c5f3e8a21 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Getting quotas for user 7d6d9806b6724e5aaf8c69be8e70d4f3 and project 307ab95daa034afbb31f90626885072b. Resources: {'instances', 'cores', 'ram'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 22:58:17.735739 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3efd5b2d-b008-4afa-820a-84d21adbcaa4 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:17.736246 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3efd5b2d-b008-4afa-820a-84d21adbcaa4 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:17.736697 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3efd5b2d-b008-4afa-820a-84d21adbcaa4 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:17.737413 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3efd5b2d-b008-4afa-820a-84d21adbcaa4 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:17.747685 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3efd5b2d-b008-4afa-820a-84d21adbcaa4 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:17.750331 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3efd5b2d-b008-4afa-820a-84d21adbcaa4 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:17.763628 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-7dec9b7a-fd83-4a5c-aa1a-a60c5f3e8a21 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Going to run 1 instances... {{(pid=122633) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 22:58:17.771492 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-7dec9b7a-fd83-4a5c-aa1a-a60c5f3e8a21 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] [instance: ce82674f-e3eb-4e97-acd3-b4da01015330] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78ad8905-f66f-4733-8be9-2b260f1fabed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122633) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 22:58:17.903718 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-7dec9b7a-fd83-4a5c-aa1a-a60c5f3e8a21 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.123071 Aug 10 22:58:17.904816 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 340/641] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 22:58:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 2125 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 22:58:17.923451 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-4dcc664b-2909-4a61-b973-ee87fdb954de tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-850468-14", "block_migration": true, "disk_over_commit": false}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:58:17.931126 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-4dcc664b-2909-4a61-b973-ee87fdb954de tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] [instance: 47f49c52-08b0-469c-8969-c9655c6ee39b] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:17.971196 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4dcc664b-2909-4a61-b973-ee87fdb954de tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:17.976335 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4dcc664b-2909-4a61-b973-ee87fdb954de tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:17.977091 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4dcc664b-2909-4a61-b973-ee87fdb954de tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:17.988691 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4dcc664b-2909-4a61-b973-ee87fdb954de tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:17.993486 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4dcc664b-2909-4a61-b973-ee87fdb954de tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:17.995284 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4dcc664b-2909-4a61-b973-ee87fdb954de tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:18.110660 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.objects.instance [None req-4dcc664b-2909-4a61-b973-ee87fdb954de tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Lazy-loading 'flavor' on Instance uuid 47f49c52-08b0-469c-8969-c9655c6ee39b {{(pid=122633) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 22:58:18.158325 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-4dcc664b-2909-4a61-b973-ee87fdb954de tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] [instance: 47f49c52-08b0-469c-8969-c9655c6ee39b] Going to try to live migrate instance to n-h1-850468-14 {{(pid=122633) live_migrate /opt/stack/nova/nova/compute/api.py:5443}} Aug 10 22:58:18.699960 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-3efd5b2d-b008-4afa-820a-84d21adbcaa4 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0415b5bdb48249d6b9f1ef7c92aad597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29083d61c29b43b4b47539a141b3d1fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:18.718840 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-3efd5b2d-b008-4afa-820a-84d21adbcaa4 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] 10.222.0.58 "GET /compute/v2.1/servers/7599a318-7a19-4f4a-bbb6-162f7a207060" status: 200 len: 1371 microversion: 2.1 time: 1.018823 Aug 10 22:58:18.723757 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 302/642] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:58:17 2022] GET /compute/v2.1/servers/7599a318-7a19-4f4a-bbb6-162f7a207060 => generated 1371 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:58:18.733299 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-3dc90c18-4743-472d-9d4c-ad0763f086c9 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:18.741680 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-3dc90c18-4743-472d-9d4c-ad0763f086c9 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] [instance: ce82674f-e3eb-4e97-acd3-b4da01015330] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:19.076782 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-3dc90c18-4743-472d-9d4c-ad0763f086c9 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6d9806b6724e5aaf8c69be8e70d4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307ab95daa034afbb31f90626885072b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:19.087189 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-3dc90c18-4743-472d-9d4c-ad0763f086c9 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] 10.222.0.58 "GET /compute/v2.1/servers/ce82674f-e3eb-4e97-acd3-b4da01015330" status: 200 len: 1207 microversion: 2.1 time: 0.361664 Aug 10 22:58:19.088374 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 303/643] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:58:18 2022] GET /compute/v2.1/servers/ce82674f-e3eb-4e97-acd3-b4da01015330 => generated 1207 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:58:19.100964 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-1088878e-eb31-44b6-95e5-716744181455 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:19.105898 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-1088878e-eb31-44b6-95e5-716744181455 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 3e467caf-9d1e-4dc0-830d-585aeabc1e5a] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:19.119650 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1088878e-eb31-44b6-95e5-716744181455 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:19.120284 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1088878e-eb31-44b6-95e5-716744181455 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:19.123910 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1088878e-eb31-44b6-95e5-716744181455 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:19.125083 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1088878e-eb31-44b6-95e5-716744181455 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:19.126637 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1088878e-eb31-44b6-95e5-716744181455 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:19.127286 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1088878e-eb31-44b6-95e5-716744181455 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:19.839345 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-1088878e-eb31-44b6-95e5-716744181455 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:19.853726 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-1088878e-eb31-44b6-95e5-716744181455 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/3e467caf-9d1e-4dc0-830d-585aeabc1e5a" status: 200 len: 1472 microversion: 2.1 time: 0.761341 Aug 10 22:58:19.854331 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 304/644] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:58:19 2022] GET /compute/v2.1/servers/3e467caf-9d1e-4dc0-830d-585aeabc1e5a => generated 1472 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:58:19.859187 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-5e3fc8b6-ee31-4b9b-a13c-495459b03694 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:19.859799 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-5e3fc8b6-ee31-4b9b-a13c-495459b03694 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] [instance: eaea4cc7-b1b8-43a7-83a4-8cfc8a44f9c1] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:19.875759 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5e3fc8b6-ee31-4b9b-a13c-495459b03694 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:19.876249 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5e3fc8b6-ee31-4b9b-a13c-495459b03694 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:19.876699 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5e3fc8b6-ee31-4b9b-a13c-495459b03694 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:19.877454 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5e3fc8b6-ee31-4b9b-a13c-495459b03694 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:19.877911 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5e3fc8b6-ee31-4b9b-a13c-495459b03694 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:19.878340 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5e3fc8b6-ee31-4b9b-a13c-495459b03694 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:20.615979 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-5e3fc8b6-ee31-4b9b-a13c-495459b03694 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:20.625430 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-5e3fc8b6-ee31-4b9b-a13c-495459b03694 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:20.627052 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-5e3fc8b6-ee31-4b9b-a13c-495459b03694 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:20.628452 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-5e3fc8b6-ee31-4b9b-a13c-495459b03694 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] 10.222.0.58 "GET /compute/v2.1/servers/eaea4cc7-b1b8-43a7-83a4-8cfc8a44f9c1" status: 200 len: 1567 microversion: 2.25 time: 0.772784 Aug 10 22:58:20.632827 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 305/645] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 22:58:19 2022] GET /compute/v2.1/servers/eaea4cc7-b1b8-43a7-83a4-8cfc8a44f9c1 => generated 1567 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:58:20.641548 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-19f8d0e4-313c-443b-92f5-355267b1f5f1 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:20.642056 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-19f8d0e4-313c-443b-92f5-355267b1f5f1 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] [instance: e773ec0c-0cd0-4a08-b9f0-5c2d0a342751] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:20.655502 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-19f8d0e4-313c-443b-92f5-355267b1f5f1 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:20.656246 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-19f8d0e4-313c-443b-92f5-355267b1f5f1 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:20.656851 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-19f8d0e4-313c-443b-92f5-355267b1f5f1 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:20.658131 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-19f8d0e4-313c-443b-92f5-355267b1f5f1 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:20.663375 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-19f8d0e4-313c-443b-92f5-355267b1f5f1 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:20.664226 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-19f8d0e4-313c-443b-92f5-355267b1f5f1 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:20.728813 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-19f8d0e4-313c-443b-92f5-355267b1f5f1 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] [instance: e773ec0c-0cd0-4a08-b9f0-5c2d0a342751] Going to try to terminate instance {{(pid=122632) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 22:58:20.732321 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:58:20.848096 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-19f8d0e4-313c-443b-92f5-355267b1f5f1 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] 10.222.0.58 "DELETE /compute/v2.1/servers/e773ec0c-0cd0-4a08-b9f0-5c2d0a342751" status: 204 len: 0 microversion: 2.1 time: 0.213486 Aug 10 22:58:20.853407 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 306/646] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 22:58:20 2022] DELETE /compute/v2.1/servers/e773ec0c-0cd0-4a08-b9f0-5c2d0a342751 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 22:58:20.860978 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-2a28af7a-0229-4d4e-9632-3381af20e4ad tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:20.862050 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-2a28af7a-0229-4d4e-9632-3381af20e4ad tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] [instance: 7599a318-7a19-4f4a-bbb6-162f7a207060] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:20.871777 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2a28af7a-0229-4d4e-9632-3381af20e4ad tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:20.872273 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2a28af7a-0229-4d4e-9632-3381af20e4ad tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:20.872780 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2a28af7a-0229-4d4e-9632-3381af20e4ad tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:20.873499 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2a28af7a-0229-4d4e-9632-3381af20e4ad tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:20.874013 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2a28af7a-0229-4d4e-9632-3381af20e4ad tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:20.874441 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2a28af7a-0229-4d4e-9632-3381af20e4ad tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:21.632048 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-2a28af7a-0229-4d4e-9632-3381af20e4ad tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0415b5bdb48249d6b9f1ef7c92aad597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29083d61c29b43b4b47539a141b3d1fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:21.641370 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-2a28af7a-0229-4d4e-9632-3381af20e4ad tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] 10.222.0.58 "GET /compute/v2.1/servers/7599a318-7a19-4f4a-bbb6-162f7a207060" status: 200 len: 1556 microversion: 2.1 time: 0.785859 Aug 10 22:58:21.641958 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 307/647] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:58:20 2022] GET /compute/v2.1/servers/7599a318-7a19-4f4a-bbb6-162f7a207060 => generated 1556 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:58:21.678679 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-ce67f1a5-1a17-4db0-a630-f01b3d71ede0 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:21.679653 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-ce67f1a5-1a17-4db0-a630-f01b3d71ede0 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] [instance: ce82674f-e3eb-4e97-acd3-b4da01015330] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:21.691806 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ce67f1a5-1a17-4db0-a630-f01b3d71ede0 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:21.692399 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ce67f1a5-1a17-4db0-a630-f01b3d71ede0 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:21.692910 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ce67f1a5-1a17-4db0-a630-f01b3d71ede0 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:21.693978 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ce67f1a5-1a17-4db0-a630-f01b3d71ede0 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:21.694567 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ce67f1a5-1a17-4db0-a630-f01b3d71ede0 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:21.695117 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ce67f1a5-1a17-4db0-a630-f01b3d71ede0 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:21.862831 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-ce67f1a5-1a17-4db0-a630-f01b3d71ede0 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6d9806b6724e5aaf8c69be8e70d4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307ab95daa034afbb31f90626885072b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:21.874074 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-ce67f1a5-1a17-4db0-a630-f01b3d71ede0 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] 10.222.0.58 "GET /compute/v2.1/servers/ce82674f-e3eb-4e97-acd3-b4da01015330" status: 200 len: 1265 microversion: 2.1 time: 0.203540 Aug 10 22:58:21.887730 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 308/648] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:58:21 2022] GET /compute/v2.1/servers/ce82674f-e3eb-4e97-acd3-b4da01015330 => generated 1265 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:58:21.895019 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-f4b3e286-6d49-478e-8dca-3043656c8b80 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:21.895961 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-f4b3e286-6d49-478e-8dca-3043656c8b80 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] [instance: e773ec0c-0cd0-4a08-b9f0-5c2d0a342751] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:21.903481 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f4b3e286-6d49-478e-8dca-3043656c8b80 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:21.904250 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f4b3e286-6d49-478e-8dca-3043656c8b80 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:21.904925 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f4b3e286-6d49-478e-8dca-3043656c8b80 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:21.906367 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f4b3e286-6d49-478e-8dca-3043656c8b80 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:21.907225 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f4b3e286-6d49-478e-8dca-3043656c8b80 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:21.908024 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f4b3e286-6d49-478e-8dca-3043656c8b80 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:22.087738 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-4dcc664b-2909-4a61-b973-ee87fdb954de tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/47f49c52-08b0-469c-8969-c9655c6ee39b/action" status: 202 len: 0 microversion: 2.1 time: 4.181772 Aug 10 22:58:22.091733 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 341/649] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 22:58:17 2022] POST /compute/v2.1/servers/47f49c52-08b0-469c-8969-c9655c6ee39b/action => generated 0 bytes in 4186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 22:58:22.096672 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-11a698c5-64d9-402a-a092-b37911a33422 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:22.098272 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-11a698c5-64d9-402a-a092-b37911a33422 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 3e467caf-9d1e-4dc0-830d-585aeabc1e5a] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:22.105668 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-11a698c5-64d9-402a-a092-b37911a33422 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:22.111062 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-11a698c5-64d9-402a-a092-b37911a33422 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:22.113713 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-11a698c5-64d9-402a-a092-b37911a33422 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:22.115577 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-11a698c5-64d9-402a-a092-b37911a33422 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:22.116201 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-11a698c5-64d9-402a-a092-b37911a33422 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:22.118328 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-11a698c5-64d9-402a-a092-b37911a33422 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:22.319043 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-11a698c5-64d9-402a-a092-b37911a33422 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:22.331037 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-11a698c5-64d9-402a-a092-b37911a33422 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/3e467caf-9d1e-4dc0-830d-585aeabc1e5a" status: 200 len: 1472 microversion: 2.1 time: 0.237900 Aug 10 22:58:22.332575 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 342/650] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:58:22 2022] GET /compute/v2.1/servers/3e467caf-9d1e-4dc0-830d-585aeabc1e5a => generated 1472 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:58:22.345642 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-d2cca206-8d36-4ddc-bf76-75c3af2e745f tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:22.356768 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-d2cca206-8d36-4ddc-bf76-75c3af2e745f tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] [instance: eaea4cc7-b1b8-43a7-83a4-8cfc8a44f9c1] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:22.388338 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d2cca206-8d36-4ddc-bf76-75c3af2e745f tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:22.389135 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d2cca206-8d36-4ddc-bf76-75c3af2e745f tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:22.389531 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d2cca206-8d36-4ddc-bf76-75c3af2e745f tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:22.390242 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d2cca206-8d36-4ddc-bf76-75c3af2e745f tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:22.390699 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d2cca206-8d36-4ddc-bf76-75c3af2e745f tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:22.391147 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d2cca206-8d36-4ddc-bf76-75c3af2e745f tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:22.392496 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-f4b3e286-6d49-478e-8dca-3043656c8b80 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaed2a2e56f749a88c340aaccb15d2d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deaba512051743deb45881d76eb206ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:22.402850 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-f4b3e286-6d49-478e-8dca-3043656c8b80 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] 10.222.0.58 "GET /compute/v2.1/servers/e773ec0c-0cd0-4a08-b9f0-5c2d0a342751" status: 200 len: 1710 microversion: 2.1 time: 0.513294 Aug 10 22:58:22.403898 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 309/651] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:58:21 2022] GET /compute/v2.1/servers/e773ec0c-0cd0-4a08-b9f0-5c2d0a342751 => generated 1710 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:58:22.414577 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-5e93b0db-3c9c-411c-a620-8edbaf59c30d tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:22.417014 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-5e93b0db-3c9c-411c-a620-8edbaf59c30d tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] [instance: 7599a318-7a19-4f4a-bbb6-162f7a207060] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:22.444632 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5e93b0db-3c9c-411c-a620-8edbaf59c30d tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:22.445363 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5e93b0db-3c9c-411c-a620-8edbaf59c30d tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:22.446369 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5e93b0db-3c9c-411c-a620-8edbaf59c30d tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:22.447295 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5e93b0db-3c9c-411c-a620-8edbaf59c30d tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:22.448482 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5e93b0db-3c9c-411c-a620-8edbaf59c30d tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:22.449062 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5e93b0db-3c9c-411c-a620-8edbaf59c30d tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:22.642617 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-5e93b0db-3c9c-411c-a620-8edbaf59c30d tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] 10.222.0.58 "GET /compute/v2.1/servers/7599a318-7a19-4f4a-bbb6-162f7a207060/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.235833 Aug 10 22:58:22.644933 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 310/652] 10.222.0.58 () {58 vars in 1275 bytes} [Wed Aug 10 22:58:22 2022] GET /compute/v2.1/servers/7599a318-7a19-4f4a-bbb6-162f7a207060/os-interface => generated 284 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:58:22.650773 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-153b6218-448b-4089-974b-14fc02a7c17a tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:22.651683 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-153b6218-448b-4089-974b-14fc02a7c17a tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] [instance: 47f49c52-08b0-469c-8969-c9655c6ee39b] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:22.660985 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-153b6218-448b-4089-974b-14fc02a7c17a tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:22.661910 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-153b6218-448b-4089-974b-14fc02a7c17a tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:22.662565 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-153b6218-448b-4089-974b-14fc02a7c17a tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:22.665447 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-153b6218-448b-4089-974b-14fc02a7c17a tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:22.669334 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-153b6218-448b-4089-974b-14fc02a7c17a tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:22.670048 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-153b6218-448b-4089-974b-14fc02a7c17a tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:22.825351 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-d2cca206-8d36-4ddc-bf76-75c3af2e745f tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:22.837380 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-d2cca206-8d36-4ddc-bf76-75c3af2e745f tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:22.842068 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-d2cca206-8d36-4ddc-bf76-75c3af2e745f tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:22.844401 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-d2cca206-8d36-4ddc-bf76-75c3af2e745f tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] 10.222.0.58 "GET /compute/v2.1/servers/eaea4cc7-b1b8-43a7-83a4-8cfc8a44f9c1" status: 200 len: 1567 microversion: 2.25 time: 0.510388 Aug 10 22:58:22.851264 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 343/653] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 22:58:22 2022] GET /compute/v2.1/servers/eaea4cc7-b1b8-43a7-83a4-8cfc8a44f9c1 => generated 1567 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:58:22.870821 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-912da144-a792-4339-8f8f-eeee064de183 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-2000287340", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452", "networks": [{"uuid": "2be996ec-9fab-4768-8a24-5648297e4335"}], "security_groups": [{"name": "tempest-securitygroup--487531786"}], "key_name": "tempest-keypair-1315665311", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:58:23.111464 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.network.neutron [None req-912da144-a792-4339-8f8f-eeee064de183 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] validate_networks() for [('2be996ec-9fab-4768-8a24-5648297e4335', None, None, None, None, None)] {{(pid=122633) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 22:58:23.291004 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-153b6218-448b-4089-974b-14fc02a7c17a tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632904331d024d9b8e4d3660dff2cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ed0bdee3aa4013bd9219069bda558c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:23.299586 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-153b6218-448b-4089-974b-14fc02a7c17a tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] 10.222.0.58 "GET /compute/v2.1/servers/47f49c52-08b0-469c-8969-c9655c6ee39b" status: 200 len: 1504 microversion: 2.1 time: 0.653250 Aug 10 22:58:23.300443 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 311/654] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:58:22 2022] GET /compute/v2.1/servers/47f49c52-08b0-469c-8969-c9655c6ee39b => generated 1504 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:58:23.306658 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-7a460add-1e55-4187-a499-d6d5f6c603f7 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:23.307698 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-7a460add-1e55-4187-a499-d6d5f6c603f7 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] [instance: ce82674f-e3eb-4e97-acd3-b4da01015330] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:23.320212 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7a460add-1e55-4187-a499-d6d5f6c603f7 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:23.320709 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7a460add-1e55-4187-a499-d6d5f6c603f7 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:23.321215 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7a460add-1e55-4187-a499-d6d5f6c603f7 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:23.322552 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7a460add-1e55-4187-a499-d6d5f6c603f7 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:23.322552 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7a460add-1e55-4187-a499-d6d5f6c603f7 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:23.322868 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7a460add-1e55-4187-a499-d6d5f6c603f7 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:24.233622 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-7a460add-1e55-4187-a499-d6d5f6c603f7 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6d9806b6724e5aaf8c69be8e70d4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307ab95daa034afbb31f90626885072b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:24.248210 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-7a460add-1e55-4187-a499-d6d5f6c603f7 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] 10.222.0.58 "GET /compute/v2.1/servers/ce82674f-e3eb-4e97-acd3-b4da01015330" status: 200 len: 1307 microversion: 2.1 time: 0.945962 Aug 10 22:58:24.257458 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 312/655] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:58:23 2022] GET /compute/v2.1/servers/ce82674f-e3eb-4e97-acd3-b4da01015330 => generated 1307 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:58:24.276552 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-418b4b42-d454-4848-82f9-25ae71d89954 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:24.279752 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-418b4b42-d454-4848-82f9-25ae71d89954 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 3e467caf-9d1e-4dc0-830d-585aeabc1e5a] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:24.288817 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-418b4b42-d454-4848-82f9-25ae71d89954 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:24.289522 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-418b4b42-d454-4848-82f9-25ae71d89954 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:24.290814 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-418b4b42-d454-4848-82f9-25ae71d89954 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:24.291646 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-418b4b42-d454-4848-82f9-25ae71d89954 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:24.292205 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-418b4b42-d454-4848-82f9-25ae71d89954 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:24.293415 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-418b4b42-d454-4848-82f9-25ae71d89954 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:24.340136 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-912da144-a792-4339-8f8f-eeee064de183 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Flavor limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 22:58:24.341150 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-912da144-a792-4339-8f8f-eeee064de183 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Image limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 22:58:24.341794 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-912da144-a792-4339-8f8f-eeee064de183 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Flavor pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 22:58:24.342347 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-912da144-a792-4339-8f8f-eeee064de183 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Image pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 22:58:24.342948 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-912da144-a792-4339-8f8f-eeee064de183 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 22:58:24.353420 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-912da144-a792-4339-8f8f-eeee064de183 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:24.354098 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-912da144-a792-4339-8f8f-eeee064de183 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:24.354837 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-912da144-a792-4339-8f8f-eeee064de183 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:24.355875 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-912da144-a792-4339-8f8f-eeee064de183 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:24.356468 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-912da144-a792-4339-8f8f-eeee064de183 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:24.357053 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-912da144-a792-4339-8f8f-eeee064de183 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:24.383557 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-912da144-a792-4339-8f8f-eeee064de183 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Getting quotas for project eae334ad72ba421797a6d836edcbab0c. Resources: {'instances', 'cores', 'ram'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 22:58:24.388815 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-912da144-a792-4339-8f8f-eeee064de183 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Getting quotas for user 6e437f9eb7254dc98e2839656c053f2d and project eae334ad72ba421797a6d836edcbab0c. Resources: {'instances', 'cores', 'ram'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 22:58:24.403988 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-912da144-a792-4339-8f8f-eeee064de183 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Going to run 1 instances... {{(pid=122633) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 22:58:24.406350 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-912da144-a792-4339-8f8f-eeee064de183 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] [instance: 3553ba91-ca7b-44d9-944a-1540fa047cb6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78ad8905-f66f-4733-8be9-2b260f1fabed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122633) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 22:58:24.489117 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-912da144-a792-4339-8f8f-eeee064de183 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.622275 Aug 10 22:58:24.490368 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 344/656] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 22:58:22 2022] POST /compute/v2.1/servers => generated 405 bytes in 1642 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 22:58:24.504060 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-bf1a807b-42f1-4d6d-9b8d-a0c7f9343e62 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:24.505087 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-bf1a807b-42f1-4d6d-9b8d-a0c7f9343e62 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] [instance: e773ec0c-0cd0-4a08-b9f0-5c2d0a342751] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:24.515169 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bf1a807b-42f1-4d6d-9b8d-a0c7f9343e62 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:24.515667 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bf1a807b-42f1-4d6d-9b8d-a0c7f9343e62 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:24.516183 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bf1a807b-42f1-4d6d-9b8d-a0c7f9343e62 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:24.516894 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bf1a807b-42f1-4d6d-9b8d-a0c7f9343e62 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:24.517394 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bf1a807b-42f1-4d6d-9b8d-a0c7f9343e62 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:24.517872 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bf1a807b-42f1-4d6d-9b8d-a0c7f9343e62 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:24.675175 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-bf1a807b-42f1-4d6d-9b8d-a0c7f9343e62 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaed2a2e56f749a88c340aaccb15d2d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deaba512051743deb45881d76eb206ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:24.691340 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-bf1a807b-42f1-4d6d-9b8d-a0c7f9343e62 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] 10.222.0.58 "GET /compute/v2.1/servers/e773ec0c-0cd0-4a08-b9f0-5c2d0a342751" status: 200 len: 1642 microversion: 2.1 time: 0.197833 Aug 10 22:58:24.693468 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 345/657] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:58:24 2022] GET /compute/v2.1/servers/e773ec0c-0cd0-4a08-b9f0-5c2d0a342751 => generated 1642 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:58:24.707884 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-260d9bb0-f16a-4698-adc5-ad6bb22c27e7 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:24.712786 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-260d9bb0-f16a-4698-adc5-ad6bb22c27e7 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] [instance: eaea4cc7-b1b8-43a7-83a4-8cfc8a44f9c1] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:24.726596 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-260d9bb0-f16a-4698-adc5-ad6bb22c27e7 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:24.727374 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-260d9bb0-f16a-4698-adc5-ad6bb22c27e7 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:24.727848 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-260d9bb0-f16a-4698-adc5-ad6bb22c27e7 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:24.728638 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-260d9bb0-f16a-4698-adc5-ad6bb22c27e7 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:24.729090 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-260d9bb0-f16a-4698-adc5-ad6bb22c27e7 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:24.729514 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-260d9bb0-f16a-4698-adc5-ad6bb22c27e7 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:25.155021 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-418b4b42-d454-4848-82f9-25ae71d89954 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:25.171876 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-418b4b42-d454-4848-82f9-25ae71d89954 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/3e467caf-9d1e-4dc0-830d-585aeabc1e5a" status: 200 len: 1477 microversion: 2.1 time: 0.904438 Aug 10 22:58:25.172782 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 313/658] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:58:24 2022] GET /compute/v2.1/servers/3e467caf-9d1e-4dc0-830d-585aeabc1e5a => generated 1477 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:58:25.177888 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-9dac0d68-7a86-48c2-906e-ae52b9fbc060 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:25.178685 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-9dac0d68-7a86-48c2-906e-ae52b9fbc060 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] [instance: 47f49c52-08b0-469c-8969-c9655c6ee39b] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:25.195146 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9dac0d68-7a86-48c2-906e-ae52b9fbc060 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:25.196025 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9dac0d68-7a86-48c2-906e-ae52b9fbc060 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:25.196616 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9dac0d68-7a86-48c2-906e-ae52b9fbc060 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:25.197599 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9dac0d68-7a86-48c2-906e-ae52b9fbc060 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:25.198199 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9dac0d68-7a86-48c2-906e-ae52b9fbc060 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:25.198853 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9dac0d68-7a86-48c2-906e-ae52b9fbc060 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:25.286607 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-260d9bb0-f16a-4698-adc5-ad6bb22c27e7 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:25.302117 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-260d9bb0-f16a-4698-adc5-ad6bb22c27e7 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:25.304181 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-260d9bb0-f16a-4698-adc5-ad6bb22c27e7 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:25.312524 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-260d9bb0-f16a-4698-adc5-ad6bb22c27e7 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] 10.222.0.58 "GET /compute/v2.1/servers/eaea4cc7-b1b8-43a7-83a4-8cfc8a44f9c1" status: 200 len: 1567 microversion: 2.25 time: 0.616525 Aug 10 22:58:25.328174 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 346/659] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 22:58:24 2022] GET /compute/v2.1/servers/eaea4cc7-b1b8-43a7-83a4-8cfc8a44f9c1 => generated 1567 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:58:25.337625 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-6009c7b6-722c-448f-aa51-cc2bc128c362 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:25.338770 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-6009c7b6-722c-448f-aa51-cc2bc128c362 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] [instance: 3553ba91-ca7b-44d9-944a-1540fa047cb6] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:25.466621 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-6009c7b6-722c-448f-aa51-cc2bc128c362 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e437f9eb7254dc98e2839656c053f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eae334ad72ba421797a6d836edcbab0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:25.482005 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-6009c7b6-722c-448f-aa51-cc2bc128c362 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] 10.222.0.58 "GET /compute/v2.1/servers/3553ba91-ca7b-44d9-944a-1540fa047cb6" status: 200 len: 1242 microversion: 2.1 time: 0.149325 Aug 10 22:58:25.482668 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 347/660] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:58:25 2022] GET /compute/v2.1/servers/3553ba91-ca7b-44d9-944a-1540fa047cb6 => generated 1242 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:58:25.507894 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-76b86d9f-db29-4b7d-8726-edfc8bb85dbb req-2ac33636-469d-4d2f-87ed-4c687a6693ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e773ec0c-0cd0-4a08-b9f0-5c2d0a342751", "name": "network-vif-deleted", "tag": "4509aea6-eb69-433a-9c36-162726644a47"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:58:25.538102 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-76b86d9f-db29-4b7d-8726-edfc8bb85dbb req-2ac33636-469d-4d2f-87ed-4c687a6693ac service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:25.539589 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-76b86d9f-db29-4b7d-8726-edfc8bb85dbb req-2ac33636-469d-4d2f-87ed-4c687a6693ac service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:25.540262 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-76b86d9f-db29-4b7d-8726-edfc8bb85dbb req-2ac33636-469d-4d2f-87ed-4c687a6693ac service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:25.584257 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-76b86d9f-db29-4b7d-8726-edfc8bb85dbb req-2ac33636-469d-4d2f-87ed-4c687a6693ac service nova] Creating event network-vif-deleted:4509aea6-eb69-433a-9c36-162726644a47 for instance e773ec0c-0cd0-4a08-b9f0-5c2d0a342751 on n-h2-850468-14 Aug 10 22:58:25.604618 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-76b86d9f-db29-4b7d-8726-edfc8bb85dbb req-2ac33636-469d-4d2f-87ed-4c687a6693ac service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101479 Aug 10 22:58:25.607607 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 348/661] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 22:58:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:58:25.623216 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-3ce2b8a5-cb87-4955-9695-7680c6eb4038 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:25.627100 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-3ce2b8a5-cb87-4955-9695-7680c6eb4038 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] [instance: ce82674f-e3eb-4e97-acd3-b4da01015330] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:25.647777 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3ce2b8a5-cb87-4955-9695-7680c6eb4038 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:25.650642 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3ce2b8a5-cb87-4955-9695-7680c6eb4038 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:25.651692 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3ce2b8a5-cb87-4955-9695-7680c6eb4038 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:25.652452 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3ce2b8a5-cb87-4955-9695-7680c6eb4038 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:25.652912 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3ce2b8a5-cb87-4955-9695-7680c6eb4038 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:25.658074 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3ce2b8a5-cb87-4955-9695-7680c6eb4038 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:25.704090 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-9dac0d68-7a86-48c2-906e-ae52b9fbc060 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632904331d024d9b8e4d3660dff2cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ed0bdee3aa4013bd9219069bda558c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:25.717550 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-9dac0d68-7a86-48c2-906e-ae52b9fbc060 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] 10.222.0.58 "GET /compute/v2.1/servers/47f49c52-08b0-469c-8969-c9655c6ee39b" status: 200 len: 1504 microversion: 2.1 time: 0.543702 Aug 10 22:58:25.718416 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 314/662] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:58:25 2022] GET /compute/v2.1/servers/47f49c52-08b0-469c-8969-c9655c6ee39b => generated 1504 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:58:25.735035 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-92c1baee-7805-4f59-8f1d-c6dac5cad554 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:25.735873 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-92c1baee-7805-4f59-8f1d-c6dac5cad554 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] [instance: e773ec0c-0cd0-4a08-b9f0-5c2d0a342751] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:25.749506 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-92c1baee-7805-4f59-8f1d-c6dac5cad554 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:25.750181 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-92c1baee-7805-4f59-8f1d-c6dac5cad554 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:25.750777 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-92c1baee-7805-4f59-8f1d-c6dac5cad554 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:25.756732 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-92c1baee-7805-4f59-8f1d-c6dac5cad554 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:25.757362 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-92c1baee-7805-4f59-8f1d-c6dac5cad554 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:25.757947 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-92c1baee-7805-4f59-8f1d-c6dac5cad554 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:25.836339 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-92c1baee-7805-4f59-8f1d-c6dac5cad554 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:25.836834 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-92c1baee-7805-4f59-8f1d-c6dac5cad554 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:25.837341 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-92c1baee-7805-4f59-8f1d-c6dac5cad554 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:25.837965 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.objects.instance [None req-92c1baee-7805-4f59-8f1d-c6dac5cad554 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Lazy-loading 'fault' on Instance uuid e773ec0c-0cd0-4a08-b9f0-5c2d0a342751 {{(pid=122632) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 22:58:25.981028 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-92c1baee-7805-4f59-8f1d-c6dac5cad554 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaed2a2e56f749a88c340aaccb15d2d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'deaba512051743deb45881d76eb206ed', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:25.995596 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-92c1baee-7805-4f59-8f1d-c6dac5cad554 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] 10.222.0.58 "GET /compute/v2.1/servers/e773ec0c-0cd0-4a08-b9f0-5c2d0a342751" status: 200 len: 1349 microversion: 2.1 time: 0.275947 Aug 10 22:58:25.996394 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 315/663] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:58:25 2022] GET /compute/v2.1/servers/e773ec0c-0cd0-4a08-b9f0-5c2d0a342751 => generated 1349 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:58:26.128284 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-3ce2b8a5-cb87-4955-9695-7680c6eb4038 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6d9806b6724e5aaf8c69be8e70d4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307ab95daa034afbb31f90626885072b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:26.141461 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-3ce2b8a5-cb87-4955-9695-7680c6eb4038 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] 10.222.0.58 "GET /compute/v2.1/servers/ce82674f-e3eb-4e97-acd3-b4da01015330" status: 200 len: 1307 microversion: 2.1 time: 0.532175 Aug 10 22:58:26.154466 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 349/664] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:58:25 2022] GET /compute/v2.1/servers/ce82674f-e3eb-4e97-acd3-b4da01015330 => generated 1307 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:58:26.207424 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-1b2e2e32-4e1c-492b-aa06-0e0a8bed7e5c tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:26.209724 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-1b2e2e32-4e1c-492b-aa06-0e0a8bed7e5c tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 3e467caf-9d1e-4dc0-830d-585aeabc1e5a] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:26.225886 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1b2e2e32-4e1c-492b-aa06-0e0a8bed7e5c tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:26.228589 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1b2e2e32-4e1c-492b-aa06-0e0a8bed7e5c tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:26.229320 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1b2e2e32-4e1c-492b-aa06-0e0a8bed7e5c tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:26.233792 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1b2e2e32-4e1c-492b-aa06-0e0a8bed7e5c tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:26.234570 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1b2e2e32-4e1c-492b-aa06-0e0a8bed7e5c tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:26.237150 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1b2e2e32-4e1c-492b-aa06-0e0a8bed7e5c tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:26.338190 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-212c4add-fa4b-49f8-97f0-42fe087fdd67 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:26.339129 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-212c4add-fa4b-49f8-97f0-42fe087fdd67 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] [instance: eaea4cc7-b1b8-43a7-83a4-8cfc8a44f9c1] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:26.356510 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-212c4add-fa4b-49f8-97f0-42fe087fdd67 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:26.357249 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-212c4add-fa4b-49f8-97f0-42fe087fdd67 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:26.357884 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-212c4add-fa4b-49f8-97f0-42fe087fdd67 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:26.358608 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-212c4add-fa4b-49f8-97f0-42fe087fdd67 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:26.359094 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-212c4add-fa4b-49f8-97f0-42fe087fdd67 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:26.359524 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-212c4add-fa4b-49f8-97f0-42fe087fdd67 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:26.376628 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:58:26.822114 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-212c4add-fa4b-49f8-97f0-42fe087fdd67 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:26.836772 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-212c4add-fa4b-49f8-97f0-42fe087fdd67 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:26.841047 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-212c4add-fa4b-49f8-97f0-42fe087fdd67 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:26.844094 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-212c4add-fa4b-49f8-97f0-42fe087fdd67 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] 10.222.0.58 "GET /compute/v2.1/servers/eaea4cc7-b1b8-43a7-83a4-8cfc8a44f9c1" status: 200 len: 1542 microversion: 2.25 time: 0.510272 Aug 10 22:58:26.860061 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 350/665] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 22:58:26 2022] GET /compute/v2.1/servers/eaea4cc7-b1b8-43a7-83a4-8cfc8a44f9c1 => generated 1542 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 22:58:26.877721 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-51cb3eb4-64ed-4952-ad3c-fc224bddb373 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:26.878567 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-51cb3eb4-64ed-4952-ad3c-fc224bddb373 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] [instance: 3553ba91-ca7b-44d9-944a-1540fa047cb6] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:26.886904 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-51cb3eb4-64ed-4952-ad3c-fc224bddb373 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:26.887955 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-51cb3eb4-64ed-4952-ad3c-fc224bddb373 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:26.888630 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-51cb3eb4-64ed-4952-ad3c-fc224bddb373 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:26.889563 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-51cb3eb4-64ed-4952-ad3c-fc224bddb373 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:26.890886 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-51cb3eb4-64ed-4952-ad3c-fc224bddb373 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:26.891531 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-51cb3eb4-64ed-4952-ad3c-fc224bddb373 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:27.156046 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-51cb3eb4-64ed-4952-ad3c-fc224bddb373 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e437f9eb7254dc98e2839656c053f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eae334ad72ba421797a6d836edcbab0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:27.165341 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-51cb3eb4-64ed-4952-ad3c-fc224bddb373 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] 10.222.0.58 "GET /compute/v2.1/servers/3553ba91-ca7b-44d9-944a-1540fa047cb6" status: 200 len: 1312 microversion: 2.1 time: 0.302801 Aug 10 22:58:27.172538 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 351/666] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:58:26 2022] GET /compute/v2.1/servers/3553ba91-ca7b-44d9-944a-1540fa047cb6 => generated 1312 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:58:27.185190 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-122c2396-a411-4323-850c-eeef2ddb6a6b tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:27.186225 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-122c2396-a411-4323-850c-eeef2ddb6a6b tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] [instance: 47f49c52-08b0-469c-8969-c9655c6ee39b] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:27.193761 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-122c2396-a411-4323-850c-eeef2ddb6a6b tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:27.194304 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-122c2396-a411-4323-850c-eeef2ddb6a6b tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:27.194905 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-122c2396-a411-4323-850c-eeef2ddb6a6b tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:27.195587 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-122c2396-a411-4323-850c-eeef2ddb6a6b tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:27.196034 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-122c2396-a411-4323-850c-eeef2ddb6a6b tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:27.196534 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-122c2396-a411-4323-850c-eeef2ddb6a6b tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:27.293126 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-1b2e2e32-4e1c-492b-aa06-0e0a8bed7e5c tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:27.303629 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-1b2e2e32-4e1c-492b-aa06-0e0a8bed7e5c tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/3e467caf-9d1e-4dc0-830d-585aeabc1e5a" status: 200 len: 1477 microversion: 2.1 time: 1.110681 Aug 10 22:58:27.304218 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 316/667] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:58:26 2022] GET /compute/v2.1/servers/3e467caf-9d1e-4dc0-830d-585aeabc1e5a => generated 1477 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:58:27.313778 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c63b44cb-69b5-46cc-acbe-a3cd318d31e0 tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Calling method '.version_select at 0x7f847d67ce50>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:27.327661 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c63b44cb-69b5-46cc-acbe-a3cd318d31e0 tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:27.328366 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c63b44cb-69b5-46cc-acbe-a3cd318d31e0 tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:27.335882 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c63b44cb-69b5-46cc-acbe-a3cd318d31e0 tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:27.367519 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-c63b44cb-69b5-46cc-acbe-a3cd318d31e0 tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] 10.222.0.58 "GET /compute/v2.1/os-migrations" status: 200 len: 2631 microversion: 2.25 time: 0.059111 Aug 10 22:58:27.368113 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 317/668] 10.222.0.58 () {60 vars in 1184 bytes} [Wed Aug 10 22:58:27 2022] GET /compute/v2.1/os-migrations => generated 2631 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:58:27.372689 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-3d9fa92d-05c0-4df0-871a-6aeae181bafd tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:27.373291 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-3d9fa92d-05c0-4df0-871a-6aeae181bafd tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] [instance: e773ec0c-0cd0-4a08-b9f0-5c2d0a342751] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:27.381087 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3d9fa92d-05c0-4df0-871a-6aeae181bafd tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:27.381396 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3d9fa92d-05c0-4df0-871a-6aeae181bafd tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:27.382057 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3d9fa92d-05c0-4df0-871a-6aeae181bafd tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:27.383357 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3d9fa92d-05c0-4df0-871a-6aeae181bafd tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:27.383819 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3d9fa92d-05c0-4df0-871a-6aeae181bafd tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:27.384793 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3d9fa92d-05c0-4df0-871a-6aeae181bafd tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:27.402561 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-3d9fa92d-05c0-4df0-871a-6aeae181bafd tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] HTTP exception thrown: Instance e773ec0c-0cd0-4a08-b9f0-5c2d0a342751 could not be found. Aug 10 22:58:27.406772 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-3d9fa92d-05c0-4df0-871a-6aeae181bafd tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Request method failure captured: Aug 10 22:58:27.406772 n-d-850468-14 devstack@n-api.service[122632]: request: GET /compute/v2.1/servers/e773ec0c-0cd0-4a08-b9f0-5c2d0a342751 HTTP/1.1 Aug 10 22:58:27.406772 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 22:58:27.406772 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 22:58:27.406772 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 22:58:27.406772 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 22:58:27.406772 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 22:58:27.406772 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 22:58:27.406772 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 22:58:27.406772 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 22:58:27.406772 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9DdzQdZttcsDSkbAvtrDq0FZz2KWBbMTdIrmHT-AvA-Wyp17Vlkz0PaeHZbDt6n4uD88Vge7C9Kb_BpIKM6Qhf1cawUzH2TgSHfqsjQq1yae35dpz-Cc8WCOzjPdNN6g_ujEhmDOhlM1LonGq3GHybmGm7vEyCIPKCXdHaqW9ANOE20 Aug 10 22:58:27.406772 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 22:58:27.406772 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 22:58:27.406772 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 22:58:27.406772 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 22:58:27.406772 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 22:58:27.406772 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 22:58:27.406772 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: deaba512051743deb45881d76eb206ed Aug 10 22:58:27.406772 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1638290532 Aug 10 22:58:27.406772 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 22:58:27.406772 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 22:58:27.408142 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/deaba512051743deb45881d76eb206ed"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/deaba512051743deb45881d76eb206ed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/deaba512051743deb45881d76eb206ed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_deaba512051743deb45881d76eb206ed", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 22:58:27.408142 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1638290532 Aug 10 22:58:27.408142 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: deaba512051743deb45881d76eb206ed Aug 10 22:58:27.408142 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1638290532 Aug 10 22:58:27.408142 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1638290532-project Aug 10 22:58:27.408142 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 22:58:27.408142 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 22:58:27.408142 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: eaed2a2e56f749a88c340aaccb15d2d9 Aug 10 22:58:27.408142 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1638290532-project Aug 10 22:58:27.408142 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 22:58:27.408142 n-d-850468-14 devstack@n-api.service[122632]: exception: Instance e773ec0c-0cd0-4a08-b9f0-5c2d0a342751 could not be found. Aug 10 22:58:27.408142 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': 'e773ec0c-0cd0-4a08-b9f0-5c2d0a342751'} Aug 10 22:58:27.408973 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 22:58:27.408973 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:58:27.408973 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 22:58:27.408973 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 22:58:27.408973 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 22:58:27.408973 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 22:58:27.408973 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 22:58:27.408973 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 22:58:27.408973 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 22:58:27.408973 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 22:58:27.408973 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e773ec0c-0cd0-4a08-b9f0-5c2d0a342751 could not be found. Aug 10 22:58:27.408973 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:58:27.408973 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:58:27.408973 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:58:27.408973 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:58:27.408973 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:58:27.408973 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:58:27.408973 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 22:58:27.408973 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 22:58:27.408973 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 22:58:27.410179 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 22:58:27.410179 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 22:58:27.410179 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 22:58:27.410179 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 22:58:27.410179 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 22:58:27.410179 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 22:58:27.410179 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 22:58:27.410179 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e773ec0c-0cd0-4a08-b9f0-5c2d0a342751 could not be found. Aug 10 22:58:27.410179 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:58:27.410179 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:58:27.410179 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:58:27.410179 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:58:27.410179 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:58:27.410179 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:58:27.410179 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 22:58:27.410179 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 22:58:27.410179 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e773ec0c-0cd0-4a08-b9f0-5c2d0a342751 could not be found. Aug 10 22:58:27.410179 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:58:27.413942 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-3d9fa92d-05c0-4df0-871a-6aeae181bafd tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Returning 404 to user: Instance e773ec0c-0cd0-4a08-b9f0-5c2d0a342751 could not be found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 22:58:27.418500 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-3d9fa92d-05c0-4df0-871a-6aeae181bafd tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] 10.222.0.58 "GET /compute/v2.1/servers/e773ec0c-0cd0-4a08-b9f0-5c2d0a342751" status: 404 len: 111 microversion: 2.1 time: 0.046287 Aug 10 22:58:27.419329 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 318/669] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:58:27 2022] GET /compute/v2.1/servers/e773ec0c-0cd0-4a08-b9f0-5c2d0a342751 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 22:58:27.432602 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-ada0f50a-0a3f-40a9-a7df-5ecbc268b162 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:27.433479 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-ada0f50a-0a3f-40a9-a7df-5ecbc268b162 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] [instance: ce82674f-e3eb-4e97-acd3-b4da01015330] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:27.446023 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ada0f50a-0a3f-40a9-a7df-5ecbc268b162 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:27.446519 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ada0f50a-0a3f-40a9-a7df-5ecbc268b162 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:27.447002 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ada0f50a-0a3f-40a9-a7df-5ecbc268b162 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:27.447711 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ada0f50a-0a3f-40a9-a7df-5ecbc268b162 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:27.448161 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ada0f50a-0a3f-40a9-a7df-5ecbc268b162 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:27.449103 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ada0f50a-0a3f-40a9-a7df-5ecbc268b162 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:27.613902 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=2 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:58:27.801737 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-122c2396-a411-4323-850c-eeef2ddb6a6b tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632904331d024d9b8e4d3660dff2cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ed0bdee3aa4013bd9219069bda558c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:27.827557 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-122c2396-a411-4323-850c-eeef2ddb6a6b tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] 10.222.0.58 "GET /compute/v2.1/servers/47f49c52-08b0-469c-8969-c9655c6ee39b" status: 200 len: 1504 microversion: 2.1 time: 0.653556 Aug 10 22:58:27.830518 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 352/670] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:58:27 2022] GET /compute/v2.1/servers/47f49c52-08b0-469c-8969-c9655c6ee39b => generated 1504 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:58:27.838230 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-6b096433-e863-4774-8266-2358fb9de68e tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:27.839309 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-6b096433-e863-4774-8266-2358fb9de68e tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] [instance: eaea4cc7-b1b8-43a7-83a4-8cfc8a44f9c1] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:27.849378 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6b096433-e863-4774-8266-2358fb9de68e tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:27.850109 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6b096433-e863-4774-8266-2358fb9de68e tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:27.850759 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6b096433-e863-4774-8266-2358fb9de68e tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:27.852357 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6b096433-e863-4774-8266-2358fb9de68e tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:27.853417 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6b096433-e863-4774-8266-2358fb9de68e tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:27.854012 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6b096433-e863-4774-8266-2358fb9de68e tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:28.163811 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.objects.instance [None req-6b096433-e863-4774-8266-2358fb9de68e tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Lazy-loading 'services' on Instance uuid eaea4cc7-b1b8-43a7-83a4-8cfc8a44f9c1 {{(pid=122633) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 22:58:28.193626 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-6b096433-e863-4774-8266-2358fb9de68e tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/eaea4cc7-b1b8-43a7-83a4-8cfc8a44f9c1" status: 200 len: 2036 microversion: 2.25 time: 0.361619 Aug 10 22:58:28.194266 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 353/671] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 22:58:27 2022] GET /compute/v2.1/servers/eaea4cc7-b1b8-43a7-83a4-8cfc8a44f9c1 => generated 2036 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:58:28.202204 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-95221946-9985-43b2-a48f-68c1656f94fb req-41f2516f-8ab3-44e5-8f03-3b86a7bc5da6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce82674f-e3eb-4e97-acd3-b4da01015330", "tag": "a612824c-2998-441d-ad59-b655d3918bdf"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:58:28.234041 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-95221946-9985-43b2-a48f-68c1656f94fb req-41f2516f-8ab3-44e5-8f03-3b86a7bc5da6 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:28.234527 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-95221946-9985-43b2-a48f-68c1656f94fb req-41f2516f-8ab3-44e5-8f03-3b86a7bc5da6 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:28.234999 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-95221946-9985-43b2-a48f-68c1656f94fb req-41f2516f-8ab3-44e5-8f03-3b86a7bc5da6 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:28.269853 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-95221946-9985-43b2-a48f-68c1656f94fb req-41f2516f-8ab3-44e5-8f03-3b86a7bc5da6 service nova] Creating event network-changed:a612824c-2998-441d-ad59-b655d3918bdf for instance ce82674f-e3eb-4e97-acd3-b4da01015330 on n-h2-850468-14 Aug 10 22:58:28.278554 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-95221946-9985-43b2-a48f-68c1656f94fb req-41f2516f-8ab3-44e5-8f03-3b86a7bc5da6 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079845 Aug 10 22:58:28.279818 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 354/672] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 22:58:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:58:28.287651 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-9b2a904e-3199-40d0-9b58-bda8e0d353a8 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:28.288294 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-9b2a904e-3199-40d0-9b58-bda8e0d353a8 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] [instance: ef725aca-9cd8-49a0-81cd-d23710041306] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:28.304046 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9b2a904e-3199-40d0-9b58-bda8e0d353a8 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:28.304956 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9b2a904e-3199-40d0-9b58-bda8e0d353a8 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:28.305819 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9b2a904e-3199-40d0-9b58-bda8e0d353a8 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:28.307155 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9b2a904e-3199-40d0-9b58-bda8e0d353a8 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:28.308113 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9b2a904e-3199-40d0-9b58-bda8e0d353a8 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:28.308760 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9b2a904e-3199-40d0-9b58-bda8e0d353a8 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:28.330675 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-9b2a904e-3199-40d0-9b58-bda8e0d353a8 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] HTTP exception thrown: Instance ef725aca-9cd8-49a0-81cd-d23710041306 could not be found. Aug 10 22:58:28.333611 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-9b2a904e-3199-40d0-9b58-bda8e0d353a8 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Request method failure captured: Aug 10 22:58:28.333611 n-d-850468-14 devstack@n-api.service[122633]: request: DELETE /compute/v2.1/servers/ef725aca-9cd8-49a0-81cd-d23710041306 HTTP/1.1 Aug 10 22:58:28.333611 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 22:58:28.333611 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 22:58:28.333611 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 22:58:28.333611 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 22:58:28.333611 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 22:58:28.333611 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 22:58:28.333611 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 22:58:28.333611 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 22:58:28.333611 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9DdzQdZttcsDSkbAvtrDq0FZz2KWBbMTdIrmHT-AvA-Wyp17Vlkz0PaeHZbDt6n4uD88Vge7C9Kb_BpIKM6Qhf1cawUzH2TgSHfqsjQq1yae35dpz-Cc8WCOzjPdNN6g_ujEhmDOhlM1LonGq3GHybmGm7vEyCIPKCXdHaqW9ANOE20 Aug 10 22:58:28.333611 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 22:58:28.333611 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 22:58:28.333611 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 22:58:28.333611 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 22:58:28.333611 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 22:58:28.333611 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 22:58:28.333611 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: deaba512051743deb45881d76eb206ed Aug 10 22:58:28.333611 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1638290532 Aug 10 22:58:28.333611 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 22:58:28.333611 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 22:58:28.335198 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/deaba512051743deb45881d76eb206ed"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/deaba512051743deb45881d76eb206ed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/deaba512051743deb45881d76eb206ed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_deaba512051743deb45881d76eb206ed", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 22:58:28.335198 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1638290532 Aug 10 22:58:28.335198 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: deaba512051743deb45881d76eb206ed Aug 10 22:58:28.335198 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1638290532 Aug 10 22:58:28.335198 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1638290532-project Aug 10 22:58:28.335198 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 22:58:28.335198 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 22:58:28.335198 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: eaed2a2e56f749a88c340aaccb15d2d9 Aug 10 22:58:28.335198 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1638290532-project Aug 10 22:58:28.335198 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 22:58:28.335198 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance ef725aca-9cd8-49a0-81cd-d23710041306 could not be found. Aug 10 22:58:28.335198 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': 'ef725aca-9cd8-49a0-81cd-d23710041306'} Aug 10 22:58:28.336067 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 22:58:28.336067 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:58:28.336067 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 22:58:28.336067 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 22:58:28.336067 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 22:58:28.336067 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 22:58:28.336067 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 22:58:28.336067 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 22:58:28.336067 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 22:58:28.336067 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 22:58:28.336067 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef725aca-9cd8-49a0-81cd-d23710041306 could not be found. Aug 10 22:58:28.336067 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:58:28.336067 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:58:28.336067 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:58:28.336067 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:58:28.336067 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:58:28.336067 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:58:28.336067 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 22:58:28.336067 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 22:58:28.336067 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 22:58:28.337410 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 22:58:28.337410 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 22:58:28.337410 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 22:58:28.337410 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 22:58:28.337410 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 22:58:28.337410 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 22:58:28.337410 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 22:58:28.337410 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 22:58:28.337410 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 22:58:28.337410 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef725aca-9cd8-49a0-81cd-d23710041306 could not be found. Aug 10 22:58:28.337410 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:58:28.337410 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:58:28.337410 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:58:28.337410 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:58:28.337410 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:58:28.337410 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:58:28.337410 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 22:58:28.337410 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 22:58:28.337410 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef725aca-9cd8-49a0-81cd-d23710041306 could not be found. Aug 10 22:58:28.337410 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:58:28.340470 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-9b2a904e-3199-40d0-9b58-bda8e0d353a8 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Returning 404 to user: Instance ef725aca-9cd8-49a0-81cd-d23710041306 could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 22:58:28.341563 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-9b2a904e-3199-40d0-9b58-bda8e0d353a8 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] 10.222.0.58 "DELETE /compute/v2.1/servers/ef725aca-9cd8-49a0-81cd-d23710041306" status: 404 len: 111 microversion: 2.1 time: 0.060606 Aug 10 22:58:28.346241 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 355/673] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 22:58:28 2022] DELETE /compute/v2.1/servers/ef725aca-9cd8-49a0-81cd-d23710041306 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 22:58:28.353667 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-30fb3bc0-bab6-4717-9919-0c026c315497 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:28.354553 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-30fb3bc0-bab6-4717-9919-0c026c315497 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] [instance: 3553ba91-ca7b-44d9-944a-1540fa047cb6] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:28.365234 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-30fb3bc0-bab6-4717-9919-0c026c315497 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:28.366148 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-30fb3bc0-bab6-4717-9919-0c026c315497 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:28.367140 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-30fb3bc0-bab6-4717-9919-0c026c315497 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:28.368064 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-30fb3bc0-bab6-4717-9919-0c026c315497 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:28.368630 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-30fb3bc0-bab6-4717-9919-0c026c315497 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:28.369144 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-30fb3bc0-bab6-4717-9919-0c026c315497 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:28.387283 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-ada0f50a-0a3f-40a9-a7df-5ecbc268b162 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6d9806b6724e5aaf8c69be8e70d4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307ab95daa034afbb31f90626885072b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:28.395902 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-ada0f50a-0a3f-40a9-a7df-5ecbc268b162 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] 10.222.0.58 "GET /compute/v2.1/servers/ce82674f-e3eb-4e97-acd3-b4da01015330" status: 200 len: 1307 microversion: 2.1 time: 0.974936 Aug 10 22:58:28.396592 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 319/674] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:58:27 2022] GET /compute/v2.1/servers/ce82674f-e3eb-4e97-acd3-b4da01015330 => generated 1307 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:58:28.406046 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-a1134d02-b3d3-44db-9c50-fbfde27250f5 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Action: 'create', calling method: .version_select at 0x7f847d6300d0>, body: {"keypair": {"name": "tempest-keypair-388514188", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGExbRVp60KWlm8GI3KhGO6co55MXGnRSW5HdUKJDYbhD/g+dqFIPqCxuMutnaPUr8/93hlDqmYGit3BVRy9ukyzKvXshttVHgUhzlGUgNbH/XuvVJyiAMQrFbdYVclSxA=="}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:58:28.436483 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-a1134d02-b3d3-44db-9c50-fbfde27250f5 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Getting quotas for project b4355fdc73c84fa2baf0d5c9a33e69d5. Resources: {'key_pairs'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 22:58:28.443381 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-a1134d02-b3d3-44db-9c50-fbfde27250f5 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Getting quotas for user 394f0e6843424c7b83d2dfff61f66ede and project b4355fdc73c84fa2baf0d5c9a33e69d5. Resources: {'key_pairs'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 22:58:28.467193 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-30fb3bc0-bab6-4717-9919-0c026c315497 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e437f9eb7254dc98e2839656c053f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eae334ad72ba421797a6d836edcbab0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:28.477235 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-a1134d02-b3d3-44db-9c50-fbfde27250f5 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.25 time: 0.079509 Aug 10 22:58:28.479256 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 320/675] 10.222.0.58 () {62 vars in 1200 bytes} [Wed Aug 10 22:58:28 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 82 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 10 22:58:28.479415 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-30fb3bc0-bab6-4717-9919-0c026c315497 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] 10.222.0.58 "GET /compute/v2.1/servers/3553ba91-ca7b-44d9-944a-1540fa047cb6" status: 200 len: 1300 microversion: 2.1 time: 0.130882 Aug 10 22:58:28.480249 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 356/676] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:58:28 2022] GET /compute/v2.1/servers/3553ba91-ca7b-44d9-944a-1540fa047cb6 => generated 1300 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:58:28.487339 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-6c154e13-ab57-48e9-83b4-8a87182a171e tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:28.488374 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-6c154e13-ab57-48e9-83b4-8a87182a171e tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] [instance: ef725aca-9cd8-49a0-81cd-d23710041306] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:28.499264 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6c154e13-ab57-48e9-83b4-8a87182a171e tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:28.500122 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6c154e13-ab57-48e9-83b4-8a87182a171e tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:28.500758 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6c154e13-ab57-48e9-83b4-8a87182a171e tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:28.501692 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6c154e13-ab57-48e9-83b4-8a87182a171e tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:28.501810 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-4ec1f1d5-63fb-4085-b417-24627e2c96e5 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:28.502443 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-4ec1f1d5-63fb-4085-b417-24627e2c96e5 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 3e467caf-9d1e-4dc0-830d-585aeabc1e5a] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:28.502694 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6c154e13-ab57-48e9-83b4-8a87182a171e tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:28.503391 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6c154e13-ab57-48e9-83b4-8a87182a171e tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:28.509718 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4ec1f1d5-63fb-4085-b417-24627e2c96e5 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:28.510258 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4ec1f1d5-63fb-4085-b417-24627e2c96e5 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:28.510808 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4ec1f1d5-63fb-4085-b417-24627e2c96e5 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:28.511766 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4ec1f1d5-63fb-4085-b417-24627e2c96e5 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:28.512261 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4ec1f1d5-63fb-4085-b417-24627e2c96e5 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:28.512759 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4ec1f1d5-63fb-4085-b417-24627e2c96e5 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:28.528482 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-6c154e13-ab57-48e9-83b4-8a87182a171e tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] HTTP exception thrown: Instance ef725aca-9cd8-49a0-81cd-d23710041306 could not be found. Aug 10 22:58:28.530555 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-6c154e13-ab57-48e9-83b4-8a87182a171e tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Request method failure captured: Aug 10 22:58:28.530555 n-d-850468-14 devstack@n-api.service[122633]: request: GET /compute/v2.1/servers/ef725aca-9cd8-49a0-81cd-d23710041306 HTTP/1.1 Aug 10 22:58:28.530555 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 22:58:28.530555 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 22:58:28.530555 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 22:58:28.530555 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 22:58:28.530555 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 22:58:28.530555 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 22:58:28.530555 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 22:58:28.530555 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 22:58:28.530555 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9DdzQdZttcsDSkbAvtrDq0FZz2KWBbMTdIrmHT-AvA-Wyp17Vlkz0PaeHZbDt6n4uD88Vge7C9Kb_BpIKM6Qhf1cawUzH2TgSHfqsjQq1yae35dpz-Cc8WCOzjPdNN6g_ujEhmDOhlM1LonGq3GHybmGm7vEyCIPKCXdHaqW9ANOE20 Aug 10 22:58:28.530555 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 22:58:28.530555 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 22:58:28.530555 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 22:58:28.530555 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 22:58:28.530555 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 22:58:28.530555 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 22:58:28.530555 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: deaba512051743deb45881d76eb206ed Aug 10 22:58:28.530555 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1638290532 Aug 10 22:58:28.530555 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 22:58:28.530555 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 22:58:28.531990 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/deaba512051743deb45881d76eb206ed"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/deaba512051743deb45881d76eb206ed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/deaba512051743deb45881d76eb206ed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_deaba512051743deb45881d76eb206ed", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 22:58:28.531990 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1638290532 Aug 10 22:58:28.531990 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: deaba512051743deb45881d76eb206ed Aug 10 22:58:28.531990 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1638290532 Aug 10 22:58:28.531990 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1638290532-project Aug 10 22:58:28.531990 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 22:58:28.531990 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 22:58:28.531990 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: eaed2a2e56f749a88c340aaccb15d2d9 Aug 10 22:58:28.531990 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1638290532-project Aug 10 22:58:28.531990 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 22:58:28.531990 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance ef725aca-9cd8-49a0-81cd-d23710041306 could not be found. Aug 10 22:58:28.531990 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': 'ef725aca-9cd8-49a0-81cd-d23710041306'} Aug 10 22:58:28.532746 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 22:58:28.532746 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:58:28.532746 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 22:58:28.532746 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 22:58:28.532746 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 22:58:28.532746 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 22:58:28.532746 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 22:58:28.532746 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 22:58:28.532746 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 22:58:28.532746 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 22:58:28.532746 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef725aca-9cd8-49a0-81cd-d23710041306 could not be found. Aug 10 22:58:28.532746 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:58:28.532746 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:58:28.532746 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:58:28.532746 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:58:28.532746 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:58:28.532746 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:58:28.532746 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 22:58:28.532746 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 22:58:28.532746 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 22:58:28.537266 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 22:58:28.537266 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 22:58:28.537266 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 22:58:28.537266 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 22:58:28.537266 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 22:58:28.537266 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 22:58:28.537266 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 22:58:28.537266 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef725aca-9cd8-49a0-81cd-d23710041306 could not be found. Aug 10 22:58:28.537266 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:58:28.537266 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:58:28.537266 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:58:28.537266 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:58:28.537266 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:58:28.537266 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:58:28.537266 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 22:58:28.537266 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 22:58:28.537266 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef725aca-9cd8-49a0-81cd-d23710041306 could not be found. Aug 10 22:58:28.537266 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:58:28.547187 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-6c154e13-ab57-48e9-83b4-8a87182a171e tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Returning 404 to user: Instance ef725aca-9cd8-49a0-81cd-d23710041306 could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 22:58:28.547501 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-6c154e13-ab57-48e9-83b4-8a87182a171e tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] 10.222.0.58 "GET /compute/v2.1/servers/ef725aca-9cd8-49a0-81cd-d23710041306" status: 404 len: 111 microversion: 2.1 time: 0.064181 Aug 10 22:58:28.552753 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 357/677] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:58:28 2022] GET /compute/v2.1/servers/ef725aca-9cd8-49a0-81cd-d23710041306 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 22:58:28.558745 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-4be51094-ea2e-4bb8-8114-0f58ac544782 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Calling method '.version_select at 0x7f847d60ca60>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:28.583626 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-4be51094-ea2e-4bb8-8114-0f58ac544782 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1466905669" status: 202 len: 0 microversion: 2.1 time: 0.029292 Aug 10 22:58:28.587741 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 358/678] 10.222.0.58 () {58 vars in 1221 bytes} [Wed Aug 10 22:58:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1466905669 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 22:58:28.857218 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-1440a32b-d5ee-470c-a956-5a78180ed5af tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:28.857986 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-1440a32b-d5ee-470c-a956-5a78180ed5af tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] [instance: 47f49c52-08b0-469c-8969-c9655c6ee39b] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:28.868770 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1440a32b-d5ee-470c-a956-5a78180ed5af tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:28.869390 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1440a32b-d5ee-470c-a956-5a78180ed5af tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:28.869938 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1440a32b-d5ee-470c-a956-5a78180ed5af tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:28.873237 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1440a32b-d5ee-470c-a956-5a78180ed5af tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:28.873809 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1440a32b-d5ee-470c-a956-5a78180ed5af tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:28.874497 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1440a32b-d5ee-470c-a956-5a78180ed5af tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:29.193046 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-4ec1f1d5-63fb-4085-b417-24627e2c96e5 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:29.206689 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-4ec1f1d5-63fb-4085-b417-24627e2c96e5 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/3e467caf-9d1e-4dc0-830d-585aeabc1e5a" status: 200 len: 1477 microversion: 2.1 time: 0.713814 Aug 10 22:58:29.212616 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 321/679] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:58:28 2022] GET /compute/v2.1/servers/3e467caf-9d1e-4dc0-830d-585aeabc1e5a => generated 1477 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:58:29.311553 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-1440a32b-d5ee-470c-a956-5a78180ed5af tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632904331d024d9b8e4d3660dff2cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ed0bdee3aa4013bd9219069bda558c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:29.368686 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-1440a32b-d5ee-470c-a956-5a78180ed5af tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] 10.222.0.58 "GET /compute/v2.1/servers/47f49c52-08b0-469c-8969-c9655c6ee39b" status: 200 len: 1504 microversion: 2.1 time: 0.515628 Aug 10 22:58:29.369275 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 359/680] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:58:28 2022] GET /compute/v2.1/servers/47f49c52-08b0-469c-8969-c9655c6ee39b => generated 1504 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:58:29.417627 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-3d2bb3a7-5f7c-4ce7-a796-b78cad07da59 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:29.418987 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-3d2bb3a7-5f7c-4ce7-a796-b78cad07da59 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] [instance: ce82674f-e3eb-4e97-acd3-b4da01015330] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:29.426487 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3d2bb3a7-5f7c-4ce7-a796-b78cad07da59 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:29.427416 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3d2bb3a7-5f7c-4ce7-a796-b78cad07da59 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:29.428102 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3d2bb3a7-5f7c-4ce7-a796-b78cad07da59 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:29.429097 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3d2bb3a7-5f7c-4ce7-a796-b78cad07da59 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:29.429807 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3d2bb3a7-5f7c-4ce7-a796-b78cad07da59 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:29.430500 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3d2bb3a7-5f7c-4ce7-a796-b78cad07da59 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:29.505446 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-1cc569a0-6b89-4ec0-9bb8-53045d24f7c2 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:29.506036 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-1cc569a0-6b89-4ec0-9bb8-53045d24f7c2 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] [instance: 3553ba91-ca7b-44d9-944a-1540fa047cb6] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:29.524573 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1cc569a0-6b89-4ec0-9bb8-53045d24f7c2 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:29.525592 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1cc569a0-6b89-4ec0-9bb8-53045d24f7c2 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:29.526296 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1cc569a0-6b89-4ec0-9bb8-53045d24f7c2 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:29.527528 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1cc569a0-6b89-4ec0-9bb8-53045d24f7c2 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:29.528536 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1cc569a0-6b89-4ec0-9bb8-53045d24f7c2 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:29.529373 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1cc569a0-6b89-4ec0-9bb8-53045d24f7c2 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:29.652315 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-1cc569a0-6b89-4ec0-9bb8-53045d24f7c2 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e437f9eb7254dc98e2839656c053f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eae334ad72ba421797a6d836edcbab0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:29.666337 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-1cc569a0-6b89-4ec0-9bb8-53045d24f7c2 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] 10.222.0.58 "GET /compute/v2.1/servers/3553ba91-ca7b-44d9-944a-1540fa047cb6" status: 200 len: 1300 microversion: 2.1 time: 0.163698 Aug 10 22:58:29.667571 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 360/681] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:58:29 2022] GET /compute/v2.1/servers/3553ba91-ca7b-44d9-944a-1540fa047cb6 => generated 1300 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:58:30.075722 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-3d2bb3a7-5f7c-4ce7-a796-b78cad07da59 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6d9806b6724e5aaf8c69be8e70d4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307ab95daa034afbb31f90626885072b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:30.088044 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-3d2bb3a7-5f7c-4ce7-a796-b78cad07da59 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] 10.222.0.58 "GET /compute/v2.1/servers/ce82674f-e3eb-4e97-acd3-b4da01015330" status: 200 len: 1307 microversion: 2.1 time: 0.674249 Aug 10 22:58:30.088982 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 322/682] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:58:29 2022] GET /compute/v2.1/servers/ce82674f-e3eb-4e97-acd3-b4da01015330 => generated 1307 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:58:30.230267 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-f895cf72-e691-4a78-9815-6100efac6702 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:30.230912 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-f895cf72-e691-4a78-9815-6100efac6702 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 3e467caf-9d1e-4dc0-830d-585aeabc1e5a] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:30.239342 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f895cf72-e691-4a78-9815-6100efac6702 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:30.248594 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f895cf72-e691-4a78-9815-6100efac6702 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:30.249216 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f895cf72-e691-4a78-9815-6100efac6702 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:30.250134 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f895cf72-e691-4a78-9815-6100efac6702 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:30.250833 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f895cf72-e691-4a78-9815-6100efac6702 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:30.251492 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f895cf72-e691-4a78-9815-6100efac6702 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:30.311905 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-1e41babb-3df5-478a-a33b-a0e1657c41cd req-932edc65-0a5d-458b-8510-5af12e7ce7be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47f49c52-08b0-469c-8969-c9655c6ee39b", "name": "network-vif-unplugged", "status": "completed", "tag": "18b62a0a-3eba-4608-9dea-969a87874984"}, {"name": "network-changed", "server_uuid": "7599a318-7a19-4f4a-bbb6-162f7a207060", "tag": "f22c5d16-4ab5-4e8c-987e-74d273711590"}, {"name": "network-changed", "server_uuid": "47f49c52-08b0-469c-8969-c9655c6ee39b", "tag": "18b62a0a-3eba-4608-9dea-969a87874984"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:58:30.336012 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-1e41babb-3df5-478a-a33b-a0e1657c41cd req-932edc65-0a5d-458b-8510-5af12e7ce7be service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:30.338578 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-1e41babb-3df5-478a-a33b-a0e1657c41cd req-932edc65-0a5d-458b-8510-5af12e7ce7be service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:30.339162 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-1e41babb-3df5-478a-a33b-a0e1657c41cd req-932edc65-0a5d-458b-8510-5af12e7ce7be service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:30.369407 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-1e41babb-3df5-478a-a33b-a0e1657c41cd req-932edc65-0a5d-458b-8510-5af12e7ce7be service nova] Creating event network-vif-unplugged:18b62a0a-3eba-4608-9dea-969a87874984 for instance 47f49c52-08b0-469c-8969-c9655c6ee39b on n-h2-850468-14 Aug 10 22:58:30.371078 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-1e41babb-3df5-478a-a33b-a0e1657c41cd req-932edc65-0a5d-458b-8510-5af12e7ce7be service nova] Creating event network-changed:f22c5d16-4ab5-4e8c-987e-74d273711590 for instance 7599a318-7a19-4f4a-bbb6-162f7a207060 on n-h1-850468-14 Aug 10 22:58:30.372816 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-1e41babb-3df5-478a-a33b-a0e1657c41cd req-932edc65-0a5d-458b-8510-5af12e7ce7be service nova] Creating event network-changed:18b62a0a-3eba-4608-9dea-969a87874984 for instance 47f49c52-08b0-469c-8969-c9655c6ee39b on n-h2-850468-14 Aug 10 22:58:30.391256 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-1e41babb-3df5-478a-a33b-a0e1657c41cd req-932edc65-0a5d-458b-8510-5af12e7ce7be service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 519 microversion: 2.1 time: 0.085541 Aug 10 22:58:30.392127 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 323/683] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 22:58:30 2022] POST /compute/v2.1/os-server-external-events => generated 519 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 22:58:30.401171 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-d115e9d9-fd7b-436f-b2fa-b2cf4aacf84c tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:30.406017 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-d115e9d9-fd7b-436f-b2fa-b2cf4aacf84c tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] [instance: 47f49c52-08b0-469c-8969-c9655c6ee39b] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:30.429299 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d115e9d9-fd7b-436f-b2fa-b2cf4aacf84c tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:30.430060 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d115e9d9-fd7b-436f-b2fa-b2cf4aacf84c tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:30.430426 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d115e9d9-fd7b-436f-b2fa-b2cf4aacf84c tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:30.431519 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d115e9d9-fd7b-436f-b2fa-b2cf4aacf84c tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:30.433598 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d115e9d9-fd7b-436f-b2fa-b2cf4aacf84c tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:30.434344 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d115e9d9-fd7b-436f-b2fa-b2cf4aacf84c tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:30.965701 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-d115e9d9-fd7b-436f-b2fa-b2cf4aacf84c tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632904331d024d9b8e4d3660dff2cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ed0bdee3aa4013bd9219069bda558c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:31.004750 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:58:31.011841 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-d115e9d9-fd7b-436f-b2fa-b2cf4aacf84c tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] 10.222.0.58 "GET /compute/v2.1/servers/47f49c52-08b0-469c-8969-c9655c6ee39b" status: 200 len: 1504 microversion: 2.1 time: 0.616585 Aug 10 22:58:31.032820 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 324/684] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:58:30 2022] GET /compute/v2.1/servers/47f49c52-08b0-469c-8969-c9655c6ee39b => generated 1504 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:58:31.055870 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-3c7b53e2-cbdc-49d0-ae37-dbbad2520462 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:31.057007 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-3c7b53e2-cbdc-49d0-ae37-dbbad2520462 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] [instance: 3553ba91-ca7b-44d9-944a-1540fa047cb6] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:31.078145 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3c7b53e2-cbdc-49d0-ae37-dbbad2520462 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:31.087043 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3c7b53e2-cbdc-49d0-ae37-dbbad2520462 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:31.087917 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3c7b53e2-cbdc-49d0-ae37-dbbad2520462 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:31.088935 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3c7b53e2-cbdc-49d0-ae37-dbbad2520462 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:31.090249 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3c7b53e2-cbdc-49d0-ae37-dbbad2520462 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:31.092055 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3c7b53e2-cbdc-49d0-ae37-dbbad2520462 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:31.204859 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-f895cf72-e691-4a78-9815-6100efac6702 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:31.214468 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-f895cf72-e691-4a78-9815-6100efac6702 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/3e467caf-9d1e-4dc0-830d-585aeabc1e5a" status: 200 len: 1477 microversion: 2.1 time: 0.988247 Aug 10 22:58:31.220002 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 361/685] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:58:30 2022] GET /compute/v2.1/servers/3e467caf-9d1e-4dc0-830d-585aeabc1e5a => generated 1477 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:58:31.227409 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-4c9ddd15-33ac-449a-9de5-c647c5e6fda1 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:31.228255 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-4c9ddd15-33ac-449a-9de5-c647c5e6fda1 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] [instance: ce82674f-e3eb-4e97-acd3-b4da01015330] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:31.253093 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4c9ddd15-33ac-449a-9de5-c647c5e6fda1 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:31.254719 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4c9ddd15-33ac-449a-9de5-c647c5e6fda1 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:31.255500 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4c9ddd15-33ac-449a-9de5-c647c5e6fda1 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:31.259516 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4c9ddd15-33ac-449a-9de5-c647c5e6fda1 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:31.262057 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4c9ddd15-33ac-449a-9de5-c647c5e6fda1 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:31.264838 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4c9ddd15-33ac-449a-9de5-c647c5e6fda1 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:31.658145 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-3c7b53e2-cbdc-49d0-ae37-dbbad2520462 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e437f9eb7254dc98e2839656c053f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eae334ad72ba421797a6d836edcbab0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:31.671564 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-3c7b53e2-cbdc-49d0-ae37-dbbad2520462 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] 10.222.0.58 "GET /compute/v2.1/servers/3553ba91-ca7b-44d9-944a-1540fa047cb6" status: 200 len: 1367 microversion: 2.1 time: 0.634598 Aug 10 22:58:31.674349 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 325/686] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:58:31 2022] GET /compute/v2.1/servers/3553ba91-ca7b-44d9-944a-1540fa047cb6 => generated 1367 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:58:31.684498 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-4c9ddd15-33ac-449a-9de5-c647c5e6fda1 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6d9806b6724e5aaf8c69be8e70d4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307ab95daa034afbb31f90626885072b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:31.697922 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-4c9ddd15-33ac-449a-9de5-c647c5e6fda1 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] 10.222.0.58 "GET /compute/v2.1/servers/ce82674f-e3eb-4e97-acd3-b4da01015330" status: 200 len: 1307 microversion: 2.1 time: 0.476166 Aug 10 22:58:31.699648 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 362/687] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:58:31 2022] GET /compute/v2.1/servers/ce82674f-e3eb-4e97-acd3-b4da01015330 => generated 1307 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:58:31.920665 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-2d6bd565-b09a-4cd3-9b80-65a7ce74d191 tempest-ServersWithSpecificFlavorTestJSON-1697787177 tempest-ServersWithSpecificFlavorTestJSON-1697787177-project-admin] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:31.922015 n-d-850468-14 devstack@n-api.service[122632]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:58:31.922015 n-d-850468-14 devstack@n-api.service[122632]: warnings.warn(msg) Aug 10 22:58:31.950610 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:58:31.962139 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-2d6bd565-b09a-4cd3-9b80-65a7ce74d191 tempest-ServersWithSpecificFlavorTestJSON-1697787177 tempest-ServersWithSpecificFlavorTestJSON-1697787177-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/1169490990" status: 202 len: 0 microversion: 2.1 time: 0.057143 Aug 10 22:58:31.963777 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 326/688] 10.222.0.58 () {58 vars in 1161 bytes} [Wed Aug 10 22:58:31 2022] DELETE /compute/v2.1/flavors/1169490990 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 22:58:31.971900 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-5432d7d6-84ff-44a0-820a-13571288b46b tempest-ServersWithSpecificFlavorTestJSON-1697787177 tempest-ServersWithSpecificFlavorTestJSON-1697787177-project-admin] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:32.033043 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-5432d7d6-84ff-44a0-820a-13571288b46b tempest-ServersWithSpecificFlavorTestJSON-1697787177 tempest-ServersWithSpecificFlavorTestJSON-1697787177-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 5396 microversion: 2.1 time: 0.065021 Aug 10 22:58:32.035060 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 363/689] 10.222.0.58 () {58 vars in 1146 bytes} [Wed Aug 10 22:58:31 2022] GET /compute/v2.1/flavors/detail => generated 5396 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:58:32.036999 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-55f944e5-709c-41f1-9784-f93f4d9d7661 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:32.037618 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-55f944e5-709c-41f1-9784-f93f4d9d7661 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] [instance: 47f49c52-08b0-469c-8969-c9655c6ee39b] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:32.054808 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-55f944e5-709c-41f1-9784-f93f4d9d7661 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:32.055537 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-55f944e5-709c-41f1-9784-f93f4d9d7661 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:32.056128 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-55f944e5-709c-41f1-9784-f93f4d9d7661 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:32.057021 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-55f944e5-709c-41f1-9784-f93f4d9d7661 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:32.057632 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-55f944e5-709c-41f1-9784-f93f4d9d7661 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:32.058201 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-55f944e5-709c-41f1-9784-f93f4d9d7661 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:32.063896 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-dfc452f5-38c1-4e44-9c98-f887d8caec2b tempest-ServersWithSpecificFlavorTestJSON-1697787177 tempest-ServersWithSpecificFlavorTestJSON-1697787177-project-admin] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:32.065588 n-d-850468-14 devstack@n-api.service[122633]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:58:32.065588 n-d-850468-14 devstack@n-api.service[122633]: warnings.warn(msg) Aug 10 22:58:32.097124 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-dfc452f5-38c1-4e44-9c98-f887d8caec2b tempest-ServersWithSpecificFlavorTestJSON-1697787177 tempest-ServersWithSpecificFlavorTestJSON-1697787177-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/9698657" status: 202 len: 0 microversion: 2.1 time: 0.042250 Aug 10 22:58:32.103777 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 364/690] 10.222.0.58 () {58 vars in 1152 bytes} [Wed Aug 10 22:58:32 2022] DELETE /compute/v2.1/flavors/9698657 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 10 22:58:32.110360 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-8466b1a9-52da-4d4e-9faf-5236ed06642d tempest-ServersWithSpecificFlavorTestJSON-1697787177 tempest-ServersWithSpecificFlavorTestJSON-1697787177-project-admin] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:32.135501 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_api:INSERT=7,nova_api:SELECT=89,nova_api:DELETE=4 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:58:32.167332 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-8466b1a9-52da-4d4e-9faf-5236ed06642d tempest-ServersWithSpecificFlavorTestJSON-1697787177 tempest-ServersWithSpecificFlavorTestJSON-1697787177-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.061916 Aug 10 22:58:32.178734 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 365/691] 10.222.0.58 () {58 vars in 1146 bytes} [Wed Aug 10 22:58:32 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:58:32.202168 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-35c920c9-5c24-4580-95ce-76add0a3f1f8 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:32.203617 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-35c920c9-5c24-4580-95ce-76add0a3f1f8 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] [instance: e773ec0c-0cd0-4a08-b9f0-5c2d0a342751] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:32.218309 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-35c920c9-5c24-4580-95ce-76add0a3f1f8 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:32.219754 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-35c920c9-5c24-4580-95ce-76add0a3f1f8 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:32.220200 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-35c920c9-5c24-4580-95ce-76add0a3f1f8 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:32.220994 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-35c920c9-5c24-4580-95ce-76add0a3f1f8 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:32.222126 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-35c920c9-5c24-4580-95ce-76add0a3f1f8 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:32.223299 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-35c920c9-5c24-4580-95ce-76add0a3f1f8 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:32.246836 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-35c920c9-5c24-4580-95ce-76add0a3f1f8 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] HTTP exception thrown: Instance e773ec0c-0cd0-4a08-b9f0-5c2d0a342751 could not be found. Aug 10 22:58:32.250697 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-35c920c9-5c24-4580-95ce-76add0a3f1f8 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Request method failure captured: Aug 10 22:58:32.250697 n-d-850468-14 devstack@n-api.service[122633]: request: DELETE /compute/v2.1/servers/e773ec0c-0cd0-4a08-b9f0-5c2d0a342751 HTTP/1.1 Aug 10 22:58:32.250697 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 22:58:32.250697 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 22:58:32.250697 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 22:58:32.250697 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 22:58:32.250697 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 22:58:32.250697 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 22:58:32.250697 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 22:58:32.250697 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 22:58:32.250697 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9DdzQdZttcsDSkbAvtrDq0FZz2KWBbMTdIrmHT-AvA-Wyp17Vlkz0PaeHZbDt6n4uD88Vge7C9Kb_BpIKM6Qhf1cawUzH2TgSHfqsjQq1yae35dpz-Cc8WCOzjPdNN6g_ujEhmDOhlM1LonGq3GHybmGm7vEyCIPKCXdHaqW9ANOE20 Aug 10 22:58:32.250697 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 22:58:32.250697 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 22:58:32.250697 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 22:58:32.250697 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 22:58:32.250697 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 22:58:32.250697 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 22:58:32.250697 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: deaba512051743deb45881d76eb206ed Aug 10 22:58:32.250697 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1638290532 Aug 10 22:58:32.250697 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 22:58:32.250697 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 22:58:32.252283 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/deaba512051743deb45881d76eb206ed"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/deaba512051743deb45881d76eb206ed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/deaba512051743deb45881d76eb206ed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_deaba512051743deb45881d76eb206ed", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 22:58:32.252283 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1638290532 Aug 10 22:58:32.252283 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: deaba512051743deb45881d76eb206ed Aug 10 22:58:32.252283 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1638290532 Aug 10 22:58:32.252283 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1638290532-project Aug 10 22:58:32.252283 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 22:58:32.252283 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 22:58:32.252283 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: eaed2a2e56f749a88c340aaccb15d2d9 Aug 10 22:58:32.252283 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1638290532-project Aug 10 22:58:32.252283 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 22:58:32.252283 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance e773ec0c-0cd0-4a08-b9f0-5c2d0a342751 could not be found. Aug 10 22:58:32.252283 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': 'e773ec0c-0cd0-4a08-b9f0-5c2d0a342751'} Aug 10 22:58:32.253005 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 22:58:32.253005 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:58:32.253005 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 22:58:32.253005 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 22:58:32.253005 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 22:58:32.253005 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 22:58:32.253005 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 22:58:32.253005 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 22:58:32.253005 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 22:58:32.253005 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 22:58:32.253005 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e773ec0c-0cd0-4a08-b9f0-5c2d0a342751 could not be found. Aug 10 22:58:32.253005 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:58:32.253005 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:58:32.253005 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:58:32.253005 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:58:32.253005 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:58:32.253005 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:58:32.253005 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 22:58:32.253005 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 22:58:32.253005 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 22:58:32.257069 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 22:58:32.257069 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 22:58:32.257069 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 22:58:32.257069 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 22:58:32.257069 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 22:58:32.257069 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 22:58:32.257069 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 22:58:32.257069 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 22:58:32.257069 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 22:58:32.257069 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e773ec0c-0cd0-4a08-b9f0-5c2d0a342751 could not be found. Aug 10 22:58:32.257069 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:58:32.257069 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:58:32.257069 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:58:32.257069 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:58:32.257069 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:58:32.257069 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:58:32.257069 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 22:58:32.257069 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 22:58:32.257069 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e773ec0c-0cd0-4a08-b9f0-5c2d0a342751 could not be found. Aug 10 22:58:32.257069 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 22:58:32.259870 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-35c920c9-5c24-4580-95ce-76add0a3f1f8 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Returning 404 to user: Instance e773ec0c-0cd0-4a08-b9f0-5c2d0a342751 could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 22:58:32.259870 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-35c920c9-5c24-4580-95ce-76add0a3f1f8 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] 10.222.0.58 "DELETE /compute/v2.1/servers/e773ec0c-0cd0-4a08-b9f0-5c2d0a342751" status: 404 len: 111 microversion: 2.1 time: 0.058694 Aug 10 22:58:32.259870 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 366/692] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 22:58:32 2022] DELETE /compute/v2.1/servers/e773ec0c-0cd0-4a08-b9f0-5c2d0a342751 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 10 22:58:32.264627 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-d15be218-34fa-4666-9659-1efdd11a5750 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:32.269592 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-d15be218-34fa-4666-9659-1efdd11a5750 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 3e467caf-9d1e-4dc0-830d-585aeabc1e5a] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:32.277670 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d15be218-34fa-4666-9659-1efdd11a5750 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:32.279914 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d15be218-34fa-4666-9659-1efdd11a5750 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:32.280620 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d15be218-34fa-4666-9659-1efdd11a5750 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:32.281588 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d15be218-34fa-4666-9659-1efdd11a5750 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:32.282469 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d15be218-34fa-4666-9659-1efdd11a5750 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:32.283210 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d15be218-34fa-4666-9659-1efdd11a5750 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:32.652617 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-55f944e5-709c-41f1-9784-f93f4d9d7661 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632904331d024d9b8e4d3660dff2cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ed0bdee3aa4013bd9219069bda558c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:32.663581 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-55f944e5-709c-41f1-9784-f93f4d9d7661 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] 10.222.0.58 "GET /compute/v2.1/servers/47f49c52-08b0-469c-8969-c9655c6ee39b" status: 200 len: 1504 microversion: 2.1 time: 0.631015 Aug 10 22:58:32.669517 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 327/693] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:58:32 2022] GET /compute/v2.1/servers/47f49c52-08b0-469c-8969-c9655c6ee39b => generated 1504 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:58:32.677950 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-0ec224a3-2489-47f4-a0e8-ab17cca3abf4 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:32.683151 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-0ec224a3-2489-47f4-a0e8-ab17cca3abf4 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] [instance: e773ec0c-0cd0-4a08-b9f0-5c2d0a342751] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:32.698249 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0ec224a3-2489-47f4-a0e8-ab17cca3abf4 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:32.698838 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0ec224a3-2489-47f4-a0e8-ab17cca3abf4 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:32.699294 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0ec224a3-2489-47f4-a0e8-ab17cca3abf4 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:32.700077 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0ec224a3-2489-47f4-a0e8-ab17cca3abf4 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:32.716899 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0ec224a3-2489-47f4-a0e8-ab17cca3abf4 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:32.717357 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0ec224a3-2489-47f4-a0e8-ab17cca3abf4 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:32.756112 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-0ec224a3-2489-47f4-a0e8-ab17cca3abf4 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] HTTP exception thrown: Instance e773ec0c-0cd0-4a08-b9f0-5c2d0a342751 could not be found. Aug 10 22:58:32.758194 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-0ec224a3-2489-47f4-a0e8-ab17cca3abf4 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Request method failure captured: Aug 10 22:58:32.758194 n-d-850468-14 devstack@n-api.service[122632]: request: GET /compute/v2.1/servers/e773ec0c-0cd0-4a08-b9f0-5c2d0a342751 HTTP/1.1 Aug 10 22:58:32.758194 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 22:58:32.758194 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 22:58:32.758194 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 22:58:32.758194 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 22:58:32.758194 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 22:58:32.758194 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 22:58:32.758194 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 22:58:32.758194 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 22:58:32.758194 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9DdzQdZttcsDSkbAvtrDq0FZz2KWBbMTdIrmHT-AvA-Wyp17Vlkz0PaeHZbDt6n4uD88Vge7C9Kb_BpIKM6Qhf1cawUzH2TgSHfqsjQq1yae35dpz-Cc8WCOzjPdNN6g_ujEhmDOhlM1LonGq3GHybmGm7vEyCIPKCXdHaqW9ANOE20 Aug 10 22:58:32.758194 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 22:58:32.758194 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 22:58:32.758194 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 22:58:32.758194 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 22:58:32.758194 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 22:58:32.758194 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 22:58:32.758194 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: deaba512051743deb45881d76eb206ed Aug 10 22:58:32.758194 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1638290532 Aug 10 22:58:32.758194 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 22:58:32.758194 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 22:58:32.759529 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/deaba512051743deb45881d76eb206ed"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/deaba512051743deb45881d76eb206ed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/deaba512051743deb45881d76eb206ed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_deaba512051743deb45881d76eb206ed", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 22:58:32.759529 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1638290532 Aug 10 22:58:32.759529 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: deaba512051743deb45881d76eb206ed Aug 10 22:58:32.759529 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1638290532 Aug 10 22:58:32.759529 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1638290532-project Aug 10 22:58:32.759529 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 22:58:32.759529 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 22:58:32.759529 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: eaed2a2e56f749a88c340aaccb15d2d9 Aug 10 22:58:32.759529 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1638290532-project Aug 10 22:58:32.759529 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 22:58:32.759529 n-d-850468-14 devstack@n-api.service[122632]: exception: Instance e773ec0c-0cd0-4a08-b9f0-5c2d0a342751 could not be found. Aug 10 22:58:32.759529 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': 'e773ec0c-0cd0-4a08-b9f0-5c2d0a342751'} Aug 10 22:58:32.760247 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 22:58:32.760247 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:58:32.760247 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 22:58:32.760247 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 22:58:32.760247 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 22:58:32.760247 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 22:58:32.760247 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 22:58:32.760247 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 22:58:32.760247 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 22:58:32.760247 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 22:58:32.760247 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e773ec0c-0cd0-4a08-b9f0-5c2d0a342751 could not be found. Aug 10 22:58:32.760247 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:58:32.760247 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:58:32.760247 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:58:32.760247 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:58:32.760247 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:58:32.760247 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:58:32.760247 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 22:58:32.760247 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 22:58:32.760247 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 22:58:32.761379 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 22:58:32.761379 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 22:58:32.761379 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 22:58:32.761379 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 22:58:32.761379 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 22:58:32.761379 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 22:58:32.761379 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 22:58:32.761379 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e773ec0c-0cd0-4a08-b9f0-5c2d0a342751 could not be found. Aug 10 22:58:32.761379 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:58:32.761379 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:58:32.761379 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:58:32.761379 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:58:32.761379 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:58:32.761379 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:58:32.761379 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 22:58:32.761379 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 22:58:32.761379 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e773ec0c-0cd0-4a08-b9f0-5c2d0a342751 could not be found. Aug 10 22:58:32.761379 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:58:32.764374 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-0ec224a3-2489-47f4-a0e8-ab17cca3abf4 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Returning 404 to user: Instance e773ec0c-0cd0-4a08-b9f0-5c2d0a342751 could not be found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 22:58:32.766175 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-0ec224a3-2489-47f4-a0e8-ab17cca3abf4 tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] 10.222.0.58 "GET /compute/v2.1/servers/e773ec0c-0cd0-4a08-b9f0-5c2d0a342751" status: 404 len: 111 microversion: 2.1 time: 0.095453 Aug 10 22:58:32.767005 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 328/694] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:58:32 2022] GET /compute/v2.1/servers/e773ec0c-0cd0-4a08-b9f0-5c2d0a342751 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 22:58:32.781705 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-fe7552e0-669c-4e43-93b8-942f56ca68d9 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:32.782989 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-fe7552e0-669c-4e43-93b8-942f56ca68d9 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] [instance: 3553ba91-ca7b-44d9-944a-1540fa047cb6] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:32.811229 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fe7552e0-669c-4e43-93b8-942f56ca68d9 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:32.812510 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fe7552e0-669c-4e43-93b8-942f56ca68d9 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:32.813371 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fe7552e0-669c-4e43-93b8-942f56ca68d9 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:32.822894 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fe7552e0-669c-4e43-93b8-942f56ca68d9 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:32.823564 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fe7552e0-669c-4e43-93b8-942f56ca68d9 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:32.824188 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fe7552e0-669c-4e43-93b8-942f56ca68d9 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:33.008840 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-d15be218-34fa-4666-9659-1efdd11a5750 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:33.018363 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-d15be218-34fa-4666-9659-1efdd11a5750 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/3e467caf-9d1e-4dc0-830d-585aeabc1e5a" status: 200 len: 1477 microversion: 2.1 time: 0.764571 Aug 10 22:58:33.025743 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 367/695] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:58:32 2022] GET /compute/v2.1/servers/3e467caf-9d1e-4dc0-830d-585aeabc1e5a => generated 1477 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:58:33.051337 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-3719e6e2-62c0-4c43-94ca-84b2c383b53c tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:33.052652 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-3719e6e2-62c0-4c43-94ca-84b2c383b53c tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] [instance: ce82674f-e3eb-4e97-acd3-b4da01015330] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:33.065835 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3719e6e2-62c0-4c43-94ca-84b2c383b53c tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:33.067608 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3719e6e2-62c0-4c43-94ca-84b2c383b53c tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:33.069747 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3719e6e2-62c0-4c43-94ca-84b2c383b53c tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:33.070768 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3719e6e2-62c0-4c43-94ca-84b2c383b53c tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:33.072684 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3719e6e2-62c0-4c43-94ca-84b2c383b53c tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:33.073323 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3719e6e2-62c0-4c43-94ca-84b2c383b53c tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:33.468553 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-fe7552e0-669c-4e43-93b8-942f56ca68d9 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e437f9eb7254dc98e2839656c053f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eae334ad72ba421797a6d836edcbab0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:33.487912 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-fe7552e0-669c-4e43-93b8-942f56ca68d9 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] 10.222.0.58 "GET /compute/v2.1/servers/3553ba91-ca7b-44d9-944a-1540fa047cb6" status: 200 len: 1367 microversion: 2.1 time: 0.719380 Aug 10 22:58:33.489595 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 329/696] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:58:32 2022] GET /compute/v2.1/servers/3553ba91-ca7b-44d9-944a-1540fa047cb6 => generated 1367 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:58:33.495050 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-9fe69427-a0b1-4e42-9b0f-bf712502a7df tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:33.497854 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-9fe69427-a0b1-4e42-9b0f-bf712502a7df tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] [instance: ef725aca-9cd8-49a0-81cd-d23710041306] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:33.524377 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9fe69427-a0b1-4e42-9b0f-bf712502a7df tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:33.525074 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9fe69427-a0b1-4e42-9b0f-bf712502a7df tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:33.525675 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9fe69427-a0b1-4e42-9b0f-bf712502a7df tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:33.526724 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9fe69427-a0b1-4e42-9b0f-bf712502a7df tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:33.527542 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9fe69427-a0b1-4e42-9b0f-bf712502a7df tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:33.528131 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9fe69427-a0b1-4e42-9b0f-bf712502a7df tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:33.562042 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-9fe69427-a0b1-4e42-9b0f-bf712502a7df tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] HTTP exception thrown: Instance ef725aca-9cd8-49a0-81cd-d23710041306 could not be found. Aug 10 22:58:33.565619 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-9fe69427-a0b1-4e42-9b0f-bf712502a7df tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Request method failure captured: Aug 10 22:58:33.565619 n-d-850468-14 devstack@n-api.service[122632]: request: DELETE /compute/v2.1/servers/ef725aca-9cd8-49a0-81cd-d23710041306 HTTP/1.1 Aug 10 22:58:33.565619 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 22:58:33.565619 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 22:58:33.565619 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 22:58:33.565619 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 22:58:33.565619 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 22:58:33.565619 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 22:58:33.565619 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 22:58:33.565619 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 22:58:33.565619 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9DdzQdZttcsDSkbAvtrDq0FZz2KWBbMTdIrmHT-AvA-Wyp17Vlkz0PaeHZbDt6n4uD88Vge7C9Kb_BpIKM6Qhf1cawUzH2TgSHfqsjQq1yae35dpz-Cc8WCOzjPdNN6g_ujEhmDOhlM1LonGq3GHybmGm7vEyCIPKCXdHaqW9ANOE20 Aug 10 22:58:33.565619 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 22:58:33.565619 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 22:58:33.565619 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 22:58:33.565619 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 22:58:33.565619 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 22:58:33.565619 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 22:58:33.565619 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: deaba512051743deb45881d76eb206ed Aug 10 22:58:33.565619 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1638290532 Aug 10 22:58:33.565619 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 22:58:33.565619 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 22:58:33.572620 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/deaba512051743deb45881d76eb206ed"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/deaba512051743deb45881d76eb206ed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/deaba512051743deb45881d76eb206ed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_deaba512051743deb45881d76eb206ed", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 22:58:33.572620 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1638290532 Aug 10 22:58:33.572620 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: deaba512051743deb45881d76eb206ed Aug 10 22:58:33.572620 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1638290532 Aug 10 22:58:33.572620 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1638290532-project Aug 10 22:58:33.572620 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 22:58:33.572620 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 22:58:33.572620 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: eaed2a2e56f749a88c340aaccb15d2d9 Aug 10 22:58:33.572620 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1638290532-project Aug 10 22:58:33.572620 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 22:58:33.572620 n-d-850468-14 devstack@n-api.service[122632]: exception: Instance ef725aca-9cd8-49a0-81cd-d23710041306 could not be found. Aug 10 22:58:33.572620 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': 'ef725aca-9cd8-49a0-81cd-d23710041306'} Aug 10 22:58:33.573418 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 22:58:33.573418 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:58:33.573418 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 22:58:33.573418 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 22:58:33.573418 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 22:58:33.573418 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 22:58:33.573418 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 22:58:33.573418 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 22:58:33.573418 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 22:58:33.573418 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 22:58:33.573418 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef725aca-9cd8-49a0-81cd-d23710041306 could not be found. Aug 10 22:58:33.573418 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:58:33.573418 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:58:33.573418 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:58:33.573418 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:58:33.573418 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:58:33.573418 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:58:33.573418 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 22:58:33.573418 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 22:58:33.573418 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 22:58:33.574679 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 22:58:33.574679 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 22:58:33.574679 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 22:58:33.574679 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 22:58:33.574679 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 22:58:33.574679 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 22:58:33.574679 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 22:58:33.574679 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 22:58:33.574679 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 22:58:33.574679 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef725aca-9cd8-49a0-81cd-d23710041306 could not be found. Aug 10 22:58:33.574679 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:58:33.574679 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:58:33.574679 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:58:33.574679 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:58:33.574679 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:58:33.574679 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:58:33.574679 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 22:58:33.574679 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 22:58:33.574679 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef725aca-9cd8-49a0-81cd-d23710041306 could not be found. Aug 10 22:58:33.574679 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:58:33.575871 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-9fe69427-a0b1-4e42-9b0f-bf712502a7df tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Returning 404 to user: Instance ef725aca-9cd8-49a0-81cd-d23710041306 could not be found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 22:58:33.575871 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-9fe69427-a0b1-4e42-9b0f-bf712502a7df tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] 10.222.0.58 "DELETE /compute/v2.1/servers/ef725aca-9cd8-49a0-81cd-d23710041306" status: 404 len: 111 microversion: 2.1 time: 0.074337 Aug 10 22:58:33.575871 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 330/697] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 22:58:33 2022] DELETE /compute/v2.1/servers/ef725aca-9cd8-49a0-81cd-d23710041306 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 22:58:33.584932 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-64dfcf7b-51eb-481c-9226-80182531a0a1 req-2113f8bd-d5a0-4458-84c6-5b022ac402d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3553ba91-ca7b-44d9-944a-1540fa047cb6", "tag": "85a66084-439b-411f-bdff-14a0d1ae381a"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:58:33.596330 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-64dfcf7b-51eb-481c-9226-80182531a0a1 req-2113f8bd-d5a0-4458-84c6-5b022ac402d8 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:33.596812 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-64dfcf7b-51eb-481c-9226-80182531a0a1 req-2113f8bd-d5a0-4458-84c6-5b022ac402d8 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:33.597242 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-64dfcf7b-51eb-481c-9226-80182531a0a1 req-2113f8bd-d5a0-4458-84c6-5b022ac402d8 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:33.630672 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-64dfcf7b-51eb-481c-9226-80182531a0a1 req-2113f8bd-d5a0-4458-84c6-5b022ac402d8 service nova] Creating event network-changed:85a66084-439b-411f-bdff-14a0d1ae381a for instance 3553ba91-ca7b-44d9-944a-1540fa047cb6 on n-h1-850468-14 Aug 10 22:58:33.658671 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-64dfcf7b-51eb-481c-9226-80182531a0a1 req-2113f8bd-d5a0-4458-84c6-5b022ac402d8 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091203 Aug 10 22:58:33.660916 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 331/698] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 22:58:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:58:33.698805 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-6707ce49-da85-4423-ac88-454bd31a8add tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:33.702402 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-6707ce49-da85-4423-ac88-454bd31a8add tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] [instance: ef725aca-9cd8-49a0-81cd-d23710041306] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:33.710130 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-3719e6e2-62c0-4c43-94ca-84b2c383b53c tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6d9806b6724e5aaf8c69be8e70d4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307ab95daa034afbb31f90626885072b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:33.732351 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-3719e6e2-62c0-4c43-94ca-84b2c383b53c tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] 10.222.0.58 "GET /compute/v2.1/servers/ce82674f-e3eb-4e97-acd3-b4da01015330" status: 200 len: 1307 microversion: 2.1 time: 0.702865 Aug 10 22:58:33.735220 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6707ce49-da85-4423-ac88-454bd31a8add tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:33.735994 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 368/699] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:58:33 2022] GET /compute/v2.1/servers/ce82674f-e3eb-4e97-acd3-b4da01015330 => generated 1307 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:58:33.740535 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6707ce49-da85-4423-ac88-454bd31a8add tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:33.742012 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6707ce49-da85-4423-ac88-454bd31a8add tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:33.743861 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6707ce49-da85-4423-ac88-454bd31a8add tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:33.747639 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6707ce49-da85-4423-ac88-454bd31a8add tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:33.748259 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6707ce49-da85-4423-ac88-454bd31a8add tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:33.764090 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-af1d2542-9d6b-40d0-bccc-857faf11f4c3 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:33.768398 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-af1d2542-9d6b-40d0-bccc-857faf11f4c3 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] [instance: 47f49c52-08b0-469c-8969-c9655c6ee39b] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:33.776083 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-6707ce49-da85-4423-ac88-454bd31a8add tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] HTTP exception thrown: Instance ef725aca-9cd8-49a0-81cd-d23710041306 could not be found. Aug 10 22:58:33.779971 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-6707ce49-da85-4423-ac88-454bd31a8add tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Request method failure captured: Aug 10 22:58:33.779971 n-d-850468-14 devstack@n-api.service[122632]: request: GET /compute/v2.1/servers/ef725aca-9cd8-49a0-81cd-d23710041306 HTTP/1.1 Aug 10 22:58:33.779971 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 22:58:33.779971 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 22:58:33.779971 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 22:58:33.779971 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 22:58:33.779971 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 22:58:33.779971 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 22:58:33.779971 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 22:58:33.779971 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 22:58:33.779971 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9DdzQdZttcsDSkbAvtrDq0FZz2KWBbMTdIrmHT-AvA-Wyp17Vlkz0PaeHZbDt6n4uD88Vge7C9Kb_BpIKM6Qhf1cawUzH2TgSHfqsjQq1yae35dpz-Cc8WCOzjPdNN6g_ujEhmDOhlM1LonGq3GHybmGm7vEyCIPKCXdHaqW9ANOE20 Aug 10 22:58:33.779971 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 22:58:33.779971 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 22:58:33.779971 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 22:58:33.779971 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 22:58:33.779971 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 22:58:33.779971 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 22:58:33.779971 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: deaba512051743deb45881d76eb206ed Aug 10 22:58:33.779971 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1638290532 Aug 10 22:58:33.779971 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 22:58:33.779971 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 22:58:33.781384 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/deaba512051743deb45881d76eb206ed"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/deaba512051743deb45881d76eb206ed"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/deaba512051743deb45881d76eb206ed"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_deaba512051743deb45881d76eb206ed", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 22:58:33.781384 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1638290532 Aug 10 22:58:33.781384 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: deaba512051743deb45881d76eb206ed Aug 10 22:58:33.781384 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1638290532 Aug 10 22:58:33.781384 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1638290532-project Aug 10 22:58:33.781384 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 22:58:33.781384 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 22:58:33.781384 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: eaed2a2e56f749a88c340aaccb15d2d9 Aug 10 22:58:33.781384 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1638290532-project Aug 10 22:58:33.781384 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 22:58:33.781384 n-d-850468-14 devstack@n-api.service[122632]: exception: Instance ef725aca-9cd8-49a0-81cd-d23710041306 could not be found. Aug 10 22:58:33.781384 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': 'ef725aca-9cd8-49a0-81cd-d23710041306'} Aug 10 22:58:33.782126 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 22:58:33.782126 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:58:33.782126 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 22:58:33.782126 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 22:58:33.782126 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 22:58:33.782126 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 22:58:33.782126 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 22:58:33.782126 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 22:58:33.782126 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 22:58:33.782126 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 22:58:33.782126 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef725aca-9cd8-49a0-81cd-d23710041306 could not be found. Aug 10 22:58:33.782126 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:58:33.782126 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:58:33.782126 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:58:33.782126 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:58:33.782126 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:58:33.782126 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:58:33.782126 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 22:58:33.782126 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 22:58:33.782126 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 22:58:33.783382 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 22:58:33.783382 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 22:58:33.783382 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 22:58:33.783382 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 22:58:33.783382 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 22:58:33.783382 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 22:58:33.783382 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 22:58:33.783382 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef725aca-9cd8-49a0-81cd-d23710041306 could not be found. Aug 10 22:58:33.783382 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:58:33.783382 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:58:33.783382 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:58:33.783382 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:58:33.783382 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:58:33.783382 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:58:33.783382 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 22:58:33.783382 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 22:58:33.783382 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef725aca-9cd8-49a0-81cd-d23710041306 could not be found. Aug 10 22:58:33.783382 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:58:33.788277 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-6707ce49-da85-4423-ac88-454bd31a8add tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] Returning 404 to user: Instance ef725aca-9cd8-49a0-81cd-d23710041306 could not be found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 22:58:33.790877 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-6707ce49-da85-4423-ac88-454bd31a8add tempest-ServersWithSpecificFlavorTestJSON-1638290532 tempest-ServersWithSpecificFlavorTestJSON-1638290532-project] 10.222.0.58 "GET /compute/v2.1/servers/ef725aca-9cd8-49a0-81cd-d23710041306" status: 404 len: 111 microversion: 2.1 time: 0.127351 Aug 10 22:58:33.794737 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-af1d2542-9d6b-40d0-bccc-857faf11f4c3 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:33.806211 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-af1d2542-9d6b-40d0-bccc-857faf11f4c3 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:33.806211 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-af1d2542-9d6b-40d0-bccc-857faf11f4c3 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:33.806211 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-af1d2542-9d6b-40d0-bccc-857faf11f4c3 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:33.806211 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-af1d2542-9d6b-40d0-bccc-857faf11f4c3 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:33.806545 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 332/700] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:58:33 2022] GET /compute/v2.1/servers/ef725aca-9cd8-49a0-81cd-d23710041306 => generated 111 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 22:58:33.808239 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-af1d2542-9d6b-40d0-bccc-857faf11f4c3 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:33.812512 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-cc30c3a6-61ae-41b1-b0f2-0f18a85725bb tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1311767268", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452", "networks": [{"uuid": "aa35c9d2-0c9d-4fce-b653-23b4074314a8"}], "security_groups": [{"name": "tempest-securitygroup--1840328558"}], "key_name": "tempest-keypair-388514188", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:58:34.224451 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-af1d2542-9d6b-40d0-bccc-857faf11f4c3 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632904331d024d9b8e4d3660dff2cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ed0bdee3aa4013bd9219069bda558c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:34.245879 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-af1d2542-9d6b-40d0-bccc-857faf11f4c3 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] 10.222.0.58 "GET /compute/v2.1/servers/47f49c52-08b0-469c-8969-c9655c6ee39b" status: 200 len: 1504 microversion: 2.1 time: 0.505065 Aug 10 22:58:34.265461 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 369/701] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:58:33 2022] GET /compute/v2.1/servers/47f49c52-08b0-469c-8969-c9655c6ee39b => generated 1504 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:58:34.277982 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-11f5c984-0f5a-47fb-9204-400c8a678775 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:34.278912 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-11f5c984-0f5a-47fb-9204-400c8a678775 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 3e467caf-9d1e-4dc0-830d-585aeabc1e5a] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:34.289222 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-11f5c984-0f5a-47fb-9204-400c8a678775 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:34.292914 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-11f5c984-0f5a-47fb-9204-400c8a678775 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:34.293813 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-11f5c984-0f5a-47fb-9204-400c8a678775 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:34.297378 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-11f5c984-0f5a-47fb-9204-400c8a678775 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:34.297887 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-11f5c984-0f5a-47fb-9204-400c8a678775 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:34.303717 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-11f5c984-0f5a-47fb-9204-400c8a678775 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:34.372530 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=4 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:58:34.379369 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.network.neutron [None req-cc30c3a6-61ae-41b1-b0f2-0f18a85725bb tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] validate_networks() for [('aa35c9d2-0c9d-4fce-b653-23b4074314a8', None, None, None, None, None)] {{(pid=122632) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 22:58:34.684624 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-11f5c984-0f5a-47fb-9204-400c8a678775 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:34.696536 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-11f5c984-0f5a-47fb-9204-400c8a678775 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/3e467caf-9d1e-4dc0-830d-585aeabc1e5a" status: 200 len: 1477 microversion: 2.1 time: 0.433007 Aug 10 22:58:34.697863 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 370/702] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:58:34 2022] GET /compute/v2.1/servers/3e467caf-9d1e-4dc0-830d-585aeabc1e5a => generated 1477 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:58:34.704095 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-8030981b-c861-4980-8a35-b4e3537e4cea tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:34.705013 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-8030981b-c861-4980-8a35-b4e3537e4cea tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] [instance: 3553ba91-ca7b-44d9-944a-1540fa047cb6] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:34.712826 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8030981b-c861-4980-8a35-b4e3537e4cea tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:34.714462 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8030981b-c861-4980-8a35-b4e3537e4cea tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:34.715034 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8030981b-c861-4980-8a35-b4e3537e4cea tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:34.715851 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8030981b-c861-4980-8a35-b4e3537e4cea tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:34.716616 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8030981b-c861-4980-8a35-b4e3537e4cea tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:34.718048 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8030981b-c861-4980-8a35-b4e3537e4cea tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:34.842374 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-cc30c3a6-61ae-41b1-b0f2-0f18a85725bb tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Flavor limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 22:58:34.844214 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-cc30c3a6-61ae-41b1-b0f2-0f18a85725bb tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Image limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 22:58:34.844726 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-cc30c3a6-61ae-41b1-b0f2-0f18a85725bb tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Flavor pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 22:58:34.845139 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-cc30c3a6-61ae-41b1-b0f2-0f18a85725bb tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Image pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 22:58:34.846136 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-cc30c3a6-61ae-41b1-b0f2-0f18a85725bb tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 22:58:34.861231 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cc30c3a6-61ae-41b1-b0f2-0f18a85725bb tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:34.861730 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cc30c3a6-61ae-41b1-b0f2-0f18a85725bb tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:34.862171 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cc30c3a6-61ae-41b1-b0f2-0f18a85725bb tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:34.863626 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cc30c3a6-61ae-41b1-b0f2-0f18a85725bb tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:34.865258 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cc30c3a6-61ae-41b1-b0f2-0f18a85725bb tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:34.865871 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cc30c3a6-61ae-41b1-b0f2-0f18a85725bb tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:34.891734 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-cc30c3a6-61ae-41b1-b0f2-0f18a85725bb tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Getting quotas for project b4355fdc73c84fa2baf0d5c9a33e69d5. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 22:58:34.900450 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-cc30c3a6-61ae-41b1-b0f2-0f18a85725bb tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Getting quotas for user 394f0e6843424c7b83d2dfff61f66ede and project b4355fdc73c84fa2baf0d5c9a33e69d5. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 22:58:34.919248 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-cc30c3a6-61ae-41b1-b0f2-0f18a85725bb tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Going to run 1 instances... {{(pid=122632) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 22:58:34.924316 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-cc30c3a6-61ae-41b1-b0f2-0f18a85725bb tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] [instance: 99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78ad8905-f66f-4733-8be9-2b260f1fabed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122632) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 22:58:34.987709 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-cc30c3a6-61ae-41b1-b0f2-0f18a85725bb tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.25 time: 1.183499 Aug 10 22:58:34.989395 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 333/703] 10.222.0.58 () {62 vars in 1188 bytes} [Wed Aug 10 22:58:33 2022] POST /compute/v2.1/servers => generated 406 bytes in 1186 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 10 22:58:34.994313 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-b8228908-a68b-4616-bd23-860a3c6a221b tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:34.995222 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-b8228908-a68b-4616-bd23-860a3c6a221b tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] [instance: ce82674f-e3eb-4e97-acd3-b4da01015330] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:35.002455 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b8228908-a68b-4616-bd23-860a3c6a221b tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:35.003142 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b8228908-a68b-4616-bd23-860a3c6a221b tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:35.003967 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b8228908-a68b-4616-bd23-860a3c6a221b tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:35.004867 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b8228908-a68b-4616-bd23-860a3c6a221b tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:35.005478 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b8228908-a68b-4616-bd23-860a3c6a221b tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:35.006092 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b8228908-a68b-4616-bd23-860a3c6a221b tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:35.282664 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-b8228908-a68b-4616-bd23-860a3c6a221b tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6d9806b6724e5aaf8c69be8e70d4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307ab95daa034afbb31f90626885072b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:35.291380 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-b8228908-a68b-4616-bd23-860a3c6a221b tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] 10.222.0.58 "GET /compute/v2.1/servers/ce82674f-e3eb-4e97-acd3-b4da01015330" status: 200 len: 1307 microversion: 2.1 time: 0.300665 Aug 10 22:58:35.292193 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 334/704] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:58:34 2022] GET /compute/v2.1/servers/ce82674f-e3eb-4e97-acd3-b4da01015330 => generated 1307 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:58:35.300477 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-942c2b7a-1045-4567-9b43-090ba7fb1c7d tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:35.301853 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-942c2b7a-1045-4567-9b43-090ba7fb1c7d tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] [instance: 99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:35.376109 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-8030981b-c861-4980-8a35-b4e3537e4cea tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e437f9eb7254dc98e2839656c053f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eae334ad72ba421797a6d836edcbab0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:35.387495 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-8030981b-c861-4980-8a35-b4e3537e4cea tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] 10.222.0.58 "GET /compute/v2.1/servers/3553ba91-ca7b-44d9-944a-1540fa047cb6" status: 200 len: 1367 microversion: 2.1 time: 0.688408 Aug 10 22:58:35.400087 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 371/705] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:58:34 2022] GET /compute/v2.1/servers/3553ba91-ca7b-44d9-944a-1540fa047cb6 => generated 1367 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:58:35.400360 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-942c2b7a-1045-4567-9b43-090ba7fb1c7d tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:35.407922 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-b65ed20e-d567-4541-99da-895a89bf6e28 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:35.408823 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-b65ed20e-d567-4541-99da-895a89bf6e28 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] [instance: 47f49c52-08b0-469c-8969-c9655c6ee39b] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:35.418059 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-942c2b7a-1045-4567-9b43-090ba7fb1c7d tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:35.421330 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-942c2b7a-1045-4567-9b43-090ba7fb1c7d tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:35.424594 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-942c2b7a-1045-4567-9b43-090ba7fb1c7d tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] 10.222.0.58 "GET /compute/v2.1/servers/99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0" status: 200 len: 1285 microversion: 2.25 time: 0.131159 Aug 10 22:58:35.424939 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b65ed20e-d567-4541-99da-895a89bf6e28 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:35.425833 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b65ed20e-d567-4541-99da-895a89bf6e28 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:35.426446 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b65ed20e-d567-4541-99da-895a89bf6e28 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:35.427434 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b65ed20e-d567-4541-99da-895a89bf6e28 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:35.428054 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b65ed20e-d567-4541-99da-895a89bf6e28 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:35.428663 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b65ed20e-d567-4541-99da-895a89bf6e28 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:35.443344 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 335/706] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 22:58:35 2022] GET /compute/v2.1/servers/99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0 => generated 1285 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:58:35.482770 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=18 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:58:35.718289 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-d1a12628-b73e-4506-b455-097c2f93e9ca tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:35.718934 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-d1a12628-b73e-4506-b455-097c2f93e9ca tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 3e467caf-9d1e-4dc0-830d-585aeabc1e5a] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:35.725175 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d1a12628-b73e-4506-b455-097c2f93e9ca tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:35.725666 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d1a12628-b73e-4506-b455-097c2f93e9ca tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:35.726103 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d1a12628-b73e-4506-b455-097c2f93e9ca tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:35.727080 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d1a12628-b73e-4506-b455-097c2f93e9ca tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:35.727905 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d1a12628-b73e-4506-b455-097c2f93e9ca tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:35.728584 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d1a12628-b73e-4506-b455-097c2f93e9ca tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:35.831325 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-b65ed20e-d567-4541-99da-895a89bf6e28 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632904331d024d9b8e4d3660dff2cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ed0bdee3aa4013bd9219069bda558c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:35.850442 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-b65ed20e-d567-4541-99da-895a89bf6e28 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] 10.222.0.58 "GET /compute/v2.1/servers/47f49c52-08b0-469c-8969-c9655c6ee39b" status: 200 len: 1504 microversion: 2.1 time: 0.448814 Aug 10 22:58:35.855015 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 372/707] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:58:35 2022] GET /compute/v2.1/servers/47f49c52-08b0-469c-8969-c9655c6ee39b => generated 1504 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:58:36.134562 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-d1a12628-b73e-4506-b455-097c2f93e9ca tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:36.157179 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-d1a12628-b73e-4506-b455-097c2f93e9ca tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/3e467caf-9d1e-4dc0-830d-585aeabc1e5a" status: 200 len: 1477 microversion: 2.1 time: 0.439780 Aug 10 22:58:36.171437 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 336/708] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:58:35 2022] GET /compute/v2.1/servers/3e467caf-9d1e-4dc0-830d-585aeabc1e5a => generated 1477 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:58:36.201056 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-983164dd-0573-4c72-ac0a-7825d465bb92 tempest-FloatingIPDetailsTestJSON-1048992273 tempest-FloatingIPDetailsTestJSON-1048992273-project] Action: 'create', calling method: .version_select at 0x7f847d624790>, body: {"pool": null} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:58:36.315977 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-3a149c9f-a509-49a4-8363-ffd9de0b92df tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:36.317695 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-3a149c9f-a509-49a4-8363-ffd9de0b92df tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] [instance: ce82674f-e3eb-4e97-acd3-b4da01015330] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:36.329841 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3a149c9f-a509-49a4-8363-ffd9de0b92df tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:36.331887 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3a149c9f-a509-49a4-8363-ffd9de0b92df tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:36.333909 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3a149c9f-a509-49a4-8363-ffd9de0b92df tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:36.337026 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3a149c9f-a509-49a4-8363-ffd9de0b92df tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:36.337767 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3a149c9f-a509-49a4-8363-ffd9de0b92df tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:36.338420 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3a149c9f-a509-49a4-8363-ffd9de0b92df tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:36.959045 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-3a149c9f-a509-49a4-8363-ffd9de0b92df tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6d9806b6724e5aaf8c69be8e70d4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307ab95daa034afbb31f90626885072b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:36.979187 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-3a149c9f-a509-49a4-8363-ffd9de0b92df tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] 10.222.0.58 "GET /compute/v2.1/servers/ce82674f-e3eb-4e97-acd3-b4da01015330" status: 200 len: 1307 microversion: 2.1 time: 0.667923 Aug 10 22:58:36.999229 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 337/709] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:58:36 2022] GET /compute/v2.1/servers/ce82674f-e3eb-4e97-acd3-b4da01015330 => generated 1307 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:58:37.012990 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-afb0e142-2df2-4a46-813f-d73e7e909781 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:37.015624 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-afb0e142-2df2-4a46-813f-d73e7e909781 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] [instance: 3553ba91-ca7b-44d9-944a-1540fa047cb6] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:37.036609 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-afb0e142-2df2-4a46-813f-d73e7e909781 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:37.037147 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-afb0e142-2df2-4a46-813f-d73e7e909781 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:37.045898 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-afb0e142-2df2-4a46-813f-d73e7e909781 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:37.047052 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-afb0e142-2df2-4a46-813f-d73e7e909781 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:37.052439 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-afb0e142-2df2-4a46-813f-d73e7e909781 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:37.053219 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-afb0e142-2df2-4a46-813f-d73e7e909781 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:37.424603 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-afb0e142-2df2-4a46-813f-d73e7e909781 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e437f9eb7254dc98e2839656c053f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eae334ad72ba421797a6d836edcbab0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:37.435399 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-afb0e142-2df2-4a46-813f-d73e7e909781 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] 10.222.0.58 "GET /compute/v2.1/servers/3553ba91-ca7b-44d9-944a-1540fa047cb6" status: 200 len: 1367 microversion: 2.1 time: 0.434403 Aug 10 22:58:37.447010 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 338/710] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:58:36 2022] GET /compute/v2.1/servers/3553ba91-ca7b-44d9-944a-1540fa047cb6 => generated 1367 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:58:37.455242 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-d1d57e75-81bb-4f5b-90a7-8a142d0d7eec req-abcbab25-1ca6-41b0-8cf3-f1e42194fda9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce82674f-e3eb-4e97-acd3-b4da01015330", "name": "network-vif-plugged", "status": "completed", "tag": "a612824c-2998-441d-ad59-b655d3918bdf"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:58:37.487389 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-d1d57e75-81bb-4f5b-90a7-8a142d0d7eec req-abcbab25-1ca6-41b0-8cf3-f1e42194fda9 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:37.490009 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-d1d57e75-81bb-4f5b-90a7-8a142d0d7eec req-abcbab25-1ca6-41b0-8cf3-f1e42194fda9 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:37.490915 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-d1d57e75-81bb-4f5b-90a7-8a142d0d7eec req-abcbab25-1ca6-41b0-8cf3-f1e42194fda9 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:37.503366 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-d1d57e75-81bb-4f5b-90a7-8a142d0d7eec req-abcbab25-1ca6-41b0-8cf3-f1e42194fda9 service nova] Creating event network-vif-plugged:a612824c-2998-441d-ad59-b655d3918bdf for instance ce82674f-e3eb-4e97-acd3-b4da01015330 on n-h2-850468-14 Aug 10 22:58:37.510540 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-d1d57e75-81bb-4f5b-90a7-8a142d0d7eec req-abcbab25-1ca6-41b0-8cf3-f1e42194fda9 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073267 Aug 10 22:58:37.517809 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 339/711] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 22:58:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:58:37.560819 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-f7f0f88c-f98b-4901-97c0-1582a5da6a1c tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:37.570887 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-f7f0f88c-f98b-4901-97c0-1582a5da6a1c tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] [instance: 99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:37.587841 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f7f0f88c-f98b-4901-97c0-1582a5da6a1c tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:37.588636 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f7f0f88c-f98b-4901-97c0-1582a5da6a1c tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:37.591194 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f7f0f88c-f98b-4901-97c0-1582a5da6a1c tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:37.594645 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f7f0f88c-f98b-4901-97c0-1582a5da6a1c tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:37.597956 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f7f0f88c-f98b-4901-97c0-1582a5da6a1c tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:37.598701 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f7f0f88c-f98b-4901-97c0-1582a5da6a1c tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:37.747163 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-f7f0f88c-f98b-4901-97c0-1582a5da6a1c tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:37.761493 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-f7f0f88c-f98b-4901-97c0-1582a5da6a1c tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:37.766040 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-f7f0f88c-f98b-4901-97c0-1582a5da6a1c tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:37.770047 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-f7f0f88c-f98b-4901-97c0-1582a5da6a1c tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] 10.222.0.58 "GET /compute/v2.1/servers/99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0" status: 200 len: 1343 microversion: 2.25 time: 0.230976 Aug 10 22:58:37.774749 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 340/712] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 22:58:37 2022] GET /compute/v2.1/servers/99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0 => generated 1343 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:58:37.789005 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c7632111-f641-4d3c-8d2b-1fcb386f1bf6 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:37.789637 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-c7632111-f641-4d3c-8d2b-1fcb386f1bf6 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] [instance: 47f49c52-08b0-469c-8969-c9655c6ee39b] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:37.807907 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c7632111-f641-4d3c-8d2b-1fcb386f1bf6 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:37.808598 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c7632111-f641-4d3c-8d2b-1fcb386f1bf6 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:37.809101 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c7632111-f641-4d3c-8d2b-1fcb386f1bf6 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:37.810019 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c7632111-f641-4d3c-8d2b-1fcb386f1bf6 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:37.810489 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c7632111-f641-4d3c-8d2b-1fcb386f1bf6 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:37.810973 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c7632111-f641-4d3c-8d2b-1fcb386f1bf6 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:38.268162 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-c7632111-f641-4d3c-8d2b-1fcb386f1bf6 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632904331d024d9b8e4d3660dff2cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ed0bdee3aa4013bd9219069bda558c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:38.276803 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-c7632111-f641-4d3c-8d2b-1fcb386f1bf6 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] 10.222.0.58 "GET /compute/v2.1/servers/47f49c52-08b0-469c-8969-c9655c6ee39b" status: 200 len: 1504 microversion: 2.1 time: 0.500436 Aug 10 22:58:38.277408 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 341/713] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:58:37 2022] GET /compute/v2.1/servers/47f49c52-08b0-469c-8969-c9655c6ee39b => generated 1504 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:58:38.287584 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c0e0c7c1-11a7-4fec-b103-3a7d7a121db7 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:38.288227 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-c0e0c7c1-11a7-4fec-b103-3a7d7a121db7 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 3e467caf-9d1e-4dc0-830d-585aeabc1e5a] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:38.313055 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c0e0c7c1-11a7-4fec-b103-3a7d7a121db7 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:38.314705 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c0e0c7c1-11a7-4fec-b103-3a7d7a121db7 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:38.315198 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c0e0c7c1-11a7-4fec-b103-3a7d7a121db7 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:38.315923 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c0e0c7c1-11a7-4fec-b103-3a7d7a121db7 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:38.316670 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c0e0c7c1-11a7-4fec-b103-3a7d7a121db7 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:38.317264 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c0e0c7c1-11a7-4fec-b103-3a7d7a121db7 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:39.070566 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-c0e0c7c1-11a7-4fec-b103-3a7d7a121db7 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:39.091600 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-c0e0c7c1-11a7-4fec-b103-3a7d7a121db7 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/3e467caf-9d1e-4dc0-830d-585aeabc1e5a" status: 200 len: 1477 microversion: 2.1 time: 0.811117 Aug 10 22:58:39.092921 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 342/714] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:58:38 2022] GET /compute/v2.1/servers/3e467caf-9d1e-4dc0-830d-585aeabc1e5a => generated 1477 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:58:39.099183 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-1bcf14fc-e6c9-47ed-9f53-3e8e3a251af5 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:39.100075 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-1bcf14fc-e6c9-47ed-9f53-3e8e3a251af5 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] [instance: ce82674f-e3eb-4e97-acd3-b4da01015330] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:39.107459 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1bcf14fc-e6c9-47ed-9f53-3e8e3a251af5 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:39.108164 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1bcf14fc-e6c9-47ed-9f53-3e8e3a251af5 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:39.108757 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1bcf14fc-e6c9-47ed-9f53-3e8e3a251af5 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:39.109656 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1bcf14fc-e6c9-47ed-9f53-3e8e3a251af5 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:39.110267 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1bcf14fc-e6c9-47ed-9f53-3e8e3a251af5 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:39.110877 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1bcf14fc-e6c9-47ed-9f53-3e8e3a251af5 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:39.664522 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-1bcf14fc-e6c9-47ed-9f53-3e8e3a251af5 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6d9806b6724e5aaf8c69be8e70d4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307ab95daa034afbb31f90626885072b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:39.672874 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-1bcf14fc-e6c9-47ed-9f53-3e8e3a251af5 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] 10.222.0.58 "GET /compute/v2.1/servers/ce82674f-e3eb-4e97-acd3-b4da01015330" status: 200 len: 1307 microversion: 2.1 time: 0.578666 Aug 10 22:58:39.688933 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 343/715] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:58:39 2022] GET /compute/v2.1/servers/ce82674f-e3eb-4e97-acd3-b4da01015330 => generated 1307 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:58:39.699373 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-3ff4138a-6541-4159-a2a4-49bb9ab97957 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:39.703194 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-3ff4138a-6541-4159-a2a4-49bb9ab97957 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] [instance: 3553ba91-ca7b-44d9-944a-1540fa047cb6] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:39.723013 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3ff4138a-6541-4159-a2a4-49bb9ab97957 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:39.733444 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3ff4138a-6541-4159-a2a4-49bb9ab97957 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:39.734323 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3ff4138a-6541-4159-a2a4-49bb9ab97957 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:39.735334 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3ff4138a-6541-4159-a2a4-49bb9ab97957 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:39.736015 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3ff4138a-6541-4159-a2a4-49bb9ab97957 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:39.736666 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3ff4138a-6541-4159-a2a4-49bb9ab97957 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:39.923825 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-983164dd-0573-4c72-ac0a-7825d465bb92 tempest-FloatingIPDetailsTestJSON-1048992273 tempest-FloatingIPDetailsTestJSON-1048992273-project] 10.222.0.58 "POST /compute/v2.1/os-floating-ips" status: 200 len: 140 microversion: 2.1 time: 3.943119 Aug 10 22:58:39.924893 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 373/716] 10.222.0.58 () {60 vars in 1170 bytes} [Wed Aug 10 22:58:35 2022] POST /compute/v2.1/os-floating-ips => generated 140 bytes in 3945 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:58:39.930410 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-b2fac4f0-9955-46b3-a188-eedebd1689fb tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:39.931556 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-b2fac4f0-9955-46b3-a188-eedebd1689fb tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] [instance: 99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:39.946201 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b2fac4f0-9955-46b3-a188-eedebd1689fb tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:39.947097 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b2fac4f0-9955-46b3-a188-eedebd1689fb tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:39.947711 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b2fac4f0-9955-46b3-a188-eedebd1689fb tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:39.948593 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b2fac4f0-9955-46b3-a188-eedebd1689fb tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:39.949189 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b2fac4f0-9955-46b3-a188-eedebd1689fb tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:39.949775 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b2fac4f0-9955-46b3-a188-eedebd1689fb tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:39.956188 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=100 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:58:40.124732 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-3ff4138a-6541-4159-a2a4-49bb9ab97957 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e437f9eb7254dc98e2839656c053f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eae334ad72ba421797a6d836edcbab0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:40.145507 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-3ff4138a-6541-4159-a2a4-49bb9ab97957 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] 10.222.0.58 "GET /compute/v2.1/servers/3553ba91-ca7b-44d9-944a-1540fa047cb6" status: 200 len: 1367 microversion: 2.1 time: 0.454428 Aug 10 22:58:40.149822 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 344/717] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:58:39 2022] GET /compute/v2.1/servers/3553ba91-ca7b-44d9-944a-1540fa047cb6 => generated 1367 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:58:40.160937 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-27c35056-097a-411b-835c-e911a50c93cd tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:40.164752 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-27c35056-097a-411b-835c-e911a50c93cd tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] [instance: 47f49c52-08b0-469c-8969-c9655c6ee39b] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:40.180002 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-27c35056-097a-411b-835c-e911a50c93cd tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:40.180679 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-27c35056-097a-411b-835c-e911a50c93cd tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:40.181213 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-27c35056-097a-411b-835c-e911a50c93cd tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:40.182311 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-27c35056-097a-411b-835c-e911a50c93cd tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:40.182914 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-27c35056-097a-411b-835c-e911a50c93cd tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:40.183449 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-27c35056-097a-411b-835c-e911a50c93cd tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:40.215094 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-b2fac4f0-9955-46b3-a188-eedebd1689fb tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:40.228765 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-b2fac4f0-9955-46b3-a188-eedebd1689fb tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:40.230161 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-b2fac4f0-9955-46b3-a188-eedebd1689fb tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:40.231321 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-b2fac4f0-9955-46b3-a188-eedebd1689fb tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] 10.222.0.58 "GET /compute/v2.1/servers/99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0" status: 200 len: 1411 microversion: 2.25 time: 0.305295 Aug 10 22:58:40.234235 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 374/718] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 22:58:39 2022] GET /compute/v2.1/servers/99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0 => generated 1411 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:58:40.253617 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-1a74916a-391b-4c3b-8e8a-1ab1a3b08347 req-a064a3fb-ef68-4ed9-943c-aacd43188649 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3553ba91-ca7b-44d9-944a-1540fa047cb6", "name": "network-vif-plugged", "status": "completed", "tag": "85a66084-439b-411f-bdff-14a0d1ae381a"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:58:40.274322 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-1a74916a-391b-4c3b-8e8a-1ab1a3b08347 req-a064a3fb-ef68-4ed9-943c-aacd43188649 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:40.275125 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-1a74916a-391b-4c3b-8e8a-1ab1a3b08347 req-a064a3fb-ef68-4ed9-943c-aacd43188649 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:40.275748 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-1a74916a-391b-4c3b-8e8a-1ab1a3b08347 req-a064a3fb-ef68-4ed9-943c-aacd43188649 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:40.289359 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-1a74916a-391b-4c3b-8e8a-1ab1a3b08347 req-a064a3fb-ef68-4ed9-943c-aacd43188649 service nova] Creating event network-vif-plugged:85a66084-439b-411f-bdff-14a0d1ae381a for instance 3553ba91-ca7b-44d9-944a-1540fa047cb6 on n-h1-850468-14 Aug 10 22:58:40.295018 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-1a74916a-391b-4c3b-8e8a-1ab1a3b08347 req-a064a3fb-ef68-4ed9-943c-aacd43188649 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056939 Aug 10 22:58:40.295628 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 375/719] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 22:58:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:58:40.301148 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-aae74dc7-8314-4250-8edb-2ee24c358a2f tempest-FloatingIPDetailsTestJSON-1048992273 tempest-FloatingIPDetailsTestJSON-1048992273-project] Action: 'create', calling method: .version_select at 0x7f847d6241f0>, body: {"pool": null} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:58:40.720431 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-27c35056-097a-411b-835c-e911a50c93cd tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632904331d024d9b8e4d3660dff2cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ed0bdee3aa4013bd9219069bda558c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:40.733336 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-27c35056-097a-411b-835c-e911a50c93cd tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] 10.222.0.58 "GET /compute/v2.1/servers/47f49c52-08b0-469c-8969-c9655c6ee39b" status: 200 len: 1494 microversion: 2.1 time: 0.581994 Aug 10 22:58:40.734307 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 345/720] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:58:40 2022] GET /compute/v2.1/servers/47f49c52-08b0-469c-8969-c9655c6ee39b => generated 1494 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:58:40.739763 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-99a23264-0bb2-4e73-98a5-8b341b7457eb tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:40.740939 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-99a23264-0bb2-4e73-98a5-8b341b7457eb tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 3e467caf-9d1e-4dc0-830d-585aeabc1e5a] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:40.747504 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-99a23264-0bb2-4e73-98a5-8b341b7457eb tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:40.749621 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-99a23264-0bb2-4e73-98a5-8b341b7457eb tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:40.750066 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-99a23264-0bb2-4e73-98a5-8b341b7457eb tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:40.751155 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-99a23264-0bb2-4e73-98a5-8b341b7457eb tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:40.751779 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-99a23264-0bb2-4e73-98a5-8b341b7457eb tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:40.752201 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-99a23264-0bb2-4e73-98a5-8b341b7457eb tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:41.187827 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-99a23264-0bb2-4e73-98a5-8b341b7457eb tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:41.196925 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-99a23264-0bb2-4e73-98a5-8b341b7457eb tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/3e467caf-9d1e-4dc0-830d-585aeabc1e5a" status: 200 len: 1477 microversion: 2.1 time: 0.461141 Aug 10 22:58:41.212884 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 346/721] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:58:40 2022] GET /compute/v2.1/servers/3e467caf-9d1e-4dc0-830d-585aeabc1e5a => generated 1477 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:58:41.220686 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-39002384-477a-48d7-ba9b-278a948e3f84 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:41.221518 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-39002384-477a-48d7-ba9b-278a948e3f84 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] [instance: ce82674f-e3eb-4e97-acd3-b4da01015330] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:41.228993 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-39002384-477a-48d7-ba9b-278a948e3f84 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:41.229656 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-39002384-477a-48d7-ba9b-278a948e3f84 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:41.230253 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-39002384-477a-48d7-ba9b-278a948e3f84 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:41.231189 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-39002384-477a-48d7-ba9b-278a948e3f84 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:41.231805 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-39002384-477a-48d7-ba9b-278a948e3f84 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:41.232411 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-39002384-477a-48d7-ba9b-278a948e3f84 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:41.249642 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=100 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:58:41.487117 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-39002384-477a-48d7-ba9b-278a948e3f84 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6d9806b6724e5aaf8c69be8e70d4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307ab95daa034afbb31f90626885072b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:41.498058 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-39002384-477a-48d7-ba9b-278a948e3f84 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] 10.222.0.58 "GET /compute/v2.1/servers/ce82674f-e3eb-4e97-acd3-b4da01015330" status: 200 len: 1487 microversion: 2.1 time: 0.283686 Aug 10 22:58:41.508662 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 347/722] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:58:41 2022] GET /compute/v2.1/servers/ce82674f-e3eb-4e97-acd3-b4da01015330 => generated 1487 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:58:41.524252 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-8a9720e3-af65-4bf7-b5b7-536099c8ab08 tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Calling method '.version_select at 0x7f847d7a6e50>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:41.533487 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8a9720e3-af65-4bf7-b5b7-536099c8ab08 tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:41.533986 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8a9720e3-af65-4bf7-b5b7-536099c8ab08 tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:41.534468 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8a9720e3-af65-4bf7-b5b7-536099c8ab08 tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:41.547993 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-8a9720e3-af65-4bf7-b5b7-536099c8ab08 tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] 10.222.0.58 "GET /compute/v2.1/os-migrations" status: 200 len: 1974 microversion: 2.1 time: 0.041105 Aug 10 22:58:41.564439 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 348/723] 10.222.0.58 () {58 vars in 1143 bytes} [Wed Aug 10 22:58:41 2022] GET /compute/v2.1/os-migrations => generated 1974 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:58:41.570570 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-004e4d64-348c-4121-b645-7fc1943abc13 req-b0604d0b-2353-4c82-83df-37153b827728 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0", "tag": "8098dfba-8285-4ba1-8119-160040ca6e4b"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:58:41.582966 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-004e4d64-348c-4121-b645-7fc1943abc13 req-b0604d0b-2353-4c82-83df-37153b827728 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:41.583655 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-004e4d64-348c-4121-b645-7fc1943abc13 req-b0604d0b-2353-4c82-83df-37153b827728 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:41.584101 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-004e4d64-348c-4121-b645-7fc1943abc13 req-b0604d0b-2353-4c82-83df-37153b827728 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:41.600670 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-004e4d64-348c-4121-b645-7fc1943abc13 req-b0604d0b-2353-4c82-83df-37153b827728 service nova] Creating event network-changed:8098dfba-8285-4ba1-8119-160040ca6e4b for instance 99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0 on n-h2-850468-14 Aug 10 22:58:41.609250 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-004e4d64-348c-4121-b645-7fc1943abc13 req-b0604d0b-2353-4c82-83df-37153b827728 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043416 Aug 10 22:58:41.610920 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 349/724] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 22:58:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:58:41.618197 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-5cfbd07d-4ed7-445e-b29d-ad003f2c0a6d tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:41.619709 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-5cfbd07d-4ed7-445e-b29d-ad003f2c0a6d tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] [instance: 3553ba91-ca7b-44d9-944a-1540fa047cb6] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:41.627157 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5cfbd07d-4ed7-445e-b29d-ad003f2c0a6d tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:41.627651 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5cfbd07d-4ed7-445e-b29d-ad003f2c0a6d tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:41.628616 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5cfbd07d-4ed7-445e-b29d-ad003f2c0a6d tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:41.630123 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5cfbd07d-4ed7-445e-b29d-ad003f2c0a6d tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:41.630772 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5cfbd07d-4ed7-445e-b29d-ad003f2c0a6d tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:41.631230 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5cfbd07d-4ed7-445e-b29d-ad003f2c0a6d tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:41.769271 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-5cfbd07d-4ed7-445e-b29d-ad003f2c0a6d tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e437f9eb7254dc98e2839656c053f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eae334ad72ba421797a6d836edcbab0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:41.777572 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-5cfbd07d-4ed7-445e-b29d-ad003f2c0a6d tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] 10.222.0.58 "GET /compute/v2.1/servers/3553ba91-ca7b-44d9-944a-1540fa047cb6" status: 200 len: 1367 microversion: 2.1 time: 0.164930 Aug 10 22:58:41.778229 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 350/725] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:58:41 2022] GET /compute/v2.1/servers/3553ba91-ca7b-44d9-944a-1540fa047cb6 => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:58:41.783026 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-1d2a726e-47e6-412d-a400-c67fa89d06af tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:41.783659 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-1d2a726e-47e6-412d-a400-c67fa89d06af tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] [instance: 99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:41.789966 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1d2a726e-47e6-412d-a400-c67fa89d06af tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:41.790454 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1d2a726e-47e6-412d-a400-c67fa89d06af tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:41.791042 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1d2a726e-47e6-412d-a400-c67fa89d06af tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:41.791790 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1d2a726e-47e6-412d-a400-c67fa89d06af tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:41.792414 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1d2a726e-47e6-412d-a400-c67fa89d06af tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:41.792843 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1d2a726e-47e6-412d-a400-c67fa89d06af tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:41.949789 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-1d2a726e-47e6-412d-a400-c67fa89d06af tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:41.958402 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-1d2a726e-47e6-412d-a400-c67fa89d06af tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:41.959970 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-1d2a726e-47e6-412d-a400-c67fa89d06af tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:41.961064 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-1d2a726e-47e6-412d-a400-c67fa89d06af tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] 10.222.0.58 "GET /compute/v2.1/servers/99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0" status: 200 len: 1411 microversion: 2.25 time: 0.181693 Aug 10 22:58:41.961620 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 351/726] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 22:58:41 2022] GET /compute/v2.1/servers/99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0 => generated 1411 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:58:41.966110 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-1eb8aeb7-3618-4ef5-b0a5-291239809e92 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:58:41.966972 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-1eb8aeb7-3618-4ef5-b0a5-291239809e92 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] [instance: ce82674f-e3eb-4e97-acd3-b4da01015330] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:41.978489 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1eb8aeb7-3618-4ef5-b0a5-291239809e92 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:41.979372 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1eb8aeb7-3618-4ef5-b0a5-291239809e92 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:41.979805 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1eb8aeb7-3618-4ef5-b0a5-291239809e92 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:41.980697 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1eb8aeb7-3618-4ef5-b0a5-291239809e92 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:41.981142 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1eb8aeb7-3618-4ef5-b0a5-291239809e92 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:41.981563 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1eb8aeb7-3618-4ef5-b0a5-291239809e92 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:42.057592 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-1eb8aeb7-3618-4ef5-b0a5-291239809e92 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] 10.222.0.58 "POST /compute/v2.1/servers/ce82674f-e3eb-4e97-acd3-b4da01015330/action" status: 202 len: 0 microversion: 2.1 time: 0.094701 Aug 10 22:58:42.061514 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 352/727] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 22:58:41 2022] POST /compute/v2.1/servers/ce82674f-e3eb-4e97-acd3-b4da01015330/action => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 22:58:42.064365 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c98c85f2-10fe-412d-a986-08250fcfbc33 tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:42.065154 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-c98c85f2-10fe-412d-a986-08250fcfbc33 tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] [instance: 47f49c52-08b0-469c-8969-c9655c6ee39b] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:42.072539 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c98c85f2-10fe-412d-a986-08250fcfbc33 tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:42.073116 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c98c85f2-10fe-412d-a986-08250fcfbc33 tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:42.073685 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c98c85f2-10fe-412d-a986-08250fcfbc33 tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:42.074501 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c98c85f2-10fe-412d-a986-08250fcfbc33 tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:42.075059 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c98c85f2-10fe-412d-a986-08250fcfbc33 tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:42.075561 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c98c85f2-10fe-412d-a986-08250fcfbc33 tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:42.215503 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-c98c85f2-10fe-412d-a986-08250fcfbc33 tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/47f49c52-08b0-469c-8969-c9655c6ee39b" status: 200 len: 1647 microversion: 2.1 time: 0.155386 Aug 10 22:58:42.216280 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 353/728] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:58:42 2022] GET /compute/v2.1/servers/47f49c52-08b0-469c-8969-c9655c6ee39b => generated 1647 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:58:42.221933 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-d2fe8660-578a-4d12-b652-4d77ca7346e0 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:42.223071 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-d2fe8660-578a-4d12-b652-4d77ca7346e0 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] [instance: ce82674f-e3eb-4e97-acd3-b4da01015330] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:42.228952 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d2fe8660-578a-4d12-b652-4d77ca7346e0 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:42.229436 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d2fe8660-578a-4d12-b652-4d77ca7346e0 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:42.234348 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d2fe8660-578a-4d12-b652-4d77ca7346e0 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:42.234348 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d2fe8660-578a-4d12-b652-4d77ca7346e0 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:42.234348 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d2fe8660-578a-4d12-b652-4d77ca7346e0 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:42.234348 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d2fe8660-578a-4d12-b652-4d77ca7346e0 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:42.268663 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-aae74dc7-8314-4250-8edb-2ee24c358a2f tempest-FloatingIPDetailsTestJSON-1048992273 tempest-FloatingIPDetailsTestJSON-1048992273-project] 10.222.0.58 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 1.971665 Aug 10 22:58:42.270309 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 376/729] 10.222.0.58 () {60 vars in 1170 bytes} [Wed Aug 10 22:58:40 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 1974 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:58:42.275200 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-05adcbcc-84e8-4dd3-b48b-8909a32aa898 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:42.276425 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-05adcbcc-84e8-4dd3-b48b-8909a32aa898 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 3e467caf-9d1e-4dc0-830d-585aeabc1e5a] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:42.283137 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-05adcbcc-84e8-4dd3-b48b-8909a32aa898 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:42.284075 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-05adcbcc-84e8-4dd3-b48b-8909a32aa898 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:42.284677 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-05adcbcc-84e8-4dd3-b48b-8909a32aa898 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:42.286248 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-05adcbcc-84e8-4dd3-b48b-8909a32aa898 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:42.286904 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-05adcbcc-84e8-4dd3-b48b-8909a32aa898 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:42.287477 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-05adcbcc-84e8-4dd3-b48b-8909a32aa898 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:42.385154 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-d2fe8660-578a-4d12-b652-4d77ca7346e0 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6d9806b6724e5aaf8c69be8e70d4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307ab95daa034afbb31f90626885072b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:42.392940 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-d2fe8660-578a-4d12-b652-4d77ca7346e0 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] 10.222.0.58 "GET /compute/v2.1/servers/ce82674f-e3eb-4e97-acd3-b4da01015330" status: 200 len: 1492 microversion: 2.1 time: 0.176003 Aug 10 22:58:42.393515 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 354/730] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:58:42 2022] GET /compute/v2.1/servers/ce82674f-e3eb-4e97-acd3-b4da01015330 => generated 1492 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:58:42.399188 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-9360e159-6ab2-4940-9d7a-75e82448f0fa tempest-FloatingIPDetailsTestJSON-1048992273 tempest-FloatingIPDetailsTestJSON-1048992273-project] Action: 'create', calling method: .version_select at 0x7f847d614c10>, body: {"pool": null} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:58:42.523004 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-05adcbcc-84e8-4dd3-b48b-8909a32aa898 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:42.532644 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-05adcbcc-84e8-4dd3-b48b-8909a32aa898 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/3e467caf-9d1e-4dc0-830d-585aeabc1e5a" status: 200 len: 1477 microversion: 2.1 time: 0.261053 Aug 10 22:58:42.533297 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 377/731] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:58:42 2022] GET /compute/v2.1/servers/3e467caf-9d1e-4dc0-830d-585aeabc1e5a => generated 1477 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:58:42.539715 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-581a2800-6063-4769-a202-5fd2c8ba7a59 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-123722936", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452", "networks": [{"uuid": "cf6262ce-5add-4f6f-96db-0c1b276bc5f7"}]}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:58:42.603872 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.network.neutron [None req-581a2800-6063-4769-a202-5fd2c8ba7a59 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] validate_networks() for [('cf6262ce-5add-4f6f-96db-0c1b276bc5f7', None, None, None, None, None)] {{(pid=122633) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 22:58:43.292971 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-581a2800-6063-4769-a202-5fd2c8ba7a59 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Flavor limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 22:58:43.294262 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-581a2800-6063-4769-a202-5fd2c8ba7a59 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Image limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 22:58:43.295073 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-581a2800-6063-4769-a202-5fd2c8ba7a59 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Flavor pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 22:58:43.295654 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-581a2800-6063-4769-a202-5fd2c8ba7a59 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Image pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 22:58:43.297887 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-581a2800-6063-4769-a202-5fd2c8ba7a59 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 22:58:43.309776 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-581a2800-6063-4769-a202-5fd2c8ba7a59 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:43.310671 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-581a2800-6063-4769-a202-5fd2c8ba7a59 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:43.320077 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-581a2800-6063-4769-a202-5fd2c8ba7a59 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:43.321530 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-581a2800-6063-4769-a202-5fd2c8ba7a59 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:43.322754 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-581a2800-6063-4769-a202-5fd2c8ba7a59 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:43.323455 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-581a2800-6063-4769-a202-5fd2c8ba7a59 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:43.350912 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-581a2800-6063-4769-a202-5fd2c8ba7a59 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Getting quotas for project 56ed0bdee3aa4013bd9219069bda558c. Resources: {'instances', 'cores', 'ram'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 22:58:43.356082 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-581a2800-6063-4769-a202-5fd2c8ba7a59 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Getting quotas for user 632904331d024d9b8e4d3660dff2cdf3 and project 56ed0bdee3aa4013bd9219069bda558c. Resources: {'instances', 'cores', 'ram'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 22:58:43.369909 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-581a2800-6063-4769-a202-5fd2c8ba7a59 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Going to run 1 instances... {{(pid=122633) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 22:58:43.372812 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-581a2800-6063-4769-a202-5fd2c8ba7a59 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] [instance: 9b8271c8-f9d7-48fc-b8ad-a50e71d3cec5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78ad8905-f66f-4733-8be9-2b260f1fabed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122633) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 22:58:43.420820 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-581a2800-6063-4769-a202-5fd2c8ba7a59 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.885799 Aug 10 22:58:43.421455 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 378/732] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 22:58:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 887 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 22:58:43.431831 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-d36787f6-aacc-4fb4-8cdf-72a11efd7393 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:43.432730 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-d36787f6-aacc-4fb4-8cdf-72a11efd7393 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] [instance: 3553ba91-ca7b-44d9-944a-1540fa047cb6] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:43.441481 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d36787f6-aacc-4fb4-8cdf-72a11efd7393 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:43.444251 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d36787f6-aacc-4fb4-8cdf-72a11efd7393 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:43.445975 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d36787f6-aacc-4fb4-8cdf-72a11efd7393 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:43.447219 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d36787f6-aacc-4fb4-8cdf-72a11efd7393 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:43.447822 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d36787f6-aacc-4fb4-8cdf-72a11efd7393 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:43.448391 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d36787f6-aacc-4fb4-8cdf-72a11efd7393 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:43.844734 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-d36787f6-aacc-4fb4-8cdf-72a11efd7393 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e437f9eb7254dc98e2839656c053f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eae334ad72ba421797a6d836edcbab0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:43.874683 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-d36787f6-aacc-4fb4-8cdf-72a11efd7393 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] 10.222.0.58 "GET /compute/v2.1/servers/3553ba91-ca7b-44d9-944a-1540fa047cb6" status: 200 len: 1557 microversion: 2.1 time: 0.451452 Aug 10 22:58:43.884558 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 379/733] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:58:43 2022] GET /compute/v2.1/servers/3553ba91-ca7b-44d9-944a-1540fa047cb6 => generated 1557 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:58:43.891749 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-35d54beb-1936-4497-8f4c-bfb9e6b7cd54 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:43.893613 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-35d54beb-1936-4497-8f4c-bfb9e6b7cd54 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] [instance: 99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:43.902740 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-35d54beb-1936-4497-8f4c-bfb9e6b7cd54 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:43.903481 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-35d54beb-1936-4497-8f4c-bfb9e6b7cd54 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:43.904068 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-35d54beb-1936-4497-8f4c-bfb9e6b7cd54 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:43.904919 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-35d54beb-1936-4497-8f4c-bfb9e6b7cd54 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:43.905538 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-35d54beb-1936-4497-8f4c-bfb9e6b7cd54 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:43.906031 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-35d54beb-1936-4497-8f4c-bfb9e6b7cd54 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:44.016738 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-9360e159-6ab2-4940-9d7a-75e82448f0fa tempest-FloatingIPDetailsTestJSON-1048992273 tempest-FloatingIPDetailsTestJSON-1048992273-project] 10.222.0.58 "POST /compute/v2.1/os-floating-ips" status: 200 len: 140 microversion: 2.1 time: 1.621799 Aug 10 22:58:44.026072 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 355/734] 10.222.0.58 () {60 vars in 1170 bytes} [Wed Aug 10 22:58:42 2022] POST /compute/v2.1/os-floating-ips => generated 140 bytes in 1624 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:58:44.026072 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c6de1c42-77e2-4835-b25a-858987343347 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:44.026072 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-c6de1c42-77e2-4835-b25a-858987343347 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] [instance: ce82674f-e3eb-4e97-acd3-b4da01015330] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:44.039152 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c6de1c42-77e2-4835-b25a-858987343347 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:44.039940 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c6de1c42-77e2-4835-b25a-858987343347 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:44.040456 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c6de1c42-77e2-4835-b25a-858987343347 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:44.041272 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c6de1c42-77e2-4835-b25a-858987343347 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:44.042053 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c6de1c42-77e2-4835-b25a-858987343347 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:44.042599 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c6de1c42-77e2-4835-b25a-858987343347 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:44.200930 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-c6de1c42-77e2-4835-b25a-858987343347 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6d9806b6724e5aaf8c69be8e70d4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307ab95daa034afbb31f90626885072b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:44.216451 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-c6de1c42-77e2-4835-b25a-858987343347 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] 10.222.0.58 "GET /compute/v2.1/servers/ce82674f-e3eb-4e97-acd3-b4da01015330" status: 200 len: 1472 microversion: 2.1 time: 0.196694 Aug 10 22:58:44.217158 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 356/735] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:58:44 2022] GET /compute/v2.1/servers/ce82674f-e3eb-4e97-acd3-b4da01015330 => generated 1472 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:58:44.231270 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-0fa8eac4-1d16-4cd4-9034-d5a812f727dc tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:44.233097 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-0fa8eac4-1d16-4cd4-9034-d5a812f727dc tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] [instance: 9b8271c8-f9d7-48fc-b8ad-a50e71d3cec5] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:44.241963 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0fa8eac4-1d16-4cd4-9034-d5a812f727dc tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:44.244270 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0fa8eac4-1d16-4cd4-9034-d5a812f727dc tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:44.244717 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0fa8eac4-1d16-4cd4-9034-d5a812f727dc tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:44.245615 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0fa8eac4-1d16-4cd4-9034-d5a812f727dc tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:44.246261 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0fa8eac4-1d16-4cd4-9034-d5a812f727dc tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:44.246885 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0fa8eac4-1d16-4cd4-9034-d5a812f727dc tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:44.355329 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-35d54beb-1936-4497-8f4c-bfb9e6b7cd54 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:44.355848 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-0fa8eac4-1d16-4cd4-9034-d5a812f727dc tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632904331d024d9b8e4d3660dff2cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ed0bdee3aa4013bd9219069bda558c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:44.364726 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-0fa8eac4-1d16-4cd4-9034-d5a812f727dc tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] 10.222.0.58 "GET /compute/v2.1/servers/9b8271c8-f9d7-48fc-b8ad-a50e71d3cec5" status: 200 len: 1262 microversion: 2.1 time: 0.145872 Aug 10 22:58:44.365812 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 357/736] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:58:44 2022] GET /compute/v2.1/servers/9b8271c8-f9d7-48fc-b8ad-a50e71d3cec5 => generated 1262 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:58:44.379799 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-35d54beb-1936-4497-8f4c-bfb9e6b7cd54 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:44.384378 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-5816e630-efce-4388-a93d-1a5dbaa0ce46 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:44.387931 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-5816e630-efce-4388-a93d-1a5dbaa0ce46 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 3e467caf-9d1e-4dc0-830d-585aeabc1e5a] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:44.389843 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-35d54beb-1936-4497-8f4c-bfb9e6b7cd54 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:44.392486 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-35d54beb-1936-4497-8f4c-bfb9e6b7cd54 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] 10.222.0.58 "GET /compute/v2.1/servers/99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0" status: 200 len: 1411 microversion: 2.25 time: 0.515872 Aug 10 22:58:44.395490 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 380/737] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 22:58:43 2022] GET /compute/v2.1/servers/99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0 => generated 1411 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:58:44.406343 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5816e630-efce-4388-a93d-1a5dbaa0ce46 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:44.407293 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5816e630-efce-4388-a93d-1a5dbaa0ce46 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:44.407958 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5816e630-efce-4388-a93d-1a5dbaa0ce46 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:44.409075 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5816e630-efce-4388-a93d-1a5dbaa0ce46 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:44.410979 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5816e630-efce-4388-a93d-1a5dbaa0ce46 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:44.411463 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5816e630-efce-4388-a93d-1a5dbaa0ce46 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:44.415120 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-0312ee6c-3902-4c2d-aae8-e0dcc65f169e tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:44.415895 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-0312ee6c-3902-4c2d-aae8-e0dcc65f169e tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] [instance: 3553ba91-ca7b-44d9-944a-1540fa047cb6] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:44.422872 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0312ee6c-3902-4c2d-aae8-e0dcc65f169e tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:44.423958 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0312ee6c-3902-4c2d-aae8-e0dcc65f169e tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:44.424585 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0312ee6c-3902-4c2d-aae8-e0dcc65f169e tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:44.425480 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0312ee6c-3902-4c2d-aae8-e0dcc65f169e tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:44.426096 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0312ee6c-3902-4c2d-aae8-e0dcc65f169e tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:44.426675 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0312ee6c-3902-4c2d-aae8-e0dcc65f169e tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:44.548421 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-0312ee6c-3902-4c2d-aae8-e0dcc65f169e tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] 10.222.0.58 "GET /compute/v2.1/servers/3553ba91-ca7b-44d9-944a-1540fa047cb6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.146478 Aug 10 22:58:44.549276 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 381/738] 10.222.0.58 () {58 vars in 1275 bytes} [Wed Aug 10 22:58:44 2022] GET /compute/v2.1/servers/3553ba91-ca7b-44d9-944a-1540fa047cb6/os-interface => generated 284 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:58:44.563129 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-02f17276-00b7-4119-a6fd-67f8fa06ac26 tempest-FloatingIPDetailsTestJSON-1048992273 tempest-FloatingIPDetailsTestJSON-1048992273-project] Action: 'create', calling method: .version_select at 0x7f847d624790>, body: {"pool": null} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:58:44.879548 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=2 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:58:45.366803 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-5816e630-efce-4388-a93d-1a5dbaa0ce46 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:45.393043 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-5816e630-efce-4388-a93d-1a5dbaa0ce46 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/3e467caf-9d1e-4dc0-830d-585aeabc1e5a" status: 200 len: 1477 microversion: 2.1 time: 1.024474 Aug 10 22:58:45.393660 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 358/739] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:58:44 2022] GET /compute/v2.1/servers/3e467caf-9d1e-4dc0-830d-585aeabc1e5a => generated 1477 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:58:45.401948 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-f1b5dd03-faa8-4a92-83cf-9d6421d6e96d tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-12506120"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:58:45.405232 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-f1b5dd03-faa8-4a92-83cf-9d6421d6e96d tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] [instance: ce82674f-e3eb-4e97-acd3-b4da01015330] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:45.414612 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=14 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:58:45.417061 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f1b5dd03-faa8-4a92-83cf-9d6421d6e96d tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:45.417912 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f1b5dd03-faa8-4a92-83cf-9d6421d6e96d tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:45.418694 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f1b5dd03-faa8-4a92-83cf-9d6421d6e96d tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:45.419620 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f1b5dd03-faa8-4a92-83cf-9d6421d6e96d tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:45.420238 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f1b5dd03-faa8-4a92-83cf-9d6421d6e96d tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:45.420821 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f1b5dd03-faa8-4a92-83cf-9d6421d6e96d tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:45.707674 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-f1b5dd03-faa8-4a92-83cf-9d6421d6e96d tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] 10.222.0.58 "POST /compute/v2.1/servers/ce82674f-e3eb-4e97-acd3-b4da01015330/action" status: 202 len: 0 microversion: 2.1 time: 0.309708 Aug 10 22:58:45.708675 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 359/740] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 22:58:45 2022] POST /compute/v2.1/servers/ce82674f-e3eb-4e97-acd3-b4da01015330/action => generated 0 bytes in 312 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 10 22:58:45.714507 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-95db15f7-d353-460e-8496-9eed12452206 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:45.715471 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-95db15f7-d353-460e-8496-9eed12452206 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] [instance: 9b8271c8-f9d7-48fc-b8ad-a50e71d3cec5] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:45.723984 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-95db15f7-d353-460e-8496-9eed12452206 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:45.725381 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-95db15f7-d353-460e-8496-9eed12452206 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:45.726300 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-95db15f7-d353-460e-8496-9eed12452206 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:45.727402 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-95db15f7-d353-460e-8496-9eed12452206 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:45.728296 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-95db15f7-d353-460e-8496-9eed12452206 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:45.732598 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-95db15f7-d353-460e-8496-9eed12452206 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:45.874529 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-95db15f7-d353-460e-8496-9eed12452206 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632904331d024d9b8e4d3660dff2cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ed0bdee3aa4013bd9219069bda558c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:45.896151 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-95db15f7-d353-460e-8496-9eed12452206 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] 10.222.0.58 "GET /compute/v2.1/servers/9b8271c8-f9d7-48fc-b8ad-a50e71d3cec5" status: 200 len: 1268 microversion: 2.1 time: 0.184545 Aug 10 22:58:45.898226 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 360/741] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:58:45 2022] GET /compute/v2.1/servers/9b8271c8-f9d7-48fc-b8ad-a50e71d3cec5 => generated 1268 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:58:45.905226 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-8dd7468f-0e1f-4d23-9dda-9b35f1ca3a0b tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:45.906222 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-8dd7468f-0e1f-4d23-9dda-9b35f1ca3a0b tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] [instance: 99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:45.915204 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8dd7468f-0e1f-4d23-9dda-9b35f1ca3a0b tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:45.916474 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8dd7468f-0e1f-4d23-9dda-9b35f1ca3a0b tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:45.917154 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8dd7468f-0e1f-4d23-9dda-9b35f1ca3a0b tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:45.918820 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8dd7468f-0e1f-4d23-9dda-9b35f1ca3a0b tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:45.920169 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8dd7468f-0e1f-4d23-9dda-9b35f1ca3a0b tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:45.921162 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8dd7468f-0e1f-4d23-9dda-9b35f1ca3a0b tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:46.078654 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-02f17276-00b7-4119-a6fd-67f8fa06ac26 tempest-FloatingIPDetailsTestJSON-1048992273 tempest-FloatingIPDetailsTestJSON-1048992273-project] 10.222.0.58 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 1.527395 Aug 10 22:58:46.079363 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 382/742] 10.222.0.58 () {60 vars in 1170 bytes} [Wed Aug 10 22:58:44 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 1529 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:58:46.084838 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-d136d63d-1836-4046-8031-4e8865570f8c tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Calling method '.version_select at 0x7f847d4f8af0>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:46.132075 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-d136d63d-1836-4046-8031-4e8865570f8c tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] 10.222.0.58 "GET /compute/v2.1/images/62f64dd0-73ef-4e90-b110-f212252849b4" status: 200 len: 1412 microversion: 2.1 time: 0.051596 Aug 10 22:58:46.132659 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 383/743] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 10 22:58:46 2022] GET /compute/v2.1/images/62f64dd0-73ef-4e90-b110-f212252849b4 => generated 1412 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:58:46.146520 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-aa06b1d5-4236-49b7-9c21-28dd932afb4d tempest-FloatingIPDetailsTestJSON-1048992273 tempest-FloatingIPDetailsTestJSON-1048992273-project] Calling method '.version_select at 0x7f847d6ac9d0>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:46.335570 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-aa06b1d5-4236-49b7-9c21-28dd932afb4d tempest-FloatingIPDetailsTestJSON-1048992273 tempest-FloatingIPDetailsTestJSON-1048992273-project] 10.222.0.58 "GET /compute/v2.1/os-floating-ips/3726167f-228a-4f95-9356-6925c20ea418" status: 200 len: 142 microversion: 2.1 time: 0.195098 Aug 10 22:58:46.336722 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 384/744] 10.222.0.58 () {58 vars in 1260 bytes} [Wed Aug 10 22:58:46 2022] GET /compute/v2.1/os-floating-ips/3726167f-228a-4f95-9356-6925c20ea418 => generated 142 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:58:46.352539 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-863cd1f4-32f2-4851-94c7-afa265a49f0b tempest-FloatingIPDetailsTestJSON-1048992273 tempest-FloatingIPDetailsTestJSON-1048992273-project] Calling method '.version_select at 0x7f847d4a75e0>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:46.506182 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-8dd7468f-0e1f-4d23-9dda-9b35f1ca3a0b tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:46.528288 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-8dd7468f-0e1f-4d23-9dda-9b35f1ca3a0b tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:46.530529 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-8dd7468f-0e1f-4d23-9dda-9b35f1ca3a0b tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:46.531776 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-8dd7468f-0e1f-4d23-9dda-9b35f1ca3a0b tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] 10.222.0.58 "GET /compute/v2.1/servers/99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0" status: 200 len: 1411 microversion: 2.25 time: 0.631891 Aug 10 22:58:46.546176 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 361/745] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 22:58:45 2022] GET /compute/v2.1/servers/99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0 => generated 1411 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:58:46.555039 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-2986aeed-c119-4230-b467-8213d5c11457 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:46.555830 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-2986aeed-c119-4230-b467-8213d5c11457 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 3e467caf-9d1e-4dc0-830d-585aeabc1e5a] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:46.563067 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2986aeed-c119-4230-b467-8213d5c11457 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:46.563829 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2986aeed-c119-4230-b467-8213d5c11457 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:46.564593 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2986aeed-c119-4230-b467-8213d5c11457 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:46.565518 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2986aeed-c119-4230-b467-8213d5c11457 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:46.566506 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2986aeed-c119-4230-b467-8213d5c11457 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:46.567523 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2986aeed-c119-4230-b467-8213d5c11457 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:47.168938 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-863cd1f4-32f2-4851-94c7-afa265a49f0b tempest-FloatingIPDetailsTestJSON-1048992273 tempest-FloatingIPDetailsTestJSON-1048992273-project] 10.222.0.58 "DELETE /compute/v2.1/os-floating-ips/3726167f-228a-4f95-9356-6925c20ea418" status: 202 len: 0 microversion: 2.1 time: 0.822904 Aug 10 22:58:47.169659 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 385/746] 10.222.0.58 () {58 vars in 1263 bytes} [Wed Aug 10 22:58:46 2022] DELETE /compute/v2.1/os-floating-ips/3726167f-228a-4f95-9356-6925c20ea418 => generated 0 bytes in 824 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 22:58:47.174613 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-c92657c6-975e-4d48-af84-fca30a9e2cc8 req-ae8730c8-89cf-471e-92d4-59f85705e9c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0", "name": "network-vif-plugged", "status": "completed", "tag": "8098dfba-8285-4ba1-8119-160040ca6e4b"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:58:47.185412 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-c92657c6-975e-4d48-af84-fca30a9e2cc8 req-ae8730c8-89cf-471e-92d4-59f85705e9c2 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:47.185984 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-c92657c6-975e-4d48-af84-fca30a9e2cc8 req-ae8730c8-89cf-471e-92d4-59f85705e9c2 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:47.186485 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-c92657c6-975e-4d48-af84-fca30a9e2cc8 req-ae8730c8-89cf-471e-92d4-59f85705e9c2 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:47.198720 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-c92657c6-975e-4d48-af84-fca30a9e2cc8 req-ae8730c8-89cf-471e-92d4-59f85705e9c2 service nova] Creating event network-vif-plugged:8098dfba-8285-4ba1-8119-160040ca6e4b for instance 99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0 on n-h2-850468-14 Aug 10 22:58:47.204036 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-c92657c6-975e-4d48-af84-fca30a9e2cc8 req-ae8730c8-89cf-471e-92d4-59f85705e9c2 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033072 Aug 10 22:58:47.204645 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 386/747] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 22:58:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:58:47.209807 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-ffdbfb20-e587-4d50-8b5f-2ddfdbb0f7e2 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:47.210498 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-ffdbfb20-e587-4d50-8b5f-2ddfdbb0f7e2 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] [instance: 9b8271c8-f9d7-48fc-b8ad-a50e71d3cec5] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:47.217850 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ffdbfb20-e587-4d50-8b5f-2ddfdbb0f7e2 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:47.218304 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ffdbfb20-e587-4d50-8b5f-2ddfdbb0f7e2 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:47.218777 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ffdbfb20-e587-4d50-8b5f-2ddfdbb0f7e2 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:47.219602 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ffdbfb20-e587-4d50-8b5f-2ddfdbb0f7e2 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:47.220236 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ffdbfb20-e587-4d50-8b5f-2ddfdbb0f7e2 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:47.221175 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ffdbfb20-e587-4d50-8b5f-2ddfdbb0f7e2 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:47.299749 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-ffdbfb20-e587-4d50-8b5f-2ddfdbb0f7e2 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632904331d024d9b8e4d3660dff2cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ed0bdee3aa4013bd9219069bda558c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:47.310457 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-ffdbfb20-e587-4d50-8b5f-2ddfdbb0f7e2 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] 10.222.0.58 "GET /compute/v2.1/servers/9b8271c8-f9d7-48fc-b8ad-a50e71d3cec5" status: 200 len: 1268 microversion: 2.1 time: 0.104267 Aug 10 22:58:47.311165 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 387/748] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:58:47 2022] GET /compute/v2.1/servers/9b8271c8-f9d7-48fc-b8ad-a50e71d3cec5 => generated 1268 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:58:47.319981 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-109e400c-b408-4a3d-a015-b320effef990 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Calling method '.version_select at 0x7f847d4f81f0>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:47.375996 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-109e400c-b408-4a3d-a015-b320effef990 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] 10.222.0.58 "GET /compute/v2.1/images/62f64dd0-73ef-4e90-b110-f212252849b4" status: 200 len: 1412 microversion: 2.1 time: 0.063182 Aug 10 22:58:47.377038 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 388/749] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 10 22:58:47 2022] GET /compute/v2.1/images/62f64dd0-73ef-4e90-b110-f212252849b4 => generated 1412 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:58:47.382858 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-208a6368-1e1f-42e3-8b35-f936b3a281d3 tempest-FloatingIPDetailsTestJSON-1048992273 tempest-FloatingIPDetailsTestJSON-1048992273-project] Calling method '.version_select at 0x7f847d5b6040>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:47.384227 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-2986aeed-c119-4230-b467-8213d5c11457 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:47.391859 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-2986aeed-c119-4230-b467-8213d5c11457 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/3e467caf-9d1e-4dc0-830d-585aeabc1e5a" status: 200 len: 1476 microversion: 2.1 time: 0.844142 Aug 10 22:58:47.392432 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 362/750] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:58:46 2022] GET /compute/v2.1/servers/3e467caf-9d1e-4dc0-830d-585aeabc1e5a => generated 1476 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:58:47.564104 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-d5e44d9c-fd80-459c-a91d-2c7e0d5a4cd5 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:47.564737 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-d5e44d9c-fd80-459c-a91d-2c7e0d5a4cd5 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] [instance: 99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:47.572675 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d5e44d9c-fd80-459c-a91d-2c7e0d5a4cd5 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:47.573172 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d5e44d9c-fd80-459c-a91d-2c7e0d5a4cd5 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:47.573845 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d5e44d9c-fd80-459c-a91d-2c7e0d5a4cd5 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:47.574664 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d5e44d9c-fd80-459c-a91d-2c7e0d5a4cd5 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:47.575149 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d5e44d9c-fd80-459c-a91d-2c7e0d5a4cd5 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:47.575567 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d5e44d9c-fd80-459c-a91d-2c7e0d5a4cd5 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:47.615375 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-208a6368-1e1f-42e3-8b35-f936b3a281d3 tempest-FloatingIPDetailsTestJSON-1048992273 tempest-FloatingIPDetailsTestJSON-1048992273-project] 10.222.0.58 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.236865 Aug 10 22:58:47.616215 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 389/751] 10.222.0.58 () {58 vars in 1164 bytes} [Wed Aug 10 22:58:47 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 22:58:47.626815 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-4b349a40-19c9-48ea-98a1-53803155687b req-c681113b-cb62-493b-a678-429d554de9af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e467caf-9d1e-4dc0-830d-585aeabc1e5a", "name": "network-vif-unplugged", "status": "completed", "tag": "4039e5dc-d9c0-4105-991d-a67f51743ea9"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:58:47.643770 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-4b349a40-19c9-48ea-98a1-53803155687b req-c681113b-cb62-493b-a678-429d554de9af service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:47.645032 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-4b349a40-19c9-48ea-98a1-53803155687b req-c681113b-cb62-493b-a678-429d554de9af service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:47.645825 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-4b349a40-19c9-48ea-98a1-53803155687b req-c681113b-cb62-493b-a678-429d554de9af service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:47.657447 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-4b349a40-19c9-48ea-98a1-53803155687b req-c681113b-cb62-493b-a678-429d554de9af service nova] Creating event network-vif-unplugged:4039e5dc-d9c0-4105-991d-a67f51743ea9 for instance 3e467caf-9d1e-4dc0-830d-585aeabc1e5a on n-h2-850468-14 Aug 10 22:58:47.664505 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [req-4b349a40-19c9-48ea-98a1-53803155687b req-c681113b-cb62-493b-a678-429d554de9af service nova] Instance 3e467caf-9d1e-4dc0-830d-585aeabc1e5a is migrating within the same cell, copying events to all relevant hosts: {'n-h1-850468-14', 'n-h2-850468-14'} {{(pid=122633) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5901}} Aug 10 22:58:47.679104 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-4b349a40-19c9-48ea-98a1-53803155687b req-c681113b-cb62-493b-a678-429d554de9af service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.061245 Aug 10 22:58:47.680091 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 390/752] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 22:58:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:58:47.685966 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-edf6e5e0-8316-44e4-9e80-da9bf5a8980f tempest-FloatingIPDetailsTestJSON-1048992273 tempest-FloatingIPDetailsTestJSON-1048992273-project] Calling method '.version_select at 0x7f847d4a7ca0>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:47.859523 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-edf6e5e0-8316-44e4-9e80-da9bf5a8980f tempest-FloatingIPDetailsTestJSON-1048992273 tempest-FloatingIPDetailsTestJSON-1048992273-project] 10.222.0.58 "GET /compute/v2.1/os-floating-ips" status: 200 len: 395 microversion: 2.1 time: 0.177970 Aug 10 22:58:47.860186 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 391/753] 10.222.0.58 () {58 vars in 1149 bytes} [Wed Aug 10 22:58:47 2022] GET /compute/v2.1/os-floating-ips => generated 395 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:58:47.873517 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-cbbff653-51be-4ab1-8549-b3d5b6d5188e tempest-FloatingIPDetailsTestJSON-1048992273 tempest-FloatingIPDetailsTestJSON-1048992273-project] Calling method '.version_select at 0x7f847d4f8af0>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:48.155124 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-d5e44d9c-fd80-459c-a91d-2c7e0d5a4cd5 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:48.170773 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-d5e44d9c-fd80-459c-a91d-2c7e0d5a4cd5 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:48.172540 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-d5e44d9c-fd80-459c-a91d-2c7e0d5a4cd5 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:48.173820 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-d5e44d9c-fd80-459c-a91d-2c7e0d5a4cd5 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] 10.222.0.58 "GET /compute/v2.1/servers/99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0" status: 200 len: 1411 microversion: 2.25 time: 0.614758 Aug 10 22:58:48.193098 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 363/754] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 22:58:47 2022] GET /compute/v2.1/servers/99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0 => generated 1411 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:58:48.341577 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-13f6a6b7-1986-4651-908c-aac5f54e4bf7 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:48.344239 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-13f6a6b7-1986-4651-908c-aac5f54e4bf7 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] [instance: 9b8271c8-f9d7-48fc-b8ad-a50e71d3cec5] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:48.366694 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-13f6a6b7-1986-4651-908c-aac5f54e4bf7 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:48.371578 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-13f6a6b7-1986-4651-908c-aac5f54e4bf7 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:48.372492 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-13f6a6b7-1986-4651-908c-aac5f54e4bf7 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:48.373592 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-13f6a6b7-1986-4651-908c-aac5f54e4bf7 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:48.374423 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-13f6a6b7-1986-4651-908c-aac5f54e4bf7 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:48.375205 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-13f6a6b7-1986-4651-908c-aac5f54e4bf7 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:48.466148 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:58:48.871250 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-13f6a6b7-1986-4651-908c-aac5f54e4bf7 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632904331d024d9b8e4d3660dff2cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ed0bdee3aa4013bd9219069bda558c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:48.889635 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-13f6a6b7-1986-4651-908c-aac5f54e4bf7 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] 10.222.0.58 "GET /compute/v2.1/servers/9b8271c8-f9d7-48fc-b8ad-a50e71d3cec5" status: 200 len: 1310 microversion: 2.1 time: 0.559521 Aug 10 22:58:48.890976 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 364/755] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:58:48 2022] GET /compute/v2.1/servers/9b8271c8-f9d7-48fc-b8ad-a50e71d3cec5 => generated 1310 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:58:48.900440 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-a2957811-044d-4346-aa9c-ee70014d41be tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Calling method '.version_select at 0x7f847d59aaf0>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:48.988922 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-a2957811-044d-4346-aa9c-ee70014d41be tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] 10.222.0.58 "GET /compute/v2.1/images/62f64dd0-73ef-4e90-b110-f212252849b4" status: 200 len: 1412 microversion: 2.1 time: 0.095854 Aug 10 22:58:48.992453 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 365/756] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 10 22:58:48 2022] GET /compute/v2.1/images/62f64dd0-73ef-4e90-b110-f212252849b4 => generated 1412 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:58:49.022727 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c60e68d4-d051-45ef-8e76-6274c42ee9bf tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:49.023557 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-c60e68d4-d051-45ef-8e76-6274c42ee9bf tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 3e467caf-9d1e-4dc0-830d-585aeabc1e5a] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:49.043197 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c60e68d4-d051-45ef-8e76-6274c42ee9bf tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:49.043599 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c60e68d4-d051-45ef-8e76-6274c42ee9bf tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:49.044057 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c60e68d4-d051-45ef-8e76-6274c42ee9bf tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:49.046141 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c60e68d4-d051-45ef-8e76-6274c42ee9bf tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:49.046619 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c60e68d4-d051-45ef-8e76-6274c42ee9bf tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:49.054094 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c60e68d4-d051-45ef-8e76-6274c42ee9bf tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:49.198767 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-cbbff653-51be-4ab1-8549-b3d5b6d5188e tempest-FloatingIPDetailsTestJSON-1048992273 tempest-FloatingIPDetailsTestJSON-1048992273-project] 10.222.0.58 "DELETE /compute/v2.1/os-floating-ips/e6d4a910-653f-4b3c-ae77-20b59b0f6821" status: 202 len: 0 microversion: 2.1 time: 1.328545 Aug 10 22:58:49.199667 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 392/757] 10.222.0.58 () {58 vars in 1263 bytes} [Wed Aug 10 22:58:47 2022] DELETE /compute/v2.1/os-floating-ips/e6d4a910-653f-4b3c-ae77-20b59b0f6821 => generated 0 bytes in 1330 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 10 22:58:49.205650 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-be06c6c0-bae4-4476-82f5-2c06b088b7e5 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:49.207465 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-be06c6c0-bae4-4476-82f5-2c06b088b7e5 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] [instance: 99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:49.218523 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-be06c6c0-bae4-4476-82f5-2c06b088b7e5 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:49.219279 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-be06c6c0-bae4-4476-82f5-2c06b088b7e5 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:49.219898 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-be06c6c0-bae4-4476-82f5-2c06b088b7e5 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:49.220751 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-be06c6c0-bae4-4476-82f5-2c06b088b7e5 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:49.221188 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-be06c6c0-bae4-4476-82f5-2c06b088b7e5 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:49.221792 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-be06c6c0-bae4-4476-82f5-2c06b088b7e5 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:49.499958 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-be06c6c0-bae4-4476-82f5-2c06b088b7e5 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:49.509612 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-be06c6c0-bae4-4476-82f5-2c06b088b7e5 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:49.522682 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-be06c6c0-bae4-4476-82f5-2c06b088b7e5 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:49.524235 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-be06c6c0-bae4-4476-82f5-2c06b088b7e5 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] 10.222.0.58 "GET /compute/v2.1/servers/99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0" status: 200 len: 1607 microversion: 2.25 time: 0.323269 Aug 10 22:58:49.539429 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 393/758] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 22:58:49 2022] GET /compute/v2.1/servers/99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0 => generated 1607 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:58:49.547496 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-4b7c1d31-0f9f-4924-80ed-0f7904274051 tempest-FloatingIPDetailsTestJSON-1048992273 tempest-FloatingIPDetailsTestJSON-1048992273-project] Calling method '.version_select at 0x7f847d4a7a60>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:49.578605 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-c60e68d4-d051-45ef-8e76-6274c42ee9bf tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:49.591165 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-c60e68d4-d051-45ef-8e76-6274c42ee9bf tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/3e467caf-9d1e-4dc0-830d-585aeabc1e5a" status: 200 len: 1476 microversion: 2.1 time: 0.595463 Aug 10 22:58:49.596404 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 366/759] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:58:48 2022] GET /compute/v2.1/servers/3e467caf-9d1e-4dc0-830d-585aeabc1e5a => generated 1476 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:58:49.607243 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c165039a-f1fd-4b08-a4d9-f7b68d123e3e tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:49.614910 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-c165039a-f1fd-4b08-a4d9-f7b68d123e3e tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] [instance: 99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:49.624408 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=3,nova_api:INSERT=3 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:58:49.626135 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c165039a-f1fd-4b08-a4d9-f7b68d123e3e tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:49.626901 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c165039a-f1fd-4b08-a4d9-f7b68d123e3e tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:49.627558 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c165039a-f1fd-4b08-a4d9-f7b68d123e3e tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:49.628506 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c165039a-f1fd-4b08-a4d9-f7b68d123e3e tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:49.629467 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c165039a-f1fd-4b08-a4d9-f7b68d123e3e tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:49.630198 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c165039a-f1fd-4b08-a4d9-f7b68d123e3e tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:49.787096 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-c165039a-f1fd-4b08-a4d9-f7b68d123e3e tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] 10.222.0.58 "GET /compute/v2.1/servers/99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0/os-interface" status: 200 len: 284 microversion: 2.25 time: 0.185862 Aug 10 22:58:49.788455 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 367/760] 10.222.0.58 () {60 vars in 1316 bytes} [Wed Aug 10 22:58:49 2022] GET /compute/v2.1/servers/99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0/os-interface => generated 284 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 22:58:49.802059 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-11bef4b1-0ab5-4127-8fa8-cd0d9de85173 req-64b46ef1-52b3-4e35-ae45-bce630682da9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3553ba91-ca7b-44d9-944a-1540fa047cb6", "tag": "85a66084-439b-411f-bdff-14a0d1ae381a"}, {"name": "network-changed", "server_uuid": "3e467caf-9d1e-4dc0-830d-585aeabc1e5a", "tag": "4039e5dc-d9c0-4105-991d-a67f51743ea9"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:58:49.815609 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-11bef4b1-0ab5-4127-8fa8-cd0d9de85173 req-64b46ef1-52b3-4e35-ae45-bce630682da9 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:49.816875 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-11bef4b1-0ab5-4127-8fa8-cd0d9de85173 req-64b46ef1-52b3-4e35-ae45-bce630682da9 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:49.817588 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-11bef4b1-0ab5-4127-8fa8-cd0d9de85173 req-64b46ef1-52b3-4e35-ae45-bce630682da9 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:49.836533 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-11bef4b1-0ab5-4127-8fa8-cd0d9de85173 req-64b46ef1-52b3-4e35-ae45-bce630682da9 service nova] Creating event network-changed:85a66084-439b-411f-bdff-14a0d1ae381a for instance 3553ba91-ca7b-44d9-944a-1540fa047cb6 on n-h1-850468-14 Aug 10 22:58:49.837479 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-11bef4b1-0ab5-4127-8fa8-cd0d9de85173 req-64b46ef1-52b3-4e35-ae45-bce630682da9 service nova] Creating event network-changed:4039e5dc-d9c0-4105-991d-a67f51743ea9 for instance 3e467caf-9d1e-4dc0-830d-585aeabc1e5a on n-h2-850468-14 Aug 10 22:58:49.860661 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [req-11bef4b1-0ab5-4127-8fa8-cd0d9de85173 req-64b46ef1-52b3-4e35-ae45-bce630682da9 service nova] Instance 3e467caf-9d1e-4dc0-830d-585aeabc1e5a is migrating within the same cell, copying events to all relevant hosts: {'n-h1-850468-14', 'n-h2-850468-14'} {{(pid=122632) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5901}} Aug 10 22:58:49.876786 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-11bef4b1-0ab5-4127-8fa8-cd0d9de85173 req-64b46ef1-52b3-4e35-ae45-bce630682da9 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.085588 Aug 10 22:58:49.879126 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 368/761] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 22:58:49 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:58:49.911754 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-76f013f8-6311-4a95-abfc-592552959b10 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:49.913997 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-76f013f8-6311-4a95-abfc-592552959b10 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] [instance: 9b8271c8-f9d7-48fc-b8ad-a50e71d3cec5] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:49.929776 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-76f013f8-6311-4a95-abfc-592552959b10 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:49.930378 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-76f013f8-6311-4a95-abfc-592552959b10 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:49.931280 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-76f013f8-6311-4a95-abfc-592552959b10 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:49.933357 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-76f013f8-6311-4a95-abfc-592552959b10 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:49.938295 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-76f013f8-6311-4a95-abfc-592552959b10 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:49.938295 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-76f013f8-6311-4a95-abfc-592552959b10 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:51.291360 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-4b7c1d31-0f9f-4924-80ed-0f7904274051 tempest-FloatingIPDetailsTestJSON-1048992273 tempest-FloatingIPDetailsTestJSON-1048992273-project] 10.222.0.58 "DELETE /compute/v2.1/os-floating-ips/9e6e449d-ea75-4020-88e6-c160620beabb" status: 202 len: 0 microversion: 2.1 time: 1.750691 Aug 10 22:58:51.292007 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 394/762] 10.222.0.58 () {58 vars in 1263 bytes} [Wed Aug 10 22:58:49 2022] DELETE /compute/v2.1/os-floating-ips/9e6e449d-ea75-4020-88e6-c160620beabb => generated 0 bytes in 1752 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 22:58:51.302060 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-8a98ea12-86e9-4e64-8d8d-ac8c0f88ee7f tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Calling method '.version_select at 0x7f847d5b6670>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:51.332624 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-76f013f8-6311-4a95-abfc-592552959b10 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632904331d024d9b8e4d3660dff2cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ed0bdee3aa4013bd9219069bda558c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:51.348899 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-76f013f8-6311-4a95-abfc-592552959b10 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] 10.222.0.58 "GET /compute/v2.1/servers/9b8271c8-f9d7-48fc-b8ad-a50e71d3cec5" status: 200 len: 1310 microversion: 2.1 time: 1.441064 Aug 10 22:58:51.351574 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 369/763] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:58:49 2022] GET /compute/v2.1/servers/9b8271c8-f9d7-48fc-b8ad-a50e71d3cec5 => generated 1310 bytes in 1447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:58:51.356917 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-dee04db8-e567-40d7-bfee-24a7bf8b920f tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:51.357536 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-dee04db8-e567-40d7-bfee-24a7bf8b920f tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 3e467caf-9d1e-4dc0-830d-585aeabc1e5a] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:51.365186 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dee04db8-e567-40d7-bfee-24a7bf8b920f tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:51.365887 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dee04db8-e567-40d7-bfee-24a7bf8b920f tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:51.366512 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dee04db8-e567-40d7-bfee-24a7bf8b920f tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:51.368128 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dee04db8-e567-40d7-bfee-24a7bf8b920f tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:51.368894 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dee04db8-e567-40d7-bfee-24a7bf8b920f tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:51.369692 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dee04db8-e567-40d7-bfee-24a7bf8b920f tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:51.370399 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-8a98ea12-86e9-4e64-8d8d-ac8c0f88ee7f tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] 10.222.0.58 "GET /compute/v2.1/images/62f64dd0-73ef-4e90-b110-f212252849b4" status: 200 len: 1412 microversion: 2.1 time: 0.076236 Aug 10 22:58:51.371510 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 395/764] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 10 22:58:51 2022] GET /compute/v2.1/images/62f64dd0-73ef-4e90-b110-f212252849b4 => generated 1412 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:58:51.394479 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-cb26c020-8f31-4b9b-b96b-fccc4863ba03 tempest-FloatingIPDetailsTestJSON-1048992273 tempest-FloatingIPDetailsTestJSON-1048992273-project] Calling method '.version_select at 0x7f847d5b6b80>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:52.077521 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-dee04db8-e567-40d7-bfee-24a7bf8b920f tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:52.122635 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-dee04db8-e567-40d7-bfee-24a7bf8b920f tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/3e467caf-9d1e-4dc0-830d-585aeabc1e5a" status: 200 len: 1476 microversion: 2.1 time: 0.767147 Aug 10 22:58:52.125238 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 370/765] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:58:51 2022] GET /compute/v2.1/servers/3e467caf-9d1e-4dc0-830d-585aeabc1e5a => generated 1476 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:58:52.138013 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-d18c537a-3975-4a45-bb9d-9d202e9f058c req-dff80c58-5881-4915-8960-94d10bf0afe7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b8271c8-f9d7-48fc-b8ad-a50e71d3cec5", "tag": "1fc37ded-1174-48fe-96fd-658af446018b"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:58:52.165363 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-d18c537a-3975-4a45-bb9d-9d202e9f058c req-dff80c58-5881-4915-8960-94d10bf0afe7 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:52.166417 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-d18c537a-3975-4a45-bb9d-9d202e9f058c req-dff80c58-5881-4915-8960-94d10bf0afe7 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:52.167093 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-d18c537a-3975-4a45-bb9d-9d202e9f058c req-dff80c58-5881-4915-8960-94d10bf0afe7 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:52.183932 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-d18c537a-3975-4a45-bb9d-9d202e9f058c req-dff80c58-5881-4915-8960-94d10bf0afe7 service nova] Creating event network-changed:1fc37ded-1174-48fe-96fd-658af446018b for instance 9b8271c8-f9d7-48fc-b8ad-a50e71d3cec5 on n-h2-850468-14 Aug 10 22:58:52.190980 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-d18c537a-3975-4a45-bb9d-9d202e9f058c req-dff80c58-5881-4915-8960-94d10bf0afe7 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061901 Aug 10 22:58:52.193342 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 371/766] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 22:58:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:58:52.378017 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-22140f76-373d-4243-a823-789750b22961 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:52.379929 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-22140f76-373d-4243-a823-789750b22961 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] [instance: 9b8271c8-f9d7-48fc-b8ad-a50e71d3cec5] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:52.404400 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-22140f76-373d-4243-a823-789750b22961 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:52.406936 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-22140f76-373d-4243-a823-789750b22961 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:52.411118 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-22140f76-373d-4243-a823-789750b22961 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:52.412939 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-22140f76-373d-4243-a823-789750b22961 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:52.415346 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-22140f76-373d-4243-a823-789750b22961 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:52.417807 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-22140f76-373d-4243-a823-789750b22961 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:52.928249 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-cb26c020-8f31-4b9b-b96b-fccc4863ba03 tempest-FloatingIPDetailsTestJSON-1048992273 tempest-FloatingIPDetailsTestJSON-1048992273-project] 10.222.0.58 "DELETE /compute/v2.1/os-floating-ips/2fb1f228-b570-4c80-b68b-479fdd8a14b1" status: 202 len: 0 microversion: 2.1 time: 1.555273 Aug 10 22:58:52.929525 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 396/767] 10.222.0.58 () {58 vars in 1263 bytes} [Wed Aug 10 22:58:51 2022] DELETE /compute/v2.1/os-floating-ips/2fb1f228-b570-4c80-b68b-479fdd8a14b1 => generated 0 bytes in 1557 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 22:58:52.936914 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-6c585449-53e2-4181-94ed-b8bdcb1e6ba6 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Calling method '.version_select at 0x7f84801cef70>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:53.007769 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-6c585449-53e2-4181-94ed-b8bdcb1e6ba6 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] 10.222.0.58 "GET /compute/v2.1/images/62f64dd0-73ef-4e90-b110-f212252849b4" status: 200 len: 1412 microversion: 2.1 time: 0.077145 Aug 10 22:58:53.016465 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 397/768] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 10 22:58:52 2022] GET /compute/v2.1/images/62f64dd0-73ef-4e90-b110-f212252849b4 => generated 1412 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:58:53.024397 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-fdfa7658-58e7-4ed2-b5d0-77b12970c6be req-fc5a8fcf-a341-4704-a83a-c533e7487c18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce82674f-e3eb-4e97-acd3-b4da01015330", "name": "network-vif-plugged", "status": "completed", "tag": "a612824c-2998-441d-ad59-b655d3918bdf"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:58:53.048364 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-fdfa7658-58e7-4ed2-b5d0-77b12970c6be req-fc5a8fcf-a341-4704-a83a-c533e7487c18 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:53.050302 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-fdfa7658-58e7-4ed2-b5d0-77b12970c6be req-fc5a8fcf-a341-4704-a83a-c533e7487c18 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:53.059403 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-fdfa7658-58e7-4ed2-b5d0-77b12970c6be req-fc5a8fcf-a341-4704-a83a-c533e7487c18 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:53.085979 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-fdfa7658-58e7-4ed2-b5d0-77b12970c6be req-fc5a8fcf-a341-4704-a83a-c533e7487c18 service nova] Creating event network-vif-plugged:a612824c-2998-441d-ad59-b655d3918bdf for instance ce82674f-e3eb-4e97-acd3-b4da01015330 on n-h2-850468-14 Aug 10 22:58:53.092065 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-fdfa7658-58e7-4ed2-b5d0-77b12970c6be req-fc5a8fcf-a341-4704-a83a-c533e7487c18 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074869 Aug 10 22:58:53.092958 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 398/769] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 22:58:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:58:53.147639 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-4b88255f-e08a-4dc4-8112-f3542c22aa40 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:53.148643 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-4b88255f-e08a-4dc4-8112-f3542c22aa40 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 3e467caf-9d1e-4dc0-830d-585aeabc1e5a] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:53.158380 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4b88255f-e08a-4dc4-8112-f3542c22aa40 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:53.159244 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4b88255f-e08a-4dc4-8112-f3542c22aa40 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:53.160047 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4b88255f-e08a-4dc4-8112-f3542c22aa40 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:53.161637 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4b88255f-e08a-4dc4-8112-f3542c22aa40 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:53.162285 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4b88255f-e08a-4dc4-8112-f3542c22aa40 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:53.162989 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4b88255f-e08a-4dc4-8112-f3542c22aa40 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:53.198038 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-22140f76-373d-4243-a823-789750b22961 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632904331d024d9b8e4d3660dff2cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ed0bdee3aa4013bd9219069bda558c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:53.206370 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-22140f76-373d-4243-a823-789750b22961 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] 10.222.0.58 "GET /compute/v2.1/servers/9b8271c8-f9d7-48fc-b8ad-a50e71d3cec5" status: 200 len: 1310 microversion: 2.1 time: 0.836731 Aug 10 22:58:53.210154 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 372/770] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:58:52 2022] GET /compute/v2.1/servers/9b8271c8-f9d7-48fc-b8ad-a50e71d3cec5 => generated 1310 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:58:53.336273 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=2 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:58:53.363423 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=6 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:58:53.538825 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-4b88255f-e08a-4dc4-8112-f3542c22aa40 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:53.549992 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-4b88255f-e08a-4dc4-8112-f3542c22aa40 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/3e467caf-9d1e-4dc0-830d-585aeabc1e5a" status: 200 len: 1474 microversion: 2.1 time: 0.406949 Aug 10 22:58:53.551727 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 399/771] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:58:53 2022] GET /compute/v2.1/servers/3e467caf-9d1e-4dc0-830d-585aeabc1e5a => generated 1474 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:58:54.024562 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-a9cdc252-2d39-4739-826c-3cf3a773935d tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Calling method '.version_select at 0x7f847d59aca0>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:54.152387 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-a9cdc252-2d39-4739-826c-3cf3a773935d tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] 10.222.0.58 "GET /compute/v2.1/images/62f64dd0-73ef-4e90-b110-f212252849b4" status: 200 len: 1412 microversion: 2.1 time: 0.132484 Aug 10 22:58:54.153272 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 373/772] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 10 22:58:54 2022] GET /compute/v2.1/images/62f64dd0-73ef-4e90-b110-f212252849b4 => generated 1412 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:58:54.234616 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c6ac9823-20fa-42f4-9419-c4842d827ee3 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:54.235977 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-c6ac9823-20fa-42f4-9419-c4842d827ee3 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] [instance: 9b8271c8-f9d7-48fc-b8ad-a50e71d3cec5] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:54.250819 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c6ac9823-20fa-42f4-9419-c4842d827ee3 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:54.251730 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c6ac9823-20fa-42f4-9419-c4842d827ee3 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:54.255550 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c6ac9823-20fa-42f4-9419-c4842d827ee3 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:54.259269 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c6ac9823-20fa-42f4-9419-c4842d827ee3 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:54.259992 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c6ac9823-20fa-42f4-9419-c4842d827ee3 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:54.263814 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c6ac9823-20fa-42f4-9419-c4842d827ee3 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:54.350260 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-bd563fb4-bd19-407a-affc-a58e29b0df31 req-11cd4934-337f-4c08-abac-c972ce3bd7a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0", "tag": "8098dfba-8285-4ba1-8119-160040ca6e4b"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:58:54.365575 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-bd563fb4-bd19-407a-affc-a58e29b0df31 req-11cd4934-337f-4c08-abac-c972ce3bd7a6 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:54.368762 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-bd563fb4-bd19-407a-affc-a58e29b0df31 req-11cd4934-337f-4c08-abac-c972ce3bd7a6 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:54.369472 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-bd563fb4-bd19-407a-affc-a58e29b0df31 req-11cd4934-337f-4c08-abac-c972ce3bd7a6 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:54.410363 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-bd563fb4-bd19-407a-affc-a58e29b0df31 req-11cd4934-337f-4c08-abac-c972ce3bd7a6 service nova] Creating event network-changed:8098dfba-8285-4ba1-8119-160040ca6e4b for instance 99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0 on n-h2-850468-14 Aug 10 22:58:54.447659 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-bd563fb4-bd19-407a-affc-a58e29b0df31 req-11cd4934-337f-4c08-abac-c972ce3bd7a6 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085015 Aug 10 22:58:54.459516 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 374/773] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 22:58:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Aug 10 22:58:54.577349 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-2a2382d2-ac5c-4610-97f2-9b3ac6a98c03 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:54.578242 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-2a2382d2-ac5c-4610-97f2-9b3ac6a98c03 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 3e467caf-9d1e-4dc0-830d-585aeabc1e5a] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:54.588984 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2a2382d2-ac5c-4610-97f2-9b3ac6a98c03 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:54.589509 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2a2382d2-ac5c-4610-97f2-9b3ac6a98c03 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:54.589966 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2a2382d2-ac5c-4610-97f2-9b3ac6a98c03 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:54.590691 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2a2382d2-ac5c-4610-97f2-9b3ac6a98c03 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:54.591191 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2a2382d2-ac5c-4610-97f2-9b3ac6a98c03 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:54.591597 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2a2382d2-ac5c-4610-97f2-9b3ac6a98c03 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:55.307090 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-2a2382d2-ac5c-4610-97f2-9b3ac6a98c03 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:55.320717 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-2a2382d2-ac5c-4610-97f2-9b3ac6a98c03 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/3e467caf-9d1e-4dc0-830d-585aeabc1e5a" status: 200 len: 1471 microversion: 2.1 time: 0.748275 Aug 10 22:58:55.321625 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 375/774] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:58:54 2022] GET /compute/v2.1/servers/3e467caf-9d1e-4dc0-830d-585aeabc1e5a => generated 1471 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:58:55.326148 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c2c5fafe-2ccc-4be2-96d1-f5cb3d0294cb tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Calling method '.version_select at 0x7f847d614550>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:55.401067 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-c2c5fafe-2ccc-4be2-96d1-f5cb3d0294cb tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] 10.222.0.58 "GET /compute/v2.1/images/62f64dd0-73ef-4e90-b110-f212252849b4" status: 200 len: 1412 microversion: 2.1 time: 0.078387 Aug 10 22:58:55.401701 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 376/775] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 10 22:58:55 2022] GET /compute/v2.1/images/62f64dd0-73ef-4e90-b110-f212252849b4 => generated 1412 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:58:55.414654 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-0b1e71be-b62f-484d-b50e-bb4227021e77 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:58:55.419670 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-0b1e71be-b62f-484d-b50e-bb4227021e77 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 3e467caf-9d1e-4dc0-830d-585aeabc1e5a] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:55.423911 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-c6ac9823-20fa-42f4-9419-c4842d827ee3 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632904331d024d9b8e4d3660dff2cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ed0bdee3aa4013bd9219069bda558c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:55.435169 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-c6ac9823-20fa-42f4-9419-c4842d827ee3 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] 10.222.0.58 "GET /compute/v2.1/servers/9b8271c8-f9d7-48fc-b8ad-a50e71d3cec5" status: 200 len: 1310 microversion: 2.1 time: 1.205790 Aug 10 22:58:55.440709 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0b1e71be-b62f-484d-b50e-bb4227021e77 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:55.441372 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0b1e71be-b62f-484d-b50e-bb4227021e77 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:55.443183 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0b1e71be-b62f-484d-b50e-bb4227021e77 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:55.450053 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0b1e71be-b62f-484d-b50e-bb4227021e77 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:55.450769 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0b1e71be-b62f-484d-b50e-bb4227021e77 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:55.452101 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0b1e71be-b62f-484d-b50e-bb4227021e77 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:55.461023 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 400/776] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:58:54 2022] GET /compute/v2.1/servers/9b8271c8-f9d7-48fc-b8ad-a50e71d3cec5 => generated 1310 bytes in 1229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:58:55.574721 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-0b1e71be-b62f-484d-b50e-bb4227021e77 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "POST /compute/v2.1/servers/3e467caf-9d1e-4dc0-830d-585aeabc1e5a/action" status: 204 len: 0 microversion: 2.1 time: 0.171749 Aug 10 22:58:55.578020 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 377/777] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 22:58:55 2022] POST /compute/v2.1/servers/3e467caf-9d1e-4dc0-830d-585aeabc1e5a/action => generated 0 bytes in 175 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 22:58:55.587395 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c3069ea0-3a51-4964-994a-9275de68681d tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:55.588312 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-c3069ea0-3a51-4964-994a-9275de68681d tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 3e467caf-9d1e-4dc0-830d-585aeabc1e5a] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:55.599489 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c3069ea0-3a51-4964-994a-9275de68681d tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:55.607601 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c3069ea0-3a51-4964-994a-9275de68681d tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:55.608253 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c3069ea0-3a51-4964-994a-9275de68681d tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:55.609253 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c3069ea0-3a51-4964-994a-9275de68681d tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:55.609713 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c3069ea0-3a51-4964-994a-9275de68681d tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:55.610139 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c3069ea0-3a51-4964-994a-9275de68681d tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:56.250404 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-c3069ea0-3a51-4964-994a-9275de68681d tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:56.265020 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-c3069ea0-3a51-4964-994a-9275de68681d tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/3e467caf-9d1e-4dc0-830d-585aeabc1e5a" status: 200 len: 1471 microversion: 2.1 time: 0.682315 Aug 10 22:58:56.292394 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 401/778] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:58:55 2022] GET /compute/v2.1/servers/3e467caf-9d1e-4dc0-830d-585aeabc1e5a => generated 1471 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:58:56.352469 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-5f32e3b8-33d8-4f03-98da-d25d16cacf44 tempest-FlavorsV255TestJSON-4979459 tempest-FlavorsV255TestJSON-4979459-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-569558298", "id": 1720797538, "os-flavor-access:is_public": "True"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:58:56.355630 n-d-850468-14 devstack@n-api.service[122632]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:58:56.355630 n-d-850468-14 devstack@n-api.service[122632]: warnings.warn(msg) Aug 10 22:58:56.413498 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-5f32e3b8-33d8-4f03-98da-d25d16cacf44 tempest-FlavorsV255TestJSON-4979459 tempest-FlavorsV255TestJSON-4979459-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 448 microversion: 2.55 time: 0.475692 Aug 10 22:58:56.415096 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 378/779] 10.222.0.58 () {62 vars in 1188 bytes} [Wed Aug 10 22:58:55 2022] POST /compute/v2.1/flavors => generated 448 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 22:58:56.417933 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-a5ae9bd2-cd5d-4201-bdfd-19ff3da6653b tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Calling method '.version_select at 0x7f847d5b68b0>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:56.540783 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-a5ae9bd2-cd5d-4201-bdfd-19ff3da6653b tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] 10.222.0.58 "GET /compute/v2.1/images/62f64dd0-73ef-4e90-b110-f212252849b4" status: 200 len: 1412 microversion: 2.1 time: 0.125313 Aug 10 22:58:56.545389 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 402/780] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 10 22:58:56 2022] GET /compute/v2.1/images/62f64dd0-73ef-4e90-b110-f212252849b4 => generated 1412 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:58:56.557126 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-69ebfaed-7933-4ee8-a173-39ba98d2aef8 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:56.559773 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-69ebfaed-7933-4ee8-a173-39ba98d2aef8 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] [instance: 9b8271c8-f9d7-48fc-b8ad-a50e71d3cec5] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:56.573145 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-69ebfaed-7933-4ee8-a173-39ba98d2aef8 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:56.573635 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-69ebfaed-7933-4ee8-a173-39ba98d2aef8 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:56.575164 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-69ebfaed-7933-4ee8-a173-39ba98d2aef8 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:56.576278 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-69ebfaed-7933-4ee8-a173-39ba98d2aef8 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:56.582561 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-69ebfaed-7933-4ee8-a173-39ba98d2aef8 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:56.583383 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-69ebfaed-7933-4ee8-a173-39ba98d2aef8 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:56.623046 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-1644aed8-a7c5-4964-bb46-233745b03f82 tempest-FlavorsV255TestJSON-87208070 tempest-FlavorsV255TestJSON-87208070-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:56.635588 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-1644aed8-a7c5-4964-bb46-233745b03f82 tempest-FlavorsV255TestJSON-87208070 tempest-FlavorsV255TestJSON-87208070-project] 10.222.0.58 "GET /compute/v2.1/flavors/1720797538" status: 200 len: 448 microversion: 2.55 time: 0.212561 Aug 10 22:58:56.639377 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 379/781] 10.222.0.58 () {60 vars in 1199 bytes} [Wed Aug 10 22:58:56 2022] GET /compute/v2.1/flavors/1720797538 => generated 448 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 22:58:56.652647 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-40eb4b07-4743-4524-a2eb-27a274a6aefd tempest-FlavorsV255TestJSON-4979459 tempest-FlavorsV255TestJSON-4979459-project-admin] Action: 'update', calling method: .version_select at 0x7f84800ca4c0>, body: {"flavor": {"description": "new"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:58:56.665421 n-d-850468-14 devstack@n-api.service[122632]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:58:56.665421 n-d-850468-14 devstack@n-api.service[122632]: warnings.warn(msg) Aug 10 22:58:56.704504 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-40eb4b07-4743-4524-a2eb-27a274a6aefd tempest-FlavorsV255TestJSON-4979459 tempest-FlavorsV255TestJSON-4979459-project-admin] 10.222.0.58 "PUT /compute/v2.1/flavors/1720797538" status: 200 len: 449 microversion: 2.55 time: 0.055871 Aug 10 22:58:56.705915 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 380/782] 10.222.0.58 () {62 vars in 1219 bytes} [Wed Aug 10 22:58:56 2022] PUT /compute/v2.1/flavors/1720797538 => generated 449 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 22:58:56.720562 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-6237e8a3-e394-4d3f-a35c-5c8a1469a325 tempest-FlavorsV255TestJSON-87208070 tempest-FlavorsV255TestJSON-87208070-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:56.752247 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-6237e8a3-e394-4d3f-a35c-5c8a1469a325 tempest-FlavorsV255TestJSON-87208070 tempest-FlavorsV255TestJSON-87208070-project] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 5724 microversion: 2.55 time: 0.037194 Aug 10 22:58:56.754133 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 381/783] 10.222.0.58 () {60 vars in 1187 bytes} [Wed Aug 10 22:58:56 2022] GET /compute/v2.1/flavors/detail => generated 5724 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:58:56.777337 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-7b2aa837-b4ca-43e8-ba02-8c0a40a5411d tempest-FlavorsV255TestJSON-87208070 tempest-FlavorsV255TestJSON-87208070-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:56.803770 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-7b2aa837-b4ca-43e8-ba02-8c0a40a5411d tempest-FlavorsV255TestJSON-87208070 tempest-FlavorsV255TestJSON-87208070-project] 10.222.0.58 "GET /compute/v2.1/flavors" status: 200 len: 3156 microversion: 2.55 time: 0.030829 Aug 10 22:58:56.804830 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 382/784] 10.222.0.58 () {60 vars in 1166 bytes} [Wed Aug 10 22:58:56 2022] GET /compute/v2.1/flavors => generated 3156 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 22:58:56.824014 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-9c203758-021b-43ab-8b21-5a41a750e213 tempest-FlavorsV255TestJSON-4979459 tempest-FlavorsV255TestJSON-4979459-project-admin] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:56.825116 n-d-850468-14 devstack@n-api.service[122632]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:58:56.825116 n-d-850468-14 devstack@n-api.service[122632]: warnings.warn(msg) Aug 10 22:58:56.850847 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-9c203758-021b-43ab-8b21-5a41a750e213 tempest-FlavorsV255TestJSON-4979459 tempest-FlavorsV255TestJSON-4979459-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/1720797538" status: 202 len: 0 microversion: 2.55 time: 0.029528 Aug 10 22:58:56.854035 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 383/785] 10.222.0.58 () {60 vars in 1202 bytes} [Wed Aug 10 22:58:56 2022] DELETE /compute/v2.1/flavors/1720797538 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 10 22:58:56.866245 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-f67c68f0-4c6b-4cba-9bff-404f9f85db0a tempest-FlavorsV255TestJSON-4979459 tempest-FlavorsV255TestJSON-4979459-project-admin] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:56.912127 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-f67c68f0-4c6b-4cba-9bff-404f9f85db0a tempest-FlavorsV255TestJSON-4979459 tempest-FlavorsV255TestJSON-4979459-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 5285 microversion: 2.55 time: 0.054199 Aug 10 22:58:56.914004 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 384/786] 10.222.0.58 () {60 vars in 1187 bytes} [Wed Aug 10 22:58:56 2022] GET /compute/v2.1/flavors/detail => generated 5285 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:58:57.149162 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-69ebfaed-7933-4ee8-a173-39ba98d2aef8 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632904331d024d9b8e4d3660dff2cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ed0bdee3aa4013bd9219069bda558c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:57.158283 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-69ebfaed-7933-4ee8-a173-39ba98d2aef8 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] 10.222.0.58 "GET /compute/v2.1/servers/9b8271c8-f9d7-48fc-b8ad-a50e71d3cec5" status: 200 len: 1310 microversion: 2.1 time: 0.607642 Aug 10 22:58:57.159505 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 403/787] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:58:56 2022] GET /compute/v2.1/servers/9b8271c8-f9d7-48fc-b8ad-a50e71d3cec5 => generated 1310 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:58:57.290277 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-9154de47-4139-4aeb-ac6a-dc404eabbd31 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:57.292360 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-9154de47-4139-4aeb-ac6a-dc404eabbd31 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 3e467caf-9d1e-4dc0-830d-585aeabc1e5a] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:57.303908 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9154de47-4139-4aeb-ac6a-dc404eabbd31 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:57.304531 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9154de47-4139-4aeb-ac6a-dc404eabbd31 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:57.306123 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9154de47-4139-4aeb-ac6a-dc404eabbd31 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:57.308412 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9154de47-4139-4aeb-ac6a-dc404eabbd31 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:57.309142 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9154de47-4139-4aeb-ac6a-dc404eabbd31 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:57.312154 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9154de47-4139-4aeb-ac6a-dc404eabbd31 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:57.558363 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-5d13f3b6-7b7f-4679-9f41-8a7414190197 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Calling method '.version_select at 0x7f847d6cb700>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:57.673387 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-5d13f3b6-7b7f-4679-9f41-8a7414190197 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] 10.222.0.58 "GET /compute/v2.1/images/62f64dd0-73ef-4e90-b110-f212252849b4" status: 200 len: 1412 microversion: 2.1 time: 0.120998 Aug 10 22:58:57.674211 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 404/788] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 10 22:58:57 2022] GET /compute/v2.1/images/62f64dd0-73ef-4e90-b110-f212252849b4 => generated 1412 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:58:58.151799 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-9154de47-4139-4aeb-ac6a-dc404eabbd31 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:58.167893 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-9154de47-4139-4aeb-ac6a-dc404eabbd31 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/3e467caf-9d1e-4dc0-830d-585aeabc1e5a" status: 200 len: 1471 microversion: 2.1 time: 0.881625 Aug 10 22:58:58.181836 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-030fe818-9672-4182-919e-9c1f471173f6 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:58.182737 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-030fe818-9672-4182-919e-9c1f471173f6 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] [instance: 9b8271c8-f9d7-48fc-b8ad-a50e71d3cec5] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:58.188013 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 385/789] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:58:57 2022] GET /compute/v2.1/servers/3e467caf-9d1e-4dc0-830d-585aeabc1e5a => generated 1471 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:58:58.197529 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-030fe818-9672-4182-919e-9c1f471173f6 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:58.198252 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-030fe818-9672-4182-919e-9c1f471173f6 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:58.200835 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-030fe818-9672-4182-919e-9c1f471173f6 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:58.201788 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-030fe818-9672-4182-919e-9c1f471173f6 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:58.203361 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-030fe818-9672-4182-919e-9c1f471173f6 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:58.206311 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-030fe818-9672-4182-919e-9c1f471173f6 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:58.522445 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-030fe818-9672-4182-919e-9c1f471173f6 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632904331d024d9b8e4d3660dff2cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ed0bdee3aa4013bd9219069bda558c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:58.534211 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-030fe818-9672-4182-919e-9c1f471173f6 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] 10.222.0.58 "GET /compute/v2.1/servers/9b8271c8-f9d7-48fc-b8ad-a50e71d3cec5" status: 200 len: 1310 microversion: 2.1 time: 0.356089 Aug 10 22:58:58.538172 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 405/790] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:58:58 2022] GET /compute/v2.1/servers/9b8271c8-f9d7-48fc-b8ad-a50e71d3cec5 => generated 1310 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:58:58.689075 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-a8694cae-4348-42e1-8bba-6a52b8571993 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Calling method '.version_select at 0x7f847d59a4c0>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:58.745337 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-a8694cae-4348-42e1-8bba-6a52b8571993 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] 10.222.0.58 "GET /compute/v2.1/images/62f64dd0-73ef-4e90-b110-f212252849b4" status: 200 len: 1412 microversion: 2.1 time: 0.060263 Aug 10 22:58:58.746634 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 386/791] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 10 22:58:58 2022] GET /compute/v2.1/images/62f64dd0-73ef-4e90-b110-f212252849b4 => generated 1412 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:58:59.191352 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-cf695d66-133d-4742-a7a7-a9fb5716115d tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:59.193663 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-cf695d66-133d-4742-a7a7-a9fb5716115d tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 3e467caf-9d1e-4dc0-830d-585aeabc1e5a] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:59.209511 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cf695d66-133d-4742-a7a7-a9fb5716115d tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:59.211953 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cf695d66-133d-4742-a7a7-a9fb5716115d tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:59.213862 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cf695d66-133d-4742-a7a7-a9fb5716115d tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:59.215435 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cf695d66-133d-4742-a7a7-a9fb5716115d tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:59.217076 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cf695d66-133d-4742-a7a7-a9fb5716115d tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:59.219931 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cf695d66-133d-4742-a7a7-a9fb5716115d tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:59.265539 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-7b5e9aff-be48-437e-8fbc-6371f1e27ba9 req-4b394f75-4e7f-4deb-9149-40da645f39a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e467caf-9d1e-4dc0-830d-585aeabc1e5a", "name": "network-vif-plugged", "status": "completed", "tag": "4039e5dc-d9c0-4105-991d-a67f51743ea9"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:58:59.284467 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-7b5e9aff-be48-437e-8fbc-6371f1e27ba9 req-4b394f75-4e7f-4deb-9149-40da645f39a2 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:59.285568 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-7b5e9aff-be48-437e-8fbc-6371f1e27ba9 req-4b394f75-4e7f-4deb-9149-40da645f39a2 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:59.286059 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-7b5e9aff-be48-437e-8fbc-6371f1e27ba9 req-4b394f75-4e7f-4deb-9149-40da645f39a2 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:59.324926 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-7b5e9aff-be48-437e-8fbc-6371f1e27ba9 req-4b394f75-4e7f-4deb-9149-40da645f39a2 service nova] Creating event network-vif-plugged:4039e5dc-d9c0-4105-991d-a67f51743ea9 for instance 3e467caf-9d1e-4dc0-830d-585aeabc1e5a on n-h2-850468-14 Aug 10 22:58:59.335870 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-7b5e9aff-be48-437e-8fbc-6371f1e27ba9 req-4b394f75-4e7f-4deb-9149-40da645f39a2 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074287 Aug 10 22:58:59.352184 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 387/792] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 22:58:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 22:58:59.564156 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c1ea79f9-325f-4d83-a1aa-4c4ae5e1bdc1 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:59.565042 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-c1ea79f9-325f-4d83-a1aa-4c4ae5e1bdc1 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] [instance: 9b8271c8-f9d7-48fc-b8ad-a50e71d3cec5] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:59.581767 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c1ea79f9-325f-4d83-a1aa-4c4ae5e1bdc1 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:59.591808 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c1ea79f9-325f-4d83-a1aa-4c4ae5e1bdc1 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:59.596117 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c1ea79f9-325f-4d83-a1aa-4c4ae5e1bdc1 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:59.597985 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c1ea79f9-325f-4d83-a1aa-4c4ae5e1bdc1 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:59.599280 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-cf695d66-133d-4742-a7a7-a9fb5716115d tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:59.611906 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c1ea79f9-325f-4d83-a1aa-4c4ae5e1bdc1 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:59.612621 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c1ea79f9-325f-4d83-a1aa-4c4ae5e1bdc1 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:59.614242 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-cf695d66-133d-4742-a7a7-a9fb5716115d tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/3e467caf-9d1e-4dc0-830d-585aeabc1e5a" status: 200 len: 1463 microversion: 2.1 time: 0.426511 Aug 10 22:58:59.616672 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 406/793] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:58:59 2022] GET /compute/v2.1/servers/3e467caf-9d1e-4dc0-830d-585aeabc1e5a => generated 1463 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:58:59.645323 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-90a9ef01-f30d-48c5-8e6a-df7736586cae tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:58:59.645945 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-90a9ef01-f30d-48c5-8e6a-df7736586cae tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 3e467caf-9d1e-4dc0-830d-585aeabc1e5a] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:58:59.656189 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-90a9ef01-f30d-48c5-8e6a-df7736586cae tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:59.656678 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-90a9ef01-f30d-48c5-8e6a-df7736586cae tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:59.660088 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-90a9ef01-f30d-48c5-8e6a-df7736586cae tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:59.661044 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-90a9ef01-f30d-48c5-8e6a-df7736586cae tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:58:59.662147 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-90a9ef01-f30d-48c5-8e6a-df7736586cae tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:58:59.664126 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-90a9ef01-f30d-48c5-8e6a-df7736586cae tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:58:59.963202 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-c1ea79f9-325f-4d83-a1aa-4c4ae5e1bdc1 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632904331d024d9b8e4d3660dff2cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ed0bdee3aa4013bd9219069bda558c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:58:59.997525 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-c1ea79f9-325f-4d83-a1aa-4c4ae5e1bdc1 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] 10.222.0.58 "GET /compute/v2.1/servers/9b8271c8-f9d7-48fc-b8ad-a50e71d3cec5" status: 200 len: 1310 microversion: 2.1 time: 0.438689 Aug 10 22:59:00.003345 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 388/794] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:58:59 2022] GET /compute/v2.1/servers/9b8271c8-f9d7-48fc-b8ad-a50e71d3cec5 => generated 1310 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:59:00.034006 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-452feb97-2b32-43ff-a6e5-b75afd9ccf7a tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Calling method '.version_select at 0x7f847d5eaa60>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:00.153418 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-452feb97-2b32-43ff-a6e5-b75afd9ccf7a tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] 10.222.0.58 "GET /compute/v2.1/images/62f64dd0-73ef-4e90-b110-f212252849b4" status: 200 len: 1412 microversion: 2.1 time: 0.140567 Aug 10 22:59:00.166888 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 389/795] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 10 22:59:00 2022] GET /compute/v2.1/images/62f64dd0-73ef-4e90-b110-f212252849b4 => generated 1412 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:59:00.435898 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-90a9ef01-f30d-48c5-8e6a-df7736586cae tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:59:00.448335 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-90a9ef01-f30d-48c5-8e6a-df7736586cae tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/3e467caf-9d1e-4dc0-830d-585aeabc1e5a" status: 200 len: 1463 microversion: 2.1 time: 0.805860 Aug 10 22:59:00.449493 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 407/796] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:58:59 2022] GET /compute/v2.1/servers/3e467caf-9d1e-4dc0-830d-585aeabc1e5a => generated 1463 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:59:00.479150 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c09a340d-ea5f-4117-8b4f-b84005dda6a1 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Action: 'create', calling method: .version_select at 0x7f847d5975e0>, body: {"keypair": {"name": "tempest-keypair-1067921324", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKHRxQdFtuccrue9HqEXlMwS9rqpJjg76cMh9OqOE+MGk7hSdjFaSxXMLE/fQ+L0FaIAStbXjLWC48wwIQzah7S1cZJJUVoFg76q+JsIYBPPlFk31GIpyrHJ17dOwOX2wQ=="}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:59:00.499457 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-c09a340d-ea5f-4117-8b4f-b84005dda6a1 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Getting quotas for project f9582683a1cf4e92b3bd3f10db0b497b. Resources: {'key_pairs'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 22:59:00.506928 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-c09a340d-ea5f-4117-8b4f-b84005dda6a1 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Getting quotas for user 5c48fd7279544b1fae228500f5a1e46d and project f9582683a1cf4e92b3bd3f10db0b497b. Resources: {'key_pairs'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 22:59:00.562544 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-c09a340d-ea5f-4117-8b4f-b84005dda6a1 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.087518 Aug 10 22:59:00.563257 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 390/797] 10.222.0.58 () {60 vars in 1159 bytes} [Wed Aug 10 22:59:00 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:59:01.030024 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-40f35c54-ec79-4efb-a683-9c885361b41e tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:01.031236 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-40f35c54-ec79-4efb-a683-9c885361b41e tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] [instance: 9b8271c8-f9d7-48fc-b8ad-a50e71d3cec5] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:01.051319 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-40f35c54-ec79-4efb-a683-9c885361b41e tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:01.057306 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-40f35c54-ec79-4efb-a683-9c885361b41e tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:01.058519 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-40f35c54-ec79-4efb-a683-9c885361b41e tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:01.064290 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-40f35c54-ec79-4efb-a683-9c885361b41e tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:01.064849 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-40f35c54-ec79-4efb-a683-9c885361b41e tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:01.069935 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-40f35c54-ec79-4efb-a683-9c885361b41e tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:01.171683 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-2eca6659-9677-493e-89dd-12989b811632 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Calling method '.version_select at 0x7f847d5ea310>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:01.234763 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-2eca6659-9677-493e-89dd-12989b811632 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] 10.222.0.58 "GET /compute/v2.1/images/62f64dd0-73ef-4e90-b110-f212252849b4" status: 200 len: 1412 microversion: 2.1 time: 0.069493 Aug 10 22:59:01.235875 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 391/798] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 10 22:59:01 2022] GET /compute/v2.1/images/62f64dd0-73ef-4e90-b110-f212252849b4 => generated 1412 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:59:01.546659 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-40f35c54-ec79-4efb-a683-9c885361b41e tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632904331d024d9b8e4d3660dff2cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ed0bdee3aa4013bd9219069bda558c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:59:01.569126 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-40f35c54-ec79-4efb-a683-9c885361b41e tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] 10.222.0.58 "GET /compute/v2.1/servers/9b8271c8-f9d7-48fc-b8ad-a50e71d3cec5" status: 200 len: 1310 microversion: 2.1 time: 0.541510 Aug 10 22:59:01.571603 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 408/799] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:59:01 2022] GET /compute/v2.1/servers/9b8271c8-f9d7-48fc-b8ad-a50e71d3cec5 => generated 1310 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:59:02.257288 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-2f923aba-f853-4cee-9a10-2cb229e4868a tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Calling method '.version_select at 0x7f847d742550>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:02.360476 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-2f923aba-f853-4cee-9a10-2cb229e4868a tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] 10.222.0.58 "GET /compute/v2.1/images/62f64dd0-73ef-4e90-b110-f212252849b4" status: 200 len: 1412 microversion: 2.1 time: 0.111346 Aug 10 22:59:02.361647 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 392/800] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 10 22:59:02 2022] GET /compute/v2.1/images/62f64dd0-73ef-4e90-b110-f212252849b4 => generated 1412 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:59:02.592616 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-35946d1a-9141-469e-80ec-5798f6fef593 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:02.593230 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-35946d1a-9141-469e-80ec-5798f6fef593 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] [instance: 9b8271c8-f9d7-48fc-b8ad-a50e71d3cec5] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:02.608965 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-35946d1a-9141-469e-80ec-5798f6fef593 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:02.609542 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-35946d1a-9141-469e-80ec-5798f6fef593 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:02.609977 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-35946d1a-9141-469e-80ec-5798f6fef593 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:02.610698 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-35946d1a-9141-469e-80ec-5798f6fef593 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:02.611186 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-35946d1a-9141-469e-80ec-5798f6fef593 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:02.611622 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-35946d1a-9141-469e-80ec-5798f6fef593 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:02.723909 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-e7319dd6-be55-49c1-b335-76b90c734b80 tempest-HostsAdminTestJSON-296234779 tempest-HostsAdminTestJSON-296234779-project-admin] Calling method '.version_select at 0x7f847d647ee0>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:02.727574 n-d-850468-14 devstack@n-api.service[122633]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:59:02.727574 n-d-850468-14 devstack@n-api.service[122633]: warnings.warn(msg) Aug 10 22:59:02.730332 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e7319dd6-be55-49c1-b335-76b90c734b80 tempest-HostsAdminTestJSON-296234779 tempest-HostsAdminTestJSON-296234779-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:02.735074 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e7319dd6-be55-49c1-b335-76b90c734b80 tempest-HostsAdminTestJSON-296234779 tempest-HostsAdminTestJSON-296234779-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:02.737324 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e7319dd6-be55-49c1-b335-76b90c734b80 tempest-HostsAdminTestJSON-296234779 tempest-HostsAdminTestJSON-296234779-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:02.738836 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e7319dd6-be55-49c1-b335-76b90c734b80 tempest-HostsAdminTestJSON-296234779 tempest-HostsAdminTestJSON-296234779-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:02.739300 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e7319dd6-be55-49c1-b335-76b90c734b80 tempest-HostsAdminTestJSON-296234779 tempest-HostsAdminTestJSON-296234779-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:02.751146 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e7319dd6-be55-49c1-b335-76b90c734b80 tempest-HostsAdminTestJSON-296234779 tempest-HostsAdminTestJSON-296234779-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:02.794375 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=100 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:59:02.813260 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=3 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:59:02.858706 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-e7319dd6-be55-49c1-b335-76b90c734b80 tempest-HostsAdminTestJSON-296234779 tempest-HostsAdminTestJSON-296234779-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.406502 Aug 10 22:59:02.859981 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 409/801] 10.222.0.58 () {58 vars in 1128 bytes} [Wed Aug 10 22:59:02 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:59:02.876784 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-ddc8a550-82e0-4c9d-ada5-e8579de04054 tempest-HostsAdminTestJSON-296234779 tempest-HostsAdminTestJSON-296234779-project-admin] Calling method '.version_select at 0x7f847d647f70>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:02.880806 n-d-850468-14 devstack@n-api.service[122633]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:59:02.880806 n-d-850468-14 devstack@n-api.service[122633]: warnings.warn(msg) Aug 10 22:59:02.887591 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ddc8a550-82e0-4c9d-ada5-e8579de04054 tempest-HostsAdminTestJSON-296234779 tempest-HostsAdminTestJSON-296234779-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:02.888973 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ddc8a550-82e0-4c9d-ada5-e8579de04054 tempest-HostsAdminTestJSON-296234779 tempest-HostsAdminTestJSON-296234779-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:02.889974 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ddc8a550-82e0-4c9d-ada5-e8579de04054 tempest-HostsAdminTestJSON-296234779 tempest-HostsAdminTestJSON-296234779-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:02.891606 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ddc8a550-82e0-4c9d-ada5-e8579de04054 tempest-HostsAdminTestJSON-296234779 tempest-HostsAdminTestJSON-296234779-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:02.892355 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ddc8a550-82e0-4c9d-ada5-e8579de04054 tempest-HostsAdminTestJSON-296234779 tempest-HostsAdminTestJSON-296234779-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:02.893393 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ddc8a550-82e0-4c9d-ada5-e8579de04054 tempest-HostsAdminTestJSON-296234779 tempest-HostsAdminTestJSON-296234779-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:02.936561 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-ddc8a550-82e0-4c9d-ada5-e8579de04054 tempest-HostsAdminTestJSON-296234779 tempest-HostsAdminTestJSON-296234779-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 381 microversion: 2.1 time: 0.063891 Aug 10 22:59:02.938626 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 410/802] 10.222.0.58 () {58 vars in 1139 bytes} [Wed Aug 10 22:59:02 2022] GET /compute/v2.1/os-hosts?zone= => generated 381 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:59:02.950689 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-1c94d5f8-55fc-4f15-a1f0-b58cd4a89aa2 tempest-HostsAdminTestJSON-296234779 tempest-HostsAdminTestJSON-296234779-project-admin] Calling method '.version_select at 0x7f847d6cb670>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:02.953737 n-d-850468-14 devstack@n-api.service[122633]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:59:02.953737 n-d-850468-14 devstack@n-api.service[122633]: warnings.warn(msg) Aug 10 22:59:02.955360 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1c94d5f8-55fc-4f15-a1f0-b58cd4a89aa2 tempest-HostsAdminTestJSON-296234779 tempest-HostsAdminTestJSON-296234779-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:02.956186 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1c94d5f8-55fc-4f15-a1f0-b58cd4a89aa2 tempest-HostsAdminTestJSON-296234779 tempest-HostsAdminTestJSON-296234779-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:02.957086 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1c94d5f8-55fc-4f15-a1f0-b58cd4a89aa2 tempest-HostsAdminTestJSON-296234779 tempest-HostsAdminTestJSON-296234779-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:02.958522 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1c94d5f8-55fc-4f15-a1f0-b58cd4a89aa2 tempest-HostsAdminTestJSON-296234779 tempest-HostsAdminTestJSON-296234779-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:02.959282 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1c94d5f8-55fc-4f15-a1f0-b58cd4a89aa2 tempest-HostsAdminTestJSON-296234779 tempest-HostsAdminTestJSON-296234779-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:02.961245 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1c94d5f8-55fc-4f15-a1f0-b58cd4a89aa2 tempest-HostsAdminTestJSON-296234779 tempest-HostsAdminTestJSON-296234779-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:02.997643 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-1c94d5f8-55fc-4f15-a1f0-b58cd4a89aa2 tempest-HostsAdminTestJSON-296234779 tempest-HostsAdminTestJSON-296234779-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.051514 Aug 10 22:59:02.999045 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 411/803] 10.222.0.58 () {58 vars in 1145 bytes} [Wed Aug 10 22:59:02 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 22:59:03.023784 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-693502a2-9c3c-410a-975c-d27900558697 tempest-HostsAdminTestJSON-296234779 tempest-HostsAdminTestJSON-296234779-project-admin] Calling method '.version_select at 0x7f84801cef70>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:03.025531 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-35946d1a-9141-469e-80ec-5798f6fef593 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632904331d024d9b8e4d3660dff2cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ed0bdee3aa4013bd9219069bda558c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:59:03.026330 n-d-850468-14 devstack@n-api.service[122633]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:59:03.026330 n-d-850468-14 devstack@n-api.service[122633]: warnings.warn(msg) Aug 10 22:59:03.027532 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-693502a2-9c3c-410a-975c-d27900558697 tempest-HostsAdminTestJSON-296234779 tempest-HostsAdminTestJSON-296234779-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:03.028021 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-693502a2-9c3c-410a-975c-d27900558697 tempest-HostsAdminTestJSON-296234779 tempest-HostsAdminTestJSON-296234779-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:03.028461 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-693502a2-9c3c-410a-975c-d27900558697 tempest-HostsAdminTestJSON-296234779 tempest-HostsAdminTestJSON-296234779-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:03.029196 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-693502a2-9c3c-410a-975c-d27900558697 tempest-HostsAdminTestJSON-296234779 tempest-HostsAdminTestJSON-296234779-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:03.029648 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-693502a2-9c3c-410a-975c-d27900558697 tempest-HostsAdminTestJSON-296234779 tempest-HostsAdminTestJSON-296234779-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:03.030076 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-693502a2-9c3c-410a-975c-d27900558697 tempest-HostsAdminTestJSON-296234779 tempest-HostsAdminTestJSON-296234779-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:03.071343 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-35946d1a-9141-469e-80ec-5798f6fef593 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] 10.222.0.58 "GET /compute/v2.1/servers/9b8271c8-f9d7-48fc-b8ad-a50e71d3cec5" status: 200 len: 1310 microversion: 2.1 time: 0.481227 Aug 10 22:59:03.074066 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 393/804] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:59:02 2022] GET /compute/v2.1/servers/9b8271c8-f9d7-48fc-b8ad-a50e71d3cec5 => generated 1310 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:59:03.100200 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-693502a2-9c3c-410a-975c-d27900558697 tempest-HostsAdminTestJSON-296234779 tempest-HostsAdminTestJSON-296234779-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.089190 Aug 10 22:59:03.114188 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 412/805] 10.222.0.58 () {58 vars in 1128 bytes} [Wed Aug 10 22:59:03 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:59:03.129672 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-710a14fb-903f-46a8-ba50-30874e517367 tempest-HostsAdminTestJSON-296234779 tempest-HostsAdminTestJSON-296234779-project-admin] Calling method '.version_select at 0x7f847d649e50>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:03.140503 n-d-850468-14 devstack@n-api.service[122632]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:59:03.140503 n-d-850468-14 devstack@n-api.service[122632]: warnings.warn(msg) Aug 10 22:59:03.142362 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-710a14fb-903f-46a8-ba50-30874e517367 tempest-HostsAdminTestJSON-296234779 tempest-HostsAdminTestJSON-296234779-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:03.143051 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-710a14fb-903f-46a8-ba50-30874e517367 tempest-HostsAdminTestJSON-296234779 tempest-HostsAdminTestJSON-296234779-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:03.143649 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-710a14fb-903f-46a8-ba50-30874e517367 tempest-HostsAdminTestJSON-296234779 tempest-HostsAdminTestJSON-296234779-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:03.144641 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-710a14fb-903f-46a8-ba50-30874e517367 tempest-HostsAdminTestJSON-296234779 tempest-HostsAdminTestJSON-296234779-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:03.145262 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-710a14fb-903f-46a8-ba50-30874e517367 tempest-HostsAdminTestJSON-296234779 tempest-HostsAdminTestJSON-296234779-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:03.146040 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-710a14fb-903f-46a8-ba50-30874e517367 tempest-HostsAdminTestJSON-296234779 tempest-HostsAdminTestJSON-296234779-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:03.169559 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-73cd8135-5c94-4de0-ae00-b3738e372b59 tempest-MigrationsAdminTest-974767625 tempest-MigrationsAdminTest-974767625-project-admin] Calling method '.version_select at 0x7f847d647310>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:03.173411 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-73cd8135-5c94-4de0-ae00-b3738e372b59 tempest-MigrationsAdminTest-974767625 tempest-MigrationsAdminTest-974767625-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:03.174067 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-73cd8135-5c94-4de0-ae00-b3738e372b59 tempest-MigrationsAdminTest-974767625 tempest-MigrationsAdminTest-974767625-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:03.174664 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-73cd8135-5c94-4de0-ae00-b3738e372b59 tempest-MigrationsAdminTest-974767625 tempest-MigrationsAdminTest-974767625-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:03.199967 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-73cd8135-5c94-4de0-ae00-b3738e372b59 tempest-MigrationsAdminTest-974767625 tempest-MigrationsAdminTest-974767625-project-admin] 10.222.0.58 "GET /compute/v2.1/os-migrations" status: 200 len: 1974 microversion: 2.1 time: 0.034098 Aug 10 22:59:03.214276 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 413/806] 10.222.0.58 () {58 vars in 1143 bytes} [Wed Aug 10 22:59:03 2022] GET /compute/v2.1/os-migrations => generated 1974 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:59:03.218389 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-710a14fb-903f-46a8-ba50-30874e517367 tempest-HostsAdminTestJSON-296234779 tempest-HostsAdminTestJSON-296234779-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 239 microversion: 2.1 time: 0.092757 Aug 10 22:59:03.228271 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 394/807] 10.222.0.58 () {58 vars in 1155 bytes} [Wed Aug 10 22:59:03 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 239 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:59:03.231620 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-6994bffe-c645-49b8-87f2-77cfa8fc889e tempest-MigrationsAdminTest-974767625 tempest-MigrationsAdminTest-974767625-project-admin] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:03.238595 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-73ac9d5d-e011-425e-9536-ae137826135e tempest-HostsAdminTestJSON-296234779 tempest-HostsAdminTestJSON-296234779-project-admin] Calling method '.version_select at 0x7f847d6498b0>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:03.245468 n-d-850468-14 devstack@n-api.service[122632]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:59:03.245468 n-d-850468-14 devstack@n-api.service[122632]: warnings.warn(msg) Aug 10 22:59:03.247432 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-73ac9d5d-e011-425e-9536-ae137826135e tempest-HostsAdminTestJSON-296234779 tempest-HostsAdminTestJSON-296234779-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:03.248079 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-73ac9d5d-e011-425e-9536-ae137826135e tempest-HostsAdminTestJSON-296234779 tempest-HostsAdminTestJSON-296234779-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:03.248694 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-73ac9d5d-e011-425e-9536-ae137826135e tempest-HostsAdminTestJSON-296234779 tempest-HostsAdminTestJSON-296234779-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:03.249589 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-73ac9d5d-e011-425e-9536-ae137826135e tempest-HostsAdminTestJSON-296234779 tempest-HostsAdminTestJSON-296234779-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:03.250470 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-73ac9d5d-e011-425e-9536-ae137826135e tempest-HostsAdminTestJSON-296234779 tempest-HostsAdminTestJSON-296234779-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:03.251143 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-73ac9d5d-e011-425e-9536-ae137826135e tempest-HostsAdminTestJSON-296234779 tempest-HostsAdminTestJSON-296234779-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:03.251349 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-6994bffe-c645-49b8-87f2-77cfa8fc889e tempest-MigrationsAdminTest-974767625 tempest-MigrationsAdminTest-974767625-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.027838 Aug 10 22:59:03.254243 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 414/808] 10.222.0.58 () {58 vars in 1137 bytes} [Wed Aug 10 22:59:03 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:59:03.270441 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-0bd470cc-dcfb-4b47-958a-a5d615e4cae9 req-7c16a545-c44b-40af-a15b-74359b27c6ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b8271c8-f9d7-48fc-b8ad-a50e71d3cec5", "name": "network-vif-plugged", "status": "completed", "tag": "1fc37ded-1174-48fe-96fd-658af446018b"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:59:03.289998 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-73ac9d5d-e011-425e-9536-ae137826135e tempest-HostsAdminTestJSON-296234779 tempest-HostsAdminTestJSON-296234779-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.059597 Aug 10 22:59:03.294837 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 395/809] 10.222.0.58 () {58 vars in 1128 bytes} [Wed Aug 10 22:59:03 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:59:03.300791 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-35a05381-e841-416b-807e-717ca9e6852d tempest-MigrationsAdminTest-974767625 tempest-MigrationsAdminTest-974767625-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-2085130952", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:59:03.304502 n-d-850468-14 devstack@n-api.service[122632]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:59:03.304502 n-d-850468-14 devstack@n-api.service[122632]: warnings.warn(msg) Aug 10 22:59:03.323383 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-0bd470cc-dcfb-4b47-958a-a5d615e4cae9 req-7c16a545-c44b-40af-a15b-74359b27c6ac service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:03.323911 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-0bd470cc-dcfb-4b47-958a-a5d615e4cae9 req-7c16a545-c44b-40af-a15b-74359b27c6ac service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:03.324364 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-0bd470cc-dcfb-4b47-958a-a5d615e4cae9 req-7c16a545-c44b-40af-a15b-74359b27c6ac service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:03.332261 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-35a05381-e841-416b-807e-717ca9e6852d tempest-MigrationsAdminTest-974767625 tempest-MigrationsAdminTest-974767625-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 499 microversion: 2.1 time: 0.035525 Aug 10 22:59:03.352090 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-0bd470cc-dcfb-4b47-958a-a5d615e4cae9 req-7c16a545-c44b-40af-a15b-74359b27c6ac service nova] Creating event network-vif-plugged:1fc37ded-1174-48fe-96fd-658af446018b for instance 9b8271c8-f9d7-48fc-b8ad-a50e71d3cec5 on n-h2-850468-14 Aug 10 22:59:03.357100 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 396/810] 10.222.0.58 () {60 vars in 1146 bytes} [Wed Aug 10 22:59:03 2022] POST /compute/v2.1/flavors => generated 499 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:59:03.362389 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-be55a47f-a8fd-44df-8a3f-903d18b5393a tempest-HostsAdminTestJSON-296234779 tempest-HostsAdminTestJSON-296234779-project-admin] Calling method '.version_select at 0x7f847d59a550>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:03.364155 n-d-850468-14 devstack@n-api.service[122632]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:59:03.364155 n-d-850468-14 devstack@n-api.service[122632]: warnings.warn(msg) Aug 10 22:59:03.368383 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-0bd470cc-dcfb-4b47-958a-a5d615e4cae9 req-7c16a545-c44b-40af-a15b-74359b27c6ac service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112320 Aug 10 22:59:03.369037 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 415/811] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 22:59:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:59:03.373067 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-be55a47f-a8fd-44df-8a3f-903d18b5393a tempest-HostsAdminTestJSON-296234779 tempest-HostsAdminTestJSON-296234779-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:03.373777 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-be55a47f-a8fd-44df-8a3f-903d18b5393a tempest-HostsAdminTestJSON-296234779 tempest-HostsAdminTestJSON-296234779-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:03.374052 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-2f6c88c8-060e-4240-976a-e03003712ea2 tempest-MigrationsAdminTest-974767625 tempest-MigrationsAdminTest-974767625-project-admin] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:03.374556 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-be55a47f-a8fd-44df-8a3f-903d18b5393a tempest-HostsAdminTestJSON-296234779 tempest-HostsAdminTestJSON-296234779-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:03.394625 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-be55a47f-a8fd-44df-8a3f-903d18b5393a tempest-HostsAdminTestJSON-296234779 tempest-HostsAdminTestJSON-296234779-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:03.395573 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-be55a47f-a8fd-44df-8a3f-903d18b5393a tempest-HostsAdminTestJSON-296234779 tempest-HostsAdminTestJSON-296234779-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:03.396350 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-be55a47f-a8fd-44df-8a3f-903d18b5393a tempest-HostsAdminTestJSON-296234779 tempest-HostsAdminTestJSON-296234779-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:03.417786 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-2f6c88c8-060e-4240-976a-e03003712ea2 tempest-MigrationsAdminTest-974767625 tempest-MigrationsAdminTest-974767625-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.047512 Aug 10 22:59:03.418825 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 416/812] 10.222.0.58 () {58 vars in 1182 bytes} [Wed Aug 10 22:59:03 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 22:59:03.426369 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-2fde06e3-3de1-4d51-9265-8c65ab456134 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Calling method '.version_select at 0x7f847d5a0d30>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:03.503420 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-be55a47f-a8fd-44df-8a3f-903d18b5393a tempest-HostsAdminTestJSON-296234779 tempest-HostsAdminTestJSON-296234779-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hosts/n-h1-850468-14" status: 200 len: 867 microversion: 2.1 time: 0.144951 Aug 10 22:59:03.508272 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 397/813] 10.222.0.58 () {58 vars in 1173 bytes} [Wed Aug 10 22:59:03 2022] GET /compute/v2.1/os-hosts/n-h1-850468-14 => generated 867 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:59:03.549589 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-b274675c-8b82-46ae-9b6c-92f7473bab8d tempest-HostsAdminTestJSON-296234779 tempest-HostsAdminTestJSON-296234779-project-admin] Calling method '.version_select at 0x7f847d5ea700>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:03.552538 n-d-850468-14 devstack@n-api.service[122632]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:59:03.552538 n-d-850468-14 devstack@n-api.service[122632]: warnings.warn(msg) Aug 10 22:59:03.569471 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b274675c-8b82-46ae-9b6c-92f7473bab8d tempest-HostsAdminTestJSON-296234779 tempest-HostsAdminTestJSON-296234779-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:03.573637 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b274675c-8b82-46ae-9b6c-92f7473bab8d tempest-HostsAdminTestJSON-296234779 tempest-HostsAdminTestJSON-296234779-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:03.576594 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b274675c-8b82-46ae-9b6c-92f7473bab8d tempest-HostsAdminTestJSON-296234779 tempest-HostsAdminTestJSON-296234779-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:03.682210 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-2fde06e3-3de1-4d51-9265-8c65ab456134 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] 10.222.0.58 "GET /compute/v2.1/images/62f64dd0-73ef-4e90-b110-f212252849b4" status: 200 len: 1412 microversion: 2.1 time: 0.261555 Aug 10 22:59:03.685169 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b274675c-8b82-46ae-9b6c-92f7473bab8d tempest-HostsAdminTestJSON-296234779 tempest-HostsAdminTestJSON-296234779-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:03.689352 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 417/814] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 10 22:59:03 2022] GET /compute/v2.1/images/62f64dd0-73ef-4e90-b110-f212252849b4 => generated 1412 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:59:03.701549 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b274675c-8b82-46ae-9b6c-92f7473bab8d tempest-HostsAdminTestJSON-296234779 tempest-HostsAdminTestJSON-296234779-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:03.702824 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b274675c-8b82-46ae-9b6c-92f7473bab8d tempest-HostsAdminTestJSON-296234779 tempest-HostsAdminTestJSON-296234779-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:03.787837 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-b274675c-8b82-46ae-9b6c-92f7473bab8d tempest-HostsAdminTestJSON-296234779 tempest-HostsAdminTestJSON-296234779-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hosts/n-h2-850468-14" status: 200 len: 866 microversion: 2.1 time: 0.250880 Aug 10 22:59:03.788997 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 398/815] 10.222.0.58 () {58 vars in 1173 bytes} [Wed Aug 10 22:59:03 2022] GET /compute/v2.1/os-hosts/n-h2-850468-14 => generated 866 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:59:03.826421 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-b29598ac-0187-41f9-99ed-ff44810054bf tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1201723728", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "8f981c7e-cc2e-453c-8da0-478648af3419"}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:59:04.023081 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.network.neutron [None req-b29598ac-0187-41f9-99ed-ff44810054bf tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] validate_networks() for None {{(pid=122633) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 22:59:04.099640 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-5b3b2b1f-5e07-4d3e-85fc-7b69a18a2811 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:04.103942 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-5b3b2b1f-5e07-4d3e-85fc-7b69a18a2811 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] [instance: 9b8271c8-f9d7-48fc-b8ad-a50e71d3cec5] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:04.110676 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5b3b2b1f-5e07-4d3e-85fc-7b69a18a2811 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:04.111190 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5b3b2b1f-5e07-4d3e-85fc-7b69a18a2811 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:04.111620 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5b3b2b1f-5e07-4d3e-85fc-7b69a18a2811 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:04.112321 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5b3b2b1f-5e07-4d3e-85fc-7b69a18a2811 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:04.112798 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5b3b2b1f-5e07-4d3e-85fc-7b69a18a2811 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:04.113927 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5b3b2b1f-5e07-4d3e-85fc-7b69a18a2811 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:04.143274 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:59:04.289060 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-5b3b2b1f-5e07-4d3e-85fc-7b69a18a2811 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632904331d024d9b8e4d3660dff2cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ed0bdee3aa4013bd9219069bda558c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:59:04.304641 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-5b3b2b1f-5e07-4d3e-85fc-7b69a18a2811 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] 10.222.0.58 "GET /compute/v2.1/servers/9b8271c8-f9d7-48fc-b8ad-a50e71d3cec5" status: 200 len: 1310 microversion: 2.1 time: 0.212735 Aug 10 22:59:04.306682 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 399/816] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:59:04 2022] GET /compute/v2.1/servers/9b8271c8-f9d7-48fc-b8ad-a50e71d3cec5 => generated 1310 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:59:04.356360 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-b29598ac-0187-41f9-99ed-ff44810054bf tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Flavor limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 22:59:04.356777 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-b29598ac-0187-41f9-99ed-ff44810054bf tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Image limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 22:59:04.357243 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-b29598ac-0187-41f9-99ed-ff44810054bf tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Flavor pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 22:59:04.357645 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-b29598ac-0187-41f9-99ed-ff44810054bf tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Image pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 22:59:04.358073 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-b29598ac-0187-41f9-99ed-ff44810054bf tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 22:59:04.372413 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b29598ac-0187-41f9-99ed-ff44810054bf tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:04.372889 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b29598ac-0187-41f9-99ed-ff44810054bf tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:04.373477 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b29598ac-0187-41f9-99ed-ff44810054bf tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:04.374466 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b29598ac-0187-41f9-99ed-ff44810054bf tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:04.374943 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b29598ac-0187-41f9-99ed-ff44810054bf tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:04.376107 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b29598ac-0187-41f9-99ed-ff44810054bf tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:04.398837 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-b29598ac-0187-41f9-99ed-ff44810054bf tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Getting quotas for project f9582683a1cf4e92b3bd3f10db0b497b. Resources: {'instances', 'cores', 'ram'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 22:59:04.405224 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-b29598ac-0187-41f9-99ed-ff44810054bf tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Getting quotas for user 5c48fd7279544b1fae228500f5a1e46d and project f9582683a1cf4e92b3bd3f10db0b497b. Resources: {'instances', 'cores', 'ram'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 22:59:04.432509 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-b29598ac-0187-41f9-99ed-ff44810054bf tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Going to run 1 instances... {{(pid=122633) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 22:59:04.436901 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-b29598ac-0187-41f9-99ed-ff44810054bf tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 1464324b-6977-4faa-8b84-370603a77429] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78ad8905-f66f-4733-8be9-2b260f1fabed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122633) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 22:59:04.509991 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-b29598ac-0187-41f9-99ed-ff44810054bf tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.688548 Aug 10 22:59:04.511316 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 418/817] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 22:59:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 690 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 22:59:04.530333 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c21f643d-01af-4291-8dc2-e2905fb63bd0 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:04.531088 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-c21f643d-01af-4291-8dc2-e2905fb63bd0 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 1464324b-6977-4faa-8b84-370603a77429] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:04.605493 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-c21f643d-01af-4291-8dc2-e2905fb63bd0 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:59:04.619640 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-c21f643d-01af-4291-8dc2-e2905fb63bd0 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/1464324b-6977-4faa-8b84-370603a77429" status: 200 len: 1279 microversion: 2.1 time: 0.098584 Aug 10 22:59:04.623094 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 400/818] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:59:04 2022] GET /compute/v2.1/servers/1464324b-6977-4faa-8b84-370603a77429 => generated 1279 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:59:04.706200 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-4618d4d4-d3b3-4fcb-9612-a2f23ddd1cbe tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Calling method '.version_select at 0x7f847d4a7c10>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:04.786569 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-4618d4d4-d3b3-4fcb-9612-a2f23ddd1cbe tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] 10.222.0.58 "GET /compute/v2.1/images/62f64dd0-73ef-4e90-b110-f212252849b4" status: 200 len: 1412 microversion: 2.1 time: 0.084351 Aug 10 22:59:04.790871 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 419/819] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 10 22:59:04 2022] GET /compute/v2.1/images/62f64dd0-73ef-4e90-b110-f212252849b4 => generated 1412 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:59:04.818952 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c7f53400-5a26-49a6-8dd9-cbd8b397ad74 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "26cb5fdb-51db-4ea8-8a08-d24d1c6d424a"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:59:04.821514 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-c7f53400-5a26-49a6-8dd9-cbd8b397ad74 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] [instance: 7599a318-7a19-4f4a-bbb6-162f7a207060] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:04.829744 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c7f53400-5a26-49a6-8dd9-cbd8b397ad74 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:04.830418 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c7f53400-5a26-49a6-8dd9-cbd8b397ad74 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:04.831040 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c7f53400-5a26-49a6-8dd9-cbd8b397ad74 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:04.833049 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c7f53400-5a26-49a6-8dd9-cbd8b397ad74 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:04.833683 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c7f53400-5a26-49a6-8dd9-cbd8b397ad74 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:04.834417 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c7f53400-5a26-49a6-8dd9-cbd8b397ad74 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:05.328993 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-3dc2ad87-806a-4848-99b5-8fd3cdfb5109 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:05.329809 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-3dc2ad87-806a-4848-99b5-8fd3cdfb5109 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] [instance: 9b8271c8-f9d7-48fc-b8ad-a50e71d3cec5] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:05.357172 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3dc2ad87-806a-4848-99b5-8fd3cdfb5109 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:05.357967 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3dc2ad87-806a-4848-99b5-8fd3cdfb5109 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:05.358961 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3dc2ad87-806a-4848-99b5-8fd3cdfb5109 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:05.359889 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3dc2ad87-806a-4848-99b5-8fd3cdfb5109 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:05.360814 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3dc2ad87-806a-4848-99b5-8fd3cdfb5109 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:05.361475 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3dc2ad87-806a-4848-99b5-8fd3cdfb5109 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:05.400515 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-c7f53400-5a26-49a6-8dd9-cbd8b397ad74 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] 10.222.0.58 "POST /compute/v2.1/servers/7599a318-7a19-4f4a-bbb6-162f7a207060/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.585060 Aug 10 22:59:05.414619 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 401/820] 10.222.0.58 () {60 vars in 1323 bytes} [Wed Aug 10 22:59:04 2022] POST /compute/v2.1/servers/7599a318-7a19-4f4a-bbb6-162f7a207060/os-volume_attachments => generated 194 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:59:05.643645 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-f79e6e6d-636e-40ff-8a4c-382e71c88173 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:05.644931 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-f79e6e6d-636e-40ff-8a4c-382e71c88173 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 1464324b-6977-4faa-8b84-370603a77429] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:05.662734 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f79e6e6d-636e-40ff-8a4c-382e71c88173 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:05.664057 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f79e6e6d-636e-40ff-8a4c-382e71c88173 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:05.666157 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f79e6e6d-636e-40ff-8a4c-382e71c88173 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:05.670532 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f79e6e6d-636e-40ff-8a4c-382e71c88173 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:05.672779 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f79e6e6d-636e-40ff-8a4c-382e71c88173 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:05.673832 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f79e6e6d-636e-40ff-8a4c-382e71c88173 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:05.777386 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-f79e6e6d-636e-40ff-8a4c-382e71c88173 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:59:05.785741 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-3dc2ad87-806a-4848-99b5-8fd3cdfb5109 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632904331d024d9b8e4d3660dff2cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ed0bdee3aa4013bd9219069bda558c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:59:05.794055 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-f79e6e6d-636e-40ff-8a4c-382e71c88173 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/1464324b-6977-4faa-8b84-370603a77429" status: 200 len: 1275 microversion: 2.1 time: 0.155270 Aug 10 22:59:05.795280 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 402/821] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:59:05 2022] GET /compute/v2.1/servers/1464324b-6977-4faa-8b84-370603a77429 => generated 1275 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:59:05.795394 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-3dc2ad87-806a-4848-99b5-8fd3cdfb5109 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] 10.222.0.58 "GET /compute/v2.1/servers/9b8271c8-f9d7-48fc-b8ad-a50e71d3cec5" status: 200 len: 1493 microversion: 2.1 time: 0.471199 Aug 10 22:59:05.795877 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 420/822] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:59:05 2022] GET /compute/v2.1/servers/9b8271c8-f9d7-48fc-b8ad-a50e71d3cec5 => generated 1493 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:59:05.803570 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-b6428937-ac30-46a4-b242-4b50a8fbb5e3 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Calling method '.version_select at 0x7f847d649f70>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:05.827015 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-e4fd11f9-fcce-4660-9ee5-e886390cbc15 tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:05.829493 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-e4fd11f9-fcce-4660-9ee5-e886390cbc15 tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] [instance: 9b8271c8-f9d7-48fc-b8ad-a50e71d3cec5] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:05.845136 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e4fd11f9-fcce-4660-9ee5-e886390cbc15 tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:05.845794 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e4fd11f9-fcce-4660-9ee5-e886390cbc15 tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:05.846546 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e4fd11f9-fcce-4660-9ee5-e886390cbc15 tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:05.849918 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e4fd11f9-fcce-4660-9ee5-e886390cbc15 tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:05.850486 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e4fd11f9-fcce-4660-9ee5-e886390cbc15 tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:05.851033 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e4fd11f9-fcce-4660-9ee5-e886390cbc15 tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:06.063346 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-e4fd11f9-fcce-4660-9ee5-e886390cbc15 tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/9b8271c8-f9d7-48fc-b8ad-a50e71d3cec5" status: 200 len: 1646 microversion: 2.1 time: 0.240892 Aug 10 22:59:06.063932 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 421/823] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:59:05 2022] GET /compute/v2.1/servers/9b8271c8-f9d7-48fc-b8ad-a50e71d3cec5 => generated 1646 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:59:06.085126 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-17ddd3a0-a632-4a0f-8b4e-a6ee72c708b2 tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:06.086270 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-17ddd3a0-a632-4a0f-8b4e-a6ee72c708b2 tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] [instance: 9b8271c8-f9d7-48fc-b8ad-a50e71d3cec5] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:06.099561 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-17ddd3a0-a632-4a0f-8b4e-a6ee72c708b2 tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:06.100443 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-17ddd3a0-a632-4a0f-8b4e-a6ee72c708b2 tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:06.101040 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-17ddd3a0-a632-4a0f-8b4e-a6ee72c708b2 tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:06.104162 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-17ddd3a0-a632-4a0f-8b4e-a6ee72c708b2 tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:06.104933 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-17ddd3a0-a632-4a0f-8b4e-a6ee72c708b2 tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:06.105542 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-17ddd3a0-a632-4a0f-8b4e-a6ee72c708b2 tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:06.363548 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-17ddd3a0-a632-4a0f-8b4e-a6ee72c708b2 tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/9b8271c8-f9d7-48fc-b8ad-a50e71d3cec5" status: 200 len: 1646 microversion: 2.1 time: 0.281617 Aug 10 22:59:06.365648 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 422/824] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:59:06 2022] GET /compute/v2.1/servers/9b8271c8-f9d7-48fc-b8ad-a50e71d3cec5 => generated 1646 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:59:06.388874 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-5d223bca-e0df-4ff3-8815-85c32ee75e93 tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:06.399633 n-d-850468-14 devstack@n-api.service[122633]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:59:06.399633 n-d-850468-14 devstack@n-api.service[122633]: warnings.warn(msg) Aug 10 22:59:06.414483 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5d223bca-e0df-4ff3-8815-85c32ee75e93 tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:06.415173 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5d223bca-e0df-4ff3-8815-85c32ee75e93 tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:06.416522 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5d223bca-e0df-4ff3-8815-85c32ee75e93 tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:06.417811 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5d223bca-e0df-4ff3-8815-85c32ee75e93 tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:06.419826 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5d223bca-e0df-4ff3-8815-85c32ee75e93 tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:06.420895 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5d223bca-e0df-4ff3-8815-85c32ee75e93 tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:06.509752 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-5d223bca-e0df-4ff3-8815-85c32ee75e93 tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] 10.222.0.58 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.117121 Aug 10 22:59:06.514383 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 423/825] 10.222.0.58 () {58 vars in 1176 bytes} [Wed Aug 10 22:59:06 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:59:06.528081 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-a10a68af-1b6c-4a3f-8b24-1a8f12abca51 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Calling method '.version_select at 0x7f847d5b63a0>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:06.532202 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-b6428937-ac30-46a4-b242-4b50a8fbb5e3 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] 10.222.0.58 "GET /compute/v2.1/images/62f64dd0-73ef-4e90-b110-f212252849b4" status: 200 len: 1412 microversion: 2.1 time: 0.734627 Aug 10 22:59:06.539532 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 403/826] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 10 22:59:05 2022] GET /compute/v2.1/images/62f64dd0-73ef-4e90-b110-f212252849b4 => generated 1412 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:59:06.544927 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-dcc17a9a-064d-41cf-88a2-17eca8d6cee6 tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:59:06.545540 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-dcc17a9a-064d-41cf-88a2-17eca8d6cee6 tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] [instance: 9b8271c8-f9d7-48fc-b8ad-a50e71d3cec5] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:06.567725 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dcc17a9a-064d-41cf-88a2-17eca8d6cee6 tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:06.568236 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dcc17a9a-064d-41cf-88a2-17eca8d6cee6 tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:06.568686 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dcc17a9a-064d-41cf-88a2-17eca8d6cee6 tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:06.572850 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dcc17a9a-064d-41cf-88a2-17eca8d6cee6 tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:06.573889 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dcc17a9a-064d-41cf-88a2-17eca8d6cee6 tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:06.574340 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dcc17a9a-064d-41cf-88a2-17eca8d6cee6 tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:06.646866 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-a10a68af-1b6c-4a3f-8b24-1a8f12abca51 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] 10.222.0.58 "GET /compute/v2.1/images/d91b763b-361c-40e7-bd00-ef66ee78938a" status: 200 len: 661 microversion: 2.1 time: 0.131103 Aug 10 22:59:06.647436 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 424/827] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 10 22:59:06 2022] GET /compute/v2.1/images/d91b763b-361c-40e7-bd00-ef66ee78938a => generated 661 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:59:06.668269 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-7013e139-9529-4784-8544-0657ffbe0d89 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Calling method '.version_select at 0x7f847d663160>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:06.764890 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-7013e139-9529-4784-8544-0657ffbe0d89 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] 10.222.0.58 "GET /compute/v2.1/images/d91b763b-361c-40e7-bd00-ef66ee78938a" status: 200 len: 661 microversion: 2.1 time: 0.106452 Aug 10 22:59:06.774437 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 425/828] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 10 22:59:06 2022] GET /compute/v2.1/images/d91b763b-361c-40e7-bd00-ef66ee78938a => generated 661 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:59:06.784038 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-dcc17a9a-064d-41cf-88a2-17eca8d6cee6 tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/9b8271c8-f9d7-48fc-b8ad-a50e71d3cec5/action" status: 202 len: 0 microversion: 2.1 time: 0.246376 Aug 10 22:59:06.811945 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 404/829] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 22:59:06 2022] POST /compute/v2.1/servers/9b8271c8-f9d7-48fc-b8ad-a50e71d3cec5/action => generated 0 bytes in 277 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 22:59:06.816649 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-79eb2744-49a0-4758-ae41-63098b01e8aa tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:06.817547 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-79eb2744-49a0-4758-ae41-63098b01e8aa tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] [instance: 9b8271c8-f9d7-48fc-b8ad-a50e71d3cec5] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:06.829168 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-79eb2744-49a0-4758-ae41-63098b01e8aa tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:06.835532 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-79eb2744-49a0-4758-ae41-63098b01e8aa tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:06.837046 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-79eb2744-49a0-4758-ae41-63098b01e8aa tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:06.839834 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-79eb2744-49a0-4758-ae41-63098b01e8aa tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:06.840487 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-79eb2744-49a0-4758-ae41-63098b01e8aa tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:06.841650 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-ebd63d7e-c96c-4972-a626-379ed15d3d9f tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:06.842559 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-79eb2744-49a0-4758-ae41-63098b01e8aa tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:06.847001 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-ebd63d7e-c96c-4972-a626-379ed15d3d9f tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 1464324b-6977-4faa-8b84-370603a77429] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:06.889870 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ebd63d7e-c96c-4972-a626-379ed15d3d9f tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:06.891164 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ebd63d7e-c96c-4972-a626-379ed15d3d9f tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:06.896262 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ebd63d7e-c96c-4972-a626-379ed15d3d9f tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:06.901105 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ebd63d7e-c96c-4972-a626-379ed15d3d9f tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:06.906971 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ebd63d7e-c96c-4972-a626-379ed15d3d9f tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:06.912952 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ebd63d7e-c96c-4972-a626-379ed15d3d9f tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:07.091528 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-79eb2744-49a0-4758-ae41-63098b01e8aa tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/9b8271c8-f9d7-48fc-b8ad-a50e71d3cec5" status: 200 len: 1651 microversion: 2.1 time: 0.279820 Aug 10 22:59:07.092177 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 426/830] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:59:06 2022] GET /compute/v2.1/servers/9b8271c8-f9d7-48fc-b8ad-a50e71d3cec5 => generated 1651 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:59:07.093297 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-ebd63d7e-c96c-4972-a626-379ed15d3d9f tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:59:07.108068 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-ebd63d7e-c96c-4972-a626-379ed15d3d9f tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/1464324b-6977-4faa-8b84-370603a77429" status: 200 len: 1349 microversion: 2.1 time: 0.292460 Aug 10 22:59:07.122688 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 405/831] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:59:06 2022] GET /compute/v2.1/servers/1464324b-6977-4faa-8b84-370603a77429 => generated 1349 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:59:07.548355 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-6badba71-3799-42a1-87df-d9c05d73cdd4 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Calling method '.version_select at 0x7f847d4d6b80>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:07.620013 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-6badba71-3799-42a1-87df-d9c05d73cdd4 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] 10.222.0.58 "GET /compute/v2.1/images/62f64dd0-73ef-4e90-b110-f212252849b4" status: 200 len: 1412 microversion: 2.1 time: 0.076548 Aug 10 22:59:07.642683 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 427/832] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 10 22:59:07 2022] GET /compute/v2.1/images/62f64dd0-73ef-4e90-b110-f212252849b4 => generated 1412 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:59:08.113528 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-93f8745a-744c-4922-9a4a-2df5d10b8166 tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:08.114763 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-93f8745a-744c-4922-9a4a-2df5d10b8166 tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] [instance: 9b8271c8-f9d7-48fc-b8ad-a50e71d3cec5] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:08.126357 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-93f8745a-744c-4922-9a4a-2df5d10b8166 tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:08.130604 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-770ae8de-eab6-45b8-8113-cc3906b55097 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:08.131259 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-770ae8de-eab6-45b8-8113-cc3906b55097 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 1464324b-6977-4faa-8b84-370603a77429] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:08.133098 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-93f8745a-744c-4922-9a4a-2df5d10b8166 tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:08.133661 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-93f8745a-744c-4922-9a4a-2df5d10b8166 tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:08.140168 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-93f8745a-744c-4922-9a4a-2df5d10b8166 tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:08.143194 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-93f8745a-744c-4922-9a4a-2df5d10b8166 tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:08.143763 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-93f8745a-744c-4922-9a4a-2df5d10b8166 tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:08.153751 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-770ae8de-eab6-45b8-8113-cc3906b55097 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:08.157369 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-770ae8de-eab6-45b8-8113-cc3906b55097 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:08.157889 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-770ae8de-eab6-45b8-8113-cc3906b55097 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:08.158665 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-770ae8de-eab6-45b8-8113-cc3906b55097 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:08.159165 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-770ae8de-eab6-45b8-8113-cc3906b55097 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:08.159631 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-770ae8de-eab6-45b8-8113-cc3906b55097 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:08.575174 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-770ae8de-eab6-45b8-8113-cc3906b55097 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:59:08.590935 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-770ae8de-eab6-45b8-8113-cc3906b55097 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/1464324b-6977-4faa-8b84-370603a77429" status: 200 len: 1379 microversion: 2.1 time: 0.464606 Aug 10 22:59:08.592010 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 428/833] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:59:08 2022] GET /compute/v2.1/servers/1464324b-6977-4faa-8b84-370603a77429 => generated 1379 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:59:08.649773 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-d346197e-4d01-4be4-b3e6-f512bc129e2d tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Calling method '.version_select at 0x7f847d5a00d0>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:08.686145 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-93f8745a-744c-4922-9a4a-2df5d10b8166 tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/9b8271c8-f9d7-48fc-b8ad-a50e71d3cec5" status: 200 len: 1631 microversion: 2.1 time: 0.574456 Aug 10 22:59:08.687367 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 406/834] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:59:08 2022] GET /compute/v2.1/servers/9b8271c8-f9d7-48fc-b8ad-a50e71d3cec5 => generated 1631 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:59:08.712412 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-129b5453-c5d1-4bba-bde8-f9b0e5418c1c tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-850468-14", "block_migration": true, "disk_over_commit": false}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:59:08.715055 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-129b5453-c5d1-4bba-bde8-f9b0e5418c1c tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] [instance: 9b8271c8-f9d7-48fc-b8ad-a50e71d3cec5] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:08.718323 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=3 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:59:08.731172 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-129b5453-c5d1-4bba-bde8-f9b0e5418c1c tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:08.742265 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-129b5453-c5d1-4bba-bde8-f9b0e5418c1c tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:08.743257 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-129b5453-c5d1-4bba-bde8-f9b0e5418c1c tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:08.744186 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-129b5453-c5d1-4bba-bde8-f9b0e5418c1c tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:08.744842 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-129b5453-c5d1-4bba-bde8-f9b0e5418c1c tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:08.745426 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-129b5453-c5d1-4bba-bde8-f9b0e5418c1c tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:09.018093 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-d346197e-4d01-4be4-b3e6-f512bc129e2d tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] 10.222.0.58 "GET /compute/v2.1/images/62f64dd0-73ef-4e90-b110-f212252849b4" status: 200 len: 1412 microversion: 2.1 time: 0.381854 Aug 10 22:59:09.019062 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 429/835] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 10 22:59:08 2022] GET /compute/v2.1/images/62f64dd0-73ef-4e90-b110-f212252849b4 => generated 1412 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:59:09.025321 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-e3baea05-c379-4420-a474-2f350c81c403 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Calling method '.version_select at 0x7f847d5b6670>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:09.081048 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-e3baea05-c379-4420-a474-2f350c81c403 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] 10.222.0.58 "GET /compute/v2.1/images/4681311a-a245-4205-a962-7920b815371c" status: 200 len: 661 microversion: 2.1 time: 0.060544 Aug 10 22:59:09.082264 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 430/836] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 10 22:59:09 2022] GET /compute/v2.1/images/4681311a-a245-4205-a962-7920b815371c => generated 661 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:59:09.108218 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-eae42597-22e4-4363-ae2e-29c083cf3dfc tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Calling method '.version_select at 0x7f847d538af0>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:09.179156 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-eae42597-22e4-4363-ae2e-29c083cf3dfc tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] 10.222.0.58 "GET /compute/v2.1/images/4681311a-a245-4205-a962-7920b815371c" status: 200 len: 661 microversion: 2.1 time: 0.085334 Aug 10 22:59:09.193787 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 431/837] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 10 22:59:09 2022] GET /compute/v2.1/images/4681311a-a245-4205-a962-7920b815371c => generated 661 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:59:09.224100 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.objects.instance [None req-129b5453-c5d1-4bba-bde8-f9b0e5418c1c tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Lazy-loading 'flavor' on Instance uuid 9b8271c8-f9d7-48fc-b8ad-a50e71d3cec5 {{(pid=122632) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 22:59:09.323471 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-129b5453-c5d1-4bba-bde8-f9b0e5418c1c tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] [instance: 9b8271c8-f9d7-48fc-b8ad-a50e71d3cec5] Going to try to live migrate instance to n-h1-850468-14 {{(pid=122632) live_migrate /opt/stack/nova/nova/compute/api.py:5443}} Aug 10 22:59:09.616784 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-b32b81ce-ef05-4250-8efe-a29c58ec997e tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:09.617402 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-b32b81ce-ef05-4250-8efe-a29c58ec997e tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 1464324b-6977-4faa-8b84-370603a77429] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:09.634458 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b32b81ce-ef05-4250-8efe-a29c58ec997e tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:09.635783 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b32b81ce-ef05-4250-8efe-a29c58ec997e tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:09.640309 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b32b81ce-ef05-4250-8efe-a29c58ec997e tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:09.642265 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b32b81ce-ef05-4250-8efe-a29c58ec997e tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:09.643059 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b32b81ce-ef05-4250-8efe-a29c58ec997e tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:09.647189 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b32b81ce-ef05-4250-8efe-a29c58ec997e tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:10.088614 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-b32b81ce-ef05-4250-8efe-a29c58ec997e tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:59:10.103488 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-b32b81ce-ef05-4250-8efe-a29c58ec997e tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/1464324b-6977-4faa-8b84-370603a77429" status: 200 len: 1379 microversion: 2.1 time: 0.490051 Aug 10 22:59:10.106675 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 432/838] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:59:09 2022] GET /compute/v2.1/servers/1464324b-6977-4faa-8b84-370603a77429 => generated 1379 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:59:10.131700 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-09c8d4e6-119f-4769-b5fe-d24bc4206372 req-f570731f-15cb-4479-8761-dc2c4f1e6049 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1464324b-6977-4faa-8b84-370603a77429", "tag": "6a54d59d-b7dd-4033-89c5-dd089d9e9fb8"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:59:10.166958 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-09c8d4e6-119f-4769-b5fe-d24bc4206372 req-f570731f-15cb-4479-8761-dc2c4f1e6049 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:10.169251 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-09c8d4e6-119f-4769-b5fe-d24bc4206372 req-f570731f-15cb-4479-8761-dc2c4f1e6049 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:10.169990 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-09c8d4e6-119f-4769-b5fe-d24bc4206372 req-f570731f-15cb-4479-8761-dc2c4f1e6049 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:10.190742 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-09c8d4e6-119f-4769-b5fe-d24bc4206372 req-f570731f-15cb-4479-8761-dc2c4f1e6049 service nova] Creating event network-changed:6a54d59d-b7dd-4033-89c5-dd089d9e9fb8 for instance 1464324b-6977-4faa-8b84-370603a77429 on n-h1-850468-14 Aug 10 22:59:10.197759 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-09c8d4e6-119f-4769-b5fe-d24bc4206372 req-f570731f-15cb-4479-8761-dc2c4f1e6049 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089666 Aug 10 22:59:10.198537 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 433/839] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 22:59:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:59:10.204178 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-55a384c9-37c4-4f02-ab1b-163bf49a6851 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Calling method '.version_select at 0x7f847d4aa040>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:10.308327 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-55a384c9-37c4-4f02-ab1b-163bf49a6851 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] 10.222.0.58 "GET /compute/v2.1/images/62f64dd0-73ef-4e90-b110-f212252849b4" status: 200 len: 1412 microversion: 2.1 time: 0.107451 Aug 10 22:59:10.316655 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 434/840] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 10 22:59:10 2022] GET /compute/v2.1/images/62f64dd0-73ef-4e90-b110-f212252849b4 => generated 1412 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:59:11.133983 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-b23b81d6-7d58-40ff-80df-ce51708c8d65 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:11.137834 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-b23b81d6-7d58-40ff-80df-ce51708c8d65 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 1464324b-6977-4faa-8b84-370603a77429] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:11.181261 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b23b81d6-7d58-40ff-80df-ce51708c8d65 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:11.186922 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b23b81d6-7d58-40ff-80df-ce51708c8d65 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:11.188891 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b23b81d6-7d58-40ff-80df-ce51708c8d65 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:11.192850 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b23b81d6-7d58-40ff-80df-ce51708c8d65 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:11.195905 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b23b81d6-7d58-40ff-80df-ce51708c8d65 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:11.197108 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b23b81d6-7d58-40ff-80df-ce51708c8d65 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:11.504670 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-b23b81d6-7d58-40ff-80df-ce51708c8d65 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:59:11.513353 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-b23b81d6-7d58-40ff-80df-ce51708c8d65 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/1464324b-6977-4faa-8b84-370603a77429" status: 200 len: 1379 microversion: 2.1 time: 0.390291 Aug 10 22:59:11.513944 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 435/841] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:59:11 2022] GET /compute/v2.1/servers/1464324b-6977-4faa-8b84-370603a77429 => generated 1379 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:59:11.543462 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-02a4bd4c-ba3f-4a12-83eb-5014509ca077 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Calling method '.version_select at 0x7f847d4aa550>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:11.632427 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-02a4bd4c-ba3f-4a12-83eb-5014509ca077 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] 10.222.0.58 "GET /compute/v2.1/images/cff0a8aa-9950-478f-bb9a-280d71f0899a" status: 200 len: 661 microversion: 2.1 time: 0.117252 Aug 10 22:59:11.633657 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 436/842] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 10 22:59:11 2022] GET /compute/v2.1/images/cff0a8aa-9950-478f-bb9a-280d71f0899a => generated 661 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:59:11.639509 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-9e7ffa27-7537-485d-9fac-8a555a4c8274 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Calling method '.version_select at 0x7f847d4aa820>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:11.768545 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-9e7ffa27-7537-485d-9fac-8a555a4c8274 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] 10.222.0.58 "GET /compute/v2.1/images/62f64dd0-73ef-4e90-b110-f212252849b4" status: 200 len: 1412 microversion: 2.1 time: 0.129702 Aug 10 22:59:11.774721 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 437/843] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 10 22:59:11 2022] GET /compute/v2.1/images/62f64dd0-73ef-4e90-b110-f212252849b4 => generated 1412 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:59:11.789425 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-d4f22f10-0ec7-4dda-af32-ac786cb04a28 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Calling method '.version_select at 0x7f847d4c4550>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:11.889787 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-d4f22f10-0ec7-4dda-af32-ac786cb04a28 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] 10.222.0.58 "GET /compute/v2.1/images/cff0a8aa-9950-478f-bb9a-280d71f0899a" status: 200 len: 661 microversion: 2.1 time: 0.113705 Aug 10 22:59:11.890866 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 438/844] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 10 22:59:11 2022] GET /compute/v2.1/images/cff0a8aa-9950-478f-bb9a-280d71f0899a => generated 661 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:59:12.088462 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-05c8f8b2-18d4-4168-adc2-e3c6e441e035 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1823779206", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452"}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:59:12.191840 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.network.neutron [None req-05c8f8b2-18d4-4168-adc2-e3c6e441e035 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] validate_networks() for None {{(pid=122633) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 22:59:12.560161 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-05c8f8b2-18d4-4168-adc2-e3c6e441e035 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Flavor limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 22:59:12.560840 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-05c8f8b2-18d4-4168-adc2-e3c6e441e035 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Image limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 22:59:12.561306 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-05c8f8b2-18d4-4168-adc2-e3c6e441e035 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Flavor pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 22:59:12.561705 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-05c8f8b2-18d4-4168-adc2-e3c6e441e035 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Image pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 22:59:12.562107 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-05c8f8b2-18d4-4168-adc2-e3c6e441e035 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 22:59:12.577141 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-05c8f8b2-18d4-4168-adc2-e3c6e441e035 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:12.578889 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-05c8f8b2-18d4-4168-adc2-e3c6e441e035 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:12.579335 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-05c8f8b2-18d4-4168-adc2-e3c6e441e035 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:12.582365 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-05c8f8b2-18d4-4168-adc2-e3c6e441e035 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:12.582841 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-05c8f8b2-18d4-4168-adc2-e3c6e441e035 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:12.583453 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-05c8f8b2-18d4-4168-adc2-e3c6e441e035 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:12.604063 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-05c8f8b2-18d4-4168-adc2-e3c6e441e035 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Getting quotas for project 25090b10522b4936b3117dc25dd6f609. Resources: {'instances', 'cores', 'ram'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 22:59:12.610317 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-05c8f8b2-18d4-4168-adc2-e3c6e441e035 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Getting quotas for user e86e6a62c56248d6a7887be0ec712f95 and project 25090b10522b4936b3117dc25dd6f609. Resources: {'instances', 'cores', 'ram'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 22:59:12.625269 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-05c8f8b2-18d4-4168-adc2-e3c6e441e035 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Going to run 1 instances... {{(pid=122633) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 22:59:12.629944 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-05c8f8b2-18d4-4168-adc2-e3c6e441e035 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] [instance: d716cac6-ac7c-4b98-b6ea-2496ccd62096] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78ad8905-f66f-4733-8be9-2b260f1fabed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122633) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 22:59:12.694769 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-05c8f8b2-18d4-4168-adc2-e3c6e441e035 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.610263 Aug 10 22:59:12.695653 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 439/845] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 22:59:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 612 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 22:59:12.701213 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-2aa5ea1c-3f64-4285-9b69-761dbd385270 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:12.703816 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-2aa5ea1c-3f64-4285-9b69-761dbd385270 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 1464324b-6977-4faa-8b84-370603a77429] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:12.712132 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2aa5ea1c-3f64-4285-9b69-761dbd385270 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:12.712827 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2aa5ea1c-3f64-4285-9b69-761dbd385270 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:12.713410 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2aa5ea1c-3f64-4285-9b69-761dbd385270 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:12.714260 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2aa5ea1c-3f64-4285-9b69-761dbd385270 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:12.715051 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2aa5ea1c-3f64-4285-9b69-761dbd385270 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:12.715620 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2aa5ea1c-3f64-4285-9b69-761dbd385270 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:13.018419 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-129b5453-c5d1-4bba-bde8-f9b0e5418c1c tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/9b8271c8-f9d7-48fc-b8ad-a50e71d3cec5/action" status: 202 len: 0 microversion: 2.1 time: 4.309870 Aug 10 22:59:13.019775 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 407/846] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 22:59:08 2022] POST /compute/v2.1/servers/9b8271c8-f9d7-48fc-b8ad-a50e71d3cec5/action => generated 0 bytes in 4311 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 22:59:13.026370 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-8735a686-0d11-4556-a24f-2bcce71e845c tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-739948664", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:59:13.096371 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-2aa5ea1c-3f64-4285-9b69-761dbd385270 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:59:13.110907 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-2aa5ea1c-3f64-4285-9b69-761dbd385270 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/1464324b-6977-4faa-8b84-370603a77429" status: 200 len: 1379 microversion: 2.1 time: 0.413376 Aug 10 22:59:13.111527 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 440/847] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:59:12 2022] GET /compute/v2.1/servers/1464324b-6977-4faa-8b84-370603a77429 => generated 1379 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:59:13.141063 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-bb5b50be-c0aa-451a-8b20-812109e34ae9 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Calling method '.version_select at 0x7f847d4d6ee0>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:13.153441 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.network.neutron [None req-8735a686-0d11-4556-a24f-2bcce71e845c tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] validate_networks() for None {{(pid=122632) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 22:59:13.230994 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-bb5b50be-c0aa-451a-8b20-812109e34ae9 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] 10.222.0.58 "GET /compute/v2.1/images/62f64dd0-73ef-4e90-b110-f212252849b4" status: 200 len: 1421 microversion: 2.1 time: 0.100648 Aug 10 22:59:13.232505 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 441/848] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 10 22:59:13 2022] GET /compute/v2.1/images/62f64dd0-73ef-4e90-b110-f212252849b4 => generated 1421 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:59:13.237319 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-eb0114f8-f6e7-434e-8adb-258c336a1a0e tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:13.239062 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-eb0114f8-f6e7-434e-8adb-258c336a1a0e tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] [instance: 9b8271c8-f9d7-48fc-b8ad-a50e71d3cec5] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:13.245886 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-eb0114f8-f6e7-434e-8adb-258c336a1a0e tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:13.246735 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-eb0114f8-f6e7-434e-8adb-258c336a1a0e tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:13.247456 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-eb0114f8-f6e7-434e-8adb-258c336a1a0e tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:13.248393 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-eb0114f8-f6e7-434e-8adb-258c336a1a0e tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:13.249062 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-eb0114f8-f6e7-434e-8adb-258c336a1a0e tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:13.249694 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-eb0114f8-f6e7-434e-8adb-258c336a1a0e tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:13.266431 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=4 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:59:13.643205 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-eb0114f8-f6e7-434e-8adb-258c336a1a0e tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632904331d024d9b8e4d3660dff2cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ed0bdee3aa4013bd9219069bda558c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:59:13.652088 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-eb0114f8-f6e7-434e-8adb-258c336a1a0e tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] 10.222.0.58 "GET /compute/v2.1/servers/9b8271c8-f9d7-48fc-b8ad-a50e71d3cec5" status: 200 len: 1503 microversion: 2.1 time: 0.418343 Aug 10 22:59:13.656973 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 442/849] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:59:13 2022] GET /compute/v2.1/servers/9b8271c8-f9d7-48fc-b8ad-a50e71d3cec5 => generated 1503 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:59:13.670662 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-df586516-4829-4d1c-9392-a0dedb238f52 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Calling method '.version_select at 0x7f847d73e280>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:13.780700 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-df586516-4829-4d1c-9392-a0dedb238f52 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] 10.222.0.58 "GET /compute/v2.1/images/62f64dd0-73ef-4e90-b110-f212252849b4" status: 200 len: 1421 microversion: 2.1 time: 0.122381 Aug 10 22:59:13.781987 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 443/850] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 10 22:59:13 2022] GET /compute/v2.1/images/62f64dd0-73ef-4e90-b110-f212252849b4 => generated 1421 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:59:13.799783 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c47e337b-ac1c-4bc4-a082-da022afe57c8 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Calling method '.version_select at 0x7f847d4aa0d0>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:13.919829 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-8735a686-0d11-4556-a24f-2bcce71e845c tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Flavor limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 22:59:13.920254 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-8735a686-0d11-4556-a24f-2bcce71e845c tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Image limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 22:59:13.920778 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-8735a686-0d11-4556-a24f-2bcce71e845c tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Flavor pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 22:59:13.921816 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-8735a686-0d11-4556-a24f-2bcce71e845c tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Image pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 22:59:13.922248 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-8735a686-0d11-4556-a24f-2bcce71e845c tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 22:59:13.939205 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8735a686-0d11-4556-a24f-2bcce71e845c tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:13.942917 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8735a686-0d11-4556-a24f-2bcce71e845c tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:13.943749 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8735a686-0d11-4556-a24f-2bcce71e845c tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:13.946311 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8735a686-0d11-4556-a24f-2bcce71e845c tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:13.949531 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8735a686-0d11-4556-a24f-2bcce71e845c tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:13.950856 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8735a686-0d11-4556-a24f-2bcce71e845c tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:14.009278 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-8735a686-0d11-4556-a24f-2bcce71e845c tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Getting quotas for project 25090b10522b4936b3117dc25dd6f609. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 22:59:14.021265 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-8735a686-0d11-4556-a24f-2bcce71e845c tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Getting quotas for user e86e6a62c56248d6a7887be0ec712f95 and project 25090b10522b4936b3117dc25dd6f609. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 22:59:14.054601 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-8735a686-0d11-4556-a24f-2bcce71e845c tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Going to run 1 instances... {{(pid=122632) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 22:59:14.057304 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-8735a686-0d11-4556-a24f-2bcce71e845c tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] [instance: e1deb45a-4597-4456-a1bd-54013c9484a4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78ad8905-f66f-4733-8be9-2b260f1fabed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122632) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 22:59:14.177728 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-8735a686-0d11-4556-a24f-2bcce71e845c tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.156441 Aug 10 22:59:14.187310 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 408/851] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 22:59:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 1161 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 22:59:14.193249 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-baa9b85a-fab2-4499-bf02-8557f0e53792 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:14.193880 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-baa9b85a-fab2-4499-bf02-8557f0e53792 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 1464324b-6977-4faa-8b84-370603a77429] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:14.212882 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-baa9b85a-fab2-4499-bf02-8557f0e53792 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:14.213398 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-baa9b85a-fab2-4499-bf02-8557f0e53792 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:14.213850 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-baa9b85a-fab2-4499-bf02-8557f0e53792 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:14.214573 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-baa9b85a-fab2-4499-bf02-8557f0e53792 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:14.217362 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-baa9b85a-fab2-4499-bf02-8557f0e53792 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:14.217833 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-baa9b85a-fab2-4499-bf02-8557f0e53792 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:14.798222 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-baa9b85a-fab2-4499-bf02-8557f0e53792 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:59:14.804520 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-c47e337b-ac1c-4bc4-a082-da022afe57c8 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] 10.222.0.58 "DELETE /compute/v2.1/images/62f64dd0-73ef-4e90-b110-f212252849b4" status: 204 len: 0 microversion: 2.1 time: 1.008239 Aug 10 22:59:14.806605 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 444/852] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:59:13 2022] DELETE /compute/v2.1/images/62f64dd0-73ef-4e90-b110-f212252849b4 => generated 0 bytes in 1011 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 22:59:14.816707 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-2c9b705d-3c1e-4d5d-b11d-50139e77b982 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:14.822041 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-2c9b705d-3c1e-4d5d-b11d-50139e77b982 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] [instance: e1deb45a-4597-4456-a1bd-54013c9484a4] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:14.829118 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-baa9b85a-fab2-4499-bf02-8557f0e53792 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/1464324b-6977-4faa-8b84-370603a77429" status: 200 len: 1379 microversion: 2.1 time: 0.644390 Aug 10 22:59:14.837813 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 409/853] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:59:14 2022] GET /compute/v2.1/servers/1464324b-6977-4faa-8b84-370603a77429 => generated 1379 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:59:14.857625 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-b9d779d5-71b5-45c3-b2b5-0d1de60636a5 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:14.865868 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-b9d779d5-71b5-45c3-b2b5-0d1de60636a5 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] [instance: 9b8271c8-f9d7-48fc-b8ad-a50e71d3cec5] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:14.885253 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b9d779d5-71b5-45c3-b2b5-0d1de60636a5 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:14.886660 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b9d779d5-71b5-45c3-b2b5-0d1de60636a5 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:14.891319 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b9d779d5-71b5-45c3-b2b5-0d1de60636a5 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:14.892288 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b9d779d5-71b5-45c3-b2b5-0d1de60636a5 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:14.893373 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b9d779d5-71b5-45c3-b2b5-0d1de60636a5 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:14.896128 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b9d779d5-71b5-45c3-b2b5-0d1de60636a5 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:15.000169 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-2c9b705d-3c1e-4d5d-b11d-50139e77b982 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e86e6a62c56248d6a7887be0ec712f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25090b10522b4936b3117dc25dd6f609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:59:15.012876 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-2c9b705d-3c1e-4d5d-b11d-50139e77b982 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] 10.222.0.58 "GET /compute/v2.1/servers/e1deb45a-4597-4456-a1bd-54013c9484a4" status: 200 len: 1217 microversion: 2.1 time: 0.204300 Aug 10 22:59:15.015415 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 445/854] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:59:14 2022] GET /compute/v2.1/servers/e1deb45a-4597-4456-a1bd-54013c9484a4 => generated 1217 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:59:15.032928 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-2048b395-87bb-4450-a825-d10f86090f53 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:15.036529 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-2048b395-87bb-4450-a825-d10f86090f53 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] [instance: ce82674f-e3eb-4e97-acd3-b4da01015330] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:15.056823 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2048b395-87bb-4450-a825-d10f86090f53 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:15.057508 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2048b395-87bb-4450-a825-d10f86090f53 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:15.058132 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2048b395-87bb-4450-a825-d10f86090f53 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:15.060337 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2048b395-87bb-4450-a825-d10f86090f53 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:15.061218 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2048b395-87bb-4450-a825-d10f86090f53 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:15.064398 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2048b395-87bb-4450-a825-d10f86090f53 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:15.136806 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-2048b395-87bb-4450-a825-d10f86090f53 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] [instance: ce82674f-e3eb-4e97-acd3-b4da01015330] Going to try to terminate instance {{(pid=122633) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 22:59:15.321180 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-b9d779d5-71b5-45c3-b2b5-0d1de60636a5 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632904331d024d9b8e4d3660dff2cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ed0bdee3aa4013bd9219069bda558c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:59:15.340038 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-b9d779d5-71b5-45c3-b2b5-0d1de60636a5 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] 10.222.0.58 "GET /compute/v2.1/servers/9b8271c8-f9d7-48fc-b8ad-a50e71d3cec5" status: 200 len: 1503 microversion: 2.1 time: 0.500823 Aug 10 22:59:15.342031 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 410/855] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:59:14 2022] GET /compute/v2.1/servers/9b8271c8-f9d7-48fc-b8ad-a50e71d3cec5 => generated 1503 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:59:15.357709 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-2048b395-87bb-4450-a825-d10f86090f53 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] 10.222.0.58 "DELETE /compute/v2.1/servers/ce82674f-e3eb-4e97-acd3-b4da01015330" status: 204 len: 0 microversion: 2.1 time: 0.340167 Aug 10 22:59:15.358642 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 446/856] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 22:59:15 2022] DELETE /compute/v2.1/servers/ce82674f-e3eb-4e97-acd3-b4da01015330 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 22:59:15.439771 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-60b81856-df73-4b6e-8fc6-113294a62887 req-2da42430-deea-4752-99b3-ed2aa5f8e78b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce82674f-e3eb-4e97-acd3-b4da01015330", "name": "network-vif-unplugged", "status": "completed", "tag": "a612824c-2998-441d-ad59-b655d3918bdf"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:59:15.483384 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-60b81856-df73-4b6e-8fc6-113294a62887 req-2da42430-deea-4752-99b3-ed2aa5f8e78b service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:15.483988 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-60b81856-df73-4b6e-8fc6-113294a62887 req-2da42430-deea-4752-99b3-ed2aa5f8e78b service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:15.484881 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-60b81856-df73-4b6e-8fc6-113294a62887 req-2da42430-deea-4752-99b3-ed2aa5f8e78b service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:15.528701 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-60b81856-df73-4b6e-8fc6-113294a62887 req-2da42430-deea-4752-99b3-ed2aa5f8e78b service nova] Creating event network-vif-unplugged:a612824c-2998-441d-ad59-b655d3918bdf for instance ce82674f-e3eb-4e97-acd3-b4da01015330 on n-h2-850468-14 Aug 10 22:59:15.554759 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-60b81856-df73-4b6e-8fc6-113294a62887 req-2da42430-deea-4752-99b3-ed2aa5f8e78b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.116656 Aug 10 22:59:15.558301 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 411/857] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 22:59:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:59:15.669512 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-ec11b414-40f8-45e0-ad29-1c01a54a18b3 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1901981125", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452", "networks": [{"uuid": "b7470d0a-cf37-4051-8236-4c65a5fc36b5"}]}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:59:15.788828 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.network.neutron [None req-ec11b414-40f8-45e0-ad29-1c01a54a18b3 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] validate_networks() for [('b7470d0a-cf37-4051-8236-4c65a5fc36b5', None, None, None, None, None)] {{(pid=122633) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 22:59:15.851378 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-99aebf49-ac53-45d5-b0ab-3aa38509713a req-544c4de9-2a89-41b0-b371-4a034e7ebb87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b8271c8-f9d7-48fc-b8ad-a50e71d3cec5", "name": "network-vif-unplugged", "status": "completed", "tag": "1fc37ded-1174-48fe-96fd-658af446018b"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:59:15.872558 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-99aebf49-ac53-45d5-b0ab-3aa38509713a req-544c4de9-2a89-41b0-b371-4a034e7ebb87 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:15.873331 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-99aebf49-ac53-45d5-b0ab-3aa38509713a req-544c4de9-2a89-41b0-b371-4a034e7ebb87 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:15.874028 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-99aebf49-ac53-45d5-b0ab-3aa38509713a req-544c4de9-2a89-41b0-b371-4a034e7ebb87 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:15.898561 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-99aebf49-ac53-45d5-b0ab-3aa38509713a req-544c4de9-2a89-41b0-b371-4a034e7ebb87 service nova] Creating event network-vif-unplugged:1fc37ded-1174-48fe-96fd-658af446018b for instance 9b8271c8-f9d7-48fc-b8ad-a50e71d3cec5 on n-h2-850468-14 Aug 10 22:59:15.905667 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-99aebf49-ac53-45d5-b0ab-3aa38509713a req-544c4de9-2a89-41b0-b371-4a034e7ebb87 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.059297 Aug 10 22:59:15.906837 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 412/858] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 22:59:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:59:15.914077 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-893140cd-8858-43a3-8007-b985e5a22bfa tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:15.915434 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-893140cd-8858-43a3-8007-b985e5a22bfa tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 1464324b-6977-4faa-8b84-370603a77429] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:15.924333 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-893140cd-8858-43a3-8007-b985e5a22bfa tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:15.925037 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-893140cd-8858-43a3-8007-b985e5a22bfa tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:15.926143 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-893140cd-8858-43a3-8007-b985e5a22bfa tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:15.927052 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-893140cd-8858-43a3-8007-b985e5a22bfa tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:15.927694 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-893140cd-8858-43a3-8007-b985e5a22bfa tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:15.928268 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-893140cd-8858-43a3-8007-b985e5a22bfa tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:16.297209 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-893140cd-8858-43a3-8007-b985e5a22bfa tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:59:16.313654 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-893140cd-8858-43a3-8007-b985e5a22bfa tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/1464324b-6977-4faa-8b84-370603a77429" status: 200 len: 1379 microversion: 2.1 time: 0.403961 Aug 10 22:59:16.314944 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 413/859] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:59:15 2022] GET /compute/v2.1/servers/1464324b-6977-4faa-8b84-370603a77429 => generated 1379 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:59:16.333970 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-45dfe33c-5b42-4e73-b2d8-8f0e6454fde9 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:16.339999 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-45dfe33c-5b42-4e73-b2d8-8f0e6454fde9 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] [instance: e1deb45a-4597-4456-a1bd-54013c9484a4] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:16.349170 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-45dfe33c-5b42-4e73-b2d8-8f0e6454fde9 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:16.350086 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-45dfe33c-5b42-4e73-b2d8-8f0e6454fde9 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:16.350830 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-45dfe33c-5b42-4e73-b2d8-8f0e6454fde9 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:16.352079 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-45dfe33c-5b42-4e73-b2d8-8f0e6454fde9 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:16.352955 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-45dfe33c-5b42-4e73-b2d8-8f0e6454fde9 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:16.353611 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-45dfe33c-5b42-4e73-b2d8-8f0e6454fde9 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:16.492530 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-45dfe33c-5b42-4e73-b2d8-8f0e6454fde9 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e86e6a62c56248d6a7887be0ec712f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25090b10522b4936b3117dc25dd6f609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:59:16.502698 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-45dfe33c-5b42-4e73-b2d8-8f0e6454fde9 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] 10.222.0.58 "GET /compute/v2.1/servers/e1deb45a-4597-4456-a1bd-54013c9484a4" status: 200 len: 1275 microversion: 2.1 time: 0.184485 Aug 10 22:59:16.503987 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 414/860] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:59:16 2022] GET /compute/v2.1/servers/e1deb45a-4597-4456-a1bd-54013c9484a4 => generated 1275 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:59:16.530760 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-bbc3675b-7cbe-4962-b307-b524ad25254e tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:16.531541 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-bbc3675b-7cbe-4962-b307-b524ad25254e tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] [instance: 9b8271c8-f9d7-48fc-b8ad-a50e71d3cec5] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:16.541454 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bbc3675b-7cbe-4962-b307-b524ad25254e tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:16.542202 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bbc3675b-7cbe-4962-b307-b524ad25254e tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:16.543119 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bbc3675b-7cbe-4962-b307-b524ad25254e tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:16.543992 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bbc3675b-7cbe-4962-b307-b524ad25254e tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:16.544868 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bbc3675b-7cbe-4962-b307-b524ad25254e tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:16.546064 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bbc3675b-7cbe-4962-b307-b524ad25254e tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:16.886843 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-ec11b414-40f8-45e0-ad29-1c01a54a18b3 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Flavor limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 22:59:16.887854 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-ec11b414-40f8-45e0-ad29-1c01a54a18b3 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Image limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 22:59:16.888475 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-ec11b414-40f8-45e0-ad29-1c01a54a18b3 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Flavor pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 22:59:16.889031 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-ec11b414-40f8-45e0-ad29-1c01a54a18b3 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Image pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 22:59:16.889578 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-ec11b414-40f8-45e0-ad29-1c01a54a18b3 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 22:59:16.911325 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ec11b414-40f8-45e0-ad29-1c01a54a18b3 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:16.914567 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-bbc3675b-7cbe-4962-b307-b524ad25254e tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632904331d024d9b8e4d3660dff2cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ed0bdee3aa4013bd9219069bda558c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:59:16.914747 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ec11b414-40f8-45e0-ad29-1c01a54a18b3 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:16.916382 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ec11b414-40f8-45e0-ad29-1c01a54a18b3 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:16.918740 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ec11b414-40f8-45e0-ad29-1c01a54a18b3 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:16.919613 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ec11b414-40f8-45e0-ad29-1c01a54a18b3 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:16.920211 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ec11b414-40f8-45e0-ad29-1c01a54a18b3 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:16.923836 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:59:16.940496 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-bbc3675b-7cbe-4962-b307-b524ad25254e tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] 10.222.0.58 "GET /compute/v2.1/servers/9b8271c8-f9d7-48fc-b8ad-a50e71d3cec5" status: 200 len: 1503 microversion: 2.1 time: 0.435176 Aug 10 22:59:16.944285 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 415/861] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:59:16 2022] GET /compute/v2.1/servers/9b8271c8-f9d7-48fc-b8ad-a50e71d3cec5 => generated 1503 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:59:16.991318 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-ec11b414-40f8-45e0-ad29-1c01a54a18b3 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Getting quotas for project 307ab95daa034afbb31f90626885072b. Resources: {'instances', 'cores', 'ram'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 22:59:17.012261 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-ec11b414-40f8-45e0-ad29-1c01a54a18b3 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Getting quotas for user 7d6d9806b6724e5aaf8c69be8e70d4f3 and project 307ab95daa034afbb31f90626885072b. Resources: {'instances', 'cores', 'ram'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 22:59:17.046035 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:59:17.056863 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-ec11b414-40f8-45e0-ad29-1c01a54a18b3 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Going to run 1 instances... {{(pid=122633) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 22:59:17.066027 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-ec11b414-40f8-45e0-ad29-1c01a54a18b3 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] [instance: f3722f40-7320-484b-8c20-78b2de3e89f1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78ad8905-f66f-4733-8be9-2b260f1fabed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122633) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 22:59:17.157345 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-ec11b414-40f8-45e0-ad29-1c01a54a18b3 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.492246 Aug 10 22:59:17.158254 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 447/862] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 22:59:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 1495 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 22:59:17.171889 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-4febd6b7-9bd2-4ca9-8f04-ea6e0742d6e1 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:17.172537 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-4febd6b7-9bd2-4ca9-8f04-ea6e0742d6e1 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] [instance: f3722f40-7320-484b-8c20-78b2de3e89f1] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:17.336959 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-85abf748-4911-48be-83d5-791037476843 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:17.337815 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-85abf748-4911-48be-83d5-791037476843 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 1464324b-6977-4faa-8b84-370603a77429] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:17.346086 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-85abf748-4911-48be-83d5-791037476843 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:17.350526 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-85abf748-4911-48be-83d5-791037476843 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:17.353682 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-85abf748-4911-48be-83d5-791037476843 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:17.354641 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-85abf748-4911-48be-83d5-791037476843 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:17.355299 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-85abf748-4911-48be-83d5-791037476843 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:17.357247 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-85abf748-4911-48be-83d5-791037476843 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:17.384726 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-4febd6b7-9bd2-4ca9-8f04-ea6e0742d6e1 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6d9806b6724e5aaf8c69be8e70d4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307ab95daa034afbb31f90626885072b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:59:17.395488 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-4febd6b7-9bd2-4ca9-8f04-ea6e0742d6e1 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] 10.222.0.58 "GET /compute/v2.1/servers/f3722f40-7320-484b-8c20-78b2de3e89f1" status: 200 len: 1208 microversion: 2.1 time: 0.228717 Aug 10 22:59:17.411714 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 416/863] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:59:17 2022] GET /compute/v2.1/servers/f3722f40-7320-484b-8c20-78b2de3e89f1 => generated 1208 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:59:17.525560 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-4d543045-9f5a-4c78-aef9-3d507853a4ae tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:17.526604 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-4d543045-9f5a-4c78-aef9-3d507853a4ae tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] [instance: e1deb45a-4597-4456-a1bd-54013c9484a4] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:17.546756 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4d543045-9f5a-4c78-aef9-3d507853a4ae tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:17.547671 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4d543045-9f5a-4c78-aef9-3d507853a4ae tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:17.548276 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4d543045-9f5a-4c78-aef9-3d507853a4ae tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:17.551144 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4d543045-9f5a-4c78-aef9-3d507853a4ae tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:17.554199 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4d543045-9f5a-4c78-aef9-3d507853a4ae tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:17.557862 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4d543045-9f5a-4c78-aef9-3d507853a4ae tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:17.756845 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-4d543045-9f5a-4c78-aef9-3d507853a4ae tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e86e6a62c56248d6a7887be0ec712f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25090b10522b4936b3117dc25dd6f609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:59:17.766797 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-4d543045-9f5a-4c78-aef9-3d507853a4ae tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] 10.222.0.58 "GET /compute/v2.1/servers/e1deb45a-4597-4456-a1bd-54013c9484a4" status: 200 len: 1275 microversion: 2.1 time: 0.245555 Aug 10 22:59:17.782459 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 417/864] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:59:17 2022] GET /compute/v2.1/servers/e1deb45a-4597-4456-a1bd-54013c9484a4 => generated 1275 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:59:17.789244 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-b4c4bb2c-619c-4ec1-a373-452a25b92442 req-abc71885-2d86-40e1-be7a-208670801ab7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1464324b-6977-4faa-8b84-370603a77429", "name": "network-vif-plugged", "status": "completed", "tag": "6a54d59d-b7dd-4033-89c5-dd089d9e9fb8"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:59:17.804790 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-b4c4bb2c-619c-4ec1-a373-452a25b92442 req-abc71885-2d86-40e1-be7a-208670801ab7 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:17.806193 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-b4c4bb2c-619c-4ec1-a373-452a25b92442 req-abc71885-2d86-40e1-be7a-208670801ab7 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:17.806842 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-b4c4bb2c-619c-4ec1-a373-452a25b92442 req-abc71885-2d86-40e1-be7a-208670801ab7 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:17.824614 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-b4c4bb2c-619c-4ec1-a373-452a25b92442 req-abc71885-2d86-40e1-be7a-208670801ab7 service nova] Creating event network-vif-plugged:6a54d59d-b7dd-4033-89c5-dd089d9e9fb8 for instance 1464324b-6977-4faa-8b84-370603a77429 on n-h1-850468-14 Aug 10 22:59:17.831579 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-b4c4bb2c-619c-4ec1-a373-452a25b92442 req-abc71885-2d86-40e1-be7a-208670801ab7 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047035 Aug 10 22:59:17.833488 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 418/865] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 22:59:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:59:17.939094 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-93dbd537-8e20-4d4b-9c51-924995e81449 req-1d49da8f-e2c6-4360-bbb3-2c4a43741247 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b8271c8-f9d7-48fc-b8ad-a50e71d3cec5", "tag": "1fc37ded-1174-48fe-96fd-658af446018b"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:59:17.957999 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-93dbd537-8e20-4d4b-9c51-924995e81449 req-1d49da8f-e2c6-4360-bbb3-2c4a43741247 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:17.958483 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-93dbd537-8e20-4d4b-9c51-924995e81449 req-1d49da8f-e2c6-4360-bbb3-2c4a43741247 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:17.958960 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-93dbd537-8e20-4d4b-9c51-924995e81449 req-1d49da8f-e2c6-4360-bbb3-2c4a43741247 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:17.975597 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-93dbd537-8e20-4d4b-9c51-924995e81449 req-1d49da8f-e2c6-4360-bbb3-2c4a43741247 service nova] Creating event network-changed:1fc37ded-1174-48fe-96fd-658af446018b for instance 9b8271c8-f9d7-48fc-b8ad-a50e71d3cec5 on n-h2-850468-14 Aug 10 22:59:17.982251 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-93dbd537-8e20-4d4b-9c51-924995e81449 req-1d49da8f-e2c6-4360-bbb3-2c4a43741247 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048320 Aug 10 22:59:17.983759 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 419/866] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 22:59:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:59:18.009544 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-f6bc5f90-ad0c-4283-b3de-6a65d014c353 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:18.011738 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-f6bc5f90-ad0c-4283-b3de-6a65d014c353 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] [instance: 9b8271c8-f9d7-48fc-b8ad-a50e71d3cec5] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:18.019899 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f6bc5f90-ad0c-4283-b3de-6a65d014c353 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:18.020414 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f6bc5f90-ad0c-4283-b3de-6a65d014c353 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:18.020835 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f6bc5f90-ad0c-4283-b3de-6a65d014c353 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:18.021127 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-85abf748-4911-48be-83d5-791037476843 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:59:18.021640 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f6bc5f90-ad0c-4283-b3de-6a65d014c353 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:18.022187 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f6bc5f90-ad0c-4283-b3de-6a65d014c353 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:18.022618 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f6bc5f90-ad0c-4283-b3de-6a65d014c353 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:18.057359 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-85abf748-4911-48be-83d5-791037476843 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/1464324b-6977-4faa-8b84-370603a77429" status: 200 len: 1379 microversion: 2.1 time: 0.725099 Aug 10 22:59:18.075892 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 448/867] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:59:17 2022] GET /compute/v2.1/servers/1464324b-6977-4faa-8b84-370603a77429 => generated 1379 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:59:18.428817 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-8a4a47bd-3607-44f9-a849-523559f6cc8c tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:18.429721 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-8a4a47bd-3607-44f9-a849-523559f6cc8c tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] [instance: f3722f40-7320-484b-8c20-78b2de3e89f1] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:18.439976 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8a4a47bd-3607-44f9-a849-523559f6cc8c tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:18.442496 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8a4a47bd-3607-44f9-a849-523559f6cc8c tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:18.443205 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8a4a47bd-3607-44f9-a849-523559f6cc8c tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:18.445038 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8a4a47bd-3607-44f9-a849-523559f6cc8c tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:18.445884 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8a4a47bd-3607-44f9-a849-523559f6cc8c tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:18.447575 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8a4a47bd-3607-44f9-a849-523559f6cc8c tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:18.468364 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:59:18.520293 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-f6bc5f90-ad0c-4283-b3de-6a65d014c353 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632904331d024d9b8e4d3660dff2cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ed0bdee3aa4013bd9219069bda558c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:59:18.534453 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-f6bc5f90-ad0c-4283-b3de-6a65d014c353 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] 10.222.0.58 "GET /compute/v2.1/servers/9b8271c8-f9d7-48fc-b8ad-a50e71d3cec5" status: 200 len: 1503 microversion: 2.1 time: 0.548889 Aug 10 22:59:18.536881 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 420/868] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:59:17 2022] GET /compute/v2.1/servers/9b8271c8-f9d7-48fc-b8ad-a50e71d3cec5 => generated 1503 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:59:18.657879 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-8a4a47bd-3607-44f9-a849-523559f6cc8c tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6d9806b6724e5aaf8c69be8e70d4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307ab95daa034afbb31f90626885072b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:59:18.668693 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-8a4a47bd-3607-44f9-a849-523559f6cc8c tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] 10.222.0.58 "GET /compute/v2.1/servers/f3722f40-7320-484b-8c20-78b2de3e89f1" status: 200 len: 1260 microversion: 2.1 time: 0.246910 Aug 10 22:59:18.673088 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 449/869] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:59:18 2022] GET /compute/v2.1/servers/f3722f40-7320-484b-8c20-78b2de3e89f1 => generated 1260 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:59:18.790769 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-e942db5a-7409-484a-8de9-81beaef0ee20 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:18.791883 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-e942db5a-7409-484a-8de9-81beaef0ee20 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] [instance: e1deb45a-4597-4456-a1bd-54013c9484a4] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:18.812321 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e942db5a-7409-484a-8de9-81beaef0ee20 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:18.812546 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e942db5a-7409-484a-8de9-81beaef0ee20 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:18.812890 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e942db5a-7409-484a-8de9-81beaef0ee20 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:18.816556 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e942db5a-7409-484a-8de9-81beaef0ee20 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:18.817048 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e942db5a-7409-484a-8de9-81beaef0ee20 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:18.817490 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e942db5a-7409-484a-8de9-81beaef0ee20 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:19.087078 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-4e35ec56-4633-4913-99b1-645b04a1ea00 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:19.089336 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-4e35ec56-4633-4913-99b1-645b04a1ea00 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 1464324b-6977-4faa-8b84-370603a77429] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:19.113734 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4e35ec56-4633-4913-99b1-645b04a1ea00 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:19.114441 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4e35ec56-4633-4913-99b1-645b04a1ea00 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:19.116661 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4e35ec56-4633-4913-99b1-645b04a1ea00 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:19.117445 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4e35ec56-4633-4913-99b1-645b04a1ea00 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:19.119001 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4e35ec56-4633-4913-99b1-645b04a1ea00 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:19.124094 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4e35ec56-4633-4913-99b1-645b04a1ea00 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:19.541918 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-4e35ec56-4633-4913-99b1-645b04a1ea00 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:59:19.567633 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-4e35ec56-4633-4913-99b1-645b04a1ea00 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/1464324b-6977-4faa-8b84-370603a77429" status: 200 len: 1379 microversion: 2.1 time: 0.486853 Aug 10 22:59:19.585390 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 450/870] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:59:19 2022] GET /compute/v2.1/servers/1464324b-6977-4faa-8b84-370603a77429 => generated 1379 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:59:19.598918 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-9d11558c-930b-4475-b3cd-7787494f5fbe tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:19.600825 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-9d11558c-930b-4475-b3cd-7787494f5fbe tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] [instance: 9b8271c8-f9d7-48fc-b8ad-a50e71d3cec5] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:19.620621 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9d11558c-930b-4475-b3cd-7787494f5fbe tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:19.623397 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9d11558c-930b-4475-b3cd-7787494f5fbe tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:19.624186 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9d11558c-930b-4475-b3cd-7787494f5fbe tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:19.627702 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9d11558c-930b-4475-b3cd-7787494f5fbe tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:19.629574 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9d11558c-930b-4475-b3cd-7787494f5fbe tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:19.630556 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9d11558c-930b-4475-b3cd-7787494f5fbe tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:19.783139 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-e942db5a-7409-484a-8de9-81beaef0ee20 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e86e6a62c56248d6a7887be0ec712f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25090b10522b4936b3117dc25dd6f609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:59:19.796441 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-e942db5a-7409-484a-8de9-81beaef0ee20 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] 10.222.0.58 "GET /compute/v2.1/servers/e1deb45a-4597-4456-a1bd-54013c9484a4" status: 200 len: 1275 microversion: 2.1 time: 1.007647 Aug 10 22:59:19.797088 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 421/871] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:59:18 2022] GET /compute/v2.1/servers/e1deb45a-4597-4456-a1bd-54013c9484a4 => generated 1275 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:59:19.803317 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-7bf4f6fd-8b27-409b-9425-36c23b3a2aae req-a37d3bed-9c8d-48ce-bba7-a7e28fc23f9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce82674f-e3eb-4e97-acd3-b4da01015330", "name": "network-vif-deleted", "tag": "a612824c-2998-441d-ad59-b655d3918bdf"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:59:19.823005 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-7bf4f6fd-8b27-409b-9425-36c23b3a2aae req-a37d3bed-9c8d-48ce-bba7-a7e28fc23f9b service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:19.824093 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-7bf4f6fd-8b27-409b-9425-36c23b3a2aae req-a37d3bed-9c8d-48ce-bba7-a7e28fc23f9b service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:19.824817 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-7bf4f6fd-8b27-409b-9425-36c23b3a2aae req-a37d3bed-9c8d-48ce-bba7-a7e28fc23f9b service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:19.840909 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-7bf4f6fd-8b27-409b-9425-36c23b3a2aae req-a37d3bed-9c8d-48ce-bba7-a7e28fc23f9b service nova] Creating event network-vif-deleted:a612824c-2998-441d-ad59-b655d3918bdf for instance ce82674f-e3eb-4e97-acd3-b4da01015330 on n-h2-850468-14 Aug 10 22:59:19.849268 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-7bf4f6fd-8b27-409b-9425-36c23b3a2aae req-a37d3bed-9c8d-48ce-bba7-a7e28fc23f9b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048028 Aug 10 22:59:19.850627 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 422/872] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 22:59:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:59:19.858490 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-64dfe50f-d270-43a6-9a57-9bde9cd2b311 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:19.860959 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-64dfe50f-d270-43a6-9a57-9bde9cd2b311 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] [instance: f3722f40-7320-484b-8c20-78b2de3e89f1] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:19.870491 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-64dfe50f-d270-43a6-9a57-9bde9cd2b311 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:19.871296 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-64dfe50f-d270-43a6-9a57-9bde9cd2b311 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:19.871988 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-64dfe50f-d270-43a6-9a57-9bde9cd2b311 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:19.873146 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-64dfe50f-d270-43a6-9a57-9bde9cd2b311 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:19.874153 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-64dfe50f-d270-43a6-9a57-9bde9cd2b311 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:19.874881 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-64dfe50f-d270-43a6-9a57-9bde9cd2b311 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:20.007980 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-64dfe50f-d270-43a6-9a57-9bde9cd2b311 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6d9806b6724e5aaf8c69be8e70d4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307ab95daa034afbb31f90626885072b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:59:20.033613 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-64dfe50f-d270-43a6-9a57-9bde9cd2b311 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] 10.222.0.58 "GET /compute/v2.1/servers/f3722f40-7320-484b-8c20-78b2de3e89f1" status: 200 len: 1266 microversion: 2.1 time: 0.180946 Aug 10 22:59:20.041525 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 423/873] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:59:19 2022] GET /compute/v2.1/servers/f3722f40-7320-484b-8c20-78b2de3e89f1 => generated 1266 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:59:20.281599 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-9d11558c-930b-4475-b3cd-7787494f5fbe tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632904331d024d9b8e4d3660dff2cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ed0bdee3aa4013bd9219069bda558c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:59:20.290234 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-9d11558c-930b-4475-b3cd-7787494f5fbe tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] 10.222.0.58 "GET /compute/v2.1/servers/9b8271c8-f9d7-48fc-b8ad-a50e71d3cec5" status: 200 len: 1503 microversion: 2.1 time: 0.703188 Aug 10 22:59:20.290846 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 451/874] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:59:19 2022] GET /compute/v2.1/servers/9b8271c8-f9d7-48fc-b8ad-a50e71d3cec5 => generated 1503 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:59:20.597931 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-f6f7ce71-512d-4353-b87f-06ab87397bc8 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:20.598556 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-f6f7ce71-512d-4353-b87f-06ab87397bc8 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 1464324b-6977-4faa-8b84-370603a77429] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:20.612210 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f6f7ce71-512d-4353-b87f-06ab87397bc8 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:20.613772 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f6f7ce71-512d-4353-b87f-06ab87397bc8 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:20.614446 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f6f7ce71-512d-4353-b87f-06ab87397bc8 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:20.615357 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f6f7ce71-512d-4353-b87f-06ab87397bc8 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:20.615970 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f6f7ce71-512d-4353-b87f-06ab87397bc8 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:20.616572 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f6f7ce71-512d-4353-b87f-06ab87397bc8 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:20.818169 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-2792f2f6-c84a-4ee3-9a56-906fa2ae8aec tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:20.819127 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-2792f2f6-c84a-4ee3-9a56-906fa2ae8aec tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] [instance: e1deb45a-4597-4456-a1bd-54013c9484a4] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:20.826271 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2792f2f6-c84a-4ee3-9a56-906fa2ae8aec tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:20.827058 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2792f2f6-c84a-4ee3-9a56-906fa2ae8aec tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:20.827649 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2792f2f6-c84a-4ee3-9a56-906fa2ae8aec tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:20.828527 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2792f2f6-c84a-4ee3-9a56-906fa2ae8aec tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:20.829118 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2792f2f6-c84a-4ee3-9a56-906fa2ae8aec tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:20.829694 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2792f2f6-c84a-4ee3-9a56-906fa2ae8aec tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:21.124415 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-2792f2f6-c84a-4ee3-9a56-906fa2ae8aec tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e86e6a62c56248d6a7887be0ec712f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25090b10522b4936b3117dc25dd6f609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:59:21.136758 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-2792f2f6-c84a-4ee3-9a56-906fa2ae8aec tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] 10.222.0.58 "GET /compute/v2.1/servers/e1deb45a-4597-4456-a1bd-54013c9484a4" status: 200 len: 1317 microversion: 2.1 time: 0.322896 Aug 10 22:59:21.150514 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 452/875] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:59:20 2022] GET /compute/v2.1/servers/e1deb45a-4597-4456-a1bd-54013c9484a4 => generated 1317 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:59:21.161061 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-ae270c7f-d2ed-4d16-a1b6-6b04c1ecef59 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:21.161677 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-ae270c7f-d2ed-4d16-a1b6-6b04c1ecef59 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] [instance: f3722f40-7320-484b-8c20-78b2de3e89f1] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:21.176961 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ae270c7f-d2ed-4d16-a1b6-6b04c1ecef59 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:21.177709 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ae270c7f-d2ed-4d16-a1b6-6b04c1ecef59 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:21.178146 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ae270c7f-d2ed-4d16-a1b6-6b04c1ecef59 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:21.178880 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ae270c7f-d2ed-4d16-a1b6-6b04c1ecef59 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:21.179334 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ae270c7f-d2ed-4d16-a1b6-6b04c1ecef59 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:21.179768 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ae270c7f-d2ed-4d16-a1b6-6b04c1ecef59 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:21.254634 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-f6f7ce71-512d-4353-b87f-06ab87397bc8 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:59:21.268725 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-f6f7ce71-512d-4353-b87f-06ab87397bc8 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/1464324b-6977-4faa-8b84-370603a77429" status: 200 len: 1528 microversion: 2.1 time: 0.675643 Aug 10 22:59:21.270127 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 424/876] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:59:20 2022] GET /compute/v2.1/servers/1464324b-6977-4faa-8b84-370603a77429 => generated 1528 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:59:21.300738 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c82aaae8-aaa7-4515-9673-8742c293280b tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:21.302145 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-c82aaae8-aaa7-4515-9673-8742c293280b tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 1464324b-6977-4faa-8b84-370603a77429] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:21.316902 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c82aaae8-aaa7-4515-9673-8742c293280b tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:21.319292 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c82aaae8-aaa7-4515-9673-8742c293280b tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:21.320011 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c82aaae8-aaa7-4515-9673-8742c293280b tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:21.321067 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c82aaae8-aaa7-4515-9673-8742c293280b tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:21.322039 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c82aaae8-aaa7-4515-9673-8742c293280b tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:21.322965 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c82aaae8-aaa7-4515-9673-8742c293280b tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:21.593669 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-ae270c7f-d2ed-4d16-a1b6-6b04c1ecef59 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6d9806b6724e5aaf8c69be8e70d4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307ab95daa034afbb31f90626885072b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:59:21.603849 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-ae270c7f-d2ed-4d16-a1b6-6b04c1ecef59 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] 10.222.0.58 "GET /compute/v2.1/servers/f3722f40-7320-484b-8c20-78b2de3e89f1" status: 200 len: 1308 microversion: 2.1 time: 0.452082 Aug 10 22:59:21.615713 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 453/877] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:59:21 2022] GET /compute/v2.1/servers/f3722f40-7320-484b-8c20-78b2de3e89f1 => generated 1308 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:59:21.620756 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-0f5f3bc7-c000-468b-a42a-daa28404b41b tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:21.621710 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-0f5f3bc7-c000-468b-a42a-daa28404b41b tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] [instance: 9b8271c8-f9d7-48fc-b8ad-a50e71d3cec5] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:21.628789 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0f5f3bc7-c000-468b-a42a-daa28404b41b tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:21.629515 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0f5f3bc7-c000-468b-a42a-daa28404b41b tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:21.630179 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0f5f3bc7-c000-468b-a42a-daa28404b41b tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:21.631130 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0f5f3bc7-c000-468b-a42a-daa28404b41b tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:21.631784 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0f5f3bc7-c000-468b-a42a-daa28404b41b tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:21.632402 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0f5f3bc7-c000-468b-a42a-daa28404b41b tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:21.888947 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-c82aaae8-aaa7-4515-9673-8742c293280b tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:59:21.911985 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-c82aaae8-aaa7-4515-9673-8742c293280b tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/1464324b-6977-4faa-8b84-370603a77429" status: 200 len: 1528 microversion: 2.1 time: 0.622213 Aug 10 22:59:21.913347 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 425/878] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:59:21 2022] GET /compute/v2.1/servers/1464324b-6977-4faa-8b84-370603a77429 => generated 1528 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:59:21.932573 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-d5a3ad64-2d9f-49de-a336-7ebe21329205 tempest-MigrationsAdminTest-974767625 tempest-MigrationsAdminTest-974767625-project-admin] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:21.933713 n-d-850468-14 devstack@n-api.service[122632]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:59:21.933713 n-d-850468-14 devstack@n-api.service[122632]: warnings.warn(msg) Aug 10 22:59:21.954212 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-d5a3ad64-2d9f-49de-a336-7ebe21329205 tempest-MigrationsAdminTest-974767625 tempest-MigrationsAdminTest-974767625-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/8f981c7e-cc2e-453c-8da0-478648af3419" status: 202 len: 0 microversion: 2.1 time: 0.025237 Aug 10 22:59:21.954837 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 426/879] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 22:59:21 2022] DELETE /compute/v2.1/flavors/8f981c7e-cc2e-453c-8da0-478648af3419 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 10 22:59:21.967017 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-92d73ee3-0a30-4fc2-88cc-36ba7a60a336 tempest-MigrationsAdminTest-974767625 tempest-MigrationsAdminTest-974767625-project-admin] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:22.006537 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-92d73ee3-0a30-4fc2-88cc-36ba7a60a336 tempest-MigrationsAdminTest-974767625 tempest-MigrationsAdminTest-974767625-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.046434 Aug 10 22:59:22.007779 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 427/880] 10.222.0.58 () {58 vars in 1146 bytes} [Wed Aug 10 22:59:21 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:59:22.026551 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-bac0642c-f7c7-4fda-829f-08c51a1a65a8 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:59:22.030283 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-bac0642c-f7c7-4fda-829f-08c51a1a65a8 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 1464324b-6977-4faa-8b84-370603a77429] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:22.037174 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bac0642c-f7c7-4fda-829f-08c51a1a65a8 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:22.037862 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bac0642c-f7c7-4fda-829f-08c51a1a65a8 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:22.038477 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bac0642c-f7c7-4fda-829f-08c51a1a65a8 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:22.039403 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bac0642c-f7c7-4fda-829f-08c51a1a65a8 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:22.040010 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bac0642c-f7c7-4fda-829f-08c51a1a65a8 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:22.040587 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bac0642c-f7c7-4fda-829f-08c51a1a65a8 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:22.077654 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-bac0642c-f7c7-4fda-829f-08c51a1a65a8 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:59:22.086484 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-bac0642c-f7c7-4fda-829f-08c51a1a65a8 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 1464324b-6977-4faa-8b84-370603a77429] Old instance type tempest-test_resize_flavor_-2085130952, new instance type m1.heat {{(pid=122632) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 10 22:59:22.090704 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-0f5f3bc7-c000-468b-a42a-daa28404b41b tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632904331d024d9b8e4d3660dff2cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ed0bdee3aa4013bd9219069bda558c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:59:22.099218 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-bac0642c-f7c7-4fda-829f-08c51a1a65a8 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Flavor limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 22:59:22.099855 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-bac0642c-f7c7-4fda-829f-08c51a1a65a8 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Image limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 22:59:22.100560 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-bac0642c-f7c7-4fda-829f-08c51a1a65a8 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Flavor pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 22:59:22.101119 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-bac0642c-f7c7-4fda-829f-08c51a1a65a8 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Image pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 22:59:22.101703 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-bac0642c-f7c7-4fda-829f-08c51a1a65a8 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 22:59:22.103194 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-0f5f3bc7-c000-468b-a42a-daa28404b41b tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] 10.222.0.58 "GET /compute/v2.1/servers/9b8271c8-f9d7-48fc-b8ad-a50e71d3cec5" status: 200 len: 1503 microversion: 2.1 time: 0.484264 Aug 10 22:59:22.107357 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 454/881] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:59:21 2022] GET /compute/v2.1/servers/9b8271c8-f9d7-48fc-b8ad-a50e71d3cec5 => generated 1503 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:59:22.119168 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-be74fe1d-6adb-47ee-a1d9-3baa7864f2c4 req-528c30fb-fbae-452e-a5ca-2443acd219d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d716cac6-ac7c-4b98-b6ea-2496ccd62096", "tag": "30ea23cf-a364-4798-a6be-6ab46d11599e"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:59:22.145853 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-be74fe1d-6adb-47ee-a1d9-3baa7864f2c4 req-528c30fb-fbae-452e-a5ca-2443acd219d5 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:22.146760 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-be74fe1d-6adb-47ee-a1d9-3baa7864f2c4 req-528c30fb-fbae-452e-a5ca-2443acd219d5 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:22.147862 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-be74fe1d-6adb-47ee-a1d9-3baa7864f2c4 req-528c30fb-fbae-452e-a5ca-2443acd219d5 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:22.188283 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-be74fe1d-6adb-47ee-a1d9-3baa7864f2c4 req-528c30fb-fbae-452e-a5ca-2443acd219d5 service nova] Creating event network-changed:30ea23cf-a364-4798-a6be-6ab46d11599e for instance d716cac6-ac7c-4b98-b6ea-2496ccd62096 on n-h2-850468-14 Aug 10 22:59:22.197332 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-be74fe1d-6adb-47ee-a1d9-3baa7864f2c4 req-528c30fb-fbae-452e-a5ca-2443acd219d5 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086568 Aug 10 22:59:22.221510 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-bac0642c-f7c7-4fda-829f-08c51a1a65a8 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "POST /compute/v2.1/servers/1464324b-6977-4faa-8b84-370603a77429/action" status: 202 len: 0 microversion: 2.1 time: 0.184344 Aug 10 22:59:22.226042 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 428/882] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 22:59:22 2022] POST /compute/v2.1/servers/1464324b-6977-4faa-8b84-370603a77429/action => generated 0 bytes in 205 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 22:59:22.263464 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-4b06a388-637f-4e5e-86e1-5b5d4ac1bc9e tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:22.264295 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 455/883] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 22:59:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:59:22.271287 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-4b06a388-637f-4e5e-86e1-5b5d4ac1bc9e tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] [instance: e1deb45a-4597-4456-a1bd-54013c9484a4] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:22.290119 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-736cecb2-908f-4d3f-ae70-3aa69e3cf837 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:22.295439 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-736cecb2-908f-4d3f-ae70-3aa69e3cf837 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 1464324b-6977-4faa-8b84-370603a77429] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:22.304792 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4b06a388-637f-4e5e-86e1-5b5d4ac1bc9e tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:22.305284 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4b06a388-637f-4e5e-86e1-5b5d4ac1bc9e tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:22.305724 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4b06a388-637f-4e5e-86e1-5b5d4ac1bc9e tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:22.306439 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4b06a388-637f-4e5e-86e1-5b5d4ac1bc9e tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:22.306925 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4b06a388-637f-4e5e-86e1-5b5d4ac1bc9e tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:22.307348 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4b06a388-637f-4e5e-86e1-5b5d4ac1bc9e tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:22.324828 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-736cecb2-908f-4d3f-ae70-3aa69e3cf837 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:22.325327 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-736cecb2-908f-4d3f-ae70-3aa69e3cf837 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:22.325774 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-736cecb2-908f-4d3f-ae70-3aa69e3cf837 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:22.330623 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-736cecb2-908f-4d3f-ae70-3aa69e3cf837 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:22.332530 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-736cecb2-908f-4d3f-ae70-3aa69e3cf837 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:22.333641 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-736cecb2-908f-4d3f-ae70-3aa69e3cf837 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:22.796513 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-4b06a388-637f-4e5e-86e1-5b5d4ac1bc9e tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e86e6a62c56248d6a7887be0ec712f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25090b10522b4936b3117dc25dd6f609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:59:22.806978 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-4b06a388-637f-4e5e-86e1-5b5d4ac1bc9e tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] 10.222.0.58 "GET /compute/v2.1/servers/e1deb45a-4597-4456-a1bd-54013c9484a4" status: 200 len: 1317 microversion: 2.1 time: 0.579692 Aug 10 22:59:22.807577 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 429/884] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:59:22 2022] GET /compute/v2.1/servers/e1deb45a-4597-4456-a1bd-54013c9484a4 => generated 1317 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:59:22.824774 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-be73b754-b7c6-4e67-9ca5-c78feeebf3e8 req-cef2e776-c06a-4047-b5e1-eece4b5ad52c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3722f40-7320-484b-8c20-78b2de3e89f1", "tag": "3cd54803-1880-47e0-b27e-07883f5c80f2"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:59:22.850531 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-be73b754-b7c6-4e67-9ca5-c78feeebf3e8 req-cef2e776-c06a-4047-b5e1-eece4b5ad52c service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:22.851056 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-be73b754-b7c6-4e67-9ca5-c78feeebf3e8 req-cef2e776-c06a-4047-b5e1-eece4b5ad52c service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:22.851484 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-be73b754-b7c6-4e67-9ca5-c78feeebf3e8 req-cef2e776-c06a-4047-b5e1-eece4b5ad52c service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:22.897712 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-be73b754-b7c6-4e67-9ca5-c78feeebf3e8 req-cef2e776-c06a-4047-b5e1-eece4b5ad52c service nova] Creating event network-changed:3cd54803-1880-47e0-b27e-07883f5c80f2 for instance f3722f40-7320-484b-8c20-78b2de3e89f1 on n-h2-850468-14 Aug 10 22:59:22.903932 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-be73b754-b7c6-4e67-9ca5-c78feeebf3e8 req-cef2e776-c06a-4047-b5e1-eece4b5ad52c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095116 Aug 10 22:59:22.907303 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 430/885] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 22:59:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:59:22.921450 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-8b75334a-fa50-4ca4-ba75-b951fd969a38 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:22.922177 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-8b75334a-fa50-4ca4-ba75-b951fd969a38 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] [instance: f3722f40-7320-484b-8c20-78b2de3e89f1] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:22.951838 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8b75334a-fa50-4ca4-ba75-b951fd969a38 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:22.952351 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8b75334a-fa50-4ca4-ba75-b951fd969a38 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:22.952785 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8b75334a-fa50-4ca4-ba75-b951fd969a38 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:22.953399 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8b75334a-fa50-4ca4-ba75-b951fd969a38 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:22.953849 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8b75334a-fa50-4ca4-ba75-b951fd969a38 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:22.954331 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8b75334a-fa50-4ca4-ba75-b951fd969a38 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:23.066369 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-736cecb2-908f-4d3f-ae70-3aa69e3cf837 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:59:23.076929 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-736cecb2-908f-4d3f-ae70-3aa69e3cf837 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/1464324b-6977-4faa-8b84-370603a77429" status: 200 len: 1537 microversion: 2.1 time: 0.796438 Aug 10 22:59:23.091200 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 456/886] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:59:22 2022] GET /compute/v2.1/servers/1464324b-6977-4faa-8b84-370603a77429 => generated 1537 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:59:23.133019 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-2c570229-247b-47ff-ae05-84bc2cc74ce9 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:23.133830 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-2c570229-247b-47ff-ae05-84bc2cc74ce9 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] [instance: 9b8271c8-f9d7-48fc-b8ad-a50e71d3cec5] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:23.147244 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2c570229-247b-47ff-ae05-84bc2cc74ce9 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:23.147738 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2c570229-247b-47ff-ae05-84bc2cc74ce9 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:23.148196 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2c570229-247b-47ff-ae05-84bc2cc74ce9 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:23.148930 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2c570229-247b-47ff-ae05-84bc2cc74ce9 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:23.161078 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2c570229-247b-47ff-ae05-84bc2cc74ce9 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:23.161881 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2c570229-247b-47ff-ae05-84bc2cc74ce9 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:23.895079 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-8b75334a-fa50-4ca4-ba75-b951fd969a38 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6d9806b6724e5aaf8c69be8e70d4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307ab95daa034afbb31f90626885072b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:59:23.916520 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-8b75334a-fa50-4ca4-ba75-b951fd969a38 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] 10.222.0.58 "GET /compute/v2.1/servers/f3722f40-7320-484b-8c20-78b2de3e89f1" status: 200 len: 1308 microversion: 2.1 time: 1.000068 Aug 10 22:59:23.921023 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 431/887] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:59:22 2022] GET /compute/v2.1/servers/f3722f40-7320-484b-8c20-78b2de3e89f1 => generated 1308 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:59:23.926225 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-5b61b4b3-e2b7-423f-b88a-7dbdf516cdde tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:23.928562 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-5b61b4b3-e2b7-423f-b88a-7dbdf516cdde tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] [instance: 7599a318-7a19-4f4a-bbb6-162f7a207060] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:23.954757 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5b61b4b3-e2b7-423f-b88a-7dbdf516cdde tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:23.955303 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5b61b4b3-e2b7-423f-b88a-7dbdf516cdde tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:23.955754 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5b61b4b3-e2b7-423f-b88a-7dbdf516cdde tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:23.956547 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5b61b4b3-e2b7-423f-b88a-7dbdf516cdde tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:23.960300 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5b61b4b3-e2b7-423f-b88a-7dbdf516cdde tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:23.960802 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5b61b4b3-e2b7-423f-b88a-7dbdf516cdde tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:23.999243 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=2 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:59:24.053236 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-5b61b4b3-e2b7-423f-b88a-7dbdf516cdde tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] 10.222.0.58 "GET /compute/v2.1/servers/7599a318-7a19-4f4a-bbb6-162f7a207060/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.131129 Aug 10 22:59:24.053854 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 432/888] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 10 22:59:23 2022] GET /compute/v2.1/servers/7599a318-7a19-4f4a-bbb6-162f7a207060/os-volume_attachments => generated 197 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:59:24.067797 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-fcbb7797-f06e-4864-aa66-216298620259 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:24.068446 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-fcbb7797-f06e-4864-aa66-216298620259 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] [instance: e1deb45a-4597-4456-a1bd-54013c9484a4] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:24.085363 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fcbb7797-f06e-4864-aa66-216298620259 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:24.090659 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fcbb7797-f06e-4864-aa66-216298620259 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:24.091240 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fcbb7797-f06e-4864-aa66-216298620259 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:24.092009 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fcbb7797-f06e-4864-aa66-216298620259 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:24.092487 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fcbb7797-f06e-4864-aa66-216298620259 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:24.092920 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fcbb7797-f06e-4864-aa66-216298620259 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:24.240468 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-2c570229-247b-47ff-ae05-84bc2cc74ce9 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632904331d024d9b8e4d3660dff2cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ed0bdee3aa4013bd9219069bda558c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:59:24.259779 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-2c570229-247b-47ff-ae05-84bc2cc74ce9 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] 10.222.0.58 "GET /compute/v2.1/servers/9b8271c8-f9d7-48fc-b8ad-a50e71d3cec5" status: 200 len: 1503 microversion: 2.1 time: 1.130417 Aug 10 22:59:24.260414 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 457/889] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:59:23 2022] GET /compute/v2.1/servers/9b8271c8-f9d7-48fc-b8ad-a50e71d3cec5 => generated 1503 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:59:24.272216 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-8e51cce7-5b6a-418f-92b0-5e326265d820 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:24.272723 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-8e51cce7-5b6a-418f-92b0-5e326265d820 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] [instance: 7599a318-7a19-4f4a-bbb6-162f7a207060] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:24.290351 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8e51cce7-5b6a-418f-92b0-5e326265d820 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:24.291030 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8e51cce7-5b6a-418f-92b0-5e326265d820 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:24.291494 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8e51cce7-5b6a-418f-92b0-5e326265d820 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:24.292323 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8e51cce7-5b6a-418f-92b0-5e326265d820 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:24.292717 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8e51cce7-5b6a-418f-92b0-5e326265d820 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:24.293362 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8e51cce7-5b6a-418f-92b0-5e326265d820 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:24.607973 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.objects.instance [None req-8e51cce7-5b6a-418f-92b0-5e326265d820 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Lazy-loading 'services' on Instance uuid 7599a318-7a19-4f4a-bbb6-162f7a207060 {{(pid=122633) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 22:59:24.856022 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-8e51cce7-5b6a-418f-92b0-5e326265d820 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] 10.222.0.58 "DELETE /compute/v2.1/servers/7599a318-7a19-4f4a-bbb6-162f7a207060/os-volume_attachments/26cb5fdb-51db-4ea8-8a08-d24d1c6d424a" status: 202 len: 0 microversion: 2.1 time: 0.592919 Aug 10 22:59:24.859725 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 458/890] 10.222.0.58 () {58 vars in 1416 bytes} [Wed Aug 10 22:59:24 2022] DELETE /compute/v2.1/servers/7599a318-7a19-4f4a-bbb6-162f7a207060/os-volume_attachments/26cb5fdb-51db-4ea8-8a08-d24d1c6d424a => generated 0 bytes in 599 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 22:59:24.890725 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-4db24604-66d7-43f3-abae-8d3de49b6086 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:24.899356 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-4db24604-66d7-43f3-abae-8d3de49b6086 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 1464324b-6977-4faa-8b84-370603a77429] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:24.920172 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4db24604-66d7-43f3-abae-8d3de49b6086 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:24.920679 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4db24604-66d7-43f3-abae-8d3de49b6086 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:24.921127 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4db24604-66d7-43f3-abae-8d3de49b6086 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:24.921855 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4db24604-66d7-43f3-abae-8d3de49b6086 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:24.927136 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4db24604-66d7-43f3-abae-8d3de49b6086 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:24.928653 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4db24604-66d7-43f3-abae-8d3de49b6086 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:25.524228 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-fcbb7797-f06e-4864-aa66-216298620259 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e86e6a62c56248d6a7887be0ec712f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25090b10522b4936b3117dc25dd6f609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:59:25.543507 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-fcbb7797-f06e-4864-aa66-216298620259 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] 10.222.0.58 "GET /compute/v2.1/servers/e1deb45a-4597-4456-a1bd-54013c9484a4" status: 200 len: 1317 microversion: 2.1 time: 1.488575 Aug 10 22:59:25.544357 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 433/891] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:59:24 2022] GET /compute/v2.1/servers/e1deb45a-4597-4456-a1bd-54013c9484a4 => generated 1317 bytes in 1490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:59:25.553967 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-bfadc183-8590-408c-90d1-27c6d4317ad0 req-b3c54b9d-ce77-4ead-901c-0d9378c1d2d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1deb45a-4597-4456-a1bd-54013c9484a4", "tag": "c23c9196-ec43-4cc3-a250-0ae9f5c58948"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:59:25.599213 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-bfadc183-8590-408c-90d1-27c6d4317ad0 req-b3c54b9d-ce77-4ead-901c-0d9378c1d2d5 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:25.601755 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-bfadc183-8590-408c-90d1-27c6d4317ad0 req-b3c54b9d-ce77-4ead-901c-0d9378c1d2d5 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:25.607628 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-bfadc183-8590-408c-90d1-27c6d4317ad0 req-b3c54b9d-ce77-4ead-901c-0d9378c1d2d5 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:25.629247 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-bfadc183-8590-408c-90d1-27c6d4317ad0 req-b3c54b9d-ce77-4ead-901c-0d9378c1d2d5 service nova] Creating event network-changed:c23c9196-ec43-4cc3-a250-0ae9f5c58948 for instance e1deb45a-4597-4456-a1bd-54013c9484a4 on n-h1-850468-14 Aug 10 22:59:25.646039 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-bfadc183-8590-408c-90d1-27c6d4317ad0 req-b3c54b9d-ce77-4ead-901c-0d9378c1d2d5 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094034 Aug 10 22:59:25.647186 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 434/892] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 22:59:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:59:25.667118 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-8ada620b-f0d6-447c-ac3b-dd6c727da2c4 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:25.668088 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-8ada620b-f0d6-447c-ac3b-dd6c727da2c4 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] [instance: f3722f40-7320-484b-8c20-78b2de3e89f1] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:25.689944 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8ada620b-f0d6-447c-ac3b-dd6c727da2c4 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:25.691464 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8ada620b-f0d6-447c-ac3b-dd6c727da2c4 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:25.692629 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8ada620b-f0d6-447c-ac3b-dd6c727da2c4 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:25.693771 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8ada620b-f0d6-447c-ac3b-dd6c727da2c4 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:25.698576 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8ada620b-f0d6-447c-ac3b-dd6c727da2c4 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:25.699684 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8ada620b-f0d6-447c-ac3b-dd6c727da2c4 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:25.733297 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-4db24604-66d7-43f3-abae-8d3de49b6086 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:59:25.749482 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-4db24604-66d7-43f3-abae-8d3de49b6086 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/1464324b-6977-4faa-8b84-370603a77429" status: 200 len: 1537 microversion: 2.1 time: 0.875896 Aug 10 22:59:25.758092 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 459/893] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:59:24 2022] GET /compute/v2.1/servers/1464324b-6977-4faa-8b84-370603a77429 => generated 1537 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:59:25.776824 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c7d02946-c734-46cb-bd22-7ce378b807c9 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:25.780616 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-c7d02946-c734-46cb-bd22-7ce378b807c9 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] [instance: 9b8271c8-f9d7-48fc-b8ad-a50e71d3cec5] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:25.804522 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c7d02946-c734-46cb-bd22-7ce378b807c9 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:25.805030 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c7d02946-c734-46cb-bd22-7ce378b807c9 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:25.805462 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c7d02946-c734-46cb-bd22-7ce378b807c9 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:25.812807 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c7d02946-c734-46cb-bd22-7ce378b807c9 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:25.816733 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c7d02946-c734-46cb-bd22-7ce378b807c9 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:25.818357 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c7d02946-c734-46cb-bd22-7ce378b807c9 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:26.211821 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-c7d02946-c734-46cb-bd22-7ce378b807c9 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632904331d024d9b8e4d3660dff2cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ed0bdee3aa4013bd9219069bda558c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:59:26.225260 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-c7d02946-c734-46cb-bd22-7ce378b807c9 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] 10.222.0.58 "GET /compute/v2.1/servers/9b8271c8-f9d7-48fc-b8ad-a50e71d3cec5" status: 200 len: 1503 microversion: 2.1 time: 0.463643 Aug 10 22:59:26.225847 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 460/894] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:59:25 2022] GET /compute/v2.1/servers/9b8271c8-f9d7-48fc-b8ad-a50e71d3cec5 => generated 1503 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:59:26.226114 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-8ada620b-f0d6-447c-ac3b-dd6c727da2c4 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6d9806b6724e5aaf8c69be8e70d4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307ab95daa034afbb31f90626885072b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:59:26.243095 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-964cc234-1fb0-47a9-9ecc-6f4e3db3bc6f tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0d0219e7-5148-47c2-869d-347f08238220"}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:59:26.245527 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-964cc234-1fb0-47a9-9ecc-6f4e3db3bc6f tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] [instance: 3553ba91-ca7b-44d9-944a-1540fa047cb6] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:26.265256 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-964cc234-1fb0-47a9-9ecc-6f4e3db3bc6f tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:26.265789 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-964cc234-1fb0-47a9-9ecc-6f4e3db3bc6f tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:26.268745 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-8ada620b-f0d6-447c-ac3b-dd6c727da2c4 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] 10.222.0.58 "GET /compute/v2.1/servers/f3722f40-7320-484b-8c20-78b2de3e89f1" status: 200 len: 1308 microversion: 2.1 time: 0.619761 Aug 10 22:59:26.270520 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 435/895] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:59:25 2022] GET /compute/v2.1/servers/f3722f40-7320-484b-8c20-78b2de3e89f1 => generated 1308 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:59:26.275173 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-964cc234-1fb0-47a9-9ecc-6f4e3db3bc6f tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:26.275980 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-964cc234-1fb0-47a9-9ecc-6f4e3db3bc6f tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:26.276418 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-964cc234-1fb0-47a9-9ecc-6f4e3db3bc6f tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:26.276843 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-964cc234-1fb0-47a9-9ecc-6f4e3db3bc6f tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:26.564999 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-ce86c922-38ac-4702-a9fe-360279ab5218 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:26.566433 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-ce86c922-38ac-4702-a9fe-360279ab5218 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] [instance: e1deb45a-4597-4456-a1bd-54013c9484a4] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:26.577047 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ce86c922-38ac-4702-a9fe-360279ab5218 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:26.577727 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ce86c922-38ac-4702-a9fe-360279ab5218 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:26.580554 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ce86c922-38ac-4702-a9fe-360279ab5218 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:26.582727 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ce86c922-38ac-4702-a9fe-360279ab5218 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:26.584652 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ce86c922-38ac-4702-a9fe-360279ab5218 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:26.585328 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ce86c922-38ac-4702-a9fe-360279ab5218 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:26.820501 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-964cc234-1fb0-47a9-9ecc-6f4e3db3bc6f tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] 10.222.0.58 "POST /compute/v2.1/servers/3553ba91-ca7b-44d9-944a-1540fa047cb6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.589816 Aug 10 22:59:26.825006 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 461/896] 10.222.0.58 () {60 vars in 1323 bytes} [Wed Aug 10 22:59:26 2022] POST /compute/v2.1/servers/3553ba91-ca7b-44d9-944a-1540fa047cb6/os-volume_attachments => generated 194 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:59:26.847595 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-ce86c922-38ac-4702-a9fe-360279ab5218 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e86e6a62c56248d6a7887be0ec712f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25090b10522b4936b3117dc25dd6f609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:59:26.856637 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-ce86c922-38ac-4702-a9fe-360279ab5218 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] 10.222.0.58 "GET /compute/v2.1/servers/e1deb45a-4597-4456-a1bd-54013c9484a4" status: 200 len: 1317 microversion: 2.1 time: 0.295785 Aug 10 22:59:26.857747 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-7904aa0c-de61-49b8-ae14-d7ad1c227b21 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:26.860821 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-7904aa0c-de61-49b8-ae14-d7ad1c227b21 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 1464324b-6977-4faa-8b84-370603a77429] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:26.866444 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 436/897] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:59:26 2022] GET /compute/v2.1/servers/e1deb45a-4597-4456-a1bd-54013c9484a4 => generated 1317 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:59:26.903879 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7904aa0c-de61-49b8-ae14-d7ad1c227b21 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:26.904381 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7904aa0c-de61-49b8-ae14-d7ad1c227b21 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:26.910508 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7904aa0c-de61-49b8-ae14-d7ad1c227b21 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:26.913974 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7904aa0c-de61-49b8-ae14-d7ad1c227b21 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:26.915585 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7904aa0c-de61-49b8-ae14-d7ad1c227b21 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:26.917737 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7904aa0c-de61-49b8-ae14-d7ad1c227b21 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:27.019622 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=16 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:59:27.031097 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=20 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:59:27.252777 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c89f3817-5590-4b52-b57d-06a9e6c2fdb4 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:27.255998 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-c89f3817-5590-4b52-b57d-06a9e6c2fdb4 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] [instance: 9b8271c8-f9d7-48fc-b8ad-a50e71d3cec5] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:27.271195 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c89f3817-5590-4b52-b57d-06a9e6c2fdb4 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:27.272262 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c89f3817-5590-4b52-b57d-06a9e6c2fdb4 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:27.272942 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c89f3817-5590-4b52-b57d-06a9e6c2fdb4 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:27.274060 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c89f3817-5590-4b52-b57d-06a9e6c2fdb4 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:27.274742 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c89f3817-5590-4b52-b57d-06a9e6c2fdb4 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:27.279750 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c89f3817-5590-4b52-b57d-06a9e6c2fdb4 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:27.373500 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:59:27.408171 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=14 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:59:27.454436 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-7904aa0c-de61-49b8-ae14-d7ad1c227b21 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:59:27.467191 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-7904aa0c-de61-49b8-ae14-d7ad1c227b21 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/1464324b-6977-4faa-8b84-370603a77429" status: 200 len: 1537 microversion: 2.1 time: 0.637522 Aug 10 22:59:27.485708 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 462/898] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:59:26 2022] GET /compute/v2.1/servers/1464324b-6977-4faa-8b84-370603a77429 => generated 1537 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:59:27.501053 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-9195604a-9f97-4dd3-85c1-a2d27ec78699 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:27.504286 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-9195604a-9f97-4dd3-85c1-a2d27ec78699 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] [instance: f3722f40-7320-484b-8c20-78b2de3e89f1] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:27.525442 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9195604a-9f97-4dd3-85c1-a2d27ec78699 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:27.525929 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9195604a-9f97-4dd3-85c1-a2d27ec78699 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:27.526361 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9195604a-9f97-4dd3-85c1-a2d27ec78699 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:27.532230 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9195604a-9f97-4dd3-85c1-a2d27ec78699 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:27.532752 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9195604a-9f97-4dd3-85c1-a2d27ec78699 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:27.533237 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9195604a-9f97-4dd3-85c1-a2d27ec78699 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:27.707942 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-c89f3817-5590-4b52-b57d-06a9e6c2fdb4 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632904331d024d9b8e4d3660dff2cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ed0bdee3aa4013bd9219069bda558c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:59:27.718682 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-c89f3817-5590-4b52-b57d-06a9e6c2fdb4 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] 10.222.0.58 "GET /compute/v2.1/servers/9b8271c8-f9d7-48fc-b8ad-a50e71d3cec5" status: 200 len: 1503 microversion: 2.1 time: 0.475888 Aug 10 22:59:27.719937 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 437/899] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:59:27 2022] GET /compute/v2.1/servers/9b8271c8-f9d7-48fc-b8ad-a50e71d3cec5 => generated 1503 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:59:27.884668 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-a264d856-759a-4f88-8198-04a868f42469 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:27.885287 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-a264d856-759a-4f88-8198-04a868f42469 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] [instance: e1deb45a-4597-4456-a1bd-54013c9484a4] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:27.894228 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a264d856-759a-4f88-8198-04a868f42469 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:27.895098 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a264d856-759a-4f88-8198-04a868f42469 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:27.895746 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a264d856-759a-4f88-8198-04a868f42469 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:27.897712 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a264d856-759a-4f88-8198-04a868f42469 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:27.898912 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a264d856-759a-4f88-8198-04a868f42469 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:27.900282 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a264d856-759a-4f88-8198-04a868f42469 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:27.929610 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-9195604a-9f97-4dd3-85c1-a2d27ec78699 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6d9806b6724e5aaf8c69be8e70d4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307ab95daa034afbb31f90626885072b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:59:27.951050 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-9195604a-9f97-4dd3-85c1-a2d27ec78699 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] 10.222.0.58 "GET /compute/v2.1/servers/f3722f40-7320-484b-8c20-78b2de3e89f1" status: 200 len: 1308 microversion: 2.1 time: 0.464149 Aug 10 22:59:27.957507 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 463/900] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:59:27 2022] GET /compute/v2.1/servers/f3722f40-7320-484b-8c20-78b2de3e89f1 => generated 1308 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:59:28.489656 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-9ea8cf3c-7a1c-49a9-91da-55238538157b tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:28.490444 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-9ea8cf3c-7a1c-49a9-91da-55238538157b tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 1464324b-6977-4faa-8b84-370603a77429] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:28.495794 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-a264d856-759a-4f88-8198-04a868f42469 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e86e6a62c56248d6a7887be0ec712f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25090b10522b4936b3117dc25dd6f609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:59:28.499665 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9ea8cf3c-7a1c-49a9-91da-55238538157b tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:28.504355 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9ea8cf3c-7a1c-49a9-91da-55238538157b tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:28.504951 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9ea8cf3c-7a1c-49a9-91da-55238538157b tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:28.505520 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-a264d856-759a-4f88-8198-04a868f42469 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] 10.222.0.58 "GET /compute/v2.1/servers/e1deb45a-4597-4456-a1bd-54013c9484a4" status: 200 len: 1317 microversion: 2.1 time: 0.624789 Aug 10 22:59:28.506390 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9ea8cf3c-7a1c-49a9-91da-55238538157b tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:28.508810 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9ea8cf3c-7a1c-49a9-91da-55238538157b tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:28.509375 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9ea8cf3c-7a1c-49a9-91da-55238538157b tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:28.522655 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 438/901] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:59:27 2022] GET /compute/v2.1/servers/e1deb45a-4597-4456-a1bd-54013c9484a4 => generated 1317 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:59:28.742161 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-aaff3323-88b9-42fd-8a97-51299b8bf718 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:28.744203 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-aaff3323-88b9-42fd-8a97-51299b8bf718 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] [instance: 9b8271c8-f9d7-48fc-b8ad-a50e71d3cec5] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:28.760524 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-aaff3323-88b9-42fd-8a97-51299b8bf718 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:28.761913 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-aaff3323-88b9-42fd-8a97-51299b8bf718 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:28.763353 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-aaff3323-88b9-42fd-8a97-51299b8bf718 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:28.764989 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-aaff3323-88b9-42fd-8a97-51299b8bf718 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:28.766725 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-aaff3323-88b9-42fd-8a97-51299b8bf718 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:28.769623 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-aaff3323-88b9-42fd-8a97-51299b8bf718 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:29.400168 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-9ea8cf3c-7a1c-49a9-91da-55238538157b tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:59:29.403772 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:59:29.417095 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-9ea8cf3c-7a1c-49a9-91da-55238538157b tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/1464324b-6977-4faa-8b84-370603a77429" status: 200 len: 1537 microversion: 2.1 time: 0.932178 Aug 10 22:59:29.435092 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 464/902] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:59:28 2022] GET /compute/v2.1/servers/1464324b-6977-4faa-8b84-370603a77429 => generated 1537 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:59:29.477121 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-e3d70331-a2ff-42a3-8801-e80f2d32260d tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:29.477752 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-e3d70331-a2ff-42a3-8801-e80f2d32260d tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] [instance: f3722f40-7320-484b-8c20-78b2de3e89f1] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:29.501329 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e3d70331-a2ff-42a3-8801-e80f2d32260d tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:29.502432 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e3d70331-a2ff-42a3-8801-e80f2d32260d tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:29.503938 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e3d70331-a2ff-42a3-8801-e80f2d32260d tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:29.506087 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e3d70331-a2ff-42a3-8801-e80f2d32260d tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:29.506864 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e3d70331-a2ff-42a3-8801-e80f2d32260d tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:29.507613 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e3d70331-a2ff-42a3-8801-e80f2d32260d tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:29.868436 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-e3d70331-a2ff-42a3-8801-e80f2d32260d tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6d9806b6724e5aaf8c69be8e70d4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307ab95daa034afbb31f90626885072b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:59:29.880205 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-e3d70331-a2ff-42a3-8801-e80f2d32260d tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] 10.222.0.58 "GET /compute/v2.1/servers/f3722f40-7320-484b-8c20-78b2de3e89f1" status: 200 len: 1308 microversion: 2.1 time: 0.441426 Aug 10 22:59:29.883101 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 465/903] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:59:29 2022] GET /compute/v2.1/servers/f3722f40-7320-484b-8c20-78b2de3e89f1 => generated 1308 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:59:29.912882 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-a3deaadf-4275-4f50-bc3b-b8946f53fb31 tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:29.913751 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-a3deaadf-4275-4f50-bc3b-b8946f53fb31 tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] [instance: 99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:29.939282 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a3deaadf-4275-4f50-bc3b-b8946f53fb31 tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:29.949948 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a3deaadf-4275-4f50-bc3b-b8946f53fb31 tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:29.951829 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a3deaadf-4275-4f50-bc3b-b8946f53fb31 tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:29.957125 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a3deaadf-4275-4f50-bc3b-b8946f53fb31 tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:29.958353 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a3deaadf-4275-4f50-bc3b-b8946f53fb31 tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:29.960007 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a3deaadf-4275-4f50-bc3b-b8946f53fb31 tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:30.108231 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-aaff3323-88b9-42fd-8a97-51299b8bf718 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632904331d024d9b8e4d3660dff2cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ed0bdee3aa4013bd9219069bda558c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:59:30.118987 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-aaff3323-88b9-42fd-8a97-51299b8bf718 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] 10.222.0.58 "GET /compute/v2.1/servers/9b8271c8-f9d7-48fc-b8ad-a50e71d3cec5" status: 200 len: 1478 microversion: 2.1 time: 1.382428 Aug 10 22:59:30.123769 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 439/904] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:59:28 2022] GET /compute/v2.1/servers/9b8271c8-f9d7-48fc-b8ad-a50e71d3cec5 => generated 1478 bytes in 1388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:59:30.129895 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c0478435-b082-4713-9f0e-b4ef83540dfd tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:30.138869 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-c0478435-b082-4713-9f0e-b4ef83540dfd tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] [instance: e1deb45a-4597-4456-a1bd-54013c9484a4] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:30.150469 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c0478435-b082-4713-9f0e-b4ef83540dfd tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:30.160766 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c0478435-b082-4713-9f0e-b4ef83540dfd tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:30.161572 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c0478435-b082-4713-9f0e-b4ef83540dfd tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:30.163967 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c0478435-b082-4713-9f0e-b4ef83540dfd tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:30.164588 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c0478435-b082-4713-9f0e-b4ef83540dfd tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:30.167568 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c0478435-b082-4713-9f0e-b4ef83540dfd tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:30.290374 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.objects.instance [None req-a3deaadf-4275-4f50-bc3b-b8946f53fb31 tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Lazy-loading 'services' on Instance uuid 99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0 {{(pid=122633) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 22:59:30.332295 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-a3deaadf-4275-4f50-bc3b-b8946f53fb31 tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0" status: 200 len: 2347 microversion: 2.25 time: 0.428481 Aug 10 22:59:30.333055 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 466/905] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 22:59:29 2022] GET /compute/v2.1/servers/99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0 => generated 2347 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:59:30.343517 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-b4661248-0d91-4049-98b8-f32d2c8f55ee tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Calling method '.version_select at 0x7f847d429790>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:30.349744 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b4661248-0d91-4049-98b8-f32d2c8f55ee tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:30.350318 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b4661248-0d91-4049-98b8-f32d2c8f55ee tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:30.351588 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b4661248-0d91-4049-98b8-f32d2c8f55ee tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:30.375282 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-b4661248-0d91-4049-98b8-f32d2c8f55ee tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] 10.222.0.58 "GET /compute/v2.1/os-migrations" status: 200 len: 2757 microversion: 2.1 time: 0.041014 Aug 10 22:59:30.394744 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 467/906] 10.222.0.58 () {58 vars in 1143 bytes} [Wed Aug 10 22:59:30 2022] GET /compute/v2.1/os-migrations => generated 2757 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:59:30.394744 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-3e8a1de6-0c18-47a7-829f-37290fa3edc9 tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:30.394744 n-d-850468-14 devstack@n-api.service[122633]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 22:59:30.394744 n-d-850468-14 devstack@n-api.service[122633]: warnings.warn(msg) Aug 10 22:59:30.401870 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3e8a1de6-0c18-47a7-829f-37290fa3edc9 tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:30.402585 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3e8a1de6-0c18-47a7-829f-37290fa3edc9 tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:30.403128 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3e8a1de6-0c18-47a7-829f-37290fa3edc9 tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:30.404741 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3e8a1de6-0c18-47a7-829f-37290fa3edc9 tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:30.404741 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3e8a1de6-0c18-47a7-829f-37290fa3edc9 tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:30.410990 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3e8a1de6-0c18-47a7-829f-37290fa3edc9 tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:30.471302 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-3e8a1de6-0c18-47a7-829f-37290fa3edc9 tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] 10.222.0.58 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.085898 Aug 10 22:59:30.480103 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 468/907] 10.222.0.58 () {60 vars in 1217 bytes} [Wed Aug 10 22:59:30 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 22:59:30.484908 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-e27e62ef-371a-4c50-bd34-f470d6f174b9 tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:30.485517 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-e27e62ef-371a-4c50-bd34-f470d6f174b9 tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] [instance: 9b8271c8-f9d7-48fc-b8ad-a50e71d3cec5] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:30.507070 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e27e62ef-371a-4c50-bd34-f470d6f174b9 tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:30.507566 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e27e62ef-371a-4c50-bd34-f470d6f174b9 tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:30.507998 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e27e62ef-371a-4c50-bd34-f470d6f174b9 tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:30.508709 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e27e62ef-371a-4c50-bd34-f470d6f174b9 tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:30.519268 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e27e62ef-371a-4c50-bd34-f470d6f174b9 tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:30.519723 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e27e62ef-371a-4c50-bd34-f470d6f174b9 tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:30.562113 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-c0478435-b082-4713-9f0e-b4ef83540dfd tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e86e6a62c56248d6a7887be0ec712f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25090b10522b4936b3117dc25dd6f609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:59:30.570544 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-c0478435-b082-4713-9f0e-b4ef83540dfd tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] 10.222.0.58 "GET /compute/v2.1/servers/e1deb45a-4597-4456-a1bd-54013c9484a4" status: 200 len: 1317 microversion: 2.1 time: 0.445218 Aug 10 22:59:30.577967 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 440/908] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:59:30 2022] GET /compute/v2.1/servers/e1deb45a-4597-4456-a1bd-54013c9484a4 => generated 1317 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:59:30.587789 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-13ba8882-5563-4321-89fe-5da606fd6315 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:30.594826 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-13ba8882-5563-4321-89fe-5da606fd6315 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 1464324b-6977-4faa-8b84-370603a77429] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:30.606891 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-13ba8882-5563-4321-89fe-5da606fd6315 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:30.609348 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-13ba8882-5563-4321-89fe-5da606fd6315 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:30.613907 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-13ba8882-5563-4321-89fe-5da606fd6315 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:30.615005 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-13ba8882-5563-4321-89fe-5da606fd6315 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:30.615557 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-13ba8882-5563-4321-89fe-5da606fd6315 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:30.616060 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-13ba8882-5563-4321-89fe-5da606fd6315 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:31.003413 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-13ba8882-5563-4321-89fe-5da606fd6315 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:59:31.016547 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-13ba8882-5563-4321-89fe-5da606fd6315 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/1464324b-6977-4faa-8b84-370603a77429" status: 200 len: 1542 microversion: 2.1 time: 0.437314 Aug 10 22:59:31.031318 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 441/909] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:59:30 2022] GET /compute/v2.1/servers/1464324b-6977-4faa-8b84-370603a77429 => generated 1542 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:59:31.062979 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-384af99a-2795-4541-896f-9d3e9525a9a5 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:31.067769 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-384af99a-2795-4541-896f-9d3e9525a9a5 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] [instance: f3722f40-7320-484b-8c20-78b2de3e89f1] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:31.080744 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-384af99a-2795-4541-896f-9d3e9525a9a5 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:31.084321 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-384af99a-2795-4541-896f-9d3e9525a9a5 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:31.084540 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-384af99a-2795-4541-896f-9d3e9525a9a5 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:31.093062 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-384af99a-2795-4541-896f-9d3e9525a9a5 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:31.093729 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-384af99a-2795-4541-896f-9d3e9525a9a5 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:31.094170 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-384af99a-2795-4541-896f-9d3e9525a9a5 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:31.406750 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-e27e62ef-371a-4c50-bd34-f470d6f174b9 tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/9b8271c8-f9d7-48fc-b8ad-a50e71d3cec5" status: 200 len: 1631 microversion: 2.1 time: 0.925337 Aug 10 22:59:31.407346 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 469/910] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:59:30 2022] GET /compute/v2.1/servers/9b8271c8-f9d7-48fc-b8ad-a50e71d3cec5 => generated 1631 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:59:31.439713 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-2fcb9cee-342d-4fa3-b26e-bd9c12357420 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Action: 'create', calling method: .version_select at 0x7f847d44e310>, body: {"keypair": {"name": "tempest-keypair-480888818", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMiUj6l740keMsVcHxvDaO+gwQ4mwscsU5bvAJ3Je9AfpLGw089dJbbRyZ0M2g352r2WTeuHk8Ddmbzs0w6MVMYP12D2peVEcG58lf5nFiSioVpL76POOmNkdc2+yxbRYA=="}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:59:31.472816 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-384af99a-2795-4541-896f-9d3e9525a9a5 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6d9806b6724e5aaf8c69be8e70d4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307ab95daa034afbb31f90626885072b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:59:31.488996 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-384af99a-2795-4541-896f-9d3e9525a9a5 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] 10.222.0.58 "GET /compute/v2.1/servers/f3722f40-7320-484b-8c20-78b2de3e89f1" status: 200 len: 1308 microversion: 2.1 time: 0.455536 Aug 10 22:59:31.489608 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 442/911] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:59:31 2022] GET /compute/v2.1/servers/f3722f40-7320-484b-8c20-78b2de3e89f1 => generated 1308 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:59:31.495311 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-2fcb9cee-342d-4fa3-b26e-bd9c12357420 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Getting quotas for project 56ed0bdee3aa4013bd9219069bda558c. Resources: {'key_pairs'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 22:59:31.512313 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-2fcb9cee-342d-4fa3-b26e-bd9c12357420 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Getting quotas for user 632904331d024d9b8e4d3660dff2cdf3 and project 56ed0bdee3aa4013bd9219069bda558c. Resources: {'key_pairs'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 22:59:31.575693 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-2fcb9cee-342d-4fa3-b26e-bd9c12357420 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.140491 Aug 10 22:59:31.583135 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 470/912] 10.222.0.58 () {60 vars in 1159 bytes} [Wed Aug 10 22:59:31 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 22:59:31.602616 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-85f3313d-2844-41c7-b382-18f13aa01565 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:31.603625 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-85f3313d-2844-41c7-b382-18f13aa01565 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] [instance: e1deb45a-4597-4456-a1bd-54013c9484a4] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:31.610962 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-85f3313d-2844-41c7-b382-18f13aa01565 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:31.611803 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-85f3313d-2844-41c7-b382-18f13aa01565 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:31.614148 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-85f3313d-2844-41c7-b382-18f13aa01565 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:31.615695 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-85f3313d-2844-41c7-b382-18f13aa01565 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:31.616385 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-85f3313d-2844-41c7-b382-18f13aa01565 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:31.617237 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-85f3313d-2844-41c7-b382-18f13aa01565 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:31.957325 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-85f3313d-2844-41c7-b382-18f13aa01565 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e86e6a62c56248d6a7887be0ec712f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25090b10522b4936b3117dc25dd6f609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:59:31.969765 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-85f3313d-2844-41c7-b382-18f13aa01565 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] 10.222.0.58 "GET /compute/v2.1/servers/e1deb45a-4597-4456-a1bd-54013c9484a4" status: 200 len: 1317 microversion: 2.1 time: 0.373674 Aug 10 22:59:31.970369 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 443/913] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:59:31 2022] GET /compute/v2.1/servers/e1deb45a-4597-4456-a1bd-54013c9484a4 => generated 1317 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:59:32.038031 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-cc44ff85-9cfe-470f-a048-e9b8be832bce tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:32.039513 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-cc44ff85-9cfe-470f-a048-e9b8be832bce tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 1464324b-6977-4faa-8b84-370603a77429] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:32.057075 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cc44ff85-9cfe-470f-a048-e9b8be832bce tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:32.059072 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cc44ff85-9cfe-470f-a048-e9b8be832bce tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:32.059866 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cc44ff85-9cfe-470f-a048-e9b8be832bce tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:32.063565 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cc44ff85-9cfe-470f-a048-e9b8be832bce tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:32.064964 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cc44ff85-9cfe-470f-a048-e9b8be832bce tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:32.066843 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cc44ff85-9cfe-470f-a048-e9b8be832bce tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:32.511013 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-36ce88c1-d981-4495-98d9-34408f63993a tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:32.511637 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-36ce88c1-d981-4495-98d9-34408f63993a tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] [instance: f3722f40-7320-484b-8c20-78b2de3e89f1] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:32.511808 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-cc44ff85-9cfe-470f-a048-e9b8be832bce tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:59:32.525442 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:DELETE=3 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:59:32.527767 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-36ce88c1-d981-4495-98d9-34408f63993a tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:32.528019 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-cc44ff85-9cfe-470f-a048-e9b8be832bce tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/1464324b-6977-4faa-8b84-370603a77429" status: 200 len: 1542 microversion: 2.1 time: 0.494087 Aug 10 22:59:32.528722 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 471/914] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:59:32 2022] GET /compute/v2.1/servers/1464324b-6977-4faa-8b84-370603a77429 => generated 1542 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:59:32.532000 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-36ce88c1-d981-4495-98d9-34408f63993a tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:32.533426 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-36ce88c1-d981-4495-98d9-34408f63993a tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:32.537563 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-36ce88c1-d981-4495-98d9-34408f63993a tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:32.539618 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-36ce88c1-d981-4495-98d9-34408f63993a tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:32.541254 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-36ce88c1-d981-4495-98d9-34408f63993a tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:32.884811 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-36ce88c1-d981-4495-98d9-34408f63993a tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6d9806b6724e5aaf8c69be8e70d4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307ab95daa034afbb31f90626885072b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:59:32.897813 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-36ce88c1-d981-4495-98d9-34408f63993a tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] 10.222.0.58 "GET /compute/v2.1/servers/f3722f40-7320-484b-8c20-78b2de3e89f1" status: 200 len: 1308 microversion: 2.1 time: 0.390538 Aug 10 22:59:32.911915 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 444/915] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:59:32 2022] GET /compute/v2.1/servers/f3722f40-7320-484b-8c20-78b2de3e89f1 => generated 1308 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:59:32.992579 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-9655718b-e81d-4a0e-9633-dea04edf7d8f tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:32.993127 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-9655718b-e81d-4a0e-9633-dea04edf7d8f tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] [instance: e1deb45a-4597-4456-a1bd-54013c9484a4] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:33.006772 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9655718b-e81d-4a0e-9633-dea04edf7d8f tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:33.011733 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9655718b-e81d-4a0e-9633-dea04edf7d8f tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:33.012164 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9655718b-e81d-4a0e-9633-dea04edf7d8f tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:33.012912 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9655718b-e81d-4a0e-9633-dea04edf7d8f tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:33.013370 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9655718b-e81d-4a0e-9633-dea04edf7d8f tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:33.013789 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9655718b-e81d-4a0e-9633-dea04edf7d8f tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:33.256921 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-298f6e92-ca82-4b74-a12a-0146b1f615aa tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:33.259900 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-298f6e92-ca82-4b74-a12a-0146b1f615aa tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] [instance: 7599a318-7a19-4f4a-bbb6-162f7a207060] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:33.271789 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-298f6e92-ca82-4b74-a12a-0146b1f615aa tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:33.275423 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-298f6e92-ca82-4b74-a12a-0146b1f615aa tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:33.276651 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-298f6e92-ca82-4b74-a12a-0146b1f615aa tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:33.278136 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-298f6e92-ca82-4b74-a12a-0146b1f615aa tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:33.280410 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-298f6e92-ca82-4b74-a12a-0146b1f615aa tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:33.283851 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-298f6e92-ca82-4b74-a12a-0146b1f615aa tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:33.394286 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-298f6e92-ca82-4b74-a12a-0146b1f615aa tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] 10.222.0.58 "GET /compute/v2.1/servers/7599a318-7a19-4f4a-bbb6-162f7a207060/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.139107 Aug 10 22:59:33.397014 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 445/916] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 10 22:59:33 2022] GET /compute/v2.1/servers/7599a318-7a19-4f4a-bbb6-162f7a207060/os-volume_attachments => generated 25 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 22:59:33.409303 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-829205bb-e752-4aca-be93-2e80258c780e req-d9424ab5-328c-47a9-85d5-8404fa24c383 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3722f40-7320-484b-8c20-78b2de3e89f1", "name": "network-vif-plugged", "status": "completed", "tag": "3cd54803-1880-47e0-b27e-07883f5c80f2"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:59:33.439671 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-829205bb-e752-4aca-be93-2e80258c780e req-d9424ab5-328c-47a9-85d5-8404fa24c383 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:33.440147 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-829205bb-e752-4aca-be93-2e80258c780e req-d9424ab5-328c-47a9-85d5-8404fa24c383 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:33.442479 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-829205bb-e752-4aca-be93-2e80258c780e req-d9424ab5-328c-47a9-85d5-8404fa24c383 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:33.465509 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-829205bb-e752-4aca-be93-2e80258c780e req-d9424ab5-328c-47a9-85d5-8404fa24c383 service nova] Creating event network-vif-plugged:3cd54803-1880-47e0-b27e-07883f5c80f2 for instance f3722f40-7320-484b-8c20-78b2de3e89f1 on n-h2-850468-14 Aug 10 22:59:33.476053 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-829205bb-e752-4aca-be93-2e80258c780e req-d9424ab5-328c-47a9-85d5-8404fa24c383 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069715 Aug 10 22:59:33.477261 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 446/917] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 22:59:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:59:33.555343 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-2c9530e0-bd6d-429f-9b5b-9741b0a30993 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:33.556049 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-2c9530e0-bd6d-429f-9b5b-9741b0a30993 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 1464324b-6977-4faa-8b84-370603a77429] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:33.579419 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2c9530e0-bd6d-429f-9b5b-9741b0a30993 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:33.580039 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2c9530e0-bd6d-429f-9b5b-9741b0a30993 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:33.580492 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2c9530e0-bd6d-429f-9b5b-9741b0a30993 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:33.585816 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2c9530e0-bd6d-429f-9b5b-9741b0a30993 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:33.586442 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2c9530e0-bd6d-429f-9b5b-9741b0a30993 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:33.586736 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2c9530e0-bd6d-429f-9b5b-9741b0a30993 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:33.917401 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-9655718b-e81d-4a0e-9633-dea04edf7d8f tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e86e6a62c56248d6a7887be0ec712f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25090b10522b4936b3117dc25dd6f609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:59:33.928401 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-9655718b-e81d-4a0e-9633-dea04edf7d8f tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] 10.222.0.58 "GET /compute/v2.1/servers/e1deb45a-4597-4456-a1bd-54013c9484a4" status: 200 len: 1317 microversion: 2.1 time: 0.940903 Aug 10 22:59:33.933593 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 472/918] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:59:32 2022] GET /compute/v2.1/servers/e1deb45a-4597-4456-a1bd-54013c9484a4 => generated 1317 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:59:33.947951 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-6817bdcf-6cc1-4011-854b-c63d600332e6 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:33.957584 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-6817bdcf-6cc1-4011-854b-c63d600332e6 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] [instance: f3722f40-7320-484b-8c20-78b2de3e89f1] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:33.995012 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6817bdcf-6cc1-4011-854b-c63d600332e6 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:33.995502 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6817bdcf-6cc1-4011-854b-c63d600332e6 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:33.995946 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6817bdcf-6cc1-4011-854b-c63d600332e6 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:33.996653 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6817bdcf-6cc1-4011-854b-c63d600332e6 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:33.997107 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6817bdcf-6cc1-4011-854b-c63d600332e6 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:33.997531 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6817bdcf-6cc1-4011-854b-c63d600332e6 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:34.258559 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-2c9530e0-bd6d-429f-9b5b-9741b0a30993 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:59:34.279358 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-2c9530e0-bd6d-429f-9b5b-9741b0a30993 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/1464324b-6977-4faa-8b84-370603a77429" status: 200 len: 1542 microversion: 2.1 time: 0.732061 Aug 10 22:59:34.286667 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 447/919] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:59:33 2022] GET /compute/v2.1/servers/1464324b-6977-4faa-8b84-370603a77429 => generated 1542 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:59:34.308050 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-ebda7954-0460-4dec-8e04-9a79840dc46f tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:34.312306 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-ebda7954-0460-4dec-8e04-9a79840dc46f tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] [instance: 7599a318-7a19-4f4a-bbb6-162f7a207060] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:34.334317 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ebda7954-0460-4dec-8e04-9a79840dc46f tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:34.337235 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ebda7954-0460-4dec-8e04-9a79840dc46f tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:34.339273 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ebda7954-0460-4dec-8e04-9a79840dc46f tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:34.340198 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ebda7954-0460-4dec-8e04-9a79840dc46f tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:34.342324 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ebda7954-0460-4dec-8e04-9a79840dc46f tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:34.343146 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ebda7954-0460-4dec-8e04-9a79840dc46f tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:34.428586 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-ebda7954-0460-4dec-8e04-9a79840dc46f tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] 10.222.0.58 "GET /compute/v2.1/servers/7599a318-7a19-4f4a-bbb6-162f7a207060/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.140466 Aug 10 22:59:34.430143 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 448/920] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 10 22:59:34 2022] GET /compute/v2.1/servers/7599a318-7a19-4f4a-bbb6-162f7a207060/os-volume_attachments => generated 25 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 22:59:34.460893 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-6817bdcf-6cc1-4011-854b-c63d600332e6 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6d9806b6724e5aaf8c69be8e70d4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307ab95daa034afbb31f90626885072b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:59:34.474827 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-6817bdcf-6cc1-4011-854b-c63d600332e6 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] 10.222.0.58 "GET /compute/v2.1/servers/f3722f40-7320-484b-8c20-78b2de3e89f1" status: 200 len: 1308 microversion: 2.1 time: 0.540021 Aug 10 22:59:34.475673 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 473/921] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:59:33 2022] GET /compute/v2.1/servers/f3722f40-7320-484b-8c20-78b2de3e89f1 => generated 1308 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:59:34.610290 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-fbb6ee56-5d1c-4fac-9bb4-fd486930ff0a tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1038616464", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452", "networks": [{"uuid": "cf6262ce-5add-4f6f-96db-0c1b276bc5f7"}], "security_groups": [{"name": "tempest-securitygroup--1543259861"}], "key_name": "tempest-keypair-480888818", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:59:34.669547 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-de4dd4b9-487a-477c-a361-4384f0a7293b tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:34.670070 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-de4dd4b9-487a-477c-a361-4384f0a7293b tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] [instance: 7599a318-7a19-4f4a-bbb6-162f7a207060] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:34.680603 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-de4dd4b9-487a-477c-a361-4384f0a7293b tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:34.683569 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-de4dd4b9-487a-477c-a361-4384f0a7293b tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:34.684253 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-de4dd4b9-487a-477c-a361-4384f0a7293b tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:34.685164 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-de4dd4b9-487a-477c-a361-4384f0a7293b tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:34.687402 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-de4dd4b9-487a-477c-a361-4384f0a7293b tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:34.688068 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-de4dd4b9-487a-477c-a361-4384f0a7293b tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:34.750259 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-de4dd4b9-487a-477c-a361-4384f0a7293b tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] [instance: 7599a318-7a19-4f4a-bbb6-162f7a207060] Going to try to terminate instance {{(pid=122633) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 22:59:34.839386 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.network.neutron [None req-fbb6ee56-5d1c-4fac-9bb4-fd486930ff0a tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] validate_networks() for [('cf6262ce-5add-4f6f-96db-0c1b276bc5f7', None, None, None, None, None)] {{(pid=122632) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 22:59:34.920097 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-de4dd4b9-487a-477c-a361-4384f0a7293b tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] 10.222.0.58 "DELETE /compute/v2.1/servers/7599a318-7a19-4f4a-bbb6-162f7a207060" status: 204 len: 0 microversion: 2.1 time: 0.255329 Aug 10 22:59:34.920835 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 474/922] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 22:59:34 2022] DELETE /compute/v2.1/servers/7599a318-7a19-4f4a-bbb6-162f7a207060 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 10 22:59:34.936252 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-bf541a74-78f0-493c-a34d-8a3759273d07 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:34.936870 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-bf541a74-78f0-493c-a34d-8a3759273d07 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] [instance: 7599a318-7a19-4f4a-bbb6-162f7a207060] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:34.949807 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bf541a74-78f0-493c-a34d-8a3759273d07 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:34.950298 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bf541a74-78f0-493c-a34d-8a3759273d07 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:34.950746 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bf541a74-78f0-493c-a34d-8a3759273d07 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:34.951467 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bf541a74-78f0-493c-a34d-8a3759273d07 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:34.951915 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bf541a74-78f0-493c-a34d-8a3759273d07 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:34.959195 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bf541a74-78f0-493c-a34d-8a3759273d07 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:35.457226 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-bf541a74-78f0-493c-a34d-8a3759273d07 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0415b5bdb48249d6b9f1ef7c92aad597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29083d61c29b43b4b47539a141b3d1fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:59:35.489364 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-bf541a74-78f0-493c-a34d-8a3759273d07 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] 10.222.0.58 "GET /compute/v2.1/servers/7599a318-7a19-4f4a-bbb6-162f7a207060" status: 200 len: 1681 microversion: 2.1 time: 0.561565 Aug 10 22:59:35.489974 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 475/923] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:59:34 2022] GET /compute/v2.1/servers/7599a318-7a19-4f4a-bbb6-162f7a207060 => generated 1681 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:59:35.505623 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-1e513a31-7194-45e0-9f2a-e4b462a87bc9 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:35.518093 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-1e513a31-7194-45e0-9f2a-e4b462a87bc9 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] [instance: e1deb45a-4597-4456-a1bd-54013c9484a4] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:35.537395 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1e513a31-7194-45e0-9f2a-e4b462a87bc9 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:35.538258 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1e513a31-7194-45e0-9f2a-e4b462a87bc9 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:35.538970 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1e513a31-7194-45e0-9f2a-e4b462a87bc9 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:35.540059 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1e513a31-7194-45e0-9f2a-e4b462a87bc9 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:35.540789 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1e513a31-7194-45e0-9f2a-e4b462a87bc9 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:35.548713 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1e513a31-7194-45e0-9f2a-e4b462a87bc9 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:35.759830 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-fbb6ee56-5d1c-4fac-9bb4-fd486930ff0a tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Flavor limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 22:59:35.761939 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-fbb6ee56-5d1c-4fac-9bb4-fd486930ff0a tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Image limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 22:59:35.762632 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-fbb6ee56-5d1c-4fac-9bb4-fd486930ff0a tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Flavor pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 22:59:35.763253 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-fbb6ee56-5d1c-4fac-9bb4-fd486930ff0a tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Image pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 22:59:35.763836 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-fbb6ee56-5d1c-4fac-9bb4-fd486930ff0a tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 22:59:35.786303 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fbb6ee56-5d1c-4fac-9bb4-fd486930ff0a tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:35.789010 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fbb6ee56-5d1c-4fac-9bb4-fd486930ff0a tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:35.789656 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fbb6ee56-5d1c-4fac-9bb4-fd486930ff0a tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:35.792273 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fbb6ee56-5d1c-4fac-9bb4-fd486930ff0a tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:35.794755 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fbb6ee56-5d1c-4fac-9bb4-fd486930ff0a tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:35.795404 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fbb6ee56-5d1c-4fac-9bb4-fd486930ff0a tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:35.840235 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-fbb6ee56-5d1c-4fac-9bb4-fd486930ff0a tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Getting quotas for project 56ed0bdee3aa4013bd9219069bda558c. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 22:59:35.856413 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-fbb6ee56-5d1c-4fac-9bb4-fd486930ff0a tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Getting quotas for user 632904331d024d9b8e4d3660dff2cdf3 and project 56ed0bdee3aa4013bd9219069bda558c. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 22:59:35.874423 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-fbb6ee56-5d1c-4fac-9bb4-fd486930ff0a tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Going to run 1 instances... {{(pid=122632) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 22:59:35.880076 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-fbb6ee56-5d1c-4fac-9bb4-fd486930ff0a tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] [instance: 8e91f1ac-f79d-4ab0-aa13-ea32b0e74888] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78ad8905-f66f-4733-8be9-2b260f1fabed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122632) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 22:59:35.956121 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-fbb6ee56-5d1c-4fac-9bb4-fd486930ff0a tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.350651 Aug 10 22:59:35.957471 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 449/924] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 22:59:34 2022] POST /compute/v2.1/servers => generated 406 bytes in 1353 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 22:59:35.962691 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-bdddb6b7-bec8-4fe0-9653-6d273003a9f9 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:35.963980 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-bdddb6b7-bec8-4fe0-9653-6d273003a9f9 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 1464324b-6977-4faa-8b84-370603a77429] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:35.972170 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bdddb6b7-bec8-4fe0-9653-6d273003a9f9 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:35.972981 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bdddb6b7-bec8-4fe0-9653-6d273003a9f9 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:35.973973 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bdddb6b7-bec8-4fe0-9653-6d273003a9f9 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:35.975827 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bdddb6b7-bec8-4fe0-9653-6d273003a9f9 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:35.976592 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bdddb6b7-bec8-4fe0-9653-6d273003a9f9 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:35.977560 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bdddb6b7-bec8-4fe0-9653-6d273003a9f9 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:36.207140 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-bdddb6b7-bec8-4fe0-9653-6d273003a9f9 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:59:36.219892 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-bdddb6b7-bec8-4fe0-9653-6d273003a9f9 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/1464324b-6977-4faa-8b84-370603a77429" status: 200 len: 1542 microversion: 2.1 time: 0.260108 Aug 10 22:59:36.220513 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 450/925] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:59:35 2022] GET /compute/v2.1/servers/1464324b-6977-4faa-8b84-370603a77429 => generated 1542 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:59:36.243021 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-82e2c756-3bca-4fac-a26a-49d798a90188 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:36.243811 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-82e2c756-3bca-4fac-a26a-49d798a90188 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] [instance: f3722f40-7320-484b-8c20-78b2de3e89f1] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:36.263896 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-82e2c756-3bca-4fac-a26a-49d798a90188 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:36.263896 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-82e2c756-3bca-4fac-a26a-49d798a90188 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:36.263896 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-82e2c756-3bca-4fac-a26a-49d798a90188 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:36.267169 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-82e2c756-3bca-4fac-a26a-49d798a90188 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:36.267770 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-82e2c756-3bca-4fac-a26a-49d798a90188 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:36.268368 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-82e2c756-3bca-4fac-a26a-49d798a90188 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:36.439305 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-1e513a31-7194-45e0-9f2a-e4b462a87bc9 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e86e6a62c56248d6a7887be0ec712f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25090b10522b4936b3117dc25dd6f609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:59:36.450485 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-1e513a31-7194-45e0-9f2a-e4b462a87bc9 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] 10.222.0.58 "GET /compute/v2.1/servers/e1deb45a-4597-4456-a1bd-54013c9484a4" status: 200 len: 1317 microversion: 2.1 time: 0.951144 Aug 10 22:59:36.451276 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 476/926] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:59:35 2022] GET /compute/v2.1/servers/e1deb45a-4597-4456-a1bd-54013c9484a4 => generated 1317 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:59:36.458985 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-21499ac0-d91b-421d-8663-ee0aba488097 req-219c4000-1e19-43ce-8377-73bcf374f13f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d716cac6-ac7c-4b98-b6ea-2496ccd62096", "name": "network-vif-plugged", "status": "completed", "tag": "30ea23cf-a364-4798-a6be-6ab46d11599e"}, {"server_uuid": "e1deb45a-4597-4456-a1bd-54013c9484a4", "name": "network-vif-plugged", "status": "completed", "tag": "c23c9196-ec43-4cc3-a250-0ae9f5c58948"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:59:36.492649 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-21499ac0-d91b-421d-8663-ee0aba488097 req-219c4000-1e19-43ce-8377-73bcf374f13f service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:36.493387 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-21499ac0-d91b-421d-8663-ee0aba488097 req-219c4000-1e19-43ce-8377-73bcf374f13f service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:36.494932 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-21499ac0-d91b-421d-8663-ee0aba488097 req-219c4000-1e19-43ce-8377-73bcf374f13f service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:36.538452 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-21499ac0-d91b-421d-8663-ee0aba488097 req-219c4000-1e19-43ce-8377-73bcf374f13f service nova] Creating event network-vif-plugged:30ea23cf-a364-4798-a6be-6ab46d11599e for instance d716cac6-ac7c-4b98-b6ea-2496ccd62096 on n-h2-850468-14 Aug 10 22:59:36.539448 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-21499ac0-d91b-421d-8663-ee0aba488097 req-219c4000-1e19-43ce-8377-73bcf374f13f service nova] Creating event network-vif-plugged:c23c9196-ec43-4cc3-a250-0ae9f5c58948 for instance e1deb45a-4597-4456-a1bd-54013c9484a4 on n-h1-850468-14 Aug 10 22:59:36.557118 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-21499ac0-d91b-421d-8663-ee0aba488097 req-219c4000-1e19-43ce-8377-73bcf374f13f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.102172 Aug 10 22:59:36.558454 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-82e2c756-3bca-4fac-a26a-49d798a90188 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6d9806b6724e5aaf8c69be8e70d4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307ab95daa034afbb31f90626885072b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:59:36.561633 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 477/927] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 22:59:36 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:59:36.575810 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-ee4ef484-b375-4c39-b6c1-fde071b72ea1 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:36.576850 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-ee4ef484-b375-4c39-b6c1-fde071b72ea1 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] [instance: 8e91f1ac-f79d-4ab0-aa13-ea32b0e74888] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:36.582361 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-82e2c756-3bca-4fac-a26a-49d798a90188 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] 10.222.0.58 "GET /compute/v2.1/servers/f3722f40-7320-484b-8c20-78b2de3e89f1" status: 200 len: 1488 microversion: 2.1 time: 0.345292 Aug 10 22:59:36.587268 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 451/928] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:59:36 2022] GET /compute/v2.1/servers/f3722f40-7320-484b-8c20-78b2de3e89f1 => generated 1488 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:59:36.606312 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-45516cc3-991f-412b-8546-94fb3e162c4b tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "33d528e4-0ee2-4b94-90c3-69929299119e", "device": "/dev/xvdb"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:59:36.609530 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-45516cc3-991f-412b-8546-94fb3e162c4b tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] [instance: 99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:36.639568 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-45516cc3-991f-412b-8546-94fb3e162c4b tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:36.641222 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-45516cc3-991f-412b-8546-94fb3e162c4b tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:36.644204 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-45516cc3-991f-412b-8546-94fb3e162c4b tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:36.645287 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-45516cc3-991f-412b-8546-94fb3e162c4b tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:36.646389 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-45516cc3-991f-412b-8546-94fb3e162c4b tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:36.647430 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-45516cc3-991f-412b-8546-94fb3e162c4b tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:36.713132 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-ee4ef484-b375-4c39-b6c1-fde071b72ea1 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632904331d024d9b8e4d3660dff2cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ed0bdee3aa4013bd9219069bda558c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:59:36.723877 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-ee4ef484-b375-4c39-b6c1-fde071b72ea1 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] 10.222.0.58 "GET /compute/v2.1/servers/8e91f1ac-f79d-4ab0-aa13-ea32b0e74888" status: 200 len: 1234 microversion: 2.1 time: 0.160801 Aug 10 22:59:36.724765 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 478/929] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:59:36 2022] GET /compute/v2.1/servers/8e91f1ac-f79d-4ab0-aa13-ea32b0e74888 => generated 1234 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:59:36.732948 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-7cff8a28-fb25-4f8d-8ca1-1b8cc0d57607 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:36.733985 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-7cff8a28-fb25-4f8d-8ca1-1b8cc0d57607 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] [instance: 7599a318-7a19-4f4a-bbb6-162f7a207060] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:36.753899 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7cff8a28-fb25-4f8d-8ca1-1b8cc0d57607 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:36.754747 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7cff8a28-fb25-4f8d-8ca1-1b8cc0d57607 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:36.755543 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7cff8a28-fb25-4f8d-8ca1-1b8cc0d57607 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:36.757825 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7cff8a28-fb25-4f8d-8ca1-1b8cc0d57607 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:36.774882 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7cff8a28-fb25-4f8d-8ca1-1b8cc0d57607 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:36.775541 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7cff8a28-fb25-4f8d-8ca1-1b8cc0d57607 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:37.175497 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-7cff8a28-fb25-4f8d-8ca1-1b8cc0d57607 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0415b5bdb48249d6b9f1ef7c92aad597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29083d61c29b43b4b47539a141b3d1fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:59:37.189960 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-7cff8a28-fb25-4f8d-8ca1-1b8cc0d57607 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] 10.222.0.58 "GET /compute/v2.1/servers/7599a318-7a19-4f4a-bbb6-162f7a207060" status: 200 len: 1681 microversion: 2.1 time: 0.463900 Aug 10 22:59:37.193573 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 479/930] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:59:36 2022] GET /compute/v2.1/servers/7599a318-7a19-4f4a-bbb6-162f7a207060 => generated 1681 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:59:37.207605 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-13bd3984-a928-41de-9f7a-092405f52289 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:59:37.217715 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-13bd3984-a928-41de-9f7a-092405f52289 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:37.220728 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-13bd3984-a928-41de-9f7a-092405f52289 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:37.225460 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-13bd3984-a928-41de-9f7a-092405f52289 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:37.374182 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-13bd3984-a928-41de-9f7a-092405f52289 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] [instance: f3722f40-7320-484b-8c20-78b2de3e89f1] Going to try to stop instance {{(pid=122633) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 10 22:59:37.377178 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-45516cc3-991f-412b-8546-94fb3e162c4b tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] 10.222.0.58 "POST /compute/v2.1/servers/99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 0.784447 Aug 10 22:59:37.391841 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 452/931] 10.222.0.58 () {62 vars in 1364 bytes} [Wed Aug 10 22:59:36 2022] POST /compute/v2.1/servers/99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0/os-volume_attachments => generated 194 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 22:59:37.414766 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-d420a7b8-59c1-466d-b684-d61cf83d924d tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:37.415962 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-d420a7b8-59c1-466d-b684-d61cf83d924d tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 1464324b-6977-4faa-8b84-370603a77429] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:37.425700 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d420a7b8-59c1-466d-b684-d61cf83d924d tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:37.428165 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d420a7b8-59c1-466d-b684-d61cf83d924d tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:37.431079 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d420a7b8-59c1-466d-b684-d61cf83d924d tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:37.433992 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d420a7b8-59c1-466d-b684-d61cf83d924d tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:37.436607 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d420a7b8-59c1-466d-b684-d61cf83d924d tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:37.437420 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d420a7b8-59c1-466d-b684-d61cf83d924d tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:37.461766 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-13bd3984-a928-41de-9f7a-092405f52289 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] 10.222.0.58 "POST /compute/v2.1/servers/f3722f40-7320-484b-8c20-78b2de3e89f1/action" status: 202 len: 0 microversion: 2.1 time: 0.263406 Aug 10 22:59:37.462623 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 480/932] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 22:59:37 2022] POST /compute/v2.1/servers/f3722f40-7320-484b-8c20-78b2de3e89f1/action => generated 0 bytes in 265 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 22:59:37.476720 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-42183505-1589-4ba4-8890-b75c003e430e tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:37.481408 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-42183505-1589-4ba4-8890-b75c003e430e tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] [instance: f3722f40-7320-484b-8c20-78b2de3e89f1] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:37.495923 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-42183505-1589-4ba4-8890-b75c003e430e tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:37.496416 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-42183505-1589-4ba4-8890-b75c003e430e tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:37.496848 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-42183505-1589-4ba4-8890-b75c003e430e tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:37.497548 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-42183505-1589-4ba4-8890-b75c003e430e tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:37.497993 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-42183505-1589-4ba4-8890-b75c003e430e tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:37.498411 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-42183505-1589-4ba4-8890-b75c003e430e tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:37.830332 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-d420a7b8-59c1-466d-b684-d61cf83d924d tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:59:37.840756 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-d420a7b8-59c1-466d-b684-d61cf83d924d tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/1464324b-6977-4faa-8b84-370603a77429" status: 200 len: 1542 microversion: 2.1 time: 0.436339 Aug 10 22:59:37.841364 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 453/933] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:59:37 2022] GET /compute/v2.1/servers/1464324b-6977-4faa-8b84-370603a77429 => generated 1542 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:59:37.876810 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-857d6bb0-d00c-462d-bacb-c0b069606f63 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:37.877463 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-857d6bb0-d00c-462d-bacb-c0b069606f63 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] [instance: e1deb45a-4597-4456-a1bd-54013c9484a4] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:37.892943 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-857d6bb0-d00c-462d-bacb-c0b069606f63 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:37.895059 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-857d6bb0-d00c-462d-bacb-c0b069606f63 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:37.895602 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-857d6bb0-d00c-462d-bacb-c0b069606f63 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:37.896365 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-857d6bb0-d00c-462d-bacb-c0b069606f63 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:37.897832 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-857d6bb0-d00c-462d-bacb-c0b069606f63 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:37.897832 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-857d6bb0-d00c-462d-bacb-c0b069606f63 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:37.910334 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:59:38.040580 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-42183505-1589-4ba4-8890-b75c003e430e tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6d9806b6724e5aaf8c69be8e70d4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307ab95daa034afbb31f90626885072b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:59:38.074210 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-42183505-1589-4ba4-8890-b75c003e430e tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] 10.222.0.58 "GET /compute/v2.1/servers/f3722f40-7320-484b-8c20-78b2de3e89f1" status: 200 len: 1498 microversion: 2.1 time: 0.594110 Aug 10 22:59:38.077187 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 481/934] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:59:37 2022] GET /compute/v2.1/servers/f3722f40-7320-484b-8c20-78b2de3e89f1 => generated 1498 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:59:38.094822 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-f752c57c-d99a-431f-9c9b-ec2cfd6f9a5d tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:38.101012 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-f752c57c-d99a-431f-9c9b-ec2cfd6f9a5d tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] [instance: 8e91f1ac-f79d-4ab0-aa13-ea32b0e74888] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:38.124123 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f752c57c-d99a-431f-9c9b-ec2cfd6f9a5d tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:38.125684 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f752c57c-d99a-431f-9c9b-ec2cfd6f9a5d tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:38.127194 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f752c57c-d99a-431f-9c9b-ec2cfd6f9a5d tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:38.128372 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f752c57c-d99a-431f-9c9b-ec2cfd6f9a5d tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:38.134287 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f752c57c-d99a-431f-9c9b-ec2cfd6f9a5d tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:38.135088 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f752c57c-d99a-431f-9c9b-ec2cfd6f9a5d tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:38.178372 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:59:38.328522 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-f752c57c-d99a-431f-9c9b-ec2cfd6f9a5d tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632904331d024d9b8e4d3660dff2cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ed0bdee3aa4013bd9219069bda558c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:59:38.337266 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-f752c57c-d99a-431f-9c9b-ec2cfd6f9a5d tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] 10.222.0.58 "GET /compute/v2.1/servers/8e91f1ac-f79d-4ab0-aa13-ea32b0e74888" status: 200 len: 1286 microversion: 2.1 time: 0.258740 Aug 10 22:59:38.341732 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 482/935] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:59:38 2022] GET /compute/v2.1/servers/8e91f1ac-f79d-4ab0-aa13-ea32b0e74888 => generated 1286 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:59:38.350834 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-aefc81eb-42b4-4432-8eae-b0df125757aa tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:38.358569 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-aefc81eb-42b4-4432-8eae-b0df125757aa tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] [instance: 7599a318-7a19-4f4a-bbb6-162f7a207060] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:38.369558 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-aefc81eb-42b4-4432-8eae-b0df125757aa tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:38.373777 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-aefc81eb-42b4-4432-8eae-b0df125757aa tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:38.376245 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-aefc81eb-42b4-4432-8eae-b0df125757aa tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:38.377895 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-aefc81eb-42b4-4432-8eae-b0df125757aa tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:38.378555 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-aefc81eb-42b4-4432-8eae-b0df125757aa tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:38.381882 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-aefc81eb-42b4-4432-8eae-b0df125757aa tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:38.514527 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-857d6bb0-d00c-462d-bacb-c0b069606f63 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e86e6a62c56248d6a7887be0ec712f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25090b10522b4936b3117dc25dd6f609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:59:38.530414 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-857d6bb0-d00c-462d-bacb-c0b069606f63 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] 10.222.0.58 "GET /compute/v2.1/servers/e1deb45a-4597-4456-a1bd-54013c9484a4" status: 200 len: 1317 microversion: 2.1 time: 0.687833 Aug 10 22:59:38.531395 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 454/936] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:59:37 2022] GET /compute/v2.1/servers/e1deb45a-4597-4456-a1bd-54013c9484a4 => generated 1317 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:59:38.583359 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-aefc81eb-42b4-4432-8eae-b0df125757aa tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0415b5bdb48249d6b9f1ef7c92aad597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29083d61c29b43b4b47539a141b3d1fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:59:38.591408 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-aefc81eb-42b4-4432-8eae-b0df125757aa tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] 10.222.0.58 "GET /compute/v2.1/servers/7599a318-7a19-4f4a-bbb6-162f7a207060" status: 200 len: 1613 microversion: 2.1 time: 0.248141 Aug 10 22:59:38.601187 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 483/937] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:59:38 2022] GET /compute/v2.1/servers/7599a318-7a19-4f4a-bbb6-162f7a207060 => generated 1613 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:59:38.862464 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-ff977c24-9692-4569-a5dc-c55dbec26aee tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:38.863824 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-ff977c24-9692-4569-a5dc-c55dbec26aee tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 1464324b-6977-4faa-8b84-370603a77429] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:38.870218 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ff977c24-9692-4569-a5dc-c55dbec26aee tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:38.879795 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ff977c24-9692-4569-a5dc-c55dbec26aee tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:38.880438 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ff977c24-9692-4569-a5dc-c55dbec26aee tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:38.881293 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ff977c24-9692-4569-a5dc-c55dbec26aee tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:38.881854 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ff977c24-9692-4569-a5dc-c55dbec26aee tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:38.882364 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ff977c24-9692-4569-a5dc-c55dbec26aee tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:39.096236 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-6fc8bc85-4761-4cce-a8aa-dc21a9376f02 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:39.098723 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-6fc8bc85-4761-4cce-a8aa-dc21a9376f02 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] [instance: f3722f40-7320-484b-8c20-78b2de3e89f1] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:39.124529 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6fc8bc85-4761-4cce-a8aa-dc21a9376f02 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:39.125137 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6fc8bc85-4761-4cce-a8aa-dc21a9376f02 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:39.125941 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6fc8bc85-4761-4cce-a8aa-dc21a9376f02 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:39.126873 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6fc8bc85-4761-4cce-a8aa-dc21a9376f02 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:39.128137 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6fc8bc85-4761-4cce-a8aa-dc21a9376f02 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:39.135237 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6fc8bc85-4761-4cce-a8aa-dc21a9376f02 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:39.475466 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-ff977c24-9692-4569-a5dc-c55dbec26aee tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:59:39.501887 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-ff977c24-9692-4569-a5dc-c55dbec26aee tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/1464324b-6977-4faa-8b84-370603a77429" status: 200 len: 1542 microversion: 2.1 time: 0.643979 Aug 10 22:59:39.514810 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 455/938] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:59:38 2022] GET /compute/v2.1/servers/1464324b-6977-4faa-8b84-370603a77429 => generated 1542 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:59:39.534081 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-954b3255-5e3a-497e-aa0b-fbb3440419d4 req-b3c532dc-e151-4d22-b0de-5da321f7c499 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7599a318-7a19-4f4a-bbb6-162f7a207060", "name": "network-vif-deleted", "tag": "f22c5d16-4ab5-4e8c-987e-74d273711590"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:59:39.595567 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-954b3255-5e3a-497e-aa0b-fbb3440419d4 req-b3c532dc-e151-4d22-b0de-5da321f7c499 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:39.596061 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-954b3255-5e3a-497e-aa0b-fbb3440419d4 req-b3c532dc-e151-4d22-b0de-5da321f7c499 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:39.596605 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-954b3255-5e3a-497e-aa0b-fbb3440419d4 req-b3c532dc-e151-4d22-b0de-5da321f7c499 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:39.655430 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-954b3255-5e3a-497e-aa0b-fbb3440419d4 req-b3c532dc-e151-4d22-b0de-5da321f7c499 service nova] Creating event network-vif-deleted:f22c5d16-4ab5-4e8c-987e-74d273711590 for instance 7599a318-7a19-4f4a-bbb6-162f7a207060 on n-h1-850468-14 Aug 10 22:59:39.678988 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-954b3255-5e3a-497e-aa0b-fbb3440419d4 req-b3c532dc-e151-4d22-b0de-5da321f7c499 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.173163 Aug 10 22:59:39.680729 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 456/939] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 22:59:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:59:39.686182 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-7f69bc91-86bd-4053-a3d1-ae83bce88808 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:39.693678 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-7f69bc91-86bd-4053-a3d1-ae83bce88808 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] [instance: 8e91f1ac-f79d-4ab0-aa13-ea32b0e74888] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:39.725244 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7f69bc91-86bd-4053-a3d1-ae83bce88808 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:39.727765 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7f69bc91-86bd-4053-a3d1-ae83bce88808 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:39.729580 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7f69bc91-86bd-4053-a3d1-ae83bce88808 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:39.739928 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7f69bc91-86bd-4053-a3d1-ae83bce88808 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:39.740427 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7f69bc91-86bd-4053-a3d1-ae83bce88808 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:39.740991 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7f69bc91-86bd-4053-a3d1-ae83bce88808 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:39.834154 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-6fc8bc85-4761-4cce-a8aa-dc21a9376f02 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6d9806b6724e5aaf8c69be8e70d4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307ab95daa034afbb31f90626885072b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:59:39.843129 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-6fc8bc85-4761-4cce-a8aa-dc21a9376f02 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] 10.222.0.58 "GET /compute/v2.1/servers/f3722f40-7320-484b-8c20-78b2de3e89f1" status: 200 len: 1498 microversion: 2.1 time: 0.749868 Aug 10 22:59:39.863719 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 484/940] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:59:39 2022] GET /compute/v2.1/servers/f3722f40-7320-484b-8c20-78b2de3e89f1 => generated 1498 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:59:39.885749 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-091fa104-0879-41ae-98f3-e7b479e9be7d tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:39.886744 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-091fa104-0879-41ae-98f3-e7b479e9be7d tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] [instance: e1deb45a-4597-4456-a1bd-54013c9484a4] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:39.904054 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-091fa104-0879-41ae-98f3-e7b479e9be7d tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:39.904562 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-091fa104-0879-41ae-98f3-e7b479e9be7d tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:39.905002 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-091fa104-0879-41ae-98f3-e7b479e9be7d tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:39.910696 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-091fa104-0879-41ae-98f3-e7b479e9be7d tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:39.912434 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-091fa104-0879-41ae-98f3-e7b479e9be7d tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:39.912901 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-091fa104-0879-41ae-98f3-e7b479e9be7d tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:39.978381 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-7f69bc91-86bd-4053-a3d1-ae83bce88808 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632904331d024d9b8e4d3660dff2cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ed0bdee3aa4013bd9219069bda558c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:59:39.996918 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-7f69bc91-86bd-4053-a3d1-ae83bce88808 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] 10.222.0.58 "GET /compute/v2.1/servers/8e91f1ac-f79d-4ab0-aa13-ea32b0e74888" status: 200 len: 1292 microversion: 2.1 time: 0.309573 Aug 10 22:59:40.002058 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 457/941] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:59:39 2022] GET /compute/v2.1/servers/8e91f1ac-f79d-4ab0-aa13-ea32b0e74888 => generated 1292 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:59:40.036643 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-1ad0aedf-11c3-44af-9224-b4a8a6188d12 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:40.037564 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-1ad0aedf-11c3-44af-9224-b4a8a6188d12 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] [instance: 7599a318-7a19-4f4a-bbb6-162f7a207060] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:40.050146 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1ad0aedf-11c3-44af-9224-b4a8a6188d12 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:40.056590 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1ad0aedf-11c3-44af-9224-b4a8a6188d12 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:40.063754 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1ad0aedf-11c3-44af-9224-b4a8a6188d12 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:40.064942 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1ad0aedf-11c3-44af-9224-b4a8a6188d12 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:40.067452 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1ad0aedf-11c3-44af-9224-b4a8a6188d12 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:40.067937 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1ad0aedf-11c3-44af-9224-b4a8a6188d12 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:40.142982 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1ad0aedf-11c3-44af-9224-b4a8a6188d12 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:40.144104 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1ad0aedf-11c3-44af-9224-b4a8a6188d12 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:40.144550 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1ad0aedf-11c3-44af-9224-b4a8a6188d12 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:40.150044 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.objects.instance [None req-1ad0aedf-11c3-44af-9224-b4a8a6188d12 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Lazy-loading 'fault' on Instance uuid 7599a318-7a19-4f4a-bbb6-162f7a207060 {{(pid=122632) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 22:59:40.413158 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-091fa104-0879-41ae-98f3-e7b479e9be7d tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e86e6a62c56248d6a7887be0ec712f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25090b10522b4936b3117dc25dd6f609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:59:40.423989 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-091fa104-0879-41ae-98f3-e7b479e9be7d tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] 10.222.0.58 "GET /compute/v2.1/servers/e1deb45a-4597-4456-a1bd-54013c9484a4" status: 200 len: 1467 microversion: 2.1 time: 0.557252 Aug 10 22:59:40.426194 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 485/942] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:59:39 2022] GET /compute/v2.1/servers/e1deb45a-4597-4456-a1bd-54013c9484a4 => generated 1467 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:59:40.451103 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-1a871337-862b-40a3-8580-73bf847029a6 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:40.452077 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-1a871337-862b-40a3-8580-73bf847029a6 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] [instance: d716cac6-ac7c-4b98-b6ea-2496ccd62096] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:40.460964 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=2 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:59:40.462776 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:59:40.490219 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1a871337-862b-40a3-8580-73bf847029a6 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:40.490863 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1a871337-862b-40a3-8580-73bf847029a6 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:40.491400 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1a871337-862b-40a3-8580-73bf847029a6 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:40.492271 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1a871337-862b-40a3-8580-73bf847029a6 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:40.494218 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1a871337-862b-40a3-8580-73bf847029a6 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:40.494743 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1a871337-862b-40a3-8580-73bf847029a6 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:40.860895 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-1a871337-862b-40a3-8580-73bf847029a6 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e86e6a62c56248d6a7887be0ec712f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25090b10522b4936b3117dc25dd6f609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:59:40.870391 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-1a871337-862b-40a3-8580-73bf847029a6 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] 10.222.0.58 "GET /compute/v2.1/servers/d716cac6-ac7c-4b98-b6ea-2496ccd62096" status: 200 len: 1467 microversion: 2.1 time: 0.423246 Aug 10 22:59:40.871773 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 486/943] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:59:40 2022] GET /compute/v2.1/servers/d716cac6-ac7c-4b98-b6ea-2496ccd62096 => generated 1467 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:59:40.877276 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-1cd8d9f6-6abb-4d65-8e4b-c5149eb75ab5 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:40.878547 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-1cd8d9f6-6abb-4d65-8e4b-c5149eb75ab5 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 1464324b-6977-4faa-8b84-370603a77429] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:40.889642 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1cd8d9f6-6abb-4d65-8e4b-c5149eb75ab5 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:40.892841 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1cd8d9f6-6abb-4d65-8e4b-c5149eb75ab5 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:40.894035 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1cd8d9f6-6abb-4d65-8e4b-c5149eb75ab5 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:40.894729 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1cd8d9f6-6abb-4d65-8e4b-c5149eb75ab5 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:40.910758 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1cd8d9f6-6abb-4d65-8e4b-c5149eb75ab5 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:40.911279 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1cd8d9f6-6abb-4d65-8e4b-c5149eb75ab5 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:40.951313 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-1ad0aedf-11c3-44af-9224-b4a8a6188d12 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0415b5bdb48249d6b9f1ef7c92aad597', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29083d61c29b43b4b47539a141b3d1fb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:59:40.962442 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-1ad0aedf-11c3-44af-9224-b4a8a6188d12 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] 10.222.0.58 "GET /compute/v2.1/servers/7599a318-7a19-4f4a-bbb6-162f7a207060" status: 200 len: 1331 microversion: 2.1 time: 0.954949 Aug 10 22:59:40.967885 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 458/944] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:59:40 2022] GET /compute/v2.1/servers/7599a318-7a19-4f4a-bbb6-162f7a207060 => generated 1331 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:59:40.991707 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-9d2197ee-8424-46a4-9452-3e8142206710 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:40.992408 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-9d2197ee-8424-46a4-9452-3e8142206710 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] [instance: f3722f40-7320-484b-8c20-78b2de3e89f1] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:41.028310 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9d2197ee-8424-46a4-9452-3e8142206710 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:41.028817 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9d2197ee-8424-46a4-9452-3e8142206710 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:41.029264 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9d2197ee-8424-46a4-9452-3e8142206710 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:41.030002 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9d2197ee-8424-46a4-9452-3e8142206710 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:41.030450 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9d2197ee-8424-46a4-9452-3e8142206710 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:41.031180 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9d2197ee-8424-46a4-9452-3e8142206710 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:41.370193 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-9d2197ee-8424-46a4-9452-3e8142206710 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6d9806b6724e5aaf8c69be8e70d4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307ab95daa034afbb31f90626885072b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:59:41.390156 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-9d2197ee-8424-46a4-9452-3e8142206710 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] 10.222.0.58 "GET /compute/v2.1/servers/f3722f40-7320-484b-8c20-78b2de3e89f1" status: 200 len: 1498 microversion: 2.1 time: 0.421067 Aug 10 22:59:41.403164 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 459/945] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:59:40 2022] GET /compute/v2.1/servers/f3722f40-7320-484b-8c20-78b2de3e89f1 => generated 1498 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:59:41.413570 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-af4aeead-ee31-4743-9aa2-246d616de8a3 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1247670939"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:59:41.426258 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-af4aeead-ee31-4743-9aa2-246d616de8a3 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] [instance: d716cac6-ac7c-4b98-b6ea-2496ccd62096] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:41.440705 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-af4aeead-ee31-4743-9aa2-246d616de8a3 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:41.445781 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-af4aeead-ee31-4743-9aa2-246d616de8a3 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:41.446498 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-af4aeead-ee31-4743-9aa2-246d616de8a3 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:41.447523 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-af4aeead-ee31-4743-9aa2-246d616de8a3 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:41.448229 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-af4aeead-ee31-4743-9aa2-246d616de8a3 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:41.453610 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-af4aeead-ee31-4743-9aa2-246d616de8a3 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:41.669462 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-1cd8d9f6-6abb-4d65-8e4b-c5149eb75ab5 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:59:41.686439 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-1cd8d9f6-6abb-4d65-8e4b-c5149eb75ab5 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/1464324b-6977-4faa-8b84-370603a77429" status: 200 len: 1542 microversion: 2.1 time: 0.813159 Aug 10 22:59:41.687260 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 487/946] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:59:40 2022] GET /compute/v2.1/servers/1464324b-6977-4faa-8b84-370603a77429 => generated 1542 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:59:41.708513 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-5d67e9e7-e0db-4ccf-a3ba-df001d786da0 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:41.709524 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-5d67e9e7-e0db-4ccf-a3ba-df001d786da0 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] [instance: 8e91f1ac-f79d-4ab0-aa13-ea32b0e74888] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:41.716429 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5d67e9e7-e0db-4ccf-a3ba-df001d786da0 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:41.717140 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5d67e9e7-e0db-4ccf-a3ba-df001d786da0 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:41.717909 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5d67e9e7-e0db-4ccf-a3ba-df001d786da0 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:41.718765 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5d67e9e7-e0db-4ccf-a3ba-df001d786da0 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:41.719739 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5d67e9e7-e0db-4ccf-a3ba-df001d786da0 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:41.720455 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5d67e9e7-e0db-4ccf-a3ba-df001d786da0 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:41.933116 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-af4aeead-ee31-4743-9aa2-246d616de8a3 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] 10.222.0.58 "POST /compute/v2.1/servers/d716cac6-ac7c-4b98-b6ea-2496ccd62096/action" status: 202 len: 0 microversion: 2.1 time: 0.528271 Aug 10 22:59:41.938621 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 460/947] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 22:59:41 2022] POST /compute/v2.1/servers/d716cac6-ac7c-4b98-b6ea-2496ccd62096/action => generated 0 bytes in 535 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 10 22:59:41.972232 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-77fafa1f-8d42-4608-af68-5811459e7eff tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Calling method '.version_select at 0x7f847d8bfa60>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:42.071691 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-77fafa1f-8d42-4608-af68-5811459e7eff tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] 10.222.0.58 "GET /compute/v2.1/images/be4c34b4-d5ba-42f3-8dac-aa84837569a0" status: 200 len: 1455 microversion: 2.1 time: 0.122132 Aug 10 22:59:42.082818 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 461/948] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 10 22:59:41 2022] GET /compute/v2.1/images/be4c34b4-d5ba-42f3-8dac-aa84837569a0 => generated 1455 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:59:42.093084 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-e1004780-4588-4e5c-a081-f1282eb3ead4 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:42.094199 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-e1004780-4588-4e5c-a081-f1282eb3ead4 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] [instance: 7599a318-7a19-4f4a-bbb6-162f7a207060] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:42.110604 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e1004780-4588-4e5c-a081-f1282eb3ead4 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:42.112029 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e1004780-4588-4e5c-a081-f1282eb3ead4 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:42.113229 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e1004780-4588-4e5c-a081-f1282eb3ead4 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:42.114202 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e1004780-4588-4e5c-a081-f1282eb3ead4 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:42.114956 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e1004780-4588-4e5c-a081-f1282eb3ead4 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:42.115608 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e1004780-4588-4e5c-a081-f1282eb3ead4 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:42.134983 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-e1004780-4588-4e5c-a081-f1282eb3ead4 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] HTTP exception thrown: Instance 7599a318-7a19-4f4a-bbb6-162f7a207060 could not be found. Aug 10 22:59:42.137771 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-e1004780-4588-4e5c-a081-f1282eb3ead4 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Request method failure captured: Aug 10 22:59:42.137771 n-d-850468-14 devstack@n-api.service[122632]: request: GET /compute/v2.1/servers/7599a318-7a19-4f4a-bbb6-162f7a207060 HTTP/1.1 Aug 10 22:59:42.137771 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 22:59:42.137771 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 22:59:42.137771 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 22:59:42.137771 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 22:59:42.137771 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 22:59:42.137771 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 22:59:42.137771 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 22:59:42.137771 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 22:59:42.137771 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9DewiuJdVoHNtUHdGGJp0zg8n2XPQ0k5_9_bhVmvR0L4c50AOE_HsUnVs_XYp3Ut1nfNSm0aJ3eKRzMv7IuaQMgSPD4f3umSzmxlCDg0ojfmA82W4VHsC9cWOvXZF2vgn6zJiIqUIuJD-L1N_gpOZvHl3WeJCqWSKDn9z5aPvhdfRl8 Aug 10 22:59:42.137771 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 22:59:42.137771 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 22:59:42.137771 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 22:59:42.137771 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 22:59:42.137771 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 22:59:42.137771 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 22:59:42.137771 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 29083d61c29b43b4b47539a141b3d1fb Aug 10 22:59:42.137771 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-232922240 Aug 10 22:59:42.137771 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 22:59:42.137771 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 22:59:42.139274 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/29083d61c29b43b4b47539a141b3d1fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/29083d61c29b43b4b47539a141b3d1fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/29083d61c29b43b4b47539a141b3d1fb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_29083d61c29b43b4b47539a141b3d1fb", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 22:59:42.139274 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-232922240 Aug 10 22:59:42.139274 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 29083d61c29b43b4b47539a141b3d1fb Aug 10 22:59:42.139274 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-232922240 Aug 10 22:59:42.139274 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-AttachSCSIVolumeTestJSON-232922240-project Aug 10 22:59:42.139274 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 22:59:42.139274 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 22:59:42.139274 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: 0415b5bdb48249d6b9f1ef7c92aad597 Aug 10 22:59:42.139274 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-232922240-project Aug 10 22:59:42.139274 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 22:59:42.139274 n-d-850468-14 devstack@n-api.service[122632]: exception: Instance 7599a318-7a19-4f4a-bbb6-162f7a207060 could not be found. Aug 10 22:59:42.139274 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': '7599a318-7a19-4f4a-bbb6-162f7a207060'} Aug 10 22:59:42.140071 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 22:59:42.140071 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:59:42.140071 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 22:59:42.140071 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 22:59:42.140071 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 22:59:42.140071 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 22:59:42.140071 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 22:59:42.140071 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 22:59:42.140071 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 22:59:42.140071 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 22:59:42.140071 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7599a318-7a19-4f4a-bbb6-162f7a207060 could not be found. Aug 10 22:59:42.140071 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:59:42.140071 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:59:42.140071 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:59:42.140071 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:59:42.140071 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:59:42.140071 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:59:42.140071 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 22:59:42.140071 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 22:59:42.140071 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 22:59:42.141411 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 22:59:42.141411 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 22:59:42.141411 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 22:59:42.141411 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 22:59:42.141411 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 22:59:42.141411 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 22:59:42.141411 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 22:59:42.141411 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7599a318-7a19-4f4a-bbb6-162f7a207060 could not be found. Aug 10 22:59:42.141411 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:59:42.141411 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:59:42.141411 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:59:42.141411 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:59:42.141411 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:59:42.141411 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:59:42.141411 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 22:59:42.141411 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 22:59:42.141411 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7599a318-7a19-4f4a-bbb6-162f7a207060 could not be found. Aug 10 22:59:42.141411 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:59:42.148224 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-e1004780-4588-4e5c-a081-f1282eb3ead4 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Returning 404 to user: Instance 7599a318-7a19-4f4a-bbb6-162f7a207060 could not be found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 22:59:42.149395 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-e1004780-4588-4e5c-a081-f1282eb3ead4 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] 10.222.0.58 "GET /compute/v2.1/servers/7599a318-7a19-4f4a-bbb6-162f7a207060" status: 404 len: 111 microversion: 2.1 time: 0.065492 Aug 10 22:59:42.150206 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 462/949] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:59:42 2022] GET /compute/v2.1/servers/7599a318-7a19-4f4a-bbb6-162f7a207060 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 22:59:42.160336 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-1655b936-7e72-43a1-bb1e-d99592999f2e tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Calling method '.version_select at 0x7f847d978700>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:42.188458 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-1655b936-7e72-43a1-bb1e-d99592999f2e tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-382485334" status: 202 len: 0 microversion: 2.1 time: 0.031909 Aug 10 22:59:42.189775 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 463/950] 10.222.0.58 () {58 vars in 1218 bytes} [Wed Aug 10 22:59:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-382485334 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 22:59:42.281421 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-5d67e9e7-e0db-4ccf-a3ba-df001d786da0 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632904331d024d9b8e4d3660dff2cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ed0bdee3aa4013bd9219069bda558c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:59:42.304045 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-5d67e9e7-e0db-4ccf-a3ba-df001d786da0 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] 10.222.0.58 "GET /compute/v2.1/servers/8e91f1ac-f79d-4ab0-aa13-ea32b0e74888" status: 200 len: 1360 microversion: 2.1 time: 0.601014 Aug 10 22:59:42.305392 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 488/951] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:59:41 2022] GET /compute/v2.1/servers/8e91f1ac-f79d-4ab0-aa13-ea32b0e74888 => generated 1360 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:59:42.415912 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-04d764be-c914-4173-bd69-126a4f7310d4 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:42.416715 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-04d764be-c914-4173-bd69-126a4f7310d4 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] [instance: f3722f40-7320-484b-8c20-78b2de3e89f1] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:42.429391 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-04d764be-c914-4173-bd69-126a4f7310d4 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:42.434094 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-04d764be-c914-4173-bd69-126a4f7310d4 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:42.434719 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-04d764be-c914-4173-bd69-126a4f7310d4 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:42.435877 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-04d764be-c914-4173-bd69-126a4f7310d4 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:42.441063 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-04d764be-c914-4173-bd69-126a4f7310d4 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:42.441652 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-04d764be-c914-4173-bd69-126a4f7310d4 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:42.711939 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-603ef336-43fa-4708-be68-48e5ad08a837 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:42.712770 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-603ef336-43fa-4708-be68-48e5ad08a837 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 1464324b-6977-4faa-8b84-370603a77429] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:42.724046 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-603ef336-43fa-4708-be68-48e5ad08a837 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:42.726114 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-603ef336-43fa-4708-be68-48e5ad08a837 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:42.727015 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-603ef336-43fa-4708-be68-48e5ad08a837 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:42.728000 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-603ef336-43fa-4708-be68-48e5ad08a837 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:42.729776 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-603ef336-43fa-4708-be68-48e5ad08a837 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:42.730418 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-603ef336-43fa-4708-be68-48e5ad08a837 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:42.909912 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-04d764be-c914-4173-bd69-126a4f7310d4 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6d9806b6724e5aaf8c69be8e70d4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307ab95daa034afbb31f90626885072b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:59:42.917814 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-04d764be-c914-4173-bd69-126a4f7310d4 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] 10.222.0.58 "GET /compute/v2.1/servers/f3722f40-7320-484b-8c20-78b2de3e89f1" status: 200 len: 1498 microversion: 2.1 time: 0.506598 Aug 10 22:59:42.931382 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 464/952] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:59:42 2022] GET /compute/v2.1/servers/f3722f40-7320-484b-8c20-78b2de3e89f1 => generated 1498 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:59:42.938223 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-41469d28-8de9-4f37-8194-159ae6b75c5b req-93a7636e-b481-42c8-99ef-08b2c5d425eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e91f1ac-f79d-4ab0-aa13-ea32b0e74888", "tag": "19d4795c-3095-41be-b300-ea441bb13af4"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:59:42.954921 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-41469d28-8de9-4f37-8194-159ae6b75c5b req-93a7636e-b481-42c8-99ef-08b2c5d425eb service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:42.955624 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-41469d28-8de9-4f37-8194-159ae6b75c5b req-93a7636e-b481-42c8-99ef-08b2c5d425eb service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:42.956788 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-41469d28-8de9-4f37-8194-159ae6b75c5b req-93a7636e-b481-42c8-99ef-08b2c5d425eb service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:42.969476 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-41469d28-8de9-4f37-8194-159ae6b75c5b req-93a7636e-b481-42c8-99ef-08b2c5d425eb service nova] Creating event network-changed:19d4795c-3095-41be-b300-ea441bb13af4 for instance 8e91f1ac-f79d-4ab0-aa13-ea32b0e74888 on n-h2-850468-14 Aug 10 22:59:42.975827 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-41469d28-8de9-4f37-8194-159ae6b75c5b req-93a7636e-b481-42c8-99ef-08b2c5d425eb service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042227 Aug 10 22:59:42.977431 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 465/953] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 22:59:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:59:43.092304 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-a674605c-abba-4a0e-8c9f-a98d602d1846 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Calling method '.version_select at 0x7f847d98c160>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:43.169117 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-a674605c-abba-4a0e-8c9f-a98d602d1846 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] 10.222.0.58 "GET /compute/v2.1/images/be4c34b4-d5ba-42f3-8dac-aa84837569a0" status: 200 len: 1455 microversion: 2.1 time: 0.082640 Aug 10 22:59:43.177473 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 466/954] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 10 22:59:43 2022] GET /compute/v2.1/images/be4c34b4-d5ba-42f3-8dac-aa84837569a0 => generated 1455 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:59:43.328680 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-982aa028-e81c-40a3-b612-1196b00414f1 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:43.329819 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-982aa028-e81c-40a3-b612-1196b00414f1 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] [instance: 8e91f1ac-f79d-4ab0-aa13-ea32b0e74888] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:43.338153 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-982aa028-e81c-40a3-b612-1196b00414f1 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:43.339051 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-982aa028-e81c-40a3-b612-1196b00414f1 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:43.339729 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-982aa028-e81c-40a3-b612-1196b00414f1 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:43.342259 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-982aa028-e81c-40a3-b612-1196b00414f1 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:43.342978 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-982aa028-e81c-40a3-b612-1196b00414f1 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:43.343646 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-982aa028-e81c-40a3-b612-1196b00414f1 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:43.391675 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-603ef336-43fa-4708-be68-48e5ad08a837 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:59:43.405186 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-603ef336-43fa-4708-be68-48e5ad08a837 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/1464324b-6977-4faa-8b84-370603a77429" status: 200 len: 1542 microversion: 2.1 time: 0.700304 Aug 10 22:59:43.406645 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 489/955] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:59:42 2022] GET /compute/v2.1/servers/1464324b-6977-4faa-8b84-370603a77429 => generated 1542 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:59:43.694500 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-982aa028-e81c-40a3-b612-1196b00414f1 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632904331d024d9b8e4d3660dff2cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ed0bdee3aa4013bd9219069bda558c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:59:43.704981 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-982aa028-e81c-40a3-b612-1196b00414f1 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] 10.222.0.58 "GET /compute/v2.1/servers/8e91f1ac-f79d-4ab0-aa13-ea32b0e74888" status: 200 len: 1360 microversion: 2.1 time: 0.380042 Aug 10 22:59:43.708547 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 467/956] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:59:43 2022] GET /compute/v2.1/servers/8e91f1ac-f79d-4ab0-aa13-ea32b0e74888 => generated 1360 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:59:43.946220 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-b4614b79-ece6-4458-ad3b-5a1cbe10afa1 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:43.947991 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-b4614b79-ece6-4458-ad3b-5a1cbe10afa1 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] [instance: f3722f40-7320-484b-8c20-78b2de3e89f1] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:43.962441 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b4614b79-ece6-4458-ad3b-5a1cbe10afa1 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:43.963306 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b4614b79-ece6-4458-ad3b-5a1cbe10afa1 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:43.964141 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b4614b79-ece6-4458-ad3b-5a1cbe10afa1 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:43.965061 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b4614b79-ece6-4458-ad3b-5a1cbe10afa1 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:43.965722 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b4614b79-ece6-4458-ad3b-5a1cbe10afa1 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:43.967274 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b4614b79-ece6-4458-ad3b-5a1cbe10afa1 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:44.185871 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-d74cd899-48ca-466c-b6f2-ed485ac9342f tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Calling method '.version_select at 0x7f847d98c550>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:44.246505 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-d74cd899-48ca-466c-b6f2-ed485ac9342f tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] 10.222.0.58 "GET /compute/v2.1/images/be4c34b4-d5ba-42f3-8dac-aa84837569a0" status: 200 len: 1455 microversion: 2.1 time: 0.065638 Aug 10 22:59:44.248452 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 468/957] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 10 22:59:44 2022] GET /compute/v2.1/images/be4c34b4-d5ba-42f3-8dac-aa84837569a0 => generated 1455 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:59:44.275121 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-b4614b79-ece6-4458-ad3b-5a1cbe10afa1 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6d9806b6724e5aaf8c69be8e70d4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307ab95daa034afbb31f90626885072b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:59:44.288417 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-b4614b79-ece6-4458-ad3b-5a1cbe10afa1 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] 10.222.0.58 "GET /compute/v2.1/servers/f3722f40-7320-484b-8c20-78b2de3e89f1" status: 200 len: 1498 microversion: 2.1 time: 0.348411 Aug 10 22:59:44.289001 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 490/958] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:59:43 2022] GET /compute/v2.1/servers/f3722f40-7320-484b-8c20-78b2de3e89f1 => generated 1498 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:59:44.428115 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-9317022f-9054-490b-b030-e77a0727f727 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:44.431959 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-9317022f-9054-490b-b030-e77a0727f727 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 1464324b-6977-4faa-8b84-370603a77429] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:44.447475 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9317022f-9054-490b-b030-e77a0727f727 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:44.447977 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9317022f-9054-490b-b030-e77a0727f727 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:44.448742 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9317022f-9054-490b-b030-e77a0727f727 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:44.449610 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9317022f-9054-490b-b030-e77a0727f727 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:44.450290 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9317022f-9054-490b-b030-e77a0727f727 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:44.450836 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9317022f-9054-490b-b030-e77a0727f727 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:44.622648 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-9317022f-9054-490b-b030-e77a0727f727 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:59:44.632700 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-9317022f-9054-490b-b030-e77a0727f727 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/1464324b-6977-4faa-8b84-370603a77429" status: 200 len: 1542 microversion: 2.1 time: 0.209437 Aug 10 22:59:44.634005 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 469/959] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:59:44 2022] GET /compute/v2.1/servers/1464324b-6977-4faa-8b84-370603a77429 => generated 1542 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:59:44.728693 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-39a5dd14-f5f3-4779-b440-d3ce8b00404b tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:44.729289 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-39a5dd14-f5f3-4779-b440-d3ce8b00404b tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] [instance: 8e91f1ac-f79d-4ab0-aa13-ea32b0e74888] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:44.741524 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-39a5dd14-f5f3-4779-b440-d3ce8b00404b tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:44.742009 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-39a5dd14-f5f3-4779-b440-d3ce8b00404b tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:44.742439 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-39a5dd14-f5f3-4779-b440-d3ce8b00404b tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:44.743345 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-39a5dd14-f5f3-4779-b440-d3ce8b00404b tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:44.751546 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-39a5dd14-f5f3-4779-b440-d3ce8b00404b tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:44.753475 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-39a5dd14-f5f3-4779-b440-d3ce8b00404b tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:45.065025 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-39a5dd14-f5f3-4779-b440-d3ce8b00404b tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632904331d024d9b8e4d3660dff2cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ed0bdee3aa4013bd9219069bda558c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:59:45.074986 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-39a5dd14-f5f3-4779-b440-d3ce8b00404b tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] 10.222.0.58 "GET /compute/v2.1/servers/8e91f1ac-f79d-4ab0-aa13-ea32b0e74888" status: 200 len: 1360 microversion: 2.1 time: 0.349977 Aug 10 22:59:45.083190 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 491/960] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:59:44 2022] GET /compute/v2.1/servers/8e91f1ac-f79d-4ab0-aa13-ea32b0e74888 => generated 1360 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:59:45.264447 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-5d59d125-733b-4b18-b129-7d4d9cbfd67c tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Calling method '.version_select at 0x7f847d77e280>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:45.313299 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-6e90c5fa-4197-439a-908f-306b9fb00228 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:45.313965 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-6e90c5fa-4197-439a-908f-306b9fb00228 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] [instance: f3722f40-7320-484b-8c20-78b2de3e89f1] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:45.336490 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-5d59d125-733b-4b18-b129-7d4d9cbfd67c tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] 10.222.0.58 "GET /compute/v2.1/images/be4c34b4-d5ba-42f3-8dac-aa84837569a0" status: 200 len: 1455 microversion: 2.1 time: 0.076556 Aug 10 22:59:45.338328 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6e90c5fa-4197-439a-908f-306b9fb00228 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:45.338872 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6e90c5fa-4197-439a-908f-306b9fb00228 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:45.339375 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6e90c5fa-4197-439a-908f-306b9fb00228 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:45.340116 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6e90c5fa-4197-439a-908f-306b9fb00228 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:45.340577 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6e90c5fa-4197-439a-908f-306b9fb00228 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:45.341042 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6e90c5fa-4197-439a-908f-306b9fb00228 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:45.344704 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 470/961] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 10 22:59:45 2022] GET /compute/v2.1/images/be4c34b4-d5ba-42f3-8dac-aa84837569a0 => generated 1455 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:59:45.657912 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-aaae9508-cdab-4216-adfe-d9469189cdff tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:45.658755 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-aaae9508-cdab-4216-adfe-d9469189cdff tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 1464324b-6977-4faa-8b84-370603a77429] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:45.664675 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-6e90c5fa-4197-439a-908f-306b9fb00228 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6d9806b6724e5aaf8c69be8e70d4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307ab95daa034afbb31f90626885072b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:59:45.675837 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-6e90c5fa-4197-439a-908f-306b9fb00228 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] 10.222.0.58 "GET /compute/v2.1/servers/f3722f40-7320-484b-8c20-78b2de3e89f1" status: 200 len: 1498 microversion: 2.1 time: 0.367053 Aug 10 22:59:45.689342 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-aaae9508-cdab-4216-adfe-d9469189cdff tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:45.692428 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 492/962] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:59:45 2022] GET /compute/v2.1/servers/f3722f40-7320-484b-8c20-78b2de3e89f1 => generated 1498 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:59:45.693231 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-aaae9508-cdab-4216-adfe-d9469189cdff tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:45.695724 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-aaae9508-cdab-4216-adfe-d9469189cdff tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:45.696583 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-aaae9508-cdab-4216-adfe-d9469189cdff tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:45.697302 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-aaae9508-cdab-4216-adfe-d9469189cdff tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:45.698340 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-aaae9508-cdab-4216-adfe-d9469189cdff tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:45.816469 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=2 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:59:45.866221 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=6 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:59:46.014374 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-aaae9508-cdab-4216-adfe-d9469189cdff tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:59:46.040391 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-aaae9508-cdab-4216-adfe-d9469189cdff tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/1464324b-6977-4faa-8b84-370603a77429" status: 200 len: 1542 microversion: 2.1 time: 0.386981 Aug 10 22:59:46.041099 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 471/963] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:59:45 2022] GET /compute/v2.1/servers/1464324b-6977-4faa-8b84-370603a77429 => generated 1542 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:59:46.126955 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-24082efa-cb50-4189-9cc6-bfcbcd30b883 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:46.128657 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-24082efa-cb50-4189-9cc6-bfcbcd30b883 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] [instance: 8e91f1ac-f79d-4ab0-aa13-ea32b0e74888] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:46.136740 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-24082efa-cb50-4189-9cc6-bfcbcd30b883 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:46.137219 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-24082efa-cb50-4189-9cc6-bfcbcd30b883 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:46.137738 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-24082efa-cb50-4189-9cc6-bfcbcd30b883 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:46.138840 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-24082efa-cb50-4189-9cc6-bfcbcd30b883 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:46.139487 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-24082efa-cb50-4189-9cc6-bfcbcd30b883 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:46.139973 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-24082efa-cb50-4189-9cc6-bfcbcd30b883 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:46.356806 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-97e0a551-6793-442f-a6e9-cbda43519418 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Calling method '.version_select at 0x7f847d98f5e0>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:46.443623 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-97e0a551-6793-442f-a6e9-cbda43519418 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] 10.222.0.58 "GET /compute/v2.1/images/be4c34b4-d5ba-42f3-8dac-aa84837569a0" status: 200 len: 1455 microversion: 2.1 time: 0.080407 Aug 10 22:59:46.444520 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 472/964] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 10 22:59:46 2022] GET /compute/v2.1/images/be4c34b4-d5ba-42f3-8dac-aa84837569a0 => generated 1455 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:59:46.470469 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-24082efa-cb50-4189-9cc6-bfcbcd30b883 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632904331d024d9b8e4d3660dff2cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ed0bdee3aa4013bd9219069bda558c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:59:46.493758 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-24082efa-cb50-4189-9cc6-bfcbcd30b883 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] 10.222.0.58 "GET /compute/v2.1/servers/8e91f1ac-f79d-4ab0-aa13-ea32b0e74888" status: 200 len: 1360 microversion: 2.1 time: 0.391115 Aug 10 22:59:46.495736 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 493/965] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:59:46 2022] GET /compute/v2.1/servers/8e91f1ac-f79d-4ab0-aa13-ea32b0e74888 => generated 1360 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:59:46.701290 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-b9e7a7f7-bb55-44a5-99fb-92ff56d46ed3 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:46.701963 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-b9e7a7f7-bb55-44a5-99fb-92ff56d46ed3 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] [instance: f3722f40-7320-484b-8c20-78b2de3e89f1] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:46.722317 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b9e7a7f7-bb55-44a5-99fb-92ff56d46ed3 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:46.722934 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b9e7a7f7-bb55-44a5-99fb-92ff56d46ed3 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:46.723369 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b9e7a7f7-bb55-44a5-99fb-92ff56d46ed3 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:46.730915 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b9e7a7f7-bb55-44a5-99fb-92ff56d46ed3 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:46.734715 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b9e7a7f7-bb55-44a5-99fb-92ff56d46ed3 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:46.735200 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b9e7a7f7-bb55-44a5-99fb-92ff56d46ed3 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:47.068626 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-8df9e819-37d8-4e5e-be19-8821d1791831 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:47.069682 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-8df9e819-37d8-4e5e-be19-8821d1791831 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 1464324b-6977-4faa-8b84-370603a77429] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:47.076049 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=6 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:59:47.079840 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8df9e819-37d8-4e5e-be19-8821d1791831 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:47.081864 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8df9e819-37d8-4e5e-be19-8821d1791831 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:47.082667 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8df9e819-37d8-4e5e-be19-8821d1791831 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:47.083742 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8df9e819-37d8-4e5e-be19-8821d1791831 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:47.084495 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8df9e819-37d8-4e5e-be19-8821d1791831 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:47.085164 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8df9e819-37d8-4e5e-be19-8821d1791831 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:47.123928 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-b9e7a7f7-bb55-44a5-99fb-92ff56d46ed3 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6d9806b6724e5aaf8c69be8e70d4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307ab95daa034afbb31f90626885072b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:59:47.137369 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-b9e7a7f7-bb55-44a5-99fb-92ff56d46ed3 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] 10.222.0.58 "GET /compute/v2.1/servers/f3722f40-7320-484b-8c20-78b2de3e89f1" status: 200 len: 1498 microversion: 2.1 time: 0.441175 Aug 10 22:59:47.137974 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 473/966] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:59:46 2022] GET /compute/v2.1/servers/f3722f40-7320-484b-8c20-78b2de3e89f1 => generated 1498 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:59:47.409686 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-8df9e819-37d8-4e5e-be19-8821d1791831 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:59:47.423194 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-8df9e819-37d8-4e5e-be19-8821d1791831 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/1464324b-6977-4faa-8b84-370603a77429" status: 200 len: 1542 microversion: 2.1 time: 0.360629 Aug 10 22:59:47.443771 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 494/967] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:59:47 2022] GET /compute/v2.1/servers/1464324b-6977-4faa-8b84-370603a77429 => generated 1542 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:59:47.462935 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-036ffcb0-3ef3-4a32-b436-30184e9e18da tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Calling method '.version_select at 0x7f847d98f310>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:47.523360 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-eca10d1c-3d5f-4715-afe3-84eba127fd97 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:47.524312 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-eca10d1c-3d5f-4715-afe3-84eba127fd97 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] [instance: 8e91f1ac-f79d-4ab0-aa13-ea32b0e74888] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:47.539425 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-eca10d1c-3d5f-4715-afe3-84eba127fd97 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:47.540395 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-eca10d1c-3d5f-4715-afe3-84eba127fd97 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:47.541452 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-eca10d1c-3d5f-4715-afe3-84eba127fd97 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:47.542928 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-eca10d1c-3d5f-4715-afe3-84eba127fd97 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:47.543604 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-eca10d1c-3d5f-4715-afe3-84eba127fd97 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:47.545860 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-eca10d1c-3d5f-4715-afe3-84eba127fd97 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:47.579838 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-036ffcb0-3ef3-4a32-b436-30184e9e18da tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] 10.222.0.58 "GET /compute/v2.1/images/be4c34b4-d5ba-42f3-8dac-aa84837569a0" status: 200 len: 1455 microversion: 2.1 time: 0.125367 Aug 10 22:59:47.580422 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 474/968] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 10 22:59:47 2022] GET /compute/v2.1/images/be4c34b4-d5ba-42f3-8dac-aa84837569a0 => generated 1455 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:59:48.052876 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-7bc19150-6e3b-42a9-8b84-925aaf721a5f tempest-VolumesAdminNegativeTest-2021290746 tempest-VolumesAdminNegativeTest-2021290746-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "0adcc443-b619-4d6c-8b36-220e979c4569"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:59:48.060858 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-7bc19150-6e3b-42a9-8b84-925aaf721a5f tempest-VolumesAdminNegativeTest-2021290746 tempest-VolumesAdminNegativeTest-2021290746-project-admin] [instance: 3553ba91-ca7b-44d9-944a-1540fa047cb6] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:48.070590 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7bc19150-6e3b-42a9-8b84-925aaf721a5f tempest-VolumesAdminNegativeTest-2021290746 tempest-VolumesAdminNegativeTest-2021290746-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:48.071263 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7bc19150-6e3b-42a9-8b84-925aaf721a5f tempest-VolumesAdminNegativeTest-2021290746 tempest-VolumesAdminNegativeTest-2021290746-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:48.076119 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7bc19150-6e3b-42a9-8b84-925aaf721a5f tempest-VolumesAdminNegativeTest-2021290746 tempest-VolumesAdminNegativeTest-2021290746-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:48.077316 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7bc19150-6e3b-42a9-8b84-925aaf721a5f tempest-VolumesAdminNegativeTest-2021290746 tempest-VolumesAdminNegativeTest-2021290746-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:48.078524 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7bc19150-6e3b-42a9-8b84-925aaf721a5f tempest-VolumesAdminNegativeTest-2021290746 tempest-VolumesAdminNegativeTest-2021290746-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:48.079241 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7bc19150-6e3b-42a9-8b84-925aaf721a5f tempest-VolumesAdminNegativeTest-2021290746 tempest-VolumesAdminNegativeTest-2021290746-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:48.316534 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-7bc19150-6e3b-42a9-8b84-925aaf721a5f tempest-VolumesAdminNegativeTest-2021290746 tempest-VolumesAdminNegativeTest-2021290746-project-admin] HTTP exception thrown: Volume 0adcc443-b619-4d6c-8b36-220e979c4569 could not be found. Aug 10 22:59:48.329126 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-eca10d1c-3d5f-4715-afe3-84eba127fd97 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632904331d024d9b8e4d3660dff2cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ed0bdee3aa4013bd9219069bda558c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:59:48.352914 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-7bc19150-6e3b-42a9-8b84-925aaf721a5f tempest-VolumesAdminNegativeTest-2021290746 tempest-VolumesAdminNegativeTest-2021290746-project-admin] Request method failure captured: Aug 10 22:59:48.352914 n-d-850468-14 devstack@n-api.service[122632]: request: PUT /compute/v2.1/servers/3553ba91-ca7b-44d9-944a-1540fa047cb6/os-volume_attachments/0d0219e7-5148-47c2-869d-347f08238220 HTTP/1.1 Aug 10 22:59:48.352914 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 22:59:48.352914 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 22:59:48.352914 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 22:59:48.352914 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 74 Aug 10 22:59:48.352914 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 22:59:48.352914 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 22:59:48.352914 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 22:59:48.352914 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 22:59:48.352914 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9DgF8huFL2CXO9mzOyxuj_dj9s4ffpnCuvxmWne1N_15TO9vMDU2S3MlKkVeqwAVWCnB7ApjS0MOokILohO7Ekac1S8gW5auXHfP8c2H5jqTNnFE61cGtL7ScI7gtHr_lAsU5GuO_4HUjuM8OoMCpY7JENOkYQDoqijP0mkvC4_u3V8 Aug 10 22:59:48.352914 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 22:59:48.352914 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 22:59:48.352914 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 22:59:48.352914 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 22:59:48.352914 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 22:59:48.352914 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 22:59:48.352914 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: cf94b5644c334be0a0333818ba8c2376 Aug 10 22:59:48.352914 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-VolumesAdminNegativeTest-2021290746 Aug 10 22:59:48.352914 n-d-850468-14 devstack@n-api.service[122632]: X-Role: admin,member,reader Aug 10 22:59:48.352914 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: admin,member,reader Aug 10 22:59:48.354520 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/cf94b5644c334be0a0333818ba8c2376"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/cf94b5644c334be0a0333818ba8c2376"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/cf94b5644c334be0a0333818ba8c2376"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_cf94b5644c334be0a0333818ba8c2376", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 22:59:48.354520 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-VolumesAdminNegativeTest-2021290746 Aug 10 22:59:48.354520 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: cf94b5644c334be0a0333818ba8c2376 Aug 10 22:59:48.354520 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-2021290746 Aug 10 22:59:48.354520 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-VolumesAdminNegativeTest-2021290746-project-admin Aug 10 22:59:48.354520 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 22:59:48.354520 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 22:59:48.354520 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: 1ba65cb3b35f4f36bd3321bb172e3b8b Aug 10 22:59:48.354520 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-VolumesAdminNegativeTest-2021290746-project-admin Aug 10 22:59:48.354520 n-d-850468-14 devstack@n-api.service[122632]: Aug 10 22:59:48.354520 n-d-850468-14 devstack@n-api.service[122632]: {"volumeAttachment": {"volumeId": "0adcc443-b619-4d6c-8b36-220e979c4569"}} Aug 10 22:59:48.354520 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 22:59:48.354520 n-d-850468-14 devstack@n-api.service[122632]: exception: Volume 0adcc443-b619-4d6c-8b36-220e979c4569 could not be found. Aug 10 22:59:48.355544 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'server_id': '3553ba91-ca7b-44d9-944a-1540fa047cb6', 'id': '0d0219e7-5148-47c2-869d-347f08238220', 'body': {'volumeAttachment': {'volumeId': '0adcc443-b619-4d6c-8b36-220e979c4569'}}} Aug 10 22:59:48.355544 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 22:59:48.355544 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:59:48.355544 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 22:59:48.355544 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 22:59:48.355544 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 10 22:59:48.355544 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 10 22:59:48.355544 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 10 22:59:48.355544 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 10 22:59:48.355544 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 10 22:59:48.355544 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 10 22:59:48.355544 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 10 22:59:48.355544 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 10 22:59:48.355544 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 22:59:48.355544 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 22:59:48.355544 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 22:59:48.355544 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 22:59:48.356711 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0adcc443-b619-4d6c-8b36-220e979c4569 could not be found. (HTTP 404) (Request-ID: req-dd7c76dd-3d45-41f7-a471-33b0b0bb1a42) Aug 10 22:59:48.356711 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:59:48.356711 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:59:48.356711 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:59:48.356711 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:59:48.356711 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Aug 10 22:59:48.356711 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Aug 10 22:59:48.356711 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 10 22:59:48.356711 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 10 22:59:48.356711 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 10 22:59:48.356711 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 10 22:59:48.356711 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 10 22:59:48.356711 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 10 22:59:48.356711 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 22:59:48.356711 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 22:59:48.356711 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 10 22:59:48.356711 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 10 22:59:48.356711 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 10 22:59:48.356711 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 10 22:59:48.358075 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 10 22:59:48.358075 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 10 22:59:48.358075 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 10 22:59:48.358075 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 10 22:59:48.358075 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 22:59:48.358075 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 22:59:48.358075 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 22:59:48.358075 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 22:59:48.358075 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0adcc443-b619-4d6c-8b36-220e979c4569 could not be found. Aug 10 22:59:48.358075 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:59:48.358075 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:59:48.358075 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:59:48.358075 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:59:48.358075 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:59:48.358075 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:59:48.358075 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 22:59:48.358075 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 22:59:48.358075 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 22:59:48.358075 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 22:59:48.359516 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 22:59:48.359516 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 22:59:48.359516 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 22:59:48.359516 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 22:59:48.359516 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Aug 10 22:59:48.359516 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Aug 10 22:59:48.359516 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Aug 10 22:59:48.359516 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 10 22:59:48.359516 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume 0adcc443-b619-4d6c-8b36-220e979c4569 could not be found. Aug 10 22:59:48.359516 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:59:48.359516 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:59:48.359516 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:59:48.359516 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:59:48.359516 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:59:48.359516 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:59:48.359516 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 22:59:48.359516 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 22:59:48.359516 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0adcc443-b619-4d6c-8b36-220e979c4569 could not be found. Aug 10 22:59:48.359516 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:59:48.363805 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-7bc19150-6e3b-42a9-8b84-925aaf721a5f tempest-VolumesAdminNegativeTest-2021290746 tempest-VolumesAdminNegativeTest-2021290746-project-admin] Returning 400 to user: Volume 0adcc443-b619-4d6c-8b36-220e979c4569 could not be found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 22:59:48.364911 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-7bc19150-6e3b-42a9-8b84-925aaf721a5f tempest-VolumesAdminNegativeTest-2021290746 tempest-VolumesAdminNegativeTest-2021290746-project-admin] 10.222.0.58 "PUT /compute/v2.1/servers/3553ba91-ca7b-44d9-944a-1540fa047cb6/os-volume_attachments/0d0219e7-5148-47c2-869d-347f08238220" status: 400 len: 107 microversion: 2.1 time: 0.696666 Aug 10 22:59:48.370289 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 475/969] 10.222.0.58 () {60 vars in 1433 bytes} [Wed Aug 10 22:59:47 2022] PUT /compute/v2.1/servers/3553ba91-ca7b-44d9-944a-1540fa047cb6/os-volume_attachments/0d0219e7-5148-47c2-869d-347f08238220 => generated 107 bytes in 702 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 10 22:59:48.371608 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-eca10d1c-3d5f-4715-afe3-84eba127fd97 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] 10.222.0.58 "GET /compute/v2.1/servers/8e91f1ac-f79d-4ab0-aa13-ea32b0e74888" status: 200 len: 1360 microversion: 2.1 time: 0.855769 Aug 10 22:59:48.372211 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 495/970] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:59:47 2022] GET /compute/v2.1/servers/8e91f1ac-f79d-4ab0-aa13-ea32b0e74888 => generated 1360 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:59:48.387476 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-364d806d-9add-4077-8eaf-f652f309b890 req-32b61f1c-e806-42ba-94b8-6baec8a26c39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d716cac6-ac7c-4b98-b6ea-2496ccd62096", "name": "network-vif-plugged", "status": "completed", "tag": "30ea23cf-a364-4798-a6be-6ab46d11599e"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:59:48.397606 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-73540922-cb22-4ff0-b158-b558caef4c23 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:48.398239 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-73540922-cb22-4ff0-b158-b558caef4c23 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] [instance: f3722f40-7320-484b-8c20-78b2de3e89f1] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:48.411959 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-364d806d-9add-4077-8eaf-f652f309b890 req-32b61f1c-e806-42ba-94b8-6baec8a26c39 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:48.423400 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-364d806d-9add-4077-8eaf-f652f309b890 req-32b61f1c-e806-42ba-94b8-6baec8a26c39 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:48.424039 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-364d806d-9add-4077-8eaf-f652f309b890 req-32b61f1c-e806-42ba-94b8-6baec8a26c39 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:48.429891 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-73540922-cb22-4ff0-b158-b558caef4c23 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:48.430443 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-73540922-cb22-4ff0-b158-b558caef4c23 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:48.431661 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-73540922-cb22-4ff0-b158-b558caef4c23 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:48.432446 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-73540922-cb22-4ff0-b158-b558caef4c23 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:48.432962 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-73540922-cb22-4ff0-b158-b558caef4c23 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:48.433401 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-73540922-cb22-4ff0-b158-b558caef4c23 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:48.441503 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-364d806d-9add-4077-8eaf-f652f309b890 req-32b61f1c-e806-42ba-94b8-6baec8a26c39 service nova] Creating event network-vif-plugged:30ea23cf-a364-4798-a6be-6ab46d11599e for instance d716cac6-ac7c-4b98-b6ea-2496ccd62096 on n-h2-850468-14 Aug 10 22:59:48.451346 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-364d806d-9add-4077-8eaf-f652f309b890 req-32b61f1c-e806-42ba-94b8-6baec8a26c39 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074637 Aug 10 22:59:48.452233 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 476/971] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 22:59:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:59:48.458387 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c87ae3cf-33a9-4797-92d0-09908a4c0039 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:48.459373 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-c87ae3cf-33a9-4797-92d0-09908a4c0039 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 1464324b-6977-4faa-8b84-370603a77429] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:48.484145 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c87ae3cf-33a9-4797-92d0-09908a4c0039 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:48.485257 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c87ae3cf-33a9-4797-92d0-09908a4c0039 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:48.486186 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c87ae3cf-33a9-4797-92d0-09908a4c0039 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:48.487666 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c87ae3cf-33a9-4797-92d0-09908a4c0039 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:48.488286 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c87ae3cf-33a9-4797-92d0-09908a4c0039 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:48.488868 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c87ae3cf-33a9-4797-92d0-09908a4c0039 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:48.702677 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-c87ae3cf-33a9-4797-92d0-09908a4c0039 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:59:48.713500 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-c87ae3cf-33a9-4797-92d0-09908a4c0039 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/1464324b-6977-4faa-8b84-370603a77429" status: 200 len: 1542 microversion: 2.1 time: 0.259893 Aug 10 22:59:48.714706 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 477/972] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:59:48 2022] GET /compute/v2.1/servers/1464324b-6977-4faa-8b84-370603a77429 => generated 1542 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:59:48.724113 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-b6da6be5-65d1-43fa-9da5-9672ff0265ef tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:48.724846 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-b6da6be5-65d1-43fa-9da5-9672ff0265ef tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] [instance: 3553ba91-ca7b-44d9-944a-1540fa047cb6] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:48.732661 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b6da6be5-65d1-43fa-9da5-9672ff0265ef tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:48.733393 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b6da6be5-65d1-43fa-9da5-9672ff0265ef tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:48.734198 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b6da6be5-65d1-43fa-9da5-9672ff0265ef tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:48.735239 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b6da6be5-65d1-43fa-9da5-9672ff0265ef tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:48.743245 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b6da6be5-65d1-43fa-9da5-9672ff0265ef tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:48.744263 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b6da6be5-65d1-43fa-9da5-9672ff0265ef tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:48.888778 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-73540922-cb22-4ff0-b158-b558caef4c23 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6d9806b6724e5aaf8c69be8e70d4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307ab95daa034afbb31f90626885072b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:59:48.902359 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-73540922-cb22-4ff0-b158-b558caef4c23 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] 10.222.0.58 "GET /compute/v2.1/servers/f3722f40-7320-484b-8c20-78b2de3e89f1" status: 200 len: 1498 microversion: 2.1 time: 0.523030 Aug 10 22:59:48.904640 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 496/973] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:59:48 2022] GET /compute/v2.1/servers/f3722f40-7320-484b-8c20-78b2de3e89f1 => generated 1498 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:59:48.916073 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-a02d386d-20b9-484d-b1e3-31619f2fb5ec tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Calling method '.version_select at 0x7f847d3984c0>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:48.941939 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.objects.instance [None req-b6da6be5-65d1-43fa-9da5-9672ff0265ef tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lazy-loading 'services' on Instance uuid 3553ba91-ca7b-44d9-944a-1540fa047cb6 {{(pid=122632) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 22:59:49.005898 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-a02d386d-20b9-484d-b1e3-31619f2fb5ec tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] 10.222.0.58 "GET /compute/v2.1/images/be4c34b4-d5ba-42f3-8dac-aa84837569a0" status: 200 len: 1455 microversion: 2.1 time: 0.100132 Aug 10 22:59:49.007109 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 497/974] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 10 22:59:48 2022] GET /compute/v2.1/images/be4c34b4-d5ba-42f3-8dac-aa84837569a0 => generated 1455 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:59:49.025939 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:59:49.137305 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-b6da6be5-65d1-43fa-9da5-9672ff0265ef tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] 10.222.0.58 "DELETE /compute/v2.1/servers/3553ba91-ca7b-44d9-944a-1540fa047cb6/os-volume_attachments/0d0219e7-5148-47c2-869d-347f08238220" status: 202 len: 0 microversion: 2.1 time: 0.421098 Aug 10 22:59:49.137906 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 478/975] 10.222.0.58 () {58 vars in 1416 bytes} [Wed Aug 10 22:59:48 2022] DELETE /compute/v2.1/servers/3553ba91-ca7b-44d9-944a-1540fa047cb6/os-volume_attachments/0d0219e7-5148-47c2-869d-347f08238220 => generated 0 bytes in 422 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 22:59:49.147564 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-736e4edc-3bb8-430b-be14-ac83fafec434 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:49.149873 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-736e4edc-3bb8-430b-be14-ac83fafec434 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] [instance: 3553ba91-ca7b-44d9-944a-1540fa047cb6] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:49.169917 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-736e4edc-3bb8-430b-be14-ac83fafec434 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:49.170417 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-736e4edc-3bb8-430b-be14-ac83fafec434 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:49.176252 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-736e4edc-3bb8-430b-be14-ac83fafec434 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:49.182255 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-736e4edc-3bb8-430b-be14-ac83fafec434 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:49.182747 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-736e4edc-3bb8-430b-be14-ac83fafec434 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:49.188543 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-736e4edc-3bb8-430b-be14-ac83fafec434 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:49.259662 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-736e4edc-3bb8-430b-be14-ac83fafec434 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] 10.222.0.58 "GET /compute/v2.1/servers/3553ba91-ca7b-44d9-944a-1540fa047cb6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.115259 Aug 10 22:59:49.265231 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 498/976] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 10 22:59:49 2022] GET /compute/v2.1/servers/3553ba91-ca7b-44d9-944a-1540fa047cb6/os-volume_attachments => generated 197 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:59:49.400219 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-43d95e85-7b5c-4447-bc55-aed9c9b1581c tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:49.401194 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-43d95e85-7b5c-4447-bc55-aed9c9b1581c tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] [instance: 8e91f1ac-f79d-4ab0-aa13-ea32b0e74888] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:49.408710 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-43d95e85-7b5c-4447-bc55-aed9c9b1581c tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:49.409525 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-43d95e85-7b5c-4447-bc55-aed9c9b1581c tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:49.410249 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-43d95e85-7b5c-4447-bc55-aed9c9b1581c tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:49.411514 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-43d95e85-7b5c-4447-bc55-aed9c9b1581c tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:49.412423 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-43d95e85-7b5c-4447-bc55-aed9c9b1581c tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:49.413213 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-43d95e85-7b5c-4447-bc55-aed9c9b1581c tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:49.666229 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-43d95e85-7b5c-4447-bc55-aed9c9b1581c tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632904331d024d9b8e4d3660dff2cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ed0bdee3aa4013bd9219069bda558c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:59:49.683121 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-43d95e85-7b5c-4447-bc55-aed9c9b1581c tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] 10.222.0.58 "GET /compute/v2.1/servers/8e91f1ac-f79d-4ab0-aa13-ea32b0e74888" status: 200 len: 1360 microversion: 2.1 time: 0.289023 Aug 10 22:59:49.685317 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 479/977] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:59:49 2022] GET /compute/v2.1/servers/8e91f1ac-f79d-4ab0-aa13-ea32b0e74888 => generated 1360 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:59:49.739871 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-4620fd9b-e9ae-4d6a-95ea-3064f334bed7 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:49.740581 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-4620fd9b-e9ae-4d6a-95ea-3064f334bed7 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 1464324b-6977-4faa-8b84-370603a77429] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:49.753779 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4620fd9b-e9ae-4d6a-95ea-3064f334bed7 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:49.754498 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4620fd9b-e9ae-4d6a-95ea-3064f334bed7 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:49.755016 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4620fd9b-e9ae-4d6a-95ea-3064f334bed7 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:49.755746 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4620fd9b-e9ae-4d6a-95ea-3064f334bed7 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:49.756725 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4620fd9b-e9ae-4d6a-95ea-3064f334bed7 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:49.757346 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4620fd9b-e9ae-4d6a-95ea-3064f334bed7 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:49.923835 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-4bd29b46-f06b-4ee6-948a-63faea30a34f tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:49.924484 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-4bd29b46-f06b-4ee6-948a-63faea30a34f tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] [instance: f3722f40-7320-484b-8c20-78b2de3e89f1] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:49.942437 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4bd29b46-f06b-4ee6-948a-63faea30a34f tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:49.942971 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4bd29b46-f06b-4ee6-948a-63faea30a34f tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:49.943417 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4bd29b46-f06b-4ee6-948a-63faea30a34f tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:49.951145 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4bd29b46-f06b-4ee6-948a-63faea30a34f tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:49.951801 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4bd29b46-f06b-4ee6-948a-63faea30a34f tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:49.952274 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4bd29b46-f06b-4ee6-948a-63faea30a34f tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:50.085860 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-4620fd9b-e9ae-4d6a-95ea-3064f334bed7 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:59:50.096278 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-4620fd9b-e9ae-4d6a-95ea-3064f334bed7 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/1464324b-6977-4faa-8b84-370603a77429" status: 200 len: 1542 microversion: 2.1 time: 0.360187 Aug 10 22:59:50.112334 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 499/978] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:59:49 2022] GET /compute/v2.1/servers/1464324b-6977-4faa-8b84-370603a77429 => generated 1542 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:59:50.118218 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-d436eeba-25e5-4b03-a3c0-53e033042909 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Calling method '.version_select at 0x7f847d3ba790>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:50.208003 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-d436eeba-25e5-4b03-a3c0-53e033042909 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] 10.222.0.58 "GET /compute/v2.1/images/be4c34b4-d5ba-42f3-8dac-aa84837569a0" status: 200 len: 1455 microversion: 2.1 time: 0.093483 Aug 10 22:59:50.208598 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 500/979] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 10 22:59:50 2022] GET /compute/v2.1/images/be4c34b4-d5ba-42f3-8dac-aa84837569a0 => generated 1455 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:59:50.230102 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-4bd29b46-f06b-4ee6-948a-63faea30a34f tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6d9806b6724e5aaf8c69be8e70d4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307ab95daa034afbb31f90626885072b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:59:50.247197 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-4bd29b46-f06b-4ee6-948a-63faea30a34f tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] 10.222.0.58 "GET /compute/v2.1/servers/f3722f40-7320-484b-8c20-78b2de3e89f1" status: 200 len: 1498 microversion: 2.1 time: 0.327035 Aug 10 22:59:50.248203 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 480/980] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:59:49 2022] GET /compute/v2.1/servers/f3722f40-7320-484b-8c20-78b2de3e89f1 => generated 1498 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:59:50.274713 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-fa2e8332-660b-44db-8488-49fb18280d00 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:50.277431 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-fa2e8332-660b-44db-8488-49fb18280d00 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] [instance: 3553ba91-ca7b-44d9-944a-1540fa047cb6] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:50.284844 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fa2e8332-660b-44db-8488-49fb18280d00 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:50.285608 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fa2e8332-660b-44db-8488-49fb18280d00 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:50.286208 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fa2e8332-660b-44db-8488-49fb18280d00 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:50.287162 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fa2e8332-660b-44db-8488-49fb18280d00 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:50.293342 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fa2e8332-660b-44db-8488-49fb18280d00 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:50.298169 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fa2e8332-660b-44db-8488-49fb18280d00 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:50.312152 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=100 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:59:50.377159 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-fa2e8332-660b-44db-8488-49fb18280d00 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] 10.222.0.58 "GET /compute/v2.1/servers/3553ba91-ca7b-44d9-944a-1540fa047cb6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.107902 Aug 10 22:59:50.387113 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 501/981] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 10 22:59:50 2022] GET /compute/v2.1/servers/3553ba91-ca7b-44d9-944a-1540fa047cb6/os-volume_attachments => generated 197 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:59:50.708315 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-6ac35185-3188-4936-a313-3d977367cbaa tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:50.709022 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-6ac35185-3188-4936-a313-3d977367cbaa tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] [instance: 8e91f1ac-f79d-4ab0-aa13-ea32b0e74888] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:50.716648 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-8bc3465a-e54f-42f4-a26a-080f34f07604 req-1c8a3538-cdd3-4dac-a2fb-665fb3d6f8eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e91f1ac-f79d-4ab0-aa13-ea32b0e74888", "name": "network-vif-plugged", "status": "completed", "tag": "19d4795c-3095-41be-b300-ea441bb13af4"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:59:50.720386 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6ac35185-3188-4936-a313-3d977367cbaa tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:50.723330 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6ac35185-3188-4936-a313-3d977367cbaa tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:50.726569 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6ac35185-3188-4936-a313-3d977367cbaa tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:50.727462 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6ac35185-3188-4936-a313-3d977367cbaa tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:50.731164 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6ac35185-3188-4936-a313-3d977367cbaa tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:50.733996 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6ac35185-3188-4936-a313-3d977367cbaa tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:50.739434 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-8bc3465a-e54f-42f4-a26a-080f34f07604 req-1c8a3538-cdd3-4dac-a2fb-665fb3d6f8eb service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:50.740338 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-8bc3465a-e54f-42f4-a26a-080f34f07604 req-1c8a3538-cdd3-4dac-a2fb-665fb3d6f8eb service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:50.741562 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-8bc3465a-e54f-42f4-a26a-080f34f07604 req-1c8a3538-cdd3-4dac-a2fb-665fb3d6f8eb service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:50.755690 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-8bc3465a-e54f-42f4-a26a-080f34f07604 req-1c8a3538-cdd3-4dac-a2fb-665fb3d6f8eb service nova] Creating event network-vif-plugged:19d4795c-3095-41be-b300-ea441bb13af4 for instance 8e91f1ac-f79d-4ab0-aa13-ea32b0e74888 on n-h2-850468-14 Aug 10 22:59:50.764795 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-8bc3465a-e54f-42f4-a26a-080f34f07604 req-1c8a3538-cdd3-4dac-a2fb-665fb3d6f8eb service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052155 Aug 10 22:59:50.766020 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 502/982] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 22:59:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:59:51.065782 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-6ac35185-3188-4936-a313-3d977367cbaa tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632904331d024d9b8e4d3660dff2cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ed0bdee3aa4013bd9219069bda558c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:59:51.077903 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-6ac35185-3188-4936-a313-3d977367cbaa tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] 10.222.0.58 "GET /compute/v2.1/servers/8e91f1ac-f79d-4ab0-aa13-ea32b0e74888" status: 200 len: 1360 microversion: 2.1 time: 0.373994 Aug 10 22:59:51.085958 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 481/983] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:59:50 2022] GET /compute/v2.1/servers/8e91f1ac-f79d-4ab0-aa13-ea32b0e74888 => generated 1360 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:59:51.119161 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-eb0d9f68-93f3-4239-910c-05f3eadbccf4 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:51.119889 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-eb0d9f68-93f3-4239-910c-05f3eadbccf4 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 1464324b-6977-4faa-8b84-370603a77429] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:51.136610 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-eb0d9f68-93f3-4239-910c-05f3eadbccf4 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:51.137310 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-eb0d9f68-93f3-4239-910c-05f3eadbccf4 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:51.137929 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-eb0d9f68-93f3-4239-910c-05f3eadbccf4 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:51.139539 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-eb0d9f68-93f3-4239-910c-05f3eadbccf4 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:51.140005 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-eb0d9f68-93f3-4239-910c-05f3eadbccf4 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:51.140441 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-eb0d9f68-93f3-4239-910c-05f3eadbccf4 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:51.223585 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-f119c79f-d98c-4f44-b0eb-dfbbb1369993 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Calling method '.version_select at 0x7f847dd4f5e0>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:51.324219 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-f119c79f-d98c-4f44-b0eb-dfbbb1369993 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] 10.222.0.58 "GET /compute/v2.1/images/be4c34b4-d5ba-42f3-8dac-aa84837569a0" status: 200 len: 1455 microversion: 2.1 time: 0.104653 Aug 10 22:59:51.325718 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 482/984] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 10 22:59:51 2022] GET /compute/v2.1/images/be4c34b4-d5ba-42f3-8dac-aa84837569a0 => generated 1455 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:59:51.351559 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c30c8005-3ffa-466d-a113-6fb917c2bc81 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:51.354049 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-c30c8005-3ffa-466d-a113-6fb917c2bc81 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] [instance: f3722f40-7320-484b-8c20-78b2de3e89f1] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:51.370492 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c30c8005-3ffa-466d-a113-6fb917c2bc81 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:51.374576 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c30c8005-3ffa-466d-a113-6fb917c2bc81 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:51.375312 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c30c8005-3ffa-466d-a113-6fb917c2bc81 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:51.376420 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c30c8005-3ffa-466d-a113-6fb917c2bc81 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:51.377328 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c30c8005-3ffa-466d-a113-6fb917c2bc81 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:51.377987 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c30c8005-3ffa-466d-a113-6fb917c2bc81 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:51.434032 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-eb0d9f68-93f3-4239-910c-05f3eadbccf4 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:59:51.446353 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-eb0d9f68-93f3-4239-910c-05f3eadbccf4 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/1464324b-6977-4faa-8b84-370603a77429" status: 200 len: 1542 microversion: 2.1 time: 0.331606 Aug 10 22:59:51.447239 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 503/985] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:59:51 2022] GET /compute/v2.1/servers/1464324b-6977-4faa-8b84-370603a77429 => generated 1542 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:59:51.452030 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-2417d962-66c2-4b5d-9eb5-252608fddd4f tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:51.454213 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-2417d962-66c2-4b5d-9eb5-252608fddd4f tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] [instance: 3553ba91-ca7b-44d9-944a-1540fa047cb6] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:51.461960 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2417d962-66c2-4b5d-9eb5-252608fddd4f tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:51.462458 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2417d962-66c2-4b5d-9eb5-252608fddd4f tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:51.462933 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2417d962-66c2-4b5d-9eb5-252608fddd4f tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:51.463634 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2417d962-66c2-4b5d-9eb5-252608fddd4f tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:51.464088 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2417d962-66c2-4b5d-9eb5-252608fddd4f tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:51.464507 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2417d962-66c2-4b5d-9eb5-252608fddd4f tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:51.506190 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-2417d962-66c2-4b5d-9eb5-252608fddd4f tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] 10.222.0.58 "GET /compute/v2.1/servers/3553ba91-ca7b-44d9-944a-1540fa047cb6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049750 Aug 10 22:59:51.506190 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 504/986] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 10 22:59:51 2022] GET /compute/v2.1/servers/3553ba91-ca7b-44d9-944a-1540fa047cb6/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:59:51.637831 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-c30c8005-3ffa-466d-a113-6fb917c2bc81 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6d9806b6724e5aaf8c69be8e70d4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307ab95daa034afbb31f90626885072b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:59:51.648899 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-c30c8005-3ffa-466d-a113-6fb917c2bc81 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] 10.222.0.58 "GET /compute/v2.1/servers/f3722f40-7320-484b-8c20-78b2de3e89f1" status: 200 len: 1498 microversion: 2.1 time: 0.321853 Aug 10 22:59:51.653172 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 483/987] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:59:51 2022] GET /compute/v2.1/servers/f3722f40-7320-484b-8c20-78b2de3e89f1 => generated 1498 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:59:52.114755 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c1c49bb2-1f3d-4517-b1f3-a8431d5691ce tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:52.116384 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-c1c49bb2-1f3d-4517-b1f3-a8431d5691ce tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] [instance: 8e91f1ac-f79d-4ab0-aa13-ea32b0e74888] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:52.133623 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c1c49bb2-1f3d-4517-b1f3-a8431d5691ce tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:52.138152 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c1c49bb2-1f3d-4517-b1f3-a8431d5691ce tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:52.141590 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c1c49bb2-1f3d-4517-b1f3-a8431d5691ce tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:52.143238 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c1c49bb2-1f3d-4517-b1f3-a8431d5691ce tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:52.145180 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c1c49bb2-1f3d-4517-b1f3-a8431d5691ce tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:52.147523 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c1c49bb2-1f3d-4517-b1f3-a8431d5691ce tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:52.340566 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-4e8b2581-4839-457d-8bf4-4cd269f87f11 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Calling method '.version_select at 0x7f847d8bf550>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:52.407931 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-4e8b2581-4839-457d-8bf4-4cd269f87f11 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] 10.222.0.58 "GET /compute/v2.1/images/be4c34b4-d5ba-42f3-8dac-aa84837569a0" status: 200 len: 1455 microversion: 2.1 time: 0.072008 Aug 10 22:59:52.409244 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 484/988] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 10 22:59:52 2022] GET /compute/v2.1/images/be4c34b4-d5ba-42f3-8dac-aa84837569a0 => generated 1455 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:59:52.477767 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-8a2dd98d-e993-4fde-912f-86c60b284c5e tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:52.478830 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-8a2dd98d-e993-4fde-912f-86c60b284c5e tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 1464324b-6977-4faa-8b84-370603a77429] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:52.489750 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8a2dd98d-e993-4fde-912f-86c60b284c5e tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:52.493097 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8a2dd98d-e993-4fde-912f-86c60b284c5e tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:52.494005 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8a2dd98d-e993-4fde-912f-86c60b284c5e tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:52.495125 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8a2dd98d-e993-4fde-912f-86c60b284c5e tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:52.495908 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8a2dd98d-e993-4fde-912f-86c60b284c5e tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:52.496616 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8a2dd98d-e993-4fde-912f-86c60b284c5e tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:52.610376 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-c1c49bb2-1f3d-4517-b1f3-a8431d5691ce tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632904331d024d9b8e4d3660dff2cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ed0bdee3aa4013bd9219069bda558c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:59:52.620486 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-c1c49bb2-1f3d-4517-b1f3-a8431d5691ce tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] 10.222.0.58 "GET /compute/v2.1/servers/8e91f1ac-f79d-4ab0-aa13-ea32b0e74888" status: 200 len: 1360 microversion: 2.1 time: 0.516311 Aug 10 22:59:52.621642 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 505/989] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:59:52 2022] GET /compute/v2.1/servers/8e91f1ac-f79d-4ab0-aa13-ea32b0e74888 => generated 1360 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:59:52.629284 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-d5bbb267-3291-45d3-a8f3-ecfe336916ca tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:52.631830 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-d5bbb267-3291-45d3-a8f3-ecfe336916ca tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] [instance: 3553ba91-ca7b-44d9-944a-1540fa047cb6] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:52.640051 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d5bbb267-3291-45d3-a8f3-ecfe336916ca tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:52.640814 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d5bbb267-3291-45d3-a8f3-ecfe336916ca tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:52.644623 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d5bbb267-3291-45d3-a8f3-ecfe336916ca tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:52.645806 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d5bbb267-3291-45d3-a8f3-ecfe336916ca tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:52.646429 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d5bbb267-3291-45d3-a8f3-ecfe336916ca tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:52.650031 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d5bbb267-3291-45d3-a8f3-ecfe336916ca tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:52.688359 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-d5bbb267-3291-45d3-a8f3-ecfe336916ca tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] 10.222.0.58 "GET /compute/v2.1/servers/3553ba91-ca7b-44d9-944a-1540fa047cb6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065500 Aug 10 22:59:52.691832 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 506/990] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 10 22:59:52 2022] GET /compute/v2.1/servers/3553ba91-ca7b-44d9-944a-1540fa047cb6/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:59:52.700033 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c4f9361b-1b6b-4dd0-8020-cc1194b3d41b tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:52.735982 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-c4f9361b-1b6b-4dd0-8020-cc1194b3d41b tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] [instance: f3722f40-7320-484b-8c20-78b2de3e89f1] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:52.743265 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c4f9361b-1b6b-4dd0-8020-cc1194b3d41b tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:52.743759 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c4f9361b-1b6b-4dd0-8020-cc1194b3d41b tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:52.744180 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c4f9361b-1b6b-4dd0-8020-cc1194b3d41b tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:52.745072 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c4f9361b-1b6b-4dd0-8020-cc1194b3d41b tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:52.745523 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c4f9361b-1b6b-4dd0-8020-cc1194b3d41b tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:52.745940 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c4f9361b-1b6b-4dd0-8020-cc1194b3d41b tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:52.779098 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-8a2dd98d-e993-4fde-912f-86c60b284c5e tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:59:52.790154 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-8a2dd98d-e993-4fde-912f-86c60b284c5e tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/1464324b-6977-4faa-8b84-370603a77429" status: 200 len: 1542 microversion: 2.1 time: 0.320200 Aug 10 22:59:52.791337 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 485/991] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:59:52 2022] GET /compute/v2.1/servers/1464324b-6977-4faa-8b84-370603a77429 => generated 1542 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:59:52.858010 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-2fee6691-cf0f-4c9f-83ab-61e14573f803 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:52.858829 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-2fee6691-cf0f-4c9f-83ab-61e14573f803 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] [instance: 7599a318-7a19-4f4a-bbb6-162f7a207060] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:52.868760 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2fee6691-cf0f-4c9f-83ab-61e14573f803 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:52.869549 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2fee6691-cf0f-4c9f-83ab-61e14573f803 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:52.870143 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2fee6691-cf0f-4c9f-83ab-61e14573f803 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:52.879513 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2fee6691-cf0f-4c9f-83ab-61e14573f803 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:52.880975 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2fee6691-cf0f-4c9f-83ab-61e14573f803 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:52.881853 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2fee6691-cf0f-4c9f-83ab-61e14573f803 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:52.917468 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-2fee6691-cf0f-4c9f-83ab-61e14573f803 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] HTTP exception thrown: Instance 7599a318-7a19-4f4a-bbb6-162f7a207060 could not be found. Aug 10 22:59:52.919666 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-2fee6691-cf0f-4c9f-83ab-61e14573f803 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Request method failure captured: Aug 10 22:59:52.919666 n-d-850468-14 devstack@n-api.service[122632]: request: DELETE /compute/v2.1/servers/7599a318-7a19-4f4a-bbb6-162f7a207060 HTTP/1.1 Aug 10 22:59:52.919666 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 22:59:52.919666 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 22:59:52.919666 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 22:59:52.919666 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 22:59:52.919666 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 22:59:52.919666 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 22:59:52.919666 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 22:59:52.919666 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 22:59:52.919666 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9DewiuJdVoHNtUHdGGJp0zg8n2XPQ0k5_9_bhVmvR0L4c50AOE_HsUnVs_XYp3Ut1nfNSm0aJ3eKRzMv7IuaQMgSPD4f3umSzmxlCDg0ojfmA82W4VHsC9cWOvXZF2vgn6zJiIqUIuJD-L1N_gpOZvHl3WeJCqWSKDn9z5aPvhdfRl8 Aug 10 22:59:52.919666 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 22:59:52.919666 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 22:59:52.919666 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 22:59:52.919666 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 22:59:52.919666 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 22:59:52.919666 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 22:59:52.919666 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 29083d61c29b43b4b47539a141b3d1fb Aug 10 22:59:52.919666 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-232922240 Aug 10 22:59:52.919666 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 22:59:52.919666 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 22:59:52.921195 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/29083d61c29b43b4b47539a141b3d1fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/29083d61c29b43b4b47539a141b3d1fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/29083d61c29b43b4b47539a141b3d1fb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_29083d61c29b43b4b47539a141b3d1fb", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 22:59:52.921195 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-232922240 Aug 10 22:59:52.921195 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 29083d61c29b43b4b47539a141b3d1fb Aug 10 22:59:52.921195 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-232922240 Aug 10 22:59:52.921195 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-AttachSCSIVolumeTestJSON-232922240-project Aug 10 22:59:52.921195 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 22:59:52.921195 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 22:59:52.921195 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: 0415b5bdb48249d6b9f1ef7c92aad597 Aug 10 22:59:52.921195 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-232922240-project Aug 10 22:59:52.921195 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 22:59:52.921195 n-d-850468-14 devstack@n-api.service[122632]: exception: Instance 7599a318-7a19-4f4a-bbb6-162f7a207060 could not be found. Aug 10 22:59:52.921195 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': '7599a318-7a19-4f4a-bbb6-162f7a207060'} Aug 10 22:59:52.922044 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 22:59:52.922044 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:59:52.922044 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 22:59:52.922044 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 22:59:52.922044 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 22:59:52.922044 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 22:59:52.922044 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 22:59:52.922044 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 22:59:52.922044 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 22:59:52.922044 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 22:59:52.922044 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7599a318-7a19-4f4a-bbb6-162f7a207060 could not be found. Aug 10 22:59:52.922044 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:59:52.922044 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:59:52.922044 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:59:52.922044 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:59:52.922044 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:59:52.922044 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:59:52.922044 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 22:59:52.922044 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 22:59:52.922044 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 22:59:52.923598 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 22:59:52.923598 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 22:59:52.923598 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 22:59:52.923598 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 22:59:52.923598 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 22:59:52.923598 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 22:59:52.923598 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 22:59:52.923598 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 22:59:52.923598 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 22:59:52.923598 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7599a318-7a19-4f4a-bbb6-162f7a207060 could not be found. Aug 10 22:59:52.923598 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:59:52.923598 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:59:52.923598 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:59:52.923598 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:59:52.923598 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:59:52.923598 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:59:52.923598 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 22:59:52.923598 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 22:59:52.923598 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7599a318-7a19-4f4a-bbb6-162f7a207060 could not be found. Aug 10 22:59:52.923598 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:59:52.927625 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-2fee6691-cf0f-4c9f-83ab-61e14573f803 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Returning 404 to user: Instance 7599a318-7a19-4f4a-bbb6-162f7a207060 could not be found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 22:59:52.928703 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-2fee6691-cf0f-4c9f-83ab-61e14573f803 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] 10.222.0.58 "DELETE /compute/v2.1/servers/7599a318-7a19-4f4a-bbb6-162f7a207060" status: 404 len: 111 microversion: 2.1 time: 0.075662 Aug 10 22:59:52.932698 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 486/992] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 22:59:52 2022] DELETE /compute/v2.1/servers/7599a318-7a19-4f4a-bbb6-162f7a207060 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 10 22:59:52.939008 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-9b314460-8f81-42e5-9984-225f98ed85a0 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:52.939873 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-9b314460-8f81-42e5-9984-225f98ed85a0 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] [instance: 7599a318-7a19-4f4a-bbb6-162f7a207060] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:52.948363 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9b314460-8f81-42e5-9984-225f98ed85a0 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:52.949081 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9b314460-8f81-42e5-9984-225f98ed85a0 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:52.951957 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9b314460-8f81-42e5-9984-225f98ed85a0 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:52.952916 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9b314460-8f81-42e5-9984-225f98ed85a0 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:52.953670 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9b314460-8f81-42e5-9984-225f98ed85a0 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:52.954283 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9b314460-8f81-42e5-9984-225f98ed85a0 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:52.972268 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-9b314460-8f81-42e5-9984-225f98ed85a0 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] HTTP exception thrown: Instance 7599a318-7a19-4f4a-bbb6-162f7a207060 could not be found. Aug 10 22:59:52.974093 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-9b314460-8f81-42e5-9984-225f98ed85a0 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Request method failure captured: Aug 10 22:59:52.974093 n-d-850468-14 devstack@n-api.service[122632]: request: GET /compute/v2.1/servers/7599a318-7a19-4f4a-bbb6-162f7a207060 HTTP/1.1 Aug 10 22:59:52.974093 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 22:59:52.974093 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 22:59:52.974093 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 22:59:52.974093 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 22:59:52.974093 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 22:59:52.974093 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 22:59:52.974093 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 22:59:52.974093 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 22:59:52.974093 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9DewiuJdVoHNtUHdGGJp0zg8n2XPQ0k5_9_bhVmvR0L4c50AOE_HsUnVs_XYp3Ut1nfNSm0aJ3eKRzMv7IuaQMgSPD4f3umSzmxlCDg0ojfmA82W4VHsC9cWOvXZF2vgn6zJiIqUIuJD-L1N_gpOZvHl3WeJCqWSKDn9z5aPvhdfRl8 Aug 10 22:59:52.974093 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 22:59:52.974093 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 22:59:52.974093 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 22:59:52.974093 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 22:59:52.974093 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 22:59:52.974093 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 22:59:52.974093 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 29083d61c29b43b4b47539a141b3d1fb Aug 10 22:59:52.974093 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-232922240 Aug 10 22:59:52.974093 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 22:59:52.974093 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 22:59:52.975719 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/29083d61c29b43b4b47539a141b3d1fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/29083d61c29b43b4b47539a141b3d1fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/29083d61c29b43b4b47539a141b3d1fb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_29083d61c29b43b4b47539a141b3d1fb", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 22:59:52.975719 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-232922240 Aug 10 22:59:52.975719 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 29083d61c29b43b4b47539a141b3d1fb Aug 10 22:59:52.975719 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-232922240 Aug 10 22:59:52.975719 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-AttachSCSIVolumeTestJSON-232922240-project Aug 10 22:59:52.975719 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 22:59:52.975719 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 22:59:52.975719 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: 0415b5bdb48249d6b9f1ef7c92aad597 Aug 10 22:59:52.975719 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-232922240-project Aug 10 22:59:52.975719 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 22:59:52.975719 n-d-850468-14 devstack@n-api.service[122632]: exception: Instance 7599a318-7a19-4f4a-bbb6-162f7a207060 could not be found. Aug 10 22:59:52.975719 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': '7599a318-7a19-4f4a-bbb6-162f7a207060'} Aug 10 22:59:52.976533 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 22:59:52.976533 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:59:52.976533 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 22:59:52.976533 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 22:59:52.976533 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 22:59:52.976533 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 22:59:52.976533 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 22:59:52.976533 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 22:59:52.976533 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 22:59:52.976533 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 22:59:52.976533 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7599a318-7a19-4f4a-bbb6-162f7a207060 could not be found. Aug 10 22:59:52.976533 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:59:52.976533 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:59:52.976533 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:59:52.976533 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:59:52.976533 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:59:52.976533 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:59:52.976533 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 22:59:52.976533 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 22:59:52.976533 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 22:59:52.978042 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 22:59:52.978042 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 22:59:52.978042 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 22:59:52.978042 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 22:59:52.978042 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 22:59:52.978042 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 22:59:52.978042 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 22:59:52.978042 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7599a318-7a19-4f4a-bbb6-162f7a207060 could not be found. Aug 10 22:59:52.978042 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:59:52.978042 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 22:59:52.978042 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:59:52.978042 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 22:59:52.978042 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 22:59:52.978042 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 22:59:52.978042 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 22:59:52.978042 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 22:59:52.978042 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7599a318-7a19-4f4a-bbb6-162f7a207060 could not be found. Aug 10 22:59:52.978042 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 22:59:52.981022 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-9b314460-8f81-42e5-9984-225f98ed85a0 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] Returning 404 to user: Instance 7599a318-7a19-4f4a-bbb6-162f7a207060 could not be found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 22:59:52.982045 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-9b314460-8f81-42e5-9984-225f98ed85a0 tempest-AttachSCSIVolumeTestJSON-232922240 tempest-AttachSCSIVolumeTestJSON-232922240-project] 10.222.0.58 "GET /compute/v2.1/servers/7599a318-7a19-4f4a-bbb6-162f7a207060" status: 404 len: 111 microversion: 2.1 time: 0.048190 Aug 10 22:59:52.995720 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 487/993] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:59:52 2022] GET /compute/v2.1/servers/7599a318-7a19-4f4a-bbb6-162f7a207060 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 22:59:53.048788 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-c4f9361b-1b6b-4dd0-8020-cc1194b3d41b tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6d9806b6724e5aaf8c69be8e70d4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307ab95daa034afbb31f90626885072b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:59:53.069104 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-c4f9361b-1b6b-4dd0-8020-cc1194b3d41b tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] 10.222.0.58 "GET /compute/v2.1/servers/f3722f40-7320-484b-8c20-78b2de3e89f1" status: 200 len: 1498 microversion: 2.1 time: 0.371156 Aug 10 22:59:53.089791 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 507/994] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:59:52 2022] GET /compute/v2.1/servers/f3722f40-7320-484b-8c20-78b2de3e89f1 => generated 1498 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:59:53.293564 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-5ff58a9d-975a-419e-b101-9b4c8698107f tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1615870572", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:59:53.414416 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.network.neutron [None req-5ff58a9d-975a-419e-b101-9b4c8698107f tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] validate_networks() for None {{(pid=122632) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 22:59:53.423093 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-cdefc0cd-bd0b-4cff-b147-cb849eb82599 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Calling method '.version_select at 0x7f847d3b23a0>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:53.494610 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-cdefc0cd-bd0b-4cff-b147-cb849eb82599 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] 10.222.0.58 "GET /compute/v2.1/images/be4c34b4-d5ba-42f3-8dac-aa84837569a0" status: 200 len: 1455 microversion: 2.1 time: 0.075429 Aug 10 22:59:53.502058 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 508/995] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 10 22:59:53 2022] GET /compute/v2.1/images/be4c34b4-d5ba-42f3-8dac-aa84837569a0 => generated 1455 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:59:53.646499 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-e5cf3ec8-cb35-4ce8-a05c-fb7f25a6a1ba tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:53.647283 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-e5cf3ec8-cb35-4ce8-a05c-fb7f25a6a1ba tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] [instance: 8e91f1ac-f79d-4ab0-aa13-ea32b0e74888] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:53.661206 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e5cf3ec8-cb35-4ce8-a05c-fb7f25a6a1ba tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:53.661841 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e5cf3ec8-cb35-4ce8-a05c-fb7f25a6a1ba tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:53.664461 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e5cf3ec8-cb35-4ce8-a05c-fb7f25a6a1ba tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:53.665322 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e5cf3ec8-cb35-4ce8-a05c-fb7f25a6a1ba tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:53.667565 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e5cf3ec8-cb35-4ce8-a05c-fb7f25a6a1ba tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:53.668142 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e5cf3ec8-cb35-4ce8-a05c-fb7f25a6a1ba tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:53.967957 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-e5cf3ec8-cb35-4ce8-a05c-fb7f25a6a1ba tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632904331d024d9b8e4d3660dff2cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ed0bdee3aa4013bd9219069bda558c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:59:53.979860 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-e5cf3ec8-cb35-4ce8-a05c-fb7f25a6a1ba tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] 10.222.0.58 "GET /compute/v2.1/servers/8e91f1ac-f79d-4ab0-aa13-ea32b0e74888" status: 200 len: 1543 microversion: 2.1 time: 0.338680 Aug 10 22:59:53.982839 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 509/996] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:59:53 2022] GET /compute/v2.1/servers/8e91f1ac-f79d-4ab0-aa13-ea32b0e74888 => generated 1543 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 22:59:53.999239 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-365e023e-f233-41b4-a061-59a6c589c3d7 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:54.001963 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-365e023e-f233-41b4-a061-59a6c589c3d7 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] [instance: 3553ba91-ca7b-44d9-944a-1540fa047cb6] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:54.012734 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-365e023e-f233-41b4-a061-59a6c589c3d7 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:54.015825 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-365e023e-f233-41b4-a061-59a6c589c3d7 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:54.016395 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-365e023e-f233-41b4-a061-59a6c589c3d7 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:54.017859 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-365e023e-f233-41b4-a061-59a6c589c3d7 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:54.019909 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-365e023e-f233-41b4-a061-59a6c589c3d7 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:54.020482 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-365e023e-f233-41b4-a061-59a6c589c3d7 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:54.080115 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-365e023e-f233-41b4-a061-59a6c589c3d7 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] 10.222.0.58 "GET /compute/v2.1/servers/3553ba91-ca7b-44d9-944a-1540fa047cb6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.095766 Aug 10 22:59:54.085375 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 510/997] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 10 22:59:53 2022] GET /compute/v2.1/servers/3553ba91-ca7b-44d9-944a-1540fa047cb6/os-volume_attachments => generated 197 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:59:54.090818 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-e4f06b9f-f04f-4e44-a170-dfb76b5dc10f tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:54.091651 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-e4f06b9f-f04f-4e44-a170-dfb76b5dc10f tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 1464324b-6977-4faa-8b84-370603a77429] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:54.098731 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e4f06b9f-f04f-4e44-a170-dfb76b5dc10f tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:54.099511 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e4f06b9f-f04f-4e44-a170-dfb76b5dc10f tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:54.100120 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e4f06b9f-f04f-4e44-a170-dfb76b5dc10f tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:54.100984 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e4f06b9f-f04f-4e44-a170-dfb76b5dc10f tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:54.101589 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e4f06b9f-f04f-4e44-a170-dfb76b5dc10f tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:54.102168 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e4f06b9f-f04f-4e44-a170-dfb76b5dc10f tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:54.356494 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-e4f06b9f-f04f-4e44-a170-dfb76b5dc10f tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:59:54.366644 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-e4f06b9f-f04f-4e44-a170-dfb76b5dc10f tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/1464324b-6977-4faa-8b84-370603a77429" status: 200 len: 1542 microversion: 2.1 time: 0.279780 Aug 10 22:59:54.371218 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 511/998] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:59:54 2022] GET /compute/v2.1/servers/1464324b-6977-4faa-8b84-370603a77429 => generated 1542 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:59:54.385038 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-48093430-9aaf-4620-824c-f27ff2a65999 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:54.386813 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-48093430-9aaf-4620-824c-f27ff2a65999 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] [instance: 8e91f1ac-f79d-4ab0-aa13-ea32b0e74888] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:54.403510 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-48093430-9aaf-4620-824c-f27ff2a65999 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:54.404588 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-48093430-9aaf-4620-824c-f27ff2a65999 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:54.407027 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-48093430-9aaf-4620-824c-f27ff2a65999 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:54.408088 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-48093430-9aaf-4620-824c-f27ff2a65999 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:54.418985 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-48093430-9aaf-4620-824c-f27ff2a65999 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:54.420205 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-48093430-9aaf-4620-824c-f27ff2a65999 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:54.571994 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-48093430-9aaf-4620-824c-f27ff2a65999 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] 10.222.0.58 "GET /compute/v2.1/servers/8e91f1ac-f79d-4ab0-aa13-ea32b0e74888/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.195526 Aug 10 22:59:54.572965 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 512/999] 10.222.0.58 () {58 vars in 1275 bytes} [Wed Aug 10 22:59:54 2022] GET /compute/v2.1/servers/8e91f1ac-f79d-4ab0-aa13-ea32b0e74888/os-interface => generated 284 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:59:54.584316 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-11402061-7bb3-471c-a56f-b0d5984d02f6 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:54.592631 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-11402061-7bb3-471c-a56f-b0d5984d02f6 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] [instance: f3722f40-7320-484b-8c20-78b2de3e89f1] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:54.607856 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-11402061-7bb3-471c-a56f-b0d5984d02f6 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:54.609293 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-11402061-7bb3-471c-a56f-b0d5984d02f6 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:54.609923 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-11402061-7bb3-471c-a56f-b0d5984d02f6 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:54.611362 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-11402061-7bb3-471c-a56f-b0d5984d02f6 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:54.612373 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-11402061-7bb3-471c-a56f-b0d5984d02f6 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:54.613612 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-11402061-7bb3-471c-a56f-b0d5984d02f6 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:54.719982 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-5ff58a9d-975a-419e-b101-9b4c8698107f tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Flavor limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 22:59:54.721238 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-5ff58a9d-975a-419e-b101-9b4c8698107f tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Image limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 22:59:54.722102 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-5ff58a9d-975a-419e-b101-9b4c8698107f tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Flavor pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 22:59:54.722859 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-5ff58a9d-975a-419e-b101-9b4c8698107f tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Image pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 22:59:54.723513 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-5ff58a9d-975a-419e-b101-9b4c8698107f tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 22:59:54.743740 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5ff58a9d-975a-419e-b101-9b4c8698107f tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:54.745518 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5ff58a9d-975a-419e-b101-9b4c8698107f tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:54.747059 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5ff58a9d-975a-419e-b101-9b4c8698107f tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:54.749094 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5ff58a9d-975a-419e-b101-9b4c8698107f tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:54.751391 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5ff58a9d-975a-419e-b101-9b4c8698107f tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:54.752112 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5ff58a9d-975a-419e-b101-9b4c8698107f tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:54.819417 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-5ff58a9d-975a-419e-b101-9b4c8698107f tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Getting quotas for project b27e6ee9495a438b8450a4ef0d62cbcd. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 22:59:54.838090 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-5ff58a9d-975a-419e-b101-9b4c8698107f tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Getting quotas for user 417d4eaaeb1c4df78745496ececb3e88 and project b27e6ee9495a438b8450a4ef0d62cbcd. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 22:59:54.850401 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:59:54.868377 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-5ff58a9d-975a-419e-b101-9b4c8698107f tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Going to run 1 instances... {{(pid=122632) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 22:59:54.871494 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-5ff58a9d-975a-419e-b101-9b4c8698107f tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] [instance: 0af574c3-bfa0-4df6-8f0e-6fcd12e9b8a9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78ad8905-f66f-4733-8be9-2b260f1fabed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122632) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 22:59:54.977619 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-5ff58a9d-975a-419e-b101-9b4c8698107f tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.941345 Aug 10 22:59:54.987795 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 488/1000] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 22:59:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 1952 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 10 22:59:55.004069 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-7aa2cf21-6b00-4876-8176-1e6a03d99139 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Calling method '.version_select at 0x7f847dd50790>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:55.102961 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-7aa2cf21-6b00-4876-8176-1e6a03d99139 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] 10.222.0.58 "GET /compute/v2.1/images/be4c34b4-d5ba-42f3-8dac-aa84837569a0" status: 200 len: 1455 microversion: 2.1 time: 0.112199 Aug 10 22:59:55.112078 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 489/1001] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 10 22:59:54 2022] GET /compute/v2.1/images/be4c34b4-d5ba-42f3-8dac-aa84837569a0 => generated 1455 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:59:55.117394 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-6e672a31-bcac-4980-950f-cca6df24f86b tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:55.118093 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-6e672a31-bcac-4980-950f-cca6df24f86b tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] [instance: 0af574c3-bfa0-4df6-8f0e-6fcd12e9b8a9] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:55.452015 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-6e672a31-bcac-4980-950f-cca6df24f86b tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '417d4eaaeb1c4df78745496ececb3e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27e6ee9495a438b8450a4ef0d62cbcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:59:55.462349 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-6e672a31-bcac-4980-950f-cca6df24f86b tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] 10.222.0.58 "GET /compute/v2.1/servers/0af574c3-bfa0-4df6-8f0e-6fcd12e9b8a9" status: 200 len: 1217 microversion: 2.1 time: 0.349127 Aug 10 22:59:55.465714 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 490/1002] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:59:55 2022] GET /compute/v2.1/servers/0af574c3-bfa0-4df6-8f0e-6fcd12e9b8a9 => generated 1217 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:59:55.482714 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-a9ae66c9-93f4-44d4-a824-199f9b664215 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:55.491803 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-a9ae66c9-93f4-44d4-a824-199f9b664215 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] [instance: 3553ba91-ca7b-44d9-944a-1540fa047cb6] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:55.514348 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a9ae66c9-93f4-44d4-a824-199f9b664215 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:55.515469 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a9ae66c9-93f4-44d4-a824-199f9b664215 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:55.516415 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a9ae66c9-93f4-44d4-a824-199f9b664215 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:55.518136 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a9ae66c9-93f4-44d4-a824-199f9b664215 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:55.519013 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a9ae66c9-93f4-44d4-a824-199f9b664215 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:55.520768 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a9ae66c9-93f4-44d4-a824-199f9b664215 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:55.578759 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-a9ae66c9-93f4-44d4-a824-199f9b664215 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] 10.222.0.58 "GET /compute/v2.1/servers/3553ba91-ca7b-44d9-944a-1540fa047cb6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.106754 Aug 10 22:59:55.592901 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 491/1003] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 10 22:59:55 2022] GET /compute/v2.1/servers/3553ba91-ca7b-44d9-944a-1540fa047cb6/os-volume_attachments => generated 197 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:59:55.601727 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-087498aa-5b53-4bda-b627-16ede1fabcfa tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:55.615818 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-087498aa-5b53-4bda-b627-16ede1fabcfa tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] [instance: 99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:55.622649 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-087498aa-5b53-4bda-b627-16ede1fabcfa tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:55.623517 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-087498aa-5b53-4bda-b627-16ede1fabcfa tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:55.624212 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-087498aa-5b53-4bda-b627-16ede1fabcfa tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:55.625019 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-087498aa-5b53-4bda-b627-16ede1fabcfa tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:55.625527 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-087498aa-5b53-4bda-b627-16ede1fabcfa tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:55.626013 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-087498aa-5b53-4bda-b627-16ede1fabcfa tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:55.965033 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.objects.instance [None req-087498aa-5b53-4bda-b627-16ede1fabcfa tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Lazy-loading 'services' on Instance uuid 99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0 {{(pid=122632) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 22:59:56.006967 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-087498aa-5b53-4bda-b627-16ede1fabcfa tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0" status: 200 len: 2425 microversion: 2.25 time: 0.412564 Aug 10 22:59:56.008777 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 492/1004] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 22:59:55 2022] GET /compute/v2.1/servers/99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0 => generated 2425 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 22:59:56.016579 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-ce23383f-ba59-4457-a50c-dd00d43e1cbb tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:56.017535 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-ce23383f-ba59-4457-a50c-dd00d43e1cbb tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 1464324b-6977-4faa-8b84-370603a77429] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:56.031178 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ce23383f-ba59-4457-a50c-dd00d43e1cbb tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:56.033314 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ce23383f-ba59-4457-a50c-dd00d43e1cbb tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:56.034488 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ce23383f-ba59-4457-a50c-dd00d43e1cbb tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:56.035548 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ce23383f-ba59-4457-a50c-dd00d43e1cbb tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:56.036609 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ce23383f-ba59-4457-a50c-dd00d43e1cbb tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:56.037190 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ce23383f-ba59-4457-a50c-dd00d43e1cbb tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:56.500412 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-ce23383f-ba59-4457-a50c-dd00d43e1cbb tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:59:56.513111 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-ce23383f-ba59-4457-a50c-dd00d43e1cbb tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/1464324b-6977-4faa-8b84-370603a77429" status: 200 len: 1542 microversion: 2.1 time: 0.501724 Aug 10 22:59:56.528719 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 493/1005] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:59:56 2022] GET /compute/v2.1/servers/1464324b-6977-4faa-8b84-370603a77429 => generated 1542 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:59:56.536914 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-f27b1721-9b0b-40f2-b76f-a79b06aac624 tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-850468-14", "block_migration": "auto"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:59:56.542950 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-f27b1721-9b0b-40f2-b76f-a79b06aac624 tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] [instance: 99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:56.553474 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f27b1721-9b0b-40f2-b76f-a79b06aac624 tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:56.554241 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f27b1721-9b0b-40f2-b76f-a79b06aac624 tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:56.554892 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f27b1721-9b0b-40f2-b76f-a79b06aac624 tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:56.555986 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f27b1721-9b0b-40f2-b76f-a79b06aac624 tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:56.556591 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f27b1721-9b0b-40f2-b76f-a79b06aac624 tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:56.557291 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f27b1721-9b0b-40f2-b76f-a79b06aac624 tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:56.592613 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.objects.instance [None req-f27b1721-9b0b-40f2-b76f-a79b06aac624 tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Lazy-loading 'flavor' on Instance uuid 99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0 {{(pid=122632) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 22:59:56.610547 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-11402061-7bb3-471c-a56f-b0d5984d02f6 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6d9806b6724e5aaf8c69be8e70d4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307ab95daa034afbb31f90626885072b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:59:56.615291 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-f27b1721-9b0b-40f2-b76f-a79b06aac624 tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] [instance: 99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0] Going to try to live migrate instance to n-h1-850468-14 {{(pid=122632) live_migrate /opt/stack/nova/nova/compute/api.py:5443}} Aug 10 22:59:56.625990 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-11402061-7bb3-471c-a56f-b0d5984d02f6 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] 10.222.0.58 "GET /compute/v2.1/servers/f3722f40-7320-484b-8c20-78b2de3e89f1" status: 200 len: 1498 microversion: 2.1 time: 2.047673 Aug 10 22:59:56.641612 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 513/1006] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:59:54 2022] GET /compute/v2.1/servers/f3722f40-7320-484b-8c20-78b2de3e89f1 => generated 1498 bytes in 2068 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:59:56.648935 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-61df8aef-97a3-4227-af8d-53fd5aacc142 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Calling method '.version_select at 0x7f847d3de940>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:56.765269 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-61df8aef-97a3-4227-af8d-53fd5aacc142 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] 10.222.0.58 "GET /compute/v2.1/images/be4c34b4-d5ba-42f3-8dac-aa84837569a0" status: 200 len: 1455 microversion: 2.1 time: 0.120366 Aug 10 22:59:56.771148 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 514/1007] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 10 22:59:56 2022] GET /compute/v2.1/images/be4c34b4-d5ba-42f3-8dac-aa84837569a0 => generated 1455 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:59:56.782653 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-f72eed25-e300-4e2e-ab44-cdef8d4c6bac tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:56.783322 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-f72eed25-e300-4e2e-ab44-cdef8d4c6bac tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] [instance: 0af574c3-bfa0-4df6-8f0e-6fcd12e9b8a9] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:56.796138 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f72eed25-e300-4e2e-ab44-cdef8d4c6bac tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:56.796628 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f72eed25-e300-4e2e-ab44-cdef8d4c6bac tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:56.797067 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f72eed25-e300-4e2e-ab44-cdef8d4c6bac tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:56.797785 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f72eed25-e300-4e2e-ab44-cdef8d4c6bac tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:56.798244 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f72eed25-e300-4e2e-ab44-cdef8d4c6bac tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:56.798657 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f72eed25-e300-4e2e-ab44-cdef8d4c6bac tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:57.045109 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-f72eed25-e300-4e2e-ab44-cdef8d4c6bac tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '417d4eaaeb1c4df78745496ececb3e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27e6ee9495a438b8450a4ef0d62cbcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:59:57.053679 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-f72eed25-e300-4e2e-ab44-cdef8d4c6bac tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] 10.222.0.58 "GET /compute/v2.1/servers/0af574c3-bfa0-4df6-8f0e-6fcd12e9b8a9" status: 200 len: 1269 microversion: 2.1 time: 0.281369 Aug 10 22:59:57.060974 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 515/1008] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:59:56 2022] GET /compute/v2.1/servers/0af574c3-bfa0-4df6-8f0e-6fcd12e9b8a9 => generated 1269 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:59:57.066952 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-18cdd477-2182-40b3-ac5a-23e547abe747 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:57.094077 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-18cdd477-2182-40b3-ac5a-23e547abe747 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] [instance: 3553ba91-ca7b-44d9-944a-1540fa047cb6] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:57.139328 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-18cdd477-2182-40b3-ac5a-23e547abe747 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:57.139831 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-18cdd477-2182-40b3-ac5a-23e547abe747 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:57.140271 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-18cdd477-2182-40b3-ac5a-23e547abe747 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:57.141140 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-18cdd477-2182-40b3-ac5a-23e547abe747 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:57.141589 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-18cdd477-2182-40b3-ac5a-23e547abe747 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:57.144255 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-18cdd477-2182-40b3-ac5a-23e547abe747 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:57.245200 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-18cdd477-2182-40b3-ac5a-23e547abe747 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] 10.222.0.58 "GET /compute/v2.1/servers/3553ba91-ca7b-44d9-944a-1540fa047cb6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.183002 Aug 10 22:59:57.253163 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 516/1009] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 10 22:59:57 2022] GET /compute/v2.1/servers/3553ba91-ca7b-44d9-944a-1540fa047cb6/os-volume_attachments => generated 25 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 22:59:57.540196 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-0d2a9663-a82f-4981-accb-11e86f290810 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:57.540811 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-0d2a9663-a82f-4981-accb-11e86f290810 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 1464324b-6977-4faa-8b84-370603a77429] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:57.560149 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0d2a9663-a82f-4981-accb-11e86f290810 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:57.562437 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0d2a9663-a82f-4981-accb-11e86f290810 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:57.563067 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0d2a9663-a82f-4981-accb-11e86f290810 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:57.563953 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0d2a9663-a82f-4981-accb-11e86f290810 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:57.564594 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0d2a9663-a82f-4981-accb-11e86f290810 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:57.565496 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0d2a9663-a82f-4981-accb-11e86f290810 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:57.844056 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-0d2a9663-a82f-4981-accb-11e86f290810 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:59:57.859200 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-0d2a9663-a82f-4981-accb-11e86f290810 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/1464324b-6977-4faa-8b84-370603a77429" status: 200 len: 1542 microversion: 2.1 time: 0.320871 Aug 10 22:59:57.867453 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 517/1010] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:59:57 2022] GET /compute/v2.1/servers/1464324b-6977-4faa-8b84-370603a77429 => generated 1542 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:59:57.880067 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-11d29b30-2e51-4c5a-8df5-3f0770367b82 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-965115513", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452", "networks": [{"uuid": "2be996ec-9fab-4768-8a24-5648297e4335"}]}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:59:57.974051 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.network.neutron [None req-11d29b30-2e51-4c5a-8df5-3f0770367b82 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] validate_networks() for [('2be996ec-9fab-4768-8a24-5648297e4335', None, None, None, None, None)] {{(pid=122633) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 22:59:58.865435 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-11d29b30-2e51-4c5a-8df5-3f0770367b82 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Flavor limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 22:59:58.866752 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-11d29b30-2e51-4c5a-8df5-3f0770367b82 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Image limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 22:59:58.867614 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-11d29b30-2e51-4c5a-8df5-3f0770367b82 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Flavor pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 22:59:58.868376 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-11d29b30-2e51-4c5a-8df5-3f0770367b82 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Image pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 22:59:58.869026 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-11d29b30-2e51-4c5a-8df5-3f0770367b82 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 22:59:58.882417 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-11d29b30-2e51-4c5a-8df5-3f0770367b82 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:58.883356 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-11d29b30-2e51-4c5a-8df5-3f0770367b82 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:58.884009 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-11d29b30-2e51-4c5a-8df5-3f0770367b82 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:58.884951 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-11d29b30-2e51-4c5a-8df5-3f0770367b82 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:58.885854 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-11d29b30-2e51-4c5a-8df5-3f0770367b82 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:58.886543 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-11d29b30-2e51-4c5a-8df5-3f0770367b82 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:58.919452 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-11d29b30-2e51-4c5a-8df5-3f0770367b82 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Getting quotas for project eae334ad72ba421797a6d836edcbab0c. Resources: {'instances', 'cores', 'ram'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 22:59:58.926649 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-11d29b30-2e51-4c5a-8df5-3f0770367b82 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Getting quotas for user 6e437f9eb7254dc98e2839656c053f2d and project eae334ad72ba421797a6d836edcbab0c. Resources: {'instances', 'cores', 'ram'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 22:59:58.945126 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-11d29b30-2e51-4c5a-8df5-3f0770367b82 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Going to run 1 instances... {{(pid=122633) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 22:59:58.949201 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-11d29b30-2e51-4c5a-8df5-3f0770367b82 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] [instance: e0617f11-199e-41b8-a853-27eb2be0a8db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78ad8905-f66f-4733-8be9-2b260f1fabed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122633) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 22:59:59.029973 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-11d29b30-2e51-4c5a-8df5-3f0770367b82 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.160622 Aug 10 22:59:59.037193 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 518/1011] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 22:59:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 1162 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 22:59:59.037963 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-bdc7a082-372f-41fd-9d74-d60bae54f20d req-c4700bed-6d5c-4586-9ab5-61585fb17f93 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e91f1ac-f79d-4ab0-aa13-ea32b0e74888", "tag": "19d4795c-3095-41be-b300-ea441bb13af4"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 22:59:59.050088 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-bdc7a082-372f-41fd-9d74-d60bae54f20d req-c4700bed-6d5c-4586-9ab5-61585fb17f93 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:59.051203 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-bdc7a082-372f-41fd-9d74-d60bae54f20d req-c4700bed-6d5c-4586-9ab5-61585fb17f93 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:59.051651 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-bdc7a082-372f-41fd-9d74-d60bae54f20d req-c4700bed-6d5c-4586-9ab5-61585fb17f93 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:59.072470 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-bdc7a082-372f-41fd-9d74-d60bae54f20d req-c4700bed-6d5c-4586-9ab5-61585fb17f93 service nova] Creating event network-changed:19d4795c-3095-41be-b300-ea441bb13af4 for instance 8e91f1ac-f79d-4ab0-aa13-ea32b0e74888 on n-h2-850468-14 Aug 10 22:59:59.102495 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-bdc7a082-372f-41fd-9d74-d60bae54f20d req-c4700bed-6d5c-4586-9ab5-61585fb17f93 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065353 Aug 10 22:59:59.105164 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 519/1012] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 22:59:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 22:59:59.117376 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-378df91f-2502-4e25-a07f-31d4c4bbeb27 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:59.122729 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-378df91f-2502-4e25-a07f-31d4c4bbeb27 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] [instance: f3722f40-7320-484b-8c20-78b2de3e89f1] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:59.135840 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-378df91f-2502-4e25-a07f-31d4c4bbeb27 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:59.136336 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-378df91f-2502-4e25-a07f-31d4c4bbeb27 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:59.136784 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-378df91f-2502-4e25-a07f-31d4c4bbeb27 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:59.137504 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-378df91f-2502-4e25-a07f-31d4c4bbeb27 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:59.138290 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-378df91f-2502-4e25-a07f-31d4c4bbeb27 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:59.138734 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-378df91f-2502-4e25-a07f-31d4c4bbeb27 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:59.422336 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-378df91f-2502-4e25-a07f-31d4c4bbeb27 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6d9806b6724e5aaf8c69be8e70d4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307ab95daa034afbb31f90626885072b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:59:59.451223 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-378df91f-2502-4e25-a07f-31d4c4bbeb27 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] 10.222.0.58 "GET /compute/v2.1/servers/f3722f40-7320-484b-8c20-78b2de3e89f1" status: 200 len: 1498 microversion: 2.1 time: 0.344658 Aug 10 22:59:59.453708 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 520/1013] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:59:59 2022] GET /compute/v2.1/servers/f3722f40-7320-484b-8c20-78b2de3e89f1 => generated 1498 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:59:59.461787 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-0eba48af-74e3-4550-b0d7-e177eb9c4cfe tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Calling method '.version_select at 0x7f847d42ab80>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:59.573070 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-0eba48af-74e3-4550-b0d7-e177eb9c4cfe tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] 10.222.0.58 "GET /compute/v2.1/images/be4c34b4-d5ba-42f3-8dac-aa84837569a0" status: 200 len: 1455 microversion: 2.1 time: 0.117137 Aug 10 22:59:59.581331 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 521/1014] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 10 22:59:59 2022] GET /compute/v2.1/images/be4c34b4-d5ba-42f3-8dac-aa84837569a0 => generated 1455 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:59:59.588406 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-7ae624be-0c68-4b65-aabd-aa0a8793f85f tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:59.589800 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-7ae624be-0c68-4b65-aabd-aa0a8793f85f tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] [instance: 0af574c3-bfa0-4df6-8f0e-6fcd12e9b8a9] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:59.638995 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7ae624be-0c68-4b65-aabd-aa0a8793f85f tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:59.639533 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7ae624be-0c68-4b65-aabd-aa0a8793f85f tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:59.640282 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7ae624be-0c68-4b65-aabd-aa0a8793f85f tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:59.641494 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7ae624be-0c68-4b65-aabd-aa0a8793f85f tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:59.641955 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7ae624be-0c68-4b65-aabd-aa0a8793f85f tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:59.643706 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7ae624be-0c68-4b65-aabd-aa0a8793f85f tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:59.758197 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-7ae624be-0c68-4b65-aabd-aa0a8793f85f tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '417d4eaaeb1c4df78745496ececb3e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27e6ee9495a438b8450a4ef0d62cbcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 22:59:59.773035 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-7ae624be-0c68-4b65-aabd-aa0a8793f85f tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] 10.222.0.58 "GET /compute/v2.1/servers/0af574c3-bfa0-4df6-8f0e-6fcd12e9b8a9" status: 200 len: 1275 microversion: 2.1 time: 0.192055 Aug 10 22:59:59.775450 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 522/1015] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:59:59 2022] GET /compute/v2.1/servers/0af574c3-bfa0-4df6-8f0e-6fcd12e9b8a9 => generated 1275 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 22:59:59.787875 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-4c53a446-c3db-4839-a8e3-3243779eda23 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:59.789103 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-4c53a446-c3db-4839-a8e3-3243779eda23 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 1464324b-6977-4faa-8b84-370603a77429] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 22:59:59.800803 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4c53a446-c3db-4839-a8e3-3243779eda23 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:59.801818 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4c53a446-c3db-4839-a8e3-3243779eda23 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:59.802237 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4c53a446-c3db-4839-a8e3-3243779eda23 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:59.803472 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4c53a446-c3db-4839-a8e3-3243779eda23 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 22:59:59.803941 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4c53a446-c3db-4839-a8e3-3243779eda23 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 22:59:59.804918 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4c53a446-c3db-4839-a8e3-3243779eda23 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 22:59:59.811174 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=100 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 22:59:59.964668 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-f27b1721-9b0b-40f2-b76f-a79b06aac624 tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0/action" status: 202 len: 0 microversion: 2.25 time: 3.432664 Aug 10 22:59:59.965267 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 494/1016] 10.222.0.58 () {62 vars in 1319 bytes} [Wed Aug 10 22:59:56 2022] POST /compute/v2.1/servers/99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0/action => generated 0 bytes in 3436 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 10 22:59:59.972982 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c61bb82c-3b45-44ad-b2bd-250545dde656 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 22:59:59.973610 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-c61bb82c-3b45-44ad-b2bd-250545dde656 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] [instance: e0617f11-199e-41b8-a853-27eb2be0a8db] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:00:00.000397 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-4c53a446-c3db-4839-a8e3-3243779eda23 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:00:00.012002 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c61bb82c-3b45-44ad-b2bd-250545dde656 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:00.012919 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-4c53a446-c3db-4839-a8e3-3243779eda23 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/1464324b-6977-4faa-8b84-370603a77429" status: 200 len: 1542 microversion: 2.1 time: 0.233909 Aug 10 23:00:00.013747 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 523/1017] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:59:59 2022] GET /compute/v2.1/servers/1464324b-6977-4faa-8b84-370603a77429 => generated 1542 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:00:00.014304 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c61bb82c-3b45-44ad-b2bd-250545dde656 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:00.016229 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c61bb82c-3b45-44ad-b2bd-250545dde656 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:00.019568 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c61bb82c-3b45-44ad-b2bd-250545dde656 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:00.022433 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c61bb82c-3b45-44ad-b2bd-250545dde656 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:00.023511 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c61bb82c-3b45-44ad-b2bd-250545dde656 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:00.034332 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-81032b12-31f9-48b1-a191-16903255b155 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:00.035099 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-81032b12-31f9-48b1-a191-16903255b155 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] [instance: 99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:00:00.053242 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-81032b12-31f9-48b1-a191-16903255b155 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:00.054270 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-81032b12-31f9-48b1-a191-16903255b155 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:00.054777 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-81032b12-31f9-48b1-a191-16903255b155 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:00.055539 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-81032b12-31f9-48b1-a191-16903255b155 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:00.055999 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-81032b12-31f9-48b1-a191-16903255b155 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:00.056429 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-81032b12-31f9-48b1-a191-16903255b155 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:00.282522 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-81032b12-31f9-48b1-a191-16903255b155 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:00:00.296233 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-81032b12-31f9-48b1-a191-16903255b155 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:00:00.297720 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-81032b12-31f9-48b1-a191-16903255b155 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:00:00.300573 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-81032b12-31f9-48b1-a191-16903255b155 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] 10.222.0.58 "GET /compute/v2.1/servers/99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0" status: 200 len: 1814 microversion: 2.25 time: 0.276388 Aug 10 23:00:00.301165 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 524/1018] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:00:00 2022] GET /compute/v2.1/servers/99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0 => generated 1814 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:00:00.314697 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-c61bb82c-3b45-44ad-b2bd-250545dde656 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e437f9eb7254dc98e2839656c053f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eae334ad72ba421797a6d836edcbab0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:00:00.326422 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-c61bb82c-3b45-44ad-b2bd-250545dde656 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] 10.222.0.58 "GET /compute/v2.1/servers/e0617f11-199e-41b8-a853-27eb2be0a8db" status: 200 len: 1221 microversion: 2.1 time: 0.359585 Aug 10 23:00:00.327224 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 495/1019] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 22:59:59 2022] GET /compute/v2.1/servers/e0617f11-199e-41b8-a853-27eb2be0a8db => generated 1221 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:00:00.495031 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c0909042-a5ba-4819-990d-d78435a61dae tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:00.495031 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-c0909042-a5ba-4819-990d-d78435a61dae tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] [instance: f3722f40-7320-484b-8c20-78b2de3e89f1] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:00:00.501872 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c0909042-a5ba-4819-990d-d78435a61dae tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:00.522673 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c0909042-a5ba-4819-990d-d78435a61dae tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:00.524938 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c0909042-a5ba-4819-990d-d78435a61dae tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:00.525998 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c0909042-a5ba-4819-990d-d78435a61dae tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:00.526709 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c0909042-a5ba-4819-990d-d78435a61dae tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:00.528642 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c0909042-a5ba-4819-990d-d78435a61dae tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:00.589747 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-545e5bb9-e006-46c8-8814-65d9844fe088 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Calling method '.version_select at 0x7f847d7a6f70>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:00.689511 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-545e5bb9-e006-46c8-8814-65d9844fe088 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] 10.222.0.58 "GET /compute/v2.1/images/be4c34b4-d5ba-42f3-8dac-aa84837569a0" status: 200 len: 1455 microversion: 2.1 time: 0.103945 Aug 10 23:00:00.691810 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 496/1020] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 10 23:00:00 2022] GET /compute/v2.1/images/be4c34b4-d5ba-42f3-8dac-aa84837569a0 => generated 1455 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:00:00.802268 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-99fa0e60-1b1b-4d08-8c67-4566aa9bbdb5 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:00.803269 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-99fa0e60-1b1b-4d08-8c67-4566aa9bbdb5 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] [instance: 0af574c3-bfa0-4df6-8f0e-6fcd12e9b8a9] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:00:00.841327 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-99fa0e60-1b1b-4d08-8c67-4566aa9bbdb5 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:00.842809 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-99fa0e60-1b1b-4d08-8c67-4566aa9bbdb5 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:00.845469 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-99fa0e60-1b1b-4d08-8c67-4566aa9bbdb5 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:00.848478 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-99fa0e60-1b1b-4d08-8c67-4566aa9bbdb5 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:00.851076 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-99fa0e60-1b1b-4d08-8c67-4566aa9bbdb5 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:00.852802 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-99fa0e60-1b1b-4d08-8c67-4566aa9bbdb5 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:00.983455 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-c0909042-a5ba-4819-990d-d78435a61dae tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6d9806b6724e5aaf8c69be8e70d4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307ab95daa034afbb31f90626885072b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:00:00.996185 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-c0909042-a5ba-4819-990d-d78435a61dae tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] 10.222.0.58 "GET /compute/v2.1/servers/f3722f40-7320-484b-8c20-78b2de3e89f1" status: 200 len: 1498 microversion: 2.1 time: 0.509127 Aug 10 23:00:01.014630 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 525/1021] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:00:00 2022] GET /compute/v2.1/servers/f3722f40-7320-484b-8c20-78b2de3e89f1 => generated 1498 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:00:01.047970 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-0a103aa1-605b-4620-ba27-8e4b10a51a02 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:01.048771 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-0a103aa1-605b-4620-ba27-8e4b10a51a02 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 1464324b-6977-4faa-8b84-370603a77429] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:00:01.114702 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0a103aa1-605b-4620-ba27-8e4b10a51a02 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:01.116759 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0a103aa1-605b-4620-ba27-8e4b10a51a02 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:01.117481 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0a103aa1-605b-4620-ba27-8e4b10a51a02 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:01.118432 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0a103aa1-605b-4620-ba27-8e4b10a51a02 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:01.122398 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0a103aa1-605b-4620-ba27-8e4b10a51a02 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:01.124502 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0a103aa1-605b-4620-ba27-8e4b10a51a02 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:01.395019 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-99fa0e60-1b1b-4d08-8c67-4566aa9bbdb5 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '417d4eaaeb1c4df78745496ececb3e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27e6ee9495a438b8450a4ef0d62cbcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:00:01.403834 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-99fa0e60-1b1b-4d08-8c67-4566aa9bbdb5 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] 10.222.0.58 "GET /compute/v2.1/servers/0af574c3-bfa0-4df6-8f0e-6fcd12e9b8a9" status: 200 len: 1317 microversion: 2.1 time: 0.608883 Aug 10 23:00:01.409471 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 497/1022] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:00:00 2022] GET /compute/v2.1/servers/0af574c3-bfa0-4df6-8f0e-6fcd12e9b8a9 => generated 1317 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:00:01.417621 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-461940db-9667-4b35-b481-39d5bfde01a6 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:01.418236 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-461940db-9667-4b35-b481-39d5bfde01a6 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] [instance: 99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:00:01.432699 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-461940db-9667-4b35-b481-39d5bfde01a6 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:01.433524 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-461940db-9667-4b35-b481-39d5bfde01a6 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:01.434241 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-461940db-9667-4b35-b481-39d5bfde01a6 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:01.435285 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-461940db-9667-4b35-b481-39d5bfde01a6 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:01.436181 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-461940db-9667-4b35-b481-39d5bfde01a6 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:01.436614 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-461940db-9667-4b35-b481-39d5bfde01a6 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:01.932416 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-0a103aa1-605b-4620-ba27-8e4b10a51a02 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:00:01.948346 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-0a103aa1-605b-4620-ba27-8e4b10a51a02 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/1464324b-6977-4faa-8b84-370603a77429" status: 200 len: 1542 microversion: 2.1 time: 0.905813 Aug 10 23:00:01.952962 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-461940db-9667-4b35-b481-39d5bfde01a6 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:00:01.959432 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 526/1023] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:00:01 2022] GET /compute/v2.1/servers/1464324b-6977-4faa-8b84-370603a77429 => generated 1542 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:00:01.965724 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-461940db-9667-4b35-b481-39d5bfde01a6 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:00:01.969190 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-ad819808-b52c-40ad-8a19-8286b1b6290e tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:01.969967 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-ad819808-b52c-40ad-8a19-8286b1b6290e tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] [instance: e0617f11-199e-41b8-a853-27eb2be0a8db] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:00:01.972173 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-461940db-9667-4b35-b481-39d5bfde01a6 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:00:01.976596 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ad819808-b52c-40ad-8a19-8286b1b6290e tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:01.977087 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ad819808-b52c-40ad-8a19-8286b1b6290e tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:01.977532 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ad819808-b52c-40ad-8a19-8286b1b6290e tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:01.978239 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ad819808-b52c-40ad-8a19-8286b1b6290e tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:01.978820 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ad819808-b52c-40ad-8a19-8286b1b6290e tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:01.979277 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ad819808-b52c-40ad-8a19-8286b1b6290e tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:01.979690 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-461940db-9667-4b35-b481-39d5bfde01a6 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] 10.222.0.58 "GET /compute/v2.1/servers/99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0" status: 200 len: 1814 microversion: 2.25 time: 0.567680 Aug 10 23:00:01.980864 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 498/1024] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:00:01 2022] GET /compute/v2.1/servers/99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0 => generated 1814 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:00:01.985877 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-e3fb9f39-9372-4a7c-adc3-f0b365c37872 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Calling method '.version_select at 0x7f847d98f8b0>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:02.069182 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-e3fb9f39-9372-4a7c-adc3-f0b365c37872 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] 10.222.0.58 "GET /compute/v2.1/images/be4c34b4-d5ba-42f3-8dac-aa84837569a0" status: 200 len: 1455 microversion: 2.1 time: 0.086211 Aug 10 23:00:02.070438 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 499/1025] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 10 23:00:01 2022] GET /compute/v2.1/images/be4c34b4-d5ba-42f3-8dac-aa84837569a0 => generated 1455 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:00:02.085220 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-1938423c-6401-41f1-91d9-882f16289380 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:02.086143 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-1938423c-6401-41f1-91d9-882f16289380 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] [instance: f3722f40-7320-484b-8c20-78b2de3e89f1] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:00:02.104252 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1938423c-6401-41f1-91d9-882f16289380 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:02.105187 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1938423c-6401-41f1-91d9-882f16289380 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:02.105790 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1938423c-6401-41f1-91d9-882f16289380 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:02.106681 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1938423c-6401-41f1-91d9-882f16289380 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:02.107352 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1938423c-6401-41f1-91d9-882f16289380 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:02.107990 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1938423c-6401-41f1-91d9-882f16289380 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:02.197471 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-ad819808-b52c-40ad-8a19-8286b1b6290e tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e437f9eb7254dc98e2839656c053f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eae334ad72ba421797a6d836edcbab0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:00:02.209250 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-ad819808-b52c-40ad-8a19-8286b1b6290e tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] 10.222.0.58 "GET /compute/v2.1/servers/e0617f11-199e-41b8-a853-27eb2be0a8db" status: 200 len: 1275 microversion: 2.1 time: 0.244228 Aug 10 23:00:02.211331 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 527/1026] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:00:01 2022] GET /compute/v2.1/servers/e0617f11-199e-41b8-a853-27eb2be0a8db => generated 1275 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:00:02.431034 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-bd2a5d8c-fc71-451a-b353-e62ca533ebb7 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:02.431657 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-bd2a5d8c-fc71-451a-b353-e62ca533ebb7 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] [instance: 0af574c3-bfa0-4df6-8f0e-6fcd12e9b8a9] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:00:02.449589 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bd2a5d8c-fc71-451a-b353-e62ca533ebb7 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:02.450132 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bd2a5d8c-fc71-451a-b353-e62ca533ebb7 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:02.450761 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bd2a5d8c-fc71-451a-b353-e62ca533ebb7 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:02.451520 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bd2a5d8c-fc71-451a-b353-e62ca533ebb7 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:02.451981 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bd2a5d8c-fc71-451a-b353-e62ca533ebb7 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:02.452406 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bd2a5d8c-fc71-451a-b353-e62ca533ebb7 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:02.537092 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-1938423c-6401-41f1-91d9-882f16289380 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6d9806b6724e5aaf8c69be8e70d4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307ab95daa034afbb31f90626885072b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:00:02.555658 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:00:02.561068 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-1938423c-6401-41f1-91d9-882f16289380 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] 10.222.0.58 "GET /compute/v2.1/servers/f3722f40-7320-484b-8c20-78b2de3e89f1" status: 200 len: 1498 microversion: 2.1 time: 0.484908 Aug 10 23:00:02.580219 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 500/1027] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:00:02 2022] GET /compute/v2.1/servers/f3722f40-7320-484b-8c20-78b2de3e89f1 => generated 1498 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:00:02.822984 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-bd2a5d8c-fc71-451a-b353-e62ca533ebb7 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '417d4eaaeb1c4df78745496ececb3e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27e6ee9495a438b8450a4ef0d62cbcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:00:02.848002 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-bd2a5d8c-fc71-451a-b353-e62ca533ebb7 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] 10.222.0.58 "GET /compute/v2.1/servers/0af574c3-bfa0-4df6-8f0e-6fcd12e9b8a9" status: 200 len: 1317 microversion: 2.1 time: 0.420732 Aug 10 23:00:02.849946 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 528/1028] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:00:02 2022] GET /compute/v2.1/servers/0af574c3-bfa0-4df6-8f0e-6fcd12e9b8a9 => generated 1317 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:00:02.971323 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-268a7212-5298-46dc-8635-b52a8264c060 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:02.972125 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-268a7212-5298-46dc-8635-b52a8264c060 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 1464324b-6977-4faa-8b84-370603a77429] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:00:02.981443 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-268a7212-5298-46dc-8635-b52a8264c060 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:02.982751 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-268a7212-5298-46dc-8635-b52a8264c060 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:02.983522 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-268a7212-5298-46dc-8635-b52a8264c060 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:02.984779 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-268a7212-5298-46dc-8635-b52a8264c060 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:02.985617 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-268a7212-5298-46dc-8635-b52a8264c060 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:02.986927 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-268a7212-5298-46dc-8635-b52a8264c060 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:03.008700 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-0ac0c7a0-14b6-4545-b9c9-a9dc64ac7f44 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:03.009113 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-0ac0c7a0-14b6-4545-b9c9-a9dc64ac7f44 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] [instance: 99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:00:03.020485 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0ac0c7a0-14b6-4545-b9c9-a9dc64ac7f44 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:03.021539 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0ac0c7a0-14b6-4545-b9c9-a9dc64ac7f44 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:03.027567 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0ac0c7a0-14b6-4545-b9c9-a9dc64ac7f44 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:03.030015 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0ac0c7a0-14b6-4545-b9c9-a9dc64ac7f44 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:03.034515 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0ac0c7a0-14b6-4545-b9c9-a9dc64ac7f44 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:03.035222 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0ac0c7a0-14b6-4545-b9c9-a9dc64ac7f44 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:03.432717 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-268a7212-5298-46dc-8635-b52a8264c060 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:00:03.466639 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-268a7212-5298-46dc-8635-b52a8264c060 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/1464324b-6977-4faa-8b84-370603a77429" status: 200 len: 1541 microversion: 2.1 time: 0.499428 Aug 10 23:00:03.476292 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 501/1029] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:00:02 2022] GET /compute/v2.1/servers/1464324b-6977-4faa-8b84-370603a77429 => generated 1541 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:00:03.513584 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-62776a84-9f69-4d71-b327-a02dea534bfb tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Calling method '.version_select at 0x7f847d98c5e0>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:03.649648 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-62776a84-9f69-4d71-b327-a02dea534bfb tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] 10.222.0.58 "GET /compute/v2.1/images/be4c34b4-d5ba-42f3-8dac-aa84837569a0" status: 200 len: 1455 microversion: 2.1 time: 0.168958 Aug 10 23:00:03.667778 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 502/1030] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 10 23:00:03 2022] GET /compute/v2.1/images/be4c34b4-d5ba-42f3-8dac-aa84837569a0 => generated 1455 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:00:03.673204 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-202799a2-1d7f-463a-b430-026fabd91d95 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:03.676599 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-202799a2-1d7f-463a-b430-026fabd91d95 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] [instance: e0617f11-199e-41b8-a853-27eb2be0a8db] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:00:03.693555 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-202799a2-1d7f-463a-b430-026fabd91d95 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:03.694354 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-202799a2-1d7f-463a-b430-026fabd91d95 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:03.695000 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-202799a2-1d7f-463a-b430-026fabd91d95 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:03.695897 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-202799a2-1d7f-463a-b430-026fabd91d95 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:03.696515 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-202799a2-1d7f-463a-b430-026fabd91d95 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:03.697140 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-202799a2-1d7f-463a-b430-026fabd91d95 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:03.903993 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-202799a2-1d7f-463a-b430-026fabd91d95 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e437f9eb7254dc98e2839656c053f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eae334ad72ba421797a6d836edcbab0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:00:03.917705 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-202799a2-1d7f-463a-b430-026fabd91d95 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] 10.222.0.58 "GET /compute/v2.1/servers/e0617f11-199e-41b8-a853-27eb2be0a8db" status: 200 len: 1317 microversion: 2.1 time: 0.247620 Aug 10 23:00:03.919468 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 503/1031] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:00:03 2022] GET /compute/v2.1/servers/e0617f11-199e-41b8-a853-27eb2be0a8db => generated 1317 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:00:03.924875 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-0b5f8747-f42b-4e6f-b37b-6ac2c431354d req-a5d24b86-e293-4f8f-86f7-892ca5a8289a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0af574c3-bfa0-4df6-8f0e-6fcd12e9b8a9", "tag": "619742dd-1d71-452c-be56-cfa1c8c095fa"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:00:03.934659 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-0b5f8747-f42b-4e6f-b37b-6ac2c431354d req-a5d24b86-e293-4f8f-86f7-892ca5a8289a service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:03.935193 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-0b5f8747-f42b-4e6f-b37b-6ac2c431354d req-a5d24b86-e293-4f8f-86f7-892ca5a8289a service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:03.935880 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-0b5f8747-f42b-4e6f-b37b-6ac2c431354d req-a5d24b86-e293-4f8f-86f7-892ca5a8289a service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:03.948169 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-0b5f8747-f42b-4e6f-b37b-6ac2c431354d req-a5d24b86-e293-4f8f-86f7-892ca5a8289a service nova] Creating event network-changed:619742dd-1d71-452c-be56-cfa1c8c095fa for instance 0af574c3-bfa0-4df6-8f0e-6fcd12e9b8a9 on n-h1-850468-14 Aug 10 23:00:03.952837 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-0b5f8747-f42b-4e6f-b37b-6ac2c431354d req-a5d24b86-e293-4f8f-86f7-892ca5a8289a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031616 Aug 10 23:00:03.953595 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 504/1032] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:00:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:00:03.961632 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-d0633052-67d5-42ef-95c0-3970815dea66 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:03.962405 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-d0633052-67d5-42ef-95c0-3970815dea66 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] [instance: f3722f40-7320-484b-8c20-78b2de3e89f1] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:00:03.969272 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d0633052-67d5-42ef-95c0-3970815dea66 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:03.969769 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d0633052-67d5-42ef-95c0-3970815dea66 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:03.970208 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d0633052-67d5-42ef-95c0-3970815dea66 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:03.971472 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d0633052-67d5-42ef-95c0-3970815dea66 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:03.971934 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d0633052-67d5-42ef-95c0-3970815dea66 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:03.972366 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d0633052-67d5-42ef-95c0-3970815dea66 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:03.982182 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-0ac0c7a0-14b6-4545-b9c9-a9dc64ac7f44 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:00:03.998295 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-0ac0c7a0-14b6-4545-b9c9-a9dc64ac7f44 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:00:04.004293 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-0ac0c7a0-14b6-4545-b9c9-a9dc64ac7f44 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:00:04.009602 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-0ac0c7a0-14b6-4545-b9c9-a9dc64ac7f44 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] 10.222.0.58 "GET /compute/v2.1/servers/99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0" status: 200 len: 1814 microversion: 2.25 time: 1.004521 Aug 10 23:00:04.010796 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 529/1033] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:00:03 2022] GET /compute/v2.1/servers/99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0 => generated 1814 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:00:04.016458 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-7d351b1b-9d39-46d6-bdee-ae7bf828a5f3 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:04.017310 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-7d351b1b-9d39-46d6-bdee-ae7bf828a5f3 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] [instance: 0af574c3-bfa0-4df6-8f0e-6fcd12e9b8a9] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:00:04.035384 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7d351b1b-9d39-46d6-bdee-ae7bf828a5f3 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:04.036634 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7d351b1b-9d39-46d6-bdee-ae7bf828a5f3 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:04.037284 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7d351b1b-9d39-46d6-bdee-ae7bf828a5f3 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:04.038210 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7d351b1b-9d39-46d6-bdee-ae7bf828a5f3 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:04.038896 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7d351b1b-9d39-46d6-bdee-ae7bf828a5f3 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:04.039706 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7d351b1b-9d39-46d6-bdee-ae7bf828a5f3 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:04.155014 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-d0633052-67d5-42ef-95c0-3970815dea66 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6d9806b6724e5aaf8c69be8e70d4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307ab95daa034afbb31f90626885072b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:00:04.163350 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-d0633052-67d5-42ef-95c0-3970815dea66 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] 10.222.0.58 "GET /compute/v2.1/servers/f3722f40-7320-484b-8c20-78b2de3e89f1" status: 200 len: 1498 microversion: 2.1 time: 0.205575 Aug 10 23:00:04.180937 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 505/1034] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:00:03 2022] GET /compute/v2.1/servers/f3722f40-7320-484b-8c20-78b2de3e89f1 => generated 1498 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:00:04.495889 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-7d351b1b-9d39-46d6-bdee-ae7bf828a5f3 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '417d4eaaeb1c4df78745496ececb3e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27e6ee9495a438b8450a4ef0d62cbcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:00:04.504929 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-7d351b1b-9d39-46d6-bdee-ae7bf828a5f3 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] 10.222.0.58 "GET /compute/v2.1/servers/0af574c3-bfa0-4df6-8f0e-6fcd12e9b8a9" status: 200 len: 1317 microversion: 2.1 time: 0.492869 Aug 10 23:00:04.506092 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 530/1035] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:00:04 2022] GET /compute/v2.1/servers/0af574c3-bfa0-4df6-8f0e-6fcd12e9b8a9 => generated 1317 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:00:04.515579 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-1fa03f05-546a-4c1f-99b9-ff08d6a24f10 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:04.516413 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-1fa03f05-546a-4c1f-99b9-ff08d6a24f10 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 1464324b-6977-4faa-8b84-370603a77429] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:00:04.540052 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1fa03f05-546a-4c1f-99b9-ff08d6a24f10 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:04.540859 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1fa03f05-546a-4c1f-99b9-ff08d6a24f10 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:04.544392 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1fa03f05-546a-4c1f-99b9-ff08d6a24f10 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:04.545470 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1fa03f05-546a-4c1f-99b9-ff08d6a24f10 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:04.546339 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1fa03f05-546a-4c1f-99b9-ff08d6a24f10 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:04.547014 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1fa03f05-546a-4c1f-99b9-ff08d6a24f10 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:04.673840 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-ac5375d9-7beb-442f-8f54-da3ff29d5ee7 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Calling method '.version_select at 0x7f847d42a5e0>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:04.749317 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-ac5375d9-7beb-442f-8f54-da3ff29d5ee7 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] 10.222.0.58 "GET /compute/v2.1/images/be4c34b4-d5ba-42f3-8dac-aa84837569a0" status: 200 len: 1455 microversion: 2.1 time: 0.084215 Aug 10 23:00:04.750872 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 531/1036] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 10 23:00:04 2022] GET /compute/v2.1/images/be4c34b4-d5ba-42f3-8dac-aa84837569a0 => generated 1455 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:00:04.777454 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=2 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:00:04.864493 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-1fa03f05-546a-4c1f-99b9-ff08d6a24f10 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:00:04.883636 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-1fa03f05-546a-4c1f-99b9-ff08d6a24f10 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/1464324b-6977-4faa-8b84-370603a77429" status: 200 len: 1473 microversion: 2.1 time: 0.392228 Aug 10 23:00:04.884668 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 506/1037] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:00:04 2022] GET /compute/v2.1/servers/1464324b-6977-4faa-8b84-370603a77429 => generated 1473 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:00:04.942851 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-7e8723f4-f630-4a99-b5f2-acf4f0dc88a7 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:04.943475 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-7e8723f4-f630-4a99-b5f2-acf4f0dc88a7 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] [instance: e0617f11-199e-41b8-a853-27eb2be0a8db] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:00:04.951437 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7e8723f4-f630-4a99-b5f2-acf4f0dc88a7 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:04.952198 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7e8723f4-f630-4a99-b5f2-acf4f0dc88a7 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:04.952405 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7e8723f4-f630-4a99-b5f2-acf4f0dc88a7 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:04.953084 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7e8723f4-f630-4a99-b5f2-acf4f0dc88a7 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:04.953505 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7e8723f4-f630-4a99-b5f2-acf4f0dc88a7 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:04.953936 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7e8723f4-f630-4a99-b5f2-acf4f0dc88a7 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:04.980457 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-bbebebd3-16b2-4ac9-8297-ed6bbd8a66f7 req-81b69228-f435-44ac-96d0-e8f76b9b8dfc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e0617f11-199e-41b8-a853-27eb2be0a8db", "tag": "4c64e25d-82ab-4c38-8bc1-7e67b114eba8"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:00:05.016130 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-bbebebd3-16b2-4ac9-8297-ed6bbd8a66f7 req-81b69228-f435-44ac-96d0-e8f76b9b8dfc service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:05.016613 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-bbebebd3-16b2-4ac9-8297-ed6bbd8a66f7 req-81b69228-f435-44ac-96d0-e8f76b9b8dfc service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:05.017044 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-bbebebd3-16b2-4ac9-8297-ed6bbd8a66f7 req-81b69228-f435-44ac-96d0-e8f76b9b8dfc service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:05.042202 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-bbebebd3-16b2-4ac9-8297-ed6bbd8a66f7 req-81b69228-f435-44ac-96d0-e8f76b9b8dfc service nova] Creating event network-changed:4c64e25d-82ab-4c38-8bc1-7e67b114eba8 for instance e0617f11-199e-41b8-a853-27eb2be0a8db on n-h2-850468-14 Aug 10 23:00:05.054497 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-bbebebd3-16b2-4ac9-8297-ed6bbd8a66f7 req-81b69228-f435-44ac-96d0-e8f76b9b8dfc service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079598 Aug 10 23:00:05.055436 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 507/1038] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:00:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 23:00:05.061445 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-78cf4a78-cdbe-433f-93d2-fd42b6782b64 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:05.062201 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-78cf4a78-cdbe-433f-93d2-fd42b6782b64 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] [instance: 99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:00:05.070811 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-78cf4a78-cdbe-433f-93d2-fd42b6782b64 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:05.071334 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-78cf4a78-cdbe-433f-93d2-fd42b6782b64 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:05.071779 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-78cf4a78-cdbe-433f-93d2-fd42b6782b64 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:05.072494 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-78cf4a78-cdbe-433f-93d2-fd42b6782b64 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:05.072953 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-78cf4a78-cdbe-433f-93d2-fd42b6782b64 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:05.073377 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-78cf4a78-cdbe-433f-93d2-fd42b6782b64 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:05.304194 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-7e8723f4-f630-4a99-b5f2-acf4f0dc88a7 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e437f9eb7254dc98e2839656c053f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eae334ad72ba421797a6d836edcbab0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:00:05.314331 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-7e8723f4-f630-4a99-b5f2-acf4f0dc88a7 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] 10.222.0.58 "GET /compute/v2.1/servers/e0617f11-199e-41b8-a853-27eb2be0a8db" status: 200 len: 1317 microversion: 2.1 time: 0.377662 Aug 10 23:00:05.331574 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 532/1039] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:00:04 2022] GET /compute/v2.1/servers/e0617f11-199e-41b8-a853-27eb2be0a8db => generated 1317 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:00:05.338479 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-748c12ca-477b-4ab8-96d6-1cb7f24c49fe tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:05.344147 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-748c12ca-477b-4ab8-96d6-1cb7f24c49fe tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] [instance: f3722f40-7320-484b-8c20-78b2de3e89f1] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:00:05.354580 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-748c12ca-477b-4ab8-96d6-1cb7f24c49fe tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:05.359074 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-748c12ca-477b-4ab8-96d6-1cb7f24c49fe tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:05.366214 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-748c12ca-477b-4ab8-96d6-1cb7f24c49fe tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:05.367821 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-748c12ca-477b-4ab8-96d6-1cb7f24c49fe tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:05.368627 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-748c12ca-477b-4ab8-96d6-1cb7f24c49fe tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:05.369397 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-748c12ca-477b-4ab8-96d6-1cb7f24c49fe tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:05.461227 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=8 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:00:05.776281 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-748c12ca-477b-4ab8-96d6-1cb7f24c49fe tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6d9806b6724e5aaf8c69be8e70d4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307ab95daa034afbb31f90626885072b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:00:05.806083 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-748c12ca-477b-4ab8-96d6-1cb7f24c49fe tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] 10.222.0.58 "GET /compute/v2.1/servers/f3722f40-7320-484b-8c20-78b2de3e89f1" status: 200 len: 1498 microversion: 2.1 time: 0.471653 Aug 10 23:00:05.812577 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 533/1040] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:00:05 2022] GET /compute/v2.1/servers/f3722f40-7320-484b-8c20-78b2de3e89f1 => generated 1498 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:00:05.836097 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-817d49d1-48e5-427d-bbe5-231e35f99b88 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:05.836810 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-817d49d1-48e5-427d-bbe5-231e35f99b88 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] [instance: 0af574c3-bfa0-4df6-8f0e-6fcd12e9b8a9] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:00:05.848335 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-817d49d1-48e5-427d-bbe5-231e35f99b88 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:05.849626 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-817d49d1-48e5-427d-bbe5-231e35f99b88 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:05.866128 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-817d49d1-48e5-427d-bbe5-231e35f99b88 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:05.866978 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-817d49d1-48e5-427d-bbe5-231e35f99b88 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:05.867487 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-817d49d1-48e5-427d-bbe5-231e35f99b88 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:05.867954 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-817d49d1-48e5-427d-bbe5-231e35f99b88 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:05.938453 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-78cf4a78-cdbe-433f-93d2-fd42b6782b64 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:00:05.964814 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-78cf4a78-cdbe-433f-93d2-fd42b6782b64 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:00:05.967428 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-78cf4a78-cdbe-433f-93d2-fd42b6782b64 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:00:05.970476 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-78cf4a78-cdbe-433f-93d2-fd42b6782b64 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] 10.222.0.58 "GET /compute/v2.1/servers/99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0" status: 200 len: 1814 microversion: 2.25 time: 0.913758 Aug 10 23:00:05.972203 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 508/1041] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:00:05 2022] GET /compute/v2.1/servers/99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0 => generated 1814 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:00:05.977814 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-618b257d-6649-4951-a99b-7d49698c0857 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Calling method '.version_select at 0x7f847d529a60>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:06.045637 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-817d49d1-48e5-427d-bbe5-231e35f99b88 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '417d4eaaeb1c4df78745496ececb3e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27e6ee9495a438b8450a4ef0d62cbcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:00:06.047102 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-618b257d-6649-4951-a99b-7d49698c0857 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] 10.222.0.58 "GET /compute/v2.1/images/be4c34b4-d5ba-42f3-8dac-aa84837569a0" status: 200 len: 1464 microversion: 2.1 time: 0.071887 Aug 10 23:00:06.049084 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 509/1042] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 10 23:00:05 2022] GET /compute/v2.1/images/be4c34b4-d5ba-42f3-8dac-aa84837569a0 => generated 1464 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:00:06.055482 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-6bb40fa2-bc02-4bd9-8f20-c73b3a950a5f tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:06.055649 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-817d49d1-48e5-427d-bbe5-231e35f99b88 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] 10.222.0.58 "GET /compute/v2.1/servers/0af574c3-bfa0-4df6-8f0e-6fcd12e9b8a9" status: 200 len: 1317 microversion: 2.1 time: 0.241634 Aug 10 23:00:06.056067 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 534/1043] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:00:05 2022] GET /compute/v2.1/servers/0af574c3-bfa0-4df6-8f0e-6fcd12e9b8a9 => generated 1317 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:00:06.056960 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-6bb40fa2-bc02-4bd9-8f20-c73b3a950a5f tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 1464324b-6977-4faa-8b84-370603a77429] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:00:06.069058 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6bb40fa2-bc02-4bd9-8f20-c73b3a950a5f tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:06.069905 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6bb40fa2-bc02-4bd9-8f20-c73b3a950a5f tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:06.070564 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6bb40fa2-bc02-4bd9-8f20-c73b3a950a5f tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:06.071732 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6bb40fa2-bc02-4bd9-8f20-c73b3a950a5f tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:06.072271 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6bb40fa2-bc02-4bd9-8f20-c73b3a950a5f tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:06.072772 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6bb40fa2-bc02-4bd9-8f20-c73b3a950a5f tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:06.074455 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-40c15c0a-7daf-4ec4-9db2-e51aadbd13bb req-a6076b35-9eaa-4fdf-8bea-2e0b64c71aa9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1464324b-6977-4faa-8b84-370603a77429", "name": "network-vif-unplugged", "status": "completed", "tag": "6a54d59d-b7dd-4033-89c5-dd089d9e9fb8"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:00:06.079336 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:00:06.085507 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-40c15c0a-7daf-4ec4-9db2-e51aadbd13bb req-a6076b35-9eaa-4fdf-8bea-2e0b64c71aa9 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:06.086267 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-40c15c0a-7daf-4ec4-9db2-e51aadbd13bb req-a6076b35-9eaa-4fdf-8bea-2e0b64c71aa9 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:06.086949 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-40c15c0a-7daf-4ec4-9db2-e51aadbd13bb req-a6076b35-9eaa-4fdf-8bea-2e0b64c71aa9 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:06.101111 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-40c15c0a-7daf-4ec4-9db2-e51aadbd13bb req-a6076b35-9eaa-4fdf-8bea-2e0b64c71aa9 service nova] Creating event network-vif-unplugged:6a54d59d-b7dd-4033-89c5-dd089d9e9fb8 for instance 1464324b-6977-4faa-8b84-370603a77429 on n-h1-850468-14 Aug 10 23:00:06.107468 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [req-40c15c0a-7daf-4ec4-9db2-e51aadbd13bb req-a6076b35-9eaa-4fdf-8bea-2e0b64c71aa9 service nova] Instance 1464324b-6977-4faa-8b84-370603a77429 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-850468-14'} {{(pid=122633) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5901}} Aug 10 23:00:06.115182 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-40c15c0a-7daf-4ec4-9db2-e51aadbd13bb req-a6076b35-9eaa-4fdf-8bea-2e0b64c71aa9 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.057697 Aug 10 23:00:06.116376 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 535/1044] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:00:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:00:06.122561 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-92053349-738e-446e-b00a-ec28e3a7caff tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Calling method '.version_select at 0x7f847d3e70d0>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:06.178754 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-92053349-738e-446e-b00a-ec28e3a7caff tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] 10.222.0.58 "GET /compute/v2.1/images/be4c34b4-d5ba-42f3-8dac-aa84837569a0" status: 200 len: 1464 microversion: 2.1 time: 0.061020 Aug 10 23:00:06.179538 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 536/1045] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 10 23:00:06 2022] GET /compute/v2.1/images/be4c34b4-d5ba-42f3-8dac-aa84837569a0 => generated 1464 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:00:06.193117 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-da799ed6-96df-4f5b-bce9-09e406679441 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:06.193835 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-da799ed6-96df-4f5b-bce9-09e406679441 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] [instance: d716cac6-ac7c-4b98-b6ea-2496ccd62096] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:00:06.200614 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-da799ed6-96df-4f5b-bce9-09e406679441 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:06.201099 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-da799ed6-96df-4f5b-bce9-09e406679441 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:06.201533 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-da799ed6-96df-4f5b-bce9-09e406679441 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:06.202226 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-da799ed6-96df-4f5b-bce9-09e406679441 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:06.202671 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-da799ed6-96df-4f5b-bce9-09e406679441 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:06.203115 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-da799ed6-96df-4f5b-bce9-09e406679441 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:06.364489 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-da799ed6-96df-4f5b-bce9-09e406679441 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e86e6a62c56248d6a7887be0ec712f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25090b10522b4936b3117dc25dd6f609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:00:06.372207 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-da799ed6-96df-4f5b-bce9-09e406679441 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] 10.222.0.58 "GET /compute/v2.1/servers/d716cac6-ac7c-4b98-b6ea-2496ccd62096" status: 200 len: 1480 microversion: 2.1 time: 0.183059 Aug 10 23:00:06.372779 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 537/1046] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:00:06 2022] GET /compute/v2.1/servers/d716cac6-ac7c-4b98-b6ea-2496ccd62096 => generated 1480 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:00:06.379979 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-d338841c-79e4-4d56-afe3-03ec0e83ea9f tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:06.381353 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-d338841c-79e4-4d56-afe3-03ec0e83ea9f tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] [instance: e0617f11-199e-41b8-a853-27eb2be0a8db] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:00:06.387614 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d338841c-79e4-4d56-afe3-03ec0e83ea9f tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:06.388478 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d338841c-79e4-4d56-afe3-03ec0e83ea9f tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:06.389139 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d338841c-79e4-4d56-afe3-03ec0e83ea9f tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:06.389906 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d338841c-79e4-4d56-afe3-03ec0e83ea9f tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:06.390424 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d338841c-79e4-4d56-afe3-03ec0e83ea9f tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:06.390931 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d338841c-79e4-4d56-afe3-03ec0e83ea9f tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:06.426182 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-6bb40fa2-bc02-4bd9-8f20-c73b3a950a5f tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:00:06.436309 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-6bb40fa2-bc02-4bd9-8f20-c73b3a950a5f tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/1464324b-6977-4faa-8b84-370603a77429" status: 200 len: 1470 microversion: 2.1 time: 0.384884 Aug 10 23:00:06.458204 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 510/1047] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:00:06 2022] GET /compute/v2.1/servers/1464324b-6977-4faa-8b84-370603a77429 => generated 1470 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:00:06.464188 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-81c665d8-3e5f-4d13-a7a8-424c80111491 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:00:06.466748 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-81c665d8-3e5f-4d13-a7a8-424c80111491 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 1464324b-6977-4faa-8b84-370603a77429] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:00:06.478476 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-81c665d8-3e5f-4d13-a7a8-424c80111491 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:06.479418 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-81c665d8-3e5f-4d13-a7a8-424c80111491 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:06.480126 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-81c665d8-3e5f-4d13-a7a8-424c80111491 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:06.481102 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-81c665d8-3e5f-4d13-a7a8-424c80111491 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:06.481822 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-81c665d8-3e5f-4d13-a7a8-424c80111491 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:06.482584 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-81c665d8-3e5f-4d13-a7a8-424c80111491 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:06.531722 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-81c665d8-3e5f-4d13-a7a8-424c80111491 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:06.532694 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-81c665d8-3e5f-4d13-a7a8-424c80111491 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:06.533882 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-81c665d8-3e5f-4d13-a7a8-424c80111491 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:06.535565 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-81c665d8-3e5f-4d13-a7a8-424c80111491 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:06.536235 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-81c665d8-3e5f-4d13-a7a8-424c80111491 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:06.536851 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-81c665d8-3e5f-4d13-a7a8-424c80111491 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:06.565449 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-81c665d8-3e5f-4d13-a7a8-424c80111491 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Getting quotas for project f9582683a1cf4e92b3bd3f10db0b497b. Resources: {'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:00:06.571372 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-81c665d8-3e5f-4d13-a7a8-424c80111491 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Getting quotas for user 5c48fd7279544b1fae228500f5a1e46d and project f9582683a1cf4e92b3bd3f10db0b497b. Resources: {'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:00:06.586435 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-d338841c-79e4-4d56-afe3-03ec0e83ea9f tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e437f9eb7254dc98e2839656c053f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eae334ad72ba421797a6d836edcbab0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:00:06.597150 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-d338841c-79e4-4d56-afe3-03ec0e83ea9f tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] 10.222.0.58 "GET /compute/v2.1/servers/e0617f11-199e-41b8-a853-27eb2be0a8db" status: 200 len: 1317 microversion: 2.1 time: 0.222055 Aug 10 23:00:06.607968 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 538/1048] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:00:06 2022] GET /compute/v2.1/servers/e0617f11-199e-41b8-a853-27eb2be0a8db => generated 1317 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:00:06.709847 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-81c665d8-3e5f-4d13-a7a8-424c80111491 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "POST /compute/v2.1/servers/1464324b-6977-4faa-8b84-370603a77429/action" status: 202 len: 0 microversion: 2.1 time: 0.249748 Aug 10 23:00:06.710776 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 511/1049] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:00:06 2022] POST /compute/v2.1/servers/1464324b-6977-4faa-8b84-370603a77429/action => generated 0 bytes in 252 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:00:06.719949 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-70e88d34-d3df-4d97-aa04-86488c67c4a1 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:06.721703 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-70e88d34-d3df-4d97-aa04-86488c67c4a1 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 1464324b-6977-4faa-8b84-370603a77429] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:00:06.728312 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-70e88d34-d3df-4d97-aa04-86488c67c4a1 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:06.729012 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-70e88d34-d3df-4d97-aa04-86488c67c4a1 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:06.729446 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-70e88d34-d3df-4d97-aa04-86488c67c4a1 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:06.730284 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-70e88d34-d3df-4d97-aa04-86488c67c4a1 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:06.731046 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-70e88d34-d3df-4d97-aa04-86488c67c4a1 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:06.731473 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-70e88d34-d3df-4d97-aa04-86488c67c4a1 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:06.905993 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-46e360de-975e-4692-a3e4-49066c74cff0 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:06.906994 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-46e360de-975e-4692-a3e4-49066c74cff0 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] [instance: f3722f40-7320-484b-8c20-78b2de3e89f1] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:00:06.922762 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-46e360de-975e-4692-a3e4-49066c74cff0 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:06.923293 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-46e360de-975e-4692-a3e4-49066c74cff0 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:06.924581 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-46e360de-975e-4692-a3e4-49066c74cff0 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:06.925848 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-46e360de-975e-4692-a3e4-49066c74cff0 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:06.926300 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-46e360de-975e-4692-a3e4-49066c74cff0 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:06.926728 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-46e360de-975e-4692-a3e4-49066c74cff0 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:06.941564 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-70e88d34-d3df-4d97-aa04-86488c67c4a1 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:00:06.950249 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-70e88d34-d3df-4d97-aa04-86488c67c4a1 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/1464324b-6977-4faa-8b84-370603a77429" status: 200 len: 1469 microversion: 2.1 time: 0.234836 Aug 10 23:00:06.950846 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 539/1050] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:00:06 2022] GET /compute/v2.1/servers/1464324b-6977-4faa-8b84-370603a77429 => generated 1469 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:00:06.999078 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-e54ea5d5-1728-4a37-bc4e-9880a1d4758e tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:06.999598 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-e54ea5d5-1728-4a37-bc4e-9880a1d4758e tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] [instance: 99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:00:07.006582 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e54ea5d5-1728-4a37-bc4e-9880a1d4758e tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:07.007183 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e54ea5d5-1728-4a37-bc4e-9880a1d4758e tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:07.007748 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e54ea5d5-1728-4a37-bc4e-9880a1d4758e tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:07.008463 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e54ea5d5-1728-4a37-bc4e-9880a1d4758e tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:07.009415 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e54ea5d5-1728-4a37-bc4e-9880a1d4758e tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:07.009415 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e54ea5d5-1728-4a37-bc4e-9880a1d4758e tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:07.201394 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-e54ea5d5-1728-4a37-bc4e-9880a1d4758e tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:00:07.202538 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-46e360de-975e-4692-a3e4-49066c74cff0 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6d9806b6724e5aaf8c69be8e70d4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307ab95daa034afbb31f90626885072b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:00:07.211288 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-46e360de-975e-4692-a3e4-49066c74cff0 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] 10.222.0.58 "GET /compute/v2.1/servers/f3722f40-7320-484b-8c20-78b2de3e89f1" status: 200 len: 1498 microversion: 2.1 time: 0.309792 Aug 10 23:00:07.211951 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-e54ea5d5-1728-4a37-bc4e-9880a1d4758e tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:00:07.214183 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-e54ea5d5-1728-4a37-bc4e-9880a1d4758e tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:00:07.215853 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-e54ea5d5-1728-4a37-bc4e-9880a1d4758e tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] 10.222.0.58 "GET /compute/v2.1/servers/99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0" status: 200 len: 1814 microversion: 2.25 time: 0.220849 Aug 10 23:00:07.227078 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 512/1051] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:00:06 2022] GET /compute/v2.1/servers/f3722f40-7320-484b-8c20-78b2de3e89f1 => generated 1498 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:00:07.232874 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 540/1052] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:00:06 2022] GET /compute/v2.1/servers/99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0 => generated 1814 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 23:00:07.233045 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-0a141f3e-2a7a-4835-b03d-9a279dbb5bd3 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:07.233045 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-0a141f3e-2a7a-4835-b03d-9a279dbb5bd3 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] [instance: 0af574c3-bfa0-4df6-8f0e-6fcd12e9b8a9] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:00:07.237545 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0a141f3e-2a7a-4835-b03d-9a279dbb5bd3 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:07.238030 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0a141f3e-2a7a-4835-b03d-9a279dbb5bd3 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:07.238467 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0a141f3e-2a7a-4835-b03d-9a279dbb5bd3 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:07.239241 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0a141f3e-2a7a-4835-b03d-9a279dbb5bd3 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:07.240181 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0a141f3e-2a7a-4835-b03d-9a279dbb5bd3 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:07.240181 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0a141f3e-2a7a-4835-b03d-9a279dbb5bd3 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:07.396994 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-ac0a9289-b84b-48d3-a49b-6c013a1f5e44 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:07.402151 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-ac0a9289-b84b-48d3-a49b-6c013a1f5e44 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] [instance: d716cac6-ac7c-4b98-b6ea-2496ccd62096] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:00:07.416210 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ac0a9289-b84b-48d3-a49b-6c013a1f5e44 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:07.418005 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ac0a9289-b84b-48d3-a49b-6c013a1f5e44 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:07.420292 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ac0a9289-b84b-48d3-a49b-6c013a1f5e44 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:07.424344 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ac0a9289-b84b-48d3-a49b-6c013a1f5e44 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:07.427437 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ac0a9289-b84b-48d3-a49b-6c013a1f5e44 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:07.429401 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ac0a9289-b84b-48d3-a49b-6c013a1f5e44 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:07.496214 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-0a141f3e-2a7a-4835-b03d-9a279dbb5bd3 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '417d4eaaeb1c4df78745496ececb3e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27e6ee9495a438b8450a4ef0d62cbcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:00:07.507067 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-0a141f3e-2a7a-4835-b03d-9a279dbb5bd3 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] 10.222.0.58 "GET /compute/v2.1/servers/0af574c3-bfa0-4df6-8f0e-6fcd12e9b8a9" status: 200 len: 1317 microversion: 2.1 time: 0.279786 Aug 10 23:00:07.524728 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 513/1053] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:00:07 2022] GET /compute/v2.1/servers/0af574c3-bfa0-4df6-8f0e-6fcd12e9b8a9 => generated 1317 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:00:07.621394 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-762c2885-e681-4e9c-84a8-8125cd6d5cd5 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:07.622121 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-762c2885-e681-4e9c-84a8-8125cd6d5cd5 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] [instance: e0617f11-199e-41b8-a853-27eb2be0a8db] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:00:07.631769 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-762c2885-e681-4e9c-84a8-8125cd6d5cd5 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:07.634858 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-762c2885-e681-4e9c-84a8-8125cd6d5cd5 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:07.636064 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-762c2885-e681-4e9c-84a8-8125cd6d5cd5 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:07.636835 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-762c2885-e681-4e9c-84a8-8125cd6d5cd5 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:07.637291 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-762c2885-e681-4e9c-84a8-8125cd6d5cd5 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:07.637721 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-762c2885-e681-4e9c-84a8-8125cd6d5cd5 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:07.827380 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-ac0a9289-b84b-48d3-a49b-6c013a1f5e44 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e86e6a62c56248d6a7887be0ec712f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25090b10522b4936b3117dc25dd6f609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:00:07.840556 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-ac0a9289-b84b-48d3-a49b-6c013a1f5e44 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] 10.222.0.58 "GET /compute/v2.1/servers/d716cac6-ac7c-4b98-b6ea-2496ccd62096" status: 200 len: 1467 microversion: 2.1 time: 0.448320 Aug 10 23:00:07.841718 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 541/1054] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:00:07 2022] GET /compute/v2.1/servers/d716cac6-ac7c-4b98-b6ea-2496ccd62096 => generated 1467 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:00:07.867308 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-cac5360a-cda4-4643-bd94-9ddcc10985e1 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1775103122"}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:00:07.870650 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-cac5360a-cda4-4643-bd94-9ddcc10985e1 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] [instance: e1deb45a-4597-4456-a1bd-54013c9484a4] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:00:07.884597 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cac5360a-cda4-4643-bd94-9ddcc10985e1 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:07.887926 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cac5360a-cda4-4643-bd94-9ddcc10985e1 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:07.889163 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cac5360a-cda4-4643-bd94-9ddcc10985e1 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:07.890382 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cac5360a-cda4-4643-bd94-9ddcc10985e1 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:07.891106 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cac5360a-cda4-4643-bd94-9ddcc10985e1 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:07.892960 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cac5360a-cda4-4643-bd94-9ddcc10985e1 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:07.899777 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=100 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:00:08.053649 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-762c2885-e681-4e9c-84a8-8125cd6d5cd5 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e437f9eb7254dc98e2839656c053f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eae334ad72ba421797a6d836edcbab0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:00:08.066698 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-762c2885-e681-4e9c-84a8-8125cd6d5cd5 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] 10.222.0.58 "GET /compute/v2.1/servers/e0617f11-199e-41b8-a853-27eb2be0a8db" status: 200 len: 1317 microversion: 2.1 time: 0.450166 Aug 10 23:00:08.069418 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 514/1055] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:00:07 2022] GET /compute/v2.1/servers/e0617f11-199e-41b8-a853-27eb2be0a8db => generated 1317 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:00:08.094526 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-88681a56-d36c-4fd0-9cb6-fee1aa910dec tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:08.101011 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-88681a56-d36c-4fd0-9cb6-fee1aa910dec tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 1464324b-6977-4faa-8b84-370603a77429] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:00:08.132277 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-88681a56-d36c-4fd0-9cb6-fee1aa910dec tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:08.137252 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-88681a56-d36c-4fd0-9cb6-fee1aa910dec tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:08.137897 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-88681a56-d36c-4fd0-9cb6-fee1aa910dec tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:08.139831 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-88681a56-d36c-4fd0-9cb6-fee1aa910dec tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:08.142800 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-88681a56-d36c-4fd0-9cb6-fee1aa910dec tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:08.146222 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-88681a56-d36c-4fd0-9cb6-fee1aa910dec tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:08.291162 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-cac5360a-cda4-4643-bd94-9ddcc10985e1 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] 10.222.0.58 "POST /compute/v2.1/servers/e1deb45a-4597-4456-a1bd-54013c9484a4/action" status: 202 len: 0 microversion: 2.1 time: 0.427686 Aug 10 23:00:08.292604 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 542/1056] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:00:07 2022] POST /compute/v2.1/servers/e1deb45a-4597-4456-a1bd-54013c9484a4/action => generated 0 bytes in 430 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 10 23:00:08.299772 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-23f0fbd1-1bbe-496d-b714-435d4f3df9f9 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:08.301769 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-23f0fbd1-1bbe-496d-b714-435d4f3df9f9 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] [instance: f3722f40-7320-484b-8c20-78b2de3e89f1] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:00:08.311143 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-23f0fbd1-1bbe-496d-b714-435d4f3df9f9 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:08.312165 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-23f0fbd1-1bbe-496d-b714-435d4f3df9f9 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:08.312811 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-23f0fbd1-1bbe-496d-b714-435d4f3df9f9 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:08.313906 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-23f0fbd1-1bbe-496d-b714-435d4f3df9f9 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:08.316066 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-23f0fbd1-1bbe-496d-b714-435d4f3df9f9 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:08.316857 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-23f0fbd1-1bbe-496d-b714-435d4f3df9f9 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:08.587110 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-88681a56-d36c-4fd0-9cb6-fee1aa910dec tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:00:08.605550 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-88681a56-d36c-4fd0-9cb6-fee1aa910dec tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/1464324b-6977-4faa-8b84-370603a77429" status: 200 len: 1469 microversion: 2.1 time: 0.518594 Aug 10 23:00:08.606151 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 515/1057] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:00:08 2022] GET /compute/v2.1/servers/1464324b-6977-4faa-8b84-370603a77429 => generated 1469 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:00:08.611825 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-8f715464-e353-4046-b5db-e9dfeeb02614 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:08.612170 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-8f715464-e353-4046-b5db-e9dfeeb02614 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] [instance: 99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:00:08.634150 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8f715464-e353-4046-b5db-e9dfeeb02614 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:08.634924 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8f715464-e353-4046-b5db-e9dfeeb02614 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:08.635523 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8f715464-e353-4046-b5db-e9dfeeb02614 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:08.636424 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8f715464-e353-4046-b5db-e9dfeeb02614 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:08.637036 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8f715464-e353-4046-b5db-e9dfeeb02614 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:08.637618 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8f715464-e353-4046-b5db-e9dfeeb02614 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:08.708262 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-23f0fbd1-1bbe-496d-b714-435d4f3df9f9 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6d9806b6724e5aaf8c69be8e70d4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307ab95daa034afbb31f90626885072b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:00:08.717130 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-23f0fbd1-1bbe-496d-b714-435d4f3df9f9 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] 10.222.0.58 "GET /compute/v2.1/servers/f3722f40-7320-484b-8c20-78b2de3e89f1" status: 200 len: 1498 microversion: 2.1 time: 0.422990 Aug 10 23:00:08.733083 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 543/1058] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:00:08 2022] GET /compute/v2.1/servers/f3722f40-7320-484b-8c20-78b2de3e89f1 => generated 1498 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:00:08.733083 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-846cd6a8-b36d-4e54-a212-19bc712be1e2 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Calling method '.version_select at 0x7f847d429700>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:08.819119 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-846cd6a8-b36d-4e54-a212-19bc712be1e2 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] 10.222.0.58 "GET /compute/v2.1/images/29dc70c1-ba79-4729-808e-b203238c7dc9" status: 200 len: 1455 microversion: 2.1 time: 0.095477 Aug 10 23:00:08.820400 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 544/1059] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 10 23:00:08 2022] GET /compute/v2.1/images/29dc70c1-ba79-4729-808e-b203238c7dc9 => generated 1455 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:00:08.826461 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-732fa642-99af-4f80-a7b4-96da5d8da050 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:08.828627 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-732fa642-99af-4f80-a7b4-96da5d8da050 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] [instance: 0af574c3-bfa0-4df6-8f0e-6fcd12e9b8a9] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:00:08.838827 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-732fa642-99af-4f80-a7b4-96da5d8da050 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:08.839721 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-732fa642-99af-4f80-a7b4-96da5d8da050 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:08.840380 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-732fa642-99af-4f80-a7b4-96da5d8da050 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:08.841301 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-732fa642-99af-4f80-a7b4-96da5d8da050 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:08.841964 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-732fa642-99af-4f80-a7b4-96da5d8da050 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:08.842592 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-732fa642-99af-4f80-a7b4-96da5d8da050 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:08.912296 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=2 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:00:08.940368 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=6 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:00:08.999382 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-8f715464-e353-4046-b5db-e9dfeeb02614 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:00:09.009916 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-8f715464-e353-4046-b5db-e9dfeeb02614 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:00:09.014142 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-8f715464-e353-4046-b5db-e9dfeeb02614 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:00:09.017073 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-8f715464-e353-4046-b5db-e9dfeeb02614 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] 10.222.0.58 "GET /compute/v2.1/servers/99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0" status: 200 len: 1814 microversion: 2.25 time: 0.409966 Aug 10 23:00:09.018695 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 516/1060] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:00:08 2022] GET /compute/v2.1/servers/99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0 => generated 1814 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:00:09.094750 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-f106e8cf-a0ff-4600-ae33-6fe9110f742e tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:09.095225 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-f106e8cf-a0ff-4600-ae33-6fe9110f742e tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] [instance: e0617f11-199e-41b8-a853-27eb2be0a8db] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:00:09.101953 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f106e8cf-a0ff-4600-ae33-6fe9110f742e tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:09.102662 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f106e8cf-a0ff-4600-ae33-6fe9110f742e tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:09.103278 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f106e8cf-a0ff-4600-ae33-6fe9110f742e tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:09.104221 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f106e8cf-a0ff-4600-ae33-6fe9110f742e tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:09.104957 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f106e8cf-a0ff-4600-ae33-6fe9110f742e tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:09.105523 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f106e8cf-a0ff-4600-ae33-6fe9110f742e tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:09.245105 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-732fa642-99af-4f80-a7b4-96da5d8da050 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '417d4eaaeb1c4df78745496ececb3e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27e6ee9495a438b8450a4ef0d62cbcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:00:09.256381 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-732fa642-99af-4f80-a7b4-96da5d8da050 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] 10.222.0.58 "GET /compute/v2.1/servers/0af574c3-bfa0-4df6-8f0e-6fcd12e9b8a9" status: 200 len: 1317 microversion: 2.1 time: 0.434709 Aug 10 23:00:09.269830 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 545/1061] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:00:08 2022] GET /compute/v2.1/servers/0af574c3-bfa0-4df6-8f0e-6fcd12e9b8a9 => generated 1317 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:00:09.632735 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-ddb7d890-ef9d-4b71-a919-634d3683b6db tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:09.634600 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-ddb7d890-ef9d-4b71-a919-634d3683b6db tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 1464324b-6977-4faa-8b84-370603a77429] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:00:09.643000 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ddb7d890-ef9d-4b71-a919-634d3683b6db tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:09.644088 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ddb7d890-ef9d-4b71-a919-634d3683b6db tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:09.645007 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ddb7d890-ef9d-4b71-a919-634d3683b6db tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:09.645992 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ddb7d890-ef9d-4b71-a919-634d3683b6db tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:09.646816 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ddb7d890-ef9d-4b71-a919-634d3683b6db tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:09.647497 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ddb7d890-ef9d-4b71-a919-634d3683b6db tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:09.776358 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-f106e8cf-a0ff-4600-ae33-6fe9110f742e tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e437f9eb7254dc98e2839656c053f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eae334ad72ba421797a6d836edcbab0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:00:09.788237 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:00:09.807315 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-f106e8cf-a0ff-4600-ae33-6fe9110f742e tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] 10.222.0.58 "GET /compute/v2.1/servers/e0617f11-199e-41b8-a853-27eb2be0a8db" status: 200 len: 1317 microversion: 2.1 time: 0.716331 Aug 10 23:00:09.809134 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 517/1062] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:00:09 2022] GET /compute/v2.1/servers/e0617f11-199e-41b8-a853-27eb2be0a8db => generated 1317 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:00:09.829320 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-7db40b23-913e-4283-882c-d651b6ac148b tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:09.830499 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-7db40b23-913e-4283-882c-d651b6ac148b tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] [instance: f3722f40-7320-484b-8c20-78b2de3e89f1] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:00:09.857761 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7db40b23-913e-4283-882c-d651b6ac148b tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:09.860804 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7db40b23-913e-4283-882c-d651b6ac148b tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:09.861599 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7db40b23-913e-4283-882c-d651b6ac148b tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:09.862528 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7db40b23-913e-4283-882c-d651b6ac148b tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:09.867067 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7db40b23-913e-4283-882c-d651b6ac148b tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:09.868347 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7db40b23-913e-4283-882c-d651b6ac148b tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:09.971682 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-ddb7d890-ef9d-4b71-a919-634d3683b6db tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:00:09.981752 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-ddb7d890-ef9d-4b71-a919-634d3683b6db tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/1464324b-6977-4faa-8b84-370603a77429" status: 200 len: 1469 microversion: 2.1 time: 0.353199 Aug 10 23:00:09.991992 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 546/1063] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:00:09 2022] GET /compute/v2.1/servers/1464324b-6977-4faa-8b84-370603a77429 => generated 1469 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:00:10.001270 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c7284438-22cc-4b92-908c-d3a0443dc85d tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Calling method '.version_select at 0x7f847d3748b0>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:10.069724 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-c7284438-22cc-4b92-908c-d3a0443dc85d tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] 10.222.0.58 "GET /compute/v2.1/images/29dc70c1-ba79-4729-808e-b203238c7dc9" status: 200 len: 1455 microversion: 2.1 time: 0.076433 Aug 10 23:00:10.070645 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 547/1064] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 10 23:00:09 2022] GET /compute/v2.1/images/29dc70c1-ba79-4729-808e-b203238c7dc9 => generated 1455 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:00:10.086358 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-41233275-5d78-456d-9221-d2f260a45db3 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:10.087086 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-41233275-5d78-456d-9221-d2f260a45db3 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] [instance: 99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:00:10.093838 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-41233275-5d78-456d-9221-d2f260a45db3 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:10.096455 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-41233275-5d78-456d-9221-d2f260a45db3 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:10.096942 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-41233275-5d78-456d-9221-d2f260a45db3 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:10.097741 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-41233275-5d78-456d-9221-d2f260a45db3 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:10.098209 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-41233275-5d78-456d-9221-d2f260a45db3 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:10.098635 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-41233275-5d78-456d-9221-d2f260a45db3 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:10.223152 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-7db40b23-913e-4283-882c-d651b6ac148b tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6d9806b6724e5aaf8c69be8e70d4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307ab95daa034afbb31f90626885072b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:00:10.252273 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-7db40b23-913e-4283-882c-d651b6ac148b tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] 10.222.0.58 "GET /compute/v2.1/servers/f3722f40-7320-484b-8c20-78b2de3e89f1" status: 200 len: 1475 microversion: 2.1 time: 0.436487 Aug 10 23:00:10.254824 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 518/1065] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:00:09 2022] GET /compute/v2.1/servers/f3722f40-7320-484b-8c20-78b2de3e89f1 => generated 1475 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:00:10.261327 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-824f4daf-3b00-4c49-af50-00c2066ad181 req-e0f7301f-d235-4269-bfe8-2bec2e02d17f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d716cac6-ac7c-4b98-b6ea-2496ccd62096", "name": "network-vif-unplugged", "status": "completed", "tag": "30ea23cf-a364-4798-a6be-6ab46d11599e"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:00:10.280928 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-824f4daf-3b00-4c49-af50-00c2066ad181 req-e0f7301f-d235-4269-bfe8-2bec2e02d17f service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:10.281858 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-824f4daf-3b00-4c49-af50-00c2066ad181 req-e0f7301f-d235-4269-bfe8-2bec2e02d17f service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:10.282494 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-824f4daf-3b00-4c49-af50-00c2066ad181 req-e0f7301f-d235-4269-bfe8-2bec2e02d17f service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:10.309324 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-824f4daf-3b00-4c49-af50-00c2066ad181 req-e0f7301f-d235-4269-bfe8-2bec2e02d17f service nova] Creating event network-vif-unplugged:30ea23cf-a364-4798-a6be-6ab46d11599e for instance d716cac6-ac7c-4b98-b6ea-2496ccd62096 on n-h2-850468-14 Aug 10 23:00:10.325007 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-824f4daf-3b00-4c49-af50-00c2066ad181 req-e0f7301f-d235-4269-bfe8-2bec2e02d17f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.068630 Aug 10 23:00:10.326942 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 519/1066] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:00:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:00:10.339375 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-e8446a13-858f-4e01-88ef-66c08ae8e6e2 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:10.340636 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-e8446a13-858f-4e01-88ef-66c08ae8e6e2 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] [instance: 0af574c3-bfa0-4df6-8f0e-6fcd12e9b8a9] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:00:10.351467 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e8446a13-858f-4e01-88ef-66c08ae8e6e2 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:10.352557 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e8446a13-858f-4e01-88ef-66c08ae8e6e2 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:10.353224 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e8446a13-858f-4e01-88ef-66c08ae8e6e2 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:10.354602 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e8446a13-858f-4e01-88ef-66c08ae8e6e2 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:10.355362 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e8446a13-858f-4e01-88ef-66c08ae8e6e2 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:10.355997 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e8446a13-858f-4e01-88ef-66c08ae8e6e2 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:10.492700 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-41233275-5d78-456d-9221-d2f260a45db3 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:00:10.510870 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-41233275-5d78-456d-9221-d2f260a45db3 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:00:10.541679 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-41233275-5d78-456d-9221-d2f260a45db3 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:00:10.542947 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-41233275-5d78-456d-9221-d2f260a45db3 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] 10.222.0.58 "GET /compute/v2.1/servers/99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0" status: 200 len: 1814 microversion: 2.25 time: 0.470103 Aug 10 23:00:10.561220 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 548/1067] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:00:10 2022] GET /compute/v2.1/servers/99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0 => generated 1814 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:00:10.567148 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-f6c6a809-721c-49c0-a138-b99beb6cd3fb tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1605948371"}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:00:10.581940 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-f6c6a809-721c-49c0-a138-b99beb6cd3fb tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] [instance: f3722f40-7320-484b-8c20-78b2de3e89f1] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:00:10.591199 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f6c6a809-721c-49c0-a138-b99beb6cd3fb tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:10.591928 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f6c6a809-721c-49c0-a138-b99beb6cd3fb tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:10.592521 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f6c6a809-721c-49c0-a138-b99beb6cd3fb tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:10.595762 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f6c6a809-721c-49c0-a138-b99beb6cd3fb tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:10.596590 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f6c6a809-721c-49c0-a138-b99beb6cd3fb tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:10.597337 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f6c6a809-721c-49c0-a138-b99beb6cd3fb tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:10.670260 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-e8446a13-858f-4e01-88ef-66c08ae8e6e2 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '417d4eaaeb1c4df78745496ececb3e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27e6ee9495a438b8450a4ef0d62cbcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:00:10.682047 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-e8446a13-858f-4e01-88ef-66c08ae8e6e2 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] 10.222.0.58 "GET /compute/v2.1/servers/0af574c3-bfa0-4df6-8f0e-6fcd12e9b8a9" status: 200 len: 1317 microversion: 2.1 time: 0.352724 Aug 10 23:00:10.695893 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 520/1068] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:00:10 2022] GET /compute/v2.1/servers/0af574c3-bfa0-4df6-8f0e-6fcd12e9b8a9 => generated 1317 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:00:10.834771 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-98bf9bc4-ced1-4d2d-abb3-11f9ac5faf68 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:10.835481 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-98bf9bc4-ced1-4d2d-abb3-11f9ac5faf68 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] [instance: e0617f11-199e-41b8-a853-27eb2be0a8db] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:00:10.853062 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-98bf9bc4-ced1-4d2d-abb3-11f9ac5faf68 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:10.855006 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-98bf9bc4-ced1-4d2d-abb3-11f9ac5faf68 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:10.865857 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-98bf9bc4-ced1-4d2d-abb3-11f9ac5faf68 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:10.867595 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-98bf9bc4-ced1-4d2d-abb3-11f9ac5faf68 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:10.876268 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-98bf9bc4-ced1-4d2d-abb3-11f9ac5faf68 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:10.878386 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-98bf9bc4-ced1-4d2d-abb3-11f9ac5faf68 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:10.885314 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-f6c6a809-721c-49c0-a138-b99beb6cd3fb tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] 10.222.0.58 "POST /compute/v2.1/servers/f3722f40-7320-484b-8c20-78b2de3e89f1/action" status: 202 len: 0 microversion: 2.1 time: 0.322391 Aug 10 23:00:10.892870 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 549/1069] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:00:10 2022] POST /compute/v2.1/servers/f3722f40-7320-484b-8c20-78b2de3e89f1/action => generated 0 bytes in 331 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 10 23:00:10.906521 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-ec55c64f-d67b-4985-b28d-440cc542e3dd tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Calling method '.version_select at 0x7f847d3c0940>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:10.984794 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-ec55c64f-d67b-4985-b28d-440cc542e3dd tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] 10.222.0.58 "GET /compute/v2.1/images/e2865b60-3ea2-4c52-b3d9-f3a6e58bc75a" status: 200 len: 1414 microversion: 2.1 time: 0.084189 Aug 10 23:00:10.995727 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 550/1070] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 10 23:00:10 2022] GET /compute/v2.1/images/e2865b60-3ea2-4c52-b3d9-f3a6e58bc75a => generated 1414 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:00:11.006757 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-9da9f801-f76d-48d4-9658-4b85f0f2f4cc tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:11.007840 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-9da9f801-f76d-48d4-9658-4b85f0f2f4cc tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 1464324b-6977-4faa-8b84-370603a77429] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:00:11.022340 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9da9f801-f76d-48d4-9658-4b85f0f2f4cc tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:11.022340 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9da9f801-f76d-48d4-9658-4b85f0f2f4cc tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:11.022340 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9da9f801-f76d-48d4-9658-4b85f0f2f4cc tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:11.022340 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9da9f801-f76d-48d4-9658-4b85f0f2f4cc tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:11.022650 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9da9f801-f76d-48d4-9658-4b85f0f2f4cc tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:11.022650 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9da9f801-f76d-48d4-9658-4b85f0f2f4cc tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:11.120473 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-98bf9bc4-ced1-4d2d-abb3-11f9ac5faf68 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e437f9eb7254dc98e2839656c053f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eae334ad72ba421797a6d836edcbab0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:00:11.130498 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-98bf9bc4-ced1-4d2d-abb3-11f9ac5faf68 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] 10.222.0.58 "GET /compute/v2.1/servers/e0617f11-199e-41b8-a853-27eb2be0a8db" status: 200 len: 1317 microversion: 2.1 time: 0.304524 Aug 10 23:00:11.132140 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 521/1071] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:00:10 2022] GET /compute/v2.1/servers/e0617f11-199e-41b8-a853-27eb2be0a8db => generated 1317 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:00:11.137377 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-ad82d304-8c7b-4afc-8ad4-d1ff25acc0ca tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Calling method '.version_select at 0x7f847d4fbb80>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:11.191629 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-ad82d304-8c7b-4afc-8ad4-d1ff25acc0ca tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] 10.222.0.58 "GET /compute/v2.1/images/29dc70c1-ba79-4729-808e-b203238c7dc9" status: 200 len: 1455 microversion: 2.1 time: 0.058195 Aug 10 23:00:11.193070 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 522/1072] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 10 23:00:11 2022] GET /compute/v2.1/images/29dc70c1-ba79-4729-808e-b203238c7dc9 => generated 1455 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:00:11.421411 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-9da9f801-f76d-48d4-9658-4b85f0f2f4cc tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:00:11.431080 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-9da9f801-f76d-48d4-9658-4b85f0f2f4cc tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/1464324b-6977-4faa-8b84-370603a77429" status: 200 len: 1469 microversion: 2.1 time: 0.429235 Aug 10 23:00:11.434407 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 551/1073] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:00:11 2022] GET /compute/v2.1/servers/1464324b-6977-4faa-8b84-370603a77429 => generated 1469 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:00:11.569065 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-54feb435-6c02-4a80-a63a-e5437abda45f tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:11.569598 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-54feb435-6c02-4a80-a63a-e5437abda45f tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] [instance: 99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:00:11.576478 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-54feb435-6c02-4a80-a63a-e5437abda45f tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:11.577380 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-54feb435-6c02-4a80-a63a-e5437abda45f tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:11.578021 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-54feb435-6c02-4a80-a63a-e5437abda45f tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:11.579002 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-54feb435-6c02-4a80-a63a-e5437abda45f tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:11.579459 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-54feb435-6c02-4a80-a63a-e5437abda45f tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:11.580105 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-54feb435-6c02-4a80-a63a-e5437abda45f tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:11.703076 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-aad52281-f4fd-4a3d-87b9-047905672c23 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:11.703929 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-aad52281-f4fd-4a3d-87b9-047905672c23 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] [instance: 0af574c3-bfa0-4df6-8f0e-6fcd12e9b8a9] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:00:11.711160 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-aad52281-f4fd-4a3d-87b9-047905672c23 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:11.711907 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-aad52281-f4fd-4a3d-87b9-047905672c23 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:11.715204 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-aad52281-f4fd-4a3d-87b9-047905672c23 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:11.717813 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-aad52281-f4fd-4a3d-87b9-047905672c23 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:11.719203 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-aad52281-f4fd-4a3d-87b9-047905672c23 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:11.719898 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-aad52281-f4fd-4a3d-87b9-047905672c23 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:11.813437 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-54feb435-6c02-4a80-a63a-e5437abda45f tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:00:11.830285 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-54feb435-6c02-4a80-a63a-e5437abda45f tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:00:11.835150 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-54feb435-6c02-4a80-a63a-e5437abda45f tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:00:11.841647 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-54feb435-6c02-4a80-a63a-e5437abda45f tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] 10.222.0.58 "GET /compute/v2.1/servers/99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0" status: 200 len: 1814 microversion: 2.25 time: 0.277057 Aug 10 23:00:11.855761 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 523/1074] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:00:11 2022] GET /compute/v2.1/servers/99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0 => generated 1814 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:00:12.006544 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-cece6f0f-5db5-485f-ae3a-519070478aeb tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Calling method '.version_select at 0x7f847d390d30>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:12.080946 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-cece6f0f-5db5-485f-ae3a-519070478aeb tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] 10.222.0.58 "GET /compute/v2.1/images/e2865b60-3ea2-4c52-b3d9-f3a6e58bc75a" status: 200 len: 1414 microversion: 2.1 time: 0.081469 Aug 10 23:00:12.088253 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 524/1075] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 10 23:00:11 2022] GET /compute/v2.1/images/e2865b60-3ea2-4c52-b3d9-f3a6e58bc75a => generated 1414 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:00:12.154824 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-60c18660-0d3f-4a6a-b681-9c65b4234327 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:12.160493 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-60c18660-0d3f-4a6a-b681-9c65b4234327 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] [instance: e0617f11-199e-41b8-a853-27eb2be0a8db] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:00:12.182170 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-60c18660-0d3f-4a6a-b681-9c65b4234327 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:12.183461 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-60c18660-0d3f-4a6a-b681-9c65b4234327 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:12.185836 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-60c18660-0d3f-4a6a-b681-9c65b4234327 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:12.187233 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-60c18660-0d3f-4a6a-b681-9c65b4234327 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:12.187925 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-60c18660-0d3f-4a6a-b681-9c65b4234327 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:12.188582 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-60c18660-0d3f-4a6a-b681-9c65b4234327 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:12.304724 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-aad52281-f4fd-4a3d-87b9-047905672c23 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '417d4eaaeb1c4df78745496ececb3e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27e6ee9495a438b8450a4ef0d62cbcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:00:12.319138 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-aad52281-f4fd-4a3d-87b9-047905672c23 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] 10.222.0.58 "GET /compute/v2.1/servers/0af574c3-bfa0-4df6-8f0e-6fcd12e9b8a9" status: 200 len: 1317 microversion: 2.1 time: 0.615123 Aug 10 23:00:12.320155 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 552/1076] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:00:11 2022] GET /compute/v2.1/servers/0af574c3-bfa0-4df6-8f0e-6fcd12e9b8a9 => generated 1317 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:00:12.325109 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-6cf0d12a-fdf7-46c7-bf38-fa4efaa014a4 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Calling method '.version_select at 0x7f847d32d3a0>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:12.390362 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-6cf0d12a-fdf7-46c7-bf38-fa4efaa014a4 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] 10.222.0.58 "GET /compute/v2.1/images/29dc70c1-ba79-4729-808e-b203238c7dc9" status: 200 len: 1455 microversion: 2.1 time: 0.068885 Aug 10 23:00:12.391883 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 553/1077] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 10 23:00:12 2022] GET /compute/v2.1/images/29dc70c1-ba79-4729-808e-b203238c7dc9 => generated 1455 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:00:12.403412 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-11e8e66c-b138-4ace-b2de-1e124bbe6b8a req-d026f7b3-d0f2-4698-b9a9-1476cccac4eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0617f11-199e-41b8-a853-27eb2be0a8db", "name": "network-vif-plugged", "status": "completed", "tag": "4c64e25d-82ab-4c38-8bc1-7e67b114eba8"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:00:12.403639 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-60c18660-0d3f-4a6a-b681-9c65b4234327 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e437f9eb7254dc98e2839656c053f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eae334ad72ba421797a6d836edcbab0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:00:12.413249 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-60c18660-0d3f-4a6a-b681-9c65b4234327 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] 10.222.0.58 "GET /compute/v2.1/servers/e0617f11-199e-41b8-a853-27eb2be0a8db" status: 200 len: 1317 microversion: 2.1 time: 0.264349 Aug 10 23:00:12.414692 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 525/1078] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:00:12 2022] GET /compute/v2.1/servers/e0617f11-199e-41b8-a853-27eb2be0a8db => generated 1317 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:00:12.415521 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-11e8e66c-b138-4ace-b2de-1e124bbe6b8a req-d026f7b3-d0f2-4698-b9a9-1476cccac4eb service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:12.416064 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-11e8e66c-b138-4ace-b2de-1e124bbe6b8a req-d026f7b3-d0f2-4698-b9a9-1476cccac4eb service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:12.416809 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-11e8e66c-b138-4ace-b2de-1e124bbe6b8a req-d026f7b3-d0f2-4698-b9a9-1476cccac4eb service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:12.429413 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-11e8e66c-b138-4ace-b2de-1e124bbe6b8a req-d026f7b3-d0f2-4698-b9a9-1476cccac4eb service nova] Creating event network-vif-plugged:4c64e25d-82ab-4c38-8bc1-7e67b114eba8 for instance e0617f11-199e-41b8-a853-27eb2be0a8db on n-h2-850468-14 Aug 10 23:00:12.435948 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-11e8e66c-b138-4ace-b2de-1e124bbe6b8a req-d026f7b3-d0f2-4698-b9a9-1476cccac4eb service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036942 Aug 10 23:00:12.437008 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 554/1079] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:00:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:00:12.453773 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-bc521a27-279d-4415-9d40-059f4c7836c4 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:12.454405 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-bc521a27-279d-4415-9d40-059f4c7836c4 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 1464324b-6977-4faa-8b84-370603a77429] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:00:12.463348 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bc521a27-279d-4415-9d40-059f4c7836c4 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:12.464210 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bc521a27-279d-4415-9d40-059f4c7836c4 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:12.465004 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bc521a27-279d-4415-9d40-059f4c7836c4 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:12.480743 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bc521a27-279d-4415-9d40-059f4c7836c4 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:12.482537 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bc521a27-279d-4415-9d40-059f4c7836c4 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:12.483988 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bc521a27-279d-4415-9d40-059f4c7836c4 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:12.719480 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-bc521a27-279d-4415-9d40-059f4c7836c4 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:00:12.728310 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-bc521a27-279d-4415-9d40-059f4c7836c4 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/1464324b-6977-4faa-8b84-370603a77429" status: 200 len: 1535 microversion: 2.1 time: 0.278216 Aug 10 23:00:12.734903 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 526/1080] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:00:12 2022] GET /compute/v2.1/servers/1464324b-6977-4faa-8b84-370603a77429 => generated 1535 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:00:12.873951 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-50812260-b45d-41cb-a028-06c8815f97da tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:12.874697 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-50812260-b45d-41cb-a028-06c8815f97da tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] [instance: 99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:00:12.890016 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-50812260-b45d-41cb-a028-06c8815f97da tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:12.890748 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-50812260-b45d-41cb-a028-06c8815f97da tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:12.891327 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-50812260-b45d-41cb-a028-06c8815f97da tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:12.892261 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-50812260-b45d-41cb-a028-06c8815f97da tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:12.893289 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-50812260-b45d-41cb-a028-06c8815f97da tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:12.893787 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-50812260-b45d-41cb-a028-06c8815f97da tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:13.097140 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-33125b67-a090-4995-9ef6-447f8c4d5686 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Calling method '.version_select at 0x7f847db49160>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:13.105164 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-50812260-b45d-41cb-a028-06c8815f97da tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:00:13.116364 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-50812260-b45d-41cb-a028-06c8815f97da tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:00:13.118076 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-50812260-b45d-41cb-a028-06c8815f97da tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:00:13.119839 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-50812260-b45d-41cb-a028-06c8815f97da tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] 10.222.0.58 "GET /compute/v2.1/servers/99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0" status: 200 len: 1814 microversion: 2.25 time: 0.249973 Aug 10 23:00:13.120716 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 555/1081] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:00:12 2022] GET /compute/v2.1/servers/99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0 => generated 1814 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:00:13.176156 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-33125b67-a090-4995-9ef6-447f8c4d5686 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] 10.222.0.58 "GET /compute/v2.1/images/e2865b60-3ea2-4c52-b3d9-f3a6e58bc75a" status: 200 len: 1414 microversion: 2.1 time: 0.085332 Aug 10 23:00:13.176735 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 527/1082] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 10 23:00:13 2022] GET /compute/v2.1/images/e2865b60-3ea2-4c52-b3d9-f3a6e58bc75a => generated 1414 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:00:13.340237 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-30c33f64-f984-4e01-8b08-ceef37063762 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:13.340963 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-30c33f64-f984-4e01-8b08-ceef37063762 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] [instance: 0af574c3-bfa0-4df6-8f0e-6fcd12e9b8a9] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:00:13.349689 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-30c33f64-f984-4e01-8b08-ceef37063762 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:13.350799 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-30c33f64-f984-4e01-8b08-ceef37063762 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:13.351379 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-30c33f64-f984-4e01-8b08-ceef37063762 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:13.352428 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-30c33f64-f984-4e01-8b08-ceef37063762 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:13.353018 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-30c33f64-f984-4e01-8b08-ceef37063762 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:13.353603 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-30c33f64-f984-4e01-8b08-ceef37063762 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:13.406947 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-16c1624f-ca26-485c-9065-7de2a3628bc1 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Calling method '.version_select at 0x7f847d8f9ee0>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:13.476011 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-16c1624f-ca26-485c-9065-7de2a3628bc1 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] 10.222.0.58 "GET /compute/v2.1/images/29dc70c1-ba79-4729-808e-b203238c7dc9" status: 200 len: 1455 microversion: 2.1 time: 0.071287 Aug 10 23:00:13.487773 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 528/1083] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 10 23:00:13 2022] GET /compute/v2.1/images/29dc70c1-ba79-4729-808e-b203238c7dc9 => generated 1455 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:00:13.494181 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-4d5501aa-f326-483f-8385-dbe9daf16458 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:13.494181 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-4d5501aa-f326-483f-8385-dbe9daf16458 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] [instance: e0617f11-199e-41b8-a853-27eb2be0a8db] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:00:13.508427 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4d5501aa-f326-483f-8385-dbe9daf16458 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:13.508427 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4d5501aa-f326-483f-8385-dbe9daf16458 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:13.508786 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4d5501aa-f326-483f-8385-dbe9daf16458 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:13.509453 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4d5501aa-f326-483f-8385-dbe9daf16458 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:13.509904 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4d5501aa-f326-483f-8385-dbe9daf16458 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:13.510325 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4d5501aa-f326-483f-8385-dbe9daf16458 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:13.559470 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-30c33f64-f984-4e01-8b08-ceef37063762 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '417d4eaaeb1c4df78745496ececb3e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27e6ee9495a438b8450a4ef0d62cbcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:00:13.568338 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-30c33f64-f984-4e01-8b08-ceef37063762 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] 10.222.0.58 "GET /compute/v2.1/servers/0af574c3-bfa0-4df6-8f0e-6fcd12e9b8a9" status: 200 len: 1317 microversion: 2.1 time: 0.231920 Aug 10 23:00:13.569187 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 556/1084] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:00:13 2022] GET /compute/v2.1/servers/0af574c3-bfa0-4df6-8f0e-6fcd12e9b8a9 => generated 1317 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:00:13.670773 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-4d5501aa-f326-483f-8385-dbe9daf16458 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e437f9eb7254dc98e2839656c053f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eae334ad72ba421797a6d836edcbab0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:00:13.685171 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-4d5501aa-f326-483f-8385-dbe9daf16458 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] 10.222.0.58 "GET /compute/v2.1/servers/e0617f11-199e-41b8-a853-27eb2be0a8db" status: 200 len: 1317 microversion: 2.1 time: 0.197009 Aug 10 23:00:13.686208 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 529/1085] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:00:13 2022] GET /compute/v2.1/servers/e0617f11-199e-41b8-a853-27eb2be0a8db => generated 1317 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:00:13.750305 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-d422ebc4-fea2-4f5f-b3bf-b67145c9f632 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:13.750973 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-d422ebc4-fea2-4f5f-b3bf-b67145c9f632 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 1464324b-6977-4faa-8b84-370603a77429] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:00:13.757787 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d422ebc4-fea2-4f5f-b3bf-b67145c9f632 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:13.758514 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d422ebc4-fea2-4f5f-b3bf-b67145c9f632 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:13.759350 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d422ebc4-fea2-4f5f-b3bf-b67145c9f632 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:13.760435 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d422ebc4-fea2-4f5f-b3bf-b67145c9f632 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:13.761134 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d422ebc4-fea2-4f5f-b3bf-b67145c9f632 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:13.761566 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d422ebc4-fea2-4f5f-b3bf-b67145c9f632 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:13.925848 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-d422ebc4-fea2-4f5f-b3bf-b67145c9f632 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:00:13.935052 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-d422ebc4-fea2-4f5f-b3bf-b67145c9f632 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/1464324b-6977-4faa-8b84-370603a77429" status: 200 len: 1535 microversion: 2.1 time: 0.189533 Aug 10 23:00:13.936024 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 557/1086] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:00:13 2022] GET /compute/v2.1/servers/1464324b-6977-4faa-8b84-370603a77429 => generated 1535 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:00:14.024760 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-92d73185-7435-46d6-9348-5df51bba9ac9 tempest-FlavorsV2NegativeTest-993776041 tempest-FlavorsV2NegativeTest-993776041-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:14.033839 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-92d73185-7435-46d6-9348-5df51bba9ac9 tempest-FlavorsV2NegativeTest-993776041 tempest-FlavorsV2NegativeTest-993776041-project] 10.222.0.58 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.144631 Aug 10 23:00:14.034391 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 530/1087] 10.222.0.58 () {58 vars in 1137 bytes} [Wed Aug 10 23:00:13 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 23:00:14.144351 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-2d231c1f-dd45-437f-a134-4b4bf7c6c62c tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:14.144967 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-2d231c1f-dd45-437f-a134-4b4bf7c6c62c tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] [instance: 99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:00:14.152595 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2d231c1f-dd45-437f-a134-4b4bf7c6c62c tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:14.153415 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2d231c1f-dd45-437f-a134-4b4bf7c6c62c tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:14.153991 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2d231c1f-dd45-437f-a134-4b4bf7c6c62c tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:14.154914 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2d231c1f-dd45-437f-a134-4b4bf7c6c62c tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:14.155365 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2d231c1f-dd45-437f-a134-4b4bf7c6c62c tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:14.155984 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2d231c1f-dd45-437f-a134-4b4bf7c6c62c tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:14.191477 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c800de47-c575-4a5c-9e4b-f4ab3cd2ea0a tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Calling method '.version_select at 0x7f847d367670>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:14.334200 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-2d231c1f-dd45-437f-a134-4b4bf7c6c62c tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:00:14.344022 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-2d231c1f-dd45-437f-a134-4b4bf7c6c62c tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:00:14.347184 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-2d231c1f-dd45-437f-a134-4b4bf7c6c62c tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:00:14.348439 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-2d231c1f-dd45-437f-a134-4b4bf7c6c62c tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] 10.222.0.58 "GET /compute/v2.1/servers/99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0" status: 200 len: 1814 microversion: 2.25 time: 0.209209 Aug 10 23:00:14.349214 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 558/1088] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:00:14 2022] GET /compute/v2.1/servers/99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0 => generated 1814 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 23:00:14.483923 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-ebe7d451-6208-4ab8-a45e-77951cf995a1 req-396861eb-970f-48eb-b5c3-8b0154631d2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0af574c3-bfa0-4df6-8f0e-6fcd12e9b8a9", "name": "network-vif-plugged", "status": "completed", "tag": "619742dd-1d71-452c-be56-cfa1c8c095fa"}, {"server_uuid": "1464324b-6977-4faa-8b84-370603a77429", "name": "network-vif-plugged", "status": "completed", "tag": "6a54d59d-b7dd-4033-89c5-dd089d9e9fb8"}, {"server_uuid": "f3722f40-7320-484b-8c20-78b2de3e89f1", "name": "network-vif-plugged", "status": "completed", "tag": "3cd54803-1880-47e0-b27e-07883f5c80f2"}, {"server_uuid": "e1deb45a-4597-4456-a1bd-54013c9484a4", "name": "network-vif-plugged", "status": "completed", "tag": "c23c9196-ec43-4cc3-a250-0ae9f5c58948"}, {"server_uuid": "1464324b-6977-4faa-8b84-370603a77429", "name": "network-vif-unplugged", "status": "completed", "tag": "6a54d59d-b7dd-4033-89c5-dd089d9e9fb8"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:00:14.498537 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-ebe7d451-6208-4ab8-a45e-77951cf995a1 req-396861eb-970f-48eb-b5c3-8b0154631d2e service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:14.508778 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-ebe7d451-6208-4ab8-a45e-77951cf995a1 req-396861eb-970f-48eb-b5c3-8b0154631d2e service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:14.515148 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-ebe7d451-6208-4ab8-a45e-77951cf995a1 req-396861eb-970f-48eb-b5c3-8b0154631d2e service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:14.546357 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-ebe7d451-6208-4ab8-a45e-77951cf995a1 req-396861eb-970f-48eb-b5c3-8b0154631d2e service nova] Creating event network-vif-plugged:619742dd-1d71-452c-be56-cfa1c8c095fa for instance 0af574c3-bfa0-4df6-8f0e-6fcd12e9b8a9 on n-h1-850468-14 Aug 10 23:00:14.546878 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-ebe7d451-6208-4ab8-a45e-77951cf995a1 req-396861eb-970f-48eb-b5c3-8b0154631d2e service nova] Creating event network-vif-plugged:6a54d59d-b7dd-4033-89c5-dd089d9e9fb8 for instance 1464324b-6977-4faa-8b84-370603a77429 on n-h1-850468-14 Aug 10 23:00:14.547384 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-ebe7d451-6208-4ab8-a45e-77951cf995a1 req-396861eb-970f-48eb-b5c3-8b0154631d2e service nova] Creating event network-vif-plugged:3cd54803-1880-47e0-b27e-07883f5c80f2 for instance f3722f40-7320-484b-8c20-78b2de3e89f1 on n-h2-850468-14 Aug 10 23:00:14.547881 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-ebe7d451-6208-4ab8-a45e-77951cf995a1 req-396861eb-970f-48eb-b5c3-8b0154631d2e service nova] Creating event network-vif-plugged:c23c9196-ec43-4cc3-a250-0ae9f5c58948 for instance e1deb45a-4597-4456-a1bd-54013c9484a4 on n-h1-850468-14 Aug 10 23:00:14.548706 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-ebe7d451-6208-4ab8-a45e-77951cf995a1 req-396861eb-970f-48eb-b5c3-8b0154631d2e service nova] Creating event network-vif-unplugged:6a54d59d-b7dd-4033-89c5-dd089d9e9fb8 for instance 1464324b-6977-4faa-8b84-370603a77429 on n-h1-850468-14 Aug 10 23:00:14.554962 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [req-ebe7d451-6208-4ab8-a45e-77951cf995a1 req-396861eb-970f-48eb-b5c3-8b0154631d2e service nova] Instance 1464324b-6977-4faa-8b84-370603a77429 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-850468-14'} {{(pid=122633) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5901}} Aug 10 23:00:14.588165 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-ebe7d451-6208-4ab8-a45e-77951cf995a1 req-396861eb-970f-48eb-b5c3-8b0154631d2e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 869 microversion: 2.1 time: 0.114277 Aug 10 23:00:14.589020 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 559/1089] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:00:14 2022] POST /compute/v2.1/os-server-external-events => generated 869 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:00:14.599289 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-f82fa5b6-0bb2-40ab-9fb8-6c460d2ea7a0 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Calling method '.version_select at 0x7f847d3c0040>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:14.718767 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-c800de47-c575-4a5c-9e4b-f4ab3cd2ea0a tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] 10.222.0.58 "GET /compute/v2.1/images/e2865b60-3ea2-4c52-b3d9-f3a6e58bc75a" status: 200 len: 1414 microversion: 2.1 time: 0.530725 Aug 10 23:00:14.727950 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 531/1090] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 10 23:00:14 2022] GET /compute/v2.1/images/e2865b60-3ea2-4c52-b3d9-f3a6e58bc75a => generated 1414 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:00:14.734306 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c8a30f00-3fec-4e5e-8222-efca72605d20 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:14.735205 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-c8a30f00-3fec-4e5e-8222-efca72605d20 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] [instance: 0af574c3-bfa0-4df6-8f0e-6fcd12e9b8a9] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:00:14.747160 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c8a30f00-3fec-4e5e-8222-efca72605d20 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:14.747834 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c8a30f00-3fec-4e5e-8222-efca72605d20 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:14.748999 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c8a30f00-3fec-4e5e-8222-efca72605d20 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:14.751041 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c8a30f00-3fec-4e5e-8222-efca72605d20 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:14.752006 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c8a30f00-3fec-4e5e-8222-efca72605d20 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:14.752801 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c8a30f00-3fec-4e5e-8222-efca72605d20 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:15.023893 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-c8a30f00-3fec-4e5e-8222-efca72605d20 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '417d4eaaeb1c4df78745496ececb3e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27e6ee9495a438b8450a4ef0d62cbcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:00:15.046799 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-c8a30f00-3fec-4e5e-8222-efca72605d20 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] 10.222.0.58 "GET /compute/v2.1/servers/0af574c3-bfa0-4df6-8f0e-6fcd12e9b8a9" status: 200 len: 1317 microversion: 2.1 time: 0.312357 Aug 10 23:00:15.046799 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 532/1091] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:00:14 2022] GET /compute/v2.1/servers/0af574c3-bfa0-4df6-8f0e-6fcd12e9b8a9 => generated 1317 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:00:15.051437 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-21568f90-2f52-4c7d-bed2-ca7bd73b312e tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:15.052013 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-21568f90-2f52-4c7d-bed2-ca7bd73b312e tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] [instance: e0617f11-199e-41b8-a853-27eb2be0a8db] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:00:15.064697 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-21568f90-2f52-4c7d-bed2-ca7bd73b312e tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:15.065184 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-21568f90-2f52-4c7d-bed2-ca7bd73b312e tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:15.067193 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-21568f90-2f52-4c7d-bed2-ca7bd73b312e tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:15.067959 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-21568f90-2f52-4c7d-bed2-ca7bd73b312e tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:15.068513 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-21568f90-2f52-4c7d-bed2-ca7bd73b312e tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:15.069298 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-21568f90-2f52-4c7d-bed2-ca7bd73b312e tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:15.352874 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-21568f90-2f52-4c7d-bed2-ca7bd73b312e tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e437f9eb7254dc98e2839656c053f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eae334ad72ba421797a6d836edcbab0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:00:15.367121 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-21568f90-2f52-4c7d-bed2-ca7bd73b312e tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] 10.222.0.58 "GET /compute/v2.1/servers/e0617f11-199e-41b8-a853-27eb2be0a8db" status: 200 len: 1507 microversion: 2.1 time: 0.320849 Aug 10 23:00:15.383511 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 533/1092] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:00:15 2022] GET /compute/v2.1/servers/e0617f11-199e-41b8-a853-27eb2be0a8db => generated 1507 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:00:15.394380 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-7ad931b8-053f-47e8-99f0-c0289543c6de tempest-FlavorsV2NegativeTest-993776041 tempest-FlavorsV2NegativeTest-993776041-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-703252647", "imageRef": "db9d4507-fb8a-4cf3-b0e6-3bb5df99aebf", "flavorRef": "452"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:00:16.549147 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=3 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:00:24.500667 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_api:SELECT=39 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:00:24.552450 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:00:25.361485 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=56 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:00:25.404847 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-f82fa5b6-0bb2-40ab-9fb8-6c460d2ea7a0 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] 10.222.0.58 "GET /compute/v2.1/images/29dc70c1-ba79-4729-808e-b203238c7dc9" status: 200 len: 1455 microversion: 2.1 time: 10.814430 Aug 10 23:00:25.413512 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 560/1093] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 10 23:00:14 2022] GET /compute/v2.1/images/29dc70c1-ba79-4729-808e-b203238c7dc9 => generated 1455 bytes in 10824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:00:25.419426 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:00:25.419843 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-83f054dd-da91-4538-a600-d3b0e42adfef tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:25.420778 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-83f054dd-da91-4538-a600-d3b0e42adfef tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 1464324b-6977-4faa-8b84-370603a77429] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:00:25.429609 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-83f054dd-da91-4538-a600-d3b0e42adfef tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:25.430106 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-83f054dd-da91-4538-a600-d3b0e42adfef tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:25.430243 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.network.neutron [None req-7ad931b8-053f-47e8-99f0-c0289543c6de tempest-FlavorsV2NegativeTest-993776041 tempest-FlavorsV2NegativeTest-993776041-project] validate_networks() for None {{(pid=122632) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 23:00:25.430550 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-83f054dd-da91-4538-a600-d3b0e42adfef tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:25.431350 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-83f054dd-da91-4538-a600-d3b0e42adfef tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:25.431810 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-83f054dd-da91-4538-a600-d3b0e42adfef tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:25.432428 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-83f054dd-da91-4538-a600-d3b0e42adfef tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:25.599440 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-83f054dd-da91-4538-a600-d3b0e42adfef tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:00:25.608042 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-83f054dd-da91-4538-a600-d3b0e42adfef tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/1464324b-6977-4faa-8b84-370603a77429" status: 200 len: 1528 microversion: 2.1 time: 0.193170 Aug 10 23:00:25.608619 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 561/1094] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:00:25 2022] GET /compute/v2.1/servers/1464324b-6977-4faa-8b84-370603a77429 => generated 1528 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:00:25.615046 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-47ec72ad-152a-469a-a4c1-c0dc8eb275e2 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:25.615865 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-47ec72ad-152a-469a-a4c1-c0dc8eb275e2 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] [instance: 99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:00:25.622228 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-47ec72ad-152a-469a-a4c1-c0dc8eb275e2 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:25.623290 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-47ec72ad-152a-469a-a4c1-c0dc8eb275e2 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:25.623983 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-47ec72ad-152a-469a-a4c1-c0dc8eb275e2 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:25.624679 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-47ec72ad-152a-469a-a4c1-c0dc8eb275e2 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:25.625126 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-47ec72ad-152a-469a-a4c1-c0dc8eb275e2 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:25.625544 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-47ec72ad-152a-469a-a4c1-c0dc8eb275e2 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:25.711830 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-7ad931b8-053f-47e8-99f0-c0289543c6de tempest-FlavorsV2NegativeTest-993776041 tempest-FlavorsV2NegativeTest-993776041-project] HTTP exception thrown: Flavor's memory is too small for requested image. Aug 10 23:00:25.713796 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-7ad931b8-053f-47e8-99f0-c0289543c6de tempest-FlavorsV2NegativeTest-993776041 tempest-FlavorsV2NegativeTest-993776041-project] Request method failure captured: Aug 10 23:00:25.713796 n-d-850468-14 devstack@n-api.service[122632]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 10 23:00:25.713796 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:00:25.713796 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:00:25.713796 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:00:25.713796 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 142 Aug 10 23:00:25.713796 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:00:25.713796 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:00:25.713796 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:00:25.713796 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:00:25.713796 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9Dh9WPRsmUjGq6y1rZUPK_s5W7kIZhQZk0QxwENMwhXHNeVQ9mLsdFpL8H6YVvTe0L1vFbwt7LyUABMKUfA1uxzeCydcupDvf0Yq77YM8cNhTlEqxoj3TCPxRMxk1QfEUxap3MAlFlOhqkMox0slJUwFhlhH55VQy9FKFZ4D5BnRxcE Aug 10 23:00:25.713796 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:00:25.713796 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:00:25.713796 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:00:25.713796 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:00:25.713796 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:00:25.713796 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:00:25.713796 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: a2b18b815226480a80009bf6cfed8b65 Aug 10 23:00:25.713796 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-FlavorsV2NegativeTest-993776041 Aug 10 23:00:25.713796 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:00:25.713796 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:00:25.715503 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a2b18b815226480a80009bf6cfed8b65"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a2b18b815226480a80009bf6cfed8b65"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a2b18b815226480a80009bf6cfed8b65"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a2b18b815226480a80009bf6cfed8b65", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:00:25.715503 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-FlavorsV2NegativeTest-993776041 Aug 10 23:00:25.715503 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: a2b18b815226480a80009bf6cfed8b65 Aug 10 23:00:25.715503 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-993776041 Aug 10 23:00:25.715503 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-FlavorsV2NegativeTest-993776041-project Aug 10 23:00:25.715503 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:00:25.715503 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:00:25.715503 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: 39c999af68fd4038a45389285efd375a Aug 10 23:00:25.715503 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-FlavorsV2NegativeTest-993776041-project Aug 10 23:00:25.715503 n-d-850468-14 devstack@n-api.service[122632]: Aug 10 23:00:25.715503 n-d-850468-14 devstack@n-api.service[122632]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-703252647", "imageRef": "db9d4507-fb8a-4cf3-b0e6-3bb5df99aebf", "flavorRef": "452"}} Aug 10 23:00:25.715503 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:00:25.716441 n-d-850468-14 devstack@n-api.service[122632]: exception: Flavor's memory is too small for requested image. Aug 10 23:00:25.716441 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-703252647', 'imageRef': 'db9d4507-fb8a-4cf3-b0e6-3bb5df99aebf', 'flavorRef': '452'}}} Aug 10 23:00:25.716441 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:00:25.716441 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:00:25.716441 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 23:00:25.716441 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 23:00:25.716441 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 23:00:25.716441 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 23:00:25.716441 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 10 23:00:25.716441 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Aug 10 23:00:25.716441 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1007, in _checks_for_create_and_rebuild Aug 10 23:00:25.716441 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Aug 10 23:00:25.716441 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 671, in _validate_flavor_image Aug 10 23:00:25.716441 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Aug 10 23:00:25.716441 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 739, in _validate_flavor_image_nostatus Aug 10 23:00:25.716441 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Aug 10 23:00:25.716441 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Aug 10 23:00:25.716441 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:00:25.716441 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:00:25.716441 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:00:25.718040 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:00:25.718040 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:00:25.718040 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:00:25.718040 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:00:25.718040 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:00:25.718040 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:00:25.718040 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:00:25.718040 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 23:00:25.718040 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 23:00:25.718040 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 23:00:25.718040 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 23:00:25.718040 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 23:00:25.718040 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 23:00:25.718040 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 23:00:25.718040 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Aug 10 23:00:25.718040 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 10 23:00:25.718040 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Aug 10 23:00:25.718040 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:00:25.718040 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:00:25.718040 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:00:25.718040 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:00:25.719627 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:00:25.719627 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:00:25.719627 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:00:25.719627 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:00:25.719627 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Aug 10 23:00:25.719627 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:00:25.719627 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-7ad931b8-053f-47e8-99f0-c0289543c6de tempest-FlavorsV2NegativeTest-993776041 tempest-FlavorsV2NegativeTest-993776041-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:00:25.719627 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-7ad931b8-053f-47e8-99f0-c0289543c6de tempest-FlavorsV2NegativeTest-993776041 tempest-FlavorsV2NegativeTest-993776041-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 10.332895 Aug 10 23:00:25.724117 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 534/1095] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 23:00:15 2022] POST /compute/v2.1/servers => generated 93 bytes in 10340 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 10 23:00:25.731386 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-096b8f58-2f6b-49ac-bff0-9206412ad499 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Calling method '.version_select at 0x7f847d3703a0>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:25.817394 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-47ec72ad-152a-469a-a4c1-c0dc8eb275e2 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:00:25.828550 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-47ec72ad-152a-469a-a4c1-c0dc8eb275e2 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:00:25.831363 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-47ec72ad-152a-469a-a4c1-c0dc8eb275e2 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:00:25.832659 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-47ec72ad-152a-469a-a4c1-c0dc8eb275e2 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] 10.222.0.58 "GET /compute/v2.1/servers/99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0" status: 200 len: 1814 microversion: 2.25 time: 0.223123 Aug 10 23:00:25.833335 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 562/1096] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:00:25 2022] GET /compute/v2.1/servers/99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0 => generated 1814 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:00:25.838057 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-674389d1-618b-4146-92f5-60adc235ed4b tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:25.838818 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-674389d1-618b-4146-92f5-60adc235ed4b tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] [instance: 0af574c3-bfa0-4df6-8f0e-6fcd12e9b8a9] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:00:25.844944 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-674389d1-618b-4146-92f5-60adc235ed4b tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:25.846058 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-674389d1-618b-4146-92f5-60adc235ed4b tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:25.846587 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-674389d1-618b-4146-92f5-60adc235ed4b tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:25.847496 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-674389d1-618b-4146-92f5-60adc235ed4b tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:25.848068 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-674389d1-618b-4146-92f5-60adc235ed4b tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:25.848588 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-674389d1-618b-4146-92f5-60adc235ed4b tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:26.004340 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-674389d1-618b-4146-92f5-60adc235ed4b tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '417d4eaaeb1c4df78745496ececb3e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27e6ee9495a438b8450a4ef0d62cbcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:00:26.013854 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-674389d1-618b-4146-92f5-60adc235ed4b tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] 10.222.0.58 "GET /compute/v2.1/servers/0af574c3-bfa0-4df6-8f0e-6fcd12e9b8a9" status: 200 len: 1466 microversion: 2.1 time: 0.178700 Aug 10 23:00:26.014478 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 563/1097] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:00:25 2022] GET /compute/v2.1/servers/0af574c3-bfa0-4df6-8f0e-6fcd12e9b8a9 => generated 1466 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:00:26.021662 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-86f5b302-dc43-4eec-bba8-715e0c849e0b tempest-VolumesAdminNegativeTest-2021290746 tempest-VolumesAdminNegativeTest-2021290746-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "89b3ae65-b23e-45a8-9c29-eae31414fce9"}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:00:26.024844 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-86f5b302-dc43-4eec-bba8-715e0c849e0b tempest-VolumesAdminNegativeTest-2021290746 tempest-VolumesAdminNegativeTest-2021290746-project-admin] [instance: e0617f11-199e-41b8-a853-27eb2be0a8db] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:00:26.033472 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-86f5b302-dc43-4eec-bba8-715e0c849e0b tempest-VolumesAdminNegativeTest-2021290746 tempest-VolumesAdminNegativeTest-2021290746-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:26.034232 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-86f5b302-dc43-4eec-bba8-715e0c849e0b tempest-VolumesAdminNegativeTest-2021290746 tempest-VolumesAdminNegativeTest-2021290746-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:26.034904 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-86f5b302-dc43-4eec-bba8-715e0c849e0b tempest-VolumesAdminNegativeTest-2021290746 tempest-VolumesAdminNegativeTest-2021290746-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:26.036002 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-86f5b302-dc43-4eec-bba8-715e0c849e0b tempest-VolumesAdminNegativeTest-2021290746 tempest-VolumesAdminNegativeTest-2021290746-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:26.036844 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-86f5b302-dc43-4eec-bba8-715e0c849e0b tempest-VolumesAdminNegativeTest-2021290746 tempest-VolumesAdminNegativeTest-2021290746-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:26.037760 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-86f5b302-dc43-4eec-bba8-715e0c849e0b tempest-VolumesAdminNegativeTest-2021290746 tempest-VolumesAdminNegativeTest-2021290746-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:26.085534 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-096b8f58-2f6b-49ac-bff0-9206412ad499 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] 10.222.0.58 "GET /compute/v2.1/images/e2865b60-3ea2-4c52-b3d9-f3a6e58bc75a" status: 200 len: 1423 microversion: 2.1 time: 0.360297 Aug 10 23:00:26.097968 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 535/1098] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 10 23:00:25 2022] GET /compute/v2.1/images/e2865b60-3ea2-4c52-b3d9-f3a6e58bc75a => generated 1423 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:00:26.108234 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-0b9c5ae1-9913-446a-bdda-6a700e38648f req-7dc17829-eb4a-48e5-973b-f45384e4282b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1464324b-6977-4faa-8b84-370603a77429", "name": "network-vif-plugged", "status": "completed", "tag": "6a54d59d-b7dd-4033-89c5-dd089d9e9fb8"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:00:26.119128 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-0b9c5ae1-9913-446a-bdda-6a700e38648f req-7dc17829-eb4a-48e5-973b-f45384e4282b service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:26.119786 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-0b9c5ae1-9913-446a-bdda-6a700e38648f req-7dc17829-eb4a-48e5-973b-f45384e4282b service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:26.120235 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-0b9c5ae1-9913-446a-bdda-6a700e38648f req-7dc17829-eb4a-48e5-973b-f45384e4282b service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:26.122910 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-86f5b302-dc43-4eec-bba8-715e0c849e0b tempest-VolumesAdminNegativeTest-2021290746 tempest-VolumesAdminNegativeTest-2021290746-project-admin] HTTP exception thrown: Volume 20a33888-7152-40f6-9f16-6c5b3ecf434c could not be found. Aug 10 23:00:26.127312 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-86f5b302-dc43-4eec-bba8-715e0c849e0b tempest-VolumesAdminNegativeTest-2021290746 tempest-VolumesAdminNegativeTest-2021290746-project-admin] Request method failure captured: Aug 10 23:00:26.127312 n-d-850468-14 devstack@n-api.service[122633]: request: PUT /compute/v2.1/servers/e0617f11-199e-41b8-a853-27eb2be0a8db/os-volume_attachments/20a33888-7152-40f6-9f16-6c5b3ecf434c HTTP/1.1 Aug 10 23:00:26.127312 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:00:26.127312 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:00:26.127312 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:00:26.127312 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 74 Aug 10 23:00:26.127312 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:00:26.127312 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:00:26.127312 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:00:26.127312 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:00:26.127312 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9DgF8huFL2CXO9mzOyxuj_dj9s4ffpnCuvxmWne1N_15TO9vMDU2S3MlKkVeqwAVWCnB7ApjS0MOokILohO7Ekac1S8gW5auXHfP8c2H5jqTNnFE61cGtL7ScI7gtHr_lAsU5GuO_4HUjuM8OoMCpY7JENOkYQDoqijP0mkvC4_u3V8 Aug 10 23:00:26.127312 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:00:26.127312 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:00:26.127312 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:00:26.127312 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:00:26.127312 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:00:26.127312 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:00:26.127312 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: cf94b5644c334be0a0333818ba8c2376 Aug 10 23:00:26.127312 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-VolumesAdminNegativeTest-2021290746 Aug 10 23:00:26.127312 n-d-850468-14 devstack@n-api.service[122633]: X-Role: admin,member,reader Aug 10 23:00:26.127312 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: admin,member,reader Aug 10 23:00:26.128682 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/cf94b5644c334be0a0333818ba8c2376"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/cf94b5644c334be0a0333818ba8c2376"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/cf94b5644c334be0a0333818ba8c2376"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_cf94b5644c334be0a0333818ba8c2376", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:00:26.128682 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-VolumesAdminNegativeTest-2021290746 Aug 10 23:00:26.128682 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: cf94b5644c334be0a0333818ba8c2376 Aug 10 23:00:26.128682 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-2021290746 Aug 10 23:00:26.128682 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-VolumesAdminNegativeTest-2021290746-project-admin Aug 10 23:00:26.128682 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:00:26.128682 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:00:26.128682 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 1ba65cb3b35f4f36bd3321bb172e3b8b Aug 10 23:00:26.128682 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-VolumesAdminNegativeTest-2021290746-project-admin Aug 10 23:00:26.128682 n-d-850468-14 devstack@n-api.service[122633]: Aug 10 23:00:26.128682 n-d-850468-14 devstack@n-api.service[122633]: {"volumeAttachment": {"volumeId": "89b3ae65-b23e-45a8-9c29-eae31414fce9"}} Aug 10 23:00:26.128682 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:00:26.128682 n-d-850468-14 devstack@n-api.service[122633]: exception: Volume 20a33888-7152-40f6-9f16-6c5b3ecf434c could not be found. Aug 10 23:00:26.129612 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'server_id': 'e0617f11-199e-41b8-a853-27eb2be0a8db', 'id': '20a33888-7152-40f6-9f16-6c5b3ecf434c', 'body': {'volumeAttachment': {'volumeId': '89b3ae65-b23e-45a8-9c29-eae31414fce9'}}} Aug 10 23:00:26.129612 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:00:26.129612 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:00:26.129612 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 23:00:26.129612 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 23:00:26.129612 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 10 23:00:26.129612 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 10 23:00:26.129612 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 10 23:00:26.129612 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 10 23:00:26.129612 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 10 23:00:26.129612 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 10 23:00:26.129612 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 10 23:00:26.129612 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 10 23:00:26.129612 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 23:00:26.129612 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 23:00:26.129612 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 23:00:26.129612 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 23:00:26.131224 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 20a33888-7152-40f6-9f16-6c5b3ecf434c could not be found. (HTTP 404) (Request-ID: req-904d6ab7-42bb-4999-9eb5-099843b48a4f) Aug 10 23:00:26.131224 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:00:26.131224 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:00:26.131224 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:00:26.131224 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:00:26.131224 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Aug 10 23:00:26.131224 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Aug 10 23:00:26.131224 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 10 23:00:26.131224 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 10 23:00:26.131224 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 10 23:00:26.131224 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 10 23:00:26.131224 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 10 23:00:26.131224 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 10 23:00:26.131224 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 23:00:26.131224 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 23:00:26.131224 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 10 23:00:26.131224 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 10 23:00:26.131224 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 10 23:00:26.131224 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 10 23:00:26.132365 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 10 23:00:26.132365 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 10 23:00:26.132365 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 10 23:00:26.132365 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 10 23:00:26.132365 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 23:00:26.132365 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 23:00:26.132365 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 23:00:26.132365 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 23:00:26.132365 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 20a33888-7152-40f6-9f16-6c5b3ecf434c could not be found. Aug 10 23:00:26.132365 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:00:26.132365 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:00:26.132365 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:00:26.132365 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:00:26.132365 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:00:26.132365 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:00:26.132365 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:00:26.132365 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:00:26.132365 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:00:26.132365 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:00:26.133471 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 23:00:26.133471 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 23:00:26.133471 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 23:00:26.133471 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 23:00:26.133471 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Aug 10 23:00:26.133471 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Aug 10 23:00:26.133471 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Aug 10 23:00:26.133471 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:00:26.133471 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 20a33888-7152-40f6-9f16-6c5b3ecf434c could not be found. Aug 10 23:00:26.133471 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:00:26.133471 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:00:26.133471 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:00:26.133471 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:00:26.133471 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:00:26.133471 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:00:26.133471 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:00:26.133471 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:00:26.133471 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 20a33888-7152-40f6-9f16-6c5b3ecf434c could not be found. Aug 10 23:00:26.133471 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:00:26.136023 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-86f5b302-dc43-4eec-bba8-715e0c849e0b tempest-VolumesAdminNegativeTest-2021290746 tempest-VolumesAdminNegativeTest-2021290746-project-admin] Returning 404 to user: Volume 20a33888-7152-40f6-9f16-6c5b3ecf434c could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:00:26.136023 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-86f5b302-dc43-4eec-bba8-715e0c849e0b tempest-VolumesAdminNegativeTest-2021290746 tempest-VolumesAdminNegativeTest-2021290746-project-admin] 10.222.0.58 "PUT /compute/v2.1/servers/e0617f11-199e-41b8-a853-27eb2be0a8db/os-volume_attachments/20a33888-7152-40f6-9f16-6c5b3ecf434c" status: 404 len: 109 microversion: 2.1 time: 0.113125 Aug 10 23:00:26.136023 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 564/1099] 10.222.0.58 () {60 vars in 1433 bytes} [Wed Aug 10 23:00:26 2022] PUT /compute/v2.1/servers/e0617f11-199e-41b8-a853-27eb2be0a8db/os-volume_attachments/20a33888-7152-40f6-9f16-6c5b3ecf434c => generated 109 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:00:26.136522 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-0b9c5ae1-9913-446a-bdda-6a700e38648f req-7dc17829-eb4a-48e5-973b-f45384e4282b service nova] Creating event network-vif-plugged:6a54d59d-b7dd-4033-89c5-dd089d9e9fb8 for instance 1464324b-6977-4faa-8b84-370603a77429 on n-h1-850468-14 Aug 10 23:00:26.136609 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-ada25406-1624-4c94-93d3-6a5edcfe196c req-ec3f8f99-2875-49a8-b22d-c1cd60cd0795 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0", "name": "network-vif-unplugged", "status": "completed", "tag": "8098dfba-8285-4ba1-8119-160040ca6e4b"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:00:26.140642 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-0b9c5ae1-9913-446a-bdda-6a700e38648f req-7dc17829-eb4a-48e5-973b-f45384e4282b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035925 Aug 10 23:00:26.141315 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 536/1100] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:00:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:00:26.149539 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-cad57b04-6e94-4e3a-93fb-904606fc1d74 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:26.150238 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-cad57b04-6e94-4e3a-93fb-904606fc1d74 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 1464324b-6977-4faa-8b84-370603a77429] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:00:26.156742 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cad57b04-6e94-4e3a-93fb-904606fc1d74 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:26.157483 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cad57b04-6e94-4e3a-93fb-904606fc1d74 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:26.158859 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cad57b04-6e94-4e3a-93fb-904606fc1d74 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:26.159725 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cad57b04-6e94-4e3a-93fb-904606fc1d74 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:26.160337 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cad57b04-6e94-4e3a-93fb-904606fc1d74 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:26.160913 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cad57b04-6e94-4e3a-93fb-904606fc1d74 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:26.164981 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-ada25406-1624-4c94-93d3-6a5edcfe196c req-ec3f8f99-2875-49a8-b22d-c1cd60cd0795 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:26.165466 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-ada25406-1624-4c94-93d3-6a5edcfe196c req-ec3f8f99-2875-49a8-b22d-c1cd60cd0795 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:26.165888 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-ada25406-1624-4c94-93d3-6a5edcfe196c req-ec3f8f99-2875-49a8-b22d-c1cd60cd0795 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:26.202202 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-ada25406-1624-4c94-93d3-6a5edcfe196c req-ec3f8f99-2875-49a8-b22d-c1cd60cd0795 service nova] Creating event network-vif-unplugged:8098dfba-8285-4ba1-8119-160040ca6e4b for instance 99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0 on n-h2-850468-14 Aug 10 23:00:26.209368 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-ada25406-1624-4c94-93d3-6a5edcfe196c req-ec3f8f99-2875-49a8-b22d-c1cd60cd0795 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.078159 Aug 10 23:00:26.210883 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 565/1101] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:00:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:00:26.391288 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-cad57b04-6e94-4e3a-93fb-904606fc1d74 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:00:26.411536 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-0b862a99-31e7-4324-bfa6-993b13aeaea0 tempest-ServersOnMultiNodesTest-79489 tempest-ServersOnMultiNodesTest-79489-project-admin] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:26.413288 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-0b862a99-31e7-4324-bfa6-993b13aeaea0 tempest-ServersOnMultiNodesTest-79489 tempest-ServersOnMultiNodesTest-79489-project-admin] [instance: 0af574c3-bfa0-4df6-8f0e-6fcd12e9b8a9] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:00:26.415993 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-cad57b04-6e94-4e3a-93fb-904606fc1d74 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/1464324b-6977-4faa-8b84-370603a77429" status: 200 len: 1528 microversion: 2.1 time: 0.270901 Aug 10 23:00:26.418397 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 537/1102] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:00:26 2022] GET /compute/v2.1/servers/1464324b-6977-4faa-8b84-370603a77429 => generated 1528 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:00:26.425855 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0b862a99-31e7-4324-bfa6-993b13aeaea0 tempest-ServersOnMultiNodesTest-79489 tempest-ServersOnMultiNodesTest-79489-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:26.427793 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0b862a99-31e7-4324-bfa6-993b13aeaea0 tempest-ServersOnMultiNodesTest-79489 tempest-ServersOnMultiNodesTest-79489-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:26.428404 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-d60451a7-b158-4fc6-8775-a7800d99116c tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Calling method '.version_select at 0x7f847d732040>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:26.429149 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0b862a99-31e7-4324-bfa6-993b13aeaea0 tempest-ServersOnMultiNodesTest-79489 tempest-ServersOnMultiNodesTest-79489-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:26.430654 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0b862a99-31e7-4324-bfa6-993b13aeaea0 tempest-ServersOnMultiNodesTest-79489 tempest-ServersOnMultiNodesTest-79489-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:26.431352 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0b862a99-31e7-4324-bfa6-993b13aeaea0 tempest-ServersOnMultiNodesTest-79489 tempest-ServersOnMultiNodesTest-79489-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:26.431998 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0b862a99-31e7-4324-bfa6-993b13aeaea0 tempest-ServersOnMultiNodesTest-79489 tempest-ServersOnMultiNodesTest-79489-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:26.490490 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-d60451a7-b158-4fc6-8775-a7800d99116c tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] 10.222.0.58 "GET /compute/v2.1/images/e2865b60-3ea2-4c52-b3d9-f3a6e58bc75a" status: 200 len: 1423 microversion: 2.1 time: 0.070716 Aug 10 23:00:26.494832 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 538/1103] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 10 23:00:26 2022] GET /compute/v2.1/images/e2865b60-3ea2-4c52-b3d9-f3a6e58bc75a => generated 1423 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:00:26.517655 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-41b8c1d0-1a26-4e9a-92b4-0ce77344ffc7 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Calling method '.version_select at 0x7f847d367160>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:26.590375 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-41b8c1d0-1a26-4e9a-92b4-0ce77344ffc7 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] 10.222.0.58 "GET /compute/v2.1/images/29dc70c1-ba79-4729-808e-b203238c7dc9" status: 200 len: 1455 microversion: 2.1 time: 0.097950 Aug 10 23:00:26.591367 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 539/1104] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 10 23:00:26 2022] GET /compute/v2.1/images/29dc70c1-ba79-4729-808e-b203238c7dc9 => generated 1455 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:00:26.596734 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-8fda3527-6a8a-4896-acc3-ae146af2e2bc tempest-MigrationsAdminTest-974767625 tempest-MigrationsAdminTest-974767625-project-admin] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:26.598278 n-d-850468-14 devstack@n-api.service[122632]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 23:00:26.598278 n-d-850468-14 devstack@n-api.service[122632]: warnings.warn(msg) Aug 10 23:00:26.605551 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-8fda3527-6a8a-4896-acc3-ae146af2e2bc tempest-MigrationsAdminTest-974767625 tempest-MigrationsAdminTest-974767625-project-admin] HTTP exception thrown: Flavor 8f981c7e-cc2e-453c-8da0-478648af3419 could not be found. Aug 10 23:00:26.631697 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-8fda3527-6a8a-4896-acc3-ae146af2e2bc tempest-MigrationsAdminTest-974767625 tempest-MigrationsAdminTest-974767625-project-admin] Request method failure captured: Aug 10 23:00:26.631697 n-d-850468-14 devstack@n-api.service[122632]: request: DELETE /compute/v2.1/flavors/8f981c7e-cc2e-453c-8da0-478648af3419 HTTP/1.1 Aug 10 23:00:26.631697 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:00:26.631697 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:00:26.631697 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:00:26.631697 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 23:00:26.631697 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:00:26.631697 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:00:26.631697 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:00:26.631697 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:00:26.631697 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9DeSxvCJiV9CZ7nN84c0HkwPWmxHhVbx2nvm10BSDoh8kk-6uYPVn3dD8c3TJRU2BWmQhmfcS2s1fqklxkbt3wDf-nFXiYqo54n43SnKpF7isJ1JtcilGfhEXuaV0Y0MOwQPjVYl7I2W1fp5FvbVPcMl7OUYtm607zUcrmuNerVJCro Aug 10 23:00:26.631697 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:00:26.631697 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:00:26.631697 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:00:26.631697 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:00:26.631697 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:00:26.631697 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:00:26.631697 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: cb50f4a3b69e4d2da01cf4057a57e675 Aug 10 23:00:26.631697 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-MigrationsAdminTest-974767625 Aug 10 23:00:26.631697 n-d-850468-14 devstack@n-api.service[122632]: X-Role: admin,member,reader Aug 10 23:00:26.631697 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: admin,member,reader Aug 10 23:00:26.633475 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/cb50f4a3b69e4d2da01cf4057a57e675"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/cb50f4a3b69e4d2da01cf4057a57e675"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/cb50f4a3b69e4d2da01cf4057a57e675"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_cb50f4a3b69e4d2da01cf4057a57e675", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:00:26.633475 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-MigrationsAdminTest-974767625 Aug 10 23:00:26.633475 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: cb50f4a3b69e4d2da01cf4057a57e675 Aug 10 23:00:26.633475 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-MigrationsAdminTest-974767625 Aug 10 23:00:26.633475 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-MigrationsAdminTest-974767625-project-admin Aug 10 23:00:26.633475 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:00:26.633475 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:00:26.633475 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: 8226b7db08ce49328cb235804da6740d Aug 10 23:00:26.633475 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-MigrationsAdminTest-974767625-project-admin Aug 10 23:00:26.633475 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:00:26.633475 n-d-850468-14 devstack@n-api.service[122632]: exception: Flavor 8f981c7e-cc2e-453c-8da0-478648af3419 could not be found. Aug 10 23:00:26.633475 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': '8f981c7e-cc2e-453c-8da0-478648af3419'} Aug 10 23:00:26.634728 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:00:26.634728 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:00:26.634728 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Aug 10 23:00:26.634728 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi flavor.destroy() Aug 10 23:00:26.634728 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 10 23:00:26.634728 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 10 23:00:26.634728 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Aug 10 23:00:26.634728 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Aug 10 23:00:26.634728 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Aug 10 23:00:26.634728 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Aug 10 23:00:26.634728 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 10 23:00:26.634728 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 10 23:00:26.634728 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Aug 10 23:00:26.634728 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Aug 10 23:00:26.634728 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 8f981c7e-cc2e-453c-8da0-478648af3419 could not be found. Aug 10 23:00:26.634728 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:00:26.634728 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:00:26.634728 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:00:26.634728 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:00:26.634728 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:00:26.636049 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:00:26.636049 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:00:26.636049 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:00:26.636049 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:00:26.636049 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:00:26.636049 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Aug 10 23:00:26.636049 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:00:26.636049 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 8f981c7e-cc2e-453c-8da0-478648af3419 could not be found. Aug 10 23:00:26.636049 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:00:26.636049 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:00:26.636049 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:00:26.636049 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:00:26.636049 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:00:26.636049 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:00:26.636049 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:00:26.636049 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:00:26.636049 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 8f981c7e-cc2e-453c-8da0-478648af3419 could not be found. Aug 10 23:00:26.636049 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:00:26.638955 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-8fda3527-6a8a-4896-acc3-ae146af2e2bc tempest-MigrationsAdminTest-974767625 tempest-MigrationsAdminTest-974767625-project-admin] Returning 404 to user: Flavor 8f981c7e-cc2e-453c-8da0-478648af3419 could not be found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:00:26.638955 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-8fda3527-6a8a-4896-acc3-ae146af2e2bc tempest-MigrationsAdminTest-974767625 tempest-MigrationsAdminTest-974767625-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/8f981c7e-cc2e-453c-8da0-478648af3419" status: 404 len: 109 microversion: 2.1 time: 0.040361 Aug 10 23:00:26.638955 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 540/1105] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:00:26 2022] DELETE /compute/v2.1/flavors/8f981c7e-cc2e-453c-8da0-478648af3419 => generated 109 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:00:26.640366 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-bd3b0316-ca5b-439a-9a57-00085123c82d tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Calling method '.version_select at 0x7f847d387ca0>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:26.918433 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-0b862a99-31e7-4324-bfa6-993b13aeaea0 tempest-ServersOnMultiNodesTest-79489 tempest-ServersOnMultiNodesTest-79489-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/0af574c3-bfa0-4df6-8f0e-6fcd12e9b8a9" status: 200 len: 1619 microversion: 2.1 time: 0.705674 Aug 10 23:00:26.924970 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 566/1106] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:00:26 2022] GET /compute/v2.1/servers/0af574c3-bfa0-4df6-8f0e-6fcd12e9b8a9 => generated 1619 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:00:26.937592 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-5f4ec9ba-e429-475f-b6da-d1b29a197915 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-429375240", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452"}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:00:27.056073 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.network.neutron [None req-5f4ec9ba-e429-475f-b6da-d1b29a197915 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] validate_networks() for None {{(pid=122633) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 23:00:27.510355 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-5f4ec9ba-e429-475f-b6da-d1b29a197915 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Flavor limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:00:27.527827 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-5f4ec9ba-e429-475f-b6da-d1b29a197915 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Image limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:00:27.528509 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-5f4ec9ba-e429-475f-b6da-d1b29a197915 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Flavor pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:00:27.528928 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-5f4ec9ba-e429-475f-b6da-d1b29a197915 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Image pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:00:27.529426 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-5f4ec9ba-e429-475f-b6da-d1b29a197915 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:00:27.548376 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5f4ec9ba-e429-475f-b6da-d1b29a197915 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:27.549427 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5f4ec9ba-e429-475f-b6da-d1b29a197915 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:27.551596 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5f4ec9ba-e429-475f-b6da-d1b29a197915 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:27.553607 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5f4ec9ba-e429-475f-b6da-d1b29a197915 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:27.557904 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5f4ec9ba-e429-475f-b6da-d1b29a197915 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:27.561551 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5f4ec9ba-e429-475f-b6da-d1b29a197915 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:27.596995 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-5f4ec9ba-e429-475f-b6da-d1b29a197915 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Getting quotas for project f9582683a1cf4e92b3bd3f10db0b497b. Resources: {'instances', 'cores', 'ram'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:00:27.606533 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-5f4ec9ba-e429-475f-b6da-d1b29a197915 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Getting quotas for user 5c48fd7279544b1fae228500f5a1e46d and project f9582683a1cf4e92b3bd3f10db0b497b. Resources: {'instances', 'cores', 'ram'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:00:27.621658 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-5f4ec9ba-e429-475f-b6da-d1b29a197915 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Going to run 1 instances... {{(pid=122633) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 23:00:27.626681 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-5f4ec9ba-e429-475f-b6da-d1b29a197915 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 0dabc2bf-08ff-45b5-a791-34d655349eae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78ad8905-f66f-4733-8be9-2b260f1fabed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122633) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 23:00:27.670688 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-bd3b0316-ca5b-439a-9a57-00085123c82d tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] 10.222.0.58 "DELETE /compute/v2.1/images/e2865b60-3ea2-4c52-b3d9-f3a6e58bc75a" status: 204 len: 0 microversion: 2.1 time: 1.035559 Aug 10 23:00:27.675427 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 541/1107] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:00:26 2022] DELETE /compute/v2.1/images/e2865b60-3ea2-4c52-b3d9-f3a6e58bc75a => generated 0 bytes in 1037 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:00:27.684698 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-8df9a0f1-82b6-4e6e-a1b4-9cc194afbca0 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:27.687104 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-8df9a0f1-82b6-4e6e-a1b4-9cc194afbca0 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] [instance: 99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:00:27.700231 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8df9a0f1-82b6-4e6e-a1b4-9cc194afbca0 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:27.700846 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8df9a0f1-82b6-4e6e-a1b4-9cc194afbca0 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:27.707274 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8df9a0f1-82b6-4e6e-a1b4-9cc194afbca0 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:27.710070 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8df9a0f1-82b6-4e6e-a1b4-9cc194afbca0 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:27.725143 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8df9a0f1-82b6-4e6e-a1b4-9cc194afbca0 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:27.725862 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8df9a0f1-82b6-4e6e-a1b4-9cc194afbca0 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:27.726956 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-5f4ec9ba-e429-475f-b6da-d1b29a197915 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.798062 Aug 10 23:00:27.728268 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 567/1108] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 23:00:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 802 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 23:00:27.734696 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-1255f1c4-d9cb-4fdf-ac08-72171b87f98b tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Action: 'create', calling method: .version_select at 0x7f847d42aaf0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1161016766", "policies": ["affinity"]}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:00:27.760742 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-1255f1c4-d9cb-4fdf-ac08-72171b87f98b tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Getting quotas for project b27e6ee9495a438b8450a4ef0d62cbcd. Resources: {'server_groups'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:00:27.768292 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-1255f1c4-d9cb-4fdf-ac08-72171b87f98b tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Getting quotas for user 417d4eaaeb1c4df78745496ececb3e88 and project b27e6ee9495a438b8450a4ef0d62cbcd. Resources: {'server_groups'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:00:27.904908 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-1255f1c4-d9cb-4fdf-ac08-72171b87f98b tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Getting quotas for project b27e6ee9495a438b8450a4ef0d62cbcd. Resources: {'server_groups'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:00:27.913898 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-1255f1c4-d9cb-4fdf-ac08-72171b87f98b tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Getting quotas for user 417d4eaaeb1c4df78745496ececb3e88 and project b27e6ee9495a438b8450a4ef0d62cbcd. Resources: {'server_groups'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:00:27.947635 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-1255f1c4-d9cb-4fdf-ac08-72171b87f98b tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] 10.222.0.58 "POST /compute/v2.1/os-server-groups" status: 200 len: 188 microversion: 2.1 time: 0.217882 Aug 10 23:00:27.948264 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 568/1109] 10.222.0.58 () {60 vars in 1174 bytes} [Wed Aug 10 23:00:27 2022] POST /compute/v2.1/os-server-groups => generated 188 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:00:27.964036 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-f39a9286-1cab-4703-8331-6e524259b10a tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Calling method '.version_select at 0x7f847d3c0ee0>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:28.002434 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-8df9a0f1-82b6-4e6e-a1b4-9cc194afbca0 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:00:28.030154 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-8df9a0f1-82b6-4e6e-a1b4-9cc194afbca0 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:00:28.034161 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-8df9a0f1-82b6-4e6e-a1b4-9cc194afbca0 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:00:28.035913 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-8df9a0f1-82b6-4e6e-a1b4-9cc194afbca0 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] 10.222.0.58 "GET /compute/v2.1/servers/99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0" status: 200 len: 1814 microversion: 2.25 time: 0.362781 Aug 10 23:00:28.046811 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 542/1110] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:00:27 2022] GET /compute/v2.1/servers/99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0 => generated 1814 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:00:28.046811 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-e216b195-1eae-4474-9125-1bedfab1b9d5 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:28.046811 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-e216b195-1eae-4474-9125-1bedfab1b9d5 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] [instance: f3722f40-7320-484b-8c20-78b2de3e89f1] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:00:28.055095 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-f39a9286-1cab-4703-8331-6e524259b10a tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] 10.222.0.58 "GET /compute/v2.1/images/29dc70c1-ba79-4729-808e-b203238c7dc9" status: 200 len: 1464 microversion: 2.1 time: 0.102032 Aug 10 23:00:28.056116 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 569/1111] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 10 23:00:27 2022] GET /compute/v2.1/images/29dc70c1-ba79-4729-808e-b203238c7dc9 => generated 1464 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:00:28.067689 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e216b195-1eae-4474-9125-1bedfab1b9d5 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:28.069143 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-1dde7e65-f2e9-45b9-a5d9-a3cd64d83571 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:28.069286 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e216b195-1eae-4474-9125-1bedfab1b9d5 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:28.069780 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-1dde7e65-f2e9-45b9-a5d9-a3cd64d83571 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 0dabc2bf-08ff-45b5-a791-34d655349eae] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:00:28.069922 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e216b195-1eae-4474-9125-1bedfab1b9d5 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:28.072934 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e216b195-1eae-4474-9125-1bedfab1b9d5 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:28.073429 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e216b195-1eae-4474-9125-1bedfab1b9d5 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:28.075713 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e216b195-1eae-4474-9125-1bedfab1b9d5 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:28.142549 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-e216b195-1eae-4474-9125-1bedfab1b9d5 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] [instance: f3722f40-7320-484b-8c20-78b2de3e89f1] Going to try to terminate instance {{(pid=122632) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:00:28.194176 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-1dde7e65-f2e9-45b9-a5d9-a3cd64d83571 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:00:28.216502 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-1dde7e65-f2e9-45b9-a5d9-a3cd64d83571 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/0dabc2bf-08ff-45b5-a791-34d655349eae" status: 200 len: 1212 microversion: 2.1 time: 0.153370 Aug 10 23:00:28.227219 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 570/1112] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:00:28 2022] GET /compute/v2.1/servers/0dabc2bf-08ff-45b5-a791-34d655349eae => generated 1212 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:00:28.227219 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-a83c6d97-0ee5-4be4-98cf-893a7f1f1cf7 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Calling method '.version_select at 0x7f847d30edc0>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:28.319287 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-e216b195-1eae-4474-9125-1bedfab1b9d5 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] 10.222.0.58 "DELETE /compute/v2.1/servers/f3722f40-7320-484b-8c20-78b2de3e89f1" status: 204 len: 0 microversion: 2.1 time: 0.280070 Aug 10 23:00:28.320430 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 543/1113] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:00:28 2022] DELETE /compute/v2.1/servers/f3722f40-7320-484b-8c20-78b2de3e89f1 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:00:28.326568 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-2eec82ed-08c1-4911-a54e-bac92cfbd484 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1002463696", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "da03a39d-f6f0-4dab-8d44-bd22debb8b03"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:00:28.344829 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-a83c6d97-0ee5-4be4-98cf-893a7f1f1cf7 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] 10.222.0.58 "GET /compute/v2.1/images/29dc70c1-ba79-4729-808e-b203238c7dc9" status: 200 len: 1464 microversion: 2.1 time: 0.121318 Aug 10 23:00:28.350239 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 571/1114] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 10 23:00:28 2022] GET /compute/v2.1/images/29dc70c1-ba79-4729-808e-b203238c7dc9 => generated 1464 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:00:28.377431 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-c4aa41da-da97-4de0-b7de-71007408f33b req-05f105b1-ff03-49cc-a0f2-9cc6b0545f85 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0", "tag": "8098dfba-8285-4ba1-8119-160040ca6e4b"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:00:28.404139 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-c4aa41da-da97-4de0-b7de-71007408f33b req-05f105b1-ff03-49cc-a0f2-9cc6b0545f85 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:28.405066 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-c4aa41da-da97-4de0-b7de-71007408f33b req-05f105b1-ff03-49cc-a0f2-9cc6b0545f85 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:28.405760 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-c4aa41da-da97-4de0-b7de-71007408f33b req-05f105b1-ff03-49cc-a0f2-9cc6b0545f85 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:28.442697 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-c4aa41da-da97-4de0-b7de-71007408f33b req-05f105b1-ff03-49cc-a0f2-9cc6b0545f85 service nova] Creating event network-changed:8098dfba-8285-4ba1-8119-160040ca6e4b for instance 99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0 on n-h2-850468-14 Aug 10 23:00:28.451881 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-c4aa41da-da97-4de0-b7de-71007408f33b req-05f105b1-ff03-49cc-a0f2-9cc6b0545f85 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099585 Aug 10 23:00:28.452681 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 572/1115] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:00:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:00:28.460052 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.network.neutron [None req-2eec82ed-08c1-4911-a54e-bac92cfbd484 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] validate_networks() for None {{(pid=122632) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 23:00:28.460510 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-4cb0049f-c1d1-4c56-b813-508880471628 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:28.461403 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-4cb0049f-c1d1-4c56-b813-508880471628 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] [instance: e1deb45a-4597-4456-a1bd-54013c9484a4] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:00:28.469476 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4cb0049f-c1d1-4c56-b813-508880471628 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:28.470874 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4cb0049f-c1d1-4c56-b813-508880471628 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:28.471529 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4cb0049f-c1d1-4c56-b813-508880471628 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:28.487409 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4cb0049f-c1d1-4c56-b813-508880471628 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:28.488300 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4cb0049f-c1d1-4c56-b813-508880471628 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:28.489193 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4cb0049f-c1d1-4c56-b813-508880471628 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:28.730337 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-4cb0049f-c1d1-4c56-b813-508880471628 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e86e6a62c56248d6a7887be0ec712f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25090b10522b4936b3117dc25dd6f609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:00:28.744864 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-4cb0049f-c1d1-4c56-b813-508880471628 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] 10.222.0.58 "GET /compute/v2.1/servers/e1deb45a-4597-4456-a1bd-54013c9484a4" status: 200 len: 1467 microversion: 2.1 time: 0.287104 Aug 10 23:00:28.758873 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 573/1116] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:00:28 2022] GET /compute/v2.1/servers/e1deb45a-4597-4456-a1bd-54013c9484a4 => generated 1467 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:00:28.765177 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c1d9bdfb-1daf-4e86-a998-897114aff21d tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1657146604", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452", "networks": [{"uuid": "b7470d0a-cf37-4051-8236-4c65a5fc36b5"}]}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:00:28.803501 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-2eec82ed-08c1-4911-a54e-bac92cfbd484 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Flavor limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:00:28.804061 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-2eec82ed-08c1-4911-a54e-bac92cfbd484 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Image limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:00:28.804421 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-2eec82ed-08c1-4911-a54e-bac92cfbd484 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Flavor pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:00:28.804794 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-2eec82ed-08c1-4911-a54e-bac92cfbd484 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Image pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:00:28.805209 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-2eec82ed-08c1-4911-a54e-bac92cfbd484 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:00:28.837257 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2eec82ed-08c1-4911-a54e-bac92cfbd484 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:28.838145 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2eec82ed-08c1-4911-a54e-bac92cfbd484 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:28.838774 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2eec82ed-08c1-4911-a54e-bac92cfbd484 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:28.839948 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2eec82ed-08c1-4911-a54e-bac92cfbd484 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:28.840566 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2eec82ed-08c1-4911-a54e-bac92cfbd484 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:28.841150 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2eec82ed-08c1-4911-a54e-bac92cfbd484 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:28.844275 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.network.neutron [None req-c1d9bdfb-1daf-4e86-a998-897114aff21d tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] validate_networks() for [('b7470d0a-cf37-4051-8236-4c65a5fc36b5', None, None, None, None, None)] {{(pid=122633) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 23:00:28.875505 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-2eec82ed-08c1-4911-a54e-bac92cfbd484 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Getting quotas for project b27e6ee9495a438b8450a4ef0d62cbcd. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:00:28.888273 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-2eec82ed-08c1-4911-a54e-bac92cfbd484 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Getting quotas for user 417d4eaaeb1c4df78745496ececb3e88 and project b27e6ee9495a438b8450a4ef0d62cbcd. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:00:28.917307 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-2eec82ed-08c1-4911-a54e-bac92cfbd484 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Going to run 2 instances... {{(pid=122632) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 23:00:28.919823 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-2eec82ed-08c1-4911-a54e-bac92cfbd484 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] [instance: bea7ce47-7ad2-4283-9b48-f4f61f71965a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78ad8905-f66f-4733-8be9-2b260f1fabed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122632) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 23:00:28.983188 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-2eec82ed-08c1-4911-a54e-bac92cfbd484 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=122632) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Aug 10 23:00:29.012535 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-2eec82ed-08c1-4911-a54e-bac92cfbd484 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Getting quotas for project b27e6ee9495a438b8450a4ef0d62cbcd. Resources: {'server_group_members'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:00:29.018999 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-2eec82ed-08c1-4911-a54e-bac92cfbd484 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Getting quotas for user 417d4eaaeb1c4df78745496ececb3e88 and project b27e6ee9495a438b8450a4ef0d62cbcd. Resources: {'server_group_members'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:00:29.076413 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-2eec82ed-08c1-4911-a54e-bac92cfbd484 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Getting quotas for project b27e6ee9495a438b8450a4ef0d62cbcd. Resources: {'server_group_members'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:00:29.082094 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-2eec82ed-08c1-4911-a54e-bac92cfbd484 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Getting quotas for user 417d4eaaeb1c4df78745496ececb3e88 and project b27e6ee9495a438b8450a4ef0d62cbcd. Resources: {'server_group_members'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:00:29.104799 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-2eec82ed-08c1-4911-a54e-bac92cfbd484 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] [instance: a0995db2-2ae0-4216-996a-39a03357c1eb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78ad8905-f66f-4733-8be9-2b260f1fabed',instance=,instance_uuid=bea7ce47-7ad2-4283-9b48-f4f61f71965a,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122632) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 23:00:29.182260 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-2eec82ed-08c1-4911-a54e-bac92cfbd484 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Getting quotas for project b27e6ee9495a438b8450a4ef0d62cbcd. Resources: {'server_group_members'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:00:29.190660 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-2eec82ed-08c1-4911-a54e-bac92cfbd484 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Getting quotas for user 417d4eaaeb1c4df78745496ececb3e88 and project b27e6ee9495a438b8450a4ef0d62cbcd. Resources: {'server_group_members'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:00:29.272556 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-2eec82ed-08c1-4911-a54e-bac92cfbd484 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Getting quotas for project b27e6ee9495a438b8450a4ef0d62cbcd. Resources: {'server_group_members'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:00:29.292353 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-2eec82ed-08c1-4911-a54e-bac92cfbd484 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Getting quotas for user 417d4eaaeb1c4df78745496ececb3e88 and project b27e6ee9495a438b8450a4ef0d62cbcd. Resources: {'server_group_members'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:00:29.363901 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-2eec82ed-08c1-4911-a54e-bac92cfbd484 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.040379 Aug 10 23:00:29.365548 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 544/1117] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 23:00:28 2022] POST /compute/v2.1/servers => generated 32 bytes in 1044 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Aug 10 23:00:29.379143 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-904e94d8-9557-40dc-8f9d-c272b77b16d0 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-34841111"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:00:29.383956 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-904e94d8-9557-40dc-8f9d-c272b77b16d0 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] [instance: d716cac6-ac7c-4b98-b6ea-2496ccd62096] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:00:29.400815 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-904e94d8-9557-40dc-8f9d-c272b77b16d0 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:29.402982 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-904e94d8-9557-40dc-8f9d-c272b77b16d0 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:29.403413 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-904e94d8-9557-40dc-8f9d-c272b77b16d0 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:29.406459 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-904e94d8-9557-40dc-8f9d-c272b77b16d0 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:29.407820 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-904e94d8-9557-40dc-8f9d-c272b77b16d0 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:29.408972 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-904e94d8-9557-40dc-8f9d-c272b77b16d0 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:29.583387 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-c1d9bdfb-1daf-4e86-a998-897114aff21d tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Flavor limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:00:29.583927 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-c1d9bdfb-1daf-4e86-a998-897114aff21d tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Image limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:00:29.584691 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-c1d9bdfb-1daf-4e86-a998-897114aff21d tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Flavor pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:00:29.585170 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-c1d9bdfb-1daf-4e86-a998-897114aff21d tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Image pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:00:29.585810 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-c1d9bdfb-1daf-4e86-a998-897114aff21d tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:00:29.597798 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c1d9bdfb-1daf-4e86-a998-897114aff21d tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:29.598623 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c1d9bdfb-1daf-4e86-a998-897114aff21d tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:29.599353 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c1d9bdfb-1daf-4e86-a998-897114aff21d tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:29.600860 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c1d9bdfb-1daf-4e86-a998-897114aff21d tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:29.601539 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c1d9bdfb-1daf-4e86-a998-897114aff21d tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:29.602116 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c1d9bdfb-1daf-4e86-a998-897114aff21d tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:29.625783 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-c1d9bdfb-1daf-4e86-a998-897114aff21d tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Getting quotas for project 307ab95daa034afbb31f90626885072b. Resources: {'instances', 'cores', 'ram'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:00:29.633333 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-c1d9bdfb-1daf-4e86-a998-897114aff21d tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Getting quotas for user 7d6d9806b6724e5aaf8c69be8e70d4f3 and project 307ab95daa034afbb31f90626885072b. Resources: {'instances', 'cores', 'ram'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:00:29.653419 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-c1d9bdfb-1daf-4e86-a998-897114aff21d tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Going to run 1 instances... {{(pid=122633) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 23:00:29.660504 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-c1d9bdfb-1daf-4e86-a998-897114aff21d tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] [instance: 2a68f86c-37de-4207-aa43-6a1350342a56] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78ad8905-f66f-4733-8be9-2b260f1fabed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122633) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 23:00:29.741095 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-c1d9bdfb-1daf-4e86-a998-897114aff21d tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.992591 Aug 10 23:00:29.744048 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 574/1118] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 23:00:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 996 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 23:00:29.752497 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-55249511-cd7e-4118-af35-f3d200002caf tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:29.753327 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-55249511-cd7e-4118-af35-f3d200002caf tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] [instance: 99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:00:29.761311 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-55249511-cd7e-4118-af35-f3d200002caf tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:29.762139 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-55249511-cd7e-4118-af35-f3d200002caf tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:29.762874 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-55249511-cd7e-4118-af35-f3d200002caf tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:29.763863 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-55249511-cd7e-4118-af35-f3d200002caf tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:29.764634 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-55249511-cd7e-4118-af35-f3d200002caf tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:29.765267 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-55249511-cd7e-4118-af35-f3d200002caf tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:29.870967 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-904e94d8-9557-40dc-8f9d-c272b77b16d0 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] 10.222.0.58 "POST /compute/v2.1/servers/d716cac6-ac7c-4b98-b6ea-2496ccd62096/action" status: 202 len: 0 microversion: 2.1 time: 0.504061 Aug 10 23:00:29.874163 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 545/1119] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:00:29 2022] POST /compute/v2.1/servers/d716cac6-ac7c-4b98-b6ea-2496ccd62096/action => generated 0 bytes in 508 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 10 23:00:29.889162 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-4c1a0c9e-dc74-4eb7-a06a-7385fadba4e5 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:29.890774 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-4c1a0c9e-dc74-4eb7-a06a-7385fadba4e5 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 0dabc2bf-08ff-45b5-a791-34d655349eae] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:00:29.907585 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4c1a0c9e-dc74-4eb7-a06a-7385fadba4e5 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:29.909809 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4c1a0c9e-dc74-4eb7-a06a-7385fadba4e5 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:29.910586 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4c1a0c9e-dc74-4eb7-a06a-7385fadba4e5 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:29.911986 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4c1a0c9e-dc74-4eb7-a06a-7385fadba4e5 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:29.913836 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4c1a0c9e-dc74-4eb7-a06a-7385fadba4e5 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:29.914614 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4c1a0c9e-dc74-4eb7-a06a-7385fadba4e5 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:30.073756 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-4c1a0c9e-dc74-4eb7-a06a-7385fadba4e5 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:00:30.087116 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-4c1a0c9e-dc74-4eb7-a06a-7385fadba4e5 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/0dabc2bf-08ff-45b5-a791-34d655349eae" status: 200 len: 1216 microversion: 2.1 time: 0.210292 Aug 10 23:00:30.088050 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 546/1120] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:00:29 2022] GET /compute/v2.1/servers/0dabc2bf-08ff-45b5-a791-34d655349eae => generated 1216 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:00:30.107578 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-d29d042a-4405-47b6-aeef-883cde0ff1ef tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:30.119883 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-d29d042a-4405-47b6-aeef-883cde0ff1ef tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '417d4eaaeb1c4df78745496ececb3e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27e6ee9495a438b8450a4ef0d62cbcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:00:30.120677 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-d29d042a-4405-47b6-aeef-883cde0ff1ef tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Searching by: {'deleted': False, 'project_id': 'b27e6ee9495a438b8450a4ef0d62cbcd'} {{(pid=122632) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 10 23:00:30.175952 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d29d042a-4405-47b6-aeef-883cde0ff1ef tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:30.176447 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d29d042a-4405-47b6-aeef-883cde0ff1ef tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:30.176890 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d29d042a-4405-47b6-aeef-883cde0ff1ef tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:30.177622 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d29d042a-4405-47b6-aeef-883cde0ff1ef tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:30.178079 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d29d042a-4405-47b6-aeef-883cde0ff1ef tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:30.178508 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d29d042a-4405-47b6-aeef-883cde0ff1ef tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:30.479502 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.multi_cell_list [None req-d29d042a-4405-47b6-aeef-883cde0ff1ef tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=122632) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 10 23:00:30.655427 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-d29d042a-4405-47b6-aeef-883cde0ff1ef tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] 10.222.0.58 "GET /compute/v2.1/servers" status: 200 len: 1004 microversion: 2.1 time: 0.565737 Aug 10 23:00:30.667395 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 547/1121] 10.222.0.58 () {58 vars in 1125 bytes} [Wed Aug 10 23:00:30 2022] GET /compute/v2.1/servers => generated 1004 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:00:30.673032 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-e3338bd2-30aa-4b9e-ae36-a4a9468f4dcf tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:30.673936 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-e3338bd2-30aa-4b9e-ae36-a4a9468f4dcf tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] [instance: e0617f11-199e-41b8-a853-27eb2be0a8db] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:00:30.691904 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e3338bd2-30aa-4b9e-ae36-a4a9468f4dcf tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:30.692550 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e3338bd2-30aa-4b9e-ae36-a4a9468f4dcf tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:30.692892 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e3338bd2-30aa-4b9e-ae36-a4a9468f4dcf tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:30.694016 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e3338bd2-30aa-4b9e-ae36-a4a9468f4dcf tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:30.695640 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e3338bd2-30aa-4b9e-ae36-a4a9468f4dcf tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:30.696087 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e3338bd2-30aa-4b9e-ae36-a4a9468f4dcf tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:30.749982 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-e3338bd2-30aa-4b9e-ae36-a4a9468f4dcf tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] [instance: e0617f11-199e-41b8-a853-27eb2be0a8db] Going to try to terminate instance {{(pid=122632) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:00:30.806502 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-55249511-cd7e-4118-af35-f3d200002caf tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:00:30.824495 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-55249511-cd7e-4118-af35-f3d200002caf tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:00:30.826283 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-55249511-cd7e-4118-af35-f3d200002caf tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:00:30.827510 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-55249511-cd7e-4118-af35-f3d200002caf tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] 10.222.0.58 "GET /compute/v2.1/servers/99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0" status: 200 len: 1814 microversion: 2.25 time: 1.082492 Aug 10 23:00:30.828075 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 575/1122] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:00:29 2022] GET /compute/v2.1/servers/99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0 => generated 1814 bytes in 1083 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:00:30.837910 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-2aa1b307-e7b7-486b-a6f8-3fb119aee802 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:30.842607 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-2aa1b307-e7b7-486b-a6f8-3fb119aee802 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] [instance: 2a68f86c-37de-4207-aa43-6a1350342a56] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:00:30.855919 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2aa1b307-e7b7-486b-a6f8-3fb119aee802 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:30.857458 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2aa1b307-e7b7-486b-a6f8-3fb119aee802 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:30.857931 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2aa1b307-e7b7-486b-a6f8-3fb119aee802 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:30.860490 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2aa1b307-e7b7-486b-a6f8-3fb119aee802 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:30.862002 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2aa1b307-e7b7-486b-a6f8-3fb119aee802 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:30.862455 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2aa1b307-e7b7-486b-a6f8-3fb119aee802 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:30.984698 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-2aa1b307-e7b7-486b-a6f8-3fb119aee802 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6d9806b6724e5aaf8c69be8e70d4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307ab95daa034afbb31f90626885072b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:00:30.993313 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=1,nova_api:INSERT=8 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:00:31.000744 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-e3338bd2-30aa-4b9e-ae36-a4a9468f4dcf tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] 10.222.0.58 "DELETE /compute/v2.1/servers/e0617f11-199e-41b8-a853-27eb2be0a8db" status: 204 len: 0 microversion: 2.1 time: 0.332050 Aug 10 23:00:31.007395 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-2aa1b307-e7b7-486b-a6f8-3fb119aee802 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] 10.222.0.58 "GET /compute/v2.1/servers/2a68f86c-37de-4207-aa43-6a1350342a56" status: 200 len: 1212 microversion: 2.1 time: 0.178089 Aug 10 23:00:31.010514 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 548/1123] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:00:30 2022] DELETE /compute/v2.1/servers/e0617f11-199e-41b8-a853-27eb2be0a8db => generated 0 bytes in 340 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:00:31.011231 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 576/1124] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:00:30 2022] GET /compute/v2.1/servers/2a68f86c-37de-4207-aa43-6a1350342a56 => generated 1212 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:00:31.014279 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-91d1cd07-4219-4c09-91ca-8296c479c947 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Calling method '.version_select at 0x7f847d370670>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:31.022274 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-f3ac85bd-b688-4df3-ae25-8632b46ad059 req-8f75c8a3-282f-42bf-bd68-485ce0f6c718 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3722f40-7320-484b-8c20-78b2de3e89f1", "name": "network-vif-unplugged", "status": "completed", "tag": "3cd54803-1880-47e0-b27e-07883f5c80f2"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:00:31.037421 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-f3ac85bd-b688-4df3-ae25-8632b46ad059 req-8f75c8a3-282f-42bf-bd68-485ce0f6c718 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:31.037864 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-f3ac85bd-b688-4df3-ae25-8632b46ad059 req-8f75c8a3-282f-42bf-bd68-485ce0f6c718 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:31.038292 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-f3ac85bd-b688-4df3-ae25-8632b46ad059 req-8f75c8a3-282f-42bf-bd68-485ce0f6c718 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:31.050404 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-f3ac85bd-b688-4df3-ae25-8632b46ad059 req-8f75c8a3-282f-42bf-bd68-485ce0f6c718 service nova] Creating event network-vif-unplugged:3cd54803-1880-47e0-b27e-07883f5c80f2 for instance f3722f40-7320-484b-8c20-78b2de3e89f1 on n-h2-850468-14 Aug 10 23:00:31.056002 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-f3ac85bd-b688-4df3-ae25-8632b46ad059 req-8f75c8a3-282f-42bf-bd68-485ce0f6c718 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040228 Aug 10 23:00:31.056585 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 577/1125] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:00:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:00:31.066906 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-b6663867-6460-4309-bcbc-6eef3b9651b5 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:31.067850 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-b6663867-6460-4309-bcbc-6eef3b9651b5 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] [instance: a0995db2-2ae0-4216-996a-39a03357c1eb] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:00:31.072800 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-91d1cd07-4219-4c09-91ca-8296c479c947 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] 10.222.0.58 "GET /compute/v2.1/images/3d48cfd3-2ced-4117-a393-83f358ed89c6" status: 200 len: 1453 microversion: 2.1 time: 0.063478 Aug 10 23:00:31.073967 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 549/1126] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 10 23:00:31 2022] GET /compute/v2.1/images/3d48cfd3-2ced-4117-a393-83f358ed89c6 => generated 1453 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:00:31.080699 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b6663867-6460-4309-bcbc-6eef3b9651b5 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:31.081565 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b6663867-6460-4309-bcbc-6eef3b9651b5 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:31.085384 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-09d847e7-593e-40bb-a6a8-3109977936a0 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:31.086100 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b6663867-6460-4309-bcbc-6eef3b9651b5 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:31.086992 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b6663867-6460-4309-bcbc-6eef3b9651b5 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:31.087562 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b6663867-6460-4309-bcbc-6eef3b9651b5 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:31.087946 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-09d847e7-593e-40bb-a6a8-3109977936a0 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] [instance: e0617f11-199e-41b8-a853-27eb2be0a8db] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:00:31.088185 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b6663867-6460-4309-bcbc-6eef3b9651b5 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:31.096536 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-09d847e7-593e-40bb-a6a8-3109977936a0 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:31.097405 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-09d847e7-593e-40bb-a6a8-3109977936a0 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:31.098008 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-09d847e7-593e-40bb-a6a8-3109977936a0 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:31.098922 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-09d847e7-593e-40bb-a6a8-3109977936a0 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:31.099572 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-09d847e7-593e-40bb-a6a8-3109977936a0 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:31.100144 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-09d847e7-593e-40bb-a6a8-3109977936a0 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:31.244785 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-b6663867-6460-4309-bcbc-6eef3b9651b5 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '417d4eaaeb1c4df78745496ececb3e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27e6ee9495a438b8450a4ef0d62cbcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:00:31.260996 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-b6663867-6460-4309-bcbc-6eef3b9651b5 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] 10.222.0.58 "GET /compute/v2.1/servers/a0995db2-2ae0-4216-996a-39a03357c1eb" status: 200 len: 1223 microversion: 2.1 time: 0.202158 Aug 10 23:00:31.261986 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 578/1127] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:00:31 2022] GET /compute/v2.1/servers/a0995db2-2ae0-4216-996a-39a03357c1eb => generated 1223 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:00:31.270131 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-8e90e543-a5cb-4fc6-b147-655a11eef185 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:31.275712 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-8e90e543-a5cb-4fc6-b147-655a11eef185 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 0dabc2bf-08ff-45b5-a791-34d655349eae] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:00:31.291323 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8e90e543-a5cb-4fc6-b147-655a11eef185 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:31.292196 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8e90e543-a5cb-4fc6-b147-655a11eef185 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:31.292879 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8e90e543-a5cb-4fc6-b147-655a11eef185 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:31.296364 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8e90e543-a5cb-4fc6-b147-655a11eef185 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:31.297121 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8e90e543-a5cb-4fc6-b147-655a11eef185 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:31.298272 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8e90e543-a5cb-4fc6-b147-655a11eef185 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:31.452531 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-09d847e7-593e-40bb-a6a8-3109977936a0 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e437f9eb7254dc98e2839656c053f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eae334ad72ba421797a6d836edcbab0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:00:31.464145 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-09d847e7-593e-40bb-a6a8-3109977936a0 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] 10.222.0.58 "GET /compute/v2.1/servers/e0617f11-199e-41b8-a853-27eb2be0a8db" status: 200 len: 1513 microversion: 2.1 time: 0.388897 Aug 10 23:00:31.467236 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 550/1128] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:00:31 2022] GET /compute/v2.1/servers/e0617f11-199e-41b8-a853-27eb2be0a8db => generated 1513 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:00:31.550209 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-8e90e543-a5cb-4fc6-b147-655a11eef185 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:00:31.564798 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-8e90e543-a5cb-4fc6-b147-655a11eef185 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/0dabc2bf-08ff-45b5-a791-34d655349eae" status: 200 len: 1264 microversion: 2.1 time: 0.301510 Aug 10 23:00:31.565803 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 579/1129] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:00:31 2022] GET /compute/v2.1/servers/0dabc2bf-08ff-45b5-a791-34d655349eae => generated 1264 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:00:31.870143 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-79384c06-b3d6-495a-af9c-30bf8439dd22 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:31.870669 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-79384c06-b3d6-495a-af9c-30bf8439dd22 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] [instance: 99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:00:31.879817 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-79384c06-b3d6-495a-af9c-30bf8439dd22 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:31.880312 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-79384c06-b3d6-495a-af9c-30bf8439dd22 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:31.880749 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-79384c06-b3d6-495a-af9c-30bf8439dd22 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:31.881489 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-79384c06-b3d6-495a-af9c-30bf8439dd22 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:31.881938 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-79384c06-b3d6-495a-af9c-30bf8439dd22 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:31.895419 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-79384c06-b3d6-495a-af9c-30bf8439dd22 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:32.033601 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-90cd208a-dbae-4188-b8d9-ce516116c6b2 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:32.035254 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-90cd208a-dbae-4188-b8d9-ce516116c6b2 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] [instance: 2a68f86c-37de-4207-aa43-6a1350342a56] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:00:32.059039 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-79384c06-b3d6-495a-af9c-30bf8439dd22 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:00:32.063144 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-90cd208a-dbae-4188-b8d9-ce516116c6b2 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:32.068000 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-90cd208a-dbae-4188-b8d9-ce516116c6b2 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:32.068475 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-90cd208a-dbae-4188-b8d9-ce516116c6b2 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:32.069212 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-90cd208a-dbae-4188-b8d9-ce516116c6b2 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:32.069661 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-90cd208a-dbae-4188-b8d9-ce516116c6b2 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:32.070079 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-90cd208a-dbae-4188-b8d9-ce516116c6b2 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:32.075688 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-79384c06-b3d6-495a-af9c-30bf8439dd22 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:00:32.077377 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-79384c06-b3d6-495a-af9c-30bf8439dd22 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:00:32.078741 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-79384c06-b3d6-495a-af9c-30bf8439dd22 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] 10.222.0.58 "GET /compute/v2.1/servers/99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0" status: 200 len: 1814 microversion: 2.25 time: 0.213458 Aug 10 23:00:32.095639 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 551/1130] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:00:31 2022] GET /compute/v2.1/servers/99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0 => generated 1814 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:00:32.111568 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-4eca2abd-d013-4afd-b1e0-b77d364574eb tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Calling method '.version_select at 0x7f847d27e9d0>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:32.178931 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-4eca2abd-d013-4afd-b1e0-b77d364574eb tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] 10.222.0.58 "GET /compute/v2.1/images/3d48cfd3-2ced-4117-a393-83f358ed89c6" status: 200 len: 1453 microversion: 2.1 time: 0.081717 Aug 10 23:00:32.179924 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 552/1131] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 10 23:00:32 2022] GET /compute/v2.1/images/3d48cfd3-2ced-4117-a393-83f358ed89c6 => generated 1453 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:00:32.281367 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-d64712cf-9668-480c-a339-5b57835dee01 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:32.282600 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-d64712cf-9668-480c-a339-5b57835dee01 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] [instance: a0995db2-2ae0-4216-996a-39a03357c1eb] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:00:32.298839 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d64712cf-9668-480c-a339-5b57835dee01 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:32.299612 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d64712cf-9668-480c-a339-5b57835dee01 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:32.300200 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d64712cf-9668-480c-a339-5b57835dee01 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:32.301062 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d64712cf-9668-480c-a339-5b57835dee01 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:32.301669 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d64712cf-9668-480c-a339-5b57835dee01 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:32.302241 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d64712cf-9668-480c-a339-5b57835dee01 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:32.391961 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-d64712cf-9668-480c-a339-5b57835dee01 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '417d4eaaeb1c4df78745496ececb3e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27e6ee9495a438b8450a4ef0d62cbcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:00:32.404329 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-d64712cf-9668-480c-a339-5b57835dee01 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] 10.222.0.58 "GET /compute/v2.1/servers/a0995db2-2ae0-4216-996a-39a03357c1eb" status: 200 len: 1223 microversion: 2.1 time: 0.126615 Aug 10 23:00:32.418270 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 553/1132] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:00:32 2022] GET /compute/v2.1/servers/a0995db2-2ae0-4216-996a-39a03357c1eb => generated 1223 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:00:32.422057 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-90cd208a-dbae-4188-b8d9-ce516116c6b2 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6d9806b6724e5aaf8c69be8e70d4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307ab95daa034afbb31f90626885072b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:00:32.433116 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-90cd208a-dbae-4188-b8d9-ce516116c6b2 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] 10.222.0.58 "GET /compute/v2.1/servers/2a68f86c-37de-4207-aa43-6a1350342a56" status: 200 len: 1212 microversion: 2.1 time: 0.403673 Aug 10 23:00:32.433891 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 580/1133] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:00:32 2022] GET /compute/v2.1/servers/2a68f86c-37de-4207-aa43-6a1350342a56 => generated 1212 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:00:32.513472 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-86295aa1-4b37-4cd8-82cf-b1cf5955148e tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:32.514139 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-86295aa1-4b37-4cd8-82cf-b1cf5955148e tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] [instance: e0617f11-199e-41b8-a853-27eb2be0a8db] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:00:32.522137 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-86295aa1-4b37-4cd8-82cf-b1cf5955148e tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:32.533352 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-86295aa1-4b37-4cd8-82cf-b1cf5955148e tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:32.534279 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-86295aa1-4b37-4cd8-82cf-b1cf5955148e tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:32.537645 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-86295aa1-4b37-4cd8-82cf-b1cf5955148e tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:32.539340 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-86295aa1-4b37-4cd8-82cf-b1cf5955148e tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:32.545004 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-86295aa1-4b37-4cd8-82cf-b1cf5955148e tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:32.590797 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c4b6462f-8097-4620-9a29-7faa4b3b7498 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:32.591708 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-c4b6462f-8097-4620-9a29-7faa4b3b7498 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 0dabc2bf-08ff-45b5-a791-34d655349eae] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:00:32.604264 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c4b6462f-8097-4620-9a29-7faa4b3b7498 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:32.608915 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c4b6462f-8097-4620-9a29-7faa4b3b7498 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:32.609687 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c4b6462f-8097-4620-9a29-7faa4b3b7498 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:32.611453 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c4b6462f-8097-4620-9a29-7faa4b3b7498 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:32.612131 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c4b6462f-8097-4620-9a29-7faa4b3b7498 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:32.612726 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c4b6462f-8097-4620-9a29-7faa4b3b7498 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:32.892745 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-86295aa1-4b37-4cd8-82cf-b1cf5955148e tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e437f9eb7254dc98e2839656c053f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eae334ad72ba421797a6d836edcbab0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:00:32.900515 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:00:32.913877 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-86295aa1-4b37-4cd8-82cf-b1cf5955148e tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] 10.222.0.58 "GET /compute/v2.1/servers/e0617f11-199e-41b8-a853-27eb2be0a8db" status: 200 len: 1513 microversion: 2.1 time: 0.415629 Aug 10 23:00:32.915755 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 554/1134] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:00:32 2022] GET /compute/v2.1/servers/e0617f11-199e-41b8-a853-27eb2be0a8db => generated 1513 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:00:32.924246 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-c4b6462f-8097-4620-9a29-7faa4b3b7498 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:00:32.936902 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-c4b6462f-8097-4620-9a29-7faa4b3b7498 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/0dabc2bf-08ff-45b5-a791-34d655349eae" status: 200 len: 1272 microversion: 2.1 time: 0.352784 Aug 10 23:00:32.938000 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 581/1135] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:00:32 2022] GET /compute/v2.1/servers/0dabc2bf-08ff-45b5-a791-34d655349eae => generated 1272 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:00:33.071964 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-900bef65-0274-474f-b957-c64154fb8f5d req-7e7915f3-91c6-4973-8047-31f308c132f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1deb45a-4597-4456-a1bd-54013c9484a4", "name": "network-vif-unplugged", "status": "completed", "tag": "c23c9196-ec43-4cc3-a250-0ae9f5c58948"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:00:33.093181 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-900bef65-0274-474f-b957-c64154fb8f5d req-7e7915f3-91c6-4973-8047-31f308c132f6 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:33.094229 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-900bef65-0274-474f-b957-c64154fb8f5d req-7e7915f3-91c6-4973-8047-31f308c132f6 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:33.095483 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-900bef65-0274-474f-b957-c64154fb8f5d req-7e7915f3-91c6-4973-8047-31f308c132f6 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:33.109813 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-50e11f24-8768-4013-9f4a-071f831feb10 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:33.111123 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-50e11f24-8768-4013-9f4a-071f831feb10 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] [instance: 99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:00:33.132623 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-50e11f24-8768-4013-9f4a-071f831feb10 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:33.134340 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-50e11f24-8768-4013-9f4a-071f831feb10 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:33.137604 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-50e11f24-8768-4013-9f4a-071f831feb10 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:33.140300 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-50e11f24-8768-4013-9f4a-071f831feb10 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:33.140789 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-50e11f24-8768-4013-9f4a-071f831feb10 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:33.141232 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-50e11f24-8768-4013-9f4a-071f831feb10 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:33.156895 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-900bef65-0274-474f-b957-c64154fb8f5d req-7e7915f3-91c6-4973-8047-31f308c132f6 service nova] Creating event network-vif-unplugged:c23c9196-ec43-4cc3-a250-0ae9f5c58948 for instance e1deb45a-4597-4456-a1bd-54013c9484a4 on n-h1-850468-14 Aug 10 23:00:33.179935 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-900bef65-0274-474f-b957-c64154fb8f5d req-7e7915f3-91c6-4973-8047-31f308c132f6 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.107683 Aug 10 23:00:33.188960 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 555/1136] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:00:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:00:33.212461 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-4be519a6-b5ff-48e7-b511-fa5f027eecbc tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Calling method '.version_select at 0x7f847d24bee0>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:33.323719 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-4be519a6-b5ff-48e7-b511-fa5f027eecbc tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] 10.222.0.58 "GET /compute/v2.1/images/3d48cfd3-2ced-4117-a393-83f358ed89c6" status: 200 len: 1453 microversion: 2.1 time: 0.131546 Aug 10 23:00:33.324297 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 556/1137] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 10 23:00:33 2022] GET /compute/v2.1/images/3d48cfd3-2ced-4117-a393-83f358ed89c6 => generated 1453 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:00:33.433620 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-e75fdd17-0d99-4c1f-ac41-e8dbf9e09fa1 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:33.434459 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-e75fdd17-0d99-4c1f-ac41-e8dbf9e09fa1 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] [instance: a0995db2-2ae0-4216-996a-39a03357c1eb] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:00:33.471092 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e75fdd17-0d99-4c1f-ac41-e8dbf9e09fa1 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:33.471848 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e75fdd17-0d99-4c1f-ac41-e8dbf9e09fa1 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:33.472481 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e75fdd17-0d99-4c1f-ac41-e8dbf9e09fa1 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:33.473552 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e75fdd17-0d99-4c1f-ac41-e8dbf9e09fa1 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:33.474183 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e75fdd17-0d99-4c1f-ac41-e8dbf9e09fa1 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:33.474613 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e75fdd17-0d99-4c1f-ac41-e8dbf9e09fa1 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:33.616229 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-e75fdd17-0d99-4c1f-ac41-e8dbf9e09fa1 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '417d4eaaeb1c4df78745496ececb3e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27e6ee9495a438b8450a4ef0d62cbcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:00:33.630603 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-e75fdd17-0d99-4c1f-ac41-e8dbf9e09fa1 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] 10.222.0.58 "GET /compute/v2.1/servers/a0995db2-2ae0-4216-996a-39a03357c1eb" status: 200 len: 1271 microversion: 2.1 time: 0.207872 Aug 10 23:00:33.631235 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 557/1138] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:00:33 2022] GET /compute/v2.1/servers/a0995db2-2ae0-4216-996a-39a03357c1eb => generated 1271 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:00:33.647734 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-dee85300-228d-4509-a2bb-f3ba032b8d80 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:33.648351 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-dee85300-228d-4509-a2bb-f3ba032b8d80 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] [instance: 2a68f86c-37de-4207-aa43-6a1350342a56] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:00:33.669192 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dee85300-228d-4509-a2bb-f3ba032b8d80 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:33.671360 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dee85300-228d-4509-a2bb-f3ba032b8d80 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:33.671744 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dee85300-228d-4509-a2bb-f3ba032b8d80 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:33.672473 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dee85300-228d-4509-a2bb-f3ba032b8d80 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:33.673490 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dee85300-228d-4509-a2bb-f3ba032b8d80 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:33.674273 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dee85300-228d-4509-a2bb-f3ba032b8d80 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:33.948107 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-dee85300-228d-4509-a2bb-f3ba032b8d80 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6d9806b6724e5aaf8c69be8e70d4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307ab95daa034afbb31f90626885072b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:00:33.966969 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-dee85300-228d-4509-a2bb-f3ba032b8d80 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] 10.222.0.58 "GET /compute/v2.1/servers/2a68f86c-37de-4207-aa43-6a1350342a56" status: 200 len: 1260 microversion: 2.1 time: 0.329240 Aug 10 23:00:33.971049 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 558/1139] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:00:33 2022] GET /compute/v2.1/servers/2a68f86c-37de-4207-aa43-6a1350342a56 => generated 1260 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:00:34.001412 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-a99bb21a-5ee5-4f58-abfb-cbc67f2ab428 req-b37b221f-7a33-458c-abc6-32ec8089e8f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3722f40-7320-484b-8c20-78b2de3e89f1", "name": "network-vif-deleted", "tag": "3cd54803-1880-47e0-b27e-07883f5c80f2"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:00:34.049447 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-a99bb21a-5ee5-4f58-abfb-cbc67f2ab428 req-b37b221f-7a33-458c-abc6-32ec8089e8f2 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:34.051174 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-a99bb21a-5ee5-4f58-abfb-cbc67f2ab428 req-b37b221f-7a33-458c-abc6-32ec8089e8f2 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:34.053681 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-a99bb21a-5ee5-4f58-abfb-cbc67f2ab428 req-b37b221f-7a33-458c-abc6-32ec8089e8f2 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:34.083085 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-a99bb21a-5ee5-4f58-abfb-cbc67f2ab428 req-b37b221f-7a33-458c-abc6-32ec8089e8f2 service nova] Creating event network-vif-deleted:3cd54803-1880-47e0-b27e-07883f5c80f2 for instance f3722f40-7320-484b-8c20-78b2de3e89f1 on n-h2-850468-14 Aug 10 23:00:34.095974 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-a99bb21a-5ee5-4f58-abfb-cbc67f2ab428 req-b37b221f-7a33-458c-abc6-32ec8089e8f2 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121183 Aug 10 23:00:34.098689 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 559/1140] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:00:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:00:34.108290 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-dd33faba-a33a-40b4-92b8-76ea6fe9bee1 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:34.109000 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-dd33faba-a33a-40b4-92b8-76ea6fe9bee1 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] [instance: e0617f11-199e-41b8-a853-27eb2be0a8db] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:00:34.120967 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dd33faba-a33a-40b4-92b8-76ea6fe9bee1 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:34.121460 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dd33faba-a33a-40b4-92b8-76ea6fe9bee1 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:34.121903 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dd33faba-a33a-40b4-92b8-76ea6fe9bee1 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:34.123020 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dd33faba-a33a-40b4-92b8-76ea6fe9bee1 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:34.123643 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dd33faba-a33a-40b4-92b8-76ea6fe9bee1 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:34.124065 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dd33faba-a33a-40b4-92b8-76ea6fe9bee1 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:34.380790 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-dd33faba-a33a-40b4-92b8-76ea6fe9bee1 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e437f9eb7254dc98e2839656c053f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eae334ad72ba421797a6d836edcbab0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:00:34.389124 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-dd33faba-a33a-40b4-92b8-76ea6fe9bee1 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] 10.222.0.58 "GET /compute/v2.1/servers/e0617f11-199e-41b8-a853-27eb2be0a8db" status: 200 len: 1513 microversion: 2.1 time: 0.284956 Aug 10 23:00:34.394200 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 560/1141] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:00:34 2022] GET /compute/v2.1/servers/e0617f11-199e-41b8-a853-27eb2be0a8db => generated 1513 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:00:34.399292 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-10626d8d-286b-40f8-b780-5be8dd1bce38 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:34.400085 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-10626d8d-286b-40f8-b780-5be8dd1bce38 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 0dabc2bf-08ff-45b5-a791-34d655349eae] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:00:34.403860 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-50e11f24-8768-4013-9f4a-071f831feb10 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:00:34.423916 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-50e11f24-8768-4013-9f4a-071f831feb10 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:00:34.425034 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-10626d8d-286b-40f8-b780-5be8dd1bce38 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:34.428746 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-10626d8d-286b-40f8-b780-5be8dd1bce38 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:34.431928 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-10626d8d-286b-40f8-b780-5be8dd1bce38 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:34.435674 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-50e11f24-8768-4013-9f4a-071f831feb10 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:00:34.436761 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-10626d8d-286b-40f8-b780-5be8dd1bce38 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:34.436897 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-50e11f24-8768-4013-9f4a-071f831feb10 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] 10.222.0.58 "GET /compute/v2.1/servers/99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0" status: 200 len: 1814 microversion: 2.25 time: 1.331428 Aug 10 23:00:34.443708 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 582/1142] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:00:33 2022] GET /compute/v2.1/servers/99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0 => generated 1814 bytes in 1338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:00:34.452539 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-10626d8d-286b-40f8-b780-5be8dd1bce38 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:34.453101 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-10626d8d-286b-40f8-b780-5be8dd1bce38 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:34.458769 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-a61546d0-c0ce-47de-a1d2-b8075c50c32d tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Calling method '.version_select at 0x7f847d32daf0>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:34.561617 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-a61546d0-c0ce-47de-a1d2-b8075c50c32d tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] 10.222.0.58 "GET /compute/v2.1/images/3d48cfd3-2ced-4117-a393-83f358ed89c6" status: 200 len: 1453 microversion: 2.1 time: 0.116410 Aug 10 23:00:34.562539 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 583/1143] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 10 23:00:34 2022] GET /compute/v2.1/images/3d48cfd3-2ced-4117-a393-83f358ed89c6 => generated 1453 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:00:34.654183 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-f37b801e-5f5d-41c2-b97e-ca3e288cea2a tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:34.654812 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-f37b801e-5f5d-41c2-b97e-ca3e288cea2a tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] [instance: a0995db2-2ae0-4216-996a-39a03357c1eb] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:00:34.678859 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f37b801e-5f5d-41c2-b97e-ca3e288cea2a tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:34.679393 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f37b801e-5f5d-41c2-b97e-ca3e288cea2a tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:34.680310 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f37b801e-5f5d-41c2-b97e-ca3e288cea2a tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:34.681094 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f37b801e-5f5d-41c2-b97e-ca3e288cea2a tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:34.681554 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f37b801e-5f5d-41c2-b97e-ca3e288cea2a tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:34.681983 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f37b801e-5f5d-41c2-b97e-ca3e288cea2a tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:34.785280 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-10626d8d-286b-40f8-b780-5be8dd1bce38 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:00:34.821128 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-10626d8d-286b-40f8-b780-5be8dd1bce38 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/0dabc2bf-08ff-45b5-a791-34d655349eae" status: 200 len: 1270 microversion: 2.1 time: 0.425348 Aug 10 23:00:34.822194 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 561/1144] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:00:34 2022] GET /compute/v2.1/servers/0dabc2bf-08ff-45b5-a791-34d655349eae => generated 1270 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:00:34.995583 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-d4fc59ee-e4cd-47cb-b407-e91829fe1962 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:34.996200 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-d4fc59ee-e4cd-47cb-b407-e91829fe1962 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] [instance: 2a68f86c-37de-4207-aa43-6a1350342a56] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:00:35.004322 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d4fc59ee-e4cd-47cb-b407-e91829fe1962 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:35.005251 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d4fc59ee-e4cd-47cb-b407-e91829fe1962 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:35.006813 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d4fc59ee-e4cd-47cb-b407-e91829fe1962 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:35.007886 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d4fc59ee-e4cd-47cb-b407-e91829fe1962 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:35.008497 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d4fc59ee-e4cd-47cb-b407-e91829fe1962 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:35.009074 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d4fc59ee-e4cd-47cb-b407-e91829fe1962 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:35.053436 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-f37b801e-5f5d-41c2-b97e-ca3e288cea2a tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '417d4eaaeb1c4df78745496ececb3e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27e6ee9495a438b8450a4ef0d62cbcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:00:35.064803 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-f37b801e-5f5d-41c2-b97e-ca3e288cea2a tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] 10.222.0.58 "GET /compute/v2.1/servers/a0995db2-2ae0-4216-996a-39a03357c1eb" status: 200 len: 1279 microversion: 2.1 time: 0.414833 Aug 10 23:00:35.066188 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 584/1145] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:00:34 2022] GET /compute/v2.1/servers/a0995db2-2ae0-4216-996a-39a03357c1eb => generated 1279 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:00:35.115372 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-d4fc59ee-e4cd-47cb-b407-e91829fe1962 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6d9806b6724e5aaf8c69be8e70d4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307ab95daa034afbb31f90626885072b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:00:35.124111 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-d4fc59ee-e4cd-47cb-b407-e91829fe1962 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] 10.222.0.58 "GET /compute/v2.1/servers/2a68f86c-37de-4207-aa43-6a1350342a56" status: 200 len: 1266 microversion: 2.1 time: 0.133353 Aug 10 23:00:35.136747 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 562/1146] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:00:34 2022] GET /compute/v2.1/servers/2a68f86c-37de-4207-aa43-6a1350342a56 => generated 1266 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:00:35.241653 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-c49944c9-2530-48be-b5ff-cbf07623c2a2 req-d20cc4b9-4628-4f10-91ba-3e97e64b4391 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d716cac6-ac7c-4b98-b6ea-2496ccd62096", "name": "network-vif-plugged", "status": "completed", "tag": "30ea23cf-a364-4798-a6be-6ab46d11599e"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:00:35.259735 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-c49944c9-2530-48be-b5ff-cbf07623c2a2 req-d20cc4b9-4628-4f10-91ba-3e97e64b4391 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:35.260542 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-c49944c9-2530-48be-b5ff-cbf07623c2a2 req-d20cc4b9-4628-4f10-91ba-3e97e64b4391 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:35.260984 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-c49944c9-2530-48be-b5ff-cbf07623c2a2 req-d20cc4b9-4628-4f10-91ba-3e97e64b4391 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:35.287570 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-c49944c9-2530-48be-b5ff-cbf07623c2a2 req-d20cc4b9-4628-4f10-91ba-3e97e64b4391 service nova] Creating event network-vif-plugged:30ea23cf-a364-4798-a6be-6ab46d11599e for instance d716cac6-ac7c-4b98-b6ea-2496ccd62096 on n-h2-850468-14 Aug 10 23:00:35.307262 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-c49944c9-2530-48be-b5ff-cbf07623c2a2 req-d20cc4b9-4628-4f10-91ba-3e97e64b4391 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069936 Aug 10 23:00:35.308258 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 585/1147] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:00:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:00:35.415386 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-bc6231fc-c08d-4214-b013-978f55998a64 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:35.416157 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-bc6231fc-c08d-4214-b013-978f55998a64 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] [instance: e0617f11-199e-41b8-a853-27eb2be0a8db] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:00:35.426142 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bc6231fc-c08d-4214-b013-978f55998a64 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:35.426627 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bc6231fc-c08d-4214-b013-978f55998a64 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:35.432060 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bc6231fc-c08d-4214-b013-978f55998a64 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:35.432799 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bc6231fc-c08d-4214-b013-978f55998a64 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:35.433266 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bc6231fc-c08d-4214-b013-978f55998a64 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:35.434092 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bc6231fc-c08d-4214-b013-978f55998a64 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:35.468042 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-0baf6656-52e6-4f12-bff7-a57fd2a657e7 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:35.468733 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-0baf6656-52e6-4f12-bff7-a57fd2a657e7 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] [instance: 99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:00:35.474816 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:00:35.487647 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0baf6656-52e6-4f12-bff7-a57fd2a657e7 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:35.492048 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0baf6656-52e6-4f12-bff7-a57fd2a657e7 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:35.492867 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0baf6656-52e6-4f12-bff7-a57fd2a657e7 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:35.494243 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0baf6656-52e6-4f12-bff7-a57fd2a657e7 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:35.496132 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0baf6656-52e6-4f12-bff7-a57fd2a657e7 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:35.497163 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0baf6656-52e6-4f12-bff7-a57fd2a657e7 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:36.129163 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-bc6231fc-c08d-4214-b013-978f55998a64 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e437f9eb7254dc98e2839656c053f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eae334ad72ba421797a6d836edcbab0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:00:36.141061 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-bc6231fc-c08d-4214-b013-978f55998a64 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] 10.222.0.58 "GET /compute/v2.1/servers/e0617f11-199e-41b8-a853-27eb2be0a8db" status: 200 len: 1513 microversion: 2.1 time: 0.730223 Aug 10 23:00:36.142991 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 563/1148] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:00:35 2022] GET /compute/v2.1/servers/e0617f11-199e-41b8-a853-27eb2be0a8db => generated 1513 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:00:36.148458 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-b32d9ce4-2011-43ad-b45e-5d1a7db3ab0a tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Calling method '.version_select at 0x7f847d1f3940>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:36.209304 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-b32d9ce4-2011-43ad-b45e-5d1a7db3ab0a tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] 10.222.0.58 "GET /compute/v2.1/images/3d48cfd3-2ced-4117-a393-83f358ed89c6" status: 200 len: 1453 microversion: 2.1 time: 0.064951 Aug 10 23:00:36.210368 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 564/1149] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 10 23:00:36 2022] GET /compute/v2.1/images/3d48cfd3-2ced-4117-a393-83f358ed89c6 => generated 1453 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:00:36.215925 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-1ee374de-3351-4cb2-b2ba-839d7c98d1b8 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:36.216841 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-1ee374de-3351-4cb2-b2ba-839d7c98d1b8 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 0dabc2bf-08ff-45b5-a791-34d655349eae] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:00:36.224670 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1ee374de-3351-4cb2-b2ba-839d7c98d1b8 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:36.225595 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1ee374de-3351-4cb2-b2ba-839d7c98d1b8 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:36.226338 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1ee374de-3351-4cb2-b2ba-839d7c98d1b8 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:36.227491 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1ee374de-3351-4cb2-b2ba-839d7c98d1b8 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:36.228051 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1ee374de-3351-4cb2-b2ba-839d7c98d1b8 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:36.228715 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1ee374de-3351-4cb2-b2ba-839d7c98d1b8 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:36.429211 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-1ee374de-3351-4cb2-b2ba-839d7c98d1b8 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:00:36.452152 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-1ee374de-3351-4cb2-b2ba-839d7c98d1b8 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/0dabc2bf-08ff-45b5-a791-34d655349eae" status: 200 len: 1312 microversion: 2.1 time: 0.238326 Aug 10 23:00:36.455847 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 565/1150] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:00:36 2022] GET /compute/v2.1/servers/0dabc2bf-08ff-45b5-a791-34d655349eae => generated 1312 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:00:36.468792 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-d49fb53f-97b6-4549-9659-0f6326d8b306 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:36.470572 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-d49fb53f-97b6-4549-9659-0f6326d8b306 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] [instance: a0995db2-2ae0-4216-996a-39a03357c1eb] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:00:36.482925 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d49fb53f-97b6-4549-9659-0f6326d8b306 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:36.483672 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d49fb53f-97b6-4549-9659-0f6326d8b306 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:36.484350 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d49fb53f-97b6-4549-9659-0f6326d8b306 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:36.485534 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d49fb53f-97b6-4549-9659-0f6326d8b306 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:36.486220 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d49fb53f-97b6-4549-9659-0f6326d8b306 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:36.488128 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d49fb53f-97b6-4549-9659-0f6326d8b306 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:36.502972 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-0baf6656-52e6-4f12-bff7-a57fd2a657e7 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:00:36.506547 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=100 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:00:36.541706 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-0baf6656-52e6-4f12-bff7-a57fd2a657e7 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:00:36.543659 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-0baf6656-52e6-4f12-bff7-a57fd2a657e7 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:00:36.545100 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-0baf6656-52e6-4f12-bff7-a57fd2a657e7 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] 10.222.0.58 "GET /compute/v2.1/servers/99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0" status: 200 len: 1814 microversion: 2.25 time: 1.082068 Aug 10 23:00:36.555919 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 586/1151] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:00:35 2022] GET /compute/v2.1/servers/99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0 => generated 1814 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:00:36.571533 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-d3ea956a-e241-4ac7-a5fe-cbcdde60c24b tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:36.572564 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-d3ea956a-e241-4ac7-a5fe-cbcdde60c24b tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] [instance: 2a68f86c-37de-4207-aa43-6a1350342a56] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:00:36.590301 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d3ea956a-e241-4ac7-a5fe-cbcdde60c24b tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:36.590974 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d3ea956a-e241-4ac7-a5fe-cbcdde60c24b tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:36.591515 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d3ea956a-e241-4ac7-a5fe-cbcdde60c24b tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:36.592325 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d3ea956a-e241-4ac7-a5fe-cbcdde60c24b tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:36.592897 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d3ea956a-e241-4ac7-a5fe-cbcdde60c24b tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:36.593513 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d3ea956a-e241-4ac7-a5fe-cbcdde60c24b tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:36.648259 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-d49fb53f-97b6-4549-9659-0f6326d8b306 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '417d4eaaeb1c4df78745496ececb3e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27e6ee9495a438b8450a4ef0d62cbcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:00:36.663911 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-d49fb53f-97b6-4549-9659-0f6326d8b306 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] 10.222.0.58 "GET /compute/v2.1/servers/a0995db2-2ae0-4216-996a-39a03357c1eb" status: 200 len: 1277 microversion: 2.1 time: 0.206630 Aug 10 23:00:36.669388 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 566/1152] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:00:36 2022] GET /compute/v2.1/servers/a0995db2-2ae0-4216-996a-39a03357c1eb => generated 1277 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:00:36.832235 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-d3ea956a-e241-4ac7-a5fe-cbcdde60c24b tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6d9806b6724e5aaf8c69be8e70d4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307ab95daa034afbb31f90626885072b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:00:36.852738 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-d3ea956a-e241-4ac7-a5fe-cbcdde60c24b tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] 10.222.0.58 "GET /compute/v2.1/servers/2a68f86c-37de-4207-aa43-6a1350342a56" status: 200 len: 1266 microversion: 2.1 time: 0.295030 Aug 10 23:00:36.861580 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 587/1153] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:00:36 2022] GET /compute/v2.1/servers/2a68f86c-37de-4207-aa43-6a1350342a56 => generated 1266 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:00:36.980138 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-a023127d-4d2c-4096-ac53-3e746e7de1b1 req-a9897e4c-8834-469d-ab1d-e69b5fffa4e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0dabc2bf-08ff-45b5-a791-34d655349eae", "tag": "8dba1a8f-5d05-48a3-afda-7507568fcb46"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:00:37.028902 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-b6f1cef8-820d-41d4-9470-61d94a1fcbd9 req-abc38ebb-14be-40d1-96fb-c1b02a2eb35b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e0617f11-199e-41b8-a853-27eb2be0a8db", "name": "network-vif-deleted", "tag": "4c64e25d-82ab-4c38-8bc1-7e67b114eba8"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:00:37.036997 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-a023127d-4d2c-4096-ac53-3e746e7de1b1 req-a9897e4c-8834-469d-ab1d-e69b5fffa4e3 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:37.037662 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-a023127d-4d2c-4096-ac53-3e746e7de1b1 req-a9897e4c-8834-469d-ab1d-e69b5fffa4e3 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:37.038354 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-a023127d-4d2c-4096-ac53-3e746e7de1b1 req-a9897e4c-8834-469d-ab1d-e69b5fffa4e3 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:37.057757 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-a023127d-4d2c-4096-ac53-3e746e7de1b1 req-a9897e4c-8834-469d-ab1d-e69b5fffa4e3 service nova] Creating event network-changed:8dba1a8f-5d05-48a3-afda-7507568fcb46 for instance 0dabc2bf-08ff-45b5-a791-34d655349eae on n-h2-850468-14 Aug 10 23:00:37.061420 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-b6f1cef8-820d-41d4-9470-61d94a1fcbd9 req-abc38ebb-14be-40d1-96fb-c1b02a2eb35b service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:37.061897 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-b6f1cef8-820d-41d4-9470-61d94a1fcbd9 req-abc38ebb-14be-40d1-96fb-c1b02a2eb35b service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:37.062326 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-b6f1cef8-820d-41d4-9470-61d94a1fcbd9 req-abc38ebb-14be-40d1-96fb-c1b02a2eb35b service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:37.065700 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-a023127d-4d2c-4096-ac53-3e746e7de1b1 req-a9897e4c-8834-469d-ab1d-e69b5fffa4e3 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090830 Aug 10 23:00:37.081659 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 567/1154] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:00:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:00:37.114888 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-b6f1cef8-820d-41d4-9470-61d94a1fcbd9 req-abc38ebb-14be-40d1-96fb-c1b02a2eb35b service nova] Creating event network-vif-deleted:4c64e25d-82ab-4c38-8bc1-7e67b114eba8 for instance e0617f11-199e-41b8-a853-27eb2be0a8db on n-h2-850468-14 Aug 10 23:00:37.137202 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-b6f1cef8-820d-41d4-9470-61d94a1fcbd9 req-abc38ebb-14be-40d1-96fb-c1b02a2eb35b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113137 Aug 10 23:00:37.137813 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 588/1155] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:00:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 23:00:37.171555 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-91d18507-5fe9-46f1-bce5-7585f777ab44 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:37.174216 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-91d18507-5fe9-46f1-bce5-7585f777ab44 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] [instance: e0617f11-199e-41b8-a853-27eb2be0a8db] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:00:37.203060 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-91d18507-5fe9-46f1-bce5-7585f777ab44 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:37.206554 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-91d18507-5fe9-46f1-bce5-7585f777ab44 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:37.207222 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-91d18507-5fe9-46f1-bce5-7585f777ab44 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:37.208865 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-91d18507-5fe9-46f1-bce5-7585f777ab44 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:37.211634 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-91d18507-5fe9-46f1-bce5-7585f777ab44 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:37.212212 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-91d18507-5fe9-46f1-bce5-7585f777ab44 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:37.227629 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-5b435856-20e0-4e11-844e-f83c2f962e9e tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Calling method '.version_select at 0x7f847d432dc0>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:37.271179 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-91d18507-5fe9-46f1-bce5-7585f777ab44 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:37.271919 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-91d18507-5fe9-46f1-bce5-7585f777ab44 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:37.272469 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-91d18507-5fe9-46f1-bce5-7585f777ab44 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:37.273035 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.objects.instance [None req-91d18507-5fe9-46f1-bce5-7585f777ab44 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lazy-loading 'fault' on Instance uuid e0617f11-199e-41b8-a853-27eb2be0a8db {{(pid=122632) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:00:37.323766 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-5b435856-20e0-4e11-844e-f83c2f962e9e tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] 10.222.0.58 "GET /compute/v2.1/images/3d48cfd3-2ced-4117-a393-83f358ed89c6" status: 200 len: 1453 microversion: 2.1 time: 0.101821 Aug 10 23:00:37.325100 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 589/1156] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 10 23:00:37 2022] GET /compute/v2.1/images/3d48cfd3-2ced-4117-a393-83f358ed89c6 => generated 1453 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:00:37.476225 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-1f59caf0-a792-43d5-a95c-7e18700935e5 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:37.476876 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-1f59caf0-a792-43d5-a95c-7e18700935e5 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 0dabc2bf-08ff-45b5-a791-34d655349eae] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:00:37.488889 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1f59caf0-a792-43d5-a95c-7e18700935e5 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:37.496986 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1f59caf0-a792-43d5-a95c-7e18700935e5 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:37.497733 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1f59caf0-a792-43d5-a95c-7e18700935e5 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:37.501579 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1f59caf0-a792-43d5-a95c-7e18700935e5 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:37.506731 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-91d18507-5fe9-46f1-bce5-7585f777ab44 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e437f9eb7254dc98e2839656c053f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eae334ad72ba421797a6d836edcbab0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:00:37.507591 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1f59caf0-a792-43d5-a95c-7e18700935e5 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:37.508887 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1f59caf0-a792-43d5-a95c-7e18700935e5 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:37.517647 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-91d18507-5fe9-46f1-bce5-7585f777ab44 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] 10.222.0.58 "GET /compute/v2.1/servers/e0617f11-199e-41b8-a853-27eb2be0a8db" status: 200 len: 1307 microversion: 2.1 time: 0.358247 Aug 10 23:00:37.536486 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 568/1157] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:00:37 2022] GET /compute/v2.1/servers/e0617f11-199e-41b8-a853-27eb2be0a8db => generated 1307 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:00:37.582830 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-471097fb-d1ed-4ea7-9253-7fed38d9d1bc tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:37.583918 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-471097fb-d1ed-4ea7-9253-7fed38d9d1bc tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] [instance: 99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:00:37.593441 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-471097fb-d1ed-4ea7-9253-7fed38d9d1bc tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:37.599768 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-471097fb-d1ed-4ea7-9253-7fed38d9d1bc tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:37.600736 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-471097fb-d1ed-4ea7-9253-7fed38d9d1bc tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:37.601726 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-471097fb-d1ed-4ea7-9253-7fed38d9d1bc tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:37.602412 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-471097fb-d1ed-4ea7-9253-7fed38d9d1bc tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:37.603148 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-471097fb-d1ed-4ea7-9253-7fed38d9d1bc tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:38.393206 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-471097fb-d1ed-4ea7-9253-7fed38d9d1bc tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:00:38.413153 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-471097fb-d1ed-4ea7-9253-7fed38d9d1bc tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:00:38.414664 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-471097fb-d1ed-4ea7-9253-7fed38d9d1bc tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:00:38.415903 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-471097fb-d1ed-4ea7-9253-7fed38d9d1bc tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] 10.222.0.58 "GET /compute/v2.1/servers/99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0" status: 200 len: 1814 microversion: 2.25 time: 0.838186 Aug 10 23:00:38.416471 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 569/1158] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:00:37 2022] GET /compute/v2.1/servers/99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0 => generated 1814 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:00:38.427986 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-cc5487b9-51bb-4077-a1e9-911ad7b47bf3 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:38.432160 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-cc5487b9-51bb-4077-a1e9-911ad7b47bf3 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] [instance: a0995db2-2ae0-4216-996a-39a03357c1eb] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:00:38.456712 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cc5487b9-51bb-4077-a1e9-911ad7b47bf3 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:38.457203 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cc5487b9-51bb-4077-a1e9-911ad7b47bf3 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:38.457634 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cc5487b9-51bb-4077-a1e9-911ad7b47bf3 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:38.458349 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cc5487b9-51bb-4077-a1e9-911ad7b47bf3 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:38.458810 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cc5487b9-51bb-4077-a1e9-911ad7b47bf3 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:38.459240 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cc5487b9-51bb-4077-a1e9-911ad7b47bf3 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:38.635748 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-1f59caf0-a792-43d5-a95c-7e18700935e5 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:00:38.645952 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-1f59caf0-a792-43d5-a95c-7e18700935e5 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/0dabc2bf-08ff-45b5-a791-34d655349eae" status: 200 len: 1312 microversion: 2.1 time: 1.174316 Aug 10 23:00:38.660268 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 590/1159] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:00:37 2022] GET /compute/v2.1/servers/0dabc2bf-08ff-45b5-a791-34d655349eae => generated 1312 bytes in 1189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:00:38.665991 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-e7937dda-fadf-4651-87f3-c8903c8cfc07 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:38.666955 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-e7937dda-fadf-4651-87f3-c8903c8cfc07 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] [instance: 2a68f86c-37de-4207-aa43-6a1350342a56] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:00:38.676478 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e7937dda-fadf-4651-87f3-c8903c8cfc07 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:38.677368 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e7937dda-fadf-4651-87f3-c8903c8cfc07 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:38.678028 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e7937dda-fadf-4651-87f3-c8903c8cfc07 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:38.679163 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e7937dda-fadf-4651-87f3-c8903c8cfc07 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:38.679869 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e7937dda-fadf-4651-87f3-c8903c8cfc07 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:38.681181 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e7937dda-fadf-4651-87f3-c8903c8cfc07 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:38.791822 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-cc5487b9-51bb-4077-a1e9-911ad7b47bf3 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '417d4eaaeb1c4df78745496ececb3e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27e6ee9495a438b8450a4ef0d62cbcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:00:38.800591 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-cc5487b9-51bb-4077-a1e9-911ad7b47bf3 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] 10.222.0.58 "GET /compute/v2.1/servers/a0995db2-2ae0-4216-996a-39a03357c1eb" status: 200 len: 1319 microversion: 2.1 time: 0.379524 Aug 10 23:00:38.801191 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 570/1160] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:00:38 2022] GET /compute/v2.1/servers/a0995db2-2ae0-4216-996a-39a03357c1eb => generated 1319 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:00:38.823461 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-54d87565-3fd7-4a8d-b808-8e8500716eb3 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Calling method '.version_select at 0x7f847d1b39d0>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:38.889384 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-54d87565-3fd7-4a8d-b808-8e8500716eb3 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] 10.222.0.58 "GET /compute/v2.1/images/3d48cfd3-2ced-4117-a393-83f358ed89c6" status: 200 len: 1453 microversion: 2.1 time: 0.071350 Aug 10 23:00:38.897808 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 571/1161] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 10 23:00:38 2022] GET /compute/v2.1/images/3d48cfd3-2ced-4117-a393-83f358ed89c6 => generated 1453 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:00:38.903983 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-1c9c00e4-9e63-4908-97d1-56ecdb96cdf6 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:38.904702 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-1c9c00e4-9e63-4908-97d1-56ecdb96cdf6 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] [instance: e0617f11-199e-41b8-a853-27eb2be0a8db] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:00:38.914437 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1c9c00e4-9e63-4908-97d1-56ecdb96cdf6 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:38.914974 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1c9c00e4-9e63-4908-97d1-56ecdb96cdf6 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:38.915412 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1c9c00e4-9e63-4908-97d1-56ecdb96cdf6 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:38.916235 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1c9c00e4-9e63-4908-97d1-56ecdb96cdf6 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:38.916691 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1c9c00e4-9e63-4908-97d1-56ecdb96cdf6 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:38.917113 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1c9c00e4-9e63-4908-97d1-56ecdb96cdf6 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:38.934122 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-1c9c00e4-9e63-4908-97d1-56ecdb96cdf6 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] HTTP exception thrown: Instance e0617f11-199e-41b8-a853-27eb2be0a8db could not be found. Aug 10 23:00:38.936896 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-1c9c00e4-9e63-4908-97d1-56ecdb96cdf6 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Request method failure captured: Aug 10 23:00:38.936896 n-d-850468-14 devstack@n-api.service[122632]: request: GET /compute/v2.1/servers/e0617f11-199e-41b8-a853-27eb2be0a8db HTTP/1.1 Aug 10 23:00:38.936896 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:00:38.936896 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:00:38.936896 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:00:38.936896 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 23:00:38.936896 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:00:38.936896 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:00:38.936896 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:00:38.936896 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:00:38.936896 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9Dfy3xy8R2ATQNzdVgtjes_wXZj0k2pZt-bxjEPLk5B6P5Wut-mxZ23U5UJQnTeAIOV5L1s_zZb97gm4jJhXPY7TW5iOeiiT0vd1xYX5sPGvKOVk_KBA_XgumKQ1wPzb99WC7kqJodwoG7NWo0WUW2WC6DrLsoKw4gcTxuP4K0GMWjc Aug 10 23:00:38.936896 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:00:38.936896 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:00:38.936896 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:00:38.936896 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:00:38.936896 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:00:38.936896 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:00:38.936896 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: eae334ad72ba421797a6d836edcbab0c Aug 10 23:00:38.936896 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-VolumesAdminNegativeTest-1191651426 Aug 10 23:00:38.936896 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:00:38.936896 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:00:38.938434 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/eae334ad72ba421797a6d836edcbab0c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/eae334ad72ba421797a6d836edcbab0c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/eae334ad72ba421797a6d836edcbab0c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_eae334ad72ba421797a6d836edcbab0c", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:00:38.938434 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-VolumesAdminNegativeTest-1191651426 Aug 10 23:00:38.938434 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: eae334ad72ba421797a6d836edcbab0c Aug 10 23:00:38.938434 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1191651426 Aug 10 23:00:38.938434 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-VolumesAdminNegativeTest-1191651426-project Aug 10 23:00:38.938434 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:00:38.938434 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:00:38.938434 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: 6e437f9eb7254dc98e2839656c053f2d Aug 10 23:00:38.938434 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-VolumesAdminNegativeTest-1191651426-project Aug 10 23:00:38.938434 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:00:38.938434 n-d-850468-14 devstack@n-api.service[122632]: exception: Instance e0617f11-199e-41b8-a853-27eb2be0a8db could not be found. Aug 10 23:00:38.938434 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': 'e0617f11-199e-41b8-a853-27eb2be0a8db'} Aug 10 23:00:38.939409 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:00:38.939409 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:00:38.939409 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:00:38.939409 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:00:38.939409 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:00:38.939409 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:00:38.939409 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:00:38.939409 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:00:38.939409 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:00:38.939409 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:00:38.939409 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e0617f11-199e-41b8-a853-27eb2be0a8db could not be found. Aug 10 23:00:38.939409 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:00:38.939409 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:00:38.939409 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:00:38.939409 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:00:38.939409 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:00:38.939409 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:00:38.939409 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:00:38.939409 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:00:38.939409 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:00:38.941193 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:00:38.941193 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:00:38.941193 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:00:38.941193 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:00:38.941193 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:00:38.941193 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:00:38.941193 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:00:38.941193 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e0617f11-199e-41b8-a853-27eb2be0a8db could not be found. Aug 10 23:00:38.941193 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:00:38.941193 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:00:38.941193 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:00:38.941193 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:00:38.941193 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:00:38.941193 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:00:38.941193 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:00:38.941193 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:00:38.941193 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e0617f11-199e-41b8-a853-27eb2be0a8db could not be found. Aug 10 23:00:38.941193 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:00:38.942326 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-1c9c00e4-9e63-4908-97d1-56ecdb96cdf6 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Returning 404 to user: Instance e0617f11-199e-41b8-a853-27eb2be0a8db could not be found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:00:38.942326 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-1c9c00e4-9e63-4908-97d1-56ecdb96cdf6 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] 10.222.0.58 "GET /compute/v2.1/servers/e0617f11-199e-41b8-a853-27eb2be0a8db" status: 404 len: 111 microversion: 2.1 time: 0.039496 Aug 10 23:00:38.954560 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 572/1162] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:00:38 2022] GET /compute/v2.1/servers/e0617f11-199e-41b8-a853-27eb2be0a8db => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:00:39.445149 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-03f72b54-17da-4473-8f67-dadbc437d40c tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:39.446197 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-03f72b54-17da-4473-8f67-dadbc437d40c tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] [instance: 99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:00:39.450173 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=22 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:00:39.475471 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-03f72b54-17da-4473-8f67-dadbc437d40c tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:39.476667 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-03f72b54-17da-4473-8f67-dadbc437d40c tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:39.484695 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-e7937dda-fadf-4651-87f3-c8903c8cfc07 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6d9806b6724e5aaf8c69be8e70d4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307ab95daa034afbb31f90626885072b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:00:39.490862 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-03f72b54-17da-4473-8f67-dadbc437d40c tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:39.492878 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-e7937dda-fadf-4651-87f3-c8903c8cfc07 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] 10.222.0.58 "GET /compute/v2.1/servers/2a68f86c-37de-4207-aa43-6a1350342a56" status: 200 len: 1308 microversion: 2.1 time: 0.831125 Aug 10 23:00:39.494432 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-03f72b54-17da-4473-8f67-dadbc437d40c tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:39.495948 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-03f72b54-17da-4473-8f67-dadbc437d40c tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:39.502830 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-03f72b54-17da-4473-8f67-dadbc437d40c tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:39.510591 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 591/1163] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:00:38 2022] GET /compute/v2.1/servers/2a68f86c-37de-4207-aa43-6a1350342a56 => generated 1308 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:00:39.666099 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-7ff03603-ecfc-4912-929f-2d02e1ee19b1 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:39.666730 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-7ff03603-ecfc-4912-929f-2d02e1ee19b1 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 0dabc2bf-08ff-45b5-a791-34d655349eae] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:00:39.680102 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=4 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:00:39.681565 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=22 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:00:39.683850 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7ff03603-ecfc-4912-929f-2d02e1ee19b1 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:39.684349 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7ff03603-ecfc-4912-929f-2d02e1ee19b1 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:39.684836 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7ff03603-ecfc-4912-929f-2d02e1ee19b1 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:39.685815 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7ff03603-ecfc-4912-929f-2d02e1ee19b1 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:39.686276 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7ff03603-ecfc-4912-929f-2d02e1ee19b1 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:39.686704 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7ff03603-ecfc-4912-929f-2d02e1ee19b1 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:40.094190 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-03f72b54-17da-4473-8f67-dadbc437d40c tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:00:40.134471 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-03f72b54-17da-4473-8f67-dadbc437d40c tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:00:40.151240 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-03f72b54-17da-4473-8f67-dadbc437d40c tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:00:40.157885 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-03f72b54-17da-4473-8f67-dadbc437d40c tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] 10.222.0.58 "GET /compute/v2.1/servers/99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0" status: 200 len: 1804 microversion: 2.25 time: 0.716415 Aug 10 23:00:40.159164 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 573/1164] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:00:39 2022] GET /compute/v2.1/servers/99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0 => generated 1804 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 23:00:40.189475 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-7c80fe67-00d3-481b-89b2-7186f61d6cf2 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:40.191443 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-7c80fe67-00d3-481b-89b2-7186f61d6cf2 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] [instance: a0995db2-2ae0-4216-996a-39a03357c1eb] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:00:40.214704 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7c80fe67-00d3-481b-89b2-7186f61d6cf2 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:40.215682 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7c80fe67-00d3-481b-89b2-7186f61d6cf2 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:40.216527 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7c80fe67-00d3-481b-89b2-7186f61d6cf2 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:40.226020 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7c80fe67-00d3-481b-89b2-7186f61d6cf2 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:40.227087 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7c80fe67-00d3-481b-89b2-7186f61d6cf2 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:40.227883 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7c80fe67-00d3-481b-89b2-7186f61d6cf2 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:40.325368 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=4 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:00:40.890695 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-7ff03603-ecfc-4912-929f-2d02e1ee19b1 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:00:40.927963 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-7ff03603-ecfc-4912-929f-2d02e1ee19b1 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/0dabc2bf-08ff-45b5-a791-34d655349eae" status: 200 len: 1312 microversion: 2.1 time: 1.265717 Aug 10 23:00:40.932381 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 592/1165] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:00:39 2022] GET /compute/v2.1/servers/0dabc2bf-08ff-45b5-a791-34d655349eae => generated 1312 bytes in 1271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:00:40.938109 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-9db149b8-c3ba-4921-8e4a-ee7c7acd32e6 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Calling method '.version_select at 0x7f847d371af0>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:41.049292 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-9db149b8-c3ba-4921-8e4a-ee7c7acd32e6 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] 10.222.0.58 "GET /compute/v2.1/images/3d48cfd3-2ced-4117-a393-83f358ed89c6" status: 200 len: 1453 microversion: 2.1 time: 0.114809 Aug 10 23:00:41.057801 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 593/1166] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 10 23:00:40 2022] GET /compute/v2.1/images/3d48cfd3-2ced-4117-a393-83f358ed89c6 => generated 1453 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:00:41.064904 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-8eb5a850-24dc-49df-8688-d656d13c9c9b tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Calling method '.version_select at 0x7f847d3c00d0>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:41.069427 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8eb5a850-24dc-49df-8688-d656d13c9c9b tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:41.070847 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8eb5a850-24dc-49df-8688-d656d13c9c9b tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:41.071542 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8eb5a850-24dc-49df-8688-d656d13c9c9b tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:41.099254 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-7c80fe67-00d3-481b-89b2-7186f61d6cf2 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '417d4eaaeb1c4df78745496ececb3e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27e6ee9495a438b8450a4ef0d62cbcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:00:41.108986 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-8eb5a850-24dc-49df-8688-d656d13c9c9b tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] 10.222.0.58 "GET /compute/v2.1/os-migrations" status: 200 len: 3657 microversion: 2.25 time: 0.049577 Aug 10 23:00:41.110776 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 594/1167] 10.222.0.58 () {60 vars in 1184 bytes} [Wed Aug 10 23:00:41 2022] GET /compute/v2.1/os-migrations => generated 3657 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:00:41.110949 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-7c80fe67-00d3-481b-89b2-7186f61d6cf2 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] 10.222.0.58 "GET /compute/v2.1/servers/a0995db2-2ae0-4216-996a-39a03357c1eb" status: 200 len: 1319 microversion: 2.1 time: 0.950234 Aug 10 23:00:41.114389 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 574/1168] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:00:40 2022] GET /compute/v2.1/servers/a0995db2-2ae0-4216-996a-39a03357c1eb => generated 1319 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:00:41.130321 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-cdedaead-04c4-4824-8e31-89c932f0130a tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:41.130984 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-cdedaead-04c4-4824-8e31-89c932f0130a tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] [instance: 99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:00:41.146226 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-33ba0e83-ebe4-4a55-867e-b7fb3024cc97 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:41.147954 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-33ba0e83-ebe4-4a55-867e-b7fb3024cc97 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] [instance: 2a68f86c-37de-4207-aa43-6a1350342a56] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:00:41.154753 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-33ba0e83-ebe4-4a55-867e-b7fb3024cc97 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:41.155686 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-33ba0e83-ebe4-4a55-867e-b7fb3024cc97 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:41.157274 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-33ba0e83-ebe4-4a55-867e-b7fb3024cc97 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:41.158348 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-33ba0e83-ebe4-4a55-867e-b7fb3024cc97 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:41.159640 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-33ba0e83-ebe4-4a55-867e-b7fb3024cc97 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:41.160698 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cdedaead-04c4-4824-8e31-89c932f0130a tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:41.161299 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-33ba0e83-ebe4-4a55-867e-b7fb3024cc97 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:41.161644 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cdedaead-04c4-4824-8e31-89c932f0130a tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:41.162260 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cdedaead-04c4-4824-8e31-89c932f0130a tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:41.163094 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cdedaead-04c4-4824-8e31-89c932f0130a tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:41.163485 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cdedaead-04c4-4824-8e31-89c932f0130a tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:41.163915 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cdedaead-04c4-4824-8e31-89c932f0130a tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:41.747228 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.objects.instance [None req-cdedaead-04c4-4824-8e31-89c932f0130a tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Lazy-loading 'services' on Instance uuid 99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0 {{(pid=122632) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:00:41.775214 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-cdedaead-04c4-4824-8e31-89c932f0130a tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0" status: 200 len: 2425 microversion: 2.25 time: 0.651396 Aug 10 23:00:41.775811 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 575/1169] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:00:41 2022] GET /compute/v2.1/servers/99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0 => generated 2425 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:00:41.796134 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-e4c01575-3a82-4685-9b4f-708cdbb816ea req-250e94b1-ac41-42c5-8c79-332edba17976 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0995db2-2ae0-4216-996a-39a03357c1eb", "tag": "25ce4b44-8eb9-433e-96ad-43b05662b91c"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:00:41.811145 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-e4c01575-3a82-4685-9b4f-708cdbb816ea req-250e94b1-ac41-42c5-8c79-332edba17976 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:41.811661 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-e4c01575-3a82-4685-9b4f-708cdbb816ea req-250e94b1-ac41-42c5-8c79-332edba17976 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:41.812473 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-e4c01575-3a82-4685-9b4f-708cdbb816ea req-250e94b1-ac41-42c5-8c79-332edba17976 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:41.826001 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-e4c01575-3a82-4685-9b4f-708cdbb816ea req-250e94b1-ac41-42c5-8c79-332edba17976 service nova] Creating event network-changed:25ce4b44-8eb9-433e-96ad-43b05662b91c for instance a0995db2-2ae0-4216-996a-39a03357c1eb on n-h2-850468-14 Aug 10 23:00:41.832803 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-e4c01575-3a82-4685-9b4f-708cdbb816ea req-250e94b1-ac41-42c5-8c79-332edba17976 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039959 Aug 10 23:00:41.836568 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 576/1170] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:00:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:00:41.841941 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-f8b9766a-abeb-45ab-a4e3-f0d670425f5e tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:41.842827 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-f8b9766a-abeb-45ab-a4e3-f0d670425f5e tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] [instance: 99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:00:41.849818 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f8b9766a-abeb-45ab-a4e3-f0d670425f5e tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:41.850325 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f8b9766a-abeb-45ab-a4e3-f0d670425f5e tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:41.850670 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f8b9766a-abeb-45ab-a4e3-f0d670425f5e tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:41.851408 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f8b9766a-abeb-45ab-a4e3-f0d670425f5e tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:41.851864 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f8b9766a-abeb-45ab-a4e3-f0d670425f5e tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:41.852292 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f8b9766a-abeb-45ab-a4e3-f0d670425f5e tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:41.858381 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=100 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:00:42.160556 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-33ba0e83-ebe4-4a55-867e-b7fb3024cc97 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6d9806b6724e5aaf8c69be8e70d4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307ab95daa034afbb31f90626885072b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:00:42.179322 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-33ba0e83-ebe4-4a55-867e-b7fb3024cc97 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] 10.222.0.58 "GET /compute/v2.1/servers/2a68f86c-37de-4207-aa43-6a1350342a56" status: 200 len: 1308 microversion: 2.1 time: 1.066967 Aug 10 23:00:42.183451 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 595/1171] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:00:41 2022] GET /compute/v2.1/servers/2a68f86c-37de-4207-aa43-6a1350342a56 => generated 1308 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:00:42.217818 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-6320d350-5bc7-4f33-a2af-aea2c291ce08 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:42.222908 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-6320d350-5bc7-4f33-a2af-aea2c291ce08 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 0dabc2bf-08ff-45b5-a791-34d655349eae] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:00:42.238055 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6320d350-5bc7-4f33-a2af-aea2c291ce08 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:42.243407 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6320d350-5bc7-4f33-a2af-aea2c291ce08 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:42.245645 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6320d350-5bc7-4f33-a2af-aea2c291ce08 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:42.253631 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6320d350-5bc7-4f33-a2af-aea2c291ce08 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:42.254513 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6320d350-5bc7-4f33-a2af-aea2c291ce08 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:42.255406 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6320d350-5bc7-4f33-a2af-aea2c291ce08 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:42.488453 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.objects.instance [None req-f8b9766a-abeb-45ab-a4e3-f0d670425f5e tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Lazy-loading 'services' on Instance uuid 99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0 {{(pid=122632) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:00:42.548931 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-f8b9766a-abeb-45ab-a4e3-f0d670425f5e tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0" status: 200 len: 2425 microversion: 2.25 time: 0.710932 Aug 10 23:00:42.568175 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 577/1172] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:00:41 2022] GET /compute/v2.1/servers/99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0 => generated 2425 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:00:42.592679 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-625367cd-f5e1-4fe2-9181-8218bced6035 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Calling method '.version_select at 0x7f847d1f3670>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:42.681372 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-625367cd-f5e1-4fe2-9181-8218bced6035 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] 10.222.0.58 "GET /compute/v2.1/images/3d48cfd3-2ced-4117-a393-83f358ed89c6" status: 200 len: 1453 microversion: 2.1 time: 0.111000 Aug 10 23:00:42.682491 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 578/1173] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 10 23:00:42 2022] GET /compute/v2.1/images/3d48cfd3-2ced-4117-a393-83f358ed89c6 => generated 1453 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:00:42.696191 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-bdba07cf-932a-443a-bd55-e8a3aef15bcc tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:42.697224 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-bdba07cf-932a-443a-bd55-e8a3aef15bcc tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] [instance: 8e91f1ac-f79d-4ab0-aa13-ea32b0e74888] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:00:42.714148 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bdba07cf-932a-443a-bd55-e8a3aef15bcc tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:42.716203 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bdba07cf-932a-443a-bd55-e8a3aef15bcc tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:42.720325 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bdba07cf-932a-443a-bd55-e8a3aef15bcc tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:42.721440 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bdba07cf-932a-443a-bd55-e8a3aef15bcc tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:42.722248 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bdba07cf-932a-443a-bd55-e8a3aef15bcc tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:42.723090 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bdba07cf-932a-443a-bd55-e8a3aef15bcc tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:43.046776 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-bdba07cf-932a-443a-bd55-e8a3aef15bcc tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/8e91f1ac-f79d-4ab0-aa13-ea32b0e74888" status: 200 len: 1815 microversion: 2.1 time: 0.362400 Aug 10 23:00:43.050038 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 579/1174] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:00:42 2022] GET /compute/v2.1/servers/8e91f1ac-f79d-4ab0-aa13-ea32b0e74888 => generated 1815 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:00:43.072287 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-41e6f4c7-fc77-45b4-8175-f1b0be20fc1e tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:43.073542 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-41e6f4c7-fc77-45b4-8175-f1b0be20fc1e tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] [instance: a0995db2-2ae0-4216-996a-39a03357c1eb] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:00:43.084576 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-41e6f4c7-fc77-45b4-8175-f1b0be20fc1e tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:43.085673 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-41e6f4c7-fc77-45b4-8175-f1b0be20fc1e tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:43.100970 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-41e6f4c7-fc77-45b4-8175-f1b0be20fc1e tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:43.102091 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-41e6f4c7-fc77-45b4-8175-f1b0be20fc1e tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:43.102765 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-41e6f4c7-fc77-45b4-8175-f1b0be20fc1e tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:43.103437 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-41e6f4c7-fc77-45b4-8175-f1b0be20fc1e tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:43.183839 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-6320d350-5bc7-4f33-a2af-aea2c291ce08 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:00:43.191990 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-6320d350-5bc7-4f33-a2af-aea2c291ce08 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/0dabc2bf-08ff-45b5-a791-34d655349eae" status: 200 len: 1312 microversion: 2.1 time: 0.991401 Aug 10 23:00:43.192581 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 596/1175] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:00:42 2022] GET /compute/v2.1/servers/0dabc2bf-08ff-45b5-a791-34d655349eae => generated 1312 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:00:43.207809 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-82796e96-608e-4588-a5de-8e7b371bd4c6 req-b7ef963c-f7a6-46f6-a294-917c8122fedb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0dabc2bf-08ff-45b5-a791-34d655349eae", "name": "network-vif-plugged", "status": "completed", "tag": "8dba1a8f-5d05-48a3-afda-7507568fcb46"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:00:43.228156 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-82796e96-608e-4588-a5de-8e7b371bd4c6 req-b7ef963c-f7a6-46f6-a294-917c8122fedb service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:43.228983 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-82796e96-608e-4588-a5de-8e7b371bd4c6 req-b7ef963c-f7a6-46f6-a294-917c8122fedb service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:43.229611 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-82796e96-608e-4588-a5de-8e7b371bd4c6 req-b7ef963c-f7a6-46f6-a294-917c8122fedb service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:43.260608 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-82796e96-608e-4588-a5de-8e7b371bd4c6 req-b7ef963c-f7a6-46f6-a294-917c8122fedb service nova] Creating event network-vif-plugged:8dba1a8f-5d05-48a3-afda-7507568fcb46 for instance 0dabc2bf-08ff-45b5-a791-34d655349eae on n-h2-850468-14 Aug 10 23:00:43.282513 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-82796e96-608e-4588-a5de-8e7b371bd4c6 req-b7ef963c-f7a6-46f6-a294-917c8122fedb service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079046 Aug 10 23:00:43.287648 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 597/1176] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:00:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:00:43.311772 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-a0145917-6440-4703-ae85-058a3f40b801 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:43.332714 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-a0145917-6440-4703-ae85-058a3f40b801 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] [instance: 99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:00:43.339156 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-41e6f4c7-fc77-45b4-8175-f1b0be20fc1e tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '417d4eaaeb1c4df78745496ececb3e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27e6ee9495a438b8450a4ef0d62cbcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:00:43.347920 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-41e6f4c7-fc77-45b4-8175-f1b0be20fc1e tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] 10.222.0.58 "GET /compute/v2.1/servers/a0995db2-2ae0-4216-996a-39a03357c1eb" status: 200 len: 1319 microversion: 2.1 time: 0.294498 Aug 10 23:00:43.348918 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a0145917-6440-4703-ae85-058a3f40b801 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:43.349500 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a0145917-6440-4703-ae85-058a3f40b801 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:43.350248 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 580/1177] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:00:43 2022] GET /compute/v2.1/servers/a0995db2-2ae0-4216-996a-39a03357c1eb => generated 1319 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:00:43.356082 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-1d3fae7b-76cb-495d-a753-d67ac12e032e req-001c9323-9cf2-4f6a-94f0-7481dd11d868 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a68f86c-37de-4207-aa43-6a1350342a56", "tag": "c4194225-7832-4162-ab1c-9691d11ab1ae"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:00:43.356988 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a0145917-6440-4703-ae85-058a3f40b801 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:43.360589 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a0145917-6440-4703-ae85-058a3f40b801 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:43.366120 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a0145917-6440-4703-ae85-058a3f40b801 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:43.366769 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a0145917-6440-4703-ae85-058a3f40b801 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:43.384875 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-1d3fae7b-76cb-495d-a753-d67ac12e032e req-001c9323-9cf2-4f6a-94f0-7481dd11d868 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:43.399397 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-1d3fae7b-76cb-495d-a753-d67ac12e032e req-001c9323-9cf2-4f6a-94f0-7481dd11d868 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:43.399991 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-1d3fae7b-76cb-495d-a753-d67ac12e032e req-001c9323-9cf2-4f6a-94f0-7481dd11d868 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:43.428998 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-1d3fae7b-76cb-495d-a753-d67ac12e032e req-001c9323-9cf2-4f6a-94f0-7481dd11d868 service nova] Creating event network-changed:c4194225-7832-4162-ab1c-9691d11ab1ae for instance 2a68f86c-37de-4207-aa43-6a1350342a56 on n-h2-850468-14 Aug 10 23:00:43.441395 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-1d3fae7b-76cb-495d-a753-d67ac12e032e req-001c9323-9cf2-4f6a-94f0-7481dd11d868 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089662 Aug 10 23:00:43.449072 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 581/1178] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:00:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:00:43.454701 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-79b539c2-43a7-4300-8106-3dd8e6d6b61a tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:43.457713 n-d-850468-14 devstack@n-api.service[122632]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 23:00:43.457713 n-d-850468-14 devstack@n-api.service[122632]: warnings.warn(msg) Aug 10 23:00:43.460786 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-79b539c2-43a7-4300-8106-3dd8e6d6b61a tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:43.461402 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-79b539c2-43a7-4300-8106-3dd8e6d6b61a tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:43.461952 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-79b539c2-43a7-4300-8106-3dd8e6d6b61a tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:43.462848 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-79b539c2-43a7-4300-8106-3dd8e6d6b61a tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:43.463508 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-79b539c2-43a7-4300-8106-3dd8e6d6b61a tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:43.464104 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-79b539c2-43a7-4300-8106-3dd8e6d6b61a tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:43.499199 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-79b539c2-43a7-4300-8106-3dd8e6d6b61a tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] 10.222.0.58 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.048681 Aug 10 23:00:43.509567 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 582/1179] 10.222.0.58 () {58 vars in 1176 bytes} [Wed Aug 10 23:00:43 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:00:43.524232 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-3ea37e11-5580-42db-9e82-98652d95b130 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:43.525223 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-3ea37e11-5580-42db-9e82-98652d95b130 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] [instance: 2a68f86c-37de-4207-aa43-6a1350342a56] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:00:43.536108 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3ea37e11-5580-42db-9e82-98652d95b130 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:43.536805 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3ea37e11-5580-42db-9e82-98652d95b130 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:43.537417 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3ea37e11-5580-42db-9e82-98652d95b130 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:43.546026 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3ea37e11-5580-42db-9e82-98652d95b130 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:43.548078 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3ea37e11-5580-42db-9e82-98652d95b130 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:43.548732 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3ea37e11-5580-42db-9e82-98652d95b130 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:43.579254 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.objects.instance [None req-a0145917-6440-4703-ae85-058a3f40b801 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lazy-loading 'services' on Instance uuid 99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0 {{(pid=122633) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:00:43.796733 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-a0145917-6440-4703-ae85-058a3f40b801 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] 10.222.0.58 "DELETE /compute/v2.1/servers/99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0/os-volume_attachments/33d528e4-0ee2-4b94-90c3-69929299119e" status: 202 len: 0 microversion: 2.25 time: 0.500516 Aug 10 23:00:43.801091 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 598/1180] 10.222.0.58 () {60 vars in 1457 bytes} [Wed Aug 10 23:00:43 2022] DELETE /compute/v2.1/servers/99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0/os-volume_attachments/33d528e4-0ee2-4b94-90c3-69929299119e => generated 0 bytes in 506 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:00:43.806599 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-9310eb51-5c70-4f24-b943-a32e44348cd9 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Calling method '.version_select at 0x7f847d412f70>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:43.887383 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-9310eb51-5c70-4f24-b943-a32e44348cd9 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] 10.222.0.58 "GET /compute/v2.1/images/3d48cfd3-2ced-4117-a393-83f358ed89c6" status: 200 len: 1453 microversion: 2.1 time: 0.084747 Aug 10 23:00:43.891939 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 599/1181] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 10 23:00:43 2022] GET /compute/v2.1/images/3d48cfd3-2ced-4117-a393-83f358ed89c6 => generated 1453 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:00:43.908626 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-98a11ffd-0a6c-4498-ab5a-441b10afe8b5 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:43.913775 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-98a11ffd-0a6c-4498-ab5a-441b10afe8b5 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] [instance: 99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:00:43.932397 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-98a11ffd-0a6c-4498-ab5a-441b10afe8b5 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:43.944644 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-98a11ffd-0a6c-4498-ab5a-441b10afe8b5 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:43.945578 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-98a11ffd-0a6c-4498-ab5a-441b10afe8b5 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:43.946539 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-98a11ffd-0a6c-4498-ab5a-441b10afe8b5 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:43.947231 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-98a11ffd-0a6c-4498-ab5a-441b10afe8b5 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:43.949829 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-98a11ffd-0a6c-4498-ab5a-441b10afe8b5 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:44.028422 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-98a11ffd-0a6c-4498-ab5a-441b10afe8b5 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] 10.222.0.58 "GET /compute/v2.1/servers/99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.131410 Aug 10 23:00:44.029361 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 600/1182] 10.222.0.58 () {60 vars in 1343 bytes} [Wed Aug 10 23:00:43 2022] GET /compute/v2.1/servers/99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0/os-volume_attachments => generated 197 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 23:00:44.153505 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-3ea37e11-5580-42db-9e82-98652d95b130 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6d9806b6724e5aaf8c69be8e70d4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307ab95daa034afbb31f90626885072b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:00:44.165693 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-3ea37e11-5580-42db-9e82-98652d95b130 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] 10.222.0.58 "GET /compute/v2.1/servers/2a68f86c-37de-4207-aa43-6a1350342a56" status: 200 len: 1308 microversion: 2.1 time: 0.654670 Aug 10 23:00:44.185537 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 583/1183] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:00:43 2022] GET /compute/v2.1/servers/2a68f86c-37de-4207-aa43-6a1350342a56 => generated 1308 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:00:44.214519 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-7a5be9ac-5b0f-488c-a8fd-d578676f0769 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:44.215986 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-7a5be9ac-5b0f-488c-a8fd-d578676f0769 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 0dabc2bf-08ff-45b5-a791-34d655349eae] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:00:44.241041 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7a5be9ac-5b0f-488c-a8fd-d578676f0769 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:44.241844 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7a5be9ac-5b0f-488c-a8fd-d578676f0769 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:44.242446 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7a5be9ac-5b0f-488c-a8fd-d578676f0769 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:44.243492 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7a5be9ac-5b0f-488c-a8fd-d578676f0769 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:44.245703 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7a5be9ac-5b0f-488c-a8fd-d578676f0769 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:44.251593 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7a5be9ac-5b0f-488c-a8fd-d578676f0769 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:44.373982 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-9a8a084b-3b9d-4e6f-ae07-acff532b8b1a tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:44.374867 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-9a8a084b-3b9d-4e6f-ae07-acff532b8b1a tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] [instance: a0995db2-2ae0-4216-996a-39a03357c1eb] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:00:44.393497 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9a8a084b-3b9d-4e6f-ae07-acff532b8b1a tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:44.394204 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9a8a084b-3b9d-4e6f-ae07-acff532b8b1a tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:44.398925 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9a8a084b-3b9d-4e6f-ae07-acff532b8b1a tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:44.403365 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9a8a084b-3b9d-4e6f-ae07-acff532b8b1a tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:44.403880 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9a8a084b-3b9d-4e6f-ae07-acff532b8b1a tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:44.404332 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9a8a084b-3b9d-4e6f-ae07-acff532b8b1a tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:45.203052 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-7a5be9ac-5b0f-488c-a8fd-d578676f0769 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:00:45.226001 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-7a5be9ac-5b0f-488c-a8fd-d578676f0769 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/0dabc2bf-08ff-45b5-a791-34d655349eae" status: 200 len: 1312 microversion: 2.1 time: 1.015894 Aug 10 23:00:45.246423 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 601/1184] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:00:44 2022] GET /compute/v2.1/servers/0dabc2bf-08ff-45b5-a791-34d655349eae => generated 1312 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:00:45.253198 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-8d0f0d7d-de29-45da-bc12-b9e51b4cc86b tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Calling method '.version_select at 0x7f847d3a7040>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:45.376718 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-9a8a084b-3b9d-4e6f-ae07-acff532b8b1a tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '417d4eaaeb1c4df78745496ececb3e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27e6ee9495a438b8450a4ef0d62cbcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:00:45.381094 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-8d0f0d7d-de29-45da-bc12-b9e51b4cc86b tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] 10.222.0.58 "GET /compute/v2.1/images/3d48cfd3-2ced-4117-a393-83f358ed89c6" status: 200 len: 1453 microversion: 2.1 time: 0.133833 Aug 10 23:00:45.394141 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-9a8a084b-3b9d-4e6f-ae07-acff532b8b1a tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] 10.222.0.58 "GET /compute/v2.1/servers/a0995db2-2ae0-4216-996a-39a03357c1eb" status: 200 len: 1319 microversion: 2.1 time: 1.024855 Aug 10 23:00:45.394817 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 602/1185] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 10 23:00:45 2022] GET /compute/v2.1/images/3d48cfd3-2ced-4117-a393-83f358ed89c6 => generated 1453 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:00:45.404543 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-826b9a10-a5c7-4dde-af39-b7bd28b0706a tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:45.422816 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 584/1186] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:00:44 2022] GET /compute/v2.1/servers/a0995db2-2ae0-4216-996a-39a03357c1eb => generated 1319 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:00:45.425341 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-1da6085e-6de4-4bbd-b425-860edb3b25a4 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:45.425605 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-826b9a10-a5c7-4dde-af39-b7bd28b0706a tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] [instance: 99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:00:45.426683 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-1da6085e-6de4-4bbd-b425-860edb3b25a4 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] [instance: 2a68f86c-37de-4207-aa43-6a1350342a56] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:00:45.444357 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1da6085e-6de4-4bbd-b425-860edb3b25a4 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:45.447037 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1da6085e-6de4-4bbd-b425-860edb3b25a4 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:45.447739 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1da6085e-6de4-4bbd-b425-860edb3b25a4 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:45.448516 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-826b9a10-a5c7-4dde-af39-b7bd28b0706a tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:45.449081 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-826b9a10-a5c7-4dde-af39-b7bd28b0706a tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:45.449545 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-826b9a10-a5c7-4dde-af39-b7bd28b0706a tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:45.450213 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1da6085e-6de4-4bbd-b425-860edb3b25a4 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:45.452135 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-826b9a10-a5c7-4dde-af39-b7bd28b0706a tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:45.452620 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-826b9a10-a5c7-4dde-af39-b7bd28b0706a tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:45.453060 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-826b9a10-a5c7-4dde-af39-b7bd28b0706a tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:45.453928 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1da6085e-6de4-4bbd-b425-860edb3b25a4 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:45.454600 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1da6085e-6de4-4bbd-b425-860edb3b25a4 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:45.610269 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-826b9a10-a5c7-4dde-af39-b7bd28b0706a tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] 10.222.0.58 "GET /compute/v2.1/servers/99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.213427 Aug 10 23:00:45.627985 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 603/1187] 10.222.0.58 () {60 vars in 1343 bytes} [Wed Aug 10 23:00:45 2022] GET /compute/v2.1/servers/99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0/os-volume_attachments => generated 197 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 23:00:45.931989 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c2c4334a-1bf6-4d1a-85ce-6c44dcd862ab tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:45.932495 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-c2c4334a-1bf6-4d1a-85ce-6c44dcd862ab tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] [instance: 3553ba91-ca7b-44d9-944a-1540fa047cb6] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:00:45.950479 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c2c4334a-1bf6-4d1a-85ce-6c44dcd862ab tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:45.960515 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c2c4334a-1bf6-4d1a-85ce-6c44dcd862ab tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:45.961095 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c2c4334a-1bf6-4d1a-85ce-6c44dcd862ab tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:45.961875 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c2c4334a-1bf6-4d1a-85ce-6c44dcd862ab tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:45.970568 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c2c4334a-1bf6-4d1a-85ce-6c44dcd862ab tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:45.971207 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c2c4334a-1bf6-4d1a-85ce-6c44dcd862ab tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:45.980155 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-1da6085e-6de4-4bbd-b425-860edb3b25a4 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6d9806b6724e5aaf8c69be8e70d4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307ab95daa034afbb31f90626885072b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:00:45.991981 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-1da6085e-6de4-4bbd-b425-860edb3b25a4 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] 10.222.0.58 "GET /compute/v2.1/servers/2a68f86c-37de-4207-aa43-6a1350342a56" status: 200 len: 1308 microversion: 2.1 time: 0.579279 Aug 10 23:00:45.995864 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 585/1188] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:00:45 2022] GET /compute/v2.1/servers/2a68f86c-37de-4207-aa43-6a1350342a56 => generated 1308 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:00:46.133532 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-c2c4334a-1bf6-4d1a-85ce-6c44dcd862ab tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] [instance: 3553ba91-ca7b-44d9-944a-1540fa047cb6] Going to try to terminate instance {{(pid=122633) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:00:46.254521 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-b120ccea-3c7a-4a39-bef8-6fa6c900c63b tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:46.255234 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-b120ccea-3c7a-4a39-bef8-6fa6c900c63b tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 0dabc2bf-08ff-45b5-a791-34d655349eae] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:00:46.275791 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b120ccea-3c7a-4a39-bef8-6fa6c900c63b tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:46.277113 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b120ccea-3c7a-4a39-bef8-6fa6c900c63b tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:46.280050 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b120ccea-3c7a-4a39-bef8-6fa6c900c63b tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:46.285880 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b120ccea-3c7a-4a39-bef8-6fa6c900c63b tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:46.286581 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b120ccea-3c7a-4a39-bef8-6fa6c900c63b tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:46.290516 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b120ccea-3c7a-4a39-bef8-6fa6c900c63b tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:46.477056 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-c2c4334a-1bf6-4d1a-85ce-6c44dcd862ab tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] 10.222.0.58 "DELETE /compute/v2.1/servers/3553ba91-ca7b-44d9-944a-1540fa047cb6" status: 204 len: 0 microversion: 2.1 time: 0.547580 Aug 10 23:00:46.478840 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 604/1189] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:00:45 2022] DELETE /compute/v2.1/servers/3553ba91-ca7b-44d9-944a-1540fa047cb6 => generated 0 bytes in 551 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 10 23:00:46.490517 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-7783d0f3-d7e5-410e-bc18-c4beb0cf2a20 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Calling method '.version_select at 0x7f847d4129d0>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:46.584316 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-7783d0f3-d7e5-410e-bc18-c4beb0cf2a20 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] 10.222.0.58 "GET /compute/v2.1/images/3d48cfd3-2ced-4117-a393-83f358ed89c6" status: 200 len: 1453 microversion: 2.1 time: 0.103648 Aug 10 23:00:46.585414 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 605/1190] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 10 23:00:46 2022] GET /compute/v2.1/images/3d48cfd3-2ced-4117-a393-83f358ed89c6 => generated 1453 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:00:46.603896 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-0c92c4a4-1887-4151-a1ce-8be8bfd6b922 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:46.613853 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-0c92c4a4-1887-4151-a1ce-8be8bfd6b922 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] [instance: a0995db2-2ae0-4216-996a-39a03357c1eb] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:00:46.637963 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0c92c4a4-1887-4151-a1ce-8be8bfd6b922 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:46.661234 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0c92c4a4-1887-4151-a1ce-8be8bfd6b922 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:46.662219 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0c92c4a4-1887-4151-a1ce-8be8bfd6b922 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:46.668612 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0c92c4a4-1887-4151-a1ce-8be8bfd6b922 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:46.670747 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0c92c4a4-1887-4151-a1ce-8be8bfd6b922 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:46.671506 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0c92c4a4-1887-4151-a1ce-8be8bfd6b922 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:46.998241 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-b120ccea-3c7a-4a39-bef8-6fa6c900c63b tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:00:47.039473 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-b120ccea-3c7a-4a39-bef8-6fa6c900c63b tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/0dabc2bf-08ff-45b5-a791-34d655349eae" status: 200 len: 1462 microversion: 2.1 time: 0.777811 Aug 10 23:00:47.040154 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 586/1191] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:00:46 2022] GET /compute/v2.1/servers/0dabc2bf-08ff-45b5-a791-34d655349eae => generated 1462 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:00:47.076433 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-14902c61-2795-4b58-8f55-4a6eb341c1a1 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:47.081687 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-14902c61-2795-4b58-8f55-4a6eb341c1a1 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] [instance: 3553ba91-ca7b-44d9-944a-1540fa047cb6] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:00:47.102166 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-14902c61-2795-4b58-8f55-4a6eb341c1a1 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:47.103604 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-14902c61-2795-4b58-8f55-4a6eb341c1a1 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:47.104849 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-14902c61-2795-4b58-8f55-4a6eb341c1a1 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:47.107245 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-14902c61-2795-4b58-8f55-4a6eb341c1a1 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:47.108898 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-14902c61-2795-4b58-8f55-4a6eb341c1a1 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:47.109774 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-14902c61-2795-4b58-8f55-4a6eb341c1a1 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:47.721136 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-14902c61-2795-4b58-8f55-4a6eb341c1a1 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e437f9eb7254dc98e2839656c053f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eae334ad72ba421797a6d836edcbab0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:00:47.738012 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-14902c61-2795-4b58-8f55-4a6eb341c1a1 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] 10.222.0.58 "GET /compute/v2.1/servers/3553ba91-ca7b-44d9-944a-1540fa047cb6" status: 200 len: 1681 microversion: 2.1 time: 0.692245 Aug 10 23:00:47.750812 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 587/1192] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:00:47 2022] GET /compute/v2.1/servers/3553ba91-ca7b-44d9-944a-1540fa047cb6 => generated 1681 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:00:47.750812 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-1343e230-31d3-428a-8a17-461bc6618282 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:47.759081 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-1343e230-31d3-428a-8a17-461bc6618282 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] [instance: 99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:00:47.768994 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1343e230-31d3-428a-8a17-461bc6618282 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:47.771226 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1343e230-31d3-428a-8a17-461bc6618282 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:47.771750 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1343e230-31d3-428a-8a17-461bc6618282 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:47.772706 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1343e230-31d3-428a-8a17-461bc6618282 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:47.773459 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1343e230-31d3-428a-8a17-461bc6618282 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:47.773891 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1343e230-31d3-428a-8a17-461bc6618282 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:47.824447 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-1343e230-31d3-428a-8a17-461bc6618282 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] 10.222.0.58 "GET /compute/v2.1/servers/99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.083535 Aug 10 23:00:47.825771 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 588/1193] 10.222.0.58 () {60 vars in 1343 bytes} [Wed Aug 10 23:00:47 2022] GET /compute/v2.1/servers/99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 23:00:47.838215 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-1d5802bb-2852-4f5c-bd1c-b6d3bc6cabe8 req-6202c671-a721-4d3d-be8b-511c237962af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bea7ce47-7ad2-4283-9b48-f4f61f71965a", "tag": "74d9803a-f789-4d14-b0ab-c4424356ec89"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:00:47.850124 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-1d5802bb-2852-4f5c-bd1c-b6d3bc6cabe8 req-6202c671-a721-4d3d-be8b-511c237962af service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:47.850919 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-1d5802bb-2852-4f5c-bd1c-b6d3bc6cabe8 req-6202c671-a721-4d3d-be8b-511c237962af service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:47.851531 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-1d5802bb-2852-4f5c-bd1c-b6d3bc6cabe8 req-6202c671-a721-4d3d-be8b-511c237962af service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:47.867856 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-1d5802bb-2852-4f5c-bd1c-b6d3bc6cabe8 req-6202c671-a721-4d3d-be8b-511c237962af service nova] Creating event network-changed:74d9803a-f789-4d14-b0ab-c4424356ec89 for instance bea7ce47-7ad2-4283-9b48-f4f61f71965a on n-h2-850468-14 Aug 10 23:00:47.875081 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-1d5802bb-2852-4f5c-bd1c-b6d3bc6cabe8 req-6202c671-a721-4d3d-be8b-511c237962af service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040426 Aug 10 23:00:47.876786 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 589/1194] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:00:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:00:47.884769 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-68c37d1b-7c0a-4576-9faf-dd164a5edfbb tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:47.886040 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-68c37d1b-7c0a-4576-9faf-dd164a5edfbb tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] [instance: 2a68f86c-37de-4207-aa43-6a1350342a56] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:00:47.888876 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-0c92c4a4-1887-4151-a1ce-8be8bfd6b922 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '417d4eaaeb1c4df78745496ececb3e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27e6ee9495a438b8450a4ef0d62cbcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:00:47.896381 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-68c37d1b-7c0a-4576-9faf-dd164a5edfbb tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:47.897148 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-68c37d1b-7c0a-4576-9faf-dd164a5edfbb tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:47.897744 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-68c37d1b-7c0a-4576-9faf-dd164a5edfbb tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:47.898687 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-68c37d1b-7c0a-4576-9faf-dd164a5edfbb tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:47.899324 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-68c37d1b-7c0a-4576-9faf-dd164a5edfbb tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:47.899982 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-68c37d1b-7c0a-4576-9faf-dd164a5edfbb tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:47.903097 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-0c92c4a4-1887-4151-a1ce-8be8bfd6b922 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] 10.222.0.58 "GET /compute/v2.1/servers/a0995db2-2ae0-4216-996a-39a03357c1eb" status: 200 len: 1319 microversion: 2.1 time: 1.316373 Aug 10 23:00:47.903677 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 606/1195] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:00:46 2022] GET /compute/v2.1/servers/a0995db2-2ae0-4216-996a-39a03357c1eb => generated 1319 bytes in 1318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:00:47.926031 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-7d854fc8-f03e-42cd-abc2-94541855e8fa tempest-MigrationsAdminTest-974767625 tempest-MigrationsAdminTest-974767625-project-admin] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:47.939931 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-7d854fc8-f03e-42cd-abc2-94541855e8fa tempest-MigrationsAdminTest-974767625 tempest-MigrationsAdminTest-974767625-project-admin] [instance: 0dabc2bf-08ff-45b5-a791-34d655349eae] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:00:47.991669 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7d854fc8-f03e-42cd-abc2-94541855e8fa tempest-MigrationsAdminTest-974767625 tempest-MigrationsAdminTest-974767625-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:47.992170 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7d854fc8-f03e-42cd-abc2-94541855e8fa tempest-MigrationsAdminTest-974767625 tempest-MigrationsAdminTest-974767625-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:47.998599 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7d854fc8-f03e-42cd-abc2-94541855e8fa tempest-MigrationsAdminTest-974767625 tempest-MigrationsAdminTest-974767625-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:48.002148 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7d854fc8-f03e-42cd-abc2-94541855e8fa tempest-MigrationsAdminTest-974767625 tempest-MigrationsAdminTest-974767625-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:48.010869 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7d854fc8-f03e-42cd-abc2-94541855e8fa tempest-MigrationsAdminTest-974767625 tempest-MigrationsAdminTest-974767625-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:48.011495 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7d854fc8-f03e-42cd-abc2-94541855e8fa tempest-MigrationsAdminTest-974767625 tempest-MigrationsAdminTest-974767625-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:48.127015 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-68c37d1b-7c0a-4576-9faf-dd164a5edfbb tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6d9806b6724e5aaf8c69be8e70d4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307ab95daa034afbb31f90626885072b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:00:48.147291 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-68c37d1b-7c0a-4576-9faf-dd164a5edfbb tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] 10.222.0.58 "GET /compute/v2.1/servers/2a68f86c-37de-4207-aa43-6a1350342a56" status: 200 len: 1308 microversion: 2.1 time: 0.268953 Aug 10 23:00:48.149148 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 590/1196] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:00:47 2022] GET /compute/v2.1/servers/2a68f86c-37de-4207-aa43-6a1350342a56 => generated 1308 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:00:48.160939 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-21d17737-a28c-4eae-aa9d-65f7e4eec830 req-0a226bba-cb04-4af1-af42-488c9556dc56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0995db2-2ae0-4216-996a-39a03357c1eb", "name": "network-vif-plugged", "status": "completed", "tag": "25ce4b44-8eb9-433e-96ad-43b05662b91c"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:00:48.172643 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-21d17737-a28c-4eae-aa9d-65f7e4eec830 req-0a226bba-cb04-4af1-af42-488c9556dc56 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:48.173139 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-21d17737-a28c-4eae-aa9d-65f7e4eec830 req-0a226bba-cb04-4af1-af42-488c9556dc56 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:48.173578 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-21d17737-a28c-4eae-aa9d-65f7e4eec830 req-0a226bba-cb04-4af1-af42-488c9556dc56 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:48.189992 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-21d17737-a28c-4eae-aa9d-65f7e4eec830 req-0a226bba-cb04-4af1-af42-488c9556dc56 service nova] Creating event network-vif-plugged:25ce4b44-8eb9-433e-96ad-43b05662b91c for instance a0995db2-2ae0-4216-996a-39a03357c1eb on n-h2-850468-14 Aug 10 23:00:48.197187 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-21d17737-a28c-4eae-aa9d-65f7e4eec830 req-0a226bba-cb04-4af1-af42-488c9556dc56 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045992 Aug 10 23:00:48.197795 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 591/1197] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:00:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:00:48.206963 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-68fdf58e-9a48-431b-845e-299213cf4d5a tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Calling method '.version_select at 0x7f847d2085e0>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:48.265716 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-68fdf58e-9a48-431b-845e-299213cf4d5a tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] 10.222.0.58 "GET /compute/v2.1/images/3d48cfd3-2ced-4117-a393-83f358ed89c6" status: 200 len: 1453 microversion: 2.1 time: 0.065822 Aug 10 23:00:48.266731 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 592/1198] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 10 23:00:48 2022] GET /compute/v2.1/images/3d48cfd3-2ced-4117-a393-83f358ed89c6 => generated 1453 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:00:48.273840 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-17fab8e3-82e8-4010-9cfb-11219eaa2dd5 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9db42fd1-a80f-480e-bae1-c8051e0f7d0e", "device": "/dev/xvdb"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:00:48.276657 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-17fab8e3-82e8-4010-9cfb-11219eaa2dd5 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] [instance: 8e91f1ac-f79d-4ab0-aa13-ea32b0e74888] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:00:48.286002 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-17fab8e3-82e8-4010-9cfb-11219eaa2dd5 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:48.286745 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-17fab8e3-82e8-4010-9cfb-11219eaa2dd5 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:48.287391 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-17fab8e3-82e8-4010-9cfb-11219eaa2dd5 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:48.288314 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-17fab8e3-82e8-4010-9cfb-11219eaa2dd5 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:48.289409 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-17fab8e3-82e8-4010-9cfb-11219eaa2dd5 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:48.290819 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-17fab8e3-82e8-4010-9cfb-11219eaa2dd5 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:48.656380 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-7d854fc8-f03e-42cd-abc2-94541855e8fa tempest-MigrationsAdminTest-974767625 tempest-MigrationsAdminTest-974767625-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/0dabc2bf-08ff-45b5-a791-34d655349eae" status: 200 len: 1615 microversion: 2.1 time: 0.739281 Aug 10 23:00:48.657863 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 607/1199] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:00:47 2022] GET /compute/v2.1/servers/0dabc2bf-08ff-45b5-a791-34d655349eae => generated 1615 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:00:48.682313 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-3f0ff276-b46e-467b-942b-99d1f74adec5 tempest-MigrationsAdminTest-974767625 tempest-MigrationsAdminTest-974767625-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:00:48.683319 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-3f0ff276-b46e-467b-942b-99d1f74adec5 tempest-MigrationsAdminTest-974767625 tempest-MigrationsAdminTest-974767625-project-admin] [instance: 0dabc2bf-08ff-45b5-a791-34d655349eae] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:00:48.696790 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3f0ff276-b46e-467b-942b-99d1f74adec5 tempest-MigrationsAdminTest-974767625 tempest-MigrationsAdminTest-974767625-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:48.697664 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3f0ff276-b46e-467b-942b-99d1f74adec5 tempest-MigrationsAdminTest-974767625 tempest-MigrationsAdminTest-974767625-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:48.698377 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3f0ff276-b46e-467b-942b-99d1f74adec5 tempest-MigrationsAdminTest-974767625 tempest-MigrationsAdminTest-974767625-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:48.699353 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3f0ff276-b46e-467b-942b-99d1f74adec5 tempest-MigrationsAdminTest-974767625 tempest-MigrationsAdminTest-974767625-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:48.700041 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3f0ff276-b46e-467b-942b-99d1f74adec5 tempest-MigrationsAdminTest-974767625 tempest-MigrationsAdminTest-974767625-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:48.700693 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3f0ff276-b46e-467b-942b-99d1f74adec5 tempest-MigrationsAdminTest-974767625 tempest-MigrationsAdminTest-974767625-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:48.707904 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:00:48.780955 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-3f0ff276-b46e-467b-942b-99d1f74adec5 tempest-MigrationsAdminTest-974767625 tempest-MigrationsAdminTest-974767625-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '8226b7db08ce49328cb235804da6740d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb50f4a3b69e4d2da01cf4057a57e675', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:00:48.783346 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-3f0ff276-b46e-467b-942b-99d1f74adec5 tempest-MigrationsAdminTest-974767625 tempest-MigrationsAdminTest-974767625-project-admin] [instance: 0dabc2bf-08ff-45b5-a791-34d655349eae] flavor_id is None. Assuming migration. {{(pid=122633) resize /opt/stack/nova/nova/compute/api.py:4144}} Aug 10 23:00:48.784452 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-3f0ff276-b46e-467b-942b-99d1f74adec5 tempest-MigrationsAdminTest-974767625 tempest-MigrationsAdminTest-974767625-project-admin] [instance: 0dabc2bf-08ff-45b5-a791-34d655349eae] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=122633) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 10 23:00:49.041083 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-3f0ff276-b46e-467b-942b-99d1f74adec5 tempest-MigrationsAdminTest-974767625 tempest-MigrationsAdminTest-974767625-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/0dabc2bf-08ff-45b5-a791-34d655349eae/action" status: 202 len: 0 microversion: 2.1 time: 0.362411 Aug 10 23:00:49.045343 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 608/1200] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:00:48 2022] POST /compute/v2.1/servers/0dabc2bf-08ff-45b5-a791-34d655349eae/action => generated 0 bytes in 367 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:00:49.046734 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-17fab8e3-82e8-4010-9cfb-11219eaa2dd5 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] 10.222.0.58 "POST /compute/v2.1/servers/8e91f1ac-f79d-4ab0-aa13-ea32b0e74888/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.778452 Aug 10 23:00:49.053940 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 593/1201] 10.222.0.58 () {60 vars in 1323 bytes} [Wed Aug 10 23:00:48 2022] POST /compute/v2.1/servers/8e91f1ac-f79d-4ab0-aa13-ea32b0e74888/os-volume_attachments => generated 194 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:00:49.058456 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-a0200ccc-71f3-49b7-97eb-3a08e470e176 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:49.061878 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-a0200ccc-71f3-49b7-97eb-3a08e470e176 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] [instance: 99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:00:49.071397 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-73a984d2-c18f-4476-a90b-b6fa9cee0428 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:49.072021 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-73a984d2-c18f-4476-a90b-b6fa9cee0428 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] [instance: 3553ba91-ca7b-44d9-944a-1540fa047cb6] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:00:49.073015 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a0200ccc-71f3-49b7-97eb-3a08e470e176 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:49.073785 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a0200ccc-71f3-49b7-97eb-3a08e470e176 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:49.074226 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a0200ccc-71f3-49b7-97eb-3a08e470e176 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:49.075394 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a0200ccc-71f3-49b7-97eb-3a08e470e176 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:49.075593 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a0200ccc-71f3-49b7-97eb-3a08e470e176 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:49.076109 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a0200ccc-71f3-49b7-97eb-3a08e470e176 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:49.106969 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-73a984d2-c18f-4476-a90b-b6fa9cee0428 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:49.107488 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-73a984d2-c18f-4476-a90b-b6fa9cee0428 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:49.108159 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-73a984d2-c18f-4476-a90b-b6fa9cee0428 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:49.108754 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-73a984d2-c18f-4476-a90b-b6fa9cee0428 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:49.109215 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-73a984d2-c18f-4476-a90b-b6fa9cee0428 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:49.110359 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-73a984d2-c18f-4476-a90b-b6fa9cee0428 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:49.158611 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-a0200ccc-71f3-49b7-97eb-3a08e470e176 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] 10.222.0.58 "GET /compute/v2.1/servers/99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.108231 Aug 10 23:00:49.159752 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 594/1202] 10.222.0.58 () {60 vars in 1343 bytes} [Wed Aug 10 23:00:49 2022] GET /compute/v2.1/servers/99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0/os-volume_attachments => generated 197 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 23:00:49.167040 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-930d8536-f91c-4dcc-b9bb-b7b252d14e66 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:49.167836 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-930d8536-f91c-4dcc-b9bb-b7b252d14e66 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] [instance: a0995db2-2ae0-4216-996a-39a03357c1eb] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:00:49.177234 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-930d8536-f91c-4dcc-b9bb-b7b252d14e66 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:49.177714 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-930d8536-f91c-4dcc-b9bb-b7b252d14e66 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:49.178148 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-930d8536-f91c-4dcc-b9bb-b7b252d14e66 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:49.179041 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-930d8536-f91c-4dcc-b9bb-b7b252d14e66 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:49.181221 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-930d8536-f91c-4dcc-b9bb-b7b252d14e66 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:49.181815 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-930d8536-f91c-4dcc-b9bb-b7b252d14e66 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:49.428269 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-930d8536-f91c-4dcc-b9bb-b7b252d14e66 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '417d4eaaeb1c4df78745496ececb3e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27e6ee9495a438b8450a4ef0d62cbcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:00:49.436965 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-930d8536-f91c-4dcc-b9bb-b7b252d14e66 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] 10.222.0.58 "GET /compute/v2.1/servers/a0995db2-2ae0-4216-996a-39a03357c1eb" status: 200 len: 1319 microversion: 2.1 time: 0.275815 Aug 10 23:00:49.450846 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 595/1203] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:00:49 2022] GET /compute/v2.1/servers/a0995db2-2ae0-4216-996a-39a03357c1eb => generated 1319 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:00:49.466559 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-b5ad8649-edbe-45a2-8d3f-8d3cd3ec6747 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:49.467390 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-b5ad8649-edbe-45a2-8d3f-8d3cd3ec6747 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 0dabc2bf-08ff-45b5-a791-34d655349eae] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:00:49.476784 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b5ad8649-edbe-45a2-8d3f-8d3cd3ec6747 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:49.476966 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b5ad8649-edbe-45a2-8d3f-8d3cd3ec6747 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:49.477448 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b5ad8649-edbe-45a2-8d3f-8d3cd3ec6747 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:49.478178 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b5ad8649-edbe-45a2-8d3f-8d3cd3ec6747 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:49.478724 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b5ad8649-edbe-45a2-8d3f-8d3cd3ec6747 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:49.479198 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b5ad8649-edbe-45a2-8d3f-8d3cd3ec6747 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:49.599734 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-73a984d2-c18f-4476-a90b-b6fa9cee0428 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e437f9eb7254dc98e2839656c053f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eae334ad72ba421797a6d836edcbab0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:00:49.611562 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-73a984d2-c18f-4476-a90b-b6fa9cee0428 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] 10.222.0.58 "GET /compute/v2.1/servers/3553ba91-ca7b-44d9-944a-1540fa047cb6" status: 200 len: 1681 microversion: 2.1 time: 0.563963 Aug 10 23:00:49.625412 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 609/1204] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:00:49 2022] GET /compute/v2.1/servers/3553ba91-ca7b-44d9-944a-1540fa047cb6 => generated 1681 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:00:49.629983 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-a7aeb6f5-be91-4e99-a9d3-60eec003d131 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:49.630603 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-a7aeb6f5-be91-4e99-a9d3-60eec003d131 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] [instance: 2a68f86c-37de-4207-aa43-6a1350342a56] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:00:49.644555 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a7aeb6f5-be91-4e99-a9d3-60eec003d131 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:49.653818 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a7aeb6f5-be91-4e99-a9d3-60eec003d131 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:49.654423 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a7aeb6f5-be91-4e99-a9d3-60eec003d131 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:49.657483 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a7aeb6f5-be91-4e99-a9d3-60eec003d131 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:49.658103 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a7aeb6f5-be91-4e99-a9d3-60eec003d131 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:49.658545 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a7aeb6f5-be91-4e99-a9d3-60eec003d131 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:49.770256 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-b5ad8649-edbe-45a2-8d3f-8d3cd3ec6747 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:00:49.777637 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:00:49.785338 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-b5ad8649-edbe-45a2-8d3f-8d3cd3ec6747 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/0dabc2bf-08ff-45b5-a791-34d655349eae" status: 200 len: 1471 microversion: 2.1 time: 0.342212 Aug 10 23:00:49.786283 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 596/1205] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:00:49 2022] GET /compute/v2.1/servers/0dabc2bf-08ff-45b5-a791-34d655349eae => generated 1471 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:00:49.795200 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-093e4505-1bb5-440a-9a8f-34a5ee3bc228 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Calling method '.version_select at 0x7f847d208280>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:49.909886 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-093e4505-1bb5-440a-9a8f-34a5ee3bc228 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] 10.222.0.58 "GET /compute/v2.1/images/3d48cfd3-2ced-4117-a393-83f358ed89c6" status: 200 len: 1453 microversion: 2.1 time: 0.122210 Aug 10 23:00:49.910590 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 597/1206] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 10 23:00:49 2022] GET /compute/v2.1/images/3d48cfd3-2ced-4117-a393-83f358ed89c6 => generated 1453 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:00:50.172306 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-a3763a1b-4601-409c-82b8-2064247569fc tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:50.174663 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-a3763a1b-4601-409c-82b8-2064247569fc tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] [instance: 99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:00:50.192827 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a3763a1b-4601-409c-82b8-2064247569fc tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:50.207584 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a3763a1b-4601-409c-82b8-2064247569fc tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:50.208172 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a3763a1b-4601-409c-82b8-2064247569fc tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:50.209010 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a3763a1b-4601-409c-82b8-2064247569fc tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:50.219887 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a3763a1b-4601-409c-82b8-2064247569fc tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:50.220455 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a3763a1b-4601-409c-82b8-2064247569fc tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:50.284495 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-a3763a1b-4601-409c-82b8-2064247569fc tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] 10.222.0.58 "GET /compute/v2.1/servers/99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.116967 Aug 10 23:00:50.285519 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 598/1207] 10.222.0.58 () {60 vars in 1343 bytes} [Wed Aug 10 23:00:50 2022] GET /compute/v2.1/servers/99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0/os-volume_attachments => generated 197 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 23:00:50.341405 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-a7aeb6f5-be91-4e99-a9d3-60eec003d131 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6d9806b6724e5aaf8c69be8e70d4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307ab95daa034afbb31f90626885072b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:00:50.363295 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-a7aeb6f5-be91-4e99-a9d3-60eec003d131 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] 10.222.0.58 "GET /compute/v2.1/servers/2a68f86c-37de-4207-aa43-6a1350342a56" status: 200 len: 1308 microversion: 2.1 time: 0.745521 Aug 10 23:00:50.365681 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 610/1208] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:00:49 2022] GET /compute/v2.1/servers/2a68f86c-37de-4207-aa43-6a1350342a56 => generated 1308 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:00:50.465927 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-921ed87a-985d-44f0-8a37-2e83be2dcbf0 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:50.466887 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-921ed87a-985d-44f0-8a37-2e83be2dcbf0 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] [instance: a0995db2-2ae0-4216-996a-39a03357c1eb] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:00:50.481318 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-921ed87a-985d-44f0-8a37-2e83be2dcbf0 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:50.488820 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-921ed87a-985d-44f0-8a37-2e83be2dcbf0 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:50.492768 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-921ed87a-985d-44f0-8a37-2e83be2dcbf0 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:50.493762 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-921ed87a-985d-44f0-8a37-2e83be2dcbf0 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:50.494814 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-921ed87a-985d-44f0-8a37-2e83be2dcbf0 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:50.495441 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-921ed87a-985d-44f0-8a37-2e83be2dcbf0 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:50.643667 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-9ffda99d-b54a-4088-9d55-17fa173bea1c tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:50.644668 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-9ffda99d-b54a-4088-9d55-17fa173bea1c tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] [instance: 3553ba91-ca7b-44d9-944a-1540fa047cb6] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:00:50.656206 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9ffda99d-b54a-4088-9d55-17fa173bea1c tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:50.658972 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9ffda99d-b54a-4088-9d55-17fa173bea1c tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:50.661039 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9ffda99d-b54a-4088-9d55-17fa173bea1c tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:50.662020 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9ffda99d-b54a-4088-9d55-17fa173bea1c tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:50.663312 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9ffda99d-b54a-4088-9d55-17fa173bea1c tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:50.667401 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9ffda99d-b54a-4088-9d55-17fa173bea1c tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:51.023702 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-9ffda99d-b54a-4088-9d55-17fa173bea1c tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e437f9eb7254dc98e2839656c053f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eae334ad72ba421797a6d836edcbab0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:00:51.036420 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-9ffda99d-b54a-4088-9d55-17fa173bea1c tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] 10.222.0.58 "GET /compute/v2.1/servers/3553ba91-ca7b-44d9-944a-1540fa047cb6" status: 200 len: 1614 microversion: 2.1 time: 0.394778 Aug 10 23:00:51.040507 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 611/1209] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:00:50 2022] GET /compute/v2.1/servers/3553ba91-ca7b-44d9-944a-1540fa047cb6 => generated 1614 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:00:51.077124 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-f8853a00-f3b5-42d8-8793-9d988e45fd7b tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:51.081686 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-f8853a00-f3b5-42d8-8793-9d988e45fd7b tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 0dabc2bf-08ff-45b5-a791-34d655349eae] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:00:51.092200 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-921ed87a-985d-44f0-8a37-2e83be2dcbf0 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '417d4eaaeb1c4df78745496ececb3e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27e6ee9495a438b8450a4ef0d62cbcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:00:51.101654 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-921ed87a-985d-44f0-8a37-2e83be2dcbf0 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] 10.222.0.58 "GET /compute/v2.1/servers/a0995db2-2ae0-4216-996a-39a03357c1eb" status: 200 len: 1469 microversion: 2.1 time: 0.639997 Aug 10 23:00:51.103137 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 599/1210] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:00:50 2022] GET /compute/v2.1/servers/a0995db2-2ae0-4216-996a-39a03357c1eb => generated 1469 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:00:51.119068 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f8853a00-f3b5-42d8-8793-9d988e45fd7b tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:51.119705 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f8853a00-f3b5-42d8-8793-9d988e45fd7b tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:51.120159 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f8853a00-f3b5-42d8-8793-9d988e45fd7b tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:51.120889 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f8853a00-f3b5-42d8-8793-9d988e45fd7b tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:51.121348 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f8853a00-f3b5-42d8-8793-9d988e45fd7b tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:51.121779 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f8853a00-f3b5-42d8-8793-9d988e45fd7b tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:51.123933 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-51149500-ef40-4eb8-9136-1a6f7f32ed13 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Calling method '.version_select at 0x7f847d1b34c0>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:51.286985 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-51149500-ef40-4eb8-9136-1a6f7f32ed13 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] 10.222.0.58 "GET /compute/v2.1/images/3d48cfd3-2ced-4117-a393-83f358ed89c6" status: 200 len: 1453 microversion: 2.1 time: 0.181890 Aug 10 23:00:51.287921 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 600/1211] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 10 23:00:51 2022] GET /compute/v2.1/images/3d48cfd3-2ced-4117-a393-83f358ed89c6 => generated 1453 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:00:51.300529 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-9bad23d9-bc98-4f13-81ca-3b716a0acf86 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:51.301151 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-9bad23d9-bc98-4f13-81ca-3b716a0acf86 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] [instance: bea7ce47-7ad2-4283-9b48-f4f61f71965a] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:00:51.334806 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9bad23d9-bc98-4f13-81ca-3b716a0acf86 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:51.335458 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9bad23d9-bc98-4f13-81ca-3b716a0acf86 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:51.339074 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9bad23d9-bc98-4f13-81ca-3b716a0acf86 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:51.344677 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9bad23d9-bc98-4f13-81ca-3b716a0acf86 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:51.345331 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9bad23d9-bc98-4f13-81ca-3b716a0acf86 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:51.345842 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9bad23d9-bc98-4f13-81ca-3b716a0acf86 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:51.699681 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-f8853a00-f3b5-42d8-8793-9d988e45fd7b tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:00:51.713600 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-9bad23d9-bc98-4f13-81ca-3b716a0acf86 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '417d4eaaeb1c4df78745496ececb3e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27e6ee9495a438b8450a4ef0d62cbcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:00:51.725812 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-f8853a00-f3b5-42d8-8793-9d988e45fd7b tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/0dabc2bf-08ff-45b5-a791-34d655349eae" status: 200 len: 1471 microversion: 2.1 time: 0.684165 Aug 10 23:00:51.726213 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-9bad23d9-bc98-4f13-81ca-3b716a0acf86 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] 10.222.0.58 "GET /compute/v2.1/servers/bea7ce47-7ad2-4283-9b48-f4f61f71965a" status: 200 len: 1319 microversion: 2.1 time: 0.436460 Aug 10 23:00:51.726403 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 612/1212] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:00:51 2022] GET /compute/v2.1/servers/0dabc2bf-08ff-45b5-a791-34d655349eae => generated 1471 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:00:51.736756 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-f8853a00-f3b5-42d8-8793-9d988e45fd7b tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:51.738610 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-f8853a00-f3b5-42d8-8793-9d988e45fd7b tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute//" status: 200 len: 377 microversion: - time: 0.006989 Aug 10 23:00:51.740169 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 601/1213] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:00:51 2022] GET /compute/v2.1/servers/bea7ce47-7ad2-4283-9b48-f4f61f71965a => generated 1319 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:00:51.744233 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 613/1214] 10.222.0.58 () {56 vars in 886 bytes} [Wed Aug 10 23:00:51 2022] GET /compute/ => generated 377 bytes in 14 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 10 23:00:51.758388 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-b6f45346-1cae-4e35-b4df-dbe424f04c13 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:51.760252 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-b6f45346-1cae-4e35-b4df-dbe424f04c13 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] [instance: 2a68f86c-37de-4207-aa43-6a1350342a56] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:00:51.763109 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-5506266d-a109-43e5-85dd-19ad8316284b tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:51.779092 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b6f45346-1cae-4e35-b4df-dbe424f04c13 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:51.780007 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b6f45346-1cae-4e35-b4df-dbe424f04c13 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:51.782652 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b6f45346-1cae-4e35-b4df-dbe424f04c13 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:51.783168 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-5506266d-a109-43e5-85dd-19ad8316284b tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] [instance: 99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:00:51.784105 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b6f45346-1cae-4e35-b4df-dbe424f04c13 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:51.786106 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b6f45346-1cae-4e35-b4df-dbe424f04c13 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:51.787688 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b6f45346-1cae-4e35-b4df-dbe424f04c13 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:51.799261 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5506266d-a109-43e5-85dd-19ad8316284b tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:51.799755 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5506266d-a109-43e5-85dd-19ad8316284b tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:51.800190 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5506266d-a109-43e5-85dd-19ad8316284b tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:51.800900 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5506266d-a109-43e5-85dd-19ad8316284b tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:51.807472 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5506266d-a109-43e5-85dd-19ad8316284b tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:51.807940 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5506266d-a109-43e5-85dd-19ad8316284b tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:51.909159 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-5506266d-a109-43e5-85dd-19ad8316284b tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] 10.222.0.58 "GET /compute/v2.1/servers/99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.159659 Aug 10 23:00:51.910281 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 602/1215] 10.222.0.58 () {60 vars in 1343 bytes} [Wed Aug 10 23:00:51 2022] GET /compute/v2.1/servers/99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0/os-volume_attachments => generated 197 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 23:00:52.065433 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-86240eff-c342-4524-ad9f-e31a9f129ead tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:52.066062 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-86240eff-c342-4524-ad9f-e31a9f129ead tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] [instance: 3553ba91-ca7b-44d9-944a-1540fa047cb6] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:00:52.077494 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-86240eff-c342-4524-ad9f-e31a9f129ead tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:52.077912 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-86240eff-c342-4524-ad9f-e31a9f129ead tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:52.078514 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-86240eff-c342-4524-ad9f-e31a9f129ead tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:52.079409 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-86240eff-c342-4524-ad9f-e31a9f129ead tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:52.079868 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-86240eff-c342-4524-ad9f-e31a9f129ead tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:52.080294 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-86240eff-c342-4524-ad9f-e31a9f129ead tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:52.552225 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-86240eff-c342-4524-ad9f-e31a9f129ead tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e437f9eb7254dc98e2839656c053f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eae334ad72ba421797a6d836edcbab0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:00:52.565524 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-86240eff-c342-4524-ad9f-e31a9f129ead tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] 10.222.0.58 "GET /compute/v2.1/servers/3553ba91-ca7b-44d9-944a-1540fa047cb6" status: 200 len: 1614 microversion: 2.1 time: 0.505591 Aug 10 23:00:52.581582 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 603/1216] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:00:52 2022] GET /compute/v2.1/servers/3553ba91-ca7b-44d9-944a-1540fa047cb6 => generated 1614 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:00:52.588867 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-752847e0-8eb5-4bcb-901e-e1fa001e7463 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Calling method '.version_select at 0x7f847d27e9d0>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:52.673902 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-752847e0-8eb5-4bcb-901e-e1fa001e7463 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] 10.222.0.58 "GET /compute/v2.1/images/3d48cfd3-2ced-4117-a393-83f358ed89c6" status: 200 len: 1453 microversion: 2.1 time: 0.090189 Aug 10 23:00:52.675356 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 604/1217] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 10 23:00:52 2022] GET /compute/v2.1/images/3d48cfd3-2ced-4117-a393-83f358ed89c6 => generated 1453 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:00:52.749260 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-ace27c67-c2f4-4fe2-9a06-66c2809d02ab tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:52.750540 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-ace27c67-c2f4-4fe2-9a06-66c2809d02ab tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 0dabc2bf-08ff-45b5-a791-34d655349eae] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:00:52.761454 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_api:UPDATE=1,nova_api:SELECT=99 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:00:52.764077 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ace27c67-c2f4-4fe2-9a06-66c2809d02ab tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:52.767215 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ace27c67-c2f4-4fe2-9a06-66c2809d02ab tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:52.767966 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ace27c67-c2f4-4fe2-9a06-66c2809d02ab tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:52.769463 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ace27c67-c2f4-4fe2-9a06-66c2809d02ab tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:52.771702 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ace27c67-c2f4-4fe2-9a06-66c2809d02ab tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:52.772904 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ace27c67-c2f4-4fe2-9a06-66c2809d02ab tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:52.776090 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-b6f45346-1cae-4e35-b4df-dbe424f04c13 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6d9806b6724e5aaf8c69be8e70d4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307ab95daa034afbb31f90626885072b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:00:52.789407 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-b6f45346-1cae-4e35-b4df-dbe424f04c13 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] 10.222.0.58 "GET /compute/v2.1/servers/2a68f86c-37de-4207-aa43-6a1350342a56" status: 200 len: 1308 microversion: 2.1 time: 1.044030 Aug 10 23:00:52.795960 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 614/1218] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:00:51 2022] GET /compute/v2.1/servers/2a68f86c-37de-4207-aa43-6a1350342a56 => generated 1308 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:00:52.836235 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-7b07c014-ebec-41d2-a4bb-123f83df1c68 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:52.837159 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-7b07c014-ebec-41d2-a4bb-123f83df1c68 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] [instance: bea7ce47-7ad2-4283-9b48-f4f61f71965a] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:00:52.846488 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7b07c014-ebec-41d2-a4bb-123f83df1c68 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:52.851753 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7b07c014-ebec-41d2-a4bb-123f83df1c68 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:52.852447 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7b07c014-ebec-41d2-a4bb-123f83df1c68 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:52.853446 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7b07c014-ebec-41d2-a4bb-123f83df1c68 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:52.854044 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7b07c014-ebec-41d2-a4bb-123f83df1c68 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:52.854755 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7b07c014-ebec-41d2-a4bb-123f83df1c68 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:53.282982 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-ace27c67-c2f4-4fe2-9a06-66c2809d02ab tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:00:53.295512 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-ace27c67-c2f4-4fe2-9a06-66c2809d02ab tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/0dabc2bf-08ff-45b5-a791-34d655349eae" status: 200 len: 1471 microversion: 2.1 time: 0.549958 Aug 10 23:00:53.296158 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 605/1219] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:00:52 2022] GET /compute/v2.1/servers/0dabc2bf-08ff-45b5-a791-34d655349eae => generated 1471 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:00:53.316832 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-4a536b5f-3335-4171-8aec-f6953c5d54a6 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:53.331376 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-4a536b5f-3335-4171-8aec-f6953c5d54a6 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] [instance: 99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:00:53.363607 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4a536b5f-3335-4171-8aec-f6953c5d54a6 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:53.363996 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4a536b5f-3335-4171-8aec-f6953c5d54a6 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:53.364430 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4a536b5f-3335-4171-8aec-f6953c5d54a6 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:53.365149 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4a536b5f-3335-4171-8aec-f6953c5d54a6 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:53.365604 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4a536b5f-3335-4171-8aec-f6953c5d54a6 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:53.366036 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4a536b5f-3335-4171-8aec-f6953c5d54a6 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:53.476440 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-4a536b5f-3335-4171-8aec-f6953c5d54a6 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] 10.222.0.58 "GET /compute/v2.1/servers/99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.163683 Aug 10 23:00:53.480166 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 606/1220] 10.222.0.58 () {60 vars in 1343 bytes} [Wed Aug 10 23:00:53 2022] GET /compute/v2.1/servers/99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0/os-volume_attachments => generated 197 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 23:00:53.590411 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-050af83e-763b-418e-b874-c958f84abfe9 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:53.591089 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-050af83e-763b-418e-b874-c958f84abfe9 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] [instance: 3553ba91-ca7b-44d9-944a-1540fa047cb6] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:00:53.593066 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=2 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:00:53.604658 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-050af83e-763b-418e-b874-c958f84abfe9 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:53.605223 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-050af83e-763b-418e-b874-c958f84abfe9 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:53.605693 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-050af83e-763b-418e-b874-c958f84abfe9 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:53.606412 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-050af83e-763b-418e-b874-c958f84abfe9 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:53.617325 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-050af83e-763b-418e-b874-c958f84abfe9 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:53.619998 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-050af83e-763b-418e-b874-c958f84abfe9 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:53.758165 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-050af83e-763b-418e-b874-c958f84abfe9 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:53.758677 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-050af83e-763b-418e-b874-c958f84abfe9 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:53.762645 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-050af83e-763b-418e-b874-c958f84abfe9 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:53.764418 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.objects.instance [None req-050af83e-763b-418e-b874-c958f84abfe9 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lazy-loading 'fault' on Instance uuid 3553ba91-ca7b-44d9-944a-1540fa047cb6 {{(pid=122632) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:00:53.868442 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-050af83e-763b-418e-b874-c958f84abfe9 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e437f9eb7254dc98e2839656c053f2d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eae334ad72ba421797a6d836edcbab0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:00:53.882036 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-050af83e-763b-418e-b874-c958f84abfe9 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] 10.222.0.58 "GET /compute/v2.1/servers/3553ba91-ca7b-44d9-944a-1540fa047cb6" status: 200 len: 1332 microversion: 2.1 time: 0.295224 Aug 10 23:00:53.882809 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 607/1221] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:00:53 2022] GET /compute/v2.1/servers/3553ba91-ca7b-44d9-944a-1540fa047cb6 => generated 1332 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:00:53.899325 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-50d0afab-795b-4d47-84d3-52e8f57a0c88 req-386d1d22-e337-499e-b249-658f2446572b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3553ba91-ca7b-44d9-944a-1540fa047cb6", "name": "network-vif-deleted", "tag": "85a66084-439b-411f-bdff-14a0d1ae381a"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:00:53.933460 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-50d0afab-795b-4d47-84d3-52e8f57a0c88 req-386d1d22-e337-499e-b249-658f2446572b service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:53.934260 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-50d0afab-795b-4d47-84d3-52e8f57a0c88 req-386d1d22-e337-499e-b249-658f2446572b service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:53.934955 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-50d0afab-795b-4d47-84d3-52e8f57a0c88 req-386d1d22-e337-499e-b249-658f2446572b service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:53.963967 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-50d0afab-795b-4d47-84d3-52e8f57a0c88 req-386d1d22-e337-499e-b249-658f2446572b service nova] Creating event network-vif-deleted:85a66084-439b-411f-bdff-14a0d1ae381a for instance 3553ba91-ca7b-44d9-944a-1540fa047cb6 on n-h1-850468-14 Aug 10 23:00:53.970718 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-50d0afab-795b-4d47-84d3-52e8f57a0c88 req-386d1d22-e337-499e-b249-658f2446572b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086329 Aug 10 23:00:53.974425 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 608/1222] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:00:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:00:53.986723 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-61717d9a-bf45-4fca-b352-2aeedf18db3e tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Calling method '.version_select at 0x7f847d17b790>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:54.041997 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-7b07c014-ebec-41d2-a4bb-123f83df1c68 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '417d4eaaeb1c4df78745496ececb3e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27e6ee9495a438b8450a4ef0d62cbcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:00:54.051249 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-7b07c014-ebec-41d2-a4bb-123f83df1c68 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] 10.222.0.58 "GET /compute/v2.1/servers/bea7ce47-7ad2-4283-9b48-f4f61f71965a" status: 200 len: 1319 microversion: 2.1 time: 1.253703 Aug 10 23:00:54.060321 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 615/1223] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:00:52 2022] GET /compute/v2.1/servers/bea7ce47-7ad2-4283-9b48-f4f61f71965a => generated 1319 bytes in 1263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:00:54.073144 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-eca769d8-27ca-4526-9cf2-5b4851a1738a tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:54.075511 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-eca769d8-27ca-4526-9cf2-5b4851a1738a tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] [instance: 2a68f86c-37de-4207-aa43-6a1350342a56] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:00:54.088432 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-eca769d8-27ca-4526-9cf2-5b4851a1738a tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:54.093178 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-eca769d8-27ca-4526-9cf2-5b4851a1738a tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:54.094616 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-eca769d8-27ca-4526-9cf2-5b4851a1738a tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:54.095701 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-eca769d8-27ca-4526-9cf2-5b4851a1738a tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:54.096415 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-eca769d8-27ca-4526-9cf2-5b4851a1738a tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:54.105802 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-61717d9a-bf45-4fca-b352-2aeedf18db3e tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] 10.222.0.58 "GET /compute/v2.1/images/3d48cfd3-2ced-4117-a393-83f358ed89c6" status: 200 len: 1453 microversion: 2.1 time: 0.128689 Aug 10 23:00:54.116883 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 609/1224] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 10 23:00:53 2022] GET /compute/v2.1/images/3d48cfd3-2ced-4117-a393-83f358ed89c6 => generated 1453 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:00:54.117981 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-eca769d8-27ca-4526-9cf2-5b4851a1738a tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:54.319855 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-337f5aa1-e536-4712-b0f2-8f487f84e6c3 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:54.320996 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-337f5aa1-e536-4712-b0f2-8f487f84e6c3 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 0dabc2bf-08ff-45b5-a791-34d655349eae] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:00:54.335616 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-337f5aa1-e536-4712-b0f2-8f487f84e6c3 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:54.336386 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-337f5aa1-e536-4712-b0f2-8f487f84e6c3 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:54.337057 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-337f5aa1-e536-4712-b0f2-8f487f84e6c3 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:54.338020 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-337f5aa1-e536-4712-b0f2-8f487f84e6c3 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:54.338715 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-337f5aa1-e536-4712-b0f2-8f487f84e6c3 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:54.346600 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-337f5aa1-e536-4712-b0f2-8f487f84e6c3 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:54.669874 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-eca769d8-27ca-4526-9cf2-5b4851a1738a tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6d9806b6724e5aaf8c69be8e70d4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307ab95daa034afbb31f90626885072b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:00:54.688329 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-eca769d8-27ca-4526-9cf2-5b4851a1738a tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] 10.222.0.58 "GET /compute/v2.1/servers/2a68f86c-37de-4207-aa43-6a1350342a56" status: 200 len: 1308 microversion: 2.1 time: 0.626037 Aug 10 23:00:54.697026 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 616/1225] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:00:54 2022] GET /compute/v2.1/servers/2a68f86c-37de-4207-aa43-6a1350342a56 => generated 1308 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:00:54.702535 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-8dfea3b2-24e4-4cf3-a9fb-39713bd763d8 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:54.714283 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-8dfea3b2-24e4-4cf3-a9fb-39713bd763d8 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] [instance: 99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:00:54.742952 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8dfea3b2-24e4-4cf3-a9fb-39713bd763d8 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:54.743453 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8dfea3b2-24e4-4cf3-a9fb-39713bd763d8 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:54.743897 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8dfea3b2-24e4-4cf3-a9fb-39713bd763d8 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:54.744617 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8dfea3b2-24e4-4cf3-a9fb-39713bd763d8 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:54.745071 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8dfea3b2-24e4-4cf3-a9fb-39713bd763d8 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:54.745492 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8dfea3b2-24e4-4cf3-a9fb-39713bd763d8 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:54.816733 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-337f5aa1-e536-4712-b0f2-8f487f84e6c3 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:00:54.836407 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-337f5aa1-e536-4712-b0f2-8f487f84e6c3 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/0dabc2bf-08ff-45b5-a791-34d655349eae" status: 200 len: 1471 microversion: 2.1 time: 0.520362 Aug 10 23:00:54.841340 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 610/1226] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:00:54 2022] GET /compute/v2.1/servers/0dabc2bf-08ff-45b5-a791-34d655349eae => generated 1471 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:00:54.858133 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-8dfea3b2-24e4-4cf3-a9fb-39713bd763d8 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] 10.222.0.58 "GET /compute/v2.1/servers/99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.158587 Aug 10 23:00:54.859173 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 617/1227] 10.222.0.58 () {60 vars in 1343 bytes} [Wed Aug 10 23:00:54 2022] GET /compute/v2.1/servers/99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0/os-volume_attachments => generated 197 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 23:00:54.907790 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-0c1c215b-d126-4ba8-874e-c87368b8adbc tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:54.908563 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-0c1c215b-d126-4ba8-874e-c87368b8adbc tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] [instance: 3553ba91-ca7b-44d9-944a-1540fa047cb6] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:00:54.917738 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0c1c215b-d126-4ba8-874e-c87368b8adbc tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:54.919201 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0c1c215b-d126-4ba8-874e-c87368b8adbc tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:54.919906 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0c1c215b-d126-4ba8-874e-c87368b8adbc tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:54.921614 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0c1c215b-d126-4ba8-874e-c87368b8adbc tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:54.923001 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0c1c215b-d126-4ba8-874e-c87368b8adbc tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:54.936359 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0c1c215b-d126-4ba8-874e-c87368b8adbc tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:54.989308 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-0c1c215b-d126-4ba8-874e-c87368b8adbc tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] HTTP exception thrown: Instance 3553ba91-ca7b-44d9-944a-1540fa047cb6 could not be found. Aug 10 23:00:54.995613 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-0c1c215b-d126-4ba8-874e-c87368b8adbc tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Request method failure captured: Aug 10 23:00:54.995613 n-d-850468-14 devstack@n-api.service[122632]: request: GET /compute/v2.1/servers/3553ba91-ca7b-44d9-944a-1540fa047cb6 HTTP/1.1 Aug 10 23:00:54.995613 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:00:54.995613 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:00:54.995613 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:00:54.995613 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 23:00:54.995613 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:00:54.995613 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:00:54.995613 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:00:54.995613 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:00:54.995613 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9Dfy3xy8R2ATQNzdVgtjes_wXZj0k2pZt-bxjEPLk5B6P5Wut-mxZ23U5UJQnTeAIOV5L1s_zZb97gm4jJhXPY7TW5iOeiiT0vd1xYX5sPGvKOVk_KBA_XgumKQ1wPzb99WC7kqJodwoG7NWo0WUW2WC6DrLsoKw4gcTxuP4K0GMWjc Aug 10 23:00:54.995613 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:00:54.995613 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:00:54.995613 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:00:54.995613 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:00:54.995613 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:00:54.995613 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:00:54.995613 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: eae334ad72ba421797a6d836edcbab0c Aug 10 23:00:54.995613 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-VolumesAdminNegativeTest-1191651426 Aug 10 23:00:54.995613 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:00:54.995613 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:00:54.997366 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/eae334ad72ba421797a6d836edcbab0c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/eae334ad72ba421797a6d836edcbab0c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/eae334ad72ba421797a6d836edcbab0c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_eae334ad72ba421797a6d836edcbab0c", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:00:54.997366 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-VolumesAdminNegativeTest-1191651426 Aug 10 23:00:54.997366 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: eae334ad72ba421797a6d836edcbab0c Aug 10 23:00:54.997366 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1191651426 Aug 10 23:00:54.997366 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-VolumesAdminNegativeTest-1191651426-project Aug 10 23:00:54.997366 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:00:54.997366 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:00:54.997366 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: 6e437f9eb7254dc98e2839656c053f2d Aug 10 23:00:54.997366 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-VolumesAdminNegativeTest-1191651426-project Aug 10 23:00:54.997366 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:00:54.997366 n-d-850468-14 devstack@n-api.service[122632]: exception: Instance 3553ba91-ca7b-44d9-944a-1540fa047cb6 could not be found. Aug 10 23:00:54.997366 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': '3553ba91-ca7b-44d9-944a-1540fa047cb6'} Aug 10 23:00:54.998541 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:00:54.998541 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:00:54.998541 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:00:54.998541 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:00:54.998541 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:00:54.998541 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:00:54.998541 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:00:54.998541 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:00:54.998541 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:00:54.998541 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:00:54.998541 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3553ba91-ca7b-44d9-944a-1540fa047cb6 could not be found. Aug 10 23:00:54.998541 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:00:54.998541 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:00:54.998541 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:00:54.998541 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:00:54.998541 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:00:54.998541 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:00:54.998541 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:00:54.998541 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:00:54.998541 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:00:55.001005 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:00:55.001005 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:00:55.001005 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:00:55.001005 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:00:55.001005 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:00:55.001005 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:00:55.001005 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:00:55.001005 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3553ba91-ca7b-44d9-944a-1540fa047cb6 could not be found. Aug 10 23:00:55.001005 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:00:55.001005 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:00:55.001005 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:00:55.001005 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:00:55.001005 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:00:55.001005 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:00:55.001005 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:00:55.001005 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:00:55.001005 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3553ba91-ca7b-44d9-944a-1540fa047cb6 could not be found. Aug 10 23:00:55.001005 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:00:55.002857 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-0c1c215b-d126-4ba8-874e-c87368b8adbc tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Returning 404 to user: Instance 3553ba91-ca7b-44d9-944a-1540fa047cb6 could not be found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:00:55.002857 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-0c1c215b-d126-4ba8-874e-c87368b8adbc tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] 10.222.0.58 "GET /compute/v2.1/servers/3553ba91-ca7b-44d9-944a-1540fa047cb6" status: 404 len: 111 microversion: 2.1 time: 0.095343 Aug 10 23:00:55.003793 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 611/1228] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:00:54 2022] GET /compute/v2.1/servers/3553ba91-ca7b-44d9-944a-1540fa047cb6 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:00:55.008923 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-93c60b8e-1859-418b-8e4c-ea8f2cff0c07 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] Calling method '.version_select at 0x7f847d2619d0>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:55.050121 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-93c60b8e-1859-418b-8e4c-ea8f2cff0c07 tempest-VolumesAdminNegativeTest-1191651426 tempest-VolumesAdminNegativeTest-1191651426-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1315665311" status: 202 len: 0 microversion: 2.1 time: 0.045441 Aug 10 23:00:55.054692 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 618/1229] 10.222.0.58 () {58 vars in 1221 bytes} [Wed Aug 10 23:00:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1315665311 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:00:55.081133 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-864a38f0-85ea-4c2a-b109-4550bebbaeba tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:55.082774 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-864a38f0-85ea-4c2a-b109-4550bebbaeba tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] [instance: bea7ce47-7ad2-4283-9b48-f4f61f71965a] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:00:55.093548 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-864a38f0-85ea-4c2a-b109-4550bebbaeba tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:55.107342 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-864a38f0-85ea-4c2a-b109-4550bebbaeba tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:55.107835 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-864a38f0-85ea-4c2a-b109-4550bebbaeba tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:55.112511 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-864a38f0-85ea-4c2a-b109-4550bebbaeba tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:55.113023 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-864a38f0-85ea-4c2a-b109-4550bebbaeba tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:55.113470 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-864a38f0-85ea-4c2a-b109-4550bebbaeba tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:55.123799 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-351ac8c0-61c5-4c16-8e3e-b7fcb866ec7f tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Calling method '.version_select at 0x7f847d2c3700>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:55.238394 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-351ac8c0-61c5-4c16-8e3e-b7fcb866ec7f tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] 10.222.0.58 "GET /compute/v2.1/images/3d48cfd3-2ced-4117-a393-83f358ed89c6" status: 200 len: 1453 microversion: 2.1 time: 0.118352 Aug 10 23:00:55.254639 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 619/1230] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 10 23:00:55 2022] GET /compute/v2.1/images/3d48cfd3-2ced-4117-a393-83f358ed89c6 => generated 1453 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:00:55.721689 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-0f5e3470-4bbf-4dad-8ae4-131c444b69d0 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:55.722634 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-0f5e3470-4bbf-4dad-8ae4-131c444b69d0 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] [instance: 2a68f86c-37de-4207-aa43-6a1350342a56] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:00:55.737166 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0f5e3470-4bbf-4dad-8ae4-131c444b69d0 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:55.739409 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0f5e3470-4bbf-4dad-8ae4-131c444b69d0 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:55.740052 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0f5e3470-4bbf-4dad-8ae4-131c444b69d0 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:55.742577 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0f5e3470-4bbf-4dad-8ae4-131c444b69d0 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:55.743376 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0f5e3470-4bbf-4dad-8ae4-131c444b69d0 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:55.745468 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0f5e3470-4bbf-4dad-8ae4-131c444b69d0 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:55.909017 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-864a38f0-85ea-4c2a-b109-4550bebbaeba tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '417d4eaaeb1c4df78745496ececb3e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27e6ee9495a438b8450a4ef0d62cbcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:00:55.923042 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-864a38f0-85ea-4c2a-b109-4550bebbaeba tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] 10.222.0.58 "GET /compute/v2.1/servers/bea7ce47-7ad2-4283-9b48-f4f61f71965a" status: 200 len: 1319 microversion: 2.1 time: 0.846732 Aug 10 23:00:55.931880 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 612/1231] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:00:55 2022] GET /compute/v2.1/servers/bea7ce47-7ad2-4283-9b48-f4f61f71965a => generated 1319 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:00:55.941413 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-269db72a-2631-47f8-a332-2ca196dd3120 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:55.942041 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-269db72a-2631-47f8-a332-2ca196dd3120 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 0dabc2bf-08ff-45b5-a791-34d655349eae] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:00:55.959761 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-269db72a-2631-47f8-a332-2ca196dd3120 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:55.960258 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-269db72a-2631-47f8-a332-2ca196dd3120 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:55.967228 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-269db72a-2631-47f8-a332-2ca196dd3120 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:55.968036 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-269db72a-2631-47f8-a332-2ca196dd3120 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:55.968592 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-269db72a-2631-47f8-a332-2ca196dd3120 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:55.969124 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-269db72a-2631-47f8-a332-2ca196dd3120 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:56.239665 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-0f5e3470-4bbf-4dad-8ae4-131c444b69d0 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6d9806b6724e5aaf8c69be8e70d4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307ab95daa034afbb31f90626885072b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:00:56.258765 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-0f5e3470-4bbf-4dad-8ae4-131c444b69d0 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] 10.222.0.58 "GET /compute/v2.1/servers/2a68f86c-37de-4207-aa43-6a1350342a56" status: 200 len: 1308 microversion: 2.1 time: 0.545950 Aug 10 23:00:56.263589 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 620/1232] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:00:55 2022] GET /compute/v2.1/servers/2a68f86c-37de-4207-aa43-6a1350342a56 => generated 1308 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:00:56.270913 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-8392932a-4b5e-4fa2-8568-15152881ebc3 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:56.274197 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-8392932a-4b5e-4fa2-8568-15152881ebc3 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] [instance: 99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:00:56.300409 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8392932a-4b5e-4fa2-8568-15152881ebc3 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:56.301188 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8392932a-4b5e-4fa2-8568-15152881ebc3 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:56.301863 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8392932a-4b5e-4fa2-8568-15152881ebc3 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:56.304472 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8392932a-4b5e-4fa2-8568-15152881ebc3 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:56.305874 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8392932a-4b5e-4fa2-8568-15152881ebc3 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:56.306550 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8392932a-4b5e-4fa2-8568-15152881ebc3 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:56.380422 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-8392932a-4b5e-4fa2-8568-15152881ebc3 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] 10.222.0.58 "GET /compute/v2.1/servers/99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.115419 Aug 10 23:00:56.385742 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 621/1233] 10.222.0.58 () {60 vars in 1343 bytes} [Wed Aug 10 23:00:56 2022] GET /compute/v2.1/servers/99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0/os-volume_attachments => generated 25 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:00:56.409671 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-fc6b6594-fc91-4fe9-8802-d6b9c68e4150 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Calling method '.version_select at 0x7f847d308820>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:56.500320 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-fc6b6594-fc91-4fe9-8802-d6b9c68e4150 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] 10.222.0.58 "GET /compute/v2.1/images/3d48cfd3-2ced-4117-a393-83f358ed89c6" status: 200 len: 1453 microversion: 2.1 time: 0.112574 Aug 10 23:00:56.503065 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 622/1234] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 10 23:00:56 2022] GET /compute/v2.1/images/3d48cfd3-2ced-4117-a393-83f358ed89c6 => generated 1453 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:00:56.572952 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-269db72a-2631-47f8-a332-2ca196dd3120 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:00:56.582524 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-269db72a-2631-47f8-a332-2ca196dd3120 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/0dabc2bf-08ff-45b5-a791-34d655349eae" status: 200 len: 1476 microversion: 2.1 time: 0.649513 Aug 10 23:00:56.593945 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 613/1235] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:00:55 2022] GET /compute/v2.1/servers/0dabc2bf-08ff-45b5-a791-34d655349eae => generated 1476 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:00:56.708155 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-9a067f9d-20ff-4c7f-92c5-3f4ea3f89e79 req-582826f4-c4f3-4574-acff-ac5663c2e1a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a68f86c-37de-4207-aa43-6a1350342a56", "name": "network-vif-plugged", "status": "completed", "tag": "c4194225-7832-4162-ab1c-9691d11ab1ae"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:00:56.741586 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-9a067f9d-20ff-4c7f-92c5-3f4ea3f89e79 req-582826f4-c4f3-4574-acff-ac5663c2e1a7 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:56.741986 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-9a067f9d-20ff-4c7f-92c5-3f4ea3f89e79 req-582826f4-c4f3-4574-acff-ac5663c2e1a7 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:56.742425 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-9a067f9d-20ff-4c7f-92c5-3f4ea3f89e79 req-582826f4-c4f3-4574-acff-ac5663c2e1a7 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:56.795405 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-9a067f9d-20ff-4c7f-92c5-3f4ea3f89e79 req-582826f4-c4f3-4574-acff-ac5663c2e1a7 service nova] Creating event network-vif-plugged:c4194225-7832-4162-ab1c-9691d11ab1ae for instance 2a68f86c-37de-4207-aa43-6a1350342a56 on n-h2-850468-14 Aug 10 23:00:56.807260 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-9a067f9d-20ff-4c7f-92c5-3f4ea3f89e79 req-582826f4-c4f3-4574-acff-ac5663c2e1a7 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106319 Aug 10 23:00:56.811151 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 623/1236] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:00:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:00:56.953285 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-b9051fbb-df38-48e5-9d4d-e499fb6d0cf9 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:56.954106 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-b9051fbb-df38-48e5-9d4d-e499fb6d0cf9 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] [instance: bea7ce47-7ad2-4283-9b48-f4f61f71965a] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:00:56.968987 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b9051fbb-df38-48e5-9d4d-e499fb6d0cf9 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:56.969838 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b9051fbb-df38-48e5-9d4d-e499fb6d0cf9 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:56.970461 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b9051fbb-df38-48e5-9d4d-e499fb6d0cf9 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:56.971735 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b9051fbb-df38-48e5-9d4d-e499fb6d0cf9 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:56.972356 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b9051fbb-df38-48e5-9d4d-e499fb6d0cf9 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:56.972964 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b9051fbb-df38-48e5-9d4d-e499fb6d0cf9 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:57.285496 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-4adfe62c-eb53-4b17-a80b-2d7c81fbef1e tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:57.286446 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-4adfe62c-eb53-4b17-a80b-2d7c81fbef1e tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] [instance: 2a68f86c-37de-4207-aa43-6a1350342a56] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:00:57.304398 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4adfe62c-eb53-4b17-a80b-2d7c81fbef1e tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:57.308000 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4adfe62c-eb53-4b17-a80b-2d7c81fbef1e tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:57.313691 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4adfe62c-eb53-4b17-a80b-2d7c81fbef1e tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:57.314484 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4adfe62c-eb53-4b17-a80b-2d7c81fbef1e tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:57.317518 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4adfe62c-eb53-4b17-a80b-2d7c81fbef1e tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:57.318133 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4adfe62c-eb53-4b17-a80b-2d7c81fbef1e tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:57.491374 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-b9051fbb-df38-48e5-9d4d-e499fb6d0cf9 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '417d4eaaeb1c4df78745496ececb3e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27e6ee9495a438b8450a4ef0d62cbcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:00:57.499974 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-b9051fbb-df38-48e5-9d4d-e499fb6d0cf9 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] 10.222.0.58 "GET /compute/v2.1/servers/bea7ce47-7ad2-4283-9b48-f4f61f71965a" status: 200 len: 1319 microversion: 2.1 time: 0.551431 Aug 10 23:00:57.522005 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 614/1237] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:00:56 2022] GET /compute/v2.1/servers/bea7ce47-7ad2-4283-9b48-f4f61f71965a => generated 1319 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:00:57.537168 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-46500a52-b8e9-4d0f-a5b2-bab0d46dc340 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Calling method '.version_select at 0x7f847d1b7af0>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:57.635138 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-46500a52-b8e9-4d0f-a5b2-bab0d46dc340 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] 10.222.0.58 "GET /compute/v2.1/images/3d48cfd3-2ced-4117-a393-83f358ed89c6" status: 200 len: 1453 microversion: 2.1 time: 0.109032 Aug 10 23:00:57.635726 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 615/1238] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 10 23:00:57 2022] GET /compute/v2.1/images/3d48cfd3-2ced-4117-a393-83f358ed89c6 => generated 1453 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:00:57.656747 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c47572d0-8fa1-43b4-9894-a9107a121068 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:57.658039 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-c47572d0-8fa1-43b4-9894-a9107a121068 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 0dabc2bf-08ff-45b5-a791-34d655349eae] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:00:57.676276 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c47572d0-8fa1-43b4-9894-a9107a121068 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:57.677283 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c47572d0-8fa1-43b4-9894-a9107a121068 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:57.678022 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c47572d0-8fa1-43b4-9894-a9107a121068 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:57.681550 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c47572d0-8fa1-43b4-9894-a9107a121068 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:57.683366 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c47572d0-8fa1-43b4-9894-a9107a121068 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:57.684064 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c47572d0-8fa1-43b4-9894-a9107a121068 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:58.025483 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-4adfe62c-eb53-4b17-a80b-2d7c81fbef1e tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6d9806b6724e5aaf8c69be8e70d4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307ab95daa034afbb31f90626885072b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:00:58.035384 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-4adfe62c-eb53-4b17-a80b-2d7c81fbef1e tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] 10.222.0.58 "GET /compute/v2.1/servers/2a68f86c-37de-4207-aa43-6a1350342a56" status: 200 len: 1308 microversion: 2.1 time: 0.755265 Aug 10 23:00:58.058482 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 624/1239] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:00:57 2022] GET /compute/v2.1/servers/2a68f86c-37de-4207-aa43-6a1350342a56 => generated 1308 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:00:58.355896 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-c47572d0-8fa1-43b4-9894-a9107a121068 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:00:58.368571 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-c47572d0-8fa1-43b4-9894-a9107a121068 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/0dabc2bf-08ff-45b5-a791-34d655349eae" status: 200 len: 1476 microversion: 2.1 time: 0.723442 Aug 10 23:00:58.369138 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 616/1240] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:00:57 2022] GET /compute/v2.1/servers/0dabc2bf-08ff-45b5-a791-34d655349eae => generated 1476 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:00:58.530449 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-19263d87-910e-4bbc-88ed-4ca2ef064091 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:58.531952 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-19263d87-910e-4bbc-88ed-4ca2ef064091 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] [instance: bea7ce47-7ad2-4283-9b48-f4f61f71965a] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:00:58.540005 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-19263d87-910e-4bbc-88ed-4ca2ef064091 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:58.540600 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-19263d87-910e-4bbc-88ed-4ca2ef064091 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:58.540923 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-19263d87-910e-4bbc-88ed-4ca2ef064091 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:58.542458 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-19263d87-910e-4bbc-88ed-4ca2ef064091 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:58.542946 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-19263d87-910e-4bbc-88ed-4ca2ef064091 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:58.543561 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-19263d87-910e-4bbc-88ed-4ca2ef064091 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:58.651729 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-f0235793-5a6b-40ec-a8d4-055a0aadc9ae tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Calling method '.version_select at 0x7f847d1c60d0>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:59.350024 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-19263d87-910e-4bbc-88ed-4ca2ef064091 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '417d4eaaeb1c4df78745496ececb3e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27e6ee9495a438b8450a4ef0d62cbcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:00:59.366181 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-19263d87-910e-4bbc-88ed-4ca2ef064091 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] 10.222.0.58 "GET /compute/v2.1/servers/bea7ce47-7ad2-4283-9b48-f4f61f71965a" status: 200 len: 1319 microversion: 2.1 time: 0.839399 Aug 10 23:00:59.371540 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 625/1241] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:00:58 2022] GET /compute/v2.1/servers/bea7ce47-7ad2-4283-9b48-f4f61f71965a => generated 1319 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:00:59.383518 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-f587f83e-4bab-4b2d-9716-b9fcec977395 req-8c70cbfa-3525-4d73-9fe0-75015ad5d37c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bea7ce47-7ad2-4283-9b48-f4f61f71965a", "name": "network-vif-plugged", "status": "completed", "tag": "74d9803a-f789-4d14-b0ab-c4424356ec89"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:00:59.433474 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-f587f83e-4bab-4b2d-9716-b9fcec977395 req-8c70cbfa-3525-4d73-9fe0-75015ad5d37c service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:59.433968 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-f587f83e-4bab-4b2d-9716-b9fcec977395 req-8c70cbfa-3525-4d73-9fe0-75015ad5d37c service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:59.434410 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-f587f83e-4bab-4b2d-9716-b9fcec977395 req-8c70cbfa-3525-4d73-9fe0-75015ad5d37c service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:59.483647 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-f587f83e-4bab-4b2d-9716-b9fcec977395 req-8c70cbfa-3525-4d73-9fe0-75015ad5d37c service nova] Creating event network-vif-plugged:74d9803a-f789-4d14-b0ab-c4424356ec89 for instance bea7ce47-7ad2-4283-9b48-f4f61f71965a on n-h2-850468-14 Aug 10 23:00:59.505812 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-f587f83e-4bab-4b2d-9716-b9fcec977395 req-8c70cbfa-3525-4d73-9fe0-75015ad5d37c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132949 Aug 10 23:00:59.514578 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 626/1242] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:00:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:00:59.543390 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c120e5da-bacd-4092-a1ea-61c20c0f46d5 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:00:59.545956 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-c120e5da-bacd-4092-a1ea-61c20c0f46d5 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] [instance: 2a68f86c-37de-4207-aa43-6a1350342a56] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:00:59.582992 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c120e5da-bacd-4092-a1ea-61c20c0f46d5 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:59.583505 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c120e5da-bacd-4092-a1ea-61c20c0f46d5 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:59.583955 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c120e5da-bacd-4092-a1ea-61c20c0f46d5 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:00:59.584679 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c120e5da-bacd-4092-a1ea-61c20c0f46d5 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:00:59.585140 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c120e5da-bacd-4092-a1ea-61c20c0f46d5 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:00:59.585567 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c120e5da-bacd-4092-a1ea-61c20c0f46d5 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:00.844110 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-c120e5da-bacd-4092-a1ea-61c20c0f46d5 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6d9806b6724e5aaf8c69be8e70d4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307ab95daa034afbb31f90626885072b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:01:00.853122 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-c120e5da-bacd-4092-a1ea-61c20c0f46d5 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] 10.222.0.58 "GET /compute/v2.1/servers/2a68f86c-37de-4207-aa43-6a1350342a56" status: 200 len: 1489 microversion: 2.1 time: 1.335160 Aug 10 23:01:00.875610 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 627/1243] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:00:59 2022] GET /compute/v2.1/servers/2a68f86c-37de-4207-aa43-6a1350342a56 => generated 1489 bytes in 1358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:01:00.887159 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-41602853-a3a6-4518-ba95-5f4cadf8c02d tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:00.888046 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-41602853-a3a6-4518-ba95-5f4cadf8c02d tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 0dabc2bf-08ff-45b5-a791-34d655349eae] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:01:00.906184 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-41602853-a3a6-4518-ba95-5f4cadf8c02d tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:00.907154 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-41602853-a3a6-4518-ba95-5f4cadf8c02d tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:00.907856 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-41602853-a3a6-4518-ba95-5f4cadf8c02d tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:00.908778 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-41602853-a3a6-4518-ba95-5f4cadf8c02d tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:00.909399 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-41602853-a3a6-4518-ba95-5f4cadf8c02d tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:00.909994 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-41602853-a3a6-4518-ba95-5f4cadf8c02d tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:00.959764 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:01:01.252269 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-41602853-a3a6-4518-ba95-5f4cadf8c02d tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:01:01.270229 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-41602853-a3a6-4518-ba95-5f4cadf8c02d tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/0dabc2bf-08ff-45b5-a791-34d655349eae" status: 200 len: 1476 microversion: 2.1 time: 0.393112 Aug 10 23:01:01.275617 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 628/1244] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:01:00 2022] GET /compute/v2.1/servers/0dabc2bf-08ff-45b5-a791-34d655349eae => generated 1476 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:01:01.282472 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-e8d253a3-ba91-4528-9f04-675f0ca27ca5 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:01.287006 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-e8d253a3-ba91-4528-9f04-675f0ca27ca5 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] [instance: bea7ce47-7ad2-4283-9b48-f4f61f71965a] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:01:01.294726 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e8d253a3-ba91-4528-9f04-675f0ca27ca5 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:01.298426 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e8d253a3-ba91-4528-9f04-675f0ca27ca5 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:01.301186 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e8d253a3-ba91-4528-9f04-675f0ca27ca5 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:01.302029 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e8d253a3-ba91-4528-9f04-675f0ca27ca5 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:01.302410 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e8d253a3-ba91-4528-9f04-675f0ca27ca5 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:01.306648 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e8d253a3-ba91-4528-9f04-675f0ca27ca5 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:01.900409 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-e8d253a3-ba91-4528-9f04-675f0ca27ca5 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '417d4eaaeb1c4df78745496ececb3e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27e6ee9495a438b8450a4ef0d62cbcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:01:01.910844 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-e8d253a3-ba91-4528-9f04-675f0ca27ca5 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] 10.222.0.58 "GET /compute/v2.1/servers/bea7ce47-7ad2-4283-9b48-f4f61f71965a" status: 200 len: 1319 microversion: 2.1 time: 0.633620 Aug 10 23:01:01.915774 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 629/1245] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:01:01 2022] GET /compute/v2.1/servers/bea7ce47-7ad2-4283-9b48-f4f61f71965a => generated 1319 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:01:01.923958 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-4a5d3781-0bc1-4f8e-a79f-81a6314232bf tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:01:01.929644 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-4a5d3781-0bc1-4f8e-a79f-81a6314232bf tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] [instance: 2a68f86c-37de-4207-aa43-6a1350342a56] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:01:01.945771 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4a5d3781-0bc1-4f8e-a79f-81a6314232bf tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:01.948943 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4a5d3781-0bc1-4f8e-a79f-81a6314232bf tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:01.949634 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4a5d3781-0bc1-4f8e-a79f-81a6314232bf tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:01.950550 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4a5d3781-0bc1-4f8e-a79f-81a6314232bf tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:01.956016 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4a5d3781-0bc1-4f8e-a79f-81a6314232bf tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:01.956845 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4a5d3781-0bc1-4f8e-a79f-81a6314232bf tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:02.017155 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.objects.instance [None req-4a5d3781-0bc1-4f8e-a79f-81a6314232bf tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lazy-loading 'flavor' on Instance uuid 2a68f86c-37de-4207-aa43-6a1350342a56 {{(pid=122633) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:01:02.263049 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-4a5d3781-0bc1-4f8e-a79f-81a6314232bf tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] 10.222.0.58 "POST /compute/v2.1/servers/2a68f86c-37de-4207-aa43-6a1350342a56/action" status: 202 len: 0 microversion: 2.1 time: 0.341118 Aug 10 23:01:02.268365 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 630/1246] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:01:01 2022] POST /compute/v2.1/servers/2a68f86c-37de-4207-aa43-6a1350342a56/action => generated 0 bytes in 350 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:01:02.280843 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-1f0a5661-1b0f-471b-bbc3-49af89fcdf98 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:02.282342 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-1f0a5661-1b0f-471b-bbc3-49af89fcdf98 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] [instance: 2a68f86c-37de-4207-aa43-6a1350342a56] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:01:02.300579 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1f0a5661-1b0f-471b-bbc3-49af89fcdf98 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:02.301089 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1f0a5661-1b0f-471b-bbc3-49af89fcdf98 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:02.301539 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1f0a5661-1b0f-471b-bbc3-49af89fcdf98 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:02.304271 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1f0a5661-1b0f-471b-bbc3-49af89fcdf98 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:02.304748 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1f0a5661-1b0f-471b-bbc3-49af89fcdf98 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:02.305190 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1f0a5661-1b0f-471b-bbc3-49af89fcdf98 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:02.866148 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-1f0a5661-1b0f-471b-bbc3-49af89fcdf98 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6d9806b6724e5aaf8c69be8e70d4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307ab95daa034afbb31f90626885072b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:01:02.881625 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-1f0a5661-1b0f-471b-bbc3-49af89fcdf98 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] 10.222.0.58 "GET /compute/v2.1/servers/2a68f86c-37de-4207-aa43-6a1350342a56" status: 200 len: 1497 microversion: 2.1 time: 0.611700 Aug 10 23:01:02.885649 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 631/1247] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:01:02 2022] GET /compute/v2.1/servers/2a68f86c-37de-4207-aa43-6a1350342a56 => generated 1497 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:01:02.896288 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-1826814e-d46b-4a6a-9d92-42076b82192e tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:02.898395 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-1826814e-d46b-4a6a-9d92-42076b82192e tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 0dabc2bf-08ff-45b5-a791-34d655349eae] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:01:02.917291 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1826814e-d46b-4a6a-9d92-42076b82192e tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:02.917901 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1826814e-d46b-4a6a-9d92-42076b82192e tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:02.918229 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1826814e-d46b-4a6a-9d92-42076b82192e tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:02.918988 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1826814e-d46b-4a6a-9d92-42076b82192e tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:02.919449 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1826814e-d46b-4a6a-9d92-42076b82192e tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:02.919875 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1826814e-d46b-4a6a-9d92-42076b82192e tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:03.348069 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-1826814e-d46b-4a6a-9d92-42076b82192e tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:01:03.380684 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-1826814e-d46b-4a6a-9d92-42076b82192e tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/0dabc2bf-08ff-45b5-a791-34d655349eae" status: 200 len: 1476 microversion: 2.1 time: 0.493434 Aug 10 23:01:03.402129 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 632/1248] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:01:02 2022] GET /compute/v2.1/servers/0dabc2bf-08ff-45b5-a791-34d655349eae => generated 1476 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:01:03.419321 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-97d50666-7f9b-4b35-94e1-317a2747b63b tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:03.422995 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-97d50666-7f9b-4b35-94e1-317a2747b63b tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] [instance: bea7ce47-7ad2-4283-9b48-f4f61f71965a] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:01:03.454020 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-97d50666-7f9b-4b35-94e1-317a2747b63b tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:03.459889 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-97d50666-7f9b-4b35-94e1-317a2747b63b tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:03.461554 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-97d50666-7f9b-4b35-94e1-317a2747b63b tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:03.467438 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-97d50666-7f9b-4b35-94e1-317a2747b63b tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:03.472496 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-97d50666-7f9b-4b35-94e1-317a2747b63b tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:03.473360 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-97d50666-7f9b-4b35-94e1-317a2747b63b tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:03.929104 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-97d50666-7f9b-4b35-94e1-317a2747b63b tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '417d4eaaeb1c4df78745496ececb3e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27e6ee9495a438b8450a4ef0d62cbcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:01:03.948816 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-97d50666-7f9b-4b35-94e1-317a2747b63b tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] 10.222.0.58 "GET /compute/v2.1/servers/bea7ce47-7ad2-4283-9b48-f4f61f71965a" status: 200 len: 1469 microversion: 2.1 time: 0.545020 Aug 10 23:01:03.949526 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 633/1249] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:01:03 2022] GET /compute/v2.1/servers/bea7ce47-7ad2-4283-9b48-f4f61f71965a => generated 1469 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:01:03.966153 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c0bc2b45-fe9d-4481-8a46-a306382009e8 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:03.966828 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-c0bc2b45-fe9d-4481-8a46-a306382009e8 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] [instance: 2a68f86c-37de-4207-aa43-6a1350342a56] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:01:03.988304 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c0bc2b45-fe9d-4481-8a46-a306382009e8 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:03.991292 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c0bc2b45-fe9d-4481-8a46-a306382009e8 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:03.991786 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c0bc2b45-fe9d-4481-8a46-a306382009e8 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:03.992546 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c0bc2b45-fe9d-4481-8a46-a306382009e8 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:03.993010 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c0bc2b45-fe9d-4481-8a46-a306382009e8 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:03.993439 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c0bc2b45-fe9d-4481-8a46-a306382009e8 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:04.381976 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-c0bc2b45-fe9d-4481-8a46-a306382009e8 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6d9806b6724e5aaf8c69be8e70d4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307ab95daa034afbb31f90626885072b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:01:04.399941 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-c0bc2b45-fe9d-4481-8a46-a306382009e8 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] 10.222.0.58 "GET /compute/v2.1/servers/2a68f86c-37de-4207-aa43-6a1350342a56" status: 200 len: 1480 microversion: 2.1 time: 0.448713 Aug 10 23:01:04.401642 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 634/1250] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:01:03 2022] GET /compute/v2.1/servers/2a68f86c-37de-4207-aa43-6a1350342a56 => generated 1480 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:01:04.409872 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-74899049-33db-4dd5-a587-219392cbd0b2 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:04.420603 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-74899049-33db-4dd5-a587-219392cbd0b2 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '417d4eaaeb1c4df78745496ececb3e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27e6ee9495a438b8450a4ef0d62cbcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:01:04.425618 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-74899049-33db-4dd5-a587-219392cbd0b2 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Searching by: {'reservation_id': 'r-g84404z0', 'deleted': False, 'project_id': 'b27e6ee9495a438b8450a4ef0d62cbcd'} {{(pid=122633) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 10 23:01:04.477602 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-74899049-33db-4dd5-a587-219392cbd0b2 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:04.478216 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-74899049-33db-4dd5-a587-219392cbd0b2 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:04.478659 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-74899049-33db-4dd5-a587-219392cbd0b2 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:04.485296 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-74899049-33db-4dd5-a587-219392cbd0b2 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:04.485782 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-74899049-33db-4dd5-a587-219392cbd0b2 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:04.486240 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-74899049-33db-4dd5-a587-219392cbd0b2 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:04.550321 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-f0235793-5a6b-40ec-a8d4-055a0aadc9ae tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] 10.222.0.58 "GET /compute/v2.1/images/3d48cfd3-2ced-4117-a393-83f358ed89c6" status: 200 len: 1462 microversion: 2.1 time: 5.902493 Aug 10 23:01:04.551261 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 617/1251] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 10 23:00:58 2022] GET /compute/v2.1/images/3d48cfd3-2ced-4117-a393-83f358ed89c6 => generated 1462 bytes in 5904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:01:04.564454 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-d2acdb2c-b20e-4e44-bb5c-464140097d63 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:04.565089 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-d2acdb2c-b20e-4e44-bb5c-464140097d63 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 0dabc2bf-08ff-45b5-a791-34d655349eae] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:01:04.596694 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d2acdb2c-b20e-4e44-bb5c-464140097d63 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:04.597418 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d2acdb2c-b20e-4e44-bb5c-464140097d63 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:04.599328 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d2acdb2c-b20e-4e44-bb5c-464140097d63 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:04.616991 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d2acdb2c-b20e-4e44-bb5c-464140097d63 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:04.616991 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d2acdb2c-b20e-4e44-bb5c-464140097d63 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:04.616991 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d2acdb2c-b20e-4e44-bb5c-464140097d63 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:04.839357 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.multi_cell_list [None req-74899049-33db-4dd5-a587-219392cbd0b2 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=122633) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 10 23:01:05.006610 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-d2acdb2c-b20e-4e44-bb5c-464140097d63 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:01:05.026932 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-d2acdb2c-b20e-4e44-bb5c-464140097d63 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/0dabc2bf-08ff-45b5-a791-34d655349eae" status: 200 len: 1476 microversion: 2.1 time: 0.474325 Aug 10 23:01:05.029428 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 618/1252] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:01:04 2022] GET /compute/v2.1/servers/0dabc2bf-08ff-45b5-a791-34d655349eae => generated 1476 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:01:05.051733 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-4cc668fa-6378-422f-9f15-bcb593a0fcf7 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-2077054476"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:01:05.055614 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-4cc668fa-6378-422f-9f15-bcb593a0fcf7 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] [instance: 2a68f86c-37de-4207-aa43-6a1350342a56] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:01:05.083072 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4cc668fa-6378-422f-9f15-bcb593a0fcf7 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:05.083580 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4cc668fa-6378-422f-9f15-bcb593a0fcf7 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:05.085732 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4cc668fa-6378-422f-9f15-bcb593a0fcf7 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:05.086471 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4cc668fa-6378-422f-9f15-bcb593a0fcf7 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:05.086967 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4cc668fa-6378-422f-9f15-bcb593a0fcf7 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:05.087401 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4cc668fa-6378-422f-9f15-bcb593a0fcf7 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:05.121812 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-74899049-33db-4dd5-a587-219392cbd0b2 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '417d4eaaeb1c4df78745496ececb3e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27e6ee9495a438b8450a4ef0d62cbcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:01:05.185774 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-74899049-33db-4dd5-a587-219392cbd0b2 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:05.188989 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-74899049-33db-4dd5-a587-219392cbd0b2 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:05.189278 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-74899049-33db-4dd5-a587-219392cbd0b2 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:05.490973 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=100 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:01:05.549062 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-4cc668fa-6378-422f-9f15-bcb593a0fcf7 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] 10.222.0.58 "POST /compute/v2.1/servers/2a68f86c-37de-4207-aa43-6a1350342a56/action" status: 202 len: 0 microversion: 2.1 time: 0.514600 Aug 10 23:01:05.550452 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 619/1253] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:01:05 2022] POST /compute/v2.1/servers/2a68f86c-37de-4207-aa43-6a1350342a56/action => generated 0 bytes in 519 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 10 23:01:05.569560 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-519fab9e-424b-451a-b735-6c01ff5e9339 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Calling method '.version_select at 0x7f847d1b3700>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:05.651476 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-519fab9e-424b-451a-b735-6c01ff5e9339 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] 10.222.0.58 "GET /compute/v2.1/images/3d48cfd3-2ced-4117-a393-83f358ed89c6" status: 200 len: 1462 microversion: 2.1 time: 0.096828 Aug 10 23:01:05.653145 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 620/1254] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 10 23:01:05 2022] GET /compute/v2.1/images/3d48cfd3-2ced-4117-a393-83f358ed89c6 => generated 1462 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:01:05.669122 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-8a095479-3502-49ef-b840-e13b494c885b tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Calling method '.version_select at 0x7f847d17bca0>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:05.703685 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-74899049-33db-4dd5-a587-219392cbd0b2 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] 10.222.0.58 "GET /compute/v2.1/servers/detail?reservation_id=r-g84404z0" status: 200 len: 2931 microversion: 2.1 time: 1.299769 Aug 10 23:01:05.704833 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 635/1255] 10.222.0.58 () {58 vars in 1197 bytes} [Wed Aug 10 23:01:04 2022] GET /compute/v2.1/servers/detail?reservation_id=r-g84404z0 => generated 2931 bytes in 1302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:01:05.709422 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-74c37929-012a-47d4-922c-168ef2051054 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:05.711120 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-74c37929-012a-47d4-922c-168ef2051054 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] [instance: d716cac6-ac7c-4b98-b6ea-2496ccd62096] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:01:05.725584 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:01:05.727891 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-74c37929-012a-47d4-922c-168ef2051054 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:05.728392 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-74c37929-012a-47d4-922c-168ef2051054 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:05.728832 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-74c37929-012a-47d4-922c-168ef2051054 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:05.729550 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-74c37929-012a-47d4-922c-168ef2051054 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:05.731138 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-74c37929-012a-47d4-922c-168ef2051054 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:05.731574 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-74c37929-012a-47d4-922c-168ef2051054 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:05.765664 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-8a095479-3502-49ef-b840-e13b494c885b tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] 10.222.0.58 "GET /compute/v2.1/images/c00a0c31-f3f5-4dbc-ac74-d933d5bccb9e" status: 200 len: 1440 microversion: 2.1 time: 0.110143 Aug 10 23:01:05.768683 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 621/1256] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 10 23:01:05 2022] GET /compute/v2.1/images/c00a0c31-f3f5-4dbc-ac74-d933d5bccb9e => generated 1440 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:01:05.783268 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-b07b406a-af73-46e4-b6c4-fca973f5d262 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:05.819613 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.compute.server_groups [None req-b07b406a-af73-46e4-b6c4-fca973f5d262 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Querying cell c9127db4-59f9-48ac-9ab2-b5d6690bb85f(cell1) for 2 instances {{(pid=122632) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 10 23:01:05.820661 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b07b406a-af73-46e4-b6c4-fca973f5d262 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:05.821324 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b07b406a-af73-46e4-b6c4-fca973f5d262 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:05.821915 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b07b406a-af73-46e4-b6c4-fca973f5d262 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:05.860391 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-b07b406a-af73-46e4-b6c4-fca973f5d262 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] 10.222.0.58 "GET /compute/v2.1/os-server-groups/da03a39d-f6f0-4dab-8d44-bd22debb8b03" status: 200 len: 266 microversion: 2.1 time: 0.089579 Aug 10 23:01:05.862947 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 622/1257] 10.222.0.58 () {58 vars in 1263 bytes} [Wed Aug 10 23:01:05 2022] GET /compute/v2.1/os-server-groups/da03a39d-f6f0-4dab-8d44-bd22debb8b03 => generated 266 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:01:05.873911 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c4dd649f-f24b-491e-bd87-d60d7a3cf8bc tempest-ServersOnMultiNodesTest-79489 tempest-ServersOnMultiNodesTest-79489-project-admin] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:05.875742 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-c4dd649f-f24b-491e-bd87-d60d7a3cf8bc tempest-ServersOnMultiNodesTest-79489 tempest-ServersOnMultiNodesTest-79489-project-admin] [instance: a0995db2-2ae0-4216-996a-39a03357c1eb] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:01:05.886178 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c4dd649f-f24b-491e-bd87-d60d7a3cf8bc tempest-ServersOnMultiNodesTest-79489 tempest-ServersOnMultiNodesTest-79489-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:05.887130 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c4dd649f-f24b-491e-bd87-d60d7a3cf8bc tempest-ServersOnMultiNodesTest-79489 tempest-ServersOnMultiNodesTest-79489-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:05.887593 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c4dd649f-f24b-491e-bd87-d60d7a3cf8bc tempest-ServersOnMultiNodesTest-79489 tempest-ServersOnMultiNodesTest-79489-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:05.888288 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c4dd649f-f24b-491e-bd87-d60d7a3cf8bc tempest-ServersOnMultiNodesTest-79489 tempest-ServersOnMultiNodesTest-79489-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:05.888741 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c4dd649f-f24b-491e-bd87-d60d7a3cf8bc tempest-ServersOnMultiNodesTest-79489 tempest-ServersOnMultiNodesTest-79489-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:05.889156 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c4dd649f-f24b-491e-bd87-d60d7a3cf8bc tempest-ServersOnMultiNodesTest-79489 tempest-ServersOnMultiNodesTest-79489-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:06.025877 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-74c37929-012a-47d4-922c-168ef2051054 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e86e6a62c56248d6a7887be0ec712f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25090b10522b4936b3117dc25dd6f609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:01:06.038671 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-74c37929-012a-47d4-922c-168ef2051054 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] 10.222.0.58 "GET /compute/v2.1/servers/d716cac6-ac7c-4b98-b6ea-2496ccd62096" status: 200 len: 1467 microversion: 2.1 time: 0.332414 Aug 10 23:01:06.054972 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 636/1258] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:01:05 2022] GET /compute/v2.1/servers/d716cac6-ac7c-4b98-b6ea-2496ccd62096 => generated 1467 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:01:06.068512 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-22890660-4c01-4654-b328-f32d3e909a45 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:06.070662 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-22890660-4c01-4654-b328-f32d3e909a45 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 0dabc2bf-08ff-45b5-a791-34d655349eae] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:01:06.080307 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-22890660-4c01-4654-b328-f32d3e909a45 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:06.080502 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-c4dd649f-f24b-491e-bd87-d60d7a3cf8bc tempest-ServersOnMultiNodesTest-79489 tempest-ServersOnMultiNodesTest-79489-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/a0995db2-2ae0-4216-996a-39a03357c1eb" status: 200 len: 1622 microversion: 2.1 time: 0.212420 Aug 10 23:01:06.081014 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 623/1259] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:01:05 2022] GET /compute/v2.1/servers/a0995db2-2ae0-4216-996a-39a03357c1eb => generated 1622 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:01:06.087035 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-a7666578-1742-4f25-90a2-469a63c09771 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Calling method '.version_select at 0x7f847d206550>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:06.093630 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-22890660-4c01-4654-b328-f32d3e909a45 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:06.096097 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-22890660-4c01-4654-b328-f32d3e909a45 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:06.097050 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-22890660-4c01-4654-b328-f32d3e909a45 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:06.097847 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-22890660-4c01-4654-b328-f32d3e909a45 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:06.098360 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-22890660-4c01-4654-b328-f32d3e909a45 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:06.230456 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-a7666578-1742-4f25-90a2-469a63c09771 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] 10.222.0.58 "GET /compute/v2.1/images?changes-since=2022-08-10T22%3A59%3A09Z" status: 200 len: 2373 microversion: 2.1 time: 0.147259 Aug 10 23:01:06.231702 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 624/1260] 10.222.0.58 () {58 vars in 1199 bytes} [Wed Aug 10 23:01:06 2022] GET /compute/v2.1/images?changes-since=2022-08-10T22%3A59%3A09Z => generated 2373 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:01:06.236811 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-0fcffa32-25a7-49bd-befb-f76450219a2b tempest-ServersOnMultiNodesTest-79489 tempest-ServersOnMultiNodesTest-79489-project-admin] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:06.237427 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-0fcffa32-25a7-49bd-befb-f76450219a2b tempest-ServersOnMultiNodesTest-79489 tempest-ServersOnMultiNodesTest-79489-project-admin] [instance: bea7ce47-7ad2-4283-9b48-f4f61f71965a] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:01:06.245083 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0fcffa32-25a7-49bd-befb-f76450219a2b tempest-ServersOnMultiNodesTest-79489 tempest-ServersOnMultiNodesTest-79489-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:06.246517 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0fcffa32-25a7-49bd-befb-f76450219a2b tempest-ServersOnMultiNodesTest-79489 tempest-ServersOnMultiNodesTest-79489-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:06.246730 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0fcffa32-25a7-49bd-befb-f76450219a2b tempest-ServersOnMultiNodesTest-79489 tempest-ServersOnMultiNodesTest-79489-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:06.248061 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0fcffa32-25a7-49bd-befb-f76450219a2b tempest-ServersOnMultiNodesTest-79489 tempest-ServersOnMultiNodesTest-79489-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:06.248718 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0fcffa32-25a7-49bd-befb-f76450219a2b tempest-ServersOnMultiNodesTest-79489 tempest-ServersOnMultiNodesTest-79489-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:06.251148 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0fcffa32-25a7-49bd-befb-f76450219a2b tempest-ServersOnMultiNodesTest-79489 tempest-ServersOnMultiNodesTest-79489-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:06.385118 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-22890660-4c01-4654-b328-f32d3e909a45 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:01:06.395031 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-22890660-4c01-4654-b328-f32d3e909a45 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/0dabc2bf-08ff-45b5-a791-34d655349eae" status: 200 len: 1476 microversion: 2.1 time: 0.338581 Aug 10 23:01:06.395876 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 637/1261] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:01:06 2022] GET /compute/v2.1/servers/0dabc2bf-08ff-45b5-a791-34d655349eae => generated 1476 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:01:06.437851 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-0fcffa32-25a7-49bd-befb-f76450219a2b tempest-ServersOnMultiNodesTest-79489 tempest-ServersOnMultiNodesTest-79489-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/bea7ce47-7ad2-4283-9b48-f4f61f71965a" status: 200 len: 1622 microversion: 2.1 time: 0.176435 Aug 10 23:01:06.455264 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 625/1262] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:01:06 2022] GET /compute/v2.1/servers/bea7ce47-7ad2-4283-9b48-f4f61f71965a => generated 1622 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:01:06.455264 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-1308d2a3-32c3-4e39-8212-32573a50e3d0 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Calling method '.version_select at 0x7f847d173430>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:06.554837 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-1308d2a3-32c3-4e39-8212-32573a50e3d0 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] 10.222.0.58 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-680782145" status: 200 len: 484 microversion: 2.1 time: 0.112356 Aug 10 23:01:06.555460 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 626/1263] 10.222.0.58 () {58 vars in 1229 bytes} [Wed Aug 10 23:01:06 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-680782145 => generated 484 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:01:06.569134 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-a72c36ce-4814-46c3-a455-bdd3b21508be tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Action: 'create', calling method: .version_select at 0x7f847d1b7280>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-115096170", "policies": ["anti-affinity"]}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:01:06.598065 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-a72c36ce-4814-46c3-a455-bdd3b21508be tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Getting quotas for project b27e6ee9495a438b8450a4ef0d62cbcd. Resources: {'server_groups'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:01:06.615458 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-a72c36ce-4814-46c3-a455-bdd3b21508be tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Getting quotas for user 417d4eaaeb1c4df78745496ececb3e88 and project b27e6ee9495a438b8450a4ef0d62cbcd. Resources: {'server_groups'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:01:06.636605 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-858fa32d-d917-40a5-bcc8-9e5a2d04602f tempest-VolumesGetTestJSON-1380889781 tempest-VolumesGetTestJSON-1380889781-project] Action: 'create', calling method: .version_select at 0x7f847d2caee0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1257570878", "metadata": {"Type": "work"}}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:01:06.706696 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-a72c36ce-4814-46c3-a455-bdd3b21508be tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Getting quotas for project b27e6ee9495a438b8450a4ef0d62cbcd. Resources: {'server_groups'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:01:06.713391 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-a72c36ce-4814-46c3-a455-bdd3b21508be tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Getting quotas for user 417d4eaaeb1c4df78745496ececb3e88 and project b27e6ee9495a438b8450a4ef0d62cbcd. Resources: {'server_groups'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:01:06.731449 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-a72c36ce-4814-46c3-a455-bdd3b21508be tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] 10.222.0.58 "POST /compute/v2.1/os-server-groups" status: 200 len: 192 microversion: 2.1 time: 0.173903 Aug 10 23:01:06.745712 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 627/1264] 10.222.0.58 () {60 vars in 1174 bytes} [Wed Aug 10 23:01:06 2022] POST /compute/v2.1/os-server-groups => generated 192 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:01:06.747584 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-633cd6cf-e343-4b55-844f-2a2b4d08ed09 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Calling method '.version_select at 0x7f847d174820>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:06.920077 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-633cd6cf-e343-4b55-844f-2a2b4d08ed09 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] 10.222.0.58 "GET /compute/v2.1/images?server=d716cac6-ac7c-4b98-b6ea-2496ccd62096" status: 200 len: 956 microversion: 2.1 time: 0.179616 Aug 10 23:01:06.921464 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 628/1265] 10.222.0.58 () {58 vars in 1209 bytes} [Wed Aug 10 23:01:06 2022] GET /compute/v2.1/images?server=d716cac6-ac7c-4b98-b6ea-2496ccd62096 => generated 956 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:01:06.926635 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-33e40643-3ff5-4753-8d58-7ad45cee5ecf tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Calling method '.version_select at 0x7f847d1c6790>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:06.989611 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-33e40643-3ff5-4753-8d58-7ad45cee5ecf tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] 10.222.0.58 "GET /compute/v2.1/images/c00a0c31-f3f5-4dbc-ac74-d933d5bccb9e" status: 200 len: 1440 microversion: 2.1 time: 0.067028 Aug 10 23:01:06.999999 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 629/1266] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 10 23:01:06 2022] GET /compute/v2.1/images/c00a0c31-f3f5-4dbc-ac74-d933d5bccb9e => generated 1440 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:01:07.007495 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-303c0fa6-c3c7-4aef-83d5-cd181c815852 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Calling method '.version_select at 0x7f847d173940>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:07.070770 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-303c0fa6-c3c7-4aef-83d5-cd181c815852 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] 10.222.0.58 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.58%2Fcompute%2Fv2.1%2Fservers%2Fe1deb45a-4597-4456-a1bd-54013c9484a4" status: 200 len: 485 microversion: 2.1 time: 0.068060 Aug 10 23:01:07.071457 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 630/1267] 10.222.0.58 () {58 vars in 1317 bytes} [Wed Aug 10 23:01:07 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.58%2Fcompute%2Fv2.1%2Fservers%2Fe1deb45a-4597-4456-a1bd-54013c9484a4 => generated 485 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:01:07.084045 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-478a5197-3601-4965-a06c-750f707a4646 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1181785009", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "0df0c484-6d01-4147-a85f-ab4e11db152d"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:01:07.179885 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.network.neutron [None req-478a5197-3601-4965-a06c-750f707a4646 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] validate_networks() for None {{(pid=122632) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 23:01:07.332317 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-858fa32d-d917-40a5-bcc8-9e5a2d04602f tempest-VolumesGetTestJSON-1380889781 tempest-VolumesGetTestJSON-1380889781-project] 10.222.0.58 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.935211 Aug 10 23:01:07.334176 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 638/1268] 10.222.0.58 () {60 vars in 1156 bytes} [Wed Aug 10 23:01:06 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 937 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 10 23:01:07.339943 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-bad3a0bc-771f-4552-833b-ab3ade86c282 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Calling method '.version_select at 0x7f847d1508b0>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:07.428089 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-bad3a0bc-771f-4552-833b-ab3ade86c282 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] 10.222.0.58 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.58%2Fcompute%2Fservers%2Fe1deb45a-4597-4456-a1bd-54013c9484a4" status: 200 len: 485 microversion: 2.1 time: 0.092473 Aug 10 23:01:07.429775 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 639/1269] 10.222.0.58 () {58 vars in 1303 bytes} [Wed Aug 10 23:01:07 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.58%2Fcompute%2Fservers%2Fe1deb45a-4597-4456-a1bd-54013c9484a4 => generated 485 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:01:07.443527 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-527f77e3-24e4-4104-97df-3bb0602e3b68 tempest-VolumesGetTestJSON-1380889781 tempest-VolumesGetTestJSON-1380889781-project] Calling method '.version_select at 0x7f847d2cab80>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:07.539329 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-527f77e3-24e4-4104-97df-3bb0602e3b68 tempest-VolumesGetTestJSON-1380889781 tempest-VolumesGetTestJSON-1380889781-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/bd4e0d31-ac3a-426c-8841-dda9dc99e117" status: 200 len: 353 microversion: 2.1 time: 0.108154 Aug 10 23:01:07.540397 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 640/1270] 10.222.0.58 () {58 vars in 1245 bytes} [Wed Aug 10 23:01:07 2022] GET /compute/v2.1/os-volumes/bd4e0d31-ac3a-426c-8841-dda9dc99e117 => generated 353 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:01:07.551924 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-6250be1a-adc3-4c5e-bb60-14279d53aa61 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:07.552790 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-6250be1a-adc3-4c5e-bb60-14279d53aa61 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 0dabc2bf-08ff-45b5-a791-34d655349eae] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:01:07.562029 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6250be1a-adc3-4c5e-bb60-14279d53aa61 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:07.562930 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6250be1a-adc3-4c5e-bb60-14279d53aa61 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:07.563600 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6250be1a-adc3-4c5e-bb60-14279d53aa61 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:07.564528 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6250be1a-adc3-4c5e-bb60-14279d53aa61 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:07.565221 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6250be1a-adc3-4c5e-bb60-14279d53aa61 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:07.566102 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6250be1a-adc3-4c5e-bb60-14279d53aa61 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:07.585524 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-478a5197-3601-4965-a06c-750f707a4646 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Flavor limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:01:07.586859 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-478a5197-3601-4965-a06c-750f707a4646 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Image limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:01:07.587542 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-478a5197-3601-4965-a06c-750f707a4646 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Flavor pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:01:07.588193 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-478a5197-3601-4965-a06c-750f707a4646 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Image pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:01:07.589395 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-478a5197-3601-4965-a06c-750f707a4646 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:01:07.610602 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-478a5197-3601-4965-a06c-750f707a4646 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:07.611296 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-478a5197-3601-4965-a06c-750f707a4646 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:07.611822 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-478a5197-3601-4965-a06c-750f707a4646 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:07.612653 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-478a5197-3601-4965-a06c-750f707a4646 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:07.613215 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-478a5197-3601-4965-a06c-750f707a4646 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:07.613708 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-478a5197-3601-4965-a06c-750f707a4646 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:07.632014 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-478a5197-3601-4965-a06c-750f707a4646 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Getting quotas for project b27e6ee9495a438b8450a4ef0d62cbcd. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:01:07.639534 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-478a5197-3601-4965-a06c-750f707a4646 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Getting quotas for user 417d4eaaeb1c4df78745496ececb3e88 and project b27e6ee9495a438b8450a4ef0d62cbcd. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:01:07.654969 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-478a5197-3601-4965-a06c-750f707a4646 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Going to run 2 instances... {{(pid=122632) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 23:01:07.658107 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-478a5197-3601-4965-a06c-750f707a4646 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] [instance: ad02bba7-86a5-4148-a83e-0fbd71645e4a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78ad8905-f66f-4733-8be9-2b260f1fabed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122632) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 23:01:07.715431 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-478a5197-3601-4965-a06c-750f707a4646 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Getting quotas for project b27e6ee9495a438b8450a4ef0d62cbcd. Resources: {'server_group_members'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:01:07.723013 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-478a5197-3601-4965-a06c-750f707a4646 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Getting quotas for user 417d4eaaeb1c4df78745496ececb3e88 and project b27e6ee9495a438b8450a4ef0d62cbcd. Resources: {'server_group_members'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:01:07.766366 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-478a5197-3601-4965-a06c-750f707a4646 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Getting quotas for project b27e6ee9495a438b8450a4ef0d62cbcd. Resources: {'server_group_members'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:01:07.772493 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-478a5197-3601-4965-a06c-750f707a4646 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Getting quotas for user 417d4eaaeb1c4df78745496ececb3e88 and project b27e6ee9495a438b8450a4ef0d62cbcd. Resources: {'server_group_members'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:01:07.783914 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:01:07.790752 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-478a5197-3601-4965-a06c-750f707a4646 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] [instance: 0c897f8e-81a6-4929-85ed-9d9e8d6ec2cc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78ad8905-f66f-4733-8be9-2b260f1fabed',instance=,instance_uuid=ad02bba7-86a5-4148-a83e-0fbd71645e4a,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122632) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 23:01:07.816978 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-6250be1a-adc3-4c5e-bb60-14279d53aa61 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:01:07.830023 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-6250be1a-adc3-4c5e-bb60-14279d53aa61 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/0dabc2bf-08ff-45b5-a791-34d655349eae" status: 200 len: 1476 microversion: 2.1 time: 0.287871 Aug 10 23:01:07.831237 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 641/1271] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:01:07 2022] GET /compute/v2.1/servers/0dabc2bf-08ff-45b5-a791-34d655349eae => generated 1476 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:01:07.838713 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-4b4ae3cc-97fc-476b-898f-4f7bd479261f tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Calling method '.version_select at 0x7f847d2caee0>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:07.864020 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-478a5197-3601-4965-a06c-750f707a4646 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Getting quotas for project b27e6ee9495a438b8450a4ef0d62cbcd. Resources: {'server_group_members'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:01:07.870443 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-478a5197-3601-4965-a06c-750f707a4646 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Getting quotas for user 417d4eaaeb1c4df78745496ececb3e88 and project b27e6ee9495a438b8450a4ef0d62cbcd. Resources: {'server_group_members'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:01:07.914749 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-478a5197-3601-4965-a06c-750f707a4646 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Getting quotas for project b27e6ee9495a438b8450a4ef0d62cbcd. Resources: {'server_group_members'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:01:07.920214 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-478a5197-3601-4965-a06c-750f707a4646 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Getting quotas for user 417d4eaaeb1c4df78745496ececb3e88 and project b27e6ee9495a438b8450a4ef0d62cbcd. Resources: {'server_group_members'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:01:07.961225 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-478a5197-3601-4965-a06c-750f707a4646 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 0.888526 Aug 10 23:01:07.965695 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 631/1272] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 23:01:07 2022] POST /compute/v2.1/servers => generated 32 bytes in 893 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Aug 10 23:01:07.971311 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-46a3ecbd-e8ad-4192-bc1a-f2985f8bf19a tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:07.978247 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-46a3ecbd-e8ad-4192-bc1a-f2985f8bf19a tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '417d4eaaeb1c4df78745496ececb3e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27e6ee9495a438b8450a4ef0d62cbcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:01:07.980160 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-46a3ecbd-e8ad-4192-bc1a-f2985f8bf19a tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Searching by: {'deleted': False, 'project_id': 'b27e6ee9495a438b8450a4ef0d62cbcd'} {{(pid=122632) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 10 23:01:08.019725 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-46a3ecbd-e8ad-4192-bc1a-f2985f8bf19a tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:08.020223 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-46a3ecbd-e8ad-4192-bc1a-f2985f8bf19a tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:08.021947 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-46a3ecbd-e8ad-4192-bc1a-f2985f8bf19a tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:08.023377 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-46a3ecbd-e8ad-4192-bc1a-f2985f8bf19a tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:08.026009 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-46a3ecbd-e8ad-4192-bc1a-f2985f8bf19a tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:08.026525 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-46a3ecbd-e8ad-4192-bc1a-f2985f8bf19a tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:08.060667 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-4b4ae3cc-97fc-476b-898f-4f7bd479261f tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] 10.222.0.58 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3278 microversion: 2.1 time: 0.227356 Aug 10 23:01:08.090348 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 642/1273] 10.222.0.58 () {58 vars in 1149 bytes} [Wed Aug 10 23:01:07 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3278 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:01:08.097832 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-789be6d1-a6df-4f0b-8712-4d8d7dab2ce3 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Calling method '.version_select at 0x7f847d1db430>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:08.129084 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.multi_cell_list [None req-46a3ecbd-e8ad-4192-bc1a-f2985f8bf19a tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=122632) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 10 23:01:08.157688 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-789be6d1-a6df-4f0b-8712-4d8d7dab2ce3 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] 10.222.0.58 "GET /compute/v2.1/images/c00a0c31-f3f5-4dbc-ac74-d933d5bccb9e" status: 200 len: 1440 microversion: 2.1 time: 0.065230 Aug 10 23:01:08.158993 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 643/1274] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 10 23:01:08 2022] GET /compute/v2.1/images/c00a0c31-f3f5-4dbc-ac74-d933d5bccb9e => generated 1440 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:01:08.164748 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-83f757b5-fa4d-40e3-9e52-47148166fd83 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Calling method '.version_select at 0x7f847d150ee0>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:08.237285 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-46a3ecbd-e8ad-4192-bc1a-f2985f8bf19a tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] 10.222.0.58 "GET /compute/v2.1/servers" status: 200 len: 1666 microversion: 2.1 time: 0.269646 Aug 10 23:01:08.237954 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 632/1275] 10.222.0.58 () {58 vars in 1125 bytes} [Wed Aug 10 23:01:07 2022] GET /compute/v2.1/servers => generated 1666 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:01:08.251306 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-ea1d593e-e905-41cd-b302-f71d5a343da8 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:08.252362 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-ea1d593e-e905-41cd-b302-f71d5a343da8 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] [instance: 0c897f8e-81a6-4929-85ed-9d9e8d6ec2cc] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:01:08.289614 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-83f757b5-fa4d-40e3-9e52-47148166fd83 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] 10.222.0.58 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1429 microversion: 2.1 time: 0.122922 Aug 10 23:01:08.289614 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 644/1276] 10.222.0.58 () {58 vars in 1149 bytes} [Wed Aug 10 23:01:08 2022] GET /compute/v2.1/images?type=snapshot => generated 1429 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:01:08.299369 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-6a752230-f954-4d29-8f41-b64fbe872572 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Calling method '.version_select at 0x7f847d0e8430>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:08.544574 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-ea1d593e-e905-41cd-b302-f71d5a343da8 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '417d4eaaeb1c4df78745496ececb3e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27e6ee9495a438b8450a4ef0d62cbcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:01:08.551534 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-6a752230-f954-4d29-8f41-b64fbe872572 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] 10.222.0.58 "GET /compute/v2.1/images?limit=1" status: 200 len: 620 microversion: 2.1 time: 0.255902 Aug 10 23:01:08.554383 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 645/1277] 10.222.0.58 () {58 vars in 1137 bytes} [Wed Aug 10 23:01:08 2022] GET /compute/v2.1/images?limit=1 => generated 620 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:01:08.563340 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-fce625d8-e7b3-4e55-bd2e-0781328fd18a tempest-VolumesGetTestJSON-1380889781 tempest-VolumesGetTestJSON-1380889781-project] Calling method '.version_select at 0x7f847d3c0430>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:08.565508 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-ea1d593e-e905-41cd-b302-f71d5a343da8 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] 10.222.0.58 "GET /compute/v2.1/servers/0c897f8e-81a6-4929-85ed-9d9e8d6ec2cc" status: 200 len: 1219 microversion: 2.1 time: 0.318739 Aug 10 23:01:08.566364 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 633/1278] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:01:08 2022] GET /compute/v2.1/servers/0c897f8e-81a6-4929-85ed-9d9e8d6ec2cc => generated 1219 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:01:08.591725 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c454133a-6bc4-4021-80ce-80c6e15aafe6 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Calling method '.version_select at 0x7f847d3171f0>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:08.665728 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-fce625d8-e7b3-4e55-bd2e-0781328fd18a tempest-VolumesGetTestJSON-1380889781 tempest-VolumesGetTestJSON-1380889781-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/bd4e0d31-ac3a-426c-8841-dda9dc99e117" status: 200 len: 354 microversion: 2.1 time: 0.110055 Aug 10 23:01:08.666301 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 646/1279] 10.222.0.58 () {58 vars in 1245 bytes} [Wed Aug 10 23:01:08 2022] GET /compute/v2.1/os-volumes/bd4e0d31-ac3a-426c-8841-dda9dc99e117 => generated 354 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:01:08.680921 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-072c15cf-edc8-4585-9992-112e0ef3fda1 tempest-VolumesGetTestJSON-1380889781 tempest-VolumesGetTestJSON-1380889781-project] Calling method '.version_select at 0x7f847d0e84c0>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:08.790988 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-072c15cf-edc8-4585-9992-112e0ef3fda1 tempest-VolumesGetTestJSON-1380889781 tempest-VolumesGetTestJSON-1380889781-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/bd4e0d31-ac3a-426c-8841-dda9dc99e117" status: 200 len: 354 microversion: 2.1 time: 0.115825 Aug 10 23:01:08.791830 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 647/1280] 10.222.0.58 () {58 vars in 1245 bytes} [Wed Aug 10 23:01:08 2022] GET /compute/v2.1/os-volumes/bd4e0d31-ac3a-426c-8841-dda9dc99e117 => generated 354 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:01:08.806536 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-2988adb2-ccb2-4ce2-89b0-001e21b9de92 tempest-VolumesGetTestJSON-1380889781 tempest-VolumesGetTestJSON-1380889781-project] Calling method '.version_select at 0x7f847d0fc5e0>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:08.944497 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-2988adb2-ccb2-4ce2-89b0-001e21b9de92 tempest-VolumesGetTestJSON-1380889781 tempest-VolumesGetTestJSON-1380889781-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/bd4e0d31-ac3a-426c-8841-dda9dc99e117" status: 202 len: 0 microversion: 2.1 time: 0.143296 Aug 10 23:01:08.945631 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 648/1281] 10.222.0.58 () {58 vars in 1248 bytes} [Wed Aug 10 23:01:08 2022] DELETE /compute/v2.1/os-volumes/bd4e0d31-ac3a-426c-8841-dda9dc99e117 => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 10 23:01:08.954265 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-eb2a9218-2b64-4c3c-8fc9-0f156f78af72 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:08.955157 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-eb2a9218-2b64-4c3c-8fc9-0f156f78af72 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 0dabc2bf-08ff-45b5-a791-34d655349eae] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:01:08.976290 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-eb2a9218-2b64-4c3c-8fc9-0f156f78af72 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:08.977276 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-eb2a9218-2b64-4c3c-8fc9-0f156f78af72 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:08.978139 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-eb2a9218-2b64-4c3c-8fc9-0f156f78af72 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:08.979839 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-eb2a9218-2b64-4c3c-8fc9-0f156f78af72 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:08.980680 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-eb2a9218-2b64-4c3c-8fc9-0f156f78af72 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:08.981409 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-eb2a9218-2b64-4c3c-8fc9-0f156f78af72 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:09.123674 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-c454133a-6bc4-4021-80ce-80c6e15aafe6 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] 10.222.0.58 "GET /compute/v2.1/images/detail?changes-since=2022-08-10T22%3A59%3A04Z" status: 200 len: 6331 microversion: 2.1 time: 0.552835 Aug 10 23:01:09.125632 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 634/1282] 10.222.0.58 () {58 vars in 1220 bytes} [Wed Aug 10 23:01:08 2022] GET /compute/v2.1/images/detail?changes-since=2022-08-10T22%3A59%3A04Z => generated 6331 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:01:09.355426 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-70a8d2bd-8b78-437c-8b68-2a9177168a50 req-9bdacf5a-cffd-4d30-97a1-9e851dc4d77e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a68f86c-37de-4207-aa43-6a1350342a56", "name": "network-vif-plugged", "status": "completed", "tag": "c4194225-7832-4162-ab1c-9691d11ab1ae"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:01:09.360550 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-eb2a9218-2b64-4c3c-8fc9-0f156f78af72 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:01:09.372982 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-eb2a9218-2b64-4c3c-8fc9-0f156f78af72 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/0dabc2bf-08ff-45b5-a791-34d655349eae" status: 200 len: 1476 microversion: 2.1 time: 0.425810 Aug 10 23:01:09.379736 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 649/1283] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:01:08 2022] GET /compute/v2.1/servers/0dabc2bf-08ff-45b5-a791-34d655349eae => generated 1476 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:01:09.383933 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-70a8d2bd-8b78-437c-8b68-2a9177168a50 req-9bdacf5a-cffd-4d30-97a1-9e851dc4d77e service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:09.384758 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-70a8d2bd-8b78-437c-8b68-2a9177168a50 req-9bdacf5a-cffd-4d30-97a1-9e851dc4d77e service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:09.385794 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-70a8d2bd-8b78-437c-8b68-2a9177168a50 req-9bdacf5a-cffd-4d30-97a1-9e851dc4d77e service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:09.418390 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-cfe7b85b-8304-4732-8b37-6ecd48ce21fc tempest-VolumesGetTestJSON-1380889781 tempest-VolumesGetTestJSON-1380889781-project] Calling method '.version_select at 0x7f847d0fcc10>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:09.433432 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-70a8d2bd-8b78-437c-8b68-2a9177168a50 req-9bdacf5a-cffd-4d30-97a1-9e851dc4d77e service nova] Creating event network-vif-plugged:c4194225-7832-4162-ab1c-9691d11ab1ae for instance 2a68f86c-37de-4207-aa43-6a1350342a56 on n-h2-850468-14 Aug 10 23:01:09.445131 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-70a8d2bd-8b78-437c-8b68-2a9177168a50 req-9bdacf5a-cffd-4d30-97a1-9e851dc4d77e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.307765 Aug 10 23:01:09.450310 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 635/1284] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:01:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:01:09.463469 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-05c0c7a8-9587-49e8-b092-b89ad77e9672 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Calling method '.version_select at 0x7f847d2061f0>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:09.630531 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-cfe7b85b-8304-4732-8b37-6ecd48ce21fc tempest-VolumesGetTestJSON-1380889781 tempest-VolumesGetTestJSON-1380889781-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/bd4e0d31-ac3a-426c-8841-dda9dc99e117" status: 200 len: 353 microversion: 2.1 time: 0.247354 Aug 10 23:01:09.632974 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 650/1285] 10.222.0.58 () {58 vars in 1245 bytes} [Wed Aug 10 23:01:09 2022] GET /compute/v2.1/os-volumes/bd4e0d31-ac3a-426c-8841-dda9dc99e117 => generated 353 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:01:09.652400 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c089b38e-0871-4d09-ad49-6e0dd3673a82 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Calling method '.version_select at 0x7f847d107280>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:14.664421 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=2 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:01:15.107434 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=2 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:01:18.054368 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=4 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:01:18.550068 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=32 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:01:18.975355 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_api:SELECT=7 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:01:19.362714 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=4 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:01:19.369647 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:01:19.408126 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=30,nova_cell1:INSERT=1 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:01:19.982156 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-05c0c7a8-9587-49e8-b092-b89ad77e9672 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] 10.222.0.58 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-680782145" status: 200 len: 664 microversion: 2.1 time: 10.529629 Aug 10 23:01:19.988225 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-c089b38e-0871-4d09-ad49-6e0dd3673a82 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] 10.222.0.58 "GET /compute/v2.1/images/c00a0c31-f3f5-4dbc-ac74-d933d5bccb9e" status: 200 len: 1440 microversion: 2.1 time: 10.352821 Aug 10 23:01:19.996355 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 651/1286] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 10 23:01:09 2022] GET /compute/v2.1/images/c00a0c31-f3f5-4dbc-ac74-d933d5bccb9e => generated 1440 bytes in 10363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:01:19.996913 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 636/1287] 10.222.0.58 () {58 vars in 1250 bytes} [Wed Aug 10 23:01:09 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-680782145 => generated 664 bytes in 10545 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:01:20.001896 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-1c3711cb-7f4b-4a9d-8045-ce2dd7783c56 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:20.002461 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-132dee1b-6730-4cca-a2f3-c4577f0f6eec tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:20.002985 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-1c3711cb-7f4b-4a9d-8045-ce2dd7783c56 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] [instance: 0c897f8e-81a6-4929-85ed-9d9e8d6ec2cc] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:01:20.003227 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-132dee1b-6730-4cca-a2f3-c4577f0f6eec tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 0dabc2bf-08ff-45b5-a791-34d655349eae] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:01:20.010426 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1c3711cb-7f4b-4a9d-8045-ce2dd7783c56 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:20.011151 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-132dee1b-6730-4cca-a2f3-c4577f0f6eec tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:20.011412 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1c3711cb-7f4b-4a9d-8045-ce2dd7783c56 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:20.011642 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-132dee1b-6730-4cca-a2f3-c4577f0f6eec tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:20.012080 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-132dee1b-6730-4cca-a2f3-c4577f0f6eec tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:20.012352 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1c3711cb-7f4b-4a9d-8045-ce2dd7783c56 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:20.013045 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-132dee1b-6730-4cca-a2f3-c4577f0f6eec tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:20.013396 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1c3711cb-7f4b-4a9d-8045-ce2dd7783c56 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:20.013517 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-132dee1b-6730-4cca-a2f3-c4577f0f6eec tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:20.014695 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1c3711cb-7f4b-4a9d-8045-ce2dd7783c56 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:20.015065 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-132dee1b-6730-4cca-a2f3-c4577f0f6eec tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:20.015735 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1c3711cb-7f4b-4a9d-8045-ce2dd7783c56 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:20.227129 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-1c3711cb-7f4b-4a9d-8045-ce2dd7783c56 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '417d4eaaeb1c4df78745496ececb3e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27e6ee9495a438b8450a4ef0d62cbcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:01:20.227264 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-132dee1b-6730-4cca-a2f3-c4577f0f6eec tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:01:20.234486 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-132dee1b-6730-4cca-a2f3-c4577f0f6eec tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/0dabc2bf-08ff-45b5-a791-34d655349eae" status: 200 len: 1476 microversion: 2.1 time: 0.236374 Aug 10 23:01:20.236282 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 637/1288] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:01:19 2022] GET /compute/v2.1/servers/0dabc2bf-08ff-45b5-a791-34d655349eae => generated 1476 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:01:20.240946 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-71b7a666-5819-484d-be1c-f72b4b514c49 tempest-VolumesGetTestJSON-1380889781 tempest-VolumesGetTestJSON-1380889781-project] Calling method '.version_select at 0x7f847d0d4280>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:20.272045 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-71b7a666-5819-484d-be1c-f72b4b514c49 tempest-VolumesGetTestJSON-1380889781 tempest-VolumesGetTestJSON-1380889781-project] HTTP exception thrown: Volume bd4e0d31-ac3a-426c-8841-dda9dc99e117 could not be found. Aug 10 23:01:20.274085 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-71b7a666-5819-484d-be1c-f72b4b514c49 tempest-VolumesGetTestJSON-1380889781 tempest-VolumesGetTestJSON-1380889781-project] Request method failure captured: Aug 10 23:01:20.274085 n-d-850468-14 devstack@n-api.service[122632]: request: GET /compute/v2.1/os-volumes/bd4e0d31-ac3a-426c-8841-dda9dc99e117 HTTP/1.1 Aug 10 23:01:20.274085 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:01:20.274085 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:01:20.274085 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:01:20.274085 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 23:01:20.274085 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:01:20.274085 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:01:20.274085 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:01:20.274085 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:01:20.274085 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9DixEN7rtJ5CU_mxDeb6jOJ9UY4g-f1zWBkJB85-yFcWMCQCYyRUxBis_7f5yt14DU9bTr2sVjeBJOwWuP9lisw1RdCKunqpapeb_KWIw_4lRTITdPZQUIUpp12tIrnqp_mT6SYB8UlBoBNV9gRtp3VGDteaHjcX0ba0KqM5i8sb0gA Aug 10 23:01:20.274085 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:01:20.274085 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:01:20.274085 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:01:20.274085 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:01:20.274085 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:01:20.274085 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:01:20.274085 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: c54dc8cd85b24ba1a88fd07795b47058 Aug 10 23:01:20.274085 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-VolumesGetTestJSON-1380889781 Aug 10 23:01:20.274085 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:01:20.274085 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:01:20.275871 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c54dc8cd85b24ba1a88fd07795b47058"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c54dc8cd85b24ba1a88fd07795b47058"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/c54dc8cd85b24ba1a88fd07795b47058"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_c54dc8cd85b24ba1a88fd07795b47058", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:01:20.275871 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-VolumesGetTestJSON-1380889781 Aug 10 23:01:20.275871 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: c54dc8cd85b24ba1a88fd07795b47058 Aug 10 23:01:20.275871 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-VolumesGetTestJSON-1380889781 Aug 10 23:01:20.275871 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-VolumesGetTestJSON-1380889781-project Aug 10 23:01:20.275871 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:01:20.275871 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:01:20.275871 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: 2deaa6c027eb4c3da6995a5bb47bad3d Aug 10 23:01:20.275871 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-VolumesGetTestJSON-1380889781-project Aug 10 23:01:20.275871 n-d-850468-14 devstack@n-api.service[122632]: method: Aug 10 23:01:20.275871 n-d-850468-14 devstack@n-api.service[122632]: exception: Volume bd4e0d31-ac3a-426c-8841-dda9dc99e117 could not be found. Aug 10 23:01:20.275871 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': 'bd4e0d31-ac3a-426c-8841-dda9dc99e117'} Aug 10 23:01:20.275871 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:01:20.277009 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:01:20.277009 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 23:01:20.277009 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 23:01:20.277009 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 10 23:01:20.277009 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 10 23:01:20.277009 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 10 23:01:20.277009 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 10 23:01:20.277009 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 10 23:01:20.277009 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 10 23:01:20.277009 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 10 23:01:20.277009 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 10 23:01:20.277009 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 23:01:20.277009 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 23:01:20.277009 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 23:01:20.277009 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 23:01:20.277009 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume bd4e0d31-ac3a-426c-8841-dda9dc99e117 could not be found. (HTTP 404) (Request-ID: req-b5475b27-a617-4cfc-9323-8a0d7f481d38) Aug 10 23:01:20.277009 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:01:20.277009 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:01:20.277009 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:01:20.278436 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:01:20.278436 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 10 23:01:20.278436 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 10 23:01:20.278436 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 10 23:01:20.278436 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 10 23:01:20.278436 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 10 23:01:20.278436 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 10 23:01:20.278436 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 10 23:01:20.278436 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 10 23:01:20.278436 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 23:01:20.278436 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 23:01:20.278436 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 10 23:01:20.278436 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 10 23:01:20.278436 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 10 23:01:20.278436 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 10 23:01:20.278436 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 10 23:01:20.278436 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 10 23:01:20.278436 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 10 23:01:20.278436 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 10 23:01:20.279888 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 23:01:20.279888 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 23:01:20.279888 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 23:01:20.279888 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 23:01:20.279888 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume bd4e0d31-ac3a-426c-8841-dda9dc99e117 could not be found. Aug 10 23:01:20.279888 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:01:20.279888 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:01:20.279888 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:01:20.279888 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:01:20.279888 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:01:20.279888 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:01:20.279888 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:01:20.279888 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:01:20.279888 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 23:01:20.279888 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 23:01:20.279888 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:01:20.279888 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:01:20.279888 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 10 23:01:20.279888 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:01:20.281550 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume bd4e0d31-ac3a-426c-8841-dda9dc99e117 could not be found. Aug 10 23:01:20.281550 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:01:20.281550 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:01:20.281550 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:01:20.281550 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:01:20.281550 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:01:20.281550 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:01:20.281550 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:01:20.281550 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:01:20.281550 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume bd4e0d31-ac3a-426c-8841-dda9dc99e117 could not be found. Aug 10 23:01:20.281550 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:01:20.282539 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-1c3711cb-7f4b-4a9d-8045-ce2dd7783c56 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] 10.222.0.58 "GET /compute/v2.1/servers/0c897f8e-81a6-4929-85ed-9d9e8d6ec2cc" status: 200 len: 1319 microversion: 2.1 time: 0.274433 Aug 10 23:01:20.286806 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 652/1289] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:01:19 2022] GET /compute/v2.1/servers/0c897f8e-81a6-4929-85ed-9d9e8d6ec2cc => generated 1319 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:01:20.286976 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-71b7a666-5819-484d-be1c-f72b4b514c49 tempest-VolumesGetTestJSON-1380889781 tempest-VolumesGetTestJSON-1380889781-project] Returning 404 to user: Volume bd4e0d31-ac3a-426c-8841-dda9dc99e117 could not be found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:01:20.286976 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-71b7a666-5819-484d-be1c-f72b4b514c49 tempest-VolumesGetTestJSON-1380889781 tempest-VolumesGetTestJSON-1380889781-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/bd4e0d31-ac3a-426c-8841-dda9dc99e117" status: 404 len: 109 microversion: 2.1 time: 0.048125 Aug 10 23:01:20.286976 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 638/1290] 10.222.0.58 () {58 vars in 1245 bytes} [Wed Aug 10 23:01:20 2022] GET /compute/v2.1/os-volumes/bd4e0d31-ac3a-426c-8841-dda9dc99e117 => generated 109 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:01:20.293860 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-926e2a2b-d3e5-4eac-8cb8-3d75f4d27827 tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:20.297354 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-926e2a2b-d3e5-4eac-8cb8-3d75f4d27827 tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] [instance: 8e91f1ac-f79d-4ab0-aa13-ea32b0e74888] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:01:20.304689 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-729099a3-c809-4626-a873-df34174b188b req-247e5875-3b99-4d0c-89f4-389915f32202 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d716cac6-ac7c-4b98-b6ea-2496ccd62096", "name": "network-vif-unplugged", "status": "completed", "tag": "30ea23cf-a364-4798-a6be-6ab46d11599e"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:01:20.310437 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-926e2a2b-d3e5-4eac-8cb8-3d75f4d27827 tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:20.314980 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-926e2a2b-d3e5-4eac-8cb8-3d75f4d27827 tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:20.314980 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-926e2a2b-d3e5-4eac-8cb8-3d75f4d27827 tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:20.314980 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-926e2a2b-d3e5-4eac-8cb8-3d75f4d27827 tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:20.314980 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-926e2a2b-d3e5-4eac-8cb8-3d75f4d27827 tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:20.315352 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-926e2a2b-d3e5-4eac-8cb8-3d75f4d27827 tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:20.315732 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-729099a3-c809-4626-a873-df34174b188b req-247e5875-3b99-4d0c-89f4-389915f32202 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:20.316211 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-729099a3-c809-4626-a873-df34174b188b req-247e5875-3b99-4d0c-89f4-389915f32202 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:20.316809 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-729099a3-c809-4626-a873-df34174b188b req-247e5875-3b99-4d0c-89f4-389915f32202 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:20.332021 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-729099a3-c809-4626-a873-df34174b188b req-247e5875-3b99-4d0c-89f4-389915f32202 service nova] Creating event network-vif-unplugged:30ea23cf-a364-4798-a6be-6ab46d11599e for instance d716cac6-ac7c-4b98-b6ea-2496ccd62096 on n-h2-850468-14 Aug 10 23:01:20.337317 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-729099a3-c809-4626-a873-df34174b188b req-247e5875-3b99-4d0c-89f4-389915f32202 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.052822 Aug 10 23:01:20.337958 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 653/1291] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:01:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:01:20.523857 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-926e2a2b-d3e5-4eac-8cb8-3d75f4d27827 tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/8e91f1ac-f79d-4ab0-aa13-ea32b0e74888" status: 200 len: 1861 microversion: 2.1 time: 0.236789 Aug 10 23:01:20.524453 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 639/1292] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:01:20 2022] GET /compute/v2.1/servers/8e91f1ac-f79d-4ab0-aa13-ea32b0e74888 => generated 1861 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:01:20.567370 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-634de234-9748-48fd-b2ec-a2978dd99a3f req-04a9536c-5c59-425e-800f-090860e76528 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c897f8e-81a6-4929-85ed-9d9e8d6ec2cc", "tag": "358851aa-3530-44ad-8603-dafd78d42181"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:01:20.588972 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-634de234-9748-48fd-b2ec-a2978dd99a3f req-04a9536c-5c59-425e-800f-090860e76528 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:20.590090 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-634de234-9748-48fd-b2ec-a2978dd99a3f req-04a9536c-5c59-425e-800f-090860e76528 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:20.594046 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-634de234-9748-48fd-b2ec-a2978dd99a3f req-04a9536c-5c59-425e-800f-090860e76528 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:20.621707 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-634de234-9748-48fd-b2ec-a2978dd99a3f req-04a9536c-5c59-425e-800f-090860e76528 service nova] Creating event network-changed:358851aa-3530-44ad-8603-dafd78d42181 for instance 0c897f8e-81a6-4929-85ed-9d9e8d6ec2cc on n-h2-850468-14 Aug 10 23:01:20.634008 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-634de234-9748-48fd-b2ec-a2978dd99a3f req-04a9536c-5c59-425e-800f-090860e76528 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.293036 Aug 10 23:01:20.639720 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 654/1293] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:01:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:01:20.653585 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-8b0bc300-bf64-43a8-b477-58e250c823ee tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Calling method '.version_select at 0x7f847d0fc790>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:20.727299 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-3d7bbef0-02e3-4172-bc99-f71db11cc431 tempest-ImagesDeleteNegativeTestJSON-1221685149 tempest-ImagesDeleteNegativeTestJSON-1221685149-project] 10.222.0.58 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.197748 Aug 10 23:01:20.732569 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 640/1294] 10.222.0.58 () {58 vars in 1128 bytes} [Wed Aug 10 23:01:20 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 10 23:01:20.739450 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-2e7280f0-3676-431f-a1d5-ebfa6e4b6552 tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-850468-14", "block_migration": true, "disk_over_commit": false}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:01:20.742733 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-2e7280f0-3676-431f-a1d5-ebfa6e4b6552 tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] [instance: 8e91f1ac-f79d-4ab0-aa13-ea32b0e74888] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:01:20.750444 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2e7280f0-3676-431f-a1d5-ebfa6e4b6552 tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:20.751359 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2e7280f0-3676-431f-a1d5-ebfa6e4b6552 tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:20.752276 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2e7280f0-3676-431f-a1d5-ebfa6e4b6552 tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:20.753321 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2e7280f0-3676-431f-a1d5-ebfa6e4b6552 tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:20.754143 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2e7280f0-3676-431f-a1d5-ebfa6e4b6552 tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:20.754727 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2e7280f0-3676-431f-a1d5-ebfa6e4b6552 tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:20.788416 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.objects.instance [None req-2e7280f0-3676-431f-a1d5-ebfa6e4b6552 tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Lazy-loading 'flavor' on Instance uuid 8e91f1ac-f79d-4ab0-aa13-ea32b0e74888 {{(pid=122632) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:01:20.807847 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-2e7280f0-3676-431f-a1d5-ebfa6e4b6552 tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] [instance: 8e91f1ac-f79d-4ab0-aa13-ea32b0e74888] Going to try to live migrate instance to n-h1-850468-14 {{(pid=122632) live_migrate /opt/stack/nova/nova/compute/api.py:5443}} Aug 10 23:01:20.862009 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-8b0bc300-bf64-43a8-b477-58e250c823ee tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] 10.222.0.58 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.58%2Fcompute%2Fv2.1%2Fservers%2Fe1deb45a-4597-4456-a1bd-54013c9484a4" status: 200 len: 1467 microversion: 2.1 time: 0.220717 Aug 10 23:01:20.862707 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 655/1295] 10.222.0.58 () {58 vars in 1338 bytes} [Wed Aug 10 23:01:20 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.58%2Fcompute%2Fv2.1%2Fservers%2Fe1deb45a-4597-4456-a1bd-54013c9484a4 => generated 1467 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:01:20.889194 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-fdb0699a-8a77-4a7e-aff6-2b6a54850f33 tempest-ImagesDeleteNegativeTestJSON-1221685149 tempest-ImagesDeleteNegativeTestJSON-1221685149-project] Calling method '.version_select at 0x7f847d107430>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:21.001930 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-fdb0699a-8a77-4a7e-aff6-2b6a54850f33 tempest-ImagesDeleteNegativeTestJSON-1221685149 tempest-ImagesDeleteNegativeTestJSON-1221685149-project] HTTP exception thrown: Image not found. Aug 10 23:01:21.044551 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-fdb0699a-8a77-4a7e-aff6-2b6a54850f33 tempest-ImagesDeleteNegativeTestJSON-1221685149 tempest-ImagesDeleteNegativeTestJSON-1221685149-project] Request method failure captured: Aug 10 23:01:21.044551 n-d-850468-14 devstack@n-api.service[122633]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Aug 10 23:01:21.044551 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:01:21.044551 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:01:21.044551 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:01:21.044551 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:01:21.044551 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:01:21.044551 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:01:21.044551 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:01:21.044551 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:01:21.044551 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9Di89WXXNuM0eRM3p9JxR8hyrT6j02Nj_jYhk7silTINS7s0Ykmo8BkOvlrowi8m1N7BMGMLMBKLU27E_RFQF0Fbz9ijb9RV3tUTptJ2VnkECVhNOi_3Iy0BaMR2kJ-9Cqn92Qmot9NiRzknUee87EaSN8zQlB3RvJcCs8Eh7rKcEjY Aug 10 23:01:21.044551 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:01:21.044551 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:01:21.044551 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:01:21.044551 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:01:21.044551 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:01:21.044551 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:01:21.044551 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 7ca0b899147d4282870bd42175ac91fb Aug 10 23:01:21.044551 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1221685149 Aug 10 23:01:21.044551 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:01:21.044551 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:01:21.046370 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7ca0b899147d4282870bd42175ac91fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7ca0b899147d4282870bd42175ac91fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7ca0b899147d4282870bd42175ac91fb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7ca0b899147d4282870bd42175ac91fb", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:01:21.046370 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1221685149 Aug 10 23:01:21.046370 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 7ca0b899147d4282870bd42175ac91fb Aug 10 23:01:21.046370 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1221685149 Aug 10 23:01:21.046370 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-ImagesDeleteNegativeTestJSON-1221685149-project Aug 10 23:01:21.046370 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:01:21.046370 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:01:21.046370 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: ab6db749e3f14bb2b8234fd63d48ee9e Aug 10 23:01:21.046370 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1221685149-project Aug 10 23:01:21.046370 n-d-850468-14 devstack@n-api.service[122633]: method: Aug 10 23:01:21.046370 n-d-850468-14 devstack@n-api.service[122633]: exception: Image not found. Aug 10 23:01:21.046370 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': '-1'} Aug 10 23:01:21.046370 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:01:21.046370 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:01:21.047513 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 10 23:01:21.047513 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 10 23:01:21.047513 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 10 23:01:21.047513 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 10 23:01:21.047513 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 10 23:01:21.047513 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 10 23:01:21.047513 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 10 23:01:21.047513 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 10 23:01:21.047513 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 10 23:01:21.047513 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 10 23:01:21.047513 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 10 23:01:21.047513 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 10 23:01:21.047513 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 10 23:01:21.047513 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 10 23:01:21.047513 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Aug 10 23:01:21.047513 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:01:21.047513 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:01:21.047513 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:01:21.047513 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:01:21.049038 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 10 23:01:21.049038 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 10 23:01:21.049038 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 10 23:01:21.049038 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 10 23:01:21.049038 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 10 23:01:21.049038 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 10 23:01:21.049038 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Aug 10 23:01:21.049038 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:01:21.049038 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:01:21.049038 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:01:21.049038 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:01:21.049038 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:01:21.049038 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:01:21.049038 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:01:21.049038 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:01:21.049038 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 23:01:21.049038 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 23:01:21.049038 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:01:21.049038 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:01:21.049038 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 10 23:01:21.050496 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 10 23:01:21.050496 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 10 23:01:21.050496 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:01:21.050496 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:01:21.050496 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:01:21.050496 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:01:21.050496 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:01:21.050496 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:01:21.050496 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:01:21.050496 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:01:21.050496 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 10 23:01:21.050496 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:01:21.050496 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-fdb0699a-8a77-4a7e-aff6-2b6a54850f33 tempest-ImagesDeleteNegativeTestJSON-1221685149 tempest-ImagesDeleteNegativeTestJSON-1221685149-project] Returning 404 to user: Image not found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:01:21.052000 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-fdb0699a-8a77-4a7e-aff6-2b6a54850f33 tempest-ImagesDeleteNegativeTestJSON-1221685149 tempest-ImagesDeleteNegativeTestJSON-1221685149-project] 10.222.0.58 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.175673 Aug 10 23:01:21.052106 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 656/1296] 10.222.0.58 () {58 vars in 1134 bytes} [Wed Aug 10 23:01:20 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 189 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 10 23:01:21.065258 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-35fba5f5-9123-420b-8aa1-b8338cca78ae tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Calling method '.version_select at 0x7f847d150dc0>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:21.196101 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-35fba5f5-9123-420b-8aa1-b8338cca78ae tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] 10.222.0.58 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.58%2Fcompute%2Fservers%2Fe1deb45a-4597-4456-a1bd-54013c9484a4" status: 200 len: 1467 microversion: 2.1 time: 0.138303 Aug 10 23:01:21.206969 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 657/1297] 10.222.0.58 () {58 vars in 1324 bytes} [Wed Aug 10 23:01:21 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.58%2Fcompute%2Fservers%2Fe1deb45a-4597-4456-a1bd-54013c9484a4 => generated 1467 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:01:21.211490 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-772ed815-8899-441b-9ac1-306485cef83a tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Calling method '.version_select at 0x7f847d098430>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:21.366405 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-772ed815-8899-441b-9ac1-306485cef83a tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] 10.222.0.58 "GET /compute/v2.1/images/c00a0c31-f3f5-4dbc-ac74-d933d5bccb9e" status: 200 len: 1440 microversion: 2.1 time: 0.168309 Aug 10 23:01:21.367645 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 658/1298] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 10 23:01:21 2022] GET /compute/v2.1/images/c00a0c31-f3f5-4dbc-ac74-d933d5bccb9e => generated 1440 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:01:21.375066 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-d4832d6c-0889-41d1-972f-7347a74d4694 tempest-ImagesDeleteNegativeTestJSON-1221685149 tempest-ImagesDeleteNegativeTestJSON-1221685149-project] Calling method '.version_select at 0x7f847d1509d0>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:21.426559 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-d4832d6c-0889-41d1-972f-7347a74d4694 tempest-ImagesDeleteNegativeTestJSON-1221685149 tempest-ImagesDeleteNegativeTestJSON-1221685149-project] HTTP exception thrown: Image not found. Aug 10 23:01:21.431545 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-d4832d6c-0889-41d1-972f-7347a74d4694 tempest-ImagesDeleteNegativeTestJSON-1221685149 tempest-ImagesDeleteNegativeTestJSON-1221685149-project] Request method failure captured: Aug 10 23:01:21.431545 n-d-850468-14 devstack@n-api.service[122633]: request: DELETE /compute/v2.1/images/a2c30c8a-b060-4788-a173-84743788614j HTTP/1.1 Aug 10 23:01:21.431545 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:01:21.431545 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:01:21.431545 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:01:21.431545 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:01:21.431545 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:01:21.431545 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:01:21.431545 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:01:21.431545 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:01:21.431545 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9Di89WXXNuM0eRM3p9JxR8hyrT6j02Nj_jYhk7silTINS7s0Ykmo8BkOvlrowi8m1N7BMGMLMBKLU27E_RFQF0Fbz9ijb9RV3tUTptJ2VnkECVhNOi_3Iy0BaMR2kJ-9Cqn92Qmot9NiRzknUee87EaSN8zQlB3RvJcCs8Eh7rKcEjY Aug 10 23:01:21.431545 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:01:21.431545 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:01:21.431545 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:01:21.431545 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:01:21.431545 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:01:21.431545 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:01:21.431545 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 7ca0b899147d4282870bd42175ac91fb Aug 10 23:01:21.431545 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1221685149 Aug 10 23:01:21.431545 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:01:21.431545 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:01:21.432939 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7ca0b899147d4282870bd42175ac91fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7ca0b899147d4282870bd42175ac91fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7ca0b899147d4282870bd42175ac91fb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7ca0b899147d4282870bd42175ac91fb", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:01:21.432939 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1221685149 Aug 10 23:01:21.432939 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 7ca0b899147d4282870bd42175ac91fb Aug 10 23:01:21.432939 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1221685149 Aug 10 23:01:21.432939 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-ImagesDeleteNegativeTestJSON-1221685149-project Aug 10 23:01:21.432939 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:01:21.432939 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:01:21.432939 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: ab6db749e3f14bb2b8234fd63d48ee9e Aug 10 23:01:21.432939 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1221685149-project Aug 10 23:01:21.432939 n-d-850468-14 devstack@n-api.service[122633]: method: Aug 10 23:01:21.432939 n-d-850468-14 devstack@n-api.service[122633]: exception: Image not found. Aug 10 23:01:21.432939 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': 'a2c30c8a-b060-4788-a173-84743788614j'} Aug 10 23:01:21.432939 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:01:21.433784 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:01:21.433784 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 10 23:01:21.433784 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 10 23:01:21.433784 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 10 23:01:21.433784 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 10 23:01:21.433784 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 10 23:01:21.433784 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 10 23:01:21.433784 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 10 23:01:21.433784 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 10 23:01:21.433784 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 10 23:01:21.433784 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 10 23:01:21.433784 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 10 23:01:21.433784 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 10 23:01:21.433784 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 10 23:01:21.433784 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 10 23:01:21.433784 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image a2c30c8a-b060-4788-a173-84743788614j to delete Aug 10 23:01:21.433784 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:01:21.433784 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:01:21.433784 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:01:21.435247 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:01:21.435247 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 10 23:01:21.435247 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 10 23:01:21.435247 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 10 23:01:21.435247 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 10 23:01:21.435247 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 10 23:01:21.435247 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 10 23:01:21.435247 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image a2c30c8a-b060-4788-a173-84743788614j could not be found. Aug 10 23:01:21.435247 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:01:21.435247 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:01:21.435247 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:01:21.435247 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:01:21.435247 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:01:21.435247 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:01:21.435247 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:01:21.435247 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:01:21.435247 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 23:01:21.435247 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 23:01:21.435247 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:01:21.435247 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:01:21.441329 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 10 23:01:21.441329 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 10 23:01:21.441329 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 10 23:01:21.441329 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:01:21.441329 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:01:21.441329 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:01:21.441329 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:01:21.441329 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:01:21.441329 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:01:21.441329 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:01:21.441329 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:01:21.441329 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 10 23:01:21.441329 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:01:21.441329 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-d4832d6c-0889-41d1-972f-7347a74d4694 tempest-ImagesDeleteNegativeTestJSON-1221685149 tempest-ImagesDeleteNegativeTestJSON-1221685149-project] Returning 404 to user: Image not found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:01:21.441329 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-d4832d6c-0889-41d1-972f-7347a74d4694 tempest-ImagesDeleteNegativeTestJSON-1221685149 tempest-ImagesDeleteNegativeTestJSON-1221685149-project] 10.222.0.58 "DELETE /compute/v2.1/images/a2c30c8a-b060-4788-a173-84743788614j" status: 404 len: 62 microversion: 2.1 time: 0.062512 Aug 10 23:01:21.446961 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 659/1299] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:01:21 2022] DELETE /compute/v2.1/images/a2c30c8a-b060-4788-a173-84743788614j => generated 62 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 10 23:01:21.456694 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-4b41c6ce-1aa3-4859-8661-c26aeeea011e tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Calling method '.version_select at 0x7f847d0981f0>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:21.791404 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-4b41c6ce-1aa3-4859-8661-c26aeeea011e tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] 10.222.0.58 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7106 microversion: 2.1 time: 0.345938 Aug 10 23:01:21.807761 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 660/1300] 10.222.0.58 () {58 vars in 1170 bytes} [Wed Aug 10 23:01:21 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7106 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:01:22.285090 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-56f63fa5-0227-4137-9a25-fceb76437231 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:22.285897 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-56f63fa5-0227-4137-9a25-fceb76437231 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 0dabc2bf-08ff-45b5-a791-34d655349eae] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:01:22.300748 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-56f63fa5-0227-4137-9a25-fceb76437231 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:22.313804 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-56f63fa5-0227-4137-9a25-fceb76437231 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:22.314523 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-56f63fa5-0227-4137-9a25-fceb76437231 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:22.317065 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-56f63fa5-0227-4137-9a25-fceb76437231 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:22.317768 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-56f63fa5-0227-4137-9a25-fceb76437231 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:22.319211 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-56f63fa5-0227-4137-9a25-fceb76437231 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:22.650181 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-56f63fa5-0227-4137-9a25-fceb76437231 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:01:22.666296 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-56f63fa5-0227-4137-9a25-fceb76437231 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/0dabc2bf-08ff-45b5-a791-34d655349eae" status: 200 len: 1476 microversion: 2.1 time: 0.853445 Aug 10 23:01:22.667421 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 661/1301] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:01:21 2022] GET /compute/v2.1/servers/0dabc2bf-08ff-45b5-a791-34d655349eae => generated 1476 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:01:22.681993 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-5bc9db10-4f0b-46f9-8474-dbacc0262732 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:22.682950 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-5bc9db10-4f0b-46f9-8474-dbacc0262732 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] [instance: 0c897f8e-81a6-4929-85ed-9d9e8d6ec2cc] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:01:22.702358 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5bc9db10-4f0b-46f9-8474-dbacc0262732 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:22.705081 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5bc9db10-4f0b-46f9-8474-dbacc0262732 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:22.705534 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5bc9db10-4f0b-46f9-8474-dbacc0262732 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:22.706271 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5bc9db10-4f0b-46f9-8474-dbacc0262732 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:22.708032 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5bc9db10-4f0b-46f9-8474-dbacc0262732 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:22.708468 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5bc9db10-4f0b-46f9-8474-dbacc0262732 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:22.956404 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-2e7280f0-3676-431f-a1d5-ebfa6e4b6552 tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/8e91f1ac-f79d-4ab0-aa13-ea32b0e74888/action" status: 202 len: 0 microversion: 2.1 time: 2.221836 Aug 10 23:01:22.958025 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 641/1302] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:01:20 2022] POST /compute/v2.1/servers/8e91f1ac-f79d-4ab0-aa13-ea32b0e74888/action => generated 0 bytes in 2224 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:01:22.970842 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-4f325859-69d0-49b4-8174-b3c93a256739 tempest-ImagesDeleteNegativeTestJSON-1221685149 tempest-ImagesDeleteNegativeTestJSON-1221685149-project] Calling method '.version_select at 0x7f847d1b7c10>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:22.994491 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-4f325859-69d0-49b4-8174-b3c93a256739 tempest-ImagesDeleteNegativeTestJSON-1221685149 tempest-ImagesDeleteNegativeTestJSON-1221685149-project] HTTP exception thrown: Image not found. Aug 10 23:01:23.001112 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-4f325859-69d0-49b4-8174-b3c93a256739 tempest-ImagesDeleteNegativeTestJSON-1221685149 tempest-ImagesDeleteNegativeTestJSON-1221685149-project] Request method failure captured: Aug 10 23:01:23.001112 n-d-850468-14 devstack@n-api.service[122632]: request: DELETE /compute/v2.1/images/c5619ee8-8744-440b-82f7-277c91deea421 HTTP/1.1 Aug 10 23:01:23.001112 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:01:23.001112 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:01:23.001112 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:01:23.001112 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 23:01:23.001112 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:01:23.001112 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:01:23.001112 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:01:23.001112 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:01:23.001112 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9Di89WXXNuM0eRM3p9JxR8hyrT6j02Nj_jYhk7silTINS7s0Ykmo8BkOvlrowi8m1N7BMGMLMBKLU27E_RFQF0Fbz9ijb9RV3tUTptJ2VnkECVhNOi_3Iy0BaMR2kJ-9Cqn92Qmot9NiRzknUee87EaSN8zQlB3RvJcCs8Eh7rKcEjY Aug 10 23:01:23.001112 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:01:23.001112 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:01:23.001112 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:01:23.001112 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:01:23.001112 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:01:23.001112 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:01:23.001112 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 7ca0b899147d4282870bd42175ac91fb Aug 10 23:01:23.001112 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1221685149 Aug 10 23:01:23.001112 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:01:23.001112 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:01:23.002726 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7ca0b899147d4282870bd42175ac91fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7ca0b899147d4282870bd42175ac91fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7ca0b899147d4282870bd42175ac91fb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7ca0b899147d4282870bd42175ac91fb", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:01:23.002726 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1221685149 Aug 10 23:01:23.002726 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 7ca0b899147d4282870bd42175ac91fb Aug 10 23:01:23.002726 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1221685149 Aug 10 23:01:23.002726 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-ImagesDeleteNegativeTestJSON-1221685149-project Aug 10 23:01:23.002726 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:01:23.002726 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:01:23.002726 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: ab6db749e3f14bb2b8234fd63d48ee9e Aug 10 23:01:23.002726 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1221685149-project Aug 10 23:01:23.002726 n-d-850468-14 devstack@n-api.service[122632]: method: Aug 10 23:01:23.002726 n-d-850468-14 devstack@n-api.service[122632]: exception: Image not found. Aug 10 23:01:23.002726 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': 'c5619ee8-8744-440b-82f7-277c91deea421'} Aug 10 23:01:23.002726 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:01:23.004827 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:01:23.004827 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 10 23:01:23.004827 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 10 23:01:23.004827 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 10 23:01:23.004827 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 10 23:01:23.004827 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 10 23:01:23.004827 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 10 23:01:23.004827 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 10 23:01:23.004827 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 10 23:01:23.004827 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 10 23:01:23.004827 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 10 23:01:23.004827 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 10 23:01:23.004827 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 10 23:01:23.004827 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 10 23:01:23.004827 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 10 23:01:23.004827 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image c5619ee8-8744-440b-82f7-277c91deea421 to delete Aug 10 23:01:23.004827 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:01:23.004827 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:01:23.004827 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:01:23.006548 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:01:23.006548 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 10 23:01:23.006548 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 10 23:01:23.006548 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 10 23:01:23.006548 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 10 23:01:23.006548 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 10 23:01:23.006548 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 10 23:01:23.006548 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image c5619ee8-8744-440b-82f7-277c91deea421 could not be found. Aug 10 23:01:23.006548 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:01:23.006548 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:01:23.006548 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:01:23.006548 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:01:23.006548 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:01:23.006548 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:01:23.006548 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:01:23.006548 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:01:23.006548 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 23:01:23.006548 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 23:01:23.006548 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:01:23.006548 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:01:23.008166 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 10 23:01:23.008166 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 10 23:01:23.008166 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 10 23:01:23.008166 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:01:23.008166 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:01:23.008166 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:01:23.008166 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:01:23.008166 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:01:23.008166 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:01:23.008166 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:01:23.008166 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:01:23.008166 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 10 23:01:23.008166 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:01:23.011233 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-4f325859-69d0-49b4-8174-b3c93a256739 tempest-ImagesDeleteNegativeTestJSON-1221685149 tempest-ImagesDeleteNegativeTestJSON-1221685149-project] Returning 404 to user: Image not found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:01:23.014509 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-4f325859-69d0-49b4-8174-b3c93a256739 tempest-ImagesDeleteNegativeTestJSON-1221685149 tempest-ImagesDeleteNegativeTestJSON-1221685149-project] 10.222.0.58 "DELETE /compute/v2.1/images/c5619ee8-8744-440b-82f7-277c91deea421" status: 404 len: 62 microversion: 2.1 time: 0.051634 Aug 10 23:01:23.021055 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 642/1303] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:01:22 2022] DELETE /compute/v2.1/images/c5619ee8-8744-440b-82f7-277c91deea421 => generated 62 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 10 23:01:23.026438 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-fbb976c9-e7d0-4896-8c74-616ff0e16733 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Calling method '.version_select at 0x7f847d0df430>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:23.110117 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-5bc9db10-4f0b-46f9-8474-dbacc0262732 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '417d4eaaeb1c4df78745496ececb3e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27e6ee9495a438b8450a4ef0d62cbcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:01:23.143246 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-5bc9db10-4f0b-46f9-8474-dbacc0262732 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] 10.222.0.58 "GET /compute/v2.1/servers/0c897f8e-81a6-4929-85ed-9d9e8d6ec2cc" status: 200 len: 1319 microversion: 2.1 time: 0.472624 Aug 10 23:01:23.145137 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 662/1304] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:01:22 2022] GET /compute/v2.1/servers/0c897f8e-81a6-4929-85ed-9d9e8d6ec2cc => generated 1319 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:01:23.183393 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-e1927b8f-f5bd-4c6a-859f-3f93915f18ba req-efedcba4-7686-40c0-a130-3cff17cfb0f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c897f8e-81a6-4929-85ed-9d9e8d6ec2cc", "name": "network-vif-plugged", "status": "completed", "tag": "358851aa-3530-44ad-8603-dafd78d42181"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:01:23.200611 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-fbb976c9-e7d0-4896-8c74-616ff0e16733 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] 10.222.0.58 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4375 microversion: 2.1 time: 0.178308 Aug 10 23:01:23.201206 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 643/1305] 10.222.0.58 () {58 vars in 1170 bytes} [Wed Aug 10 23:01:23 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4375 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:01:23.221022 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-e1927b8f-f5bd-4c6a-859f-3f93915f18ba req-efedcba4-7686-40c0-a130-3cff17cfb0f3 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:23.221509 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-e1927b8f-f5bd-4c6a-859f-3f93915f18ba req-efedcba4-7686-40c0-a130-3cff17cfb0f3 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:23.221940 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-e1927b8f-f5bd-4c6a-859f-3f93915f18ba req-efedcba4-7686-40c0-a130-3cff17cfb0f3 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:23.233746 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-18d6a02d-5f00-4a06-9bfe-5caabfb3e8de tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Calling method '.version_select at 0x7f847d0ce820>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:23.250503 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-e1927b8f-f5bd-4c6a-859f-3f93915f18ba req-efedcba4-7686-40c0-a130-3cff17cfb0f3 service nova] Creating event network-vif-plugged:358851aa-3530-44ad-8603-dafd78d42181 for instance 0c897f8e-81a6-4929-85ed-9d9e8d6ec2cc on n-h2-850468-14 Aug 10 23:01:23.263566 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-e1927b8f-f5bd-4c6a-859f-3f93915f18ba req-efedcba4-7686-40c0-a130-3cff17cfb0f3 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114823 Aug 10 23:01:23.267375 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 663/1306] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:01:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:01:23.284769 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-0a48e772-4c4b-4323-9c29-b27a720df72a req-90fbd553-5962-4ad7-945d-7b8941c5e921 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad02bba7-86a5-4148-a83e-0fbd71645e4a", "tag": "f52df94f-766a-4141-9ff0-c420b9f68633"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:01:23.305627 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-18d6a02d-5f00-4a06-9bfe-5caabfb3e8de tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] 10.222.0.58 "GET /compute/v2.1/images/c00a0c31-f3f5-4dbc-ac74-d933d5bccb9e" status: 200 len: 1440 microversion: 2.1 time: 0.103049 Aug 10 23:01:23.307333 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 644/1307] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 10 23:01:23 2022] GET /compute/v2.1/images/c00a0c31-f3f5-4dbc-ac74-d933d5bccb9e => generated 1440 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:01:23.313813 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-248d1393-e52d-45b7-8d32-bf6580778ea6 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:23.314879 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-248d1393-e52d-45b7-8d32-bf6580778ea6 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] [instance: 8e91f1ac-f79d-4ab0-aa13-ea32b0e74888] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:01:23.323174 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-248d1393-e52d-45b7-8d32-bf6580778ea6 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:23.323855 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-248d1393-e52d-45b7-8d32-bf6580778ea6 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:23.324460 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-248d1393-e52d-45b7-8d32-bf6580778ea6 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:23.325961 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-248d1393-e52d-45b7-8d32-bf6580778ea6 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:23.326361 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-0a48e772-4c4b-4323-9c29-b27a720df72a req-90fbd553-5962-4ad7-945d-7b8941c5e921 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:23.327232 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-0a48e772-4c4b-4323-9c29-b27a720df72a req-90fbd553-5962-4ad7-945d-7b8941c5e921 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:23.327501 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-248d1393-e52d-45b7-8d32-bf6580778ea6 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:23.328095 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-248d1393-e52d-45b7-8d32-bf6580778ea6 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:23.329771 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-0a48e772-4c4b-4323-9c29-b27a720df72a req-90fbd553-5962-4ad7-945d-7b8941c5e921 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:23.362466 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-0a48e772-4c4b-4323-9c29-b27a720df72a req-90fbd553-5962-4ad7-945d-7b8941c5e921 service nova] Creating event network-changed:f52df94f-766a-4141-9ff0-c420b9f68633 for instance ad02bba7-86a5-4148-a83e-0fbd71645e4a on n-h1-850468-14 Aug 10 23:01:23.378356 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-0a48e772-4c4b-4323-9c29-b27a720df72a req-90fbd553-5962-4ad7-945d-7b8941c5e921 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104733 Aug 10 23:01:23.381507 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 664/1308] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:01:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:01:23.405491 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-e5dc39b1-75f1-47b7-93f8-9f7dee8a3950 tempest-ImagesDeleteNegativeTestJSON-1221685149 tempest-ImagesDeleteNegativeTestJSON-1221685149-project] Calling method '.version_select at 0x7f847d263dc0>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:23.444134 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-e5dc39b1-75f1-47b7-93f8-9f7dee8a3950 tempest-ImagesDeleteNegativeTestJSON-1221685149 tempest-ImagesDeleteNegativeTestJSON-1221685149-project] HTTP exception thrown: Image not found. Aug 10 23:01:23.446677 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-e5dc39b1-75f1-47b7-93f8-9f7dee8a3950 tempest-ImagesDeleteNegativeTestJSON-1221685149 tempest-ImagesDeleteNegativeTestJSON-1221685149-project] Request method failure captured: Aug 10 23:01:23.446677 n-d-850468-14 devstack@n-api.service[122633]: request: DELETE /compute/v2.1/images/tempest-invalid-1198171114 HTTP/1.1 Aug 10 23:01:23.446677 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:01:23.446677 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:01:23.446677 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:01:23.446677 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:01:23.446677 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:01:23.446677 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:01:23.446677 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:01:23.446677 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:01:23.446677 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9Di89WXXNuM0eRM3p9JxR8hyrT6j02Nj_jYhk7silTINS7s0Ykmo8BkOvlrowi8m1N7BMGMLMBKLU27E_RFQF0Fbz9ijb9RV3tUTptJ2VnkECVhNOi_3Iy0BaMR2kJ-9Cqn92Qmot9NiRzknUee87EaSN8zQlB3RvJcCs8Eh7rKcEjY Aug 10 23:01:23.446677 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:01:23.446677 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:01:23.446677 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:01:23.446677 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:01:23.446677 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:01:23.446677 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:01:23.446677 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 7ca0b899147d4282870bd42175ac91fb Aug 10 23:01:23.446677 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1221685149 Aug 10 23:01:23.446677 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:01:23.446677 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:01:23.448281 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7ca0b899147d4282870bd42175ac91fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7ca0b899147d4282870bd42175ac91fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7ca0b899147d4282870bd42175ac91fb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7ca0b899147d4282870bd42175ac91fb", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:01:23.448281 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1221685149 Aug 10 23:01:23.448281 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 7ca0b899147d4282870bd42175ac91fb Aug 10 23:01:23.448281 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1221685149 Aug 10 23:01:23.448281 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-ImagesDeleteNegativeTestJSON-1221685149-project Aug 10 23:01:23.448281 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:01:23.448281 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:01:23.448281 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: ab6db749e3f14bb2b8234fd63d48ee9e Aug 10 23:01:23.448281 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1221685149-project Aug 10 23:01:23.448281 n-d-850468-14 devstack@n-api.service[122633]: method: Aug 10 23:01:23.448281 n-d-850468-14 devstack@n-api.service[122633]: exception: Image not found. Aug 10 23:01:23.448281 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': 'tempest-invalid-1198171114'} Aug 10 23:01:23.448281 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:01:23.449233 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:01:23.449233 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 10 23:01:23.449233 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 10 23:01:23.449233 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 10 23:01:23.449233 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 10 23:01:23.449233 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 10 23:01:23.449233 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 10 23:01:23.449233 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 10 23:01:23.449233 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 10 23:01:23.449233 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 10 23:01:23.449233 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 10 23:01:23.449233 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 10 23:01:23.449233 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 10 23:01:23.449233 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 10 23:01:23.449233 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 10 23:01:23.449233 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-1198171114 to delete Aug 10 23:01:23.449233 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:01:23.449233 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:01:23.449233 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:01:23.450644 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:01:23.450644 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 10 23:01:23.450644 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 10 23:01:23.450644 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 10 23:01:23.450644 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 10 23:01:23.450644 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 10 23:01:23.450644 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 10 23:01:23.450644 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-1198171114 could not be found. Aug 10 23:01:23.450644 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:01:23.450644 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:01:23.450644 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:01:23.450644 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:01:23.450644 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:01:23.450644 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:01:23.450644 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:01:23.450644 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:01:23.450644 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 23:01:23.450644 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 23:01:23.450644 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:01:23.450644 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:01:23.452221 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 10 23:01:23.452221 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 10 23:01:23.452221 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 10 23:01:23.452221 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:01:23.452221 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:01:23.452221 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:01:23.452221 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:01:23.452221 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:01:23.452221 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:01:23.452221 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:01:23.452221 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:01:23.452221 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 10 23:01:23.452221 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:01:23.454336 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-e5dc39b1-75f1-47b7-93f8-9f7dee8a3950 tempest-ImagesDeleteNegativeTestJSON-1221685149 tempest-ImagesDeleteNegativeTestJSON-1221685149-project] Returning 404 to user: Image not found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:01:23.455404 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-e5dc39b1-75f1-47b7-93f8-9f7dee8a3950 tempest-ImagesDeleteNegativeTestJSON-1221685149 tempest-ImagesDeleteNegativeTestJSON-1221685149-project] 10.222.0.58 "DELETE /compute/v2.1/images/tempest-invalid-1198171114" status: 404 len: 62 microversion: 2.1 time: 0.069699 Aug 10 23:01:23.457184 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 665/1309] 10.222.0.58 () {58 vars in 1206 bytes} [Wed Aug 10 23:01:23 2022] DELETE /compute/v2.1/images/tempest-invalid-1198171114 => generated 62 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 10 23:01:23.466264 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-381e1049-0c94-4601-85d1-b4f7bd930dde tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Calling method '.version_select at 0x7f847d263790>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:23.572890 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-381e1049-0c94-4601-85d1-b4f7bd930dde tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] 10.222.0.58 "GET /compute/v2.1/images/78ad8905-f66f-4733-8be9-2b260f1fabed" status: 200 len: 784 microversion: 2.1 time: 0.114337 Aug 10 23:01:23.573383 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 666/1310] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 10 23:01:23 2022] GET /compute/v2.1/images/78ad8905-f66f-4733-8be9-2b260f1fabed => generated 784 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:01:23.586764 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-40d9331c-ceff-45c6-8c56-aebaa3af430c tempest-ImagesDeleteNegativeTestJSON-1221685149 tempest-ImagesDeleteNegativeTestJSON-1221685149-project] Calling method '.version_select at 0x7f847d077dc0>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:23.622695 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-40d9331c-ceff-45c6-8c56-aebaa3af430c tempest-ImagesDeleteNegativeTestJSON-1221685149 tempest-ImagesDeleteNegativeTestJSON-1221685149-project] HTTP exception thrown: Image not found. Aug 10 23:01:23.625157 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-40d9331c-ceff-45c6-8c56-aebaa3af430c tempest-ImagesDeleteNegativeTestJSON-1221685149 tempest-ImagesDeleteNegativeTestJSON-1221685149-project] Request method failure captured: Aug 10 23:01:23.625157 n-d-850468-14 devstack@n-api.service[122633]: request: DELETE /compute/v2.1/images/d3580bdc-3bab-42c1-94fa-682ad57cc7b8 HTTP/1.1 Aug 10 23:01:23.625157 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:01:23.625157 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:01:23.625157 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:01:23.625157 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:01:23.625157 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:01:23.625157 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:01:23.625157 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:01:23.625157 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:01:23.625157 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9Di89WXXNuM0eRM3p9JxR8hyrT6j02Nj_jYhk7silTINS7s0Ykmo8BkOvlrowi8m1N7BMGMLMBKLU27E_RFQF0Fbz9ijb9RV3tUTptJ2VnkECVhNOi_3Iy0BaMR2kJ-9Cqn92Qmot9NiRzknUee87EaSN8zQlB3RvJcCs8Eh7rKcEjY Aug 10 23:01:23.625157 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:01:23.625157 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:01:23.625157 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:01:23.625157 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:01:23.625157 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:01:23.625157 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:01:23.625157 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 7ca0b899147d4282870bd42175ac91fb Aug 10 23:01:23.625157 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-1221685149 Aug 10 23:01:23.625157 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:01:23.625157 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:01:23.626720 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7ca0b899147d4282870bd42175ac91fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7ca0b899147d4282870bd42175ac91fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7ca0b899147d4282870bd42175ac91fb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7ca0b899147d4282870bd42175ac91fb", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:01:23.626720 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-1221685149 Aug 10 23:01:23.626720 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 7ca0b899147d4282870bd42175ac91fb Aug 10 23:01:23.626720 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-1221685149 Aug 10 23:01:23.626720 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-ImagesDeleteNegativeTestJSON-1221685149-project Aug 10 23:01:23.626720 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:01:23.626720 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:01:23.626720 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: ab6db749e3f14bb2b8234fd63d48ee9e Aug 10 23:01:23.626720 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-1221685149-project Aug 10 23:01:23.626720 n-d-850468-14 devstack@n-api.service[122633]: method: Aug 10 23:01:23.626720 n-d-850468-14 devstack@n-api.service[122633]: exception: Image not found. Aug 10 23:01:23.626720 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': 'd3580bdc-3bab-42c1-94fa-682ad57cc7b8'} Aug 10 23:01:23.626720 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:01:23.628160 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:01:23.628160 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 10 23:01:23.628160 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 10 23:01:23.628160 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 10 23:01:23.628160 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 10 23:01:23.628160 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 10 23:01:23.628160 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 10 23:01:23.628160 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 10 23:01:23.628160 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 10 23:01:23.628160 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 10 23:01:23.628160 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 10 23:01:23.628160 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 10 23:01:23.628160 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 10 23:01:23.628160 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 10 23:01:23.628160 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 10 23:01:23.628160 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image d3580bdc-3bab-42c1-94fa-682ad57cc7b8 to delete Aug 10 23:01:23.628160 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:01:23.628160 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:01:23.628160 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:01:23.629947 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:01:23.629947 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 10 23:01:23.629947 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 10 23:01:23.629947 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 10 23:01:23.629947 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 10 23:01:23.629947 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 10 23:01:23.629947 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 10 23:01:23.629947 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image d3580bdc-3bab-42c1-94fa-682ad57cc7b8 could not be found. Aug 10 23:01:23.629947 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:01:23.629947 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:01:23.629947 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:01:23.629947 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:01:23.629947 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:01:23.629947 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:01:23.629947 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:01:23.629947 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:01:23.629947 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 23:01:23.629947 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 23:01:23.629947 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:01:23.629947 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:01:23.631521 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 10 23:01:23.631521 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 10 23:01:23.631521 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 10 23:01:23.631521 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:01:23.631521 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:01:23.631521 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:01:23.631521 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:01:23.631521 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:01:23.631521 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:01:23.631521 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:01:23.631521 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:01:23.631521 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 10 23:01:23.631521 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:01:23.631521 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-40d9331c-ceff-45c6-8c56-aebaa3af430c tempest-ImagesDeleteNegativeTestJSON-1221685149 tempest-ImagesDeleteNegativeTestJSON-1221685149-project] Returning 404 to user: Image not found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:01:23.631521 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-40d9331c-ceff-45c6-8c56-aebaa3af430c tempest-ImagesDeleteNegativeTestJSON-1221685149 tempest-ImagesDeleteNegativeTestJSON-1221685149-project] 10.222.0.58 "DELETE /compute/v2.1/images/d3580bdc-3bab-42c1-94fa-682ad57cc7b8" status: 404 len: 62 microversion: 2.1 time: 0.052114 Aug 10 23:01:23.632611 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 667/1311] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:01:23 2022] DELETE /compute/v2.1/images/d3580bdc-3bab-42c1-94fa-682ad57cc7b8 => generated 62 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 10 23:01:23.644714 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-75ebc28d-7845-4529-9552-fc2eba7694b3 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Calling method '.version_select at 0x7f847d075670>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:23.782060 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-75ebc28d-7845-4529-9552-fc2eba7694b3 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] 10.222.0.58 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1609 microversion: 2.1 time: 0.148704 Aug 10 23:01:23.791822 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 668/1312] 10.222.0.58 () {58 vars in 1158 bytes} [Wed Aug 10 23:01:23 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1609 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:01:23.803474 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-7895b3ca-37a1-4f1a-946d-bfeb921dcf43 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:23.804263 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-7895b3ca-37a1-4f1a-946d-bfeb921dcf43 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 0dabc2bf-08ff-45b5-a791-34d655349eae] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:01:23.837468 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7895b3ca-37a1-4f1a-946d-bfeb921dcf43 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:23.837981 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7895b3ca-37a1-4f1a-946d-bfeb921dcf43 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:23.838426 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7895b3ca-37a1-4f1a-946d-bfeb921dcf43 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:23.839172 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7895b3ca-37a1-4f1a-946d-bfeb921dcf43 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:23.848123 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7895b3ca-37a1-4f1a-946d-bfeb921dcf43 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:23.848687 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7895b3ca-37a1-4f1a-946d-bfeb921dcf43 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:24.189464 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-248d1393-e52d-45b7-8d32-bf6580778ea6 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632904331d024d9b8e4d3660dff2cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ed0bdee3aa4013bd9219069bda558c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:01:24.202460 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-248d1393-e52d-45b7-8d32-bf6580778ea6 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] 10.222.0.58 "GET /compute/v2.1/servers/8e91f1ac-f79d-4ab0-aa13-ea32b0e74888" status: 200 len: 1718 microversion: 2.1 time: 0.893800 Aug 10 23:01:24.203072 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 645/1313] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:01:23 2022] GET /compute/v2.1/servers/8e91f1ac-f79d-4ab0-aa13-ea32b0e74888 => generated 1718 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:01:24.210113 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-8062240d-4d64-4b38-acd8-968e1ff63f14 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Calling method '.version_select at 0x7f847d174940>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:24.487270 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-7895b3ca-37a1-4f1a-946d-bfeb921dcf43 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:01:24.498718 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-7895b3ca-37a1-4f1a-946d-bfeb921dcf43 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/0dabc2bf-08ff-45b5-a791-34d655349eae" status: 200 len: 1476 microversion: 2.1 time: 0.703013 Aug 10 23:01:24.522439 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 669/1314] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:01:23 2022] GET /compute/v2.1/servers/0dabc2bf-08ff-45b5-a791-34d655349eae => generated 1476 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:01:24.535432 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-56e68c8d-47a3-4c26-a2fc-f20ec8efb14b tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:24.537006 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-56e68c8d-47a3-4c26-a2fc-f20ec8efb14b tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] [instance: 0c897f8e-81a6-4929-85ed-9d9e8d6ec2cc] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:01:24.550608 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-56e68c8d-47a3-4c26-a2fc-f20ec8efb14b tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:24.555625 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-56e68c8d-47a3-4c26-a2fc-f20ec8efb14b tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:24.556371 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-56e68c8d-47a3-4c26-a2fc-f20ec8efb14b tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:24.557273 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-56e68c8d-47a3-4c26-a2fc-f20ec8efb14b tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:24.557892 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-56e68c8d-47a3-4c26-a2fc-f20ec8efb14b tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:24.562301 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-56e68c8d-47a3-4c26-a2fc-f20ec8efb14b tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:25.659887 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-56e68c8d-47a3-4c26-a2fc-f20ec8efb14b tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '417d4eaaeb1c4df78745496ececb3e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27e6ee9495a438b8450a4ef0d62cbcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:01:25.667442 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-56e68c8d-47a3-4c26-a2fc-f20ec8efb14b tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] 10.222.0.58 "GET /compute/v2.1/servers/0c897f8e-81a6-4929-85ed-9d9e8d6ec2cc" status: 200 len: 1319 microversion: 2.1 time: 1.143653 Aug 10 23:01:25.668020 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 670/1315] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:01:24 2022] GET /compute/v2.1/servers/0c897f8e-81a6-4929-85ed-9d9e8d6ec2cc => generated 1319 bytes in 1145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:01:25.679779 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-1b047e89-6620-46fa-a7a7-7a0555a3bbc2 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Calling method '.version_select at 0x7f847d263e50>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:25.754885 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-8062240d-4d64-4b38-acd8-968e1ff63f14 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] 10.222.0.58 "DELETE /compute/v2.1/images/3d48cfd3-2ced-4117-a393-83f358ed89c6" status: 204 len: 0 microversion: 2.1 time: 1.548835 Aug 10 23:01:25.755827 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 646/1316] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:01:24 2022] DELETE /compute/v2.1/images/3d48cfd3-2ced-4117-a393-83f358ed89c6 => generated 0 bytes in 1550 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:01:25.761990 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-96e49e6c-e5ee-4f1a-8056-1d4b6350a43d tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:25.762677 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-96e49e6c-e5ee-4f1a-8056-1d4b6350a43d tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] [instance: 8e91f1ac-f79d-4ab0-aa13-ea32b0e74888] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:01:25.777387 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-96e49e6c-e5ee-4f1a-8056-1d4b6350a43d tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:25.778348 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-96e49e6c-e5ee-4f1a-8056-1d4b6350a43d tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:25.779045 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-96e49e6c-e5ee-4f1a-8056-1d4b6350a43d tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:25.781417 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-96e49e6c-e5ee-4f1a-8056-1d4b6350a43d tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:25.782145 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-96e49e6c-e5ee-4f1a-8056-1d4b6350a43d tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:25.782814 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-96e49e6c-e5ee-4f1a-8056-1d4b6350a43d tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:25.923743 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-1b047e89-6620-46fa-a7a7-7a0555a3bbc2 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] 10.222.0.58 "GET /compute/v2.1/images/c00a0c31-f3f5-4dbc-ac74-d933d5bccb9e" status: 200 len: 1440 microversion: 2.1 time: 0.254580 Aug 10 23:01:25.924675 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 671/1317] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 10 23:01:25 2022] GET /compute/v2.1/images/c00a0c31-f3f5-4dbc-ac74-d933d5bccb9e => generated 1440 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:01:25.931461 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-2fbd24dc-1c77-4b94-9171-5052062d61a7 req-7a68a4f9-dfa1-4357-ad84-fa23320fd5c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad02bba7-86a5-4148-a83e-0fbd71645e4a", "name": "network-vif-plugged", "status": "completed", "tag": "f52df94f-766a-4141-9ff0-c420b9f68633"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:01:25.989936 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-2fbd24dc-1c77-4b94-9171-5052062d61a7 req-7a68a4f9-dfa1-4357-ad84-fa23320fd5c0 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:25.999840 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-2fbd24dc-1c77-4b94-9171-5052062d61a7 req-7a68a4f9-dfa1-4357-ad84-fa23320fd5c0 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:26.000614 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-2fbd24dc-1c77-4b94-9171-5052062d61a7 req-7a68a4f9-dfa1-4357-ad84-fa23320fd5c0 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:26.047548 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-2fbd24dc-1c77-4b94-9171-5052062d61a7 req-7a68a4f9-dfa1-4357-ad84-fa23320fd5c0 service nova] Creating event network-vif-plugged:f52df94f-766a-4141-9ff0-c420b9f68633 for instance ad02bba7-86a5-4148-a83e-0fbd71645e4a on n-h1-850468-14 Aug 10 23:01:26.069770 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-2fbd24dc-1c77-4b94-9171-5052062d61a7 req-7a68a4f9-dfa1-4357-ad84-fa23320fd5c0 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142356 Aug 10 23:01:26.084592 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 672/1318] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:01:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:01:26.090056 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-8fc1a405-d016-4662-92a2-611bde259a1e tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:26.090764 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-8fc1a405-d016-4662-92a2-611bde259a1e tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 0dabc2bf-08ff-45b5-a791-34d655349eae] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:01:26.125826 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-96e49e6c-e5ee-4f1a-8056-1d4b6350a43d tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632904331d024d9b8e4d3660dff2cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ed0bdee3aa4013bd9219069bda558c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:01:26.140171 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-96e49e6c-e5ee-4f1a-8056-1d4b6350a43d tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] 10.222.0.58 "GET /compute/v2.1/servers/8e91f1ac-f79d-4ab0-aa13-ea32b0e74888" status: 200 len: 1718 microversion: 2.1 time: 0.379368 Aug 10 23:01:26.142092 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 647/1319] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:01:25 2022] GET /compute/v2.1/servers/8e91f1ac-f79d-4ab0-aa13-ea32b0e74888 => generated 1718 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:01:26.150046 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-b6352a76-53c5-402e-8e66-ad75b0bc91df tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Calling method '.version_select at 0x7f847d0d4550>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:26.150286 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8fc1a405-d016-4662-92a2-611bde259a1e tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:26.176401 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8fc1a405-d016-4662-92a2-611bde259a1e tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:26.176877 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8fc1a405-d016-4662-92a2-611bde259a1e tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:26.177632 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8fc1a405-d016-4662-92a2-611bde259a1e tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:26.178091 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8fc1a405-d016-4662-92a2-611bde259a1e tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:26.202374 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8fc1a405-d016-4662-92a2-611bde259a1e tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:26.956199 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-8fc1a405-d016-4662-92a2-611bde259a1e tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:01:26.968463 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-8fc1a405-d016-4662-92a2-611bde259a1e tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/0dabc2bf-08ff-45b5-a791-34d655349eae" status: 200 len: 1476 microversion: 2.1 time: 0.880303 Aug 10 23:01:26.971796 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 673/1320] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:01:26 2022] GET /compute/v2.1/servers/0dabc2bf-08ff-45b5-a791-34d655349eae => generated 1476 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:01:26.984654 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-2775ff13-301a-48e8-b0d6-4b351f55ee8e tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:26.986225 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-2775ff13-301a-48e8-b0d6-4b351f55ee8e tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] [instance: 0c897f8e-81a6-4929-85ed-9d9e8d6ec2cc] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:01:26.997282 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2775ff13-301a-48e8-b0d6-4b351f55ee8e tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:27.000902 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2775ff13-301a-48e8-b0d6-4b351f55ee8e tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:27.001760 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2775ff13-301a-48e8-b0d6-4b351f55ee8e tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:27.002766 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2775ff13-301a-48e8-b0d6-4b351f55ee8e tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:27.003684 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2775ff13-301a-48e8-b0d6-4b351f55ee8e tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:27.004510 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2775ff13-301a-48e8-b0d6-4b351f55ee8e tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:27.141071 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-b6352a76-53c5-402e-8e66-ad75b0bc91df tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] 10.222.0.58 "DELETE /compute/v2.1/images/29dc70c1-ba79-4729-808e-b203238c7dc9" status: 204 len: 0 microversion: 2.1 time: 0.997306 Aug 10 23:01:27.143422 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 648/1321] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:01:26 2022] DELETE /compute/v2.1/images/29dc70c1-ba79-4729-808e-b203238c7dc9 => generated 0 bytes in 1001 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:01:27.151013 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-59016217-c42d-409a-b9bf-94a63f2b8aaf tempest-VolumesTestJSON-1487653355 tempest-VolumesTestJSON-1487653355-project] Calling method '.version_select at 0x7f847d0ce160>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:27.282991 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-59016217-c42d-409a-b9bf-94a63f2b8aaf tempest-VolumesTestJSON-1487653355 tempest-VolumesTestJSON-1487653355-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/ec7cc732-c447-4795-bf2b-43fd907f2c10" status: 200 len: 351 microversion: 2.1 time: 0.135433 Aug 10 23:01:27.282991 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 649/1322] 10.222.0.58 () {58 vars in 1245 bytes} [Wed Aug 10 23:01:27 2022] GET /compute/v2.1/os-volumes/ec7cc732-c447-4795-bf2b-43fd907f2c10 => generated 351 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:01:27.286836 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-d02b8a03-17cd-47ed-8906-d2521941f888 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Calling method '.version_select at 0x7f847d0f40d0>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:27.303832 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-2775ff13-301a-48e8-b0d6-4b351f55ee8e tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '417d4eaaeb1c4df78745496ececb3e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27e6ee9495a438b8450a4ef0d62cbcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:01:27.313821 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-2775ff13-301a-48e8-b0d6-4b351f55ee8e tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] 10.222.0.58 "GET /compute/v2.1/servers/0c897f8e-81a6-4929-85ed-9d9e8d6ec2cc" status: 200 len: 1467 microversion: 2.1 time: 0.340660 Aug 10 23:01:27.317135 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 674/1323] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:01:26 2022] GET /compute/v2.1/servers/0c897f8e-81a6-4929-85ed-9d9e8d6ec2cc => generated 1467 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:01:27.333378 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-98e4bc85-bf78-47be-8280-36b72aeb41c5 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Calling method '.version_select at 0x7f847d295550>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:29.172395 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-d02b8a03-17cd-47ed-8906-d2521941f888 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] 10.222.0.58 "GET /compute/v2.1/images/c00a0c31-f3f5-4dbc-ac74-d933d5bccb9e" status: 200 len: 1440 microversion: 2.1 time: 1.887866 Aug 10 23:01:29.182825 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 650/1324] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 10 23:01:27 2022] GET /compute/v2.1/images/c00a0c31-f3f5-4dbc-ac74-d933d5bccb9e => generated 1440 bytes in 1901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:01:29.202896 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-a41b3e9e-69cf-4d91-a4d7-a2160146df50 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:29.207605 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-a41b3e9e-69cf-4d91-a4d7-a2160146df50 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] [instance: 8e91f1ac-f79d-4ab0-aa13-ea32b0e74888] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:01:29.256935 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a41b3e9e-69cf-4d91-a4d7-a2160146df50 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:29.261670 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a41b3e9e-69cf-4d91-a4d7-a2160146df50 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:29.262310 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a41b3e9e-69cf-4d91-a4d7-a2160146df50 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:29.267098 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a41b3e9e-69cf-4d91-a4d7-a2160146df50 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:29.267796 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a41b3e9e-69cf-4d91-a4d7-a2160146df50 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:29.268333 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a41b3e9e-69cf-4d91-a4d7-a2160146df50 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:29.314317 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-98e4bc85-bf78-47be-8280-36b72aeb41c5 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] 10.222.0.58 "DELETE /compute/v2.1/images/be4c34b4-d5ba-42f3-8dac-aa84837569a0" status: 204 len: 0 microversion: 2.1 time: 1.993684 Aug 10 23:01:29.317806 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 675/1325] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:01:27 2022] DELETE /compute/v2.1/images/be4c34b4-d5ba-42f3-8dac-aa84837569a0 => generated 0 bytes in 1996 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:01:29.321718 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-a622bd0a-e9c9-4518-8e8e-228df759656d tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:29.322335 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-a622bd0a-e9c9-4518-8e8e-228df759656d tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] [instance: ad02bba7-86a5-4148-a83e-0fbd71645e4a] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:01:29.340022 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a622bd0a-e9c9-4518-8e8e-228df759656d tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:29.345482 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a622bd0a-e9c9-4518-8e8e-228df759656d tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:29.347381 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a622bd0a-e9c9-4518-8e8e-228df759656d tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:29.349725 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a622bd0a-e9c9-4518-8e8e-228df759656d tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:29.351145 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a622bd0a-e9c9-4518-8e8e-228df759656d tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:29.351757 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a622bd0a-e9c9-4518-8e8e-228df759656d tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:29.662984 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-a622bd0a-e9c9-4518-8e8e-228df759656d tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '417d4eaaeb1c4df78745496ececb3e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27e6ee9495a438b8450a4ef0d62cbcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:01:29.678097 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-a622bd0a-e9c9-4518-8e8e-228df759656d tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] 10.222.0.58 "GET /compute/v2.1/servers/ad02bba7-86a5-4148-a83e-0fbd71645e4a" status: 200 len: 1469 microversion: 2.1 time: 0.361659 Aug 10 23:01:29.679431 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 676/1326] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:01:29 2022] GET /compute/v2.1/servers/ad02bba7-86a5-4148-a83e-0fbd71645e4a => generated 1469 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:01:29.684636 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-1c1ea6b5-cfca-46d3-b875-92355838555d tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:29.687938 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-1c1ea6b5-cfca-46d3-b875-92355838555d tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 0dabc2bf-08ff-45b5-a791-34d655349eae] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:01:29.698379 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1c1ea6b5-cfca-46d3-b875-92355838555d tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:29.699230 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1c1ea6b5-cfca-46d3-b875-92355838555d tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:29.700012 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1c1ea6b5-cfca-46d3-b875-92355838555d tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:29.703683 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1c1ea6b5-cfca-46d3-b875-92355838555d tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:29.704641 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1c1ea6b5-cfca-46d3-b875-92355838555d tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:29.705362 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1c1ea6b5-cfca-46d3-b875-92355838555d tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:30.135739 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-1c1ea6b5-cfca-46d3-b875-92355838555d tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:01:30.149653 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-1c1ea6b5-cfca-46d3-b875-92355838555d tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/0dabc2bf-08ff-45b5-a791-34d655349eae" status: 200 len: 1475 microversion: 2.1 time: 0.468679 Aug 10 23:01:30.155259 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 677/1327] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:01:29 2022] GET /compute/v2.1/servers/0dabc2bf-08ff-45b5-a791-34d655349eae => generated 1475 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:01:30.168516 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-42f3c25a-4a66-4359-a87d-2b07b985786f req-436cd26d-e64c-4bf2-ba41-437cd34bcb54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0dabc2bf-08ff-45b5-a791-34d655349eae", "name": "network-vif-unplugged", "status": "completed", "tag": "8dba1a8f-5d05-48a3-afda-7507568fcb46"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:01:30.199346 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-42f3c25a-4a66-4359-a87d-2b07b985786f req-436cd26d-e64c-4bf2-ba41-437cd34bcb54 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:30.200903 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-42f3c25a-4a66-4359-a87d-2b07b985786f req-436cd26d-e64c-4bf2-ba41-437cd34bcb54 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:30.202549 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-42f3c25a-4a66-4359-a87d-2b07b985786f req-436cd26d-e64c-4bf2-ba41-437cd34bcb54 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:30.231822 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-42f3c25a-4a66-4359-a87d-2b07b985786f req-436cd26d-e64c-4bf2-ba41-437cd34bcb54 service nova] Creating event network-vif-unplugged:8dba1a8f-5d05-48a3-afda-7507568fcb46 for instance 0dabc2bf-08ff-45b5-a791-34d655349eae on n-h1-850468-14 Aug 10 23:01:30.248887 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [req-42f3c25a-4a66-4359-a87d-2b07b985786f req-436cd26d-e64c-4bf2-ba41-437cd34bcb54 service nova] Instance 0dabc2bf-08ff-45b5-a791-34d655349eae is migrating within the same cell, copying events to all relevant hosts: {'n-h1-850468-14', 'n-h2-850468-14'} {{(pid=122633) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5901}} Aug 10 23:01:30.252712 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-a41b3e9e-69cf-4d91-a4d7-a2160146df50 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632904331d024d9b8e4d3660dff2cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ed0bdee3aa4013bd9219069bda558c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:01:30.266196 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-a41b3e9e-69cf-4d91-a4d7-a2160146df50 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] 10.222.0.58 "GET /compute/v2.1/servers/8e91f1ac-f79d-4ab0-aa13-ea32b0e74888" status: 200 len: 1718 microversion: 2.1 time: 1.081430 Aug 10 23:01:30.287013 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 651/1328] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:01:29 2022] GET /compute/v2.1/servers/8e91f1ac-f79d-4ab0-aa13-ea32b0e74888 => generated 1718 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:01:30.288730 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-42f3c25a-4a66-4359-a87d-2b07b985786f req-436cd26d-e64c-4bf2-ba41-437cd34bcb54 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.131357 Aug 10 23:01:30.289343 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 678/1329] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:01:30 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:01:30.294544 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-13d63842-1c5e-41cf-9118-033d10c21d58 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:30.311032 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-24890472-1c93-47d3-9bac-59d74e472a97 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:30.311032 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-24890472-1c93-47d3-9bac-59d74e472a97 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] [instance: e1deb45a-4597-4456-a1bd-54013c9484a4] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:01:30.311269 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-13d63842-1c5e-41cf-9118-033d10c21d58 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '417d4eaaeb1c4df78745496ececb3e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27e6ee9495a438b8450a4ef0d62cbcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:01:30.311269 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-13d63842-1c5e-41cf-9118-033d10c21d58 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Searching by: {'reservation_id': 'r-edo7nopy', 'deleted': False, 'project_id': 'b27e6ee9495a438b8450a4ef0d62cbcd'} {{(pid=122633) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 10 23:01:30.315153 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-13d63842-1c5e-41cf-9118-033d10c21d58 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:30.315716 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-13d63842-1c5e-41cf-9118-033d10c21d58 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:30.316114 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-13d63842-1c5e-41cf-9118-033d10c21d58 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:30.317013 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-13d63842-1c5e-41cf-9118-033d10c21d58 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:30.317773 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-13d63842-1c5e-41cf-9118-033d10c21d58 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:30.319068 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-13d63842-1c5e-41cf-9118-033d10c21d58 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:30.333774 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-24890472-1c93-47d3-9bac-59d74e472a97 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:30.334665 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-24890472-1c93-47d3-9bac-59d74e472a97 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:30.335232 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-24890472-1c93-47d3-9bac-59d74e472a97 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:30.336076 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-24890472-1c93-47d3-9bac-59d74e472a97 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:30.336650 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-24890472-1c93-47d3-9bac-59d74e472a97 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:30.337739 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-24890472-1c93-47d3-9bac-59d74e472a97 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:30.389990 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-24890472-1c93-47d3-9bac-59d74e472a97 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] [instance: e1deb45a-4597-4456-a1bd-54013c9484a4] Going to try to terminate instance {{(pid=122632) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:01:30.490332 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.multi_cell_list [None req-13d63842-1c5e-41cf-9118-033d10c21d58 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=122633) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 10 23:01:30.558688 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-24890472-1c93-47d3-9bac-59d74e472a97 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] 10.222.0.58 "DELETE /compute/v2.1/servers/e1deb45a-4597-4456-a1bd-54013c9484a4" status: 204 len: 0 microversion: 2.1 time: 0.269985 Aug 10 23:01:30.562803 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 652/1330] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:01:30 2022] DELETE /compute/v2.1/servers/e1deb45a-4597-4456-a1bd-54013c9484a4 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:01:30.566348 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-f046f4bd-bff4-4c71-bfd5-96da620a4379 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Calling method '.version_select at 0x7f847d2085e0>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:30.625572 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-f046f4bd-bff4-4c71-bfd5-96da620a4379 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] 10.222.0.58 "GET /compute/v2.1/images/c00a0c31-f3f5-4dbc-ac74-d933d5bccb9e" status: 200 len: 1449 microversion: 2.1 time: 0.064358 Aug 10 23:01:30.626510 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 653/1331] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 10 23:01:30 2022] GET /compute/v2.1/images/c00a0c31-f3f5-4dbc-ac74-d933d5bccb9e => generated 1449 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:01:30.632086 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-bd37d58b-2a72-45ba-8345-6d0ba92e108a tempest-VolumesTestJSON-1487653355 tempest-VolumesTestJSON-1487653355-project] Calling method '.version_select at 0x7f847d0d48b0>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:30.660753 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-13d63842-1c5e-41cf-9118-033d10c21d58 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '417d4eaaeb1c4df78745496ececb3e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27e6ee9495a438b8450a4ef0d62cbcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:01:30.668621 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-13d63842-1c5e-41cf-9118-033d10c21d58 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:30.669124 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-13d63842-1c5e-41cf-9118-033d10c21d58 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:30.670329 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-13d63842-1c5e-41cf-9118-033d10c21d58 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:30.696020 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-bd37d58b-2a72-45ba-8345-6d0ba92e108a tempest-VolumesTestJSON-1487653355 tempest-VolumesTestJSON-1487653355-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/f66bb98e-8d33-490f-97bf-a22f69398ae5" status: 200 len: 351 microversion: 2.1 time: 0.068159 Aug 10 23:01:30.696788 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 654/1332] 10.222.0.58 () {58 vars in 1245 bytes} [Wed Aug 10 23:01:30 2022] GET /compute/v2.1/os-volumes/f66bb98e-8d33-490f-97bf-a22f69398ae5 => generated 351 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:01:30.706000 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-accaca3c-f323-4542-a99b-d3a275776c9d tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:30.707059 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-accaca3c-f323-4542-a99b-d3a275776c9d tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] [instance: e1deb45a-4597-4456-a1bd-54013c9484a4] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:01:30.738224 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-accaca3c-f323-4542-a99b-d3a275776c9d tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:30.738755 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-accaca3c-f323-4542-a99b-d3a275776c9d tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:30.739241 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-accaca3c-f323-4542-a99b-d3a275776c9d tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:30.744309 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-accaca3c-f323-4542-a99b-d3a275776c9d tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:30.744862 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-accaca3c-f323-4542-a99b-d3a275776c9d tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:30.745311 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-accaca3c-f323-4542-a99b-d3a275776c9d tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:30.837414 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-13d63842-1c5e-41cf-9118-033d10c21d58 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] 10.222.0.58 "GET /compute/v2.1/servers/detail?reservation_id=r-edo7nopy" status: 200 len: 2929 microversion: 2.1 time: 0.546339 Aug 10 23:01:30.851963 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 679/1333] 10.222.0.58 () {58 vars in 1197 bytes} [Wed Aug 10 23:01:30 2022] GET /compute/v2.1/servers/detail?reservation_id=r-edo7nopy => generated 2929 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:01:30.869491 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-e92e5212-c2f6-41ce-81f6-c5a884fa543c tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Calling method '.version_select at 0x7f847d3c0ee0>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:30.983898 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-accaca3c-f323-4542-a99b-d3a275776c9d tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e86e6a62c56248d6a7887be0ec712f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25090b10522b4936b3117dc25dd6f609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:01:30.989137 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-e92e5212-c2f6-41ce-81f6-c5a884fa543c tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] 10.222.0.58 "GET /compute/v2.1/images/c00a0c31-f3f5-4dbc-ac74-d933d5bccb9e" status: 200 len: 1449 microversion: 2.1 time: 0.133363 Aug 10 23:01:30.993426 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 680/1334] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 10 23:01:30 2022] GET /compute/v2.1/images/c00a0c31-f3f5-4dbc-ac74-d933d5bccb9e => generated 1449 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:01:31.005380 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-accaca3c-f323-4542-a99b-d3a275776c9d tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] 10.222.0.58 "GET /compute/v2.1/servers/e1deb45a-4597-4456-a1bd-54013c9484a4" status: 200 len: 1473 microversion: 2.1 time: 0.306727 Aug 10 23:01:31.010476 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-62b17276-e782-4b9a-95f0-eb3e57c82165 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:31.027288 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 655/1335] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:01:30 2022] GET /compute/v2.1/servers/e1deb45a-4597-4456-a1bd-54013c9484a4 => generated 1473 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:01:31.033064 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-35dfc594-014b-42a4-af32-8fadb76a4bd9 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Calling method '.version_select at 0x7f847d27e9d0>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:31.133571 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.compute.server_groups [None req-62b17276-e782-4b9a-95f0-eb3e57c82165 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Querying cell c9127db4-59f9-48ac-9ab2-b5d6690bb85f(cell1) for 2 instances {{(pid=122633) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 10 23:01:31.136682 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-62b17276-e782-4b9a-95f0-eb3e57c82165 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:31.137402 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-62b17276-e782-4b9a-95f0-eb3e57c82165 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:31.140679 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-62b17276-e782-4b9a-95f0-eb3e57c82165 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:31.217247 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-62b17276-e782-4b9a-95f0-eb3e57c82165 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] 10.222.0.58 "GET /compute/v2.1/os-server-groups/0df0c484-6d01-4147-a85f-ab4e11db152d" status: 200 len: 270 microversion: 2.1 time: 0.222341 Aug 10 23:01:31.218095 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 681/1336] 10.222.0.58 () {58 vars in 1263 bytes} [Wed Aug 10 23:01:30 2022] GET /compute/v2.1/os-server-groups/0df0c484-6d01-4147-a85f-ab4e11db152d => generated 270 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:01:31.223309 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-5bb3eaa0-7517-4e76-9365-e44660877a82 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:31.224552 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-5bb3eaa0-7517-4e76-9365-e44660877a82 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 0dabc2bf-08ff-45b5-a791-34d655349eae] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:01:31.231582 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5bb3eaa0-7517-4e76-9365-e44660877a82 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:31.232985 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5bb3eaa0-7517-4e76-9365-e44660877a82 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:31.233691 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5bb3eaa0-7517-4e76-9365-e44660877a82 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:31.234900 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5bb3eaa0-7517-4e76-9365-e44660877a82 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:31.235600 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5bb3eaa0-7517-4e76-9365-e44660877a82 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:31.236253 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5bb3eaa0-7517-4e76-9365-e44660877a82 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:32.161424 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-35dfc594-014b-42a4-af32-8fadb76a4bd9 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] 10.222.0.58 "DELETE /compute/v2.1/images/c00a0c31-f3f5-4dbc-ac74-d933d5bccb9e" status: 204 len: 0 microversion: 2.1 time: 1.132948 Aug 10 23:01:32.162939 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 656/1337] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:01:31 2022] DELETE /compute/v2.1/images/c00a0c31-f3f5-4dbc-ac74-d933d5bccb9e => generated 0 bytes in 1135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:01:32.181175 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-ec07f2e6-7407-41a9-99ee-1a98df881e96 tempest-ServersOnMultiNodesTest-79489 tempest-ServersOnMultiNodesTest-79489-project-admin] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:32.182321 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-ec07f2e6-7407-41a9-99ee-1a98df881e96 tempest-ServersOnMultiNodesTest-79489 tempest-ServersOnMultiNodesTest-79489-project-admin] [instance: 0c897f8e-81a6-4929-85ed-9d9e8d6ec2cc] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:01:32.217991 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ec07f2e6-7407-41a9-99ee-1a98df881e96 tempest-ServersOnMultiNodesTest-79489 tempest-ServersOnMultiNodesTest-79489-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:32.223447 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ec07f2e6-7407-41a9-99ee-1a98df881e96 tempest-ServersOnMultiNodesTest-79489 tempest-ServersOnMultiNodesTest-79489-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:32.224288 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ec07f2e6-7407-41a9-99ee-1a98df881e96 tempest-ServersOnMultiNodesTest-79489 tempest-ServersOnMultiNodesTest-79489-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:32.232286 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ec07f2e6-7407-41a9-99ee-1a98df881e96 tempest-ServersOnMultiNodesTest-79489 tempest-ServersOnMultiNodesTest-79489-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:32.235399 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ec07f2e6-7407-41a9-99ee-1a98df881e96 tempest-ServersOnMultiNodesTest-79489 tempest-ServersOnMultiNodesTest-79489-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:32.239275 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ec07f2e6-7407-41a9-99ee-1a98df881e96 tempest-ServersOnMultiNodesTest-79489 tempest-ServersOnMultiNodesTest-79489-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:32.818325 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-ec07f2e6-7407-41a9-99ee-1a98df881e96 tempest-ServersOnMultiNodesTest-79489 tempest-ServersOnMultiNodesTest-79489-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/0c897f8e-81a6-4929-85ed-9d9e8d6ec2cc" status: 200 len: 1620 microversion: 2.1 time: 0.650124 Aug 10 23:01:32.818945 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 657/1338] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:01:32 2022] GET /compute/v2.1/servers/0c897f8e-81a6-4929-85ed-9d9e8d6ec2cc => generated 1620 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:01:32.836228 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-f03d3609-2128-420d-a12f-5bbf448adab4 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:32.847333 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-f03d3609-2128-420d-a12f-5bbf448adab4 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] [instance: 8e91f1ac-f79d-4ab0-aa13-ea32b0e74888] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:01:32.859322 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f03d3609-2128-420d-a12f-5bbf448adab4 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:32.865355 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-5bb3eaa0-7517-4e76-9365-e44660877a82 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:01:32.869830 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f03d3609-2128-420d-a12f-5bbf448adab4 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:32.874367 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-5bb3eaa0-7517-4e76-9365-e44660877a82 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/0dabc2bf-08ff-45b5-a791-34d655349eae" status: 200 len: 1475 microversion: 2.1 time: 1.654943 Aug 10 23:01:32.875140 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f03d3609-2128-420d-a12f-5bbf448adab4 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:32.876084 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f03d3609-2128-420d-a12f-5bbf448adab4 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:32.876548 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f03d3609-2128-420d-a12f-5bbf448adab4 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:32.877322 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 682/1339] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:01:31 2022] GET /compute/v2.1/servers/0dabc2bf-08ff-45b5-a791-34d655349eae => generated 1475 bytes in 1658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:01:32.883389 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f03d3609-2128-420d-a12f-5bbf448adab4 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:32.899471 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-00aefb20-f4b1-4a6a-9532-473953164b38 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:32.900270 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-00aefb20-f4b1-4a6a-9532-473953164b38 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] [instance: e1deb45a-4597-4456-a1bd-54013c9484a4] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:01:32.928603 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-00aefb20-f4b1-4a6a-9532-473953164b38 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:32.929111 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-00aefb20-f4b1-4a6a-9532-473953164b38 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:32.929558 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-00aefb20-f4b1-4a6a-9532-473953164b38 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:32.930280 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-00aefb20-f4b1-4a6a-9532-473953164b38 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:32.930738 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-00aefb20-f4b1-4a6a-9532-473953164b38 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:32.931553 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-00aefb20-f4b1-4a6a-9532-473953164b38 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:33.361230 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-f03d3609-2128-420d-a12f-5bbf448adab4 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632904331d024d9b8e4d3660dff2cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ed0bdee3aa4013bd9219069bda558c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:01:33.378457 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-f03d3609-2128-420d-a12f-5bbf448adab4 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] 10.222.0.58 "GET /compute/v2.1/servers/8e91f1ac-f79d-4ab0-aa13-ea32b0e74888" status: 200 len: 1718 microversion: 2.1 time: 0.544528 Aug 10 23:01:33.380649 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 658/1340] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:01:32 2022] GET /compute/v2.1/servers/8e91f1ac-f79d-4ab0-aa13-ea32b0e74888 => generated 1718 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:01:33.392253 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-0e5d30b1-2cbd-4f95-bff0-095629c87edb tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:33.395256 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-0e5d30b1-2cbd-4f95-bff0-095629c87edb tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] [instance: 2a68f86c-37de-4207-aa43-6a1350342a56] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:01:33.409899 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0e5d30b1-2cbd-4f95-bff0-095629c87edb tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:33.412495 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0e5d30b1-2cbd-4f95-bff0-095629c87edb tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:33.413198 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0e5d30b1-2cbd-4f95-bff0-095629c87edb tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:33.417427 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0e5d30b1-2cbd-4f95-bff0-095629c87edb tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:33.420257 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0e5d30b1-2cbd-4f95-bff0-095629c87edb tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:33.421469 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0e5d30b1-2cbd-4f95-bff0-095629c87edb tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:33.562521 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-0e5d30b1-2cbd-4f95-bff0-095629c87edb tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] [instance: 2a68f86c-37de-4207-aa43-6a1350342a56] Going to try to terminate instance {{(pid=122632) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:01:33.966866 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-0e5d30b1-2cbd-4f95-bff0-095629c87edb tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] 10.222.0.58 "DELETE /compute/v2.1/servers/2a68f86c-37de-4207-aa43-6a1350342a56" status: 204 len: 0 microversion: 2.1 time: 0.579449 Aug 10 23:01:33.972807 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 659/1341] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:01:33 2022] DELETE /compute/v2.1/servers/2a68f86c-37de-4207-aa43-6a1350342a56 => generated 0 bytes in 591 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:01:33.992864 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-d1981aaa-2366-4fa9-921d-df0efc4ff91f req-7acbf7c0-9339-4294-ae85-190ae969d684 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0dabc2bf-08ff-45b5-a791-34d655349eae", "tag": "8dba1a8f-5d05-48a3-afda-7507568fcb46"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:01:34.038443 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-d1981aaa-2366-4fa9-921d-df0efc4ff91f req-7acbf7c0-9339-4294-ae85-190ae969d684 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:34.041482 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-d1981aaa-2366-4fa9-921d-df0efc4ff91f req-7acbf7c0-9339-4294-ae85-190ae969d684 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:34.043031 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-d1981aaa-2366-4fa9-921d-df0efc4ff91f req-7acbf7c0-9339-4294-ae85-190ae969d684 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:34.080492 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:01:34.094485 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-d1981aaa-2366-4fa9-921d-df0efc4ff91f req-7acbf7c0-9339-4294-ae85-190ae969d684 service nova] Creating event network-changed:8dba1a8f-5d05-48a3-afda-7507568fcb46 for instance 0dabc2bf-08ff-45b5-a791-34d655349eae on n-h1-850468-14 Aug 10 23:01:34.124706 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [req-d1981aaa-2366-4fa9-921d-df0efc4ff91f req-7acbf7c0-9339-4294-ae85-190ae969d684 service nova] Instance 0dabc2bf-08ff-45b5-a791-34d655349eae is migrating within the same cell, copying events to all relevant hosts: {'n-h1-850468-14', 'n-h2-850468-14'} {{(pid=122632) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5901}} Aug 10 23:01:34.183892 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-d1981aaa-2366-4fa9-921d-df0efc4ff91f req-7acbf7c0-9339-4294-ae85-190ae969d684 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.202226 Aug 10 23:01:34.188332 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 660/1342] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:01:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:01:34.209648 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-d254b3c9-a4ac-4c8b-b850-83d1abba836e tempest-ServersOnMultiNodesTest-79489 tempest-ServersOnMultiNodesTest-79489-project-admin] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:34.211489 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-d254b3c9-a4ac-4c8b-b850-83d1abba836e tempest-ServersOnMultiNodesTest-79489 tempest-ServersOnMultiNodesTest-79489-project-admin] [instance: ad02bba7-86a5-4148-a83e-0fbd71645e4a] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:01:34.235885 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d254b3c9-a4ac-4c8b-b850-83d1abba836e tempest-ServersOnMultiNodesTest-79489 tempest-ServersOnMultiNodesTest-79489-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:34.236279 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d254b3c9-a4ac-4c8b-b850-83d1abba836e tempest-ServersOnMultiNodesTest-79489 tempest-ServersOnMultiNodesTest-79489-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:34.243543 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d254b3c9-a4ac-4c8b-b850-83d1abba836e tempest-ServersOnMultiNodesTest-79489 tempest-ServersOnMultiNodesTest-79489-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:34.244323 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d254b3c9-a4ac-4c8b-b850-83d1abba836e tempest-ServersOnMultiNodesTest-79489 tempest-ServersOnMultiNodesTest-79489-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:34.244803 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d254b3c9-a4ac-4c8b-b850-83d1abba836e tempest-ServersOnMultiNodesTest-79489 tempest-ServersOnMultiNodesTest-79489-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:34.245238 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d254b3c9-a4ac-4c8b-b850-83d1abba836e tempest-ServersOnMultiNodesTest-79489 tempest-ServersOnMultiNodesTest-79489-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:34.349668 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-00aefb20-f4b1-4a6a-9532-473953164b38 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e86e6a62c56248d6a7887be0ec712f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25090b10522b4936b3117dc25dd6f609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:01:34.360208 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-00aefb20-f4b1-4a6a-9532-473953164b38 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] 10.222.0.58 "GET /compute/v2.1/servers/e1deb45a-4597-4456-a1bd-54013c9484a4" status: 200 len: 1473 microversion: 2.1 time: 1.480881 Aug 10 23:01:34.371098 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 683/1343] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:01:32 2022] GET /compute/v2.1/servers/e1deb45a-4597-4456-a1bd-54013c9484a4 => generated 1473 bytes in 1492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:01:34.376046 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-1b9f1e38-e178-4c3d-9978-5915bd2204d7 req-d2ea5d97-5197-4888-a79d-7ccbd53bf6e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a68f86c-37de-4207-aa43-6a1350342a56", "name": "network-vif-unplugged", "status": "completed", "tag": "c4194225-7832-4162-ab1c-9691d11ab1ae"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:01:34.409365 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-1b9f1e38-e178-4c3d-9978-5915bd2204d7 req-d2ea5d97-5197-4888-a79d-7ccbd53bf6e6 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:34.409762 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-1b9f1e38-e178-4c3d-9978-5915bd2204d7 req-d2ea5d97-5197-4888-a79d-7ccbd53bf6e6 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:34.410198 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-1b9f1e38-e178-4c3d-9978-5915bd2204d7 req-d2ea5d97-5197-4888-a79d-7ccbd53bf6e6 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:34.458647 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-1b9f1e38-e178-4c3d-9978-5915bd2204d7 req-d2ea5d97-5197-4888-a79d-7ccbd53bf6e6 service nova] Creating event network-vif-unplugged:c4194225-7832-4162-ab1c-9691d11ab1ae for instance 2a68f86c-37de-4207-aa43-6a1350342a56 on n-h2-850468-14 Aug 10 23:01:34.471101 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-1b9f1e38-e178-4c3d-9978-5915bd2204d7 req-d2ea5d97-5197-4888-a79d-7ccbd53bf6e6 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.098639 Aug 10 23:01:34.472021 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 684/1344] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:01:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:01:34.483610 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-e983f551-18e9-4f69-b333-179fa9f25b8d tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:34.484262 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-e983f551-18e9-4f69-b333-179fa9f25b8d tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 0dabc2bf-08ff-45b5-a791-34d655349eae] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:01:34.497634 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e983f551-18e9-4f69-b333-179fa9f25b8d tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:34.499073 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e983f551-18e9-4f69-b333-179fa9f25b8d tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:34.499709 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e983f551-18e9-4f69-b333-179fa9f25b8d tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:34.500591 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e983f551-18e9-4f69-b333-179fa9f25b8d tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:34.503294 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e983f551-18e9-4f69-b333-179fa9f25b8d tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:34.504332 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e983f551-18e9-4f69-b333-179fa9f25b8d tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:34.592466 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-d254b3c9-a4ac-4c8b-b850-83d1abba836e tempest-ServersOnMultiNodesTest-79489 tempest-ServersOnMultiNodesTest-79489-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/ad02bba7-86a5-4148-a83e-0fbd71645e4a" status: 200 len: 1622 microversion: 2.1 time: 0.399243 Aug 10 23:01:34.593879 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 661/1345] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:01:34 2022] GET /compute/v2.1/servers/ad02bba7-86a5-4148-a83e-0fbd71645e4a => generated 1622 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:01:34.653189 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=100 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:01:35.050349 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-76fb0e9f-ef14-4fae-abfa-d15580355fa3 req-4623be82-82c0-4d72-b779-7af9607293e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1deb45a-4597-4456-a1bd-54013c9484a4", "name": "network-vif-deleted", "tag": "c23c9196-ec43-4cc3-a250-0ae9f5c58948"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:01:35.081249 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-76fb0e9f-ef14-4fae-abfa-d15580355fa3 req-4623be82-82c0-4d72-b779-7af9607293e8 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:35.082016 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-76fb0e9f-ef14-4fae-abfa-d15580355fa3 req-4623be82-82c0-4d72-b779-7af9607293e8 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:35.082699 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-76fb0e9f-ef14-4fae-abfa-d15580355fa3 req-4623be82-82c0-4d72-b779-7af9607293e8 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:35.143309 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-76fb0e9f-ef14-4fae-abfa-d15580355fa3 req-4623be82-82c0-4d72-b779-7af9607293e8 service nova] Creating event network-vif-deleted:c23c9196-ec43-4cc3-a250-0ae9f5c58948 for instance e1deb45a-4597-4456-a1bd-54013c9484a4 on n-h1-850468-14 Aug 10 23:01:35.149557 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-76fb0e9f-ef14-4fae-abfa-d15580355fa3 req-4623be82-82c0-4d72-b779-7af9607293e8 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.554151 Aug 10 23:01:35.154696 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 662/1346] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:01:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:01:35.160348 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-2ec6dd14-a4f0-46ff-92a6-d10ecb3dc1fe tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1120817742", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452", "networks": [{"uuid": "b7470d0a-cf37-4051-8236-4c65a5fc36b5"}]}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:01:35.289506 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.network.neutron [None req-2ec6dd14-a4f0-46ff-92a6-d10ecb3dc1fe tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] validate_networks() for [('b7470d0a-cf37-4051-8236-4c65a5fc36b5', None, None, None, None, None)] {{(pid=122632) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 23:01:35.537478 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-e983f551-18e9-4f69-b333-179fa9f25b8d tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:01:35.548519 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-e983f551-18e9-4f69-b333-179fa9f25b8d tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/0dabc2bf-08ff-45b5-a791-34d655349eae" status: 200 len: 1475 microversion: 2.1 time: 1.075289 Aug 10 23:01:35.549447 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 685/1347] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:01:34 2022] GET /compute/v2.1/servers/0dabc2bf-08ff-45b5-a791-34d655349eae => generated 1475 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:01:35.561786 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-913ca156-5c43-457d-84ec-f593e5eededd tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:35.563089 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-913ca156-5c43-457d-84ec-f593e5eededd tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] [instance: 8e91f1ac-f79d-4ab0-aa13-ea32b0e74888] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:01:35.576648 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-913ca156-5c43-457d-84ec-f593e5eededd tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:35.577653 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-913ca156-5c43-457d-84ec-f593e5eededd tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:35.578388 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-913ca156-5c43-457d-84ec-f593e5eededd tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:35.579616 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-913ca156-5c43-457d-84ec-f593e5eededd tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:35.580278 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-913ca156-5c43-457d-84ec-f593e5eededd tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:35.580917 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-913ca156-5c43-457d-84ec-f593e5eededd tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:35.799997 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-2ec6dd14-a4f0-46ff-92a6-d10ecb3dc1fe tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Flavor limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:01:35.801292 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-2ec6dd14-a4f0-46ff-92a6-d10ecb3dc1fe tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Image limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:01:35.801780 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-2ec6dd14-a4f0-46ff-92a6-d10ecb3dc1fe tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Flavor pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:01:35.803697 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-2ec6dd14-a4f0-46ff-92a6-d10ecb3dc1fe tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Image pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:01:35.804143 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-2ec6dd14-a4f0-46ff-92a6-d10ecb3dc1fe tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:01:35.818077 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2ec6dd14-a4f0-46ff-92a6-d10ecb3dc1fe tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:35.819338 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2ec6dd14-a4f0-46ff-92a6-d10ecb3dc1fe tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:35.819917 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2ec6dd14-a4f0-46ff-92a6-d10ecb3dc1fe tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:35.820715 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2ec6dd14-a4f0-46ff-92a6-d10ecb3dc1fe tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:35.821504 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2ec6dd14-a4f0-46ff-92a6-d10ecb3dc1fe tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:35.822616 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2ec6dd14-a4f0-46ff-92a6-d10ecb3dc1fe tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:35.848756 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-2ec6dd14-a4f0-46ff-92a6-d10ecb3dc1fe tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Getting quotas for project 307ab95daa034afbb31f90626885072b. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:01:35.853583 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-2ec6dd14-a4f0-46ff-92a6-d10ecb3dc1fe tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Getting quotas for user 7d6d9806b6724e5aaf8c69be8e70d4f3 and project 307ab95daa034afbb31f90626885072b. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:01:35.868337 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-2ec6dd14-a4f0-46ff-92a6-d10ecb3dc1fe tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Going to run 1 instances... {{(pid=122632) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 23:01:35.870985 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-2ec6dd14-a4f0-46ff-92a6-d10ecb3dc1fe tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] [instance: 1af4c3de-2464-45c7-a088-a3db68a67cb6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78ad8905-f66f-4733-8be9-2b260f1fabed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122632) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 23:01:35.961236 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-2ec6dd14-a4f0-46ff-92a6-d10ecb3dc1fe tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.804993 Aug 10 23:01:35.970320 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 663/1348] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 23:01:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 815 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 23:01:35.984203 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-e833e000-e386-423a-b576-685aa3ac4400 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-2027028528", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "0af574c3-bfa0-4df6-8f0e-6fcd12e9b8a9"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:01:36.091919 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.network.neutron [None req-e833e000-e386-423a-b576-685aa3ac4400 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] validate_networks() for None {{(pid=122632) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 23:01:36.178601 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-913ca156-5c43-457d-84ec-f593e5eededd tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632904331d024d9b8e4d3660dff2cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ed0bdee3aa4013bd9219069bda558c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:01:36.198307 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-913ca156-5c43-457d-84ec-f593e5eededd tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] 10.222.0.58 "GET /compute/v2.1/servers/8e91f1ac-f79d-4ab0-aa13-ea32b0e74888" status: 200 len: 1718 microversion: 2.1 time: 0.639251 Aug 10 23:01:36.211990 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 686/1349] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:01:35 2022] GET /compute/v2.1/servers/8e91f1ac-f79d-4ab0-aa13-ea32b0e74888 => generated 1718 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:01:36.219090 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-ca3eb0eb-7a19-4e72-bf22-2127fb2fce71 tempest-VolumesTestJSON-1487653355 tempest-VolumesTestJSON-1487653355-project] Calling method '.version_select at 0x7f847d278280>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:36.319567 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-ca3eb0eb-7a19-4e72-bf22-2127fb2fce71 tempest-VolumesTestJSON-1487653355 tempest-VolumesTestJSON-1487653355-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/7fa393d5-d958-4b3e-8dc7-e39151ceab5f" status: 200 len: 351 microversion: 2.1 time: 0.105384 Aug 10 23:01:36.325274 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 687/1350] 10.222.0.58 () {58 vars in 1245 bytes} [Wed Aug 10 23:01:36 2022] GET /compute/v2.1/os-volumes/7fa393d5-d958-4b3e-8dc7-e39151ceab5f => generated 351 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:01:36.337433 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-cc71e32f-1626-4188-b729-a8ae5ed43d85 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:36.339266 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-cc71e32f-1626-4188-b729-a8ae5ed43d85 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] [instance: e1deb45a-4597-4456-a1bd-54013c9484a4] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:01:36.347447 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cc71e32f-1626-4188-b729-a8ae5ed43d85 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:36.348072 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cc71e32f-1626-4188-b729-a8ae5ed43d85 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:36.348518 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cc71e32f-1626-4188-b729-a8ae5ed43d85 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:36.349215 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cc71e32f-1626-4188-b729-a8ae5ed43d85 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:36.349962 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cc71e32f-1626-4188-b729-a8ae5ed43d85 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:36.350604 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cc71e32f-1626-4188-b729-a8ae5ed43d85 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:36.373238 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-cc71e32f-1626-4188-b729-a8ae5ed43d85 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] HTTP exception thrown: Instance e1deb45a-4597-4456-a1bd-54013c9484a4 could not be found. Aug 10 23:01:36.375746 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-cc71e32f-1626-4188-b729-a8ae5ed43d85 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Request method failure captured: Aug 10 23:01:36.375746 n-d-850468-14 devstack@n-api.service[122633]: request: GET /compute/v2.1/servers/e1deb45a-4597-4456-a1bd-54013c9484a4 HTTP/1.1 Aug 10 23:01:36.375746 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:01:36.375746 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:01:36.375746 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:01:36.375746 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:01:36.375746 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:01:36.375746 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:01:36.375746 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:01:36.375746 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:01:36.375746 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9Dg3NhcIJLK3Y8FAVjYa9X-ZLnPSb9zvV5Bp2tiJIC26mHPrUnxHxVzN8tYWmuI7xcyWSc_C3hx3ccBmr6RXqstcE0nOh6Bb4G8yiQtk-ugV8MXuFEVU6XvkcR3xUUOuEnCsKoIyH4xNeJ9NWvmB5UNhjQzhz4MEHWwqtOE4cs4ExA0 Aug 10 23:01:36.375746 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:01:36.375746 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:01:36.375746 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:01:36.375746 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:01:36.375746 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:01:36.375746 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:01:36.375746 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 25090b10522b4936b3117dc25dd6f609 Aug 10 23:01:36.375746 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-ListImageFiltersTestJSON-1194065369 Aug 10 23:01:36.375746 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:01:36.375746 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:01:36.377308 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/25090b10522b4936b3117dc25dd6f609"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/25090b10522b4936b3117dc25dd6f609"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/25090b10522b4936b3117dc25dd6f609"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_25090b10522b4936b3117dc25dd6f609", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:01:36.377308 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-ListImageFiltersTestJSON-1194065369 Aug 10 23:01:36.377308 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 25090b10522b4936b3117dc25dd6f609 Aug 10 23:01:36.377308 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1194065369 Aug 10 23:01:36.377308 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-ListImageFiltersTestJSON-1194065369-project Aug 10 23:01:36.377308 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:01:36.377308 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:01:36.377308 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: e86e6a62c56248d6a7887be0ec712f95 Aug 10 23:01:36.377308 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-ListImageFiltersTestJSON-1194065369-project Aug 10 23:01:36.377308 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:01:36.377308 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance e1deb45a-4597-4456-a1bd-54013c9484a4 could not be found. Aug 10 23:01:36.377308 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': 'e1deb45a-4597-4456-a1bd-54013c9484a4'} Aug 10 23:01:36.378174 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:01:36.378174 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:01:36.378174 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:01:36.378174 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:01:36.378174 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:01:36.378174 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:01:36.378174 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:01:36.378174 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:01:36.378174 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:01:36.378174 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:01:36.378174 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1deb45a-4597-4456-a1bd-54013c9484a4 could not be found. Aug 10 23:01:36.378174 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:01:36.378174 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:01:36.378174 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:01:36.378174 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:01:36.378174 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:01:36.378174 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:01:36.378174 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:01:36.378174 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:01:36.378174 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:01:36.381903 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:01:36.381903 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:01:36.381903 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:01:36.381903 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:01:36.381903 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:01:36.381903 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:01:36.381903 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:01:36.381903 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1deb45a-4597-4456-a1bd-54013c9484a4 could not be found. Aug 10 23:01:36.381903 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:01:36.381903 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:01:36.381903 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:01:36.381903 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:01:36.381903 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:01:36.381903 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:01:36.381903 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:01:36.381903 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:01:36.381903 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1deb45a-4597-4456-a1bd-54013c9484a4 could not be found. Aug 10 23:01:36.381903 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:01:36.387602 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-cc71e32f-1626-4188-b729-a8ae5ed43d85 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Returning 404 to user: Instance e1deb45a-4597-4456-a1bd-54013c9484a4 could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:01:36.389372 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-cc71e32f-1626-4188-b729-a8ae5ed43d85 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] 10.222.0.58 "GET /compute/v2.1/servers/e1deb45a-4597-4456-a1bd-54013c9484a4" status: 404 len: 111 microversion: 2.1 time: 0.059941 Aug 10 23:01:36.390828 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 688/1351] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:01:36 2022] GET /compute/v2.1/servers/e1deb45a-4597-4456-a1bd-54013c9484a4 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:01:36.396378 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-d678eed9-8939-4d9d-af6d-cf81967bfe80 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:36.397973 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-d678eed9-8939-4d9d-af6d-cf81967bfe80 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] [instance: 1af4c3de-2464-45c7-a088-a3db68a67cb6] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:01:36.537084 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-d678eed9-8939-4d9d-af6d-cf81967bfe80 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6d9806b6724e5aaf8c69be8e70d4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307ab95daa034afbb31f90626885072b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:01:36.549938 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-d678eed9-8939-4d9d-af6d-cf81967bfe80 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] 10.222.0.58 "GET /compute/v2.1/servers/1af4c3de-2464-45c7-a088-a3db68a67cb6" status: 200 len: 1208 microversion: 2.1 time: 0.154464 Aug 10 23:01:36.552353 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 689/1352] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:01:36 2022] GET /compute/v2.1/servers/1af4c3de-2464-45c7-a088-a3db68a67cb6 => generated 1208 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:01:36.563459 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-9ac23a94-3123-473d-9209-89b5630121ca tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-397992786", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "aa35c9d2-0c9d-4fce-b653-23b4074314a8"}], "block_device_mapping_v2": [{"uuid": "49aff90d-b3ea-4740-b075-69dbbc299d58", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:01:36.687463 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-e833e000-e386-423a-b576-685aa3ac4400 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Flavor limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:01:36.687893 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-e833e000-e386-423a-b576-685aa3ac4400 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Image limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:01:36.688365 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-e833e000-e386-423a-b576-685aa3ac4400 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Flavor pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:01:36.688779 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-e833e000-e386-423a-b576-685aa3ac4400 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Image pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:01:36.689173 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-e833e000-e386-423a-b576-685aa3ac4400 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:01:36.706892 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.network.neutron [None req-9ac23a94-3123-473d-9209-89b5630121ca tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] validate_networks() for [('aa35c9d2-0c9d-4fce-b653-23b4074314a8', None, None, None, None, None)] {{(pid=122633) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 23:01:36.707147 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e833e000-e386-423a-b576-685aa3ac4400 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:36.708031 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e833e000-e386-423a-b576-685aa3ac4400 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:36.708723 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e833e000-e386-423a-b576-685aa3ac4400 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:36.709679 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e833e000-e386-423a-b576-685aa3ac4400 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:36.710357 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e833e000-e386-423a-b576-685aa3ac4400 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:36.711036 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e833e000-e386-423a-b576-685aa3ac4400 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:36.746261 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-e833e000-e386-423a-b576-685aa3ac4400 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Getting quotas for project b27e6ee9495a438b8450a4ef0d62cbcd. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:01:36.752777 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-e833e000-e386-423a-b576-685aa3ac4400 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Getting quotas for user 417d4eaaeb1c4df78745496ececb3e88 and project b27e6ee9495a438b8450a4ef0d62cbcd. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:01:36.772135 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-e833e000-e386-423a-b576-685aa3ac4400 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Going to run 1 instances... {{(pid=122632) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 23:01:36.778714 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-e833e000-e386-423a-b576-685aa3ac4400 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] [instance: 196377d7-c0d5-408b-9743-e1f451f71164] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78ad8905-f66f-4733-8be9-2b260f1fabed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122632) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 23:01:36.873554 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-e833e000-e386-423a-b576-685aa3ac4400 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.901004 Aug 10 23:01:36.874794 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 664/1353] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 23:01:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 903 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 23:01:36.885121 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-4a0475aa-55d2-423b-95cb-3024bb8a981b tempest-VolumesTestJSON-1487653355 tempest-VolumesTestJSON-1487653355-project] Calling method '.version_select at 0x7f847d0df0d0>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:37.023387 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-4a0475aa-55d2-423b-95cb-3024bb8a981b tempest-VolumesTestJSON-1487653355 tempest-VolumesTestJSON-1487653355-project] 10.222.0.58 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.147366 Aug 10 23:01:37.023992 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 665/1354] 10.222.0.58 () {58 vars in 1134 bytes} [Wed Aug 10 23:01:36 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:01:37.039459 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-af223c43-77b4-43bc-9af2-e79938002d31 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:37.044810 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-af223c43-77b4-43bc-9af2-e79938002d31 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] [instance: d716cac6-ac7c-4b98-b6ea-2496ccd62096] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:01:37.071977 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-af223c43-77b4-43bc-9af2-e79938002d31 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:37.072838 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-af223c43-77b4-43bc-9af2-e79938002d31 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:37.077064 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-af223c43-77b4-43bc-9af2-e79938002d31 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:37.078025 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-af223c43-77b4-43bc-9af2-e79938002d31 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:37.084588 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-af223c43-77b4-43bc-9af2-e79938002d31 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:37.086207 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-af223c43-77b4-43bc-9af2-e79938002d31 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:37.145721 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-af223c43-77b4-43bc-9af2-e79938002d31 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] [instance: d716cac6-ac7c-4b98-b6ea-2496ccd62096] Going to try to terminate instance {{(pid=122632) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:01:37.261518 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-af223c43-77b4-43bc-9af2-e79938002d31 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] 10.222.0.58 "DELETE /compute/v2.1/servers/d716cac6-ac7c-4b98-b6ea-2496ccd62096" status: 204 len: 0 microversion: 2.1 time: 0.233248 Aug 10 23:01:37.265834 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 666/1355] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:01:37 2022] DELETE /compute/v2.1/servers/d716cac6-ac7c-4b98-b6ea-2496ccd62096 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:01:37.276013 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-cc865b45-587c-4d9a-bf40-7654bec1c9d6 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:37.276882 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-cc865b45-587c-4d9a-bf40-7654bec1c9d6 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 0dabc2bf-08ff-45b5-a791-34d655349eae] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:01:37.284918 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cc865b45-587c-4d9a-bf40-7654bec1c9d6 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:37.285325 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cc865b45-587c-4d9a-bf40-7654bec1c9d6 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:37.285756 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cc865b45-587c-4d9a-bf40-7654bec1c9d6 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:37.286642 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cc865b45-587c-4d9a-bf40-7654bec1c9d6 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:37.287571 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cc865b45-587c-4d9a-bf40-7654bec1c9d6 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:37.288071 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cc865b45-587c-4d9a-bf40-7654bec1c9d6 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:37.469207 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-cc865b45-587c-4d9a-bf40-7654bec1c9d6 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:01:37.478066 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-cc865b45-587c-4d9a-bf40-7654bec1c9d6 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/0dabc2bf-08ff-45b5-a791-34d655349eae" status: 200 len: 1473 microversion: 2.1 time: 0.210816 Aug 10 23:01:37.496166 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 667/1356] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:01:37 2022] GET /compute/v2.1/servers/0dabc2bf-08ff-45b5-a791-34d655349eae => generated 1473 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:01:37.500854 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-009a44a7-43c4-4758-b147-28267bafd28a tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:37.501541 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-009a44a7-43c4-4758-b147-28267bafd28a tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] [instance: 196377d7-c0d5-408b-9743-e1f451f71164] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:01:37.600007 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-009a44a7-43c4-4758-b147-28267bafd28a tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '417d4eaaeb1c4df78745496ececb3e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27e6ee9495a438b8450a4ef0d62cbcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:01:37.615647 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-009a44a7-43c4-4758-b147-28267bafd28a tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] 10.222.0.58 "GET /compute/v2.1/servers/196377d7-c0d5-408b-9743-e1f451f71164" status: 200 len: 1217 microversion: 2.1 time: 0.118685 Aug 10 23:01:37.630512 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 668/1357] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:01:37 2022] GET /compute/v2.1/servers/196377d7-c0d5-408b-9743-e1f451f71164 => generated 1217 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:01:37.636168 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-88091351-7ecd-4509-b76f-2a3588f8503b tempest-VolumesTestJSON-1487653355 tempest-VolumesTestJSON-1487653355-project] Calling method '.version_select at 0x7f847d208c10>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:37.758428 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-88091351-7ecd-4509-b76f-2a3588f8503b tempest-VolumesTestJSON-1487653355 tempest-VolumesTestJSON-1487653355-project] 10.222.0.58 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.138300 Aug 10 23:01:37.759079 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 669/1358] 10.222.0.58 () {58 vars in 1149 bytes} [Wed Aug 10 23:01:37 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:01:37.764824 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-7ed597c6-a2e8-444a-880a-1f4ab0e81f4c req-21972d56-2406-47d9-97f5-27ab8ffb006d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a68f86c-37de-4207-aa43-6a1350342a56", "name": "network-vif-deleted", "tag": "c4194225-7832-4162-ab1c-9691d11ab1ae"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:01:37.776489 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-7ed597c6-a2e8-444a-880a-1f4ab0e81f4c req-21972d56-2406-47d9-97f5-27ab8ffb006d service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:37.776973 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-7ed597c6-a2e8-444a-880a-1f4ab0e81f4c req-21972d56-2406-47d9-97f5-27ab8ffb006d service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:37.777409 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-7ed597c6-a2e8-444a-880a-1f4ab0e81f4c req-21972d56-2406-47d9-97f5-27ab8ffb006d service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:37.788768 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-7ed597c6-a2e8-444a-880a-1f4ab0e81f4c req-21972d56-2406-47d9-97f5-27ab8ffb006d service nova] Creating event network-vif-deleted:c4194225-7832-4162-ab1c-9691d11ab1ae for instance 2a68f86c-37de-4207-aa43-6a1350342a56 on n-h2-850468-14 Aug 10 23:01:37.793963 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-7ed597c6-a2e8-444a-880a-1f4ab0e81f4c req-21972d56-2406-47d9-97f5-27ab8ffb006d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033318 Aug 10 23:01:37.794528 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 670/1359] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:01:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:01:37.800064 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-e8493aae-758b-4d8b-8faf-02c8b51f2a7c tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:37.800772 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-e8493aae-758b-4d8b-8faf-02c8b51f2a7c tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] [instance: 8e91f1ac-f79d-4ab0-aa13-ea32b0e74888] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:01:37.807322 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e8493aae-758b-4d8b-8faf-02c8b51f2a7c tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:37.807818 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e8493aae-758b-4d8b-8faf-02c8b51f2a7c tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:37.808259 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e8493aae-758b-4d8b-8faf-02c8b51f2a7c tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:37.808978 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e8493aae-758b-4d8b-8faf-02c8b51f2a7c tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:37.809696 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e8493aae-758b-4d8b-8faf-02c8b51f2a7c tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:37.810849 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e8493aae-758b-4d8b-8faf-02c8b51f2a7c tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:37.953464 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-e8493aae-758b-4d8b-8faf-02c8b51f2a7c tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632904331d024d9b8e4d3660dff2cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ed0bdee3aa4013bd9219069bda558c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:01:37.962939 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-e8493aae-758b-4d8b-8faf-02c8b51f2a7c tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] 10.222.0.58 "GET /compute/v2.1/servers/8e91f1ac-f79d-4ab0-aa13-ea32b0e74888" status: 200 len: 1718 microversion: 2.1 time: 0.166655 Aug 10 23:01:37.963751 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 671/1360] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:01:37 2022] GET /compute/v2.1/servers/8e91f1ac-f79d-4ab0-aa13-ea32b0e74888 => generated 1718 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:01:37.969643 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c425d44d-3c62-4c05-8df3-dbcd3f154dbf tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:37.970258 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-c425d44d-3c62-4c05-8df3-dbcd3f154dbf tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] [instance: d716cac6-ac7c-4b98-b6ea-2496ccd62096] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:01:37.978187 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c425d44d-3c62-4c05-8df3-dbcd3f154dbf tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:37.978678 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c425d44d-3c62-4c05-8df3-dbcd3f154dbf tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:37.979147 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c425d44d-3c62-4c05-8df3-dbcd3f154dbf tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:37.979864 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c425d44d-3c62-4c05-8df3-dbcd3f154dbf tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:37.980318 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c425d44d-3c62-4c05-8df3-dbcd3f154dbf tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:37.980928 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c425d44d-3c62-4c05-8df3-dbcd3f154dbf tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:38.186769 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-c425d44d-3c62-4c05-8df3-dbcd3f154dbf tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e86e6a62c56248d6a7887be0ec712f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25090b10522b4936b3117dc25dd6f609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:01:38.202046 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-c425d44d-3c62-4c05-8df3-dbcd3f154dbf tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] 10.222.0.58 "GET /compute/v2.1/servers/d716cac6-ac7c-4b98-b6ea-2496ccd62096" status: 200 len: 1473 microversion: 2.1 time: 0.235797 Aug 10 23:01:38.203305 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 672/1361] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:01:37 2022] GET /compute/v2.1/servers/d716cac6-ac7c-4b98-b6ea-2496ccd62096 => generated 1473 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:01:38.209740 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-55c78a40-daad-4210-ac9b-3f631a02f950 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:38.210669 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-55c78a40-daad-4210-ac9b-3f631a02f950 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] [instance: 1af4c3de-2464-45c7-a088-a3db68a67cb6] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:01:38.224332 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-55c78a40-daad-4210-ac9b-3f631a02f950 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:38.225322 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-55c78a40-daad-4210-ac9b-3f631a02f950 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:38.226050 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-55c78a40-daad-4210-ac9b-3f631a02f950 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:38.227744 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-55c78a40-daad-4210-ac9b-3f631a02f950 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:38.228200 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-55c78a40-daad-4210-ac9b-3f631a02f950 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:38.228984 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-55c78a40-daad-4210-ac9b-3f631a02f950 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:38.321918 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-9ac23a94-3123-473d-9209-89b5630121ca tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Flavor limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:01:38.322903 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-9ac23a94-3123-473d-9209-89b5630121ca tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Image limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:01:38.324275 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-9ac23a94-3123-473d-9209-89b5630121ca tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Flavor pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:01:38.324853 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-9ac23a94-3123-473d-9209-89b5630121ca tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Image pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:01:38.326667 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-9ac23a94-3123-473d-9209-89b5630121ca tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:01:38.336287 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-55c78a40-daad-4210-ac9b-3f631a02f950 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6d9806b6724e5aaf8c69be8e70d4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307ab95daa034afbb31f90626885072b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:01:38.337489 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9ac23a94-3123-473d-9209-89b5630121ca tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:38.338456 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9ac23a94-3123-473d-9209-89b5630121ca tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:38.339081 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9ac23a94-3123-473d-9209-89b5630121ca tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:38.339970 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9ac23a94-3123-473d-9209-89b5630121ca tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:38.340577 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9ac23a94-3123-473d-9209-89b5630121ca tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:38.341737 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9ac23a94-3123-473d-9209-89b5630121ca tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:38.347340 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-55c78a40-daad-4210-ac9b-3f631a02f950 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] 10.222.0.58 "GET /compute/v2.1/servers/1af4c3de-2464-45c7-a088-a3db68a67cb6" status: 200 len: 1268 microversion: 2.1 time: 0.141373 Aug 10 23:01:38.349655 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 673/1362] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:01:38 2022] GET /compute/v2.1/servers/1af4c3de-2464-45c7-a088-a3db68a67cb6 => generated 1268 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:01:38.360780 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-a16f1818-9806-4d91-a94f-24aaab3aab82 tempest-VolumesTestJSON-1487653355 tempest-VolumesTestJSON-1487653355-project] Calling method '.version_select at 0x7f847d1735e0>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:38.367905 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-9ac23a94-3123-473d-9209-89b5630121ca tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Getting quotas for project b4355fdc73c84fa2baf0d5c9a33e69d5. Resources: {'instances', 'cores', 'ram'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:01:38.373903 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-9ac23a94-3123-473d-9209-89b5630121ca tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Getting quotas for user 394f0e6843424c7b83d2dfff61f66ede and project b4355fdc73c84fa2baf0d5c9a33e69d5. Resources: {'instances', 'cores', 'ram'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:01:38.445120 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-9ac23a94-3123-473d-9209-89b5630121ca tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Going to run 1 instances... {{(pid=122633) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 23:01:38.447234 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-9ac23a94-3123-473d-9209-89b5630121ca tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] [instance: 3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='49aff90d-b3ea-4740-b075-69dbbc299d58',volume_size=None,volume_type=None)] {{(pid=122633) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 23:01:38.478478 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-a16f1818-9806-4d91-a94f-24aaab3aab82 tempest-VolumesTestJSON-1487653355 tempest-VolumesTestJSON-1487653355-project] 10.222.0.58 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.126978 Aug 10 23:01:38.479500 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 674/1363] 10.222.0.58 () {58 vars in 1134 bytes} [Wed Aug 10 23:01:38 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:01:38.495127 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-df079bc1-54a6-497b-a537-e86fe08cc7e5 tempest-VolumesTestJSON-1487653355 tempest-VolumesTestJSON-1487653355-project] Calling method '.version_select at 0x7f847d0d4160>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:38.594588 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-df079bc1-54a6-497b-a537-e86fe08cc7e5 tempest-VolumesTestJSON-1487653355 tempest-VolumesTestJSON-1487653355-project] 10.222.0.58 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.102944 Aug 10 23:01:38.610137 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 675/1364] 10.222.0.58 () {58 vars in 1167 bytes} [Wed Aug 10 23:01:38 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:01:38.619174 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-70de34ae-c601-4ebc-a4c5-46c631560c7a tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:38.620633 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-70de34ae-c601-4ebc-a4c5-46c631560c7a tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 0dabc2bf-08ff-45b5-a791-34d655349eae] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:01:38.636443 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-70de34ae-c601-4ebc-a4c5-46c631560c7a tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:38.637088 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-70de34ae-c601-4ebc-a4c5-46c631560c7a tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:38.638391 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-70de34ae-c601-4ebc-a4c5-46c631560c7a tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:38.640770 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-70de34ae-c601-4ebc-a4c5-46c631560c7a tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:38.640972 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-70de34ae-c601-4ebc-a4c5-46c631560c7a tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:38.641719 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-70de34ae-c601-4ebc-a4c5-46c631560c7a tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:38.730136 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-9ac23a94-3123-473d-9209-89b5630121ca tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 2.176109 Aug 10 23:01:38.733216 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 690/1365] 10.222.0.58 () {62 vars in 1188 bytes} [Wed Aug 10 23:01:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 2180 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 10 23:01:38.742586 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-58c96458-0885-4165-9490-fd2c756cd1d5 tempest-VolumesTestJSON-1487653355 tempest-VolumesTestJSON-1487653355-project] Calling method '.version_select at 0x7f847cf67d30>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:38.845203 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-58c96458-0885-4165-9490-fd2c756cd1d5 tempest-VolumesTestJSON-1487653355 tempest-VolumesTestJSON-1487653355-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.110304 Aug 10 23:01:38.846059 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 691/1366] 10.222.0.58 () {58 vars in 1170 bytes} [Wed Aug 10 23:01:38 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:01:38.859912 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-f3923da8-57ea-4a5a-aa31-5cf870e565a0 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:38.861054 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-f3923da8-57ea-4a5a-aa31-5cf870e565a0 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] [instance: 196377d7-c0d5-408b-9743-e1f451f71164] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:01:38.871700 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f3923da8-57ea-4a5a-aa31-5cf870e565a0 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:38.872690 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f3923da8-57ea-4a5a-aa31-5cf870e565a0 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:38.873601 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f3923da8-57ea-4a5a-aa31-5cf870e565a0 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:38.874323 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f3923da8-57ea-4a5a-aa31-5cf870e565a0 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:38.874987 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f3923da8-57ea-4a5a-aa31-5cf870e565a0 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:38.875577 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f3923da8-57ea-4a5a-aa31-5cf870e565a0 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:38.945000 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-f3923da8-57ea-4a5a-aa31-5cf870e565a0 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '417d4eaaeb1c4df78745496ececb3e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27e6ee9495a438b8450a4ef0d62cbcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:01:38.952730 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-f3923da8-57ea-4a5a-aa31-5cf870e565a0 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] 10.222.0.58 "GET /compute/v2.1/servers/196377d7-c0d5-408b-9743-e1f451f71164" status: 200 len: 1221 microversion: 2.1 time: 0.105266 Aug 10 23:01:38.963404 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 692/1367] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:01:38 2022] GET /compute/v2.1/servers/196377d7-c0d5-408b-9743-e1f451f71164 => generated 1221 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:01:38.963404 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-742838ae-ec2c-4637-9506-e31c997ff5aa tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:38.963404 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-742838ae-ec2c-4637-9506-e31c997ff5aa tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] [instance: 3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:01:38.988903 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-70de34ae-c601-4ebc-a4c5-46c631560c7a tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:01:38.998941 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-70de34ae-c601-4ebc-a4c5-46c631560c7a tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/0dabc2bf-08ff-45b5-a791-34d655349eae" status: 200 len: 1470 microversion: 2.1 time: 0.386274 Aug 10 23:01:38.999956 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 676/1368] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:01:38 2022] GET /compute/v2.1/servers/0dabc2bf-08ff-45b5-a791-34d655349eae => generated 1470 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:01:39.006727 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-fb355df1-ca81-4d96-832b-842e67f90b8d tempest-VolumesTestJSON-1487653355 tempest-VolumesTestJSON-1487653355-project] Calling method '.version_select at 0x7f847d174040>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:39.167904 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-fb355df1-ca81-4d96-832b-842e67f90b8d tempest-VolumesTestJSON-1487653355 tempest-VolumesTestJSON-1487653355-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.166719 Aug 10 23:01:39.178912 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 677/1369] 10.222.0.58 () {58 vars in 1155 bytes} [Wed Aug 10 23:01:38 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:01:39.188768 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-e673769d-0146-434e-9163-9061dc9f4ff9 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:39.189536 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-e673769d-0146-434e-9163-9061dc9f4ff9 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] [instance: 8e91f1ac-f79d-4ab0-aa13-ea32b0e74888] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:01:39.193798 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=3,nova_api:INSERT=6 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:01:39.200137 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e673769d-0146-434e-9163-9061dc9f4ff9 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:39.201966 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e673769d-0146-434e-9163-9061dc9f4ff9 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:39.202602 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e673769d-0146-434e-9163-9061dc9f4ff9 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:39.203572 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e673769d-0146-434e-9163-9061dc9f4ff9 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:39.204241 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e673769d-0146-434e-9163-9061dc9f4ff9 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:39.204876 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e673769d-0146-434e-9163-9061dc9f4ff9 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:39.242884 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-742838ae-ec2c-4637-9506-e31c997ff5aa tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:01:39.253316 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-742838ae-ec2c-4637-9506-e31c997ff5aa tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:01:39.254884 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-742838ae-ec2c-4637-9506-e31c997ff5aa tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:01:39.255999 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-742838ae-ec2c-4637-9506-e31c997ff5aa tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] 10.222.0.58 "GET /compute/v2.1/servers/3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51" status: 200 len: 1103 microversion: 2.25 time: 0.300626 Aug 10 23:01:39.258915 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 693/1370] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:01:38 2022] GET /compute/v2.1/servers/3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51 => generated 1103 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:01:39.290179 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-81d17e55-60ba-443a-843a-7f5779a14205 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:01:39.292398 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-81d17e55-60ba-443a-843a-7f5779a14205 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 0dabc2bf-08ff-45b5-a791-34d655349eae] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:01:39.303175 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-81d17e55-60ba-443a-843a-7f5779a14205 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:39.304276 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-81d17e55-60ba-443a-843a-7f5779a14205 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:39.305157 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-81d17e55-60ba-443a-843a-7f5779a14205 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:39.306320 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-81d17e55-60ba-443a-843a-7f5779a14205 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:39.307409 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-81d17e55-60ba-443a-843a-7f5779a14205 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:39.308272 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-81d17e55-60ba-443a-843a-7f5779a14205 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:39.509243 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-e673769d-0146-434e-9163-9061dc9f4ff9 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632904331d024d9b8e4d3660dff2cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ed0bdee3aa4013bd9219069bda558c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:01:39.545866 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-e673769d-0146-434e-9163-9061dc9f4ff9 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] 10.222.0.58 "GET /compute/v2.1/servers/8e91f1ac-f79d-4ab0-aa13-ea32b0e74888" status: 200 len: 1718 microversion: 2.1 time: 0.350512 Aug 10 23:01:39.546676 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 678/1371] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:01:39 2022] GET /compute/v2.1/servers/8e91f1ac-f79d-4ab0-aa13-ea32b0e74888 => generated 1718 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:01:39.563735 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-b737e7b1-a724-47a4-97ee-65c852ecb10e tempest-VolumesTestJSON-1487653355 tempest-VolumesTestJSON-1487653355-project] Calling method '.version_select at 0x7f847d1b7160>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:39.588988 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-81d17e55-60ba-443a-843a-7f5779a14205 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "POST /compute/v2.1/servers/0dabc2bf-08ff-45b5-a791-34d655349eae/action" status: 202 len: 0 microversion: 2.1 time: 0.327637 Aug 10 23:01:39.591274 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 694/1372] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:01:39 2022] POST /compute/v2.1/servers/0dabc2bf-08ff-45b5-a791-34d655349eae/action => generated 0 bytes in 331 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:01:39.599540 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-491c9756-faa2-4997-b452-87730fb65219 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:39.600608 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-491c9756-faa2-4997-b452-87730fb65219 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] [instance: d716cac6-ac7c-4b98-b6ea-2496ccd62096] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:01:39.608189 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-491c9756-faa2-4997-b452-87730fb65219 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:39.609123 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-491c9756-faa2-4997-b452-87730fb65219 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:39.610670 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-491c9756-faa2-4997-b452-87730fb65219 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:39.611945 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-491c9756-faa2-4997-b452-87730fb65219 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:39.612669 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-491c9756-faa2-4997-b452-87730fb65219 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:39.613303 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-491c9756-faa2-4997-b452-87730fb65219 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:39.775563 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-b737e7b1-a724-47a4-97ee-65c852ecb10e tempest-VolumesTestJSON-1487653355 tempest-VolumesTestJSON-1487653355-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.226414 Aug 10 23:01:39.776770 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 679/1373] 10.222.0.58 () {58 vars in 1188 bytes} [Wed Aug 10 23:01:39 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:01:39.791285 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-7435fb7e-c983-4e59-8908-721012b3f18e tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:39.792325 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-7435fb7e-c983-4e59-8908-721012b3f18e tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] [instance: 1af4c3de-2464-45c7-a088-a3db68a67cb6] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:01:39.806220 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7435fb7e-c983-4e59-8908-721012b3f18e tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:39.807231 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7435fb7e-c983-4e59-8908-721012b3f18e tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:39.808870 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7435fb7e-c983-4e59-8908-721012b3f18e tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:39.811875 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7435fb7e-c983-4e59-8908-721012b3f18e tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:39.812481 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7435fb7e-c983-4e59-8908-721012b3f18e tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:39.813953 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7435fb7e-c983-4e59-8908-721012b3f18e tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:39.978994 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-7435fb7e-c983-4e59-8908-721012b3f18e tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6d9806b6724e5aaf8c69be8e70d4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307ab95daa034afbb31f90626885072b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:01:40.001639 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-7435fb7e-c983-4e59-8908-721012b3f18e tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] 10.222.0.58 "GET /compute/v2.1/servers/1af4c3de-2464-45c7-a088-a3db68a67cb6" status: 200 len: 1266 microversion: 2.1 time: 0.221645 Aug 10 23:01:40.003691 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 680/1374] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:01:39 2022] GET /compute/v2.1/servers/1af4c3de-2464-45c7-a088-a3db68a67cb6 => generated 1266 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:01:40.021819 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-d3935a7e-c683-49b5-a96b-764c71ee3bbd tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:40.024119 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-d3935a7e-c683-49b5-a96b-764c71ee3bbd tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 0dabc2bf-08ff-45b5-a791-34d655349eae] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:01:40.039057 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d3935a7e-c683-49b5-a96b-764c71ee3bbd tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:40.043792 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d3935a7e-c683-49b5-a96b-764c71ee3bbd tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:40.044844 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d3935a7e-c683-49b5-a96b-764c71ee3bbd tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:40.048147 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d3935a7e-c683-49b5-a96b-764c71ee3bbd tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:40.049408 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d3935a7e-c683-49b5-a96b-764c71ee3bbd tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:40.053467 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d3935a7e-c683-49b5-a96b-764c71ee3bbd tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:40.368578 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-491c9756-faa2-4997-b452-87730fb65219 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e86e6a62c56248d6a7887be0ec712f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25090b10522b4936b3117dc25dd6f609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:01:40.414016 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-491c9756-faa2-4997-b452-87730fb65219 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] 10.222.0.58 "GET /compute/v2.1/servers/d716cac6-ac7c-4b98-b6ea-2496ccd62096" status: 200 len: 1473 microversion: 2.1 time: 0.821243 Aug 10 23:01:40.416782 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 695/1375] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:01:39 2022] GET /compute/v2.1/servers/d716cac6-ac7c-4b98-b6ea-2496ccd62096 => generated 1473 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:01:40.431262 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-9db44231-b462-47c2-a544-ce83a1fdc19c tempest-VolumesTestJSON-1487653355 tempest-VolumesTestJSON-1487653355-project] Calling method '.version_select at 0x7f847cf67ca0>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:40.619212 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-9db44231-b462-47c2-a544-ce83a1fdc19c tempest-VolumesTestJSON-1487653355 tempest-VolumesTestJSON-1487653355-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.192931 Aug 10 23:01:40.619773 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 696/1376] 10.222.0.58 () {58 vars in 1155 bytes} [Wed Aug 10 23:01:40 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:01:40.627048 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-825e7cf6-1d5b-448e-a705-a5cca0910dfd tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:40.629129 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-825e7cf6-1d5b-448e-a705-a5cca0910dfd tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] [instance: 196377d7-c0d5-408b-9743-e1f451f71164] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:01:40.644485 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-825e7cf6-1d5b-448e-a705-a5cca0910dfd tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:40.644980 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-825e7cf6-1d5b-448e-a705-a5cca0910dfd tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:40.645420 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-825e7cf6-1d5b-448e-a705-a5cca0910dfd tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:40.651446 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-825e7cf6-1d5b-448e-a705-a5cca0910dfd tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:40.652126 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-825e7cf6-1d5b-448e-a705-a5cca0910dfd tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:40.652727 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-825e7cf6-1d5b-448e-a705-a5cca0910dfd tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:40.901377 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-825e7cf6-1d5b-448e-a705-a5cca0910dfd tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '417d4eaaeb1c4df78745496ececb3e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27e6ee9495a438b8450a4ef0d62cbcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:01:40.912386 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-825e7cf6-1d5b-448e-a705-a5cca0910dfd tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] 10.222.0.58 "GET /compute/v2.1/servers/196377d7-c0d5-408b-9743-e1f451f71164" status: 200 len: 1277 microversion: 2.1 time: 0.291471 Aug 10 23:01:40.917065 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 697/1377] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:01:40 2022] GET /compute/v2.1/servers/196377d7-c0d5-408b-9743-e1f451f71164 => generated 1277 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:01:40.931249 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-36e50a5a-8393-4dcd-a9cc-074e7709259a tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:40.931249 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-36e50a5a-8393-4dcd-a9cc-074e7709259a tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] [instance: 3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:01:40.949116 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-36e50a5a-8393-4dcd-a9cc-074e7709259a tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:40.949660 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-36e50a5a-8393-4dcd-a9cc-074e7709259a tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:40.950112 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-36e50a5a-8393-4dcd-a9cc-074e7709259a tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:40.951408 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-36e50a5a-8393-4dcd-a9cc-074e7709259a tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:40.952064 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-36e50a5a-8393-4dcd-a9cc-074e7709259a tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:40.952260 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-36e50a5a-8393-4dcd-a9cc-074e7709259a tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:41.123975 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-d3935a7e-c683-49b5-a96b-764c71ee3bbd tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:01:41.140522 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-d3935a7e-c683-49b5-a96b-764c71ee3bbd tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/0dabc2bf-08ff-45b5-a791-34d655349eae" status: 200 len: 1469 microversion: 2.1 time: 1.131145 Aug 10 23:01:41.158986 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 681/1378] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:01:40 2022] GET /compute/v2.1/servers/0dabc2bf-08ff-45b5-a791-34d655349eae => generated 1469 bytes in 1153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:01:41.164438 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-9c8384a9-0887-4d5f-960a-fbb995392998 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:41.172492 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-9c8384a9-0887-4d5f-960a-fbb995392998 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] [instance: 8e91f1ac-f79d-4ab0-aa13-ea32b0e74888] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:01:41.209373 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9c8384a9-0887-4d5f-960a-fbb995392998 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:41.209373 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9c8384a9-0887-4d5f-960a-fbb995392998 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:41.209373 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9c8384a9-0887-4d5f-960a-fbb995392998 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:41.209833 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9c8384a9-0887-4d5f-960a-fbb995392998 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:41.210235 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9c8384a9-0887-4d5f-960a-fbb995392998 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:41.210667 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9c8384a9-0887-4d5f-960a-fbb995392998 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:41.800934 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-36e50a5a-8393-4dcd-a9cc-074e7709259a tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:01:41.813461 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-36e50a5a-8393-4dcd-a9cc-074e7709259a tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:01:41.815952 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-36e50a5a-8393-4dcd-a9cc-074e7709259a tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:01:41.820307 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-36e50a5a-8393-4dcd-a9cc-074e7709259a tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] 10.222.0.58 "GET /compute/v2.1/servers/3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51" status: 200 len: 1250 microversion: 2.25 time: 0.901923 Aug 10 23:01:41.824187 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 698/1379] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:01:40 2022] GET /compute/v2.1/servers/3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51 => generated 1250 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:01:41.840474 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-318f6c64-5af9-4d46-a67a-8522113093b9 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:41.842375 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-318f6c64-5af9-4d46-a67a-8522113093b9 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] [instance: 1af4c3de-2464-45c7-a088-a3db68a67cb6] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:01:41.855053 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-318f6c64-5af9-4d46-a67a-8522113093b9 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:41.855976 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-318f6c64-5af9-4d46-a67a-8522113093b9 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:41.859627 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-318f6c64-5af9-4d46-a67a-8522113093b9 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:41.861503 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-318f6c64-5af9-4d46-a67a-8522113093b9 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:41.862702 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-318f6c64-5af9-4d46-a67a-8522113093b9 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:41.863376 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-318f6c64-5af9-4d46-a67a-8522113093b9 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:42.511076 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-9c8384a9-0887-4d5f-960a-fbb995392998 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632904331d024d9b8e4d3660dff2cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ed0bdee3aa4013bd9219069bda558c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:01:42.521344 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-9c8384a9-0887-4d5f-960a-fbb995392998 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] 10.222.0.58 "GET /compute/v2.1/servers/8e91f1ac-f79d-4ab0-aa13-ea32b0e74888" status: 200 len: 1718 microversion: 2.1 time: 1.360816 Aug 10 23:01:42.546871 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 682/1380] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:01:41 2022] GET /compute/v2.1/servers/8e91f1ac-f79d-4ab0-aa13-ea32b0e74888 => generated 1718 bytes in 1384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:01:42.561742 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-cdd85bbb-3d9a-456b-ad41-6bad50069a22 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:42.562679 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-cdd85bbb-3d9a-456b-ad41-6bad50069a22 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] [instance: d716cac6-ac7c-4b98-b6ea-2496ccd62096] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:01:42.577847 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cdd85bbb-3d9a-456b-ad41-6bad50069a22 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:42.580158 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cdd85bbb-3d9a-456b-ad41-6bad50069a22 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:42.583262 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cdd85bbb-3d9a-456b-ad41-6bad50069a22 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:42.584249 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cdd85bbb-3d9a-456b-ad41-6bad50069a22 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:42.584887 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cdd85bbb-3d9a-456b-ad41-6bad50069a22 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:42.588845 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cdd85bbb-3d9a-456b-ad41-6bad50069a22 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:42.666758 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cdd85bbb-3d9a-456b-ad41-6bad50069a22 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:42.669149 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cdd85bbb-3d9a-456b-ad41-6bad50069a22 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:42.669994 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cdd85bbb-3d9a-456b-ad41-6bad50069a22 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:42.673897 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.objects.instance [None req-cdd85bbb-3d9a-456b-ad41-6bad50069a22 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Lazy-loading 'fault' on Instance uuid d716cac6-ac7c-4b98-b6ea-2496ccd62096 {{(pid=122632) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:01:42.697687 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-318f6c64-5af9-4d46-a67a-8522113093b9 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6d9806b6724e5aaf8c69be8e70d4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307ab95daa034afbb31f90626885072b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:01:42.709248 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-318f6c64-5af9-4d46-a67a-8522113093b9 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] 10.222.0.58 "GET /compute/v2.1/servers/1af4c3de-2464-45c7-a088-a3db68a67cb6" status: 200 len: 1308 microversion: 2.1 time: 0.883537 Aug 10 23:01:42.712901 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 699/1381] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:01:41 2022] GET /compute/v2.1/servers/1af4c3de-2464-45c7-a088-a3db68a67cb6 => generated 1308 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:01:42.725296 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-4b162bc8-5d84-4c60-b912-6dba6a5f332a req-61290dbf-5605-476b-97d2-729163f48b77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0dabc2bf-08ff-45b5-a791-34d655349eae", "name": "network-vif-plugged", "status": "completed", "tag": "8dba1a8f-5d05-48a3-afda-7507568fcb46"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:01:42.760919 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-4b162bc8-5d84-4c60-b912-6dba6a5f332a req-61290dbf-5605-476b-97d2-729163f48b77 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:42.765010 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-4b162bc8-5d84-4c60-b912-6dba6a5f332a req-61290dbf-5605-476b-97d2-729163f48b77 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:42.765587 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-4b162bc8-5d84-4c60-b912-6dba6a5f332a req-61290dbf-5605-476b-97d2-729163f48b77 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:42.791999 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-cdd85bbb-3d9a-456b-ad41-6bad50069a22 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e86e6a62c56248d6a7887be0ec712f95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25090b10522b4936b3117dc25dd6f609', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:01:42.801945 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-4b162bc8-5d84-4c60-b912-6dba6a5f332a req-61290dbf-5605-476b-97d2-729163f48b77 service nova] Creating event network-vif-plugged:8dba1a8f-5d05-48a3-afda-7507568fcb46 for instance 0dabc2bf-08ff-45b5-a791-34d655349eae on n-h1-850468-14 Aug 10 23:01:42.808273 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-cdd85bbb-3d9a-456b-ad41-6bad50069a22 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] 10.222.0.58 "GET /compute/v2.1/servers/d716cac6-ac7c-4b98-b6ea-2496ccd62096" status: 200 len: 1308 microversion: 2.1 time: 0.259803 Aug 10 23:01:42.809374 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 683/1382] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:01:42 2022] GET /compute/v2.1/servers/d716cac6-ac7c-4b98-b6ea-2496ccd62096 => generated 1308 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:01:42.823882 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [req-4b162bc8-5d84-4c60-b912-6dba6a5f332a req-61290dbf-5605-476b-97d2-729163f48b77 service nova] Instance 0dabc2bf-08ff-45b5-a791-34d655349eae is migrating within the same cell, copying events to all relevant hosts: {'n-h1-850468-14', 'n-h2-850468-14'} {{(pid=122633) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5901}} Aug 10 23:01:42.827535 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-0a79c195-b009-48ce-82bb-fe0e0f37d3ea tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:42.828175 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-0a79c195-b009-48ce-82bb-fe0e0f37d3ea tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] [instance: 196377d7-c0d5-408b-9743-e1f451f71164] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:01:42.843879 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0a79c195-b009-48ce-82bb-fe0e0f37d3ea tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:42.845134 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0a79c195-b009-48ce-82bb-fe0e0f37d3ea tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:42.845822 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0a79c195-b009-48ce-82bb-fe0e0f37d3ea tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:42.847330 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0a79c195-b009-48ce-82bb-fe0e0f37d3ea tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:42.847965 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0a79c195-b009-48ce-82bb-fe0e0f37d3ea tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:42.849068 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0a79c195-b009-48ce-82bb-fe0e0f37d3ea tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:42.876789 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-4b162bc8-5d84-4c60-b912-6dba6a5f332a req-61290dbf-5605-476b-97d2-729163f48b77 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.159740 Aug 10 23:01:42.878945 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 700/1383] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:01:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:01:42.896467 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-a4d9343e-f63b-48c9-a554-bd22d2bc36c5 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:42.900558 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-a4d9343e-f63b-48c9-a554-bd22d2bc36c5 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 0dabc2bf-08ff-45b5-a791-34d655349eae] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:01:42.926984 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a4d9343e-f63b-48c9-a554-bd22d2bc36c5 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:42.931306 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a4d9343e-f63b-48c9-a554-bd22d2bc36c5 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:42.932727 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a4d9343e-f63b-48c9-a554-bd22d2bc36c5 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:42.934330 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a4d9343e-f63b-48c9-a554-bd22d2bc36c5 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:42.936877 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a4d9343e-f63b-48c9-a554-bd22d2bc36c5 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:42.946622 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a4d9343e-f63b-48c9-a554-bd22d2bc36c5 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:43.334921 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-0a79c195-b009-48ce-82bb-fe0e0f37d3ea tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '417d4eaaeb1c4df78745496ececb3e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27e6ee9495a438b8450a4ef0d62cbcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:01:43.370593 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:01:43.400692 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-0a79c195-b009-48ce-82bb-fe0e0f37d3ea tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] 10.222.0.58 "GET /compute/v2.1/servers/196377d7-c0d5-408b-9743-e1f451f71164" status: 200 len: 1275 microversion: 2.1 time: 0.588959 Aug 10 23:01:43.404339 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 684/1384] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:01:42 2022] GET /compute/v2.1/servers/196377d7-c0d5-408b-9743-e1f451f71164 => generated 1275 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:01:43.433168 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-a4d9343e-f63b-48c9-a554-bd22d2bc36c5 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:01:43.436000 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-d1cd6551-3837-44fc-9b05-f12f5167ca56 req-d06e4f42-d965-42e8-92ef-031d475ed3fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d716cac6-ac7c-4b98-b6ea-2496ccd62096", "name": "network-vif-deleted", "tag": "30ea23cf-a364-4798-a6be-6ab46d11599e"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:01:43.445056 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-a4d9343e-f63b-48c9-a554-bd22d2bc36c5 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/0dabc2bf-08ff-45b5-a791-34d655349eae" status: 200 len: 1469 microversion: 2.1 time: 0.564615 Aug 10 23:01:43.454105 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 701/1385] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:01:42 2022] GET /compute/v2.1/servers/0dabc2bf-08ff-45b5-a791-34d655349eae => generated 1469 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:01:43.459306 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-7872d5fd-822f-4a54-9547-5bce9083ab5e tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:43.459719 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-7872d5fd-822f-4a54-9547-5bce9083ab5e tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] [instance: 3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:01:43.480559 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-d1cd6551-3837-44fc-9b05-f12f5167ca56 req-d06e4f42-d965-42e8-92ef-031d475ed3fe service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:43.483772 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-d1cd6551-3837-44fc-9b05-f12f5167ca56 req-d06e4f42-d965-42e8-92ef-031d475ed3fe service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:43.484232 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-d1cd6551-3837-44fc-9b05-f12f5167ca56 req-d06e4f42-d965-42e8-92ef-031d475ed3fe service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:43.493324 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7872d5fd-822f-4a54-9547-5bce9083ab5e tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:43.494222 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7872d5fd-822f-4a54-9547-5bce9083ab5e tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:43.494740 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7872d5fd-822f-4a54-9547-5bce9083ab5e tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:43.495486 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7872d5fd-822f-4a54-9547-5bce9083ab5e tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:43.495942 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7872d5fd-822f-4a54-9547-5bce9083ab5e tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:43.496375 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7872d5fd-822f-4a54-9547-5bce9083ab5e tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:43.513051 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-d1cd6551-3837-44fc-9b05-f12f5167ca56 req-d06e4f42-d965-42e8-92ef-031d475ed3fe service nova] Creating event network-vif-deleted:30ea23cf-a364-4798-a6be-6ab46d11599e for instance d716cac6-ac7c-4b98-b6ea-2496ccd62096 on n-h2-850468-14 Aug 10 23:01:43.523259 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-d1cd6551-3837-44fc-9b05-f12f5167ca56 req-d06e4f42-d965-42e8-92ef-031d475ed3fe service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114746 Aug 10 23:01:43.529780 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 685/1386] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:01:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:01:43.659542 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c35dc197-46fe-48a5-8f07-614bdb86d55e tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-1388622058", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452", "networks": [{"uuid": "e486802b-cc99-45db-8599-aa4d9f5ff9ca"}]}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:01:43.760851 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.network.neutron [None req-c35dc197-46fe-48a5-8f07-614bdb86d55e tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] validate_networks() for [('e486802b-cc99-45db-8599-aa4d9f5ff9ca', None, None, None, None, None)] {{(pid=122632) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 23:01:43.906376 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-7872d5fd-822f-4a54-9547-5bce9083ab5e tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:01:43.915552 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-7872d5fd-822f-4a54-9547-5bce9083ab5e tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:01:43.926134 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-7872d5fd-822f-4a54-9547-5bce9083ab5e tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:01:43.931295 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-7872d5fd-822f-4a54-9547-5bce9083ab5e tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] 10.222.0.58 "GET /compute/v2.1/servers/3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51" status: 200 len: 1250 microversion: 2.25 time: 0.476020 Aug 10 23:01:43.931904 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 702/1387] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:01:43 2022] GET /compute/v2.1/servers/3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51 => generated 1250 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:01:43.945243 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-f26514a2-e721-4d79-b57d-3deb53cfc49d tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:43.957457 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-f26514a2-e721-4d79-b57d-3deb53cfc49d tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] [instance: 8e91f1ac-f79d-4ab0-aa13-ea32b0e74888] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:01:43.979334 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f26514a2-e721-4d79-b57d-3deb53cfc49d tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:43.983483 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f26514a2-e721-4d79-b57d-3deb53cfc49d tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:43.984151 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f26514a2-e721-4d79-b57d-3deb53cfc49d tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:43.985602 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f26514a2-e721-4d79-b57d-3deb53cfc49d tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:43.986237 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f26514a2-e721-4d79-b57d-3deb53cfc49d tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:43.988320 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f26514a2-e721-4d79-b57d-3deb53cfc49d tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:44.396889 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-f26514a2-e721-4d79-b57d-3deb53cfc49d tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632904331d024d9b8e4d3660dff2cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ed0bdee3aa4013bd9219069bda558c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:01:44.410129 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-f26514a2-e721-4d79-b57d-3deb53cfc49d tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] 10.222.0.58 "GET /compute/v2.1/servers/8e91f1ac-f79d-4ab0-aa13-ea32b0e74888" status: 200 len: 1718 microversion: 2.1 time: 0.477130 Aug 10 23:01:44.414898 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 703/1388] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:01:43 2022] GET /compute/v2.1/servers/8e91f1ac-f79d-4ab0-aa13-ea32b0e74888 => generated 1718 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:01:44.436904 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-07385acd-5c3c-4b85-b4a2-8a86c63572d4 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:44.437529 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-07385acd-5c3c-4b85-b4a2-8a86c63572d4 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] [instance: 1af4c3de-2464-45c7-a088-a3db68a67cb6] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:01:44.455648 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:01:44.471289 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-07385acd-5c3c-4b85-b4a2-8a86c63572d4 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:44.471726 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-07385acd-5c3c-4b85-b4a2-8a86c63572d4 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:44.472172 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-07385acd-5c3c-4b85-b4a2-8a86c63572d4 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:44.472895 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-07385acd-5c3c-4b85-b4a2-8a86c63572d4 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:44.473349 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-07385acd-5c3c-4b85-b4a2-8a86c63572d4 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:44.473772 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-07385acd-5c3c-4b85-b4a2-8a86c63572d4 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:44.992922 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-07385acd-5c3c-4b85-b4a2-8a86c63572d4 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6d9806b6724e5aaf8c69be8e70d4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307ab95daa034afbb31f90626885072b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:01:45.013527 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-07385acd-5c3c-4b85-b4a2-8a86c63572d4 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] 10.222.0.58 "GET /compute/v2.1/servers/1af4c3de-2464-45c7-a088-a3db68a67cb6" status: 200 len: 1308 microversion: 2.1 time: 0.597419 Aug 10 23:01:45.028184 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 704/1389] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:01:44 2022] GET /compute/v2.1/servers/1af4c3de-2464-45c7-a088-a3db68a67cb6 => generated 1308 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:01:45.034029 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-2e6cc616-030c-42d4-a10b-07d8a5d1dd0b tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:45.034872 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-2e6cc616-030c-42d4-a10b-07d8a5d1dd0b tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] [instance: d716cac6-ac7c-4b98-b6ea-2496ccd62096] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:01:45.043422 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2e6cc616-030c-42d4-a10b-07d8a5d1dd0b tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:45.045813 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2e6cc616-030c-42d4-a10b-07d8a5d1dd0b tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:45.046437 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2e6cc616-030c-42d4-a10b-07d8a5d1dd0b tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:45.047869 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2e6cc616-030c-42d4-a10b-07d8a5d1dd0b tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:45.048493 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2e6cc616-030c-42d4-a10b-07d8a5d1dd0b tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:45.049094 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2e6cc616-030c-42d4-a10b-07d8a5d1dd0b tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:45.064784 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-2e6cc616-030c-42d4-a10b-07d8a5d1dd0b tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] HTTP exception thrown: Instance d716cac6-ac7c-4b98-b6ea-2496ccd62096 could not be found. Aug 10 23:01:45.066733 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-2e6cc616-030c-42d4-a10b-07d8a5d1dd0b tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Request method failure captured: Aug 10 23:01:45.066733 n-d-850468-14 devstack@n-api.service[122633]: request: GET /compute/v2.1/servers/d716cac6-ac7c-4b98-b6ea-2496ccd62096 HTTP/1.1 Aug 10 23:01:45.066733 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:01:45.066733 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:01:45.066733 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:01:45.066733 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:01:45.066733 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:01:45.066733 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:01:45.066733 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:01:45.066733 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:01:45.066733 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9Dg3NhcIJLK3Y8FAVjYa9X-ZLnPSb9zvV5Bp2tiJIC26mHPrUnxHxVzN8tYWmuI7xcyWSc_C3hx3ccBmr6RXqstcE0nOh6Bb4G8yiQtk-ugV8MXuFEVU6XvkcR3xUUOuEnCsKoIyH4xNeJ9NWvmB5UNhjQzhz4MEHWwqtOE4cs4ExA0 Aug 10 23:01:45.066733 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:01:45.066733 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:01:45.066733 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:01:45.066733 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:01:45.066733 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:01:45.066733 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:01:45.066733 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 25090b10522b4936b3117dc25dd6f609 Aug 10 23:01:45.066733 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-ListImageFiltersTestJSON-1194065369 Aug 10 23:01:45.066733 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:01:45.066733 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:01:45.068412 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/25090b10522b4936b3117dc25dd6f609"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/25090b10522b4936b3117dc25dd6f609"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/25090b10522b4936b3117dc25dd6f609"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_25090b10522b4936b3117dc25dd6f609", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:01:45.068412 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-ListImageFiltersTestJSON-1194065369 Aug 10 23:01:45.068412 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 25090b10522b4936b3117dc25dd6f609 Aug 10 23:01:45.068412 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-1194065369 Aug 10 23:01:45.068412 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-ListImageFiltersTestJSON-1194065369-project Aug 10 23:01:45.068412 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:01:45.068412 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:01:45.068412 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: e86e6a62c56248d6a7887be0ec712f95 Aug 10 23:01:45.068412 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-ListImageFiltersTestJSON-1194065369-project Aug 10 23:01:45.068412 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:01:45.068412 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance d716cac6-ac7c-4b98-b6ea-2496ccd62096 could not be found. Aug 10 23:01:45.068412 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': 'd716cac6-ac7c-4b98-b6ea-2496ccd62096'} Aug 10 23:01:45.069303 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:01:45.069303 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:01:45.069303 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:01:45.069303 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:01:45.069303 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:01:45.069303 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:01:45.069303 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:01:45.069303 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:01:45.069303 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:01:45.069303 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:01:45.069303 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d716cac6-ac7c-4b98-b6ea-2496ccd62096 could not be found. Aug 10 23:01:45.069303 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:01:45.069303 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:01:45.069303 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:01:45.069303 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:01:45.069303 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:01:45.069303 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:01:45.069303 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:01:45.069303 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:01:45.069303 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:01:45.071266 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:01:45.071266 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:01:45.071266 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:01:45.071266 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:01:45.071266 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:01:45.071266 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:01:45.071266 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:01:45.071266 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d716cac6-ac7c-4b98-b6ea-2496ccd62096 could not be found. Aug 10 23:01:45.071266 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:01:45.071266 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:01:45.071266 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:01:45.071266 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:01:45.071266 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:01:45.071266 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:01:45.071266 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:01:45.071266 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:01:45.071266 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d716cac6-ac7c-4b98-b6ea-2496ccd62096 could not be found. Aug 10 23:01:45.071266 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:01:45.073759 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-2e6cc616-030c-42d4-a10b-07d8a5d1dd0b tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Returning 404 to user: Instance d716cac6-ac7c-4b98-b6ea-2496ccd62096 could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:01:45.074816 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-2e6cc616-030c-42d4-a10b-07d8a5d1dd0b tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] 10.222.0.58 "GET /compute/v2.1/servers/d716cac6-ac7c-4b98-b6ea-2496ccd62096" status: 404 len: 111 microversion: 2.1 time: 0.044654 Aug 10 23:01:45.075694 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 705/1390] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:01:45 2022] GET /compute/v2.1/servers/d716cac6-ac7c-4b98-b6ea-2496ccd62096 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:01:45.082477 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-d8622391-12d6-4fa8-bb84-a20a57d9e89e tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:45.083984 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-d8622391-12d6-4fa8-bb84-a20a57d9e89e tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] [instance: 196377d7-c0d5-408b-9743-e1f451f71164] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:01:45.092332 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d8622391-12d6-4fa8-bb84-a20a57d9e89e tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:45.093844 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d8622391-12d6-4fa8-bb84-a20a57d9e89e tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:45.094505 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d8622391-12d6-4fa8-bb84-a20a57d9e89e tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:45.095518 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d8622391-12d6-4fa8-bb84-a20a57d9e89e tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:45.096890 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d8622391-12d6-4fa8-bb84-a20a57d9e89e tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:45.097530 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d8622391-12d6-4fa8-bb84-a20a57d9e89e tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:45.234211 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-d8622391-12d6-4fa8-bb84-a20a57d9e89e tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '417d4eaaeb1c4df78745496ececb3e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27e6ee9495a438b8450a4ef0d62cbcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:01:45.249184 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-d8622391-12d6-4fa8-bb84-a20a57d9e89e tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] 10.222.0.58 "GET /compute/v2.1/servers/196377d7-c0d5-408b-9743-e1f451f71164" status: 200 len: 1275 microversion: 2.1 time: 0.165650 Aug 10 23:01:45.251142 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 706/1391] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:01:45 2022] GET /compute/v2.1/servers/196377d7-c0d5-408b-9743-e1f451f71164 => generated 1275 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:01:45.266012 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-a851f708-5b4c-4c42-a369-35069d4bedfd tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:45.280171 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-a851f708-5b4c-4c42-a369-35069d4bedfd tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 0dabc2bf-08ff-45b5-a791-34d655349eae] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:01:45.302945 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a851f708-5b4c-4c42-a369-35069d4bedfd tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:45.305143 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a851f708-5b4c-4c42-a369-35069d4bedfd tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:45.308695 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a851f708-5b4c-4c42-a369-35069d4bedfd tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:45.313129 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a851f708-5b4c-4c42-a369-35069d4bedfd tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:45.316363 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a851f708-5b4c-4c42-a369-35069d4bedfd tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:45.318147 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a851f708-5b4c-4c42-a369-35069d4bedfd tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:45.801230 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-c35dc197-46fe-48a5-8f07-614bdb86d55e tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Flavor limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:01:45.802353 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-c35dc197-46fe-48a5-8f07-614bdb86d55e tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Image limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:01:45.803860 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-c35dc197-46fe-48a5-8f07-614bdb86d55e tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Flavor pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:01:45.804472 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-c35dc197-46fe-48a5-8f07-614bdb86d55e tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Image pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:01:45.805047 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-c35dc197-46fe-48a5-8f07-614bdb86d55e tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:01:45.823695 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c35dc197-46fe-48a5-8f07-614bdb86d55e tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:45.826437 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c35dc197-46fe-48a5-8f07-614bdb86d55e tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:45.828210 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c35dc197-46fe-48a5-8f07-614bdb86d55e tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:45.831254 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c35dc197-46fe-48a5-8f07-614bdb86d55e tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:45.831903 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c35dc197-46fe-48a5-8f07-614bdb86d55e tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:45.834775 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c35dc197-46fe-48a5-8f07-614bdb86d55e tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:45.914740 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-c35dc197-46fe-48a5-8f07-614bdb86d55e tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Getting quotas for project 701fe4c2829c4ef4a748cfe83d84294f. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:01:45.939606 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-c35dc197-46fe-48a5-8f07-614bdb86d55e tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Getting quotas for user abb4dc460d3b4bb1a20a45d27d524cd9 and project 701fe4c2829c4ef4a748cfe83d84294f. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:01:45.994216 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-c35dc197-46fe-48a5-8f07-614bdb86d55e tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Going to run 1 instances... {{(pid=122632) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 23:01:46.010478 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-c35dc197-46fe-48a5-8f07-614bdb86d55e tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] [instance: 38d1e924-eaea-449b-9724-1d2b16fcdfbc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78ad8905-f66f-4733-8be9-2b260f1fabed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122632) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 23:01:46.056382 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-a851f708-5b4c-4c42-a369-35069d4bedfd tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:01:46.058765 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:01:46.080903 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-a851f708-5b4c-4c42-a369-35069d4bedfd tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/0dabc2bf-08ff-45b5-a791-34d655349eae" status: 200 len: 1469 microversion: 2.1 time: 0.825728 Aug 10 23:01:46.086901 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 707/1392] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:01:45 2022] GET /compute/v2.1/servers/0dabc2bf-08ff-45b5-a791-34d655349eae => generated 1469 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:01:46.102352 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-bf1ab7ac-da45-4d98-bb9e-22acfc39d17f tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:46.108596 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-bf1ab7ac-da45-4d98-bb9e-22acfc39d17f tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] [instance: 3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:01:46.144290 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bf1ab7ac-da45-4d98-bb9e-22acfc39d17f tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:46.146331 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bf1ab7ac-da45-4d98-bb9e-22acfc39d17f tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:46.158670 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-c35dc197-46fe-48a5-8f07-614bdb86d55e tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.627010 Aug 10 23:01:46.159151 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bf1ab7ac-da45-4d98-bb9e-22acfc39d17f tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:46.159977 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 686/1393] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 23:01:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 2629 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 23:01:46.166769 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bf1ab7ac-da45-4d98-bb9e-22acfc39d17f tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:46.174418 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bf1ab7ac-da45-4d98-bb9e-22acfc39d17f tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:46.175025 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bf1ab7ac-da45-4d98-bb9e-22acfc39d17f tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:46.189039 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-73bbb4ee-c820-4f23-9e89-9d8089f59d97 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Calling method '.version_select at 0x7f847d083f70>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:46.933849 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-73bbb4ee-c820-4f23-9e89-9d8089f59d97 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] 10.222.0.58 "DELETE /compute/v2.1/images/cff0a8aa-9950-478f-bb9a-280d71f0899a" status: 204 len: 0 microversion: 2.1 time: 0.759817 Aug 10 23:01:46.936163 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 687/1394] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:01:46 2022] DELETE /compute/v2.1/images/cff0a8aa-9950-478f-bb9a-280d71f0899a => generated 0 bytes in 775 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:01:46.953797 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-d3ed83f7-558e-4c47-b0de-e6f271d655b9 req-8839c1e4-60b7-4c05-a7ee-fbc1cc31fe1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e91f1ac-f79d-4ab0-aa13-ea32b0e74888", "name": "network-vif-unplugged", "status": "completed", "tag": "19d4795c-3095-41be-b300-ea441bb13af4"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:01:47.004248 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-d3ed83f7-558e-4c47-b0de-e6f271d655b9 req-8839c1e4-60b7-4c05-a7ee-fbc1cc31fe1b service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:47.005891 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-d3ed83f7-558e-4c47-b0de-e6f271d655b9 req-8839c1e4-60b7-4c05-a7ee-fbc1cc31fe1b service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:47.006920 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-d3ed83f7-558e-4c47-b0de-e6f271d655b9 req-8839c1e4-60b7-4c05-a7ee-fbc1cc31fe1b service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:47.065982 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-d3ed83f7-558e-4c47-b0de-e6f271d655b9 req-8839c1e4-60b7-4c05-a7ee-fbc1cc31fe1b service nova] Creating event network-vif-unplugged:19d4795c-3095-41be-b300-ea441bb13af4 for instance 8e91f1ac-f79d-4ab0-aa13-ea32b0e74888 on n-h2-850468-14 Aug 10 23:01:47.088651 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-d3ed83f7-558e-4c47-b0de-e6f271d655b9 req-8839c1e4-60b7-4c05-a7ee-fbc1cc31fe1b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.150949 Aug 10 23:01:47.091514 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 688/1395] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:01:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:01:47.101908 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-85120331-1735-48cb-af78-894e8a3f9ed4 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:47.115060 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-85120331-1735-48cb-af78-894e8a3f9ed4 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] [instance: 8e91f1ac-f79d-4ab0-aa13-ea32b0e74888] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:01:47.135844 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-85120331-1735-48cb-af78-894e8a3f9ed4 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:47.136255 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-85120331-1735-48cb-af78-894e8a3f9ed4 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:47.136696 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-85120331-1735-48cb-af78-894e8a3f9ed4 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:47.137409 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-85120331-1735-48cb-af78-894e8a3f9ed4 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:47.138578 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-85120331-1735-48cb-af78-894e8a3f9ed4 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:47.147594 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-85120331-1735-48cb-af78-894e8a3f9ed4 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:47.250683 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-bf1ab7ac-da45-4d98-bb9e-22acfc39d17f tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:01:47.271007 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-bf1ab7ac-da45-4d98-bb9e-22acfc39d17f tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:01:47.275399 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-bf1ab7ac-da45-4d98-bb9e-22acfc39d17f tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:01:47.285456 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-bf1ab7ac-da45-4d98-bb9e-22acfc39d17f tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] 10.222.0.58 "GET /compute/v2.1/servers/3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51" status: 200 len: 1292 microversion: 2.25 time: 1.195377 Aug 10 23:01:47.286345 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 708/1396] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:01:46 2022] GET /compute/v2.1/servers/3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51 => generated 1292 bytes in 1198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:01:47.291147 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-d48db987-a0a7-417a-963d-42e73e3ccdc3 req-fc5d3426-1568-440f-9384-21f5bbb7acf3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1af4c3de-2464-45c7-a088-a3db68a67cb6", "tag": "881060b7-d25b-4d47-9b25-466798c6e4e3"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:01:47.338496 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-d48db987-a0a7-417a-963d-42e73e3ccdc3 req-fc5d3426-1568-440f-9384-21f5bbb7acf3 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:47.353514 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-d48db987-a0a7-417a-963d-42e73e3ccdc3 req-fc5d3426-1568-440f-9384-21f5bbb7acf3 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:47.356182 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-d48db987-a0a7-417a-963d-42e73e3ccdc3 req-fc5d3426-1568-440f-9384-21f5bbb7acf3 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:47.406570 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-d48db987-a0a7-417a-963d-42e73e3ccdc3 req-fc5d3426-1568-440f-9384-21f5bbb7acf3 service nova] Creating event network-changed:881060b7-d25b-4d47-9b25-466798c6e4e3 for instance 1af4c3de-2464-45c7-a088-a3db68a67cb6 on n-h2-850468-14 Aug 10 23:01:47.427474 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-d48db987-a0a7-417a-963d-42e73e3ccdc3 req-fc5d3426-1568-440f-9384-21f5bbb7acf3 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.138076 Aug 10 23:01:47.430755 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 709/1397] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:01:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:01:47.451722 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c339d294-19d9-479f-ab79-f352ca7d5ab5 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:47.452841 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-c339d294-19d9-479f-ab79-f352ca7d5ab5 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] [instance: 1af4c3de-2464-45c7-a088-a3db68a67cb6] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:01:47.469597 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c339d294-19d9-479f-ab79-f352ca7d5ab5 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:47.470502 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c339d294-19d9-479f-ab79-f352ca7d5ab5 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:47.471217 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c339d294-19d9-479f-ab79-f352ca7d5ab5 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:47.472405 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c339d294-19d9-479f-ab79-f352ca7d5ab5 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:47.473490 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c339d294-19d9-479f-ab79-f352ca7d5ab5 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:47.474225 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c339d294-19d9-479f-ab79-f352ca7d5ab5 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:47.917413 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-c339d294-19d9-479f-ab79-f352ca7d5ab5 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6d9806b6724e5aaf8c69be8e70d4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307ab95daa034afbb31f90626885072b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:01:47.932157 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-c339d294-19d9-479f-ab79-f352ca7d5ab5 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] 10.222.0.58 "GET /compute/v2.1/servers/1af4c3de-2464-45c7-a088-a3db68a67cb6" status: 200 len: 1308 microversion: 2.1 time: 0.499857 Aug 10 23:01:47.933313 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 710/1398] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:01:47 2022] GET /compute/v2.1/servers/1af4c3de-2464-45c7-a088-a3db68a67cb6 => generated 1308 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:01:47.943704 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-f62948b2-3fca-4896-9465-00ed3ab3b6fb tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:47.944590 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-f62948b2-3fca-4896-9465-00ed3ab3b6fb tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] [instance: 38d1e924-eaea-449b-9724-1d2b16fcdfbc] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:01:47.961268 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f62948b2-3fca-4896-9465-00ed3ab3b6fb tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:47.962660 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f62948b2-3fca-4896-9465-00ed3ab3b6fb tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:47.963344 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f62948b2-3fca-4896-9465-00ed3ab3b6fb tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:47.964269 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f62948b2-3fca-4896-9465-00ed3ab3b6fb tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:47.964926 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f62948b2-3fca-4896-9465-00ed3ab3b6fb tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:47.965543 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f62948b2-3fca-4896-9465-00ed3ab3b6fb tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:48.331272 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-85120331-1735-48cb-af78-894e8a3f9ed4 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632904331d024d9b8e4d3660dff2cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ed0bdee3aa4013bd9219069bda558c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:01:48.348560 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-85120331-1735-48cb-af78-894e8a3f9ed4 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] 10.222.0.58 "GET /compute/v2.1/servers/8e91f1ac-f79d-4ab0-aa13-ea32b0e74888" status: 200 len: 1718 microversion: 2.1 time: 1.250455 Aug 10 23:01:48.350091 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 689/1399] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:01:47 2022] GET /compute/v2.1/servers/8e91f1ac-f79d-4ab0-aa13-ea32b0e74888 => generated 1718 bytes in 1256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:01:48.360930 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-7435f03e-816c-4b71-8ab6-8024eeb2fcc4 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:48.364360 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-7435f03e-816c-4b71-8ab6-8024eeb2fcc4 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] [instance: 196377d7-c0d5-408b-9743-e1f451f71164] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:01:48.384579 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7435f03e-816c-4b71-8ab6-8024eeb2fcc4 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:48.385464 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7435f03e-816c-4b71-8ab6-8024eeb2fcc4 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:48.386277 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7435f03e-816c-4b71-8ab6-8024eeb2fcc4 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:48.387402 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7435f03e-816c-4b71-8ab6-8024eeb2fcc4 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:48.388882 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7435f03e-816c-4b71-8ab6-8024eeb2fcc4 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:48.389621 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7435f03e-816c-4b71-8ab6-8024eeb2fcc4 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:48.483440 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=4 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:01:49.229339 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-f62948b2-3fca-4896-9465-00ed3ab3b6fb tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb4dc460d3b4bb1a20a45d27d524cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701fe4c2829c4ef4a748cfe83d84294f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:01:49.239420 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-f62948b2-3fca-4896-9465-00ed3ab3b6fb tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] 10.222.0.58 "GET /compute/v2.1/servers/38d1e924-eaea-449b-9724-1d2b16fcdfbc" status: 200 len: 1269 microversion: 2.1 time: 1.303114 Aug 10 23:01:49.254496 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 711/1400] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:01:47 2022] GET /compute/v2.1/servers/38d1e924-eaea-449b-9724-1d2b16fcdfbc => generated 1269 bytes in 1320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:01:49.259832 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-15462154-f850-4d0e-93f8-e338cab71c35 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Calling method '.version_select at 0x7f847cf91e50>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:49.270107 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=12 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:01:49.688826 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-15462154-f850-4d0e-93f8-e338cab71c35 tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] 10.222.0.58 "DELETE /compute/v2.1/images/4681311a-a245-4205-a962-7920b815371c" status: 204 len: 0 microversion: 2.1 time: 0.432671 Aug 10 23:01:49.690167 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 712/1401] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:01:49 2022] DELETE /compute/v2.1/images/4681311a-a245-4205-a962-7920b815371c => generated 0 bytes in 435 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:01:49.696271 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-ee77e801-66a5-46cb-aca6-6dfaaba0a566 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:49.697090 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-ee77e801-66a5-46cb-aca6-6dfaaba0a566 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 0dabc2bf-08ff-45b5-a791-34d655349eae] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:01:49.710659 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-7435f03e-816c-4b71-8ab6-8024eeb2fcc4 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '417d4eaaeb1c4df78745496ececb3e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27e6ee9495a438b8450a4ef0d62cbcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:01:49.711863 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ee77e801-66a5-46cb-aca6-6dfaaba0a566 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:49.712344 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ee77e801-66a5-46cb-aca6-6dfaaba0a566 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:49.712786 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ee77e801-66a5-46cb-aca6-6dfaaba0a566 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:49.713498 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ee77e801-66a5-46cb-aca6-6dfaaba0a566 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:49.713953 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ee77e801-66a5-46cb-aca6-6dfaaba0a566 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:49.714376 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ee77e801-66a5-46cb-aca6-6dfaaba0a566 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:49.723182 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-7435f03e-816c-4b71-8ab6-8024eeb2fcc4 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] 10.222.0.58 "GET /compute/v2.1/servers/196377d7-c0d5-408b-9743-e1f451f71164" status: 200 len: 1317 microversion: 2.1 time: 1.371727 Aug 10 23:01:49.727506 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 690/1402] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:01:48 2022] GET /compute/v2.1/servers/196377d7-c0d5-408b-9743-e1f451f71164 => generated 1317 bytes in 1377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:01:49.736981 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-76cb1005-2679-44ca-8b8f-539a8bb38e4f tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:49.738772 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-76cb1005-2679-44ca-8b8f-539a8bb38e4f tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] [instance: 3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:01:49.754338 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-76cb1005-2679-44ca-8b8f-539a8bb38e4f tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:49.755233 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-76cb1005-2679-44ca-8b8f-539a8bb38e4f tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:49.755919 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-76cb1005-2679-44ca-8b8f-539a8bb38e4f tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:49.756896 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-76cb1005-2679-44ca-8b8f-539a8bb38e4f tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:49.758776 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-76cb1005-2679-44ca-8b8f-539a8bb38e4f tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:49.761016 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-76cb1005-2679-44ca-8b8f-539a8bb38e4f tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:50.159339 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-76cb1005-2679-44ca-8b8f-539a8bb38e4f tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:01:50.173132 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-76cb1005-2679-44ca-8b8f-539a8bb38e4f tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:01:50.175924 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-76cb1005-2679-44ca-8b8f-539a8bb38e4f tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:01:50.177049 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-76cb1005-2679-44ca-8b8f-539a8bb38e4f tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] 10.222.0.58 "GET /compute/v2.1/servers/3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51" status: 200 len: 1292 microversion: 2.25 time: 0.448116 Aug 10 23:01:50.181690 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 691/1403] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:01:49 2022] GET /compute/v2.1/servers/3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51 => generated 1292 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:01:50.195296 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-a24ea525-f482-4f44-ac93-41c5284a0841 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:50.196375 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-a24ea525-f482-4f44-ac93-41c5284a0841 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] [instance: 1af4c3de-2464-45c7-a088-a3db68a67cb6] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:01:50.208181 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a24ea525-f482-4f44-ac93-41c5284a0841 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:50.213682 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a24ea525-f482-4f44-ac93-41c5284a0841 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:50.214471 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a24ea525-f482-4f44-ac93-41c5284a0841 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:50.215530 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a24ea525-f482-4f44-ac93-41c5284a0841 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:50.217068 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a24ea525-f482-4f44-ac93-41c5284a0841 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:50.217727 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a24ea525-f482-4f44-ac93-41c5284a0841 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:50.392796 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-ee77e801-66a5-46cb-aca6-6dfaaba0a566 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:01:50.406514 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-ee77e801-66a5-46cb-aca6-6dfaaba0a566 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/0dabc2bf-08ff-45b5-a791-34d655349eae" status: 200 len: 1469 microversion: 2.1 time: 0.713950 Aug 10 23:01:50.407886 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 713/1404] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:01:49 2022] GET /compute/v2.1/servers/0dabc2bf-08ff-45b5-a791-34d655349eae => generated 1469 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:01:50.458383 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-b2a0bc56-8d3e-4d88-8c52-ba98e692c3d6 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:50.459201 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-b2a0bc56-8d3e-4d88-8c52-ba98e692c3d6 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] [instance: 8e91f1ac-f79d-4ab0-aa13-ea32b0e74888] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:01:50.476067 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b2a0bc56-8d3e-4d88-8c52-ba98e692c3d6 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:50.476593 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b2a0bc56-8d3e-4d88-8c52-ba98e692c3d6 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:50.477037 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b2a0bc56-8d3e-4d88-8c52-ba98e692c3d6 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:50.481439 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b2a0bc56-8d3e-4d88-8c52-ba98e692c3d6 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:50.482186 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b2a0bc56-8d3e-4d88-8c52-ba98e692c3d6 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:50.482775 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b2a0bc56-8d3e-4d88-8c52-ba98e692c3d6 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:50.643995 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-a24ea525-f482-4f44-ac93-41c5284a0841 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6d9806b6724e5aaf8c69be8e70d4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307ab95daa034afbb31f90626885072b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:01:50.651805 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-a24ea525-f482-4f44-ac93-41c5284a0841 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] 10.222.0.58 "GET /compute/v2.1/servers/1af4c3de-2464-45c7-a088-a3db68a67cb6" status: 200 len: 1308 microversion: 2.1 time: 0.460672 Aug 10 23:01:50.652397 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 692/1405] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:01:50 2022] GET /compute/v2.1/servers/1af4c3de-2464-45c7-a088-a3db68a67cb6 => generated 1308 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:01:50.688080 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-e9c71a5e-448e-48ed-8560-34c6e18b8d8a req-ed256ace-769f-4c9f-9964-33d4913d88ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e91f1ac-f79d-4ab0-aa13-ea32b0e74888", "tag": "19d4795c-3095-41be-b300-ea441bb13af4"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:01:50.708998 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-e9c71a5e-448e-48ed-8560-34c6e18b8d8a req-ed256ace-769f-4c9f-9964-33d4913d88ba service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:50.709858 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-e9c71a5e-448e-48ed-8560-34c6e18b8d8a req-ed256ace-769f-4c9f-9964-33d4913d88ba service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:50.710490 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-e9c71a5e-448e-48ed-8560-34c6e18b8d8a req-ed256ace-769f-4c9f-9964-33d4913d88ba service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:50.730337 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-e9c71a5e-448e-48ed-8560-34c6e18b8d8a req-ed256ace-769f-4c9f-9964-33d4913d88ba service nova] Creating event network-changed:19d4795c-3095-41be-b300-ea441bb13af4 for instance 8e91f1ac-f79d-4ab0-aa13-ea32b0e74888 on n-h2-850468-14 Aug 10 23:01:50.745421 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-e9c71a5e-448e-48ed-8560-34c6e18b8d8a req-ed256ace-769f-4c9f-9964-33d4913d88ba service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061276 Aug 10 23:01:50.746617 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 693/1406] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:01:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:01:50.752758 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-96e1dd59-2938-4811-92c7-8271a6bd01da tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] Calling method '.version_select at 0x7f847d0ce430>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:51.228184 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-96e1dd59-2938-4811-92c7-8271a6bd01da tempest-ListImageFiltersTestJSON-1194065369 tempest-ListImageFiltersTestJSON-1194065369-project] 10.222.0.58 "DELETE /compute/v2.1/images/d91b763b-361c-40e7-bd00-ef66ee78938a" status: 204 len: 0 microversion: 2.1 time: 0.479321 Aug 10 23:01:51.229076 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 694/1407] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:01:50 2022] DELETE /compute/v2.1/images/d91b763b-361c-40e7-bd00-ef66ee78938a => generated 0 bytes in 482 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:01:51.242875 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-fa6f9cb5-75cc-47e3-8ab4-a9cf2721f285 tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:51.248462 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-fa6f9cb5-75cc-47e3-8ab4-a9cf2721f285 tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] [instance: 38d1e924-eaea-449b-9724-1d2b16fcdfbc] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:01:51.265812 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fa6f9cb5-75cc-47e3-8ab4-a9cf2721f285 tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:51.275269 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fa6f9cb5-75cc-47e3-8ab4-a9cf2721f285 tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:51.275807 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fa6f9cb5-75cc-47e3-8ab4-a9cf2721f285 tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:51.286047 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fa6f9cb5-75cc-47e3-8ab4-a9cf2721f285 tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:51.286592 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fa6f9cb5-75cc-47e3-8ab4-a9cf2721f285 tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:51.287138 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fa6f9cb5-75cc-47e3-8ab4-a9cf2721f285 tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:51.423101 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-b2a0bc56-8d3e-4d88-8c52-ba98e692c3d6 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632904331d024d9b8e4d3660dff2cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ed0bdee3aa4013bd9219069bda558c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:01:51.433409 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-b2a0bc56-8d3e-4d88-8c52-ba98e692c3d6 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] 10.222.0.58 "GET /compute/v2.1/servers/8e91f1ac-f79d-4ab0-aa13-ea32b0e74888" status: 200 len: 1718 microversion: 2.1 time: 0.993840 Aug 10 23:01:51.439130 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 714/1408] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:01:50 2022] GET /compute/v2.1/servers/8e91f1ac-f79d-4ab0-aa13-ea32b0e74888 => generated 1718 bytes in 1001 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:01:51.459297 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-7f5d09ad-905e-4447-beec-c905eaf7b7e6 req-1cf05145-e134-43b0-82d6-cbf74df1cbe0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0dabc2bf-08ff-45b5-a791-34d655349eae", "name": "network-vif-unplugged", "status": "completed", "tag": "8dba1a8f-5d05-48a3-afda-7507568fcb46"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:01:51.483662 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-7f5d09ad-905e-4447-beec-c905eaf7b7e6 req-1cf05145-e134-43b0-82d6-cbf74df1cbe0 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:51.484164 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-7f5d09ad-905e-4447-beec-c905eaf7b7e6 req-1cf05145-e134-43b0-82d6-cbf74df1cbe0 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:51.484591 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-7f5d09ad-905e-4447-beec-c905eaf7b7e6 req-1cf05145-e134-43b0-82d6-cbf74df1cbe0 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:51.527060 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-7f5d09ad-905e-4447-beec-c905eaf7b7e6 req-1cf05145-e134-43b0-82d6-cbf74df1cbe0 service nova] Creating event network-vif-unplugged:8dba1a8f-5d05-48a3-afda-7507568fcb46 for instance 0dabc2bf-08ff-45b5-a791-34d655349eae on n-h2-850468-14 Aug 10 23:01:51.542083 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [req-7f5d09ad-905e-4447-beec-c905eaf7b7e6 req-1cf05145-e134-43b0-82d6-cbf74df1cbe0 service nova] Instance 0dabc2bf-08ff-45b5-a791-34d655349eae is migrating within the same cell, copying events to all relevant hosts: {'n-h1-850468-14', 'n-h2-850468-14'} {{(pid=122633) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5901}} Aug 10 23:01:51.571525 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-7f5d09ad-905e-4447-beec-c905eaf7b7e6 req-1cf05145-e134-43b0-82d6-cbf74df1cbe0 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.130842 Aug 10 23:01:51.572459 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 715/1409] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:01:51 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:01:51.582574 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-6d8d64d0-9e45-4e46-ac4a-ae9e2b1ef0e2 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:51.583326 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-6d8d64d0-9e45-4e46-ac4a-ae9e2b1ef0e2 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] [instance: 196377d7-c0d5-408b-9743-e1f451f71164] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:01:51.604821 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6d8d64d0-9e45-4e46-ac4a-ae9e2b1ef0e2 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:51.605320 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6d8d64d0-9e45-4e46-ac4a-ae9e2b1ef0e2 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:51.605763 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6d8d64d0-9e45-4e46-ac4a-ae9e2b1ef0e2 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:51.606538 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6d8d64d0-9e45-4e46-ac4a-ae9e2b1ef0e2 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:51.607028 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6d8d64d0-9e45-4e46-ac4a-ae9e2b1ef0e2 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:51.607461 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6d8d64d0-9e45-4e46-ac4a-ae9e2b1ef0e2 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:51.671475 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-fa6f9cb5-75cc-47e3-8ab4-a9cf2721f285 tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb4dc460d3b4bb1a20a45d27d524cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701fe4c2829c4ef4a748cfe83d84294f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:01:51.688552 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-fa6f9cb5-75cc-47e3-8ab4-a9cf2721f285 tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] 10.222.0.58 "GET /compute/v2.1/servers/38d1e924-eaea-449b-9724-1d2b16fcdfbc" status: 200 len: 1275 microversion: 2.1 time: 0.457657 Aug 10 23:01:51.689132 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 695/1410] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:01:51 2022] GET /compute/v2.1/servers/38d1e924-eaea-449b-9724-1d2b16fcdfbc => generated 1275 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:01:51.706714 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-f117cf97-3f7d-4c91-9dcd-5917b8922b4f tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:51.707625 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-f117cf97-3f7d-4c91-9dcd-5917b8922b4f tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] [instance: 3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:01:51.729108 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f117cf97-3f7d-4c91-9dcd-5917b8922b4f tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:51.739543 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f117cf97-3f7d-4c91-9dcd-5917b8922b4f tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:51.740668 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f117cf97-3f7d-4c91-9dcd-5917b8922b4f tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:51.741589 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f117cf97-3f7d-4c91-9dcd-5917b8922b4f tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:51.744523 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f117cf97-3f7d-4c91-9dcd-5917b8922b4f tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:51.745274 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f117cf97-3f7d-4c91-9dcd-5917b8922b4f tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:52.270627 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-6d8d64d0-9e45-4e46-ac4a-ae9e2b1ef0e2 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '417d4eaaeb1c4df78745496ececb3e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27e6ee9495a438b8450a4ef0d62cbcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:01:52.284078 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-6d8d64d0-9e45-4e46-ac4a-ae9e2b1ef0e2 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] 10.222.0.58 "GET /compute/v2.1/servers/196377d7-c0d5-408b-9743-e1f451f71164" status: 200 len: 1317 microversion: 2.1 time: 0.710337 Aug 10 23:01:52.295639 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 716/1411] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:01:51 2022] GET /compute/v2.1/servers/196377d7-c0d5-408b-9743-e1f451f71164 => generated 1317 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:01:52.300233 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-5ceecfd0-cd68-4e67-8994-7b8de1253b03 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:52.301127 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-5ceecfd0-cd68-4e67-8994-7b8de1253b03 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 0dabc2bf-08ff-45b5-a791-34d655349eae] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:01:52.314150 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5ceecfd0-cd68-4e67-8994-7b8de1253b03 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:52.314962 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5ceecfd0-cd68-4e67-8994-7b8de1253b03 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:52.315612 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5ceecfd0-cd68-4e67-8994-7b8de1253b03 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:52.316537 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5ceecfd0-cd68-4e67-8994-7b8de1253b03 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:52.319632 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5ceecfd0-cd68-4e67-8994-7b8de1253b03 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:52.320299 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5ceecfd0-cd68-4e67-8994-7b8de1253b03 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:52.486092 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-f117cf97-3f7d-4c91-9dcd-5917b8922b4f tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:01:52.495982 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-f117cf97-3f7d-4c91-9dcd-5917b8922b4f tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:01:52.499232 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-f117cf97-3f7d-4c91-9dcd-5917b8922b4f tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:01:52.501082 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-f117cf97-3f7d-4c91-9dcd-5917b8922b4f tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] 10.222.0.58 "GET /compute/v2.1/servers/3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51" status: 200 len: 1292 microversion: 2.25 time: 0.810261 Aug 10 23:01:52.502282 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 696/1412] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:01:51 2022] GET /compute/v2.1/servers/3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51 => generated 1292 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:01:52.507365 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-ffe3a6a8-dc06-4154-a469-7928076cfced tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:52.508232 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-ffe3a6a8-dc06-4154-a469-7928076cfced tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] [instance: 1af4c3de-2464-45c7-a088-a3db68a67cb6] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:01:52.516403 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ffe3a6a8-dc06-4154-a469-7928076cfced tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:52.517214 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ffe3a6a8-dc06-4154-a469-7928076cfced tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:52.517896 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ffe3a6a8-dc06-4154-a469-7928076cfced tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:52.518920 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ffe3a6a8-dc06-4154-a469-7928076cfced tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:52.519607 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ffe3a6a8-dc06-4154-a469-7928076cfced tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:52.520273 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ffe3a6a8-dc06-4154-a469-7928076cfced tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:52.760739 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-5ceecfd0-cd68-4e67-8994-7b8de1253b03 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:01:52.782049 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-5ceecfd0-cd68-4e67-8994-7b8de1253b03 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/0dabc2bf-08ff-45b5-a791-34d655349eae" status: 200 len: 1469 microversion: 2.1 time: 0.484854 Aug 10 23:01:52.816069 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 717/1413] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:01:52 2022] GET /compute/v2.1/servers/0dabc2bf-08ff-45b5-a791-34d655349eae => generated 1469 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:01:52.824566 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-8d668b5e-dd42-4a5a-9393-cd3e619dc4ca tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:52.825289 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-8d668b5e-dd42-4a5a-9393-cd3e619dc4ca tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] [instance: 8e91f1ac-f79d-4ab0-aa13-ea32b0e74888] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:01:52.839446 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8d668b5e-dd42-4a5a-9393-cd3e619dc4ca tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:52.839948 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8d668b5e-dd42-4a5a-9393-cd3e619dc4ca tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:52.842561 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8d668b5e-dd42-4a5a-9393-cd3e619dc4ca tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:52.867402 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8d668b5e-dd42-4a5a-9393-cd3e619dc4ca tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:52.868681 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8d668b5e-dd42-4a5a-9393-cd3e619dc4ca tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:52.869798 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8d668b5e-dd42-4a5a-9393-cd3e619dc4ca tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:53.040545 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-ffe3a6a8-dc06-4154-a469-7928076cfced tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6d9806b6724e5aaf8c69be8e70d4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307ab95daa034afbb31f90626885072b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:01:53.052512 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-ffe3a6a8-dc06-4154-a469-7928076cfced tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] 10.222.0.58 "GET /compute/v2.1/servers/1af4c3de-2464-45c7-a088-a3db68a67cb6" status: 200 len: 1308 microversion: 2.1 time: 0.546697 Aug 10 23:01:53.053882 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 697/1414] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:01:52 2022] GET /compute/v2.1/servers/1af4c3de-2464-45c7-a088-a3db68a67cb6 => generated 1308 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:01:53.079340 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-39f85081-f30e-4263-85f2-6815378bed5d tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:53.080522 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-39f85081-f30e-4263-85f2-6815378bed5d tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] [instance: 38d1e924-eaea-449b-9724-1d2b16fcdfbc] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:01:53.095549 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-39f85081-f30e-4263-85f2-6815378bed5d tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:53.098415 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-39f85081-f30e-4263-85f2-6815378bed5d tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:53.098985 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-39f85081-f30e-4263-85f2-6815378bed5d tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:53.101680 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-39f85081-f30e-4263-85f2-6815378bed5d tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:53.103672 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-39f85081-f30e-4263-85f2-6815378bed5d tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:53.104153 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-39f85081-f30e-4263-85f2-6815378bed5d tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:53.339063 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-8d668b5e-dd42-4a5a-9393-cd3e619dc4ca tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632904331d024d9b8e4d3660dff2cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ed0bdee3aa4013bd9219069bda558c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:01:53.353572 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-8d668b5e-dd42-4a5a-9393-cd3e619dc4ca tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] 10.222.0.58 "GET /compute/v2.1/servers/8e91f1ac-f79d-4ab0-aa13-ea32b0e74888" status: 200 len: 1718 microversion: 2.1 time: 0.536268 Aug 10 23:01:53.354177 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 718/1415] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:01:52 2022] GET /compute/v2.1/servers/8e91f1ac-f79d-4ab0-aa13-ea32b0e74888 => generated 1718 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:01:53.380549 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-bec71ce5-f7ea-4a70-9d30-bf65fe546a5c req-991996a5-68af-4a58-94e0-073351d59fe9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51", "tag": "c83e0948-d394-45c1-aa16-31416d85184b"}, {"name": "network-changed", "server_uuid": "196377d7-c0d5-408b-9743-e1f451f71164", "tag": "ee547e27-7a4d-4b9b-a6b3-23c2283a5297"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:01:53.400966 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-bec71ce5-f7ea-4a70-9d30-bf65fe546a5c req-991996a5-68af-4a58-94e0-073351d59fe9 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:53.401453 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-bec71ce5-f7ea-4a70-9d30-bf65fe546a5c req-991996a5-68af-4a58-94e0-073351d59fe9 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:53.401891 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-bec71ce5-f7ea-4a70-9d30-bf65fe546a5c req-991996a5-68af-4a58-94e0-073351d59fe9 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:53.440164 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-bec71ce5-f7ea-4a70-9d30-bf65fe546a5c req-991996a5-68af-4a58-94e0-073351d59fe9 service nova] Creating event network-changed:c83e0948-d394-45c1-aa16-31416d85184b for instance 3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51 on n-h1-850468-14 Aug 10 23:01:53.440787 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-bec71ce5-f7ea-4a70-9d30-bf65fe546a5c req-991996a5-68af-4a58-94e0-073351d59fe9 service nova] Creating event network-changed:ee547e27-7a4d-4b9b-a6b3-23c2283a5297 for instance 196377d7-c0d5-408b-9743-e1f451f71164 on n-h2-850468-14 Aug 10 23:01:53.453261 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-bec71ce5-f7ea-4a70-9d30-bf65fe546a5c req-991996a5-68af-4a58-94e0-073351d59fe9 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.089118 Aug 10 23:01:53.458237 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 719/1416] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:01:53 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:01:53.473602 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-63cff20b-366c-4054-a799-11fcbd379eb2 req-137d9994-6587-4ef7-beb8-6197a6ee74f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1af4c3de-2464-45c7-a088-a3db68a67cb6", "name": "network-vif-plugged", "status": "completed", "tag": "881060b7-d25b-4d47-9b25-466798c6e4e3"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:01:53.495980 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-63cff20b-366c-4054-a799-11fcbd379eb2 req-137d9994-6587-4ef7-beb8-6197a6ee74f9 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:53.501604 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-63cff20b-366c-4054-a799-11fcbd379eb2 req-137d9994-6587-4ef7-beb8-6197a6ee74f9 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:53.502197 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-63cff20b-366c-4054-a799-11fcbd379eb2 req-137d9994-6587-4ef7-beb8-6197a6ee74f9 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:53.528918 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-63cff20b-366c-4054-a799-11fcbd379eb2 req-137d9994-6587-4ef7-beb8-6197a6ee74f9 service nova] Creating event network-vif-plugged:881060b7-d25b-4d47-9b25-466798c6e4e3 for instance 1af4c3de-2464-45c7-a088-a3db68a67cb6 on n-h2-850468-14 Aug 10 23:01:53.545632 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-63cff20b-366c-4054-a799-11fcbd379eb2 req-137d9994-6587-4ef7-beb8-6197a6ee74f9 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085194 Aug 10 23:01:53.546596 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 720/1417] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:01:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:01:53.552636 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-0f45cbe5-8389-4a05-b282-2e66171ea3a3 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:53.553338 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-0f45cbe5-8389-4a05-b282-2e66171ea3a3 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] [instance: 196377d7-c0d5-408b-9743-e1f451f71164] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:01:53.574611 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0f45cbe5-8389-4a05-b282-2e66171ea3a3 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:53.575974 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0f45cbe5-8389-4a05-b282-2e66171ea3a3 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:53.576509 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0f45cbe5-8389-4a05-b282-2e66171ea3a3 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:53.579953 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0f45cbe5-8389-4a05-b282-2e66171ea3a3 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:53.580487 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0f45cbe5-8389-4a05-b282-2e66171ea3a3 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:53.580936 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0f45cbe5-8389-4a05-b282-2e66171ea3a3 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:53.623529 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-39f85081-f30e-4263-85f2-6815378bed5d tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb4dc460d3b4bb1a20a45d27d524cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701fe4c2829c4ef4a748cfe83d84294f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:01:53.635937 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-39f85081-f30e-4263-85f2-6815378bed5d tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] 10.222.0.58 "GET /compute/v2.1/servers/38d1e924-eaea-449b-9724-1d2b16fcdfbc" status: 200 len: 1317 microversion: 2.1 time: 0.579812 Aug 10 23:01:53.639557 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 698/1418] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:01:53 2022] GET /compute/v2.1/servers/38d1e924-eaea-449b-9724-1d2b16fcdfbc => generated 1317 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:01:53.651382 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-b1bc8153-9258-4ead-9b86-b4c7def5fbc2 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:53.652271 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-b1bc8153-9258-4ead-9b86-b4c7def5fbc2 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] [instance: 3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:01:53.667790 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b1bc8153-9258-4ead-9b86-b4c7def5fbc2 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:53.667790 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b1bc8153-9258-4ead-9b86-b4c7def5fbc2 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:53.667790 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b1bc8153-9258-4ead-9b86-b4c7def5fbc2 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:53.669002 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b1bc8153-9258-4ead-9b86-b4c7def5fbc2 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:53.669479 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b1bc8153-9258-4ead-9b86-b4c7def5fbc2 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:53.669999 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b1bc8153-9258-4ead-9b86-b4c7def5fbc2 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:53.890806 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-0f45cbe5-8389-4a05-b282-2e66171ea3a3 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '417d4eaaeb1c4df78745496ececb3e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27e6ee9495a438b8450a4ef0d62cbcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:01:53.900347 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-0f45cbe5-8389-4a05-b282-2e66171ea3a3 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] 10.222.0.58 "GET /compute/v2.1/servers/196377d7-c0d5-408b-9743-e1f451f71164" status: 200 len: 1317 microversion: 2.1 time: 0.352200 Aug 10 23:01:53.901167 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 721/1419] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:01:53 2022] GET /compute/v2.1/servers/196377d7-c0d5-408b-9743-e1f451f71164 => generated 1317 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:01:53.923505 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-d2a94c5e-3a74-4f67-ad16-6d2af7fa41a0 req-b6f550aa-7339-4230-b5a8-37bcd88e1180 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0dabc2bf-08ff-45b5-a791-34d655349eae", "tag": "8dba1a8f-5d05-48a3-afda-7507568fcb46"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:01:53.947564 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-d2a94c5e-3a74-4f67-ad16-6d2af7fa41a0 req-b6f550aa-7339-4230-b5a8-37bcd88e1180 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:53.948325 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-d2a94c5e-3a74-4f67-ad16-6d2af7fa41a0 req-b6f550aa-7339-4230-b5a8-37bcd88e1180 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:53.948772 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-d2a94c5e-3a74-4f67-ad16-6d2af7fa41a0 req-b6f550aa-7339-4230-b5a8-37bcd88e1180 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:53.987694 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-d2a94c5e-3a74-4f67-ad16-6d2af7fa41a0 req-b6f550aa-7339-4230-b5a8-37bcd88e1180 service nova] Creating event network-changed:8dba1a8f-5d05-48a3-afda-7507568fcb46 for instance 0dabc2bf-08ff-45b5-a791-34d655349eae on n-h2-850468-14 Aug 10 23:01:54.002969 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [req-d2a94c5e-3a74-4f67-ad16-6d2af7fa41a0 req-b6f550aa-7339-4230-b5a8-37bcd88e1180 service nova] Instance 0dabc2bf-08ff-45b5-a791-34d655349eae is migrating within the same cell, copying events to all relevant hosts: {'n-h1-850468-14', 'n-h2-850468-14'} {{(pid=122633) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5901}} Aug 10 23:01:54.019542 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-d2a94c5e-3a74-4f67-ad16-6d2af7fa41a0 req-b6f550aa-7339-4230-b5a8-37bcd88e1180 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101649 Aug 10 23:01:54.020676 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 722/1420] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:01:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:01:54.026136 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-6e0c3597-5dc1-4f0b-81bb-cf62027e4c0d tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:54.026726 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-6e0c3597-5dc1-4f0b-81bb-cf62027e4c0d tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 0dabc2bf-08ff-45b5-a791-34d655349eae] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:01:54.034167 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6e0c3597-5dc1-4f0b-81bb-cf62027e4c0d tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:54.034869 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6e0c3597-5dc1-4f0b-81bb-cf62027e4c0d tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:54.035477 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6e0c3597-5dc1-4f0b-81bb-cf62027e4c0d tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:54.036390 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6e0c3597-5dc1-4f0b-81bb-cf62027e4c0d tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:54.037010 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6e0c3597-5dc1-4f0b-81bb-cf62027e4c0d tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:54.037605 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6e0c3597-5dc1-4f0b-81bb-cf62027e4c0d tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:54.080979 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-b1bc8153-9258-4ead-9b86-b4c7def5fbc2 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:01:54.089831 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-b1bc8153-9258-4ead-9b86-b4c7def5fbc2 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:01:54.091950 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-b1bc8153-9258-4ead-9b86-b4c7def5fbc2 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:01:54.093227 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-b1bc8153-9258-4ead-9b86-b4c7def5fbc2 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] 10.222.0.58 "GET /compute/v2.1/servers/3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51" status: 200 len: 1280 microversion: 2.25 time: 0.452311 Aug 10 23:01:54.110285 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 699/1421] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:01:53 2022] GET /compute/v2.1/servers/3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51 => generated 1280 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:01:54.118156 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-73b2e38a-4fb6-4aea-bb1e-d8ed18edbbf6 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:54.119442 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-73b2e38a-4fb6-4aea-bb1e-d8ed18edbbf6 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] [instance: 1af4c3de-2464-45c7-a088-a3db68a67cb6] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:01:54.126398 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-73b2e38a-4fb6-4aea-bb1e-d8ed18edbbf6 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:54.127105 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-73b2e38a-4fb6-4aea-bb1e-d8ed18edbbf6 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:54.127706 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-73b2e38a-4fb6-4aea-bb1e-d8ed18edbbf6 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:54.128605 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-73b2e38a-4fb6-4aea-bb1e-d8ed18edbbf6 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:54.129486 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-73b2e38a-4fb6-4aea-bb1e-d8ed18edbbf6 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:54.130083 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-73b2e38a-4fb6-4aea-bb1e-d8ed18edbbf6 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:54.498186 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-73b2e38a-4fb6-4aea-bb1e-d8ed18edbbf6 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6d9806b6724e5aaf8c69be8e70d4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307ab95daa034afbb31f90626885072b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:01:54.513980 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-73b2e38a-4fb6-4aea-bb1e-d8ed18edbbf6 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] 10.222.0.58 "GET /compute/v2.1/servers/1af4c3de-2464-45c7-a088-a3db68a67cb6" status: 200 len: 1308 microversion: 2.1 time: 0.400509 Aug 10 23:01:54.514758 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 700/1422] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:01:54 2022] GET /compute/v2.1/servers/1af4c3de-2464-45c7-a088-a3db68a67cb6 => generated 1308 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:01:54.525217 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-4382e1d8-203a-4b24-a429-2998e26e8300 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:54.529628 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-4382e1d8-203a-4b24-a429-2998e26e8300 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] [instance: 8e91f1ac-f79d-4ab0-aa13-ea32b0e74888] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:01:54.576722 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4382e1d8-203a-4b24-a429-2998e26e8300 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:54.579159 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4382e1d8-203a-4b24-a429-2998e26e8300 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:54.581713 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4382e1d8-203a-4b24-a429-2998e26e8300 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:54.583282 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4382e1d8-203a-4b24-a429-2998e26e8300 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:54.585621 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4382e1d8-203a-4b24-a429-2998e26e8300 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:54.589692 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4382e1d8-203a-4b24-a429-2998e26e8300 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:54.705599 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-6e0c3597-5dc1-4f0b-81bb-cf62027e4c0d tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:01:54.714682 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-6e0c3597-5dc1-4f0b-81bb-cf62027e4c0d tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/0dabc2bf-08ff-45b5-a791-34d655349eae" status: 200 len: 1469 microversion: 2.1 time: 0.692822 Aug 10 23:01:54.718987 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 723/1423] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:01:54 2022] GET /compute/v2.1/servers/0dabc2bf-08ff-45b5-a791-34d655349eae => generated 1469 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:01:54.723828 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-a8cbd6be-40a7-4dac-b580-10b521795530 tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:54.730252 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-a8cbd6be-40a7-4dac-b580-10b521795530 tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] [instance: 38d1e924-eaea-449b-9724-1d2b16fcdfbc] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:01:54.742243 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a8cbd6be-40a7-4dac-b580-10b521795530 tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:54.745614 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a8cbd6be-40a7-4dac-b580-10b521795530 tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:54.746326 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a8cbd6be-40a7-4dac-b580-10b521795530 tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:54.748627 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a8cbd6be-40a7-4dac-b580-10b521795530 tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:54.751314 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a8cbd6be-40a7-4dac-b580-10b521795530 tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:54.753150 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a8cbd6be-40a7-4dac-b580-10b521795530 tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:55.075488 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-4382e1d8-203a-4b24-a429-2998e26e8300 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632904331d024d9b8e4d3660dff2cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ed0bdee3aa4013bd9219069bda558c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:01:55.092756 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-4382e1d8-203a-4b24-a429-2998e26e8300 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] 10.222.0.58 "GET /compute/v2.1/servers/8e91f1ac-f79d-4ab0-aa13-ea32b0e74888" status: 200 len: 1718 microversion: 2.1 time: 0.572354 Aug 10 23:01:55.094226 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 701/1424] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:01:54 2022] GET /compute/v2.1/servers/8e91f1ac-f79d-4ab0-aa13-ea32b0e74888 => generated 1718 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:01:55.107242 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-575d2799-8aef-4951-861c-34492d4a0b37 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:55.108511 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-575d2799-8aef-4951-861c-34492d4a0b37 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] [instance: 196377d7-c0d5-408b-9743-e1f451f71164] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:01:55.127911 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-575d2799-8aef-4951-861c-34492d4a0b37 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:55.132233 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-575d2799-8aef-4951-861c-34492d4a0b37 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:55.133117 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-575d2799-8aef-4951-861c-34492d4a0b37 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:55.134622 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-575d2799-8aef-4951-861c-34492d4a0b37 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:55.140943 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-575d2799-8aef-4951-861c-34492d4a0b37 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:55.142018 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-575d2799-8aef-4951-861c-34492d4a0b37 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:55.184811 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-a8cbd6be-40a7-4dac-b580-10b521795530 tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb4dc460d3b4bb1a20a45d27d524cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701fe4c2829c4ef4a748cfe83d84294f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:01:55.202308 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-a8cbd6be-40a7-4dac-b580-10b521795530 tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] 10.222.0.58 "GET /compute/v2.1/servers/38d1e924-eaea-449b-9724-1d2b16fcdfbc" status: 200 len: 1317 microversion: 2.1 time: 0.481992 Aug 10 23:01:55.216544 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 724/1425] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:01:54 2022] GET /compute/v2.1/servers/38d1e924-eaea-449b-9724-1d2b16fcdfbc => generated 1317 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:01:55.221805 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-7dfebd1c-ea47-4adc-98bc-36c2f0c8858c tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:55.225677 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-7dfebd1c-ea47-4adc-98bc-36c2f0c8858c tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] [instance: 3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:01:55.240393 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7dfebd1c-ea47-4adc-98bc-36c2f0c8858c tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:55.249166 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7dfebd1c-ea47-4adc-98bc-36c2f0c8858c tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:55.249166 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7dfebd1c-ea47-4adc-98bc-36c2f0c8858c tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:55.249166 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7dfebd1c-ea47-4adc-98bc-36c2f0c8858c tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:55.249166 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7dfebd1c-ea47-4adc-98bc-36c2f0c8858c tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:55.249514 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7dfebd1c-ea47-4adc-98bc-36c2f0c8858c tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:55.824896 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-575d2799-8aef-4951-861c-34492d4a0b37 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '417d4eaaeb1c4df78745496ececb3e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27e6ee9495a438b8450a4ef0d62cbcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:01:55.836409 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-575d2799-8aef-4951-861c-34492d4a0b37 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] 10.222.0.58 "GET /compute/v2.1/servers/196377d7-c0d5-408b-9743-e1f451f71164" status: 200 len: 1317 microversion: 2.1 time: 0.740596 Aug 10 23:01:55.857424 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 702/1426] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:01:55 2022] GET /compute/v2.1/servers/196377d7-c0d5-408b-9743-e1f451f71164 => generated 1317 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:01:55.875155 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-926a9195-d1fc-48ac-b214-537b990f78b6 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:55.876211 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-926a9195-d1fc-48ac-b214-537b990f78b6 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] [instance: 1af4c3de-2464-45c7-a088-a3db68a67cb6] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:01:55.890935 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=6 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:01:55.892699 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-926a9195-d1fc-48ac-b214-537b990f78b6 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:55.893043 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-926a9195-d1fc-48ac-b214-537b990f78b6 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:55.897517 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-926a9195-d1fc-48ac-b214-537b990f78b6 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:55.898481 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-926a9195-d1fc-48ac-b214-537b990f78b6 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:55.899141 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-926a9195-d1fc-48ac-b214-537b990f78b6 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:55.900380 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-926a9195-d1fc-48ac-b214-537b990f78b6 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:55.912244 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-7dfebd1c-ea47-4adc-98bc-36c2f0c8858c tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:01:55.936838 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-7dfebd1c-ea47-4adc-98bc-36c2f0c8858c tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:01:55.940935 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-7dfebd1c-ea47-4adc-98bc-36c2f0c8858c tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:01:55.947441 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-7dfebd1c-ea47-4adc-98bc-36c2f0c8858c tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] 10.222.0.58 "GET /compute/v2.1/servers/3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51" status: 200 len: 1280 microversion: 2.25 time: 0.726736 Aug 10 23:01:55.960440 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 725/1427] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:01:55 2022] GET /compute/v2.1/servers/3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51 => generated 1280 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:01:55.966835 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=20 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:01:55.983341 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-deccf96b-f6ff-43bc-bc51-0d93512b5ad0 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:55.987256 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-deccf96b-f6ff-43bc-bc51-0d93512b5ad0 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 0dabc2bf-08ff-45b5-a791-34d655349eae] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:01:56.002598 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-deccf96b-f6ff-43bc-bc51-0d93512b5ad0 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:56.008294 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-deccf96b-f6ff-43bc-bc51-0d93512b5ad0 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:56.014661 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-deccf96b-f6ff-43bc-bc51-0d93512b5ad0 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:56.015974 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-deccf96b-f6ff-43bc-bc51-0d93512b5ad0 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:56.016489 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-deccf96b-f6ff-43bc-bc51-0d93512b5ad0 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:56.019413 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-deccf96b-f6ff-43bc-bc51-0d93512b5ad0 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:56.193609 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-deccf96b-f6ff-43bc-bc51-0d93512b5ad0 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:01:56.204942 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-deccf96b-f6ff-43bc-bc51-0d93512b5ad0 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/0dabc2bf-08ff-45b5-a791-34d655349eae" status: 200 len: 1462 microversion: 2.1 time: 0.243075 Aug 10 23:01:56.206320 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 726/1428] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:01:55 2022] GET /compute/v2.1/servers/0dabc2bf-08ff-45b5-a791-34d655349eae => generated 1462 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:01:56.219911 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-23d399da-9d6f-4ef1-99d0-c638e04b4f40 req-ec6c3434-8d15-41cc-87e1-6124d2b1e9ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38d1e924-eaea-449b-9724-1d2b16fcdfbc", "tag": "6456c6d8-67cf-4eb9-a700-b8d5398267d5"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:01:56.230554 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-23d399da-9d6f-4ef1-99d0-c638e04b4f40 req-ec6c3434-8d15-41cc-87e1-6124d2b1e9ba service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:56.232203 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-23d399da-9d6f-4ef1-99d0-c638e04b4f40 req-ec6c3434-8d15-41cc-87e1-6124d2b1e9ba service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:56.232652 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-23d399da-9d6f-4ef1-99d0-c638e04b4f40 req-ec6c3434-8d15-41cc-87e1-6124d2b1e9ba service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:56.246821 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-23d399da-9d6f-4ef1-99d0-c638e04b4f40 req-ec6c3434-8d15-41cc-87e1-6124d2b1e9ba service nova] Creating event network-changed:6456c6d8-67cf-4eb9-a700-b8d5398267d5 for instance 38d1e924-eaea-449b-9724-1d2b16fcdfbc on n-h1-850468-14 Aug 10 23:01:56.252788 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-23d399da-9d6f-4ef1-99d0-c638e04b4f40 req-ec6c3434-8d15-41cc-87e1-6124d2b1e9ba service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044985 Aug 10 23:01:56.254024 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 727/1429] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:01:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:01:56.260563 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-f1b5b706-c672-40ed-aad5-32d9af2209c3 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:56.261269 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-f1b5b706-c672-40ed-aad5-32d9af2209c3 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] [instance: 8e91f1ac-f79d-4ab0-aa13-ea32b0e74888] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:01:56.267925 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f1b5b706-c672-40ed-aad5-32d9af2209c3 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:56.268366 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f1b5b706-c672-40ed-aad5-32d9af2209c3 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:56.268826 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f1b5b706-c672-40ed-aad5-32d9af2209c3 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:56.269503 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f1b5b706-c672-40ed-aad5-32d9af2209c3 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:56.269954 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f1b5b706-c672-40ed-aad5-32d9af2209c3 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:56.270570 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f1b5b706-c672-40ed-aad5-32d9af2209c3 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:56.422637 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-f1b5b706-c672-40ed-aad5-32d9af2209c3 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632904331d024d9b8e4d3660dff2cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ed0bdee3aa4013bd9219069bda558c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:01:56.425635 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=100 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:01:56.433317 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-f1b5b706-c672-40ed-aad5-32d9af2209c3 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] 10.222.0.58 "GET /compute/v2.1/servers/8e91f1ac-f79d-4ab0-aa13-ea32b0e74888" status: 200 len: 1718 microversion: 2.1 time: 0.177880 Aug 10 23:01:56.452674 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 728/1430] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:01:56 2022] GET /compute/v2.1/servers/8e91f1ac-f79d-4ab0-aa13-ea32b0e74888 => generated 1718 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:01:56.458604 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-068eae97-bcf5-488b-83d3-d0a268cdee14 tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:56.459425 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-068eae97-bcf5-488b-83d3-d0a268cdee14 tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] [instance: 38d1e924-eaea-449b-9724-1d2b16fcdfbc] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:01:56.468453 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-068eae97-bcf5-488b-83d3-d0a268cdee14 tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:56.469231 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-068eae97-bcf5-488b-83d3-d0a268cdee14 tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:56.469890 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-068eae97-bcf5-488b-83d3-d0a268cdee14 tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:56.470754 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-068eae97-bcf5-488b-83d3-d0a268cdee14 tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:56.472889 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-068eae97-bcf5-488b-83d3-d0a268cdee14 tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:56.473475 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-068eae97-bcf5-488b-83d3-d0a268cdee14 tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:56.692630 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-926a9195-d1fc-48ac-b214-537b990f78b6 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6d9806b6724e5aaf8c69be8e70d4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307ab95daa034afbb31f90626885072b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:01:56.720621 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-926a9195-d1fc-48ac-b214-537b990f78b6 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] 10.222.0.58 "GET /compute/v2.1/servers/1af4c3de-2464-45c7-a088-a3db68a67cb6" status: 200 len: 1308 microversion: 2.1 time: 0.861017 Aug 10 23:01:56.732477 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 703/1431] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:01:55 2022] GET /compute/v2.1/servers/1af4c3de-2464-45c7-a088-a3db68a67cb6 => generated 1308 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:01:56.785095 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-068eae97-bcf5-488b-83d3-d0a268cdee14 tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb4dc460d3b4bb1a20a45d27d524cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701fe4c2829c4ef4a748cfe83d84294f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:01:56.809699 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-068eae97-bcf5-488b-83d3-d0a268cdee14 tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] 10.222.0.58 "GET /compute/v2.1/servers/38d1e924-eaea-449b-9724-1d2b16fcdfbc" status: 200 len: 1317 microversion: 2.1 time: 0.354270 Aug 10 23:01:56.815448 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 729/1432] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:01:56 2022] GET /compute/v2.1/servers/38d1e924-eaea-449b-9724-1d2b16fcdfbc => generated 1317 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:01:56.862110 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-01a12143-c5c4-41a1-be9b-0df3ed4ffcc4 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:56.863197 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-01a12143-c5c4-41a1-be9b-0df3ed4ffcc4 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] [instance: 196377d7-c0d5-408b-9743-e1f451f71164] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:01:56.878887 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-01a12143-c5c4-41a1-be9b-0df3ed4ffcc4 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:56.879563 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-01a12143-c5c4-41a1-be9b-0df3ed4ffcc4 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:56.881817 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-01a12143-c5c4-41a1-be9b-0df3ed4ffcc4 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:56.882963 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-01a12143-c5c4-41a1-be9b-0df3ed4ffcc4 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:56.884304 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-01a12143-c5c4-41a1-be9b-0df3ed4ffcc4 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:56.885022 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-01a12143-c5c4-41a1-be9b-0df3ed4ffcc4 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:57.355554 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-01a12143-c5c4-41a1-be9b-0df3ed4ffcc4 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '417d4eaaeb1c4df78745496ececb3e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27e6ee9495a438b8450a4ef0d62cbcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:01:57.367209 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-01a12143-c5c4-41a1-be9b-0df3ed4ffcc4 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] 10.222.0.58 "GET /compute/v2.1/servers/196377d7-c0d5-408b-9743-e1f451f71164" status: 200 len: 1317 microversion: 2.1 time: 0.509420 Aug 10 23:01:57.368292 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 730/1433] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:01:56 2022] GET /compute/v2.1/servers/196377d7-c0d5-408b-9743-e1f451f71164 => generated 1317 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:01:57.386961 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-ba739cdb-312c-48bc-94e9-c68aac29936a tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:57.392787 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-ba739cdb-312c-48bc-94e9-c68aac29936a tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] [instance: 3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:01:57.414894 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ba739cdb-312c-48bc-94e9-c68aac29936a tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:57.415901 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ba739cdb-312c-48bc-94e9-c68aac29936a tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:57.420875 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ba739cdb-312c-48bc-94e9-c68aac29936a tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:57.423936 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ba739cdb-312c-48bc-94e9-c68aac29936a tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:57.425766 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ba739cdb-312c-48bc-94e9-c68aac29936a tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:57.429198 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ba739cdb-312c-48bc-94e9-c68aac29936a tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:57.542277 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-b6185302-1256-4bb2-8205-13ac660c95be tempest-MigrationsAdminTest-974767625 tempest-MigrationsAdminTest-974767625-project-admin] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:57.542910 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-b6185302-1256-4bb2-8205-13ac660c95be tempest-MigrationsAdminTest-974767625 tempest-MigrationsAdminTest-974767625-project-admin] [instance: 0dabc2bf-08ff-45b5-a791-34d655349eae] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:01:57.561756 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b6185302-1256-4bb2-8205-13ac660c95be tempest-MigrationsAdminTest-974767625 tempest-MigrationsAdminTest-974767625-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:57.562268 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b6185302-1256-4bb2-8205-13ac660c95be tempest-MigrationsAdminTest-974767625 tempest-MigrationsAdminTest-974767625-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:57.562720 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b6185302-1256-4bb2-8205-13ac660c95be tempest-MigrationsAdminTest-974767625 tempest-MigrationsAdminTest-974767625-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:57.569750 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b6185302-1256-4bb2-8205-13ac660c95be tempest-MigrationsAdminTest-974767625 tempest-MigrationsAdminTest-974767625-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:57.571909 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b6185302-1256-4bb2-8205-13ac660c95be tempest-MigrationsAdminTest-974767625 tempest-MigrationsAdminTest-974767625-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:57.574203 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b6185302-1256-4bb2-8205-13ac660c95be tempest-MigrationsAdminTest-974767625 tempest-MigrationsAdminTest-974767625-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:58.099351 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-ba739cdb-312c-48bc-94e9-c68aac29936a tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:01:58.113587 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-ba739cdb-312c-48bc-94e9-c68aac29936a tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:01:58.130371 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-ba739cdb-312c-48bc-94e9-c68aac29936a tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:01:58.134767 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-ba739cdb-312c-48bc-94e9-c68aac29936a tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] 10.222.0.58 "GET /compute/v2.1/servers/3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51" status: 200 len: 1280 microversion: 2.25 time: 0.764349 Aug 10 23:01:58.135970 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 731/1434] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:01:57 2022] GET /compute/v2.1/servers/3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51 => generated 1280 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:01:58.146966 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-5f2f8823-ca33-4a6b-9c89-46704fedac9f tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:58.152246 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-5f2f8823-ca33-4a6b-9c89-46704fedac9f tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] [instance: 8e91f1ac-f79d-4ab0-aa13-ea32b0e74888] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:01:58.168132 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5f2f8823-ca33-4a6b-9c89-46704fedac9f tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:58.170066 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5f2f8823-ca33-4a6b-9c89-46704fedac9f tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:58.170700 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5f2f8823-ca33-4a6b-9c89-46704fedac9f tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:58.175021 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5f2f8823-ca33-4a6b-9c89-46704fedac9f tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:58.175738 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5f2f8823-ca33-4a6b-9c89-46704fedac9f tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:58.176343 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5f2f8823-ca33-4a6b-9c89-46704fedac9f tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:58.239658 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-b6185302-1256-4bb2-8205-13ac660c95be tempest-MigrationsAdminTest-974767625 tempest-MigrationsAdminTest-974767625-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/0dabc2bf-08ff-45b5-a791-34d655349eae" status: 200 len: 1615 microversion: 2.1 time: 1.513981 Aug 10 23:01:58.258398 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 704/1435] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:01:56 2022] GET /compute/v2.1/servers/0dabc2bf-08ff-45b5-a791-34d655349eae => generated 1615 bytes in 1534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:01:58.275005 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-4f82f845-9a29-4e12-b38e-edb049e957b2 req-2f4f5f1a-246b-4a17-a1db-b08c76045cd5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0dabc2bf-08ff-45b5-a791-34d655349eae", "name": "network-vif-plugged", "status": "completed", "tag": "8dba1a8f-5d05-48a3-afda-7507568fcb46"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:01:58.286581 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-4f82f845-9a29-4e12-b38e-edb049e957b2 req-2f4f5f1a-246b-4a17-a1db-b08c76045cd5 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:58.287094 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-4f82f845-9a29-4e12-b38e-edb049e957b2 req-2f4f5f1a-246b-4a17-a1db-b08c76045cd5 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:58.287529 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-4f82f845-9a29-4e12-b38e-edb049e957b2 req-2f4f5f1a-246b-4a17-a1db-b08c76045cd5 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:58.304308 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-4f82f845-9a29-4e12-b38e-edb049e957b2 req-2f4f5f1a-246b-4a17-a1db-b08c76045cd5 service nova] Creating event network-vif-plugged:8dba1a8f-5d05-48a3-afda-7507568fcb46 for instance 0dabc2bf-08ff-45b5-a791-34d655349eae on n-h2-850468-14 Aug 10 23:01:58.312636 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-4f82f845-9a29-4e12-b38e-edb049e957b2 req-2f4f5f1a-246b-4a17-a1db-b08c76045cd5 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050551 Aug 10 23:01:58.313563 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 705/1436] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:01:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:01:58.319332 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-1af2de7d-00dd-48e5-8fcd-c63c1b11ea32 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:58.320276 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-1af2de7d-00dd-48e5-8fcd-c63c1b11ea32 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] [instance: 1af4c3de-2464-45c7-a088-a3db68a67cb6] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:01:58.329190 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1af2de7d-00dd-48e5-8fcd-c63c1b11ea32 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:58.329972 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1af2de7d-00dd-48e5-8fcd-c63c1b11ea32 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:58.331349 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1af2de7d-00dd-48e5-8fcd-c63c1b11ea32 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:58.333411 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1af2de7d-00dd-48e5-8fcd-c63c1b11ea32 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:58.334065 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1af2de7d-00dd-48e5-8fcd-c63c1b11ea32 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:58.334824 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1af2de7d-00dd-48e5-8fcd-c63c1b11ea32 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:58.518895 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-5f2f8823-ca33-4a6b-9c89-46704fedac9f tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632904331d024d9b8e4d3660dff2cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ed0bdee3aa4013bd9219069bda558c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:01:58.533643 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-5f2f8823-ca33-4a6b-9c89-46704fedac9f tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] 10.222.0.58 "GET /compute/v2.1/servers/8e91f1ac-f79d-4ab0-aa13-ea32b0e74888" status: 200 len: 1718 microversion: 2.1 time: 0.396369 Aug 10 23:01:58.534250 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 732/1437] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:01:58 2022] GET /compute/v2.1/servers/8e91f1ac-f79d-4ab0-aa13-ea32b0e74888 => generated 1718 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:01:58.541511 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-8a612b16-a1bc-48ed-ac1d-1a609b6aa527 tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:58.543903 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-8a612b16-a1bc-48ed-ac1d-1a609b6aa527 tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] [instance: 38d1e924-eaea-449b-9724-1d2b16fcdfbc] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:01:58.552892 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8a612b16-a1bc-48ed-ac1d-1a609b6aa527 tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:58.553441 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8a612b16-a1bc-48ed-ac1d-1a609b6aa527 tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:58.584712 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8a612b16-a1bc-48ed-ac1d-1a609b6aa527 tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:58.588870 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8a612b16-a1bc-48ed-ac1d-1a609b6aa527 tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:58.589733 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8a612b16-a1bc-48ed-ac1d-1a609b6aa527 tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:58.595373 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8a612b16-a1bc-48ed-ac1d-1a609b6aa527 tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:58.719809 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-1af2de7d-00dd-48e5-8fcd-c63c1b11ea32 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6d9806b6724e5aaf8c69be8e70d4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307ab95daa034afbb31f90626885072b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:01:58.723444 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=100 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:01:58.728816 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-1af2de7d-00dd-48e5-8fcd-c63c1b11ea32 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] 10.222.0.58 "GET /compute/v2.1/servers/1af4c3de-2464-45c7-a088-a3db68a67cb6" status: 200 len: 1488 microversion: 2.1 time: 0.413836 Aug 10 23:01:58.729620 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 706/1438] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:01:58 2022] GET /compute/v2.1/servers/1af4c3de-2464-45c7-a088-a3db68a67cb6 => generated 1488 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:01:58.914919 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-e694b8df-5035-4932-8fdf-3de6cc56d425 tempest-VolumesNegativeTest-49330106 tempest-VolumesNegativeTest-49330106-project] Action: 'create', calling method: .version_select at 0x7f847d174040>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-29882418", "metadata": {"Type": "work"}}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:01:58.921954 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-e694b8df-5035-4932-8fdf-3de6cc56d425 tempest-VolumesNegativeTest-49330106 tempest-VolumesNegativeTest-49330106-project] Request method failure captured: Aug 10 23:01:58.921954 n-d-850468-14 devstack@n-api.service[122632]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 10 23:01:58.921954 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:01:58.921954 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:01:58.921954 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:01:58.921954 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 120 Aug 10 23:01:58.921954 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:01:58.921954 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:01:58.921954 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:01:58.921954 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:01:58.921954 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9DjmxjXgvb-riFDbj8RrcVJnE5X-H0pfPr_e0MsRj6cq5qbwUv3TUb3lXNUmFwLyN61rImyerDMf9ghPLIGDKAw2XYK4ka6msnGWpipdhh2wC4bcbe3M-tVhfGCfaEZuV0uO6pn7u1tIDD-WzTZkGJl9eQfi4CW3bwaCgKpVKoD6RHg Aug 10 23:01:58.921954 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:01:58.921954 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:01:58.921954 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:01:58.921954 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:01:58.921954 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:01:58.921954 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:01:58.921954 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 6fad6a9aa56b4ae1b7185b08af9dcadc Aug 10 23:01:58.921954 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-VolumesNegativeTest-49330106 Aug 10 23:01:58.921954 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:01:58.921954 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:01:58.924437 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6fad6a9aa56b4ae1b7185b08af9dcadc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6fad6a9aa56b4ae1b7185b08af9dcadc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/6fad6a9aa56b4ae1b7185b08af9dcadc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_6fad6a9aa56b4ae1b7185b08af9dcadc", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:01:58.924437 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-VolumesNegativeTest-49330106 Aug 10 23:01:58.924437 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 6fad6a9aa56b4ae1b7185b08af9dcadc Aug 10 23:01:58.924437 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-VolumesNegativeTest-49330106 Aug 10 23:01:58.924437 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-VolumesNegativeTest-49330106-project Aug 10 23:01:58.924437 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:01:58.924437 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:01:58.924437 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: 81ff989d8ba842658925965c9710a134 Aug 10 23:01:58.924437 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-VolumesNegativeTest-49330106-project Aug 10 23:01:58.924437 n-d-850468-14 devstack@n-api.service[122632]: Aug 10 23:01:58.924437 n-d-850468-14 devstack@n-api.service[122632]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-29882418", "metadata": {"Type": "work"}}} Aug 10 23:01:58.924437 n-d-850468-14 devstack@n-api.service[122632]: method: Aug 10 23:01:58.924437 n-d-850468-14 devstack@n-api.service[122632]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 10 23:01:58.925539 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-29882418', 'metadata': {'Type': 'work'}}}} Aug 10 23:01:58.925539 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:01:58.925539 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:01:58.925539 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 10 23:01:58.925539 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 10 23:01:58.925539 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 10 23:01:58.925539 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise error Aug 10 23:01:58.925539 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 10 23:01:58.925539 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:01:58.925539 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 10 23:01:58.925539 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 10 23:01:58.925539 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:01:58.925539 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 10 23:01:58.925539 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi '#$%' Aug 10 23:01:58.925539 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:01:58.925539 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:01:58.925539 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:01:58.925539 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:01:58.925539 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:01:58.925539 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:01:58.925539 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:01:58.925539 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:01:58.927339 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 23:01:58.927339 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 23:01:58.927339 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:01:58.927339 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:01:58.927339 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 10 23:01:58.927339 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 10 23:01:58.927339 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 10 23:01:58.927339 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 10 23:01:58.927339 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 10 23:01:58.927339 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 10 23:01:58.927339 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 10 23:01:58.927339 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:01:58.927339 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:01:58.927339 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:01:58.927339 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:01:58.927339 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:01:58.927339 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:01:58.927339 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 10 23:01:58.927339 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 10 23:01:58.929921 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 10 23:01:58.929921 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:01:58.931613 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-e694b8df-5035-4932-8fdf-3de6cc56d425 tempest-VolumesNegativeTest-49330106 tempest-VolumesNegativeTest-49330106-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:01:58.932646 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-e694b8df-5035-4932-8fdf-3de6cc56d425 tempest-VolumesNegativeTest-49330106 tempest-VolumesNegativeTest-49330106-project] 10.222.0.58 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.201942 Aug 10 23:01:58.933486 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 707/1439] 10.222.0.58 () {60 vars in 1156 bytes} [Wed Aug 10 23:01:58 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 203 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 10 23:01:58.945428 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-8536bdfc-83df-4ae9-92bb-4242ef32c2e8 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:58.946203 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-8536bdfc-83df-4ae9-92bb-4242ef32c2e8 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 0dabc2bf-08ff-45b5-a791-34d655349eae] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:01:58.955380 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8536bdfc-83df-4ae9-92bb-4242ef32c2e8 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:58.956161 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8536bdfc-83df-4ae9-92bb-4242ef32c2e8 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:58.956792 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8536bdfc-83df-4ae9-92bb-4242ef32c2e8 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:58.957687 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8536bdfc-83df-4ae9-92bb-4242ef32c2e8 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:58.958298 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8536bdfc-83df-4ae9-92bb-4242ef32c2e8 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:58.959597 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8536bdfc-83df-4ae9-92bb-4242ef32c2e8 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:59.007578 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-8536bdfc-83df-4ae9-92bb-4242ef32c2e8 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 0dabc2bf-08ff-45b5-a791-34d655349eae] Going to try to terminate instance {{(pid=122632) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:01:59.083137 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-8a612b16-a1bc-48ed-ac1d-1a609b6aa527 tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb4dc460d3b4bb1a20a45d27d524cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701fe4c2829c4ef4a748cfe83d84294f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:01:59.104901 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-8a612b16-a1bc-48ed-ac1d-1a609b6aa527 tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] 10.222.0.58 "GET /compute/v2.1/servers/38d1e924-eaea-449b-9724-1d2b16fcdfbc" status: 200 len: 1317 microversion: 2.1 time: 0.567246 Aug 10 23:01:59.108555 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 733/1440] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:01:58 2022] GET /compute/v2.1/servers/38d1e924-eaea-449b-9724-1d2b16fcdfbc => generated 1317 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:01:59.119266 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-8536bdfc-83df-4ae9-92bb-4242ef32c2e8 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "DELETE /compute/v2.1/servers/0dabc2bf-08ff-45b5-a791-34d655349eae" status: 204 len: 0 microversion: 2.1 time: 0.179403 Aug 10 23:01:59.120628 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 708/1441] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:01:58 2022] DELETE /compute/v2.1/servers/0dabc2bf-08ff-45b5-a791-34d655349eae => generated 0 bytes in 182 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:01:59.124472 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-7034ec81-27e1-4001-968e-fd693e4a9f12 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:59.127725 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-7034ec81-27e1-4001-968e-fd693e4a9f12 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] [instance: 196377d7-c0d5-408b-9743-e1f451f71164] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:01:59.129423 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-f090c44b-f4e3-42e7-a111-83896455a560 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1555978608"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:01:59.133748 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-f090c44b-f4e3-42e7-a111-83896455a560 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] [instance: 1af4c3de-2464-45c7-a088-a3db68a67cb6] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:01:59.139423 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7034ec81-27e1-4001-968e-fd693e4a9f12 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:59.140849 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7034ec81-27e1-4001-968e-fd693e4a9f12 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:59.141483 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7034ec81-27e1-4001-968e-fd693e4a9f12 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:59.142039 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f090c44b-f4e3-42e7-a111-83896455a560 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:59.142680 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f090c44b-f4e3-42e7-a111-83896455a560 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:59.143552 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7034ec81-27e1-4001-968e-fd693e4a9f12 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:59.144066 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f090c44b-f4e3-42e7-a111-83896455a560 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:59.145142 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7034ec81-27e1-4001-968e-fd693e4a9f12 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:59.145544 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f090c44b-f4e3-42e7-a111-83896455a560 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:59.146228 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7034ec81-27e1-4001-968e-fd693e4a9f12 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:59.146354 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f090c44b-f4e3-42e7-a111-83896455a560 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:59.147070 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f090c44b-f4e3-42e7-a111-83896455a560 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:59.393851 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-f090c44b-f4e3-42e7-a111-83896455a560 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] 10.222.0.58 "POST /compute/v2.1/servers/1af4c3de-2464-45c7-a088-a3db68a67cb6/action" status: 202 len: 0 microversion: 2.1 time: 0.271125 Aug 10 23:01:59.395214 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 709/1442] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:01:59 2022] POST /compute/v2.1/servers/1af4c3de-2464-45c7-a088-a3db68a67cb6/action => generated 0 bytes in 274 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 10 23:01:59.400765 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-83d7a640-5daf-446b-8618-474a922ff5d0 tempest-VolumesNegativeTest-49330106 tempest-VolumesNegativeTest-49330106-project] Action: 'create', calling method: .version_select at 0x7f847d023b80>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-189255536", "metadata": {"Type": "work"}}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:01:59.405817 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-83d7a640-5daf-446b-8618-474a922ff5d0 tempest-VolumesNegativeTest-49330106 tempest-VolumesNegativeTest-49330106-project] Request method failure captured: Aug 10 23:01:59.405817 n-d-850468-14 devstack@n-api.service[122632]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 10 23:01:59.405817 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:01:59.405817 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:01:59.405817 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:01:59.405817 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 119 Aug 10 23:01:59.405817 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:01:59.405817 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:01:59.405817 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:01:59.405817 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:01:59.405817 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9DjmxjXgvb-riFDbj8RrcVJnE5X-H0pfPr_e0MsRj6cq5qbwUv3TUb3lXNUmFwLyN61rImyerDMf9ghPLIGDKAw2XYK4ka6msnGWpipdhh2wC4bcbe3M-tVhfGCfaEZuV0uO6pn7u1tIDD-WzTZkGJl9eQfi4CW3bwaCgKpVKoD6RHg Aug 10 23:01:59.405817 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:01:59.405817 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:01:59.405817 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:01:59.405817 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:01:59.405817 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:01:59.405817 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:01:59.405817 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 6fad6a9aa56b4ae1b7185b08af9dcadc Aug 10 23:01:59.405817 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-VolumesNegativeTest-49330106 Aug 10 23:01:59.405817 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:01:59.405817 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:01:59.407569 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6fad6a9aa56b4ae1b7185b08af9dcadc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6fad6a9aa56b4ae1b7185b08af9dcadc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/6fad6a9aa56b4ae1b7185b08af9dcadc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_6fad6a9aa56b4ae1b7185b08af9dcadc", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:01:59.407569 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-VolumesNegativeTest-49330106 Aug 10 23:01:59.407569 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 6fad6a9aa56b4ae1b7185b08af9dcadc Aug 10 23:01:59.407569 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-VolumesNegativeTest-49330106 Aug 10 23:01:59.407569 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-VolumesNegativeTest-49330106-project Aug 10 23:01:59.407569 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:01:59.407569 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:01:59.407569 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: 81ff989d8ba842658925965c9710a134 Aug 10 23:01:59.407569 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-VolumesNegativeTest-49330106-project Aug 10 23:01:59.407569 n-d-850468-14 devstack@n-api.service[122632]: Aug 10 23:01:59.407569 n-d-850468-14 devstack@n-api.service[122632]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-189255536", "metadata": {"Type": "work"}}} Aug 10 23:01:59.407569 n-d-850468-14 devstack@n-api.service[122632]: method: Aug 10 23:01:59.407569 n-d-850468-14 devstack@n-api.service[122632]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 10 23:01:59.408474 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-189255536', 'metadata': {'Type': 'work'}}}} Aug 10 23:01:59.408474 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:01:59.408474 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:01:59.408474 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 10 23:01:59.408474 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 10 23:01:59.408474 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 10 23:01:59.408474 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise error Aug 10 23:01:59.408474 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 10 23:01:59.408474 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:01:59.408474 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 10 23:01:59.408474 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 10 23:01:59.408474 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:01:59.408474 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 10 23:01:59.408474 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi '0' Aug 10 23:01:59.408474 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:01:59.408474 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:01:59.408474 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:01:59.408474 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:01:59.408474 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:01:59.408474 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:01:59.408474 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:01:59.408474 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:01:59.410141 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 23:01:59.410141 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 23:01:59.410141 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:01:59.410141 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:01:59.410141 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 10 23:01:59.410141 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 10 23:01:59.410141 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 10 23:01:59.410141 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 10 23:01:59.410141 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 10 23:01:59.410141 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 10 23:01:59.410141 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 10 23:01:59.410141 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:01:59.410141 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:01:59.410141 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:01:59.410141 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:01:59.410141 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:01:59.410141 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:01:59.410141 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 10 23:01:59.410141 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 10 23:01:59.411628 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 10 23:01:59.411628 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:01:59.411628 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-83d7a640-5daf-446b-8618-474a922ff5d0 tempest-VolumesNegativeTest-49330106 tempest-VolumesNegativeTest-49330106-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:01:59.411628 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-83d7a640-5daf-446b-8618-474a922ff5d0 tempest-VolumesNegativeTest-49330106 tempest-VolumesNegativeTest-49330106-project] 10.222.0.58 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.011744 Aug 10 23:01:59.411628 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 710/1443] 10.222.0.58 () {60 vars in 1156 bytes} [Wed Aug 10 23:01:59 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 10 23:01:59.418004 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-ed55d99d-bb1d-46e8-bf6f-1b055afd301d tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:59.419225 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-ed55d99d-bb1d-46e8-bf6f-1b055afd301d tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 0dabc2bf-08ff-45b5-a791-34d655349eae] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:01:59.431616 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ed55d99d-bb1d-46e8-bf6f-1b055afd301d tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:59.432573 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ed55d99d-bb1d-46e8-bf6f-1b055afd301d tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:59.435521 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ed55d99d-bb1d-46e8-bf6f-1b055afd301d tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:59.437109 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ed55d99d-bb1d-46e8-bf6f-1b055afd301d tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:59.437648 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ed55d99d-bb1d-46e8-bf6f-1b055afd301d tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:59.438245 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ed55d99d-bb1d-46e8-bf6f-1b055afd301d tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:59.495556 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-7034ec81-27e1-4001-968e-fd693e4a9f12 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '417d4eaaeb1c4df78745496ececb3e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27e6ee9495a438b8450a4ef0d62cbcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:01:59.505247 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-7034ec81-27e1-4001-968e-fd693e4a9f12 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] 10.222.0.58 "GET /compute/v2.1/servers/196377d7-c0d5-408b-9743-e1f451f71164" status: 200 len: 1317 microversion: 2.1 time: 0.393369 Aug 10 23:01:59.506958 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 734/1444] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:01:59 2022] GET /compute/v2.1/servers/196377d7-c0d5-408b-9743-e1f451f71164 => generated 1317 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:01:59.513218 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-86631533-87bc-4d33-b2e4-1d627ba72da7 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:59.513999 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-86631533-87bc-4d33-b2e4-1d627ba72da7 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] [instance: 3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:01:59.520902 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-86631533-87bc-4d33-b2e4-1d627ba72da7 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:59.522352 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-86631533-87bc-4d33-b2e4-1d627ba72da7 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:59.523100 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-86631533-87bc-4d33-b2e4-1d627ba72da7 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:59.524220 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-86631533-87bc-4d33-b2e4-1d627ba72da7 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:59.524813 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-86631533-87bc-4d33-b2e4-1d627ba72da7 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:59.525711 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-86631533-87bc-4d33-b2e4-1d627ba72da7 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:59.660912 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-ed55d99d-bb1d-46e8-bf6f-1b055afd301d tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:01:59.669280 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-ed55d99d-bb1d-46e8-bf6f-1b055afd301d tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/0dabc2bf-08ff-45b5-a791-34d655349eae" status: 200 len: 1468 microversion: 2.1 time: 0.256652 Aug 10 23:01:59.672500 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 711/1445] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:01:59 2022] GET /compute/v2.1/servers/0dabc2bf-08ff-45b5-a791-34d655349eae => generated 1468 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:01:59.674832 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-03260057-1321-4e20-8fe0-1176697e2e78 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Calling method '.version_select at 0x7f847d023820>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:59.735222 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-03260057-1321-4e20-8fe0-1176697e2e78 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] 10.222.0.58 "GET /compute/v2.1/images/aa11c27d-647b-4b9d-bf80-610d7dd4a8b2" status: 200 len: 1414 microversion: 2.1 time: 0.061350 Aug 10 23:01:59.736070 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 712/1446] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 10 23:01:59 2022] GET /compute/v2.1/images/aa11c27d-647b-4b9d-bf80-610d7dd4a8b2 => generated 1414 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:01:59.741721 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-987c373f-cf24-44ef-82cb-feb9f196d6d0 tempest-VolumesNegativeTest-49330106 tempest-VolumesNegativeTest-49330106-project] Action: 'create', calling method: .version_select at 0x7f847d055280>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1010804208", "metadata": {"Type": "work"}}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:01:59.745959 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-987c373f-cf24-44ef-82cb-feb9f196d6d0 tempest-VolumesNegativeTest-49330106 tempest-VolumesNegativeTest-49330106-project] Request method failure captured: Aug 10 23:01:59.745959 n-d-850468-14 devstack@n-api.service[122632]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 10 23:01:59.745959 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:01:59.745959 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:01:59.745959 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:01:59.745959 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 119 Aug 10 23:01:59.745959 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:01:59.745959 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:01:59.745959 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:01:59.745959 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:01:59.745959 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9DjmxjXgvb-riFDbj8RrcVJnE5X-H0pfPr_e0MsRj6cq5qbwUv3TUb3lXNUmFwLyN61rImyerDMf9ghPLIGDKAw2XYK4ka6msnGWpipdhh2wC4bcbe3M-tVhfGCfaEZuV0uO6pn7u1tIDD-WzTZkGJl9eQfi4CW3bwaCgKpVKoD6RHg Aug 10 23:01:59.745959 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:01:59.745959 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:01:59.745959 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:01:59.745959 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:01:59.745959 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:01:59.745959 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:01:59.745959 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 6fad6a9aa56b4ae1b7185b08af9dcadc Aug 10 23:01:59.745959 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-VolumesNegativeTest-49330106 Aug 10 23:01:59.745959 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:01:59.745959 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:01:59.747557 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6fad6a9aa56b4ae1b7185b08af9dcadc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6fad6a9aa56b4ae1b7185b08af9dcadc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/6fad6a9aa56b4ae1b7185b08af9dcadc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_6fad6a9aa56b4ae1b7185b08af9dcadc", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:01:59.747557 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-VolumesNegativeTest-49330106 Aug 10 23:01:59.747557 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 6fad6a9aa56b4ae1b7185b08af9dcadc Aug 10 23:01:59.747557 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-VolumesNegativeTest-49330106 Aug 10 23:01:59.747557 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-VolumesNegativeTest-49330106-project Aug 10 23:01:59.747557 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:01:59.747557 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:01:59.747557 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: 81ff989d8ba842658925965c9710a134 Aug 10 23:01:59.747557 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-VolumesNegativeTest-49330106-project Aug 10 23:01:59.747557 n-d-850468-14 devstack@n-api.service[122632]: Aug 10 23:01:59.747557 n-d-850468-14 devstack@n-api.service[122632]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1010804208", "metadata": {"Type": "work"}}} Aug 10 23:01:59.747557 n-d-850468-14 devstack@n-api.service[122632]: method: Aug 10 23:01:59.747557 n-d-850468-14 devstack@n-api.service[122632]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 10 23:01:59.748420 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1010804208', 'metadata': {'Type': 'work'}}}} Aug 10 23:01:59.748420 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:01:59.748420 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:01:59.748420 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 10 23:01:59.748420 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 10 23:01:59.748420 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 10 23:01:59.748420 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise error Aug 10 23:01:59.748420 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 10 23:01:59.748420 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:01:59.748420 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 10 23:01:59.748420 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 10 23:01:59.748420 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:01:59.748420 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 10 23:01:59.748420 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi '' Aug 10 23:01:59.748420 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:01:59.748420 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:01:59.748420 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:01:59.748420 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:01:59.748420 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:01:59.748420 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:01:59.748420 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:01:59.748420 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:01:59.749903 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 23:01:59.749903 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 23:01:59.749903 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:01:59.749903 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:01:59.749903 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 10 23:01:59.749903 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 10 23:01:59.749903 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 10 23:01:59.749903 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 10 23:01:59.749903 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 10 23:01:59.749903 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 10 23:01:59.749903 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 10 23:01:59.749903 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:01:59.749903 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:01:59.749903 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:01:59.749903 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:01:59.749903 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:01:59.749903 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:01:59.749903 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 10 23:01:59.749903 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 10 23:01:59.753608 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 10 23:01:59.753608 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:01:59.753608 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-987c373f-cf24-44ef-82cb-feb9f196d6d0 tempest-VolumesNegativeTest-49330106 tempest-VolumesNegativeTest-49330106-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:01:59.753608 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-987c373f-cf24-44ef-82cb-feb9f196d6d0 tempest-VolumesNegativeTest-49330106 tempest-VolumesNegativeTest-49330106-project] 10.222.0.58 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.011457 Aug 10 23:01:59.753608 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 713/1447] 10.222.0.58 () {60 vars in 1156 bytes} [Wed Aug 10 23:01:59 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 10 23:01:59.754531 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-768112b1-fd06-4676-85b5-865cc28efd1e tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:01:59.755201 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-768112b1-fd06-4676-85b5-865cc28efd1e tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] [instance: 8e91f1ac-f79d-4ab0-aa13-ea32b0e74888] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:01:59.764834 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-768112b1-fd06-4676-85b5-865cc28efd1e tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:59.765336 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-768112b1-fd06-4676-85b5-865cc28efd1e tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:59.765804 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-768112b1-fd06-4676-85b5-865cc28efd1e tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:59.766486 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-768112b1-fd06-4676-85b5-865cc28efd1e tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:01:59.766986 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-768112b1-fd06-4676-85b5-865cc28efd1e tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:01:59.767618 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-768112b1-fd06-4676-85b5-865cc28efd1e tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:01:59.940880 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-768112b1-fd06-4676-85b5-865cc28efd1e tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632904331d024d9b8e4d3660dff2cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ed0bdee3aa4013bd9219069bda558c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:01:59.954061 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-768112b1-fd06-4676-85b5-865cc28efd1e tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] 10.222.0.58 "GET /compute/v2.1/servers/8e91f1ac-f79d-4ab0-aa13-ea32b0e74888" status: 200 len: 1718 microversion: 2.1 time: 0.203382 Aug 10 23:01:59.955360 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 714/1448] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:01:59 2022] GET /compute/v2.1/servers/8e91f1ac-f79d-4ab0-aa13-ea32b0e74888 => generated 1718 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:01:59.960242 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-0b9788ab-fa5b-4b59-96e6-4ebc871a4e33 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Calling method '.version_select at 0x7f847d055550>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:00.010819 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-0b9788ab-fa5b-4b59-96e6-4ebc871a4e33 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] 10.222.0.58 "GET /compute/v2.1/images/aa11c27d-647b-4b9d-bf80-610d7dd4a8b2" status: 200 len: 1414 microversion: 2.1 time: 0.054058 Aug 10 23:02:00.011516 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 715/1449] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 10 23:01:59 2022] GET /compute/v2.1/images/aa11c27d-647b-4b9d-bf80-610d7dd4a8b2 => generated 1414 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:02:00.017204 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-025390c6-201c-462c-af8c-33309610a9c1 tempest-VolumesNegativeTest-49330106 tempest-VolumesNegativeTest-49330106-project] Calling method '.version_select at 0x7f847d023d30>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:00.049771 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-025390c6-201c-462c-af8c-33309610a9c1 tempest-VolumesNegativeTest-49330106 tempest-VolumesNegativeTest-49330106-project] HTTP exception thrown: Volume tempest-invalid-148387826 could not be found. Aug 10 23:02:00.052006 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-025390c6-201c-462c-af8c-33309610a9c1 tempest-VolumesNegativeTest-49330106 tempest-VolumesNegativeTest-49330106-project] Request method failure captured: Aug 10 23:02:00.052006 n-d-850468-14 devstack@n-api.service[122632]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-148387826 HTTP/1.1 Aug 10 23:02:00.052006 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:02:00.052006 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:02:00.052006 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:02:00.052006 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 23:02:00.052006 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:02:00.052006 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:02:00.052006 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:02:00.052006 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:02:00.052006 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9DjmxjXgvb-riFDbj8RrcVJnE5X-H0pfPr_e0MsRj6cq5qbwUv3TUb3lXNUmFwLyN61rImyerDMf9ghPLIGDKAw2XYK4ka6msnGWpipdhh2wC4bcbe3M-tVhfGCfaEZuV0uO6pn7u1tIDD-WzTZkGJl9eQfi4CW3bwaCgKpVKoD6RHg Aug 10 23:02:00.052006 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:02:00.052006 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:02:00.052006 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:02:00.052006 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:02:00.052006 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:02:00.052006 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:02:00.052006 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 6fad6a9aa56b4ae1b7185b08af9dcadc Aug 10 23:02:00.052006 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-VolumesNegativeTest-49330106 Aug 10 23:02:00.052006 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:02:00.052006 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:02:00.053607 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6fad6a9aa56b4ae1b7185b08af9dcadc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6fad6a9aa56b4ae1b7185b08af9dcadc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/6fad6a9aa56b4ae1b7185b08af9dcadc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_6fad6a9aa56b4ae1b7185b08af9dcadc", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:02:00.053607 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-VolumesNegativeTest-49330106 Aug 10 23:02:00.053607 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 6fad6a9aa56b4ae1b7185b08af9dcadc Aug 10 23:02:00.053607 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-VolumesNegativeTest-49330106 Aug 10 23:02:00.053607 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-VolumesNegativeTest-49330106-project Aug 10 23:02:00.053607 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:02:00.053607 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:02:00.053607 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: 81ff989d8ba842658925965c9710a134 Aug 10 23:02:00.053607 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-VolumesNegativeTest-49330106-project Aug 10 23:02:00.053607 n-d-850468-14 devstack@n-api.service[122632]: method: Aug 10 23:02:00.053607 n-d-850468-14 devstack@n-api.service[122632]: exception: Volume tempest-invalid-148387826 could not be found. Aug 10 23:02:00.053607 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': 'tempest-invalid-148387826'} Aug 10 23:02:00.053607 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:02:00.059350 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:02:00.059350 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 23:02:00.059350 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 23:02:00.059350 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 10 23:02:00.059350 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 10 23:02:00.059350 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 10 23:02:00.059350 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 10 23:02:00.059350 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 10 23:02:00.059350 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 10 23:02:00.059350 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 10 23:02:00.059350 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 10 23:02:00.059350 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 23:02:00.059350 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 23:02:00.059350 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 23:02:00.059350 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 23:02:00.059350 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-148387826 could not be found. (HTTP 404) (Request-ID: req-6d8f68d0-32b4-45fa-ac2b-cf968afa1a36) Aug 10 23:02:00.059350 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:02:00.059350 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:02:00.059350 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:02:00.061042 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:02:00.061042 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 10 23:02:00.061042 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 10 23:02:00.061042 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 10 23:02:00.061042 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 10 23:02:00.061042 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 10 23:02:00.061042 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 10 23:02:00.061042 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 10 23:02:00.061042 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 10 23:02:00.061042 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 23:02:00.061042 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 23:02:00.061042 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 10 23:02:00.061042 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 10 23:02:00.061042 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 10 23:02:00.061042 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 10 23:02:00.061042 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 10 23:02:00.061042 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 10 23:02:00.061042 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 10 23:02:00.061042 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 10 23:02:00.062493 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 23:02:00.062493 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 23:02:00.062493 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 23:02:00.062493 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 23:02:00.062493 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-148387826 could not be found. Aug 10 23:02:00.062493 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:02:00.062493 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:02:00.062493 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:02:00.062493 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:02:00.062493 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:02:00.062493 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:02:00.062493 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:02:00.062493 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:02:00.062493 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 23:02:00.062493 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 23:02:00.062493 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:02:00.062493 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:02:00.062493 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 10 23:02:00.062493 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:02:00.062493 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-148387826 could not be found. Aug 10 23:02:00.064200 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:02:00.064200 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:02:00.064200 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:02:00.064200 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:02:00.064200 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:02:00.064200 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:02:00.064200 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:02:00.064200 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:02:00.064200 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-148387826 could not be found. Aug 10 23:02:00.064200 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:02:00.064200 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-025390c6-201c-462c-af8c-33309610a9c1 tempest-VolumesNegativeTest-49330106 tempest-VolumesNegativeTest-49330106-project] Returning 404 to user: Volume tempest-invalid-148387826 could not be found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:02:00.064200 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-025390c6-201c-462c-af8c-33309610a9c1 tempest-VolumesNegativeTest-49330106 tempest-VolumesNegativeTest-49330106-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/tempest-invalid-148387826" status: 404 len: 98 microversion: 2.1 time: 0.040847 Aug 10 23:02:00.064200 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 716/1450] 10.222.0.58 () {58 vars in 1215 bytes} [Wed Aug 10 23:02:00 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-148387826 => generated 98 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 10 23:02:00.065233 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-f48ec33a-5a2d-4694-bff1-13962e2ee93e tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Calling method '.version_select at 0x7f847d174b80>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:00.201988 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-f48ec33a-5a2d-4694-bff1-13962e2ee93e tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] 10.222.0.58 "DELETE /compute/v2.1/images/aa11c27d-647b-4b9d-bf80-610d7dd4a8b2" status: 204 len: 0 microversion: 2.1 time: 0.147001 Aug 10 23:02:00.202559 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 717/1451] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:02:00 2022] DELETE /compute/v2.1/images/aa11c27d-647b-4b9d-bf80-610d7dd4a8b2 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:02:00.209466 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-3453ad19-80e3-43d4-bcc5-6381e99bdf33 tempest-VolumesNegativeTest-49330106 tempest-VolumesNegativeTest-49330106-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005674 Aug 10 23:02:00.214405 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 718/1452] 10.222.0.58 () {58 vars in 1140 bytes} [Wed Aug 10 23:02:00 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 11 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 10 23:02:00.220732 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-15ac3d63-5d5a-47f2-82e9-e4ad1ec99f61 tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:00.221346 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-15ac3d63-5d5a-47f2-82e9-e4ad1ec99f61 tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] [instance: 38d1e924-eaea-449b-9724-1d2b16fcdfbc] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:02:00.227958 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-15ac3d63-5d5a-47f2-82e9-e4ad1ec99f61 tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:00.228437 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-15ac3d63-5d5a-47f2-82e9-e4ad1ec99f61 tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:00.229090 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-15ac3d63-5d5a-47f2-82e9-e4ad1ec99f61 tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:00.230115 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-15ac3d63-5d5a-47f2-82e9-e4ad1ec99f61 tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:00.231359 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-15ac3d63-5d5a-47f2-82e9-e4ad1ec99f61 tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:00.232144 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-15ac3d63-5d5a-47f2-82e9-e4ad1ec99f61 tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:00.303874 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-86631533-87bc-4d33-b2e4-1d627ba72da7 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:02:00.314188 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-86631533-87bc-4d33-b2e4-1d627ba72da7 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:02:00.316145 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-86631533-87bc-4d33-b2e4-1d627ba72da7 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:02:00.317577 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-86631533-87bc-4d33-b2e4-1d627ba72da7 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] 10.222.0.58 "GET /compute/v2.1/servers/3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51" status: 200 len: 1280 microversion: 2.25 time: 0.808959 Aug 10 23:02:00.319762 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 735/1453] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:01:59 2022] GET /compute/v2.1/servers/3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51 => generated 1280 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:02:00.325561 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-fc6aa433-ca2a-4754-864a-b8bf6e7790e5 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Calling method '.version_select at 0x7f847d075ca0>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:00.375162 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-fc6aa433-ca2a-4754-864a-b8bf6e7790e5 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] HTTP exception thrown: Image not found. Aug 10 23:02:00.377517 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-fc6aa433-ca2a-4754-864a-b8bf6e7790e5 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Request method failure captured: Aug 10 23:02:00.377517 n-d-850468-14 devstack@n-api.service[122633]: request: GET /compute/v2.1/images/aa11c27d-647b-4b9d-bf80-610d7dd4a8b2 HTTP/1.1 Aug 10 23:02:00.377517 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:02:00.377517 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:02:00.377517 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:02:00.377517 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:02:00.377517 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:02:00.377517 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:02:00.377517 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:02:00.377517 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:02:00.377517 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9DgG869H1c8f0vbp0V7En7JFi_WIaXbrI3LJGQVZ9CZJGJ5tE0ttFDP0GLvV2QyQzFa98JnG3z8rMrapcPk2Wv2xg0AdGD-P9jDChgdbhVmmNjfdSCAmAgD2r7Z3NIqXzHov-GWhvIwwFP3ghOFWaMRMeNNOk3SIjTZY-cSRl1BQNss Aug 10 23:02:00.377517 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:02:00.377517 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:02:00.377517 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:02:00.377517 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:02:00.377517 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:02:00.377517 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:02:00.377517 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 307ab95daa034afbb31f90626885072b Aug 10 23:02:00.377517 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-ImagesTestJSON-1761176174 Aug 10 23:02:00.377517 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:02:00.377517 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:02:00.379284 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/307ab95daa034afbb31f90626885072b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/307ab95daa034afbb31f90626885072b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/307ab95daa034afbb31f90626885072b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_307ab95daa034afbb31f90626885072b", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:02:00.379284 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-ImagesTestJSON-1761176174 Aug 10 23:02:00.379284 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 307ab95daa034afbb31f90626885072b Aug 10 23:02:00.379284 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-ImagesTestJSON-1761176174 Aug 10 23:02:00.379284 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-ImagesTestJSON-1761176174-project Aug 10 23:02:00.379284 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:02:00.379284 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:02:00.379284 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 7d6d9806b6724e5aaf8c69be8e70d4f3 Aug 10 23:02:00.379284 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-ImagesTestJSON-1761176174-project Aug 10 23:02:00.379284 n-d-850468-14 devstack@n-api.service[122633]: method: Aug 10 23:02:00.379284 n-d-850468-14 devstack@n-api.service[122633]: exception: Image not found. Aug 10 23:02:00.379284 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': 'aa11c27d-647b-4b9d-bf80-610d7dd4a8b2'} Aug 10 23:02:00.379284 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:02:00.379284 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:02:00.380567 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 10 23:02:00.380567 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 10 23:02:00.380567 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 10 23:02:00.380567 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 10 23:02:00.380567 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 10 23:02:00.380567 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 10 23:02:00.380567 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 10 23:02:00.380567 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 10 23:02:00.380567 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 10 23:02:00.380567 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 10 23:02:00.380567 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 10 23:02:00.380567 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 10 23:02:00.380567 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 10 23:02:00.380567 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 10 23:02:00.380567 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 10 23:02:00.380567 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 10 23:02:00.380567 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID aa11c27d-647b-4b9d-bf80-610d7dd4a8b2 Aug 10 23:02:00.380567 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:02:00.382005 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:02:00.382005 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:02:00.382005 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:02:00.382005 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Aug 10 23:02:00.382005 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Aug 10 23:02:00.382005 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 10 23:02:00.382005 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 10 23:02:00.382005 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 10 23:02:00.382005 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 10 23:02:00.382005 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 10 23:02:00.382005 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 10 23:02:00.382005 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 10 23:02:00.382005 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 10 23:02:00.382005 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 10 23:02:00.382005 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 10 23:02:00.382005 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 10 23:02:00.382005 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 10 23:02:00.382005 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 10 23:02:00.382005 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 10 23:02:00.383567 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 10 23:02:00.383567 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 10 23:02:00.383567 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 10 23:02:00.383567 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 10 23:02:00.383567 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 10 23:02:00.383567 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 10 23:02:00.383567 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 10 23:02:00.383567 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 10 23:02:00.383567 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image aa11c27d-647b-4b9d-bf80-610d7dd4a8b2 could not be found. Aug 10 23:02:00.383567 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:02:00.383567 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:02:00.383567 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:02:00.383567 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:02:00.383567 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:02:00.383567 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:02:00.383567 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:02:00.383567 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:02:00.383567 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 23:02:00.383567 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 23:02:00.385060 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:02:00.385060 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:02:00.385060 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Aug 10 23:02:00.385060 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 10 23:02:00.385060 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 10 23:02:00.385060 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:02:00.385060 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:02:00.385060 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:02:00.385060 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:02:00.385060 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:02:00.385060 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:02:00.385060 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:02:00.385060 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:02:00.385060 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 10 23:02:00.385060 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:02:00.385060 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-fc6aa433-ca2a-4754-864a-b8bf6e7790e5 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Returning 404 to user: Image not found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:02:00.387805 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-fc6aa433-ca2a-4754-864a-b8bf6e7790e5 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] 10.222.0.58 "GET /compute/v2.1/images/aa11c27d-647b-4b9d-bf80-610d7dd4a8b2" status: 404 len: 62 microversion: 2.1 time: 0.062207 Aug 10 23:02:00.390502 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 736/1454] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 10 23:02:00 2022] GET /compute/v2.1/images/aa11c27d-647b-4b9d-bf80-610d7dd4a8b2 => generated 62 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 10 23:02:00.399484 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-362e5fb1-9bc3-4711-a100-b4b2290ca929 tempest-VolumesNegativeTest-49330106 tempest-VolumesNegativeTest-49330106-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.007694 Aug 10 23:02:00.401540 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 737/1455] 10.222.0.58 () {58 vars in 1137 bytes} [Wed Aug 10 23:02:00 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 10 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 10 23:02:00.416468 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-55359ebb-9867-4a23-817f-cfd72e1706de tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:00.418560 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-55359ebb-9867-4a23-817f-cfd72e1706de tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] [instance: 1af4c3de-2464-45c7-a088-a3db68a67cb6] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:02:00.431670 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-55359ebb-9867-4a23-817f-cfd72e1706de tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:00.432318 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-55359ebb-9867-4a23-817f-cfd72e1706de tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:00.432862 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-55359ebb-9867-4a23-817f-cfd72e1706de tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:00.434180 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-55359ebb-9867-4a23-817f-cfd72e1706de tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:00.434604 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-55359ebb-9867-4a23-817f-cfd72e1706de tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:00.435199 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-55359ebb-9867-4a23-817f-cfd72e1706de tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:00.464693 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-15ac3d63-5d5a-47f2-82e9-e4ad1ec99f61 tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb4dc460d3b4bb1a20a45d27d524cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701fe4c2829c4ef4a748cfe83d84294f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:02:00.477235 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-15ac3d63-5d5a-47f2-82e9-e4ad1ec99f61 tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] 10.222.0.58 "GET /compute/v2.1/servers/38d1e924-eaea-449b-9724-1d2b16fcdfbc" status: 200 len: 1317 microversion: 2.1 time: 0.260352 Aug 10 23:02:00.480217 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 719/1456] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:02:00 2022] GET /compute/v2.1/servers/38d1e924-eaea-449b-9724-1d2b16fcdfbc => generated 1317 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:02:00.490673 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-775419ee-602b-45e6-b087-560436212841 tempest-VolumesNegativeTest-49330106 tempest-VolumesNegativeTest-49330106-project] Calling method '.version_select at 0x7f847d208670>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:00.542828 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-775419ee-602b-45e6-b087-560436212841 tempest-VolumesNegativeTest-49330106 tempest-VolumesNegativeTest-49330106-project] HTTP exception thrown: Volume bb70bdce-6bab-4baf-b06b-4ca1f9a9f5fe could not be found. Aug 10 23:02:00.545915 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-775419ee-602b-45e6-b087-560436212841 tempest-VolumesNegativeTest-49330106 tempest-VolumesNegativeTest-49330106-project] Request method failure captured: Aug 10 23:02:00.545915 n-d-850468-14 devstack@n-api.service[122632]: request: DELETE /compute/v2.1/os-volumes/bb70bdce-6bab-4baf-b06b-4ca1f9a9f5fe HTTP/1.1 Aug 10 23:02:00.545915 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:02:00.545915 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:02:00.545915 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:02:00.545915 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 23:02:00.545915 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:02:00.545915 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:02:00.545915 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:02:00.545915 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:02:00.545915 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9DjmxjXgvb-riFDbj8RrcVJnE5X-H0pfPr_e0MsRj6cq5qbwUv3TUb3lXNUmFwLyN61rImyerDMf9ghPLIGDKAw2XYK4ka6msnGWpipdhh2wC4bcbe3M-tVhfGCfaEZuV0uO6pn7u1tIDD-WzTZkGJl9eQfi4CW3bwaCgKpVKoD6RHg Aug 10 23:02:00.545915 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:02:00.545915 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:02:00.545915 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:02:00.545915 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:02:00.545915 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:02:00.545915 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:02:00.545915 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 6fad6a9aa56b4ae1b7185b08af9dcadc Aug 10 23:02:00.545915 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-VolumesNegativeTest-49330106 Aug 10 23:02:00.545915 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:02:00.545915 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:02:00.547343 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6fad6a9aa56b4ae1b7185b08af9dcadc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6fad6a9aa56b4ae1b7185b08af9dcadc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/6fad6a9aa56b4ae1b7185b08af9dcadc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_6fad6a9aa56b4ae1b7185b08af9dcadc", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:02:00.547343 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-VolumesNegativeTest-49330106 Aug 10 23:02:00.547343 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 6fad6a9aa56b4ae1b7185b08af9dcadc Aug 10 23:02:00.547343 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-VolumesNegativeTest-49330106 Aug 10 23:02:00.547343 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-VolumesNegativeTest-49330106-project Aug 10 23:02:00.547343 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:02:00.547343 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:02:00.547343 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: 81ff989d8ba842658925965c9710a134 Aug 10 23:02:00.547343 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-VolumesNegativeTest-49330106-project Aug 10 23:02:00.547343 n-d-850468-14 devstack@n-api.service[122632]: method: Aug 10 23:02:00.547343 n-d-850468-14 devstack@n-api.service[122632]: exception: Volume bb70bdce-6bab-4baf-b06b-4ca1f9a9f5fe could not be found. Aug 10 23:02:00.547343 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': 'bb70bdce-6bab-4baf-b06b-4ca1f9a9f5fe'} Aug 10 23:02:00.547343 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:02:00.548350 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:02:00.548350 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 23:02:00.548350 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 23:02:00.548350 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 10 23:02:00.548350 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 10 23:02:00.548350 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 10 23:02:00.548350 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 10 23:02:00.548350 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 10 23:02:00.548350 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 10 23:02:00.548350 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 10 23:02:00.548350 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 10 23:02:00.548350 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 23:02:00.548350 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 23:02:00.548350 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 23:02:00.548350 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 23:02:00.548350 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume bb70bdce-6bab-4baf-b06b-4ca1f9a9f5fe could not be found. (HTTP 404) (Request-ID: req-11a4082c-4878-4bb2-8b31-805919cce4c0) Aug 10 23:02:00.548350 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:02:00.548350 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:02:00.548350 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:02:00.549522 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:02:00.549522 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 10 23:02:00.549522 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 10 23:02:00.549522 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 10 23:02:00.549522 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 10 23:02:00.549522 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 10 23:02:00.549522 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 10 23:02:00.549522 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 10 23:02:00.549522 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 10 23:02:00.549522 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 23:02:00.549522 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 23:02:00.549522 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 10 23:02:00.549522 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 10 23:02:00.549522 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 10 23:02:00.549522 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 10 23:02:00.549522 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 10 23:02:00.549522 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 10 23:02:00.549522 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 10 23:02:00.549522 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 10 23:02:00.551711 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 23:02:00.551711 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 23:02:00.551711 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 23:02:00.551711 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 23:02:00.551711 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume bb70bdce-6bab-4baf-b06b-4ca1f9a9f5fe could not be found. Aug 10 23:02:00.551711 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:02:00.551711 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:02:00.551711 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:02:00.551711 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:02:00.551711 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:02:00.551711 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:02:00.551711 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:02:00.551711 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:02:00.551711 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 23:02:00.551711 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 23:02:00.551711 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:02:00.551711 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:02:00.551711 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 10 23:02:00.551711 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:02:00.556096 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume bb70bdce-6bab-4baf-b06b-4ca1f9a9f5fe could not be found. Aug 10 23:02:00.556096 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:02:00.556096 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:02:00.556096 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:02:00.556096 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:02:00.556096 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:02:00.556096 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:02:00.556096 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:02:00.556096 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:02:00.556096 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume bb70bdce-6bab-4baf-b06b-4ca1f9a9f5fe could not be found. Aug 10 23:02:00.556096 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:02:00.556096 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-775419ee-602b-45e6-b087-560436212841 tempest-VolumesNegativeTest-49330106 tempest-VolumesNegativeTest-49330106-project] Returning 404 to user: Volume bb70bdce-6bab-4baf-b06b-4ca1f9a9f5fe could not be found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:02:00.556096 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-775419ee-602b-45e6-b087-560436212841 tempest-VolumesNegativeTest-49330106 tempest-VolumesNegativeTest-49330106-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/bb70bdce-6bab-4baf-b06b-4ca1f9a9f5fe" status: 404 len: 109 microversion: 2.1 time: 0.064421 Aug 10 23:02:00.556096 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 720/1457] 10.222.0.58 () {58 vars in 1248 bytes} [Wed Aug 10 23:02:00 2022] DELETE /compute/v2.1/os-volumes/bb70bdce-6bab-4baf-b06b-4ca1f9a9f5fe => generated 109 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:02:00.566692 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-0e2141ba-b067-48f0-844b-5659b9414f1a tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:00.567148 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-0e2141ba-b067-48f0-844b-5659b9414f1a tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] [instance: 196377d7-c0d5-408b-9743-e1f451f71164] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:02:00.604753 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0e2141ba-b067-48f0-844b-5659b9414f1a tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:00.605088 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0e2141ba-b067-48f0-844b-5659b9414f1a tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:00.608030 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0e2141ba-b067-48f0-844b-5659b9414f1a tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:00.613544 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0e2141ba-b067-48f0-844b-5659b9414f1a tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:00.615546 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0e2141ba-b067-48f0-844b-5659b9414f1a tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:00.616208 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0e2141ba-b067-48f0-844b-5659b9414f1a tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:00.794215 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-55359ebb-9867-4a23-817f-cfd72e1706de tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6d9806b6724e5aaf8c69be8e70d4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307ab95daa034afbb31f90626885072b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:02:00.802627 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-55359ebb-9867-4a23-817f-cfd72e1706de tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] 10.222.0.58 "GET /compute/v2.1/servers/1af4c3de-2464-45c7-a088-a3db68a67cb6" status: 200 len: 1500 microversion: 2.1 time: 0.399790 Aug 10 23:02:00.803260 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 738/1458] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:02:00 2022] GET /compute/v2.1/servers/1af4c3de-2464-45c7-a088-a3db68a67cb6 => generated 1500 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:02:00.835887 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-ce20064d-5256-4fa3-a7ad-fd83aaf69df1 tempest-VolumesNegativeTest-49330106 tempest-VolumesNegativeTest-49330106-project] Calling method '.version_select at 0x7f847cf21040>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:00.876526 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-ce20064d-5256-4fa3-a7ad-fd83aaf69df1 tempest-VolumesNegativeTest-49330106 tempest-VolumesNegativeTest-49330106-project] HTTP exception thrown: Volume 260f367b-12a0-41e6-856d-0fc24fba145f could not be found. Aug 10 23:02:00.878495 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-ce20064d-5256-4fa3-a7ad-fd83aaf69df1 tempest-VolumesNegativeTest-49330106 tempest-VolumesNegativeTest-49330106-project] Request method failure captured: Aug 10 23:02:00.878495 n-d-850468-14 devstack@n-api.service[122633]: request: GET /compute/v2.1/os-volumes/260f367b-12a0-41e6-856d-0fc24fba145f HTTP/1.1 Aug 10 23:02:00.878495 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:02:00.878495 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:02:00.878495 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:02:00.878495 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:02:00.878495 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:02:00.878495 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:02:00.878495 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:02:00.878495 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:02:00.878495 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9DjmxjXgvb-riFDbj8RrcVJnE5X-H0pfPr_e0MsRj6cq5qbwUv3TUb3lXNUmFwLyN61rImyerDMf9ghPLIGDKAw2XYK4ka6msnGWpipdhh2wC4bcbe3M-tVhfGCfaEZuV0uO6pn7u1tIDD-WzTZkGJl9eQfi4CW3bwaCgKpVKoD6RHg Aug 10 23:02:00.878495 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:02:00.878495 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:02:00.878495 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:02:00.878495 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:02:00.878495 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:02:00.878495 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:02:00.878495 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 6fad6a9aa56b4ae1b7185b08af9dcadc Aug 10 23:02:00.878495 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-VolumesNegativeTest-49330106 Aug 10 23:02:00.878495 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:02:00.878495 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:02:00.880077 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6fad6a9aa56b4ae1b7185b08af9dcadc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6fad6a9aa56b4ae1b7185b08af9dcadc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/6fad6a9aa56b4ae1b7185b08af9dcadc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_6fad6a9aa56b4ae1b7185b08af9dcadc", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:02:00.880077 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-VolumesNegativeTest-49330106 Aug 10 23:02:00.880077 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 6fad6a9aa56b4ae1b7185b08af9dcadc Aug 10 23:02:00.880077 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-VolumesNegativeTest-49330106 Aug 10 23:02:00.880077 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-VolumesNegativeTest-49330106-project Aug 10 23:02:00.880077 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:02:00.880077 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:02:00.880077 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 81ff989d8ba842658925965c9710a134 Aug 10 23:02:00.880077 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-VolumesNegativeTest-49330106-project Aug 10 23:02:00.880077 n-d-850468-14 devstack@n-api.service[122633]: method: Aug 10 23:02:00.880077 n-d-850468-14 devstack@n-api.service[122633]: exception: Volume 260f367b-12a0-41e6-856d-0fc24fba145f could not be found. Aug 10 23:02:00.880077 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': '260f367b-12a0-41e6-856d-0fc24fba145f'} Aug 10 23:02:00.880077 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:02:00.880980 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:02:00.880980 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 23:02:00.880980 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 23:02:00.880980 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 10 23:02:00.880980 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 10 23:02:00.880980 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 10 23:02:00.880980 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 10 23:02:00.880980 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 10 23:02:00.880980 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 10 23:02:00.880980 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 10 23:02:00.880980 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 10 23:02:00.880980 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 23:02:00.880980 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 23:02:00.880980 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 23:02:00.880980 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 23:02:00.880980 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 260f367b-12a0-41e6-856d-0fc24fba145f could not be found. (HTTP 404) (Request-ID: req-ce65a5d2-a5f0-4aee-95b2-161b6b02a3f3) Aug 10 23:02:00.880980 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:02:00.880980 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:02:00.880980 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:02:00.883087 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:02:00.883087 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 10 23:02:00.883087 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 10 23:02:00.883087 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 10 23:02:00.883087 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 10 23:02:00.883087 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 10 23:02:00.883087 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 10 23:02:00.883087 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 10 23:02:00.883087 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 10 23:02:00.883087 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 23:02:00.883087 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 23:02:00.883087 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 10 23:02:00.883087 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 10 23:02:00.883087 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 10 23:02:00.883087 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 10 23:02:00.883087 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 10 23:02:00.883087 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 10 23:02:00.883087 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 10 23:02:00.883087 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 10 23:02:00.886101 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 23:02:00.886101 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 23:02:00.886101 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 23:02:00.886101 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 23:02:00.886101 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 260f367b-12a0-41e6-856d-0fc24fba145f could not be found. Aug 10 23:02:00.886101 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:02:00.886101 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:02:00.886101 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:02:00.886101 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:02:00.886101 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:02:00.886101 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:02:00.886101 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:02:00.886101 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:02:00.886101 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 23:02:00.886101 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 23:02:00.886101 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:02:00.886101 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:02:00.886101 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 10 23:02:00.886101 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:02:00.889817 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 260f367b-12a0-41e6-856d-0fc24fba145f could not be found. Aug 10 23:02:00.889817 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:02:00.889817 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:02:00.889817 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:02:00.889817 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:02:00.889817 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:02:00.889817 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:02:00.889817 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:02:00.889817 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:02:00.889817 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 260f367b-12a0-41e6-856d-0fc24fba145f could not be found. Aug 10 23:02:00.889817 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:02:00.889817 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-ce20064d-5256-4fa3-a7ad-fd83aaf69df1 tempest-VolumesNegativeTest-49330106 tempest-VolumesNegativeTest-49330106-project] Returning 404 to user: Volume 260f367b-12a0-41e6-856d-0fc24fba145f could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:02:00.889817 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-ce20064d-5256-4fa3-a7ad-fd83aaf69df1 tempest-VolumesNegativeTest-49330106 tempest-VolumesNegativeTest-49330106-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/260f367b-12a0-41e6-856d-0fc24fba145f" status: 404 len: 109 microversion: 2.1 time: 0.052136 Aug 10 23:02:00.889817 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 739/1459] 10.222.0.58 () {58 vars in 1245 bytes} [Wed Aug 10 23:02:00 2022] GET /compute/v2.1/os-volumes/260f367b-12a0-41e6-856d-0fc24fba145f => generated 109 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:02:00.895180 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-7ad7f7cd-e923-4c7e-b6f6-326927d243ac tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:00.905803 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-7ad7f7cd-e923-4c7e-b6f6-326927d243ac tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 0dabc2bf-08ff-45b5-a791-34d655349eae] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:02:00.920852 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7ad7f7cd-e923-4c7e-b6f6-326927d243ac tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:00.925039 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7ad7f7cd-e923-4c7e-b6f6-326927d243ac tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:00.925675 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7ad7f7cd-e923-4c7e-b6f6-326927d243ac tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:00.928349 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7ad7f7cd-e923-4c7e-b6f6-326927d243ac tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:00.931423 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7ad7f7cd-e923-4c7e-b6f6-326927d243ac tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:00.934658 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7ad7f7cd-e923-4c7e-b6f6-326927d243ac tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:00.978114 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-0e2141ba-b067-48f0-844b-5659b9414f1a tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '417d4eaaeb1c4df78745496ececb3e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27e6ee9495a438b8450a4ef0d62cbcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:02:00.992557 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-0e2141ba-b067-48f0-844b-5659b9414f1a tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] 10.222.0.58 "GET /compute/v2.1/servers/196377d7-c0d5-408b-9743-e1f451f71164" status: 200 len: 1317 microversion: 2.1 time: 0.436056 Aug 10 23:02:00.993132 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 721/1460] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:02:00 2022] GET /compute/v2.1/servers/196377d7-c0d5-408b-9743-e1f451f71164 => generated 1317 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:02:01.004464 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-255667b2-6207-4176-9a6c-fdb8250cfc2f req-22285682-56c2-4c8b-92e9-60d078674242 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38d1e924-eaea-449b-9724-1d2b16fcdfbc", "name": "network-vif-plugged", "status": "completed", "tag": "6456c6d8-67cf-4eb9-a700-b8d5398267d5"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:02:01.031371 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-255667b2-6207-4176-9a6c-fdb8250cfc2f req-22285682-56c2-4c8b-92e9-60d078674242 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:01.032608 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-255667b2-6207-4176-9a6c-fdb8250cfc2f req-22285682-56c2-4c8b-92e9-60d078674242 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:01.033819 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-255667b2-6207-4176-9a6c-fdb8250cfc2f req-22285682-56c2-4c8b-92e9-60d078674242 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:01.052469 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-255667b2-6207-4176-9a6c-fdb8250cfc2f req-22285682-56c2-4c8b-92e9-60d078674242 service nova] Creating event network-vif-plugged:6456c6d8-67cf-4eb9-a700-b8d5398267d5 for instance 38d1e924-eaea-449b-9724-1d2b16fcdfbc on n-h1-850468-14 Aug 10 23:02:01.060715 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-255667b2-6207-4176-9a6c-fdb8250cfc2f req-22285682-56c2-4c8b-92e9-60d078674242 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066118 Aug 10 23:02:01.061419 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 722/1461] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:02:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:02:01.077144 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-b1920273-edde-4996-947b-87f0f46f6e37 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:01.077923 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-b1920273-edde-4996-947b-87f0f46f6e37 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] [instance: 8e91f1ac-f79d-4ab0-aa13-ea32b0e74888] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:02:01.107072 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b1920273-edde-4996-947b-87f0f46f6e37 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:01.107647 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b1920273-edde-4996-947b-87f0f46f6e37 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:01.108096 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b1920273-edde-4996-947b-87f0f46f6e37 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:01.109265 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b1920273-edde-4996-947b-87f0f46f6e37 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:01.109879 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b1920273-edde-4996-947b-87f0f46f6e37 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:01.111251 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b1920273-edde-4996-947b-87f0f46f6e37 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:01.573064 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-7ad7f7cd-e923-4c7e-b6f6-326927d243ac tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:02:01.586932 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-7ad7f7cd-e923-4c7e-b6f6-326927d243ac tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/0dabc2bf-08ff-45b5-a791-34d655349eae" status: 200 len: 1468 microversion: 2.1 time: 0.701930 Aug 10 23:02:01.588706 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 740/1462] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:02:00 2022] GET /compute/v2.1/servers/0dabc2bf-08ff-45b5-a791-34d655349eae => generated 1468 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:02:01.602144 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-7ffacff6-c315-46c0-a526-a63e7660094b tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:01.602986 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-7ffacff6-c315-46c0-a526-a63e7660094b tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] [instance: 3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:02:01.613385 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-b1920273-edde-4996-947b-87f0f46f6e37 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632904331d024d9b8e4d3660dff2cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ed0bdee3aa4013bd9219069bda558c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:02:01.615981 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7ffacff6-c315-46c0-a526-a63e7660094b tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:01.619330 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7ffacff6-c315-46c0-a526-a63e7660094b tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:01.621119 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7ffacff6-c315-46c0-a526-a63e7660094b tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:01.624305 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7ffacff6-c315-46c0-a526-a63e7660094b tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:01.625362 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7ffacff6-c315-46c0-a526-a63e7660094b tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:01.625985 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7ffacff6-c315-46c0-a526-a63e7660094b tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:01.630010 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-b1920273-edde-4996-947b-87f0f46f6e37 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] 10.222.0.58 "GET /compute/v2.1/servers/8e91f1ac-f79d-4ab0-aa13-ea32b0e74888" status: 200 len: 1718 microversion: 2.1 time: 0.565475 Aug 10 23:02:01.638008 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 723/1463] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:02:01 2022] GET /compute/v2.1/servers/8e91f1ac-f79d-4ab0-aa13-ea32b0e74888 => generated 1718 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:02:01.654665 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-f1e6faed-9a4c-44c7-99ea-23f10d03cd43 tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:01.655444 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-f1e6faed-9a4c-44c7-99ea-23f10d03cd43 tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] [instance: 38d1e924-eaea-449b-9724-1d2b16fcdfbc] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:02:01.671792 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f1e6faed-9a4c-44c7-99ea-23f10d03cd43 tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:01.676393 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f1e6faed-9a4c-44c7-99ea-23f10d03cd43 tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:01.677212 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f1e6faed-9a4c-44c7-99ea-23f10d03cd43 tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:01.678369 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f1e6faed-9a4c-44c7-99ea-23f10d03cd43 tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:01.680437 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f1e6faed-9a4c-44c7-99ea-23f10d03cd43 tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:01.684307 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f1e6faed-9a4c-44c7-99ea-23f10d03cd43 tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:01.952603 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-7ffacff6-c315-46c0-a526-a63e7660094b tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:02:01.961508 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-7ffacff6-c315-46c0-a526-a63e7660094b tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:02:01.963573 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-7ffacff6-c315-46c0-a526-a63e7660094b tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:02:01.965141 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-7ffacff6-c315-46c0-a526-a63e7660094b tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] 10.222.0.58 "GET /compute/v2.1/servers/3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51" status: 200 len: 1280 microversion: 2.25 time: 0.374048 Aug 10 23:02:01.979643 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 741/1464] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:02:01 2022] GET /compute/v2.1/servers/3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51 => generated 1280 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:02:01.987374 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-ea842821-fd7d-42f1-8cc1-e310a31409e4 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:01.988661 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-ea842821-fd7d-42f1-8cc1-e310a31409e4 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] [instance: 1af4c3de-2464-45c7-a088-a3db68a67cb6] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:02:01.995051 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ea842821-fd7d-42f1-8cc1-e310a31409e4 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:01.995993 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ea842821-fd7d-42f1-8cc1-e310a31409e4 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:01.996751 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ea842821-fd7d-42f1-8cc1-e310a31409e4 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:01.997794 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ea842821-fd7d-42f1-8cc1-e310a31409e4 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:01.998481 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ea842821-fd7d-42f1-8cc1-e310a31409e4 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:01.999162 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ea842821-fd7d-42f1-8cc1-e310a31409e4 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:01.999284 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-f1e6faed-9a4c-44c7-99ea-23f10d03cd43 tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb4dc460d3b4bb1a20a45d27d524cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701fe4c2829c4ef4a748cfe83d84294f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:02:02.014321 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-f1e6faed-9a4c-44c7-99ea-23f10d03cd43 tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] 10.222.0.58 "GET /compute/v2.1/servers/38d1e924-eaea-449b-9724-1d2b16fcdfbc" status: 200 len: 1317 microversion: 2.1 time: 0.374965 Aug 10 23:02:02.031378 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 724/1465] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:02:01 2022] GET /compute/v2.1/servers/38d1e924-eaea-449b-9724-1d2b16fcdfbc => generated 1317 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:02:02.036917 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-f548954e-6f58-462f-a8cd-ea0ab0fdc16f tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:02.037900 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-f548954e-6f58-462f-a8cd-ea0ab0fdc16f tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] [instance: 196377d7-c0d5-408b-9743-e1f451f71164] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:02:02.045298 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f548954e-6f58-462f-a8cd-ea0ab0fdc16f tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:02.046128 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f548954e-6f58-462f-a8cd-ea0ab0fdc16f tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:02.046854 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f548954e-6f58-462f-a8cd-ea0ab0fdc16f tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:02.047792 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f548954e-6f58-462f-a8cd-ea0ab0fdc16f tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:02.048643 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f548954e-6f58-462f-a8cd-ea0ab0fdc16f tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:02.049289 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f548954e-6f58-462f-a8cd-ea0ab0fdc16f tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:02.327419 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-f548954e-6f58-462f-a8cd-ea0ab0fdc16f tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '417d4eaaeb1c4df78745496ececb3e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27e6ee9495a438b8450a4ef0d62cbcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:02:02.339156 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-f548954e-6f58-462f-a8cd-ea0ab0fdc16f tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] 10.222.0.58 "GET /compute/v2.1/servers/196377d7-c0d5-408b-9743-e1f451f71164" status: 200 len: 1317 microversion: 2.1 time: 0.305852 Aug 10 23:02:02.339747 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 725/1466] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:02:02 2022] GET /compute/v2.1/servers/196377d7-c0d5-408b-9743-e1f451f71164 => generated 1317 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:02:02.360380 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-ea842821-fd7d-42f1-8cc1-e310a31409e4 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6d9806b6724e5aaf8c69be8e70d4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307ab95daa034afbb31f90626885072b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:02:02.369866 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-ea842821-fd7d-42f1-8cc1-e310a31409e4 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] 10.222.0.58 "GET /compute/v2.1/servers/1af4c3de-2464-45c7-a088-a3db68a67cb6" status: 200 len: 1506 microversion: 2.1 time: 0.388718 Aug 10 23:02:02.372049 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 742/1467] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:02:01 2022] GET /compute/v2.1/servers/1af4c3de-2464-45c7-a088-a3db68a67cb6 => generated 1506 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:02:02.390722 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-3d9e82c3-f47f-4cce-a6f3-5250760dbf80 req-02c63964-cac6-4641-8135-bac2b3eacd2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0dabc2bf-08ff-45b5-a791-34d655349eae", "name": "network-vif-deleted", "tag": "8dba1a8f-5d05-48a3-afda-7507568fcb46"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:02:02.406568 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-3d9e82c3-f47f-4cce-a6f3-5250760dbf80 req-02c63964-cac6-4641-8135-bac2b3eacd2e service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:02.407349 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-3d9e82c3-f47f-4cce-a6f3-5250760dbf80 req-02c63964-cac6-4641-8135-bac2b3eacd2e service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:02.408020 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-3d9e82c3-f47f-4cce-a6f3-5250760dbf80 req-02c63964-cac6-4641-8135-bac2b3eacd2e service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:02.425273 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-3d9e82c3-f47f-4cce-a6f3-5250760dbf80 req-02c63964-cac6-4641-8135-bac2b3eacd2e service nova] Creating event network-vif-deleted:8dba1a8f-5d05-48a3-afda-7507568fcb46 for instance 0dabc2bf-08ff-45b5-a791-34d655349eae on n-h2-850468-14 Aug 10 23:02:02.431532 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-3d9e82c3-f47f-4cce-a6f3-5250760dbf80 req-02c63964-cac6-4641-8135-bac2b3eacd2e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044912 Aug 10 23:02:02.432685 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 726/1468] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:02:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:02:02.612078 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-168383ed-0247-40f7-b75d-6d3d973a8412 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:02.612703 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-168383ed-0247-40f7-b75d-6d3d973a8412 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 0dabc2bf-08ff-45b5-a791-34d655349eae] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:02:02.624578 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-168383ed-0247-40f7-b75d-6d3d973a8412 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:02.625184 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-168383ed-0247-40f7-b75d-6d3d973a8412 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:02.631199 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-168383ed-0247-40f7-b75d-6d3d973a8412 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:02.633302 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-168383ed-0247-40f7-b75d-6d3d973a8412 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:02.634366 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-168383ed-0247-40f7-b75d-6d3d973a8412 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:02.635557 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-168383ed-0247-40f7-b75d-6d3d973a8412 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:02.670137 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-46ac88ab-22fc-4909-9817-9d968cb13148 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:02.673309 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-46ac88ab-22fc-4909-9817-9d968cb13148 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] [instance: 8e91f1ac-f79d-4ab0-aa13-ea32b0e74888] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:02:02.703617 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-46ac88ab-22fc-4909-9817-9d968cb13148 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:02.704863 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-46ac88ab-22fc-4909-9817-9d968cb13148 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:02.712610 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-46ac88ab-22fc-4909-9817-9d968cb13148 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:02.715441 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-46ac88ab-22fc-4909-9817-9d968cb13148 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:02.717604 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-46ac88ab-22fc-4909-9817-9d968cb13148 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:02.718756 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-46ac88ab-22fc-4909-9817-9d968cb13148 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:02.720732 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-168383ed-0247-40f7-b75d-6d3d973a8412 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:02.723426 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-168383ed-0247-40f7-b75d-6d3d973a8412 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:02.723912 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-168383ed-0247-40f7-b75d-6d3d973a8412 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:02.724436 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.objects.instance [None req-168383ed-0247-40f7-b75d-6d3d973a8412 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lazy-loading 'fault' on Instance uuid 0dabc2bf-08ff-45b5-a791-34d655349eae {{(pid=122633) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:02:02.898819 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-168383ed-0247-40f7-b75d-6d3d973a8412 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:02:02.909312 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-168383ed-0247-40f7-b75d-6d3d973a8412 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/0dabc2bf-08ff-45b5-a791-34d655349eae" status: 200 len: 1302 microversion: 2.1 time: 0.303536 Aug 10 23:02:02.913950 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 743/1469] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:02:02 2022] GET /compute/v2.1/servers/0dabc2bf-08ff-45b5-a791-34d655349eae => generated 1302 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:02:02.991816 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-222dad0d-b869-4693-b300-be7d5c8a3a9c tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:02.992422 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-222dad0d-b869-4693-b300-be7d5c8a3a9c tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] [instance: 3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:02:03.007002 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-222dad0d-b869-4693-b300-be7d5c8a3a9c tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:03.015526 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-222dad0d-b869-4693-b300-be7d5c8a3a9c tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:03.016288 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-222dad0d-b869-4693-b300-be7d5c8a3a9c tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:03.017296 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-222dad0d-b869-4693-b300-be7d5c8a3a9c tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:03.017926 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-222dad0d-b869-4693-b300-be7d5c8a3a9c tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:03.018551 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-222dad0d-b869-4693-b300-be7d5c8a3a9c tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:03.023415 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-46ac88ab-22fc-4909-9817-9d968cb13148 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632904331d024d9b8e4d3660dff2cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ed0bdee3aa4013bd9219069bda558c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:02:03.036701 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-46ac88ab-22fc-4909-9817-9d968cb13148 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] 10.222.0.58 "GET /compute/v2.1/servers/8e91f1ac-f79d-4ab0-aa13-ea32b0e74888" status: 200 len: 1718 microversion: 2.1 time: 0.382043 Aug 10 23:02:03.044403 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 727/1470] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:02:02 2022] GET /compute/v2.1/servers/8e91f1ac-f79d-4ab0-aa13-ea32b0e74888 => generated 1718 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:02:03.051036 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-16612dbc-2f04-4b7d-9ad6-41006f6d2536 tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:03.054878 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-16612dbc-2f04-4b7d-9ad6-41006f6d2536 tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] [instance: 38d1e924-eaea-449b-9724-1d2b16fcdfbc] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:02:03.071142 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-16612dbc-2f04-4b7d-9ad6-41006f6d2536 tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:03.087715 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-16612dbc-2f04-4b7d-9ad6-41006f6d2536 tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:03.092841 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-16612dbc-2f04-4b7d-9ad6-41006f6d2536 tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:03.095609 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-16612dbc-2f04-4b7d-9ad6-41006f6d2536 tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:03.099909 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-16612dbc-2f04-4b7d-9ad6-41006f6d2536 tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:03.100555 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-16612dbc-2f04-4b7d-9ad6-41006f6d2536 tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:03.381319 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-222dad0d-b869-4693-b300-be7d5c8a3a9c tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:02:03.402423 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-222dad0d-b869-4693-b300-be7d5c8a3a9c tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:02:03.404979 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-222dad0d-b869-4693-b300-be7d5c8a3a9c tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:02:03.406329 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-222dad0d-b869-4693-b300-be7d5c8a3a9c tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] 10.222.0.58 "GET /compute/v2.1/servers/3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51" status: 200 len: 1280 microversion: 2.25 time: 0.419201 Aug 10 23:02:03.407070 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 744/1471] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:02:02 2022] GET /compute/v2.1/servers/3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51 => generated 1280 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 23:02:03.426170 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-0127c8e5-fd6a-47bd-9702-831ae63a0053 req-d97c1741-5694-4a0e-916e-dc5fbe383f81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "196377d7-c0d5-408b-9743-e1f451f71164", "name": "network-vif-plugged", "status": "completed", "tag": "ee547e27-7a4d-4b9b-a6b3-23c2283a5297"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:02:03.452593 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-0127c8e5-fd6a-47bd-9702-831ae63a0053 req-d97c1741-5694-4a0e-916e-dc5fbe383f81 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:03.453898 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-0127c8e5-fd6a-47bd-9702-831ae63a0053 req-d97c1741-5694-4a0e-916e-dc5fbe383f81 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:03.454394 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-0127c8e5-fd6a-47bd-9702-831ae63a0053 req-d97c1741-5694-4a0e-916e-dc5fbe383f81 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:03.492731 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-0127c8e5-fd6a-47bd-9702-831ae63a0053 req-d97c1741-5694-4a0e-916e-dc5fbe383f81 service nova] Creating event network-vif-plugged:ee547e27-7a4d-4b9b-a6b3-23c2283a5297 for instance 196377d7-c0d5-408b-9743-e1f451f71164 on n-h2-850468-14 Aug 10 23:02:03.494972 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-16612dbc-2f04-4b7d-9ad6-41006f6d2536 tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb4dc460d3b4bb1a20a45d27d524cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701fe4c2829c4ef4a748cfe83d84294f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:02:03.504121 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-0127c8e5-fd6a-47bd-9702-831ae63a0053 req-d97c1741-5694-4a0e-916e-dc5fbe383f81 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092613 Aug 10 23:02:03.506040 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 745/1472] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:02:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:02:03.506243 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-16612dbc-2f04-4b7d-9ad6-41006f6d2536 tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] 10.222.0.58 "GET /compute/v2.1/servers/38d1e924-eaea-449b-9724-1d2b16fcdfbc" status: 200 len: 1317 microversion: 2.1 time: 0.459880 Aug 10 23:02:03.536419 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-faefbb40-20df-4e61-8011-dc353c8fabde tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:03.540999 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-faefbb40-20df-4e61-8011-dc353c8fabde tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] [instance: 196377d7-c0d5-408b-9743-e1f451f71164] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:02:03.541737 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 728/1473] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:02:03 2022] GET /compute/v2.1/servers/38d1e924-eaea-449b-9724-1d2b16fcdfbc => generated 1317 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:02:03.552414 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-faefbb40-20df-4e61-8011-dc353c8fabde tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:03.554978 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-faefbb40-20df-4e61-8011-dc353c8fabde tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:03.556203 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-faefbb40-20df-4e61-8011-dc353c8fabde tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:03.557242 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-faefbb40-20df-4e61-8011-dc353c8fabde tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:03.558104 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-faefbb40-20df-4e61-8011-dc353c8fabde tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:03.559890 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-faefbb40-20df-4e61-8011-dc353c8fabde tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:03.571313 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-bbc13526-9865-4683-ac96-c995a0669f2f tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:03.572186 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-bbc13526-9865-4683-ac96-c995a0669f2f tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] [instance: 1af4c3de-2464-45c7-a088-a3db68a67cb6] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:02:03.603010 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:02:03.605659 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bbc13526-9865-4683-ac96-c995a0669f2f tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:03.606470 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bbc13526-9865-4683-ac96-c995a0669f2f tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:03.606833 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bbc13526-9865-4683-ac96-c995a0669f2f tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:03.609528 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bbc13526-9865-4683-ac96-c995a0669f2f tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:03.612133 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bbc13526-9865-4683-ac96-c995a0669f2f tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:03.612711 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bbc13526-9865-4683-ac96-c995a0669f2f tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:03.899715 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-faefbb40-20df-4e61-8011-dc353c8fabde tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '417d4eaaeb1c4df78745496ececb3e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27e6ee9495a438b8450a4ef0d62cbcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:02:03.910900 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-faefbb40-20df-4e61-8011-dc353c8fabde tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] 10.222.0.58 "GET /compute/v2.1/servers/196377d7-c0d5-408b-9743-e1f451f71164" status: 200 len: 1317 microversion: 2.1 time: 0.402726 Aug 10 23:02:03.916235 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 746/1474] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:02:03 2022] GET /compute/v2.1/servers/196377d7-c0d5-408b-9743-e1f451f71164 => generated 1317 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:02:03.938721 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-4f4200f8-453b-4d70-b651-7e8a89473e66 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:03.939602 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-4f4200f8-453b-4d70-b651-7e8a89473e66 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 0dabc2bf-08ff-45b5-a791-34d655349eae] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:02:03.951918 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4f4200f8-453b-4d70-b651-7e8a89473e66 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:03.952426 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4f4200f8-453b-4d70-b651-7e8a89473e66 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:03.952864 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4f4200f8-453b-4d70-b651-7e8a89473e66 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:03.955549 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4f4200f8-453b-4d70-b651-7e8a89473e66 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:03.956197 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4f4200f8-453b-4d70-b651-7e8a89473e66 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:03.957279 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4f4200f8-453b-4d70-b651-7e8a89473e66 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:03.983616 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-4f4200f8-453b-4d70-b651-7e8a89473e66 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] HTTP exception thrown: Instance 0dabc2bf-08ff-45b5-a791-34d655349eae could not be found. Aug 10 23:02:03.994114 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-4f4200f8-453b-4d70-b651-7e8a89473e66 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Request method failure captured: Aug 10 23:02:03.994114 n-d-850468-14 devstack@n-api.service[122633]: request: GET /compute/v2.1/servers/0dabc2bf-08ff-45b5-a791-34d655349eae HTTP/1.1 Aug 10 23:02:03.994114 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:02:03.994114 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:02:03.994114 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:02:03.994114 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:02:03.994114 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:02:03.994114 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:02:03.994114 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:02:03.994114 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:02:03.994114 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9DeQmxTbOitwd_j9YtdAnQSwQ89-Dy6u8ScBzZvyZW9HY4wPsjGy7IRMWg-qG5FMs97q83zI4T-3jk9dEElmnqLqzqyNSsYmIaBHEjEiS-9wcAaMJigIlFlxe5p_oKuFcblN8OKqmSYdvWW9qENhJcW3FtG8UPbZXFHnVNw53wlKQ4Y Aug 10 23:02:03.994114 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:02:03.994114 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:02:03.994114 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:02:03.994114 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:02:03.994114 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:02:03.994114 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:02:03.994114 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: f9582683a1cf4e92b3bd3f10db0b497b Aug 10 23:02:03.994114 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-MigrationsAdminTest-2034094486 Aug 10 23:02:03.994114 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:02:03.994114 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:02:03.996307 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f9582683a1cf4e92b3bd3f10db0b497b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f9582683a1cf4e92b3bd3f10db0b497b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/f9582683a1cf4e92b3bd3f10db0b497b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_f9582683a1cf4e92b3bd3f10db0b497b", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:02:03.996307 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-MigrationsAdminTest-2034094486 Aug 10 23:02:03.996307 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: f9582683a1cf4e92b3bd3f10db0b497b Aug 10 23:02:03.996307 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-MigrationsAdminTest-2034094486 Aug 10 23:02:03.996307 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-MigrationsAdminTest-2034094486-project Aug 10 23:02:03.996307 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:02:03.996307 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:02:03.996307 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 5c48fd7279544b1fae228500f5a1e46d Aug 10 23:02:03.996307 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-MigrationsAdminTest-2034094486-project Aug 10 23:02:03.996307 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:02:03.996307 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance 0dabc2bf-08ff-45b5-a791-34d655349eae could not be found. Aug 10 23:02:03.996307 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': '0dabc2bf-08ff-45b5-a791-34d655349eae'} Aug 10 23:02:03.997314 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:02:03.997314 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:02:03.997314 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:02:03.997314 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:02:03.997314 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:02:03.997314 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:02:03.997314 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:02:03.997314 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:02:03.997314 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:02:03.997314 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:02:03.997314 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0dabc2bf-08ff-45b5-a791-34d655349eae could not be found. Aug 10 23:02:03.997314 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:02:03.997314 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:02:03.997314 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:02:03.997314 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:02:03.997314 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:02:03.997314 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:02:03.997314 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:02:03.997314 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:02:03.997314 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:02:03.999063 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:02:03.999063 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:02:03.999063 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:02:03.999063 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:02:03.999063 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:02:03.999063 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:02:03.999063 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:02:03.999063 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0dabc2bf-08ff-45b5-a791-34d655349eae could not be found. Aug 10 23:02:03.999063 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:02:03.999063 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:02:03.999063 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:02:03.999063 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:02:03.999063 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:02:03.999063 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:02:03.999063 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:02:03.999063 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:02:03.999063 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0dabc2bf-08ff-45b5-a791-34d655349eae could not be found. Aug 10 23:02:03.999063 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:02:04.002252 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-bbc13526-9865-4683-ac96-c995a0669f2f tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6d9806b6724e5aaf8c69be8e70d4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307ab95daa034afbb31f90626885072b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:02:04.003617 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-4f4200f8-453b-4d70-b651-7e8a89473e66 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Returning 404 to user: Instance 0dabc2bf-08ff-45b5-a791-34d655349eae could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:02:04.004723 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-4f4200f8-453b-4d70-b651-7e8a89473e66 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/0dabc2bf-08ff-45b5-a791-34d655349eae" status: 404 len: 111 microversion: 2.1 time: 0.070537 Aug 10 23:02:04.013463 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 747/1475] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:02:03 2022] GET /compute/v2.1/servers/0dabc2bf-08ff-45b5-a791-34d655349eae => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 10 23:02:04.016710 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-bbc13526-9865-4683-ac96-c995a0669f2f tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] 10.222.0.58 "GET /compute/v2.1/servers/1af4c3de-2464-45c7-a088-a3db68a67cb6" status: 200 len: 1501 microversion: 2.1 time: 0.470138 Aug 10 23:02:04.017958 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 729/1476] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:02:03 2022] GET /compute/v2.1/servers/1af4c3de-2464-45c7-a088-a3db68a67cb6 => generated 1501 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:02:04.020553 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-5aa19b0f-a983-4dd6-9aaf-aed0b7ad5d22 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:04.021055 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-5aa19b0f-a983-4dd6-9aaf-aed0b7ad5d22 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 1464324b-6977-4faa-8b84-370603a77429] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:02:04.029507 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5aa19b0f-a983-4dd6-9aaf-aed0b7ad5d22 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:04.030011 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5aa19b0f-a983-4dd6-9aaf-aed0b7ad5d22 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:04.030459 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5aa19b0f-a983-4dd6-9aaf-aed0b7ad5d22 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:04.031259 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5aa19b0f-a983-4dd6-9aaf-aed0b7ad5d22 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:04.031724 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5aa19b0f-a983-4dd6-9aaf-aed0b7ad5d22 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:04.032155 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5aa19b0f-a983-4dd6-9aaf-aed0b7ad5d22 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:04.072863 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-6807f77c-8523-41bb-8d2c-55c1532410d6 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:04.073488 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-6807f77c-8523-41bb-8d2c-55c1532410d6 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] [instance: 8e91f1ac-f79d-4ab0-aa13-ea32b0e74888] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:02:04.081681 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-5aa19b0f-a983-4dd6-9aaf-aed0b7ad5d22 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 1464324b-6977-4faa-8b84-370603a77429] Going to try to terminate instance {{(pid=122633) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:02:04.086167 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6807f77c-8523-41bb-8d2c-55c1532410d6 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:04.086970 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6807f77c-8523-41bb-8d2c-55c1532410d6 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:04.087576 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6807f77c-8523-41bb-8d2c-55c1532410d6 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:04.091074 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6807f77c-8523-41bb-8d2c-55c1532410d6 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:04.091770 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6807f77c-8523-41bb-8d2c-55c1532410d6 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:04.092369 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6807f77c-8523-41bb-8d2c-55c1532410d6 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:04.132679 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=100 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:02:04.268498 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-5aa19b0f-a983-4dd6-9aaf-aed0b7ad5d22 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "DELETE /compute/v2.1/servers/1464324b-6977-4faa-8b84-370603a77429" status: 204 len: 0 microversion: 2.1 time: 0.250474 Aug 10 23:02:04.270954 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 748/1477] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:02:04 2022] DELETE /compute/v2.1/servers/1464324b-6977-4faa-8b84-370603a77429 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:02:04.285941 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-f0d4afef-ddd3-434d-a95f-1f633fc34c03 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:04.286712 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-f0d4afef-ddd3-434d-a95f-1f633fc34c03 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 1464324b-6977-4faa-8b84-370603a77429] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:02:04.302298 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f0d4afef-ddd3-434d-a95f-1f633fc34c03 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:04.302724 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f0d4afef-ddd3-434d-a95f-1f633fc34c03 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:04.305415 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f0d4afef-ddd3-434d-a95f-1f633fc34c03 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:04.306701 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f0d4afef-ddd3-434d-a95f-1f633fc34c03 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:04.307771 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f0d4afef-ddd3-434d-a95f-1f633fc34c03 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:04.313431 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f0d4afef-ddd3-434d-a95f-1f633fc34c03 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:04.417806 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-6807f77c-8523-41bb-8d2c-55c1532410d6 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632904331d024d9b8e4d3660dff2cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ed0bdee3aa4013bd9219069bda558c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:02:04.422329 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:02:04.439559 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-6807f77c-8523-41bb-8d2c-55c1532410d6 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] 10.222.0.58 "GET /compute/v2.1/servers/8e91f1ac-f79d-4ab0-aa13-ea32b0e74888" status: 200 len: 1708 microversion: 2.1 time: 0.365160 Aug 10 23:02:04.440296 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 730/1478] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:02:04 2022] GET /compute/v2.1/servers/8e91f1ac-f79d-4ab0-aa13-ea32b0e74888 => generated 1708 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:02:04.445244 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-28d31ed9-4eb0-4150-aa98-24268cb09b33 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:04.450422 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-28d31ed9-4eb0-4150-aa98-24268cb09b33 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] [instance: 3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:02:04.463341 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-28d31ed9-4eb0-4150-aa98-24268cb09b33 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:04.464171 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-28d31ed9-4eb0-4150-aa98-24268cb09b33 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:04.466709 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-28d31ed9-4eb0-4150-aa98-24268cb09b33 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:04.468381 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-28d31ed9-4eb0-4150-aa98-24268cb09b33 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:04.469641 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-28d31ed9-4eb0-4150-aa98-24268cb09b33 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:04.470515 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-28d31ed9-4eb0-4150-aa98-24268cb09b33 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:04.635045 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-f0d4afef-ddd3-434d-a95f-1f633fc34c03 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:02:04.646091 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-f0d4afef-ddd3-434d-a95f-1f633fc34c03 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/1464324b-6977-4faa-8b84-370603a77429" status: 200 len: 1534 microversion: 2.1 time: 0.370497 Aug 10 23:02:04.651028 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 749/1479] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:02:04 2022] GET /compute/v2.1/servers/1464324b-6977-4faa-8b84-370603a77429 => generated 1534 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:02:04.656960 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-f7da5048-ef1b-47a4-9825-3edab44055ec tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Calling method '.version_select at 0x7f847cf21670>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:04.661039 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f7da5048-ef1b-47a4-9825-3edab44055ec tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:04.661758 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f7da5048-ef1b-47a4-9825-3edab44055ec tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:04.662517 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f7da5048-ef1b-47a4-9825-3edab44055ec tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:04.690959 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-28d31ed9-4eb0-4150-aa98-24268cb09b33 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:02:04.706193 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-28d31ed9-4eb0-4150-aa98-24268cb09b33 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:02:04.709233 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-28d31ed9-4eb0-4150-aa98-24268cb09b33 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:02:04.710335 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-f7da5048-ef1b-47a4-9825-3edab44055ec tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] 10.222.0.58 "GET /compute/v2.1/os-migrations" status: 200 len: 3533 microversion: 2.1 time: 0.057747 Aug 10 23:02:04.711003 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 750/1480] 10.222.0.58 () {58 vars in 1143 bytes} [Wed Aug 10 23:02:04 2022] GET /compute/v2.1/os-migrations => generated 3533 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:02:04.711332 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-28d31ed9-4eb0-4150-aa98-24268cb09b33 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] 10.222.0.58 "GET /compute/v2.1/servers/3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51" status: 200 len: 1280 microversion: 2.25 time: 0.269126 Aug 10 23:02:04.712470 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 731/1481] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:02:04 2022] GET /compute/v2.1/servers/3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51 => generated 1280 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:02:04.734642 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-3b2ca232-5d42-4645-b715-73595388245a tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:04.735586 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-06f0e14c-886a-4dfc-b52a-e8ea6521e4ed tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:04.736583 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-06f0e14c-886a-4dfc-b52a-e8ea6521e4ed tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] [instance: 38d1e924-eaea-449b-9724-1d2b16fcdfbc] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:02:04.736742 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-3b2ca232-5d42-4645-b715-73595388245a tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] [instance: 8e91f1ac-f79d-4ab0-aa13-ea32b0e74888] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:02:04.745490 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-06f0e14c-886a-4dfc-b52a-e8ea6521e4ed tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:04.748084 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-06f0e14c-886a-4dfc-b52a-e8ea6521e4ed tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:04.749372 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-06f0e14c-886a-4dfc-b52a-e8ea6521e4ed tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:04.750367 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-06f0e14c-886a-4dfc-b52a-e8ea6521e4ed tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:04.751686 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-06f0e14c-886a-4dfc-b52a-e8ea6521e4ed tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:04.752358 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-06f0e14c-886a-4dfc-b52a-e8ea6521e4ed tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:04.752945 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3b2ca232-5d42-4645-b715-73595388245a tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:04.754389 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3b2ca232-5d42-4645-b715-73595388245a tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:04.755652 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3b2ca232-5d42-4645-b715-73595388245a tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:04.756749 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3b2ca232-5d42-4645-b715-73595388245a tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:04.759213 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3b2ca232-5d42-4645-b715-73595388245a tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:04.759839 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3b2ca232-5d42-4645-b715-73595388245a tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:04.986820 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-06f0e14c-886a-4dfc-b52a-e8ea6521e4ed tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb4dc460d3b4bb1a20a45d27d524cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701fe4c2829c4ef4a748cfe83d84294f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:02:04.996508 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-06f0e14c-886a-4dfc-b52a-e8ea6521e4ed tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] 10.222.0.58 "GET /compute/v2.1/servers/38d1e924-eaea-449b-9724-1d2b16fcdfbc" status: 200 len: 1506 microversion: 2.1 time: 0.274804 Aug 10 23:02:05.000833 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 751/1482] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:02:04 2022] GET /compute/v2.1/servers/38d1e924-eaea-449b-9724-1d2b16fcdfbc => generated 1506 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:02:05.017569 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-421b52e7-2517-47b7-8192-b2a7314dbcd1 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:05.017881 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-3b2ca232-5d42-4645-b715-73595388245a tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/8e91f1ac-f79d-4ab0-aa13-ea32b0e74888" status: 200 len: 1861 microversion: 2.1 time: 0.295332 Aug 10 23:02:05.018482 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 732/1483] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:02:04 2022] GET /compute/v2.1/servers/8e91f1ac-f79d-4ab0-aa13-ea32b0e74888 => generated 1861 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:02:05.018912 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-421b52e7-2517-47b7-8192-b2a7314dbcd1 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] [instance: 196377d7-c0d5-408b-9743-e1f451f71164] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:02:05.024458 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-246ec2e3-fae0-4cd8-a55a-158a94b3268c tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:05.025024 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-246ec2e3-fae0-4cd8-a55a-158a94b3268c tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] [instance: 38d1e924-eaea-449b-9724-1d2b16fcdfbc] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:02:05.042562 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-421b52e7-2517-47b7-8192-b2a7314dbcd1 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:05.043390 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-246ec2e3-fae0-4cd8-a55a-158a94b3268c tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:05.043915 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-246ec2e3-fae0-4cd8-a55a-158a94b3268c tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:05.044034 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-421b52e7-2517-47b7-8192-b2a7314dbcd1 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:05.044367 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-421b52e7-2517-47b7-8192-b2a7314dbcd1 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:05.044481 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-246ec2e3-fae0-4cd8-a55a-158a94b3268c tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:05.045154 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-421b52e7-2517-47b7-8192-b2a7314dbcd1 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:05.045270 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-246ec2e3-fae0-4cd8-a55a-158a94b3268c tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:05.045650 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-421b52e7-2517-47b7-8192-b2a7314dbcd1 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:05.045769 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-246ec2e3-fae0-4cd8-a55a-158a94b3268c tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:05.046075 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-421b52e7-2517-47b7-8192-b2a7314dbcd1 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:05.046204 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-246ec2e3-fae0-4cd8-a55a-158a94b3268c tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:05.086252 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-246ec2e3-fae0-4cd8-a55a-158a94b3268c tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': 'abb4dc460d3b4bb1a20a45d27d524cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701fe4c2829c4ef4a748cfe83d84294f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:02:05.087405 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-246ec2e3-fae0-4cd8-a55a-158a94b3268c tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] 10.222.0.58 "GET /compute/v2.1/servers/38d1e924-eaea-449b-9724-1d2b16fcdfbc/os-instance-actions/req-c35dc197-46fe-48a5-8f07-614bdb86d55e" status: 200 len: 313 microversion: 2.1 time: 0.067792 Aug 10 23:02:05.088393 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 733/1484] 10.222.0.58 () {58 vars in 1419 bytes} [Wed Aug 10 23:02:05 2022] GET /compute/v2.1/servers/38d1e924-eaea-449b-9724-1d2b16fcdfbc/os-instance-actions/req-c35dc197-46fe-48a5-8f07-614bdb86d55e => generated 313 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:02:05.095684 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-e08db52c-3c1e-40fa-9d5e-0e174ba7adae tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:05.096566 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-e08db52c-3c1e-40fa-9d5e-0e174ba7adae tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] [instance: 1af4c3de-2464-45c7-a088-a3db68a67cb6] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:02:05.104207 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e08db52c-3c1e-40fa-9d5e-0e174ba7adae tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:05.105004 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e08db52c-3c1e-40fa-9d5e-0e174ba7adae tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:05.105707 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e08db52c-3c1e-40fa-9d5e-0e174ba7adae tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:05.106815 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e08db52c-3c1e-40fa-9d5e-0e174ba7adae tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:05.107588 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e08db52c-3c1e-40fa-9d5e-0e174ba7adae tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:05.108188 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e08db52c-3c1e-40fa-9d5e-0e174ba7adae tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:05.411146 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-e08db52c-3c1e-40fa-9d5e-0e174ba7adae tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6d9806b6724e5aaf8c69be8e70d4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307ab95daa034afbb31f90626885072b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:02:05.419374 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-e08db52c-3c1e-40fa-9d5e-0e174ba7adae tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] 10.222.0.58 "GET /compute/v2.1/servers/1af4c3de-2464-45c7-a088-a3db68a67cb6" status: 200 len: 1488 microversion: 2.1 time: 0.329642 Aug 10 23:02:05.428575 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 734/1485] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:02:05 2022] GET /compute/v2.1/servers/1af4c3de-2464-45c7-a088-a3db68a67cb6 => generated 1488 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:02:05.434245 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-49e3239f-1dc9-4251-b0ce-3ebd44f4c22d tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:05.435235 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-49e3239f-1dc9-4251-b0ce-3ebd44f4c22d tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] [instance: 8e91f1ac-f79d-4ab0-aa13-ea32b0e74888] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:02:05.450876 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-49e3239f-1dc9-4251-b0ce-3ebd44f4c22d tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:05.451688 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-49e3239f-1dc9-4251-b0ce-3ebd44f4c22d tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:05.452371 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-49e3239f-1dc9-4251-b0ce-3ebd44f4c22d tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:05.453261 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-49e3239f-1dc9-4251-b0ce-3ebd44f4c22d tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:05.453905 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-49e3239f-1dc9-4251-b0ce-3ebd44f4c22d tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:05.454344 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-49e3239f-1dc9-4251-b0ce-3ebd44f4c22d tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:05.664757 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-49e3239f-1dc9-4251-b0ce-3ebd44f4c22d tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/8e91f1ac-f79d-4ab0-aa13-ea32b0e74888" status: 200 len: 1861 microversion: 2.1 time: 0.234671 Aug 10 23:02:05.666146 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 735/1486] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:02:05 2022] GET /compute/v2.1/servers/8e91f1ac-f79d-4ab0-aa13-ea32b0e74888 => generated 1861 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:02:05.673782 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-79b1521b-58d9-4a58-9bd7-033742cab4b8 tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:02:05.677164 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-79b1521b-58d9-4a58-9bd7-033742cab4b8 tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] [instance: 38d1e924-eaea-449b-9724-1d2b16fcdfbc] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:02:05.697260 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-79b1521b-58d9-4a58-9bd7-033742cab4b8 tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:05.698686 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-79b1521b-58d9-4a58-9bd7-033742cab4b8 tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:05.699509 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-79b1521b-58d9-4a58-9bd7-033742cab4b8 tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:05.700517 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-79b1521b-58d9-4a58-9bd7-033742cab4b8 tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:05.706771 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-79b1521b-58d9-4a58-9bd7-033742cab4b8 tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:05.742827 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-79b1521b-58d9-4a58-9bd7-033742cab4b8 tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:05.795699 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-421b52e7-2517-47b7-8192-b2a7314dbcd1 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '417d4eaaeb1c4df78745496ececb3e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27e6ee9495a438b8450a4ef0d62cbcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:02:05.827435 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-421b52e7-2517-47b7-8192-b2a7314dbcd1 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] 10.222.0.58 "GET /compute/v2.1/servers/196377d7-c0d5-408b-9743-e1f451f71164" status: 200 len: 1317 microversion: 2.1 time: 0.820912 Aug 10 23:02:05.830469 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 752/1487] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:02:05 2022] GET /compute/v2.1/servers/196377d7-c0d5-408b-9743-e1f451f71164 => generated 1317 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:02:05.838104 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-d961a85b-d19a-4e9a-bcee-bd7111421d1a tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:05.838880 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-d961a85b-d19a-4e9a-bcee-bd7111421d1a tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] [instance: 1af4c3de-2464-45c7-a088-a3db68a67cb6] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:02:05.873147 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d961a85b-d19a-4e9a-bcee-bd7111421d1a tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:05.874632 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d961a85b-d19a-4e9a-bcee-bd7111421d1a tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:05.878253 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d961a85b-d19a-4e9a-bcee-bd7111421d1a tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:05.881995 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d961a85b-d19a-4e9a-bcee-bd7111421d1a tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:05.882494 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d961a85b-d19a-4e9a-bcee-bd7111421d1a tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:05.883422 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d961a85b-d19a-4e9a-bcee-bd7111421d1a tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:05.922014 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-79b1521b-58d9-4a58-9bd7-033742cab4b8 tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] 10.222.0.58 "POST /compute/v2.1/servers/38d1e924-eaea-449b-9724-1d2b16fcdfbc/action" status: 202 len: 0 microversion: 2.1 time: 0.253257 Aug 10 23:02:05.923093 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 736/1488] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:02:05 2022] POST /compute/v2.1/servers/38d1e924-eaea-449b-9724-1d2b16fcdfbc/action => generated 0 bytes in 256 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:02:05.931306 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-0e22e229-1d14-442e-a03c-237b18746d9a req-55e314b0-a081-482a-ab74-5c0349161403 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51", "name": "network-vif-plugged", "status": "completed", "tag": "c83e0948-d394-45c1-aa16-31416d85184b"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:02:05.946932 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-0e22e229-1d14-442e-a03c-237b18746d9a req-55e314b0-a081-482a-ab74-5c0349161403 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:05.947861 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-0e22e229-1d14-442e-a03c-237b18746d9a req-55e314b0-a081-482a-ab74-5c0349161403 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:05.949032 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-0e22e229-1d14-442e-a03c-237b18746d9a req-55e314b0-a081-482a-ab74-5c0349161403 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:05.968752 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-0e22e229-1d14-442e-a03c-237b18746d9a req-55e314b0-a081-482a-ab74-5c0349161403 service nova] Creating event network-vif-plugged:c83e0948-d394-45c1-aa16-31416d85184b for instance 3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51 on n-h1-850468-14 Aug 10 23:02:05.977303 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-0e22e229-1d14-442e-a03c-237b18746d9a req-55e314b0-a081-482a-ab74-5c0349161403 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051672 Aug 10 23:02:05.979395 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 737/1489] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:02:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:02:05.989184 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-7a9ca725-9a40-469f-af22-e42081db39fb tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:05.990546 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-7a9ca725-9a40-469f-af22-e42081db39fb tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 1464324b-6977-4faa-8b84-370603a77429] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:02:05.999527 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7a9ca725-9a40-469f-af22-e42081db39fb tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:06.000821 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7a9ca725-9a40-469f-af22-e42081db39fb tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:06.001682 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7a9ca725-9a40-469f-af22-e42081db39fb tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:06.003691 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7a9ca725-9a40-469f-af22-e42081db39fb tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:06.004936 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-d961a85b-d19a-4e9a-bcee-bd7111421d1a tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] [instance: 1af4c3de-2464-45c7-a088-a3db68a67cb6] Going to try to terminate instance {{(pid=122633) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:02:06.005524 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7a9ca725-9a40-469f-af22-e42081db39fb tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:06.006145 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7a9ca725-9a40-469f-af22-e42081db39fb tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:06.178220 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:02:06.202947 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-d961a85b-d19a-4e9a-bcee-bd7111421d1a tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] 10.222.0.58 "DELETE /compute/v2.1/servers/1af4c3de-2464-45c7-a088-a3db68a67cb6" status: 204 len: 0 microversion: 2.1 time: 0.370521 Aug 10 23:02:06.209534 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 753/1490] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:02:05 2022] DELETE /compute/v2.1/servers/1af4c3de-2464-45c7-a088-a3db68a67cb6 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:02:06.217286 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-a7409a71-88a7-4d54-b10b-0180b5e51b99 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:06.218797 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-a7409a71-88a7-4d54-b10b-0180b5e51b99 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] [instance: 3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:02:06.228691 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a7409a71-88a7-4d54-b10b-0180b5e51b99 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:06.229450 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a7409a71-88a7-4d54-b10b-0180b5e51b99 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:06.230251 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a7409a71-88a7-4d54-b10b-0180b5e51b99 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:06.231893 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a7409a71-88a7-4d54-b10b-0180b5e51b99 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:06.232559 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a7409a71-88a7-4d54-b10b-0180b5e51b99 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:06.233310 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a7409a71-88a7-4d54-b10b-0180b5e51b99 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:06.484883 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-7a9ca725-9a40-469f-af22-e42081db39fb tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:02:06.493412 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-7a9ca725-9a40-469f-af22-e42081db39fb tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/1464324b-6977-4faa-8b84-370603a77429" status: 200 len: 1534 microversion: 2.1 time: 0.512038 Aug 10 23:02:06.499185 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 738/1491] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:02:05 2022] GET /compute/v2.1/servers/1464324b-6977-4faa-8b84-370603a77429 => generated 1534 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:02:06.535917 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-68ddaf55-55a6-438c-868e-6d28f852fb05 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:06.536512 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-68ddaf55-55a6-438c-868e-6d28f852fb05 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] [instance: 8e91f1ac-f79d-4ab0-aa13-ea32b0e74888] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:02:06.547235 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-a7409a71-88a7-4d54-b10b-0180b5e51b99 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:02:06.552131 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-68ddaf55-55a6-438c-868e-6d28f852fb05 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:06.552720 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-68ddaf55-55a6-438c-868e-6d28f852fb05 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:06.553242 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-68ddaf55-55a6-438c-868e-6d28f852fb05 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:06.554082 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-68ddaf55-55a6-438c-868e-6d28f852fb05 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:06.554541 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-68ddaf55-55a6-438c-868e-6d28f852fb05 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:06.555053 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-68ddaf55-55a6-438c-868e-6d28f852fb05 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:06.561657 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-a7409a71-88a7-4d54-b10b-0180b5e51b99 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:02:06.566140 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-a7409a71-88a7-4d54-b10b-0180b5e51b99 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:02:06.570046 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-a7409a71-88a7-4d54-b10b-0180b5e51b99 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] 10.222.0.58 "GET /compute/v2.1/servers/3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51" status: 200 len: 1280 microversion: 2.25 time: 0.358318 Aug 10 23:02:06.572838 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 754/1492] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:02:06 2022] GET /compute/v2.1/servers/3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51 => generated 1280 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:02:06.587155 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-f4f6e5e4-c4dc-481d-9171-389c1e5270c6 tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:06.587967 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-f4f6e5e4-c4dc-481d-9171-389c1e5270c6 tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] [instance: 38d1e924-eaea-449b-9724-1d2b16fcdfbc] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:02:06.602019 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f4f6e5e4-c4dc-481d-9171-389c1e5270c6 tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:06.605207 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f4f6e5e4-c4dc-481d-9171-389c1e5270c6 tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:06.606405 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f4f6e5e4-c4dc-481d-9171-389c1e5270c6 tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:06.607419 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f4f6e5e4-c4dc-481d-9171-389c1e5270c6 tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:06.609448 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f4f6e5e4-c4dc-481d-9171-389c1e5270c6 tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:06.610918 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f4f6e5e4-c4dc-481d-9171-389c1e5270c6 tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:06.715751 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.objects.instance [None req-68ddaf55-55a6-438c-868e-6d28f852fb05 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lazy-loading 'services' on Instance uuid 8e91f1ac-f79d-4ab0-aa13-ea32b0e74888 {{(pid=122632) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:02:06.815316 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-68ddaf55-55a6-438c-868e-6d28f852fb05 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] 10.222.0.58 "DELETE /compute/v2.1/servers/8e91f1ac-f79d-4ab0-aa13-ea32b0e74888/os-volume_attachments/9db42fd1-a80f-480e-bae1-c8051e0f7d0e" status: 202 len: 0 microversion: 2.1 time: 0.288999 Aug 10 23:02:06.820935 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 739/1493] 10.222.0.58 () {58 vars in 1416 bytes} [Wed Aug 10 23:02:06 2022] DELETE /compute/v2.1/servers/8e91f1ac-f79d-4ab0-aa13-ea32b0e74888/os-volume_attachments/9db42fd1-a80f-480e-bae1-c8051e0f7d0e => generated 0 bytes in 321 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:02:06.827792 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-6e2e4a78-4680-44ed-8268-e4179ba207f0 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Calling method '.version_select at 0x7f847d04ddc0>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:06.895434 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-6e2e4a78-4680-44ed-8268-e4179ba207f0 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] HTTP exception thrown: Image not found. Aug 10 23:02:06.897859 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-6e2e4a78-4680-44ed-8268-e4179ba207f0 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Request method failure captured: Aug 10 23:02:06.897859 n-d-850468-14 devstack@n-api.service[122632]: request: DELETE /compute/v2.1/images/aa11c27d-647b-4b9d-bf80-610d7dd4a8b2 HTTP/1.1 Aug 10 23:02:06.897859 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:02:06.897859 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:02:06.897859 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:02:06.897859 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 23:02:06.897859 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:02:06.897859 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:02:06.897859 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:02:06.897859 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:02:06.897859 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9DgG869H1c8f0vbp0V7En7JFi_WIaXbrI3LJGQVZ9CZJGJ5tE0ttFDP0GLvV2QyQzFa98JnG3z8rMrapcPk2Wv2xg0AdGD-P9jDChgdbhVmmNjfdSCAmAgD2r7Z3NIqXzHov-GWhvIwwFP3ghOFWaMRMeNNOk3SIjTZY-cSRl1BQNss Aug 10 23:02:06.897859 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:02:06.897859 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:02:06.897859 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:02:06.897859 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:02:06.897859 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:02:06.897859 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:02:06.897859 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 307ab95daa034afbb31f90626885072b Aug 10 23:02:06.897859 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-ImagesTestJSON-1761176174 Aug 10 23:02:06.897859 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:02:06.897859 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:02:06.899412 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/307ab95daa034afbb31f90626885072b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/307ab95daa034afbb31f90626885072b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/307ab95daa034afbb31f90626885072b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_307ab95daa034afbb31f90626885072b", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:02:06.899412 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-ImagesTestJSON-1761176174 Aug 10 23:02:06.899412 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 307ab95daa034afbb31f90626885072b Aug 10 23:02:06.899412 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-ImagesTestJSON-1761176174 Aug 10 23:02:06.899412 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-ImagesTestJSON-1761176174-project Aug 10 23:02:06.899412 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:02:06.899412 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:02:06.899412 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: 7d6d9806b6724e5aaf8c69be8e70d4f3 Aug 10 23:02:06.899412 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-ImagesTestJSON-1761176174-project Aug 10 23:02:06.899412 n-d-850468-14 devstack@n-api.service[122632]: method: Aug 10 23:02:06.899412 n-d-850468-14 devstack@n-api.service[122632]: exception: Image not found. Aug 10 23:02:06.899412 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': 'aa11c27d-647b-4b9d-bf80-610d7dd4a8b2'} Aug 10 23:02:06.899412 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:02:06.899412 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:02:06.900335 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 10 23:02:06.900335 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 10 23:02:06.900335 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 10 23:02:06.900335 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 10 23:02:06.900335 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 10 23:02:06.900335 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 10 23:02:06.900335 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 10 23:02:06.900335 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 10 23:02:06.900335 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 10 23:02:06.900335 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 10 23:02:06.900335 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 10 23:02:06.900335 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 10 23:02:06.900335 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 10 23:02:06.900335 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 10 23:02:06.900335 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image aa11c27d-647b-4b9d-bf80-610d7dd4a8b2 to delete Aug 10 23:02:06.900335 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:02:06.900335 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:02:06.900335 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:02:06.900335 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:02:06.901565 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 10 23:02:06.901565 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 10 23:02:06.901565 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 10 23:02:06.901565 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 10 23:02:06.901565 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 10 23:02:06.901565 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 10 23:02:06.901565 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image aa11c27d-647b-4b9d-bf80-610d7dd4a8b2 could not be found. Aug 10 23:02:06.901565 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:02:06.901565 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:02:06.901565 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:02:06.901565 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:02:06.901565 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:02:06.901565 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:02:06.901565 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:02:06.901565 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:02:06.901565 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 23:02:06.901565 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 23:02:06.901565 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:02:06.901565 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:02:06.901565 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 10 23:02:06.904411 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 10 23:02:06.904411 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 10 23:02:06.904411 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:02:06.904411 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:02:06.904411 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:02:06.904411 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:02:06.904411 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:02:06.904411 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:02:06.904411 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:02:06.904411 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:02:06.904411 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 10 23:02:06.904411 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:02:06.908324 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-6e2e4a78-4680-44ed-8268-e4179ba207f0 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Returning 404 to user: Image not found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:02:06.909403 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-6e2e4a78-4680-44ed-8268-e4179ba207f0 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] 10.222.0.58 "DELETE /compute/v2.1/images/aa11c27d-647b-4b9d-bf80-610d7dd4a8b2" status: 404 len: 62 microversion: 2.1 time: 0.086874 Aug 10 23:02:06.911204 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 740/1494] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:02:06 2022] DELETE /compute/v2.1/images/aa11c27d-647b-4b9d-bf80-610d7dd4a8b2 => generated 62 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 10 23:02:07.024708 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-f4f6e5e4-c4dc-481d-9171-389c1e5270c6 tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb4dc460d3b4bb1a20a45d27d524cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701fe4c2829c4ef4a748cfe83d84294f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:02:07.040710 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-f4f6e5e4-c4dc-481d-9171-389c1e5270c6 tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] 10.222.0.58 "GET /compute/v2.1/servers/38d1e924-eaea-449b-9724-1d2b16fcdfbc" status: 200 len: 1508 microversion: 2.1 time: 0.466542 Aug 10 23:02:07.049755 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 755/1495] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:02:06 2022] GET /compute/v2.1/servers/38d1e924-eaea-449b-9724-1d2b16fcdfbc => generated 1508 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:02:07.069313 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-4262ffdc-e16d-4d09-afa2-b1e27f81f2eb tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:07.076988 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-4262ffdc-e16d-4d09-afa2-b1e27f81f2eb tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] [instance: 8e91f1ac-f79d-4ab0-aa13-ea32b0e74888] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:02:07.091736 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4262ffdc-e16d-4d09-afa2-b1e27f81f2eb tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:07.092388 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4262ffdc-e16d-4d09-afa2-b1e27f81f2eb tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:07.096356 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4262ffdc-e16d-4d09-afa2-b1e27f81f2eb tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:07.097261 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4262ffdc-e16d-4d09-afa2-b1e27f81f2eb tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:07.097882 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4262ffdc-e16d-4d09-afa2-b1e27f81f2eb tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:07.098405 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4262ffdc-e16d-4d09-afa2-b1e27f81f2eb tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:07.177887 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-4262ffdc-e16d-4d09-afa2-b1e27f81f2eb tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] 10.222.0.58 "GET /compute/v2.1/servers/8e91f1ac-f79d-4ab0-aa13-ea32b0e74888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.120347 Aug 10 23:02:07.178767 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 756/1496] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 10 23:02:07 2022] GET /compute/v2.1/servers/8e91f1ac-f79d-4ab0-aa13-ea32b0e74888/os-volume_attachments => generated 197 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:02:07.188494 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-a0b6425b-f7e0-435e-b37c-fc998c0cc49a tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:07.189378 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-a0b6425b-f7e0-435e-b37c-fc998c0cc49a tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] [instance: 196377d7-c0d5-408b-9743-e1f451f71164] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:02:07.196927 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a0b6425b-f7e0-435e-b37c-fc998c0cc49a tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:07.197604 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a0b6425b-f7e0-435e-b37c-fc998c0cc49a tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:07.198366 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a0b6425b-f7e0-435e-b37c-fc998c0cc49a tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:07.200051 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a0b6425b-f7e0-435e-b37c-fc998c0cc49a tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:07.200778 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a0b6425b-f7e0-435e-b37c-fc998c0cc49a tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:07.201502 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a0b6425b-f7e0-435e-b37c-fc998c0cc49a tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:07.362908 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-f27f60aa-ed88-4fe2-85c5-86021cec2b97 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Action: 'create', calling method: .version_select at 0x7f847d028160>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-440143743", "description": "tempest-description-1793059934"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:02:07.420543 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-a0b6425b-f7e0-435e-b37c-fc998c0cc49a tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '417d4eaaeb1c4df78745496ececb3e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27e6ee9495a438b8450a4ef0d62cbcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:02:07.430117 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-a0b6425b-f7e0-435e-b37c-fc998c0cc49a tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] 10.222.0.58 "GET /compute/v2.1/servers/196377d7-c0d5-408b-9743-e1f451f71164" status: 200 len: 1467 microversion: 2.1 time: 0.245874 Aug 10 23:02:07.431000 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 757/1497] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:02:07 2022] GET /compute/v2.1/servers/196377d7-c0d5-408b-9743-e1f451f71164 => generated 1467 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:02:07.438925 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-64633c63-d739-4279-9d61-a56f9b8fde81 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:07.439753 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-64633c63-d739-4279-9d61-a56f9b8fde81 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] [instance: 1af4c3de-2464-45c7-a088-a3db68a67cb6] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:02:07.453868 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-64633c63-d739-4279-9d61-a56f9b8fde81 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:07.456270 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-64633c63-d739-4279-9d61-a56f9b8fde81 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:07.456782 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-64633c63-d739-4279-9d61-a56f9b8fde81 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:07.457923 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-64633c63-d739-4279-9d61-a56f9b8fde81 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:07.458391 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-64633c63-d739-4279-9d61-a56f9b8fde81 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:07.459039 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-64633c63-d739-4279-9d61-a56f9b8fde81 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:07.498642 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-64633c63-d739-4279-9d61-a56f9b8fde81 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] [instance: 1af4c3de-2464-45c7-a088-a3db68a67cb6] Going to try to terminate instance {{(pid=122633) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:02:07.713920 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.compute.api [None req-64633c63-d739-4279-9d61-a56f9b8fde81 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] [instance: 1af4c3de-2464-45c7-a088-a3db68a67cb6] Instance is already in deleting state, ignoring this request Aug 10 23:02:07.716822 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-64633c63-d739-4279-9d61-a56f9b8fde81 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] 10.222.0.58 "DELETE /compute/v2.1/servers/1af4c3de-2464-45c7-a088-a3db68a67cb6" status: 204 len: 0 microversion: 2.1 time: 0.284260 Aug 10 23:02:07.718458 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 758/1498] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:02:07 2022] DELETE /compute/v2.1/servers/1af4c3de-2464-45c7-a088-a3db68a67cb6 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:02:07.729496 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-63c5c129-c490-4bc2-bedf-62f74aad36e3 req-ff670aa2-8804-4e71-819f-a638400eaa12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1464324b-6977-4faa-8b84-370603a77429", "name": "network-vif-deleted", "tag": "6a54d59d-b7dd-4033-89c5-dd089d9e9fb8"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:02:07.738190 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-f27f60aa-ed88-4fe2-85c5-86021cec2b97 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] 10.222.0.58 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.824776 Aug 10 23:02:07.746970 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 741/1499] 10.222.0.58 () {60 vars in 1180 bytes} [Wed Aug 10 23:02:06 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:02:07.746970 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-3259c562-d896-41b4-9085-fb20c95ede78 tempest-ServersOnMultiNodesTest-79489 tempest-ServersOnMultiNodesTest-79489-project-admin] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:07.746970 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-3259c562-d896-41b4-9085-fb20c95ede78 tempest-ServersOnMultiNodesTest-79489 tempest-ServersOnMultiNodesTest-79489-project-admin] [instance: 196377d7-c0d5-408b-9743-e1f451f71164] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:02:07.761777 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3259c562-d896-41b4-9085-fb20c95ede78 tempest-ServersOnMultiNodesTest-79489 tempest-ServersOnMultiNodesTest-79489-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:07.764806 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3259c562-d896-41b4-9085-fb20c95ede78 tempest-ServersOnMultiNodesTest-79489 tempest-ServersOnMultiNodesTest-79489-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:07.767464 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3259c562-d896-41b4-9085-fb20c95ede78 tempest-ServersOnMultiNodesTest-79489 tempest-ServersOnMultiNodesTest-79489-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:07.768758 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3259c562-d896-41b4-9085-fb20c95ede78 tempest-ServersOnMultiNodesTest-79489 tempest-ServersOnMultiNodesTest-79489-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:07.771234 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3259c562-d896-41b4-9085-fb20c95ede78 tempest-ServersOnMultiNodesTest-79489 tempest-ServersOnMultiNodesTest-79489-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:07.771852 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3259c562-d896-41b4-9085-fb20c95ede78 tempest-ServersOnMultiNodesTest-79489 tempest-ServersOnMultiNodesTest-79489-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:07.775220 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-63c5c129-c490-4bc2-bedf-62f74aad36e3 req-ff670aa2-8804-4e71-819f-a638400eaa12 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:07.776007 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-63c5c129-c490-4bc2-bedf-62f74aad36e3 req-ff670aa2-8804-4e71-819f-a638400eaa12 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:07.778894 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-63c5c129-c490-4bc2-bedf-62f74aad36e3 req-ff670aa2-8804-4e71-819f-a638400eaa12 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:07.847740 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-63c5c129-c490-4bc2-bedf-62f74aad36e3 req-ff670aa2-8804-4e71-819f-a638400eaa12 service nova] Creating event network-vif-deleted:6a54d59d-b7dd-4033-89c5-dd089d9e9fb8 for instance 1464324b-6977-4faa-8b84-370603a77429 on n-h1-850468-14 Aug 10 23:02:07.873978 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-63c5c129-c490-4bc2-bedf-62f74aad36e3 req-ff670aa2-8804-4e71-819f-a638400eaa12 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.148132 Aug 10 23:02:07.883596 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 759/1500] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:02:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:02:07.894880 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-ea2cce12-c4a8-47e4-9c63-7c1c4c53b390 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:07.895911 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-ea2cce12-c4a8-47e4-9c63-7c1c4c53b390 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 1464324b-6977-4faa-8b84-370603a77429] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:02:07.903672 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ea2cce12-c4a8-47e4-9c63-7c1c4c53b390 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:07.904632 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ea2cce12-c4a8-47e4-9c63-7c1c4c53b390 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:07.905185 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ea2cce12-c4a8-47e4-9c63-7c1c4c53b390 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:07.906143 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ea2cce12-c4a8-47e4-9c63-7c1c4c53b390 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:07.906752 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ea2cce12-c4a8-47e4-9c63-7c1c4c53b390 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:07.907416 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ea2cce12-c4a8-47e4-9c63-7c1c4c53b390 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:08.018400 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-ea2cce12-c4a8-47e4-9c63-7c1c4c53b390 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:02:08.043546 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-ea2cce12-c4a8-47e4-9c63-7c1c4c53b390 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/1464324b-6977-4faa-8b84-370603a77429" status: 200 len: 1364 microversion: 2.1 time: 0.153811 Aug 10 23:02:08.045157 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 760/1501] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:02:07 2022] GET /compute/v2.1/servers/1464324b-6977-4faa-8b84-370603a77429 => generated 1364 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:02:08.051389 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-e5257440-f365-4bb8-a3b8-d41f64496b64 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:08.054103 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-e5257440-f365-4bb8-a3b8-d41f64496b64 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] [instance: 3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:02:08.064444 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e5257440-f365-4bb8-a3b8-d41f64496b64 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:08.065190 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e5257440-f365-4bb8-a3b8-d41f64496b64 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:08.065802 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e5257440-f365-4bb8-a3b8-d41f64496b64 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:08.066684 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e5257440-f365-4bb8-a3b8-d41f64496b64 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:08.068836 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e5257440-f365-4bb8-a3b8-d41f64496b64 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:08.069018 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-3259c562-d896-41b4-9085-fb20c95ede78 tempest-ServersOnMultiNodesTest-79489 tempest-ServersOnMultiNodesTest-79489-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/196377d7-c0d5-408b-9743-e1f451f71164" status: 200 len: 1620 microversion: 2.1 time: 0.328746 Aug 10 23:02:08.070837 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e5257440-f365-4bb8-a3b8-d41f64496b64 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:08.071142 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 742/1502] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:02:07 2022] GET /compute/v2.1/servers/196377d7-c0d5-408b-9743-e1f451f71164 => generated 1620 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:02:08.077547 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-a75a6043-2e63-4430-8423-7d19dfc85e71 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:08.078519 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-a75a6043-2e63-4430-8423-7d19dfc85e71 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] [instance: 1af4c3de-2464-45c7-a088-a3db68a67cb6] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:02:08.087117 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a75a6043-2e63-4430-8423-7d19dfc85e71 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:08.088011 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a75a6043-2e63-4430-8423-7d19dfc85e71 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:08.088853 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a75a6043-2e63-4430-8423-7d19dfc85e71 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:08.089927 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a75a6043-2e63-4430-8423-7d19dfc85e71 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:08.090721 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a75a6043-2e63-4430-8423-7d19dfc85e71 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:08.091368 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a75a6043-2e63-4430-8423-7d19dfc85e71 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:08.348532 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-e5257440-f365-4bb8-a3b8-d41f64496b64 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:02:08.361026 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-e5257440-f365-4bb8-a3b8-d41f64496b64 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:02:08.364495 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-e5257440-f365-4bb8-a3b8-d41f64496b64 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:02:08.366626 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-e5257440-f365-4bb8-a3b8-d41f64496b64 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] 10.222.0.58 "GET /compute/v2.1/servers/3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51" status: 200 len: 1280 microversion: 2.25 time: 0.319036 Aug 10 23:02:08.367652 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 761/1503] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:02:08 2022] GET /compute/v2.1/servers/3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51 => generated 1280 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:02:08.374444 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-9dac57cb-b646-4f0e-acc0-95712e857b2a tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Action: 'create', calling method: .version_select at 0x7f847d263670>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1025083301", "description": "tempest-description-1984618793"}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:02:08.416801 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-a75a6043-2e63-4430-8423-7d19dfc85e71 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6d9806b6724e5aaf8c69be8e70d4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307ab95daa034afbb31f90626885072b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:02:08.432439 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-a75a6043-2e63-4430-8423-7d19dfc85e71 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] 10.222.0.58 "GET /compute/v2.1/servers/1af4c3de-2464-45c7-a088-a3db68a67cb6" status: 200 len: 1494 microversion: 2.1 time: 0.359819 Aug 10 23:02:08.450535 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 743/1504] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:02:08 2022] GET /compute/v2.1/servers/1af4c3de-2464-45c7-a088-a3db68a67cb6 => generated 1494 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:02:08.463288 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-5f0b2e1e-4898-41f3-8247-82e200e212dc req-5d50b6da-2521-40ee-a200-d959915afe5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1af4c3de-2464-45c7-a088-a3db68a67cb6", "name": "network-vif-plugged", "status": "completed", "tag": "881060b7-d25b-4d47-9b25-466798c6e4e3"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:02:08.490219 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-5f0b2e1e-4898-41f3-8247-82e200e212dc req-5d50b6da-2521-40ee-a200-d959915afe5f service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:08.491415 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-5f0b2e1e-4898-41f3-8247-82e200e212dc req-5d50b6da-2521-40ee-a200-d959915afe5f service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:08.493558 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-5f0b2e1e-4898-41f3-8247-82e200e212dc req-5d50b6da-2521-40ee-a200-d959915afe5f service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:08.528573 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-5f0b2e1e-4898-41f3-8247-82e200e212dc req-5d50b6da-2521-40ee-a200-d959915afe5f service nova] Creating event network-vif-plugged:881060b7-d25b-4d47-9b25-466798c6e4e3 for instance 1af4c3de-2464-45c7-a088-a3db68a67cb6 on n-h2-850468-14 Aug 10 23:02:08.555638 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-5f0b2e1e-4898-41f3-8247-82e200e212dc req-5d50b6da-2521-40ee-a200-d959915afe5f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099628 Aug 10 23:02:08.557137 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 744/1505] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:02:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:02:08.566733 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-77d18a03-00ff-415a-9ea0-3b2b43846a6b tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:08.575404 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-77d18a03-00ff-415a-9ea0-3b2b43846a6b tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] [instance: 38d1e924-eaea-449b-9724-1d2b16fcdfbc] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:02:08.590982 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-77d18a03-00ff-415a-9ea0-3b2b43846a6b tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:08.592767 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-77d18a03-00ff-415a-9ea0-3b2b43846a6b tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:08.594160 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-77d18a03-00ff-415a-9ea0-3b2b43846a6b tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:08.596415 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-77d18a03-00ff-415a-9ea0-3b2b43846a6b tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:08.597205 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-77d18a03-00ff-415a-9ea0-3b2b43846a6b tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:08.599805 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-77d18a03-00ff-415a-9ea0-3b2b43846a6b tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:08.771385 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-9dac57cb-b646-4f0e-acc0-95712e857b2a tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] 10.222.0.58 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.402212 Aug 10 23:02:08.772661 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 762/1506] 10.222.0.58 () {60 vars in 1180 bytes} [Wed Aug 10 23:02:08 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:02:08.780243 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-2d9bf2c7-197e-4889-99c0-28a82e9298fc tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:08.791857 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-2d9bf2c7-197e-4889-99c0-28a82e9298fc tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] [instance: 8e91f1ac-f79d-4ab0-aa13-ea32b0e74888] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:02:08.811899 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2d9bf2c7-197e-4889-99c0-28a82e9298fc tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:08.814377 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2d9bf2c7-197e-4889-99c0-28a82e9298fc tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:08.815789 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2d9bf2c7-197e-4889-99c0-28a82e9298fc tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:08.818007 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2d9bf2c7-197e-4889-99c0-28a82e9298fc tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:08.819568 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2d9bf2c7-197e-4889-99c0-28a82e9298fc tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:08.820377 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2d9bf2c7-197e-4889-99c0-28a82e9298fc tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:08.890319 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:02:08.911066 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-2d9bf2c7-197e-4889-99c0-28a82e9298fc tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] 10.222.0.58 "GET /compute/v2.1/servers/8e91f1ac-f79d-4ab0-aa13-ea32b0e74888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.136832 Aug 10 23:02:08.916251 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 763/1507] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 10 23:02:08 2022] GET /compute/v2.1/servers/8e91f1ac-f79d-4ab0-aa13-ea32b0e74888/os-volume_attachments => generated 197 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:02:08.929751 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-81fc9bc4-3188-4239-a01c-f0e72312af1b tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1579317628", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["0af574c3-bfa0-4df6-8f0e-6fcd12e9b8a9"]}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:02:09.033266 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-77d18a03-00ff-415a-9ea0-3b2b43846a6b tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb4dc460d3b4bb1a20a45d27d524cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701fe4c2829c4ef4a748cfe83d84294f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:02:09.044471 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-77d18a03-00ff-415a-9ea0-3b2b43846a6b tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] 10.222.0.58 "GET /compute/v2.1/servers/38d1e924-eaea-449b-9724-1d2b16fcdfbc" status: 200 len: 1513 microversion: 2.1 time: 0.485954 Aug 10 23:02:09.068561 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 745/1508] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:02:08 2022] GET /compute/v2.1/servers/38d1e924-eaea-449b-9724-1d2b16fcdfbc => generated 1513 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:02:09.079748 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.network.neutron [None req-81fc9bc4-3188-4239-a01c-f0e72312af1b tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] validate_networks() for None {{(pid=122633) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 23:02:09.099869 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-28ff0f68-cd68-4a08-b9c2-426013b4829b tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-314609135", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452", "networks": [{"uuid": "bc6cdacf-50bb-4fff-92e1-1d2d0cfa843d"}]}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:02:09.223071 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.network.neutron [None req-28ff0f68-cd68-4a08-b9c2-426013b4829b tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] validate_networks() for [('bc6cdacf-50bb-4fff-92e1-1d2d0cfa843d', None, None, None, None, None)] {{(pid=122632) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 23:02:09.392449 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-81fc9bc4-3188-4239-a01c-f0e72312af1b tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Flavor limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:02:09.392880 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-81fc9bc4-3188-4239-a01c-f0e72312af1b tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Image limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:02:09.393362 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-81fc9bc4-3188-4239-a01c-f0e72312af1b tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Flavor pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:02:09.394649 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-81fc9bc4-3188-4239-a01c-f0e72312af1b tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Image pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:02:09.395270 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-81fc9bc4-3188-4239-a01c-f0e72312af1b tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:02:09.410866 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-81fc9bc4-3188-4239-a01c-f0e72312af1b tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:09.411518 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-81fc9bc4-3188-4239-a01c-f0e72312af1b tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:09.411966 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-81fc9bc4-3188-4239-a01c-f0e72312af1b tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:09.412801 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-81fc9bc4-3188-4239-a01c-f0e72312af1b tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:09.413458 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-81fc9bc4-3188-4239-a01c-f0e72312af1b tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:09.413886 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-81fc9bc4-3188-4239-a01c-f0e72312af1b tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:09.473225 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-81fc9bc4-3188-4239-a01c-f0e72312af1b tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Getting quotas for project b27e6ee9495a438b8450a4ef0d62cbcd. Resources: {'instances', 'cores', 'ram'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:02:09.481803 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-81fc9bc4-3188-4239-a01c-f0e72312af1b tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Getting quotas for user 417d4eaaeb1c4df78745496ececb3e88 and project b27e6ee9495a438b8450a4ef0d62cbcd. Resources: {'instances', 'cores', 'ram'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:02:09.507277 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-81fc9bc4-3188-4239-a01c-f0e72312af1b tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Going to run 1 instances... {{(pid=122633) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 23:02:09.515414 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-81fc9bc4-3188-4239-a01c-f0e72312af1b tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] [instance: 2636ab6a-a1c8-4b70-a18f-afe073dd31db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78ad8905-f66f-4733-8be9-2b260f1fabed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122633) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 23:02:09.641210 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-81fc9bc4-3188-4239-a01c-f0e72312af1b tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.723058 Aug 10 23:02:09.642520 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 764/1509] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 23:02:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 725 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 23:02:09.653084 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-d6c41a2c-8d4c-44e0-9fcb-f5c3a03be5ca tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:09.654011 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-d6c41a2c-8d4c-44e0-9fcb-f5c3a03be5ca tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 1464324b-6977-4faa-8b84-370603a77429] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:02:09.661501 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d6c41a2c-8d4c-44e0-9fcb-f5c3a03be5ca tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:09.662242 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d6c41a2c-8d4c-44e0-9fcb-f5c3a03be5ca tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:09.662905 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d6c41a2c-8d4c-44e0-9fcb-f5c3a03be5ca tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:09.663786 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d6c41a2c-8d4c-44e0-9fcb-f5c3a03be5ca tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:09.664399 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d6c41a2c-8d4c-44e0-9fcb-f5c3a03be5ca tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:09.664984 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d6c41a2c-8d4c-44e0-9fcb-f5c3a03be5ca tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:09.705306 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-d6c41a2c-8d4c-44e0-9fcb-f5c3a03be5ca tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] HTTP exception thrown: Instance 1464324b-6977-4faa-8b84-370603a77429 could not be found. Aug 10 23:02:09.707600 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-d6c41a2c-8d4c-44e0-9fcb-f5c3a03be5ca tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Request method failure captured: Aug 10 23:02:09.707600 n-d-850468-14 devstack@n-api.service[122633]: request: GET /compute/v2.1/servers/1464324b-6977-4faa-8b84-370603a77429 HTTP/1.1 Aug 10 23:02:09.707600 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:02:09.707600 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:02:09.707600 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:02:09.707600 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:02:09.707600 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:02:09.707600 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:02:09.707600 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:02:09.707600 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:02:09.707600 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9DeQmxTbOitwd_j9YtdAnQSwQ89-Dy6u8ScBzZvyZW9HY4wPsjGy7IRMWg-qG5FMs97q83zI4T-3jk9dEElmnqLqzqyNSsYmIaBHEjEiS-9wcAaMJigIlFlxe5p_oKuFcblN8OKqmSYdvWW9qENhJcW3FtG8UPbZXFHnVNw53wlKQ4Y Aug 10 23:02:09.707600 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:02:09.707600 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:02:09.707600 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:02:09.707600 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:02:09.707600 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:02:09.707600 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:02:09.707600 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: f9582683a1cf4e92b3bd3f10db0b497b Aug 10 23:02:09.707600 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-MigrationsAdminTest-2034094486 Aug 10 23:02:09.707600 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:02:09.707600 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:02:09.709319 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f9582683a1cf4e92b3bd3f10db0b497b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f9582683a1cf4e92b3bd3f10db0b497b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/f9582683a1cf4e92b3bd3f10db0b497b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_f9582683a1cf4e92b3bd3f10db0b497b", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:02:09.709319 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-MigrationsAdminTest-2034094486 Aug 10 23:02:09.709319 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: f9582683a1cf4e92b3bd3f10db0b497b Aug 10 23:02:09.709319 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-MigrationsAdminTest-2034094486 Aug 10 23:02:09.709319 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-MigrationsAdminTest-2034094486-project Aug 10 23:02:09.709319 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:02:09.709319 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:02:09.709319 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 5c48fd7279544b1fae228500f5a1e46d Aug 10 23:02:09.709319 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-MigrationsAdminTest-2034094486-project Aug 10 23:02:09.709319 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:02:09.709319 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance 1464324b-6977-4faa-8b84-370603a77429 could not be found. Aug 10 23:02:09.709319 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': '1464324b-6977-4faa-8b84-370603a77429'} Aug 10 23:02:09.710272 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:02:09.710272 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:02:09.710272 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:02:09.710272 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:02:09.710272 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:02:09.710272 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:02:09.710272 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:02:09.710272 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:02:09.710272 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:02:09.710272 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:02:09.710272 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1464324b-6977-4faa-8b84-370603a77429 could not be found. Aug 10 23:02:09.710272 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:02:09.710272 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:02:09.710272 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:02:09.710272 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:02:09.710272 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:02:09.710272 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:02:09.710272 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:02:09.710272 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:02:09.710272 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:02:09.711824 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:02:09.711824 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:02:09.711824 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:02:09.711824 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:02:09.711824 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:02:09.711824 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:02:09.711824 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:02:09.711824 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1464324b-6977-4faa-8b84-370603a77429 could not be found. Aug 10 23:02:09.711824 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:02:09.711824 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:02:09.711824 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:02:09.711824 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:02:09.711824 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:02:09.711824 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:02:09.711824 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:02:09.711824 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:02:09.711824 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1464324b-6977-4faa-8b84-370603a77429 could not be found. Aug 10 23:02:09.711824 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:02:09.717569 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-d6c41a2c-8d4c-44e0-9fcb-f5c3a03be5ca tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Returning 404 to user: Instance 1464324b-6977-4faa-8b84-370603a77429 could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:02:09.722127 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-d6c41a2c-8d4c-44e0-9fcb-f5c3a03be5ca tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/1464324b-6977-4faa-8b84-370603a77429" status: 404 len: 111 microversion: 2.1 time: 0.078365 Aug 10 23:02:09.726993 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 765/1510] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:02:09 2022] GET /compute/v2.1/servers/1464324b-6977-4faa-8b84-370603a77429 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:02:09.736829 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-0901c95f-40b0-42f1-b7f3-039a02c0c6f7 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:09.737806 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-0901c95f-40b0-42f1-b7f3-039a02c0c6f7 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] [instance: 3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:02:09.748573 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0901c95f-40b0-42f1-b7f3-039a02c0c6f7 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:09.749316 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0901c95f-40b0-42f1-b7f3-039a02c0c6f7 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:09.749951 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0901c95f-40b0-42f1-b7f3-039a02c0c6f7 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:09.751014 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0901c95f-40b0-42f1-b7f3-039a02c0c6f7 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:09.751627 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0901c95f-40b0-42f1-b7f3-039a02c0c6f7 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:09.752392 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0901c95f-40b0-42f1-b7f3-039a02c0c6f7 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:10.068259 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-0901c95f-40b0-42f1-b7f3-039a02c0c6f7 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:02:10.096624 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-0901c95f-40b0-42f1-b7f3-039a02c0c6f7 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:02:10.101569 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-0901c95f-40b0-42f1-b7f3-039a02c0c6f7 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:02:10.107394 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-0901c95f-40b0-42f1-b7f3-039a02c0c6f7 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] 10.222.0.58 "GET /compute/v2.1/servers/3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51" status: 200 len: 1476 microversion: 2.25 time: 0.374905 Aug 10 23:02:10.108537 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 766/1511] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:02:09 2022] GET /compute/v2.1/servers/3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51 => generated 1476 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:02:10.134885 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-16127271-d256-49ff-b3dc-58039e8cf87b tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:10.137874 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-16127271-d256-49ff-b3dc-58039e8cf87b tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] [instance: 1af4c3de-2464-45c7-a088-a3db68a67cb6] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:02:10.157137 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-16127271-d256-49ff-b3dc-58039e8cf87b tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:10.158544 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-16127271-d256-49ff-b3dc-58039e8cf87b tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:10.159284 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-16127271-d256-49ff-b3dc-58039e8cf87b tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:10.160338 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-16127271-d256-49ff-b3dc-58039e8cf87b tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:10.161366 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-16127271-d256-49ff-b3dc-58039e8cf87b tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:10.162189 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-16127271-d256-49ff-b3dc-58039e8cf87b tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:10.361393 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-28ff0f68-cd68-4a08-b9c2-426013b4829b tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Flavor limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:02:10.362271 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-28ff0f68-cd68-4a08-b9c2-426013b4829b tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Image limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:02:10.362932 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-28ff0f68-cd68-4a08-b9c2-426013b4829b tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Flavor pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:02:10.363640 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-28ff0f68-cd68-4a08-b9c2-426013b4829b tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Image pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:02:10.364343 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-28ff0f68-cd68-4a08-b9c2-426013b4829b tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:02:10.380967 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-28ff0f68-cd68-4a08-b9c2-426013b4829b tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:10.382671 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-28ff0f68-cd68-4a08-b9c2-426013b4829b tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:10.383268 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-28ff0f68-cd68-4a08-b9c2-426013b4829b tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:10.384384 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-28ff0f68-cd68-4a08-b9c2-426013b4829b tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:10.385057 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-28ff0f68-cd68-4a08-b9c2-426013b4829b tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:10.386086 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-28ff0f68-cd68-4a08-b9c2-426013b4829b tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:10.391645 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-16127271-d256-49ff-b3dc-58039e8cf87b tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7d6d9806b6724e5aaf8c69be8e70d4f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '307ab95daa034afbb31f90626885072b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:02:10.403770 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-16127271-d256-49ff-b3dc-58039e8cf87b tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] 10.222.0.58 "GET /compute/v2.1/servers/1af4c3de-2464-45c7-a088-a3db68a67cb6" status: 200 len: 1452 microversion: 2.1 time: 0.293709 Aug 10 23:02:10.405500 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 767/1512] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:02:10 2022] GET /compute/v2.1/servers/1af4c3de-2464-45c7-a088-a3db68a67cb6 => generated 1452 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:02:10.423322 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-fab55f21-3e58-4a30-8c37-a90a2cee2252 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:10.424199 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-fab55f21-3e58-4a30-8c37-a90a2cee2252 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] [instance: 2636ab6a-a1c8-4b70-a18f-afe073dd31db] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:02:10.428996 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-28ff0f68-cd68-4a08-b9c2-426013b4829b tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Getting quotas for project 707f869910b34768ae1a348cd0b5f284. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:02:10.436737 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-28ff0f68-cd68-4a08-b9c2-426013b4829b tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Getting quotas for user bfd6d8e6a8444f5b9fcf1cf8da242ac0 and project 707f869910b34768ae1a348cd0b5f284. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:02:10.454254 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-28ff0f68-cd68-4a08-b9c2-426013b4829b tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Going to run 1 instances... {{(pid=122632) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 23:02:10.457242 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-28ff0f68-cd68-4a08-b9c2-426013b4829b tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] [instance: 9725dd3f-f5a6-496e-99c5-66ee08b6c1f7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78ad8905-f66f-4733-8be9-2b260f1fabed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122632) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 23:02:10.540749 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-28ff0f68-cd68-4a08-b9c2-426013b4829b tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.454075 Aug 10 23:02:10.545344 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 746/1513] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 23:02:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1464 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 23:02:10.556978 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-ae910fd3-cab9-4b2f-b3b1-0b9593cced4b tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '.version_select at 0x7f847d084e50>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:10.561297 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-fab55f21-3e58-4a30-8c37-a90a2cee2252 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '417d4eaaeb1c4df78745496ececb3e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27e6ee9495a438b8450a4ef0d62cbcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:02:10.572434 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-fab55f21-3e58-4a30-8c37-a90a2cee2252 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] 10.222.0.58 "GET /compute/v2.1/servers/2636ab6a-a1c8-4b70-a18f-afe073dd31db" status: 200 len: 1217 microversion: 2.1 time: 0.165306 Aug 10 23:02:10.573249 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 768/1514] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:02:10 2022] GET /compute/v2.1/servers/2636ab6a-a1c8-4b70-a18f-afe073dd31db => generated 1217 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:02:10.601616 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-39ad1efd-1929-4628-bb6a-751848c31f5c tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:10.605093 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-39ad1efd-1929-4628-bb6a-751848c31f5c tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] [instance: 8e91f1ac-f79d-4ab0-aa13-ea32b0e74888] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:02:10.617176 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-ae910fd3-cab9-4b2f-b3b1-0b9593cced4b tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1067921324" status: 202 len: 0 microversion: 2.1 time: 0.070342 Aug 10 23:02:10.627317 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 747/1515] 10.222.0.58 () {58 vars in 1221 bytes} [Wed Aug 10 23:02:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1067921324 => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:02:10.631415 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-39ad1efd-1929-4628-bb6a-751848c31f5c tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:10.634703 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-39ad1efd-1929-4628-bb6a-751848c31f5c tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:10.635505 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-39ad1efd-1929-4628-bb6a-751848c31f5c tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:10.637623 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-39ad1efd-1929-4628-bb6a-751848c31f5c tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:10.640424 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-39ad1efd-1929-4628-bb6a-751848c31f5c tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:10.640960 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-3d0f205f-bd64-49b6-8eea-82f253432ca0 tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:10.641594 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-39ad1efd-1929-4628-bb6a-751848c31f5c tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:10.643113 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-3d0f205f-bd64-49b6-8eea-82f253432ca0 tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] [instance: 38d1e924-eaea-449b-9724-1d2b16fcdfbc] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:02:10.659095 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3d0f205f-bd64-49b6-8eea-82f253432ca0 tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:10.660101 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3d0f205f-bd64-49b6-8eea-82f253432ca0 tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:10.660811 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3d0f205f-bd64-49b6-8eea-82f253432ca0 tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:10.663853 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3d0f205f-bd64-49b6-8eea-82f253432ca0 tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:10.664516 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3d0f205f-bd64-49b6-8eea-82f253432ca0 tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:10.665319 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3d0f205f-bd64-49b6-8eea-82f253432ca0 tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:10.738049 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-39ad1efd-1929-4628-bb6a-751848c31f5c tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] 10.222.0.58 "GET /compute/v2.1/servers/8e91f1ac-f79d-4ab0-aa13-ea32b0e74888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.162955 Aug 10 23:02:10.749723 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 769/1516] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 10 23:02:10 2022] GET /compute/v2.1/servers/8e91f1ac-f79d-4ab0-aa13-ea32b0e74888/os-volume_attachments => generated 197 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:02:11.153680 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-3d0f205f-bd64-49b6-8eea-82f253432ca0 tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb4dc460d3b4bb1a20a45d27d524cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701fe4c2829c4ef4a748cfe83d84294f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:02:11.161998 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-3d0f205f-bd64-49b6-8eea-82f253432ca0 tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] 10.222.0.58 "GET /compute/v2.1/servers/38d1e924-eaea-449b-9724-1d2b16fcdfbc" status: 200 len: 1506 microversion: 2.1 time: 0.532476 Aug 10 23:02:11.170296 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 748/1517] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:02:10 2022] GET /compute/v2.1/servers/38d1e924-eaea-449b-9724-1d2b16fcdfbc => generated 1506 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:02:11.176963 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-5dbcb1fb-e7e3-4094-aa2f-780d00790601 req-9c6c270f-9c98-4468-8a79-243624041f4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1af4c3de-2464-45c7-a088-a3db68a67cb6", "name": "network-vif-deleted", "tag": "881060b7-d25b-4d47-9b25-466798c6e4e3"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:02:11.224126 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-5dbcb1fb-e7e3-4094-aa2f-780d00790601 req-9c6c270f-9c98-4468-8a79-243624041f4d service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:11.224974 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-5dbcb1fb-e7e3-4094-aa2f-780d00790601 req-9c6c270f-9c98-4468-8a79-243624041f4d service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:11.227272 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-5dbcb1fb-e7e3-4094-aa2f-780d00790601 req-9c6c270f-9c98-4468-8a79-243624041f4d service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:11.312189 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-5dbcb1fb-e7e3-4094-aa2f-780d00790601 req-9c6c270f-9c98-4468-8a79-243624041f4d service nova] Creating event network-vif-deleted:881060b7-d25b-4d47-9b25-466798c6e4e3 for instance 1af4c3de-2464-45c7-a088-a3db68a67cb6 on n-h2-850468-14 Aug 10 23:02:11.333951 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-5dbcb1fb-e7e3-4094-aa2f-780d00790601 req-9c6c270f-9c98-4468-8a79-243624041f4d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.154955 Aug 10 23:02:11.346180 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 749/1518] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:02:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:02:11.378109 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-4c3c6131-6d2a-428e-b065-1cc2e2aa36cd tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:11.385459 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-4c3c6131-6d2a-428e-b065-1cc2e2aa36cd tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] [instance: 9725dd3f-f5a6-496e-99c5-66ee08b6c1f7] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:02:11.420438 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-3f12ac4c-afb9-4cf1-931a-8e3957cdc97f tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:11.421996 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-3f12ac4c-afb9-4cf1-931a-8e3957cdc97f tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] [instance: 3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:02:11.448836 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3f12ac4c-afb9-4cf1-931a-8e3957cdc97f tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:11.451250 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3f12ac4c-afb9-4cf1-931a-8e3957cdc97f tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:11.451789 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3f12ac4c-afb9-4cf1-931a-8e3957cdc97f tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:11.453453 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3f12ac4c-afb9-4cf1-931a-8e3957cdc97f tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:11.455118 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3f12ac4c-afb9-4cf1-931a-8e3957cdc97f tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:11.457421 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3f12ac4c-afb9-4cf1-931a-8e3957cdc97f tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:11.500756 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-4c3c6131-6d2a-428e-b065-1cc2e2aa36cd tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfd6d8e6a8444f5b9fcf1cf8da242ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707f869910b34768ae1a348cd0b5f284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:02:11.508175 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-4c3c6131-6d2a-428e-b065-1cc2e2aa36cd tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] 10.222.0.58 "GET /compute/v2.1/servers/9725dd3f-f5a6-496e-99c5-66ee08b6c1f7" status: 200 len: 1215 microversion: 2.1 time: 0.160090 Aug 10 23:02:11.512532 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 750/1519] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:02:11 2022] GET /compute/v2.1/servers/9725dd3f-f5a6-496e-99c5-66ee08b6c1f7 => generated 1215 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:02:11.523489 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-d2af111d-19ca-4144-a59e-8af12f9c8306 tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Calling method '.version_select at 0x7f847cfe6790>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:11.524298 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-d2af111d-19ca-4144-a59e-8af12f9c8306 tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] [instance: 38d1e924-eaea-449b-9724-1d2b16fcdfbc] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:02:11.532370 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d2af111d-19ca-4144-a59e-8af12f9c8306 tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:11.533303 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d2af111d-19ca-4144-a59e-8af12f9c8306 tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:11.533979 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d2af111d-19ca-4144-a59e-8af12f9c8306 tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:11.534944 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d2af111d-19ca-4144-a59e-8af12f9c8306 tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:11.535614 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d2af111d-19ca-4144-a59e-8af12f9c8306 tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:11.536294 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d2af111d-19ca-4144-a59e-8af12f9c8306 tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:11.831125 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-d2af111d-19ca-4144-a59e-8af12f9c8306 tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] 10.222.0.58 "GET /compute/v2.1/servers/38d1e924-eaea-449b-9724-1d2b16fcdfbc/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.317132 Aug 10 23:02:11.832563 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 751/1520] 10.222.0.58 () {58 vars in 1296 bytes} [Wed Aug 10 23:02:11 2022] GET /compute/v2.1/servers/38d1e924-eaea-449b-9724-1d2b16fcdfbc/os-instance-actions => generated 611 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:02:11.840091 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-43e7128a-522e-4538-824d-c5f70c74ead5 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:11.841134 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-43e7128a-522e-4538-824d-c5f70c74ead5 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] [instance: 1af4c3de-2464-45c7-a088-a3db68a67cb6] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:02:11.849629 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-43e7128a-522e-4538-824d-c5f70c74ead5 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:11.850354 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-43e7128a-522e-4538-824d-c5f70c74ead5 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:11.851072 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-43e7128a-522e-4538-824d-c5f70c74ead5 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:11.852241 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-43e7128a-522e-4538-824d-c5f70c74ead5 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:11.852907 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-43e7128a-522e-4538-824d-c5f70c74ead5 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:11.853542 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-43e7128a-522e-4538-824d-c5f70c74ead5 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:11.875035 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-43e7128a-522e-4538-824d-c5f70c74ead5 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] HTTP exception thrown: Instance 1af4c3de-2464-45c7-a088-a3db68a67cb6 could not be found. Aug 10 23:02:11.877105 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-43e7128a-522e-4538-824d-c5f70c74ead5 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Request method failure captured: Aug 10 23:02:11.877105 n-d-850468-14 devstack@n-api.service[122632]: request: GET /compute/v2.1/servers/1af4c3de-2464-45c7-a088-a3db68a67cb6 HTTP/1.1 Aug 10 23:02:11.877105 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:02:11.877105 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:02:11.877105 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:02:11.877105 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 23:02:11.877105 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:02:11.877105 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:02:11.877105 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:02:11.877105 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:02:11.877105 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9DgG869H1c8f0vbp0V7En7JFi_WIaXbrI3LJGQVZ9CZJGJ5tE0ttFDP0GLvV2QyQzFa98JnG3z8rMrapcPk2Wv2xg0AdGD-P9jDChgdbhVmmNjfdSCAmAgD2r7Z3NIqXzHov-GWhvIwwFP3ghOFWaMRMeNNOk3SIjTZY-cSRl1BQNss Aug 10 23:02:11.877105 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:02:11.877105 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:02:11.877105 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:02:11.877105 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:02:11.877105 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:02:11.877105 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:02:11.877105 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 307ab95daa034afbb31f90626885072b Aug 10 23:02:11.877105 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-ImagesTestJSON-1761176174 Aug 10 23:02:11.877105 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:02:11.877105 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:02:11.878653 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/307ab95daa034afbb31f90626885072b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/307ab95daa034afbb31f90626885072b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/307ab95daa034afbb31f90626885072b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_307ab95daa034afbb31f90626885072b", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:02:11.878653 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-ImagesTestJSON-1761176174 Aug 10 23:02:11.878653 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 307ab95daa034afbb31f90626885072b Aug 10 23:02:11.878653 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-ImagesTestJSON-1761176174 Aug 10 23:02:11.878653 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-ImagesTestJSON-1761176174-project Aug 10 23:02:11.878653 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:02:11.878653 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:02:11.878653 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: 7d6d9806b6724e5aaf8c69be8e70d4f3 Aug 10 23:02:11.878653 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-ImagesTestJSON-1761176174-project Aug 10 23:02:11.878653 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:02:11.878653 n-d-850468-14 devstack@n-api.service[122632]: exception: Instance 1af4c3de-2464-45c7-a088-a3db68a67cb6 could not be found. Aug 10 23:02:11.878653 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': '1af4c3de-2464-45c7-a088-a3db68a67cb6'} Aug 10 23:02:11.879548 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:02:11.879548 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:02:11.879548 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:02:11.879548 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:02:11.879548 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:02:11.879548 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:02:11.879548 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:02:11.879548 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:02:11.879548 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:02:11.879548 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:02:11.879548 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1af4c3de-2464-45c7-a088-a3db68a67cb6 could not be found. Aug 10 23:02:11.879548 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:02:11.879548 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:02:11.879548 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:02:11.879548 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:02:11.879548 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:02:11.879548 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:02:11.879548 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:02:11.879548 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:02:11.879548 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:02:11.880866 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:02:11.880866 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:02:11.880866 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:02:11.880866 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:02:11.880866 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:02:11.880866 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:02:11.880866 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:02:11.880866 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1af4c3de-2464-45c7-a088-a3db68a67cb6 could not be found. Aug 10 23:02:11.880866 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:02:11.880866 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:02:11.880866 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:02:11.880866 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:02:11.880866 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:02:11.880866 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:02:11.880866 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:02:11.880866 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:02:11.880866 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1af4c3de-2464-45c7-a088-a3db68a67cb6 could not be found. Aug 10 23:02:11.880866 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:02:11.883810 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-43e7128a-522e-4538-824d-c5f70c74ead5 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Returning 404 to user: Instance 1af4c3de-2464-45c7-a088-a3db68a67cb6 could not be found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:02:11.884913 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-43e7128a-522e-4538-824d-c5f70c74ead5 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] 10.222.0.58 "GET /compute/v2.1/servers/1af4c3de-2464-45c7-a088-a3db68a67cb6" status: 404 len: 111 microversion: 2.1 time: 0.051150 Aug 10 23:02:11.886025 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 752/1521] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:02:11 2022] GET /compute/v2.1/servers/1af4c3de-2464-45c7-a088-a3db68a67cb6 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:02:11.891872 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-cbbdd858-ce2d-49f5-bee1-f8acb4580d83 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:11.892807 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-cbbdd858-ce2d-49f5-bee1-f8acb4580d83 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] [instance: 2636ab6a-a1c8-4b70-a18f-afe073dd31db] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:02:11.900540 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cbbdd858-ce2d-49f5-bee1-f8acb4580d83 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:11.901551 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cbbdd858-ce2d-49f5-bee1-f8acb4580d83 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:11.903671 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cbbdd858-ce2d-49f5-bee1-f8acb4580d83 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:11.904774 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cbbdd858-ce2d-49f5-bee1-f8acb4580d83 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:11.905581 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cbbdd858-ce2d-49f5-bee1-f8acb4580d83 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:11.906231 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cbbdd858-ce2d-49f5-bee1-f8acb4580d83 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:11.949096 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:02:12.066177 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.objects.instance [None req-3f12ac4c-afb9-4cf1-931a-8e3957cdc97f tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Lazy-loading 'services' on Instance uuid 3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51 {{(pid=122633) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:02:12.084726 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-cbbdd858-ce2d-49f5-bee1-f8acb4580d83 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '417d4eaaeb1c4df78745496ececb3e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27e6ee9495a438b8450a4ef0d62cbcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:02:12.099666 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-cbbdd858-ce2d-49f5-bee1-f8acb4580d83 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] 10.222.0.58 "GET /compute/v2.1/servers/2636ab6a-a1c8-4b70-a18f-afe073dd31db" status: 200 len: 1277 microversion: 2.1 time: 0.206855 Aug 10 23:02:12.102938 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 753/1522] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:02:11 2022] GET /compute/v2.1/servers/2636ab6a-a1c8-4b70-a18f-afe073dd31db => generated 1277 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:02:12.112443 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-bea8ac9c-2c15-43d1-a738-d9bf4750cdb1 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:12.116708 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-bea8ac9c-2c15-43d1-a738-d9bf4750cdb1 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] [instance: 8e91f1ac-f79d-4ab0-aa13-ea32b0e74888] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:02:12.129934 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bea8ac9c-2c15-43d1-a738-d9bf4750cdb1 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:12.130418 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bea8ac9c-2c15-43d1-a738-d9bf4750cdb1 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:12.131361 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-3f12ac4c-afb9-4cf1-931a-8e3957cdc97f tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51" status: 200 len: 1970 microversion: 2.25 time: 1.375294 Aug 10 23:02:12.134729 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 770/1523] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:02:10 2022] GET /compute/v2.1/servers/3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51 => generated 1970 bytes in 1383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:02:12.135214 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bea8ac9c-2c15-43d1-a738-d9bf4750cdb1 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:12.136272 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bea8ac9c-2c15-43d1-a738-d9bf4750cdb1 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:12.137170 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bea8ac9c-2c15-43d1-a738-d9bf4750cdb1 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:12.143480 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bea8ac9c-2c15-43d1-a738-d9bf4750cdb1 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:12.146966 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-b8b4810d-78f6-4f95-920e-5020e567b952 tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:12.158179 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-b8b4810d-78f6-4f95-920e-5020e567b952 tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] [instance: 38d1e924-eaea-449b-9724-1d2b16fcdfbc] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:02:12.183883 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b8b4810d-78f6-4f95-920e-5020e567b952 tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:12.186711 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b8b4810d-78f6-4f95-920e-5020e567b952 tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:12.191752 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b8b4810d-78f6-4f95-920e-5020e567b952 tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:12.192719 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b8b4810d-78f6-4f95-920e-5020e567b952 tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:12.193212 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b8b4810d-78f6-4f95-920e-5020e567b952 tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:12.193650 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b8b4810d-78f6-4f95-920e-5020e567b952 tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:12.240707 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-bea8ac9c-2c15-43d1-a738-d9bf4750cdb1 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] 10.222.0.58 "GET /compute/v2.1/servers/8e91f1ac-f79d-4ab0-aa13-ea32b0e74888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.132199 Aug 10 23:02:12.242025 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 754/1524] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 10 23:02:12 2022] GET /compute/v2.1/servers/8e91f1ac-f79d-4ab0-aa13-ea32b0e74888/os-volume_attachments => generated 197 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:02:12.253473 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-3f334dce-3722-480c-88be-9133c7eb4ce4 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Calling method '.version_select at 0x7f847d173c10>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:12.299848 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-3f334dce-3722-480c-88be-9133c7eb4ce4 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] HTTP exception thrown: Image not found. Aug 10 23:02:12.302051 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-3f334dce-3722-480c-88be-9133c7eb4ce4 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Request method failure captured: Aug 10 23:02:12.302051 n-d-850468-14 devstack@n-api.service[122632]: request: DELETE /compute/v2.1/images/c00a0c31-f3f5-4dbc-ac74-d933d5bccb9e HTTP/1.1 Aug 10 23:02:12.302051 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:02:12.302051 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:02:12.302051 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:02:12.302051 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 23:02:12.302051 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:02:12.302051 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:02:12.302051 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:02:12.302051 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:02:12.302051 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9DgG869H1c8f0vbp0V7En7JFi_WIaXbrI3LJGQVZ9CZJGJ5tE0ttFDP0GLvV2QyQzFa98JnG3z8rMrapcPk2Wv2xg0AdGD-P9jDChgdbhVmmNjfdSCAmAgD2r7Z3NIqXzHov-GWhvIwwFP3ghOFWaMRMeNNOk3SIjTZY-cSRl1BQNss Aug 10 23:02:12.302051 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:02:12.302051 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:02:12.302051 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:02:12.302051 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:02:12.302051 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:02:12.302051 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:02:12.302051 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 307ab95daa034afbb31f90626885072b Aug 10 23:02:12.302051 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-ImagesTestJSON-1761176174 Aug 10 23:02:12.302051 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:02:12.302051 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:02:12.303932 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/307ab95daa034afbb31f90626885072b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/307ab95daa034afbb31f90626885072b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/307ab95daa034afbb31f90626885072b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_307ab95daa034afbb31f90626885072b", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:02:12.303932 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-ImagesTestJSON-1761176174 Aug 10 23:02:12.303932 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 307ab95daa034afbb31f90626885072b Aug 10 23:02:12.303932 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-ImagesTestJSON-1761176174 Aug 10 23:02:12.303932 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-ImagesTestJSON-1761176174-project Aug 10 23:02:12.303932 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:02:12.303932 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:02:12.303932 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: 7d6d9806b6724e5aaf8c69be8e70d4f3 Aug 10 23:02:12.303932 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-ImagesTestJSON-1761176174-project Aug 10 23:02:12.303932 n-d-850468-14 devstack@n-api.service[122632]: method: Aug 10 23:02:12.303932 n-d-850468-14 devstack@n-api.service[122632]: exception: Image not found. Aug 10 23:02:12.303932 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': 'c00a0c31-f3f5-4dbc-ac74-d933d5bccb9e'} Aug 10 23:02:12.303932 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:02:12.303932 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:02:12.304928 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 10 23:02:12.304928 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 10 23:02:12.304928 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 10 23:02:12.304928 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 10 23:02:12.304928 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 10 23:02:12.304928 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 10 23:02:12.304928 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 10 23:02:12.304928 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 10 23:02:12.304928 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 10 23:02:12.304928 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 10 23:02:12.304928 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 10 23:02:12.304928 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 10 23:02:12.304928 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 10 23:02:12.304928 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 10 23:02:12.304928 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image c00a0c31-f3f5-4dbc-ac74-d933d5bccb9e to delete Aug 10 23:02:12.304928 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:02:12.304928 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:02:12.304928 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:02:12.304928 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:02:12.306189 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 10 23:02:12.306189 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 10 23:02:12.306189 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 10 23:02:12.306189 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 10 23:02:12.306189 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 10 23:02:12.306189 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 10 23:02:12.306189 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image c00a0c31-f3f5-4dbc-ac74-d933d5bccb9e could not be found. Aug 10 23:02:12.306189 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:02:12.306189 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:02:12.306189 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:02:12.306189 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:02:12.306189 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:02:12.306189 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:02:12.306189 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:02:12.306189 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:02:12.306189 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 23:02:12.306189 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 23:02:12.306189 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:02:12.306189 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:02:12.306189 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 10 23:02:12.308716 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 10 23:02:12.308716 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 10 23:02:12.308716 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:02:12.308716 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:02:12.308716 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:02:12.308716 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:02:12.308716 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:02:12.308716 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:02:12.308716 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:02:12.308716 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:02:12.308716 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 10 23:02:12.308716 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:02:12.308716 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-3f334dce-3722-480c-88be-9133c7eb4ce4 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Returning 404 to user: Image not found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:02:12.309887 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-b8b4810d-78f6-4f95-920e-5020e567b952 tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] [instance: 38d1e924-eaea-449b-9724-1d2b16fcdfbc] Going to try to terminate instance {{(pid=122633) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:02:12.310003 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-3f334dce-3722-480c-88be-9133c7eb4ce4 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] 10.222.0.58 "DELETE /compute/v2.1/images/c00a0c31-f3f5-4dbc-ac74-d933d5bccb9e" status: 404 len: 62 microversion: 2.1 time: 0.058096 Aug 10 23:02:12.310003 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 755/1525] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:02:12 2022] DELETE /compute/v2.1/images/c00a0c31-f3f5-4dbc-ac74-d933d5bccb9e => generated 62 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 10 23:02:12.312274 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-24dda1f3-ca89-4f2a-8a24-05b79a1c4ab1 tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:12.312886 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-24dda1f3-ca89-4f2a-8a24-05b79a1c4ab1 tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] [instance: 3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:02:12.332030 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-24dda1f3-ca89-4f2a-8a24-05b79a1c4ab1 tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:12.332764 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-24dda1f3-ca89-4f2a-8a24-05b79a1c4ab1 tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:12.333374 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-24dda1f3-ca89-4f2a-8a24-05b79a1c4ab1 tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:12.335013 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-24dda1f3-ca89-4f2a-8a24-05b79a1c4ab1 tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:12.335641 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-24dda1f3-ca89-4f2a-8a24-05b79a1c4ab1 tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:12.336230 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-24dda1f3-ca89-4f2a-8a24-05b79a1c4ab1 tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:12.494075 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-b8b4810d-78f6-4f95-920e-5020e567b952 tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] 10.222.0.58 "DELETE /compute/v2.1/servers/38d1e924-eaea-449b-9724-1d2b16fcdfbc" status: 204 len: 0 microversion: 2.1 time: 0.356763 Aug 10 23:02:12.498911 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 771/1526] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:02:12 2022] DELETE /compute/v2.1/servers/38d1e924-eaea-449b-9724-1d2b16fcdfbc => generated 0 bytes in 359 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:02:12.502327 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-9598dbaf-05c7-419d-b956-bf7caf4e1592 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:12.503240 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-9598dbaf-05c7-419d-b956-bf7caf4e1592 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] [instance: 2a68f86c-37de-4207-aa43-6a1350342a56] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:02:12.510951 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9598dbaf-05c7-419d-b956-bf7caf4e1592 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:12.511577 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9598dbaf-05c7-419d-b956-bf7caf4e1592 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:12.512395 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9598dbaf-05c7-419d-b956-bf7caf4e1592 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:12.513500 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9598dbaf-05c7-419d-b956-bf7caf4e1592 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:12.514194 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9598dbaf-05c7-419d-b956-bf7caf4e1592 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:12.514916 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9598dbaf-05c7-419d-b956-bf7caf4e1592 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:12.577793 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-9598dbaf-05c7-419d-b956-bf7caf4e1592 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] HTTP exception thrown: Instance 2a68f86c-37de-4207-aa43-6a1350342a56 could not be found. Aug 10 23:02:12.579030 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.objects.instance [None req-24dda1f3-ca89-4f2a-8a24-05b79a1c4ab1 tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Lazy-loading 'services' on Instance uuid 3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51 {{(pid=122632) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:02:12.585805 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-9598dbaf-05c7-419d-b956-bf7caf4e1592 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Request method failure captured: Aug 10 23:02:12.585805 n-d-850468-14 devstack@n-api.service[122633]: request: DELETE /compute/v2.1/servers/2a68f86c-37de-4207-aa43-6a1350342a56 HTTP/1.1 Aug 10 23:02:12.585805 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:02:12.585805 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:02:12.585805 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:02:12.585805 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:02:12.585805 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:02:12.585805 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:02:12.585805 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:02:12.585805 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:02:12.585805 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9DgG869H1c8f0vbp0V7En7JFi_WIaXbrI3LJGQVZ9CZJGJ5tE0ttFDP0GLvV2QyQzFa98JnG3z8rMrapcPk2Wv2xg0AdGD-P9jDChgdbhVmmNjfdSCAmAgD2r7Z3NIqXzHov-GWhvIwwFP3ghOFWaMRMeNNOk3SIjTZY-cSRl1BQNss Aug 10 23:02:12.585805 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:02:12.585805 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:02:12.585805 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:02:12.585805 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:02:12.585805 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:02:12.585805 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:02:12.585805 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 307ab95daa034afbb31f90626885072b Aug 10 23:02:12.585805 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-ImagesTestJSON-1761176174 Aug 10 23:02:12.585805 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:02:12.585805 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:02:12.587379 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/307ab95daa034afbb31f90626885072b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/307ab95daa034afbb31f90626885072b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/307ab95daa034afbb31f90626885072b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_307ab95daa034afbb31f90626885072b", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:02:12.587379 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-ImagesTestJSON-1761176174 Aug 10 23:02:12.587379 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 307ab95daa034afbb31f90626885072b Aug 10 23:02:12.587379 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-ImagesTestJSON-1761176174 Aug 10 23:02:12.587379 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-ImagesTestJSON-1761176174-project Aug 10 23:02:12.587379 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:02:12.587379 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:02:12.587379 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 7d6d9806b6724e5aaf8c69be8e70d4f3 Aug 10 23:02:12.587379 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-ImagesTestJSON-1761176174-project Aug 10 23:02:12.587379 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:02:12.587379 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance 2a68f86c-37de-4207-aa43-6a1350342a56 could not be found. Aug 10 23:02:12.587379 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': '2a68f86c-37de-4207-aa43-6a1350342a56'} Aug 10 23:02:12.588419 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:02:12.588419 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:02:12.588419 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:02:12.588419 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:02:12.588419 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:02:12.588419 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:02:12.588419 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:02:12.588419 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:02:12.588419 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:02:12.588419 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:02:12.588419 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a68f86c-37de-4207-aa43-6a1350342a56 could not be found. Aug 10 23:02:12.588419 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:02:12.588419 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:02:12.588419 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:02:12.588419 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:02:12.588419 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:02:12.588419 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:02:12.588419 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:02:12.588419 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:02:12.588419 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:02:12.590544 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:02:12.590544 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 23:02:12.590544 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 23:02:12.590544 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 23:02:12.590544 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 23:02:12.590544 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:02:12.590544 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:02:12.590544 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:02:12.590544 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:02:12.590544 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a68f86c-37de-4207-aa43-6a1350342a56 could not be found. Aug 10 23:02:12.590544 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:02:12.590544 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:02:12.590544 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:02:12.590544 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:02:12.590544 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:02:12.590544 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:02:12.590544 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:02:12.590544 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:02:12.590544 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a68f86c-37de-4207-aa43-6a1350342a56 could not be found. Aug 10 23:02:12.590544 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:02:12.595974 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-9598dbaf-05c7-419d-b956-bf7caf4e1592 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Returning 404 to user: Instance 2a68f86c-37de-4207-aa43-6a1350342a56 could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:02:12.600344 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-9598dbaf-05c7-419d-b956-bf7caf4e1592 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] 10.222.0.58 "DELETE /compute/v2.1/servers/2a68f86c-37de-4207-aa43-6a1350342a56" status: 404 len: 111 microversion: 2.1 time: 0.103336 Aug 10 23:02:12.601239 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 772/1527] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:02:12 2022] DELETE /compute/v2.1/servers/2a68f86c-37de-4207-aa43-6a1350342a56 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:02:12.609840 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-fc92c026-9ad8-4776-b93c-11ff8e888973 tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:12.618553 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-fc92c026-9ad8-4776-b93c-11ff8e888973 tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] [instance: 38d1e924-eaea-449b-9724-1d2b16fcdfbc] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:02:12.626085 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-24dda1f3-ca89-4f2a-8a24-05b79a1c4ab1 tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51" status: 200 len: 1970 microversion: 2.25 time: 0.321023 Aug 10 23:02:12.642810 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 756/1528] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:02:12 2022] GET /compute/v2.1/servers/3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51 => generated 1970 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:02:12.642810 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-a8ed19ed-63ac-46f8-8b5d-b0207e8590d3 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:12.642810 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-a8ed19ed-63ac-46f8-8b5d-b0207e8590d3 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] [instance: 9725dd3f-f5a6-496e-99c5-66ee08b6c1f7] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:02:12.648300 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fc92c026-9ad8-4776-b93c-11ff8e888973 tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:12.649032 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fc92c026-9ad8-4776-b93c-11ff8e888973 tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:12.649693 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fc92c026-9ad8-4776-b93c-11ff8e888973 tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:12.650627 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fc92c026-9ad8-4776-b93c-11ff8e888973 tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:12.655459 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fc92c026-9ad8-4776-b93c-11ff8e888973 tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:12.656048 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fc92c026-9ad8-4776-b93c-11ff8e888973 tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:12.678568 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a8ed19ed-63ac-46f8-8b5d-b0207e8590d3 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:12.679917 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a8ed19ed-63ac-46f8-8b5d-b0207e8590d3 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:12.705056 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a8ed19ed-63ac-46f8-8b5d-b0207e8590d3 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:12.707496 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a8ed19ed-63ac-46f8-8b5d-b0207e8590d3 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:12.708115 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a8ed19ed-63ac-46f8-8b5d-b0207e8590d3 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:12.708695 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a8ed19ed-63ac-46f8-8b5d-b0207e8590d3 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:12.867932 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-a8ed19ed-63ac-46f8-8b5d-b0207e8590d3 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfd6d8e6a8444f5b9fcf1cf8da242ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707f869910b34768ae1a348cd0b5f284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:02:12.885557 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-a8ed19ed-63ac-46f8-8b5d-b0207e8590d3 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] 10.222.0.58 "GET /compute/v2.1/servers/9725dd3f-f5a6-496e-99c5-66ee08b6c1f7" status: 200 len: 1275 microversion: 2.1 time: 0.254732 Aug 10 23:02:12.889238 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 757/1529] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:02:12 2022] GET /compute/v2.1/servers/9725dd3f-f5a6-496e-99c5-66ee08b6c1f7 => generated 1275 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:02:12.908093 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-171b46c5-74a6-4887-8a65-4c3b0a65615d tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:12.912618 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-171b46c5-74a6-4887-8a65-4c3b0a65615d tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 3e467caf-9d1e-4dc0-830d-585aeabc1e5a] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:02:12.949769 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-171b46c5-74a6-4887-8a65-4c3b0a65615d tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:12.950489 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-171b46c5-74a6-4887-8a65-4c3b0a65615d tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:12.953591 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-171b46c5-74a6-4887-8a65-4c3b0a65615d tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:12.953946 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-171b46c5-74a6-4887-8a65-4c3b0a65615d tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:12.954436 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-171b46c5-74a6-4887-8a65-4c3b0a65615d tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:12.960628 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-171b46c5-74a6-4887-8a65-4c3b0a65615d tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:13.055718 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-171b46c5-74a6-4887-8a65-4c3b0a65615d tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 3e467caf-9d1e-4dc0-830d-585aeabc1e5a] Going to try to terminate instance {{(pid=122632) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:02:13.144704 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-fc92c026-9ad8-4776-b93c-11ff8e888973 tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb4dc460d3b4bb1a20a45d27d524cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701fe4c2829c4ef4a748cfe83d84294f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:02:13.154189 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-fc92c026-9ad8-4776-b93c-11ff8e888973 tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] 10.222.0.58 "GET /compute/v2.1/servers/38d1e924-eaea-449b-9724-1d2b16fcdfbc" status: 200 len: 1512 microversion: 2.1 time: 0.549611 Aug 10 23:02:13.174054 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 773/1530] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:02:12 2022] GET /compute/v2.1/servers/38d1e924-eaea-449b-9724-1d2b16fcdfbc => generated 1512 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:02:13.189164 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-b21e68a0-8a40-4fd5-af48-63a885db5854 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:13.194691 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-b21e68a0-8a40-4fd5-af48-63a885db5854 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] [instance: 2a68f86c-37de-4207-aa43-6a1350342a56] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:02:13.207522 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b21e68a0-8a40-4fd5-af48-63a885db5854 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:13.215421 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b21e68a0-8a40-4fd5-af48-63a885db5854 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:13.215978 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b21e68a0-8a40-4fd5-af48-63a885db5854 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:13.216750 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b21e68a0-8a40-4fd5-af48-63a885db5854 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:13.217254 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b21e68a0-8a40-4fd5-af48-63a885db5854 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:13.217666 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b21e68a0-8a40-4fd5-af48-63a885db5854 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:13.249788 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-171b46c5-74a6-4887-8a65-4c3b0a65615d tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "DELETE /compute/v2.1/servers/3e467caf-9d1e-4dc0-830d-585aeabc1e5a" status: 204 len: 0 microversion: 2.1 time: 0.358653 Aug 10 23:02:13.251512 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 758/1531] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:02:12 2022] DELETE /compute/v2.1/servers/3e467caf-9d1e-4dc0-830d-585aeabc1e5a => generated 0 bytes in 362 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:02:13.263529 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-b21e68a0-8a40-4fd5-af48-63a885db5854 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] HTTP exception thrown: Instance 2a68f86c-37de-4207-aa43-6a1350342a56 could not be found. Aug 10 23:02:13.275895 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-b21e68a0-8a40-4fd5-af48-63a885db5854 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Request method failure captured: Aug 10 23:02:13.275895 n-d-850468-14 devstack@n-api.service[122633]: request: GET /compute/v2.1/servers/2a68f86c-37de-4207-aa43-6a1350342a56 HTTP/1.1 Aug 10 23:02:13.275895 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:02:13.275895 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:02:13.275895 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:02:13.275895 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:02:13.275895 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:02:13.275895 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:02:13.275895 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:02:13.275895 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:02:13.275895 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9DgG869H1c8f0vbp0V7En7JFi_WIaXbrI3LJGQVZ9CZJGJ5tE0ttFDP0GLvV2QyQzFa98JnG3z8rMrapcPk2Wv2xg0AdGD-P9jDChgdbhVmmNjfdSCAmAgD2r7Z3NIqXzHov-GWhvIwwFP3ghOFWaMRMeNNOk3SIjTZY-cSRl1BQNss Aug 10 23:02:13.275895 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:02:13.275895 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:02:13.275895 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:02:13.275895 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:02:13.275895 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:02:13.275895 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:02:13.275895 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 307ab95daa034afbb31f90626885072b Aug 10 23:02:13.275895 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-ImagesTestJSON-1761176174 Aug 10 23:02:13.275895 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:02:13.275895 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:02:13.281378 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/307ab95daa034afbb31f90626885072b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/307ab95daa034afbb31f90626885072b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/307ab95daa034afbb31f90626885072b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_307ab95daa034afbb31f90626885072b", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:02:13.281378 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-ImagesTestJSON-1761176174 Aug 10 23:02:13.281378 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 307ab95daa034afbb31f90626885072b Aug 10 23:02:13.281378 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-ImagesTestJSON-1761176174 Aug 10 23:02:13.281378 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-ImagesTestJSON-1761176174-project Aug 10 23:02:13.281378 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:02:13.281378 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:02:13.281378 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 7d6d9806b6724e5aaf8c69be8e70d4f3 Aug 10 23:02:13.281378 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-ImagesTestJSON-1761176174-project Aug 10 23:02:13.281378 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:02:13.281378 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance 2a68f86c-37de-4207-aa43-6a1350342a56 could not be found. Aug 10 23:02:13.281378 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': '2a68f86c-37de-4207-aa43-6a1350342a56'} Aug 10 23:02:13.282199 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:02:13.282199 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:02:13.282199 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:02:13.282199 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:02:13.282199 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:02:13.282199 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:02:13.282199 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:02:13.282199 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:02:13.282199 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:02:13.282199 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:02:13.282199 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a68f86c-37de-4207-aa43-6a1350342a56 could not be found. Aug 10 23:02:13.282199 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:02:13.282199 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:02:13.282199 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:02:13.282199 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:02:13.282199 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:02:13.282199 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:02:13.282199 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:02:13.282199 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:02:13.282199 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:02:13.283828 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:02:13.283828 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:02:13.283828 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:02:13.283828 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:02:13.283828 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:02:13.283828 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:02:13.283828 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:02:13.283828 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a68f86c-37de-4207-aa43-6a1350342a56 could not be found. Aug 10 23:02:13.283828 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:02:13.283828 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:02:13.283828 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:02:13.283828 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:02:13.283828 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:02:13.283828 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:02:13.283828 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:02:13.283828 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:02:13.283828 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a68f86c-37de-4207-aa43-6a1350342a56 could not be found. Aug 10 23:02:13.283828 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:02:13.286440 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-b21e68a0-8a40-4fd5-af48-63a885db5854 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Returning 404 to user: Instance 2a68f86c-37de-4207-aa43-6a1350342a56 could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:02:13.286440 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-b21e68a0-8a40-4fd5-af48-63a885db5854 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] 10.222.0.58 "GET /compute/v2.1/servers/2a68f86c-37de-4207-aa43-6a1350342a56" status: 404 len: 111 microversion: 2.1 time: 0.102413 Aug 10 23:02:13.286440 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 774/1532] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:02:13 2022] GET /compute/v2.1/servers/2a68f86c-37de-4207-aa43-6a1350342a56 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:02:13.286835 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-8bd46a98-3fdd-454b-83ba-0ddeefc2b197 tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:13.286975 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-717973f3-7cf4-4780-942d-058c45c07ddf tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:13.286975 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-717973f3-7cf4-4780-942d-058c45c07ddf tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] [instance: 2636ab6a-a1c8-4b70-a18f-afe073dd31db] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:02:13.295370 n-d-850468-14 devstack@n-api.service[122632]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 23:02:13.295370 n-d-850468-14 devstack@n-api.service[122632]: warnings.warn(msg) Aug 10 23:02:13.297442 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8bd46a98-3fdd-454b-83ba-0ddeefc2b197 tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:13.297935 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8bd46a98-3fdd-454b-83ba-0ddeefc2b197 tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:13.298395 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8bd46a98-3fdd-454b-83ba-0ddeefc2b197 tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:13.299162 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8bd46a98-3fdd-454b-83ba-0ddeefc2b197 tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:13.299622 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8bd46a98-3fdd-454b-83ba-0ddeefc2b197 tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:13.300047 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8bd46a98-3fdd-454b-83ba-0ddeefc2b197 tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:13.306197 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-717973f3-7cf4-4780-942d-058c45c07ddf tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:13.306701 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-717973f3-7cf4-4780-942d-058c45c07ddf tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:13.307177 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-717973f3-7cf4-4780-942d-058c45c07ddf tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:13.307902 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-717973f3-7cf4-4780-942d-058c45c07ddf tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:13.308687 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-717973f3-7cf4-4780-942d-058c45c07ddf tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:13.309126 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-717973f3-7cf4-4780-942d-058c45c07ddf tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:13.414658 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-717973f3-7cf4-4780-942d-058c45c07ddf tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '417d4eaaeb1c4df78745496ececb3e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27e6ee9495a438b8450a4ef0d62cbcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:02:13.442713 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-8bd46a98-3fdd-454b-83ba-0ddeefc2b197 tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] 10.222.0.58 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.188500 Aug 10 23:02:13.445246 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-717973f3-7cf4-4780-942d-058c45c07ddf tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] 10.222.0.58 "GET /compute/v2.1/servers/2636ab6a-a1c8-4b70-a18f-afe073dd31db" status: 200 len: 1275 microversion: 2.1 time: 0.163322 Aug 10 23:02:13.446108 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 775/1533] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:02:13 2022] GET /compute/v2.1/servers/2636ab6a-a1c8-4b70-a18f-afe073dd31db => generated 1275 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:02:13.459397 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 759/1534] 10.222.0.58 () {60 vars in 1217 bytes} [Wed Aug 10 23:02:13 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 23:02:13.476289 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-38361701-4df9-46a3-8beb-0a1fd1775494 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:13.480537 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-40e9fa27-de61-49ac-9880-302c98168f58 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:13.481710 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-40e9fa27-de61-49ac-9880-302c98168f58 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 3e467caf-9d1e-4dc0-830d-585aeabc1e5a] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:02:13.487019 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-38361701-4df9-46a3-8beb-0a1fd1775494 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] [instance: 8e91f1ac-f79d-4ab0-aa13-ea32b0e74888] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:02:13.498751 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-40e9fa27-de61-49ac-9880-302c98168f58 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:13.500067 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-40e9fa27-de61-49ac-9880-302c98168f58 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:13.501993 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-40e9fa27-de61-49ac-9880-302c98168f58 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:13.502985 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-40e9fa27-de61-49ac-9880-302c98168f58 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:13.504945 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-38361701-4df9-46a3-8beb-0a1fd1775494 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:13.506050 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-40e9fa27-de61-49ac-9880-302c98168f58 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:13.506744 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-40e9fa27-de61-49ac-9880-302c98168f58 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:13.507240 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-38361701-4df9-46a3-8beb-0a1fd1775494 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:13.507728 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-38361701-4df9-46a3-8beb-0a1fd1775494 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:13.508466 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-38361701-4df9-46a3-8beb-0a1fd1775494 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:13.521279 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-38361701-4df9-46a3-8beb-0a1fd1775494 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:13.527808 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-38361701-4df9-46a3-8beb-0a1fd1775494 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:13.640517 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-38361701-4df9-46a3-8beb-0a1fd1775494 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] 10.222.0.58 "GET /compute/v2.1/servers/8e91f1ac-f79d-4ab0-aa13-ea32b0e74888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.185695 Aug 10 23:02:13.642768 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 776/1535] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 10 23:02:13 2022] GET /compute/v2.1/servers/8e91f1ac-f79d-4ab0-aa13-ea32b0e74888/os-volume_attachments => generated 197 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:02:13.654344 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-3aeb0203-7c40-4025-9411-2d5c46fe7dc2 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Calling method '.version_select at 0x7f847d1db790>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:13.697548 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-3aeb0203-7c40-4025-9411-2d5c46fe7dc2 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] HTTP exception thrown: Image not found. Aug 10 23:02:13.699927 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-3aeb0203-7c40-4025-9411-2d5c46fe7dc2 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Request method failure captured: Aug 10 23:02:13.699927 n-d-850468-14 devstack@n-api.service[122633]: request: DELETE /compute/v2.1/images/e2865b60-3ea2-4c52-b3d9-f3a6e58bc75a HTTP/1.1 Aug 10 23:02:13.699927 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:02:13.699927 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:02:13.699927 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:02:13.699927 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:02:13.699927 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:02:13.699927 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:02:13.699927 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:02:13.699927 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:02:13.699927 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9DgG869H1c8f0vbp0V7En7JFi_WIaXbrI3LJGQVZ9CZJGJ5tE0ttFDP0GLvV2QyQzFa98JnG3z8rMrapcPk2Wv2xg0AdGD-P9jDChgdbhVmmNjfdSCAmAgD2r7Z3NIqXzHov-GWhvIwwFP3ghOFWaMRMeNNOk3SIjTZY-cSRl1BQNss Aug 10 23:02:13.699927 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:02:13.699927 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:02:13.699927 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:02:13.699927 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:02:13.699927 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:02:13.699927 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:02:13.699927 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 307ab95daa034afbb31f90626885072b Aug 10 23:02:13.699927 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-ImagesTestJSON-1761176174 Aug 10 23:02:13.699927 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:02:13.699927 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:02:13.702119 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/307ab95daa034afbb31f90626885072b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/307ab95daa034afbb31f90626885072b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/307ab95daa034afbb31f90626885072b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_307ab95daa034afbb31f90626885072b", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:02:13.702119 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-ImagesTestJSON-1761176174 Aug 10 23:02:13.702119 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 307ab95daa034afbb31f90626885072b Aug 10 23:02:13.702119 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-ImagesTestJSON-1761176174 Aug 10 23:02:13.702119 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-ImagesTestJSON-1761176174-project Aug 10 23:02:13.702119 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:02:13.702119 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:02:13.702119 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 7d6d9806b6724e5aaf8c69be8e70d4f3 Aug 10 23:02:13.702119 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-ImagesTestJSON-1761176174-project Aug 10 23:02:13.702119 n-d-850468-14 devstack@n-api.service[122633]: method: Aug 10 23:02:13.702119 n-d-850468-14 devstack@n-api.service[122633]: exception: Image not found. Aug 10 23:02:13.702119 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': 'e2865b60-3ea2-4c52-b3d9-f3a6e58bc75a'} Aug 10 23:02:13.702119 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:02:13.702119 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:02:13.703391 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 10 23:02:13.703391 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 10 23:02:13.703391 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 10 23:02:13.703391 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 10 23:02:13.703391 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 10 23:02:13.703391 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 10 23:02:13.703391 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 10 23:02:13.703391 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 10 23:02:13.703391 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 10 23:02:13.703391 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 10 23:02:13.703391 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 10 23:02:13.703391 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 10 23:02:13.703391 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 10 23:02:13.703391 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 10 23:02:13.703391 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image e2865b60-3ea2-4c52-b3d9-f3a6e58bc75a to delete Aug 10 23:02:13.703391 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:02:13.703391 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:02:13.703391 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:02:13.703391 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:02:13.706406 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 10 23:02:13.706406 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 10 23:02:13.706406 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 10 23:02:13.706406 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 10 23:02:13.706406 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 10 23:02:13.706406 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 10 23:02:13.706406 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image e2865b60-3ea2-4c52-b3d9-f3a6e58bc75a could not be found. Aug 10 23:02:13.706406 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:02:13.706406 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:02:13.706406 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:02:13.706406 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:02:13.706406 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:02:13.706406 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:02:13.706406 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:02:13.706406 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:02:13.706406 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 23:02:13.706406 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 23:02:13.706406 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:02:13.706406 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:02:13.706406 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 10 23:02:13.710204 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 10 23:02:13.710204 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 10 23:02:13.710204 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:02:13.710204 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:02:13.710204 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:02:13.710204 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:02:13.710204 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:02:13.710204 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:02:13.710204 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:02:13.710204 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:02:13.710204 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 10 23:02:13.710204 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:02:13.710204 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-3aeb0203-7c40-4025-9411-2d5c46fe7dc2 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Returning 404 to user: Image not found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:02:13.710204 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-3aeb0203-7c40-4025-9411-2d5c46fe7dc2 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] 10.222.0.58 "DELETE /compute/v2.1/images/e2865b60-3ea2-4c52-b3d9-f3a6e58bc75a" status: 404 len: 62 microversion: 2.1 time: 0.058934 Aug 10 23:02:13.710204 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 777/1536] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:02:13 2022] DELETE /compute/v2.1/images/e2865b60-3ea2-4c52-b3d9-f3a6e58bc75a => generated 62 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 10 23:02:13.721763 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-5ad86ee8-b71c-4b6b-8c08-518960e3189e tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-850468-14", "block_migration": "auto"}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:02:13.733154 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-5ad86ee8-b71c-4b6b-8c08-518960e3189e tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] [instance: 3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:02:13.758564 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5ad86ee8-b71c-4b6b-8c08-518960e3189e tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:13.760084 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5ad86ee8-b71c-4b6b-8c08-518960e3189e tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:13.764467 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5ad86ee8-b71c-4b6b-8c08-518960e3189e tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:13.765948 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5ad86ee8-b71c-4b6b-8c08-518960e3189e tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:13.768250 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5ad86ee8-b71c-4b6b-8c08-518960e3189e tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:13.768799 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5ad86ee8-b71c-4b6b-8c08-518960e3189e tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:13.839774 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.objects.instance [None req-5ad86ee8-b71c-4b6b-8c08-518960e3189e tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Lazy-loading 'flavor' on Instance uuid 3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51 {{(pid=122633) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:02:13.875019 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-5ad86ee8-b71c-4b6b-8c08-518960e3189e tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] [instance: 3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51] Going to try to live migrate instance to n-h2-850468-14 {{(pid=122633) live_migrate /opt/stack/nova/nova/compute/api.py:5443}} Aug 10 23:02:14.072524 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-40e9fa27-de61-49ac-9880-302c98168f58 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:02:14.088619 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-40e9fa27-de61-49ac-9880-302c98168f58 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/3e467caf-9d1e-4dc0-830d-585aeabc1e5a" status: 200 len: 1469 microversion: 2.1 time: 0.627376 Aug 10 23:02:14.090086 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 760/1537] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:02:13 2022] GET /compute/v2.1/servers/3e467caf-9d1e-4dc0-830d-585aeabc1e5a => generated 1469 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:02:14.095653 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-15433806-de9f-41c6-8948-82050c6e8d5b tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:14.096839 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-15433806-de9f-41c6-8948-82050c6e8d5b tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] [instance: f3722f40-7320-484b-8c20-78b2de3e89f1] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:02:14.114675 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-15433806-de9f-41c6-8948-82050c6e8d5b tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:14.117472 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-15433806-de9f-41c6-8948-82050c6e8d5b tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:14.118330 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-15433806-de9f-41c6-8948-82050c6e8d5b tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:14.120611 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-15433806-de9f-41c6-8948-82050c6e8d5b tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:14.121362 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-15433806-de9f-41c6-8948-82050c6e8d5b tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:14.126912 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-15433806-de9f-41c6-8948-82050c6e8d5b tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:14.154014 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-15433806-de9f-41c6-8948-82050c6e8d5b tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] HTTP exception thrown: Instance f3722f40-7320-484b-8c20-78b2de3e89f1 could not be found. Aug 10 23:02:14.160032 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-15433806-de9f-41c6-8948-82050c6e8d5b tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Request method failure captured: Aug 10 23:02:14.160032 n-d-850468-14 devstack@n-api.service[122632]: request: DELETE /compute/v2.1/servers/f3722f40-7320-484b-8c20-78b2de3e89f1 HTTP/1.1 Aug 10 23:02:14.160032 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:02:14.160032 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:02:14.160032 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:02:14.160032 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 23:02:14.160032 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:02:14.160032 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:02:14.160032 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:02:14.160032 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:02:14.160032 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9DgG869H1c8f0vbp0V7En7JFi_WIaXbrI3LJGQVZ9CZJGJ5tE0ttFDP0GLvV2QyQzFa98JnG3z8rMrapcPk2Wv2xg0AdGD-P9jDChgdbhVmmNjfdSCAmAgD2r7Z3NIqXzHov-GWhvIwwFP3ghOFWaMRMeNNOk3SIjTZY-cSRl1BQNss Aug 10 23:02:14.160032 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:02:14.160032 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:02:14.160032 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:02:14.160032 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:02:14.160032 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:02:14.160032 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:02:14.160032 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 307ab95daa034afbb31f90626885072b Aug 10 23:02:14.160032 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-ImagesTestJSON-1761176174 Aug 10 23:02:14.160032 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:02:14.160032 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:02:14.161695 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/307ab95daa034afbb31f90626885072b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/307ab95daa034afbb31f90626885072b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/307ab95daa034afbb31f90626885072b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_307ab95daa034afbb31f90626885072b", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:02:14.161695 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-ImagesTestJSON-1761176174 Aug 10 23:02:14.161695 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 307ab95daa034afbb31f90626885072b Aug 10 23:02:14.161695 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-ImagesTestJSON-1761176174 Aug 10 23:02:14.161695 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-ImagesTestJSON-1761176174-project Aug 10 23:02:14.161695 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:02:14.161695 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:02:14.161695 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: 7d6d9806b6724e5aaf8c69be8e70d4f3 Aug 10 23:02:14.161695 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-ImagesTestJSON-1761176174-project Aug 10 23:02:14.161695 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:02:14.161695 n-d-850468-14 devstack@n-api.service[122632]: exception: Instance f3722f40-7320-484b-8c20-78b2de3e89f1 could not be found. Aug 10 23:02:14.161695 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': 'f3722f40-7320-484b-8c20-78b2de3e89f1'} Aug 10 23:02:14.162522 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:02:14.162522 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:02:14.162522 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:02:14.162522 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:02:14.162522 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:02:14.162522 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:02:14.162522 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:02:14.162522 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:02:14.162522 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:02:14.162522 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:02:14.162522 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3722f40-7320-484b-8c20-78b2de3e89f1 could not be found. Aug 10 23:02:14.162522 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:02:14.162522 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:02:14.162522 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:02:14.162522 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:02:14.162522 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:02:14.162522 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:02:14.162522 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:02:14.162522 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:02:14.162522 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:02:14.163871 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:02:14.163871 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 23:02:14.163871 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 23:02:14.163871 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 23:02:14.163871 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 23:02:14.163871 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:02:14.163871 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:02:14.163871 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:02:14.163871 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:02:14.163871 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3722f40-7320-484b-8c20-78b2de3e89f1 could not be found. Aug 10 23:02:14.163871 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:02:14.163871 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:02:14.163871 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:02:14.163871 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:02:14.163871 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:02:14.163871 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:02:14.163871 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:02:14.163871 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:02:14.163871 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3722f40-7320-484b-8c20-78b2de3e89f1 could not be found. Aug 10 23:02:14.163871 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:02:14.169981 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-15433806-de9f-41c6-8948-82050c6e8d5b tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Returning 404 to user: Instance f3722f40-7320-484b-8c20-78b2de3e89f1 could not be found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:02:14.171930 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-15433806-de9f-41c6-8948-82050c6e8d5b tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] 10.222.0.58 "DELETE /compute/v2.1/servers/f3722f40-7320-484b-8c20-78b2de3e89f1" status: 404 len: 111 microversion: 2.1 time: 0.079190 Aug 10 23:02:14.174585 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 761/1538] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:02:14 2022] DELETE /compute/v2.1/servers/f3722f40-7320-484b-8c20-78b2de3e89f1 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:02:14.182490 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-899c19ae-d75d-4b86-840a-0c07c25a516b tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:14.185642 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-899c19ae-d75d-4b86-840a-0c07c25a516b tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] [instance: 9725dd3f-f5a6-496e-99c5-66ee08b6c1f7] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:02:14.201507 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-899c19ae-d75d-4b86-840a-0c07c25a516b tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:14.204103 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-899c19ae-d75d-4b86-840a-0c07c25a516b tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:14.204987 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-899c19ae-d75d-4b86-840a-0c07c25a516b tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:14.207935 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-899c19ae-d75d-4b86-840a-0c07c25a516b tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:14.209946 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-899c19ae-d75d-4b86-840a-0c07c25a516b tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:14.210533 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-899c19ae-d75d-4b86-840a-0c07c25a516b tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:14.347000 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-899c19ae-d75d-4b86-840a-0c07c25a516b tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfd6d8e6a8444f5b9fcf1cf8da242ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707f869910b34768ae1a348cd0b5f284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:02:14.362004 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-899c19ae-d75d-4b86-840a-0c07c25a516b tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] 10.222.0.58 "GET /compute/v2.1/servers/9725dd3f-f5a6-496e-99c5-66ee08b6c1f7" status: 200 len: 1273 microversion: 2.1 time: 0.186085 Aug 10 23:02:14.368530 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 762/1539] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:02:14 2022] GET /compute/v2.1/servers/9725dd3f-f5a6-496e-99c5-66ee08b6c1f7 => generated 1273 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:02:14.381468 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-3adaefe1-6986-4606-990f-bb2807767774 tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:14.382096 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-3adaefe1-6986-4606-990f-bb2807767774 tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] [instance: 38d1e924-eaea-449b-9724-1d2b16fcdfbc] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:02:14.395806 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3adaefe1-6986-4606-990f-bb2807767774 tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:14.396305 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3adaefe1-6986-4606-990f-bb2807767774 tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:14.397402 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3adaefe1-6986-4606-990f-bb2807767774 tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:14.398176 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3adaefe1-6986-4606-990f-bb2807767774 tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:14.401016 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3adaefe1-6986-4606-990f-bb2807767774 tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:14.401515 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3adaefe1-6986-4606-990f-bb2807767774 tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:15.087467 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-3adaefe1-6986-4606-990f-bb2807767774 tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abb4dc460d3b4bb1a20a45d27d524cd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '701fe4c2829c4ef4a748cfe83d84294f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:02:15.099913 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-3adaefe1-6986-4606-990f-bb2807767774 tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] 10.222.0.58 "GET /compute/v2.1/servers/38d1e924-eaea-449b-9724-1d2b16fcdfbc" status: 200 len: 1512 microversion: 2.1 time: 0.730215 Aug 10 23:02:15.103926 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 763/1540] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:02:14 2022] GET /compute/v2.1/servers/38d1e924-eaea-449b-9724-1d2b16fcdfbc => generated 1512 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:02:15.116879 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-543bd6e2-6a50-4611-8991-58d460381c22 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:15.126218 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-543bd6e2-6a50-4611-8991-58d460381c22 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] [instance: f3722f40-7320-484b-8c20-78b2de3e89f1] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:02:15.144404 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-543bd6e2-6a50-4611-8991-58d460381c22 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:15.145283 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-543bd6e2-6a50-4611-8991-58d460381c22 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:15.145801 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-543bd6e2-6a50-4611-8991-58d460381c22 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:15.146824 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-543bd6e2-6a50-4611-8991-58d460381c22 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:15.149091 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-543bd6e2-6a50-4611-8991-58d460381c22 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:15.149777 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-543bd6e2-6a50-4611-8991-58d460381c22 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:15.191487 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-543bd6e2-6a50-4611-8991-58d460381c22 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] HTTP exception thrown: Instance f3722f40-7320-484b-8c20-78b2de3e89f1 could not be found. Aug 10 23:02:15.205162 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-543bd6e2-6a50-4611-8991-58d460381c22 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Request method failure captured: Aug 10 23:02:15.205162 n-d-850468-14 devstack@n-api.service[122632]: request: GET /compute/v2.1/servers/f3722f40-7320-484b-8c20-78b2de3e89f1 HTTP/1.1 Aug 10 23:02:15.205162 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:02:15.205162 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:02:15.205162 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:02:15.205162 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 23:02:15.205162 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:02:15.205162 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:02:15.205162 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:02:15.205162 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:02:15.205162 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9DgG869H1c8f0vbp0V7En7JFi_WIaXbrI3LJGQVZ9CZJGJ5tE0ttFDP0GLvV2QyQzFa98JnG3z8rMrapcPk2Wv2xg0AdGD-P9jDChgdbhVmmNjfdSCAmAgD2r7Z3NIqXzHov-GWhvIwwFP3ghOFWaMRMeNNOk3SIjTZY-cSRl1BQNss Aug 10 23:02:15.205162 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:02:15.205162 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:02:15.205162 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:02:15.205162 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:02:15.205162 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:02:15.205162 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:02:15.205162 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 307ab95daa034afbb31f90626885072b Aug 10 23:02:15.205162 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-ImagesTestJSON-1761176174 Aug 10 23:02:15.205162 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:02:15.205162 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:02:15.206656 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/307ab95daa034afbb31f90626885072b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/307ab95daa034afbb31f90626885072b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/307ab95daa034afbb31f90626885072b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_307ab95daa034afbb31f90626885072b", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:02:15.206656 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-ImagesTestJSON-1761176174 Aug 10 23:02:15.206656 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 307ab95daa034afbb31f90626885072b Aug 10 23:02:15.206656 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-ImagesTestJSON-1761176174 Aug 10 23:02:15.206656 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-ImagesTestJSON-1761176174-project Aug 10 23:02:15.206656 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:02:15.206656 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:02:15.206656 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: 7d6d9806b6724e5aaf8c69be8e70d4f3 Aug 10 23:02:15.206656 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-ImagesTestJSON-1761176174-project Aug 10 23:02:15.206656 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:02:15.206656 n-d-850468-14 devstack@n-api.service[122632]: exception: Instance f3722f40-7320-484b-8c20-78b2de3e89f1 could not be found. Aug 10 23:02:15.206656 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': 'f3722f40-7320-484b-8c20-78b2de3e89f1'} Aug 10 23:02:15.207623 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:02:15.207623 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:02:15.207623 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:02:15.207623 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:02:15.207623 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:02:15.207623 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:02:15.207623 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:02:15.207623 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:02:15.207623 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:02:15.207623 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:02:15.207623 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3722f40-7320-484b-8c20-78b2de3e89f1 could not be found. Aug 10 23:02:15.207623 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:02:15.207623 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:02:15.207623 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:02:15.207623 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:02:15.207623 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:02:15.207623 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:02:15.207623 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:02:15.207623 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:02:15.207623 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:02:15.208968 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:02:15.208968 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:02:15.208968 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:02:15.208968 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:02:15.208968 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:02:15.208968 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:02:15.208968 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:02:15.208968 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3722f40-7320-484b-8c20-78b2de3e89f1 could not be found. Aug 10 23:02:15.208968 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:02:15.208968 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:02:15.208968 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:02:15.208968 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:02:15.208968 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:02:15.208968 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:02:15.208968 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:02:15.208968 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:02:15.208968 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3722f40-7320-484b-8c20-78b2de3e89f1 could not be found. Aug 10 23:02:15.208968 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:02:15.211660 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-543bd6e2-6a50-4611-8991-58d460381c22 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Returning 404 to user: Instance f3722f40-7320-484b-8c20-78b2de3e89f1 could not be found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:02:15.212836 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-543bd6e2-6a50-4611-8991-58d460381c22 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] 10.222.0.58 "GET /compute/v2.1/servers/f3722f40-7320-484b-8c20-78b2de3e89f1" status: 404 len: 111 microversion: 2.1 time: 0.103937 Aug 10 23:02:15.219085 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 764/1541] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:02:15 2022] GET /compute/v2.1/servers/f3722f40-7320-484b-8c20-78b2de3e89f1 => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:02:15.227445 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-37837133-35fd-464a-a633-23006609b5ca tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:15.231678 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-37837133-35fd-464a-a633-23006609b5ca tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] [instance: 2636ab6a-a1c8-4b70-a18f-afe073dd31db] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:02:15.250376 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-37837133-35fd-464a-a633-23006609b5ca tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:15.251475 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-37837133-35fd-464a-a633-23006609b5ca tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:15.252150 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-37837133-35fd-464a-a633-23006609b5ca tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:15.253098 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-37837133-35fd-464a-a633-23006609b5ca tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:15.253846 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-37837133-35fd-464a-a633-23006609b5ca tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:15.254527 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-37837133-35fd-464a-a633-23006609b5ca tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:16.047782 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-37837133-35fd-464a-a633-23006609b5ca tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '417d4eaaeb1c4df78745496ececb3e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27e6ee9495a438b8450a4ef0d62cbcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:02:16.071936 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-37837133-35fd-464a-a633-23006609b5ca tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] 10.222.0.58 "GET /compute/v2.1/servers/2636ab6a-a1c8-4b70-a18f-afe073dd31db" status: 200 len: 1317 microversion: 2.1 time: 0.851393 Aug 10 23:02:16.072932 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 765/1542] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:02:15 2022] GET /compute/v2.1/servers/2636ab6a-a1c8-4b70-a18f-afe073dd31db => generated 1317 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:02:16.100701 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-fb55a51a-076d-4f44-9f1b-e5d759b18fd6 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:16.110336 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-fb55a51a-076d-4f44-9f1b-e5d759b18fd6 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] [instance: 8e91f1ac-f79d-4ab0-aa13-ea32b0e74888] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:02:16.132594 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fb55a51a-076d-4f44-9f1b-e5d759b18fd6 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:16.133021 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fb55a51a-076d-4f44-9f1b-e5d759b18fd6 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:16.133687 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fb55a51a-076d-4f44-9f1b-e5d759b18fd6 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:16.134599 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fb55a51a-076d-4f44-9f1b-e5d759b18fd6 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:16.139521 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fb55a51a-076d-4f44-9f1b-e5d759b18fd6 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:16.143047 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fb55a51a-076d-4f44-9f1b-e5d759b18fd6 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:16.212493 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-fb55a51a-076d-4f44-9f1b-e5d759b18fd6 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] 10.222.0.58 "GET /compute/v2.1/servers/8e91f1ac-f79d-4ab0-aa13-ea32b0e74888/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.135337 Aug 10 23:02:16.223858 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 766/1543] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 10 23:02:16 2022] GET /compute/v2.1/servers/8e91f1ac-f79d-4ab0-aa13-ea32b0e74888/os-volume_attachments => generated 197 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:02:16.237832 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-cf8935ba-1aba-423c-b634-8b68d3bd4735 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:16.248327 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-cf8935ba-1aba-423c-b634-8b68d3bd4735 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 3e467caf-9d1e-4dc0-830d-585aeabc1e5a] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:02:16.267903 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cf8935ba-1aba-423c-b634-8b68d3bd4735 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:16.268735 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cf8935ba-1aba-423c-b634-8b68d3bd4735 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:16.269410 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cf8935ba-1aba-423c-b634-8b68d3bd4735 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:16.270343 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cf8935ba-1aba-423c-b634-8b68d3bd4735 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:16.271083 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cf8935ba-1aba-423c-b634-8b68d3bd4735 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:16.271728 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cf8935ba-1aba-423c-b634-8b68d3bd4735 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:16.831169 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-cf8935ba-1aba-423c-b634-8b68d3bd4735 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:02:16.845211 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-cf8935ba-1aba-423c-b634-8b68d3bd4735 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/3e467caf-9d1e-4dc0-830d-585aeabc1e5a" status: 200 len: 1469 microversion: 2.1 time: 0.612939 Aug 10 23:02:16.847232 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 767/1544] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:02:16 2022] GET /compute/v2.1/servers/3e467caf-9d1e-4dc0-830d-585aeabc1e5a => generated 1469 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:02:16.860745 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-820f30af-f9d8-40c4-b288-075d49ed3213 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Calling method '.version_select at 0x7f847d1b7040>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:16.926466 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-820f30af-f9d8-40c4-b288-075d49ed3213 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] HTTP exception thrown: Image not found. Aug 10 23:02:16.929955 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-820f30af-f9d8-40c4-b288-075d49ed3213 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Request method failure captured: Aug 10 23:02:16.929955 n-d-850468-14 devstack@n-api.service[122632]: request: DELETE /compute/v2.1/images/62f64dd0-73ef-4e90-b110-f212252849b4 HTTP/1.1 Aug 10 23:02:16.929955 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:02:16.929955 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:02:16.929955 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:02:16.929955 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 23:02:16.929955 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:02:16.929955 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:02:16.929955 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:02:16.929955 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:02:16.929955 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9DgG869H1c8f0vbp0V7En7JFi_WIaXbrI3LJGQVZ9CZJGJ5tE0ttFDP0GLvV2QyQzFa98JnG3z8rMrapcPk2Wv2xg0AdGD-P9jDChgdbhVmmNjfdSCAmAgD2r7Z3NIqXzHov-GWhvIwwFP3ghOFWaMRMeNNOk3SIjTZY-cSRl1BQNss Aug 10 23:02:16.929955 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:02:16.929955 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:02:16.929955 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:02:16.929955 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:02:16.929955 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:02:16.929955 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:02:16.929955 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 307ab95daa034afbb31f90626885072b Aug 10 23:02:16.929955 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-ImagesTestJSON-1761176174 Aug 10 23:02:16.929955 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:02:16.929955 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:02:16.931528 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/307ab95daa034afbb31f90626885072b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/307ab95daa034afbb31f90626885072b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/307ab95daa034afbb31f90626885072b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_307ab95daa034afbb31f90626885072b", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:02:16.931528 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-ImagesTestJSON-1761176174 Aug 10 23:02:16.931528 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 307ab95daa034afbb31f90626885072b Aug 10 23:02:16.931528 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-ImagesTestJSON-1761176174 Aug 10 23:02:16.931528 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-ImagesTestJSON-1761176174-project Aug 10 23:02:16.931528 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:02:16.931528 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:02:16.931528 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: 7d6d9806b6724e5aaf8c69be8e70d4f3 Aug 10 23:02:16.931528 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-ImagesTestJSON-1761176174-project Aug 10 23:02:16.931528 n-d-850468-14 devstack@n-api.service[122632]: method: Aug 10 23:02:16.931528 n-d-850468-14 devstack@n-api.service[122632]: exception: Image not found. Aug 10 23:02:16.931528 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': '62f64dd0-73ef-4e90-b110-f212252849b4'} Aug 10 23:02:16.931528 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:02:16.931528 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:02:16.932492 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 10 23:02:16.932492 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 10 23:02:16.932492 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 10 23:02:16.932492 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 10 23:02:16.932492 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 10 23:02:16.932492 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 10 23:02:16.932492 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 10 23:02:16.932492 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 10 23:02:16.932492 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 10 23:02:16.932492 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 10 23:02:16.932492 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 10 23:02:16.932492 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 10 23:02:16.932492 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 10 23:02:16.932492 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 10 23:02:16.932492 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 62f64dd0-73ef-4e90-b110-f212252849b4 to delete Aug 10 23:02:16.932492 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:02:16.932492 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:02:16.932492 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:02:16.932492 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:02:16.934101 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 10 23:02:16.934101 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 10 23:02:16.934101 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 10 23:02:16.934101 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 10 23:02:16.934101 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 10 23:02:16.934101 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 10 23:02:16.934101 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 62f64dd0-73ef-4e90-b110-f212252849b4 could not be found. Aug 10 23:02:16.934101 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:02:16.934101 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:02:16.934101 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:02:16.934101 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:02:16.934101 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:02:16.934101 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:02:16.934101 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:02:16.934101 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:02:16.934101 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 23:02:16.934101 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 23:02:16.934101 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:02:16.934101 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:02:16.934101 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 10 23:02:16.935607 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 10 23:02:16.935607 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 10 23:02:16.935607 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:02:16.935607 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:02:16.935607 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:02:16.935607 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:02:16.935607 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:02:16.935607 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:02:16.935607 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:02:16.935607 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:02:16.935607 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 10 23:02:16.935607 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:02:16.941692 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-820f30af-f9d8-40c4-b288-075d49ed3213 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Returning 404 to user: Image not found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:02:16.944092 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-820f30af-f9d8-40c4-b288-075d49ed3213 tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] 10.222.0.58 "DELETE /compute/v2.1/images/62f64dd0-73ef-4e90-b110-f212252849b4" status: 404 len: 62 microversion: 2.1 time: 0.095868 Aug 10 23:02:16.946285 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 768/1545] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:02:16 2022] DELETE /compute/v2.1/images/62f64dd0-73ef-4e90-b110-f212252849b4 => generated 62 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 10 23:02:16.959501 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-2ccbcd87-9923-4cdb-b7e7-228f3803cc18 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:16.961722 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-2ccbcd87-9923-4cdb-b7e7-228f3803cc18 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] [instance: 9725dd3f-f5a6-496e-99c5-66ee08b6c1f7] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:02:16.990753 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2ccbcd87-9923-4cdb-b7e7-228f3803cc18 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:16.992052 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2ccbcd87-9923-4cdb-b7e7-228f3803cc18 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:16.994658 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2ccbcd87-9923-4cdb-b7e7-228f3803cc18 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:16.996707 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2ccbcd87-9923-4cdb-b7e7-228f3803cc18 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:17.002775 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2ccbcd87-9923-4cdb-b7e7-228f3803cc18 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:17.011539 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2ccbcd87-9923-4cdb-b7e7-228f3803cc18 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:17.764050 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-2ccbcd87-9923-4cdb-b7e7-228f3803cc18 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfd6d8e6a8444f5b9fcf1cf8da242ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707f869910b34768ae1a348cd0b5f284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:02:17.784774 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-2ccbcd87-9923-4cdb-b7e7-228f3803cc18 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] 10.222.0.58 "GET /compute/v2.1/servers/9725dd3f-f5a6-496e-99c5-66ee08b6c1f7" status: 200 len: 1315 microversion: 2.1 time: 0.830738 Aug 10 23:02:17.803076 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 769/1546] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:02:16 2022] GET /compute/v2.1/servers/9725dd3f-f5a6-496e-99c5-66ee08b6c1f7 => generated 1315 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:02:17.811270 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-0f447d52-472d-48ad-8c9e-561fb7e7e060 req-64fc8148-26f8-403c-8acb-ab2a0ddd390a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38d1e924-eaea-449b-9724-1d2b16fcdfbc", "name": "network-vif-deleted", "tag": "6456c6d8-67cf-4eb9-a700-b8d5398267d5"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:02:17.824690 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:02:17.827782 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-0f447d52-472d-48ad-8c9e-561fb7e7e060 req-64fc8148-26f8-403c-8acb-ab2a0ddd390a service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:17.828507 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-0f447d52-472d-48ad-8c9e-561fb7e7e060 req-64fc8148-26f8-403c-8acb-ab2a0ddd390a service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:17.829310 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-0f447d52-472d-48ad-8c9e-561fb7e7e060 req-64fc8148-26f8-403c-8acb-ab2a0ddd390a service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:17.847346 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-0f447d52-472d-48ad-8c9e-561fb7e7e060 req-64fc8148-26f8-403c-8acb-ab2a0ddd390a service nova] Creating event network-vif-deleted:6456c6d8-67cf-4eb9-a700-b8d5398267d5 for instance 38d1e924-eaea-449b-9724-1d2b16fcdfbc on n-h1-850468-14 Aug 10 23:02:17.853904 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-0f447d52-472d-48ad-8c9e-561fb7e7e060 req-64fc8148-26f8-403c-8acb-ab2a0ddd390a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048113 Aug 10 23:02:17.855770 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 770/1547] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:02:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:02:17.869787 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-83ed159c-9f8b-4d78-b4e5-e0ced07327ab tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:17.870955 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-83ed159c-9f8b-4d78-b4e5-e0ced07327ab tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] [instance: 38d1e924-eaea-449b-9724-1d2b16fcdfbc] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:02:17.879388 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-83ed159c-9f8b-4d78-b4e5-e0ced07327ab tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:17.879934 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-83ed159c-9f8b-4d78-b4e5-e0ced07327ab tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:17.880460 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-83ed159c-9f8b-4d78-b4e5-e0ced07327ab tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:17.881256 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-83ed159c-9f8b-4d78-b4e5-e0ced07327ab tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:17.881804 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-83ed159c-9f8b-4d78-b4e5-e0ced07327ab tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:17.882201 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-83ed159c-9f8b-4d78-b4e5-e0ced07327ab tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:17.895904 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-5ad86ee8-b71c-4b6b-8c08-518960e3189e tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51/action" status: 202 len: 0 microversion: 2.25 time: 4.187627 Aug 10 23:02:17.900645 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 778/1548] 10.222.0.58 () {62 vars in 1319 bytes} [Wed Aug 10 23:02:13 2022] POST /compute/v2.1/servers/3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51/action => generated 0 bytes in 4193 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:02:17.902587 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-83ed159c-9f8b-4d78-b4e5-e0ced07327ab tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] HTTP exception thrown: Instance 38d1e924-eaea-449b-9724-1d2b16fcdfbc could not be found. Aug 10 23:02:17.904623 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-83ed159c-9f8b-4d78-b4e5-e0ced07327ab tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Request method failure captured: Aug 10 23:02:17.904623 n-d-850468-14 devstack@n-api.service[122632]: request: GET /compute/v2.1/servers/38d1e924-eaea-449b-9724-1d2b16fcdfbc HTTP/1.1 Aug 10 23:02:17.904623 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:02:17.904623 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:02:17.904623 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:02:17.904623 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 23:02:17.904623 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:02:17.904623 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:02:17.904623 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:02:17.904623 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:02:17.904623 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9DjXxN6H2yI0NYLmowzREhQ56WlwpX_gp2ejo0_xRUplxhLBogdRVkTSXcKokKuaVMBzV22FPJMAd2OoxL3UabYmxm_nQoDzwefHNlI-wGPq7UymNsMHIpy-l-nYdVGrQhFzQ3JdpiusXkJw8obhVB-Y-2DR2DJW8eRQI7X4RmsTedA Aug 10 23:02:17.904623 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:02:17.904623 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:02:17.904623 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:02:17.904623 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:02:17.904623 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:02:17.904623 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:02:17.904623 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 701fe4c2829c4ef4a748cfe83d84294f Aug 10 23:02:17.904623 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-InstanceActionsTestJSON-1684107681 Aug 10 23:02:17.904623 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:02:17.904623 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:02:17.906506 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/701fe4c2829c4ef4a748cfe83d84294f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/701fe4c2829c4ef4a748cfe83d84294f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/701fe4c2829c4ef4a748cfe83d84294f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_701fe4c2829c4ef4a748cfe83d84294f", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:02:17.906506 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-InstanceActionsTestJSON-1684107681 Aug 10 23:02:17.906506 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 701fe4c2829c4ef4a748cfe83d84294f Aug 10 23:02:17.906506 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-InstanceActionsTestJSON-1684107681 Aug 10 23:02:17.906506 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-InstanceActionsTestJSON-1684107681-project Aug 10 23:02:17.906506 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:02:17.906506 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:02:17.906506 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: abb4dc460d3b4bb1a20a45d27d524cd9 Aug 10 23:02:17.906506 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-InstanceActionsTestJSON-1684107681-project Aug 10 23:02:17.906506 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:02:17.906506 n-d-850468-14 devstack@n-api.service[122632]: exception: Instance 38d1e924-eaea-449b-9724-1d2b16fcdfbc could not be found. Aug 10 23:02:17.906506 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': '38d1e924-eaea-449b-9724-1d2b16fcdfbc'} Aug 10 23:02:17.907478 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:02:17.907478 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:02:17.907478 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:02:17.907478 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:02:17.907478 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:02:17.907478 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:02:17.907478 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:02:17.907478 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:02:17.907478 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:02:17.907478 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:02:17.907478 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38d1e924-eaea-449b-9724-1d2b16fcdfbc could not be found. Aug 10 23:02:17.907478 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:02:17.907478 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:02:17.907478 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:02:17.907478 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:02:17.907478 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:02:17.907478 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:02:17.907478 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:02:17.907478 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:02:17.907478 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:02:17.908881 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:02:17.908881 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:02:17.908881 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:02:17.908881 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:02:17.908881 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:02:17.908881 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:02:17.908881 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:02:17.908881 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38d1e924-eaea-449b-9724-1d2b16fcdfbc could not be found. Aug 10 23:02:17.908881 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:02:17.908881 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:02:17.908881 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:02:17.908881 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:02:17.908881 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:02:17.908881 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:02:17.908881 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:02:17.908881 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:02:17.908881 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38d1e924-eaea-449b-9724-1d2b16fcdfbc could not be found. Aug 10 23:02:17.908881 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:02:17.910251 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-113c65d3-4141-45fd-aa20-d7b0bef32dfa tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:17.910251 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-113c65d3-4141-45fd-aa20-d7b0bef32dfa tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] [instance: ce82674f-e3eb-4e97-acd3-b4da01015330] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:02:17.912922 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-83ed159c-9f8b-4d78-b4e5-e0ced07327ab tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] Returning 404 to user: Instance 38d1e924-eaea-449b-9724-1d2b16fcdfbc could not be found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:02:17.914709 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-83ed159c-9f8b-4d78-b4e5-e0ced07327ab tempest-InstanceActionsTestJSON-1684107681 tempest-InstanceActionsTestJSON-1684107681-project] 10.222.0.58 "GET /compute/v2.1/servers/38d1e924-eaea-449b-9724-1d2b16fcdfbc" status: 404 len: 111 microversion: 2.1 time: 0.057332 Aug 10 23:02:17.916041 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 771/1549] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:02:17 2022] GET /compute/v2.1/servers/38d1e924-eaea-449b-9724-1d2b16fcdfbc => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:02:17.924111 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-2aca939f-0ef2-44b8-bfdb-b54301f0e82c tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:17.925329 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-2aca939f-0ef2-44b8-bfdb-b54301f0e82c tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] [instance: 2636ab6a-a1c8-4b70-a18f-afe073dd31db] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:02:17.937659 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2aca939f-0ef2-44b8-bfdb-b54301f0e82c tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:17.938741 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2aca939f-0ef2-44b8-bfdb-b54301f0e82c tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:17.941033 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-113c65d3-4141-45fd-aa20-d7b0bef32dfa tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:17.941836 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-113c65d3-4141-45fd-aa20-d7b0bef32dfa tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:17.942290 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-113c65d3-4141-45fd-aa20-d7b0bef32dfa tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:17.942575 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2aca939f-0ef2-44b8-bfdb-b54301f0e82c tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:17.943091 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-113c65d3-4141-45fd-aa20-d7b0bef32dfa tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:17.943551 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-113c65d3-4141-45fd-aa20-d7b0bef32dfa tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:17.944277 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-113c65d3-4141-45fd-aa20-d7b0bef32dfa tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:17.945936 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2aca939f-0ef2-44b8-bfdb-b54301f0e82c tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:17.946540 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2aca939f-0ef2-44b8-bfdb-b54301f0e82c tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:17.948584 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2aca939f-0ef2-44b8-bfdb-b54301f0e82c tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:17.997174 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-113c65d3-4141-45fd-aa20-d7b0bef32dfa tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] HTTP exception thrown: Instance ce82674f-e3eb-4e97-acd3-b4da01015330 could not be found. Aug 10 23:02:18.001517 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-113c65d3-4141-45fd-aa20-d7b0bef32dfa tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Request method failure captured: Aug 10 23:02:18.001517 n-d-850468-14 devstack@n-api.service[122633]: request: DELETE /compute/v2.1/servers/ce82674f-e3eb-4e97-acd3-b4da01015330 HTTP/1.1 Aug 10 23:02:18.001517 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:02:18.001517 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:02:18.001517 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:02:18.001517 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:02:18.001517 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:02:18.001517 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:02:18.001517 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:02:18.001517 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:02:18.001517 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9DgG869H1c8f0vbp0V7En7JFi_WIaXbrI3LJGQVZ9CZJGJ5tE0ttFDP0GLvV2QyQzFa98JnG3z8rMrapcPk2Wv2xg0AdGD-P9jDChgdbhVmmNjfdSCAmAgD2r7Z3NIqXzHov-GWhvIwwFP3ghOFWaMRMeNNOk3SIjTZY-cSRl1BQNss Aug 10 23:02:18.001517 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:02:18.001517 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:02:18.001517 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:02:18.001517 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:02:18.001517 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:02:18.001517 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:02:18.001517 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 307ab95daa034afbb31f90626885072b Aug 10 23:02:18.001517 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-ImagesTestJSON-1761176174 Aug 10 23:02:18.001517 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:02:18.001517 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:02:18.003285 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/307ab95daa034afbb31f90626885072b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/307ab95daa034afbb31f90626885072b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/307ab95daa034afbb31f90626885072b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_307ab95daa034afbb31f90626885072b", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:02:18.003285 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-ImagesTestJSON-1761176174 Aug 10 23:02:18.003285 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 307ab95daa034afbb31f90626885072b Aug 10 23:02:18.003285 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-ImagesTestJSON-1761176174 Aug 10 23:02:18.003285 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-ImagesTestJSON-1761176174-project Aug 10 23:02:18.003285 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:02:18.003285 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:02:18.003285 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 7d6d9806b6724e5aaf8c69be8e70d4f3 Aug 10 23:02:18.003285 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-ImagesTestJSON-1761176174-project Aug 10 23:02:18.003285 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:02:18.003285 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance ce82674f-e3eb-4e97-acd3-b4da01015330 could not be found. Aug 10 23:02:18.003285 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': 'ce82674f-e3eb-4e97-acd3-b4da01015330'} Aug 10 23:02:18.004162 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:02:18.004162 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:02:18.004162 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:02:18.004162 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:02:18.004162 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:02:18.004162 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:02:18.004162 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:02:18.004162 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:02:18.004162 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:02:18.004162 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:02:18.004162 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce82674f-e3eb-4e97-acd3-b4da01015330 could not be found. Aug 10 23:02:18.004162 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:02:18.004162 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:02:18.004162 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:02:18.004162 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:02:18.004162 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:02:18.004162 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:02:18.004162 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:02:18.004162 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:02:18.004162 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:02:18.006346 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:02:18.006346 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 23:02:18.006346 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 23:02:18.006346 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 23:02:18.006346 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 23:02:18.006346 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:02:18.006346 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:02:18.006346 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:02:18.006346 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:02:18.006346 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce82674f-e3eb-4e97-acd3-b4da01015330 could not be found. Aug 10 23:02:18.006346 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:02:18.006346 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:02:18.006346 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:02:18.006346 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:02:18.006346 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:02:18.006346 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:02:18.006346 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:02:18.006346 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:02:18.006346 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce82674f-e3eb-4e97-acd3-b4da01015330 could not be found. Aug 10 23:02:18.006346 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:02:18.016622 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-113c65d3-4141-45fd-aa20-d7b0bef32dfa tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Returning 404 to user: Instance ce82674f-e3eb-4e97-acd3-b4da01015330 could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:02:18.020882 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-113c65d3-4141-45fd-aa20-d7b0bef32dfa tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] 10.222.0.58 "DELETE /compute/v2.1/servers/ce82674f-e3eb-4e97-acd3-b4da01015330" status: 404 len: 111 microversion: 2.1 time: 0.114671 Aug 10 23:02:18.023859 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 779/1550] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:02:17 2022] DELETE /compute/v2.1/servers/ce82674f-e3eb-4e97-acd3-b4da01015330 => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:02:18.055180 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-618f636a-b707-48b0-9f19-e324f25b76e7 req-44d89daa-d6a7-4f7c-8e46-6391ba2987f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2636ab6a-a1c8-4b70-a18f-afe073dd31db", "tag": "f6251d46-01d4-44a9-9707-04ab7fb39207"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:02:18.086743 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-618f636a-b707-48b0-9f19-e324f25b76e7 req-44d89daa-d6a7-4f7c-8e46-6391ba2987f0 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:18.087273 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-618f636a-b707-48b0-9f19-e324f25b76e7 req-44d89daa-d6a7-4f7c-8e46-6391ba2987f0 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:18.092558 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-618f636a-b707-48b0-9f19-e324f25b76e7 req-44d89daa-d6a7-4f7c-8e46-6391ba2987f0 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:18.119242 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-618f636a-b707-48b0-9f19-e324f25b76e7 req-44d89daa-d6a7-4f7c-8e46-6391ba2987f0 service nova] Creating event network-changed:f6251d46-01d4-44a9-9707-04ab7fb39207 for instance 2636ab6a-a1c8-4b70-a18f-afe073dd31db on n-h2-850468-14 Aug 10 23:02:18.133491 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-618f636a-b707-48b0-9f19-e324f25b76e7 req-44d89daa-d6a7-4f7c-8e46-6391ba2987f0 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107704 Aug 10 23:02:18.137350 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 780/1551] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:02:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:02:18.151361 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-7a826512-c0bd-4d55-80ac-8a115858f7e9 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:18.164299 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-7a826512-c0bd-4d55-80ac-8a115858f7e9 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] [instance: 8e91f1ac-f79d-4ab0-aa13-ea32b0e74888] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:02:18.174036 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7a826512-c0bd-4d55-80ac-8a115858f7e9 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:18.174898 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7a826512-c0bd-4d55-80ac-8a115858f7e9 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:18.176380 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7a826512-c0bd-4d55-80ac-8a115858f7e9 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:18.177712 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7a826512-c0bd-4d55-80ac-8a115858f7e9 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:18.178905 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7a826512-c0bd-4d55-80ac-8a115858f7e9 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:18.179655 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7a826512-c0bd-4d55-80ac-8a115858f7e9 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:18.228098 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-7a826512-c0bd-4d55-80ac-8a115858f7e9 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] 10.222.0.58 "GET /compute/v2.1/servers/8e91f1ac-f79d-4ab0-aa13-ea32b0e74888/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.088833 Aug 10 23:02:18.229411 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 781/1552] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 10 23:02:18 2022] GET /compute/v2.1/servers/8e91f1ac-f79d-4ab0-aa13-ea32b0e74888/os-volume_attachments => generated 25 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 23:02:18.234979 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-7169e47c-5874-4a5b-ae61-efa5915dcb6b tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:18.235630 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-7169e47c-5874-4a5b-ae61-efa5915dcb6b tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 3e467caf-9d1e-4dc0-830d-585aeabc1e5a] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:02:18.248090 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7169e47c-5874-4a5b-ae61-efa5915dcb6b tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:18.249237 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7169e47c-5874-4a5b-ae61-efa5915dcb6b tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:18.251917 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7169e47c-5874-4a5b-ae61-efa5915dcb6b tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:18.253002 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7169e47c-5874-4a5b-ae61-efa5915dcb6b tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:18.253739 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7169e47c-5874-4a5b-ae61-efa5915dcb6b tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:18.254466 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7169e47c-5874-4a5b-ae61-efa5915dcb6b tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:18.276465 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:02:18.374842 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-7169e47c-5874-4a5b-ae61-efa5915dcb6b tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:02:18.384597 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-7169e47c-5874-4a5b-ae61-efa5915dcb6b tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/3e467caf-9d1e-4dc0-830d-585aeabc1e5a" status: 200 len: 1298 microversion: 2.1 time: 0.153719 Aug 10 23:02:18.385421 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 782/1553] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:02:18 2022] GET /compute/v2.1/servers/3e467caf-9d1e-4dc0-830d-585aeabc1e5a => generated 1298 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:02:18.391248 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-d50b6f8d-a44e-4f4a-9de7-0baa9f8dbc67 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:18.392196 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-d50b6f8d-a44e-4f4a-9de7-0baa9f8dbc67 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] [instance: 3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:02:18.398580 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d50b6f8d-a44e-4f4a-9de7-0baa9f8dbc67 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:18.399565 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d50b6f8d-a44e-4f4a-9de7-0baa9f8dbc67 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:18.400306 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d50b6f8d-a44e-4f4a-9de7-0baa9f8dbc67 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:18.402319 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d50b6f8d-a44e-4f4a-9de7-0baa9f8dbc67 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:18.403031 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d50b6f8d-a44e-4f4a-9de7-0baa9f8dbc67 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:18.403665 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d50b6f8d-a44e-4f4a-9de7-0baa9f8dbc67 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:18.503355 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-2aca939f-0ef2-44b8-bfdb-b54301f0e82c tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '417d4eaaeb1c4df78745496ececb3e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27e6ee9495a438b8450a4ef0d62cbcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:02:18.525358 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-2aca939f-0ef2-44b8-bfdb-b54301f0e82c tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] 10.222.0.58 "GET /compute/v2.1/servers/2636ab6a-a1c8-4b70-a18f-afe073dd31db" status: 200 len: 1317 microversion: 2.1 time: 0.593810 Aug 10 23:02:18.526403 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 772/1554] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:02:17 2022] GET /compute/v2.1/servers/2636ab6a-a1c8-4b70-a18f-afe073dd31db => generated 1317 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:02:18.537551 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-a0158726-fd13-483b-84b7-24759e6ea8ed tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:18.538195 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-a0158726-fd13-483b-84b7-24759e6ea8ed tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] [instance: ce82674f-e3eb-4e97-acd3-b4da01015330] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:02:18.554641 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a0158726-fd13-483b-84b7-24759e6ea8ed tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:18.555247 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a0158726-fd13-483b-84b7-24759e6ea8ed tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:18.558728 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a0158726-fd13-483b-84b7-24759e6ea8ed tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:18.561705 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a0158726-fd13-483b-84b7-24759e6ea8ed tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:18.562198 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a0158726-fd13-483b-84b7-24759e6ea8ed tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:18.563761 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a0158726-fd13-483b-84b7-24759e6ea8ed tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:18.574736 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:02:18.610735 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-a0158726-fd13-483b-84b7-24759e6ea8ed tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] HTTP exception thrown: Instance ce82674f-e3eb-4e97-acd3-b4da01015330 could not be found. Aug 10 23:02:18.612753 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-a0158726-fd13-483b-84b7-24759e6ea8ed tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Request method failure captured: Aug 10 23:02:18.612753 n-d-850468-14 devstack@n-api.service[122632]: request: GET /compute/v2.1/servers/ce82674f-e3eb-4e97-acd3-b4da01015330 HTTP/1.1 Aug 10 23:02:18.612753 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:02:18.612753 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:02:18.612753 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:02:18.612753 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 23:02:18.612753 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:02:18.612753 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:02:18.612753 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:02:18.612753 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:02:18.612753 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9DgG869H1c8f0vbp0V7En7JFi_WIaXbrI3LJGQVZ9CZJGJ5tE0ttFDP0GLvV2QyQzFa98JnG3z8rMrapcPk2Wv2xg0AdGD-P9jDChgdbhVmmNjfdSCAmAgD2r7Z3NIqXzHov-GWhvIwwFP3ghOFWaMRMeNNOk3SIjTZY-cSRl1BQNss Aug 10 23:02:18.612753 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:02:18.612753 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:02:18.612753 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:02:18.612753 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:02:18.612753 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:02:18.612753 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:02:18.612753 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 307ab95daa034afbb31f90626885072b Aug 10 23:02:18.612753 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-ImagesTestJSON-1761176174 Aug 10 23:02:18.612753 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:02:18.612753 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:02:18.614314 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/307ab95daa034afbb31f90626885072b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/307ab95daa034afbb31f90626885072b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/307ab95daa034afbb31f90626885072b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_307ab95daa034afbb31f90626885072b", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:02:18.614314 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-ImagesTestJSON-1761176174 Aug 10 23:02:18.614314 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 307ab95daa034afbb31f90626885072b Aug 10 23:02:18.614314 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-ImagesTestJSON-1761176174 Aug 10 23:02:18.614314 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-ImagesTestJSON-1761176174-project Aug 10 23:02:18.614314 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:02:18.614314 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:02:18.614314 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: 7d6d9806b6724e5aaf8c69be8e70d4f3 Aug 10 23:02:18.614314 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-ImagesTestJSON-1761176174-project Aug 10 23:02:18.614314 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:02:18.614314 n-d-850468-14 devstack@n-api.service[122632]: exception: Instance ce82674f-e3eb-4e97-acd3-b4da01015330 could not be found. Aug 10 23:02:18.614314 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': 'ce82674f-e3eb-4e97-acd3-b4da01015330'} Aug 10 23:02:18.615153 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:02:18.615153 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:02:18.615153 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:02:18.615153 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:02:18.615153 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:02:18.615153 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:02:18.615153 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:02:18.615153 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:02:18.615153 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:02:18.615153 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:02:18.615153 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce82674f-e3eb-4e97-acd3-b4da01015330 could not be found. Aug 10 23:02:18.615153 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:02:18.615153 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:02:18.615153 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:02:18.615153 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:02:18.615153 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:02:18.615153 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:02:18.615153 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:02:18.615153 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:02:18.615153 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:02:18.616467 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:02:18.616467 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:02:18.616467 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:02:18.616467 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:02:18.616467 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:02:18.616467 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:02:18.616467 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:02:18.616467 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce82674f-e3eb-4e97-acd3-b4da01015330 could not be found. Aug 10 23:02:18.616467 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:02:18.616467 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:02:18.616467 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:02:18.616467 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:02:18.616467 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:02:18.616467 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:02:18.616467 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:02:18.616467 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:02:18.616467 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce82674f-e3eb-4e97-acd3-b4da01015330 could not be found. Aug 10 23:02:18.616467 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:02:18.629428 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-a0158726-fd13-483b-84b7-24759e6ea8ed tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] Returning 404 to user: Instance ce82674f-e3eb-4e97-acd3-b4da01015330 could not be found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:02:18.630820 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-a0158726-fd13-483b-84b7-24759e6ea8ed tempest-ImagesTestJSON-1761176174 tempest-ImagesTestJSON-1761176174-project] 10.222.0.58 "GET /compute/v2.1/servers/ce82674f-e3eb-4e97-acd3-b4da01015330" status: 404 len: 111 microversion: 2.1 time: 0.103112 Aug 10 23:02:18.638460 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 773/1555] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:02:18 2022] GET /compute/v2.1/servers/ce82674f-e3eb-4e97-acd3-b4da01015330 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:02:18.807543 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-2023492d-afce-488e-be38-53b76c6434a8 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:18.810056 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-2023492d-afce-488e-be38-53b76c6434a8 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] [instance: 9725dd3f-f5a6-496e-99c5-66ee08b6c1f7] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:02:18.828972 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2023492d-afce-488e-be38-53b76c6434a8 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:18.829464 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2023492d-afce-488e-be38-53b76c6434a8 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:18.842768 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2023492d-afce-488e-be38-53b76c6434a8 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:18.845653 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2023492d-afce-488e-be38-53b76c6434a8 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:18.846363 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2023492d-afce-488e-be38-53b76c6434a8 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:18.849421 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2023492d-afce-488e-be38-53b76c6434a8 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:18.869214 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-d50b6f8d-a44e-4f4a-9de7-0baa9f8dbc67 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:02:18.881925 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-d50b6f8d-a44e-4f4a-9de7-0baa9f8dbc67 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:02:18.883607 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-d50b6f8d-a44e-4f4a-9de7-0baa9f8dbc67 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:02:18.884799 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-d50b6f8d-a44e-4f4a-9de7-0baa9f8dbc67 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] 10.222.0.58 "GET /compute/v2.1/servers/3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51" status: 200 len: 1486 microversion: 2.25 time: 0.497780 Aug 10 23:02:18.893633 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 783/1556] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:02:18 2022] GET /compute/v2.1/servers/3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51 => generated 1486 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:02:19.408405 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-cb33e48b-b0b4-4b01-aa65-4573ace9866d tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:19.409066 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-cb33e48b-b0b4-4b01-aa65-4573ace9866d tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 3e467caf-9d1e-4dc0-830d-585aeabc1e5a] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:02:19.438380 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cb33e48b-b0b4-4b01-aa65-4573ace9866d tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:19.439923 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cb33e48b-b0b4-4b01-aa65-4573ace9866d tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:19.441463 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cb33e48b-b0b4-4b01-aa65-4573ace9866d tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:19.442776 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cb33e48b-b0b4-4b01-aa65-4573ace9866d tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:19.445610 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cb33e48b-b0b4-4b01-aa65-4573ace9866d tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:19.446889 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cb33e48b-b0b4-4b01-aa65-4573ace9866d tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:19.448850 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=2 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:02:19.545947 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cb33e48b-b0b4-4b01-aa65-4573ace9866d tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:19.546661 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cb33e48b-b0b4-4b01-aa65-4573ace9866d tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:19.548180 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cb33e48b-b0b4-4b01-aa65-4573ace9866d tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:19.548819 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.objects.instance [None req-cb33e48b-b0b4-4b01-aa65-4573ace9866d tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lazy-loading 'fault' on Instance uuid 3e467caf-9d1e-4dc0-830d-585aeabc1e5a {{(pid=122633) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:02:19.637360 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-cb33e48b-b0b4-4b01-aa65-4573ace9866d tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:02:19.656006 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-cb33e48b-b0b4-4b01-aa65-4573ace9866d tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/3e467caf-9d1e-4dc0-830d-585aeabc1e5a" status: 200 len: 1303 microversion: 2.1 time: 0.250472 Aug 10 23:02:19.669335 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 784/1557] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:02:19 2022] GET /compute/v2.1/servers/3e467caf-9d1e-4dc0-830d-585aeabc1e5a => generated 1303 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:02:19.673853 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-1802d0ff-54aa-4795-8bad-440cead93f27 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:19.675120 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-1802d0ff-54aa-4795-8bad-440cead93f27 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] [instance: 2636ab6a-a1c8-4b70-a18f-afe073dd31db] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:02:19.696281 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1802d0ff-54aa-4795-8bad-440cead93f27 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:19.701004 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1802d0ff-54aa-4795-8bad-440cead93f27 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:19.702967 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1802d0ff-54aa-4795-8bad-440cead93f27 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:19.703850 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1802d0ff-54aa-4795-8bad-440cead93f27 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:19.704340 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1802d0ff-54aa-4795-8bad-440cead93f27 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:19.704945 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1802d0ff-54aa-4795-8bad-440cead93f27 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:20.069131 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-2023492d-afce-488e-be38-53b76c6434a8 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfd6d8e6a8444f5b9fcf1cf8da242ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707f869910b34768ae1a348cd0b5f284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:02:20.088609 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-2023492d-afce-488e-be38-53b76c6434a8 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] 10.222.0.58 "GET /compute/v2.1/servers/9725dd3f-f5a6-496e-99c5-66ee08b6c1f7" status: 200 len: 1315 microversion: 2.1 time: 1.281788 Aug 10 23:02:20.091942 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 774/1558] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:02:18 2022] GET /compute/v2.1/servers/9725dd3f-f5a6-496e-99c5-66ee08b6c1f7 => generated 1315 bytes in 1290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:02:20.101621 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-1802d0ff-54aa-4795-8bad-440cead93f27 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '417d4eaaeb1c4df78745496ececb3e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27e6ee9495a438b8450a4ef0d62cbcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:02:20.106137 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-53cd5fb5-56ea-472e-bf05-653aa9d5ede6 req-09db8de1-8c2a-4ace-a8c7-2a074c674cc5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9725dd3f-f5a6-496e-99c5-66ee08b6c1f7", "tag": "b6ec14f6-4359-4750-92e8-cd76718aa49e"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:02:20.116273 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-1802d0ff-54aa-4795-8bad-440cead93f27 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] 10.222.0.58 "GET /compute/v2.1/servers/2636ab6a-a1c8-4b70-a18f-afe073dd31db" status: 200 len: 1317 microversion: 2.1 time: 0.454815 Aug 10 23:02:20.119593 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 785/1559] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:02:19 2022] GET /compute/v2.1/servers/2636ab6a-a1c8-4b70-a18f-afe073dd31db => generated 1317 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:02:20.129548 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-7fdbbb74-864a-4453-8831-f31705d2a183 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:20.132959 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-7fdbbb74-864a-4453-8831-f31705d2a183 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] [instance: 3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:02:20.148211 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7fdbbb74-864a-4453-8831-f31705d2a183 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:20.152297 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7fdbbb74-864a-4453-8831-f31705d2a183 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:20.152950 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7fdbbb74-864a-4453-8831-f31705d2a183 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:20.153526 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-53cd5fb5-56ea-472e-bf05-653aa9d5ede6 req-09db8de1-8c2a-4ace-a8c7-2a074c674cc5 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:20.153992 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7fdbbb74-864a-4453-8831-f31705d2a183 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:20.154456 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7fdbbb74-864a-4453-8831-f31705d2a183 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:20.154947 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-53cd5fb5-56ea-472e-bf05-653aa9d5ede6 req-09db8de1-8c2a-4ace-a8c7-2a074c674cc5 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:20.155755 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-53cd5fb5-56ea-472e-bf05-653aa9d5ede6 req-09db8de1-8c2a-4ace-a8c7-2a074c674cc5 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:20.158662 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7fdbbb74-864a-4453-8831-f31705d2a183 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:20.175443 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-53cd5fb5-56ea-472e-bf05-653aa9d5ede6 req-09db8de1-8c2a-4ace-a8c7-2a074c674cc5 service nova] Creating event network-changed:b6ec14f6-4359-4750-92e8-cd76718aa49e for instance 9725dd3f-f5a6-496e-99c5-66ee08b6c1f7 on n-h2-850468-14 Aug 10 23:02:20.184732 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-53cd5fb5-56ea-472e-bf05-653aa9d5ede6 req-09db8de1-8c2a-4ace-a8c7-2a074c674cc5 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090529 Aug 10 23:02:20.186957 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 775/1560] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:02:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:02:20.212598 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-641c6673-24a1-4810-8dd7-78a0fdcd40e1 req-4b9c44ad-17d7-42ea-bd3b-36de90d23da6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e467caf-9d1e-4dc0-830d-585aeabc1e5a", "name": "network-vif-deleted", "tag": "4039e5dc-d9c0-4105-991d-a67f51743ea9"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:02:20.234558 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-641c6673-24a1-4810-8dd7-78a0fdcd40e1 req-4b9c44ad-17d7-42ea-bd3b-36de90d23da6 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:20.235596 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-641c6673-24a1-4810-8dd7-78a0fdcd40e1 req-4b9c44ad-17d7-42ea-bd3b-36de90d23da6 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:20.238724 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-641c6673-24a1-4810-8dd7-78a0fdcd40e1 req-4b9c44ad-17d7-42ea-bd3b-36de90d23da6 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:20.271218 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-641c6673-24a1-4810-8dd7-78a0fdcd40e1 req-4b9c44ad-17d7-42ea-bd3b-36de90d23da6 service nova] Creating event network-vif-deleted:4039e5dc-d9c0-4105-991d-a67f51743ea9 for instance 3e467caf-9d1e-4dc0-830d-585aeabc1e5a on n-h2-850468-14 Aug 10 23:02:20.282324 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-641c6673-24a1-4810-8dd7-78a0fdcd40e1 req-4b9c44ad-17d7-42ea-bd3b-36de90d23da6 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089861 Aug 10 23:02:20.283533 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 776/1561] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:02:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:02:20.567180 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=8 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:02:20.591510 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-7fdbbb74-864a-4453-8831-f31705d2a183 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:02:20.607531 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-7fdbbb74-864a-4453-8831-f31705d2a183 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:02:20.609796 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-7fdbbb74-864a-4453-8831-f31705d2a183 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:02:20.614170 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-7fdbbb74-864a-4453-8831-f31705d2a183 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] 10.222.0.58 "GET /compute/v2.1/servers/3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51" status: 200 len: 1486 microversion: 2.25 time: 0.493227 Aug 10 23:02:20.615064 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 786/1562] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:02:20 2022] GET /compute/v2.1/servers/3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51 => generated 1486 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:02:20.680704 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-420773a2-1fe0-412f-98c8-3869a0b665d0 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:20.681596 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-420773a2-1fe0-412f-98c8-3869a0b665d0 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 3e467caf-9d1e-4dc0-830d-585aeabc1e5a] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:02:20.693647 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-420773a2-1fe0-412f-98c8-3869a0b665d0 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:20.695893 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-420773a2-1fe0-412f-98c8-3869a0b665d0 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:20.696892 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-420773a2-1fe0-412f-98c8-3869a0b665d0 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:20.697805 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-420773a2-1fe0-412f-98c8-3869a0b665d0 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:20.701207 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-420773a2-1fe0-412f-98c8-3869a0b665d0 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:20.702046 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-420773a2-1fe0-412f-98c8-3869a0b665d0 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:20.723109 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-420773a2-1fe0-412f-98c8-3869a0b665d0 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] HTTP exception thrown: Instance 3e467caf-9d1e-4dc0-830d-585aeabc1e5a could not be found. Aug 10 23:02:20.725049 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-420773a2-1fe0-412f-98c8-3869a0b665d0 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Request method failure captured: Aug 10 23:02:20.725049 n-d-850468-14 devstack@n-api.service[122632]: request: GET /compute/v2.1/servers/3e467caf-9d1e-4dc0-830d-585aeabc1e5a HTTP/1.1 Aug 10 23:02:20.725049 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:02:20.725049 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:02:20.725049 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:02:20.725049 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 23:02:20.725049 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:02:20.725049 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:02:20.725049 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:02:20.725049 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:02:20.725049 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9DeQmxTbOitwd_j9YtdAnQSwQ89-Dy6u8ScBzZvyZW9HY4wPsjGy7IRMWg-qG5FMs97q83zI4T-3jk9dEElmnqLqzqyNSsYmIaBHEjEiS-9wcAaMJigIlFlxe5p_oKuFcblN8OKqmSYdvWW9qENhJcW3FtG8UPbZXFHnVNw53wlKQ4Y Aug 10 23:02:20.725049 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:02:20.725049 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:02:20.725049 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:02:20.725049 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:02:20.725049 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:02:20.725049 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:02:20.725049 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: f9582683a1cf4e92b3bd3f10db0b497b Aug 10 23:02:20.725049 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-MigrationsAdminTest-2034094486 Aug 10 23:02:20.725049 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:02:20.725049 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:02:20.727289 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f9582683a1cf4e92b3bd3f10db0b497b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f9582683a1cf4e92b3bd3f10db0b497b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/f9582683a1cf4e92b3bd3f10db0b497b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_f9582683a1cf4e92b3bd3f10db0b497b", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:02:20.727289 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-MigrationsAdminTest-2034094486 Aug 10 23:02:20.727289 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: f9582683a1cf4e92b3bd3f10db0b497b Aug 10 23:02:20.727289 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-MigrationsAdminTest-2034094486 Aug 10 23:02:20.727289 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-MigrationsAdminTest-2034094486-project Aug 10 23:02:20.727289 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:02:20.727289 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:02:20.727289 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: 5c48fd7279544b1fae228500f5a1e46d Aug 10 23:02:20.727289 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-MigrationsAdminTest-2034094486-project Aug 10 23:02:20.727289 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:02:20.727289 n-d-850468-14 devstack@n-api.service[122632]: exception: Instance 3e467caf-9d1e-4dc0-830d-585aeabc1e5a could not be found. Aug 10 23:02:20.727289 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': '3e467caf-9d1e-4dc0-830d-585aeabc1e5a'} Aug 10 23:02:20.728616 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:02:20.728616 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:02:20.728616 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:02:20.728616 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:02:20.728616 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:02:20.728616 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:02:20.728616 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:02:20.728616 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:02:20.728616 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:02:20.728616 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:02:20.728616 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e467caf-9d1e-4dc0-830d-585aeabc1e5a could not be found. Aug 10 23:02:20.728616 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:02:20.728616 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:02:20.728616 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:02:20.728616 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:02:20.728616 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:02:20.728616 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:02:20.728616 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:02:20.728616 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:02:20.728616 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:02:20.730874 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:02:20.730874 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:02:20.730874 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:02:20.730874 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:02:20.730874 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:02:20.730874 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:02:20.730874 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:02:20.730874 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e467caf-9d1e-4dc0-830d-585aeabc1e5a could not be found. Aug 10 23:02:20.730874 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:02:20.730874 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:02:20.730874 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:02:20.730874 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:02:20.730874 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:02:20.730874 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:02:20.730874 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:02:20.730874 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:02:20.730874 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e467caf-9d1e-4dc0-830d-585aeabc1e5a could not be found. Aug 10 23:02:20.730874 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:02:20.732664 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-420773a2-1fe0-412f-98c8-3869a0b665d0 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Returning 404 to user: Instance 3e467caf-9d1e-4dc0-830d-585aeabc1e5a could not be found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:02:20.732664 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-420773a2-1fe0-412f-98c8-3869a0b665d0 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/3e467caf-9d1e-4dc0-830d-585aeabc1e5a" status: 404 len: 111 microversion: 2.1 time: 0.050882 Aug 10 23:02:20.732664 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 777/1563] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:02:20 2022] GET /compute/v2.1/servers/3e467caf-9d1e-4dc0-830d-585aeabc1e5a => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:02:20.739872 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-dfecdbdc-5218-479b-99e5-eb04e0c90657 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:20.740571 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-dfecdbdc-5218-479b-99e5-eb04e0c90657 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 9acba217-4a32-4650-a43e-9d998061323c] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:02:20.766468 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dfecdbdc-5218-479b-99e5-eb04e0c90657 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:20.767312 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dfecdbdc-5218-479b-99e5-eb04e0c90657 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:20.768017 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dfecdbdc-5218-479b-99e5-eb04e0c90657 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:20.769273 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dfecdbdc-5218-479b-99e5-eb04e0c90657 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:20.770232 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dfecdbdc-5218-479b-99e5-eb04e0c90657 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:20.770813 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dfecdbdc-5218-479b-99e5-eb04e0c90657 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:20.816338 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-dfecdbdc-5218-479b-99e5-eb04e0c90657 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 9acba217-4a32-4650-a43e-9d998061323c] Going to try to terminate instance {{(pid=122633) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:02:20.959830 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-dfecdbdc-5218-479b-99e5-eb04e0c90657 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "DELETE /compute/v2.1/servers/9acba217-4a32-4650-a43e-9d998061323c" status: 204 len: 0 microversion: 2.1 time: 0.226125 Aug 10 23:02:20.961702 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 787/1564] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:02:20 2022] DELETE /compute/v2.1/servers/9acba217-4a32-4650-a43e-9d998061323c => generated 0 bytes in 229 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 10 23:02:20.970420 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-855a514f-94d5-467c-8a2a-f6a0e81fea99 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:20.971181 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-855a514f-94d5-467c-8a2a-f6a0e81fea99 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 9acba217-4a32-4650-a43e-9d998061323c] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:02:20.988053 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-855a514f-94d5-467c-8a2a-f6a0e81fea99 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:20.988549 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-855a514f-94d5-467c-8a2a-f6a0e81fea99 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:20.991497 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-855a514f-94d5-467c-8a2a-f6a0e81fea99 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:20.992409 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-855a514f-94d5-467c-8a2a-f6a0e81fea99 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:20.998504 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-855a514f-94d5-467c-8a2a-f6a0e81fea99 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:20.999312 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-855a514f-94d5-467c-8a2a-f6a0e81fea99 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:21.123543 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-1d472cb6-fb78-47f7-8ca0-9ff054114575 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:21.129477 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-1d472cb6-fb78-47f7-8ca0-9ff054114575 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] [instance: 9725dd3f-f5a6-496e-99c5-66ee08b6c1f7] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:02:21.140234 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_api:UPDATE=3,nova_api:SELECT=94,nova_api:INSERT=3 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:02:21.162132 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1d472cb6-fb78-47f7-8ca0-9ff054114575 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:21.162688 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1d472cb6-fb78-47f7-8ca0-9ff054114575 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:21.163189 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1d472cb6-fb78-47f7-8ca0-9ff054114575 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:21.164072 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1d472cb6-fb78-47f7-8ca0-9ff054114575 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:21.164586 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1d472cb6-fb78-47f7-8ca0-9ff054114575 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:21.165076 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1d472cb6-fb78-47f7-8ca0-9ff054114575 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:21.507228 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=8 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:02:21.693988 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-855a514f-94d5-467c-8a2a-f6a0e81fea99 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:02:21.705671 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-855a514f-94d5-467c-8a2a-f6a0e81fea99 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/9acba217-4a32-4650-a43e-9d998061323c" status: 200 len: 1468 microversion: 2.1 time: 0.737486 Aug 10 23:02:21.705671 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 778/1565] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:02:20 2022] GET /compute/v2.1/servers/9acba217-4a32-4650-a43e-9d998061323c => generated 1468 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:02:21.715585 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-d9502abc-899b-430a-9167-e3746d823115 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:21.719587 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-d9502abc-899b-430a-9167-e3746d823115 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] [instance: 2636ab6a-a1c8-4b70-a18f-afe073dd31db] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:02:21.732529 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d9502abc-899b-430a-9167-e3746d823115 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:21.733026 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d9502abc-899b-430a-9167-e3746d823115 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:21.733498 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d9502abc-899b-430a-9167-e3746d823115 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:21.734612 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d9502abc-899b-430a-9167-e3746d823115 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:21.736391 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d9502abc-899b-430a-9167-e3746d823115 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:21.736838 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d9502abc-899b-430a-9167-e3746d823115 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:21.903291 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-1d472cb6-fb78-47f7-8ca0-9ff054114575 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfd6d8e6a8444f5b9fcf1cf8da242ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707f869910b34768ae1a348cd0b5f284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:02:21.917285 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-1d472cb6-fb78-47f7-8ca0-9ff054114575 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] 10.222.0.58 "GET /compute/v2.1/servers/9725dd3f-f5a6-496e-99c5-66ee08b6c1f7" status: 200 len: 1315 microversion: 2.1 time: 0.801507 Aug 10 23:02:21.918949 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 788/1566] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:02:21 2022] GET /compute/v2.1/servers/9725dd3f-f5a6-496e-99c5-66ee08b6c1f7 => generated 1315 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:02:21.925410 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-b7e14320-3aa9-420f-becc-3cce9277fbab req-21269bc1-4844-4437-8d74-042496f7c93d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9725dd3f-f5a6-496e-99c5-66ee08b6c1f7", "name": "network-vif-plugged", "status": "completed", "tag": "b6ec14f6-4359-4750-92e8-cd76718aa49e"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:02:21.953284 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-b7e14320-3aa9-420f-becc-3cce9277fbab req-21269bc1-4844-4437-8d74-042496f7c93d service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:21.954497 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-b7e14320-3aa9-420f-becc-3cce9277fbab req-21269bc1-4844-4437-8d74-042496f7c93d service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:21.957453 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-b7e14320-3aa9-420f-becc-3cce9277fbab req-21269bc1-4844-4437-8d74-042496f7c93d service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:21.981375 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-b7e14320-3aa9-420f-becc-3cce9277fbab req-21269bc1-4844-4437-8d74-042496f7c93d service nova] Creating event network-vif-plugged:b6ec14f6-4359-4750-92e8-cd76718aa49e for instance 9725dd3f-f5a6-496e-99c5-66ee08b6c1f7 on n-h2-850468-14 Aug 10 23:02:21.994072 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-b7e14320-3aa9-420f-becc-3cce9277fbab req-21269bc1-4844-4437-8d74-042496f7c93d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072419 Aug 10 23:02:21.996406 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 789/1567] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:02:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:02:22.004041 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-b557215e-714a-4460-936d-0b24f93f00fe tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:22.015856 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-b557215e-714a-4460-936d-0b24f93f00fe tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] [instance: 3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:02:22.029403 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b557215e-714a-4460-936d-0b24f93f00fe tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:22.030293 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b557215e-714a-4460-936d-0b24f93f00fe tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:22.031035 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b557215e-714a-4460-936d-0b24f93f00fe tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:22.031984 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b557215e-714a-4460-936d-0b24f93f00fe tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:22.032663 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b557215e-714a-4460-936d-0b24f93f00fe tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:22.033316 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b557215e-714a-4460-936d-0b24f93f00fe tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:22.372339 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-d9502abc-899b-430a-9167-e3746d823115 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '417d4eaaeb1c4df78745496ececb3e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27e6ee9495a438b8450a4ef0d62cbcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:02:22.380683 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-d9502abc-899b-430a-9167-e3746d823115 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] 10.222.0.58 "GET /compute/v2.1/servers/2636ab6a-a1c8-4b70-a18f-afe073dd31db" status: 200 len: 1317 microversion: 2.1 time: 0.675306 Aug 10 23:02:22.387080 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 779/1568] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:02:21 2022] GET /compute/v2.1/servers/2636ab6a-a1c8-4b70-a18f-afe073dd31db => generated 1317 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:02:22.488430 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-b557215e-714a-4460-936d-0b24f93f00fe tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:02:22.505442 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-b557215e-714a-4460-936d-0b24f93f00fe tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:02:22.508730 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-b557215e-714a-4460-936d-0b24f93f00fe tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:02:22.509925 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-b557215e-714a-4460-936d-0b24f93f00fe tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] 10.222.0.58 "GET /compute/v2.1/servers/3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51" status: 200 len: 1486 microversion: 2.25 time: 0.511956 Aug 10 23:02:22.515899 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 790/1569] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:02:21 2022] GET /compute/v2.1/servers/3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51 => generated 1486 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:02:22.725440 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-de5c6550-2f23-417a-859e-dce7687c4e42 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:22.726041 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-de5c6550-2f23-417a-859e-dce7687c4e42 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 9acba217-4a32-4650-a43e-9d998061323c] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:02:22.738653 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-de5c6550-2f23-417a-859e-dce7687c4e42 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:22.741570 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-de5c6550-2f23-417a-859e-dce7687c4e42 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:22.742432 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-de5c6550-2f23-417a-859e-dce7687c4e42 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:22.744028 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-de5c6550-2f23-417a-859e-dce7687c4e42 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:22.746288 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-de5c6550-2f23-417a-859e-dce7687c4e42 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:22.747774 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-de5c6550-2f23-417a-859e-dce7687c4e42 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:22.944689 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-737f8c5a-992e-4bcb-b194-56a309303a62 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:22.945891 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-737f8c5a-992e-4bcb-b194-56a309303a62 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] [instance: 9725dd3f-f5a6-496e-99c5-66ee08b6c1f7] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:02:22.966118 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-737f8c5a-992e-4bcb-b194-56a309303a62 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:22.967563 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-737f8c5a-992e-4bcb-b194-56a309303a62 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:22.968205 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-737f8c5a-992e-4bcb-b194-56a309303a62 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:22.970001 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-737f8c5a-992e-4bcb-b194-56a309303a62 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:22.970660 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-737f8c5a-992e-4bcb-b194-56a309303a62 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:22.972384 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-737f8c5a-992e-4bcb-b194-56a309303a62 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:23.348160 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=4 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:02:23.740495 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-de5c6550-2f23-417a-859e-dce7687c4e42 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:02:23.753350 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-de5c6550-2f23-417a-859e-dce7687c4e42 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/9acba217-4a32-4650-a43e-9d998061323c" status: 200 len: 1468 microversion: 2.1 time: 1.031610 Aug 10 23:02:23.756621 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 780/1570] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:02:22 2022] GET /compute/v2.1/servers/9acba217-4a32-4650-a43e-9d998061323c => generated 1468 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:02:23.785657 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-e94ccc87-9d8e-405a-9124-c5b1c39bd1b0 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:23.787816 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-e94ccc87-9d8e-405a-9124-c5b1c39bd1b0 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] [instance: 2636ab6a-a1c8-4b70-a18f-afe073dd31db] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:02:23.817555 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e94ccc87-9d8e-405a-9124-c5b1c39bd1b0 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:23.818491 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e94ccc87-9d8e-405a-9124-c5b1c39bd1b0 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:23.820388 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e94ccc87-9d8e-405a-9124-c5b1c39bd1b0 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:23.822702 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e94ccc87-9d8e-405a-9124-c5b1c39bd1b0 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:23.824298 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e94ccc87-9d8e-405a-9124-c5b1c39bd1b0 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:23.828299 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e94ccc87-9d8e-405a-9124-c5b1c39bd1b0 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:23.929426 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-737f8c5a-992e-4bcb-b194-56a309303a62 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfd6d8e6a8444f5b9fcf1cf8da242ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707f869910b34768ae1a348cd0b5f284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:02:23.940517 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-737f8c5a-992e-4bcb-b194-56a309303a62 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] 10.222.0.58 "GET /compute/v2.1/servers/9725dd3f-f5a6-496e-99c5-66ee08b6c1f7" status: 200 len: 1315 microversion: 2.1 time: 1.000293 Aug 10 23:02:23.941100 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 791/1571] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:02:22 2022] GET /compute/v2.1/servers/9725dd3f-f5a6-496e-99c5-66ee08b6c1f7 => generated 1315 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:02:23.974201 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-dbb7bb3e-85ef-4a30-a334-dfb0c1a27187 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:23.979950 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-dbb7bb3e-85ef-4a30-a334-dfb0c1a27187 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] [instance: 3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:02:24.014345 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dbb7bb3e-85ef-4a30-a334-dfb0c1a27187 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:24.015115 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dbb7bb3e-85ef-4a30-a334-dfb0c1a27187 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:24.016678 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dbb7bb3e-85ef-4a30-a334-dfb0c1a27187 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:24.017570 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dbb7bb3e-85ef-4a30-a334-dfb0c1a27187 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:24.019206 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dbb7bb3e-85ef-4a30-a334-dfb0c1a27187 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:24.021929 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dbb7bb3e-85ef-4a30-a334-dfb0c1a27187 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:24.380447 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-dbb7bb3e-85ef-4a30-a334-dfb0c1a27187 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:02:24.398325 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-dbb7bb3e-85ef-4a30-a334-dfb0c1a27187 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:02:24.402330 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-dbb7bb3e-85ef-4a30-a334-dfb0c1a27187 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:02:24.404361 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-dbb7bb3e-85ef-4a30-a334-dfb0c1a27187 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] 10.222.0.58 "GET /compute/v2.1/servers/3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51" status: 200 len: 1486 microversion: 2.25 time: 0.451437 Aug 10 23:02:24.408370 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 792/1572] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:02:23 2022] GET /compute/v2.1/servers/3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51 => generated 1486 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:02:24.778198 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-05634595-0280-4438-971f-0c0051450939 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:24.778736 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-05634595-0280-4438-971f-0c0051450939 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 9acba217-4a32-4650-a43e-9d998061323c] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:02:24.793983 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-e94ccc87-9d8e-405a-9124-c5b1c39bd1b0 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '417d4eaaeb1c4df78745496ececb3e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27e6ee9495a438b8450a4ef0d62cbcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:02:24.806941 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-05634595-0280-4438-971f-0c0051450939 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:24.808395 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-05634595-0280-4438-971f-0c0051450939 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:24.810665 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-e94ccc87-9d8e-405a-9124-c5b1c39bd1b0 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] 10.222.0.58 "GET /compute/v2.1/servers/2636ab6a-a1c8-4b70-a18f-afe073dd31db" status: 200 len: 1317 microversion: 2.1 time: 1.052296 Aug 10 23:02:24.811064 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-05634595-0280-4438-971f-0c0051450939 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:24.812072 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 781/1573] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:02:23 2022] GET /compute/v2.1/servers/2636ab6a-a1c8-4b70-a18f-afe073dd31db => generated 1317 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:02:24.813952 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-05634595-0280-4438-971f-0c0051450939 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:24.814445 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-05634595-0280-4438-971f-0c0051450939 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:24.814911 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-05634595-0280-4438-971f-0c0051450939 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:24.966617 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-db84b4d7-8637-44fa-8fd7-d3bc626dc79f tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:24.967385 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-db84b4d7-8637-44fa-8fd7-d3bc626dc79f tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] [instance: 9725dd3f-f5a6-496e-99c5-66ee08b6c1f7] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:02:24.996166 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-db84b4d7-8637-44fa-8fd7-d3bc626dc79f tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:24.997146 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-db84b4d7-8637-44fa-8fd7-d3bc626dc79f tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:25.003486 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-db84b4d7-8637-44fa-8fd7-d3bc626dc79f tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:25.004454 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-db84b4d7-8637-44fa-8fd7-d3bc626dc79f tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:25.004956 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-db84b4d7-8637-44fa-8fd7-d3bc626dc79f tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:25.012298 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-db84b4d7-8637-44fa-8fd7-d3bc626dc79f tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:25.617342 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-05634595-0280-4438-971f-0c0051450939 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c48fd7279544b1fae228500f5a1e46d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9582683a1cf4e92b3bd3f10db0b497b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:02:25.629827 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-05634595-0280-4438-971f-0c0051450939 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/9acba217-4a32-4650-a43e-9d998061323c" status: 200 len: 1426 microversion: 2.1 time: 0.856630 Aug 10 23:02:25.643177 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 793/1574] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:02:24 2022] GET /compute/v2.1/servers/9acba217-4a32-4650-a43e-9d998061323c => generated 1426 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:02:25.656669 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-9b1b7604-78bd-4c0e-908e-ddf6e6e22503 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:25.659350 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-9b1b7604-78bd-4c0e-908e-ddf6e6e22503 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] [instance: 3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:02:25.673009 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9b1b7604-78bd-4c0e-908e-ddf6e6e22503 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:25.674067 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9b1b7604-78bd-4c0e-908e-ddf6e6e22503 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:25.674711 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9b1b7604-78bd-4c0e-908e-ddf6e6e22503 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:25.675743 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9b1b7604-78bd-4c0e-908e-ddf6e6e22503 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:25.676400 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9b1b7604-78bd-4c0e-908e-ddf6e6e22503 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:25.677043 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9b1b7604-78bd-4c0e-908e-ddf6e6e22503 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:25.709385 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-db84b4d7-8637-44fa-8fd7-d3bc626dc79f tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfd6d8e6a8444f5b9fcf1cf8da242ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707f869910b34768ae1a348cd0b5f284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:02:25.749654 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-db84b4d7-8637-44fa-8fd7-d3bc626dc79f tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] 10.222.0.58 "GET /compute/v2.1/servers/9725dd3f-f5a6-496e-99c5-66ee08b6c1f7" status: 200 len: 1503 microversion: 2.1 time: 0.788089 Aug 10 23:02:25.756066 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 782/1575] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:02:24 2022] GET /compute/v2.1/servers/9725dd3f-f5a6-496e-99c5-66ee08b6c1f7 => generated 1503 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:02:25.779491 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-06ba9509-4244-4755-a1e6-7ead330df6c1 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-440143743"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:02:25.787727 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-06ba9509-4244-4755-a1e6-7ead330df6c1 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] [instance: 9725dd3f-f5a6-496e-99c5-66ee08b6c1f7] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:02:25.821102 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-06ba9509-4244-4755-a1e6-7ead330df6c1 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:25.821722 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-06ba9509-4244-4755-a1e6-7ead330df6c1 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:25.828933 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-06ba9509-4244-4755-a1e6-7ead330df6c1 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:25.838020 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-06ba9509-4244-4755-a1e6-7ead330df6c1 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:25.839443 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-06ba9509-4244-4755-a1e6-7ead330df6c1 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:25.840875 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-06ba9509-4244-4755-a1e6-7ead330df6c1 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:26.189820 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-9b1b7604-78bd-4c0e-908e-ddf6e6e22503 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:02:26.198379 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-9b1b7604-78bd-4c0e-908e-ddf6e6e22503 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:02:26.200835 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-9b1b7604-78bd-4c0e-908e-ddf6e6e22503 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:02:26.212695 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-9b1b7604-78bd-4c0e-908e-ddf6e6e22503 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] 10.222.0.58 "GET /compute/v2.1/servers/3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51" status: 200 len: 1486 microversion: 2.25 time: 0.557481 Aug 10 23:02:26.213392 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 794/1576] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:02:25 2022] GET /compute/v2.1/servers/3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51 => generated 1486 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:02:26.240166 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-dcc82b07-30d6-455f-aef3-7c56bd03c7ff tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:26.241268 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-dcc82b07-30d6-455f-aef3-7c56bd03c7ff tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] [instance: 2636ab6a-a1c8-4b70-a18f-afe073dd31db] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:02:26.269783 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dcc82b07-30d6-455f-aef3-7c56bd03c7ff tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:26.269783 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dcc82b07-30d6-455f-aef3-7c56bd03c7ff tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:26.269783 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dcc82b07-30d6-455f-aef3-7c56bd03c7ff tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:26.269783 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dcc82b07-30d6-455f-aef3-7c56bd03c7ff tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:26.270109 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dcc82b07-30d6-455f-aef3-7c56bd03c7ff tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:26.270109 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dcc82b07-30d6-455f-aef3-7c56bd03c7ff tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:26.476068 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.network.security_group_api [None req-06ba9509-4244-4755-a1e6-7ead330df6c1 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Adding security group 85b9aaad-eb49-4989-90bb-410291b4f7fb to port b6ec14f6-4359-4750-92e8-cd76718aa49e Aug 10 23:02:27.264750 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-dcc82b07-30d6-455f-aef3-7c56bd03c7ff tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '417d4eaaeb1c4df78745496ececb3e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27e6ee9495a438b8450a4ef0d62cbcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:02:27.287536 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-dcc82b07-30d6-455f-aef3-7c56bd03c7ff tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] 10.222.0.58 "GET /compute/v2.1/servers/2636ab6a-a1c8-4b70-a18f-afe073dd31db" status: 200 len: 1317 microversion: 2.1 time: 1.072486 Aug 10 23:02:27.292151 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 795/1577] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:02:26 2022] GET /compute/v2.1/servers/2636ab6a-a1c8-4b70-a18f-afe073dd31db => generated 1317 bytes in 1078 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:02:27.301416 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-d31dc6c5-a514-41f5-a693-4bb5f5ea8c06 req-98ce8b6a-8a4d-4a34-8d74-4d0e2484d1dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9acba217-4a32-4650-a43e-9d998061323c", "name": "network-vif-deleted", "tag": "7f752529-8509-4990-90aa-e93ad25cb8d1"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:02:27.324867 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-d31dc6c5-a514-41f5-a693-4bb5f5ea8c06 req-98ce8b6a-8a4d-4a34-8d74-4d0e2484d1dc service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:27.326588 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-d31dc6c5-a514-41f5-a693-4bb5f5ea8c06 req-98ce8b6a-8a4d-4a34-8d74-4d0e2484d1dc service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:27.327933 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-d31dc6c5-a514-41f5-a693-4bb5f5ea8c06 req-98ce8b6a-8a4d-4a34-8d74-4d0e2484d1dc service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:27.352406 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-d31dc6c5-a514-41f5-a693-4bb5f5ea8c06 req-98ce8b6a-8a4d-4a34-8d74-4d0e2484d1dc service nova] Creating event network-vif-deleted:7f752529-8509-4990-90aa-e93ad25cb8d1 for instance 9acba217-4a32-4650-a43e-9d998061323c on n-h1-850468-14 Aug 10 23:02:27.364552 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-d31dc6c5-a514-41f5-a693-4bb5f5ea8c06 req-98ce8b6a-8a4d-4a34-8d74-4d0e2484d1dc service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070771 Aug 10 23:02:27.372655 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 796/1578] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:02:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:02:27.379944 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-cb22764d-256f-4267-9836-b877cb0c0029 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:27.380798 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-cb22764d-256f-4267-9836-b877cb0c0029 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] [instance: 9acba217-4a32-4650-a43e-9d998061323c] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:02:27.398283 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cb22764d-256f-4267-9836-b877cb0c0029 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:27.403512 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cb22764d-256f-4267-9836-b877cb0c0029 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:27.405510 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cb22764d-256f-4267-9836-b877cb0c0029 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:27.409083 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cb22764d-256f-4267-9836-b877cb0c0029 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:27.410119 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cb22764d-256f-4267-9836-b877cb0c0029 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:27.412459 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cb22764d-256f-4267-9836-b877cb0c0029 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:27.457026 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-cb22764d-256f-4267-9836-b877cb0c0029 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] HTTP exception thrown: Instance 9acba217-4a32-4650-a43e-9d998061323c could not be found. Aug 10 23:02:27.460721 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-cb22764d-256f-4267-9836-b877cb0c0029 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Request method failure captured: Aug 10 23:02:27.460721 n-d-850468-14 devstack@n-api.service[122633]: request: GET /compute/v2.1/servers/9acba217-4a32-4650-a43e-9d998061323c HTTP/1.1 Aug 10 23:02:27.460721 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:02:27.460721 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:02:27.460721 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:02:27.460721 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:02:27.460721 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:02:27.460721 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:02:27.460721 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:02:27.460721 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:02:27.460721 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9DeQmxTbOitwd_j9YtdAnQSwQ89-Dy6u8ScBzZvyZW9HY4wPsjGy7IRMWg-qG5FMs97q83zI4T-3jk9dEElmnqLqzqyNSsYmIaBHEjEiS-9wcAaMJigIlFlxe5p_oKuFcblN8OKqmSYdvWW9qENhJcW3FtG8UPbZXFHnVNw53wlKQ4Y Aug 10 23:02:27.460721 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:02:27.460721 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:02:27.460721 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:02:27.460721 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:02:27.460721 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:02:27.460721 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:02:27.460721 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: f9582683a1cf4e92b3bd3f10db0b497b Aug 10 23:02:27.460721 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-MigrationsAdminTest-2034094486 Aug 10 23:02:27.460721 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:02:27.460721 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:02:27.463231 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f9582683a1cf4e92b3bd3f10db0b497b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f9582683a1cf4e92b3bd3f10db0b497b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/f9582683a1cf4e92b3bd3f10db0b497b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_f9582683a1cf4e92b3bd3f10db0b497b", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:02:27.463231 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-MigrationsAdminTest-2034094486 Aug 10 23:02:27.463231 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: f9582683a1cf4e92b3bd3f10db0b497b Aug 10 23:02:27.463231 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-MigrationsAdminTest-2034094486 Aug 10 23:02:27.463231 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-MigrationsAdminTest-2034094486-project Aug 10 23:02:27.463231 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:02:27.463231 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:02:27.463231 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 5c48fd7279544b1fae228500f5a1e46d Aug 10 23:02:27.463231 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-MigrationsAdminTest-2034094486-project Aug 10 23:02:27.463231 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:02:27.463231 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance 9acba217-4a32-4650-a43e-9d998061323c could not be found. Aug 10 23:02:27.463231 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': '9acba217-4a32-4650-a43e-9d998061323c'} Aug 10 23:02:27.466345 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:02:27.466345 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:02:27.466345 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:02:27.466345 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:02:27.466345 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:02:27.466345 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:02:27.466345 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:02:27.466345 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:02:27.466345 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:02:27.466345 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:02:27.466345 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9acba217-4a32-4650-a43e-9d998061323c could not be found. Aug 10 23:02:27.466345 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:02:27.466345 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:02:27.466345 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:02:27.466345 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:02:27.466345 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:02:27.466345 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:02:27.466345 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:02:27.466345 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:02:27.466345 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:02:27.469461 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:02:27.469461 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:02:27.469461 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:02:27.469461 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:02:27.469461 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:02:27.469461 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:02:27.469461 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:02:27.469461 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9acba217-4a32-4650-a43e-9d998061323c could not be found. Aug 10 23:02:27.469461 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:02:27.469461 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:02:27.469461 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:02:27.469461 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:02:27.469461 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:02:27.469461 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:02:27.469461 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:02:27.469461 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:02:27.469461 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9acba217-4a32-4650-a43e-9d998061323c could not be found. Aug 10 23:02:27.469461 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:02:27.473516 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-cb22764d-256f-4267-9836-b877cb0c0029 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] Returning 404 to user: Instance 9acba217-4a32-4650-a43e-9d998061323c could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:02:27.473516 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-cb22764d-256f-4267-9836-b877cb0c0029 tempest-MigrationsAdminTest-2034094486 tempest-MigrationsAdminTest-2034094486-project] 10.222.0.58 "GET /compute/v2.1/servers/9acba217-4a32-4650-a43e-9d998061323c" status: 404 len: 111 microversion: 2.1 time: 0.096045 Aug 10 23:02:27.480896 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 797/1579] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:02:27 2022] GET /compute/v2.1/servers/9acba217-4a32-4650-a43e-9d998061323c => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:02:27.491938 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-d0ec25f9-e770-401b-8719-3ef3bbee095f req-078638c3-d15d-49a0-bd33-51cc15e9c65f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2636ab6a-a1c8-4b70-a18f-afe073dd31db", "name": "network-vif-plugged", "status": "completed", "tag": "f6251d46-01d4-44a9-9707-04ab7fb39207"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:02:27.519038 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-d0ec25f9-e770-401b-8719-3ef3bbee095f req-078638c3-d15d-49a0-bd33-51cc15e9c65f service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:27.523708 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-d0ec25f9-e770-401b-8719-3ef3bbee095f req-078638c3-d15d-49a0-bd33-51cc15e9c65f service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:27.524944 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-d0ec25f9-e770-401b-8719-3ef3bbee095f req-078638c3-d15d-49a0-bd33-51cc15e9c65f service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:27.564062 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-d0ec25f9-e770-401b-8719-3ef3bbee095f req-078638c3-d15d-49a0-bd33-51cc15e9c65f service nova] Creating event network-vif-plugged:f6251d46-01d4-44a9-9707-04ab7fb39207 for instance 2636ab6a-a1c8-4b70-a18f-afe073dd31db on n-h2-850468-14 Aug 10 23:02:27.577663 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-d0ec25f9-e770-401b-8719-3ef3bbee095f req-078638c3-d15d-49a0-bd33-51cc15e9c65f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092999 Aug 10 23:02:27.578987 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 798/1580] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:02:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:02:27.592320 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c1ca9b87-80df-4728-b139-9704b0fc7574 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:27.593172 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-c1ca9b87-80df-4728-b139-9704b0fc7574 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] [instance: 3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:02:27.605733 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c1ca9b87-80df-4728-b139-9704b0fc7574 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:27.609551 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c1ca9b87-80df-4728-b139-9704b0fc7574 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:27.610322 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c1ca9b87-80df-4728-b139-9704b0fc7574 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:27.611379 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c1ca9b87-80df-4728-b139-9704b0fc7574 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:27.612073 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c1ca9b87-80df-4728-b139-9704b0fc7574 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:27.612772 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c1ca9b87-80df-4728-b139-9704b0fc7574 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:27.691731 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-06ba9509-4244-4755-a1e6-7ead330df6c1 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] 10.222.0.58 "POST /compute/v2.1/servers/9725dd3f-f5a6-496e-99c5-66ee08b6c1f7/action" status: 202 len: 0 microversion: 2.1 time: 1.918975 Aug 10 23:02:27.692679 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 783/1581] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:02:25 2022] POST /compute/v2.1/servers/9725dd3f-f5a6-496e-99c5-66ee08b6c1f7/action => generated 0 bytes in 1921 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:02:27.707199 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-75432099-a2e5-4f38-bc2e-8b52e09c01bf tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1025083301"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:02:27.707758 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-75432099-a2e5-4f38-bc2e-8b52e09c01bf tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] [instance: 9725dd3f-f5a6-496e-99c5-66ee08b6c1f7] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:02:27.734668 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-75432099-a2e5-4f38-bc2e-8b52e09c01bf tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:27.735268 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-75432099-a2e5-4f38-bc2e-8b52e09c01bf tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:27.739532 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-75432099-a2e5-4f38-bc2e-8b52e09c01bf tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:27.746606 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-75432099-a2e5-4f38-bc2e-8b52e09c01bf tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:27.747491 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-75432099-a2e5-4f38-bc2e-8b52e09c01bf tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:27.747950 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-75432099-a2e5-4f38-bc2e-8b52e09c01bf tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:28.421635 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-c1ca9b87-80df-4728-b139-9704b0fc7574 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:02:28.445558 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:02:28.455208 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-c1ca9b87-80df-4728-b139-9704b0fc7574 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:02:28.460707 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-c1ca9b87-80df-4728-b139-9704b0fc7574 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:02:28.465932 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-c1ca9b87-80df-4728-b139-9704b0fc7574 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] 10.222.0.58 "GET /compute/v2.1/servers/3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51" status: 200 len: 1486 microversion: 2.25 time: 0.883345 Aug 10 23:02:28.480212 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 799/1582] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:02:27 2022] GET /compute/v2.1/servers/3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51 => generated 1486 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:02:28.488472 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-d78bcf07-2c9f-4d5e-bd05-3ae14f60a5e6 req-48d2c7bb-fc86-4046-9e8f-c151a86cba29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9725dd3f-f5a6-496e-99c5-66ee08b6c1f7", "tag": "b6ec14f6-4359-4750-92e8-cd76718aa49e"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:02:28.542672 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-d78bcf07-2c9f-4d5e-bd05-3ae14f60a5e6 req-48d2c7bb-fc86-4046-9e8f-c151a86cba29 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:28.544178 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-d78bcf07-2c9f-4d5e-bd05-3ae14f60a5e6 req-48d2c7bb-fc86-4046-9e8f-c151a86cba29 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:28.546065 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-d78bcf07-2c9f-4d5e-bd05-3ae14f60a5e6 req-48d2c7bb-fc86-4046-9e8f-c151a86cba29 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:28.601435 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-d78bcf07-2c9f-4d5e-bd05-3ae14f60a5e6 req-48d2c7bb-fc86-4046-9e8f-c151a86cba29 service nova] Creating event network-changed:b6ec14f6-4359-4750-92e8-cd76718aa49e for instance 9725dd3f-f5a6-496e-99c5-66ee08b6c1f7 on n-h2-850468-14 Aug 10 23:02:28.620734 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-d78bcf07-2c9f-4d5e-bd05-3ae14f60a5e6 req-48d2c7bb-fc86-4046-9e8f-c151a86cba29 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.146572 Aug 10 23:02:28.623582 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 800/1583] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:02:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:02:28.633664 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.network.security_group_api [None req-75432099-a2e5-4f38-bc2e-8b52e09c01bf tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Adding security group d4a3fea6-2689-4e50-9b62-4cacb2a5cbb5 to port b6ec14f6-4359-4750-92e8-cd76718aa49e Aug 10 23:02:28.636061 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-b569d99c-6cfb-441a-8899-09f1f0751ebc tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:28.645291 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-b569d99c-6cfb-441a-8899-09f1f0751ebc tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] [instance: 2636ab6a-a1c8-4b70-a18f-afe073dd31db] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:02:28.662759 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b569d99c-6cfb-441a-8899-09f1f0751ebc tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:28.665342 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b569d99c-6cfb-441a-8899-09f1f0751ebc tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:28.666040 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b569d99c-6cfb-441a-8899-09f1f0751ebc tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:28.668429 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b569d99c-6cfb-441a-8899-09f1f0751ebc tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:28.669360 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b569d99c-6cfb-441a-8899-09f1f0751ebc tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:28.671035 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b569d99c-6cfb-441a-8899-09f1f0751ebc tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:29.216363 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-b569d99c-6cfb-441a-8899-09f1f0751ebc tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '417d4eaaeb1c4df78745496ececb3e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27e6ee9495a438b8450a4ef0d62cbcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:02:29.230128 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-b569d99c-6cfb-441a-8899-09f1f0751ebc tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] 10.222.0.58 "GET /compute/v2.1/servers/2636ab6a-a1c8-4b70-a18f-afe073dd31db" status: 200 len: 1317 microversion: 2.1 time: 0.603479 Aug 10 23:02:29.234273 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 801/1584] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:02:28 2022] GET /compute/v2.1/servers/2636ab6a-a1c8-4b70-a18f-afe073dd31db => generated 1317 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:02:29.499389 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-935a6cb2-8eae-4789-9fc4-f6c9a1457cf5 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:29.500112 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-935a6cb2-8eae-4789-9fc4-f6c9a1457cf5 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] [instance: 3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:02:29.536192 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-935a6cb2-8eae-4789-9fc4-f6c9a1457cf5 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:29.538707 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-935a6cb2-8eae-4789-9fc4-f6c9a1457cf5 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:29.545666 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-935a6cb2-8eae-4789-9fc4-f6c9a1457cf5 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:29.546735 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-935a6cb2-8eae-4789-9fc4-f6c9a1457cf5 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:29.547308 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-935a6cb2-8eae-4789-9fc4-f6c9a1457cf5 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:29.578865 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-935a6cb2-8eae-4789-9fc4-f6c9a1457cf5 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:30.418519 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-935a6cb2-8eae-4789-9fc4-f6c9a1457cf5 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:02:30.440549 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-935a6cb2-8eae-4789-9fc4-f6c9a1457cf5 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:02:30.443992 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-935a6cb2-8eae-4789-9fc4-f6c9a1457cf5 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:02:30.445700 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-935a6cb2-8eae-4789-9fc4-f6c9a1457cf5 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] 10.222.0.58 "GET /compute/v2.1/servers/3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51" status: 200 len: 1486 microversion: 2.25 time: 0.952414 Aug 10 23:02:30.448733 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 802/1585] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:02:29 2022] GET /compute/v2.1/servers/3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51 => generated 1486 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:02:30.465096 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-5b2d43c1-fa21-44a4-a5d6-02704882ea89 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:30.466475 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-5b2d43c1-fa21-44a4-a5d6-02704882ea89 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] [instance: 2636ab6a-a1c8-4b70-a18f-afe073dd31db] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:02:30.477623 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5b2d43c1-fa21-44a4-a5d6-02704882ea89 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:30.478728 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5b2d43c1-fa21-44a4-a5d6-02704882ea89 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:30.480201 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5b2d43c1-fa21-44a4-a5d6-02704882ea89 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:30.483040 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5b2d43c1-fa21-44a4-a5d6-02704882ea89 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:30.483999 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5b2d43c1-fa21-44a4-a5d6-02704882ea89 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:30.484695 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5b2d43c1-fa21-44a4-a5d6-02704882ea89 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:30.765025 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-75432099-a2e5-4f38-bc2e-8b52e09c01bf tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] 10.222.0.58 "POST /compute/v2.1/servers/9725dd3f-f5a6-496e-99c5-66ee08b6c1f7/action" status: 202 len: 0 microversion: 2.1 time: 3.066755 Aug 10 23:02:30.771405 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 784/1586] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:02:27 2022] POST /compute/v2.1/servers/9725dd3f-f5a6-496e-99c5-66ee08b6c1f7/action => generated 0 bytes in 3074 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 10 23:02:30.778069 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-1ec04456-3309-42a4-9ba6-782a0a5833ae tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:30.780235 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-1ec04456-3309-42a4-9ba6-782a0a5833ae tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] [instance: 9725dd3f-f5a6-496e-99c5-66ee08b6c1f7] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:02:30.810688 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1ec04456-3309-42a4-9ba6-782a0a5833ae tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:30.811776 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1ec04456-3309-42a4-9ba6-782a0a5833ae tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:30.812381 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1ec04456-3309-42a4-9ba6-782a0a5833ae tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:30.813828 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1ec04456-3309-42a4-9ba6-782a0a5833ae tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:30.814467 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1ec04456-3309-42a4-9ba6-782a0a5833ae tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:30.815093 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1ec04456-3309-42a4-9ba6-782a0a5833ae tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:31.175324 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-5b2d43c1-fa21-44a4-a5d6-02704882ea89 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '417d4eaaeb1c4df78745496ececb3e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27e6ee9495a438b8450a4ef0d62cbcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:02:31.199288 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-5b2d43c1-fa21-44a4-a5d6-02704882ea89 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] 10.222.0.58 "GET /compute/v2.1/servers/2636ab6a-a1c8-4b70-a18f-afe073dd31db" status: 200 len: 1467 microversion: 2.1 time: 0.748477 Aug 10 23:02:31.201183 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 803/1587] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:02:30 2022] GET /compute/v2.1/servers/2636ab6a-a1c8-4b70-a18f-afe073dd31db => generated 1467 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:02:31.220821 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-b80f02ff-edc2-422f-8c9b-5f24f0a40fd2 req-3538566a-75c1-43f7-a7a3-838224335e63 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9725dd3f-f5a6-496e-99c5-66ee08b6c1f7", "tag": "b6ec14f6-4359-4750-92e8-cd76718aa49e"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:02:31.247577 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-b80f02ff-edc2-422f-8c9b-5f24f0a40fd2 req-3538566a-75c1-43f7-a7a3-838224335e63 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:31.250533 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-b80f02ff-edc2-422f-8c9b-5f24f0a40fd2 req-3538566a-75c1-43f7-a7a3-838224335e63 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:31.251029 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-b80f02ff-edc2-422f-8c9b-5f24f0a40fd2 req-3538566a-75c1-43f7-a7a3-838224335e63 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:31.290846 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-b80f02ff-edc2-422f-8c9b-5f24f0a40fd2 req-3538566a-75c1-43f7-a7a3-838224335e63 service nova] Creating event network-changed:b6ec14f6-4359-4750-92e8-cd76718aa49e for instance 9725dd3f-f5a6-496e-99c5-66ee08b6c1f7 on n-h2-850468-14 Aug 10 23:02:31.308890 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-b80f02ff-edc2-422f-8c9b-5f24f0a40fd2 req-3538566a-75c1-43f7-a7a3-838224335e63 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102612 Aug 10 23:02:31.312944 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 804/1588] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:02:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:02:31.325721 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-afc21d68-d996-43c7-b8fe-41cba8350b1c tempest-ServersOnMultiNodesTest-79489 tempest-ServersOnMultiNodesTest-79489-project-admin] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:31.327231 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-afc21d68-d996-43c7-b8fe-41cba8350b1c tempest-ServersOnMultiNodesTest-79489 tempest-ServersOnMultiNodesTest-79489-project-admin] [instance: 2636ab6a-a1c8-4b70-a18f-afe073dd31db] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:02:31.349987 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-afc21d68-d996-43c7-b8fe-41cba8350b1c tempest-ServersOnMultiNodesTest-79489 tempest-ServersOnMultiNodesTest-79489-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:31.350739 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-afc21d68-d996-43c7-b8fe-41cba8350b1c tempest-ServersOnMultiNodesTest-79489 tempest-ServersOnMultiNodesTest-79489-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:31.351393 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-afc21d68-d996-43c7-b8fe-41cba8350b1c tempest-ServersOnMultiNodesTest-79489 tempest-ServersOnMultiNodesTest-79489-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:31.354505 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-afc21d68-d996-43c7-b8fe-41cba8350b1c tempest-ServersOnMultiNodesTest-79489 tempest-ServersOnMultiNodesTest-79489-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:31.370226 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-afc21d68-d996-43c7-b8fe-41cba8350b1c tempest-ServersOnMultiNodesTest-79489 tempest-ServersOnMultiNodesTest-79489-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:31.373221 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-afc21d68-d996-43c7-b8fe-41cba8350b1c tempest-ServersOnMultiNodesTest-79489 tempest-ServersOnMultiNodesTest-79489-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:32.321523 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-afc21d68-d996-43c7-b8fe-41cba8350b1c tempest-ServersOnMultiNodesTest-79489 tempest-ServersOnMultiNodesTest-79489-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/2636ab6a-a1c8-4b70-a18f-afe073dd31db" status: 200 len: 1620 microversion: 2.1 time: 1.007117 Aug 10 23:02:32.324362 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 805/1589] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:02:31 2022] GET /compute/v2.1/servers/2636ab6a-a1c8-4b70-a18f-afe073dd31db => generated 1620 bytes in 1011 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:02:32.341041 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-6fa6f1d6-0df7-41a4-af66-ea9317cc1ebf tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:32.342130 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-6fa6f1d6-0df7-41a4-af66-ea9317cc1ebf tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] [instance: 3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:02:32.351529 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6fa6f1d6-0df7-41a4-af66-ea9317cc1ebf tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:32.356849 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6fa6f1d6-0df7-41a4-af66-ea9317cc1ebf tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:32.357987 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6fa6f1d6-0df7-41a4-af66-ea9317cc1ebf tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:32.360561 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6fa6f1d6-0df7-41a4-af66-ea9317cc1ebf tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:32.361311 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6fa6f1d6-0df7-41a4-af66-ea9317cc1ebf tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:32.362774 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6fa6f1d6-0df7-41a4-af66-ea9317cc1ebf tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:32.816996 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-6fa6f1d6-0df7-41a4-af66-ea9317cc1ebf tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:02:32.830375 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-6fa6f1d6-0df7-41a4-af66-ea9317cc1ebf tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:02:32.836053 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-6fa6f1d6-0df7-41a4-af66-ea9317cc1ebf tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:02:32.840648 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-6fa6f1d6-0df7-41a4-af66-ea9317cc1ebf tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] 10.222.0.58 "GET /compute/v2.1/servers/3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51" status: 200 len: 1486 microversion: 2.25 time: 0.512850 Aug 10 23:02:32.843199 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 806/1590] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:02:32 2022] GET /compute/v2.1/servers/3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51 => generated 1486 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:02:32.990214 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-0ac28b6c-4df6-418d-9626-89a606805060 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1600491151", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "0af574c3-bfa0-4df6-8f0e-6fcd12e9b8a9"}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:02:33.089724 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.network.neutron [None req-0ac28b6c-4df6-418d-9626-89a606805060 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] validate_networks() for None {{(pid=122633) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 23:02:33.149984 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-1ec04456-3309-42a4-9ba6-782a0a5833ae tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] 10.222.0.58 "GET /compute/v2.1/servers/9725dd3f-f5a6-496e-99c5-66ee08b6c1f7/os-security-groups" status: 200 len: 1158 microversion: 2.1 time: 2.377290 Aug 10 23:02:33.150580 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 785/1591] 10.222.0.58 () {58 vars in 1293 bytes} [Wed Aug 10 23:02:30 2022] GET /compute/v2.1/servers/9725dd3f-f5a6-496e-99c5-66ee08b6c1f7/os-security-groups => generated 1158 bytes in 2379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:02:33.177023 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-48b1c24f-df2c-4e17-8664-59ad188ac728 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Action: 'create', calling method: .version_select at 0x7f847d2064c0>, body: {"security_group": {"name": " tempest-securitygroup -534341561 ", "description": "tempest-description-1954991954"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:02:33.960718 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-0ac28b6c-4df6-418d-9626-89a606805060 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Flavor limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:02:33.961792 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-0ac28b6c-4df6-418d-9626-89a606805060 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Image limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:02:33.962395 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-0ac28b6c-4df6-418d-9626-89a606805060 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Flavor pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:02:33.962977 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-0ac28b6c-4df6-418d-9626-89a606805060 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Image pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:02:33.963567 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-0ac28b6c-4df6-418d-9626-89a606805060 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:02:33.978085 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0ac28b6c-4df6-418d-9626-89a606805060 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:33.979012 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0ac28b6c-4df6-418d-9626-89a606805060 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:33.980231 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0ac28b6c-4df6-418d-9626-89a606805060 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:33.981380 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0ac28b6c-4df6-418d-9626-89a606805060 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:33.982319 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0ac28b6c-4df6-418d-9626-89a606805060 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:33.983070 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0ac28b6c-4df6-418d-9626-89a606805060 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:34.062977 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-0ac28b6c-4df6-418d-9626-89a606805060 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Getting quotas for project b27e6ee9495a438b8450a4ef0d62cbcd. Resources: {'instances', 'cores', 'ram'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:02:34.080206 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-0ac28b6c-4df6-418d-9626-89a606805060 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Getting quotas for user 417d4eaaeb1c4df78745496ececb3e88 and project b27e6ee9495a438b8450a4ef0d62cbcd. Resources: {'instances', 'cores', 'ram'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:02:34.130539 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-0ac28b6c-4df6-418d-9626-89a606805060 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Going to run 1 instances... {{(pid=122633) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 23:02:34.134083 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-0ac28b6c-4df6-418d-9626-89a606805060 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] [instance: 1fcd0cf8-e654-4e2a-bf05-d5d3c47bd200] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78ad8905-f66f-4733-8be9-2b260f1fabed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122633) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 23:02:34.245087 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-0ac28b6c-4df6-418d-9626-89a606805060 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.260179 Aug 10 23:02:34.249010 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 807/1592] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 23:02:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 1267 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 10 23:02:34.258816 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-5f497262-ef09-448a-93c2-ef5a2cc5aa1b tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:34.261632 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-5f497262-ef09-448a-93c2-ef5a2cc5aa1b tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] [instance: 3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:02:34.271517 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5f497262-ef09-448a-93c2-ef5a2cc5aa1b tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:34.272528 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5f497262-ef09-448a-93c2-ef5a2cc5aa1b tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:34.273990 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5f497262-ef09-448a-93c2-ef5a2cc5aa1b tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:34.275783 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5f497262-ef09-448a-93c2-ef5a2cc5aa1b tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:34.278684 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5f497262-ef09-448a-93c2-ef5a2cc5aa1b tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:34.285831 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5f497262-ef09-448a-93c2-ef5a2cc5aa1b tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:34.731723 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-5f497262-ef09-448a-93c2-ef5a2cc5aa1b tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:02:34.746157 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-5f497262-ef09-448a-93c2-ef5a2cc5aa1b tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:02:34.753089 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-5f497262-ef09-448a-93c2-ef5a2cc5aa1b tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:02:34.761619 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-5f497262-ef09-448a-93c2-ef5a2cc5aa1b tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] 10.222.0.58 "GET /compute/v2.1/servers/3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51" status: 200 len: 1486 microversion: 2.25 time: 0.505436 Aug 10 23:02:34.766106 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 808/1593] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:02:34 2022] GET /compute/v2.1/servers/3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51 => generated 1486 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:02:34.777032 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-3fdf871a-ce30-479a-9b02-3559cb89e232 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:34.778737 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-3fdf871a-ce30-479a-9b02-3559cb89e232 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] [instance: 1fcd0cf8-e654-4e2a-bf05-d5d3c47bd200] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:02:34.911483 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-3fdf871a-ce30-479a-9b02-3559cb89e232 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '417d4eaaeb1c4df78745496ececb3e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27e6ee9495a438b8450a4ef0d62cbcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:02:34.921868 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-3fdf871a-ce30-479a-9b02-3559cb89e232 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] 10.222.0.58 "GET /compute/v2.1/servers/1fcd0cf8-e654-4e2a-bf05-d5d3c47bd200" status: 200 len: 1217 microversion: 2.1 time: 0.154289 Aug 10 23:02:34.922638 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 809/1594] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:02:34 2022] GET /compute/v2.1/servers/1fcd0cf8-e654-4e2a-bf05-d5d3c47bd200 => generated 1217 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:02:34.966833 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-48b1c24f-df2c-4e17-8664-59ad188ac728 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] 10.222.0.58 "POST /compute/v2.1/os-security-groups" status: 200 len: 223 microversion: 2.1 time: 1.801399 Aug 10 23:02:34.967794 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 786/1595] 10.222.0.58 () {60 vars in 1180 bytes} [Wed Aug 10 23:02:33 2022] POST /compute/v2.1/os-security-groups => generated 223 bytes in 1804 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:02:34.983146 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-d655bfb9-4269-44dc-94cb-8480e9a90006 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Calling method '.version_select at 0x7f847d2ca040>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:35.106192 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-d655bfb9-4269-44dc-94cb-8480e9a90006 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] 10.222.0.58 "GET /compute/v2.1/os-security-groups/9643f52d-6588-49da-be41-0e1ee1ca0e5f" status: 200 len: 223 microversion: 2.1 time: 0.128824 Aug 10 23:02:35.106823 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 810/1596] 10.222.0.58 () {58 vars in 1269 bytes} [Wed Aug 10 23:02:34 2022] GET /compute/v2.1/os-security-groups/9643f52d-6588-49da-be41-0e1ee1ca0e5f => generated 223 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:02:35.138047 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-e25af3c9-2d2a-41fc-8b11-0e391e401f2a tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Calling method '.version_select at 0x7f847d1b3700>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:35.718733 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-e25af3c9-2d2a-41fc-8b11-0e391e401f2a tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/9643f52d-6588-49da-be41-0e1ee1ca0e5f" status: 202 len: 0 microversion: 2.1 time: 0.602950 Aug 10 23:02:35.719419 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 787/1597] 10.222.0.58 () {58 vars in 1272 bytes} [Wed Aug 10 23:02:35 2022] DELETE /compute/v2.1/os-security-groups/9643f52d-6588-49da-be41-0e1ee1ca0e5f => generated 0 bytes in 605 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:02:35.728514 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-0c60e883-f141-4096-b3bd-3d3c00555bf6 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Calling method '.version_select at 0x7f847d2959d0>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:35.766927 n-d-850468-14 devstack@n-api.service[122633]: DEBUG neutronclient.v2_0.client [None req-0c60e883-f141-4096-b3bd-3d3c00555bf6 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 9643f52d-6588-49da-be41-0e1ee1ca0e5f does not exist", "detail": ""}} {{(pid=122633) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 10 23:02:35.767862 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.network.security_group_api [None req-0c60e883-f141-4096-b3bd-3d3c00555bf6 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Neutron security group 9643f52d-6588-49da-be41-0e1ee1ca0e5f not found {{(pid=122633) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 10 23:02:35.768462 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-0c60e883-f141-4096-b3bd-3d3c00555bf6 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] HTTP exception thrown: Security group 9643f52d-6588-49da-be41-0e1ee1ca0e5f does not exist Aug 10 23:02:35.768462 n-d-850468-14 devstack@n-api.service[122633]: Neutron server returns request_ids: ['req-ee0467f1-a429-491b-9843-549745da9b09'] Aug 10 23:02:35.789121 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-0c60e883-f141-4096-b3bd-3d3c00555bf6 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Request method failure captured: Aug 10 23:02:35.789121 n-d-850468-14 devstack@n-api.service[122633]: request: GET /compute/v2.1/os-security-groups/9643f52d-6588-49da-be41-0e1ee1ca0e5f HTTP/1.1 Aug 10 23:02:35.789121 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:02:35.789121 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:02:35.789121 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:02:35.789121 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:02:35.789121 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:02:35.789121 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:02:35.789121 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:02:35.789121 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:02:35.789121 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9Dju6bcY6WgJPTWLWUJ0fX6JaJBRP8GkYZWFafNrDYn8ACaF-JC0t8YD4rSPFgG5Deze7mjmq2_rnPCZ1jpXNRGkHxz134mT5MqTqUm9UAyuVcbLtNQAiAf-L4A3117brPwKa_CN56-tZ47WT8aAPEON_2-WsEOp9qATqEToy30jo_s Aug 10 23:02:35.789121 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:02:35.789121 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:02:35.789121 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:02:35.789121 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:02:35.789121 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:02:35.789121 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:02:35.789121 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 707f869910b34768ae1a348cd0b5f284 Aug 10 23:02:35.789121 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-SecurityGroupsTestJSON-1406525704 Aug 10 23:02:35.789121 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:02:35.789121 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:02:35.791645 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/707f869910b34768ae1a348cd0b5f284"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/707f869910b34768ae1a348cd0b5f284"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/707f869910b34768ae1a348cd0b5f284"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_707f869910b34768ae1a348cd0b5f284", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:02:35.791645 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-SecurityGroupsTestJSON-1406525704 Aug 10 23:02:35.791645 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 707f869910b34768ae1a348cd0b5f284 Aug 10 23:02:35.791645 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1406525704 Aug 10 23:02:35.791645 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-SecurityGroupsTestJSON-1406525704-project Aug 10 23:02:35.791645 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:02:35.791645 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:02:35.791645 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: bfd6d8e6a8444f5b9fcf1cf8da242ac0 Aug 10 23:02:35.791645 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-SecurityGroupsTestJSON-1406525704-project Aug 10 23:02:35.791645 n-d-850468-14 devstack@n-api.service[122633]: method: Aug 10 23:02:35.791645 n-d-850468-14 devstack@n-api.service[122633]: exception: Security group 9643f52d-6588-49da-be41-0e1ee1ca0e5f does not exist Aug 10 23:02:35.791645 n-d-850468-14 devstack@n-api.service[122633]: Neutron server returns request_ids: ['req-ee0467f1-a429-491b-9843-549745da9b09'] Aug 10 23:02:35.791645 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': '9643f52d-6588-49da-be41-0e1ee1ca0e5f'} Aug 10 23:02:35.792803 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:02:35.792803 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:02:35.792803 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 10 23:02:35.792803 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 10 23:02:35.792803 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 23:02:35.792803 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 23:02:35.792803 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 10 23:02:35.792803 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 10 23:02:35.792803 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 23:02:35.792803 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 23:02:35.792803 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 23:02:35.792803 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 23:02:35.792803 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 23:02:35.792803 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 23:02:35.792803 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 23:02:35.792803 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 23:02:35.792803 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 23:02:35.792803 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 23:02:35.792803 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 10 23:02:35.794408 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 10 23:02:35.794408 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 23:02:35.794408 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 23:02:35.794408 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 10 23:02:35.794408 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 10 23:02:35.794408 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 10 23:02:35.794408 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 10 23:02:35.794408 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 9643f52d-6588-49da-be41-0e1ee1ca0e5f does not exist Aug 10 23:02:35.794408 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ee0467f1-a429-491b-9843-549745da9b09'] Aug 10 23:02:35.794408 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:02:35.794408 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:02:35.794408 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:02:35.794408 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:02:35.794408 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 10 23:02:35.794408 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 10 23:02:35.794408 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 10 23:02:35.794408 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 10 23:02:35.794408 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 9643f52d-6588-49da-be41-0e1ee1ca0e5f does not exist Aug 10 23:02:35.796018 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ee0467f1-a429-491b-9843-549745da9b09'] Aug 10 23:02:35.796018 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:02:35.796018 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:02:35.796018 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:02:35.796018 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:02:35.796018 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:02:35.796018 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:02:35.796018 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:02:35.796018 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:02:35.796018 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 23:02:35.796018 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 23:02:35.796018 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:02:35.796018 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:02:35.796018 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 10 23:02:35.796018 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 10 23:02:35.796018 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 9643f52d-6588-49da-be41-0e1ee1ca0e5f does not exist Aug 10 23:02:35.796018 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ee0467f1-a429-491b-9843-549745da9b09'] Aug 10 23:02:35.796018 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:02:35.796018 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:02:35.796018 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:02:35.796018 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:02:35.798054 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:02:35.798054 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:02:35.798054 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:02:35.798054 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:02:35.798054 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 9643f52d-6588-49da-be41-0e1ee1ca0e5f does not exist Aug 10 23:02:35.798054 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ee0467f1-a429-491b-9843-549745da9b09'] Aug 10 23:02:35.798054 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:02:35.799012 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-06fb295a-47fc-4b7a-9344-a8e46961a5f0 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:35.800024 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-0c60e883-f141-4096-b3bd-3d3c00555bf6 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Returning 404 to user: Security group 9643f52d-6588-49da-be41-0e1ee1ca0e5f does not exist Aug 10 23:02:35.800024 n-d-850468-14 devstack@n-api.service[122633]: Neutron server returns request_ids: ['req-ee0467f1-a429-491b-9843-549745da9b09'] {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:02:35.800245 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-06fb295a-47fc-4b7a-9344-a8e46961a5f0 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] [instance: 3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:02:35.801232 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-0c60e883-f141-4096-b3bd-3d3c00555bf6 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] 10.222.0.58 "GET /compute/v2.1/os-security-groups/9643f52d-6588-49da-be41-0e1ee1ca0e5f" status: 404 len: 194 microversion: 2.1 time: 0.077110 Aug 10 23:02:35.802414 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 811/1598] 10.222.0.58 () {58 vars in 1269 bytes} [Wed Aug 10 23:02:35 2022] GET /compute/v2.1/os-security-groups/9643f52d-6588-49da-be41-0e1ee1ca0e5f => generated 194 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:02:35.811299 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-06fb295a-47fc-4b7a-9344-a8e46961a5f0 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:35.812353 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-06fb295a-47fc-4b7a-9344-a8e46961a5f0 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:35.812804 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-06fb295a-47fc-4b7a-9344-a8e46961a5f0 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:35.814364 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-87bdffd4-9ea0-49a0-8b15-79c208fe5d8b tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Action: 'create', calling method: .version_select at 0x7f847d371700>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-944902977", "description": "tempest-description-587579962"}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:02:35.814553 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-06fb295a-47fc-4b7a-9344-a8e46961a5f0 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:35.815184 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-06fb295a-47fc-4b7a-9344-a8e46961a5f0 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:35.816182 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-06fb295a-47fc-4b7a-9344-a8e46961a5f0 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:36.096448 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-06fb295a-47fc-4b7a-9344-a8e46961a5f0 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:02:36.114717 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-06fb295a-47fc-4b7a-9344-a8e46961a5f0 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:02:36.116664 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-06fb295a-47fc-4b7a-9344-a8e46961a5f0 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:02:36.117859 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-06fb295a-47fc-4b7a-9344-a8e46961a5f0 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] 10.222.0.58 "GET /compute/v2.1/servers/3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51" status: 200 len: 1486 microversion: 2.25 time: 0.331969 Aug 10 23:02:36.118734 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 788/1599] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:02:35 2022] GET /compute/v2.1/servers/3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51 => generated 1486 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:02:36.123915 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-9f65863e-f523-4fd3-9510-4d54a24a274e tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:36.124565 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-9f65863e-f523-4fd3-9510-4d54a24a274e tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] [instance: 1fcd0cf8-e654-4e2a-bf05-d5d3c47bd200] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:02:36.146363 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9f65863e-f523-4fd3-9510-4d54a24a274e tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:36.146899 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9f65863e-f523-4fd3-9510-4d54a24a274e tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:36.147409 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9f65863e-f523-4fd3-9510-4d54a24a274e tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:36.148135 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9f65863e-f523-4fd3-9510-4d54a24a274e tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:36.159570 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9f65863e-f523-4fd3-9510-4d54a24a274e tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:36.160326 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9f65863e-f523-4fd3-9510-4d54a24a274e tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:36.305295 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-9f65863e-f523-4fd3-9510-4d54a24a274e tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '417d4eaaeb1c4df78745496ececb3e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27e6ee9495a438b8450a4ef0d62cbcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:02:36.317342 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-9f65863e-f523-4fd3-9510-4d54a24a274e tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] 10.222.0.58 "GET /compute/v2.1/servers/1fcd0cf8-e654-4e2a-bf05-d5d3c47bd200" status: 200 len: 1287 microversion: 2.1 time: 0.196911 Aug 10 23:02:36.317999 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 789/1600] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:02:36 2022] GET /compute/v2.1/servers/1fcd0cf8-e654-4e2a-bf05-d5d3c47bd200 => generated 1287 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:02:36.478058 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-87bdffd4-9ea0-49a0-8b15-79c208fe5d8b tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] 10.222.0.58 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.668604 Aug 10 23:02:36.479205 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 812/1601] 10.222.0.58 () {60 vars in 1180 bytes} [Wed Aug 10 23:02:35 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 23:02:36.492132 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-20154d8a-b938-455d-b889-ce24742970a0 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Action: 'create', calling method: .version_select at 0x7f847d11fc10>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-866896482", "description": "tempest-description-1362612318"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:02:36.769451 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-20154d8a-b938-455d-b889-ce24742970a0 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] 10.222.0.58 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.281557 Aug 10 23:02:36.771223 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 790/1602] 10.222.0.58 () {60 vars in 1180 bytes} [Wed Aug 10 23:02:36 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:02:36.792505 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-40ad6e30-e395-43f1-80d3-a3777a5ebd7a tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Action: 'create', calling method: .version_select at 0x7f847d32caf0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1457214394", "description": "tempest-description-1039740906"}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:02:37.143203 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-dd788f2f-ef2d-4a49-86cf-6f13e059db0c tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:37.144590 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-dd788f2f-ef2d-4a49-86cf-6f13e059db0c tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] [instance: 3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:02:37.158687 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dd788f2f-ef2d-4a49-86cf-6f13e059db0c tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:37.159226 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dd788f2f-ef2d-4a49-86cf-6f13e059db0c tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:37.165795 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dd788f2f-ef2d-4a49-86cf-6f13e059db0c tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:37.167288 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dd788f2f-ef2d-4a49-86cf-6f13e059db0c tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:37.167905 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dd788f2f-ef2d-4a49-86cf-6f13e059db0c tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:37.168342 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dd788f2f-ef2d-4a49-86cf-6f13e059db0c tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:37.459207 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-40ad6e30-e395-43f1-80d3-a3777a5ebd7a tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] 10.222.0.58 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.677831 Aug 10 23:02:37.460590 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 813/1603] 10.222.0.58 () {60 vars in 1180 bytes} [Wed Aug 10 23:02:36 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:02:37.468002 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-83b2bd46-3824-4cbf-ae06-0cbee5e26301 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:37.470703 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-83b2bd46-3824-4cbf-ae06-0cbee5e26301 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] [instance: 1fcd0cf8-e654-4e2a-bf05-d5d3c47bd200] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:02:37.495865 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-83b2bd46-3824-4cbf-ae06-0cbee5e26301 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:37.497803 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-83b2bd46-3824-4cbf-ae06-0cbee5e26301 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:37.500098 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-83b2bd46-3824-4cbf-ae06-0cbee5e26301 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:37.502407 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-83b2bd46-3824-4cbf-ae06-0cbee5e26301 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:37.504661 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-83b2bd46-3824-4cbf-ae06-0cbee5e26301 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:37.505752 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-83b2bd46-3824-4cbf-ae06-0cbee5e26301 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:37.622621 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-dd788f2f-ef2d-4a49-86cf-6f13e059db0c tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:02:37.638823 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-dd788f2f-ef2d-4a49-86cf-6f13e059db0c tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:02:37.643043 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-dd788f2f-ef2d-4a49-86cf-6f13e059db0c tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:02:37.644402 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-dd788f2f-ef2d-4a49-86cf-6f13e059db0c tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] 10.222.0.58 "GET /compute/v2.1/servers/3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51" status: 200 len: 1486 microversion: 2.25 time: 0.505822 Aug 10 23:02:37.647291 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 791/1604] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:02:37 2022] GET /compute/v2.1/servers/3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51 => generated 1486 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:02:37.652373 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-eae301d1-9f90-40d0-93b3-985471802530 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Calling method '.version_select at 0x7f847d11f670>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:38.029199 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-eae301d1-9f90-40d0-93b3-985471802530 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] 10.222.0.58 "GET /compute/v2.1/os-security-groups" status: 200 len: 1833 microversion: 2.1 time: 0.380688 Aug 10 23:02:38.030237 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 792/1605] 10.222.0.58 () {58 vars in 1158 bytes} [Wed Aug 10 23:02:37 2022] GET /compute/v2.1/os-security-groups => generated 1833 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:02:38.043490 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-83b2bd46-3824-4cbf-ae06-0cbee5e26301 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '417d4eaaeb1c4df78745496ececb3e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27e6ee9495a438b8450a4ef0d62cbcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:02:38.049639 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-e4b8df93-dab1-478b-b8b5-b2ed6adc1070 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Calling method '.version_select at 0x7f847d1e21f0>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:38.066050 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-83b2bd46-3824-4cbf-ae06-0cbee5e26301 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] 10.222.0.58 "GET /compute/v2.1/servers/1fcd0cf8-e654-4e2a-bf05-d5d3c47bd200" status: 200 len: 1317 microversion: 2.1 time: 0.603664 Aug 10 23:02:38.069068 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 814/1606] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:02:37 2022] GET /compute/v2.1/servers/1fcd0cf8-e654-4e2a-bf05-d5d3c47bd200 => generated 1317 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:02:38.361983 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-e4b8df93-dab1-478b-b8b5-b2ed6adc1070 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/8d006294-7bbe-4631-93c9-515e3239f0aa" status: 202 len: 0 microversion: 2.1 time: 0.321314 Aug 10 23:02:38.363258 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 793/1607] 10.222.0.58 () {58 vars in 1272 bytes} [Wed Aug 10 23:02:38 2022] DELETE /compute/v2.1/os-security-groups/8d006294-7bbe-4631-93c9-515e3239f0aa => generated 0 bytes in 323 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:02:38.373115 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-dfc631be-78a3-499e-98a0-f3a2a6e72ede tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Calling method '.version_select at 0x7f847d27eee0>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:38.419165 n-d-850468-14 devstack@n-api.service[122632]: DEBUG neutronclient.v2_0.client [None req-dfc631be-78a3-499e-98a0-f3a2a6e72ede tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 8d006294-7bbe-4631-93c9-515e3239f0aa does not exist", "detail": ""}} {{(pid=122632) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 10 23:02:38.420040 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.network.security_group_api [None req-dfc631be-78a3-499e-98a0-f3a2a6e72ede tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Neutron security group 8d006294-7bbe-4631-93c9-515e3239f0aa not found {{(pid=122632) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 10 23:02:38.420897 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-dfc631be-78a3-499e-98a0-f3a2a6e72ede tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] HTTP exception thrown: Security group 8d006294-7bbe-4631-93c9-515e3239f0aa does not exist Aug 10 23:02:38.420897 n-d-850468-14 devstack@n-api.service[122632]: Neutron server returns request_ids: ['req-890d7a94-6702-4683-a98c-fbc6f237664c'] Aug 10 23:02:38.426423 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-dfc631be-78a3-499e-98a0-f3a2a6e72ede tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Request method failure captured: Aug 10 23:02:38.426423 n-d-850468-14 devstack@n-api.service[122632]: request: GET /compute/v2.1/os-security-groups/8d006294-7bbe-4631-93c9-515e3239f0aa HTTP/1.1 Aug 10 23:02:38.426423 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:02:38.426423 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:02:38.426423 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:02:38.426423 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 23:02:38.426423 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:02:38.426423 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:02:38.426423 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:02:38.426423 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:02:38.426423 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9Dju6bcY6WgJPTWLWUJ0fX6JaJBRP8GkYZWFafNrDYn8ACaF-JC0t8YD4rSPFgG5Deze7mjmq2_rnPCZ1jpXNRGkHxz134mT5MqTqUm9UAyuVcbLtNQAiAf-L4A3117brPwKa_CN56-tZ47WT8aAPEON_2-WsEOp9qATqEToy30jo_s Aug 10 23:02:38.426423 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:02:38.426423 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:02:38.426423 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:02:38.426423 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:02:38.426423 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:02:38.426423 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:02:38.426423 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 707f869910b34768ae1a348cd0b5f284 Aug 10 23:02:38.426423 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-SecurityGroupsTestJSON-1406525704 Aug 10 23:02:38.426423 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:02:38.426423 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:02:38.428091 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/707f869910b34768ae1a348cd0b5f284"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/707f869910b34768ae1a348cd0b5f284"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/707f869910b34768ae1a348cd0b5f284"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_707f869910b34768ae1a348cd0b5f284", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:02:38.428091 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-SecurityGroupsTestJSON-1406525704 Aug 10 23:02:38.428091 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 707f869910b34768ae1a348cd0b5f284 Aug 10 23:02:38.428091 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1406525704 Aug 10 23:02:38.428091 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-SecurityGroupsTestJSON-1406525704-project Aug 10 23:02:38.428091 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:02:38.428091 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:02:38.428091 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: bfd6d8e6a8444f5b9fcf1cf8da242ac0 Aug 10 23:02:38.428091 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-SecurityGroupsTestJSON-1406525704-project Aug 10 23:02:38.428091 n-d-850468-14 devstack@n-api.service[122632]: method: Aug 10 23:02:38.428091 n-d-850468-14 devstack@n-api.service[122632]: exception: Security group 8d006294-7bbe-4631-93c9-515e3239f0aa does not exist Aug 10 23:02:38.428091 n-d-850468-14 devstack@n-api.service[122632]: Neutron server returns request_ids: ['req-890d7a94-6702-4683-a98c-fbc6f237664c'] Aug 10 23:02:38.428091 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': '8d006294-7bbe-4631-93c9-515e3239f0aa'} Aug 10 23:02:38.429624 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:02:38.429624 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:02:38.429624 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 10 23:02:38.429624 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 10 23:02:38.429624 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 23:02:38.429624 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 23:02:38.429624 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 10 23:02:38.429624 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 10 23:02:38.429624 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 23:02:38.429624 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 23:02:38.429624 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 23:02:38.429624 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 23:02:38.429624 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 23:02:38.429624 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 23:02:38.429624 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 23:02:38.429624 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 23:02:38.429624 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 23:02:38.429624 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 23:02:38.429624 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 10 23:02:38.432196 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 10 23:02:38.432196 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 23:02:38.432196 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 23:02:38.432196 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 10 23:02:38.432196 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 10 23:02:38.432196 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 10 23:02:38.432196 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 10 23:02:38.432196 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 8d006294-7bbe-4631-93c9-515e3239f0aa does not exist Aug 10 23:02:38.432196 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-890d7a94-6702-4683-a98c-fbc6f237664c'] Aug 10 23:02:38.432196 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:02:38.432196 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:02:38.432196 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:02:38.432196 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:02:38.432196 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 10 23:02:38.432196 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 10 23:02:38.432196 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 10 23:02:38.432196 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 10 23:02:38.432196 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 8d006294-7bbe-4631-93c9-515e3239f0aa does not exist Aug 10 23:02:38.435131 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-890d7a94-6702-4683-a98c-fbc6f237664c'] Aug 10 23:02:38.435131 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:02:38.435131 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:02:38.435131 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:02:38.435131 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:02:38.435131 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:02:38.435131 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:02:38.435131 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:02:38.435131 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:02:38.435131 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 23:02:38.435131 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 23:02:38.435131 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:02:38.435131 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:02:38.435131 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 10 23:02:38.435131 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 10 23:02:38.435131 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 8d006294-7bbe-4631-93c9-515e3239f0aa does not exist Aug 10 23:02:38.435131 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-890d7a94-6702-4683-a98c-fbc6f237664c'] Aug 10 23:02:38.435131 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:02:38.435131 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:02:38.435131 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:02:38.435131 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:02:38.439178 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:02:38.439178 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:02:38.439178 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:02:38.439178 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:02:38.439178 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 8d006294-7bbe-4631-93c9-515e3239f0aa does not exist Aug 10 23:02:38.439178 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-890d7a94-6702-4683-a98c-fbc6f237664c'] Aug 10 23:02:38.439178 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:02:38.439178 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-dfc631be-78a3-499e-98a0-f3a2a6e72ede tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Returning 404 to user: Security group 8d006294-7bbe-4631-93c9-515e3239f0aa does not exist Aug 10 23:02:38.439178 n-d-850468-14 devstack@n-api.service[122632]: Neutron server returns request_ids: ['req-890d7a94-6702-4683-a98c-fbc6f237664c'] {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:02:38.439178 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-dfc631be-78a3-499e-98a0-f3a2a6e72ede tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] 10.222.0.58 "GET /compute/v2.1/os-security-groups/8d006294-7bbe-4631-93c9-515e3239f0aa" status: 404 len: 194 microversion: 2.1 time: 0.059818 Aug 10 23:02:38.439178 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 794/1608] 10.222.0.58 () {58 vars in 1269 bytes} [Wed Aug 10 23:02:38 2022] GET /compute/v2.1/os-security-groups/8d006294-7bbe-4631-93c9-515e3239f0aa => generated 194 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:02:38.449138 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-a34752f5-b901-4f2d-9e72-1976d5d12f9a tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Calling method '.version_select at 0x7f847d390040>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:38.915598 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-a34752f5-b901-4f2d-9e72-1976d5d12f9a tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/96068930-bb08-4e25-8909-73ead6115edb" status: 202 len: 0 microversion: 2.1 time: 0.479674 Aug 10 23:02:38.916496 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 795/1609] 10.222.0.58 () {58 vars in 1272 bytes} [Wed Aug 10 23:02:38 2022] DELETE /compute/v2.1/os-security-groups/96068930-bb08-4e25-8909-73ead6115edb => generated 0 bytes in 481 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:02:38.924222 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-912ab6f8-f662-4176-bcd0-e5e424369941 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:38.925567 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-912ab6f8-f662-4176-bcd0-e5e424369941 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] [instance: 3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:02:38.997571 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-912ab6f8-f662-4176-bcd0-e5e424369941 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:39.001011 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-912ab6f8-f662-4176-bcd0-e5e424369941 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:39.005770 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-912ab6f8-f662-4176-bcd0-e5e424369941 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:39.007530 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-912ab6f8-f662-4176-bcd0-e5e424369941 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:39.014357 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-912ab6f8-f662-4176-bcd0-e5e424369941 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:39.015355 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-912ab6f8-f662-4176-bcd0-e5e424369941 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:39.053649 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-d96879ee-650f-4471-a7a6-ef4ab9ec6015 tempest-QuotaClassesAdminTestJSON-1043725095 tempest-QuotaClassesAdminTestJSON-1043725095-project-admin] Calling method '.version_select at 0x7f847d371550>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:39.056044 n-d-850468-14 devstack@n-api.service[122633]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 23:02:39.056044 n-d-850468-14 devstack@n-api.service[122633]: warnings.warn(msg) Aug 10 23:02:39.110310 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-d96879ee-650f-4471-a7a6-ef4ab9ec6015 tempest-QuotaClassesAdminTestJSON-1043725095 tempest-QuotaClassesAdminTestJSON-1043725095-project-admin] 10.222.0.58 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.806219 Aug 10 23:02:39.115944 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 815/1610] 10.222.0.58 () {58 vars in 1185 bytes} [Wed Aug 10 23:02:38 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:02:39.141713 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-4f962d65-6dc6-4e15-a851-930f01bf7aa1 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Calling method '.version_select at 0x7f847d3085e0>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:39.233798 n-d-850468-14 devstack@n-api.service[122633]: DEBUG neutronclient.v2_0.client [None req-4f962d65-6dc6-4e15-a851-930f01bf7aa1 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 96068930-bb08-4e25-8909-73ead6115edb does not exist", "detail": ""}} {{(pid=122633) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 10 23:02:39.234615 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.network.security_group_api [None req-4f962d65-6dc6-4e15-a851-930f01bf7aa1 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Neutron security group 96068930-bb08-4e25-8909-73ead6115edb not found {{(pid=122633) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 10 23:02:39.236127 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-4f962d65-6dc6-4e15-a851-930f01bf7aa1 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] HTTP exception thrown: Security group 96068930-bb08-4e25-8909-73ead6115edb does not exist Aug 10 23:02:39.236127 n-d-850468-14 devstack@n-api.service[122633]: Neutron server returns request_ids: ['req-bb573f25-3792-4f21-a21a-bf5379911546'] Aug 10 23:02:39.240460 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-4f962d65-6dc6-4e15-a851-930f01bf7aa1 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Request method failure captured: Aug 10 23:02:39.240460 n-d-850468-14 devstack@n-api.service[122633]: request: GET /compute/v2.1/os-security-groups/96068930-bb08-4e25-8909-73ead6115edb HTTP/1.1 Aug 10 23:02:39.240460 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:02:39.240460 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:02:39.240460 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:02:39.240460 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:02:39.240460 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:02:39.240460 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:02:39.240460 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:02:39.240460 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:02:39.240460 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9Dju6bcY6WgJPTWLWUJ0fX6JaJBRP8GkYZWFafNrDYn8ACaF-JC0t8YD4rSPFgG5Deze7mjmq2_rnPCZ1jpXNRGkHxz134mT5MqTqUm9UAyuVcbLtNQAiAf-L4A3117brPwKa_CN56-tZ47WT8aAPEON_2-WsEOp9qATqEToy30jo_s Aug 10 23:02:39.240460 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:02:39.240460 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:02:39.240460 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:02:39.240460 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:02:39.240460 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:02:39.240460 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:02:39.240460 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 707f869910b34768ae1a348cd0b5f284 Aug 10 23:02:39.240460 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-SecurityGroupsTestJSON-1406525704 Aug 10 23:02:39.240460 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:02:39.240460 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:02:39.243765 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/707f869910b34768ae1a348cd0b5f284"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/707f869910b34768ae1a348cd0b5f284"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/707f869910b34768ae1a348cd0b5f284"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_707f869910b34768ae1a348cd0b5f284", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:02:39.243765 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-SecurityGroupsTestJSON-1406525704 Aug 10 23:02:39.243765 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 707f869910b34768ae1a348cd0b5f284 Aug 10 23:02:39.243765 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1406525704 Aug 10 23:02:39.243765 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-SecurityGroupsTestJSON-1406525704-project Aug 10 23:02:39.243765 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:02:39.243765 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:02:39.243765 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: bfd6d8e6a8444f5b9fcf1cf8da242ac0 Aug 10 23:02:39.243765 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-SecurityGroupsTestJSON-1406525704-project Aug 10 23:02:39.243765 n-d-850468-14 devstack@n-api.service[122633]: method: Aug 10 23:02:39.243765 n-d-850468-14 devstack@n-api.service[122633]: exception: Security group 96068930-bb08-4e25-8909-73ead6115edb does not exist Aug 10 23:02:39.243765 n-d-850468-14 devstack@n-api.service[122633]: Neutron server returns request_ids: ['req-bb573f25-3792-4f21-a21a-bf5379911546'] Aug 10 23:02:39.243765 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': '96068930-bb08-4e25-8909-73ead6115edb'} Aug 10 23:02:39.247019 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:02:39.247019 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:02:39.247019 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 10 23:02:39.247019 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 10 23:02:39.247019 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 23:02:39.247019 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 23:02:39.247019 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 10 23:02:39.247019 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 10 23:02:39.247019 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 23:02:39.247019 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 23:02:39.247019 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 23:02:39.247019 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 23:02:39.247019 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 23:02:39.247019 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 23:02:39.247019 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 23:02:39.247019 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 23:02:39.247019 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 23:02:39.247019 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 23:02:39.247019 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 10 23:02:39.249754 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 10 23:02:39.249754 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 23:02:39.249754 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 23:02:39.249754 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 10 23:02:39.249754 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 10 23:02:39.249754 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 10 23:02:39.249754 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 10 23:02:39.249754 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 96068930-bb08-4e25-8909-73ead6115edb does not exist Aug 10 23:02:39.249754 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bb573f25-3792-4f21-a21a-bf5379911546'] Aug 10 23:02:39.249754 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:02:39.249754 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:02:39.249754 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:02:39.249754 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:02:39.249754 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 10 23:02:39.249754 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 10 23:02:39.249754 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 10 23:02:39.249754 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 10 23:02:39.249754 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 96068930-bb08-4e25-8909-73ead6115edb does not exist Aug 10 23:02:39.252279 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bb573f25-3792-4f21-a21a-bf5379911546'] Aug 10 23:02:39.252279 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:02:39.252279 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:02:39.252279 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:02:39.252279 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:02:39.252279 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:02:39.252279 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:02:39.252279 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:02:39.252279 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:02:39.252279 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 23:02:39.252279 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 23:02:39.252279 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:02:39.252279 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:02:39.252279 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 10 23:02:39.252279 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 10 23:02:39.252279 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 96068930-bb08-4e25-8909-73ead6115edb does not exist Aug 10 23:02:39.252279 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bb573f25-3792-4f21-a21a-bf5379911546'] Aug 10 23:02:39.252279 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:02:39.252279 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:02:39.252279 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:02:39.252279 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:02:39.264240 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:02:39.264240 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:02:39.264240 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:02:39.264240 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:02:39.264240 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 96068930-bb08-4e25-8909-73ead6115edb does not exist Aug 10 23:02:39.264240 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-bb573f25-3792-4f21-a21a-bf5379911546'] Aug 10 23:02:39.264240 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:02:39.264240 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-4f962d65-6dc6-4e15-a851-930f01bf7aa1 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Returning 404 to user: Security group 96068930-bb08-4e25-8909-73ead6115edb does not exist Aug 10 23:02:39.264240 n-d-850468-14 devstack@n-api.service[122633]: Neutron server returns request_ids: ['req-bb573f25-3792-4f21-a21a-bf5379911546'] {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:02:39.267526 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-4f962d65-6dc6-4e15-a851-930f01bf7aa1 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] 10.222.0.58 "GET /compute/v2.1/os-security-groups/96068930-bb08-4e25-8909-73ead6115edb" status: 404 len: 194 microversion: 2.1 time: 0.142538 Aug 10 23:02:39.268784 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 816/1611] 10.222.0.58 () {58 vars in 1269 bytes} [Wed Aug 10 23:02:39 2022] GET /compute/v2.1/os-security-groups/96068930-bb08-4e25-8909-73ead6115edb => generated 194 bytes in 152 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:02:39.280386 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-1f36bb58-bb89-43e8-b0d9-15d140c43796 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:39.281299 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-1f36bb58-bb89-43e8-b0d9-15d140c43796 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] [instance: 1fcd0cf8-e654-4e2a-bf05-d5d3c47bd200] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:02:39.293979 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1f36bb58-bb89-43e8-b0d9-15d140c43796 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:39.296008 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1f36bb58-bb89-43e8-b0d9-15d140c43796 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:39.296877 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1f36bb58-bb89-43e8-b0d9-15d140c43796 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:39.299854 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1f36bb58-bb89-43e8-b0d9-15d140c43796 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:39.302857 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1f36bb58-bb89-43e8-b0d9-15d140c43796 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:39.303489 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1f36bb58-bb89-43e8-b0d9-15d140c43796 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:39.413566 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-912ab6f8-f662-4176-bcd0-e5e424369941 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:02:39.431758 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-912ab6f8-f662-4176-bcd0-e5e424369941 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:02:39.434961 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-912ab6f8-f662-4176-bcd0-e5e424369941 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:02:39.441587 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-912ab6f8-f662-4176-bcd0-e5e424369941 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] 10.222.0.58 "GET /compute/v2.1/servers/3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51" status: 200 len: 1486 microversion: 2.25 time: 0.520829 Aug 10 23:02:39.443596 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 796/1612] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:02:38 2022] GET /compute/v2.1/servers/3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51 => generated 1486 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:02:39.457040 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-add41b62-e3ae-489a-b9e1-3e4cf83332eb tempest-QuotaClassesAdminTestJSON-1043725095 tempest-QuotaClassesAdminTestJSON-1043725095-project-admin] Action: 'update', calling method: .version_select at 0x7f847d387af0>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:02:39.465987 n-d-850468-14 devstack@n-api.service[122632]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 23:02:39.465987 n-d-850468-14 devstack@n-api.service[122632]: warnings.warn(msg) Aug 10 23:02:39.582710 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-1f36bb58-bb89-43e8-b0d9-15d140c43796 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '417d4eaaeb1c4df78745496ececb3e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27e6ee9495a438b8450a4ef0d62cbcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:02:39.599096 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-1f36bb58-bb89-43e8-b0d9-15d140c43796 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] 10.222.0.58 "GET /compute/v2.1/servers/1fcd0cf8-e654-4e2a-bf05-d5d3c47bd200" status: 200 len: 1317 microversion: 2.1 time: 0.324640 Aug 10 23:02:39.601488 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 817/1613] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:02:39 2022] GET /compute/v2.1/servers/1fcd0cf8-e654-4e2a-bf05-d5d3c47bd200 => generated 1317 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:02:39.613717 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c7d7c337-6b1a-48bd-922b-1ec17c984c82 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Calling method '.version_select at 0x7f847d31dc10>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:39.938889 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-add41b62-e3ae-489a-b9e1-3e4cf83332eb tempest-QuotaClassesAdminTestJSON-1043725095 tempest-QuotaClassesAdminTestJSON-1043725095-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 0.493919 Aug 10 23:02:39.948576 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 797/1614] 10.222.0.58 () {60 vars in 1206 bytes} [Wed Aug 10 23:02:39 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:02:39.965916 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-892181e7-71dc-430c-b13f-8af65962b15e req-fb47e3d4-f73f-416a-b89a-ef2767d535d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1fcd0cf8-e654-4e2a-bf05-d5d3c47bd200", "tag": "578f05e6-523e-4412-be47-9c7a2d430921"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:02:39.992672 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-892181e7-71dc-430c-b13f-8af65962b15e req-fb47e3d4-f73f-416a-b89a-ef2767d535d6 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:39.993178 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-892181e7-71dc-430c-b13f-8af65962b15e req-fb47e3d4-f73f-416a-b89a-ef2767d535d6 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:39.993707 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-892181e7-71dc-430c-b13f-8af65962b15e req-fb47e3d4-f73f-416a-b89a-ef2767d535d6 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:40.021626 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-892181e7-71dc-430c-b13f-8af65962b15e req-fb47e3d4-f73f-416a-b89a-ef2767d535d6 service nova] Creating event network-changed:578f05e6-523e-4412-be47-9c7a2d430921 for instance 1fcd0cf8-e654-4e2a-bf05-d5d3c47bd200 on n-h1-850468-14 Aug 10 23:02:40.028453 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-892181e7-71dc-430c-b13f-8af65962b15e req-fb47e3d4-f73f-416a-b89a-ef2767d535d6 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072054 Aug 10 23:02:40.029464 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 798/1615] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:02:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:02:40.035838 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-d4b7c6b5-0673-4253-bbea-fbfaaf219694 tempest-QuotaClassesAdminTestJSON-1043725095 tempest-QuotaClassesAdminTestJSON-1043725095-project-admin] Calling method '.version_select at 0x7f847d387a60>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:40.037106 n-d-850468-14 devstack@n-api.service[122632]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 23:02:40.037106 n-d-850468-14 devstack@n-api.service[122632]: warnings.warn(msg) Aug 10 23:02:40.054124 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-d4b7c6b5-0673-4253-bbea-fbfaaf219694 tempest-QuotaClassesAdminTestJSON-1043725095 tempest-QuotaClassesAdminTestJSON-1043725095-project-admin] 10.222.0.58 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.023164 Aug 10 23:02:40.057836 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 799/1616] 10.222.0.58 () {58 vars in 1185 bytes} [Wed Aug 10 23:02:40 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:02:40.074025 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-27f62c21-4159-4763-8e12-99af5ef664cf tempest-QuotaClassesAdminTestJSON-1043725095 tempest-QuotaClassesAdminTestJSON-1043725095-project-admin] Action: 'update', calling method: .version_select at 0x7f847d3875e0>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:02:40.081426 n-d-850468-14 devstack@n-api.service[122632]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 23:02:40.081426 n-d-850468-14 devstack@n-api.service[122632]: warnings.warn(msg) Aug 10 23:02:40.155657 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=17,nova_api:INSERT=7 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:02:40.299433 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-27f62c21-4159-4763-8e12-99af5ef664cf tempest-QuotaClassesAdminTestJSON-1043725095 tempest-QuotaClassesAdminTestJSON-1043725095-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.234805 Aug 10 23:02:40.301708 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 800/1617] 10.222.0.58 () {60 vars in 1206 bytes} [Wed Aug 10 23:02:40 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 23:02:40.483554 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-358fe82d-94fb-4f83-be36-110787226cbc tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:40.485935 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-358fe82d-94fb-4f83-be36-110787226cbc tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] [instance: 3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:02:40.504225 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-358fe82d-94fb-4f83-be36-110787226cbc tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:40.505699 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-358fe82d-94fb-4f83-be36-110787226cbc tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:40.507087 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-358fe82d-94fb-4f83-be36-110787226cbc tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:40.508317 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-358fe82d-94fb-4f83-be36-110787226cbc tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:40.509125 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-358fe82d-94fb-4f83-be36-110787226cbc tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:40.512996 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-358fe82d-94fb-4f83-be36-110787226cbc tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:40.580142 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-c7d7c337-6b1a-48bd-922b-1ec17c984c82 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/aba3b9a5-0e86-4933-9547-ecc7eeb675ce" status: 202 len: 0 microversion: 2.1 time: 0.976388 Aug 10 23:02:40.581422 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 818/1618] 10.222.0.58 () {58 vars in 1272 bytes} [Wed Aug 10 23:02:39 2022] DELETE /compute/v2.1/os-security-groups/aba3b9a5-0e86-4933-9547-ecc7eeb675ce => generated 0 bytes in 979 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:02:40.591659 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-bae0ff98-a99e-4831-964d-dc2edeb79560 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Calling method '.version_select at 0x7f847d3085e0>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:40.745652 n-d-850468-14 devstack@n-api.service[122633]: DEBUG neutronclient.v2_0.client [None req-bae0ff98-a99e-4831-964d-dc2edeb79560 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group aba3b9a5-0e86-4933-9547-ecc7eeb675ce does not exist", "detail": ""}} {{(pid=122633) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 10 23:02:40.746695 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.network.security_group_api [None req-bae0ff98-a99e-4831-964d-dc2edeb79560 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Neutron security group aba3b9a5-0e86-4933-9547-ecc7eeb675ce not found {{(pid=122633) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 10 23:02:40.748211 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-bae0ff98-a99e-4831-964d-dc2edeb79560 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] HTTP exception thrown: Security group aba3b9a5-0e86-4933-9547-ecc7eeb675ce does not exist Aug 10 23:02:40.748211 n-d-850468-14 devstack@n-api.service[122633]: Neutron server returns request_ids: ['req-805b1fef-b72d-466c-b736-008e10a3f8d3'] Aug 10 23:02:40.750548 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-bae0ff98-a99e-4831-964d-dc2edeb79560 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Request method failure captured: Aug 10 23:02:40.750548 n-d-850468-14 devstack@n-api.service[122633]: request: GET /compute/v2.1/os-security-groups/aba3b9a5-0e86-4933-9547-ecc7eeb675ce HTTP/1.1 Aug 10 23:02:40.750548 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:02:40.750548 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:02:40.750548 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:02:40.750548 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:02:40.750548 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:02:40.750548 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:02:40.750548 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:02:40.750548 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:02:40.750548 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9Dju6bcY6WgJPTWLWUJ0fX6JaJBRP8GkYZWFafNrDYn8ACaF-JC0t8YD4rSPFgG5Deze7mjmq2_rnPCZ1jpXNRGkHxz134mT5MqTqUm9UAyuVcbLtNQAiAf-L4A3117brPwKa_CN56-tZ47WT8aAPEON_2-WsEOp9qATqEToy30jo_s Aug 10 23:02:40.750548 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:02:40.750548 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:02:40.750548 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:02:40.750548 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:02:40.750548 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:02:40.750548 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:02:40.750548 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 707f869910b34768ae1a348cd0b5f284 Aug 10 23:02:40.750548 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-SecurityGroupsTestJSON-1406525704 Aug 10 23:02:40.750548 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:02:40.750548 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:02:40.752380 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/707f869910b34768ae1a348cd0b5f284"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/707f869910b34768ae1a348cd0b5f284"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/707f869910b34768ae1a348cd0b5f284"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_707f869910b34768ae1a348cd0b5f284", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:02:40.752380 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-SecurityGroupsTestJSON-1406525704 Aug 10 23:02:40.752380 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 707f869910b34768ae1a348cd0b5f284 Aug 10 23:02:40.752380 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1406525704 Aug 10 23:02:40.752380 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-SecurityGroupsTestJSON-1406525704-project Aug 10 23:02:40.752380 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:02:40.752380 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:02:40.752380 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: bfd6d8e6a8444f5b9fcf1cf8da242ac0 Aug 10 23:02:40.752380 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-SecurityGroupsTestJSON-1406525704-project Aug 10 23:02:40.752380 n-d-850468-14 devstack@n-api.service[122633]: method: Aug 10 23:02:40.752380 n-d-850468-14 devstack@n-api.service[122633]: exception: Security group aba3b9a5-0e86-4933-9547-ecc7eeb675ce does not exist Aug 10 23:02:40.752380 n-d-850468-14 devstack@n-api.service[122633]: Neutron server returns request_ids: ['req-805b1fef-b72d-466c-b736-008e10a3f8d3'] Aug 10 23:02:40.752380 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': 'aba3b9a5-0e86-4933-9547-ecc7eeb675ce'} Aug 10 23:02:40.753840 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:02:40.753840 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:02:40.753840 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 10 23:02:40.753840 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 10 23:02:40.753840 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 23:02:40.753840 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 23:02:40.753840 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 10 23:02:40.753840 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 10 23:02:40.753840 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 23:02:40.753840 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 23:02:40.753840 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 23:02:40.753840 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 23:02:40.753840 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 23:02:40.753840 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 23:02:40.753840 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 23:02:40.753840 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 23:02:40.753840 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 23:02:40.753840 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 23:02:40.753840 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 10 23:02:40.756085 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 10 23:02:40.756085 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 23:02:40.756085 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 23:02:40.756085 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 10 23:02:40.756085 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 10 23:02:40.756085 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 10 23:02:40.756085 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 10 23:02:40.756085 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group aba3b9a5-0e86-4933-9547-ecc7eeb675ce does not exist Aug 10 23:02:40.756085 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-805b1fef-b72d-466c-b736-008e10a3f8d3'] Aug 10 23:02:40.756085 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:02:40.756085 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:02:40.756085 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:02:40.756085 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:02:40.756085 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 10 23:02:40.756085 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 10 23:02:40.756085 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 10 23:02:40.756085 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 10 23:02:40.756085 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group aba3b9a5-0e86-4933-9547-ecc7eeb675ce does not exist Aug 10 23:02:40.757968 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-805b1fef-b72d-466c-b736-008e10a3f8d3'] Aug 10 23:02:40.757968 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:02:40.757968 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:02:40.757968 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:02:40.757968 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:02:40.757968 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:02:40.757968 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:02:40.757968 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:02:40.757968 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:02:40.757968 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 23:02:40.757968 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 23:02:40.757968 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:02:40.757968 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:02:40.757968 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 10 23:02:40.757968 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 10 23:02:40.757968 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group aba3b9a5-0e86-4933-9547-ecc7eeb675ce does not exist Aug 10 23:02:40.757968 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-805b1fef-b72d-466c-b736-008e10a3f8d3'] Aug 10 23:02:40.757968 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:02:40.757968 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:02:40.757968 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:02:40.757968 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:02:40.760738 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:02:40.760738 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:02:40.760738 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:02:40.760738 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:02:40.760738 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group aba3b9a5-0e86-4933-9547-ecc7eeb675ce does not exist Aug 10 23:02:40.760738 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-805b1fef-b72d-466c-b736-008e10a3f8d3'] Aug 10 23:02:40.760738 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:02:40.762814 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-bae0ff98-a99e-4831-964d-dc2edeb79560 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Returning 404 to user: Security group aba3b9a5-0e86-4933-9547-ecc7eeb675ce does not exist Aug 10 23:02:40.762814 n-d-850468-14 devstack@n-api.service[122633]: Neutron server returns request_ids: ['req-805b1fef-b72d-466c-b736-008e10a3f8d3'] {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:02:40.763980 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-bae0ff98-a99e-4831-964d-dc2edeb79560 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] 10.222.0.58 "GET /compute/v2.1/os-security-groups/aba3b9a5-0e86-4933-9547-ecc7eeb675ce" status: 404 len: 194 microversion: 2.1 time: 0.177629 Aug 10 23:02:40.764751 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 819/1619] 10.222.0.58 () {58 vars in 1269 bytes} [Wed Aug 10 23:02:40 2022] GET /compute/v2.1/os-security-groups/aba3b9a5-0e86-4933-9547-ecc7eeb675ce => generated 194 bytes in 179 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 10 23:02:40.785955 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-69f435fe-5dda-48b9-b138-19949109dbf9 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:40.789790 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-69f435fe-5dda-48b9-b138-19949109dbf9 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] [instance: 1fcd0cf8-e654-4e2a-bf05-d5d3c47bd200] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:02:40.813907 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-69f435fe-5dda-48b9-b138-19949109dbf9 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:40.817579 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-358fe82d-94fb-4f83-be36-110787226cbc tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:02:40.820598 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-69f435fe-5dda-48b9-b138-19949109dbf9 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:40.823513 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-69f435fe-5dda-48b9-b138-19949109dbf9 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:40.827946 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-69f435fe-5dda-48b9-b138-19949109dbf9 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:40.832648 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-358fe82d-94fb-4f83-be36-110787226cbc tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:02:40.836848 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-69f435fe-5dda-48b9-b138-19949109dbf9 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:40.838337 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-358fe82d-94fb-4f83-be36-110787226cbc tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:02:40.839103 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-69f435fe-5dda-48b9-b138-19949109dbf9 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:40.841187 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-358fe82d-94fb-4f83-be36-110787226cbc tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] 10.222.0.58 "GET /compute/v2.1/servers/3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51" status: 200 len: 1486 microversion: 2.25 time: 0.369000 Aug 10 23:02:40.843953 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 801/1620] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:02:40 2022] GET /compute/v2.1/servers/3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51 => generated 1486 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 23:02:40.858259 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-e0b1bb80-1ff9-4df2-8ade-52fe0fe6679c tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Calling method '.version_select at 0x7f847d1b3af0>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:41.549391 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-69f435fe-5dda-48b9-b138-19949109dbf9 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '417d4eaaeb1c4df78745496ececb3e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27e6ee9495a438b8450a4ef0d62cbcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:02:41.565616 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-69f435fe-5dda-48b9-b138-19949109dbf9 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] 10.222.0.58 "GET /compute/v2.1/servers/1fcd0cf8-e654-4e2a-bf05-d5d3c47bd200" status: 200 len: 1317 microversion: 2.1 time: 0.799267 Aug 10 23:02:41.567838 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 820/1621] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:02:40 2022] GET /compute/v2.1/servers/1fcd0cf8-e654-4e2a-bf05-d5d3c47bd200 => generated 1317 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:02:41.836816 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-e0b1bb80-1ff9-4df2-8ade-52fe0fe6679c tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] 10.222.0.58 "GET /compute/v2.1/os-security-groups" status: 200 len: 1158 microversion: 2.1 time: 0.991620 Aug 10 23:02:41.838389 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 802/1622] 10.222.0.58 () {58 vars in 1158 bytes} [Wed Aug 10 23:02:40 2022] GET /compute/v2.1/os-security-groups => generated 1158 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:02:41.861662 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-b5823b58-eca3-4439-a263-48d93a35616a tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Action: 'create', calling method: .version_select at 0x7f847d32d790>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1997372543", "description": "tempest-description-1460664917"}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:02:41.877831 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-94703da7-0c1b-479f-abd5-ad420b48e621 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:41.878450 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-94703da7-0c1b-479f-abd5-ad420b48e621 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] [instance: 3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:02:41.919281 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-94703da7-0c1b-479f-abd5-ad420b48e621 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:41.919811 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-94703da7-0c1b-479f-abd5-ad420b48e621 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:41.920266 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-94703da7-0c1b-479f-abd5-ad420b48e621 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:41.921000 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-94703da7-0c1b-479f-abd5-ad420b48e621 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:41.924678 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-94703da7-0c1b-479f-abd5-ad420b48e621 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:41.925165 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-94703da7-0c1b-479f-abd5-ad420b48e621 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:42.996523 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-94703da7-0c1b-479f-abd5-ad420b48e621 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:02:43.013505 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-94703da7-0c1b-479f-abd5-ad420b48e621 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:02:43.017104 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-94703da7-0c1b-479f-abd5-ad420b48e621 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:02:43.019572 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-94703da7-0c1b-479f-abd5-ad420b48e621 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] 10.222.0.58 "GET /compute/v2.1/servers/3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51" status: 200 len: 1486 microversion: 2.25 time: 1.151037 Aug 10 23:02:43.021526 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 803/1623] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:02:41 2022] GET /compute/v2.1/servers/3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51 => generated 1486 bytes in 1154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:02:43.035723 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-0a5cd98f-0bcd-4979-b92e-3b49fb126e9f tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:43.037997 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-0a5cd98f-0bcd-4979-b92e-3b49fb126e9f tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] [instance: 1fcd0cf8-e654-4e2a-bf05-d5d3c47bd200] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:02:43.053002 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0a5cd98f-0bcd-4979-b92e-3b49fb126e9f tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:43.055652 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0a5cd98f-0bcd-4979-b92e-3b49fb126e9f tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:43.059775 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0a5cd98f-0bcd-4979-b92e-3b49fb126e9f tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:43.061007 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0a5cd98f-0bcd-4979-b92e-3b49fb126e9f tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:43.061945 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0a5cd98f-0bcd-4979-b92e-3b49fb126e9f tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:43.062715 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0a5cd98f-0bcd-4979-b92e-3b49fb126e9f tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:43.659211 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-0a5cd98f-0bcd-4979-b92e-3b49fb126e9f tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '417d4eaaeb1c4df78745496ececb3e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27e6ee9495a438b8450a4ef0d62cbcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:02:43.675676 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-0a5cd98f-0bcd-4979-b92e-3b49fb126e9f tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] 10.222.0.58 "GET /compute/v2.1/servers/1fcd0cf8-e654-4e2a-bf05-d5d3c47bd200" status: 200 len: 1317 microversion: 2.1 time: 0.650892 Aug 10 23:02:43.689251 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 804/1624] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:02:43 2022] GET /compute/v2.1/servers/1fcd0cf8-e654-4e2a-bf05-d5d3c47bd200 => generated 1317 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:02:43.718137 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-c84a05cb-244d-430c-a839-7f4f043ec7d1 req-142a614a-25ef-477a-85b9-273ce8de883d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51", "name": "network-vif-unplugged", "status": "completed", "tag": "c83e0948-d394-45c1-aa16-31416d85184b"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:02:43.744327 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-c84a05cb-244d-430c-a839-7f4f043ec7d1 req-142a614a-25ef-477a-85b9-273ce8de883d service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:43.745210 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-c84a05cb-244d-430c-a839-7f4f043ec7d1 req-142a614a-25ef-477a-85b9-273ce8de883d service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:43.747856 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-c84a05cb-244d-430c-a839-7f4f043ec7d1 req-142a614a-25ef-477a-85b9-273ce8de883d service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:43.777974 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=100 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:02:43.784324 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-c84a05cb-244d-430c-a839-7f4f043ec7d1 req-142a614a-25ef-477a-85b9-273ce8de883d service nova] Creating event network-vif-unplugged:c83e0948-d394-45c1-aa16-31416d85184b for instance 3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51 on n-h1-850468-14 Aug 10 23:02:43.785882 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-b5823b58-eca3-4439-a263-48d93a35616a tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] 10.222.0.58 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 1.935513 Aug 10 23:02:43.786676 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 821/1625] 10.222.0.58 () {60 vars in 1180 bytes} [Wed Aug 10 23:02:41 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 1937 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:02:43.799282 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-c84a05cb-244d-430c-a839-7f4f043ec7d1 req-142a614a-25ef-477a-85b9-273ce8de883d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.086612 Aug 10 23:02:43.803129 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 805/1626] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:02:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:02:43.803290 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-db74e60d-f63d-42e8-86a6-d417dbdfd015 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Action: 'create', calling method: .version_select at 0x7f847d3c0280>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-427790589", "description": "tempest-description-141211405"}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:02:44.026542 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=2 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:02:44.051812 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c6884c44-598a-4022-9f81-e8c6984f2a11 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:44.052504 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-c6884c44-598a-4022-9f81-e8c6984f2a11 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] [instance: 3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:02:44.066850 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c6884c44-598a-4022-9f81-e8c6984f2a11 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:44.069140 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c6884c44-598a-4022-9f81-e8c6984f2a11 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:44.069651 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c6884c44-598a-4022-9f81-e8c6984f2a11 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:44.073081 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c6884c44-598a-4022-9f81-e8c6984f2a11 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:44.073656 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c6884c44-598a-4022-9f81-e8c6984f2a11 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:44.074178 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c6884c44-598a-4022-9f81-e8c6984f2a11 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:44.913104 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-c6884c44-598a-4022-9f81-e8c6984f2a11 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:02:44.923001 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-c6884c44-598a-4022-9f81-e8c6984f2a11 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:02:44.924641 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-c6884c44-598a-4022-9f81-e8c6984f2a11 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:02:44.925740 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-c6884c44-598a-4022-9f81-e8c6984f2a11 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] 10.222.0.58 "GET /compute/v2.1/servers/3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51" status: 200 len: 1486 microversion: 2.25 time: 0.879690 Aug 10 23:02:44.926237 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 806/1627] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:02:44 2022] GET /compute/v2.1/servers/3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51 => generated 1486 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 23:02:44.947442 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-de1b7767-80c1-45d7-9c89-1128e3776562 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:44.948020 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-de1b7767-80c1-45d7-9c89-1128e3776562 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] [instance: 1fcd0cf8-e654-4e2a-bf05-d5d3c47bd200] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:02:44.971810 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-de1b7767-80c1-45d7-9c89-1128e3776562 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:44.972315 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-de1b7767-80c1-45d7-9c89-1128e3776562 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:44.972787 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-de1b7767-80c1-45d7-9c89-1128e3776562 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:44.973551 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-de1b7767-80c1-45d7-9c89-1128e3776562 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:44.974039 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-de1b7767-80c1-45d7-9c89-1128e3776562 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:44.987606 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-de1b7767-80c1-45d7-9c89-1128e3776562 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:45.673431 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-db74e60d-f63d-42e8-86a6-d417dbdfd015 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] 10.222.0.58 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 1.874924 Aug 10 23:02:45.674644 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 822/1628] 10.222.0.58 () {60 vars in 1180 bytes} [Wed Aug 10 23:02:43 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 1877 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 23:02:45.772354 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-de1b7767-80c1-45d7-9c89-1128e3776562 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '417d4eaaeb1c4df78745496ececb3e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27e6ee9495a438b8450a4ef0d62cbcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:02:45.785571 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-de1b7767-80c1-45d7-9c89-1128e3776562 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] 10.222.0.58 "GET /compute/v2.1/servers/1fcd0cf8-e654-4e2a-bf05-d5d3c47bd200" status: 200 len: 1317 microversion: 2.1 time: 0.858269 Aug 10 23:02:45.801314 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 807/1629] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:02:44 2022] GET /compute/v2.1/servers/1fcd0cf8-e654-4e2a-bf05-d5d3c47bd200 => generated 1317 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:02:45.879099 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-b26bdcc3-5437-44e3-b5ce-f842fd356548 req-375b7a7b-436f-47ee-93a4-d517d6917533 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51", "tag": "c83e0948-d394-45c1-aa16-31416d85184b"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:02:45.898850 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-b26bdcc3-5437-44e3-b5ce-f842fd356548 req-375b7a7b-436f-47ee-93a4-d517d6917533 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:45.899801 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-b26bdcc3-5437-44e3-b5ce-f842fd356548 req-375b7a7b-436f-47ee-93a4-d517d6917533 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:45.901888 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-b26bdcc3-5437-44e3-b5ce-f842fd356548 req-375b7a7b-436f-47ee-93a4-d517d6917533 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:45.939747 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-b26bdcc3-5437-44e3-b5ce-f842fd356548 req-375b7a7b-436f-47ee-93a4-d517d6917533 service nova] Creating event network-changed:c83e0948-d394-45c1-aa16-31416d85184b for instance 3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51 on n-h1-850468-14 Aug 10 23:02:45.949811 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c6580952-2290-484a-9e3a-fdea2418b45f tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:45.950430 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-c6580952-2290-484a-9e3a-fdea2418b45f tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] [instance: 3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:02:45.959414 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-b26bdcc3-5437-44e3-b5ce-f842fd356548 req-375b7a7b-436f-47ee-93a4-d517d6917533 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081781 Aug 10 23:02:45.962695 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 823/1630] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:02:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:02:45.966327 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c6580952-2290-484a-9e3a-fdea2418b45f tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:45.967137 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c6580952-2290-484a-9e3a-fdea2418b45f tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:45.974604 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c6580952-2290-484a-9e3a-fdea2418b45f tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:45.975593 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c6580952-2290-484a-9e3a-fdea2418b45f tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:45.976268 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c6580952-2290-484a-9e3a-fdea2418b45f tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:45.976869 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c6580952-2290-484a-9e3a-fdea2418b45f tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:45.978657 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-24aec4d7-1b69-4c90-9aee-b350deff8c60 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-185961474", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452", "networks": [{"uuid": "bc6cdacf-50bb-4fff-92e1-1d2d0cfa843d"}]}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:02:46.062378 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.network.neutron [None req-24aec4d7-1b69-4c90-9aee-b350deff8c60 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] validate_networks() for [('bc6cdacf-50bb-4fff-92e1-1d2d0cfa843d', None, None, None, None, None)] {{(pid=122633) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 23:02:46.601279 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-c6580952-2290-484a-9e3a-fdea2418b45f tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:02:46.609954 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-c6580952-2290-484a-9e3a-fdea2418b45f tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:02:46.625942 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-c6580952-2290-484a-9e3a-fdea2418b45f tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:02:46.633310 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-c6580952-2290-484a-9e3a-fdea2418b45f tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] 10.222.0.58 "GET /compute/v2.1/servers/3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51" status: 200 len: 1486 microversion: 2.25 time: 0.688028 Aug 10 23:02:46.633899 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 808/1631] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:02:45 2022] GET /compute/v2.1/servers/3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51 => generated 1486 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 23:02:46.808578 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-340c5be5-8db1-45de-adea-0d182a9b7d07 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:46.809192 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-340c5be5-8db1-45de-adea-0d182a9b7d07 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] [instance: 1fcd0cf8-e654-4e2a-bf05-d5d3c47bd200] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:02:46.824702 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-340c5be5-8db1-45de-adea-0d182a9b7d07 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:46.825991 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-340c5be5-8db1-45de-adea-0d182a9b7d07 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:46.826702 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-340c5be5-8db1-45de-adea-0d182a9b7d07 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:46.827635 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-340c5be5-8db1-45de-adea-0d182a9b7d07 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:46.831602 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-340c5be5-8db1-45de-adea-0d182a9b7d07 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:46.832291 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-340c5be5-8db1-45de-adea-0d182a9b7d07 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:47.672041 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-340c5be5-8db1-45de-adea-0d182a9b7d07 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '417d4eaaeb1c4df78745496ececb3e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27e6ee9495a438b8450a4ef0d62cbcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:02:47.702747 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-340c5be5-8db1-45de-adea-0d182a9b7d07 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] 10.222.0.58 "GET /compute/v2.1/servers/1fcd0cf8-e654-4e2a-bf05-d5d3c47bd200" status: 200 len: 1317 microversion: 2.1 time: 0.896780 Aug 10 23:02:47.731163 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 809/1632] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:02:46 2022] GET /compute/v2.1/servers/1fcd0cf8-e654-4e2a-bf05-d5d3c47bd200 => generated 1317 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:02:47.736366 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-02d8c649-438e-47d4-9a2d-27bfe6bfcf34 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:47.771030 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-02d8c649-438e-47d4-9a2d-27bfe6bfcf34 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] [instance: 3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:02:47.796341 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-02d8c649-438e-47d4-9a2d-27bfe6bfcf34 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:47.803518 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-02d8c649-438e-47d4-9a2d-27bfe6bfcf34 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:47.804195 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-02d8c649-438e-47d4-9a2d-27bfe6bfcf34 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:47.806727 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-02d8c649-438e-47d4-9a2d-27bfe6bfcf34 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:47.809537 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-02d8c649-438e-47d4-9a2d-27bfe6bfcf34 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:47.815115 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-02d8c649-438e-47d4-9a2d-27bfe6bfcf34 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:48.230927 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-24aec4d7-1b69-4c90-9aee-b350deff8c60 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Flavor limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:02:48.231399 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-24aec4d7-1b69-4c90-9aee-b350deff8c60 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Image limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:02:48.231825 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-24aec4d7-1b69-4c90-9aee-b350deff8c60 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Flavor pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:02:48.232239 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-24aec4d7-1b69-4c90-9aee-b350deff8c60 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Image pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:02:48.232657 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-24aec4d7-1b69-4c90-9aee-b350deff8c60 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:02:48.255070 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-24aec4d7-1b69-4c90-9aee-b350deff8c60 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:48.256806 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-24aec4d7-1b69-4c90-9aee-b350deff8c60 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:48.257256 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-24aec4d7-1b69-4c90-9aee-b350deff8c60 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:48.259031 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-24aec4d7-1b69-4c90-9aee-b350deff8c60 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:48.259775 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-24aec4d7-1b69-4c90-9aee-b350deff8c60 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:48.262878 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-24aec4d7-1b69-4c90-9aee-b350deff8c60 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:48.298102 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-24aec4d7-1b69-4c90-9aee-b350deff8c60 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Getting quotas for project 707f869910b34768ae1a348cd0b5f284. Resources: {'instances', 'cores', 'ram'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:02:48.306892 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-24aec4d7-1b69-4c90-9aee-b350deff8c60 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Getting quotas for user bfd6d8e6a8444f5b9fcf1cf8da242ac0 and project 707f869910b34768ae1a348cd0b5f284. Resources: {'instances', 'cores', 'ram'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:02:48.326039 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-24aec4d7-1b69-4c90-9aee-b350deff8c60 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Going to run 1 instances... {{(pid=122633) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 23:02:48.329203 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-24aec4d7-1b69-4c90-9aee-b350deff8c60 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] [instance: 67accb8d-3e90-483c-a1e5-9a0c04a685c8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78ad8905-f66f-4733-8be9-2b260f1fabed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122633) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 23:02:48.407521 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-24aec4d7-1b69-4c90-9aee-b350deff8c60 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.435986 Aug 10 23:02:48.410862 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 824/1633] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 23:02:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 2441 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 23:02:48.423991 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-8fc4e17e-aa3d-467b-8bb3-d6ed150a0576 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:48.425319 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-8fc4e17e-aa3d-467b-8bb3-d6ed150a0576 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] [instance: 67accb8d-3e90-483c-a1e5-9a0c04a685c8] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:02:48.655064 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-8fc4e17e-aa3d-467b-8bb3-d6ed150a0576 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfd6d8e6a8444f5b9fcf1cf8da242ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707f869910b34768ae1a348cd0b5f284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:02:48.662224 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-8fc4e17e-aa3d-467b-8bb3-d6ed150a0576 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] 10.222.0.58 "GET /compute/v2.1/servers/67accb8d-3e90-483c-a1e5-9a0c04a685c8" status: 200 len: 1215 microversion: 2.1 time: 0.245056 Aug 10 23:02:48.679236 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 825/1634] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:02:48 2022] GET /compute/v2.1/servers/67accb8d-3e90-483c-a1e5-9a0c04a685c8 => generated 1215 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:02:48.733837 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-293495c0-e100-4e59-a44c-e1710125884f tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:48.734459 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-293495c0-e100-4e59-a44c-e1710125884f tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] [instance: 1fcd0cf8-e654-4e2a-bf05-d5d3c47bd200] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:02:48.745496 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-293495c0-e100-4e59-a44c-e1710125884f tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:48.746010 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-293495c0-e100-4e59-a44c-e1710125884f tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:48.746456 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-293495c0-e100-4e59-a44c-e1710125884f tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:48.747212 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-293495c0-e100-4e59-a44c-e1710125884f tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:48.747782 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-293495c0-e100-4e59-a44c-e1710125884f tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:48.748085 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-293495c0-e100-4e59-a44c-e1710125884f tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:49.468454 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-293495c0-e100-4e59-a44c-e1710125884f tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '417d4eaaeb1c4df78745496ececb3e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27e6ee9495a438b8450a4ef0d62cbcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:02:49.487750 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-293495c0-e100-4e59-a44c-e1710125884f tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] 10.222.0.58 "GET /compute/v2.1/servers/1fcd0cf8-e654-4e2a-bf05-d5d3c47bd200" status: 200 len: 1317 microversion: 2.1 time: 0.756220 Aug 10 23:02:49.489012 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 826/1635] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:02:48 2022] GET /compute/v2.1/servers/1fcd0cf8-e654-4e2a-bf05-d5d3c47bd200 => generated 1317 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:02:49.501011 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-02d8c649-438e-47d4-9a2d-27bfe6bfcf34 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:02:49.530097 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-02d8c649-438e-47d4-9a2d-27bfe6bfcf34 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:02:49.542687 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-02d8c649-438e-47d4-9a2d-27bfe6bfcf34 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:02:49.548518 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-02d8c649-438e-47d4-9a2d-27bfe6bfcf34 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] 10.222.0.58 "GET /compute/v2.1/servers/3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51" status: 200 len: 1486 microversion: 2.25 time: 1.816096 Aug 10 23:02:49.550588 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 810/1636] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:02:47 2022] GET /compute/v2.1/servers/3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51 => generated 1486 bytes in 1819 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:02:49.686807 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-adcc4917-a565-416e-88a4-d77d381e0e3e tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:49.688612 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-adcc4917-a565-416e-88a4-d77d381e0e3e tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] [instance: 67accb8d-3e90-483c-a1e5-9a0c04a685c8] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:02:49.721853 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-adcc4917-a565-416e-88a4-d77d381e0e3e tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:49.722370 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-adcc4917-a565-416e-88a4-d77d381e0e3e tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:49.722839 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-adcc4917-a565-416e-88a4-d77d381e0e3e tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:49.731545 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-adcc4917-a565-416e-88a4-d77d381e0e3e tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:49.732128 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-adcc4917-a565-416e-88a4-d77d381e0e3e tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:49.732572 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-adcc4917-a565-416e-88a4-d77d381e0e3e tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:49.900029 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-adcc4917-a565-416e-88a4-d77d381e0e3e tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfd6d8e6a8444f5b9fcf1cf8da242ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707f869910b34768ae1a348cd0b5f284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:02:49.920995 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-adcc4917-a565-416e-88a4-d77d381e0e3e tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] 10.222.0.58 "GET /compute/v2.1/servers/67accb8d-3e90-483c-a1e5-9a0c04a685c8" status: 200 len: 1211 microversion: 2.1 time: 0.233725 Aug 10 23:02:49.921745 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 827/1637] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:02:49 2022] GET /compute/v2.1/servers/67accb8d-3e90-483c-a1e5-9a0c04a685c8 => generated 1211 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:02:50.086108 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-df477c39-9468-4771-9d14-f3a0cae9eee0 tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-372080838", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:02:50.229628 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.network.neutron [None req-df477c39-9468-4771-9d14-f3a0cae9eee0 tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] validate_networks() for None {{(pid=122632) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 23:02:50.288157 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=27,nova_cell0:UPDATE=7 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:02:50.522880 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-92651457-3c62-4474-bee1-143e9f648f28 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:50.524377 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-92651457-3c62-4474-bee1-143e9f648f28 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] [instance: 1fcd0cf8-e654-4e2a-bf05-d5d3c47bd200] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:02:50.550805 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-92651457-3c62-4474-bee1-143e9f648f28 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:50.564188 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-92651457-3c62-4474-bee1-143e9f648f28 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:50.564600 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-92651457-3c62-4474-bee1-143e9f648f28 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:50.565398 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-92651457-3c62-4474-bee1-143e9f648f28 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:50.565884 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-92651457-3c62-4474-bee1-143e9f648f28 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:50.566368 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-92651457-3c62-4474-bee1-143e9f648f28 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:50.850949 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-92651457-3c62-4474-bee1-143e9f648f28 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '417d4eaaeb1c4df78745496ececb3e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27e6ee9495a438b8450a4ef0d62cbcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:02:50.859849 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-92651457-3c62-4474-bee1-143e9f648f28 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] 10.222.0.58 "GET /compute/v2.1/servers/1fcd0cf8-e654-4e2a-bf05-d5d3c47bd200" status: 200 len: 1317 microversion: 2.1 time: 0.347146 Aug 10 23:02:50.865005 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 828/1638] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:02:50 2022] GET /compute/v2.1/servers/1fcd0cf8-e654-4e2a-bf05-d5d3c47bd200 => generated 1317 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:02:50.883531 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-ba092ce7-1aad-4f66-844a-db460d445c72 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:50.884855 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-ba092ce7-1aad-4f66-844a-db460d445c72 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] [instance: 3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:02:50.905586 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ba092ce7-1aad-4f66-844a-db460d445c72 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:50.906399 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ba092ce7-1aad-4f66-844a-db460d445c72 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:50.907076 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ba092ce7-1aad-4f66-844a-db460d445c72 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:50.907985 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ba092ce7-1aad-4f66-844a-db460d445c72 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:50.908603 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ba092ce7-1aad-4f66-844a-db460d445c72 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:50.909196 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ba092ce7-1aad-4f66-844a-db460d445c72 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:51.330772 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-ba092ce7-1aad-4f66-844a-db460d445c72 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:02:51.343133 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-ba092ce7-1aad-4f66-844a-db460d445c72 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:02:51.349686 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-ba092ce7-1aad-4f66-844a-db460d445c72 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:02:51.355624 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-ba092ce7-1aad-4f66-844a-db460d445c72 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] 10.222.0.58 "GET /compute/v2.1/servers/3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51" status: 200 len: 1486 microversion: 2.25 time: 0.483323 Aug 10 23:02:51.356754 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 829/1639] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:02:50 2022] GET /compute/v2.1/servers/3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51 => generated 1486 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:02:51.366496 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-4130a671-a9a3-4293-ba2b-cf53157546bf tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:51.367416 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-4130a671-a9a3-4293-ba2b-cf53157546bf tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] [instance: 67accb8d-3e90-483c-a1e5-9a0c04a685c8] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:02:51.371022 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:02:51.387633 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4130a671-a9a3-4293-ba2b-cf53157546bf tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:51.392744 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4130a671-a9a3-4293-ba2b-cf53157546bf tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:51.395322 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4130a671-a9a3-4293-ba2b-cf53157546bf tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:51.396627 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4130a671-a9a3-4293-ba2b-cf53157546bf tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:51.400495 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4130a671-a9a3-4293-ba2b-cf53157546bf tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:51.402313 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4130a671-a9a3-4293-ba2b-cf53157546bf tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:51.689746 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-4130a671-a9a3-4293-ba2b-cf53157546bf tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfd6d8e6a8444f5b9fcf1cf8da242ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707f869910b34768ae1a348cd0b5f284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:02:51.699065 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-4130a671-a9a3-4293-ba2b-cf53157546bf tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] 10.222.0.58 "GET /compute/v2.1/servers/67accb8d-3e90-483c-a1e5-9a0c04a685c8" status: 200 len: 1273 microversion: 2.1 time: 0.340991 Aug 10 23:02:51.722273 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 830/1640] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:02:51 2022] GET /compute/v2.1/servers/67accb8d-3e90-483c-a1e5-9a0c04a685c8 => generated 1273 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:02:51.890555 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-edf899a1-7b71-450c-a67e-0df48de65a77 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:51.891576 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-edf899a1-7b71-450c-a67e-0df48de65a77 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] [instance: 1fcd0cf8-e654-4e2a-bf05-d5d3c47bd200] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:02:51.901906 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-edf899a1-7b71-450c-a67e-0df48de65a77 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:51.902626 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-edf899a1-7b71-450c-a67e-0df48de65a77 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:51.905368 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-edf899a1-7b71-450c-a67e-0df48de65a77 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:51.906315 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-edf899a1-7b71-450c-a67e-0df48de65a77 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:51.908924 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-edf899a1-7b71-450c-a67e-0df48de65a77 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:51.909557 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-edf899a1-7b71-450c-a67e-0df48de65a77 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:52.231198 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-df477c39-9468-4771-9d14-f3a0cae9eee0 tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] Flavor limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:02:52.231773 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-df477c39-9468-4771-9d14-f3a0cae9eee0 tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] Image limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:02:52.232079 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-df477c39-9468-4771-9d14-f3a0cae9eee0 tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] Flavor pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:02:52.232485 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-df477c39-9468-4771-9d14-f3a0cae9eee0 tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] Image pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:02:52.232896 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-df477c39-9468-4771-9d14-f3a0cae9eee0 tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:02:52.304637 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-df477c39-9468-4771-9d14-f3a0cae9eee0 tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:52.306824 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-edf899a1-7b71-450c-a67e-0df48de65a77 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '417d4eaaeb1c4df78745496ececb3e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27e6ee9495a438b8450a4ef0d62cbcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:02:52.308174 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-df477c39-9468-4771-9d14-f3a0cae9eee0 tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:52.309321 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-df477c39-9468-4771-9d14-f3a0cae9eee0 tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:52.311814 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-df477c39-9468-4771-9d14-f3a0cae9eee0 tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:52.313465 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-df477c39-9468-4771-9d14-f3a0cae9eee0 tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:52.314947 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-df477c39-9468-4771-9d14-f3a0cae9eee0 tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:52.328870 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=100 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:02:52.334460 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-edf899a1-7b71-450c-a67e-0df48de65a77 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] 10.222.0.58 "GET /compute/v2.1/servers/1fcd0cf8-e654-4e2a-bf05-d5d3c47bd200" status: 200 len: 1317 microversion: 2.1 time: 0.447263 Aug 10 23:02:52.341873 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 831/1641] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:02:51 2022] GET /compute/v2.1/servers/1fcd0cf8-e654-4e2a-bf05-d5d3c47bd200 => generated 1317 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:02:52.378567 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-df477c39-9468-4771-9d14-f3a0cae9eee0 tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] Getting quotas for project 7f0030d3c62f48e6acd142058158e11e. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:02:52.385923 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-7bcf5bfb-1e2f-4d8f-9693-d93981089987 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:52.386855 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-7bcf5bfb-1e2f-4d8f-9693-d93981089987 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] [instance: 3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:02:52.397288 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-df477c39-9468-4771-9d14-f3a0cae9eee0 tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] Getting quotas for user 4be22a1243524178bdfea6892f27b255 and project 7f0030d3c62f48e6acd142058158e11e. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:02:52.405185 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7bcf5bfb-1e2f-4d8f-9693-d93981089987 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:52.406882 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7bcf5bfb-1e2f-4d8f-9693-d93981089987 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:52.409677 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7bcf5bfb-1e2f-4d8f-9693-d93981089987 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:52.413458 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7bcf5bfb-1e2f-4d8f-9693-d93981089987 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:52.420074 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7bcf5bfb-1e2f-4d8f-9693-d93981089987 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:52.421662 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7bcf5bfb-1e2f-4d8f-9693-d93981089987 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:52.439352 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-df477c39-9468-4771-9d14-f3a0cae9eee0 tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] Going to run 1 instances... {{(pid=122632) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 23:02:52.449281 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-df477c39-9468-4771-9d14-f3a0cae9eee0 tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] [instance: 8fa0b7c8-ae4b-413c-9592-f4944cfb22fc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78ad8905-f66f-4733-8be9-2b260f1fabed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122632) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 23:02:52.612560 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-df477c39-9468-4771-9d14-f3a0cae9eee0 tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.762021 Aug 10 23:02:52.668701 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 811/1642] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 23:02:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 2818 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 23:02:52.694663 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-711aeb94-8929-4f9b-93ca-d50221b475ce req-123e27bd-545c-47a9-8ca2-689d36516549 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fcd0cf8-e654-4e2a-bf05-d5d3c47bd200", "name": "network-vif-plugged", "status": "completed", "tag": "578f05e6-523e-4412-be47-9c7a2d430921"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:02:52.717653 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-711aeb94-8929-4f9b-93ca-d50221b475ce req-123e27bd-545c-47a9-8ca2-689d36516549 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:52.718755 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-711aeb94-8929-4f9b-93ca-d50221b475ce req-123e27bd-545c-47a9-8ca2-689d36516549 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:52.719498 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-711aeb94-8929-4f9b-93ca-d50221b475ce req-123e27bd-545c-47a9-8ca2-689d36516549 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:52.744687 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-711aeb94-8929-4f9b-93ca-d50221b475ce req-123e27bd-545c-47a9-8ca2-689d36516549 service nova] Creating event network-vif-plugged:578f05e6-523e-4412-be47-9c7a2d430921 for instance 1fcd0cf8-e654-4e2a-bf05-d5d3c47bd200 on n-h1-850468-14 Aug 10 23:02:52.755577 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-711aeb94-8929-4f9b-93ca-d50221b475ce req-123e27bd-545c-47a9-8ca2-689d36516549 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081831 Aug 10 23:02:52.756912 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 812/1643] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:02:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:02:52.817693 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-d3f24521-5c35-43c4-8aed-70e9da743bd8 tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:52.825403 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-d3f24521-5c35-43c4-8aed-70e9da743bd8 tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] [instance: 8fa0b7c8-ae4b-413c-9592-f4944cfb22fc] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:02:53.152425 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-d3f24521-5c35-43c4-8aed-70e9da743bd8 tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be22a1243524178bdfea6892f27b255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f0030d3c62f48e6acd142058158e11e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:02:53.161171 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-d3f24521-5c35-43c4-8aed-70e9da743bd8 tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] 10.222.0.58 "GET /compute/v2.1/servers/8fa0b7c8-ae4b-413c-9592-f4944cfb22fc" status: 200 len: 1222 microversion: 2.1 time: 0.400010 Aug 10 23:02:53.165690 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 813/1644] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:02:52 2022] GET /compute/v2.1/servers/8fa0b7c8-ae4b-413c-9592-f4944cfb22fc => generated 1222 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:02:53.170744 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-d6b0cbf6-233d-479a-82be-b1f00ea328bf tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:53.174140 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-d6b0cbf6-233d-479a-82be-b1f00ea328bf tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] [instance: 67accb8d-3e90-483c-a1e5-9a0c04a685c8] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:02:53.197960 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d6b0cbf6-233d-479a-82be-b1f00ea328bf tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:53.198684 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d6b0cbf6-233d-479a-82be-b1f00ea328bf tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:53.199159 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d6b0cbf6-233d-479a-82be-b1f00ea328bf tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:53.199903 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d6b0cbf6-233d-479a-82be-b1f00ea328bf tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:53.200358 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d6b0cbf6-233d-479a-82be-b1f00ea328bf tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:53.200790 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d6b0cbf6-233d-479a-82be-b1f00ea328bf tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:53.495081 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-7bcf5bfb-1e2f-4d8f-9693-d93981089987 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:02:53.537495 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-7bcf5bfb-1e2f-4d8f-9693-d93981089987 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:02:53.562775 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-7bcf5bfb-1e2f-4d8f-9693-d93981089987 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:02:53.566655 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-7bcf5bfb-1e2f-4d8f-9693-d93981089987 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] 10.222.0.58 "GET /compute/v2.1/servers/3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51" status: 200 len: 1486 microversion: 2.25 time: 1.187342 Aug 10 23:02:53.568159 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 832/1645] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:02:52 2022] GET /compute/v2.1/servers/3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51 => generated 1486 bytes in 1190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 23:02:53.578865 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c9adef19-8495-4ffb-a5f4-68420f54330e tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:53.580416 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-c9adef19-8495-4ffb-a5f4-68420f54330e tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] [instance: 1fcd0cf8-e654-4e2a-bf05-d5d3c47bd200] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:02:53.616653 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c9adef19-8495-4ffb-a5f4-68420f54330e tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:53.619973 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c9adef19-8495-4ffb-a5f4-68420f54330e tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:53.620699 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c9adef19-8495-4ffb-a5f4-68420f54330e tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:53.622139 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c9adef19-8495-4ffb-a5f4-68420f54330e tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:53.623199 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c9adef19-8495-4ffb-a5f4-68420f54330e tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:53.624592 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c9adef19-8495-4ffb-a5f4-68420f54330e tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:53.940068 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-d6b0cbf6-233d-479a-82be-b1f00ea328bf tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfd6d8e6a8444f5b9fcf1cf8da242ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707f869910b34768ae1a348cd0b5f284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:02:53.957146 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-d6b0cbf6-233d-479a-82be-b1f00ea328bf tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] 10.222.0.58 "GET /compute/v2.1/servers/67accb8d-3e90-483c-a1e5-9a0c04a685c8" status: 200 len: 1273 microversion: 2.1 time: 0.790287 Aug 10 23:02:53.964430 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 814/1646] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:02:53 2022] GET /compute/v2.1/servers/67accb8d-3e90-483c-a1e5-9a0c04a685c8 => generated 1273 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:02:54.187166 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-d8bcfd2d-8d80-44a9-bd89-e7263390b0a4 tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:54.187993 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-d8bcfd2d-8d80-44a9-bd89-e7263390b0a4 tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] [instance: 8fa0b7c8-ae4b-413c-9592-f4944cfb22fc] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:02:54.197394 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-c9adef19-8495-4ffb-a5f4-68420f54330e tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '417d4eaaeb1c4df78745496ececb3e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27e6ee9495a438b8450a4ef0d62cbcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:02:54.202905 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d8bcfd2d-8d80-44a9-bd89-e7263390b0a4 tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:54.203413 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d8bcfd2d-8d80-44a9-bd89-e7263390b0a4 tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:54.203861 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d8bcfd2d-8d80-44a9-bd89-e7263390b0a4 tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:54.204734 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d8bcfd2d-8d80-44a9-bd89-e7263390b0a4 tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:54.205247 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d8bcfd2d-8d80-44a9-bd89-e7263390b0a4 tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:54.205624 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d8bcfd2d-8d80-44a9-bd89-e7263390b0a4 tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:54.231791 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-c9adef19-8495-4ffb-a5f4-68420f54330e tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] 10.222.0.58 "GET /compute/v2.1/servers/1fcd0cf8-e654-4e2a-bf05-d5d3c47bd200" status: 200 len: 1317 microversion: 2.1 time: 0.660186 Aug 10 23:02:54.234734 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 833/1647] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:02:53 2022] GET /compute/v2.1/servers/1fcd0cf8-e654-4e2a-bf05-d5d3c47bd200 => generated 1317 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:02:54.539675 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-d8bcfd2d-8d80-44a9-bd89-e7263390b0a4 tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be22a1243524178bdfea6892f27b255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f0030d3c62f48e6acd142058158e11e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:02:54.568385 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-d8bcfd2d-8d80-44a9-bd89-e7263390b0a4 tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] 10.222.0.58 "GET /compute/v2.1/servers/8fa0b7c8-ae4b-413c-9592-f4944cfb22fc" status: 200 len: 1218 microversion: 2.1 time: 0.377530 Aug 10 23:02:54.577849 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 815/1648] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:02:54 2022] GET /compute/v2.1/servers/8fa0b7c8-ae4b-413c-9592-f4944cfb22fc => generated 1218 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:02:54.605589 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-36249a56-b56b-4884-97ff-2f82fbaf1714 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:54.607466 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-36249a56-b56b-4884-97ff-2f82fbaf1714 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] [instance: 3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:02:54.632093 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-36249a56-b56b-4884-97ff-2f82fbaf1714 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:54.632609 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-36249a56-b56b-4884-97ff-2f82fbaf1714 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:54.635302 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-36249a56-b56b-4884-97ff-2f82fbaf1714 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:54.637500 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-36249a56-b56b-4884-97ff-2f82fbaf1714 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:54.639794 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-36249a56-b56b-4884-97ff-2f82fbaf1714 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:54.646419 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-36249a56-b56b-4884-97ff-2f82fbaf1714 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:54.989182 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-3d7512fb-82e9-4a28-bf02-a93b85d2afed tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:54.990893 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-3d7512fb-82e9-4a28-bf02-a93b85d2afed tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] [instance: 67accb8d-3e90-483c-a1e5-9a0c04a685c8] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:02:55.011802 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-36249a56-b56b-4884-97ff-2f82fbaf1714 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:02:55.014345 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3d7512fb-82e9-4a28-bf02-a93b85d2afed tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:55.016213 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3d7512fb-82e9-4a28-bf02-a93b85d2afed tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:55.018260 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3d7512fb-82e9-4a28-bf02-a93b85d2afed tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:55.020687 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3d7512fb-82e9-4a28-bf02-a93b85d2afed tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:55.022070 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3d7512fb-82e9-4a28-bf02-a93b85d2afed tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:55.023263 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3d7512fb-82e9-4a28-bf02-a93b85d2afed tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:55.028569 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-36249a56-b56b-4884-97ff-2f82fbaf1714 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:02:55.034414 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-36249a56-b56b-4884-97ff-2f82fbaf1714 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:02:55.037001 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-36249a56-b56b-4884-97ff-2f82fbaf1714 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] 10.222.0.58 "GET /compute/v2.1/servers/3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51" status: 200 len: 1486 microversion: 2.25 time: 0.443703 Aug 10 23:02:55.057694 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 834/1649] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:02:54 2022] GET /compute/v2.1/servers/3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51 => generated 1486 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:02:55.170951 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-acfbbc7c-0263-49b1-995a-a7adbc6cbf1e tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1182673537", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "cf6262ce-5add-4f6f-96db-0c1b276bc5f7"}], "block_device_mapping_v2": [{"uuid": "a3cbaee6-f354-4b7f-b529-25082b696458", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:02:55.292685 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.network.neutron [None req-acfbbc7c-0263-49b1-995a-a7adbc6cbf1e tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] validate_networks() for [('cf6262ce-5add-4f6f-96db-0c1b276bc5f7', None, None, None, None, None)] {{(pid=122633) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 23:02:55.392175 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-3d7512fb-82e9-4a28-bf02-a93b85d2afed tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfd6d8e6a8444f5b9fcf1cf8da242ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707f869910b34768ae1a348cd0b5f284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:02:55.409434 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-3d7512fb-82e9-4a28-bf02-a93b85d2afed tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] 10.222.0.58 "GET /compute/v2.1/servers/67accb8d-3e90-483c-a1e5-9a0c04a685c8" status: 200 len: 1273 microversion: 2.1 time: 0.426383 Aug 10 23:02:55.410584 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 816/1650] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:02:54 2022] GET /compute/v2.1/servers/67accb8d-3e90-483c-a1e5-9a0c04a685c8 => generated 1273 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:02:55.424209 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-57ef6fad-d9fa-4ee6-9d27-d147f235cfa8 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:55.426443 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-57ef6fad-d9fa-4ee6-9d27-d147f235cfa8 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] [instance: 1fcd0cf8-e654-4e2a-bf05-d5d3c47bd200] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:02:55.449718 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-57ef6fad-d9fa-4ee6-9d27-d147f235cfa8 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:55.450519 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-57ef6fad-d9fa-4ee6-9d27-d147f235cfa8 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:55.451133 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-57ef6fad-d9fa-4ee6-9d27-d147f235cfa8 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:55.452048 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-57ef6fad-d9fa-4ee6-9d27-d147f235cfa8 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:55.452698 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-57ef6fad-d9fa-4ee6-9d27-d147f235cfa8 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:55.453620 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-57ef6fad-d9fa-4ee6-9d27-d147f235cfa8 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:55.952288 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-acfbbc7c-0263-49b1-995a-a7adbc6cbf1e tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Flavor limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:02:55.952736 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-acfbbc7c-0263-49b1-995a-a7adbc6cbf1e tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Image limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:02:55.953172 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-acfbbc7c-0263-49b1-995a-a7adbc6cbf1e tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Flavor pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:02:55.953579 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-acfbbc7c-0263-49b1-995a-a7adbc6cbf1e tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Image pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:02:55.954144 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-acfbbc7c-0263-49b1-995a-a7adbc6cbf1e tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:02:55.974921 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-acfbbc7c-0263-49b1-995a-a7adbc6cbf1e tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:55.975415 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-acfbbc7c-0263-49b1-995a-a7adbc6cbf1e tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:55.975853 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-acfbbc7c-0263-49b1-995a-a7adbc6cbf1e tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:55.976581 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-acfbbc7c-0263-49b1-995a-a7adbc6cbf1e tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:55.977040 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-acfbbc7c-0263-49b1-995a-a7adbc6cbf1e tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:55.978002 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-acfbbc7c-0263-49b1-995a-a7adbc6cbf1e tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:56.007655 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-acfbbc7c-0263-49b1-995a-a7adbc6cbf1e tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Getting quotas for project 56ed0bdee3aa4013bd9219069bda558c. Resources: {'instances', 'cores', 'ram'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:02:56.013442 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-acfbbc7c-0263-49b1-995a-a7adbc6cbf1e tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Getting quotas for user 632904331d024d9b8e4d3660dff2cdf3 and project 56ed0bdee3aa4013bd9219069bda558c. Resources: {'instances', 'cores', 'ram'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:02:56.089258 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-acfbbc7c-0263-49b1-995a-a7adbc6cbf1e tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Going to run 1 instances... {{(pid=122633) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 23:02:56.092304 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-acfbbc7c-0263-49b1-995a-a7adbc6cbf1e tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] [instance: 63d2bd74-d060-4925-9323-b39d5131f958] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a3cbaee6-f354-4b7f-b529-25082b696458',volume_size=None,volume_type=None)] {{(pid=122633) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 23:02:56.364037 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-acfbbc7c-0263-49b1-995a-a7adbc6cbf1e tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.197678 Aug 10 23:02:56.373003 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 835/1651] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 23:02:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1208 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 10 23:02:56.379974 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-13e202d3-4030-42be-817c-67c766b56e33 tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:56.380807 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-13e202d3-4030-42be-817c-67c766b56e33 tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] [instance: 8fa0b7c8-ae4b-413c-9592-f4944cfb22fc] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:02:56.397430 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-13e202d3-4030-42be-817c-67c766b56e33 tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:56.398115 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-13e202d3-4030-42be-817c-67c766b56e33 tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:56.399079 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-13e202d3-4030-42be-817c-67c766b56e33 tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:56.400757 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-13e202d3-4030-42be-817c-67c766b56e33 tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:56.401416 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-13e202d3-4030-42be-817c-67c766b56e33 tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:56.402031 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-13e202d3-4030-42be-817c-67c766b56e33 tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:56.422162 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-57ef6fad-d9fa-4ee6-9d27-d147f235cfa8 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '417d4eaaeb1c4df78745496ececb3e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27e6ee9495a438b8450a4ef0d62cbcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:02:56.435691 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-57ef6fad-d9fa-4ee6-9d27-d147f235cfa8 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] 10.222.0.58 "GET /compute/v2.1/servers/1fcd0cf8-e654-4e2a-bf05-d5d3c47bd200" status: 200 len: 1466 microversion: 2.1 time: 1.017527 Aug 10 23:02:56.446907 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 817/1652] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:02:55 2022] GET /compute/v2.1/servers/1fcd0cf8-e654-4e2a-bf05-d5d3c47bd200 => generated 1466 bytes in 1026 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:02:56.454698 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-b86aa16d-a988-48d2-83d8-eae027b86ff7 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:56.454698 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-b86aa16d-a988-48d2-83d8-eae027b86ff7 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] [instance: 3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:02:56.469171 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b86aa16d-a988-48d2-83d8-eae027b86ff7 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:56.469668 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b86aa16d-a988-48d2-83d8-eae027b86ff7 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:56.470109 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b86aa16d-a988-48d2-83d8-eae027b86ff7 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:56.482356 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b86aa16d-a988-48d2-83d8-eae027b86ff7 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:56.482356 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b86aa16d-a988-48d2-83d8-eae027b86ff7 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:56.495947 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b86aa16d-a988-48d2-83d8-eae027b86ff7 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:56.562512 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-13e202d3-4030-42be-817c-67c766b56e33 tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be22a1243524178bdfea6892f27b255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f0030d3c62f48e6acd142058158e11e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:02:56.575216 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-13e202d3-4030-42be-817c-67c766b56e33 tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] 10.222.0.58 "GET /compute/v2.1/servers/8fa0b7c8-ae4b-413c-9592-f4944cfb22fc" status: 200 len: 1280 microversion: 2.1 time: 0.200741 Aug 10 23:02:56.576553 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 836/1653] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:02:56 2022] GET /compute/v2.1/servers/8fa0b7c8-ae4b-413c-9592-f4944cfb22fc => generated 1280 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:02:56.587909 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-faeaf529-0b0f-464f-86a4-f831bc56d0ef tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:56.590646 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-faeaf529-0b0f-464f-86a4-f831bc56d0ef tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] [instance: 63d2bd74-d060-4925-9323-b39d5131f958] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:02:56.693375 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-faeaf529-0b0f-464f-86a4-f831bc56d0ef tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632904331d024d9b8e4d3660dff2cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ed0bdee3aa4013bd9219069bda558c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:02:56.701240 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-faeaf529-0b0f-464f-86a4-f831bc56d0ef tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] 10.222.0.58 "GET /compute/v2.1/servers/63d2bd74-d060-4925-9323-b39d5131f958" status: 200 len: 1053 microversion: 2.1 time: 0.123165 Aug 10 23:02:56.701948 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 837/1654] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:02:56 2022] GET /compute/v2.1/servers/63d2bd74-d060-4925-9323-b39d5131f958 => generated 1053 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:02:56.707147 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-d00e8f65-8a78-457c-88cb-f010923a9531 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:56.712473 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-d00e8f65-8a78-457c-88cb-f010923a9531 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] [instance: 67accb8d-3e90-483c-a1e5-9a0c04a685c8] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:02:56.720198 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d00e8f65-8a78-457c-88cb-f010923a9531 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:56.720705 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d00e8f65-8a78-457c-88cb-f010923a9531 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:56.721149 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d00e8f65-8a78-457c-88cb-f010923a9531 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:56.721879 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d00e8f65-8a78-457c-88cb-f010923a9531 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:56.722774 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d00e8f65-8a78-457c-88cb-f010923a9531 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:56.723131 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d00e8f65-8a78-457c-88cb-f010923a9531 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:56.983374 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-d00e8f65-8a78-457c-88cb-f010923a9531 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfd6d8e6a8444f5b9fcf1cf8da242ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707f869910b34768ae1a348cd0b5f284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:02:56.992879 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-d00e8f65-8a78-457c-88cb-f010923a9531 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] 10.222.0.58 "GET /compute/v2.1/servers/67accb8d-3e90-483c-a1e5-9a0c04a685c8" status: 200 len: 1315 microversion: 2.1 time: 0.289598 Aug 10 23:02:57.001130 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 838/1655] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:02:56 2022] GET /compute/v2.1/servers/67accb8d-3e90-483c-a1e5-9a0c04a685c8 => generated 1315 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:02:57.011449 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-f00749a2-536e-4319-a7e6-f322eebb3184 tempest-ServersOnMultiNodesTest-79489 tempest-ServersOnMultiNodesTest-79489-project-admin] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:57.012084 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-f00749a2-536e-4319-a7e6-f322eebb3184 tempest-ServersOnMultiNodesTest-79489 tempest-ServersOnMultiNodesTest-79489-project-admin] [instance: 1fcd0cf8-e654-4e2a-bf05-d5d3c47bd200] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:02:57.018331 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f00749a2-536e-4319-a7e6-f322eebb3184 tempest-ServersOnMultiNodesTest-79489 tempest-ServersOnMultiNodesTest-79489-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:57.019412 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f00749a2-536e-4319-a7e6-f322eebb3184 tempest-ServersOnMultiNodesTest-79489 tempest-ServersOnMultiNodesTest-79489-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:57.020264 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f00749a2-536e-4319-a7e6-f322eebb3184 tempest-ServersOnMultiNodesTest-79489 tempest-ServersOnMultiNodesTest-79489-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:57.021833 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f00749a2-536e-4319-a7e6-f322eebb3184 tempest-ServersOnMultiNodesTest-79489 tempest-ServersOnMultiNodesTest-79489-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:57.022484 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f00749a2-536e-4319-a7e6-f322eebb3184 tempest-ServersOnMultiNodesTest-79489 tempest-ServersOnMultiNodesTest-79489-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:57.023112 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f00749a2-536e-4319-a7e6-f322eebb3184 tempest-ServersOnMultiNodesTest-79489 tempest-ServersOnMultiNodesTest-79489-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:57.184729 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-f00749a2-536e-4319-a7e6-f322eebb3184 tempest-ServersOnMultiNodesTest-79489 tempest-ServersOnMultiNodesTest-79489-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/1fcd0cf8-e654-4e2a-bf05-d5d3c47bd200" status: 200 len: 1619 microversion: 2.1 time: 0.181603 Aug 10 23:02:57.185325 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 839/1656] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:02:57 2022] GET /compute/v2.1/servers/1fcd0cf8-e654-4e2a-bf05-d5d3c47bd200 => generated 1619 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:02:57.214287 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-1379db2a-5ee0-4965-865a-f91b3f1cb2e0 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:57.215032 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-1379db2a-5ee0-4965-865a-f91b3f1cb2e0 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] [instance: 1fcd0cf8-e654-4e2a-bf05-d5d3c47bd200] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:02:57.226297 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1379db2a-5ee0-4965-865a-f91b3f1cb2e0 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:57.226825 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1379db2a-5ee0-4965-865a-f91b3f1cb2e0 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:57.227261 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1379db2a-5ee0-4965-865a-f91b3f1cb2e0 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:57.228434 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1379db2a-5ee0-4965-865a-f91b3f1cb2e0 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:57.228565 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1379db2a-5ee0-4965-865a-f91b3f1cb2e0 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:57.228928 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1379db2a-5ee0-4965-865a-f91b3f1cb2e0 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:57.267132 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-1379db2a-5ee0-4965-865a-f91b3f1cb2e0 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] [instance: 1fcd0cf8-e654-4e2a-bf05-d5d3c47bd200] Going to try to terminate instance {{(pid=122633) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:02:57.392815 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-1379db2a-5ee0-4965-865a-f91b3f1cb2e0 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] 10.222.0.58 "DELETE /compute/v2.1/servers/1fcd0cf8-e654-4e2a-bf05-d5d3c47bd200" status: 204 len: 0 microversion: 2.1 time: 0.185219 Aug 10 23:02:57.394629 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 840/1657] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:02:57 2022] DELETE /compute/v2.1/servers/1fcd0cf8-e654-4e2a-bf05-d5d3c47bd200 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:02:57.417232 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-79325e76-3e9c-45e6-a8dc-4d51442ac4b8 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:57.422749 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-79325e76-3e9c-45e6-a8dc-4d51442ac4b8 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] [instance: 1fcd0cf8-e654-4e2a-bf05-d5d3c47bd200] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:02:57.430359 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-79325e76-3e9c-45e6-a8dc-4d51442ac4b8 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:57.431790 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-79325e76-3e9c-45e6-a8dc-4d51442ac4b8 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:57.433706 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-79325e76-3e9c-45e6-a8dc-4d51442ac4b8 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:57.434565 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-79325e76-3e9c-45e6-a8dc-4d51442ac4b8 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:57.435106 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-79325e76-3e9c-45e6-a8dc-4d51442ac4b8 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:57.435659 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-79325e76-3e9c-45e6-a8dc-4d51442ac4b8 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:57.475542 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-b86aa16d-a988-48d2-83d8-eae027b86ff7 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:02:57.493806 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-b86aa16d-a988-48d2-83d8-eae027b86ff7 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:02:57.495806 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-b86aa16d-a988-48d2-83d8-eae027b86ff7 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:02:57.497225 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-b86aa16d-a988-48d2-83d8-eae027b86ff7 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] 10.222.0.58 "GET /compute/v2.1/servers/3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51" status: 200 len: 1486 microversion: 2.25 time: 1.058570 Aug 10 23:02:57.504250 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 818/1658] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:02:56 2022] GET /compute/v2.1/servers/3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51 => generated 1486 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:02:57.601384 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-e2caa1ed-eb9b-41e7-9b4a-fa110c5677e5 tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:57.602229 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-e2caa1ed-eb9b-41e7-9b4a-fa110c5677e5 tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] [instance: 8fa0b7c8-ae4b-413c-9592-f4944cfb22fc] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:02:57.609566 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e2caa1ed-eb9b-41e7-9b4a-fa110c5677e5 tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:57.611699 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e2caa1ed-eb9b-41e7-9b4a-fa110c5677e5 tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:57.612399 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e2caa1ed-eb9b-41e7-9b4a-fa110c5677e5 tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:57.613337 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e2caa1ed-eb9b-41e7-9b4a-fa110c5677e5 tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:57.615295 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e2caa1ed-eb9b-41e7-9b4a-fa110c5677e5 tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:57.617520 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e2caa1ed-eb9b-41e7-9b4a-fa110c5677e5 tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:57.635193 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-79325e76-3e9c-45e6-a8dc-4d51442ac4b8 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '417d4eaaeb1c4df78745496ececb3e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27e6ee9495a438b8450a4ef0d62cbcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:02:57.647195 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-79325e76-3e9c-45e6-a8dc-4d51442ac4b8 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] 10.222.0.58 "GET /compute/v2.1/servers/1fcd0cf8-e654-4e2a-bf05-d5d3c47bd200" status: 200 len: 1472 microversion: 2.1 time: 0.247162 Aug 10 23:02:57.661322 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 841/1659] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:02:57 2022] GET /compute/v2.1/servers/1fcd0cf8-e654-4e2a-bf05-d5d3c47bd200 => generated 1472 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:02:57.723533 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-2592339b-a69b-4691-85ed-feb26d49db40 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:57.724344 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-2592339b-a69b-4691-85ed-feb26d49db40 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] [instance: 63d2bd74-d060-4925-9323-b39d5131f958] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:02:57.737711 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2592339b-a69b-4691-85ed-feb26d49db40 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:57.738206 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2592339b-a69b-4691-85ed-feb26d49db40 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:57.738673 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2592339b-a69b-4691-85ed-feb26d49db40 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:57.739391 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2592339b-a69b-4691-85ed-feb26d49db40 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:57.740071 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2592339b-a69b-4691-85ed-feb26d49db40 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:57.740491 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2592339b-a69b-4691-85ed-feb26d49db40 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:57.811109 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-2592339b-a69b-4691-85ed-feb26d49db40 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632904331d024d9b8e4d3660dff2cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ed0bdee3aa4013bd9219069bda558c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:02:57.820082 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-2592339b-a69b-4691-85ed-feb26d49db40 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] 10.222.0.58 "GET /compute/v2.1/servers/63d2bd74-d060-4925-9323-b39d5131f958" status: 200 len: 1151 microversion: 2.1 time: 0.101731 Aug 10 23:02:57.820832 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 842/1660] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:02:57 2022] GET /compute/v2.1/servers/63d2bd74-d060-4925-9323-b39d5131f958 => generated 1151 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:02:57.906746 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-e2caa1ed-eb9b-41e7-9b4a-fa110c5677e5 tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be22a1243524178bdfea6892f27b255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f0030d3c62f48e6acd142058158e11e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:02:57.916862 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-e2caa1ed-eb9b-41e7-9b4a-fa110c5677e5 tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] 10.222.0.58 "GET /compute/v2.1/servers/8fa0b7c8-ae4b-413c-9592-f4944cfb22fc" status: 200 len: 1280 microversion: 2.1 time: 0.320463 Aug 10 23:02:57.917883 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 819/1661] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:02:57 2022] GET /compute/v2.1/servers/8fa0b7c8-ae4b-413c-9592-f4944cfb22fc => generated 1280 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:02:58.020604 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-1b3f9498-7632-4b9f-8f3a-4714a21c9bd4 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:58.021895 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-1b3f9498-7632-4b9f-8f3a-4714a21c9bd4 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] [instance: 67accb8d-3e90-483c-a1e5-9a0c04a685c8] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:02:58.029956 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1b3f9498-7632-4b9f-8f3a-4714a21c9bd4 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:58.030456 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1b3f9498-7632-4b9f-8f3a-4714a21c9bd4 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:58.030931 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1b3f9498-7632-4b9f-8f3a-4714a21c9bd4 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:58.031751 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1b3f9498-7632-4b9f-8f3a-4714a21c9bd4 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:58.032208 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1b3f9498-7632-4b9f-8f3a-4714a21c9bd4 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:58.032641 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1b3f9498-7632-4b9f-8f3a-4714a21c9bd4 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:58.227878 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-1b3f9498-7632-4b9f-8f3a-4714a21c9bd4 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfd6d8e6a8444f5b9fcf1cf8da242ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707f869910b34768ae1a348cd0b5f284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:02:58.235957 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-1b3f9498-7632-4b9f-8f3a-4714a21c9bd4 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] 10.222.0.58 "GET /compute/v2.1/servers/67accb8d-3e90-483c-a1e5-9a0c04a685c8" status: 200 len: 1315 microversion: 2.1 time: 0.219310 Aug 10 23:02:58.236549 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 843/1662] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:02:58 2022] GET /compute/v2.1/servers/67accb8d-3e90-483c-a1e5-9a0c04a685c8 => generated 1315 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:02:58.527092 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-709e9e14-661c-4a86-8482-dd784d5f0ee4 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:58.528574 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-709e9e14-661c-4a86-8482-dd784d5f0ee4 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] [instance: 3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:02:58.558649 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-709e9e14-661c-4a86-8482-dd784d5f0ee4 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:58.562562 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-709e9e14-661c-4a86-8482-dd784d5f0ee4 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:58.563409 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-709e9e14-661c-4a86-8482-dd784d5f0ee4 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:58.565973 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-709e9e14-661c-4a86-8482-dd784d5f0ee4 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:58.567409 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-709e9e14-661c-4a86-8482-dd784d5f0ee4 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:58.568938 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-709e9e14-661c-4a86-8482-dd784d5f0ee4 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:58.671992 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-66c6c9fb-7cff-4b93-b664-3d4e39c7e971 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:02:58.673270 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-66c6c9fb-7cff-4b93-b664-3d4e39c7e971 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] [instance: 1fcd0cf8-e654-4e2a-bf05-d5d3c47bd200] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:02:58.688542 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-66c6c9fb-7cff-4b93-b664-3d4e39c7e971 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:58.689408 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-66c6c9fb-7cff-4b93-b664-3d4e39c7e971 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:58.691195 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-66c6c9fb-7cff-4b93-b664-3d4e39c7e971 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:58.692631 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-66c6c9fb-7cff-4b93-b664-3d4e39c7e971 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:02:58.693581 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-66c6c9fb-7cff-4b93-b664-3d4e39c7e971 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:02:58.694226 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-66c6c9fb-7cff-4b93-b664-3d4e39c7e971 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:02:58.934018 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-66c6c9fb-7cff-4b93-b664-3d4e39c7e971 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '417d4eaaeb1c4df78745496ececb3e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27e6ee9495a438b8450a4ef0d62cbcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:02:58.956316 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-66c6c9fb-7cff-4b93-b664-3d4e39c7e971 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] 10.222.0.58 "GET /compute/v2.1/servers/1fcd0cf8-e654-4e2a-bf05-d5d3c47bd200" status: 200 len: 1472 microversion: 2.1 time: 0.288052 Aug 10 23:02:58.962980 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 844/1663] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:02:58 2022] GET /compute/v2.1/servers/1fcd0cf8-e654-4e2a-bf05-d5d3c47bd200 => generated 1472 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:02:59.422407 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-459faf43-16ca-444c-941c-9b886fb0bf82 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-1722182935", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "17ba7c5b-265f-416d-8f1f-084885c4df3b"}]}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:02:59.549346 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.network.neutron [None req-459faf43-16ca-444c-941c-9b886fb0bf82 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] validate_networks() for [('17ba7c5b-265f-416d-8f1f-084885c4df3b', None, None, None, None, None)] {{(pid=122633) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 23:03:00.286611 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-709e9e14-661c-4a86-8482-dd784d5f0ee4 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:00.299028 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-709e9e14-661c-4a86-8482-dd784d5f0ee4 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:00.308377 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-709e9e14-661c-4a86-8482-dd784d5f0ee4 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:00.310030 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-709e9e14-661c-4a86-8482-dd784d5f0ee4 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] 10.222.0.58 "GET /compute/v2.1/servers/3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51" status: 200 len: 1486 microversion: 2.25 time: 1.790689 Aug 10 23:03:00.311915 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 820/1664] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:02:58 2022] GET /compute/v2.1/servers/3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51 => generated 1486 bytes in 1793 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 23:03:00.326184 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-629ba708-12c7-40ec-87d6-c83afcb28c4a tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:00.327141 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-629ba708-12c7-40ec-87d6-c83afcb28c4a tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] [instance: 63d2bd74-d060-4925-9323-b39d5131f958] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:00.342879 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-629ba708-12c7-40ec-87d6-c83afcb28c4a tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:00.343647 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-629ba708-12c7-40ec-87d6-c83afcb28c4a tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:00.344413 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-629ba708-12c7-40ec-87d6-c83afcb28c4a tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:00.345358 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-629ba708-12c7-40ec-87d6-c83afcb28c4a tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:00.350290 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-629ba708-12c7-40ec-87d6-c83afcb28c4a tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:00.351027 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-629ba708-12c7-40ec-87d6-c83afcb28c4a tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:00.483863 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-459faf43-16ca-444c-941c-9b886fb0bf82 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Flavor limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:03:00.484697 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-459faf43-16ca-444c-941c-9b886fb0bf82 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Image limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:03:00.485330 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-459faf43-16ca-444c-941c-9b886fb0bf82 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Flavor pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:03:00.485790 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-459faf43-16ca-444c-941c-9b886fb0bf82 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Image pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:03:00.486309 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-459faf43-16ca-444c-941c-9b886fb0bf82 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:03:00.505294 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-459faf43-16ca-444c-941c-9b886fb0bf82 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:00.506051 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-459faf43-16ca-444c-941c-9b886fb0bf82 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:00.506652 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-459faf43-16ca-444c-941c-9b886fb0bf82 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:00.507844 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-459faf43-16ca-444c-941c-9b886fb0bf82 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:00.508975 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-459faf43-16ca-444c-941c-9b886fb0bf82 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:00.509542 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-459faf43-16ca-444c-941c-9b886fb0bf82 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:00.561164 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-459faf43-16ca-444c-941c-9b886fb0bf82 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Getting quotas for project 9e9cf3129a4e4f56a17bebf68b7bc42b. Resources: {'instances', 'cores', 'ram'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:03:00.577997 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-459faf43-16ca-444c-941c-9b886fb0bf82 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Getting quotas for user 890735b21f5d4764aefd789f74e00222 and project 9e9cf3129a4e4f56a17bebf68b7bc42b. Resources: {'instances', 'cores', 'ram'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:03:00.586559 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=31 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:03:00.596981 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-459faf43-16ca-444c-941c-9b886fb0bf82 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Going to run 3 instances... {{(pid=122633) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 23:03:00.599734 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-459faf43-16ca-444c-941c-9b886fb0bf82 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] [instance: 17b32f05-1f0e-473f-bfda-fab92a90b04f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78ad8905-f66f-4733-8be9-2b260f1fabed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122633) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 23:03:00.644488 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-459faf43-16ca-444c-941c-9b886fb0bf82 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] [instance: 6bf5e469-d129-4daa-93f8-36661ec153a2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78ad8905-f66f-4733-8be9-2b260f1fabed',instance=,instance_uuid=17b32f05-1f0e-473f-bfda-fab92a90b04f,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122633) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 23:03:00.695199 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-459faf43-16ca-444c-941c-9b886fb0bf82 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] [instance: 10ede6f4-625a-4c5a-a5d6-d7d0f2476dee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78ad8905-f66f-4733-8be9-2b260f1fabed',instance=,instance_uuid=6bf5e469-d129-4daa-93f8-36661ec153a2,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122633) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 23:03:00.809256 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-629ba708-12c7-40ec-87d6-c83afcb28c4a tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632904331d024d9b8e4d3660dff2cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ed0bdee3aa4013bd9219069bda558c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:00.825890 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-629ba708-12c7-40ec-87d6-c83afcb28c4a tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] 10.222.0.58 "GET /compute/v2.1/servers/63d2bd74-d060-4925-9323-b39d5131f958" status: 200 len: 1169 microversion: 2.1 time: 0.511867 Aug 10 23:03:00.847026 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-459faf43-16ca-444c-941c-9b886fb0bf82 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.882534 Aug 10 23:03:00.849686 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 821/1665] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:03:00 2022] GET /compute/v2.1/servers/63d2bd74-d060-4925-9323-b39d5131f958 => generated 1169 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:03:00.852792 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 845/1666] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 23:02:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 1889 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 23:03:00.862174 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-677a3dc9-80c0-4395-991e-773dc5af7afa tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:00.869139 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-a2601450-7667-45d6-b34a-084e04bbf66b tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:00.869803 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-a2601450-7667-45d6-b34a-084e04bbf66b tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] [instance: 67accb8d-3e90-483c-a1e5-9a0c04a685c8] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:00.875345 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-677a3dc9-80c0-4395-991e-773dc5af7afa tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] [instance: 8fa0b7c8-ae4b-413c-9592-f4944cfb22fc] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:00.889932 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a2601450-7667-45d6-b34a-084e04bbf66b tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:00.890501 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a2601450-7667-45d6-b34a-084e04bbf66b tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:00.891025 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a2601450-7667-45d6-b34a-084e04bbf66b tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:00.891785 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a2601450-7667-45d6-b34a-084e04bbf66b tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:00.892253 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a2601450-7667-45d6-b34a-084e04bbf66b tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:00.893934 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a2601450-7667-45d6-b34a-084e04bbf66b tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:00.895437 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-677a3dc9-80c0-4395-991e-773dc5af7afa tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:00.897429 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-677a3dc9-80c0-4395-991e-773dc5af7afa tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:00.898072 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-677a3dc9-80c0-4395-991e-773dc5af7afa tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:00.903154 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-677a3dc9-80c0-4395-991e-773dc5af7afa tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:00.906558 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-677a3dc9-80c0-4395-991e-773dc5af7afa tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:00.907257 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-677a3dc9-80c0-4395-991e-773dc5af7afa tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:01.511233 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-a2601450-7667-45d6-b34a-084e04bbf66b tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfd6d8e6a8444f5b9fcf1cf8da242ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707f869910b34768ae1a348cd0b5f284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:01.526773 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-a2601450-7667-45d6-b34a-084e04bbf66b tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] 10.222.0.58 "GET /compute/v2.1/servers/67accb8d-3e90-483c-a1e5-9a0c04a685c8" status: 200 len: 1315 microversion: 2.1 time: 0.672785 Aug 10 23:03:01.530032 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 846/1667] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:03:00 2022] GET /compute/v2.1/servers/67accb8d-3e90-483c-a1e5-9a0c04a685c8 => generated 1315 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:03:01.536770 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-dd09754f-e5fa-4e18-9106-9247e213545e tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:01.543608 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-dd09754f-e5fa-4e18-9106-9247e213545e tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] [instance: 1fcd0cf8-e654-4e2a-bf05-d5d3c47bd200] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:01.561614 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dd09754f-e5fa-4e18-9106-9247e213545e tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:01.562682 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dd09754f-e5fa-4e18-9106-9247e213545e tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:01.563349 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dd09754f-e5fa-4e18-9106-9247e213545e tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:01.566717 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dd09754f-e5fa-4e18-9106-9247e213545e tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:01.567231 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dd09754f-e5fa-4e18-9106-9247e213545e tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:01.569269 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dd09754f-e5fa-4e18-9106-9247e213545e tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:01.969308 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-dd09754f-e5fa-4e18-9106-9247e213545e tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '417d4eaaeb1c4df78745496ececb3e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27e6ee9495a438b8450a4ef0d62cbcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:01.995405 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-dd09754f-e5fa-4e18-9106-9247e213545e tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] 10.222.0.58 "GET /compute/v2.1/servers/1fcd0cf8-e654-4e2a-bf05-d5d3c47bd200" status: 200 len: 1472 microversion: 2.1 time: 0.463738 Aug 10 23:03:02.010587 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 847/1668] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:03:01 2022] GET /compute/v2.1/servers/1fcd0cf8-e654-4e2a-bf05-d5d3c47bd200 => generated 1472 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:03:02.017801 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-d04dd2cd-e35c-4504-bf4b-eae80188137c tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:02.022725 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-d04dd2cd-e35c-4504-bf4b-eae80188137c tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '890735b21f5d4764aefd789f74e00222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9cf3129a4e4f56a17bebf68b7bc42b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:02.023539 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-d04dd2cd-e35c-4504-bf4b-eae80188137c tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Searching by: {'deleted': False, 'project_id': '9e9cf3129a4e4f56a17bebf68b7bc42b'} {{(pid=122633) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 10 23:03:02.055642 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d04dd2cd-e35c-4504-bf4b-eae80188137c tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:02.056091 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d04dd2cd-e35c-4504-bf4b-eae80188137c tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:02.057201 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d04dd2cd-e35c-4504-bf4b-eae80188137c tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:02.058373 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d04dd2cd-e35c-4504-bf4b-eae80188137c tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:02.059297 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d04dd2cd-e35c-4504-bf4b-eae80188137c tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:02.060152 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d04dd2cd-e35c-4504-bf4b-eae80188137c tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:02.195621 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-d04dd2cd-e35c-4504-bf4b-eae80188137c tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] 10.222.0.58 "GET /compute/v2.1/servers" status: 200 len: 1018 microversion: 2.1 time: 0.183789 Aug 10 23:03:02.197202 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 848/1669] 10.222.0.58 () {58 vars in 1125 bytes} [Wed Aug 10 23:03:02 2022] GET /compute/v2.1/servers => generated 1018 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:03:02.202759 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-2dde3095-683e-4f25-a024-32c4ded442e6 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:02.203584 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-2dde3095-683e-4f25-a024-32c4ded442e6 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] [instance: 3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:02.218919 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2dde3095-683e-4f25-a024-32c4ded442e6 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:02.219451 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2dde3095-683e-4f25-a024-32c4ded442e6 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:02.219898 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2dde3095-683e-4f25-a024-32c4ded442e6 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:02.220653 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2dde3095-683e-4f25-a024-32c4ded442e6 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:02.221111 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2dde3095-683e-4f25-a024-32c4ded442e6 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:02.221539 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2dde3095-683e-4f25-a024-32c4ded442e6 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:02.343587 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=2 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:03:02.502380 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-677a3dc9-80c0-4395-991e-773dc5af7afa tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be22a1243524178bdfea6892f27b255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f0030d3c62f48e6acd142058158e11e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:02.563099 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-677a3dc9-80c0-4395-991e-773dc5af7afa tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] 10.222.0.58 "GET /compute/v2.1/servers/8fa0b7c8-ae4b-413c-9592-f4944cfb22fc" status: 200 len: 1322 microversion: 2.1 time: 1.710545 Aug 10 23:03:02.564348 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 822/1670] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:03:00 2022] GET /compute/v2.1/servers/8fa0b7c8-ae4b-413c-9592-f4944cfb22fc => generated 1322 bytes in 1714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:03:02.576302 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-55dfa5a9-321c-456d-8800-518b4eeae5cc tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:02.577317 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-55dfa5a9-321c-456d-8800-518b4eeae5cc tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] [instance: 63d2bd74-d060-4925-9323-b39d5131f958] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:02.588631 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-55dfa5a9-321c-456d-8800-518b4eeae5cc tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:02.589833 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-55dfa5a9-321c-456d-8800-518b4eeae5cc tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:02.590521 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-55dfa5a9-321c-456d-8800-518b4eeae5cc tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:02.591535 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-55dfa5a9-321c-456d-8800-518b4eeae5cc tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:02.592213 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-55dfa5a9-321c-456d-8800-518b4eeae5cc tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:02.594326 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-55dfa5a9-321c-456d-8800-518b4eeae5cc tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:03.143061 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-2dde3095-683e-4f25-a024-32c4ded442e6 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:03.151061 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:03:03.159626 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=8 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:03:03.159933 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-2dde3095-683e-4f25-a024-32c4ded442e6 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:03.166774 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-2dde3095-683e-4f25-a024-32c4ded442e6 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:03.169108 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-2dde3095-683e-4f25-a024-32c4ded442e6 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] 10.222.0.58 "GET /compute/v2.1/servers/3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51" status: 200 len: 1486 microversion: 2.25 time: 0.970806 Aug 10 23:03:03.169698 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 849/1671] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:03:02 2022] GET /compute/v2.1/servers/3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51 => generated 1486 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:03:03.189376 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-55b9788c-da82-40e3-8bc3-a00caf97fc85 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:03.189828 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-55b9788c-da82-40e3-8bc3-a00caf97fc85 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] [instance: 10ede6f4-625a-4c5a-a5d6-d7d0f2476dee] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:03.283675 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-55b9788c-da82-40e3-8bc3-a00caf97fc85 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:03.287492 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-55b9788c-da82-40e3-8bc3-a00caf97fc85 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:03.290235 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-55b9788c-da82-40e3-8bc3-a00caf97fc85 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:03.292183 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-55b9788c-da82-40e3-8bc3-a00caf97fc85 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:03.302212 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-55b9788c-da82-40e3-8bc3-a00caf97fc85 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:03.303244 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-55b9788c-da82-40e3-8bc3-a00caf97fc85 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:03.796906 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-55b9788c-da82-40e3-8bc3-a00caf97fc85 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890735b21f5d4764aefd789f74e00222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9cf3129a4e4f56a17bebf68b7bc42b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:03.810887 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-55b9788c-da82-40e3-8bc3-a00caf97fc85 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] 10.222.0.58 "GET /compute/v2.1/servers/10ede6f4-625a-4c5a-a5d6-d7d0f2476dee" status: 200 len: 1227 microversion: 2.1 time: 0.639809 Aug 10 23:03:03.821108 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 850/1672] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:03:03 2022] GET /compute/v2.1/servers/10ede6f4-625a-4c5a-a5d6-d7d0f2476dee => generated 1227 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:03:03.829927 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-866aaf83-de1c-4ef7-9543-d4f3b682f8a1 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:03.831809 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-866aaf83-de1c-4ef7-9543-d4f3b682f8a1 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] [instance: 67accb8d-3e90-483c-a1e5-9a0c04a685c8] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:03.851008 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-866aaf83-de1c-4ef7-9543-d4f3b682f8a1 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:03.851631 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-866aaf83-de1c-4ef7-9543-d4f3b682f8a1 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:03.852261 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-866aaf83-de1c-4ef7-9543-d4f3b682f8a1 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:03.853286 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-866aaf83-de1c-4ef7-9543-d4f3b682f8a1 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:03.860501 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-866aaf83-de1c-4ef7-9543-d4f3b682f8a1 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:03.860501 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-866aaf83-de1c-4ef7-9543-d4f3b682f8a1 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:05.459128 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-55dfa5a9-321c-456d-8800-518b4eeae5cc tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632904331d024d9b8e4d3660dff2cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ed0bdee3aa4013bd9219069bda558c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:05.478604 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-55dfa5a9-321c-456d-8800-518b4eeae5cc tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] 10.222.0.58 "GET /compute/v2.1/servers/63d2bd74-d060-4925-9323-b39d5131f958" status: 200 len: 1211 microversion: 2.1 time: 2.910383 Aug 10 23:03:05.498049 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 823/1673] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:03:02 2022] GET /compute/v2.1/servers/63d2bd74-d060-4925-9323-b39d5131f958 => generated 1211 bytes in 2920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:03:05.861691 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-866aaf83-de1c-4ef7-9543-d4f3b682f8a1 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfd6d8e6a8444f5b9fcf1cf8da242ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707f869910b34768ae1a348cd0b5f284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:05.879408 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-866aaf83-de1c-4ef7-9543-d4f3b682f8a1 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] 10.222.0.58 "GET /compute/v2.1/servers/67accb8d-3e90-483c-a1e5-9a0c04a685c8" status: 200 len: 1315 microversion: 2.1 time: 2.056556 Aug 10 23:03:05.879868 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 851/1674] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:03:03 2022] GET /compute/v2.1/servers/67accb8d-3e90-483c-a1e5-9a0c04a685c8 => generated 1315 bytes in 2058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:03:05.885211 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-9eac8a91-5fc0-41cf-88e8-89bb9d3303b0 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:05.886050 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-9eac8a91-5fc0-41cf-88e8-89bb9d3303b0 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] [instance: 1fcd0cf8-e654-4e2a-bf05-d5d3c47bd200] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:05.893930 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9eac8a91-5fc0-41cf-88e8-89bb9d3303b0 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:05.898344 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9eac8a91-5fc0-41cf-88e8-89bb9d3303b0 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:05.911374 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9eac8a91-5fc0-41cf-88e8-89bb9d3303b0 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:05.912175 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9eac8a91-5fc0-41cf-88e8-89bb9d3303b0 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:05.913074 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9eac8a91-5fc0-41cf-88e8-89bb9d3303b0 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:05.913686 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9eac8a91-5fc0-41cf-88e8-89bb9d3303b0 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:05.955575 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-9eac8a91-5fc0-41cf-88e8-89bb9d3303b0 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] HTTP exception thrown: Instance 1fcd0cf8-e654-4e2a-bf05-d5d3c47bd200 could not be found. Aug 10 23:03:05.957287 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-9eac8a91-5fc0-41cf-88e8-89bb9d3303b0 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Request method failure captured: Aug 10 23:03:05.957287 n-d-850468-14 devstack@n-api.service[122633]: request: GET /compute/v2.1/servers/1fcd0cf8-e654-4e2a-bf05-d5d3c47bd200 HTTP/1.1 Aug 10 23:03:05.957287 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:03:05.957287 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:03:05.957287 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:03:05.957287 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:03:05.957287 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:03:05.957287 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:03:05.957287 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:03:05.957287 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:03:05.957287 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9DhnJQVy677u4b7dnMoSItqtWsJm27g_Vg031CYXViqt8YYY7d4cXYrgXs0Pp9xS3IIxdwWgPKq2sDULWw--Li9t2t8l1R3feSY4uh4FysmLVRfKNCAYvKF_tmPQ5ZUjwhrC4jAx70ULoXcE-6wvpA-wHk_CVzAxHX7IWuhEQLk8ZDk Aug 10 23:03:05.957287 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:03:05.957287 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:03:05.957287 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:03:05.957287 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:03:05.957287 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:03:05.957287 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:03:05.957287 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: b27e6ee9495a438b8450a4ef0d62cbcd Aug 10 23:03:05.957287 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-ServersOnMultiNodesTest-936995831 Aug 10 23:03:05.957287 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:03:05.957287 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:03:05.959002 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b27e6ee9495a438b8450a4ef0d62cbcd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b27e6ee9495a438b8450a4ef0d62cbcd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b27e6ee9495a438b8450a4ef0d62cbcd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b27e6ee9495a438b8450a4ef0d62cbcd", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:03:05.959002 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-ServersOnMultiNodesTest-936995831 Aug 10 23:03:05.959002 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: b27e6ee9495a438b8450a4ef0d62cbcd Aug 10 23:03:05.959002 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-936995831 Aug 10 23:03:05.959002 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-ServersOnMultiNodesTest-936995831-project Aug 10 23:03:05.959002 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:03:05.959002 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:03:05.959002 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 417d4eaaeb1c4df78745496ececb3e88 Aug 10 23:03:05.959002 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-ServersOnMultiNodesTest-936995831-project Aug 10 23:03:05.959002 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:03:05.959002 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance 1fcd0cf8-e654-4e2a-bf05-d5d3c47bd200 could not be found. Aug 10 23:03:05.959002 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': '1fcd0cf8-e654-4e2a-bf05-d5d3c47bd200'} Aug 10 23:03:05.959922 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:03:05.959922 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:03:05.959922 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:03:05.959922 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:03:05.959922 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:03:05.959922 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:03:05.959922 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:03:05.959922 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:03:05.959922 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:03:05.959922 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:03:05.959922 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1fcd0cf8-e654-4e2a-bf05-d5d3c47bd200 could not be found. Aug 10 23:03:05.959922 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:03:05.959922 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:03:05.959922 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:03:05.959922 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:03:05.959922 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:03:05.959922 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:03:05.959922 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:03:05.959922 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:03:05.959922 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:03:05.964041 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:03:05.964041 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:03:05.964041 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:03:05.964041 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:03:05.964041 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:03:05.964041 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:03:05.964041 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:03:05.964041 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1fcd0cf8-e654-4e2a-bf05-d5d3c47bd200 could not be found. Aug 10 23:03:05.964041 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:03:05.964041 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:03:05.964041 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:03:05.964041 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:03:05.964041 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:03:05.964041 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:03:05.964041 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:03:05.964041 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:03:05.964041 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1fcd0cf8-e654-4e2a-bf05-d5d3c47bd200 could not be found. Aug 10 23:03:05.964041 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:03:05.965663 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-9eac8a91-5fc0-41cf-88e8-89bb9d3303b0 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Returning 404 to user: Instance 1fcd0cf8-e654-4e2a-bf05-d5d3c47bd200 could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:03:05.965663 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-9eac8a91-5fc0-41cf-88e8-89bb9d3303b0 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] 10.222.0.58 "GET /compute/v2.1/servers/1fcd0cf8-e654-4e2a-bf05-d5d3c47bd200" status: 404 len: 111 microversion: 2.1 time: 0.077717 Aug 10 23:03:05.968873 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 852/1675] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:03:05 2022] GET /compute/v2.1/servers/1fcd0cf8-e654-4e2a-bf05-d5d3c47bd200 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:03:05.973962 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-291877d8-e2d2-4365-8ac2-ae5103b837c7 tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:05.974575 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-291877d8-e2d2-4365-8ac2-ae5103b837c7 tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] [instance: 8fa0b7c8-ae4b-413c-9592-f4944cfb22fc] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:05.991500 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-291877d8-e2d2-4365-8ac2-ae5103b837c7 tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:05.992004 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-291877d8-e2d2-4365-8ac2-ae5103b837c7 tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:05.993069 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-291877d8-e2d2-4365-8ac2-ae5103b837c7 tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:05.993899 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-291877d8-e2d2-4365-8ac2-ae5103b837c7 tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:05.994364 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-291877d8-e2d2-4365-8ac2-ae5103b837c7 tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:05.994811 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-291877d8-e2d2-4365-8ac2-ae5103b837c7 tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:06.046956 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-0ca562b2-1f5a-423f-beaa-af791173e67e tempest-SecurityGroupRulesTestJSON-678387735 tempest-SecurityGroupRulesTestJSON-678387735-project] Action: 'create', calling method: .version_select at 0x7f847d8c3ee0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1500066802", "description": "tempest-description-413937843"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:03:06.902596 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-291877d8-e2d2-4365-8ac2-ae5103b837c7 tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be22a1243524178bdfea6892f27b255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f0030d3c62f48e6acd142058158e11e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:06.920773 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-291877d8-e2d2-4365-8ac2-ae5103b837c7 tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] 10.222.0.58 "GET /compute/v2.1/servers/8fa0b7c8-ae4b-413c-9592-f4944cfb22fc" status: 200 len: 1322 microversion: 2.1 time: 0.949339 Aug 10 23:03:06.922341 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 853/1676] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:03:05 2022] GET /compute/v2.1/servers/8fa0b7c8-ae4b-413c-9592-f4944cfb22fc => generated 1322 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:03:06.941194 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-5a3fd10c-a2d4-45c3-a31b-7afd24ddcdd0 req-20327b49-d93a-4060-99d8-596ea19dbf99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63d2bd74-d060-4925-9323-b39d5131f958", "tag": "6375592d-fb15-4844-83aa-70296bc72a55"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:03:06.977921 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-5a3fd10c-a2d4-45c3-a31b-7afd24ddcdd0 req-20327b49-d93a-4060-99d8-596ea19dbf99 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:06.978522 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-5a3fd10c-a2d4-45c3-a31b-7afd24ddcdd0 req-20327b49-d93a-4060-99d8-596ea19dbf99 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:06.979049 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-5a3fd10c-a2d4-45c3-a31b-7afd24ddcdd0 req-20327b49-d93a-4060-99d8-596ea19dbf99 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:07.001164 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-5a3fd10c-a2d4-45c3-a31b-7afd24ddcdd0 req-20327b49-d93a-4060-99d8-596ea19dbf99 service nova] Creating event network-changed:6375592d-fb15-4844-83aa-70296bc72a55 for instance 63d2bd74-d060-4925-9323-b39d5131f958 on n-h1-850468-14 Aug 10 23:03:07.006918 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-5a3fd10c-a2d4-45c3-a31b-7afd24ddcdd0 req-20327b49-d93a-4060-99d8-596ea19dbf99 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080792 Aug 10 23:03:07.008710 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 854/1677] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:03:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:03:07.015561 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-1546e679-125d-4ba4-aaa6-caf4bca433d3 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:07.016812 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-1546e679-125d-4ba4-aaa6-caf4bca433d3 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] [instance: 3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:07.024323 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1546e679-125d-4ba4-aaa6-caf4bca433d3 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:07.025232 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1546e679-125d-4ba4-aaa6-caf4bca433d3 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:07.025986 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1546e679-125d-4ba4-aaa6-caf4bca433d3 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:07.027250 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1546e679-125d-4ba4-aaa6-caf4bca433d3 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:07.027987 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1546e679-125d-4ba4-aaa6-caf4bca433d3 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:07.028767 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1546e679-125d-4ba4-aaa6-caf4bca433d3 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:07.218992 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-0ca562b2-1f5a-423f-beaa-af791173e67e tempest-SecurityGroupRulesTestJSON-678387735 tempest-SecurityGroupRulesTestJSON-678387735-project] 10.222.0.58 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 1.731126 Aug 10 23:03:07.219598 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 824/1678] 10.222.0.58 () {60 vars in 1180 bytes} [Wed Aug 10 23:03:05 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 1734 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:03:07.231912 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-a99a9f43-63ce-4ced-b109-c36059d63a45 req-5fd3562e-a8de-48fa-aa64-bf7e004304ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67accb8d-3e90-483c-a1e5-9a0c04a685c8", "tag": "b9a81f82-f5d3-48ec-8420-23fe4897a6b8"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:03:07.253375 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-a99a9f43-63ce-4ced-b109-c36059d63a45 req-5fd3562e-a8de-48fa-aa64-bf7e004304ff service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:07.253862 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-a99a9f43-63ce-4ced-b109-c36059d63a45 req-5fd3562e-a8de-48fa-aa64-bf7e004304ff service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:07.254299 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-a99a9f43-63ce-4ced-b109-c36059d63a45 req-5fd3562e-a8de-48fa-aa64-bf7e004304ff service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:07.283364 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-a99a9f43-63ce-4ced-b109-c36059d63a45 req-5fd3562e-a8de-48fa-aa64-bf7e004304ff service nova] Creating event network-changed:b9a81f82-f5d3-48ec-8420-23fe4897a6b8 for instance 67accb8d-3e90-483c-a1e5-9a0c04a685c8 on n-h1-850468-14 Aug 10 23:03:07.288935 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-a99a9f43-63ce-4ced-b109-c36059d63a45 req-5fd3562e-a8de-48fa-aa64-bf7e004304ff service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068176 Aug 10 23:03:07.291500 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 825/1679] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:03:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:03:07.297689 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-4095f230-791b-4f40-b8b2-7de6121f5694 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:07.298840 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-4095f230-791b-4f40-b8b2-7de6121f5694 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] [instance: 10ede6f4-625a-4c5a-a5d6-d7d0f2476dee] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:07.308926 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4095f230-791b-4f40-b8b2-7de6121f5694 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:07.313056 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4095f230-791b-4f40-b8b2-7de6121f5694 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:07.314021 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4095f230-791b-4f40-b8b2-7de6121f5694 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:07.315012 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4095f230-791b-4f40-b8b2-7de6121f5694 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:07.318329 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4095f230-791b-4f40-b8b2-7de6121f5694 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:07.319111 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4095f230-791b-4f40-b8b2-7de6121f5694 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:07.357306 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=100 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:03:07.549312 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-4095f230-791b-4f40-b8b2-7de6121f5694 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890735b21f5d4764aefd789f74e00222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9cf3129a4e4f56a17bebf68b7bc42b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:07.562303 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-4095f230-791b-4f40-b8b2-7de6121f5694 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] 10.222.0.58 "GET /compute/v2.1/servers/10ede6f4-625a-4c5a-a5d6-d7d0f2476dee" status: 200 len: 1281 microversion: 2.1 time: 0.269014 Aug 10 23:03:07.562849 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 826/1680] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:03:07 2022] GET /compute/v2.1/servers/10ede6f4-625a-4c5a-a5d6-d7d0f2476dee => generated 1281 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:03:07.580448 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-b7390d23-0d81-4ea6-9be0-f0a7925e5fc1 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:07.587637 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-b7390d23-0d81-4ea6-9be0-f0a7925e5fc1 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] [instance: 2636ab6a-a1c8-4b70-a18f-afe073dd31db] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:07.605826 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b7390d23-0d81-4ea6-9be0-f0a7925e5fc1 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:07.606594 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b7390d23-0d81-4ea6-9be0-f0a7925e5fc1 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:07.607531 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b7390d23-0d81-4ea6-9be0-f0a7925e5fc1 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:07.610351 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b7390d23-0d81-4ea6-9be0-f0a7925e5fc1 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:07.615516 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b7390d23-0d81-4ea6-9be0-f0a7925e5fc1 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:07.616186 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b7390d23-0d81-4ea6-9be0-f0a7925e5fc1 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:07.651890 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-1546e679-125d-4ba4-aaa6-caf4bca433d3 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:07.669851 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-1546e679-125d-4ba4-aaa6-caf4bca433d3 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:07.683112 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-1546e679-125d-4ba4-aaa6-caf4bca433d3 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:07.684231 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-b7390d23-0d81-4ea6-9be0-f0a7925e5fc1 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] [instance: 2636ab6a-a1c8-4b70-a18f-afe073dd31db] Going to try to terminate instance {{(pid=122632) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:03:07.690243 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-1546e679-125d-4ba4-aaa6-caf4bca433d3 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] 10.222.0.58 "GET /compute/v2.1/servers/3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51" status: 200 len: 1476 microversion: 2.25 time: 0.677692 Aug 10 23:03:07.693978 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 855/1681] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:03:07 2022] GET /compute/v2.1/servers/3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51 => generated 1476 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:03:07.706121 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-d9672179-fbd2-4d3d-85d3-5f53404065de tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:07.706957 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-d9672179-fbd2-4d3d-85d3-5f53404065de tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] [instance: 63d2bd74-d060-4925-9323-b39d5131f958] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:07.722478 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=12,nova_api:UPDATE=1 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:03:07.728637 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d9672179-fbd2-4d3d-85d3-5f53404065de tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:07.733052 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d9672179-fbd2-4d3d-85d3-5f53404065de tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:07.733950 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d9672179-fbd2-4d3d-85d3-5f53404065de tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:07.734973 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d9672179-fbd2-4d3d-85d3-5f53404065de tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:07.737702 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d9672179-fbd2-4d3d-85d3-5f53404065de tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:07.738449 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d9672179-fbd2-4d3d-85d3-5f53404065de tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:07.846184 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-b7390d23-0d81-4ea6-9be0-f0a7925e5fc1 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] 10.222.0.58 "DELETE /compute/v2.1/servers/2636ab6a-a1c8-4b70-a18f-afe073dd31db" status: 204 len: 0 microversion: 2.1 time: 0.275242 Aug 10 23:03:07.848442 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 827/1682] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:03:07 2022] DELETE /compute/v2.1/servers/2636ab6a-a1c8-4b70-a18f-afe073dd31db => generated 0 bytes in 280 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:03:07.868572 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-e8663e27-0806-4439-a86e-f87f4051eb0f tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:07.869420 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-e8663e27-0806-4439-a86e-f87f4051eb0f tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] [instance: 67accb8d-3e90-483c-a1e5-9a0c04a685c8] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:07.884822 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e8663e27-0806-4439-a86e-f87f4051eb0f tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:07.885560 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e8663e27-0806-4439-a86e-f87f4051eb0f tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:07.887317 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e8663e27-0806-4439-a86e-f87f4051eb0f tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:07.888214 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e8663e27-0806-4439-a86e-f87f4051eb0f tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:07.888836 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e8663e27-0806-4439-a86e-f87f4051eb0f tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:07.889576 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e8663e27-0806-4439-a86e-f87f4051eb0f tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:08.110941 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-d9672179-fbd2-4d3d-85d3-5f53404065de tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632904331d024d9b8e4d3660dff2cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ed0bdee3aa4013bd9219069bda558c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:08.125637 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-d9672179-fbd2-4d3d-85d3-5f53404065de tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] 10.222.0.58 "GET /compute/v2.1/servers/63d2bd74-d060-4925-9323-b39d5131f958" status: 200 len: 1211 microversion: 2.1 time: 0.427582 Aug 10 23:03:08.149180 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 856/1683] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:03:07 2022] GET /compute/v2.1/servers/63d2bd74-d060-4925-9323-b39d5131f958 => generated 1211 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:03:08.154320 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-05fc03c2-6626-4f14-b1bb-08d9a7458676 tempest-SecurityGroupRulesTestJSON-678387735 tempest-SecurityGroupRulesTestJSON-678387735-project] Action: 'create', calling method: .version_select at 0x7f847d2959d0>, body: {"security_group_rule": {"parent_group_id": "f37e34f8-15d6-4eb4-8a30-46f1f7543fdf", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:03:08.477889 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-e8663e27-0806-4439-a86e-f87f4051eb0f tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfd6d8e6a8444f5b9fcf1cf8da242ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707f869910b34768ae1a348cd0b5f284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:08.488599 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-e8663e27-0806-4439-a86e-f87f4051eb0f tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] 10.222.0.58 "GET /compute/v2.1/servers/67accb8d-3e90-483c-a1e5-9a0c04a685c8" status: 200 len: 1315 microversion: 2.1 time: 0.638884 Aug 10 23:03:08.491620 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 828/1684] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:03:07 2022] GET /compute/v2.1/servers/67accb8d-3e90-483c-a1e5-9a0c04a685c8 => generated 1315 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:03:08.500569 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-f773b7c7-aa71-4acf-9998-b6061d5a65a6 tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Calling method '.version_select at 0x7f847dd500d0>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:08.505239 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f773b7c7-aa71-4acf-9998-b6061d5a65a6 tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:08.506102 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f773b7c7-aa71-4acf-9998-b6061d5a65a6 tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:08.515667 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f773b7c7-aa71-4acf-9998-b6061d5a65a6 tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:08.548308 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-f773b7c7-aa71-4acf-9998-b6061d5a65a6 tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] 10.222.0.58 "GET /compute/v2.1/os-migrations" status: 200 len: 3232 microversion: 2.25 time: 0.054045 Aug 10 23:03:08.551762 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 829/1685] 10.222.0.58 () {60 vars in 1184 bytes} [Wed Aug 10 23:03:08 2022] GET /compute/v2.1/os-migrations => generated 3232 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:03:08.558548 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-98eb1866-ae17-4b13-bc52-3aae81a66579 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:08.560179 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-98eb1866-ae17-4b13-bc52-3aae81a66579 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] [instance: 2636ab6a-a1c8-4b70-a18f-afe073dd31db] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:08.585263 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-98eb1866-ae17-4b13-bc52-3aae81a66579 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:08.585776 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-98eb1866-ae17-4b13-bc52-3aae81a66579 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:08.586265 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-98eb1866-ae17-4b13-bc52-3aae81a66579 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:08.589109 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-98eb1866-ae17-4b13-bc52-3aae81a66579 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:08.589630 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-98eb1866-ae17-4b13-bc52-3aae81a66579 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:08.590075 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-98eb1866-ae17-4b13-bc52-3aae81a66579 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:08.619285 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-05fc03c2-6626-4f14-b1bb-08d9a7458676 tempest-SecurityGroupRulesTestJSON-678387735 tempest-SecurityGroupRulesTestJSON-678387735-project] 10.222.0.58 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.468167 Aug 10 23:03:08.621435 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 857/1686] 10.222.0.58 () {60 vars in 1195 bytes} [Wed Aug 10 23:03:08 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:03:08.638059 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-4f9a4b09-f237-48cb-8e99-a5c57c2835fb tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:08.640190 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-4f9a4b09-f237-48cb-8e99-a5c57c2835fb tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] [instance: 8fa0b7c8-ae4b-413c-9592-f4944cfb22fc] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:08.659710 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4f9a4b09-f237-48cb-8e99-a5c57c2835fb tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:08.661534 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4f9a4b09-f237-48cb-8e99-a5c57c2835fb tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:08.662394 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4f9a4b09-f237-48cb-8e99-a5c57c2835fb tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:08.665073 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4f9a4b09-f237-48cb-8e99-a5c57c2835fb tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:08.666080 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4f9a4b09-f237-48cb-8e99-a5c57c2835fb tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:08.666732 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4f9a4b09-f237-48cb-8e99-a5c57c2835fb tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:09.159460 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-98eb1866-ae17-4b13-bc52-3aae81a66579 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '417d4eaaeb1c4df78745496ececb3e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27e6ee9495a438b8450a4ef0d62cbcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:09.170548 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-98eb1866-ae17-4b13-bc52-3aae81a66579 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] 10.222.0.58 "GET /compute/v2.1/servers/2636ab6a-a1c8-4b70-a18f-afe073dd31db" status: 200 len: 1473 microversion: 2.1 time: 0.616952 Aug 10 23:03:09.171345 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 830/1687] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:03:08 2022] GET /compute/v2.1/servers/2636ab6a-a1c8-4b70-a18f-afe073dd31db => generated 1473 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:03:09.183865 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-d625ebfd-cdf4-4563-9ec7-bb2dacd7a60c tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:09.185068 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-d625ebfd-cdf4-4563-9ec7-bb2dacd7a60c tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] [instance: 3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:09.197837 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d625ebfd-cdf4-4563-9ec7-bb2dacd7a60c tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:09.203027 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d625ebfd-cdf4-4563-9ec7-bb2dacd7a60c tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:09.203675 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d625ebfd-cdf4-4563-9ec7-bb2dacd7a60c tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:09.204733 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d625ebfd-cdf4-4563-9ec7-bb2dacd7a60c tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:09.205366 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d625ebfd-cdf4-4563-9ec7-bb2dacd7a60c tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:09.205972 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d625ebfd-cdf4-4563-9ec7-bb2dacd7a60c tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:09.301600 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-4f9a4b09-f237-48cb-8e99-a5c57c2835fb tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be22a1243524178bdfea6892f27b255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f0030d3c62f48e6acd142058158e11e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:09.313442 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-4f9a4b09-f237-48cb-8e99-a5c57c2835fb tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] 10.222.0.58 "GET /compute/v2.1/servers/8fa0b7c8-ae4b-413c-9592-f4944cfb22fc" status: 200 len: 1322 microversion: 2.1 time: 0.688781 Aug 10 23:03:09.314396 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 858/1688] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:03:08 2022] GET /compute/v2.1/servers/8fa0b7c8-ae4b-413c-9592-f4944cfb22fc => generated 1322 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:03:09.335026 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-0d5ab43b-28d9-478d-bf11-5c4637cfc7af tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:09.335673 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-0d5ab43b-28d9-478d-bf11-5c4637cfc7af tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] [instance: 10ede6f4-625a-4c5a-a5d6-d7d0f2476dee] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:09.344292 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0d5ab43b-28d9-478d-bf11-5c4637cfc7af tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:09.344912 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0d5ab43b-28d9-478d-bf11-5c4637cfc7af tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:09.345290 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0d5ab43b-28d9-478d-bf11-5c4637cfc7af tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:09.346065 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0d5ab43b-28d9-478d-bf11-5c4637cfc7af tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:09.346568 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0d5ab43b-28d9-478d-bf11-5c4637cfc7af tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:09.347048 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0d5ab43b-28d9-478d-bf11-5c4637cfc7af tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:09.765092 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-0d5ab43b-28d9-478d-bf11-5c4637cfc7af tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890735b21f5d4764aefd789f74e00222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9cf3129a4e4f56a17bebf68b7bc42b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:09.783554 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-0d5ab43b-28d9-478d-bf11-5c4637cfc7af tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] 10.222.0.58 "GET /compute/v2.1/servers/10ede6f4-625a-4c5a-a5d6-d7d0f2476dee" status: 200 len: 1323 microversion: 2.1 time: 0.446034 Aug 10 23:03:09.784712 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 859/1689] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:03:09 2022] GET /compute/v2.1/servers/10ede6f4-625a-4c5a-a5d6-d7d0f2476dee => generated 1323 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:03:09.790212 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-410ae2ec-7777-4d5f-9966-abe09e9606cf tempest-SecurityGroupRulesTestJSON-678387735 tempest-SecurityGroupRulesTestJSON-678387735-project] Action: 'create', calling method: .version_select at 0x7f847d32c9d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-725756440", "description": "tempest-description-365384581"}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:03:09.855733 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.objects.instance [None req-d625ebfd-cdf4-4563-9ec7-bb2dacd7a60c tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] Lazy-loading 'services' on Instance uuid 3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51 {{(pid=122632) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:03:09.899784 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-d625ebfd-cdf4-4563-9ec7-bb2dacd7a60c tempest-LiveAutoBlockMigrationV225Test-811273074 tempest-LiveAutoBlockMigrationV225Test-811273074-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51" status: 200 len: 1970 microversion: 2.25 time: 0.722034 Aug 10 23:03:09.901275 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 831/1690] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:03:09 2022] GET /compute/v2.1/servers/3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51 => generated 1970 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:03:09.910181 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c7f80ae3-5978-4a4c-9512-c1d342a461e9 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:09.911460 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-c7f80ae3-5978-4a4c-9512-c1d342a461e9 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] [instance: 63d2bd74-d060-4925-9323-b39d5131f958] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:09.933378 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c7f80ae3-5978-4a4c-9512-c1d342a461e9 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:09.938645 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c7f80ae3-5978-4a4c-9512-c1d342a461e9 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:09.939343 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c7f80ae3-5978-4a4c-9512-c1d342a461e9 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:09.948076 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c7f80ae3-5978-4a4c-9512-c1d342a461e9 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:09.949138 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c7f80ae3-5978-4a4c-9512-c1d342a461e9 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:09.950374 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c7f80ae3-5978-4a4c-9512-c1d342a461e9 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:10.327808 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-410ae2ec-7777-4d5f-9966-abe09e9606cf tempest-SecurityGroupRulesTestJSON-678387735 tempest-SecurityGroupRulesTestJSON-678387735-project] 10.222.0.58 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.541857 Aug 10 23:03:10.329062 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 860/1691] 10.222.0.58 () {60 vars in 1180 bytes} [Wed Aug 10 23:03:09 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:03:10.344345 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-4921b2aa-ecd1-4f73-9459-93b0e00b6993 req-79ee1cac-8f13-4db7-81c4-61504f5abdfb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1fcd0cf8-e654-4e2a-bf05-d5d3c47bd200", "name": "network-vif-deleted", "tag": "578f05e6-523e-4412-be47-9c7a2d430921"}, {"name": "network-changed", "server_uuid": "8fa0b7c8-ae4b-413c-9592-f4944cfb22fc", "tag": "eef1b5f8-6d51-406e-a11e-bdd5e6c015ed"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:03:10.370168 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-4921b2aa-ecd1-4f73-9459-93b0e00b6993 req-79ee1cac-8f13-4db7-81c4-61504f5abdfb service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:10.370934 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-4921b2aa-ecd1-4f73-9459-93b0e00b6993 req-79ee1cac-8f13-4db7-81c4-61504f5abdfb service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:10.375520 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-4921b2aa-ecd1-4f73-9459-93b0e00b6993 req-79ee1cac-8f13-4db7-81c4-61504f5abdfb service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:10.413128 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-4921b2aa-ecd1-4f73-9459-93b0e00b6993 req-79ee1cac-8f13-4db7-81c4-61504f5abdfb service nova] Creating event network-vif-deleted:578f05e6-523e-4412-be47-9c7a2d430921 for instance 1fcd0cf8-e654-4e2a-bf05-d5d3c47bd200 on n-h1-850468-14 Aug 10 23:03:10.413656 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-4921b2aa-ecd1-4f73-9459-93b0e00b6993 req-79ee1cac-8f13-4db7-81c4-61504f5abdfb service nova] Creating event network-changed:eef1b5f8-6d51-406e-a11e-bdd5e6c015ed for instance 8fa0b7c8-ae4b-413c-9592-f4944cfb22fc on n-h2-850468-14 Aug 10 23:03:10.414681 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-c7f80ae3-5978-4a4c-9512-c1d342a461e9 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632904331d024d9b8e4d3660dff2cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ed0bdee3aa4013bd9219069bda558c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:10.435855 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-4921b2aa-ecd1-4f73-9459-93b0e00b6993 req-79ee1cac-8f13-4db7-81c4-61504f5abdfb service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.103309 Aug 10 23:03:10.437823 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 861/1692] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:03:10 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:03:10.454957 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-6817f192-be9b-44e0-8c95-06b6e53bd37d tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:10.457496 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-6817f192-be9b-44e0-8c95-06b6e53bd37d tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] [instance: 67accb8d-3e90-483c-a1e5-9a0c04a685c8] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:10.468582 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-c7f80ae3-5978-4a4c-9512-c1d342a461e9 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] 10.222.0.58 "GET /compute/v2.1/servers/63d2bd74-d060-4925-9323-b39d5131f958" status: 200 len: 1211 microversion: 2.1 time: 0.561703 Aug 10 23:03:10.474886 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6817f192-be9b-44e0-8c95-06b6e53bd37d tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:10.475656 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6817f192-be9b-44e0-8c95-06b6e53bd37d tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:10.476816 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 832/1693] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:03:09 2022] GET /compute/v2.1/servers/63d2bd74-d060-4925-9323-b39d5131f958 => generated 1211 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:03:10.477036 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6817f192-be9b-44e0-8c95-06b6e53bd37d tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:10.478168 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6817f192-be9b-44e0-8c95-06b6e53bd37d tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:10.478889 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6817f192-be9b-44e0-8c95-06b6e53bd37d tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:10.479528 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6817f192-be9b-44e0-8c95-06b6e53bd37d tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:10.504413 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-b554e04e-8903-457b-9917-afe5962bffef tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:10.507161 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-b554e04e-8903-457b-9917-afe5962bffef tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] [instance: 3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:10.515779 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_api:UPDATE=8,nova_api:SELECT=85,nova_api:INSERT=3 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:03:10.541823 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b554e04e-8903-457b-9917-afe5962bffef tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:10.542328 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b554e04e-8903-457b-9917-afe5962bffef tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:10.542773 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b554e04e-8903-457b-9917-afe5962bffef tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:10.552375 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b554e04e-8903-457b-9917-afe5962bffef tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:10.553331 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b554e04e-8903-457b-9917-afe5962bffef tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:10.554214 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b554e04e-8903-457b-9917-afe5962bffef tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:10.593086 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=1 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:03:10.622698 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-b554e04e-8903-457b-9917-afe5962bffef tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] [instance: 3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51] Going to try to terminate instance {{(pid=122632) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:03:10.778155 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-6817f192-be9b-44e0-8c95-06b6e53bd37d tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfd6d8e6a8444f5b9fcf1cf8da242ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707f869910b34768ae1a348cd0b5f284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:10.788292 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-6817f192-be9b-44e0-8c95-06b6e53bd37d tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] 10.222.0.58 "GET /compute/v2.1/servers/67accb8d-3e90-483c-a1e5-9a0c04a685c8" status: 200 len: 1315 microversion: 2.1 time: 0.346926 Aug 10 23:03:10.790580 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 862/1694] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:03:10 2022] GET /compute/v2.1/servers/67accb8d-3e90-483c-a1e5-9a0c04a685c8 => generated 1315 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:03:10.795677 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-b554e04e-8903-457b-9917-afe5962bffef tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] 10.222.0.58 "DELETE /compute/v2.1/servers/3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51" status: 204 len: 0 microversion: 2.25 time: 0.310852 Aug 10 23:03:10.799183 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 833/1695] 10.222.0.58 () {60 vars in 1280 bytes} [Wed Aug 10 23:03:10 2022] DELETE /compute/v2.1/servers/3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 10 23:03:10.803869 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-8c5c2a5a-d51e-4403-8314-70bb78ff841b tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:10.806193 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-8c5c2a5a-d51e-4403-8314-70bb78ff841b tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] [instance: 2636ab6a-a1c8-4b70-a18f-afe073dd31db] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:10.811872 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-9a5b8673-78d4-4c52-96b7-da26cf43d7bc tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:10.814807 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-9a5b8673-78d4-4c52-96b7-da26cf43d7bc tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] [instance: 8fa0b7c8-ae4b-413c-9592-f4944cfb22fc] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:10.822550 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8c5c2a5a-d51e-4403-8314-70bb78ff841b tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:10.825070 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8c5c2a5a-d51e-4403-8314-70bb78ff841b tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:10.826962 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8c5c2a5a-d51e-4403-8314-70bb78ff841b tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:10.827427 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9a5b8673-78d4-4c52-96b7-da26cf43d7bc tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:10.828008 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9a5b8673-78d4-4c52-96b7-da26cf43d7bc tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:10.828542 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9a5b8673-78d4-4c52-96b7-da26cf43d7bc tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:10.828993 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8c5c2a5a-d51e-4403-8314-70bb78ff841b tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:10.829509 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9a5b8673-78d4-4c52-96b7-da26cf43d7bc tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:10.829969 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8c5c2a5a-d51e-4403-8314-70bb78ff841b tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:10.830136 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9a5b8673-78d4-4c52-96b7-da26cf43d7bc tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:10.830659 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9a5b8673-78d4-4c52-96b7-da26cf43d7bc tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:10.831075 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8c5c2a5a-d51e-4403-8314-70bb78ff841b tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:11.217449 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-8c5c2a5a-d51e-4403-8314-70bb78ff841b tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '417d4eaaeb1c4df78745496ececb3e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27e6ee9495a438b8450a4ef0d62cbcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:11.260499 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-8c5c2a5a-d51e-4403-8314-70bb78ff841b tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] 10.222.0.58 "GET /compute/v2.1/servers/2636ab6a-a1c8-4b70-a18f-afe073dd31db" status: 200 len: 1473 microversion: 2.1 time: 0.467915 Aug 10 23:03:11.261590 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 863/1696] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:03:10 2022] GET /compute/v2.1/servers/2636ab6a-a1c8-4b70-a18f-afe073dd31db => generated 1473 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:03:11.279330 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-eb8c7806-da7d-4dfb-8413-86f6a577dbfc tempest-SecurityGroupRulesTestJSON-678387735 tempest-SecurityGroupRulesTestJSON-678387735-project] Action: 'create', calling method: .version_select at 0x7f847cf21310>, body: {"security_group_rule": {"parent_group_id": "89b73eae-14e6-48a2-8106-5b6c3f2d9a94", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:03:11.414492 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-9a5b8673-78d4-4c52-96b7-da26cf43d7bc tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be22a1243524178bdfea6892f27b255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f0030d3c62f48e6acd142058158e11e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:11.430867 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-9a5b8673-78d4-4c52-96b7-da26cf43d7bc tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] 10.222.0.58 "GET /compute/v2.1/servers/8fa0b7c8-ae4b-413c-9592-f4944cfb22fc" status: 200 len: 1322 microversion: 2.1 time: 0.629674 Aug 10 23:03:11.432683 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 834/1697] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:03:10 2022] GET /compute/v2.1/servers/8fa0b7c8-ae4b-413c-9592-f4944cfb22fc => generated 1322 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:03:11.437610 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-67266bca-6340-4346-a4b4-baff4fc73076 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:11.438443 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-67266bca-6340-4346-a4b4-baff4fc73076 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] [instance: 10ede6f4-625a-4c5a-a5d6-d7d0f2476dee] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:11.447484 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-67266bca-6340-4346-a4b4-baff4fc73076 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:11.448267 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-67266bca-6340-4346-a4b4-baff4fc73076 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:11.448877 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-67266bca-6340-4346-a4b4-baff4fc73076 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:11.449773 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-67266bca-6340-4346-a4b4-baff4fc73076 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:11.450232 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-67266bca-6340-4346-a4b4-baff4fc73076 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:11.450657 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-67266bca-6340-4346-a4b4-baff4fc73076 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:12.028367 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-67266bca-6340-4346-a4b4-baff4fc73076 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890735b21f5d4764aefd789f74e00222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9cf3129a4e4f56a17bebf68b7bc42b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:12.045109 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-67266bca-6340-4346-a4b4-baff4fc73076 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] 10.222.0.58 "GET /compute/v2.1/servers/10ede6f4-625a-4c5a-a5d6-d7d0f2476dee" status: 200 len: 1323 microversion: 2.1 time: 0.611047 Aug 10 23:03:12.046184 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 835/1698] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:03:11 2022] GET /compute/v2.1/servers/10ede6f4-625a-4c5a-a5d6-d7d0f2476dee => generated 1323 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:03:12.051706 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-d0a9e906-5659-4023-aa50-c16b011a7db0 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:12.055207 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-d0a9e906-5659-4023-aa50-c16b011a7db0 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] [instance: 3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:12.066230 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d0a9e906-5659-4023-aa50-c16b011a7db0 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:12.067025 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d0a9e906-5659-4023-aa50-c16b011a7db0 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:12.067650 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d0a9e906-5659-4023-aa50-c16b011a7db0 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:12.068585 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d0a9e906-5659-4023-aa50-c16b011a7db0 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:12.069280 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d0a9e906-5659-4023-aa50-c16b011a7db0 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:12.069882 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d0a9e906-5659-4023-aa50-c16b011a7db0 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:12.126846 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-eb8c7806-da7d-4dfb-8413-86f6a577dbfc tempest-SecurityGroupRulesTestJSON-678387735 tempest-SecurityGroupRulesTestJSON-678387735-project] 10.222.0.58 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 0.859852 Aug 10 23:03:12.128648 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 864/1699] 10.222.0.58 () {60 vars in 1195 bytes} [Wed Aug 10 23:03:11 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:03:12.135651 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-e24c69ff-701d-471d-875d-b347691be137 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:12.136821 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-e24c69ff-701d-471d-875d-b347691be137 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] [instance: 63d2bd74-d060-4925-9323-b39d5131f958] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:12.143125 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=8 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:03:12.145027 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e24c69ff-701d-471d-875d-b347691be137 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:12.146317 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e24c69ff-701d-471d-875d-b347691be137 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:12.147105 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e24c69ff-701d-471d-875d-b347691be137 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:12.149696 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e24c69ff-701d-471d-875d-b347691be137 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:12.150416 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e24c69ff-701d-471d-875d-b347691be137 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:12.151286 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e24c69ff-701d-471d-875d-b347691be137 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:12.639156 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-d0a9e906-5659-4023-aa50-c16b011a7db0 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:12.652526 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-d0a9e906-5659-4023-aa50-c16b011a7db0 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:12.654174 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-d0a9e906-5659-4023-aa50-c16b011a7db0 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:12.657701 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-d0a9e906-5659-4023-aa50-c16b011a7db0 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] 10.222.0.58 "GET /compute/v2.1/servers/3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51" status: 200 len: 1482 microversion: 2.25 time: 0.610085 Aug 10 23:03:12.660617 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 836/1700] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:03:12 2022] GET /compute/v2.1/servers/3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51 => generated 1482 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:03:12.675013 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-a08c88d7-3eef-485a-8e14-e590e8927ccd tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:12.675954 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-a08c88d7-3eef-485a-8e14-e590e8927ccd tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] [instance: 67accb8d-3e90-483c-a1e5-9a0c04a685c8] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:12.689086 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a08c88d7-3eef-485a-8e14-e590e8927ccd tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:12.690027 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a08c88d7-3eef-485a-8e14-e590e8927ccd tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:12.690713 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a08c88d7-3eef-485a-8e14-e590e8927ccd tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:12.697614 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a08c88d7-3eef-485a-8e14-e590e8927ccd tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:12.698772 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a08c88d7-3eef-485a-8e14-e590e8927ccd tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:12.699716 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a08c88d7-3eef-485a-8e14-e590e8927ccd tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:13.032949 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-e24c69ff-701d-471d-875d-b347691be137 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632904331d024d9b8e4d3660dff2cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ed0bdee3aa4013bd9219069bda558c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:13.041067 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-e24c69ff-701d-471d-875d-b347691be137 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] 10.222.0.58 "GET /compute/v2.1/servers/63d2bd74-d060-4925-9323-b39d5131f958" status: 200 len: 1199 microversion: 2.1 time: 0.911174 Aug 10 23:03:13.042023 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 865/1701] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:03:12 2022] GET /compute/v2.1/servers/63d2bd74-d060-4925-9323-b39d5131f958 => generated 1199 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:03:13.047261 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-d78d0117-7626-4808-a0fb-c7cbf8972bc1 req-0f3d1d8c-e8a2-4322-9043-e97dd9224288 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17b32f05-1f0e-473f-bfda-fab92a90b04f", "tag": "4dabccdf-cbe5-4d0c-8550-14b485c16ce4"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:03:13.061133 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-d78d0117-7626-4808-a0fb-c7cbf8972bc1 req-0f3d1d8c-e8a2-4322-9043-e97dd9224288 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:13.061981 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-d78d0117-7626-4808-a0fb-c7cbf8972bc1 req-0f3d1d8c-e8a2-4322-9043-e97dd9224288 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:13.062576 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-d78d0117-7626-4808-a0fb-c7cbf8972bc1 req-0f3d1d8c-e8a2-4322-9043-e97dd9224288 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:13.089116 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-d78d0117-7626-4808-a0fb-c7cbf8972bc1 req-0f3d1d8c-e8a2-4322-9043-e97dd9224288 service nova] Creating event network-changed:4dabccdf-cbe5-4d0c-8550-14b485c16ce4 for instance 17b32f05-1f0e-473f-bfda-fab92a90b04f on n-h2-850468-14 Aug 10 23:03:13.099390 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-d78d0117-7626-4808-a0fb-c7cbf8972bc1 req-0f3d1d8c-e8a2-4322-9043-e97dd9224288 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055604 Aug 10 23:03:13.100651 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 866/1702] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:03:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:03:13.107170 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-12161834-d394-4329-8969-962fd803780f tempest-SecurityGroupRulesTestJSON-678387735 tempest-SecurityGroupRulesTestJSON-678387735-project] Action: 'create', calling method: .version_select at 0x7f847d254ee0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-740846827", "description": "tempest-description-558633819"}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:03:13.371130 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-a08c88d7-3eef-485a-8e14-e590e8927ccd tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfd6d8e6a8444f5b9fcf1cf8da242ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707f869910b34768ae1a348cd0b5f284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:13.397060 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-a08c88d7-3eef-485a-8e14-e590e8927ccd tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] 10.222.0.58 "GET /compute/v2.1/servers/67accb8d-3e90-483c-a1e5-9a0c04a685c8" status: 200 len: 1315 microversion: 2.1 time: 0.734898 Aug 10 23:03:13.398727 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 837/1703] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:03:12 2022] GET /compute/v2.1/servers/67accb8d-3e90-483c-a1e5-9a0c04a685c8 => generated 1315 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:03:13.409205 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-a0dc8f3e-a80c-4ae8-a64b-089a55966e10 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:13.410358 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-a0dc8f3e-a80c-4ae8-a64b-089a55966e10 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] [instance: 2636ab6a-a1c8-4b70-a18f-afe073dd31db] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:13.419085 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a0dc8f3e-a80c-4ae8-a64b-089a55966e10 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:13.420466 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a0dc8f3e-a80c-4ae8-a64b-089a55966e10 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:13.421093 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a0dc8f3e-a80c-4ae8-a64b-089a55966e10 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:13.422436 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a0dc8f3e-a80c-4ae8-a64b-089a55966e10 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:13.423153 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a0dc8f3e-a80c-4ae8-a64b-089a55966e10 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:13.423853 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a0dc8f3e-a80c-4ae8-a64b-089a55966e10 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:13.489477 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a0dc8f3e-a80c-4ae8-a64b-089a55966e10 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:13.490602 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a0dc8f3e-a80c-4ae8-a64b-089a55966e10 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:13.491655 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a0dc8f3e-a80c-4ae8-a64b-089a55966e10 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:13.494419 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.objects.instance [None req-a0dc8f3e-a80c-4ae8-a64b-089a55966e10 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lazy-loading 'fault' on Instance uuid 2636ab6a-a1c8-4b70-a18f-afe073dd31db {{(pid=122632) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:03:13.619756 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-a0dc8f3e-a80c-4ae8-a64b-089a55966e10 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '417d4eaaeb1c4df78745496ececb3e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27e6ee9495a438b8450a4ef0d62cbcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:13.646758 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-12161834-d394-4329-8969-962fd803780f tempest-SecurityGroupRulesTestJSON-678387735 tempest-SecurityGroupRulesTestJSON-678387735-project] 10.222.0.58 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.544091 Aug 10 23:03:13.647598 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 867/1704] 10.222.0.58 () {60 vars in 1180 bytes} [Wed Aug 10 23:03:13 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:03:13.653200 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-a0dc8f3e-a80c-4ae8-a64b-089a55966e10 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] 10.222.0.58 "GET /compute/v2.1/servers/2636ab6a-a1c8-4b70-a18f-afe073dd31db" status: 200 len: 1307 microversion: 2.1 time: 0.253025 Aug 10 23:03:13.654604 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 838/1705] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:03:13 2022] GET /compute/v2.1/servers/2636ab6a-a1c8-4b70-a18f-afe073dd31db => generated 1307 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:03:13.658287 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-6f20a65e-c023-488c-bc81-28723620547c tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:13.662241 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-6f20a65e-c023-488c-bc81-28723620547c tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] [instance: 8fa0b7c8-ae4b-413c-9592-f4944cfb22fc] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:13.687807 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-72c48038-7643-4989-906d-dc7b9a43acc8 req-da64db65-c73c-45c0-b77b-a5c509a2e188 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6bf5e469-d129-4daa-93f8-36661ec153a2", "tag": "d6e8df11-a924-4886-8d4e-e5c76996d805"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:03:13.704369 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6f20a65e-c023-488c-bc81-28723620547c tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:13.705205 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6f20a65e-c023-488c-bc81-28723620547c tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:13.708905 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6f20a65e-c023-488c-bc81-28723620547c tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:13.719971 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6f20a65e-c023-488c-bc81-28723620547c tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:13.721419 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6f20a65e-c023-488c-bc81-28723620547c tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:13.724267 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6f20a65e-c023-488c-bc81-28723620547c tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:13.781021 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-72c48038-7643-4989-906d-dc7b9a43acc8 req-da64db65-c73c-45c0-b77b-a5c509a2e188 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:13.781510 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-72c48038-7643-4989-906d-dc7b9a43acc8 req-da64db65-c73c-45c0-b77b-a5c509a2e188 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:13.781948 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-72c48038-7643-4989-906d-dc7b9a43acc8 req-da64db65-c73c-45c0-b77b-a5c509a2e188 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:13.829109 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-72c48038-7643-4989-906d-dc7b9a43acc8 req-da64db65-c73c-45c0-b77b-a5c509a2e188 service nova] Creating event network-changed:d6e8df11-a924-4886-8d4e-e5c76996d805 for instance 6bf5e469-d129-4daa-93f8-36661ec153a2 on n-h1-850468-14 Aug 10 23:03:13.849547 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-72c48038-7643-4989-906d-dc7b9a43acc8 req-da64db65-c73c-45c0-b77b-a5c509a2e188 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.177701 Aug 10 23:03:13.854221 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 839/1706] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:03:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:03:13.864535 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-07fe9ddb-f870-40ff-a0b9-818fecea630c tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:13.865246 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-07fe9ddb-f870-40ff-a0b9-818fecea630c tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] [instance: 10ede6f4-625a-4c5a-a5d6-d7d0f2476dee] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:13.880510 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-07fe9ddb-f870-40ff-a0b9-818fecea630c tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:13.881001 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-07fe9ddb-f870-40ff-a0b9-818fecea630c tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:13.881427 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-07fe9ddb-f870-40ff-a0b9-818fecea630c tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:13.882151 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-07fe9ddb-f870-40ff-a0b9-818fecea630c tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:13.883202 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-07fe9ddb-f870-40ff-a0b9-818fecea630c tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:13.884378 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-07fe9ddb-f870-40ff-a0b9-818fecea630c tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:13.946684 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:03:14.188853 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-07fe9ddb-f870-40ff-a0b9-818fecea630c tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890735b21f5d4764aefd789f74e00222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9cf3129a4e4f56a17bebf68b7bc42b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:14.203333 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-6f20a65e-c023-488c-bc81-28723620547c tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be22a1243524178bdfea6892f27b255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f0030d3c62f48e6acd142058158e11e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:14.204610 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-07fe9ddb-f870-40ff-a0b9-818fecea630c tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] 10.222.0.58 "GET /compute/v2.1/servers/10ede6f4-625a-4c5a-a5d6-d7d0f2476dee" status: 200 len: 1323 microversion: 2.1 time: 0.349062 Aug 10 23:03:14.205570 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 840/1707] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:03:13 2022] GET /compute/v2.1/servers/10ede6f4-625a-4c5a-a5d6-d7d0f2476dee => generated 1323 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:03:14.226010 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-6f20a65e-c023-488c-bc81-28723620547c tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] 10.222.0.58 "GET /compute/v2.1/servers/8fa0b7c8-ae4b-413c-9592-f4944cfb22fc" status: 200 len: 1322 microversion: 2.1 time: 0.576195 Aug 10 23:03:14.226666 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 868/1708] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:03:13 2022] GET /compute/v2.1/servers/8fa0b7c8-ae4b-413c-9592-f4944cfb22fc => generated 1322 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:03:14.231614 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-2f1afe10-9774-4eac-b58f-d219c00a5409 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:14.232485 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-2f1afe10-9774-4eac-b58f-d219c00a5409 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] [instance: 3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:14.237903 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-e0e048cf-1862-4a11-8db6-9fa720d5bd62 tempest-SecurityGroupRulesTestJSON-678387735 tempest-SecurityGroupRulesTestJSON-678387735-project] Action: 'create', calling method: .version_select at 0x7f847d927dc0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-371174578", "description": "tempest-description-1651184780"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:03:14.239191 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2f1afe10-9774-4eac-b58f-d219c00a5409 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:14.239846 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2f1afe10-9774-4eac-b58f-d219c00a5409 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:14.240522 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2f1afe10-9774-4eac-b58f-d219c00a5409 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:14.241404 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2f1afe10-9774-4eac-b58f-d219c00a5409 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:14.241862 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2f1afe10-9774-4eac-b58f-d219c00a5409 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:14.242871 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2f1afe10-9774-4eac-b58f-d219c00a5409 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:14.323046 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-2f1afe10-9774-4eac-b58f-d219c00a5409 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:14.334594 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-2f1afe10-9774-4eac-b58f-d219c00a5409 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:14.337290 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-2f1afe10-9774-4eac-b58f-d219c00a5409 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:14.338674 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-2f1afe10-9774-4eac-b58f-d219c00a5409 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] 10.222.0.58 "GET /compute/v2.1/servers/3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51" status: 200 len: 1265 microversion: 2.25 time: 0.110795 Aug 10 23:03:14.341049 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 869/1709] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:03:14 2022] GET /compute/v2.1/servers/3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51 => generated 1265 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:03:14.359242 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-f6f12db0-d28c-42b3-8772-27c5a2bcd38c tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:14.359796 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-f6f12db0-d28c-42b3-8772-27c5a2bcd38c tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] [instance: 63d2bd74-d060-4925-9323-b39d5131f958] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:14.376632 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f6f12db0-d28c-42b3-8772-27c5a2bcd38c tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:14.377094 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f6f12db0-d28c-42b3-8772-27c5a2bcd38c tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:14.384442 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f6f12db0-d28c-42b3-8772-27c5a2bcd38c tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:14.385421 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f6f12db0-d28c-42b3-8772-27c5a2bcd38c tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:14.386100 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f6f12db0-d28c-42b3-8772-27c5a2bcd38c tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:14.386709 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f6f12db0-d28c-42b3-8772-27c5a2bcd38c tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:14.514546 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-e0e048cf-1862-4a11-8db6-9fa720d5bd62 tempest-SecurityGroupRulesTestJSON-678387735 tempest-SecurityGroupRulesTestJSON-678387735-project] 10.222.0.58 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.292873 Aug 10 23:03:14.515133 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 841/1710] 10.222.0.58 () {60 vars in 1180 bytes} [Wed Aug 10 23:03:14 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:03:14.520675 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-92fdbb1a-ef92-4ea6-a599-715473a695c9 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:14.521296 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-92fdbb1a-ef92-4ea6-a599-715473a695c9 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] [instance: 67accb8d-3e90-483c-a1e5-9a0c04a685c8] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:14.531390 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-92fdbb1a-ef92-4ea6-a599-715473a695c9 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:14.531896 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-92fdbb1a-ef92-4ea6-a599-715473a695c9 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:14.532354 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-92fdbb1a-ef92-4ea6-a599-715473a695c9 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:14.533071 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-92fdbb1a-ef92-4ea6-a599-715473a695c9 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:14.533517 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-92fdbb1a-ef92-4ea6-a599-715473a695c9 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:14.534122 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-92fdbb1a-ef92-4ea6-a599-715473a695c9 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:14.705758 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-f6f12db0-d28c-42b3-8772-27c5a2bcd38c tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632904331d024d9b8e4d3660dff2cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ed0bdee3aa4013bd9219069bda558c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:14.714911 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-f6f12db0-d28c-42b3-8772-27c5a2bcd38c tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] 10.222.0.58 "GET /compute/v2.1/servers/63d2bd74-d060-4925-9323-b39d5131f958" status: 200 len: 1199 microversion: 2.1 time: 0.364492 Aug 10 23:03:14.715893 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 870/1711] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:03:14 2022] GET /compute/v2.1/servers/63d2bd74-d060-4925-9323-b39d5131f958 => generated 1199 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:03:14.720789 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-8d6965e7-c526-41bb-82d6-9f01c50b260c tempest-SecurityGroupRulesTestJSON-678387735 tempest-SecurityGroupRulesTestJSON-678387735-project] Action: 'create', calling method: .version_select at 0x7f847d4351f0>, body: {"security_group_rule": {"parent_group_id": "b2bc83f0-6566-457a-902a-a62d0121cb28", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "f4ce0ab5-f10b-496c-bd85-5e614deab1cb"}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:03:14.763845 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-92fdbb1a-ef92-4ea6-a599-715473a695c9 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfd6d8e6a8444f5b9fcf1cf8da242ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707f869910b34768ae1a348cd0b5f284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:14.772116 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-92fdbb1a-ef92-4ea6-a599-715473a695c9 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] 10.222.0.58 "GET /compute/v2.1/servers/67accb8d-3e90-483c-a1e5-9a0c04a685c8" status: 200 len: 1315 microversion: 2.1 time: 0.255898 Aug 10 23:03:14.773565 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 842/1712] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:03:14 2022] GET /compute/v2.1/servers/67accb8d-3e90-483c-a1e5-9a0c04a685c8 => generated 1315 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:03:14.779565 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-dfd9295e-477a-4f2d-9220-86c8dfcbd7c4 req-9ca0fd78-6620-43dc-b372-e277fb825c7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67accb8d-3e90-483c-a1e5-9a0c04a685c8", "name": "network-vif-plugged", "status": "completed", "tag": "b9a81f82-f5d3-48ec-8420-23fe4897a6b8"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:03:14.793020 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-dfd9295e-477a-4f2d-9220-86c8dfcbd7c4 req-9ca0fd78-6620-43dc-b372-e277fb825c7f service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:14.794275 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-dfd9295e-477a-4f2d-9220-86c8dfcbd7c4 req-9ca0fd78-6620-43dc-b372-e277fb825c7f service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:14.795291 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-dfd9295e-477a-4f2d-9220-86c8dfcbd7c4 req-9ca0fd78-6620-43dc-b372-e277fb825c7f service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:14.813005 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-dfd9295e-477a-4f2d-9220-86c8dfcbd7c4 req-9ca0fd78-6620-43dc-b372-e277fb825c7f service nova] Creating event network-vif-plugged:b9a81f82-f5d3-48ec-8420-23fe4897a6b8 for instance 67accb8d-3e90-483c-a1e5-9a0c04a685c8 on n-h1-850468-14 Aug 10 23:03:14.819852 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-dfd9295e-477a-4f2d-9220-86c8dfcbd7c4 req-9ca0fd78-6620-43dc-b372-e277fb825c7f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044662 Aug 10 23:03:14.821649 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 843/1713] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:03:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:03:14.827136 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-d801f4d7-c5a8-4283-9359-efd9ceb13401 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:14.827625 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-d801f4d7-c5a8-4283-9359-efd9ceb13401 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] [instance: 2636ab6a-a1c8-4b70-a18f-afe073dd31db] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:14.834378 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d801f4d7-c5a8-4283-9359-efd9ceb13401 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:14.835213 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d801f4d7-c5a8-4283-9359-efd9ceb13401 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:14.835930 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d801f4d7-c5a8-4283-9359-efd9ceb13401 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:14.838100 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d801f4d7-c5a8-4283-9359-efd9ceb13401 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:14.838769 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d801f4d7-c5a8-4283-9359-efd9ceb13401 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:14.839390 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d801f4d7-c5a8-4283-9359-efd9ceb13401 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:14.856414 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-d801f4d7-c5a8-4283-9359-efd9ceb13401 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] HTTP exception thrown: Instance 2636ab6a-a1c8-4b70-a18f-afe073dd31db could not be found. Aug 10 23:03:14.858368 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-d801f4d7-c5a8-4283-9359-efd9ceb13401 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Request method failure captured: Aug 10 23:03:14.858368 n-d-850468-14 devstack@n-api.service[122632]: request: GET /compute/v2.1/servers/2636ab6a-a1c8-4b70-a18f-afe073dd31db HTTP/1.1 Aug 10 23:03:14.858368 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:03:14.858368 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:03:14.858368 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:03:14.858368 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 23:03:14.858368 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:03:14.858368 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:03:14.858368 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:03:14.858368 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:03:14.858368 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9DhnJQVy677u4b7dnMoSItqtWsJm27g_Vg031CYXViqt8YYY7d4cXYrgXs0Pp9xS3IIxdwWgPKq2sDULWw--Li9t2t8l1R3feSY4uh4FysmLVRfKNCAYvKF_tmPQ5ZUjwhrC4jAx70ULoXcE-6wvpA-wHk_CVzAxHX7IWuhEQLk8ZDk Aug 10 23:03:14.858368 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:03:14.858368 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:03:14.858368 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:03:14.858368 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:03:14.858368 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:03:14.858368 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:03:14.858368 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: b27e6ee9495a438b8450a4ef0d62cbcd Aug 10 23:03:14.858368 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-ServersOnMultiNodesTest-936995831 Aug 10 23:03:14.858368 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:03:14.858368 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:03:14.860211 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b27e6ee9495a438b8450a4ef0d62cbcd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b27e6ee9495a438b8450a4ef0d62cbcd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b27e6ee9495a438b8450a4ef0d62cbcd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b27e6ee9495a438b8450a4ef0d62cbcd", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:03:14.860211 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-ServersOnMultiNodesTest-936995831 Aug 10 23:03:14.860211 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: b27e6ee9495a438b8450a4ef0d62cbcd Aug 10 23:03:14.860211 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-936995831 Aug 10 23:03:14.860211 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-ServersOnMultiNodesTest-936995831-project Aug 10 23:03:14.860211 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:03:14.860211 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:03:14.860211 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: 417d4eaaeb1c4df78745496ececb3e88 Aug 10 23:03:14.860211 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-ServersOnMultiNodesTest-936995831-project Aug 10 23:03:14.860211 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:03:14.860211 n-d-850468-14 devstack@n-api.service[122632]: exception: Instance 2636ab6a-a1c8-4b70-a18f-afe073dd31db could not be found. Aug 10 23:03:14.860211 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': '2636ab6a-a1c8-4b70-a18f-afe073dd31db'} Aug 10 23:03:14.861206 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:03:14.861206 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:03:14.861206 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:03:14.861206 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:03:14.861206 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:03:14.861206 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:03:14.861206 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:03:14.861206 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:03:14.861206 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:03:14.861206 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:03:14.861206 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2636ab6a-a1c8-4b70-a18f-afe073dd31db could not be found. Aug 10 23:03:14.861206 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:03:14.861206 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:03:14.861206 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:03:14.861206 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:03:14.861206 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:03:14.861206 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:03:14.861206 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:03:14.861206 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:03:14.861206 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:03:14.862841 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:03:14.862841 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:03:14.862841 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:03:14.862841 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:03:14.862841 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:03:14.862841 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:03:14.862841 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:03:14.862841 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2636ab6a-a1c8-4b70-a18f-afe073dd31db could not be found. Aug 10 23:03:14.862841 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:03:14.862841 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:03:14.862841 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:03:14.862841 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:03:14.862841 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:03:14.862841 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:03:14.862841 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:03:14.862841 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:03:14.862841 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2636ab6a-a1c8-4b70-a18f-afe073dd31db could not be found. Aug 10 23:03:14.862841 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:03:14.865176 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-d801f4d7-c5a8-4283-9359-efd9ceb13401 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Returning 404 to user: Instance 2636ab6a-a1c8-4b70-a18f-afe073dd31db could not be found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:03:14.866678 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-d801f4d7-c5a8-4283-9359-efd9ceb13401 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] 10.222.0.58 "GET /compute/v2.1/servers/2636ab6a-a1c8-4b70-a18f-afe073dd31db" status: 404 len: 111 microversion: 2.1 time: 0.043938 Aug 10 23:03:14.868170 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 844/1714] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:03:14 2022] GET /compute/v2.1/servers/2636ab6a-a1c8-4b70-a18f-afe073dd31db => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:03:14.881817 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-11678881-ac41-4ddf-952c-3874f28f03b0 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:14.883401 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-11678881-ac41-4ddf-952c-3874f28f03b0 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] [instance: 196377d7-c0d5-408b-9743-e1f451f71164] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:14.903826 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-11678881-ac41-4ddf-952c-3874f28f03b0 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:14.904454 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-11678881-ac41-4ddf-952c-3874f28f03b0 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:14.904895 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-11678881-ac41-4ddf-952c-3874f28f03b0 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:14.905883 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-11678881-ac41-4ddf-952c-3874f28f03b0 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:14.906673 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-11678881-ac41-4ddf-952c-3874f28f03b0 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:14.907129 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-11678881-ac41-4ddf-952c-3874f28f03b0 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:14.946025 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-11678881-ac41-4ddf-952c-3874f28f03b0 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] [instance: 196377d7-c0d5-408b-9743-e1f451f71164] Going to try to terminate instance {{(pid=122632) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:03:15.096464 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-11678881-ac41-4ddf-952c-3874f28f03b0 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] 10.222.0.58 "DELETE /compute/v2.1/servers/196377d7-c0d5-408b-9743-e1f451f71164" status: 204 len: 0 microversion: 2.1 time: 0.219143 Aug 10 23:03:15.097193 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 845/1715] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:03:14 2022] DELETE /compute/v2.1/servers/196377d7-c0d5-408b-9743-e1f451f71164 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:03:15.108335 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-366748ad-e8b2-40fa-b191-119bd7523a46 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:15.109849 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-366748ad-e8b2-40fa-b191-119bd7523a46 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] [instance: 196377d7-c0d5-408b-9743-e1f451f71164] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:15.126469 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-366748ad-e8b2-40fa-b191-119bd7523a46 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:15.127095 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-366748ad-e8b2-40fa-b191-119bd7523a46 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:15.128616 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-366748ad-e8b2-40fa-b191-119bd7523a46 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:15.129448 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-366748ad-e8b2-40fa-b191-119bd7523a46 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:15.131531 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-366748ad-e8b2-40fa-b191-119bd7523a46 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:15.134514 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-366748ad-e8b2-40fa-b191-119bd7523a46 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:15.432958 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-366748ad-e8b2-40fa-b191-119bd7523a46 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '417d4eaaeb1c4df78745496ececb3e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27e6ee9495a438b8450a4ef0d62cbcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:15.450274 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-366748ad-e8b2-40fa-b191-119bd7523a46 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] 10.222.0.58 "GET /compute/v2.1/servers/196377d7-c0d5-408b-9743-e1f451f71164" status: 200 len: 1473 microversion: 2.1 time: 0.348621 Aug 10 23:03:15.454093 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 846/1716] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:03:15 2022] GET /compute/v2.1/servers/196377d7-c0d5-408b-9743-e1f451f71164 => generated 1473 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:03:15.468447 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-e577cd0e-77af-480d-91a8-eafd1a4c41b7 req-452e22c3-7a73-4c21-9bec-f65e4c8df12e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10ede6f4-625a-4c5a-a5d6-d7d0f2476dee", "tag": "cddf9930-172d-4081-9a2f-2ad8b6fc95e2"}, {"server_uuid": "3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51", "name": "network-vif-deleted", "tag": "c83e0948-d394-45c1-aa16-31416d85184b"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:03:15.498923 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-e577cd0e-77af-480d-91a8-eafd1a4c41b7 req-452e22c3-7a73-4c21-9bec-f65e4c8df12e service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:15.501092 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-e577cd0e-77af-480d-91a8-eafd1a4c41b7 req-452e22c3-7a73-4c21-9bec-f65e4c8df12e service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:15.505070 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-e577cd0e-77af-480d-91a8-eafd1a4c41b7 req-452e22c3-7a73-4c21-9bec-f65e4c8df12e service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:15.541678 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-8d6965e7-c526-41bb-82d6-9f01c50b260c tempest-SecurityGroupRulesTestJSON-678387735 tempest-SecurityGroupRulesTestJSON-678387735-project] 10.222.0.58 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 330 microversion: 2.1 time: 0.824461 Aug 10 23:03:15.542529 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 871/1717] 10.222.0.58 () {60 vars in 1195 bytes} [Wed Aug 10 23:03:14 2022] POST /compute/v2.1/os-security-group-rules => generated 330 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:03:15.552380 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-9ef2f212-061d-4b3d-98c2-a872c856cdcf tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:15.553977 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-9ef2f212-061d-4b3d-98c2-a872c856cdcf tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] [instance: 10ede6f4-625a-4c5a-a5d6-d7d0f2476dee] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:15.566386 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-e577cd0e-77af-480d-91a8-eafd1a4c41b7 req-452e22c3-7a73-4c21-9bec-f65e4c8df12e service nova] Creating event network-changed:cddf9930-172d-4081-9a2f-2ad8b6fc95e2 for instance 10ede6f4-625a-4c5a-a5d6-d7d0f2476dee on n-h2-850468-14 Aug 10 23:03:15.572512 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-e577cd0e-77af-480d-91a8-eafd1a4c41b7 req-452e22c3-7a73-4c21-9bec-f65e4c8df12e service nova] Creating event network-vif-deleted:c83e0948-d394-45c1-aa16-31416d85184b for instance 3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51 on n-h2-850468-14 Aug 10 23:03:15.592460 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-e577cd0e-77af-480d-91a8-eafd1a4c41b7 req-452e22c3-7a73-4c21-9bec-f65e4c8df12e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.135997 Aug 10 23:03:15.597611 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9ef2f212-061d-4b3d-98c2-a872c856cdcf tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:15.598970 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 847/1718] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:03:15 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:03:15.600120 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9ef2f212-061d-4b3d-98c2-a872c856cdcf tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:15.601474 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9ef2f212-061d-4b3d-98c2-a872c856cdcf tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:15.606386 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9ef2f212-061d-4b3d-98c2-a872c856cdcf tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:15.607041 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9ef2f212-061d-4b3d-98c2-a872c856cdcf tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:15.607479 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9ef2f212-061d-4b3d-98c2-a872c856cdcf tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:15.613868 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-b4e016d2-e63d-4b26-b56d-4a0275697100 tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:15.614857 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-b4e016d2-e63d-4b26-b56d-4a0275697100 tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] [instance: 8fa0b7c8-ae4b-413c-9592-f4944cfb22fc] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:15.622915 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b4e016d2-e63d-4b26-b56d-4a0275697100 tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:15.623653 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b4e016d2-e63d-4b26-b56d-4a0275697100 tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:15.624325 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b4e016d2-e63d-4b26-b56d-4a0275697100 tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:15.625238 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b4e016d2-e63d-4b26-b56d-4a0275697100 tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:15.625693 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b4e016d2-e63d-4b26-b56d-4a0275697100 tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:15.626422 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b4e016d2-e63d-4b26-b56d-4a0275697100 tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:15.809748 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-b4e016d2-e63d-4b26-b56d-4a0275697100 tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be22a1243524178bdfea6892f27b255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f0030d3c62f48e6acd142058158e11e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:15.810389 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-9ef2f212-061d-4b3d-98c2-a872c856cdcf tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890735b21f5d4764aefd789f74e00222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9cf3129a4e4f56a17bebf68b7bc42b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:15.819697 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-b4e016d2-e63d-4b26-b56d-4a0275697100 tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] 10.222.0.58 "GET /compute/v2.1/servers/8fa0b7c8-ae4b-413c-9592-f4944cfb22fc" status: 200 len: 1322 microversion: 2.1 time: 0.217108 Aug 10 23:03:15.819948 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-9ef2f212-061d-4b3d-98c2-a872c856cdcf tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] 10.222.0.58 "GET /compute/v2.1/servers/10ede6f4-625a-4c5a-a5d6-d7d0f2476dee" status: 200 len: 1323 microversion: 2.1 time: 0.275660 Aug 10 23:03:15.820781 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 872/1719] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:03:15 2022] GET /compute/v2.1/servers/10ede6f4-625a-4c5a-a5d6-d7d0f2476dee => generated 1323 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:03:15.825861 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-909fe349-f018-4bdf-8edd-4f3dce2a41ea tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:15.826682 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-909fe349-f018-4bdf-8edd-4f3dce2a41ea tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] [instance: 3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:15.829258 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 848/1720] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:03:15 2022] GET /compute/v2.1/servers/8fa0b7c8-ae4b-413c-9592-f4944cfb22fc => generated 1322 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:03:15.841147 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c6ed731c-65b2-4eca-928d-21ea3c1e2feb tempest-SecurityGroupRulesTestJSON-678387735 tempest-SecurityGroupRulesTestJSON-678387735-project] Action: 'create', calling method: .version_select at 0x7f847d206160>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1163845583", "description": "tempest-description-1589068787"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:03:15.844818 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-909fe349-f018-4bdf-8edd-4f3dce2a41ea tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:15.845633 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-909fe349-f018-4bdf-8edd-4f3dce2a41ea tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:15.846250 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-909fe349-f018-4bdf-8edd-4f3dce2a41ea tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:15.847361 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-909fe349-f018-4bdf-8edd-4f3dce2a41ea tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:15.848000 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-909fe349-f018-4bdf-8edd-4f3dce2a41ea tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:15.848434 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-909fe349-f018-4bdf-8edd-4f3dce2a41ea tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:15.939504 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-909fe349-f018-4bdf-8edd-4f3dce2a41ea tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:15.953579 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-909fe349-f018-4bdf-8edd-4f3dce2a41ea tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:15.955664 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-909fe349-f018-4bdf-8edd-4f3dce2a41ea tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:15.957191 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-909fe349-f018-4bdf-8edd-4f3dce2a41ea tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] 10.222.0.58 "GET /compute/v2.1/servers/3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51" status: 200 len: 1265 microversion: 2.25 time: 0.135308 Aug 10 23:03:15.958264 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 873/1721] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:03:15 2022] GET /compute/v2.1/servers/3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51 => generated 1265 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:03:15.964722 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-95ea0573-93d4-418f-932f-c2dc22a5b539 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:15.966312 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-95ea0573-93d4-418f-932f-c2dc22a5b539 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] [instance: 63d2bd74-d060-4925-9323-b39d5131f958] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:15.974296 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-95ea0573-93d4-418f-932f-c2dc22a5b539 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:15.975055 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-95ea0573-93d4-418f-932f-c2dc22a5b539 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:15.975682 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-95ea0573-93d4-418f-932f-c2dc22a5b539 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:15.977955 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-95ea0573-93d4-418f-932f-c2dc22a5b539 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:15.978571 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-95ea0573-93d4-418f-932f-c2dc22a5b539 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:15.979231 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-95ea0573-93d4-418f-932f-c2dc22a5b539 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:15.992428 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=100 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:03:16.193045 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-c6ed731c-65b2-4eca-928d-21ea3c1e2feb tempest-SecurityGroupRulesTestJSON-678387735 tempest-SecurityGroupRulesTestJSON-678387735-project] 10.222.0.58 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.362442 Aug 10 23:03:16.193666 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-95ea0573-93d4-418f-932f-c2dc22a5b539 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632904331d024d9b8e4d3660dff2cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ed0bdee3aa4013bd9219069bda558c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:16.193809 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 849/1722] 10.222.0.58 () {60 vars in 1180 bytes} [Wed Aug 10 23:03:15 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:03:16.208104 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-95ea0573-93d4-418f-932f-c2dc22a5b539 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] 10.222.0.58 "GET /compute/v2.1/servers/63d2bd74-d060-4925-9323-b39d5131f958" status: 200 len: 1199 microversion: 2.1 time: 0.248361 Aug 10 23:03:16.211445 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 874/1723] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:03:15 2022] GET /compute/v2.1/servers/63d2bd74-d060-4925-9323-b39d5131f958 => generated 1199 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:03:16.228820 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-2936026a-1c26-4920-a08a-d20c66d3b193 req-67e66e9e-02f7-49e2-8da0-6470ab2657f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2636ab6a-a1c8-4b70-a18f-afe073dd31db", "name": "network-vif-deleted", "tag": "f6251d46-01d4-44a9-9707-04ab7fb39207"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:03:16.233155 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-5ed51a09-ce24-4a17-8ddc-55d73bb0702e tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:16.235017 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-5ed51a09-ce24-4a17-8ddc-55d73bb0702e tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] [instance: 67accb8d-3e90-483c-a1e5-9a0c04a685c8] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:16.253371 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-2936026a-1c26-4920-a08a-d20c66d3b193 req-67e66e9e-02f7-49e2-8da0-6470ab2657f1 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:16.254388 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-2936026a-1c26-4920-a08a-d20c66d3b193 req-67e66e9e-02f7-49e2-8da0-6470ab2657f1 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:16.255313 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-2936026a-1c26-4920-a08a-d20c66d3b193 req-67e66e9e-02f7-49e2-8da0-6470ab2657f1 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:16.255642 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5ed51a09-ce24-4a17-8ddc-55d73bb0702e tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:16.256147 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5ed51a09-ce24-4a17-8ddc-55d73bb0702e tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:16.256595 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5ed51a09-ce24-4a17-8ddc-55d73bb0702e tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:16.257356 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5ed51a09-ce24-4a17-8ddc-55d73bb0702e tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:16.258356 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5ed51a09-ce24-4a17-8ddc-55d73bb0702e tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:16.263957 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5ed51a09-ce24-4a17-8ddc-55d73bb0702e tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:16.280983 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-2936026a-1c26-4920-a08a-d20c66d3b193 req-67e66e9e-02f7-49e2-8da0-6470ab2657f1 service nova] Creating event network-vif-deleted:f6251d46-01d4-44a9-9707-04ab7fb39207 for instance 2636ab6a-a1c8-4b70-a18f-afe073dd31db on n-h2-850468-14 Aug 10 23:03:16.295833 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-2936026a-1c26-4920-a08a-d20c66d3b193 req-67e66e9e-02f7-49e2-8da0-6470ab2657f1 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082194 Aug 10 23:03:16.305129 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 875/1724] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:03:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:03:16.314307 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-ac8a6c52-3417-44d7-a7e6-df8945b2c6b6 tempest-SecurityGroupRulesTestJSON-678387735 tempest-SecurityGroupRulesTestJSON-678387735-project] Action: 'create', calling method: .version_select at 0x7f847d3e79d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1436140195", "description": "tempest-description-1916053245"}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:03:16.574523 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-5ed51a09-ce24-4a17-8ddc-55d73bb0702e tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfd6d8e6a8444f5b9fcf1cf8da242ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707f869910b34768ae1a348cd0b5f284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:16.586641 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-5ed51a09-ce24-4a17-8ddc-55d73bb0702e tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] 10.222.0.58 "GET /compute/v2.1/servers/67accb8d-3e90-483c-a1e5-9a0c04a685c8" status: 200 len: 1315 microversion: 2.1 time: 0.369858 Aug 10 23:03:16.588298 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 850/1725] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:03:16 2022] GET /compute/v2.1/servers/67accb8d-3e90-483c-a1e5-9a0c04a685c8 => generated 1315 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:03:16.593745 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-50b32a2d-9b8d-4a73-bdbe-cd0beb089412 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:16.594926 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-50b32a2d-9b8d-4a73-bdbe-cd0beb089412 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] [instance: 196377d7-c0d5-408b-9743-e1f451f71164] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:16.602606 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-50b32a2d-9b8d-4a73-bdbe-cd0beb089412 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:16.603511 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-50b32a2d-9b8d-4a73-bdbe-cd0beb089412 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:16.604253 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-50b32a2d-9b8d-4a73-bdbe-cd0beb089412 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:16.606080 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-50b32a2d-9b8d-4a73-bdbe-cd0beb089412 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:16.606831 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-50b32a2d-9b8d-4a73-bdbe-cd0beb089412 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:16.607805 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-50b32a2d-9b8d-4a73-bdbe-cd0beb089412 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:16.612984 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-ac8a6c52-3417-44d7-a7e6-df8945b2c6b6 tempest-SecurityGroupRulesTestJSON-678387735 tempest-SecurityGroupRulesTestJSON-678387735-project] 10.222.0.58 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.306240 Aug 10 23:03:16.613831 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 876/1726] 10.222.0.58 () {60 vars in 1180 bytes} [Wed Aug 10 23:03:16 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:03:16.628898 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-95591704-67ba-40ac-844b-71845ce0d3b4 tempest-SecurityGroupRulesTestJSON-678387735 tempest-SecurityGroupRulesTestJSON-678387735-project] Action: 'create', calling method: .version_select at 0x7f847d2548b0>, body: {"security_group_rule": {"parent_group_id": "6e6a1753-1b90-4a40-ba31-181b9893221d", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "3e727766-813c-4e81-98c4-d1e6eaba9285"}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:03:16.823351 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-50b32a2d-9b8d-4a73-bdbe-cd0beb089412 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '417d4eaaeb1c4df78745496ececb3e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27e6ee9495a438b8450a4ef0d62cbcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:16.833300 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-50b32a2d-9b8d-4a73-bdbe-cd0beb089412 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] 10.222.0.58 "GET /compute/v2.1/servers/196377d7-c0d5-408b-9743-e1f451f71164" status: 200 len: 1473 microversion: 2.1 time: 0.243706 Aug 10 23:03:16.851958 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 851/1727] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:03:16 2022] GET /compute/v2.1/servers/196377d7-c0d5-408b-9743-e1f451f71164 => generated 1473 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:03:16.862250 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-aa14f564-373b-4aeb-b8ea-76d2251a2b03 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:16.863377 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-aa14f564-373b-4aeb-b8ea-76d2251a2b03 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] [instance: 10ede6f4-625a-4c5a-a5d6-d7d0f2476dee] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:16.875724 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-aa14f564-373b-4aeb-b8ea-76d2251a2b03 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:16.876494 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-aa14f564-373b-4aeb-b8ea-76d2251a2b03 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:16.877226 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-aa14f564-373b-4aeb-b8ea-76d2251a2b03 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:16.878856 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-aa14f564-373b-4aeb-b8ea-76d2251a2b03 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:16.879723 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-aa14f564-373b-4aeb-b8ea-76d2251a2b03 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:16.880481 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-aa14f564-373b-4aeb-b8ea-76d2251a2b03 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:17.036964 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-95591704-67ba-40ac-844b-71845ce0d3b4 tempest-SecurityGroupRulesTestJSON-678387735 tempest-SecurityGroupRulesTestJSON-678387735-project] 10.222.0.58 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 0.412995 Aug 10 23:03:17.038276 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 877/1728] 10.222.0.58 () {60 vars in 1195 bytes} [Wed Aug 10 23:03:16 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 23:03:17.043967 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-4ac7d0f7-e45e-4d10-bbf5-15729529788c tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:17.045045 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-4ac7d0f7-e45e-4d10-bbf5-15729529788c tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] [instance: 8fa0b7c8-ae4b-413c-9592-f4944cfb22fc] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:17.054272 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4ac7d0f7-e45e-4d10-bbf5-15729529788c tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:17.055136 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4ac7d0f7-e45e-4d10-bbf5-15729529788c tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:17.055870 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4ac7d0f7-e45e-4d10-bbf5-15729529788c tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:17.056856 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4ac7d0f7-e45e-4d10-bbf5-15729529788c tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:17.057318 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4ac7d0f7-e45e-4d10-bbf5-15729529788c tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:17.058129 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4ac7d0f7-e45e-4d10-bbf5-15729529788c tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:17.069592 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-aa14f564-373b-4aeb-b8ea-76d2251a2b03 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890735b21f5d4764aefd789f74e00222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9cf3129a4e4f56a17bebf68b7bc42b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:17.083483 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-aa14f564-373b-4aeb-b8ea-76d2251a2b03 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] 10.222.0.58 "GET /compute/v2.1/servers/10ede6f4-625a-4c5a-a5d6-d7d0f2476dee" status: 200 len: 1323 microversion: 2.1 time: 0.227795 Aug 10 23:03:17.085248 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 852/1729] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:03:16 2022] GET /compute/v2.1/servers/10ede6f4-625a-4c5a-a5d6-d7d0f2476dee => generated 1323 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:03:17.092917 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-42358e36-9901-4c57-a5b9-d47df823351f req-cf4cc860-048a-4093-8940-f93bb7c49e0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8fa0b7c8-ae4b-413c-9592-f4944cfb22fc", "name": "network-vif-plugged", "status": "completed", "tag": "eef1b5f8-6d51-406e-a11e-bdd5e6c015ed"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:03:17.103956 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-42358e36-9901-4c57-a5b9-d47df823351f req-cf4cc860-048a-4093-8940-f93bb7c49e0c service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:17.104552 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-42358e36-9901-4c57-a5b9-d47df823351f req-cf4cc860-048a-4093-8940-f93bb7c49e0c service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:17.105049 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-42358e36-9901-4c57-a5b9-d47df823351f req-cf4cc860-048a-4093-8940-f93bb7c49e0c service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:17.118326 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-42358e36-9901-4c57-a5b9-d47df823351f req-cf4cc860-048a-4093-8940-f93bb7c49e0c service nova] Creating event network-vif-plugged:eef1b5f8-6d51-406e-a11e-bdd5e6c015ed for instance 8fa0b7c8-ae4b-413c-9592-f4944cfb22fc on n-h2-850468-14 Aug 10 23:03:17.123539 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-42358e36-9901-4c57-a5b9-d47df823351f req-cf4cc860-048a-4093-8940-f93bb7c49e0c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036431 Aug 10 23:03:17.124594 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 853/1730] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:03:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:03:17.140550 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-ff2783bf-3f9c-4e75-8e67-8e1c7dff289a tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:17.142845 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-ff2783bf-3f9c-4e75-8e67-8e1c7dff289a tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] [instance: 3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:17.165821 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ff2783bf-3f9c-4e75-8e67-8e1c7dff289a tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:17.166432 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ff2783bf-3f9c-4e75-8e67-8e1c7dff289a tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:17.167004 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ff2783bf-3f9c-4e75-8e67-8e1c7dff289a tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:17.167800 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ff2783bf-3f9c-4e75-8e67-8e1c7dff289a tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:17.168327 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ff2783bf-3f9c-4e75-8e67-8e1c7dff289a tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:17.168821 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ff2783bf-3f9c-4e75-8e67-8e1c7dff289a tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:17.265352 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-ff2783bf-3f9c-4e75-8e67-8e1c7dff289a tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:17.276882 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-ff2783bf-3f9c-4e75-8e67-8e1c7dff289a tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:17.277628 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-4ac7d0f7-e45e-4d10-bbf5-15729529788c tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be22a1243524178bdfea6892f27b255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f0030d3c62f48e6acd142058158e11e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:17.279801 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-ff2783bf-3f9c-4e75-8e67-8e1c7dff289a tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:17.281017 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-ff2783bf-3f9c-4e75-8e67-8e1c7dff289a tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] 10.222.0.58 "GET /compute/v2.1/servers/3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51" status: 200 len: 1265 microversion: 2.25 time: 0.155072 Aug 10 23:03:17.281595 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 854/1731] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:03:17 2022] GET /compute/v2.1/servers/3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:03:17.288429 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-4ac7d0f7-e45e-4d10-bbf5-15729529788c tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] 10.222.0.58 "GET /compute/v2.1/servers/8fa0b7c8-ae4b-413c-9592-f4944cfb22fc" status: 200 len: 1322 microversion: 2.1 time: 0.248092 Aug 10 23:03:17.289595 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 878/1732] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:03:17 2022] GET /compute/v2.1/servers/8fa0b7c8-ae4b-413c-9592-f4944cfb22fc => generated 1322 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:03:17.298235 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-bd856c94-0437-4258-a468-d0748a1e3b2f tempest-SecurityGroupRulesTestJSON-678387735 tempest-SecurityGroupRulesTestJSON-678387735-project] Calling method '.version_select at 0x7f847d8ac9d0>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:17.301282 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-8b73afc0-6c0a-4ed6-bd1c-3e6fd2940848 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:17.302147 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-8b73afc0-6c0a-4ed6-bd1c-3e6fd2940848 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] [instance: 63d2bd74-d060-4925-9323-b39d5131f958] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:17.322994 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8b73afc0-6c0a-4ed6-bd1c-3e6fd2940848 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:17.323495 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8b73afc0-6c0a-4ed6-bd1c-3e6fd2940848 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:17.323934 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8b73afc0-6c0a-4ed6-bd1c-3e6fd2940848 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:17.324646 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8b73afc0-6c0a-4ed6-bd1c-3e6fd2940848 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:17.325098 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8b73afc0-6c0a-4ed6-bd1c-3e6fd2940848 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:17.325518 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8b73afc0-6c0a-4ed6-bd1c-3e6fd2940848 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:17.488439 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-8b73afc0-6c0a-4ed6-bd1c-3e6fd2940848 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632904331d024d9b8e4d3660dff2cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ed0bdee3aa4013bd9219069bda558c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:17.498070 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-8b73afc0-6c0a-4ed6-bd1c-3e6fd2940848 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] 10.222.0.58 "GET /compute/v2.1/servers/63d2bd74-d060-4925-9323-b39d5131f958" status: 200 len: 1199 microversion: 2.1 time: 0.206889 Aug 10 23:03:17.511770 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 879/1733] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:03:17 2022] GET /compute/v2.1/servers/63d2bd74-d060-4925-9323-b39d5131f958 => generated 1199 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:03:17.552054 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-bd856c94-0437-4258-a468-d0748a1e3b2f tempest-SecurityGroupRulesTestJSON-678387735 tempest-SecurityGroupRulesTestJSON-678387735-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/3e727766-813c-4e81-98c4-d1e6eaba9285" status: 202 len: 0 microversion: 2.1 time: 0.267705 Aug 10 23:03:17.553899 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 855/1734] 10.222.0.58 () {58 vars in 1272 bytes} [Wed Aug 10 23:03:17 2022] DELETE /compute/v2.1/os-security-groups/3e727766-813c-4e81-98c4-d1e6eaba9285 => generated 0 bytes in 272 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:03:17.563475 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-66e83872-715c-46e0-a40f-c6fadcc77967 tempest-SecurityGroupRulesTestJSON-678387735 tempest-SecurityGroupRulesTestJSON-678387735-project] Calling method '.version_select at 0x7f847d3b2c10>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:17.634194 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-8b267b2c-01e1-4f41-835f-de6be14bd0f5 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:17.634194 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-8b267b2c-01e1-4f41-835f-de6be14bd0f5 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] [instance: 67accb8d-3e90-483c-a1e5-9a0c04a685c8] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:17.634194 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8b267b2c-01e1-4f41-835f-de6be14bd0f5 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:17.634194 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8b267b2c-01e1-4f41-835f-de6be14bd0f5 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:17.635449 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8b267b2c-01e1-4f41-835f-de6be14bd0f5 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:17.635449 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8b267b2c-01e1-4f41-835f-de6be14bd0f5 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:17.635449 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8b267b2c-01e1-4f41-835f-de6be14bd0f5 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:17.635449 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8b267b2c-01e1-4f41-835f-de6be14bd0f5 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:17.635768 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-66e83872-715c-46e0-a40f-c6fadcc77967 tempest-SecurityGroupRulesTestJSON-678387735 tempest-SecurityGroupRulesTestJSON-678387735-project] 10.222.0.58 "GET /compute/v2.1/os-security-groups/6e6a1753-1b90-4a40-ba31-181b9893221d" status: 200 len: 248 microversion: 2.1 time: 0.070912 Aug 10 23:03:17.635768 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 880/1735] 10.222.0.58 () {58 vars in 1269 bytes} [Wed Aug 10 23:03:17 2022] GET /compute/v2.1/os-security-groups/6e6a1753-1b90-4a40-ba31-181b9893221d => generated 248 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:03:17.644926 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-f9223db6-aa26-4266-8a63-369cf5b774fd tempest-SecurityGroupRulesTestJSON-678387735 tempest-SecurityGroupRulesTestJSON-678387735-project] Action: 'create', calling method: .version_select at 0x7f847d3baca0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-29711210", "description": "tempest-description-1772007558"}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:03:18.229914 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-8b267b2c-01e1-4f41-835f-de6be14bd0f5 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfd6d8e6a8444f5b9fcf1cf8da242ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707f869910b34768ae1a348cd0b5f284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:18.241127 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-8b267b2c-01e1-4f41-835f-de6be14bd0f5 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] 10.222.0.58 "GET /compute/v2.1/servers/67accb8d-3e90-483c-a1e5-9a0c04a685c8" status: 200 len: 1503 microversion: 2.1 time: 0.636037 Aug 10 23:03:18.243842 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 856/1736] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:03:17 2022] GET /compute/v2.1/servers/67accb8d-3e90-483c-a1e5-9a0c04a685c8 => generated 1503 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:03:18.253311 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-dcdfe786-5ae3-4885-a3fa-695d04c2e6a0 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:18.255644 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-dcdfe786-5ae3-4885-a3fa-695d04c2e6a0 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] [instance: 196377d7-c0d5-408b-9743-e1f451f71164] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:18.268404 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dcdfe786-5ae3-4885-a3fa-695d04c2e6a0 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:18.270660 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dcdfe786-5ae3-4885-a3fa-695d04c2e6a0 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:18.271508 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dcdfe786-5ae3-4885-a3fa-695d04c2e6a0 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:18.276114 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dcdfe786-5ae3-4885-a3fa-695d04c2e6a0 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:18.281058 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dcdfe786-5ae3-4885-a3fa-695d04c2e6a0 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:18.281957 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dcdfe786-5ae3-4885-a3fa-695d04c2e6a0 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:18.465796 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-f9223db6-aa26-4266-8a63-369cf5b774fd tempest-SecurityGroupRulesTestJSON-678387735 tempest-SecurityGroupRulesTestJSON-678387735-project] 10.222.0.58 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.824865 Aug 10 23:03:18.466411 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 881/1737] 10.222.0.58 () {60 vars in 1180 bytes} [Wed Aug 10 23:03:17 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:03:18.478567 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-4b7ac776-1ca8-4089-b77c-ac0e8caf6f30 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:18.480352 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-4b7ac776-1ca8-4089-b77c-ac0e8caf6f30 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] [instance: 10ede6f4-625a-4c5a-a5d6-d7d0f2476dee] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:18.489369 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4b7ac776-1ca8-4089-b77c-ac0e8caf6f30 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:18.490233 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4b7ac776-1ca8-4089-b77c-ac0e8caf6f30 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:18.491117 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4b7ac776-1ca8-4089-b77c-ac0e8caf6f30 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:18.493189 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4b7ac776-1ca8-4089-b77c-ac0e8caf6f30 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:18.493924 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4b7ac776-1ca8-4089-b77c-ac0e8caf6f30 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:18.494602 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4b7ac776-1ca8-4089-b77c-ac0e8caf6f30 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:18.573103 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-dcdfe786-5ae3-4885-a3fa-695d04c2e6a0 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '417d4eaaeb1c4df78745496ececb3e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27e6ee9495a438b8450a4ef0d62cbcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:18.584053 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-dcdfe786-5ae3-4885-a3fa-695d04c2e6a0 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] 10.222.0.58 "GET /compute/v2.1/servers/196377d7-c0d5-408b-9743-e1f451f71164" status: 200 len: 1473 microversion: 2.1 time: 0.336454 Aug 10 23:03:18.600545 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 857/1738] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:03:18 2022] GET /compute/v2.1/servers/196377d7-c0d5-408b-9743-e1f451f71164 => generated 1473 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:03:18.607713 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-1e99de74-3a96-432a-87dc-b60b429b8a58 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1997372543"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:03:18.608536 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-1e99de74-3a96-432a-87dc-b60b429b8a58 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] [instance: 67accb8d-3e90-483c-a1e5-9a0c04a685c8] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:18.616823 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1e99de74-3a96-432a-87dc-b60b429b8a58 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:18.617748 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1e99de74-3a96-432a-87dc-b60b429b8a58 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:18.619535 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1e99de74-3a96-432a-87dc-b60b429b8a58 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:18.621660 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1e99de74-3a96-432a-87dc-b60b429b8a58 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:18.622465 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1e99de74-3a96-432a-87dc-b60b429b8a58 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:18.623199 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1e99de74-3a96-432a-87dc-b60b429b8a58 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:18.830012 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.network.security_group_api [None req-1e99de74-3a96-432a-87dc-b60b429b8a58 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Adding security group 6a8f01ff-e4b7-461e-9543-d4774d97a84a to port b9a81f82-f5d3-48ec-8420-23fe4897a6b8 Aug 10 23:03:19.364573 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-1e99de74-3a96-432a-87dc-b60b429b8a58 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] 10.222.0.58 "POST /compute/v2.1/servers/67accb8d-3e90-483c-a1e5-9a0c04a685c8/action" status: 202 len: 0 microversion: 2.1 time: 0.762273 Aug 10 23:03:19.365730 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 858/1739] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:03:18 2022] POST /compute/v2.1/servers/67accb8d-3e90-483c-a1e5-9a0c04a685c8/action => generated 0 bytes in 764 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:03:19.372714 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-54b96534-df38-4c18-8b66-1564bfa54de2 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:19.374319 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-54b96534-df38-4c18-8b66-1564bfa54de2 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] [instance: 3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:19.394673 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-54b96534-df38-4c18-8b66-1564bfa54de2 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:19.395956 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-54b96534-df38-4c18-8b66-1564bfa54de2 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:19.397076 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-54b96534-df38-4c18-8b66-1564bfa54de2 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:19.400309 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-54b96534-df38-4c18-8b66-1564bfa54de2 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:19.409335 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-54b96534-df38-4c18-8b66-1564bfa54de2 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:19.411311 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-54b96534-df38-4c18-8b66-1564bfa54de2 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:19.562868 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-4b7ac776-1ca8-4089-b77c-ac0e8caf6f30 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890735b21f5d4764aefd789f74e00222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9cf3129a4e4f56a17bebf68b7bc42b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:19.607733 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-4b7ac776-1ca8-4089-b77c-ac0e8caf6f30 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] 10.222.0.58 "GET /compute/v2.1/servers/10ede6f4-625a-4c5a-a5d6-d7d0f2476dee" status: 200 len: 1323 microversion: 2.1 time: 1.138038 Aug 10 23:03:19.608353 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 882/1740] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:03:18 2022] GET /compute/v2.1/servers/10ede6f4-625a-4c5a-a5d6-d7d0f2476dee => generated 1323 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:03:19.610685 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-54b96534-df38-4c18-8b66-1564bfa54de2 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:19.613657 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-51b18133-0a7e-4512-99b7-f3fe7cd41b05 tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:19.614420 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-51b18133-0a7e-4512-99b7-f3fe7cd41b05 tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] [instance: 8fa0b7c8-ae4b-413c-9592-f4944cfb22fc] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:19.622941 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-51b18133-0a7e-4512-99b7-f3fe7cd41b05 tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:19.623765 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-51b18133-0a7e-4512-99b7-f3fe7cd41b05 tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:19.624418 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-51b18133-0a7e-4512-99b7-f3fe7cd41b05 tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:19.626019 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-51b18133-0a7e-4512-99b7-f3fe7cd41b05 tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:19.626694 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-51b18133-0a7e-4512-99b7-f3fe7cd41b05 tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:19.627323 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-51b18133-0a7e-4512-99b7-f3fe7cd41b05 tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:19.642898 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-54b96534-df38-4c18-8b66-1564bfa54de2 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:19.647999 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-54b96534-df38-4c18-8b66-1564bfa54de2 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:19.652009 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-54b96534-df38-4c18-8b66-1564bfa54de2 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] 10.222.0.58 "GET /compute/v2.1/servers/3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51" status: 200 len: 1265 microversion: 2.25 time: 0.285120 Aug 10 23:03:19.655862 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 859/1741] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:03:19 2022] GET /compute/v2.1/servers/3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51 => generated 1265 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:03:19.672593 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-ff111ad7-be45-4e14-bb1d-db35351a8010 tempest-SecurityGroupRulesTestJSON-678387735 tempest-SecurityGroupRulesTestJSON-678387735-project] Action: 'create', calling method: .version_select at 0x7f847d757940>, body: {"security_group_rule": {"parent_group_id": "47ea68d2-8308-410d-814e-196439ec4165", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:03:19.976733 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-51b18133-0a7e-4512-99b7-f3fe7cd41b05 tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be22a1243524178bdfea6892f27b255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f0030d3c62f48e6acd142058158e11e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:19.990822 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-51b18133-0a7e-4512-99b7-f3fe7cd41b05 tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] 10.222.0.58 "GET /compute/v2.1/servers/8fa0b7c8-ae4b-413c-9592-f4944cfb22fc" status: 200 len: 1322 microversion: 2.1 time: 0.379529 Aug 10 23:03:19.993650 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 883/1742] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:03:19 2022] GET /compute/v2.1/servers/8fa0b7c8-ae4b-413c-9592-f4944cfb22fc => generated 1322 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:03:20.004673 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-95642eea-4127-454a-a4d5-6003c53071d9 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:20.006160 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-95642eea-4127-454a-a4d5-6003c53071d9 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] [instance: 63d2bd74-d060-4925-9323-b39d5131f958] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:20.024119 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-95642eea-4127-454a-a4d5-6003c53071d9 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:20.024970 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-95642eea-4127-454a-a4d5-6003c53071d9 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:20.027019 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-95642eea-4127-454a-a4d5-6003c53071d9 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:20.028089 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-95642eea-4127-454a-a4d5-6003c53071d9 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:20.029758 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-95642eea-4127-454a-a4d5-6003c53071d9 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:20.032070 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-95642eea-4127-454a-a4d5-6003c53071d9 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:20.287307 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-ff111ad7-be45-4e14-bb1d-db35351a8010 tempest-SecurityGroupRulesTestJSON-678387735 tempest-SecurityGroupRulesTestJSON-678387735-project] 10.222.0.58 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.627517 Aug 10 23:03:20.290680 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 860/1743] 10.222.0.58 () {60 vars in 1195 bytes} [Wed Aug 10 23:03:19 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:03:20.301998 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-f06c06db-0c0b-4da3-ab71-f6c4e8e5d128 req-3b0bbb8d-d2d4-489b-a83a-3d1f082faed9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17b32f05-1f0e-473f-bfda-fab92a90b04f", "name": "network-vif-plugged", "status": "completed", "tag": "4dabccdf-cbe5-4d0c-8550-14b485c16ce4"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:03:20.317333 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-f06c06db-0c0b-4da3-ab71-f6c4e8e5d128 req-3b0bbb8d-d2d4-489b-a83a-3d1f082faed9 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:20.318124 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-f06c06db-0c0b-4da3-ab71-f6c4e8e5d128 req-3b0bbb8d-d2d4-489b-a83a-3d1f082faed9 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:20.318923 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-f06c06db-0c0b-4da3-ab71-f6c4e8e5d128 req-3b0bbb8d-d2d4-489b-a83a-3d1f082faed9 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:20.331160 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-95642eea-4127-454a-a4d5-6003c53071d9 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632904331d024d9b8e4d3660dff2cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ed0bdee3aa4013bd9219069bda558c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:20.339677 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-f06c06db-0c0b-4da3-ab71-f6c4e8e5d128 req-3b0bbb8d-d2d4-489b-a83a-3d1f082faed9 service nova] Creating event network-vif-plugged:4dabccdf-cbe5-4d0c-8550-14b485c16ce4 for instance 17b32f05-1f0e-473f-bfda-fab92a90b04f on n-h2-850468-14 Aug 10 23:03:20.342406 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-95642eea-4127-454a-a4d5-6003c53071d9 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] 10.222.0.58 "GET /compute/v2.1/servers/63d2bd74-d060-4925-9323-b39d5131f958" status: 200 len: 1199 microversion: 2.1 time: 0.347447 Aug 10 23:03:20.346706 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 884/1744] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:03:19 2022] GET /compute/v2.1/servers/63d2bd74-d060-4925-9323-b39d5131f958 => generated 1199 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:03:20.351664 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-f06c06db-0c0b-4da3-ab71-f6c4e8e5d128 req-3b0bbb8d-d2d4-489b-a83a-3d1f082faed9 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058778 Aug 10 23:03:20.352962 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 861/1745] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:03:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:03:20.364946 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-3217ea3c-0b58-45a5-879f-69dfbb00da59 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Calling method '.version_select at 0x7f847d3a7b80>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:20.381394 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-d9317550-9d10-4d34-ba1f-b68e66cf20a3 req-b89f3de9-b077-4202-a6fb-dcfc03b47dbc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67accb8d-3e90-483c-a1e5-9a0c04a685c8", "tag": "b9a81f82-f5d3-48ec-8420-23fe4897a6b8"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:03:20.417504 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-d9317550-9d10-4d34-ba1f-b68e66cf20a3 req-b89f3de9-b077-4202-a6fb-dcfc03b47dbc service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:20.419930 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-d9317550-9d10-4d34-ba1f-b68e66cf20a3 req-b89f3de9-b077-4202-a6fb-dcfc03b47dbc service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:20.423146 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-d9317550-9d10-4d34-ba1f-b68e66cf20a3 req-b89f3de9-b077-4202-a6fb-dcfc03b47dbc service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:20.452679 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-d9317550-9d10-4d34-ba1f-b68e66cf20a3 req-b89f3de9-b077-4202-a6fb-dcfc03b47dbc service nova] Creating event network-changed:b9a81f82-f5d3-48ec-8420-23fe4897a6b8 for instance 67accb8d-3e90-483c-a1e5-9a0c04a685c8 on n-h1-850468-14 Aug 10 23:03:20.464317 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-d9317550-9d10-4d34-ba1f-b68e66cf20a3 req-b89f3de9-b077-4202-a6fb-dcfc03b47dbc service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106559 Aug 10 23:03:20.465548 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 862/1746] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:03:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:03:20.481644 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-802283a8-0c45-4595-a1f4-93095d75d06a tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:20.485354 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-802283a8-0c45-4595-a1f4-93095d75d06a tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] [instance: 196377d7-c0d5-408b-9743-e1f451f71164] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:20.506709 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-802283a8-0c45-4595-a1f4-93095d75d06a tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:20.507554 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-802283a8-0c45-4595-a1f4-93095d75d06a tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:20.508242 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-802283a8-0c45-4595-a1f4-93095d75d06a tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:20.512279 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-802283a8-0c45-4595-a1f4-93095d75d06a tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:20.513006 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-802283a8-0c45-4595-a1f4-93095d75d06a tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:20.513687 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-802283a8-0c45-4595-a1f4-93095d75d06a tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:20.649995 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-802283a8-0c45-4595-a1f4-93095d75d06a tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:20.658812 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-802283a8-0c45-4595-a1f4-93095d75d06a tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:20.659785 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-802283a8-0c45-4595-a1f4-93095d75d06a tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:20.660427 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.objects.instance [None req-802283a8-0c45-4595-a1f4-93095d75d06a tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lazy-loading 'fault' on Instance uuid 196377d7-c0d5-408b-9743-e1f451f71164 {{(pid=122632) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:03:20.669144 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:03:20.787310 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-802283a8-0c45-4595-a1f4-93095d75d06a tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '417d4eaaeb1c4df78745496ececb3e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27e6ee9495a438b8450a4ef0d62cbcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:20.806492 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-802283a8-0c45-4595-a1f4-93095d75d06a tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] 10.222.0.58 "GET /compute/v2.1/servers/196377d7-c0d5-408b-9743-e1f451f71164" status: 200 len: 1307 microversion: 2.1 time: 0.336720 Aug 10 23:03:20.809647 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 863/1747] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:03:20 2022] GET /compute/v2.1/servers/196377d7-c0d5-408b-9743-e1f451f71164 => generated 1307 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:03:20.826563 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-9df64ac1-c1e9-454d-be9f-f4ad98a70102 req-31ac54ec-19eb-4dae-a0ed-0a3d5193804a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "196377d7-c0d5-408b-9743-e1f451f71164", "name": "network-vif-deleted", "tag": "ee547e27-7a4d-4b9b-a6b3-23c2283a5297"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:03:20.849776 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-9df64ac1-c1e9-454d-be9f-f4ad98a70102 req-31ac54ec-19eb-4dae-a0ed-0a3d5193804a service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:20.850390 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-9df64ac1-c1e9-454d-be9f-f4ad98a70102 req-31ac54ec-19eb-4dae-a0ed-0a3d5193804a service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:20.854902 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-9df64ac1-c1e9-454d-be9f-f4ad98a70102 req-31ac54ec-19eb-4dae-a0ed-0a3d5193804a service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:20.886943 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-9df64ac1-c1e9-454d-be9f-f4ad98a70102 req-31ac54ec-19eb-4dae-a0ed-0a3d5193804a service nova] Creating event network-vif-deleted:ee547e27-7a4d-4b9b-a6b3-23c2283a5297 for instance 196377d7-c0d5-408b-9743-e1f451f71164 on n-h2-850468-14 Aug 10 23:03:20.908250 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-9df64ac1-c1e9-454d-be9f-f4ad98a70102 req-31ac54ec-19eb-4dae-a0ed-0a3d5193804a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091896 Aug 10 23:03:20.909162 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 864/1748] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:03:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:03:20.920441 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-02f79569-2745-41c0-8cda-c2770a99d7c6 tempest-SecurityGroupRulesTestJSON-678387735 tempest-SecurityGroupRulesTestJSON-678387735-project] Action: 'create', calling method: .version_select at 0x7f847d9501f0>, body: {"security_group_rule": {"parent_group_id": "47ea68d2-8308-410d-814e-196439ec4165", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:03:20.998607 n-d-850468-14 devstack@n-api.service[122633]: DEBUG neutronclient.v2_0.client [None req-3217ea3c-0b58-45a5-879f-69dfbb00da59 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 6a8f01ff-e4b7-461e-9543-d4774d97a84a in use.", "detail": ""}} {{(pid=122633) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 10 23:03:20.999408 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-3217ea3c-0b58-45a5-879f-69dfbb00da59 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] HTTP exception thrown: Security Group 6a8f01ff-e4b7-461e-9543-d4774d97a84a in use. Aug 10 23:03:20.999408 n-d-850468-14 devstack@n-api.service[122633]: Neutron server returns request_ids: ['req-9e9d09c7-b7fa-4bcc-bf38-4550473a6ffa'] Aug 10 23:03:21.001488 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-3217ea3c-0b58-45a5-879f-69dfbb00da59 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Request method failure captured: Aug 10 23:03:21.001488 n-d-850468-14 devstack@n-api.service[122633]: request: DELETE /compute/v2.1/os-security-groups/6a8f01ff-e4b7-461e-9543-d4774d97a84a HTTP/1.1 Aug 10 23:03:21.001488 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:03:21.001488 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:03:21.001488 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:03:21.001488 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:03:21.001488 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:03:21.001488 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:03:21.001488 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:03:21.001488 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:03:21.001488 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9Dju6bcY6WgJPTWLWUJ0fX6JaJBRP8GkYZWFafNrDYn8ACaF-JC0t8YD4rSPFgG5Deze7mjmq2_rnPCZ1jpXNRGkHxz134mT5MqTqUm9UAyuVcbLtNQAiAf-L4A3117brPwKa_CN56-tZ47WT8aAPEON_2-WsEOp9qATqEToy30jo_s Aug 10 23:03:21.001488 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:03:21.001488 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:03:21.001488 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:03:21.001488 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:03:21.001488 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:03:21.001488 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:03:21.001488 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 707f869910b34768ae1a348cd0b5f284 Aug 10 23:03:21.001488 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-SecurityGroupsTestJSON-1406525704 Aug 10 23:03:21.001488 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:03:21.001488 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:03:21.003331 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/707f869910b34768ae1a348cd0b5f284"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/707f869910b34768ae1a348cd0b5f284"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/707f869910b34768ae1a348cd0b5f284"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_707f869910b34768ae1a348cd0b5f284", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:03:21.003331 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-SecurityGroupsTestJSON-1406525704 Aug 10 23:03:21.003331 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 707f869910b34768ae1a348cd0b5f284 Aug 10 23:03:21.003331 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1406525704 Aug 10 23:03:21.003331 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-SecurityGroupsTestJSON-1406525704-project Aug 10 23:03:21.003331 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:03:21.003331 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:03:21.003331 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: bfd6d8e6a8444f5b9fcf1cf8da242ac0 Aug 10 23:03:21.003331 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-SecurityGroupsTestJSON-1406525704-project Aug 10 23:03:21.003331 n-d-850468-14 devstack@n-api.service[122633]: method: Aug 10 23:03:21.003331 n-d-850468-14 devstack@n-api.service[122633]: exception: Security Group 6a8f01ff-e4b7-461e-9543-d4774d97a84a in use. Aug 10 23:03:21.003331 n-d-850468-14 devstack@n-api.service[122633]: Neutron server returns request_ids: ['req-9e9d09c7-b7fa-4bcc-bf38-4550473a6ffa'] Aug 10 23:03:21.003331 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': '6a8f01ff-e4b7-461e-9543-d4774d97a84a'} Aug 10 23:03:21.004490 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:03:21.004490 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:03:21.004490 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Aug 10 23:03:21.004490 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Aug 10 23:03:21.004490 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 23:03:21.004490 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 23:03:21.004490 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Aug 10 23:03:21.004490 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Aug 10 23:03:21.004490 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 23:03:21.004490 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 23:03:21.004490 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Aug 10 23:03:21.004490 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Aug 10 23:03:21.004490 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 23:03:21.004490 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 23:03:21.004490 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 23:03:21.004490 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 23:03:21.004490 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 23:03:21.004490 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 23:03:21.004490 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 10 23:03:21.008248 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 10 23:03:21.008248 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 23:03:21.008248 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 23:03:21.008248 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 10 23:03:21.008248 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 10 23:03:21.008248 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 10 23:03:21.008248 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 10 23:03:21.008248 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 6a8f01ff-e4b7-461e-9543-d4774d97a84a in use. Aug 10 23:03:21.008248 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9e9d09c7-b7fa-4bcc-bf38-4550473a6ffa'] Aug 10 23:03:21.008248 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:03:21.008248 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:03:21.008248 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:03:21.008248 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:03:21.008248 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Aug 10 23:03:21.008248 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Aug 10 23:03:21.008248 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Aug 10 23:03:21.008248 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Aug 10 23:03:21.008248 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 6a8f01ff-e4b7-461e-9543-d4774d97a84a in use. Aug 10 23:03:21.008248 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9e9d09c7-b7fa-4bcc-bf38-4550473a6ffa'] Aug 10 23:03:21.009843 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:03:21.009843 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:03:21.009843 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:03:21.009843 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:03:21.009843 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:03:21.009843 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:03:21.009843 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:03:21.009843 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:03:21.009843 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 23:03:21.009843 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 23:03:21.009843 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:03:21.009843 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:03:21.009843 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Aug 10 23:03:21.009843 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 10 23:03:21.009843 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 6a8f01ff-e4b7-461e-9543-d4774d97a84a in use. Aug 10 23:03:21.009843 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9e9d09c7-b7fa-4bcc-bf38-4550473a6ffa'] Aug 10 23:03:21.009843 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:03:21.009843 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:03:21.009843 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:03:21.009843 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:03:21.009843 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:03:21.011690 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:03:21.011690 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:03:21.011690 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:03:21.011690 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 6a8f01ff-e4b7-461e-9543-d4774d97a84a in use. Aug 10 23:03:21.011690 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9e9d09c7-b7fa-4bcc-bf38-4550473a6ffa'] Aug 10 23:03:21.011690 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:03:21.011690 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-3217ea3c-0b58-45a5-879f-69dfbb00da59 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Returning 400 to user: Security Group 6a8f01ff-e4b7-461e-9543-d4774d97a84a in use. Aug 10 23:03:21.011690 n-d-850468-14 devstack@n-api.service[122633]: Neutron server returns request_ids: ['req-9e9d09c7-b7fa-4bcc-bf38-4550473a6ffa'] {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:03:21.011690 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-3217ea3c-0b58-45a5-879f-69dfbb00da59 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/6a8f01ff-e4b7-461e-9543-d4774d97a84a" status: 400 len: 185 microversion: 2.1 time: 0.655081 Aug 10 23:03:21.011690 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 885/1749] 10.222.0.58 () {58 vars in 1272 bytes} [Wed Aug 10 23:03:20 2022] DELETE /compute/v2.1/os-security-groups/6a8f01ff-e4b7-461e-9543-d4774d97a84a => generated 185 bytes in 659 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 10 23:03:21.013552 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-55f2be1f-5eea-4b9f-bd15-ee4415d4a16a tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:21.013711 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-55f2be1f-5eea-4b9f-bd15-ee4415d4a16a tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] [instance: 10ede6f4-625a-4c5a-a5d6-d7d0f2476dee] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:21.026610 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-55f2be1f-5eea-4b9f-bd15-ee4415d4a16a tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:21.027172 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-55f2be1f-5eea-4b9f-bd15-ee4415d4a16a tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:21.027619 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-55f2be1f-5eea-4b9f-bd15-ee4415d4a16a tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:21.028338 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-55f2be1f-5eea-4b9f-bd15-ee4415d4a16a tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:21.028800 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-55f2be1f-5eea-4b9f-bd15-ee4415d4a16a tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:21.029232 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-55f2be1f-5eea-4b9f-bd15-ee4415d4a16a tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:21.322202 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-55f2be1f-5eea-4b9f-bd15-ee4415d4a16a tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890735b21f5d4764aefd789f74e00222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9cf3129a4e4f56a17bebf68b7bc42b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:21.334596 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-55f2be1f-5eea-4b9f-bd15-ee4415d4a16a tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] 10.222.0.58 "GET /compute/v2.1/servers/10ede6f4-625a-4c5a-a5d6-d7d0f2476dee" status: 200 len: 1323 microversion: 2.1 time: 0.326264 Aug 10 23:03:21.335524 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 886/1750] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:03:21 2022] GET /compute/v2.1/servers/10ede6f4-625a-4c5a-a5d6-d7d0f2476dee => generated 1323 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:03:21.346750 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c4d1a2cb-fa41-4847-be1a-9d13cb477380 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:21.348862 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-c4d1a2cb-fa41-4847-be1a-9d13cb477380 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] [instance: 3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:21.357733 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c4d1a2cb-fa41-4847-be1a-9d13cb477380 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:21.358237 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c4d1a2cb-fa41-4847-be1a-9d13cb477380 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:21.358672 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c4d1a2cb-fa41-4847-be1a-9d13cb477380 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:21.359704 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c4d1a2cb-fa41-4847-be1a-9d13cb477380 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:21.360335 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c4d1a2cb-fa41-4847-be1a-9d13cb477380 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:21.360971 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c4d1a2cb-fa41-4847-be1a-9d13cb477380 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:21.475535 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-c4d1a2cb-fa41-4847-be1a-9d13cb477380 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:21.485706 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-c4d1a2cb-fa41-4847-be1a-9d13cb477380 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:21.486828 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-02f79569-2745-41c0-8cda-c2770a99d7c6 tempest-SecurityGroupRulesTestJSON-678387735 tempest-SecurityGroupRulesTestJSON-678387735-project] 10.222.0.58 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.575060 Aug 10 23:03:21.487319 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-c4d1a2cb-fa41-4847-be1a-9d13cb477380 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:21.488082 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 865/1751] 10.222.0.58 () {60 vars in 1195 bytes} [Wed Aug 10 23:03:20 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:03:21.493387 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-0e697d08-6ad0-4e1d-8724-b8d29283a0ce tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:21.494306 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-0e697d08-6ad0-4e1d-8724-b8d29283a0ce tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] [instance: 8fa0b7c8-ae4b-413c-9592-f4944cfb22fc] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:21.495314 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-c4d1a2cb-fa41-4847-be1a-9d13cb477380 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] 10.222.0.58 "GET /compute/v2.1/servers/3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51" status: 200 len: 1265 microversion: 2.25 time: 0.157391 Aug 10 23:03:21.495899 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 887/1752] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:03:21 2022] GET /compute/v2.1/servers/3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:03:21.525008 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0e697d08-6ad0-4e1d-8724-b8d29283a0ce tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:21.525679 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0e697d08-6ad0-4e1d-8724-b8d29283a0ce tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:21.526141 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0e697d08-6ad0-4e1d-8724-b8d29283a0ce tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:21.528886 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0e697d08-6ad0-4e1d-8724-b8d29283a0ce tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:21.529397 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0e697d08-6ad0-4e1d-8724-b8d29283a0ce tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:21.529840 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0e697d08-6ad0-4e1d-8724-b8d29283a0ce tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:21.545308 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-54c5f30f-5461-4449-bed6-8721883e3f0d tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:03:21.549663 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-54c5f30f-5461-4449-bed6-8721883e3f0d tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] [instance: 67accb8d-3e90-483c-a1e5-9a0c04a685c8] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:21.562359 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-54c5f30f-5461-4449-bed6-8721883e3f0d tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:21.563932 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-54c5f30f-5461-4449-bed6-8721883e3f0d tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:21.564421 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-54c5f30f-5461-4449-bed6-8721883e3f0d tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:21.565568 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-54c5f30f-5461-4449-bed6-8721883e3f0d tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:21.566275 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-54c5f30f-5461-4449-bed6-8721883e3f0d tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:21.566981 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-54c5f30f-5461-4449-bed6-8721883e3f0d tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:21.667212 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-54c5f30f-5461-4449-bed6-8721883e3f0d tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] 10.222.0.58 "POST /compute/v2.1/servers/67accb8d-3e90-483c-a1e5-9a0c04a685c8/action" status: 202 len: 0 microversion: 2.1 time: 0.155955 Aug 10 23:03:21.668337 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 888/1753] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:03:21 2022] POST /compute/v2.1/servers/67accb8d-3e90-483c-a1e5-9a0c04a685c8/action => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:03:21.687143 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-ed83732b-5674-480f-a568-e4000725d44d tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:21.688516 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-ed83732b-5674-480f-a568-e4000725d44d tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] [instance: 63d2bd74-d060-4925-9323-b39d5131f958] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:21.700010 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ed83732b-5674-480f-a568-e4000725d44d tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:21.700824 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ed83732b-5674-480f-a568-e4000725d44d tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:21.701701 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ed83732b-5674-480f-a568-e4000725d44d tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:21.704360 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ed83732b-5674-480f-a568-e4000725d44d tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:21.705020 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ed83732b-5674-480f-a568-e4000725d44d tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:21.705658 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ed83732b-5674-480f-a568-e4000725d44d tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:21.817318 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-0e697d08-6ad0-4e1d-8724-b8d29283a0ce tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be22a1243524178bdfea6892f27b255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f0030d3c62f48e6acd142058158e11e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:21.831784 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-0e697d08-6ad0-4e1d-8724-b8d29283a0ce tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] 10.222.0.58 "GET /compute/v2.1/servers/8fa0b7c8-ae4b-413c-9592-f4944cfb22fc" status: 200 len: 1470 microversion: 2.1 time: 0.342484 Aug 10 23:03:21.848557 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 866/1754] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:03:21 2022] GET /compute/v2.1/servers/8fa0b7c8-ae4b-413c-9592-f4944cfb22fc => generated 1470 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:03:21.856220 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-b2caf310-0792-430c-a6f1-ae4e92931eab tempest-SecurityGroupRulesTestJSON-678387735 tempest-SecurityGroupRulesTestJSON-678387735-project] Calling method '.version_select at 0x7f847d950d30>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:21.986718 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-ed83732b-5674-480f-a568-e4000725d44d tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632904331d024d9b8e4d3660dff2cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ed0bdee3aa4013bd9219069bda558c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:22.006462 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-ed83732b-5674-480f-a568-e4000725d44d tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] 10.222.0.58 "GET /compute/v2.1/servers/63d2bd74-d060-4925-9323-b39d5131f958" status: 200 len: 1199 microversion: 2.1 time: 0.335854 Aug 10 23:03:22.009225 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 889/1755] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:03:21 2022] GET /compute/v2.1/servers/63d2bd74-d060-4925-9323-b39d5131f958 => generated 1199 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:03:22.032005 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-9345d6d1-2199-4e49-bfc0-30379b944c6a tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:22.032974 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-9345d6d1-2199-4e49-bfc0-30379b944c6a tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] [instance: 67accb8d-3e90-483c-a1e5-9a0c04a685c8] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:22.040857 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9345d6d1-2199-4e49-bfc0-30379b944c6a tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:22.041686 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9345d6d1-2199-4e49-bfc0-30379b944c6a tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:22.042282 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9345d6d1-2199-4e49-bfc0-30379b944c6a tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:22.043192 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9345d6d1-2199-4e49-bfc0-30379b944c6a tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:22.044123 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9345d6d1-2199-4e49-bfc0-30379b944c6a tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:22.044757 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9345d6d1-2199-4e49-bfc0-30379b944c6a tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:22.053432 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-b2caf310-0792-430c-a6f1-ae4e92931eab tempest-SecurityGroupRulesTestJSON-678387735 tempest-SecurityGroupRulesTestJSON-678387735-project] 10.222.0.58 "GET /compute/v2.1/os-security-groups/47ea68d2-8308-410d-814e-196439ec4165" status: 200 len: 663 microversion: 2.1 time: 0.203421 Aug 10 23:03:22.055571 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 867/1756] 10.222.0.58 () {58 vars in 1269 bytes} [Wed Aug 10 23:03:21 2022] GET /compute/v2.1/os-security-groups/47ea68d2-8308-410d-814e-196439ec4165 => generated 663 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:03:22.067484 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-8af845d8-6fdb-423b-a429-7145c2d7ee3c tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:22.073235 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-8af845d8-6fdb-423b-a429-7145c2d7ee3c tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] [instance: 196377d7-c0d5-408b-9743-e1f451f71164] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:22.114493 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8af845d8-6fdb-423b-a429-7145c2d7ee3c tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:22.120065 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8af845d8-6fdb-423b-a429-7145c2d7ee3c tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:22.122713 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8af845d8-6fdb-423b-a429-7145c2d7ee3c tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:22.124935 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8af845d8-6fdb-423b-a429-7145c2d7ee3c tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:22.128116 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8af845d8-6fdb-423b-a429-7145c2d7ee3c tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:22.131813 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8af845d8-6fdb-423b-a429-7145c2d7ee3c tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:22.166564 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-8af845d8-6fdb-423b-a429-7145c2d7ee3c tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] HTTP exception thrown: Instance 196377d7-c0d5-408b-9743-e1f451f71164 could not be found. Aug 10 23:03:22.168722 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-8af845d8-6fdb-423b-a429-7145c2d7ee3c tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Request method failure captured: Aug 10 23:03:22.168722 n-d-850468-14 devstack@n-api.service[122632]: request: GET /compute/v2.1/servers/196377d7-c0d5-408b-9743-e1f451f71164 HTTP/1.1 Aug 10 23:03:22.168722 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:03:22.168722 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:03:22.168722 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:03:22.168722 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 23:03:22.168722 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:03:22.168722 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:03:22.168722 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:03:22.168722 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:03:22.168722 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9DhnJQVy677u4b7dnMoSItqtWsJm27g_Vg031CYXViqt8YYY7d4cXYrgXs0Pp9xS3IIxdwWgPKq2sDULWw--Li9t2t8l1R3feSY4uh4FysmLVRfKNCAYvKF_tmPQ5ZUjwhrC4jAx70ULoXcE-6wvpA-wHk_CVzAxHX7IWuhEQLk8ZDk Aug 10 23:03:22.168722 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:03:22.168722 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:03:22.168722 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:03:22.168722 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:03:22.168722 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:03:22.168722 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:03:22.168722 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: b27e6ee9495a438b8450a4ef0d62cbcd Aug 10 23:03:22.168722 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-ServersOnMultiNodesTest-936995831 Aug 10 23:03:22.168722 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:03:22.168722 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:03:22.170319 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b27e6ee9495a438b8450a4ef0d62cbcd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b27e6ee9495a438b8450a4ef0d62cbcd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b27e6ee9495a438b8450a4ef0d62cbcd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b27e6ee9495a438b8450a4ef0d62cbcd", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:03:22.170319 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-ServersOnMultiNodesTest-936995831 Aug 10 23:03:22.170319 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: b27e6ee9495a438b8450a4ef0d62cbcd Aug 10 23:03:22.170319 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-936995831 Aug 10 23:03:22.170319 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-ServersOnMultiNodesTest-936995831-project Aug 10 23:03:22.170319 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:03:22.170319 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:03:22.170319 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: 417d4eaaeb1c4df78745496ececb3e88 Aug 10 23:03:22.170319 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-ServersOnMultiNodesTest-936995831-project Aug 10 23:03:22.170319 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:03:22.170319 n-d-850468-14 devstack@n-api.service[122632]: exception: Instance 196377d7-c0d5-408b-9743-e1f451f71164 could not be found. Aug 10 23:03:22.170319 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': '196377d7-c0d5-408b-9743-e1f451f71164'} Aug 10 23:03:22.171579 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:03:22.171579 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:03:22.171579 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:03:22.171579 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:03:22.171579 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:03:22.171579 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:03:22.171579 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:03:22.171579 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:03:22.171579 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:03:22.171579 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:03:22.171579 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 196377d7-c0d5-408b-9743-e1f451f71164 could not be found. Aug 10 23:03:22.171579 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:03:22.171579 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:03:22.171579 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:03:22.171579 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:03:22.171579 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:03:22.171579 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:03:22.171579 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:03:22.171579 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:03:22.171579 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:03:22.173263 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:03:22.173263 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:03:22.173263 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:03:22.173263 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:03:22.173263 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:03:22.173263 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:03:22.173263 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:03:22.173263 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 196377d7-c0d5-408b-9743-e1f451f71164 could not be found. Aug 10 23:03:22.173263 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:03:22.173263 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:03:22.173263 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:03:22.173263 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:03:22.173263 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:03:22.173263 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:03:22.173263 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:03:22.173263 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:03:22.173263 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 196377d7-c0d5-408b-9743-e1f451f71164 could not be found. Aug 10 23:03:22.173263 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:03:22.177254 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-8af845d8-6fdb-423b-a429-7145c2d7ee3c tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Returning 404 to user: Instance 196377d7-c0d5-408b-9743-e1f451f71164 could not be found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:03:22.178437 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-8af845d8-6fdb-423b-a429-7145c2d7ee3c tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] 10.222.0.58 "GET /compute/v2.1/servers/196377d7-c0d5-408b-9743-e1f451f71164" status: 404 len: 111 microversion: 2.1 time: 0.120806 Aug 10 23:03:22.179292 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 868/1757] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:03:22 2022] GET /compute/v2.1/servers/196377d7-c0d5-408b-9743-e1f451f71164 => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:03:22.186298 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-d9505073-057e-4314-a2ed-6d96766fc991 tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:22.187450 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-d9505073-057e-4314-a2ed-6d96766fc991 tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] [instance: 8fa0b7c8-ae4b-413c-9592-f4944cfb22fc] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:22.203566 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d9505073-057e-4314-a2ed-6d96766fc991 tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:22.204508 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d9505073-057e-4314-a2ed-6d96766fc991 tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:22.205314 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d9505073-057e-4314-a2ed-6d96766fc991 tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:22.206528 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d9505073-057e-4314-a2ed-6d96766fc991 tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:22.207625 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d9505073-057e-4314-a2ed-6d96766fc991 tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:22.208450 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d9505073-057e-4314-a2ed-6d96766fc991 tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:22.266633 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-d9505073-057e-4314-a2ed-6d96766fc991 tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': '4be22a1243524178bdfea6892f27b255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f0030d3c62f48e6acd142058158e11e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:22.273789 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-d9505073-057e-4314-a2ed-6d96766fc991 tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] Request method failure captured: Aug 10 23:03:22.273789 n-d-850468-14 devstack@n-api.service[122632]: request: GET /compute/v2.1/servers/8fa0b7c8-ae4b-413c-9592-f4944cfb22fc/diagnostics HTTP/1.1 Aug 10 23:03:22.273789 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:03:22.273789 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:03:22.273789 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:03:22.273789 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 23:03:22.273789 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:03:22.273789 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:03:22.273789 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:03:22.273789 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:03:22.273789 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9DkYv6GyycjQ7NberlZDcpD4pGTWTvP64gS5fVSvaIapDd4YgcyAVXryQd3NNjtTimBRuvuk-lAQCLGntqlvt4b_hgq8mUxJ85uNMD1Z3aFz9qUe1OlYZC5KJLec0pvHBGgZf_0S8O_LhF2Dkx0pT2f7HkbSuJFqqcq8qvgFYsK3mpg Aug 10 23:03:22.273789 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:03:22.273789 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:03:22.273789 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:03:22.273789 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:03:22.273789 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:03:22.273789 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:03:22.273789 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 7f0030d3c62f48e6acd142058158e11e Aug 10 23:03:22.273789 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-112441911 Aug 10 23:03:22.273789 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:03:22.273789 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:03:22.276299 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7f0030d3c62f48e6acd142058158e11e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7f0030d3c62f48e6acd142058158e11e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7f0030d3c62f48e6acd142058158e11e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7f0030d3c62f48e6acd142058158e11e", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:03:22.276299 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-112441911 Aug 10 23:03:22.276299 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 7f0030d3c62f48e6acd142058158e11e Aug 10 23:03:22.276299 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-112441911 Aug 10 23:03:22.276299 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-ServerDiagnosticsNegativeTest-112441911-project Aug 10 23:03:22.276299 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:03:22.276299 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:03:22.276299 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: 4be22a1243524178bdfea6892f27b255 Aug 10 23:03:22.276299 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-112441911-project Aug 10 23:03:22.276299 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:03:22.276299 n-d-850468-14 devstack@n-api.service[122632]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Aug 10 23:03:22.277800 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'server_id': '8fa0b7c8-ae4b-413c-9592-f4944cfb22fc'} Aug 10 23:03:22.277800 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:03:22.277800 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:03:22.277800 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:03:22.277800 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:03:22.277800 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:03:22.277800 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:03:22.277800 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:03:22.277800 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:03:22.277800 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Aug 10 23:03:22.277800 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Aug 10 23:03:22.277800 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 10 23:03:22.277800 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 10 23:03:22.277800 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 10 23:03:22.277800 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 10 23:03:22.277800 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 10 23:03:22.277800 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 10 23:03:22.277800 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 10 23:03:22.277800 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise self.value Aug 10 23:03:22.277800 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 10 23:03:22.281864 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 10 23:03:22.281864 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 10 23:03:22.281864 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 10 23:03:22.281864 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 10 23:03:22.281864 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 10 23:03:22.281864 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Aug 10 23:03:22.281864 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:03:22.281864 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:03:22.281864 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:03:22.281864 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:03:22.281864 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:03:22.281864 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:03:22.281864 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 10 23:03:22.281864 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 10 23:03:22.281864 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Aug 10 23:03:22.281864 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:03:22.281864 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-d9505073-057e-4314-a2ed-6d96766fc991 tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:03:22.286544 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-d9505073-057e-4314-a2ed-6d96766fc991 tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] 10.222.0.58 "GET /compute/v2.1/servers/8fa0b7c8-ae4b-413c-9592-f4944cfb22fc/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.097517 Aug 10 23:03:22.286544 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 869/1758] 10.222.0.58 () {58 vars in 1272 bytes} [Wed Aug 10 23:03:22 2022] GET /compute/v2.1/servers/8fa0b7c8-ae4b-413c-9592-f4944cfb22fc/diagnostics => generated 117 bytes in 103 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:03:22.296441 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-24bb14a9-acf1-41f2-92b1-b48c465e8aa3 tempest-SecurityGroupRulesTestJSON-678387735 tempest-SecurityGroupRulesTestJSON-678387735-project] Calling method '.version_select at 0x7f847d2060d0>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:22.341119 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-9345d6d1-2199-4e49-bfc0-30379b944c6a tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfd6d8e6a8444f5b9fcf1cf8da242ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707f869910b34768ae1a348cd0b5f284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:22.353614 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-9345d6d1-2199-4e49-bfc0-30379b944c6a tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] 10.222.0.58 "GET /compute/v2.1/servers/67accb8d-3e90-483c-a1e5-9a0c04a685c8" status: 200 len: 1574 microversion: 2.1 time: 0.325431 Aug 10 23:03:22.356768 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 890/1759] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:03:22 2022] GET /compute/v2.1/servers/67accb8d-3e90-483c-a1e5-9a0c04a685c8 => generated 1574 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:03:22.372254 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c88730dd-0fca-42ed-821c-a31405f6e0ee tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:22.380429 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-c88730dd-0fca-42ed-821c-a31405f6e0ee tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] [instance: ad02bba7-86a5-4148-a83e-0fbd71645e4a] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:22.396342 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c88730dd-0fca-42ed-821c-a31405f6e0ee tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:22.400597 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c88730dd-0fca-42ed-821c-a31405f6e0ee tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:22.401292 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c88730dd-0fca-42ed-821c-a31405f6e0ee tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:22.402224 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c88730dd-0fca-42ed-821c-a31405f6e0ee tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:22.406202 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c88730dd-0fca-42ed-821c-a31405f6e0ee tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:22.406911 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c88730dd-0fca-42ed-821c-a31405f6e0ee tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:22.499811 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-c88730dd-0fca-42ed-821c-a31405f6e0ee tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] [instance: ad02bba7-86a5-4148-a83e-0fbd71645e4a] Going to try to terminate instance {{(pid=122633) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:03:22.685630 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-c88730dd-0fca-42ed-821c-a31405f6e0ee tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] 10.222.0.58 "DELETE /compute/v2.1/servers/ad02bba7-86a5-4148-a83e-0fbd71645e4a" status: 204 len: 0 microversion: 2.1 time: 0.326440 Aug 10 23:03:22.691113 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 891/1760] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:03:22 2022] DELETE /compute/v2.1/servers/ad02bba7-86a5-4148-a83e-0fbd71645e4a => generated 0 bytes in 329 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:03:22.713374 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-5e66f56e-9f9f-4e83-9382-64fcc52552d8 tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:22.714282 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-5e66f56e-9f9f-4e83-9382-64fcc52552d8 tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] [instance: 8fa0b7c8-ae4b-413c-9592-f4944cfb22fc] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:22.727278 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5e66f56e-9f9f-4e83-9382-64fcc52552d8 tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:22.728336 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5e66f56e-9f9f-4e83-9382-64fcc52552d8 tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:22.728336 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5e66f56e-9f9f-4e83-9382-64fcc52552d8 tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:22.729068 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5e66f56e-9f9f-4e83-9382-64fcc52552d8 tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:22.729602 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5e66f56e-9f9f-4e83-9382-64fcc52552d8 tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:22.729943 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5e66f56e-9f9f-4e83-9382-64fcc52552d8 tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:22.774411 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-5e66f56e-9f9f-4e83-9382-64fcc52552d8 tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] [instance: 8fa0b7c8-ae4b-413c-9592-f4944cfb22fc] Going to try to terminate instance {{(pid=122633) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:03:22.780969 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-24bb14a9-acf1-41f2-92b1-b48c465e8aa3 tempest-SecurityGroupRulesTestJSON-678387735 tempest-SecurityGroupRulesTestJSON-678387735-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-group-rules/5b0d7857-7bcd-4d37-bb45-c75edde4a130" status: 202 len: 0 microversion: 2.1 time: 0.495732 Aug 10 23:03:22.785962 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 870/1761] 10.222.0.58 () {58 vars in 1287 bytes} [Wed Aug 10 23:03:22 2022] DELETE /compute/v2.1/os-security-group-rules/5b0d7857-7bcd-4d37-bb45-c75edde4a130 => generated 0 bytes in 499 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:03:22.787628 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-a6795e95-e393-4ef5-8b5b-4dbded301251 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:22.788249 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-a6795e95-e393-4ef5-8b5b-4dbded301251 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] [instance: 10ede6f4-625a-4c5a-a5d6-d7d0f2476dee] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:22.802181 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a6795e95-e393-4ef5-8b5b-4dbded301251 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:22.803424 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a6795e95-e393-4ef5-8b5b-4dbded301251 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:22.803879 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a6795e95-e393-4ef5-8b5b-4dbded301251 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:22.805124 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a6795e95-e393-4ef5-8b5b-4dbded301251 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:22.805778 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a6795e95-e393-4ef5-8b5b-4dbded301251 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:22.806503 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a6795e95-e393-4ef5-8b5b-4dbded301251 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:22.892327 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:03:23.006102 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-a6795e95-e393-4ef5-8b5b-4dbded301251 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890735b21f5d4764aefd789f74e00222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9cf3129a4e4f56a17bebf68b7bc42b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:23.014828 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-5e66f56e-9f9f-4e83-9382-64fcc52552d8 tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] 10.222.0.58 "DELETE /compute/v2.1/servers/8fa0b7c8-ae4b-413c-9592-f4944cfb22fc" status: 204 len: 0 microversion: 2.1 time: 0.321023 Aug 10 23:03:23.016107 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 892/1762] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:03:22 2022] DELETE /compute/v2.1/servers/8fa0b7c8-ae4b-413c-9592-f4944cfb22fc => generated 0 bytes in 324 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:03:23.017980 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-a6795e95-e393-4ef5-8b5b-4dbded301251 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] 10.222.0.58 "GET /compute/v2.1/servers/10ede6f4-625a-4c5a-a5d6-d7d0f2476dee" status: 200 len: 1323 microversion: 2.1 time: 0.234093 Aug 10 23:03:23.022511 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-143c563a-fb18-45f6-8de0-d968d7c76770 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:23.023314 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-143c563a-fb18-45f6-8de0-d968d7c76770 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] [instance: 3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:23.027202 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 871/1763] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:03:22 2022] GET /compute/v2.1/servers/10ede6f4-625a-4c5a-a5d6-d7d0f2476dee => generated 1323 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:03:23.031826 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-143c563a-fb18-45f6-8de0-d968d7c76770 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:23.032562 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-143c563a-fb18-45f6-8de0-d968d7c76770 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:23.033232 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-143c563a-fb18-45f6-8de0-d968d7c76770 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:23.034131 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-143c563a-fb18-45f6-8de0-d968d7c76770 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:23.034751 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-143c563a-fb18-45f6-8de0-d968d7c76770 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:23.035509 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-143c563a-fb18-45f6-8de0-d968d7c76770 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:23.044295 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-b070b9e2-7168-4d85-8256-56e01ab55c6a tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:23.047534 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-b070b9e2-7168-4d85-8256-56e01ab55c6a tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] [instance: 0c897f8e-81a6-4929-85ed-9d9e8d6ec2cc] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:23.053885 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-143c563a-fb18-45f6-8de0-d968d7c76770 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] HTTP exception thrown: Instance 3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51 could not be found. Aug 10 23:03:23.057720 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-143c563a-fb18-45f6-8de0-d968d7c76770 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Request method failure captured: Aug 10 23:03:23.057720 n-d-850468-14 devstack@n-api.service[122633]: request: GET /compute/v2.1/servers/3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51 HTTP/1.1 Aug 10 23:03:23.057720 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:03:23.057720 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:03:23.057720 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:03:23.057720 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:03:23.057720 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:03:23.057720 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:03:23.057720 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:03:23.057720 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:03:23.057720 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9DeXYkYLR9CQVdccVgq1hPt0DrO7Y-Tqsq3tzOpEmY8RKTZKEbj7rqP5rBgNFt9k52KejWIWfCOOWUkHukYq1jM7AQrc94vGo1O5nAgAlIU3PqIOLdYIPmLGjLIoW_vctUlJlDlwGinCVbduLE5oYkTQOwNuHIPOOO5NqXrRvcyb7gQ Aug 10 23:03:23.057720 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:03:23.057720 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:03:23.057720 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:03:23.057720 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:03:23.057720 n-d-850468-14 devstack@n-api.service[122633]: X-Openstack-Nova-Api-Version: 2.25 Aug 10 23:03:23.057720 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:03:23.057720 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:03:23.057720 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: b4355fdc73c84fa2baf0d5c9a33e69d5 Aug 10 23:03:23.057720 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1885042872 Aug 10 23:03:23.057720 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:03:23.057720 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:03:23.059831 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b4355fdc73c84fa2baf0d5c9a33e69d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b4355fdc73c84fa2baf0d5c9a33e69d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b4355fdc73c84fa2baf0d5c9a33e69d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b4355fdc73c84fa2baf0d5c9a33e69d5", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:03:23.059831 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1885042872 Aug 10 23:03:23.059831 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: b4355fdc73c84fa2baf0d5c9a33e69d5 Aug 10 23:03:23.059831 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1885042872 Aug 10 23:03:23.059831 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-LiveAutoBlockMigrationV225Test-1885042872-project Aug 10 23:03:23.059831 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:03:23.059831 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:03:23.059831 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 394f0e6843424c7b83d2dfff61f66ede Aug 10 23:03:23.059831 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1885042872-project Aug 10 23:03:23.059831 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:03:23.059831 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance 3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51 could not be found. Aug 10 23:03:23.059831 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': '3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51'} Aug 10 23:03:23.060794 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:03:23.060794 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:03:23.060794 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:03:23.060794 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:03:23.060794 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:03:23.060794 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:03:23.060794 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:03:23.060794 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:03:23.060794 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:03:23.060794 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:03:23.060794 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51 could not be found. Aug 10 23:03:23.060794 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:03:23.060794 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:03:23.060794 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:03:23.060794 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:03:23.060794 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:03:23.060794 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:03:23.060794 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:03:23.060794 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:03:23.060794 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:03:23.062458 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:03:23.062458 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:03:23.062458 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:03:23.062458 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:03:23.062458 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:03:23.062458 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:03:23.062458 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:03:23.062458 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51 could not be found. Aug 10 23:03:23.062458 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:03:23.062458 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:03:23.062458 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:03:23.062458 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:03:23.062458 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:03:23.062458 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:03:23.062458 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:03:23.062458 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:03:23.062458 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51 could not be found. Aug 10 23:03:23.062458 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:03:23.067429 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-143c563a-fb18-45f6-8de0-d968d7c76770 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Returning 404 to user: Instance 3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51 could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:03:23.068582 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-143c563a-fb18-45f6-8de0-d968d7c76770 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] 10.222.0.58 "GET /compute/v2.1/servers/3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51" status: 404 len: 111 microversion: 2.25 time: 0.051231 Aug 10 23:03:23.070243 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 893/1764] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:03:23 2022] GET /compute/v2.1/servers/3b379fe3-5b68-4b3a-86f9-ada6c0f2ea51 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 10 23:03:23.077990 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-f808e13e-e63d-409c-8399-50602bcefb2d tempest-SecurityGroupRulesTestJSON-678387735 tempest-SecurityGroupRulesTestJSON-678387735-project] Calling method '.version_select at 0x7f847d31ddc0>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:23.078834 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b070b9e2-7168-4d85-8256-56e01ab55c6a tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:23.079511 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b070b9e2-7168-4d85-8256-56e01ab55c6a tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:23.080060 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b070b9e2-7168-4d85-8256-56e01ab55c6a tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:23.080894 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b070b9e2-7168-4d85-8256-56e01ab55c6a tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:23.081534 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b070b9e2-7168-4d85-8256-56e01ab55c6a tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:23.082089 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b070b9e2-7168-4d85-8256-56e01ab55c6a tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:23.119137 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-b070b9e2-7168-4d85-8256-56e01ab55c6a tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] [instance: 0c897f8e-81a6-4929-85ed-9d9e8d6ec2cc] Going to try to terminate instance {{(pid=122632) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:03:23.302484 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-b070b9e2-7168-4d85-8256-56e01ab55c6a tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] 10.222.0.58 "DELETE /compute/v2.1/servers/0c897f8e-81a6-4929-85ed-9d9e8d6ec2cc" status: 204 len: 0 microversion: 2.1 time: 0.270514 Aug 10 23:03:23.304176 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 872/1765] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:03:23 2022] DELETE /compute/v2.1/servers/0c897f8e-81a6-4929-85ed-9d9e8d6ec2cc => generated 0 bytes in 276 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:03:23.332696 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-adfd5a33-8a55-44a6-83d3-196051bc48ea tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:23.340615 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-adfd5a33-8a55-44a6-83d3-196051bc48ea tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] [instance: 8fa0b7c8-ae4b-413c-9592-f4944cfb22fc] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:23.369916 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-adfd5a33-8a55-44a6-83d3-196051bc48ea tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:23.374458 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-adfd5a33-8a55-44a6-83d3-196051bc48ea tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:23.375806 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-adfd5a33-8a55-44a6-83d3-196051bc48ea tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:23.379825 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-adfd5a33-8a55-44a6-83d3-196051bc48ea tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:23.380586 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-adfd5a33-8a55-44a6-83d3-196051bc48ea tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:23.381932 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-adfd5a33-8a55-44a6-83d3-196051bc48ea tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:23.521910 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-f808e13e-e63d-409c-8399-50602bcefb2d tempest-SecurityGroupRulesTestJSON-678387735 tempest-SecurityGroupRulesTestJSON-678387735-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/47ea68d2-8308-410d-814e-196439ec4165" status: 202 len: 0 microversion: 2.1 time: 0.449167 Aug 10 23:03:23.523192 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 894/1766] 10.222.0.58 () {58 vars in 1272 bytes} [Wed Aug 10 23:03:23 2022] DELETE /compute/v2.1/os-security-groups/47ea68d2-8308-410d-814e-196439ec4165 => generated 0 bytes in 451 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:03:23.529962 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-9b385678-5ac2-4aa4-9016-1c2c379b5459 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:23.531294 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-9b385678-5ac2-4aa4-9016-1c2c379b5459 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] [instance: 63d2bd74-d060-4925-9323-b39d5131f958] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:23.548676 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9b385678-5ac2-4aa4-9016-1c2c379b5459 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:23.549824 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9b385678-5ac2-4aa4-9016-1c2c379b5459 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:23.556476 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9b385678-5ac2-4aa4-9016-1c2c379b5459 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:23.558001 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9b385678-5ac2-4aa4-9016-1c2c379b5459 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:23.558751 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9b385678-5ac2-4aa4-9016-1c2c379b5459 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:23.559503 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9b385678-5ac2-4aa4-9016-1c2c379b5459 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:23.647031 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-adfd5a33-8a55-44a6-83d3-196051bc48ea tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be22a1243524178bdfea6892f27b255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f0030d3c62f48e6acd142058158e11e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:23.656522 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-adfd5a33-8a55-44a6-83d3-196051bc48ea tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] 10.222.0.58 "GET /compute/v2.1/servers/8fa0b7c8-ae4b-413c-9592-f4944cfb22fc" status: 200 len: 1476 microversion: 2.1 time: 0.348230 Aug 10 23:03:23.660104 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 873/1767] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:03:23 2022] GET /compute/v2.1/servers/8fa0b7c8-ae4b-413c-9592-f4944cfb22fc => generated 1476 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:03:23.671301 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-34ef6478-9da6-4e3a-afb6-1cfc177a1039 req-b0cb78d9-84bc-490d-b51c-be6065c99a9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10ede6f4-625a-4c5a-a5d6-d7d0f2476dee", "name": "network-vif-plugged", "status": "completed", "tag": "cddf9930-172d-4081-9a2f-2ad8b6fc95e2"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:03:23.681825 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-34ef6478-9da6-4e3a-afb6-1cfc177a1039 req-b0cb78d9-84bc-490d-b51c-be6065c99a9d service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:23.682681 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-34ef6478-9da6-4e3a-afb6-1cfc177a1039 req-b0cb78d9-84bc-490d-b51c-be6065c99a9d service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:23.683213 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-34ef6478-9da6-4e3a-afb6-1cfc177a1039 req-b0cb78d9-84bc-490d-b51c-be6065c99a9d service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:23.697298 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-34ef6478-9da6-4e3a-afb6-1cfc177a1039 req-b0cb78d9-84bc-490d-b51c-be6065c99a9d service nova] Creating event network-vif-plugged:cddf9930-172d-4081-9a2f-2ad8b6fc95e2 for instance 10ede6f4-625a-4c5a-a5d6-d7d0f2476dee on n-h2-850468-14 Aug 10 23:03:23.703204 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-34ef6478-9da6-4e3a-afb6-1cfc177a1039 req-b0cb78d9-84bc-490d-b51c-be6065c99a9d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041788 Aug 10 23:03:23.704462 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 874/1768] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:03:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:03:23.712542 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-ddb7c624-a1ed-4169-b9c0-4ec61d2dff1b tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:23.713569 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-ddb7c624-a1ed-4169-b9c0-4ec61d2dff1b tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] [instance: ad02bba7-86a5-4148-a83e-0fbd71645e4a] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:23.720611 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ddb7c624-a1ed-4169-b9c0-4ec61d2dff1b tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:23.721423 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ddb7c624-a1ed-4169-b9c0-4ec61d2dff1b tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:23.722085 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ddb7c624-a1ed-4169-b9c0-4ec61d2dff1b tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:23.723052 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ddb7c624-a1ed-4169-b9c0-4ec61d2dff1b tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:23.723746 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ddb7c624-a1ed-4169-b9c0-4ec61d2dff1b tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:23.724361 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ddb7c624-a1ed-4169-b9c0-4ec61d2dff1b tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:23.840925 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-9b385678-5ac2-4aa4-9016-1c2c379b5459 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632904331d024d9b8e4d3660dff2cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ed0bdee3aa4013bd9219069bda558c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:23.852153 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-9b385678-5ac2-4aa4-9016-1c2c379b5459 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] 10.222.0.58 "GET /compute/v2.1/servers/63d2bd74-d060-4925-9323-b39d5131f958" status: 200 len: 1199 microversion: 2.1 time: 0.326217 Aug 10 23:03:23.853761 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 895/1769] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:03:23 2022] GET /compute/v2.1/servers/63d2bd74-d060-4925-9323-b39d5131f958 => generated 1199 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:03:23.874247 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-aac79fc1-9d7f-4cd5-b1e8-2eb81cb41f1f tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:23.876498 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-aac79fc1-9d7f-4cd5-b1e8-2eb81cb41f1f tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] [instance: 67accb8d-3e90-483c-a1e5-9a0c04a685c8] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:23.892359 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-aac79fc1-9d7f-4cd5-b1e8-2eb81cb41f1f tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:23.892906 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-aac79fc1-9d7f-4cd5-b1e8-2eb81cb41f1f tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:23.893357 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-aac79fc1-9d7f-4cd5-b1e8-2eb81cb41f1f tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:23.894088 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-aac79fc1-9d7f-4cd5-b1e8-2eb81cb41f1f tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:23.894542 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-aac79fc1-9d7f-4cd5-b1e8-2eb81cb41f1f tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:23.895008 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-aac79fc1-9d7f-4cd5-b1e8-2eb81cb41f1f tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:24.001856 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-ddb7c624-a1ed-4169-b9c0-4ec61d2dff1b tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '417d4eaaeb1c4df78745496ececb3e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27e6ee9495a438b8450a4ef0d62cbcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:24.010197 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-ddb7c624-a1ed-4169-b9c0-4ec61d2dff1b tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] 10.222.0.58 "GET /compute/v2.1/servers/ad02bba7-86a5-4148-a83e-0fbd71645e4a" status: 200 len: 1475 microversion: 2.1 time: 0.304231 Aug 10 23:03:24.015421 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 875/1770] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:03:23 2022] GET /compute/v2.1/servers/ad02bba7-86a5-4148-a83e-0fbd71645e4a => generated 1475 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:03:24.020796 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c82b3a6e-3986-4893-91f2-645f31825067 tempest-SecurityGroupRulesTestJSON-678387735 tempest-SecurityGroupRulesTestJSON-678387735-project] Calling method '.version_select at 0x7f847d1c6f70>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:24.044563 n-d-850468-14 devstack@n-api.service[122632]: DEBUG neutronclient.v2_0.client [None req-c82b3a6e-3986-4893-91f2-645f31825067 tempest-SecurityGroupRulesTestJSON-678387735 tempest-SecurityGroupRulesTestJSON-678387735-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 3e727766-813c-4e81-98c4-d1e6eaba9285 does not exist", "detail": ""}} {{(pid=122632) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 10 23:03:24.045178 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.network.security_group_api [None req-c82b3a6e-3986-4893-91f2-645f31825067 tempest-SecurityGroupRulesTestJSON-678387735 tempest-SecurityGroupRulesTestJSON-678387735-project] Neutron security group 3e727766-813c-4e81-98c4-d1e6eaba9285 not found {{(pid=122632) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 10 23:03:24.045798 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-c82b3a6e-3986-4893-91f2-645f31825067 tempest-SecurityGroupRulesTestJSON-678387735 tempest-SecurityGroupRulesTestJSON-678387735-project] HTTP exception thrown: Security group 3e727766-813c-4e81-98c4-d1e6eaba9285 does not exist Aug 10 23:03:24.045798 n-d-850468-14 devstack@n-api.service[122632]: Neutron server returns request_ids: ['req-7e6d2925-ba94-4572-9612-6fca0832dc6b'] Aug 10 23:03:24.047681 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c82b3a6e-3986-4893-91f2-645f31825067 tempest-SecurityGroupRulesTestJSON-678387735 tempest-SecurityGroupRulesTestJSON-678387735-project] Request method failure captured: Aug 10 23:03:24.047681 n-d-850468-14 devstack@n-api.service[122632]: request: DELETE /compute/v2.1/os-security-groups/3e727766-813c-4e81-98c4-d1e6eaba9285 HTTP/1.1 Aug 10 23:03:24.047681 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:03:24.047681 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:03:24.047681 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:03:24.047681 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 23:03:24.047681 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:03:24.047681 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:03:24.047681 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:03:24.047681 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:03:24.047681 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9DkmcGN9HL4LTiGE-NEWEIAvrulr5WTBG3pkAtz5K6IDW5cnXIvKaXlUK40IlQEfo8Bi0JUmenGVvJT0FBu6MsWShFVpi9kJzu95Yt_5bqUu19CgcGEbS4gg3AUN_GjnenDzMoreo-eqthpATWwWWl9npWrnoDygt9xSdg7eEe13EfQ Aug 10 23:03:24.047681 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:03:24.047681 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:03:24.047681 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:03:24.047681 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:03:24.047681 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:03:24.047681 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:03:24.047681 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 0f77b5ef0a744b7fa4a76311a29e85b3 Aug 10 23:03:24.047681 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-678387735 Aug 10 23:03:24.047681 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:03:24.047681 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:03:24.049363 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0f77b5ef0a744b7fa4a76311a29e85b3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0f77b5ef0a744b7fa4a76311a29e85b3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/0f77b5ef0a744b7fa4a76311a29e85b3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_0f77b5ef0a744b7fa4a76311a29e85b3", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:03:24.049363 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-SecurityGroupRulesTestJSON-678387735 Aug 10 23:03:24.049363 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 0f77b5ef0a744b7fa4a76311a29e85b3 Aug 10 23:03:24.049363 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-678387735 Aug 10 23:03:24.049363 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-SecurityGroupRulesTestJSON-678387735-project Aug 10 23:03:24.049363 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:03:24.049363 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:03:24.049363 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: d804ad31f97c4b5bab5d3b6eb8126454 Aug 10 23:03:24.049363 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-SecurityGroupRulesTestJSON-678387735-project Aug 10 23:03:24.049363 n-d-850468-14 devstack@n-api.service[122632]: method: Aug 10 23:03:24.049363 n-d-850468-14 devstack@n-api.service[122632]: exception: Security group 3e727766-813c-4e81-98c4-d1e6eaba9285 does not exist Aug 10 23:03:24.049363 n-d-850468-14 devstack@n-api.service[122632]: Neutron server returns request_ids: ['req-7e6d2925-ba94-4572-9612-6fca0832dc6b'] Aug 10 23:03:24.049363 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': '3e727766-813c-4e81-98c4-d1e6eaba9285'} Aug 10 23:03:24.050327 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:03:24.050327 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:03:24.050327 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 10 23:03:24.050327 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 10 23:03:24.050327 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 23:03:24.050327 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 23:03:24.050327 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 10 23:03:24.050327 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 10 23:03:24.050327 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 23:03:24.050327 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 23:03:24.050327 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 23:03:24.050327 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 23:03:24.050327 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 23:03:24.050327 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 23:03:24.050327 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 23:03:24.050327 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 23:03:24.050327 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 23:03:24.050327 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 23:03:24.050327 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 10 23:03:24.051702 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 10 23:03:24.051702 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 23:03:24.051702 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 23:03:24.051702 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 10 23:03:24.051702 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 10 23:03:24.051702 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 10 23:03:24.051702 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 10 23:03:24.051702 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 3e727766-813c-4e81-98c4-d1e6eaba9285 does not exist Aug 10 23:03:24.051702 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7e6d2925-ba94-4572-9612-6fca0832dc6b'] Aug 10 23:03:24.051702 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:03:24.051702 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:03:24.051702 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:03:24.051702 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:03:24.051702 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 10 23:03:24.051702 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 10 23:03:24.051702 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 10 23:03:24.051702 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 10 23:03:24.051702 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 3e727766-813c-4e81-98c4-d1e6eaba9285 does not exist Aug 10 23:03:24.054593 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7e6d2925-ba94-4572-9612-6fca0832dc6b'] Aug 10 23:03:24.054593 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:03:24.054593 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:03:24.054593 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:03:24.054593 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:03:24.054593 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:03:24.054593 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:03:24.054593 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:03:24.054593 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:03:24.054593 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 23:03:24.054593 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 23:03:24.054593 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:03:24.054593 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:03:24.054593 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 10 23:03:24.054593 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 10 23:03:24.054593 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 3e727766-813c-4e81-98c4-d1e6eaba9285 does not exist Aug 10 23:03:24.054593 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7e6d2925-ba94-4572-9612-6fca0832dc6b'] Aug 10 23:03:24.054593 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:03:24.054593 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:03:24.054593 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:03:24.054593 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:03:24.058231 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:03:24.058231 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:03:24.058231 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:03:24.058231 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:03:24.058231 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 3e727766-813c-4e81-98c4-d1e6eaba9285 does not exist Aug 10 23:03:24.058231 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7e6d2925-ba94-4572-9612-6fca0832dc6b'] Aug 10 23:03:24.058231 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:03:24.058231 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c82b3a6e-3986-4893-91f2-645f31825067 tempest-SecurityGroupRulesTestJSON-678387735 tempest-SecurityGroupRulesTestJSON-678387735-project] Returning 404 to user: Security group 3e727766-813c-4e81-98c4-d1e6eaba9285 does not exist Aug 10 23:03:24.058231 n-d-850468-14 devstack@n-api.service[122632]: Neutron server returns request_ids: ['req-7e6d2925-ba94-4572-9612-6fca0832dc6b'] {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:03:24.058231 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-c82b3a6e-3986-4893-91f2-645f31825067 tempest-SecurityGroupRulesTestJSON-678387735 tempest-SecurityGroupRulesTestJSON-678387735-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/3e727766-813c-4e81-98c4-d1e6eaba9285" status: 404 len: 194 microversion: 2.1 time: 0.032688 Aug 10 23:03:24.058231 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 876/1771] 10.222.0.58 () {58 vars in 1272 bytes} [Wed Aug 10 23:03:24 2022] DELETE /compute/v2.1/os-security-groups/3e727766-813c-4e81-98c4-d1e6eaba9285 => generated 194 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:03:24.060455 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c50af0b8-9610-49cc-a3b9-562a3e6d509d tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:24.060455 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-c50af0b8-9610-49cc-a3b9-562a3e6d509d tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] [instance: 10ede6f4-625a-4c5a-a5d6-d7d0f2476dee] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:24.067394 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c50af0b8-9610-49cc-a3b9-562a3e6d509d tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:24.067970 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c50af0b8-9610-49cc-a3b9-562a3e6d509d tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:24.068352 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c50af0b8-9610-49cc-a3b9-562a3e6d509d tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:24.069312 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c50af0b8-9610-49cc-a3b9-562a3e6d509d tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:24.069828 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c50af0b8-9610-49cc-a3b9-562a3e6d509d tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:24.070336 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c50af0b8-9610-49cc-a3b9-562a3e6d509d tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:24.201807 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-aac79fc1-9d7f-4cd5-b1e8-2eb81cb41f1f tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfd6d8e6a8444f5b9fcf1cf8da242ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707f869910b34768ae1a348cd0b5f284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:24.217158 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-aac79fc1-9d7f-4cd5-b1e8-2eb81cb41f1f tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] 10.222.0.58 "GET /compute/v2.1/servers/67accb8d-3e90-483c-a1e5-9a0c04a685c8" status: 200 len: 1574 microversion: 2.1 time: 0.361518 Aug 10 23:03:24.218053 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 896/1772] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:03:23 2022] GET /compute/v2.1/servers/67accb8d-3e90-483c-a1e5-9a0c04a685c8 => generated 1574 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:03:24.229395 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-9ce5e0e6-2014-4417-a02f-fe6a2ea2ccc2 tempest-SecurityGroupRulesTestJSON-678387735 tempest-SecurityGroupRulesTestJSON-678387735-project] Calling method '.version_select at 0x7f847d3d6430>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:24.454010 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-c50af0b8-9610-49cc-a3b9-562a3e6d509d tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890735b21f5d4764aefd789f74e00222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9cf3129a4e4f56a17bebf68b7bc42b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:24.464547 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-c50af0b8-9610-49cc-a3b9-562a3e6d509d tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] 10.222.0.58 "GET /compute/v2.1/servers/10ede6f4-625a-4c5a-a5d6-d7d0f2476dee" status: 200 len: 1323 microversion: 2.1 time: 0.412333 Aug 10 23:03:24.464547 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 877/1773] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:03:24 2022] GET /compute/v2.1/servers/10ede6f4-625a-4c5a-a5d6-d7d0f2476dee => generated 1323 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:03:24.682861 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-9631f1d9-0fbd-411c-b393-2c7fc4ff7d39 tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:24.683615 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-9631f1d9-0fbd-411c-b393-2c7fc4ff7d39 tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] [instance: 8fa0b7c8-ae4b-413c-9592-f4944cfb22fc] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:24.691149 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-9ce5e0e6-2014-4417-a02f-fe6a2ea2ccc2 tempest-SecurityGroupRulesTestJSON-678387735 tempest-SecurityGroupRulesTestJSON-678387735-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/6e6a1753-1b90-4a40-ba31-181b9893221d" status: 202 len: 0 microversion: 2.1 time: 0.472230 Aug 10 23:03:24.691730 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 897/1774] 10.222.0.58 () {58 vars in 1272 bytes} [Wed Aug 10 23:03:24 2022] DELETE /compute/v2.1/os-security-groups/6e6a1753-1b90-4a40-ba31-181b9893221d => generated 0 bytes in 473 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:03:24.700804 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-9a2aadd0-be27-47b0-b79f-764765dc15e2 tempest-SecurityGroupRulesTestJSON-678387735 tempest-SecurityGroupRulesTestJSON-678387735-project] Calling method '.version_select at 0x7f847d295a60>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:24.713271 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9631f1d9-0fbd-411c-b393-2c7fc4ff7d39 tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:24.718278 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9631f1d9-0fbd-411c-b393-2c7fc4ff7d39 tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:24.718749 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9631f1d9-0fbd-411c-b393-2c7fc4ff7d39 tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:24.719538 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9631f1d9-0fbd-411c-b393-2c7fc4ff7d39 tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:24.723826 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9631f1d9-0fbd-411c-b393-2c7fc4ff7d39 tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:24.724278 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9631f1d9-0fbd-411c-b393-2c7fc4ff7d39 tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:25.302962 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-9a2aadd0-be27-47b0-b79f-764765dc15e2 tempest-SecurityGroupRulesTestJSON-678387735 tempest-SecurityGroupRulesTestJSON-678387735-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/f4ce0ab5-f10b-496c-bd85-5e614deab1cb" status: 202 len: 0 microversion: 2.1 time: 0.605735 Aug 10 23:03:25.303563 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 898/1775] 10.222.0.58 () {58 vars in 1272 bytes} [Wed Aug 10 23:03:24 2022] DELETE /compute/v2.1/os-security-groups/f4ce0ab5-f10b-496c-bd85-5e614deab1cb => generated 0 bytes in 608 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 10 23:03:25.308909 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-db7eb3df-1dcd-486f-baa0-1a859803c86c tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:25.309768 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-db7eb3df-1dcd-486f-baa0-1a859803c86c tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] [instance: 63d2bd74-d060-4925-9323-b39d5131f958] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:25.328085 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-db7eb3df-1dcd-486f-baa0-1a859803c86c tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:25.329871 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-db7eb3df-1dcd-486f-baa0-1a859803c86c tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:25.333816 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-db7eb3df-1dcd-486f-baa0-1a859803c86c tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:25.334910 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-db7eb3df-1dcd-486f-baa0-1a859803c86c tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:25.335586 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-db7eb3df-1dcd-486f-baa0-1a859803c86c tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:25.341247 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-db7eb3df-1dcd-486f-baa0-1a859803c86c tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:25.646447 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-9631f1d9-0fbd-411c-b393-2c7fc4ff7d39 tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be22a1243524178bdfea6892f27b255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f0030d3c62f48e6acd142058158e11e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:25.692592 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-9631f1d9-0fbd-411c-b393-2c7fc4ff7d39 tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] 10.222.0.58 "GET /compute/v2.1/servers/8fa0b7c8-ae4b-413c-9592-f4944cfb22fc" status: 200 len: 1476 microversion: 2.1 time: 1.011746 Aug 10 23:03:25.693374 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 878/1776] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:03:24 2022] GET /compute/v2.1/servers/8fa0b7c8-ae4b-413c-9592-f4944cfb22fc => generated 1476 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:03:25.706616 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-0346dfd6-e8dd-4e2f-9f04-aef2df39da87 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:25.715496 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-0346dfd6-e8dd-4e2f-9f04-aef2df39da87 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] [instance: ad02bba7-86a5-4148-a83e-0fbd71645e4a] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:25.722893 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0346dfd6-e8dd-4e2f-9f04-aef2df39da87 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:25.725842 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0346dfd6-e8dd-4e2f-9f04-aef2df39da87 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:25.726914 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0346dfd6-e8dd-4e2f-9f04-aef2df39da87 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:25.731331 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0346dfd6-e8dd-4e2f-9f04-aef2df39da87 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:25.732000 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0346dfd6-e8dd-4e2f-9f04-aef2df39da87 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:25.735407 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0346dfd6-e8dd-4e2f-9f04-aef2df39da87 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:25.876212 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-0346dfd6-e8dd-4e2f-9f04-aef2df39da87 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '417d4eaaeb1c4df78745496ececb3e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27e6ee9495a438b8450a4ef0d62cbcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:25.886046 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-db7eb3df-1dcd-486f-baa0-1a859803c86c tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632904331d024d9b8e4d3660dff2cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ed0bdee3aa4013bd9219069bda558c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:25.902343 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-0346dfd6-e8dd-4e2f-9f04-aef2df39da87 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] 10.222.0.58 "GET /compute/v2.1/servers/ad02bba7-86a5-4148-a83e-0fbd71645e4a" status: 200 len: 1433 microversion: 2.1 time: 0.207850 Aug 10 23:03:25.905827 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-db7eb3df-1dcd-486f-baa0-1a859803c86c tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] 10.222.0.58 "GET /compute/v2.1/servers/63d2bd74-d060-4925-9323-b39d5131f958" status: 200 len: 1199 microversion: 2.1 time: 0.590363 Aug 10 23:03:25.907452 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 879/1777] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:03:25 2022] GET /compute/v2.1/servers/ad02bba7-86a5-4148-a83e-0fbd71645e4a => generated 1433 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:03:25.907863 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 899/1778] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:03:25 2022] GET /compute/v2.1/servers/63d2bd74-d060-4925-9323-b39d5131f958 => generated 1199 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:03:25.941796 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-5b51b39e-af8a-4da6-9856-8e4ca4078f09 tempest-SecurityGroupRulesTestJSON-678387735 tempest-SecurityGroupRulesTestJSON-678387735-project] Calling method '.version_select at 0x7f847d950550>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:25.945262 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-ce8c0584-0c2f-4410-9fed-f5e5b40bcfa6 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:25.952131 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-ce8c0584-0c2f-4410-9fed-f5e5b40bcfa6 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] [instance: 67accb8d-3e90-483c-a1e5-9a0c04a685c8] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:25.973025 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ce8c0584-0c2f-4410-9fed-f5e5b40bcfa6 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:25.974995 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ce8c0584-0c2f-4410-9fed-f5e5b40bcfa6 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:25.975604 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ce8c0584-0c2f-4410-9fed-f5e5b40bcfa6 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:25.978878 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ce8c0584-0c2f-4410-9fed-f5e5b40bcfa6 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:25.979888 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ce8c0584-0c2f-4410-9fed-f5e5b40bcfa6 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:25.983094 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ce8c0584-0c2f-4410-9fed-f5e5b40bcfa6 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:26.409861 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-5b51b39e-af8a-4da6-9856-8e4ca4078f09 tempest-SecurityGroupRulesTestJSON-678387735 tempest-SecurityGroupRulesTestJSON-678387735-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/b2bc83f0-6566-457a-902a-a62d0121cb28" status: 202 len: 0 microversion: 2.1 time: 0.499533 Aug 10 23:03:26.413316 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 880/1779] 10.222.0.58 () {58 vars in 1272 bytes} [Wed Aug 10 23:03:25 2022] DELETE /compute/v2.1/os-security-groups/b2bc83f0-6566-457a-902a-a62d0121cb28 => generated 0 bytes in 501 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:03:26.426300 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-0de2047c-3d62-48c0-9aba-f89214d6dd80 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:26.432509 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-0de2047c-3d62-48c0-9aba-f89214d6dd80 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] [instance: 10ede6f4-625a-4c5a-a5d6-d7d0f2476dee] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:26.446944 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:03:26.475813 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0de2047c-3d62-48c0-9aba-f89214d6dd80 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:26.479757 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0de2047c-3d62-48c0-9aba-f89214d6dd80 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:26.480260 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0de2047c-3d62-48c0-9aba-f89214d6dd80 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:26.486692 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0de2047c-3d62-48c0-9aba-f89214d6dd80 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:26.487291 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0de2047c-3d62-48c0-9aba-f89214d6dd80 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:26.489828 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0de2047c-3d62-48c0-9aba-f89214d6dd80 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:26.985661 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-ce8c0584-0c2f-4410-9fed-f5e5b40bcfa6 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfd6d8e6a8444f5b9fcf1cf8da242ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707f869910b34768ae1a348cd0b5f284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:26.997360 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-ce8c0584-0c2f-4410-9fed-f5e5b40bcfa6 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] 10.222.0.58 "GET /compute/v2.1/servers/67accb8d-3e90-483c-a1e5-9a0c04a685c8" status: 200 len: 1572 microversion: 2.1 time: 1.088032 Aug 10 23:03:27.015486 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 900/1780] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:03:25 2022] GET /compute/v2.1/servers/67accb8d-3e90-483c-a1e5-9a0c04a685c8 => generated 1572 bytes in 1107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:03:27.034453 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-0de2047c-3d62-48c0-9aba-f89214d6dd80 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890735b21f5d4764aefd789f74e00222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9cf3129a4e4f56a17bebf68b7bc42b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:27.035166 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-172cc3c9-5416-4495-bc98-64538cb90b7c req-7c68e107-e4b6-4209-be82-73fe587a8c3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bf5e469-d129-4daa-93f8-36661ec153a2", "name": "network-vif-plugged", "status": "completed", "tag": "d6e8df11-a924-4886-8d4e-e5c76996d805"}, {"server_uuid": "63d2bd74-d060-4925-9323-b39d5131f958", "name": "network-vif-plugged", "status": "completed", "tag": "6375592d-fb15-4844-83aa-70296bc72a55"}, {"server_uuid": "ad02bba7-86a5-4148-a83e-0fbd71645e4a", "name": "network-vif-unplugged", "status": "completed", "tag": "f52df94f-766a-4141-9ff0-c420b9f68633"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:03:27.046613 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-0de2047c-3d62-48c0-9aba-f89214d6dd80 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] 10.222.0.58 "GET /compute/v2.1/servers/10ede6f4-625a-4c5a-a5d6-d7d0f2476dee" status: 200 len: 1323 microversion: 2.1 time: 0.630549 Aug 10 23:03:27.047247 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 881/1781] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:03:26 2022] GET /compute/v2.1/servers/10ede6f4-625a-4c5a-a5d6-d7d0f2476dee => generated 1323 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:03:27.059188 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-172cc3c9-5416-4495-bc98-64538cb90b7c req-7c68e107-e4b6-4209-be82-73fe587a8c3f service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:27.062367 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-a15663c4-c6ff-4c53-bcef-b72e3bb37495 req-59a2c0f9-e670-42ce-a04e-6e5116b5cddc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad02bba7-86a5-4148-a83e-0fbd71645e4a", "name": "network-vif-deleted", "tag": "f52df94f-766a-4141-9ff0-c420b9f68633"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:03:27.063764 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-172cc3c9-5416-4495-bc98-64538cb90b7c req-7c68e107-e4b6-4209-be82-73fe587a8c3f service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:27.064376 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-172cc3c9-5416-4495-bc98-64538cb90b7c req-7c68e107-e4b6-4209-be82-73fe587a8c3f service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:27.098563 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-a15663c4-c6ff-4c53-bcef-b72e3bb37495 req-59a2c0f9-e670-42ce-a04e-6e5116b5cddc service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:27.101032 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-172cc3c9-5416-4495-bc98-64538cb90b7c req-7c68e107-e4b6-4209-be82-73fe587a8c3f service nova] Creating event network-vif-plugged:d6e8df11-a924-4886-8d4e-e5c76996d805 for instance 6bf5e469-d129-4daa-93f8-36661ec153a2 on n-h1-850468-14 Aug 10 23:03:27.101739 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-172cc3c9-5416-4495-bc98-64538cb90b7c req-7c68e107-e4b6-4209-be82-73fe587a8c3f service nova] Creating event network-vif-plugged:6375592d-fb15-4844-83aa-70296bc72a55 for instance 63d2bd74-d060-4925-9323-b39d5131f958 on n-h1-850468-14 Aug 10 23:03:27.102775 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-172cc3c9-5416-4495-bc98-64538cb90b7c req-7c68e107-e4b6-4209-be82-73fe587a8c3f service nova] Creating event network-vif-unplugged:f52df94f-766a-4141-9ff0-c420b9f68633 for instance ad02bba7-86a5-4148-a83e-0fbd71645e4a on n-h1-850468-14 Aug 10 23:03:27.103581 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-a15663c4-c6ff-4c53-bcef-b72e3bb37495 req-59a2c0f9-e670-42ce-a04e-6e5116b5cddc service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:27.104042 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-a15663c4-c6ff-4c53-bcef-b72e3bb37495 req-59a2c0f9-e670-42ce-a04e-6e5116b5cddc service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:27.119988 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-172cc3c9-5416-4495-bc98-64538cb90b7c req-7c68e107-e4b6-4209-be82-73fe587a8c3f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.102838 Aug 10 23:03:27.121206 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 901/1782] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:03:27 2022] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:03:27.138063 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-a03e3f8f-d545-42ac-8631-76c67d790048 tempest-SecurityGroupRulesTestJSON-678387735 tempest-SecurityGroupRulesTestJSON-678387735-project] Calling method '.version_select at 0x7f847d42a9d0>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:27.155128 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-a15663c4-c6ff-4c53-bcef-b72e3bb37495 req-59a2c0f9-e670-42ce-a04e-6e5116b5cddc service nova] Creating event network-vif-deleted:f52df94f-766a-4141-9ff0-c420b9f68633 for instance ad02bba7-86a5-4148-a83e-0fbd71645e4a on n-h1-850468-14 Aug 10 23:03:27.179635 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-a15663c4-c6ff-4c53-bcef-b72e3bb37495 req-59a2c0f9-e670-42ce-a04e-6e5116b5cddc service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129765 Aug 10 23:03:27.185381 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 882/1783] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:03:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:03:27.192405 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-d2874a17-d0e6-44a5-a9fc-1e4d77b09a23 tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:27.193117 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-d2874a17-d0e6-44a5-a9fc-1e4d77b09a23 tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] [instance: 8fa0b7c8-ae4b-413c-9592-f4944cfb22fc] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:27.234878 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d2874a17-d0e6-44a5-a9fc-1e4d77b09a23 tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:27.235447 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d2874a17-d0e6-44a5-a9fc-1e4d77b09a23 tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:27.235905 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d2874a17-d0e6-44a5-a9fc-1e4d77b09a23 tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:27.236654 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d2874a17-d0e6-44a5-a9fc-1e4d77b09a23 tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:27.237115 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d2874a17-d0e6-44a5-a9fc-1e4d77b09a23 tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:27.241997 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d2874a17-d0e6-44a5-a9fc-1e4d77b09a23 tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:27.831120 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-d2874a17-d0e6-44a5-a9fc-1e4d77b09a23 tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4be22a1243524178bdfea6892f27b255', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f0030d3c62f48e6acd142058158e11e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:27.842898 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-d2874a17-d0e6-44a5-a9fc-1e4d77b09a23 tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] 10.222.0.58 "GET /compute/v2.1/servers/8fa0b7c8-ae4b-413c-9592-f4944cfb22fc" status: 200 len: 1476 microversion: 2.1 time: 0.656002 Aug 10 23:03:27.844511 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 883/1784] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:03:27 2022] GET /compute/v2.1/servers/8fa0b7c8-ae4b-413c-9592-f4944cfb22fc => generated 1476 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:03:27.856765 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-93030403-ca69-4a3d-8b5c-6485f1d62e1f tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:27.863938 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-93030403-ca69-4a3d-8b5c-6485f1d62e1f tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] [instance: 63d2bd74-d060-4925-9323-b39d5131f958] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:27.905117 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-93030403-ca69-4a3d-8b5c-6485f1d62e1f tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:27.907853 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-93030403-ca69-4a3d-8b5c-6485f1d62e1f tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:27.908817 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-93030403-ca69-4a3d-8b5c-6485f1d62e1f tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:27.910288 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-93030403-ca69-4a3d-8b5c-6485f1d62e1f tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:27.913493 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-93030403-ca69-4a3d-8b5c-6485f1d62e1f tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:27.915253 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-93030403-ca69-4a3d-8b5c-6485f1d62e1f tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:28.127112 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-a03e3f8f-d545-42ac-8631-76c67d790048 tempest-SecurityGroupRulesTestJSON-678387735 tempest-SecurityGroupRulesTestJSON-678387735-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/89b73eae-14e6-48a2-8106-5b6c3f2d9a94" status: 202 len: 0 microversion: 2.1 time: 1.004164 Aug 10 23:03:28.127789 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 902/1785] 10.222.0.58 () {58 vars in 1272 bytes} [Wed Aug 10 23:03:27 2022] DELETE /compute/v2.1/os-security-groups/89b73eae-14e6-48a2-8106-5b6c3f2d9a94 => generated 0 bytes in 1006 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:03:28.133512 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-bdfbc25a-d46b-4399-8d41-9b7b770fefbe tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:28.134208 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-bdfbc25a-d46b-4399-8d41-9b7b770fefbe tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] [instance: ad02bba7-86a5-4148-a83e-0fbd71645e4a] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:28.157668 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bdfbc25a-d46b-4399-8d41-9b7b770fefbe tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:28.158058 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bdfbc25a-d46b-4399-8d41-9b7b770fefbe tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:28.158504 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bdfbc25a-d46b-4399-8d41-9b7b770fefbe tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:28.159295 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bdfbc25a-d46b-4399-8d41-9b7b770fefbe tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:28.159752 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bdfbc25a-d46b-4399-8d41-9b7b770fefbe tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:28.160176 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bdfbc25a-d46b-4399-8d41-9b7b770fefbe tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:28.192743 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-93030403-ca69-4a3d-8b5c-6485f1d62e1f tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632904331d024d9b8e4d3660dff2cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ed0bdee3aa4013bd9219069bda558c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:28.201383 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-bdfbc25a-d46b-4399-8d41-9b7b770fefbe tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] HTTP exception thrown: Instance ad02bba7-86a5-4148-a83e-0fbd71645e4a could not be found. Aug 10 23:03:28.205115 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-93030403-ca69-4a3d-8b5c-6485f1d62e1f tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] 10.222.0.58 "GET /compute/v2.1/servers/63d2bd74-d060-4925-9323-b39d5131f958" status: 200 len: 1199 microversion: 2.1 time: 0.357710 Aug 10 23:03:28.218312 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-bdfbc25a-d46b-4399-8d41-9b7b770fefbe tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Request method failure captured: Aug 10 23:03:28.218312 n-d-850468-14 devstack@n-api.service[122633]: request: GET /compute/v2.1/servers/ad02bba7-86a5-4148-a83e-0fbd71645e4a HTTP/1.1 Aug 10 23:03:28.218312 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:03:28.218312 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:03:28.218312 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:03:28.218312 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:03:28.218312 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:03:28.218312 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:03:28.218312 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:03:28.218312 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:03:28.218312 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9DhnJQVy677u4b7dnMoSItqtWsJm27g_Vg031CYXViqt8YYY7d4cXYrgXs0Pp9xS3IIxdwWgPKq2sDULWw--Li9t2t8l1R3feSY4uh4FysmLVRfKNCAYvKF_tmPQ5ZUjwhrC4jAx70ULoXcE-6wvpA-wHk_CVzAxHX7IWuhEQLk8ZDk Aug 10 23:03:28.218312 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:03:28.218312 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:03:28.218312 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:03:28.218312 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:03:28.218312 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:03:28.218312 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:03:28.218312 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: b27e6ee9495a438b8450a4ef0d62cbcd Aug 10 23:03:28.218312 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-ServersOnMultiNodesTest-936995831 Aug 10 23:03:28.218312 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:03:28.218312 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:03:28.219840 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b27e6ee9495a438b8450a4ef0d62cbcd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b27e6ee9495a438b8450a4ef0d62cbcd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b27e6ee9495a438b8450a4ef0d62cbcd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b27e6ee9495a438b8450a4ef0d62cbcd", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:03:28.219840 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-ServersOnMultiNodesTest-936995831 Aug 10 23:03:28.219840 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: b27e6ee9495a438b8450a4ef0d62cbcd Aug 10 23:03:28.219840 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-936995831 Aug 10 23:03:28.219840 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-ServersOnMultiNodesTest-936995831-project Aug 10 23:03:28.219840 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:03:28.219840 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:03:28.219840 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 417d4eaaeb1c4df78745496ececb3e88 Aug 10 23:03:28.219840 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-ServersOnMultiNodesTest-936995831-project Aug 10 23:03:28.219840 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:03:28.219840 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance ad02bba7-86a5-4148-a83e-0fbd71645e4a could not be found. Aug 10 23:03:28.219840 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': 'ad02bba7-86a5-4148-a83e-0fbd71645e4a'} Aug 10 23:03:28.220798 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:03:28.220798 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:03:28.220798 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:03:28.220798 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:03:28.220798 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:03:28.220798 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:03:28.220798 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:03:28.220798 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:03:28.220798 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:03:28.220798 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:03:28.220798 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad02bba7-86a5-4148-a83e-0fbd71645e4a could not be found. Aug 10 23:03:28.220798 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:03:28.220798 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:03:28.220798 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:03:28.220798 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:03:28.220798 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:03:28.220798 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:03:28.220798 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:03:28.220798 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:03:28.220798 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:03:28.222159 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:03:28.222159 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:03:28.222159 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:03:28.222159 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:03:28.222159 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:03:28.222159 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:03:28.222159 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:03:28.222159 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad02bba7-86a5-4148-a83e-0fbd71645e4a could not be found. Aug 10 23:03:28.222159 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:03:28.222159 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:03:28.222159 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:03:28.222159 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:03:28.222159 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:03:28.222159 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:03:28.222159 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:03:28.222159 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:03:28.222159 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad02bba7-86a5-4148-a83e-0fbd71645e4a could not be found. Aug 10 23:03:28.222159 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:03:28.223467 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-bdfbc25a-d46b-4399-8d41-9b7b770fefbe tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Returning 404 to user: Instance ad02bba7-86a5-4148-a83e-0fbd71645e4a could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:03:28.223467 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-bdfbc25a-d46b-4399-8d41-9b7b770fefbe tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] 10.222.0.58 "GET /compute/v2.1/servers/ad02bba7-86a5-4148-a83e-0fbd71645e4a" status: 404 len: 111 microversion: 2.1 time: 0.080257 Aug 10 23:03:28.228268 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 884/1786] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:03:27 2022] GET /compute/v2.1/servers/63d2bd74-d060-4925-9323-b39d5131f958 => generated 1199 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:03:28.232716 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 903/1787] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:03:28 2022] GET /compute/v2.1/servers/ad02bba7-86a5-4148-a83e-0fbd71645e4a => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:03:28.250244 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-88a301da-f38f-402f-befb-c35c69137b6b req-cfc21ee1-3f1e-48e0-a204-a460ea352887 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c897f8e-81a6-4929-85ed-9d9e8d6ec2cc", "name": "network-vif-deleted", "tag": "358851aa-3530-44ad-8603-dafd78d42181"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:03:28.252798 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-274c3c11-b817-4852-8c78-49c095b26959 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-427790589"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:03:28.259667 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-274c3c11-b817-4852-8c78-49c095b26959 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] [instance: 67accb8d-3e90-483c-a1e5-9a0c04a685c8] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:28.299787 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-274c3c11-b817-4852-8c78-49c095b26959 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:28.305017 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-274c3c11-b817-4852-8c78-49c095b26959 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:28.307684 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-274c3c11-b817-4852-8c78-49c095b26959 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:28.327905 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-274c3c11-b817-4852-8c78-49c095b26959 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:28.328405 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-274c3c11-b817-4852-8c78-49c095b26959 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:28.328855 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-274c3c11-b817-4852-8c78-49c095b26959 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:28.333360 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-88a301da-f38f-402f-befb-c35c69137b6b req-cfc21ee1-3f1e-48e0-a204-a460ea352887 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:28.333862 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-88a301da-f38f-402f-befb-c35c69137b6b req-cfc21ee1-3f1e-48e0-a204-a460ea352887 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:28.334300 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-88a301da-f38f-402f-befb-c35c69137b6b req-cfc21ee1-3f1e-48e0-a204-a460ea352887 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:28.398208 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-88a301da-f38f-402f-befb-c35c69137b6b req-cfc21ee1-3f1e-48e0-a204-a460ea352887 service nova] Creating event network-vif-deleted:358851aa-3530-44ad-8603-dafd78d42181 for instance 0c897f8e-81a6-4929-85ed-9d9e8d6ec2cc on n-h2-850468-14 Aug 10 23:03:28.408523 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-88a301da-f38f-402f-befb-c35c69137b6b req-cfc21ee1-3f1e-48e0-a204-a460ea352887 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.173822 Aug 10 23:03:28.410720 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 904/1788] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:03:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:03:28.438341 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-18e792c4-6863-42ac-ab5d-da3e79200eee tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:28.440199 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-18e792c4-6863-42ac-ab5d-da3e79200eee tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] [instance: 99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:28.456965 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-18e792c4-6863-42ac-ab5d-da3e79200eee tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:28.457578 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-18e792c4-6863-42ac-ab5d-da3e79200eee tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:28.458384 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-18e792c4-6863-42ac-ab5d-da3e79200eee tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:28.461690 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-18e792c4-6863-42ac-ab5d-da3e79200eee tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:28.461690 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-18e792c4-6863-42ac-ab5d-da3e79200eee tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:28.464851 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-18e792c4-6863-42ac-ab5d-da3e79200eee tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:28.533346 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-18e792c4-6863-42ac-ab5d-da3e79200eee tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] [instance: 99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0] Going to try to terminate instance {{(pid=122633) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:03:28.717948 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-18e792c4-6863-42ac-ab5d-da3e79200eee tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] 10.222.0.58 "DELETE /compute/v2.1/servers/99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0" status: 204 len: 0 microversion: 2.25 time: 0.287162 Aug 10 23:03:28.722437 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 905/1789] 10.222.0.58 () {60 vars in 1280 bytes} [Wed Aug 10 23:03:28 2022] DELETE /compute/v2.1/servers/99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 10 23:03:28.750305 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-fce50317-f989-44d5-b83e-d4c8bb271a50 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:28.752999 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-fce50317-f989-44d5-b83e-d4c8bb271a50 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] [instance: 10ede6f4-625a-4c5a-a5d6-d7d0f2476dee] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:28.780411 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fce50317-f989-44d5-b83e-d4c8bb271a50 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:28.781210 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fce50317-f989-44d5-b83e-d4c8bb271a50 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:28.781915 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fce50317-f989-44d5-b83e-d4c8bb271a50 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:28.783246 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fce50317-f989-44d5-b83e-d4c8bb271a50 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:28.783911 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fce50317-f989-44d5-b83e-d4c8bb271a50 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:28.785448 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fce50317-f989-44d5-b83e-d4c8bb271a50 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:28.875239 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.network.security_group_api [None req-274c3c11-b817-4852-8c78-49c095b26959 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Adding security group e7812d23-703d-433d-a1e7-509e5ada814d to port b9a81f82-f5d3-48ec-8420-23fe4897a6b8 Aug 10 23:03:29.122278 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-fce50317-f989-44d5-b83e-d4c8bb271a50 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890735b21f5d4764aefd789f74e00222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9cf3129a4e4f56a17bebf68b7bc42b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:29.139424 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-fce50317-f989-44d5-b83e-d4c8bb271a50 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] 10.222.0.58 "GET /compute/v2.1/servers/10ede6f4-625a-4c5a-a5d6-d7d0f2476dee" status: 200 len: 1514 microversion: 2.1 time: 0.408994 Aug 10 23:03:29.155441 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 906/1790] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:03:28 2022] GET /compute/v2.1/servers/10ede6f4-625a-4c5a-a5d6-d7d0f2476dee => generated 1514 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:03:29.162876 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-986a5412-5460-4dfc-8161-9d3e0efd6032 tempest-SecurityGroupRulesTestJSON-678387735 tempest-SecurityGroupRulesTestJSON-678387735-project] Calling method '.version_select at 0x7f847d308160>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:29.543143 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-986a5412-5460-4dfc-8161-9d3e0efd6032 tempest-SecurityGroupRulesTestJSON-678387735 tempest-SecurityGroupRulesTestJSON-678387735-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/f37e34f8-15d6-4eb4-8a30-46f1f7543fdf" status: 202 len: 0 microversion: 2.1 time: 0.386068 Aug 10 23:03:29.543855 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 907/1791] 10.222.0.58 () {58 vars in 1272 bytes} [Wed Aug 10 23:03:29 2022] DELETE /compute/v2.1/os-security-groups/f37e34f8-15d6-4eb4-8a30-46f1f7543fdf => generated 0 bytes in 388 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:03:29.550213 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-fdfe7d5f-860c-4d3e-bd10-db886f71a7e3 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:29.550996 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-fdfe7d5f-860c-4d3e-bd10-db886f71a7e3 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] [instance: 0c897f8e-81a6-4929-85ed-9d9e8d6ec2cc] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:29.574460 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fdfe7d5f-860c-4d3e-bd10-db886f71a7e3 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:29.575356 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fdfe7d5f-860c-4d3e-bd10-db886f71a7e3 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:29.576508 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fdfe7d5f-860c-4d3e-bd10-db886f71a7e3 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:29.579140 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fdfe7d5f-860c-4d3e-bd10-db886f71a7e3 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:29.579841 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fdfe7d5f-860c-4d3e-bd10-db886f71a7e3 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:29.582931 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fdfe7d5f-860c-4d3e-bd10-db886f71a7e3 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:29.624287 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-fdfe7d5f-860c-4d3e-bd10-db886f71a7e3 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] HTTP exception thrown: Instance 0c897f8e-81a6-4929-85ed-9d9e8d6ec2cc could not be found. Aug 10 23:03:29.627116 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-fdfe7d5f-860c-4d3e-bd10-db886f71a7e3 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Request method failure captured: Aug 10 23:03:29.627116 n-d-850468-14 devstack@n-api.service[122633]: request: GET /compute/v2.1/servers/0c897f8e-81a6-4929-85ed-9d9e8d6ec2cc HTTP/1.1 Aug 10 23:03:29.627116 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:03:29.627116 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:03:29.627116 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:03:29.627116 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:03:29.627116 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:03:29.627116 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:03:29.627116 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:03:29.627116 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:03:29.627116 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9DhnJQVy677u4b7dnMoSItqtWsJm27g_Vg031CYXViqt8YYY7d4cXYrgXs0Pp9xS3IIxdwWgPKq2sDULWw--Li9t2t8l1R3feSY4uh4FysmLVRfKNCAYvKF_tmPQ5ZUjwhrC4jAx70ULoXcE-6wvpA-wHk_CVzAxHX7IWuhEQLk8ZDk Aug 10 23:03:29.627116 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:03:29.627116 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:03:29.627116 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:03:29.627116 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:03:29.627116 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:03:29.627116 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:03:29.627116 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: b27e6ee9495a438b8450a4ef0d62cbcd Aug 10 23:03:29.627116 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-ServersOnMultiNodesTest-936995831 Aug 10 23:03:29.627116 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:03:29.627116 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:03:29.629147 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b27e6ee9495a438b8450a4ef0d62cbcd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b27e6ee9495a438b8450a4ef0d62cbcd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b27e6ee9495a438b8450a4ef0d62cbcd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b27e6ee9495a438b8450a4ef0d62cbcd", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:03:29.629147 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-ServersOnMultiNodesTest-936995831 Aug 10 23:03:29.629147 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: b27e6ee9495a438b8450a4ef0d62cbcd Aug 10 23:03:29.629147 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-936995831 Aug 10 23:03:29.629147 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-ServersOnMultiNodesTest-936995831-project Aug 10 23:03:29.629147 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:03:29.629147 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:03:29.629147 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 417d4eaaeb1c4df78745496ececb3e88 Aug 10 23:03:29.629147 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-ServersOnMultiNodesTest-936995831-project Aug 10 23:03:29.629147 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:03:29.629147 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance 0c897f8e-81a6-4929-85ed-9d9e8d6ec2cc could not be found. Aug 10 23:03:29.629147 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': '0c897f8e-81a6-4929-85ed-9d9e8d6ec2cc'} Aug 10 23:03:29.630161 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:03:29.630161 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:03:29.630161 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:03:29.630161 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:03:29.630161 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:03:29.630161 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:03:29.630161 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:03:29.630161 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:03:29.630161 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:03:29.630161 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:03:29.630161 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c897f8e-81a6-4929-85ed-9d9e8d6ec2cc could not be found. Aug 10 23:03:29.630161 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:03:29.630161 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:03:29.630161 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:03:29.630161 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:03:29.630161 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:03:29.630161 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:03:29.630161 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:03:29.630161 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:03:29.630161 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:03:29.633635 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:03:29.633635 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:03:29.633635 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:03:29.633635 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:03:29.633635 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:03:29.633635 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:03:29.633635 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:03:29.633635 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c897f8e-81a6-4929-85ed-9d9e8d6ec2cc could not be found. Aug 10 23:03:29.633635 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:03:29.633635 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:03:29.633635 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:03:29.633635 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:03:29.633635 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:03:29.633635 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:03:29.633635 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:03:29.633635 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:03:29.633635 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c897f8e-81a6-4929-85ed-9d9e8d6ec2cc could not be found. Aug 10 23:03:29.633635 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:03:29.636112 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-fdfe7d5f-860c-4d3e-bd10-db886f71a7e3 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Returning 404 to user: Instance 0c897f8e-81a6-4929-85ed-9d9e8d6ec2cc could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:03:29.637547 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-fdfe7d5f-860c-4d3e-bd10-db886f71a7e3 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] 10.222.0.58 "GET /compute/v2.1/servers/0c897f8e-81a6-4929-85ed-9d9e8d6ec2cc" status: 404 len: 111 microversion: 2.1 time: 0.092550 Aug 10 23:03:29.638631 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 908/1792] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:03:29 2022] GET /compute/v2.1/servers/0c897f8e-81a6-4929-85ed-9d9e8d6ec2cc => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:03:29.644311 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-68464685-e2bd-4ebf-9995-95e203ce447d tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:29.646210 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-68464685-e2bd-4ebf-9995-95e203ce447d tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] [instance: 99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:29.654065 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-68464685-e2bd-4ebf-9995-95e203ce447d tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:29.654972 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-68464685-e2bd-4ebf-9995-95e203ce447d tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:29.655616 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-68464685-e2bd-4ebf-9995-95e203ce447d tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:29.656569 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-68464685-e2bd-4ebf-9995-95e203ce447d tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:29.657385 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-68464685-e2bd-4ebf-9995-95e203ce447d tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:29.658651 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-68464685-e2bd-4ebf-9995-95e203ce447d tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:29.895708 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-68464685-e2bd-4ebf-9995-95e203ce447d tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:29.907115 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-68464685-e2bd-4ebf-9995-95e203ce447d tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:29.909625 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-68464685-e2bd-4ebf-9995-95e203ce447d tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:29.911288 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-68464685-e2bd-4ebf-9995-95e203ce447d tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] 10.222.0.58 "GET /compute/v2.1/servers/99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0" status: 200 len: 1732 microversion: 2.25 time: 0.271450 Aug 10 23:03:29.912861 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 909/1793] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:03:29 2022] GET /compute/v2.1/servers/99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0 => generated 1732 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:03:29.920665 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-531eed59-f6f0-40b8-8ab5-b52de656b063 tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:29.921706 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-531eed59-f6f0-40b8-8ab5-b52de656b063 tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] [instance: 8fa0b7c8-ae4b-413c-9592-f4944cfb22fc] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:29.935035 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-531eed59-f6f0-40b8-8ab5-b52de656b063 tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:29.940225 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-531eed59-f6f0-40b8-8ab5-b52de656b063 tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:29.941332 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-531eed59-f6f0-40b8-8ab5-b52de656b063 tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:29.942097 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-531eed59-f6f0-40b8-8ab5-b52de656b063 tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:29.942569 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-531eed59-f6f0-40b8-8ab5-b52de656b063 tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:29.945169 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-531eed59-f6f0-40b8-8ab5-b52de656b063 tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:29.983968 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-531eed59-f6f0-40b8-8ab5-b52de656b063 tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] HTTP exception thrown: Instance 8fa0b7c8-ae4b-413c-9592-f4944cfb22fc could not be found. Aug 10 23:03:29.985889 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-531eed59-f6f0-40b8-8ab5-b52de656b063 tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] Request method failure captured: Aug 10 23:03:29.985889 n-d-850468-14 devstack@n-api.service[122633]: request: GET /compute/v2.1/servers/8fa0b7c8-ae4b-413c-9592-f4944cfb22fc HTTP/1.1 Aug 10 23:03:29.985889 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:03:29.985889 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:03:29.985889 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:03:29.985889 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:03:29.985889 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:03:29.985889 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:03:29.985889 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:03:29.985889 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:03:29.985889 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9DkYv6GyycjQ7NberlZDcpD4pGTWTvP64gS5fVSvaIapDd4YgcyAVXryQd3NNjtTimBRuvuk-lAQCLGntqlvt4b_hgq8mUxJ85uNMD1Z3aFz9qUe1OlYZC5KJLec0pvHBGgZf_0S8O_LhF2Dkx0pT2f7HkbSuJFqqcq8qvgFYsK3mpg Aug 10 23:03:29.985889 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:03:29.985889 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:03:29.985889 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:03:29.985889 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:03:29.985889 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:03:29.985889 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:03:29.985889 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 7f0030d3c62f48e6acd142058158e11e Aug 10 23:03:29.985889 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-112441911 Aug 10 23:03:29.985889 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:03:29.985889 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:03:29.987577 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7f0030d3c62f48e6acd142058158e11e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7f0030d3c62f48e6acd142058158e11e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7f0030d3c62f48e6acd142058158e11e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7f0030d3c62f48e6acd142058158e11e", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:03:29.987577 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-112441911 Aug 10 23:03:29.987577 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 7f0030d3c62f48e6acd142058158e11e Aug 10 23:03:29.987577 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-112441911 Aug 10 23:03:29.987577 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-ServerDiagnosticsNegativeTest-112441911-project Aug 10 23:03:29.987577 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:03:29.987577 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:03:29.987577 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 4be22a1243524178bdfea6892f27b255 Aug 10 23:03:29.987577 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-112441911-project Aug 10 23:03:29.987577 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:03:29.987577 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance 8fa0b7c8-ae4b-413c-9592-f4944cfb22fc could not be found. Aug 10 23:03:29.987577 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': '8fa0b7c8-ae4b-413c-9592-f4944cfb22fc'} Aug 10 23:03:29.988436 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:03:29.988436 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:03:29.988436 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:03:29.988436 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:03:29.988436 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:03:29.988436 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:03:29.988436 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:03:29.988436 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:03:29.988436 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:03:29.988436 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:03:29.988436 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8fa0b7c8-ae4b-413c-9592-f4944cfb22fc could not be found. Aug 10 23:03:29.988436 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:03:29.988436 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:03:29.988436 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:03:29.988436 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:03:29.988436 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:03:29.988436 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:03:29.988436 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:03:29.988436 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:03:29.988436 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:03:29.991871 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:03:29.991871 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:03:29.991871 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:03:29.991871 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:03:29.991871 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:03:29.991871 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:03:29.991871 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:03:29.991871 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8fa0b7c8-ae4b-413c-9592-f4944cfb22fc could not be found. Aug 10 23:03:29.991871 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:03:29.991871 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:03:29.991871 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:03:29.991871 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:03:29.991871 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:03:29.991871 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:03:29.991871 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:03:29.991871 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:03:29.991871 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8fa0b7c8-ae4b-413c-9592-f4944cfb22fc could not be found. Aug 10 23:03:29.991871 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:03:29.995837 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-531eed59-f6f0-40b8-8ab5-b52de656b063 tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] Returning 404 to user: Instance 8fa0b7c8-ae4b-413c-9592-f4944cfb22fc could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:03:29.995837 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-531eed59-f6f0-40b8-8ab5-b52de656b063 tempest-ServerDiagnosticsNegativeTest-112441911 tempest-ServerDiagnosticsNegativeTest-112441911-project] 10.222.0.58 "GET /compute/v2.1/servers/8fa0b7c8-ae4b-413c-9592-f4944cfb22fc" status: 404 len: 111 microversion: 2.1 time: 0.073245 Aug 10 23:03:29.995837 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 910/1794] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:03:29 2022] GET /compute/v2.1/servers/8fa0b7c8-ae4b-413c-9592-f4944cfb22fc => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:03:30.001040 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-be658175-8127-47c7-9a56-193bb849d0c6 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:30.001674 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-be658175-8127-47c7-9a56-193bb849d0c6 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] [instance: 6bf5e469-d129-4daa-93f8-36661ec153a2] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:30.012139 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-be658175-8127-47c7-9a56-193bb849d0c6 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:30.012724 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-be658175-8127-47c7-9a56-193bb849d0c6 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:30.013387 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-be658175-8127-47c7-9a56-193bb849d0c6 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:30.014610 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-be658175-8127-47c7-9a56-193bb849d0c6 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:30.015152 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-be658175-8127-47c7-9a56-193bb849d0c6 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:30.015590 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-be658175-8127-47c7-9a56-193bb849d0c6 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:30.267098 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-be658175-8127-47c7-9a56-193bb849d0c6 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890735b21f5d4764aefd789f74e00222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9cf3129a4e4f56a17bebf68b7bc42b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:30.280324 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-be658175-8127-47c7-9a56-193bb849d0c6 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] 10.222.0.58 "GET /compute/v2.1/servers/6bf5e469-d129-4daa-93f8-36661ec153a2" status: 200 len: 1514 microversion: 2.1 time: 0.284419 Aug 10 23:03:30.282220 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 911/1795] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:03:29 2022] GET /compute/v2.1/servers/6bf5e469-d129-4daa-93f8-36661ec153a2 => generated 1514 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:03:30.293299 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-1923b6f2-6539-4144-80be-80a7a566a1c0 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:30.294615 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-1923b6f2-6539-4144-80be-80a7a566a1c0 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] [instance: 63d2bd74-d060-4925-9323-b39d5131f958] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:30.311551 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:03:30.319483 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1923b6f2-6539-4144-80be-80a7a566a1c0 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:30.320375 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1923b6f2-6539-4144-80be-80a7a566a1c0 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:30.321731 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1923b6f2-6539-4144-80be-80a7a566a1c0 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:30.323074 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1923b6f2-6539-4144-80be-80a7a566a1c0 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:30.323862 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1923b6f2-6539-4144-80be-80a7a566a1c0 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:30.324504 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1923b6f2-6539-4144-80be-80a7a566a1c0 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:30.512375 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-1923b6f2-6539-4144-80be-80a7a566a1c0 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632904331d024d9b8e4d3660dff2cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ed0bdee3aa4013bd9219069bda558c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:30.523119 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-1923b6f2-6539-4144-80be-80a7a566a1c0 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] 10.222.0.58 "GET /compute/v2.1/servers/63d2bd74-d060-4925-9323-b39d5131f958" status: 200 len: 1382 microversion: 2.1 time: 0.239301 Aug 10 23:03:30.543254 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 912/1796] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:03:30 2022] GET /compute/v2.1/servers/63d2bd74-d060-4925-9323-b39d5131f958 => generated 1382 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:03:30.550909 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-5832c5b2-97f7-4f1c-b5c3-bed9e15bf0be tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:30.606594 n-d-850468-14 devstack@n-api.service[122633]: ERROR oslo.messaging._drivers.impl_rabbit [None req-5832c5b2-97f7-4f1c-b5c3-bed9e15bf0be tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] [e2f225cb-bf19-4d7b-8a8a-277b90e5ad43] AMQP server on 10.222.0.58:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 10 23:03:30.743175 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-274c3c11-b817-4852-8c78-49c095b26959 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] 10.222.0.58 "POST /compute/v2.1/servers/67accb8d-3e90-483c-a1e5-9a0c04a685c8/action" status: 202 len: 0 microversion: 2.1 time: 2.512806 Aug 10 23:03:30.746232 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 885/1797] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:03:28 2022] POST /compute/v2.1/servers/67accb8d-3e90-483c-a1e5-9a0c04a685c8/action => generated 0 bytes in 2517 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:03:30.757216 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-5c3a73f3-c26c-4446-860c-ae751a4dccb7 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:30.758831 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-5c3a73f3-c26c-4446-860c-ae751a4dccb7 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] [instance: 17b32f05-1f0e-473f-bfda-fab92a90b04f] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:30.778439 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5c3a73f3-c26c-4446-860c-ae751a4dccb7 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:30.780792 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5c3a73f3-c26c-4446-860c-ae751a4dccb7 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:30.782484 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5c3a73f3-c26c-4446-860c-ae751a4dccb7 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:30.785518 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5c3a73f3-c26c-4446-860c-ae751a4dccb7 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:30.786299 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5c3a73f3-c26c-4446-860c-ae751a4dccb7 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:30.787628 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5c3a73f3-c26c-4446-860c-ae751a4dccb7 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:31.229430 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-5c3a73f3-c26c-4446-860c-ae751a4dccb7 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890735b21f5d4764aefd789f74e00222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9cf3129a4e4f56a17bebf68b7bc42b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:31.233099 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:03:31.242464 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-5c3a73f3-c26c-4446-860c-ae751a4dccb7 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] 10.222.0.58 "GET /compute/v2.1/servers/17b32f05-1f0e-473f-bfda-fab92a90b04f" status: 200 len: 1514 microversion: 2.1 time: 0.494413 Aug 10 23:03:31.244793 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 886/1798] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:03:30 2022] GET /compute/v2.1/servers/17b32f05-1f0e-473f-bfda-fab92a90b04f => generated 1514 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:03:31.256273 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-c6321150-f869-4823-83f7-0162e078aabb req-c928b1aa-20c5-42c6-b9c5-fdfbafb8d9c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8fa0b7c8-ae4b-413c-9592-f4944cfb22fc", "name": "network-vif-deleted", "tag": "eef1b5f8-6d51-406e-a11e-bdd5e6c015ed"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:03:31.269192 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-c6321150-f869-4823-83f7-0162e078aabb req-c928b1aa-20c5-42c6-b9c5-fdfbafb8d9c1 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:31.269954 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-c6321150-f869-4823-83f7-0162e078aabb req-c928b1aa-20c5-42c6-b9c5-fdfbafb8d9c1 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:31.270601 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-c6321150-f869-4823-83f7-0162e078aabb req-c928b1aa-20c5-42c6-b9c5-fdfbafb8d9c1 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:31.286692 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-c6321150-f869-4823-83f7-0162e078aabb req-c928b1aa-20c5-42c6-b9c5-fdfbafb8d9c1 service nova] Creating event network-vif-deleted:eef1b5f8-6d51-406e-a11e-bdd5e6c015ed for instance 8fa0b7c8-ae4b-413c-9592-f4944cfb22fc on n-h2-850468-14 Aug 10 23:03:31.293569 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-c6321150-f869-4823-83f7-0162e078aabb req-c928b1aa-20c5-42c6-b9c5-fdfbafb8d9c1 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041443 Aug 10 23:03:31.298388 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 887/1799] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:03:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:03:31.615278 n-d-850468-14 devstack@n-api.service[122633]: INFO oslo.messaging._drivers.impl_rabbit [None req-5832c5b2-97f7-4f1c-b5c3-bed9e15bf0be tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] [e2f225cb-bf19-4d7b-8a8a-277b90e5ad43] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 42494. Aug 10 23:03:31.622386 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-5832c5b2-97f7-4f1c-b5c3-bed9e15bf0be tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] 10.222.0.58 "DELETE /compute/v2.1/os-server-groups/0df0c484-6d01-4147-a85f-ab4e11db152d" status: 204 len: 0 microversion: 2.1 time: 1.077972 Aug 10 23:03:31.623586 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 913/1800] 10.222.0.58 () {58 vars in 1266 bytes} [Wed Aug 10 23:03:30 2022] DELETE /compute/v2.1/os-server-groups/0df0c484-6d01-4147-a85f-ab4e11db152d => generated 0 bytes in 1080 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:03:31.628579 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-08ada365-20ec-4f57-a0b5-4fc1f3619ea5 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Calling method '.version_select at 0x7f847d3baee0>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:31.761386 n-d-850468-14 devstack@n-api.service[122633]: DEBUG neutronclient.v2_0.client [None req-08ada365-20ec-4f57-a0b5-4fc1f3619ea5 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group e7812d23-703d-433d-a1e7-509e5ada814d in use.", "detail": ""}} {{(pid=122633) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 10 23:03:31.762331 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-08ada365-20ec-4f57-a0b5-4fc1f3619ea5 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] HTTP exception thrown: Security Group e7812d23-703d-433d-a1e7-509e5ada814d in use. Aug 10 23:03:31.762331 n-d-850468-14 devstack@n-api.service[122633]: Neutron server returns request_ids: ['req-a814cb85-3330-46a2-93b1-a9c51579a2d5'] Aug 10 23:03:31.764688 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-08ada365-20ec-4f57-a0b5-4fc1f3619ea5 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Request method failure captured: Aug 10 23:03:31.764688 n-d-850468-14 devstack@n-api.service[122633]: request: DELETE /compute/v2.1/os-security-groups/e7812d23-703d-433d-a1e7-509e5ada814d HTTP/1.1 Aug 10 23:03:31.764688 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:03:31.764688 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:03:31.764688 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:03:31.764688 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:03:31.764688 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:03:31.764688 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:03:31.764688 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:03:31.764688 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:03:31.764688 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9Dju6bcY6WgJPTWLWUJ0fX6JaJBRP8GkYZWFafNrDYn8ACaF-JC0t8YD4rSPFgG5Deze7mjmq2_rnPCZ1jpXNRGkHxz134mT5MqTqUm9UAyuVcbLtNQAiAf-L4A3117brPwKa_CN56-tZ47WT8aAPEON_2-WsEOp9qATqEToy30jo_s Aug 10 23:03:31.764688 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:03:31.764688 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:03:31.764688 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:03:31.764688 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:03:31.764688 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:03:31.764688 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:03:31.764688 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 707f869910b34768ae1a348cd0b5f284 Aug 10 23:03:31.764688 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-SecurityGroupsTestJSON-1406525704 Aug 10 23:03:31.764688 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:03:31.764688 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:03:31.766487 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/707f869910b34768ae1a348cd0b5f284"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/707f869910b34768ae1a348cd0b5f284"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/707f869910b34768ae1a348cd0b5f284"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_707f869910b34768ae1a348cd0b5f284", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:03:31.766487 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-SecurityGroupsTestJSON-1406525704 Aug 10 23:03:31.766487 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 707f869910b34768ae1a348cd0b5f284 Aug 10 23:03:31.766487 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1406525704 Aug 10 23:03:31.766487 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-SecurityGroupsTestJSON-1406525704-project Aug 10 23:03:31.766487 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:03:31.766487 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:03:31.766487 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: bfd6d8e6a8444f5b9fcf1cf8da242ac0 Aug 10 23:03:31.766487 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-SecurityGroupsTestJSON-1406525704-project Aug 10 23:03:31.766487 n-d-850468-14 devstack@n-api.service[122633]: method: Aug 10 23:03:31.766487 n-d-850468-14 devstack@n-api.service[122633]: exception: Security Group e7812d23-703d-433d-a1e7-509e5ada814d in use. Aug 10 23:03:31.766487 n-d-850468-14 devstack@n-api.service[122633]: Neutron server returns request_ids: ['req-a814cb85-3330-46a2-93b1-a9c51579a2d5'] Aug 10 23:03:31.766487 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': 'e7812d23-703d-433d-a1e7-509e5ada814d'} Aug 10 23:03:31.767880 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:03:31.767880 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:03:31.767880 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Aug 10 23:03:31.767880 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Aug 10 23:03:31.767880 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 23:03:31.767880 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 23:03:31.767880 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Aug 10 23:03:31.767880 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Aug 10 23:03:31.767880 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 23:03:31.767880 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 23:03:31.767880 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Aug 10 23:03:31.767880 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Aug 10 23:03:31.767880 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 23:03:31.767880 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 23:03:31.767880 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 23:03:31.767880 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 23:03:31.767880 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 23:03:31.767880 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 23:03:31.767880 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 10 23:03:31.769976 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 10 23:03:31.769976 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 23:03:31.769976 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 23:03:31.769976 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 10 23:03:31.769976 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 10 23:03:31.769976 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 10 23:03:31.769976 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 10 23:03:31.769976 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group e7812d23-703d-433d-a1e7-509e5ada814d in use. Aug 10 23:03:31.769976 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a814cb85-3330-46a2-93b1-a9c51579a2d5'] Aug 10 23:03:31.769976 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:03:31.769976 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:03:31.769976 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:03:31.769976 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:03:31.769976 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Aug 10 23:03:31.769976 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Aug 10 23:03:31.769976 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Aug 10 23:03:31.769976 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Aug 10 23:03:31.769976 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group e7812d23-703d-433d-a1e7-509e5ada814d in use. Aug 10 23:03:31.769976 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a814cb85-3330-46a2-93b1-a9c51579a2d5'] Aug 10 23:03:31.772940 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:03:31.772940 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:03:31.772940 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:03:31.772940 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:03:31.772940 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:03:31.772940 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:03:31.772940 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:03:31.772940 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:03:31.772940 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 23:03:31.772940 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 23:03:31.772940 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:03:31.772940 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:03:31.772940 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Aug 10 23:03:31.772940 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 10 23:03:31.772940 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group e7812d23-703d-433d-a1e7-509e5ada814d in use. Aug 10 23:03:31.772940 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a814cb85-3330-46a2-93b1-a9c51579a2d5'] Aug 10 23:03:31.772940 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:03:31.772940 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:03:31.772940 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:03:31.772940 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:03:31.772940 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:03:31.776764 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:03:31.776764 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:03:31.776764 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:03:31.776764 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group e7812d23-703d-433d-a1e7-509e5ada814d in use. Aug 10 23:03:31.776764 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a814cb85-3330-46a2-93b1-a9c51579a2d5'] Aug 10 23:03:31.776764 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:03:31.778856 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-08ada365-20ec-4f57-a0b5-4fc1f3619ea5 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Returning 400 to user: Security Group e7812d23-703d-433d-a1e7-509e5ada814d in use. Aug 10 23:03:31.778856 n-d-850468-14 devstack@n-api.service[122633]: Neutron server returns request_ids: ['req-a814cb85-3330-46a2-93b1-a9c51579a2d5'] {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:03:31.780327 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-08ada365-20ec-4f57-a0b5-4fc1f3619ea5 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/e7812d23-703d-433d-a1e7-509e5ada814d" status: 400 len: 185 microversion: 2.1 time: 0.155505 Aug 10 23:03:31.781193 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 914/1801] 10.222.0.58 () {58 vars in 1272 bytes} [Wed Aug 10 23:03:31 2022] DELETE /compute/v2.1/os-security-groups/e7812d23-703d-433d-a1e7-509e5ada814d => generated 185 bytes in 157 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 10 23:03:31.786176 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-73e6a7ac-dcfa-4624-86da-7e13613283f6 req-8cec156f-b288-4938-8a82-e99593a994e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67accb8d-3e90-483c-a1e5-9a0c04a685c8", "tag": "b9a81f82-f5d3-48ec-8420-23fe4897a6b8"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:03:31.799021 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-73e6a7ac-dcfa-4624-86da-7e13613283f6 req-8cec156f-b288-4938-8a82-e99593a994e8 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:31.799898 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-73e6a7ac-dcfa-4624-86da-7e13613283f6 req-8cec156f-b288-4938-8a82-e99593a994e8 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:31.800606 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-73e6a7ac-dcfa-4624-86da-7e13613283f6 req-8cec156f-b288-4938-8a82-e99593a994e8 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:31.813119 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-73e6a7ac-dcfa-4624-86da-7e13613283f6 req-8cec156f-b288-4938-8a82-e99593a994e8 service nova] Creating event network-changed:b9a81f82-f5d3-48ec-8420-23fe4897a6b8 for instance 67accb8d-3e90-483c-a1e5-9a0c04a685c8 on n-h1-850468-14 Aug 10 23:03:31.819633 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-73e6a7ac-dcfa-4624-86da-7e13613283f6 req-8cec156f-b288-4938-8a82-e99593a994e8 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036970 Aug 10 23:03:31.820648 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 915/1802] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:03:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:03:31.827382 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-a20dd66b-ba7f-43aa-b5dd-4eccb225bb7c tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:31.828613 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-a20dd66b-ba7f-43aa-b5dd-4eccb225bb7c tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] [instance: 99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:31.838054 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-dddf7753-3955-4fe9-9361-747ffc1c46ed tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:31.839616 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-dddf7753-3955-4fe9-9361-747ffc1c46ed tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] [instance: 63d2bd74-d060-4925-9323-b39d5131f958] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:31.853863 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a20dd66b-ba7f-43aa-b5dd-4eccb225bb7c tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:31.855618 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dddf7753-3955-4fe9-9361-747ffc1c46ed tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:31.856361 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dddf7753-3955-4fe9-9361-747ffc1c46ed tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:31.857295 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dddf7753-3955-4fe9-9361-747ffc1c46ed tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:31.858275 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dddf7753-3955-4fe9-9361-747ffc1c46ed tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:31.859101 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dddf7753-3955-4fe9-9361-747ffc1c46ed tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:31.860806 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a20dd66b-ba7f-43aa-b5dd-4eccb225bb7c tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:31.861205 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dddf7753-3955-4fe9-9361-747ffc1c46ed tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:31.863299 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a20dd66b-ba7f-43aa-b5dd-4eccb225bb7c tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:31.864380 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a20dd66b-ba7f-43aa-b5dd-4eccb225bb7c tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:31.867773 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a20dd66b-ba7f-43aa-b5dd-4eccb225bb7c tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:31.869278 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a20dd66b-ba7f-43aa-b5dd-4eccb225bb7c tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:32.192238 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-a20dd66b-ba7f-43aa-b5dd-4eccb225bb7c tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:32.213103 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-a20dd66b-ba7f-43aa-b5dd-4eccb225bb7c tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:32.216764 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-a20dd66b-ba7f-43aa-b5dd-4eccb225bb7c tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:32.223911 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-a20dd66b-ba7f-43aa-b5dd-4eccb225bb7c tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] 10.222.0.58 "GET /compute/v2.1/servers/99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0" status: 200 len: 1732 microversion: 2.25 time: 0.401739 Aug 10 23:03:32.242076 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 916/1803] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:03:31 2022] GET /compute/v2.1/servers/99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0 => generated 1732 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:03:32.254822 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-1425021e-c7ca-4851-b66f-b82f52fa5c64 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:32.255369 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-1425021e-c7ca-4851-b66f-b82f52fa5c64 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] [instance: 17b32f05-1f0e-473f-bfda-fab92a90b04f] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:32.265029 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1425021e-c7ca-4851-b66f-b82f52fa5c64 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:32.265612 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1425021e-c7ca-4851-b66f-b82f52fa5c64 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:32.266627 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1425021e-c7ca-4851-b66f-b82f52fa5c64 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:32.267670 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1425021e-c7ca-4851-b66f-b82f52fa5c64 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:32.268298 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1425021e-c7ca-4851-b66f-b82f52fa5c64 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:32.268901 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1425021e-c7ca-4851-b66f-b82f52fa5c64 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:32.301539 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-1425021e-c7ca-4851-b66f-b82f52fa5c64 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] [instance: 17b32f05-1f0e-473f-bfda-fab92a90b04f] Going to try to terminate instance {{(pid=122633) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:03:32.358387 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:03:32.429139 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-dddf7753-3955-4fe9-9361-747ffc1c46ed tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/63d2bd74-d060-4925-9323-b39d5131f958" status: 200 len: 1535 microversion: 2.1 time: 1.126926 Aug 10 23:03:32.433281 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 888/1804] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:03:31 2022] GET /compute/v2.1/servers/63d2bd74-d060-4925-9323-b39d5131f958 => generated 1535 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:03:32.459840 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-40b8a0c5-9378-4173-a4be-486254603bd5 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:32.466093 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-40b8a0c5-9378-4173-a4be-486254603bd5 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] [instance: bea7ce47-7ad2-4283-9b48-f4f61f71965a] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:32.487247 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-40b8a0c5-9378-4173-a4be-486254603bd5 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:32.488854 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-40b8a0c5-9378-4173-a4be-486254603bd5 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:32.495291 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-40b8a0c5-9378-4173-a4be-486254603bd5 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:32.497469 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-40b8a0c5-9378-4173-a4be-486254603bd5 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:32.500485 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-40b8a0c5-9378-4173-a4be-486254603bd5 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:32.502574 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-40b8a0c5-9378-4173-a4be-486254603bd5 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:32.525728 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-1425021e-c7ca-4851-b66f-b82f52fa5c64 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] 10.222.0.58 "DELETE /compute/v2.1/servers/17b32f05-1f0e-473f-bfda-fab92a90b04f" status: 204 len: 0 microversion: 2.1 time: 0.279356 Aug 10 23:03:32.526864 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 917/1805] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:03:32 2022] DELETE /compute/v2.1/servers/17b32f05-1f0e-473f-bfda-fab92a90b04f => generated 0 bytes in 284 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:03:32.542903 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c2ad8818-79fa-477c-9e5a-b524c9f02a61 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:32.543946 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-c2ad8818-79fa-477c-9e5a-b524c9f02a61 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] [instance: 67accb8d-3e90-483c-a1e5-9a0c04a685c8] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:32.562405 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c2ad8818-79fa-477c-9e5a-b524c9f02a61 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:32.564410 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c2ad8818-79fa-477c-9e5a-b524c9f02a61 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:32.566373 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c2ad8818-79fa-477c-9e5a-b524c9f02a61 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:32.568069 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c2ad8818-79fa-477c-9e5a-b524c9f02a61 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:32.570128 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c2ad8818-79fa-477c-9e5a-b524c9f02a61 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:32.571698 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c2ad8818-79fa-477c-9e5a-b524c9f02a61 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:32.583459 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-40b8a0c5-9378-4173-a4be-486254603bd5 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] [instance: bea7ce47-7ad2-4283-9b48-f4f61f71965a] Going to try to terminate instance {{(pid=122632) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:03:32.635856 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-c2ad8818-79fa-477c-9e5a-b524c9f02a61 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] [instance: 67accb8d-3e90-483c-a1e5-9a0c04a685c8] Going to try to terminate instance {{(pid=122633) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:03:32.741785 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-40b8a0c5-9378-4173-a4be-486254603bd5 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] 10.222.0.58 "DELETE /compute/v2.1/servers/bea7ce47-7ad2-4283-9b48-f4f61f71965a" status: 204 len: 0 microversion: 2.1 time: 0.300273 Aug 10 23:03:32.743616 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 889/1806] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:03:32 2022] DELETE /compute/v2.1/servers/bea7ce47-7ad2-4283-9b48-f4f61f71965a => generated 0 bytes in 309 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:03:32.762006 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-707f7ffa-f011-4ad1-824b-1ae8b4c7d2d1 tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:32.762815 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-707f7ffa-f011-4ad1-824b-1ae8b4c7d2d1 tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] [instance: 63d2bd74-d060-4925-9323-b39d5131f958] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:32.777175 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-707f7ffa-f011-4ad1-824b-1ae8b4c7d2d1 tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:32.778067 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-707f7ffa-f011-4ad1-824b-1ae8b4c7d2d1 tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:32.779452 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-707f7ffa-f011-4ad1-824b-1ae8b4c7d2d1 tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:32.781812 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-707f7ffa-f011-4ad1-824b-1ae8b4c7d2d1 tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:32.782563 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-707f7ffa-f011-4ad1-824b-1ae8b4c7d2d1 tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:32.784576 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-707f7ffa-f011-4ad1-824b-1ae8b4c7d2d1 tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:32.813703 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-c2ad8818-79fa-477c-9e5a-b524c9f02a61 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] 10.222.0.58 "DELETE /compute/v2.1/servers/67accb8d-3e90-483c-a1e5-9a0c04a685c8" status: 204 len: 0 microversion: 2.1 time: 0.284308 Aug 10 23:03:32.814298 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 918/1807] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:03:32 2022] DELETE /compute/v2.1/servers/67accb8d-3e90-483c-a1e5-9a0c04a685c8 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:03:32.821638 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-1031c2e8-5bc8-43b0-8593-18354d80e697 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:32.825957 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-1031c2e8-5bc8-43b0-8593-18354d80e697 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] [instance: 17b32f05-1f0e-473f-bfda-fab92a90b04f] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:32.842268 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1031c2e8-5bc8-43b0-8593-18354d80e697 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:32.842809 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1031c2e8-5bc8-43b0-8593-18354d80e697 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:32.843267 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1031c2e8-5bc8-43b0-8593-18354d80e697 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:32.844850 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1031c2e8-5bc8-43b0-8593-18354d80e697 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:32.845307 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1031c2e8-5bc8-43b0-8593-18354d80e697 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:32.845718 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1031c2e8-5bc8-43b0-8593-18354d80e697 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:33.045421 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-1031c2e8-5bc8-43b0-8593-18354d80e697 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890735b21f5d4764aefd789f74e00222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9cf3129a4e4f56a17bebf68b7bc42b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:33.058021 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-1031c2e8-5bc8-43b0-8593-18354d80e697 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] 10.222.0.58 "GET /compute/v2.1/servers/17b32f05-1f0e-473f-bfda-fab92a90b04f" status: 200 len: 1520 microversion: 2.1 time: 0.239490 Aug 10 23:03:33.072949 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 919/1808] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:03:32 2022] GET /compute/v2.1/servers/17b32f05-1f0e-473f-bfda-fab92a90b04f => generated 1520 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:03:33.080765 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-f36c8676-0ea3-4c02-bc11-1bd42be0b56d tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:33.081657 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-f36c8676-0ea3-4c02-bc11-1bd42be0b56d tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] [instance: a0995db2-2ae0-4216-996a-39a03357c1eb] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:33.089398 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f36c8676-0ea3-4c02-bc11-1bd42be0b56d tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:33.089896 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f36c8676-0ea3-4c02-bc11-1bd42be0b56d tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:33.090414 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f36c8676-0ea3-4c02-bc11-1bd42be0b56d tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:33.091252 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f36c8676-0ea3-4c02-bc11-1bd42be0b56d tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:33.091709 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f36c8676-0ea3-4c02-bc11-1bd42be0b56d tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:33.092139 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f36c8676-0ea3-4c02-bc11-1bd42be0b56d tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:33.127818 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-f36c8676-0ea3-4c02-bc11-1bd42be0b56d tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] [instance: a0995db2-2ae0-4216-996a-39a03357c1eb] Going to try to terminate instance {{(pid=122633) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:03:33.222294 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-707f7ffa-f011-4ad1-824b-1ae8b4c7d2d1 tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/63d2bd74-d060-4925-9323-b39d5131f958" status: 200 len: 1535 microversion: 2.1 time: 0.476661 Aug 10 23:03:33.222937 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 890/1809] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:03:32 2022] GET /compute/v2.1/servers/63d2bd74-d060-4925-9323-b39d5131f958 => generated 1535 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:03:33.237377 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-2d068f82-84f1-4a5d-9faa-4316bf5808ee tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:33.238151 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-2d068f82-84f1-4a5d-9faa-4316bf5808ee tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] [instance: 67accb8d-3e90-483c-a1e5-9a0c04a685c8] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:33.250556 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2d068f82-84f1-4a5d-9faa-4316bf5808ee tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:33.251093 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2d068f82-84f1-4a5d-9faa-4316bf5808ee tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:33.251543 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2d068f82-84f1-4a5d-9faa-4316bf5808ee tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:33.252264 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2d068f82-84f1-4a5d-9faa-4316bf5808ee tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:33.252724 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2d068f82-84f1-4a5d-9faa-4316bf5808ee tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:33.253160 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2d068f82-84f1-4a5d-9faa-4316bf5808ee tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:33.275719 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-f36c8676-0ea3-4c02-bc11-1bd42be0b56d tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] 10.222.0.58 "DELETE /compute/v2.1/servers/a0995db2-2ae0-4216-996a-39a03357c1eb" status: 204 len: 0 microversion: 2.1 time: 0.201246 Aug 10 23:03:33.279531 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 920/1810] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:03:33 2022] DELETE /compute/v2.1/servers/a0995db2-2ae0-4216-996a-39a03357c1eb => generated 0 bytes in 203 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:03:33.284802 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-399bc728-d21a-47c9-90d6-1dc7dc38f342 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:33.286224 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-399bc728-d21a-47c9-90d6-1dc7dc38f342 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] [instance: 99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:33.299022 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-399bc728-d21a-47c9-90d6-1dc7dc38f342 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:33.299943 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-399bc728-d21a-47c9-90d6-1dc7dc38f342 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:33.300496 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-399bc728-d21a-47c9-90d6-1dc7dc38f342 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:33.301570 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-399bc728-d21a-47c9-90d6-1dc7dc38f342 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:33.302135 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-399bc728-d21a-47c9-90d6-1dc7dc38f342 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:33.302872 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-399bc728-d21a-47c9-90d6-1dc7dc38f342 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:33.468733 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-399bc728-d21a-47c9-90d6-1dc7dc38f342 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:33.495229 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-399bc728-d21a-47c9-90d6-1dc7dc38f342 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:33.502214 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-399bc728-d21a-47c9-90d6-1dc7dc38f342 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:33.506373 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-399bc728-d21a-47c9-90d6-1dc7dc38f342 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] 10.222.0.58 "GET /compute/v2.1/servers/99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0" status: 200 len: 1664 microversion: 2.25 time: 0.228373 Aug 10 23:03:33.507551 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 921/1811] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:03:33 2022] GET /compute/v2.1/servers/99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0 => generated 1664 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:03:33.521121 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-b1e42ec4-a4d9-49e1-acaf-a9a4a352bcbe tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:33.535236 n-d-850468-14 devstack@n-api.service[122633]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 23:03:33.535236 n-d-850468-14 devstack@n-api.service[122633]: warnings.warn(msg) Aug 10 23:03:33.537958 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b1e42ec4-a4d9-49e1-acaf-a9a4a352bcbe tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:33.541242 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b1e42ec4-a4d9-49e1-acaf-a9a4a352bcbe tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:33.541782 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b1e42ec4-a4d9-49e1-acaf-a9a4a352bcbe tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:33.542652 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b1e42ec4-a4d9-49e1-acaf-a9a4a352bcbe tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:33.543157 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b1e42ec4-a4d9-49e1-acaf-a9a4a352bcbe tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:33.543642 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b1e42ec4-a4d9-49e1-acaf-a9a4a352bcbe tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:33.656248 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-b1e42ec4-a4d9-49e1-acaf-a9a4a352bcbe tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] 10.222.0.58 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.146031 Aug 10 23:03:33.656938 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 922/1812] 10.222.0.58 () {58 vars in 1176 bytes} [Wed Aug 10 23:03:33 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:03:33.662880 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-3e0ecbd2-54a4-4659-91e0-1987ebe63f79 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:33.663765 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-3e0ecbd2-54a4-4659-91e0-1987ebe63f79 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] [instance: bea7ce47-7ad2-4283-9b48-f4f61f71965a] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:33.673141 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3e0ecbd2-54a4-4659-91e0-1987ebe63f79 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:33.673639 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3e0ecbd2-54a4-4659-91e0-1987ebe63f79 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:33.674080 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3e0ecbd2-54a4-4659-91e0-1987ebe63f79 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:33.674814 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3e0ecbd2-54a4-4659-91e0-1987ebe63f79 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:33.675272 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3e0ecbd2-54a4-4659-91e0-1987ebe63f79 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:33.675696 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3e0ecbd2-54a4-4659-91e0-1987ebe63f79 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:33.857914 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-3e0ecbd2-54a4-4659-91e0-1987ebe63f79 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '417d4eaaeb1c4df78745496ececb3e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27e6ee9495a438b8450a4ef0d62cbcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:33.867001 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-3e0ecbd2-54a4-4659-91e0-1987ebe63f79 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] 10.222.0.58 "GET /compute/v2.1/servers/bea7ce47-7ad2-4283-9b48-f4f61f71965a" status: 200 len: 1475 microversion: 2.1 time: 0.208654 Aug 10 23:03:33.882055 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 923/1813] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:03:33 2022] GET /compute/v2.1/servers/bea7ce47-7ad2-4283-9b48-f4f61f71965a => generated 1475 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:03:33.892718 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-35d061df-2d1e-4460-b746-55b50e5fc425 tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-850468-14", "block_migration": false, "disk_over_commit": false}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:03:33.895301 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-35d061df-2d1e-4460-b746-55b50e5fc425 tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] [instance: 63d2bd74-d060-4925-9323-b39d5131f958] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:33.903492 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-35d061df-2d1e-4460-b746-55b50e5fc425 tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:33.904001 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-35d061df-2d1e-4460-b746-55b50e5fc425 tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:33.904558 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-35d061df-2d1e-4460-b746-55b50e5fc425 tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:33.905169 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-35d061df-2d1e-4460-b746-55b50e5fc425 tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:33.905632 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-35d061df-2d1e-4460-b746-55b50e5fc425 tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:33.906067 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-35d061df-2d1e-4460-b746-55b50e5fc425 tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:33.947511 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.objects.instance [None req-35d061df-2d1e-4460-b746-55b50e5fc425 tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Lazy-loading 'flavor' on Instance uuid 63d2bd74-d060-4925-9323-b39d5131f958 {{(pid=122633) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:03:33.988723 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-35d061df-2d1e-4460-b746-55b50e5fc425 tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] [instance: 63d2bd74-d060-4925-9323-b39d5131f958] Going to try to live migrate instance to n-h2-850468-14 {{(pid=122633) live_migrate /opt/stack/nova/nova/compute/api.py:5443}} Aug 10 23:03:34.083017 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-2d068f82-84f1-4a5d-9faa-4316bf5808ee tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfd6d8e6a8444f5b9fcf1cf8da242ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707f869910b34768ae1a348cd0b5f284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:34.099525 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-2d068f82-84f1-4a5d-9faa-4316bf5808ee tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] 10.222.0.58 "GET /compute/v2.1/servers/67accb8d-3e90-483c-a1e5-9a0c04a685c8" status: 200 len: 1646 microversion: 2.1 time: 0.870758 Aug 10 23:03:34.104489 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 891/1814] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:03:33 2022] GET /compute/v2.1/servers/67accb8d-3e90-483c-a1e5-9a0c04a685c8 => generated 1646 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:03:34.114359 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-1d2f9047-e85c-4f1d-bfd7-044daa24532c tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:34.118356 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-1d2f9047-e85c-4f1d-bfd7-044daa24532c tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] [instance: 17b32f05-1f0e-473f-bfda-fab92a90b04f] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:34.125413 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1d2f9047-e85c-4f1d-bfd7-044daa24532c tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:34.126105 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1d2f9047-e85c-4f1d-bfd7-044daa24532c tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:34.127020 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1d2f9047-e85c-4f1d-bfd7-044daa24532c tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:34.140360 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1d2f9047-e85c-4f1d-bfd7-044daa24532c tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:34.141430 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1d2f9047-e85c-4f1d-bfd7-044daa24532c tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:34.147182 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1d2f9047-e85c-4f1d-bfd7-044daa24532c tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:35.107407 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-1d2f9047-e85c-4f1d-bfd7-044daa24532c tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890735b21f5d4764aefd789f74e00222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9cf3129a4e4f56a17bebf68b7bc42b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:35.120522 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-1d2f9047-e85c-4f1d-bfd7-044daa24532c tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] 10.222.0.58 "GET /compute/v2.1/servers/17b32f05-1f0e-473f-bfda-fab92a90b04f" status: 200 len: 1520 microversion: 2.1 time: 1.014892 Aug 10 23:03:35.121118 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 892/1815] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:03:34 2022] GET /compute/v2.1/servers/17b32f05-1f0e-473f-bfda-fab92a90b04f => generated 1520 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:03:35.136287 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-49f15388-c10a-4b03-b719-dfec575320ea req-042cc7f0-db70-4544-a2ef-2b5cf34523c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0", "name": "network-vif-deleted", "tag": "8098dfba-8285-4ba1-8119-160040ca6e4b"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:03:35.158771 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-49f15388-c10a-4b03-b719-dfec575320ea req-042cc7f0-db70-4544-a2ef-2b5cf34523c0 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:35.159277 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-49f15388-c10a-4b03-b719-dfec575320ea req-042cc7f0-db70-4544-a2ef-2b5cf34523c0 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:35.159699 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-49f15388-c10a-4b03-b719-dfec575320ea req-042cc7f0-db70-4544-a2ef-2b5cf34523c0 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:35.173133 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-49f15388-c10a-4b03-b719-dfec575320ea req-042cc7f0-db70-4544-a2ef-2b5cf34523c0 service nova] Creating event network-vif-deleted:8098dfba-8285-4ba1-8119-160040ca6e4b for instance 99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0 on n-h1-850468-14 Aug 10 23:03:35.197602 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-49f15388-c10a-4b03-b719-dfec575320ea req-042cc7f0-db70-4544-a2ef-2b5cf34523c0 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074506 Aug 10 23:03:35.198511 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 893/1816] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:03:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:03:35.204013 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-547e45d9-bf87-40f5-97ea-44198ed150bb tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:35.205154 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-547e45d9-bf87-40f5-97ea-44198ed150bb tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] [instance: 99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:35.217509 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-547e45d9-bf87-40f5-97ea-44198ed150bb tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:35.227771 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-547e45d9-bf87-40f5-97ea-44198ed150bb tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:35.228502 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-547e45d9-bf87-40f5-97ea-44198ed150bb tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:35.229465 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-547e45d9-bf87-40f5-97ea-44198ed150bb tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:35.230090 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-547e45d9-bf87-40f5-97ea-44198ed150bb tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:35.230945 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-547e45d9-bf87-40f5-97ea-44198ed150bb tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:35.271299 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-547e45d9-bf87-40f5-97ea-44198ed150bb tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] HTTP exception thrown: Instance 99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0 could not be found. Aug 10 23:03:35.278880 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-547e45d9-bf87-40f5-97ea-44198ed150bb tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Request method failure captured: Aug 10 23:03:35.278880 n-d-850468-14 devstack@n-api.service[122632]: request: GET /compute/v2.1/servers/99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0 HTTP/1.1 Aug 10 23:03:35.278880 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:03:35.278880 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:03:35.278880 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:03:35.278880 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 23:03:35.278880 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:03:35.278880 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:03:35.278880 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:03:35.278880 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:03:35.278880 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9DeXYkYLR9CQVdccVgq1hPt0DrO7Y-Tqsq3tzOpEmY8RKTZKEbj7rqP5rBgNFt9k52KejWIWfCOOWUkHukYq1jM7AQrc94vGo1O5nAgAlIU3PqIOLdYIPmLGjLIoW_vctUlJlDlwGinCVbduLE5oYkTQOwNuHIPOOO5NqXrRvcyb7gQ Aug 10 23:03:35.278880 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:03:35.278880 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:03:35.278880 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:03:35.278880 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:03:35.278880 n-d-850468-14 devstack@n-api.service[122632]: X-Openstack-Nova-Api-Version: 2.25 Aug 10 23:03:35.278880 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:03:35.278880 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:03:35.278880 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: b4355fdc73c84fa2baf0d5c9a33e69d5 Aug 10 23:03:35.278880 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1885042872 Aug 10 23:03:35.278880 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:03:35.278880 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:03:35.281841 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b4355fdc73c84fa2baf0d5c9a33e69d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b4355fdc73c84fa2baf0d5c9a33e69d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b4355fdc73c84fa2baf0d5c9a33e69d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b4355fdc73c84fa2baf0d5c9a33e69d5", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:03:35.281841 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1885042872 Aug 10 23:03:35.281841 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: b4355fdc73c84fa2baf0d5c9a33e69d5 Aug 10 23:03:35.281841 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1885042872 Aug 10 23:03:35.281841 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-LiveAutoBlockMigrationV225Test-1885042872-project Aug 10 23:03:35.281841 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:03:35.281841 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:03:35.281841 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: 394f0e6843424c7b83d2dfff61f66ede Aug 10 23:03:35.281841 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1885042872-project Aug 10 23:03:35.281841 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:03:35.281841 n-d-850468-14 devstack@n-api.service[122632]: exception: Instance 99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0 could not be found. Aug 10 23:03:35.281841 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': '99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0'} Aug 10 23:03:35.282908 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:03:35.282908 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:03:35.282908 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:03:35.282908 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:03:35.282908 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:03:35.282908 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:03:35.282908 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:03:35.282908 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:03:35.282908 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:03:35.282908 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:03:35.282908 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0 could not be found. Aug 10 23:03:35.282908 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:03:35.282908 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:03:35.282908 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:03:35.282908 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:03:35.282908 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:03:35.282908 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:03:35.282908 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:03:35.282908 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:03:35.282908 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:03:35.284438 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:03:35.284438 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:03:35.284438 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:03:35.284438 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:03:35.284438 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:03:35.284438 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:03:35.284438 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:03:35.284438 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0 could not be found. Aug 10 23:03:35.284438 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:03:35.284438 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:03:35.284438 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:03:35.284438 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:03:35.284438 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:03:35.284438 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:03:35.284438 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:03:35.284438 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:03:35.284438 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0 could not be found. Aug 10 23:03:35.284438 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:03:35.288237 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-547e45d9-bf87-40f5-97ea-44198ed150bb tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Returning 404 to user: Instance 99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0 could not be found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:03:35.288237 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-547e45d9-bf87-40f5-97ea-44198ed150bb tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] 10.222.0.58 "GET /compute/v2.1/servers/99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0" status: 404 len: 111 microversion: 2.25 time: 0.081179 Aug 10 23:03:35.288237 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 894/1817] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:03:35 2022] GET /compute/v2.1/servers/99bb27bb-a4a4-4fe0-8b59-0ceb097ed9a0 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 10 23:03:35.296353 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-084664d4-e885-4503-98cd-d5de07a539fe tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:35.296823 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-084664d4-e885-4503-98cd-d5de07a539fe tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] [instance: bea7ce47-7ad2-4283-9b48-f4f61f71965a] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:35.312045 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-084664d4-e885-4503-98cd-d5de07a539fe tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:35.312444 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-084664d4-e885-4503-98cd-d5de07a539fe tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:35.313306 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-084664d4-e885-4503-98cd-d5de07a539fe tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:35.314207 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-084664d4-e885-4503-98cd-d5de07a539fe tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:35.314857 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-084664d4-e885-4503-98cd-d5de07a539fe tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:35.317280 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-084664d4-e885-4503-98cd-d5de07a539fe tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:35.757467 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-084664d4-e885-4503-98cd-d5de07a539fe tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '417d4eaaeb1c4df78745496ececb3e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27e6ee9495a438b8450a4ef0d62cbcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:35.771343 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-084664d4-e885-4503-98cd-d5de07a539fe tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] 10.222.0.58 "GET /compute/v2.1/servers/bea7ce47-7ad2-4283-9b48-f4f61f71965a" status: 200 len: 1475 microversion: 2.1 time: 0.484687 Aug 10 23:03:35.772261 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 895/1818] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:03:35 2022] GET /compute/v2.1/servers/bea7ce47-7ad2-4283-9b48-f4f61f71965a => generated 1475 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:03:35.781300 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-a86c6a4c-ed11-4bab-a151-b6c0b0fc1b1f tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:35.787056 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-a86c6a4c-ed11-4bab-a151-b6c0b0fc1b1f tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] [instance: 67accb8d-3e90-483c-a1e5-9a0c04a685c8] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:35.800388 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a86c6a4c-ed11-4bab-a151-b6c0b0fc1b1f tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:35.800884 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a86c6a4c-ed11-4bab-a151-b6c0b0fc1b1f tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:35.801328 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a86c6a4c-ed11-4bab-a151-b6c0b0fc1b1f tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:35.802050 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a86c6a4c-ed11-4bab-a151-b6c0b0fc1b1f tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:35.803265 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a86c6a4c-ed11-4bab-a151-b6c0b0fc1b1f tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:35.803696 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a86c6a4c-ed11-4bab-a151-b6c0b0fc1b1f tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:36.221991 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-a86c6a4c-ed11-4bab-a151-b6c0b0fc1b1f tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfd6d8e6a8444f5b9fcf1cf8da242ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707f869910b34768ae1a348cd0b5f284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:36.235468 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-a86c6a4c-ed11-4bab-a151-b6c0b0fc1b1f tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] 10.222.0.58 "GET /compute/v2.1/servers/67accb8d-3e90-483c-a1e5-9a0c04a685c8" status: 200 len: 1646 microversion: 2.1 time: 0.461773 Aug 10 23:03:36.248525 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 896/1819] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:03:35 2022] GET /compute/v2.1/servers/67accb8d-3e90-483c-a1e5-9a0c04a685c8 => generated 1646 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:03:36.261758 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-dc86d14a-4015-435b-af04-644c31148f6b tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Calling method '.version_select at 0x7f847d732f70>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:36.310958 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-dc86d14a-4015-435b-af04-644c31148f6b tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-388514188" status: 204 len: 0 microversion: 2.25 time: 0.059630 Aug 10 23:03:36.312759 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 897/1820] 10.222.0.58 () {60 vars in 1259 bytes} [Wed Aug 10 23:03:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-388514188 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 10 23:03:36.324342 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-dcd05fe0-696d-4458-aeb9-4b6e5efea038 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:36.326415 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-dcd05fe0-696d-4458-aeb9-4b6e5efea038 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] [instance: 17b32f05-1f0e-473f-bfda-fab92a90b04f] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:36.338973 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dcd05fe0-696d-4458-aeb9-4b6e5efea038 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:36.341936 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dcd05fe0-696d-4458-aeb9-4b6e5efea038 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:36.343542 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dcd05fe0-696d-4458-aeb9-4b6e5efea038 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:36.344486 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dcd05fe0-696d-4458-aeb9-4b6e5efea038 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:36.347742 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dcd05fe0-696d-4458-aeb9-4b6e5efea038 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:36.348193 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dcd05fe0-696d-4458-aeb9-4b6e5efea038 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:37.068475 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-dcd05fe0-696d-4458-aeb9-4b6e5efea038 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890735b21f5d4764aefd789f74e00222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9cf3129a4e4f56a17bebf68b7bc42b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:37.077555 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-dcd05fe0-696d-4458-aeb9-4b6e5efea038 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] 10.222.0.58 "GET /compute/v2.1/servers/17b32f05-1f0e-473f-bfda-fab92a90b04f" status: 200 len: 1520 microversion: 2.1 time: 0.762300 Aug 10 23:03:37.083668 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 898/1821] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:03:36 2022] GET /compute/v2.1/servers/17b32f05-1f0e-473f-bfda-fab92a90b04f => generated 1520 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:03:37.330131 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-5becd78d-8358-473f-854d-721981a747cd tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-833235726", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:03:37.425433 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.network.neutron [None req-5becd78d-8358-473f-854d-721981a747cd tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] validate_networks() for None {{(pid=122632) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 23:03:38.495246 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-5becd78d-8358-473f-854d-721981a747cd tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Flavor limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:03:38.495828 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-5becd78d-8358-473f-854d-721981a747cd tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Image limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:03:38.496126 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-5becd78d-8358-473f-854d-721981a747cd tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Flavor pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:03:38.496739 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-5becd78d-8358-473f-854d-721981a747cd tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Image pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:03:38.497328 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-5becd78d-8358-473f-854d-721981a747cd tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:03:38.521455 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5becd78d-8358-473f-854d-721981a747cd tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:38.522243 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5becd78d-8358-473f-854d-721981a747cd tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:38.523021 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5becd78d-8358-473f-854d-721981a747cd tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:38.524106 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5becd78d-8358-473f-854d-721981a747cd tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:38.525118 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5becd78d-8358-473f-854d-721981a747cd tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:38.525772 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5becd78d-8358-473f-854d-721981a747cd tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:38.548752 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-5becd78d-8358-473f-854d-721981a747cd tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Getting quotas for project c8a6ac1a984c478da9337692485d16ea. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:03:38.560366 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-5becd78d-8358-473f-854d-721981a747cd tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Getting quotas for user 11c26e69e2274083916402c96d71c5a7 and project c8a6ac1a984c478da9337692485d16ea. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:03:38.599248 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-5becd78d-8358-473f-854d-721981a747cd tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Going to run 1 instances... {{(pid=122632) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 23:03:38.606476 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-5becd78d-8358-473f-854d-721981a747cd tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] [instance: 3f5e8cd2-6666-4206-a393-9f0507322402] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78ad8905-f66f-4733-8be9-2b260f1fabed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122632) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 23:03:38.691147 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-5becd78d-8358-473f-854d-721981a747cd tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.606049 Aug 10 23:03:38.692513 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 899/1822] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 23:03:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 1608 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 23:03:38.717920 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-49319b36-f26c-4e4b-b419-61f951f7da63 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:38.723486 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-49319b36-f26c-4e4b-b419-61f951f7da63 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] [instance: bea7ce47-7ad2-4283-9b48-f4f61f71965a] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:38.748810 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-49319b36-f26c-4e4b-b419-61f951f7da63 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:38.750129 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-49319b36-f26c-4e4b-b419-61f951f7da63 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:38.751189 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-49319b36-f26c-4e4b-b419-61f951f7da63 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:38.753587 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-49319b36-f26c-4e4b-b419-61f951f7da63 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:38.754360 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-49319b36-f26c-4e4b-b419-61f951f7da63 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:38.755066 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-49319b36-f26c-4e4b-b419-61f951f7da63 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:39.014187 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-49319b36-f26c-4e4b-b419-61f951f7da63 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '417d4eaaeb1c4df78745496ececb3e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27e6ee9495a438b8450a4ef0d62cbcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:39.025919 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-49319b36-f26c-4e4b-b419-61f951f7da63 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] 10.222.0.58 "GET /compute/v2.1/servers/bea7ce47-7ad2-4283-9b48-f4f61f71965a" status: 200 len: 1433 microversion: 2.1 time: 0.331794 Aug 10 23:03:39.039280 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 900/1823] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:03:38 2022] GET /compute/v2.1/servers/bea7ce47-7ad2-4283-9b48-f4f61f71965a => generated 1433 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:03:39.046831 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-76458691-ceaf-46d6-938c-7853d939b681 req-e9767d4d-0a0a-46a7-ac08-a6776c302acc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67accb8d-3e90-483c-a1e5-9a0c04a685c8", "name": "network-vif-deleted", "tag": "b9a81f82-f5d3-48ec-8420-23fe4897a6b8"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:03:39.059120 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-76458691-ceaf-46d6-938c-7853d939b681 req-e9767d4d-0a0a-46a7-ac08-a6776c302acc service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:39.059999 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-76458691-ceaf-46d6-938c-7853d939b681 req-e9767d4d-0a0a-46a7-ac08-a6776c302acc service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:39.060595 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-76458691-ceaf-46d6-938c-7853d939b681 req-e9767d4d-0a0a-46a7-ac08-a6776c302acc service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:39.089616 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-76458691-ceaf-46d6-938c-7853d939b681 req-e9767d4d-0a0a-46a7-ac08-a6776c302acc service nova] Creating event network-vif-deleted:b9a81f82-f5d3-48ec-8420-23fe4897a6b8 for instance 67accb8d-3e90-483c-a1e5-9a0c04a685c8 on n-h1-850468-14 Aug 10 23:03:39.094304 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-76458691-ceaf-46d6-938c-7853d939b681 req-e9767d4d-0a0a-46a7-ac08-a6776c302acc service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053457 Aug 10 23:03:39.095751 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 901/1824] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:03:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:03:39.102220 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-47696d0a-46e9-4822-a93f-25fe45aefaa3 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:39.103611 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-47696d0a-46e9-4822-a93f-25fe45aefaa3 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] [instance: 67accb8d-3e90-483c-a1e5-9a0c04a685c8] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:39.112299 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-47696d0a-46e9-4822-a93f-25fe45aefaa3 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:39.113666 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-47696d0a-46e9-4822-a93f-25fe45aefaa3 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:39.114506 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-47696d0a-46e9-4822-a93f-25fe45aefaa3 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:39.115548 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-47696d0a-46e9-4822-a93f-25fe45aefaa3 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:39.116242 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-47696d0a-46e9-4822-a93f-25fe45aefaa3 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:39.117052 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-47696d0a-46e9-4822-a93f-25fe45aefaa3 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:39.135468 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-47696d0a-46e9-4822-a93f-25fe45aefaa3 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] HTTP exception thrown: Instance 67accb8d-3e90-483c-a1e5-9a0c04a685c8 could not be found. Aug 10 23:03:39.140909 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-47696d0a-46e9-4822-a93f-25fe45aefaa3 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Request method failure captured: Aug 10 23:03:39.140909 n-d-850468-14 devstack@n-api.service[122632]: request: GET /compute/v2.1/servers/67accb8d-3e90-483c-a1e5-9a0c04a685c8 HTTP/1.1 Aug 10 23:03:39.140909 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:03:39.140909 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:03:39.140909 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:03:39.140909 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 23:03:39.140909 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:03:39.140909 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:03:39.140909 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:03:39.140909 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:03:39.140909 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9Dju6bcY6WgJPTWLWUJ0fX6JaJBRP8GkYZWFafNrDYn8ACaF-JC0t8YD4rSPFgG5Deze7mjmq2_rnPCZ1jpXNRGkHxz134mT5MqTqUm9UAyuVcbLtNQAiAf-L4A3117brPwKa_CN56-tZ47WT8aAPEON_2-WsEOp9qATqEToy30jo_s Aug 10 23:03:39.140909 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:03:39.140909 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:03:39.140909 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:03:39.140909 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:03:39.140909 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:03:39.140909 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:03:39.140909 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 707f869910b34768ae1a348cd0b5f284 Aug 10 23:03:39.140909 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-SecurityGroupsTestJSON-1406525704 Aug 10 23:03:39.140909 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:03:39.140909 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:03:39.142722 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/707f869910b34768ae1a348cd0b5f284"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/707f869910b34768ae1a348cd0b5f284"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/707f869910b34768ae1a348cd0b5f284"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_707f869910b34768ae1a348cd0b5f284", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:03:39.142722 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-SecurityGroupsTestJSON-1406525704 Aug 10 23:03:39.142722 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 707f869910b34768ae1a348cd0b5f284 Aug 10 23:03:39.142722 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1406525704 Aug 10 23:03:39.142722 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-SecurityGroupsTestJSON-1406525704-project Aug 10 23:03:39.142722 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:03:39.142722 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:03:39.142722 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: bfd6d8e6a8444f5b9fcf1cf8da242ac0 Aug 10 23:03:39.142722 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-SecurityGroupsTestJSON-1406525704-project Aug 10 23:03:39.142722 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:03:39.142722 n-d-850468-14 devstack@n-api.service[122632]: exception: Instance 67accb8d-3e90-483c-a1e5-9a0c04a685c8 could not be found. Aug 10 23:03:39.142722 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': '67accb8d-3e90-483c-a1e5-9a0c04a685c8'} Aug 10 23:03:39.143601 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:03:39.143601 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:03:39.143601 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:03:39.143601 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:03:39.143601 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:03:39.143601 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:03:39.143601 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:03:39.143601 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:03:39.143601 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:03:39.143601 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:03:39.143601 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67accb8d-3e90-483c-a1e5-9a0c04a685c8 could not be found. Aug 10 23:03:39.143601 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:03:39.143601 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:03:39.143601 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:03:39.143601 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:03:39.143601 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:03:39.143601 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:03:39.143601 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:03:39.143601 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:03:39.143601 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:03:39.145007 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:03:39.145007 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:03:39.145007 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:03:39.145007 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:03:39.145007 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:03:39.145007 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:03:39.145007 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:03:39.145007 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67accb8d-3e90-483c-a1e5-9a0c04a685c8 could not be found. Aug 10 23:03:39.145007 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:03:39.145007 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:03:39.145007 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:03:39.145007 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:03:39.145007 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:03:39.145007 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:03:39.145007 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:03:39.145007 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:03:39.145007 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67accb8d-3e90-483c-a1e5-9a0c04a685c8 could not be found. Aug 10 23:03:39.145007 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:03:39.146334 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-47696d0a-46e9-4822-a93f-25fe45aefaa3 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Returning 404 to user: Instance 67accb8d-3e90-483c-a1e5-9a0c04a685c8 could not be found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:03:39.146334 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-47696d0a-46e9-4822-a93f-25fe45aefaa3 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] 10.222.0.58 "GET /compute/v2.1/servers/67accb8d-3e90-483c-a1e5-9a0c04a685c8" status: 404 len: 111 microversion: 2.1 time: 0.045602 Aug 10 23:03:39.146334 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 902/1825] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:03:39 2022] GET /compute/v2.1/servers/67accb8d-3e90-483c-a1e5-9a0c04a685c8 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:03:39.153408 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-4eaa661a-baad-4f28-b175-86d17b3098f7 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:39.155858 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-4eaa661a-baad-4f28-b175-86d17b3098f7 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] [instance: 17b32f05-1f0e-473f-bfda-fab92a90b04f] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:39.163903 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4eaa661a-baad-4f28-b175-86d17b3098f7 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:39.164512 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4eaa661a-baad-4f28-b175-86d17b3098f7 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:39.165228 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4eaa661a-baad-4f28-b175-86d17b3098f7 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:39.166260 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4eaa661a-baad-4f28-b175-86d17b3098f7 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:39.167329 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4eaa661a-baad-4f28-b175-86d17b3098f7 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:39.168040 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4eaa661a-baad-4f28-b175-86d17b3098f7 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:39.235887 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-35d061df-2d1e-4460-b746-55b50e5fc425 tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/63d2bd74-d060-4925-9323-b39d5131f958/action" status: 202 len: 0 microversion: 2.1 time: 5.366312 Aug 10 23:03:39.239899 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 924/1826] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:03:33 2022] POST /compute/v2.1/servers/63d2bd74-d060-4925-9323-b39d5131f958/action => generated 0 bytes in 5371 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:03:39.241596 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4eaa661a-baad-4f28-b175-86d17b3098f7 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:39.244603 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4eaa661a-baad-4f28-b175-86d17b3098f7 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:39.245299 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-2cdd38b5-49e8-46b1-8f79-0e6791baf3a1 req-d6bfe1e0-f232-4bfc-bc91-52d98dcfaa04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17b32f05-1f0e-473f-bfda-fab92a90b04f", "name": "network-vif-deleted", "tag": "4dabccdf-cbe5-4d0c-8550-14b485c16ce4"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:03:39.245743 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4eaa661a-baad-4f28-b175-86d17b3098f7 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:39.246483 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.objects.instance [None req-4eaa661a-baad-4f28-b175-86d17b3098f7 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Lazy-loading 'fault' on Instance uuid 17b32f05-1f0e-473f-bfda-fab92a90b04f {{(pid=122632) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:03:39.278997 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-2cdd38b5-49e8-46b1-8f79-0e6791baf3a1 req-d6bfe1e0-f232-4bfc-bc91-52d98dcfaa04 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:39.281535 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-2cdd38b5-49e8-46b1-8f79-0e6791baf3a1 req-d6bfe1e0-f232-4bfc-bc91-52d98dcfaa04 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:39.282319 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-2cdd38b5-49e8-46b1-8f79-0e6791baf3a1 req-d6bfe1e0-f232-4bfc-bc91-52d98dcfaa04 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:39.319671 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-2cdd38b5-49e8-46b1-8f79-0e6791baf3a1 req-d6bfe1e0-f232-4bfc-bc91-52d98dcfaa04 service nova] Creating event network-vif-deleted:4dabccdf-cbe5-4d0c-8550-14b485c16ce4 for instance 17b32f05-1f0e-473f-bfda-fab92a90b04f on n-h2-850468-14 Aug 10 23:03:39.331762 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-2cdd38b5-49e8-46b1-8f79-0e6791baf3a1 req-d6bfe1e0-f232-4bfc-bc91-52d98dcfaa04 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090556 Aug 10 23:03:39.349793 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 925/1827] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:03:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:03:39.370336 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-caa98e15-f389-4e06-8401-a9a6961a2e12 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:39.383902 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-caa98e15-f389-4e06-8401-a9a6961a2e12 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] [instance: 3f5e8cd2-6666-4206-a393-9f0507322402] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:39.487900 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-4eaa661a-baad-4f28-b175-86d17b3098f7 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890735b21f5d4764aefd789f74e00222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9cf3129a4e4f56a17bebf68b7bc42b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:39.501861 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-4eaa661a-baad-4f28-b175-86d17b3098f7 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] 10.222.0.58 "GET /compute/v2.1/servers/17b32f05-1f0e-473f-bfda-fab92a90b04f" status: 200 len: 1313 microversion: 2.1 time: 0.356898 Aug 10 23:03:39.520413 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 903/1828] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:03:39 2022] GET /compute/v2.1/servers/17b32f05-1f0e-473f-bfda-fab92a90b04f => generated 1313 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:03:39.530705 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-051595c9-4624-4a38-8d07-541eaf59c18a tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Calling method '.version_select at 0x7f847d8f9af0>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:39.556861 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-caa98e15-f389-4e06-8401-a9a6961a2e12 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c26e69e2274083916402c96d71c5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a6ac1a984c478da9337692485d16ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:39.566999 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-caa98e15-f389-4e06-8401-a9a6961a2e12 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] 10.222.0.58 "GET /compute/v2.1/servers/3f5e8cd2-6666-4206-a393-9f0507322402" status: 200 len: 1221 microversion: 2.1 time: 0.213424 Aug 10 23:03:39.568679 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 926/1829] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:03:39 2022] GET /compute/v2.1/servers/3f5e8cd2-6666-4206-a393-9f0507322402 => generated 1221 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:03:39.592413 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-322c7c3a-70e1-493c-a1b3-35ae619955d5 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:39.593994 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-322c7c3a-70e1-493c-a1b3-35ae619955d5 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] [instance: 63d2bd74-d060-4925-9323-b39d5131f958] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:39.613032 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-322c7c3a-70e1-493c-a1b3-35ae619955d5 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:39.613403 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-322c7c3a-70e1-493c-a1b3-35ae619955d5 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:39.615089 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-322c7c3a-70e1-493c-a1b3-35ae619955d5 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:39.617902 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-322c7c3a-70e1-493c-a1b3-35ae619955d5 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:39.618917 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-322c7c3a-70e1-493c-a1b3-35ae619955d5 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:39.619355 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-322c7c3a-70e1-493c-a1b3-35ae619955d5 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:40.008572 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-322c7c3a-70e1-493c-a1b3-35ae619955d5 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632904331d024d9b8e4d3660dff2cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ed0bdee3aa4013bd9219069bda558c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:40.023351 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-322c7c3a-70e1-493c-a1b3-35ae619955d5 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] 10.222.0.58 "GET /compute/v2.1/servers/63d2bd74-d060-4925-9323-b39d5131f958" status: 200 len: 1392 microversion: 2.1 time: 0.452952 Aug 10 23:03:40.025463 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 927/1830] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:03:39 2022] GET /compute/v2.1/servers/63d2bd74-d060-4925-9323-b39d5131f958 => generated 1392 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:03:40.049593 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-8c3fd91f-4189-43c9-b474-4901fd9ab2d4 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:40.050361 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-8c3fd91f-4189-43c9-b474-4901fd9ab2d4 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] [instance: eaea4cc7-b1b8-43a7-83a4-8cfc8a44f9c1] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:40.065610 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8c3fd91f-4189-43c9-b474-4901fd9ab2d4 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:40.067536 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8c3fd91f-4189-43c9-b474-4901fd9ab2d4 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:40.069483 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8c3fd91f-4189-43c9-b474-4901fd9ab2d4 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:40.071607 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8c3fd91f-4189-43c9-b474-4901fd9ab2d4 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:40.072040 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8c3fd91f-4189-43c9-b474-4901fd9ab2d4 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:40.076094 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8c3fd91f-4189-43c9-b474-4901fd9ab2d4 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:40.136700 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-8c3fd91f-4189-43c9-b474-4901fd9ab2d4 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] [instance: eaea4cc7-b1b8-43a7-83a4-8cfc8a44f9c1] Going to try to terminate instance {{(pid=122633) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:03:40.247460 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-8c3fd91f-4189-43c9-b474-4901fd9ab2d4 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] 10.222.0.58 "DELETE /compute/v2.1/servers/eaea4cc7-b1b8-43a7-83a4-8cfc8a44f9c1" status: 204 len: 0 microversion: 2.25 time: 0.218747 Aug 10 23:03:40.260899 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 928/1831] 10.222.0.58 () {60 vars in 1280 bytes} [Wed Aug 10 23:03:40 2022] DELETE /compute/v2.1/servers/eaea4cc7-b1b8-43a7-83a4-8cfc8a44f9c1 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 10 23:03:40.266517 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-0406c7ae-f9e6-4440-a041-c007afcceccf tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:40.267249 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-0406c7ae-f9e6-4440-a041-c007afcceccf tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] [instance: bea7ce47-7ad2-4283-9b48-f4f61f71965a] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:40.277844 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0406c7ae-f9e6-4440-a041-c007afcceccf tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:40.279671 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0406c7ae-f9e6-4440-a041-c007afcceccf tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:40.280382 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0406c7ae-f9e6-4440-a041-c007afcceccf tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:40.281917 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0406c7ae-f9e6-4440-a041-c007afcceccf tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:40.283845 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0406c7ae-f9e6-4440-a041-c007afcceccf tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:40.288452 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0406c7ae-f9e6-4440-a041-c007afcceccf tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:40.294186 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=5,nova_cell1:UPDATE=5 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:03:40.338249 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0406c7ae-f9e6-4440-a041-c007afcceccf tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:40.340447 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0406c7ae-f9e6-4440-a041-c007afcceccf tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:40.340447 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0406c7ae-f9e6-4440-a041-c007afcceccf tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:40.340912 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.objects.instance [None req-0406c7ae-f9e6-4440-a041-c007afcceccf tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lazy-loading 'fault' on Instance uuid bea7ce47-7ad2-4283-9b48-f4f61f71965a {{(pid=122633) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:03:40.406392 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-0406c7ae-f9e6-4440-a041-c007afcceccf tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '417d4eaaeb1c4df78745496ececb3e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27e6ee9495a438b8450a4ef0d62cbcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:40.423530 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-0406c7ae-f9e6-4440-a041-c007afcceccf tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] 10.222.0.58 "GET /compute/v2.1/servers/bea7ce47-7ad2-4283-9b48-f4f61f71965a" status: 200 len: 1309 microversion: 2.1 time: 0.159431 Aug 10 23:03:40.427001 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 929/1832] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:03:40 2022] GET /compute/v2.1/servers/bea7ce47-7ad2-4283-9b48-f4f61f71965a => generated 1309 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:03:40.440337 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-7f38d570-1df7-45e4-9b9f-4725f397e735 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:40.441057 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-7f38d570-1df7-45e4-9b9f-4725f397e735 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] [instance: eaea4cc7-b1b8-43a7-83a4-8cfc8a44f9c1] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:40.448936 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7f38d570-1df7-45e4-9b9f-4725f397e735 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:40.449501 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7f38d570-1df7-45e4-9b9f-4725f397e735 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:40.450188 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7f38d570-1df7-45e4-9b9f-4725f397e735 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:40.451118 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7f38d570-1df7-45e4-9b9f-4725f397e735 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:40.451674 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7f38d570-1df7-45e4-9b9f-4725f397e735 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:40.452173 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7f38d570-1df7-45e4-9b9f-4725f397e735 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:40.593391 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-051595c9-4624-4a38-8d07-541eaf59c18a tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/6a8f01ff-e4b7-461e-9543-d4774d97a84a" status: 202 len: 0 microversion: 2.1 time: 1.071217 Aug 10 23:03:40.599021 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 904/1833] 10.222.0.58 () {58 vars in 1272 bytes} [Wed Aug 10 23:03:39 2022] DELETE /compute/v2.1/os-security-groups/6a8f01ff-e4b7-461e-9543-d4774d97a84a => generated 0 bytes in 1078 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:03:40.605674 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-dbd7ac61-619d-48aa-91fe-922da0b8236c tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:40.606911 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-dbd7ac61-619d-48aa-91fe-922da0b8236c tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] [instance: 17b32f05-1f0e-473f-bfda-fab92a90b04f] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:40.615225 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dbd7ac61-619d-48aa-91fe-922da0b8236c tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:40.616283 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dbd7ac61-619d-48aa-91fe-922da0b8236c tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:40.618313 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dbd7ac61-619d-48aa-91fe-922da0b8236c tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:40.620085 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dbd7ac61-619d-48aa-91fe-922da0b8236c tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:40.621432 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dbd7ac61-619d-48aa-91fe-922da0b8236c tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:40.622122 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dbd7ac61-619d-48aa-91fe-922da0b8236c tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:40.645255 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-dbd7ac61-619d-48aa-91fe-922da0b8236c tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] HTTP exception thrown: Instance 17b32f05-1f0e-473f-bfda-fab92a90b04f could not be found. Aug 10 23:03:40.650716 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-dbd7ac61-619d-48aa-91fe-922da0b8236c tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Request method failure captured: Aug 10 23:03:40.650716 n-d-850468-14 devstack@n-api.service[122632]: request: GET /compute/v2.1/servers/17b32f05-1f0e-473f-bfda-fab92a90b04f HTTP/1.1 Aug 10 23:03:40.650716 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:03:40.650716 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:03:40.650716 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:03:40.650716 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 23:03:40.650716 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:03:40.650716 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:03:40.650716 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:03:40.650716 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:03:40.650716 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9DkiAjWMnEScmXUQ4URpE929LR04Z8tVQFM7-HlbAmthzngpnguHOyLOUY0k3vhcWXMqybRYRnxQLljJds4eIyjIcnw25UUriDcSFQLJ0yAgBKlC5ig8XoT5HsrMNoi0tzD74DHerwRzKapIeqizBGLGMzal9OBH_ENocwnLGn23ebg Aug 10 23:03:40.650716 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:03:40.650716 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:03:40.650716 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:03:40.650716 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:03:40.650716 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:03:40.650716 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:03:40.650716 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 9e9cf3129a4e4f56a17bebf68b7bc42b Aug 10 23:03:40.650716 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-ListServersNegativeTestJSON-1516024484 Aug 10 23:03:40.650716 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:03:40.650716 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:03:40.652478 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9e9cf3129a4e4f56a17bebf68b7bc42b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9e9cf3129a4e4f56a17bebf68b7bc42b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/9e9cf3129a4e4f56a17bebf68b7bc42b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_9e9cf3129a4e4f56a17bebf68b7bc42b", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:03:40.652478 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-ListServersNegativeTestJSON-1516024484 Aug 10 23:03:40.652478 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 9e9cf3129a4e4f56a17bebf68b7bc42b Aug 10 23:03:40.652478 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1516024484 Aug 10 23:03:40.652478 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-ListServersNegativeTestJSON-1516024484-project Aug 10 23:03:40.652478 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:03:40.652478 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:03:40.652478 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: 890735b21f5d4764aefd789f74e00222 Aug 10 23:03:40.652478 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-ListServersNegativeTestJSON-1516024484-project Aug 10 23:03:40.652478 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:03:40.652478 n-d-850468-14 devstack@n-api.service[122632]: exception: Instance 17b32f05-1f0e-473f-bfda-fab92a90b04f could not be found. Aug 10 23:03:40.652478 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': '17b32f05-1f0e-473f-bfda-fab92a90b04f'} Aug 10 23:03:40.653458 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:03:40.653458 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:03:40.653458 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:03:40.653458 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:03:40.653458 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:03:40.653458 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:03:40.653458 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:03:40.653458 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:03:40.653458 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:03:40.653458 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:03:40.653458 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17b32f05-1f0e-473f-bfda-fab92a90b04f could not be found. Aug 10 23:03:40.653458 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:03:40.653458 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:03:40.653458 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:03:40.653458 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:03:40.653458 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:03:40.653458 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:03:40.653458 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:03:40.653458 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:03:40.653458 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:03:40.654969 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:03:40.654969 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:03:40.654969 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:03:40.654969 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:03:40.654969 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:03:40.654969 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:03:40.654969 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:03:40.654969 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17b32f05-1f0e-473f-bfda-fab92a90b04f could not be found. Aug 10 23:03:40.654969 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:03:40.654969 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:03:40.654969 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:03:40.654969 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:03:40.654969 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:03:40.654969 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:03:40.654969 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:03:40.654969 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:03:40.654969 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17b32f05-1f0e-473f-bfda-fab92a90b04f could not be found. Aug 10 23:03:40.654969 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:03:40.658406 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-dbd7ac61-619d-48aa-91fe-922da0b8236c tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Returning 404 to user: Instance 17b32f05-1f0e-473f-bfda-fab92a90b04f could not be found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:03:40.658406 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-dbd7ac61-619d-48aa-91fe-922da0b8236c tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] 10.222.0.58 "GET /compute/v2.1/servers/17b32f05-1f0e-473f-bfda-fab92a90b04f" status: 404 len: 111 microversion: 2.1 time: 0.051940 Aug 10 23:03:40.659534 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 905/1834] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:03:40 2022] GET /compute/v2.1/servers/17b32f05-1f0e-473f-bfda-fab92a90b04f => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:03:40.673255 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-fb5f8039-b696-4147-9939-2a223a44e4d2 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:40.674459 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-fb5f8039-b696-4147-9939-2a223a44e4d2 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] [instance: 3f5e8cd2-6666-4206-a393-9f0507322402] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:40.685570 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-7f38d570-1df7-45e4-9b9f-4725f397e735 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:40.698125 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-7f38d570-1df7-45e4-9b9f-4725f397e735 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:40.701896 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fb5f8039-b696-4147-9939-2a223a44e4d2 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:40.702414 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-7f38d570-1df7-45e4-9b9f-4725f397e735 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:40.706524 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fb5f8039-b696-4147-9939-2a223a44e4d2 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:40.707090 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fb5f8039-b696-4147-9939-2a223a44e4d2 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:40.707840 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fb5f8039-b696-4147-9939-2a223a44e4d2 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:40.708899 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-7f38d570-1df7-45e4-9b9f-4725f397e735 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] 10.222.0.58 "GET /compute/v2.1/servers/eaea4cc7-b1b8-43a7-83a4-8cfc8a44f9c1" status: 200 len: 1548 microversion: 2.25 time: 0.272839 Aug 10 23:03:40.709125 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 930/1835] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:03:40 2022] GET /compute/v2.1/servers/eaea4cc7-b1b8-43a7-83a4-8cfc8a44f9c1 => generated 1548 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:03:40.719736 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fb5f8039-b696-4147-9939-2a223a44e4d2 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:40.723350 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fb5f8039-b696-4147-9939-2a223a44e4d2 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:40.730069 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-d6eec967-81bc-42f7-b05f-2eebfcf26a01 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Calling method '.version_select at 0x7f847d3744c0>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:40.834830 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-fb5f8039-b696-4147-9939-2a223a44e4d2 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c26e69e2274083916402c96d71c5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a6ac1a984c478da9337692485d16ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:40.845612 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-fb5f8039-b696-4147-9939-2a223a44e4d2 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] 10.222.0.58 "GET /compute/v2.1/servers/3f5e8cd2-6666-4206-a393-9f0507322402" status: 200 len: 1273 microversion: 2.1 time: 0.183617 Aug 10 23:03:40.846102 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 906/1836] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:03:40 2022] GET /compute/v2.1/servers/3f5e8cd2-6666-4206-a393-9f0507322402 => generated 1273 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:03:40.861378 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-2ec3abc9-fa78-49fb-ad69-24289128e80f tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:40.874431 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-2ec3abc9-fa78-49fb-ad69-24289128e80f tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '890735b21f5d4764aefd789f74e00222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9cf3129a4e4f56a17bebf68b7bc42b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:40.876825 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-2ec3abc9-fa78-49fb-ad69-24289128e80f tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': '9e9cf3129a4e4f56a17bebf68b7bc42b'} {{(pid=122632) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 10 23:03:40.891732 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2ec3abc9-fa78-49fb-ad69-24289128e80f tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:40.896210 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2ec3abc9-fa78-49fb-ad69-24289128e80f tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:40.896880 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2ec3abc9-fa78-49fb-ad69-24289128e80f tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:40.897868 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2ec3abc9-fa78-49fb-ad69-24289128e80f tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:40.898574 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2ec3abc9-fa78-49fb-ad69-24289128e80f tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:40.900672 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2ec3abc9-fa78-49fb-ad69-24289128e80f tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:41.035039 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-2ec3abc9-fa78-49fb-ad69-24289128e80f tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] 10.222.0.58 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.187488 Aug 10 23:03:41.036103 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 907/1837] 10.222.0.58 () {58 vars in 1230 bytes} [Wed Aug 10 23:03:40 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 23:03:41.054492 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-30b8bb3c-3a0d-4fe1-be54-6de7137c473f tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:41.061841 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-30b8bb3c-3a0d-4fe1-be54-6de7137c473f tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Request method failure captured: Aug 10 23:03:41.061841 n-d-850468-14 devstack@n-api.service[122632]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 Aug 10 23:03:41.061841 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:03:41.061841 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:03:41.061841 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:03:41.061841 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 23:03:41.061841 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:03:41.061841 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:03:41.061841 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:03:41.061841 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:03:41.061841 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9DkiAjWMnEScmXUQ4URpE929LR04Z8tVQFM7-HlbAmthzngpnguHOyLOUY0k3vhcWXMqybRYRnxQLljJds4eIyjIcnw25UUriDcSFQLJ0yAgBKlC5ig8XoT5HsrMNoi0tzD74DHerwRzKapIeqizBGLGMzal9OBH_ENocwnLGn23ebg Aug 10 23:03:41.061841 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:03:41.061841 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:03:41.061841 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:03:41.061841 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:03:41.061841 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:03:41.061841 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:03:41.061841 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 9e9cf3129a4e4f56a17bebf68b7bc42b Aug 10 23:03:41.061841 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-ListServersNegativeTestJSON-1516024484 Aug 10 23:03:41.061841 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:03:41.061841 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:03:41.063726 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9e9cf3129a4e4f56a17bebf68b7bc42b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9e9cf3129a4e4f56a17bebf68b7bc42b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/9e9cf3129a4e4f56a17bebf68b7bc42b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_9e9cf3129a4e4f56a17bebf68b7bc42b", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:03:41.063726 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-ListServersNegativeTestJSON-1516024484 Aug 10 23:03:41.063726 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 9e9cf3129a4e4f56a17bebf68b7bc42b Aug 10 23:03:41.063726 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1516024484 Aug 10 23:03:41.063726 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-ListServersNegativeTestJSON-1516024484-project Aug 10 23:03:41.063726 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:03:41.063726 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:03:41.063726 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: 890735b21f5d4764aefd789f74e00222 Aug 10 23:03:41.063726 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-ListServersNegativeTestJSON-1516024484-project Aug 10 23:03:41.063726 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:03:41.063726 n-d-850468-14 devstack@n-api.service[122632]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Aug 10 23:03:41.063726 n-d-850468-14 devstack@n-api.service[122632]: action_args: {} Aug 10 23:03:41.064743 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:03:41.064743 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:03:41.064743 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 10 23:03:41.064743 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 10 23:03:41.064743 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 10 23:03:41.064743 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise error Aug 10 23:03:41.064743 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' Aug 10 23:03:41.064743 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:03:41.064743 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: Aug 10 23:03:41.064743 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} Aug 10 23:03:41.064743 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:03:41.064743 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi On instance[0]: Aug 10 23:03:41.064743 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi '2011/01/01' Aug 10 23:03:41.064743 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:03:41.064743 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:03:41.064743 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:03:41.064743 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:03:41.064743 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:03:41.064743 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:03:41.064743 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:03:41.064743 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:03:41.064743 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:03:41.064743 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:03:41.066546 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 10 23:03:41.066546 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 23:03:41.066546 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 10 23:03:41.066546 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 23:03:41.066546 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 10 23:03:41.066546 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 23:03:41.066546 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 10 23:03:41.066546 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Aug 10 23:03:41.066546 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Aug 10 23:03:41.066546 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 10 23:03:41.066546 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 10 23:03:41.066546 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 10 23:03:41.066546 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 10 23:03:41.066546 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Aug 10 23:03:41.066546 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:03:41.066546 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:03:41.066546 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:03:41.066546 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:03:41.066546 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:03:41.066546 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:03:41.068084 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 10 23:03:41.068084 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 10 23:03:41.068084 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Aug 10 23:03:41.068084 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:03:41.068565 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-30b8bb3c-3a0d-4fe1-be54-6de7137c473f tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:03:41.069767 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-30b8bb3c-3a0d-4fe1-be54-6de7137c473f tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] 10.222.0.58 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.024151 Aug 10 23:03:41.070351 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 908/1838] 10.222.0.58 () {58 vars in 1182 bytes} [Wed Aug 10 23:03:41 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 10 23:03:41.080899 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-1a7cc658-e9f6-44c8-a441-da58a27dce57 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:41.082156 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-1a7cc658-e9f6-44c8-a441-da58a27dce57 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] [instance: 63d2bd74-d060-4925-9323-b39d5131f958] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:41.092040 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1a7cc658-e9f6-44c8-a441-da58a27dce57 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:41.092711 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1a7cc658-e9f6-44c8-a441-da58a27dce57 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:41.093161 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1a7cc658-e9f6-44c8-a441-da58a27dce57 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:41.101818 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1a7cc658-e9f6-44c8-a441-da58a27dce57 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:41.103113 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1a7cc658-e9f6-44c8-a441-da58a27dce57 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:41.103562 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1a7cc658-e9f6-44c8-a441-da58a27dce57 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:41.261053 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-d6eec967-81bc-42f7-b05f-2eebfcf26a01 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/e7812d23-703d-433d-a1e7-509e5ada814d" status: 202 len: 0 microversion: 2.1 time: 0.539845 Aug 10 23:03:41.263287 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 931/1839] 10.222.0.58 () {58 vars in 1272 bytes} [Wed Aug 10 23:03:40 2022] DELETE /compute/v2.1/os-security-groups/e7812d23-703d-433d-a1e7-509e5ada814d => generated 0 bytes in 553 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:03:41.270042 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-5390f7e7-63b0-4316-a309-c85e150ef529 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:41.277252 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-5390f7e7-63b0-4316-a309-c85e150ef529 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '890735b21f5d4764aefd789f74e00222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9cf3129a4e4f56a17bebf68b7bc42b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:41.297156 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-5390f7e7-63b0-4316-a309-c85e150ef529 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Searching by: {'deleted': False, 'project_id': '9e9cf3129a4e4f56a17bebf68b7bc42b'} {{(pid=122633) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 10 23:03:41.306023 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5390f7e7-63b0-4316-a309-c85e150ef529 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:41.307086 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5390f7e7-63b0-4316-a309-c85e150ef529 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:41.307742 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5390f7e7-63b0-4316-a309-c85e150ef529 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:41.308944 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5390f7e7-63b0-4316-a309-c85e150ef529 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:41.309690 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5390f7e7-63b0-4316-a309-c85e150ef529 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:41.310711 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5390f7e7-63b0-4316-a309-c85e150ef529 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:41.374288 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.multi_cell_list [None req-5390f7e7-63b0-4316-a309-c85e150ef529 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=122633) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 10 23:03:41.481151 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-5390f7e7-63b0-4316-a309-c85e150ef529 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] 10.222.0.58 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.216156 Aug 10 23:03:41.481804 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 932/1840] 10.222.0.58 () {58 vars in 1125 bytes} [Wed Aug 10 23:03:41 2022] GET /compute/v2.1/servers => generated 683 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:03:41.487659 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-5f8c9875-26fd-4d53-99f1-2b4eb2c5d566 req-b76d974f-7ee0-4223-9de9-d381eb1f11de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bea7ce47-7ad2-4283-9b48-f4f61f71965a", "name": "network-vif-deleted", "tag": "74d9803a-f789-4d14-b0ab-c4424356ec89"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:03:41.511070 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-5f8c9875-26fd-4d53-99f1-2b4eb2c5d566 req-b76d974f-7ee0-4223-9de9-d381eb1f11de service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:41.512131 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-5f8c9875-26fd-4d53-99f1-2b4eb2c5d566 req-b76d974f-7ee0-4223-9de9-d381eb1f11de service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:41.512840 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-5f8c9875-26fd-4d53-99f1-2b4eb2c5d566 req-b76d974f-7ee0-4223-9de9-d381eb1f11de service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:41.548976 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-5f8c9875-26fd-4d53-99f1-2b4eb2c5d566 req-b76d974f-7ee0-4223-9de9-d381eb1f11de service nova] Creating event network-vif-deleted:74d9803a-f789-4d14-b0ab-c4424356ec89 for instance bea7ce47-7ad2-4283-9b48-f4f61f71965a on n-h2-850468-14 Aug 10 23:03:41.557914 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-5f8c9875-26fd-4d53-99f1-2b4eb2c5d566 req-b76d974f-7ee0-4223-9de9-d381eb1f11de service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074096 Aug 10 23:03:41.559661 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 933/1841] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:03:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:03:41.567814 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-bcc5d09b-6e9c-44e6-bb73-1137542f70d0 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Action: 'create', calling method: .version_select at 0x7f847cf38040>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-371495617", "description": "tempest-description-372890652"}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:03:41.679706 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-1a7cc658-e9f6-44c8-a441-da58a27dce57 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632904331d024d9b8e4d3660dff2cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ed0bdee3aa4013bd9219069bda558c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:41.689040 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:03:41.698838 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-1a7cc658-e9f6-44c8-a441-da58a27dce57 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] 10.222.0.58 "GET /compute/v2.1/servers/63d2bd74-d060-4925-9323-b39d5131f958" status: 200 len: 1392 microversion: 2.1 time: 0.625636 Aug 10 23:03:41.702717 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 909/1842] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:03:41 2022] GET /compute/v2.1/servers/63d2bd74-d060-4925-9323-b39d5131f958 => generated 1392 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:03:41.710363 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-901a896f-d21f-4f8b-891e-b9953113d956 req-08f15d13-6007-4444-9f89-138806ec5f73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0995db2-2ae0-4216-996a-39a03357c1eb", "name": "network-vif-deleted", "tag": "25ce4b44-8eb9-433e-96ad-43b05662b91c"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:03:41.733652 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-901a896f-d21f-4f8b-891e-b9953113d956 req-08f15d13-6007-4444-9f89-138806ec5f73 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:41.735264 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-901a896f-d21f-4f8b-891e-b9953113d956 req-08f15d13-6007-4444-9f89-138806ec5f73 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:41.736409 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-901a896f-d21f-4f8b-891e-b9953113d956 req-08f15d13-6007-4444-9f89-138806ec5f73 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:41.757539 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-901a896f-d21f-4f8b-891e-b9953113d956 req-08f15d13-6007-4444-9f89-138806ec5f73 service nova] Creating event network-vif-deleted:25ce4b44-8eb9-433e-96ad-43b05662b91c for instance a0995db2-2ae0-4216-996a-39a03357c1eb on n-h2-850468-14 Aug 10 23:03:41.766637 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-901a896f-d21f-4f8b-891e-b9953113d956 req-08f15d13-6007-4444-9f89-138806ec5f73 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061385 Aug 10 23:03:41.767788 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 910/1843] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:03:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:03:41.779988 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-72c4498a-cf57-4991-b9a2-60b9adbd454f tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:41.780999 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-72c4498a-cf57-4991-b9a2-60b9adbd454f tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] [instance: bea7ce47-7ad2-4283-9b48-f4f61f71965a] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:41.791514 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-72c4498a-cf57-4991-b9a2-60b9adbd454f tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:41.792616 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-72c4498a-cf57-4991-b9a2-60b9adbd454f tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:41.793203 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-72c4498a-cf57-4991-b9a2-60b9adbd454f tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:41.794047 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-72c4498a-cf57-4991-b9a2-60b9adbd454f tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:41.794605 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-72c4498a-cf57-4991-b9a2-60b9adbd454f tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:41.795144 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-72c4498a-cf57-4991-b9a2-60b9adbd454f tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:41.814628 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-72c4498a-cf57-4991-b9a2-60b9adbd454f tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] HTTP exception thrown: Instance bea7ce47-7ad2-4283-9b48-f4f61f71965a could not be found. Aug 10 23:03:41.817142 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-72c4498a-cf57-4991-b9a2-60b9adbd454f tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Request method failure captured: Aug 10 23:03:41.817142 n-d-850468-14 devstack@n-api.service[122632]: request: GET /compute/v2.1/servers/bea7ce47-7ad2-4283-9b48-f4f61f71965a HTTP/1.1 Aug 10 23:03:41.817142 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:03:41.817142 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:03:41.817142 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:03:41.817142 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 23:03:41.817142 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:03:41.817142 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:03:41.817142 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:03:41.817142 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:03:41.817142 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9DhnJQVy677u4b7dnMoSItqtWsJm27g_Vg031CYXViqt8YYY7d4cXYrgXs0Pp9xS3IIxdwWgPKq2sDULWw--Li9t2t8l1R3feSY4uh4FysmLVRfKNCAYvKF_tmPQ5ZUjwhrC4jAx70ULoXcE-6wvpA-wHk_CVzAxHX7IWuhEQLk8ZDk Aug 10 23:03:41.817142 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:03:41.817142 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:03:41.817142 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:03:41.817142 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:03:41.817142 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:03:41.817142 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:03:41.817142 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: b27e6ee9495a438b8450a4ef0d62cbcd Aug 10 23:03:41.817142 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-ServersOnMultiNodesTest-936995831 Aug 10 23:03:41.817142 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:03:41.817142 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:03:41.819114 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b27e6ee9495a438b8450a4ef0d62cbcd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b27e6ee9495a438b8450a4ef0d62cbcd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b27e6ee9495a438b8450a4ef0d62cbcd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b27e6ee9495a438b8450a4ef0d62cbcd", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:03:41.819114 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-ServersOnMultiNodesTest-936995831 Aug 10 23:03:41.819114 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: b27e6ee9495a438b8450a4ef0d62cbcd Aug 10 23:03:41.819114 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-936995831 Aug 10 23:03:41.819114 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-ServersOnMultiNodesTest-936995831-project Aug 10 23:03:41.819114 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:03:41.819114 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:03:41.819114 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: 417d4eaaeb1c4df78745496ececb3e88 Aug 10 23:03:41.819114 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-ServersOnMultiNodesTest-936995831-project Aug 10 23:03:41.819114 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:03:41.819114 n-d-850468-14 devstack@n-api.service[122632]: exception: Instance bea7ce47-7ad2-4283-9b48-f4f61f71965a could not be found. Aug 10 23:03:41.819114 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': 'bea7ce47-7ad2-4283-9b48-f4f61f71965a'} Aug 10 23:03:41.820351 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:03:41.820351 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:03:41.820351 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:03:41.820351 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:03:41.820351 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:03:41.820351 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:03:41.820351 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:03:41.820351 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:03:41.820351 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:03:41.820351 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:03:41.820351 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bea7ce47-7ad2-4283-9b48-f4f61f71965a could not be found. Aug 10 23:03:41.820351 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:03:41.820351 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:03:41.820351 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:03:41.820351 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:03:41.820351 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:03:41.820351 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:03:41.820351 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:03:41.820351 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:03:41.820351 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:03:41.823739 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:03:41.823739 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:03:41.823739 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:03:41.823739 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:03:41.823739 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:03:41.823739 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:03:41.823739 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:03:41.823739 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bea7ce47-7ad2-4283-9b48-f4f61f71965a could not be found. Aug 10 23:03:41.823739 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:03:41.823739 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:03:41.823739 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:03:41.823739 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:03:41.823739 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:03:41.823739 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:03:41.823739 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:03:41.823739 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:03:41.823739 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bea7ce47-7ad2-4283-9b48-f4f61f71965a could not be found. Aug 10 23:03:41.823739 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:03:41.826667 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-72c4498a-cf57-4991-b9a2-60b9adbd454f tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Returning 404 to user: Instance bea7ce47-7ad2-4283-9b48-f4f61f71965a could not be found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:03:41.826667 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-72c4498a-cf57-4991-b9a2-60b9adbd454f tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] 10.222.0.58 "GET /compute/v2.1/servers/bea7ce47-7ad2-4283-9b48-f4f61f71965a" status: 404 len: 111 microversion: 2.1 time: 0.049410 Aug 10 23:03:41.826667 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 911/1844] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:03:41 2022] GET /compute/v2.1/servers/bea7ce47-7ad2-4283-9b48-f4f61f71965a => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:03:41.828056 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-44b5ae20-1107-43ce-bf13-e33927e530cd tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:41.834276 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-44b5ae20-1107-43ce-bf13-e33927e530cd tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '890735b21f5d4764aefd789f74e00222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9cf3129a4e4f56a17bebf68b7bc42b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:41.834738 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.compute.servers [None req-44b5ae20-1107-43ce-bf13-e33927e530cd tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Removing options 'limit' from query {{(pid=122632) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 10 23:03:41.835993 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-44b5ae20-1107-43ce-bf13-e33927e530cd tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Searching by: {'deleted': False, 'project_id': '9e9cf3129a4e4f56a17bebf68b7bc42b'} {{(pid=122632) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 10 23:03:41.843079 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-44b5ae20-1107-43ce-bf13-e33927e530cd tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:41.843797 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-44b5ae20-1107-43ce-bf13-e33927e530cd tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:41.844447 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-44b5ae20-1107-43ce-bf13-e33927e530cd tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:41.845344 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-44b5ae20-1107-43ce-bf13-e33927e530cd tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:41.845813 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-44b5ae20-1107-43ce-bf13-e33927e530cd tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:41.846240 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-44b5ae20-1107-43ce-bf13-e33927e530cd tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:41.891685 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.multi_cell_list [None req-44b5ae20-1107-43ce-bf13-e33927e530cd tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=122632) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 10 23:03:41.970443 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-44b5ae20-1107-43ce-bf13-e33927e530cd tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] 10.222.0.58 "GET /compute/v2.1/servers?limit=102" status: 200 len: 683 microversion: 2.1 time: 0.149158 Aug 10 23:03:41.971460 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 912/1845] 10.222.0.58 () {58 vars in 1144 bytes} [Wed Aug 10 23:03:41 2022] GET /compute/v2.1/servers?limit=102 => generated 683 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:03:41.985669 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-310662c9-bf31-4ee8-9a85-85fcb727c2b1 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:41.986439 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-310662c9-bf31-4ee8-9a85-85fcb727c2b1 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] [instance: eaea4cc7-b1b8-43a7-83a4-8cfc8a44f9c1] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:41.994658 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-310662c9-bf31-4ee8-9a85-85fcb727c2b1 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:41.995298 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-310662c9-bf31-4ee8-9a85-85fcb727c2b1 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:41.995770 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-310662c9-bf31-4ee8-9a85-85fcb727c2b1 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:41.997931 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-310662c9-bf31-4ee8-9a85-85fcb727c2b1 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:41.999792 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-310662c9-bf31-4ee8-9a85-85fcb727c2b1 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:42.001842 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-310662c9-bf31-4ee8-9a85-85fcb727c2b1 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:42.219541 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-bcc5d09b-6e9c-44e6-bb73-1137542f70d0 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] 10.222.0.58 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.656501 Aug 10 23:03:42.223321 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 934/1846] 10.222.0.58 () {60 vars in 1180 bytes} [Wed Aug 10 23:03:41 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:03:42.241470 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c2f4fae3-291c-485b-a8a4-5d0964ee6515 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:42.244148 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-c2f4fae3-291c-485b-a8a4-5d0964ee6515 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] [instance: a0995db2-2ae0-4216-996a-39a03357c1eb] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:42.257609 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c2f4fae3-291c-485b-a8a4-5d0964ee6515 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:42.259917 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c2f4fae3-291c-485b-a8a4-5d0964ee6515 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:42.260732 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c2f4fae3-291c-485b-a8a4-5d0964ee6515 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:42.261638 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c2f4fae3-291c-485b-a8a4-5d0964ee6515 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:42.262202 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c2f4fae3-291c-485b-a8a4-5d0964ee6515 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:42.262878 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c2f4fae3-291c-485b-a8a4-5d0964ee6515 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:42.280581 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-c2f4fae3-291c-485b-a8a4-5d0964ee6515 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] HTTP exception thrown: Instance a0995db2-2ae0-4216-996a-39a03357c1eb could not be found. Aug 10 23:03:42.284482 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c2f4fae3-291c-485b-a8a4-5d0964ee6515 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Request method failure captured: Aug 10 23:03:42.284482 n-d-850468-14 devstack@n-api.service[122633]: request: GET /compute/v2.1/servers/a0995db2-2ae0-4216-996a-39a03357c1eb HTTP/1.1 Aug 10 23:03:42.284482 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:03:42.284482 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:03:42.284482 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:03:42.284482 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:03:42.284482 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:03:42.284482 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:03:42.284482 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:03:42.284482 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:03:42.284482 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9DhnJQVy677u4b7dnMoSItqtWsJm27g_Vg031CYXViqt8YYY7d4cXYrgXs0Pp9xS3IIxdwWgPKq2sDULWw--Li9t2t8l1R3feSY4uh4FysmLVRfKNCAYvKF_tmPQ5ZUjwhrC4jAx70ULoXcE-6wvpA-wHk_CVzAxHX7IWuhEQLk8ZDk Aug 10 23:03:42.284482 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:03:42.284482 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:03:42.284482 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:03:42.284482 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:03:42.284482 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:03:42.284482 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:03:42.284482 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: b27e6ee9495a438b8450a4ef0d62cbcd Aug 10 23:03:42.284482 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-ServersOnMultiNodesTest-936995831 Aug 10 23:03:42.284482 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:03:42.284482 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:03:42.286616 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b27e6ee9495a438b8450a4ef0d62cbcd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b27e6ee9495a438b8450a4ef0d62cbcd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b27e6ee9495a438b8450a4ef0d62cbcd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b27e6ee9495a438b8450a4ef0d62cbcd", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:03:42.286616 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-ServersOnMultiNodesTest-936995831 Aug 10 23:03:42.286616 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: b27e6ee9495a438b8450a4ef0d62cbcd Aug 10 23:03:42.286616 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-936995831 Aug 10 23:03:42.286616 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-ServersOnMultiNodesTest-936995831-project Aug 10 23:03:42.286616 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:03:42.286616 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:03:42.286616 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 417d4eaaeb1c4df78745496ececb3e88 Aug 10 23:03:42.286616 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-ServersOnMultiNodesTest-936995831-project Aug 10 23:03:42.286616 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:03:42.286616 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance a0995db2-2ae0-4216-996a-39a03357c1eb could not be found. Aug 10 23:03:42.286616 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': 'a0995db2-2ae0-4216-996a-39a03357c1eb'} Aug 10 23:03:42.287906 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:03:42.287906 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:03:42.287906 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:03:42.287906 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:03:42.287906 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:03:42.287906 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:03:42.287906 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:03:42.287906 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:03:42.287906 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:03:42.287906 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:03:42.287906 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0995db2-2ae0-4216-996a-39a03357c1eb could not be found. Aug 10 23:03:42.287906 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:03:42.287906 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:03:42.287906 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:03:42.287906 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:03:42.287906 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:03:42.287906 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:03:42.287906 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:03:42.287906 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:03:42.287906 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:03:42.301381 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:03:42.301381 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:03:42.301381 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:03:42.301381 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:03:42.301381 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:03:42.301381 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:03:42.301381 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:03:42.301381 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0995db2-2ae0-4216-996a-39a03357c1eb could not be found. Aug 10 23:03:42.301381 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:03:42.301381 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:03:42.301381 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:03:42.301381 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:03:42.301381 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:03:42.301381 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:03:42.301381 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:03:42.301381 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:03:42.301381 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0995db2-2ae0-4216-996a-39a03357c1eb could not be found. Aug 10 23:03:42.301381 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:03:42.314678 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c2f4fae3-291c-485b-a8a4-5d0964ee6515 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Returning 404 to user: Instance a0995db2-2ae0-4216-996a-39a03357c1eb could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:03:42.315862 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-c2f4fae3-291c-485b-a8a4-5d0964ee6515 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] 10.222.0.58 "GET /compute/v2.1/servers/a0995db2-2ae0-4216-996a-39a03357c1eb" status: 404 len: 111 microversion: 2.1 time: 0.091157 Aug 10 23:03:42.325439 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 935/1847] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:03:42 2022] GET /compute/v2.1/servers/a0995db2-2ae0-4216-996a-39a03357c1eb => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:03:42.327937 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-ad9428af-971d-4196-abc7-0aec66635371 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:42.331418 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-ad9428af-971d-4196-abc7-0aec66635371 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] [instance: 3f5e8cd2-6666-4206-a393-9f0507322402] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:42.339713 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ad9428af-971d-4196-abc7-0aec66635371 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:42.340546 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ad9428af-971d-4196-abc7-0aec66635371 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:42.341339 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ad9428af-971d-4196-abc7-0aec66635371 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:42.342473 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ad9428af-971d-4196-abc7-0aec66635371 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:42.343208 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ad9428af-971d-4196-abc7-0aec66635371 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:42.343861 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ad9428af-971d-4196-abc7-0aec66635371 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:42.506059 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-310662c9-bf31-4ee8-9a85-85fcb727c2b1 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:42.523205 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-310662c9-bf31-4ee8-9a85-85fcb727c2b1 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:42.530872 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-310662c9-bf31-4ee8-9a85-85fcb727c2b1 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:42.532725 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-310662c9-bf31-4ee8-9a85-85fcb727c2b1 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] 10.222.0.58 "GET /compute/v2.1/servers/eaea4cc7-b1b8-43a7-83a4-8cfc8a44f9c1" status: 200 len: 1548 microversion: 2.25 time: 0.560097 Aug 10 23:03:42.533941 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 913/1848] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:03:41 2022] GET /compute/v2.1/servers/eaea4cc7-b1b8-43a7-83a4-8cfc8a44f9c1 => generated 1548 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:03:42.550675 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-2f37f0b7-b3de-40e7-a6e5-90a63ba82514 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:42.559922 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-ad9428af-971d-4196-abc7-0aec66635371 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c26e69e2274083916402c96d71c5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a6ac1a984c478da9337692485d16ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:42.565974 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-2f37f0b7-b3de-40e7-a6e5-90a63ba82514 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Request method failure captured: Aug 10 23:03:42.565974 n-d-850468-14 devstack@n-api.service[122632]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 Aug 10 23:03:42.565974 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:03:42.565974 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:03:42.565974 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:03:42.565974 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 23:03:42.565974 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:03:42.565974 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:03:42.565974 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:03:42.565974 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:03:42.565974 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9DkiAjWMnEScmXUQ4URpE929LR04Z8tVQFM7-HlbAmthzngpnguHOyLOUY0k3vhcWXMqybRYRnxQLljJds4eIyjIcnw25UUriDcSFQLJ0yAgBKlC5ig8XoT5HsrMNoi0tzD74DHerwRzKapIeqizBGLGMzal9OBH_ENocwnLGn23ebg Aug 10 23:03:42.565974 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:03:42.565974 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:03:42.565974 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:03:42.565974 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:03:42.565974 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:03:42.565974 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:03:42.565974 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 9e9cf3129a4e4f56a17bebf68b7bc42b Aug 10 23:03:42.565974 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-ListServersNegativeTestJSON-1516024484 Aug 10 23:03:42.565974 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:03:42.565974 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:03:42.567861 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9e9cf3129a4e4f56a17bebf68b7bc42b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9e9cf3129a4e4f56a17bebf68b7bc42b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/9e9cf3129a4e4f56a17bebf68b7bc42b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_9e9cf3129a4e4f56a17bebf68b7bc42b", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:03:42.567861 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-ListServersNegativeTestJSON-1516024484 Aug 10 23:03:42.567861 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 9e9cf3129a4e4f56a17bebf68b7bc42b Aug 10 23:03:42.567861 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1516024484 Aug 10 23:03:42.567861 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-ListServersNegativeTestJSON-1516024484-project Aug 10 23:03:42.567861 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:03:42.567861 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:03:42.567861 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: 890735b21f5d4764aefd789f74e00222 Aug 10 23:03:42.567861 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-ListServersNegativeTestJSON-1516024484-project Aug 10 23:03:42.567861 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:03:42.567861 n-d-850468-14 devstack@n-api.service[122632]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Aug 10 23:03:42.567861 n-d-850468-14 devstack@n-api.service[122632]: action_args: {} Aug 10 23:03:42.568862 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:03:42.568862 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:03:42.568862 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 10 23:03:42.568862 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 10 23:03:42.568862 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 10 23:03:42.568862 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise error Aug 10 23:03:42.568862 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' Aug 10 23:03:42.568862 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:03:42.568862 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Aug 10 23:03:42.568862 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 10 23:03:42.568862 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi 'minimum': 0, Aug 10 23:03:42.568862 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 10 23:03:42.568862 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 10 23:03:42.568862 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:03:42.568862 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi On instance[0]: Aug 10 23:03:42.568862 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi '-1' Aug 10 23:03:42.568862 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:03:42.568862 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:03:42.568862 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:03:42.568862 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:03:42.568862 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:03:42.568862 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:03:42.568862 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:03:42.568862 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:03:42.570774 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:03:42.570774 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:03:42.570774 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 10 23:03:42.570774 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 23:03:42.570774 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 10 23:03:42.570774 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 23:03:42.570774 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 10 23:03:42.570774 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 23:03:42.570774 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 10 23:03:42.570774 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Aug 10 23:03:42.570774 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Aug 10 23:03:42.570774 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 10 23:03:42.570774 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 10 23:03:42.570774 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 10 23:03:42.570774 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 10 23:03:42.570774 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Aug 10 23:03:42.570774 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:03:42.570774 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:03:42.570774 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:03:42.570774 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:03:42.573584 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:03:42.573584 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:03:42.573584 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 10 23:03:42.573584 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 10 23:03:42.573584 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Aug 10 23:03:42.573584 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:03:42.573584 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-2f37f0b7-b3de-40e7-a6e5-90a63ba82514 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:03:42.573584 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-2f37f0b7-b3de-40e7-a6e5-90a63ba82514 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] 10.222.0.58 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.032494 Aug 10 23:03:42.577133 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 914/1849] 10.222.0.58 () {58 vars in 1142 bytes} [Wed Aug 10 23:03:42 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 42 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 10 23:03:42.580769 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-ad9428af-971d-4196-abc7-0aec66635371 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] 10.222.0.58 "GET /compute/v2.1/servers/3f5e8cd2-6666-4206-a393-9f0507322402" status: 200 len: 1279 microversion: 2.1 time: 0.257074 Aug 10 23:03:42.599208 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-8abb428a-548d-4323-b2db-248e140949b4 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Action: 'update', calling method: .version_select at 0x7f847d81c0d0>, body: {"security_group": {"name": "tempest-sg-hth-242524644", "description": "tempest-description-hth-857087908"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:03:42.605718 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 936/1850] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:03:42 2022] GET /compute/v2.1/servers/3f5e8cd2-6666-4206-a393-9f0507322402 => generated 1279 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:03:42.610582 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-9aa788f6-53cf-445c-ac21-56b700d451d2 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:42.676747 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-9aa788f6-53cf-445c-ac21-56b700d451d2 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] 10.222.0.58 "DELETE /compute/v2.1/os-server-groups/da03a39d-f6f0-4dab-8d44-bd22debb8b03" status: 204 len: 0 microversion: 2.1 time: 0.069244 Aug 10 23:03:42.678065 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 937/1851] 10.222.0.58 () {58 vars in 1266 bytes} [Wed Aug 10 23:03:42 2022] DELETE /compute/v2.1/os-server-groups/da03a39d-f6f0-4dab-8d44-bd22debb8b03 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:03:42.689758 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-12e7ec3a-dc6d-4bee-91de-dac33f62f3ef tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:42.694881 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-12e7ec3a-dc6d-4bee-91de-dac33f62f3ef tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Request method failure captured: Aug 10 23:03:42.694881 n-d-850468-14 devstack@n-api.service[122633]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 Aug 10 23:03:42.694881 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:03:42.694881 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:03:42.694881 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:03:42.694881 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:03:42.694881 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:03:42.694881 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:03:42.694881 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:03:42.694881 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:03:42.694881 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9DkiAjWMnEScmXUQ4URpE929LR04Z8tVQFM7-HlbAmthzngpnguHOyLOUY0k3vhcWXMqybRYRnxQLljJds4eIyjIcnw25UUriDcSFQLJ0yAgBKlC5ig8XoT5HsrMNoi0tzD74DHerwRzKapIeqizBGLGMzal9OBH_ENocwnLGn23ebg Aug 10 23:03:42.694881 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:03:42.694881 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:03:42.694881 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:03:42.694881 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:03:42.694881 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:03:42.694881 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:03:42.694881 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 9e9cf3129a4e4f56a17bebf68b7bc42b Aug 10 23:03:42.694881 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-ListServersNegativeTestJSON-1516024484 Aug 10 23:03:42.694881 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:03:42.694881 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:03:42.697192 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9e9cf3129a4e4f56a17bebf68b7bc42b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9e9cf3129a4e4f56a17bebf68b7bc42b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/9e9cf3129a4e4f56a17bebf68b7bc42b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_9e9cf3129a4e4f56a17bebf68b7bc42b", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:03:42.697192 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-ListServersNegativeTestJSON-1516024484 Aug 10 23:03:42.697192 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 9e9cf3129a4e4f56a17bebf68b7bc42b Aug 10 23:03:42.697192 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1516024484 Aug 10 23:03:42.697192 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-ListServersNegativeTestJSON-1516024484-project Aug 10 23:03:42.697192 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:03:42.697192 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:03:42.697192 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 890735b21f5d4764aefd789f74e00222 Aug 10 23:03:42.697192 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-ListServersNegativeTestJSON-1516024484-project Aug 10 23:03:42.697192 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:03:42.697192 n-d-850468-14 devstack@n-api.service[122633]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Aug 10 23:03:42.697192 n-d-850468-14 devstack@n-api.service[122633]: action_args: {} Aug 10 23:03:42.698028 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:03:42.698028 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:03:42.698028 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 10 23:03:42.698028 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 10 23:03:42.698028 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 10 23:03:42.698028 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise error Aug 10 23:03:42.698028 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' Aug 10 23:03:42.698028 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:03:42.698028 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Aug 10 23:03:42.698028 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 10 23:03:42.698028 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi 'minimum': 0, Aug 10 23:03:42.698028 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 10 23:03:42.698028 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 10 23:03:42.698028 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:03:42.698028 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi On instance[0]: Aug 10 23:03:42.698028 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi 'testing' Aug 10 23:03:42.698028 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:03:42.698028 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:03:42.698028 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:03:42.698028 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:03:42.698028 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:03:42.698028 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:03:42.698028 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:03:42.698028 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:03:42.699865 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:03:42.699865 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:03:42.699865 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 10 23:03:42.699865 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 23:03:42.699865 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 10 23:03:42.699865 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 23:03:42.699865 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 10 23:03:42.699865 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 23:03:42.699865 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 10 23:03:42.699865 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Aug 10 23:03:42.699865 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Aug 10 23:03:42.699865 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 10 23:03:42.699865 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 10 23:03:42.699865 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 10 23:03:42.699865 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 10 23:03:42.699865 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Aug 10 23:03:42.699865 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:03:42.699865 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:03:42.699865 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:03:42.699865 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:03:42.701264 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:03:42.701264 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:03:42.701264 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 10 23:03:42.701264 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 10 23:03:42.701264 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Aug 10 23:03:42.701264 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:03:42.701264 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-12e7ec3a-dc6d-4bee-91de-dac33f62f3ef tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:03:42.702428 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-12e7ec3a-dc6d-4bee-91de-dac33f62f3ef tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] 10.222.0.58 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.023086 Aug 10 23:03:42.703907 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 938/1852] 10.222.0.58 () {58 vars in 1152 bytes} [Wed Aug 10 23:03:42 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 10 23:03:42.718574 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-2ce2dd96-a94a-4df7-900e-fa82370d2be0 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:42.720939 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-2ce2dd96-a94a-4df7-900e-fa82370d2be0 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] [instance: 0af574c3-bfa0-4df6-8f0e-6fcd12e9b8a9] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:42.736739 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2ce2dd96-a94a-4df7-900e-fa82370d2be0 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:42.738206 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2ce2dd96-a94a-4df7-900e-fa82370d2be0 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:42.741292 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2ce2dd96-a94a-4df7-900e-fa82370d2be0 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:42.742239 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2ce2dd96-a94a-4df7-900e-fa82370d2be0 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:42.747067 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2ce2dd96-a94a-4df7-900e-fa82370d2be0 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:42.747475 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2ce2dd96-a94a-4df7-900e-fa82370d2be0 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:42.783596 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-2ce2dd96-a94a-4df7-900e-fa82370d2be0 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] [instance: 0af574c3-bfa0-4df6-8f0e-6fcd12e9b8a9] Going to try to terminate instance {{(pid=122633) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:03:42.909802 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-2ce2dd96-a94a-4df7-900e-fa82370d2be0 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] 10.222.0.58 "DELETE /compute/v2.1/servers/0af574c3-bfa0-4df6-8f0e-6fcd12e9b8a9" status: 204 len: 0 microversion: 2.1 time: 0.202800 Aug 10 23:03:42.912783 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 939/1853] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:03:42 2022] DELETE /compute/v2.1/servers/0af574c3-bfa0-4df6-8f0e-6fcd12e9b8a9 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:03:42.918869 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-dc83da13-5662-45d5-8c0d-e3cedeafb32c tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:42.926470 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-dc83da13-5662-45d5-8c0d-e3cedeafb32c tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '890735b21f5d4764aefd789f74e00222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9cf3129a4e4f56a17bebf68b7bc42b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:42.927554 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-dc83da13-5662-45d5-8c0d-e3cedeafb32c tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': '9e9cf3129a4e4f56a17bebf68b7bc42b'} {{(pid=122633) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 10 23:03:42.937067 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.compute.servers [None req-dc83da13-5662-45d5-8c0d-e3cedeafb32c tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Flavor 'non_existing_flavor' could not be found {{(pid=122633) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Aug 10 23:03:42.939222 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-dc83da13-5662-45d5-8c0d-e3cedeafb32c tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] 10.222.0.58 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.025174 Aug 10 23:03:42.940564 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 940/1854] 10.222.0.58 () {58 vars in 1178 bytes} [Wed Aug 10 23:03:42 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 23:03:42.948026 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-4168fe9f-b1cd-4cef-8f9d-c1449ebf58be tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:42.949276 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-4168fe9f-b1cd-4cef-8f9d-c1449ebf58be tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] [instance: 63d2bd74-d060-4925-9323-b39d5131f958] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:42.952326 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_api:SELECT=89,nova_api:DELETE=6,nova_api:UPDATE=5 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:03:42.963560 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4168fe9f-b1cd-4cef-8f9d-c1449ebf58be tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:42.963851 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4168fe9f-b1cd-4cef-8f9d-c1449ebf58be tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:42.964497 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4168fe9f-b1cd-4cef-8f9d-c1449ebf58be tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:42.965405 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4168fe9f-b1cd-4cef-8f9d-c1449ebf58be tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:42.966060 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4168fe9f-b1cd-4cef-8f9d-c1449ebf58be tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:42.966651 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4168fe9f-b1cd-4cef-8f9d-c1449ebf58be tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:43.035115 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-8abb428a-548d-4323-b2db-248e140949b4 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] 10.222.0.58 "PUT /compute/v2.1/os-security-groups/7c6718ce-fa2e-4a60-a976-b990d3c2170d" status: 200 len: 216 microversion: 2.1 time: 0.455435 Aug 10 23:03:43.036334 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 915/1855] 10.222.0.58 () {60 vars in 1290 bytes} [Wed Aug 10 23:03:42 2022] PUT /compute/v2.1/os-security-groups/7c6718ce-fa2e-4a60-a976-b990d3c2170d => generated 216 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:03:43.042580 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-3eb99ff5-c312-4c64-9500-7d2dda2e1b4a tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:43.043686 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-3eb99ff5-c312-4c64-9500-7d2dda2e1b4a tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] [instance: 0af574c3-bfa0-4df6-8f0e-6fcd12e9b8a9] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:43.072952 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3eb99ff5-c312-4c64-9500-7d2dda2e1b4a tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:43.074167 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3eb99ff5-c312-4c64-9500-7d2dda2e1b4a tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:43.074901 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3eb99ff5-c312-4c64-9500-7d2dda2e1b4a tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:43.083931 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3eb99ff5-c312-4c64-9500-7d2dda2e1b4a tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:43.084601 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3eb99ff5-c312-4c64-9500-7d2dda2e1b4a tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:43.085255 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3eb99ff5-c312-4c64-9500-7d2dda2e1b4a tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:43.323518 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-4168fe9f-b1cd-4cef-8f9d-c1449ebf58be tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632904331d024d9b8e4d3660dff2cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ed0bdee3aa4013bd9219069bda558c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:43.332340 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-4168fe9f-b1cd-4cef-8f9d-c1449ebf58be tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] 10.222.0.58 "GET /compute/v2.1/servers/63d2bd74-d060-4925-9323-b39d5131f958" status: 200 len: 1392 microversion: 2.1 time: 0.390539 Aug 10 23:03:43.333197 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 941/1856] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:03:42 2022] GET /compute/v2.1/servers/63d2bd74-d060-4925-9323-b39d5131f958 => generated 1392 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:03:43.338317 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-cf55040a-8174-4646-ad88-86dda0a8159a tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:43.344403 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-cf55040a-8174-4646-ad88-86dda0a8159a tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '890735b21f5d4764aefd789f74e00222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9cf3129a4e4f56a17bebf68b7bc42b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:43.345341 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-cf55040a-8174-4646-ad88-86dda0a8159a tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': '9e9cf3129a4e4f56a17bebf68b7bc42b'} {{(pid=122633) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 10 23:03:43.351251 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cf55040a-8174-4646-ad88-86dda0a8159a tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:43.351926 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cf55040a-8174-4646-ad88-86dda0a8159a tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:43.353065 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cf55040a-8174-4646-ad88-86dda0a8159a tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:43.354094 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cf55040a-8174-4646-ad88-86dda0a8159a tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:43.354928 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cf55040a-8174-4646-ad88-86dda0a8159a tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:43.355524 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cf55040a-8174-4646-ad88-86dda0a8159a tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:43.382312 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-3eb99ff5-c312-4c64-9500-7d2dda2e1b4a tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '417d4eaaeb1c4df78745496ececb3e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27e6ee9495a438b8450a4ef0d62cbcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:43.396469 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-3eb99ff5-c312-4c64-9500-7d2dda2e1b4a tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] 10.222.0.58 "GET /compute/v2.1/servers/0af574c3-bfa0-4df6-8f0e-6fcd12e9b8a9" status: 200 len: 1472 microversion: 2.1 time: 0.358764 Aug 10 23:03:43.397049 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 916/1857] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:03:43 2022] GET /compute/v2.1/servers/0af574c3-bfa0-4df6-8f0e-6fcd12e9b8a9 => generated 1472 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:03:43.415434 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-1132af45-a1da-411c-a315-a0f3a4f54a81 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Calling method '.version_select at 0x7f847d732550>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:43.495603 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-1132af45-a1da-411c-a315-a0f3a4f54a81 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] 10.222.0.58 "GET /compute/v2.1/os-security-groups/7c6718ce-fa2e-4a60-a976-b990d3c2170d" status: 200 len: 216 microversion: 2.1 time: 0.093991 Aug 10 23:03:43.499362 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-cf55040a-8174-4646-ad88-86dda0a8159a tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] 10.222.0.58 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.164864 Aug 10 23:03:43.500459 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 942/1858] 10.222.0.58 () {58 vars in 1174 bytes} [Wed Aug 10 23:03:43 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 23:03:43.503121 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 917/1859] 10.222.0.58 () {58 vars in 1269 bytes} [Wed Aug 10 23:03:43 2022] GET /compute/v2.1/os-security-groups/7c6718ce-fa2e-4a60-a976-b990d3c2170d => generated 216 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:03:43.516140 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-3b2b2141-1b9d-4241-b552-f5962b331fba tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:43.524989 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-80f076ba-4f7a-4abf-a90f-886ce4847487 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Calling method '.version_select at 0x7f847d798ca0>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:43.531049 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-3b2b2141-1b9d-4241-b552-f5962b331fba tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '890735b21f5d4764aefd789f74e00222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9cf3129a4e4f56a17bebf68b7bc42b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:43.531945 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-3b2b2141-1b9d-4241-b552-f5962b331fba tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': '9e9cf3129a4e4f56a17bebf68b7bc42b'} {{(pid=122633) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 10 23:03:43.538091 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3b2b2141-1b9d-4241-b552-f5962b331fba tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:43.538824 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3b2b2141-1b9d-4241-b552-f5962b331fba tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:43.540260 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3b2b2141-1b9d-4241-b552-f5962b331fba tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:43.541371 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3b2b2141-1b9d-4241-b552-f5962b331fba tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:43.542124 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3b2b2141-1b9d-4241-b552-f5962b331fba tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:43.542737 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3b2b2141-1b9d-4241-b552-f5962b331fba tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:43.652985 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-3b2b2141-1b9d-4241-b552-f5962b331fba tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] 10.222.0.58 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.144481 Aug 10 23:03:43.661767 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 943/1860] 10.222.0.58 () {58 vars in 1184 bytes} [Wed Aug 10 23:03:43 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 23:03:43.669777 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-54e62366-0c66-417b-b9e0-aa9a11b1b7ee tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:43.670397 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-54e62366-0c66-417b-b9e0-aa9a11b1b7ee tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] [instance: eaea4cc7-b1b8-43a7-83a4-8cfc8a44f9c1] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:43.682617 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-54e62366-0c66-417b-b9e0-aa9a11b1b7ee tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:43.683146 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-54e62366-0c66-417b-b9e0-aa9a11b1b7ee tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:43.683850 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-54e62366-0c66-417b-b9e0-aa9a11b1b7ee tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:43.684570 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-54e62366-0c66-417b-b9e0-aa9a11b1b7ee tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:43.685014 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-54e62366-0c66-417b-b9e0-aa9a11b1b7ee tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:43.685687 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-54e62366-0c66-417b-b9e0-aa9a11b1b7ee tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:43.700742 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-54e62366-0c66-417b-b9e0-aa9a11b1b7ee tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] HTTP exception thrown: Instance eaea4cc7-b1b8-43a7-83a4-8cfc8a44f9c1 could not be found. Aug 10 23:03:43.703152 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-54e62366-0c66-417b-b9e0-aa9a11b1b7ee tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Request method failure captured: Aug 10 23:03:43.703152 n-d-850468-14 devstack@n-api.service[122633]: request: GET /compute/v2.1/servers/eaea4cc7-b1b8-43a7-83a4-8cfc8a44f9c1 HTTP/1.1 Aug 10 23:03:43.703152 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:03:43.703152 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:03:43.703152 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:03:43.703152 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:03:43.703152 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:03:43.703152 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:03:43.703152 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:03:43.703152 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:03:43.703152 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9DeXYkYLR9CQVdccVgq1hPt0DrO7Y-Tqsq3tzOpEmY8RKTZKEbj7rqP5rBgNFt9k52KejWIWfCOOWUkHukYq1jM7AQrc94vGo1O5nAgAlIU3PqIOLdYIPmLGjLIoW_vctUlJlDlwGinCVbduLE5oYkTQOwNuHIPOOO5NqXrRvcyb7gQ Aug 10 23:03:43.703152 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:03:43.703152 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:03:43.703152 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:03:43.703152 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:03:43.703152 n-d-850468-14 devstack@n-api.service[122633]: X-Openstack-Nova-Api-Version: 2.25 Aug 10 23:03:43.703152 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:03:43.703152 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:03:43.703152 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: b4355fdc73c84fa2baf0d5c9a33e69d5 Aug 10 23:03:43.703152 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1885042872 Aug 10 23:03:43.703152 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:03:43.703152 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:03:43.704861 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b4355fdc73c84fa2baf0d5c9a33e69d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b4355fdc73c84fa2baf0d5c9a33e69d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b4355fdc73c84fa2baf0d5c9a33e69d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b4355fdc73c84fa2baf0d5c9a33e69d5", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:03:43.704861 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1885042872 Aug 10 23:03:43.704861 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: b4355fdc73c84fa2baf0d5c9a33e69d5 Aug 10 23:03:43.704861 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1885042872 Aug 10 23:03:43.704861 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-LiveAutoBlockMigrationV225Test-1885042872-project Aug 10 23:03:43.704861 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:03:43.704861 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:03:43.704861 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 394f0e6843424c7b83d2dfff61f66ede Aug 10 23:03:43.704861 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1885042872-project Aug 10 23:03:43.704861 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:03:43.704861 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance eaea4cc7-b1b8-43a7-83a4-8cfc8a44f9c1 could not be found. Aug 10 23:03:43.704861 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': 'eaea4cc7-b1b8-43a7-83a4-8cfc8a44f9c1'} Aug 10 23:03:43.705755 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:03:43.705755 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:03:43.705755 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:03:43.705755 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:03:43.705755 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:03:43.705755 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:03:43.705755 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:03:43.705755 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:03:43.705755 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:03:43.705755 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:03:43.705755 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eaea4cc7-b1b8-43a7-83a4-8cfc8a44f9c1 could not be found. Aug 10 23:03:43.705755 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:03:43.705755 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:03:43.705755 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:03:43.705755 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:03:43.705755 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:03:43.705755 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:03:43.705755 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:03:43.705755 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:03:43.705755 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:03:43.707236 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:03:43.707236 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:03:43.707236 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:03:43.707236 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:03:43.707236 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:03:43.707236 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:03:43.707236 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:03:43.707236 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eaea4cc7-b1b8-43a7-83a4-8cfc8a44f9c1 could not be found. Aug 10 23:03:43.707236 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:03:43.707236 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:03:43.707236 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:03:43.707236 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:03:43.707236 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:03:43.707236 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:03:43.707236 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:03:43.707236 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:03:43.707236 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eaea4cc7-b1b8-43a7-83a4-8cfc8a44f9c1 could not be found. Aug 10 23:03:43.707236 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:03:43.709999 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-54e62366-0c66-417b-b9e0-aa9a11b1b7ee tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Returning 404 to user: Instance eaea4cc7-b1b8-43a7-83a4-8cfc8a44f9c1 could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:03:43.711168 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-54e62366-0c66-417b-b9e0-aa9a11b1b7ee tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] 10.222.0.58 "GET /compute/v2.1/servers/eaea4cc7-b1b8-43a7-83a4-8cfc8a44f9c1" status: 404 len: 111 microversion: 2.25 time: 0.048307 Aug 10 23:03:43.712002 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 944/1861] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:03:43 2022] GET /compute/v2.1/servers/eaea4cc7-b1b8-43a7-83a4-8cfc8a44f9c1 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 10 23:03:43.723006 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-3460cf0f-ffb3-44ab-abd4-7f52d21b1b02 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:43.723989 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-3460cf0f-ffb3-44ab-abd4-7f52d21b1b02 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] [instance: 3f5e8cd2-6666-4206-a393-9f0507322402] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:43.734341 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3460cf0f-ffb3-44ab-abd4-7f52d21b1b02 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:43.735101 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3460cf0f-ffb3-44ab-abd4-7f52d21b1b02 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:43.735836 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3460cf0f-ffb3-44ab-abd4-7f52d21b1b02 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:43.736918 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3460cf0f-ffb3-44ab-abd4-7f52d21b1b02 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:43.737537 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3460cf0f-ffb3-44ab-abd4-7f52d21b1b02 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:43.738133 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3460cf0f-ffb3-44ab-abd4-7f52d21b1b02 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:44.016117 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-3460cf0f-ffb3-44ab-abd4-7f52d21b1b02 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c26e69e2274083916402c96d71c5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a6ac1a984c478da9337692485d16ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:44.029802 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-3460cf0f-ffb3-44ab-abd4-7f52d21b1b02 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] 10.222.0.58 "GET /compute/v2.1/servers/3f5e8cd2-6666-4206-a393-9f0507322402" status: 200 len: 1321 microversion: 2.1 time: 0.316239 Aug 10 23:03:44.030751 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 945/1862] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:03:43 2022] GET /compute/v2.1/servers/3f5e8cd2-6666-4206-a393-9f0507322402 => generated 1321 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:03:44.039093 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-4ca4b7c6-bbf3-4549-a4a1-7440e12bb974 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:44.047837 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-4ca4b7c6-bbf3-4549-a4a1-7440e12bb974 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '890735b21f5d4764aefd789f74e00222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9cf3129a4e4f56a17bebf68b7bc42b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:44.049659 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-4ca4b7c6-bbf3-4549-a4a1-7440e12bb974 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Searching by: {'deleted': False, 'project_id': '9e9cf3129a4e4f56a17bebf68b7bc42b'} {{(pid=122633) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 10 23:03:44.057820 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4ca4b7c6-bbf3-4549-a4a1-7440e12bb974 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:44.059020 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4ca4b7c6-bbf3-4549-a4a1-7440e12bb974 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:44.059479 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4ca4b7c6-bbf3-4549-a4a1-7440e12bb974 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:44.060456 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4ca4b7c6-bbf3-4549-a4a1-7440e12bb974 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:44.060924 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4ca4b7c6-bbf3-4549-a4a1-7440e12bb974 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:44.061412 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4ca4b7c6-bbf3-4549-a4a1-7440e12bb974 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:44.100409 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-80f076ba-4f7a-4abf-a90f-886ce4847487 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/7c6718ce-fa2e-4a60-a976-b990d3c2170d" status: 202 len: 0 microversion: 2.1 time: 0.586605 Aug 10 23:03:44.101830 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 918/1863] 10.222.0.58 () {58 vars in 1272 bytes} [Wed Aug 10 23:03:43 2022] DELETE /compute/v2.1/os-security-groups/7c6718ce-fa2e-4a60-a976-b990d3c2170d => generated 0 bytes in 589 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:03:44.110841 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-a03a48e2-de7c-44dd-a325-aa7f46264d0e tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:44.111776 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-a03a48e2-de7c-44dd-a325-aa7f46264d0e tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] [instance: baf47131-7a59-4588-9ce6-113709fa8480] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:44.156326 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a03a48e2-de7c-44dd-a325-aa7f46264d0e tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:44.158094 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a03a48e2-de7c-44dd-a325-aa7f46264d0e tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:44.160182 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a03a48e2-de7c-44dd-a325-aa7f46264d0e tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:44.162232 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a03a48e2-de7c-44dd-a325-aa7f46264d0e tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:44.164241 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a03a48e2-de7c-44dd-a325-aa7f46264d0e tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:44.169004 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a03a48e2-de7c-44dd-a325-aa7f46264d0e tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:44.246293 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-a03a48e2-de7c-44dd-a325-aa7f46264d0e tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] [instance: baf47131-7a59-4588-9ce6-113709fa8480] Going to try to terminate instance {{(pid=122632) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:03:44.385618 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.multi_cell_list [None req-4ca4b7c6-bbf3-4549-a4a1-7440e12bb974 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=122633) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 10 23:03:44.400789 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-a03a48e2-de7c-44dd-a325-aa7f46264d0e tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] 10.222.0.58 "DELETE /compute/v2.1/servers/baf47131-7a59-4588-9ce6-113709fa8480" status: 204 len: 0 microversion: 2.25 time: 0.296423 Aug 10 23:03:44.404088 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 919/1864] 10.222.0.58 () {60 vars in 1280 bytes} [Wed Aug 10 23:03:44 2022] DELETE /compute/v2.1/servers/baf47131-7a59-4588-9ce6-113709fa8480 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 10 23:03:44.420373 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-1d1d0521-346e-49bd-8732-d03712254755 req-9874ab74-7819-4e17-aee4-ec24a464cec9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eaea4cc7-b1b8-43a7-83a4-8cfc8a44f9c1", "name": "network-vif-deleted", "tag": "736e341a-be60-4b0a-ac9e-ebacb140516d"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:03:44.454242 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-1d1d0521-346e-49bd-8732-d03712254755 req-9874ab74-7819-4e17-aee4-ec24a464cec9 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:44.456334 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-1d1d0521-346e-49bd-8732-d03712254755 req-9874ab74-7819-4e17-aee4-ec24a464cec9 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:44.457801 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-1d1d0521-346e-49bd-8732-d03712254755 req-9874ab74-7819-4e17-aee4-ec24a464cec9 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:44.489733 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-1d1d0521-346e-49bd-8732-d03712254755 req-9874ab74-7819-4e17-aee4-ec24a464cec9 service nova] Creating event network-vif-deleted:736e341a-be60-4b0a-ac9e-ebacb140516d for instance eaea4cc7-b1b8-43a7-83a4-8cfc8a44f9c1 on n-h2-850468-14 Aug 10 23:03:44.506221 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-1d1d0521-346e-49bd-8732-d03712254755 req-9874ab74-7819-4e17-aee4-ec24a464cec9 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098465 Aug 10 23:03:44.506221 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 920/1865] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:03:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:03:44.524793 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-0e1c6790-35d8-4c1b-baa7-d3164cae6c73 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:44.525585 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-0e1c6790-35d8-4c1b-baa7-d3164cae6c73 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] [instance: 67accb8d-3e90-483c-a1e5-9a0c04a685c8] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:44.546912 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0e1c6790-35d8-4c1b-baa7-d3164cae6c73 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:44.549465 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0e1c6790-35d8-4c1b-baa7-d3164cae6c73 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:44.550417 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0e1c6790-35d8-4c1b-baa7-d3164cae6c73 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:44.551741 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0e1c6790-35d8-4c1b-baa7-d3164cae6c73 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:44.553017 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0e1c6790-35d8-4c1b-baa7-d3164cae6c73 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:44.553826 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0e1c6790-35d8-4c1b-baa7-d3164cae6c73 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:44.570849 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-4ca4b7c6-bbf3-4549-a4a1-7440e12bb974 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890735b21f5d4764aefd789f74e00222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9cf3129a4e4f56a17bebf68b7bc42b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:44.575943 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-0e1c6790-35d8-4c1b-baa7-d3164cae6c73 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] HTTP exception thrown: Instance 67accb8d-3e90-483c-a1e5-9a0c04a685c8 could not be found. Aug 10 23:03:44.577741 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-0e1c6790-35d8-4c1b-baa7-d3164cae6c73 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Request method failure captured: Aug 10 23:03:44.577741 n-d-850468-14 devstack@n-api.service[122632]: request: DELETE /compute/v2.1/servers/67accb8d-3e90-483c-a1e5-9a0c04a685c8 HTTP/1.1 Aug 10 23:03:44.577741 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:03:44.577741 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:03:44.577741 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:03:44.577741 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 23:03:44.577741 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:03:44.577741 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:03:44.577741 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:03:44.577741 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:03:44.577741 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9Dju6bcY6WgJPTWLWUJ0fX6JaJBRP8GkYZWFafNrDYn8ACaF-JC0t8YD4rSPFgG5Deze7mjmq2_rnPCZ1jpXNRGkHxz134mT5MqTqUm9UAyuVcbLtNQAiAf-L4A3117brPwKa_CN56-tZ47WT8aAPEON_2-WsEOp9qATqEToy30jo_s Aug 10 23:03:44.577741 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:03:44.577741 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:03:44.577741 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:03:44.577741 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:03:44.577741 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:03:44.577741 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:03:44.577741 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 707f869910b34768ae1a348cd0b5f284 Aug 10 23:03:44.577741 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-SecurityGroupsTestJSON-1406525704 Aug 10 23:03:44.577741 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:03:44.577741 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:03:44.579557 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/707f869910b34768ae1a348cd0b5f284"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/707f869910b34768ae1a348cd0b5f284"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/707f869910b34768ae1a348cd0b5f284"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_707f869910b34768ae1a348cd0b5f284", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:03:44.579557 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-SecurityGroupsTestJSON-1406525704 Aug 10 23:03:44.579557 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 707f869910b34768ae1a348cd0b5f284 Aug 10 23:03:44.579557 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1406525704 Aug 10 23:03:44.579557 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-SecurityGroupsTestJSON-1406525704-project Aug 10 23:03:44.579557 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:03:44.579557 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:03:44.579557 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: bfd6d8e6a8444f5b9fcf1cf8da242ac0 Aug 10 23:03:44.579557 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-SecurityGroupsTestJSON-1406525704-project Aug 10 23:03:44.579557 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:03:44.579557 n-d-850468-14 devstack@n-api.service[122632]: exception: Instance 67accb8d-3e90-483c-a1e5-9a0c04a685c8 could not be found. Aug 10 23:03:44.579557 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': '67accb8d-3e90-483c-a1e5-9a0c04a685c8'} Aug 10 23:03:44.580635 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:03:44.580635 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:03:44.580635 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:03:44.580635 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:03:44.580635 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:03:44.580635 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:03:44.580635 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:03:44.580635 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:03:44.580635 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:03:44.580635 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:03:44.580635 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67accb8d-3e90-483c-a1e5-9a0c04a685c8 could not be found. Aug 10 23:03:44.580635 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:03:44.580635 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:03:44.580635 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:03:44.580635 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:03:44.580635 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:03:44.580635 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:03:44.580635 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:03:44.580635 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:03:44.580635 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:03:44.587504 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:03:44.587504 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 23:03:44.587504 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 23:03:44.587504 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 23:03:44.587504 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 23:03:44.587504 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:03:44.587504 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:03:44.587504 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:03:44.587504 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:03:44.587504 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67accb8d-3e90-483c-a1e5-9a0c04a685c8 could not be found. Aug 10 23:03:44.587504 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:03:44.587504 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:03:44.587504 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:03:44.587504 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:03:44.587504 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:03:44.587504 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:03:44.587504 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:03:44.587504 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:03:44.587504 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67accb8d-3e90-483c-a1e5-9a0c04a685c8 could not be found. Aug 10 23:03:44.587504 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:03:44.590742 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-0e1c6790-35d8-4c1b-baa7-d3164cae6c73 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Returning 404 to user: Instance 67accb8d-3e90-483c-a1e5-9a0c04a685c8 could not be found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:03:44.590742 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-0e1c6790-35d8-4c1b-baa7-d3164cae6c73 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] 10.222.0.58 "DELETE /compute/v2.1/servers/67accb8d-3e90-483c-a1e5-9a0c04a685c8" status: 404 len: 111 microversion: 2.1 time: 0.071160 Aug 10 23:03:44.590742 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 921/1866] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:03:44 2022] DELETE /compute/v2.1/servers/67accb8d-3e90-483c-a1e5-9a0c04a685c8 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:03:44.592362 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-03b8a6e9-eb1b-4c9e-a2d9-cc1d10a66753 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:44.592949 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-03b8a6e9-eb1b-4c9e-a2d9-cc1d10a66753 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] [instance: 63d2bd74-d060-4925-9323-b39d5131f958] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:44.593156 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4ca4b7c6-bbf3-4549-a4a1-7440e12bb974 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:44.593525 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4ca4b7c6-bbf3-4549-a4a1-7440e12bb974 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:44.594083 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4ca4b7c6-bbf3-4549-a4a1-7440e12bb974 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:44.595721 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:03:44.607841 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-03b8a6e9-eb1b-4c9e-a2d9-cc1d10a66753 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:44.608714 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-03b8a6e9-eb1b-4c9e-a2d9-cc1d10a66753 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:44.609171 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-03b8a6e9-eb1b-4c9e-a2d9-cc1d10a66753 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:44.610061 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-03b8a6e9-eb1b-4c9e-a2d9-cc1d10a66753 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:44.610527 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-03b8a6e9-eb1b-4c9e-a2d9-cc1d10a66753 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:44.611345 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-03b8a6e9-eb1b-4c9e-a2d9-cc1d10a66753 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:44.944239 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-03b8a6e9-eb1b-4c9e-a2d9-cc1d10a66753 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632904331d024d9b8e4d3660dff2cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ed0bdee3aa4013bd9219069bda558c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:44.956007 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-03b8a6e9-eb1b-4c9e-a2d9-cc1d10a66753 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] 10.222.0.58 "GET /compute/v2.1/servers/63d2bd74-d060-4925-9323-b39d5131f958" status: 200 len: 1392 microversion: 2.1 time: 0.371194 Aug 10 23:03:44.957115 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 922/1867] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:03:44 2022] GET /compute/v2.1/servers/63d2bd74-d060-4925-9323-b39d5131f958 => generated 1392 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:03:44.975624 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-d27aa0b3-0c46-48c4-a438-45d2cc6ccb4c tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:44.976558 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-d27aa0b3-0c46-48c4-a438-45d2cc6ccb4c tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] [instance: baf47131-7a59-4588-9ce6-113709fa8480] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:44.988712 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d27aa0b3-0c46-48c4-a438-45d2cc6ccb4c tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:44.988883 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d27aa0b3-0c46-48c4-a438-45d2cc6ccb4c tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:44.989598 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d27aa0b3-0c46-48c4-a438-45d2cc6ccb4c tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:44.996282 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d27aa0b3-0c46-48c4-a438-45d2cc6ccb4c tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:44.999601 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d27aa0b3-0c46-48c4-a438-45d2cc6ccb4c tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:45.000087 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d27aa0b3-0c46-48c4-a438-45d2cc6ccb4c tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:45.175818 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-4ca4b7c6-bbf3-4549-a4a1-7440e12bb974 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] 10.222.0.58 "GET /compute/v2.1/servers/detail" status: 200 len: 3021 microversion: 2.1 time: 1.143743 Aug 10 23:03:45.177322 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 946/1868] 10.222.0.58 () {58 vars in 1146 bytes} [Wed Aug 10 23:03:44 2022] GET /compute/v2.1/servers/detail => generated 3021 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:03:45.195388 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-25629965-f404-4857-a7f6-621be0b7a512 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:45.195673 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-25629965-f404-4857-a7f6-621be0b7a512 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] [instance: 0af574c3-bfa0-4df6-8f0e-6fcd12e9b8a9] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:45.210995 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-25629965-f404-4857-a7f6-621be0b7a512 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:45.210995 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-25629965-f404-4857-a7f6-621be0b7a512 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:45.211239 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-25629965-f404-4857-a7f6-621be0b7a512 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:45.212335 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-25629965-f404-4857-a7f6-621be0b7a512 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:45.212786 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-25629965-f404-4857-a7f6-621be0b7a512 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:45.213220 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-25629965-f404-4857-a7f6-621be0b7a512 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:45.419919 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-d27aa0b3-0c46-48c4-a438-45d2cc6ccb4c tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:45.433546 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-d27aa0b3-0c46-48c4-a438-45d2cc6ccb4c tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:45.437365 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-d27aa0b3-0c46-48c4-a438-45d2cc6ccb4c tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:45.440327 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-d27aa0b3-0c46-48c4-a438-45d2cc6ccb4c tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] 10.222.0.58 "GET /compute/v2.1/servers/baf47131-7a59-4588-9ce6-113709fa8480" status: 200 len: 1565 microversion: 2.25 time: 0.481840 Aug 10 23:03:45.440772 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 923/1869] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:03:44 2022] GET /compute/v2.1/servers/baf47131-7a59-4588-9ce6-113709fa8480 => generated 1565 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:03:45.463660 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-737d9a4d-9ae3-4389-a185-3205963d7812 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:45.464313 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-737d9a4d-9ae3-4389-a185-3205963d7812 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] [instance: 67accb8d-3e90-483c-a1e5-9a0c04a685c8] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:45.488671 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-737d9a4d-9ae3-4389-a185-3205963d7812 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:45.489182 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-737d9a4d-9ae3-4389-a185-3205963d7812 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:45.489632 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-737d9a4d-9ae3-4389-a185-3205963d7812 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:45.490599 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-737d9a4d-9ae3-4389-a185-3205963d7812 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:45.490952 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-737d9a4d-9ae3-4389-a185-3205963d7812 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:45.491367 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-737d9a4d-9ae3-4389-a185-3205963d7812 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:45.519063 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-737d9a4d-9ae3-4389-a185-3205963d7812 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] HTTP exception thrown: Instance 67accb8d-3e90-483c-a1e5-9a0c04a685c8 could not be found. Aug 10 23:03:45.520709 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-737d9a4d-9ae3-4389-a185-3205963d7812 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Request method failure captured: Aug 10 23:03:45.520709 n-d-850468-14 devstack@n-api.service[122632]: request: GET /compute/v2.1/servers/67accb8d-3e90-483c-a1e5-9a0c04a685c8 HTTP/1.1 Aug 10 23:03:45.520709 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:03:45.520709 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:03:45.520709 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:03:45.520709 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 23:03:45.520709 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:03:45.520709 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:03:45.520709 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:03:45.520709 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:03:45.520709 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9Dju6bcY6WgJPTWLWUJ0fX6JaJBRP8GkYZWFafNrDYn8ACaF-JC0t8YD4rSPFgG5Deze7mjmq2_rnPCZ1jpXNRGkHxz134mT5MqTqUm9UAyuVcbLtNQAiAf-L4A3117brPwKa_CN56-tZ47WT8aAPEON_2-WsEOp9qATqEToy30jo_s Aug 10 23:03:45.520709 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:03:45.520709 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:03:45.520709 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:03:45.520709 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:03:45.520709 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:03:45.520709 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:03:45.520709 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 707f869910b34768ae1a348cd0b5f284 Aug 10 23:03:45.520709 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-SecurityGroupsTestJSON-1406525704 Aug 10 23:03:45.520709 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:03:45.520709 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:03:45.522558 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/707f869910b34768ae1a348cd0b5f284"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/707f869910b34768ae1a348cd0b5f284"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/707f869910b34768ae1a348cd0b5f284"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_707f869910b34768ae1a348cd0b5f284", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:03:45.522558 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-SecurityGroupsTestJSON-1406525704 Aug 10 23:03:45.522558 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 707f869910b34768ae1a348cd0b5f284 Aug 10 23:03:45.522558 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1406525704 Aug 10 23:03:45.522558 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-SecurityGroupsTestJSON-1406525704-project Aug 10 23:03:45.522558 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:03:45.522558 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:03:45.522558 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: bfd6d8e6a8444f5b9fcf1cf8da242ac0 Aug 10 23:03:45.522558 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-SecurityGroupsTestJSON-1406525704-project Aug 10 23:03:45.522558 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:03:45.522558 n-d-850468-14 devstack@n-api.service[122632]: exception: Instance 67accb8d-3e90-483c-a1e5-9a0c04a685c8 could not be found. Aug 10 23:03:45.522558 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': '67accb8d-3e90-483c-a1e5-9a0c04a685c8'} Aug 10 23:03:45.523608 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:03:45.523608 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:03:45.523608 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:03:45.523608 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:03:45.523608 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:03:45.523608 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:03:45.523608 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:03:45.523608 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:03:45.523608 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:03:45.523608 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:03:45.523608 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67accb8d-3e90-483c-a1e5-9a0c04a685c8 could not be found. Aug 10 23:03:45.523608 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:03:45.523608 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:03:45.523608 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:03:45.523608 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:03:45.523608 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:03:45.523608 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:03:45.523608 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:03:45.523608 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:03:45.523608 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:03:45.525333 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:03:45.525333 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:03:45.525333 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:03:45.525333 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:03:45.525333 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:03:45.525333 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:03:45.525333 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:03:45.525333 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67accb8d-3e90-483c-a1e5-9a0c04a685c8 could not be found. Aug 10 23:03:45.525333 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:03:45.525333 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:03:45.525333 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:03:45.525333 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:03:45.525333 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:03:45.525333 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:03:45.525333 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:03:45.525333 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:03:45.525333 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67accb8d-3e90-483c-a1e5-9a0c04a685c8 could not be found. Aug 10 23:03:45.525333 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:03:45.528831 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-737d9a4d-9ae3-4389-a185-3205963d7812 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Returning 404 to user: Instance 67accb8d-3e90-483c-a1e5-9a0c04a685c8 could not be found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:03:45.529849 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-737d9a4d-9ae3-4389-a185-3205963d7812 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] 10.222.0.58 "GET /compute/v2.1/servers/67accb8d-3e90-483c-a1e5-9a0c04a685c8" status: 404 len: 111 microversion: 2.1 time: 0.086732 Aug 10 23:03:45.530430 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 924/1870] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:03:45 2022] GET /compute/v2.1/servers/67accb8d-3e90-483c-a1e5-9a0c04a685c8 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:03:45.540795 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-a9c11fcb-41b1-4d9a-b054-a78811f91d7e tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:45.543643 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-a9c11fcb-41b1-4d9a-b054-a78811f91d7e tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] [instance: 3f5e8cd2-6666-4206-a393-9f0507322402] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:45.559218 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a9c11fcb-41b1-4d9a-b054-a78811f91d7e tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:45.560469 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a9c11fcb-41b1-4d9a-b054-a78811f91d7e tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:45.561970 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a9c11fcb-41b1-4d9a-b054-a78811f91d7e tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:45.564965 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a9c11fcb-41b1-4d9a-b054-a78811f91d7e tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:45.567115 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a9c11fcb-41b1-4d9a-b054-a78811f91d7e tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:45.568064 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a9c11fcb-41b1-4d9a-b054-a78811f91d7e tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:46.367423 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-25629965-f404-4857-a7f6-621be0b7a512 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '417d4eaaeb1c4df78745496ececb3e88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b27e6ee9495a438b8450a4ef0d62cbcd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:46.379396 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-25629965-f404-4857-a7f6-621be0b7a512 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] 10.222.0.58 "GET /compute/v2.1/servers/0af574c3-bfa0-4df6-8f0e-6fcd12e9b8a9" status: 200 len: 1472 microversion: 2.1 time: 1.200927 Aug 10 23:03:46.392078 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 947/1871] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:03:45 2022] GET /compute/v2.1/servers/0af574c3-bfa0-4df6-8f0e-6fcd12e9b8a9 => generated 1472 bytes in 1214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:03:46.397945 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-832502c4-2437-4ef1-9abd-8b1edcd4ac15 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:46.416355 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-832502c4-2437-4ef1-9abd-8b1edcd4ac15 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '890735b21f5d4764aefd789f74e00222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9cf3129a4e4f56a17bebf68b7bc42b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:46.418992 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-832502c4-2437-4ef1-9abd-8b1edcd4ac15 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] 10.222.0.58 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.025237 Aug 10 23:03:46.427716 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 948/1872] 10.222.0.58 () {58 vars in 1178 bytes} [Wed Aug 10 23:03:46 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 23:03:46.433802 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-adc70630-232c-4064-887f-c552a6a92aad tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Calling method '.version_select at 0x7f847d412e50>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:46.474644 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-a9c11fcb-41b1-4d9a-b054-a78811f91d7e tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c26e69e2274083916402c96d71c5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a6ac1a984c478da9337692485d16ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:46.486113 n-d-850468-14 devstack@n-api.service[122633]: DEBUG neutronclient.v2_0.client [None req-adc70630-232c-4064-887f-c552a6a92aad tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group e7812d23-703d-433d-a1e7-509e5ada814d does not exist", "detail": ""}} {{(pid=122633) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 10 23:03:46.486804 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.network.security_group_api [None req-adc70630-232c-4064-887f-c552a6a92aad tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Neutron security group e7812d23-703d-433d-a1e7-509e5ada814d not found {{(pid=122633) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 10 23:03:46.487430 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-adc70630-232c-4064-887f-c552a6a92aad tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] HTTP exception thrown: Security group e7812d23-703d-433d-a1e7-509e5ada814d does not exist Aug 10 23:03:46.487430 n-d-850468-14 devstack@n-api.service[122633]: Neutron server returns request_ids: ['req-093aec26-a178-4b29-929e-378937ec3f83'] Aug 10 23:03:46.489720 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-adc70630-232c-4064-887f-c552a6a92aad tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Request method failure captured: Aug 10 23:03:46.489720 n-d-850468-14 devstack@n-api.service[122633]: request: DELETE /compute/v2.1/os-security-groups/e7812d23-703d-433d-a1e7-509e5ada814d HTTP/1.1 Aug 10 23:03:46.489720 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:03:46.489720 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:03:46.489720 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:03:46.489720 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:03:46.489720 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:03:46.489720 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:03:46.489720 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:03:46.489720 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:03:46.489720 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9Dju6bcY6WgJPTWLWUJ0fX6JaJBRP8GkYZWFafNrDYn8ACaF-JC0t8YD4rSPFgG5Deze7mjmq2_rnPCZ1jpXNRGkHxz134mT5MqTqUm9UAyuVcbLtNQAiAf-L4A3117brPwKa_CN56-tZ47WT8aAPEON_2-WsEOp9qATqEToy30jo_s Aug 10 23:03:46.489720 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:03:46.489720 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:03:46.489720 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:03:46.489720 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:03:46.489720 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:03:46.489720 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:03:46.489720 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 707f869910b34768ae1a348cd0b5f284 Aug 10 23:03:46.489720 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-SecurityGroupsTestJSON-1406525704 Aug 10 23:03:46.489720 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:03:46.489720 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:03:46.491566 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/707f869910b34768ae1a348cd0b5f284"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/707f869910b34768ae1a348cd0b5f284"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/707f869910b34768ae1a348cd0b5f284"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_707f869910b34768ae1a348cd0b5f284", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:03:46.491566 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-SecurityGroupsTestJSON-1406525704 Aug 10 23:03:46.491566 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 707f869910b34768ae1a348cd0b5f284 Aug 10 23:03:46.491566 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1406525704 Aug 10 23:03:46.491566 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-SecurityGroupsTestJSON-1406525704-project Aug 10 23:03:46.491566 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:03:46.491566 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:03:46.491566 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: bfd6d8e6a8444f5b9fcf1cf8da242ac0 Aug 10 23:03:46.491566 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-SecurityGroupsTestJSON-1406525704-project Aug 10 23:03:46.491566 n-d-850468-14 devstack@n-api.service[122633]: method: Aug 10 23:03:46.491566 n-d-850468-14 devstack@n-api.service[122633]: exception: Security group e7812d23-703d-433d-a1e7-509e5ada814d does not exist Aug 10 23:03:46.491566 n-d-850468-14 devstack@n-api.service[122633]: Neutron server returns request_ids: ['req-093aec26-a178-4b29-929e-378937ec3f83'] Aug 10 23:03:46.491566 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': 'e7812d23-703d-433d-a1e7-509e5ada814d'} Aug 10 23:03:46.492519 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:03:46.492519 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:03:46.492519 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 10 23:03:46.492519 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 10 23:03:46.492519 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 23:03:46.492519 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 23:03:46.492519 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 10 23:03:46.492519 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 10 23:03:46.492519 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 23:03:46.492519 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 23:03:46.492519 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 23:03:46.492519 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 23:03:46.492519 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 23:03:46.492519 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 23:03:46.492519 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 23:03:46.492519 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 23:03:46.492519 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 23:03:46.492519 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 23:03:46.492519 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 10 23:03:46.495337 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 10 23:03:46.495337 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 23:03:46.495337 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 23:03:46.495337 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 10 23:03:46.495337 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 10 23:03:46.495337 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 10 23:03:46.495337 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 10 23:03:46.495337 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group e7812d23-703d-433d-a1e7-509e5ada814d does not exist Aug 10 23:03:46.495337 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-093aec26-a178-4b29-929e-378937ec3f83'] Aug 10 23:03:46.495337 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:03:46.495337 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:03:46.495337 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:03:46.495337 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:03:46.495337 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 10 23:03:46.495337 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 10 23:03:46.495337 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 10 23:03:46.495337 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 10 23:03:46.495337 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group e7812d23-703d-433d-a1e7-509e5ada814d does not exist Aug 10 23:03:46.497663 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-093aec26-a178-4b29-929e-378937ec3f83'] Aug 10 23:03:46.497663 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:03:46.497663 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:03:46.497663 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:03:46.497663 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:03:46.497663 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:03:46.497663 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:03:46.497663 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:03:46.497663 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:03:46.497663 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 23:03:46.497663 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 23:03:46.497663 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:03:46.497663 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:03:46.497663 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 10 23:03:46.497663 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 10 23:03:46.497663 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group e7812d23-703d-433d-a1e7-509e5ada814d does not exist Aug 10 23:03:46.497663 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-093aec26-a178-4b29-929e-378937ec3f83'] Aug 10 23:03:46.497663 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:03:46.497663 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:03:46.497663 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:03:46.497663 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:03:46.501101 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:03:46.501101 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:03:46.501101 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:03:46.501101 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:03:46.501101 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group e7812d23-703d-433d-a1e7-509e5ada814d does not exist Aug 10 23:03:46.501101 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-093aec26-a178-4b29-929e-378937ec3f83'] Aug 10 23:03:46.501101 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:03:46.501101 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-adc70630-232c-4064-887f-c552a6a92aad tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Returning 404 to user: Security group e7812d23-703d-433d-a1e7-509e5ada814d does not exist Aug 10 23:03:46.501101 n-d-850468-14 devstack@n-api.service[122633]: Neutron server returns request_ids: ['req-093aec26-a178-4b29-929e-378937ec3f83'] {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:03:46.501101 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-adc70630-232c-4064-887f-c552a6a92aad tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/e7812d23-703d-433d-a1e7-509e5ada814d" status: 404 len: 194 microversion: 2.1 time: 0.062986 Aug 10 23:03:46.501101 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 949/1873] 10.222.0.58 () {58 vars in 1272 bytes} [Wed Aug 10 23:03:46 2022] DELETE /compute/v2.1/os-security-groups/e7812d23-703d-433d-a1e7-509e5ada814d => generated 194 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:03:46.502906 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-a9c11fcb-41b1-4d9a-b054-a78811f91d7e tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] 10.222.0.58 "GET /compute/v2.1/servers/3f5e8cd2-6666-4206-a393-9f0507322402" status: 200 len: 1321 microversion: 2.1 time: 0.967792 Aug 10 23:03:46.526100 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 925/1874] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:03:45 2022] GET /compute/v2.1/servers/3f5e8cd2-6666-4206-a393-9f0507322402 => generated 1321 bytes in 995 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:03:46.529167 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-9f066a9f-1cf9-4d5e-b09e-21cc2ef8defe tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:46.530638 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-9f066a9f-1cf9-4d5e-b09e-21cc2ef8defe tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] [instance: 63d2bd74-d060-4925-9323-b39d5131f958] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:46.536028 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-7e95fdbe-0e45-4f8c-95bf-feb06453ee16 req-447af364-8d05-4c5f-9940-d8e8f31f3539 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0af574c3-bfa0-4df6-8f0e-6fcd12e9b8a9", "name": "network-vif-deleted", "tag": "619742dd-1d71-452c-be56-cfa1c8c095fa"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:03:46.540590 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9f066a9f-1cf9-4d5e-b09e-21cc2ef8defe tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:46.541377 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9f066a9f-1cf9-4d5e-b09e-21cc2ef8defe tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:46.541906 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9f066a9f-1cf9-4d5e-b09e-21cc2ef8defe tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:46.543099 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9f066a9f-1cf9-4d5e-b09e-21cc2ef8defe tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:46.543863 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9f066a9f-1cf9-4d5e-b09e-21cc2ef8defe tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:46.544370 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9f066a9f-1cf9-4d5e-b09e-21cc2ef8defe tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:46.553446 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-7e95fdbe-0e45-4f8c-95bf-feb06453ee16 req-447af364-8d05-4c5f-9940-d8e8f31f3539 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:46.554228 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-7e95fdbe-0e45-4f8c-95bf-feb06453ee16 req-447af364-8d05-4c5f-9940-d8e8f31f3539 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:46.554928 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-7e95fdbe-0e45-4f8c-95bf-feb06453ee16 req-447af364-8d05-4c5f-9940-d8e8f31f3539 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:46.580378 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-7e95fdbe-0e45-4f8c-95bf-feb06453ee16 req-447af364-8d05-4c5f-9940-d8e8f31f3539 service nova] Creating event network-vif-deleted:619742dd-1d71-452c-be56-cfa1c8c095fa for instance 0af574c3-bfa0-4df6-8f0e-6fcd12e9b8a9 on n-h1-850468-14 Aug 10 23:03:46.592934 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-7e95fdbe-0e45-4f8c-95bf-feb06453ee16 req-447af364-8d05-4c5f-9940-d8e8f31f3539 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065078 Aug 10 23:03:46.593685 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 926/1875] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:03:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:03:46.599586 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-71d129c2-6838-48a4-91c6-fb436e3c3501 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:46.605152 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-71d129c2-6838-48a4-91c6-fb436e3c3501 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '890735b21f5d4764aefd789f74e00222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9cf3129a4e4f56a17bebf68b7bc42b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:46.606467 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-71d129c2-6838-48a4-91c6-fb436e3c3501 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Searching by: {'deleted': False, 'project_id': '9e9cf3129a4e4f56a17bebf68b7bc42b'} {{(pid=122632) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 10 23:03:46.614133 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-71d129c2-6838-48a4-91c6-fb436e3c3501 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:46.614916 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-71d129c2-6838-48a4-91c6-fb436e3c3501 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:46.615707 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-71d129c2-6838-48a4-91c6-fb436e3c3501 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:46.616774 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-71d129c2-6838-48a4-91c6-fb436e3c3501 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:46.617418 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-71d129c2-6838-48a4-91c6-fb436e3c3501 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:46.618945 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-71d129c2-6838-48a4-91c6-fb436e3c3501 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:46.655989 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.multi_cell_list [None req-71d129c2-6838-48a4-91c6-fb436e3c3501 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=122632) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 10 23:03:46.705200 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-71d129c2-6838-48a4-91c6-fb436e3c3501 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] 10.222.0.58 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.110365 Aug 10 23:03:46.713371 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 927/1876] 10.222.0.58 () {58 vars in 1125 bytes} [Wed Aug 10 23:03:46 2022] GET /compute/v2.1/servers => generated 683 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:03:46.724745 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-4b945377-7334-4527-ba3c-2f48d0ea2f78 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:46.729181 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-4b945377-7334-4527-ba3c-2f48d0ea2f78 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] [instance: baf47131-7a59-4588-9ce6-113709fa8480] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:46.742704 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4b945377-7334-4527-ba3c-2f48d0ea2f78 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:46.743555 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4b945377-7334-4527-ba3c-2f48d0ea2f78 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:46.744704 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4b945377-7334-4527-ba3c-2f48d0ea2f78 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:46.746002 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4b945377-7334-4527-ba3c-2f48d0ea2f78 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:46.747539 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4b945377-7334-4527-ba3c-2f48d0ea2f78 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:46.748987 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4b945377-7334-4527-ba3c-2f48d0ea2f78 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:46.970873 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-9f066a9f-1cf9-4d5e-b09e-21cc2ef8defe tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632904331d024d9b8e4d3660dff2cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ed0bdee3aa4013bd9219069bda558c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:46.982955 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-9f066a9f-1cf9-4d5e-b09e-21cc2ef8defe tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] 10.222.0.58 "GET /compute/v2.1/servers/63d2bd74-d060-4925-9323-b39d5131f958" status: 200 len: 1392 microversion: 2.1 time: 0.484375 Aug 10 23:03:46.983853 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 950/1877] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:03:46 2022] GET /compute/v2.1/servers/63d2bd74-d060-4925-9323-b39d5131f958 => generated 1392 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:03:46.999144 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-b62a4132-7899-44d1-be9d-c22009501212 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Calling method '.version_select at 0x7f847d3b28b0>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:47.147723 n-d-850468-14 devstack@n-api.service[122633]: DEBUG neutronclient.v2_0.client [None req-b62a4132-7899-44d1-be9d-c22009501212 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 6a8f01ff-e4b7-461e-9543-d4774d97a84a does not exist", "detail": ""}} {{(pid=122633) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 10 23:03:47.148351 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.network.security_group_api [None req-b62a4132-7899-44d1-be9d-c22009501212 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Neutron security group 6a8f01ff-e4b7-461e-9543-d4774d97a84a not found {{(pid=122633) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 10 23:03:47.149009 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-b62a4132-7899-44d1-be9d-c22009501212 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] HTTP exception thrown: Security group 6a8f01ff-e4b7-461e-9543-d4774d97a84a does not exist Aug 10 23:03:47.149009 n-d-850468-14 devstack@n-api.service[122633]: Neutron server returns request_ids: ['req-0def03f5-c505-4d95-b63f-d4a675004b3d'] Aug 10 23:03:47.151791 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-b62a4132-7899-44d1-be9d-c22009501212 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Request method failure captured: Aug 10 23:03:47.151791 n-d-850468-14 devstack@n-api.service[122633]: request: DELETE /compute/v2.1/os-security-groups/6a8f01ff-e4b7-461e-9543-d4774d97a84a HTTP/1.1 Aug 10 23:03:47.151791 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:03:47.151791 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:03:47.151791 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:03:47.151791 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:03:47.151791 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:03:47.151791 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:03:47.151791 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:03:47.151791 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:03:47.151791 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9Dju6bcY6WgJPTWLWUJ0fX6JaJBRP8GkYZWFafNrDYn8ACaF-JC0t8YD4rSPFgG5Deze7mjmq2_rnPCZ1jpXNRGkHxz134mT5MqTqUm9UAyuVcbLtNQAiAf-L4A3117brPwKa_CN56-tZ47WT8aAPEON_2-WsEOp9qATqEToy30jo_s Aug 10 23:03:47.151791 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:03:47.151791 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:03:47.151791 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:03:47.151791 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:03:47.151791 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:03:47.151791 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:03:47.151791 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 707f869910b34768ae1a348cd0b5f284 Aug 10 23:03:47.151791 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-SecurityGroupsTestJSON-1406525704 Aug 10 23:03:47.151791 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:03:47.151791 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:03:47.153644 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/707f869910b34768ae1a348cd0b5f284"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/707f869910b34768ae1a348cd0b5f284"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/707f869910b34768ae1a348cd0b5f284"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_707f869910b34768ae1a348cd0b5f284", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:03:47.153644 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-SecurityGroupsTestJSON-1406525704 Aug 10 23:03:47.153644 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 707f869910b34768ae1a348cd0b5f284 Aug 10 23:03:47.153644 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1406525704 Aug 10 23:03:47.153644 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-SecurityGroupsTestJSON-1406525704-project Aug 10 23:03:47.153644 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:03:47.153644 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:03:47.153644 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: bfd6d8e6a8444f5b9fcf1cf8da242ac0 Aug 10 23:03:47.153644 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-SecurityGroupsTestJSON-1406525704-project Aug 10 23:03:47.153644 n-d-850468-14 devstack@n-api.service[122633]: method: Aug 10 23:03:47.153644 n-d-850468-14 devstack@n-api.service[122633]: exception: Security group 6a8f01ff-e4b7-461e-9543-d4774d97a84a does not exist Aug 10 23:03:47.153644 n-d-850468-14 devstack@n-api.service[122633]: Neutron server returns request_ids: ['req-0def03f5-c505-4d95-b63f-d4a675004b3d'] Aug 10 23:03:47.153644 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': '6a8f01ff-e4b7-461e-9543-d4774d97a84a'} Aug 10 23:03:47.155000 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:03:47.155000 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:03:47.155000 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 10 23:03:47.155000 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 10 23:03:47.155000 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 23:03:47.155000 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 23:03:47.155000 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 10 23:03:47.155000 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 10 23:03:47.155000 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 23:03:47.155000 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 23:03:47.155000 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 23:03:47.155000 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 23:03:47.155000 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 23:03:47.155000 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 23:03:47.155000 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 23:03:47.155000 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 23:03:47.155000 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 23:03:47.155000 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 23:03:47.155000 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 10 23:03:47.156603 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 10 23:03:47.156603 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 23:03:47.156603 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 23:03:47.156603 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 10 23:03:47.156603 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 10 23:03:47.156603 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 10 23:03:47.156603 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 10 23:03:47.156603 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 6a8f01ff-e4b7-461e-9543-d4774d97a84a does not exist Aug 10 23:03:47.156603 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0def03f5-c505-4d95-b63f-d4a675004b3d'] Aug 10 23:03:47.156603 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:03:47.156603 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:03:47.156603 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:03:47.156603 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:03:47.156603 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 10 23:03:47.156603 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 10 23:03:47.156603 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 10 23:03:47.156603 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 10 23:03:47.156603 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 6a8f01ff-e4b7-461e-9543-d4774d97a84a does not exist Aug 10 23:03:47.159274 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0def03f5-c505-4d95-b63f-d4a675004b3d'] Aug 10 23:03:47.159274 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:03:47.159274 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:03:47.159274 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:03:47.159274 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:03:47.159274 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:03:47.159274 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:03:47.159274 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:03:47.159274 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:03:47.159274 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 23:03:47.159274 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 23:03:47.159274 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:03:47.159274 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:03:47.159274 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 10 23:03:47.159274 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 10 23:03:47.159274 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 6a8f01ff-e4b7-461e-9543-d4774d97a84a does not exist Aug 10 23:03:47.159274 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0def03f5-c505-4d95-b63f-d4a675004b3d'] Aug 10 23:03:47.159274 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:03:47.159274 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:03:47.159274 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:03:47.159274 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:03:47.162078 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:03:47.162078 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:03:47.162078 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:03:47.162078 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:03:47.162078 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 6a8f01ff-e4b7-461e-9543-d4774d97a84a does not exist Aug 10 23:03:47.162078 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0def03f5-c505-4d95-b63f-d4a675004b3d'] Aug 10 23:03:47.162078 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:03:47.164692 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-b62a4132-7899-44d1-be9d-c22009501212 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Returning 404 to user: Security group 6a8f01ff-e4b7-461e-9543-d4774d97a84a does not exist Aug 10 23:03:47.164692 n-d-850468-14 devstack@n-api.service[122633]: Neutron server returns request_ids: ['req-0def03f5-c505-4d95-b63f-d4a675004b3d'] {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:03:47.168611 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-b62a4132-7899-44d1-be9d-c22009501212 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/6a8f01ff-e4b7-461e-9543-d4774d97a84a" status: 404 len: 194 microversion: 2.1 time: 0.182175 Aug 10 23:03:47.173321 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 951/1878] 10.222.0.58 () {58 vars in 1272 bytes} [Wed Aug 10 23:03:46 2022] DELETE /compute/v2.1/os-security-groups/6a8f01ff-e4b7-461e-9543-d4774d97a84a => generated 194 bytes in 188 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:03:47.180196 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-2836432e-de24-4697-8fc4-18b4abe86da8 req-f77a4e00-2dca-47a2-89d1-eb18ee8faa9e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f5e8cd2-6666-4206-a393-9f0507322402", "tag": "8d20efca-c421-4e1d-9824-67555899ca9d"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:03:47.195738 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-2836432e-de24-4697-8fc4-18b4abe86da8 req-f77a4e00-2dca-47a2-89d1-eb18ee8faa9e service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:47.196649 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-2836432e-de24-4697-8fc4-18b4abe86da8 req-f77a4e00-2dca-47a2-89d1-eb18ee8faa9e service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:47.197267 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-2836432e-de24-4697-8fc4-18b4abe86da8 req-f77a4e00-2dca-47a2-89d1-eb18ee8faa9e service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:47.209177 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-2836432e-de24-4697-8fc4-18b4abe86da8 req-f77a4e00-2dca-47a2-89d1-eb18ee8faa9e service nova] Creating event network-changed:8d20efca-c421-4e1d-9824-67555899ca9d for instance 3f5e8cd2-6666-4206-a393-9f0507322402 on n-h2-850468-14 Aug 10 23:03:47.216340 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-2836432e-de24-4697-8fc4-18b4abe86da8 req-f77a4e00-2dca-47a2-89d1-eb18ee8faa9e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040514 Aug 10 23:03:47.217185 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 952/1879] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:03:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:03:47.223576 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-6d57d215-9388-4177-acf1-5d575f67eee6 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:47.225237 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-6d57d215-9388-4177-acf1-5d575f67eee6 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] [instance: 17b32f05-1f0e-473f-bfda-fab92a90b04f] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:47.235911 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6d57d215-9388-4177-acf1-5d575f67eee6 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:47.237069 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6d57d215-9388-4177-acf1-5d575f67eee6 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:47.237712 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6d57d215-9388-4177-acf1-5d575f67eee6 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:47.249201 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6d57d215-9388-4177-acf1-5d575f67eee6 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:47.250259 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6d57d215-9388-4177-acf1-5d575f67eee6 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:47.251590 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6d57d215-9388-4177-acf1-5d575f67eee6 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:47.289949 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-4b945377-7334-4527-ba3c-2f48d0ea2f78 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:47.300417 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-6d57d215-9388-4177-acf1-5d575f67eee6 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] HTTP exception thrown: Instance 17b32f05-1f0e-473f-bfda-fab92a90b04f could not be found. Aug 10 23:03:47.301758 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-4b945377-7334-4527-ba3c-2f48d0ea2f78 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:47.303019 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-6d57d215-9388-4177-acf1-5d575f67eee6 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Request method failure captured: Aug 10 23:03:47.303019 n-d-850468-14 devstack@n-api.service[122633]: request: DELETE /compute/v2.1/servers/17b32f05-1f0e-473f-bfda-fab92a90b04f HTTP/1.1 Aug 10 23:03:47.303019 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:03:47.303019 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:03:47.303019 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:03:47.303019 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:03:47.303019 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:03:47.303019 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:03:47.303019 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:03:47.303019 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:03:47.303019 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9DkiAjWMnEScmXUQ4URpE929LR04Z8tVQFM7-HlbAmthzngpnguHOyLOUY0k3vhcWXMqybRYRnxQLljJds4eIyjIcnw25UUriDcSFQLJ0yAgBKlC5ig8XoT5HsrMNoi0tzD74DHerwRzKapIeqizBGLGMzal9OBH_ENocwnLGn23ebg Aug 10 23:03:47.303019 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:03:47.303019 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:03:47.303019 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:03:47.303019 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:03:47.303019 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:03:47.303019 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:03:47.303019 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 9e9cf3129a4e4f56a17bebf68b7bc42b Aug 10 23:03:47.303019 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-ListServersNegativeTestJSON-1516024484 Aug 10 23:03:47.303019 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:03:47.303019 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:03:47.304784 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9e9cf3129a4e4f56a17bebf68b7bc42b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9e9cf3129a4e4f56a17bebf68b7bc42b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/9e9cf3129a4e4f56a17bebf68b7bc42b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_9e9cf3129a4e4f56a17bebf68b7bc42b", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:03:47.304784 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-ListServersNegativeTestJSON-1516024484 Aug 10 23:03:47.304784 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 9e9cf3129a4e4f56a17bebf68b7bc42b Aug 10 23:03:47.304784 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1516024484 Aug 10 23:03:47.304784 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-ListServersNegativeTestJSON-1516024484-project Aug 10 23:03:47.304784 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:03:47.304784 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:03:47.304784 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 890735b21f5d4764aefd789f74e00222 Aug 10 23:03:47.304784 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-ListServersNegativeTestJSON-1516024484-project Aug 10 23:03:47.304784 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:03:47.304784 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance 17b32f05-1f0e-473f-bfda-fab92a90b04f could not be found. Aug 10 23:03:47.304784 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': '17b32f05-1f0e-473f-bfda-fab92a90b04f'} Aug 10 23:03:47.306333 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:03:47.306333 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:03:47.306333 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:03:47.306333 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:03:47.306333 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:03:47.306333 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:03:47.306333 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:03:47.306333 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:03:47.306333 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:03:47.306333 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:03:47.306333 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17b32f05-1f0e-473f-bfda-fab92a90b04f could not be found. Aug 10 23:03:47.306333 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:03:47.306333 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:03:47.306333 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:03:47.306333 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:03:47.306333 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:03:47.306333 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:03:47.306333 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:03:47.306333 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:03:47.306333 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:03:47.308124 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:03:47.308124 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 23:03:47.308124 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 23:03:47.308124 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 23:03:47.308124 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 23:03:47.308124 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:03:47.308124 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:03:47.308124 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:03:47.308124 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:03:47.308124 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17b32f05-1f0e-473f-bfda-fab92a90b04f could not be found. Aug 10 23:03:47.308124 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:03:47.308124 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:03:47.308124 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:03:47.308124 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:03:47.308124 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:03:47.308124 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:03:47.308124 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:03:47.308124 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:03:47.308124 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17b32f05-1f0e-473f-bfda-fab92a90b04f could not be found. Aug 10 23:03:47.308124 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:03:47.310035 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-4b945377-7334-4527-ba3c-2f48d0ea2f78 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:47.310035 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-4b945377-7334-4527-ba3c-2f48d0ea2f78 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] 10.222.0.58 "GET /compute/v2.1/servers/baf47131-7a59-4588-9ce6-113709fa8480" status: 200 len: 1565 microversion: 2.25 time: 0.591251 Aug 10 23:03:47.312482 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-6d57d215-9388-4177-acf1-5d575f67eee6 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Returning 404 to user: Instance 17b32f05-1f0e-473f-bfda-fab92a90b04f could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:03:47.313218 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 928/1880] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:03:46 2022] GET /compute/v2.1/servers/baf47131-7a59-4588-9ce6-113709fa8480 => generated 1565 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:03:47.314087 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-6d57d215-9388-4177-acf1-5d575f67eee6 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] 10.222.0.58 "DELETE /compute/v2.1/servers/17b32f05-1f0e-473f-bfda-fab92a90b04f" status: 404 len: 111 microversion: 2.1 time: 0.095490 Aug 10 23:03:47.315023 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 953/1881] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:03:47 2022] DELETE /compute/v2.1/servers/17b32f05-1f0e-473f-bfda-fab92a90b04f => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:03:47.325114 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-e8191c9b-8c41-4fa6-b70b-c07ef371b802 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:47.325663 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-e8191c9b-8c41-4fa6-b70b-c07ef371b802 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] [instance: 6bf5e469-d129-4daa-93f8-36661ec153a2] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:47.334505 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-ba58b06b-879d-40ac-940c-bf097bb82388 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Calling method '.version_select at 0x7f847d732700>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:47.341191 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e8191c9b-8c41-4fa6-b70b-c07ef371b802 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:47.345546 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e8191c9b-8c41-4fa6-b70b-c07ef371b802 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:47.345942 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e8191c9b-8c41-4fa6-b70b-c07ef371b802 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:47.346688 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e8191c9b-8c41-4fa6-b70b-c07ef371b802 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:47.347179 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e8191c9b-8c41-4fa6-b70b-c07ef371b802 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:47.347606 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e8191c9b-8c41-4fa6-b70b-c07ef371b802 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:47.385937 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-e8191c9b-8c41-4fa6-b70b-c07ef371b802 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] [instance: 6bf5e469-d129-4daa-93f8-36661ec153a2] Going to try to terminate instance {{(pid=122633) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:03:47.404854 n-d-850468-14 devstack@n-api.service[122632]: DEBUG neutronclient.v2_0.client [None req-ba58b06b-879d-40ac-940c-bf097bb82388 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group aba3b9a5-0e86-4933-9547-ecc7eeb675ce does not exist", "detail": ""}} {{(pid=122632) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 10 23:03:47.405846 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.network.security_group_api [None req-ba58b06b-879d-40ac-940c-bf097bb82388 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Neutron security group aba3b9a5-0e86-4933-9547-ecc7eeb675ce not found {{(pid=122632) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 10 23:03:47.406602 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-ba58b06b-879d-40ac-940c-bf097bb82388 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] HTTP exception thrown: Security group aba3b9a5-0e86-4933-9547-ecc7eeb675ce does not exist Aug 10 23:03:47.406602 n-d-850468-14 devstack@n-api.service[122632]: Neutron server returns request_ids: ['req-550f5834-8785-4c59-ba57-527c5c048fdf'] Aug 10 23:03:47.409128 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-ba58b06b-879d-40ac-940c-bf097bb82388 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Request method failure captured: Aug 10 23:03:47.409128 n-d-850468-14 devstack@n-api.service[122632]: request: DELETE /compute/v2.1/os-security-groups/aba3b9a5-0e86-4933-9547-ecc7eeb675ce HTTP/1.1 Aug 10 23:03:47.409128 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:03:47.409128 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:03:47.409128 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:03:47.409128 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 23:03:47.409128 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:03:47.409128 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:03:47.409128 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:03:47.409128 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:03:47.409128 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9Dju6bcY6WgJPTWLWUJ0fX6JaJBRP8GkYZWFafNrDYn8ACaF-JC0t8YD4rSPFgG5Deze7mjmq2_rnPCZ1jpXNRGkHxz134mT5MqTqUm9UAyuVcbLtNQAiAf-L4A3117brPwKa_CN56-tZ47WT8aAPEON_2-WsEOp9qATqEToy30jo_s Aug 10 23:03:47.409128 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:03:47.409128 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:03:47.409128 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:03:47.409128 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:03:47.409128 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:03:47.409128 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:03:47.409128 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 707f869910b34768ae1a348cd0b5f284 Aug 10 23:03:47.409128 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-SecurityGroupsTestJSON-1406525704 Aug 10 23:03:47.409128 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:03:47.409128 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:03:47.410932 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/707f869910b34768ae1a348cd0b5f284"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/707f869910b34768ae1a348cd0b5f284"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/707f869910b34768ae1a348cd0b5f284"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_707f869910b34768ae1a348cd0b5f284", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:03:47.410932 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-SecurityGroupsTestJSON-1406525704 Aug 10 23:03:47.410932 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 707f869910b34768ae1a348cd0b5f284 Aug 10 23:03:47.410932 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1406525704 Aug 10 23:03:47.410932 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-SecurityGroupsTestJSON-1406525704-project Aug 10 23:03:47.410932 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:03:47.410932 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:03:47.410932 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: bfd6d8e6a8444f5b9fcf1cf8da242ac0 Aug 10 23:03:47.410932 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-SecurityGroupsTestJSON-1406525704-project Aug 10 23:03:47.410932 n-d-850468-14 devstack@n-api.service[122632]: method: Aug 10 23:03:47.410932 n-d-850468-14 devstack@n-api.service[122632]: exception: Security group aba3b9a5-0e86-4933-9547-ecc7eeb675ce does not exist Aug 10 23:03:47.410932 n-d-850468-14 devstack@n-api.service[122632]: Neutron server returns request_ids: ['req-550f5834-8785-4c59-ba57-527c5c048fdf'] Aug 10 23:03:47.410932 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': 'aba3b9a5-0e86-4933-9547-ecc7eeb675ce'} Aug 10 23:03:47.411975 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:03:47.411975 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:03:47.411975 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 10 23:03:47.411975 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 10 23:03:47.411975 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 23:03:47.411975 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 23:03:47.411975 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 10 23:03:47.411975 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 10 23:03:47.411975 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 23:03:47.411975 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 23:03:47.411975 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 23:03:47.411975 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 23:03:47.411975 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 23:03:47.411975 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 23:03:47.411975 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 23:03:47.411975 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 23:03:47.411975 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 23:03:47.411975 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 23:03:47.411975 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 10 23:03:47.413524 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 10 23:03:47.413524 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 23:03:47.413524 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 23:03:47.413524 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 10 23:03:47.413524 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 10 23:03:47.413524 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 10 23:03:47.413524 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 10 23:03:47.413524 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group aba3b9a5-0e86-4933-9547-ecc7eeb675ce does not exist Aug 10 23:03:47.413524 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-550f5834-8785-4c59-ba57-527c5c048fdf'] Aug 10 23:03:47.413524 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:03:47.413524 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:03:47.413524 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:03:47.413524 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:03:47.413524 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 10 23:03:47.413524 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 10 23:03:47.413524 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 10 23:03:47.413524 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 10 23:03:47.413524 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group aba3b9a5-0e86-4933-9547-ecc7eeb675ce does not exist Aug 10 23:03:47.415009 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-550f5834-8785-4c59-ba57-527c5c048fdf'] Aug 10 23:03:47.415009 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:03:47.415009 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:03:47.415009 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:03:47.415009 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:03:47.415009 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:03:47.415009 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:03:47.415009 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:03:47.415009 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:03:47.415009 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 23:03:47.415009 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 23:03:47.415009 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:03:47.415009 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:03:47.415009 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 10 23:03:47.415009 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 10 23:03:47.415009 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group aba3b9a5-0e86-4933-9547-ecc7eeb675ce does not exist Aug 10 23:03:47.415009 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-550f5834-8785-4c59-ba57-527c5c048fdf'] Aug 10 23:03:47.415009 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:03:47.415009 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:03:47.415009 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:03:47.415009 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:03:47.417585 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:03:47.417585 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:03:47.417585 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:03:47.417585 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:03:47.417585 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group aba3b9a5-0e86-4933-9547-ecc7eeb675ce does not exist Aug 10 23:03:47.417585 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-550f5834-8785-4c59-ba57-527c5c048fdf'] Aug 10 23:03:47.417585 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:03:47.419336 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-ba58b06b-879d-40ac-940c-bf097bb82388 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Returning 404 to user: Security group aba3b9a5-0e86-4933-9547-ecc7eeb675ce does not exist Aug 10 23:03:47.419336 n-d-850468-14 devstack@n-api.service[122632]: Neutron server returns request_ids: ['req-550f5834-8785-4c59-ba57-527c5c048fdf'] {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:03:47.420546 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-ba58b06b-879d-40ac-940c-bf097bb82388 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/aba3b9a5-0e86-4933-9547-ecc7eeb675ce" status: 404 len: 194 microversion: 2.1 time: 0.106287 Aug 10 23:03:47.428213 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 929/1882] 10.222.0.58 () {58 vars in 1272 bytes} [Wed Aug 10 23:03:47 2022] DELETE /compute/v2.1/os-security-groups/aba3b9a5-0e86-4933-9547-ecc7eeb675ce => generated 194 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:03:47.452646 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-e98a5581-e70b-4e83-ae7f-8983dd01be49 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:47.456853 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-e98a5581-e70b-4e83-ae7f-8983dd01be49 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] [instance: 0af574c3-bfa0-4df6-8f0e-6fcd12e9b8a9] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:47.475364 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:03:47.484196 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e98a5581-e70b-4e83-ae7f-8983dd01be49 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:47.486227 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e98a5581-e70b-4e83-ae7f-8983dd01be49 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:47.490355 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e98a5581-e70b-4e83-ae7f-8983dd01be49 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:47.493797 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e98a5581-e70b-4e83-ae7f-8983dd01be49 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:47.498762 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e98a5581-e70b-4e83-ae7f-8983dd01be49 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:47.501458 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e98a5581-e70b-4e83-ae7f-8983dd01be49 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:47.559783 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-e98a5581-e70b-4e83-ae7f-8983dd01be49 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] HTTP exception thrown: Instance 0af574c3-bfa0-4df6-8f0e-6fcd12e9b8a9 could not be found. Aug 10 23:03:47.563553 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-e98a5581-e70b-4e83-ae7f-8983dd01be49 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Request method failure captured: Aug 10 23:03:47.563553 n-d-850468-14 devstack@n-api.service[122632]: request: GET /compute/v2.1/servers/0af574c3-bfa0-4df6-8f0e-6fcd12e9b8a9 HTTP/1.1 Aug 10 23:03:47.563553 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:03:47.563553 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:03:47.563553 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:03:47.563553 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 23:03:47.563553 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:03:47.563553 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:03:47.563553 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:03:47.563553 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:03:47.563553 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9DhnJQVy677u4b7dnMoSItqtWsJm27g_Vg031CYXViqt8YYY7d4cXYrgXs0Pp9xS3IIxdwWgPKq2sDULWw--Li9t2t8l1R3feSY4uh4FysmLVRfKNCAYvKF_tmPQ5ZUjwhrC4jAx70ULoXcE-6wvpA-wHk_CVzAxHX7IWuhEQLk8ZDk Aug 10 23:03:47.563553 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:03:47.563553 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:03:47.563553 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:03:47.563553 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:03:47.563553 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:03:47.563553 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:03:47.563553 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: b27e6ee9495a438b8450a4ef0d62cbcd Aug 10 23:03:47.563553 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-ServersOnMultiNodesTest-936995831 Aug 10 23:03:47.563553 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:03:47.563553 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:03:47.565994 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b27e6ee9495a438b8450a4ef0d62cbcd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b27e6ee9495a438b8450a4ef0d62cbcd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b27e6ee9495a438b8450a4ef0d62cbcd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b27e6ee9495a438b8450a4ef0d62cbcd", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:03:47.565994 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-ServersOnMultiNodesTest-936995831 Aug 10 23:03:47.565994 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: b27e6ee9495a438b8450a4ef0d62cbcd Aug 10 23:03:47.565994 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-936995831 Aug 10 23:03:47.565994 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-ServersOnMultiNodesTest-936995831-project Aug 10 23:03:47.565994 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:03:47.565994 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:03:47.565994 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: 417d4eaaeb1c4df78745496ececb3e88 Aug 10 23:03:47.565994 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-ServersOnMultiNodesTest-936995831-project Aug 10 23:03:47.565994 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:03:47.565994 n-d-850468-14 devstack@n-api.service[122632]: exception: Instance 0af574c3-bfa0-4df6-8f0e-6fcd12e9b8a9 could not be found. Aug 10 23:03:47.565994 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': '0af574c3-bfa0-4df6-8f0e-6fcd12e9b8a9'} Aug 10 23:03:47.567168 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:03:47.567168 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:03:47.567168 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:03:47.567168 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:03:47.567168 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:03:47.567168 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:03:47.567168 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:03:47.567168 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:03:47.567168 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:03:47.567168 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:03:47.567168 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0af574c3-bfa0-4df6-8f0e-6fcd12e9b8a9 could not be found. Aug 10 23:03:47.567168 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:03:47.567168 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:03:47.567168 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:03:47.567168 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:03:47.567168 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:03:47.567168 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:03:47.567168 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:03:47.567168 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:03:47.567168 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:03:47.569560 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:03:47.569560 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:03:47.569560 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:03:47.569560 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:03:47.569560 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:03:47.569560 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:03:47.569560 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:03:47.569560 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0af574c3-bfa0-4df6-8f0e-6fcd12e9b8a9 could not be found. Aug 10 23:03:47.569560 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:03:47.569560 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:03:47.569560 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:03:47.569560 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:03:47.569560 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:03:47.569560 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:03:47.569560 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:03:47.569560 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:03:47.569560 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0af574c3-bfa0-4df6-8f0e-6fcd12e9b8a9 could not be found. Aug 10 23:03:47.569560 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:03:47.571871 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-e98a5581-e70b-4e83-ae7f-8983dd01be49 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] Returning 404 to user: Instance 0af574c3-bfa0-4df6-8f0e-6fcd12e9b8a9 could not be found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:03:47.571871 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-e98a5581-e70b-4e83-ae7f-8983dd01be49 tempest-ServersOnMultiNodesTest-936995831 tempest-ServersOnMultiNodesTest-936995831-project] 10.222.0.58 "GET /compute/v2.1/servers/0af574c3-bfa0-4df6-8f0e-6fcd12e9b8a9" status: 404 len: 111 microversion: 2.1 time: 0.130121 Aug 10 23:03:47.571871 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 930/1883] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:03:47 2022] GET /compute/v2.1/servers/0af574c3-bfa0-4df6-8f0e-6fcd12e9b8a9 => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:03:47.587793 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-44d5d47f-a6cc-4d4f-af71-f5a149cbf8c6 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Calling method '.version_select at 0x7f847d1c6670>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:47.629920 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-e8191c9b-8c41-4fa6-b70b-c07ef371b802 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] 10.222.0.58 "DELETE /compute/v2.1/servers/6bf5e469-d129-4daa-93f8-36661ec153a2" status: 204 len: 0 microversion: 2.1 time: 0.309663 Aug 10 23:03:47.630637 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 954/1884] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:03:47 2022] DELETE /compute/v2.1/servers/6bf5e469-d129-4daa-93f8-36661ec153a2 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 10 23:03:47.640131 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-48ce93a6-6547-4863-890f-7e50b422636e tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:47.640935 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-48ce93a6-6547-4863-890f-7e50b422636e tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] [instance: 3f5e8cd2-6666-4206-a393-9f0507322402] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:47.663193 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-48ce93a6-6547-4863-890f-7e50b422636e tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:47.663708 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-48ce93a6-6547-4863-890f-7e50b422636e tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:47.664179 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-48ce93a6-6547-4863-890f-7e50b422636e tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:47.665668 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-48ce93a6-6547-4863-890f-7e50b422636e tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:47.666016 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-48ce93a6-6547-4863-890f-7e50b422636e tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:47.666449 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-48ce93a6-6547-4863-890f-7e50b422636e tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:47.693910 n-d-850468-14 devstack@n-api.service[122632]: DEBUG neutronclient.v2_0.client [None req-44d5d47f-a6cc-4d4f-af71-f5a149cbf8c6 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 96068930-bb08-4e25-8909-73ead6115edb does not exist", "detail": ""}} {{(pid=122632) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 10 23:03:47.695011 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.network.security_group_api [None req-44d5d47f-a6cc-4d4f-af71-f5a149cbf8c6 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Neutron security group 96068930-bb08-4e25-8909-73ead6115edb not found {{(pid=122632) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 10 23:03:47.696798 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-44d5d47f-a6cc-4d4f-af71-f5a149cbf8c6 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] HTTP exception thrown: Security group 96068930-bb08-4e25-8909-73ead6115edb does not exist Aug 10 23:03:47.696798 n-d-850468-14 devstack@n-api.service[122632]: Neutron server returns request_ids: ['req-daf6f43f-f178-4f18-9384-c7ebefc62a8e'] Aug 10 23:03:47.699471 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-44d5d47f-a6cc-4d4f-af71-f5a149cbf8c6 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Request method failure captured: Aug 10 23:03:47.699471 n-d-850468-14 devstack@n-api.service[122632]: request: DELETE /compute/v2.1/os-security-groups/96068930-bb08-4e25-8909-73ead6115edb HTTP/1.1 Aug 10 23:03:47.699471 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:03:47.699471 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:03:47.699471 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:03:47.699471 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 23:03:47.699471 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:03:47.699471 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:03:47.699471 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:03:47.699471 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:03:47.699471 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9Dju6bcY6WgJPTWLWUJ0fX6JaJBRP8GkYZWFafNrDYn8ACaF-JC0t8YD4rSPFgG5Deze7mjmq2_rnPCZ1jpXNRGkHxz134mT5MqTqUm9UAyuVcbLtNQAiAf-L4A3117brPwKa_CN56-tZ47WT8aAPEON_2-WsEOp9qATqEToy30jo_s Aug 10 23:03:47.699471 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:03:47.699471 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:03:47.699471 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:03:47.699471 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:03:47.699471 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:03:47.699471 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:03:47.699471 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 707f869910b34768ae1a348cd0b5f284 Aug 10 23:03:47.699471 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-SecurityGroupsTestJSON-1406525704 Aug 10 23:03:47.699471 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:03:47.699471 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:03:47.700982 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/707f869910b34768ae1a348cd0b5f284"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/707f869910b34768ae1a348cd0b5f284"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/707f869910b34768ae1a348cd0b5f284"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_707f869910b34768ae1a348cd0b5f284", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:03:47.700982 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-SecurityGroupsTestJSON-1406525704 Aug 10 23:03:47.700982 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 707f869910b34768ae1a348cd0b5f284 Aug 10 23:03:47.700982 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1406525704 Aug 10 23:03:47.700982 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-SecurityGroupsTestJSON-1406525704-project Aug 10 23:03:47.700982 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:03:47.700982 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:03:47.700982 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: bfd6d8e6a8444f5b9fcf1cf8da242ac0 Aug 10 23:03:47.700982 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-SecurityGroupsTestJSON-1406525704-project Aug 10 23:03:47.700982 n-d-850468-14 devstack@n-api.service[122632]: method: Aug 10 23:03:47.700982 n-d-850468-14 devstack@n-api.service[122632]: exception: Security group 96068930-bb08-4e25-8909-73ead6115edb does not exist Aug 10 23:03:47.700982 n-d-850468-14 devstack@n-api.service[122632]: Neutron server returns request_ids: ['req-daf6f43f-f178-4f18-9384-c7ebefc62a8e'] Aug 10 23:03:47.700982 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': '96068930-bb08-4e25-8909-73ead6115edb'} Aug 10 23:03:47.701973 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:03:47.701973 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:03:47.701973 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 10 23:03:47.701973 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 10 23:03:47.701973 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 23:03:47.701973 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 23:03:47.701973 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 10 23:03:47.701973 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 10 23:03:47.701973 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 23:03:47.701973 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 23:03:47.701973 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 23:03:47.701973 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 23:03:47.701973 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 23:03:47.701973 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 23:03:47.701973 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 23:03:47.701973 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 23:03:47.701973 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 23:03:47.701973 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 23:03:47.701973 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 10 23:03:47.703378 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 10 23:03:47.703378 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 23:03:47.703378 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 23:03:47.703378 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 10 23:03:47.703378 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 10 23:03:47.703378 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 10 23:03:47.703378 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 10 23:03:47.703378 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 96068930-bb08-4e25-8909-73ead6115edb does not exist Aug 10 23:03:47.703378 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-daf6f43f-f178-4f18-9384-c7ebefc62a8e'] Aug 10 23:03:47.703378 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:03:47.703378 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:03:47.703378 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:03:47.703378 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:03:47.703378 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 10 23:03:47.703378 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 10 23:03:47.703378 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 10 23:03:47.703378 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 10 23:03:47.703378 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 96068930-bb08-4e25-8909-73ead6115edb does not exist Aug 10 23:03:47.706658 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-daf6f43f-f178-4f18-9384-c7ebefc62a8e'] Aug 10 23:03:47.706658 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:03:47.706658 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:03:47.706658 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:03:47.706658 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:03:47.706658 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:03:47.706658 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:03:47.706658 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:03:47.706658 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:03:47.706658 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 23:03:47.706658 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 23:03:47.706658 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:03:47.706658 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:03:47.706658 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 10 23:03:47.706658 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 10 23:03:47.706658 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 96068930-bb08-4e25-8909-73ead6115edb does not exist Aug 10 23:03:47.706658 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-daf6f43f-f178-4f18-9384-c7ebefc62a8e'] Aug 10 23:03:47.706658 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:03:47.706658 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:03:47.706658 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:03:47.706658 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:03:47.708425 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:03:47.708425 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:03:47.708425 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:03:47.708425 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:03:47.708425 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 96068930-bb08-4e25-8909-73ead6115edb does not exist Aug 10 23:03:47.708425 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-daf6f43f-f178-4f18-9384-c7ebefc62a8e'] Aug 10 23:03:47.708425 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:03:47.708425 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-44d5d47f-a6cc-4d4f-af71-f5a149cbf8c6 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Returning 404 to user: Security group 96068930-bb08-4e25-8909-73ead6115edb does not exist Aug 10 23:03:47.708425 n-d-850468-14 devstack@n-api.service[122632]: Neutron server returns request_ids: ['req-daf6f43f-f178-4f18-9384-c7ebefc62a8e'] {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:03:47.708425 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-44d5d47f-a6cc-4d4f-af71-f5a149cbf8c6 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/96068930-bb08-4e25-8909-73ead6115edb" status: 404 len: 194 microversion: 2.1 time: 0.118098 Aug 10 23:03:47.708425 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 931/1885] 10.222.0.58 () {58 vars in 1272 bytes} [Wed Aug 10 23:03:47 2022] DELETE /compute/v2.1/os-security-groups/96068930-bb08-4e25-8909-73ead6115edb => generated 194 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:03:47.718361 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-156bd9ab-d1ee-4012-8e6b-b78c5536cd4b tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:47.718920 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-156bd9ab-d1ee-4012-8e6b-b78c5536cd4b tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] [instance: 10ede6f4-625a-4c5a-a5d6-d7d0f2476dee] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:47.744116 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-156bd9ab-d1ee-4012-8e6b-b78c5536cd4b tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:47.745408 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-156bd9ab-d1ee-4012-8e6b-b78c5536cd4b tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:47.746609 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-156bd9ab-d1ee-4012-8e6b-b78c5536cd4b tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:47.747613 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-156bd9ab-d1ee-4012-8e6b-b78c5536cd4b tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:47.749211 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-156bd9ab-d1ee-4012-8e6b-b78c5536cd4b tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:47.749850 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-156bd9ab-d1ee-4012-8e6b-b78c5536cd4b tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:47.793193 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-156bd9ab-d1ee-4012-8e6b-b78c5536cd4b tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] [instance: 10ede6f4-625a-4c5a-a5d6-d7d0f2476dee] Going to try to terminate instance {{(pid=122632) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:03:47.921510 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-156bd9ab-d1ee-4012-8e6b-b78c5536cd4b tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] 10.222.0.58 "DELETE /compute/v2.1/servers/10ede6f4-625a-4c5a-a5d6-d7d0f2476dee" status: 204 len: 0 microversion: 2.1 time: 0.214355 Aug 10 23:03:47.922086 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 932/1886] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:03:47 2022] DELETE /compute/v2.1/servers/10ede6f4-625a-4c5a-a5d6-d7d0f2476dee => generated 0 bytes in 216 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:03:47.931654 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-8d942487-d8a5-4639-b62a-cc8d4886739e tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Calling method '.version_select at 0x7f848051aee0>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:47.966976 n-d-850468-14 devstack@n-api.service[122632]: DEBUG neutronclient.v2_0.client [None req-8d942487-d8a5-4639-b62a-cc8d4886739e tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 8d006294-7bbe-4631-93c9-515e3239f0aa does not exist", "detail": ""}} {{(pid=122632) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 10 23:03:47.967920 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.network.security_group_api [None req-8d942487-d8a5-4639-b62a-cc8d4886739e tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Neutron security group 8d006294-7bbe-4631-93c9-515e3239f0aa not found {{(pid=122632) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 10 23:03:47.968630 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-8d942487-d8a5-4639-b62a-cc8d4886739e tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] HTTP exception thrown: Security group 8d006294-7bbe-4631-93c9-515e3239f0aa does not exist Aug 10 23:03:47.968630 n-d-850468-14 devstack@n-api.service[122632]: Neutron server returns request_ids: ['req-a86b6d3b-5c6d-4650-a906-fdc96a0f733b'] Aug 10 23:03:47.971251 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-8d942487-d8a5-4639-b62a-cc8d4886739e tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Request method failure captured: Aug 10 23:03:47.971251 n-d-850468-14 devstack@n-api.service[122632]: request: DELETE /compute/v2.1/os-security-groups/8d006294-7bbe-4631-93c9-515e3239f0aa HTTP/1.1 Aug 10 23:03:47.971251 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:03:47.971251 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:03:47.971251 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:03:47.971251 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 23:03:47.971251 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:03:47.971251 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:03:47.971251 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:03:47.971251 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:03:47.971251 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9Dju6bcY6WgJPTWLWUJ0fX6JaJBRP8GkYZWFafNrDYn8ACaF-JC0t8YD4rSPFgG5Deze7mjmq2_rnPCZ1jpXNRGkHxz134mT5MqTqUm9UAyuVcbLtNQAiAf-L4A3117brPwKa_CN56-tZ47WT8aAPEON_2-WsEOp9qATqEToy30jo_s Aug 10 23:03:47.971251 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:03:47.971251 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:03:47.971251 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:03:47.971251 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:03:47.971251 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:03:47.971251 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:03:47.971251 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 707f869910b34768ae1a348cd0b5f284 Aug 10 23:03:47.971251 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-SecurityGroupsTestJSON-1406525704 Aug 10 23:03:47.971251 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:03:47.971251 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:03:47.973177 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/707f869910b34768ae1a348cd0b5f284"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/707f869910b34768ae1a348cd0b5f284"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/707f869910b34768ae1a348cd0b5f284"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_707f869910b34768ae1a348cd0b5f284", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:03:47.973177 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-SecurityGroupsTestJSON-1406525704 Aug 10 23:03:47.973177 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 707f869910b34768ae1a348cd0b5f284 Aug 10 23:03:47.973177 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1406525704 Aug 10 23:03:47.973177 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-SecurityGroupsTestJSON-1406525704-project Aug 10 23:03:47.973177 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:03:47.973177 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:03:47.973177 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: bfd6d8e6a8444f5b9fcf1cf8da242ac0 Aug 10 23:03:47.973177 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-SecurityGroupsTestJSON-1406525704-project Aug 10 23:03:47.973177 n-d-850468-14 devstack@n-api.service[122632]: method: Aug 10 23:03:47.973177 n-d-850468-14 devstack@n-api.service[122632]: exception: Security group 8d006294-7bbe-4631-93c9-515e3239f0aa does not exist Aug 10 23:03:47.973177 n-d-850468-14 devstack@n-api.service[122632]: Neutron server returns request_ids: ['req-a86b6d3b-5c6d-4650-a906-fdc96a0f733b'] Aug 10 23:03:47.973177 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': '8d006294-7bbe-4631-93c9-515e3239f0aa'} Aug 10 23:03:47.974300 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:03:47.974300 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:03:47.974300 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 10 23:03:47.974300 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 10 23:03:47.974300 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 23:03:47.974300 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 23:03:47.974300 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 10 23:03:47.974300 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 10 23:03:47.974300 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 23:03:47.974300 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 23:03:47.974300 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 23:03:47.974300 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 23:03:47.974300 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 23:03:47.974300 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 23:03:47.974300 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 23:03:47.974300 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 23:03:47.974300 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 23:03:47.974300 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 23:03:47.974300 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 10 23:03:47.975879 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 10 23:03:47.975879 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 23:03:47.975879 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 23:03:47.975879 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 10 23:03:47.975879 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 10 23:03:47.975879 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 10 23:03:47.975879 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 10 23:03:47.975879 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 8d006294-7bbe-4631-93c9-515e3239f0aa does not exist Aug 10 23:03:47.975879 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a86b6d3b-5c6d-4650-a906-fdc96a0f733b'] Aug 10 23:03:47.975879 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:03:47.975879 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:03:47.975879 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:03:47.975879 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:03:47.975879 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 10 23:03:47.975879 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 10 23:03:47.975879 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 10 23:03:47.975879 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 10 23:03:47.975879 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 8d006294-7bbe-4631-93c9-515e3239f0aa does not exist Aug 10 23:03:47.978054 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a86b6d3b-5c6d-4650-a906-fdc96a0f733b'] Aug 10 23:03:47.978054 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:03:47.978054 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:03:47.978054 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:03:47.978054 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:03:47.978054 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:03:47.978054 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:03:47.978054 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:03:47.978054 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:03:47.978054 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 23:03:47.978054 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 23:03:47.978054 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:03:47.978054 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:03:47.978054 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 10 23:03:47.978054 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 10 23:03:47.978054 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 8d006294-7bbe-4631-93c9-515e3239f0aa does not exist Aug 10 23:03:47.978054 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a86b6d3b-5c6d-4650-a906-fdc96a0f733b'] Aug 10 23:03:47.978054 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:03:47.978054 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:03:47.978054 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:03:47.978054 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:03:47.980251 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:03:47.980251 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:03:47.980251 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:03:47.980251 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:03:47.980251 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 8d006294-7bbe-4631-93c9-515e3239f0aa does not exist Aug 10 23:03:47.980251 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a86b6d3b-5c6d-4650-a906-fdc96a0f733b'] Aug 10 23:03:47.980251 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:03:47.982204 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-8d942487-d8a5-4639-b62a-cc8d4886739e tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Returning 404 to user: Security group 8d006294-7bbe-4631-93c9-515e3239f0aa does not exist Aug 10 23:03:47.982204 n-d-850468-14 devstack@n-api.service[122632]: Neutron server returns request_ids: ['req-a86b6d3b-5c6d-4650-a906-fdc96a0f733b'] {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:03:47.983437 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-8d942487-d8a5-4639-b62a-cc8d4886739e tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/8d006294-7bbe-4631-93c9-515e3239f0aa" status: 404 len: 194 microversion: 2.1 time: 0.059875 Aug 10 23:03:47.984694 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 933/1887] 10.222.0.58 () {58 vars in 1272 bytes} [Wed Aug 10 23:03:47 2022] DELETE /compute/v2.1/os-security-groups/8d006294-7bbe-4631-93c9-515e3239f0aa => generated 194 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:03:47.990882 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-218e7ef0-1129-4857-b0eb-f0aa0d7276ce tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:47.991647 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-48ce93a6-6547-4863-890f-7e50b422636e tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c26e69e2274083916402c96d71c5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a6ac1a984c478da9337692485d16ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:47.993616 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-218e7ef0-1129-4857-b0eb-f0aa0d7276ce tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] [instance: 17b32f05-1f0e-473f-bfda-fab92a90b04f] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:48.000601 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-48ce93a6-6547-4863-890f-7e50b422636e tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] 10.222.0.58 "GET /compute/v2.1/servers/3f5e8cd2-6666-4206-a393-9f0507322402" status: 200 len: 1321 microversion: 2.1 time: 0.364352 Aug 10 23:03:48.000766 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-218e7ef0-1129-4857-b0eb-f0aa0d7276ce tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:48.003749 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-218e7ef0-1129-4857-b0eb-f0aa0d7276ce tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:48.004423 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-218e7ef0-1129-4857-b0eb-f0aa0d7276ce tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:48.005612 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-218e7ef0-1129-4857-b0eb-f0aa0d7276ce tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:48.006080 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-218e7ef0-1129-4857-b0eb-f0aa0d7276ce tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:48.006808 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-218e7ef0-1129-4857-b0eb-f0aa0d7276ce tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:48.015010 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 955/1888] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:03:47 2022] GET /compute/v2.1/servers/3f5e8cd2-6666-4206-a393-9f0507322402 => generated 1321 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:03:48.020635 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-60f9dc44-4b84-43ce-9d47-99a3db347cbd tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Calling method '.version_select at 0x7f847d65b5e0>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:48.025395 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:03:48.039050 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-218e7ef0-1129-4857-b0eb-f0aa0d7276ce tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] HTTP exception thrown: Instance 17b32f05-1f0e-473f-bfda-fab92a90b04f could not be found. Aug 10 23:03:48.045552 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-218e7ef0-1129-4857-b0eb-f0aa0d7276ce tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Request method failure captured: Aug 10 23:03:48.045552 n-d-850468-14 devstack@n-api.service[122632]: request: GET /compute/v2.1/servers/17b32f05-1f0e-473f-bfda-fab92a90b04f HTTP/1.1 Aug 10 23:03:48.045552 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:03:48.045552 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:03:48.045552 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:03:48.045552 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 23:03:48.045552 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:03:48.045552 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:03:48.045552 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:03:48.045552 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:03:48.045552 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9DkiAjWMnEScmXUQ4URpE929LR04Z8tVQFM7-HlbAmthzngpnguHOyLOUY0k3vhcWXMqybRYRnxQLljJds4eIyjIcnw25UUriDcSFQLJ0yAgBKlC5ig8XoT5HsrMNoi0tzD74DHerwRzKapIeqizBGLGMzal9OBH_ENocwnLGn23ebg Aug 10 23:03:48.045552 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:03:48.045552 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:03:48.045552 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:03:48.045552 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:03:48.045552 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:03:48.045552 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:03:48.045552 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 9e9cf3129a4e4f56a17bebf68b7bc42b Aug 10 23:03:48.045552 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-ListServersNegativeTestJSON-1516024484 Aug 10 23:03:48.045552 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:03:48.045552 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:03:48.047324 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9e9cf3129a4e4f56a17bebf68b7bc42b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9e9cf3129a4e4f56a17bebf68b7bc42b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/9e9cf3129a4e4f56a17bebf68b7bc42b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_9e9cf3129a4e4f56a17bebf68b7bc42b", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:03:48.047324 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-ListServersNegativeTestJSON-1516024484 Aug 10 23:03:48.047324 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 9e9cf3129a4e4f56a17bebf68b7bc42b Aug 10 23:03:48.047324 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1516024484 Aug 10 23:03:48.047324 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-ListServersNegativeTestJSON-1516024484-project Aug 10 23:03:48.047324 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:03:48.047324 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:03:48.047324 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: 890735b21f5d4764aefd789f74e00222 Aug 10 23:03:48.047324 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-ListServersNegativeTestJSON-1516024484-project Aug 10 23:03:48.047324 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:03:48.047324 n-d-850468-14 devstack@n-api.service[122632]: exception: Instance 17b32f05-1f0e-473f-bfda-fab92a90b04f could not be found. Aug 10 23:03:48.047324 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': '17b32f05-1f0e-473f-bfda-fab92a90b04f'} Aug 10 23:03:48.048328 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:03:48.048328 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:03:48.048328 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:03:48.048328 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:03:48.048328 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:03:48.048328 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:03:48.048328 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:03:48.048328 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:03:48.048328 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:03:48.048328 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:03:48.048328 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17b32f05-1f0e-473f-bfda-fab92a90b04f could not be found. Aug 10 23:03:48.048328 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:03:48.048328 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:03:48.048328 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:03:48.048328 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:03:48.048328 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:03:48.048328 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:03:48.048328 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:03:48.048328 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:03:48.048328 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:03:48.049820 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:03:48.049820 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:03:48.049820 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:03:48.049820 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:03:48.049820 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:03:48.049820 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:03:48.049820 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:03:48.049820 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17b32f05-1f0e-473f-bfda-fab92a90b04f could not be found. Aug 10 23:03:48.049820 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:03:48.049820 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:03:48.049820 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:03:48.049820 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:03:48.049820 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:03:48.049820 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:03:48.049820 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:03:48.049820 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:03:48.049820 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17b32f05-1f0e-473f-bfda-fab92a90b04f could not be found. Aug 10 23:03:48.049820 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:03:48.051493 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-218e7ef0-1129-4857-b0eb-f0aa0d7276ce tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Returning 404 to user: Instance 17b32f05-1f0e-473f-bfda-fab92a90b04f could not be found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:03:48.066948 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-218e7ef0-1129-4857-b0eb-f0aa0d7276ce tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] 10.222.0.58 "GET /compute/v2.1/servers/17b32f05-1f0e-473f-bfda-fab92a90b04f" status: 404 len: 111 microversion: 2.1 time: 0.063790 Aug 10 23:03:48.069187 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 934/1889] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:03:47 2022] GET /compute/v2.1/servers/17b32f05-1f0e-473f-bfda-fab92a90b04f => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:03:48.077889 n-d-850468-14 devstack@n-api.service[122633]: DEBUG neutronclient.v2_0.client [None req-60f9dc44-4b84-43ce-9d47-99a3db347cbd tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 9643f52d-6588-49da-be41-0e1ee1ca0e5f does not exist", "detail": ""}} {{(pid=122633) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 10 23:03:48.078559 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.network.security_group_api [None req-60f9dc44-4b84-43ce-9d47-99a3db347cbd tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Neutron security group 9643f52d-6588-49da-be41-0e1ee1ca0e5f not found {{(pid=122633) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 10 23:03:48.079114 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-60f9dc44-4b84-43ce-9d47-99a3db347cbd tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] HTTP exception thrown: Security group 9643f52d-6588-49da-be41-0e1ee1ca0e5f does not exist Aug 10 23:03:48.079114 n-d-850468-14 devstack@n-api.service[122633]: Neutron server returns request_ids: ['req-a9f6288b-b4b1-448a-8f9e-829393fc9562'] Aug 10 23:03:48.080402 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-0cb9747f-4e0b-4f2e-a9eb-ac8378eba5d4 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:48.081499 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-60f9dc44-4b84-43ce-9d47-99a3db347cbd tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Request method failure captured: Aug 10 23:03:48.081499 n-d-850468-14 devstack@n-api.service[122633]: request: DELETE /compute/v2.1/os-security-groups/9643f52d-6588-49da-be41-0e1ee1ca0e5f HTTP/1.1 Aug 10 23:03:48.081499 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:03:48.081499 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:03:48.081499 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:03:48.081499 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:03:48.081499 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:03:48.081499 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:03:48.081499 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:03:48.081499 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:03:48.081499 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9Dju6bcY6WgJPTWLWUJ0fX6JaJBRP8GkYZWFafNrDYn8ACaF-JC0t8YD4rSPFgG5Deze7mjmq2_rnPCZ1jpXNRGkHxz134mT5MqTqUm9UAyuVcbLtNQAiAf-L4A3117brPwKa_CN56-tZ47WT8aAPEON_2-WsEOp9qATqEToy30jo_s Aug 10 23:03:48.081499 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:03:48.081499 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:03:48.081499 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:03:48.081499 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:03:48.081499 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:03:48.081499 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:03:48.081499 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 707f869910b34768ae1a348cd0b5f284 Aug 10 23:03:48.081499 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-SecurityGroupsTestJSON-1406525704 Aug 10 23:03:48.081499 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:03:48.081499 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:03:48.083018 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/707f869910b34768ae1a348cd0b5f284"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/707f869910b34768ae1a348cd0b5f284"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/707f869910b34768ae1a348cd0b5f284"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_707f869910b34768ae1a348cd0b5f284", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:03:48.083018 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-SecurityGroupsTestJSON-1406525704 Aug 10 23:03:48.083018 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 707f869910b34768ae1a348cd0b5f284 Aug 10 23:03:48.083018 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1406525704 Aug 10 23:03:48.083018 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-SecurityGroupsTestJSON-1406525704-project Aug 10 23:03:48.083018 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:03:48.083018 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:03:48.083018 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: bfd6d8e6a8444f5b9fcf1cf8da242ac0 Aug 10 23:03:48.083018 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-SecurityGroupsTestJSON-1406525704-project Aug 10 23:03:48.083018 n-d-850468-14 devstack@n-api.service[122633]: method: Aug 10 23:03:48.083018 n-d-850468-14 devstack@n-api.service[122633]: exception: Security group 9643f52d-6588-49da-be41-0e1ee1ca0e5f does not exist Aug 10 23:03:48.083018 n-d-850468-14 devstack@n-api.service[122633]: Neutron server returns request_ids: ['req-a9f6288b-b4b1-448a-8f9e-829393fc9562'] Aug 10 23:03:48.083018 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': '9643f52d-6588-49da-be41-0e1ee1ca0e5f'} Aug 10 23:03:48.083969 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:03:48.083969 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:03:48.083969 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 10 23:03:48.083969 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 10 23:03:48.083969 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 23:03:48.083969 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 23:03:48.083969 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 10 23:03:48.083969 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 10 23:03:48.083969 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 23:03:48.083969 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 23:03:48.083969 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 23:03:48.083969 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 23:03:48.083969 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 23:03:48.083969 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 23:03:48.083969 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 23:03:48.083969 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 23:03:48.083969 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 23:03:48.083969 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 23:03:48.083969 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 10 23:03:48.085356 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 10 23:03:48.085356 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 23:03:48.085356 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 23:03:48.085356 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 10 23:03:48.085356 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 10 23:03:48.085356 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 10 23:03:48.085356 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 10 23:03:48.085356 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 9643f52d-6588-49da-be41-0e1ee1ca0e5f does not exist Aug 10 23:03:48.085356 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a9f6288b-b4b1-448a-8f9e-829393fc9562'] Aug 10 23:03:48.085356 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:03:48.085356 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:03:48.085356 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:03:48.085356 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:03:48.085356 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 10 23:03:48.085356 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 10 23:03:48.085356 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 10 23:03:48.085356 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 10 23:03:48.085356 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 9643f52d-6588-49da-be41-0e1ee1ca0e5f does not exist Aug 10 23:03:48.088213 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a9f6288b-b4b1-448a-8f9e-829393fc9562'] Aug 10 23:03:48.088213 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:03:48.088213 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:03:48.088213 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:03:48.088213 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:03:48.088213 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:03:48.088213 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:03:48.088213 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:03:48.088213 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:03:48.088213 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 23:03:48.088213 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 23:03:48.088213 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:03:48.088213 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:03:48.088213 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 10 23:03:48.088213 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 10 23:03:48.088213 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 9643f52d-6588-49da-be41-0e1ee1ca0e5f does not exist Aug 10 23:03:48.088213 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a9f6288b-b4b1-448a-8f9e-829393fc9562'] Aug 10 23:03:48.088213 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:03:48.088213 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:03:48.088213 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:03:48.088213 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:03:48.091622 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:03:48.091622 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:03:48.091622 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:03:48.091622 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:03:48.091622 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 9643f52d-6588-49da-be41-0e1ee1ca0e5f does not exist Aug 10 23:03:48.091622 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-a9f6288b-b4b1-448a-8f9e-829393fc9562'] Aug 10 23:03:48.091622 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:03:48.092825 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-0cb9747f-4e0b-4f2e-a9eb-ac8378eba5d4 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] [instance: 63d2bd74-d060-4925-9323-b39d5131f958] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:48.093286 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-60f9dc44-4b84-43ce-9d47-99a3db347cbd tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Returning 404 to user: Security group 9643f52d-6588-49da-be41-0e1ee1ca0e5f does not exist Aug 10 23:03:48.093286 n-d-850468-14 devstack@n-api.service[122633]: Neutron server returns request_ids: ['req-a9f6288b-b4b1-448a-8f9e-829393fc9562'] {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:03:48.093286 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-60f9dc44-4b84-43ce-9d47-99a3db347cbd tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/9643f52d-6588-49da-be41-0e1ee1ca0e5f" status: 404 len: 194 microversion: 2.1 time: 0.067584 Aug 10 23:03:48.093286 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 956/1890] 10.222.0.58 () {58 vars in 1272 bytes} [Wed Aug 10 23:03:48 2022] DELETE /compute/v2.1/os-security-groups/9643f52d-6588-49da-be41-0e1ee1ca0e5f => generated 194 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:03:48.103194 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0cb9747f-4e0b-4f2e-a9eb-ac8378eba5d4 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:48.103815 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0cb9747f-4e0b-4f2e-a9eb-ac8378eba5d4 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:48.104164 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-f5f290f4-3d92-4709-b80b-de06dd9d2b37 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:48.104289 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0cb9747f-4e0b-4f2e-a9eb-ac8378eba5d4 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:48.104807 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-f5f290f4-3d92-4709-b80b-de06dd9d2b37 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] [instance: 6bf5e469-d129-4daa-93f8-36661ec153a2] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:48.105030 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0cb9747f-4e0b-4f2e-a9eb-ac8378eba5d4 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:48.107481 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0cb9747f-4e0b-4f2e-a9eb-ac8378eba5d4 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:48.108981 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0cb9747f-4e0b-4f2e-a9eb-ac8378eba5d4 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:48.124591 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f5f290f4-3d92-4709-b80b-de06dd9d2b37 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:48.125389 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f5f290f4-3d92-4709-b80b-de06dd9d2b37 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:48.126076 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f5f290f4-3d92-4709-b80b-de06dd9d2b37 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:48.133934 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f5f290f4-3d92-4709-b80b-de06dd9d2b37 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:48.134807 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f5f290f4-3d92-4709-b80b-de06dd9d2b37 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:48.135275 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f5f290f4-3d92-4709-b80b-de06dd9d2b37 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:48.460627 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-0cb9747f-4e0b-4f2e-a9eb-ac8378eba5d4 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632904331d024d9b8e4d3660dff2cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ed0bdee3aa4013bd9219069bda558c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:48.469482 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-0cb9747f-4e0b-4f2e-a9eb-ac8378eba5d4 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] 10.222.0.58 "GET /compute/v2.1/servers/63d2bd74-d060-4925-9323-b39d5131f958" status: 200 len: 1392 microversion: 2.1 time: 0.398563 Aug 10 23:03:48.473351 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 935/1891] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:03:48 2022] GET /compute/v2.1/servers/63d2bd74-d060-4925-9323-b39d5131f958 => generated 1392 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:03:48.491652 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-92b0d3a4-7c9c-4ea3-9aba-9ca4ebeeb7d9 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:48.493262 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-92b0d3a4-7c9c-4ea3-9aba-9ca4ebeeb7d9 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] [instance: 9725dd3f-f5a6-496e-99c5-66ee08b6c1f7] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:48.500213 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-92b0d3a4-7c9c-4ea3-9aba-9ca4ebeeb7d9 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:48.504495 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-92b0d3a4-7c9c-4ea3-9aba-9ca4ebeeb7d9 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:48.505623 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-92b0d3a4-7c9c-4ea3-9aba-9ca4ebeeb7d9 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:48.506815 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-92b0d3a4-7c9c-4ea3-9aba-9ca4ebeeb7d9 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:48.511218 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-92b0d3a4-7c9c-4ea3-9aba-9ca4ebeeb7d9 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:48.512033 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-92b0d3a4-7c9c-4ea3-9aba-9ca4ebeeb7d9 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:48.591503 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=6 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:03:48.599270 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-92b0d3a4-7c9c-4ea3-9aba-9ca4ebeeb7d9 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] [instance: 9725dd3f-f5a6-496e-99c5-66ee08b6c1f7] Going to try to terminate instance {{(pid=122632) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:03:48.883128 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-92b0d3a4-7c9c-4ea3-9aba-9ca4ebeeb7d9 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] 10.222.0.58 "DELETE /compute/v2.1/servers/9725dd3f-f5a6-496e-99c5-66ee08b6c1f7" status: 204 len: 0 microversion: 2.1 time: 0.408215 Aug 10 23:03:48.893008 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 936/1892] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:03:48 2022] DELETE /compute/v2.1/servers/9725dd3f-f5a6-496e-99c5-66ee08b6c1f7 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:03:48.902186 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-3f175f9f-fde3-475d-a02e-6fed2315d299 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:48.902925 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-3f175f9f-fde3-475d-a02e-6fed2315d299 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] [instance: baf47131-7a59-4588-9ce6-113709fa8480] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:48.937007 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3f175f9f-fde3-475d-a02e-6fed2315d299 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:48.937504 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3f175f9f-fde3-475d-a02e-6fed2315d299 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:48.945165 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3f175f9f-fde3-475d-a02e-6fed2315d299 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:48.945970 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3f175f9f-fde3-475d-a02e-6fed2315d299 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:48.947032 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3f175f9f-fde3-475d-a02e-6fed2315d299 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:48.947473 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3f175f9f-fde3-475d-a02e-6fed2315d299 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:49.053845 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3f175f9f-fde3-475d-a02e-6fed2315d299 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:49.054353 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3f175f9f-fde3-475d-a02e-6fed2315d299 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:49.054802 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3f175f9f-fde3-475d-a02e-6fed2315d299 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:49.055286 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.objects.instance [None req-3f175f9f-fde3-475d-a02e-6fed2315d299 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lazy-loading 'fault' on Instance uuid baf47131-7a59-4588-9ce6-113709fa8480 {{(pid=122632) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:03:49.073982 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-f5f290f4-3d92-4709-b80b-de06dd9d2b37 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890735b21f5d4764aefd789f74e00222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9cf3129a4e4f56a17bebf68b7bc42b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:49.088514 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-f5f290f4-3d92-4709-b80b-de06dd9d2b37 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] 10.222.0.58 "GET /compute/v2.1/servers/6bf5e469-d129-4daa-93f8-36661ec153a2" status: 200 len: 1520 microversion: 2.1 time: 0.997140 Aug 10 23:03:49.089118 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 957/1893] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:03:48 2022] GET /compute/v2.1/servers/6bf5e469-d129-4daa-93f8-36661ec153a2 => generated 1520 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:03:49.109640 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-3f175f9f-fde3-475d-a02e-6fed2315d299 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:49.113808 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-8d2cbcee-3352-456f-9210-9455050447e1 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:49.114297 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-8d2cbcee-3352-456f-9210-9455050447e1 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] [instance: 9725dd3f-f5a6-496e-99c5-66ee08b6c1f7] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:49.121613 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-3f175f9f-fde3-475d-a02e-6fed2315d299 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:49.131946 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-3f175f9f-fde3-475d-a02e-6fed2315d299 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:49.134133 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-3f175f9f-fde3-475d-a02e-6fed2315d299 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] 10.222.0.58 "GET /compute/v2.1/servers/baf47131-7a59-4588-9ce6-113709fa8480" status: 200 len: 1352 microversion: 2.25 time: 0.238359 Aug 10 23:03:49.134420 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8d2cbcee-3352-456f-9210-9455050447e1 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:49.135009 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8d2cbcee-3352-456f-9210-9455050447e1 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:49.135728 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 937/1894] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:03:48 2022] GET /compute/v2.1/servers/baf47131-7a59-4588-9ce6-113709fa8480 => generated 1352 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:03:49.136645 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8d2cbcee-3352-456f-9210-9455050447e1 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:49.140120 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8d2cbcee-3352-456f-9210-9455050447e1 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:49.144611 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-49959832-0def-4680-a527-9ae80b9b9290 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:49.145470 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-49959832-0def-4680-a527-9ae80b9b9290 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] [instance: 3f5e8cd2-6666-4206-a393-9f0507322402] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:49.145608 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8d2cbcee-3352-456f-9210-9455050447e1 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:49.146090 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8d2cbcee-3352-456f-9210-9455050447e1 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:49.174683 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-49959832-0def-4680-a527-9ae80b9b9290 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:49.185613 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-49959832-0def-4680-a527-9ae80b9b9290 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:49.186262 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-49959832-0def-4680-a527-9ae80b9b9290 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:49.187212 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-49959832-0def-4680-a527-9ae80b9b9290 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:49.187837 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-49959832-0def-4680-a527-9ae80b9b9290 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:49.188437 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-49959832-0def-4680-a527-9ae80b9b9290 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:49.633073 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-49959832-0def-4680-a527-9ae80b9b9290 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c26e69e2274083916402c96d71c5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a6ac1a984c478da9337692485d16ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:49.643493 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-49959832-0def-4680-a527-9ae80b9b9290 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] 10.222.0.58 "GET /compute/v2.1/servers/3f5e8cd2-6666-4206-a393-9f0507322402" status: 200 len: 1321 microversion: 2.1 time: 0.506291 Aug 10 23:03:49.644526 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 938/1895] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:03:49 2022] GET /compute/v2.1/servers/3f5e8cd2-6666-4206-a393-9f0507322402 => generated 1321 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:03:49.650859 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-9e6de026-de81-45b6-bf9b-ea102c589849 req-7c75cfe5-1fe1-485f-be14-12e08eafa98c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "baf47131-7a59-4588-9ce6-113709fa8480", "name": "network-vif-deleted", "tag": "2da43b40-f84d-4748-92ca-1bd0d92e6665"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:03:49.665295 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-9e6de026-de81-45b6-bf9b-ea102c589849 req-7c75cfe5-1fe1-485f-be14-12e08eafa98c service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:49.666304 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-9e6de026-de81-45b6-bf9b-ea102c589849 req-7c75cfe5-1fe1-485f-be14-12e08eafa98c service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:49.666975 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-9e6de026-de81-45b6-bf9b-ea102c589849 req-7c75cfe5-1fe1-485f-be14-12e08eafa98c service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:49.689997 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-9e6de026-de81-45b6-bf9b-ea102c589849 req-7c75cfe5-1fe1-485f-be14-12e08eafa98c service nova] Creating event network-vif-deleted:2da43b40-f84d-4748-92ca-1bd0d92e6665 for instance baf47131-7a59-4588-9ce6-113709fa8480 on n-h2-850468-14 Aug 10 23:03:49.698185 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-9e6de026-de81-45b6-bf9b-ea102c589849 req-7c75cfe5-1fe1-485f-be14-12e08eafa98c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051898 Aug 10 23:03:49.699221 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 939/1896] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:03:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:03:49.706923 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-4189b535-f474-4aea-9bd3-75241cc2d53a tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:49.710171 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-4189b535-f474-4aea-9bd3-75241cc2d53a tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] [instance: 63d2bd74-d060-4925-9323-b39d5131f958] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:49.724259 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4189b535-f474-4aea-9bd3-75241cc2d53a tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:49.724994 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4189b535-f474-4aea-9bd3-75241cc2d53a tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:49.725394 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4189b535-f474-4aea-9bd3-75241cc2d53a tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:49.727142 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4189b535-f474-4aea-9bd3-75241cc2d53a tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:49.728713 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4189b535-f474-4aea-9bd3-75241cc2d53a tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:49.729581 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4189b535-f474-4aea-9bd3-75241cc2d53a tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:49.761078 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-8d2cbcee-3352-456f-9210-9455050447e1 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfd6d8e6a8444f5b9fcf1cf8da242ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707f869910b34768ae1a348cd0b5f284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:49.773348 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-8d2cbcee-3352-456f-9210-9455050447e1 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] 10.222.0.58 "GET /compute/v2.1/servers/9725dd3f-f5a6-496e-99c5-66ee08b6c1f7" status: 200 len: 1646 microversion: 2.1 time: 0.671011 Aug 10 23:03:49.776442 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 958/1897] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:03:49 2022] GET /compute/v2.1/servers/9725dd3f-f5a6-496e-99c5-66ee08b6c1f7 => generated 1646 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:03:50.039654 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-4189b535-f474-4aea-9bd3-75241cc2d53a tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632904331d024d9b8e4d3660dff2cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ed0bdee3aa4013bd9219069bda558c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:50.058535 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-4189b535-f474-4aea-9bd3-75241cc2d53a tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] 10.222.0.58 "GET /compute/v2.1/servers/63d2bd74-d060-4925-9323-b39d5131f958" status: 200 len: 1392 microversion: 2.1 time: 0.355378 Aug 10 23:03:50.074885 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 940/1898] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:03:49 2022] GET /compute/v2.1/servers/63d2bd74-d060-4925-9323-b39d5131f958 => generated 1392 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:03:50.114392 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-934795ba-2d11-4e70-9626-c78913d9b8a7 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:50.115280 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-934795ba-2d11-4e70-9626-c78913d9b8a7 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] [instance: 6bf5e469-d129-4daa-93f8-36661ec153a2] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:50.136828 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-934795ba-2d11-4e70-9626-c78913d9b8a7 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:50.138110 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-934795ba-2d11-4e70-9626-c78913d9b8a7 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:50.139273 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-934795ba-2d11-4e70-9626-c78913d9b8a7 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:50.141499 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-934795ba-2d11-4e70-9626-c78913d9b8a7 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:50.142374 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-934795ba-2d11-4e70-9626-c78913d9b8a7 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:50.143113 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-934795ba-2d11-4e70-9626-c78913d9b8a7 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:50.166036 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-bd036b04-7dbb-4a0b-85a3-987da62ac315 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:50.166708 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-bd036b04-7dbb-4a0b-85a3-987da62ac315 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] [instance: baf47131-7a59-4588-9ce6-113709fa8480] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:50.185658 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bd036b04-7dbb-4a0b-85a3-987da62ac315 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:50.186158 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bd036b04-7dbb-4a0b-85a3-987da62ac315 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:50.186607 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bd036b04-7dbb-4a0b-85a3-987da62ac315 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:50.196396 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bd036b04-7dbb-4a0b-85a3-987da62ac315 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:50.197959 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bd036b04-7dbb-4a0b-85a3-987da62ac315 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:50.199007 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bd036b04-7dbb-4a0b-85a3-987da62ac315 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:50.280064 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bd036b04-7dbb-4a0b-85a3-987da62ac315 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:50.280600 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bd036b04-7dbb-4a0b-85a3-987da62ac315 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:50.281041 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bd036b04-7dbb-4a0b-85a3-987da62ac315 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:50.281574 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.objects.instance [None req-bd036b04-7dbb-4a0b-85a3-987da62ac315 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lazy-loading 'fault' on Instance uuid baf47131-7a59-4588-9ce6-113709fa8480 {{(pid=122632) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:03:50.348615 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-bd036b04-7dbb-4a0b-85a3-987da62ac315 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:50.363247 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-bd036b04-7dbb-4a0b-85a3-987da62ac315 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:50.366890 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-bd036b04-7dbb-4a0b-85a3-987da62ac315 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '394f0e6843424c7b83d2dfff61f66ede', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4355fdc73c84fa2baf0d5c9a33e69d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:50.368580 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-bd036b04-7dbb-4a0b-85a3-987da62ac315 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] 10.222.0.58 "GET /compute/v2.1/servers/baf47131-7a59-4588-9ce6-113709fa8480" status: 200 len: 1352 microversion: 2.25 time: 0.206973 Aug 10 23:03:50.369354 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 941/1899] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:03:50 2022] GET /compute/v2.1/servers/baf47131-7a59-4588-9ce6-113709fa8480 => generated 1352 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 23:03:50.468454 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-ed2565ff-6b9f-4c7c-8da3-6dbb85bcfd73 req-ff8c52dd-e112-4f80-a40f-4e58c76eb0da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bf5e469-d129-4daa-93f8-36661ec153a2", "name": "network-vif-deleted", "tag": "d6e8df11-a924-4886-8d4e-e5c76996d805"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:03:50.491533 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-ed2565ff-6b9f-4c7c-8da3-6dbb85bcfd73 req-ff8c52dd-e112-4f80-a40f-4e58c76eb0da service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:50.492106 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-ed2565ff-6b9f-4c7c-8da3-6dbb85bcfd73 req-ff8c52dd-e112-4f80-a40f-4e58c76eb0da service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:50.494737 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-ed2565ff-6b9f-4c7c-8da3-6dbb85bcfd73 req-ff8c52dd-e112-4f80-a40f-4e58c76eb0da service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:50.525905 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-ed2565ff-6b9f-4c7c-8da3-6dbb85bcfd73 req-ff8c52dd-e112-4f80-a40f-4e58c76eb0da service nova] Creating event network-vif-deleted:d6e8df11-a924-4886-8d4e-e5c76996d805 for instance 6bf5e469-d129-4daa-93f8-36661ec153a2 on n-h1-850468-14 Aug 10 23:03:50.536907 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-ed2565ff-6b9f-4c7c-8da3-6dbb85bcfd73 req-ff8c52dd-e112-4f80-a40f-4e58c76eb0da service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072372 Aug 10 23:03:50.540573 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 942/1900] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:03:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 23:03:50.667555 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-a22e0d9a-2c24-4235-96aa-685ca12f4245 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:50.669004 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-a22e0d9a-2c24-4235-96aa-685ca12f4245 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] [instance: 3f5e8cd2-6666-4206-a393-9f0507322402] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:50.684173 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a22e0d9a-2c24-4235-96aa-685ca12f4245 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:50.699999 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a22e0d9a-2c24-4235-96aa-685ca12f4245 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:50.700812 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a22e0d9a-2c24-4235-96aa-685ca12f4245 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:50.701855 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a22e0d9a-2c24-4235-96aa-685ca12f4245 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:50.704045 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a22e0d9a-2c24-4235-96aa-685ca12f4245 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:50.704721 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a22e0d9a-2c24-4235-96aa-685ca12f4245 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:50.816746 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-934795ba-2d11-4e70-9626-c78913d9b8a7 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890735b21f5d4764aefd789f74e00222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9cf3129a4e4f56a17bebf68b7bc42b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:50.827522 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-934795ba-2d11-4e70-9626-c78913d9b8a7 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] 10.222.0.58 "GET /compute/v2.1/servers/6bf5e469-d129-4daa-93f8-36661ec153a2" status: 200 len: 1520 microversion: 2.1 time: 0.717685 Aug 10 23:03:50.830126 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 959/1901] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:03:50 2022] GET /compute/v2.1/servers/6bf5e469-d129-4daa-93f8-36661ec153a2 => generated 1520 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:03:50.843546 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-214149e5-b903-4b21-83cc-c3d0602f185c tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:50.844608 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-214149e5-b903-4b21-83cc-c3d0602f185c tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] [instance: 9725dd3f-f5a6-496e-99c5-66ee08b6c1f7] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:50.860072 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-214149e5-b903-4b21-83cc-c3d0602f185c tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:50.860574 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-214149e5-b903-4b21-83cc-c3d0602f185c tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:50.863358 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-214149e5-b903-4b21-83cc-c3d0602f185c tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:50.865419 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-214149e5-b903-4b21-83cc-c3d0602f185c tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:50.866890 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-214149e5-b903-4b21-83cc-c3d0602f185c tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:50.869240 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-214149e5-b903-4b21-83cc-c3d0602f185c tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:51.086268 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-a22e0d9a-2c24-4235-96aa-685ca12f4245 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c26e69e2274083916402c96d71c5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a6ac1a984c478da9337692485d16ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:51.097472 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-a22e0d9a-2c24-4235-96aa-685ca12f4245 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] 10.222.0.58 "GET /compute/v2.1/servers/3f5e8cd2-6666-4206-a393-9f0507322402" status: 200 len: 1321 microversion: 2.1 time: 0.435581 Aug 10 23:03:51.098422 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 943/1902] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:03:50 2022] GET /compute/v2.1/servers/3f5e8cd2-6666-4206-a393-9f0507322402 => generated 1321 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:03:51.107529 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-63416f7f-654d-4ff9-a160-b5293aaf233f tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:51.108154 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-63416f7f-654d-4ff9-a160-b5293aaf233f tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] [instance: 63d2bd74-d060-4925-9323-b39d5131f958] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:51.128197 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-63416f7f-654d-4ff9-a160-b5293aaf233f tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:51.128612 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-63416f7f-654d-4ff9-a160-b5293aaf233f tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:51.132293 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-63416f7f-654d-4ff9-a160-b5293aaf233f tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:51.134387 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-63416f7f-654d-4ff9-a160-b5293aaf233f tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:51.139317 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-63416f7f-654d-4ff9-a160-b5293aaf233f tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:51.141079 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-63416f7f-654d-4ff9-a160-b5293aaf233f tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:51.578089 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-214149e5-b903-4b21-83cc-c3d0602f185c tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfd6d8e6a8444f5b9fcf1cf8da242ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707f869910b34768ae1a348cd0b5f284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:51.592595 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-214149e5-b903-4b21-83cc-c3d0602f185c tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] 10.222.0.58 "GET /compute/v2.1/servers/9725dd3f-f5a6-496e-99c5-66ee08b6c1f7" status: 200 len: 1646 microversion: 2.1 time: 0.759902 Aug 10 23:03:51.595120 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 960/1903] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:03:50 2022] GET /compute/v2.1/servers/9725dd3f-f5a6-496e-99c5-66ee08b6c1f7 => generated 1646 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:03:51.603672 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-63792cd3-9b01-43f0-b3cd-f12a34ce7da5 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:51.604818 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-63792cd3-9b01-43f0-b3cd-f12a34ce7da5 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] [instance: baf47131-7a59-4588-9ce6-113709fa8480] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:51.628410 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-63792cd3-9b01-43f0-b3cd-f12a34ce7da5 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:51.629468 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-63792cd3-9b01-43f0-b3cd-f12a34ce7da5 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:51.631174 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-63792cd3-9b01-43f0-b3cd-f12a34ce7da5 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:51.632128 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-63792cd3-9b01-43f0-b3cd-f12a34ce7da5 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:51.636416 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-63792cd3-9b01-43f0-b3cd-f12a34ce7da5 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:51.637214 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-63792cd3-9b01-43f0-b3cd-f12a34ce7da5 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:51.676683 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-63792cd3-9b01-43f0-b3cd-f12a34ce7da5 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] HTTP exception thrown: Instance baf47131-7a59-4588-9ce6-113709fa8480 could not be found. Aug 10 23:03:51.684214 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-63792cd3-9b01-43f0-b3cd-f12a34ce7da5 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Request method failure captured: Aug 10 23:03:51.684214 n-d-850468-14 devstack@n-api.service[122633]: request: GET /compute/v2.1/servers/baf47131-7a59-4588-9ce6-113709fa8480 HTTP/1.1 Aug 10 23:03:51.684214 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:03:51.684214 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:03:51.684214 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:03:51.684214 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:03:51.684214 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:03:51.684214 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:03:51.684214 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:03:51.684214 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:03:51.684214 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9DeXYkYLR9CQVdccVgq1hPt0DrO7Y-Tqsq3tzOpEmY8RKTZKEbj7rqP5rBgNFt9k52KejWIWfCOOWUkHukYq1jM7AQrc94vGo1O5nAgAlIU3PqIOLdYIPmLGjLIoW_vctUlJlDlwGinCVbduLE5oYkTQOwNuHIPOOO5NqXrRvcyb7gQ Aug 10 23:03:51.684214 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:03:51.684214 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:03:51.684214 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:03:51.684214 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:03:51.684214 n-d-850468-14 devstack@n-api.service[122633]: X-Openstack-Nova-Api-Version: 2.25 Aug 10 23:03:51.684214 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:03:51.684214 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:03:51.684214 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: b4355fdc73c84fa2baf0d5c9a33e69d5 Aug 10 23:03:51.684214 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-1885042872 Aug 10 23:03:51.684214 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:03:51.684214 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:03:51.686085 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b4355fdc73c84fa2baf0d5c9a33e69d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b4355fdc73c84fa2baf0d5c9a33e69d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b4355fdc73c84fa2baf0d5c9a33e69d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b4355fdc73c84fa2baf0d5c9a33e69d5", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:03:51.686085 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-1885042872 Aug 10 23:03:51.686085 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: b4355fdc73c84fa2baf0d5c9a33e69d5 Aug 10 23:03:51.686085 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-1885042872 Aug 10 23:03:51.686085 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-LiveAutoBlockMigrationV225Test-1885042872-project Aug 10 23:03:51.686085 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:03:51.686085 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:03:51.686085 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 394f0e6843424c7b83d2dfff61f66ede Aug 10 23:03:51.686085 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-1885042872-project Aug 10 23:03:51.686085 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:03:51.686085 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance baf47131-7a59-4588-9ce6-113709fa8480 could not be found. Aug 10 23:03:51.686085 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': 'baf47131-7a59-4588-9ce6-113709fa8480'} Aug 10 23:03:51.687105 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:03:51.687105 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:03:51.687105 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:03:51.687105 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:03:51.687105 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:03:51.687105 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:03:51.687105 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:03:51.687105 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:03:51.687105 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:03:51.687105 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:03:51.687105 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance baf47131-7a59-4588-9ce6-113709fa8480 could not be found. Aug 10 23:03:51.687105 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:03:51.687105 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:03:51.687105 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:03:51.687105 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:03:51.687105 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:03:51.687105 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:03:51.687105 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:03:51.687105 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:03:51.687105 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:03:51.688692 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:03:51.688692 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:03:51.688692 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:03:51.688692 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:03:51.688692 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:03:51.688692 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:03:51.688692 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:03:51.688692 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance baf47131-7a59-4588-9ce6-113709fa8480 could not be found. Aug 10 23:03:51.688692 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:03:51.688692 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:03:51.688692 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:03:51.688692 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:03:51.688692 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:03:51.688692 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:03:51.688692 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:03:51.688692 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:03:51.688692 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance baf47131-7a59-4588-9ce6-113709fa8480 could not be found. Aug 10 23:03:51.688692 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:03:51.696210 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-63792cd3-9b01-43f0-b3cd-f12a34ce7da5 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] Returning 404 to user: Instance baf47131-7a59-4588-9ce6-113709fa8480 could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:03:51.698601 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-63792cd3-9b01-43f0-b3cd-f12a34ce7da5 tempest-LiveAutoBlockMigrationV225Test-1885042872 tempest-LiveAutoBlockMigrationV225Test-1885042872-project] 10.222.0.58 "GET /compute/v2.1/servers/baf47131-7a59-4588-9ce6-113709fa8480" status: 404 len: 111 microversion: 2.25 time: 0.101608 Aug 10 23:03:51.699759 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 961/1904] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:03:51 2022] GET /compute/v2.1/servers/baf47131-7a59-4588-9ce6-113709fa8480 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 10 23:03:51.850654 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-eeaeadca-6707-461a-a6f2-57370a8f28d7 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:51.851725 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-eeaeadca-6707-461a-a6f2-57370a8f28d7 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] [instance: 6bf5e469-d129-4daa-93f8-36661ec153a2] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:51.864862 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-eeaeadca-6707-461a-a6f2-57370a8f28d7 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:51.866694 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-eeaeadca-6707-461a-a6f2-57370a8f28d7 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:51.872098 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-eeaeadca-6707-461a-a6f2-57370a8f28d7 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:51.874011 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-eeaeadca-6707-461a-a6f2-57370a8f28d7 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:51.875106 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-eeaeadca-6707-461a-a6f2-57370a8f28d7 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:51.876219 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-eeaeadca-6707-461a-a6f2-57370a8f28d7 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:51.915982 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-63416f7f-654d-4ff9-a160-b5293aaf233f tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632904331d024d9b8e4d3660dff2cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ed0bdee3aa4013bd9219069bda558c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:51.923115 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-eeaeadca-6707-461a-a6f2-57370a8f28d7 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] HTTP exception thrown: Instance 6bf5e469-d129-4daa-93f8-36661ec153a2 could not be found. Aug 10 23:03:51.926984 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-63416f7f-654d-4ff9-a160-b5293aaf233f tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] 10.222.0.58 "GET /compute/v2.1/servers/63d2bd74-d060-4925-9323-b39d5131f958" status: 200 len: 1392 microversion: 2.1 time: 0.827138 Aug 10 23:03:51.928037 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-eeaeadca-6707-461a-a6f2-57370a8f28d7 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Request method failure captured: Aug 10 23:03:51.928037 n-d-850468-14 devstack@n-api.service[122633]: request: GET /compute/v2.1/servers/6bf5e469-d129-4daa-93f8-36661ec153a2 HTTP/1.1 Aug 10 23:03:51.928037 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:03:51.928037 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:03:51.928037 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:03:51.928037 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:03:51.928037 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:03:51.928037 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:03:51.928037 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:03:51.928037 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:03:51.928037 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9DkiAjWMnEScmXUQ4URpE929LR04Z8tVQFM7-HlbAmthzngpnguHOyLOUY0k3vhcWXMqybRYRnxQLljJds4eIyjIcnw25UUriDcSFQLJ0yAgBKlC5ig8XoT5HsrMNoi0tzD74DHerwRzKapIeqizBGLGMzal9OBH_ENocwnLGn23ebg Aug 10 23:03:51.928037 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:03:51.928037 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:03:51.928037 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:03:51.928037 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:03:51.928037 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:03:51.928037 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:03:51.928037 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 9e9cf3129a4e4f56a17bebf68b7bc42b Aug 10 23:03:51.928037 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-ListServersNegativeTestJSON-1516024484 Aug 10 23:03:51.928037 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:03:51.928037 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:03:51.931170 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9e9cf3129a4e4f56a17bebf68b7bc42b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9e9cf3129a4e4f56a17bebf68b7bc42b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/9e9cf3129a4e4f56a17bebf68b7bc42b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_9e9cf3129a4e4f56a17bebf68b7bc42b", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:03:51.931170 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-ListServersNegativeTestJSON-1516024484 Aug 10 23:03:51.931170 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 9e9cf3129a4e4f56a17bebf68b7bc42b Aug 10 23:03:51.931170 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1516024484 Aug 10 23:03:51.931170 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-ListServersNegativeTestJSON-1516024484-project Aug 10 23:03:51.931170 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:03:51.931170 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:03:51.931170 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 890735b21f5d4764aefd789f74e00222 Aug 10 23:03:51.931170 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-ListServersNegativeTestJSON-1516024484-project Aug 10 23:03:51.931170 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:03:51.931170 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance 6bf5e469-d129-4daa-93f8-36661ec153a2 could not be found. Aug 10 23:03:51.931170 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': '6bf5e469-d129-4daa-93f8-36661ec153a2'} Aug 10 23:03:51.932305 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:03:51.932305 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:03:51.932305 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:03:51.932305 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:03:51.932305 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:03:51.932305 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:03:51.932305 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:03:51.932305 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:03:51.932305 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:03:51.932305 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:03:51.932305 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6bf5e469-d129-4daa-93f8-36661ec153a2 could not be found. Aug 10 23:03:51.932305 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:03:51.932305 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:03:51.932305 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:03:51.932305 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:03:51.932305 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:03:51.932305 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:03:51.932305 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:03:51.932305 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:03:51.932305 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:03:51.934112 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:03:51.934112 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:03:51.934112 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:03:51.934112 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:03:51.934112 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:03:51.934112 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:03:51.934112 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:03:51.934112 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6bf5e469-d129-4daa-93f8-36661ec153a2 could not be found. Aug 10 23:03:51.934112 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:03:51.934112 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:03:51.934112 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:03:51.934112 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:03:51.934112 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:03:51.934112 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:03:51.934112 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:03:51.934112 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:03:51.934112 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6bf5e469-d129-4daa-93f8-36661ec153a2 could not be found. Aug 10 23:03:51.934112 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:03:51.935732 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-eeaeadca-6707-461a-a6f2-57370a8f28d7 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Returning 404 to user: Instance 6bf5e469-d129-4daa-93f8-36661ec153a2 could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:03:51.935732 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-eeaeadca-6707-461a-a6f2-57370a8f28d7 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] 10.222.0.58 "GET /compute/v2.1/servers/6bf5e469-d129-4daa-93f8-36661ec153a2" status: 404 len: 111 microversion: 2.1 time: 0.083399 Aug 10 23:03:51.937443 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 962/1905] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:03:51 2022] GET /compute/v2.1/servers/6bf5e469-d129-4daa-93f8-36661ec153a2 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:03:51.941891 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 944/1906] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:03:51 2022] GET /compute/v2.1/servers/63d2bd74-d060-4925-9323-b39d5131f958 => generated 1392 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:03:51.966610 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-cbbda832-5091-4818-b1a2-f979efd9110f tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:51.967266 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-cbbda832-5091-4818-b1a2-f979efd9110f tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] [instance: 10ede6f4-625a-4c5a-a5d6-d7d0f2476dee] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:51.985716 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cbbda832-5091-4818-b1a2-f979efd9110f tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:51.986664 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cbbda832-5091-4818-b1a2-f979efd9110f tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:51.987127 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cbbda832-5091-4818-b1a2-f979efd9110f tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:51.987945 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cbbda832-5091-4818-b1a2-f979efd9110f tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:51.988560 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cbbda832-5091-4818-b1a2-f979efd9110f tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:51.996935 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cbbda832-5091-4818-b1a2-f979efd9110f tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:52.118046 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-537dccad-39d3-4e80-afed-dd034cfcd7bc tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:52.119187 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-537dccad-39d3-4e80-afed-dd034cfcd7bc tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] [instance: 3f5e8cd2-6666-4206-a393-9f0507322402] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:52.128401 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-537dccad-39d3-4e80-afed-dd034cfcd7bc tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:52.128896 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-537dccad-39d3-4e80-afed-dd034cfcd7bc tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:52.129342 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-537dccad-39d3-4e80-afed-dd034cfcd7bc tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:52.130057 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-537dccad-39d3-4e80-afed-dd034cfcd7bc tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:52.130514 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-537dccad-39d3-4e80-afed-dd034cfcd7bc tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:52.130983 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-537dccad-39d3-4e80-afed-dd034cfcd7bc tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:52.619836 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-cbbda832-5091-4818-b1a2-f979efd9110f tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890735b21f5d4764aefd789f74e00222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9cf3129a4e4f56a17bebf68b7bc42b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:52.630500 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-cbbda832-5091-4818-b1a2-f979efd9110f tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] 10.222.0.58 "GET /compute/v2.1/servers/10ede6f4-625a-4c5a-a5d6-d7d0f2476dee" status: 200 len: 1520 microversion: 2.1 time: 0.674405 Aug 10 23:03:52.647603 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 963/1907] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:03:51 2022] GET /compute/v2.1/servers/10ede6f4-625a-4c5a-a5d6-d7d0f2476dee => generated 1520 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:03:52.657228 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-9fc291bc-9169-4d95-b84a-c79084c09738 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:52.659377 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-9fc291bc-9169-4d95-b84a-c79084c09738 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] [instance: 9725dd3f-f5a6-496e-99c5-66ee08b6c1f7] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:52.668215 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-537dccad-39d3-4e80-afed-dd034cfcd7bc tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c26e69e2274083916402c96d71c5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a6ac1a984c478da9337692485d16ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:52.672866 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9fc291bc-9169-4d95-b84a-c79084c09738 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:52.674896 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9fc291bc-9169-4d95-b84a-c79084c09738 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:52.676185 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9fc291bc-9169-4d95-b84a-c79084c09738 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:52.677018 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9fc291bc-9169-4d95-b84a-c79084c09738 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:52.677747 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9fc291bc-9169-4d95-b84a-c79084c09738 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:52.679963 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9fc291bc-9169-4d95-b84a-c79084c09738 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:52.680276 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-537dccad-39d3-4e80-afed-dd034cfcd7bc tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] 10.222.0.58 "GET /compute/v2.1/servers/3f5e8cd2-6666-4206-a393-9f0507322402" status: 200 len: 1321 microversion: 2.1 time: 0.563984 Aug 10 23:03:52.681520 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 945/1908] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:03:52 2022] GET /compute/v2.1/servers/3f5e8cd2-6666-4206-a393-9f0507322402 => generated 1321 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:03:52.962579 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-62c4042b-dc91-4602-ab0e-cf2363057815 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:52.963263 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-62c4042b-dc91-4602-ab0e-cf2363057815 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] [instance: 63d2bd74-d060-4925-9323-b39d5131f958] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:53.004825 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-62c4042b-dc91-4602-ab0e-cf2363057815 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:53.013479 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-62c4042b-dc91-4602-ab0e-cf2363057815 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:53.015942 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-62c4042b-dc91-4602-ab0e-cf2363057815 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:53.016973 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-62c4042b-dc91-4602-ab0e-cf2363057815 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:53.018819 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-62c4042b-dc91-4602-ab0e-cf2363057815 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:53.019469 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-62c4042b-dc91-4602-ab0e-cf2363057815 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:53.137306 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-9fc291bc-9169-4d95-b84a-c79084c09738 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfd6d8e6a8444f5b9fcf1cf8da242ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707f869910b34768ae1a348cd0b5f284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:53.146531 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-9fc291bc-9169-4d95-b84a-c79084c09738 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] 10.222.0.58 "GET /compute/v2.1/servers/9725dd3f-f5a6-496e-99c5-66ee08b6c1f7" status: 200 len: 1646 microversion: 2.1 time: 0.497610 Aug 10 23:03:53.155086 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 964/1909] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:03:52 2022] GET /compute/v2.1/servers/9725dd3f-f5a6-496e-99c5-66ee08b6c1f7 => generated 1646 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:03:53.171814 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-99097426-984f-4597-ae09-8e0b0611bf30 req-db1e6452-5ac6-4fdb-a286-6a6d4506a0f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10ede6f4-625a-4c5a-a5d6-d7d0f2476dee", "name": "network-vif-deleted", "tag": "cddf9930-172d-4081-9a2f-2ad8b6fc95e2"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:03:53.191063 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-99097426-984f-4597-ae09-8e0b0611bf30 req-db1e6452-5ac6-4fdb-a286-6a6d4506a0f6 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:53.192132 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-99097426-984f-4597-ae09-8e0b0611bf30 req-db1e6452-5ac6-4fdb-a286-6a6d4506a0f6 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:53.193357 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-99097426-984f-4597-ae09-8e0b0611bf30 req-db1e6452-5ac6-4fdb-a286-6a6d4506a0f6 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:53.226103 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-99097426-984f-4597-ae09-8e0b0611bf30 req-db1e6452-5ac6-4fdb-a286-6a6d4506a0f6 service nova] Creating event network-vif-deleted:cddf9930-172d-4081-9a2f-2ad8b6fc95e2 for instance 10ede6f4-625a-4c5a-a5d6-d7d0f2476dee on n-h2-850468-14 Aug 10 23:03:53.232597 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-99097426-984f-4597-ae09-8e0b0611bf30 req-db1e6452-5ac6-4fdb-a286-6a6d4506a0f6 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075387 Aug 10 23:03:53.234857 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 965/1910] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:03:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:03:53.531025 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-62c4042b-dc91-4602-ab0e-cf2363057815 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632904331d024d9b8e4d3660dff2cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ed0bdee3aa4013bd9219069bda558c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:53.547572 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-62c4042b-dc91-4602-ab0e-cf2363057815 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] 10.222.0.58 "GET /compute/v2.1/servers/63d2bd74-d060-4925-9323-b39d5131f958" status: 200 len: 1392 microversion: 2.1 time: 0.590344 Aug 10 23:03:53.548335 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 946/1911] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:03:52 2022] GET /compute/v2.1/servers/63d2bd74-d060-4925-9323-b39d5131f958 => generated 1392 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:03:53.566866 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-503b0c96-da7f-45da-9578-66a8af167014 req-d22e9be9-35bc-4c6e-8c8e-627ae2e709a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9725dd3f-f5a6-496e-99c5-66ee08b6c1f7", "name": "network-vif-deleted", "tag": "b6ec14f6-4359-4750-92e8-cd76718aa49e"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:03:53.587659 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-503b0c96-da7f-45da-9578-66a8af167014 req-d22e9be9-35bc-4c6e-8c8e-627ae2e709a7 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:53.588310 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-503b0c96-da7f-45da-9578-66a8af167014 req-d22e9be9-35bc-4c6e-8c8e-627ae2e709a7 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:53.588741 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-503b0c96-da7f-45da-9578-66a8af167014 req-d22e9be9-35bc-4c6e-8c8e-627ae2e709a7 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:53.619471 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-503b0c96-da7f-45da-9578-66a8af167014 req-d22e9be9-35bc-4c6e-8c8e-627ae2e709a7 service nova] Creating event network-vif-deleted:b6ec14f6-4359-4750-92e8-cd76718aa49e for instance 9725dd3f-f5a6-496e-99c5-66ee08b6c1f7 on n-h2-850468-14 Aug 10 23:03:53.628476 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-503b0c96-da7f-45da-9578-66a8af167014 req-d22e9be9-35bc-4c6e-8c8e-627ae2e709a7 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078695 Aug 10 23:03:53.629559 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 947/1912] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:03:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:03:53.655910 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-5122368f-88a0-4aac-858c-9e22a5ac2040 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:53.656913 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-5122368f-88a0-4aac-858c-9e22a5ac2040 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] [instance: 10ede6f4-625a-4c5a-a5d6-d7d0f2476dee] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:53.667738 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5122368f-88a0-4aac-858c-9e22a5ac2040 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:53.675953 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5122368f-88a0-4aac-858c-9e22a5ac2040 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:53.676717 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5122368f-88a0-4aac-858c-9e22a5ac2040 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:53.677659 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5122368f-88a0-4aac-858c-9e22a5ac2040 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:53.678302 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5122368f-88a0-4aac-858c-9e22a5ac2040 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:53.678960 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5122368f-88a0-4aac-858c-9e22a5ac2040 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:53.777267 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-1ea7e359-a525-4884-bc2d-c37060efdcc4 tempest-ServicesAdminNegativeTestJSON-2142524593 tempest-ServicesAdminNegativeTestJSON-2142524593-project-admin] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:53.783715 n-d-850468-14 devstack@n-api.service[122633]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 23:03:53.783715 n-d-850468-14 devstack@n-api.service[122633]: warnings.warn(msg) Aug 10 23:03:53.789658 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1ea7e359-a525-4884-bc2d-c37060efdcc4 tempest-ServicesAdminNegativeTestJSON-2142524593 tempest-ServicesAdminNegativeTestJSON-2142524593-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:53.792522 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1ea7e359-a525-4884-bc2d-c37060efdcc4 tempest-ServicesAdminNegativeTestJSON-2142524593 tempest-ServicesAdminNegativeTestJSON-2142524593-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:53.793246 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1ea7e359-a525-4884-bc2d-c37060efdcc4 tempest-ServicesAdminNegativeTestJSON-2142524593 tempest-ServicesAdminNegativeTestJSON-2142524593-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:53.796772 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1ea7e359-a525-4884-bc2d-c37060efdcc4 tempest-ServicesAdminNegativeTestJSON-2142524593 tempest-ServicesAdminNegativeTestJSON-2142524593-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:53.799543 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1ea7e359-a525-4884-bc2d-c37060efdcc4 tempest-ServicesAdminNegativeTestJSON-2142524593 tempest-ServicesAdminNegativeTestJSON-2142524593-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:53.800226 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1ea7e359-a525-4884-bc2d-c37060efdcc4 tempest-ServicesAdminNegativeTestJSON-2142524593 tempest-ServicesAdminNegativeTestJSON-2142524593-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:53.820830 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5122368f-88a0-4aac-858c-9e22a5ac2040 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:53.822243 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5122368f-88a0-4aac-858c-9e22a5ac2040 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:53.824545 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5122368f-88a0-4aac-858c-9e22a5ac2040 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:53.826068 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.objects.instance [None req-5122368f-88a0-4aac-858c-9e22a5ac2040 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Lazy-loading 'fault' on Instance uuid 10ede6f4-625a-4c5a-a5d6-d7d0f2476dee {{(pid=122632) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:03:53.866198 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-1ea7e359-a525-4884-bc2d-c37060efdcc4 tempest-ServicesAdminNegativeTestJSON-2142524593 tempest-ServicesAdminNegativeTestJSON-2142524593-project-admin] 10.222.0.58 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.445622 Aug 10 23:03:53.867735 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 966/1913] 10.222.0.58 () {58 vars in 1137 bytes} [Wed Aug 10 23:03:53 2022] GET /compute/v2.1/os-services => generated 949 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:03:53.881826 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-232aa10b-9a19-4a5a-bb87-78882b233e7d tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:53.882656 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-232aa10b-9a19-4a5a-bb87-78882b233e7d tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] [instance: 3f5e8cd2-6666-4206-a393-9f0507322402] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:53.891580 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-232aa10b-9a19-4a5a-bb87-78882b233e7d tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:53.892638 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-232aa10b-9a19-4a5a-bb87-78882b233e7d tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:53.893312 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-232aa10b-9a19-4a5a-bb87-78882b233e7d tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:53.894382 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-232aa10b-9a19-4a5a-bb87-78882b233e7d tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:53.895776 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-232aa10b-9a19-4a5a-bb87-78882b233e7d tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:53.896443 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-232aa10b-9a19-4a5a-bb87-78882b233e7d tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:53.950563 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-5122368f-88a0-4aac-858c-9e22a5ac2040 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '890735b21f5d4764aefd789f74e00222', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e9cf3129a4e4f56a17bebf68b7bc42b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:53.958006 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-5122368f-88a0-4aac-858c-9e22a5ac2040 tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] 10.222.0.58 "GET /compute/v2.1/servers/10ede6f4-625a-4c5a-a5d6-d7d0f2476dee" status: 200 len: 1313 microversion: 2.1 time: 0.306506 Aug 10 23:03:53.958704 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 948/1914] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:03:53 2022] GET /compute/v2.1/servers/10ede6f4-625a-4c5a-a5d6-d7d0f2476dee => generated 1313 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:03:53.964888 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-a2e0430c-82cf-493d-b9a6-044763ed75e1 tempest-ServicesAdminNegativeTestJSON-2142524593 tempest-ServicesAdminNegativeTestJSON-2142524593-project-admin] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:53.968760 n-d-850468-14 devstack@n-api.service[122632]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 23:03:53.968760 n-d-850468-14 devstack@n-api.service[122632]: warnings.warn(msg) Aug 10 23:03:53.970435 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a2e0430c-82cf-493d-b9a6-044763ed75e1 tempest-ServicesAdminNegativeTestJSON-2142524593 tempest-ServicesAdminNegativeTestJSON-2142524593-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:53.971349 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a2e0430c-82cf-493d-b9a6-044763ed75e1 tempest-ServicesAdminNegativeTestJSON-2142524593 tempest-ServicesAdminNegativeTestJSON-2142524593-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:53.972040 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a2e0430c-82cf-493d-b9a6-044763ed75e1 tempest-ServicesAdminNegativeTestJSON-2142524593 tempest-ServicesAdminNegativeTestJSON-2142524593-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:53.973117 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a2e0430c-82cf-493d-b9a6-044763ed75e1 tempest-ServicesAdminNegativeTestJSON-2142524593 tempest-ServicesAdminNegativeTestJSON-2142524593-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:53.973794 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a2e0430c-82cf-493d-b9a6-044763ed75e1 tempest-ServicesAdminNegativeTestJSON-2142524593 tempest-ServicesAdminNegativeTestJSON-2142524593-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:53.974563 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a2e0430c-82cf-493d-b9a6-044763ed75e1 tempest-ServicesAdminNegativeTestJSON-2142524593 tempest-ServicesAdminNegativeTestJSON-2142524593-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:54.003685 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-a2e0430c-82cf-493d-b9a6-044763ed75e1 tempest-ServicesAdminNegativeTestJSON-2142524593 tempest-ServicesAdminNegativeTestJSON-2142524593-project-admin] 10.222.0.58 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.043490 Aug 10 23:03:54.019813 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 949/1915] 10.222.0.58 () {58 vars in 1170 bytes} [Wed Aug 10 23:03:53 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 949 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:03:54.027516 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-8ea6664e-6a5d-4588-9b3d-5ed3964969a5 tempest-ServicesAdminNegativeTestJSON-2142524593 tempest-ServicesAdminNegativeTestJSON-2142524593-project-admin] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:54.031700 n-d-850468-14 devstack@n-api.service[122632]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 23:03:54.031700 n-d-850468-14 devstack@n-api.service[122632]: warnings.warn(msg) Aug 10 23:03:54.033255 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8ea6664e-6a5d-4588-9b3d-5ed3964969a5 tempest-ServicesAdminNegativeTestJSON-2142524593 tempest-ServicesAdminNegativeTestJSON-2142524593-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:54.033821 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8ea6664e-6a5d-4588-9b3d-5ed3964969a5 tempest-ServicesAdminNegativeTestJSON-2142524593 tempest-ServicesAdminNegativeTestJSON-2142524593-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:54.034340 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8ea6664e-6a5d-4588-9b3d-5ed3964969a5 tempest-ServicesAdminNegativeTestJSON-2142524593 tempest-ServicesAdminNegativeTestJSON-2142524593-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:54.035359 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8ea6664e-6a5d-4588-9b3d-5ed3964969a5 tempest-ServicesAdminNegativeTestJSON-2142524593 tempest-ServicesAdminNegativeTestJSON-2142524593-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:54.036002 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8ea6664e-6a5d-4588-9b3d-5ed3964969a5 tempest-ServicesAdminNegativeTestJSON-2142524593 tempest-ServicesAdminNegativeTestJSON-2142524593-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:54.036590 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8ea6664e-6a5d-4588-9b3d-5ed3964969a5 tempest-ServicesAdminNegativeTestJSON-2142524593 tempest-ServicesAdminNegativeTestJSON-2142524593-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:54.063330 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-8ea6664e-6a5d-4588-9b3d-5ed3964969a5 tempest-ServicesAdminNegativeTestJSON-2142524593 tempest-ServicesAdminNegativeTestJSON-2142524593-project-admin] 10.222.0.58 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.042032 Aug 10 23:03:54.064035 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 950/1916] 10.222.0.58 () {58 vars in 1137 bytes} [Wed Aug 10 23:03:54 2022] GET /compute/v2.1/os-services => generated 949 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:03:54.077906 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-ffa8020e-a6cc-40cf-92d4-333bd9bf2704 tempest-ServicesAdminNegativeTestJSON-2142524593 tempest-ServicesAdminNegativeTestJSON-2142524593-project-admin] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:54.081180 n-d-850468-14 devstack@n-api.service[122632]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 23:03:54.081180 n-d-850468-14 devstack@n-api.service[122632]: warnings.warn(msg) Aug 10 23:03:54.082545 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ffa8020e-a6cc-40cf-92d4-333bd9bf2704 tempest-ServicesAdminNegativeTestJSON-2142524593 tempest-ServicesAdminNegativeTestJSON-2142524593-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:54.083339 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ffa8020e-a6cc-40cf-92d4-333bd9bf2704 tempest-ServicesAdminNegativeTestJSON-2142524593 tempest-ServicesAdminNegativeTestJSON-2142524593-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:54.084037 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ffa8020e-a6cc-40cf-92d4-333bd9bf2704 tempest-ServicesAdminNegativeTestJSON-2142524593 tempest-ServicesAdminNegativeTestJSON-2142524593-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:54.084896 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ffa8020e-a6cc-40cf-92d4-333bd9bf2704 tempest-ServicesAdminNegativeTestJSON-2142524593 tempest-ServicesAdminNegativeTestJSON-2142524593-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:54.085339 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ffa8020e-a6cc-40cf-92d4-333bd9bf2704 tempest-ServicesAdminNegativeTestJSON-2142524593 tempest-ServicesAdminNegativeTestJSON-2142524593-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:54.086236 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ffa8020e-a6cc-40cf-92d4-333bd9bf2704 tempest-ServicesAdminNegativeTestJSON-2142524593 tempest-ServicesAdminNegativeTestJSON-2142524593-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:54.113305 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-ffa8020e-a6cc-40cf-92d4-333bd9bf2704 tempest-ServicesAdminNegativeTestJSON-2142524593 tempest-ServicesAdminNegativeTestJSON-2142524593-project-admin] 10.222.0.58 "GET /compute/v2.1/os-services?host=n-d-850468-14&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.039897 Aug 10 23:03:54.118914 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 951/1917] 10.222.0.58 () {58 vars in 1196 bytes} [Wed Aug 10 23:03:54 2022] GET /compute/v2.1/os-services?host=n-d-850468-14&binary=xxx => generated 16 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 10 23:03:54.129503 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-bc984776-a37b-44b6-b73d-2b85f3326e16 tempest-ServicesAdminNegativeTestJSON-2142524593 tempest-ServicesAdminNegativeTestJSON-2142524593-project-admin] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:54.133771 n-d-850468-14 devstack@n-api.service[122632]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 23:03:54.133771 n-d-850468-14 devstack@n-api.service[122632]: warnings.warn(msg) Aug 10 23:03:54.136653 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bc984776-a37b-44b6-b73d-2b85f3326e16 tempest-ServicesAdminNegativeTestJSON-2142524593 tempest-ServicesAdminNegativeTestJSON-2142524593-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:54.137527 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bc984776-a37b-44b6-b73d-2b85f3326e16 tempest-ServicesAdminNegativeTestJSON-2142524593 tempest-ServicesAdminNegativeTestJSON-2142524593-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:54.137975 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bc984776-a37b-44b6-b73d-2b85f3326e16 tempest-ServicesAdminNegativeTestJSON-2142524593 tempest-ServicesAdminNegativeTestJSON-2142524593-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:54.138863 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bc984776-a37b-44b6-b73d-2b85f3326e16 tempest-ServicesAdminNegativeTestJSON-2142524593 tempest-ServicesAdminNegativeTestJSON-2142524593-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:54.139325 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bc984776-a37b-44b6-b73d-2b85f3326e16 tempest-ServicesAdminNegativeTestJSON-2142524593 tempest-ServicesAdminNegativeTestJSON-2142524593-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:54.139904 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bc984776-a37b-44b6-b73d-2b85f3326e16 tempest-ServicesAdminNegativeTestJSON-2142524593 tempest-ServicesAdminNegativeTestJSON-2142524593-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:54.176371 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-bc984776-a37b-44b6-b73d-2b85f3326e16 tempest-ServicesAdminNegativeTestJSON-2142524593 tempest-ServicesAdminNegativeTestJSON-2142524593-project-admin] 10.222.0.58 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.051667 Aug 10 23:03:54.178670 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 952/1918] 10.222.0.58 () {58 vars in 1137 bytes} [Wed Aug 10 23:03:54 2022] GET /compute/v2.1/os-services => generated 949 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:03:54.191545 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-72a324b2-e577-416d-833c-b120d8b070ba tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:54.192543 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-72a324b2-e577-416d-833c-b120d8b070ba tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] [instance: 9725dd3f-f5a6-496e-99c5-66ee08b6c1f7] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:54.201420 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-72a324b2-e577-416d-833c-b120d8b070ba tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:54.202344 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-72a324b2-e577-416d-833c-b120d8b070ba tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:54.203028 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-72a324b2-e577-416d-833c-b120d8b070ba tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:54.204166 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-72a324b2-e577-416d-833c-b120d8b070ba tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:54.205234 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-72a324b2-e577-416d-833c-b120d8b070ba tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:54.205988 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-72a324b2-e577-416d-833c-b120d8b070ba tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:54.234980 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:03:54.256163 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-72a324b2-e577-416d-833c-b120d8b070ba tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:54.257367 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-72a324b2-e577-416d-833c-b120d8b070ba tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:54.258190 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-72a324b2-e577-416d-833c-b120d8b070ba tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:54.259481 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.objects.instance [None req-72a324b2-e577-416d-833c-b120d8b070ba tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lazy-loading 'fault' on Instance uuid 9725dd3f-f5a6-496e-99c5-66ee08b6c1f7 {{(pid=122632) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:03:54.336296 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-232aa10b-9a19-4a5a-bb87-78882b233e7d tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c26e69e2274083916402c96d71c5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a6ac1a984c478da9337692485d16ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:54.345537 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-232aa10b-9a19-4a5a-bb87-78882b233e7d tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] 10.222.0.58 "GET /compute/v2.1/servers/3f5e8cd2-6666-4206-a393-9f0507322402" status: 200 len: 1321 microversion: 2.1 time: 0.476095 Aug 10 23:03:54.359342 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 967/1919] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:03:53 2022] GET /compute/v2.1/servers/3f5e8cd2-6666-4206-a393-9f0507322402 => generated 1321 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:03:54.368329 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-85f452bf-af41-4c53-b5b5-8a03798f7c91 tempest-ServicesAdminNegativeTestJSON-2142524593 tempest-ServicesAdminNegativeTestJSON-2142524593-project-admin] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:54.371419 n-d-850468-14 devstack@n-api.service[122633]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 23:03:54.371419 n-d-850468-14 devstack@n-api.service[122633]: warnings.warn(msg) Aug 10 23:03:54.373604 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-85f452bf-af41-4c53-b5b5-8a03798f7c91 tempest-ServicesAdminNegativeTestJSON-2142524593 tempest-ServicesAdminNegativeTestJSON-2142524593-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:54.374336 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-85f452bf-af41-4c53-b5b5-8a03798f7c91 tempest-ServicesAdminNegativeTestJSON-2142524593 tempest-ServicesAdminNegativeTestJSON-2142524593-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:54.374988 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-85f452bf-af41-4c53-b5b5-8a03798f7c91 tempest-ServicesAdminNegativeTestJSON-2142524593 tempest-ServicesAdminNegativeTestJSON-2142524593-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:54.375933 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-85f452bf-af41-4c53-b5b5-8a03798f7c91 tempest-ServicesAdminNegativeTestJSON-2142524593 tempest-ServicesAdminNegativeTestJSON-2142524593-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:54.377188 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-85f452bf-af41-4c53-b5b5-8a03798f7c91 tempest-ServicesAdminNegativeTestJSON-2142524593 tempest-ServicesAdminNegativeTestJSON-2142524593-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:54.377828 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-85f452bf-af41-4c53-b5b5-8a03798f7c91 tempest-ServicesAdminNegativeTestJSON-2142524593 tempest-ServicesAdminNegativeTestJSON-2142524593-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:54.405762 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-85f452bf-af41-4c53-b5b5-8a03798f7c91 tempest-ServicesAdminNegativeTestJSON-2142524593 tempest-ServicesAdminNegativeTestJSON-2142524593-project-admin] 10.222.0.58 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.045025 Aug 10 23:03:54.408352 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 968/1920] 10.222.0.58 () {58 vars in 1198 bytes} [Wed Aug 10 23:03:54 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 23:03:54.564055 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=4 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:03:54.583473 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-72a324b2-e577-416d-833c-b120d8b070ba tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfd6d8e6a8444f5b9fcf1cf8da242ac0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '707f869910b34768ae1a348cd0b5f284', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:54.594048 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-2ce108e4-44c2-4b35-b601-8e24357148d0 tempest-ServicesAdminNegativeTestJSON-1258811045 tempest-ServicesAdminNegativeTestJSON-1258811045-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:54.594803 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-72a324b2-e577-416d-833c-b120d8b070ba tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] 10.222.0.58 "GET /compute/v2.1/servers/9725dd3f-f5a6-496e-99c5-66ee08b6c1f7" status: 200 len: 1305 microversion: 2.1 time: 0.412214 Aug 10 23:03:54.598273 n-d-850468-14 devstack@n-api.service[122633]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 23:03:54.598273 n-d-850468-14 devstack@n-api.service[122633]: warnings.warn(msg) Aug 10 23:03:54.599775 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-2ce108e4-44c2-4b35-b601-8e24357148d0 tempest-ServicesAdminNegativeTestJSON-1258811045 tempest-ServicesAdminNegativeTestJSON-1258811045-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '3d6878ab94324c97afef10f02e6255b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc92876b4ec48d3ae78a163d4de0c17', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:54.603224 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-2ce108e4-44c2-4b35-b601-8e24357148d0 tempest-ServicesAdminNegativeTestJSON-1258811045 tempest-ServicesAdminNegativeTestJSON-1258811045-project] Request method failure captured: Aug 10 23:03:54.603224 n-d-850468-14 devstack@n-api.service[122633]: request: GET /compute/v2.1/os-services HTTP/1.1 Aug 10 23:03:54.603224 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:03:54.603224 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:03:54.603224 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:03:54.603224 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:03:54.603224 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:03:54.603224 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:03:54.603224 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:03:54.603224 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:03:54.603224 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9DlYdB-VgwjnIBPQ7IQjGNM1Pu21-vhZeD-wIj-Ips1m-ZNzUJ6y2InQ60Atp3uYr3IidHgx5T2O84pyqeMB5swzyR6LUIEaRNpXPToJXpnJ4Bc7oWNgIXj0I5YDxflkLzQykajV-hnXD9wyhdzefEcRIWFyQdQpTJgeXj4xPBxjrf8 Aug 10 23:03:54.603224 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:03:54.603224 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:03:54.603224 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:03:54.603224 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:03:54.603224 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:03:54.603224 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:03:54.603224 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: afc92876b4ec48d3ae78a163d4de0c17 Aug 10 23:03:54.603224 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-1258811045 Aug 10 23:03:54.603224 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:03:54.603224 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:03:54.605249 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/afc92876b4ec48d3ae78a163d4de0c17"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/afc92876b4ec48d3ae78a163d4de0c17"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/afc92876b4ec48d3ae78a163d4de0c17"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_afc92876b4ec48d3ae78a163d4de0c17", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:03:54.605249 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-1258811045 Aug 10 23:03:54.605249 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: afc92876b4ec48d3ae78a163d4de0c17 Aug 10 23:03:54.605249 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-1258811045 Aug 10 23:03:54.605249 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-ServicesAdminNegativeTestJSON-1258811045-project Aug 10 23:03:54.605249 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:03:54.605249 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:03:54.605249 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 3d6878ab94324c97afef10f02e6255b9 Aug 10 23:03:54.605249 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-1258811045-project Aug 10 23:03:54.605249 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:03:54.605249 n-d-850468-14 devstack@n-api.service[122633]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 10 23:03:54.605249 n-d-850468-14 devstack@n-api.service[122633]: action_args: {} Aug 10 23:03:54.606217 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:03:54.606217 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:03:54.606217 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:03:54.606217 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:03:54.606217 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:03:54.606217 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:03:54.606217 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 10 23:03:54.606217 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 23:03:54.606217 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 10 23:03:54.606217 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 23:03:54.606217 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:03:54.606217 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:03:54.606217 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 387, in index Aug 10 23:03:54.606217 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Aug 10 23:03:54.606217 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 10 23:03:54.606217 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 10 23:03:54.606217 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 10 23:03:54.606217 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 10 23:03:54.606217 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 10 23:03:54.607644 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 10 23:03:54.607644 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 10 23:03:54.607644 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise self.value Aug 10 23:03:54.607644 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 10 23:03:54.607644 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 10 23:03:54.607644 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 10 23:03:54.607644 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 10 23:03:54.607644 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 10 23:03:54.607644 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 10 23:03:54.607644 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 10 23:03:54.607644 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:03:54.607644 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:03:54.607644 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:03:54.607644 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:03:54.607644 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:03:54.607644 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:03:54.607644 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 10 23:03:54.607644 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 10 23:03:54.607644 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 10 23:03:54.607644 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:03:54.611451 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-2ce108e4-44c2-4b35-b601-8e24357148d0 tempest-ServicesAdminNegativeTestJSON-1258811045 tempest-ServicesAdminNegativeTestJSON-1258811045-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:03:54.613007 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-2ce108e4-44c2-4b35-b601-8e24357148d0 tempest-ServicesAdminNegativeTestJSON-1258811045 tempest-ServicesAdminNegativeTestJSON-1258811045-project] 10.222.0.58 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.195951 Aug 10 23:03:54.614476 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 969/1922] 10.222.0.58 () {58 vars in 1137 bytes} [Wed Aug 10 23:03:54 2022] GET /compute/v2.1/os-services => generated 112 bytes in 198 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 10 23:03:54.620313 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 953/1922] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:03:54 2022] GET /compute/v2.1/servers/9725dd3f-f5a6-496e-99c5-66ee08b6c1f7 => generated 1305 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:03:54.620688 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-ea60feba-de48-4d3a-942f-38b5c79d452b tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:54.622440 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-ea60feba-de48-4d3a-942f-38b5c79d452b tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] [instance: 63d2bd74-d060-4925-9323-b39d5131f958] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:54.635072 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ea60feba-de48-4d3a-942f-38b5c79d452b tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:54.636186 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ea60feba-de48-4d3a-942f-38b5c79d452b tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:54.636868 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ea60feba-de48-4d3a-942f-38b5c79d452b tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:54.637796 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ea60feba-de48-4d3a-942f-38b5c79d452b tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:54.638530 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ea60feba-de48-4d3a-942f-38b5c79d452b tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:54.639240 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ea60feba-de48-4d3a-942f-38b5c79d452b tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:54.717230 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-8d8ca65a-033c-45b8-bc56-0c0fd25a5af3 req-085a1e96-101e-4795-bda9-e8f48bb4949a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f5e8cd2-6666-4206-a393-9f0507322402", "name": "network-vif-plugged", "status": "completed", "tag": "8d20efca-c421-4e1d-9824-67555899ca9d"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:03:54.736013 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-8d8ca65a-033c-45b8-bc56-0c0fd25a5af3 req-085a1e96-101e-4795-bda9-e8f48bb4949a service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:54.736899 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-8d8ca65a-033c-45b8-bc56-0c0fd25a5af3 req-085a1e96-101e-4795-bda9-e8f48bb4949a service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:54.737603 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-8d8ca65a-033c-45b8-bc56-0c0fd25a5af3 req-085a1e96-101e-4795-bda9-e8f48bb4949a service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:54.769875 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-8d8ca65a-033c-45b8-bc56-0c0fd25a5af3 req-085a1e96-101e-4795-bda9-e8f48bb4949a service nova] Creating event network-vif-plugged:8d20efca-c421-4e1d-9824-67555899ca9d for instance 3f5e8cd2-6666-4206-a393-9f0507322402 on n-h2-850468-14 Aug 10 23:03:54.783024 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-8d8ca65a-033c-45b8-bc56-0c0fd25a5af3 req-085a1e96-101e-4795-bda9-e8f48bb4949a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071554 Aug 10 23:03:54.784202 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 954/1923] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:03:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 23:03:54.983552 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-41809e22-fca2-4262-8b32-d5774c3d513e tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:54.984400 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-41809e22-fca2-4262-8b32-d5774c3d513e tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] [instance: 10ede6f4-625a-4c5a-a5d6-d7d0f2476dee] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:55.001762 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-41809e22-fca2-4262-8b32-d5774c3d513e tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:55.002340 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-41809e22-fca2-4262-8b32-d5774c3d513e tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:55.002868 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-41809e22-fca2-4262-8b32-d5774c3d513e tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:55.003812 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-41809e22-fca2-4262-8b32-d5774c3d513e tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:55.004362 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-41809e22-fca2-4262-8b32-d5774c3d513e tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:55.005514 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-41809e22-fca2-4262-8b32-d5774c3d513e tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:55.018244 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-ea60feba-de48-4d3a-942f-38b5c79d452b tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632904331d024d9b8e4d3660dff2cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ed0bdee3aa4013bd9219069bda558c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:55.029023 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-41809e22-fca2-4262-8b32-d5774c3d513e tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] HTTP exception thrown: Instance 10ede6f4-625a-4c5a-a5d6-d7d0f2476dee could not be found. Aug 10 23:03:55.030146 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-ea60feba-de48-4d3a-942f-38b5c79d452b tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] 10.222.0.58 "GET /compute/v2.1/servers/63d2bd74-d060-4925-9323-b39d5131f958" status: 200 len: 1392 microversion: 2.1 time: 0.414172 Aug 10 23:03:55.039593 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-41809e22-fca2-4262-8b32-d5774c3d513e tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Request method failure captured: Aug 10 23:03:55.039593 n-d-850468-14 devstack@n-api.service[122632]: request: GET /compute/v2.1/servers/10ede6f4-625a-4c5a-a5d6-d7d0f2476dee HTTP/1.1 Aug 10 23:03:55.039593 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:03:55.039593 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:03:55.039593 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:03:55.039593 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 23:03:55.039593 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:03:55.039593 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:03:55.039593 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:03:55.039593 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:03:55.039593 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9DkiAjWMnEScmXUQ4URpE929LR04Z8tVQFM7-HlbAmthzngpnguHOyLOUY0k3vhcWXMqybRYRnxQLljJds4eIyjIcnw25UUriDcSFQLJ0yAgBKlC5ig8XoT5HsrMNoi0tzD74DHerwRzKapIeqizBGLGMzal9OBH_ENocwnLGn23ebg Aug 10 23:03:55.039593 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:03:55.039593 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:03:55.039593 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:03:55.039593 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:03:55.039593 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:03:55.039593 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:03:55.039593 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 9e9cf3129a4e4f56a17bebf68b7bc42b Aug 10 23:03:55.039593 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-ListServersNegativeTestJSON-1516024484 Aug 10 23:03:55.039593 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:03:55.039593 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:03:55.042052 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9e9cf3129a4e4f56a17bebf68b7bc42b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9e9cf3129a4e4f56a17bebf68b7bc42b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/9e9cf3129a4e4f56a17bebf68b7bc42b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_9e9cf3129a4e4f56a17bebf68b7bc42b", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:03:55.042052 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-ListServersNegativeTestJSON-1516024484 Aug 10 23:03:55.042052 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 9e9cf3129a4e4f56a17bebf68b7bc42b Aug 10 23:03:55.042052 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1516024484 Aug 10 23:03:55.042052 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-ListServersNegativeTestJSON-1516024484-project Aug 10 23:03:55.042052 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:03:55.042052 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:03:55.042052 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: 890735b21f5d4764aefd789f74e00222 Aug 10 23:03:55.042052 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-ListServersNegativeTestJSON-1516024484-project Aug 10 23:03:55.042052 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:03:55.042052 n-d-850468-14 devstack@n-api.service[122632]: exception: Instance 10ede6f4-625a-4c5a-a5d6-d7d0f2476dee could not be found. Aug 10 23:03:55.042052 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': '10ede6f4-625a-4c5a-a5d6-d7d0f2476dee'} Aug 10 23:03:55.043019 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:03:55.043019 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:03:55.043019 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:03:55.043019 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:03:55.043019 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:03:55.043019 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:03:55.043019 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:03:55.043019 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:03:55.043019 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:03:55.043019 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:03:55.043019 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10ede6f4-625a-4c5a-a5d6-d7d0f2476dee could not be found. Aug 10 23:03:55.043019 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:03:55.043019 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:03:55.043019 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:03:55.043019 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:03:55.043019 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:03:55.043019 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:03:55.043019 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:03:55.043019 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:03:55.043019 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:03:55.044673 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:03:55.044673 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:03:55.044673 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:03:55.044673 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:03:55.044673 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:03:55.044673 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:03:55.044673 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:03:55.044673 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10ede6f4-625a-4c5a-a5d6-d7d0f2476dee could not be found. Aug 10 23:03:55.044673 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:03:55.044673 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:03:55.044673 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:03:55.044673 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:03:55.044673 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:03:55.044673 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:03:55.044673 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:03:55.044673 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:03:55.044673 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10ede6f4-625a-4c5a-a5d6-d7d0f2476dee could not be found. Aug 10 23:03:55.044673 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:03:55.045938 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 970/1924] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:03:54 2022] GET /compute/v2.1/servers/63d2bd74-d060-4925-9323-b39d5131f958 => generated 1392 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:03:55.053823 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-41809e22-fca2-4262-8b32-d5774c3d513e tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] Returning 404 to user: Instance 10ede6f4-625a-4c5a-a5d6-d7d0f2476dee could not be found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:03:55.056581 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-41809e22-fca2-4262-8b32-d5774c3d513e tempest-ListServersNegativeTestJSON-1516024484 tempest-ListServersNegativeTestJSON-1516024484-project] 10.222.0.58 "GET /compute/v2.1/servers/10ede6f4-625a-4c5a-a5d6-d7d0f2476dee" status: 404 len: 111 microversion: 2.1 time: 0.077280 Aug 10 23:03:55.061437 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 955/1925] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:03:54 2022] GET /compute/v2.1/servers/10ede6f4-625a-4c5a-a5d6-d7d0f2476dee => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:03:55.378066 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-642391c1-0280-4505-be50-9c5b5a73dfdb tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:55.378282 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-642391c1-0280-4505-be50-9c5b5a73dfdb tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] [instance: 3f5e8cd2-6666-4206-a393-9f0507322402] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:55.389249 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-642391c1-0280-4505-be50-9c5b5a73dfdb tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:55.389746 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-642391c1-0280-4505-be50-9c5b5a73dfdb tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:55.390185 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-642391c1-0280-4505-be50-9c5b5a73dfdb tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:55.396611 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-642391c1-0280-4505-be50-9c5b5a73dfdb tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:55.397349 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-642391c1-0280-4505-be50-9c5b5a73dfdb tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:55.398479 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-642391c1-0280-4505-be50-9c5b5a73dfdb tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:55.624377 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-6bcf63e5-b750-4f69-91aa-e3e8c8c51146 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:55.625253 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-6bcf63e5-b750-4f69-91aa-e3e8c8c51146 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] [instance: 9725dd3f-f5a6-496e-99c5-66ee08b6c1f7] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:55.641025 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6bcf63e5-b750-4f69-91aa-e3e8c8c51146 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:55.641529 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6bcf63e5-b750-4f69-91aa-e3e8c8c51146 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:55.644945 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6bcf63e5-b750-4f69-91aa-e3e8c8c51146 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:55.646911 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6bcf63e5-b750-4f69-91aa-e3e8c8c51146 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:55.654769 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6bcf63e5-b750-4f69-91aa-e3e8c8c51146 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:55.656456 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6bcf63e5-b750-4f69-91aa-e3e8c8c51146 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:55.700342 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-6bcf63e5-b750-4f69-91aa-e3e8c8c51146 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] HTTP exception thrown: Instance 9725dd3f-f5a6-496e-99c5-66ee08b6c1f7 could not be found. Aug 10 23:03:55.724227 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-6bcf63e5-b750-4f69-91aa-e3e8c8c51146 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Request method failure captured: Aug 10 23:03:55.724227 n-d-850468-14 devstack@n-api.service[122632]: request: GET /compute/v2.1/servers/9725dd3f-f5a6-496e-99c5-66ee08b6c1f7 HTTP/1.1 Aug 10 23:03:55.724227 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:03:55.724227 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:03:55.724227 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:03:55.724227 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 23:03:55.724227 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:03:55.724227 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:03:55.724227 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:03:55.724227 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:03:55.724227 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9Dju6bcY6WgJPTWLWUJ0fX6JaJBRP8GkYZWFafNrDYn8ACaF-JC0t8YD4rSPFgG5Deze7mjmq2_rnPCZ1jpXNRGkHxz134mT5MqTqUm9UAyuVcbLtNQAiAf-L4A3117brPwKa_CN56-tZ47WT8aAPEON_2-WsEOp9qATqEToy30jo_s Aug 10 23:03:55.724227 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:03:55.724227 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:03:55.724227 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:03:55.724227 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:03:55.724227 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:03:55.724227 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:03:55.724227 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 707f869910b34768ae1a348cd0b5f284 Aug 10 23:03:55.724227 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-SecurityGroupsTestJSON-1406525704 Aug 10 23:03:55.724227 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:03:55.724227 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:03:55.726853 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/707f869910b34768ae1a348cd0b5f284"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/707f869910b34768ae1a348cd0b5f284"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/707f869910b34768ae1a348cd0b5f284"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_707f869910b34768ae1a348cd0b5f284", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:03:55.726853 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-SecurityGroupsTestJSON-1406525704 Aug 10 23:03:55.726853 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 707f869910b34768ae1a348cd0b5f284 Aug 10 23:03:55.726853 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1406525704 Aug 10 23:03:55.726853 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-SecurityGroupsTestJSON-1406525704-project Aug 10 23:03:55.726853 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:03:55.726853 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:03:55.726853 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: bfd6d8e6a8444f5b9fcf1cf8da242ac0 Aug 10 23:03:55.726853 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-SecurityGroupsTestJSON-1406525704-project Aug 10 23:03:55.726853 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:03:55.726853 n-d-850468-14 devstack@n-api.service[122632]: exception: Instance 9725dd3f-f5a6-496e-99c5-66ee08b6c1f7 could not be found. Aug 10 23:03:55.726853 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': '9725dd3f-f5a6-496e-99c5-66ee08b6c1f7'} Aug 10 23:03:55.728983 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:03:55.728983 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:03:55.728983 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:03:55.728983 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:03:55.728983 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:03:55.728983 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:03:55.728983 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:03:55.728983 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:03:55.728983 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:03:55.728983 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:03:55.728983 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9725dd3f-f5a6-496e-99c5-66ee08b6c1f7 could not be found. Aug 10 23:03:55.728983 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:03:55.728983 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:03:55.728983 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:03:55.728983 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:03:55.728983 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:03:55.728983 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:03:55.728983 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:03:55.728983 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:03:55.728983 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:03:55.731321 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:03:55.731321 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:03:55.731321 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:03:55.731321 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:03:55.731321 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:03:55.731321 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:03:55.731321 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:03:55.731321 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9725dd3f-f5a6-496e-99c5-66ee08b6c1f7 could not be found. Aug 10 23:03:55.731321 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:03:55.731321 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:03:55.731321 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:03:55.731321 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:03:55.731321 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:03:55.731321 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:03:55.731321 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:03:55.731321 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:03:55.731321 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9725dd3f-f5a6-496e-99c5-66ee08b6c1f7 could not be found. Aug 10 23:03:55.731321 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:03:55.734840 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-6bcf63e5-b750-4f69-91aa-e3e8c8c51146 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Returning 404 to user: Instance 9725dd3f-f5a6-496e-99c5-66ee08b6c1f7 could not be found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:03:55.738409 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-6bcf63e5-b750-4f69-91aa-e3e8c8c51146 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] 10.222.0.58 "GET /compute/v2.1/servers/9725dd3f-f5a6-496e-99c5-66ee08b6c1f7" status: 404 len: 111 microversion: 2.1 time: 0.120745 Aug 10 23:03:55.740616 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 956/1926] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:03:55 2022] GET /compute/v2.1/servers/9725dd3f-f5a6-496e-99c5-66ee08b6c1f7 => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 10 23:03:55.751241 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c6b291d4-599a-4732-a70b-82abb9442cf7 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Calling method '.version_select at 0x7f847d5974c0>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:55.938354 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-642391c1-0280-4505-be50-9c5b5a73dfdb tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c26e69e2274083916402c96d71c5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a6ac1a984c478da9337692485d16ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:55.955169 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-642391c1-0280-4505-be50-9c5b5a73dfdb tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] 10.222.0.58 "GET /compute/v2.1/servers/3f5e8cd2-6666-4206-a393-9f0507322402" status: 200 len: 1321 microversion: 2.1 time: 0.580966 Aug 10 23:03:55.956962 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 971/1927] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:03:55 2022] GET /compute/v2.1/servers/3f5e8cd2-6666-4206-a393-9f0507322402 => generated 1321 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:03:56.075128 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-8f4efced-0ff9-48e8-b1ed-0288f437077f tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:56.076479 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-8f4efced-0ff9-48e8-b1ed-0288f437077f tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] [instance: 63d2bd74-d060-4925-9323-b39d5131f958] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:56.091342 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8f4efced-0ff9-48e8-b1ed-0288f437077f tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:56.092904 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8f4efced-0ff9-48e8-b1ed-0288f437077f tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:56.093390 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8f4efced-0ff9-48e8-b1ed-0288f437077f tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:56.096113 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8f4efced-0ff9-48e8-b1ed-0288f437077f tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:56.096856 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8f4efced-0ff9-48e8-b1ed-0288f437077f tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:56.096992 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8f4efced-0ff9-48e8-b1ed-0288f437077f tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:56.454404 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-c6b291d4-599a-4732-a70b-82abb9442cf7 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/d4a3fea6-2689-4e50-9b62-4cacb2a5cbb5" status: 202 len: 0 microversion: 2.1 time: 0.707958 Aug 10 23:03:56.455632 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 957/1928] 10.222.0.58 () {58 vars in 1272 bytes} [Wed Aug 10 23:03:55 2022] DELETE /compute/v2.1/os-security-groups/d4a3fea6-2689-4e50-9b62-4cacb2a5cbb5 => generated 0 bytes in 713 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:03:56.464420 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-592f6612-f57f-4e8d-a329-f0efe37ca133 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] Calling method '.version_select at 0x7f847dd4f5e0>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:56.533819 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-8f4efced-0ff9-48e8-b1ed-0288f437077f tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632904331d024d9b8e4d3660dff2cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ed0bdee3aa4013bd9219069bda558c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:56.559566 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-8f4efced-0ff9-48e8-b1ed-0288f437077f tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] 10.222.0.58 "GET /compute/v2.1/servers/63d2bd74-d060-4925-9323-b39d5131f958" status: 200 len: 1392 microversion: 2.1 time: 0.497804 Aug 10 23:03:56.560228 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 972/1929] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:03:56 2022] GET /compute/v2.1/servers/63d2bd74-d060-4925-9323-b39d5131f958 => generated 1392 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:03:57.000243 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-0441b48a-56dd-4add-a14b-2841c2e92d7f tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:57.000243 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-0441b48a-56dd-4add-a14b-2841c2e92d7f tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] [instance: 3f5e8cd2-6666-4206-a393-9f0507322402] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:57.016940 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0441b48a-56dd-4add-a14b-2841c2e92d7f tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:57.017621 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0441b48a-56dd-4add-a14b-2841c2e92d7f tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:57.018480 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0441b48a-56dd-4add-a14b-2841c2e92d7f tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:57.019405 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0441b48a-56dd-4add-a14b-2841c2e92d7f tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:57.020028 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0441b48a-56dd-4add-a14b-2841c2e92d7f tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:57.020624 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0441b48a-56dd-4add-a14b-2841c2e92d7f tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:57.642227 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-592f6612-f57f-4e8d-a329-f0efe37ca133 tempest-SecurityGroupsTestJSON-1406525704 tempest-SecurityGroupsTestJSON-1406525704-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/85b9aaad-eb49-4989-90bb-410291b4f7fb" status: 202 len: 0 microversion: 2.1 time: 1.182044 Aug 10 23:03:57.645747 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 958/1930] 10.222.0.58 () {58 vars in 1272 bytes} [Wed Aug 10 23:03:56 2022] DELETE /compute/v2.1/os-security-groups/85b9aaad-eb49-4989-90bb-410291b4f7fb => generated 0 bytes in 1186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:03:57.656237 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-d1f511fd-33b9-4f73-8cec-fc3e92fd1959 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:57.657321 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-d1f511fd-33b9-4f73-8cec-fc3e92fd1959 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] [instance: 63d2bd74-d060-4925-9323-b39d5131f958] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:57.670315 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d1f511fd-33b9-4f73-8cec-fc3e92fd1959 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:57.671857 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d1f511fd-33b9-4f73-8cec-fc3e92fd1959 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:57.672707 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d1f511fd-33b9-4f73-8cec-fc3e92fd1959 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:57.675140 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d1f511fd-33b9-4f73-8cec-fc3e92fd1959 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:57.676413 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d1f511fd-33b9-4f73-8cec-fc3e92fd1959 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:57.677105 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d1f511fd-33b9-4f73-8cec-fc3e92fd1959 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:57.971329 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-0441b48a-56dd-4add-a14b-2841c2e92d7f tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c26e69e2274083916402c96d71c5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a6ac1a984c478da9337692485d16ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:57.983601 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-0441b48a-56dd-4add-a14b-2841c2e92d7f tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] 10.222.0.58 "GET /compute/v2.1/servers/3f5e8cd2-6666-4206-a393-9f0507322402" status: 200 len: 1471 microversion: 2.1 time: 1.004766 Aug 10 23:03:57.984797 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 973/1931] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:03:56 2022] GET /compute/v2.1/servers/3f5e8cd2-6666-4206-a393-9f0507322402 => generated 1471 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:03:58.439052 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-d1f511fd-33b9-4f73-8cec-fc3e92fd1959 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632904331d024d9b8e4d3660dff2cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ed0bdee3aa4013bd9219069bda558c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:58.451846 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-d1f511fd-33b9-4f73-8cec-fc3e92fd1959 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] 10.222.0.58 "GET /compute/v2.1/servers/63d2bd74-d060-4925-9323-b39d5131f958" status: 200 len: 1392 microversion: 2.1 time: 0.804632 Aug 10 23:03:58.452809 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 959/1932] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:03:57 2022] GET /compute/v2.1/servers/63d2bd74-d060-4925-9323-b39d5131f958 => generated 1392 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:03:58.543929 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-87016b6a-6c30-4cf2-bdf0-e2324db87065 tempest-ServersAdminNegativeTestJSON-257998267 tempest-ServersAdminNegativeTestJSON-257998267-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:03:58.545031 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-87016b6a-6c30-4cf2-bdf0-e2324db87065 tempest-ServersAdminNegativeTestJSON-257998267 tempest-ServersAdminNegativeTestJSON-257998267-project-admin] [instance: 670ac9fa-8e66-438d-9121-77c45e7a0b56] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:58.554155 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-87016b6a-6c30-4cf2-bdf0-e2324db87065 tempest-ServersAdminNegativeTestJSON-257998267 tempest-ServersAdminNegativeTestJSON-257998267-project-admin] HTTP exception thrown: Instance 670ac9fa-8e66-438d-9121-77c45e7a0b56 could not be found. Aug 10 23:03:58.568619 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-87016b6a-6c30-4cf2-bdf0-e2324db87065 tempest-ServersAdminNegativeTestJSON-257998267 tempest-ServersAdminNegativeTestJSON-257998267-project-admin] Request method failure captured: Aug 10 23:03:58.568619 n-d-850468-14 devstack@n-api.service[122633]: request: POST /compute/v2.1/servers/670ac9fa-8e66-438d-9121-77c45e7a0b56/action HTTP/1.1 Aug 10 23:03:58.568619 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:03:58.568619 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:03:58.568619 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:03:58.568619 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 15 Aug 10 23:03:58.568619 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:03:58.568619 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:03:58.568619 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:03:58.568619 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:03:58.568619 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9DlI1CoD5kLKbxHT3eVw_3GSVtvU34hkR3k_tXUUAsYJrpGYUMoEh0LSe64EH2AEKCxJjZe2Aq4pljcPSr1IJ1gI4N3woLCH-6ktCr52lygl9P077CyMqJZ7Wy37I7dZ7zFopkA229VzEzgCQb38Wij8wVfhy-ymklq6wyrhrwMpAW0 Aug 10 23:03:58.568619 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:03:58.568619 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:03:58.568619 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:03:58.568619 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:03:58.568619 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:03:58.568619 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:03:58.568619 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: f0458bb7c6284928adaa2efc3710e70d Aug 10 23:03:58.568619 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-257998267 Aug 10 23:03:58.568619 n-d-850468-14 devstack@n-api.service[122633]: X-Role: admin,member,reader Aug 10 23:03:58.568619 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: admin,member,reader Aug 10 23:03:58.569690 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f0458bb7c6284928adaa2efc3710e70d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f0458bb7c6284928adaa2efc3710e70d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/f0458bb7c6284928adaa2efc3710e70d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_f0458bb7c6284928adaa2efc3710e70d", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:03:58.569690 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-ServersAdminNegativeTestJSON-257998267 Aug 10 23:03:58.569690 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: f0458bb7c6284928adaa2efc3710e70d Aug 10 23:03:58.569690 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-257998267 Aug 10 23:03:58.569690 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-ServersAdminNegativeTestJSON-257998267-project-admin Aug 10 23:03:58.569690 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:03:58.569690 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:03:58.569690 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 3690a2c07fd74a5b93032acc152c2752 Aug 10 23:03:58.569690 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-ServersAdminNegativeTestJSON-257998267-project-admin Aug 10 23:03:58.569690 n-d-850468-14 devstack@n-api.service[122633]: Aug 10 23:03:58.569690 n-d-850468-14 devstack@n-api.service[122633]: {"migrate": {}} Aug 10 23:03:58.569690 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:03:58.569690 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance 670ac9fa-8e66-438d-9121-77c45e7a0b56 could not be found. Aug 10 23:03:58.571093 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': '670ac9fa-8e66-438d-9121-77c45e7a0b56', 'body': {'migrate': {}}} Aug 10 23:03:58.571093 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:03:58.571093 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:03:58.571093 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:03:58.571093 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:03:58.571093 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:03:58.571093 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:03:58.571093 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 10 23:03:58.571093 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 10 23:03:58.571093 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 670ac9fa-8e66-438d-9121-77c45e7a0b56 could not be found. Aug 10 23:03:58.571093 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:03:58.571093 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:03:58.571093 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:03:58.571093 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:03:58.571093 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:03:58.571093 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:03:58.571093 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:03:58.571093 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:03:58.571093 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:03:58.571093 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:03:58.572734 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 23:03:58.572734 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 23:03:58.572734 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Aug 10 23:03:58.572734 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Aug 10 23:03:58.572734 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:03:58.572734 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:03:58.572734 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 670ac9fa-8e66-438d-9121-77c45e7a0b56 could not be found. Aug 10 23:03:58.572734 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:03:58.572734 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:03:58.572734 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:03:58.572734 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:03:58.572734 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:03:58.572734 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:03:58.572734 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:03:58.572734 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:03:58.572734 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 670ac9fa-8e66-438d-9121-77c45e7a0b56 could not be found. Aug 10 23:03:58.572734 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:03:58.576068 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-87016b6a-6c30-4cf2-bdf0-e2324db87065 tempest-ServersAdminNegativeTestJSON-257998267 tempest-ServersAdminNegativeTestJSON-257998267-project-admin] Returning 404 to user: Instance 670ac9fa-8e66-438d-9121-77c45e7a0b56 could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:03:58.577379 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-87016b6a-6c30-4cf2-bdf0-e2324db87065 tempest-ServersAdminNegativeTestJSON-257998267 tempest-ServersAdminNegativeTestJSON-257998267-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/670ac9fa-8e66-438d-9121-77c45e7a0b56/action" status: 404 len: 111 microversion: 2.1 time: 0.570358 Aug 10 23:03:58.578653 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 974/1933] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:03:58 2022] POST /compute/v2.1/servers/670ac9fa-8e66-438d-9121-77c45e7a0b56/action => generated 111 bytes in 572 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:03:58.718153 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-8bd0b98b-f810-467b-a950-883600305294 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-2141486897", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:03:58.799915 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.network.neutron [None req-8bd0b98b-f810-467b-a950-883600305294 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] validate_networks() for None {{(pid=122632) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 23:03:59.480809 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-239f6801-0a80-49f4-a014-6b0cd1fd705d tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:59.482285 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-239f6801-0a80-49f4-a014-6b0cd1fd705d tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] [instance: 63d2bd74-d060-4925-9323-b39d5131f958] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:59.495815 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-239f6801-0a80-49f4-a014-6b0cd1fd705d tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:59.499734 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-239f6801-0a80-49f4-a014-6b0cd1fd705d tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:59.500311 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-239f6801-0a80-49f4-a014-6b0cd1fd705d tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:59.501273 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-239f6801-0a80-49f4-a014-6b0cd1fd705d tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:59.503617 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-239f6801-0a80-49f4-a014-6b0cd1fd705d tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:59.504187 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-239f6801-0a80-49f4-a014-6b0cd1fd705d tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:59.583094 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-8bd0b98b-f810-467b-a950-883600305294 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Flavor limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:03:59.583525 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-8bd0b98b-f810-467b-a950-883600305294 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Image limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:03:59.584068 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-8bd0b98b-f810-467b-a950-883600305294 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Flavor pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:03:59.584534 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-8bd0b98b-f810-467b-a950-883600305294 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Image pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:03:59.585182 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-8bd0b98b-f810-467b-a950-883600305294 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:03:59.633299 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8bd0b98b-f810-467b-a950-883600305294 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:59.635446 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8bd0b98b-f810-467b-a950-883600305294 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:59.636298 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8bd0b98b-f810-467b-a950-883600305294 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:59.637573 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8bd0b98b-f810-467b-a950-883600305294 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:59.639669 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8bd0b98b-f810-467b-a950-883600305294 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:59.641369 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8bd0b98b-f810-467b-a950-883600305294 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:59.670024 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-8bd0b98b-f810-467b-a950-883600305294 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Getting quotas for project c8a6ac1a984c478da9337692485d16ea. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:03:59.673310 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:03:59.678036 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-8bd0b98b-f810-467b-a950-883600305294 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Getting quotas for user 11c26e69e2274083916402c96d71c5a7 and project c8a6ac1a984c478da9337692485d16ea. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:03:59.701233 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-8bd0b98b-f810-467b-a950-883600305294 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Going to run 1 instances... {{(pid=122632) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 23:03:59.704270 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-8bd0b98b-f810-467b-a950-883600305294 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] [instance: 0eb8b76a-370b-423d-a053-d2befea52a4b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78ad8905-f66f-4733-8be9-2b260f1fabed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122632) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 23:03:59.777054 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-8bd0b98b-f810-467b-a950-883600305294 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.065265 Aug 10 23:03:59.786739 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 960/1934] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 23:03:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 1076 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 23:03:59.794368 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-dfa8a47d-ea97-4067-9346-aa42e5c2da91 req-5b62121d-0b71-49ad-98e9-025f769ead28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63d2bd74-d060-4925-9323-b39d5131f958", "name": "network-vif-unplugged", "status": "completed", "tag": "6375592d-fb15-4844-83aa-70296bc72a55"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:03:59.822827 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-dfa8a47d-ea97-4067-9346-aa42e5c2da91 req-5b62121d-0b71-49ad-98e9-025f769ead28 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:03:59.824047 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-dfa8a47d-ea97-4067-9346-aa42e5c2da91 req-5b62121d-0b71-49ad-98e9-025f769ead28 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:03:59.824644 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-dfa8a47d-ea97-4067-9346-aa42e5c2da91 req-5b62121d-0b71-49ad-98e9-025f769ead28 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:03:59.844217 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-dfa8a47d-ea97-4067-9346-aa42e5c2da91 req-5b62121d-0b71-49ad-98e9-025f769ead28 service nova] Creating event network-vif-unplugged:6375592d-fb15-4844-83aa-70296bc72a55 for instance 63d2bd74-d060-4925-9323-b39d5131f958 on n-h1-850468-14 Aug 10 23:03:59.851189 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-dfa8a47d-ea97-4067-9346-aa42e5c2da91 req-5b62121d-0b71-49ad-98e9-025f769ead28 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.061437 Aug 10 23:03:59.852515 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 961/1935] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:03:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:03:59.866138 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-e7fcd4a8-8c7e-4337-ba81-b555a92434db tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:03:59.868319 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-e7fcd4a8-8c7e-4337-ba81-b555a92434db tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] [instance: 0eb8b76a-370b-423d-a053-d2befea52a4b] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:03:59.982628 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-239f6801-0a80-49f4-a014-6b0cd1fd705d tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632904331d024d9b8e4d3660dff2cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ed0bdee3aa4013bd9219069bda558c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:59.994461 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-e7fcd4a8-8c7e-4337-ba81-b555a92434db tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c26e69e2274083916402c96d71c5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a6ac1a984c478da9337692485d16ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:03:59.996807 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-239f6801-0a80-49f4-a014-6b0cd1fd705d tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] 10.222.0.58 "GET /compute/v2.1/servers/63d2bd74-d060-4925-9323-b39d5131f958" status: 200 len: 1392 microversion: 2.1 time: 0.520582 Aug 10 23:03:59.999114 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 975/1936] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:03:59 2022] GET /compute/v2.1/servers/63d2bd74-d060-4925-9323-b39d5131f958 => generated 1392 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:04:00.010980 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-e7fcd4a8-8c7e-4337-ba81-b555a92434db tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] 10.222.0.58 "GET /compute/v2.1/servers/0eb8b76a-370b-423d-a053-d2befea52a4b" status: 200 len: 1222 microversion: 2.1 time: 0.156385 Aug 10 23:04:00.011583 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 962/1937] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:03:59 2022] GET /compute/v2.1/servers/0eb8b76a-370b-423d-a053-d2befea52a4b => generated 1222 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:04:01.025876 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-91006457-39e6-4ffb-827f-a8dc8613153e tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:04:01.027684 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-91006457-39e6-4ffb-827f-a8dc8613153e tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] [instance: 63d2bd74-d060-4925-9323-b39d5131f958] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:04:01.050754 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-91006457-39e6-4ffb-827f-a8dc8613153e tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:01.052941 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-91006457-39e6-4ffb-827f-a8dc8613153e tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:01.053634 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-91006457-39e6-4ffb-827f-a8dc8613153e tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:01.056461 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-91006457-39e6-4ffb-827f-a8dc8613153e tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:01.058501 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-91006457-39e6-4ffb-827f-a8dc8613153e tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:01.059668 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-91006457-39e6-4ffb-827f-a8dc8613153e tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:01.266241 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-4dde60a4-032c-4726-ad10-cca6a47aa4a7 tempest-SecurityGroupRulesNegativeTestJSON-1048289237 tempest-SecurityGroupRulesNegativeTestJSON-1048289237-project] Action: 'create', calling method: .version_select at 0x7f8482382160>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-200360570", "description": "tempest-description-872678240"}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:04:02.098485 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-91006457-39e6-4ffb-827f-a8dc8613153e tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632904331d024d9b8e4d3660dff2cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ed0bdee3aa4013bd9219069bda558c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:04:02.109907 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-91006457-39e6-4ffb-827f-a8dc8613153e tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] 10.222.0.58 "GET /compute/v2.1/servers/63d2bd74-d060-4925-9323-b39d5131f958" status: 200 len: 1392 microversion: 2.1 time: 1.090936 Aug 10 23:04:02.112181 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 963/1938] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:04:01 2022] GET /compute/v2.1/servers/63d2bd74-d060-4925-9323-b39d5131f958 => generated 1392 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:04:02.127231 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-eeadf26e-657e-430e-8831-9448aaee8939 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:04:02.128889 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-eeadf26e-657e-430e-8831-9448aaee8939 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] [instance: 0eb8b76a-370b-423d-a053-d2befea52a4b] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:04:02.145111 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-eeadf26e-657e-430e-8831-9448aaee8939 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:02.146580 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-eeadf26e-657e-430e-8831-9448aaee8939 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:02.147940 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-eeadf26e-657e-430e-8831-9448aaee8939 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:02.150992 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-eeadf26e-657e-430e-8831-9448aaee8939 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:02.153328 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-eeadf26e-657e-430e-8831-9448aaee8939 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:02.154130 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-eeadf26e-657e-430e-8831-9448aaee8939 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:02.362066 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-eeadf26e-657e-430e-8831-9448aaee8939 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c26e69e2274083916402c96d71c5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a6ac1a984c478da9337692485d16ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:04:02.375929 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-eeadf26e-657e-430e-8831-9448aaee8939 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] 10.222.0.58 "GET /compute/v2.1/servers/0eb8b76a-370b-423d-a053-d2befea52a4b" status: 200 len: 1280 microversion: 2.1 time: 0.253280 Aug 10 23:04:02.380415 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 964/1939] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:04:02 2022] GET /compute/v2.1/servers/0eb8b76a-370b-423d-a053-d2befea52a4b => generated 1280 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:04:02.392613 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-a82dff2e-e72a-43e4-9eb1-406f21247fa7 req-0aad8083-ad18-46d9-b6cd-18a39fb12cda service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63d2bd74-d060-4925-9323-b39d5131f958", "tag": "6375592d-fb15-4844-83aa-70296bc72a55"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:04:02.436048 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-a82dff2e-e72a-43e4-9eb1-406f21247fa7 req-0aad8083-ad18-46d9-b6cd-18a39fb12cda service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:02.436811 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-a82dff2e-e72a-43e4-9eb1-406f21247fa7 req-0aad8083-ad18-46d9-b6cd-18a39fb12cda service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:02.437648 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-a82dff2e-e72a-43e4-9eb1-406f21247fa7 req-0aad8083-ad18-46d9-b6cd-18a39fb12cda service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:02.450466 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-4dde60a4-032c-4726-ad10-cca6a47aa4a7 tempest-SecurityGroupRulesNegativeTestJSON-1048289237 tempest-SecurityGroupRulesNegativeTestJSON-1048289237-project] 10.222.0.58 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 1.867340 Aug 10 23:04:02.451074 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 976/1940] 10.222.0.58 () {60 vars in 1180 bytes} [Wed Aug 10 23:04:00 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 1869 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:04:02.466859 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-2456b422-1019-45e4-8104-8d8c7c9aae48 tempest-SecurityGroupRulesNegativeTestJSON-1048289237 tempest-SecurityGroupRulesNegativeTestJSON-1048289237-project] Action: 'create', calling method: .version_select at 0x7f8482397280>, body: {"security_group_rule": {"parent_group_id": "a86f3d23-b72a-4469-9d63-36e5beb1cc1c", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:04:02.468054 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-a82dff2e-e72a-43e4-9eb1-406f21247fa7 req-0aad8083-ad18-46d9-b6cd-18a39fb12cda service nova] Creating event network-changed:6375592d-fb15-4844-83aa-70296bc72a55 for instance 63d2bd74-d060-4925-9323-b39d5131f958 on n-h1-850468-14 Aug 10 23:04:02.480698 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-a82dff2e-e72a-43e4-9eb1-406f21247fa7 req-0aad8083-ad18-46d9-b6cd-18a39fb12cda service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097127 Aug 10 23:04:02.483377 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 965/1941] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:04:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:04:03.140203 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-e3539ebd-b0df-48fe-bf3b-69d78f734fd0 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:04:03.141194 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-e3539ebd-b0df-48fe-bf3b-69d78f734fd0 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] [instance: 63d2bd74-d060-4925-9323-b39d5131f958] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:04:03.206434 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e3539ebd-b0df-48fe-bf3b-69d78f734fd0 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:03.206986 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e3539ebd-b0df-48fe-bf3b-69d78f734fd0 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:03.207429 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e3539ebd-b0df-48fe-bf3b-69d78f734fd0 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:03.212446 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e3539ebd-b0df-48fe-bf3b-69d78f734fd0 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:03.215049 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e3539ebd-b0df-48fe-bf3b-69d78f734fd0 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:03.215676 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e3539ebd-b0df-48fe-bf3b-69d78f734fd0 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:03.885950 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-2456b422-1019-45e4-8104-8d8c7c9aae48 tempest-SecurityGroupRulesNegativeTestJSON-1048289237 tempest-SecurityGroupRulesNegativeTestJSON-1048289237-project] 10.222.0.58 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 1.420842 Aug 10 23:04:03.887058 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 977/1942] 10.222.0.58 () {60 vars in 1195 bytes} [Wed Aug 10 23:04:02 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 1425 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:04:03.891394 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-b1a432d6-6db5-40fc-898f-728d851fffe8 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:04:03.892012 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-b1a432d6-6db5-40fc-898f-728d851fffe8 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] [instance: 0eb8b76a-370b-423d-a053-d2befea52a4b] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:04:03.911310 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b1a432d6-6db5-40fc-898f-728d851fffe8 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:03.911835 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b1a432d6-6db5-40fc-898f-728d851fffe8 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:03.912285 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b1a432d6-6db5-40fc-898f-728d851fffe8 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:03.913449 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b1a432d6-6db5-40fc-898f-728d851fffe8 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:03.913765 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b1a432d6-6db5-40fc-898f-728d851fffe8 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:03.914034 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b1a432d6-6db5-40fc-898f-728d851fffe8 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:04.062814 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-e3539ebd-b0df-48fe-bf3b-69d78f734fd0 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632904331d024d9b8e4d3660dff2cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ed0bdee3aa4013bd9219069bda558c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:04:04.074799 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-e3539ebd-b0df-48fe-bf3b-69d78f734fd0 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] 10.222.0.58 "GET /compute/v2.1/servers/63d2bd74-d060-4925-9323-b39d5131f958" status: 200 len: 1392 microversion: 2.1 time: 0.943202 Aug 10 23:04:04.083668 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 966/1943] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:04:03 2022] GET /compute/v2.1/servers/63d2bd74-d060-4925-9323-b39d5131f958 => generated 1392 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:04:04.089397 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-f9957de5-5e86-4d86-8cb6-c69eb7a41220 tempest-SecurityGroupRulesNegativeTestJSON-1048289237 tempest-SecurityGroupRulesNegativeTestJSON-1048289237-project] Action: 'create', calling method: .version_select at 0x7f847d0841f0>, body: {"security_group_rule": {"parent_group_id": "a86f3d23-b72a-4469-9d63-36e5beb1cc1c", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:04:04.128201 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-b1a432d6-6db5-40fc-898f-728d851fffe8 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c26e69e2274083916402c96d71c5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a6ac1a984c478da9337692485d16ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:04:04.135053 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:04:04.138237 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-b1a432d6-6db5-40fc-898f-728d851fffe8 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] 10.222.0.58 "GET /compute/v2.1/servers/0eb8b76a-370b-423d-a053-d2befea52a4b" status: 200 len: 1280 microversion: 2.1 time: 0.250569 Aug 10 23:04:04.149321 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 978/1944] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:04:03 2022] GET /compute/v2.1/servers/0eb8b76a-370b-423d-a053-d2befea52a4b => generated 1280 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:04:04.425762 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-f9957de5-5e86-4d86-8cb6-c69eb7a41220 tempest-SecurityGroupRulesNegativeTestJSON-1048289237 tempest-SecurityGroupRulesNegativeTestJSON-1048289237-project] HTTP exception thrown: This rule already exists in group a86f3d23-b72a-4469-9d63-36e5beb1cc1c Aug 10 23:04:04.432459 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-f9957de5-5e86-4d86-8cb6-c69eb7a41220 tempest-SecurityGroupRulesNegativeTestJSON-1048289237 tempest-SecurityGroupRulesNegativeTestJSON-1048289237-project] Request method failure captured: Aug 10 23:04:04.432459 n-d-850468-14 devstack@n-api.service[122632]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 10 23:04:04.432459 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:04:04.432459 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:04:04.432459 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:04:04.432459 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 138 Aug 10 23:04:04.432459 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:04:04.432459 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:04:04.432459 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:04:04.432459 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:04:04.432459 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9Dlg_2kWvRFNefN2DUjhFdwHY3IeWV3F1RVYcFaSdW0-0iOxEAur_GBk7eEg3Za67LQk78oj12JOeFzCFmluAsns1PGlZsD-dNOocOyRvFXLMf0tlySA1MeaK5ASHwoXvOsoyEHOsOqxxmf26sPMbxkA90J_ZIL288geRnjKQPt95vM Aug 10 23:04:04.432459 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:04:04.432459 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:04:04.432459 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:04:04.432459 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:04:04.432459 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:04:04.432459 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:04:04.432459 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 924dad36295b48d2843af833a242549a Aug 10 23:04:04.432459 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1048289237 Aug 10 23:04:04.432459 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:04:04.432459 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:04:04.436113 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/924dad36295b48d2843af833a242549a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/924dad36295b48d2843af833a242549a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/924dad36295b48d2843af833a242549a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_924dad36295b48d2843af833a242549a", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:04:04.436113 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1048289237 Aug 10 23:04:04.436113 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 924dad36295b48d2843af833a242549a Aug 10 23:04:04.436113 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1048289237 Aug 10 23:04:04.436113 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1048289237-project Aug 10 23:04:04.436113 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:04:04.436113 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:04:04.436113 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: 7b9270a92af446dc8300122b87ef323a Aug 10 23:04:04.436113 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1048289237-project Aug 10 23:04:04.436113 n-d-850468-14 devstack@n-api.service[122632]: Aug 10 23:04:04.436113 n-d-850468-14 devstack@n-api.service[122632]: {"security_group_rule": {"parent_group_id": "a86f3d23-b72a-4469-9d63-36e5beb1cc1c", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Aug 10 23:04:04.436113 n-d-850468-14 devstack@n-api.service[122632]: method: Aug 10 23:04:04.439150 n-d-850468-14 devstack@n-api.service[122632]: exception: This rule already exists in group a86f3d23-b72a-4469-9d63-36e5beb1cc1c Aug 10 23:04:04.439150 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'a86f3d23-b72a-4469-9d63-36e5beb1cc1c', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Aug 10 23:04:04.439150 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:04:04.439150 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:04:04.439150 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Aug 10 23:04:04.439150 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Aug 10 23:04:04.439150 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Aug 10 23:04:04.439150 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Aug 10 23:04:04.439150 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group a86f3d23-b72a-4469-9d63-36e5beb1cc1c Aug 10 23:04:04.439150 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:04:04.439150 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:04:04.439150 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:04:04.439150 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:04:04.439150 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:04:04.439150 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:04:04.439150 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:04:04.439150 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:04:04.439150 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 23:04:04.439150 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 23:04:04.439150 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:04:04.441786 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:04:04.441786 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Aug 10 23:04:04.441786 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 10 23:04:04.441786 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group a86f3d23-b72a-4469-9d63-36e5beb1cc1c Aug 10 23:04:04.441786 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:04:04.441786 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:04:04.441786 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:04:04.441786 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:04:04.441786 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:04:04.441786 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:04:04.441786 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:04:04.441786 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:04:04.441786 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group a86f3d23-b72a-4469-9d63-36e5beb1cc1c Aug 10 23:04:04.441786 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:04:04.446164 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-f9957de5-5e86-4d86-8cb6-c69eb7a41220 tempest-SecurityGroupRulesNegativeTestJSON-1048289237 tempest-SecurityGroupRulesNegativeTestJSON-1048289237-project] Returning 400 to user: This rule already exists in group a86f3d23-b72a-4469-9d63-36e5beb1cc1c {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:04:04.447570 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-f9957de5-5e86-4d86-8cb6-c69eb7a41220 tempest-SecurityGroupRulesNegativeTestJSON-1048289237 tempest-SecurityGroupRulesNegativeTestJSON-1048289237-project] 10.222.0.58 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.362659 Aug 10 23:04:04.449487 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 967/1945] 10.222.0.58 () {60 vars in 1195 bytes} [Wed Aug 10 23:04:04 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 364 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 10 23:04:04.457530 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-d44180fa-f24b-43b4-989b-ff1e73078f84 tempest-SecurityGroupRulesNegativeTestJSON-1048289237 tempest-SecurityGroupRulesNegativeTestJSON-1048289237-project] Calling method '.version_select at 0x7f8482397670>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:04:04.465597 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=14 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:04:05.108078 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-31186be8-1e8b-4dd8-b8e9-c5146592a27b tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:04:05.108851 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-31186be8-1e8b-4dd8-b8e9-c5146592a27b tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] [instance: 63d2bd74-d060-4925-9323-b39d5131f958] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:04:05.139116 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-31186be8-1e8b-4dd8-b8e9-c5146592a27b tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:05.145750 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-31186be8-1e8b-4dd8-b8e9-c5146592a27b tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:05.147155 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-31186be8-1e8b-4dd8-b8e9-c5146592a27b tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:05.150354 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-31186be8-1e8b-4dd8-b8e9-c5146592a27b tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:05.155155 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-31186be8-1e8b-4dd8-b8e9-c5146592a27b tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:05.155699 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-31186be8-1e8b-4dd8-b8e9-c5146592a27b tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:05.832475 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-31186be8-1e8b-4dd8-b8e9-c5146592a27b tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632904331d024d9b8e4d3660dff2cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ed0bdee3aa4013bd9219069bda558c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:04:05.852737 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-31186be8-1e8b-4dd8-b8e9-c5146592a27b tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] 10.222.0.58 "GET /compute/v2.1/servers/63d2bd74-d060-4925-9323-b39d5131f958" status: 200 len: 1392 microversion: 2.1 time: 0.750467 Aug 10 23:04:05.871256 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 968/1946] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:04:05 2022] GET /compute/v2.1/servers/63d2bd74-d060-4925-9323-b39d5131f958 => generated 1392 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:04:05.879243 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-acbe7010-a931-4b78-a8cc-cd484b8eb5b3 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:04:05.880324 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-acbe7010-a931-4b78-a8cc-cd484b8eb5b3 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] [instance: 0eb8b76a-370b-423d-a053-d2befea52a4b] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:04:05.887871 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-d44180fa-f24b-43b4-989b-ff1e73078f84 tempest-SecurityGroupRulesNegativeTestJSON-1048289237 tempest-SecurityGroupRulesNegativeTestJSON-1048289237-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-group-rules/317d20a8-9629-405a-ac11-b98053c88ad3" status: 202 len: 0 microversion: 2.1 time: 1.434595 Aug 10 23:04:05.888608 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 979/1947] 10.222.0.58 () {58 vars in 1287 bytes} [Wed Aug 10 23:04:04 2022] DELETE /compute/v2.1/os-security-group-rules/317d20a8-9629-405a-ac11-b98053c88ad3 => generated 0 bytes in 1436 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:04:05.890242 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-acbe7010-a931-4b78-a8cc-cd484b8eb5b3 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:05.890953 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-acbe7010-a931-4b78-a8cc-cd484b8eb5b3 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:05.893084 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-acbe7010-a931-4b78-a8cc-cd484b8eb5b3 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:05.894442 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-acbe7010-a931-4b78-a8cc-cd484b8eb5b3 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:05.895351 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-acbe7010-a931-4b78-a8cc-cd484b8eb5b3 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:05.895945 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-acbe7010-a931-4b78-a8cc-cd484b8eb5b3 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:05.898401 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-99305d1d-190d-47ec-ba7a-4f98d2911326 tempest-SecurityGroupRulesNegativeTestJSON-1048289237 tempest-SecurityGroupRulesNegativeTestJSON-1048289237-project] Action: 'create', calling method: .version_select at 0x7f847d4290d0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-275173139", "description": "tempest-description-1545734418"}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:04:06.778798 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-acbe7010-a931-4b78-a8cc-cd484b8eb5b3 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c26e69e2274083916402c96d71c5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a6ac1a984c478da9337692485d16ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:04:06.793336 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-acbe7010-a931-4b78-a8cc-cd484b8eb5b3 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] 10.222.0.58 "GET /compute/v2.1/servers/0eb8b76a-370b-423d-a053-d2befea52a4b" status: 200 len: 1322 microversion: 2.1 time: 0.920706 Aug 10 23:04:06.796990 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 969/1948] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:04:05 2022] GET /compute/v2.1/servers/0eb8b76a-370b-423d-a053-d2befea52a4b => generated 1322 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:04:06.889235 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-0af7224c-04f9-4996-abae-e0e4711ea97f tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:04:06.891518 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-0af7224c-04f9-4996-abae-e0e4711ea97f tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] [instance: 63d2bd74-d060-4925-9323-b39d5131f958] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:04:06.909886 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0af7224c-04f9-4996-abae-e0e4711ea97f tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:06.910695 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0af7224c-04f9-4996-abae-e0e4711ea97f tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:06.911274 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0af7224c-04f9-4996-abae-e0e4711ea97f tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:06.912098 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0af7224c-04f9-4996-abae-e0e4711ea97f tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:06.913813 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0af7224c-04f9-4996-abae-e0e4711ea97f tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:06.917648 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0af7224c-04f9-4996-abae-e0e4711ea97f tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:07.765360 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-0af7224c-04f9-4996-abae-e0e4711ea97f tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632904331d024d9b8e4d3660dff2cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ed0bdee3aa4013bd9219069bda558c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:04:07.777150 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-0af7224c-04f9-4996-abae-e0e4711ea97f tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] 10.222.0.58 "GET /compute/v2.1/servers/63d2bd74-d060-4925-9323-b39d5131f958" status: 200 len: 1392 microversion: 2.1 time: 0.902430 Aug 10 23:04:07.783507 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 970/1949] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:04:06 2022] GET /compute/v2.1/servers/63d2bd74-d060-4925-9323-b39d5131f958 => generated 1392 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:04:07.820551 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-7144a2e0-028b-474f-8849-952d017aaace tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:04:07.822007 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-7144a2e0-028b-474f-8849-952d017aaace tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] [instance: 0eb8b76a-370b-423d-a053-d2befea52a4b] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:04:07.832170 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7144a2e0-028b-474f-8849-952d017aaace tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:07.833595 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7144a2e0-028b-474f-8849-952d017aaace tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:07.834199 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7144a2e0-028b-474f-8849-952d017aaace tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:07.836240 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7144a2e0-028b-474f-8849-952d017aaace tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:07.836902 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7144a2e0-028b-474f-8849-952d017aaace tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:07.837810 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7144a2e0-028b-474f-8849-952d017aaace tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:07.925449 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-99305d1d-190d-47ec-ba7a-4f98d2911326 tempest-SecurityGroupRulesNegativeTestJSON-1048289237 tempest-SecurityGroupRulesNegativeTestJSON-1048289237-project] 10.222.0.58 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 2.031296 Aug 10 23:04:07.950035 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 980/1950] 10.222.0.58 () {60 vars in 1180 bytes} [Wed Aug 10 23:04:05 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 2056 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 23:04:07.973841 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-8c8afed3-ec33-4d18-8d76-390f7b29dee7 tempest-SecurityGroupRulesNegativeTestJSON-1048289237 tempest-SecurityGroupRulesNegativeTestJSON-1048289237-project] Action: 'create', calling method: .version_select at 0x7f848238edc0>, body: {"security_group_rule": {"parent_group_id": "6536efd3-81f2-4d1c-b577-d28b24becb3c", "ip_protocol": "tcp", "from_port": 719588203, "to_port": 22}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:04:08.160217 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-7144a2e0-028b-474f-8849-952d017aaace tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c26e69e2274083916402c96d71c5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a6ac1a984c478da9337692485d16ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:04:08.174306 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-7144a2e0-028b-474f-8849-952d017aaace tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] 10.222.0.58 "GET /compute/v2.1/servers/0eb8b76a-370b-423d-a053-d2befea52a4b" status: 200 len: 1322 microversion: 2.1 time: 0.360404 Aug 10 23:04:08.213575 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 971/1951] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:04:07 2022] GET /compute/v2.1/servers/0eb8b76a-370b-423d-a053-d2befea52a4b => generated 1322 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:04:08.222561 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-24057e9c-8273-4a74-9bb2-aac479ea9dc8 req-d6612e9d-217c-48e0-be31-783ebd5c3ee2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0eb8b76a-370b-423d-a053-d2befea52a4b", "tag": "d0e21f83-9eb8-45d7-8e17-c0b4fcc59561"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:04:08.244084 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-24057e9c-8273-4a74-9bb2-aac479ea9dc8 req-d6612e9d-217c-48e0-be31-783ebd5c3ee2 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:08.246211 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-24057e9c-8273-4a74-9bb2-aac479ea9dc8 req-d6612e9d-217c-48e0-be31-783ebd5c3ee2 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:08.246883 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-24057e9c-8273-4a74-9bb2-aac479ea9dc8 req-d6612e9d-217c-48e0-be31-783ebd5c3ee2 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:08.274060 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-24057e9c-8273-4a74-9bb2-aac479ea9dc8 req-d6612e9d-217c-48e0-be31-783ebd5c3ee2 service nova] Creating event network-changed:d0e21f83-9eb8-45d7-8e17-c0b4fcc59561 for instance 0eb8b76a-370b-423d-a053-d2befea52a4b on n-h2-850468-14 Aug 10 23:04:08.288122 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-24057e9c-8273-4a74-9bb2-aac479ea9dc8 req-d6612e9d-217c-48e0-be31-783ebd5c3ee2 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071352 Aug 10 23:04:08.291540 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 972/1952] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:04:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:04:08.363060 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-8c8afed3-ec33-4d18-8d76-390f7b29dee7 tempest-SecurityGroupRulesNegativeTestJSON-1048289237 tempest-SecurityGroupRulesNegativeTestJSON-1048289237-project] HTTP exception thrown: Invalid port range 719588203:22. Former value cannot be greater than the later Aug 10 23:04:08.365656 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-8c8afed3-ec33-4d18-8d76-390f7b29dee7 tempest-SecurityGroupRulesNegativeTestJSON-1048289237 tempest-SecurityGroupRulesNegativeTestJSON-1048289237-project] Request method failure captured: Aug 10 23:04:08.365656 n-d-850468-14 devstack@n-api.service[122633]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 10 23:04:08.365656 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:04:08.365656 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:04:08.365656 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:04:08.365656 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 145 Aug 10 23:04:08.365656 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:04:08.365656 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:04:08.365656 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:04:08.365656 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:04:08.365656 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9Dlg_2kWvRFNefN2DUjhFdwHY3IeWV3F1RVYcFaSdW0-0iOxEAur_GBk7eEg3Za67LQk78oj12JOeFzCFmluAsns1PGlZsD-dNOocOyRvFXLMf0tlySA1MeaK5ASHwoXvOsoyEHOsOqxxmf26sPMbxkA90J_ZIL288geRnjKQPt95vM Aug 10 23:04:08.365656 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:04:08.365656 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:04:08.365656 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:04:08.365656 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:04:08.365656 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:04:08.365656 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:04:08.365656 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 924dad36295b48d2843af833a242549a Aug 10 23:04:08.365656 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1048289237 Aug 10 23:04:08.365656 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:04:08.365656 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:04:08.366849 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/924dad36295b48d2843af833a242549a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/924dad36295b48d2843af833a242549a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/924dad36295b48d2843af833a242549a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_924dad36295b48d2843af833a242549a", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:04:08.366849 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1048289237 Aug 10 23:04:08.366849 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 924dad36295b48d2843af833a242549a Aug 10 23:04:08.366849 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1048289237 Aug 10 23:04:08.366849 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1048289237-project Aug 10 23:04:08.366849 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:04:08.366849 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:04:08.366849 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 7b9270a92af446dc8300122b87ef323a Aug 10 23:04:08.366849 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1048289237-project Aug 10 23:04:08.366849 n-d-850468-14 devstack@n-api.service[122633]: Aug 10 23:04:08.366849 n-d-850468-14 devstack@n-api.service[122633]: {"security_group_rule": {"parent_group_id": "6536efd3-81f2-4d1c-b577-d28b24becb3c", "ip_protocol": "tcp", "from_port": 719588203, "to_port": 22}} Aug 10 23:04:08.366849 n-d-850468-14 devstack@n-api.service[122633]: method: Aug 10 23:04:08.367509 n-d-850468-14 devstack@n-api.service[122633]: exception: Invalid port range 719588203:22. Former value cannot be greater than the later Aug 10 23:04:08.367509 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'body': {'security_group_rule': {'parent_group_id': '6536efd3-81f2-4d1c-b577-d28b24becb3c', 'ip_protocol': 'tcp', 'from_port': 719588203, 'to_port': 22}}} Aug 10 23:04:08.367509 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:04:08.367509 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:04:08.367509 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Aug 10 23:04:08.367509 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Aug 10 23:04:08.367509 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Aug 10 23:04:08.367509 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Aug 10 23:04:08.367509 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Aug 10 23:04:08.367509 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Aug 10 23:04:08.367509 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Aug 10 23:04:08.367509 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Aug 10 23:04:08.367509 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 719588203:22. Former value cannot be greater than the later Aug 10 23:04:08.367509 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:04:08.367509 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:04:08.367509 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:04:08.367509 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:04:08.367509 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:04:08.367509 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:04:08.369167 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:04:08.369167 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:04:08.369167 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 23:04:08.369167 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 23:04:08.369167 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:04:08.369167 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:04:08.369167 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 10 23:04:08.369167 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 10 23:04:08.369167 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 719588203:22. Former value cannot be greater than the later Aug 10 23:04:08.369167 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:04:08.369167 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:04:08.369167 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:04:08.369167 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:04:08.369167 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:04:08.369167 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:04:08.369167 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:04:08.369167 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:04:08.369167 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 719588203:22. Former value cannot be greater than the later Aug 10 23:04:08.369167 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:04:08.370991 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-8c8afed3-ec33-4d18-8d76-390f7b29dee7 tempest-SecurityGroupRulesNegativeTestJSON-1048289237 tempest-SecurityGroupRulesNegativeTestJSON-1048289237-project] Returning 400 to user: Invalid port range 719588203:22. Former value cannot be greater than the later {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:04:08.372443 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-8c8afed3-ec33-4d18-8d76-390f7b29dee7 tempest-SecurityGroupRulesNegativeTestJSON-1048289237 tempest-SecurityGroupRulesNegativeTestJSON-1048289237-project] 10.222.0.58 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 122 microversion: 2.1 time: 0.420846 Aug 10 23:04:08.380106 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 981/1953] 10.222.0.58 () {60 vars in 1195 bytes} [Wed Aug 10 23:04:07 2022] POST /compute/v2.1/os-security-group-rules => generated 122 bytes in 429 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 10 23:04:08.387936 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-b32945f3-d293-43a4-9cf3-68cf78fe23af tempest-SecurityGroupRulesNegativeTestJSON-1048289237 tempest-SecurityGroupRulesNegativeTestJSON-1048289237-project] Action: 'create', calling method: .version_select at 0x7f847d848310>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-2130808322", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:04:08.390092 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-b32945f3-d293-43a4-9cf3-68cf78fe23af tempest-SecurityGroupRulesNegativeTestJSON-1048289237 tempest-SecurityGroupRulesNegativeTestJSON-1048289237-project] HTTP exception thrown: Security group id should be uuid Aug 10 23:04:08.392099 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-b32945f3-d293-43a4-9cf3-68cf78fe23af tempest-SecurityGroupRulesNegativeTestJSON-1048289237 tempest-SecurityGroupRulesNegativeTestJSON-1048289237-project] Request method failure captured: Aug 10 23:04:08.392099 n-d-850468-14 devstack@n-api.service[122632]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 10 23:04:08.392099 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:04:08.392099 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:04:08.392099 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:04:08.392099 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 131 Aug 10 23:04:08.392099 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:04:08.392099 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:04:08.392099 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:04:08.392099 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:04:08.392099 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9Dlg_2kWvRFNefN2DUjhFdwHY3IeWV3F1RVYcFaSdW0-0iOxEAur_GBk7eEg3Za67LQk78oj12JOeFzCFmluAsns1PGlZsD-dNOocOyRvFXLMf0tlySA1MeaK5ASHwoXvOsoyEHOsOqxxmf26sPMbxkA90J_ZIL288geRnjKQPt95vM Aug 10 23:04:08.392099 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:04:08.392099 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:04:08.392099 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:04:08.392099 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:04:08.392099 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:04:08.392099 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:04:08.392099 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 924dad36295b48d2843af833a242549a Aug 10 23:04:08.392099 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1048289237 Aug 10 23:04:08.392099 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:04:08.392099 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:04:08.393225 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/924dad36295b48d2843af833a242549a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/924dad36295b48d2843af833a242549a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/924dad36295b48d2843af833a242549a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_924dad36295b48d2843af833a242549a", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:04:08.393225 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1048289237 Aug 10 23:04:08.393225 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 924dad36295b48d2843af833a242549a Aug 10 23:04:08.393225 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1048289237 Aug 10 23:04:08.393225 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1048289237-project Aug 10 23:04:08.393225 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:04:08.393225 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:04:08.393225 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: 7b9270a92af446dc8300122b87ef323a Aug 10 23:04:08.393225 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1048289237-project Aug 10 23:04:08.393225 n-d-850468-14 devstack@n-api.service[122632]: Aug 10 23:04:08.393225 n-d-850468-14 devstack@n-api.service[122632]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-2130808322", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Aug 10 23:04:08.393225 n-d-850468-14 devstack@n-api.service[122632]: method: Aug 10 23:04:08.393225 n-d-850468-14 devstack@n-api.service[122632]: exception: Security group id should be uuid Aug 10 23:04:08.393847 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-2130808322', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Aug 10 23:04:08.393847 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:04:08.393847 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:04:08.393847 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Aug 10 23:04:08.393847 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Aug 10 23:04:08.393847 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Aug 10 23:04:08.393847 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Aug 10 23:04:08.393847 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Aug 10 23:04:08.393847 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:04:08.393847 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:04:08.393847 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:04:08.393847 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:04:08.393847 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:04:08.393847 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:04:08.393847 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:04:08.393847 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:04:08.393847 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 23:04:08.393847 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 23:04:08.393847 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:04:08.393847 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:04:08.394934 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 10 23:04:08.394934 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 10 23:04:08.394934 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Aug 10 23:04:08.394934 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:04:08.394934 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:04:08.394934 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:04:08.394934 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:04:08.394934 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:04:08.394934 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:04:08.394934 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:04:08.394934 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:04:08.394934 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Aug 10 23:04:08.394934 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:04:08.397569 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-b32945f3-d293-43a4-9cf3-68cf78fe23af tempest-SecurityGroupRulesNegativeTestJSON-1048289237 tempest-SecurityGroupRulesNegativeTestJSON-1048289237-project] Returning 400 to user: Security group id should be uuid {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:04:08.398652 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-b32945f3-d293-43a4-9cf3-68cf78fe23af tempest-SecurityGroupRulesNegativeTestJSON-1048289237 tempest-SecurityGroupRulesNegativeTestJSON-1048289237-project] 10.222.0.58 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.018780 Aug 10 23:04:08.399472 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 973/1954] 10.222.0.58 () {60 vars in 1195 bytes} [Wed Aug 10 23:04:08 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Aug 10 23:04:08.412394 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-36c31bd1-7886-40ab-9643-1d2154228eca tempest-SecurityGroupRulesNegativeTestJSON-1048289237 tempest-SecurityGroupRulesNegativeTestJSON-1048289237-project] Action: 'create', calling method: .version_select at 0x7f8482397040>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1652919877", "description": "tempest-description-1965352397"}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:04:08.809277 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-ea4f78e6-e8f3-4d94-84b7-5996476c7911 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:04:08.810346 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-ea4f78e6-e8f3-4d94-84b7-5996476c7911 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] [instance: 63d2bd74-d060-4925-9323-b39d5131f958] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:04:08.820399 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ea4f78e6-e8f3-4d94-84b7-5996476c7911 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:08.820933 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ea4f78e6-e8f3-4d94-84b7-5996476c7911 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:08.822237 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ea4f78e6-e8f3-4d94-84b7-5996476c7911 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:08.823574 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ea4f78e6-e8f3-4d94-84b7-5996476c7911 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:08.824223 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ea4f78e6-e8f3-4d94-84b7-5996476c7911 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:08.824824 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ea4f78e6-e8f3-4d94-84b7-5996476c7911 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:09.269994 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-ea4f78e6-e8f3-4d94-84b7-5996476c7911 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632904331d024d9b8e4d3660dff2cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ed0bdee3aa4013bd9219069bda558c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:04:09.285804 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-ea4f78e6-e8f3-4d94-84b7-5996476c7911 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] 10.222.0.58 "GET /compute/v2.1/servers/63d2bd74-d060-4925-9323-b39d5131f958" status: 200 len: 1392 microversion: 2.1 time: 0.480771 Aug 10 23:04:09.286549 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 974/1955] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:04:08 2022] GET /compute/v2.1/servers/63d2bd74-d060-4925-9323-b39d5131f958 => generated 1392 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:04:09.298895 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-143bf0a1-d42f-4bab-88ff-cbde4a0ac5f9 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:04:09.299985 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-143bf0a1-d42f-4bab-88ff-cbde4a0ac5f9 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] [instance: 0eb8b76a-370b-423d-a053-d2befea52a4b] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:04:09.312199 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-143bf0a1-d42f-4bab-88ff-cbde4a0ac5f9 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:09.313052 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-143bf0a1-d42f-4bab-88ff-cbde4a0ac5f9 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:09.313503 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-143bf0a1-d42f-4bab-88ff-cbde4a0ac5f9 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:09.314442 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-143bf0a1-d42f-4bab-88ff-cbde4a0ac5f9 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:09.314989 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-143bf0a1-d42f-4bab-88ff-cbde4a0ac5f9 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:09.315430 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-143bf0a1-d42f-4bab-88ff-cbde4a0ac5f9 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:09.653303 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=18 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:04:09.733160 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-143bf0a1-d42f-4bab-88ff-cbde4a0ac5f9 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c26e69e2274083916402c96d71c5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a6ac1a984c478da9337692485d16ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:04:09.750545 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-143bf0a1-d42f-4bab-88ff-cbde4a0ac5f9 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] 10.222.0.58 "GET /compute/v2.1/servers/0eb8b76a-370b-423d-a053-d2befea52a4b" status: 200 len: 1322 microversion: 2.1 time: 0.456566 Aug 10 23:04:09.752293 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 975/1956] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:04:09 2022] GET /compute/v2.1/servers/0eb8b76a-370b-423d-a053-d2befea52a4b => generated 1322 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:04:09.921676 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-36c31bd1-7886-40ab-9643-1d2154228eca tempest-SecurityGroupRulesNegativeTestJSON-1048289237 tempest-SecurityGroupRulesNegativeTestJSON-1048289237-project] 10.222.0.58 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 1.515177 Aug 10 23:04:09.930215 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 982/1957] 10.222.0.58 () {60 vars in 1180 bytes} [Wed Aug 10 23:04:08 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 1517 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:04:09.936905 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-0b48e694-bb91-4cc1-87c8-9cfc4511d763 tempest-SecurityGroupRulesNegativeTestJSON-1048289237 tempest-SecurityGroupRulesNegativeTestJSON-1048289237-project] Action: 'create', calling method: .version_select at 0x7f847d028ca0>, body: {"security_group_rule": {"parent_group_id": "fa0b67be-4def-4ba3-a0d3-195481d551a0", "ip_protocol": "tempest-999-192848058", "from_port": 22, "to_port": 22}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:04:09.999117 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=8 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:04:10.052029 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-0b48e694-bb91-4cc1-87c8-9cfc4511d763 tempest-SecurityGroupRulesNegativeTestJSON-1048289237 tempest-SecurityGroupRulesNegativeTestJSON-1048289237-project] HTTP exception thrown: Invalid IP protocol tempest-999-192848058. Aug 10 23:04:10.054520 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-0b48e694-bb91-4cc1-87c8-9cfc4511d763 tempest-SecurityGroupRulesNegativeTestJSON-1048289237 tempest-SecurityGroupRulesNegativeTestJSON-1048289237-project] Request method failure captured: Aug 10 23:04:10.054520 n-d-850468-14 devstack@n-api.service[122632]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 10 23:04:10.054520 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:04:10.054520 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:04:10.054520 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:04:10.054520 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 156 Aug 10 23:04:10.054520 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:04:10.054520 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:04:10.054520 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:04:10.054520 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:04:10.054520 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9Dlg_2kWvRFNefN2DUjhFdwHY3IeWV3F1RVYcFaSdW0-0iOxEAur_GBk7eEg3Za67LQk78oj12JOeFzCFmluAsns1PGlZsD-dNOocOyRvFXLMf0tlySA1MeaK5ASHwoXvOsoyEHOsOqxxmf26sPMbxkA90J_ZIL288geRnjKQPt95vM Aug 10 23:04:10.054520 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:04:10.054520 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:04:10.054520 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:04:10.054520 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:04:10.054520 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:04:10.054520 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:04:10.054520 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 924dad36295b48d2843af833a242549a Aug 10 23:04:10.054520 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1048289237 Aug 10 23:04:10.054520 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:04:10.054520 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:04:10.055538 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/924dad36295b48d2843af833a242549a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/924dad36295b48d2843af833a242549a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/924dad36295b48d2843af833a242549a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_924dad36295b48d2843af833a242549a", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:04:10.055538 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1048289237 Aug 10 23:04:10.055538 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 924dad36295b48d2843af833a242549a Aug 10 23:04:10.055538 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1048289237 Aug 10 23:04:10.055538 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1048289237-project Aug 10 23:04:10.055538 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:04:10.055538 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:04:10.055538 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: 7b9270a92af446dc8300122b87ef323a Aug 10 23:04:10.055538 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1048289237-project Aug 10 23:04:10.055538 n-d-850468-14 devstack@n-api.service[122632]: Aug 10 23:04:10.055538 n-d-850468-14 devstack@n-api.service[122632]: {"security_group_rule": {"parent_group_id": "fa0b67be-4def-4ba3-a0d3-195481d551a0", "ip_protocol": "tempest-999-192848058", "from_port": 22, "to_port": 22}} Aug 10 23:04:10.055538 n-d-850468-14 devstack@n-api.service[122632]: method: Aug 10 23:04:10.056287 n-d-850468-14 devstack@n-api.service[122632]: exception: Invalid IP protocol tempest-999-192848058. Aug 10 23:04:10.056287 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'fa0b67be-4def-4ba3-a0d3-195481d551a0', 'ip_protocol': 'tempest-999-192848058', 'from_port': 22, 'to_port': 22}}} Aug 10 23:04:10.056287 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:04:10.056287 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:04:10.056287 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Aug 10 23:04:10.056287 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Aug 10 23:04:10.056287 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Aug 10 23:04:10.056287 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Aug 10 23:04:10.056287 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Aug 10 23:04:10.056287 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Aug 10 23:04:10.056287 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Aug 10 23:04:10.056287 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Aug 10 23:04:10.056287 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-192848058. Aug 10 23:04:10.056287 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:04:10.056287 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:04:10.056287 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:04:10.056287 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:04:10.056287 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:04:10.056287 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:04:10.057246 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:04:10.057246 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:04:10.057246 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 23:04:10.057246 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 23:04:10.057246 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:04:10.057246 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:04:10.057246 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 10 23:04:10.057246 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 10 23:04:10.057246 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-192848058. Aug 10 23:04:10.057246 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:04:10.057246 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:04:10.057246 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:04:10.057246 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:04:10.057246 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:04:10.057246 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:04:10.057246 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:04:10.057246 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:04:10.057246 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-192848058. Aug 10 23:04:10.057246 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:04:10.064524 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-0b48e694-bb91-4cc1-87c8-9cfc4511d763 tempest-SecurityGroupRulesNegativeTestJSON-1048289237 tempest-SecurityGroupRulesNegativeTestJSON-1048289237-project] Returning 400 to user: Invalid IP protocol tempest-999-192848058. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:04:10.065657 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-0b48e694-bb91-4cc1-87c8-9cfc4511d763 tempest-SecurityGroupRulesNegativeTestJSON-1048289237 tempest-SecurityGroupRulesNegativeTestJSON-1048289237-project] 10.222.0.58 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 86 microversion: 2.1 time: 0.133566 Aug 10 23:04:10.066439 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 976/1958] 10.222.0.58 () {60 vars in 1195 bytes} [Wed Aug 10 23:04:09 2022] POST /compute/v2.1/os-security-group-rules => generated 86 bytes in 135 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 10 23:04:10.085571 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-b3c8a018-7920-4034-ab90-9111afa29a9c tempest-SecurityGroupRulesNegativeTestJSON-1048289237 tempest-SecurityGroupRulesNegativeTestJSON-1048289237-project] Action: 'create', calling method: .version_select at 0x7f848238e940>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-199340417", "description": "tempest-description-1241328694"}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:04:10.312553 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-a857fc33-8928-465d-be39-432945244f2a tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:04:10.313627 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-a857fc33-8928-465d-be39-432945244f2a tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] [instance: 63d2bd74-d060-4925-9323-b39d5131f958] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:04:10.326025 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a857fc33-8928-465d-be39-432945244f2a tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:10.327732 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a857fc33-8928-465d-be39-432945244f2a tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:10.328641 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a857fc33-8928-465d-be39-432945244f2a tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:10.329512 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a857fc33-8928-465d-be39-432945244f2a tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:10.330082 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a857fc33-8928-465d-be39-432945244f2a tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:10.330722 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a857fc33-8928-465d-be39-432945244f2a tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:10.643602 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-a857fc33-8928-465d-be39-432945244f2a tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632904331d024d9b8e4d3660dff2cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ed0bdee3aa4013bd9219069bda558c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:04:10.660339 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-a857fc33-8928-465d-be39-432945244f2a tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] 10.222.0.58 "GET /compute/v2.1/servers/63d2bd74-d060-4925-9323-b39d5131f958" status: 200 len: 1392 microversion: 2.1 time: 0.354185 Aug 10 23:04:10.662021 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 977/1959] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:04:10 2022] GET /compute/v2.1/servers/63d2bd74-d060-4925-9323-b39d5131f958 => generated 1392 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:04:10.778102 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-16a81fe7-a776-4e33-b409-a384f773ba40 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:04:10.779593 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-16a81fe7-a776-4e33-b409-a384f773ba40 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] [instance: 0eb8b76a-370b-423d-a053-d2befea52a4b] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:04:10.786960 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-16a81fe7-a776-4e33-b409-a384f773ba40 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:10.787463 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-16a81fe7-a776-4e33-b409-a384f773ba40 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:10.788078 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-16a81fe7-a776-4e33-b409-a384f773ba40 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:10.788713 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-16a81fe7-a776-4e33-b409-a384f773ba40 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:10.789171 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-16a81fe7-a776-4e33-b409-a384f773ba40 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:10.789599 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-16a81fe7-a776-4e33-b409-a384f773ba40 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:10.905465 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-b3c8a018-7920-4034-ab90-9111afa29a9c tempest-SecurityGroupRulesNegativeTestJSON-1048289237 tempest-SecurityGroupRulesNegativeTestJSON-1048289237-project] 10.222.0.58 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.830924 Aug 10 23:04:10.906433 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 983/1960] 10.222.0.58 () {60 vars in 1180 bytes} [Wed Aug 10 23:04:10 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:04:10.921309 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-7fb9446f-df83-48f3-ae35-83c73404709d tempest-SecurityGroupRulesNegativeTestJSON-1048289237 tempest-SecurityGroupRulesNegativeTestJSON-1048289237-project] Action: 'create', calling method: .version_select at 0x7f84823cb940>, body: {"security_group_rule": {"parent_group_id": "dede3234-beb1-41dc-91db-235957cb5009", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:04:11.223297 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-16a81fe7-a776-4e33-b409-a384f773ba40 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c26e69e2274083916402c96d71c5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a6ac1a984c478da9337692485d16ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:04:11.239282 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-16a81fe7-a776-4e33-b409-a384f773ba40 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] 10.222.0.58 "GET /compute/v2.1/servers/0eb8b76a-370b-423d-a053-d2befea52a4b" status: 200 len: 1322 microversion: 2.1 time: 0.469589 Aug 10 23:04:11.240236 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 978/1961] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:04:10 2022] GET /compute/v2.1/servers/0eb8b76a-370b-423d-a053-d2befea52a4b => generated 1322 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:04:11.256263 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-7fb9446f-df83-48f3-ae35-83c73404709d tempest-SecurityGroupRulesNegativeTestJSON-1048289237 tempest-SecurityGroupRulesNegativeTestJSON-1048289237-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Aug 10 23:04:11.258988 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-7fb9446f-df83-48f3-ae35-83c73404709d tempest-SecurityGroupRulesNegativeTestJSON-1048289237 tempest-SecurityGroupRulesNegativeTestJSON-1048289237-project] Request method failure captured: Aug 10 23:04:11.258988 n-d-850468-14 devstack@n-api.service[122633]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 10 23:04:11.258988 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:04:11.258988 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:04:11.258988 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:04:11.258988 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 138 Aug 10 23:04:11.258988 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:04:11.258988 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:04:11.258988 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:04:11.258988 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:04:11.258988 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9Dlg_2kWvRFNefN2DUjhFdwHY3IeWV3F1RVYcFaSdW0-0iOxEAur_GBk7eEg3Za67LQk78oj12JOeFzCFmluAsns1PGlZsD-dNOocOyRvFXLMf0tlySA1MeaK5ASHwoXvOsoyEHOsOqxxmf26sPMbxkA90J_ZIL288geRnjKQPt95vM Aug 10 23:04:11.258988 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:04:11.258988 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:04:11.258988 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:04:11.258988 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:04:11.258988 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:04:11.258988 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:04:11.258988 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 924dad36295b48d2843af833a242549a Aug 10 23:04:11.258988 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1048289237 Aug 10 23:04:11.258988 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:04:11.258988 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:04:11.261007 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/924dad36295b48d2843af833a242549a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/924dad36295b48d2843af833a242549a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/924dad36295b48d2843af833a242549a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_924dad36295b48d2843af833a242549a", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:04:11.261007 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1048289237 Aug 10 23:04:11.261007 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 924dad36295b48d2843af833a242549a Aug 10 23:04:11.261007 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1048289237 Aug 10 23:04:11.261007 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1048289237-project Aug 10 23:04:11.261007 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:04:11.261007 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:04:11.261007 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 7b9270a92af446dc8300122b87ef323a Aug 10 23:04:11.261007 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1048289237-project Aug 10 23:04:11.261007 n-d-850468-14 devstack@n-api.service[122633]: Aug 10 23:04:11.261007 n-d-850468-14 devstack@n-api.service[122633]: {"security_group_rule": {"parent_group_id": "dede3234-beb1-41dc-91db-235957cb5009", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Aug 10 23:04:11.261007 n-d-850468-14 devstack@n-api.service[122633]: method: Aug 10 23:04:11.261740 n-d-850468-14 devstack@n-api.service[122633]: exception: Invalid port range 22:21. Former value cannot be greater than the later Aug 10 23:04:11.261740 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'dede3234-beb1-41dc-91db-235957cb5009', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Aug 10 23:04:11.261740 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:04:11.261740 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:04:11.261740 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Aug 10 23:04:11.261740 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Aug 10 23:04:11.261740 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Aug 10 23:04:11.261740 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Aug 10 23:04:11.261740 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Aug 10 23:04:11.261740 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Aug 10 23:04:11.261740 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Aug 10 23:04:11.261740 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Aug 10 23:04:11.261740 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Aug 10 23:04:11.261740 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:04:11.261740 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:04:11.261740 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:04:11.261740 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:04:11.261740 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:04:11.261740 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:04:11.262849 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:04:11.262849 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:04:11.262849 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 23:04:11.262849 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 23:04:11.262849 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:04:11.262849 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:04:11.262849 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 10 23:04:11.262849 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 10 23:04:11.262849 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Aug 10 23:04:11.262849 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:04:11.262849 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:04:11.262849 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:04:11.262849 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:04:11.262849 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:04:11.262849 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:04:11.262849 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:04:11.262849 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:04:11.262849 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Aug 10 23:04:11.262849 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:04:11.263921 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-7fb9446f-df83-48f3-ae35-83c73404709d tempest-SecurityGroupRulesNegativeTestJSON-1048289237 tempest-SecurityGroupRulesNegativeTestJSON-1048289237-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:04:11.264696 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-7fb9446f-df83-48f3-ae35-83c73404709d tempest-SecurityGroupRulesNegativeTestJSON-1048289237 tempest-SecurityGroupRulesNegativeTestJSON-1048289237-project] 10.222.0.58 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.348899 Aug 10 23:04:11.266837 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 984/1962] 10.222.0.58 () {60 vars in 1195 bytes} [Wed Aug 10 23:04:10 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 351 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 10 23:04:11.275414 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-219edc55-7259-472b-93a9-39307469fb5b tempest-SecurityGroupRulesNegativeTestJSON-1048289237 tempest-SecurityGroupRulesNegativeTestJSON-1048289237-project] Action: 'create', calling method: .version_select at 0x7f847d0241f0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1957118402", "description": "tempest-description-987594327"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:04:11.687344 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-bf2ad5ec-a9d5-4589-a5c8-e52a9dfa0215 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:04:11.688496 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-bf2ad5ec-a9d5-4589-a5c8-e52a9dfa0215 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] [instance: 63d2bd74-d060-4925-9323-b39d5131f958] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:04:11.701988 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bf2ad5ec-a9d5-4589-a5c8-e52a9dfa0215 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:11.702816 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bf2ad5ec-a9d5-4589-a5c8-e52a9dfa0215 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:11.704639 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bf2ad5ec-a9d5-4589-a5c8-e52a9dfa0215 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:11.705596 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bf2ad5ec-a9d5-4589-a5c8-e52a9dfa0215 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:11.723646 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bf2ad5ec-a9d5-4589-a5c8-e52a9dfa0215 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:11.726574 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bf2ad5ec-a9d5-4589-a5c8-e52a9dfa0215 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:11.874808 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-219edc55-7259-472b-93a9-39307469fb5b tempest-SecurityGroupRulesNegativeTestJSON-1048289237 tempest-SecurityGroupRulesNegativeTestJSON-1048289237-project] 10.222.0.58 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.602886 Aug 10 23:04:11.877115 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 979/1963] 10.222.0.58 () {60 vars in 1180 bytes} [Wed Aug 10 23:04:11 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 23:04:11.892094 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-6b8c5216-de44-44cb-839f-7fffdeeace0a tempest-SecurityGroupRulesNegativeTestJSON-1048289237 tempest-SecurityGroupRulesNegativeTestJSON-1048289237-project] Action: 'create', calling method: .version_select at 0x7f847d028820>, body: {"security_group_rule": {"parent_group_id": "89985f3a-68bb-447b-8453-959ae1b378b6", "ip_protocol": "tcp", "from_port": 22, "to_port": 1956126575}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:04:12.092254 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-6b8c5216-de44-44cb-839f-7fffdeeace0a tempest-SecurityGroupRulesNegativeTestJSON-1048289237 tempest-SecurityGroupRulesNegativeTestJSON-1048289237-project] HTTP exception thrown: Invalid port range 22:1956126575. Valid TCP ports should be between 1-65535 Aug 10 23:04:12.098456 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-6b8c5216-de44-44cb-839f-7fffdeeace0a tempest-SecurityGroupRulesNegativeTestJSON-1048289237 tempest-SecurityGroupRulesNegativeTestJSON-1048289237-project] Request method failure captured: Aug 10 23:04:12.098456 n-d-850468-14 devstack@n-api.service[122632]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 10 23:04:12.098456 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:04:12.098456 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:04:12.098456 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:04:12.098456 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 146 Aug 10 23:04:12.098456 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:04:12.098456 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:04:12.098456 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:04:12.098456 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:04:12.098456 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9Dlg_2kWvRFNefN2DUjhFdwHY3IeWV3F1RVYcFaSdW0-0iOxEAur_GBk7eEg3Za67LQk78oj12JOeFzCFmluAsns1PGlZsD-dNOocOyRvFXLMf0tlySA1MeaK5ASHwoXvOsoyEHOsOqxxmf26sPMbxkA90J_ZIL288geRnjKQPt95vM Aug 10 23:04:12.098456 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:04:12.098456 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:04:12.098456 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:04:12.098456 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:04:12.098456 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:04:12.098456 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:04:12.098456 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 924dad36295b48d2843af833a242549a Aug 10 23:04:12.098456 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1048289237 Aug 10 23:04:12.098456 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:04:12.098456 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:04:12.099977 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/924dad36295b48d2843af833a242549a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/924dad36295b48d2843af833a242549a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/924dad36295b48d2843af833a242549a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_924dad36295b48d2843af833a242549a", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:04:12.099977 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1048289237 Aug 10 23:04:12.099977 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 924dad36295b48d2843af833a242549a Aug 10 23:04:12.099977 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1048289237 Aug 10 23:04:12.099977 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1048289237-project Aug 10 23:04:12.099977 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:04:12.099977 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:04:12.099977 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: 7b9270a92af446dc8300122b87ef323a Aug 10 23:04:12.099977 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1048289237-project Aug 10 23:04:12.099977 n-d-850468-14 devstack@n-api.service[122632]: Aug 10 23:04:12.099977 n-d-850468-14 devstack@n-api.service[122632]: {"security_group_rule": {"parent_group_id": "89985f3a-68bb-447b-8453-959ae1b378b6", "ip_protocol": "tcp", "from_port": 22, "to_port": 1956126575}} Aug 10 23:04:12.099977 n-d-850468-14 devstack@n-api.service[122632]: method: Aug 10 23:04:12.100712 n-d-850468-14 devstack@n-api.service[122632]: exception: Invalid port range 22:1956126575. Valid TCP ports should be between 1-65535 Aug 10 23:04:12.100712 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'body': {'security_group_rule': {'parent_group_id': '89985f3a-68bb-447b-8453-959ae1b378b6', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 1956126575}}} Aug 10 23:04:12.100712 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:04:12.100712 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:04:12.100712 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Aug 10 23:04:12.100712 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Aug 10 23:04:12.100712 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Aug 10 23:04:12.100712 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Aug 10 23:04:12.100712 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Aug 10 23:04:12.100712 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Aug 10 23:04:12.100712 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Aug 10 23:04:12.100712 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Aug 10 23:04:12.100712 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:1956126575. Valid TCP ports should be between 1-65535 Aug 10 23:04:12.100712 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:04:12.100712 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:04:12.100712 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:04:12.100712 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:04:12.100712 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:04:12.100712 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:04:12.101803 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:04:12.101803 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:04:12.101803 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 23:04:12.101803 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 23:04:12.101803 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:04:12.101803 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:04:12.101803 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 10 23:04:12.101803 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 10 23:04:12.101803 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:1956126575. Valid TCP ports should be between 1-65535 Aug 10 23:04:12.101803 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:04:12.101803 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:04:12.101803 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:04:12.101803 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:04:12.101803 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:04:12.101803 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:04:12.101803 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:04:12.101803 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:04:12.101803 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:1956126575. Valid TCP ports should be between 1-65535 Aug 10 23:04:12.101803 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:04:12.103049 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-6b8c5216-de44-44cb-839f-7fffdeeace0a tempest-SecurityGroupRulesNegativeTestJSON-1048289237 tempest-SecurityGroupRulesNegativeTestJSON-1048289237-project] Returning 400 to user: Invalid port range 22:1956126575. Valid TCP ports should be between 1-65535 {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:04:12.103049 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-6b8c5216-de44-44cb-839f-7fffdeeace0a tempest-SecurityGroupRulesNegativeTestJSON-1048289237 tempest-SecurityGroupRulesNegativeTestJSON-1048289237-project] 10.222.0.58 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 119 microversion: 2.1 time: 0.212979 Aug 10 23:04:12.111191 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 980/1964] 10.222.0.58 () {60 vars in 1195 bytes} [Wed Aug 10 23:04:11 2022] POST /compute/v2.1/os-security-group-rules => generated 119 bytes in 225 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 10 23:04:12.130513 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-ed86d0a9-5372-4068-93a0-11175b723802 tempest-SecurityGroupRulesNegativeTestJSON-1048289237 tempest-SecurityGroupRulesNegativeTestJSON-1048289237-project] Action: 'create', calling method: .version_select at 0x7f847d848040>, body: {"security_group_rule": {"parent_group_id": "2875f0ea-f425-4f50-91e7-f715eb150723", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:04:12.220269 n-d-850468-14 devstack@n-api.service[122632]: DEBUG neutronclient.v2_0.client [None req-ed86d0a9-5372-4068-93a0-11175b723802 tempest-SecurityGroupRulesNegativeTestJSON-1048289237 tempest-SecurityGroupRulesNegativeTestJSON-1048289237-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 2875f0ea-f425-4f50-91e7-f715eb150723 does not exist", "detail": ""}} {{(pid=122632) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 10 23:04:12.223907 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.network.security_group_api [None req-ed86d0a9-5372-4068-93a0-11175b723802 tempest-SecurityGroupRulesNegativeTestJSON-1048289237 tempest-SecurityGroupRulesNegativeTestJSON-1048289237-project] Neutron security group 2875f0ea-f425-4f50-91e7-f715eb150723 not found {{(pid=122632) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 10 23:04:12.224387 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-ed86d0a9-5372-4068-93a0-11175b723802 tempest-SecurityGroupRulesNegativeTestJSON-1048289237 tempest-SecurityGroupRulesNegativeTestJSON-1048289237-project] HTTP exception thrown: Security group 2875f0ea-f425-4f50-91e7-f715eb150723 does not exist Aug 10 23:04:12.224387 n-d-850468-14 devstack@n-api.service[122632]: Neutron server returns request_ids: ['req-4e1d271a-a89b-4383-ab1e-6eec67c6c96f'] Aug 10 23:04:12.226268 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-ed86d0a9-5372-4068-93a0-11175b723802 tempest-SecurityGroupRulesNegativeTestJSON-1048289237 tempest-SecurityGroupRulesNegativeTestJSON-1048289237-project] Request method failure captured: Aug 10 23:04:12.226268 n-d-850468-14 devstack@n-api.service[122632]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 10 23:04:12.226268 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:04:12.226268 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:04:12.226268 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:04:12.226268 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 138 Aug 10 23:04:12.226268 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:04:12.226268 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:04:12.226268 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:04:12.226268 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:04:12.226268 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9Dlg_2kWvRFNefN2DUjhFdwHY3IeWV3F1RVYcFaSdW0-0iOxEAur_GBk7eEg3Za67LQk78oj12JOeFzCFmluAsns1PGlZsD-dNOocOyRvFXLMf0tlySA1MeaK5ASHwoXvOsoyEHOsOqxxmf26sPMbxkA90J_ZIL288geRnjKQPt95vM Aug 10 23:04:12.226268 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:04:12.226268 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:04:12.226268 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:04:12.226268 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:04:12.226268 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:04:12.226268 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:04:12.226268 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 924dad36295b48d2843af833a242549a Aug 10 23:04:12.226268 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1048289237 Aug 10 23:04:12.226268 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:04:12.226268 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:04:12.227631 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/924dad36295b48d2843af833a242549a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/924dad36295b48d2843af833a242549a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/924dad36295b48d2843af833a242549a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_924dad36295b48d2843af833a242549a", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:04:12.227631 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1048289237 Aug 10 23:04:12.227631 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 924dad36295b48d2843af833a242549a Aug 10 23:04:12.227631 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1048289237 Aug 10 23:04:12.227631 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1048289237-project Aug 10 23:04:12.227631 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:04:12.227631 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:04:12.227631 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: 7b9270a92af446dc8300122b87ef323a Aug 10 23:04:12.227631 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1048289237-project Aug 10 23:04:12.227631 n-d-850468-14 devstack@n-api.service[122632]: Aug 10 23:04:12.227631 n-d-850468-14 devstack@n-api.service[122632]: {"security_group_rule": {"parent_group_id": "2875f0ea-f425-4f50-91e7-f715eb150723", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Aug 10 23:04:12.227631 n-d-850468-14 devstack@n-api.service[122632]: method: Aug 10 23:04:12.228512 n-d-850468-14 devstack@n-api.service[122632]: exception: Security group 2875f0ea-f425-4f50-91e7-f715eb150723 does not exist Aug 10 23:04:12.228512 n-d-850468-14 devstack@n-api.service[122632]: Neutron server returns request_ids: ['req-4e1d271a-a89b-4383-ab1e-6eec67c6c96f'] Aug 10 23:04:12.228512 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'body': {'security_group_rule': {'parent_group_id': '2875f0ea-f425-4f50-91e7-f715eb150723', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Aug 10 23:04:12.228512 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:04:12.228512 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:04:12.228512 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 10 23:04:12.228512 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 10 23:04:12.228512 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 23:04:12.228512 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 23:04:12.228512 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 10 23:04:12.228512 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 10 23:04:12.228512 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 23:04:12.228512 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 23:04:12.228512 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 23:04:12.228512 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 23:04:12.228512 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 23:04:12.228512 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 23:04:12.228512 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 23:04:12.228512 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 23:04:12.229716 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 23:04:12.229716 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 23:04:12.229716 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 10 23:04:12.229716 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 10 23:04:12.229716 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 23:04:12.229716 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 23:04:12.229716 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 10 23:04:12.229716 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 10 23:04:12.229716 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 10 23:04:12.229716 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 10 23:04:12.229716 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 2875f0ea-f425-4f50-91e7-f715eb150723 does not exist Aug 10 23:04:12.229716 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4e1d271a-a89b-4383-ab1e-6eec67c6c96f'] Aug 10 23:04:12.229716 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:04:12.229716 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:04:12.229716 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:04:12.229716 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:04:12.229716 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Aug 10 23:04:12.229716 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Aug 10 23:04:12.229716 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 10 23:04:12.230895 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 10 23:04:12.230895 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 2875f0ea-f425-4f50-91e7-f715eb150723 does not exist Aug 10 23:04:12.230895 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4e1d271a-a89b-4383-ab1e-6eec67c6c96f'] Aug 10 23:04:12.230895 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:04:12.230895 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:04:12.230895 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:04:12.230895 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:04:12.230895 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:04:12.230895 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:04:12.230895 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:04:12.230895 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:04:12.230895 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 23:04:12.230895 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 23:04:12.230895 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:04:12.230895 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:04:12.230895 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Aug 10 23:04:12.230895 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 10 23:04:12.230895 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 2875f0ea-f425-4f50-91e7-f715eb150723 does not exist Aug 10 23:04:12.230895 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4e1d271a-a89b-4383-ab1e-6eec67c6c96f'] Aug 10 23:04:12.230895 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:04:12.232964 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:04:12.232964 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:04:12.232964 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:04:12.232964 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:04:12.232964 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:04:12.232964 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:04:12.232964 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:04:12.232964 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 2875f0ea-f425-4f50-91e7-f715eb150723 does not exist Aug 10 23:04:12.232964 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4e1d271a-a89b-4383-ab1e-6eec67c6c96f'] Aug 10 23:04:12.232964 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:04:12.232964 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-ed86d0a9-5372-4068-93a0-11175b723802 tempest-SecurityGroupRulesNegativeTestJSON-1048289237 tempest-SecurityGroupRulesNegativeTestJSON-1048289237-project] Returning 404 to user: Security group 2875f0ea-f425-4f50-91e7-f715eb150723 does not exist Aug 10 23:04:12.232964 n-d-850468-14 devstack@n-api.service[122632]: Neutron server returns request_ids: ['req-4e1d271a-a89b-4383-ab1e-6eec67c6c96f'] {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:04:12.235090 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-ed86d0a9-5372-4068-93a0-11175b723802 tempest-SecurityGroupRulesNegativeTestJSON-1048289237 tempest-SecurityGroupRulesNegativeTestJSON-1048289237-project] 10.222.0.58 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.118178 Aug 10 23:04:12.235896 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 981/1965] 10.222.0.58 () {60 vars in 1195 bytes} [Wed Aug 10 23:04:12 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:04:12.245832 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-f53aa67f-5d24-47b4-a80f-c4a9ade09d85 tempest-SecurityGroupRulesNegativeTestJSON-1048289237 tempest-SecurityGroupRulesNegativeTestJSON-1048289237-project] Calling method '.version_select at 0x7f847d028040>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:04:12.294071 n-d-850468-14 devstack@n-api.service[122632]: DEBUG neutronclient.v2_0.client [None req-f53aa67f-5d24-47b4-a80f-c4a9ade09d85 tempest-SecurityGroupRulesNegativeTestJSON-1048289237 tempest-SecurityGroupRulesNegativeTestJSON-1048289237-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule acd6fc7c-b533-4b6f-bb7c-aeceabcb5558 does not exist", "detail": ""}} {{(pid=122632) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 10 23:04:12.294674 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.network.security_group_api [None req-f53aa67f-5d24-47b4-a80f-c4a9ade09d85 tempest-SecurityGroupRulesNegativeTestJSON-1048289237 tempest-SecurityGroupRulesNegativeTestJSON-1048289237-project] Neutron security group rule acd6fc7c-b533-4b6f-bb7c-aeceabcb5558 not found {{(pid=122632) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Aug 10 23:04:12.295216 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-f53aa67f-5d24-47b4-a80f-c4a9ade09d85 tempest-SecurityGroupRulesNegativeTestJSON-1048289237 tempest-SecurityGroupRulesNegativeTestJSON-1048289237-project] HTTP exception thrown: Security group rule acd6fc7c-b533-4b6f-bb7c-aeceabcb5558 does not exist Aug 10 23:04:12.295216 n-d-850468-14 devstack@n-api.service[122632]: Neutron server returns request_ids: ['req-3d8fbbef-f8c9-465c-960a-403fd1c6d5fa'] Aug 10 23:04:12.297393 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-f53aa67f-5d24-47b4-a80f-c4a9ade09d85 tempest-SecurityGroupRulesNegativeTestJSON-1048289237 tempest-SecurityGroupRulesNegativeTestJSON-1048289237-project] Request method failure captured: Aug 10 23:04:12.297393 n-d-850468-14 devstack@n-api.service[122632]: request: DELETE /compute/v2.1/os-security-group-rules/acd6fc7c-b533-4b6f-bb7c-aeceabcb5558 HTTP/1.1 Aug 10 23:04:12.297393 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:04:12.297393 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:04:12.297393 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:04:12.297393 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 23:04:12.297393 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:04:12.297393 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:04:12.297393 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:04:12.297393 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:04:12.297393 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9Dlg_2kWvRFNefN2DUjhFdwHY3IeWV3F1RVYcFaSdW0-0iOxEAur_GBk7eEg3Za67LQk78oj12JOeFzCFmluAsns1PGlZsD-dNOocOyRvFXLMf0tlySA1MeaK5ASHwoXvOsoyEHOsOqxxmf26sPMbxkA90J_ZIL288geRnjKQPt95vM Aug 10 23:04:12.297393 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:04:12.297393 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:04:12.297393 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:04:12.297393 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:04:12.297393 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:04:12.297393 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:04:12.297393 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 924dad36295b48d2843af833a242549a Aug 10 23:04:12.297393 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1048289237 Aug 10 23:04:12.297393 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:04:12.297393 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:04:12.298723 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/924dad36295b48d2843af833a242549a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/924dad36295b48d2843af833a242549a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/924dad36295b48d2843af833a242549a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_924dad36295b48d2843af833a242549a", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:04:12.298723 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1048289237 Aug 10 23:04:12.298723 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 924dad36295b48d2843af833a242549a Aug 10 23:04:12.298723 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1048289237 Aug 10 23:04:12.298723 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1048289237-project Aug 10 23:04:12.298723 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:04:12.298723 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:04:12.298723 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: 7b9270a92af446dc8300122b87ef323a Aug 10 23:04:12.298723 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1048289237-project Aug 10 23:04:12.298723 n-d-850468-14 devstack@n-api.service[122632]: method: Aug 10 23:04:12.298723 n-d-850468-14 devstack@n-api.service[122632]: exception: Security group rule acd6fc7c-b533-4b6f-bb7c-aeceabcb5558 does not exist Aug 10 23:04:12.298723 n-d-850468-14 devstack@n-api.service[122632]: Neutron server returns request_ids: ['req-3d8fbbef-f8c9-465c-960a-403fd1c6d5fa'] Aug 10 23:04:12.299465 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': 'acd6fc7c-b533-4b6f-bb7c-aeceabcb5558'} Aug 10 23:04:12.299465 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:04:12.299465 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:04:12.299465 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Aug 10 23:04:12.299465 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Aug 10 23:04:12.299465 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 23:04:12.299465 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 23:04:12.299465 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1064, in show_security_group_rule Aug 10 23:04:12.299465 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Aug 10 23:04:12.299465 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 23:04:12.299465 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 23:04:12.299465 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 23:04:12.299465 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 23:04:12.299465 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 23:04:12.299465 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 23:04:12.299465 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 23:04:12.299465 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 23:04:12.299465 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 23:04:12.299465 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 23:04:12.300352 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 10 23:04:12.300352 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 10 23:04:12.300352 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 23:04:12.300352 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 23:04:12.300352 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 10 23:04:12.300352 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 10 23:04:12.300352 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 10 23:04:12.300352 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 10 23:04:12.300352 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule acd6fc7c-b533-4b6f-bb7c-aeceabcb5558 does not exist Aug 10 23:04:12.300352 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3d8fbbef-f8c9-465c-960a-403fd1c6d5fa'] Aug 10 23:04:12.300352 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:04:12.300352 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:04:12.300352 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:04:12.300352 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:04:12.300352 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Aug 10 23:04:12.300352 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Aug 10 23:04:12.300352 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Aug 10 23:04:12.300352 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 10 23:04:12.301205 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule acd6fc7c-b533-4b6f-bb7c-aeceabcb5558 does not exist Aug 10 23:04:12.301205 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3d8fbbef-f8c9-465c-960a-403fd1c6d5fa'] Aug 10 23:04:12.301205 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:04:12.301205 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:04:12.301205 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:04:12.301205 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:04:12.301205 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:04:12.301205 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:04:12.301205 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:04:12.301205 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:04:12.301205 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 23:04:12.301205 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 23:04:12.301205 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:04:12.301205 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:04:12.301205 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Aug 10 23:04:12.301205 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 10 23:04:12.301205 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule acd6fc7c-b533-4b6f-bb7c-aeceabcb5558 does not exist Aug 10 23:04:12.301205 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3d8fbbef-f8c9-465c-960a-403fd1c6d5fa'] Aug 10 23:04:12.301205 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:04:12.301205 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:04:12.303620 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:04:12.303620 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:04:12.303620 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:04:12.303620 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:04:12.303620 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:04:12.303620 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:04:12.303620 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule acd6fc7c-b533-4b6f-bb7c-aeceabcb5558 does not exist Aug 10 23:04:12.303620 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3d8fbbef-f8c9-465c-960a-403fd1c6d5fa'] Aug 10 23:04:12.303620 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:04:12.303620 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-f53aa67f-5d24-47b4-a80f-c4a9ade09d85 tempest-SecurityGroupRulesNegativeTestJSON-1048289237 tempest-SecurityGroupRulesNegativeTestJSON-1048289237-project] Returning 404 to user: Security group rule acd6fc7c-b533-4b6f-bb7c-aeceabcb5558 does not exist Aug 10 23:04:12.303620 n-d-850468-14 devstack@n-api.service[122632]: Neutron server returns request_ids: ['req-3d8fbbef-f8c9-465c-960a-403fd1c6d5fa'] {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:04:12.303620 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-f53aa67f-5d24-47b4-a80f-c4a9ade09d85 tempest-SecurityGroupRulesNegativeTestJSON-1048289237 tempest-SecurityGroupRulesNegativeTestJSON-1048289237-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-group-rules/acd6fc7c-b533-4b6f-bb7c-aeceabcb5558" status: 404 len: 199 microversion: 2.1 time: 0.057358 Aug 10 23:04:12.304397 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 982/1966] 10.222.0.58 () {58 vars in 1287 bytes} [Wed Aug 10 23:04:12 2022] DELETE /compute/v2.1/os-security-group-rules/acd6fc7c-b533-4b6f-bb7c-aeceabcb5558 => generated 199 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:04:12.307256 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-58204abf-f8dc-4a47-a8cd-76593c44ea5a tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:04:12.307873 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-58204abf-f8dc-4a47-a8cd-76593c44ea5a tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] [instance: 0eb8b76a-370b-423d-a053-d2befea52a4b] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:04:12.348031 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-58204abf-f8dc-4a47-a8cd-76593c44ea5a tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:12.349215 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-58204abf-f8dc-4a47-a8cd-76593c44ea5a tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:12.349780 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-58204abf-f8dc-4a47-a8cd-76593c44ea5a tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:12.355014 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-58204abf-f8dc-4a47-a8cd-76593c44ea5a tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:12.355014 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-58204abf-f8dc-4a47-a8cd-76593c44ea5a tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:12.355014 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-58204abf-f8dc-4a47-a8cd-76593c44ea5a tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:12.421077 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-bf2ad5ec-a9d5-4589-a5c8-e52a9dfa0215 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632904331d024d9b8e4d3660dff2cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ed0bdee3aa4013bd9219069bda558c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:04:12.460575 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-bf2ad5ec-a9d5-4589-a5c8-e52a9dfa0215 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] 10.222.0.58 "GET /compute/v2.1/servers/63d2bd74-d060-4925-9323-b39d5131f958" status: 200 len: 1392 microversion: 2.1 time: 0.773926 Aug 10 23:04:12.462816 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 985/1967] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:04:11 2022] GET /compute/v2.1/servers/63d2bd74-d060-4925-9323-b39d5131f958 => generated 1392 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:04:12.479739 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-8b0eca88-018c-49db-a699-0be159dac904 tempest-SecurityGroupRulesNegativeTestJSON-1048289237 tempest-SecurityGroupRulesNegativeTestJSON-1048289237-project] Calling method '.version_select at 0x7f848238eaf0>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:04:12.705148 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-58204abf-f8dc-4a47-a8cd-76593c44ea5a tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c26e69e2274083916402c96d71c5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a6ac1a984c478da9337692485d16ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:04:12.725516 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-58204abf-f8dc-4a47-a8cd-76593c44ea5a tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] 10.222.0.58 "GET /compute/v2.1/servers/0eb8b76a-370b-423d-a053-d2befea52a4b" status: 200 len: 1322 microversion: 2.1 time: 0.424712 Aug 10 23:04:12.741210 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 983/1968] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:04:12 2022] GET /compute/v2.1/servers/0eb8b76a-370b-423d-a053-d2befea52a4b => generated 1322 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:04:13.497737 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-d2344107-075f-4385-b97c-c4ebe2d797e0 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:04:13.500158 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-d2344107-075f-4385-b97c-c4ebe2d797e0 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] [instance: 63d2bd74-d060-4925-9323-b39d5131f958] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:04:13.524294 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d2344107-075f-4385-b97c-c4ebe2d797e0 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:13.530115 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d2344107-075f-4385-b97c-c4ebe2d797e0 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:13.539394 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d2344107-075f-4385-b97c-c4ebe2d797e0 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:13.540743 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d2344107-075f-4385-b97c-c4ebe2d797e0 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:13.542306 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d2344107-075f-4385-b97c-c4ebe2d797e0 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:13.543083 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d2344107-075f-4385-b97c-c4ebe2d797e0 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:13.579256 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=100 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:04:13.768063 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-8b0eca88-018c-49db-a699-0be159dac904 tempest-SecurityGroupRulesNegativeTestJSON-1048289237 tempest-SecurityGroupRulesNegativeTestJSON-1048289237-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/89985f3a-68bb-447b-8453-959ae1b378b6" status: 202 len: 0 microversion: 2.1 time: 1.301208 Aug 10 23:04:13.770257 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 986/1969] 10.222.0.58 () {58 vars in 1272 bytes} [Wed Aug 10 23:04:12 2022] DELETE /compute/v2.1/os-security-groups/89985f3a-68bb-447b-8453-959ae1b378b6 => generated 0 bytes in 1306 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:04:13.783366 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-2d5bfcce-23bc-4601-add0-4f8937005ffe tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:04:13.785647 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-2d5bfcce-23bc-4601-add0-4f8937005ffe tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] [instance: 0eb8b76a-370b-423d-a053-d2befea52a4b] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:04:13.802879 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=1 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:04:13.805458 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2d5bfcce-23bc-4601-add0-4f8937005ffe tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:13.807099 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2d5bfcce-23bc-4601-add0-4f8937005ffe tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:13.808732 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2d5bfcce-23bc-4601-add0-4f8937005ffe tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:13.813132 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2d5bfcce-23bc-4601-add0-4f8937005ffe tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:13.814010 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2d5bfcce-23bc-4601-add0-4f8937005ffe tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:13.814664 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2d5bfcce-23bc-4601-add0-4f8937005ffe tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:14.199000 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-2d5bfcce-23bc-4601-add0-4f8937005ffe tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c26e69e2274083916402c96d71c5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a6ac1a984c478da9337692485d16ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:04:14.209735 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-2d5bfcce-23bc-4601-add0-4f8937005ffe tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] 10.222.0.58 "GET /compute/v2.1/servers/0eb8b76a-370b-423d-a053-d2befea52a4b" status: 200 len: 1322 microversion: 2.1 time: 0.437826 Aug 10 23:04:14.225049 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 987/1970] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:04:13 2022] GET /compute/v2.1/servers/0eb8b76a-370b-423d-a053-d2befea52a4b => generated 1322 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:04:14.237009 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-861d9c5f-2c61-45d1-86a3-c77b2e4cb803 tempest-SecurityGroupRulesNegativeTestJSON-1048289237 tempest-SecurityGroupRulesNegativeTestJSON-1048289237-project] Calling method '.version_select at 0x7f847cf38160>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:04:14.494980 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-d2344107-075f-4385-b97c-c4ebe2d797e0 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632904331d024d9b8e4d3660dff2cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ed0bdee3aa4013bd9219069bda558c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:04:14.507830 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-d2344107-075f-4385-b97c-c4ebe2d797e0 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] 10.222.0.58 "GET /compute/v2.1/servers/63d2bd74-d060-4925-9323-b39d5131f958" status: 200 len: 1382 microversion: 2.1 time: 1.025500 Aug 10 23:04:14.509053 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 984/1971] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:04:13 2022] GET /compute/v2.1/servers/63d2bd74-d060-4925-9323-b39d5131f958 => generated 1382 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:04:14.541969 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-e673f13d-f8fb-4b68-977e-f12fec7f6fc4 tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Calling method '.version_select at 0x7f847d529700>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:04:14.549997 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e673f13d-f8fb-4b68-977e-f12fec7f6fc4 tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:14.551252 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e673f13d-f8fb-4b68-977e-f12fec7f6fc4 tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:14.553273 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e673f13d-f8fb-4b68-977e-f12fec7f6fc4 tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:14.582179 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-e673f13d-f8fb-4b68-977e-f12fec7f6fc4 tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] 10.222.0.58 "GET /compute/v2.1/os-migrations" status: 200 len: 1570 microversion: 2.1 time: 0.044802 Aug 10 23:04:14.586157 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 985/1972] 10.222.0.58 () {58 vars in 1143 bytes} [Wed Aug 10 23:04:14 2022] GET /compute/v2.1/os-migrations => generated 1570 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:04:14.604032 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-71686bed-d380-4102-aca1-bcd3e221ded9 tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:04:14.604984 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-71686bed-d380-4102-aca1-bcd3e221ded9 tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] [instance: 63d2bd74-d060-4925-9323-b39d5131f958] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:04:14.615172 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-71686bed-d380-4102-aca1-bcd3e221ded9 tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:14.615849 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-71686bed-d380-4102-aca1-bcd3e221ded9 tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:14.617931 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-71686bed-d380-4102-aca1-bcd3e221ded9 tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:14.619122 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-71686bed-d380-4102-aca1-bcd3e221ded9 tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:14.620526 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-71686bed-d380-4102-aca1-bcd3e221ded9 tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:14.624069 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-71686bed-d380-4102-aca1-bcd3e221ded9 tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:15.101188 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-71686bed-d380-4102-aca1-bcd3e221ded9 tempest-LiveMigrationTest-1830360301 tempest-LiveMigrationTest-1830360301-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/63d2bd74-d060-4925-9323-b39d5131f958" status: 200 len: 1535 microversion: 2.1 time: 0.501601 Aug 10 23:04:15.120161 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 986/1973] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:04:14 2022] GET /compute/v2.1/servers/63d2bd74-d060-4925-9323-b39d5131f958 => generated 1535 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:04:15.147333 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-b6769e9c-f453-4a83-93c7-77697a18d693 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:04:15.147941 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-b6769e9c-f453-4a83-93c7-77697a18d693 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] [instance: 63d2bd74-d060-4925-9323-b39d5131f958] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:04:15.164484 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b6769e9c-f453-4a83-93c7-77697a18d693 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:15.165045 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b6769e9c-f453-4a83-93c7-77697a18d693 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:15.168414 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b6769e9c-f453-4a83-93c7-77697a18d693 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:15.172548 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b6769e9c-f453-4a83-93c7-77697a18d693 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:15.173034 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b6769e9c-f453-4a83-93c7-77697a18d693 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:15.174351 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b6769e9c-f453-4a83-93c7-77697a18d693 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:15.261751 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-861d9c5f-2c61-45d1-86a3-c77b2e4cb803 tempest-SecurityGroupRulesNegativeTestJSON-1048289237 tempest-SecurityGroupRulesNegativeTestJSON-1048289237-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/dede3234-beb1-41dc-91db-235957cb5009" status: 202 len: 0 microversion: 2.1 time: 1.030753 Aug 10 23:04:15.264815 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 988/1974] 10.222.0.58 () {58 vars in 1272 bytes} [Wed Aug 10 23:04:14 2022] DELETE /compute/v2.1/os-security-groups/dede3234-beb1-41dc-91db-235957cb5009 => generated 0 bytes in 1039 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:04:15.273378 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-b6769e9c-f453-4a83-93c7-77697a18d693 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] [instance: 63d2bd74-d060-4925-9323-b39d5131f958] Going to try to terminate instance {{(pid=122632) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:04:15.282037 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-a7a6eb6a-f22e-4177-978c-fa11b76fe94c tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:04:15.299697 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-a7a6eb6a-f22e-4177-978c-fa11b76fe94c tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] [instance: 0eb8b76a-370b-423d-a053-d2befea52a4b] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:04:15.325225 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a7a6eb6a-f22e-4177-978c-fa11b76fe94c tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:15.326515 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a7a6eb6a-f22e-4177-978c-fa11b76fe94c tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:15.327624 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a7a6eb6a-f22e-4177-978c-fa11b76fe94c tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:15.334195 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a7a6eb6a-f22e-4177-978c-fa11b76fe94c tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:15.334913 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a7a6eb6a-f22e-4177-978c-fa11b76fe94c tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:15.336870 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a7a6eb6a-f22e-4177-978c-fa11b76fe94c tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:15.670460 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-b6769e9c-f453-4a83-93c7-77697a18d693 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] 10.222.0.58 "DELETE /compute/v2.1/servers/63d2bd74-d060-4925-9323-b39d5131f958" status: 204 len: 0 microversion: 2.1 time: 0.529577 Aug 10 23:04:15.676801 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 987/1975] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:04:15 2022] DELETE /compute/v2.1/servers/63d2bd74-d060-4925-9323-b39d5131f958 => generated 0 bytes in 534 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:04:15.687353 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-cf9c936d-add6-4844-b6f8-13ce9e6848cd tempest-SecurityGroupRulesNegativeTestJSON-1048289237 tempest-SecurityGroupRulesNegativeTestJSON-1048289237-project] Calling method '.version_select at 0x7f847d59a1f0>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:04:16.004021 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-a7a6eb6a-f22e-4177-978c-fa11b76fe94c tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c26e69e2274083916402c96d71c5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a6ac1a984c478da9337692485d16ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:04:16.022309 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-a7a6eb6a-f22e-4177-978c-fa11b76fe94c tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] 10.222.0.58 "GET /compute/v2.1/servers/0eb8b76a-370b-423d-a053-d2befea52a4b" status: 200 len: 1322 microversion: 2.1 time: 0.754951 Aug 10 23:04:16.023223 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 989/1976] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:04:15 2022] GET /compute/v2.1/servers/0eb8b76a-370b-423d-a053-d2befea52a4b => generated 1322 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:04:16.043332 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-66629048-d4c7-4c09-ae03-060fe77b2dba tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:04:16.044466 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-66629048-d4c7-4c09-ae03-060fe77b2dba tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] [instance: 63d2bd74-d060-4925-9323-b39d5131f958] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:04:16.051435 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-66629048-d4c7-4c09-ae03-060fe77b2dba tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:16.052751 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-66629048-d4c7-4c09-ae03-060fe77b2dba tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:16.053330 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-66629048-d4c7-4c09-ae03-060fe77b2dba tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:16.054347 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-66629048-d4c7-4c09-ae03-060fe77b2dba tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:16.055129 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-66629048-d4c7-4c09-ae03-060fe77b2dba tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:16.055688 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-66629048-d4c7-4c09-ae03-060fe77b2dba tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:16.700524 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-66629048-d4c7-4c09-ae03-060fe77b2dba tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632904331d024d9b8e4d3660dff2cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ed0bdee3aa4013bd9219069bda558c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:04:16.713226 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-66629048-d4c7-4c09-ae03-060fe77b2dba tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] 10.222.0.58 "GET /compute/v2.1/servers/63d2bd74-d060-4925-9323-b39d5131f958" status: 200 len: 1388 microversion: 2.1 time: 0.679096 Aug 10 23:04:16.714971 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 990/1977] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:04:16 2022] GET /compute/v2.1/servers/63d2bd74-d060-4925-9323-b39d5131f958 => generated 1388 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:04:16.720503 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-2efe533b-9c49-4320-b099-bc4a9193c9e0 req-107b184d-892c-4217-b611-8c96f0dfd0da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0eb8b76a-370b-423d-a053-d2befea52a4b", "name": "network-vif-plugged", "status": "completed", "tag": "d0e21f83-9eb8-45d7-8e17-c0b4fcc59561"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:04:16.731847 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-2efe533b-9c49-4320-b099-bc4a9193c9e0 req-107b184d-892c-4217-b611-8c96f0dfd0da service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:16.732545 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-2efe533b-9c49-4320-b099-bc4a9193c9e0 req-107b184d-892c-4217-b611-8c96f0dfd0da service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:16.733167 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-2efe533b-9c49-4320-b099-bc4a9193c9e0 req-107b184d-892c-4217-b611-8c96f0dfd0da service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:16.749663 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-2efe533b-9c49-4320-b099-bc4a9193c9e0 req-107b184d-892c-4217-b611-8c96f0dfd0da service nova] Creating event network-vif-plugged:d0e21f83-9eb8-45d7-8e17-c0b4fcc59561 for instance 0eb8b76a-370b-423d-a053-d2befea52a4b on n-h2-850468-14 Aug 10 23:04:16.755582 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-2efe533b-9c49-4320-b099-bc4a9193c9e0 req-107b184d-892c-4217-b611-8c96f0dfd0da service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039299 Aug 10 23:04:16.756767 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 991/1978] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:04:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:04:17.046520 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-109f9883-2f6d-4cba-ace0-ca4045f24537 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:04:17.047265 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-109f9883-2f6d-4cba-ace0-ca4045f24537 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] [instance: 0eb8b76a-370b-423d-a053-d2befea52a4b] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:04:17.061902 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-109f9883-2f6d-4cba-ace0-ca4045f24537 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:17.062396 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-109f9883-2f6d-4cba-ace0-ca4045f24537 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:17.062894 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-109f9883-2f6d-4cba-ace0-ca4045f24537 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:17.063616 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-109f9883-2f6d-4cba-ace0-ca4045f24537 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:17.064061 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-109f9883-2f6d-4cba-ace0-ca4045f24537 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:17.070220 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-109f9883-2f6d-4cba-ace0-ca4045f24537 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:17.403699 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-cf9c936d-add6-4844-b6f8-13ce9e6848cd tempest-SecurityGroupRulesNegativeTestJSON-1048289237 tempest-SecurityGroupRulesNegativeTestJSON-1048289237-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/fa0b67be-4def-4ba3-a0d3-195481d551a0" status: 202 len: 0 microversion: 2.1 time: 1.724418 Aug 10 23:04:17.404273 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 988/1979] 10.222.0.58 () {58 vars in 1272 bytes} [Wed Aug 10 23:04:15 2022] DELETE /compute/v2.1/os-security-groups/fa0b67be-4def-4ba3-a0d3-195481d551a0 => generated 0 bytes in 1727 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:04:17.412808 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-d2b04c23-dc40-441a-8908-1d39f28f7c8f tempest-SecurityGroupRulesNegativeTestJSON-1048289237 tempest-SecurityGroupRulesNegativeTestJSON-1048289237-project] Calling method '.version_select at 0x7f847d0245e0>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:04:18.476873 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-109f9883-2f6d-4cba-ace0-ca4045f24537 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c26e69e2274083916402c96d71c5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a6ac1a984c478da9337692485d16ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:04:18.497650 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-109f9883-2f6d-4cba-ace0-ca4045f24537 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] 10.222.0.58 "GET /compute/v2.1/servers/0eb8b76a-370b-423d-a053-d2befea52a4b" status: 200 len: 1322 microversion: 2.1 time: 1.455123 Aug 10 23:04:18.511916 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 992/1980] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:04:17 2022] GET /compute/v2.1/servers/0eb8b76a-370b-423d-a053-d2befea52a4b => generated 1322 bytes in 1457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:04:18.527391 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-cce6b277-6e2e-4258-a052-18498dafd2fe tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:04:18.528145 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-cce6b277-6e2e-4258-a052-18498dafd2fe tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] [instance: 63d2bd74-d060-4925-9323-b39d5131f958] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:04:18.548793 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cce6b277-6e2e-4258-a052-18498dafd2fe tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:18.549284 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cce6b277-6e2e-4258-a052-18498dafd2fe tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:18.549719 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cce6b277-6e2e-4258-a052-18498dafd2fe tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:18.550696 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cce6b277-6e2e-4258-a052-18498dafd2fe tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:18.553784 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cce6b277-6e2e-4258-a052-18498dafd2fe tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:18.554693 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cce6b277-6e2e-4258-a052-18498dafd2fe tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:18.909726 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-cce6b277-6e2e-4258-a052-18498dafd2fe tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632904331d024d9b8e4d3660dff2cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ed0bdee3aa4013bd9219069bda558c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:04:18.919756 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-d2b04c23-dc40-441a-8908-1d39f28f7c8f tempest-SecurityGroupRulesNegativeTestJSON-1048289237 tempest-SecurityGroupRulesNegativeTestJSON-1048289237-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/6536efd3-81f2-4d1c-b577-d28b24becb3c" status: 202 len: 0 microversion: 2.1 time: 1.511438 Aug 10 23:04:18.923103 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 989/1981] 10.222.0.58 () {58 vars in 1272 bytes} [Wed Aug 10 23:04:17 2022] DELETE /compute/v2.1/os-security-groups/6536efd3-81f2-4d1c-b577-d28b24becb3c => generated 0 bytes in 1513 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 10 23:04:18.925775 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-bf803e09-6ac8-4bde-9ea0-be7e5fc25200 req-01c62647-a817-48ef-8951-a5c12eeeb1b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63d2bd74-d060-4925-9323-b39d5131f958", "name": "network-vif-deleted", "tag": "6375592d-fb15-4844-83aa-70296bc72a55"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:04:18.926282 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-cce6b277-6e2e-4258-a052-18498dafd2fe tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] 10.222.0.58 "GET /compute/v2.1/servers/63d2bd74-d060-4925-9323-b39d5131f958" status: 200 len: 1184 microversion: 2.1 time: 0.426460 Aug 10 23:04:18.926892 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 993/1982] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:04:18 2022] GET /compute/v2.1/servers/63d2bd74-d060-4925-9323-b39d5131f958 => generated 1184 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:04:18.931930 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-f3de3be7-8e97-49bb-a220-d02e15d85659 tempest-SecurityGroupRulesNegativeTestJSON-1048289237 tempest-SecurityGroupRulesNegativeTestJSON-1048289237-project] Calling method '.version_select at 0x7f848238e3a0>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:04:18.959580 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-bf803e09-6ac8-4bde-9ea0-be7e5fc25200 req-01c62647-a817-48ef-8951-a5c12eeeb1b4 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:18.964348 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-bf803e09-6ac8-4bde-9ea0-be7e5fc25200 req-01c62647-a817-48ef-8951-a5c12eeeb1b4 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:18.965243 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-bf803e09-6ac8-4bde-9ea0-be7e5fc25200 req-01c62647-a817-48ef-8951-a5c12eeeb1b4 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:19.013383 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-bf803e09-6ac8-4bde-9ea0-be7e5fc25200 req-01c62647-a817-48ef-8951-a5c12eeeb1b4 service nova] Creating event network-vif-deleted:6375592d-fb15-4844-83aa-70296bc72a55 for instance 63d2bd74-d060-4925-9323-b39d5131f958 on n-h2-850468-14 Aug 10 23:04:19.025851 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-bf803e09-6ac8-4bde-9ea0-be7e5fc25200 req-01c62647-a817-48ef-8951-a5c12eeeb1b4 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102988 Aug 10 23:04:19.029574 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 990/1983] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:04:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:04:19.491752 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-f3de3be7-8e97-49bb-a220-d02e15d85659 tempest-SecurityGroupRulesNegativeTestJSON-1048289237 tempest-SecurityGroupRulesNegativeTestJSON-1048289237-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/a86f3d23-b72a-4469-9d63-36e5beb1cc1c" status: 202 len: 0 microversion: 2.1 time: 0.563377 Aug 10 23:04:19.493357 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 994/1984] 10.222.0.58 () {58 vars in 1272 bytes} [Wed Aug 10 23:04:18 2022] DELETE /compute/v2.1/os-security-groups/a86f3d23-b72a-4469-9d63-36e5beb1cc1c => generated 0 bytes in 565 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:04:19.519717 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-cfc6592e-03a5-4ee5-863e-634156e2e515 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:04:19.520673 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-cfc6592e-03a5-4ee5-863e-634156e2e515 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] [instance: 0eb8b76a-370b-423d-a053-d2befea52a4b] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:04:19.532987 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cfc6592e-03a5-4ee5-863e-634156e2e515 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:19.536147 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cfc6592e-03a5-4ee5-863e-634156e2e515 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:19.539632 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cfc6592e-03a5-4ee5-863e-634156e2e515 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:19.543745 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cfc6592e-03a5-4ee5-863e-634156e2e515 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:19.544492 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cfc6592e-03a5-4ee5-863e-634156e2e515 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:19.546411 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cfc6592e-03a5-4ee5-863e-634156e2e515 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:19.952327 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-3f3a5ca5-6f41-4c0b-a261-c824d04d351d tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:04:19.952945 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-3f3a5ca5-6f41-4c0b-a261-c824d04d351d tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] [instance: 63d2bd74-d060-4925-9323-b39d5131f958] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:04:19.963202 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3f3a5ca5-6f41-4c0b-a261-c824d04d351d tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:19.963694 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3f3a5ca5-6f41-4c0b-a261-c824d04d351d tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:19.964132 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3f3a5ca5-6f41-4c0b-a261-c824d04d351d tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:19.964851 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3f3a5ca5-6f41-4c0b-a261-c824d04d351d tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:19.965304 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3f3a5ca5-6f41-4c0b-a261-c824d04d351d tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:19.965731 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3f3a5ca5-6f41-4c0b-a261-c824d04d351d tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:20.372955 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-3f3a5ca5-6f41-4c0b-a261-c824d04d351d tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632904331d024d9b8e4d3660dff2cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ed0bdee3aa4013bd9219069bda558c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:04:20.384561 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-3f3a5ca5-6f41-4c0b-a261-c824d04d351d tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] 10.222.0.58 "GET /compute/v2.1/servers/63d2bd74-d060-4925-9323-b39d5131f958" status: 200 len: 1184 microversion: 2.1 time: 0.437730 Aug 10 23:04:20.388178 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 995/1985] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:04:19 2022] GET /compute/v2.1/servers/63d2bd74-d060-4925-9323-b39d5131f958 => generated 1184 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:04:20.553624 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-cfc6592e-03a5-4ee5-863e-634156e2e515 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c26e69e2274083916402c96d71c5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a6ac1a984c478da9337692485d16ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:04:20.577582 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-cfc6592e-03a5-4ee5-863e-634156e2e515 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] 10.222.0.58 "GET /compute/v2.1/servers/0eb8b76a-370b-423d-a053-d2befea52a4b" status: 200 len: 1470 microversion: 2.1 time: 1.062370 Aug 10 23:04:20.578185 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 991/1986] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:04:19 2022] GET /compute/v2.1/servers/0eb8b76a-370b-423d-a053-d2befea52a4b => generated 1470 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:04:20.602801 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-2234dc8d-3c3e-40a7-aed4-e4d4fcee029d tempest-ServersAdminNegativeTestJSON-257998267 tempest-ServersAdminNegativeTestJSON-257998267-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:04:20.604050 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-2234dc8d-3c3e-40a7-aed4-e4d4fcee029d tempest-ServersAdminNegativeTestJSON-257998267 tempest-ServersAdminNegativeTestJSON-257998267-project-admin] [instance: 0eb8b76a-370b-423d-a053-d2befea52a4b] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:04:20.616834 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2234dc8d-3c3e-40a7-aed4-e4d4fcee029d tempest-ServersAdminNegativeTestJSON-257998267 tempest-ServersAdminNegativeTestJSON-257998267-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:20.617342 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2234dc8d-3c3e-40a7-aed4-e4d4fcee029d tempest-ServersAdminNegativeTestJSON-257998267 tempest-ServersAdminNegativeTestJSON-257998267-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:20.619580 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2234dc8d-3c3e-40a7-aed4-e4d4fcee029d tempest-ServersAdminNegativeTestJSON-257998267 tempest-ServersAdminNegativeTestJSON-257998267-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:20.620409 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2234dc8d-3c3e-40a7-aed4-e4d4fcee029d tempest-ServersAdminNegativeTestJSON-257998267 tempest-ServersAdminNegativeTestJSON-257998267-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:20.620871 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2234dc8d-3c3e-40a7-aed4-e4d4fcee029d tempest-ServersAdminNegativeTestJSON-257998267 tempest-ServersAdminNegativeTestJSON-257998267-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:20.621302 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2234dc8d-3c3e-40a7-aed4-e4d4fcee029d tempest-ServersAdminNegativeTestJSON-257998267 tempest-ServersAdminNegativeTestJSON-257998267-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:20.681783 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.objects.instance [None req-2234dc8d-3c3e-40a7-aed4-e4d4fcee029d tempest-ServersAdminNegativeTestJSON-257998267 tempest-ServersAdminNegativeTestJSON-257998267-project-admin] Lazy-loading 'flavor' on Instance uuid 0eb8b76a-370b-423d-a053-d2befea52a4b {{(pid=122633) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:04:20.815966 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-2234dc8d-3c3e-40a7-aed4-e4d4fcee029d tempest-ServersAdminNegativeTestJSON-257998267 tempest-ServersAdminNegativeTestJSON-257998267-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/0eb8b76a-370b-423d-a053-d2befea52a4b/action" status: 202 len: 0 microversion: 2.1 time: 0.219228 Aug 10 23:04:20.818549 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 996/1987] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:04:20 2022] POST /compute/v2.1/servers/0eb8b76a-370b-423d-a053-d2befea52a4b/action => generated 0 bytes in 223 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 10 23:04:20.827234 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-96660df2-a9c2-4186-bae1-ec46d84fdb38 tempest-ServersAdminNegativeTestJSON-257998267 tempest-ServersAdminNegativeTestJSON-257998267-project-admin] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:04:20.827850 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-96660df2-a9c2-4186-bae1-ec46d84fdb38 tempest-ServersAdminNegativeTestJSON-257998267 tempest-ServersAdminNegativeTestJSON-257998267-project-admin] [instance: 0eb8b76a-370b-423d-a053-d2befea52a4b] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:04:20.841083 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-96660df2-a9c2-4186-bae1-ec46d84fdb38 tempest-ServersAdminNegativeTestJSON-257998267 tempest-ServersAdminNegativeTestJSON-257998267-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:20.842874 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-96660df2-a9c2-4186-bae1-ec46d84fdb38 tempest-ServersAdminNegativeTestJSON-257998267 tempest-ServersAdminNegativeTestJSON-257998267-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:20.846113 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-96660df2-a9c2-4186-bae1-ec46d84fdb38 tempest-ServersAdminNegativeTestJSON-257998267 tempest-ServersAdminNegativeTestJSON-257998267-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:20.847940 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-96660df2-a9c2-4186-bae1-ec46d84fdb38 tempest-ServersAdminNegativeTestJSON-257998267 tempest-ServersAdminNegativeTestJSON-257998267-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:20.848431 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-96660df2-a9c2-4186-bae1-ec46d84fdb38 tempest-ServersAdminNegativeTestJSON-257998267 tempest-ServersAdminNegativeTestJSON-257998267-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:20.848942 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-96660df2-a9c2-4186-bae1-ec46d84fdb38 tempest-ServersAdminNegativeTestJSON-257998267 tempest-ServersAdminNegativeTestJSON-257998267-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:21.416206 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-53d13f33-a1fa-4aec-96ad-dc135bc5ecc2 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:04:21.416984 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-53d13f33-a1fa-4aec-96ad-dc135bc5ecc2 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] [instance: 63d2bd74-d060-4925-9323-b39d5131f958] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:04:21.437233 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-53d13f33-a1fa-4aec-96ad-dc135bc5ecc2 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:21.438741 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-53d13f33-a1fa-4aec-96ad-dc135bc5ecc2 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:21.442988 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-53d13f33-a1fa-4aec-96ad-dc135bc5ecc2 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:21.443949 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-53d13f33-a1fa-4aec-96ad-dc135bc5ecc2 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:21.444563 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-53d13f33-a1fa-4aec-96ad-dc135bc5ecc2 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:21.445135 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-53d13f33-a1fa-4aec-96ad-dc135bc5ecc2 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:21.765489 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-96660df2-a9c2-4186-bae1-ec46d84fdb38 tempest-ServersAdminNegativeTestJSON-257998267 tempest-ServersAdminNegativeTestJSON-257998267-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/0eb8b76a-370b-423d-a053-d2befea52a4b" status: 200 len: 1631 microversion: 2.1 time: 0.942003 Aug 10 23:04:21.771138 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 992/1988] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:04:20 2022] GET /compute/v2.1/servers/0eb8b76a-370b-423d-a053-d2befea52a4b => generated 1631 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:04:22.067031 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-53d13f33-a1fa-4aec-96ad-dc135bc5ecc2 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632904331d024d9b8e4d3660dff2cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ed0bdee3aa4013bd9219069bda558c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:04:22.076431 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-53d13f33-a1fa-4aec-96ad-dc135bc5ecc2 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] 10.222.0.58 "GET /compute/v2.1/servers/63d2bd74-d060-4925-9323-b39d5131f958" status: 200 len: 1184 microversion: 2.1 time: 0.671825 Aug 10 23:04:22.084164 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 997/1989] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:04:21 2022] GET /compute/v2.1/servers/63d2bd74-d060-4925-9323-b39d5131f958 => generated 1184 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:04:22.787579 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-bdb324c6-02a3-46bd-96f7-2badb57f6cc9 tempest-ServersAdminNegativeTestJSON-257998267 tempest-ServersAdminNegativeTestJSON-257998267-project-admin] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:04:22.788191 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-bdb324c6-02a3-46bd-96f7-2badb57f6cc9 tempest-ServersAdminNegativeTestJSON-257998267 tempest-ServersAdminNegativeTestJSON-257998267-project-admin] [instance: 0eb8b76a-370b-423d-a053-d2befea52a4b] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:04:22.804480 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bdb324c6-02a3-46bd-96f7-2badb57f6cc9 tempest-ServersAdminNegativeTestJSON-257998267 tempest-ServersAdminNegativeTestJSON-257998267-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:22.812581 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bdb324c6-02a3-46bd-96f7-2badb57f6cc9 tempest-ServersAdminNegativeTestJSON-257998267 tempest-ServersAdminNegativeTestJSON-257998267-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:22.813249 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bdb324c6-02a3-46bd-96f7-2badb57f6cc9 tempest-ServersAdminNegativeTestJSON-257998267 tempest-ServersAdminNegativeTestJSON-257998267-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:22.815688 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bdb324c6-02a3-46bd-96f7-2badb57f6cc9 tempest-ServersAdminNegativeTestJSON-257998267 tempest-ServersAdminNegativeTestJSON-257998267-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:22.824648 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bdb324c6-02a3-46bd-96f7-2badb57f6cc9 tempest-ServersAdminNegativeTestJSON-257998267 tempest-ServersAdminNegativeTestJSON-257998267-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:22.834027 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bdb324c6-02a3-46bd-96f7-2badb57f6cc9 tempest-ServersAdminNegativeTestJSON-257998267 tempest-ServersAdminNegativeTestJSON-257998267-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:23.598817 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-13a7967d-c273-4258-a2f9-83db598bd12a tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-71038256", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452", "networks": [{"uuid": "b41606e0-6882-4bc8-a807-c42ffd505c58"}]}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:04:23.725132 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.network.neutron [None req-13a7967d-c273-4258-a2f9-83db598bd12a tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] validate_networks() for [('b41606e0-6882-4bc8-a807-c42ffd505c58', None, None, None, None, None)] {{(pid=122633) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 23:04:23.847966 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-bdb324c6-02a3-46bd-96f7-2badb57f6cc9 tempest-ServersAdminNegativeTestJSON-257998267 tempest-ServersAdminNegativeTestJSON-257998267-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/0eb8b76a-370b-423d-a053-d2befea52a4b" status: 200 len: 1614 microversion: 2.1 time: 1.064464 Aug 10 23:04:23.848555 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 993/1990] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:04:22 2022] GET /compute/v2.1/servers/0eb8b76a-370b-423d-a053-d2befea52a4b => generated 1614 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:04:23.865654 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-427dddee-105c-434f-b478-933b5aa1a58c tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:04:23.873101 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-427dddee-105c-434f-b478-933b5aa1a58c tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] [instance: 63d2bd74-d060-4925-9323-b39d5131f958] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:04:23.879923 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-427dddee-105c-434f-b478-933b5aa1a58c tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:23.883375 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-427dddee-105c-434f-b478-933b5aa1a58c tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:23.884100 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-427dddee-105c-434f-b478-933b5aa1a58c tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:23.886886 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-427dddee-105c-434f-b478-933b5aa1a58c tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:23.887640 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-427dddee-105c-434f-b478-933b5aa1a58c tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:23.893491 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-427dddee-105c-434f-b478-933b5aa1a58c tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:24.258223 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-427dddee-105c-434f-b478-933b5aa1a58c tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632904331d024d9b8e4d3660dff2cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ed0bdee3aa4013bd9219069bda558c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:04:24.275732 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-427dddee-105c-434f-b478-933b5aa1a58c tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] 10.222.0.58 "GET /compute/v2.1/servers/63d2bd74-d060-4925-9323-b39d5131f958" status: 200 len: 1184 microversion: 2.1 time: 0.420420 Aug 10 23:04:24.289949 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 994/1991] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:04:23 2022] GET /compute/v2.1/servers/63d2bd74-d060-4925-9323-b39d5131f958 => generated 1184 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:04:24.305087 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-43064b06-fdf9-42a8-b252-6e67889907a1 tempest-ServersAdminNegativeTestJSON-257998267 tempest-ServersAdminNegativeTestJSON-257998267-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:04:24.305806 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-43064b06-fdf9-42a8-b252-6e67889907a1 tempest-ServersAdminNegativeTestJSON-257998267 tempest-ServersAdminNegativeTestJSON-257998267-project-admin] [instance: 0eb8b76a-370b-423d-a053-d2befea52a4b] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:04:24.326246 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-43064b06-fdf9-42a8-b252-6e67889907a1 tempest-ServersAdminNegativeTestJSON-257998267 tempest-ServersAdminNegativeTestJSON-257998267-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:24.326866 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-43064b06-fdf9-42a8-b252-6e67889907a1 tempest-ServersAdminNegativeTestJSON-257998267 tempest-ServersAdminNegativeTestJSON-257998267-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:24.329874 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-43064b06-fdf9-42a8-b252-6e67889907a1 tempest-ServersAdminNegativeTestJSON-257998267 tempest-ServersAdminNegativeTestJSON-257998267-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:24.330919 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-43064b06-fdf9-42a8-b252-6e67889907a1 tempest-ServersAdminNegativeTestJSON-257998267 tempest-ServersAdminNegativeTestJSON-257998267-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:24.334814 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-43064b06-fdf9-42a8-b252-6e67889907a1 tempest-ServersAdminNegativeTestJSON-257998267 tempest-ServersAdminNegativeTestJSON-257998267-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:24.336234 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-43064b06-fdf9-42a8-b252-6e67889907a1 tempest-ServersAdminNegativeTestJSON-257998267 tempest-ServersAdminNegativeTestJSON-257998267-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:24.540386 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-43064b06-fdf9-42a8-b252-6e67889907a1 tempest-ServersAdminNegativeTestJSON-257998267 tempest-ServersAdminNegativeTestJSON-257998267-project-admin] HTTP exception thrown: Cannot 'migrate' instance 0eb8b76a-370b-423d-a053-d2befea52a4b while it is in vm_state suspended Aug 10 23:04:24.556895 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-43064b06-fdf9-42a8-b252-6e67889907a1 tempest-ServersAdminNegativeTestJSON-257998267 tempest-ServersAdminNegativeTestJSON-257998267-project-admin] Request method failure captured: Aug 10 23:04:24.556895 n-d-850468-14 devstack@n-api.service[122632]: request: POST /compute/v2.1/servers/0eb8b76a-370b-423d-a053-d2befea52a4b/action HTTP/1.1 Aug 10 23:04:24.556895 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:04:24.556895 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:04:24.556895 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:04:24.556895 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 15 Aug 10 23:04:24.556895 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:04:24.556895 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:04:24.556895 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:04:24.556895 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:04:24.556895 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9DlI1CoD5kLKbxHT3eVw_3GSVtvU34hkR3k_tXUUAsYJrpGYUMoEh0LSe64EH2AEKCxJjZe2Aq4pljcPSr1IJ1gI4N3woLCH-6ktCr52lygl9P077CyMqJZ7Wy37I7dZ7zFopkA229VzEzgCQb38Wij8wVfhy-ymklq6wyrhrwMpAW0 Aug 10 23:04:24.556895 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:04:24.556895 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:04:24.556895 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:04:24.556895 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:04:24.556895 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:04:24.556895 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:04:24.556895 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: f0458bb7c6284928adaa2efc3710e70d Aug 10 23:04:24.556895 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-257998267 Aug 10 23:04:24.556895 n-d-850468-14 devstack@n-api.service[122632]: X-Role: admin,member,reader Aug 10 23:04:24.556895 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: admin,member,reader Aug 10 23:04:24.558094 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f0458bb7c6284928adaa2efc3710e70d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f0458bb7c6284928adaa2efc3710e70d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/f0458bb7c6284928adaa2efc3710e70d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_f0458bb7c6284928adaa2efc3710e70d", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:04:24.558094 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-ServersAdminNegativeTestJSON-257998267 Aug 10 23:04:24.558094 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: f0458bb7c6284928adaa2efc3710e70d Aug 10 23:04:24.558094 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-257998267 Aug 10 23:04:24.558094 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-ServersAdminNegativeTestJSON-257998267-project-admin Aug 10 23:04:24.558094 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:04:24.558094 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:04:24.558094 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: 3690a2c07fd74a5b93032acc152c2752 Aug 10 23:04:24.558094 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-ServersAdminNegativeTestJSON-257998267-project-admin Aug 10 23:04:24.558094 n-d-850468-14 devstack@n-api.service[122632]: Aug 10 23:04:24.558094 n-d-850468-14 devstack@n-api.service[122632]: {"migrate": {}} Aug 10 23:04:24.558094 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:04:24.558094 n-d-850468-14 devstack@n-api.service[122632]: exception: Cannot 'migrate' instance 0eb8b76a-370b-423d-a053-d2befea52a4b while it is in vm_state suspended Aug 10 23:04:24.558919 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': '0eb8b76a-370b-423d-a053-d2befea52a4b', 'body': {'migrate': {}}} Aug 10 23:04:24.558919 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:04:24.558919 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:04:24.558919 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Aug 10 23:04:24.558919 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Aug 10 23:04:24.558919 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Aug 10 23:04:24.558919 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 10 23:04:24.558919 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Aug 10 23:04:24.558919 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 10 23:04:24.558919 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Aug 10 23:04:24.558919 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 10 23:04:24.558919 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Aug 10 23:04:24.558919 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 10 23:04:24.558919 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 10 23:04:24.558919 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 10 23:04:24.558919 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 10 23:04:24.558919 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 10 23:04:24.558919 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 0eb8b76a-370b-423d-a053-d2befea52a4b in vm_state suspended. Cannot resize while the instance is in this state. Aug 10 23:04:24.558919 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:04:24.559845 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:04:24.559845 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:04:24.559845 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:04:24.559845 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:04:24.559845 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:04:24.559845 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:04:24.559845 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:04:24.559845 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:04:24.559845 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:04:24.559845 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 23:04:24.559845 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 23:04:24.559845 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Aug 10 23:04:24.559845 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 10 23:04:24.559845 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 10 23:04:24.559845 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 10 23:04:24.559845 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance 0eb8b76a-370b-423d-a053-d2befea52a4b while it is in vm_state suspended Aug 10 23:04:24.559845 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:04:24.559845 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:04:24.559845 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:04:24.559845 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:04:24.561063 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:04:24.561063 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:04:24.561063 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:04:24.561063 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:04:24.561063 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance 0eb8b76a-370b-423d-a053-d2befea52a4b while it is in vm_state suspended Aug 10 23:04:24.561063 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:04:24.573407 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-43064b06-fdf9-42a8-b252-6e67889907a1 tempest-ServersAdminNegativeTestJSON-257998267 tempest-ServersAdminNegativeTestJSON-257998267-project-admin] Returning 409 to user: Cannot 'migrate' instance 0eb8b76a-370b-423d-a053-d2befea52a4b while it is in vm_state suspended {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:04:24.575836 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-43064b06-fdf9-42a8-b252-6e67889907a1 tempest-ServersAdminNegativeTestJSON-257998267 tempest-ServersAdminNegativeTestJSON-257998267-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/0eb8b76a-370b-423d-a053-d2befea52a4b/action" status: 409 len: 148 microversion: 2.1 time: 0.283522 Aug 10 23:04:24.591742 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 995/1992] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:04:24 2022] POST /compute/v2.1/servers/0eb8b76a-370b-423d-a053-d2befea52a4b/action => generated 148 bytes in 301 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 10 23:04:24.607084 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-68bf1049-c483-4bbb-8816-d794393695c6 tempest-ServersAdminNegativeTestJSON-257998267 tempest-ServersAdminNegativeTestJSON-257998267-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:04:24.620013 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-68bf1049-c483-4bbb-8816-d794393695c6 tempest-ServersAdminNegativeTestJSON-257998267 tempest-ServersAdminNegativeTestJSON-257998267-project-admin] Request method failure captured: Aug 10 23:04:24.620013 n-d-850468-14 devstack@n-api.service[122632]: request: POST /compute/v2.1/servers/3f5e8cd2-6666-4206-a393-9f0507322402/action HTTP/1.1 Aug 10 23:04:24.620013 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:04:24.620013 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:04:24.620013 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:04:24.620013 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 39 Aug 10 23:04:24.620013 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:04:24.620013 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:04:24.620013 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:04:24.620013 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:04:24.620013 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9DlI1CoD5kLKbxHT3eVw_3GSVtvU34hkR3k_tXUUAsYJrpGYUMoEh0LSe64EH2AEKCxJjZe2Aq4pljcPSr1IJ1gI4N3woLCH-6ktCr52lygl9P077CyMqJZ7Wy37I7dZ7zFopkA229VzEzgCQb38Wij8wVfhy-ymklq6wyrhrwMpAW0 Aug 10 23:04:24.620013 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:04:24.620013 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:04:24.620013 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:04:24.620013 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:04:24.620013 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:04:24.620013 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:04:24.620013 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: f0458bb7c6284928adaa2efc3710e70d Aug 10 23:04:24.620013 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-257998267 Aug 10 23:04:24.620013 n-d-850468-14 devstack@n-api.service[122632]: X-Role: admin,member,reader Aug 10 23:04:24.620013 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: admin,member,reader Aug 10 23:04:24.621090 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f0458bb7c6284928adaa2efc3710e70d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f0458bb7c6284928adaa2efc3710e70d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/f0458bb7c6284928adaa2efc3710e70d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_f0458bb7c6284928adaa2efc3710e70d", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:04:24.621090 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-ServersAdminNegativeTestJSON-257998267 Aug 10 23:04:24.621090 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: f0458bb7c6284928adaa2efc3710e70d Aug 10 23:04:24.621090 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-257998267 Aug 10 23:04:24.621090 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-ServersAdminNegativeTestJSON-257998267-project-admin Aug 10 23:04:24.621090 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:04:24.621090 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:04:24.621090 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: 3690a2c07fd74a5b93032acc152c2752 Aug 10 23:04:24.621090 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-ServersAdminNegativeTestJSON-257998267-project-admin Aug 10 23:04:24.621090 n-d-850468-14 devstack@n-api.service[122632]: Aug 10 23:04:24.621090 n-d-850468-14 devstack@n-api.service[122632]: {"os-resetState": {"state": "invalid"}} Aug 10 23:04:24.621090 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:04:24.621676 n-d-850468-14 devstack@n-api.service[122632]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Aug 10 23:04:24.621676 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': '3f5e8cd2-6666-4206-a393-9f0507322402', 'body': {'os-resetState': {'state': 'invalid'}}} Aug 10 23:04:24.621676 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:04:24.621676 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:04:24.621676 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 10 23:04:24.621676 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 10 23:04:24.621676 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 10 23:04:24.621676 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise error Aug 10 23:04:24.621676 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Aug 10 23:04:24.621676 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:04:24.621676 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Aug 10 23:04:24.621676 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Aug 10 23:04:24.621676 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:04:24.621676 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Aug 10 23:04:24.621676 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi 'invalid' Aug 10 23:04:24.621676 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:04:24.621676 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:04:24.621676 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:04:24.621676 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:04:24.621676 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:04:24.621676 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:04:24.621676 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:04:24.622721 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:04:24.622721 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:04:24.622721 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:04:24.622721 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 10 23:04:24.622721 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 10 23:04:24.622721 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 10 23:04:24.622721 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 10 23:04:24.622721 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 10 23:04:24.622721 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 10 23:04:24.622721 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Aug 10 23:04:24.622721 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:04:24.622721 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:04:24.622721 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:04:24.622721 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:04:24.622721 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:04:24.622721 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:04:24.622721 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 10 23:04:24.622721 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 10 23:04:24.622721 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Aug 10 23:04:24.623668 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:04:24.625507 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-68bf1049-c483-4bbb-8816-d794393695c6 tempest-ServersAdminNegativeTestJSON-257998267 tempest-ServersAdminNegativeTestJSON-257998267-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:04:24.626599 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-68bf1049-c483-4bbb-8816-d794393695c6 tempest-ServersAdminNegativeTestJSON-257998267 tempest-ServersAdminNegativeTestJSON-257998267-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/3f5e8cd2-6666-4206-a393-9f0507322402/action" status: 400 len: 144 microversion: 2.1 time: 0.024603 Aug 10 23:04:24.629311 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 996/1993] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:04:24 2022] POST /compute/v2.1/servers/3f5e8cd2-6666-4206-a393-9f0507322402/action => generated 144 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 10 23:04:24.645707 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-49815c61-4da8-45c0-a84a-56b5b9a1b8eb tempest-ServersAdminNegativeTestJSON-257998267 tempest-ServersAdminNegativeTestJSON-257998267-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:04:24.657241 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-49815c61-4da8-45c0-a84a-56b5b9a1b8eb tempest-ServersAdminNegativeTestJSON-257998267 tempest-ServersAdminNegativeTestJSON-257998267-project-admin] Request method failure captured: Aug 10 23:04:24.657241 n-d-850468-14 devstack@n-api.service[122632]: request: POST /compute/v2.1/servers/3f5e8cd2-6666-4206-a393-9f0507322402/action HTTP/1.1 Aug 10 23:04:24.657241 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:04:24.657241 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:04:24.657241 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:04:24.657241 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 31 Aug 10 23:04:24.657241 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:04:24.657241 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:04:24.657241 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:04:24.657241 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:04:24.657241 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9DlI1CoD5kLKbxHT3eVw_3GSVtvU34hkR3k_tXUUAsYJrpGYUMoEh0LSe64EH2AEKCxJjZe2Aq4pljcPSr1IJ1gI4N3woLCH-6ktCr52lygl9P077CyMqJZ7Wy37I7dZ7zFopkA229VzEzgCQb38Wij8wVfhy-ymklq6wyrhrwMpAW0 Aug 10 23:04:24.657241 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:04:24.657241 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:04:24.657241 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:04:24.657241 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:04:24.657241 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:04:24.657241 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:04:24.657241 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: f0458bb7c6284928adaa2efc3710e70d Aug 10 23:04:24.657241 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-257998267 Aug 10 23:04:24.657241 n-d-850468-14 devstack@n-api.service[122632]: X-Role: admin,member,reader Aug 10 23:04:24.657241 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: admin,member,reader Aug 10 23:04:24.658476 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f0458bb7c6284928adaa2efc3710e70d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f0458bb7c6284928adaa2efc3710e70d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/f0458bb7c6284928adaa2efc3710e70d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_f0458bb7c6284928adaa2efc3710e70d", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:04:24.658476 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-ServersAdminNegativeTestJSON-257998267 Aug 10 23:04:24.658476 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: f0458bb7c6284928adaa2efc3710e70d Aug 10 23:04:24.658476 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-257998267 Aug 10 23:04:24.658476 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-ServersAdminNegativeTestJSON-257998267-project-admin Aug 10 23:04:24.658476 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:04:24.658476 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:04:24.658476 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: 3690a2c07fd74a5b93032acc152c2752 Aug 10 23:04:24.658476 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-ServersAdminNegativeTestJSON-257998267-project-admin Aug 10 23:04:24.658476 n-d-850468-14 devstack@n-api.service[122632]: Aug 10 23:04:24.658476 n-d-850468-14 devstack@n-api.service[122632]: {"os-resetState": {"state": 1}} Aug 10 23:04:24.658476 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:04:24.658476 n-d-850468-14 devstack@n-api.service[122632]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Aug 10 23:04:24.659669 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': '3f5e8cd2-6666-4206-a393-9f0507322402', 'body': {'os-resetState': {'state': 1}}} Aug 10 23:04:24.659669 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:04:24.659669 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:04:24.659669 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 10 23:04:24.659669 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 10 23:04:24.659669 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 10 23:04:24.659669 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise error Aug 10 23:04:24.659669 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Aug 10 23:04:24.659669 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:04:24.659669 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Aug 10 23:04:24.659669 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Aug 10 23:04:24.659669 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:04:24.659669 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Aug 10 23:04:24.659669 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi 1 Aug 10 23:04:24.659669 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:04:24.659669 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:04:24.659669 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:04:24.659669 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:04:24.659669 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:04:24.659669 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:04:24.659669 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:04:24.659669 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:04:24.662222 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:04:24.662222 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:04:24.662222 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 10 23:04:24.662222 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 10 23:04:24.662222 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 10 23:04:24.662222 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 10 23:04:24.662222 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 10 23:04:24.662222 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 10 23:04:24.662222 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Aug 10 23:04:24.662222 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:04:24.662222 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:04:24.662222 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:04:24.662222 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:04:24.662222 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:04:24.662222 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:04:24.662222 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 10 23:04:24.662222 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 10 23:04:24.662222 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Aug 10 23:04:24.662222 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:04:24.664800 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-49815c61-4da8-45c0-a84a-56b5b9a1b8eb tempest-ServersAdminNegativeTestJSON-257998267 tempest-ServersAdminNegativeTestJSON-257998267-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:04:24.669399 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-49815c61-4da8-45c0-a84a-56b5b9a1b8eb tempest-ServersAdminNegativeTestJSON-257998267 tempest-ServersAdminNegativeTestJSON-257998267-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/3f5e8cd2-6666-4206-a393-9f0507322402/action" status: 400 len: 120 microversion: 2.1 time: 0.034651 Aug 10 23:04:24.678664 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 997/1994] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:04:24 2022] POST /compute/v2.1/servers/3f5e8cd2-6666-4206-a393-9f0507322402/action => generated 120 bytes in 39 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 10 23:04:24.700029 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-f5af072c-d14c-4abb-adbf-60460bee0815 tempest-ServersAdminNegativeTestJSON-257998267 tempest-ServersAdminNegativeTestJSON-257998267-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:04:24.709842 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-f5af072c-d14c-4abb-adbf-60460bee0815 tempest-ServersAdminNegativeTestJSON-257998267 tempest-ServersAdminNegativeTestJSON-257998267-project-admin] Failed to fetch instance by id 999 {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2928}} Aug 10 23:04:24.710528 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-f5af072c-d14c-4abb-adbf-60460bee0815 tempest-ServersAdminNegativeTestJSON-257998267 tempest-ServersAdminNegativeTestJSON-257998267-project-admin] HTTP exception thrown: Instance 999 could not be found. Aug 10 23:04:24.720218 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-f5af072c-d14c-4abb-adbf-60460bee0815 tempest-ServersAdminNegativeTestJSON-257998267 tempest-ServersAdminNegativeTestJSON-257998267-project-admin] Request method failure captured: Aug 10 23:04:24.720218 n-d-850468-14 devstack@n-api.service[122632]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Aug 10 23:04:24.720218 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:04:24.720218 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:04:24.720218 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:04:24.720218 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 37 Aug 10 23:04:24.720218 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:04:24.720218 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:04:24.720218 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:04:24.720218 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:04:24.720218 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9DlI1CoD5kLKbxHT3eVw_3GSVtvU34hkR3k_tXUUAsYJrpGYUMoEh0LSe64EH2AEKCxJjZe2Aq4pljcPSr1IJ1gI4N3woLCH-6ktCr52lygl9P077CyMqJZ7Wy37I7dZ7zFopkA229VzEzgCQb38Wij8wVfhy-ymklq6wyrhrwMpAW0 Aug 10 23:04:24.720218 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:04:24.720218 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:04:24.720218 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:04:24.720218 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:04:24.720218 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:04:24.720218 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:04:24.720218 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: f0458bb7c6284928adaa2efc3710e70d Aug 10 23:04:24.720218 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-257998267 Aug 10 23:04:24.720218 n-d-850468-14 devstack@n-api.service[122632]: X-Role: admin,member,reader Aug 10 23:04:24.720218 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: admin,member,reader Aug 10 23:04:24.721625 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f0458bb7c6284928adaa2efc3710e70d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f0458bb7c6284928adaa2efc3710e70d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/f0458bb7c6284928adaa2efc3710e70d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_f0458bb7c6284928adaa2efc3710e70d", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:04:24.721625 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-ServersAdminNegativeTestJSON-257998267 Aug 10 23:04:24.721625 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: f0458bb7c6284928adaa2efc3710e70d Aug 10 23:04:24.721625 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-257998267 Aug 10 23:04:24.721625 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-ServersAdminNegativeTestJSON-257998267-project-admin Aug 10 23:04:24.721625 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:04:24.721625 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:04:24.721625 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: 3690a2c07fd74a5b93032acc152c2752 Aug 10 23:04:24.721625 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-ServersAdminNegativeTestJSON-257998267-project-admin Aug 10 23:04:24.721625 n-d-850468-14 devstack@n-api.service[122632]: Aug 10 23:04:24.721625 n-d-850468-14 devstack@n-api.service[122632]: {"os-resetState": {"state": "error"}} Aug 10 23:04:24.721625 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:04:24.721625 n-d-850468-14 devstack@n-api.service[122632]: exception: Instance 999 could not be found. Aug 10 23:04:24.722378 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Aug 10 23:04:24.722378 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:04:24.722378 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:04:24.722378 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:04:24.722378 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:04:24.722378 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2929, in get Aug 10 23:04:24.722378 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 10 23:04:24.722378 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Aug 10 23:04:24.722378 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:04:24.722378 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:04:24.722378 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:04:24.722378 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:04:24.722378 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:04:24.722378 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:04:24.722378 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:04:24.722378 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:04:24.722378 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:04:24.722378 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:04:24.722378 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 23:04:24.722378 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 23:04:24.722378 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Aug 10 23:04:24.723443 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 10 23:04:24.723443 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:04:24.723443 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:04:24.723443 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Aug 10 23:04:24.723443 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:04:24.723443 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:04:24.723443 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:04:24.723443 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:04:24.723443 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:04:24.723443 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:04:24.723443 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:04:24.723443 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:04:24.723443 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Aug 10 23:04:24.723443 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:04:24.723443 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-f5af072c-d14c-4abb-adbf-60460bee0815 tempest-ServersAdminNegativeTestJSON-257998267 tempest-ServersAdminNegativeTestJSON-257998267-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:04:24.724213 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-f5af072c-d14c-4abb-adbf-60460bee0815 tempest-ServersAdminNegativeTestJSON-257998267 tempest-ServersAdminNegativeTestJSON-257998267-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.040223 Aug 10 23:04:24.725924 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 998/1995] 10.222.0.58 () {60 vars in 1179 bytes} [Wed Aug 10 23:04:24 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 10 23:04:24.740008 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-e1bd58a5-2694-4653-a51b-6ac1700d8fc4 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:04:24.740975 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-e1bd58a5-2694-4653-a51b-6ac1700d8fc4 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] [instance: 0eb8b76a-370b-423d-a053-d2befea52a4b] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:04:24.764750 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e1bd58a5-2694-4653-a51b-6ac1700d8fc4 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:24.769037 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e1bd58a5-2694-4653-a51b-6ac1700d8fc4 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:24.770001 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e1bd58a5-2694-4653-a51b-6ac1700d8fc4 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:24.771891 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e1bd58a5-2694-4653-a51b-6ac1700d8fc4 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:24.772992 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e1bd58a5-2694-4653-a51b-6ac1700d8fc4 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:24.773618 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e1bd58a5-2694-4653-a51b-6ac1700d8fc4 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:24.843187 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-e1bd58a5-2694-4653-a51b-6ac1700d8fc4 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] [instance: 0eb8b76a-370b-423d-a053-d2befea52a4b] Going to try to terminate instance {{(pid=122632) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:04:25.172806 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-e1bd58a5-2694-4653-a51b-6ac1700d8fc4 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] 10.222.0.58 "DELETE /compute/v2.1/servers/0eb8b76a-370b-423d-a053-d2befea52a4b" status: 204 len: 0 microversion: 2.1 time: 0.439282 Aug 10 23:04:25.175542 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 999/1996] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:04:24 2022] DELETE /compute/v2.1/servers/0eb8b76a-370b-423d-a053-d2befea52a4b => generated 0 bytes in 445 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 10 23:04:25.185886 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-15ba32d3-94ee-493d-9b68-d8616a9c0da2 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:04:25.187325 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-15ba32d3-94ee-493d-9b68-d8616a9c0da2 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] [instance: 0eb8b76a-370b-423d-a053-d2befea52a4b] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:04:25.204883 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-15ba32d3-94ee-493d-9b68-d8616a9c0da2 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:25.207266 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-15ba32d3-94ee-493d-9b68-d8616a9c0da2 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:25.208889 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-15ba32d3-94ee-493d-9b68-d8616a9c0da2 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:25.210875 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-15ba32d3-94ee-493d-9b68-d8616a9c0da2 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:25.215922 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-15ba32d3-94ee-493d-9b68-d8616a9c0da2 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:25.219953 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-15ba32d3-94ee-493d-9b68-d8616a9c0da2 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:26.341001 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-15ba32d3-94ee-493d-9b68-d8616a9c0da2 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c26e69e2274083916402c96d71c5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a6ac1a984c478da9337692485d16ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:04:26.352602 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-15ba32d3-94ee-493d-9b68-d8616a9c0da2 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] 10.222.0.58 "GET /compute/v2.1/servers/0eb8b76a-370b-423d-a053-d2befea52a4b" status: 200 len: 1467 microversion: 2.1 time: 1.173004 Aug 10 23:04:26.358333 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1000/1997] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:04:25 2022] GET /compute/v2.1/servers/0eb8b76a-370b-423d-a053-d2befea52a4b => generated 1467 bytes in 1180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:04:26.378207 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-f032b981-4a81-4978-a8a3-77717761a8b6 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:04:26.381146 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-f032b981-4a81-4978-a8a3-77717761a8b6 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] [instance: 63d2bd74-d060-4925-9323-b39d5131f958] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:04:26.392528 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f032b981-4a81-4978-a8a3-77717761a8b6 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:26.400162 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f032b981-4a81-4978-a8a3-77717761a8b6 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:26.402721 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f032b981-4a81-4978-a8a3-77717761a8b6 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:26.405210 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f032b981-4a81-4978-a8a3-77717761a8b6 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:26.407725 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f032b981-4a81-4978-a8a3-77717761a8b6 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:26.411460 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f032b981-4a81-4978-a8a3-77717761a8b6 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:26.651034 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-f032b981-4a81-4978-a8a3-77717761a8b6 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632904331d024d9b8e4d3660dff2cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ed0bdee3aa4013bd9219069bda558c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:04:26.662626 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-f032b981-4a81-4978-a8a3-77717761a8b6 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] 10.222.0.58 "GET /compute/v2.1/servers/63d2bd74-d060-4925-9323-b39d5131f958" status: 200 len: 1184 microversion: 2.1 time: 0.300690 Aug 10 23:04:26.681056 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1001/1998] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:04:26 2022] GET /compute/v2.1/servers/63d2bd74-d060-4925-9323-b39d5131f958 => generated 1184 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:04:27.379056 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-79e51294-d700-4443-83eb-0b32c908ecdb tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:04:27.379672 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-79e51294-d700-4443-83eb-0b32c908ecdb tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] [instance: 0eb8b76a-370b-423d-a053-d2befea52a4b] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:04:27.395760 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-79e51294-d700-4443-83eb-0b32c908ecdb tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:27.396509 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-79e51294-d700-4443-83eb-0b32c908ecdb tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:27.397109 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-79e51294-d700-4443-83eb-0b32c908ecdb tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:27.397987 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-79e51294-d700-4443-83eb-0b32c908ecdb tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:27.403828 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-79e51294-d700-4443-83eb-0b32c908ecdb tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:27.404843 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-79e51294-d700-4443-83eb-0b32c908ecdb tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:27.838764 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-79e51294-d700-4443-83eb-0b32c908ecdb tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c26e69e2274083916402c96d71c5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a6ac1a984c478da9337692485d16ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:04:27.850708 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-79e51294-d700-4443-83eb-0b32c908ecdb tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] 10.222.0.58 "GET /compute/v2.1/servers/0eb8b76a-370b-423d-a053-d2befea52a4b" status: 200 len: 1467 microversion: 2.1 time: 0.475540 Aug 10 23:04:27.853459 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1002/1999] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:04:27 2022] GET /compute/v2.1/servers/0eb8b76a-370b-423d-a053-d2befea52a4b => generated 1467 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:04:27.869551 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-8ca112ca-89c2-4375-9c65-bb6996292901 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:04:27.879268 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-8ca112ca-89c2-4375-9c65-bb6996292901 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] [instance: 63d2bd74-d060-4925-9323-b39d5131f958] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:04:27.897176 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8ca112ca-89c2-4375-9c65-bb6996292901 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:27.898140 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8ca112ca-89c2-4375-9c65-bb6996292901 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:27.898840 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8ca112ca-89c2-4375-9c65-bb6996292901 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:27.899836 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8ca112ca-89c2-4375-9c65-bb6996292901 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:27.903665 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8ca112ca-89c2-4375-9c65-bb6996292901 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:27.904429 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8ca112ca-89c2-4375-9c65-bb6996292901 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:28.051658 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8ca112ca-89c2-4375-9c65-bb6996292901 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:28.053165 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8ca112ca-89c2-4375-9c65-bb6996292901 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:28.054469 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8ca112ca-89c2-4375-9c65-bb6996292901 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:28.057645 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.objects.instance [None req-8ca112ca-89c2-4375-9c65-bb6996292901 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lazy-loading 'fault' on Instance uuid 63d2bd74-d060-4925-9323-b39d5131f958 {{(pid=122632) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:04:28.327430 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-13a7967d-c273-4258-a2f9-83db598bd12a tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Flavor limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:04:28.327887 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-13a7967d-c273-4258-a2f9-83db598bd12a tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Image limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:04:28.328318 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-13a7967d-c273-4258-a2f9-83db598bd12a tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Flavor pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:04:28.329218 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-13a7967d-c273-4258-a2f9-83db598bd12a tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Image pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:04:28.329218 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-13a7967d-c273-4258-a2f9-83db598bd12a tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:04:28.357876 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-13a7967d-c273-4258-a2f9-83db598bd12a tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:28.358378 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-13a7967d-c273-4258-a2f9-83db598bd12a tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:28.358839 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-13a7967d-c273-4258-a2f9-83db598bd12a tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:28.359568 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-13a7967d-c273-4258-a2f9-83db598bd12a tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:28.372972 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-13a7967d-c273-4258-a2f9-83db598bd12a tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:28.373564 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-13a7967d-c273-4258-a2f9-83db598bd12a tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:28.439472 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-13a7967d-c273-4258-a2f9-83db598bd12a tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Getting quotas for project c04b07c6f0284e9bb36ba0030f4a31d2. Resources: {'instances', 'cores', 'ram'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:04:28.460117 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-13a7967d-c273-4258-a2f9-83db598bd12a tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Getting quotas for user f4d2f8f63e9444fe8cf621d2f7c252bd and project c04b07c6f0284e9bb36ba0030f4a31d2. Resources: {'instances', 'cores', 'ram'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:04:28.486157 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-13a7967d-c273-4258-a2f9-83db598bd12a tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Going to run 1 instances... {{(pid=122633) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 23:04:28.488483 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-13a7967d-c273-4258-a2f9-83db598bd12a tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] [instance: 153d30e2-3eed-4bba-b15b-ca82e6688dbe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78ad8905-f66f-4733-8be9-2b260f1fabed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122633) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 23:04:28.642203 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-13a7967d-c273-4258-a2f9-83db598bd12a tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.584744 Aug 10 23:04:28.643360 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 998/2000] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 23:04:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 5589 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 23:04:28.894628 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-35588869-bf62-4814-b9a6-834ccdd0b350 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1632216219", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452"}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:04:28.995521 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-8ca112ca-89c2-4375-9c65-bb6996292901 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632904331d024d9b8e4d3660dff2cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ed0bdee3aa4013bd9219069bda558c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:04:29.007962 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-8ca112ca-89c2-4375-9c65-bb6996292901 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] 10.222.0.58 "GET /compute/v2.1/servers/63d2bd74-d060-4925-9323-b39d5131f958" status: 200 len: 1143 microversion: 2.1 time: 1.150691 Aug 10 23:04:29.013176 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1003/2001] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:04:27 2022] GET /compute/v2.1/servers/63d2bd74-d060-4925-9323-b39d5131f958 => generated 1143 bytes in 1157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:04:29.016142 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.network.neutron [None req-35588869-bf62-4814-b9a6-834ccdd0b350 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] validate_networks() for None {{(pid=122633) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 23:04:29.025972 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-5205e814-6a8b-4bab-a308-8e6312a222cf tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:04:29.027774 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-5205e814-6a8b-4bab-a308-8e6312a222cf tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] [instance: 153d30e2-3eed-4bba-b15b-ca82e6688dbe] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:04:29.245678 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-5205e814-6a8b-4bab-a308-8e6312a222cf tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d2f8f63e9444fe8cf621d2f7c252bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04b07c6f0284e9bb36ba0030f4a31d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:04:29.261085 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-5205e814-6a8b-4bab-a308-8e6312a222cf tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] 10.222.0.58 "GET /compute/v2.1/servers/153d30e2-3eed-4bba-b15b-ca82e6688dbe" status: 200 len: 1214 microversion: 2.1 time: 0.243431 Aug 10 23:04:29.262584 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1004/2002] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:04:29 2022] GET /compute/v2.1/servers/153d30e2-3eed-4bba-b15b-ca82e6688dbe => generated 1214 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:04:29.283280 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-8506c986-cf25-4aad-948c-29b0111366ba tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:04:29.286476 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-8506c986-cf25-4aad-948c-29b0111366ba tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] [instance: 0eb8b76a-370b-423d-a053-d2befea52a4b] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:04:29.299638 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8506c986-cf25-4aad-948c-29b0111366ba tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:29.305530 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8506c986-cf25-4aad-948c-29b0111366ba tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:29.306219 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8506c986-cf25-4aad-948c-29b0111366ba tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:29.309646 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8506c986-cf25-4aad-948c-29b0111366ba tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:29.310841 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8506c986-cf25-4aad-948c-29b0111366ba tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:29.312033 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8506c986-cf25-4aad-948c-29b0111366ba tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:29.367368 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:04:29.800554 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-35588869-bf62-4814-b9a6-834ccdd0b350 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Flavor limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:04:29.801874 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-35588869-bf62-4814-b9a6-834ccdd0b350 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Image limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:04:29.802496 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-35588869-bf62-4814-b9a6-834ccdd0b350 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Flavor pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:04:29.803599 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-35588869-bf62-4814-b9a6-834ccdd0b350 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Image pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:04:29.804154 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-35588869-bf62-4814-b9a6-834ccdd0b350 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:04:29.824468 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-35588869-bf62-4814-b9a6-834ccdd0b350 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:29.825799 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-35588869-bf62-4814-b9a6-834ccdd0b350 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:29.830455 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-35588869-bf62-4814-b9a6-834ccdd0b350 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:29.832022 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-35588869-bf62-4814-b9a6-834ccdd0b350 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:29.832998 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-35588869-bf62-4814-b9a6-834ccdd0b350 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:29.833735 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-35588869-bf62-4814-b9a6-834ccdd0b350 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:29.879938 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-35588869-bf62-4814-b9a6-834ccdd0b350 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Getting quotas for project b14c63df2e6c46d2af23b6b8a52690d9. Resources: {'instances', 'cores', 'ram'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:04:29.887637 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-35588869-bf62-4814-b9a6-834ccdd0b350 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Getting quotas for user 6de244f1f82143a0b3d3283c31d80bc9 and project b14c63df2e6c46d2af23b6b8a52690d9. Resources: {'instances', 'cores', 'ram'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:04:29.931050 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-35588869-bf62-4814-b9a6-834ccdd0b350 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Going to run 1 instances... {{(pid=122633) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 23:04:29.935914 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-35588869-bf62-4814-b9a6-834ccdd0b350 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] [instance: b3b3730c-1396-4ca6-9d9e-8a3104950324] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78ad8905-f66f-4733-8be9-2b260f1fabed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122633) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 23:04:30.042232 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-35588869-bf62-4814-b9a6-834ccdd0b350 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.396227 Aug 10 23:04:30.043989 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 999/2003] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 23:04:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 1400 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 23:04:30.068408 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-6693ce50-74f3-4fb8-85d6-5e03593a66b4 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:04:30.069041 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-6693ce50-74f3-4fb8-85d6-5e03593a66b4 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] [instance: 63d2bd74-d060-4925-9323-b39d5131f958] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:04:30.101625 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6693ce50-74f3-4fb8-85d6-5e03593a66b4 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:30.102163 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6693ce50-74f3-4fb8-85d6-5e03593a66b4 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:30.102617 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6693ce50-74f3-4fb8-85d6-5e03593a66b4 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:30.103711 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6693ce50-74f3-4fb8-85d6-5e03593a66b4 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:30.104174 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6693ce50-74f3-4fb8-85d6-5e03593a66b4 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:30.104617 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6693ce50-74f3-4fb8-85d6-5e03593a66b4 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:30.144519 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-6693ce50-74f3-4fb8-85d6-5e03593a66b4 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] HTTP exception thrown: Instance 63d2bd74-d060-4925-9323-b39d5131f958 could not be found. Aug 10 23:04:30.146211 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-6693ce50-74f3-4fb8-85d6-5e03593a66b4 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Request method failure captured: Aug 10 23:04:30.146211 n-d-850468-14 devstack@n-api.service[122633]: request: GET /compute/v2.1/servers/63d2bd74-d060-4925-9323-b39d5131f958 HTTP/1.1 Aug 10 23:04:30.146211 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:04:30.146211 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:04:30.146211 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:04:30.146211 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:04:30.146211 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:04:30.146211 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:04:30.146211 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:04:30.146211 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:04:30.146211 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9DfOEywB9oeD_C2SwugHriPH6QPax3SubHvct868zap6PD9BiLAj3q-t9YA3Fiw0HKhahbZB4KIKKcaf61C3Wt-lqKMWkeMB0U5Hy-b51nFx374XbUqtnrhL-_0NpcyHXThCK21eb7hc3wOrIDMIf5OvLiBpImI0ZmmFDD5V_kdMRpY Aug 10 23:04:30.146211 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:04:30.146211 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:04:30.146211 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:04:30.146211 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:04:30.146211 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:04:30.146211 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:04:30.146211 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 56ed0bdee3aa4013bd9219069bda558c Aug 10 23:04:30.146211 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-LiveMigrationTest-2043915664 Aug 10 23:04:30.146211 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:04:30.146211 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:04:30.147583 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/56ed0bdee3aa4013bd9219069bda558c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/56ed0bdee3aa4013bd9219069bda558c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/56ed0bdee3aa4013bd9219069bda558c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_56ed0bdee3aa4013bd9219069bda558c", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:04:30.147583 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-LiveMigrationTest-2043915664 Aug 10 23:04:30.147583 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 56ed0bdee3aa4013bd9219069bda558c Aug 10 23:04:30.147583 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-LiveMigrationTest-2043915664 Aug 10 23:04:30.147583 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-LiveMigrationTest-2043915664-project Aug 10 23:04:30.147583 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:04:30.147583 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:04:30.147583 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 632904331d024d9b8e4d3660dff2cdf3 Aug 10 23:04:30.147583 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-LiveMigrationTest-2043915664-project Aug 10 23:04:30.147583 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:04:30.147583 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance 63d2bd74-d060-4925-9323-b39d5131f958 could not be found. Aug 10 23:04:30.147583 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': '63d2bd74-d060-4925-9323-b39d5131f958'} Aug 10 23:04:30.148266 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:04:30.148266 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:04:30.148266 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:04:30.148266 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:04:30.148266 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:04:30.148266 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:04:30.148266 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:04:30.148266 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:04:30.148266 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:04:30.148266 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:04:30.148266 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63d2bd74-d060-4925-9323-b39d5131f958 could not be found. Aug 10 23:04:30.148266 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:04:30.148266 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:04:30.148266 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:04:30.148266 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:04:30.148266 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:04:30.148266 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:04:30.148266 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:04:30.148266 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:04:30.148266 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:04:30.149306 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:04:30.149306 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:04:30.149306 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:04:30.149306 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:04:30.149306 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:04:30.149306 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:04:30.149306 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:04:30.149306 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63d2bd74-d060-4925-9323-b39d5131f958 could not be found. Aug 10 23:04:30.149306 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:04:30.149306 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:04:30.149306 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:04:30.149306 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:04:30.149306 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:04:30.149306 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:04:30.149306 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:04:30.149306 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:04:30.149306 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63d2bd74-d060-4925-9323-b39d5131f958 could not be found. Aug 10 23:04:30.149306 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:04:30.150331 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-6693ce50-74f3-4fb8-85d6-5e03593a66b4 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Returning 404 to user: Instance 63d2bd74-d060-4925-9323-b39d5131f958 could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:04:30.151871 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-6693ce50-74f3-4fb8-85d6-5e03593a66b4 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] 10.222.0.58 "GET /compute/v2.1/servers/63d2bd74-d060-4925-9323-b39d5131f958" status: 404 len: 111 microversion: 2.1 time: 0.106651 Aug 10 23:04:30.155667 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1000/2004] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:04:30 2022] GET /compute/v2.1/servers/63d2bd74-d060-4925-9323-b39d5131f958 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:04:30.164172 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-b0e3c761-63ab-4ea5-b1cd-eadab4e2d193 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-180845108", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452"}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:04:30.219484 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-8506c986-cf25-4aad-948c-29b0111366ba tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c26e69e2274083916402c96d71c5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a6ac1a984c478da9337692485d16ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:04:30.233828 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-8506c986-cf25-4aad-948c-29b0111366ba tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] 10.222.0.58 "GET /compute/v2.1/servers/0eb8b76a-370b-423d-a053-d2befea52a4b" status: 200 len: 1467 microversion: 2.1 time: 0.966269 Aug 10 23:04:30.235204 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1005/2005] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:04:29 2022] GET /compute/v2.1/servers/0eb8b76a-370b-423d-a053-d2befea52a4b => generated 1467 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:04:30.261918 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.network.neutron [None req-b0e3c761-63ab-4ea5-b1cd-eadab4e2d193 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] validate_networks() for None {{(pid=122633) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 23:04:30.283018 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-888c68e3-a9e7-466f-aa4f-0fb67fac57c6 tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:04:30.283980 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-888c68e3-a9e7-466f-aa4f-0fb67fac57c6 tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] [instance: 153d30e2-3eed-4bba-b15b-ca82e6688dbe] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:04:30.295268 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:04:30.302720 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-888c68e3-a9e7-466f-aa4f-0fb67fac57c6 tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:30.304651 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-888c68e3-a9e7-466f-aa4f-0fb67fac57c6 tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:30.307719 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-888c68e3-a9e7-466f-aa4f-0fb67fac57c6 tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:30.309611 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-888c68e3-a9e7-466f-aa4f-0fb67fac57c6 tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:30.312548 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-888c68e3-a9e7-466f-aa4f-0fb67fac57c6 tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:30.313215 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-888c68e3-a9e7-466f-aa4f-0fb67fac57c6 tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:31.423794 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-888c68e3-a9e7-466f-aa4f-0fb67fac57c6 tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d2f8f63e9444fe8cf621d2f7c252bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04b07c6f0284e9bb36ba0030f4a31d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:04:31.439529 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-888c68e3-a9e7-466f-aa4f-0fb67fac57c6 tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] 10.222.0.58 "GET /compute/v2.1/servers/153d30e2-3eed-4bba-b15b-ca82e6688dbe" status: 200 len: 1266 microversion: 2.1 time: 1.158647 Aug 10 23:04:31.440688 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1006/2006] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:04:30 2022] GET /compute/v2.1/servers/153d30e2-3eed-4bba-b15b-ca82e6688dbe => generated 1266 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:04:31.470709 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-66b95357-05b2-454b-b7cf-61b62451b0a0 req-ee71d11a-3748-4a0e-a5a6-84d45a81ca10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0eb8b76a-370b-423d-a053-d2befea52a4b", "name": "network-vif-deleted", "tag": "d0e21f83-9eb8-45d7-8e17-c0b4fcc59561"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:04:31.516022 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-66b95357-05b2-454b-b7cf-61b62451b0a0 req-ee71d11a-3748-4a0e-a5a6-84d45a81ca10 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:31.519439 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-66b95357-05b2-454b-b7cf-61b62451b0a0 req-ee71d11a-3748-4a0e-a5a6-84d45a81ca10 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:31.520013 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-66b95357-05b2-454b-b7cf-61b62451b0a0 req-ee71d11a-3748-4a0e-a5a6-84d45a81ca10 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:31.556827 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-66b95357-05b2-454b-b7cf-61b62451b0a0 req-ee71d11a-3748-4a0e-a5a6-84d45a81ca10 service nova] Creating event network-vif-deleted:d0e21f83-9eb8-45d7-8e17-c0b4fcc59561 for instance 0eb8b76a-370b-423d-a053-d2befea52a4b on n-h2-850468-14 Aug 10 23:04:31.569582 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-66b95357-05b2-454b-b7cf-61b62451b0a0 req-ee71d11a-3748-4a0e-a5a6-84d45a81ca10 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110520 Aug 10 23:04:31.570420 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1007/2007] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:04:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:04:31.580006 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-bb24a501-4f46-433b-ba46-a468f8700e18 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:04:31.583624 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-bb24a501-4f46-433b-ba46-a468f8700e18 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] [instance: 0eb8b76a-370b-423d-a053-d2befea52a4b] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:04:31.609546 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bb24a501-4f46-433b-ba46-a468f8700e18 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:31.610255 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bb24a501-4f46-433b-ba46-a468f8700e18 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:31.610888 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bb24a501-4f46-433b-ba46-a468f8700e18 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:31.611786 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bb24a501-4f46-433b-ba46-a468f8700e18 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:31.612385 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bb24a501-4f46-433b-ba46-a468f8700e18 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:31.613736 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bb24a501-4f46-433b-ba46-a468f8700e18 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:31.731651 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bb24a501-4f46-433b-ba46-a468f8700e18 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:31.732394 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bb24a501-4f46-433b-ba46-a468f8700e18 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:31.733404 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bb24a501-4f46-433b-ba46-a468f8700e18 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:31.735553 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.objects.instance [None req-bb24a501-4f46-433b-ba46-a468f8700e18 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Lazy-loading 'fault' on Instance uuid 0eb8b76a-370b-423d-a053-d2befea52a4b {{(pid=122632) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:04:31.841309 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-b0e3c761-63ab-4ea5-b1cd-eadab4e2d193 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Flavor limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:04:31.841863 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-b0e3c761-63ab-4ea5-b1cd-eadab4e2d193 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Image limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:04:31.842455 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-b0e3c761-63ab-4ea5-b1cd-eadab4e2d193 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Flavor pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:04:31.843786 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-b0e3c761-63ab-4ea5-b1cd-eadab4e2d193 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Image pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:04:31.843786 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-b0e3c761-63ab-4ea5-b1cd-eadab4e2d193 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:04:31.872109 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b0e3c761-63ab-4ea5-b1cd-eadab4e2d193 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:31.872990 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b0e3c761-63ab-4ea5-b1cd-eadab4e2d193 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:31.874272 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b0e3c761-63ab-4ea5-b1cd-eadab4e2d193 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:31.875293 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b0e3c761-63ab-4ea5-b1cd-eadab4e2d193 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:31.876063 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b0e3c761-63ab-4ea5-b1cd-eadab4e2d193 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:31.876695 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b0e3c761-63ab-4ea5-b1cd-eadab4e2d193 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:31.930480 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-b0e3c761-63ab-4ea5-b1cd-eadab4e2d193 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Getting quotas for project b14c63df2e6c46d2af23b6b8a52690d9. Resources: {'instances', 'cores', 'ram'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:04:31.953733 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-b0e3c761-63ab-4ea5-b1cd-eadab4e2d193 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Getting quotas for user 6de244f1f82143a0b3d3283c31d80bc9 and project b14c63df2e6c46d2af23b6b8a52690d9. Resources: {'instances', 'cores', 'ram'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:04:31.998647 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-b0e3c761-63ab-4ea5-b1cd-eadab4e2d193 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Going to run 1 instances... {{(pid=122633) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 23:04:32.007291 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-b0e3c761-63ab-4ea5-b1cd-eadab4e2d193 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] [instance: 541591c5-62f9-489a-96e7-e7cbbbfc4e28] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78ad8905-f66f-4733-8be9-2b260f1fabed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122633) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 23:04:32.116186 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-bb24a501-4f46-433b-ba46-a468f8700e18 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c26e69e2274083916402c96d71c5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a6ac1a984c478da9337692485d16ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:04:32.130002 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-bb24a501-4f46-433b-ba46-a468f8700e18 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] 10.222.0.58 "GET /compute/v2.1/servers/0eb8b76a-370b-423d-a053-d2befea52a4b" status: 200 len: 1312 microversion: 2.1 time: 0.558154 Aug 10 23:04:32.132631 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1008/2008] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:04:31 2022] GET /compute/v2.1/servers/0eb8b76a-370b-423d-a053-d2befea52a4b => generated 1312 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:04:32.148967 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-b0e3c761-63ab-4ea5-b1cd-eadab4e2d193 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.991808 Aug 10 23:04:32.154088 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1001/2009] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 23:04:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 1998 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 23:04:32.169942 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-ec48acf5-1fc8-47ba-9b04-41c20d4e8d6d tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:04:32.173337 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-ec48acf5-1fc8-47ba-9b04-41c20d4e8d6d tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] [instance: 541591c5-62f9-489a-96e7-e7cbbbfc4e28] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:04:32.461554 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-91ff9c0b-0e83-4aa4-aa0f-0257c5dcc0b7 tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:04:32.462373 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-91ff9c0b-0e83-4aa4-aa0f-0257c5dcc0b7 tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] [instance: 153d30e2-3eed-4bba-b15b-ca82e6688dbe] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:04:32.498852 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-91ff9c0b-0e83-4aa4-aa0f-0257c5dcc0b7 tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:32.499436 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-91ff9c0b-0e83-4aa4-aa0f-0257c5dcc0b7 tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:32.504326 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-91ff9c0b-0e83-4aa4-aa0f-0257c5dcc0b7 tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:32.506395 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-91ff9c0b-0e83-4aa4-aa0f-0257c5dcc0b7 tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:32.510760 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-91ff9c0b-0e83-4aa4-aa0f-0257c5dcc0b7 tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:32.511039 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-91ff9c0b-0e83-4aa4-aa0f-0257c5dcc0b7 tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:32.739827 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-ec48acf5-1fc8-47ba-9b04-41c20d4e8d6d tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de244f1f82143a0b3d3283c31d80bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14c63df2e6c46d2af23b6b8a52690d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:04:32.753070 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-ec48acf5-1fc8-47ba-9b04-41c20d4e8d6d tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] 10.222.0.58 "GET /compute/v2.1/servers/541591c5-62f9-489a-96e7-e7cbbbfc4e28" status: 200 len: 1213 microversion: 2.1 time: 0.591984 Aug 10 23:04:32.765525 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1009/2010] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:04:32 2022] GET /compute/v2.1/servers/541591c5-62f9-489a-96e7-e7cbbbfc4e28 => generated 1213 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:04:32.836747 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-91ff9c0b-0e83-4aa4-aa0f-0257c5dcc0b7 tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d2f8f63e9444fe8cf621d2f7c252bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04b07c6f0284e9bb36ba0030f4a31d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:04:32.852382 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-91ff9c0b-0e83-4aa4-aa0f-0257c5dcc0b7 tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] 10.222.0.58 "GET /compute/v2.1/servers/153d30e2-3eed-4bba-b15b-ca82e6688dbe" status: 200 len: 1272 microversion: 2.1 time: 0.395427 Aug 10 23:04:32.856591 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1002/2011] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:04:32 2022] GET /compute/v2.1/servers/153d30e2-3eed-4bba-b15b-ca82e6688dbe => generated 1272 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:04:33.153261 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-17edc458-f630-4566-8b30-b7727159012a tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:04:33.153950 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-17edc458-f630-4566-8b30-b7727159012a tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] [instance: 0eb8b76a-370b-423d-a053-d2befea52a4b] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:04:33.168905 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-17edc458-f630-4566-8b30-b7727159012a tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:33.170228 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-17edc458-f630-4566-8b30-b7727159012a tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:33.170772 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-17edc458-f630-4566-8b30-b7727159012a tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:33.175987 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-17edc458-f630-4566-8b30-b7727159012a tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:33.176933 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-17edc458-f630-4566-8b30-b7727159012a tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:33.177877 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-17edc458-f630-4566-8b30-b7727159012a tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:33.222181 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-17edc458-f630-4566-8b30-b7727159012a tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] HTTP exception thrown: Instance 0eb8b76a-370b-423d-a053-d2befea52a4b could not be found. Aug 10 23:04:33.236176 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-17edc458-f630-4566-8b30-b7727159012a tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Request method failure captured: Aug 10 23:04:33.236176 n-d-850468-14 devstack@n-api.service[122632]: request: GET /compute/v2.1/servers/0eb8b76a-370b-423d-a053-d2befea52a4b HTTP/1.1 Aug 10 23:04:33.236176 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:04:33.236176 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:04:33.236176 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:04:33.236176 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 23:04:33.236176 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:04:33.236176 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:04:33.236176 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:04:33.236176 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:04:33.236176 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9DlHYUlsD4g5vcJuYNZ7WV4ZyeiZtLzoKWsRNUS8RB5xQt4XaHXFL58uEIF4tFn5IDct-wu8wzBvuIkM4t5U1NquTIhJebl97XRsP6EPA2SZGAFy75_6y_xfbrqxCDoE2r0lv-QzcdpDOMWyT_fbv-c4jbaWJQlehBG0QedvoU_g-VY Aug 10 23:04:33.236176 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:04:33.236176 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:04:33.236176 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:04:33.236176 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:04:33.236176 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:04:33.236176 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:04:33.236176 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: c8a6ac1a984c478da9337692485d16ea Aug 10 23:04:33.236176 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1530197574 Aug 10 23:04:33.236176 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:04:33.236176 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:04:33.237510 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c8a6ac1a984c478da9337692485d16ea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c8a6ac1a984c478da9337692485d16ea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/c8a6ac1a984c478da9337692485d16ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_c8a6ac1a984c478da9337692485d16ea", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:04:33.237510 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1530197574 Aug 10 23:04:33.237510 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: c8a6ac1a984c478da9337692485d16ea Aug 10 23:04:33.237510 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1530197574 Aug 10 23:04:33.237510 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-ServersAdminNegativeTestJSON-1530197574-project Aug 10 23:04:33.237510 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:04:33.237510 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:04:33.237510 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: 11c26e69e2274083916402c96d71c5a7 Aug 10 23:04:33.237510 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1530197574-project Aug 10 23:04:33.237510 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:04:33.237510 n-d-850468-14 devstack@n-api.service[122632]: exception: Instance 0eb8b76a-370b-423d-a053-d2befea52a4b could not be found. Aug 10 23:04:33.237510 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': '0eb8b76a-370b-423d-a053-d2befea52a4b'} Aug 10 23:04:33.238297 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:04:33.238297 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:04:33.238297 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:04:33.238297 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:04:33.238297 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:04:33.238297 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:04:33.238297 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:04:33.238297 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:04:33.238297 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:04:33.238297 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:04:33.238297 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0eb8b76a-370b-423d-a053-d2befea52a4b could not be found. Aug 10 23:04:33.238297 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:04:33.238297 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:04:33.238297 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:04:33.238297 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:04:33.238297 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:04:33.238297 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:04:33.238297 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:04:33.238297 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:04:33.238297 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:04:33.239450 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:04:33.239450 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:04:33.239450 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:04:33.239450 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:04:33.239450 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:04:33.239450 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:04:33.239450 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:04:33.239450 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0eb8b76a-370b-423d-a053-d2befea52a4b could not be found. Aug 10 23:04:33.239450 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:04:33.239450 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:04:33.239450 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:04:33.239450 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:04:33.239450 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:04:33.239450 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:04:33.239450 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:04:33.239450 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:04:33.239450 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0eb8b76a-370b-423d-a053-d2befea52a4b could not be found. Aug 10 23:04:33.239450 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:04:33.241010 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-17edc458-f630-4566-8b30-b7727159012a tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Returning 404 to user: Instance 0eb8b76a-370b-423d-a053-d2befea52a4b could not be found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:04:33.245688 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-17edc458-f630-4566-8b30-b7727159012a tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] 10.222.0.58 "GET /compute/v2.1/servers/0eb8b76a-370b-423d-a053-d2befea52a4b" status: 404 len: 111 microversion: 2.1 time: 0.096553 Aug 10 23:04:33.249981 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1010/2012] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:04:33 2022] GET /compute/v2.1/servers/0eb8b76a-370b-423d-a053-d2befea52a4b => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:04:33.259139 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-3c813895-c667-4f0b-86d0-00efe149b5c5 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:04:33.259796 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-3c813895-c667-4f0b-86d0-00efe149b5c5 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] [instance: 3f5e8cd2-6666-4206-a393-9f0507322402] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:04:33.271833 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3c813895-c667-4f0b-86d0-00efe149b5c5 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:33.272485 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3c813895-c667-4f0b-86d0-00efe149b5c5 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:33.273611 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3c813895-c667-4f0b-86d0-00efe149b5c5 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:33.278419 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3c813895-c667-4f0b-86d0-00efe149b5c5 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:33.279203 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3c813895-c667-4f0b-86d0-00efe149b5c5 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:33.280250 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3c813895-c667-4f0b-86d0-00efe149b5c5 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:33.409334 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-3c813895-c667-4f0b-86d0-00efe149b5c5 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] [instance: 3f5e8cd2-6666-4206-a393-9f0507322402] Going to try to terminate instance {{(pid=122633) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:04:33.752023 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-3c813895-c667-4f0b-86d0-00efe149b5c5 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] 10.222.0.58 "DELETE /compute/v2.1/servers/3f5e8cd2-6666-4206-a393-9f0507322402" status: 204 len: 0 microversion: 2.1 time: 0.495070 Aug 10 23:04:33.753395 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1003/2013] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:04:33 2022] DELETE /compute/v2.1/servers/3f5e8cd2-6666-4206-a393-9f0507322402 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:04:33.766113 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-966596b4-f43d-45d7-aad0-f18c01483585 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:04:33.767544 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-966596b4-f43d-45d7-aad0-f18c01483585 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] [instance: 3f5e8cd2-6666-4206-a393-9f0507322402] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:04:33.778371 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-d2b22a0c-2bb5-4cb7-a0cc-f3c923d69005 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:04:33.779453 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-d2b22a0c-2bb5-4cb7-a0cc-f3c923d69005 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] [instance: 541591c5-62f9-489a-96e7-e7cbbbfc4e28] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:04:33.797562 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d2b22a0c-2bb5-4cb7-a0cc-f3c923d69005 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:33.798377 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d2b22a0c-2bb5-4cb7-a0cc-f3c923d69005 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:33.800302 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-966596b4-f43d-45d7-aad0-f18c01483585 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:33.800613 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d2b22a0c-2bb5-4cb7-a0cc-f3c923d69005 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:33.802721 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-966596b4-f43d-45d7-aad0-f18c01483585 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:33.812577 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-966596b4-f43d-45d7-aad0-f18c01483585 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:33.813519 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-966596b4-f43d-45d7-aad0-f18c01483585 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:33.814604 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-966596b4-f43d-45d7-aad0-f18c01483585 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:33.818160 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d2b22a0c-2bb5-4cb7-a0cc-f3c923d69005 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:33.818701 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d2b22a0c-2bb5-4cb7-a0cc-f3c923d69005 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:33.819195 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d2b22a0c-2bb5-4cb7-a0cc-f3c923d69005 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:33.819597 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-966596b4-f43d-45d7-aad0-f18c01483585 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:33.859780 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:04:34.716827 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-966596b4-f43d-45d7-aad0-f18c01483585 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c26e69e2274083916402c96d71c5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a6ac1a984c478da9337692485d16ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:04:34.734879 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-966596b4-f43d-45d7-aad0-f18c01483585 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] 10.222.0.58 "GET /compute/v2.1/servers/3f5e8cd2-6666-4206-a393-9f0507322402" status: 200 len: 1477 microversion: 2.1 time: 0.974820 Aug 10 23:04:34.746829 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1011/2014] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:04:33 2022] GET /compute/v2.1/servers/3f5e8cd2-6666-4206-a393-9f0507322402 => generated 1477 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:04:34.923516 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-f7818281-cbd1-474c-bfe5-aa50fff8a20b tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Action: 'create', calling method: .version_select at 0x7f847d024670>, body: {"keypair": {"name": "tempest-keypair-938102435", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNdUavxylviDgjJYYJr1ivKhnq22VpTDP0SQ7BQJL4IGRH91gHSzJr99lUlv91Y2lOCPQSN0/mk3CCl4On9bgznN8De96mSu10K98DldvAy4E0mC8NDEPog9i7OvRkZmCA=="}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:04:34.970305 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-f7818281-cbd1-474c-bfe5-aa50fff8a20b tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Getting quotas for project 597863bfebdc481188f1f30095da5396. Resources: {'key_pairs'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:04:34.985045 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-f7818281-cbd1-474c-bfe5-aa50fff8a20b tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Getting quotas for user a1986185dc9b4df4affcc421365462f7 and project 597863bfebdc481188f1f30095da5396. Resources: {'key_pairs'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:04:35.045768 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-d2b22a0c-2bb5-4cb7-a0cc-f3c923d69005 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de244f1f82143a0b3d3283c31d80bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14c63df2e6c46d2af23b6b8a52690d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:04:35.056453 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-f7818281-cbd1-474c-bfe5-aa50fff8a20b tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.316527 Aug 10 23:04:35.064741 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1012/2015] 10.222.0.58 () {60 vars in 1159 bytes} [Wed Aug 10 23:04:34 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:04:35.070357 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-30897730-d464-4ab5-9f9c-c1f4ca99f668 tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:04:35.077768 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-30897730-d464-4ab5-9f9c-c1f4ca99f668 tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] [instance: 153d30e2-3eed-4bba-b15b-ca82e6688dbe] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:04:35.087709 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-d2b22a0c-2bb5-4cb7-a0cc-f3c923d69005 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] 10.222.0.58 "GET /compute/v2.1/servers/541591c5-62f9-489a-96e7-e7cbbbfc4e28" status: 200 len: 1265 microversion: 2.1 time: 1.315446 Aug 10 23:04:35.088314 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1004/2016] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:04:33 2022] GET /compute/v2.1/servers/541591c5-62f9-489a-96e7-e7cbbbfc4e28 => generated 1265 bytes in 1317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:04:35.110766 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-30897730-d464-4ab5-9f9c-c1f4ca99f668 tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:35.110766 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-30897730-d464-4ab5-9f9c-c1f4ca99f668 tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:35.110766 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-30897730-d464-4ab5-9f9c-c1f4ca99f668 tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:35.110766 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-30897730-d464-4ab5-9f9c-c1f4ca99f668 tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:35.111253 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-30897730-d464-4ab5-9f9c-c1f4ca99f668 tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:35.111253 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-30897730-d464-4ab5-9f9c-c1f4ca99f668 tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:35.455049 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-30897730-d464-4ab5-9f9c-c1f4ca99f668 tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d2f8f63e9444fe8cf621d2f7c252bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04b07c6f0284e9bb36ba0030f4a31d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:04:35.473966 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-30897730-d464-4ab5-9f9c-c1f4ca99f668 tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] 10.222.0.58 "GET /compute/v2.1/servers/153d30e2-3eed-4bba-b15b-ca82e6688dbe" status: 200 len: 1272 microversion: 2.1 time: 0.407670 Aug 10 23:04:35.480620 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1013/2017] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:04:35 2022] GET /compute/v2.1/servers/153d30e2-3eed-4bba-b15b-ca82e6688dbe => generated 1272 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:04:35.762589 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-21fe8924-c699-4a36-91d7-d4830310a8cb tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:04:35.763465 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-21fe8924-c699-4a36-91d7-d4830310a8cb tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] [instance: 3f5e8cd2-6666-4206-a393-9f0507322402] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:04:35.777546 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-21fe8924-c699-4a36-91d7-d4830310a8cb tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:35.779103 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-21fe8924-c699-4a36-91d7-d4830310a8cb tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:35.781902 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-21fe8924-c699-4a36-91d7-d4830310a8cb tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:35.783187 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-21fe8924-c699-4a36-91d7-d4830310a8cb tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:35.785266 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-21fe8924-c699-4a36-91d7-d4830310a8cb tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:35.785935 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-21fe8924-c699-4a36-91d7-d4830310a8cb tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:36.108975 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-0798ff14-c6c4-4c24-98f6-47afff3be173 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:04:36.109645 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-0798ff14-c6c4-4c24-98f6-47afff3be173 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] [instance: 541591c5-62f9-489a-96e7-e7cbbbfc4e28] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:04:36.132194 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0798ff14-c6c4-4c24-98f6-47afff3be173 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:36.132937 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0798ff14-c6c4-4c24-98f6-47afff3be173 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:36.133560 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0798ff14-c6c4-4c24-98f6-47afff3be173 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:36.136124 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0798ff14-c6c4-4c24-98f6-47afff3be173 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:36.136851 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0798ff14-c6c4-4c24-98f6-47afff3be173 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:36.138673 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0798ff14-c6c4-4c24-98f6-47afff3be173 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:36.449618 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-0798ff14-c6c4-4c24-98f6-47afff3be173 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de244f1f82143a0b3d3283c31d80bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14c63df2e6c46d2af23b6b8a52690d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:04:36.460014 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-0798ff14-c6c4-4c24-98f6-47afff3be173 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] 10.222.0.58 "GET /compute/v2.1/servers/541591c5-62f9-489a-96e7-e7cbbbfc4e28" status: 200 len: 1271 microversion: 2.1 time: 0.355089 Aug 10 23:04:36.465255 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1014/2018] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:04:36 2022] GET /compute/v2.1/servers/541591c5-62f9-489a-96e7-e7cbbbfc4e28 => generated 1271 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:04:36.504887 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c278411b-ad1d-4103-9907-5f6fcdec88f5 tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:04:36.505650 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-c278411b-ad1d-4103-9907-5f6fcdec88f5 tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] [instance: 153d30e2-3eed-4bba-b15b-ca82e6688dbe] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:04:36.524496 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c278411b-ad1d-4103-9907-5f6fcdec88f5 tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:36.526541 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c278411b-ad1d-4103-9907-5f6fcdec88f5 tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:36.527035 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c278411b-ad1d-4103-9907-5f6fcdec88f5 tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:36.532919 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c278411b-ad1d-4103-9907-5f6fcdec88f5 tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:36.533978 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c278411b-ad1d-4103-9907-5f6fcdec88f5 tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:36.534510 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c278411b-ad1d-4103-9907-5f6fcdec88f5 tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:36.553073 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-21fe8924-c699-4a36-91d7-d4830310a8cb tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c26e69e2274083916402c96d71c5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a6ac1a984c478da9337692485d16ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:04:36.585175 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-21fe8924-c699-4a36-91d7-d4830310a8cb tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] 10.222.0.58 "GET /compute/v2.1/servers/3f5e8cd2-6666-4206-a393-9f0507322402" status: 200 len: 1477 microversion: 2.1 time: 0.827823 Aug 10 23:04:36.595252 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1005/2019] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:04:35 2022] GET /compute/v2.1/servers/3f5e8cd2-6666-4206-a393-9f0507322402 => generated 1477 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:04:37.085137 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-04955dab-074c-4bfe-b8b8-e02146f4f10d tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:04:37.085747 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-04955dab-074c-4bfe-b8b8-e02146f4f10d tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] [instance: 8e91f1ac-f79d-4ab0-aa13-ea32b0e74888] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:04:37.106507 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-04955dab-074c-4bfe-b8b8-e02146f4f10d tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:37.107041 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-04955dab-074c-4bfe-b8b8-e02146f4f10d tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:37.113919 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-04955dab-074c-4bfe-b8b8-e02146f4f10d tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:37.114754 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-04955dab-074c-4bfe-b8b8-e02146f4f10d tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:37.115262 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-04955dab-074c-4bfe-b8b8-e02146f4f10d tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:37.115703 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-04955dab-074c-4bfe-b8b8-e02146f4f10d tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:37.217773 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-04955dab-074c-4bfe-b8b8-e02146f4f10d tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] [instance: 8e91f1ac-f79d-4ab0-aa13-ea32b0e74888] Going to try to terminate instance {{(pid=122633) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:04:37.424098 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-04955dab-074c-4bfe-b8b8-e02146f4f10d tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] 10.222.0.58 "DELETE /compute/v2.1/servers/8e91f1ac-f79d-4ab0-aa13-ea32b0e74888" status: 204 len: 0 microversion: 2.1 time: 0.341853 Aug 10 23:04:37.430277 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1006/2020] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:04:37 2022] DELETE /compute/v2.1/servers/8e91f1ac-f79d-4ab0-aa13-ea32b0e74888 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:04:37.444864 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-f46dffc3-2563-4db8-a297-c42ac76081b3 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:04:37.445895 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-f46dffc3-2563-4db8-a297-c42ac76081b3 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] [instance: 8e91f1ac-f79d-4ab0-aa13-ea32b0e74888] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:04:37.471596 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f46dffc3-2563-4db8-a297-c42ac76081b3 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:37.473373 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f46dffc3-2563-4db8-a297-c42ac76081b3 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:37.473902 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f46dffc3-2563-4db8-a297-c42ac76081b3 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:37.476746 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f46dffc3-2563-4db8-a297-c42ac76081b3 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:37.480480 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f46dffc3-2563-4db8-a297-c42ac76081b3 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:37.481129 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f46dffc3-2563-4db8-a297-c42ac76081b3 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:37.523376 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-c278411b-ad1d-4103-9907-5f6fcdec88f5 tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d2f8f63e9444fe8cf621d2f7c252bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04b07c6f0284e9bb36ba0030f4a31d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:04:37.536095 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-c278411b-ad1d-4103-9907-5f6fcdec88f5 tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] 10.222.0.58 "GET /compute/v2.1/servers/153d30e2-3eed-4bba-b15b-ca82e6688dbe" status: 200 len: 1314 microversion: 2.1 time: 1.035702 Aug 10 23:04:37.538603 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1015/2021] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:04:36 2022] GET /compute/v2.1/servers/153d30e2-3eed-4bba-b15b-ca82e6688dbe => generated 1314 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:04:37.555521 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-a439cea2-1839-4099-958d-7025473ad1b1 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:04:37.556329 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-a439cea2-1839-4099-958d-7025473ad1b1 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] [instance: 541591c5-62f9-489a-96e7-e7cbbbfc4e28] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:04:37.581023 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a439cea2-1839-4099-958d-7025473ad1b1 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:37.581720 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a439cea2-1839-4099-958d-7025473ad1b1 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:37.582273 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a439cea2-1839-4099-958d-7025473ad1b1 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:37.583270 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a439cea2-1839-4099-958d-7025473ad1b1 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:37.585507 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a439cea2-1839-4099-958d-7025473ad1b1 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:37.586078 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a439cea2-1839-4099-958d-7025473ad1b1 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:38.946179 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-a439cea2-1839-4099-958d-7025473ad1b1 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de244f1f82143a0b3d3283c31d80bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14c63df2e6c46d2af23b6b8a52690d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:04:38.957294 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-a439cea2-1839-4099-958d-7025473ad1b1 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] 10.222.0.58 "GET /compute/v2.1/servers/541591c5-62f9-489a-96e7-e7cbbbfc4e28" status: 200 len: 1271 microversion: 2.1 time: 1.417315 Aug 10 23:04:38.960429 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1016/2022] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:04:37 2022] GET /compute/v2.1/servers/541591c5-62f9-489a-96e7-e7cbbbfc4e28 => generated 1271 bytes in 1421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:04:38.966509 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-395c064e-746a-4b23-81c6-e9357e8753f2 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:04:38.976150 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-395c064e-746a-4b23-81c6-e9357e8753f2 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] [instance: 3f5e8cd2-6666-4206-a393-9f0507322402] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:04:38.992029 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-395c064e-746a-4b23-81c6-e9357e8753f2 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:38.995386 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-395c064e-746a-4b23-81c6-e9357e8753f2 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:38.996610 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-395c064e-746a-4b23-81c6-e9357e8753f2 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:38.999221 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-395c064e-746a-4b23-81c6-e9357e8753f2 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:39.000686 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-395c064e-746a-4b23-81c6-e9357e8753f2 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:39.001304 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-395c064e-746a-4b23-81c6-e9357e8753f2 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:39.007955 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-f46dffc3-2563-4db8-a297-c42ac76081b3 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632904331d024d9b8e4d3660dff2cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ed0bdee3aa4013bd9219069bda558c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:04:39.024898 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-f46dffc3-2563-4db8-a297-c42ac76081b3 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] 10.222.0.58 "GET /compute/v2.1/servers/8e91f1ac-f79d-4ab0-aa13-ea32b0e74888" status: 200 len: 1668 microversion: 2.1 time: 1.592043 Aug 10 23:04:39.027202 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1007/2023] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:04:37 2022] GET /compute/v2.1/servers/8e91f1ac-f79d-4ab0-aa13-ea32b0e74888 => generated 1668 bytes in 1596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:04:39.039932 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-463135e2-b40d-4992-a424-8085c49ad83a tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:04:39.041136 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-463135e2-b40d-4992-a424-8085c49ad83a tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] [instance: 153d30e2-3eed-4bba-b15b-ca82e6688dbe] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:04:39.059078 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-463135e2-b40d-4992-a424-8085c49ad83a tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:39.062865 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-463135e2-b40d-4992-a424-8085c49ad83a tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:39.063551 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-463135e2-b40d-4992-a424-8085c49ad83a tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:39.064475 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-463135e2-b40d-4992-a424-8085c49ad83a tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:39.065388 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-463135e2-b40d-4992-a424-8085c49ad83a tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:39.070830 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-463135e2-b40d-4992-a424-8085c49ad83a tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:39.331448 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-395c064e-746a-4b23-81c6-e9357e8753f2 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11c26e69e2274083916402c96d71c5a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c8a6ac1a984c478da9337692485d16ea', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:04:39.342592 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-395c064e-746a-4b23-81c6-e9357e8753f2 tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] 10.222.0.58 "GET /compute/v2.1/servers/3f5e8cd2-6666-4206-a393-9f0507322402" status: 200 len: 1477 microversion: 2.1 time: 0.380940 Aug 10 23:04:39.347306 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1017/2024] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:04:38 2022] GET /compute/v2.1/servers/3f5e8cd2-6666-4206-a393-9f0507322402 => generated 1477 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:04:39.805779 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-67fa7068-2d2f-4d9e-bf8b-48f770eac2d4 req-1915683b-3316-42d4-9da2-f17f4f201703 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f5e8cd2-6666-4206-a393-9f0507322402", "name": "network-vif-deleted", "tag": "8d20efca-c421-4e1d-9824-67555899ca9d"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:04:39.821310 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-67fa7068-2d2f-4d9e-bf8b-48f770eac2d4 req-1915683b-3316-42d4-9da2-f17f4f201703 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:39.821778 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-67fa7068-2d2f-4d9e-bf8b-48f770eac2d4 req-1915683b-3316-42d4-9da2-f17f4f201703 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:39.822246 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-67fa7068-2d2f-4d9e-bf8b-48f770eac2d4 req-1915683b-3316-42d4-9da2-f17f4f201703 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:39.832419 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-463135e2-b40d-4992-a424-8085c49ad83a tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d2f8f63e9444fe8cf621d2f7c252bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04b07c6f0284e9bb36ba0030f4a31d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:04:39.840652 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-67fa7068-2d2f-4d9e-bf8b-48f770eac2d4 req-1915683b-3316-42d4-9da2-f17f4f201703 service nova] Creating event network-vif-deleted:8d20efca-c421-4e1d-9824-67555899ca9d for instance 3f5e8cd2-6666-4206-a393-9f0507322402 on n-h2-850468-14 Aug 10 23:04:39.847564 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-463135e2-b40d-4992-a424-8085c49ad83a tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] 10.222.0.58 "GET /compute/v2.1/servers/153d30e2-3eed-4bba-b15b-ca82e6688dbe" status: 200 len: 1314 microversion: 2.1 time: 0.816708 Aug 10 23:04:39.851185 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-67fa7068-2d2f-4d9e-bf8b-48f770eac2d4 req-1915683b-3316-42d4-9da2-f17f4f201703 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048076 Aug 10 23:04:39.854501 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1008/2025] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:04:39 2022] GET /compute/v2.1/servers/153d30e2-3eed-4bba-b15b-ca82e6688dbe => generated 1314 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:04:39.855277 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1018/2026] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:04:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 23:04:39.935458 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-b870fb87-adc0-4d84-86e3-b6b2362685e2 req-6a7f674e-c46f-4ba9-af8e-a5ca1624a843 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "153d30e2-3eed-4bba-b15b-ca82e6688dbe", "tag": "9be2d009-04de-4d66-bd2d-b90c4c4a5270"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:04:39.945626 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-b870fb87-adc0-4d84-86e3-b6b2362685e2 req-6a7f674e-c46f-4ba9-af8e-a5ca1624a843 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:39.946404 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-b870fb87-adc0-4d84-86e3-b6b2362685e2 req-6a7f674e-c46f-4ba9-af8e-a5ca1624a843 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:39.947187 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-b870fb87-adc0-4d84-86e3-b6b2362685e2 req-6a7f674e-c46f-4ba9-af8e-a5ca1624a843 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:39.960442 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-b870fb87-adc0-4d84-86e3-b6b2362685e2 req-6a7f674e-c46f-4ba9-af8e-a5ca1624a843 service nova] Creating event network-changed:9be2d009-04de-4d66-bd2d-b90c4c4a5270 for instance 153d30e2-3eed-4bba-b15b-ca82e6688dbe on n-h1-850468-14 Aug 10 23:04:39.973839 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-b870fb87-adc0-4d84-86e3-b6b2362685e2 req-6a7f674e-c46f-4ba9-af8e-a5ca1624a843 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042788 Aug 10 23:04:39.974973 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1009/2027] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:04:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:04:39.989724 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-0eb94ae8-66ee-4c8f-961f-5885ba37657c tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:04:39.990634 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-0eb94ae8-66ee-4c8f-961f-5885ba37657c tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] [instance: 541591c5-62f9-489a-96e7-e7cbbbfc4e28] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:04:39.999724 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0eb94ae8-66ee-4c8f-961f-5885ba37657c tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:40.000438 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0eb94ae8-66ee-4c8f-961f-5885ba37657c tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:40.001156 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0eb94ae8-66ee-4c8f-961f-5885ba37657c tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:40.002180 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0eb94ae8-66ee-4c8f-961f-5885ba37657c tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:40.003071 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0eb94ae8-66ee-4c8f-961f-5885ba37657c tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:40.003640 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0eb94ae8-66ee-4c8f-961f-5885ba37657c tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:40.052997 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-60a6c4ac-c152-43bc-a869-47cc8819efc0 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:04:40.054830 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-60a6c4ac-c152-43bc-a869-47cc8819efc0 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] [instance: 8e91f1ac-f79d-4ab0-aa13-ea32b0e74888] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:04:40.062536 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-60a6c4ac-c152-43bc-a869-47cc8819efc0 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:40.063518 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-60a6c4ac-c152-43bc-a869-47cc8819efc0 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:40.064105 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-60a6c4ac-c152-43bc-a869-47cc8819efc0 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:40.065119 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-60a6c4ac-c152-43bc-a869-47cc8819efc0 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:40.065989 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-60a6c4ac-c152-43bc-a869-47cc8819efc0 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:40.066921 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-60a6c4ac-c152-43bc-a869-47cc8819efc0 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:40.769707 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-0eb94ae8-66ee-4c8f-961f-5885ba37657c tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de244f1f82143a0b3d3283c31d80bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14c63df2e6c46d2af23b6b8a52690d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:04:40.784754 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-0eb94ae8-66ee-4c8f-961f-5885ba37657c tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] 10.222.0.58 "GET /compute/v2.1/servers/541591c5-62f9-489a-96e7-e7cbbbfc4e28" status: 200 len: 1313 microversion: 2.1 time: 0.799125 Aug 10 23:04:40.786525 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1019/2028] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:04:39 2022] GET /compute/v2.1/servers/541591c5-62f9-489a-96e7-e7cbbbfc4e28 => generated 1313 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:04:40.793049 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-fb7461ac-4f83-4df5-82c9-3ebf03473ccb tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:04:40.794012 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-fb7461ac-4f83-4df5-82c9-3ebf03473ccb tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] [instance: 3f5e8cd2-6666-4206-a393-9f0507322402] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:04:40.802557 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fb7461ac-4f83-4df5-82c9-3ebf03473ccb tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:40.803390 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fb7461ac-4f83-4df5-82c9-3ebf03473ccb tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:40.804060 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fb7461ac-4f83-4df5-82c9-3ebf03473ccb tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:40.805214 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fb7461ac-4f83-4df5-82c9-3ebf03473ccb tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:40.805785 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fb7461ac-4f83-4df5-82c9-3ebf03473ccb tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:40.806145 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fb7461ac-4f83-4df5-82c9-3ebf03473ccb tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:40.827112 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-fb7461ac-4f83-4df5-82c9-3ebf03473ccb tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] HTTP exception thrown: Instance 3f5e8cd2-6666-4206-a393-9f0507322402 could not be found. Aug 10 23:04:40.829384 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-fb7461ac-4f83-4df5-82c9-3ebf03473ccb tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Request method failure captured: Aug 10 23:04:40.829384 n-d-850468-14 devstack@n-api.service[122632]: request: GET /compute/v2.1/servers/3f5e8cd2-6666-4206-a393-9f0507322402 HTTP/1.1 Aug 10 23:04:40.829384 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:04:40.829384 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:04:40.829384 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:04:40.829384 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 23:04:40.829384 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:04:40.829384 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:04:40.829384 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:04:40.829384 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:04:40.829384 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9DlHYUlsD4g5vcJuYNZ7WV4ZyeiZtLzoKWsRNUS8RB5xQt4XaHXFL58uEIF4tFn5IDct-wu8wzBvuIkM4t5U1NquTIhJebl97XRsP6EPA2SZGAFy75_6y_xfbrqxCDoE2r0lv-QzcdpDOMWyT_fbv-c4jbaWJQlehBG0QedvoU_g-VY Aug 10 23:04:40.829384 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:04:40.829384 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:04:40.829384 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:04:40.829384 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:04:40.829384 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:04:40.829384 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:04:40.829384 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: c8a6ac1a984c478da9337692485d16ea Aug 10 23:04:40.829384 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1530197574 Aug 10 23:04:40.829384 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:04:40.829384 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:04:40.831063 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c8a6ac1a984c478da9337692485d16ea"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c8a6ac1a984c478da9337692485d16ea"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/c8a6ac1a984c478da9337692485d16ea"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_c8a6ac1a984c478da9337692485d16ea", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:04:40.831063 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1530197574 Aug 10 23:04:40.831063 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: c8a6ac1a984c478da9337692485d16ea Aug 10 23:04:40.831063 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1530197574 Aug 10 23:04:40.831063 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-ServersAdminNegativeTestJSON-1530197574-project Aug 10 23:04:40.831063 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:04:40.831063 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:04:40.831063 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: 11c26e69e2274083916402c96d71c5a7 Aug 10 23:04:40.831063 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1530197574-project Aug 10 23:04:40.831063 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:04:40.831063 n-d-850468-14 devstack@n-api.service[122632]: exception: Instance 3f5e8cd2-6666-4206-a393-9f0507322402 could not be found. Aug 10 23:04:40.831063 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': '3f5e8cd2-6666-4206-a393-9f0507322402'} Aug 10 23:04:40.831934 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:04:40.831934 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:04:40.831934 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:04:40.831934 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:04:40.831934 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:04:40.831934 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:04:40.831934 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:04:40.831934 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:04:40.831934 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:04:40.831934 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:04:40.831934 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f5e8cd2-6666-4206-a393-9f0507322402 could not be found. Aug 10 23:04:40.831934 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:04:40.831934 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:04:40.831934 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:04:40.831934 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:04:40.831934 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:04:40.831934 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:04:40.831934 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:04:40.831934 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:04:40.831934 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:04:40.833463 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:04:40.833463 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:04:40.833463 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:04:40.833463 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:04:40.833463 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:04:40.833463 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:04:40.833463 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:04:40.833463 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f5e8cd2-6666-4206-a393-9f0507322402 could not be found. Aug 10 23:04:40.833463 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:04:40.833463 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:04:40.833463 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:04:40.833463 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:04:40.833463 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:04:40.833463 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:04:40.833463 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:04:40.833463 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:04:40.833463 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f5e8cd2-6666-4206-a393-9f0507322402 could not be found. Aug 10 23:04:40.833463 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:04:40.835884 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-fb7461ac-4f83-4df5-82c9-3ebf03473ccb tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] Returning 404 to user: Instance 3f5e8cd2-6666-4206-a393-9f0507322402 could not be found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:04:40.836862 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-fb7461ac-4f83-4df5-82c9-3ebf03473ccb tempest-ServersAdminNegativeTestJSON-1530197574 tempest-ServersAdminNegativeTestJSON-1530197574-project] 10.222.0.58 "GET /compute/v2.1/servers/3f5e8cd2-6666-4206-a393-9f0507322402" status: 404 len: 111 microversion: 2.1 time: 0.049006 Aug 10 23:04:40.837562 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1020/2029] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:04:40 2022] GET /compute/v2.1/servers/3f5e8cd2-6666-4206-a393-9f0507322402 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:04:40.877125 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-44a3edb7-f746-45a3-92e6-51199b0ea5c7 tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:04:40.878097 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-44a3edb7-f746-45a3-92e6-51199b0ea5c7 tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] [instance: 153d30e2-3eed-4bba-b15b-ca82e6688dbe] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:04:40.896590 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-44a3edb7-f746-45a3-92e6-51199b0ea5c7 tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:40.897102 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-44a3edb7-f746-45a3-92e6-51199b0ea5c7 tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:40.897548 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-44a3edb7-f746-45a3-92e6-51199b0ea5c7 tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:40.898266 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-44a3edb7-f746-45a3-92e6-51199b0ea5c7 tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:40.906760 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-44a3edb7-f746-45a3-92e6-51199b0ea5c7 tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:40.910716 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-44a3edb7-f746-45a3-92e6-51199b0ea5c7 tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:41.052535 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-60a6c4ac-c152-43bc-a869-47cc8819efc0 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632904331d024d9b8e4d3660dff2cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ed0bdee3aa4013bd9219069bda558c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:04:41.067304 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-60a6c4ac-c152-43bc-a869-47cc8819efc0 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] 10.222.0.58 "GET /compute/v2.1/servers/8e91f1ac-f79d-4ab0-aa13-ea32b0e74888" status: 200 len: 1668 microversion: 2.1 time: 1.019722 Aug 10 23:04:41.069571 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1010/2030] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:04:40 2022] GET /compute/v2.1/servers/8e91f1ac-f79d-4ab0-aa13-ea32b0e74888 => generated 1668 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:04:41.542746 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-44a3edb7-f746-45a3-92e6-51199b0ea5c7 tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d2f8f63e9444fe8cf621d2f7c252bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04b07c6f0284e9bb36ba0030f4a31d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:04:41.556974 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-44a3edb7-f746-45a3-92e6-51199b0ea5c7 tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] 10.222.0.58 "GET /compute/v2.1/servers/153d30e2-3eed-4bba-b15b-ca82e6688dbe" status: 200 len: 1314 microversion: 2.1 time: 0.689984 Aug 10 23:04:41.578068 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1021/2031] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:04:40 2022] GET /compute/v2.1/servers/153d30e2-3eed-4bba-b15b-ca82e6688dbe => generated 1314 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:04:41.809160 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-68f5cdda-920b-4adc-9cac-7d0aa0d3354c tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:04:41.810404 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-68f5cdda-920b-4adc-9cac-7d0aa0d3354c tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] [instance: 541591c5-62f9-489a-96e7-e7cbbbfc4e28] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:04:41.818310 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-68f5cdda-920b-4adc-9cac-7d0aa0d3354c tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:41.819196 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-68f5cdda-920b-4adc-9cac-7d0aa0d3354c tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:41.820162 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-68f5cdda-920b-4adc-9cac-7d0aa0d3354c tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:41.821148 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-68f5cdda-920b-4adc-9cac-7d0aa0d3354c tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:41.821951 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-68f5cdda-920b-4adc-9cac-7d0aa0d3354c tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:41.823562 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-68f5cdda-920b-4adc-9cac-7d0aa0d3354c tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:41.901009 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=6 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:04:41.989671 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=18 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:04:41.995279 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-404a7f70-9eb7-432e-a917-1ec808adc106 req-73b64729-86ac-4616-9a7c-fa45d6ee3bc7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e91f1ac-f79d-4ab0-aa13-ea32b0e74888", "name": "network-vif-deleted", "tag": "19d4795c-3095-41be-b300-ea441bb13af4"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:04:42.031090 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-404a7f70-9eb7-432e-a917-1ec808adc106 req-73b64729-86ac-4616-9a7c-fa45d6ee3bc7 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:42.032009 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-404a7f70-9eb7-432e-a917-1ec808adc106 req-73b64729-86ac-4616-9a7c-fa45d6ee3bc7 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:42.032666 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-404a7f70-9eb7-432e-a917-1ec808adc106 req-73b64729-86ac-4616-9a7c-fa45d6ee3bc7 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:42.068610 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-404a7f70-9eb7-432e-a917-1ec808adc106 req-73b64729-86ac-4616-9a7c-fa45d6ee3bc7 service nova] Creating event network-vif-deleted:19d4795c-3095-41be-b300-ea441bb13af4 for instance 8e91f1ac-f79d-4ab0-aa13-ea32b0e74888 on n-h1-850468-14 Aug 10 23:04:42.081338 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-404a7f70-9eb7-432e-a917-1ec808adc106 req-73b64729-86ac-4616-9a7c-fa45d6ee3bc7 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092178 Aug 10 23:04:42.086524 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1022/2032] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:04:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 23:04:42.093858 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-dea322b3-6da3-4249-9b13-a7709b1304b6 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:04:42.094636 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-dea322b3-6da3-4249-9b13-a7709b1304b6 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] [instance: 8e91f1ac-f79d-4ab0-aa13-ea32b0e74888] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:04:42.115324 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dea322b3-6da3-4249-9b13-a7709b1304b6 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:42.115827 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dea322b3-6da3-4249-9b13-a7709b1304b6 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:42.116274 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dea322b3-6da3-4249-9b13-a7709b1304b6 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:42.116997 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dea322b3-6da3-4249-9b13-a7709b1304b6 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:42.117453 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dea322b3-6da3-4249-9b13-a7709b1304b6 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:42.122504 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dea322b3-6da3-4249-9b13-a7709b1304b6 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:42.197247 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-68f5cdda-920b-4adc-9cac-7d0aa0d3354c tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de244f1f82143a0b3d3283c31d80bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14c63df2e6c46d2af23b6b8a52690d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:04:42.224065 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-68f5cdda-920b-4adc-9cac-7d0aa0d3354c tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] 10.222.0.58 "GET /compute/v2.1/servers/541591c5-62f9-489a-96e7-e7cbbbfc4e28" status: 200 len: 1313 microversion: 2.1 time: 0.421505 Aug 10 23:04:42.231491 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1011/2033] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:04:41 2022] GET /compute/v2.1/servers/541591c5-62f9-489a-96e7-e7cbbbfc4e28 => generated 1313 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:04:42.779565 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-542baeb3-7bb1-49dc-b5bf-b0b7125c52be tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Action: 'create', calling method: .version_select at 0x7f848238e8b0>, body: {"keypair": {"name": "tempest-keypair-526983953", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFbExZWcm1me2QCZ9XPUOrOFOLYV1f++5UP9vGB62oT9fPBNLKUqG1mXd62OP+YjrUtGoB+xG1rFVXrbO/xx8T77Qk6xgl4LdYn52NjRrAfDdLaoDeM2Zg98ULOEkJ4GpQ=="}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:04:42.788960 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=9,nova_api:UPDATE=2 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:04:42.819328 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-542baeb3-7bb1-49dc-b5bf-b0b7125c52be tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Getting quotas for project 27408df8ea9f4d848b15b0bbba451a21. Resources: {'key_pairs'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:04:42.848510 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-542baeb3-7bb1-49dc-b5bf-b0b7125c52be tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Getting quotas for user 1cf1bcb51dec4134ac27ea7964684c7d and project 27408df8ea9f4d848b15b0bbba451a21. Resources: {'key_pairs'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:04:42.890883 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-542baeb3-7bb1-49dc-b5bf-b0b7125c52be tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.565755 Aug 10 23:04:42.896031 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1012/2034] 10.222.0.58 () {60 vars in 1159 bytes} [Wed Aug 10 23:04:42 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 23:04:42.903116 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-98dd5e4c-35e5-4c35-9b93-7c03505490ea tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:04:42.903841 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-98dd5e4c-35e5-4c35-9b93-7c03505490ea tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] [instance: 153d30e2-3eed-4bba-b15b-ca82e6688dbe] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:04:42.910731 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-98dd5e4c-35e5-4c35-9b93-7c03505490ea tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:42.911290 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-98dd5e4c-35e5-4c35-9b93-7c03505490ea tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:42.911830 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-98dd5e4c-35e5-4c35-9b93-7c03505490ea tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:42.912548 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-98dd5e4c-35e5-4c35-9b93-7c03505490ea tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:42.913003 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-98dd5e4c-35e5-4c35-9b93-7c03505490ea tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:42.913474 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-98dd5e4c-35e5-4c35-9b93-7c03505490ea tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:42.978457 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-dea322b3-6da3-4249-9b13-a7709b1304b6 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632904331d024d9b8e4d3660dff2cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ed0bdee3aa4013bd9219069bda558c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:04:42.992366 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-dea322b3-6da3-4249-9b13-a7709b1304b6 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] 10.222.0.58 "GET /compute/v2.1/servers/8e91f1ac-f79d-4ab0-aa13-ea32b0e74888" status: 200 len: 1319 microversion: 2.1 time: 0.901479 Aug 10 23:04:42.995866 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1023/2035] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:04:42 2022] GET /compute/v2.1/servers/8e91f1ac-f79d-4ab0-aa13-ea32b0e74888 => generated 1319 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:04:43.009031 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-b6007914-0d06-4362-914f-dee218989bd6 req-f9abf868-ca77-40a1-b7da-34fc46756281 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b3b3730c-1396-4ca6-9d9e-8a3104950324", "tag": "aee4dd1c-12e7-4581-960e-4729757cc898"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:04:43.032215 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-b6007914-0d06-4362-914f-dee218989bd6 req-f9abf868-ca77-40a1-b7da-34fc46756281 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:43.032697 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-b6007914-0d06-4362-914f-dee218989bd6 req-f9abf868-ca77-40a1-b7da-34fc46756281 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:43.033132 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-b6007914-0d06-4362-914f-dee218989bd6 req-f9abf868-ca77-40a1-b7da-34fc46756281 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:43.065908 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-b6007914-0d06-4362-914f-dee218989bd6 req-f9abf868-ca77-40a1-b7da-34fc46756281 service nova] Creating event network-changed:aee4dd1c-12e7-4581-960e-4729757cc898 for instance b3b3730c-1396-4ca6-9d9e-8a3104950324 on n-h1-850468-14 Aug 10 23:04:43.083376 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-b6007914-0d06-4362-914f-dee218989bd6 req-f9abf868-ca77-40a1-b7da-34fc46756281 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082056 Aug 10 23:04:43.084031 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1024/2036] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:04:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:04:43.257088 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-e9b64e12-e048-4255-b4ca-a111ed5ed010 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:04:43.263615 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-e9b64e12-e048-4255-b4ca-a111ed5ed010 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] [instance: 541591c5-62f9-489a-96e7-e7cbbbfc4e28] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:04:43.286648 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e9b64e12-e048-4255-b4ca-a111ed5ed010 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:43.293060 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e9b64e12-e048-4255-b4ca-a111ed5ed010 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:43.296929 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e9b64e12-e048-4255-b4ca-a111ed5ed010 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:43.301161 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e9b64e12-e048-4255-b4ca-a111ed5ed010 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:43.303180 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e9b64e12-e048-4255-b4ca-a111ed5ed010 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:43.305109 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e9b64e12-e048-4255-b4ca-a111ed5ed010 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:43.412221 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-98dd5e4c-35e5-4c35-9b93-7c03505490ea tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d2f8f63e9444fe8cf621d2f7c252bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04b07c6f0284e9bb36ba0030f4a31d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:04:43.429568 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-98dd5e4c-35e5-4c35-9b93-7c03505490ea tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] 10.222.0.58 "GET /compute/v2.1/servers/153d30e2-3eed-4bba-b15b-ca82e6688dbe" status: 200 len: 1314 microversion: 2.1 time: 0.524989 Aug 10 23:04:43.430237 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1013/2037] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:04:42 2022] GET /compute/v2.1/servers/153d30e2-3eed-4bba-b15b-ca82e6688dbe => generated 1314 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:04:43.972271 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-e9b64e12-e048-4255-b4ca-a111ed5ed010 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de244f1f82143a0b3d3283c31d80bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14c63df2e6c46d2af23b6b8a52690d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:04:43.984093 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-e9b64e12-e048-4255-b4ca-a111ed5ed010 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] 10.222.0.58 "GET /compute/v2.1/servers/541591c5-62f9-489a-96e7-e7cbbbfc4e28" status: 200 len: 1313 microversion: 2.1 time: 0.732293 Aug 10 23:04:43.984799 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1025/2038] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:04:43 2022] GET /compute/v2.1/servers/541591c5-62f9-489a-96e7-e7cbbbfc4e28 => generated 1313 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:04:44.020617 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-4663eccc-4947-43e1-ad29-2bd1d2397387 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:04:44.031702 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-4663eccc-4947-43e1-ad29-2bd1d2397387 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] [instance: 8e91f1ac-f79d-4ab0-aa13-ea32b0e74888] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:04:44.062171 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4663eccc-4947-43e1-ad29-2bd1d2397387 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:44.063074 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4663eccc-4947-43e1-ad29-2bd1d2397387 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:44.066193 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4663eccc-4947-43e1-ad29-2bd1d2397387 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:44.080192 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4663eccc-4947-43e1-ad29-2bd1d2397387 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:44.081284 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4663eccc-4947-43e1-ad29-2bd1d2397387 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:44.082265 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4663eccc-4947-43e1-ad29-2bd1d2397387 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:44.148558 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-4663eccc-4947-43e1-ad29-2bd1d2397387 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] HTTP exception thrown: Instance 8e91f1ac-f79d-4ab0-aa13-ea32b0e74888 could not be found. Aug 10 23:04:44.152820 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-4663eccc-4947-43e1-ad29-2bd1d2397387 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Request method failure captured: Aug 10 23:04:44.152820 n-d-850468-14 devstack@n-api.service[122633]: request: GET /compute/v2.1/servers/8e91f1ac-f79d-4ab0-aa13-ea32b0e74888 HTTP/1.1 Aug 10 23:04:44.152820 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:04:44.152820 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:04:44.152820 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:04:44.152820 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:04:44.152820 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:04:44.152820 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:04:44.152820 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:04:44.152820 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:04:44.152820 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9DfOEywB9oeD_C2SwugHriPH6QPax3SubHvct868zap6PD9BiLAj3q-t9YA3Fiw0HKhahbZB4KIKKcaf61C3Wt-lqKMWkeMB0U5Hy-b51nFx374XbUqtnrhL-_0NpcyHXThCK21eb7hc3wOrIDMIf5OvLiBpImI0ZmmFDD5V_kdMRpY Aug 10 23:04:44.152820 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:04:44.152820 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:04:44.152820 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:04:44.152820 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:04:44.152820 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:04:44.152820 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:04:44.152820 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 56ed0bdee3aa4013bd9219069bda558c Aug 10 23:04:44.152820 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-LiveMigrationTest-2043915664 Aug 10 23:04:44.152820 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:04:44.152820 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:04:44.155416 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/56ed0bdee3aa4013bd9219069bda558c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/56ed0bdee3aa4013bd9219069bda558c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/56ed0bdee3aa4013bd9219069bda558c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_56ed0bdee3aa4013bd9219069bda558c", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:04:44.155416 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-LiveMigrationTest-2043915664 Aug 10 23:04:44.155416 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 56ed0bdee3aa4013bd9219069bda558c Aug 10 23:04:44.155416 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-LiveMigrationTest-2043915664 Aug 10 23:04:44.155416 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-LiveMigrationTest-2043915664-project Aug 10 23:04:44.155416 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:04:44.155416 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:04:44.155416 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 632904331d024d9b8e4d3660dff2cdf3 Aug 10 23:04:44.155416 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-LiveMigrationTest-2043915664-project Aug 10 23:04:44.155416 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:04:44.155416 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance 8e91f1ac-f79d-4ab0-aa13-ea32b0e74888 could not be found. Aug 10 23:04:44.155416 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': '8e91f1ac-f79d-4ab0-aa13-ea32b0e74888'} Aug 10 23:04:44.156851 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:04:44.156851 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:04:44.156851 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:04:44.156851 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:04:44.156851 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:04:44.156851 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:04:44.156851 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:04:44.156851 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:04:44.156851 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:04:44.156851 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:04:44.156851 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e91f1ac-f79d-4ab0-aa13-ea32b0e74888 could not be found. Aug 10 23:04:44.156851 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:04:44.156851 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:04:44.156851 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:04:44.156851 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:04:44.156851 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:04:44.156851 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:04:44.156851 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:04:44.156851 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:04:44.156851 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:04:44.159319 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:04:44.159319 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:04:44.159319 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:04:44.159319 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:04:44.159319 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:04:44.159319 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:04:44.159319 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:04:44.159319 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e91f1ac-f79d-4ab0-aa13-ea32b0e74888 could not be found. Aug 10 23:04:44.159319 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:04:44.159319 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:04:44.159319 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:04:44.159319 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:04:44.159319 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:04:44.159319 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:04:44.159319 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:04:44.159319 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:04:44.159319 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e91f1ac-f79d-4ab0-aa13-ea32b0e74888 could not be found. Aug 10 23:04:44.159319 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:04:44.180243 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-4663eccc-4947-43e1-ad29-2bd1d2397387 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Returning 404 to user: Instance 8e91f1ac-f79d-4ab0-aa13-ea32b0e74888 could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:04:44.188777 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-4663eccc-4947-43e1-ad29-2bd1d2397387 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] 10.222.0.58 "GET /compute/v2.1/servers/8e91f1ac-f79d-4ab0-aa13-ea32b0e74888" status: 404 len: 111 microversion: 2.1 time: 0.174052 Aug 10 23:04:44.190010 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1014/2039] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:04:44 2022] GET /compute/v2.1/servers/8e91f1ac-f79d-4ab0-aa13-ea32b0e74888 => generated 111 bytes in 178 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:04:44.204757 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-30d764b0-81e3-498b-8029-fd554628aed4 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Calling method '.version_select at 0x7f847d978700>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:04:44.257859 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-30d764b0-81e3-498b-8029-fd554628aed4 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-480888818" status: 202 len: 0 microversion: 2.1 time: 0.062820 Aug 10 23:04:44.262649 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1026/2040] 10.222.0.58 () {58 vars in 1218 bytes} [Wed Aug 10 23:04:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-480888818 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 10 23:04:44.456754 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-f1a66b89-5797-4096-a3b3-cc5d03619cb8 tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:04:44.458306 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-f1a66b89-5797-4096-a3b3-cc5d03619cb8 tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] [instance: 153d30e2-3eed-4bba-b15b-ca82e6688dbe] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:04:44.468498 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f1a66b89-5797-4096-a3b3-cc5d03619cb8 tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:44.475586 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f1a66b89-5797-4096-a3b3-cc5d03619cb8 tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:44.476481 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f1a66b89-5797-4096-a3b3-cc5d03619cb8 tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:44.477461 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f1a66b89-5797-4096-a3b3-cc5d03619cb8 tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:44.478138 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f1a66b89-5797-4096-a3b3-cc5d03619cb8 tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:44.480297 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f1a66b89-5797-4096-a3b3-cc5d03619cb8 tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:45.005431 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-e05b0c27-5778-4d17-94a3-33097d3af060 tempest-FlavorsV2TestJSON-1259480527 tempest-FlavorsV2TestJSON-1259480527-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:04:45.016475 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=8 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:04:45.020436 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-e05b0c27-5778-4d17-94a3-33097d3af060 tempest-FlavorsV2TestJSON-1259480527 tempest-FlavorsV2TestJSON-1259480527-project] 10.222.0.58 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.283671 Aug 10 23:04:45.022246 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1027/2041] 10.222.0.58 () {58 vars in 1137 bytes} [Wed Aug 10 23:04:44 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:04:45.027961 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-a1fba0af-1ff6-4c96-9ea9-b2cf057c3508 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:04:45.030915 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-a1fba0af-1ff6-4c96-9ea9-b2cf057c3508 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] [instance: 541591c5-62f9-489a-96e7-e7cbbbfc4e28] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:04:45.038680 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a1fba0af-1ff6-4c96-9ea9-b2cf057c3508 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:45.040007 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a1fba0af-1ff6-4c96-9ea9-b2cf057c3508 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:45.043389 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a1fba0af-1ff6-4c96-9ea9-b2cf057c3508 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:45.044946 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a1fba0af-1ff6-4c96-9ea9-b2cf057c3508 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:45.045640 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a1fba0af-1ff6-4c96-9ea9-b2cf057c3508 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:45.046668 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a1fba0af-1ff6-4c96-9ea9-b2cf057c3508 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:45.239125 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-f1a66b89-5797-4096-a3b3-cc5d03619cb8 tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d2f8f63e9444fe8cf621d2f7c252bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04b07c6f0284e9bb36ba0030f4a31d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:04:45.255571 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-f1a66b89-5797-4096-a3b3-cc5d03619cb8 tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] 10.222.0.58 "GET /compute/v2.1/servers/153d30e2-3eed-4bba-b15b-ca82e6688dbe" status: 200 len: 1314 microversion: 2.1 time: 0.805724 Aug 10 23:04:45.257634 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1015/2042] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:04:44 2022] GET /compute/v2.1/servers/153d30e2-3eed-4bba-b15b-ca82e6688dbe => generated 1314 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:04:45.265916 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-2929d73e-84ff-46de-a2b8-85af0a31965e tempest-FlavorsV2TestJSON-1259480527 tempest-FlavorsV2TestJSON-1259480527-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:04:45.312731 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-2929d73e-84ff-46de-a2b8-85af0a31965e tempest-FlavorsV2TestJSON-1259480527 tempest-FlavorsV2TestJSON-1259480527-project] 10.222.0.58 "GET /compute/v2.1/flavors" status: 200 len: 2594 microversion: 2.1 time: 0.053628 Aug 10 23:04:45.323714 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1016/2043] 10.222.0.58 () {58 vars in 1125 bytes} [Wed Aug 10 23:04:45 2022] GET /compute/v2.1/flavors => generated 2594 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:04:45.333003 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-83800878-4674-4df6-9a60-e86557692746 tempest-FlavorsV2TestJSON-1259480527 tempest-FlavorsV2TestJSON-1259480527-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:04:45.352692 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-83800878-4674-4df6-9a60-e86557692746 tempest-FlavorsV2TestJSON-1259480527 tempest-FlavorsV2TestJSON-1259480527-project] 10.222.0.58 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.023634 Aug 10 23:04:45.356483 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1017/2044] 10.222.0.58 () {58 vars in 1137 bytes} [Wed Aug 10 23:04:45 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:04:45.368344 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-fbcea46c-02be-41d4-a368-84a2076e5d56 tempest-FlavorsV2TestJSON-1259480527 tempest-FlavorsV2TestJSON-1259480527-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:04:45.377425 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-fbcea46c-02be-41d4-a368-84a2076e5d56 tempest-FlavorsV2TestJSON-1259480527 tempest-FlavorsV2TestJSON-1259480527-project] 10.222.0.58 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.014270 Aug 10 23:04:45.378484 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1018/2045] 10.222.0.58 () {58 vars in 1137 bytes} [Wed Aug 10 23:04:45 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:04:45.392800 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-25fb79b5-778a-4781-b4b3-f233ca8ce386 tempest-FlavorsV2TestJSON-1259480527 tempest-FlavorsV2TestJSON-1259480527-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:04:45.437490 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-25fb79b5-778a-4781-b4b3-f233ca8ce386 tempest-FlavorsV2TestJSON-1259480527 tempest-FlavorsV2TestJSON-1259480527-project] 10.222.0.58 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.050390 Aug 10 23:04:45.438702 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1019/2046] 10.222.0.58 () {58 vars in 1165 bytes} [Wed Aug 10 23:04:45 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:04:45.458313 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-f2953e20-9aed-4e60-a5ab-ca7127100bf0 tempest-FlavorsV2TestJSON-1259480527 tempest-FlavorsV2TestJSON-1259480527-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:04:45.470999 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-f2953e20-9aed-4e60-a5ab-ca7127100bf0 tempest-FlavorsV2TestJSON-1259480527 tempest-FlavorsV2TestJSON-1259480527-project] 10.222.0.58 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.016348 Aug 10 23:04:45.471915 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1020/2047] 10.222.0.58 () {58 vars in 1137 bytes} [Wed Aug 10 23:04:45 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 23:04:45.484010 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-886f8ac8-decf-415f-b3b1-db18dea15e12 tempest-FlavorsV2TestJSON-1259480527 tempest-FlavorsV2TestJSON-1259480527-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:04:45.560160 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-886f8ac8-decf-415f-b3b1-db18dea15e12 tempest-FlavorsV2TestJSON-1259480527 tempest-FlavorsV2TestJSON-1259480527-project] 10.222.0.58 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.079938 Aug 10 23:04:45.563503 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1021/2048] 10.222.0.58 () {58 vars in 1169 bytes} [Wed Aug 10 23:04:45 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:04:45.587417 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-670da913-1705-44ee-a00f-3bc36b86aa23 tempest-FlavorsV2TestJSON-1259480527 tempest-FlavorsV2TestJSON-1259480527-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:04:45.615264 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-670da913-1705-44ee-a00f-3bc36b86aa23 tempest-FlavorsV2TestJSON-1259480527 tempest-FlavorsV2TestJSON-1259480527-project] 10.222.0.58 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.033108 Aug 10 23:04:45.618012 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1022/2049] 10.222.0.58 () {58 vars in 1161 bytes} [Wed Aug 10 23:04:45 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 23:04:45.634160 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-704b23cc-db70-4b56-a017-f1a25aa5876c tempest-FlavorsV2TestJSON-1259480527 tempest-FlavorsV2TestJSON-1259480527-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:04:45.657871 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-704b23cc-db70-4b56-a017-f1a25aa5876c tempest-FlavorsV2TestJSON-1259480527 tempest-FlavorsV2TestJSON-1259480527-project] 10.222.0.58 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.027996 Aug 10 23:04:45.659585 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1023/2050] 10.222.0.58 () {58 vars in 1137 bytes} [Wed Aug 10 23:04:45 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:04:45.675358 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-3f7a68e1-a7cd-44ba-aa8f-db61ceb03f18 tempest-FlavorsV2TestJSON-1259480527 tempest-FlavorsV2TestJSON-1259480527-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:04:45.763111 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-3f7a68e1-a7cd-44ba-aa8f-db61ceb03f18 tempest-FlavorsV2TestJSON-1259480527 tempest-FlavorsV2TestJSON-1259480527-project] 10.222.0.58 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.095398 Aug 10 23:04:45.768400 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1024/2051] 10.222.0.58 () {58 vars in 1167 bytes} [Wed Aug 10 23:04:45 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:04:45.797368 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-4090f933-3fc7-4065-9880-e22f655cb988 tempest-FlavorsV2TestJSON-1259480527 tempest-FlavorsV2TestJSON-1259480527-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:04:45.826189 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-4090f933-3fc7-4065-9880-e22f655cb988 tempest-FlavorsV2TestJSON-1259480527 tempest-FlavorsV2TestJSON-1259480527-project] 10.222.0.58 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.034837 Aug 10 23:04:45.827446 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1025/2052] 10.222.0.58 () {58 vars in 1137 bytes} [Wed Aug 10 23:04:45 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:04:45.846974 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-5be8e763-4a6e-448a-929a-f1183a1b6d75 tempest-FlavorsV2TestJSON-1259480527 tempest-FlavorsV2TestJSON-1259480527-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:04:45.887382 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-5be8e763-4a6e-448a-929a-f1183a1b6d75 tempest-FlavorsV2TestJSON-1259480527 tempest-FlavorsV2TestJSON-1259480527-project] 10.222.0.58 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.046929 Aug 10 23:04:45.889029 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1026/2053] 10.222.0.58 () {58 vars in 1144 bytes} [Wed Aug 10 23:04:45 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:04:45.895908 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-630543cd-2570-44eb-b040-f08bc77b3278 req-6a91a11e-2a21-4196-9b18-5ab41973fee6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "541591c5-62f9-489a-96e7-e7cbbbfc4e28", "tag": "1e288590-eb74-4df3-ad37-16250a74ba4e"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:04:45.911192 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-630543cd-2570-44eb-b040-f08bc77b3278 req-6a91a11e-2a21-4196-9b18-5ab41973fee6 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:45.912060 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-630543cd-2570-44eb-b040-f08bc77b3278 req-6a91a11e-2a21-4196-9b18-5ab41973fee6 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:45.912760 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-630543cd-2570-44eb-b040-f08bc77b3278 req-6a91a11e-2a21-4196-9b18-5ab41973fee6 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:45.929108 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-630543cd-2570-44eb-b040-f08bc77b3278 req-6a91a11e-2a21-4196-9b18-5ab41973fee6 service nova] Creating event network-changed:1e288590-eb74-4df3-ad37-16250a74ba4e for instance 541591c5-62f9-489a-96e7-e7cbbbfc4e28 on n-h2-850468-14 Aug 10 23:04:45.941779 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-630543cd-2570-44eb-b040-f08bc77b3278 req-6a91a11e-2a21-4196-9b18-5ab41973fee6 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049753 Aug 10 23:04:45.942662 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1027/2054] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:04:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:04:45.946426 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-a1fba0af-1ff6-4c96-9ea9-b2cf057c3508 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de244f1f82143a0b3d3283c31d80bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14c63df2e6c46d2af23b6b8a52690d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:04:45.951108 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-32581370-cf4a-4dd4-886f-5eab09cc40aa tempest-FlavorsV2TestJSON-1259480527 tempest-FlavorsV2TestJSON-1259480527-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:04:45.959661 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-a1fba0af-1ff6-4c96-9ea9-b2cf057c3508 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] 10.222.0.58 "GET /compute/v2.1/servers/541591c5-62f9-489a-96e7-e7cbbbfc4e28" status: 200 len: 1313 microversion: 2.1 time: 0.936025 Aug 10 23:04:45.962377 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-32581370-cf4a-4dd4-886f-5eab09cc40aa tempest-FlavorsV2TestJSON-1259480527 tempest-FlavorsV2TestJSON-1259480527-project] 10.222.0.58 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.017844 Aug 10 23:04:45.964069 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1028/2055] 10.222.0.58 () {58 vars in 1137 bytes} [Wed Aug 10 23:04:45 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:04:45.964180 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1028/2056] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:04:45 2022] GET /compute/v2.1/servers/541591c5-62f9-489a-96e7-e7cbbbfc4e28 => generated 1313 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:04:45.975603 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-ed6fcf9a-c6ad-4e58-b6fa-a6ebee967f03 tempest-FlavorsV2TestJSON-1259480527 tempest-FlavorsV2TestJSON-1259480527-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:04:45.998621 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-ed6fcf9a-c6ad-4e58-b6fa-a6ebee967f03 tempest-FlavorsV2TestJSON-1259480527 tempest-FlavorsV2TestJSON-1259480527-project] 10.222.0.58 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.026846 Aug 10 23:04:46.009027 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1029/2057] 10.222.0.58 () {58 vars in 1148 bytes} [Wed Aug 10 23:04:45 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:04:46.014966 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-ba7cbfc8-a233-4b52-8a5d-8ad3e3cb24ba tempest-FlavorsV2TestJSON-1259480527 tempest-FlavorsV2TestJSON-1259480527-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:04:46.038766 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-ba7cbfc8-a233-4b52-8a5d-8ad3e3cb24ba tempest-FlavorsV2TestJSON-1259480527 tempest-FlavorsV2TestJSON-1259480527-project] 10.222.0.58 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.029534 Aug 10 23:04:46.039701 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1029/2058] 10.222.0.58 () {58 vars in 1140 bytes} [Wed Aug 10 23:04:46 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 23:04:46.052840 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-ce2e3cd6-a105-4f40-8ff3-a5fa365b5ebf tempest-FlavorsV2TestJSON-1259480527 tempest-FlavorsV2TestJSON-1259480527-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:04:46.068925 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-ce2e3cd6-a105-4f40-8ff3-a5fa365b5ebf tempest-FlavorsV2TestJSON-1259480527 tempest-FlavorsV2TestJSON-1259480527-project] 10.222.0.58 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.020085 Aug 10 23:04:46.069329 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1030/2059] 10.222.0.58 () {58 vars in 1137 bytes} [Wed Aug 10 23:04:46 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:04:46.097750 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-4b327f18-961e-4a1f-887e-b07c55ba507d tempest-FlavorsV2TestJSON-1259480527 tempest-FlavorsV2TestJSON-1259480527-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:04:46.161329 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-4b327f18-961e-4a1f-887e-b07c55ba507d tempest-FlavorsV2TestJSON-1259480527 tempest-FlavorsV2TestJSON-1259480527-project] 10.222.0.58 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.078495 Aug 10 23:04:46.162466 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1030/2060] 10.222.0.58 () {58 vars in 1146 bytes} [Wed Aug 10 23:04:46 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:04:46.180273 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-e2bc8257-0477-40c4-9294-13c8d2a1ddc8 tempest-FlavorsV2TestJSON-1259480527 tempest-FlavorsV2TestJSON-1259480527-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:04:46.206968 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-e2bc8257-0477-40c4-9294-13c8d2a1ddc8 tempest-FlavorsV2TestJSON-1259480527 tempest-FlavorsV2TestJSON-1259480527-project] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.032689 Aug 10 23:04:46.221323 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1031/2061] 10.222.0.58 () {58 vars in 1146 bytes} [Wed Aug 10 23:04:46 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:04:46.234961 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-d86d2ed0-0165-4d7e-8172-1a95dd969339 tempest-FlavorsV2TestJSON-1259480527 tempest-FlavorsV2TestJSON-1259480527-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:04:46.259330 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-d86d2ed0-0165-4d7e-8172-1a95dd969339 tempest-FlavorsV2TestJSON-1259480527 tempest-FlavorsV2TestJSON-1259480527-project] 10.222.0.58 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.035855 Aug 10 23:04:46.263341 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1031/2062] 10.222.0.58 () {58 vars in 1137 bytes} [Wed Aug 10 23:04:46 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:04:46.271014 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-96ad2972-6690-49f5-8ec1-5c9d13709444 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1031622232", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b9faafad-d704-47e8-a221-ba688e261596"}], "security_groups": [{"name": "tempest-securitygroup--2001033353"}], "key_name": "tempest-keypair-938102435", "user_data": "}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:04:46.313631 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-8e4e5326-6a83-46c0-9370-c7d480847fc2 tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:04:46.315997 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-8e4e5326-6a83-46c0-9370-c7d480847fc2 tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] [instance: 153d30e2-3eed-4bba-b15b-ca82e6688dbe] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:04:46.332333 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8e4e5326-6a83-46c0-9370-c7d480847fc2 tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:46.335679 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8e4e5326-6a83-46c0-9370-c7d480847fc2 tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:46.336327 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8e4e5326-6a83-46c0-9370-c7d480847fc2 tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:46.340115 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8e4e5326-6a83-46c0-9370-c7d480847fc2 tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:46.343822 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8e4e5326-6a83-46c0-9370-c7d480847fc2 tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:46.344538 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8e4e5326-6a83-46c0-9370-c7d480847fc2 tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:46.394379 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=100 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:04:46.513920 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.network.neutron [None req-96ad2972-6690-49f5-8ec1-5c9d13709444 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] validate_networks() for [('b9faafad-d704-47e8-a221-ba688e261596', None, None, None, None, None)] {{(pid=122633) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 23:04:47.446999 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-8e4e5326-6a83-46c0-9370-c7d480847fc2 tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d2f8f63e9444fe8cf621d2f7c252bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04b07c6f0284e9bb36ba0030f4a31d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:04:47.471586 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-8e4e5326-6a83-46c0-9370-c7d480847fc2 tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] 10.222.0.58 "GET /compute/v2.1/servers/153d30e2-3eed-4bba-b15b-ca82e6688dbe" status: 200 len: 1314 microversion: 2.1 time: 1.175515 Aug 10 23:04:47.475683 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1032/2063] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:04:46 2022] GET /compute/v2.1/servers/153d30e2-3eed-4bba-b15b-ca82e6688dbe => generated 1314 bytes in 1198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:04:47.484552 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-82e62cd6-f657-43eb-96d6-0fbc0c55cf38 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:04:47.485602 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-82e62cd6-f657-43eb-96d6-0fbc0c55cf38 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] [instance: 541591c5-62f9-489a-96e7-e7cbbbfc4e28] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:04:47.495482 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-82e62cd6-f657-43eb-96d6-0fbc0c55cf38 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:47.496034 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-82e62cd6-f657-43eb-96d6-0fbc0c55cf38 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:47.496491 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-82e62cd6-f657-43eb-96d6-0fbc0c55cf38 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:47.497196 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-82e62cd6-f657-43eb-96d6-0fbc0c55cf38 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:47.497819 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-82e62cd6-f657-43eb-96d6-0fbc0c55cf38 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:47.498126 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-82e62cd6-f657-43eb-96d6-0fbc0c55cf38 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:47.553375 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-96ad2972-6690-49f5-8ec1-5c9d13709444 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Flavor limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:04:47.554554 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-96ad2972-6690-49f5-8ec1-5c9d13709444 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Image limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:04:47.556135 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-96ad2972-6690-49f5-8ec1-5c9d13709444 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Flavor pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:04:47.557418 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-96ad2972-6690-49f5-8ec1-5c9d13709444 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Image pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:04:47.559248 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-96ad2972-6690-49f5-8ec1-5c9d13709444 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:04:47.569660 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-96ad2972-6690-49f5-8ec1-5c9d13709444 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:47.570894 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-96ad2972-6690-49f5-8ec1-5c9d13709444 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:47.571437 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-96ad2972-6690-49f5-8ec1-5c9d13709444 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:47.572827 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-96ad2972-6690-49f5-8ec1-5c9d13709444 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:47.573594 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-96ad2972-6690-49f5-8ec1-5c9d13709444 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:47.574333 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-96ad2972-6690-49f5-8ec1-5c9d13709444 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:47.600610 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-96ad2972-6690-49f5-8ec1-5c9d13709444 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Getting quotas for project 597863bfebdc481188f1f30095da5396. Resources: {'instances', 'cores', 'ram'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:04:47.610876 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-96ad2972-6690-49f5-8ec1-5c9d13709444 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Getting quotas for user a1986185dc9b4df4affcc421365462f7 and project 597863bfebdc481188f1f30095da5396. Resources: {'instances', 'cores', 'ram'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:04:47.633286 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-96ad2972-6690-49f5-8ec1-5c9d13709444 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Going to run 1 instances... {{(pid=122633) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 23:04:47.637339 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-96ad2972-6690-49f5-8ec1-5c9d13709444 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] [instance: 45beadf1-a6da-49ab-9098-6b681b5184c9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78ad8905-f66f-4733-8be9-2b260f1fabed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122633) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 23:04:47.739218 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-96ad2972-6690-49f5-8ec1-5c9d13709444 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.482596 Aug 10 23:04:47.742162 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1032/2064] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 23:04:46 2022] POST /compute/v2.1/servers => generated 402 bytes in 1486 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 10 23:04:47.750121 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-67eb3463-0ca9-4e5b-b029-888d30ef4d30 tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-755489582", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "f3c01913-ebb5-4849-bac8-31eca2fd2b75"}], "security_groups": [{"name": "tempest-securitygroup--31087785"}], "key_name": "tempest-keypair-526983953", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:04:47.875486 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-82e62cd6-f657-43eb-96d6-0fbc0c55cf38 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de244f1f82143a0b3d3283c31d80bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14c63df2e6c46d2af23b6b8a52690d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:04:47.886112 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-82e62cd6-f657-43eb-96d6-0fbc0c55cf38 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] 10.222.0.58 "GET /compute/v2.1/servers/541591c5-62f9-489a-96e7-e7cbbbfc4e28" status: 200 len: 1313 microversion: 2.1 time: 0.412313 Aug 10 23:04:47.898124 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1033/2065] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:04:47 2022] GET /compute/v2.1/servers/541591c5-62f9-489a-96e7-e7cbbbfc4e28 => generated 1313 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:04:47.937689 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-1401588a-ae14-43a2-a1a1-e3b1f4e12df6 req-d170cc3e-b33f-4b7e-85f0-b88206d41880 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "153d30e2-3eed-4bba-b15b-ca82e6688dbe", "name": "network-vif-plugged", "status": "completed", "tag": "9be2d009-04de-4d66-bd2d-b90c4c4a5270"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:04:47.974994 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-1401588a-ae14-43a2-a1a1-e3b1f4e12df6 req-d170cc3e-b33f-4b7e-85f0-b88206d41880 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:47.975720 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-1401588a-ae14-43a2-a1a1-e3b1f4e12df6 req-d170cc3e-b33f-4b7e-85f0-b88206d41880 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:47.976306 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-1401588a-ae14-43a2-a1a1-e3b1f4e12df6 req-d170cc3e-b33f-4b7e-85f0-b88206d41880 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:48.008272 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-1401588a-ae14-43a2-a1a1-e3b1f4e12df6 req-d170cc3e-b33f-4b7e-85f0-b88206d41880 service nova] Creating event network-vif-plugged:9be2d009-04de-4d66-bd2d-b90c4c4a5270 for instance 153d30e2-3eed-4bba-b15b-ca82e6688dbe on n-h1-850468-14 Aug 10 23:04:48.033471 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-1401588a-ae14-43a2-a1a1-e3b1f4e12df6 req-d170cc3e-b33f-4b7e-85f0-b88206d41880 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133613 Aug 10 23:04:48.034353 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1034/2066] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:04:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:04:48.042810 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-8e4d60c5-3088-4b8e-ab91-da97b5c858b0 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:04:48.043837 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-8e4d60c5-3088-4b8e-ab91-da97b5c858b0 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] [instance: 45beadf1-a6da-49ab-9098-6b681b5184c9] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:04:48.159057 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-8e4d60c5-3088-4b8e-ab91-da97b5c858b0 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1986185dc9b4df4affcc421365462f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597863bfebdc481188f1f30095da5396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:04:48.172797 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-8e4d60c5-3088-4b8e-ab91-da97b5c858b0 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] 10.222.0.58 "GET /compute/v2.1/servers/45beadf1-a6da-49ab-9098-6b681b5184c9" status: 200 len: 1237 microversion: 2.1 time: 0.134742 Aug 10 23:04:48.191860 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1035/2067] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:04:48 2022] GET /compute/v2.1/servers/45beadf1-a6da-49ab-9098-6b681b5184c9 => generated 1237 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:04:48.201916 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.network.neutron [None req-67eb3463-0ca9-4e5b-b029-888d30ef4d30 tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] validate_networks() for [('f3c01913-ebb5-4849-bac8-31eca2fd2b75', None, None, None, None, None)] {{(pid=122633) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 23:04:48.498848 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-6ae40d89-5c85-4457-9326-ff742bbbd202 tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:04:48.500003 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-6ae40d89-5c85-4457-9326-ff742bbbd202 tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] [instance: 153d30e2-3eed-4bba-b15b-ca82e6688dbe] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:04:48.513608 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6ae40d89-5c85-4457-9326-ff742bbbd202 tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:48.520787 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6ae40d89-5c85-4457-9326-ff742bbbd202 tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:48.522548 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6ae40d89-5c85-4457-9326-ff742bbbd202 tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:48.527096 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6ae40d89-5c85-4457-9326-ff742bbbd202 tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:48.527890 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6ae40d89-5c85-4457-9326-ff742bbbd202 tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:48.528544 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6ae40d89-5c85-4457-9326-ff742bbbd202 tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:49.012528 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-6ae40d89-5c85-4457-9326-ff742bbbd202 tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d2f8f63e9444fe8cf621d2f7c252bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04b07c6f0284e9bb36ba0030f4a31d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:04:49.024195 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-67eb3463-0ca9-4e5b-b029-888d30ef4d30 tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Getting quotas for project 27408df8ea9f4d848b15b0bbba451a21. Resources: dict_keys(['metadata_items']) {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:04:49.027569 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-6ae40d89-5c85-4457-9326-ff742bbbd202 tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] 10.222.0.58 "GET /compute/v2.1/servers/153d30e2-3eed-4bba-b15b-ca82e6688dbe" status: 200 len: 1314 microversion: 2.1 time: 0.535209 Aug 10 23:04:49.030574 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1036/2068] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:04:48 2022] GET /compute/v2.1/servers/153d30e2-3eed-4bba-b15b-ca82e6688dbe => generated 1314 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:04:49.037177 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-392ad4e8-d4dc-4ae2-a016-e32cc6a7689d tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:04:49.039721 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-67eb3463-0ca9-4e5b-b029-888d30ef4d30 tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Getting quotas for user 1cf1bcb51dec4134ac27ea7964684c7d and project 27408df8ea9f4d848b15b0bbba451a21. Resources: dict_keys(['metadata_items']) {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:04:49.044047 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-392ad4e8-d4dc-4ae2-a016-e32cc6a7689d tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] [instance: 9b8271c8-f9d7-48fc-b8ad-a50e71d3cec5] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:04:49.059981 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-392ad4e8-d4dc-4ae2-a016-e32cc6a7689d tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:49.060738 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-392ad4e8-d4dc-4ae2-a016-e32cc6a7689d tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:49.064016 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-392ad4e8-d4dc-4ae2-a016-e32cc6a7689d tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:49.064963 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-392ad4e8-d4dc-4ae2-a016-e32cc6a7689d tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:49.065593 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-392ad4e8-d4dc-4ae2-a016-e32cc6a7689d tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:49.066193 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-392ad4e8-d4dc-4ae2-a016-e32cc6a7689d tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:49.097900 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-67eb3463-0ca9-4e5b-b029-888d30ef4d30 tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Flavor limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:04:49.099809 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-67eb3463-0ca9-4e5b-b029-888d30ef4d30 tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Image limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:04:49.101625 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-67eb3463-0ca9-4e5b-b029-888d30ef4d30 tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Flavor pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:04:49.102464 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-67eb3463-0ca9-4e5b-b029-888d30ef4d30 tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Image pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:04:49.107518 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-67eb3463-0ca9-4e5b-b029-888d30ef4d30 tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:04:49.133849 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-67eb3463-0ca9-4e5b-b029-888d30ef4d30 tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:49.134342 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-67eb3463-0ca9-4e5b-b029-888d30ef4d30 tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:49.135343 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-67eb3463-0ca9-4e5b-b029-888d30ef4d30 tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:49.135462 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-392ad4e8-d4dc-4ae2-a016-e32cc6a7689d tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] [instance: 9b8271c8-f9d7-48fc-b8ad-a50e71d3cec5] Going to try to terminate instance {{(pid=122632) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:04:49.146844 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-67eb3463-0ca9-4e5b-b029-888d30ef4d30 tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:49.147697 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-67eb3463-0ca9-4e5b-b029-888d30ef4d30 tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:49.148158 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-67eb3463-0ca9-4e5b-b029-888d30ef4d30 tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:49.189882 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-67eb3463-0ca9-4e5b-b029-888d30ef4d30 tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Getting quotas for project 27408df8ea9f4d848b15b0bbba451a21. Resources: {'instances', 'cores', 'ram'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:04:49.201940 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-67eb3463-0ca9-4e5b-b029-888d30ef4d30 tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Getting quotas for user 1cf1bcb51dec4134ac27ea7964684c7d and project 27408df8ea9f4d848b15b0bbba451a21. Resources: {'instances', 'cores', 'ram'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:04:49.220558 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-67eb3463-0ca9-4e5b-b029-888d30ef4d30 tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Going to run 1 instances... {{(pid=122633) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 23:04:49.224279 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-67eb3463-0ca9-4e5b-b029-888d30ef4d30 tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] [instance: e822b468-16f3-4a20-94d9-7a2517802a92] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78ad8905-f66f-4733-8be9-2b260f1fabed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122633) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 23:04:49.312101 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-67eb3463-0ca9-4e5b-b029-888d30ef4d30 tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.566454 Aug 10 23:04:49.314258 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1033/2069] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 23:04:47 2022] POST /compute/v2.1/servers => generated 405 bytes in 1571 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 23:04:49.328037 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-bd768ec7-a861-4346-a3fd-5d8742628d42 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:04:49.331048 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-bd768ec7-a861-4346-a3fd-5d8742628d42 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] [instance: 541591c5-62f9-489a-96e7-e7cbbbfc4e28] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:04:49.332218 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-392ad4e8-d4dc-4ae2-a016-e32cc6a7689d tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] 10.222.0.58 "DELETE /compute/v2.1/servers/9b8271c8-f9d7-48fc-b8ad-a50e71d3cec5" status: 204 len: 0 microversion: 2.1 time: 0.298725 Aug 10 23:04:49.333175 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1037/2070] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:04:49 2022] DELETE /compute/v2.1/servers/9b8271c8-f9d7-48fc-b8ad-a50e71d3cec5 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:04:49.347646 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bd768ec7-a861-4346-a3fd-5d8742628d42 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:49.349975 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bd768ec7-a861-4346-a3fd-5d8742628d42 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:49.350560 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bd768ec7-a861-4346-a3fd-5d8742628d42 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:49.353226 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bd768ec7-a861-4346-a3fd-5d8742628d42 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:49.355364 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bd768ec7-a861-4346-a3fd-5d8742628d42 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:49.357122 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-85b04c1b-c077-4e3c-953e-79cc5729ea8c tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:04:49.357236 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bd768ec7-a861-4346-a3fd-5d8742628d42 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:49.358512 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-85b04c1b-c077-4e3c-953e-79cc5729ea8c tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] [instance: 45beadf1-a6da-49ab-9098-6b681b5184c9] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:04:49.408728 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-85b04c1b-c077-4e3c-953e-79cc5729ea8c tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:49.418563 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-85b04c1b-c077-4e3c-953e-79cc5729ea8c tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:49.419071 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-85b04c1b-c077-4e3c-953e-79cc5729ea8c tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:49.424269 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-85b04c1b-c077-4e3c-953e-79cc5729ea8c tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:49.427838 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-85b04c1b-c077-4e3c-953e-79cc5729ea8c tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:49.428308 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-85b04c1b-c077-4e3c-953e-79cc5729ea8c tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:49.643391 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-85b04c1b-c077-4e3c-953e-79cc5729ea8c tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1986185dc9b4df4affcc421365462f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597863bfebdc481188f1f30095da5396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:04:49.659025 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-85b04c1b-c077-4e3c-953e-79cc5729ea8c tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] 10.222.0.58 "GET /compute/v2.1/servers/45beadf1-a6da-49ab-9098-6b681b5184c9" status: 200 len: 1241 microversion: 2.1 time: 0.320739 Aug 10 23:04:49.660197 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1038/2071] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:04:49 2022] GET /compute/v2.1/servers/45beadf1-a6da-49ab-9098-6b681b5184c9 => generated 1241 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:04:49.670565 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-b5d31d62-3549-4cfb-a063-1fe459766cff tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:04:49.671408 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-b5d31d62-3549-4cfb-a063-1fe459766cff tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] [instance: e822b468-16f3-4a20-94d9-7a2517802a92] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:04:49.726394 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-bd768ec7-a861-4346-a3fd-5d8742628d42 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de244f1f82143a0b3d3283c31d80bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14c63df2e6c46d2af23b6b8a52690d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:04:49.740562 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-bd768ec7-a861-4346-a3fd-5d8742628d42 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] 10.222.0.58 "GET /compute/v2.1/servers/541591c5-62f9-489a-96e7-e7cbbbfc4e28" status: 200 len: 1313 microversion: 2.1 time: 0.424228 Aug 10 23:04:49.741201 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1034/2072] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:04:49 2022] GET /compute/v2.1/servers/541591c5-62f9-489a-96e7-e7cbbbfc4e28 => generated 1313 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:04:49.753185 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-29b3a2ae-5b0e-4a8c-b248-6067bbd55ffb tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:04:49.753782 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-29b3a2ae-5b0e-4a8c-b248-6067bbd55ffb tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] [instance: 9b8271c8-f9d7-48fc-b8ad-a50e71d3cec5] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:04:49.771853 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-29b3a2ae-5b0e-4a8c-b248-6067bbd55ffb tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:49.773146 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-29b3a2ae-5b0e-4a8c-b248-6067bbd55ffb tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:49.773606 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-29b3a2ae-5b0e-4a8c-b248-6067bbd55ffb tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:49.774337 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-29b3a2ae-5b0e-4a8c-b248-6067bbd55ffb tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:49.774816 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-29b3a2ae-5b0e-4a8c-b248-6067bbd55ffb tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:49.775870 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-29b3a2ae-5b0e-4a8c-b248-6067bbd55ffb tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:49.951940 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-b5d31d62-3549-4cfb-a063-1fe459766cff tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf1bcb51dec4134ac27ea7964684c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27408df8ea9f4d848b15b0bbba451a21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:04:49.964737 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-b5d31d62-3549-4cfb-a063-1fe459766cff tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] 10.222.0.58 "GET /compute/v2.1/servers/e822b468-16f3-4a20-94d9-7a2517802a92" status: 200 len: 1268 microversion: 2.1 time: 0.303360 Aug 10 23:04:49.965519 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1039/2073] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:04:49 2022] GET /compute/v2.1/servers/e822b468-16f3-4a20-94d9-7a2517802a92 => generated 1268 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:04:50.058287 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-de968cbe-3a21-45c3-8166-d59cf2b02526 tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:04:50.059280 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-de968cbe-3a21-45c3-8166-d59cf2b02526 tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] [instance: 153d30e2-3eed-4bba-b15b-ca82e6688dbe] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:04:50.086004 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-de968cbe-3a21-45c3-8166-d59cf2b02526 tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:50.086510 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-de968cbe-3a21-45c3-8166-d59cf2b02526 tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:50.087251 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-de968cbe-3a21-45c3-8166-d59cf2b02526 tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:50.088825 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-de968cbe-3a21-45c3-8166-d59cf2b02526 tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:50.090004 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-de968cbe-3a21-45c3-8166-d59cf2b02526 tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:50.091885 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-de968cbe-3a21-45c3-8166-d59cf2b02526 tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:50.255078 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-29b3a2ae-5b0e-4a8c-b248-6067bbd55ffb tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632904331d024d9b8e4d3660dff2cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ed0bdee3aa4013bd9219069bda558c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:04:50.277907 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-29b3a2ae-5b0e-4a8c-b248-6067bbd55ffb tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] 10.222.0.58 "GET /compute/v2.1/servers/9b8271c8-f9d7-48fc-b8ad-a50e71d3cec5" status: 200 len: 1484 microversion: 2.1 time: 0.529047 Aug 10 23:04:50.285212 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1035/2074] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:04:49 2022] GET /compute/v2.1/servers/9b8271c8-f9d7-48fc-b8ad-a50e71d3cec5 => generated 1484 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:04:50.546803 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-de968cbe-3a21-45c3-8166-d59cf2b02526 tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d2f8f63e9444fe8cf621d2f7c252bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04b07c6f0284e9bb36ba0030f4a31d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:04:50.566534 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-de968cbe-3a21-45c3-8166-d59cf2b02526 tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] 10.222.0.58 "GET /compute/v2.1/servers/153d30e2-3eed-4bba-b15b-ca82e6688dbe" status: 200 len: 1501 microversion: 2.1 time: 0.517865 Aug 10 23:04:50.567194 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1040/2075] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:04:50 2022] GET /compute/v2.1/servers/153d30e2-3eed-4bba-b15b-ca82e6688dbe => generated 1501 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:04:50.589909 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-4477058a-adae-4794-8906-c71ecc702d90 tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:04:50.590469 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-4477058a-adae-4794-8906-c71ecc702d90 tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] [instance: 153d30e2-3eed-4bba-b15b-ca82e6688dbe] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:04:50.594831 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:04:50.618373 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4477058a-adae-4794-8906-c71ecc702d90 tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:50.618908 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4477058a-adae-4794-8906-c71ecc702d90 tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:50.619416 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4477058a-adae-4794-8906-c71ecc702d90 tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:50.620140 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4477058a-adae-4794-8906-c71ecc702d90 tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:50.623230 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4477058a-adae-4794-8906-c71ecc702d90 tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:50.623780 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4477058a-adae-4794-8906-c71ecc702d90 tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:50.670701 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-4477058a-adae-4794-8906-c71ecc702d90 tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] [instance: 153d30e2-3eed-4bba-b15b-ca82e6688dbe] Going to try to terminate instance {{(pid=122633) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:04:50.683281 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-f8ff0e26-7b85-4872-8f29-6d5b9277cb03 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:04:50.687743 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-f8ff0e26-7b85-4872-8f29-6d5b9277cb03 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] [instance: 45beadf1-a6da-49ab-9098-6b681b5184c9] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:04:50.696166 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f8ff0e26-7b85-4872-8f29-6d5b9277cb03 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:50.709563 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f8ff0e26-7b85-4872-8f29-6d5b9277cb03 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:50.710822 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f8ff0e26-7b85-4872-8f29-6d5b9277cb03 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:50.712938 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f8ff0e26-7b85-4872-8f29-6d5b9277cb03 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:50.713718 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f8ff0e26-7b85-4872-8f29-6d5b9277cb03 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:50.714323 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f8ff0e26-7b85-4872-8f29-6d5b9277cb03 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:50.877272 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-4477058a-adae-4794-8906-c71ecc702d90 tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] 10.222.0.58 "DELETE /compute/v2.1/servers/153d30e2-3eed-4bba-b15b-ca82e6688dbe" status: 204 len: 0 microversion: 2.1 time: 0.292226 Aug 10 23:04:50.878196 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1036/2076] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:04:50 2022] DELETE /compute/v2.1/servers/153d30e2-3eed-4bba-b15b-ca82e6688dbe => generated 0 bytes in 294 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:04:50.885673 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-fdd57f3a-0bb5-401c-8913-3e38ce12fa33 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:04:50.886412 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-fdd57f3a-0bb5-401c-8913-3e38ce12fa33 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] [instance: 541591c5-62f9-489a-96e7-e7cbbbfc4e28] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:04:50.908011 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fdd57f3a-0bb5-401c-8913-3e38ce12fa33 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:50.908985 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fdd57f3a-0bb5-401c-8913-3e38ce12fa33 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:50.909756 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fdd57f3a-0bb5-401c-8913-3e38ce12fa33 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:50.910643 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fdd57f3a-0bb5-401c-8913-3e38ce12fa33 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:50.911341 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fdd57f3a-0bb5-401c-8913-3e38ce12fa33 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:50.911965 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fdd57f3a-0bb5-401c-8913-3e38ce12fa33 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:50.917781 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:04:51.380702 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-f8ff0e26-7b85-4872-8f29-6d5b9277cb03 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1986185dc9b4df4affcc421365462f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597863bfebdc481188f1f30095da5396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:04:51.394392 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-f8ff0e26-7b85-4872-8f29-6d5b9277cb03 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] 10.222.0.58 "GET /compute/v2.1/servers/45beadf1-a6da-49ab-9098-6b681b5184c9" status: 200 len: 1307 microversion: 2.1 time: 0.715406 Aug 10 23:04:51.410828 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1041/2077] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:04:50 2022] GET /compute/v2.1/servers/45beadf1-a6da-49ab-9098-6b681b5184c9 => generated 1307 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:04:51.412190 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-91f83bb2-925b-4dcf-a18a-fea1c4c21ffe tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:04:51.420424 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-91f83bb2-925b-4dcf-a18a-fea1c4c21ffe tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] [instance: 153d30e2-3eed-4bba-b15b-ca82e6688dbe] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:04:51.429536 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=1,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:04:51.451283 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-91f83bb2-925b-4dcf-a18a-fea1c4c21ffe tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:51.451729 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-91f83bb2-925b-4dcf-a18a-fea1c4c21ffe tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:51.452161 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-91f83bb2-925b-4dcf-a18a-fea1c4c21ffe tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:51.452884 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-91f83bb2-925b-4dcf-a18a-fea1c4c21ffe tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:51.453332 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-91f83bb2-925b-4dcf-a18a-fea1c4c21ffe tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:51.453750 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-91f83bb2-925b-4dcf-a18a-fea1c4c21ffe tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:51.687346 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-fdd57f3a-0bb5-401c-8913-3e38ce12fa33 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de244f1f82143a0b3d3283c31d80bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14c63df2e6c46d2af23b6b8a52690d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:04:51.697153 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-fdd57f3a-0bb5-401c-8913-3e38ce12fa33 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] 10.222.0.58 "GET /compute/v2.1/servers/541591c5-62f9-489a-96e7-e7cbbbfc4e28" status: 200 len: 1313 microversion: 2.1 time: 0.817137 Aug 10 23:04:51.697585 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1037/2078] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:04:50 2022] GET /compute/v2.1/servers/541591c5-62f9-489a-96e7-e7cbbbfc4e28 => generated 1313 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:04:51.725558 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c4acd1c9-e2ce-4b78-a84f-3802460def53 tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:04:51.726177 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-c4acd1c9-e2ce-4b78-a84f-3802460def53 tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] [instance: e822b468-16f3-4a20-94d9-7a2517802a92] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:04:51.742639 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c4acd1c9-e2ce-4b78-a84f-3802460def53 tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:51.743170 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c4acd1c9-e2ce-4b78-a84f-3802460def53 tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:51.743780 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c4acd1c9-e2ce-4b78-a84f-3802460def53 tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:51.744798 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c4acd1c9-e2ce-4b78-a84f-3802460def53 tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:51.745494 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c4acd1c9-e2ce-4b78-a84f-3802460def53 tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:51.745907 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c4acd1c9-e2ce-4b78-a84f-3802460def53 tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:52.066875 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-c4acd1c9-e2ce-4b78-a84f-3802460def53 tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf1bcb51dec4134ac27ea7964684c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27408df8ea9f4d848b15b0bbba451a21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:04:52.080135 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-c4acd1c9-e2ce-4b78-a84f-3802460def53 tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] 10.222.0.58 "GET /compute/v2.1/servers/e822b468-16f3-4a20-94d9-7a2517802a92" status: 200 len: 1338 microversion: 2.1 time: 0.358015 Aug 10 23:04:52.081117 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1038/2079] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:04:51 2022] GET /compute/v2.1/servers/e822b468-16f3-4a20-94d9-7a2517802a92 => generated 1338 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:04:52.089305 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-f9d4b49e-5e08-4cfc-afce-a86c552b26c6 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:04:52.090825 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-f9d4b49e-5e08-4cfc-afce-a86c552b26c6 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] [instance: 9b8271c8-f9d7-48fc-b8ad-a50e71d3cec5] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:04:52.109019 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f9d4b49e-5e08-4cfc-afce-a86c552b26c6 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:52.109717 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f9d4b49e-5e08-4cfc-afce-a86c552b26c6 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:52.110307 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f9d4b49e-5e08-4cfc-afce-a86c552b26c6 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:52.111439 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f9d4b49e-5e08-4cfc-afce-a86c552b26c6 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:52.112587 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f9d4b49e-5e08-4cfc-afce-a86c552b26c6 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:52.113977 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f9d4b49e-5e08-4cfc-afce-a86c552b26c6 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:52.169925 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f9d4b49e-5e08-4cfc-afce-a86c552b26c6 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:52.170498 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f9d4b49e-5e08-4cfc-afce-a86c552b26c6 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:52.171111 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f9d4b49e-5e08-4cfc-afce-a86c552b26c6 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:52.171787 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.objects.instance [None req-f9d4b49e-5e08-4cfc-afce-a86c552b26c6 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lazy-loading 'fault' on Instance uuid 9b8271c8-f9d7-48fc-b8ad-a50e71d3cec5 {{(pid=122633) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:04:52.202334 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-91f83bb2-925b-4dcf-a18a-fea1c4c21ffe tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d2f8f63e9444fe8cf621d2f7c252bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04b07c6f0284e9bb36ba0030f4a31d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:04:52.217859 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-91f83bb2-925b-4dcf-a18a-fea1c4c21ffe tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] 10.222.0.58 "GET /compute/v2.1/servers/153d30e2-3eed-4bba-b15b-ca82e6688dbe" status: 200 len: 1507 microversion: 2.1 time: 0.818622 Aug 10 23:04:52.230819 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1042/2080] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:04:51 2022] GET /compute/v2.1/servers/153d30e2-3eed-4bba-b15b-ca82e6688dbe => generated 1507 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:04:52.236780 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-5d11a81b-b4b4-4e4c-b06c-adae3d768308 req-f4e20988-9b6c-4200-8938-47187470b063 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b8271c8-f9d7-48fc-b8ad-a50e71d3cec5", "name": "network-vif-deleted", "tag": "1fc37ded-1174-48fe-96fd-658af446018b"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:04:52.257341 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-5d11a81b-b4b4-4e4c-b06c-adae3d768308 req-f4e20988-9b6c-4200-8938-47187470b063 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:52.257972 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-5d11a81b-b4b4-4e4c-b06c-adae3d768308 req-f4e20988-9b6c-4200-8938-47187470b063 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:52.258482 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-5d11a81b-b4b4-4e4c-b06c-adae3d768308 req-f4e20988-9b6c-4200-8938-47187470b063 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:52.275058 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-5d11a81b-b4b4-4e4c-b06c-adae3d768308 req-f4e20988-9b6c-4200-8938-47187470b063 service nova] Creating event network-vif-deleted:1fc37ded-1174-48fe-96fd-658af446018b for instance 9b8271c8-f9d7-48fc-b8ad-a50e71d3cec5 on n-h1-850468-14 Aug 10 23:04:52.280331 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-5d11a81b-b4b4-4e4c-b06c-adae3d768308 req-f4e20988-9b6c-4200-8938-47187470b063 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057004 Aug 10 23:04:52.284057 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1043/2081] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:04:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:04:52.295868 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-14cb88d0-de56-44c4-a6d6-f485750c544f req-51171bbe-684e-467a-9318-fb75416a4b73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3b3730c-1396-4ca6-9d9e-8a3104950324", "name": "network-vif-plugged", "status": "completed", "tag": "aee4dd1c-12e7-4581-960e-4729757cc898"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:04:52.315085 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-14cb88d0-de56-44c4-a6d6-f485750c544f req-51171bbe-684e-467a-9318-fb75416a4b73 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:52.315852 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-14cb88d0-de56-44c4-a6d6-f485750c544f req-51171bbe-684e-467a-9318-fb75416a4b73 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:52.316462 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-14cb88d0-de56-44c4-a6d6-f485750c544f req-51171bbe-684e-467a-9318-fb75416a4b73 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:52.330568 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-14cb88d0-de56-44c4-a6d6-f485750c544f req-51171bbe-684e-467a-9318-fb75416a4b73 service nova] Creating event network-vif-plugged:aee4dd1c-12e7-4581-960e-4729757cc898 for instance b3b3730c-1396-4ca6-9d9e-8a3104950324 on n-h1-850468-14 Aug 10 23:04:52.344972 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-14cb88d0-de56-44c4-a6d6-f485750c544f req-51171bbe-684e-467a-9318-fb75416a4b73 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059676 Aug 10 23:04:52.346447 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1044/2082] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:04:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:04:52.428324 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-14f446e4-421e-446e-85a0-c1abef671f7d tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:04:52.428953 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-14f446e4-421e-446e-85a0-c1abef671f7d tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] [instance: 45beadf1-a6da-49ab-9098-6b681b5184c9] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:04:52.439450 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-14f446e4-421e-446e-85a0-c1abef671f7d tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:52.440764 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-14f446e4-421e-446e-85a0-c1abef671f7d tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:52.442557 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-14f446e4-421e-446e-85a0-c1abef671f7d tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:52.443746 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-14f446e4-421e-446e-85a0-c1abef671f7d tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:52.444366 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-14f446e4-421e-446e-85a0-c1abef671f7d tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:52.444962 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-14f446e4-421e-446e-85a0-c1abef671f7d tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:52.584506 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-f9d4b49e-5e08-4cfc-afce-a86c552b26c6 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632904331d024d9b8e4d3660dff2cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ed0bdee3aa4013bd9219069bda558c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:04:52.593107 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-f9d4b49e-5e08-4cfc-afce-a86c552b26c6 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] 10.222.0.58 "GET /compute/v2.1/servers/9b8271c8-f9d7-48fc-b8ad-a50e71d3cec5" status: 200 len: 1300 microversion: 2.1 time: 0.509492 Aug 10 23:04:52.595676 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1039/2083] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:04:52 2022] GET /compute/v2.1/servers/9b8271c8-f9d7-48fc-b8ad-a50e71d3cec5 => generated 1300 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:04:52.722655 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-861e62e3-32aa-4946-b023-73a29440ae8b tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:04:52.724721 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-861e62e3-32aa-4946-b023-73a29440ae8b tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] [instance: 541591c5-62f9-489a-96e7-e7cbbbfc4e28] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:04:52.735620 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-861e62e3-32aa-4946-b023-73a29440ae8b tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:52.737356 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-861e62e3-32aa-4946-b023-73a29440ae8b tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:52.738065 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-861e62e3-32aa-4946-b023-73a29440ae8b tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:52.739654 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-861e62e3-32aa-4946-b023-73a29440ae8b tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:52.740339 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-861e62e3-32aa-4946-b023-73a29440ae8b tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:52.741493 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-861e62e3-32aa-4946-b023-73a29440ae8b tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:52.939489 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-14f446e4-421e-446e-85a0-c1abef671f7d tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1986185dc9b4df4affcc421365462f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597863bfebdc481188f1f30095da5396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:04:52.966485 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-14f446e4-421e-446e-85a0-c1abef671f7d tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] 10.222.0.58 "GET /compute/v2.1/servers/45beadf1-a6da-49ab-9098-6b681b5184c9" status: 200 len: 1295 microversion: 2.1 time: 0.542008 Aug 10 23:04:52.967971 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1045/2084] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:04:52 2022] GET /compute/v2.1/servers/45beadf1-a6da-49ab-9098-6b681b5184c9 => generated 1295 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:04:53.122465 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-0335c836-d93c-4dda-92b2-44c38ecf2311 tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:04:53.125372 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-0335c836-d93c-4dda-92b2-44c38ecf2311 tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] [instance: e822b468-16f3-4a20-94d9-7a2517802a92] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:04:53.153956 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0335c836-d93c-4dda-92b2-44c38ecf2311 tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:53.155344 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0335c836-d93c-4dda-92b2-44c38ecf2311 tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:53.156002 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0335c836-d93c-4dda-92b2-44c38ecf2311 tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:53.157453 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0335c836-d93c-4dda-92b2-44c38ecf2311 tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:53.158099 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0335c836-d93c-4dda-92b2-44c38ecf2311 tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:53.159003 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0335c836-d93c-4dda-92b2-44c38ecf2311 tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:53.187956 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-861e62e3-32aa-4946-b023-73a29440ae8b tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de244f1f82143a0b3d3283c31d80bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14c63df2e6c46d2af23b6b8a52690d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:04:53.196313 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-861e62e3-32aa-4946-b023-73a29440ae8b tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] 10.222.0.58 "GET /compute/v2.1/servers/541591c5-62f9-489a-96e7-e7cbbbfc4e28" status: 200 len: 1313 microversion: 2.1 time: 0.481023 Aug 10 23:04:53.204588 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1040/2085] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:04:52 2022] GET /compute/v2.1/servers/541591c5-62f9-489a-96e7-e7cbbbfc4e28 => generated 1313 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:04:53.246762 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-4c4200a3-080f-4915-bc8f-5bd6ba2a5bba tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:04:53.247560 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-4c4200a3-080f-4915-bc8f-5bd6ba2a5bba tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] [instance: 153d30e2-3eed-4bba-b15b-ca82e6688dbe] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:04:53.255824 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4c4200a3-080f-4915-bc8f-5bd6ba2a5bba tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:53.257115 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4c4200a3-080f-4915-bc8f-5bd6ba2a5bba tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:53.257634 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4c4200a3-080f-4915-bc8f-5bd6ba2a5bba tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:53.258873 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4c4200a3-080f-4915-bc8f-5bd6ba2a5bba tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:53.259398 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4c4200a3-080f-4915-bc8f-5bd6ba2a5bba tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:53.260859 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4c4200a3-080f-4915-bc8f-5bd6ba2a5bba tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:53.424015 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-0335c836-d93c-4dda-92b2-44c38ecf2311 tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf1bcb51dec4134ac27ea7964684c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27408df8ea9f4d848b15b0bbba451a21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:04:53.444671 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-0335c836-d93c-4dda-92b2-44c38ecf2311 tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] 10.222.0.58 "GET /compute/v2.1/servers/e822b468-16f3-4a20-94d9-7a2517802a92" status: 200 len: 1326 microversion: 2.1 time: 0.337679 Aug 10 23:04:53.445588 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1046/2086] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:04:53 2022] GET /compute/v2.1/servers/e822b468-16f3-4a20-94d9-7a2517802a92 => generated 1326 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:04:53.620822 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-cc3a94c9-a687-4479-b1db-63e309ee4608 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:04:53.621753 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-cc3a94c9-a687-4479-b1db-63e309ee4608 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] [instance: 9b8271c8-f9d7-48fc-b8ad-a50e71d3cec5] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:04:53.639065 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cc3a94c9-a687-4479-b1db-63e309ee4608 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:53.641160 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cc3a94c9-a687-4479-b1db-63e309ee4608 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:53.643274 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cc3a94c9-a687-4479-b1db-63e309ee4608 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:53.645858 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cc3a94c9-a687-4479-b1db-63e309ee4608 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:53.647316 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cc3a94c9-a687-4479-b1db-63e309ee4608 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:53.661995 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cc3a94c9-a687-4479-b1db-63e309ee4608 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:53.665062 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-4c4200a3-080f-4915-bc8f-5bd6ba2a5bba tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d2f8f63e9444fe8cf621d2f7c252bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04b07c6f0284e9bb36ba0030f4a31d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:04:53.680858 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-4c4200a3-080f-4915-bc8f-5bd6ba2a5bba tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] 10.222.0.58 "GET /compute/v2.1/servers/153d30e2-3eed-4bba-b15b-ca82e6688dbe" status: 200 len: 1507 microversion: 2.1 time: 0.440366 Aug 10 23:04:53.681421 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1041/2087] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:04:53 2022] GET /compute/v2.1/servers/153d30e2-3eed-4bba-b15b-ca82e6688dbe => generated 1507 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:04:53.688034 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-cc3a94c9-a687-4479-b1db-63e309ee4608 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] HTTP exception thrown: Instance 9b8271c8-f9d7-48fc-b8ad-a50e71d3cec5 could not be found. Aug 10 23:04:53.691242 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-cc3a94c9-a687-4479-b1db-63e309ee4608 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Request method failure captured: Aug 10 23:04:53.691242 n-d-850468-14 devstack@n-api.service[122632]: request: GET /compute/v2.1/servers/9b8271c8-f9d7-48fc-b8ad-a50e71d3cec5 HTTP/1.1 Aug 10 23:04:53.691242 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:04:53.691242 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:04:53.691242 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:04:53.691242 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 23:04:53.691242 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:04:53.691242 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:04:53.691242 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:04:53.691242 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:04:53.691242 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9DfOEywB9oeD_C2SwugHriPH6QPax3SubHvct868zap6PD9BiLAj3q-t9YA3Fiw0HKhahbZB4KIKKcaf61C3Wt-lqKMWkeMB0U5Hy-b51nFx374XbUqtnrhL-_0NpcyHXThCK21eb7hc3wOrIDMIf5OvLiBpImI0ZmmFDD5V_kdMRpY Aug 10 23:04:53.691242 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:04:53.691242 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:04:53.691242 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:04:53.691242 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:04:53.691242 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:04:53.691242 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:04:53.691242 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 56ed0bdee3aa4013bd9219069bda558c Aug 10 23:04:53.691242 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-LiveMigrationTest-2043915664 Aug 10 23:04:53.691242 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:04:53.691242 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:04:53.692454 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/56ed0bdee3aa4013bd9219069bda558c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/56ed0bdee3aa4013bd9219069bda558c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/56ed0bdee3aa4013bd9219069bda558c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_56ed0bdee3aa4013bd9219069bda558c", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:04:53.692454 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-LiveMigrationTest-2043915664 Aug 10 23:04:53.692454 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 56ed0bdee3aa4013bd9219069bda558c Aug 10 23:04:53.692454 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-LiveMigrationTest-2043915664 Aug 10 23:04:53.692454 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-LiveMigrationTest-2043915664-project Aug 10 23:04:53.692454 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:04:53.692454 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:04:53.692454 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: 632904331d024d9b8e4d3660dff2cdf3 Aug 10 23:04:53.692454 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-LiveMigrationTest-2043915664-project Aug 10 23:04:53.692454 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:04:53.692454 n-d-850468-14 devstack@n-api.service[122632]: exception: Instance 9b8271c8-f9d7-48fc-b8ad-a50e71d3cec5 could not be found. Aug 10 23:04:53.692454 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': '9b8271c8-f9d7-48fc-b8ad-a50e71d3cec5'} Aug 10 23:04:53.693101 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:04:53.693101 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:04:53.693101 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:04:53.693101 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:04:53.693101 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:04:53.693101 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:04:53.693101 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:04:53.693101 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:04:53.693101 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:04:53.693101 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:04:53.693101 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b8271c8-f9d7-48fc-b8ad-a50e71d3cec5 could not be found. Aug 10 23:04:53.693101 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:04:53.693101 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:04:53.693101 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:04:53.693101 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:04:53.693101 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:04:53.693101 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:04:53.693101 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:04:53.693101 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:04:53.693101 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:04:53.694185 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:04:53.694185 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:04:53.694185 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:04:53.694185 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:04:53.694185 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:04:53.694185 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:04:53.694185 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:04:53.694185 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b8271c8-f9d7-48fc-b8ad-a50e71d3cec5 could not be found. Aug 10 23:04:53.694185 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:04:53.694185 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:04:53.694185 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:04:53.694185 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:04:53.694185 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:04:53.694185 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:04:53.694185 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:04:53.694185 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:04:53.694185 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b8271c8-f9d7-48fc-b8ad-a50e71d3cec5 could not be found. Aug 10 23:04:53.694185 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:04:53.700827 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-cc3a94c9-a687-4479-b1db-63e309ee4608 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Returning 404 to user: Instance 9b8271c8-f9d7-48fc-b8ad-a50e71d3cec5 could not be found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:04:53.702257 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-cc3a94c9-a687-4479-b1db-63e309ee4608 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] 10.222.0.58 "GET /compute/v2.1/servers/9b8271c8-f9d7-48fc-b8ad-a50e71d3cec5" status: 404 len: 111 microversion: 2.1 time: 0.089050 Aug 10 23:04:53.703169 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1047/2088] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:04:53 2022] GET /compute/v2.1/servers/9b8271c8-f9d7-48fc-b8ad-a50e71d3cec5 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 10 23:04:53.713142 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-8051e8bd-898e-49d3-aa3a-38bb15b59704 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:04:53.713658 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-8051e8bd-898e-49d3-aa3a-38bb15b59704 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] [instance: 47f49c52-08b0-469c-8969-c9655c6ee39b] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:04:53.721143 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8051e8bd-898e-49d3-aa3a-38bb15b59704 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:53.721645 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8051e8bd-898e-49d3-aa3a-38bb15b59704 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:53.722095 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8051e8bd-898e-49d3-aa3a-38bb15b59704 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:53.722885 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8051e8bd-898e-49d3-aa3a-38bb15b59704 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:53.723421 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8051e8bd-898e-49d3-aa3a-38bb15b59704 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:53.723743 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8051e8bd-898e-49d3-aa3a-38bb15b59704 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:53.755370 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-8051e8bd-898e-49d3-aa3a-38bb15b59704 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] [instance: 47f49c52-08b0-469c-8969-c9655c6ee39b] Going to try to terminate instance {{(pid=122633) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:04:53.909644 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-8051e8bd-898e-49d3-aa3a-38bb15b59704 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] 10.222.0.58 "DELETE /compute/v2.1/servers/47f49c52-08b0-469c-8969-c9655c6ee39b" status: 204 len: 0 microversion: 2.1 time: 0.200651 Aug 10 23:04:53.911639 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1042/2089] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:04:53 2022] DELETE /compute/v2.1/servers/47f49c52-08b0-469c-8969-c9655c6ee39b => generated 0 bytes in 204 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:04:53.925673 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-6fa05e19-ffe6-40b9-b1f7-b72da27f66e0 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:04:53.928669 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-6fa05e19-ffe6-40b9-b1f7-b72da27f66e0 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] [instance: 47f49c52-08b0-469c-8969-c9655c6ee39b] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:04:53.945326 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6fa05e19-ffe6-40b9-b1f7-b72da27f66e0 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:53.947380 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6fa05e19-ffe6-40b9-b1f7-b72da27f66e0 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:53.948166 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6fa05e19-ffe6-40b9-b1f7-b72da27f66e0 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:53.949939 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6fa05e19-ffe6-40b9-b1f7-b72da27f66e0 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:53.950623 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6fa05e19-ffe6-40b9-b1f7-b72da27f66e0 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:53.951412 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6fa05e19-ffe6-40b9-b1f7-b72da27f66e0 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:53.990099 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-f85eb60e-142d-4537-8c31-93bf8a25e68c tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:04:53.991343 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-f85eb60e-142d-4537-8c31-93bf8a25e68c tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] [instance: 45beadf1-a6da-49ab-9098-6b681b5184c9] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:04:54.010724 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f85eb60e-142d-4537-8c31-93bf8a25e68c tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:54.011332 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f85eb60e-142d-4537-8c31-93bf8a25e68c tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:54.013213 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f85eb60e-142d-4537-8c31-93bf8a25e68c tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:54.014194 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f85eb60e-142d-4537-8c31-93bf8a25e68c tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:54.025881 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f85eb60e-142d-4537-8c31-93bf8a25e68c tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:54.030574 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f85eb60e-142d-4537-8c31-93bf8a25e68c tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:54.405766 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-6fa05e19-ffe6-40b9-b1f7-b72da27f66e0 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632904331d024d9b8e4d3660dff2cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ed0bdee3aa4013bd9219069bda558c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:04:54.420005 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-6fa05e19-ffe6-40b9-b1f7-b72da27f66e0 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] 10.222.0.58 "GET /compute/v2.1/servers/47f49c52-08b0-469c-8969-c9655c6ee39b" status: 200 len: 1500 microversion: 2.1 time: 0.502048 Aug 10 23:04:54.420588 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1048/2090] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:04:53 2022] GET /compute/v2.1/servers/47f49c52-08b0-469c-8969-c9655c6ee39b => generated 1500 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:04:54.431936 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-1f887c88-d6c7-4824-ae83-e2c06b3a0eef tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:04:54.433297 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-1f887c88-d6c7-4824-ae83-e2c06b3a0eef tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] [instance: 541591c5-62f9-489a-96e7-e7cbbbfc4e28] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:04:54.445507 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1f887c88-d6c7-4824-ae83-e2c06b3a0eef tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:54.447999 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1f887c88-d6c7-4824-ae83-e2c06b3a0eef tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:54.455738 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1f887c88-d6c7-4824-ae83-e2c06b3a0eef tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:54.456712 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1f887c88-d6c7-4824-ae83-e2c06b3a0eef tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:54.457377 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1f887c88-d6c7-4824-ae83-e2c06b3a0eef tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:54.458224 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1f887c88-d6c7-4824-ae83-e2c06b3a0eef tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:54.536464 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-f85eb60e-142d-4537-8c31-93bf8a25e68c tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1986185dc9b4df4affcc421365462f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597863bfebdc481188f1f30095da5396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:04:54.546860 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-f85eb60e-142d-4537-8c31-93bf8a25e68c tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] 10.222.0.58 "GET /compute/v2.1/servers/45beadf1-a6da-49ab-9098-6b681b5184c9" status: 200 len: 1363 microversion: 2.1 time: 0.561845 Aug 10 23:04:54.547931 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1043/2091] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:04:53 2022] GET /compute/v2.1/servers/45beadf1-a6da-49ab-9098-6b681b5184c9 => generated 1363 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:04:54.575573 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-77e72be8-9109-4421-a9a4-9d599ac94129 req-ea33dabb-5eb8-4da9-bc67-57e17036e629 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "541591c5-62f9-489a-96e7-e7cbbbfc4e28", "name": "network-vif-plugged", "status": "completed", "tag": "1e288590-eb74-4df3-ad37-16250a74ba4e"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:04:54.630853 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-77e72be8-9109-4421-a9a4-9d599ac94129 req-ea33dabb-5eb8-4da9-bc67-57e17036e629 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:54.635950 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-77e72be8-9109-4421-a9a4-9d599ac94129 req-ea33dabb-5eb8-4da9-bc67-57e17036e629 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:54.637879 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-77e72be8-9109-4421-a9a4-9d599ac94129 req-ea33dabb-5eb8-4da9-bc67-57e17036e629 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:54.691525 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-77e72be8-9109-4421-a9a4-9d599ac94129 req-ea33dabb-5eb8-4da9-bc67-57e17036e629 service nova] Creating event network-vif-plugged:1e288590-eb74-4df3-ad37-16250a74ba4e for instance 541591c5-62f9-489a-96e7-e7cbbbfc4e28 on n-h2-850468-14 Aug 10 23:04:54.709252 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-77e72be8-9109-4421-a9a4-9d599ac94129 req-ea33dabb-5eb8-4da9-bc67-57e17036e629 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.160066 Aug 10 23:04:54.717609 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1044/2092] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:04:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:04:54.751720 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-1b2f77ee-86ea-4e80-a783-dfb7d9733360 tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:04:54.759185 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-1b2f77ee-86ea-4e80-a783-dfb7d9733360 tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] [instance: e822b468-16f3-4a20-94d9-7a2517802a92] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:04:54.787276 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1b2f77ee-86ea-4e80-a783-dfb7d9733360 tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:54.787837 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1b2f77ee-86ea-4e80-a783-dfb7d9733360 tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:54.788290 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1b2f77ee-86ea-4e80-a783-dfb7d9733360 tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:54.789033 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1b2f77ee-86ea-4e80-a783-dfb7d9733360 tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:54.789485 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1b2f77ee-86ea-4e80-a783-dfb7d9733360 tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:54.797799 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1b2f77ee-86ea-4e80-a783-dfb7d9733360 tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:55.399586 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-1f887c88-d6c7-4824-ae83-e2c06b3a0eef tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de244f1f82143a0b3d3283c31d80bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14c63df2e6c46d2af23b6b8a52690d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:04:55.411063 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-1f887c88-d6c7-4824-ae83-e2c06b3a0eef tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] 10.222.0.58 "GET /compute/v2.1/servers/541591c5-62f9-489a-96e7-e7cbbbfc4e28" status: 200 len: 1313 microversion: 2.1 time: 0.989040 Aug 10 23:04:55.414695 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1049/2093] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:04:54 2022] GET /compute/v2.1/servers/541591c5-62f9-489a-96e7-e7cbbbfc4e28 => generated 1313 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:04:55.426685 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-a86226cf-e57d-4722-bfc6-911afe4059cb tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:04:55.430095 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-a86226cf-e57d-4722-bfc6-911afe4059cb tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] [instance: 153d30e2-3eed-4bba-b15b-ca82e6688dbe] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:04:55.455958 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a86226cf-e57d-4722-bfc6-911afe4059cb tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:55.457575 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a86226cf-e57d-4722-bfc6-911afe4059cb tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:55.458207 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a86226cf-e57d-4722-bfc6-911afe4059cb tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:55.459531 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a86226cf-e57d-4722-bfc6-911afe4059cb tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:55.460224 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a86226cf-e57d-4722-bfc6-911afe4059cb tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:55.461331 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a86226cf-e57d-4722-bfc6-911afe4059cb tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:55.476319 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-1b2f77ee-86ea-4e80-a783-dfb7d9733360 tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf1bcb51dec4134ac27ea7964684c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27408df8ea9f4d848b15b0bbba451a21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:04:55.486943 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-1b2f77ee-86ea-4e80-a783-dfb7d9733360 tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] 10.222.0.58 "GET /compute/v2.1/servers/e822b468-16f3-4a20-94d9-7a2517802a92" status: 200 len: 1392 microversion: 2.1 time: 0.754767 Aug 10 23:04:55.492124 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1045/2094] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:04:54 2022] GET /compute/v2.1/servers/e822b468-16f3-4a20-94d9-7a2517802a92 => generated 1392 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:04:55.498139 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-ad630cd8-828e-42f8-9677-911bc6539a3c tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:04:55.507447 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-ad630cd8-828e-42f8-9677-911bc6539a3c tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] [instance: 47f49c52-08b0-469c-8969-c9655c6ee39b] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:04:55.535503 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ad630cd8-828e-42f8-9677-911bc6539a3c tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:55.537863 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ad630cd8-828e-42f8-9677-911bc6539a3c tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:55.547536 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ad630cd8-828e-42f8-9677-911bc6539a3c tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:55.548540 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ad630cd8-828e-42f8-9677-911bc6539a3c tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:55.549153 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ad630cd8-828e-42f8-9677-911bc6539a3c tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:55.549725 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ad630cd8-828e-42f8-9677-911bc6539a3c tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:55.796998 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-a86226cf-e57d-4722-bfc6-911afe4059cb tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4d2f8f63e9444fe8cf621d2f7c252bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c04b07c6f0284e9bb36ba0030f4a31d2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:04:55.809532 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-a86226cf-e57d-4722-bfc6-911afe4059cb tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] 10.222.0.58 "GET /compute/v2.1/servers/153d30e2-3eed-4bba-b15b-ca82e6688dbe" status: 200 len: 1299 microversion: 2.1 time: 0.391237 Aug 10 23:04:55.812205 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1050/2095] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:04:55 2022] GET /compute/v2.1/servers/153d30e2-3eed-4bba-b15b-ca82e6688dbe => generated 1299 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:04:55.817608 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-81a31ad1-af1c-4eb7-9ff2-cdab32cf50b6 req-e4d231e2-c2fb-4f5c-ae56-92945fb4f4c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "153d30e2-3eed-4bba-b15b-ca82e6688dbe", "name": "network-vif-deleted", "tag": "9be2d009-04de-4d66-bd2d-b90c4c4a5270"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:04:55.858133 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-81a31ad1-af1c-4eb7-9ff2-cdab32cf50b6 req-e4d231e2-c2fb-4f5c-ae56-92945fb4f4c6 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:55.858616 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-81a31ad1-af1c-4eb7-9ff2-cdab32cf50b6 req-e4d231e2-c2fb-4f5c-ae56-92945fb4f4c6 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:55.859067 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-81a31ad1-af1c-4eb7-9ff2-cdab32cf50b6 req-e4d231e2-c2fb-4f5c-ae56-92945fb4f4c6 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:55.886614 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-81a31ad1-af1c-4eb7-9ff2-cdab32cf50b6 req-e4d231e2-c2fb-4f5c-ae56-92945fb4f4c6 service nova] Creating event network-vif-deleted:9be2d009-04de-4d66-bd2d-b90c4c4a5270 for instance 153d30e2-3eed-4bba-b15b-ca82e6688dbe on n-h1-850468-14 Aug 10 23:04:55.894805 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-81a31ad1-af1c-4eb7-9ff2-cdab32cf50b6 req-e4d231e2-c2fb-4f5c-ae56-92945fb4f4c6 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080666 Aug 10 23:04:55.895968 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1051/2096] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:04:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:04:55.912383 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-453b4978-5c43-4416-8b96-20fe7f6b4246 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:04:55.913510 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-453b4978-5c43-4416-8b96-20fe7f6b4246 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] [instance: 45beadf1-a6da-49ab-9098-6b681b5184c9] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:04:55.937223 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-453b4978-5c43-4416-8b96-20fe7f6b4246 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:55.938063 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-453b4978-5c43-4416-8b96-20fe7f6b4246 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:55.943090 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-453b4978-5c43-4416-8b96-20fe7f6b4246 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:55.944154 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-453b4978-5c43-4416-8b96-20fe7f6b4246 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:55.944873 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-453b4978-5c43-4416-8b96-20fe7f6b4246 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:55.945503 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-453b4978-5c43-4416-8b96-20fe7f6b4246 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:56.344670 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-ad630cd8-828e-42f8-9677-911bc6539a3c tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632904331d024d9b8e4d3660dff2cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ed0bdee3aa4013bd9219069bda558c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:04:56.353443 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-ad630cd8-828e-42f8-9677-911bc6539a3c tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] 10.222.0.58 "GET /compute/v2.1/servers/47f49c52-08b0-469c-8969-c9655c6ee39b" status: 200 len: 1500 microversion: 2.1 time: 0.859872 Aug 10 23:04:56.357180 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1046/2097] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:04:55 2022] GET /compute/v2.1/servers/47f49c52-08b0-469c-8969-c9655c6ee39b => generated 1500 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:04:56.437148 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-b228b40f-645f-4d8f-b5f0-7711bebd2ed5 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:04:56.437961 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-b228b40f-645f-4d8f-b5f0-7711bebd2ed5 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] [instance: 541591c5-62f9-489a-96e7-e7cbbbfc4e28] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:04:56.446712 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b228b40f-645f-4d8f-b5f0-7711bebd2ed5 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:56.447288 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b228b40f-645f-4d8f-b5f0-7711bebd2ed5 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:56.447781 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b228b40f-645f-4d8f-b5f0-7711bebd2ed5 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:56.448529 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b228b40f-645f-4d8f-b5f0-7711bebd2ed5 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:56.448985 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b228b40f-645f-4d8f-b5f0-7711bebd2ed5 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:56.450016 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b228b40f-645f-4d8f-b5f0-7711bebd2ed5 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:56.897972 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-453b4978-5c43-4416-8b96-20fe7f6b4246 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1986185dc9b4df4affcc421365462f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597863bfebdc481188f1f30095da5396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:04:56.910080 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:04:56.929611 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-453b4978-5c43-4416-8b96-20fe7f6b4246 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] 10.222.0.58 "GET /compute/v2.1/servers/45beadf1-a6da-49ab-9098-6b681b5184c9" status: 200 len: 1363 microversion: 2.1 time: 1.031931 Aug 10 23:04:56.937990 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1052/2098] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:04:55 2022] GET /compute/v2.1/servers/45beadf1-a6da-49ab-9098-6b681b5184c9 => generated 1363 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:04:56.951290 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-27ca60a5-0511-4ba2-ab9f-5833fca5bc5a tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:04:56.955582 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-27ca60a5-0511-4ba2-ab9f-5833fca5bc5a tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] [instance: e822b468-16f3-4a20-94d9-7a2517802a92] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:04:56.970575 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-27ca60a5-0511-4ba2-ab9f-5833fca5bc5a tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:56.971505 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-27ca60a5-0511-4ba2-ab9f-5833fca5bc5a tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:56.972849 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-27ca60a5-0511-4ba2-ab9f-5833fca5bc5a tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:56.973931 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-27ca60a5-0511-4ba2-ab9f-5833fca5bc5a tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:56.975395 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-27ca60a5-0511-4ba2-ab9f-5833fca5bc5a tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:56.976189 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-27ca60a5-0511-4ba2-ab9f-5833fca5bc5a tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:57.333036 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-b228b40f-645f-4d8f-b5f0-7711bebd2ed5 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de244f1f82143a0b3d3283c31d80bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14c63df2e6c46d2af23b6b8a52690d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:04:57.345386 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-b228b40f-645f-4d8f-b5f0-7711bebd2ed5 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] 10.222.0.58 "GET /compute/v2.1/servers/541591c5-62f9-489a-96e7-e7cbbbfc4e28" status: 200 len: 1313 microversion: 2.1 time: 0.913375 Aug 10 23:04:57.357051 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1047/2099] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:04:56 2022] GET /compute/v2.1/servers/541591c5-62f9-489a-96e7-e7cbbbfc4e28 => generated 1313 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:04:57.364145 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-442ff6ad-7632-44bb-892b-164c379394f1 tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:04:57.364857 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-442ff6ad-7632-44bb-892b-164c379394f1 tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] [instance: 153d30e2-3eed-4bba-b15b-ca82e6688dbe] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:04:57.374073 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-442ff6ad-7632-44bb-892b-164c379394f1 tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:57.374732 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-442ff6ad-7632-44bb-892b-164c379394f1 tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:57.375662 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-442ff6ad-7632-44bb-892b-164c379394f1 tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:57.376697 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-442ff6ad-7632-44bb-892b-164c379394f1 tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:57.377578 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-442ff6ad-7632-44bb-892b-164c379394f1 tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:57.378254 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-442ff6ad-7632-44bb-892b-164c379394f1 tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:57.396434 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-442ff6ad-7632-44bb-892b-164c379394f1 tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] HTTP exception thrown: Instance 153d30e2-3eed-4bba-b15b-ca82e6688dbe could not be found. Aug 10 23:04:57.398242 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-442ff6ad-7632-44bb-892b-164c379394f1 tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Request method failure captured: Aug 10 23:04:57.398242 n-d-850468-14 devstack@n-api.service[122633]: request: GET /compute/v2.1/servers/153d30e2-3eed-4bba-b15b-ca82e6688dbe HTTP/1.1 Aug 10 23:04:57.398242 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:04:57.398242 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:04:57.398242 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:04:57.398242 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:04:57.398242 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:04:57.398242 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:04:57.398242 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:04:57.398242 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:04:57.398242 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9Dl2bliDBRJnkL1a_LEG8Vs4lNFE4681leyy9A95PKolEtK7biHybKu6KRoAGpg7N7EYuiJtqBlEJaaFMLuvgkk3uRv-K9ZoxSKlILE78RphdLg3QKo0-jpnE6Q9YLANb5fkkf9CRcgjez5z27Jwf0e7icY502I62-3NbeoaZaLPoBY Aug 10 23:04:57.398242 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:04:57.398242 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:04:57.398242 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:04:57.398242 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:04:57.398242 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:04:57.398242 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:04:57.398242 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: c04b07c6f0284e9bb36ba0030f4a31d2 Aug 10 23:04:57.398242 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-ImagesNegativeTestJSON-286442712 Aug 10 23:04:57.398242 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:04:57.398242 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:04:57.399411 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c04b07c6f0284e9bb36ba0030f4a31d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c04b07c6f0284e9bb36ba0030f4a31d2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/c04b07c6f0284e9bb36ba0030f4a31d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_c04b07c6f0284e9bb36ba0030f4a31d2", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:04:57.399411 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-ImagesNegativeTestJSON-286442712 Aug 10 23:04:57.399411 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: c04b07c6f0284e9bb36ba0030f4a31d2 Aug 10 23:04:57.399411 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-286442712 Aug 10 23:04:57.399411 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-ImagesNegativeTestJSON-286442712-project Aug 10 23:04:57.399411 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:04:57.399411 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:04:57.399411 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: f4d2f8f63e9444fe8cf621d2f7c252bd Aug 10 23:04:57.399411 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-ImagesNegativeTestJSON-286442712-project Aug 10 23:04:57.399411 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:04:57.399411 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance 153d30e2-3eed-4bba-b15b-ca82e6688dbe could not be found. Aug 10 23:04:57.399411 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': '153d30e2-3eed-4bba-b15b-ca82e6688dbe'} Aug 10 23:04:57.400117 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:04:57.400117 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:04:57.400117 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:04:57.400117 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:04:57.400117 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:04:57.400117 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:04:57.400117 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:04:57.400117 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:04:57.400117 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:04:57.400117 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:04:57.400117 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 153d30e2-3eed-4bba-b15b-ca82e6688dbe could not be found. Aug 10 23:04:57.400117 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:04:57.400117 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:04:57.400117 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:04:57.400117 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:04:57.400117 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:04:57.400117 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:04:57.400117 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:04:57.400117 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:04:57.400117 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:04:57.404592 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:04:57.404592 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:04:57.404592 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:04:57.404592 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:04:57.404592 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:04:57.404592 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:04:57.404592 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:04:57.404592 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 153d30e2-3eed-4bba-b15b-ca82e6688dbe could not be found. Aug 10 23:04:57.404592 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:04:57.404592 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:04:57.404592 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:04:57.404592 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:04:57.404592 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:04:57.404592 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:04:57.404592 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:04:57.404592 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:04:57.404592 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 153d30e2-3eed-4bba-b15b-ca82e6688dbe could not be found. Aug 10 23:04:57.404592 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:04:57.406868 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-442ff6ad-7632-44bb-892b-164c379394f1 tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Returning 404 to user: Instance 153d30e2-3eed-4bba-b15b-ca82e6688dbe could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:04:57.406868 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-442ff6ad-7632-44bb-892b-164c379394f1 tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] 10.222.0.58 "GET /compute/v2.1/servers/153d30e2-3eed-4bba-b15b-ca82e6688dbe" status: 404 len: 111 microversion: 2.1 time: 0.041519 Aug 10 23:04:57.406868 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1048/2100] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:04:57 2022] GET /compute/v2.1/servers/153d30e2-3eed-4bba-b15b-ca82e6688dbe => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:04:57.411624 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-1feee248-0ec8-4754-b939-01228842bf64 req-3b094d0f-d7e6-487e-a0bb-5846d4da3dbc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e822b468-16f3-4a20-94d9-7a2517802a92", "tag": "975c2c0f-d400-4824-a681-225263ddf461"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:04:57.423050 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-27ca60a5-0511-4ba2-ab9f-5833fca5bc5a tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf1bcb51dec4134ac27ea7964684c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27408df8ea9f4d848b15b0bbba451a21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:04:57.429113 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-1feee248-0ec8-4754-b939-01228842bf64 req-3b094d0f-d7e6-487e-a0bb-5846d4da3dbc service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:57.430057 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-1feee248-0ec8-4754-b939-01228842bf64 req-3b094d0f-d7e6-487e-a0bb-5846d4da3dbc service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:57.431127 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-1feee248-0ec8-4754-b939-01228842bf64 req-3b094d0f-d7e6-487e-a0bb-5846d4da3dbc service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:57.439604 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-27ca60a5-0511-4ba2-ab9f-5833fca5bc5a tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] 10.222.0.58 "GET /compute/v2.1/servers/e822b468-16f3-4a20-94d9-7a2517802a92" status: 200 len: 1392 microversion: 2.1 time: 0.498682 Aug 10 23:04:57.450809 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1053/2101] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:04:56 2022] GET /compute/v2.1/servers/e822b468-16f3-4a20-94d9-7a2517802a92 => generated 1392 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:04:57.451108 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-1feee248-0ec8-4754-b939-01228842bf64 req-3b094d0f-d7e6-487e-a0bb-5846d4da3dbc service nova] Creating event network-changed:975c2c0f-d400-4824-a681-225263ddf461 for instance e822b468-16f3-4a20-94d9-7a2517802a92 on n-h2-850468-14 Aug 10 23:04:57.456539 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-3197f8d2-dbc8-421a-a5f0-8f8a686267e3 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:04:57.456539 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-3197f8d2-dbc8-421a-a5f0-8f8a686267e3 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] [instance: 47f49c52-08b0-469c-8969-c9655c6ee39b] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:04:57.462306 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-1feee248-0ec8-4754-b939-01228842bf64 req-3b094d0f-d7e6-487e-a0bb-5846d4da3dbc service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051063 Aug 10 23:04:57.464659 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1049/2102] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:04:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:04:57.468429 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3197f8d2-dbc8-421a-a5f0-8f8a686267e3 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:57.468940 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3197f8d2-dbc8-421a-a5f0-8f8a686267e3 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:57.469346 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3197f8d2-dbc8-421a-a5f0-8f8a686267e3 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:57.470066 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3197f8d2-dbc8-421a-a5f0-8f8a686267e3 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:57.470525 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3197f8d2-dbc8-421a-a5f0-8f8a686267e3 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:57.470984 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3197f8d2-dbc8-421a-a5f0-8f8a686267e3 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:57.495140 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-1f7ec2cb-bba4-4422-8999-2a950b9f6fa3 tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-210909228", "metadata": {"image_type": "test"}}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:04:57.503690 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-1f7ec2cb-bba4-4422-8999-2a950b9f6fa3 tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] [instance: 153d30e2-3eed-4bba-b15b-ca82e6688dbe] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:04:57.554233 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1f7ec2cb-bba4-4422-8999-2a950b9f6fa3 tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:57.554746 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1f7ec2cb-bba4-4422-8999-2a950b9f6fa3 tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:57.555222 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1f7ec2cb-bba4-4422-8999-2a950b9f6fa3 tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:57.555954 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1f7ec2cb-bba4-4422-8999-2a950b9f6fa3 tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:57.556406 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1f7ec2cb-bba4-4422-8999-2a950b9f6fa3 tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:57.560529 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1f7ec2cb-bba4-4422-8999-2a950b9f6fa3 tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:57.595894 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-1f7ec2cb-bba4-4422-8999-2a950b9f6fa3 tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] HTTP exception thrown: Instance 153d30e2-3eed-4bba-b15b-ca82e6688dbe could not be found. Aug 10 23:04:57.604197 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-1f7ec2cb-bba4-4422-8999-2a950b9f6fa3 tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Request method failure captured: Aug 10 23:04:57.604197 n-d-850468-14 devstack@n-api.service[122633]: request: POST /compute/v2.1/servers/153d30e2-3eed-4bba-b15b-ca82e6688dbe/action HTTP/1.1 Aug 10 23:04:57.604197 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:04:57.604197 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:04:57.604197 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:04:57.604197 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 111 Aug 10 23:04:57.604197 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:04:57.604197 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:04:57.604197 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:04:57.604197 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:04:57.604197 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9Dl2bliDBRJnkL1a_LEG8Vs4lNFE4681leyy9A95PKolEtK7biHybKu6KRoAGpg7N7EYuiJtqBlEJaaFMLuvgkk3uRv-K9ZoxSKlILE78RphdLg3QKo0-jpnE6Q9YLANb5fkkf9CRcgjez5z27Jwf0e7icY502I62-3NbeoaZaLPoBY Aug 10 23:04:57.604197 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:04:57.604197 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:04:57.604197 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:04:57.604197 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:04:57.604197 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:04:57.604197 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:04:57.604197 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: c04b07c6f0284e9bb36ba0030f4a31d2 Aug 10 23:04:57.604197 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-ImagesNegativeTestJSON-286442712 Aug 10 23:04:57.604197 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:04:57.604197 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:04:57.607052 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c04b07c6f0284e9bb36ba0030f4a31d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c04b07c6f0284e9bb36ba0030f4a31d2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/c04b07c6f0284e9bb36ba0030f4a31d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_c04b07c6f0284e9bb36ba0030f4a31d2", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:04:57.607052 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-ImagesNegativeTestJSON-286442712 Aug 10 23:04:57.607052 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: c04b07c6f0284e9bb36ba0030f4a31d2 Aug 10 23:04:57.607052 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-286442712 Aug 10 23:04:57.607052 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-ImagesNegativeTestJSON-286442712-project Aug 10 23:04:57.607052 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:04:57.607052 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:04:57.607052 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: f4d2f8f63e9444fe8cf621d2f7c252bd Aug 10 23:04:57.607052 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-ImagesNegativeTestJSON-286442712-project Aug 10 23:04:57.607052 n-d-850468-14 devstack@n-api.service[122633]: Aug 10 23:04:57.607052 n-d-850468-14 devstack@n-api.service[122633]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-210909228", "metadata": {"image_type": "test"}}} Aug 10 23:04:57.607052 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:04:57.608236 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance 153d30e2-3eed-4bba-b15b-ca82e6688dbe could not be found. Aug 10 23:04:57.608236 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': '153d30e2-3eed-4bba-b15b-ca82e6688dbe', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-210909228', 'metadata': {'image_type': 'test'}}}} Aug 10 23:04:57.608236 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:04:57.608236 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:04:57.608236 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:04:57.608236 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:04:57.608236 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:04:57.608236 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:04:57.608236 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:04:57.608236 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:04:57.608236 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:04:57.608236 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:04:57.608236 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 153d30e2-3eed-4bba-b15b-ca82e6688dbe could not be found. Aug 10 23:04:57.608236 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:04:57.608236 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:04:57.608236 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:04:57.608236 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:04:57.608236 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:04:57.608236 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:04:57.609696 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:04:57.609696 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:04:57.609696 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:04:57.609696 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:04:57.609696 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 23:04:57.609696 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 23:04:57.609696 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 23:04:57.609696 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 23:04:57.609696 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Aug 10 23:04:57.609696 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 10 23:04:57.609696 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:04:57.609696 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:04:57.609696 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:04:57.609696 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:04:57.609696 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 153d30e2-3eed-4bba-b15b-ca82e6688dbe could not be found. Aug 10 23:04:57.609696 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:04:57.609696 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:04:57.609696 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:04:57.609696 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:04:57.609696 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:04:57.610719 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:04:57.610719 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:04:57.610719 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:04:57.610719 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 153d30e2-3eed-4bba-b15b-ca82e6688dbe could not be found. Aug 10 23:04:57.610719 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:04:57.610719 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-1f7ec2cb-bba4-4422-8999-2a950b9f6fa3 tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Returning 404 to user: Instance 153d30e2-3eed-4bba-b15b-ca82e6688dbe could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:04:57.610719 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-1f7ec2cb-bba4-4422-8999-2a950b9f6fa3 tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] 10.222.0.58 "POST /compute/v2.1/servers/153d30e2-3eed-4bba-b15b-ca82e6688dbe/action" status: 404 len: 111 microversion: 2.1 time: 0.142841 Aug 10 23:04:57.617294 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1050/2103] 10.222.0.58 () {60 vars in 1279 bytes} [Wed Aug 10 23:04:57 2022] POST /compute/v2.1/servers/153d30e2-3eed-4bba-b15b-ca82e6688dbe/action => generated 111 bytes in 151 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:04:57.649543 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-5e68ffd2-8591-4c6d-896e-127bb3806f58 tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1319921608", "metadata": {"image_type": "test"}}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:04:57.652554 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-5e68ffd2-8591-4c6d-896e-127bb3806f58 tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Failed to fetch instance by id tempest-invalid-705654367 {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2928}} Aug 10 23:04:57.653064 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-5e68ffd2-8591-4c6d-896e-127bb3806f58 tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] HTTP exception thrown: Instance tempest-invalid-705654367 could not be found. Aug 10 23:04:57.667565 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-5e68ffd2-8591-4c6d-896e-127bb3806f58 tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Request method failure captured: Aug 10 23:04:57.667565 n-d-850468-14 devstack@n-api.service[122633]: request: POST /compute/v2.1/servers/tempest-invalid-705654367/action HTTP/1.1 Aug 10 23:04:57.667565 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:04:57.667565 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:04:57.667565 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:04:57.667565 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 112 Aug 10 23:04:57.667565 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:04:57.667565 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:04:57.667565 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:04:57.667565 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:04:57.667565 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9Dl2bliDBRJnkL1a_LEG8Vs4lNFE4681leyy9A95PKolEtK7biHybKu6KRoAGpg7N7EYuiJtqBlEJaaFMLuvgkk3uRv-K9ZoxSKlILE78RphdLg3QKo0-jpnE6Q9YLANb5fkkf9CRcgjez5z27Jwf0e7icY502I62-3NbeoaZaLPoBY Aug 10 23:04:57.667565 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:04:57.667565 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:04:57.667565 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:04:57.667565 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:04:57.667565 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:04:57.667565 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:04:57.667565 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: c04b07c6f0284e9bb36ba0030f4a31d2 Aug 10 23:04:57.667565 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-ImagesNegativeTestJSON-286442712 Aug 10 23:04:57.667565 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:04:57.667565 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:04:57.668818 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c04b07c6f0284e9bb36ba0030f4a31d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c04b07c6f0284e9bb36ba0030f4a31d2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/c04b07c6f0284e9bb36ba0030f4a31d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_c04b07c6f0284e9bb36ba0030f4a31d2", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:04:57.668818 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-ImagesNegativeTestJSON-286442712 Aug 10 23:04:57.668818 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: c04b07c6f0284e9bb36ba0030f4a31d2 Aug 10 23:04:57.668818 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-286442712 Aug 10 23:04:57.668818 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-ImagesNegativeTestJSON-286442712-project Aug 10 23:04:57.668818 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:04:57.668818 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:04:57.668818 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: f4d2f8f63e9444fe8cf621d2f7c252bd Aug 10 23:04:57.668818 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-ImagesNegativeTestJSON-286442712-project Aug 10 23:04:57.668818 n-d-850468-14 devstack@n-api.service[122633]: Aug 10 23:04:57.668818 n-d-850468-14 devstack@n-api.service[122633]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1319921608", "metadata": {"image_type": "test"}}} Aug 10 23:04:57.668818 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:04:57.668818 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance tempest-invalid-705654367 could not be found. Aug 10 23:04:57.669535 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': 'tempest-invalid-705654367', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1319921608', 'metadata': {'image_type': 'test'}}}} Aug 10 23:04:57.669535 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:04:57.669535 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:04:57.669535 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:04:57.669535 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:04:57.669535 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2929, in get Aug 10 23:04:57.669535 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 10 23:04:57.669535 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-705654367 could not be found. Aug 10 23:04:57.669535 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:04:57.669535 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:04:57.669535 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:04:57.669535 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:04:57.669535 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:04:57.669535 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:04:57.669535 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:04:57.669535 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:04:57.669535 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:04:57.669535 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:04:57.669535 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 23:04:57.669535 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 23:04:57.670567 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 23:04:57.670567 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 23:04:57.670567 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Aug 10 23:04:57.670567 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 10 23:04:57.670567 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:04:57.670567 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:04:57.670567 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:04:57.670567 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:04:57.670567 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-705654367 could not be found. Aug 10 23:04:57.670567 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:04:57.670567 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:04:57.670567 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:04:57.670567 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:04:57.670567 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:04:57.670567 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:04:57.670567 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:04:57.670567 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:04:57.670567 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-705654367 could not be found. Aug 10 23:04:57.670567 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:04:57.673052 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-5e68ffd2-8591-4c6d-896e-127bb3806f58 tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Returning 404 to user: Instance tempest-invalid-705654367 could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:04:57.675168 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-5e68ffd2-8591-4c6d-896e-127bb3806f58 tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] 10.222.0.58 "POST /compute/v2.1/servers/tempest-invalid-705654367/action" status: 404 len: 100 microversion: 2.1 time: 0.055658 Aug 10 23:04:57.680502 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1051/2104] 10.222.0.58 () {60 vars in 1246 bytes} [Wed Aug 10 23:04:57 2022] POST /compute/v2.1/servers/tempest-invalid-705654367/action => generated 100 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:04:57.693818 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-71bc8c54-ae96-45ff-bdbf-780405042430 tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-927606816"}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:04:57.703733 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-71bc8c54-ae96-45ff-bdbf-780405042430 tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2928}} Aug 10 23:04:57.704413 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-71bc8c54-ae96-45ff-bdbf-780405042430 tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 10 23:04:57.708918 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-3197f8d2-dbc8-421a-a5f0-8f8a686267e3 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '632904331d024d9b8e4d3660dff2cdf3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56ed0bdee3aa4013bd9219069bda558c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:04:57.723267 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-71bc8c54-ae96-45ff-bdbf-780405042430 tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Request method failure captured: Aug 10 23:04:57.723267 n-d-850468-14 devstack@n-api.service[122633]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Aug 10 23:04:57.723267 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:04:57.723267 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:04:57.723267 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:04:57.723267 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 56 Aug 10 23:04:57.723267 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:04:57.723267 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:04:57.723267 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:04:57.723267 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:04:57.723267 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9Dl2bliDBRJnkL1a_LEG8Vs4lNFE4681leyy9A95PKolEtK7biHybKu6KRoAGpg7N7EYuiJtqBlEJaaFMLuvgkk3uRv-K9ZoxSKlILE78RphdLg3QKo0-jpnE6Q9YLANb5fkkf9CRcgjez5z27Jwf0e7icY502I62-3NbeoaZaLPoBY Aug 10 23:04:57.723267 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:04:57.723267 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:04:57.723267 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:04:57.723267 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:04:57.723267 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:04:57.723267 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:04:57.723267 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: c04b07c6f0284e9bb36ba0030f4a31d2 Aug 10 23:04:57.723267 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-ImagesNegativeTestJSON-286442712 Aug 10 23:04:57.723267 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:04:57.723267 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:04:57.724665 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c04b07c6f0284e9bb36ba0030f4a31d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c04b07c6f0284e9bb36ba0030f4a31d2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/c04b07c6f0284e9bb36ba0030f4a31d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_c04b07c6f0284e9bb36ba0030f4a31d2", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:04:57.724665 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-ImagesNegativeTestJSON-286442712 Aug 10 23:04:57.724665 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: c04b07c6f0284e9bb36ba0030f4a31d2 Aug 10 23:04:57.724665 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-286442712 Aug 10 23:04:57.724665 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-ImagesNegativeTestJSON-286442712-project Aug 10 23:04:57.724665 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:04:57.724665 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:04:57.724665 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: f4d2f8f63e9444fe8cf621d2f7c252bd Aug 10 23:04:57.724665 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-ImagesNegativeTestJSON-286442712-project Aug 10 23:04:57.724665 n-d-850468-14 devstack@n-api.service[122633]: Aug 10 23:04:57.724665 n-d-850468-14 devstack@n-api.service[122633]: {"createImage": {"name": "tempest-test-snap-927606816"}} Aug 10 23:04:57.724665 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:04:57.724665 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 10 23:04:57.725516 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-927606816'}}} Aug 10 23:04:57.725516 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:04:57.725516 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:04:57.725516 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:04:57.725516 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:04:57.725516 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2929, in get Aug 10 23:04:57.725516 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 10 23:04:57.725516 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 10 23:04:57.725516 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:04:57.725516 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:04:57.725516 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:04:57.725516 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:04:57.725516 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:04:57.725516 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:04:57.725516 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:04:57.725516 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:04:57.725516 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:04:57.725516 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:04:57.725516 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 23:04:57.725516 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 23:04:57.726533 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 23:04:57.726533 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 23:04:57.726533 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Aug 10 23:04:57.726533 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 10 23:04:57.726533 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:04:57.726533 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:04:57.726533 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:04:57.726533 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:04:57.726533 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 10 23:04:57.726533 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:04:57.726533 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:04:57.726533 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:04:57.726533 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:04:57.726533 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:04:57.726533 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:04:57.726533 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:04:57.726533 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:04:57.726533 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 10 23:04:57.726533 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:04:57.737852 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-71bc8c54-ae96-45ff-bdbf-780405042430 tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:04:57.738576 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-3197f8d2-dbc8-421a-a5f0-8f8a686267e3 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] 10.222.0.58 "GET /compute/v2.1/servers/47f49c52-08b0-469c-8969-c9655c6ee39b" status: 200 len: 1295 microversion: 2.1 time: 0.279219 Aug 10 23:04:57.740996 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-71bc8c54-ae96-45ff-bdbf-780405042430 tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] 10.222.0.58 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.057396 Aug 10 23:04:57.741918 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1054/2105] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:04:57 2022] GET /compute/v2.1/servers/47f49c52-08b0-469c-8969-c9655c6ee39b => generated 1295 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:04:57.763548 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1052/2106] 10.222.0.58 () {60 vars in 1275 bytes} [Wed Aug 10 23:04:57 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:04:57.778614 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-3b02dad3-7809-472e-90e7-823447f085cf tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-497330558"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:04:57.781649 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-3b02dad3-7809-472e-90e7-823447f085cf tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2928}} Aug 10 23:04:57.782186 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-3b02dad3-7809-472e-90e7-823447f085cf tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 10 23:04:57.796166 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-3b02dad3-7809-472e-90e7-823447f085cf tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Request method failure captured: Aug 10 23:04:57.796166 n-d-850468-14 devstack@n-api.service[122632]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Aug 10 23:04:57.796166 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:04:57.796166 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:04:57.796166 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:04:57.796166 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 56 Aug 10 23:04:57.796166 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:04:57.796166 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:04:57.796166 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:04:57.796166 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:04:57.796166 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9Dl2bliDBRJnkL1a_LEG8Vs4lNFE4681leyy9A95PKolEtK7biHybKu6KRoAGpg7N7EYuiJtqBlEJaaFMLuvgkk3uRv-K9ZoxSKlILE78RphdLg3QKo0-jpnE6Q9YLANb5fkkf9CRcgjez5z27Jwf0e7icY502I62-3NbeoaZaLPoBY Aug 10 23:04:57.796166 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:04:57.796166 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:04:57.796166 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:04:57.796166 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:04:57.796166 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:04:57.796166 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:04:57.796166 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: c04b07c6f0284e9bb36ba0030f4a31d2 Aug 10 23:04:57.796166 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-ImagesNegativeTestJSON-286442712 Aug 10 23:04:57.796166 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:04:57.796166 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:04:57.797518 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c04b07c6f0284e9bb36ba0030f4a31d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c04b07c6f0284e9bb36ba0030f4a31d2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/c04b07c6f0284e9bb36ba0030f4a31d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_c04b07c6f0284e9bb36ba0030f4a31d2", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:04:57.797518 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-ImagesNegativeTestJSON-286442712 Aug 10 23:04:57.797518 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: c04b07c6f0284e9bb36ba0030f4a31d2 Aug 10 23:04:57.797518 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-286442712 Aug 10 23:04:57.797518 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-ImagesNegativeTestJSON-286442712-project Aug 10 23:04:57.797518 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:04:57.797518 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:04:57.797518 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: f4d2f8f63e9444fe8cf621d2f7c252bd Aug 10 23:04:57.797518 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-ImagesNegativeTestJSON-286442712-project Aug 10 23:04:57.797518 n-d-850468-14 devstack@n-api.service[122632]: Aug 10 23:04:57.797518 n-d-850468-14 devstack@n-api.service[122632]: {"createImage": {"name": "tempest-test-snap-497330558"}} Aug 10 23:04:57.797518 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:04:57.797518 n-d-850468-14 devstack@n-api.service[122632]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 10 23:04:57.798336 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-497330558'}}} Aug 10 23:04:57.798336 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:04:57.798336 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:04:57.798336 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:04:57.798336 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:04:57.798336 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2929, in get Aug 10 23:04:57.798336 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 10 23:04:57.798336 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 10 23:04:57.798336 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:04:57.798336 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:04:57.798336 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:04:57.798336 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:04:57.798336 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:04:57.798336 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:04:57.798336 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:04:57.798336 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:04:57.798336 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:04:57.798336 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:04:57.798336 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 23:04:57.798336 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 23:04:57.799489 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 23:04:57.799489 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 23:04:57.799489 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Aug 10 23:04:57.799489 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 10 23:04:57.799489 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:04:57.799489 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:04:57.799489 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:04:57.799489 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:04:57.799489 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 10 23:04:57.799489 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:04:57.799489 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:04:57.799489 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:04:57.799489 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:04:57.799489 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:04:57.799489 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:04:57.799489 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:04:57.799489 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:04:57.799489 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 10 23:04:57.799489 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:04:57.801920 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-3b02dad3-7809-472e-90e7-823447f085cf tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:04:57.801920 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-3b02dad3-7809-472e-90e7-823447f085cf tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] 10.222.0.58 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.028602 Aug 10 23:04:57.801920 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1055/2107] 10.222.0.58 () {60 vars in 1281 bytes} [Wed Aug 10 23:04:57 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:04:57.810491 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-eb3a8a3a-5673-4a80-90ae-a4a1046601bc tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:04:57.811302 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-eb3a8a3a-5673-4a80-90ae-a4a1046601bc tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] [instance: 153d30e2-3eed-4bba-b15b-ca82e6688dbe] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:04:57.818539 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-eb3a8a3a-5673-4a80-90ae-a4a1046601bc tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:57.818942 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-eb3a8a3a-5673-4a80-90ae-a4a1046601bc tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:57.819486 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-eb3a8a3a-5673-4a80-90ae-a4a1046601bc tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:57.820581 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-eb3a8a3a-5673-4a80-90ae-a4a1046601bc tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:57.821164 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-eb3a8a3a-5673-4a80-90ae-a4a1046601bc tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:57.821693 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-eb3a8a3a-5673-4a80-90ae-a4a1046601bc tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:57.845371 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-eb3a8a3a-5673-4a80-90ae-a4a1046601bc tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] HTTP exception thrown: Instance 153d30e2-3eed-4bba-b15b-ca82e6688dbe could not be found. Aug 10 23:04:57.847586 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-eb3a8a3a-5673-4a80-90ae-a4a1046601bc tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Request method failure captured: Aug 10 23:04:57.847586 n-d-850468-14 devstack@n-api.service[122633]: request: DELETE /compute/v2.1/servers/153d30e2-3eed-4bba-b15b-ca82e6688dbe HTTP/1.1 Aug 10 23:04:57.847586 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:04:57.847586 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:04:57.847586 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:04:57.847586 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:04:57.847586 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:04:57.847586 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:04:57.847586 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:04:57.847586 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:04:57.847586 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9Dl2bliDBRJnkL1a_LEG8Vs4lNFE4681leyy9A95PKolEtK7biHybKu6KRoAGpg7N7EYuiJtqBlEJaaFMLuvgkk3uRv-K9ZoxSKlILE78RphdLg3QKo0-jpnE6Q9YLANb5fkkf9CRcgjez5z27Jwf0e7icY502I62-3NbeoaZaLPoBY Aug 10 23:04:57.847586 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:04:57.847586 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:04:57.847586 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:04:57.847586 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:04:57.847586 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:04:57.847586 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:04:57.847586 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: c04b07c6f0284e9bb36ba0030f4a31d2 Aug 10 23:04:57.847586 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-ImagesNegativeTestJSON-286442712 Aug 10 23:04:57.847586 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:04:57.847586 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:04:57.848738 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c04b07c6f0284e9bb36ba0030f4a31d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c04b07c6f0284e9bb36ba0030f4a31d2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/c04b07c6f0284e9bb36ba0030f4a31d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_c04b07c6f0284e9bb36ba0030f4a31d2", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:04:57.848738 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-ImagesNegativeTestJSON-286442712 Aug 10 23:04:57.848738 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: c04b07c6f0284e9bb36ba0030f4a31d2 Aug 10 23:04:57.848738 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-286442712 Aug 10 23:04:57.848738 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-ImagesNegativeTestJSON-286442712-project Aug 10 23:04:57.848738 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:04:57.848738 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:04:57.848738 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: f4d2f8f63e9444fe8cf621d2f7c252bd Aug 10 23:04:57.848738 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-ImagesNegativeTestJSON-286442712-project Aug 10 23:04:57.848738 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:04:57.848738 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance 153d30e2-3eed-4bba-b15b-ca82e6688dbe could not be found. Aug 10 23:04:57.848738 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': '153d30e2-3eed-4bba-b15b-ca82e6688dbe'} Aug 10 23:04:57.849511 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:04:57.849511 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:04:57.849511 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:04:57.849511 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:04:57.849511 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:04:57.849511 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:04:57.849511 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:04:57.849511 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:04:57.849511 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:04:57.849511 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:04:57.849511 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 153d30e2-3eed-4bba-b15b-ca82e6688dbe could not be found. Aug 10 23:04:57.849511 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:04:57.849511 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:04:57.849511 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:04:57.849511 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:04:57.849511 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:04:57.849511 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:04:57.849511 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:04:57.849511 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:04:57.849511 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:04:57.850747 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:04:57.850747 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 23:04:57.850747 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 23:04:57.850747 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 23:04:57.850747 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 23:04:57.850747 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:04:57.850747 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:04:57.850747 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:04:57.850747 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:04:57.850747 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 153d30e2-3eed-4bba-b15b-ca82e6688dbe could not be found. Aug 10 23:04:57.850747 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:04:57.850747 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:04:57.850747 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:04:57.850747 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:04:57.850747 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:04:57.850747 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:04:57.850747 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:04:57.850747 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:04:57.850747 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 153d30e2-3eed-4bba-b15b-ca82e6688dbe could not be found. Aug 10 23:04:57.850747 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:04:57.859531 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-eb3a8a3a-5673-4a80-90ae-a4a1046601bc tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Returning 404 to user: Instance 153d30e2-3eed-4bba-b15b-ca82e6688dbe could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:04:57.860688 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-eb3a8a3a-5673-4a80-90ae-a4a1046601bc tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] 10.222.0.58 "DELETE /compute/v2.1/servers/153d30e2-3eed-4bba-b15b-ca82e6688dbe" status: 404 len: 111 microversion: 2.1 time: 0.056145 Aug 10 23:04:57.861464 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1053/2108] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:04:57 2022] DELETE /compute/v2.1/servers/153d30e2-3eed-4bba-b15b-ca82e6688dbe => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:04:57.875970 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-fc89602b-b62c-401a-b155-ce7a43795cec tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:04:57.876349 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-fc89602b-b62c-401a-b155-ce7a43795cec tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] [instance: 153d30e2-3eed-4bba-b15b-ca82e6688dbe] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:04:57.901922 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fc89602b-b62c-401a-b155-ce7a43795cec tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:57.902518 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fc89602b-b62c-401a-b155-ce7a43795cec tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:57.902881 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fc89602b-b62c-401a-b155-ce7a43795cec tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:57.903599 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fc89602b-b62c-401a-b155-ce7a43795cec tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:57.904056 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fc89602b-b62c-401a-b155-ce7a43795cec tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:57.904477 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fc89602b-b62c-401a-b155-ce7a43795cec tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:57.937540 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-35080a3e-4fdd-4ffb-8861-d7000bcb9729 req-91b7c151-1eb4-4497-bd10-f9acbf6c1150 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47f49c52-08b0-469c-8969-c9655c6ee39b", "name": "network-vif-deleted", "tag": "18b62a0a-3eba-4608-9dea-969a87874984"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:04:57.960306 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-35080a3e-4fdd-4ffb-8861-d7000bcb9729 req-91b7c151-1eb4-4497-bd10-f9acbf6c1150 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:57.965030 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-35080a3e-4fdd-4ffb-8861-d7000bcb9729 req-91b7c151-1eb4-4497-bd10-f9acbf6c1150 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:57.965526 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-35080a3e-4fdd-4ffb-8861-d7000bcb9729 req-91b7c151-1eb4-4497-bd10-f9acbf6c1150 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:57.973420 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-fc89602b-b62c-401a-b155-ce7a43795cec tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] HTTP exception thrown: Instance 153d30e2-3eed-4bba-b15b-ca82e6688dbe could not be found. Aug 10 23:04:57.979596 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-fc89602b-b62c-401a-b155-ce7a43795cec tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Request method failure captured: Aug 10 23:04:57.979596 n-d-850468-14 devstack@n-api.service[122632]: request: GET /compute/v2.1/servers/153d30e2-3eed-4bba-b15b-ca82e6688dbe HTTP/1.1 Aug 10 23:04:57.979596 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:04:57.979596 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:04:57.979596 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:04:57.979596 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 23:04:57.979596 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:04:57.979596 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:04:57.979596 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:04:57.979596 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:04:57.979596 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9Dl2bliDBRJnkL1a_LEG8Vs4lNFE4681leyy9A95PKolEtK7biHybKu6KRoAGpg7N7EYuiJtqBlEJaaFMLuvgkk3uRv-K9ZoxSKlILE78RphdLg3QKo0-jpnE6Q9YLANb5fkkf9CRcgjez5z27Jwf0e7icY502I62-3NbeoaZaLPoBY Aug 10 23:04:57.979596 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:04:57.979596 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:04:57.979596 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:04:57.979596 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:04:57.979596 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:04:57.979596 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:04:57.979596 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: c04b07c6f0284e9bb36ba0030f4a31d2 Aug 10 23:04:57.979596 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-ImagesNegativeTestJSON-286442712 Aug 10 23:04:57.979596 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:04:57.979596 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:04:57.980836 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c04b07c6f0284e9bb36ba0030f4a31d2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c04b07c6f0284e9bb36ba0030f4a31d2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/c04b07c6f0284e9bb36ba0030f4a31d2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_c04b07c6f0284e9bb36ba0030f4a31d2", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:04:57.980836 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-ImagesNegativeTestJSON-286442712 Aug 10 23:04:57.980836 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: c04b07c6f0284e9bb36ba0030f4a31d2 Aug 10 23:04:57.980836 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-286442712 Aug 10 23:04:57.980836 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-ImagesNegativeTestJSON-286442712-project Aug 10 23:04:57.980836 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:04:57.980836 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:04:57.980836 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: f4d2f8f63e9444fe8cf621d2f7c252bd Aug 10 23:04:57.980836 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-ImagesNegativeTestJSON-286442712-project Aug 10 23:04:57.980836 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:04:57.980836 n-d-850468-14 devstack@n-api.service[122632]: exception: Instance 153d30e2-3eed-4bba-b15b-ca82e6688dbe could not be found. Aug 10 23:04:57.980836 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': '153d30e2-3eed-4bba-b15b-ca82e6688dbe'} Aug 10 23:04:57.981463 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:04:57.981463 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:04:57.981463 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:04:57.981463 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:04:57.981463 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:04:57.981463 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:04:57.981463 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:04:57.981463 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:04:57.981463 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:04:57.981463 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:04:57.981463 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 153d30e2-3eed-4bba-b15b-ca82e6688dbe could not be found. Aug 10 23:04:57.981463 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:04:57.981463 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:04:57.981463 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:04:57.981463 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:04:57.981463 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:04:57.981463 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:04:57.981463 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:04:57.981463 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:04:57.981463 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:04:57.982534 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:04:57.982534 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:04:57.982534 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:04:57.982534 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:04:57.982534 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:04:57.982534 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:04:57.982534 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:04:57.982534 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 153d30e2-3eed-4bba-b15b-ca82e6688dbe could not be found. Aug 10 23:04:57.982534 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:04:57.982534 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:04:57.982534 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:04:57.982534 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:04:57.982534 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:04:57.982534 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:04:57.982534 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:04:57.982534 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:04:57.982534 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 153d30e2-3eed-4bba-b15b-ca82e6688dbe could not be found. Aug 10 23:04:57.982534 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:04:57.983508 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-fc89602b-b62c-401a-b155-ce7a43795cec tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] Returning 404 to user: Instance 153d30e2-3eed-4bba-b15b-ca82e6688dbe could not be found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:04:57.983508 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-fc89602b-b62c-401a-b155-ce7a43795cec tempest-ImagesNegativeTestJSON-286442712 tempest-ImagesNegativeTestJSON-286442712-project] 10.222.0.58 "GET /compute/v2.1/servers/153d30e2-3eed-4bba-b15b-ca82e6688dbe" status: 404 len: 111 microversion: 2.1 time: 0.115562 Aug 10 23:04:57.988843 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1056/2109] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:04:57 2022] GET /compute/v2.1/servers/153d30e2-3eed-4bba-b15b-ca82e6688dbe => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:04:58.001934 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-35080a3e-4fdd-4ffb-8861-d7000bcb9729 req-91b7c151-1eb4-4497-bd10-f9acbf6c1150 service nova] Creating event network-vif-deleted:18b62a0a-3eba-4608-9dea-969a87874984 for instance 47f49c52-08b0-469c-8969-c9655c6ee39b on n-h1-850468-14 Aug 10 23:04:58.008547 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-35080a3e-4fdd-4ffb-8861-d7000bcb9729 req-91b7c151-1eb4-4497-bd10-f9acbf6c1150 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076458 Aug 10 23:04:58.009833 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1054/2110] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:04:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 23:04:58.018746 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-9153b803-7c4a-4763-b8b4-9778eeee3d17 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:04:58.019400 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-9153b803-7c4a-4763-b8b4-9778eeee3d17 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] [instance: 45beadf1-a6da-49ab-9098-6b681b5184c9] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:04:58.028289 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9153b803-7c4a-4763-b8b4-9778eeee3d17 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:58.028831 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9153b803-7c4a-4763-b8b4-9778eeee3d17 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:58.029306 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9153b803-7c4a-4763-b8b4-9778eeee3d17 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:58.034330 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9153b803-7c4a-4763-b8b4-9778eeee3d17 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:58.036497 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9153b803-7c4a-4763-b8b4-9778eeee3d17 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:58.036979 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9153b803-7c4a-4763-b8b4-9778eeee3d17 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:58.367952 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-27c6bb83-6a51-492f-a6fd-3f949c10e579 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:04:58.368564 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-27c6bb83-6a51-492f-a6fd-3f949c10e579 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] [instance: 541591c5-62f9-489a-96e7-e7cbbbfc4e28] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:04:58.382762 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-27c6bb83-6a51-492f-a6fd-3f949c10e579 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:58.383402 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-27c6bb83-6a51-492f-a6fd-3f949c10e579 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:58.383856 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-27c6bb83-6a51-492f-a6fd-3f949c10e579 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:58.385994 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-27c6bb83-6a51-492f-a6fd-3f949c10e579 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:58.387472 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-27c6bb83-6a51-492f-a6fd-3f949c10e579 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:58.391400 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-27c6bb83-6a51-492f-a6fd-3f949c10e579 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:58.680334 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-9153b803-7c4a-4763-b8b4-9778eeee3d17 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1986185dc9b4df4affcc421365462f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597863bfebdc481188f1f30095da5396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:04:58.690123 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-9153b803-7c4a-4763-b8b4-9778eeee3d17 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] 10.222.0.58 "GET /compute/v2.1/servers/45beadf1-a6da-49ab-9098-6b681b5184c9" status: 200 len: 1363 microversion: 2.1 time: 0.689147 Aug 10 23:04:58.710675 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1057/2111] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:04:57 2022] GET /compute/v2.1/servers/45beadf1-a6da-49ab-9098-6b681b5184c9 => generated 1363 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:04:58.722612 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-019c5d38-7d58-4782-adee-09d294ceda2b tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:04:58.723833 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-019c5d38-7d58-4782-adee-09d294ceda2b tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] [instance: e822b468-16f3-4a20-94d9-7a2517802a92] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:04:58.739594 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-019c5d38-7d58-4782-adee-09d294ceda2b tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:58.740463 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-019c5d38-7d58-4782-adee-09d294ceda2b tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:58.745356 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-019c5d38-7d58-4782-adee-09d294ceda2b tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:58.748493 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-019c5d38-7d58-4782-adee-09d294ceda2b tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:58.749155 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-019c5d38-7d58-4782-adee-09d294ceda2b tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:58.750841 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-019c5d38-7d58-4782-adee-09d294ceda2b tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:58.899814 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-27c6bb83-6a51-492f-a6fd-3f949c10e579 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de244f1f82143a0b3d3283c31d80bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14c63df2e6c46d2af23b6b8a52690d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:04:58.913672 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-27c6bb83-6a51-492f-a6fd-3f949c10e579 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] 10.222.0.58 "GET /compute/v2.1/servers/541591c5-62f9-489a-96e7-e7cbbbfc4e28" status: 200 len: 1462 microversion: 2.1 time: 0.549840 Aug 10 23:04:58.933479 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1055/2112] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:04:58 2022] GET /compute/v2.1/servers/541591c5-62f9-489a-96e7-e7cbbbfc4e28 => generated 1462 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:04:58.940023 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-67094f6d-5a86-4340-a050-ba30f80707d4 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:04:58.940876 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-67094f6d-5a86-4340-a050-ba30f80707d4 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] [instance: 47f49c52-08b0-469c-8969-c9655c6ee39b] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:04:58.948110 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-67094f6d-5a86-4340-a050-ba30f80707d4 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:58.949177 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-67094f6d-5a86-4340-a050-ba30f80707d4 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:58.950480 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-67094f6d-5a86-4340-a050-ba30f80707d4 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:58.951454 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-67094f6d-5a86-4340-a050-ba30f80707d4 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:58.952065 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-67094f6d-5a86-4340-a050-ba30f80707d4 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:58.952492 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-67094f6d-5a86-4340-a050-ba30f80707d4 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:58.972505 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-67094f6d-5a86-4340-a050-ba30f80707d4 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] HTTP exception thrown: Instance 47f49c52-08b0-469c-8969-c9655c6ee39b could not be found. Aug 10 23:04:58.974434 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-67094f6d-5a86-4340-a050-ba30f80707d4 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Request method failure captured: Aug 10 23:04:58.974434 n-d-850468-14 devstack@n-api.service[122633]: request: GET /compute/v2.1/servers/47f49c52-08b0-469c-8969-c9655c6ee39b HTTP/1.1 Aug 10 23:04:58.974434 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:04:58.974434 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:04:58.974434 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:04:58.974434 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:04:58.974434 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:04:58.974434 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:04:58.974434 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:04:58.974434 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:04:58.974434 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9DfOEywB9oeD_C2SwugHriPH6QPax3SubHvct868zap6PD9BiLAj3q-t9YA3Fiw0HKhahbZB4KIKKcaf61C3Wt-lqKMWkeMB0U5Hy-b51nFx374XbUqtnrhL-_0NpcyHXThCK21eb7hc3wOrIDMIf5OvLiBpImI0ZmmFDD5V_kdMRpY Aug 10 23:04:58.974434 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:04:58.974434 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:04:58.974434 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:04:58.974434 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:04:58.974434 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:04:58.974434 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:04:58.974434 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 56ed0bdee3aa4013bd9219069bda558c Aug 10 23:04:58.974434 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-LiveMigrationTest-2043915664 Aug 10 23:04:58.974434 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:04:58.974434 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:04:58.975930 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/56ed0bdee3aa4013bd9219069bda558c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/56ed0bdee3aa4013bd9219069bda558c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/56ed0bdee3aa4013bd9219069bda558c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_56ed0bdee3aa4013bd9219069bda558c", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:04:58.975930 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-LiveMigrationTest-2043915664 Aug 10 23:04:58.975930 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 56ed0bdee3aa4013bd9219069bda558c Aug 10 23:04:58.975930 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-LiveMigrationTest-2043915664 Aug 10 23:04:58.975930 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-LiveMigrationTest-2043915664-project Aug 10 23:04:58.975930 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:04:58.975930 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:04:58.975930 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 632904331d024d9b8e4d3660dff2cdf3 Aug 10 23:04:58.975930 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-LiveMigrationTest-2043915664-project Aug 10 23:04:58.975930 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:04:58.975930 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance 47f49c52-08b0-469c-8969-c9655c6ee39b could not be found. Aug 10 23:04:58.975930 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': '47f49c52-08b0-469c-8969-c9655c6ee39b'} Aug 10 23:04:58.976768 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:04:58.976768 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:04:58.976768 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:04:58.976768 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:04:58.976768 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:04:58.976768 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:04:58.976768 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:04:58.976768 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:04:58.976768 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:04:58.976768 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:04:58.976768 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47f49c52-08b0-469c-8969-c9655c6ee39b could not be found. Aug 10 23:04:58.976768 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:04:58.976768 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:04:58.976768 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:04:58.976768 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:04:58.976768 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:04:58.976768 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:04:58.976768 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:04:58.976768 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:04:58.976768 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:04:58.978016 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:04:58.978016 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:04:58.978016 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:04:58.978016 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:04:58.978016 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:04:58.978016 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:04:58.978016 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:04:58.978016 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47f49c52-08b0-469c-8969-c9655c6ee39b could not be found. Aug 10 23:04:58.978016 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:04:58.978016 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:04:58.978016 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:04:58.978016 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:04:58.978016 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:04:58.978016 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:04:58.978016 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:04:58.978016 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:04:58.978016 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47f49c52-08b0-469c-8969-c9655c6ee39b could not be found. Aug 10 23:04:58.978016 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:04:58.980439 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-67094f6d-5a86-4340-a050-ba30f80707d4 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] Returning 404 to user: Instance 47f49c52-08b0-469c-8969-c9655c6ee39b could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:04:58.981900 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-67094f6d-5a86-4340-a050-ba30f80707d4 tempest-LiveMigrationTest-2043915664 tempest-LiveMigrationTest-2043915664-project] 10.222.0.58 "GET /compute/v2.1/servers/47f49c52-08b0-469c-8969-c9655c6ee39b" status: 404 len: 111 microversion: 2.1 time: 0.047079 Aug 10 23:04:58.984149 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1056/2113] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:04:58 2022] GET /compute/v2.1/servers/47f49c52-08b0-469c-8969-c9655c6ee39b => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:04:58.990586 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-9f721bf3-001b-43b7-8366-98c9f00d812c tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:04:58.991399 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-9f721bf3-001b-43b7-8366-98c9f00d812c tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] [instance: b3b3730c-1396-4ca6-9d9e-8a3104950324] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:04:58.999206 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9f721bf3-001b-43b7-8366-98c9f00d812c tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:58.999870 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9f721bf3-001b-43b7-8366-98c9f00d812c tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:59.000547 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9f721bf3-001b-43b7-8366-98c9f00d812c tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:59.001524 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9f721bf3-001b-43b7-8366-98c9f00d812c tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:59.002574 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9f721bf3-001b-43b7-8366-98c9f00d812c tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:59.003319 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9f721bf3-001b-43b7-8366-98c9f00d812c tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:59.164843 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=4 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:04:59.211944 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=20 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:04:59.245742 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-9f721bf3-001b-43b7-8366-98c9f00d812c tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de244f1f82143a0b3d3283c31d80bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14c63df2e6c46d2af23b6b8a52690d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:04:59.254575 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-9f721bf3-001b-43b7-8366-98c9f00d812c tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] 10.222.0.58 "GET /compute/v2.1/servers/b3b3730c-1396-4ca6-9d9e-8a3104950324" status: 200 len: 1463 microversion: 2.1 time: 0.268998 Aug 10 23:04:59.259312 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1057/2114] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:04:58 2022] GET /compute/v2.1/servers/b3b3730c-1396-4ca6-9d9e-8a3104950324 => generated 1463 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:04:59.413251 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-019c5d38-7d58-4782-adee-09d294ceda2b tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf1bcb51dec4134ac27ea7964684c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27408df8ea9f4d848b15b0bbba451a21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:04:59.429267 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-019c5d38-7d58-4782-adee-09d294ceda2b tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] 10.222.0.58 "GET /compute/v2.1/servers/e822b468-16f3-4a20-94d9-7a2517802a92" status: 200 len: 1392 microversion: 2.1 time: 0.717209 Aug 10 23:04:59.434430 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1058/2115] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:04:58 2022] GET /compute/v2.1/servers/e822b468-16f3-4a20-94d9-7a2517802a92 => generated 1392 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:04:59.468378 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-705a2d89-d414-46bb-ab16-333f4a51ef43 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-628889506", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "b3b3730c-1396-4ca6-9d9e-8a3104950324"}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:04:59.498856 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-ef46f2bd-4382-4eab-862f-5d7a0594272f req-26031307-7f06-45f1-ae27-2f719718bb66 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45beadf1-a6da-49ab-9098-6b681b5184c9", "tag": "896d850e-4103-42f9-83bc-43f3e82924c2"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:04:59.538406 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-ef46f2bd-4382-4eab-862f-5d7a0594272f req-26031307-7f06-45f1-ae27-2f719718bb66 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:59.540498 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-ef46f2bd-4382-4eab-862f-5d7a0594272f req-26031307-7f06-45f1-ae27-2f719718bb66 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:59.542190 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-ef46f2bd-4382-4eab-862f-5d7a0594272f req-26031307-7f06-45f1-ae27-2f719718bb66 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:59.592296 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.network.neutron [None req-705a2d89-d414-46bb-ab16-333f4a51ef43 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] validate_networks() for None {{(pid=122633) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 23:04:59.599346 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-ef46f2bd-4382-4eab-862f-5d7a0594272f req-26031307-7f06-45f1-ae27-2f719718bb66 service nova] Creating event network-changed:896d850e-4103-42f9-83bc-43f3e82924c2 for instance 45beadf1-a6da-49ab-9098-6b681b5184c9 on n-h2-850468-14 Aug 10 23:04:59.611153 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-ef46f2bd-4382-4eab-862f-5d7a0594272f req-26031307-7f06-45f1-ae27-2f719718bb66 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116714 Aug 10 23:04:59.612004 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1059/2116] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:04:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:04:59.721956 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-8ac88a2f-36c3-42fb-a68f-e83071007eaa tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:04:59.728117 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-8ac88a2f-36c3-42fb-a68f-e83071007eaa tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] [instance: 45beadf1-a6da-49ab-9098-6b681b5184c9] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:04:59.758013 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8ac88a2f-36c3-42fb-a68f-e83071007eaa tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:59.761645 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8ac88a2f-36c3-42fb-a68f-e83071007eaa tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:59.763560 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8ac88a2f-36c3-42fb-a68f-e83071007eaa tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:59.765522 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8ac88a2f-36c3-42fb-a68f-e83071007eaa tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:04:59.766885 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8ac88a2f-36c3-42fb-a68f-e83071007eaa tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:04:59.767696 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8ac88a2f-36c3-42fb-a68f-e83071007eaa tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:04:59.958616 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=4 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:05:00.244749 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-705a2d89-d414-46bb-ab16-333f4a51ef43 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Flavor limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:05:00.245873 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-705a2d89-d414-46bb-ab16-333f4a51ef43 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Image limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:05:00.246597 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-705a2d89-d414-46bb-ab16-333f4a51ef43 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Flavor pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:05:00.247392 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-705a2d89-d414-46bb-ab16-333f4a51ef43 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Image pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:05:00.248297 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-705a2d89-d414-46bb-ab16-333f4a51ef43 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:05:00.259313 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-705a2d89-d414-46bb-ab16-333f4a51ef43 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:00.260034 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-705a2d89-d414-46bb-ab16-333f4a51ef43 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:00.260736 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-705a2d89-d414-46bb-ab16-333f4a51ef43 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:00.262510 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-705a2d89-d414-46bb-ab16-333f4a51ef43 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:00.263127 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-705a2d89-d414-46bb-ab16-333f4a51ef43 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:00.263664 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-705a2d89-d414-46bb-ab16-333f4a51ef43 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:00.295823 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-705a2d89-d414-46bb-ab16-333f4a51ef43 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Getting quotas for project b14c63df2e6c46d2af23b6b8a52690d9. Resources: {'instances', 'cores', 'ram'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:05:00.302477 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-705a2d89-d414-46bb-ab16-333f4a51ef43 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Getting quotas for user 6de244f1f82143a0b3d3283c31d80bc9 and project b14c63df2e6c46d2af23b6b8a52690d9. Resources: {'instances', 'cores', 'ram'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:05:00.318573 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-705a2d89-d414-46bb-ab16-333f4a51ef43 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Going to run 1 instances... {{(pid=122633) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 23:05:00.321458 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-705a2d89-d414-46bb-ab16-333f4a51ef43 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] [instance: f08ce987-9b15-48ba-8a71-a9c58616c789] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78ad8905-f66f-4733-8be9-2b260f1fabed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122633) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 23:05:00.396924 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-705a2d89-d414-46bb-ab16-333f4a51ef43 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.932215 Aug 10 23:05:00.398291 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1058/2117] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 23:04:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 934 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 23:05:00.410929 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-b411f4a0-3b8b-48bf-ba55-56d4a6c6f8e4 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:05:00.411833 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-b411f4a0-3b8b-48bf-ba55-56d4a6c6f8e4 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] [instance: f08ce987-9b15-48ba-8a71-a9c58616c789] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:05:00.519528 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-8ac88a2f-36c3-42fb-a68f-e83071007eaa tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1986185dc9b4df4affcc421365462f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597863bfebdc481188f1f30095da5396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:05:00.551931 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-8ac88a2f-36c3-42fb-a68f-e83071007eaa tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] 10.222.0.58 "GET /compute/v2.1/servers/45beadf1-a6da-49ab-9098-6b681b5184c9" status: 200 len: 1363 microversion: 2.1 time: 0.836470 Aug 10 23:05:00.562957 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1060/2118] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:04:59 2022] GET /compute/v2.1/servers/45beadf1-a6da-49ab-9098-6b681b5184c9 => generated 1363 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:05:00.583884 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-ca330c3e-f1e6-4f43-ae19-2abb280e006a tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:05:00.584795 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-ca330c3e-f1e6-4f43-ae19-2abb280e006a tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] [instance: e822b468-16f3-4a20-94d9-7a2517802a92] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:05:00.599921 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ca330c3e-f1e6-4f43-ae19-2abb280e006a tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:00.600308 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ca330c3e-f1e6-4f43-ae19-2abb280e006a tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:00.603964 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ca330c3e-f1e6-4f43-ae19-2abb280e006a tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:00.605449 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ca330c3e-f1e6-4f43-ae19-2abb280e006a tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:00.606072 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ca330c3e-f1e6-4f43-ae19-2abb280e006a tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:00.606671 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ca330c3e-f1e6-4f43-ae19-2abb280e006a tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:00.616957 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-b411f4a0-3b8b-48bf-ba55-56d4a6c6f8e4 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de244f1f82143a0b3d3283c31d80bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14c63df2e6c46d2af23b6b8a52690d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:05:00.637045 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-b411f4a0-3b8b-48bf-ba55-56d4a6c6f8e4 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] 10.222.0.58 "GET /compute/v2.1/servers/f08ce987-9b15-48ba-8a71-a9c58616c789" status: 200 len: 1213 microversion: 2.1 time: 0.230711 Aug 10 23:05:00.637845 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1059/2119] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:05:00 2022] GET /compute/v2.1/servers/f08ce987-9b15-48ba-8a71-a9c58616c789 => generated 1213 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:05:01.502646 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-ca330c3e-f1e6-4f43-ae19-2abb280e006a tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf1bcb51dec4134ac27ea7964684c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27408df8ea9f4d848b15b0bbba451a21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:05:01.538428 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-ca330c3e-f1e6-4f43-ae19-2abb280e006a tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] 10.222.0.58 "GET /compute/v2.1/servers/e822b468-16f3-4a20-94d9-7a2517802a92" status: 200 len: 1392 microversion: 2.1 time: 0.970020 Aug 10 23:05:01.550083 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1061/2120] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:05:00 2022] GET /compute/v2.1/servers/e822b468-16f3-4a20-94d9-7a2517802a92 => generated 1392 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:05:01.573993 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-adb92ccf-d53b-4676-97da-9da774d7ede1 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:05:01.574625 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-adb92ccf-d53b-4676-97da-9da774d7ede1 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] [instance: 45beadf1-a6da-49ab-9098-6b681b5184c9] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:05:01.588364 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-adb92ccf-d53b-4676-97da-9da774d7ede1 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:01.589148 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-adb92ccf-d53b-4676-97da-9da774d7ede1 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:01.589706 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-adb92ccf-d53b-4676-97da-9da774d7ede1 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:01.590441 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-adb92ccf-d53b-4676-97da-9da774d7ede1 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:01.594739 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-adb92ccf-d53b-4676-97da-9da774d7ede1 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:01.595219 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-adb92ccf-d53b-4676-97da-9da774d7ede1 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:01.608656 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:05:01.658625 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-8f75630e-5db3-43bd-b4c9-5695e3958483 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:05:01.659539 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-8f75630e-5db3-43bd-b4c9-5695e3958483 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] [instance: f08ce987-9b15-48ba-8a71-a9c58616c789] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:05:01.677157 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8f75630e-5db3-43bd-b4c9-5695e3958483 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:01.677928 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8f75630e-5db3-43bd-b4c9-5695e3958483 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:01.679571 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8f75630e-5db3-43bd-b4c9-5695e3958483 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:01.685146 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8f75630e-5db3-43bd-b4c9-5695e3958483 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:01.685852 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8f75630e-5db3-43bd-b4c9-5695e3958483 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:01.686465 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8f75630e-5db3-43bd-b4c9-5695e3958483 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:02.099923 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-8f75630e-5db3-43bd-b4c9-5695e3958483 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de244f1f82143a0b3d3283c31d80bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14c63df2e6c46d2af23b6b8a52690d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:05:02.112323 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-8f75630e-5db3-43bd-b4c9-5695e3958483 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] 10.222.0.58 "GET /compute/v2.1/servers/f08ce987-9b15-48ba-8a71-a9c58616c789" status: 200 len: 1265 microversion: 2.1 time: 0.458499 Aug 10 23:05:02.114749 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1062/2121] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:05:01 2022] GET /compute/v2.1/servers/f08ce987-9b15-48ba-8a71-a9c58616c789 => generated 1265 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:05:02.267710 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-adb92ccf-d53b-4676-97da-9da774d7ede1 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1986185dc9b4df4affcc421365462f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597863bfebdc481188f1f30095da5396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:05:02.285633 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-adb92ccf-d53b-4676-97da-9da774d7ede1 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] 10.222.0.58 "GET /compute/v2.1/servers/45beadf1-a6da-49ab-9098-6b681b5184c9" status: 200 len: 1363 microversion: 2.1 time: 0.714564 Aug 10 23:05:02.289907 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1060/2122] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:05:01 2022] GET /compute/v2.1/servers/45beadf1-a6da-49ab-9098-6b681b5184c9 => generated 1363 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:05:02.576941 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-1e39cc8e-2c15-4a57-a94b-f73b8d42a53d tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:05:02.577573 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-1e39cc8e-2c15-4a57-a94b-f73b8d42a53d tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] [instance: e822b468-16f3-4a20-94d9-7a2517802a92] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:05:02.598052 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1e39cc8e-2c15-4a57-a94b-f73b8d42a53d tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:02.599227 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1e39cc8e-2c15-4a57-a94b-f73b8d42a53d tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:02.600088 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1e39cc8e-2c15-4a57-a94b-f73b8d42a53d tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:02.603206 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1e39cc8e-2c15-4a57-a94b-f73b8d42a53d tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:02.606614 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1e39cc8e-2c15-4a57-a94b-f73b8d42a53d tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:02.608083 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1e39cc8e-2c15-4a57-a94b-f73b8d42a53d tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:03.139813 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-67fda7b3-580b-4443-869c-9526b4859659 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:05:03.140756 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-67fda7b3-580b-4443-869c-9526b4859659 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] [instance: f08ce987-9b15-48ba-8a71-a9c58616c789] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:05:03.170238 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-67fda7b3-580b-4443-869c-9526b4859659 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:03.173542 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-67fda7b3-580b-4443-869c-9526b4859659 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:03.174430 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-67fda7b3-580b-4443-869c-9526b4859659 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:03.176424 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-67fda7b3-580b-4443-869c-9526b4859659 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:03.179608 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-67fda7b3-580b-4443-869c-9526b4859659 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:03.180691 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-67fda7b3-580b-4443-869c-9526b4859659 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:03.534643 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-1e39cc8e-2c15-4a57-a94b-f73b8d42a53d tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf1bcb51dec4134ac27ea7964684c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27408df8ea9f4d848b15b0bbba451a21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:05:03.550157 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-1e39cc8e-2c15-4a57-a94b-f73b8d42a53d tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] 10.222.0.58 "GET /compute/v2.1/servers/e822b468-16f3-4a20-94d9-7a2517802a92" status: 200 len: 1392 microversion: 2.1 time: 0.979527 Aug 10 23:05:03.551115 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1063/2123] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:05:02 2022] GET /compute/v2.1/servers/e822b468-16f3-4a20-94d9-7a2517802a92 => generated 1392 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:05:03.555776 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-a55dbcd1-9544-4ac1-a99c-ced48ed12440 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:05:03.556385 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-a55dbcd1-9544-4ac1-a99c-ced48ed12440 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] [instance: 45beadf1-a6da-49ab-9098-6b681b5184c9] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:05:03.581856 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-67fda7b3-580b-4443-869c-9526b4859659 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de244f1f82143a0b3d3283c31d80bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14c63df2e6c46d2af23b6b8a52690d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:05:03.594535 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a55dbcd1-9544-4ac1-a99c-ced48ed12440 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:03.595248 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a55dbcd1-9544-4ac1-a99c-ced48ed12440 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:03.595618 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a55dbcd1-9544-4ac1-a99c-ced48ed12440 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:03.596094 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-67fda7b3-580b-4443-869c-9526b4859659 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] 10.222.0.58 "GET /compute/v2.1/servers/f08ce987-9b15-48ba-8a71-a9c58616c789" status: 200 len: 1271 microversion: 2.1 time: 0.459540 Aug 10 23:05:03.597819 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a55dbcd1-9544-4ac1-a99c-ced48ed12440 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:03.598526 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a55dbcd1-9544-4ac1-a99c-ced48ed12440 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:03.600900 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a55dbcd1-9544-4ac1-a99c-ced48ed12440 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:03.616152 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1061/2124] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:05:03 2022] GET /compute/v2.1/servers/f08ce987-9b15-48ba-8a71-a9c58616c789 => generated 1271 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:05:03.683042 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-9af1a004-9fd4-4d1c-b437-914cc333beea req-3489a1ed-1f06-4d3c-afcb-e7aceb43fb93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e822b468-16f3-4a20-94d9-7a2517802a92", "name": "network-vif-plugged", "status": "completed", "tag": "975c2c0f-d400-4824-a681-225263ddf461"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:05:03.711589 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-9af1a004-9fd4-4d1c-b437-914cc333beea req-3489a1ed-1f06-4d3c-afcb-e7aceb43fb93 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:03.712308 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-9af1a004-9fd4-4d1c-b437-914cc333beea req-3489a1ed-1f06-4d3c-afcb-e7aceb43fb93 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:03.713401 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-9af1a004-9fd4-4d1c-b437-914cc333beea req-3489a1ed-1f06-4d3c-afcb-e7aceb43fb93 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:03.736045 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-9af1a004-9fd4-4d1c-b437-914cc333beea req-3489a1ed-1f06-4d3c-afcb-e7aceb43fb93 service nova] Creating event network-vif-plugged:975c2c0f-d400-4824-a681-225263ddf461 for instance e822b468-16f3-4a20-94d9-7a2517802a92 on n-h2-850468-14 Aug 10 23:05:03.768708 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-9af1a004-9fd4-4d1c-b437-914cc333beea req-3489a1ed-1f06-4d3c-afcb-e7aceb43fb93 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090451 Aug 10 23:05:03.770613 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1062/2125] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:05:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:05:04.574119 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-63f695b1-420a-4dde-aee4-6852e1e7d73f tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:05:04.575646 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-63f695b1-420a-4dde-aee4-6852e1e7d73f tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] [instance: e822b468-16f3-4a20-94d9-7a2517802a92] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:05:04.602498 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-63f695b1-420a-4dde-aee4-6852e1e7d73f tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:04.603115 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-63f695b1-420a-4dde-aee4-6852e1e7d73f tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:04.603501 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-63f695b1-420a-4dde-aee4-6852e1e7d73f tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:04.613568 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-63f695b1-420a-4dde-aee4-6852e1e7d73f tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:04.614198 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-63f695b1-420a-4dde-aee4-6852e1e7d73f tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:04.614647 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-63f695b1-420a-4dde-aee4-6852e1e7d73f tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:04.890061 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-a55dbcd1-9544-4ac1-a99c-ced48ed12440 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1986185dc9b4df4affcc421365462f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597863bfebdc481188f1f30095da5396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:05:04.900003 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-a55dbcd1-9544-4ac1-a99c-ced48ed12440 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] 10.222.0.58 "GET /compute/v2.1/servers/45beadf1-a6da-49ab-9098-6b681b5184c9" status: 200 len: 1363 microversion: 2.1 time: 1.347747 Aug 10 23:05:04.906715 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1064/2126] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:05:03 2022] GET /compute/v2.1/servers/45beadf1-a6da-49ab-9098-6b681b5184c9 => generated 1363 bytes in 1355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:05:04.922109 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-f050c8fb-0251-4848-87ac-f3fe7104c4b5 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:05:04.923190 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-f050c8fb-0251-4848-87ac-f3fe7104c4b5 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] [instance: f08ce987-9b15-48ba-8a71-a9c58616c789] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:05:04.943090 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f050c8fb-0251-4848-87ac-f3fe7104c4b5 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:04.948805 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-63f695b1-420a-4dde-aee4-6852e1e7d73f tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf1bcb51dec4134ac27ea7964684c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27408df8ea9f4d848b15b0bbba451a21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:05:04.949268 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f050c8fb-0251-4848-87ac-f3fe7104c4b5 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:04.949815 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f050c8fb-0251-4848-87ac-f3fe7104c4b5 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:04.953385 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f050c8fb-0251-4848-87ac-f3fe7104c4b5 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:04.960316 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f050c8fb-0251-4848-87ac-f3fe7104c4b5 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:04.961408 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f050c8fb-0251-4848-87ac-f3fe7104c4b5 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:04.964376 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-63f695b1-420a-4dde-aee4-6852e1e7d73f tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] 10.222.0.58 "GET /compute/v2.1/servers/e822b468-16f3-4a20-94d9-7a2517802a92" status: 200 len: 1392 microversion: 2.1 time: 0.395849 Aug 10 23:05:04.968952 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1063/2127] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:05:04 2022] GET /compute/v2.1/servers/e822b468-16f3-4a20-94d9-7a2517802a92 => generated 1392 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:05:05.668939 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-f050c8fb-0251-4848-87ac-f3fe7104c4b5 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de244f1f82143a0b3d3283c31d80bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14c63df2e6c46d2af23b6b8a52690d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:05:05.686038 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-f050c8fb-0251-4848-87ac-f3fe7104c4b5 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] 10.222.0.58 "GET /compute/v2.1/servers/f08ce987-9b15-48ba-8a71-a9c58616c789" status: 200 len: 1271 microversion: 2.1 time: 0.777918 Aug 10 23:05:05.688039 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1065/2128] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:05:04 2022] GET /compute/v2.1/servers/f08ce987-9b15-48ba-8a71-a9c58616c789 => generated 1271 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:05:05.928863 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-979b5e6b-9f31-4e35-8f2d-0800024c4007 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:05:05.930104 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-979b5e6b-9f31-4e35-8f2d-0800024c4007 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] [instance: 45beadf1-a6da-49ab-9098-6b681b5184c9] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:05:05.952306 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-c30a4fc6-2587-4378-a95e-7e74f3c7d638 req-8a5931ef-88cf-4009-a19d-ef84063ee592 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45beadf1-a6da-49ab-9098-6b681b5184c9", "name": "network-vif-plugged", "status": "completed", "tag": "896d850e-4103-42f9-83bc-43f3e82924c2"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:05:05.954166 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-979b5e6b-9f31-4e35-8f2d-0800024c4007 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:05.954853 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-979b5e6b-9f31-4e35-8f2d-0800024c4007 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:05.955985 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-979b5e6b-9f31-4e35-8f2d-0800024c4007 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:05.959367 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-979b5e6b-9f31-4e35-8f2d-0800024c4007 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:05.959897 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-979b5e6b-9f31-4e35-8f2d-0800024c4007 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:05.960561 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-979b5e6b-9f31-4e35-8f2d-0800024c4007 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:05.971170 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-c30a4fc6-2587-4378-a95e-7e74f3c7d638 req-8a5931ef-88cf-4009-a19d-ef84063ee592 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:05.972310 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-c30a4fc6-2587-4378-a95e-7e74f3c7d638 req-8a5931ef-88cf-4009-a19d-ef84063ee592 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:05.972894 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-c30a4fc6-2587-4378-a95e-7e74f3c7d638 req-8a5931ef-88cf-4009-a19d-ef84063ee592 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:06.036136 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-c30a4fc6-2587-4378-a95e-7e74f3c7d638 req-8a5931ef-88cf-4009-a19d-ef84063ee592 service nova] Creating event network-vif-plugged:896d850e-4103-42f9-83bc-43f3e82924c2 for instance 45beadf1-a6da-49ab-9098-6b681b5184c9 on n-h2-850468-14 Aug 10 23:05:06.060560 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-c30a4fc6-2587-4378-a95e-7e74f3c7d638 req-8a5931ef-88cf-4009-a19d-ef84063ee592 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111275 Aug 10 23:05:06.062315 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1066/2129] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:05:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:05:06.088487 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-d9854098-d9a2-43cf-a88b-43c4e3327c0b tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:05:06.089434 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-d9854098-d9a2-43cf-a88b-43c4e3327c0b tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] [instance: e822b468-16f3-4a20-94d9-7a2517802a92] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:05:06.140130 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d9854098-d9a2-43cf-a88b-43c4e3327c0b tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:06.140820 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d9854098-d9a2-43cf-a88b-43c4e3327c0b tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:06.141331 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d9854098-d9a2-43cf-a88b-43c4e3327c0b tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:06.142092 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d9854098-d9a2-43cf-a88b-43c4e3327c0b tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:06.142708 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d9854098-d9a2-43cf-a88b-43c4e3327c0b tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:06.156214 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d9854098-d9a2-43cf-a88b-43c4e3327c0b tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:06.383475 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-979b5e6b-9f31-4e35-8f2d-0800024c4007 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1986185dc9b4df4affcc421365462f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597863bfebdc481188f1f30095da5396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:05:06.414549 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-979b5e6b-9f31-4e35-8f2d-0800024c4007 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] 10.222.0.58 "GET /compute/v2.1/servers/45beadf1-a6da-49ab-9098-6b681b5184c9" status: 200 len: 1363 microversion: 2.1 time: 0.490332 Aug 10 23:05:06.416551 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1064/2130] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:05:05 2022] GET /compute/v2.1/servers/45beadf1-a6da-49ab-9098-6b681b5184c9 => generated 1363 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:05:06.720847 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-8f3f05ae-7b28-4c76-ae7b-860f999f2b65 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:05:06.725828 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-8f3f05ae-7b28-4c76-ae7b-860f999f2b65 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] [instance: f08ce987-9b15-48ba-8a71-a9c58616c789] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:05:06.746468 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8f3f05ae-7b28-4c76-ae7b-860f999f2b65 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:06.747894 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8f3f05ae-7b28-4c76-ae7b-860f999f2b65 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:06.753052 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8f3f05ae-7b28-4c76-ae7b-860f999f2b65 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:06.756045 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8f3f05ae-7b28-4c76-ae7b-860f999f2b65 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:06.758578 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8f3f05ae-7b28-4c76-ae7b-860f999f2b65 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:06.761017 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8f3f05ae-7b28-4c76-ae7b-860f999f2b65 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:06.861751 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-d9854098-d9a2-43cf-a88b-43c4e3327c0b tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf1bcb51dec4134ac27ea7964684c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27408df8ea9f4d848b15b0bbba451a21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:05:06.893489 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-d9854098-d9a2-43cf-a88b-43c4e3327c0b tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] 10.222.0.58 "GET /compute/v2.1/servers/e822b468-16f3-4a20-94d9-7a2517802a92" status: 200 len: 1573 microversion: 2.1 time: 0.827535 Aug 10 23:05:06.904639 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1067/2131] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:05:06 2022] GET /compute/v2.1/servers/e822b468-16f3-4a20-94d9-7a2517802a92 => generated 1573 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:05:06.937341 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-8f3f05ae-7b28-4c76-ae7b-860f999f2b65 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de244f1f82143a0b3d3283c31d80bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14c63df2e6c46d2af23b6b8a52690d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:05:06.940728 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-441491b5-b051-44b8-a2e2-7064fdb8baca tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:05:06.941266 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-441491b5-b051-44b8-a2e2-7064fdb8baca tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] [instance: e822b468-16f3-4a20-94d9-7a2517802a92] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:05:06.953501 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-441491b5-b051-44b8-a2e2-7064fdb8baca tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:06.953501 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-441491b5-b051-44b8-a2e2-7064fdb8baca tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:06.953501 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-441491b5-b051-44b8-a2e2-7064fdb8baca tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:06.953501 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-441491b5-b051-44b8-a2e2-7064fdb8baca tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:06.954318 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-441491b5-b051-44b8-a2e2-7064fdb8baca tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:06.954318 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-441491b5-b051-44b8-a2e2-7064fdb8baca tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:06.966588 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-8f3f05ae-7b28-4c76-ae7b-860f999f2b65 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] 10.222.0.58 "GET /compute/v2.1/servers/f08ce987-9b15-48ba-8a71-a9c58616c789" status: 200 len: 1271 microversion: 2.1 time: 0.262564 Aug 10 23:05:06.980424 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1065/2132] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:05:06 2022] GET /compute/v2.1/servers/f08ce987-9b15-48ba-8a71-a9c58616c789 => generated 1271 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:05:07.383893 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-441491b5-b051-44b8-a2e2-7064fdb8baca tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] 10.222.0.58 "GET /compute/v2.1/servers/e822b468-16f3-4a20-94d9-7a2517802a92/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.454358 Aug 10 23:05:07.387155 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1068/2133] 10.222.0.58 () {58 vars in 1275 bytes} [Wed Aug 10 23:05:06 2022] GET /compute/v2.1/servers/e822b468-16f3-4a20-94d9-7a2517802a92/os-interface => generated 284 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:05:07.435835 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-179a4262-506f-4a96-9e1b-9c61bd3cfb12 tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Action: 'create', calling method: .version_select at 0x7f847c94b700>, body: {"keypair": {"name": "tempest-keypair-1883150369", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP9xBtSaXWzDL55V89ACk6lG/S8yg++yX0Bk3PiyAzsqmud/pg00Zclq4n+EwQwBVD1HK1CQdBPyXZRmiJkuTbBSZEOsp5h22e6LO9pDN9rHzGvhy7V8dUeI53sSNuvimQ=="}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:05:07.440013 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-7a499d21-a814-4f45-9d9f-c0cc2f7e4bd1 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:05:07.440629 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-7a499d21-a814-4f45-9d9f-c0cc2f7e4bd1 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] [instance: 45beadf1-a6da-49ab-9098-6b681b5184c9] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:05:07.458041 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7a499d21-a814-4f45-9d9f-c0cc2f7e4bd1 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:07.458594 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7a499d21-a814-4f45-9d9f-c0cc2f7e4bd1 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:07.468583 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7a499d21-a814-4f45-9d9f-c0cc2f7e4bd1 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:07.474113 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7a499d21-a814-4f45-9d9f-c0cc2f7e4bd1 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:07.476091 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7a499d21-a814-4f45-9d9f-c0cc2f7e4bd1 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:07.481250 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7a499d21-a814-4f45-9d9f-c0cc2f7e4bd1 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:07.499865 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-179a4262-506f-4a96-9e1b-9c61bd3cfb12 tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Getting quotas for project 9960516a057e4f629fe5deb41e54d1d7. Resources: {'key_pairs'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:05:07.520798 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-179a4262-506f-4a96-9e1b-9c61bd3cfb12 tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Getting quotas for user b9a2a5950cd342da86821122c08f028b and project 9960516a057e4f629fe5deb41e54d1d7. Resources: {'key_pairs'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:05:07.574687 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-179a4262-506f-4a96-9e1b-9c61bd3cfb12 tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.424400 Aug 10 23:05:07.576257 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1066/2134] 10.222.0.58 () {60 vars in 1159 bytes} [Wed Aug 10 23:05:07 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 23:05:07.994094 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-5dfd916f-a8ca-42ff-b066-ca77c47bf49f tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:05:07.996324 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-5dfd916f-a8ca-42ff-b066-ca77c47bf49f tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] [instance: f08ce987-9b15-48ba-8a71-a9c58616c789] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:05:08.008634 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5dfd916f-a8ca-42ff-b066-ca77c47bf49f tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:08.013956 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5dfd916f-a8ca-42ff-b066-ca77c47bf49f tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:08.018813 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5dfd916f-a8ca-42ff-b066-ca77c47bf49f tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:08.020213 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5dfd916f-a8ca-42ff-b066-ca77c47bf49f tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:08.024224 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5dfd916f-a8ca-42ff-b066-ca77c47bf49f tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:08.025085 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5dfd916f-a8ca-42ff-b066-ca77c47bf49f tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:08.557384 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-5dfd916f-a8ca-42ff-b066-ca77c47bf49f tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de244f1f82143a0b3d3283c31d80bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14c63df2e6c46d2af23b6b8a52690d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:05:08.575709 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-5dfd916f-a8ca-42ff-b066-ca77c47bf49f tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] 10.222.0.58 "GET /compute/v2.1/servers/f08ce987-9b15-48ba-8a71-a9c58616c789" status: 200 len: 1313 microversion: 2.1 time: 0.589944 Aug 10 23:05:08.576581 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1067/2135] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:05:07 2022] GET /compute/v2.1/servers/f08ce987-9b15-48ba-8a71-a9c58616c789 => generated 1313 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:05:09.233711 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-7a499d21-a814-4f45-9d9f-c0cc2f7e4bd1 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1986185dc9b4df4affcc421365462f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597863bfebdc481188f1f30095da5396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:05:09.250113 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-7a499d21-a814-4f45-9d9f-c0cc2f7e4bd1 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] 10.222.0.58 "GET /compute/v2.1/servers/45beadf1-a6da-49ab-9098-6b681b5184c9" status: 200 len: 1363 microversion: 2.1 time: 1.817075 Aug 10 23:05:09.251403 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1069/2136] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:05:07 2022] GET /compute/v2.1/servers/45beadf1-a6da-49ab-9098-6b681b5184c9 => generated 1363 bytes in 1819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:05:09.615519 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-bbf1b09a-f3aa-4300-b0e7-30692b323dee tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:05:09.619101 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-bbf1b09a-f3aa-4300-b0e7-30692b323dee tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] [instance: f08ce987-9b15-48ba-8a71-a9c58616c789] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:05:09.633969 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:05:09.644427 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bbf1b09a-f3aa-4300-b0e7-30692b323dee tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:09.645270 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bbf1b09a-f3aa-4300-b0e7-30692b323dee tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:09.645350 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bbf1b09a-f3aa-4300-b0e7-30692b323dee tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:09.647492 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bbf1b09a-f3aa-4300-b0e7-30692b323dee tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:09.647963 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bbf1b09a-f3aa-4300-b0e7-30692b323dee tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:09.648397 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bbf1b09a-f3aa-4300-b0e7-30692b323dee tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:10.276623 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-fb99cc33-8ac0-49af-b817-dc5574420825 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:05:10.277242 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-fb99cc33-8ac0-49af-b817-dc5574420825 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] [instance: 45beadf1-a6da-49ab-9098-6b681b5184c9] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:05:10.283971 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=2 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:05:10.287630 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fb99cc33-8ac0-49af-b817-dc5574420825 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:10.294492 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fb99cc33-8ac0-49af-b817-dc5574420825 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:10.295299 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fb99cc33-8ac0-49af-b817-dc5574420825 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:10.296232 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fb99cc33-8ac0-49af-b817-dc5574420825 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:10.296846 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fb99cc33-8ac0-49af-b817-dc5574420825 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:10.301472 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fb99cc33-8ac0-49af-b817-dc5574420825 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:10.535303 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-bbf1b09a-f3aa-4300-b0e7-30692b323dee tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de244f1f82143a0b3d3283c31d80bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14c63df2e6c46d2af23b6b8a52690d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:05:10.544364 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-bbf1b09a-f3aa-4300-b0e7-30692b323dee tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] 10.222.0.58 "GET /compute/v2.1/servers/f08ce987-9b15-48ba-8a71-a9c58616c789" status: 200 len: 1313 microversion: 2.1 time: 0.948039 Aug 10 23:05:10.544998 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1068/2137] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:05:09 2022] GET /compute/v2.1/servers/f08ce987-9b15-48ba-8a71-a9c58616c789 => generated 1313 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:05:10.889513 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-fb99cc33-8ac0-49af-b817-dc5574420825 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1986185dc9b4df4affcc421365462f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597863bfebdc481188f1f30095da5396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:05:10.898704 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-fb99cc33-8ac0-49af-b817-dc5574420825 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] 10.222.0.58 "GET /compute/v2.1/servers/45beadf1-a6da-49ab-9098-6b681b5184c9" status: 200 len: 1549 microversion: 2.1 time: 0.625974 Aug 10 23:05:10.904958 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1070/2138] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:05:10 2022] GET /compute/v2.1/servers/45beadf1-a6da-49ab-9098-6b681b5184c9 => generated 1549 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:05:10.930441 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-ee0432a3-7680-40e1-94c8-28f52f261f21 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:05:10.932278 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-ee0432a3-7680-40e1-94c8-28f52f261f21 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] [instance: 45beadf1-a6da-49ab-9098-6b681b5184c9] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:05:10.941113 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ee0432a3-7680-40e1-94c8-28f52f261f21 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:10.941911 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ee0432a3-7680-40e1-94c8-28f52f261f21 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:10.943046 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ee0432a3-7680-40e1-94c8-28f52f261f21 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:10.949844 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ee0432a3-7680-40e1-94c8-28f52f261f21 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:10.955366 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ee0432a3-7680-40e1-94c8-28f52f261f21 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:10.956394 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ee0432a3-7680-40e1-94c8-28f52f261f21 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:11.250391 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-4ea3556e-8f90-46a3-9186-a89da10ce699 req-f5026c02-3a79-46d4-be7d-205176f75781 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f08ce987-9b15-48ba-8a71-a9c58616c789", "tag": "8b5a3d3b-7337-4c9b-8f89-ec55547858f9"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:05:11.281450 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-4ea3556e-8f90-46a3-9186-a89da10ce699 req-f5026c02-3a79-46d4-be7d-205176f75781 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:11.286303 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-4ea3556e-8f90-46a3-9186-a89da10ce699 req-f5026c02-3a79-46d4-be7d-205176f75781 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:11.287010 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-4ea3556e-8f90-46a3-9186-a89da10ce699 req-f5026c02-3a79-46d4-be7d-205176f75781 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:11.318281 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-4ea3556e-8f90-46a3-9186-a89da10ce699 req-f5026c02-3a79-46d4-be7d-205176f75781 service nova] Creating event network-changed:8b5a3d3b-7337-4c9b-8f89-ec55547858f9 for instance f08ce987-9b15-48ba-8a71-a9c58616c789 on n-h1-850468-14 Aug 10 23:05:11.324672 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-4ea3556e-8f90-46a3-9186-a89da10ce699 req-f5026c02-3a79-46d4-be7d-205176f75781 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077616 Aug 10 23:05:11.326095 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1071/2139] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:05:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:05:11.567271 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-f48bc6de-fd2f-449a-baad-713363bdc8eb tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:05:11.568075 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-f48bc6de-fd2f-449a-baad-713363bdc8eb tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] [instance: f08ce987-9b15-48ba-8a71-a9c58616c789] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:05:11.579045 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f48bc6de-fd2f-449a-baad-713363bdc8eb tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:11.584979 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f48bc6de-fd2f-449a-baad-713363bdc8eb tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:11.586880 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f48bc6de-fd2f-449a-baad-713363bdc8eb tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:11.591206 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f48bc6de-fd2f-449a-baad-713363bdc8eb tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:11.591344 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-ee0432a3-7680-40e1-94c8-28f52f261f21 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] 10.222.0.58 "GET /compute/v2.1/servers/45beadf1-a6da-49ab-9098-6b681b5184c9/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.669181 Aug 10 23:05:11.591842 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f48bc6de-fd2f-449a-baad-713363bdc8eb tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:11.592317 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1069/2140] 10.222.0.58 () {58 vars in 1275 bytes} [Wed Aug 10 23:05:10 2022] GET /compute/v2.1/servers/45beadf1-a6da-49ab-9098-6b681b5184c9/os-interface => generated 285 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:05:11.596512 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f48bc6de-fd2f-449a-baad-713363bdc8eb tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:11.831894 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-001e2eaa-6aba-446b-9abb-11cf222d5c17 tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-157927389", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452", "networks": [{"uuid": "08b082ca-1914-4b5a-a95f-5a10f05c8ff5"}]}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:05:11.923247 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.network.neutron [None req-001e2eaa-6aba-446b-9abb-11cf222d5c17 tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] validate_networks() for [('08b082ca-1914-4b5a-a95f-5a10f05c8ff5', None, None, None, None, None)] {{(pid=122633) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 23:05:11.999992 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-f48bc6de-fd2f-449a-baad-713363bdc8eb tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de244f1f82143a0b3d3283c31d80bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14c63df2e6c46d2af23b6b8a52690d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:05:12.008067 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-f48bc6de-fd2f-449a-baad-713363bdc8eb tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] 10.222.0.58 "GET /compute/v2.1/servers/f08ce987-9b15-48ba-8a71-a9c58616c789" status: 200 len: 1313 microversion: 2.1 time: 0.445060 Aug 10 23:05:12.015701 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1072/2141] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:05:11 2022] GET /compute/v2.1/servers/f08ce987-9b15-48ba-8a71-a9c58616c789 => generated 1313 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:05:13.045472 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-dd723ece-bc52-4b67-8095-e6702b66f1a0 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:05:13.045926 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-dd723ece-bc52-4b67-8095-e6702b66f1a0 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] [instance: f08ce987-9b15-48ba-8a71-a9c58616c789] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:05:13.062909 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dd723ece-bc52-4b67-8095-e6702b66f1a0 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:13.063728 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dd723ece-bc52-4b67-8095-e6702b66f1a0 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:13.064353 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dd723ece-bc52-4b67-8095-e6702b66f1a0 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:13.065268 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dd723ece-bc52-4b67-8095-e6702b66f1a0 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:13.066093 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dd723ece-bc52-4b67-8095-e6702b66f1a0 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:13.066913 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dd723ece-bc52-4b67-8095-e6702b66f1a0 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:13.103395 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=100 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:05:13.484196 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-dd723ece-bc52-4b67-8095-e6702b66f1a0 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de244f1f82143a0b3d3283c31d80bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14c63df2e6c46d2af23b6b8a52690d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:05:13.496638 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-dd723ece-bc52-4b67-8095-e6702b66f1a0 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] 10.222.0.58 "GET /compute/v2.1/servers/f08ce987-9b15-48ba-8a71-a9c58616c789" status: 200 len: 1313 microversion: 2.1 time: 0.460832 Aug 10 23:05:13.511766 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1073/2142] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:05:13 2022] GET /compute/v2.1/servers/f08ce987-9b15-48ba-8a71-a9c58616c789 => generated 1313 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:05:13.719411 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-9cb3ec48-97b4-4bc7-a08e-10edc18bbdde tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:05:13.720491 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-9cb3ec48-97b4-4bc7-a08e-10edc18bbdde tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] [instance: e822b468-16f3-4a20-94d9-7a2517802a92] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:05:13.728236 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9cb3ec48-97b4-4bc7-a08e-10edc18bbdde tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:13.730548 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9cb3ec48-97b4-4bc7-a08e-10edc18bbdde tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:13.731495 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9cb3ec48-97b4-4bc7-a08e-10edc18bbdde tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:13.732605 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9cb3ec48-97b4-4bc7-a08e-10edc18bbdde tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:13.733359 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9cb3ec48-97b4-4bc7-a08e-10edc18bbdde tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:13.734165 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9cb3ec48-97b4-4bc7-a08e-10edc18bbdde tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:14.249430 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-9cb3ec48-97b4-4bc7-a08e-10edc18bbdde tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf1bcb51dec4134ac27ea7964684c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27408df8ea9f4d848b15b0bbba451a21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:05:14.263575 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-9cb3ec48-97b4-4bc7-a08e-10edc18bbdde tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] 10.222.0.58 "GET /compute/v2.1/servers/e822b468-16f3-4a20-94d9-7a2517802a92" status: 200 len: 1573 microversion: 2.1 time: 0.545931 Aug 10 23:05:14.266063 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1074/2143] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:05:13 2022] GET /compute/v2.1/servers/e822b468-16f3-4a20-94d9-7a2517802a92 => generated 1573 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:05:14.305461 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-ef6a8fdb-a5a0-406a-96c3-1cea5f7b4e7c req-8df50669-6a2a-4cbf-9144-b4601dc5e705 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e822b468-16f3-4a20-94d9-7a2517802a92", "tag": "975c2c0f-d400-4824-a681-225263ddf461"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:05:14.333611 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-ef6a8fdb-a5a0-406a-96c3-1cea5f7b4e7c req-8df50669-6a2a-4cbf-9144-b4601dc5e705 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:14.335444 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-ef6a8fdb-a5a0-406a-96c3-1cea5f7b4e7c req-8df50669-6a2a-4cbf-9144-b4601dc5e705 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:14.335807 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-ef6a8fdb-a5a0-406a-96c3-1cea5f7b4e7c req-8df50669-6a2a-4cbf-9144-b4601dc5e705 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:14.363196 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-ef6a8fdb-a5a0-406a-96c3-1cea5f7b4e7c req-8df50669-6a2a-4cbf-9144-b4601dc5e705 service nova] Creating event network-changed:975c2c0f-d400-4824-a681-225263ddf461 for instance e822b468-16f3-4a20-94d9-7a2517802a92 on n-h2-850468-14 Aug 10 23:05:14.371352 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-ef6a8fdb-a5a0-406a-96c3-1cea5f7b4e7c req-8df50669-6a2a-4cbf-9144-b4601dc5e705 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071594 Aug 10 23:05:14.373141 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1075/2144] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:05:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:05:14.522510 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-efdf28fb-262b-4fdf-9fe6-11d7e2ac596d tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:05:14.523733 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-efdf28fb-262b-4fdf-9fe6-11d7e2ac596d tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] [instance: f08ce987-9b15-48ba-8a71-a9c58616c789] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:05:14.539801 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-efdf28fb-262b-4fdf-9fe6-11d7e2ac596d tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:14.542332 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-efdf28fb-262b-4fdf-9fe6-11d7e2ac596d tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:14.543310 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-efdf28fb-262b-4fdf-9fe6-11d7e2ac596d tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:14.545591 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-efdf28fb-262b-4fdf-9fe6-11d7e2ac596d tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:14.547707 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-efdf28fb-262b-4fdf-9fe6-11d7e2ac596d tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:14.551816 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-efdf28fb-262b-4fdf-9fe6-11d7e2ac596d tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:14.653694 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-001e2eaa-6aba-446b-9abb-11cf222d5c17 tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Flavor limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:05:14.657172 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-001e2eaa-6aba-446b-9abb-11cf222d5c17 tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Image limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:05:14.657852 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-001e2eaa-6aba-446b-9abb-11cf222d5c17 tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Flavor pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:05:14.658599 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-001e2eaa-6aba-446b-9abb-11cf222d5c17 tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Image pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:05:14.659224 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-001e2eaa-6aba-446b-9abb-11cf222d5c17 tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:05:14.673529 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-001e2eaa-6aba-446b-9abb-11cf222d5c17 tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:14.683644 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-001e2eaa-6aba-446b-9abb-11cf222d5c17 tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:14.684351 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-001e2eaa-6aba-446b-9abb-11cf222d5c17 tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:14.685793 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-001e2eaa-6aba-446b-9abb-11cf222d5c17 tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:14.686564 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-001e2eaa-6aba-446b-9abb-11cf222d5c17 tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:14.687678 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-001e2eaa-6aba-446b-9abb-11cf222d5c17 tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:14.726241 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-001e2eaa-6aba-446b-9abb-11cf222d5c17 tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Getting quotas for project 13d6f13784504fc7b2fcf0d6957b4920. Resources: {'instances', 'cores', 'ram'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:05:14.738146 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-001e2eaa-6aba-446b-9abb-11cf222d5c17 tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Getting quotas for user 933e6a08c3014b36aee164b213bbfaf0 and project 13d6f13784504fc7b2fcf0d6957b4920. Resources: {'instances', 'cores', 'ram'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:05:14.775329 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-001e2eaa-6aba-446b-9abb-11cf222d5c17 tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Going to run 1 instances... {{(pid=122633) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 23:05:14.781106 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-001e2eaa-6aba-446b-9abb-11cf222d5c17 tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] [instance: 717a8812-6a48-49ad-baa8-0cf0fb41671d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78ad8905-f66f-4733-8be9-2b260f1fabed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122633) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 23:05:14.887204 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-001e2eaa-6aba-446b-9abb-11cf222d5c17 tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.150870 Aug 10 23:05:14.893488 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1070/2145] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 23:05:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 3155 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 10 23:05:14.898602 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-a5080317-62f4-4d39-b673-e61a993d18d8 tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:05:14.899245 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-a5080317-62f4-4d39-b673-e61a993d18d8 tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] [instance: 717a8812-6a48-49ad-baa8-0cf0fb41671d] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:05:15.131225 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-efdf28fb-262b-4fdf-9fe6-11d7e2ac596d tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de244f1f82143a0b3d3283c31d80bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14c63df2e6c46d2af23b6b8a52690d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:05:15.140566 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-efdf28fb-262b-4fdf-9fe6-11d7e2ac596d tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] 10.222.0.58 "GET /compute/v2.1/servers/f08ce987-9b15-48ba-8a71-a9c58616c789" status: 200 len: 1313 microversion: 2.1 time: 0.623794 Aug 10 23:05:15.146727 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1076/2146] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:05:14 2022] GET /compute/v2.1/servers/f08ce987-9b15-48ba-8a71-a9c58616c789 => generated 1313 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:05:15.804782 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-a5080317-62f4-4d39-b673-e61a993d18d8 tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '933e6a08c3014b36aee164b213bbfaf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d6f13784504fc7b2fcf0d6957b4920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:05:15.817824 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-a5080317-62f4-4d39-b673-e61a993d18d8 tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] 10.222.0.58 "GET /compute/v2.1/servers/717a8812-6a48-49ad-baa8-0cf0fb41671d" status: 200 len: 1223 microversion: 2.1 time: 0.922714 Aug 10 23:05:15.819597 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1071/2147] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:05:14 2022] GET /compute/v2.1/servers/717a8812-6a48-49ad-baa8-0cf0fb41671d => generated 1223 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:05:16.173329 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-7369277a-c6d7-4ab6-8b9b-4f0a1ee0440c tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:05:16.174151 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-7369277a-c6d7-4ab6-8b9b-4f0a1ee0440c tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] [instance: f08ce987-9b15-48ba-8a71-a9c58616c789] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:05:16.194126 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7369277a-c6d7-4ab6-8b9b-4f0a1ee0440c tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:16.194627 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7369277a-c6d7-4ab6-8b9b-4f0a1ee0440c tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:16.195546 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7369277a-c6d7-4ab6-8b9b-4f0a1ee0440c tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:16.195984 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7369277a-c6d7-4ab6-8b9b-4f0a1ee0440c tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:16.196383 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7369277a-c6d7-4ab6-8b9b-4f0a1ee0440c tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:16.196817 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7369277a-c6d7-4ab6-8b9b-4f0a1ee0440c tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:16.512690 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-7369277a-c6d7-4ab6-8b9b-4f0a1ee0440c tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de244f1f82143a0b3d3283c31d80bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14c63df2e6c46d2af23b6b8a52690d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:05:16.533263 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-7369277a-c6d7-4ab6-8b9b-4f0a1ee0440c tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] 10.222.0.58 "GET /compute/v2.1/servers/f08ce987-9b15-48ba-8a71-a9c58616c789" status: 200 len: 1313 microversion: 2.1 time: 0.363892 Aug 10 23:05:16.553480 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1077/2148] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:05:16 2022] GET /compute/v2.1/servers/f08ce987-9b15-48ba-8a71-a9c58616c789 => generated 1313 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:05:16.840542 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-fb90917a-09a2-44f1-9877-cc28d581399d tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:05:16.841081 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-fb90917a-09a2-44f1-9877-cc28d581399d tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] [instance: 717a8812-6a48-49ad-baa8-0cf0fb41671d] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:05:16.868840 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fb90917a-09a2-44f1-9877-cc28d581399d tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:16.868840 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fb90917a-09a2-44f1-9877-cc28d581399d tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:16.870577 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fb90917a-09a2-44f1-9877-cc28d581399d tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:16.872718 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fb90917a-09a2-44f1-9877-cc28d581399d tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:16.877737 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fb90917a-09a2-44f1-9877-cc28d581399d tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:16.879712 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fb90917a-09a2-44f1-9877-cc28d581399d tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:17.127014 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-fb90917a-09a2-44f1-9877-cc28d581399d tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '933e6a08c3014b36aee164b213bbfaf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d6f13784504fc7b2fcf0d6957b4920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:05:17.140833 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-fb90917a-09a2-44f1-9877-cc28d581399d tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] 10.222.0.58 "GET /compute/v2.1/servers/717a8812-6a48-49ad-baa8-0cf0fb41671d" status: 200 len: 1293 microversion: 2.1 time: 0.305244 Aug 10 23:05:17.142263 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1072/2149] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:05:16 2022] GET /compute/v2.1/servers/717a8812-6a48-49ad-baa8-0cf0fb41671d => generated 1293 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:05:17.575822 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-f09eb948-f54f-4426-9ad5-d3122c644666 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:05:17.576966 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-f09eb948-f54f-4426-9ad5-d3122c644666 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] [instance: f08ce987-9b15-48ba-8a71-a9c58616c789] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:05:17.589818 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-65f2335e-8047-444c-bc79-55a530540762 req-fd8b374a-e092-4640-9bf7-fd42f97f4ceb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f08ce987-9b15-48ba-8a71-a9c58616c789", "name": "network-vif-plugged", "status": "completed", "tag": "8b5a3d3b-7337-4c9b-8f89-ec55547858f9"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:05:17.590040 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f09eb948-f54f-4426-9ad5-d3122c644666 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:17.590751 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f09eb948-f54f-4426-9ad5-d3122c644666 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:17.591451 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f09eb948-f54f-4426-9ad5-d3122c644666 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:17.592360 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f09eb948-f54f-4426-9ad5-d3122c644666 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:17.592927 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f09eb948-f54f-4426-9ad5-d3122c644666 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:17.594920 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f09eb948-f54f-4426-9ad5-d3122c644666 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:17.613334 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-65f2335e-8047-444c-bc79-55a530540762 req-fd8b374a-e092-4640-9bf7-fd42f97f4ceb service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:17.613821 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-65f2335e-8047-444c-bc79-55a530540762 req-fd8b374a-e092-4640-9bf7-fd42f97f4ceb service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:17.614254 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-65f2335e-8047-444c-bc79-55a530540762 req-fd8b374a-e092-4640-9bf7-fd42f97f4ceb service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:17.630225 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-65f2335e-8047-444c-bc79-55a530540762 req-fd8b374a-e092-4640-9bf7-fd42f97f4ceb service nova] Creating event network-vif-plugged:8b5a3d3b-7337-4c9b-8f89-ec55547858f9 for instance f08ce987-9b15-48ba-8a71-a9c58616c789 on n-h1-850468-14 Aug 10 23:05:17.636470 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-65f2335e-8047-444c-bc79-55a530540762 req-fd8b374a-e092-4640-9bf7-fd42f97f4ceb service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051083 Aug 10 23:05:17.639361 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1073/2150] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:05:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 23:05:17.994569 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-f09eb948-f54f-4426-9ad5-d3122c644666 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de244f1f82143a0b3d3283c31d80bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14c63df2e6c46d2af23b6b8a52690d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:05:18.012416 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-f09eb948-f54f-4426-9ad5-d3122c644666 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] 10.222.0.58 "GET /compute/v2.1/servers/f08ce987-9b15-48ba-8a71-a9c58616c789" status: 200 len: 1313 microversion: 2.1 time: 0.440352 Aug 10 23:05:18.023138 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1078/2151] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:05:17 2022] GET /compute/v2.1/servers/f08ce987-9b15-48ba-8a71-a9c58616c789 => generated 1313 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:05:18.028874 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-bb202c39-e2e4-4c96-925a-15358d7f632e req-d70d382f-00c5-4509-846b-d28c07943af7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45beadf1-a6da-49ab-9098-6b681b5184c9", "tag": "896d850e-4103-42f9-83bc-43f3e82924c2"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:05:18.059474 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-bb202c39-e2e4-4c96-925a-15358d7f632e req-d70d382f-00c5-4509-846b-d28c07943af7 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:18.061645 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-bb202c39-e2e4-4c96-925a-15358d7f632e req-d70d382f-00c5-4509-846b-d28c07943af7 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:18.062954 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-bb202c39-e2e4-4c96-925a-15358d7f632e req-d70d382f-00c5-4509-846b-d28c07943af7 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:18.095439 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-bb202c39-e2e4-4c96-925a-15358d7f632e req-d70d382f-00c5-4509-846b-d28c07943af7 service nova] Creating event network-changed:896d850e-4103-42f9-83bc-43f3e82924c2 for instance 45beadf1-a6da-49ab-9098-6b681b5184c9 on n-h2-850468-14 Aug 10 23:05:18.102008 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-bb202c39-e2e4-4c96-925a-15358d7f632e req-d70d382f-00c5-4509-846b-d28c07943af7 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077212 Aug 10 23:05:18.105114 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1079/2152] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:05:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:05:18.163964 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-4218ea1c-271b-4bf9-9cf9-ff42481d32b6 tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:05:18.164673 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-4218ea1c-271b-4bf9-9cf9-ff42481d32b6 tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] [instance: 717a8812-6a48-49ad-baa8-0cf0fb41671d] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:05:18.179570 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4218ea1c-271b-4bf9-9cf9-ff42481d32b6 tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:18.180079 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4218ea1c-271b-4bf9-9cf9-ff42481d32b6 tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:18.180533 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4218ea1c-271b-4bf9-9cf9-ff42481d32b6 tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:18.181266 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4218ea1c-271b-4bf9-9cf9-ff42481d32b6 tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:18.185974 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4218ea1c-271b-4bf9-9cf9-ff42481d32b6 tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:18.186610 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4218ea1c-271b-4bf9-9cf9-ff42481d32b6 tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:18.234827 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-d298c854-b714-4ac0-8f38-1684f56a5f04 tempest-ListImageFiltersNegativeTestJSON-1003206650 tempest-ListImageFiltersNegativeTestJSON-1003206650-project] Calling method '.version_select at 0x7f847c94b9d0>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:05:18.271618 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-d298c854-b714-4ac0-8f38-1684f56a5f04 tempest-ListImageFiltersNegativeTestJSON-1003206650 tempest-ListImageFiltersNegativeTestJSON-1003206650-project] HTTP exception thrown: Image not found. Aug 10 23:05:18.276468 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-d298c854-b714-4ac0-8f38-1684f56a5f04 tempest-ListImageFiltersNegativeTestJSON-1003206650 tempest-ListImageFiltersNegativeTestJSON-1003206650-project] Request method failure captured: Aug 10 23:05:18.276468 n-d-850468-14 devstack@n-api.service[122633]: request: GET /compute/v2.1/images/29f02cbb-ecb4-42cb-bc94-3e4cb6b8479a HTTP/1.1 Aug 10 23:05:18.276468 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:05:18.276468 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:05:18.276468 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:05:18.276468 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:05:18.276468 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:05:18.276468 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:05:18.276468 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:05:18.276468 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:05:18.276468 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9DmtvvqI2Aqf4rmtz8uRh1zKhl7N4RZzemzJksqOkZNjiRphiQSPJeniWTN_0ioZpT7fmx-IYcATAbZV3apCbJdiNewGatyrFwt3bNLsI3eB4apDcAWVHcfMmDvn12DuoBhw2U0wRaO4y8D1qiZd94uLXxsxZrpweez0YyHJs9v355g Aug 10 23:05:18.276468 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:05:18.276468 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:05:18.276468 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:05:18.276468 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:05:18.276468 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:05:18.276468 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:05:18.276468 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: d36524b41d504e9fb8b275407a02921a Aug 10 23:05:18.276468 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-1003206650 Aug 10 23:05:18.276468 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:05:18.276468 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:05:18.278160 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d36524b41d504e9fb8b275407a02921a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d36524b41d504e9fb8b275407a02921a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d36524b41d504e9fb8b275407a02921a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d36524b41d504e9fb8b275407a02921a", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:05:18.278160 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-1003206650 Aug 10 23:05:18.278160 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: d36524b41d504e9fb8b275407a02921a Aug 10 23:05:18.278160 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-1003206650 Aug 10 23:05:18.278160 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-ListImageFiltersNegativeTestJSON-1003206650-project Aug 10 23:05:18.278160 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:05:18.278160 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:05:18.278160 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: b9c4ac94cd70473bae23052bc1d0f0ac Aug 10 23:05:18.278160 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-1003206650-project Aug 10 23:05:18.278160 n-d-850468-14 devstack@n-api.service[122633]: method: Aug 10 23:05:18.278160 n-d-850468-14 devstack@n-api.service[122633]: exception: Image not found. Aug 10 23:05:18.278160 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': '29f02cbb-ecb4-42cb-bc94-3e4cb6b8479a'} Aug 10 23:05:18.278160 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:05:18.278883 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:05:18.278883 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 10 23:05:18.278883 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 10 23:05:18.278883 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 10 23:05:18.278883 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 10 23:05:18.278883 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 10 23:05:18.278883 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 10 23:05:18.278883 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 10 23:05:18.278883 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 10 23:05:18.278883 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 10 23:05:18.278883 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 10 23:05:18.278883 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 10 23:05:18.278883 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 10 23:05:18.278883 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 10 23:05:18.278883 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 10 23:05:18.278883 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 10 23:05:18.278883 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 10 23:05:18.278883 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 29f02cbb-ecb4-42cb-bc94-3e4cb6b8479a Aug 10 23:05:18.279835 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:05:18.279835 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:05:18.279835 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:05:18.279835 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:05:18.279835 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Aug 10 23:05:18.279835 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Aug 10 23:05:18.279835 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 10 23:05:18.279835 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 10 23:05:18.279835 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 10 23:05:18.279835 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 10 23:05:18.279835 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 10 23:05:18.279835 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 10 23:05:18.279835 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 10 23:05:18.279835 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 10 23:05:18.279835 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 10 23:05:18.279835 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 10 23:05:18.279835 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 10 23:05:18.279835 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 10 23:05:18.279835 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 10 23:05:18.279835 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 10 23:05:18.280848 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 10 23:05:18.280848 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 10 23:05:18.280848 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 10 23:05:18.280848 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 10 23:05:18.280848 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 10 23:05:18.280848 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 10 23:05:18.280848 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 10 23:05:18.280848 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 10 23:05:18.280848 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 29f02cbb-ecb4-42cb-bc94-3e4cb6b8479a could not be found. Aug 10 23:05:18.280848 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:05:18.280848 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:05:18.280848 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:05:18.280848 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:05:18.280848 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:05:18.280848 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:05:18.280848 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:05:18.280848 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:05:18.280848 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 23:05:18.280848 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 23:05:18.281829 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:05:18.281829 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:05:18.281829 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Aug 10 23:05:18.281829 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 10 23:05:18.281829 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 10 23:05:18.281829 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:05:18.281829 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:05:18.281829 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:05:18.281829 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:05:18.281829 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:05:18.281829 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:05:18.281829 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:05:18.281829 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:05:18.281829 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 10 23:05:18.281829 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:05:18.289842 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-d298c854-b714-4ac0-8f38-1684f56a5f04 tempest-ListImageFiltersNegativeTestJSON-1003206650 tempest-ListImageFiltersNegativeTestJSON-1003206650-project] Returning 404 to user: Image not found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:05:18.291927 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-d298c854-b714-4ac0-8f38-1684f56a5f04 tempest-ListImageFiltersNegativeTestJSON-1003206650 tempest-ListImageFiltersNegativeTestJSON-1003206650-project] 10.222.0.58 "GET /compute/v2.1/images/29f02cbb-ecb4-42cb-bc94-3e4cb6b8479a" status: 404 len: 62 microversion: 2.1 time: 0.325667 Aug 10 23:05:18.293599 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1074/2153] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 10 23:05:17 2022] GET /compute/v2.1/images/29f02cbb-ecb4-42cb-bc94-3e4cb6b8479a => generated 62 bytes in 330 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 10 23:05:18.491595 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-4218ea1c-271b-4bf9-9cf9-ff42481d32b6 tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '933e6a08c3014b36aee164b213bbfaf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d6f13784504fc7b2fcf0d6957b4920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:05:18.501382 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-4218ea1c-271b-4bf9-9cf9-ff42481d32b6 tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] 10.222.0.58 "GET /compute/v2.1/servers/717a8812-6a48-49ad-baa8-0cf0fb41671d" status: 200 len: 1323 microversion: 2.1 time: 0.341798 Aug 10 23:05:18.501991 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1080/2154] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:05:18 2022] GET /compute/v2.1/servers/717a8812-6a48-49ad-baa8-0cf0fb41671d => generated 1323 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:05:18.922512 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-7d081793-122d-4f76-9d6f-866e09c43b0a tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-1011589967", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "2c7693b0-2f49-4252-a4e4-a96a1c59746d"}], "security_groups": [{"name": "tempest-securitygroup--1957156810"}], "key_name": "tempest-keypair-1883150369", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:05:19.037434 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c22fd0d4-f616-4bf5-aebb-0d101b0bdee5 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:05:19.038917 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-c22fd0d4-f616-4bf5-aebb-0d101b0bdee5 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] [instance: f08ce987-9b15-48ba-8a71-a9c58616c789] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:05:19.050351 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c22fd0d4-f616-4bf5-aebb-0d101b0bdee5 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:19.053433 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c22fd0d4-f616-4bf5-aebb-0d101b0bdee5 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:19.054034 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c22fd0d4-f616-4bf5-aebb-0d101b0bdee5 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:19.054947 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c22fd0d4-f616-4bf5-aebb-0d101b0bdee5 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:19.057868 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c22fd0d4-f616-4bf5-aebb-0d101b0bdee5 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:19.058725 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c22fd0d4-f616-4bf5-aebb-0d101b0bdee5 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:19.330844 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.network.neutron [None req-7d081793-122d-4f76-9d6f-866e09c43b0a tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] validate_networks() for [('2c7693b0-2f49-4252-a4e4-a96a1c59746d', None, None, None, None, None)] {{(pid=122633) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 23:05:20.170267 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-c22fd0d4-f616-4bf5-aebb-0d101b0bdee5 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de244f1f82143a0b3d3283c31d80bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14c63df2e6c46d2af23b6b8a52690d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:05:20.180452 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-c22fd0d4-f616-4bf5-aebb-0d101b0bdee5 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] 10.222.0.58 "GET /compute/v2.1/servers/f08ce987-9b15-48ba-8a71-a9c58616c789" status: 200 len: 1313 microversion: 2.1 time: 1.147950 Aug 10 23:05:20.185475 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1081/2155] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:05:19 2022] GET /compute/v2.1/servers/f08ce987-9b15-48ba-8a71-a9c58616c789 => generated 1313 bytes in 1153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:05:20.199000 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-0f0c961c-bbf4-4490-8fb0-3cbd3611956c tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:05:20.199835 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-0f0c961c-bbf4-4490-8fb0-3cbd3611956c tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] [instance: 717a8812-6a48-49ad-baa8-0cf0fb41671d] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:05:20.211387 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0f0c961c-bbf4-4490-8fb0-3cbd3611956c tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:20.214516 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0f0c961c-bbf4-4490-8fb0-3cbd3611956c tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:20.215190 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0f0c961c-bbf4-4490-8fb0-3cbd3611956c tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:20.217481 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0f0c961c-bbf4-4490-8fb0-3cbd3611956c tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:20.218109 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0f0c961c-bbf4-4490-8fb0-3cbd3611956c tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:20.223345 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0f0c961c-bbf4-4490-8fb0-3cbd3611956c tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:20.613641 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-0f0c961c-bbf4-4490-8fb0-3cbd3611956c tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '933e6a08c3014b36aee164b213bbfaf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d6f13784504fc7b2fcf0d6957b4920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:05:20.630659 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-0f0c961c-bbf4-4490-8fb0-3cbd3611956c tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] 10.222.0.58 "GET /compute/v2.1/servers/717a8812-6a48-49ad-baa8-0cf0fb41671d" status: 200 len: 1323 microversion: 2.1 time: 0.443652 Aug 10 23:05:20.636220 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1082/2156] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:05:20 2022] GET /compute/v2.1/servers/717a8812-6a48-49ad-baa8-0cf0fb41671d => generated 1323 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:05:20.681287 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-2646d5e9-fdfc-4fa5-a214-2cb302cbd653 req-5316c4c0-9286-4551-a70c-92332f92080e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "717a8812-6a48-49ad-baa8-0cf0fb41671d", "tag": "06ceffef-a360-4b97-8d79-f13f49f62568"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:05:20.739977 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-2646d5e9-fdfc-4fa5-a214-2cb302cbd653 req-5316c4c0-9286-4551-a70c-92332f92080e service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:20.750467 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-2646d5e9-fdfc-4fa5-a214-2cb302cbd653 req-5316c4c0-9286-4551-a70c-92332f92080e service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:20.755773 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-2646d5e9-fdfc-4fa5-a214-2cb302cbd653 req-5316c4c0-9286-4551-a70c-92332f92080e service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:20.776830 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-2646d5e9-fdfc-4fa5-a214-2cb302cbd653 req-5316c4c0-9286-4551-a70c-92332f92080e service nova] Creating event network-changed:06ceffef-a360-4b97-8d79-f13f49f62568 for instance 717a8812-6a48-49ad-baa8-0cf0fb41671d on n-h1-850468-14 Aug 10 23:05:20.798530 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-2646d5e9-fdfc-4fa5-a214-2cb302cbd653 req-5316c4c0-9286-4551-a70c-92332f92080e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.158538 Aug 10 23:05:20.799186 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1083/2157] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:05:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:05:20.844458 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-7d081793-122d-4f76-9d6f-866e09c43b0a tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Getting quotas for project 9960516a057e4f629fe5deb41e54d1d7. Resources: dict_keys(['metadata_items']) {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:05:20.857907 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-7d081793-122d-4f76-9d6f-866e09c43b0a tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Getting quotas for user b9a2a5950cd342da86821122c08f028b and project 9960516a057e4f629fe5deb41e54d1d7. Resources: dict_keys(['metadata_items']) {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:05:20.884724 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-7d081793-122d-4f76-9d6f-866e09c43b0a tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Flavor limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:05:20.886831 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-7d081793-122d-4f76-9d6f-866e09c43b0a tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Image limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:05:20.887515 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-7d081793-122d-4f76-9d6f-866e09c43b0a tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Flavor pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:05:20.888122 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-7d081793-122d-4f76-9d6f-866e09c43b0a tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Image pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:05:20.888730 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-7d081793-122d-4f76-9d6f-866e09c43b0a tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:05:20.908889 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7d081793-122d-4f76-9d6f-866e09c43b0a tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:20.909622 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7d081793-122d-4f76-9d6f-866e09c43b0a tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:20.910284 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7d081793-122d-4f76-9d6f-866e09c43b0a tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:20.911272 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7d081793-122d-4f76-9d6f-866e09c43b0a tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:20.911936 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7d081793-122d-4f76-9d6f-866e09c43b0a tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:20.912558 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7d081793-122d-4f76-9d6f-866e09c43b0a tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:20.945537 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-7d081793-122d-4f76-9d6f-866e09c43b0a tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Getting quotas for project 9960516a057e4f629fe5deb41e54d1d7. Resources: {'instances', 'cores', 'ram'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:05:20.952601 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-7d081793-122d-4f76-9d6f-866e09c43b0a tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Getting quotas for user b9a2a5950cd342da86821122c08f028b and project 9960516a057e4f629fe5deb41e54d1d7. Resources: {'instances', 'cores', 'ram'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:05:20.997525 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-7d081793-122d-4f76-9d6f-866e09c43b0a tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Going to run 1 instances... {{(pid=122633) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 23:05:21.000569 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-7d081793-122d-4f76-9d6f-866e09c43b0a tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] [instance: b9b9e57b-0669-46b6-afae-b5c439f688d2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78ad8905-f66f-4733-8be9-2b260f1fabed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122633) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 23:05:21.057398 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-7d081793-122d-4f76-9d6f-866e09c43b0a tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 2.140934 Aug 10 23:05:21.062460 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1075/2158] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 23:05:18 2022] POST /compute/v2.1/servers => generated 409 bytes in 2148 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 23:05:21.076514 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-cca86925-de51-4dc2-8960-2f65e4891236 tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:05:21.082114 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-cca86925-de51-4dc2-8960-2f65e4891236 tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] [instance: b9b9e57b-0669-46b6-afae-b5c439f688d2] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:05:21.208439 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-7e922a18-3378-4d34-ae4a-f4f3ed6ffbde tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:05:21.209106 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-7e922a18-3378-4d34-ae4a-f4f3ed6ffbde tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] [instance: f08ce987-9b15-48ba-8a71-a9c58616c789] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:05:21.222422 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7e922a18-3378-4d34-ae4a-f4f3ed6ffbde tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:21.222877 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7e922a18-3378-4d34-ae4a-f4f3ed6ffbde tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:21.223336 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7e922a18-3378-4d34-ae4a-f4f3ed6ffbde tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:21.229409 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7e922a18-3378-4d34-ae4a-f4f3ed6ffbde tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:21.230190 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7e922a18-3378-4d34-ae4a-f4f3ed6ffbde tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:21.230834 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7e922a18-3378-4d34-ae4a-f4f3ed6ffbde tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:21.265021 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-cca86925-de51-4dc2-8960-2f65e4891236 tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a2a5950cd342da86821122c08f028b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9960516a057e4f629fe5deb41e54d1d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:05:21.277648 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-cca86925-de51-4dc2-8960-2f65e4891236 tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] 10.222.0.58 "GET /compute/v2.1/servers/b9b9e57b-0669-46b6-afae-b5c439f688d2" status: 200 len: 1278 microversion: 2.1 time: 0.203972 Aug 10 23:05:21.278546 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1084/2159] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:05:21 2022] GET /compute/v2.1/servers/b9b9e57b-0669-46b6-afae-b5c439f688d2 => generated 1278 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:05:21.548850 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-7e922a18-3378-4d34-ae4a-f4f3ed6ffbde tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de244f1f82143a0b3d3283c31d80bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14c63df2e6c46d2af23b6b8a52690d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:05:21.569365 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-7e922a18-3378-4d34-ae4a-f4f3ed6ffbde tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] 10.222.0.58 "GET /compute/v2.1/servers/f08ce987-9b15-48ba-8a71-a9c58616c789" status: 200 len: 1463 microversion: 2.1 time: 0.353083 Aug 10 23:05:21.583412 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1076/2160] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:05:21 2022] GET /compute/v2.1/servers/f08ce987-9b15-48ba-8a71-a9c58616c789 => generated 1463 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:05:21.656941 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-523e8ff6-8aa7-4201-9f9e-28f50170f57e tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:05:21.657565 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-523e8ff6-8aa7-4201-9f9e-28f50170f57e tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] [instance: 717a8812-6a48-49ad-baa8-0cf0fb41671d] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:05:21.665322 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-523e8ff6-8aa7-4201-9f9e-28f50170f57e tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:21.665812 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-523e8ff6-8aa7-4201-9f9e-28f50170f57e tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:21.670228 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-523e8ff6-8aa7-4201-9f9e-28f50170f57e tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:21.672790 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-523e8ff6-8aa7-4201-9f9e-28f50170f57e tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:21.673271 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-523e8ff6-8aa7-4201-9f9e-28f50170f57e tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:21.675697 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-523e8ff6-8aa7-4201-9f9e-28f50170f57e tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:22.084741 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-430ce7a7-3f09-4518-9592-f64da1c77358 tempest-ServersAdminTestJSON-1449791209 tempest-ServersAdminTestJSON-1449791209-project-admin] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:05:22.090459 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-430ce7a7-3f09-4518-9592-f64da1c77358 tempest-ServersAdminTestJSON-1449791209 tempest-ServersAdminTestJSON-1449791209-project-admin] Searching by: {'deleted': False, 'project_id': '5acfeb45a31044e79c07af5165a5180a'} {{(pid=122632) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 10 23:05:22.100389 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_api:SELECT=85 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:05:22.113157 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-430ce7a7-3f09-4518-9592-f64da1c77358 tempest-ServersAdminTestJSON-1449791209 tempest-ServersAdminTestJSON-1449791209-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:22.115483 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-430ce7a7-3f09-4518-9592-f64da1c77358 tempest-ServersAdminTestJSON-1449791209 tempest-ServersAdminTestJSON-1449791209-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:22.116876 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-430ce7a7-3f09-4518-9592-f64da1c77358 tempest-ServersAdminTestJSON-1449791209 tempest-ServersAdminTestJSON-1449791209-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:22.118425 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-430ce7a7-3f09-4518-9592-f64da1c77358 tempest-ServersAdminTestJSON-1449791209 tempest-ServersAdminTestJSON-1449791209-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:22.120674 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-430ce7a7-3f09-4518-9592-f64da1c77358 tempest-ServersAdminTestJSON-1449791209 tempest-ServersAdminTestJSON-1449791209-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:22.122565 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-430ce7a7-3f09-4518-9592-f64da1c77358 tempest-ServersAdminTestJSON-1449791209 tempest-ServersAdminTestJSON-1449791209-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:22.173796 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-523e8ff6-8aa7-4201-9f9e-28f50170f57e tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '933e6a08c3014b36aee164b213bbfaf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d6f13784504fc7b2fcf0d6957b4920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:05:22.186284 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-523e8ff6-8aa7-4201-9f9e-28f50170f57e tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] 10.222.0.58 "GET /compute/v2.1/servers/717a8812-6a48-49ad-baa8-0cf0fb41671d" status: 200 len: 1323 microversion: 2.1 time: 0.533623 Aug 10 23:05:22.186955 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1077/2161] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:05:21 2022] GET /compute/v2.1/servers/717a8812-6a48-49ad-baa8-0cf0fb41671d => generated 1323 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:05:22.318861 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-430ce7a7-3f09-4518-9592-f64da1c77358 tempest-ServersAdminTestJSON-1449791209 tempest-ServersAdminTestJSON-1449791209-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.718247 Aug 10 23:05:22.339678 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1085/2162] 10.222.0.58 () {58 vars in 1146 bytes} [Wed Aug 10 23:05:21 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 23:05:22.353124 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-50054206-fef5-4442-961f-70b940690e79 tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:05:22.357351 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-03740c39-b8c9-49ce-ab8b-8c677e455c87 tempest-ListImagesTestJSON-560085251 tempest-ListImagesTestJSON-560085251-project] Calling method '.version_select at 0x7f847c8ff790>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:05:22.359674 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-50054206-fef5-4442-961f-70b940690e79 tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] [instance: b9b9e57b-0669-46b6-afae-b5c439f688d2] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:05:22.376051 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-50054206-fef5-4442-961f-70b940690e79 tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:22.376253 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-50054206-fef5-4442-961f-70b940690e79 tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:22.376700 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-50054206-fef5-4442-961f-70b940690e79 tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:22.377414 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-50054206-fef5-4442-961f-70b940690e79 tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:22.381041 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-50054206-fef5-4442-961f-70b940690e79 tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:22.386009 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-50054206-fef5-4442-961f-70b940690e79 tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:22.414229 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-03740c39-b8c9-49ce-ab8b-8c677e455c87 tempest-ListImagesTestJSON-560085251 tempest-ListImagesTestJSON-560085251-project] 10.222.0.58 "GET /compute/v2.1/images/78ad8905-f66f-4733-8be9-2b260f1fabed" status: 200 len: 784 microversion: 2.1 time: 0.224175 Aug 10 23:05:22.422603 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1078/2163] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 10 23:05:22 2022] GET /compute/v2.1/images/78ad8905-f66f-4733-8be9-2b260f1fabed => generated 784 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:05:22.429208 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-e2b8d37b-927e-4fa5-aa51-d269bd8ac23b tempest-ServersAdminTestJSON-1449791209 tempest-ServersAdminTestJSON-1449791209-project-admin] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:05:22.438376 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-e2b8d37b-927e-4fa5-aa51-d269bd8ac23b tempest-ServersAdminTestJSON-1449791209 tempest-ServersAdminTestJSON-1449791209-project-admin] Searching by: {'deleted': False} {{(pid=122633) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 10 23:05:22.450940 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e2b8d37b-927e-4fa5-aa51-d269bd8ac23b tempest-ServersAdminTestJSON-1449791209 tempest-ServersAdminTestJSON-1449791209-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:22.451759 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e2b8d37b-927e-4fa5-aa51-d269bd8ac23b tempest-ServersAdminTestJSON-1449791209 tempest-ServersAdminTestJSON-1449791209-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:22.465305 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e2b8d37b-927e-4fa5-aa51-d269bd8ac23b tempest-ServersAdminTestJSON-1449791209 tempest-ServersAdminTestJSON-1449791209-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:22.467263 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e2b8d37b-927e-4fa5-aa51-d269bd8ac23b tempest-ServersAdminTestJSON-1449791209 tempest-ServersAdminTestJSON-1449791209-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:22.469423 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e2b8d37b-927e-4fa5-aa51-d269bd8ac23b tempest-ServersAdminTestJSON-1449791209 tempest-ServersAdminTestJSON-1449791209-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:22.471519 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e2b8d37b-927e-4fa5-aa51-d269bd8ac23b tempest-ServersAdminTestJSON-1449791209 tempest-ServersAdminTestJSON-1449791209-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:22.561645 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-50054206-fef5-4442-961f-70b940690e79 tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a2a5950cd342da86821122c08f028b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9960516a057e4f629fe5deb41e54d1d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:05:22.570246 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-50054206-fef5-4442-961f-70b940690e79 tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] 10.222.0.58 "GET /compute/v2.1/servers/b9b9e57b-0669-46b6-afae-b5c439f688d2" status: 200 len: 1330 microversion: 2.1 time: 0.233179 Aug 10 23:05:22.571095 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1086/2164] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:05:22 2022] GET /compute/v2.1/servers/b9b9e57b-0669-46b6-afae-b5c439f688d2 => generated 1330 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:05:22.577795 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-7b06f040-ba6a-425b-b090-0e78c14c4bc3 tempest-ListImagesTestJSON-560085251 tempest-ListImagesTestJSON-560085251-project] Calling method '.version_select at 0x7f848252ed30>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:05:22.632630 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.multi_cell_list [None req-e2b8d37b-927e-4fa5-aa51-d269bd8ac23b tempest-ServersAdminTestJSON-1449791209 tempest-ServersAdminTestJSON-1449791209-project-admin] Listed batch of 7 results from cell out of 1000 limit. Returned 7 total so far. {{(pid=122633) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 10 23:05:22.659869 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-7b06f040-ba6a-425b-b090-0e78c14c4bc3 tempest-ListImagesTestJSON-560085251 tempest-ListImagesTestJSON-560085251-project] 10.222.0.58 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.087501 Aug 10 23:05:22.669848 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1087/2165] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 10 23:05:22 2022] GET /compute/v2.1/images => generated 445 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:05:22.692756 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-1aa98feb-3acc-4b8a-b826-29c2ab086103 tempest-ListImagesTestJSON-560085251 tempest-ListImagesTestJSON-560085251-project] Calling method '.version_select at 0x7f847d0240d0>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:05:22.771637 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-1aa98feb-3acc-4b8a-b826-29c2ab086103 tempest-ListImagesTestJSON-560085251 tempest-ListImagesTestJSON-560085251-project] 10.222.0.58 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.098121 Aug 10 23:05:22.772246 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1088/2166] 10.222.0.58 () {58 vars in 1143 bytes} [Wed Aug 10 23:05:22 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:05:22.782639 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e2b8d37b-927e-4fa5-aa51-d269bd8ac23b tempest-ServersAdminTestJSON-1449791209 tempest-ServersAdminTestJSON-1449791209-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:22.787333 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e2b8d37b-927e-4fa5-aa51-d269bd8ac23b tempest-ServersAdminTestJSON-1449791209 tempest-ServersAdminTestJSON-1449791209-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:22.788006 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e2b8d37b-927e-4fa5-aa51-d269bd8ac23b tempest-ServersAdminTestJSON-1449791209 tempest-ServersAdminTestJSON-1449791209-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:23.210612 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-17d980eb-41ab-4b96-8727-35f532424c1a tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:05:23.211292 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-17d980eb-41ab-4b96-8727-35f532424c1a tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] [instance: 717a8812-6a48-49ad-baa8-0cf0fb41671d] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:05:23.234570 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-17d980eb-41ab-4b96-8727-35f532424c1a tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:23.237094 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-17d980eb-41ab-4b96-8727-35f532424c1a tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:23.237548 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-17d980eb-41ab-4b96-8727-35f532424c1a tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:23.239680 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-17d980eb-41ab-4b96-8727-35f532424c1a tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:23.240219 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-17d980eb-41ab-4b96-8727-35f532424c1a tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:23.240649 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-17d980eb-41ab-4b96-8727-35f532424c1a tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:23.676752 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-17d980eb-41ab-4b96-8727-35f532424c1a tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '933e6a08c3014b36aee164b213bbfaf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d6f13784504fc7b2fcf0d6957b4920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:05:23.686245 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-e2b8d37b-927e-4fa5-aa51-d269bd8ac23b tempest-ServersAdminTestJSON-1449791209 tempest-ServersAdminTestJSON-1449791209-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 11415 microversion: 2.1 time: 1.262146 Aug 10 23:05:23.686872 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1079/2167] 10.222.0.58 () {58 vars in 1171 bytes} [Wed Aug 10 23:05:22 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 11415 bytes in 1263 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 23:05:23.694226 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-17d980eb-41ab-4b96-8727-35f532424c1a tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] 10.222.0.58 "GET /compute/v2.1/servers/717a8812-6a48-49ad-baa8-0cf0fb41671d" status: 200 len: 1323 microversion: 2.1 time: 0.488550 Aug 10 23:05:23.707023 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1089/2168] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:05:23 2022] GET /compute/v2.1/servers/717a8812-6a48-49ad-baa8-0cf0fb41671d => generated 1323 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:05:23.716411 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-2621adcd-bbf9-477d-87d2-a23cae0a51a7 tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:05:23.717214 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-2621adcd-bbf9-477d-87d2-a23cae0a51a7 tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] [instance: b9b9e57b-0669-46b6-afae-b5c439f688d2] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:05:23.721879 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-0aafa479-21ba-412b-af3e-b71ba110f279 tempest-ServersAdminTestJSON-1449791209 tempest-ServersAdminTestJSON-1449791209-project-admin] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:05:23.727280 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-0aafa479-21ba-412b-af3e-b71ba110f279 tempest-ServersAdminTestJSON-1449791209 tempest-ServersAdminTestJSON-1449791209-project-admin] Searching by: {'deleted': False, 'project_id': '5acfeb45a31044e79c07af5165a5180a'} {{(pid=122632) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 10 23:05:23.733388 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0aafa479-21ba-412b-af3e-b71ba110f279 tempest-ServersAdminTestJSON-1449791209 tempest-ServersAdminTestJSON-1449791209-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:23.734153 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0aafa479-21ba-412b-af3e-b71ba110f279 tempest-ServersAdminTestJSON-1449791209 tempest-ServersAdminTestJSON-1449791209-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:23.734768 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0aafa479-21ba-412b-af3e-b71ba110f279 tempest-ServersAdminTestJSON-1449791209 tempest-ServersAdminTestJSON-1449791209-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:23.735699 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0aafa479-21ba-412b-af3e-b71ba110f279 tempest-ServersAdminTestJSON-1449791209 tempest-ServersAdminTestJSON-1449791209-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:23.736350 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0aafa479-21ba-412b-af3e-b71ba110f279 tempest-ServersAdminTestJSON-1449791209 tempest-ServersAdminTestJSON-1449791209-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:23.737013 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0aafa479-21ba-412b-af3e-b71ba110f279 tempest-ServersAdminTestJSON-1449791209 tempest-ServersAdminTestJSON-1449791209-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:23.742927 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2621adcd-bbf9-477d-87d2-a23cae0a51a7 tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:23.743860 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2621adcd-bbf9-477d-87d2-a23cae0a51a7 tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:23.746890 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2621adcd-bbf9-477d-87d2-a23cae0a51a7 tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:23.748266 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2621adcd-bbf9-477d-87d2-a23cae0a51a7 tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:23.751074 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2621adcd-bbf9-477d-87d2-a23cae0a51a7 tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:23.751671 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2621adcd-bbf9-477d-87d2-a23cae0a51a7 tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:23.778192 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-0aafa479-21ba-412b-af3e-b71ba110f279 tempest-ServersAdminTestJSON-1449791209 tempest-ServersAdminTestJSON-1449791209-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/detail?tenant_id=b14c63df2e6c46d2af23b6b8a52690d9" status: 200 len: 15 microversion: 2.1 time: 0.060027 Aug 10 23:05:23.792366 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1090/2169] 10.222.0.58 () {58 vars in 1231 bytes} [Wed Aug 10 23:05:23 2022] GET /compute/v2.1/servers/detail?tenant_id=b14c63df2e6c46d2af23b6b8a52690d9 => generated 15 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 10 23:05:23.811997 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-09e82816-8cca-45a1-ac43-b8e1da9aa236 tempest-ServersAdminTestJSON-1449791209 tempest-ServersAdminTestJSON-1449791209-project-admin] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:05:23.818798 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-09e82816-8cca-45a1-ac43-b8e1da9aa236 tempest-ServersAdminTestJSON-1449791209 tempest-ServersAdminTestJSON-1449791209-project-admin] Searching by: {'tenant_id': 'b14c63df2e6c46d2af23b6b8a52690d9', 'deleted': False} {{(pid=122632) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 10 23:05:23.825094 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-09e82816-8cca-45a1-ac43-b8e1da9aa236 tempest-ServersAdminTestJSON-1449791209 tempest-ServersAdminTestJSON-1449791209-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:23.825782 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-09e82816-8cca-45a1-ac43-b8e1da9aa236 tempest-ServersAdminTestJSON-1449791209 tempest-ServersAdminTestJSON-1449791209-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:23.826363 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-09e82816-8cca-45a1-ac43-b8e1da9aa236 tempest-ServersAdminTestJSON-1449791209 tempest-ServersAdminTestJSON-1449791209-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:23.827415 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-09e82816-8cca-45a1-ac43-b8e1da9aa236 tempest-ServersAdminTestJSON-1449791209 tempest-ServersAdminTestJSON-1449791209-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:23.828027 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-09e82816-8cca-45a1-ac43-b8e1da9aa236 tempest-ServersAdminTestJSON-1449791209 tempest-ServersAdminTestJSON-1449791209-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:23.828603 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-09e82816-8cca-45a1-ac43-b8e1da9aa236 tempest-ServersAdminTestJSON-1449791209 tempest-ServersAdminTestJSON-1449791209-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:23.868879 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.multi_cell_list [None req-09e82816-8cca-45a1-ac43-b8e1da9aa236 tempest-ServersAdminTestJSON-1449791209 tempest-ServersAdminTestJSON-1449791209-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122632) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 10 23:05:23.971266 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-2621adcd-bbf9-477d-87d2-a23cae0a51a7 tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a2a5950cd342da86821122c08f028b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9960516a057e4f629fe5deb41e54d1d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:05:23.971594 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-09e82816-8cca-45a1-ac43-b8e1da9aa236 tempest-ServersAdminTestJSON-1449791209 tempest-ServersAdminTestJSON-1449791209-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:23.972224 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-09e82816-8cca-45a1-ac43-b8e1da9aa236 tempest-ServersAdminTestJSON-1449791209 tempest-ServersAdminTestJSON-1449791209-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:23.972779 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-09e82816-8cca-45a1-ac43-b8e1da9aa236 tempest-ServersAdminTestJSON-1449791209 tempest-ServersAdminTestJSON-1449791209-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:23.985241 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-2621adcd-bbf9-477d-87d2-a23cae0a51a7 tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] 10.222.0.58 "GET /compute/v2.1/servers/b9b9e57b-0669-46b6-afae-b5c439f688d2" status: 200 len: 1336 microversion: 2.1 time: 0.284844 Aug 10 23:05:23.986323 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1080/2170] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:05:23 2022] GET /compute/v2.1/servers/b9b9e57b-0669-46b6-afae-b5c439f688d2 => generated 1336 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:05:24.259276 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-09e82816-8cca-45a1-ac43-b8e1da9aa236 tempest-ServersAdminTestJSON-1449791209 tempest-ServersAdminTestJSON-1449791209-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=b14c63df2e6c46d2af23b6b8a52690d9" status: 200 len: 4830 microversion: 2.1 time: 0.451061 Aug 10 23:05:24.261025 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1091/2171] 10.222.0.58 () {58 vars in 1257 bytes} [Wed Aug 10 23:05:23 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=b14c63df2e6c46d2af23b6b8a52690d9 => generated 4830 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:05:24.289565 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-21dd0fd7-2dd5-45a6-8e0f-1b4df3cffd78 tempest-ServersAdminTestJSON-1449791209 tempest-ServersAdminTestJSON-1449791209-project-admin] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:05:24.299920 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-21dd0fd7-2dd5-45a6-8e0f-1b4df3cffd78 tempest-ServersAdminTestJSON-1449791209 tempest-ServersAdminTestJSON-1449791209-project-admin] Searching by: {'tenant_id': '5acfeb45a31044e79c07af5165a5180a', 'deleted': False} {{(pid=122633) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 10 23:05:24.313751 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-21dd0fd7-2dd5-45a6-8e0f-1b4df3cffd78 tempest-ServersAdminTestJSON-1449791209 tempest-ServersAdminTestJSON-1449791209-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:24.314341 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-21dd0fd7-2dd5-45a6-8e0f-1b4df3cffd78 tempest-ServersAdminTestJSON-1449791209 tempest-ServersAdminTestJSON-1449791209-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:24.315149 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-21dd0fd7-2dd5-45a6-8e0f-1b4df3cffd78 tempest-ServersAdminTestJSON-1449791209 tempest-ServersAdminTestJSON-1449791209-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:24.315965 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-21dd0fd7-2dd5-45a6-8e0f-1b4df3cffd78 tempest-ServersAdminTestJSON-1449791209 tempest-ServersAdminTestJSON-1449791209-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:24.316837 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-21dd0fd7-2dd5-45a6-8e0f-1b4df3cffd78 tempest-ServersAdminTestJSON-1449791209 tempest-ServersAdminTestJSON-1449791209-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:24.317267 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-21dd0fd7-2dd5-45a6-8e0f-1b4df3cffd78 tempest-ServersAdminTestJSON-1449791209 tempest-ServersAdminTestJSON-1449791209-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:24.596338 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-21dd0fd7-2dd5-45a6-8e0f-1b4df3cffd78 tempest-ServersAdminTestJSON-1449791209 tempest-ServersAdminTestJSON-1449791209-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=5acfeb45a31044e79c07af5165a5180a" status: 200 len: 15 microversion: 2.1 time: 0.314012 Aug 10 23:05:24.597442 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1081/2172] 10.222.0.58 () {58 vars in 1257 bytes} [Wed Aug 10 23:05:24 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=5acfeb45a31044e79c07af5165a5180a => generated 15 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 23:05:24.619907 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c11a7f7a-a690-4dc2-8960-859f51cdc31e tempest-ServersAdminTestJSON-1449791209 tempest-ServersAdminTestJSON-1449791209-project-admin] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:05:24.629489 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-c11a7f7a-a690-4dc2-8960-859f51cdc31e tempest-ServersAdminTestJSON-1449791209 tempest-ServersAdminTestJSON-1449791209-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.012194 Aug 10 23:05:24.632252 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1092/2173] 10.222.0.58 () {58 vars in 1189 bytes} [Wed Aug 10 23:05:24 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 23:05:24.657676 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-750cad4c-f51c-43e1-8e2f-dc12e749dfb2 tempest-ServersAdminTestJSON-1449791209 tempest-ServersAdminTestJSON-1449791209-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:05:24.661638 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-750cad4c-f51c-43e1-8e2f-dc12e749dfb2 tempest-ServersAdminTestJSON-1449791209 tempest-ServersAdminTestJSON-1449791209-project-admin] [instance: b3b3730c-1396-4ca6-9d9e-8a3104950324] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:05:24.673481 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-750cad4c-f51c-43e1-8e2f-dc12e749dfb2 tempest-ServersAdminTestJSON-1449791209 tempest-ServersAdminTestJSON-1449791209-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:24.673973 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-750cad4c-f51c-43e1-8e2f-dc12e749dfb2 tempest-ServersAdminTestJSON-1449791209 tempest-ServersAdminTestJSON-1449791209-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:24.674407 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-750cad4c-f51c-43e1-8e2f-dc12e749dfb2 tempest-ServersAdminTestJSON-1449791209 tempest-ServersAdminTestJSON-1449791209-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:24.675381 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-750cad4c-f51c-43e1-8e2f-dc12e749dfb2 tempest-ServersAdminTestJSON-1449791209 tempest-ServersAdminTestJSON-1449791209-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:24.675896 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-750cad4c-f51c-43e1-8e2f-dc12e749dfb2 tempest-ServersAdminTestJSON-1449791209 tempest-ServersAdminTestJSON-1449791209-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:24.676435 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-750cad4c-f51c-43e1-8e2f-dc12e749dfb2 tempest-ServersAdminTestJSON-1449791209 tempest-ServersAdminTestJSON-1449791209-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:24.717101 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c4e38e8a-d85b-4946-94cd-dd88ddddfae2 tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:05:24.717723 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-c4e38e8a-d85b-4946-94cd-dd88ddddfae2 tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] [instance: 717a8812-6a48-49ad-baa8-0cf0fb41671d] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:05:24.729189 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c4e38e8a-d85b-4946-94cd-dd88ddddfae2 tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:24.729788 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c4e38e8a-d85b-4946-94cd-dd88ddddfae2 tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:24.730228 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c4e38e8a-d85b-4946-94cd-dd88ddddfae2 tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:24.731067 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c4e38e8a-d85b-4946-94cd-dd88ddddfae2 tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:24.731443 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c4e38e8a-d85b-4946-94cd-dd88ddddfae2 tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:24.731948 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c4e38e8a-d85b-4946-94cd-dd88ddddfae2 tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:24.805499 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:05:24.854422 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-750cad4c-f51c-43e1-8e2f-dc12e749dfb2 tempest-ServersAdminTestJSON-1449791209 tempest-ServersAdminTestJSON-1449791209-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/b3b3730c-1396-4ca6-9d9e-8a3104950324/action" status: 202 len: 0 microversion: 2.1 time: 0.199946 Aug 10 23:05:24.858262 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1082/2174] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:05:24 2022] POST /compute/v2.1/servers/b3b3730c-1396-4ca6-9d9e-8a3104950324/action => generated 0 bytes in 202 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:05:24.865098 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-033d033e-a7d1-4e1e-b892-162a5a11089f tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:05:24.873568 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-033d033e-a7d1-4e1e-b892-162a5a11089f tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6de244f1f82143a0b3d3283c31d80bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14c63df2e6c46d2af23b6b8a52690d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:05:24.874316 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-033d033e-a7d1-4e1e-b892-162a5a11089f tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': 'b14c63df2e6c46d2af23b6b8a52690d9'} {{(pid=122633) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 10 23:05:24.883193 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-033d033e-a7d1-4e1e-b892-162a5a11089f tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:24.883689 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-033d033e-a7d1-4e1e-b892-162a5a11089f tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:24.884162 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-033d033e-a7d1-4e1e-b892-162a5a11089f tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:24.885366 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-033d033e-a7d1-4e1e-b892-162a5a11089f tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:24.887255 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-033d033e-a7d1-4e1e-b892-162a5a11089f tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:24.887715 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-033d033e-a7d1-4e1e-b892-162a5a11089f tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:25.007517 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.multi_cell_list [None req-033d033e-a7d1-4e1e-b892-162a5a11089f tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122633) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 10 23:05:25.126454 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-033d033e-a7d1-4e1e-b892-162a5a11089f tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] 10.222.0.58 "GET /compute/v2.1/servers?status=error" status: 200 len: 339 microversion: 2.1 time: 0.265591 Aug 10 23:05:25.127382 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1083/2175] 10.222.0.58 () {58 vars in 1150 bytes} [Wed Aug 10 23:05:24 2022] GET /compute/v2.1/servers?status=error => generated 339 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:05:25.136023 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-59ce4a03-c7a4-4ca6-b474-4be9ca76b1e7 tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:05:25.140247 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-59ce4a03-c7a4-4ca6-b474-4be9ca76b1e7 tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] [instance: b9b9e57b-0669-46b6-afae-b5c439f688d2] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:05:25.149635 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-59ce4a03-c7a4-4ca6-b474-4be9ca76b1e7 tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:25.150146 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-59ce4a03-c7a4-4ca6-b474-4be9ca76b1e7 tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:25.151302 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-59ce4a03-c7a4-4ca6-b474-4be9ca76b1e7 tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:25.152268 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-59ce4a03-c7a4-4ca6-b474-4be9ca76b1e7 tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:25.153908 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-59ce4a03-c7a4-4ca6-b474-4be9ca76b1e7 tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:25.154510 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-59ce4a03-c7a4-4ca6-b474-4be9ca76b1e7 tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:25.237949 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-c4e38e8a-d85b-4946-94cd-dd88ddddfae2 tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '933e6a08c3014b36aee164b213bbfaf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d6f13784504fc7b2fcf0d6957b4920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:05:25.246860 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-c4e38e8a-d85b-4946-94cd-dd88ddddfae2 tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] 10.222.0.58 "GET /compute/v2.1/servers/717a8812-6a48-49ad-baa8-0cf0fb41671d" status: 200 len: 1323 microversion: 2.1 time: 0.534631 Aug 10 23:05:25.260606 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1093/2176] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:05:24 2022] GET /compute/v2.1/servers/717a8812-6a48-49ad-baa8-0cf0fb41671d => generated 1323 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:05:25.267696 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-ce410a05-649c-4eec-a602-6039d039b48d tempest-ServersAdminTestJSON-1449791209 tempest-ServersAdminTestJSON-1449791209-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:05:25.270198 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-ce410a05-649c-4eec-a602-6039d039b48d tempest-ServersAdminTestJSON-1449791209 tempest-ServersAdminTestJSON-1449791209-project-admin] [instance: b3b3730c-1396-4ca6-9d9e-8a3104950324] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:05:25.277152 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ce410a05-649c-4eec-a602-6039d039b48d tempest-ServersAdminTestJSON-1449791209 tempest-ServersAdminTestJSON-1449791209-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:25.278001 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ce410a05-649c-4eec-a602-6039d039b48d tempest-ServersAdminTestJSON-1449791209 tempest-ServersAdminTestJSON-1449791209-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:25.278752 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ce410a05-649c-4eec-a602-6039d039b48d tempest-ServersAdminTestJSON-1449791209 tempest-ServersAdminTestJSON-1449791209-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:25.279882 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ce410a05-649c-4eec-a602-6039d039b48d tempest-ServersAdminTestJSON-1449791209 tempest-ServersAdminTestJSON-1449791209-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:25.280554 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ce410a05-649c-4eec-a602-6039d039b48d tempest-ServersAdminTestJSON-1449791209 tempest-ServersAdminTestJSON-1449791209-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:25.281213 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ce410a05-649c-4eec-a602-6039d039b48d tempest-ServersAdminTestJSON-1449791209 tempest-ServersAdminTestJSON-1449791209-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:25.434127 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-ce410a05-649c-4eec-a602-6039d039b48d tempest-ServersAdminTestJSON-1449791209 tempest-ServersAdminTestJSON-1449791209-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/b3b3730c-1396-4ca6-9d9e-8a3104950324/action" status: 202 len: 0 microversion: 2.1 time: 0.172218 Aug 10 23:05:25.438466 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1094/2177] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:05:25 2022] POST /compute/v2.1/servers/b3b3730c-1396-4ca6-9d9e-8a3104950324/action => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:05:25.445468 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c744850d-51d1-4d91-83dd-55b3c6aa8ee5 tempest-ServersAdminTestJSON-1449791209 tempest-ServersAdminTestJSON-1449791209-project-admin] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:05:25.446856 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-c744850d-51d1-4d91-83dd-55b3c6aa8ee5 tempest-ServersAdminTestJSON-1449791209 tempest-ServersAdminTestJSON-1449791209-project-admin] [instance: b3b3730c-1396-4ca6-9d9e-8a3104950324] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:05:25.464092 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c744850d-51d1-4d91-83dd-55b3c6aa8ee5 tempest-ServersAdminTestJSON-1449791209 tempest-ServersAdminTestJSON-1449791209-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:25.467626 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c744850d-51d1-4d91-83dd-55b3c6aa8ee5 tempest-ServersAdminTestJSON-1449791209 tempest-ServersAdminTestJSON-1449791209-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:25.468932 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c744850d-51d1-4d91-83dd-55b3c6aa8ee5 tempest-ServersAdminTestJSON-1449791209 tempest-ServersAdminTestJSON-1449791209-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:25.471507 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c744850d-51d1-4d91-83dd-55b3c6aa8ee5 tempest-ServersAdminTestJSON-1449791209 tempest-ServersAdminTestJSON-1449791209-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:25.472217 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c744850d-51d1-4d91-83dd-55b3c6aa8ee5 tempest-ServersAdminTestJSON-1449791209 tempest-ServersAdminTestJSON-1449791209-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:25.474754 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c744850d-51d1-4d91-83dd-55b3c6aa8ee5 tempest-ServersAdminTestJSON-1449791209 tempest-ServersAdminTestJSON-1449791209-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:25.502398 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:05:25.537192 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-59ce4a03-c7a4-4ca6-b474-4be9ca76b1e7 tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a2a5950cd342da86821122c08f028b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9960516a057e4f629fe5deb41e54d1d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:05:25.549854 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-59ce4a03-c7a4-4ca6-b474-4be9ca76b1e7 tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] 10.222.0.58 "GET /compute/v2.1/servers/b9b9e57b-0669-46b6-afae-b5c439f688d2" status: 200 len: 1404 microversion: 2.1 time: 0.419864 Aug 10 23:05:25.550656 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1084/2178] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:05:25 2022] GET /compute/v2.1/servers/b9b9e57b-0669-46b6-afae-b5c439f688d2 => generated 1404 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:05:25.626957 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-6a86a6d4-dba7-4413-bda8-a7ce6ca9b76d req-4cbcc4dd-d90d-4dd7-991b-3e8bc9468360 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "717a8812-6a48-49ad-baa8-0cf0fb41671d", "name": "network-vif-plugged", "status": "completed", "tag": "06ceffef-a360-4b97-8d79-f13f49f62568"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:05:25.649189 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-6a86a6d4-dba7-4413-bda8-a7ce6ca9b76d req-4cbcc4dd-d90d-4dd7-991b-3e8bc9468360 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:25.649686 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-6a86a6d4-dba7-4413-bda8-a7ce6ca9b76d req-4cbcc4dd-d90d-4dd7-991b-3e8bc9468360 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:25.650123 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-6a86a6d4-dba7-4413-bda8-a7ce6ca9b76d req-4cbcc4dd-d90d-4dd7-991b-3e8bc9468360 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:25.676572 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-6a86a6d4-dba7-4413-bda8-a7ce6ca9b76d req-4cbcc4dd-d90d-4dd7-991b-3e8bc9468360 service nova] Creating event network-vif-plugged:06ceffef-a360-4b97-8d79-f13f49f62568 for instance 717a8812-6a48-49ad-baa8-0cf0fb41671d on n-h1-850468-14 Aug 10 23:05:25.678583 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-c744850d-51d1-4d91-83dd-55b3c6aa8ee5 tempest-ServersAdminTestJSON-1449791209 tempest-ServersAdminTestJSON-1449791209-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/b3b3730c-1396-4ca6-9d9e-8a3104950324" status: 200 len: 1616 microversion: 2.1 time: 0.237343 Aug 10 23:05:25.691526 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-6a86a6d4-dba7-4413-bda8-a7ce6ca9b76d req-4cbcc4dd-d90d-4dd7-991b-3e8bc9468360 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070917 Aug 10 23:05:25.692409 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1095/2179] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:05:25 2022] GET /compute/v2.1/servers/b3b3730c-1396-4ca6-9d9e-8a3104950324 => generated 1616 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:05:25.696739 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1085/2180] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:05:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 23:05:25.708475 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-8b34f3d7-0470-4258-8728-622294b454e9 tempest-ServersAdminTestJSON-1449791209 tempest-ServersAdminTestJSON-1449791209-project-admin] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:05:25.709816 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-8b34f3d7-0470-4258-8728-622294b454e9 tempest-ServersAdminTestJSON-1449791209 tempest-ServersAdminTestJSON-1449791209-project-admin] [instance: b3b3730c-1396-4ca6-9d9e-8a3104950324] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:05:25.734723 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8b34f3d7-0470-4258-8728-622294b454e9 tempest-ServersAdminTestJSON-1449791209 tempest-ServersAdminTestJSON-1449791209-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:25.735897 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8b34f3d7-0470-4258-8728-622294b454e9 tempest-ServersAdminTestJSON-1449791209 tempest-ServersAdminTestJSON-1449791209-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:25.736573 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8b34f3d7-0470-4258-8728-622294b454e9 tempest-ServersAdminTestJSON-1449791209 tempest-ServersAdminTestJSON-1449791209-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:25.738066 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8b34f3d7-0470-4258-8728-622294b454e9 tempest-ServersAdminTestJSON-1449791209 tempest-ServersAdminTestJSON-1449791209-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:25.738760 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8b34f3d7-0470-4258-8728-622294b454e9 tempest-ServersAdminTestJSON-1449791209 tempest-ServersAdminTestJSON-1449791209-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:25.739416 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8b34f3d7-0470-4258-8728-622294b454e9 tempest-ServersAdminTestJSON-1449791209 tempest-ServersAdminTestJSON-1449791209-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:25.972528 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-8b34f3d7-0470-4258-8728-622294b454e9 tempest-ServersAdminTestJSON-1449791209 tempest-ServersAdminTestJSON-1449791209-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/b3b3730c-1396-4ca6-9d9e-8a3104950324" status: 200 len: 1616 microversion: 2.1 time: 0.267954 Aug 10 23:05:25.982881 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1096/2181] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:05:25 2022] GET /compute/v2.1/servers/b3b3730c-1396-4ca6-9d9e-8a3104950324 => generated 1616 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:05:25.994849 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-1d4dc88d-caa8-4ce6-b121-096a2f9f8f54 tempest-ServersAdminTestJSON-1449791209 tempest-ServersAdminTestJSON-1449791209-project-admin] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:05:26.002118 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-1d4dc88d-caa8-4ce6-b121-096a2f9f8f54 tempest-ServersAdminTestJSON-1449791209 tempest-ServersAdminTestJSON-1449791209-project-admin] Searching by: {'host': 'n-h1-850468-14', 'deleted': False} {{(pid=122633) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 10 23:05:26.009290 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1d4dc88d-caa8-4ce6-b121-096a2f9f8f54 tempest-ServersAdminTestJSON-1449791209 tempest-ServersAdminTestJSON-1449791209-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:26.010413 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1d4dc88d-caa8-4ce6-b121-096a2f9f8f54 tempest-ServersAdminTestJSON-1449791209 tempest-ServersAdminTestJSON-1449791209-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:26.010954 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1d4dc88d-caa8-4ce6-b121-096a2f9f8f54 tempest-ServersAdminTestJSON-1449791209 tempest-ServersAdminTestJSON-1449791209-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:26.011908 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1d4dc88d-caa8-4ce6-b121-096a2f9f8f54 tempest-ServersAdminTestJSON-1449791209 tempest-ServersAdminTestJSON-1449791209-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:26.012717 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1d4dc88d-caa8-4ce6-b121-096a2f9f8f54 tempest-ServersAdminTestJSON-1449791209 tempest-ServersAdminTestJSON-1449791209-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:26.013348 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1d4dc88d-caa8-4ce6-b121-096a2f9f8f54 tempest-ServersAdminTestJSON-1449791209 tempest-ServersAdminTestJSON-1449791209-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:26.133158 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-96b62df2-c413-4455-8ca1-d1d68aa2ed7e req-cf5b3bb0-bd9d-45bf-a828-383c3fe4c9f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9b9e57b-0669-46b6-afae-b5c439f688d2", "tag": "0291afb1-e014-41f8-9d03-ceea7b48df34"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:05:26.147815 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.multi_cell_list [None req-1d4dc88d-caa8-4ce6-b121-096a2f9f8f54 tempest-ServersAdminTestJSON-1449791209 tempest-ServersAdminTestJSON-1449791209-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122633) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 10 23:05:26.148923 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-96b62df2-c413-4455-8ca1-d1d68aa2ed7e req-cf5b3bb0-bd9d-45bf-a828-383c3fe4c9f8 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:26.149408 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-96b62df2-c413-4455-8ca1-d1d68aa2ed7e req-cf5b3bb0-bd9d-45bf-a828-383c3fe4c9f8 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:26.149942 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-96b62df2-c413-4455-8ca1-d1d68aa2ed7e req-cf5b3bb0-bd9d-45bf-a828-383c3fe4c9f8 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:26.191224 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-96b62df2-c413-4455-8ca1-d1d68aa2ed7e req-cf5b3bb0-bd9d-45bf-a828-383c3fe4c9f8 service nova] Creating event network-changed:0291afb1-e014-41f8-9d03-ceea7b48df34 for instance b9b9e57b-0669-46b6-afae-b5c439f688d2 on n-h2-850468-14 Aug 10 23:05:26.205740 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-96b62df2-c413-4455-8ca1-d1d68aa2ed7e req-cf5b3bb0-bd9d-45bf-a828-383c3fe4c9f8 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076730 Aug 10 23:05:26.208604 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1097/2182] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:05:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 23:05:26.222466 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-1d4dc88d-caa8-4ce6-b121-096a2f9f8f54 tempest-ServersAdminTestJSON-1449791209 tempest-ServersAdminTestJSON-1449791209-project-admin] 10.222.0.58 "GET /compute/v2.1/servers?host=n-h1-850468-14&all_tenants=1" status: 200 len: 999 microversion: 2.1 time: 0.231544 Aug 10 23:05:26.227810 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1086/2183] 10.222.0.58 () {58 vars in 1192 bytes} [Wed Aug 10 23:05:25 2022] GET /compute/v2.1/servers?host=n-h1-850468-14&all_tenants=1 => generated 999 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:05:26.235359 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-7fcedc92-f6b8-4bfb-b413-4d89aedf0bfa tempest-ServersAdminTestJSON-1449791209 tempest-ServersAdminTestJSON-1449791209-project-admin] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:05:26.242683 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-7fcedc92-f6b8-4bfb-b413-4d89aedf0bfa tempest-ServersAdminTestJSON-1449791209 tempest-ServersAdminTestJSON-1449791209-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=122632) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 10 23:05:26.250764 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7fcedc92-f6b8-4bfb-b413-4d89aedf0bfa tempest-ServersAdminTestJSON-1449791209 tempest-ServersAdminTestJSON-1449791209-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:26.251963 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7fcedc92-f6b8-4bfb-b413-4d89aedf0bfa tempest-ServersAdminTestJSON-1449791209 tempest-ServersAdminTestJSON-1449791209-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:26.252669 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7fcedc92-f6b8-4bfb-b413-4d89aedf0bfa tempest-ServersAdminTestJSON-1449791209 tempest-ServersAdminTestJSON-1449791209-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:26.253861 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7fcedc92-f6b8-4bfb-b413-4d89aedf0bfa tempest-ServersAdminTestJSON-1449791209 tempest-ServersAdminTestJSON-1449791209-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:26.254608 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7fcedc92-f6b8-4bfb-b413-4d89aedf0bfa tempest-ServersAdminTestJSON-1449791209 tempest-ServersAdminTestJSON-1449791209-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:26.255485 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7fcedc92-f6b8-4bfb-b413-4d89aedf0bfa tempest-ServersAdminTestJSON-1449791209 tempest-ServersAdminTestJSON-1449791209-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:26.274173 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-f15d9376-8c88-4f39-bab8-e57f384d333d tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:05:26.275150 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-f15d9376-8c88-4f39-bab8-e57f384d333d tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] [instance: 717a8812-6a48-49ad-baa8-0cf0fb41671d] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:05:26.290543 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f15d9376-8c88-4f39-bab8-e57f384d333d tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:26.295072 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f15d9376-8c88-4f39-bab8-e57f384d333d tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:26.296691 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f15d9376-8c88-4f39-bab8-e57f384d333d tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:26.301486 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f15d9376-8c88-4f39-bab8-e57f384d333d tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:26.302641 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f15d9376-8c88-4f39-bab8-e57f384d333d tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:26.303297 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f15d9376-8c88-4f39-bab8-e57f384d333d tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:26.469805 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-7fcedc92-f6b8-4bfb-b413-4d89aedf0bfa tempest-ServersAdminTestJSON-1449791209 tempest-ServersAdminTestJSON-1449791209-project-admin] 10.222.0.58 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.238587 Aug 10 23:05:26.470406 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1098/2184] 10.222.0.58 () {58 vars in 1196 bytes} [Wed Aug 10 23:05:26 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 23:05:26.488289 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-d862a4cf-b536-4493-8e07-fbd6459db7b0 tempest-ServersAdminTestJSON-1449791209 tempest-ServersAdminTestJSON-1449791209-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:05:26.492943 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-d862a4cf-b536-4493-8e07-fbd6459db7b0 tempest-ServersAdminTestJSON-1449791209 tempest-ServersAdminTestJSON-1449791209-project-admin] [instance: b3b3730c-1396-4ca6-9d9e-8a3104950324] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:05:26.509058 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d862a4cf-b536-4493-8e07-fbd6459db7b0 tempest-ServersAdminTestJSON-1449791209 tempest-ServersAdminTestJSON-1449791209-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:26.509801 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d862a4cf-b536-4493-8e07-fbd6459db7b0 tempest-ServersAdminTestJSON-1449791209 tempest-ServersAdminTestJSON-1449791209-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:26.511960 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d862a4cf-b536-4493-8e07-fbd6459db7b0 tempest-ServersAdminTestJSON-1449791209 tempest-ServersAdminTestJSON-1449791209-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:26.512890 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d862a4cf-b536-4493-8e07-fbd6459db7b0 tempest-ServersAdminTestJSON-1449791209 tempest-ServersAdminTestJSON-1449791209-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:26.513502 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d862a4cf-b536-4493-8e07-fbd6459db7b0 tempest-ServersAdminTestJSON-1449791209 tempest-ServersAdminTestJSON-1449791209-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:26.514078 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d862a4cf-b536-4493-8e07-fbd6459db7b0 tempest-ServersAdminTestJSON-1449791209 tempest-ServersAdminTestJSON-1449791209-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:26.622515 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-d862a4cf-b536-4493-8e07-fbd6459db7b0 tempest-ServersAdminTestJSON-1449791209 tempest-ServersAdminTestJSON-1449791209-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/b3b3730c-1396-4ca6-9d9e-8a3104950324/action" status: 202 len: 0 microversion: 2.1 time: 0.143548 Aug 10 23:05:26.624457 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1099/2185] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:05:26 2022] POST /compute/v2.1/servers/b3b3730c-1396-4ca6-9d9e-8a3104950324/action => generated 0 bytes in 146 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:05:26.974304 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-f15d9376-8c88-4f39-bab8-e57f384d333d tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '933e6a08c3014b36aee164b213bbfaf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d6f13784504fc7b2fcf0d6957b4920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:05:26.983196 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-f15d9376-8c88-4f39-bab8-e57f384d333d tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] 10.222.0.58 "GET /compute/v2.1/servers/717a8812-6a48-49ad-baa8-0cf0fb41671d" status: 200 len: 1323 microversion: 2.1 time: 0.713221 Aug 10 23:05:27.001722 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1087/2186] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:05:26 2022] GET /compute/v2.1/servers/717a8812-6a48-49ad-baa8-0cf0fb41671d => generated 1323 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:05:27.015630 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-49302ef2-31b4-4449-a98b-292e2b5b0f27 tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:05:27.016254 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-49302ef2-31b4-4449-a98b-292e2b5b0f27 tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] [instance: b9b9e57b-0669-46b6-afae-b5c439f688d2] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:05:27.028870 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-49302ef2-31b4-4449-a98b-292e2b5b0f27 tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:27.029613 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-49302ef2-31b4-4449-a98b-292e2b5b0f27 tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:27.030272 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-49302ef2-31b4-4449-a98b-292e2b5b0f27 tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:27.031399 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-49302ef2-31b4-4449-a98b-292e2b5b0f27 tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:27.032145 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-49302ef2-31b4-4449-a98b-292e2b5b0f27 tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:27.032803 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-49302ef2-31b4-4449-a98b-292e2b5b0f27 tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:27.047429 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-0cc9c275-e19b-41cf-ba7c-a1cad86da8f5 tempest-AZV2TestJSON-1824864242 tempest-AZV2TestJSON-1824864242-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:05:27.049849 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0cc9c275-e19b-41cf-ba7c-a1cad86da8f5 tempest-AZV2TestJSON-1824864242 tempest-AZV2TestJSON-1824864242-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:27.050523 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0cc9c275-e19b-41cf-ba7c-a1cad86da8f5 tempest-AZV2TestJSON-1824864242 tempest-AZV2TestJSON-1824864242-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:27.051354 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0cc9c275-e19b-41cf-ba7c-a1cad86da8f5 tempest-AZV2TestJSON-1824864242 tempest-AZV2TestJSON-1824864242-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:27.052530 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0cc9c275-e19b-41cf-ba7c-a1cad86da8f5 tempest-AZV2TestJSON-1824864242 tempest-AZV2TestJSON-1824864242-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:27.057211 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0cc9c275-e19b-41cf-ba7c-a1cad86da8f5 tempest-AZV2TestJSON-1824864242 tempest-AZV2TestJSON-1824864242-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:27.058133 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0cc9c275-e19b-41cf-ba7c-a1cad86da8f5 tempest-AZV2TestJSON-1824864242 tempest-AZV2TestJSON-1824864242-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:27.140028 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-0cc9c275-e19b-41cf-ba7c-a1cad86da8f5 tempest-AZV2TestJSON-1824864242 tempest-AZV2TestJSON-1824864242-project] 10.222.0.58 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.513773 Aug 10 23:05:27.141060 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1100/2187] 10.222.0.58 () {58 vars in 1164 bytes} [Wed Aug 10 23:05:26 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 23:05:27.154739 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c9f24287-d217-4c08-ad8c-4ade6d554083 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:05:27.160457 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-c9f24287-d217-4c08-ad8c-4ade6d554083 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] [instance: b3b3730c-1396-4ca6-9d9e-8a3104950324] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:05:27.172497 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c9f24287-d217-4c08-ad8c-4ade6d554083 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:27.173735 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c9f24287-d217-4c08-ad8c-4ade6d554083 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:27.174838 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c9f24287-d217-4c08-ad8c-4ade6d554083 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:27.176709 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c9f24287-d217-4c08-ad8c-4ade6d554083 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:27.177662 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c9f24287-d217-4c08-ad8c-4ade6d554083 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:27.178619 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c9f24287-d217-4c08-ad8c-4ade6d554083 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:27.314728 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-c9f24287-d217-4c08-ad8c-4ade6d554083 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Flavor limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:05:27.315465 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-c9f24287-d217-4c08-ad8c-4ade6d554083 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Image limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:05:27.316118 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-c9f24287-d217-4c08-ad8c-4ade6d554083 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Flavor pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:05:27.316982 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-c9f24287-d217-4c08-ad8c-4ade6d554083 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Image pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:05:27.317694 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-c9f24287-d217-4c08-ad8c-4ade6d554083 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:05:27.365589 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-49302ef2-31b4-4449-a98b-292e2b5b0f27 tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a2a5950cd342da86821122c08f028b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9960516a057e4f629fe5deb41e54d1d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:05:27.377198 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-49302ef2-31b4-4449-a98b-292e2b5b0f27 tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] 10.222.0.58 "GET /compute/v2.1/servers/b9b9e57b-0669-46b6-afae-b5c439f688d2" status: 200 len: 1404 microversion: 2.1 time: 0.374057 Aug 10 23:05:27.377978 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1088/2188] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:05:27 2022] GET /compute/v2.1/servers/b9b9e57b-0669-46b6-afae-b5c439f688d2 => generated 1404 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:05:27.412158 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-c9f24287-d217-4c08-ad8c-4ade6d554083 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] [instance: b3b3730c-1396-4ca6-9d9e-8a3104950324] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:05:27.419782 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c9f24287-d217-4c08-ad8c-4ade6d554083 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:27.420257 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c9f24287-d217-4c08-ad8c-4ade6d554083 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:27.420959 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c9f24287-d217-4c08-ad8c-4ade6d554083 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:27.421668 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c9f24287-d217-4c08-ad8c-4ade6d554083 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:27.422293 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c9f24287-d217-4c08-ad8c-4ade6d554083 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:27.423063 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c9f24287-d217-4c08-ad8c-4ade6d554083 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:27.457620 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-c9f24287-d217-4c08-ad8c-4ade6d554083 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] 10.222.0.58 "POST /compute/v2.1/servers/b3b3730c-1396-4ca6-9d9e-8a3104950324/action" status: 202 len: 1067 microversion: 2.1 time: 0.315155 Aug 10 23:05:27.458266 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1101/2189] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:05:27 2022] POST /compute/v2.1/servers/b3b3730c-1396-4ca6-9d9e-8a3104950324/action => generated 1067 bytes in 317 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 10 23:05:27.476260 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-4baf161a-23d8-4df7-8e62-8438604e2394 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:05:27.477184 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-4baf161a-23d8-4df7-8e62-8438604e2394 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] [instance: b3b3730c-1396-4ca6-9d9e-8a3104950324] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:05:27.485201 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4baf161a-23d8-4df7-8e62-8438604e2394 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:27.486004 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4baf161a-23d8-4df7-8e62-8438604e2394 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:27.486624 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4baf161a-23d8-4df7-8e62-8438604e2394 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:27.487617 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4baf161a-23d8-4df7-8e62-8438604e2394 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:27.488274 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4baf161a-23d8-4df7-8e62-8438604e2394 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:27.488881 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4baf161a-23d8-4df7-8e62-8438604e2394 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:27.663650 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-4baf161a-23d8-4df7-8e62-8438604e2394 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de244f1f82143a0b3d3283c31d80bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14c63df2e6c46d2af23b6b8a52690d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:05:27.675875 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-4baf161a-23d8-4df7-8e62-8438604e2394 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] 10.222.0.58 "GET /compute/v2.1/servers/b3b3730c-1396-4ca6-9d9e-8a3104950324" status: 200 len: 1471 microversion: 2.1 time: 0.203061 Aug 10 23:05:27.677294 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1089/2190] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:05:27 2022] GET /compute/v2.1/servers/b3b3730c-1396-4ca6-9d9e-8a3104950324 => generated 1471 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:05:28.010708 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-57b333b8-23ea-49b7-b67b-9d896c285b70 tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:05:28.011512 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-57b333b8-23ea-49b7-b67b-9d896c285b70 tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] [instance: 717a8812-6a48-49ad-baa8-0cf0fb41671d] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:05:28.023597 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-57b333b8-23ea-49b7-b67b-9d896c285b70 tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:28.024258 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-57b333b8-23ea-49b7-b67b-9d896c285b70 tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:28.024796 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-57b333b8-23ea-49b7-b67b-9d896c285b70 tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:28.025876 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-57b333b8-23ea-49b7-b67b-9d896c285b70 tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:28.026335 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-57b333b8-23ea-49b7-b67b-9d896c285b70 tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:28.026946 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-57b333b8-23ea-49b7-b67b-9d896c285b70 tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:28.276727 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-57b333b8-23ea-49b7-b67b-9d896c285b70 tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '933e6a08c3014b36aee164b213bbfaf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d6f13784504fc7b2fcf0d6957b4920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:05:28.285741 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-57b333b8-23ea-49b7-b67b-9d896c285b70 tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] 10.222.0.58 "GET /compute/v2.1/servers/717a8812-6a48-49ad-baa8-0cf0fb41671d" status: 200 len: 1520 microversion: 2.1 time: 0.280420 Aug 10 23:05:28.318996 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1102/2191] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:05:28 2022] GET /compute/v2.1/servers/717a8812-6a48-49ad-baa8-0cf0fb41671d => generated 1520 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:05:28.320710 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-758fc7a3-81fc-467e-ba02-ac09425f8622 tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Action: 'create', calling method: .version_select at 0x7f847d6630d0>, body: {"pool": null} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:05:28.399255 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c4b321ad-1718-405e-95b8-48055b567b08 tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:05:28.400241 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-c4b321ad-1718-405e-95b8-48055b567b08 tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] [instance: b9b9e57b-0669-46b6-afae-b5c439f688d2] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:05:28.407848 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c4b321ad-1718-405e-95b8-48055b567b08 tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:28.408345 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c4b321ad-1718-405e-95b8-48055b567b08 tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:28.408780 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c4b321ad-1718-405e-95b8-48055b567b08 tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:28.409777 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c4b321ad-1718-405e-95b8-48055b567b08 tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:28.410385 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c4b321ad-1718-405e-95b8-48055b567b08 tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:28.410986 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c4b321ad-1718-405e-95b8-48055b567b08 tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:28.605459 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-c4b321ad-1718-405e-95b8-48055b567b08 tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a2a5950cd342da86821122c08f028b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9960516a057e4f629fe5deb41e54d1d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:05:28.614283 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-c4b321ad-1718-405e-95b8-48055b567b08 tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] 10.222.0.58 "GET /compute/v2.1/servers/b9b9e57b-0669-46b6-afae-b5c439f688d2" status: 200 len: 1404 microversion: 2.1 time: 0.219156 Aug 10 23:05:28.616191 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1103/2192] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:05:28 2022] GET /compute/v2.1/servers/b9b9e57b-0669-46b6-afae-b5c439f688d2 => generated 1404 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:05:28.699867 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-899c2386-730a-48f4-bcc5-50cda35b3868 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:05:28.700565 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-899c2386-730a-48f4-bcc5-50cda35b3868 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] [instance: b3b3730c-1396-4ca6-9d9e-8a3104950324] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:05:28.713525 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-899c2386-730a-48f4-bcc5-50cda35b3868 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:28.715785 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-899c2386-730a-48f4-bcc5-50cda35b3868 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:28.716478 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-899c2386-730a-48f4-bcc5-50cda35b3868 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:28.717378 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-899c2386-730a-48f4-bcc5-50cda35b3868 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:28.718050 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-899c2386-730a-48f4-bcc5-50cda35b3868 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:28.718631 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-899c2386-730a-48f4-bcc5-50cda35b3868 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:28.912111 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-899c2386-730a-48f4-bcc5-50cda35b3868 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de244f1f82143a0b3d3283c31d80bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14c63df2e6c46d2af23b6b8a52690d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:05:28.923092 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-899c2386-730a-48f4-bcc5-50cda35b3868 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] 10.222.0.58 "GET /compute/v2.1/servers/b3b3730c-1396-4ca6-9d9e-8a3104950324" status: 200 len: 1471 microversion: 2.1 time: 0.227728 Aug 10 23:05:28.924701 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1104/2193] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:05:28 2022] GET /compute/v2.1/servers/b3b3730c-1396-4ca6-9d9e-8a3104950324 => generated 1471 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:05:29.808145 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-039575a0-804d-4427-a98f-e6b8e5d56edb tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-163132805", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:05:29.889768 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.network.neutron [None req-039575a0-804d-4427-a98f-e6b8e5d56edb tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] validate_networks() for None {{(pid=122632) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 23:05:30.199743 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-039575a0-804d-4427-a98f-e6b8e5d56edb tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Flavor limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:05:30.200163 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-039575a0-804d-4427-a98f-e6b8e5d56edb tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Image limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:05:30.200923 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-039575a0-804d-4427-a98f-e6b8e5d56edb tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Flavor pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:05:30.201509 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-039575a0-804d-4427-a98f-e6b8e5d56edb tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Image pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:05:30.202101 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-039575a0-804d-4427-a98f-e6b8e5d56edb tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:05:30.216276 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-039575a0-804d-4427-a98f-e6b8e5d56edb tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:30.216751 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-039575a0-804d-4427-a98f-e6b8e5d56edb tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:30.217188 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-039575a0-804d-4427-a98f-e6b8e5d56edb tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:30.217907 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-039575a0-804d-4427-a98f-e6b8e5d56edb tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:30.218349 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-039575a0-804d-4427-a98f-e6b8e5d56edb tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:30.218770 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-039575a0-804d-4427-a98f-e6b8e5d56edb tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:30.247781 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-039575a0-804d-4427-a98f-e6b8e5d56edb tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Getting quotas for project 891f4d07d0af47b19c4f43b24ff0b7ef. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:05:30.254122 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-039575a0-804d-4427-a98f-e6b8e5d56edb tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Getting quotas for user 1a092c6b8aa444999c32d8be76cabd3d and project 891f4d07d0af47b19c4f43b24ff0b7ef. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:05:30.269704 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-039575a0-804d-4427-a98f-e6b8e5d56edb tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Going to run 1 instances... {{(pid=122632) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 23:05:30.273650 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-039575a0-804d-4427-a98f-e6b8e5d56edb tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] [instance: d65d59de-9c9c-47c6-8066-6c9bb7245bd7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78ad8905-f66f-4733-8be9-2b260f1fabed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122632) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 23:05:30.325107 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-039575a0-804d-4427-a98f-e6b8e5d56edb tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.727129 Aug 10 23:05:30.325766 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1105/2194] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 23:05:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 729 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 23:05:30.341947 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-df2e7f46-80b0-4b02-abdb-7538fa7ef278 tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:05:30.343150 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-df2e7f46-80b0-4b02-abdb-7538fa7ef278 tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] [instance: b9b9e57b-0669-46b6-afae-b5c439f688d2] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:05:30.351984 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-df2e7f46-80b0-4b02-abdb-7538fa7ef278 tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:30.352532 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-df2e7f46-80b0-4b02-abdb-7538fa7ef278 tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:30.353341 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-df2e7f46-80b0-4b02-abdb-7538fa7ef278 tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:30.355000 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-df2e7f46-80b0-4b02-abdb-7538fa7ef278 tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:30.355689 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-df2e7f46-80b0-4b02-abdb-7538fa7ef278 tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:30.356332 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-df2e7f46-80b0-4b02-abdb-7538fa7ef278 tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:30.459125 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-758fc7a3-81fc-467e-ba02-ac09425f8622 tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] 10.222.0.58 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.142186 Aug 10 23:05:30.460039 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1090/2195] 10.222.0.58 () {60 vars in 1170 bytes} [Wed Aug 10 23:05:28 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:05:30.466302 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-332590ef-a838-4918-a179-a2bc5cd7ca0f tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:05:30.467326 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-332590ef-a838-4918-a179-a2bc5cd7ca0f tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] [instance: b3b3730c-1396-4ca6-9d9e-8a3104950324] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:05:30.475516 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-332590ef-a838-4918-a179-a2bc5cd7ca0f tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:30.476676 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-332590ef-a838-4918-a179-a2bc5cd7ca0f tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:30.477270 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-332590ef-a838-4918-a179-a2bc5cd7ca0f tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:30.478202 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-332590ef-a838-4918-a179-a2bc5cd7ca0f tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:30.480102 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-332590ef-a838-4918-a179-a2bc5cd7ca0f tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:30.480691 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-332590ef-a838-4918-a179-a2bc5cd7ca0f tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:30.570968 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-df2e7f46-80b0-4b02-abdb-7538fa7ef278 tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a2a5950cd342da86821122c08f028b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9960516a057e4f629fe5deb41e54d1d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:05:30.582256 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-df2e7f46-80b0-4b02-abdb-7538fa7ef278 tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] 10.222.0.58 "GET /compute/v2.1/servers/b9b9e57b-0669-46b6-afae-b5c439f688d2" status: 200 len: 1404 microversion: 2.1 time: 0.255118 Aug 10 23:05:30.592387 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1106/2196] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:05:30 2022] GET /compute/v2.1/servers/b9b9e57b-0669-46b6-afae-b5c439f688d2 => generated 1404 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:05:30.608870 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-d1960e5e-737f-43e9-a3d1-37a168c6a046 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:05:30.611699 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-d1960e5e-737f-43e9-a3d1-37a168c6a046 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] [instance: d65d59de-9c9c-47c6-8066-6c9bb7245bd7] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:05:30.736371 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-d1960e5e-737f-43e9-a3d1-37a168c6a046 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a092c6b8aa444999c32d8be76cabd3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891f4d07d0af47b19c4f43b24ff0b7ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:05:30.759040 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-d1960e5e-737f-43e9-a3d1-37a168c6a046 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] 10.222.0.58 "GET /compute/v2.1/servers/d65d59de-9c9c-47c6-8066-6c9bb7245bd7" status: 200 len: 1218 microversion: 2.1 time: 0.158425 Aug 10 23:05:30.772735 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1107/2197] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:05:30 2022] GET /compute/v2.1/servers/d65d59de-9c9c-47c6-8066-6c9bb7245bd7 => generated 1218 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:05:30.789503 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-2c1c08c0-a03c-4378-9562-cb7cc973154c tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1586597000", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452", "networks": [{"uuid": "08b082ca-1914-4b5a-a95f-5a10f05c8ff5"}]}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:05:30.809496 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-332590ef-a838-4918-a179-a2bc5cd7ca0f tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de244f1f82143a0b3d3283c31d80bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14c63df2e6c46d2af23b6b8a52690d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:05:30.822079 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-332590ef-a838-4918-a179-a2bc5cd7ca0f tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] 10.222.0.58 "GET /compute/v2.1/servers/b3b3730c-1396-4ca6-9d9e-8a3104950324" status: 200 len: 1471 microversion: 2.1 time: 0.358649 Aug 10 23:05:30.825365 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1091/2198] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:05:30 2022] GET /compute/v2.1/servers/b3b3730c-1396-4ca6-9d9e-8a3104950324 => generated 1471 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:05:30.851940 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.network.neutron [None req-2c1c08c0-a03c-4378-9562-cb7cc973154c tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] validate_networks() for [('08b082ca-1914-4b5a-a95f-5a10f05c8ff5', None, None, None, None, None)] {{(pid=122632) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 23:05:31.343250 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-23e0e56b-b9cc-4f25-afb8-433ac96c3b2b req-22f79705-779f-4847-bbd2-ecd45585f182 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9b9e57b-0669-46b6-afae-b5c439f688d2", "name": "network-vif-plugged", "status": "completed", "tag": "0291afb1-e014-41f8-9d03-ceea7b48df34"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:05:31.361820 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-23e0e56b-b9cc-4f25-afb8-433ac96c3b2b req-22f79705-779f-4847-bbd2-ecd45585f182 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:31.363563 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-23e0e56b-b9cc-4f25-afb8-433ac96c3b2b req-22f79705-779f-4847-bbd2-ecd45585f182 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:31.364031 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-23e0e56b-b9cc-4f25-afb8-433ac96c3b2b req-22f79705-779f-4847-bbd2-ecd45585f182 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:31.394526 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-23e0e56b-b9cc-4f25-afb8-433ac96c3b2b req-22f79705-779f-4847-bbd2-ecd45585f182 service nova] Creating event network-vif-plugged:0291afb1-e014-41f8-9d03-ceea7b48df34 for instance b9b9e57b-0669-46b6-afae-b5c439f688d2 on n-h2-850468-14 Aug 10 23:05:31.410466 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-23e0e56b-b9cc-4f25-afb8-433ac96c3b2b req-22f79705-779f-4847-bbd2-ecd45585f182 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068305 Aug 10 23:05:31.411178 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1092/2199] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:05:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 23:05:31.420865 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-2c1c08c0-a03c-4378-9562-cb7cc973154c tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Flavor limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:05:31.421540 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-2c1c08c0-a03c-4378-9562-cb7cc973154c tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Image limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:05:31.422178 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-2c1c08c0-a03c-4378-9562-cb7cc973154c tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Flavor pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:05:31.422744 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-2c1c08c0-a03c-4378-9562-cb7cc973154c tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Image pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:05:31.423554 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-2c1c08c0-a03c-4378-9562-cb7cc973154c tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:05:31.435564 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2c1c08c0-a03c-4378-9562-cb7cc973154c tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:31.436284 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2c1c08c0-a03c-4378-9562-cb7cc973154c tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:31.436906 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2c1c08c0-a03c-4378-9562-cb7cc973154c tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:31.437799 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2c1c08c0-a03c-4378-9562-cb7cc973154c tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:31.439266 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2c1c08c0-a03c-4378-9562-cb7cc973154c tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:31.439863 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2c1c08c0-a03c-4378-9562-cb7cc973154c tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:31.464179 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-2c1c08c0-a03c-4378-9562-cb7cc973154c tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Getting quotas for project 13d6f13784504fc7b2fcf0d6957b4920. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:05:31.472260 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-2c1c08c0-a03c-4378-9562-cb7cc973154c tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Getting quotas for user 933e6a08c3014b36aee164b213bbfaf0 and project 13d6f13784504fc7b2fcf0d6957b4920. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:05:31.488464 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-2c1c08c0-a03c-4378-9562-cb7cc973154c tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Going to run 1 instances... {{(pid=122632) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 23:05:31.491435 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-2c1c08c0-a03c-4378-9562-cb7cc973154c tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] [instance: 33a1bb4c-217e-40f9-b67f-d873bea80284] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78ad8905-f66f-4733-8be9-2b260f1fabed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122632) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 23:05:31.545470 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-2c1c08c0-a03c-4378-9562-cb7cc973154c tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.768686 Aug 10 23:05:31.545470 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1108/2200] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 23:05:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 770 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 23:05:31.563759 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-042745c9-a416-4572-940e-87ba98b91f77 tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:05:31.564475 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-042745c9-a416-4572-940e-87ba98b91f77 tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] [instance: 33a1bb4c-217e-40f9-b67f-d873bea80284] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:05:31.607941 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-b1b692eb-9873-4305-9567-7abe0633670e tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:05:31.608564 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-b1b692eb-9873-4305-9567-7abe0633670e tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] [instance: b9b9e57b-0669-46b6-afae-b5c439f688d2] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:05:31.627692 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b1b692eb-9873-4305-9567-7abe0633670e tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:31.628182 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b1b692eb-9873-4305-9567-7abe0633670e tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:31.628786 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b1b692eb-9873-4305-9567-7abe0633670e tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:31.629658 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b1b692eb-9873-4305-9567-7abe0633670e tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:31.635461 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b1b692eb-9873-4305-9567-7abe0633670e tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:31.636196 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b1b692eb-9873-4305-9567-7abe0633670e tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:31.699228 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-042745c9-a416-4572-940e-87ba98b91f77 tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '933e6a08c3014b36aee164b213bbfaf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d6f13784504fc7b2fcf0d6957b4920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:05:31.702064 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=33 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:05:31.713675 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-042745c9-a416-4572-940e-87ba98b91f77 tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] 10.222.0.58 "GET /compute/v2.1/servers/33a1bb4c-217e-40f9-b67f-d873bea80284" status: 200 len: 1224 microversion: 2.1 time: 0.162646 Aug 10 23:05:31.714333 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1093/2201] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:05:31 2022] GET /compute/v2.1/servers/33a1bb4c-217e-40f9-b67f-d873bea80284 => generated 1224 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:05:31.781133 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-1659e72d-7fe4-4b71-b6a5-7a6eeb6f7c5b tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:05:31.781755 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-1659e72d-7fe4-4b71-b6a5-7a6eeb6f7c5b tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] [instance: d65d59de-9c9c-47c6-8066-6c9bb7245bd7] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:05:31.797143 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1659e72d-7fe4-4b71-b6a5-7a6eeb6f7c5b tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:31.797643 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1659e72d-7fe4-4b71-b6a5-7a6eeb6f7c5b tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:31.798085 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1659e72d-7fe4-4b71-b6a5-7a6eeb6f7c5b tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:31.798860 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1659e72d-7fe4-4b71-b6a5-7a6eeb6f7c5b tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:31.799281 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1659e72d-7fe4-4b71-b6a5-7a6eeb6f7c5b tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:31.799716 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1659e72d-7fe4-4b71-b6a5-7a6eeb6f7c5b tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:31.934599 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-b1b692eb-9873-4305-9567-7abe0633670e tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a2a5950cd342da86821122c08f028b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9960516a057e4f629fe5deb41e54d1d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:05:31.945763 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-b1b692eb-9873-4305-9567-7abe0633670e tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] 10.222.0.58 "GET /compute/v2.1/servers/b9b9e57b-0669-46b6-afae-b5c439f688d2" status: 200 len: 1404 microversion: 2.1 time: 0.341841 Aug 10 23:05:31.947946 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1109/2202] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:05:31 2022] GET /compute/v2.1/servers/b9b9e57b-0669-46b6-afae-b5c439f688d2 => generated 1404 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:05:31.953255 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-5f3237bd-31fc-4881-8ee4-c8cb704afd3a tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:05:31.954332 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-5f3237bd-31fc-4881-8ee4-c8cb704afd3a tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] [instance: b3b3730c-1396-4ca6-9d9e-8a3104950324] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:05:31.962391 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5f3237bd-31fc-4881-8ee4-c8cb704afd3a tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:31.964620 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5f3237bd-31fc-4881-8ee4-c8cb704afd3a tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:31.965388 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5f3237bd-31fc-4881-8ee4-c8cb704afd3a tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:31.967437 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5f3237bd-31fc-4881-8ee4-c8cb704afd3a tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:31.968410 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5f3237bd-31fc-4881-8ee4-c8cb704afd3a tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:31.969276 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5f3237bd-31fc-4881-8ee4-c8cb704afd3a tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:31.981002 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-1659e72d-7fe4-4b71-b6a5-7a6eeb6f7c5b tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a092c6b8aa444999c32d8be76cabd3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891f4d07d0af47b19c4f43b24ff0b7ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:05:31.996962 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-1659e72d-7fe4-4b71-b6a5-7a6eeb6f7c5b tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] 10.222.0.58 "GET /compute/v2.1/servers/d65d59de-9c9c-47c6-8066-6c9bb7245bd7" status: 200 len: 1270 microversion: 2.1 time: 0.220462 Aug 10 23:05:31.999237 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1094/2203] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:05:31 2022] GET /compute/v2.1/servers/d65d59de-9c9c-47c6-8066-6c9bb7245bd7 => generated 1270 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:05:32.509047 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-5f3237bd-31fc-4881-8ee4-c8cb704afd3a tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de244f1f82143a0b3d3283c31d80bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14c63df2e6c46d2af23b6b8a52690d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:05:32.517848 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-5f3237bd-31fc-4881-8ee4-c8cb704afd3a tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] 10.222.0.58 "GET /compute/v2.1/servers/b3b3730c-1396-4ca6-9d9e-8a3104950324" status: 200 len: 1471 microversion: 2.1 time: 0.568519 Aug 10 23:05:32.520311 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1110/2204] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:05:31 2022] GET /compute/v2.1/servers/b3b3730c-1396-4ca6-9d9e-8a3104950324 => generated 1471 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:05:32.742349 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-1bdb2d16-42a1-4e06-b3a9-ec81070b7b10 tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:05:32.743721 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-1bdb2d16-42a1-4e06-b3a9-ec81070b7b10 tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] [instance: 33a1bb4c-217e-40f9-b67f-d873bea80284] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:05:32.757252 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1bdb2d16-42a1-4e06-b3a9-ec81070b7b10 tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:32.757954 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1bdb2d16-42a1-4e06-b3a9-ec81070b7b10 tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:32.759614 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1bdb2d16-42a1-4e06-b3a9-ec81070b7b10 tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:32.763370 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1bdb2d16-42a1-4e06-b3a9-ec81070b7b10 tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:32.764042 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1bdb2d16-42a1-4e06-b3a9-ec81070b7b10 tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:32.766273 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1bdb2d16-42a1-4e06-b3a9-ec81070b7b10 tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:32.876506 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-1bdb2d16-42a1-4e06-b3a9-ec81070b7b10 tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '933e6a08c3014b36aee164b213bbfaf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d6f13784504fc7b2fcf0d6957b4920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:05:32.891861 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-1bdb2d16-42a1-4e06-b3a9-ec81070b7b10 tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] 10.222.0.58 "GET /compute/v2.1/servers/33a1bb4c-217e-40f9-b67f-d873bea80284" status: 200 len: 1220 microversion: 2.1 time: 0.155498 Aug 10 23:05:32.904459 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1095/2205] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:05:32 2022] GET /compute/v2.1/servers/33a1bb4c-217e-40f9-b67f-d873bea80284 => generated 1220 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:05:32.974354 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-bda309f7-c49f-464d-baf8-c5beb92b8321 tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:05:32.975359 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-bda309f7-c49f-464d-baf8-c5beb92b8321 tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] [instance: b9b9e57b-0669-46b6-afae-b5c439f688d2] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:05:33.004796 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bda309f7-c49f-464d-baf8-c5beb92b8321 tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:33.009022 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bda309f7-c49f-464d-baf8-c5beb92b8321 tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:33.013300 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bda309f7-c49f-464d-baf8-c5beb92b8321 tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:33.014275 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bda309f7-c49f-464d-baf8-c5beb92b8321 tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:33.016522 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bda309f7-c49f-464d-baf8-c5beb92b8321 tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:33.017467 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bda309f7-c49f-464d-baf8-c5beb92b8321 tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:33.021791 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-d94471bd-e6fa-4349-96cd-692611217ee7 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:05:33.022536 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-d94471bd-e6fa-4349-96cd-692611217ee7 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] [instance: d65d59de-9c9c-47c6-8066-6c9bb7245bd7] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:05:33.037064 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d94471bd-e6fa-4349-96cd-692611217ee7 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:33.042810 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d94471bd-e6fa-4349-96cd-692611217ee7 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:33.043865 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d94471bd-e6fa-4349-96cd-692611217ee7 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:33.047176 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d94471bd-e6fa-4349-96cd-692611217ee7 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:33.052938 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d94471bd-e6fa-4349-96cd-692611217ee7 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:33.054220 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d94471bd-e6fa-4349-96cd-692611217ee7 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:33.223812 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-d94471bd-e6fa-4349-96cd-692611217ee7 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a092c6b8aa444999c32d8be76cabd3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891f4d07d0af47b19c4f43b24ff0b7ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:05:33.241117 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-d94471bd-e6fa-4349-96cd-692611217ee7 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] 10.222.0.58 "GET /compute/v2.1/servers/d65d59de-9c9c-47c6-8066-6c9bb7245bd7" status: 200 len: 1276 microversion: 2.1 time: 0.221225 Aug 10 23:05:33.243618 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1096/2206] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:05:33 2022] GET /compute/v2.1/servers/d65d59de-9c9c-47c6-8066-6c9bb7245bd7 => generated 1276 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:05:33.546220 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-4e6f1c9b-e112-4b3a-8557-ea94fbfe9f93 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:05:33.547274 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-4e6f1c9b-e112-4b3a-8557-ea94fbfe9f93 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] [instance: b3b3730c-1396-4ca6-9d9e-8a3104950324] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:05:33.568003 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4e6f1c9b-e112-4b3a-8557-ea94fbfe9f93 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:33.571170 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4e6f1c9b-e112-4b3a-8557-ea94fbfe9f93 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:33.574194 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4e6f1c9b-e112-4b3a-8557-ea94fbfe9f93 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:33.578804 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4e6f1c9b-e112-4b3a-8557-ea94fbfe9f93 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:33.581275 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4e6f1c9b-e112-4b3a-8557-ea94fbfe9f93 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:33.582311 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4e6f1c9b-e112-4b3a-8557-ea94fbfe9f93 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:33.892997 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-bda309f7-c49f-464d-baf8-c5beb92b8321 tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a2a5950cd342da86821122c08f028b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9960516a057e4f629fe5deb41e54d1d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:05:33.902077 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-bda309f7-c49f-464d-baf8-c5beb92b8321 tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] 10.222.0.58 "GET /compute/v2.1/servers/b9b9e57b-0669-46b6-afae-b5c439f688d2" status: 200 len: 1404 microversion: 2.1 time: 0.931201 Aug 10 23:05:33.903052 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1111/2207] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:05:32 2022] GET /compute/v2.1/servers/b9b9e57b-0669-46b6-afae-b5c439f688d2 => generated 1404 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:05:33.918564 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-a9cbfd4b-3581-41e2-a53e-7a1a2b97d685 tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:05:33.919218 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-a9cbfd4b-3581-41e2-a53e-7a1a2b97d685 tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] [instance: 33a1bb4c-217e-40f9-b67f-d873bea80284] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:05:33.930126 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a9cbfd4b-3581-41e2-a53e-7a1a2b97d685 tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:33.936112 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a9cbfd4b-3581-41e2-a53e-7a1a2b97d685 tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:33.936827 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a9cbfd4b-3581-41e2-a53e-7a1a2b97d685 tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:33.940817 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a9cbfd4b-3581-41e2-a53e-7a1a2b97d685 tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:33.942053 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a9cbfd4b-3581-41e2-a53e-7a1a2b97d685 tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:33.943844 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a9cbfd4b-3581-41e2-a53e-7a1a2b97d685 tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:34.193018 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-a9cbfd4b-3581-41e2-a53e-7a1a2b97d685 tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '933e6a08c3014b36aee164b213bbfaf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d6f13784504fc7b2fcf0d6957b4920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:05:34.201799 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:05:34.213186 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-a9cbfd4b-3581-41e2-a53e-7a1a2b97d685 tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] 10.222.0.58 "GET /compute/v2.1/servers/33a1bb4c-217e-40f9-b67f-d873bea80284" status: 200 len: 1282 microversion: 2.1 time: 0.300161 Aug 10 23:05:34.215600 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1112/2208] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:05:33 2022] GET /compute/v2.1/servers/33a1bb4c-217e-40f9-b67f-d873bea80284 => generated 1282 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:05:34.281196 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-df5ee79a-7ead-44bc-9488-690930e1dff7 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:05:34.282909 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-df5ee79a-7ead-44bc-9488-690930e1dff7 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] [instance: d65d59de-9c9c-47c6-8066-6c9bb7245bd7] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:05:34.324635 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-df5ee79a-7ead-44bc-9488-690930e1dff7 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:34.325311 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-df5ee79a-7ead-44bc-9488-690930e1dff7 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:34.328666 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-df5ee79a-7ead-44bc-9488-690930e1dff7 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:34.329553 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-df5ee79a-7ead-44bc-9488-690930e1dff7 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:34.330135 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-df5ee79a-7ead-44bc-9488-690930e1dff7 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:34.331302 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-df5ee79a-7ead-44bc-9488-690930e1dff7 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:34.465468 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-df5ee79a-7ead-44bc-9488-690930e1dff7 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a092c6b8aa444999c32d8be76cabd3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891f4d07d0af47b19c4f43b24ff0b7ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:05:34.491933 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-df5ee79a-7ead-44bc-9488-690930e1dff7 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] 10.222.0.58 "GET /compute/v2.1/servers/d65d59de-9c9c-47c6-8066-6c9bb7245bd7" status: 200 len: 1276 microversion: 2.1 time: 0.231678 Aug 10 23:05:34.493422 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1113/2209] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:05:34 2022] GET /compute/v2.1/servers/d65d59de-9c9c-47c6-8066-6c9bb7245bd7 => generated 1276 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:05:34.725778 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-4e6f1c9b-e112-4b3a-8557-ea94fbfe9f93 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de244f1f82143a0b3d3283c31d80bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14c63df2e6c46d2af23b6b8a52690d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:05:34.738471 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-4e6f1c9b-e112-4b3a-8557-ea94fbfe9f93 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] 10.222.0.58 "GET /compute/v2.1/servers/b3b3730c-1396-4ca6-9d9e-8a3104950324" status: 200 len: 1471 microversion: 2.1 time: 1.197577 Aug 10 23:05:34.760569 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1097/2210] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:05:33 2022] GET /compute/v2.1/servers/b3b3730c-1396-4ca6-9d9e-8a3104950324 => generated 1471 bytes in 1221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:05:34.928059 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-1d5313b3-ff72-4a43-a185-03f01ee1369b tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:05:34.929156 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-1d5313b3-ff72-4a43-a185-03f01ee1369b tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] [instance: b9b9e57b-0669-46b6-afae-b5c439f688d2] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:05:34.936237 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1d5313b3-ff72-4a43-a185-03f01ee1369b tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:34.938993 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1d5313b3-ff72-4a43-a185-03f01ee1369b tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:34.939708 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1d5313b3-ff72-4a43-a185-03f01ee1369b tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:34.940677 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1d5313b3-ff72-4a43-a185-03f01ee1369b tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:34.941444 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1d5313b3-ff72-4a43-a185-03f01ee1369b tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:34.942102 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1d5313b3-ff72-4a43-a185-03f01ee1369b tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:35.243183 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-64ec7dd5-8760-4767-a62c-9897e052322e tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:05:35.247825 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-64ec7dd5-8760-4767-a62c-9897e052322e tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] [instance: 33a1bb4c-217e-40f9-b67f-d873bea80284] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:05:35.264490 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:05:35.291672 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-64ec7dd5-8760-4767-a62c-9897e052322e tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:35.293678 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-64ec7dd5-8760-4767-a62c-9897e052322e tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:35.294885 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-64ec7dd5-8760-4767-a62c-9897e052322e tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:35.296033 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-64ec7dd5-8760-4767-a62c-9897e052322e tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:35.296855 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-64ec7dd5-8760-4767-a62c-9897e052322e tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:35.298014 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-64ec7dd5-8760-4767-a62c-9897e052322e tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:35.491738 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-64ec7dd5-8760-4767-a62c-9897e052322e tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '933e6a08c3014b36aee164b213bbfaf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d6f13784504fc7b2fcf0d6957b4920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:05:35.507029 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-64ec7dd5-8760-4767-a62c-9897e052322e tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] 10.222.0.58 "GET /compute/v2.1/servers/33a1bb4c-217e-40f9-b67f-d873bea80284" status: 200 len: 1282 microversion: 2.1 time: 0.265592 Aug 10 23:05:35.507793 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1098/2211] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:05:35 2022] GET /compute/v2.1/servers/33a1bb4c-217e-40f9-b67f-d873bea80284 => generated 1282 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:05:35.528708 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-d314db73-affd-4874-a188-18a79d583a83 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:05:35.529915 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-d314db73-affd-4874-a188-18a79d583a83 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] [instance: d65d59de-9c9c-47c6-8066-6c9bb7245bd7] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:05:35.536514 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d314db73-affd-4874-a188-18a79d583a83 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:35.537245 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d314db73-affd-4874-a188-18a79d583a83 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:35.537949 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d314db73-affd-4874-a188-18a79d583a83 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:35.538855 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d314db73-affd-4874-a188-18a79d583a83 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:35.539472 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d314db73-affd-4874-a188-18a79d583a83 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:35.540044 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d314db73-affd-4874-a188-18a79d583a83 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:35.543918 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-1d5313b3-ff72-4a43-a185-03f01ee1369b tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a2a5950cd342da86821122c08f028b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9960516a057e4f629fe5deb41e54d1d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:05:35.552839 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-1d5313b3-ff72-4a43-a185-03f01ee1369b tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] 10.222.0.58 "GET /compute/v2.1/servers/b9b9e57b-0669-46b6-afae-b5c439f688d2" status: 200 len: 1590 microversion: 2.1 time: 0.628566 Aug 10 23:05:35.553897 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1114/2212] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:05:34 2022] GET /compute/v2.1/servers/b9b9e57b-0669-46b6-afae-b5c439f688d2 => generated 1590 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:05:35.576001 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-6bb7f17b-4cb1-47c7-a15d-e4335ce1fec6 tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:05:35.576637 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-6bb7f17b-4cb1-47c7-a15d-e4335ce1fec6 tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] [instance: b9b9e57b-0669-46b6-afae-b5c439f688d2] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:05:35.587524 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6bb7f17b-4cb1-47c7-a15d-e4335ce1fec6 tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:35.587936 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6bb7f17b-4cb1-47c7-a15d-e4335ce1fec6 tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:35.588947 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6bb7f17b-4cb1-47c7-a15d-e4335ce1fec6 tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:35.590079 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6bb7f17b-4cb1-47c7-a15d-e4335ce1fec6 tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:35.590615 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6bb7f17b-4cb1-47c7-a15d-e4335ce1fec6 tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:35.591079 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6bb7f17b-4cb1-47c7-a15d-e4335ce1fec6 tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:35.758763 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-6bb7f17b-4cb1-47c7-a15d-e4335ce1fec6 tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] 10.222.0.58 "GET /compute/v2.1/servers/b9b9e57b-0669-46b6-afae-b5c439f688d2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.188028 Aug 10 23:05:35.761175 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1115/2213] 10.222.0.58 () {58 vars in 1275 bytes} [Wed Aug 10 23:05:35 2022] GET /compute/v2.1/servers/b9b9e57b-0669-46b6-afae-b5c439f688d2/os-interface => generated 284 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:05:35.766939 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-95e09899-f238-440e-bd15-531711ccdb0c tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:05:35.768655 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-95e09899-f238-440e-bd15-531711ccdb0c tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] [instance: b3b3730c-1396-4ca6-9d9e-8a3104950324] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:05:35.779368 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-95e09899-f238-440e-bd15-531711ccdb0c tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:35.779993 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-95e09899-f238-440e-bd15-531711ccdb0c tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:35.780728 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-95e09899-f238-440e-bd15-531711ccdb0c tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:35.781824 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-95e09899-f238-440e-bd15-531711ccdb0c tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:35.782666 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-95e09899-f238-440e-bd15-531711ccdb0c tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:35.783357 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-95e09899-f238-440e-bd15-531711ccdb0c tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:35.904231 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-d314db73-affd-4874-a188-18a79d583a83 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a092c6b8aa444999c32d8be76cabd3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891f4d07d0af47b19c4f43b24ff0b7ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:05:35.917880 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-d314db73-affd-4874-a188-18a79d583a83 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] 10.222.0.58 "GET /compute/v2.1/servers/d65d59de-9c9c-47c6-8066-6c9bb7245bd7" status: 200 len: 1318 microversion: 2.1 time: 0.396347 Aug 10 23:05:35.919753 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1099/2214] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:05:35 2022] GET /compute/v2.1/servers/d65d59de-9c9c-47c6-8066-6c9bb7245bd7 => generated 1318 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:05:36.458290 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-95e09899-f238-440e-bd15-531711ccdb0c tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de244f1f82143a0b3d3283c31d80bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14c63df2e6c46d2af23b6b8a52690d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:05:36.469619 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-95e09899-f238-440e-bd15-531711ccdb0c tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] 10.222.0.58 "GET /compute/v2.1/servers/b3b3730c-1396-4ca6-9d9e-8a3104950324" status: 200 len: 1471 microversion: 2.1 time: 0.706420 Aug 10 23:05:36.470354 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1116/2215] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:05:35 2022] GET /compute/v2.1/servers/b3b3730c-1396-4ca6-9d9e-8a3104950324 => generated 1471 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:05:36.531460 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-bcc71c55-bf47-4c9e-a195-ede48769fa2f tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:05:36.532932 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-bcc71c55-bf47-4c9e-a195-ede48769fa2f tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] [instance: 33a1bb4c-217e-40f9-b67f-d873bea80284] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:05:36.540375 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=12 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:05:36.544924 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bcc71c55-bf47-4c9e-a195-ede48769fa2f tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:36.545605 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bcc71c55-bf47-4c9e-a195-ede48769fa2f tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:36.546229 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bcc71c55-bf47-4c9e-a195-ede48769fa2f tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:36.547139 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bcc71c55-bf47-4c9e-a195-ede48769fa2f tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:36.547745 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bcc71c55-bf47-4c9e-a195-ede48769fa2f tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:36.548406 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bcc71c55-bf47-4c9e-a195-ede48769fa2f tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:36.940786 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-0b460ef7-6dab-4c8a-95a1-a47d76740f7d tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:05:36.941332 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-0b460ef7-6dab-4c8a-95a1-a47d76740f7d tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] [instance: d65d59de-9c9c-47c6-8066-6c9bb7245bd7] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:05:36.944797 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:05:36.960094 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0b460ef7-6dab-4c8a-95a1-a47d76740f7d tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:36.965428 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0b460ef7-6dab-4c8a-95a1-a47d76740f7d tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:36.967287 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0b460ef7-6dab-4c8a-95a1-a47d76740f7d tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:36.972331 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0b460ef7-6dab-4c8a-95a1-a47d76740f7d tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:36.972846 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0b460ef7-6dab-4c8a-95a1-a47d76740f7d tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:36.975987 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0b460ef7-6dab-4c8a-95a1-a47d76740f7d tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:36.997962 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-bcc71c55-bf47-4c9e-a195-ede48769fa2f tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '933e6a08c3014b36aee164b213bbfaf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d6f13784504fc7b2fcf0d6957b4920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:05:37.013880 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-bcc71c55-bf47-4c9e-a195-ede48769fa2f tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] 10.222.0.58 "GET /compute/v2.1/servers/33a1bb4c-217e-40f9-b67f-d873bea80284" status: 200 len: 1324 microversion: 2.1 time: 0.487014 Aug 10 23:05:37.016445 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1100/2216] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:05:36 2022] GET /compute/v2.1/servers/33a1bb4c-217e-40f9-b67f-d873bea80284 => generated 1324 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:05:37.491609 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-62b526a2-2e68-4cff-b83f-bac3eb4eeec1 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:05:37.492436 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-62b526a2-2e68-4cff-b83f-bac3eb4eeec1 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] [instance: b3b3730c-1396-4ca6-9d9e-8a3104950324] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:05:37.505027 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-62b526a2-2e68-4cff-b83f-bac3eb4eeec1 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:37.505027 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-62b526a2-2e68-4cff-b83f-bac3eb4eeec1 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:37.505027 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-62b526a2-2e68-4cff-b83f-bac3eb4eeec1 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:37.505675 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-62b526a2-2e68-4cff-b83f-bac3eb4eeec1 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:37.506143 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-62b526a2-2e68-4cff-b83f-bac3eb4eeec1 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:37.506576 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-62b526a2-2e68-4cff-b83f-bac3eb4eeec1 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:37.557810 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:05:37.833223 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-62b526a2-2e68-4cff-b83f-bac3eb4eeec1 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de244f1f82143a0b3d3283c31d80bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14c63df2e6c46d2af23b6b8a52690d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:05:37.845517 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-62b526a2-2e68-4cff-b83f-bac3eb4eeec1 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] 10.222.0.58 "GET /compute/v2.1/servers/b3b3730c-1396-4ca6-9d9e-8a3104950324" status: 200 len: 1471 microversion: 2.1 time: 0.357690 Aug 10 23:05:37.846460 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1101/2217] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:05:37 2022] GET /compute/v2.1/servers/b3b3730c-1396-4ca6-9d9e-8a3104950324 => generated 1471 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:05:38.037677 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-e0f66261-4ddd-4afe-ab4b-78f6cbf346bc tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:05:38.038325 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-e0f66261-4ddd-4afe-ab4b-78f6cbf346bc tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] [instance: 33a1bb4c-217e-40f9-b67f-d873bea80284] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:05:38.051964 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e0f66261-4ddd-4afe-ab4b-78f6cbf346bc tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:38.052617 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e0f66261-4ddd-4afe-ab4b-78f6cbf346bc tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:38.053387 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e0f66261-4ddd-4afe-ab4b-78f6cbf346bc tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:38.054612 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e0f66261-4ddd-4afe-ab4b-78f6cbf346bc tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:38.055302 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e0f66261-4ddd-4afe-ab4b-78f6cbf346bc tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:38.055884 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e0f66261-4ddd-4afe-ab4b-78f6cbf346bc tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:38.288374 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-0b460ef7-6dab-4c8a-95a1-a47d76740f7d tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a092c6b8aa444999c32d8be76cabd3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891f4d07d0af47b19c4f43b24ff0b7ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:05:38.308452 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-0b460ef7-6dab-4c8a-95a1-a47d76740f7d tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] 10.222.0.58 "GET /compute/v2.1/servers/d65d59de-9c9c-47c6-8066-6c9bb7245bd7" status: 200 len: 1318 microversion: 2.1 time: 1.372120 Aug 10 23:05:38.313490 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1117/2218] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:05:36 2022] GET /compute/v2.1/servers/d65d59de-9c9c-47c6-8066-6c9bb7245bd7 => generated 1318 bytes in 1378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:05:38.413115 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-e0f66261-4ddd-4afe-ab4b-78f6cbf346bc tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '933e6a08c3014b36aee164b213bbfaf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d6f13784504fc7b2fcf0d6957b4920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:05:38.439940 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-e0f66261-4ddd-4afe-ab4b-78f6cbf346bc tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] 10.222.0.58 "GET /compute/v2.1/servers/33a1bb4c-217e-40f9-b67f-d873bea80284" status: 200 len: 1324 microversion: 2.1 time: 0.407698 Aug 10 23:05:38.440718 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1102/2219] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:05:38 2022] GET /compute/v2.1/servers/33a1bb4c-217e-40f9-b67f-d873bea80284 => generated 1324 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:05:38.857742 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-c15c54a8-60e6-4c19-ba94-439075eb0848 req-3dcfc0f2-9cc8-4c86-b88b-2a47b7e8a902 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d65d59de-9c9c-47c6-8066-6c9bb7245bd7", "tag": "3fd6cc75-f4e4-45be-83fa-b2b3034b0353"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:05:38.876555 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-015b290f-e5cf-41a0-b05f-37a5d0e413ad tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:05:38.878238 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-015b290f-e5cf-41a0-b05f-37a5d0e413ad tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] [instance: b3b3730c-1396-4ca6-9d9e-8a3104950324] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:05:38.881441 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-c15c54a8-60e6-4c19-ba94-439075eb0848 req-3dcfc0f2-9cc8-4c86-b88b-2a47b7e8a902 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:38.882026 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-c15c54a8-60e6-4c19-ba94-439075eb0848 req-3dcfc0f2-9cc8-4c86-b88b-2a47b7e8a902 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:38.884706 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-c15c54a8-60e6-4c19-ba94-439075eb0848 req-3dcfc0f2-9cc8-4c86-b88b-2a47b7e8a902 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:38.892322 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-015b290f-e5cf-41a0-b05f-37a5d0e413ad tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:38.893316 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-015b290f-e5cf-41a0-b05f-37a5d0e413ad tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:38.894300 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-015b290f-e5cf-41a0-b05f-37a5d0e413ad tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:38.896655 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-015b290f-e5cf-41a0-b05f-37a5d0e413ad tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:38.898695 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-015b290f-e5cf-41a0-b05f-37a5d0e413ad tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:38.900249 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-015b290f-e5cf-41a0-b05f-37a5d0e413ad tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:38.920192 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-c15c54a8-60e6-4c19-ba94-439075eb0848 req-3dcfc0f2-9cc8-4c86-b88b-2a47b7e8a902 service nova] Creating event network-changed:3fd6cc75-f4e4-45be-83fa-b2b3034b0353 for instance d65d59de-9c9c-47c6-8066-6c9bb7245bd7 on n-h1-850468-14 Aug 10 23:05:38.931192 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-c15c54a8-60e6-4c19-ba94-439075eb0848 req-3dcfc0f2-9cc8-4c86-b88b-2a47b7e8a902 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079283 Aug 10 23:05:38.936192 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1118/2220] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:05:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:05:39.141263 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-015b290f-e5cf-41a0-b05f-37a5d0e413ad tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de244f1f82143a0b3d3283c31d80bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14c63df2e6c46d2af23b6b8a52690d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:05:39.158146 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-015b290f-e5cf-41a0-b05f-37a5d0e413ad tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] 10.222.0.58 "GET /compute/v2.1/servers/b3b3730c-1396-4ca6-9d9e-8a3104950324" status: 200 len: 1471 microversion: 2.1 time: 0.293284 Aug 10 23:05:39.176505 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1103/2221] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:05:38 2022] GET /compute/v2.1/servers/b3b3730c-1396-4ca6-9d9e-8a3104950324 => generated 1471 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:05:39.335736 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-78e3698f-cae5-4858-9169-67195e18f800 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:05:39.336627 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-78e3698f-cae5-4858-9169-67195e18f800 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] [instance: d65d59de-9c9c-47c6-8066-6c9bb7245bd7] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:05:39.348341 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-78e3698f-cae5-4858-9169-67195e18f800 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:39.350527 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-78e3698f-cae5-4858-9169-67195e18f800 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:39.351149 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-78e3698f-cae5-4858-9169-67195e18f800 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:39.352062 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-78e3698f-cae5-4858-9169-67195e18f800 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:39.352850 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-78e3698f-cae5-4858-9169-67195e18f800 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:39.353282 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-78e3698f-cae5-4858-9169-67195e18f800 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:39.417233 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c7df8fee-dc8c-4137-8c57-df4d59585f65 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1291441571", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452", "networks": [{"uuid": "72c3c713-0909-4c2e-939f-b2db0ad09ba6"}]}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:05:39.537597 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.network.neutron [None req-c7df8fee-dc8c-4137-8c57-df4d59585f65 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] validate_networks() for [('72c3c713-0909-4c2e-939f-b2db0ad09ba6', None, None, None, None, None)] {{(pid=122632) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 23:05:39.578959 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-78e3698f-cae5-4858-9169-67195e18f800 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a092c6b8aa444999c32d8be76cabd3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891f4d07d0af47b19c4f43b24ff0b7ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:05:39.588623 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-78e3698f-cae5-4858-9169-67195e18f800 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] 10.222.0.58 "GET /compute/v2.1/servers/d65d59de-9c9c-47c6-8066-6c9bb7245bd7" status: 200 len: 1318 microversion: 2.1 time: 0.256706 Aug 10 23:05:39.589217 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1104/2222] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:05:39 2022] GET /compute/v2.1/servers/d65d59de-9c9c-47c6-8066-6c9bb7245bd7 => generated 1318 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:05:39.593939 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-424bb7b6-a68b-428a-aa07-fa1b65fe457f tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:05:39.594799 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-424bb7b6-a68b-428a-aa07-fa1b65fe457f tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] [instance: 33a1bb4c-217e-40f9-b67f-d873bea80284] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:05:39.602092 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-424bb7b6-a68b-428a-aa07-fa1b65fe457f tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:39.602586 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-424bb7b6-a68b-428a-aa07-fa1b65fe457f tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:39.603149 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-424bb7b6-a68b-428a-aa07-fa1b65fe457f tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:39.605041 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-424bb7b6-a68b-428a-aa07-fa1b65fe457f tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:39.606014 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-424bb7b6-a68b-428a-aa07-fa1b65fe457f tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:39.606683 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-424bb7b6-a68b-428a-aa07-fa1b65fe457f tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:39.801683 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-424bb7b6-a68b-428a-aa07-fa1b65fe457f tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '933e6a08c3014b36aee164b213bbfaf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d6f13784504fc7b2fcf0d6957b4920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:05:39.811055 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-424bb7b6-a68b-428a-aa07-fa1b65fe457f tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] 10.222.0.58 "GET /compute/v2.1/servers/33a1bb4c-217e-40f9-b67f-d873bea80284" status: 200 len: 1324 microversion: 2.1 time: 0.220718 Aug 10 23:05:39.813590 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1105/2223] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:05:39 2022] GET /compute/v2.1/servers/33a1bb4c-217e-40f9-b67f-d873bea80284 => generated 1324 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:05:39.899284 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-f66b9a82-b84c-4165-8ebd-51405cc85551 tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:05:39.900161 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-f66b9a82-b84c-4165-8ebd-51405cc85551 tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] [instance: b9b9e57b-0669-46b6-afae-b5c439f688d2] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:05:39.914096 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f66b9a82-b84c-4165-8ebd-51405cc85551 tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:39.914588 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f66b9a82-b84c-4165-8ebd-51405cc85551 tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:39.915059 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f66b9a82-b84c-4165-8ebd-51405cc85551 tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:39.915807 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f66b9a82-b84c-4165-8ebd-51405cc85551 tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:39.916296 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f66b9a82-b84c-4165-8ebd-51405cc85551 tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:39.917158 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f66b9a82-b84c-4165-8ebd-51405cc85551 tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:40.138910 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-f66b9a82-b84c-4165-8ebd-51405cc85551 tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a2a5950cd342da86821122c08f028b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9960516a057e4f629fe5deb41e54d1d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:05:40.154185 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-f66b9a82-b84c-4165-8ebd-51405cc85551 tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] 10.222.0.58 "GET /compute/v2.1/servers/b9b9e57b-0669-46b6-afae-b5c439f688d2" status: 200 len: 1590 microversion: 2.1 time: 0.258574 Aug 10 23:05:40.154900 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1106/2224] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:05:39 2022] GET /compute/v2.1/servers/b9b9e57b-0669-46b6-afae-b5c439f688d2 => generated 1590 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:05:40.183787 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-77143a50-6cdc-4aba-aa3e-927ea125a8a6 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:05:40.185105 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-77143a50-6cdc-4aba-aa3e-927ea125a8a6 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] [instance: b3b3730c-1396-4ca6-9d9e-8a3104950324] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:05:40.195772 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-77143a50-6cdc-4aba-aa3e-927ea125a8a6 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:40.196281 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-77143a50-6cdc-4aba-aa3e-927ea125a8a6 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:40.196730 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-77143a50-6cdc-4aba-aa3e-927ea125a8a6 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:40.198657 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-77143a50-6cdc-4aba-aa3e-927ea125a8a6 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:40.199228 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-77143a50-6cdc-4aba-aa3e-927ea125a8a6 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:40.200039 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-77143a50-6cdc-4aba-aa3e-927ea125a8a6 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:40.227162 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-c7df8fee-dc8c-4137-8c57-df4d59585f65 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Flavor limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:05:40.228234 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-c7df8fee-dc8c-4137-8c57-df4d59585f65 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Image limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:05:40.229470 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-c7df8fee-dc8c-4137-8c57-df4d59585f65 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Flavor pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:05:40.229637 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-c7df8fee-dc8c-4137-8c57-df4d59585f65 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Image pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:05:40.230332 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-c7df8fee-dc8c-4137-8c57-df4d59585f65 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:05:40.240808 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c7df8fee-dc8c-4137-8c57-df4d59585f65 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:40.241661 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c7df8fee-dc8c-4137-8c57-df4d59585f65 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:40.242314 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c7df8fee-dc8c-4137-8c57-df4d59585f65 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:40.243313 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c7df8fee-dc8c-4137-8c57-df4d59585f65 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:40.244065 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c7df8fee-dc8c-4137-8c57-df4d59585f65 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:40.244949 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c7df8fee-dc8c-4137-8c57-df4d59585f65 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:40.271028 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-c7df8fee-dc8c-4137-8c57-df4d59585f65 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Getting quotas for project b46ac8b84bd649fa88897068dbfa5ce6. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:05:40.279260 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-c7df8fee-dc8c-4137-8c57-df4d59585f65 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Getting quotas for user 1b8899e278c9453fba0ab05c69b0b0b9 and project b46ac8b84bd649fa88897068dbfa5ce6. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:05:40.301045 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-c7df8fee-dc8c-4137-8c57-df4d59585f65 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Going to run 1 instances... {{(pid=122632) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 23:05:40.304123 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-c7df8fee-dc8c-4137-8c57-df4d59585f65 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] [instance: 662fba38-a52c-464c-8448-bfe0a1d78dab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78ad8905-f66f-4733-8be9-2b260f1fabed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122632) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 23:05:40.362096 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-c7df8fee-dc8c-4137-8c57-df4d59585f65 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.138195 Aug 10 23:05:40.363676 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1119/2225] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 23:05:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 1141 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 23:05:40.375628 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-9c259b2a-e199-44c8-b538-d2500de6105a tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:05:40.376580 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-9c259b2a-e199-44c8-b538-d2500de6105a tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] [instance: 662fba38-a52c-464c-8448-bfe0a1d78dab] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:05:40.453048 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-77143a50-6cdc-4aba-aa3e-927ea125a8a6 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de244f1f82143a0b3d3283c31d80bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14c63df2e6c46d2af23b6b8a52690d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:05:40.461276 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-77143a50-6cdc-4aba-aa3e-927ea125a8a6 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] 10.222.0.58 "GET /compute/v2.1/servers/b3b3730c-1396-4ca6-9d9e-8a3104950324" status: 200 len: 1477 microversion: 2.1 time: 0.284014 Aug 10 23:05:40.475303 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1107/2226] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:05:40 2022] GET /compute/v2.1/servers/b3b3730c-1396-4ca6-9d9e-8a3104950324 => generated 1477 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:05:40.495543 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-9c259b2a-e199-44c8-b538-d2500de6105a tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8899e278c9453fba0ab05c69b0b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46ac8b84bd649fa88897068dbfa5ce6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:05:40.504505 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-9c259b2a-e199-44c8-b538-d2500de6105a tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] 10.222.0.58 "GET /compute/v2.1/servers/662fba38-a52c-464c-8448-bfe0a1d78dab" status: 200 len: 1218 microversion: 2.1 time: 0.134177 Aug 10 23:05:40.506597 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1120/2227] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:05:40 2022] GET /compute/v2.1/servers/662fba38-a52c-464c-8448-bfe0a1d78dab => generated 1218 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:05:40.610129 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-a2c4f6fd-e1f8-48b7-bc08-63f908e13500 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:05:40.611055 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-a2c4f6fd-e1f8-48b7-bc08-63f908e13500 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] [instance: d65d59de-9c9c-47c6-8066-6c9bb7245bd7] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:05:40.627171 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a2c4f6fd-e1f8-48b7-bc08-63f908e13500 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:40.627679 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a2c4f6fd-e1f8-48b7-bc08-63f908e13500 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:40.628131 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a2c4f6fd-e1f8-48b7-bc08-63f908e13500 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:40.628860 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a2c4f6fd-e1f8-48b7-bc08-63f908e13500 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:40.629323 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a2c4f6fd-e1f8-48b7-bc08-63f908e13500 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:40.629756 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a2c4f6fd-e1f8-48b7-bc08-63f908e13500 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:40.836218 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-ee1c616b-3d1e-490d-afb2-d192c49f171f tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:05:40.837273 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-ee1c616b-3d1e-490d-afb2-d192c49f171f tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] [instance: 33a1bb4c-217e-40f9-b67f-d873bea80284] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:05:40.856750 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ee1c616b-3d1e-490d-afb2-d192c49f171f tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:40.859953 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ee1c616b-3d1e-490d-afb2-d192c49f171f tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:40.860703 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ee1c616b-3d1e-490d-afb2-d192c49f171f tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:40.861684 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ee1c616b-3d1e-490d-afb2-d192c49f171f tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:40.863382 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ee1c616b-3d1e-490d-afb2-d192c49f171f tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:40.864234 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ee1c616b-3d1e-490d-afb2-d192c49f171f tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:41.007783 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-a2c4f6fd-e1f8-48b7-bc08-63f908e13500 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a092c6b8aa444999c32d8be76cabd3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891f4d07d0af47b19c4f43b24ff0b7ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:05:41.018626 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-a2c4f6fd-e1f8-48b7-bc08-63f908e13500 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] 10.222.0.58 "GET /compute/v2.1/servers/d65d59de-9c9c-47c6-8066-6c9bb7245bd7" status: 200 len: 1318 microversion: 2.1 time: 0.413261 Aug 10 23:05:41.019469 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1108/2228] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:05:40 2022] GET /compute/v2.1/servers/d65d59de-9c9c-47c6-8066-6c9bb7245bd7 => generated 1318 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:05:41.034908 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-e6d93d81-77c0-4fe4-ba58-410f2eddd574 req-6b51ee6b-4657-4d02-84bf-b27edb9b7167 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33a1bb4c-217e-40f9-b67f-d873bea80284", "tag": "53ba640c-dbc3-45eb-93db-346c26b4a371"}, {"name": "network-changed", "server_uuid": "b9b9e57b-0669-46b6-afae-b5c439f688d2", "tag": "0291afb1-e014-41f8-9d03-ceea7b48df34"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:05:41.047773 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-e6d93d81-77c0-4fe4-ba58-410f2eddd574 req-6b51ee6b-4657-4d02-84bf-b27edb9b7167 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:41.054722 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-e6d93d81-77c0-4fe4-ba58-410f2eddd574 req-6b51ee6b-4657-4d02-84bf-b27edb9b7167 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:41.055413 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-e6d93d81-77c0-4fe4-ba58-410f2eddd574 req-6b51ee6b-4657-4d02-84bf-b27edb9b7167 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:41.106625 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-e6d93d81-77c0-4fe4-ba58-410f2eddd574 req-6b51ee6b-4657-4d02-84bf-b27edb9b7167 service nova] Creating event network-changed:53ba640c-dbc3-45eb-93db-346c26b4a371 for instance 33a1bb4c-217e-40f9-b67f-d873bea80284 on n-h1-850468-14 Aug 10 23:05:41.107147 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-e6d93d81-77c0-4fe4-ba58-410f2eddd574 req-6b51ee6b-4657-4d02-84bf-b27edb9b7167 service nova] Creating event network-changed:0291afb1-e014-41f8-9d03-ceea7b48df34 for instance b9b9e57b-0669-46b6-afae-b5c439f688d2 on n-h2-850468-14 Aug 10 23:05:41.139772 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-e6d93d81-77c0-4fe4-ba58-410f2eddd574 req-6b51ee6b-4657-4d02-84bf-b27edb9b7167 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.118600 Aug 10 23:05:41.152362 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1109/2229] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:05:41 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:05:41.279832 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-ee1c616b-3d1e-490d-afb2-d192c49f171f tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '933e6a08c3014b36aee164b213bbfaf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d6f13784504fc7b2fcf0d6957b4920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:05:41.292833 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-ee1c616b-3d1e-490d-afb2-d192c49f171f tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] 10.222.0.58 "GET /compute/v2.1/servers/33a1bb4c-217e-40f9-b67f-d873bea80284" status: 200 len: 1324 microversion: 2.1 time: 0.462032 Aug 10 23:05:41.293571 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1121/2230] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:05:40 2022] GET /compute/v2.1/servers/33a1bb4c-217e-40f9-b67f-d873bea80284 => generated 1324 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:05:41.487690 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-69c024ac-689a-4afa-b084-eb127cb895b8 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:05:41.489915 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-69c024ac-689a-4afa-b084-eb127cb895b8 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] [instance: b3b3730c-1396-4ca6-9d9e-8a3104950324] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:05:41.503513 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-69c024ac-689a-4afa-b084-eb127cb895b8 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:41.506320 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-69c024ac-689a-4afa-b084-eb127cb895b8 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:41.507071 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-69c024ac-689a-4afa-b084-eb127cb895b8 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:41.511273 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-69c024ac-689a-4afa-b084-eb127cb895b8 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:41.511931 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-69c024ac-689a-4afa-b084-eb127cb895b8 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:41.514154 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-69c024ac-689a-4afa-b084-eb127cb895b8 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:41.532525 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-21861076-7edf-4d5d-b581-e307d3b5311d tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:05:41.533144 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-21861076-7edf-4d5d-b581-e307d3b5311d tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] [instance: 662fba38-a52c-464c-8448-bfe0a1d78dab] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:05:41.551433 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-21861076-7edf-4d5d-b581-e307d3b5311d tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:41.551950 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-21861076-7edf-4d5d-b581-e307d3b5311d tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:41.552487 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-21861076-7edf-4d5d-b581-e307d3b5311d tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:41.560461 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-21861076-7edf-4d5d-b581-e307d3b5311d tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:41.561529 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-21861076-7edf-4d5d-b581-e307d3b5311d tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:41.562720 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-21861076-7edf-4d5d-b581-e307d3b5311d tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:41.689038 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-21861076-7edf-4d5d-b581-e307d3b5311d tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8899e278c9453fba0ab05c69b0b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46ac8b84bd649fa88897068dbfa5ce6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:05:41.699823 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-21861076-7edf-4d5d-b581-e307d3b5311d tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] 10.222.0.58 "GET /compute/v2.1/servers/662fba38-a52c-464c-8448-bfe0a1d78dab" status: 200 len: 1270 microversion: 2.1 time: 0.171052 Aug 10 23:05:41.702504 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1122/2231] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:05:41 2022] GET /compute/v2.1/servers/662fba38-a52c-464c-8448-bfe0a1d78dab => generated 1270 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:05:41.708057 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=1 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:05:41.828322 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-69c024ac-689a-4afa-b084-eb127cb895b8 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de244f1f82143a0b3d3283c31d80bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14c63df2e6c46d2af23b6b8a52690d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:05:41.838837 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-69c024ac-689a-4afa-b084-eb127cb895b8 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] 10.222.0.58 "GET /compute/v2.1/servers/b3b3730c-1396-4ca6-9d9e-8a3104950324" status: 200 len: 1477 microversion: 2.1 time: 0.355376 Aug 10 23:05:41.850927 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1110/2232] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:05:41 2022] GET /compute/v2.1/servers/b3b3730c-1396-4ca6-9d9e-8a3104950324 => generated 1477 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:05:42.040311 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-9673e2f0-e4ac-4080-ad30-d1731928c89c tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:05:42.041388 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-9673e2f0-e4ac-4080-ad30-d1731928c89c tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] [instance: d65d59de-9c9c-47c6-8066-6c9bb7245bd7] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:05:42.052703 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9673e2f0-e4ac-4080-ad30-d1731928c89c tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:42.053340 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9673e2f0-e4ac-4080-ad30-d1731928c89c tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:42.053921 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9673e2f0-e4ac-4080-ad30-d1731928c89c tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:42.062024 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9673e2f0-e4ac-4080-ad30-d1731928c89c tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:42.062520 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9673e2f0-e4ac-4080-ad30-d1731928c89c tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:42.063469 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9673e2f0-e4ac-4080-ad30-d1731928c89c tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:42.320455 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-640137d3-0789-494d-a5ea-c943a936a0eb tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:05:42.321339 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-640137d3-0789-494d-a5ea-c943a936a0eb tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] [instance: 33a1bb4c-217e-40f9-b67f-d873bea80284] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:05:42.335305 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-640137d3-0789-494d-a5ea-c943a936a0eb tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:42.335811 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-640137d3-0789-494d-a5ea-c943a936a0eb tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:42.336257 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-640137d3-0789-494d-a5ea-c943a936a0eb tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:42.336992 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-640137d3-0789-494d-a5ea-c943a936a0eb tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:42.337452 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-640137d3-0789-494d-a5ea-c943a936a0eb tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:42.343037 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-640137d3-0789-494d-a5ea-c943a936a0eb tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:42.928772 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-9673e2f0-e4ac-4080-ad30-d1731928c89c tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a092c6b8aa444999c32d8be76cabd3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891f4d07d0af47b19c4f43b24ff0b7ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:05:42.945135 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-9673e2f0-e4ac-4080-ad30-d1731928c89c tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] 10.222.0.58 "GET /compute/v2.1/servers/d65d59de-9c9c-47c6-8066-6c9bb7245bd7" status: 200 len: 1318 microversion: 2.1 time: 0.908912 Aug 10 23:05:42.945658 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1123/2233] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:05:42 2022] GET /compute/v2.1/servers/d65d59de-9c9c-47c6-8066-6c9bb7245bd7 => generated 1318 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:05:42.964383 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-23c67145-3692-40ae-b8c7-6e94d9ac8587 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:05:42.965369 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-23c67145-3692-40ae-b8c7-6e94d9ac8587 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] [instance: 662fba38-a52c-464c-8448-bfe0a1d78dab] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:05:42.972387 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-23c67145-3692-40ae-b8c7-6e94d9ac8587 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:42.973343 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-23c67145-3692-40ae-b8c7-6e94d9ac8587 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:42.987703 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-23c67145-3692-40ae-b8c7-6e94d9ac8587 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:42.989205 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-23c67145-3692-40ae-b8c7-6e94d9ac8587 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:42.989841 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-23c67145-3692-40ae-b8c7-6e94d9ac8587 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:42.990435 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-23c67145-3692-40ae-b8c7-6e94d9ac8587 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:43.074152 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-23c67145-3692-40ae-b8c7-6e94d9ac8587 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8899e278c9453fba0ab05c69b0b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46ac8b84bd649fa88897068dbfa5ce6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:05:43.084613 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-23c67145-3692-40ae-b8c7-6e94d9ac8587 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] 10.222.0.58 "GET /compute/v2.1/servers/662fba38-a52c-464c-8448-bfe0a1d78dab" status: 200 len: 1276 microversion: 2.1 time: 0.125072 Aug 10 23:05:43.085285 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1124/2234] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:05:42 2022] GET /compute/v2.1/servers/662fba38-a52c-464c-8448-bfe0a1d78dab => generated 1276 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:05:43.102138 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-d38d85f2-f74a-4516-86ca-8a203c3d0095 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:05:43.103105 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-d38d85f2-f74a-4516-86ca-8a203c3d0095 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] [instance: b3b3730c-1396-4ca6-9d9e-8a3104950324] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:05:43.113758 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d38d85f2-f74a-4516-86ca-8a203c3d0095 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:43.120958 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d38d85f2-f74a-4516-86ca-8a203c3d0095 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:43.122806 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d38d85f2-f74a-4516-86ca-8a203c3d0095 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:43.123784 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d38d85f2-f74a-4516-86ca-8a203c3d0095 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:43.124586 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d38d85f2-f74a-4516-86ca-8a203c3d0095 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:43.125244 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d38d85f2-f74a-4516-86ca-8a203c3d0095 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:43.408159 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-d38d85f2-f74a-4516-86ca-8a203c3d0095 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de244f1f82143a0b3d3283c31d80bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14c63df2e6c46d2af23b6b8a52690d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:05:43.425517 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-d38d85f2-f74a-4516-86ca-8a203c3d0095 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] 10.222.0.58 "GET /compute/v2.1/servers/b3b3730c-1396-4ca6-9d9e-8a3104950324" status: 200 len: 1477 microversion: 2.1 time: 0.338690 Aug 10 23:05:43.426056 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1125/2235] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:05:43 2022] GET /compute/v2.1/servers/b3b3730c-1396-4ca6-9d9e-8a3104950324 => generated 1477 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:05:43.545265 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-640137d3-0789-494d-a5ea-c943a936a0eb tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '933e6a08c3014b36aee164b213bbfaf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d6f13784504fc7b2fcf0d6957b4920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:05:43.559702 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-640137d3-0789-494d-a5ea-c943a936a0eb tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] 10.222.0.58 "GET /compute/v2.1/servers/33a1bb4c-217e-40f9-b67f-d873bea80284" status: 200 len: 1324 microversion: 2.1 time: 1.245853 Aug 10 23:05:43.560476 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1111/2236] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:05:42 2022] GET /compute/v2.1/servers/33a1bb4c-217e-40f9-b67f-d873bea80284 => generated 1324 bytes in 1248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:05:43.660175 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-88980617-66d8-44d5-b4db-9d5412468ed6 req-66a2d913-f58b-4802-900c-14f8fc2a32c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3b3730c-1396-4ca6-9d9e-8a3104950324", "name": "network-vif-plugged", "status": "completed", "tag": "aee4dd1c-12e7-4581-960e-4729757cc898"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:05:43.677454 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-88980617-66d8-44d5-b4db-9d5412468ed6 req-66a2d913-f58b-4802-900c-14f8fc2a32c3 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:43.677963 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-88980617-66d8-44d5-b4db-9d5412468ed6 req-66a2d913-f58b-4802-900c-14f8fc2a32c3 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:43.678377 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-88980617-66d8-44d5-b4db-9d5412468ed6 req-66a2d913-f58b-4802-900c-14f8fc2a32c3 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:43.704859 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-88980617-66d8-44d5-b4db-9d5412468ed6 req-66a2d913-f58b-4802-900c-14f8fc2a32c3 service nova] Creating event network-vif-plugged:aee4dd1c-12e7-4581-960e-4729757cc898 for instance b3b3730c-1396-4ca6-9d9e-8a3104950324 on n-h1-850468-14 Aug 10 23:05:43.714501 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-88980617-66d8-44d5-b4db-9d5412468ed6 req-66a2d913-f58b-4802-900c-14f8fc2a32c3 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055624 Aug 10 23:05:43.715608 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1126/2237] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:05:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:05:43.969108 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-8327455f-b6d3-4772-8910-71b6a8bfd004 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:05:43.970033 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-8327455f-b6d3-4772-8910-71b6a8bfd004 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] [instance: d65d59de-9c9c-47c6-8066-6c9bb7245bd7] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:05:43.983379 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8327455f-b6d3-4772-8910-71b6a8bfd004 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:43.983875 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8327455f-b6d3-4772-8910-71b6a8bfd004 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:43.984488 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8327455f-b6d3-4772-8910-71b6a8bfd004 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:43.985282 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8327455f-b6d3-4772-8910-71b6a8bfd004 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:43.985671 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8327455f-b6d3-4772-8910-71b6a8bfd004 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:43.986093 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8327455f-b6d3-4772-8910-71b6a8bfd004 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:44.109911 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-001f0880-729a-4edc-86ed-377470f50f4d tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:05:44.110692 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-001f0880-729a-4edc-86ed-377470f50f4d tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] [instance: 662fba38-a52c-464c-8448-bfe0a1d78dab] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:05:44.126241 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-001f0880-729a-4edc-86ed-377470f50f4d tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:44.131133 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-001f0880-729a-4edc-86ed-377470f50f4d tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:44.131722 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-001f0880-729a-4edc-86ed-377470f50f4d tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:44.133004 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-001f0880-729a-4edc-86ed-377470f50f4d tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:44.133473 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-001f0880-729a-4edc-86ed-377470f50f4d tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:44.134131 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-001f0880-729a-4edc-86ed-377470f50f4d tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:44.301568 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-8327455f-b6d3-4772-8910-71b6a8bfd004 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a092c6b8aa444999c32d8be76cabd3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891f4d07d0af47b19c4f43b24ff0b7ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:05:44.314765 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-8327455f-b6d3-4772-8910-71b6a8bfd004 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] 10.222.0.58 "GET /compute/v2.1/servers/d65d59de-9c9c-47c6-8066-6c9bb7245bd7" status: 200 len: 1318 microversion: 2.1 time: 0.348652 Aug 10 23:05:44.315422 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1112/2238] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:05:43 2022] GET /compute/v2.1/servers/d65d59de-9c9c-47c6-8066-6c9bb7245bd7 => generated 1318 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:05:44.451749 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-07fc5446-06e9-43f7-92de-4e71ce9b922a tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:05:44.452629 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-07fc5446-06e9-43f7-92de-4e71ce9b922a tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] [instance: b3b3730c-1396-4ca6-9d9e-8a3104950324] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:05:44.464906 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-07fc5446-06e9-43f7-92de-4e71ce9b922a tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:44.465146 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-07fc5446-06e9-43f7-92de-4e71ce9b922a tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:44.467363 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-07fc5446-06e9-43f7-92de-4e71ce9b922a tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:44.468146 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-07fc5446-06e9-43f7-92de-4e71ce9b922a tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:44.468628 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-07fc5446-06e9-43f7-92de-4e71ce9b922a tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:44.469064 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-07fc5446-06e9-43f7-92de-4e71ce9b922a tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:44.587284 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-001f0880-729a-4edc-86ed-377470f50f4d tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8899e278c9453fba0ab05c69b0b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46ac8b84bd649fa88897068dbfa5ce6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:05:44.595741 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-001f0880-729a-4edc-86ed-377470f50f4d tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] 10.222.0.58 "GET /compute/v2.1/servers/662fba38-a52c-464c-8448-bfe0a1d78dab" status: 200 len: 1318 microversion: 2.1 time: 0.491989 Aug 10 23:05:44.596321 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1127/2239] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:05:44 2022] GET /compute/v2.1/servers/662fba38-a52c-464c-8448-bfe0a1d78dab => generated 1318 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:05:44.622040 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-643f4d77-776a-4052-8339-8ec92125ac5c tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:05:44.622655 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-643f4d77-776a-4052-8339-8ec92125ac5c tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] [instance: 33a1bb4c-217e-40f9-b67f-d873bea80284] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:05:44.641584 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-643f4d77-776a-4052-8339-8ec92125ac5c tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:44.642340 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-643f4d77-776a-4052-8339-8ec92125ac5c tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:44.642921 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-643f4d77-776a-4052-8339-8ec92125ac5c tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:44.643758 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-643f4d77-776a-4052-8339-8ec92125ac5c tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:44.649667 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-643f4d77-776a-4052-8339-8ec92125ac5c tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:44.650192 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-643f4d77-776a-4052-8339-8ec92125ac5c tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:44.809749 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-07fc5446-06e9-43f7-92de-4e71ce9b922a tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de244f1f82143a0b3d3283c31d80bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14c63df2e6c46d2af23b6b8a52690d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:05:44.822152 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-07fc5446-06e9-43f7-92de-4e71ce9b922a tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] 10.222.0.58 "GET /compute/v2.1/servers/b3b3730c-1396-4ca6-9d9e-8a3104950324" status: 200 len: 1477 microversion: 2.1 time: 0.375695 Aug 10 23:05:44.825428 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1113/2240] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:05:44 2022] GET /compute/v2.1/servers/b3b3730c-1396-4ca6-9d9e-8a3104950324 => generated 1477 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:05:44.878755 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-643f4d77-776a-4052-8339-8ec92125ac5c tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '933e6a08c3014b36aee164b213bbfaf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d6f13784504fc7b2fcf0d6957b4920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:05:44.887882 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-643f4d77-776a-4052-8339-8ec92125ac5c tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] 10.222.0.58 "GET /compute/v2.1/servers/33a1bb4c-217e-40f9-b67f-d873bea80284" status: 200 len: 1324 microversion: 2.1 time: 0.273375 Aug 10 23:05:44.888808 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1128/2241] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:05:44 2022] GET /compute/v2.1/servers/33a1bb4c-217e-40f9-b67f-d873bea80284 => generated 1324 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:05:45.080950 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-494b0051-059e-46f7-8b9c-85f272f1288a req-db9bda43-56d2-45d9-97f1-9ffa6fd3eb56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "662fba38-a52c-464c-8448-bfe0a1d78dab", "tag": "9bb54bc7-e909-4194-bf93-007a16b9d1af"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:05:45.093955 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-494b0051-059e-46f7-8b9c-85f272f1288a req-db9bda43-56d2-45d9-97f1-9ffa6fd3eb56 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:45.094613 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-494b0051-059e-46f7-8b9c-85f272f1288a req-db9bda43-56d2-45d9-97f1-9ffa6fd3eb56 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:45.095187 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-494b0051-059e-46f7-8b9c-85f272f1288a req-db9bda43-56d2-45d9-97f1-9ffa6fd3eb56 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:45.110154 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-494b0051-059e-46f7-8b9c-85f272f1288a req-db9bda43-56d2-45d9-97f1-9ffa6fd3eb56 service nova] Creating event network-changed:9bb54bc7-e909-4194-bf93-007a16b9d1af for instance 662fba38-a52c-464c-8448-bfe0a1d78dab on n-h2-850468-14 Aug 10 23:05:45.115197 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-494b0051-059e-46f7-8b9c-85f272f1288a req-db9bda43-56d2-45d9-97f1-9ffa6fd3eb56 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038589 Aug 10 23:05:45.116077 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1114/2242] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:05:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:05:45.343634 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-3be7d4bd-a1dc-46b0-aed6-cd7e7efc12ec tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:05:45.344177 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-5521e6c5-fff3-439a-b73e-dac7dbd292cb tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:05:45.344826 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-5521e6c5-fff3-439a-b73e-dac7dbd292cb tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] [instance: d65d59de-9c9c-47c6-8066-6c9bb7245bd7] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:05:45.345257 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-3be7d4bd-a1dc-46b0-aed6-cd7e7efc12ec tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] [instance: 45beadf1-a6da-49ab-9098-6b681b5184c9] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:05:45.363515 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3be7d4bd-a1dc-46b0-aed6-cd7e7efc12ec tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:45.364680 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3be7d4bd-a1dc-46b0-aed6-cd7e7efc12ec tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:45.365334 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3be7d4bd-a1dc-46b0-aed6-cd7e7efc12ec tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:45.366351 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3be7d4bd-a1dc-46b0-aed6-cd7e7efc12ec tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:45.367045 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3be7d4bd-a1dc-46b0-aed6-cd7e7efc12ec tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:45.367712 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3be7d4bd-a1dc-46b0-aed6-cd7e7efc12ec tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:45.373751 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5521e6c5-fff3-439a-b73e-dac7dbd292cb tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:45.374105 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5521e6c5-fff3-439a-b73e-dac7dbd292cb tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:45.374561 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5521e6c5-fff3-439a-b73e-dac7dbd292cb tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:45.375877 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5521e6c5-fff3-439a-b73e-dac7dbd292cb tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:45.376487 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5521e6c5-fff3-439a-b73e-dac7dbd292cb tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:45.376931 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5521e6c5-fff3-439a-b73e-dac7dbd292cb tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:45.398245 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-3be7d4bd-a1dc-46b0-aed6-cd7e7efc12ec tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] 10.222.0.58 "GET /compute/v2.1/servers/45beadf1-a6da-49ab-9098-6b681b5184c9/ips" status: 200 len: 146 microversion: 2.1 time: 0.059668 Aug 10 23:05:45.399719 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1129/2243] 10.222.0.58 () {58 vars in 1248 bytes} [Wed Aug 10 23:05:45 2022] GET /compute/v2.1/servers/45beadf1-a6da-49ab-9098-6b681b5184c9/ips => generated 146 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:05:45.618541 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-01c07c73-c896-4d11-b4f5-75c58d02a7a8 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:05:45.620329 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-01c07c73-c896-4d11-b4f5-75c58d02a7a8 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] [instance: 662fba38-a52c-464c-8448-bfe0a1d78dab] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:05:45.629971 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-01c07c73-c896-4d11-b4f5-75c58d02a7a8 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:45.630684 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-01c07c73-c896-4d11-b4f5-75c58d02a7a8 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:45.631286 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-01c07c73-c896-4d11-b4f5-75c58d02a7a8 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:45.632146 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-01c07c73-c896-4d11-b4f5-75c58d02a7a8 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:45.632746 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-01c07c73-c896-4d11-b4f5-75c58d02a7a8 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:45.633339 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-01c07c73-c896-4d11-b4f5-75c58d02a7a8 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:45.677266 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-5521e6c5-fff3-439a-b73e-dac7dbd292cb tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a092c6b8aa444999c32d8be76cabd3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891f4d07d0af47b19c4f43b24ff0b7ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:05:45.688847 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-5521e6c5-fff3-439a-b73e-dac7dbd292cb tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] 10.222.0.58 "GET /compute/v2.1/servers/d65d59de-9c9c-47c6-8066-6c9bb7245bd7" status: 200 len: 1318 microversion: 2.1 time: 0.349654 Aug 10 23:05:45.689858 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1115/2244] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:05:45 2022] GET /compute/v2.1/servers/d65d59de-9c9c-47c6-8066-6c9bb7245bd7 => generated 1318 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:05:45.751954 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-2838716f-d53d-4ea2-b36f-8297126968ac req-7f6569a1-e849-46e0-a27a-932c146dc762 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33a1bb4c-217e-40f9-b67f-d873bea80284", "name": "network-vif-plugged", "status": "completed", "tag": "53ba640c-dbc3-45eb-93db-346c26b4a371"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:05:45.781427 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-2838716f-d53d-4ea2-b36f-8297126968ac req-7f6569a1-e849-46e0-a27a-932c146dc762 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:45.788234 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-2838716f-d53d-4ea2-b36f-8297126968ac req-7f6569a1-e849-46e0-a27a-932c146dc762 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:45.793598 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-2838716f-d53d-4ea2-b36f-8297126968ac req-7f6569a1-e849-46e0-a27a-932c146dc762 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:45.814366 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-2838716f-d53d-4ea2-b36f-8297126968ac req-7f6569a1-e849-46e0-a27a-932c146dc762 service nova] Creating event network-vif-plugged:53ba640c-dbc3-45eb-93db-346c26b4a371 for instance 33a1bb4c-217e-40f9-b67f-d873bea80284 on n-h1-850468-14 Aug 10 23:05:45.824771 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-2838716f-d53d-4ea2-b36f-8297126968ac req-7f6569a1-e849-46e0-a27a-932c146dc762 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078126 Aug 10 23:05:45.826159 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1116/2245] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:05:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 23:05:45.848240 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-6c5e759b-ed24-48b6-9e63-a1a439c5b4b4 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:05:45.849743 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-6c5e759b-ed24-48b6-9e63-a1a439c5b4b4 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] [instance: b3b3730c-1396-4ca6-9d9e-8a3104950324] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:05:45.857976 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6c5e759b-ed24-48b6-9e63-a1a439c5b4b4 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:45.860423 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6c5e759b-ed24-48b6-9e63-a1a439c5b4b4 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:45.861177 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6c5e759b-ed24-48b6-9e63-a1a439c5b4b4 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:45.862171 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6c5e759b-ed24-48b6-9e63-a1a439c5b4b4 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:45.862889 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6c5e759b-ed24-48b6-9e63-a1a439c5b4b4 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:45.863540 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6c5e759b-ed24-48b6-9e63-a1a439c5b4b4 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:45.893615 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-01c07c73-c896-4d11-b4f5-75c58d02a7a8 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8899e278c9453fba0ab05c69b0b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46ac8b84bd649fa88897068dbfa5ce6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:05:45.910349 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-01c07c73-c896-4d11-b4f5-75c58d02a7a8 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] 10.222.0.58 "GET /compute/v2.1/servers/662fba38-a52c-464c-8448-bfe0a1d78dab" status: 200 len: 1318 microversion: 2.1 time: 0.296361 Aug 10 23:05:45.911783 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1130/2246] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:05:45 2022] GET /compute/v2.1/servers/662fba38-a52c-464c-8448-bfe0a1d78dab => generated 1318 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:05:45.947703 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-7acfcc0a-4955-4dc0-99af-d8a8af8050eb tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:05:45.950269 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-7acfcc0a-4955-4dc0-99af-d8a8af8050eb tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] [instance: 33a1bb4c-217e-40f9-b67f-d873bea80284] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:05:45.965691 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7acfcc0a-4955-4dc0-99af-d8a8af8050eb tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:45.966166 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7acfcc0a-4955-4dc0-99af-d8a8af8050eb tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:45.966606 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7acfcc0a-4955-4dc0-99af-d8a8af8050eb tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:45.967882 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7acfcc0a-4955-4dc0-99af-d8a8af8050eb tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:45.968556 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7acfcc0a-4955-4dc0-99af-d8a8af8050eb tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:45.969385 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7acfcc0a-4955-4dc0-99af-d8a8af8050eb tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:46.101780 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-6c5e759b-ed24-48b6-9e63-a1a439c5b4b4 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de244f1f82143a0b3d3283c31d80bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14c63df2e6c46d2af23b6b8a52690d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:05:46.111504 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-6c5e759b-ed24-48b6-9e63-a1a439c5b4b4 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] 10.222.0.58 "GET /compute/v2.1/servers/b3b3730c-1396-4ca6-9d9e-8a3104950324" status: 200 len: 1477 microversion: 2.1 time: 0.267306 Aug 10 23:05:46.112566 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1117/2247] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:05:45 2022] GET /compute/v2.1/servers/b3b3730c-1396-4ca6-9d9e-8a3104950324 => generated 1477 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:05:46.214548 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-7acfcc0a-4955-4dc0-99af-d8a8af8050eb tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '933e6a08c3014b36aee164b213bbfaf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d6f13784504fc7b2fcf0d6957b4920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:05:46.223073 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-7acfcc0a-4955-4dc0-99af-d8a8af8050eb tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] 10.222.0.58 "GET /compute/v2.1/servers/33a1bb4c-217e-40f9-b67f-d873bea80284" status: 200 len: 1324 microversion: 2.1 time: 0.310003 Aug 10 23:05:46.223809 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1131/2248] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:05:45 2022] GET /compute/v2.1/servers/33a1bb4c-217e-40f9-b67f-d873bea80284 => generated 1324 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:05:46.710430 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-4e46b684-612f-4ffa-aa69-ceb42510333f tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:05:46.711320 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-4e46b684-612f-4ffa-aa69-ceb42510333f tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] [instance: d65d59de-9c9c-47c6-8066-6c9bb7245bd7] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:05:46.720123 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4e46b684-612f-4ffa-aa69-ceb42510333f tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:46.720616 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4e46b684-612f-4ffa-aa69-ceb42510333f tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:46.721197 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4e46b684-612f-4ffa-aa69-ceb42510333f tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:46.721923 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4e46b684-612f-4ffa-aa69-ceb42510333f tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:46.722374 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4e46b684-612f-4ffa-aa69-ceb42510333f tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:46.722809 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4e46b684-612f-4ffa-aa69-ceb42510333f tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:46.932892 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-be8db7fa-b67e-4d0a-8058-5b7480449559 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:05:46.933687 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-be8db7fa-b67e-4d0a-8058-5b7480449559 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] [instance: 662fba38-a52c-464c-8448-bfe0a1d78dab] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:05:46.942687 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-be8db7fa-b67e-4d0a-8058-5b7480449559 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:46.947268 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-4e46b684-612f-4ffa-aa69-ceb42510333f tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a092c6b8aa444999c32d8be76cabd3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891f4d07d0af47b19c4f43b24ff0b7ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:05:46.949428 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-be8db7fa-b67e-4d0a-8058-5b7480449559 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:46.952521 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-be8db7fa-b67e-4d0a-8058-5b7480449559 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:46.953292 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-be8db7fa-b67e-4d0a-8058-5b7480449559 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:46.953769 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-be8db7fa-b67e-4d0a-8058-5b7480449559 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:46.954203 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-be8db7fa-b67e-4d0a-8058-5b7480449559 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:46.969842 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-4e46b684-612f-4ffa-aa69-ceb42510333f tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] 10.222.0.58 "GET /compute/v2.1/servers/d65d59de-9c9c-47c6-8066-6c9bb7245bd7" status: 200 len: 1318 microversion: 2.1 time: 0.263774 Aug 10 23:05:46.983634 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1118/2249] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:05:46 2022] GET /compute/v2.1/servers/d65d59de-9c9c-47c6-8066-6c9bb7245bd7 => generated 1318 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:05:47.138070 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-be8db7fa-b67e-4d0a-8058-5b7480449559 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8899e278c9453fba0ab05c69b0b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46ac8b84bd649fa88897068dbfa5ce6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:05:47.138688 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-0a8c20cf-c1e8-4eda-a4fe-bca5a9433294 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:05:47.139424 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-0a8c20cf-c1e8-4eda-a4fe-bca5a9433294 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] [instance: b3b3730c-1396-4ca6-9d9e-8a3104950324] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:05:47.145818 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0a8c20cf-c1e8-4eda-a4fe-bca5a9433294 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:47.146427 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0a8c20cf-c1e8-4eda-a4fe-bca5a9433294 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:47.147013 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0a8c20cf-c1e8-4eda-a4fe-bca5a9433294 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:47.148017 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0a8c20cf-c1e8-4eda-a4fe-bca5a9433294 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:47.148553 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0a8c20cf-c1e8-4eda-a4fe-bca5a9433294 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:47.149057 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0a8c20cf-c1e8-4eda-a4fe-bca5a9433294 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:47.153453 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-be8db7fa-b67e-4d0a-8058-5b7480449559 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] 10.222.0.58 "GET /compute/v2.1/servers/662fba38-a52c-464c-8448-bfe0a1d78dab" status: 200 len: 1318 microversion: 2.1 time: 0.224798 Aug 10 23:05:47.165112 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1132/2250] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:05:46 2022] GET /compute/v2.1/servers/662fba38-a52c-464c-8448-bfe0a1d78dab => generated 1318 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:05:47.165112 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-5306b646-948f-4496-8676-fba83a0f9318 tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:05:47.165710 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-5306b646-948f-4496-8676-fba83a0f9318 tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1cf1bcb51dec4134ac27ea7964684c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27408df8ea9f4d848b15b0bbba451a21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:05:47.179871 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-5306b646-948f-4496-8676-fba83a0f9318 tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Searching by: {'deleted': False, 'project_id': '27408df8ea9f4d848b15b0bbba451a21'} {{(pid=122632) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 10 23:05:47.189994 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5306b646-948f-4496-8676-fba83a0f9318 tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:47.190482 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5306b646-948f-4496-8676-fba83a0f9318 tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:47.191056 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5306b646-948f-4496-8676-fba83a0f9318 tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:47.191652 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5306b646-948f-4496-8676-fba83a0f9318 tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:47.192105 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5306b646-948f-4496-8676-fba83a0f9318 tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:47.192560 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5306b646-948f-4496-8676-fba83a0f9318 tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:47.208294 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=100 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:05:47.235400 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.multi_cell_list [None req-5306b646-948f-4496-8676-fba83a0f9318 tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122632) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 10 23:05:47.268223 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-5306b646-948f-4496-8676-fba83a0f9318 tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] 10.222.0.58 "GET /compute/v2.1/servers" status: 200 len: 333 microversion: 2.1 time: 0.112364 Aug 10 23:05:47.269146 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1133/2251] 10.222.0.58 () {58 vars in 1125 bytes} [Wed Aug 10 23:05:47 2022] GET /compute/v2.1/servers => generated 333 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:05:47.273897 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-7b747cc4-fc58-4e4f-b40c-d59caf26bc70 tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:05:47.276324 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-7b747cc4-fc58-4e4f-b40c-d59caf26bc70 tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] [instance: 33a1bb4c-217e-40f9-b67f-d873bea80284] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:05:47.284282 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7b747cc4-fc58-4e4f-b40c-d59caf26bc70 tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:47.285602 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7b747cc4-fc58-4e4f-b40c-d59caf26bc70 tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:47.286203 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7b747cc4-fc58-4e4f-b40c-d59caf26bc70 tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:47.287158 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7b747cc4-fc58-4e4f-b40c-d59caf26bc70 tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:47.287764 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7b747cc4-fc58-4e4f-b40c-d59caf26bc70 tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:47.288372 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7b747cc4-fc58-4e4f-b40c-d59caf26bc70 tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:47.486331 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-7b747cc4-fc58-4e4f-b40c-d59caf26bc70 tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '933e6a08c3014b36aee164b213bbfaf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d6f13784504fc7b2fcf0d6957b4920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:05:47.488686 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-0a8c20cf-c1e8-4eda-a4fe-bca5a9433294 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de244f1f82143a0b3d3283c31d80bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14c63df2e6c46d2af23b6b8a52690d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:05:47.496675 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-7b747cc4-fc58-4e4f-b40c-d59caf26bc70 tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] 10.222.0.58 "GET /compute/v2.1/servers/33a1bb4c-217e-40f9-b67f-d873bea80284" status: 200 len: 1324 microversion: 2.1 time: 0.226464 Aug 10 23:05:47.497969 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1134/2252] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:05:47 2022] GET /compute/v2.1/servers/33a1bb4c-217e-40f9-b67f-d873bea80284 => generated 1324 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:05:47.499331 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-0a8c20cf-c1e8-4eda-a4fe-bca5a9433294 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] 10.222.0.58 "GET /compute/v2.1/servers/b3b3730c-1396-4ca6-9d9e-8a3104950324" status: 200 len: 1463 microversion: 2.1 time: 0.366710 Aug 10 23:05:47.501459 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1119/2253] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:05:47 2022] GET /compute/v2.1/servers/b3b3730c-1396-4ca6-9d9e-8a3104950324 => generated 1463 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:05:47.505434 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-5b266ba0-5bc7-41f2-b061-786e99e386d9 tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:05:47.513402 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-5b266ba0-5bc7-41f2-b061-786e99e386d9 tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1cf1bcb51dec4134ac27ea7964684c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27408df8ea9f4d848b15b0bbba451a21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:05:47.514559 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-5b266ba0-5bc7-41f2-b061-786e99e386d9 tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Searching by: {'deleted': False, 'project_id': '27408df8ea9f4d848b15b0bbba451a21'} {{(pid=122632) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 10 23:05:47.525156 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5b266ba0-5bc7-41f2-b061-786e99e386d9 tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:47.526516 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5b266ba0-5bc7-41f2-b061-786e99e386d9 tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:47.528204 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5b266ba0-5bc7-41f2-b061-786e99e386d9 tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:47.529410 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5b266ba0-5bc7-41f2-b061-786e99e386d9 tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:47.530669 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5b266ba0-5bc7-41f2-b061-786e99e386d9 tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:47.531378 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5b266ba0-5bc7-41f2-b061-786e99e386d9 tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:47.538273 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-2cbf33d3-bf46-462e-ba47-de3e797bcccd tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:05:47.538273 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-2cbf33d3-bf46-462e-ba47-de3e797bcccd tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] [instance: b3b3730c-1396-4ca6-9d9e-8a3104950324] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:05:47.558000 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2cbf33d3-bf46-462e-ba47-de3e797bcccd tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:47.558507 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2cbf33d3-bf46-462e-ba47-de3e797bcccd tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:47.559156 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2cbf33d3-bf46-462e-ba47-de3e797bcccd tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:47.559907 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2cbf33d3-bf46-462e-ba47-de3e797bcccd tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:47.560363 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2cbf33d3-bf46-462e-ba47-de3e797bcccd tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:47.561102 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2cbf33d3-bf46-462e-ba47-de3e797bcccd tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:47.573902 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.multi_cell_list [None req-5b266ba0-5bc7-41f2-b061-786e99e386d9 tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122632) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 10 23:05:47.615917 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=100 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:05:47.639688 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-5b266ba0-5bc7-41f2-b061-786e99e386d9 tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf1bcb51dec4134ac27ea7964684c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27408df8ea9f4d848b15b0bbba451a21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:05:47.654393 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5b266ba0-5bc7-41f2-b061-786e99e386d9 tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:47.655239 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5b266ba0-5bc7-41f2-b061-786e99e386d9 tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:47.655821 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5b266ba0-5bc7-41f2-b061-786e99e386d9 tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:47.774308 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-2cbf33d3-bf46-462e-ba47-de3e797bcccd tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de244f1f82143a0b3d3283c31d80bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14c63df2e6c46d2af23b6b8a52690d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:05:47.786113 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-2cbf33d3-bf46-462e-ba47-de3e797bcccd tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] 10.222.0.58 "GET /compute/v2.1/servers/b3b3730c-1396-4ca6-9d9e-8a3104950324" status: 200 len: 1463 microversion: 2.1 time: 0.254150 Aug 10 23:05:47.787428 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1120/2254] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:05:47 2022] GET /compute/v2.1/servers/b3b3730c-1396-4ca6-9d9e-8a3104950324 => generated 1463 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:05:47.809891 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-2a72935c-5e02-478e-ac73-7fc139fe2241 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed"}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:05:47.813103 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-2a72935c-5e02-478e-ac73-7fc139fe2241 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] [instance: b3b3730c-1396-4ca6-9d9e-8a3104950324] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:05:47.818921 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-5b266ba0-5bc7-41f2-b061-786e99e386d9 tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] 10.222.0.58 "GET /compute/v2.1/servers/detail" status: 200 len: 1695 microversion: 2.1 time: 0.319439 Aug 10 23:05:47.822857 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1135/2255] 10.222.0.58 () {58 vars in 1146 bytes} [Wed Aug 10 23:05:47 2022] GET /compute/v2.1/servers/detail => generated 1695 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:05:47.828401 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2a72935c-5e02-478e-ac73-7fc139fe2241 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:47.828986 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2a72935c-5e02-478e-ac73-7fc139fe2241 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:47.829715 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2a72935c-5e02-478e-ac73-7fc139fe2241 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:47.831020 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2a72935c-5e02-478e-ac73-7fc139fe2241 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:47.831626 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2a72935c-5e02-478e-ac73-7fc139fe2241 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:47.835084 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2a72935c-5e02-478e-ac73-7fc139fe2241 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:47.849663 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-136de7f9-28f7-4a69-b6c9-ee2683d63d91 tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:05:47.860087 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-136de7f9-28f7-4a69-b6c9-ee2683d63d91 tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] 10.222.0.58 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.020987 Aug 10 23:05:47.860804 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1136/2256] 10.222.0.58 () {58 vars in 1137 bytes} [Wed Aug 10 23:05:47 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 23:05:47.885023 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-ba2dc11f-dd11-4b98-ba86-5fce58d3e3e4 req-c665db1e-2f64-4422-9495-7978e938e8aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d65d59de-9c9c-47c6-8066-6c9bb7245bd7", "name": "network-vif-plugged", "status": "completed", "tag": "3fd6cc75-f4e4-45be-83fa-b2b3034b0353"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:05:47.897167 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-ba2dc11f-dd11-4b98-ba86-5fce58d3e3e4 req-c665db1e-2f64-4422-9495-7978e938e8aa service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:47.897973 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-ba2dc11f-dd11-4b98-ba86-5fce58d3e3e4 req-c665db1e-2f64-4422-9495-7978e938e8aa service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:47.898490 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-ba2dc11f-dd11-4b98-ba86-5fce58d3e3e4 req-c665db1e-2f64-4422-9495-7978e938e8aa service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:47.913941 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-ba2dc11f-dd11-4b98-ba86-5fce58d3e3e4 req-c665db1e-2f64-4422-9495-7978e938e8aa service nova] Creating event network-vif-plugged:3fd6cc75-f4e4-45be-83fa-b2b3034b0353 for instance d65d59de-9c9c-47c6-8066-6c9bb7245bd7 on n-h1-850468-14 Aug 10 23:05:47.920547 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-ba2dc11f-dd11-4b98-ba86-5fce58d3e3e4 req-c665db1e-2f64-4422-9495-7978e938e8aa service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039640 Aug 10 23:05:47.921627 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1137/2257] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:05:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 23:05:47.957459 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-2a72935c-5e02-478e-ac73-7fc139fe2241 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Flavor limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:05:47.958103 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-2a72935c-5e02-478e-ac73-7fc139fe2241 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Image limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:05:47.958501 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-2a72935c-5e02-478e-ac73-7fc139fe2241 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Flavor pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:05:47.959145 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-2a72935c-5e02-478e-ac73-7fc139fe2241 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Image pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:05:47.959784 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-2a72935c-5e02-478e-ac73-7fc139fe2241 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:05:47.997698 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-1e5632bb-d591-49c7-aa8b-ada86e209247 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:05:47.998587 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-1e5632bb-d591-49c7-aa8b-ada86e209247 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] [instance: d65d59de-9c9c-47c6-8066-6c9bb7245bd7] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:05:48.019663 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1e5632bb-d591-49c7-aa8b-ada86e209247 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:48.023407 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1e5632bb-d591-49c7-aa8b-ada86e209247 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:48.024213 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1e5632bb-d591-49c7-aa8b-ada86e209247 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:48.030929 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1e5632bb-d591-49c7-aa8b-ada86e209247 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:48.032016 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1e5632bb-d591-49c7-aa8b-ada86e209247 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:48.032689 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1e5632bb-d591-49c7-aa8b-ada86e209247 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:48.099299 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-2a72935c-5e02-478e-ac73-7fc139fe2241 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] [instance: b3b3730c-1396-4ca6-9d9e-8a3104950324] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:05:48.130115 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2a72935c-5e02-478e-ac73-7fc139fe2241 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:48.131092 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2a72935c-5e02-478e-ac73-7fc139fe2241 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:48.134339 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2a72935c-5e02-478e-ac73-7fc139fe2241 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:48.136158 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2a72935c-5e02-478e-ac73-7fc139fe2241 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:48.137320 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2a72935c-5e02-478e-ac73-7fc139fe2241 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:48.138093 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2a72935c-5e02-478e-ac73-7fc139fe2241 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:48.194409 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-2a72935c-5e02-478e-ac73-7fc139fe2241 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] 10.222.0.58 "POST /compute/v2.1/servers/b3b3730c-1396-4ca6-9d9e-8a3104950324/action" status: 202 len: 1067 microversion: 2.1 time: 0.389001 Aug 10 23:05:48.202194 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1121/2258] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:05:47 2022] POST /compute/v2.1/servers/b3b3730c-1396-4ca6-9d9e-8a3104950324/action => generated 1067 bytes in 396 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Aug 10 23:05:48.208468 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-710b8a3c-4dfe-459a-8780-7f30e728b876 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:05:48.209104 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-710b8a3c-4dfe-459a-8780-7f30e728b876 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] [instance: 662fba38-a52c-464c-8448-bfe0a1d78dab] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:05:48.217193 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-710b8a3c-4dfe-459a-8780-7f30e728b876 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:48.217695 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-710b8a3c-4dfe-459a-8780-7f30e728b876 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:48.218140 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-710b8a3c-4dfe-459a-8780-7f30e728b876 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:48.218891 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-710b8a3c-4dfe-459a-8780-7f30e728b876 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:48.219353 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-710b8a3c-4dfe-459a-8780-7f30e728b876 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:48.219779 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-710b8a3c-4dfe-459a-8780-7f30e728b876 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:48.335081 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-1e5632bb-d591-49c7-aa8b-ada86e209247 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a092c6b8aa444999c32d8be76cabd3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891f4d07d0af47b19c4f43b24ff0b7ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:05:48.346430 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-1e5632bb-d591-49c7-aa8b-ada86e209247 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] 10.222.0.58 "GET /compute/v2.1/servers/d65d59de-9c9c-47c6-8066-6c9bb7245bd7" status: 200 len: 1318 microversion: 2.1 time: 0.357292 Aug 10 23:05:48.351073 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1138/2259] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:05:47 2022] GET /compute/v2.1/servers/d65d59de-9c9c-47c6-8066-6c9bb7245bd7 => generated 1318 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:05:48.352743 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-d0c8f85d-3865-420e-955d-84d27fd7eaba tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:05:48.353496 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-d0c8f85d-3865-420e-955d-84d27fd7eaba tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] [instance: b3b3730c-1396-4ca6-9d9e-8a3104950324] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:05:48.363120 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d0c8f85d-3865-420e-955d-84d27fd7eaba tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:48.363658 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d0c8f85d-3865-420e-955d-84d27fd7eaba tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:48.364221 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d0c8f85d-3865-420e-955d-84d27fd7eaba tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:48.365304 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d0c8f85d-3865-420e-955d-84d27fd7eaba tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:48.365881 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d0c8f85d-3865-420e-955d-84d27fd7eaba tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:48.366421 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d0c8f85d-3865-420e-955d-84d27fd7eaba tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:48.420323 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-710b8a3c-4dfe-459a-8780-7f30e728b876 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8899e278c9453fba0ab05c69b0b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46ac8b84bd649fa88897068dbfa5ce6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:05:48.430974 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-710b8a3c-4dfe-459a-8780-7f30e728b876 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] 10.222.0.58 "GET /compute/v2.1/servers/662fba38-a52c-464c-8448-bfe0a1d78dab" status: 200 len: 1318 microversion: 2.1 time: 0.225993 Aug 10 23:05:48.443845 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1122/2260] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:05:48 2022] GET /compute/v2.1/servers/662fba38-a52c-464c-8448-bfe0a1d78dab => generated 1318 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:05:48.542030 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-323b413e-1771-4875-a38e-8b60b189860f tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:05:48.543059 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-323b413e-1771-4875-a38e-8b60b189860f tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] [instance: 33a1bb4c-217e-40f9-b67f-d873bea80284] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:05:48.554249 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-323b413e-1771-4875-a38e-8b60b189860f tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:48.556136 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-323b413e-1771-4875-a38e-8b60b189860f tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:48.556921 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-323b413e-1771-4875-a38e-8b60b189860f tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:48.558454 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-323b413e-1771-4875-a38e-8b60b189860f tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:48.558971 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-323b413e-1771-4875-a38e-8b60b189860f tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:48.559813 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-323b413e-1771-4875-a38e-8b60b189860f tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:48.626983 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-d0c8f85d-3865-420e-955d-84d27fd7eaba tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de244f1f82143a0b3d3283c31d80bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14c63df2e6c46d2af23b6b8a52690d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:05:48.634687 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-d0c8f85d-3865-420e-955d-84d27fd7eaba tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] 10.222.0.58 "GET /compute/v2.1/servers/b3b3730c-1396-4ca6-9d9e-8a3104950324" status: 200 len: 1472 microversion: 2.1 time: 0.286111 Aug 10 23:05:48.635823 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1139/2261] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:05:48 2022] GET /compute/v2.1/servers/b3b3730c-1396-4ca6-9d9e-8a3104950324 => generated 1472 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:05:48.660568 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-9bc6b832-466d-430e-b246-1f98c3305cf5 tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:05:48.661079 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-9bc6b832-466d-430e-b246-1f98c3305cf5 tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] [instance: e822b468-16f3-4a20-94d9-7a2517802a92] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:05:48.668321 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9bc6b832-466d-430e-b246-1f98c3305cf5 tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:48.668822 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9bc6b832-466d-430e-b246-1f98c3305cf5 tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:48.669263 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9bc6b832-466d-430e-b246-1f98c3305cf5 tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:48.670341 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9bc6b832-466d-430e-b246-1f98c3305cf5 tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:48.670873 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9bc6b832-466d-430e-b246-1f98c3305cf5 tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:48.671264 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9bc6b832-466d-430e-b246-1f98c3305cf5 tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:48.726151 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-9bc6b832-466d-430e-b246-1f98c3305cf5 tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] [instance: e822b468-16f3-4a20-94d9-7a2517802a92] Going to try to terminate instance {{(pid=122632) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:05:48.850215 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-323b413e-1771-4875-a38e-8b60b189860f tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '933e6a08c3014b36aee164b213bbfaf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d6f13784504fc7b2fcf0d6957b4920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:05:48.861470 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-9bc6b832-466d-430e-b246-1f98c3305cf5 tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] 10.222.0.58 "DELETE /compute/v2.1/servers/e822b468-16f3-4a20-94d9-7a2517802a92" status: 204 len: 0 microversion: 2.1 time: 0.205119 Aug 10 23:05:48.862337 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1140/2262] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:05:48 2022] DELETE /compute/v2.1/servers/e822b468-16f3-4a20-94d9-7a2517802a92 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:05:48.874201 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-323b413e-1771-4875-a38e-8b60b189860f tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] 10.222.0.58 "GET /compute/v2.1/servers/33a1bb4c-217e-40f9-b67f-d873bea80284" status: 200 len: 1520 microversion: 2.1 time: 0.343960 Aug 10 23:05:48.875601 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1123/2263] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:05:48 2022] GET /compute/v2.1/servers/33a1bb4c-217e-40f9-b67f-d873bea80284 => generated 1520 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:05:48.893077 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-1f254525-9dda-4c50-bf8e-36ae61a78855 tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:05:48.894621 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-1f254525-9dda-4c50-bf8e-36ae61a78855 tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] [instance: e822b468-16f3-4a20-94d9-7a2517802a92] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:05:48.901957 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-49fc7cf5-4840-4904-94c0-31090f50c59e tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Action: 'action', calling method: .version_select at 0x7f847ff7b670>, body: {"addFloatingIp": {"address": "172.25.2.179"}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:05:48.905290 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1f254525-9dda-4c50-bf8e-36ae61a78855 tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:48.906091 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1f254525-9dda-4c50-bf8e-36ae61a78855 tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:48.906342 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-49fc7cf5-4840-4904-94c0-31090f50c59e tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] [instance: 717a8812-6a48-49ad-baa8-0cf0fb41671d] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:05:48.906992 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1f254525-9dda-4c50-bf8e-36ae61a78855 tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:48.907935 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1f254525-9dda-4c50-bf8e-36ae61a78855 tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:48.911242 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1f254525-9dda-4c50-bf8e-36ae61a78855 tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:48.911781 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1f254525-9dda-4c50-bf8e-36ae61a78855 tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:48.927025 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-49fc7cf5-4840-4904-94c0-31090f50c59e tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:48.928640 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-49fc7cf5-4840-4904-94c0-31090f50c59e tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:48.929726 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-49fc7cf5-4840-4904-94c0-31090f50c59e tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:48.933043 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-49fc7cf5-4840-4904-94c0-31090f50c59e tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:48.934015 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-49fc7cf5-4840-4904-94c0-31090f50c59e tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:48.934662 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-49fc7cf5-4840-4904-94c0-31090f50c59e tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:49.018890 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-49fc7cf5-4840-4904-94c0-31090f50c59e tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Acquiring lock "refresh_cache-717a8812-6a48-49ad-baa8-0cf0fb41671d" {{(pid=122633) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 10 23:05:49.019513 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-49fc7cf5-4840-4904-94c0-31090f50c59e tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Acquired lock "refresh_cache-717a8812-6a48-49ad-baa8-0cf0fb41671d" {{(pid=122633) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 10 23:05:49.110948 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-1f254525-9dda-4c50-bf8e-36ae61a78855 tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf1bcb51dec4134ac27ea7964684c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27408df8ea9f4d848b15b0bbba451a21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:05:49.127739 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-1f254525-9dda-4c50-bf8e-36ae61a78855 tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] 10.222.0.58 "GET /compute/v2.1/servers/e822b468-16f3-4a20-94d9-7a2517802a92" status: 200 len: 1698 microversion: 2.1 time: 0.261010 Aug 10 23:05:49.130425 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1141/2264] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:05:48 2022] GET /compute/v2.1/servers/e822b468-16f3-4a20-94d9-7a2517802a92 => generated 1698 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:05:49.368216 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-703760d7-59eb-4948-8f95-abdd766ea60c tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:05:49.368856 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-703760d7-59eb-4948-8f95-abdd766ea60c tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] [instance: d65d59de-9c9c-47c6-8066-6c9bb7245bd7] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:05:49.386633 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-703760d7-59eb-4948-8f95-abdd766ea60c tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:49.387727 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-703760d7-59eb-4948-8f95-abdd766ea60c tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:49.388336 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-703760d7-59eb-4948-8f95-abdd766ea60c tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:49.389470 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-703760d7-59eb-4948-8f95-abdd766ea60c tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:49.390074 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-703760d7-59eb-4948-8f95-abdd766ea60c tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:49.390902 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-703760d7-59eb-4948-8f95-abdd766ea60c tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:49.578517 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-703760d7-59eb-4948-8f95-abdd766ea60c tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a092c6b8aa444999c32d8be76cabd3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891f4d07d0af47b19c4f43b24ff0b7ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:05:49.591847 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-703760d7-59eb-4948-8f95-abdd766ea60c tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] 10.222.0.58 "GET /compute/v2.1/servers/d65d59de-9c9c-47c6-8066-6c9bb7245bd7" status: 200 len: 1318 microversion: 2.1 time: 0.226860 Aug 10 23:05:49.592671 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1142/2265] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:05:49 2022] GET /compute/v2.1/servers/d65d59de-9c9c-47c6-8066-6c9bb7245bd7 => generated 1318 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:05:49.606960 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-156f3945-0215-4d98-a65b-28b40b36cc0c tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:05:49.606960 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-156f3945-0215-4d98-a65b-28b40b36cc0c tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] [instance: 662fba38-a52c-464c-8448-bfe0a1d78dab] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:05:49.622827 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-156f3945-0215-4d98-a65b-28b40b36cc0c tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:49.625579 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-156f3945-0215-4d98-a65b-28b40b36cc0c tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:49.626135 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-156f3945-0215-4d98-a65b-28b40b36cc0c tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:49.627013 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-156f3945-0215-4d98-a65b-28b40b36cc0c tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:49.628497 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-156f3945-0215-4d98-a65b-28b40b36cc0c tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:49.630338 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-156f3945-0215-4d98-a65b-28b40b36cc0c tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:49.783680 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-156f3945-0215-4d98-a65b-28b40b36cc0c tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8899e278c9453fba0ab05c69b0b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46ac8b84bd649fa88897068dbfa5ce6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:05:49.794168 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-156f3945-0215-4d98-a65b-28b40b36cc0c tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] 10.222.0.58 "GET /compute/v2.1/servers/662fba38-a52c-464c-8448-bfe0a1d78dab" status: 200 len: 1318 microversion: 2.1 time: 0.198903 Aug 10 23:05:49.794748 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1143/2266] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:05:49 2022] GET /compute/v2.1/servers/662fba38-a52c-464c-8448-bfe0a1d78dab => generated 1318 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:05:49.813011 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-844eb22b-5eb9-4f29-9c98-8350e9f5adca tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:05:49.814207 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-844eb22b-5eb9-4f29-9c98-8350e9f5adca tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] [instance: b3b3730c-1396-4ca6-9d9e-8a3104950324] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:05:49.824392 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-844eb22b-5eb9-4f29-9c98-8350e9f5adca tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:49.824881 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-844eb22b-5eb9-4f29-9c98-8350e9f5adca tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:49.825398 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-844eb22b-5eb9-4f29-9c98-8350e9f5adca tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:49.826437 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-844eb22b-5eb9-4f29-9c98-8350e9f5adca tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:49.826564 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-844eb22b-5eb9-4f29-9c98-8350e9f5adca tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:49.827058 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-844eb22b-5eb9-4f29-9c98-8350e9f5adca tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:50.102897 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-844eb22b-5eb9-4f29-9c98-8350e9f5adca tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de244f1f82143a0b3d3283c31d80bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14c63df2e6c46d2af23b6b8a52690d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:05:50.113637 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-844eb22b-5eb9-4f29-9c98-8350e9f5adca tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] 10.222.0.58 "GET /compute/v2.1/servers/b3b3730c-1396-4ca6-9d9e-8a3104950324" status: 200 len: 1472 microversion: 2.1 time: 0.317636 Aug 10 23:05:50.116595 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1144/2267] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:05:49 2022] GET /compute/v2.1/servers/b3b3730c-1396-4ca6-9d9e-8a3104950324 => generated 1472 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:05:50.122311 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-75f64fdd-2c92-4499-bfe8-d28629bdd83d req-c898b676-8817-4089-a687-64b9de6114e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "662fba38-a52c-464c-8448-bfe0a1d78dab", "name": "network-vif-plugged", "status": "completed", "tag": "9bb54bc7-e909-4194-bf93-007a16b9d1af"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:05:50.132157 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-75f64fdd-2c92-4499-bfe8-d28629bdd83d req-c898b676-8817-4089-a687-64b9de6114e1 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:50.132953 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-75f64fdd-2c92-4499-bfe8-d28629bdd83d req-c898b676-8817-4089-a687-64b9de6114e1 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:50.133590 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-75f64fdd-2c92-4499-bfe8-d28629bdd83d req-c898b676-8817-4089-a687-64b9de6114e1 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:50.150289 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-75f64fdd-2c92-4499-bfe8-d28629bdd83d req-c898b676-8817-4089-a687-64b9de6114e1 service nova] Creating event network-vif-plugged:9bb54bc7-e909-4194-bf93-007a16b9d1af for instance 662fba38-a52c-464c-8448-bfe0a1d78dab on n-h2-850468-14 Aug 10 23:05:50.156428 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-75f64fdd-2c92-4499-bfe8-d28629bdd83d req-c898b676-8817-4089-a687-64b9de6114e1 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038444 Aug 10 23:05:50.157367 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1145/2268] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:05:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:05:50.162668 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-e89580e1-fe1b-4710-b3e5-2228c764fe2d tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:05:50.163557 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-e89580e1-fe1b-4710-b3e5-2228c764fe2d tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] [instance: e822b468-16f3-4a20-94d9-7a2517802a92] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:05:50.170069 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e89580e1-fe1b-4710-b3e5-2228c764fe2d tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:50.170555 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e89580e1-fe1b-4710-b3e5-2228c764fe2d tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:50.171017 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e89580e1-fe1b-4710-b3e5-2228c764fe2d tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:50.171698 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e89580e1-fe1b-4710-b3e5-2228c764fe2d tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:50.172301 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e89580e1-fe1b-4710-b3e5-2228c764fe2d tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:50.172861 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e89580e1-fe1b-4710-b3e5-2228c764fe2d tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:50.401765 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-e89580e1-fe1b-4710-b3e5-2228c764fe2d tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf1bcb51dec4134ac27ea7964684c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27408df8ea9f4d848b15b0bbba451a21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:05:50.410610 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-e89580e1-fe1b-4710-b3e5-2228c764fe2d tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] 10.222.0.58 "GET /compute/v2.1/servers/e822b468-16f3-4a20-94d9-7a2517802a92" status: 200 len: 1698 microversion: 2.1 time: 0.251908 Aug 10 23:05:50.411996 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1146/2269] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:05:50 2022] GET /compute/v2.1/servers/e822b468-16f3-4a20-94d9-7a2517802a92 => generated 1698 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:05:50.613249 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-0b0ff5ec-689f-4dab-865f-d2e08f152cb2 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:05:50.613866 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-0b0ff5ec-689f-4dab-865f-d2e08f152cb2 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] [instance: d65d59de-9c9c-47c6-8066-6c9bb7245bd7] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:05:50.620559 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0b0ff5ec-689f-4dab-865f-d2e08f152cb2 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:50.621232 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0b0ff5ec-689f-4dab-865f-d2e08f152cb2 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:50.621672 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0b0ff5ec-689f-4dab-865f-d2e08f152cb2 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:50.622552 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0b0ff5ec-689f-4dab-865f-d2e08f152cb2 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:50.623043 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0b0ff5ec-689f-4dab-865f-d2e08f152cb2 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:50.623466 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0b0ff5ec-689f-4dab-865f-d2e08f152cb2 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:50.773535 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-0b0ff5ec-689f-4dab-865f-d2e08f152cb2 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a092c6b8aa444999c32d8be76cabd3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891f4d07d0af47b19c4f43b24ff0b7ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:05:50.782699 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-0b0ff5ec-689f-4dab-865f-d2e08f152cb2 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] 10.222.0.58 "GET /compute/v2.1/servers/d65d59de-9c9c-47c6-8066-6c9bb7245bd7" status: 200 len: 1468 microversion: 2.1 time: 0.173508 Aug 10 23:05:50.783434 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1147/2270] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:05:50 2022] GET /compute/v2.1/servers/d65d59de-9c9c-47c6-8066-6c9bb7245bd7 => generated 1468 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:05:50.864235 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.network.neutron [None req-49fc7cf5-4840-4904-94c0-31090f50c59e tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] [instance: 717a8812-6a48-49ad-baa8-0cf0fb41671d] Building network info cache for instance {{(pid=122633) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 10 23:05:51.161856 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-5f84026e-2d5f-4269-94dc-43367fcdd31b tempest-LiveMigrationNegativeTest-2132940867 tempest-LiveMigrationNegativeTest-2132940867-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-1612581746", "block_migration": true, "disk_over_commit": false}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:05:51.170452 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-5f84026e-2d5f-4269-94dc-43367fcdd31b tempest-LiveMigrationNegativeTest-2132940867 tempest-LiveMigrationNegativeTest-2132940867-project-admin] [instance: d65d59de-9c9c-47c6-8066-6c9bb7245bd7] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:05:51.183033 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5f84026e-2d5f-4269-94dc-43367fcdd31b tempest-LiveMigrationNegativeTest-2132940867 tempest-LiveMigrationNegativeTest-2132940867-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:51.184005 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5f84026e-2d5f-4269-94dc-43367fcdd31b tempest-LiveMigrationNegativeTest-2132940867 tempest-LiveMigrationNegativeTest-2132940867-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:51.184927 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5f84026e-2d5f-4269-94dc-43367fcdd31b tempest-LiveMigrationNegativeTest-2132940867 tempest-LiveMigrationNegativeTest-2132940867-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:51.185836 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5f84026e-2d5f-4269-94dc-43367fcdd31b tempest-LiveMigrationNegativeTest-2132940867 tempest-LiveMigrationNegativeTest-2132940867-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:51.186570 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5f84026e-2d5f-4269-94dc-43367fcdd31b tempest-LiveMigrationNegativeTest-2132940867 tempest-LiveMigrationNegativeTest-2132940867-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:51.187178 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5f84026e-2d5f-4269-94dc-43367fcdd31b tempest-LiveMigrationNegativeTest-2132940867 tempest-LiveMigrationNegativeTest-2132940867-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:51.227175 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.objects.instance [None req-5f84026e-2d5f-4269-94dc-43367fcdd31b tempest-LiveMigrationNegativeTest-2132940867 tempest-LiveMigrationNegativeTest-2132940867-project-admin] Lazy-loading 'flavor' on Instance uuid d65d59de-9c9c-47c6-8066-6c9bb7245bd7 {{(pid=122632) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:05:51.242439 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-5f84026e-2d5f-4269-94dc-43367fcdd31b tempest-LiveMigrationNegativeTest-2132940867 tempest-LiveMigrationNegativeTest-2132940867-project-admin] [instance: d65d59de-9c9c-47c6-8066-6c9bb7245bd7] Going to try to live migrate instance to tempest-host-1612581746 {{(pid=122632) live_migrate /opt/stack/nova/nova/compute/api.py:5443}} Aug 10 23:05:51.252759 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-5f84026e-2d5f-4269-94dc-43367fcdd31b tempest-LiveMigrationNegativeTest-2132940867 tempest-LiveMigrationNegativeTest-2132940867-project-admin] HTTP exception thrown: Compute host tempest-host-1612581746 could not be found. Aug 10 23:05:51.267810 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-5f84026e-2d5f-4269-94dc-43367fcdd31b tempest-LiveMigrationNegativeTest-2132940867 tempest-LiveMigrationNegativeTest-2132940867-project-admin] Request method failure captured: Aug 10 23:05:51.267810 n-d-850468-14 devstack@n-api.service[122632]: request: POST /compute/v2.1/servers/d65d59de-9c9c-47c6-8066-6c9bb7245bd7/action HTTP/1.1 Aug 10 23:05:51.267810 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:05:51.267810 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:05:51.267810 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:05:51.267810 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 107 Aug 10 23:05:51.267810 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:05:51.267810 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:05:51.267810 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:05:51.267810 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:05:51.267810 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9Dm5FKBKJID3xROT4n0rQzLfgeqWeILALWmtUWZA3aSNUsXyBOb9mt5CpbjKcAn2yRi-Dq8pk5mh__v-SgJLHsbaEUlKltNkp_mI5FTO4I2LYaLVqxWnxOygF6Pd73udCnca4cx7sIgOnbxCR5Wm0i0vrz_poq4hs3wRIB348QFRYTk Aug 10 23:05:51.267810 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:05:51.267810 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:05:51.267810 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:05:51.267810 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:05:51.267810 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:05:51.267810 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:05:51.267810 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: fc05b457e6ef4583b8c019fea06e4d4d Aug 10 23:05:51.267810 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-LiveMigrationNegativeTest-2132940867 Aug 10 23:05:51.267810 n-d-850468-14 devstack@n-api.service[122632]: X-Role: admin,member,reader Aug 10 23:05:51.267810 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: admin,member,reader Aug 10 23:05:51.269485 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fc05b457e6ef4583b8c019fea06e4d4d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fc05b457e6ef4583b8c019fea06e4d4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/fc05b457e6ef4583b8c019fea06e4d4d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_fc05b457e6ef4583b8c019fea06e4d4d", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:05:51.269485 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-LiveMigrationNegativeTest-2132940867 Aug 10 23:05:51.269485 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: fc05b457e6ef4583b8c019fea06e4d4d Aug 10 23:05:51.269485 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-2132940867 Aug 10 23:05:51.269485 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-LiveMigrationNegativeTest-2132940867-project-admin Aug 10 23:05:51.269485 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:05:51.269485 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:05:51.269485 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: d59ddc69c9104e0fb6216d3be85d1023 Aug 10 23:05:51.269485 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-LiveMigrationNegativeTest-2132940867-project-admin Aug 10 23:05:51.269485 n-d-850468-14 devstack@n-api.service[122632]: Aug 10 23:05:51.269485 n-d-850468-14 devstack@n-api.service[122632]: {"os-migrateLive": {"host": "tempest-host-1612581746", "block_migration": true, "disk_over_commit": false}} Aug 10 23:05:51.269485 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:05:51.270323 n-d-850468-14 devstack@n-api.service[122632]: exception: Compute host tempest-host-1612581746 could not be found. Aug 10 23:05:51.270323 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': 'd65d59de-9c9c-47c6-8066-6c9bb7245bd7', 'body': {'os-migrateLive': {'host': 'tempest-host-1612581746', 'block_migration': True, 'disk_over_commit': False}}} Aug 10 23:05:51.270323 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:05:51.270323 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:05:51.270323 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Aug 10 23:05:51.270323 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Aug 10 23:05:51.270323 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Aug 10 23:05:51.270323 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 10 23:05:51.270323 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Aug 10 23:05:51.270323 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 10 23:05:51.270323 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Aug 10 23:05:51.270323 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 10 23:05:51.270323 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Aug 10 23:05:51.270323 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 10 23:05:51.270323 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Aug 10 23:05:51.270323 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 10 23:05:51.270323 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner Aug 10 23:05:51.270323 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 10 23:05:51.270323 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 10 23:05:51.272548 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 10 23:05:51.272548 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 10 23:05:51.272548 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 10 23:05:51.272548 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5449, in live_migrate Aug 10 23:05:51.272548 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Aug 10 23:05:51.272548 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 10 23:05:51.272548 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 10 23:05:51.272548 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Aug 10 23:05:51.272548 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Aug 10 23:05:51.272548 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Aug 10 23:05:51.272548 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:05:51.272548 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Aug 10 23:05:51.272548 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Aug 10 23:05:51.272548 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Aug 10 23:05:51.272548 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Aug 10 23:05:51.272548 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Aug 10 23:05:51.272548 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Aug 10 23:05:51.272548 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-1612581746 could not be found. Aug 10 23:05:51.272548 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:05:51.274117 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:05:51.274117 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:05:51.274117 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:05:51.274117 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:05:51.274117 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:05:51.274117 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:05:51.274117 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:05:51.274117 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:05:51.274117 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:05:51.274117 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 23:05:51.274117 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 23:05:51.274117 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 23:05:51.274117 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 23:05:51.274117 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 23:05:51.274117 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 23:05:51.274117 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 10 23:05:51.274117 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Aug 10 23:05:51.274117 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 10 23:05:51.274117 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-1612581746 could not be found. Aug 10 23:05:51.274117 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:05:51.276429 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:05:51.276429 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:05:51.276429 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:05:51.276429 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:05:51.276429 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:05:51.276429 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:05:51.276429 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:05:51.276429 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-1612581746 could not be found. Aug 10 23:05:51.276429 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:05:51.279834 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-5f84026e-2d5f-4269-94dc-43367fcdd31b tempest-LiveMigrationNegativeTest-2132940867 tempest-LiveMigrationNegativeTest-2132940867-project-admin] Returning 400 to user: Compute host tempest-host-1612581746 could not be found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:05:51.280936 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-5f84026e-2d5f-4269-94dc-43367fcdd31b tempest-LiveMigrationNegativeTest-2132940867 tempest-LiveMigrationNegativeTest-2132940867-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/d65d59de-9c9c-47c6-8066-6c9bb7245bd7/action" status: 400 len: 100 microversion: 2.1 time: 0.472960 Aug 10 23:05:51.282154 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1148/2271] 10.222.0.58 () {60 vars in 1279 bytes} [Wed Aug 10 23:05:50 2022] POST /compute/v2.1/servers/d65d59de-9c9c-47c6-8066-6c9bb7245bd7/action => generated 100 bytes in 482 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 10 23:05:51.290091 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-25d81b20-e14d-4f57-8827-c7a537bde1ae tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:05:51.291317 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-25d81b20-e14d-4f57-8827-c7a537bde1ae tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] [instance: 662fba38-a52c-464c-8448-bfe0a1d78dab] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:05:51.309933 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-25d81b20-e14d-4f57-8827-c7a537bde1ae tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:51.310470 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-25d81b20-e14d-4f57-8827-c7a537bde1ae tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:51.310936 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-25d81b20-e14d-4f57-8827-c7a537bde1ae tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:51.311669 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-25d81b20-e14d-4f57-8827-c7a537bde1ae tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:51.312125 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-25d81b20-e14d-4f57-8827-c7a537bde1ae tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:51.312558 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-25d81b20-e14d-4f57-8827-c7a537bde1ae tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:51.317584 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:05:51.516158 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-25d81b20-e14d-4f57-8827-c7a537bde1ae tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8899e278c9453fba0ab05c69b0b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46ac8b84bd649fa88897068dbfa5ce6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:05:51.526588 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-25d81b20-e14d-4f57-8827-c7a537bde1ae tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] 10.222.0.58 "GET /compute/v2.1/servers/662fba38-a52c-464c-8448-bfe0a1d78dab" status: 200 len: 1318 microversion: 2.1 time: 0.242358 Aug 10 23:05:51.538806 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1149/2272] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:05:51 2022] GET /compute/v2.1/servers/662fba38-a52c-464c-8448-bfe0a1d78dab => generated 1318 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:05:51.543746 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-0033bfb1-8c18-4cbf-9660-f593954152bd req-e5a4310d-5c3f-4b23-8910-5464e2265240 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "717a8812-6a48-49ad-baa8-0cf0fb41671d", "tag": "06ceffef-a360-4b97-8d79-f13f49f62568"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:05:51.557905 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-0033bfb1-8c18-4cbf-9660-f593954152bd req-e5a4310d-5c3f-4b23-8910-5464e2265240 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:51.558397 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-0033bfb1-8c18-4cbf-9660-f593954152bd req-e5a4310d-5c3f-4b23-8910-5464e2265240 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:51.558900 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-0033bfb1-8c18-4cbf-9660-f593954152bd req-e5a4310d-5c3f-4b23-8910-5464e2265240 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:51.571476 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-0033bfb1-8c18-4cbf-9660-f593954152bd req-e5a4310d-5c3f-4b23-8910-5464e2265240 service nova] Creating event network-changed:06ceffef-a360-4b97-8d79-f13f49f62568 for instance 717a8812-6a48-49ad-baa8-0cf0fb41671d on n-h1-850468-14 Aug 10 23:05:51.577807 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-0033bfb1-8c18-4cbf-9660-f593954152bd req-e5a4310d-5c3f-4b23-8910-5464e2265240 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047254 Aug 10 23:05:51.578863 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1150/2273] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:05:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:05:51.597208 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-4583c4ea-1303-40ae-a1e3-2715cfbdd83a tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a51b6dbe-7684-40db-afae-70ec3d71d6b3"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:05:51.601139 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-4583c4ea-1303-40ae-a1e3-2715cfbdd83a tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] [instance: 45beadf1-a6da-49ab-9098-6b681b5184c9] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:05:51.623109 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4583c4ea-1303-40ae-a1e3-2715cfbdd83a tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:51.625646 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4583c4ea-1303-40ae-a1e3-2715cfbdd83a tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:51.626112 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4583c4ea-1303-40ae-a1e3-2715cfbdd83a tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:51.626889 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4583c4ea-1303-40ae-a1e3-2715cfbdd83a tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:51.627371 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4583c4ea-1303-40ae-a1e3-2715cfbdd83a tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:51.627793 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4583c4ea-1303-40ae-a1e3-2715cfbdd83a tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:52.069498 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-4583c4ea-1303-40ae-a1e3-2715cfbdd83a tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] 10.222.0.58 "POST /compute/v2.1/servers/45beadf1-a6da-49ab-9098-6b681b5184c9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.488245 Aug 10 23:05:52.071462 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1151/2274] 10.222.0.58 () {60 vars in 1323 bytes} [Wed Aug 10 23:05:51 2022] POST /compute/v2.1/servers/45beadf1-a6da-49ab-9098-6b681b5184c9/os-volume_attachments => generated 194 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:05:52.094037 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-4db51ae5-2427-4c02-9cad-7d6ef0afb9aa tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:05:52.096090 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-4db51ae5-2427-4c02-9cad-7d6ef0afb9aa tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] [instance: b3b3730c-1396-4ca6-9d9e-8a3104950324] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:05:52.104456 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4db51ae5-2427-4c02-9cad-7d6ef0afb9aa tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:52.105843 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4db51ae5-2427-4c02-9cad-7d6ef0afb9aa tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:52.106478 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4db51ae5-2427-4c02-9cad-7d6ef0afb9aa tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:52.107768 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4db51ae5-2427-4c02-9cad-7d6ef0afb9aa tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:52.109164 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4db51ae5-2427-4c02-9cad-7d6ef0afb9aa tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:52.109761 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4db51ae5-2427-4c02-9cad-7d6ef0afb9aa tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:52.377965 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.network.neutron [None req-49fc7cf5-4840-4904-94c0-31090f50c59e tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] [instance: 717a8812-6a48-49ad-baa8-0cf0fb41671d] Updating instance_info_cache with network_info: [{"id": "06ceffef-a360-4b97-8d79-f13f49f62568", "address": "fa:16:3e:58:43:a0", "network": {"id": "08b082ca-1914-4b5a-a95f-5a10f05c8ff5", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1871695293-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.2.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "13d6f13784504fc7b2fcf0d6957b4920", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap06ceffef-a3", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122633) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 10 23:05:52.400068 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-49fc7cf5-4840-4904-94c0-31090f50c59e tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Releasing lock "refresh_cache-717a8812-6a48-49ad-baa8-0cf0fb41671d" {{(pid=122633) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 10 23:05:52.401752 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-49fc7cf5-4840-4904-94c0-31090f50c59e tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] 10.222.0.58 "POST /compute/v2.1/servers/717a8812-6a48-49ad-baa8-0cf0fb41671d/action" status: 202 len: 0 microversion: 2.1 time: 3.506780 Aug 10 23:05:52.417375 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1124/2275] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:05:48 2022] POST /compute/v2.1/servers/717a8812-6a48-49ad-baa8-0cf0fb41671d/action => generated 0 bytes in 3523 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 10 23:05:52.432594 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c5613d3a-ee87-41b7-968f-bd77bb788294 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:05:52.434609 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-c5613d3a-ee87-41b7-968f-bd77bb788294 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] [instance: d65d59de-9c9c-47c6-8066-6c9bb7245bd7] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:05:52.444226 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c5613d3a-ee87-41b7-968f-bd77bb788294 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:52.444908 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c5613d3a-ee87-41b7-968f-bd77bb788294 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:52.445522 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c5613d3a-ee87-41b7-968f-bd77bb788294 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:52.446413 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c5613d3a-ee87-41b7-968f-bd77bb788294 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:52.447051 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c5613d3a-ee87-41b7-968f-bd77bb788294 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:52.448276 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c5613d3a-ee87-41b7-968f-bd77bb788294 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:52.462615 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-4db51ae5-2427-4c02-9cad-7d6ef0afb9aa tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de244f1f82143a0b3d3283c31d80bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14c63df2e6c46d2af23b6b8a52690d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:05:52.471557 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-4db51ae5-2427-4c02-9cad-7d6ef0afb9aa tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] 10.222.0.58 "GET /compute/v2.1/servers/b3b3730c-1396-4ca6-9d9e-8a3104950324" status: 200 len: 1472 microversion: 2.1 time: 0.397012 Aug 10 23:05:52.478088 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1152/2276] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:05:52 2022] GET /compute/v2.1/servers/b3b3730c-1396-4ca6-9d9e-8a3104950324 => generated 1472 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:05:52.494988 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-9ab87eef-549b-4d93-9d51-7505f943b9b3 tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:05:52.497565 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-9ab87eef-549b-4d93-9d51-7505f943b9b3 tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] [instance: e822b468-16f3-4a20-94d9-7a2517802a92] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:05:52.515810 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9ab87eef-549b-4d93-9d51-7505f943b9b3 tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:52.516542 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9ab87eef-549b-4d93-9d51-7505f943b9b3 tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:52.517665 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9ab87eef-549b-4d93-9d51-7505f943b9b3 tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:52.518556 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9ab87eef-549b-4d93-9d51-7505f943b9b3 tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:52.520396 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9ab87eef-549b-4d93-9d51-7505f943b9b3 tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:52.521931 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9ab87eef-549b-4d93-9d51-7505f943b9b3 tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:52.704193 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-9ab87eef-549b-4d93-9d51-7505f943b9b3 tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cf1bcb51dec4134ac27ea7964684c7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27408df8ea9f4d848b15b0bbba451a21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:05:52.712345 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-9ab87eef-549b-4d93-9d51-7505f943b9b3 tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] 10.222.0.58 "GET /compute/v2.1/servers/e822b468-16f3-4a20-94d9-7a2517802a92" status: 200 len: 1632 microversion: 2.1 time: 0.232704 Aug 10 23:05:52.713506 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1153/2277] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:05:52 2022] GET /compute/v2.1/servers/e822b468-16f3-4a20-94d9-7a2517802a92 => generated 1632 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:05:52.755331 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-d3f63098-dc87-450a-bb08-e7eac77459f7 tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Action: 'action', calling method: .version_select at 0x7f847ff3ea60>, body: {"addFloatingIp": {"address": "172.25.2.179"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:05:52.757841 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-d3f63098-dc87-450a-bb08-e7eac77459f7 tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] [instance: 33a1bb4c-217e-40f9-b67f-d873bea80284] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:05:52.779094 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d3f63098-dc87-450a-bb08-e7eac77459f7 tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:52.779690 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d3f63098-dc87-450a-bb08-e7eac77459f7 tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:52.780237 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d3f63098-dc87-450a-bb08-e7eac77459f7 tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:52.781081 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d3f63098-dc87-450a-bb08-e7eac77459f7 tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:52.783870 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d3f63098-dc87-450a-bb08-e7eac77459f7 tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:52.784332 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d3f63098-dc87-450a-bb08-e7eac77459f7 tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:52.984938 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-c5613d3a-ee87-41b7-968f-bd77bb788294 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a092c6b8aa444999c32d8be76cabd3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891f4d07d0af47b19c4f43b24ff0b7ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:05:52.985506 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d3f63098-dc87-450a-bb08-e7eac77459f7 tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Acquiring lock "refresh_cache-33a1bb4c-217e-40f9-b67f-d873bea80284" {{(pid=122632) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 10 23:05:52.986090 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d3f63098-dc87-450a-bb08-e7eac77459f7 tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Acquired lock "refresh_cache-33a1bb4c-217e-40f9-b67f-d873bea80284" {{(pid=122632) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 10 23:05:53.020894 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-c5613d3a-ee87-41b7-968f-bd77bb788294 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] 10.222.0.58 "GET /compute/v2.1/servers/d65d59de-9c9c-47c6-8066-6c9bb7245bd7" status: 200 len: 1468 microversion: 2.1 time: 0.599762 Aug 10 23:05:53.024062 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1125/2278] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:05:52 2022] GET /compute/v2.1/servers/d65d59de-9c9c-47c6-8066-6c9bb7245bd7 => generated 1468 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:05:53.032922 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c003c30f-645a-4100-ba37-e29a834b2ac5 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:05:53.034412 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-c003c30f-645a-4100-ba37-e29a834b2ac5 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] [instance: 662fba38-a52c-464c-8448-bfe0a1d78dab] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:05:53.053816 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c003c30f-645a-4100-ba37-e29a834b2ac5 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:53.055875 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c003c30f-645a-4100-ba37-e29a834b2ac5 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:53.059508 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c003c30f-645a-4100-ba37-e29a834b2ac5 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:53.062179 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c003c30f-645a-4100-ba37-e29a834b2ac5 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:53.064147 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c003c30f-645a-4100-ba37-e29a834b2ac5 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:53.065187 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c003c30f-645a-4100-ba37-e29a834b2ac5 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:53.311449 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-c003c30f-645a-4100-ba37-e29a834b2ac5 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8899e278c9453fba0ab05c69b0b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46ac8b84bd649fa88897068dbfa5ce6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:05:53.331917 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-c003c30f-645a-4100-ba37-e29a834b2ac5 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] 10.222.0.58 "GET /compute/v2.1/servers/662fba38-a52c-464c-8448-bfe0a1d78dab" status: 200 len: 1508 microversion: 2.1 time: 0.306608 Aug 10 23:05:53.350817 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1126/2279] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:05:53 2022] GET /compute/v2.1/servers/662fba38-a52c-464c-8448-bfe0a1d78dab => generated 1508 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:05:53.354566 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-46510d53-334d-458f-8b4b-b9e04b0b48eb tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-2035531684", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452"}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:05:53.434767 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.network.neutron [None req-46510d53-334d-458f-8b4b-b9e04b0b48eb tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] validate_networks() for None {{(pid=122633) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 23:05:53.909919 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-46510d53-334d-458f-8b4b-b9e04b0b48eb tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Flavor limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:05:53.911511 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-46510d53-334d-458f-8b4b-b9e04b0b48eb tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Image limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:05:53.912732 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-46510d53-334d-458f-8b4b-b9e04b0b48eb tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Flavor pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:05:53.913329 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-46510d53-334d-458f-8b4b-b9e04b0b48eb tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Image pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:05:53.914039 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-46510d53-334d-458f-8b4b-b9e04b0b48eb tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:05:53.933297 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-46510d53-334d-458f-8b4b-b9e04b0b48eb tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:53.934077 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-46510d53-334d-458f-8b4b-b9e04b0b48eb tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:53.934697 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-46510d53-334d-458f-8b4b-b9e04b0b48eb tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:53.935810 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-46510d53-334d-458f-8b4b-b9e04b0b48eb tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:53.936508 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-46510d53-334d-458f-8b4b-b9e04b0b48eb tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:53.941329 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-46510d53-334d-458f-8b4b-b9e04b0b48eb tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:53.984476 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-46510d53-334d-458f-8b4b-b9e04b0b48eb tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Getting quotas for project 891f4d07d0af47b19c4f43b24ff0b7ef. Resources: {'instances', 'cores', 'ram'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:05:53.993045 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-46510d53-334d-458f-8b4b-b9e04b0b48eb tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Getting quotas for user 1a092c6b8aa444999c32d8be76cabd3d and project 891f4d07d0af47b19c4f43b24ff0b7ef. Resources: {'instances', 'cores', 'ram'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:05:54.012200 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-46510d53-334d-458f-8b4b-b9e04b0b48eb tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Going to run 1 instances... {{(pid=122633) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 23:05:54.016206 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-46510d53-334d-458f-8b4b-b9e04b0b48eb tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] [instance: e864fe19-d87d-49ae-8c95-ffb659b4f618] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78ad8905-f66f-4733-8be9-2b260f1fabed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122633) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 23:05:54.092507 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-46510d53-334d-458f-8b4b-b9e04b0b48eb tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.749578 Aug 10 23:05:54.099703 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1127/2280] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 23:05:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 760 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 23:05:54.106726 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c0d75b10-06f8-44f6-8cc8-105da3faa1e4 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:05:54.107676 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-c0d75b10-06f8-44f6-8cc8-105da3faa1e4 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] [instance: 662fba38-a52c-464c-8448-bfe0a1d78dab] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:05:54.128638 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c0d75b10-06f8-44f6-8cc8-105da3faa1e4 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:54.132552 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c0d75b10-06f8-44f6-8cc8-105da3faa1e4 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:54.133228 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c0d75b10-06f8-44f6-8cc8-105da3faa1e4 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:54.134582 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c0d75b10-06f8-44f6-8cc8-105da3faa1e4 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:54.135503 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c0d75b10-06f8-44f6-8cc8-105da3faa1e4 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:54.136492 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c0d75b10-06f8-44f6-8cc8-105da3faa1e4 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:54.339712 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-c0d75b10-06f8-44f6-8cc8-105da3faa1e4 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8899e278c9453fba0ab05c69b0b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46ac8b84bd649fa88897068dbfa5ce6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:05:54.347926 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-c0d75b10-06f8-44f6-8cc8-105da3faa1e4 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] 10.222.0.58 "GET /compute/v2.1/servers/662fba38-a52c-464c-8448-bfe0a1d78dab" status: 200 len: 1508 microversion: 2.1 time: 0.246718 Aug 10 23:05:54.348658 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1128/2281] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:05:54 2022] GET /compute/v2.1/servers/662fba38-a52c-464c-8448-bfe0a1d78dab => generated 1508 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:05:54.370189 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-b9bd590c-ac0e-487e-8fd3-316cad4b6f57 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:05:54.370808 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-b9bd590c-ac0e-487e-8fd3-316cad4b6f57 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] [instance: b3b3730c-1396-4ca6-9d9e-8a3104950324] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:05:54.377361 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b9bd590c-ac0e-487e-8fd3-316cad4b6f57 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:54.378133 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b9bd590c-ac0e-487e-8fd3-316cad4b6f57 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:54.378706 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b9bd590c-ac0e-487e-8fd3-316cad4b6f57 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:54.379471 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b9bd590c-ac0e-487e-8fd3-316cad4b6f57 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:54.380033 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b9bd590c-ac0e-487e-8fd3-316cad4b6f57 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:54.380471 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b9bd590c-ac0e-487e-8fd3-316cad4b6f57 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:54.694456 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-b9bd590c-ac0e-487e-8fd3-316cad4b6f57 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de244f1f82143a0b3d3283c31d80bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14c63df2e6c46d2af23b6b8a52690d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:05:54.704279 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-b9bd590c-ac0e-487e-8fd3-316cad4b6f57 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] 10.222.0.58 "GET /compute/v2.1/servers/b3b3730c-1396-4ca6-9d9e-8a3104950324" status: 200 len: 1472 microversion: 2.1 time: 0.339951 Aug 10 23:05:54.716182 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1129/2282] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:05:54 2022] GET /compute/v2.1/servers/b3b3730c-1396-4ca6-9d9e-8a3104950324 => generated 1472 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:05:54.726679 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-ce517c13-025d-4c86-88a9-0d4ca99d6cb2 req-2ac78adb-3a45-4d88-937c-c9b9b07ed08a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e822b468-16f3-4a20-94d9-7a2517802a92", "name": "network-vif-deleted", "tag": "975c2c0f-d400-4824-a681-225263ddf461"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:05:54.739224 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-ce517c13-025d-4c86-88a9-0d4ca99d6cb2 req-2ac78adb-3a45-4d88-937c-c9b9b07ed08a service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:54.740440 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-ce517c13-025d-4c86-88a9-0d4ca99d6cb2 req-2ac78adb-3a45-4d88-937c-c9b9b07ed08a service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:54.740882 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-ce517c13-025d-4c86-88a9-0d4ca99d6cb2 req-2ac78adb-3a45-4d88-937c-c9b9b07ed08a service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:54.756115 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-ce517c13-025d-4c86-88a9-0d4ca99d6cb2 req-2ac78adb-3a45-4d88-937c-c9b9b07ed08a service nova] Creating event network-vif-deleted:975c2c0f-d400-4824-a681-225263ddf461 for instance e822b468-16f3-4a20-94d9-7a2517802a92 on n-h2-850468-14 Aug 10 23:05:54.788172 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-ce517c13-025d-4c86-88a9-0d4ca99d6cb2 req-2ac78adb-3a45-4d88-937c-c9b9b07ed08a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070551 Aug 10 23:05:54.796511 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1130/2283] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:05:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:05:54.827729 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-d02b2e2b-a3d7-44b7-8be8-f2d8f3faa6f3 tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:05:54.837556 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-d02b2e2b-a3d7-44b7-8be8-f2d8f3faa6f3 tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] [instance: e822b468-16f3-4a20-94d9-7a2517802a92] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:05:54.872149 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d02b2e2b-a3d7-44b7-8be8-f2d8f3faa6f3 tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:54.872646 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d02b2e2b-a3d7-44b7-8be8-f2d8f3faa6f3 tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:54.873092 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d02b2e2b-a3d7-44b7-8be8-f2d8f3faa6f3 tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:54.873820 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d02b2e2b-a3d7-44b7-8be8-f2d8f3faa6f3 tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:54.879353 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d02b2e2b-a3d7-44b7-8be8-f2d8f3faa6f3 tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:54.880127 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d02b2e2b-a3d7-44b7-8be8-f2d8f3faa6f3 tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:54.922653 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-d02b2e2b-a3d7-44b7-8be8-f2d8f3faa6f3 tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] HTTP exception thrown: Instance e822b468-16f3-4a20-94d9-7a2517802a92 could not be found. Aug 10 23:05:54.928574 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-d02b2e2b-a3d7-44b7-8be8-f2d8f3faa6f3 tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Request method failure captured: Aug 10 23:05:54.928574 n-d-850468-14 devstack@n-api.service[122633]: request: GET /compute/v2.1/servers/e822b468-16f3-4a20-94d9-7a2517802a92 HTTP/1.1 Aug 10 23:05:54.928574 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:05:54.928574 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:05:54.928574 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:05:54.928574 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:05:54.928574 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:05:54.928574 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:05:54.928574 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:05:54.928574 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:05:54.928574 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9DmKt8JWKcyn909UEhyZjDRtb0FOcka7bidfCq9hRM04K6xvvba5pwE729kp1kDXKeT36-RaKpGgPoiHGUFzmf0Blyps4d8F_vbycXF_wDSTCksmW-m45V1WFsHB4eo6sFBqxlCZWbs0PUpIgRIMpuix-UPeja6khn1MFjvtOBPWmF8 Aug 10 23:05:54.928574 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:05:54.928574 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:05:54.928574 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:05:54.928574 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:05:54.928574 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:05:54.928574 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:05:54.928574 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 27408df8ea9f4d848b15b0bbba451a21 Aug 10 23:05:54.928574 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-ServersTestJSON-1022936004 Aug 10 23:05:54.928574 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:05:54.928574 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:05:54.930334 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/27408df8ea9f4d848b15b0bbba451a21"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/27408df8ea9f4d848b15b0bbba451a21"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/27408df8ea9f4d848b15b0bbba451a21"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_27408df8ea9f4d848b15b0bbba451a21", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:05:54.930334 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-ServersTestJSON-1022936004 Aug 10 23:05:54.930334 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 27408df8ea9f4d848b15b0bbba451a21 Aug 10 23:05:54.930334 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-ServersTestJSON-1022936004 Aug 10 23:05:54.930334 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-ServersTestJSON-1022936004-project Aug 10 23:05:54.930334 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:05:54.930334 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:05:54.930334 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 1cf1bcb51dec4134ac27ea7964684c7d Aug 10 23:05:54.930334 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-ServersTestJSON-1022936004-project Aug 10 23:05:54.930334 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:05:54.930334 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance e822b468-16f3-4a20-94d9-7a2517802a92 could not be found. Aug 10 23:05:54.930334 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': 'e822b468-16f3-4a20-94d9-7a2517802a92'} Aug 10 23:05:54.931334 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:05:54.931334 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:05:54.931334 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:05:54.931334 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:05:54.931334 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:05:54.931334 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:05:54.931334 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:05:54.931334 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:05:54.931334 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:05:54.931334 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:05:54.931334 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e822b468-16f3-4a20-94d9-7a2517802a92 could not be found. Aug 10 23:05:54.931334 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:05:54.931334 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:05:54.931334 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:05:54.931334 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:05:54.931334 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:05:54.931334 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:05:54.931334 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:05:54.931334 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:05:54.931334 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:05:54.933213 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:05:54.933213 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:05:54.933213 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:05:54.933213 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:05:54.933213 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:05:54.933213 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:05:54.933213 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:05:54.933213 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e822b468-16f3-4a20-94d9-7a2517802a92 could not be found. Aug 10 23:05:54.933213 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:05:54.933213 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:05:54.933213 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:05:54.933213 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:05:54.933213 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:05:54.933213 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:05:54.933213 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:05:54.933213 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:05:54.933213 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e822b468-16f3-4a20-94d9-7a2517802a92 could not be found. Aug 10 23:05:54.933213 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:05:54.939424 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-d02b2e2b-a3d7-44b7-8be8-f2d8f3faa6f3 tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Returning 404 to user: Instance e822b468-16f3-4a20-94d9-7a2517802a92 could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:05:54.940631 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-d02b2e2b-a3d7-44b7-8be8-f2d8f3faa6f3 tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] 10.222.0.58 "GET /compute/v2.1/servers/e822b468-16f3-4a20-94d9-7a2517802a92" status: 404 len: 111 microversion: 2.1 time: 0.142515 Aug 10 23:05:54.944862 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1131/2284] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:05:54 2022] GET /compute/v2.1/servers/e822b468-16f3-4a20-94d9-7a2517802a92 => generated 111 bytes in 148 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:05:54.960223 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-961b7b47-6ad1-491a-a1b7-f080c74714eb tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:05:54.964145 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-961b7b47-6ad1-491a-a1b7-f080c74714eb tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] [instance: e864fe19-d87d-49ae-8c95-ffb659b4f618] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:05:55.095337 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-961b7b47-6ad1-491a-a1b7-f080c74714eb tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a092c6b8aa444999c32d8be76cabd3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891f4d07d0af47b19c4f43b24ff0b7ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:05:55.106364 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-961b7b47-6ad1-491a-a1b7-f080c74714eb tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] 10.222.0.58 "GET /compute/v2.1/servers/e864fe19-d87d-49ae-8c95-ffb659b4f618" status: 200 len: 1219 microversion: 2.1 time: 0.159344 Aug 10 23:05:55.120435 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1132/2285] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:05:54 2022] GET /compute/v2.1/servers/e864fe19-d87d-49ae-8c95-ffb659b4f618 => generated 1219 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:05:55.126999 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-92437147-b686-456f-99f9-2df5b7373f88 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "OS-DCF:diskConfig": "AUTO"}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:05:55.130504 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-92437147-b686-456f-99f9-2df5b7373f88 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] [instance: 662fba38-a52c-464c-8448-bfe0a1d78dab] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:05:55.139150 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-92437147-b686-456f-99f9-2df5b7373f88 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:55.139830 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-92437147-b686-456f-99f9-2df5b7373f88 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:55.140418 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-92437147-b686-456f-99f9-2df5b7373f88 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:55.141352 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-92437147-b686-456f-99f9-2df5b7373f88 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:55.141953 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-92437147-b686-456f-99f9-2df5b7373f88 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:55.142529 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-92437147-b686-456f-99f9-2df5b7373f88 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:55.273181 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-92437147-b686-456f-99f9-2df5b7373f88 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Flavor limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:05:55.273946 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-92437147-b686-456f-99f9-2df5b7373f88 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Image limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:05:55.274591 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-92437147-b686-456f-99f9-2df5b7373f88 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Flavor pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:05:55.275457 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-92437147-b686-456f-99f9-2df5b7373f88 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Image pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:05:55.276185 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-92437147-b686-456f-99f9-2df5b7373f88 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:05:55.421493 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-92437147-b686-456f-99f9-2df5b7373f88 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] [instance: 662fba38-a52c-464c-8448-bfe0a1d78dab] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:05:55.430644 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-92437147-b686-456f-99f9-2df5b7373f88 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:55.431426 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-92437147-b686-456f-99f9-2df5b7373f88 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:55.432090 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-92437147-b686-456f-99f9-2df5b7373f88 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:55.433251 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-92437147-b686-456f-99f9-2df5b7373f88 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:55.434075 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-92437147-b686-456f-99f9-2df5b7373f88 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:55.434663 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-92437147-b686-456f-99f9-2df5b7373f88 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:55.504802 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-92437147-b686-456f-99f9-2df5b7373f88 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] 10.222.0.58 "POST /compute/v2.1/servers/662fba38-a52c-464c-8448-bfe0a1d78dab/action" status: 202 len: 1110 microversion: 2.1 time: 0.382498 Aug 10 23:05:55.514918 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1133/2286] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:05:55 2022] POST /compute/v2.1/servers/662fba38-a52c-464c-8448-bfe0a1d78dab/action => generated 1110 bytes in 385 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 10 23:05:55.514918 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-80973c0f-0fc1-4d62-8a1d-5a1cdad5d36a tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] Calling method '.version_select at 0x7f84823cbaf0>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:05:55.543184 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-80973c0f-0fc1-4d62-8a1d-5a1cdad5d36a tempest-ServersTestJSON-1022936004 tempest-ServersTestJSON-1022936004-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-526983953" status: 202 len: 0 microversion: 2.1 time: 0.034589 Aug 10 23:05:55.548645 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1134/2287] 10.222.0.58 () {58 vars in 1218 bytes} [Wed Aug 10 23:05:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-526983953 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:05:55.553519 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-fda768b2-d089-44f5-a752-994fd22b2572 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:05:55.554262 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-fda768b2-d089-44f5-a752-994fd22b2572 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] [instance: 662fba38-a52c-464c-8448-bfe0a1d78dab] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:05:55.558924 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:05:55.563987 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fda768b2-d089-44f5-a752-994fd22b2572 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:55.564637 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fda768b2-d089-44f5-a752-994fd22b2572 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:55.565187 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fda768b2-d089-44f5-a752-994fd22b2572 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:55.566111 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fda768b2-d089-44f5-a752-994fd22b2572 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:55.566669 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fda768b2-d089-44f5-a752-994fd22b2572 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:55.567227 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fda768b2-d089-44f5-a752-994fd22b2572 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:55.745889 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-fda768b2-d089-44f5-a752-994fd22b2572 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8899e278c9453fba0ab05c69b0b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46ac8b84bd649fa88897068dbfa5ce6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:05:55.755076 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-fda768b2-d089-44f5-a752-994fd22b2572 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] 10.222.0.58 "GET /compute/v2.1/servers/662fba38-a52c-464c-8448-bfe0a1d78dab" status: 200 len: 1515 microversion: 2.1 time: 0.208441 Aug 10 23:05:55.760657 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1135/2288] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:05:55 2022] GET /compute/v2.1/servers/662fba38-a52c-464c-8448-bfe0a1d78dab => generated 1515 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:05:55.769214 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-a20755cd-c9d8-46bc-85b3-e6714ceea0af tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:05:55.773450 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-a20755cd-c9d8-46bc-85b3-e6714ceea0af tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] [instance: b3b3730c-1396-4ca6-9d9e-8a3104950324] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:05:55.806125 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a20755cd-c9d8-46bc-85b3-e6714ceea0af tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:55.808218 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a20755cd-c9d8-46bc-85b3-e6714ceea0af tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:55.808727 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a20755cd-c9d8-46bc-85b3-e6714ceea0af tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:55.809747 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a20755cd-c9d8-46bc-85b3-e6714ceea0af tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:55.809976 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a20755cd-c9d8-46bc-85b3-e6714ceea0af tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:55.810408 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a20755cd-c9d8-46bc-85b3-e6714ceea0af tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:55.821997 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=3,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:05:56.329099 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.network.neutron [None req-d3f63098-dc87-450a-bb08-e7eac77459f7 tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] [instance: 33a1bb4c-217e-40f9-b67f-d873bea80284] re-assign floating IP 172.25.2.179 from instance 717a8812-6a48-49ad-baa8-0cf0fb41671d Aug 10 23:05:56.408107 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.network.neutron [None req-d3f63098-dc87-450a-bb08-e7eac77459f7 tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] [instance: 717a8812-6a48-49ad-baa8-0cf0fb41671d] Building network info cache for instance {{(pid=122632) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 10 23:05:56.680795 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-a20755cd-c9d8-46bc-85b3-e6714ceea0af tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de244f1f82143a0b3d3283c31d80bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14c63df2e6c46d2af23b6b8a52690d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:05:56.689616 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-a20755cd-c9d8-46bc-85b3-e6714ceea0af tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] 10.222.0.58 "GET /compute/v2.1/servers/b3b3730c-1396-4ca6-9d9e-8a3104950324" status: 200 len: 1472 microversion: 2.1 time: 0.926908 Aug 10 23:05:56.690215 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1136/2289] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:05:55 2022] GET /compute/v2.1/servers/b3b3730c-1396-4ca6-9d9e-8a3104950324 => generated 1472 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:05:56.709699 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-22cd07ad-de7a-4072-bb42-debb491c146d tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:05:56.713209 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-22cd07ad-de7a-4072-bb42-debb491c146d tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] [instance: e864fe19-d87d-49ae-8c95-ffb659b4f618] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:05:56.730102 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-22cd07ad-de7a-4072-bb42-debb491c146d tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:56.732230 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-22cd07ad-de7a-4072-bb42-debb491c146d tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:56.734207 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-22cd07ad-de7a-4072-bb42-debb491c146d tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:56.736633 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-22cd07ad-de7a-4072-bb42-debb491c146d tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:56.737449 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-22cd07ad-de7a-4072-bb42-debb491c146d tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:56.740527 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-22cd07ad-de7a-4072-bb42-debb491c146d tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:56.911146 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-22cd07ad-de7a-4072-bb42-debb491c146d tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a092c6b8aa444999c32d8be76cabd3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891f4d07d0af47b19c4f43b24ff0b7ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:05:56.924184 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-22cd07ad-de7a-4072-bb42-debb491c146d tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] 10.222.0.58 "GET /compute/v2.1/servers/e864fe19-d87d-49ae-8c95-ffb659b4f618" status: 200 len: 1277 microversion: 2.1 time: 0.227006 Aug 10 23:05:56.925388 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1137/2290] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:05:56 2022] GET /compute/v2.1/servers/e864fe19-d87d-49ae-8c95-ffb659b4f618 => generated 1277 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:05:56.939799 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-3c531ea1-bc7d-4c89-86e0-e272a883c6f0 req-449b3625-3f59-40fd-99fa-de65d6a01082 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "717a8812-6a48-49ad-baa8-0cf0fb41671d", "tag": "06ceffef-a360-4b97-8d79-f13f49f62568"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:05:56.960837 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-3c531ea1-bc7d-4c89-86e0-e272a883c6f0 req-449b3625-3f59-40fd-99fa-de65d6a01082 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:56.964573 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-3c531ea1-bc7d-4c89-86e0-e272a883c6f0 req-449b3625-3f59-40fd-99fa-de65d6a01082 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:56.965224 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-3c531ea1-bc7d-4c89-86e0-e272a883c6f0 req-449b3625-3f59-40fd-99fa-de65d6a01082 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:56.996481 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-3c531ea1-bc7d-4c89-86e0-e272a883c6f0 req-449b3625-3f59-40fd-99fa-de65d6a01082 service nova] Creating event network-changed:06ceffef-a360-4b97-8d79-f13f49f62568 for instance 717a8812-6a48-49ad-baa8-0cf0fb41671d on n-h1-850468-14 Aug 10 23:05:57.004156 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-3c531ea1-bc7d-4c89-86e0-e272a883c6f0 req-449b3625-3f59-40fd-99fa-de65d6a01082 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077118 Aug 10 23:05:57.010450 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1138/2291] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:05:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:05:57.039347 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-39feadaa-c5b7-4fdf-b4b6-5f0230e9578a tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:05:57.047008 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-39feadaa-c5b7-4fdf-b4b6-5f0230e9578a tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] [instance: 662fba38-a52c-464c-8448-bfe0a1d78dab] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:05:57.065809 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-39feadaa-c5b7-4fdf-b4b6-5f0230e9578a tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:57.066206 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-39feadaa-c5b7-4fdf-b4b6-5f0230e9578a tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:57.079521 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-39feadaa-c5b7-4fdf-b4b6-5f0230e9578a tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:57.081110 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-39feadaa-c5b7-4fdf-b4b6-5f0230e9578a tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:57.081768 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-39feadaa-c5b7-4fdf-b4b6-5f0230e9578a tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:57.082466 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-39feadaa-c5b7-4fdf-b4b6-5f0230e9578a tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:57.500841 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-39feadaa-c5b7-4fdf-b4b6-5f0230e9578a tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8899e278c9453fba0ab05c69b0b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46ac8b84bd649fa88897068dbfa5ce6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:05:57.509119 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-39feadaa-c5b7-4fdf-b4b6-5f0230e9578a tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] 10.222.0.58 "GET /compute/v2.1/servers/662fba38-a52c-464c-8448-bfe0a1d78dab" status: 200 len: 1515 microversion: 2.1 time: 0.496895 Aug 10 23:05:57.510002 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1139/2292] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:05:57 2022] GET /compute/v2.1/servers/662fba38-a52c-464c-8448-bfe0a1d78dab => generated 1515 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:05:57.547684 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=20 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:05:57.635619 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=28 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:05:57.795681 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-03f92f4c-581a-4d07-922a-d8e514d50809 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:05:57.796301 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-03f92f4c-581a-4d07-922a-d8e514d50809 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] [instance: b3b3730c-1396-4ca6-9d9e-8a3104950324] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:05:57.809068 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-03f92f4c-581a-4d07-922a-d8e514d50809 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:57.809824 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-03f92f4c-581a-4d07-922a-d8e514d50809 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:57.810421 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-03f92f4c-581a-4d07-922a-d8e514d50809 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:57.814495 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-03f92f4c-581a-4d07-922a-d8e514d50809 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:57.815430 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-03f92f4c-581a-4d07-922a-d8e514d50809 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:57.816087 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-03f92f4c-581a-4d07-922a-d8e514d50809 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:58.278018 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.network.neutron [None req-d3f63098-dc87-450a-bb08-e7eac77459f7 tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] [instance: 717a8812-6a48-49ad-baa8-0cf0fb41671d] Updating instance_info_cache with network_info: [{"id": "06ceffef-a360-4b97-8d79-f13f49f62568", "address": "fa:16:3e:58:43:a0", "network": {"id": "08b082ca-1914-4b5a-a95f-5a10f05c8ff5", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1871695293-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "13d6f13784504fc7b2fcf0d6957b4920", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap06ceffef-a3", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122632) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 10 23:05:58.302107 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.network.neutron [None req-d3f63098-dc87-450a-bb08-e7eac77459f7 tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] [instance: 33a1bb4c-217e-40f9-b67f-d873bea80284] Building network info cache for instance {{(pid=122632) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 10 23:05:58.437895 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-03f92f4c-581a-4d07-922a-d8e514d50809 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de244f1f82143a0b3d3283c31d80bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14c63df2e6c46d2af23b6b8a52690d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:05:58.451552 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-03f92f4c-581a-4d07-922a-d8e514d50809 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] 10.222.0.58 "GET /compute/v2.1/servers/b3b3730c-1396-4ca6-9d9e-8a3104950324" status: 200 len: 1472 microversion: 2.1 time: 0.660341 Aug 10 23:05:58.452380 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1140/2293] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:05:57 2022] GET /compute/v2.1/servers/b3b3730c-1396-4ca6-9d9e-8a3104950324 => generated 1472 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:05:58.468924 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c9c135f4-b9e3-409c-ad82-5d4f5c18cf19 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:05:58.471299 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-c9c135f4-b9e3-409c-ad82-5d4f5c18cf19 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] [instance: e864fe19-d87d-49ae-8c95-ffb659b4f618] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:05:58.498063 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c9c135f4-b9e3-409c-ad82-5d4f5c18cf19 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:58.499150 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c9c135f4-b9e3-409c-ad82-5d4f5c18cf19 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:58.500572 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c9c135f4-b9e3-409c-ad82-5d4f5c18cf19 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:58.503928 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c9c135f4-b9e3-409c-ad82-5d4f5c18cf19 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:58.504599 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c9c135f4-b9e3-409c-ad82-5d4f5c18cf19 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:58.507204 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c9c135f4-b9e3-409c-ad82-5d4f5c18cf19 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:59.108211 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-c9c135f4-b9e3-409c-ad82-5d4f5c18cf19 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a092c6b8aa444999c32d8be76cabd3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891f4d07d0af47b19c4f43b24ff0b7ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:05:59.120408 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-c9c135f4-b9e3-409c-ad82-5d4f5c18cf19 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] 10.222.0.58 "GET /compute/v2.1/servers/e864fe19-d87d-49ae-8c95-ffb659b4f618" status: 200 len: 1319 microversion: 2.1 time: 0.666790 Aug 10 23:05:59.124882 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1141/2294] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:05:58 2022] GET /compute/v2.1/servers/e864fe19-d87d-49ae-8c95-ffb659b4f618 => generated 1319 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:05:59.137193 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-fca43dd1-88b7-4c9f-b1bc-e183b8e099b9 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:05:59.138949 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-fca43dd1-88b7-4c9f-b1bc-e183b8e099b9 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] [instance: 662fba38-a52c-464c-8448-bfe0a1d78dab] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:05:59.153352 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fca43dd1-88b7-4c9f-b1bc-e183b8e099b9 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:59.156052 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fca43dd1-88b7-4c9f-b1bc-e183b8e099b9 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:59.157578 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fca43dd1-88b7-4c9f-b1bc-e183b8e099b9 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:59.158643 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fca43dd1-88b7-4c9f-b1bc-e183b8e099b9 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:59.160550 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fca43dd1-88b7-4c9f-b1bc-e183b8e099b9 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:59.174920 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fca43dd1-88b7-4c9f-b1bc-e183b8e099b9 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:59.636648 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-fca43dd1-88b7-4c9f-b1bc-e183b8e099b9 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8899e278c9453fba0ab05c69b0b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46ac8b84bd649fa88897068dbfa5ce6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:05:59.650202 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-fca43dd1-88b7-4c9f-b1bc-e183b8e099b9 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] 10.222.0.58 "GET /compute/v2.1/servers/662fba38-a52c-464c-8448-bfe0a1d78dab" status: 200 len: 1515 microversion: 2.1 time: 0.519824 Aug 10 23:05:59.651834 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1142/2295] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:05:59 2022] GET /compute/v2.1/servers/662fba38-a52c-464c-8448-bfe0a1d78dab => generated 1515 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:05:59.670760 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-0b4d9a9d-6201-4d07-b4ee-3389daeff3d1 req-90ce171a-9e17-43fb-8bcc-9f862d65de66 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33a1bb4c-217e-40f9-b67f-d873bea80284", "tag": "53ba640c-dbc3-45eb-93db-346c26b4a371"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:05:59.695703 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-0b4d9a9d-6201-4d07-b4ee-3389daeff3d1 req-90ce171a-9e17-43fb-8bcc-9f862d65de66 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:59.695703 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-0b4d9a9d-6201-4d07-b4ee-3389daeff3d1 req-90ce171a-9e17-43fb-8bcc-9f862d65de66 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:59.695703 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-0b4d9a9d-6201-4d07-b4ee-3389daeff3d1 req-90ce171a-9e17-43fb-8bcc-9f862d65de66 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:59.753489 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-0b4d9a9d-6201-4d07-b4ee-3389daeff3d1 req-90ce171a-9e17-43fb-8bcc-9f862d65de66 service nova] Creating event network-changed:53ba640c-dbc3-45eb-93db-346c26b4a371 for instance 33a1bb4c-217e-40f9-b67f-d873bea80284 on n-h1-850468-14 Aug 10 23:05:59.765642 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-0b4d9a9d-6201-4d07-b4ee-3389daeff3d1 req-90ce171a-9e17-43fb-8bcc-9f862d65de66 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111282 Aug 10 23:05:59.766611 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1143/2296] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:05:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:05:59.782133 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-33ba0e24-c192-41d8-b810-5c858c94c62d tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:05:59.789782 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-33ba0e24-c192-41d8-b810-5c858c94c62d tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] [instance: b3b3730c-1396-4ca6-9d9e-8a3104950324] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:05:59.819769 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-33ba0e24-c192-41d8-b810-5c858c94c62d tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:59.821013 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-33ba0e24-c192-41d8-b810-5c858c94c62d tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:59.824563 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-33ba0e24-c192-41d8-b810-5c858c94c62d tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:05:59.828958 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-33ba0e24-c192-41d8-b810-5c858c94c62d tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:05:59.829894 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-33ba0e24-c192-41d8-b810-5c858c94c62d tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:05:59.835066 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-33ba0e24-c192-41d8-b810-5c858c94c62d tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:00.504232 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-33ba0e24-c192-41d8-b810-5c858c94c62d tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de244f1f82143a0b3d3283c31d80bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14c63df2e6c46d2af23b6b8a52690d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:06:00.514721 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-33ba0e24-c192-41d8-b810-5c858c94c62d tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] 10.222.0.58 "GET /compute/v2.1/servers/b3b3730c-1396-4ca6-9d9e-8a3104950324" status: 200 len: 1472 microversion: 2.1 time: 0.743987 Aug 10 23:06:00.519551 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1144/2297] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:05:59 2022] GET /compute/v2.1/servers/b3b3730c-1396-4ca6-9d9e-8a3104950324 => generated 1472 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:06:00.526633 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-d2746513-e815-4319-8ae0-3b953e6675af tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:00.528573 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-d2746513-e815-4319-8ae0-3b953e6675af tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] [instance: e864fe19-d87d-49ae-8c95-ffb659b4f618] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:06:00.545254 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d2746513-e815-4319-8ae0-3b953e6675af tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:00.546155 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d2746513-e815-4319-8ae0-3b953e6675af tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:00.546830 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d2746513-e815-4319-8ae0-3b953e6675af tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:00.547768 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d2746513-e815-4319-8ae0-3b953e6675af tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:00.550914 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d2746513-e815-4319-8ae0-3b953e6675af tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:00.551646 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d2746513-e815-4319-8ae0-3b953e6675af tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:00.906896 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-d2746513-e815-4319-8ae0-3b953e6675af tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a092c6b8aa444999c32d8be76cabd3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891f4d07d0af47b19c4f43b24ff0b7ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:06:00.929412 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-d2746513-e815-4319-8ae0-3b953e6675af tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] 10.222.0.58 "GET /compute/v2.1/servers/e864fe19-d87d-49ae-8c95-ffb659b4f618" status: 200 len: 1319 microversion: 2.1 time: 0.408508 Aug 10 23:06:00.935469 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1145/2298] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:06:00 2022] GET /compute/v2.1/servers/e864fe19-d87d-49ae-8c95-ffb659b4f618 => generated 1319 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:06:00.940788 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-022cbf40-408d-4bff-bef2-d8c70e60242e req-5eb8243e-9f94-4394-b424-22bc1976b551 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e864fe19-d87d-49ae-8c95-ffb659b4f618", "tag": "180cd3f3-3b1b-4930-b5db-bbdb9cb8bb30"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:06:00.974971 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-022cbf40-408d-4bff-bef2-d8c70e60242e req-5eb8243e-9f94-4394-b424-22bc1976b551 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:00.976261 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-022cbf40-408d-4bff-bef2-d8c70e60242e req-5eb8243e-9f94-4394-b424-22bc1976b551 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:00.976883 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-022cbf40-408d-4bff-bef2-d8c70e60242e req-5eb8243e-9f94-4394-b424-22bc1976b551 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:01.038817 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-022cbf40-408d-4bff-bef2-d8c70e60242e req-5eb8243e-9f94-4394-b424-22bc1976b551 service nova] Creating event network-changed:180cd3f3-3b1b-4930-b5db-bbdb9cb8bb30 for instance e864fe19-d87d-49ae-8c95-ffb659b4f618 on n-h2-850468-14 Aug 10 23:06:01.049306 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-022cbf40-408d-4bff-bef2-d8c70e60242e req-5eb8243e-9f94-4394-b424-22bc1976b551 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111484 Aug 10 23:06:01.053059 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1146/2299] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:06:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:06:01.066201 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c6b05e4d-789e-4405-a976-5b197c6f7419 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:01.067645 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-c6b05e4d-789e-4405-a976-5b197c6f7419 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] [instance: 662fba38-a52c-464c-8448-bfe0a1d78dab] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:06:01.077857 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c6b05e4d-789e-4405-a976-5b197c6f7419 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:01.078282 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c6b05e4d-789e-4405-a976-5b197c6f7419 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:01.078721 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c6b05e4d-789e-4405-a976-5b197c6f7419 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:01.079465 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c6b05e4d-789e-4405-a976-5b197c6f7419 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:01.079916 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c6b05e4d-789e-4405-a976-5b197c6f7419 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:01.084459 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c6b05e4d-789e-4405-a976-5b197c6f7419 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:01.287446 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.network.neutron [None req-d3f63098-dc87-450a-bb08-e7eac77459f7 tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] [instance: 33a1bb4c-217e-40f9-b67f-d873bea80284] Updating instance_info_cache with network_info: [{"id": "53ba640c-dbc3-45eb-93db-346c26b4a371", "address": "fa:16:3e:29:59:67", "network": {"id": "08b082ca-1914-4b5a-a95f-5a10f05c8ff5", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1871695293-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.2.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "13d6f13784504fc7b2fcf0d6957b4920", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap53ba640c-db", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122632) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 10 23:06:01.304120 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d3f63098-dc87-450a-bb08-e7eac77459f7 tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Releasing lock "refresh_cache-33a1bb4c-217e-40f9-b67f-d873bea80284" {{(pid=122632) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 10 23:06:01.306364 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-d3f63098-dc87-450a-bb08-e7eac77459f7 tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] 10.222.0.58 "POST /compute/v2.1/servers/33a1bb4c-217e-40f9-b67f-d873bea80284/action" status: 202 len: 0 microversion: 2.1 time: 8.590351 Aug 10 23:06:01.312331 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1154/2300] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:05:52 2022] POST /compute/v2.1/servers/33a1bb4c-217e-40f9-b67f-d873bea80284/action => generated 0 bytes in 8595 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 10 23:06:01.317900 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-5c375d3e-bb8c-4fcd-87c3-02a565568c16 tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Action: 'action', calling method: .version_select at 0x7f847ff3ec10>, body: {"removeFloatingIp": {"address": "172.25.2.179"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:06:01.376658 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-c6b05e4d-789e-4405-a976-5b197c6f7419 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8899e278c9453fba0ab05c69b0b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46ac8b84bd649fa88897068dbfa5ce6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:06:01.386926 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-c6b05e4d-789e-4405-a976-5b197c6f7419 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] 10.222.0.58 "GET /compute/v2.1/servers/662fba38-a52c-464c-8448-bfe0a1d78dab" status: 200 len: 1515 microversion: 2.1 time: 0.332064 Aug 10 23:06:01.388177 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1147/2301] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:06:01 2022] GET /compute/v2.1/servers/662fba38-a52c-464c-8448-bfe0a1d78dab => generated 1515 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:06:01.544551 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-eddebbac-2215-48bd-a83c-ca4b96583455 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:01.545177 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-eddebbac-2215-48bd-a83c-ca4b96583455 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] [instance: b3b3730c-1396-4ca6-9d9e-8a3104950324] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:06:01.552030 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-eddebbac-2215-48bd-a83c-ca4b96583455 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:01.552861 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-eddebbac-2215-48bd-a83c-ca4b96583455 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:01.553539 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-eddebbac-2215-48bd-a83c-ca4b96583455 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:01.554474 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-eddebbac-2215-48bd-a83c-ca4b96583455 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:01.555190 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-eddebbac-2215-48bd-a83c-ca4b96583455 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:01.555834 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-eddebbac-2215-48bd-a83c-ca4b96583455 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:01.658121 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-5c375d3e-bb8c-4fcd-87c3-02a565568c16 tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] [instance: 33a1bb4c-217e-40f9-b67f-d873bea80284] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:06:01.662157 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:06:01.669453 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5c375d3e-bb8c-4fcd-87c3-02a565568c16 tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:01.669951 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5c375d3e-bb8c-4fcd-87c3-02a565568c16 tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:01.670383 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5c375d3e-bb8c-4fcd-87c3-02a565568c16 tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:01.675219 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5c375d3e-bb8c-4fcd-87c3-02a565568c16 tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:01.675734 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5c375d3e-bb8c-4fcd-87c3-02a565568c16 tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:01.676176 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5c375d3e-bb8c-4fcd-87c3-02a565568c16 tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:01.759126 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-eddebbac-2215-48bd-a83c-ca4b96583455 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de244f1f82143a0b3d3283c31d80bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14c63df2e6c46d2af23b6b8a52690d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:06:01.767855 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-eddebbac-2215-48bd-a83c-ca4b96583455 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] 10.222.0.58 "GET /compute/v2.1/servers/b3b3730c-1396-4ca6-9d9e-8a3104950324" status: 200 len: 1472 microversion: 2.1 time: 0.227560 Aug 10 23:06:01.768375 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1148/2302] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:06:01 2022] GET /compute/v2.1/servers/b3b3730c-1396-4ca6-9d9e-8a3104950324 => generated 1472 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:06:01.957031 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-0d18ca38-1ee9-42d4-b647-b763e44fc515 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:01.957843 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-0d18ca38-1ee9-42d4-b647-b763e44fc515 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] [instance: e864fe19-d87d-49ae-8c95-ffb659b4f618] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:06:01.967310 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0d18ca38-1ee9-42d4-b647-b763e44fc515 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:01.968030 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0d18ca38-1ee9-42d4-b647-b763e44fc515 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:01.968478 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0d18ca38-1ee9-42d4-b647-b763e44fc515 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:01.969206 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0d18ca38-1ee9-42d4-b647-b763e44fc515 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:01.969660 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0d18ca38-1ee9-42d4-b647-b763e44fc515 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:01.970082 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0d18ca38-1ee9-42d4-b647-b763e44fc515 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:02.162361 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-5c375d3e-bb8c-4fcd-87c3-02a565568c16 tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] HTTP exception thrown: Floating IP 172.25.2.179 is not associated with instance 717a8812-6a48-49ad-baa8-0cf0fb41671d. Aug 10 23:06:02.165003 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-5c375d3e-bb8c-4fcd-87c3-02a565568c16 tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Request method failure captured: Aug 10 23:06:02.165003 n-d-850468-14 devstack@n-api.service[122632]: request: POST /compute/v2.1/servers/717a8812-6a48-49ad-baa8-0cf0fb41671d/action HTTP/1.1 Aug 10 23:06:02.165003 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:06:02.165003 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:06:02.165003 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:06:02.165003 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 49 Aug 10 23:06:02.165003 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:06:02.165003 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:06:02.165003 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:06:02.165003 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:06:02.165003 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9DmnLPtDRZSGfL4AUMemFhJtzFt6s4rdfOdXQaCqDUHRqNo5yVfu_wv80eve_nwLCd4fbUvicTdreQF65GmSW3qJG8AC1ZEoHr5fP3QTdwCryQqIBkdTPl9_u9it646Rl2wU0V1GTXwmEFupip0dt8llfLtffk4ojegpINlnBKspO0U Aug 10 23:06:02.165003 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:06:02.165003 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:06:02.165003 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:06:02.165003 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:06:02.165003 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:06:02.165003 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:06:02.165003 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 13d6f13784504fc7b2fcf0d6957b4920 Aug 10 23:06:02.165003 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1294999711 Aug 10 23:06:02.165003 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:06:02.165003 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:06:02.167185 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/13d6f13784504fc7b2fcf0d6957b4920"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/13d6f13784504fc7b2fcf0d6957b4920"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/13d6f13784504fc7b2fcf0d6957b4920"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_13d6f13784504fc7b2fcf0d6957b4920", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:06:02.167185 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1294999711 Aug 10 23:06:02.167185 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 13d6f13784504fc7b2fcf0d6957b4920 Aug 10 23:06:02.167185 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1294999711 Aug 10 23:06:02.167185 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-FloatingIPsAssociationTestJSON-1294999711-project Aug 10 23:06:02.167185 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:06:02.167185 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:06:02.167185 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: 933e6a08c3014b36aee164b213bbfaf0 Aug 10 23:06:02.167185 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1294999711-project Aug 10 23:06:02.167185 n-d-850468-14 devstack@n-api.service[122632]: Aug 10 23:06:02.167185 n-d-850468-14 devstack@n-api.service[122632]: {"removeFloatingIp": {"address": "172.25.2.179"}} Aug 10 23:06:02.167185 n-d-850468-14 devstack@n-api.service[122632]: method: Aug 10 23:06:02.167185 n-d-850468-14 devstack@n-api.service[122632]: exception: Floating IP 172.25.2.179 is not associated with instance 717a8812-6a48-49ad-baa8-0cf0fb41671d. Aug 10 23:06:02.167987 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': '717a8812-6a48-49ad-baa8-0cf0fb41671d', 'body': {'removeFloatingIp': {'address': '172.25.2.179'}}} Aug 10 23:06:02.167987 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:06:02.167987 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:06:02.167987 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:06:02.167987 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:06:02.167987 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:06:02.167987 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:06:02.167987 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 23:06:02.167987 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 23:06:02.167987 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:06:02.167987 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:06:02.167987 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 23:06:02.167987 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 23:06:02.167987 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Aug 10 23:06:02.167987 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 10 23:06:02.167987 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.25.2.179 is not associated with instance 717a8812-6a48-49ad-baa8-0cf0fb41671d. Aug 10 23:06:02.167987 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:06:02.167987 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:06:02.167987 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:06:02.167987 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:06:02.169144 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:06:02.169144 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:06:02.169144 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:06:02.169144 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:06:02.169144 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.25.2.179 is not associated with instance 717a8812-6a48-49ad-baa8-0cf0fb41671d. Aug 10 23:06:02.169144 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:06:02.169144 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-5c375d3e-bb8c-4fcd-87c3-02a565568c16 tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Returning 409 to user: Floating IP 172.25.2.179 is not associated with instance 717a8812-6a48-49ad-baa8-0cf0fb41671d. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:06:02.169144 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-5c375d3e-bb8c-4fcd-87c3-02a565568c16 tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] 10.222.0.58 "POST /compute/v2.1/servers/717a8812-6a48-49ad-baa8-0cf0fb41671d/action" status: 409 len: 146 microversion: 2.1 time: 0.852939 Aug 10 23:06:02.171079 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1155/2303] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:06:01 2022] POST /compute/v2.1/servers/717a8812-6a48-49ad-baa8-0cf0fb41671d/action => generated 146 bytes in 858 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 10 23:06:02.177782 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-9f26fb03-e455-42f5-817e-ebf14ee370bb tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.2.179"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:06:02.184957 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-0d18ca38-1ee9-42d4-b647-b763e44fc515 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a092c6b8aa444999c32d8be76cabd3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891f4d07d0af47b19c4f43b24ff0b7ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:06:02.193859 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-0d18ca38-1ee9-42d4-b647-b763e44fc515 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] 10.222.0.58 "GET /compute/v2.1/servers/e864fe19-d87d-49ae-8c95-ffb659b4f618" status: 200 len: 1319 microversion: 2.1 time: 0.240937 Aug 10 23:06:02.195305 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1149/2304] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:06:01 2022] GET /compute/v2.1/servers/e864fe19-d87d-49ae-8c95-ffb659b4f618 => generated 1319 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:06:02.389196 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-9f26fb03-e455-42f5-817e-ebf14ee370bb tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] [instance: 33a1bb4c-217e-40f9-b67f-d873bea80284] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:06:02.400074 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9f26fb03-e455-42f5-817e-ebf14ee370bb tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:02.401515 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9f26fb03-e455-42f5-817e-ebf14ee370bb tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:02.403975 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9f26fb03-e455-42f5-817e-ebf14ee370bb tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:02.403975 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9f26fb03-e455-42f5-817e-ebf14ee370bb tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:02.403975 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9f26fb03-e455-42f5-817e-ebf14ee370bb tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:02.403975 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9f26fb03-e455-42f5-817e-ebf14ee370bb tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:02.410110 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-0dd8d693-31d7-4247-9467-cd932d48efe9 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:02.411250 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-0dd8d693-31d7-4247-9467-cd932d48efe9 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] [instance: 662fba38-a52c-464c-8448-bfe0a1d78dab] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:06:02.420045 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0dd8d693-31d7-4247-9467-cd932d48efe9 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:02.420799 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0dd8d693-31d7-4247-9467-cd932d48efe9 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:02.421551 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0dd8d693-31d7-4247-9467-cd932d48efe9 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:02.422574 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0dd8d693-31d7-4247-9467-cd932d48efe9 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:02.423222 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0dd8d693-31d7-4247-9467-cd932d48efe9 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:02.423793 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0dd8d693-31d7-4247-9467-cd932d48efe9 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:02.850609 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-0dd8d693-31d7-4247-9467-cd932d48efe9 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8899e278c9453fba0ab05c69b0b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46ac8b84bd649fa88897068dbfa5ce6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:06:02.865848 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-0dd8d693-31d7-4247-9467-cd932d48efe9 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] 10.222.0.58 "GET /compute/v2.1/servers/662fba38-a52c-464c-8448-bfe0a1d78dab" status: 200 len: 1515 microversion: 2.1 time: 0.459881 Aug 10 23:06:02.884160 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1150/2305] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:06:02 2022] GET /compute/v2.1/servers/662fba38-a52c-464c-8448-bfe0a1d78dab => generated 1515 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:06:02.900954 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-8f161fd3-b176-4968-9f8f-c66e1270658d tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:02.903147 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-8f161fd3-b176-4968-9f8f-c66e1270658d tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] [instance: b3b3730c-1396-4ca6-9d9e-8a3104950324] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:06:02.920261 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8f161fd3-b176-4968-9f8f-c66e1270658d tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:02.920817 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8f161fd3-b176-4968-9f8f-c66e1270658d tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:02.922385 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8f161fd3-b176-4968-9f8f-c66e1270658d tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:02.925055 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8f161fd3-b176-4968-9f8f-c66e1270658d tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:02.925539 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8f161fd3-b176-4968-9f8f-c66e1270658d tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:02.925988 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8f161fd3-b176-4968-9f8f-c66e1270658d tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:03.154968 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9f26fb03-e455-42f5-817e-ebf14ee370bb tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Acquiring lock "refresh_cache-33a1bb4c-217e-40f9-b67f-d873bea80284" {{(pid=122632) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 10 23:06:03.155373 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9f26fb03-e455-42f5-817e-ebf14ee370bb tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Acquired lock "refresh_cache-33a1bb4c-217e-40f9-b67f-d873bea80284" {{(pid=122632) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 10 23:06:03.363349 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-8f161fd3-b176-4968-9f8f-c66e1270658d tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de244f1f82143a0b3d3283c31d80bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14c63df2e6c46d2af23b6b8a52690d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:06:03.379548 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-8f161fd3-b176-4968-9f8f-c66e1270658d tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] 10.222.0.58 "GET /compute/v2.1/servers/b3b3730c-1396-4ca6-9d9e-8a3104950324" status: 200 len: 1472 microversion: 2.1 time: 0.490903 Aug 10 23:06:03.380742 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1151/2306] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:06:02 2022] GET /compute/v2.1/servers/b3b3730c-1396-4ca6-9d9e-8a3104950324 => generated 1472 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:06:03.398967 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-d6a6acb2-1629-4803-b438-d51c6c3c620e tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:03.399993 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-d6a6acb2-1629-4803-b438-d51c6c3c620e tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] [instance: e864fe19-d87d-49ae-8c95-ffb659b4f618] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:06:03.416336 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d6a6acb2-1629-4803-b438-d51c6c3c620e tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:03.420964 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d6a6acb2-1629-4803-b438-d51c6c3c620e tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:03.422136 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d6a6acb2-1629-4803-b438-d51c6c3c620e tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:03.424906 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d6a6acb2-1629-4803-b438-d51c6c3c620e tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:03.427520 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d6a6acb2-1629-4803-b438-d51c6c3c620e tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:03.436307 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d6a6acb2-1629-4803-b438-d51c6c3c620e tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:03.727698 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-d6a6acb2-1629-4803-b438-d51c6c3c620e tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a092c6b8aa444999c32d8be76cabd3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891f4d07d0af47b19c4f43b24ff0b7ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:06:03.752714 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-d6a6acb2-1629-4803-b438-d51c6c3c620e tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] 10.222.0.58 "GET /compute/v2.1/servers/e864fe19-d87d-49ae-8c95-ffb659b4f618" status: 200 len: 1319 microversion: 2.1 time: 0.370463 Aug 10 23:06:03.755377 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1152/2307] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:06:03 2022] GET /compute/v2.1/servers/e864fe19-d87d-49ae-8c95-ffb659b4f618 => generated 1319 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:06:03.894262 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-14df5097-9883-4d44-89cb-4b7eb429f43f tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:03.895278 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-14df5097-9883-4d44-89cb-4b7eb429f43f tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] [instance: 662fba38-a52c-464c-8448-bfe0a1d78dab] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:06:03.904901 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-14df5097-9883-4d44-89cb-4b7eb429f43f tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:03.905637 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-14df5097-9883-4d44-89cb-4b7eb429f43f tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:03.906187 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-14df5097-9883-4d44-89cb-4b7eb429f43f tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:03.907610 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-14df5097-9883-4d44-89cb-4b7eb429f43f tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:03.908196 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-14df5097-9883-4d44-89cb-4b7eb429f43f tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:03.908737 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-14df5097-9883-4d44-89cb-4b7eb429f43f tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:03.958000 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=2 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:06:04.242567 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-14df5097-9883-4d44-89cb-4b7eb429f43f tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8899e278c9453fba0ab05c69b0b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46ac8b84bd649fa88897068dbfa5ce6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:06:04.254997 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-14df5097-9883-4d44-89cb-4b7eb429f43f tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] 10.222.0.58 "GET /compute/v2.1/servers/662fba38-a52c-464c-8448-bfe0a1d78dab" status: 200 len: 1515 microversion: 2.1 time: 0.367257 Aug 10 23:06:04.264166 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1153/2308] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:06:03 2022] GET /compute/v2.1/servers/662fba38-a52c-464c-8448-bfe0a1d78dab => generated 1515 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:06:04.402143 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c32cb01a-24c8-4a7e-a6f6-340565d7a56b tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:04.403517 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-c32cb01a-24c8-4a7e-a6f6-340565d7a56b tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] [instance: b3b3730c-1396-4ca6-9d9e-8a3104950324] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:06:04.409955 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c32cb01a-24c8-4a7e-a6f6-340565d7a56b tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:04.410716 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c32cb01a-24c8-4a7e-a6f6-340565d7a56b tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:04.411455 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c32cb01a-24c8-4a7e-a6f6-340565d7a56b tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:04.412357 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c32cb01a-24c8-4a7e-a6f6-340565d7a56b tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:04.412812 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c32cb01a-24c8-4a7e-a6f6-340565d7a56b tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:04.413458 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c32cb01a-24c8-4a7e-a6f6-340565d7a56b tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:04.641880 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-c32cb01a-24c8-4a7e-a6f6-340565d7a56b tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de244f1f82143a0b3d3283c31d80bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14c63df2e6c46d2af23b6b8a52690d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:06:04.660029 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=100 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:06:04.671327 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-c32cb01a-24c8-4a7e-a6f6-340565d7a56b tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] 10.222.0.58 "GET /compute/v2.1/servers/b3b3730c-1396-4ca6-9d9e-8a3104950324" status: 200 len: 1472 microversion: 2.1 time: 0.273246 Aug 10 23:06:04.687974 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1154/2309] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:06:04 2022] GET /compute/v2.1/servers/b3b3730c-1396-4ca6-9d9e-8a3104950324 => generated 1472 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:06:04.775968 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-47ebb8de-fd6f-41a0-83b2-bec664559d6d tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:04.776593 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-47ebb8de-fd6f-41a0-83b2-bec664559d6d tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] [instance: e864fe19-d87d-49ae-8c95-ffb659b4f618] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:06:04.784018 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-47ebb8de-fd6f-41a0-83b2-bec664559d6d tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:04.784619 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-47ebb8de-fd6f-41a0-83b2-bec664559d6d tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:04.785098 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-47ebb8de-fd6f-41a0-83b2-bec664559d6d tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:04.785865 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-47ebb8de-fd6f-41a0-83b2-bec664559d6d tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:04.786320 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-47ebb8de-fd6f-41a0-83b2-bec664559d6d tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:04.794282 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-47ebb8de-fd6f-41a0-83b2-bec664559d6d tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:04.882600 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.network.neutron [None req-9f26fb03-e455-42f5-817e-ebf14ee370bb tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] [instance: 33a1bb4c-217e-40f9-b67f-d873bea80284] Building network info cache for instance {{(pid=122632) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 10 23:06:05.102326 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=8 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:06:05.108674 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-47ebb8de-fd6f-41a0-83b2-bec664559d6d tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a092c6b8aa444999c32d8be76cabd3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891f4d07d0af47b19c4f43b24ff0b7ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:06:05.135343 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-47ebb8de-fd6f-41a0-83b2-bec664559d6d tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] 10.222.0.58 "GET /compute/v2.1/servers/e864fe19-d87d-49ae-8c95-ffb659b4f618" status: 200 len: 1319 microversion: 2.1 time: 0.362143 Aug 10 23:06:05.136859 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1155/2310] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:06:04 2022] GET /compute/v2.1/servers/e864fe19-d87d-49ae-8c95-ffb659b4f618 => generated 1319 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:06:05.152051 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-14c90dd0-df37-4cdf-90b8-133d173acf49 req-6922d4a3-fb1f-47d1-b4fa-a271552e3c89 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33a1bb4c-217e-40f9-b67f-d873bea80284", "tag": "53ba640c-dbc3-45eb-93db-346c26b4a371"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:06:05.163905 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-14c90dd0-df37-4cdf-90b8-133d173acf49 req-6922d4a3-fb1f-47d1-b4fa-a271552e3c89 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:05.164755 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-14c90dd0-df37-4cdf-90b8-133d173acf49 req-6922d4a3-fb1f-47d1-b4fa-a271552e3c89 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:05.165588 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-14c90dd0-df37-4cdf-90b8-133d173acf49 req-6922d4a3-fb1f-47d1-b4fa-a271552e3c89 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:05.187593 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-14c90dd0-df37-4cdf-90b8-133d173acf49 req-6922d4a3-fb1f-47d1-b4fa-a271552e3c89 service nova] Creating event network-changed:53ba640c-dbc3-45eb-93db-346c26b4a371 for instance 33a1bb4c-217e-40f9-b67f-d873bea80284 on n-h1-850468-14 Aug 10 23:06:05.194086 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-14c90dd0-df37-4cdf-90b8-133d173acf49 req-6922d4a3-fb1f-47d1-b4fa-a271552e3c89 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047116 Aug 10 23:06:05.195417 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1156/2311] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:06:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:06:05.283280 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-e8515b88-6964-4157-89db-8f87eb181e1d tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:05.291056 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-e8515b88-6964-4157-89db-8f87eb181e1d tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] [instance: 662fba38-a52c-464c-8448-bfe0a1d78dab] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:06:05.311575 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e8515b88-6964-4157-89db-8f87eb181e1d tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:05.314822 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e8515b88-6964-4157-89db-8f87eb181e1d tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:05.315526 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e8515b88-6964-4157-89db-8f87eb181e1d tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:05.316484 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e8515b88-6964-4157-89db-8f87eb181e1d tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:05.316957 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e8515b88-6964-4157-89db-8f87eb181e1d tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:05.317388 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e8515b88-6964-4157-89db-8f87eb181e1d tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:05.501201 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-e8515b88-6964-4157-89db-8f87eb181e1d tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8899e278c9453fba0ab05c69b0b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46ac8b84bd649fa88897068dbfa5ce6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:06:05.520097 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-e8515b88-6964-4157-89db-8f87eb181e1d tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] 10.222.0.58 "GET /compute/v2.1/servers/662fba38-a52c-464c-8448-bfe0a1d78dab" status: 200 len: 1515 microversion: 2.1 time: 0.247235 Aug 10 23:06:05.520894 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1157/2312] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:06:05 2022] GET /compute/v2.1/servers/662fba38-a52c-464c-8448-bfe0a1d78dab => generated 1515 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:06:05.702226 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c318000c-2bba-49dc-b86c-1bfd0bcf3dd7 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:05.703358 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-c318000c-2bba-49dc-b86c-1bfd0bcf3dd7 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] [instance: b3b3730c-1396-4ca6-9d9e-8a3104950324] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:06:05.712017 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c318000c-2bba-49dc-b86c-1bfd0bcf3dd7 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:05.712829 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c318000c-2bba-49dc-b86c-1bfd0bcf3dd7 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:05.713767 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c318000c-2bba-49dc-b86c-1bfd0bcf3dd7 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:05.714674 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c318000c-2bba-49dc-b86c-1bfd0bcf3dd7 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:05.715326 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c318000c-2bba-49dc-b86c-1bfd0bcf3dd7 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:05.716067 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c318000c-2bba-49dc-b86c-1bfd0bcf3dd7 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:06.017615 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-c318000c-2bba-49dc-b86c-1bfd0bcf3dd7 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de244f1f82143a0b3d3283c31d80bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14c63df2e6c46d2af23b6b8a52690d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:06:06.028089 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-c318000c-2bba-49dc-b86c-1bfd0bcf3dd7 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] 10.222.0.58 "GET /compute/v2.1/servers/b3b3730c-1396-4ca6-9d9e-8a3104950324" status: 200 len: 1472 microversion: 2.1 time: 0.329898 Aug 10 23:06:06.029519 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1158/2313] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:06:05 2022] GET /compute/v2.1/servers/b3b3730c-1396-4ca6-9d9e-8a3104950324 => generated 1472 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:06:06.041512 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-62e11dc1-a769-4730-bb5b-fea47a46e9b9 req-caa2a571-b16d-46fa-b747-9c318aaa4673 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e864fe19-d87d-49ae-8c95-ffb659b4f618", "name": "network-vif-plugged", "status": "completed", "tag": "180cd3f3-3b1b-4930-b5db-bbdb9cb8bb30"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:06:06.068634 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-62e11dc1-a769-4730-bb5b-fea47a46e9b9 req-caa2a571-b16d-46fa-b747-9c318aaa4673 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:06.069127 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-62e11dc1-a769-4730-bb5b-fea47a46e9b9 req-caa2a571-b16d-46fa-b747-9c318aaa4673 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:06.069568 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-62e11dc1-a769-4730-bb5b-fea47a46e9b9 req-caa2a571-b16d-46fa-b747-9c318aaa4673 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:06.092714 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-62e11dc1-a769-4730-bb5b-fea47a46e9b9 req-caa2a571-b16d-46fa-b747-9c318aaa4673 service nova] Creating event network-vif-plugged:180cd3f3-3b1b-4930-b5db-bbdb9cb8bb30 for instance e864fe19-d87d-49ae-8c95-ffb659b4f618 on n-h2-850468-14 Aug 10 23:06:06.101510 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-62e11dc1-a769-4730-bb5b-fea47a46e9b9 req-caa2a571-b16d-46fa-b747-9c318aaa4673 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070570 Aug 10 23:06:06.102517 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1159/2314] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:06:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:06:06.158825 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-e647e2c5-73a0-4c12-9312-7ab387a1676e tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:06.159823 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-e647e2c5-73a0-4c12-9312-7ab387a1676e tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] [instance: e864fe19-d87d-49ae-8c95-ffb659b4f618] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:06:06.170888 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e647e2c5-73a0-4c12-9312-7ab387a1676e tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:06.171480 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e647e2c5-73a0-4c12-9312-7ab387a1676e tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:06.172128 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e647e2c5-73a0-4c12-9312-7ab387a1676e tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:06.173059 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e647e2c5-73a0-4c12-9312-7ab387a1676e tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:06.173692 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e647e2c5-73a0-4c12-9312-7ab387a1676e tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:06.174450 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e647e2c5-73a0-4c12-9312-7ab387a1676e tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:06.404132 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-e647e2c5-73a0-4c12-9312-7ab387a1676e tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a092c6b8aa444999c32d8be76cabd3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891f4d07d0af47b19c4f43b24ff0b7ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:06:06.413393 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-e647e2c5-73a0-4c12-9312-7ab387a1676e tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] 10.222.0.58 "GET /compute/v2.1/servers/e864fe19-d87d-49ae-8c95-ffb659b4f618" status: 200 len: 1319 microversion: 2.1 time: 0.259711 Aug 10 23:06:06.428530 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1160/2315] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:06:06 2022] GET /compute/v2.1/servers/e864fe19-d87d-49ae-8c95-ffb659b4f618 => generated 1319 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:06:06.551635 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-9ca7c9b0-19a3-4de9-88ba-79cebe5183c2 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:06.553370 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-9ca7c9b0-19a3-4de9-88ba-79cebe5183c2 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] [instance: 662fba38-a52c-464c-8448-bfe0a1d78dab] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:06:06.561343 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.network.neutron [None req-9f26fb03-e455-42f5-817e-ebf14ee370bb tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] [instance: 33a1bb4c-217e-40f9-b67f-d873bea80284] Updating instance_info_cache with network_info: [{"id": "53ba640c-dbc3-45eb-93db-346c26b4a371", "address": "fa:16:3e:29:59:67", "network": {"id": "08b082ca-1914-4b5a-a95f-5a10f05c8ff5", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1871695293-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "13d6f13784504fc7b2fcf0d6957b4920", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap53ba640c-db", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122632) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 10 23:06:06.562169 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9ca7c9b0-19a3-4de9-88ba-79cebe5183c2 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:06.563116 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9ca7c9b0-19a3-4de9-88ba-79cebe5183c2 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:06.564102 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9ca7c9b0-19a3-4de9-88ba-79cebe5183c2 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:06.565097 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9ca7c9b0-19a3-4de9-88ba-79cebe5183c2 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:06.565793 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9ca7c9b0-19a3-4de9-88ba-79cebe5183c2 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:06.566496 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9ca7c9b0-19a3-4de9-88ba-79cebe5183c2 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:06.574824 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9f26fb03-e455-42f5-817e-ebf14ee370bb tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Releasing lock "refresh_cache-33a1bb4c-217e-40f9-b67f-d873bea80284" {{(pid=122632) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 10 23:06:06.575714 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-9f26fb03-e455-42f5-817e-ebf14ee370bb tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] 10.222.0.58 "POST /compute/v2.1/servers/33a1bb4c-217e-40f9-b67f-d873bea80284/action" status: 202 len: 0 microversion: 2.1 time: 4.403637 Aug 10 23:06:06.579408 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1156/2316] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:06:02 2022] POST /compute/v2.1/servers/33a1bb4c-217e-40f9-b67f-d873bea80284/action => generated 0 bytes in 4405 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 10 23:06:06.584490 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-46c0b7c6-011e-4b32-b06d-cb75c5ee5ca5 tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:06.584979 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-46c0b7c6-011e-4b32-b06d-cb75c5ee5ca5 tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] [instance: 33a1bb4c-217e-40f9-b67f-d873bea80284] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:06:06.599886 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-46c0b7c6-011e-4b32-b06d-cb75c5ee5ca5 tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:06.600379 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-46c0b7c6-011e-4b32-b06d-cb75c5ee5ca5 tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:06.600988 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-46c0b7c6-011e-4b32-b06d-cb75c5ee5ca5 tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:06.601871 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-46c0b7c6-011e-4b32-b06d-cb75c5ee5ca5 tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:06.602469 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-46c0b7c6-011e-4b32-b06d-cb75c5ee5ca5 tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:06.603072 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-46c0b7c6-011e-4b32-b06d-cb75c5ee5ca5 tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:06.636560 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-46c0b7c6-011e-4b32-b06d-cb75c5ee5ca5 tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] [instance: 33a1bb4c-217e-40f9-b67f-d873bea80284] Going to try to terminate instance {{(pid=122632) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:06:06.805779 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-46c0b7c6-011e-4b32-b06d-cb75c5ee5ca5 tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] 10.222.0.58 "DELETE /compute/v2.1/servers/33a1bb4c-217e-40f9-b67f-d873bea80284" status: 204 len: 0 microversion: 2.1 time: 0.224876 Aug 10 23:06:06.807272 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1157/2317] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:06:06 2022] DELETE /compute/v2.1/servers/33a1bb4c-217e-40f9-b67f-d873bea80284 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 10 23:06:06.833232 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-179172bc-be50-4188-9e93-8ddb3603778e tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.2.179"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:06:06.834432 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-9ca7c9b0-19a3-4de9-88ba-79cebe5183c2 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8899e278c9453fba0ab05c69b0b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46ac8b84bd649fa88897068dbfa5ce6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:06:06.836897 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-179172bc-be50-4188-9e93-8ddb3603778e tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] [instance: 717a8812-6a48-49ad-baa8-0cf0fb41671d] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:06:06.845501 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-179172bc-be50-4188-9e93-8ddb3603778e tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:06.845766 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-9ca7c9b0-19a3-4de9-88ba-79cebe5183c2 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] 10.222.0.58 "GET /compute/v2.1/servers/662fba38-a52c-464c-8448-bfe0a1d78dab" status: 200 len: 1515 microversion: 2.1 time: 0.306953 Aug 10 23:06:06.846143 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-179172bc-be50-4188-9e93-8ddb3603778e tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:06.846614 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1161/2318] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:06:06 2022] GET /compute/v2.1/servers/662fba38-a52c-464c-8448-bfe0a1d78dab => generated 1515 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:06:06.846766 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-179172bc-be50-4188-9e93-8ddb3603778e tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:06.847583 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-179172bc-be50-4188-9e93-8ddb3603778e tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:06.848128 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-179172bc-be50-4188-9e93-8ddb3603778e tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:06.848816 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-179172bc-be50-4188-9e93-8ddb3603778e tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:06.883421 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-179172bc-be50-4188-9e93-8ddb3603778e tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Acquiring lock "refresh_cache-717a8812-6a48-49ad-baa8-0cf0fb41671d" {{(pid=122632) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 10 23:06:06.883997 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-179172bc-be50-4188-9e93-8ddb3603778e tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Acquired lock "refresh_cache-717a8812-6a48-49ad-baa8-0cf0fb41671d" {{(pid=122632) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 10 23:06:07.055525 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-7c2624f7-4d79-4cb2-a827-bd9434af3839 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:07.056410 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-7c2624f7-4d79-4cb2-a827-bd9434af3839 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] [instance: b3b3730c-1396-4ca6-9d9e-8a3104950324] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:06:07.075468 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7c2624f7-4d79-4cb2-a827-bd9434af3839 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:07.076245 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7c2624f7-4d79-4cb2-a827-bd9434af3839 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:07.076903 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7c2624f7-4d79-4cb2-a827-bd9434af3839 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:07.077823 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7c2624f7-4d79-4cb2-a827-bd9434af3839 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:07.078512 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7c2624f7-4d79-4cb2-a827-bd9434af3839 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:07.079635 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7c2624f7-4d79-4cb2-a827-bd9434af3839 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:07.344559 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-7c2624f7-4d79-4cb2-a827-bd9434af3839 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de244f1f82143a0b3d3283c31d80bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14c63df2e6c46d2af23b6b8a52690d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:06:07.361893 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-7c2624f7-4d79-4cb2-a827-bd9434af3839 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] 10.222.0.58 "GET /compute/v2.1/servers/b3b3730c-1396-4ca6-9d9e-8a3104950324" status: 200 len: 1472 microversion: 2.1 time: 0.310442 Aug 10 23:06:07.363098 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1162/2319] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:06:07 2022] GET /compute/v2.1/servers/b3b3730c-1396-4ca6-9d9e-8a3104950324 => generated 1472 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:06:07.379290 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-f4fdf706-5172-4587-ad20-fcd85a9edfb6 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:06:07.392695 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f4fdf706-5172-4587-ad20-fcd85a9edfb6 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:07.393575 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f4fdf706-5172-4587-ad20-fcd85a9edfb6 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:07.394160 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f4fdf706-5172-4587-ad20-fcd85a9edfb6 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:07.430196 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-f4fdf706-5172-4587-ad20-fcd85a9edfb6 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] [instance: 45beadf1-a6da-49ab-9098-6b681b5184c9] Going to try to stop instance {{(pid=122633) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 10 23:06:07.511428 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-f4fdf706-5172-4587-ad20-fcd85a9edfb6 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] 10.222.0.58 "POST /compute/v2.1/servers/45beadf1-a6da-49ab-9098-6b681b5184c9/action" status: 202 len: 0 microversion: 2.1 time: 0.146732 Aug 10 23:06:07.512549 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1163/2320] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:06:07 2022] POST /compute/v2.1/servers/45beadf1-a6da-49ab-9098-6b681b5184c9/action => generated 0 bytes in 149 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:06:07.519010 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-7c975b5a-ec3d-400e-83b3-b0a69e715894 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:07.525798 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-7c975b5a-ec3d-400e-83b3-b0a69e715894 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] [instance: e864fe19-d87d-49ae-8c95-ffb659b4f618] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:06:07.541128 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7c975b5a-ec3d-400e-83b3-b0a69e715894 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:07.541744 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7c975b5a-ec3d-400e-83b3-b0a69e715894 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:07.542332 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7c975b5a-ec3d-400e-83b3-b0a69e715894 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:07.543648 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7c975b5a-ec3d-400e-83b3-b0a69e715894 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:07.544301 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7c975b5a-ec3d-400e-83b3-b0a69e715894 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:07.545116 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7c975b5a-ec3d-400e-83b3-b0a69e715894 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:07.754129 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-7c975b5a-ec3d-400e-83b3-b0a69e715894 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a092c6b8aa444999c32d8be76cabd3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891f4d07d0af47b19c4f43b24ff0b7ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:06:07.763501 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-7c975b5a-ec3d-400e-83b3-b0a69e715894 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] 10.222.0.58 "GET /compute/v2.1/servers/e864fe19-d87d-49ae-8c95-ffb659b4f618" status: 200 len: 1319 microversion: 2.1 time: 0.249581 Aug 10 23:06:07.764481 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1164/2321] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:06:07 2022] GET /compute/v2.1/servers/e864fe19-d87d-49ae-8c95-ffb659b4f618 => generated 1319 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:06:07.769580 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-413a4c07-d15c-42ac-a101-9faaa32723d4 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:07.770305 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-413a4c07-d15c-42ac-a101-9faaa32723d4 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] [instance: 45beadf1-a6da-49ab-9098-6b681b5184c9] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:06:07.777220 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-413a4c07-d15c-42ac-a101-9faaa32723d4 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:07.777723 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-413a4c07-d15c-42ac-a101-9faaa32723d4 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:07.778168 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-413a4c07-d15c-42ac-a101-9faaa32723d4 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:07.778929 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-413a4c07-d15c-42ac-a101-9faaa32723d4 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:07.779391 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-413a4c07-d15c-42ac-a101-9faaa32723d4 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:07.779819 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-413a4c07-d15c-42ac-a101-9faaa32723d4 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:07.967782 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-413a4c07-d15c-42ac-a101-9faaa32723d4 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1986185dc9b4df4affcc421365462f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597863bfebdc481188f1f30095da5396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:06:07.976940 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-413a4c07-d15c-42ac-a101-9faaa32723d4 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] 10.222.0.58 "GET /compute/v2.1/servers/45beadf1-a6da-49ab-9098-6b681b5184c9" status: 200 len: 1724 microversion: 2.1 time: 0.211152 Aug 10 23:06:07.977876 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1165/2322] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:06:07 2022] GET /compute/v2.1/servers/45beadf1-a6da-49ab-9098-6b681b5184c9 => generated 1724 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:06:07.983395 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-3c26f29e-f7ae-4da4-b914-5e0fa1b97e96 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:07.984014 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-3c26f29e-f7ae-4da4-b914-5e0fa1b97e96 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] [instance: 662fba38-a52c-464c-8448-bfe0a1d78dab] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:06:07.990564 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3c26f29e-f7ae-4da4-b914-5e0fa1b97e96 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:07.991101 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3c26f29e-f7ae-4da4-b914-5e0fa1b97e96 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:07.991544 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3c26f29e-f7ae-4da4-b914-5e0fa1b97e96 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:07.992354 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3c26f29e-f7ae-4da4-b914-5e0fa1b97e96 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:07.992819 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3c26f29e-f7ae-4da4-b914-5e0fa1b97e96 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:07.993249 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3c26f29e-f7ae-4da4-b914-5e0fa1b97e96 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:08.185392 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-3c26f29e-f7ae-4da4-b914-5e0fa1b97e96 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8899e278c9453fba0ab05c69b0b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46ac8b84bd649fa88897068dbfa5ce6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:06:08.193780 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-3c26f29e-f7ae-4da4-b914-5e0fa1b97e96 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] 10.222.0.58 "GET /compute/v2.1/servers/662fba38-a52c-464c-8448-bfe0a1d78dab" status: 200 len: 1515 microversion: 2.1 time: 0.214246 Aug 10 23:06:08.194368 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1166/2323] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:06:07 2022] GET /compute/v2.1/servers/662fba38-a52c-464c-8448-bfe0a1d78dab => generated 1515 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:06:08.383951 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-2a5f0815-39b7-43a1-8e3d-70c8f988d8c3 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:08.384655 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-2a5f0815-39b7-43a1-8e3d-70c8f988d8c3 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] [instance: b3b3730c-1396-4ca6-9d9e-8a3104950324] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:06:08.391733 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2a5f0815-39b7-43a1-8e3d-70c8f988d8c3 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:08.392225 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2a5f0815-39b7-43a1-8e3d-70c8f988d8c3 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:08.392666 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2a5f0815-39b7-43a1-8e3d-70c8f988d8c3 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:08.393564 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2a5f0815-39b7-43a1-8e3d-70c8f988d8c3 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:08.394188 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2a5f0815-39b7-43a1-8e3d-70c8f988d8c3 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:08.394617 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2a5f0815-39b7-43a1-8e3d-70c8f988d8c3 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:08.555940 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-2a5f0815-39b7-43a1-8e3d-70c8f988d8c3 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de244f1f82143a0b3d3283c31d80bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14c63df2e6c46d2af23b6b8a52690d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:06:08.564989 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-2a5f0815-39b7-43a1-8e3d-70c8f988d8c3 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] 10.222.0.58 "GET /compute/v2.1/servers/b3b3730c-1396-4ca6-9d9e-8a3104950324" status: 200 len: 1472 microversion: 2.1 time: 0.185002 Aug 10 23:06:08.579573 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1167/2324] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:06:08 2022] GET /compute/v2.1/servers/b3b3730c-1396-4ca6-9d9e-8a3104950324 => generated 1472 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:06:08.786974 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-334c7ca7-898c-4fc7-b1b6-c3d21e3fcd30 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:08.792469 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-334c7ca7-898c-4fc7-b1b6-c3d21e3fcd30 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] [instance: e864fe19-d87d-49ae-8c95-ffb659b4f618] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:06:08.799906 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-334c7ca7-898c-4fc7-b1b6-c3d21e3fcd30 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:08.800469 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-334c7ca7-898c-4fc7-b1b6-c3d21e3fcd30 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:08.800970 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-334c7ca7-898c-4fc7-b1b6-c3d21e3fcd30 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:08.802055 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-334c7ca7-898c-4fc7-b1b6-c3d21e3fcd30 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:08.802619 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-334c7ca7-898c-4fc7-b1b6-c3d21e3fcd30 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:08.803706 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-334c7ca7-898c-4fc7-b1b6-c3d21e3fcd30 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:09.001736 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-334c7ca7-898c-4fc7-b1b6-c3d21e3fcd30 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a092c6b8aa444999c32d8be76cabd3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891f4d07d0af47b19c4f43b24ff0b7ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:06:09.013670 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-334c7ca7-898c-4fc7-b1b6-c3d21e3fcd30 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] 10.222.0.58 "GET /compute/v2.1/servers/e864fe19-d87d-49ae-8c95-ffb659b4f618" status: 200 len: 1469 microversion: 2.1 time: 0.230900 Aug 10 23:06:09.015910 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1168/2325] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:06:08 2022] GET /compute/v2.1/servers/e864fe19-d87d-49ae-8c95-ffb659b4f618 => generated 1469 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:06:09.023486 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-ea0d9dc8-4ca5-497d-91a6-0c71897d06d0 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:09.030840 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-ea0d9dc8-4ca5-497d-91a6-0c71897d06d0 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] [instance: 45beadf1-a6da-49ab-9098-6b681b5184c9] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:06:09.041264 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ea0d9dc8-4ca5-497d-91a6-0c71897d06d0 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:09.041741 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ea0d9dc8-4ca5-497d-91a6-0c71897d06d0 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:09.042409 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ea0d9dc8-4ca5-497d-91a6-0c71897d06d0 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:09.043838 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ea0d9dc8-4ca5-497d-91a6-0c71897d06d0 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:09.044802 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ea0d9dc8-4ca5-497d-91a6-0c71897d06d0 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:09.045395 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ea0d9dc8-4ca5-497d-91a6-0c71897d06d0 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:09.157684 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.network.neutron [None req-179172bc-be50-4188-9e93-8ddb3603778e tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] [instance: 717a8812-6a48-49ad-baa8-0cf0fb41671d] Building network info cache for instance {{(pid=122632) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 10 23:06:09.238867 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-ea0d9dc8-4ca5-497d-91a6-0c71897d06d0 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1986185dc9b4df4affcc421365462f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597863bfebdc481188f1f30095da5396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:06:09.249996 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-ea0d9dc8-4ca5-497d-91a6-0c71897d06d0 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] 10.222.0.58 "GET /compute/v2.1/servers/45beadf1-a6da-49ab-9098-6b681b5184c9" status: 200 len: 1724 microversion: 2.1 time: 0.232913 Aug 10 23:06:09.250939 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1169/2326] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:06:09 2022] GET /compute/v2.1/servers/45beadf1-a6da-49ab-9098-6b681b5184c9 => generated 1724 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:06:09.256027 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-ede7e965-145a-4a8f-b192-6518cabc440c tempest-LiveMigrationNegativeTest-2132940867 tempest-LiveMigrationNegativeTest-2132940867-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:06:09.256561 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-ede7e965-145a-4a8f-b192-6518cabc440c tempest-LiveMigrationNegativeTest-2132940867 tempest-LiveMigrationNegativeTest-2132940867-project-admin] [instance: e864fe19-d87d-49ae-8c95-ffb659b4f618] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:06:09.264529 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ede7e965-145a-4a8f-b192-6518cabc440c tempest-LiveMigrationNegativeTest-2132940867 tempest-LiveMigrationNegativeTest-2132940867-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:09.265506 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ede7e965-145a-4a8f-b192-6518cabc440c tempest-LiveMigrationNegativeTest-2132940867 tempest-LiveMigrationNegativeTest-2132940867-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:09.266225 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ede7e965-145a-4a8f-b192-6518cabc440c tempest-LiveMigrationNegativeTest-2132940867 tempest-LiveMigrationNegativeTest-2132940867-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:09.267266 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ede7e965-145a-4a8f-b192-6518cabc440c tempest-LiveMigrationNegativeTest-2132940867 tempest-LiveMigrationNegativeTest-2132940867-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:09.267867 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ede7e965-145a-4a8f-b192-6518cabc440c tempest-LiveMigrationNegativeTest-2132940867 tempest-LiveMigrationNegativeTest-2132940867-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:09.268440 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ede7e965-145a-4a8f-b192-6518cabc440c tempest-LiveMigrationNegativeTest-2132940867 tempest-LiveMigrationNegativeTest-2132940867-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:09.308328 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.objects.instance [None req-ede7e965-145a-4a8f-b192-6518cabc440c tempest-LiveMigrationNegativeTest-2132940867 tempest-LiveMigrationNegativeTest-2132940867-project-admin] Lazy-loading 'flavor' on Instance uuid e864fe19-d87d-49ae-8c95-ffb659b4f618 {{(pid=122633) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:06:09.378977 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:06:09.413447 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-ede7e965-145a-4a8f-b192-6518cabc440c tempest-LiveMigrationNegativeTest-2132940867 tempest-LiveMigrationNegativeTest-2132940867-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/e864fe19-d87d-49ae-8c95-ffb659b4f618/action" status: 202 len: 0 microversion: 2.1 time: 0.160266 Aug 10 23:06:09.414356 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1170/2327] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:06:09 2022] POST /compute/v2.1/servers/e864fe19-d87d-49ae-8c95-ffb659b4f618/action => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:06:09.424046 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-24d17a2f-1df7-4d71-af8a-f1f50a2f0247 req-3399bde5-87a6-4e0e-86d3-ff3db663b183 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "717a8812-6a48-49ad-baa8-0cf0fb41671d", "tag": "06ceffef-a360-4b97-8d79-f13f49f62568"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:06:09.438090 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-24d17a2f-1df7-4d71-af8a-f1f50a2f0247 req-3399bde5-87a6-4e0e-86d3-ff3db663b183 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:09.439351 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-24d17a2f-1df7-4d71-af8a-f1f50a2f0247 req-3399bde5-87a6-4e0e-86d3-ff3db663b183 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:09.440378 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-24d17a2f-1df7-4d71-af8a-f1f50a2f0247 req-3399bde5-87a6-4e0e-86d3-ff3db663b183 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:09.458959 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-24d17a2f-1df7-4d71-af8a-f1f50a2f0247 req-3399bde5-87a6-4e0e-86d3-ff3db663b183 service nova] Creating event network-changed:06ceffef-a360-4b97-8d79-f13f49f62568 for instance 717a8812-6a48-49ad-baa8-0cf0fb41671d on n-h1-850468-14 Aug 10 23:06:09.469577 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-24d17a2f-1df7-4d71-af8a-f1f50a2f0247 req-3399bde5-87a6-4e0e-86d3-ff3db663b183 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051610 Aug 10 23:06:09.471793 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1171/2328] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:06:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:06:09.478292 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-56cef895-fce4-49c6-8a56-b9951ffa15e1 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:09.479879 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-56cef895-fce4-49c6-8a56-b9951ffa15e1 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] [instance: 662fba38-a52c-464c-8448-bfe0a1d78dab] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:06:09.488152 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-56cef895-fce4-49c6-8a56-b9951ffa15e1 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:09.489120 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-56cef895-fce4-49c6-8a56-b9951ffa15e1 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:09.489728 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-56cef895-fce4-49c6-8a56-b9951ffa15e1 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:09.490591 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-56cef895-fce4-49c6-8a56-b9951ffa15e1 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:09.491611 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-56cef895-fce4-49c6-8a56-b9951ffa15e1 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:09.492193 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-56cef895-fce4-49c6-8a56-b9951ffa15e1 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:09.789957 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-56cef895-fce4-49c6-8a56-b9951ffa15e1 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8899e278c9453fba0ab05c69b0b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46ac8b84bd649fa88897068dbfa5ce6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:06:09.801261 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-56cef895-fce4-49c6-8a56-b9951ffa15e1 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] 10.222.0.58 "GET /compute/v2.1/servers/662fba38-a52c-464c-8448-bfe0a1d78dab" status: 200 len: 1515 microversion: 2.1 time: 0.327948 Aug 10 23:06:09.802235 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1172/2329] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:06:09 2022] GET /compute/v2.1/servers/662fba38-a52c-464c-8448-bfe0a1d78dab => generated 1515 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:06:09.808116 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-15ef2ed1-9c63-495c-ae31-64585166372a tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:09.808742 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-15ef2ed1-9c63-495c-ae31-64585166372a tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] [instance: e864fe19-d87d-49ae-8c95-ffb659b4f618] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:06:09.828759 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-15ef2ed1-9c63-495c-ae31-64585166372a tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:09.829258 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-15ef2ed1-9c63-495c-ae31-64585166372a tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:09.829699 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-15ef2ed1-9c63-495c-ae31-64585166372a tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:09.830418 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-15ef2ed1-9c63-495c-ae31-64585166372a tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:09.830901 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-15ef2ed1-9c63-495c-ae31-64585166372a tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:09.831328 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-15ef2ed1-9c63-495c-ae31-64585166372a tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:10.093178 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-15ef2ed1-9c63-495c-ae31-64585166372a tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a092c6b8aa444999c32d8be76cabd3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891f4d07d0af47b19c4f43b24ff0b7ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:06:10.102165 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-15ef2ed1-9c63-495c-ae31-64585166372a tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] 10.222.0.58 "GET /compute/v2.1/servers/e864fe19-d87d-49ae-8c95-ffb659b4f618" status: 200 len: 1477 microversion: 2.1 time: 0.298453 Aug 10 23:06:10.104118 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1173/2330] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:06:09 2022] GET /compute/v2.1/servers/e864fe19-d87d-49ae-8c95-ffb659b4f618 => generated 1477 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:06:10.109365 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-fb2c19d3-be4c-434b-ad51-1698b2860dc3 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:10.110134 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-fb2c19d3-be4c-434b-ad51-1698b2860dc3 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] [instance: b3b3730c-1396-4ca6-9d9e-8a3104950324] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:06:10.116400 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fb2c19d3-be4c-434b-ad51-1698b2860dc3 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:10.117105 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fb2c19d3-be4c-434b-ad51-1698b2860dc3 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:10.117547 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fb2c19d3-be4c-434b-ad51-1698b2860dc3 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:10.118259 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fb2c19d3-be4c-434b-ad51-1698b2860dc3 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:10.118742 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fb2c19d3-be4c-434b-ad51-1698b2860dc3 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:10.119266 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fb2c19d3-be4c-434b-ad51-1698b2860dc3 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:10.332626 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-fb2c19d3-be4c-434b-ad51-1698b2860dc3 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de244f1f82143a0b3d3283c31d80bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14c63df2e6c46d2af23b6b8a52690d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:06:10.341784 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-fb2c19d3-be4c-434b-ad51-1698b2860dc3 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] 10.222.0.58 "GET /compute/v2.1/servers/b3b3730c-1396-4ca6-9d9e-8a3104950324" status: 200 len: 1472 microversion: 2.1 time: 0.236368 Aug 10 23:06:10.342384 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1174/2331] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:06:10 2022] GET /compute/v2.1/servers/b3b3730c-1396-4ca6-9d9e-8a3104950324 => generated 1472 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:06:10.349374 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-15e39544-6087-4cc4-8138-9af50fd90289 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:10.350019 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-15e39544-6087-4cc4-8138-9af50fd90289 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] [instance: 45beadf1-a6da-49ab-9098-6b681b5184c9] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:06:10.366048 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-15e39544-6087-4cc4-8138-9af50fd90289 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:10.366550 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-15e39544-6087-4cc4-8138-9af50fd90289 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:10.367520 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-15e39544-6087-4cc4-8138-9af50fd90289 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:10.368420 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-15e39544-6087-4cc4-8138-9af50fd90289 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:10.370620 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-15e39544-6087-4cc4-8138-9af50fd90289 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:10.371535 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-15e39544-6087-4cc4-8138-9af50fd90289 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:10.596345 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-15e39544-6087-4cc4-8138-9af50fd90289 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1986185dc9b4df4affcc421365462f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597863bfebdc481188f1f30095da5396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:06:10.611583 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-15e39544-6087-4cc4-8138-9af50fd90289 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] 10.222.0.58 "GET /compute/v2.1/servers/45beadf1-a6da-49ab-9098-6b681b5184c9" status: 200 len: 1724 microversion: 2.1 time: 0.268042 Aug 10 23:06:10.618880 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1175/2332] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:06:10 2022] GET /compute/v2.1/servers/45beadf1-a6da-49ab-9098-6b681b5184c9 => generated 1724 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:06:10.828297 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-206eedd4-c53f-4b4e-bed7-9d2c083df9e1 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:10.830136 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-206eedd4-c53f-4b4e-bed7-9d2c083df9e1 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] [instance: 662fba38-a52c-464c-8448-bfe0a1d78dab] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:06:10.837128 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-206eedd4-c53f-4b4e-bed7-9d2c083df9e1 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:10.837692 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-206eedd4-c53f-4b4e-bed7-9d2c083df9e1 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:10.838449 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-206eedd4-c53f-4b4e-bed7-9d2c083df9e1 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:10.839354 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-206eedd4-c53f-4b4e-bed7-9d2c083df9e1 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:10.839811 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-206eedd4-c53f-4b4e-bed7-9d2c083df9e1 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:10.840229 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-206eedd4-c53f-4b4e-bed7-9d2c083df9e1 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:11.000823 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-206eedd4-c53f-4b4e-bed7-9d2c083df9e1 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8899e278c9453fba0ab05c69b0b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46ac8b84bd649fa88897068dbfa5ce6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:06:11.028806 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-206eedd4-c53f-4b4e-bed7-9d2c083df9e1 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] 10.222.0.58 "GET /compute/v2.1/servers/662fba38-a52c-464c-8448-bfe0a1d78dab" status: 200 len: 1515 microversion: 2.1 time: 0.204289 Aug 10 23:06:11.029415 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1176/2333] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:06:10 2022] GET /compute/v2.1/servers/662fba38-a52c-464c-8448-bfe0a1d78dab => generated 1515 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:06:11.045231 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.network.neutron [None req-179172bc-be50-4188-9e93-8ddb3603778e tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] [instance: 717a8812-6a48-49ad-baa8-0cf0fb41671d] Updating instance_info_cache with network_info: [{"id": "06ceffef-a360-4b97-8d79-f13f49f62568", "address": "fa:16:3e:58:43:a0", "network": {"id": "08b082ca-1914-4b5a-a95f-5a10f05c8ff5", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1871695293-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.2.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "13d6f13784504fc7b2fcf0d6957b4920", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap06ceffef-a3", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122632) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 10 23:06:11.061019 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-179172bc-be50-4188-9e93-8ddb3603778e tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Releasing lock "refresh_cache-717a8812-6a48-49ad-baa8-0cf0fb41671d" {{(pid=122632) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 10 23:06:11.062452 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-179172bc-be50-4188-9e93-8ddb3603778e tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] 10.222.0.58 "POST /compute/v2.1/servers/717a8812-6a48-49ad-baa8-0cf0fb41671d/action" status: 202 len: 0 microversion: 2.1 time: 4.249159 Aug 10 23:06:11.064628 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1158/2334] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:06:06 2022] POST /compute/v2.1/servers/717a8812-6a48-49ad-baa8-0cf0fb41671d/action => generated 0 bytes in 4252 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 10 23:06:11.073821 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-dc431ad0-4cf8-401c-869a-e2c57e52e35a tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Calling method '.version_select at 0x7f847d32d790>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:11.129473 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-df068ae4-381b-4fda-8b15-7ee86bb08d16 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:11.130554 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-df068ae4-381b-4fda-8b15-7ee86bb08d16 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] [instance: e864fe19-d87d-49ae-8c95-ffb659b4f618] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:06:11.140793 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-df068ae4-381b-4fda-8b15-7ee86bb08d16 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:11.141743 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-df068ae4-381b-4fda-8b15-7ee86bb08d16 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:11.143521 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-df068ae4-381b-4fda-8b15-7ee86bb08d16 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:11.145161 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-df068ae4-381b-4fda-8b15-7ee86bb08d16 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:11.145861 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-df068ae4-381b-4fda-8b15-7ee86bb08d16 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:11.146535 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-df068ae4-381b-4fda-8b15-7ee86bb08d16 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:11.372017 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-dc431ad0-4cf8-401c-869a-e2c57e52e35a tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] 10.222.0.58 "GET /compute/v2.1/os-floating-ips/fd905614-3779-4dcc-a4da-a9a0e17bb169" status: 200 len: 185 microversion: 2.1 time: 0.302858 Aug 10 23:06:11.372743 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1177/2335] 10.222.0.58 () {58 vars in 1260 bytes} [Wed Aug 10 23:06:11 2022] GET /compute/v2.1/os-floating-ips/fd905614-3779-4dcc-a4da-a9a0e17bb169 => generated 185 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:06:11.378854 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c79da6eb-33f2-4cd3-a64d-ed4ef5695a5c tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:11.380049 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-c79da6eb-33f2-4cd3-a64d-ed4ef5695a5c tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] [instance: b3b3730c-1396-4ca6-9d9e-8a3104950324] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:06:11.388276 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c79da6eb-33f2-4cd3-a64d-ed4ef5695a5c tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:11.389067 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c79da6eb-33f2-4cd3-a64d-ed4ef5695a5c tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:11.390193 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c79da6eb-33f2-4cd3-a64d-ed4ef5695a5c tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:11.391191 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c79da6eb-33f2-4cd3-a64d-ed4ef5695a5c tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:11.391730 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c79da6eb-33f2-4cd3-a64d-ed4ef5695a5c tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:11.392202 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c79da6eb-33f2-4cd3-a64d-ed4ef5695a5c tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:11.436821 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-df068ae4-381b-4fda-8b15-7ee86bb08d16 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a092c6b8aa444999c32d8be76cabd3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891f4d07d0af47b19c4f43b24ff0b7ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:06:11.441827 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=7,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=4,nova_cell1:RELEASE=4 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:06:11.447691 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-df068ae4-381b-4fda-8b15-7ee86bb08d16 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] 10.222.0.58 "GET /compute/v2.1/servers/e864fe19-d87d-49ae-8c95-ffb659b4f618" status: 200 len: 1460 microversion: 2.1 time: 0.323179 Aug 10 23:06:11.448659 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1159/2336] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:06:11 2022] GET /compute/v2.1/servers/e864fe19-d87d-49ae-8c95-ffb659b4f618 => generated 1460 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:06:11.454936 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c47e6071-b828-4653-8973-ca1769752dec tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.2.179"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:06:11.658929 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-c47e6071-b828-4653-8973-ca1769752dec tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] [instance: 717a8812-6a48-49ad-baa8-0cf0fb41671d] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:06:11.661158 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-c79da6eb-33f2-4cd3-a64d-ed4ef5695a5c tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de244f1f82143a0b3d3283c31d80bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14c63df2e6c46d2af23b6b8a52690d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:06:11.666638 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c47e6071-b828-4653-8973-ca1769752dec tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:11.667859 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c47e6071-b828-4653-8973-ca1769752dec tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:11.668302 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c47e6071-b828-4653-8973-ca1769752dec tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:11.671141 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c47e6071-b828-4653-8973-ca1769752dec tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:11.672228 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-c79da6eb-33f2-4cd3-a64d-ed4ef5695a5c tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] 10.222.0.58 "GET /compute/v2.1/servers/b3b3730c-1396-4ca6-9d9e-8a3104950324" status: 200 len: 1472 microversion: 2.1 time: 0.298096 Aug 10 23:06:11.672527 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c47e6071-b828-4653-8973-ca1769752dec tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:11.673294 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c47e6071-b828-4653-8973-ca1769752dec tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:11.676409 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1178/2337] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:06:11 2022] GET /compute/v2.1/servers/b3b3730c-1396-4ca6-9d9e-8a3104950324 => generated 1472 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:06:11.684160 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-246c9d0c-e1e9-4c79-88be-19375070f07d tempest-LiveMigrationNegativeTest-2132940867 tempest-LiveMigrationNegativeTest-2132940867-project-admin] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:11.684773 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-246c9d0c-e1e9-4c79-88be-19375070f07d tempest-LiveMigrationNegativeTest-2132940867 tempest-LiveMigrationNegativeTest-2132940867-project-admin] [instance: e864fe19-d87d-49ae-8c95-ffb659b4f618] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:06:11.699319 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-246c9d0c-e1e9-4c79-88be-19375070f07d tempest-LiveMigrationNegativeTest-2132940867 tempest-LiveMigrationNegativeTest-2132940867-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:11.699924 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-246c9d0c-e1e9-4c79-88be-19375070f07d tempest-LiveMigrationNegativeTest-2132940867 tempest-LiveMigrationNegativeTest-2132940867-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:11.700367 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-246c9d0c-e1e9-4c79-88be-19375070f07d tempest-LiveMigrationNegativeTest-2132940867 tempest-LiveMigrationNegativeTest-2132940867-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:11.701079 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-246c9d0c-e1e9-4c79-88be-19375070f07d tempest-LiveMigrationNegativeTest-2132940867 tempest-LiveMigrationNegativeTest-2132940867-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:11.701536 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-246c9d0c-e1e9-4c79-88be-19375070f07d tempest-LiveMigrationNegativeTest-2132940867 tempest-LiveMigrationNegativeTest-2132940867-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:11.701962 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-246c9d0c-e1e9-4c79-88be-19375070f07d tempest-LiveMigrationNegativeTest-2132940867 tempest-LiveMigrationNegativeTest-2132940867-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:11.928312 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c47e6071-b828-4653-8973-ca1769752dec tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Acquiring lock "refresh_cache-717a8812-6a48-49ad-baa8-0cf0fb41671d" {{(pid=122632) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 10 23:06:11.929364 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c47e6071-b828-4653-8973-ca1769752dec tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Acquired lock "refresh_cache-717a8812-6a48-49ad-baa8-0cf0fb41671d" {{(pid=122632) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 10 23:06:12.114617 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-246c9d0c-e1e9-4c79-88be-19375070f07d tempest-LiveMigrationNegativeTest-2132940867 tempest-LiveMigrationNegativeTest-2132940867-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/e864fe19-d87d-49ae-8c95-ffb659b4f618" status: 200 len: 1613 microversion: 2.1 time: 0.436854 Aug 10 23:06:12.115882 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1179/2338] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:06:11 2022] GET /compute/v2.1/servers/e864fe19-d87d-49ae-8c95-ffb659b4f618 => generated 1613 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:06:12.121072 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-ed5e9a33-86e9-4952-b870-a8367b3bd250 req-1aaeda8c-d7bd-4c6a-9bf2-4003d95205bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33a1bb4c-217e-40f9-b67f-d873bea80284", "name": "network-vif-deleted", "tag": "53ba640c-dbc3-45eb-93db-346c26b4a371"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:06:12.141469 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-ed5e9a33-86e9-4952-b870-a8367b3bd250 req-1aaeda8c-d7bd-4c6a-9bf2-4003d95205bc service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:12.142698 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-ed5e9a33-86e9-4952-b870-a8367b3bd250 req-1aaeda8c-d7bd-4c6a-9bf2-4003d95205bc service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:12.151503 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-ed5e9a33-86e9-4952-b870-a8367b3bd250 req-1aaeda8c-d7bd-4c6a-9bf2-4003d95205bc service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:12.174375 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-ed5e9a33-86e9-4952-b870-a8367b3bd250 req-1aaeda8c-d7bd-4c6a-9bf2-4003d95205bc service nova] Creating event network-vif-deleted:53ba640c-dbc3-45eb-93db-346c26b4a371 for instance 33a1bb4c-217e-40f9-b67f-d873bea80284 on n-h1-850468-14 Aug 10 23:06:12.182318 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-ed5e9a33-86e9-4952-b870-a8367b3bd250 req-1aaeda8c-d7bd-4c6a-9bf2-4003d95205bc service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064728 Aug 10 23:06:12.185306 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1180/2339] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:06:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:06:12.191299 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-ab9912d0-6904-4d91-ba70-f7e565ac5143 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:12.192353 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-ab9912d0-6904-4d91-ba70-f7e565ac5143 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] [instance: 45beadf1-a6da-49ab-9098-6b681b5184c9] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:06:12.199042 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ab9912d0-6904-4d91-ba70-f7e565ac5143 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:12.199789 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ab9912d0-6904-4d91-ba70-f7e565ac5143 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:12.200394 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ab9912d0-6904-4d91-ba70-f7e565ac5143 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:12.201533 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ab9912d0-6904-4d91-ba70-f7e565ac5143 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:12.202218 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ab9912d0-6904-4d91-ba70-f7e565ac5143 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:12.202819 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ab9912d0-6904-4d91-ba70-f7e565ac5143 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:12.597795 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-ab9912d0-6904-4d91-ba70-f7e565ac5143 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1986185dc9b4df4affcc421365462f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597863bfebdc481188f1f30095da5396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:06:12.613707 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-ab9912d0-6904-4d91-ba70-f7e565ac5143 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] 10.222.0.58 "GET /compute/v2.1/servers/45beadf1-a6da-49ab-9098-6b681b5184c9" status: 200 len: 1724 microversion: 2.1 time: 0.425919 Aug 10 23:06:12.616906 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1181/2340] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:06:12 2022] GET /compute/v2.1/servers/45beadf1-a6da-49ab-9098-6b681b5184c9 => generated 1724 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:06:12.626856 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-93a71a77-aa57-4d1e-91ca-a8d60faf3a26 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:12.628718 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-93a71a77-aa57-4d1e-91ca-a8d60faf3a26 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] [instance: 662fba38-a52c-464c-8448-bfe0a1d78dab] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:06:12.643360 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-93a71a77-aa57-4d1e-91ca-a8d60faf3a26 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:12.644148 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-93a71a77-aa57-4d1e-91ca-a8d60faf3a26 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:12.644427 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-93a71a77-aa57-4d1e-91ca-a8d60faf3a26 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:12.645346 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-93a71a77-aa57-4d1e-91ca-a8d60faf3a26 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:12.645620 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-93a71a77-aa57-4d1e-91ca-a8d60faf3a26 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:12.646893 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-93a71a77-aa57-4d1e-91ca-a8d60faf3a26 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:12.898065 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.network.neutron [None req-c47e6071-b828-4653-8973-ca1769752dec tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] [instance: 717a8812-6a48-49ad-baa8-0cf0fb41671d] Building network info cache for instance {{(pid=122632) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 10 23:06:13.302040 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-93a71a77-aa57-4d1e-91ca-a8d60faf3a26 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8899e278c9453fba0ab05c69b0b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46ac8b84bd649fa88897068dbfa5ce6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:06:13.320536 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-93a71a77-aa57-4d1e-91ca-a8d60faf3a26 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] 10.222.0.58 "GET /compute/v2.1/servers/662fba38-a52c-464c-8448-bfe0a1d78dab" status: 200 len: 1515 microversion: 2.1 time: 0.702396 Aug 10 23:06:13.321783 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1182/2341] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:06:12 2022] GET /compute/v2.1/servers/662fba38-a52c-464c-8448-bfe0a1d78dab => generated 1515 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:06:13.332022 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-b8c1ae7d-8f95-4f43-83b1-cb32e304dd81 tempest-LiveMigrationNegativeTest-2132940867 tempest-LiveMigrationNegativeTest-2132940867-project-admin] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:13.345775 n-d-850468-14 devstack@n-api.service[122633]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 23:06:13.345775 n-d-850468-14 devstack@n-api.service[122633]: warnings.warn(msg) Aug 10 23:06:13.348776 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b8c1ae7d-8f95-4f43-83b1-cb32e304dd81 tempest-LiveMigrationNegativeTest-2132940867 tempest-LiveMigrationNegativeTest-2132940867-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:13.350086 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b8c1ae7d-8f95-4f43-83b1-cb32e304dd81 tempest-LiveMigrationNegativeTest-2132940867 tempest-LiveMigrationNegativeTest-2132940867-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:13.350536 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b8c1ae7d-8f95-4f43-83b1-cb32e304dd81 tempest-LiveMigrationNegativeTest-2132940867 tempest-LiveMigrationNegativeTest-2132940867-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:13.352121 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b8c1ae7d-8f95-4f43-83b1-cb32e304dd81 tempest-LiveMigrationNegativeTest-2132940867 tempest-LiveMigrationNegativeTest-2132940867-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:13.352644 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b8c1ae7d-8f95-4f43-83b1-cb32e304dd81 tempest-LiveMigrationNegativeTest-2132940867 tempest-LiveMigrationNegativeTest-2132940867-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:13.353082 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b8c1ae7d-8f95-4f43-83b1-cb32e304dd81 tempest-LiveMigrationNegativeTest-2132940867 tempest-LiveMigrationNegativeTest-2132940867-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:13.419964 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-b8c1ae7d-8f95-4f43-83b1-cb32e304dd81 tempest-LiveMigrationNegativeTest-2132940867 tempest-LiveMigrationNegativeTest-2132940867-project-admin] 10.222.0.58 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.095642 Aug 10 23:06:13.428478 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1183/2342] 10.222.0.58 () {58 vars in 1176 bytes} [Wed Aug 10 23:06:13 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:06:13.437899 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-cce63e09-9f6c-4455-a011-f98c36bb22ce tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:13.441056 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-cce63e09-9f6c-4455-a011-f98c36bb22ce tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] [instance: b3b3730c-1396-4ca6-9d9e-8a3104950324] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:06:13.485320 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cce63e09-9f6c-4455-a011-f98c36bb22ce tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:13.485817 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cce63e09-9f6c-4455-a011-f98c36bb22ce tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:13.486251 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cce63e09-9f6c-4455-a011-f98c36bb22ce tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:13.487561 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cce63e09-9f6c-4455-a011-f98c36bb22ce tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:13.488177 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cce63e09-9f6c-4455-a011-f98c36bb22ce tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:13.488737 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cce63e09-9f6c-4455-a011-f98c36bb22ce tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:14.128923 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-cce63e09-9f6c-4455-a011-f98c36bb22ce tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de244f1f82143a0b3d3283c31d80bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14c63df2e6c46d2af23b6b8a52690d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:06:14.142153 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-cce63e09-9f6c-4455-a011-f98c36bb22ce tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] 10.222.0.58 "GET /compute/v2.1/servers/b3b3730c-1396-4ca6-9d9e-8a3104950324" status: 200 len: 1472 microversion: 2.1 time: 0.712054 Aug 10 23:06:14.143022 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1184/2343] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:06:13 2022] GET /compute/v2.1/servers/b3b3730c-1396-4ca6-9d9e-8a3104950324 => generated 1472 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:06:14.164516 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-9452f90d-ff28-4d36-9579-a0547c19aa5e tempest-LiveMigrationNegativeTest-2132940867 tempest-LiveMigrationNegativeTest-2132940867-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-850468-14", "block_migration": true, "disk_over_commit": false}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:06:14.168335 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-9452f90d-ff28-4d36-9579-a0547c19aa5e tempest-LiveMigrationNegativeTest-2132940867 tempest-LiveMigrationNegativeTest-2132940867-project-admin] [instance: e864fe19-d87d-49ae-8c95-ffb659b4f618] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:06:14.172021 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_api:SELECT=100 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:06:14.176347 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9452f90d-ff28-4d36-9579-a0547c19aa5e tempest-LiveMigrationNegativeTest-2132940867 tempest-LiveMigrationNegativeTest-2132940867-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:14.177089 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9452f90d-ff28-4d36-9579-a0547c19aa5e tempest-LiveMigrationNegativeTest-2132940867 tempest-LiveMigrationNegativeTest-2132940867-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:14.177521 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9452f90d-ff28-4d36-9579-a0547c19aa5e tempest-LiveMigrationNegativeTest-2132940867 tempest-LiveMigrationNegativeTest-2132940867-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:14.178395 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9452f90d-ff28-4d36-9579-a0547c19aa5e tempest-LiveMigrationNegativeTest-2132940867 tempest-LiveMigrationNegativeTest-2132940867-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:14.185810 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9452f90d-ff28-4d36-9579-a0547c19aa5e tempest-LiveMigrationNegativeTest-2132940867 tempest-LiveMigrationNegativeTest-2132940867-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:14.186509 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9452f90d-ff28-4d36-9579-a0547c19aa5e tempest-LiveMigrationNegativeTest-2132940867 tempest-LiveMigrationNegativeTest-2132940867-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:14.228206 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.objects.instance [None req-9452f90d-ff28-4d36-9579-a0547c19aa5e tempest-LiveMigrationNegativeTest-2132940867 tempest-LiveMigrationNegativeTest-2132940867-project-admin] Lazy-loading 'flavor' on Instance uuid e864fe19-d87d-49ae-8c95-ffb659b4f618 {{(pid=122633) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:06:14.248886 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-9452f90d-ff28-4d36-9579-a0547c19aa5e tempest-LiveMigrationNegativeTest-2132940867 tempest-LiveMigrationNegativeTest-2132940867-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance e864fe19-d87d-49ae-8c95-ffb659b4f618 while it is in vm_state suspended Aug 10 23:06:14.255145 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-9452f90d-ff28-4d36-9579-a0547c19aa5e tempest-LiveMigrationNegativeTest-2132940867 tempest-LiveMigrationNegativeTest-2132940867-project-admin] Request method failure captured: Aug 10 23:06:14.255145 n-d-850468-14 devstack@n-api.service[122633]: request: POST /compute/v2.1/servers/e864fe19-d87d-49ae-8c95-ffb659b4f618/action HTTP/1.1 Aug 10 23:06:14.255145 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:06:14.255145 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:06:14.255145 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:06:14.255145 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 98 Aug 10 23:06:14.255145 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:06:14.255145 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:06:14.255145 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:06:14.255145 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:06:14.255145 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9Dm5FKBKJID3xROT4n0rQzLfgeqWeILALWmtUWZA3aSNUsXyBOb9mt5CpbjKcAn2yRi-Dq8pk5mh__v-SgJLHsbaEUlKltNkp_mI5FTO4I2LYaLVqxWnxOygF6Pd73udCnca4cx7sIgOnbxCR5Wm0i0vrz_poq4hs3wRIB348QFRYTk Aug 10 23:06:14.255145 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:06:14.255145 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:06:14.255145 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:06:14.255145 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:06:14.255145 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:06:14.255145 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:06:14.255145 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: fc05b457e6ef4583b8c019fea06e4d4d Aug 10 23:06:14.255145 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-LiveMigrationNegativeTest-2132940867 Aug 10 23:06:14.255145 n-d-850468-14 devstack@n-api.service[122633]: X-Role: admin,member,reader Aug 10 23:06:14.255145 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: admin,member,reader Aug 10 23:06:14.256804 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fc05b457e6ef4583b8c019fea06e4d4d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/fc05b457e6ef4583b8c019fea06e4d4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/fc05b457e6ef4583b8c019fea06e4d4d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_fc05b457e6ef4583b8c019fea06e4d4d", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:06:14.256804 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-LiveMigrationNegativeTest-2132940867 Aug 10 23:06:14.256804 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: fc05b457e6ef4583b8c019fea06e4d4d Aug 10 23:06:14.256804 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-2132940867 Aug 10 23:06:14.256804 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-LiveMigrationNegativeTest-2132940867-project-admin Aug 10 23:06:14.256804 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:06:14.256804 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:06:14.256804 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: d59ddc69c9104e0fb6216d3be85d1023 Aug 10 23:06:14.256804 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-LiveMigrationNegativeTest-2132940867-project-admin Aug 10 23:06:14.256804 n-d-850468-14 devstack@n-api.service[122633]: Aug 10 23:06:14.256804 n-d-850468-14 devstack@n-api.service[122633]: {"os-migrateLive": {"host": "n-h1-850468-14", "block_migration": true, "disk_over_commit": false}} Aug 10 23:06:14.256804 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:06:14.258004 n-d-850468-14 devstack@n-api.service[122633]: exception: Cannot 'os-migrateLive' instance e864fe19-d87d-49ae-8c95-ffb659b4f618 while it is in vm_state suspended Aug 10 23:06:14.258004 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': 'e864fe19-d87d-49ae-8c95-ffb659b4f618', 'body': {'os-migrateLive': {'host': 'n-h1-850468-14', 'block_migration': True, 'disk_over_commit': False}}} Aug 10 23:06:14.258004 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:06:14.258004 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:06:14.258004 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Aug 10 23:06:14.258004 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Aug 10 23:06:14.258004 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Aug 10 23:06:14.258004 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 10 23:06:14.258004 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Aug 10 23:06:14.258004 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 10 23:06:14.258004 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Aug 10 23:06:14.258004 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 10 23:06:14.258004 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Aug 10 23:06:14.258004 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 10 23:06:14.258004 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Aug 10 23:06:14.258004 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 10 23:06:14.258004 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner Aug 10 23:06:14.258004 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 10 23:06:14.259986 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 10 23:06:14.259986 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 10 23:06:14.259986 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 10 23:06:14.259986 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 10 23:06:14.259986 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e864fe19-d87d-49ae-8c95-ffb659b4f618 in vm_state suspended. Cannot live_migrate while the instance is in this state. Aug 10 23:06:14.259986 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:06:14.259986 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:06:14.259986 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:06:14.259986 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:06:14.259986 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:06:14.259986 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:06:14.259986 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:06:14.259986 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:06:14.259986 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:06:14.259986 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:06:14.259986 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 23:06:14.259986 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 23:06:14.259986 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 23:06:14.259986 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 23:06:14.259986 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 23:06:14.261509 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 23:06:14.261509 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 10 23:06:14.261509 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Aug 10 23:06:14.261509 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 10 23:06:14.261509 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 10 23:06:14.261509 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 10 23:06:14.261509 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance e864fe19-d87d-49ae-8c95-ffb659b4f618 while it is in vm_state suspended Aug 10 23:06:14.261509 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:06:14.261509 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:06:14.261509 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:06:14.261509 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:06:14.261509 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:06:14.261509 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:06:14.261509 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:06:14.261509 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:06:14.261509 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance e864fe19-d87d-49ae-8c95-ffb659b4f618 while it is in vm_state suspended Aug 10 23:06:14.261509 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:06:14.264702 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-9452f90d-ff28-4d36-9579-a0547c19aa5e tempest-LiveMigrationNegativeTest-2132940867 tempest-LiveMigrationNegativeTest-2132940867-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance e864fe19-d87d-49ae-8c95-ffb659b4f618 while it is in vm_state suspended {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:06:14.266102 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-9452f90d-ff28-4d36-9579-a0547c19aa5e tempest-LiveMigrationNegativeTest-2132940867 tempest-LiveMigrationNegativeTest-2132940867-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/e864fe19-d87d-49ae-8c95-ffb659b4f618/action" status: 409 len: 155 microversion: 2.1 time: 0.121943 Aug 10 23:06:14.266724 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1185/2344] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:06:14 2022] POST /compute/v2.1/servers/e864fe19-d87d-49ae-8c95-ffb659b4f618/action => generated 155 bytes in 123 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 10 23:06:14.271543 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-17c4caed-7613-4348-91ee-cb2ed7a83e0c tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:14.272162 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-17c4caed-7613-4348-91ee-cb2ed7a83e0c tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] [instance: 45beadf1-a6da-49ab-9098-6b681b5184c9] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:06:14.273338 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.network.neutron [None req-c47e6071-b828-4653-8973-ca1769752dec tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] [instance: 717a8812-6a48-49ad-baa8-0cf0fb41671d] Updating instance_info_cache with network_info: [{"id": "06ceffef-a360-4b97-8d79-f13f49f62568", "address": "fa:16:3e:58:43:a0", "network": {"id": "08b082ca-1914-4b5a-a95f-5a10f05c8ff5", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1871695293-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "13d6f13784504fc7b2fcf0d6957b4920", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap06ceffef-a3", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122632) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 10 23:06:14.280742 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-17c4caed-7613-4348-91ee-cb2ed7a83e0c tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:14.281251 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-17c4caed-7613-4348-91ee-cb2ed7a83e0c tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:14.281708 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-17c4caed-7613-4348-91ee-cb2ed7a83e0c tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:14.282449 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-17c4caed-7613-4348-91ee-cb2ed7a83e0c tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:14.283059 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-17c4caed-7613-4348-91ee-cb2ed7a83e0c tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:14.283545 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-17c4caed-7613-4348-91ee-cb2ed7a83e0c tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:14.301610 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c47e6071-b828-4653-8973-ca1769752dec tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Releasing lock "refresh_cache-717a8812-6a48-49ad-baa8-0cf0fb41671d" {{(pid=122632) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 10 23:06:14.307582 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-c47e6071-b828-4653-8973-ca1769752dec tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] 10.222.0.58 "POST /compute/v2.1/servers/717a8812-6a48-49ad-baa8-0cf0fb41671d/action" status: 202 len: 0 microversion: 2.1 time: 2.854305 Aug 10 23:06:14.313665 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1160/2345] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:06:11 2022] POST /compute/v2.1/servers/717a8812-6a48-49ad-baa8-0cf0fb41671d/action => generated 0 bytes in 2862 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 10 23:06:14.320841 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-5a70bd8e-e4ba-46e9-b2cd-f67228b69feb req-fe8e2d85-88a5-4be2-aa53-19afb6ebc3d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "717a8812-6a48-49ad-baa8-0cf0fb41671d", "tag": "06ceffef-a360-4b97-8d79-f13f49f62568"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:06:14.345440 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-5a70bd8e-e4ba-46e9-b2cd-f67228b69feb req-fe8e2d85-88a5-4be2-aa53-19afb6ebc3d4 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:14.345843 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-5a70bd8e-e4ba-46e9-b2cd-f67228b69feb req-fe8e2d85-88a5-4be2-aa53-19afb6ebc3d4 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:14.346267 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-5a70bd8e-e4ba-46e9-b2cd-f67228b69feb req-fe8e2d85-88a5-4be2-aa53-19afb6ebc3d4 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:14.358457 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-5a70bd8e-e4ba-46e9-b2cd-f67228b69feb req-fe8e2d85-88a5-4be2-aa53-19afb6ebc3d4 service nova] Creating event network-changed:06ceffef-a360-4b97-8d79-f13f49f62568 for instance 717a8812-6a48-49ad-baa8-0cf0fb41671d on n-h1-850468-14 Aug 10 23:06:14.364324 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-5a70bd8e-e4ba-46e9-b2cd-f67228b69feb req-fe8e2d85-88a5-4be2-aa53-19afb6ebc3d4 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051260 Aug 10 23:06:14.365854 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1161/2346] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:06:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:06:14.374367 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-f0697326-d5a2-478f-83fa-86e6d9e62d16 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:14.375155 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-f0697326-d5a2-478f-83fa-86e6d9e62d16 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] [instance: e864fe19-d87d-49ae-8c95-ffb659b4f618] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:06:14.383739 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f0697326-d5a2-478f-83fa-86e6d9e62d16 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:14.384248 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f0697326-d5a2-478f-83fa-86e6d9e62d16 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:14.384811 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f0697326-d5a2-478f-83fa-86e6d9e62d16 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:14.385542 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f0697326-d5a2-478f-83fa-86e6d9e62d16 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:14.386047 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f0697326-d5a2-478f-83fa-86e6d9e62d16 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:14.386483 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f0697326-d5a2-478f-83fa-86e6d9e62d16 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:14.428480 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-f0697326-d5a2-478f-83fa-86e6d9e62d16 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] [instance: e864fe19-d87d-49ae-8c95-ffb659b4f618] Going to try to terminate instance {{(pid=122632) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:06:14.591399 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-17c4caed-7613-4348-91ee-cb2ed7a83e0c tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1986185dc9b4df4affcc421365462f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597863bfebdc481188f1f30095da5396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:06:14.601789 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-17c4caed-7613-4348-91ee-cb2ed7a83e0c tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] 10.222.0.58 "GET /compute/v2.1/servers/45beadf1-a6da-49ab-9098-6b681b5184c9" status: 200 len: 1724 microversion: 2.1 time: 0.333961 Aug 10 23:06:14.606229 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1186/2347] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:06:14 2022] GET /compute/v2.1/servers/45beadf1-a6da-49ab-9098-6b681b5184c9 => generated 1724 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:06:14.616595 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-5679f320-c195-4663-8bec-9c1c0665a692 tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:14.620481 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-5679f320-c195-4663-8bec-9c1c0665a692 tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] [instance: 33a1bb4c-217e-40f9-b67f-d873bea80284] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:06:14.627529 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-f0697326-d5a2-478f-83fa-86e6d9e62d16 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] 10.222.0.58 "DELETE /compute/v2.1/servers/e864fe19-d87d-49ae-8c95-ffb659b4f618" status: 204 len: 0 microversion: 2.1 time: 0.258670 Aug 10 23:06:14.630440 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1162/2348] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:06:14 2022] DELETE /compute/v2.1/servers/e864fe19-d87d-49ae-8c95-ffb659b4f618 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:06:14.630617 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5679f320-c195-4663-8bec-9c1c0665a692 tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:14.631451 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5679f320-c195-4663-8bec-9c1c0665a692 tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:14.632129 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5679f320-c195-4663-8bec-9c1c0665a692 tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:14.633163 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5679f320-c195-4663-8bec-9c1c0665a692 tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:14.637690 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5679f320-c195-4663-8bec-9c1c0665a692 tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:14.644655 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-f157b596-afe9-4e77-98e3-5cc5a380561b tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:14.647147 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5679f320-c195-4663-8bec-9c1c0665a692 tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:14.647743 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-f157b596-afe9-4e77-98e3-5cc5a380561b tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] [instance: 662fba38-a52c-464c-8448-bfe0a1d78dab] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:06:14.664378 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f157b596-afe9-4e77-98e3-5cc5a380561b tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:14.665281 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f157b596-afe9-4e77-98e3-5cc5a380561b tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:14.668842 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f157b596-afe9-4e77-98e3-5cc5a380561b tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:14.679400 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f157b596-afe9-4e77-98e3-5cc5a380561b tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:14.686954 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f157b596-afe9-4e77-98e3-5cc5a380561b tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:14.690169 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f157b596-afe9-4e77-98e3-5cc5a380561b tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:14.700830 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-5679f320-c195-4663-8bec-9c1c0665a692 tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] HTTP exception thrown: Instance 33a1bb4c-217e-40f9-b67f-d873bea80284 could not be found. Aug 10 23:06:14.705344 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-5679f320-c195-4663-8bec-9c1c0665a692 tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Request method failure captured: Aug 10 23:06:14.705344 n-d-850468-14 devstack@n-api.service[122633]: request: DELETE /compute/v2.1/servers/33a1bb4c-217e-40f9-b67f-d873bea80284 HTTP/1.1 Aug 10 23:06:14.705344 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:06:14.705344 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:06:14.705344 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:06:14.705344 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:06:14.705344 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:06:14.705344 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:06:14.705344 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:06:14.705344 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:06:14.705344 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9DmnLPtDRZSGfL4AUMemFhJtzFt6s4rdfOdXQaCqDUHRqNo5yVfu_wv80eve_nwLCd4fbUvicTdreQF65GmSW3qJG8AC1ZEoHr5fP3QTdwCryQqIBkdTPl9_u9it646Rl2wU0V1GTXwmEFupip0dt8llfLtffk4ojegpINlnBKspO0U Aug 10 23:06:14.705344 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:06:14.705344 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:06:14.705344 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:06:14.705344 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:06:14.705344 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:06:14.705344 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:06:14.705344 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 13d6f13784504fc7b2fcf0d6957b4920 Aug 10 23:06:14.705344 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1294999711 Aug 10 23:06:14.705344 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:06:14.705344 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:06:14.709327 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/13d6f13784504fc7b2fcf0d6957b4920"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/13d6f13784504fc7b2fcf0d6957b4920"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/13d6f13784504fc7b2fcf0d6957b4920"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_13d6f13784504fc7b2fcf0d6957b4920", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:06:14.709327 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1294999711 Aug 10 23:06:14.709327 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 13d6f13784504fc7b2fcf0d6957b4920 Aug 10 23:06:14.709327 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1294999711 Aug 10 23:06:14.709327 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-FloatingIPsAssociationTestJSON-1294999711-project Aug 10 23:06:14.709327 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:06:14.709327 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:06:14.709327 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 933e6a08c3014b36aee164b213bbfaf0 Aug 10 23:06:14.709327 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1294999711-project Aug 10 23:06:14.709327 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:06:14.709327 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance 33a1bb4c-217e-40f9-b67f-d873bea80284 could not be found. Aug 10 23:06:14.709327 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': '33a1bb4c-217e-40f9-b67f-d873bea80284'} Aug 10 23:06:14.712021 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:06:14.712021 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:06:14.712021 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:06:14.712021 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:06:14.712021 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:06:14.712021 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:06:14.712021 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:06:14.712021 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:06:14.712021 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:06:14.712021 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:06:14.712021 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33a1bb4c-217e-40f9-b67f-d873bea80284 could not be found. Aug 10 23:06:14.712021 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:06:14.712021 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:06:14.712021 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:06:14.712021 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:06:14.712021 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:06:14.712021 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:06:14.712021 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:06:14.712021 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:06:14.712021 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:06:14.715746 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:06:14.715746 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 23:06:14.715746 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 23:06:14.715746 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 23:06:14.715746 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 23:06:14.715746 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:06:14.715746 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:06:14.715746 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:06:14.715746 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:06:14.715746 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33a1bb4c-217e-40f9-b67f-d873bea80284 could not be found. Aug 10 23:06:14.715746 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:06:14.715746 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:06:14.715746 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:06:14.715746 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:06:14.715746 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:06:14.715746 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:06:14.715746 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:06:14.715746 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:06:14.715746 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33a1bb4c-217e-40f9-b67f-d873bea80284 could not be found. Aug 10 23:06:14.715746 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:06:14.718150 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-5679f320-c195-4663-8bec-9c1c0665a692 tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Returning 404 to user: Instance 33a1bb4c-217e-40f9-b67f-d873bea80284 could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:06:14.718150 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-5679f320-c195-4663-8bec-9c1c0665a692 tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] 10.222.0.58 "DELETE /compute/v2.1/servers/33a1bb4c-217e-40f9-b67f-d873bea80284" status: 404 len: 111 microversion: 2.1 time: 0.102825 Aug 10 23:06:14.718150 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1187/2349] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:06:14 2022] DELETE /compute/v2.1/servers/33a1bb4c-217e-40f9-b67f-d873bea80284 => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:06:14.723837 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-17f0c9f7-ee61-4a2c-8251-f394c9bcf3b3 tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:14.740824 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-17f0c9f7-ee61-4a2c-8251-f394c9bcf3b3 tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b9a2a5950cd342da86821122c08f028b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9960516a057e4f629fe5deb41e54d1d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:06:14.741876 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-17f0c9f7-ee61-4a2c-8251-f394c9bcf3b3 tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Searching by: {'deleted': False, 'project_id': '9960516a057e4f629fe5deb41e54d1d7'} {{(pid=122633) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 10 23:06:14.754419 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-17f0c9f7-ee61-4a2c-8251-f394c9bcf3b3 tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:14.756484 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-17f0c9f7-ee61-4a2c-8251-f394c9bcf3b3 tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:14.757212 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-17f0c9f7-ee61-4a2c-8251-f394c9bcf3b3 tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:14.758361 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-17f0c9f7-ee61-4a2c-8251-f394c9bcf3b3 tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:14.759078 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-17f0c9f7-ee61-4a2c-8251-f394c9bcf3b3 tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:14.764051 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-17f0c9f7-ee61-4a2c-8251-f394c9bcf3b3 tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:14.849115 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.multi_cell_list [None req-17f0c9f7-ee61-4a2c-8251-f394c9bcf3b3 tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122633) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 10 23:06:14.944698 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-17f0c9f7-ee61-4a2c-8251-f394c9bcf3b3 tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] 10.222.0.58 "GET /compute/v2.1/servers" status: 200 len: 340 microversion: 2.1 time: 0.224762 Aug 10 23:06:14.945471 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1188/2350] 10.222.0.58 () {58 vars in 1125 bytes} [Wed Aug 10 23:06:14 2022] GET /compute/v2.1/servers => generated 340 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:06:14.958741 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-2c75ea8e-c6fc-4436-bf4b-9c5465ce8349 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:14.960687 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-2c75ea8e-c6fc-4436-bf4b-9c5465ce8349 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] [instance: e864fe19-d87d-49ae-8c95-ffb659b4f618] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:06:14.992505 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2c75ea8e-c6fc-4436-bf4b-9c5465ce8349 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:14.993307 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2c75ea8e-c6fc-4436-bf4b-9c5465ce8349 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:14.994047 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2c75ea8e-c6fc-4436-bf4b-9c5465ce8349 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:14.995053 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2c75ea8e-c6fc-4436-bf4b-9c5465ce8349 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:14.995721 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2c75ea8e-c6fc-4436-bf4b-9c5465ce8349 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:14.996354 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2c75ea8e-c6fc-4436-bf4b-9c5465ce8349 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:15.021731 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-f157b596-afe9-4e77-98e3-5cc5a380561b tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8899e278c9453fba0ab05c69b0b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46ac8b84bd649fa88897068dbfa5ce6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:06:15.033325 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-f157b596-afe9-4e77-98e3-5cc5a380561b tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] 10.222.0.58 "GET /compute/v2.1/servers/662fba38-a52c-464c-8448-bfe0a1d78dab" status: 200 len: 1515 microversion: 2.1 time: 0.400127 Aug 10 23:06:15.048728 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1163/2351] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:06:14 2022] GET /compute/v2.1/servers/662fba38-a52c-464c-8448-bfe0a1d78dab => generated 1515 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:06:15.057450 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-7445e581-8685-4c9b-b452-5761e08ec5fe tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:15.059584 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-7445e581-8685-4c9b-b452-5761e08ec5fe tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] [instance: 33a1bb4c-217e-40f9-b67f-d873bea80284] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:06:15.077149 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7445e581-8685-4c9b-b452-5761e08ec5fe tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:15.077724 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7445e581-8685-4c9b-b452-5761e08ec5fe tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:15.078183 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7445e581-8685-4c9b-b452-5761e08ec5fe tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:15.081676 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7445e581-8685-4c9b-b452-5761e08ec5fe tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:15.082168 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7445e581-8685-4c9b-b452-5761e08ec5fe tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:15.082617 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7445e581-8685-4c9b-b452-5761e08ec5fe tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:15.105337 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-7445e581-8685-4c9b-b452-5761e08ec5fe tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] HTTP exception thrown: Instance 33a1bb4c-217e-40f9-b67f-d873bea80284 could not be found. Aug 10 23:06:15.107888 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-7445e581-8685-4c9b-b452-5761e08ec5fe tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Request method failure captured: Aug 10 23:06:15.107888 n-d-850468-14 devstack@n-api.service[122632]: request: GET /compute/v2.1/servers/33a1bb4c-217e-40f9-b67f-d873bea80284 HTTP/1.1 Aug 10 23:06:15.107888 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:06:15.107888 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:06:15.107888 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:06:15.107888 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 23:06:15.107888 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:06:15.107888 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:06:15.107888 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:06:15.107888 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:06:15.107888 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9DmnLPtDRZSGfL4AUMemFhJtzFt6s4rdfOdXQaCqDUHRqNo5yVfu_wv80eve_nwLCd4fbUvicTdreQF65GmSW3qJG8AC1ZEoHr5fP3QTdwCryQqIBkdTPl9_u9it646Rl2wU0V1GTXwmEFupip0dt8llfLtffk4ojegpINlnBKspO0U Aug 10 23:06:15.107888 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:06:15.107888 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:06:15.107888 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:06:15.107888 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:06:15.107888 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:06:15.107888 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:06:15.107888 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 13d6f13784504fc7b2fcf0d6957b4920 Aug 10 23:06:15.107888 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1294999711 Aug 10 23:06:15.107888 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:06:15.107888 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:06:15.109384 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/13d6f13784504fc7b2fcf0d6957b4920"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/13d6f13784504fc7b2fcf0d6957b4920"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/13d6f13784504fc7b2fcf0d6957b4920"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_13d6f13784504fc7b2fcf0d6957b4920", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:06:15.109384 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1294999711 Aug 10 23:06:15.109384 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 13d6f13784504fc7b2fcf0d6957b4920 Aug 10 23:06:15.109384 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1294999711 Aug 10 23:06:15.109384 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-FloatingIPsAssociationTestJSON-1294999711-project Aug 10 23:06:15.109384 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:06:15.109384 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:06:15.109384 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: 933e6a08c3014b36aee164b213bbfaf0 Aug 10 23:06:15.109384 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1294999711-project Aug 10 23:06:15.109384 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:06:15.109384 n-d-850468-14 devstack@n-api.service[122632]: exception: Instance 33a1bb4c-217e-40f9-b67f-d873bea80284 could not be found. Aug 10 23:06:15.109384 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': '33a1bb4c-217e-40f9-b67f-d873bea80284'} Aug 10 23:06:15.110216 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:06:15.110216 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:06:15.110216 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:06:15.110216 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:06:15.110216 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:06:15.110216 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:06:15.110216 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:06:15.110216 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:06:15.110216 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:06:15.110216 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:06:15.110216 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33a1bb4c-217e-40f9-b67f-d873bea80284 could not be found. Aug 10 23:06:15.110216 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:06:15.110216 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:06:15.110216 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:06:15.110216 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:06:15.110216 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:06:15.110216 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:06:15.110216 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:06:15.110216 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:06:15.110216 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:06:15.111594 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:06:15.111594 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:06:15.111594 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:06:15.111594 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:06:15.111594 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:06:15.111594 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:06:15.111594 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:06:15.111594 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33a1bb4c-217e-40f9-b67f-d873bea80284 could not be found. Aug 10 23:06:15.111594 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:06:15.111594 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:06:15.111594 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:06:15.111594 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:06:15.111594 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:06:15.111594 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:06:15.111594 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:06:15.111594 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:06:15.111594 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33a1bb4c-217e-40f9-b67f-d873bea80284 could not be found. Aug 10 23:06:15.111594 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:06:15.113608 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-7445e581-8685-4c9b-b452-5761e08ec5fe tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Returning 404 to user: Instance 33a1bb4c-217e-40f9-b67f-d873bea80284 could not be found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:06:15.114628 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-7445e581-8685-4c9b-b452-5761e08ec5fe tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] 10.222.0.58 "GET /compute/v2.1/servers/33a1bb4c-217e-40f9-b67f-d873bea80284" status: 404 len: 111 microversion: 2.1 time: 0.064665 Aug 10 23:06:15.115696 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1164/2352] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:06:15 2022] GET /compute/v2.1/servers/33a1bb4c-217e-40f9-b67f-d873bea80284 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:06:15.121145 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-80beac11-d2a2-4dd1-a5da-15b237f3d89c tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:15.127712 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-80beac11-d2a2-4dd1-a5da-15b237f3d89c tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b9a2a5950cd342da86821122c08f028b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9960516a057e4f629fe5deb41e54d1d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:06:15.128800 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-80beac11-d2a2-4dd1-a5da-15b237f3d89c tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Searching by: {'deleted': False, 'project_id': '9960516a057e4f629fe5deb41e54d1d7'} {{(pid=122632) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 10 23:06:15.140525 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-80beac11-d2a2-4dd1-a5da-15b237f3d89c tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:15.141141 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-80beac11-d2a2-4dd1-a5da-15b237f3d89c tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:15.141775 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-80beac11-d2a2-4dd1-a5da-15b237f3d89c tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:15.142957 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-80beac11-d2a2-4dd1-a5da-15b237f3d89c tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:15.143615 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-80beac11-d2a2-4dd1-a5da-15b237f3d89c tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:15.144208 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-80beac11-d2a2-4dd1-a5da-15b237f3d89c tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:15.218919 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-2c75ea8e-c6fc-4436-bf4b-9c5465ce8349 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a092c6b8aa444999c32d8be76cabd3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891f4d07d0af47b19c4f43b24ff0b7ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:06:15.233725 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.multi_cell_list [None req-80beac11-d2a2-4dd1-a5da-15b237f3d89c tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122632) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 10 23:06:15.252426 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-2c75ea8e-c6fc-4436-bf4b-9c5465ce8349 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] 10.222.0.58 "GET /compute/v2.1/servers/e864fe19-d87d-49ae-8c95-ffb659b4f618" status: 200 len: 1466 microversion: 2.1 time: 0.297604 Aug 10 23:06:15.253331 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1189/2353] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:06:14 2022] GET /compute/v2.1/servers/e864fe19-d87d-49ae-8c95-ffb659b4f618 => generated 1466 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:06:15.263200 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-89857a10-5c53-4df0-8968-240f0c98232a tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Calling method '.version_select at 0x7f847d254820>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:15.362667 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-80beac11-d2a2-4dd1-a5da-15b237f3d89c tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a2a5950cd342da86821122c08f028b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9960516a057e4f629fe5deb41e54d1d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:06:15.377467 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-80beac11-d2a2-4dd1-a5da-15b237f3d89c tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:15.377969 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-80beac11-d2a2-4dd1-a5da-15b237f3d89c tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:15.378420 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-80beac11-d2a2-4dd1-a5da-15b237f3d89c tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:15.982947 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-80beac11-d2a2-4dd1-a5da-15b237f3d89c tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] 10.222.0.58 "GET /compute/v2.1/servers/detail" status: 200 len: 1711 microversion: 2.1 time: 0.865743 Aug 10 23:06:15.984050 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1165/2354] 10.222.0.58 () {58 vars in 1146 bytes} [Wed Aug 10 23:06:15 2022] GET /compute/v2.1/servers/detail => generated 1711 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:06:16.002459 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-912717ad-ea79-4175-b92b-1ceecacbf863 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:16.006380 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-912717ad-ea79-4175-b92b-1ceecacbf863 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] [instance: b3b3730c-1396-4ca6-9d9e-8a3104950324] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:06:16.021004 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-912717ad-ea79-4175-b92b-1ceecacbf863 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:16.027000 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-912717ad-ea79-4175-b92b-1ceecacbf863 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:16.027783 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-912717ad-ea79-4175-b92b-1ceecacbf863 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:16.028753 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-912717ad-ea79-4175-b92b-1ceecacbf863 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:16.029489 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-912717ad-ea79-4175-b92b-1ceecacbf863 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:16.030384 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-912717ad-ea79-4175-b92b-1ceecacbf863 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:16.354000 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-912717ad-ea79-4175-b92b-1ceecacbf863 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de244f1f82143a0b3d3283c31d80bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14c63df2e6c46d2af23b6b8a52690d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:06:16.371446 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-912717ad-ea79-4175-b92b-1ceecacbf863 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] 10.222.0.58 "GET /compute/v2.1/servers/b3b3730c-1396-4ca6-9d9e-8a3104950324" status: 200 len: 1472 microversion: 2.1 time: 0.381068 Aug 10 23:06:16.379521 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1166/2355] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:06:15 2022] GET /compute/v2.1/servers/b3b3730c-1396-4ca6-9d9e-8a3104950324 => generated 1472 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:06:16.400495 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-38bcbba2-fc0b-4c0f-9d55-382137a5f2d5 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:16.401595 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-38bcbba2-fc0b-4c0f-9d55-382137a5f2d5 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] [instance: 45beadf1-a6da-49ab-9098-6b681b5184c9] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:06:16.409481 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-38bcbba2-fc0b-4c0f-9d55-382137a5f2d5 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:16.410503 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-38bcbba2-fc0b-4c0f-9d55-382137a5f2d5 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:16.411141 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-38bcbba2-fc0b-4c0f-9d55-382137a5f2d5 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:16.412113 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-38bcbba2-fc0b-4c0f-9d55-382137a5f2d5 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:16.412798 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-38bcbba2-fc0b-4c0f-9d55-382137a5f2d5 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:16.413387 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-38bcbba2-fc0b-4c0f-9d55-382137a5f2d5 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:16.799133 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-38bcbba2-fc0b-4c0f-9d55-382137a5f2d5 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1986185dc9b4df4affcc421365462f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597863bfebdc481188f1f30095da5396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:06:16.812488 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-38bcbba2-fc0b-4c0f-9d55-382137a5f2d5 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] 10.222.0.58 "GET /compute/v2.1/servers/45beadf1-a6da-49ab-9098-6b681b5184c9" status: 200 len: 1724 microversion: 2.1 time: 0.431420 Aug 10 23:06:16.813880 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1167/2356] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:06:16 2022] GET /compute/v2.1/servers/45beadf1-a6da-49ab-9098-6b681b5184c9 => generated 1724 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:06:16.820370 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-fc3a4b51-216e-415c-ac68-e6f4381b5932 tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:16.831638 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-fc3a4b51-216e-415c-ac68-e6f4381b5932 tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] 10.222.0.58 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.016229 Aug 10 23:06:16.832237 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1168/2357] 10.222.0.58 () {58 vars in 1137 bytes} [Wed Aug 10 23:06:16 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:06:16.847901 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-4219b2c5-282d-4184-99f0-ef0c4d3e4fe6 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:16.850694 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-4219b2c5-282d-4184-99f0-ef0c4d3e4fe6 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] [instance: 662fba38-a52c-464c-8448-bfe0a1d78dab] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:06:16.861333 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4219b2c5-282d-4184-99f0-ef0c4d3e4fe6 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:16.862460 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4219b2c5-282d-4184-99f0-ef0c4d3e4fe6 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:16.867163 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4219b2c5-282d-4184-99f0-ef0c4d3e4fe6 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:16.880069 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4219b2c5-282d-4184-99f0-ef0c4d3e4fe6 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:16.882673 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4219b2c5-282d-4184-99f0-ef0c4d3e4fe6 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:16.885894 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4219b2c5-282d-4184-99f0-ef0c4d3e4fe6 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:17.164290 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-89857a10-5c53-4df0-8968-240f0c98232a tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] 10.222.0.58 "DELETE /compute/v2.1/os-floating-ips/fd905614-3779-4dcc-a4da-a9a0e17bb169" status: 202 len: 0 microversion: 2.1 time: 1.908247 Aug 10 23:06:17.166234 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1190/2358] 10.222.0.58 () {58 vars in 1263 bytes} [Wed Aug 10 23:06:15 2022] DELETE /compute/v2.1/os-floating-ips/fd905614-3779-4dcc-a4da-a9a0e17bb169 => generated 0 bytes in 1911 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:06:17.172944 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-f59b7f75-4bc7-4ce8-82f9-eb2ee9f2704e tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:17.175990 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-f59b7f75-4bc7-4ce8-82f9-eb2ee9f2704e tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] [instance: e864fe19-d87d-49ae-8c95-ffb659b4f618] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:06:17.214120 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f59b7f75-4bc7-4ce8-82f9-eb2ee9f2704e tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:17.215143 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f59b7f75-4bc7-4ce8-82f9-eb2ee9f2704e tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:17.217960 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f59b7f75-4bc7-4ce8-82f9-eb2ee9f2704e tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:17.221154 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f59b7f75-4bc7-4ce8-82f9-eb2ee9f2704e tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:17.224813 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f59b7f75-4bc7-4ce8-82f9-eb2ee9f2704e tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:17.225313 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f59b7f75-4bc7-4ce8-82f9-eb2ee9f2704e tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:17.236457 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:06:17.441173 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-f59b7f75-4bc7-4ce8-82f9-eb2ee9f2704e tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a092c6b8aa444999c32d8be76cabd3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891f4d07d0af47b19c4f43b24ff0b7ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:06:17.450462 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-f59b7f75-4bc7-4ce8-82f9-eb2ee9f2704e tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] 10.222.0.58 "GET /compute/v2.1/servers/e864fe19-d87d-49ae-8c95-ffb659b4f618" status: 200 len: 1424 microversion: 2.1 time: 0.282866 Aug 10 23:06:17.460759 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1191/2359] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:06:17 2022] GET /compute/v2.1/servers/e864fe19-d87d-49ae-8c95-ffb659b4f618 => generated 1424 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:06:17.475454 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-013569dc-a148-4eb8-8fce-40abfea0112b tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:17.476209 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-013569dc-a148-4eb8-8fce-40abfea0112b tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] [instance: b9b9e57b-0669-46b6-afae-b5c439f688d2] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:06:17.486395 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-013569dc-a148-4eb8-8fce-40abfea0112b tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:17.491483 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-013569dc-a148-4eb8-8fce-40abfea0112b tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:17.492192 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-013569dc-a148-4eb8-8fce-40abfea0112b tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:17.493182 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-013569dc-a148-4eb8-8fce-40abfea0112b tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:17.493856 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-013569dc-a148-4eb8-8fce-40abfea0112b tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:17.495825 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-013569dc-a148-4eb8-8fce-40abfea0112b tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:17.559081 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-013569dc-a148-4eb8-8fce-40abfea0112b tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] [instance: b9b9e57b-0669-46b6-afae-b5c439f688d2] Going to try to terminate instance {{(pid=122633) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:06:17.608667 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-4219b2c5-282d-4184-99f0-ef0c4d3e4fe6 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8899e278c9453fba0ab05c69b0b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46ac8b84bd649fa88897068dbfa5ce6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:06:17.619561 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-4219b2c5-282d-4184-99f0-ef0c4d3e4fe6 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] 10.222.0.58 "GET /compute/v2.1/servers/662fba38-a52c-464c-8448-bfe0a1d78dab" status: 200 len: 1515 microversion: 2.1 time: 0.778385 Aug 10 23:06:17.620176 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1169/2360] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:06:16 2022] GET /compute/v2.1/servers/662fba38-a52c-464c-8448-bfe0a1d78dab => generated 1515 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:06:17.636919 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-30fc0b01-5aa3-4c20-a1e0-5730961fc034 tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:17.637435 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-30fc0b01-5aa3-4c20-a1e0-5730961fc034 tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] [instance: 717a8812-6a48-49ad-baa8-0cf0fb41671d] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:06:17.674819 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-30fc0b01-5aa3-4c20-a1e0-5730961fc034 tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:17.678501 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-30fc0b01-5aa3-4c20-a1e0-5730961fc034 tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:17.679476 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-30fc0b01-5aa3-4c20-a1e0-5730961fc034 tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:17.683996 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-30fc0b01-5aa3-4c20-a1e0-5730961fc034 tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:17.684795 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-30fc0b01-5aa3-4c20-a1e0-5730961fc034 tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:17.685399 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-30fc0b01-5aa3-4c20-a1e0-5730961fc034 tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:17.745280 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-30fc0b01-5aa3-4c20-a1e0-5730961fc034 tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] [instance: 717a8812-6a48-49ad-baa8-0cf0fb41671d] Going to try to terminate instance {{(pid=122632) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:06:17.793955 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-013569dc-a148-4eb8-8fce-40abfea0112b tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] 10.222.0.58 "DELETE /compute/v2.1/servers/b9b9e57b-0669-46b6-afae-b5c439f688d2" status: 204 len: 0 microversion: 2.1 time: 0.331492 Aug 10 23:06:17.795451 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1192/2361] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:06:17 2022] DELETE /compute/v2.1/servers/b9b9e57b-0669-46b6-afae-b5c439f688d2 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:06:17.809231 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-017ea3af-fe4a-4a79-be6b-61d8e5298b87 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:17.821036 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-017ea3af-fe4a-4a79-be6b-61d8e5298b87 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] [instance: b3b3730c-1396-4ca6-9d9e-8a3104950324] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:06:17.840450 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-017ea3af-fe4a-4a79-be6b-61d8e5298b87 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:17.842621 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-017ea3af-fe4a-4a79-be6b-61d8e5298b87 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:17.843301 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-017ea3af-fe4a-4a79-be6b-61d8e5298b87 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:17.847888 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-017ea3af-fe4a-4a79-be6b-61d8e5298b87 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:17.848832 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-017ea3af-fe4a-4a79-be6b-61d8e5298b87 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:17.849853 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-017ea3af-fe4a-4a79-be6b-61d8e5298b87 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:18.015522 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-30fc0b01-5aa3-4c20-a1e0-5730961fc034 tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] 10.222.0.58 "DELETE /compute/v2.1/servers/717a8812-6a48-49ad-baa8-0cf0fb41671d" status: 204 len: 0 microversion: 2.1 time: 0.393443 Aug 10 23:06:18.020327 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1170/2362] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:06:17 2022] DELETE /compute/v2.1/servers/717a8812-6a48-49ad-baa8-0cf0fb41671d => generated 0 bytes in 396 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:06:18.031905 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-7d437640-c5c3-4f5a-ba9b-5fbe4cbdf768 req-b03ab8e6-580d-4f57-9540-e82c16bfdccb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e864fe19-d87d-49ae-8c95-ffb659b4f618", "name": "network-vif-deleted", "tag": "180cd3f3-3b1b-4930-b5db-bbdb9cb8bb30"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:06:18.046887 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-7d437640-c5c3-4f5a-ba9b-5fbe4cbdf768 req-b03ab8e6-580d-4f57-9540-e82c16bfdccb service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:18.047633 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-7d437640-c5c3-4f5a-ba9b-5fbe4cbdf768 req-b03ab8e6-580d-4f57-9540-e82c16bfdccb service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:18.048288 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-7d437640-c5c3-4f5a-ba9b-5fbe4cbdf768 req-b03ab8e6-580d-4f57-9540-e82c16bfdccb service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:18.066127 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-7d437640-c5c3-4f5a-ba9b-5fbe4cbdf768 req-b03ab8e6-580d-4f57-9540-e82c16bfdccb service nova] Creating event network-vif-deleted:180cd3f3-3b1b-4930-b5db-bbdb9cb8bb30 for instance e864fe19-d87d-49ae-8c95-ffb659b4f618 on n-h2-850468-14 Aug 10 23:06:18.072514 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-7d437640-c5c3-4f5a-ba9b-5fbe4cbdf768 req-b03ab8e6-580d-4f57-9540-e82c16bfdccb service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049125 Aug 10 23:06:18.073823 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1171/2363] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:06:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:06:18.080893 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-e7b13fe6-770e-4a70-a3fe-c53dbfe719be tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:18.081884 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-e7b13fe6-770e-4a70-a3fe-c53dbfe719be tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] [instance: b9b9e57b-0669-46b6-afae-b5c439f688d2] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:06:18.087121 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-017ea3af-fe4a-4a79-be6b-61d8e5298b87 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de244f1f82143a0b3d3283c31d80bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14c63df2e6c46d2af23b6b8a52690d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:06:18.091272 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e7b13fe6-770e-4a70-a3fe-c53dbfe719be tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:18.092057 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e7b13fe6-770e-4a70-a3fe-c53dbfe719be tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:18.092940 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e7b13fe6-770e-4a70-a3fe-c53dbfe719be tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:18.094056 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e7b13fe6-770e-4a70-a3fe-c53dbfe719be tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:18.094930 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e7b13fe6-770e-4a70-a3fe-c53dbfe719be tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:18.095886 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e7b13fe6-770e-4a70-a3fe-c53dbfe719be tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:18.100336 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-017ea3af-fe4a-4a79-be6b-61d8e5298b87 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] 10.222.0.58 "GET /compute/v2.1/servers/b3b3730c-1396-4ca6-9d9e-8a3104950324" status: 200 len: 1472 microversion: 2.1 time: 0.303122 Aug 10 23:06:18.101588 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1193/2364] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:06:17 2022] GET /compute/v2.1/servers/b3b3730c-1396-4ca6-9d9e-8a3104950324 => generated 1472 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:06:18.110074 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-605ae894-8cd1-4bbf-b544-f9587a52e47d tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:18.112098 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-605ae894-8cd1-4bbf-b544-f9587a52e47d tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] [instance: 45beadf1-a6da-49ab-9098-6b681b5184c9] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:06:18.125350 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-605ae894-8cd1-4bbf-b544-f9587a52e47d tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:18.126168 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-605ae894-8cd1-4bbf-b544-f9587a52e47d tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:18.126939 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-605ae894-8cd1-4bbf-b544-f9587a52e47d tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:18.128141 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-605ae894-8cd1-4bbf-b544-f9587a52e47d tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:18.128768 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-605ae894-8cd1-4bbf-b544-f9587a52e47d tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:18.129494 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-605ae894-8cd1-4bbf-b544-f9587a52e47d tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:18.364690 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-605ae894-8cd1-4bbf-b544-f9587a52e47d tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1986185dc9b4df4affcc421365462f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597863bfebdc481188f1f30095da5396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:06:18.379118 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-605ae894-8cd1-4bbf-b544-f9587a52e47d tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] 10.222.0.58 "GET /compute/v2.1/servers/45beadf1-a6da-49ab-9098-6b681b5184c9" status: 200 len: 1724 microversion: 2.1 time: 0.276157 Aug 10 23:06:18.380345 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1194/2365] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:06:18 2022] GET /compute/v2.1/servers/45beadf1-a6da-49ab-9098-6b681b5184c9 => generated 1724 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:06:18.386068 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-14d3bac7-3509-4db1-b4c2-0f0a580a07d4 tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:18.388032 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-14d3bac7-3509-4db1-b4c2-0f0a580a07d4 tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] [instance: 717a8812-6a48-49ad-baa8-0cf0fb41671d] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:06:18.396766 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-14d3bac7-3509-4db1-b4c2-0f0a580a07d4 tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:18.397580 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-14d3bac7-3509-4db1-b4c2-0f0a580a07d4 tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:18.398052 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-14d3bac7-3509-4db1-b4c2-0f0a580a07d4 tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:18.398973 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-14d3bac7-3509-4db1-b4c2-0f0a580a07d4 tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:18.399433 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-14d3bac7-3509-4db1-b4c2-0f0a580a07d4 tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:18.399863 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-14d3bac7-3509-4db1-b4c2-0f0a580a07d4 tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:18.434603 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-e7b13fe6-770e-4a70-a3fe-c53dbfe719be tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a2a5950cd342da86821122c08f028b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9960516a057e4f629fe5deb41e54d1d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:06:18.444090 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-e7b13fe6-770e-4a70-a3fe-c53dbfe719be tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] 10.222.0.58 "GET /compute/v2.1/servers/b9b9e57b-0669-46b6-afae-b5c439f688d2" status: 200 len: 1714 microversion: 2.1 time: 0.368774 Aug 10 23:06:18.447959 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1172/2366] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:06:18 2022] GET /compute/v2.1/servers/b9b9e57b-0669-46b6-afae-b5c439f688d2 => generated 1714 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:06:18.487113 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-7b3012df-0639-4cf4-a15a-81b0ed89abcc tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:18.488075 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-7b3012df-0639-4cf4-a15a-81b0ed89abcc tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] [instance: e864fe19-d87d-49ae-8c95-ffb659b4f618] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:06:18.513464 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7b3012df-0639-4cf4-a15a-81b0ed89abcc tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:18.519674 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7b3012df-0639-4cf4-a15a-81b0ed89abcc tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:18.521687 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7b3012df-0639-4cf4-a15a-81b0ed89abcc tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:18.522713 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7b3012df-0639-4cf4-a15a-81b0ed89abcc tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:18.525438 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7b3012df-0639-4cf4-a15a-81b0ed89abcc tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:18.526307 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7b3012df-0639-4cf4-a15a-81b0ed89abcc tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:18.598820 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-14d3bac7-3509-4db1-b4c2-0f0a580a07d4 tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '933e6a08c3014b36aee164b213bbfaf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d6f13784504fc7b2fcf0d6957b4920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:06:18.599434 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7b3012df-0639-4cf4-a15a-81b0ed89abcc tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:18.600048 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7b3012df-0639-4cf4-a15a-81b0ed89abcc tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:18.600692 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7b3012df-0639-4cf4-a15a-81b0ed89abcc tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:18.601366 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.objects.instance [None req-7b3012df-0639-4cf4-a15a-81b0ed89abcc tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Lazy-loading 'fault' on Instance uuid e864fe19-d87d-49ae-8c95-ffb659b4f618 {{(pid=122632) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:06:18.616446 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-14d3bac7-3509-4db1-b4c2-0f0a580a07d4 tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] 10.222.0.58 "GET /compute/v2.1/servers/717a8812-6a48-49ad-baa8-0cf0fb41671d" status: 200 len: 1526 microversion: 2.1 time: 0.233973 Aug 10 23:06:18.618189 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1195/2367] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:06:18 2022] GET /compute/v2.1/servers/717a8812-6a48-49ad-baa8-0cf0fb41671d => generated 1526 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:06:18.642394 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-a14f5703-c328-46ff-8162-701417b4774f tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:18.643300 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-a14f5703-c328-46ff-8162-701417b4774f tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] [instance: 662fba38-a52c-464c-8448-bfe0a1d78dab] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:06:18.649928 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a14f5703-c328-46ff-8162-701417b4774f tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:18.651031 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a14f5703-c328-46ff-8162-701417b4774f tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:18.651774 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a14f5703-c328-46ff-8162-701417b4774f tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:18.653622 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a14f5703-c328-46ff-8162-701417b4774f tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:18.654373 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a14f5703-c328-46ff-8162-701417b4774f tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:18.654996 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a14f5703-c328-46ff-8162-701417b4774f tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:18.679994 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-7b3012df-0639-4cf4-a15a-81b0ed89abcc tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a092c6b8aa444999c32d8be76cabd3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891f4d07d0af47b19c4f43b24ff0b7ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:06:18.707080 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-7b3012df-0639-4cf4-a15a-81b0ed89abcc tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] 10.222.0.58 "GET /compute/v2.1/servers/e864fe19-d87d-49ae-8c95-ffb659b4f618" status: 200 len: 1309 microversion: 2.1 time: 0.225934 Aug 10 23:06:18.722679 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1173/2368] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:06:18 2022] GET /compute/v2.1/servers/e864fe19-d87d-49ae-8c95-ffb659b4f618 => generated 1309 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:06:18.826186 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-a14f5703-c328-46ff-8162-701417b4774f tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8899e278c9453fba0ab05c69b0b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46ac8b84bd649fa88897068dbfa5ce6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:06:18.836598 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-a14f5703-c328-46ff-8162-701417b4774f tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] 10.222.0.58 "GET /compute/v2.1/servers/662fba38-a52c-464c-8448-bfe0a1d78dab" status: 200 len: 1515 microversion: 2.1 time: 0.197997 Aug 10 23:06:18.839538 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1196/2369] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:06:18 2022] GET /compute/v2.1/servers/662fba38-a52c-464c-8448-bfe0a1d78dab => generated 1515 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:06:19.124315 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-89c36f5e-0a12-4fae-9ffc-763974af537a tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:19.125389 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-89c36f5e-0a12-4fae-9ffc-763974af537a tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] [instance: b3b3730c-1396-4ca6-9d9e-8a3104950324] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:06:19.136145 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-89c36f5e-0a12-4fae-9ffc-763974af537a tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:19.137317 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-89c36f5e-0a12-4fae-9ffc-763974af537a tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:19.138244 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-89c36f5e-0a12-4fae-9ffc-763974af537a tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:19.139512 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-89c36f5e-0a12-4fae-9ffc-763974af537a tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:19.140071 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-89c36f5e-0a12-4fae-9ffc-763974af537a tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:19.140870 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-89c36f5e-0a12-4fae-9ffc-763974af537a tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:19.211236 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=93,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=3,nova_cell1:RELEASE=1,nova_cell1:INSERT=2 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:06:19.408077 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-4144944d-3068-4ebb-b9c5-6f6ecf973849 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:19.411788 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-4144944d-3068-4ebb-b9c5-6f6ecf973849 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] [instance: 45beadf1-a6da-49ab-9098-6b681b5184c9] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:06:19.449381 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4144944d-3068-4ebb-b9c5-6f6ecf973849 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:19.453735 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4144944d-3068-4ebb-b9c5-6f6ecf973849 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:19.456264 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4144944d-3068-4ebb-b9c5-6f6ecf973849 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:19.459328 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4144944d-3068-4ebb-b9c5-6f6ecf973849 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:19.462167 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4144944d-3068-4ebb-b9c5-6f6ecf973849 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:19.467377 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4144944d-3068-4ebb-b9c5-6f6ecf973849 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:19.538469 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-89c36f5e-0a12-4fae-9ffc-763974af537a tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de244f1f82143a0b3d3283c31d80bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14c63df2e6c46d2af23b6b8a52690d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:06:19.553989 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-89c36f5e-0a12-4fae-9ffc-763974af537a tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] 10.222.0.58 "GET /compute/v2.1/servers/b3b3730c-1396-4ca6-9d9e-8a3104950324" status: 200 len: 1472 microversion: 2.1 time: 0.428675 Aug 10 23:06:19.554912 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1174/2370] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:06:19 2022] GET /compute/v2.1/servers/b3b3730c-1396-4ca6-9d9e-8a3104950324 => generated 1472 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:06:19.565788 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-22ecf7d7-87c0-4f6a-b8ac-252ff1348b66 tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:19.567808 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-22ecf7d7-87c0-4f6a-b8ac-252ff1348b66 tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] [instance: b9b9e57b-0669-46b6-afae-b5c439f688d2] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:06:19.583567 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-22ecf7d7-87c0-4f6a-b8ac-252ff1348b66 tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:19.584486 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-22ecf7d7-87c0-4f6a-b8ac-252ff1348b66 tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:19.585416 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-22ecf7d7-87c0-4f6a-b8ac-252ff1348b66 tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:19.586856 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-22ecf7d7-87c0-4f6a-b8ac-252ff1348b66 tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:19.587569 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-22ecf7d7-87c0-4f6a-b8ac-252ff1348b66 tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:19.588264 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-22ecf7d7-87c0-4f6a-b8ac-252ff1348b66 tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:19.764644 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-22ecf7d7-87c0-4f6a-b8ac-252ff1348b66 tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a2a5950cd342da86821122c08f028b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9960516a057e4f629fe5deb41e54d1d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:06:19.772916 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-22ecf7d7-87c0-4f6a-b8ac-252ff1348b66 tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] 10.222.0.58 "GET /compute/v2.1/servers/b9b9e57b-0669-46b6-afae-b5c439f688d2" status: 200 len: 1714 microversion: 2.1 time: 0.215170 Aug 10 23:06:19.773488 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1175/2371] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:06:19 2022] GET /compute/v2.1/servers/b9b9e57b-0669-46b6-afae-b5c439f688d2 => generated 1714 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:06:19.779583 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c459aa7a-b98e-4042-acac-980490159845 tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:19.780383 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-c459aa7a-b98e-4042-acac-980490159845 tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] [instance: 717a8812-6a48-49ad-baa8-0cf0fb41671d] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:06:19.788613 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c459aa7a-b98e-4042-acac-980490159845 tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:19.789100 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c459aa7a-b98e-4042-acac-980490159845 tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:19.790516 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c459aa7a-b98e-4042-acac-980490159845 tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:19.792123 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c459aa7a-b98e-4042-acac-980490159845 tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:19.792757 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c459aa7a-b98e-4042-acac-980490159845 tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:19.793192 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c459aa7a-b98e-4042-acac-980490159845 tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:19.963022 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-c459aa7a-b98e-4042-acac-980490159845 tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '933e6a08c3014b36aee164b213bbfaf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d6f13784504fc7b2fcf0d6957b4920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:06:19.971395 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-c459aa7a-b98e-4042-acac-980490159845 tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] 10.222.0.58 "GET /compute/v2.1/servers/717a8812-6a48-49ad-baa8-0cf0fb41671d" status: 200 len: 1526 microversion: 2.1 time: 0.196676 Aug 10 23:06:19.971983 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1176/2372] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:06:19 2022] GET /compute/v2.1/servers/717a8812-6a48-49ad-baa8-0cf0fb41671d => generated 1526 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:06:19.976973 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-36c07cc5-dd14-4e97-8eaf-7b36e51519b3 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:19.978096 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-36c07cc5-dd14-4e97-8eaf-7b36e51519b3 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] [instance: e864fe19-d87d-49ae-8c95-ffb659b4f618] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:06:19.986101 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-36c07cc5-dd14-4e97-8eaf-7b36e51519b3 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:19.987167 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-36c07cc5-dd14-4e97-8eaf-7b36e51519b3 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:19.987630 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-36c07cc5-dd14-4e97-8eaf-7b36e51519b3 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:19.988357 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-36c07cc5-dd14-4e97-8eaf-7b36e51519b3 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:19.988811 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-36c07cc5-dd14-4e97-8eaf-7b36e51519b3 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:19.989243 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-36c07cc5-dd14-4e97-8eaf-7b36e51519b3 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:19.998468 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-4144944d-3068-4ebb-b9c5-6f6ecf973849 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1986185dc9b4df4affcc421365462f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597863bfebdc481188f1f30095da5396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:06:20.012596 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-36c07cc5-dd14-4e97-8eaf-7b36e51519b3 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] HTTP exception thrown: Instance e864fe19-d87d-49ae-8c95-ffb659b4f618 could not be found. Aug 10 23:06:20.012966 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-4144944d-3068-4ebb-b9c5-6f6ecf973849 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] 10.222.0.58 "GET /compute/v2.1/servers/45beadf1-a6da-49ab-9098-6b681b5184c9" status: 200 len: 1724 microversion: 2.1 time: 0.614317 Aug 10 23:06:20.013668 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1197/2373] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:06:19 2022] GET /compute/v2.1/servers/45beadf1-a6da-49ab-9098-6b681b5184c9 => generated 1724 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:06:20.015363 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-36c07cc5-dd14-4e97-8eaf-7b36e51519b3 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Request method failure captured: Aug 10 23:06:20.015363 n-d-850468-14 devstack@n-api.service[122632]: request: GET /compute/v2.1/servers/e864fe19-d87d-49ae-8c95-ffb659b4f618 HTTP/1.1 Aug 10 23:06:20.015363 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:06:20.015363 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:06:20.015363 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:06:20.015363 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 23:06:20.015363 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:06:20.015363 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:06:20.015363 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:06:20.015363 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:06:20.015363 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9Dm4hPKY0GprFinN7qrQ_eu4_ssxfzyeAqNBbMw40z172K1CrFnKw0BfJUklvUKTDQoDQTTbZhCjLE1uqiIOOxIy55GeICRmPq7RP3PWZedjrjLFi3taGnSoa9qln-1ZXX3dVkeDMFkg1jdxH7XHPC3RBmi5Rj2cB23lxnrMvgVqJlI Aug 10 23:06:20.015363 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:06:20.015363 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:06:20.015363 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:06:20.015363 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:06:20.015363 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:06:20.015363 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:06:20.015363 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 891f4d07d0af47b19c4f43b24ff0b7ef Aug 10 23:06:20.015363 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-LiveMigrationNegativeTest-705841583 Aug 10 23:06:20.015363 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:06:20.015363 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:06:20.016915 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/891f4d07d0af47b19c4f43b24ff0b7ef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/891f4d07d0af47b19c4f43b24ff0b7ef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/891f4d07d0af47b19c4f43b24ff0b7ef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_891f4d07d0af47b19c4f43b24ff0b7ef", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:06:20.016915 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-LiveMigrationNegativeTest-705841583 Aug 10 23:06:20.016915 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 891f4d07d0af47b19c4f43b24ff0b7ef Aug 10 23:06:20.016915 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-705841583 Aug 10 23:06:20.016915 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-LiveMigrationNegativeTest-705841583-project Aug 10 23:06:20.016915 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:06:20.016915 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:06:20.016915 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: 1a092c6b8aa444999c32d8be76cabd3d Aug 10 23:06:20.016915 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-LiveMigrationNegativeTest-705841583-project Aug 10 23:06:20.016915 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:06:20.016915 n-d-850468-14 devstack@n-api.service[122632]: exception: Instance e864fe19-d87d-49ae-8c95-ffb659b4f618 could not be found. Aug 10 23:06:20.016915 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': 'e864fe19-d87d-49ae-8c95-ffb659b4f618'} Aug 10 23:06:20.017699 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:06:20.017699 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:06:20.017699 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:06:20.017699 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:06:20.017699 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:06:20.017699 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:06:20.017699 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:06:20.017699 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:06:20.017699 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:06:20.017699 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:06:20.017699 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e864fe19-d87d-49ae-8c95-ffb659b4f618 could not be found. Aug 10 23:06:20.017699 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:06:20.017699 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:06:20.017699 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:06:20.017699 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:06:20.017699 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:06:20.017699 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:06:20.017699 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:06:20.017699 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:06:20.017699 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:06:20.019032 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:06:20.019032 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:06:20.019032 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:06:20.019032 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:06:20.019032 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:06:20.019032 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:06:20.019032 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:06:20.019032 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e864fe19-d87d-49ae-8c95-ffb659b4f618 could not be found. Aug 10 23:06:20.019032 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:06:20.019032 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:06:20.019032 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:06:20.019032 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:06:20.019032 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:06:20.019032 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:06:20.019032 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:06:20.019032 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:06:20.019032 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e864fe19-d87d-49ae-8c95-ffb659b4f618 could not be found. Aug 10 23:06:20.019032 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:06:20.021282 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-36c07cc5-dd14-4e97-8eaf-7b36e51519b3 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Returning 404 to user: Instance e864fe19-d87d-49ae-8c95-ffb659b4f618 could not be found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:06:20.022464 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-36c07cc5-dd14-4e97-8eaf-7b36e51519b3 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] 10.222.0.58 "GET /compute/v2.1/servers/e864fe19-d87d-49ae-8c95-ffb659b4f618" status: 404 len: 111 microversion: 2.1 time: 0.049396 Aug 10 23:06:20.023646 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1177/2374] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:06:19 2022] GET /compute/v2.1/servers/e864fe19-d87d-49ae-8c95-ffb659b4f618 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:06:20.030731 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-41d7938a-266d-4e3f-b41d-b98bf5200ab7 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:20.031522 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-41d7938a-266d-4e3f-b41d-b98bf5200ab7 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] [instance: 662fba38-a52c-464c-8448-bfe0a1d78dab] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:06:20.033008 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-e2b85ffd-1581-4db7-bf8d-e487de3a8bc4 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:20.033735 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-e2b85ffd-1581-4db7-bf8d-e487de3a8bc4 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] [instance: d65d59de-9c9c-47c6-8066-6c9bb7245bd7] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:06:20.041679 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e2b85ffd-1581-4db7-bf8d-e487de3a8bc4 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:20.042264 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e2b85ffd-1581-4db7-bf8d-e487de3a8bc4 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:20.042738 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e2b85ffd-1581-4db7-bf8d-e487de3a8bc4 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:20.043516 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e2b85ffd-1581-4db7-bf8d-e487de3a8bc4 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:20.044209 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e2b85ffd-1581-4db7-bf8d-e487de3a8bc4 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:20.044633 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-41d7938a-266d-4e3f-b41d-b98bf5200ab7 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:20.044749 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e2b85ffd-1581-4db7-bf8d-e487de3a8bc4 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:20.045164 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-41d7938a-266d-4e3f-b41d-b98bf5200ab7 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:20.046112 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-41d7938a-266d-4e3f-b41d-b98bf5200ab7 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:20.047129 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-41d7938a-266d-4e3f-b41d-b98bf5200ab7 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:20.047745 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-41d7938a-266d-4e3f-b41d-b98bf5200ab7 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:20.048369 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-41d7938a-266d-4e3f-b41d-b98bf5200ab7 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:20.082409 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-e2b85ffd-1581-4db7-bf8d-e487de3a8bc4 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] [instance: d65d59de-9c9c-47c6-8066-6c9bb7245bd7] Going to try to terminate instance {{(pid=122632) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:06:20.172923 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-e2b85ffd-1581-4db7-bf8d-e487de3a8bc4 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] 10.222.0.58 "DELETE /compute/v2.1/servers/d65d59de-9c9c-47c6-8066-6c9bb7245bd7" status: 204 len: 0 microversion: 2.1 time: 0.144722 Aug 10 23:06:20.174683 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1178/2375] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:06:20 2022] DELETE /compute/v2.1/servers/d65d59de-9c9c-47c6-8066-6c9bb7245bd7 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:06:20.183822 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-9ebf43dd-34ca-48ba-a926-90146ee03564 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:20.184732 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-9ebf43dd-34ca-48ba-a926-90146ee03564 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] [instance: d65d59de-9c9c-47c6-8066-6c9bb7245bd7] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:06:20.193257 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9ebf43dd-34ca-48ba-a926-90146ee03564 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:20.193984 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9ebf43dd-34ca-48ba-a926-90146ee03564 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:20.194440 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9ebf43dd-34ca-48ba-a926-90146ee03564 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:20.195332 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9ebf43dd-34ca-48ba-a926-90146ee03564 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:20.195794 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9ebf43dd-34ca-48ba-a926-90146ee03564 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:20.196223 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9ebf43dd-34ca-48ba-a926-90146ee03564 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:20.400047 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-9ebf43dd-34ca-48ba-a926-90146ee03564 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a092c6b8aa444999c32d8be76cabd3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891f4d07d0af47b19c4f43b24ff0b7ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:06:20.409077 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-9ebf43dd-34ca-48ba-a926-90146ee03564 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] 10.222.0.58 "GET /compute/v2.1/servers/d65d59de-9c9c-47c6-8066-6c9bb7245bd7" status: 200 len: 1474 microversion: 2.1 time: 0.230136 Aug 10 23:06:20.410096 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1179/2376] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:06:20 2022] GET /compute/v2.1/servers/d65d59de-9c9c-47c6-8066-6c9bb7245bd7 => generated 1474 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:06:20.584603 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-6c485c7e-0b0b-4f0b-b497-2fc47290ea18 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:20.585223 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-6c485c7e-0b0b-4f0b-b497-2fc47290ea18 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] [instance: b3b3730c-1396-4ca6-9d9e-8a3104950324] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:06:20.594305 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6c485c7e-0b0b-4f0b-b497-2fc47290ea18 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:20.595051 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6c485c7e-0b0b-4f0b-b497-2fc47290ea18 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:20.596828 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6c485c7e-0b0b-4f0b-b497-2fc47290ea18 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:20.598029 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6c485c7e-0b0b-4f0b-b497-2fc47290ea18 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:20.598794 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6c485c7e-0b0b-4f0b-b497-2fc47290ea18 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:20.599389 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6c485c7e-0b0b-4f0b-b497-2fc47290ea18 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:20.617655 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-41d7938a-266d-4e3f-b41d-b98bf5200ab7 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8899e278c9453fba0ab05c69b0b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46ac8b84bd649fa88897068dbfa5ce6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:06:20.643330 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-41d7938a-266d-4e3f-b41d-b98bf5200ab7 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] 10.222.0.58 "GET /compute/v2.1/servers/662fba38-a52c-464c-8448-bfe0a1d78dab" status: 200 len: 1515 microversion: 2.1 time: 0.615456 Aug 10 23:06:20.645052 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1198/2377] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:06:20 2022] GET /compute/v2.1/servers/662fba38-a52c-464c-8448-bfe0a1d78dab => generated 1515 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:06:20.808195 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-ebbe127a-6dbb-452b-936b-7100f51ca946 tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:20.810934 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-ebbe127a-6dbb-452b-936b-7100f51ca946 tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] [instance: b9b9e57b-0669-46b6-afae-b5c439f688d2] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:06:20.840995 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ebbe127a-6dbb-452b-936b-7100f51ca946 tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:20.842729 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ebbe127a-6dbb-452b-936b-7100f51ca946 tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:20.844335 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ebbe127a-6dbb-452b-936b-7100f51ca946 tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:20.845975 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ebbe127a-6dbb-452b-936b-7100f51ca946 tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:20.847363 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ebbe127a-6dbb-452b-936b-7100f51ca946 tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:20.848452 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ebbe127a-6dbb-452b-936b-7100f51ca946 tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:21.078474 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-6c485c7e-0b0b-4f0b-b497-2fc47290ea18 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de244f1f82143a0b3d3283c31d80bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14c63df2e6c46d2af23b6b8a52690d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:06:21.091775 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-6c485c7e-0b0b-4f0b-b497-2fc47290ea18 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] 10.222.0.58 "GET /compute/v2.1/servers/b3b3730c-1396-4ca6-9d9e-8a3104950324" status: 200 len: 1472 microversion: 2.1 time: 0.514118 Aug 10 23:06:21.102819 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1180/2378] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:06:20 2022] GET /compute/v2.1/servers/b3b3730c-1396-4ca6-9d9e-8a3104950324 => generated 1472 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:06:21.102819 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-f03ebd40-032a-4cb4-aeb5-d4ebe9639c7d tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:21.102819 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-f03ebd40-032a-4cb4-aeb5-d4ebe9639c7d tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] [instance: 717a8812-6a48-49ad-baa8-0cf0fb41671d] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:06:21.113281 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f03ebd40-032a-4cb4-aeb5-d4ebe9639c7d tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:21.113805 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f03ebd40-032a-4cb4-aeb5-d4ebe9639c7d tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:21.114256 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f03ebd40-032a-4cb4-aeb5-d4ebe9639c7d tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:21.115032 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f03ebd40-032a-4cb4-aeb5-d4ebe9639c7d tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:21.115498 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f03ebd40-032a-4cb4-aeb5-d4ebe9639c7d tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:21.118503 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f03ebd40-032a-4cb4-aeb5-d4ebe9639c7d tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:21.464417 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-f03ebd40-032a-4cb4-aeb5-d4ebe9639c7d tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '933e6a08c3014b36aee164b213bbfaf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d6f13784504fc7b2fcf0d6957b4920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:06:21.482057 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-f03ebd40-032a-4cb4-aeb5-d4ebe9639c7d tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] 10.222.0.58 "GET /compute/v2.1/servers/717a8812-6a48-49ad-baa8-0cf0fb41671d" status: 200 len: 1526 microversion: 2.1 time: 0.385701 Aug 10 23:06:21.482722 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1181/2379] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:06:21 2022] GET /compute/v2.1/servers/717a8812-6a48-49ad-baa8-0cf0fb41671d => generated 1526 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:06:21.508304 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-4ad83f50-e943-4f9d-ab81-b8ce5114d289 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:21.509025 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-4ad83f50-e943-4f9d-ab81-b8ce5114d289 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] [instance: 45beadf1-a6da-49ab-9098-6b681b5184c9] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:06:21.539402 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4ad83f50-e943-4f9d-ab81-b8ce5114d289 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:21.539908 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4ad83f50-e943-4f9d-ab81-b8ce5114d289 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:21.540338 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4ad83f50-e943-4f9d-ab81-b8ce5114d289 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:21.544453 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4ad83f50-e943-4f9d-ab81-b8ce5114d289 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:21.545139 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4ad83f50-e943-4f9d-ab81-b8ce5114d289 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:21.545720 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4ad83f50-e943-4f9d-ab81-b8ce5114d289 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:22.007398 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-4ad83f50-e943-4f9d-ab81-b8ce5114d289 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1986185dc9b4df4affcc421365462f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597863bfebdc481188f1f30095da5396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:06:22.020308 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-ebbe127a-6dbb-452b-936b-7100f51ca946 tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9a2a5950cd342da86821122c08f028b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9960516a057e4f629fe5deb41e54d1d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:06:22.022714 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-4ad83f50-e943-4f9d-ab81-b8ce5114d289 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] 10.222.0.58 "GET /compute/v2.1/servers/45beadf1-a6da-49ab-9098-6b681b5184c9" status: 200 len: 1724 microversion: 2.1 time: 0.520620 Aug 10 23:06:22.023704 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1182/2380] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:06:21 2022] GET /compute/v2.1/servers/45beadf1-a6da-49ab-9098-6b681b5184c9 => generated 1724 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:06:22.029692 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-5889e797-d026-4396-8a20-f798f25d5db8 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:22.030511 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-5889e797-d026-4396-8a20-f798f25d5db8 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] [instance: d65d59de-9c9c-47c6-8066-6c9bb7245bd7] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:06:22.035205 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-ebbe127a-6dbb-452b-936b-7100f51ca946 tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] 10.222.0.58 "GET /compute/v2.1/servers/b9b9e57b-0669-46b6-afae-b5c439f688d2" status: 200 len: 1714 microversion: 2.1 time: 1.238507 Aug 10 23:06:22.043098 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5889e797-d026-4396-8a20-f798f25d5db8 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:22.045992 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5889e797-d026-4396-8a20-f798f25d5db8 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:22.046836 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5889e797-d026-4396-8a20-f798f25d5db8 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:22.048346 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5889e797-d026-4396-8a20-f798f25d5db8 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:22.050768 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5889e797-d026-4396-8a20-f798f25d5db8 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:22.052147 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1199/2381] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:06:20 2022] GET /compute/v2.1/servers/b9b9e57b-0669-46b6-afae-b5c439f688d2 => generated 1714 bytes in 1258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:06:22.054371 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5889e797-d026-4396-8a20-f798f25d5db8 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:22.063193 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-17099268-6243-4983-8850-8fa547d4a677 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:22.066765 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-17099268-6243-4983-8850-8fa547d4a677 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] [instance: 662fba38-a52c-464c-8448-bfe0a1d78dab] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:06:22.085660 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-17099268-6243-4983-8850-8fa547d4a677 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:22.086573 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-17099268-6243-4983-8850-8fa547d4a677 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:22.087400 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-17099268-6243-4983-8850-8fa547d4a677 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:22.088779 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-17099268-6243-4983-8850-8fa547d4a677 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:22.092271 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-17099268-6243-4983-8850-8fa547d4a677 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:22.092945 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-17099268-6243-4983-8850-8fa547d4a677 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:22.450659 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-17099268-6243-4983-8850-8fa547d4a677 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8899e278c9453fba0ab05c69b0b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46ac8b84bd649fa88897068dbfa5ce6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:06:22.465839 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-17099268-6243-4983-8850-8fa547d4a677 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] 10.222.0.58 "GET /compute/v2.1/servers/662fba38-a52c-464c-8448-bfe0a1d78dab" status: 200 len: 1515 microversion: 2.1 time: 0.412434 Aug 10 23:06:22.478987 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1200/2382] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:06:22 2022] GET /compute/v2.1/servers/662fba38-a52c-464c-8448-bfe0a1d78dab => generated 1515 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:06:22.486838 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-d7a10587-432f-46f6-a07c-e1a9a494b627 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:22.487898 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-d7a10587-432f-46f6-a07c-e1a9a494b627 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] [instance: b3b3730c-1396-4ca6-9d9e-8a3104950324] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:06:22.496518 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d7a10587-432f-46f6-a07c-e1a9a494b627 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:22.497469 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d7a10587-432f-46f6-a07c-e1a9a494b627 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:22.498207 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d7a10587-432f-46f6-a07c-e1a9a494b627 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:22.499422 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d7a10587-432f-46f6-a07c-e1a9a494b627 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:22.500162 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d7a10587-432f-46f6-a07c-e1a9a494b627 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:22.500862 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d7a10587-432f-46f6-a07c-e1a9a494b627 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:22.860540 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-d7a10587-432f-46f6-a07c-e1a9a494b627 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de244f1f82143a0b3d3283c31d80bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14c63df2e6c46d2af23b6b8a52690d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:06:22.874100 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-d7a10587-432f-46f6-a07c-e1a9a494b627 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] 10.222.0.58 "GET /compute/v2.1/servers/b3b3730c-1396-4ca6-9d9e-8a3104950324" status: 200 len: 1478 microversion: 2.1 time: 0.393772 Aug 10 23:06:22.875550 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1201/2383] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:06:22 2022] GET /compute/v2.1/servers/b3b3730c-1396-4ca6-9d9e-8a3104950324 => generated 1478 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:06:22.890668 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-46c50e10-41d5-4d2e-9500-7e1f1cb261dd tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:22.891638 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-46c50e10-41d5-4d2e-9500-7e1f1cb261dd tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] [instance: 717a8812-6a48-49ad-baa8-0cf0fb41671d] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:06:22.907449 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-46c50e10-41d5-4d2e-9500-7e1f1cb261dd tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:22.908226 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-46c50e10-41d5-4d2e-9500-7e1f1cb261dd tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:22.909441 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-46c50e10-41d5-4d2e-9500-7e1f1cb261dd tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:22.911429 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-46c50e10-41d5-4d2e-9500-7e1f1cb261dd tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:22.913218 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-46c50e10-41d5-4d2e-9500-7e1f1cb261dd tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:22.916453 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-46c50e10-41d5-4d2e-9500-7e1f1cb261dd tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:23.266057 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-46c50e10-41d5-4d2e-9500-7e1f1cb261dd tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '933e6a08c3014b36aee164b213bbfaf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13d6f13784504fc7b2fcf0d6957b4920', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:06:23.276227 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-46c50e10-41d5-4d2e-9500-7e1f1cb261dd tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] 10.222.0.58 "GET /compute/v2.1/servers/717a8812-6a48-49ad-baa8-0cf0fb41671d" status: 200 len: 1526 microversion: 2.1 time: 0.398188 Aug 10 23:06:23.296392 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1202/2384] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:06:22 2022] GET /compute/v2.1/servers/717a8812-6a48-49ad-baa8-0cf0fb41671d => generated 1526 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:06:23.317813 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-5889e797-d026-4396-8a20-f798f25d5db8 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a092c6b8aa444999c32d8be76cabd3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891f4d07d0af47b19c4f43b24ff0b7ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:06:23.360342 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-5889e797-d026-4396-8a20-f798f25d5db8 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] 10.222.0.58 "GET /compute/v2.1/servers/d65d59de-9c9c-47c6-8066-6c9bb7245bd7" status: 200 len: 1474 microversion: 2.1 time: 1.334661 Aug 10 23:06:23.364172 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1183/2385] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:06:22 2022] GET /compute/v2.1/servers/d65d59de-9c9c-47c6-8066-6c9bb7245bd7 => generated 1474 bytes in 1340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:06:23.385624 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-ccc4a383-b52b-4e99-8ddf-1995a6a1ebba tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:23.386875 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-ccc4a383-b52b-4e99-8ddf-1995a6a1ebba tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] [instance: 45beadf1-a6da-49ab-9098-6b681b5184c9] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:06:23.407006 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ccc4a383-b52b-4e99-8ddf-1995a6a1ebba tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:23.407760 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ccc4a383-b52b-4e99-8ddf-1995a6a1ebba tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:23.410826 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ccc4a383-b52b-4e99-8ddf-1995a6a1ebba tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:23.412084 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ccc4a383-b52b-4e99-8ddf-1995a6a1ebba tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:23.414116 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ccc4a383-b52b-4e99-8ddf-1995a6a1ebba tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:23.414769 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ccc4a383-b52b-4e99-8ddf-1995a6a1ebba tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:23.681593 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-22ea15d6-54a3-4f72-9fed-f3e09626212c req-3195eb6d-1a8e-4e58-82ed-f3816866193e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9b9e57b-0669-46b6-afae-b5c439f688d2", "name": "network-vif-deleted", "tag": "0291afb1-e014-41f8-9d03-ceea7b48df34"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:06:23.696738 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-22ea15d6-54a3-4f72-9fed-f3e09626212c req-3195eb6d-1a8e-4e58-82ed-f3816866193e service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:23.699230 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-22ea15d6-54a3-4f72-9fed-f3e09626212c req-3195eb6d-1a8e-4e58-82ed-f3816866193e service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:23.700607 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-ccc4a383-b52b-4e99-8ddf-1995a6a1ebba tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1986185dc9b4df4affcc421365462f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597863bfebdc481188f1f30095da5396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:06:23.700820 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-22ea15d6-54a3-4f72-9fed-f3e09626212c req-3195eb6d-1a8e-4e58-82ed-f3816866193e service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:23.720639 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-ccc4a383-b52b-4e99-8ddf-1995a6a1ebba tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] 10.222.0.58 "GET /compute/v2.1/servers/45beadf1-a6da-49ab-9098-6b681b5184c9" status: 200 len: 1701 microversion: 2.1 time: 0.355123 Aug 10 23:06:23.721335 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-22ea15d6-54a3-4f72-9fed-f3e09626212c req-3195eb6d-1a8e-4e58-82ed-f3816866193e service nova] Creating event network-vif-deleted:0291afb1-e014-41f8-9d03-ceea7b48df34 for instance b9b9e57b-0669-46b6-afae-b5c439f688d2 on n-h2-850468-14 Aug 10 23:06:23.721456 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1184/2386] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:06:23 2022] GET /compute/v2.1/servers/45beadf1-a6da-49ab-9098-6b681b5184c9 => generated 1701 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:06:23.727867 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-22ea15d6-54a3-4f72-9fed-f3e09626212c req-3195eb6d-1a8e-4e58-82ed-f3816866193e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.429250 Aug 10 23:06:23.733455 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1203/2387] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:06:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:06:23.740165 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-6f57de9a-5d2d-4f0d-8174-ae5ddf5ac710 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:23.741165 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-6f57de9a-5d2d-4f0d-8174-ae5ddf5ac710 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] [instance: 662fba38-a52c-464c-8448-bfe0a1d78dab] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:06:23.748896 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6f57de9a-5d2d-4f0d-8174-ae5ddf5ac710 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:23.749311 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6f57de9a-5d2d-4f0d-8174-ae5ddf5ac710 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:23.749593 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-d69ab60e-e312-4626-a2f2-8392f26b92de tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:23.749772 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6f57de9a-5d2d-4f0d-8174-ae5ddf5ac710 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:23.750271 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-d69ab60e-e312-4626-a2f2-8392f26b92de tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] [instance: b9b9e57b-0669-46b6-afae-b5c439f688d2] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:06:23.750448 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6f57de9a-5d2d-4f0d-8174-ae5ddf5ac710 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:23.750942 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6f57de9a-5d2d-4f0d-8174-ae5ddf5ac710 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:23.751418 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6f57de9a-5d2d-4f0d-8174-ae5ddf5ac710 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:23.773415 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d69ab60e-e312-4626-a2f2-8392f26b92de tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:23.774213 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d69ab60e-e312-4626-a2f2-8392f26b92de tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:23.774893 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d69ab60e-e312-4626-a2f2-8392f26b92de tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:23.775879 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d69ab60e-e312-4626-a2f2-8392f26b92de tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:23.787633 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d69ab60e-e312-4626-a2f2-8392f26b92de tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:23.788407 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d69ab60e-e312-4626-a2f2-8392f26b92de tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:23.812960 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-d69ab60e-e312-4626-a2f2-8392f26b92de tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] HTTP exception thrown: Instance b9b9e57b-0669-46b6-afae-b5c439f688d2 could not be found. Aug 10 23:06:23.815153 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-d69ab60e-e312-4626-a2f2-8392f26b92de tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Request method failure captured: Aug 10 23:06:23.815153 n-d-850468-14 devstack@n-api.service[122632]: request: GET /compute/v2.1/servers/b9b9e57b-0669-46b6-afae-b5c439f688d2 HTTP/1.1 Aug 10 23:06:23.815153 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:06:23.815153 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:06:23.815153 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:06:23.815153 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 23:06:23.815153 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:06:23.815153 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:06:23.815153 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:06:23.815153 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:06:23.815153 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9DmimYUT3VDPFlAZh9YQvXL4frkl4IIaABSE-2sTRqHZN3QIDcQ-pG0PROz9v14FA0Eb1H3t9L0HKtTvNURDJwWsvRqiF9EXkHi078h3WegBHMPzcNyOCuqdmBKfMIdptJndjE8xp7QgsCJL_6cVisqdWJT-9FSYDPMB5RI1ZQyzSKI Aug 10 23:06:23.815153 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:06:23.815153 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:06:23.815153 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:06:23.815153 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:06:23.815153 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:06:23.815153 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:06:23.815153 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 9960516a057e4f629fe5deb41e54d1d7 Aug 10 23:06:23.815153 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-ServersTestManualDisk-716121351 Aug 10 23:06:23.815153 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:06:23.815153 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:06:23.816666 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9960516a057e4f629fe5deb41e54d1d7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9960516a057e4f629fe5deb41e54d1d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/9960516a057e4f629fe5deb41e54d1d7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_9960516a057e4f629fe5deb41e54d1d7", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:06:23.816666 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-ServersTestManualDisk-716121351 Aug 10 23:06:23.816666 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 9960516a057e4f629fe5deb41e54d1d7 Aug 10 23:06:23.816666 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-ServersTestManualDisk-716121351 Aug 10 23:06:23.816666 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-ServersTestManualDisk-716121351-project Aug 10 23:06:23.816666 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:06:23.816666 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:06:23.816666 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: b9a2a5950cd342da86821122c08f028b Aug 10 23:06:23.816666 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-ServersTestManualDisk-716121351-project Aug 10 23:06:23.816666 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:06:23.816666 n-d-850468-14 devstack@n-api.service[122632]: exception: Instance b9b9e57b-0669-46b6-afae-b5c439f688d2 could not be found. Aug 10 23:06:23.816666 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': 'b9b9e57b-0669-46b6-afae-b5c439f688d2'} Aug 10 23:06:23.818322 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:06:23.818322 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:06:23.818322 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:06:23.818322 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:06:23.818322 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:06:23.818322 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:06:23.818322 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:06:23.818322 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:06:23.818322 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:06:23.818322 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:06:23.818322 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9b9e57b-0669-46b6-afae-b5c439f688d2 could not be found. Aug 10 23:06:23.818322 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:06:23.818322 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:06:23.818322 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:06:23.818322 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:06:23.818322 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:06:23.818322 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:06:23.818322 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:06:23.818322 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:06:23.818322 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:06:23.819702 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:06:23.819702 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:06:23.819702 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:06:23.819702 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:06:23.819702 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:06:23.819702 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:06:23.819702 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:06:23.819702 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9b9e57b-0669-46b6-afae-b5c439f688d2 could not be found. Aug 10 23:06:23.819702 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:06:23.819702 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:06:23.819702 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:06:23.819702 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:06:23.819702 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:06:23.819702 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:06:23.819702 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:06:23.819702 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:06:23.819702 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9b9e57b-0669-46b6-afae-b5c439f688d2 could not be found. Aug 10 23:06:23.819702 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:06:23.839730 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-d69ab60e-e312-4626-a2f2-8392f26b92de tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Returning 404 to user: Instance b9b9e57b-0669-46b6-afae-b5c439f688d2 could not be found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:06:23.841167 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-d69ab60e-e312-4626-a2f2-8392f26b92de tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] 10.222.0.58 "GET /compute/v2.1/servers/b9b9e57b-0669-46b6-afae-b5c439f688d2" status: 404 len: 111 microversion: 2.1 time: 0.104373 Aug 10 23:06:23.842203 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1185/2388] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:06:23 2022] GET /compute/v2.1/servers/b9b9e57b-0669-46b6-afae-b5c439f688d2 => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:06:23.848275 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-6b2cefd1-edba-4b2f-a47c-b995a0ad659a req-551c166b-f0b6-43f5-bc86-9eca2e5abf9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "717a8812-6a48-49ad-baa8-0cf0fb41671d", "name": "network-vif-deleted", "tag": "06ceffef-a360-4b97-8d79-f13f49f62568"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:06:23.869455 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-6b2cefd1-edba-4b2f-a47c-b995a0ad659a req-551c166b-f0b6-43f5-bc86-9eca2e5abf9c service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:23.870114 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-6b2cefd1-edba-4b2f-a47c-b995a0ad659a req-551c166b-f0b6-43f5-bc86-9eca2e5abf9c service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:23.870977 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-6b2cefd1-edba-4b2f-a47c-b995a0ad659a req-551c166b-f0b6-43f5-bc86-9eca2e5abf9c service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:23.899721 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-6b2cefd1-edba-4b2f-a47c-b995a0ad659a req-551c166b-f0b6-43f5-bc86-9eca2e5abf9c service nova] Creating event network-vif-deleted:06ceffef-a360-4b97-8d79-f13f49f62568 for instance 717a8812-6a48-49ad-baa8-0cf0fb41671d on n-h1-850468-14 Aug 10 23:06:23.912662 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-6b2cefd1-edba-4b2f-a47c-b995a0ad659a req-551c166b-f0b6-43f5-bc86-9eca2e5abf9c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061817 Aug 10 23:06:23.926934 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1186/2389] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:06:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:06:23.937417 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-88a3dad4-e61b-46c1-83e9-f58a26ff495a tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:06:23.957255 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-88a3dad4-e61b-46c1-83e9-f58a26ff495a tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:23.957679 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-88a3dad4-e61b-46c1-83e9-f58a26ff495a tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:23.958125 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-88a3dad4-e61b-46c1-83e9-f58a26ff495a tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:24.149067 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-88a3dad4-e61b-46c1-83e9-f58a26ff495a tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] [instance: 45beadf1-a6da-49ab-9098-6b681b5184c9] Going to try to start instance {{(pid=122632) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 10 23:06:24.155210 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-6f57de9a-5d2d-4f0d-8174-ae5ddf5ac710 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8899e278c9453fba0ab05c69b0b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46ac8b84bd649fa88897068dbfa5ce6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:06:24.170524 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-6f57de9a-5d2d-4f0d-8174-ae5ddf5ac710 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] 10.222.0.58 "GET /compute/v2.1/servers/662fba38-a52c-464c-8448-bfe0a1d78dab" status: 200 len: 1515 microversion: 2.1 time: 0.434419 Aug 10 23:06:24.174147 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1204/2390] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:06:23 2022] GET /compute/v2.1/servers/662fba38-a52c-464c-8448-bfe0a1d78dab => generated 1515 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:06:24.186296 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-e8f2aa00-9d1b-469a-8ef4-d4957f3a4b4e tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] Calling method '.version_select at 0x7f847d3baf70>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:24.262641 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-88a3dad4-e61b-46c1-83e9-f58a26ff495a tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] 10.222.0.58 "POST /compute/v2.1/servers/45beadf1-a6da-49ab-9098-6b681b5184c9/action" status: 202 len: 0 microversion: 2.1 time: 0.331724 Aug 10 23:06:24.264579 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1187/2391] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:06:23 2022] POST /compute/v2.1/servers/45beadf1-a6da-49ab-9098-6b681b5184c9/action => generated 0 bytes in 337 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:06:24.270679 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-1991753e-0f54-4aef-b54a-3b987ad5fc4a tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:24.271714 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-1991753e-0f54-4aef-b54a-3b987ad5fc4a tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] [instance: b3b3730c-1396-4ca6-9d9e-8a3104950324] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:06:24.280859 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-e8f2aa00-9d1b-469a-8ef4-d4957f3a4b4e tempest-ServersTestManualDisk-716121351 tempest-ServersTestManualDisk-716121351-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1883150369" status: 202 len: 0 microversion: 2.1 time: 0.104962 Aug 10 23:06:24.284789 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1205/2392] 10.222.0.58 () {58 vars in 1221 bytes} [Wed Aug 10 23:06:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1883150369 => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:06:24.291828 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-897a0a6e-a72e-4d24-b1d8-3e1101518a6c tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:24.292458 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-897a0a6e-a72e-4d24-b1d8-3e1101518a6c tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] [instance: 45beadf1-a6da-49ab-9098-6b681b5184c9] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:06:24.303334 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1991753e-0f54-4aef-b54a-3b987ad5fc4a tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:24.312885 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1991753e-0f54-4aef-b54a-3b987ad5fc4a tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:24.323375 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-897a0a6e-a72e-4d24-b1d8-3e1101518a6c tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:24.323880 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-897a0a6e-a72e-4d24-b1d8-3e1101518a6c tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:24.324318 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-897a0a6e-a72e-4d24-b1d8-3e1101518a6c tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:24.325036 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-897a0a6e-a72e-4d24-b1d8-3e1101518a6c tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:24.325485 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-897a0a6e-a72e-4d24-b1d8-3e1101518a6c tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:24.325906 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-897a0a6e-a72e-4d24-b1d8-3e1101518a6c tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:24.327519 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1991753e-0f54-4aef-b54a-3b987ad5fc4a tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:24.329993 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1991753e-0f54-4aef-b54a-3b987ad5fc4a tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:24.342748 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1991753e-0f54-4aef-b54a-3b987ad5fc4a tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:24.347070 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1991753e-0f54-4aef-b54a-3b987ad5fc4a tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:24.770585 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=4 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:06:24.968862 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-897a0a6e-a72e-4d24-b1d8-3e1101518a6c tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1986185dc9b4df4affcc421365462f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597863bfebdc481188f1f30095da5396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:06:24.985671 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-897a0a6e-a72e-4d24-b1d8-3e1101518a6c tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] 10.222.0.58 "GET /compute/v2.1/servers/45beadf1-a6da-49ab-9098-6b681b5184c9" status: 200 len: 1710 microversion: 2.1 time: 0.700583 Aug 10 23:06:24.988982 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1206/2393] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:06:24 2022] GET /compute/v2.1/servers/45beadf1-a6da-49ab-9098-6b681b5184c9 => generated 1710 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:06:24.999272 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-ba941cc2-025b-412a-ae23-3cee83dccc5d tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:25.001402 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-ba941cc2-025b-412a-ae23-3cee83dccc5d tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] [instance: 717a8812-6a48-49ad-baa8-0cf0fb41671d] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:06:25.021860 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ba941cc2-025b-412a-ae23-3cee83dccc5d tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:25.023774 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ba941cc2-025b-412a-ae23-3cee83dccc5d tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:25.026537 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ba941cc2-025b-412a-ae23-3cee83dccc5d tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:25.029818 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ba941cc2-025b-412a-ae23-3cee83dccc5d tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:25.030592 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ba941cc2-025b-412a-ae23-3cee83dccc5d tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:25.031646 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ba941cc2-025b-412a-ae23-3cee83dccc5d tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:25.088952 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-ba941cc2-025b-412a-ae23-3cee83dccc5d tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] HTTP exception thrown: Instance 717a8812-6a48-49ad-baa8-0cf0fb41671d could not be found. Aug 10 23:06:25.095336 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-ba941cc2-025b-412a-ae23-3cee83dccc5d tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Request method failure captured: Aug 10 23:06:25.095336 n-d-850468-14 devstack@n-api.service[122633]: request: GET /compute/v2.1/servers/717a8812-6a48-49ad-baa8-0cf0fb41671d HTTP/1.1 Aug 10 23:06:25.095336 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:06:25.095336 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:06:25.095336 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:06:25.095336 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:06:25.095336 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:06:25.095336 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:06:25.095336 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:06:25.095336 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:06:25.095336 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9DmnLPtDRZSGfL4AUMemFhJtzFt6s4rdfOdXQaCqDUHRqNo5yVfu_wv80eve_nwLCd4fbUvicTdreQF65GmSW3qJG8AC1ZEoHr5fP3QTdwCryQqIBkdTPl9_u9it646Rl2wU0V1GTXwmEFupip0dt8llfLtffk4ojegpINlnBKspO0U Aug 10 23:06:25.095336 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:06:25.095336 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:06:25.095336 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:06:25.095336 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:06:25.095336 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:06:25.095336 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:06:25.095336 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 13d6f13784504fc7b2fcf0d6957b4920 Aug 10 23:06:25.095336 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1294999711 Aug 10 23:06:25.095336 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:06:25.095336 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:06:25.097096 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/13d6f13784504fc7b2fcf0d6957b4920"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/13d6f13784504fc7b2fcf0d6957b4920"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/13d6f13784504fc7b2fcf0d6957b4920"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_13d6f13784504fc7b2fcf0d6957b4920", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:06:25.097096 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1294999711 Aug 10 23:06:25.097096 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 13d6f13784504fc7b2fcf0d6957b4920 Aug 10 23:06:25.097096 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1294999711 Aug 10 23:06:25.097096 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-FloatingIPsAssociationTestJSON-1294999711-project Aug 10 23:06:25.097096 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:06:25.097096 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:06:25.097096 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 933e6a08c3014b36aee164b213bbfaf0 Aug 10 23:06:25.097096 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1294999711-project Aug 10 23:06:25.097096 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:06:25.097096 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance 717a8812-6a48-49ad-baa8-0cf0fb41671d could not be found. Aug 10 23:06:25.097096 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': '717a8812-6a48-49ad-baa8-0cf0fb41671d'} Aug 10 23:06:25.098076 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:06:25.098076 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:06:25.098076 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:06:25.098076 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:06:25.098076 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:06:25.098076 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:06:25.098076 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:06:25.098076 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:06:25.098076 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:06:25.098076 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:06:25.098076 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 717a8812-6a48-49ad-baa8-0cf0fb41671d could not be found. Aug 10 23:06:25.098076 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:06:25.098076 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:06:25.098076 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:06:25.098076 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:06:25.098076 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:06:25.098076 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:06:25.098076 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:06:25.098076 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:06:25.098076 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:06:25.099519 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:06:25.099519 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:06:25.099519 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:06:25.099519 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:06:25.099519 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:06:25.099519 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:06:25.099519 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:06:25.099519 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 717a8812-6a48-49ad-baa8-0cf0fb41671d could not be found. Aug 10 23:06:25.099519 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:06:25.099519 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:06:25.099519 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:06:25.099519 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:06:25.099519 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:06:25.099519 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:06:25.099519 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:06:25.099519 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:06:25.099519 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 717a8812-6a48-49ad-baa8-0cf0fb41671d could not be found. Aug 10 23:06:25.099519 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:06:25.100752 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-1991753e-0f54-4aef-b54a-3b987ad5fc4a tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de244f1f82143a0b3d3283c31d80bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14c63df2e6c46d2af23b6b8a52690d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:06:25.105210 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-ba941cc2-025b-412a-ae23-3cee83dccc5d tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] Returning 404 to user: Instance 717a8812-6a48-49ad-baa8-0cf0fb41671d could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:06:25.106889 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-ba941cc2-025b-412a-ae23-3cee83dccc5d tempest-FloatingIPsAssociationTestJSON-1294999711 tempest-FloatingIPsAssociationTestJSON-1294999711-project] 10.222.0.58 "GET /compute/v2.1/servers/717a8812-6a48-49ad-baa8-0cf0fb41671d" status: 404 len: 111 microversion: 2.1 time: 0.116508 Aug 10 23:06:25.122289 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1207/2394] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:06:24 2022] GET /compute/v2.1/servers/717a8812-6a48-49ad-baa8-0cf0fb41671d => generated 111 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:06:25.132553 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-1991753e-0f54-4aef-b54a-3b987ad5fc4a tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] 10.222.0.58 "GET /compute/v2.1/servers/b3b3730c-1396-4ca6-9d9e-8a3104950324" status: 200 len: 1478 microversion: 2.1 time: 0.861976 Aug 10 23:06:25.135481 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1188/2395] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:06:24 2022] GET /compute/v2.1/servers/b3b3730c-1396-4ca6-9d9e-8a3104950324 => generated 1478 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:06:25.145662 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-19485bd5-be0a-4568-b459-4d55a012ee23 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:25.147223 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-19485bd5-be0a-4568-b459-4d55a012ee23 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] [instance: d65d59de-9c9c-47c6-8066-6c9bb7245bd7] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:06:25.191294 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-19485bd5-be0a-4568-b459-4d55a012ee23 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:25.194074 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-19485bd5-be0a-4568-b459-4d55a012ee23 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:25.195542 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-19485bd5-be0a-4568-b459-4d55a012ee23 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:25.195676 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-594f2640-d64d-453c-88ba-64cd2b1d58c0 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:25.196279 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-594f2640-d64d-453c-88ba-64cd2b1d58c0 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] [instance: 662fba38-a52c-464c-8448-bfe0a1d78dab] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:06:25.199952 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-19485bd5-be0a-4568-b459-4d55a012ee23 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:25.202544 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=2 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:06:25.202949 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-19485bd5-be0a-4568-b459-4d55a012ee23 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:25.205864 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-19485bd5-be0a-4568-b459-4d55a012ee23 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:25.213171 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-594f2640-d64d-453c-88ba-64cd2b1d58c0 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:25.216350 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-594f2640-d64d-453c-88ba-64cd2b1d58c0 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:25.216973 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-594f2640-d64d-453c-88ba-64cd2b1d58c0 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:25.222291 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-594f2640-d64d-453c-88ba-64cd2b1d58c0 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:25.222990 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-594f2640-d64d-453c-88ba-64cd2b1d58c0 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:25.223611 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-594f2640-d64d-453c-88ba-64cd2b1d58c0 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:25.244503 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:06:25.359667 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=2 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:06:25.396657 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-19485bd5-be0a-4568-b459-4d55a012ee23 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a092c6b8aa444999c32d8be76cabd3d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '891f4d07d0af47b19c4f43b24ff0b7ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:06:25.410580 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-19485bd5-be0a-4568-b459-4d55a012ee23 tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] 10.222.0.58 "GET /compute/v2.1/servers/d65d59de-9c9c-47c6-8066-6c9bb7245bd7" status: 200 len: 1303 microversion: 2.1 time: 0.280987 Aug 10 23:06:25.411761 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1208/2396] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:06:25 2022] GET /compute/v2.1/servers/d65d59de-9c9c-47c6-8066-6c9bb7245bd7 => generated 1303 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:06:26.021368 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-fe510a0f-e3ab-4e2e-8c0c-68f1373356d7 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:26.021987 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-fe510a0f-e3ab-4e2e-8c0c-68f1373356d7 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] [instance: 45beadf1-a6da-49ab-9098-6b681b5184c9] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:06:26.038693 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fe510a0f-e3ab-4e2e-8c0c-68f1373356d7 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:26.039564 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fe510a0f-e3ab-4e2e-8c0c-68f1373356d7 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:26.040163 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fe510a0f-e3ab-4e2e-8c0c-68f1373356d7 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:26.041747 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fe510a0f-e3ab-4e2e-8c0c-68f1373356d7 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:26.042498 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fe510a0f-e3ab-4e2e-8c0c-68f1373356d7 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:26.043127 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fe510a0f-e3ab-4e2e-8c0c-68f1373356d7 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:26.322982 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-fe510a0f-e3ab-4e2e-8c0c-68f1373356d7 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1986185dc9b4df4affcc421365462f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597863bfebdc481188f1f30095da5396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:06:26.336221 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-fe510a0f-e3ab-4e2e-8c0c-68f1373356d7 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] 10.222.0.58 "GET /compute/v2.1/servers/45beadf1-a6da-49ab-9098-6b681b5184c9" status: 200 len: 1710 microversion: 2.1 time: 0.326663 Aug 10 23:06:26.339949 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1209/2397] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:06:26 2022] GET /compute/v2.1/servers/45beadf1-a6da-49ab-9098-6b681b5184c9 => generated 1710 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:06:26.345474 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-affc2f41-5e8a-4d76-883b-fb5d2188d015 req-5c6423bb-0f59-4e4b-8ea8-fc94a9a7ce91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d65d59de-9c9c-47c6-8066-6c9bb7245bd7", "name": "network-vif-deleted", "tag": "3fd6cc75-f4e4-45be-83fa-b2b3034b0353"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:06:26.372401 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-affc2f41-5e8a-4d76-883b-fb5d2188d015 req-5c6423bb-0f59-4e4b-8ea8-fc94a9a7ce91 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:26.373141 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-affc2f41-5e8a-4d76-883b-fb5d2188d015 req-5c6423bb-0f59-4e4b-8ea8-fc94a9a7ce91 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:26.373858 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-affc2f41-5e8a-4d76-883b-fb5d2188d015 req-5c6423bb-0f59-4e4b-8ea8-fc94a9a7ce91 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:26.394362 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-affc2f41-5e8a-4d76-883b-fb5d2188d015 req-5c6423bb-0f59-4e4b-8ea8-fc94a9a7ce91 service nova] Creating event network-vif-deleted:3fd6cc75-f4e4-45be-83fa-b2b3034b0353 for instance d65d59de-9c9c-47c6-8066-6c9bb7245bd7 on n-h1-850468-14 Aug 10 23:06:26.401398 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-affc2f41-5e8a-4d76-883b-fb5d2188d015 req-5c6423bb-0f59-4e4b-8ea8-fc94a9a7ce91 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059764 Aug 10 23:06:26.404105 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1210/2398] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:06:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:06:26.415228 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-40d61744-ff04-4d7d-8897-66df7ee0fee6 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:26.425196 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-40d61744-ff04-4d7d-8897-66df7ee0fee6 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] [instance: b3b3730c-1396-4ca6-9d9e-8a3104950324] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:06:26.443054 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-40d61744-ff04-4d7d-8897-66df7ee0fee6 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:26.443707 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-40d61744-ff04-4d7d-8897-66df7ee0fee6 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:26.444378 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-40d61744-ff04-4d7d-8897-66df7ee0fee6 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:26.445379 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-40d61744-ff04-4d7d-8897-66df7ee0fee6 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:26.448126 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-40d61744-ff04-4d7d-8897-66df7ee0fee6 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:26.448668 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-40d61744-ff04-4d7d-8897-66df7ee0fee6 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:26.473194 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-594f2640-d64d-453c-88ba-64cd2b1d58c0 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8899e278c9453fba0ab05c69b0b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46ac8b84bd649fa88897068dbfa5ce6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:06:26.482177 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-594f2640-d64d-453c-88ba-64cd2b1d58c0 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] 10.222.0.58 "GET /compute/v2.1/servers/662fba38-a52c-464c-8448-bfe0a1d78dab" status: 200 len: 1515 microversion: 2.1 time: 1.289729 Aug 10 23:06:26.482813 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1189/2399] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:06:25 2022] GET /compute/v2.1/servers/662fba38-a52c-464c-8448-bfe0a1d78dab => generated 1515 bytes in 1291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:06:26.488129 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-b9287334-e4aa-4a2a-be57-18b76b4ef39b tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:26.495178 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-b9287334-e4aa-4a2a-be57-18b76b4ef39b tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] [instance: d65d59de-9c9c-47c6-8066-6c9bb7245bd7] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:06:26.502529 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b9287334-e4aa-4a2a-be57-18b76b4ef39b tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:26.503263 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b9287334-e4aa-4a2a-be57-18b76b4ef39b tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:26.503867 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b9287334-e4aa-4a2a-be57-18b76b4ef39b tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:26.504757 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b9287334-e4aa-4a2a-be57-18b76b4ef39b tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:26.505377 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b9287334-e4aa-4a2a-be57-18b76b4ef39b tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:26.506202 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b9287334-e4aa-4a2a-be57-18b76b4ef39b tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:26.532458 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-b9287334-e4aa-4a2a-be57-18b76b4ef39b tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] HTTP exception thrown: Instance d65d59de-9c9c-47c6-8066-6c9bb7245bd7 could not be found. Aug 10 23:06:26.535178 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-b9287334-e4aa-4a2a-be57-18b76b4ef39b tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Request method failure captured: Aug 10 23:06:26.535178 n-d-850468-14 devstack@n-api.service[122632]: request: GET /compute/v2.1/servers/d65d59de-9c9c-47c6-8066-6c9bb7245bd7 HTTP/1.1 Aug 10 23:06:26.535178 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:06:26.535178 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:06:26.535178 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:06:26.535178 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 23:06:26.535178 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:06:26.535178 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:06:26.535178 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:06:26.535178 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:06:26.535178 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9Dm4hPKY0GprFinN7qrQ_eu4_ssxfzyeAqNBbMw40z172K1CrFnKw0BfJUklvUKTDQoDQTTbZhCjLE1uqiIOOxIy55GeICRmPq7RP3PWZedjrjLFi3taGnSoa9qln-1ZXX3dVkeDMFkg1jdxH7XHPC3RBmi5Rj2cB23lxnrMvgVqJlI Aug 10 23:06:26.535178 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:06:26.535178 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:06:26.535178 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:06:26.535178 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:06:26.535178 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:06:26.535178 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:06:26.535178 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 891f4d07d0af47b19c4f43b24ff0b7ef Aug 10 23:06:26.535178 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-LiveMigrationNegativeTest-705841583 Aug 10 23:06:26.535178 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:06:26.535178 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:06:26.536533 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/891f4d07d0af47b19c4f43b24ff0b7ef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/891f4d07d0af47b19c4f43b24ff0b7ef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/891f4d07d0af47b19c4f43b24ff0b7ef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_891f4d07d0af47b19c4f43b24ff0b7ef", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:06:26.536533 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-LiveMigrationNegativeTest-705841583 Aug 10 23:06:26.536533 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 891f4d07d0af47b19c4f43b24ff0b7ef Aug 10 23:06:26.536533 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-705841583 Aug 10 23:06:26.536533 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-LiveMigrationNegativeTest-705841583-project Aug 10 23:06:26.536533 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:06:26.536533 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:06:26.536533 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: 1a092c6b8aa444999c32d8be76cabd3d Aug 10 23:06:26.536533 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-LiveMigrationNegativeTest-705841583-project Aug 10 23:06:26.536533 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:06:26.536533 n-d-850468-14 devstack@n-api.service[122632]: exception: Instance d65d59de-9c9c-47c6-8066-6c9bb7245bd7 could not be found. Aug 10 23:06:26.536533 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': 'd65d59de-9c9c-47c6-8066-6c9bb7245bd7'} Aug 10 23:06:26.537216 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:06:26.537216 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:06:26.537216 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:06:26.537216 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:06:26.537216 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:06:26.537216 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:06:26.537216 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:06:26.537216 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:06:26.537216 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:06:26.537216 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:06:26.537216 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d65d59de-9c9c-47c6-8066-6c9bb7245bd7 could not be found. Aug 10 23:06:26.537216 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:06:26.537216 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:06:26.537216 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:06:26.537216 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:06:26.537216 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:06:26.537216 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:06:26.537216 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:06:26.537216 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:06:26.537216 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:06:26.538394 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:06:26.538394 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:06:26.538394 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:06:26.538394 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:06:26.538394 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:06:26.538394 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:06:26.538394 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:06:26.538394 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d65d59de-9c9c-47c6-8066-6c9bb7245bd7 could not be found. Aug 10 23:06:26.538394 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:06:26.538394 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:06:26.538394 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:06:26.538394 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:06:26.538394 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:06:26.538394 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:06:26.538394 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:06:26.538394 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:06:26.538394 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d65d59de-9c9c-47c6-8066-6c9bb7245bd7 could not be found. Aug 10 23:06:26.538394 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:06:26.541246 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-b9287334-e4aa-4a2a-be57-18b76b4ef39b tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] Returning 404 to user: Instance d65d59de-9c9c-47c6-8066-6c9bb7245bd7 could not be found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:06:26.542356 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-b9287334-e4aa-4a2a-be57-18b76b4ef39b tempest-LiveMigrationNegativeTest-705841583 tempest-LiveMigrationNegativeTest-705841583-project] 10.222.0.58 "GET /compute/v2.1/servers/d65d59de-9c9c-47c6-8066-6c9bb7245bd7" status: 404 len: 111 microversion: 2.1 time: 0.058242 Aug 10 23:06:26.547178 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1190/2400] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:06:26 2022] GET /compute/v2.1/servers/d65d59de-9c9c-47c6-8066-6c9bb7245bd7 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:06:26.687688 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-40d61744-ff04-4d7d-8897-66df7ee0fee6 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de244f1f82143a0b3d3283c31d80bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14c63df2e6c46d2af23b6b8a52690d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:06:26.709527 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-40d61744-ff04-4d7d-8897-66df7ee0fee6 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] 10.222.0.58 "GET /compute/v2.1/servers/b3b3730c-1396-4ca6-9d9e-8a3104950324" status: 200 len: 1478 microversion: 2.1 time: 0.303880 Aug 10 23:06:26.711046 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1211/2401] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:06:26 2022] GET /compute/v2.1/servers/b3b3730c-1396-4ca6-9d9e-8a3104950324 => generated 1478 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:06:26.793490 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-ef57b115-b790-47d9-8e3a-17f7d78ae6cb tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-75880254", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452", "networks": [{"uuid": "f7736e2a-01c1-477a-9db3-13c95b60f71d"}, {"uuid": "985304a7-4efc-4d31-8481-c06a5176383e"}, {"uuid": "f7736e2a-01c1-477a-9db3-13c95b60f71d"}]}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:06:26.806315 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=4 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:06:26.910609 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.network.neutron [None req-ef57b115-b790-47d9-8e3a-17f7d78ae6cb tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] validate_networks() for [('f7736e2a-01c1-477a-9db3-13c95b60f71d', None, None, None, None, None), ('985304a7-4efc-4d31-8481-c06a5176383e', None, None, None, None, None), ('f7736e2a-01c1-477a-9db3-13c95b60f71d', None, None, None, None, None)] {{(pid=122632) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 23:06:27.362575 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-e15f7896-7058-4b6f-ab5d-8a5913678193 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:27.363516 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-e15f7896-7058-4b6f-ab5d-8a5913678193 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] [instance: 45beadf1-a6da-49ab-9098-6b681b5184c9] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:06:27.375027 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e15f7896-7058-4b6f-ab5d-8a5913678193 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:27.377175 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e15f7896-7058-4b6f-ab5d-8a5913678193 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:27.379025 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e15f7896-7058-4b6f-ab5d-8a5913678193 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:27.379805 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e15f7896-7058-4b6f-ab5d-8a5913678193 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:27.380274 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e15f7896-7058-4b6f-ab5d-8a5913678193 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:27.380696 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e15f7896-7058-4b6f-ab5d-8a5913678193 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:27.847617 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-e15f7896-7058-4b6f-ab5d-8a5913678193 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1986185dc9b4df4affcc421365462f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597863bfebdc481188f1f30095da5396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:06:27.863347 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-e15f7896-7058-4b6f-ab5d-8a5913678193 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] 10.222.0.58 "GET /compute/v2.1/servers/45beadf1-a6da-49ab-9098-6b681b5184c9" status: 200 len: 1710 microversion: 2.1 time: 0.504515 Aug 10 23:06:27.875469 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1212/2402] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:06:27 2022] GET /compute/v2.1/servers/45beadf1-a6da-49ab-9098-6b681b5184c9 => generated 1710 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:06:27.894403 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-df73f249-618d-4731-8741-ff4616748077 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:27.896283 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-df73f249-618d-4731-8741-ff4616748077 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] [instance: 662fba38-a52c-464c-8448-bfe0a1d78dab] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:06:27.917220 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-df73f249-618d-4731-8741-ff4616748077 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:27.917880 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-df73f249-618d-4731-8741-ff4616748077 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:27.918330 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-df73f249-618d-4731-8741-ff4616748077 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:27.919108 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-df73f249-618d-4731-8741-ff4616748077 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:27.919561 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-df73f249-618d-4731-8741-ff4616748077 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:27.919987 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-df73f249-618d-4731-8741-ff4616748077 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:28.576645 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-df73f249-618d-4731-8741-ff4616748077 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8899e278c9453fba0ab05c69b0b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46ac8b84bd649fa88897068dbfa5ce6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:06:28.600742 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-df73f249-618d-4731-8741-ff4616748077 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] 10.222.0.58 "GET /compute/v2.1/servers/662fba38-a52c-464c-8448-bfe0a1d78dab" status: 200 len: 1515 microversion: 2.1 time: 0.722974 Aug 10 23:06:28.602183 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1213/2403] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:06:27 2022] GET /compute/v2.1/servers/662fba38-a52c-464c-8448-bfe0a1d78dab => generated 1515 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:06:28.608248 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-19711b5e-7d75-4fe8-b239-14912e012817 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:28.609306 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-19711b5e-7d75-4fe8-b239-14912e012817 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] [instance: b3b3730c-1396-4ca6-9d9e-8a3104950324] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:06:28.637172 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-19711b5e-7d75-4fe8-b239-14912e012817 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:28.638198 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-19711b5e-7d75-4fe8-b239-14912e012817 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:28.639924 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-19711b5e-7d75-4fe8-b239-14912e012817 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:28.641004 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-19711b5e-7d75-4fe8-b239-14912e012817 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:28.641717 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-19711b5e-7d75-4fe8-b239-14912e012817 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:28.642986 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-19711b5e-7d75-4fe8-b239-14912e012817 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:29.033858 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-19711b5e-7d75-4fe8-b239-14912e012817 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de244f1f82143a0b3d3283c31d80bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14c63df2e6c46d2af23b6b8a52690d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:06:29.049852 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-19711b5e-7d75-4fe8-b239-14912e012817 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] 10.222.0.58 "GET /compute/v2.1/servers/b3b3730c-1396-4ca6-9d9e-8a3104950324" status: 200 len: 1478 microversion: 2.1 time: 0.445028 Aug 10 23:06:29.050753 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1214/2404] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:06:28 2022] GET /compute/v2.1/servers/b3b3730c-1396-4ca6-9d9e-8a3104950324 => generated 1478 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:06:29.062471 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-2f99257a-3202-4c24-b3e5-e46b028440dc tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:29.067871 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-2f99257a-3202-4c24-b3e5-e46b028440dc tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] [instance: 45beadf1-a6da-49ab-9098-6b681b5184c9] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:06:29.080946 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2f99257a-3202-4c24-b3e5-e46b028440dc tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:29.081785 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2f99257a-3202-4c24-b3e5-e46b028440dc tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:29.084052 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2f99257a-3202-4c24-b3e5-e46b028440dc tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:29.086489 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2f99257a-3202-4c24-b3e5-e46b028440dc tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:29.094040 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2f99257a-3202-4c24-b3e5-e46b028440dc tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:29.095410 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2f99257a-3202-4c24-b3e5-e46b028440dc tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:29.605996 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-2f99257a-3202-4c24-b3e5-e46b028440dc tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1986185dc9b4df4affcc421365462f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597863bfebdc481188f1f30095da5396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:06:29.640215 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-2f99257a-3202-4c24-b3e5-e46b028440dc tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] 10.222.0.58 "GET /compute/v2.1/servers/45beadf1-a6da-49ab-9098-6b681b5184c9" status: 200 len: 1714 microversion: 2.1 time: 0.562809 Aug 10 23:06:29.644979 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1215/2405] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:06:29 2022] GET /compute/v2.1/servers/45beadf1-a6da-49ab-9098-6b681b5184c9 => generated 1714 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:06:30.115479 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-57775687-2284-4659-8c70-e0e7f6ccea12 req-eb8153b6-db19-488e-a6b3-ecf65cf6beec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3b3730c-1396-4ca6-9d9e-8a3104950324", "name": "network-vif-plugged", "status": "completed", "tag": "aee4dd1c-12e7-4581-960e-4729757cc898"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:06:30.135910 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-57775687-2284-4659-8c70-e0e7f6ccea12 req-eb8153b6-db19-488e-a6b3-ecf65cf6beec service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:30.136406 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-57775687-2284-4659-8c70-e0e7f6ccea12 req-eb8153b6-db19-488e-a6b3-ecf65cf6beec service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:30.136855 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-57775687-2284-4659-8c70-e0e7f6ccea12 req-eb8153b6-db19-488e-a6b3-ecf65cf6beec service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:30.176568 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-57775687-2284-4659-8c70-e0e7f6ccea12 req-eb8153b6-db19-488e-a6b3-ecf65cf6beec service nova] Creating event network-vif-plugged:aee4dd1c-12e7-4581-960e-4729757cc898 for instance b3b3730c-1396-4ca6-9d9e-8a3104950324 on n-h1-850468-14 Aug 10 23:06:30.193750 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-57775687-2284-4659-8c70-e0e7f6ccea12 req-eb8153b6-db19-488e-a6b3-ecf65cf6beec service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.541778 Aug 10 23:06:30.195062 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1216/2406] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:06:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:06:30.211757 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-aea747f3-2aa3-400f-923a-6035a980e11f tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:30.227936 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-aea747f3-2aa3-400f-923a-6035a980e11f tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] [instance: 662fba38-a52c-464c-8448-bfe0a1d78dab] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:06:30.260882 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-aea747f3-2aa3-400f-923a-6035a980e11f tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:30.261664 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-aea747f3-2aa3-400f-923a-6035a980e11f tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:30.263914 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-aea747f3-2aa3-400f-923a-6035a980e11f tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:30.265460 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-aea747f3-2aa3-400f-923a-6035a980e11f tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:30.268303 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-aea747f3-2aa3-400f-923a-6035a980e11f tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:30.269427 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-aea747f3-2aa3-400f-923a-6035a980e11f tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:30.361713 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-ef57b115-b790-47d9-8e3a-17f7d78ae6cb tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Flavor limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:06:30.362270 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-ef57b115-b790-47d9-8e3a-17f7d78ae6cb tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Image limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:06:30.362890 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-ef57b115-b790-47d9-8e3a-17f7d78ae6cb tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Flavor pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:06:30.363409 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-ef57b115-b790-47d9-8e3a-17f7d78ae6cb tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Image pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:06:30.364035 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-ef57b115-b790-47d9-8e3a-17f7d78ae6cb tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:06:30.389747 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ef57b115-b790-47d9-8e3a-17f7d78ae6cb tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:30.391093 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ef57b115-b790-47d9-8e3a-17f7d78ae6cb tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:30.393622 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ef57b115-b790-47d9-8e3a-17f7d78ae6cb tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:30.402394 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ef57b115-b790-47d9-8e3a-17f7d78ae6cb tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:30.407859 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ef57b115-b790-47d9-8e3a-17f7d78ae6cb tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:30.408598 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ef57b115-b790-47d9-8e3a-17f7d78ae6cb tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:30.439771 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:06:30.454994 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-ef57b115-b790-47d9-8e3a-17f7d78ae6cb tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Getting quotas for project c6473e36eada44e6bca8dc568e5ee330. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:06:30.467376 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-ef57b115-b790-47d9-8e3a-17f7d78ae6cb tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Getting quotas for user a1c6e1f505b8409ea38f8a07bad870a8 and project c6473e36eada44e6bca8dc568e5ee330. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:06:30.496614 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-ef57b115-b790-47d9-8e3a-17f7d78ae6cb tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Going to run 1 instances... {{(pid=122632) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 23:06:30.501451 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-ef57b115-b790-47d9-8e3a-17f7d78ae6cb tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] [instance: 092f973f-79e3-44bf-a2e0-f7d3bfddf42c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78ad8905-f66f-4733-8be9-2b260f1fabed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122632) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 23:06:30.626059 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-ef57b115-b790-47d9-8e3a-17f7d78ae6cb tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.837727 Aug 10 23:06:30.635242 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1191/2407] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 23:06:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 3846 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 23:06:30.663023 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-25a8f640-c740-4f7c-82fa-3106d61fda8f tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:30.663967 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-25a8f640-c740-4f7c-82fa-3106d61fda8f tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] [instance: b3b3730c-1396-4ca6-9d9e-8a3104950324] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:06:30.691468 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-25a8f640-c740-4f7c-82fa-3106d61fda8f tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:30.692546 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-25a8f640-c740-4f7c-82fa-3106d61fda8f tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:30.693174 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-25a8f640-c740-4f7c-82fa-3106d61fda8f tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:30.694286 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-25a8f640-c740-4f7c-82fa-3106d61fda8f tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:30.694933 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-25a8f640-c740-4f7c-82fa-3106d61fda8f tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:30.695741 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-25a8f640-c740-4f7c-82fa-3106d61fda8f tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:31.490088 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-aea747f3-2aa3-400f-923a-6035a980e11f tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8899e278c9453fba0ab05c69b0b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46ac8b84bd649fa88897068dbfa5ce6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:06:31.513552 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-aea747f3-2aa3-400f-923a-6035a980e11f tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] 10.222.0.58 "GET /compute/v2.1/servers/662fba38-a52c-464c-8448-bfe0a1d78dab" status: 200 len: 1521 microversion: 2.1 time: 1.312747 Aug 10 23:06:31.514387 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1217/2408] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:06:30 2022] GET /compute/v2.1/servers/662fba38-a52c-464c-8448-bfe0a1d78dab => generated 1521 bytes in 1318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:06:31.525074 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-b4cf2a8e-a167-465c-99e8-aceed8d1cbe1 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:31.538960 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-b4cf2a8e-a167-465c-99e8-aceed8d1cbe1 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] [instance: 092f973f-79e3-44bf-a2e0-f7d3bfddf42c] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:06:31.767293 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-b4cf2a8e-a167-465c-99e8-aceed8d1cbe1 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c6e1f505b8409ea38f8a07bad870a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6473e36eada44e6bca8dc568e5ee330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:06:31.793498 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-b4cf2a8e-a167-465c-99e8-aceed8d1cbe1 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] 10.222.0.58 "GET /compute/v2.1/servers/092f973f-79e3-44bf-a2e0-f7d3bfddf42c" status: 200 len: 1211 microversion: 2.1 time: 0.277320 Aug 10 23:06:31.796827 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1218/2409] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:06:31 2022] GET /compute/v2.1/servers/092f973f-79e3-44bf-a2e0-f7d3bfddf42c => generated 1211 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:06:32.360931 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-25a8f640-c740-4f7c-82fa-3106d61fda8f tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de244f1f82143a0b3d3283c31d80bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14c63df2e6c46d2af23b6b8a52690d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:06:32.372953 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-25a8f640-c740-4f7c-82fa-3106d61fda8f tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] 10.222.0.58 "GET /compute/v2.1/servers/b3b3730c-1396-4ca6-9d9e-8a3104950324" status: 200 len: 1478 microversion: 2.1 time: 1.736295 Aug 10 23:06:32.391484 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1192/2410] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:06:30 2022] GET /compute/v2.1/servers/b3b3730c-1396-4ca6-9d9e-8a3104950324 => generated 1478 bytes in 1755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:06:32.537284 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-a7f91276-318e-45b4-988c-374ddff1d50f tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:32.538423 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-a7f91276-318e-45b4-988c-374ddff1d50f tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] [instance: 662fba38-a52c-464c-8448-bfe0a1d78dab] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:06:32.563245 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a7f91276-318e-45b4-988c-374ddff1d50f tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:32.569946 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a7f91276-318e-45b4-988c-374ddff1d50f tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:32.571349 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a7f91276-318e-45b4-988c-374ddff1d50f tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:32.579614 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a7f91276-318e-45b4-988c-374ddff1d50f tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:32.582609 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a7f91276-318e-45b4-988c-374ddff1d50f tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:32.583379 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a7f91276-318e-45b4-988c-374ddff1d50f tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:32.818047 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c942c7a1-c288-4d83-8399-45b80c0f1821 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:32.818913 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-c942c7a1-c288-4d83-8399-45b80c0f1821 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] [instance: 092f973f-79e3-44bf-a2e0-f7d3bfddf42c] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:06:32.840138 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c942c7a1-c288-4d83-8399-45b80c0f1821 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:32.849237 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c942c7a1-c288-4d83-8399-45b80c0f1821 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:32.850296 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c942c7a1-c288-4d83-8399-45b80c0f1821 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:32.852181 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c942c7a1-c288-4d83-8399-45b80c0f1821 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:32.852670 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c942c7a1-c288-4d83-8399-45b80c0f1821 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:32.859646 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c942c7a1-c288-4d83-8399-45b80c0f1821 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:33.086068 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-c942c7a1-c288-4d83-8399-45b80c0f1821 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c6e1f505b8409ea38f8a07bad870a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6473e36eada44e6bca8dc568e5ee330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:06:33.099522 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-c942c7a1-c288-4d83-8399-45b80c0f1821 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] 10.222.0.58 "GET /compute/v2.1/servers/092f973f-79e3-44bf-a2e0-f7d3bfddf42c" status: 200 len: 1281 microversion: 2.1 time: 0.286246 Aug 10 23:06:33.116971 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1193/2411] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:06:32 2022] GET /compute/v2.1/servers/092f973f-79e3-44bf-a2e0-f7d3bfddf42c => generated 1281 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:06:33.419777 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-a7f91276-318e-45b4-988c-374ddff1d50f tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8899e278c9453fba0ab05c69b0b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46ac8b84bd649fa88897068dbfa5ce6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:06:33.442772 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-a7f91276-318e-45b4-988c-374ddff1d50f tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] 10.222.0.58 "GET /compute/v2.1/servers/662fba38-a52c-464c-8448-bfe0a1d78dab" status: 200 len: 1521 microversion: 2.1 time: 0.909028 Aug 10 23:06:33.461940 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1219/2412] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:06:32 2022] GET /compute/v2.1/servers/662fba38-a52c-464c-8448-bfe0a1d78dab => generated 1521 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:06:33.474918 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-66ac1584-c04f-426e-bff8-3274a923e88c tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:33.475856 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-66ac1584-c04f-426e-bff8-3274a923e88c tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] [instance: b3b3730c-1396-4ca6-9d9e-8a3104950324] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:06:33.487664 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-66ac1584-c04f-426e-bff8-3274a923e88c tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:33.488604 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-66ac1584-c04f-426e-bff8-3274a923e88c tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:33.489837 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-66ac1584-c04f-426e-bff8-3274a923e88c tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:33.490818 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-66ac1584-c04f-426e-bff8-3274a923e88c tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:33.491525 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-66ac1584-c04f-426e-bff8-3274a923e88c tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:33.493622 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-66ac1584-c04f-426e-bff8-3274a923e88c tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:33.571385 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-11cc24e2-62cf-4fcd-b4d9-df461924380b tempest-QuotasAdminTestJSON-802344082 tempest-QuotasAdminTestJSON-802344082-project-admin] Calling method '.version_select at 0x7f8482534f70>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:34.071259 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-11cc24e2-62cf-4fcd-b4d9-df461924380b tempest-QuotasAdminTestJSON-802344082 tempest-QuotasAdminTestJSON-802344082-project-admin] 10.222.0.58 "GET /compute/v2.1/os-quota-sets/2c1b6473152f48dab6ba02fafbf2e460" status: 200 len: 371 microversion: 2.1 time: 0.709802 Aug 10 23:06:34.072742 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1194/2413] 10.222.0.58 () {58 vars in 1242 bytes} [Wed Aug 10 23:06:33 2022] GET /compute/v2.1/os-quota-sets/2c1b6473152f48dab6ba02fafbf2e460 => generated 371 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 23:06:34.088395 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-abcee754-6f9f-41bb-80e0-58d3f94390d2 tempest-QuotasAdminTestJSON-802344082 tempest-QuotasAdminTestJSON-802344082-project-admin] Action: 'update', calling method: .version_select at 0x7f847d028550>, body: {"quota_set": {"ram": "5120"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:06:34.097622 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-66ac1584-c04f-426e-bff8-3274a923e88c tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de244f1f82143a0b3d3283c31d80bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14c63df2e6c46d2af23b6b8a52690d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:06:34.114806 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-66ac1584-c04f-426e-bff8-3274a923e88c tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] 10.222.0.58 "GET /compute/v2.1/servers/b3b3730c-1396-4ca6-9d9e-8a3104950324" status: 200 len: 1463 microversion: 2.1 time: 0.647931 Aug 10 23:06:34.115646 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1220/2414] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:06:33 2022] GET /compute/v2.1/servers/b3b3730c-1396-4ca6-9d9e-8a3104950324 => generated 1463 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:06:34.131347 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-f79a54ee-fdf2-4843-91f5-59e0365a9117 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:34.132116 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-f79a54ee-fdf2-4843-91f5-59e0365a9117 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] [instance: 092f973f-79e3-44bf-a2e0-f7d3bfddf42c] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:06:34.149236 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f79a54ee-fdf2-4843-91f5-59e0365a9117 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:34.149860 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f79a54ee-fdf2-4843-91f5-59e0365a9117 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:34.150993 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f79a54ee-fdf2-4843-91f5-59e0365a9117 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:34.151821 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f79a54ee-fdf2-4843-91f5-59e0365a9117 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:34.152351 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f79a54ee-fdf2-4843-91f5-59e0365a9117 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:34.155183 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f79a54ee-fdf2-4843-91f5-59e0365a9117 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:34.362164 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-f79a54ee-fdf2-4843-91f5-59e0365a9117 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c6e1f505b8409ea38f8a07bad870a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6473e36eada44e6bca8dc568e5ee330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:06:34.370920 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-f79a54ee-fdf2-4843-91f5-59e0365a9117 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] 10.222.0.58 "GET /compute/v2.1/servers/092f973f-79e3-44bf-a2e0-f7d3bfddf42c" status: 200 len: 1269 microversion: 2.1 time: 0.249180 Aug 10 23:06:34.375857 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1221/2415] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:06:34 2022] GET /compute/v2.1/servers/092f973f-79e3-44bf-a2e0-f7d3bfddf42c => generated 1269 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:06:34.378555 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-abcee754-6f9f-41bb-80e0-58d3f94390d2 tempest-QuotasAdminTestJSON-802344082 tempest-QuotasAdminTestJSON-802344082-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:34.379262 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-abcee754-6f9f-41bb-80e0-58d3f94390d2 tempest-QuotasAdminTestJSON-802344082 tempest-QuotasAdminTestJSON-802344082-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:34.379847 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-abcee754-6f9f-41bb-80e0-58d3f94390d2 tempest-QuotasAdminTestJSON-802344082 tempest-QuotasAdminTestJSON-802344082-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:34.380801 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-abcee754-6f9f-41bb-80e0-58d3f94390d2 tempest-QuotasAdminTestJSON-802344082 tempest-QuotasAdminTestJSON-802344082-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:34.381005 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-bd8e170e-8fe0-43f1-9291-53e046eea2ad tempest-ServersAdminTestJSON-1449791209 tempest-ServersAdminTestJSON-1449791209-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:06:34.381573 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-abcee754-6f9f-41bb-80e0-58d3f94390d2 tempest-QuotasAdminTestJSON-802344082 tempest-QuotasAdminTestJSON-802344082-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:34.382728 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-abcee754-6f9f-41bb-80e0-58d3f94390d2 tempest-QuotasAdminTestJSON-802344082 tempest-QuotasAdminTestJSON-802344082-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:34.383426 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-bd8e170e-8fe0-43f1-9291-53e046eea2ad tempest-ServersAdminTestJSON-1449791209 tempest-ServersAdminTestJSON-1449791209-project-admin] [instance: b3b3730c-1396-4ca6-9d9e-8a3104950324] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:06:34.408009 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bd8e170e-8fe0-43f1-9291-53e046eea2ad tempest-ServersAdminTestJSON-1449791209 tempest-ServersAdminTestJSON-1449791209-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:34.408510 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bd8e170e-8fe0-43f1-9291-53e046eea2ad tempest-ServersAdminTestJSON-1449791209 tempest-ServersAdminTestJSON-1449791209-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:34.408949 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bd8e170e-8fe0-43f1-9291-53e046eea2ad tempest-ServersAdminTestJSON-1449791209 tempest-ServersAdminTestJSON-1449791209-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:34.409672 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bd8e170e-8fe0-43f1-9291-53e046eea2ad tempest-ServersAdminTestJSON-1449791209 tempest-ServersAdminTestJSON-1449791209-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:34.410119 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bd8e170e-8fe0-43f1-9291-53e046eea2ad tempest-ServersAdminTestJSON-1449791209 tempest-ServersAdminTestJSON-1449791209-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:34.410748 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bd8e170e-8fe0-43f1-9291-53e046eea2ad tempest-ServersAdminTestJSON-1449791209 tempest-ServersAdminTestJSON-1449791209-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:34.462179 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-abcee754-6f9f-41bb-80e0-58d3f94390d2 tempest-QuotasAdminTestJSON-802344082 tempest-QuotasAdminTestJSON-802344082-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-quota-sets/2c1b6473152f48dab6ba02fafbf2e460" status: 200 len: 328 microversion: 2.1 time: 0.379480 Aug 10 23:06:34.464359 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1195/2416] 10.222.0.58 () {60 vars in 1262 bytes} [Wed Aug 10 23:06:34 2022] PUT /compute/v2.1/os-quota-sets/2c1b6473152f48dab6ba02fafbf2e460 => generated 328 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 23:06:34.487062 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-b68d407f-9a17-46a3-bb4f-715d43b1344b tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:34.489851 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-b68d407f-9a17-46a3-bb4f-715d43b1344b tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] [instance: 662fba38-a52c-464c-8448-bfe0a1d78dab] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:06:34.517899 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b68d407f-9a17-46a3-bb4f-715d43b1344b tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:34.520397 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b68d407f-9a17-46a3-bb4f-715d43b1344b tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:34.521102 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b68d407f-9a17-46a3-bb4f-715d43b1344b tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:34.527632 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b68d407f-9a17-46a3-bb4f-715d43b1344b tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:34.528473 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b68d407f-9a17-46a3-bb4f-715d43b1344b tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:34.531203 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b68d407f-9a17-46a3-bb4f-715d43b1344b tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:34.582442 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-bd8e170e-8fe0-43f1-9291-53e046eea2ad tempest-ServersAdminTestJSON-1449791209 tempest-ServersAdminTestJSON-1449791209-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/b3b3730c-1396-4ca6-9d9e-8a3104950324/action" status: 202 len: 0 microversion: 2.1 time: 0.205145 Aug 10 23:06:34.583135 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1222/2417] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:06:34 2022] POST /compute/v2.1/servers/b3b3730c-1396-4ca6-9d9e-8a3104950324/action => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:06:34.589127 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-748bbe3b-b0f1-4c4a-81e2-4f268470db9e tempest-QuotasAdminTestJSON-802344082 tempest-QuotasAdminTestJSON-802344082-project-admin] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:34.626616 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-748bbe3b-b0f1-4c4a-81e2-4f268470db9e tempest-QuotasAdminTestJSON-802344082 tempest-QuotasAdminTestJSON-802344082-project-admin] 10.222.0.58 "DELETE /compute/v2.1/os-quota-sets/2c1b6473152f48dab6ba02fafbf2e460" status: 202 len: 0 microversion: 2.1 time: 0.042180 Aug 10 23:06:34.627687 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1223/2418] 10.222.0.58 () {58 vars in 1245 bytes} [Wed Aug 10 23:06:34 2022] DELETE /compute/v2.1/os-quota-sets/2c1b6473152f48dab6ba02fafbf2e460 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:06:34.638152 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-810899b2-3ef2-4063-8b54-345503700fe2 tempest-ServersAdminTestJSON-1449791209 tempest-ServersAdminTestJSON-1449791209-project-admin] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:34.639106 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-810899b2-3ef2-4063-8b54-345503700fe2 tempest-ServersAdminTestJSON-1449791209 tempest-ServersAdminTestJSON-1449791209-project-admin] [instance: b3b3730c-1396-4ca6-9d9e-8a3104950324] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:06:34.654431 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-810899b2-3ef2-4063-8b54-345503700fe2 tempest-ServersAdminTestJSON-1449791209 tempest-ServersAdminTestJSON-1449791209-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:34.655428 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-810899b2-3ef2-4063-8b54-345503700fe2 tempest-ServersAdminTestJSON-1449791209 tempest-ServersAdminTestJSON-1449791209-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:34.656194 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-810899b2-3ef2-4063-8b54-345503700fe2 tempest-ServersAdminTestJSON-1449791209 tempest-ServersAdminTestJSON-1449791209-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:34.657285 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-810899b2-3ef2-4063-8b54-345503700fe2 tempest-ServersAdminTestJSON-1449791209 tempest-ServersAdminTestJSON-1449791209-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:34.657901 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-810899b2-3ef2-4063-8b54-345503700fe2 tempest-ServersAdminTestJSON-1449791209 tempest-ServersAdminTestJSON-1449791209-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:34.658534 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-810899b2-3ef2-4063-8b54-345503700fe2 tempest-ServersAdminTestJSON-1449791209 tempest-ServersAdminTestJSON-1449791209-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:34.699735 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-810899b2-3ef2-4063-8b54-345503700fe2 tempest-ServersAdminTestJSON-1449791209 tempest-ServersAdminTestJSON-1449791209-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:34.700577 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-810899b2-3ef2-4063-8b54-345503700fe2 tempest-ServersAdminTestJSON-1449791209 tempest-ServersAdminTestJSON-1449791209-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:34.701287 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-810899b2-3ef2-4063-8b54-345503700fe2 tempest-ServersAdminTestJSON-1449791209 tempest-ServersAdminTestJSON-1449791209-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:34.701903 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.objects.instance [None req-810899b2-3ef2-4063-8b54-345503700fe2 tempest-ServersAdminTestJSON-1449791209 tempest-ServersAdminTestJSON-1449791209-project-admin] Lazy-loading 'fault' on Instance uuid b3b3730c-1396-4ca6-9d9e-8a3104950324 {{(pid=122633) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:06:35.003154 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-b68d407f-9a17-46a3-bb4f-715d43b1344b tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8899e278c9453fba0ab05c69b0b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46ac8b84bd649fa88897068dbfa5ce6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:06:35.023944 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-b68d407f-9a17-46a3-bb4f-715d43b1344b tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] 10.222.0.58 "GET /compute/v2.1/servers/662fba38-a52c-464c-8448-bfe0a1d78dab" status: 200 len: 1521 microversion: 2.1 time: 0.550213 Aug 10 23:06:35.025255 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1196/2419] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:06:34 2022] GET /compute/v2.1/servers/662fba38-a52c-464c-8448-bfe0a1d78dab => generated 1521 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:06:35.055064 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-fe50136a-a118-4278-8323-631f873a2eae tempest-QuotasAdminTestJSON-802344082 tempest-QuotasAdminTestJSON-802344082-project-admin] Calling method '.version_select at 0x7f847d174ee0>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:35.196913 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-fe50136a-a118-4278-8323-631f873a2eae tempest-QuotasAdminTestJSON-802344082 tempest-QuotasAdminTestJSON-802344082-project-admin] 10.222.0.58 "GET /compute/v2.1/os-quota-sets/2c1b6473152f48dab6ba02fafbf2e460" status: 200 len: 371 microversion: 2.1 time: 0.170171 Aug 10 23:06:35.203797 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1197/2420] 10.222.0.58 () {58 vars in 1242 bytes} [Wed Aug 10 23:06:35 2022] GET /compute/v2.1/os-quota-sets/2c1b6473152f48dab6ba02fafbf2e460 => generated 371 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:06:35.205919 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-c941a908-4ea3-4928-88cc-505def52da19 req-134f4171-0714-4923-ab79-fcdc1bee8e30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "662fba38-a52c-464c-8448-bfe0a1d78dab", "name": "network-vif-plugged", "status": "completed", "tag": "9bb54bc7-e909-4194-bf93-007a16b9d1af"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:06:35.235921 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-c941a908-4ea3-4928-88cc-505def52da19 req-134f4171-0714-4923-ab79-fcdc1bee8e30 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:35.247390 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-c941a908-4ea3-4928-88cc-505def52da19 req-134f4171-0714-4923-ab79-fcdc1bee8e30 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:35.247844 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-c941a908-4ea3-4928-88cc-505def52da19 req-134f4171-0714-4923-ab79-fcdc1bee8e30 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:35.278233 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-c941a908-4ea3-4928-88cc-505def52da19 req-134f4171-0714-4923-ab79-fcdc1bee8e30 service nova] Creating event network-vif-plugged:9bb54bc7-e909-4194-bf93-007a16b9d1af for instance 662fba38-a52c-464c-8448-bfe0a1d78dab on n-h2-850468-14 Aug 10 23:06:35.293361 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-c941a908-4ea3-4928-88cc-505def52da19 req-134f4171-0714-4923-ab79-fcdc1bee8e30 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094276 Aug 10 23:06:35.294198 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1198/2421] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:06:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:06:35.403726 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-7a7b9caa-157f-4f0b-a127-5bd831b380d0 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:35.404746 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-7a7b9caa-157f-4f0b-a127-5bd831b380d0 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] [instance: 092f973f-79e3-44bf-a2e0-f7d3bfddf42c] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:06:35.421045 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7a7b9caa-157f-4f0b-a127-5bd831b380d0 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:35.424399 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7a7b9caa-157f-4f0b-a127-5bd831b380d0 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:35.429729 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7a7b9caa-157f-4f0b-a127-5bd831b380d0 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:35.430771 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7a7b9caa-157f-4f0b-a127-5bd831b380d0 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:35.432175 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7a7b9caa-157f-4f0b-a127-5bd831b380d0 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:35.432765 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7a7b9caa-157f-4f0b-a127-5bd831b380d0 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:35.706204 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-810899b2-3ef2-4063-8b54-345503700fe2 tempest-ServersAdminTestJSON-1449791209 tempest-ServersAdminTestJSON-1449791209-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/b3b3730c-1396-4ca6-9d9e-8a3104950324" status: 200 len: 1599 microversion: 2.1 time: 1.077440 Aug 10 23:06:35.706875 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1224/2422] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:06:34 2022] GET /compute/v2.1/servers/b3b3730c-1396-4ca6-9d9e-8a3104950324 => generated 1599 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:06:35.729422 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-146ab125-8dfd-49ac-bdcc-7a0d6d1d1f4e tempest-QuotasAdminTestJSON-802344082 tempest-QuotasAdminTestJSON-802344082-project-admin] Calling method '.version_select at 0x7f847d2c34c0>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:36.071044 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-146ab125-8dfd-49ac-bdcc-7a0d6d1d1f4e tempest-QuotasAdminTestJSON-802344082 tempest-QuotasAdminTestJSON-802344082-project-admin] 10.222.0.58 "GET /compute/v2.1/os-quota-sets/1bbce82c0fd14bf29b368676963600ea/defaults" status: 200 len: 371 microversion: 2.1 time: 0.362942 Aug 10 23:06:36.071956 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1225/2423] 10.222.0.58 () {58 vars in 1269 bytes} [Wed Aug 10 23:06:35 2022] GET /compute/v2.1/os-quota-sets/1bbce82c0fd14bf29b368676963600ea/defaults => generated 371 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:06:36.081115 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-817ec11c-7dfa-4cc8-ba2b-685894da9695 tempest-ServersAdminTestJSON-1449791209 tempest-ServersAdminTestJSON-1449791209-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:06:36.088602 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-817ec11c-7dfa-4cc8-ba2b-685894da9695 tempest-ServersAdminTestJSON-1449791209 tempest-ServersAdminTestJSON-1449791209-project-admin] [instance: b3b3730c-1396-4ca6-9d9e-8a3104950324] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:06:36.126486 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-817ec11c-7dfa-4cc8-ba2b-685894da9695 tempest-ServersAdminTestJSON-1449791209 tempest-ServersAdminTestJSON-1449791209-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:36.127585 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-817ec11c-7dfa-4cc8-ba2b-685894da9695 tempest-ServersAdminTestJSON-1449791209 tempest-ServersAdminTestJSON-1449791209-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:36.130035 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-817ec11c-7dfa-4cc8-ba2b-685894da9695 tempest-ServersAdminTestJSON-1449791209 tempest-ServersAdminTestJSON-1449791209-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:36.132426 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-817ec11c-7dfa-4cc8-ba2b-685894da9695 tempest-ServersAdminTestJSON-1449791209 tempest-ServersAdminTestJSON-1449791209-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:36.133236 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-817ec11c-7dfa-4cc8-ba2b-685894da9695 tempest-ServersAdminTestJSON-1449791209 tempest-ServersAdminTestJSON-1449791209-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:36.135208 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-817ec11c-7dfa-4cc8-ba2b-685894da9695 tempest-ServersAdminTestJSON-1449791209 tempest-ServersAdminTestJSON-1449791209-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:36.280082 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:06:36.342005 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-817ec11c-7dfa-4cc8-ba2b-685894da9695 tempest-ServersAdminTestJSON-1449791209 tempest-ServersAdminTestJSON-1449791209-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/b3b3730c-1396-4ca6-9d9e-8a3104950324/action" status: 202 len: 0 microversion: 2.1 time: 0.268450 Aug 10 23:06:36.343232 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1226/2424] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:06:36 2022] POST /compute/v2.1/servers/b3b3730c-1396-4ca6-9d9e-8a3104950324/action => generated 0 bytes in 270 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:06:36.350597 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-213cdb59-58b5-4422-9a38-33f90d971659 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:36.351642 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-213cdb59-58b5-4422-9a38-33f90d971659 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] [instance: 662fba38-a52c-464c-8448-bfe0a1d78dab] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:06:36.365071 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-213cdb59-58b5-4422-9a38-33f90d971659 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:36.365862 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-213cdb59-58b5-4422-9a38-33f90d971659 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:36.366497 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-213cdb59-58b5-4422-9a38-33f90d971659 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:36.367570 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-213cdb59-58b5-4422-9a38-33f90d971659 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:36.368621 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-213cdb59-58b5-4422-9a38-33f90d971659 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:36.371065 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-213cdb59-58b5-4422-9a38-33f90d971659 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:36.424949 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-7a7b9caa-157f-4f0b-a127-5bd831b380d0 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c6e1f505b8409ea38f8a07bad870a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6473e36eada44e6bca8dc568e5ee330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:06:36.436068 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-7a7b9caa-157f-4f0b-a127-5bd831b380d0 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] 10.222.0.58 "GET /compute/v2.1/servers/092f973f-79e3-44bf-a2e0-f7d3bfddf42c" status: 200 len: 1311 microversion: 2.1 time: 1.037995 Aug 10 23:06:36.459870 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1199/2425] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:06:35 2022] GET /compute/v2.1/servers/092f973f-79e3-44bf-a2e0-f7d3bfddf42c => generated 1311 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:06:36.465520 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-4da26239-179e-4bea-864d-f50d3eac0eb0 tempest-ServersAdminTestJSON-1449791209 tempest-ServersAdminTestJSON-1449791209-project-admin] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:36.466135 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-4da26239-179e-4bea-864d-f50d3eac0eb0 tempest-ServersAdminTestJSON-1449791209 tempest-ServersAdminTestJSON-1449791209-project-admin] [instance: b3b3730c-1396-4ca6-9d9e-8a3104950324] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:06:36.473648 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4da26239-179e-4bea-864d-f50d3eac0eb0 tempest-ServersAdminTestJSON-1449791209 tempest-ServersAdminTestJSON-1449791209-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:36.477207 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4da26239-179e-4bea-864d-f50d3eac0eb0 tempest-ServersAdminTestJSON-1449791209 tempest-ServersAdminTestJSON-1449791209-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:36.480189 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4da26239-179e-4bea-864d-f50d3eac0eb0 tempest-ServersAdminTestJSON-1449791209 tempest-ServersAdminTestJSON-1449791209-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:36.481326 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4da26239-179e-4bea-864d-f50d3eac0eb0 tempest-ServersAdminTestJSON-1449791209 tempest-ServersAdminTestJSON-1449791209-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:36.483927 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4da26239-179e-4bea-864d-f50d3eac0eb0 tempest-ServersAdminTestJSON-1449791209 tempest-ServersAdminTestJSON-1449791209-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:36.484736 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4da26239-179e-4bea-864d-f50d3eac0eb0 tempest-ServersAdminTestJSON-1449791209 tempest-ServersAdminTestJSON-1449791209-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:36.661690 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-213cdb59-58b5-4422-9a38-33f90d971659 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8899e278c9453fba0ab05c69b0b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46ac8b84bd649fa88897068dbfa5ce6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:06:36.670438 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-213cdb59-58b5-4422-9a38-33f90d971659 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] 10.222.0.58 "GET /compute/v2.1/servers/662fba38-a52c-464c-8448-bfe0a1d78dab" status: 200 len: 1521 microversion: 2.1 time: 0.325801 Aug 10 23:06:36.683858 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1227/2426] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:06:36 2022] GET /compute/v2.1/servers/662fba38-a52c-464c-8448-bfe0a1d78dab => generated 1521 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:06:36.692171 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-914cc84a-784c-4a17-bb5e-c262adb3aa1f tempest-QuotasAdminTestJSON-802344082 tempest-QuotasAdminTestJSON-802344082-project-admin] Action: 'update', calling method: .version_select at 0x7f847d3a78b0>, body: {"quota_set": {"ram": "5120"}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:06:36.883117 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-914cc84a-784c-4a17-bb5e-c262adb3aa1f tempest-QuotasAdminTestJSON-802344082 tempest-QuotasAdminTestJSON-802344082-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:36.883652 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-914cc84a-784c-4a17-bb5e-c262adb3aa1f tempest-QuotasAdminTestJSON-802344082 tempest-QuotasAdminTestJSON-802344082-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:36.884096 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-914cc84a-784c-4a17-bb5e-c262adb3aa1f tempest-QuotasAdminTestJSON-802344082 tempest-QuotasAdminTestJSON-802344082-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:36.886093 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-914cc84a-784c-4a17-bb5e-c262adb3aa1f tempest-QuotasAdminTestJSON-802344082 tempest-QuotasAdminTestJSON-802344082-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:36.886713 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-914cc84a-784c-4a17-bb5e-c262adb3aa1f tempest-QuotasAdminTestJSON-802344082 tempest-QuotasAdminTestJSON-802344082-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:36.887233 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-914cc84a-784c-4a17-bb5e-c262adb3aa1f tempest-QuotasAdminTestJSON-802344082 tempest-QuotasAdminTestJSON-802344082-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:36.911350 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:DELETE=3 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:06:36.953757 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-914cc84a-784c-4a17-bb5e-c262adb3aa1f tempest-QuotasAdminTestJSON-802344082 tempest-QuotasAdminTestJSON-802344082-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-quota-sets/d573c9129af34b30b592af53cfdd90a8" status: 200 len: 328 microversion: 2.1 time: 0.268631 Aug 10 23:06:36.954718 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1228/2427] 10.222.0.58 () {60 vars in 1262 bytes} [Wed Aug 10 23:06:36 2022] PUT /compute/v2.1/os-quota-sets/d573c9129af34b30b592af53cfdd90a8 => generated 328 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:06:36.956198 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-4da26239-179e-4bea-864d-f50d3eac0eb0 tempest-ServersAdminTestJSON-1449791209 tempest-ServersAdminTestJSON-1449791209-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/b3b3730c-1396-4ca6-9d9e-8a3104950324" status: 200 len: 1616 microversion: 2.1 time: 0.494792 Aug 10 23:06:36.956985 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1200/2428] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:06:36 2022] GET /compute/v2.1/servers/b3b3730c-1396-4ca6-9d9e-8a3104950324 => generated 1616 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:06:36.979518 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-48c2e78d-bb2d-4178-abe9-7da98f354e10 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:36.980065 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-2bccbcb0-dda3-4d2a-b765-4a66d5157d81 tempest-QuotasAdminTestJSON-802344082 tempest-QuotasAdminTestJSON-802344082-project-admin] Calling method '.version_select at 0x7f847cf8eee0>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:36.980348 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-48c2e78d-bb2d-4178-abe9-7da98f354e10 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] [instance: f08ce987-9b15-48ba-8a71-a9c58616c789] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:06:36.988613 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-48c2e78d-bb2d-4178-abe9-7da98f354e10 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:36.989518 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-48c2e78d-bb2d-4178-abe9-7da98f354e10 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:36.990328 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-48c2e78d-bb2d-4178-abe9-7da98f354e10 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:36.991392 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-48c2e78d-bb2d-4178-abe9-7da98f354e10 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:36.992828 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-48c2e78d-bb2d-4178-abe9-7da98f354e10 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:36.993339 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-48c2e78d-bb2d-4178-abe9-7da98f354e10 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:37.038529 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-48c2e78d-bb2d-4178-abe9-7da98f354e10 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] [instance: f08ce987-9b15-48ba-8a71-a9c58616c789] Going to try to terminate instance {{(pid=122632) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:06:37.114541 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2bccbcb0-dda3-4d2a-b765-4a66d5157d81 tempest-QuotasAdminTestJSON-802344082 tempest-QuotasAdminTestJSON-802344082-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:37.115119 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2bccbcb0-dda3-4d2a-b765-4a66d5157d81 tempest-QuotasAdminTestJSON-802344082 tempest-QuotasAdminTestJSON-802344082-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:37.116467 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2bccbcb0-dda3-4d2a-b765-4a66d5157d81 tempest-QuotasAdminTestJSON-802344082 tempest-QuotasAdminTestJSON-802344082-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:37.120538 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2bccbcb0-dda3-4d2a-b765-4a66d5157d81 tempest-QuotasAdminTestJSON-802344082 tempest-QuotasAdminTestJSON-802344082-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:37.121364 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2bccbcb0-dda3-4d2a-b765-4a66d5157d81 tempest-QuotasAdminTestJSON-802344082 tempest-QuotasAdminTestJSON-802344082-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:37.123362 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2bccbcb0-dda3-4d2a-b765-4a66d5157d81 tempest-QuotasAdminTestJSON-802344082 tempest-QuotasAdminTestJSON-802344082-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:37.187961 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-2bccbcb0-dda3-4d2a-b765-4a66d5157d81 tempest-QuotasAdminTestJSON-802344082 tempest-QuotasAdminTestJSON-802344082-project-admin] 10.222.0.58 "GET /compute/v2.1/os-quota-sets/d573c9129af34b30b592af53cfdd90a8/detail" status: 200 len: 916 microversion: 2.1 time: 0.213140 Aug 10 23:06:37.192437 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1229/2429] 10.222.0.58 () {58 vars in 1263 bytes} [Wed Aug 10 23:06:36 2022] GET /compute/v2.1/os-quota-sets/d573c9129af34b30b592af53cfdd90a8/detail => generated 916 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:06:37.296220 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-48c2e78d-bb2d-4178-abe9-7da98f354e10 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] 10.222.0.58 "DELETE /compute/v2.1/servers/f08ce987-9b15-48ba-8a71-a9c58616c789" status: 204 len: 0 microversion: 2.1 time: 0.321340 Aug 10 23:06:37.296821 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1201/2430] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:06:36 2022] DELETE /compute/v2.1/servers/f08ce987-9b15-48ba-8a71-a9c58616c789 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 10 23:06:37.306173 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-dae43f6a-9268-4c5c-89fc-b9f5c7bb1a81 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:37.307903 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-dae43f6a-9268-4c5c-89fc-b9f5c7bb1a81 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] [instance: f08ce987-9b15-48ba-8a71-a9c58616c789] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:06:37.330028 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dae43f6a-9268-4c5c-89fc-b9f5c7bb1a81 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:37.330531 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dae43f6a-9268-4c5c-89fc-b9f5c7bb1a81 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:37.331075 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dae43f6a-9268-4c5c-89fc-b9f5c7bb1a81 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:37.331782 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dae43f6a-9268-4c5c-89fc-b9f5c7bb1a81 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:37.332289 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dae43f6a-9268-4c5c-89fc-b9f5c7bb1a81 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:37.332741 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dae43f6a-9268-4c5c-89fc-b9f5c7bb1a81 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:37.460433 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-198100a5-314f-4a12-825f-1cc5bdd017c4 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:37.461369 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-198100a5-314f-4a12-825f-1cc5bdd017c4 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] [instance: 092f973f-79e3-44bf-a2e0-f7d3bfddf42c] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:06:37.477903 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-198100a5-314f-4a12-825f-1cc5bdd017c4 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:37.479103 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-198100a5-314f-4a12-825f-1cc5bdd017c4 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:37.479848 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-198100a5-314f-4a12-825f-1cc5bdd017c4 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:37.493005 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-198100a5-314f-4a12-825f-1cc5bdd017c4 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:37.493628 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-198100a5-314f-4a12-825f-1cc5bdd017c4 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:37.495156 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-198100a5-314f-4a12-825f-1cc5bdd017c4 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:37.849952 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-dae43f6a-9268-4c5c-89fc-b9f5c7bb1a81 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de244f1f82143a0b3d3283c31d80bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14c63df2e6c46d2af23b6b8a52690d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:06:37.858936 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-dae43f6a-9268-4c5c-89fc-b9f5c7bb1a81 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] 10.222.0.58 "GET /compute/v2.1/servers/f08ce987-9b15-48ba-8a71-a9c58616c789" status: 200 len: 1469 microversion: 2.1 time: 0.557278 Aug 10 23:06:37.864525 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1230/2431] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:06:37 2022] GET /compute/v2.1/servers/f08ce987-9b15-48ba-8a71-a9c58616c789 => generated 1469 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:06:37.869847 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-1e2aad66-eb11-4a25-bccf-f0aee4402bc7 tempest-QuotasAdminTestJSON-802344082 tempest-QuotasAdminTestJSON-802344082-project-admin] Action: 'update', calling method: .version_select at 0x7f847cf8e550>, body: {"quota_set": {"ram": "2048"}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:06:38.030744 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-198100a5-314f-4a12-825f-1cc5bdd017c4 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c6e1f505b8409ea38f8a07bad870a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6473e36eada44e6bca8dc568e5ee330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:06:38.046650 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-198100a5-314f-4a12-825f-1cc5bdd017c4 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] 10.222.0.58 "GET /compute/v2.1/servers/092f973f-79e3-44bf-a2e0-f7d3bfddf42c" status: 200 len: 1311 microversion: 2.1 time: 0.591301 Aug 10 23:06:38.047643 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1202/2432] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:06:37 2022] GET /compute/v2.1/servers/092f973f-79e3-44bf-a2e0-f7d3bfddf42c => generated 1311 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:06:38.052885 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-f6d1003d-3a71-4299-a192-b2f2f025d518 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:38.053939 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-f6d1003d-3a71-4299-a192-b2f2f025d518 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] [instance: 662fba38-a52c-464c-8448-bfe0a1d78dab] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:06:38.082855 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f6d1003d-3a71-4299-a192-b2f2f025d518 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:38.085206 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f6d1003d-3a71-4299-a192-b2f2f025d518 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:38.089728 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f6d1003d-3a71-4299-a192-b2f2f025d518 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:38.094536 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f6d1003d-3a71-4299-a192-b2f2f025d518 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:38.096985 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f6d1003d-3a71-4299-a192-b2f2f025d518 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:38.098524 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f6d1003d-3a71-4299-a192-b2f2f025d518 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:38.150072 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1e2aad66-eb11-4a25-bccf-f0aee4402bc7 tempest-QuotasAdminTestJSON-802344082 tempest-QuotasAdminTestJSON-802344082-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:38.150620 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1e2aad66-eb11-4a25-bccf-f0aee4402bc7 tempest-QuotasAdminTestJSON-802344082 tempest-QuotasAdminTestJSON-802344082-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:38.151414 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1e2aad66-eb11-4a25-bccf-f0aee4402bc7 tempest-QuotasAdminTestJSON-802344082 tempest-QuotasAdminTestJSON-802344082-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:38.152363 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1e2aad66-eb11-4a25-bccf-f0aee4402bc7 tempest-QuotasAdminTestJSON-802344082 tempest-QuotasAdminTestJSON-802344082-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:38.153018 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1e2aad66-eb11-4a25-bccf-f0aee4402bc7 tempest-QuotasAdminTestJSON-802344082 tempest-QuotasAdminTestJSON-802344082-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:38.154138 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1e2aad66-eb11-4a25-bccf-f0aee4402bc7 tempest-QuotasAdminTestJSON-802344082 tempest-QuotasAdminTestJSON-802344082-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:38.249673 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1e2aad66-eb11-4a25-bccf-f0aee4402bc7 tempest-QuotasAdminTestJSON-802344082 tempest-QuotasAdminTestJSON-802344082-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:38.250859 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1e2aad66-eb11-4a25-bccf-f0aee4402bc7 tempest-QuotasAdminTestJSON-802344082 tempest-QuotasAdminTestJSON-802344082-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:38.251361 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1e2aad66-eb11-4a25-bccf-f0aee4402bc7 tempest-QuotasAdminTestJSON-802344082 tempest-QuotasAdminTestJSON-802344082-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:38.252369 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1e2aad66-eb11-4a25-bccf-f0aee4402bc7 tempest-QuotasAdminTestJSON-802344082 tempest-QuotasAdminTestJSON-802344082-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:38.253186 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1e2aad66-eb11-4a25-bccf-f0aee4402bc7 tempest-QuotasAdminTestJSON-802344082 tempest-QuotasAdminTestJSON-802344082-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:38.253964 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1e2aad66-eb11-4a25-bccf-f0aee4402bc7 tempest-QuotasAdminTestJSON-802344082 tempest-QuotasAdminTestJSON-802344082-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:38.408363 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-1e2aad66-eb11-4a25-bccf-f0aee4402bc7 tempest-QuotasAdminTestJSON-802344082 tempest-QuotasAdminTestJSON-802344082-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-quota-sets/d573c9129af34b30b592af53cfdd90a8?user_id=fb1663310fd9423c8acb0e9ddba3e4be" status: 200 len: 328 microversion: 2.1 time: 0.541924 Aug 10 23:06:38.410041 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1231/2433] 10.222.0.58 () {60 vars in 1343 bytes} [Wed Aug 10 23:06:37 2022] PUT /compute/v2.1/os-quota-sets/d573c9129af34b30b592af53cfdd90a8?user_id=fb1663310fd9423c8acb0e9ddba3e4be => generated 328 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:06:38.422700 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-079dd1bd-f31d-44ba-9e00-d9e8199470f0 tempest-QuotasAdminTestJSON-802344082 tempest-QuotasAdminTestJSON-802344082-project-admin] Calling method '.version_select at 0x7f847cf21ee0>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:38.644592 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-f6d1003d-3a71-4299-a192-b2f2f025d518 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8899e278c9453fba0ab05c69b0b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46ac8b84bd649fa88897068dbfa5ce6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:06:38.656677 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-f6d1003d-3a71-4299-a192-b2f2f025d518 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] 10.222.0.58 "GET /compute/v2.1/servers/662fba38-a52c-464c-8448-bfe0a1d78dab" status: 200 len: 1506 microversion: 2.1 time: 0.607512 Aug 10 23:06:38.667482 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1203/2434] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:06:38 2022] GET /compute/v2.1/servers/662fba38-a52c-464c-8448-bfe0a1d78dab => generated 1506 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:06:38.679280 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-cb9c0268-7ea0-4ea2-81a3-a0725816359d tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:38.680220 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-cb9c0268-7ea0-4ea2-81a3-a0725816359d tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] [instance: 662fba38-a52c-464c-8448-bfe0a1d78dab] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:06:38.689110 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cb9c0268-7ea0-4ea2-81a3-a0725816359d tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:38.690702 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cb9c0268-7ea0-4ea2-81a3-a0725816359d tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:38.691389 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cb9c0268-7ea0-4ea2-81a3-a0725816359d tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:38.692330 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cb9c0268-7ea0-4ea2-81a3-a0725816359d tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:38.693164 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cb9c0268-7ea0-4ea2-81a3-a0725816359d tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:38.693796 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cb9c0268-7ea0-4ea2-81a3-a0725816359d tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:38.770594 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-079dd1bd-f31d-44ba-9e00-d9e8199470f0 tempest-QuotasAdminTestJSON-802344082 tempest-QuotasAdminTestJSON-802344082-project-admin] 10.222.0.58 "GET /compute/v2.1/os-quota-sets/d573c9129af34b30b592af53cfdd90a8?user_id=fb1663310fd9423c8acb0e9ddba3e4be" status: 200 len: 370 microversion: 2.1 time: 0.352368 Aug 10 23:06:38.779599 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1232/2435] 10.222.0.58 () {58 vars in 1323 bytes} [Wed Aug 10 23:06:38 2022] GET /compute/v2.1/os-quota-sets/d573c9129af34b30b592af53cfdd90a8?user_id=fb1663310fd9423c8acb0e9ddba3e4be => generated 370 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:06:38.889925 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-a54e8fd8-d854-4dee-976e-90317bf35555 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:38.890609 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-a54e8fd8-d854-4dee-976e-90317bf35555 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] [instance: f08ce987-9b15-48ba-8a71-a9c58616c789] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:06:38.897578 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a54e8fd8-d854-4dee-976e-90317bf35555 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:38.898149 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a54e8fd8-d854-4dee-976e-90317bf35555 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:38.898739 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a54e8fd8-d854-4dee-976e-90317bf35555 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:38.899667 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a54e8fd8-d854-4dee-976e-90317bf35555 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:38.900319 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a54e8fd8-d854-4dee-976e-90317bf35555 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:38.901034 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a54e8fd8-d854-4dee-976e-90317bf35555 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:39.142311 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-a54e8fd8-d854-4dee-976e-90317bf35555 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de244f1f82143a0b3d3283c31d80bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14c63df2e6c46d2af23b6b8a52690d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:06:39.155394 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-a54e8fd8-d854-4dee-976e-90317bf35555 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] 10.222.0.58 "GET /compute/v2.1/servers/f08ce987-9b15-48ba-8a71-a9c58616c789" status: 200 len: 1469 microversion: 2.1 time: 0.269266 Aug 10 23:06:39.155978 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1233/2436] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:06:38 2022] GET /compute/v2.1/servers/f08ce987-9b15-48ba-8a71-a9c58616c789 => generated 1469 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:06:39.164841 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-e87224f6-5b7b-42d1-8675-4f8e04755b8e tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:39.174644 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-e87224f6-5b7b-42d1-8675-4f8e04755b8e tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] [instance: 092f973f-79e3-44bf-a2e0-f7d3bfddf42c] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:06:39.190546 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e87224f6-5b7b-42d1-8675-4f8e04755b8e tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:39.192578 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e87224f6-5b7b-42d1-8675-4f8e04755b8e tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:39.193548 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e87224f6-5b7b-42d1-8675-4f8e04755b8e tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:39.197418 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e87224f6-5b7b-42d1-8675-4f8e04755b8e tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:39.198332 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e87224f6-5b7b-42d1-8675-4f8e04755b8e tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:39.200057 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e87224f6-5b7b-42d1-8675-4f8e04755b8e tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:39.280566 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-cb9c0268-7ea0-4ea2-81a3-a0725816359d tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8899e278c9453fba0ab05c69b0b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46ac8b84bd649fa88897068dbfa5ce6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:06:39.295099 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-cb9c0268-7ea0-4ea2-81a3-a0725816359d tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] 10.222.0.58 "GET /compute/v2.1/servers/662fba38-a52c-464c-8448-bfe0a1d78dab" status: 200 len: 1506 microversion: 2.1 time: 0.619881 Aug 10 23:06:39.299636 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1204/2437] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:06:38 2022] GET /compute/v2.1/servers/662fba38-a52c-464c-8448-bfe0a1d78dab => generated 1506 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:06:39.323465 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-098b46da-38ce-4753-9ee5-e4d55d157a4a tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:39.324381 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-098b46da-38ce-4753-9ee5-e4d55d157a4a tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] [instance: 662fba38-a52c-464c-8448-bfe0a1d78dab] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:06:39.351092 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-098b46da-38ce-4753-9ee5-e4d55d157a4a tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:39.352527 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-098b46da-38ce-4753-9ee5-e4d55d157a4a tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:39.353566 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-098b46da-38ce-4753-9ee5-e4d55d157a4a tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:39.357390 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-098b46da-38ce-4753-9ee5-e4d55d157a4a tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:39.358491 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-098b46da-38ce-4753-9ee5-e4d55d157a4a tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:39.360272 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-098b46da-38ce-4753-9ee5-e4d55d157a4a tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:39.428388 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-098b46da-38ce-4753-9ee5-e4d55d157a4a tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] [instance: 662fba38-a52c-464c-8448-bfe0a1d78dab] Going to try to terminate instance {{(pid=122632) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:06:39.542118 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-e87224f6-5b7b-42d1-8675-4f8e04755b8e tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c6e1f505b8409ea38f8a07bad870a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6473e36eada44e6bca8dc568e5ee330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:06:39.569413 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-e87224f6-5b7b-42d1-8675-4f8e04755b8e tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] 10.222.0.58 "GET /compute/v2.1/servers/092f973f-79e3-44bf-a2e0-f7d3bfddf42c" status: 200 len: 1332 microversion: 2.1 time: 0.411363 Aug 10 23:06:39.570633 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1234/2438] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:06:39 2022] GET /compute/v2.1/servers/092f973f-79e3-44bf-a2e0-f7d3bfddf42c => generated 1332 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:06:39.590238 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-66a7a3a2-293e-4a2c-81c8-96b301a32eee tempest-QuotasAdminTestJSON-802344082 tempest-QuotasAdminTestJSON-802344082-project-admin] Calling method '.version_select at 0x7f847cf8ef70>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:39.593386 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-098b46da-38ce-4753-9ee5-e4d55d157a4a tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] 10.222.0.58 "DELETE /compute/v2.1/servers/662fba38-a52c-464c-8448-bfe0a1d78dab" status: 204 len: 0 microversion: 2.1 time: 0.274709 Aug 10 23:06:39.597623 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1205/2439] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:06:39 2022] DELETE /compute/v2.1/servers/662fba38-a52c-464c-8448-bfe0a1d78dab => generated 0 bytes in 277 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:06:39.832555 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-866f4c75-dfb2-46d0-b1a4-7496f24d239f tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-330853958", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452", "networks": [{"uuid": "72c3c713-0909-4c2e-939f-b2db0ad09ba6"}]}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:06:39.922932 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.network.neutron [None req-866f4c75-dfb2-46d0-b1a4-7496f24d239f tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] validate_networks() for [('72c3c713-0909-4c2e-939f-b2db0ad09ba6', None, None, None, None, None)] {{(pid=122632) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 23:06:40.083222 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-66a7a3a2-293e-4a2c-81c8-96b301a32eee tempest-QuotasAdminTestJSON-802344082 tempest-QuotasAdminTestJSON-802344082-project-admin] 10.222.0.58 "GET /compute/v2.1/os-quota-sets/1bbce82c0fd14bf29b368676963600ea/defaults" status: 200 len: 371 microversion: 2.1 time: 0.511051 Aug 10 23:06:40.091018 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1235/2440] 10.222.0.58 () {58 vars in 1269 bytes} [Wed Aug 10 23:06:39 2022] GET /compute/v2.1/os-quota-sets/1bbce82c0fd14bf29b368676963600ea/defaults => generated 371 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:06:40.095783 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-f4a11c2a-4dd6-4da3-9835-e4678f187e5c tempest-QuotasAdminTestJSON-802344082 tempest-QuotasAdminTestJSON-802344082-project-admin] Action: 'update', calling method: .version_select at 0x7f847d261f70>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:06:40.925545 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f4a11c2a-4dd6-4da3-9835-e4678f187e5c tempest-QuotasAdminTestJSON-802344082 tempest-QuotasAdminTestJSON-802344082-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:40.926168 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f4a11c2a-4dd6-4da3-9835-e4678f187e5c tempest-QuotasAdminTestJSON-802344082 tempest-QuotasAdminTestJSON-802344082-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:40.926470 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f4a11c2a-4dd6-4da3-9835-e4678f187e5c tempest-QuotasAdminTestJSON-802344082 tempest-QuotasAdminTestJSON-802344082-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:40.927243 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f4a11c2a-4dd6-4da3-9835-e4678f187e5c tempest-QuotasAdminTestJSON-802344082 tempest-QuotasAdminTestJSON-802344082-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:40.930676 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f4a11c2a-4dd6-4da3-9835-e4678f187e5c tempest-QuotasAdminTestJSON-802344082 tempest-QuotasAdminTestJSON-802344082-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:40.933387 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f4a11c2a-4dd6-4da3-9835-e4678f187e5c tempest-QuotasAdminTestJSON-802344082 tempest-QuotasAdminTestJSON-802344082-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:41.466588 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-f4a11c2a-4dd6-4da3-9835-e4678f187e5c tempest-QuotasAdminTestJSON-802344082 tempest-QuotasAdminTestJSON-802344082-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-quota-sets/1bbce82c0fd14bf29b368676963600ea" status: 200 len: 329 microversion: 2.1 time: 1.374584 Aug 10 23:06:41.468120 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1236/2441] 10.222.0.58 () {60 vars in 1263 bytes} [Wed Aug 10 23:06:40 2022] PUT /compute/v2.1/os-quota-sets/1bbce82c0fd14bf29b368676963600ea => generated 329 bytes in 1377 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:06:41.475821 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-f00fa7ce-8a7d-42b6-8a1f-b8d92e3c8312 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:41.477786 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-f00fa7ce-8a7d-42b6-8a1f-b8d92e3c8312 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] [instance: f08ce987-9b15-48ba-8a71-a9c58616c789] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:06:41.486195 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f00fa7ce-8a7d-42b6-8a1f-b8d92e3c8312 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:41.486989 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f00fa7ce-8a7d-42b6-8a1f-b8d92e3c8312 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:41.487577 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f00fa7ce-8a7d-42b6-8a1f-b8d92e3c8312 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:41.489297 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f00fa7ce-8a7d-42b6-8a1f-b8d92e3c8312 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:41.490292 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f00fa7ce-8a7d-42b6-8a1f-b8d92e3c8312 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:41.491596 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f00fa7ce-8a7d-42b6-8a1f-b8d92e3c8312 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:41.515881 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-f00fa7ce-8a7d-42b6-8a1f-b8d92e3c8312 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] HTTP exception thrown: Instance f08ce987-9b15-48ba-8a71-a9c58616c789 could not be found. Aug 10 23:06:41.518187 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-f00fa7ce-8a7d-42b6-8a1f-b8d92e3c8312 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Request method failure captured: Aug 10 23:06:41.518187 n-d-850468-14 devstack@n-api.service[122633]: request: GET /compute/v2.1/servers/f08ce987-9b15-48ba-8a71-a9c58616c789 HTTP/1.1 Aug 10 23:06:41.518187 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:06:41.518187 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:06:41.518187 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:06:41.518187 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:06:41.518187 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:06:41.518187 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:06:41.518187 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:06:41.518187 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:06:41.518187 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9Dl6GC38IAoQwtYJepctjYFpL74I5toa99IDyqDCgzDW5hUleE_PTzRwpILUi3seJY6BeQXDpJM2O5YaEpfCX3h17mgJecTcR5YYvrNmoejmfEcdwgfkywuIX1h9S8RUQtXDfabapHiC7UL0qtSiJFQn0ATBfcKRgMQfS_Qk3Gc_V2g Aug 10 23:06:41.518187 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:06:41.518187 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:06:41.518187 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:06:41.518187 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:06:41.518187 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:06:41.518187 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:06:41.518187 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: b14c63df2e6c46d2af23b6b8a52690d9 Aug 10 23:06:41.518187 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-ServersAdminTestJSON-903269384 Aug 10 23:06:41.518187 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:06:41.518187 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:06:41.519939 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b14c63df2e6c46d2af23b6b8a52690d9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b14c63df2e6c46d2af23b6b8a52690d9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b14c63df2e6c46d2af23b6b8a52690d9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b14c63df2e6c46d2af23b6b8a52690d9", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:06:41.519939 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-ServersAdminTestJSON-903269384 Aug 10 23:06:41.519939 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: b14c63df2e6c46d2af23b6b8a52690d9 Aug 10 23:06:41.519939 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-ServersAdminTestJSON-903269384 Aug 10 23:06:41.519939 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-ServersAdminTestJSON-903269384-project Aug 10 23:06:41.519939 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:06:41.519939 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:06:41.519939 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 6de244f1f82143a0b3d3283c31d80bc9 Aug 10 23:06:41.519939 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-ServersAdminTestJSON-903269384-project Aug 10 23:06:41.519939 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:06:41.519939 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance f08ce987-9b15-48ba-8a71-a9c58616c789 could not be found. Aug 10 23:06:41.519939 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': 'f08ce987-9b15-48ba-8a71-a9c58616c789'} Aug 10 23:06:41.520853 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:06:41.520853 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:06:41.520853 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:06:41.520853 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:06:41.520853 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:06:41.520853 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:06:41.520853 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:06:41.520853 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:06:41.520853 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:06:41.520853 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:06:41.520853 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f08ce987-9b15-48ba-8a71-a9c58616c789 could not be found. Aug 10 23:06:41.520853 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:06:41.520853 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:06:41.520853 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:06:41.520853 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:06:41.520853 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:06:41.520853 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:06:41.520853 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:06:41.520853 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:06:41.520853 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:06:41.522288 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:06:41.522288 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:06:41.522288 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:06:41.522288 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:06:41.522288 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:06:41.522288 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:06:41.522288 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:06:41.522288 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f08ce987-9b15-48ba-8a71-a9c58616c789 could not be found. Aug 10 23:06:41.522288 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:06:41.522288 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:06:41.522288 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:06:41.522288 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:06:41.522288 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:06:41.522288 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:06:41.522288 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:06:41.522288 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:06:41.522288 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f08ce987-9b15-48ba-8a71-a9c58616c789 could not be found. Aug 10 23:06:41.522288 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:06:41.524558 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-f00fa7ce-8a7d-42b6-8a1f-b8d92e3c8312 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Returning 404 to user: Instance f08ce987-9b15-48ba-8a71-a9c58616c789 could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:06:41.526464 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-f00fa7ce-8a7d-42b6-8a1f-b8d92e3c8312 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] 10.222.0.58 "GET /compute/v2.1/servers/f08ce987-9b15-48ba-8a71-a9c58616c789" status: 404 len: 111 microversion: 2.1 time: 0.056772 Aug 10 23:06:41.527251 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1237/2442] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:06:41 2022] GET /compute/v2.1/servers/f08ce987-9b15-48ba-8a71-a9c58616c789 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:06:41.536370 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-a70d1816-e455-4f73-a33e-c0401c0dcc06 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:41.537330 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-a70d1816-e455-4f73-a33e-c0401c0dcc06 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] [instance: 092f973f-79e3-44bf-a2e0-f7d3bfddf42c] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:06:41.546027 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a70d1816-e455-4f73-a33e-c0401c0dcc06 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:41.546741 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a70d1816-e455-4f73-a33e-c0401c0dcc06 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:41.547582 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a70d1816-e455-4f73-a33e-c0401c0dcc06 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:41.548476 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a70d1816-e455-4f73-a33e-c0401c0dcc06 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:41.549263 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a70d1816-e455-4f73-a33e-c0401c0dcc06 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:41.549841 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a70d1816-e455-4f73-a33e-c0401c0dcc06 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:41.836234 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-a70d1816-e455-4f73-a33e-c0401c0dcc06 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c6e1f505b8409ea38f8a07bad870a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6473e36eada44e6bca8dc568e5ee330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:06:41.846697 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-a70d1816-e455-4f73-a33e-c0401c0dcc06 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] 10.222.0.58 "GET /compute/v2.1/servers/092f973f-79e3-44bf-a2e0-f7d3bfddf42c" status: 200 len: 1353 microversion: 2.1 time: 0.314546 Aug 10 23:06:41.847678 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1238/2443] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:06:41 2022] GET /compute/v2.1/servers/092f973f-79e3-44bf-a2e0-f7d3bfddf42c => generated 1353 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:06:41.857892 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-866f4c75-dfb2-46d0-b1a4-7496f24d239f tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Flavor limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:06:41.858902 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-866f4c75-dfb2-46d0-b1a4-7496f24d239f tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Image limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:06:41.859587 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-866f4c75-dfb2-46d0-b1a4-7496f24d239f tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Flavor pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:06:41.860206 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-866f4c75-dfb2-46d0-b1a4-7496f24d239f tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Image pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:06:41.860827 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-866f4c75-dfb2-46d0-b1a4-7496f24d239f tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:06:41.887253 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-866f4c75-dfb2-46d0-b1a4-7496f24d239f tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:41.888158 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-866f4c75-dfb2-46d0-b1a4-7496f24d239f tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:41.890414 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-866f4c75-dfb2-46d0-b1a4-7496f24d239f tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:41.891457 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-866f4c75-dfb2-46d0-b1a4-7496f24d239f tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:41.893030 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-866f4c75-dfb2-46d0-b1a4-7496f24d239f tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:41.895667 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-866f4c75-dfb2-46d0-b1a4-7496f24d239f tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:41.936139 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-866f4c75-dfb2-46d0-b1a4-7496f24d239f tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Getting quotas for project b46ac8b84bd649fa88897068dbfa5ce6. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:06:41.958531 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-866f4c75-dfb2-46d0-b1a4-7496f24d239f tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Getting quotas for user 1b8899e278c9453fba0ab05c69b0b0b9 and project b46ac8b84bd649fa88897068dbfa5ce6. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:06:41.990180 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-866f4c75-dfb2-46d0-b1a4-7496f24d239f tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Going to run 1 instances... {{(pid=122632) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 23:06:41.998027 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-866f4c75-dfb2-46d0-b1a4-7496f24d239f tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] [instance: 85c138c8-9302-453b-8dc1-8f0002d79f1a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78ad8905-f66f-4733-8be9-2b260f1fabed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122632) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 23:06:42.074231 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-866f4c75-dfb2-46d0-b1a4-7496f24d239f tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.249651 Aug 10 23:06:42.077399 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1206/2444] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 23:06:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 2256 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 10 23:06:42.083821 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-fcc2afee-1442-4505-aeeb-075ab831ea65 tempest-QuotasAdminTestJSON-802344082 tempest-QuotasAdminTestJSON-802344082-project-admin] Action: 'update', calling method: .version_select at 0x7f847d3174c0>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:06:42.146425 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-6b220540-e7f1-40a5-9da7-4e93762e9b14 req-77822743-775b-4e99-b10d-ea89e58ab907 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f08ce987-9b15-48ba-8a71-a9c58616c789", "name": "network-vif-deleted", "tag": "8b5a3d3b-7337-4c9b-8f89-ec55547858f9"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:06:42.171469 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-6b220540-e7f1-40a5-9da7-4e93762e9b14 req-77822743-775b-4e99-b10d-ea89e58ab907 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:42.172304 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-6b220540-e7f1-40a5-9da7-4e93762e9b14 req-77822743-775b-4e99-b10d-ea89e58ab907 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:42.174964 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-6b220540-e7f1-40a5-9da7-4e93762e9b14 req-77822743-775b-4e99-b10d-ea89e58ab907 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:42.211051 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-6b220540-e7f1-40a5-9da7-4e93762e9b14 req-77822743-775b-4e99-b10d-ea89e58ab907 service nova] Creating event network-vif-deleted:8b5a3d3b-7337-4c9b-8f89-ec55547858f9 for instance f08ce987-9b15-48ba-8a71-a9c58616c789 on n-h1-850468-14 Aug 10 23:06:42.224116 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-6b220540-e7f1-40a5-9da7-4e93762e9b14 req-77822743-775b-4e99-b10d-ea89e58ab907 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.374969 Aug 10 23:06:42.227241 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1239/2445] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:06:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:06:42.236740 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-0e452245-674f-4c4e-9741-db6f8889d03a tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:42.243179 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-0e452245-674f-4c4e-9741-db6f8889d03a tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] [instance: 541591c5-62f9-489a-96e7-e7cbbbfc4e28] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:06:42.255821 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=16 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:06:42.265480 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0e452245-674f-4c4e-9741-db6f8889d03a tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:42.265973 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0e452245-674f-4c4e-9741-db6f8889d03a tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:42.266406 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0e452245-674f-4c4e-9741-db6f8889d03a tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:42.267153 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0e452245-674f-4c4e-9741-db6f8889d03a tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:42.267622 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0e452245-674f-4c4e-9741-db6f8889d03a tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:42.268029 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0e452245-674f-4c4e-9741-db6f8889d03a tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:42.308532 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-0e452245-674f-4c4e-9741-db6f8889d03a tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] [instance: 541591c5-62f9-489a-96e7-e7cbbbfc4e28] Going to try to terminate instance {{(pid=122633) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:06:42.485352 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fcc2afee-1442-4505-aeeb-075ab831ea65 tempest-QuotasAdminTestJSON-802344082 tempest-QuotasAdminTestJSON-802344082-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:42.488750 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fcc2afee-1442-4505-aeeb-075ab831ea65 tempest-QuotasAdminTestJSON-802344082 tempest-QuotasAdminTestJSON-802344082-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:42.489261 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fcc2afee-1442-4505-aeeb-075ab831ea65 tempest-QuotasAdminTestJSON-802344082 tempest-QuotasAdminTestJSON-802344082-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:42.491741 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fcc2afee-1442-4505-aeeb-075ab831ea65 tempest-QuotasAdminTestJSON-802344082 tempest-QuotasAdminTestJSON-802344082-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:42.498416 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fcc2afee-1442-4505-aeeb-075ab831ea65 tempest-QuotasAdminTestJSON-802344082 tempest-QuotasAdminTestJSON-802344082-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:42.501991 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fcc2afee-1442-4505-aeeb-075ab831ea65 tempest-QuotasAdminTestJSON-802344082 tempest-QuotasAdminTestJSON-802344082-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:42.504025 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-0e452245-674f-4c4e-9741-db6f8889d03a tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] 10.222.0.58 "DELETE /compute/v2.1/servers/541591c5-62f9-489a-96e7-e7cbbbfc4e28" status: 204 len: 0 microversion: 2.1 time: 0.273957 Aug 10 23:06:42.515030 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1240/2446] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:06:42 2022] DELETE /compute/v2.1/servers/541591c5-62f9-489a-96e7-e7cbbbfc4e28 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:06:42.551854 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-8b7bac67-2fd4-4a87-bc08-49d6988029c0 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:42.552593 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-8b7bac67-2fd4-4a87-bc08-49d6988029c0 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] [instance: 85c138c8-9302-453b-8dc1-8f0002d79f1a] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:06:42.657254 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=8,nova_api:UPDATE=3 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:06:42.707448 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-8b7bac67-2fd4-4a87-bc08-49d6988029c0 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8899e278c9453fba0ab05c69b0b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46ac8b84bd649fa88897068dbfa5ce6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:06:42.721626 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-8b7bac67-2fd4-4a87-bc08-49d6988029c0 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] 10.222.0.58 "GET /compute/v2.1/servers/85c138c8-9302-453b-8dc1-8f0002d79f1a" status: 200 len: 1217 microversion: 2.1 time: 0.207725 Aug 10 23:06:42.736004 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1241/2447] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:06:42 2022] GET /compute/v2.1/servers/85c138c8-9302-453b-8dc1-8f0002d79f1a => generated 1217 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:06:42.741048 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-9584fc45-3e22-464b-b17d-f1b2a23cc471 req-88dc125f-faf5-4b71-965a-c62d7d947110 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "662fba38-a52c-464c-8448-bfe0a1d78dab", "name": "network-vif-deleted", "tag": "9bb54bc7-e909-4194-bf93-007a16b9d1af"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:06:42.764302 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-9584fc45-3e22-464b-b17d-f1b2a23cc471 req-88dc125f-faf5-4b71-965a-c62d7d947110 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:42.764817 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-9584fc45-3e22-464b-b17d-f1b2a23cc471 req-88dc125f-faf5-4b71-965a-c62d7d947110 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:42.765217 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-9584fc45-3e22-464b-b17d-f1b2a23cc471 req-88dc125f-faf5-4b71-965a-c62d7d947110 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:42.793122 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-9584fc45-3e22-464b-b17d-f1b2a23cc471 req-88dc125f-faf5-4b71-965a-c62d7d947110 service nova] Creating event network-vif-deleted:9bb54bc7-e909-4194-bf93-007a16b9d1af for instance 662fba38-a52c-464c-8448-bfe0a1d78dab on n-h2-850468-14 Aug 10 23:06:42.812775 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-9584fc45-3e22-464b-b17d-f1b2a23cc471 req-88dc125f-faf5-4b71-965a-c62d7d947110 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075185 Aug 10 23:06:42.813946 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1242/2448] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:06:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:06:42.827558 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-f18fe6a2-86e9-4ed2-8d1d-7c563a180b77 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:42.828709 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-f18fe6a2-86e9-4ed2-8d1d-7c563a180b77 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] [instance: 541591c5-62f9-489a-96e7-e7cbbbfc4e28] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:06:42.835463 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f18fe6a2-86e9-4ed2-8d1d-7c563a180b77 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:42.840579 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f18fe6a2-86e9-4ed2-8d1d-7c563a180b77 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:42.841269 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f18fe6a2-86e9-4ed2-8d1d-7c563a180b77 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:42.843778 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f18fe6a2-86e9-4ed2-8d1d-7c563a180b77 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:42.844525 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f18fe6a2-86e9-4ed2-8d1d-7c563a180b77 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:42.844878 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f18fe6a2-86e9-4ed2-8d1d-7c563a180b77 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:43.137308 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-f18fe6a2-86e9-4ed2-8d1d-7c563a180b77 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de244f1f82143a0b3d3283c31d80bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14c63df2e6c46d2af23b6b8a52690d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:06:43.157237 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-f18fe6a2-86e9-4ed2-8d1d-7c563a180b77 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] 10.222.0.58 "GET /compute/v2.1/servers/541591c5-62f9-489a-96e7-e7cbbbfc4e28" status: 200 len: 1468 microversion: 2.1 time: 0.341551 Aug 10 23:06:43.157809 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1243/2449] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:06:42 2022] GET /compute/v2.1/servers/541591c5-62f9-489a-96e7-e7cbbbfc4e28 => generated 1468 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:06:43.181746 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-b349faf3-4a87-4b48-8888-0e8716ba431f tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:43.182726 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-b349faf3-4a87-4b48-8888-0e8716ba431f tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] [instance: 092f973f-79e3-44bf-a2e0-f7d3bfddf42c] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:06:43.199821 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-fcc2afee-1442-4505-aeeb-075ab831ea65 tempest-QuotasAdminTestJSON-802344082 tempest-QuotasAdminTestJSON-802344082-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-quota-sets/1bbce82c0fd14bf29b368676963600ea" status: 200 len: 329 microversion: 2.1 time: 1.120893 Aug 10 23:06:43.200770 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b349faf3-4a87-4b48-8888-0e8716ba431f tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:43.201259 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b349faf3-4a87-4b48-8888-0e8716ba431f tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:43.201592 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1207/2450] 10.222.0.58 () {60 vars in 1263 bytes} [Wed Aug 10 23:06:42 2022] PUT /compute/v2.1/os-quota-sets/1bbce82c0fd14bf29b368676963600ea => generated 329 bytes in 1123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:06:43.201727 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b349faf3-4a87-4b48-8888-0e8716ba431f tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:43.202378 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b349faf3-4a87-4b48-8888-0e8716ba431f tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:43.202848 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b349faf3-4a87-4b48-8888-0e8716ba431f tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:43.203269 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b349faf3-4a87-4b48-8888-0e8716ba431f tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:43.635543 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-b349faf3-4a87-4b48-8888-0e8716ba431f tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c6e1f505b8409ea38f8a07bad870a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6473e36eada44e6bca8dc568e5ee330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:06:43.670018 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-b349faf3-4a87-4b48-8888-0e8716ba431f tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] 10.222.0.58 "GET /compute/v2.1/servers/092f973f-79e3-44bf-a2e0-f7d3bfddf42c" status: 200 len: 1353 microversion: 2.1 time: 0.496128 Aug 10 23:06:43.683556 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1244/2451] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:06:43 2022] GET /compute/v2.1/servers/092f973f-79e3-44bf-a2e0-f7d3bfddf42c => generated 1353 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:06:43.742246 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c81eb330-0a71-44ae-a18e-d4400be67b49 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:43.742816 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-c81eb330-0a71-44ae-a18e-d4400be67b49 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] [instance: 85c138c8-9302-453b-8dc1-8f0002d79f1a] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:06:43.762242 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c81eb330-0a71-44ae-a18e-d4400be67b49 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:43.763818 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c81eb330-0a71-44ae-a18e-d4400be67b49 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:43.764708 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c81eb330-0a71-44ae-a18e-d4400be67b49 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:43.766827 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c81eb330-0a71-44ae-a18e-d4400be67b49 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:43.767498 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c81eb330-0a71-44ae-a18e-d4400be67b49 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:43.768124 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c81eb330-0a71-44ae-a18e-d4400be67b49 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:44.148091 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-c81eb330-0a71-44ae-a18e-d4400be67b49 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8899e278c9453fba0ab05c69b0b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46ac8b84bd649fa88897068dbfa5ce6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:06:44.161126 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-c81eb330-0a71-44ae-a18e-d4400be67b49 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] 10.222.0.58 "GET /compute/v2.1/servers/85c138c8-9302-453b-8dc1-8f0002d79f1a" status: 200 len: 1221 microversion: 2.1 time: 0.422848 Aug 10 23:06:44.162002 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1208/2452] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:06:43 2022] GET /compute/v2.1/servers/85c138c8-9302-453b-8dc1-8f0002d79f1a => generated 1221 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:06:44.180252 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-0ca6d370-dce2-409c-ba7a-a1e03ffec6dc tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:44.182641 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-0ca6d370-dce2-409c-ba7a-a1e03ffec6dc tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] [instance: 541591c5-62f9-489a-96e7-e7cbbbfc4e28] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:06:44.196402 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0ca6d370-dce2-409c-ba7a-a1e03ffec6dc tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:44.197292 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0ca6d370-dce2-409c-ba7a-a1e03ffec6dc tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:44.197899 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0ca6d370-dce2-409c-ba7a-a1e03ffec6dc tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:44.198848 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0ca6d370-dce2-409c-ba7a-a1e03ffec6dc tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:44.199496 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0ca6d370-dce2-409c-ba7a-a1e03ffec6dc tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:44.200074 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0ca6d370-dce2-409c-ba7a-a1e03ffec6dc tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:44.275932 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-6ea32e9d-dd30-401e-a2f8-9d243f560922 req-e10feb37-fad3-4758-8f15-5f61ced395fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "092f973f-79e3-44bf-a2e0-f7d3bfddf42c", "tag": "ceec95b0-8259-4a51-84f0-06da3be72958"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:06:44.289723 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-6ea32e9d-dd30-401e-a2f8-9d243f560922 req-e10feb37-fad3-4758-8f15-5f61ced395fb service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:44.296195 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-6ea32e9d-dd30-401e-a2f8-9d243f560922 req-e10feb37-fad3-4758-8f15-5f61ced395fb service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:44.298229 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-6ea32e9d-dd30-401e-a2f8-9d243f560922 req-e10feb37-fad3-4758-8f15-5f61ced395fb service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:44.334504 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-6ea32e9d-dd30-401e-a2f8-9d243f560922 req-e10feb37-fad3-4758-8f15-5f61ced395fb service nova] Creating event network-changed:ceec95b0-8259-4a51-84f0-06da3be72958 for instance 092f973f-79e3-44bf-a2e0-f7d3bfddf42c on n-h1-850468-14 Aug 10 23:06:44.350529 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-6ea32e9d-dd30-401e-a2f8-9d243f560922 req-e10feb37-fad3-4758-8f15-5f61ced395fb service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077307 Aug 10 23:06:44.352339 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1209/2453] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:06:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:06:44.698330 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-ef103014-8be6-4ef9-9e43-30a7521b6da9 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:44.699609 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-ef103014-8be6-4ef9-9e43-30a7521b6da9 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] [instance: 092f973f-79e3-44bf-a2e0-f7d3bfddf42c] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:06:44.719688 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ef103014-8be6-4ef9-9e43-30a7521b6da9 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:44.721639 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ef103014-8be6-4ef9-9e43-30a7521b6da9 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:44.722472 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ef103014-8be6-4ef9-9e43-30a7521b6da9 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:44.723928 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ef103014-8be6-4ef9-9e43-30a7521b6da9 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:44.725749 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ef103014-8be6-4ef9-9e43-30a7521b6da9 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:44.727880 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ef103014-8be6-4ef9-9e43-30a7521b6da9 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:44.778440 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:06:45.160846 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-0ca6d370-dce2-409c-ba7a-a1e03ffec6dc tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de244f1f82143a0b3d3283c31d80bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14c63df2e6c46d2af23b6b8a52690d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:06:45.169367 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-0ca6d370-dce2-409c-ba7a-a1e03ffec6dc tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] 10.222.0.58 "GET /compute/v2.1/servers/541591c5-62f9-489a-96e7-e7cbbbfc4e28" status: 200 len: 1468 microversion: 2.1 time: 0.993032 Aug 10 23:06:45.174237 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1245/2454] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:06:44 2022] GET /compute/v2.1/servers/541591c5-62f9-489a-96e7-e7cbbbfc4e28 => generated 1468 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:06:45.195819 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-54ea2f39-9dae-460f-a83d-6477c0c5653c tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:45.196428 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-54ea2f39-9dae-460f-a83d-6477c0c5653c tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] [instance: 85c138c8-9302-453b-8dc1-8f0002d79f1a] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:06:45.212047 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-54ea2f39-9dae-460f-a83d-6477c0c5653c tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:45.213066 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-54ea2f39-9dae-460f-a83d-6477c0c5653c tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:45.213511 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-54ea2f39-9dae-460f-a83d-6477c0c5653c tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:45.214222 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-54ea2f39-9dae-460f-a83d-6477c0c5653c tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:45.214674 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-54ea2f39-9dae-460f-a83d-6477c0c5653c tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:45.215132 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-54ea2f39-9dae-460f-a83d-6477c0c5653c tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:45.489481 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-ef103014-8be6-4ef9-9e43-30a7521b6da9 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c6e1f505b8409ea38f8a07bad870a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6473e36eada44e6bca8dc568e5ee330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:06:45.502306 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-ef103014-8be6-4ef9-9e43-30a7521b6da9 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] 10.222.0.58 "GET /compute/v2.1/servers/092f973f-79e3-44bf-a2e0-f7d3bfddf42c" status: 200 len: 1353 microversion: 2.1 time: 0.809129 Aug 10 23:06:45.526710 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1210/2455] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:06:44 2022] GET /compute/v2.1/servers/092f973f-79e3-44bf-a2e0-f7d3bfddf42c => generated 1353 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:06:45.593090 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-54ea2f39-9dae-460f-a83d-6477c0c5653c tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8899e278c9453fba0ab05c69b0b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46ac8b84bd649fa88897068dbfa5ce6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:06:45.608222 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-54ea2f39-9dae-460f-a83d-6477c0c5653c tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] 10.222.0.58 "GET /compute/v2.1/servers/85c138c8-9302-453b-8dc1-8f0002d79f1a" status: 200 len: 1275 microversion: 2.1 time: 0.415767 Aug 10 23:06:45.633764 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1246/2456] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:06:45 2022] GET /compute/v2.1/servers/85c138c8-9302-453b-8dc1-8f0002d79f1a => generated 1275 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:06:46.012686 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-ee1ed392-c93b-4570-8e51-a975583ca26f req-a4a81197-b134-4f13-8004-15433b158a52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "541591c5-62f9-489a-96e7-e7cbbbfc4e28", "name": "network-vif-unplugged", "status": "completed", "tag": "1e288590-eb74-4df3-ad37-16250a74ba4e"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:06:46.044978 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-ee1ed392-c93b-4570-8e51-a975583ca26f req-a4a81197-b134-4f13-8004-15433b158a52 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:46.045471 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-ee1ed392-c93b-4570-8e51-a975583ca26f req-a4a81197-b134-4f13-8004-15433b158a52 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:46.049443 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-ee1ed392-c93b-4570-8e51-a975583ca26f req-a4a81197-b134-4f13-8004-15433b158a52 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:46.085216 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-ee1ed392-c93b-4570-8e51-a975583ca26f req-a4a81197-b134-4f13-8004-15433b158a52 service nova] Creating event network-vif-unplugged:1e288590-eb74-4df3-ad37-16250a74ba4e for instance 541591c5-62f9-489a-96e7-e7cbbbfc4e28 on n-h2-850468-14 Aug 10 23:06:46.098135 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-ee1ed392-c93b-4570-8e51-a975583ca26f req-a4a81197-b134-4f13-8004-15433b158a52 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.093377 Aug 10 23:06:46.099533 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1211/2457] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:06:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:06:46.201155 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-ebc6d1f8-650f-4774-b2ae-411d795d1d48 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:46.202397 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-ebc6d1f8-650f-4774-b2ae-411d795d1d48 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] [instance: 541591c5-62f9-489a-96e7-e7cbbbfc4e28] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:06:46.216282 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ebc6d1f8-650f-4774-b2ae-411d795d1d48 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:46.220260 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ebc6d1f8-650f-4774-b2ae-411d795d1d48 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:46.222303 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ebc6d1f8-650f-4774-b2ae-411d795d1d48 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:46.235733 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ebc6d1f8-650f-4774-b2ae-411d795d1d48 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:46.237360 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ebc6d1f8-650f-4774-b2ae-411d795d1d48 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:46.241046 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ebc6d1f8-650f-4774-b2ae-411d795d1d48 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:46.426628 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-484b804b-4bfc-4c46-a730-38079429be86 req-7facd008-c372-4f1d-912d-3ab46ef26d61 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "092f973f-79e3-44bf-a2e0-f7d3bfddf42c", "tag": "f77ec6f6-c9b1-47bb-ab17-7f7a3f702dc8"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:06:46.451678 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-484b804b-4bfc-4c46-a730-38079429be86 req-7facd008-c372-4f1d-912d-3ab46ef26d61 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:46.452169 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-484b804b-4bfc-4c46-a730-38079429be86 req-7facd008-c372-4f1d-912d-3ab46ef26d61 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:46.452615 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-484b804b-4bfc-4c46-a730-38079429be86 req-7facd008-c372-4f1d-912d-3ab46ef26d61 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:46.476124 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-484b804b-4bfc-4c46-a730-38079429be86 req-7facd008-c372-4f1d-912d-3ab46ef26d61 service nova] Creating event network-changed:f77ec6f6-c9b1-47bb-ab17-7f7a3f702dc8 for instance 092f973f-79e3-44bf-a2e0-f7d3bfddf42c on n-h1-850468-14 Aug 10 23:06:46.488760 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-484b804b-4bfc-4c46-a730-38079429be86 req-7facd008-c372-4f1d-912d-3ab46ef26d61 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070640 Aug 10 23:06:46.519105 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1212/2458] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:06:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 23:06:46.537623 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-bf7daefb-46e2-4202-b6fb-9fd82463603d tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:46.538370 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-bf7daefb-46e2-4202-b6fb-9fd82463603d tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] [instance: 092f973f-79e3-44bf-a2e0-f7d3bfddf42c] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:06:46.555052 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bf7daefb-46e2-4202-b6fb-9fd82463603d tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:46.555566 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bf7daefb-46e2-4202-b6fb-9fd82463603d tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:46.556526 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bf7daefb-46e2-4202-b6fb-9fd82463603d tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:46.560789 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bf7daefb-46e2-4202-b6fb-9fd82463603d tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:46.567096 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bf7daefb-46e2-4202-b6fb-9fd82463603d tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:46.567930 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bf7daefb-46e2-4202-b6fb-9fd82463603d tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:46.834507 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-ebc6d1f8-650f-4774-b2ae-411d795d1d48 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de244f1f82143a0b3d3283c31d80bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14c63df2e6c46d2af23b6b8a52690d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:06:46.863413 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-ebc6d1f8-650f-4774-b2ae-411d795d1d48 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] 10.222.0.58 "GET /compute/v2.1/servers/541591c5-62f9-489a-96e7-e7cbbbfc4e28" status: 200 len: 1426 microversion: 2.1 time: 0.669434 Aug 10 23:06:46.867431 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1247/2459] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:06:46 2022] GET /compute/v2.1/servers/541591c5-62f9-489a-96e7-e7cbbbfc4e28 => generated 1426 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:06:46.887414 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-0d15a3f3-34ae-4914-bcd7-3a4b3a880ff8 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:46.888426 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-0d15a3f3-34ae-4914-bcd7-3a4b3a880ff8 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] [instance: 85c138c8-9302-453b-8dc1-8f0002d79f1a] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:06:46.896323 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0d15a3f3-34ae-4914-bcd7-3a4b3a880ff8 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:46.896916 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0d15a3f3-34ae-4914-bcd7-3a4b3a880ff8 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:46.897428 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0d15a3f3-34ae-4914-bcd7-3a4b3a880ff8 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:46.898220 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0d15a3f3-34ae-4914-bcd7-3a4b3a880ff8 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:46.898743 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0d15a3f3-34ae-4914-bcd7-3a4b3a880ff8 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:46.899481 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0d15a3f3-34ae-4914-bcd7-3a4b3a880ff8 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:46.905045 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=96,nova_cell1:INSERT=1 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:06:47.097938 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-0d15a3f3-34ae-4914-bcd7-3a4b3a880ff8 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8899e278c9453fba0ab05c69b0b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46ac8b84bd649fa88897068dbfa5ce6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:06:47.122212 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-0d15a3f3-34ae-4914-bcd7-3a4b3a880ff8 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] 10.222.0.58 "GET /compute/v2.1/servers/85c138c8-9302-453b-8dc1-8f0002d79f1a" status: 200 len: 1275 microversion: 2.1 time: 0.245650 Aug 10 23:06:47.141951 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1248/2460] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:06:46 2022] GET /compute/v2.1/servers/85c138c8-9302-453b-8dc1-8f0002d79f1a => generated 1275 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:06:47.160271 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-43891c0a-baf3-4a1a-b4ca-ea95593ce2ae req-b2a2a6db-792e-4ac1-98e0-b164ec9676ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "541591c5-62f9-489a-96e7-e7cbbbfc4e28", "name": "network-vif-deleted", "tag": "1e288590-eb74-4df3-ad37-16250a74ba4e"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:06:47.195261 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-43891c0a-baf3-4a1a-b4ca-ea95593ce2ae req-b2a2a6db-792e-4ac1-98e0-b164ec9676ed service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:47.196067 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-43891c0a-baf3-4a1a-b4ca-ea95593ce2ae req-b2a2a6db-792e-4ac1-98e0-b164ec9676ed service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:47.196914 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-43891c0a-baf3-4a1a-b4ca-ea95593ce2ae req-b2a2a6db-792e-4ac1-98e0-b164ec9676ed service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:47.268506 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-43891c0a-baf3-4a1a-b4ca-ea95593ce2ae req-b2a2a6db-792e-4ac1-98e0-b164ec9676ed service nova] Creating event network-vif-deleted:1e288590-eb74-4df3-ad37-16250a74ba4e for instance 541591c5-62f9-489a-96e7-e7cbbbfc4e28 on n-h2-850468-14 Aug 10 23:06:47.303811 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-43891c0a-baf3-4a1a-b4ca-ea95593ce2ae req-b2a2a6db-792e-4ac1-98e0-b164ec9676ed service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.157423 Aug 10 23:06:47.305428 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1249/2461] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:06:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:06:47.341614 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-bf7daefb-46e2-4202-b6fb-9fd82463603d tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c6e1f505b8409ea38f8a07bad870a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6473e36eada44e6bca8dc568e5ee330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:06:47.379205 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-bf7daefb-46e2-4202-b6fb-9fd82463603d tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] 10.222.0.58 "GET /compute/v2.1/servers/092f973f-79e3-44bf-a2e0-f7d3bfddf42c" status: 200 len: 1353 microversion: 2.1 time: 0.842917 Aug 10 23:06:47.381825 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1213/2462] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:06:46 2022] GET /compute/v2.1/servers/092f973f-79e3-44bf-a2e0-f7d3bfddf42c => generated 1353 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:06:47.892176 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-108c48d2-7a61-498a-8a9a-20214eacc0e2 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:47.893032 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-108c48d2-7a61-498a-8a9a-20214eacc0e2 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] [instance: 541591c5-62f9-489a-96e7-e7cbbbfc4e28] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:06:47.921329 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-108c48d2-7a61-498a-8a9a-20214eacc0e2 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:47.922115 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-108c48d2-7a61-498a-8a9a-20214eacc0e2 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:47.922761 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-108c48d2-7a61-498a-8a9a-20214eacc0e2 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:47.924075 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-108c48d2-7a61-498a-8a9a-20214eacc0e2 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:47.924737 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-108c48d2-7a61-498a-8a9a-20214eacc0e2 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:47.925309 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-108c48d2-7a61-498a-8a9a-20214eacc0e2 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:47.971313 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-108c48d2-7a61-498a-8a9a-20214eacc0e2 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] HTTP exception thrown: Instance 541591c5-62f9-489a-96e7-e7cbbbfc4e28 could not be found. Aug 10 23:06:47.975188 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-108c48d2-7a61-498a-8a9a-20214eacc0e2 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Request method failure captured: Aug 10 23:06:47.975188 n-d-850468-14 devstack@n-api.service[122633]: request: GET /compute/v2.1/servers/541591c5-62f9-489a-96e7-e7cbbbfc4e28 HTTP/1.1 Aug 10 23:06:47.975188 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:06:47.975188 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:06:47.975188 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:06:47.975188 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:06:47.975188 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:06:47.975188 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:06:47.975188 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:06:47.975188 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:06:47.975188 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9Dl6GC38IAoQwtYJepctjYFpL74I5toa99IDyqDCgzDW5hUleE_PTzRwpILUi3seJY6BeQXDpJM2O5YaEpfCX3h17mgJecTcR5YYvrNmoejmfEcdwgfkywuIX1h9S8RUQtXDfabapHiC7UL0qtSiJFQn0ATBfcKRgMQfS_Qk3Gc_V2g Aug 10 23:06:47.975188 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:06:47.975188 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:06:47.975188 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:06:47.975188 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:06:47.975188 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:06:47.975188 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:06:47.975188 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: b14c63df2e6c46d2af23b6b8a52690d9 Aug 10 23:06:47.975188 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-ServersAdminTestJSON-903269384 Aug 10 23:06:47.975188 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:06:47.975188 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:06:47.976809 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b14c63df2e6c46d2af23b6b8a52690d9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b14c63df2e6c46d2af23b6b8a52690d9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b14c63df2e6c46d2af23b6b8a52690d9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b14c63df2e6c46d2af23b6b8a52690d9", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:06:47.976809 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-ServersAdminTestJSON-903269384 Aug 10 23:06:47.976809 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: b14c63df2e6c46d2af23b6b8a52690d9 Aug 10 23:06:47.976809 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-ServersAdminTestJSON-903269384 Aug 10 23:06:47.976809 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-ServersAdminTestJSON-903269384-project Aug 10 23:06:47.976809 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:06:47.976809 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:06:47.976809 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 6de244f1f82143a0b3d3283c31d80bc9 Aug 10 23:06:47.976809 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-ServersAdminTestJSON-903269384-project Aug 10 23:06:47.976809 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:06:47.976809 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance 541591c5-62f9-489a-96e7-e7cbbbfc4e28 could not be found. Aug 10 23:06:47.976809 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': '541591c5-62f9-489a-96e7-e7cbbbfc4e28'} Aug 10 23:06:47.977829 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:06:47.977829 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:06:47.977829 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:06:47.977829 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:06:47.977829 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:06:47.977829 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:06:47.977829 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:06:47.977829 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:06:47.977829 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:06:47.977829 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:06:47.977829 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 541591c5-62f9-489a-96e7-e7cbbbfc4e28 could not be found. Aug 10 23:06:47.977829 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:06:47.977829 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:06:47.977829 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:06:47.977829 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:06:47.977829 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:06:47.977829 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:06:47.977829 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:06:47.977829 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:06:47.977829 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:06:47.979958 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:06:47.979958 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:06:47.979958 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:06:47.979958 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:06:47.979958 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:06:47.979958 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:06:47.979958 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:06:47.979958 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 541591c5-62f9-489a-96e7-e7cbbbfc4e28 could not be found. Aug 10 23:06:47.979958 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:06:47.979958 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:06:47.979958 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:06:47.979958 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:06:47.979958 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:06:47.979958 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:06:47.979958 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:06:47.979958 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:06:47.979958 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 541591c5-62f9-489a-96e7-e7cbbbfc4e28 could not be found. Aug 10 23:06:47.979958 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:06:47.985483 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-108c48d2-7a61-498a-8a9a-20214eacc0e2 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Returning 404 to user: Instance 541591c5-62f9-489a-96e7-e7cbbbfc4e28 could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:06:47.986614 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-108c48d2-7a61-498a-8a9a-20214eacc0e2 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] 10.222.0.58 "GET /compute/v2.1/servers/541591c5-62f9-489a-96e7-e7cbbbfc4e28" status: 404 len: 111 microversion: 2.1 time: 0.102618 Aug 10 23:06:48.000722 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-29a384fe-60e1-42ad-993a-f32f5fe0b0b3 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:48.002034 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-29a384fe-60e1-42ad-993a-f32f5fe0b0b3 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] [instance: b3b3730c-1396-4ca6-9d9e-8a3104950324] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:06:48.004174 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1250/2463] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:06:47 2022] GET /compute/v2.1/servers/541591c5-62f9-489a-96e7-e7cbbbfc4e28 => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:06:48.013427 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-29a384fe-60e1-42ad-993a-f32f5fe0b0b3 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:48.014363 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-29a384fe-60e1-42ad-993a-f32f5fe0b0b3 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:48.015228 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-29a384fe-60e1-42ad-993a-f32f5fe0b0b3 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:48.017835 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-29a384fe-60e1-42ad-993a-f32f5fe0b0b3 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:48.018979 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-29a384fe-60e1-42ad-993a-f32f5fe0b0b3 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:48.019506 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-29a384fe-60e1-42ad-993a-f32f5fe0b0b3 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:48.081107 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-29a384fe-60e1-42ad-993a-f32f5fe0b0b3 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] [instance: b3b3730c-1396-4ca6-9d9e-8a3104950324] Going to try to terminate instance {{(pid=122632) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:06:48.163688 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-82be2af4-9b8e-4944-be9e-1c314a1921e9 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:48.164552 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-82be2af4-9b8e-4944-be9e-1c314a1921e9 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] [instance: 85c138c8-9302-453b-8dc1-8f0002d79f1a] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:06:48.183643 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-82be2af4-9b8e-4944-be9e-1c314a1921e9 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:48.184513 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-82be2af4-9b8e-4944-be9e-1c314a1921e9 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:48.186248 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-82be2af4-9b8e-4944-be9e-1c314a1921e9 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:48.187199 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-82be2af4-9b8e-4944-be9e-1c314a1921e9 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:48.192456 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-82be2af4-9b8e-4944-be9e-1c314a1921e9 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:48.193249 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-82be2af4-9b8e-4944-be9e-1c314a1921e9 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:48.307492 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-29a384fe-60e1-42ad-993a-f32f5fe0b0b3 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] 10.222.0.58 "DELETE /compute/v2.1/servers/b3b3730c-1396-4ca6-9d9e-8a3104950324" status: 204 len: 0 microversion: 2.1 time: 0.310562 Aug 10 23:06:48.308294 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1214/2464] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:06:47 2022] DELETE /compute/v2.1/servers/b3b3730c-1396-4ca6-9d9e-8a3104950324 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 10 23:06:48.328571 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-33865525-f711-4c87-9b96-1bb523da4c16 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:48.329269 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-33865525-f711-4c87-9b96-1bb523da4c16 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] [instance: b3b3730c-1396-4ca6-9d9e-8a3104950324] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:06:48.353956 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-33865525-f711-4c87-9b96-1bb523da4c16 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:48.354735 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-33865525-f711-4c87-9b96-1bb523da4c16 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:48.355396 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-33865525-f711-4c87-9b96-1bb523da4c16 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:48.356532 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-33865525-f711-4c87-9b96-1bb523da4c16 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:48.357148 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-33865525-f711-4c87-9b96-1bb523da4c16 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:48.357736 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-33865525-f711-4c87-9b96-1bb523da4c16 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:48.775574 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-33865525-f711-4c87-9b96-1bb523da4c16 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de244f1f82143a0b3d3283c31d80bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14c63df2e6c46d2af23b6b8a52690d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:06:48.804832 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-33865525-f711-4c87-9b96-1bb523da4c16 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] 10.222.0.58 "GET /compute/v2.1/servers/b3b3730c-1396-4ca6-9d9e-8a3104950324" status: 200 len: 1469 microversion: 2.1 time: 0.488010 Aug 10 23:06:48.808486 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1215/2465] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:06:48 2022] GET /compute/v2.1/servers/b3b3730c-1396-4ca6-9d9e-8a3104950324 => generated 1469 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:06:48.827217 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-fc969bb4-9bad-4ba4-8df2-d6f352ad74ca tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:48.831174 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-fc969bb4-9bad-4ba4-8df2-d6f352ad74ca tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] [instance: 092f973f-79e3-44bf-a2e0-f7d3bfddf42c] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:06:48.853024 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fc969bb4-9bad-4ba4-8df2-d6f352ad74ca tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:48.855222 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fc969bb4-9bad-4ba4-8df2-d6f352ad74ca tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:48.857503 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fc969bb4-9bad-4ba4-8df2-d6f352ad74ca tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:48.862544 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fc969bb4-9bad-4ba4-8df2-d6f352ad74ca tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:48.864221 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fc969bb4-9bad-4ba4-8df2-d6f352ad74ca tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:48.864857 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fc969bb4-9bad-4ba4-8df2-d6f352ad74ca tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:49.065474 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-82be2af4-9b8e-4944-be9e-1c314a1921e9 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8899e278c9453fba0ab05c69b0b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46ac8b84bd649fa88897068dbfa5ce6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:06:49.088278 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-82be2af4-9b8e-4944-be9e-1c314a1921e9 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] 10.222.0.58 "GET /compute/v2.1/servers/85c138c8-9302-453b-8dc1-8f0002d79f1a" status: 200 len: 1317 microversion: 2.1 time: 0.925362 Aug 10 23:06:49.089484 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1251/2466] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:06:48 2022] GET /compute/v2.1/servers/85c138c8-9302-453b-8dc1-8f0002d79f1a => generated 1317 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:06:49.095380 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-35fada40-2236-4d4b-9599-65076119e68f req-c316df9f-426d-43de-b294-0868fde01a13 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "092f973f-79e3-44bf-a2e0-f7d3bfddf42c", "tag": "a66e8adc-f741-49ae-b190-468d5764b853"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:06:49.121956 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-35fada40-2236-4d4b-9599-65076119e68f req-c316df9f-426d-43de-b294-0868fde01a13 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:49.137037 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-35fada40-2236-4d4b-9599-65076119e68f req-c316df9f-426d-43de-b294-0868fde01a13 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:49.149233 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-35fada40-2236-4d4b-9599-65076119e68f req-c316df9f-426d-43de-b294-0868fde01a13 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:49.172633 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-35fada40-2236-4d4b-9599-65076119e68f req-c316df9f-426d-43de-b294-0868fde01a13 service nova] Creating event network-changed:a66e8adc-f741-49ae-b190-468d5764b853 for instance 092f973f-79e3-44bf-a2e0-f7d3bfddf42c on n-h1-850468-14 Aug 10 23:06:49.192533 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-35fada40-2236-4d4b-9599-65076119e68f req-c316df9f-426d-43de-b294-0868fde01a13 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101414 Aug 10 23:06:49.193392 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1252/2467] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:06:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:06:49.831673 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-e8bdbb40-72ae-4bd7-b704-1f5d0ceefe5d tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:49.832859 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-e8bdbb40-72ae-4bd7-b704-1f5d0ceefe5d tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] [instance: b3b3730c-1396-4ca6-9d9e-8a3104950324] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:06:49.847428 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e8bdbb40-72ae-4bd7-b704-1f5d0ceefe5d tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:49.848332 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e8bdbb40-72ae-4bd7-b704-1f5d0ceefe5d tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:49.849019 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e8bdbb40-72ae-4bd7-b704-1f5d0ceefe5d tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:49.849989 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e8bdbb40-72ae-4bd7-b704-1f5d0ceefe5d tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:49.850676 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e8bdbb40-72ae-4bd7-b704-1f5d0ceefe5d tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:49.851385 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e8bdbb40-72ae-4bd7-b704-1f5d0ceefe5d tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:50.294195 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-e8bdbb40-72ae-4bd7-b704-1f5d0ceefe5d tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de244f1f82143a0b3d3283c31d80bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14c63df2e6c46d2af23b6b8a52690d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:06:50.308073 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-e8bdbb40-72ae-4bd7-b704-1f5d0ceefe5d tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] 10.222.0.58 "GET /compute/v2.1/servers/b3b3730c-1396-4ca6-9d9e-8a3104950324" status: 200 len: 1469 microversion: 2.1 time: 0.480510 Aug 10 23:06:50.309594 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1253/2468] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:06:49 2022] GET /compute/v2.1/servers/b3b3730c-1396-4ca6-9d9e-8a3104950324 => generated 1469 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:06:50.325859 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-e7870b43-a0f9-4686-a69c-7ca33bb975dd tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:50.334188 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-e7870b43-a0f9-4686-a69c-7ca33bb975dd tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] [instance: 85c138c8-9302-453b-8dc1-8f0002d79f1a] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:06:50.367822 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-fc969bb4-9bad-4ba4-8df2-d6f352ad74ca tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c6e1f505b8409ea38f8a07bad870a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6473e36eada44e6bca8dc568e5ee330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:06:50.370101 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e7870b43-a0f9-4686-a69c-7ca33bb975dd tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:50.371701 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e7870b43-a0f9-4686-a69c-7ca33bb975dd tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:50.374648 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e7870b43-a0f9-4686-a69c-7ca33bb975dd tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:50.377965 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e7870b43-a0f9-4686-a69c-7ca33bb975dd tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:50.380411 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e7870b43-a0f9-4686-a69c-7ca33bb975dd tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:50.380682 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-fc969bb4-9bad-4ba4-8df2-d6f352ad74ca tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] 10.222.0.58 "GET /compute/v2.1/servers/092f973f-79e3-44bf-a2e0-f7d3bfddf42c" status: 200 len: 1353 microversion: 2.1 time: 1.567727 Aug 10 23:06:50.381781 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1216/2469] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:06:48 2022] GET /compute/v2.1/servers/092f973f-79e3-44bf-a2e0-f7d3bfddf42c => generated 1353 bytes in 1571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:06:50.381904 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e7870b43-a0f9-4686-a69c-7ca33bb975dd tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:50.865450 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-e7870b43-a0f9-4686-a69c-7ca33bb975dd tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8899e278c9453fba0ab05c69b0b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46ac8b84bd649fa88897068dbfa5ce6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:06:50.878231 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-e7870b43-a0f9-4686-a69c-7ca33bb975dd tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] 10.222.0.58 "GET /compute/v2.1/servers/85c138c8-9302-453b-8dc1-8f0002d79f1a" status: 200 len: 1317 microversion: 2.1 time: 0.562605 Aug 10 23:06:50.879127 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1254/2470] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:06:50 2022] GET /compute/v2.1/servers/85c138c8-9302-453b-8dc1-8f0002d79f1a => generated 1317 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:06:51.281097 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-89f1ed3a-354c-4622-b169-7861f9432270 req-0c130180-7cae-4f9d-bd4d-b135640f18ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85c138c8-9302-453b-8dc1-8f0002d79f1a", "tag": "23b5445e-4fcc-47d3-96d2-0cd88c2ec431"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:06:51.321026 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-89f1ed3a-354c-4622-b169-7861f9432270 req-0c130180-7cae-4f9d-bd4d-b135640f18ef service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:51.323254 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-89f1ed3a-354c-4622-b169-7861f9432270 req-0c130180-7cae-4f9d-bd4d-b135640f18ef service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:51.328346 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-89f1ed3a-354c-4622-b169-7861f9432270 req-0c130180-7cae-4f9d-bd4d-b135640f18ef service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:51.335938 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-007419b5-bcec-43e6-a94a-5b0f904b4903 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:51.336895 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-007419b5-bcec-43e6-a94a-5b0f904b4903 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] [instance: b3b3730c-1396-4ca6-9d9e-8a3104950324] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:06:51.339728 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=11 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:06:51.362021 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-007419b5-bcec-43e6-a94a-5b0f904b4903 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:51.362537 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-007419b5-bcec-43e6-a94a-5b0f904b4903 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:51.363020 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-007419b5-bcec-43e6-a94a-5b0f904b4903 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:51.363237 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-89f1ed3a-354c-4622-b169-7861f9432270 req-0c130180-7cae-4f9d-bd4d-b135640f18ef service nova] Creating event network-changed:23b5445e-4fcc-47d3-96d2-0cd88c2ec431 for instance 85c138c8-9302-453b-8dc1-8f0002d79f1a on n-h2-850468-14 Aug 10 23:06:51.364878 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-007419b5-bcec-43e6-a94a-5b0f904b4903 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:51.371269 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-007419b5-bcec-43e6-a94a-5b0f904b4903 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:51.371905 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-007419b5-bcec-43e6-a94a-5b0f904b4903 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:51.379254 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-89f1ed3a-354c-4622-b169-7861f9432270 req-0c130180-7cae-4f9d-bd4d-b135640f18ef service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103223 Aug 10 23:06:51.379921 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1217/2471] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:06:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:06:51.404155 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-46f8f678-70e3-43c3-8f86-9513fa57bda1 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:51.404923 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-46f8f678-70e3-43c3-8f86-9513fa57bda1 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] [instance: 092f973f-79e3-44bf-a2e0-f7d3bfddf42c] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:06:51.417991 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-46f8f678-70e3-43c3-8f86-9513fa57bda1 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:51.418490 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-46f8f678-70e3-43c3-8f86-9513fa57bda1 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:51.422319 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-46f8f678-70e3-43c3-8f86-9513fa57bda1 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:51.423356 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-46f8f678-70e3-43c3-8f86-9513fa57bda1 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:51.427509 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-46f8f678-70e3-43c3-8f86-9513fa57bda1 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:51.428166 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-46f8f678-70e3-43c3-8f86-9513fa57bda1 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:51.894142 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-007419b5-bcec-43e6-a94a-5b0f904b4903 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de244f1f82143a0b3d3283c31d80bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14c63df2e6c46d2af23b6b8a52690d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:06:51.910612 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-007419b5-bcec-43e6-a94a-5b0f904b4903 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] 10.222.0.58 "GET /compute/v2.1/servers/b3b3730c-1396-4ca6-9d9e-8a3104950324" status: 200 len: 1469 microversion: 2.1 time: 0.576642 Aug 10 23:06:51.911685 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1255/2472] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:06:51 2022] GET /compute/v2.1/servers/b3b3730c-1396-4ca6-9d9e-8a3104950324 => generated 1469 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:06:52.092113 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-04b7f196-9d56-4e23-9d74-1f322e6d555d tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-1015955453", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452", "networks": "none"}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:06:52.176710 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-04b7f196-9d56-4e23-9d74-1f322e6d555d tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Flavor limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:06:52.177025 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-04b7f196-9d56-4e23-9d74-1f322e6d555d tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Image limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:06:52.177504 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-04b7f196-9d56-4e23-9d74-1f322e6d555d tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Flavor pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:06:52.177916 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-04b7f196-9d56-4e23-9d74-1f322e6d555d tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Image pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:06:52.178330 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-04b7f196-9d56-4e23-9d74-1f322e6d555d tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:06:52.195458 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-04b7f196-9d56-4e23-9d74-1f322e6d555d tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:52.196099 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-04b7f196-9d56-4e23-9d74-1f322e6d555d tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:52.196545 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-04b7f196-9d56-4e23-9d74-1f322e6d555d tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:52.198423 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-04b7f196-9d56-4e23-9d74-1f322e6d555d tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:52.199107 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-04b7f196-9d56-4e23-9d74-1f322e6d555d tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:52.199701 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-04b7f196-9d56-4e23-9d74-1f322e6d555d tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:52.239791 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-04b7f196-9d56-4e23-9d74-1f322e6d555d tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Getting quotas for project c9af75fc4bbc4b63ae83b5f900f1aa07. Resources: {'instances', 'cores', 'ram'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:06:52.253697 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-04b7f196-9d56-4e23-9d74-1f322e6d555d tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Getting quotas for user 0d79bf59dabe4c02aa5e27bf3b0bc1ad and project c9af75fc4bbc4b63ae83b5f900f1aa07. Resources: {'instances', 'cores', 'ram'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:06:52.271301 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-04b7f196-9d56-4e23-9d74-1f322e6d555d tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Going to run 1 instances... {{(pid=122633) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 23:06:52.275152 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-04b7f196-9d56-4e23-9d74-1f322e6d555d tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] [instance: 8385348f-0651-486d-9b4a-2c884933edb1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78ad8905-f66f-4733-8be9-2b260f1fabed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122633) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 23:06:52.355762 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-04b7f196-9d56-4e23-9d74-1f322e6d555d tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.440459 Aug 10 23:06:52.364234 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1256/2473] 10.222.0.58 () {62 vars in 1188 bytes} [Wed Aug 10 23:06:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 449 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 10 23:06:52.371619 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-987af462-00c7-42b4-8566-383b2db1dc57 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:52.372713 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-987af462-00c7-42b4-8566-383b2db1dc57 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] [instance: 85c138c8-9302-453b-8dc1-8f0002d79f1a] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:06:52.381176 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-987af462-00c7-42b4-8566-383b2db1dc57 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:52.382441 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-987af462-00c7-42b4-8566-383b2db1dc57 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:52.383096 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-987af462-00c7-42b4-8566-383b2db1dc57 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:52.385118 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-987af462-00c7-42b4-8566-383b2db1dc57 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:52.385975 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-987af462-00c7-42b4-8566-383b2db1dc57 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:52.386564 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-987af462-00c7-42b4-8566-383b2db1dc57 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:52.561930 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=8 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:06:52.637708 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-46f8f678-70e3-43c3-8f86-9513fa57bda1 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c6e1f505b8409ea38f8a07bad870a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6473e36eada44e6bca8dc568e5ee330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:06:52.657674 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-46f8f678-70e3-43c3-8f86-9513fa57bda1 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] 10.222.0.58 "GET /compute/v2.1/servers/092f973f-79e3-44bf-a2e0-f7d3bfddf42c" status: 200 len: 1353 microversion: 2.1 time: 1.258971 Aug 10 23:06:52.670120 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1218/2474] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:06:51 2022] GET /compute/v2.1/servers/092f973f-79e3-44bf-a2e0-f7d3bfddf42c => generated 1353 bytes in 1264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:06:52.675609 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-e4162c2d-1d90-4448-b9d0-d19812f8e862 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:06:52.676966 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-e4162c2d-1d90-4448-b9d0-d19812f8e862 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] [instance: 8385348f-0651-486d-9b4a-2c884933edb1] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:06:52.906971 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-987af462-00c7-42b4-8566-383b2db1dc57 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8899e278c9453fba0ab05c69b0b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46ac8b84bd649fa88897068dbfa5ce6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:06:52.916979 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-987af462-00c7-42b4-8566-383b2db1dc57 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] 10.222.0.58 "GET /compute/v2.1/servers/85c138c8-9302-453b-8dc1-8f0002d79f1a" status: 200 len: 1317 microversion: 2.1 time: 0.551112 Aug 10 23:06:52.917822 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1257/2475] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:06:52 2022] GET /compute/v2.1/servers/85c138c8-9302-453b-8dc1-8f0002d79f1a => generated 1317 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:06:52.936778 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-3f831323-4f5f-48ed-b43e-d2762624255b req-a69dd29e-9e82-48d3-bf02-d37b1734eea8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b3b3730c-1396-4ca6-9d9e-8a3104950324", "name": "network-vif-deleted", "tag": "aee4dd1c-12e7-4581-960e-4729757cc898"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:06:52.954712 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-3f831323-4f5f-48ed-b43e-d2762624255b req-a69dd29e-9e82-48d3-bf02-d37b1734eea8 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:52.955237 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-3f831323-4f5f-48ed-b43e-d2762624255b req-a69dd29e-9e82-48d3-bf02-d37b1734eea8 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:52.961650 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-3f831323-4f5f-48ed-b43e-d2762624255b req-a69dd29e-9e82-48d3-bf02-d37b1734eea8 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:52.993287 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-3f831323-4f5f-48ed-b43e-d2762624255b req-a69dd29e-9e82-48d3-bf02-d37b1734eea8 service nova] Creating event network-vif-deleted:aee4dd1c-12e7-4581-960e-4729757cc898 for instance b3b3730c-1396-4ca6-9d9e-8a3104950324 on n-h1-850468-14 Aug 10 23:06:53.014636 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-3f831323-4f5f-48ed-b43e-d2762624255b req-a69dd29e-9e82-48d3-bf02-d37b1734eea8 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095386 Aug 10 23:06:53.015736 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1258/2476] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:06:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:06:53.033504 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c62657a8-09a3-484c-8b99-ff561dd3b2cc tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:53.034226 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-c62657a8-09a3-484c-8b99-ff561dd3b2cc tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] [instance: b3b3730c-1396-4ca6-9d9e-8a3104950324] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:06:53.037808 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-e4162c2d-1d90-4448-b9d0-d19812f8e862 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d79bf59dabe4c02aa5e27bf3b0bc1ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9af75fc4bbc4b63ae83b5f900f1aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:06:53.061130 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c62657a8-09a3-484c-8b99-ff561dd3b2cc tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:53.061632 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c62657a8-09a3-484c-8b99-ff561dd3b2cc tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:53.062082 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c62657a8-09a3-484c-8b99-ff561dd3b2cc tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:53.062437 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-e4162c2d-1d90-4448-b9d0-d19812f8e862 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d79bf59dabe4c02aa5e27bf3b0bc1ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9af75fc4bbc4b63ae83b5f900f1aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:06:53.062821 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c62657a8-09a3-484c-8b99-ff561dd3b2cc tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:53.063291 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c62657a8-09a3-484c-8b99-ff561dd3b2cc tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:53.063828 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c62657a8-09a3-484c-8b99-ff561dd3b2cc tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:53.065825 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-e4162c2d-1d90-4448-b9d0-d19812f8e862 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d79bf59dabe4c02aa5e27bf3b0bc1ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9af75fc4bbc4b63ae83b5f900f1aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:06:53.090802 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-e4162c2d-1d90-4448-b9d0-d19812f8e862 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] 10.222.0.58 "PUT /compute/v2.1/servers/8385348f-0651-486d-9b4a-2c884933edb1" status: 200 len: 1359 microversion: 2.75 time: 0.425318 Aug 10 23:06:53.095246 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1219/2477] 10.222.0.58 () {62 vars in 1297 bytes} [Wed Aug 10 23:06:52 2022] PUT /compute/v2.1/servers/8385348f-0651-486d-9b4a-2c884933edb1 => generated 1359 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:06:53.145854 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-f8f09a73-dde5-4343-97c4-5245417806ce tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:53.150874 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-f8f09a73-dde5-4343-97c4-5245417806ce tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] [instance: 8385348f-0651-486d-9b4a-2c884933edb1] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:06:53.180714 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c62657a8-09a3-484c-8b99-ff561dd3b2cc tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:53.181973 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c62657a8-09a3-484c-8b99-ff561dd3b2cc tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:53.186926 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c62657a8-09a3-484c-8b99-ff561dd3b2cc tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:53.187742 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.objects.instance [None req-c62657a8-09a3-484c-8b99-ff561dd3b2cc tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lazy-loading 'fault' on Instance uuid b3b3730c-1396-4ca6-9d9e-8a3104950324 {{(pid=122633) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:06:53.195720 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f8f09a73-dde5-4343-97c4-5245417806ce tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:53.201383 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f8f09a73-dde5-4343-97c4-5245417806ce tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:53.204999 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f8f09a73-dde5-4343-97c4-5245417806ce tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:53.206391 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f8f09a73-dde5-4343-97c4-5245417806ce tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:53.211936 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f8f09a73-dde5-4343-97c4-5245417806ce tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:53.213851 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f8f09a73-dde5-4343-97c4-5245417806ce tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:53.403146 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-c62657a8-09a3-484c-8b99-ff561dd3b2cc tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6de244f1f82143a0b3d3283c31d80bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b14c63df2e6c46d2af23b6b8a52690d9', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:06:53.423756 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-c62657a8-09a3-484c-8b99-ff561dd3b2cc tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] 10.222.0.58 "GET /compute/v2.1/servers/b3b3730c-1396-4ca6-9d9e-8a3104950324" status: 200 len: 1304 microversion: 2.1 time: 0.406538 Aug 10 23:06:53.425240 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1259/2478] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:06:53 2022] GET /compute/v2.1/servers/b3b3730c-1396-4ca6-9d9e-8a3104950324 => generated 1304 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:06:53.687732 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-a1968484-43bb-4cce-bd4c-4d55a796a4f9 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:53.692136 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-a1968484-43bb-4cce-bd4c-4d55a796a4f9 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] [instance: 092f973f-79e3-44bf-a2e0-f7d3bfddf42c] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:06:53.712033 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a1968484-43bb-4cce-bd4c-4d55a796a4f9 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:53.712763 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a1968484-43bb-4cce-bd4c-4d55a796a4f9 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:53.713787 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a1968484-43bb-4cce-bd4c-4d55a796a4f9 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:53.714649 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a1968484-43bb-4cce-bd4c-4d55a796a4f9 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:53.715927 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a1968484-43bb-4cce-bd4c-4d55a796a4f9 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:53.718493 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a1968484-43bb-4cce-bd4c-4d55a796a4f9 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:53.794570 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-f8f09a73-dde5-4343-97c4-5245417806ce tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d79bf59dabe4c02aa5e27bf3b0bc1ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9af75fc4bbc4b63ae83b5f900f1aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:06:53.814926 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-f8f09a73-dde5-4343-97c4-5245417806ce tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d79bf59dabe4c02aa5e27bf3b0bc1ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9af75fc4bbc4b63ae83b5f900f1aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:06:53.816700 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-f8f09a73-dde5-4343-97c4-5245417806ce tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d79bf59dabe4c02aa5e27bf3b0bc1ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9af75fc4bbc4b63ae83b5f900f1aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:06:53.832025 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-f8f09a73-dde5-4343-97c4-5245417806ce tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] 10.222.0.58 "GET /compute/v2.1/servers/8385348f-0651-486d-9b4a-2c884933edb1" status: 200 len: 1355 microversion: 2.75 time: 0.712079 Aug 10 23:06:53.839162 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1220/2479] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:06:53 2022] GET /compute/v2.1/servers/8385348f-0651-486d-9b4a-2c884933edb1 => generated 1355 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:06:53.938154 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-7d0b277e-b165-4c6d-8050-73d58077dea9 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:53.939130 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-7d0b277e-b165-4c6d-8050-73d58077dea9 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] [instance: 85c138c8-9302-453b-8dc1-8f0002d79f1a] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:06:53.954519 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7d0b277e-b165-4c6d-8050-73d58077dea9 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:53.956318 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7d0b277e-b165-4c6d-8050-73d58077dea9 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:53.963496 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7d0b277e-b165-4c6d-8050-73d58077dea9 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:53.964618 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7d0b277e-b165-4c6d-8050-73d58077dea9 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:53.965563 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7d0b277e-b165-4c6d-8050-73d58077dea9 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:53.966468 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7d0b277e-b165-4c6d-8050-73d58077dea9 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:54.489478 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-a1968484-43bb-4cce-bd4c-4d55a796a4f9 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c6e1f505b8409ea38f8a07bad870a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6473e36eada44e6bca8dc568e5ee330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:06:54.501194 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-a1968484-43bb-4cce-bd4c-4d55a796a4f9 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] 10.222.0.58 "GET /compute/v2.1/servers/092f973f-79e3-44bf-a2e0-f7d3bfddf42c" status: 200 len: 1353 microversion: 2.1 time: 0.818565 Aug 10 23:06:54.504024 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1260/2480] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:06:53 2022] GET /compute/v2.1/servers/092f973f-79e3-44bf-a2e0-f7d3bfddf42c => generated 1353 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:06:54.516036 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-87422c7d-a052-49ae-b771-5c090dc76fc2 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:54.521713 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-87422c7d-a052-49ae-b771-5c090dc76fc2 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] [instance: b3b3730c-1396-4ca6-9d9e-8a3104950324] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:06:54.536329 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-87422c7d-a052-49ae-b771-5c090dc76fc2 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:54.539335 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-87422c7d-a052-49ae-b771-5c090dc76fc2 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:54.539984 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-87422c7d-a052-49ae-b771-5c090dc76fc2 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:54.545057 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-87422c7d-a052-49ae-b771-5c090dc76fc2 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:54.545786 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-87422c7d-a052-49ae-b771-5c090dc76fc2 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:54.546381 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-87422c7d-a052-49ae-b771-5c090dc76fc2 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:54.565950 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-87422c7d-a052-49ae-b771-5c090dc76fc2 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] HTTP exception thrown: Instance b3b3730c-1396-4ca6-9d9e-8a3104950324 could not be found. Aug 10 23:06:54.567929 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-87422c7d-a052-49ae-b771-5c090dc76fc2 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Request method failure captured: Aug 10 23:06:54.567929 n-d-850468-14 devstack@n-api.service[122633]: request: GET /compute/v2.1/servers/b3b3730c-1396-4ca6-9d9e-8a3104950324 HTTP/1.1 Aug 10 23:06:54.567929 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:06:54.567929 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:06:54.567929 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:06:54.567929 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:06:54.567929 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:06:54.567929 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:06:54.567929 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:06:54.567929 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:06:54.567929 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9Dl6GC38IAoQwtYJepctjYFpL74I5toa99IDyqDCgzDW5hUleE_PTzRwpILUi3seJY6BeQXDpJM2O5YaEpfCX3h17mgJecTcR5YYvrNmoejmfEcdwgfkywuIX1h9S8RUQtXDfabapHiC7UL0qtSiJFQn0ATBfcKRgMQfS_Qk3Gc_V2g Aug 10 23:06:54.567929 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:06:54.567929 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:06:54.567929 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:06:54.567929 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:06:54.567929 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:06:54.567929 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:06:54.567929 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: b14c63df2e6c46d2af23b6b8a52690d9 Aug 10 23:06:54.567929 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-ServersAdminTestJSON-903269384 Aug 10 23:06:54.567929 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:06:54.567929 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:06:54.569192 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b14c63df2e6c46d2af23b6b8a52690d9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b14c63df2e6c46d2af23b6b8a52690d9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b14c63df2e6c46d2af23b6b8a52690d9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b14c63df2e6c46d2af23b6b8a52690d9", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:06:54.569192 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-ServersAdminTestJSON-903269384 Aug 10 23:06:54.569192 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: b14c63df2e6c46d2af23b6b8a52690d9 Aug 10 23:06:54.569192 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-ServersAdminTestJSON-903269384 Aug 10 23:06:54.569192 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-ServersAdminTestJSON-903269384-project Aug 10 23:06:54.569192 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:06:54.569192 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:06:54.569192 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 6de244f1f82143a0b3d3283c31d80bc9 Aug 10 23:06:54.569192 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-ServersAdminTestJSON-903269384-project Aug 10 23:06:54.569192 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:06:54.569192 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance b3b3730c-1396-4ca6-9d9e-8a3104950324 could not be found. Aug 10 23:06:54.569192 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': 'b3b3730c-1396-4ca6-9d9e-8a3104950324'} Aug 10 23:06:54.569915 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:06:54.569915 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:06:54.569915 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:06:54.569915 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:06:54.569915 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:06:54.569915 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:06:54.569915 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:06:54.569915 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:06:54.569915 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:06:54.569915 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:06:54.569915 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b3b3730c-1396-4ca6-9d9e-8a3104950324 could not be found. Aug 10 23:06:54.569915 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:06:54.569915 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:06:54.569915 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:06:54.569915 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:06:54.569915 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:06:54.569915 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:06:54.569915 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:06:54.569915 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:06:54.569915 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:06:54.571524 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:06:54.571524 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:06:54.571524 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:06:54.571524 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:06:54.571524 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:06:54.571524 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:06:54.571524 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:06:54.571524 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b3b3730c-1396-4ca6-9d9e-8a3104950324 could not be found. Aug 10 23:06:54.571524 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:06:54.571524 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:06:54.571524 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:06:54.571524 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:06:54.571524 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:06:54.571524 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:06:54.571524 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:06:54.571524 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:06:54.571524 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b3b3730c-1396-4ca6-9d9e-8a3104950324 could not be found. Aug 10 23:06:54.571524 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:06:54.573782 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-7d0b277e-b165-4c6d-8050-73d58077dea9 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8899e278c9453fba0ab05c69b0b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46ac8b84bd649fa88897068dbfa5ce6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:06:54.574454 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-87422c7d-a052-49ae-b771-5c090dc76fc2 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] Returning 404 to user: Instance b3b3730c-1396-4ca6-9d9e-8a3104950324 could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:06:54.575672 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-87422c7d-a052-49ae-b771-5c090dc76fc2 tempest-ServersAdminTestJSON-903269384 tempest-ServersAdminTestJSON-903269384-project] 10.222.0.58 "GET /compute/v2.1/servers/b3b3730c-1396-4ca6-9d9e-8a3104950324" status: 404 len: 111 microversion: 2.1 time: 0.066136 Aug 10 23:06:54.576821 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1261/2481] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:06:54 2022] GET /compute/v2.1/servers/b3b3730c-1396-4ca6-9d9e-8a3104950324 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:06:54.586002 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-7d0b277e-b165-4c6d-8050-73d58077dea9 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] 10.222.0.58 "GET /compute/v2.1/servers/85c138c8-9302-453b-8dc1-8f0002d79f1a" status: 200 len: 1317 microversion: 2.1 time: 0.648753 Aug 10 23:06:54.598393 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1221/2482] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:06:53 2022] GET /compute/v2.1/servers/85c138c8-9302-453b-8dc1-8f0002d79f1a => generated 1317 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:06:54.862619 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-f093cb2c-8f90-42bd-8157-eb8af2761d1b tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:54.863285 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-f093cb2c-8f90-42bd-8157-eb8af2761d1b tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] [instance: 8385348f-0651-486d-9b4a-2c884933edb1] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:06:54.874594 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f093cb2c-8f90-42bd-8157-eb8af2761d1b tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:54.875153 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f093cb2c-8f90-42bd-8157-eb8af2761d1b tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:54.875571 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f093cb2c-8f90-42bd-8157-eb8af2761d1b tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:54.879013 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f093cb2c-8f90-42bd-8157-eb8af2761d1b tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:54.879688 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f093cb2c-8f90-42bd-8157-eb8af2761d1b tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:54.881604 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f093cb2c-8f90-42bd-8157-eb8af2761d1b tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:55.304819 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-f093cb2c-8f90-42bd-8157-eb8af2761d1b tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d79bf59dabe4c02aa5e27bf3b0bc1ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9af75fc4bbc4b63ae83b5f900f1aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:06:55.322292 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-f093cb2c-8f90-42bd-8157-eb8af2761d1b tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d79bf59dabe4c02aa5e27bf3b0bc1ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9af75fc4bbc4b63ae83b5f900f1aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:06:55.333589 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-f093cb2c-8f90-42bd-8157-eb8af2761d1b tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d79bf59dabe4c02aa5e27bf3b0bc1ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9af75fc4bbc4b63ae83b5f900f1aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:06:55.356511 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-f093cb2c-8f90-42bd-8157-eb8af2761d1b tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] 10.222.0.58 "GET /compute/v2.1/servers/8385348f-0651-486d-9b4a-2c884933edb1" status: 200 len: 1417 microversion: 2.75 time: 0.498666 Aug 10 23:06:55.357117 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1262/2483] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:06:54 2022] GET /compute/v2.1/servers/8385348f-0651-486d-9b4a-2c884933edb1 => generated 1417 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:06:55.528666 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-7d47feb2-9371-4fbd-8989-a900e1736e91 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:55.529820 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-7d47feb2-9371-4fbd-8989-a900e1736e91 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] [instance: 092f973f-79e3-44bf-a2e0-f7d3bfddf42c] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:06:55.544142 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_api:INSERT=13,nova_api:SELECT=73,nova_api:UPDATE=14 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:06:55.548550 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7d47feb2-9371-4fbd-8989-a900e1736e91 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:55.549429 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7d47feb2-9371-4fbd-8989-a900e1736e91 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:55.553536 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7d47feb2-9371-4fbd-8989-a900e1736e91 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:55.554603 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7d47feb2-9371-4fbd-8989-a900e1736e91 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:55.556255 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7d47feb2-9371-4fbd-8989-a900e1736e91 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:55.558429 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7d47feb2-9371-4fbd-8989-a900e1736e91 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:55.611150 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-b60b36c1-fd03-4b69-8673-cc09ff68aec7 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:55.611889 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-b60b36c1-fd03-4b69-8673-cc09ff68aec7 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] [instance: 85c138c8-9302-453b-8dc1-8f0002d79f1a] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:06:55.624811 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b60b36c1-fd03-4b69-8673-cc09ff68aec7 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:55.625673 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b60b36c1-fd03-4b69-8673-cc09ff68aec7 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:55.626225 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b60b36c1-fd03-4b69-8673-cc09ff68aec7 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:55.627675 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b60b36c1-fd03-4b69-8673-cc09ff68aec7 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:55.633934 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b60b36c1-fd03-4b69-8673-cc09ff68aec7 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:55.634612 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b60b36c1-fd03-4b69-8673-cc09ff68aec7 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:56.182268 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-b60b36c1-fd03-4b69-8673-cc09ff68aec7 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8899e278c9453fba0ab05c69b0b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46ac8b84bd649fa88897068dbfa5ce6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:06:56.192855 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-b60b36c1-fd03-4b69-8673-cc09ff68aec7 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] 10.222.0.58 "GET /compute/v2.1/servers/85c138c8-9302-453b-8dc1-8f0002d79f1a" status: 200 len: 1317 microversion: 2.1 time: 0.586820 Aug 10 23:06:56.198764 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1263/2484] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:06:55 2022] GET /compute/v2.1/servers/85c138c8-9302-453b-8dc1-8f0002d79f1a => generated 1317 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:06:56.370494 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-7d47feb2-9371-4fbd-8989-a900e1736e91 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c6e1f505b8409ea38f8a07bad870a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6473e36eada44e6bca8dc568e5ee330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:06:56.385527 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-2b5ec023-76bb-4917-ae98-4f4cbd6ec450 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:56.386295 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-2b5ec023-76bb-4917-ae98-4f4cbd6ec450 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] [instance: 8385348f-0651-486d-9b4a-2c884933edb1] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:06:56.391537 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-7d47feb2-9371-4fbd-8989-a900e1736e91 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] 10.222.0.58 "GET /compute/v2.1/servers/092f973f-79e3-44bf-a2e0-f7d3bfddf42c" status: 200 len: 1353 microversion: 2.1 time: 0.857780 Aug 10 23:06:56.394409 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1222/2485] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:06:55 2022] GET /compute/v2.1/servers/092f973f-79e3-44bf-a2e0-f7d3bfddf42c => generated 1353 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:06:56.407500 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2b5ec023-76bb-4917-ae98-4f4cbd6ec450 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:56.407500 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2b5ec023-76bb-4917-ae98-4f4cbd6ec450 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:56.407500 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2b5ec023-76bb-4917-ae98-4f4cbd6ec450 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:56.407500 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2b5ec023-76bb-4917-ae98-4f4cbd6ec450 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:56.407992 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2b5ec023-76bb-4917-ae98-4f4cbd6ec450 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:56.407992 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2b5ec023-76bb-4917-ae98-4f4cbd6ec450 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:56.604913 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-2b5ec023-76bb-4917-ae98-4f4cbd6ec450 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d79bf59dabe4c02aa5e27bf3b0bc1ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9af75fc4bbc4b63ae83b5f900f1aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:06:56.633573 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-2b5ec023-76bb-4917-ae98-4f4cbd6ec450 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d79bf59dabe4c02aa5e27bf3b0bc1ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9af75fc4bbc4b63ae83b5f900f1aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:06:56.635897 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-2b5ec023-76bb-4917-ae98-4f4cbd6ec450 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d79bf59dabe4c02aa5e27bf3b0bc1ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9af75fc4bbc4b63ae83b5f900f1aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:06:56.659918 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-2b5ec023-76bb-4917-ae98-4f4cbd6ec450 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] 10.222.0.58 "GET /compute/v2.1/servers/8385348f-0651-486d-9b4a-2c884933edb1" status: 200 len: 1417 microversion: 2.75 time: 0.277964 Aug 10 23:06:56.661084 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1264/2486] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:06:56 2022] GET /compute/v2.1/servers/8385348f-0651-486d-9b4a-2c884933edb1 => generated 1417 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:06:56.868899 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-6a85e64d-c779-4cb8-96f1-eaa8ee06495a tempest-FloatingIPDetailsNegativeTestJSON-1092496663 tempest-FloatingIPDetailsNegativeTestJSON-1092496663-project] Calling method '.version_select at 0x7f847d3709d0>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:57.045348 n-d-850468-14 devstack@n-api.service[122632]: DEBUG neutronclient.v2_0.client [None req-6a85e64d-c779-4cb8-96f1-eaa8ee06495a tempest-FloatingIPDetailsNegativeTestJSON-1092496663 tempest-FloatingIPDetailsNegativeTestJSON-1092496663-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 1b0a4570-dddf-49f0-bb38-086056d7f386 could not be found", "detail": ""}} {{(pid=122632) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 10 23:06:57.046967 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-6a85e64d-c779-4cb8-96f1-eaa8ee06495a tempest-FloatingIPDetailsNegativeTestJSON-1092496663 tempest-FloatingIPDetailsNegativeTestJSON-1092496663-project] HTTP exception thrown: Floating IP not found for ID 1b0a4570-dddf-49f0-bb38-086056d7f386 Aug 10 23:06:57.049290 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-6a85e64d-c779-4cb8-96f1-eaa8ee06495a tempest-FloatingIPDetailsNegativeTestJSON-1092496663 tempest-FloatingIPDetailsNegativeTestJSON-1092496663-project] Request method failure captured: Aug 10 23:06:57.049290 n-d-850468-14 devstack@n-api.service[122632]: request: GET /compute/v2.1/os-floating-ips/1b0a4570-dddf-49f0-bb38-086056d7f386 HTTP/1.1 Aug 10 23:06:57.049290 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:06:57.049290 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:06:57.049290 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:06:57.049290 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 23:06:57.049290 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:06:57.049290 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:06:57.049290 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:06:57.049290 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:06:57.049290 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9DoQw_VHeAcSTEvxmnU79D1GdWi_XFIoW1WvDzBfeksr-F9V6JF-y9Xx_dT7xryf2JOxgmfPwcyx_HpZ0RxhLJWUgKajEABdAMLheOABZDHTffoD30H83pINy8ff_ktAd9yq9-PBQtSZC8JvhTwcgNTtTsKcjucf0L1dVHbQKEgUHLA Aug 10 23:06:57.049290 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:06:57.049290 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:06:57.049290 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:06:57.049290 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:06:57.049290 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:06:57.049290 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:06:57.049290 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: ea2d5051f17146d3973541ab27e544d5 Aug 10 23:06:57.049290 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-1092496663 Aug 10 23:06:57.049290 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:06:57.049290 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:06:57.050754 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ea2d5051f17146d3973541ab27e544d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ea2d5051f17146d3973541ab27e544d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ea2d5051f17146d3973541ab27e544d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ea2d5051f17146d3973541ab27e544d5", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:06:57.050754 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-1092496663 Aug 10 23:06:57.050754 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: ea2d5051f17146d3973541ab27e544d5 Aug 10 23:06:57.050754 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-1092496663 Aug 10 23:06:57.050754 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-1092496663-project Aug 10 23:06:57.050754 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:06:57.050754 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:06:57.050754 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: 50143df73f4a4f618c096d09971b1ea3 Aug 10 23:06:57.050754 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-1092496663-project Aug 10 23:06:57.050754 n-d-850468-14 devstack@n-api.service[122632]: method: Aug 10 23:06:57.050754 n-d-850468-14 devstack@n-api.service[122632]: exception: Floating IP not found for ID 1b0a4570-dddf-49f0-bb38-086056d7f386 Aug 10 23:06:57.050754 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': '1b0a4570-dddf-49f0-bb38-086056d7f386'} Aug 10 23:06:57.051495 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:06:57.051495 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:06:57.051495 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Aug 10 23:06:57.051495 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Aug 10 23:06:57.051495 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 23:06:57.051495 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 23:06:57.051495 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Aug 10 23:06:57.051495 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Aug 10 23:06:57.051495 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 23:06:57.051495 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 23:06:57.051495 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 23:06:57.051495 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 23:06:57.051495 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 23:06:57.051495 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 23:06:57.051495 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 23:06:57.051495 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 23:06:57.051495 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 23:06:57.051495 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 23:06:57.051495 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 10 23:06:57.052587 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 10 23:06:57.052587 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 23:06:57.052587 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 23:06:57.052587 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 10 23:06:57.052587 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 10 23:06:57.052587 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 10 23:06:57.052587 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 10 23:06:57.052587 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 1b0a4570-dddf-49f0-bb38-086056d7f386 could not be found Aug 10 23:06:57.052587 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-34f83a97-617a-4e5d-9f02-aa20ab2ca4b3'] Aug 10 23:06:57.052587 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:06:57.052587 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:06:57.052587 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:06:57.052587 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:06:57.052587 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Aug 10 23:06:57.052587 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Aug 10 23:06:57.052587 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Aug 10 23:06:57.052587 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Aug 10 23:06:57.052587 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 1b0a4570-dddf-49f0-bb38-086056d7f386. Aug 10 23:06:57.052587 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:06:57.053710 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:06:57.053710 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:06:57.053710 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:06:57.053710 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:06:57.053710 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:06:57.053710 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:06:57.053710 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:06:57.053710 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 23:06:57.053710 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 23:06:57.053710 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:06:57.053710 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:06:57.053710 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Aug 10 23:06:57.053710 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 10 23:06:57.053710 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 1b0a4570-dddf-49f0-bb38-086056d7f386 Aug 10 23:06:57.053710 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:06:57.053710 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:06:57.053710 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:06:57.053710 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:06:57.053710 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:06:57.053710 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:06:57.053710 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:06:57.055034 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:06:57.055034 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 1b0a4570-dddf-49f0-bb38-086056d7f386 Aug 10 23:06:57.055034 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:06:57.055034 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-6a85e64d-c779-4cb8-96f1-eaa8ee06495a tempest-FloatingIPDetailsNegativeTestJSON-1092496663 tempest-FloatingIPDetailsNegativeTestJSON-1092496663-project] Returning 404 to user: Floating IP not found for ID 1b0a4570-dddf-49f0-bb38-086056d7f386 {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:06:57.055034 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-6a85e64d-c779-4cb8-96f1-eaa8ee06495a tempest-FloatingIPDetailsNegativeTestJSON-1092496663 tempest-FloatingIPDetailsNegativeTestJSON-1092496663-project] 10.222.0.58 "GET /compute/v2.1/os-floating-ips/1b0a4570-dddf-49f0-bb38-086056d7f386" status: 404 len: 111 microversion: 2.1 time: 0.555219 Aug 10 23:06:57.055034 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1223/2487] 10.222.0.58 () {58 vars in 1260 bytes} [Wed Aug 10 23:06:56 2022] GET /compute/v2.1/os-floating-ips/1b0a4570-dddf-49f0-bb38-086056d7f386 => generated 111 bytes in 557 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:06:57.223494 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-85e982a5-a0cd-48d9-8ec7-dbe8f346f50a tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:57.224454 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-85e982a5-a0cd-48d9-8ec7-dbe8f346f50a tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] [instance: 85c138c8-9302-453b-8dc1-8f0002d79f1a] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:06:57.234085 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-85e982a5-a0cd-48d9-8ec7-dbe8f346f50a tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:57.235030 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-85e982a5-a0cd-48d9-8ec7-dbe8f346f50a tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:57.236215 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-85e982a5-a0cd-48d9-8ec7-dbe8f346f50a tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:57.239677 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-85e982a5-a0cd-48d9-8ec7-dbe8f346f50a tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:57.243980 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-85e982a5-a0cd-48d9-8ec7-dbe8f346f50a tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:57.244779 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-85e982a5-a0cd-48d9-8ec7-dbe8f346f50a tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:57.420026 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-17ec2491-36ed-44e2-8c56-8a587cb77b25 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:57.421330 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-17ec2491-36ed-44e2-8c56-8a587cb77b25 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] [instance: 092f973f-79e3-44bf-a2e0-f7d3bfddf42c] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:06:57.448632 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-17ec2491-36ed-44e2-8c56-8a587cb77b25 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:57.449134 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-17ec2491-36ed-44e2-8c56-8a587cb77b25 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:57.449581 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-17ec2491-36ed-44e2-8c56-8a587cb77b25 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:57.450309 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-17ec2491-36ed-44e2-8c56-8a587cb77b25 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:57.450767 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-17ec2491-36ed-44e2-8c56-8a587cb77b25 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:57.451220 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-17ec2491-36ed-44e2-8c56-8a587cb77b25 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:57.878514 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-85e982a5-a0cd-48d9-8ec7-dbe8f346f50a tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8899e278c9453fba0ab05c69b0b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46ac8b84bd649fa88897068dbfa5ce6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:06:57.897749 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-85e982a5-a0cd-48d9-8ec7-dbe8f346f50a tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] 10.222.0.58 "GET /compute/v2.1/servers/85c138c8-9302-453b-8dc1-8f0002d79f1a" status: 200 len: 1317 microversion: 2.1 time: 0.672283 Aug 10 23:06:57.914664 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1265/2488] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:06:57 2022] GET /compute/v2.1/servers/85c138c8-9302-453b-8dc1-8f0002d79f1a => generated 1317 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:06:57.928547 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-6087df4e-1a1f-4a2f-a240-dc2d26173543 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:57.930325 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-6087df4e-1a1f-4a2f-a240-dc2d26173543 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] [instance: 8385348f-0651-486d-9b4a-2c884933edb1] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:06:57.959963 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6087df4e-1a1f-4a2f-a240-dc2d26173543 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:57.961044 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6087df4e-1a1f-4a2f-a240-dc2d26173543 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:57.962764 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6087df4e-1a1f-4a2f-a240-dc2d26173543 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:57.970554 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6087df4e-1a1f-4a2f-a240-dc2d26173543 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:57.971400 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6087df4e-1a1f-4a2f-a240-dc2d26173543 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:57.972051 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6087df4e-1a1f-4a2f-a240-dc2d26173543 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:58.182538 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-6087df4e-1a1f-4a2f-a240-dc2d26173543 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d79bf59dabe4c02aa5e27bf3b0bc1ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9af75fc4bbc4b63ae83b5f900f1aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:06:58.201065 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-6087df4e-1a1f-4a2f-a240-dc2d26173543 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d79bf59dabe4c02aa5e27bf3b0bc1ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9af75fc4bbc4b63ae83b5f900f1aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:06:58.203451 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-17ec2491-36ed-44e2-8c56-8a587cb77b25 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c6e1f505b8409ea38f8a07bad870a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6473e36eada44e6bca8dc568e5ee330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:06:58.206580 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-6087df4e-1a1f-4a2f-a240-dc2d26173543 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d79bf59dabe4c02aa5e27bf3b0bc1ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9af75fc4bbc4b63ae83b5f900f1aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:06:58.213152 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-17ec2491-36ed-44e2-8c56-8a587cb77b25 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] 10.222.0.58 "GET /compute/v2.1/servers/092f973f-79e3-44bf-a2e0-f7d3bfddf42c" status: 200 len: 1353 microversion: 2.1 time: 0.798081 Aug 10 23:06:58.224231 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-6087df4e-1a1f-4a2f-a240-dc2d26173543 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] 10.222.0.58 "GET /compute/v2.1/servers/8385348f-0651-486d-9b4a-2c884933edb1" status: 200 len: 1438 microversion: 2.75 time: 0.307994 Aug 10 23:06:58.230419 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1266/2489] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:06:57 2022] GET /compute/v2.1/servers/8385348f-0651-486d-9b4a-2c884933edb1 => generated 1438 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:06:58.231165 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1224/2490] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:06:57 2022] GET /compute/v2.1/servers/092f973f-79e3-44bf-a2e0-f7d3bfddf42c => generated 1353 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:06:58.269072 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-821396ad-33aa-4829-98b4-a0976d042413 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed"}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:06:58.279132 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-821396ad-33aa-4829-98b4-a0976d042413 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] [instance: 8385348f-0651-486d-9b4a-2c884933edb1] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:06:58.311767 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-821396ad-33aa-4829-98b4-a0976d042413 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:58.314547 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-821396ad-33aa-4829-98b4-a0976d042413 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:58.316968 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-821396ad-33aa-4829-98b4-a0976d042413 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:58.322556 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-821396ad-33aa-4829-98b4-a0976d042413 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:58.323350 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-821396ad-33aa-4829-98b4-a0976d042413 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:58.323960 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-821396ad-33aa-4829-98b4-a0976d042413 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:58.331647 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-0f7ad7e2-ac10-44ad-9372-a61c01f7d9ca req-69ac9d3f-ec49-452f-8403-88bd5a4f1898 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85c138c8-9302-453b-8dc1-8f0002d79f1a", "name": "network-vif-plugged", "status": "completed", "tag": "23b5445e-4fcc-47d3-96d2-0cd88c2ec431"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:06:58.352077 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-0f7ad7e2-ac10-44ad-9372-a61c01f7d9ca req-69ac9d3f-ec49-452f-8403-88bd5a4f1898 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:58.355525 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-0f7ad7e2-ac10-44ad-9372-a61c01f7d9ca req-69ac9d3f-ec49-452f-8403-88bd5a4f1898 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:58.356052 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-0f7ad7e2-ac10-44ad-9372-a61c01f7d9ca req-69ac9d3f-ec49-452f-8403-88bd5a4f1898 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:58.382983 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-0f7ad7e2-ac10-44ad-9372-a61c01f7d9ca req-69ac9d3f-ec49-452f-8403-88bd5a4f1898 service nova] Creating event network-vif-plugged:23b5445e-4fcc-47d3-96d2-0cd88c2ec431 for instance 85c138c8-9302-453b-8dc1-8f0002d79f1a on n-h2-850468-14 Aug 10 23:06:58.396287 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-0f7ad7e2-ac10-44ad-9372-a61c01f7d9ca req-69ac9d3f-ec49-452f-8403-88bd5a4f1898 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069808 Aug 10 23:06:58.400803 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1225/2491] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:06:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 23:06:58.665455 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-821396ad-33aa-4829-98b4-a0976d042413 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Flavor limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:06:58.665961 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-821396ad-33aa-4829-98b4-a0976d042413 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Image limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:06:58.666564 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-821396ad-33aa-4829-98b4-a0976d042413 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Flavor pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:06:58.667013 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-821396ad-33aa-4829-98b4-a0976d042413 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Image pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:06:58.667430 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-821396ad-33aa-4829-98b4-a0976d042413 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:06:58.777856 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=100 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:06:58.901856 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-821396ad-33aa-4829-98b4-a0976d042413 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] [instance: 8385348f-0651-486d-9b4a-2c884933edb1] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:06:58.930503 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-673ac5c0-7fc8-473d-bd32-f8b1033310ca tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:58.931992 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-673ac5c0-7fc8-473d-bd32-f8b1033310ca tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] [instance: 85c138c8-9302-453b-8dc1-8f0002d79f1a] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:06:58.940797 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-821396ad-33aa-4829-98b4-a0976d042413 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:58.945163 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-673ac5c0-7fc8-473d-bd32-f8b1033310ca tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:58.949351 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-821396ad-33aa-4829-98b4-a0976d042413 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:58.952065 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-821396ad-33aa-4829-98b4-a0976d042413 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:58.953151 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-821396ad-33aa-4829-98b4-a0976d042413 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:58.959495 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-821396ad-33aa-4829-98b4-a0976d042413 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:58.962750 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-821396ad-33aa-4829-98b4-a0976d042413 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:58.963410 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-673ac5c0-7fc8-473d-bd32-f8b1033310ca tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:58.967756 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-673ac5c0-7fc8-473d-bd32-f8b1033310ca tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:58.969002 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-673ac5c0-7fc8-473d-bd32-f8b1033310ca tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:58.969676 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-673ac5c0-7fc8-473d-bd32-f8b1033310ca tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:58.970326 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-673ac5c0-7fc8-473d-bd32-f8b1033310ca tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:59.435693 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-673ac5c0-7fc8-473d-bd32-f8b1033310ca tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8899e278c9453fba0ab05c69b0b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46ac8b84bd649fa88897068dbfa5ce6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:06:59.469718 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-821396ad-33aa-4829-98b4-a0976d042413 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d79bf59dabe4c02aa5e27bf3b0bc1ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9af75fc4bbc4b63ae83b5f900f1aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:06:59.483786 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-821396ad-33aa-4829-98b4-a0976d042413 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d79bf59dabe4c02aa5e27bf3b0bc1ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9af75fc4bbc4b63ae83b5f900f1aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:06:59.486923 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-673ac5c0-7fc8-473d-bd32-f8b1033310ca tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] 10.222.0.58 "GET /compute/v2.1/servers/85c138c8-9302-453b-8dc1-8f0002d79f1a" status: 200 len: 1317 microversion: 2.1 time: 0.570199 Aug 10 23:06:59.490320 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1226/2492] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:06:58 2022] GET /compute/v2.1/servers/85c138c8-9302-453b-8dc1-8f0002d79f1a => generated 1317 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:06:59.490909 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-821396ad-33aa-4829-98b4-a0976d042413 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d79bf59dabe4c02aa5e27bf3b0bc1ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9af75fc4bbc4b63ae83b5f900f1aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:06:59.501754 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c01db99d-abdf-4a7c-a528-40fb0c9cf926 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:59.503420 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-c01db99d-abdf-4a7c-a528-40fb0c9cf926 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] [instance: 092f973f-79e3-44bf-a2e0-f7d3bfddf42c] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:06:59.522299 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-821396ad-33aa-4829-98b4-a0976d042413 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] 10.222.0.58 "POST /compute/v2.1/servers/8385348f-0651-486d-9b4a-2c884933edb1/action" status: 202 len: 1495 microversion: 2.75 time: 1.259734 Aug 10 23:06:59.524406 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1267/2493] 10.222.0.58 () {62 vars in 1319 bytes} [Wed Aug 10 23:06:58 2022] POST /compute/v2.1/servers/8385348f-0651-486d-9b4a-2c884933edb1/action => generated 1495 bytes in 1267 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 10 23:06:59.553848 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c01db99d-abdf-4a7c-a528-40fb0c9cf926 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:59.555066 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c01db99d-abdf-4a7c-a528-40fb0c9cf926 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:59.559923 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-90c8cc2e-45d1-4ce3-ae8d-725af5c60a55 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:06:59.560826 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-90c8cc2e-45d1-4ce3-ae8d-725af5c60a55 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] [instance: 8385348f-0651-486d-9b4a-2c884933edb1] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:06:59.570293 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-90c8cc2e-45d1-4ce3-ae8d-725af5c60a55 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:59.571079 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-90c8cc2e-45d1-4ce3-ae8d-725af5c60a55 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:59.572260 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-90c8cc2e-45d1-4ce3-ae8d-725af5c60a55 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:59.573869 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-90c8cc2e-45d1-4ce3-ae8d-725af5c60a55 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:59.574631 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-90c8cc2e-45d1-4ce3-ae8d-725af5c60a55 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:59.575774 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-90c8cc2e-45d1-4ce3-ae8d-725af5c60a55 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:59.582228 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c01db99d-abdf-4a7c-a528-40fb0c9cf926 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:59.585823 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c01db99d-abdf-4a7c-a528-40fb0c9cf926 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:06:59.594427 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c01db99d-abdf-4a7c-a528-40fb0c9cf926 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:06:59.597598 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c01db99d-abdf-4a7c-a528-40fb0c9cf926 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:06:59.860275 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-90c8cc2e-45d1-4ce3-ae8d-725af5c60a55 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d79bf59dabe4c02aa5e27bf3b0bc1ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9af75fc4bbc4b63ae83b5f900f1aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:06:59.871406 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-90c8cc2e-45d1-4ce3-ae8d-725af5c60a55 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d79bf59dabe4c02aa5e27bf3b0bc1ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9af75fc4bbc4b63ae83b5f900f1aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:06:59.876279 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-90c8cc2e-45d1-4ce3-ae8d-725af5c60a55 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d79bf59dabe4c02aa5e27bf3b0bc1ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9af75fc4bbc4b63ae83b5f900f1aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:06:59.892403 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-90c8cc2e-45d1-4ce3-ae8d-725af5c60a55 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] 10.222.0.58 "GET /compute/v2.1/servers/8385348f-0651-486d-9b4a-2c884933edb1" status: 200 len: 1447 microversion: 2.75 time: 0.336833 Aug 10 23:06:59.911053 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1268/2494] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:06:59 2022] GET /compute/v2.1/servers/8385348f-0651-486d-9b4a-2c884933edb1 => generated 1447 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:06:59.932303 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-c01db99d-abdf-4a7c-a528-40fb0c9cf926 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c6e1f505b8409ea38f8a07bad870a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6473e36eada44e6bca8dc568e5ee330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:06:59.944696 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-c01db99d-abdf-4a7c-a528-40fb0c9cf926 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] 10.222.0.58 "GET /compute/v2.1/servers/092f973f-79e3-44bf-a2e0-f7d3bfddf42c" status: 200 len: 1353 microversion: 2.1 time: 0.452118 Aug 10 23:06:59.945782 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1227/2495] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:06:59 2022] GET /compute/v2.1/servers/092f973f-79e3-44bf-a2e0-f7d3bfddf42c => generated 1353 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:07:00.386181 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-3f466a3c-d22c-4784-90ed-952f7a51d418 tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-1847908772", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452", "networks": [{"uuid": "05649dee-ee5d-46bd-9b1f-607ca657ac7a"}]}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:07:00.468914 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.network.neutron [None req-3f466a3c-d22c-4784-90ed-952f7a51d418 tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] validate_networks() for [('05649dee-ee5d-46bd-9b1f-607ca657ac7a', None, None, None, None, None)] {{(pid=122633) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 23:07:00.513853 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-f91dc141-5194-4270-a89d-1ff547f231b1 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:00.514474 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-f91dc141-5194-4270-a89d-1ff547f231b1 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] [instance: 85c138c8-9302-453b-8dc1-8f0002d79f1a] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:00.541711 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f91dc141-5194-4270-a89d-1ff547f231b1 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:00.544304 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f91dc141-5194-4270-a89d-1ff547f231b1 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:00.545388 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f91dc141-5194-4270-a89d-1ff547f231b1 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:00.547253 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f91dc141-5194-4270-a89d-1ff547f231b1 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:00.549528 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f91dc141-5194-4270-a89d-1ff547f231b1 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:00.550268 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f91dc141-5194-4270-a89d-1ff547f231b1 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:00.776327 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-f91dc141-5194-4270-a89d-1ff547f231b1 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8899e278c9453fba0ab05c69b0b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46ac8b84bd649fa88897068dbfa5ce6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:00.784872 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-f91dc141-5194-4270-a89d-1ff547f231b1 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] 10.222.0.58 "GET /compute/v2.1/servers/85c138c8-9302-453b-8dc1-8f0002d79f1a" status: 200 len: 1506 microversion: 2.1 time: 0.276665 Aug 10 23:07:00.786221 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1228/2496] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:07:00 2022] GET /compute/v2.1/servers/85c138c8-9302-453b-8dc1-8f0002d79f1a => generated 1506 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:07:00.835315 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-b340d0cc-975a-4856-9ddd-d16d375182b1 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:00.839773 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-b340d0cc-975a-4856-9ddd-d16d375182b1 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] [instance: 85c138c8-9302-453b-8dc1-8f0002d79f1a] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:00.849190 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b340d0cc-975a-4856-9ddd-d16d375182b1 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:00.849873 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b340d0cc-975a-4856-9ddd-d16d375182b1 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:00.850327 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b340d0cc-975a-4856-9ddd-d16d375182b1 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:00.852920 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b340d0cc-975a-4856-9ddd-d16d375182b1 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:00.854030 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b340d0cc-975a-4856-9ddd-d16d375182b1 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:00.854651 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b340d0cc-975a-4856-9ddd-d16d375182b1 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:01.096127 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-b340d0cc-975a-4856-9ddd-d16d375182b1 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8899e278c9453fba0ab05c69b0b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46ac8b84bd649fa88897068dbfa5ce6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:01.105813 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-b340d0cc-975a-4856-9ddd-d16d375182b1 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] 10.222.0.58 "GET /compute/v2.1/servers/85c138c8-9302-453b-8dc1-8f0002d79f1a" status: 200 len: 1506 microversion: 2.1 time: 0.302161 Aug 10 23:07:01.149308 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1229/2497] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:07:00 2022] GET /compute/v2.1/servers/85c138c8-9302-453b-8dc1-8f0002d79f1a => generated 1506 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:07:01.156117 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-d21293f3-4ccb-48c2-bcbf-64ae801b931a tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:01.157082 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-d21293f3-4ccb-48c2-bcbf-64ae801b931a tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] [instance: 8385348f-0651-486d-9b4a-2c884933edb1] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:01.164486 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d21293f3-4ccb-48c2-bcbf-64ae801b931a tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:01.165796 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d21293f3-4ccb-48c2-bcbf-64ae801b931a tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:01.166555 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d21293f3-4ccb-48c2-bcbf-64ae801b931a tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:01.167535 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d21293f3-4ccb-48c2-bcbf-64ae801b931a tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:01.168244 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d21293f3-4ccb-48c2-bcbf-64ae801b931a tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:01.168896 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d21293f3-4ccb-48c2-bcbf-64ae801b931a tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:01.210903 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:07:01.316054 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-d21293f3-4ccb-48c2-bcbf-64ae801b931a tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d79bf59dabe4c02aa5e27bf3b0bc1ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9af75fc4bbc4b63ae83b5f900f1aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:01.335760 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-d21293f3-4ccb-48c2-bcbf-64ae801b931a tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d79bf59dabe4c02aa5e27bf3b0bc1ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9af75fc4bbc4b63ae83b5f900f1aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:01.338201 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-d21293f3-4ccb-48c2-bcbf-64ae801b931a tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d79bf59dabe4c02aa5e27bf3b0bc1ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9af75fc4bbc4b63ae83b5f900f1aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:01.355505 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-d21293f3-4ccb-48c2-bcbf-64ae801b931a tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] 10.222.0.58 "GET /compute/v2.1/servers/8385348f-0651-486d-9b4a-2c884933edb1" status: 200 len: 1447 microversion: 2.75 time: 0.203665 Aug 10 23:07:01.359926 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1230/2498] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:07:01 2022] GET /compute/v2.1/servers/8385348f-0651-486d-9b4a-2c884933edb1 => generated 1447 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:07:01.385443 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-5df439b6-daf3-4c40-beba-9bc33837b7e5 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:01.386512 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-5df439b6-daf3-4c40-beba-9bc33837b7e5 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] [instance: 092f973f-79e3-44bf-a2e0-f7d3bfddf42c] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:01.401526 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5df439b6-daf3-4c40-beba-9bc33837b7e5 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:01.402301 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5df439b6-daf3-4c40-beba-9bc33837b7e5 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:01.402948 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5df439b6-daf3-4c40-beba-9bc33837b7e5 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:01.403888 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5df439b6-daf3-4c40-beba-9bc33837b7e5 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:01.404501 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5df439b6-daf3-4c40-beba-9bc33837b7e5 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:01.406712 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5df439b6-daf3-4c40-beba-9bc33837b7e5 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:01.778075 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-5df439b6-daf3-4c40-beba-9bc33837b7e5 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c6e1f505b8409ea38f8a07bad870a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6473e36eada44e6bca8dc568e5ee330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:01.799315 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-5df439b6-daf3-4c40-beba-9bc33837b7e5 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] 10.222.0.58 "GET /compute/v2.1/servers/092f973f-79e3-44bf-a2e0-f7d3bfddf42c" status: 200 len: 1353 microversion: 2.1 time: 0.437884 Aug 10 23:07:01.800346 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1231/2499] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:07:01 2022] GET /compute/v2.1/servers/092f973f-79e3-44bf-a2e0-f7d3bfddf42c => generated 1353 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:07:01.807397 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-7977648f-50ec-4210-b742-cf653c933689 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:07:01.818015 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-7977648f-50ec-4210-b742-cf653c933689 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] [instance: 85c138c8-9302-453b-8dc1-8f0002d79f1a] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:01.835075 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7977648f-50ec-4210-b742-cf653c933689 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:01.836007 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7977648f-50ec-4210-b742-cf653c933689 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:01.839689 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7977648f-50ec-4210-b742-cf653c933689 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:01.840876 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7977648f-50ec-4210-b742-cf653c933689 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:01.849418 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7977648f-50ec-4210-b742-cf653c933689 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:01.850835 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7977648f-50ec-4210-b742-cf653c933689 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:01.948902 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-3f466a3c-d22c-4784-90ed-952f7a51d418 tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] Flavor limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:07:01.950114 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-3f466a3c-d22c-4784-90ed-952f7a51d418 tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] Image limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:07:01.950864 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-3f466a3c-d22c-4784-90ed-952f7a51d418 tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] Flavor pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:07:01.951472 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-3f466a3c-d22c-4784-90ed-952f7a51d418 tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] Image pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:07:01.952158 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-3f466a3c-d22c-4784-90ed-952f7a51d418 tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:07:01.962821 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=71 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:07:01.972203 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3f466a3c-d22c-4784-90ed-952f7a51d418 tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:01.972793 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3f466a3c-d22c-4784-90ed-952f7a51d418 tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:01.973313 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3f466a3c-d22c-4784-90ed-952f7a51d418 tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:01.974143 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3f466a3c-d22c-4784-90ed-952f7a51d418 tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:01.979587 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3f466a3c-d22c-4784-90ed-952f7a51d418 tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:01.982423 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3f466a3c-d22c-4784-90ed-952f7a51d418 tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:01.994995 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-7977648f-50ec-4210-b742-cf653c933689 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] 10.222.0.58 "PUT /compute/v2.1/servers/85c138c8-9302-453b-8dc1-8f0002d79f1a" status: 200 len: 1078 microversion: 2.1 time: 0.193029 Aug 10 23:07:02.003703 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1232/2500] 10.222.0.58 () {60 vars in 1256 bytes} [Wed Aug 10 23:07:01 2022] PUT /compute/v2.1/servers/85c138c8-9302-453b-8dc1-8f0002d79f1a => generated 1078 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:07:02.022364 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-171ade61-6b57-483a-9a63-2fd0cc15974f tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:02.023333 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-171ade61-6b57-483a-9a63-2fd0cc15974f tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] [instance: 85c138c8-9302-453b-8dc1-8f0002d79f1a] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:02.029031 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:07:02.035137 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-171ade61-6b57-483a-9a63-2fd0cc15974f tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:02.059290 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-171ade61-6b57-483a-9a63-2fd0cc15974f tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:02.059748 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-171ade61-6b57-483a-9a63-2fd0cc15974f tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:02.060512 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-171ade61-6b57-483a-9a63-2fd0cc15974f tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:02.060971 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-171ade61-6b57-483a-9a63-2fd0cc15974f tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:02.061401 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-171ade61-6b57-483a-9a63-2fd0cc15974f tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:02.070007 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-3f466a3c-d22c-4784-90ed-952f7a51d418 tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] Getting quotas for project 2f4e0ba9683c4e15932b9554d698034e. Resources: {'instances', 'cores', 'ram'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:07:02.088292 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-3f466a3c-d22c-4784-90ed-952f7a51d418 tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] Getting quotas for user eab18f771541437ca1bda46aec45dda5 and project 2f4e0ba9683c4e15932b9554d698034e. Resources: {'instances', 'cores', 'ram'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:07:02.144308 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-3f466a3c-d22c-4784-90ed-952f7a51d418 tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] Going to run 1 instances... {{(pid=122633) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 23:07:02.156926 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-3f466a3c-d22c-4784-90ed-952f7a51d418 tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] [instance: ba82fd6a-d3bf-4fd3-83e0-09103eafca25] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78ad8905-f66f-4733-8be9-2b260f1fabed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122633) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 23:07:02.331440 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-3f466a3c-d22c-4784-90ed-952f7a51d418 tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.320756 Aug 10 23:07:02.340852 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1269/2501] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 23:07:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 2331 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 23:07:02.352337 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-be614ee6-017e-43a0-a1ce-35be6fea33bd tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:02.353049 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-be614ee6-017e-43a0-a1ce-35be6fea33bd tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] [instance: ba82fd6a-d3bf-4fd3-83e0-09103eafca25] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:02.602114 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-171ade61-6b57-483a-9a63-2fd0cc15974f tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8899e278c9453fba0ab05c69b0b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46ac8b84bd649fa88897068dbfa5ce6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:02.613749 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-171ade61-6b57-483a-9a63-2fd0cc15974f tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] 10.222.0.58 "GET /compute/v2.1/servers/85c138c8-9302-453b-8dc1-8f0002d79f1a" status: 200 len: 1504 microversion: 2.1 time: 0.595566 Aug 10 23:07:02.622203 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-be614ee6-017e-43a0-a1ce-35be6fea33bd tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab18f771541437ca1bda46aec45dda5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4e0ba9683c4e15932b9554d698034e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:02.627206 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1233/2502] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:07:02 2022] GET /compute/v2.1/servers/85c138c8-9302-453b-8dc1-8f0002d79f1a => generated 1504 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:07:02.636524 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-be614ee6-017e-43a0-a1ce-35be6fea33bd tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] 10.222.0.58 "GET /compute/v2.1/servers/ba82fd6a-d3bf-4fd3-83e0-09103eafca25" status: 200 len: 1225 microversion: 2.1 time: 0.290030 Aug 10 23:07:02.653483 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-2984e60b-6d2f-468c-b485-d49f22f52c8c tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:02.654481 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-2984e60b-6d2f-468c-b485-d49f22f52c8c tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] [instance: 8385348f-0651-486d-9b4a-2c884933edb1] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:02.670045 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2984e60b-6d2f-468c-b485-d49f22f52c8c tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:02.670490 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1270/2503] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:07:02 2022] GET /compute/v2.1/servers/ba82fd6a-d3bf-4fd3-83e0-09103eafca25 => generated 1225 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:07:02.672995 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2984e60b-6d2f-468c-b485-d49f22f52c8c tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:02.673552 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2984e60b-6d2f-468c-b485-d49f22f52c8c tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:02.677270 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-dbaef0ea-6a3f-412f-a78d-ddae853c213b tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:02.677704 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2984e60b-6d2f-468c-b485-d49f22f52c8c tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:02.678291 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2984e60b-6d2f-468c-b485-d49f22f52c8c tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:02.681036 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-dbaef0ea-6a3f-412f-a78d-ddae853c213b tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] [instance: 45beadf1-a6da-49ab-9098-6b681b5184c9] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:02.682638 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2984e60b-6d2f-468c-b485-d49f22f52c8c tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:02.688068 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dbaef0ea-6a3f-412f-a78d-ddae853c213b tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:02.691420 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dbaef0ea-6a3f-412f-a78d-ddae853c213b tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:02.692086 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dbaef0ea-6a3f-412f-a78d-ddae853c213b tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:02.692998 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dbaef0ea-6a3f-412f-a78d-ddae853c213b tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:02.696047 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dbaef0ea-6a3f-412f-a78d-ddae853c213b tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:02.697378 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dbaef0ea-6a3f-412f-a78d-ddae853c213b tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:02.890727 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.objects.instance [None req-dbaef0ea-6a3f-412f-a78d-ddae853c213b tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lazy-loading 'services' on Instance uuid 45beadf1-a6da-49ab-9098-6b681b5184c9 {{(pid=122633) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:07:03.046742 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-2984e60b-6d2f-468c-b485-d49f22f52c8c tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d79bf59dabe4c02aa5e27bf3b0bc1ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9af75fc4bbc4b63ae83b5f900f1aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:03.061940 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-2984e60b-6d2f-468c-b485-d49f22f52c8c tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d79bf59dabe4c02aa5e27bf3b0bc1ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9af75fc4bbc4b63ae83b5f900f1aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:03.067553 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-2984e60b-6d2f-468c-b485-d49f22f52c8c tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d79bf59dabe4c02aa5e27bf3b0bc1ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9af75fc4bbc4b63ae83b5f900f1aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:03.077101 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=60 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:07:03.085054 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-2984e60b-6d2f-468c-b485-d49f22f52c8c tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] 10.222.0.58 "GET /compute/v2.1/servers/8385348f-0651-486d-9b4a-2c884933edb1" status: 200 len: 1447 microversion: 2.75 time: 0.456665 Aug 10 23:07:03.089726 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1234/2504] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:07:02 2022] GET /compute/v2.1/servers/8385348f-0651-486d-9b4a-2c884933edb1 => generated 1447 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:07:03.108355 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-23e88b02-5cc3-4adc-be53-8a1d47b1cf74 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:03.109240 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-23e88b02-5cc3-4adc-be53-8a1d47b1cf74 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] [instance: 85c138c8-9302-453b-8dc1-8f0002d79f1a] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:03.122374 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-23e88b02-5cc3-4adc-be53-8a1d47b1cf74 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:03.122833 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-dbaef0ea-6a3f-412f-a78d-ddae853c213b tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] 10.222.0.58 "DELETE /compute/v2.1/servers/45beadf1-a6da-49ab-9098-6b681b5184c9/os-volume_attachments/a51b6dbe-7684-40db-afae-70ec3d71d6b3" status: 202 len: 0 microversion: 2.1 time: 0.450776 Aug 10 23:07:03.124951 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-23e88b02-5cc3-4adc-be53-8a1d47b1cf74 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:03.125612 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-23e88b02-5cc3-4adc-be53-8a1d47b1cf74 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:03.127500 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1271/2505] 10.222.0.58 () {58 vars in 1416 bytes} [Wed Aug 10 23:07:02 2022] DELETE /compute/v2.1/servers/45beadf1-a6da-49ab-9098-6b681b5184c9/os-volume_attachments/a51b6dbe-7684-40db-afae-70ec3d71d6b3 => generated 0 bytes in 456 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:07:03.132714 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-23e88b02-5cc3-4adc-be53-8a1d47b1cf74 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:03.133259 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-23e88b02-5cc3-4adc-be53-8a1d47b1cf74 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:03.136654 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-23e88b02-5cc3-4adc-be53-8a1d47b1cf74 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:03.144134 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-616a96c6-a4f8-40ae-8151-0e355952ff99 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:03.145303 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-616a96c6-a4f8-40ae-8151-0e355952ff99 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] [instance: 092f973f-79e3-44bf-a2e0-f7d3bfddf42c] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:03.161571 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-616a96c6-a4f8-40ae-8151-0e355952ff99 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:03.163405 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-616a96c6-a4f8-40ae-8151-0e355952ff99 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:03.164011 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-616a96c6-a4f8-40ae-8151-0e355952ff99 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:03.166409 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-616a96c6-a4f8-40ae-8151-0e355952ff99 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:03.167913 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-616a96c6-a4f8-40ae-8151-0e355952ff99 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:03.168942 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-616a96c6-a4f8-40ae-8151-0e355952ff99 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:03.662217 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-23e88b02-5cc3-4adc-be53-8a1d47b1cf74 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8899e278c9453fba0ab05c69b0b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46ac8b84bd649fa88897068dbfa5ce6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:03.674970 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-23e88b02-5cc3-4adc-be53-8a1d47b1cf74 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] 10.222.0.58 "GET /compute/v2.1/servers/85c138c8-9302-453b-8dc1-8f0002d79f1a" status: 200 len: 1504 microversion: 2.1 time: 0.582727 Aug 10 23:07:03.686331 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1235/2506] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:07:03 2022] GET /compute/v2.1/servers/85c138c8-9302-453b-8dc1-8f0002d79f1a => generated 1504 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:07:03.703967 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-835755db-0919-44aa-9a46-bee3f0570eea tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:03.707139 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-835755db-0919-44aa-9a46-bee3f0570eea tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] [instance: ba82fd6a-d3bf-4fd3-83e0-09103eafca25] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:03.725105 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-835755db-0919-44aa-9a46-bee3f0570eea tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:03.726901 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-835755db-0919-44aa-9a46-bee3f0570eea tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:03.728697 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-835755db-0919-44aa-9a46-bee3f0570eea tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:03.730940 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-835755db-0919-44aa-9a46-bee3f0570eea tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:03.731432 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-835755db-0919-44aa-9a46-bee3f0570eea tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:03.733459 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-835755db-0919-44aa-9a46-bee3f0570eea tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:04.041288 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-835755db-0919-44aa-9a46-bee3f0570eea tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab18f771541437ca1bda46aec45dda5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4e0ba9683c4e15932b9554d698034e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:04.049788 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-835755db-0919-44aa-9a46-bee3f0570eea tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] 10.222.0.58 "GET /compute/v2.1/servers/ba82fd6a-d3bf-4fd3-83e0-09103eafca25" status: 200 len: 1221 microversion: 2.1 time: 0.362000 Aug 10 23:07:04.057500 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1236/2507] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:07:03 2022] GET /compute/v2.1/servers/ba82fd6a-d3bf-4fd3-83e0-09103eafca25 => generated 1221 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:07:04.087976 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-60d26183-39c5-4922-8c49-c0c77af54c2b tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:07:04.093787 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-60d26183-39c5-4922-8c49-c0c77af54c2b tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] [instance: 85c138c8-9302-453b-8dc1-8f0002d79f1a] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:04.131252 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-60d26183-39c5-4922-8c49-c0c77af54c2b tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:04.142916 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-60d26183-39c5-4922-8c49-c0c77af54c2b tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:04.143382 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-60d26183-39c5-4922-8c49-c0c77af54c2b tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:04.144150 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-60d26183-39c5-4922-8c49-c0c77af54c2b tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:04.144613 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-60d26183-39c5-4922-8c49-c0c77af54c2b tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:04.145044 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-60d26183-39c5-4922-8c49-c0c77af54c2b tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:04.149095 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-616a96c6-a4f8-40ae-8151-0e355952ff99 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c6e1f505b8409ea38f8a07bad870a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6473e36eada44e6bca8dc568e5ee330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:04.164181 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-616a96c6-a4f8-40ae-8151-0e355952ff99 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] 10.222.0.58 "GET /compute/v2.1/servers/092f973f-79e3-44bf-a2e0-f7d3bfddf42c" status: 200 len: 1353 microversion: 2.1 time: 1.035160 Aug 10 23:07:04.178808 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1272/2508] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:07:03 2022] GET /compute/v2.1/servers/092f973f-79e3-44bf-a2e0-f7d3bfddf42c => generated 1353 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:07:04.187356 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-a327d56e-5802-4ca9-bef1-403bb61a981a tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:04.189548 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-a327d56e-5802-4ca9-bef1-403bb61a981a tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] [instance: 8385348f-0651-486d-9b4a-2c884933edb1] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:04.201831 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a327d56e-5802-4ca9-bef1-403bb61a981a tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:04.205210 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a327d56e-5802-4ca9-bef1-403bb61a981a tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:04.206275 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a327d56e-5802-4ca9-bef1-403bb61a981a tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:04.208725 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a327d56e-5802-4ca9-bef1-403bb61a981a tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:04.211094 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a327d56e-5802-4ca9-bef1-403bb61a981a tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:04.213348 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a327d56e-5802-4ca9-bef1-403bb61a981a tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:04.307584 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-60d26183-39c5-4922-8c49-c0c77af54c2b tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Flavor limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:07:04.308002 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-60d26183-39c5-4922-8c49-c0c77af54c2b tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Image limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:07:04.313041 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-60d26183-39c5-4922-8c49-c0c77af54c2b tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Flavor pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:07:04.313824 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-60d26183-39c5-4922-8c49-c0c77af54c2b tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Image pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:07:04.314601 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-60d26183-39c5-4922-8c49-c0c77af54c2b tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:07:04.333541 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-a327d56e-5802-4ca9-bef1-403bb61a981a tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d79bf59dabe4c02aa5e27bf3b0bc1ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9af75fc4bbc4b63ae83b5f900f1aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:04.348382 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-a327d56e-5802-4ca9-bef1-403bb61a981a tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d79bf59dabe4c02aa5e27bf3b0bc1ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9af75fc4bbc4b63ae83b5f900f1aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:04.352340 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-a327d56e-5802-4ca9-bef1-403bb61a981a tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d79bf59dabe4c02aa5e27bf3b0bc1ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9af75fc4bbc4b63ae83b5f900f1aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:04.381319 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-a327d56e-5802-4ca9-bef1-403bb61a981a tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] 10.222.0.58 "GET /compute/v2.1/servers/8385348f-0651-486d-9b4a-2c884933edb1" status: 200 len: 1447 microversion: 2.75 time: 0.208906 Aug 10 23:07:04.407373 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1273/2509] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:07:04 2022] GET /compute/v2.1/servers/8385348f-0651-486d-9b4a-2c884933edb1 => generated 1447 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:07:04.499172 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-60d26183-39c5-4922-8c49-c0c77af54c2b tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] [instance: 85c138c8-9302-453b-8dc1-8f0002d79f1a] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:04.531999 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-60d26183-39c5-4922-8c49-c0c77af54c2b tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:04.532619 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-60d26183-39c5-4922-8c49-c0c77af54c2b tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:04.533309 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-60d26183-39c5-4922-8c49-c0c77af54c2b tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:04.534216 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-60d26183-39c5-4922-8c49-c0c77af54c2b tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:04.537064 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-60d26183-39c5-4922-8c49-c0c77af54c2b tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:04.537778 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-60d26183-39c5-4922-8c49-c0c77af54c2b tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:04.651775 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-60d26183-39c5-4922-8c49-c0c77af54c2b tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] 10.222.0.58 "POST /compute/v2.1/servers/85c138c8-9302-453b-8dc1-8f0002d79f1a/action" status: 202 len: 1110 microversion: 2.1 time: 0.590763 Aug 10 23:07:04.654673 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1237/2510] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:07:04 2022] POST /compute/v2.1/servers/85c138c8-9302-453b-8dc1-8f0002d79f1a/action => generated 1110 bytes in 596 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 10 23:07:04.671486 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-9e63b857-9e32-4792-b99c-ab580ba90d1e tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:04.674296 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-9e63b857-9e32-4792-b99c-ab580ba90d1e tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] [instance: 85c138c8-9302-453b-8dc1-8f0002d79f1a] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:04.685507 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9e63b857-9e32-4792-b99c-ab580ba90d1e tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:04.692756 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9e63b857-9e32-4792-b99c-ab580ba90d1e tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:04.695313 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9e63b857-9e32-4792-b99c-ab580ba90d1e tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:04.696291 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9e63b857-9e32-4792-b99c-ab580ba90d1e tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:04.699640 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9e63b857-9e32-4792-b99c-ab580ba90d1e tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:04.700322 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9e63b857-9e32-4792-b99c-ab580ba90d1e tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:05.085107 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-7aeeba31-a792-4957-9414-ce0d18848540 tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:05.087838 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-7aeeba31-a792-4957-9414-ce0d18848540 tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] [instance: ba82fd6a-d3bf-4fd3-83e0-09103eafca25] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:05.119213 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7aeeba31-a792-4957-9414-ce0d18848540 tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:05.123535 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7aeeba31-a792-4957-9414-ce0d18848540 tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:05.124295 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7aeeba31-a792-4957-9414-ce0d18848540 tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:05.125793 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7aeeba31-a792-4957-9414-ce0d18848540 tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:05.130899 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7aeeba31-a792-4957-9414-ce0d18848540 tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:05.131959 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7aeeba31-a792-4957-9414-ce0d18848540 tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:05.350140 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-7aeeba31-a792-4957-9414-ce0d18848540 tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab18f771541437ca1bda46aec45dda5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4e0ba9683c4e15932b9554d698034e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:05.352459 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-9e63b857-9e32-4792-b99c-ab580ba90d1e tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8899e278c9453fba0ab05c69b0b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46ac8b84bd649fa88897068dbfa5ce6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:05.360900 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-7aeeba31-a792-4957-9414-ce0d18848540 tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] 10.222.0.58 "GET /compute/v2.1/servers/ba82fd6a-d3bf-4fd3-83e0-09103eafca25" status: 200 len: 1283 microversion: 2.1 time: 0.286475 Aug 10 23:07:05.365742 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1238/2511] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:07:05 2022] GET /compute/v2.1/servers/ba82fd6a-d3bf-4fd3-83e0-09103eafca25 => generated 1283 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:07:05.377492 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-9e63b857-9e32-4792-b99c-ab580ba90d1e tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] 10.222.0.58 "GET /compute/v2.1/servers/85c138c8-9302-453b-8dc1-8f0002d79f1a" status: 200 len: 1515 microversion: 2.1 time: 0.709695 Aug 10 23:07:05.380860 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-1418b766-ac7d-4776-b006-e30ddb92f111 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:05.381749 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-1418b766-ac7d-4776-b006-e30ddb92f111 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] [instance: 092f973f-79e3-44bf-a2e0-f7d3bfddf42c] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:05.391945 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1274/2512] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:07:04 2022] GET /compute/v2.1/servers/85c138c8-9302-453b-8dc1-8f0002d79f1a => generated 1515 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:07:05.407178 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1418b766-ac7d-4776-b006-e30ddb92f111 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:05.408235 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1418b766-ac7d-4776-b006-e30ddb92f111 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:05.409108 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1418b766-ac7d-4776-b006-e30ddb92f111 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:05.410100 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1418b766-ac7d-4776-b006-e30ddb92f111 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:05.410826 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1418b766-ac7d-4776-b006-e30ddb92f111 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:05.411353 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c51a99be-c15d-4735-ae4f-c4ac131586aa tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:05.411703 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1418b766-ac7d-4776-b006-e30ddb92f111 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:05.412079 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-c51a99be-c15d-4735-ae4f-c4ac131586aa tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] [instance: 8385348f-0651-486d-9b4a-2c884933edb1] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:05.423613 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c51a99be-c15d-4735-ae4f-c4ac131586aa tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:05.424126 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c51a99be-c15d-4735-ae4f-c4ac131586aa tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:05.424572 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c51a99be-c15d-4735-ae4f-c4ac131586aa tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:05.425313 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c51a99be-c15d-4735-ae4f-c4ac131586aa tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:05.425737 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c51a99be-c15d-4735-ae4f-c4ac131586aa tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:05.426163 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c51a99be-c15d-4735-ae4f-c4ac131586aa tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:05.648666 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-c51a99be-c15d-4735-ae4f-c4ac131586aa tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d79bf59dabe4c02aa5e27bf3b0bc1ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9af75fc4bbc4b63ae83b5f900f1aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:05.665694 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-c51a99be-c15d-4735-ae4f-c4ac131586aa tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d79bf59dabe4c02aa5e27bf3b0bc1ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9af75fc4bbc4b63ae83b5f900f1aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:05.670078 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-c51a99be-c15d-4735-ae4f-c4ac131586aa tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d79bf59dabe4c02aa5e27bf3b0bc1ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9af75fc4bbc4b63ae83b5f900f1aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:05.691797 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-c51a99be-c15d-4735-ae4f-c4ac131586aa tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] 10.222.0.58 "GET /compute/v2.1/servers/8385348f-0651-486d-9b4a-2c884933edb1" status: 200 len: 1447 microversion: 2.75 time: 0.284230 Aug 10 23:07:05.714909 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1275/2513] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:07:05 2022] GET /compute/v2.1/servers/8385348f-0651-486d-9b4a-2c884933edb1 => generated 1447 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 23:07:05.975494 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-1418b766-ac7d-4776-b006-e30ddb92f111 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c6e1f505b8409ea38f8a07bad870a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6473e36eada44e6bca8dc568e5ee330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:05.997516 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-1418b766-ac7d-4776-b006-e30ddb92f111 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] 10.222.0.58 "GET /compute/v2.1/servers/092f973f-79e3-44bf-a2e0-f7d3bfddf42c" status: 200 len: 1353 microversion: 2.1 time: 0.630327 Aug 10 23:07:06.011672 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1239/2514] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:07:05 2022] GET /compute/v2.1/servers/092f973f-79e3-44bf-a2e0-f7d3bfddf42c => generated 1353 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:07:06.390772 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-bb6ea3b9-720e-42d8-92c1-08bde66e13dd tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:06.392246 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-bb6ea3b9-720e-42d8-92c1-08bde66e13dd tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] [instance: ba82fd6a-d3bf-4fd3-83e0-09103eafca25] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:06.405143 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c3bec2ec-59a3-4da7-bb35-4056a761818c tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:06.406001 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-c3bec2ec-59a3-4da7-bb35-4056a761818c tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] [instance: 85c138c8-9302-453b-8dc1-8f0002d79f1a] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:06.407421 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bb6ea3b9-720e-42d8-92c1-08bde66e13dd tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:06.409639 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bb6ea3b9-720e-42d8-92c1-08bde66e13dd tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:06.412521 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bb6ea3b9-720e-42d8-92c1-08bde66e13dd tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:06.416451 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bb6ea3b9-720e-42d8-92c1-08bde66e13dd tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:06.417146 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bb6ea3b9-720e-42d8-92c1-08bde66e13dd tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:06.417794 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bb6ea3b9-720e-42d8-92c1-08bde66e13dd tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:06.426437 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c3bec2ec-59a3-4da7-bb35-4056a761818c tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:06.426964 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c3bec2ec-59a3-4da7-bb35-4056a761818c tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:06.427406 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c3bec2ec-59a3-4da7-bb35-4056a761818c tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:06.433460 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c3bec2ec-59a3-4da7-bb35-4056a761818c tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:06.437785 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c3bec2ec-59a3-4da7-bb35-4056a761818c tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:06.438258 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c3bec2ec-59a3-4da7-bb35-4056a761818c tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:07.034281 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-c3bec2ec-59a3-4da7-bb35-4056a761818c tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8899e278c9453fba0ab05c69b0b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46ac8b84bd649fa88897068dbfa5ce6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:07.053948 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-c3bec2ec-59a3-4da7-bb35-4056a761818c tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] 10.222.0.58 "GET /compute/v2.1/servers/85c138c8-9302-453b-8dc1-8f0002d79f1a" status: 200 len: 1515 microversion: 2.1 time: 0.651421 Aug 10 23:07:07.054589 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1240/2515] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:07:06 2022] GET /compute/v2.1/servers/85c138c8-9302-453b-8dc1-8f0002d79f1a => generated 1515 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:07:07.098393 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-9151226a-2774-4cda-81bc-4888a9f4504f tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:07.104704 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-9151226a-2774-4cda-81bc-4888a9f4504f tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] [instance: 8385348f-0651-486d-9b4a-2c884933edb1] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:07.125609 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9151226a-2774-4cda-81bc-4888a9f4504f tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:07.126108 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9151226a-2774-4cda-81bc-4888a9f4504f tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:07.126545 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9151226a-2774-4cda-81bc-4888a9f4504f tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:07.131490 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9151226a-2774-4cda-81bc-4888a9f4504f tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:07.132231 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9151226a-2774-4cda-81bc-4888a9f4504f tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:07.132654 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9151226a-2774-4cda-81bc-4888a9f4504f tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:07.167523 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-bb6ea3b9-720e-42d8-92c1-08bde66e13dd tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab18f771541437ca1bda46aec45dda5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4e0ba9683c4e15932b9554d698034e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:07.189042 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-bb6ea3b9-720e-42d8-92c1-08bde66e13dd tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] 10.222.0.58 "GET /compute/v2.1/servers/ba82fd6a-d3bf-4fd3-83e0-09103eafca25" status: 200 len: 1325 microversion: 2.1 time: 0.802438 Aug 10 23:07:07.199225 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1276/2516] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:07:06 2022] GET /compute/v2.1/servers/ba82fd6a-d3bf-4fd3-83e0-09103eafca25 => generated 1325 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:07:07.206368 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-3321c6a6-250d-4a37-8f23-1eb842e174d1 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:07.212336 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-3321c6a6-250d-4a37-8f23-1eb842e174d1 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] [instance: 092f973f-79e3-44bf-a2e0-f7d3bfddf42c] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:07.234264 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3321c6a6-250d-4a37-8f23-1eb842e174d1 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:07.234767 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3321c6a6-250d-4a37-8f23-1eb842e174d1 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:07.239341 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3321c6a6-250d-4a37-8f23-1eb842e174d1 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:07.240307 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3321c6a6-250d-4a37-8f23-1eb842e174d1 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:07.244309 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3321c6a6-250d-4a37-8f23-1eb842e174d1 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:07.250224 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3321c6a6-250d-4a37-8f23-1eb842e174d1 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:07.380624 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-9151226a-2774-4cda-81bc-4888a9f4504f tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d79bf59dabe4c02aa5e27bf3b0bc1ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9af75fc4bbc4b63ae83b5f900f1aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:07.392148 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-9151226a-2774-4cda-81bc-4888a9f4504f tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d79bf59dabe4c02aa5e27bf3b0bc1ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9af75fc4bbc4b63ae83b5f900f1aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:07.404642 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-9151226a-2774-4cda-81bc-4888a9f4504f tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d79bf59dabe4c02aa5e27bf3b0bc1ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9af75fc4bbc4b63ae83b5f900f1aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:07.461714 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-9151226a-2774-4cda-81bc-4888a9f4504f tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] 10.222.0.58 "GET /compute/v2.1/servers/8385348f-0651-486d-9b4a-2c884933edb1" status: 200 len: 1447 microversion: 2.75 time: 0.402305 Aug 10 23:07:07.479155 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1241/2517] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:07:07 2022] GET /compute/v2.1/servers/8385348f-0651-486d-9b4a-2c884933edb1 => generated 1447 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:07:07.479155 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-c5d650d2-8fb1-4460-8994-ec81da169458 req-3b770982-6d70-4310-9406-d25202008cdd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "092f973f-79e3-44bf-a2e0-f7d3bfddf42c", "name": "network-vif-plugged", "status": "completed", "tag": "a66e8adc-f741-49ae-b190-468d5764b853"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:07:07.501236 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-c5d650d2-8fb1-4460-8994-ec81da169458 req-3b770982-6d70-4310-9406-d25202008cdd service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:07.515070 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-c5d650d2-8fb1-4460-8994-ec81da169458 req-3b770982-6d70-4310-9406-d25202008cdd service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:07.522101 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-c5d650d2-8fb1-4460-8994-ec81da169458 req-3b770982-6d70-4310-9406-d25202008cdd service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:07.591756 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-c5d650d2-8fb1-4460-8994-ec81da169458 req-3b770982-6d70-4310-9406-d25202008cdd service nova] Creating event network-vif-plugged:a66e8adc-f741-49ae-b190-468d5764b853 for instance 092f973f-79e3-44bf-a2e0-f7d3bfddf42c on n-h1-850468-14 Aug 10 23:07:07.619267 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-c5d650d2-8fb1-4460-8994-ec81da169458 req-3b770982-6d70-4310-9406-d25202008cdd service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.143070 Aug 10 23:07:07.620779 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1242/2518] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:07:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:07:08.077305 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-10ba91a5-fe08-40e7-9653-270209b81682 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:08.078592 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-10ba91a5-fe08-40e7-9653-270209b81682 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] [instance: 85c138c8-9302-453b-8dc1-8f0002d79f1a] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:08.090370 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-10ba91a5-fe08-40e7-9653-270209b81682 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:08.093129 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-10ba91a5-fe08-40e7-9653-270209b81682 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:08.094398 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-10ba91a5-fe08-40e7-9653-270209b81682 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:08.096212 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-10ba91a5-fe08-40e7-9653-270209b81682 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:08.097885 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-10ba91a5-fe08-40e7-9653-270209b81682 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:08.101291 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-10ba91a5-fe08-40e7-9653-270209b81682 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:08.133649 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-3321c6a6-250d-4a37-8f23-1eb842e174d1 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c6e1f505b8409ea38f8a07bad870a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6473e36eada44e6bca8dc568e5ee330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:08.149959 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-3321c6a6-250d-4a37-8f23-1eb842e174d1 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] 10.222.0.58 "GET /compute/v2.1/servers/092f973f-79e3-44bf-a2e0-f7d3bfddf42c" status: 200 len: 1353 microversion: 2.1 time: 0.946205 Aug 10 23:07:08.169006 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1277/2519] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:07:07 2022] GET /compute/v2.1/servers/092f973f-79e3-44bf-a2e0-f7d3bfddf42c => generated 1353 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:07:08.214398 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-96054a99-0f5b-4074-9ab1-ff4ced327f28 tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:08.215701 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-96054a99-0f5b-4074-9ab1-ff4ced327f28 tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] [instance: ba82fd6a-d3bf-4fd3-83e0-09103eafca25] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:08.233235 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-96054a99-0f5b-4074-9ab1-ff4ced327f28 tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:08.240692 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-96054a99-0f5b-4074-9ab1-ff4ced327f28 tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:08.242456 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-96054a99-0f5b-4074-9ab1-ff4ced327f28 tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:08.247476 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-96054a99-0f5b-4074-9ab1-ff4ced327f28 tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:08.249172 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-96054a99-0f5b-4074-9ab1-ff4ced327f28 tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:08.250136 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-96054a99-0f5b-4074-9ab1-ff4ced327f28 tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:08.930614 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-96054a99-0f5b-4074-9ab1-ff4ced327f28 tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab18f771541437ca1bda46aec45dda5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4e0ba9683c4e15932b9554d698034e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:08.938989 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-96054a99-0f5b-4074-9ab1-ff4ced327f28 tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] 10.222.0.58 "GET /compute/v2.1/servers/ba82fd6a-d3bf-4fd3-83e0-09103eafca25" status: 200 len: 1325 microversion: 2.1 time: 0.731460 Aug 10 23:07:08.947495 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-10ba91a5-fe08-40e7-9653-270209b81682 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8899e278c9453fba0ab05c69b0b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46ac8b84bd649fa88897068dbfa5ce6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:08.950968 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1278/2520] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:07:08 2022] GET /compute/v2.1/servers/ba82fd6a-d3bf-4fd3-83e0-09103eafca25 => generated 1325 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:07:08.963651 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-10ba91a5-fe08-40e7-9653-270209b81682 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] 10.222.0.58 "GET /compute/v2.1/servers/85c138c8-9302-453b-8dc1-8f0002d79f1a" status: 200 len: 1515 microversion: 2.1 time: 0.889492 Aug 10 23:07:08.969349 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-11446466-f44c-4097-9e22-2179c8c65cf6 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:08.970110 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-11446466-f44c-4097-9e22-2179c8c65cf6 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] [instance: 8385348f-0651-486d-9b4a-2c884933edb1] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:08.972416 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1243/2521] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:07:08 2022] GET /compute/v2.1/servers/85c138c8-9302-453b-8dc1-8f0002d79f1a => generated 1515 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:07:08.988850 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-11446466-f44c-4097-9e22-2179c8c65cf6 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:08.991772 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-11446466-f44c-4097-9e22-2179c8c65cf6 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:08.995609 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-11446466-f44c-4097-9e22-2179c8c65cf6 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:08.998561 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-11446466-f44c-4097-9e22-2179c8c65cf6 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:08.999805 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-11446466-f44c-4097-9e22-2179c8c65cf6 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:09.001076 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-11446466-f44c-4097-9e22-2179c8c65cf6 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:09.179816 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-11446466-f44c-4097-9e22-2179c8c65cf6 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d79bf59dabe4c02aa5e27bf3b0bc1ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9af75fc4bbc4b63ae83b5f900f1aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:09.180526 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-0f1ef462-e3a5-4df0-bd4b-71838dc1ff6c tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:09.199247 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-0f1ef462-e3a5-4df0-bd4b-71838dc1ff6c tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] [instance: 092f973f-79e3-44bf-a2e0-f7d3bfddf42c] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:09.204531 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-11446466-f44c-4097-9e22-2179c8c65cf6 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d79bf59dabe4c02aa5e27bf3b0bc1ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9af75fc4bbc4b63ae83b5f900f1aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:09.209213 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-11446466-f44c-4097-9e22-2179c8c65cf6 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d79bf59dabe4c02aa5e27bf3b0bc1ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9af75fc4bbc4b63ae83b5f900f1aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:09.224068 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-11446466-f44c-4097-9e22-2179c8c65cf6 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] 10.222.0.58 "GET /compute/v2.1/servers/8385348f-0651-486d-9b4a-2c884933edb1" status: 200 len: 1447 microversion: 2.75 time: 0.269433 Aug 10 23:07:09.226369 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1279/2522] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:07:08 2022] GET /compute/v2.1/servers/8385348f-0651-486d-9b4a-2c884933edb1 => generated 1447 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:07:09.232751 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0f1ef462-e3a5-4df0-bd4b-71838dc1ff6c tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:09.233273 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0f1ef462-e3a5-4df0-bd4b-71838dc1ff6c tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:09.233746 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0f1ef462-e3a5-4df0-bd4b-71838dc1ff6c tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:09.234560 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0f1ef462-e3a5-4df0-bd4b-71838dc1ff6c tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:09.235071 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0f1ef462-e3a5-4df0-bd4b-71838dc1ff6c tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:09.235547 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0f1ef462-e3a5-4df0-bd4b-71838dc1ff6c tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:09.687082 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-7795f10c-4f8e-4a66-b02c-bba87b1cc37b req-0474576d-d767-4d73-986d-0eff1344a41f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "092f973f-79e3-44bf-a2e0-f7d3bfddf42c", "name": "network-vif-plugged", "status": "completed", "tag": "f77ec6f6-c9b1-47bb-ab17-7f7a3f702dc8"}, {"server_uuid": "092f973f-79e3-44bf-a2e0-f7d3bfddf42c", "name": "network-vif-plugged", "status": "completed", "tag": "ceec95b0-8259-4a51-84f0-06da3be72958"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:07:09.727930 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-7795f10c-4f8e-4a66-b02c-bba87b1cc37b req-0474576d-d767-4d73-986d-0eff1344a41f service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:09.728753 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-7795f10c-4f8e-4a66-b02c-bba87b1cc37b req-0474576d-d767-4d73-986d-0eff1344a41f service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:09.729522 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-7795f10c-4f8e-4a66-b02c-bba87b1cc37b req-0474576d-d767-4d73-986d-0eff1344a41f service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:09.782654 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-7795f10c-4f8e-4a66-b02c-bba87b1cc37b req-0474576d-d767-4d73-986d-0eff1344a41f service nova] Creating event network-vif-plugged:f77ec6f6-c9b1-47bb-ab17-7f7a3f702dc8 for instance 092f973f-79e3-44bf-a2e0-f7d3bfddf42c on n-h1-850468-14 Aug 10 23:07:09.783521 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-7795f10c-4f8e-4a66-b02c-bba87b1cc37b req-0474576d-d767-4d73-986d-0eff1344a41f service nova] Creating event network-vif-plugged:ceec95b0-8259-4a51-84f0-06da3be72958 for instance 092f973f-79e3-44bf-a2e0-f7d3bfddf42c on n-h1-850468-14 Aug 10 23:07:09.800358 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-7795f10c-4f8e-4a66-b02c-bba87b1cc37b req-0474576d-d767-4d73-986d-0eff1344a41f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.116737 Aug 10 23:07:09.805040 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1280/2523] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:07:09 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:07:09.809654 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-0f1ef462-e3a5-4df0-bd4b-71838dc1ff6c tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c6e1f505b8409ea38f8a07bad870a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6473e36eada44e6bca8dc568e5ee330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:09.812103 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:07:09.830250 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-0f1ef462-e3a5-4df0-bd4b-71838dc1ff6c tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] 10.222.0.58 "GET /compute/v2.1/servers/092f973f-79e3-44bf-a2e0-f7d3bfddf42c" status: 200 len: 1353 microversion: 2.1 time: 0.651907 Aug 10 23:07:09.835121 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1244/2524] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:07:09 2022] GET /compute/v2.1/servers/092f973f-79e3-44bf-a2e0-f7d3bfddf42c => generated 1353 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:07:09.964922 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-a9d23f6d-0555-474e-a0df-72ab041651f8 tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:09.965889 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-a9d23f6d-0555-474e-a0df-72ab041651f8 tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] [instance: ba82fd6a-d3bf-4fd3-83e0-09103eafca25] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:09.987933 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-f6cf7800-21aa-46c4-a2dc-63d112c8a63c tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:09.989098 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-f6cf7800-21aa-46c4-a2dc-63d112c8a63c tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] [instance: 85c138c8-9302-453b-8dc1-8f0002d79f1a] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:10.001800 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f6cf7800-21aa-46c4-a2dc-63d112c8a63c tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:10.002364 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f6cf7800-21aa-46c4-a2dc-63d112c8a63c tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:10.003225 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f6cf7800-21aa-46c4-a2dc-63d112c8a63c tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:10.004097 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f6cf7800-21aa-46c4-a2dc-63d112c8a63c tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:10.004567 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f6cf7800-21aa-46c4-a2dc-63d112c8a63c tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:10.005003 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f6cf7800-21aa-46c4-a2dc-63d112c8a63c tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:10.034092 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a9d23f6d-0555-474e-a0df-72ab041651f8 tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:10.034599 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a9d23f6d-0555-474e-a0df-72ab041651f8 tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:10.035074 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a9d23f6d-0555-474e-a0df-72ab041651f8 tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:10.043394 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a9d23f6d-0555-474e-a0df-72ab041651f8 tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:10.043898 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a9d23f6d-0555-474e-a0df-72ab041651f8 tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:10.044347 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a9d23f6d-0555-474e-a0df-72ab041651f8 tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:10.518858 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-f6cf7800-21aa-46c4-a2dc-63d112c8a63c tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8899e278c9453fba0ab05c69b0b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46ac8b84bd649fa88897068dbfa5ce6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:10.533402 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-f6cf7800-21aa-46c4-a2dc-63d112c8a63c tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] 10.222.0.58 "GET /compute/v2.1/servers/85c138c8-9302-453b-8dc1-8f0002d79f1a" status: 200 len: 1515 microversion: 2.1 time: 0.549773 Aug 10 23:07:10.547593 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-a9d23f6d-0555-474e-a0df-72ab041651f8 tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab18f771541437ca1bda46aec45dda5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4e0ba9683c4e15932b9554d698034e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:10.549939 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1245/2525] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:07:09 2022] GET /compute/v2.1/servers/85c138c8-9302-453b-8dc1-8f0002d79f1a => generated 1515 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:07:10.564676 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-a9d23f6d-0555-474e-a0df-72ab041651f8 tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] 10.222.0.58 "GET /compute/v2.1/servers/ba82fd6a-d3bf-4fd3-83e0-09103eafca25" status: 200 len: 1325 microversion: 2.1 time: 0.605708 Aug 10 23:07:10.565558 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1281/2526] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:07:09 2022] GET /compute/v2.1/servers/ba82fd6a-d3bf-4fd3-83e0-09103eafca25 => generated 1325 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:07:10.565781 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-4a514a6d-8fcd-47bd-a3d4-535afa43fb1e tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:10.566705 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-4a514a6d-8fcd-47bd-a3d4-535afa43fb1e tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] [instance: 8385348f-0651-486d-9b4a-2c884933edb1] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:10.582152 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4a514a6d-8fcd-47bd-a3d4-535afa43fb1e tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:10.583120 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4a514a6d-8fcd-47bd-a3d4-535afa43fb1e tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:10.584350 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-f3379931-f127-4c4e-95bd-6f11abc50ae0 req-f301095c-915e-4b09-b537-5d87f2c6a1f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba82fd6a-d3bf-4fd3-83e0-09103eafca25", "tag": "61f2915c-3e11-4b73-bce4-1886d764dd44"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:07:10.608077 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4a514a6d-8fcd-47bd-a3d4-535afa43fb1e tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:10.609065 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4a514a6d-8fcd-47bd-a3d4-535afa43fb1e tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:10.609738 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4a514a6d-8fcd-47bd-a3d4-535afa43fb1e tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:10.612880 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4a514a6d-8fcd-47bd-a3d4-535afa43fb1e tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:10.616299 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-f3379931-f127-4c4e-95bd-6f11abc50ae0 req-f301095c-915e-4b09-b537-5d87f2c6a1f5 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:10.617667 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-f3379931-f127-4c4e-95bd-6f11abc50ae0 req-f301095c-915e-4b09-b537-5d87f2c6a1f5 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:10.620412 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-f3379931-f127-4c4e-95bd-6f11abc50ae0 req-f301095c-915e-4b09-b537-5d87f2c6a1f5 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:10.657857 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-f3379931-f127-4c4e-95bd-6f11abc50ae0 req-f301095c-915e-4b09-b537-5d87f2c6a1f5 service nova] Creating event network-changed:61f2915c-3e11-4b73-bce4-1886d764dd44 for instance ba82fd6a-d3bf-4fd3-83e0-09103eafca25 on n-h2-850468-14 Aug 10 23:07:10.672203 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-f3379931-f127-4c4e-95bd-6f11abc50ae0 req-f301095c-915e-4b09-b537-5d87f2c6a1f5 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104084 Aug 10 23:07:10.676213 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1282/2527] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:07:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:07:10.851365 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-4a514a6d-8fcd-47bd-a3d4-535afa43fb1e tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d79bf59dabe4c02aa5e27bf3b0bc1ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9af75fc4bbc4b63ae83b5f900f1aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:10.861666 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-933961de-0ebb-46a2-9b79-98a2186a1eac tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:10.864180 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-933961de-0ebb-46a2-9b79-98a2186a1eac tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] [instance: 092f973f-79e3-44bf-a2e0-f7d3bfddf42c] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:10.884960 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-4a514a6d-8fcd-47bd-a3d4-535afa43fb1e tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d79bf59dabe4c02aa5e27bf3b0bc1ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9af75fc4bbc4b63ae83b5f900f1aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:10.887598 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-933961de-0ebb-46a2-9b79-98a2186a1eac tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:10.889521 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-4a514a6d-8fcd-47bd-a3d4-535afa43fb1e tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d79bf59dabe4c02aa5e27bf3b0bc1ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9af75fc4bbc4b63ae83b5f900f1aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:10.890661 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-933961de-0ebb-46a2-9b79-98a2186a1eac tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:10.892575 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-933961de-0ebb-46a2-9b79-98a2186a1eac tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:10.895025 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-933961de-0ebb-46a2-9b79-98a2186a1eac tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:10.895691 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-933961de-0ebb-46a2-9b79-98a2186a1eac tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:10.897160 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-933961de-0ebb-46a2-9b79-98a2186a1eac tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:10.904484 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-4a514a6d-8fcd-47bd-a3d4-535afa43fb1e tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] 10.222.0.58 "GET /compute/v2.1/servers/8385348f-0651-486d-9b4a-2c884933edb1" status: 200 len: 1447 microversion: 2.75 time: 0.349470 Aug 10 23:07:10.919871 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1246/2528] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:07:10 2022] GET /compute/v2.1/servers/8385348f-0651-486d-9b4a-2c884933edb1 => generated 1447 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:07:11.310720 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-933961de-0ebb-46a2-9b79-98a2186a1eac tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c6e1f505b8409ea38f8a07bad870a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6473e36eada44e6bca8dc568e5ee330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:11.338310 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-933961de-0ebb-46a2-9b79-98a2186a1eac tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] 10.222.0.58 "GET /compute/v2.1/servers/092f973f-79e3-44bf-a2e0-f7d3bfddf42c" status: 200 len: 1353 microversion: 2.1 time: 0.479912 Aug 10 23:07:11.341676 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1283/2529] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:07:10 2022] GET /compute/v2.1/servers/092f973f-79e3-44bf-a2e0-f7d3bfddf42c => generated 1353 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:07:11.561312 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-bf71f78b-4f1b-42c0-b150-ac007e9a7d45 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:11.562975 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-bf71f78b-4f1b-42c0-b150-ac007e9a7d45 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] [instance: 85c138c8-9302-453b-8dc1-8f0002d79f1a] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:11.577128 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bf71f78b-4f1b-42c0-b150-ac007e9a7d45 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:11.582163 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bf71f78b-4f1b-42c0-b150-ac007e9a7d45 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:11.585119 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bf71f78b-4f1b-42c0-b150-ac007e9a7d45 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:11.586625 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bf71f78b-4f1b-42c0-b150-ac007e9a7d45 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:11.588436 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bf71f78b-4f1b-42c0-b150-ac007e9a7d45 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:11.589138 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bf71f78b-4f1b-42c0-b150-ac007e9a7d45 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:11.623760 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-46895291-56a5-44c6-b506-7c3cd022190f tempest-ImagesMetadataNegativeTestJSON-1066803561 tempest-ImagesMetadataNegativeTestJSON-1066803561-project] Calling method '.version_select at 0x7f847d5eaf70>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:11.662079 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-46895291-56a5-44c6-b506-7c3cd022190f tempest-ImagesMetadataNegativeTestJSON-1066803561 tempest-ImagesMetadataNegativeTestJSON-1066803561-project] HTTP exception thrown: Image not found. Aug 10 23:07:11.673075 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-46895291-56a5-44c6-b506-7c3cd022190f tempest-ImagesMetadataNegativeTestJSON-1066803561 tempest-ImagesMetadataNegativeTestJSON-1066803561-project] Request method failure captured: Aug 10 23:07:11.673075 n-d-850468-14 devstack@n-api.service[122632]: request: DELETE /compute/v2.1/images/e02c405e-1d92-4bea-9d01-5894abfa9bb9/metadata/os_distro HTTP/1.1 Aug 10 23:07:11.673075 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:07:11.673075 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:07:11.673075 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:07:11.673075 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 23:07:11.673075 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:07:11.673075 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:07:11.673075 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:07:11.673075 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:07:11.673075 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9DofaIOLg7tg0Agu6foHruV93SZhKF0i2jD4eVzghuc1YtkM_g81ZYlpkOOtOBpKY-1ngUacX7KYNy6ePBNtoAWi6ziSsXFNJTI1dsudnamILyp4dNOl-wRe-sgbBm8UEKQgRPng-iD-khlOwN3kySxtOftslNXrf8G4FLqgk4Z_HyY Aug 10 23:07:11.673075 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:07:11.673075 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:07:11.673075 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:07:11.673075 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:07:11.673075 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:07:11.673075 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:07:11.673075 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 9eea26851f1c4d989cc3e9181faa4904 Aug 10 23:07:11.673075 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1066803561 Aug 10 23:07:11.673075 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:07:11.673075 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:07:11.674711 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9eea26851f1c4d989cc3e9181faa4904"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9eea26851f1c4d989cc3e9181faa4904"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/9eea26851f1c4d989cc3e9181faa4904"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_9eea26851f1c4d989cc3e9181faa4904", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:07:11.674711 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1066803561 Aug 10 23:07:11.674711 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 9eea26851f1c4d989cc3e9181faa4904 Aug 10 23:07:11.674711 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1066803561 Aug 10 23:07:11.674711 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-ImagesMetadataNegativeTestJSON-1066803561-project Aug 10 23:07:11.674711 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:07:11.674711 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:07:11.674711 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: 2276430b938a47b4989a00cd8d99fe7b Aug 10 23:07:11.674711 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1066803561-project Aug 10 23:07:11.674711 n-d-850468-14 devstack@n-api.service[122632]: method: Aug 10 23:07:11.674711 n-d-850468-14 devstack@n-api.service[122632]: exception: Image not found. Aug 10 23:07:11.674711 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'image_id': 'e02c405e-1d92-4bea-9d01-5894abfa9bb9', 'id': 'os_distro'} Aug 10 23:07:11.674711 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:07:11.675724 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:07:11.675724 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 10 23:07:11.675724 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 10 23:07:11.675724 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 10 23:07:11.675724 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 10 23:07:11.675724 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 10 23:07:11.675724 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 10 23:07:11.675724 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 10 23:07:11.675724 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 10 23:07:11.675724 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 10 23:07:11.675724 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 10 23:07:11.675724 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 10 23:07:11.675724 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 10 23:07:11.675724 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 10 23:07:11.675724 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 10 23:07:11.675724 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 10 23:07:11.675724 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 10 23:07:11.675724 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID e02c405e-1d92-4bea-9d01-5894abfa9bb9 Aug 10 23:07:11.677018 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:07:11.677018 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:07:11.677018 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:07:11.677018 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:07:11.677018 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 10 23:07:11.677018 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 10 23:07:11.677018 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 10 23:07:11.677018 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 10 23:07:11.677018 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 10 23:07:11.677018 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 10 23:07:11.677018 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 10 23:07:11.677018 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 10 23:07:11.677018 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 10 23:07:11.677018 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 10 23:07:11.677018 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 10 23:07:11.677018 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 10 23:07:11.677018 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 10 23:07:11.677018 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 10 23:07:11.677018 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 10 23:07:11.677018 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 10 23:07:11.678413 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 10 23:07:11.678413 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 10 23:07:11.678413 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 10 23:07:11.678413 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 10 23:07:11.678413 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 10 23:07:11.678413 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 10 23:07:11.678413 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 10 23:07:11.678413 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 10 23:07:11.678413 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image e02c405e-1d92-4bea-9d01-5894abfa9bb9 could not be found. Aug 10 23:07:11.678413 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:07:11.678413 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:07:11.678413 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:07:11.678413 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:07:11.678413 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:07:11.678413 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:07:11.678413 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:07:11.678413 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:07:11.678413 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 23:07:11.678413 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 23:07:11.679916 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:07:11.679916 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:07:11.679916 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Aug 10 23:07:11.679916 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Aug 10 23:07:11.679916 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 10 23:07:11.679916 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 10 23:07:11.679916 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 10 23:07:11.679916 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:07:11.679916 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:07:11.679916 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:07:11.679916 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:07:11.679916 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:07:11.679916 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:07:11.679916 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:07:11.679916 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:07:11.679916 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 10 23:07:11.679916 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:07:11.682866 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-46895291-56a5-44c6-b506-7c3cd022190f tempest-ImagesMetadataNegativeTestJSON-1066803561 tempest-ImagesMetadataNegativeTestJSON-1066803561-project] Returning 404 to user: Image not found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:07:11.684137 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-46895291-56a5-44c6-b506-7c3cd022190f tempest-ImagesMetadataNegativeTestJSON-1066803561 tempest-ImagesMetadataNegativeTestJSON-1066803561-project] 10.222.0.58 "DELETE /compute/v2.1/images/e02c405e-1d92-4bea-9d01-5894abfa9bb9/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.418530 Aug 10 23:07:11.684901 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1247/2530] 10.222.0.58 () {58 vars in 1293 bytes} [Wed Aug 10 23:07:11 2022] DELETE /compute/v2.1/images/e02c405e-1d92-4bea-9d01-5894abfa9bb9/metadata/os_distro => generated 62 bytes in 420 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 10 23:07:11.699614 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-8e3b80fe-0819-4405-b808-fcb8f91130e5 tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:11.703217 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-8e3b80fe-0819-4405-b808-fcb8f91130e5 tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] [instance: ba82fd6a-d3bf-4fd3-83e0-09103eafca25] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:11.751829 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8e3b80fe-0819-4405-b808-fcb8f91130e5 tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:11.753303 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8e3b80fe-0819-4405-b808-fcb8f91130e5 tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:11.755023 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8e3b80fe-0819-4405-b808-fcb8f91130e5 tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:11.756317 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8e3b80fe-0819-4405-b808-fcb8f91130e5 tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:11.759651 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8e3b80fe-0819-4405-b808-fcb8f91130e5 tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:11.762454 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8e3b80fe-0819-4405-b808-fcb8f91130e5 tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:11.958971 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-bf71f78b-4f1b-42c0-b150-ac007e9a7d45 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8899e278c9453fba0ab05c69b0b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46ac8b84bd649fa88897068dbfa5ce6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:11.979161 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-bf71f78b-4f1b-42c0-b150-ac007e9a7d45 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] 10.222.0.58 "GET /compute/v2.1/servers/85c138c8-9302-453b-8dc1-8f0002d79f1a" status: 200 len: 1515 microversion: 2.1 time: 0.420851 Aug 10 23:07:11.980463 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1284/2531] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:07:11 2022] GET /compute/v2.1/servers/85c138c8-9302-453b-8dc1-8f0002d79f1a => generated 1515 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:07:11.992705 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-95364065-1047-407a-8f31-b51345b45232 tempest-ImagesMetadataNegativeTestJSON-1066803561 tempest-ImagesMetadataNegativeTestJSON-1066803561-project] Calling method '.version_select at 0x7f847cf91940>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:12.018455 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=4 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:07:12.048976 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-95364065-1047-407a-8f31-b51345b45232 tempest-ImagesMetadataNegativeTestJSON-1066803561 tempest-ImagesMetadataNegativeTestJSON-1066803561-project] HTTP exception thrown: Image not found. Aug 10 23:07:12.055387 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-95364065-1047-407a-8f31-b51345b45232 tempest-ImagesMetadataNegativeTestJSON-1066803561 tempest-ImagesMetadataNegativeTestJSON-1066803561-project] Request method failure captured: Aug 10 23:07:12.055387 n-d-850468-14 devstack@n-api.service[122633]: request: GET /compute/v2.1/images/90ecbf2f-3e18-414b-856d-560290c0f326/metadata/os_version HTTP/1.1 Aug 10 23:07:12.055387 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:07:12.055387 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:07:12.055387 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:07:12.055387 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:07:12.055387 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:07:12.055387 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:07:12.055387 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:07:12.055387 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:07:12.055387 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9DofaIOLg7tg0Agu6foHruV93SZhKF0i2jD4eVzghuc1YtkM_g81ZYlpkOOtOBpKY-1ngUacX7KYNy6ePBNtoAWi6ziSsXFNJTI1dsudnamILyp4dNOl-wRe-sgbBm8UEKQgRPng-iD-khlOwN3kySxtOftslNXrf8G4FLqgk4Z_HyY Aug 10 23:07:12.055387 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:07:12.055387 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:07:12.055387 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:07:12.055387 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:07:12.055387 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:07:12.055387 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:07:12.055387 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 9eea26851f1c4d989cc3e9181faa4904 Aug 10 23:07:12.055387 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1066803561 Aug 10 23:07:12.055387 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:07:12.055387 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:07:12.057699 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9eea26851f1c4d989cc3e9181faa4904"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9eea26851f1c4d989cc3e9181faa4904"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/9eea26851f1c4d989cc3e9181faa4904"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_9eea26851f1c4d989cc3e9181faa4904", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:07:12.057699 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1066803561 Aug 10 23:07:12.057699 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 9eea26851f1c4d989cc3e9181faa4904 Aug 10 23:07:12.057699 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1066803561 Aug 10 23:07:12.057699 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-ImagesMetadataNegativeTestJSON-1066803561-project Aug 10 23:07:12.057699 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:07:12.057699 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:07:12.057699 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 2276430b938a47b4989a00cd8d99fe7b Aug 10 23:07:12.057699 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1066803561-project Aug 10 23:07:12.057699 n-d-850468-14 devstack@n-api.service[122633]: method: Aug 10 23:07:12.057699 n-d-850468-14 devstack@n-api.service[122633]: exception: Image not found. Aug 10 23:07:12.057699 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'image_id': '90ecbf2f-3e18-414b-856d-560290c0f326', 'id': 'os_version'} Aug 10 23:07:12.057699 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:07:12.058524 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:07:12.058524 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 10 23:07:12.058524 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 10 23:07:12.058524 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 10 23:07:12.058524 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 10 23:07:12.058524 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 10 23:07:12.058524 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 10 23:07:12.058524 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 10 23:07:12.058524 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 10 23:07:12.058524 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 10 23:07:12.058524 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 10 23:07:12.058524 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 10 23:07:12.058524 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 10 23:07:12.058524 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 10 23:07:12.058524 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 10 23:07:12.058524 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 10 23:07:12.058524 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 10 23:07:12.058524 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 90ecbf2f-3e18-414b-856d-560290c0f326 Aug 10 23:07:12.060703 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:07:12.060703 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:07:12.060703 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:07:12.060703 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:07:12.060703 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 10 23:07:12.060703 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 10 23:07:12.060703 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 10 23:07:12.060703 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 10 23:07:12.060703 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 10 23:07:12.060703 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 10 23:07:12.060703 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 10 23:07:12.060703 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 10 23:07:12.060703 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 10 23:07:12.060703 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 10 23:07:12.060703 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 10 23:07:12.060703 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 10 23:07:12.060703 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 10 23:07:12.060703 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 10 23:07:12.060703 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 10 23:07:12.060703 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 10 23:07:12.063947 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 10 23:07:12.063947 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 10 23:07:12.063947 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 10 23:07:12.063947 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 10 23:07:12.063947 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 10 23:07:12.063947 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 10 23:07:12.063947 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 10 23:07:12.063947 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 10 23:07:12.063947 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 90ecbf2f-3e18-414b-856d-560290c0f326 could not be found. Aug 10 23:07:12.063947 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:07:12.063947 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:07:12.063947 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:07:12.063947 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:07:12.063947 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:07:12.063947 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:07:12.063947 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:07:12.063947 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:07:12.063947 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 23:07:12.063947 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 23:07:12.066755 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:07:12.066755 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:07:12.066755 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Aug 10 23:07:12.066755 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Aug 10 23:07:12.066755 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 10 23:07:12.066755 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 10 23:07:12.066755 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 10 23:07:12.066755 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:07:12.066755 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:07:12.066755 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:07:12.066755 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:07:12.066755 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:07:12.066755 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:07:12.066755 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:07:12.066755 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:07:12.066755 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 10 23:07:12.066755 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:07:12.071910 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-95364065-1047-407a-8f31-b51345b45232 tempest-ImagesMetadataNegativeTestJSON-1066803561 tempest-ImagesMetadataNegativeTestJSON-1066803561-project] Returning 404 to user: Image not found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:07:12.073065 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-95364065-1047-407a-8f31-b51345b45232 tempest-ImagesMetadataNegativeTestJSON-1066803561 tempest-ImagesMetadataNegativeTestJSON-1066803561-project] 10.222.0.58 "GET /compute/v2.1/images/90ecbf2f-3e18-414b-856d-560290c0f326/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.090726 Aug 10 23:07:12.073627 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1285/2532] 10.222.0.58 () {58 vars in 1293 bytes} [Wed Aug 10 23:07:11 2022] GET /compute/v2.1/images/90ecbf2f-3e18-414b-856d-560290c0f326/metadata/os_version => generated 62 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 10 23:07:12.090356 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-1ac1c184-febb-463d-826e-3f0e2eabcc79 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:12.090678 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-1ac1c184-febb-463d-826e-3f0e2eabcc79 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] [instance: 8385348f-0651-486d-9b4a-2c884933edb1] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:12.121977 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1ac1c184-febb-463d-826e-3f0e2eabcc79 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:12.122482 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1ac1c184-febb-463d-826e-3f0e2eabcc79 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:12.122977 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1ac1c184-febb-463d-826e-3f0e2eabcc79 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:12.123712 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1ac1c184-febb-463d-826e-3f0e2eabcc79 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:12.124174 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1ac1c184-febb-463d-826e-3f0e2eabcc79 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:12.124606 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1ac1c184-febb-463d-826e-3f0e2eabcc79 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:12.164571 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=97,nova_cell1:INSERT=2 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:07:12.221119 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-1ac1c184-febb-463d-826e-3f0e2eabcc79 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d79bf59dabe4c02aa5e27bf3b0bc1ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9af75fc4bbc4b63ae83b5f900f1aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:12.231804 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-1ac1c184-febb-463d-826e-3f0e2eabcc79 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d79bf59dabe4c02aa5e27bf3b0bc1ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9af75fc4bbc4b63ae83b5f900f1aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:12.236062 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-1ac1c184-febb-463d-826e-3f0e2eabcc79 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d79bf59dabe4c02aa5e27bf3b0bc1ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9af75fc4bbc4b63ae83b5f900f1aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:12.246977 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-1ac1c184-febb-463d-826e-3f0e2eabcc79 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] 10.222.0.58 "GET /compute/v2.1/servers/8385348f-0651-486d-9b4a-2c884933edb1" status: 200 len: 1447 microversion: 2.75 time: 0.159464 Aug 10 23:07:12.248594 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1286/2533] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:07:12 2022] GET /compute/v2.1/servers/8385348f-0651-486d-9b4a-2c884933edb1 => generated 1447 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:07:12.269981 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-053e3a29-5d4a-4ce7-a3cd-3be2130ceb90 tempest-ImagesMetadataNegativeTestJSON-1066803561 tempest-ImagesMetadataNegativeTestJSON-1066803561-project] Calling method '.version_select at 0x7f847d308670>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:12.278163 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-8e3b80fe-0819-4405-b808-fcb8f91130e5 tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab18f771541437ca1bda46aec45dda5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4e0ba9683c4e15932b9554d698034e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:12.289855 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-8e3b80fe-0819-4405-b808-fcb8f91130e5 tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] 10.222.0.58 "GET /compute/v2.1/servers/ba82fd6a-d3bf-4fd3-83e0-09103eafca25" status: 200 len: 1325 microversion: 2.1 time: 0.597748 Aug 10 23:07:12.297142 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-053e3a29-5d4a-4ce7-a3cd-3be2130ceb90 tempest-ImagesMetadataNegativeTestJSON-1066803561 tempest-ImagesMetadataNegativeTestJSON-1066803561-project] HTTP exception thrown: Image not found. Aug 10 23:07:12.299601 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-053e3a29-5d4a-4ce7-a3cd-3be2130ceb90 tempest-ImagesMetadataNegativeTestJSON-1066803561 tempest-ImagesMetadataNegativeTestJSON-1066803561-project] Request method failure captured: Aug 10 23:07:12.299601 n-d-850468-14 devstack@n-api.service[122633]: request: GET /compute/v2.1/images/62292022-38bc-48ee-8c85-4fd25439688d/metadata HTTP/1.1 Aug 10 23:07:12.299601 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:07:12.299601 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:07:12.299601 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:07:12.299601 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:07:12.299601 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:07:12.299601 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:07:12.299601 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:07:12.299601 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:07:12.299601 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9DofaIOLg7tg0Agu6foHruV93SZhKF0i2jD4eVzghuc1YtkM_g81ZYlpkOOtOBpKY-1ngUacX7KYNy6ePBNtoAWi6ziSsXFNJTI1dsudnamILyp4dNOl-wRe-sgbBm8UEKQgRPng-iD-khlOwN3kySxtOftslNXrf8G4FLqgk4Z_HyY Aug 10 23:07:12.299601 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:07:12.299601 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:07:12.299601 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:07:12.299601 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:07:12.299601 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:07:12.299601 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:07:12.299601 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 9eea26851f1c4d989cc3e9181faa4904 Aug 10 23:07:12.299601 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1066803561 Aug 10 23:07:12.299601 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:07:12.299601 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:07:12.301072 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9eea26851f1c4d989cc3e9181faa4904"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9eea26851f1c4d989cc3e9181faa4904"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/9eea26851f1c4d989cc3e9181faa4904"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_9eea26851f1c4d989cc3e9181faa4904", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:07:12.301072 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1066803561 Aug 10 23:07:12.301072 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 9eea26851f1c4d989cc3e9181faa4904 Aug 10 23:07:12.301072 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1066803561 Aug 10 23:07:12.301072 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-ImagesMetadataNegativeTestJSON-1066803561-project Aug 10 23:07:12.301072 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:07:12.301072 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:07:12.301072 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 2276430b938a47b4989a00cd8d99fe7b Aug 10 23:07:12.301072 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1066803561-project Aug 10 23:07:12.301072 n-d-850468-14 devstack@n-api.service[122633]: method: Aug 10 23:07:12.301072 n-d-850468-14 devstack@n-api.service[122633]: exception: Image not found. Aug 10 23:07:12.301072 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'image_id': '62292022-38bc-48ee-8c85-4fd25439688d'} Aug 10 23:07:12.301072 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:07:12.301928 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:07:12.301928 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 10 23:07:12.301928 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 10 23:07:12.301928 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 10 23:07:12.301928 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 10 23:07:12.301928 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 10 23:07:12.301928 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 10 23:07:12.301928 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 10 23:07:12.301928 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 10 23:07:12.301928 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 10 23:07:12.301928 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 10 23:07:12.301928 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 10 23:07:12.301928 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 10 23:07:12.301928 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 10 23:07:12.301928 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 10 23:07:12.301928 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 10 23:07:12.301928 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 10 23:07:12.301928 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 62292022-38bc-48ee-8c85-4fd25439688d Aug 10 23:07:12.304037 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:07:12.304037 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:07:12.304037 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:07:12.304037 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:07:12.304037 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 10 23:07:12.304037 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 10 23:07:12.304037 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 10 23:07:12.304037 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 10 23:07:12.304037 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 10 23:07:12.304037 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 10 23:07:12.304037 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 10 23:07:12.304037 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 10 23:07:12.304037 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 10 23:07:12.304037 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 10 23:07:12.304037 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 10 23:07:12.304037 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 10 23:07:12.304037 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 10 23:07:12.304037 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 10 23:07:12.304037 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 10 23:07:12.304037 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 10 23:07:12.306101 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 10 23:07:12.306101 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 10 23:07:12.306101 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 10 23:07:12.306101 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 10 23:07:12.306101 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 10 23:07:12.306101 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 10 23:07:12.306101 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 10 23:07:12.306101 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 10 23:07:12.306101 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 62292022-38bc-48ee-8c85-4fd25439688d could not be found. Aug 10 23:07:12.306101 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:07:12.306101 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:07:12.306101 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:07:12.306101 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:07:12.306101 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:07:12.306101 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:07:12.306101 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:07:12.306101 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:07:12.306101 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 23:07:12.306101 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 23:07:12.307782 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:07:12.307782 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:07:12.307782 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Aug 10 23:07:12.307782 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Aug 10 23:07:12.307782 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 10 23:07:12.307782 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 10 23:07:12.307782 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 10 23:07:12.307782 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:07:12.307782 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:07:12.307782 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:07:12.307782 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:07:12.307782 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:07:12.307782 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:07:12.307782 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:07:12.307782 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:07:12.307782 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 10 23:07:12.307782 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:07:12.308960 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1248/2534] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:07:11 2022] GET /compute/v2.1/servers/ba82fd6a-d3bf-4fd3-83e0-09103eafca25 => generated 1325 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:07:12.309053 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-053e3a29-5d4a-4ce7-a3cd-3be2130ceb90 tempest-ImagesMetadataNegativeTestJSON-1066803561 tempest-ImagesMetadataNegativeTestJSON-1066803561-project] Returning 404 to user: Image not found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:07:12.309053 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-053e3a29-5d4a-4ce7-a3cd-3be2130ceb90 tempest-ImagesMetadataNegativeTestJSON-1066803561 tempest-ImagesMetadataNegativeTestJSON-1066803561-project] 10.222.0.58 "GET /compute/v2.1/images/62292022-38bc-48ee-8c85-4fd25439688d/metadata" status: 404 len: 62 microversion: 2.1 time: 0.055476 Aug 10 23:07:12.309053 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1287/2535] 10.222.0.58 () {58 vars in 1260 bytes} [Wed Aug 10 23:07:12 2022] GET /compute/v2.1/images/62292022-38bc-48ee-8c85-4fd25439688d/metadata => generated 62 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 10 23:07:12.318189 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-dcc98206-ccf5-4ade-b0eb-e51e3dfcbf92 tempest-ImagesMetadataNegativeTestJSON-1066803561 tempest-ImagesMetadataNegativeTestJSON-1066803561-project] Action: 'update_all', calling method: .version_select at 0x7f847d5eac10>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:07:12.350159 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-dcc98206-ccf5-4ade-b0eb-e51e3dfcbf92 tempest-ImagesMetadataNegativeTestJSON-1066803561 tempest-ImagesMetadataNegativeTestJSON-1066803561-project] HTTP exception thrown: Image not found. Aug 10 23:07:12.354390 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-dcc98206-ccf5-4ade-b0eb-e51e3dfcbf92 tempest-ImagesMetadataNegativeTestJSON-1066803561 tempest-ImagesMetadataNegativeTestJSON-1066803561-project] Request method failure captured: Aug 10 23:07:12.354390 n-d-850468-14 devstack@n-api.service[122632]: request: PUT /compute/v2.1/images/757da493-78a9-4ac3-bbb7-6db2bf704ea5/metadata HTTP/1.1 Aug 10 23:07:12.354390 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:07:12.354390 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:07:12.354390 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:07:12.354390 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 57 Aug 10 23:07:12.354390 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:07:12.354390 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:07:12.354390 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:07:12.354390 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:07:12.354390 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9DofaIOLg7tg0Agu6foHruV93SZhKF0i2jD4eVzghuc1YtkM_g81ZYlpkOOtOBpKY-1ngUacX7KYNy6ePBNtoAWi6ziSsXFNJTI1dsudnamILyp4dNOl-wRe-sgbBm8UEKQgRPng-iD-khlOwN3kySxtOftslNXrf8G4FLqgk4Z_HyY Aug 10 23:07:12.354390 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:07:12.354390 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:07:12.354390 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:07:12.354390 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:07:12.354390 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:07:12.354390 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:07:12.354390 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 9eea26851f1c4d989cc3e9181faa4904 Aug 10 23:07:12.354390 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1066803561 Aug 10 23:07:12.354390 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:07:12.354390 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:07:12.355748 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9eea26851f1c4d989cc3e9181faa4904"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9eea26851f1c4d989cc3e9181faa4904"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/9eea26851f1c4d989cc3e9181faa4904"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_9eea26851f1c4d989cc3e9181faa4904", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:07:12.355748 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1066803561 Aug 10 23:07:12.355748 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 9eea26851f1c4d989cc3e9181faa4904 Aug 10 23:07:12.355748 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1066803561 Aug 10 23:07:12.355748 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-ImagesMetadataNegativeTestJSON-1066803561-project Aug 10 23:07:12.355748 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:07:12.355748 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:07:12.355748 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: 2276430b938a47b4989a00cd8d99fe7b Aug 10 23:07:12.355748 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1066803561-project Aug 10 23:07:12.355748 n-d-850468-14 devstack@n-api.service[122632]: Aug 10 23:07:12.355748 n-d-850468-14 devstack@n-api.service[122632]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Aug 10 23:07:12.355748 n-d-850468-14 devstack@n-api.service[122632]: method: Aug 10 23:07:12.355748 n-d-850468-14 devstack@n-api.service[122632]: exception: Image not found. Aug 10 23:07:12.356514 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'image_id': '757da493-78a9-4ac3-bbb7-6db2bf704ea5', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Aug 10 23:07:12.356514 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:07:12.356514 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:07:12.356514 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 10 23:07:12.356514 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 10 23:07:12.356514 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 10 23:07:12.356514 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 10 23:07:12.356514 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 10 23:07:12.356514 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 10 23:07:12.356514 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 10 23:07:12.356514 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 10 23:07:12.356514 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 10 23:07:12.356514 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 10 23:07:12.356514 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 10 23:07:12.356514 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 10 23:07:12.356514 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 10 23:07:12.356514 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 10 23:07:12.356514 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 10 23:07:12.357532 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 10 23:07:12.357532 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 757da493-78a9-4ac3-bbb7-6db2bf704ea5 Aug 10 23:07:12.357532 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:07:12.357532 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:07:12.357532 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:07:12.357532 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:07:12.357532 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 10 23:07:12.357532 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 10 23:07:12.357532 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 10 23:07:12.357532 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 10 23:07:12.357532 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 10 23:07:12.357532 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 10 23:07:12.357532 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 10 23:07:12.357532 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 10 23:07:12.357532 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 10 23:07:12.357532 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 10 23:07:12.357532 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 10 23:07:12.357532 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 10 23:07:12.357532 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 10 23:07:12.357532 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 10 23:07:12.359330 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 10 23:07:12.359330 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 10 23:07:12.359330 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 10 23:07:12.359330 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 10 23:07:12.359330 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 10 23:07:12.359330 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 10 23:07:12.359330 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 10 23:07:12.359330 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 10 23:07:12.359330 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 10 23:07:12.359330 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 10 23:07:12.359330 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 757da493-78a9-4ac3-bbb7-6db2bf704ea5 could not be found. Aug 10 23:07:12.359330 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:07:12.359330 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:07:12.359330 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:07:12.359330 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:07:12.359330 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:07:12.359330 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:07:12.359330 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:07:12.359330 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:07:12.361173 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 23:07:12.361173 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 23:07:12.361173 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:07:12.361173 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:07:12.361173 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 23:07:12.361173 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 23:07:12.361173 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Aug 10 23:07:12.361173 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Aug 10 23:07:12.361173 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 10 23:07:12.361173 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 10 23:07:12.361173 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 10 23:07:12.361173 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:07:12.361173 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:07:12.361173 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:07:12.361173 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:07:12.361173 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:07:12.361173 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:07:12.361173 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:07:12.361173 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:07:12.361173 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 10 23:07:12.361173 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:07:12.363583 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-dcc98206-ccf5-4ade-b0eb-e51e3dfcbf92 tempest-ImagesMetadataNegativeTestJSON-1066803561 tempest-ImagesMetadataNegativeTestJSON-1066803561-project] Returning 404 to user: Image not found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:07:12.363583 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-dcc98206-ccf5-4ade-b0eb-e51e3dfcbf92 tempest-ImagesMetadataNegativeTestJSON-1066803561 tempest-ImagesMetadataNegativeTestJSON-1066803561-project] 10.222.0.58 "PUT /compute/v2.1/images/757da493-78a9-4ac3-bbb7-6db2bf704ea5/metadata" status: 404 len: 62 microversion: 2.1 time: 0.043484 Aug 10 23:07:12.363583 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1249/2536] 10.222.0.58 () {60 vars in 1280 bytes} [Wed Aug 10 23:07:12 2022] PUT /compute/v2.1/images/757da493-78a9-4ac3-bbb7-6db2bf704ea5/metadata => generated 62 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 10 23:07:12.366932 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-36a1e31e-8901-4e31-a71a-4ce9290b4661 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:12.367608 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-36a1e31e-8901-4e31-a71a-4ce9290b4661 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] [instance: 092f973f-79e3-44bf-a2e0-f7d3bfddf42c] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:12.369178 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-1c07a588-483f-49a7-8a74-53dad5d0f197 tempest-ImagesMetadataNegativeTestJSON-1066803561 tempest-ImagesMetadataNegativeTestJSON-1066803561-project] Action: 'update', calling method: .version_select at 0x7f847d81c160>, body: {"meta": {"os_distro": "alt"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:07:12.381737 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-36a1e31e-8901-4e31-a71a-4ce9290b4661 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:12.382220 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-36a1e31e-8901-4e31-a71a-4ce9290b4661 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:12.382665 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-36a1e31e-8901-4e31-a71a-4ce9290b4661 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:12.383420 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-36a1e31e-8901-4e31-a71a-4ce9290b4661 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:12.386179 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-36a1e31e-8901-4e31-a71a-4ce9290b4661 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:12.386684 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-36a1e31e-8901-4e31-a71a-4ce9290b4661 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:12.401816 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-1c07a588-483f-49a7-8a74-53dad5d0f197 tempest-ImagesMetadataNegativeTestJSON-1066803561 tempest-ImagesMetadataNegativeTestJSON-1066803561-project] HTTP exception thrown: Image not found. Aug 10 23:07:12.404375 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-1c07a588-483f-49a7-8a74-53dad5d0f197 tempest-ImagesMetadataNegativeTestJSON-1066803561 tempest-ImagesMetadataNegativeTestJSON-1066803561-project] Request method failure captured: Aug 10 23:07:12.404375 n-d-850468-14 devstack@n-api.service[122632]: request: PUT /compute/v2.1/images/8f980389-1aa2-4b7a-a4a4-a6bd096ae169/metadata/os_distro HTTP/1.1 Aug 10 23:07:12.404375 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:07:12.404375 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:07:12.404375 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:07:12.404375 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 30 Aug 10 23:07:12.404375 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:07:12.404375 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:07:12.404375 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:07:12.404375 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:07:12.404375 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9DofaIOLg7tg0Agu6foHruV93SZhKF0i2jD4eVzghuc1YtkM_g81ZYlpkOOtOBpKY-1ngUacX7KYNy6ePBNtoAWi6ziSsXFNJTI1dsudnamILyp4dNOl-wRe-sgbBm8UEKQgRPng-iD-khlOwN3kySxtOftslNXrf8G4FLqgk4Z_HyY Aug 10 23:07:12.404375 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:07:12.404375 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:07:12.404375 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:07:12.404375 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:07:12.404375 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:07:12.404375 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:07:12.404375 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 9eea26851f1c4d989cc3e9181faa4904 Aug 10 23:07:12.404375 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1066803561 Aug 10 23:07:12.404375 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:07:12.404375 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:07:12.405659 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9eea26851f1c4d989cc3e9181faa4904"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9eea26851f1c4d989cc3e9181faa4904"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/9eea26851f1c4d989cc3e9181faa4904"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_9eea26851f1c4d989cc3e9181faa4904", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:07:12.405659 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1066803561 Aug 10 23:07:12.405659 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 9eea26851f1c4d989cc3e9181faa4904 Aug 10 23:07:12.405659 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1066803561 Aug 10 23:07:12.405659 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-ImagesMetadataNegativeTestJSON-1066803561-project Aug 10 23:07:12.405659 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:07:12.405659 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:07:12.405659 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: 2276430b938a47b4989a00cd8d99fe7b Aug 10 23:07:12.405659 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1066803561-project Aug 10 23:07:12.405659 n-d-850468-14 devstack@n-api.service[122632]: Aug 10 23:07:12.405659 n-d-850468-14 devstack@n-api.service[122632]: {"meta": {"os_distro": "alt"}} Aug 10 23:07:12.405659 n-d-850468-14 devstack@n-api.service[122632]: method: Aug 10 23:07:12.405659 n-d-850468-14 devstack@n-api.service[122632]: exception: Image not found. Aug 10 23:07:12.405659 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'image_id': '8f980389-1aa2-4b7a-a4a4-a6bd096ae169', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Aug 10 23:07:12.406469 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:07:12.406469 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:07:12.406469 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 10 23:07:12.406469 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 10 23:07:12.406469 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 10 23:07:12.406469 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 10 23:07:12.406469 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 10 23:07:12.406469 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 10 23:07:12.406469 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 10 23:07:12.406469 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 10 23:07:12.406469 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 10 23:07:12.406469 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 10 23:07:12.406469 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 10 23:07:12.406469 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 10 23:07:12.406469 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 10 23:07:12.406469 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 10 23:07:12.406469 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 10 23:07:12.406469 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 10 23:07:12.407634 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 8f980389-1aa2-4b7a-a4a4-a6bd096ae169 Aug 10 23:07:12.407634 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:07:12.407634 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:07:12.407634 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:07:12.407634 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:07:12.407634 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 10 23:07:12.407634 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 10 23:07:12.407634 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 10 23:07:12.407634 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 10 23:07:12.407634 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 10 23:07:12.407634 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 10 23:07:12.407634 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 10 23:07:12.407634 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 10 23:07:12.407634 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 10 23:07:12.407634 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 10 23:07:12.407634 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 10 23:07:12.407634 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 10 23:07:12.407634 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 10 23:07:12.407634 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 10 23:07:12.409650 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 10 23:07:12.409650 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 10 23:07:12.409650 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 10 23:07:12.409650 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 10 23:07:12.409650 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 10 23:07:12.409650 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 10 23:07:12.409650 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 10 23:07:12.409650 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 10 23:07:12.409650 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 10 23:07:12.409650 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 10 23:07:12.409650 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 8f980389-1aa2-4b7a-a4a4-a6bd096ae169 could not be found. Aug 10 23:07:12.409650 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:07:12.409650 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:07:12.409650 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:07:12.409650 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:07:12.409650 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:07:12.409650 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:07:12.409650 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:07:12.409650 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:07:12.410772 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 23:07:12.410772 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 23:07:12.410772 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:07:12.410772 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:07:12.410772 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 23:07:12.410772 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 23:07:12.410772 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Aug 10 23:07:12.410772 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Aug 10 23:07:12.410772 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 10 23:07:12.410772 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 10 23:07:12.410772 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 10 23:07:12.410772 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:07:12.410772 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:07:12.410772 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:07:12.410772 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:07:12.410772 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:07:12.410772 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:07:12.410772 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:07:12.410772 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:07:12.410772 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 10 23:07:12.410772 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:07:12.414000 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-1c07a588-483f-49a7-8a74-53dad5d0f197 tempest-ImagesMetadataNegativeTestJSON-1066803561 tempest-ImagesMetadataNegativeTestJSON-1066803561-project] Returning 404 to user: Image not found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:07:12.414000 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-1c07a588-483f-49a7-8a74-53dad5d0f197 tempest-ImagesMetadataNegativeTestJSON-1066803561 tempest-ImagesMetadataNegativeTestJSON-1066803561-project] 10.222.0.58 "PUT /compute/v2.1/images/8f980389-1aa2-4b7a-a4a4-a6bd096ae169/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.042305 Aug 10 23:07:12.414000 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1250/2537] 10.222.0.58 () {60 vars in 1310 bytes} [Wed Aug 10 23:07:12 2022] PUT /compute/v2.1/images/8f980389-1aa2-4b7a-a4a4-a6bd096ae169/metadata/os_distro => generated 62 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 10 23:07:12.418535 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-29b109ed-2763-415b-affb-1bc9bbdfbcc1 tempest-ImagesMetadataNegativeTestJSON-1066803561 tempest-ImagesMetadataNegativeTestJSON-1066803561-project] Action: 'create', calling method: .version_select at 0x7f847d5eac10>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:07:12.456355 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-29b109ed-2763-415b-affb-1bc9bbdfbcc1 tempest-ImagesMetadataNegativeTestJSON-1066803561 tempest-ImagesMetadataNegativeTestJSON-1066803561-project] HTTP exception thrown: Image not found. Aug 10 23:07:12.459653 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-29b109ed-2763-415b-affb-1bc9bbdfbcc1 tempest-ImagesMetadataNegativeTestJSON-1066803561 tempest-ImagesMetadataNegativeTestJSON-1066803561-project] Request method failure captured: Aug 10 23:07:12.459653 n-d-850468-14 devstack@n-api.service[122632]: request: POST /compute/v2.1/images/d4003cd7-0f8e-4bc2-b91e-662e4f06cfee/metadata HTTP/1.1 Aug 10 23:07:12.459653 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:07:12.459653 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:07:12.459653 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:07:12.459653 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 57 Aug 10 23:07:12.459653 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:07:12.459653 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:07:12.459653 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:07:12.459653 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:07:12.459653 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9DofaIOLg7tg0Agu6foHruV93SZhKF0i2jD4eVzghuc1YtkM_g81ZYlpkOOtOBpKY-1ngUacX7KYNy6ePBNtoAWi6ziSsXFNJTI1dsudnamILyp4dNOl-wRe-sgbBm8UEKQgRPng-iD-khlOwN3kySxtOftslNXrf8G4FLqgk4Z_HyY Aug 10 23:07:12.459653 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:07:12.459653 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:07:12.459653 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:07:12.459653 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:07:12.459653 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:07:12.459653 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:07:12.459653 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 9eea26851f1c4d989cc3e9181faa4904 Aug 10 23:07:12.459653 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1066803561 Aug 10 23:07:12.459653 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:07:12.459653 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:07:12.461240 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9eea26851f1c4d989cc3e9181faa4904"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/9eea26851f1c4d989cc3e9181faa4904"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/9eea26851f1c4d989cc3e9181faa4904"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_9eea26851f1c4d989cc3e9181faa4904", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:07:12.461240 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1066803561 Aug 10 23:07:12.461240 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 9eea26851f1c4d989cc3e9181faa4904 Aug 10 23:07:12.461240 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1066803561 Aug 10 23:07:12.461240 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-ImagesMetadataNegativeTestJSON-1066803561-project Aug 10 23:07:12.461240 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:07:12.461240 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:07:12.461240 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: 2276430b938a47b4989a00cd8d99fe7b Aug 10 23:07:12.461240 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1066803561-project Aug 10 23:07:12.461240 n-d-850468-14 devstack@n-api.service[122632]: Aug 10 23:07:12.461240 n-d-850468-14 devstack@n-api.service[122632]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Aug 10 23:07:12.461240 n-d-850468-14 devstack@n-api.service[122632]: method: Aug 10 23:07:12.461240 n-d-850468-14 devstack@n-api.service[122632]: exception: Image not found. Aug 10 23:07:12.461240 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'image_id': 'd4003cd7-0f8e-4bc2-b91e-662e4f06cfee', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Aug 10 23:07:12.462397 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:07:12.462397 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:07:12.462397 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 10 23:07:12.462397 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 10 23:07:12.462397 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 10 23:07:12.462397 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 10 23:07:12.462397 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 10 23:07:12.462397 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 10 23:07:12.462397 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 10 23:07:12.462397 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 10 23:07:12.462397 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 10 23:07:12.462397 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 10 23:07:12.462397 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 10 23:07:12.462397 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 10 23:07:12.462397 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 10 23:07:12.462397 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 10 23:07:12.462397 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 10 23:07:12.462397 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 10 23:07:12.464555 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID d4003cd7-0f8e-4bc2-b91e-662e4f06cfee Aug 10 23:07:12.464555 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:07:12.464555 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:07:12.464555 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:07:12.464555 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:07:12.464555 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 10 23:07:12.464555 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 10 23:07:12.464555 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 10 23:07:12.464555 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 10 23:07:12.464555 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 10 23:07:12.464555 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 10 23:07:12.464555 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 10 23:07:12.464555 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 10 23:07:12.464555 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 10 23:07:12.464555 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 10 23:07:12.464555 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 10 23:07:12.464555 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 10 23:07:12.464555 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 10 23:07:12.464555 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 10 23:07:12.466798 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 10 23:07:12.466798 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 10 23:07:12.466798 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 10 23:07:12.466798 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 10 23:07:12.466798 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 10 23:07:12.466798 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 10 23:07:12.466798 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 10 23:07:12.466798 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 10 23:07:12.466798 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 10 23:07:12.466798 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 10 23:07:12.466798 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image d4003cd7-0f8e-4bc2-b91e-662e4f06cfee could not be found. Aug 10 23:07:12.466798 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:07:12.466798 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:07:12.466798 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:07:12.466798 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:07:12.466798 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:07:12.466798 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:07:12.466798 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:07:12.466798 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:07:12.473965 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 23:07:12.473965 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 23:07:12.473965 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:07:12.473965 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:07:12.473965 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 23:07:12.473965 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 23:07:12.473965 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Aug 10 23:07:12.473965 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Aug 10 23:07:12.473965 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 10 23:07:12.473965 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 10 23:07:12.473965 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 10 23:07:12.473965 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:07:12.473965 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:07:12.473965 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:07:12.473965 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:07:12.473965 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:07:12.473965 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:07:12.473965 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:07:12.473965 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:07:12.473965 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 10 23:07:12.473965 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:07:12.477244 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-29b109ed-2763-415b-affb-1bc9bbdfbcc1 tempest-ImagesMetadataNegativeTestJSON-1066803561 tempest-ImagesMetadataNegativeTestJSON-1066803561-project] Returning 404 to user: Image not found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:07:12.477244 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-29b109ed-2763-415b-affb-1bc9bbdfbcc1 tempest-ImagesMetadataNegativeTestJSON-1066803561 tempest-ImagesMetadataNegativeTestJSON-1066803561-project] 10.222.0.58 "POST /compute/v2.1/images/d4003cd7-0f8e-4bc2-b91e-662e4f06cfee/metadata" status: 404 len: 62 microversion: 2.1 time: 0.049945 Aug 10 23:07:12.490723 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1251/2538] 10.222.0.58 () {60 vars in 1281 bytes} [Wed Aug 10 23:07:12 2022] POST /compute/v2.1/images/d4003cd7-0f8e-4bc2-b91e-662e4f06cfee/metadata => generated 62 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 10 23:07:12.626806 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=7 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:07:12.641803 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-36a1e31e-8901-4e31-a71a-4ce9290b4661 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c6e1f505b8409ea38f8a07bad870a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6473e36eada44e6bca8dc568e5ee330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:12.651639 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-36a1e31e-8901-4e31-a71a-4ce9290b4661 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] 10.222.0.58 "GET /compute/v2.1/servers/092f973f-79e3-44bf-a2e0-f7d3bfddf42c" status: 200 len: 1802 microversion: 2.1 time: 0.291739 Aug 10 23:07:12.653348 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1288/2539] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:07:12 2022] GET /compute/v2.1/servers/092f973f-79e3-44bf-a2e0-f7d3bfddf42c => generated 1802 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:07:12.676523 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-e97e9564-d198-4085-8701-9179a022be5b tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:12.677651 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-e97e9564-d198-4085-8701-9179a022be5b tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] [instance: 092f973f-79e3-44bf-a2e0-f7d3bfddf42c] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:12.688585 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e97e9564-d198-4085-8701-9179a022be5b tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:12.692699 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e97e9564-d198-4085-8701-9179a022be5b tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:12.693348 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e97e9564-d198-4085-8701-9179a022be5b tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:12.700138 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e97e9564-d198-4085-8701-9179a022be5b tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:12.700885 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e97e9564-d198-4085-8701-9179a022be5b tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:12.701504 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e97e9564-d198-4085-8701-9179a022be5b tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:12.749075 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-e97e9564-d198-4085-8701-9179a022be5b tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] 10.222.0.58 "GET /compute/v2.1/servers/092f973f-79e3-44bf-a2e0-f7d3bfddf42c/ips" status: 200 len: 217 microversion: 2.1 time: 0.077883 Aug 10 23:07:12.756967 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1252/2540] 10.222.0.58 () {58 vars in 1248 bytes} [Wed Aug 10 23:07:12 2022] GET /compute/v2.1/servers/092f973f-79e3-44bf-a2e0-f7d3bfddf42c/ips => generated 217 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:07:12.774457 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-6d825c3c-3d00-42fe-ae96-8f0df83bcb3f tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:12.774969 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-6d825c3c-3d00-42fe-ae96-8f0df83bcb3f tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] [instance: 092f973f-79e3-44bf-a2e0-f7d3bfddf42c] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:12.787036 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6d825c3c-3d00-42fe-ae96-8f0df83bcb3f tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:12.787555 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6d825c3c-3d00-42fe-ae96-8f0df83bcb3f tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:12.788007 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6d825c3c-3d00-42fe-ae96-8f0df83bcb3f tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:12.788730 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6d825c3c-3d00-42fe-ae96-8f0df83bcb3f tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:12.790972 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6d825c3c-3d00-42fe-ae96-8f0df83bcb3f tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:12.791437 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6d825c3c-3d00-42fe-ae96-8f0df83bcb3f tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:12.866220 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-6d825c3c-3d00-42fe-ae96-8f0df83bcb3f tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] [instance: 092f973f-79e3-44bf-a2e0-f7d3bfddf42c] Going to try to terminate instance {{(pid=122633) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:07:13.001613 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-5e5ce308-21dc-4a96-807f-286f6d18abd4 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:13.002681 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-5e5ce308-21dc-4a96-807f-286f6d18abd4 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] [instance: 85c138c8-9302-453b-8dc1-8f0002d79f1a] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:13.021056 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5e5ce308-21dc-4a96-807f-286f6d18abd4 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:13.023112 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5e5ce308-21dc-4a96-807f-286f6d18abd4 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:13.023844 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5e5ce308-21dc-4a96-807f-286f6d18abd4 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:13.027734 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5e5ce308-21dc-4a96-807f-286f6d18abd4 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:13.028599 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5e5ce308-21dc-4a96-807f-286f6d18abd4 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:13.029267 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5e5ce308-21dc-4a96-807f-286f6d18abd4 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:13.031972 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-6d825c3c-3d00-42fe-ae96-8f0df83bcb3f tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] 10.222.0.58 "DELETE /compute/v2.1/servers/092f973f-79e3-44bf-a2e0-f7d3bfddf42c" status: 204 len: 0 microversion: 2.1 time: 0.263303 Aug 10 23:07:13.032752 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1289/2541] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:07:12 2022] DELETE /compute/v2.1/servers/092f973f-79e3-44bf-a2e0-f7d3bfddf42c => generated 0 bytes in 265 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:07:13.058124 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-93ed5168-66d4-4df1-94db-ee99f742c6bc tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:13.058884 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-93ed5168-66d4-4df1-94db-ee99f742c6bc tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] [instance: 092f973f-79e3-44bf-a2e0-f7d3bfddf42c] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:13.076590 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-93ed5168-66d4-4df1-94db-ee99f742c6bc tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:13.077359 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-93ed5168-66d4-4df1-94db-ee99f742c6bc tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:13.077961 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-93ed5168-66d4-4df1-94db-ee99f742c6bc tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:13.088480 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-93ed5168-66d4-4df1-94db-ee99f742c6bc tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:13.089145 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-93ed5168-66d4-4df1-94db-ee99f742c6bc tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:13.089598 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-93ed5168-66d4-4df1-94db-ee99f742c6bc tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:13.490723 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-93ed5168-66d4-4df1-94db-ee99f742c6bc tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c6e1f505b8409ea38f8a07bad870a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6473e36eada44e6bca8dc568e5ee330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:13.505578 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-93ed5168-66d4-4df1-94db-ee99f742c6bc tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] 10.222.0.58 "GET /compute/v2.1/servers/092f973f-79e3-44bf-a2e0-f7d3bfddf42c" status: 200 len: 1808 microversion: 2.1 time: 0.467765 Aug 10 23:07:13.519009 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1290/2542] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:07:13 2022] GET /compute/v2.1/servers/092f973f-79e3-44bf-a2e0-f7d3bfddf42c => generated 1808 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:07:13.519009 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-5758f0c4-a48e-401f-a78e-f94af5fb846d tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:13.519009 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-5758f0c4-a48e-401f-a78e-f94af5fb846d tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] [instance: 8385348f-0651-486d-9b4a-2c884933edb1] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:13.519507 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5758f0c4-a48e-401f-a78e-f94af5fb846d tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:13.519711 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5758f0c4-a48e-401f-a78e-f94af5fb846d tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:13.520435 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5758f0c4-a48e-401f-a78e-f94af5fb846d tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:13.521397 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5758f0c4-a48e-401f-a78e-f94af5fb846d tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:13.522065 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5758f0c4-a48e-401f-a78e-f94af5fb846d tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:13.523017 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5758f0c4-a48e-401f-a78e-f94af5fb846d tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:13.702995 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-5758f0c4-a48e-401f-a78e-f94af5fb846d tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d79bf59dabe4c02aa5e27bf3b0bc1ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9af75fc4bbc4b63ae83b5f900f1aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:13.713499 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-5758f0c4-a48e-401f-a78e-f94af5fb846d tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d79bf59dabe4c02aa5e27bf3b0bc1ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9af75fc4bbc4b63ae83b5f900f1aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:13.721745 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-5758f0c4-a48e-401f-a78e-f94af5fb846d tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d79bf59dabe4c02aa5e27bf3b0bc1ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9af75fc4bbc4b63ae83b5f900f1aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:13.735561 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-5758f0c4-a48e-401f-a78e-f94af5fb846d tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] 10.222.0.58 "GET /compute/v2.1/servers/8385348f-0651-486d-9b4a-2c884933edb1" status: 200 len: 1447 microversion: 2.75 time: 0.227766 Aug 10 23:07:13.736942 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1291/2543] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:07:13 2022] GET /compute/v2.1/servers/8385348f-0651-486d-9b4a-2c884933edb1 => generated 1447 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:07:13.746055 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-5e5ce308-21dc-4a96-807f-286f6d18abd4 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8899e278c9453fba0ab05c69b0b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46ac8b84bd649fa88897068dbfa5ce6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:13.758904 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-3cc00fea-1e37-4440-b31d-736c2349f02c tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:13.760301 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-3cc00fea-1e37-4440-b31d-736c2349f02c tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] [instance: ba82fd6a-d3bf-4fd3-83e0-09103eafca25] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:13.762298 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-5e5ce308-21dc-4a96-807f-286f6d18abd4 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] 10.222.0.58 "GET /compute/v2.1/servers/85c138c8-9302-453b-8dc1-8f0002d79f1a" status: 200 len: 1515 microversion: 2.1 time: 0.764704 Aug 10 23:07:13.771309 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1253/2544] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:07:12 2022] GET /compute/v2.1/servers/85c138c8-9302-453b-8dc1-8f0002d79f1a => generated 1515 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:07:13.779682 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3cc00fea-1e37-4440-b31d-736c2349f02c tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:13.780188 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3cc00fea-1e37-4440-b31d-736c2349f02c tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:13.780629 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3cc00fea-1e37-4440-b31d-736c2349f02c tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:13.781384 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3cc00fea-1e37-4440-b31d-736c2349f02c tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:13.781839 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3cc00fea-1e37-4440-b31d-736c2349f02c tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:13.782265 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3cc00fea-1e37-4440-b31d-736c2349f02c tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:14.387818 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-3cc00fea-1e37-4440-b31d-736c2349f02c tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab18f771541437ca1bda46aec45dda5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4e0ba9683c4e15932b9554d698034e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:14.399968 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-3cc00fea-1e37-4440-b31d-736c2349f02c tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] 10.222.0.58 "GET /compute/v2.1/servers/ba82fd6a-d3bf-4fd3-83e0-09103eafca25" status: 200 len: 1325 microversion: 2.1 time: 0.661199 Aug 10 23:07:14.400602 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1292/2545] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:07:13 2022] GET /compute/v2.1/servers/ba82fd6a-d3bf-4fd3-83e0-09103eafca25 => generated 1325 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:07:14.535823 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-18b81fd6-9fca-490f-aeb4-3b221447bc9d tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:14.536831 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-18b81fd6-9fca-490f-aeb4-3b221447bc9d tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] [instance: 092f973f-79e3-44bf-a2e0-f7d3bfddf42c] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:14.554748 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-18b81fd6-9fca-490f-aeb4-3b221447bc9d tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:14.558683 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-18b81fd6-9fca-490f-aeb4-3b221447bc9d tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:14.560683 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-18b81fd6-9fca-490f-aeb4-3b221447bc9d tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:14.564497 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-18b81fd6-9fca-490f-aeb4-3b221447bc9d tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:14.565284 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-18b81fd6-9fca-490f-aeb4-3b221447bc9d tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:14.565724 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-18b81fd6-9fca-490f-aeb4-3b221447bc9d tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:14.875402 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-8c5d10b6-8f55-4f27-a172-500e8ad8b715 tempest-FloatingIPsNegativeTestJSON-2027765437 tempest-FloatingIPsNegativeTestJSON-2027765437-project] Calling method '.version_select at 0x7f847d1db3a0>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:15.016771 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-8c5d10b6-8f55-4f27-a172-500e8ad8b715 tempest-FloatingIPsNegativeTestJSON-2027765437 tempest-FloatingIPsNegativeTestJSON-2027765437-project] 10.222.0.58 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.297278 Aug 10 23:07:15.017701 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1293/2546] 10.222.0.58 () {58 vars in 1149 bytes} [Wed Aug 10 23:07:14 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 10 23:07:15.022532 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-34b6a962-c0ad-40df-b891-43afbce3bafd tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:15.023292 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-34b6a962-c0ad-40df-b891-43afbce3bafd tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] [instance: 8385348f-0651-486d-9b4a-2c884933edb1] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:15.035786 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-34b6a962-c0ad-40df-b891-43afbce3bafd tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:15.036562 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-34b6a962-c0ad-40df-b891-43afbce3bafd tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:15.037080 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-34b6a962-c0ad-40df-b891-43afbce3bafd tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:15.043291 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-34b6a962-c0ad-40df-b891-43afbce3bafd tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:15.049803 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-34b6a962-c0ad-40df-b891-43afbce3bafd tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:15.050651 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-34b6a962-c0ad-40df-b891-43afbce3bafd tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:15.143028 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-34b6a962-c0ad-40df-b891-43afbce3bafd tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d79bf59dabe4c02aa5e27bf3b0bc1ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9af75fc4bbc4b63ae83b5f900f1aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:15.153283 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-34b6a962-c0ad-40df-b891-43afbce3bafd tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d79bf59dabe4c02aa5e27bf3b0bc1ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9af75fc4bbc4b63ae83b5f900f1aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:15.154962 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-34b6a962-c0ad-40df-b891-43afbce3bafd tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d79bf59dabe4c02aa5e27bf3b0bc1ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9af75fc4bbc4b63ae83b5f900f1aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:15.161872 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-34b6a962-c0ad-40df-b891-43afbce3bafd tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] 10.222.0.58 "GET /compute/v2.1/servers/8385348f-0651-486d-9b4a-2c884933edb1" status: 200 len: 1447 microversion: 2.75 time: 0.141438 Aug 10 23:07:15.162468 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1294/2547] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:07:15 2022] GET /compute/v2.1/servers/8385348f-0651-486d-9b4a-2c884933edb1 => generated 1447 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:07:15.168626 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-76469feb-71cf-4ca9-a5d8-59df844f0832 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:15.169239 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-76469feb-71cf-4ca9-a5d8-59df844f0832 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] [instance: 85c138c8-9302-453b-8dc1-8f0002d79f1a] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:15.175663 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-76469feb-71cf-4ca9-a5d8-59df844f0832 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:15.176150 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-76469feb-71cf-4ca9-a5d8-59df844f0832 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:15.176649 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-76469feb-71cf-4ca9-a5d8-59df844f0832 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:15.177351 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-76469feb-71cf-4ca9-a5d8-59df844f0832 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:15.178036 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-76469feb-71cf-4ca9-a5d8-59df844f0832 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:15.178615 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-76469feb-71cf-4ca9-a5d8-59df844f0832 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:15.200125 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-18b81fd6-9fca-490f-aeb4-3b221447bc9d tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c6e1f505b8409ea38f8a07bad870a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6473e36eada44e6bca8dc568e5ee330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:15.220380 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-18b81fd6-9fca-490f-aeb4-3b221447bc9d tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] 10.222.0.58 "GET /compute/v2.1/servers/092f973f-79e3-44bf-a2e0-f7d3bfddf42c" status: 200 len: 1808 microversion: 2.1 time: 0.688783 Aug 10 23:07:15.221567 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1254/2548] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:07:14 2022] GET /compute/v2.1/servers/092f973f-79e3-44bf-a2e0-f7d3bfddf42c => generated 1808 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:07:15.238050 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-5c52ac26-08da-4f4c-9f57-d16c7f7ca86f tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:07:15.246139 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5c52ac26-08da-4f4c-9f57-d16c7f7ca86f tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:15.246869 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5c52ac26-08da-4f4c-9f57-d16c7f7ca86f tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:15.247505 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5c52ac26-08da-4f4c-9f57-d16c7f7ca86f tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:15.303084 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-5c52ac26-08da-4f4c-9f57-d16c7f7ca86f tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] [instance: 45beadf1-a6da-49ab-9098-6b681b5184c9] Going to try to stop instance {{(pid=122632) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 10 23:07:15.390598 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-5c52ac26-08da-4f4c-9f57-d16c7f7ca86f tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] 10.222.0.58 "POST /compute/v2.1/servers/45beadf1-a6da-49ab-9098-6b681b5184c9/action" status: 202 len: 0 microversion: 2.1 time: 0.161653 Aug 10 23:07:15.391263 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1255/2549] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:07:15 2022] POST /compute/v2.1/servers/45beadf1-a6da-49ab-9098-6b681b5184c9/action => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:07:15.406477 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-5be722fc-caa2-44d6-8bc5-3b126ad162d7 tempest-FloatingIPsNegativeTestJSON-2027765437 tempest-FloatingIPsNegativeTestJSON-2027765437-project] Action: 'create', calling method: .version_select at 0x7f847d798ca0>, body: {"pool": "non_exist_pool"} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:07:15.480231 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-76469feb-71cf-4ca9-a5d8-59df844f0832 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8899e278c9453fba0ab05c69b0b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46ac8b84bd649fa88897068dbfa5ce6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:15.485219 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-5be722fc-caa2-44d6-8bc5-3b126ad162d7 tempest-FloatingIPsNegativeTestJSON-2027765437 tempest-FloatingIPsNegativeTestJSON-2027765437-project] HTTP exception thrown: Floating IP pool not found. Aug 10 23:07:15.487150 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-5be722fc-caa2-44d6-8bc5-3b126ad162d7 tempest-FloatingIPsNegativeTestJSON-2027765437 tempest-FloatingIPsNegativeTestJSON-2027765437-project] Request method failure captured: Aug 10 23:07:15.487150 n-d-850468-14 devstack@n-api.service[122632]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Aug 10 23:07:15.487150 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:07:15.487150 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:07:15.487150 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:07:15.487150 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 26 Aug 10 23:07:15.487150 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:07:15.487150 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:07:15.487150 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:07:15.487150 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:07:15.487150 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9DoixZE2VlC2DRV9hYphoQacJfqqZN_9zglfbFzv4DWKvLOgDaWtc326bw3CcYsi4nkJtaLKEFSaTrsrTP3ybWpNFDtSFbHq9M3fH9AkRVFI992LWT_PazldinJbrBDy3CN-n9u-4uvqHlZwS9YFKezv4fK2vGJTwW3K6EWib9YqyDc Aug 10 23:07:15.487150 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:07:15.487150 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:07:15.487150 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:07:15.487150 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:07:15.487150 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:07:15.487150 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:07:15.487150 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 5c81d758ed0c48cf83904ff1d4cb4c52 Aug 10 23:07:15.487150 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-2027765437 Aug 10 23:07:15.487150 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:07:15.487150 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:07:15.488708 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5c81d758ed0c48cf83904ff1d4cb4c52"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5c81d758ed0c48cf83904ff1d4cb4c52"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/5c81d758ed0c48cf83904ff1d4cb4c52"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_5c81d758ed0c48cf83904ff1d4cb4c52", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:07:15.488708 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-2027765437 Aug 10 23:07:15.488708 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 5c81d758ed0c48cf83904ff1d4cb4c52 Aug 10 23:07:15.488708 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-2027765437 Aug 10 23:07:15.488708 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-FloatingIPsNegativeTestJSON-2027765437-project Aug 10 23:07:15.488708 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:07:15.488708 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:07:15.488708 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: e6e1e5bc5b774ac8be6363d458dc5373 Aug 10 23:07:15.488708 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-2027765437-project Aug 10 23:07:15.488708 n-d-850468-14 devstack@n-api.service[122632]: Aug 10 23:07:15.488708 n-d-850468-14 devstack@n-api.service[122632]: {"pool": "non_exist_pool"} Aug 10 23:07:15.488708 n-d-850468-14 devstack@n-api.service[122632]: method: Aug 10 23:07:15.488708 n-d-850468-14 devstack@n-api.service[122632]: exception: Floating IP pool not found. Aug 10 23:07:15.488708 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'body': {'pool': 'non_exist_pool'}} Aug 10 23:07:15.488708 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:07:15.489777 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:07:15.489777 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Aug 10 23:07:15.489777 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Aug 10 23:07:15.489777 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2975, in allocate_floating_ip Aug 10 23:07:15.489777 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Aug 10 23:07:15.489777 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2965, in _get_floating_ip_pool_id_by_name_or_id Aug 10 23:07:15.489777 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Aug 10 23:07:15.489777 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Aug 10 23:07:15.489777 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:07:15.489777 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:07:15.489777 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:07:15.489777 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:07:15.489777 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:07:15.489777 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:07:15.489777 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:07:15.489777 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:07:15.489777 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 23:07:15.489777 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 23:07:15.489777 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:07:15.489777 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:07:15.491109 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Aug 10 23:07:15.491109 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:07:15.491109 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Aug 10 23:07:15.491109 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:07:15.491109 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:07:15.491109 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:07:15.491109 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:07:15.491109 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:07:15.491109 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:07:15.491109 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:07:15.491109 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:07:15.491109 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Aug 10 23:07:15.491109 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:07:15.491109 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-5be722fc-caa2-44d6-8bc5-3b126ad162d7 tempest-FloatingIPsNegativeTestJSON-2027765437 tempest-FloatingIPsNegativeTestJSON-2027765437-project] Returning 404 to user: Floating IP pool not found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:07:15.491109 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-5be722fc-caa2-44d6-8bc5-3b126ad162d7 tempest-FloatingIPsNegativeTestJSON-2027765437 tempest-FloatingIPsNegativeTestJSON-2027765437-project] 10.222.0.58 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.093501 Aug 10 23:07:15.492159 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1256/2550] 10.222.0.58 () {60 vars in 1170 bytes} [Wed Aug 10 23:07:15 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 10 23:07:15.503761 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-426a81c7-1fe1-42a2-b8e9-becb7fa6d66e tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:15.505622 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-426a81c7-1fe1-42a2-b8e9-becb7fa6d66e tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] [instance: 45beadf1-a6da-49ab-9098-6b681b5184c9] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:15.506738 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-76469feb-71cf-4ca9-a5d8-59df844f0832 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] 10.222.0.58 "GET /compute/v2.1/servers/85c138c8-9302-453b-8dc1-8f0002d79f1a" status: 200 len: 1515 microversion: 2.1 time: 0.341929 Aug 10 23:07:15.507678 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1295/2551] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:07:15 2022] GET /compute/v2.1/servers/85c138c8-9302-453b-8dc1-8f0002d79f1a => generated 1515 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:07:15.536916 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-df013b12-3c3e-4a2f-a5d5-427fe9a55576 tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:15.537535 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-df013b12-3c3e-4a2f-a5d5-427fe9a55576 tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] [instance: ba82fd6a-d3bf-4fd3-83e0-09103eafca25] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:15.548314 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-426a81c7-1fe1-42a2-b8e9-becb7fa6d66e tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:15.548913 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-426a81c7-1fe1-42a2-b8e9-becb7fa6d66e tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:15.556755 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-426a81c7-1fe1-42a2-b8e9-becb7fa6d66e tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:15.558340 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-426a81c7-1fe1-42a2-b8e9-becb7fa6d66e tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:15.560913 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-df013b12-3c3e-4a2f-a5d5-427fe9a55576 tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:15.564280 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-426a81c7-1fe1-42a2-b8e9-becb7fa6d66e tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:15.565207 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-426a81c7-1fe1-42a2-b8e9-becb7fa6d66e tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:15.565923 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-df013b12-3c3e-4a2f-a5d5-427fe9a55576 tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:15.570268 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-df013b12-3c3e-4a2f-a5d5-427fe9a55576 tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:15.572423 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-df013b12-3c3e-4a2f-a5d5-427fe9a55576 tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:15.573166 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-df013b12-3c3e-4a2f-a5d5-427fe9a55576 tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:15.573858 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-df013b12-3c3e-4a2f-a5d5-427fe9a55576 tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:15.822369 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-df013b12-3c3e-4a2f-a5d5-427fe9a55576 tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab18f771541437ca1bda46aec45dda5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4e0ba9683c4e15932b9554d698034e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:15.833352 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-df013b12-3c3e-4a2f-a5d5-427fe9a55576 tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] 10.222.0.58 "GET /compute/v2.1/servers/ba82fd6a-d3bf-4fd3-83e0-09103eafca25" status: 200 len: 1325 microversion: 2.1 time: 0.323241 Aug 10 23:07:15.849423 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1296/2552] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:07:15 2022] GET /compute/v2.1/servers/ba82fd6a-d3bf-4fd3-83e0-09103eafca25 => generated 1325 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:07:15.855904 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-e594c27c-9e85-4a4e-b0d3-fe24e20af0ae tempest-FloatingIPsNegativeTestJSON-2027765437 tempest-FloatingIPsNegativeTestJSON-2027765437-project] Calling method '.version_select at 0x7f847d0fcf70>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:15.968168 n-d-850468-14 devstack@n-api.service[122633]: DEBUG neutronclient.v2_0.client [None req-e594c27c-9e85-4a4e-b0d3-fe24e20af0ae tempest-FloatingIPsNegativeTestJSON-2027765437 tempest-FloatingIPsNegativeTestJSON-2027765437-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 68aabbd2-ea95-4d14-9b01-b4c509ef5216 could not be found", "detail": ""}} {{(pid=122633) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 10 23:07:15.969417 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-e594c27c-9e85-4a4e-b0d3-fe24e20af0ae tempest-FloatingIPsNegativeTestJSON-2027765437 tempest-FloatingIPsNegativeTestJSON-2027765437-project] HTTP exception thrown: Floating IP not found for ID 68aabbd2-ea95-4d14-9b01-b4c509ef5216 Aug 10 23:07:15.974684 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-e594c27c-9e85-4a4e-b0d3-fe24e20af0ae tempest-FloatingIPsNegativeTestJSON-2027765437 tempest-FloatingIPsNegativeTestJSON-2027765437-project] Request method failure captured: Aug 10 23:07:15.974684 n-d-850468-14 devstack@n-api.service[122633]: request: DELETE /compute/v2.1/os-floating-ips/68aabbd2-ea95-4d14-9b01-b4c509ef5216 HTTP/1.1 Aug 10 23:07:15.974684 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:07:15.974684 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:07:15.974684 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:07:15.974684 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:07:15.974684 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:07:15.974684 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:07:15.974684 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:07:15.974684 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:07:15.974684 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9DoixZE2VlC2DRV9hYphoQacJfqqZN_9zglfbFzv4DWKvLOgDaWtc326bw3CcYsi4nkJtaLKEFSaTrsrTP3ybWpNFDtSFbHq9M3fH9AkRVFI992LWT_PazldinJbrBDy3CN-n9u-4uvqHlZwS9YFKezv4fK2vGJTwW3K6EWib9YqyDc Aug 10 23:07:15.974684 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:07:15.974684 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:07:15.974684 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:07:15.974684 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:07:15.974684 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:07:15.974684 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:07:15.974684 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 5c81d758ed0c48cf83904ff1d4cb4c52 Aug 10 23:07:15.974684 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-2027765437 Aug 10 23:07:15.974684 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:07:15.974684 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:07:15.976632 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5c81d758ed0c48cf83904ff1d4cb4c52"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5c81d758ed0c48cf83904ff1d4cb4c52"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/5c81d758ed0c48cf83904ff1d4cb4c52"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_5c81d758ed0c48cf83904ff1d4cb4c52", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:07:15.976632 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-2027765437 Aug 10 23:07:15.976632 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 5c81d758ed0c48cf83904ff1d4cb4c52 Aug 10 23:07:15.976632 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-2027765437 Aug 10 23:07:15.976632 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-FloatingIPsNegativeTestJSON-2027765437-project Aug 10 23:07:15.976632 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:07:15.976632 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:07:15.976632 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: e6e1e5bc5b774ac8be6363d458dc5373 Aug 10 23:07:15.976632 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-2027765437-project Aug 10 23:07:15.976632 n-d-850468-14 devstack@n-api.service[122633]: method: Aug 10 23:07:15.976632 n-d-850468-14 devstack@n-api.service[122633]: exception: Floating IP not found for ID 68aabbd2-ea95-4d14-9b01-b4c509ef5216 Aug 10 23:07:15.976632 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': '68aabbd2-ea95-4d14-9b01-b4c509ef5216'} Aug 10 23:07:15.976632 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:07:15.977550 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:07:15.977550 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Aug 10 23:07:15.977550 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Aug 10 23:07:15.977550 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 23:07:15.977550 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 23:07:15.977550 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Aug 10 23:07:15.977550 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Aug 10 23:07:15.977550 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 23:07:15.977550 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 23:07:15.977550 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 23:07:15.977550 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 23:07:15.977550 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 23:07:15.977550 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 23:07:15.977550 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 23:07:15.977550 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 23:07:15.977550 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 23:07:15.977550 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 23:07:15.977550 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 10 23:07:15.977550 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 10 23:07:15.978980 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 23:07:15.978980 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 23:07:15.978980 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 10 23:07:15.978980 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 10 23:07:15.978980 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 10 23:07:15.978980 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 10 23:07:15.978980 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 68aabbd2-ea95-4d14-9b01-b4c509ef5216 could not be found Aug 10 23:07:15.978980 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2375e718-9f31-4446-bdd3-b0292fc390ae'] Aug 10 23:07:15.978980 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:07:15.978980 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:07:15.978980 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:07:15.978980 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:07:15.978980 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Aug 10 23:07:15.978980 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Aug 10 23:07:15.978980 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Aug 10 23:07:15.978980 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Aug 10 23:07:15.978980 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 68aabbd2-ea95-4d14-9b01-b4c509ef5216. Aug 10 23:07:15.978980 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:07:15.978980 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:07:15.978980 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:07:15.980341 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:07:15.980341 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:07:15.980341 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:07:15.980341 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:07:15.980341 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:07:15.980341 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 23:07:15.980341 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 23:07:15.980341 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:07:15.980341 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:07:15.980341 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Aug 10 23:07:15.980341 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 10 23:07:15.980341 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 68aabbd2-ea95-4d14-9b01-b4c509ef5216 Aug 10 23:07:15.980341 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:07:15.980341 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:07:15.980341 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:07:15.980341 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:07:15.980341 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:07:15.980341 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:07:15.980341 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:07:15.980341 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:07:15.981579 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 68aabbd2-ea95-4d14-9b01-b4c509ef5216 Aug 10 23:07:15.981579 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:07:15.981579 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-e594c27c-9e85-4a4e-b0d3-fe24e20af0ae tempest-FloatingIPsNegativeTestJSON-2027765437 tempest-FloatingIPsNegativeTestJSON-2027765437-project] Returning 404 to user: Floating IP not found for ID 68aabbd2-ea95-4d14-9b01-b4c509ef5216 {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:07:15.983066 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-e594c27c-9e85-4a4e-b0d3-fe24e20af0ae tempest-FloatingIPsNegativeTestJSON-2027765437 tempest-FloatingIPsNegativeTestJSON-2027765437-project] 10.222.0.58 "DELETE /compute/v2.1/os-floating-ips/68aabbd2-ea95-4d14-9b01-b4c509ef5216" status: 404 len: 111 microversion: 2.1 time: 0.131344 Aug 10 23:07:15.999256 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1297/2553] 10.222.0.58 () {58 vars in 1263 bytes} [Wed Aug 10 23:07:15 2022] DELETE /compute/v2.1/os-floating-ips/68aabbd2-ea95-4d14-9b01-b4c509ef5216 => generated 111 bytes in 149 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:07:16.020213 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-82393a90-55f6-4868-ab1d-c6e4ea5bc341 req-0763b195-bd91-43ce-aef0-99b59322af9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "092f973f-79e3-44bf-a2e0-f7d3bfddf42c", "name": "network-vif-deleted", "tag": "a66e8adc-f741-49ae-b190-468d5764b853"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:07:16.054751 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-82393a90-55f6-4868-ab1d-c6e4ea5bc341 req-0763b195-bd91-43ce-aef0-99b59322af9f service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:16.056718 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-82393a90-55f6-4868-ab1d-c6e4ea5bc341 req-0763b195-bd91-43ce-aef0-99b59322af9f service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:16.059614 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-82393a90-55f6-4868-ab1d-c6e4ea5bc341 req-0763b195-bd91-43ce-aef0-99b59322af9f service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:16.093079 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-82393a90-55f6-4868-ab1d-c6e4ea5bc341 req-0763b195-bd91-43ce-aef0-99b59322af9f service nova] Creating event network-vif-deleted:a66e8adc-f741-49ae-b190-468d5764b853 for instance 092f973f-79e3-44bf-a2e0-f7d3bfddf42c on n-h1-850468-14 Aug 10 23:07:16.100177 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-82393a90-55f6-4868-ab1d-c6e4ea5bc341 req-0763b195-bd91-43ce-aef0-99b59322af9f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085968 Aug 10 23:07:16.101368 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1298/2554] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:07:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 23:07:16.192496 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-3ca23cf7-47eb-425a-9f46-97eb05fd5210 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:16.193543 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-3ca23cf7-47eb-425a-9f46-97eb05fd5210 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] [instance: 8385348f-0651-486d-9b4a-2c884933edb1] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:16.201261 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3ca23cf7-47eb-425a-9f46-97eb05fd5210 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:16.202163 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3ca23cf7-47eb-425a-9f46-97eb05fd5210 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:16.202163 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3ca23cf7-47eb-425a-9f46-97eb05fd5210 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:16.202951 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3ca23cf7-47eb-425a-9f46-97eb05fd5210 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:16.215456 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3ca23cf7-47eb-425a-9f46-97eb05fd5210 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:16.217123 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3ca23cf7-47eb-425a-9f46-97eb05fd5210 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:16.380602 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-426a81c7-1fe1-42a2-b8e9-becb7fa6d66e tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1986185dc9b4df4affcc421365462f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597863bfebdc481188f1f30095da5396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:16.403545 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-426a81c7-1fe1-42a2-b8e9-becb7fa6d66e tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] 10.222.0.58 "GET /compute/v2.1/servers/45beadf1-a6da-49ab-9098-6b681b5184c9" status: 200 len: 1678 microversion: 2.1 time: 0.913244 Aug 10 23:07:16.407072 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1257/2555] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:07:15 2022] GET /compute/v2.1/servers/45beadf1-a6da-49ab-9098-6b681b5184c9 => generated 1678 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:07:16.421251 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-7e292d4f-a085-4a41-84c2-38b4fd721d0b tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:16.422279 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-7e292d4f-a085-4a41-84c2-38b4fd721d0b tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] [instance: 092f973f-79e3-44bf-a2e0-f7d3bfddf42c] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:16.443085 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7e292d4f-a085-4a41-84c2-38b4fd721d0b tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:16.446394 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7e292d4f-a085-4a41-84c2-38b4fd721d0b tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:16.449602 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7e292d4f-a085-4a41-84c2-38b4fd721d0b tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:16.451215 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7e292d4f-a085-4a41-84c2-38b4fd721d0b tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:16.453201 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7e292d4f-a085-4a41-84c2-38b4fd721d0b tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:16.455195 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7e292d4f-a085-4a41-84c2-38b4fd721d0b tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:16.893245 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-7e292d4f-a085-4a41-84c2-38b4fd721d0b tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c6e1f505b8409ea38f8a07bad870a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6473e36eada44e6bca8dc568e5ee330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:16.903398 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-3ca23cf7-47eb-425a-9f46-97eb05fd5210 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d79bf59dabe4c02aa5e27bf3b0bc1ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9af75fc4bbc4b63ae83b5f900f1aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:16.905997 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-7e292d4f-a085-4a41-84c2-38b4fd721d0b tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] 10.222.0.58 "GET /compute/v2.1/servers/092f973f-79e3-44bf-a2e0-f7d3bfddf42c" status: 200 len: 1672 microversion: 2.1 time: 0.497099 Aug 10 23:07:16.919832 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-3ca23cf7-47eb-425a-9f46-97eb05fd5210 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d79bf59dabe4c02aa5e27bf3b0bc1ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9af75fc4bbc4b63ae83b5f900f1aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:16.920043 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1258/2556] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:07:16 2022] GET /compute/v2.1/servers/092f973f-79e3-44bf-a2e0-f7d3bfddf42c => generated 1672 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:07:16.921779 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-3ca23cf7-47eb-425a-9f46-97eb05fd5210 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d79bf59dabe4c02aa5e27bf3b0bc1ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9af75fc4bbc4b63ae83b5f900f1aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:16.930122 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-3ca23cf7-47eb-425a-9f46-97eb05fd5210 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] 10.222.0.58 "GET /compute/v2.1/servers/8385348f-0651-486d-9b4a-2c884933edb1" status: 200 len: 1447 microversion: 2.75 time: 0.743067 Aug 10 23:07:16.932970 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1299/2557] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:07:16 2022] GET /compute/v2.1/servers/8385348f-0651-486d-9b4a-2c884933edb1 => generated 1447 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 23:07:16.938058 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-cf627d16-9ed0-4497-9f7c-8a2c1fee7278 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:16.938910 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-cf627d16-9ed0-4497-9f7c-8a2c1fee7278 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] [instance: 85c138c8-9302-453b-8dc1-8f0002d79f1a] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:16.945560 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-2a61d9a6-90ed-4df5-a702-08bc440d2a9f req-375cd79a-0bd4-426b-8e49-20ffaed58ddb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba82fd6a-d3bf-4fd3-83e0-09103eafca25", "name": "network-vif-plugged", "status": "completed", "tag": "61f2915c-3e11-4b73-bce4-1886d764dd44"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:07:16.948362 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cf627d16-9ed0-4497-9f7c-8a2c1fee7278 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:16.949099 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cf627d16-9ed0-4497-9f7c-8a2c1fee7278 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:16.959349 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cf627d16-9ed0-4497-9f7c-8a2c1fee7278 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:16.960261 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cf627d16-9ed0-4497-9f7c-8a2c1fee7278 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:16.960749 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cf627d16-9ed0-4497-9f7c-8a2c1fee7278 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:16.961194 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cf627d16-9ed0-4497-9f7c-8a2c1fee7278 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:16.978283 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-2a61d9a6-90ed-4df5-a702-08bc440d2a9f req-375cd79a-0bd4-426b-8e49-20ffaed58ddb service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:16.979339 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-2a61d9a6-90ed-4df5-a702-08bc440d2a9f req-375cd79a-0bd4-426b-8e49-20ffaed58ddb service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:16.979952 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-2a61d9a6-90ed-4df5-a702-08bc440d2a9f req-375cd79a-0bd4-426b-8e49-20ffaed58ddb service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:16.999579 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-2a61d9a6-90ed-4df5-a702-08bc440d2a9f req-375cd79a-0bd4-426b-8e49-20ffaed58ddb service nova] Creating event network-vif-plugged:61f2915c-3e11-4b73-bce4-1886d764dd44 for instance ba82fd6a-d3bf-4fd3-83e0-09103eafca25 on n-h2-850468-14 Aug 10 23:07:17.005258 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-2a61d9a6-90ed-4df5-a702-08bc440d2a9f req-375cd79a-0bd4-426b-8e49-20ffaed58ddb service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083909 Aug 10 23:07:17.011135 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1259/2558] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:07:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:07:17.017676 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-4824f321-4297-4915-8362-fc47b0686f72 tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:17.018658 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-4824f321-4297-4915-8362-fc47b0686f72 tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] [instance: ba82fd6a-d3bf-4fd3-83e0-09103eafca25] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:17.027273 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4824f321-4297-4915-8362-fc47b0686f72 tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:17.028155 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4824f321-4297-4915-8362-fc47b0686f72 tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:17.028815 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4824f321-4297-4915-8362-fc47b0686f72 tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:17.029741 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4824f321-4297-4915-8362-fc47b0686f72 tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:17.030449 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4824f321-4297-4915-8362-fc47b0686f72 tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:17.031133 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4824f321-4297-4915-8362-fc47b0686f72 tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:17.305318 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-4824f321-4297-4915-8362-fc47b0686f72 tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab18f771541437ca1bda46aec45dda5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4e0ba9683c4e15932b9554d698034e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:17.340136 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-4824f321-4297-4915-8362-fc47b0686f72 tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] 10.222.0.58 "GET /compute/v2.1/servers/ba82fd6a-d3bf-4fd3-83e0-09103eafca25" status: 200 len: 1325 microversion: 2.1 time: 0.326885 Aug 10 23:07:17.351015 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1260/2559] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:07:17 2022] GET /compute/v2.1/servers/ba82fd6a-d3bf-4fd3-83e0-09103eafca25 => generated 1325 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:07:17.386479 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-cf627d16-9ed0-4497-9f7c-8a2c1fee7278 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8899e278c9453fba0ab05c69b0b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46ac8b84bd649fa88897068dbfa5ce6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:17.399272 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-cf627d16-9ed0-4497-9f7c-8a2c1fee7278 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] 10.222.0.58 "GET /compute/v2.1/servers/85c138c8-9302-453b-8dc1-8f0002d79f1a" status: 200 len: 1515 microversion: 2.1 time: 0.464977 Aug 10 23:07:17.400019 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1300/2560] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:07:16 2022] GET /compute/v2.1/servers/85c138c8-9302-453b-8dc1-8f0002d79f1a => generated 1515 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:07:17.431559 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-cd728097-56d9-41dd-bf87-669382de076f tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:17.432396 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-cd728097-56d9-41dd-bf87-669382de076f tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] [instance: 45beadf1-a6da-49ab-9098-6b681b5184c9] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:17.445709 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cd728097-56d9-41dd-bf87-669382de076f tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:17.447556 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cd728097-56d9-41dd-bf87-669382de076f tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:17.449313 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cd728097-56d9-41dd-bf87-669382de076f tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:17.450111 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cd728097-56d9-41dd-bf87-669382de076f tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:17.450652 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cd728097-56d9-41dd-bf87-669382de076f tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:17.451423 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cd728097-56d9-41dd-bf87-669382de076f tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:17.625538 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-e243dacb-29ac-4451-878c-05f0c97ebb65 tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-452330503", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:07:17.698157 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.network.neutron [None req-e243dacb-29ac-4451-878c-05f0c97ebb65 tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] validate_networks() for None {{(pid=122632) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 23:07:17.877287 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-cd728097-56d9-41dd-bf87-669382de076f tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1986185dc9b4df4affcc421365462f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597863bfebdc481188f1f30095da5396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:17.886206 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-cd728097-56d9-41dd-bf87-669382de076f tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] 10.222.0.58 "GET /compute/v2.1/servers/45beadf1-a6da-49ab-9098-6b681b5184c9" status: 200 len: 1678 microversion: 2.1 time: 0.459117 Aug 10 23:07:17.890440 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1301/2561] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:07:17 2022] GET /compute/v2.1/servers/45beadf1-a6da-49ab-9098-6b681b5184c9 => generated 1678 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:07:17.936601 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-40c97c0c-2fb2-4bab-a3d5-9d3789495961 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:17.939821 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-40c97c0c-2fb2-4bab-a3d5-9d3789495961 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] [instance: 092f973f-79e3-44bf-a2e0-f7d3bfddf42c] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:17.971761 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-40c97c0c-2fb2-4bab-a3d5-9d3789495961 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:17.973072 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-40c97c0c-2fb2-4bab-a3d5-9d3789495961 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:17.974927 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-40c97c0c-2fb2-4bab-a3d5-9d3789495961 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:17.977233 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-40c97c0c-2fb2-4bab-a3d5-9d3789495961 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:17.982928 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-40c97c0c-2fb2-4bab-a3d5-9d3789495961 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:17.983721 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-40c97c0c-2fb2-4bab-a3d5-9d3789495961 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:18.020681 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-e243dacb-29ac-4451-878c-05f0c97ebb65 tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Flavor limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:07:18.021250 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-e243dacb-29ac-4451-878c-05f0c97ebb65 tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Image limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:07:18.021732 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-e243dacb-29ac-4451-878c-05f0c97ebb65 tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Flavor pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:07:18.022307 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-e243dacb-29ac-4451-878c-05f0c97ebb65 tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Image pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:07:18.022756 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-e243dacb-29ac-4451-878c-05f0c97ebb65 tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:07:18.038511 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e243dacb-29ac-4451-878c-05f0c97ebb65 tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:18.039033 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e243dacb-29ac-4451-878c-05f0c97ebb65 tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:18.039476 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e243dacb-29ac-4451-878c-05f0c97ebb65 tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:18.040272 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e243dacb-29ac-4451-878c-05f0c97ebb65 tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:18.040737 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e243dacb-29ac-4451-878c-05f0c97ebb65 tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:18.041268 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e243dacb-29ac-4451-878c-05f0c97ebb65 tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:18.103012 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-e243dacb-29ac-4451-878c-05f0c97ebb65 tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Getting quotas for project de5881784cbc4d669ad7fa40880ed9c0. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:07:18.119440 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-e243dacb-29ac-4451-878c-05f0c97ebb65 tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Getting quotas for user 10d235607afb4ba59ed6ac2908c6dc33 and project de5881784cbc4d669ad7fa40880ed9c0. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:07:18.149008 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-e243dacb-29ac-4451-878c-05f0c97ebb65 tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Going to run 1 instances... {{(pid=122632) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 23:07:18.155487 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-e243dacb-29ac-4451-878c-05f0c97ebb65 tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] [instance: a632bb08-327b-4870-9f4e-90f8d0d863d0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78ad8905-f66f-4733-8be9-2b260f1fabed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122632) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 23:07:18.271045 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-e243dacb-29ac-4451-878c-05f0c97ebb65 tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.916690 Aug 10 23:07:18.281701 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1261/2562] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 23:07:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 929 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 23:07:18.294090 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-4a9d649e-bdb8-4c12-a47e-993fcabc3b10 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:18.294671 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-4a9d649e-bdb8-4c12-a47e-993fcabc3b10 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] [instance: 8385348f-0651-486d-9b4a-2c884933edb1] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:18.310634 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4a9d649e-bdb8-4c12-a47e-993fcabc3b10 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:18.311194 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4a9d649e-bdb8-4c12-a47e-993fcabc3b10 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:18.311956 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4a9d649e-bdb8-4c12-a47e-993fcabc3b10 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:18.314370 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4a9d649e-bdb8-4c12-a47e-993fcabc3b10 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:18.315363 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4a9d649e-bdb8-4c12-a47e-993fcabc3b10 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:18.317146 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4a9d649e-bdb8-4c12-a47e-993fcabc3b10 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:18.544411 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-4a9d649e-bdb8-4c12-a47e-993fcabc3b10 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d79bf59dabe4c02aa5e27bf3b0bc1ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9af75fc4bbc4b63ae83b5f900f1aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:18.556923 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-4a9d649e-bdb8-4c12-a47e-993fcabc3b10 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d79bf59dabe4c02aa5e27bf3b0bc1ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9af75fc4bbc4b63ae83b5f900f1aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:18.558644 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-4a9d649e-bdb8-4c12-a47e-993fcabc3b10 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d79bf59dabe4c02aa5e27bf3b0bc1ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9af75fc4bbc4b63ae83b5f900f1aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:18.572132 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-4a9d649e-bdb8-4c12-a47e-993fcabc3b10 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] 10.222.0.58 "GET /compute/v2.1/servers/8385348f-0651-486d-9b4a-2c884933edb1" status: 200 len: 1447 microversion: 2.75 time: 0.288916 Aug 10 23:07:18.576537 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1262/2563] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:07:18 2022] GET /compute/v2.1/servers/8385348f-0651-486d-9b4a-2c884933edb1 => generated 1447 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:07:18.585117 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-b94c8a1f-5299-4d7b-a90d-77c5b2051d5d req-c35b9092-6834-4b59-b5c0-ff5efa0f108c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "092f973f-79e3-44bf-a2e0-f7d3bfddf42c", "name": "network-vif-deleted", "tag": "ceec95b0-8259-4a51-84f0-06da3be72958"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:07:18.615523 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-b94c8a1f-5299-4d7b-a90d-77c5b2051d5d req-c35b9092-6834-4b59-b5c0-ff5efa0f108c service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:18.616268 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-b94c8a1f-5299-4d7b-a90d-77c5b2051d5d req-c35b9092-6834-4b59-b5c0-ff5efa0f108c service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:18.617524 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-b94c8a1f-5299-4d7b-a90d-77c5b2051d5d req-c35b9092-6834-4b59-b5c0-ff5efa0f108c service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:18.648361 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-b94c8a1f-5299-4d7b-a90d-77c5b2051d5d req-c35b9092-6834-4b59-b5c0-ff5efa0f108c service nova] Creating event network-vif-deleted:ceec95b0-8259-4a51-84f0-06da3be72958 for instance 092f973f-79e3-44bf-a2e0-f7d3bfddf42c on n-h1-850468-14 Aug 10 23:07:18.655503 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-b94c8a1f-5299-4d7b-a90d-77c5b2051d5d req-c35b9092-6834-4b59-b5c0-ff5efa0f108c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077566 Aug 10 23:07:18.671290 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1263/2564] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:07:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:07:18.677339 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c02a9b78-69ce-4d9d-97cb-5554b2166afb tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:18.678420 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-c02a9b78-69ce-4d9d-97cb-5554b2166afb tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] [instance: a632bb08-327b-4870-9f4e-90f8d0d863d0] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:18.681065 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:07:18.818743 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-c02a9b78-69ce-4d9d-97cb-5554b2166afb tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d235607afb4ba59ed6ac2908c6dc33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5881784cbc4d669ad7fa40880ed9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:18.828427 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-c02a9b78-69ce-4d9d-97cb-5554b2166afb tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] 10.222.0.58 "GET /compute/v2.1/servers/a632bb08-327b-4870-9f4e-90f8d0d863d0" status: 200 len: 1216 microversion: 2.1 time: 0.155495 Aug 10 23:07:18.829791 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1264/2565] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:07:18 2022] GET /compute/v2.1/servers/a632bb08-327b-4870-9f4e-90f8d0d863d0 => generated 1216 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:07:18.837397 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-36746641-ba2e-4623-bc9b-604d44f844ca tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:18.838417 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-36746641-ba2e-4623-bc9b-604d44f844ca tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] [instance: ba82fd6a-d3bf-4fd3-83e0-09103eafca25] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:18.851957 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-40c97c0c-2fb2-4bab-a3d5-9d3789495961 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c6e1f505b8409ea38f8a07bad870a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6473e36eada44e6bca8dc568e5ee330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:18.863519 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-36746641-ba2e-4623-bc9b-604d44f844ca tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:18.865777 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-36746641-ba2e-4623-bc9b-604d44f844ca tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:18.866261 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-36746641-ba2e-4623-bc9b-604d44f844ca tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:18.871778 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-36746641-ba2e-4623-bc9b-604d44f844ca tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:18.872294 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-36746641-ba2e-4623-bc9b-604d44f844ca tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:18.873153 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-40c97c0c-2fb2-4bab-a3d5-9d3789495961 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] 10.222.0.58 "GET /compute/v2.1/servers/092f973f-79e3-44bf-a2e0-f7d3bfddf42c" status: 200 len: 1651 microversion: 2.1 time: 0.932783 Aug 10 23:07:18.873385 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-36746641-ba2e-4623-bc9b-604d44f844ca tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:18.873843 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1302/2566] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:07:17 2022] GET /compute/v2.1/servers/092f973f-79e3-44bf-a2e0-f7d3bfddf42c => generated 1651 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:07:18.902390 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-048b1630-0689-4133-9a93-0b2ef5ea1c8c tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:18.904710 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-048b1630-0689-4133-9a93-0b2ef5ea1c8c tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] [instance: 85c138c8-9302-453b-8dc1-8f0002d79f1a] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:18.933532 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-048b1630-0689-4133-9a93-0b2ef5ea1c8c tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:18.935117 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-048b1630-0689-4133-9a93-0b2ef5ea1c8c tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:18.936371 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-048b1630-0689-4133-9a93-0b2ef5ea1c8c tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:18.940122 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-048b1630-0689-4133-9a93-0b2ef5ea1c8c tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:18.962881 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-048b1630-0689-4133-9a93-0b2ef5ea1c8c tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:18.964002 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-048b1630-0689-4133-9a93-0b2ef5ea1c8c tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:19.280916 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-36746641-ba2e-4623-bc9b-604d44f844ca tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab18f771541437ca1bda46aec45dda5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4e0ba9683c4e15932b9554d698034e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:19.302271 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-36746641-ba2e-4623-bc9b-604d44f844ca tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] 10.222.0.58 "GET /compute/v2.1/servers/ba82fd6a-d3bf-4fd3-83e0-09103eafca25" status: 200 len: 1523 microversion: 2.1 time: 0.470889 Aug 10 23:07:19.304144 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1265/2567] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:07:18 2022] GET /compute/v2.1/servers/ba82fd6a-d3bf-4fd3-83e0-09103eafca25 => generated 1523 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:07:19.329424 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-ffecc5ed-f181-4b0f-9734-d062608ee2ea tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:19.335370 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-ffecc5ed-f181-4b0f-9734-d062608ee2ea tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] [instance: 45beadf1-a6da-49ab-9098-6b681b5184c9] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:19.347749 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ffecc5ed-f181-4b0f-9734-d062608ee2ea tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:19.348642 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ffecc5ed-f181-4b0f-9734-d062608ee2ea tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:19.349314 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ffecc5ed-f181-4b0f-9734-d062608ee2ea tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:19.350659 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ffecc5ed-f181-4b0f-9734-d062608ee2ea tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:19.351666 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ffecc5ed-f181-4b0f-9734-d062608ee2ea tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:19.352348 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ffecc5ed-f181-4b0f-9734-d062608ee2ea tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:19.519900 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-048b1630-0689-4133-9a93-0b2ef5ea1c8c tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8899e278c9453fba0ab05c69b0b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46ac8b84bd649fa88897068dbfa5ce6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:19.541552 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-048b1630-0689-4133-9a93-0b2ef5ea1c8c tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] 10.222.0.58 "GET /compute/v2.1/servers/85c138c8-9302-453b-8dc1-8f0002d79f1a" status: 200 len: 1515 microversion: 2.1 time: 0.659542 Aug 10 23:07:19.544830 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1303/2568] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:07:18 2022] GET /compute/v2.1/servers/85c138c8-9302-453b-8dc1-8f0002d79f1a => generated 1515 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:07:19.561614 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-a1ba7207-4093-4724-89e6-527d9acdecdf tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:19.563544 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-a1ba7207-4093-4724-89e6-527d9acdecdf tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] [instance: ba82fd6a-d3bf-4fd3-83e0-09103eafca25] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:19.596246 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a1ba7207-4093-4724-89e6-527d9acdecdf tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:19.597248 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a1ba7207-4093-4724-89e6-527d9acdecdf tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:19.597968 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a1ba7207-4093-4724-89e6-527d9acdecdf tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:19.598970 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a1ba7207-4093-4724-89e6-527d9acdecdf tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:19.603692 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a1ba7207-4093-4724-89e6-527d9acdecdf tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:19.608911 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a1ba7207-4093-4724-89e6-527d9acdecdf tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:19.625750 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-ffecc5ed-f181-4b0f-9734-d062608ee2ea tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1986185dc9b4df4affcc421365462f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597863bfebdc481188f1f30095da5396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:19.634629 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-ffecc5ed-f181-4b0f-9734-d062608ee2ea tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] 10.222.0.58 "GET /compute/v2.1/servers/45beadf1-a6da-49ab-9098-6b681b5184c9" status: 200 len: 1678 microversion: 2.1 time: 0.328268 Aug 10 23:07:19.635589 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1266/2569] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:07:19 2022] GET /compute/v2.1/servers/45beadf1-a6da-49ab-9098-6b681b5184c9 => generated 1678 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:07:19.655436 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-5aab0e06-36d7-4509-a331-9e2b4ad1e390 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:19.657439 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-5aab0e06-36d7-4509-a331-9e2b4ad1e390 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] [instance: 8385348f-0651-486d-9b4a-2c884933edb1] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:19.666049 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5aab0e06-36d7-4509-a331-9e2b4ad1e390 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:19.666396 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:07:19.667152 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5aab0e06-36d7-4509-a331-9e2b4ad1e390 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:19.668606 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5aab0e06-36d7-4509-a331-9e2b4ad1e390 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:19.669655 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5aab0e06-36d7-4509-a331-9e2b4ad1e390 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:19.670098 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-a1ba7207-4093-4724-89e6-527d9acdecdf tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] HTTP exception thrown: Action 999 not found Aug 10 23:07:19.671705 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5aab0e06-36d7-4509-a331-9e2b4ad1e390 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:19.672392 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5aab0e06-36d7-4509-a331-9e2b4ad1e390 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:19.673289 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-a1ba7207-4093-4724-89e6-527d9acdecdf tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] Request method failure captured: Aug 10 23:07:19.673289 n-d-850468-14 devstack@n-api.service[122633]: request: GET /compute/v2.1/servers/ba82fd6a-d3bf-4fd3-83e0-09103eafca25/os-instance-actions/999 HTTP/1.1 Aug 10 23:07:19.673289 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:07:19.673289 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:07:19.673289 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:07:19.673289 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:07:19.673289 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:07:19.673289 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:07:19.673289 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:07:19.673289 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:07:19.673289 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9DoTzRGdUOhPfRFTnRTvOv3XzFnoAt1RCafPDtQM_w7HWrUkplr_wrmytRRsbLmZ8JsRNTqrOzPuvTsv-eRdzMD0k9IrTqN1mbBG4B-N0bAdGyxMetFkAhwPYT7HHfyKeg1SSN8NfPtWEvyY8cnUJ_ZsKmxEnvagPNuHeVpGY9cgpiA Aug 10 23:07:19.673289 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:07:19.673289 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:07:19.673289 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:07:19.673289 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:07:19.673289 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:07:19.673289 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:07:19.673289 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 2f4e0ba9683c4e15932b9554d698034e Aug 10 23:07:19.673289 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-608216130 Aug 10 23:07:19.673289 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:07:19.673289 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:07:19.674627 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2f4e0ba9683c4e15932b9554d698034e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2f4e0ba9683c4e15932b9554d698034e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2f4e0ba9683c4e15932b9554d698034e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2f4e0ba9683c4e15932b9554d698034e", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:07:19.674627 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-608216130 Aug 10 23:07:19.674627 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 2f4e0ba9683c4e15932b9554d698034e Aug 10 23:07:19.674627 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-608216130 Aug 10 23:07:19.674627 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-InstanceActionsNegativeTestJSON-608216130-project Aug 10 23:07:19.674627 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:07:19.674627 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:07:19.674627 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: eab18f771541437ca1bda46aec45dda5 Aug 10 23:07:19.674627 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-608216130-project Aug 10 23:07:19.674627 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:07:19.674627 n-d-850468-14 devstack@n-api.service[122633]: exception: Action 999 not found Aug 10 23:07:19.674627 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'server_id': 'ba82fd6a-d3bf-4fd3-83e0-09103eafca25', 'id': '999'} Aug 10 23:07:19.675459 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:07:19.675459 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:07:19.675459 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:07:19.675459 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:07:19.675459 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:07:19.675459 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:07:19.675459 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:07:19.675459 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:07:19.675459 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Aug 10 23:07:19.675459 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 10 23:07:19.675459 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Aug 10 23:07:19.675459 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:07:19.675459 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:07:19.675459 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:07:19.675459 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:07:19.675459 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:07:19.675459 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:07:19.675459 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:07:19.675459 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:07:19.675459 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Aug 10 23:07:19.675459 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:07:19.676796 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-a1ba7207-4093-4724-89e6-527d9acdecdf tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] Returning 404 to user: Action 999 not found {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:07:19.676796 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-a1ba7207-4093-4724-89e6-527d9acdecdf tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] 10.222.0.58 "GET /compute/v2.1/servers/ba82fd6a-d3bf-4fd3-83e0-09103eafca25/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.129478 Aug 10 23:07:19.676977 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1304/2570] 10.222.0.58 () {58 vars in 1308 bytes} [Wed Aug 10 23:07:19 2022] GET /compute/v2.1/servers/ba82fd6a-d3bf-4fd3-83e0-09103eafca25/os-instance-actions/999 => generated 66 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 10 23:07:19.704056 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-7f4fa6de-42bb-4cd4-819c-a2d501839f9c tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] Calling method '.version_select at 0x7f847cf50f70>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:19.708932 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-7f4fa6de-42bb-4cd4-819c-a2d501839f9c tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] [instance: 1eca9a44-2b19-4ee1-8af4-21534efe4dff] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:19.734981 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-7f4fa6de-42bb-4cd4-819c-a2d501839f9c tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] HTTP exception thrown: Instance 1eca9a44-2b19-4ee1-8af4-21534efe4dff could not be found. Aug 10 23:07:19.740447 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-7f4fa6de-42bb-4cd4-819c-a2d501839f9c tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] Request method failure captured: Aug 10 23:07:19.740447 n-d-850468-14 devstack@n-api.service[122633]: request: GET /compute/v2.1/servers/1eca9a44-2b19-4ee1-8af4-21534efe4dff/os-instance-actions HTTP/1.1 Aug 10 23:07:19.740447 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:07:19.740447 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:07:19.740447 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:07:19.740447 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:07:19.740447 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:07:19.740447 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:07:19.740447 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:07:19.740447 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:07:19.740447 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9DoTzRGdUOhPfRFTnRTvOv3XzFnoAt1RCafPDtQM_w7HWrUkplr_wrmytRRsbLmZ8JsRNTqrOzPuvTsv-eRdzMD0k9IrTqN1mbBG4B-N0bAdGyxMetFkAhwPYT7HHfyKeg1SSN8NfPtWEvyY8cnUJ_ZsKmxEnvagPNuHeVpGY9cgpiA Aug 10 23:07:19.740447 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:07:19.740447 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:07:19.740447 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:07:19.740447 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:07:19.740447 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:07:19.740447 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:07:19.740447 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 2f4e0ba9683c4e15932b9554d698034e Aug 10 23:07:19.740447 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-608216130 Aug 10 23:07:19.740447 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:07:19.740447 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:07:19.741827 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2f4e0ba9683c4e15932b9554d698034e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2f4e0ba9683c4e15932b9554d698034e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2f4e0ba9683c4e15932b9554d698034e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2f4e0ba9683c4e15932b9554d698034e", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:07:19.741827 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-608216130 Aug 10 23:07:19.741827 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 2f4e0ba9683c4e15932b9554d698034e Aug 10 23:07:19.741827 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-608216130 Aug 10 23:07:19.741827 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-InstanceActionsNegativeTestJSON-608216130-project Aug 10 23:07:19.741827 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:07:19.741827 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:07:19.741827 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: eab18f771541437ca1bda46aec45dda5 Aug 10 23:07:19.741827 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-608216130-project Aug 10 23:07:19.741827 n-d-850468-14 devstack@n-api.service[122633]: method: Aug 10 23:07:19.741827 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance 1eca9a44-2b19-4ee1-8af4-21534efe4dff could not be found. Aug 10 23:07:19.741827 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'server_id': '1eca9a44-2b19-4ee1-8af4-21534efe4dff'} Aug 10 23:07:19.742531 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:07:19.742531 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:07:19.742531 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:07:19.742531 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:07:19.742531 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:07:19.742531 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:07:19.742531 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 10 23:07:19.742531 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 10 23:07:19.742531 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1eca9a44-2b19-4ee1-8af4-21534efe4dff could not be found. Aug 10 23:07:19.742531 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:07:19.742531 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:07:19.742531 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:07:19.742531 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:07:19.742531 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:07:19.742531 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:07:19.742531 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:07:19.742531 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:07:19.742531 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 23:07:19.742531 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 23:07:19.742531 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:07:19.750054 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:07:19.750054 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Aug 10 23:07:19.750054 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Aug 10 23:07:19.750054 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 23:07:19.750054 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 23:07:19.750054 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Aug 10 23:07:19.750054 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Aug 10 23:07:19.750054 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:07:19.750054 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:07:19.750054 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1eca9a44-2b19-4ee1-8af4-21534efe4dff could not be found. Aug 10 23:07:19.750054 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:07:19.750054 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:07:19.750054 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:07:19.750054 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:07:19.750054 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:07:19.750054 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:07:19.750054 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:07:19.750054 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:07:19.750054 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1eca9a44-2b19-4ee1-8af4-21534efe4dff could not be found. Aug 10 23:07:19.750054 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:07:19.751249 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-7f4fa6de-42bb-4cd4-819c-a2d501839f9c tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] Returning 404 to user: Instance 1eca9a44-2b19-4ee1-8af4-21534efe4dff could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:07:19.751249 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-7f4fa6de-42bb-4cd4-819c-a2d501839f9c tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] 10.222.0.58 "GET /compute/v2.1/servers/1eca9a44-2b19-4ee1-8af4-21534efe4dff/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.058146 Aug 10 23:07:19.751249 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1305/2571] 10.222.0.58 () {58 vars in 1296 bytes} [Wed Aug 10 23:07:19 2022] GET /compute/v2.1/servers/1eca9a44-2b19-4ee1-8af4-21534efe4dff/os-instance-actions => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:07:19.753582 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-2ee2ad1b-bd5e-4833-bdb9-1938cde42c54 tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:19.755150 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-2ee2ad1b-bd5e-4833-bdb9-1938cde42c54 tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] [instance: ba82fd6a-d3bf-4fd3-83e0-09103eafca25] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:19.770119 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-5aab0e06-36d7-4509-a331-9e2b4ad1e390 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d79bf59dabe4c02aa5e27bf3b0bc1ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9af75fc4bbc4b63ae83b5f900f1aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:19.778342 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2ee2ad1b-bd5e-4833-bdb9-1938cde42c54 tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:19.779419 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2ee2ad1b-bd5e-4833-bdb9-1938cde42c54 tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:19.779716 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-5aab0e06-36d7-4509-a331-9e2b4ad1e390 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d79bf59dabe4c02aa5e27bf3b0bc1ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9af75fc4bbc4b63ae83b5f900f1aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:19.780300 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2ee2ad1b-bd5e-4833-bdb9-1938cde42c54 tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:19.781238 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-5aab0e06-36d7-4509-a331-9e2b4ad1e390 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d79bf59dabe4c02aa5e27bf3b0bc1ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9af75fc4bbc4b63ae83b5f900f1aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:19.781555 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2ee2ad1b-bd5e-4833-bdb9-1938cde42c54 tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:19.782198 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2ee2ad1b-bd5e-4833-bdb9-1938cde42c54 tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:19.782953 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2ee2ad1b-bd5e-4833-bdb9-1938cde42c54 tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:19.797549 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-5aab0e06-36d7-4509-a331-9e2b4ad1e390 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] 10.222.0.58 "GET /compute/v2.1/servers/8385348f-0651-486d-9b4a-2c884933edb1" status: 200 len: 1447 microversion: 2.75 time: 0.160612 Aug 10 23:07:19.798166 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1267/2572] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:07:19 2022] GET /compute/v2.1/servers/8385348f-0651-486d-9b4a-2c884933edb1 => generated 1447 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:07:19.813488 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-2ee2ad1b-bd5e-4833-bdb9-1938cde42c54 tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] [instance: ba82fd6a-d3bf-4fd3-83e0-09103eafca25] Going to try to terminate instance {{(pid=122633) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:07:19.855331 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-b4fd2e44-5da4-4b89-8004-b8ca0d20cdff tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:19.855955 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-b4fd2e44-5da4-4b89-8004-b8ca0d20cdff tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] [instance: a632bb08-327b-4870-9f4e-90f8d0d863d0] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:19.863100 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b4fd2e44-5da4-4b89-8004-b8ca0d20cdff tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:19.864459 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b4fd2e44-5da4-4b89-8004-b8ca0d20cdff tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:19.865258 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b4fd2e44-5da4-4b89-8004-b8ca0d20cdff tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:19.866376 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b4fd2e44-5da4-4b89-8004-b8ca0d20cdff tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:19.867104 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b4fd2e44-5da4-4b89-8004-b8ca0d20cdff tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:19.867693 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b4fd2e44-5da4-4b89-8004-b8ca0d20cdff tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:19.935814 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:07:19.976760 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-2ee2ad1b-bd5e-4833-bdb9-1938cde42c54 tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] 10.222.0.58 "DELETE /compute/v2.1/servers/ba82fd6a-d3bf-4fd3-83e0-09103eafca25" status: 204 len: 0 microversion: 2.1 time: 0.225782 Aug 10 23:07:19.981285 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1306/2573] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:07:19 2022] DELETE /compute/v2.1/servers/ba82fd6a-d3bf-4fd3-83e0-09103eafca25 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 10 23:07:19.987834 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-4393c6f8-8ce1-4571-bdd5-75c03fac6235 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:19.988770 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-4393c6f8-8ce1-4571-bdd5-75c03fac6235 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] [instance: 092f973f-79e3-44bf-a2e0-f7d3bfddf42c] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:19.997540 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4393c6f8-8ce1-4571-bdd5-75c03fac6235 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:19.998173 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4393c6f8-8ce1-4571-bdd5-75c03fac6235 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:19.998690 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4393c6f8-8ce1-4571-bdd5-75c03fac6235 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:19.999442 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4393c6f8-8ce1-4571-bdd5-75c03fac6235 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:19.999945 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4393c6f8-8ce1-4571-bdd5-75c03fac6235 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:20.000399 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4393c6f8-8ce1-4571-bdd5-75c03fac6235 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:20.024998 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-4393c6f8-8ce1-4571-bdd5-75c03fac6235 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] HTTP exception thrown: Instance 092f973f-79e3-44bf-a2e0-f7d3bfddf42c could not be found. Aug 10 23:07:20.027409 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-4393c6f8-8ce1-4571-bdd5-75c03fac6235 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Request method failure captured: Aug 10 23:07:20.027409 n-d-850468-14 devstack@n-api.service[122633]: request: GET /compute/v2.1/servers/092f973f-79e3-44bf-a2e0-f7d3bfddf42c HTTP/1.1 Aug 10 23:07:20.027409 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:07:20.027409 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:07:20.027409 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:07:20.027409 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:07:20.027409 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:07:20.027409 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:07:20.027409 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:07:20.027409 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:07:20.027409 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9Dnr9qhH8qABr6sGOY8du1SR95rfOClj5ZCkR3wuQSMMB2bcRJmBsw1RKG_rSrVIE8iV42HRXRAxetZmHBzbgzrG_Gv5lN5xvGD0xpsgMpj8ytwRnm7P1y5XfrOqCJhIe4RvCam6acWmEXW2e4PykLV39ynUh-_MtUn4NTKXON0FxOM Aug 10 23:07:20.027409 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:07:20.027409 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:07:20.027409 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:07:20.027409 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:07:20.027409 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:07:20.027409 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:07:20.027409 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: c6473e36eada44e6bca8dc568e5ee330 Aug 10 23:07:20.027409 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-ServersTestMultiNic-1647590367 Aug 10 23:07:20.027409 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:07:20.027409 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:07:20.028960 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c6473e36eada44e6bca8dc568e5ee330"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c6473e36eada44e6bca8dc568e5ee330"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/c6473e36eada44e6bca8dc568e5ee330"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_c6473e36eada44e6bca8dc568e5ee330", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:07:20.028960 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-ServersTestMultiNic-1647590367 Aug 10 23:07:20.028960 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: c6473e36eada44e6bca8dc568e5ee330 Aug 10 23:07:20.028960 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-ServersTestMultiNic-1647590367 Aug 10 23:07:20.028960 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-ServersTestMultiNic-1647590367-project Aug 10 23:07:20.028960 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:07:20.028960 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:07:20.028960 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: a1c6e1f505b8409ea38f8a07bad870a8 Aug 10 23:07:20.028960 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-ServersTestMultiNic-1647590367-project Aug 10 23:07:20.028960 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:07:20.028960 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance 092f973f-79e3-44bf-a2e0-f7d3bfddf42c could not be found. Aug 10 23:07:20.028960 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': '092f973f-79e3-44bf-a2e0-f7d3bfddf42c'} Aug 10 23:07:20.029996 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:07:20.029996 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:07:20.029996 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:07:20.029996 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:07:20.029996 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:07:20.029996 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:07:20.029996 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:07:20.029996 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:07:20.029996 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:07:20.029996 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:07:20.029996 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 092f973f-79e3-44bf-a2e0-f7d3bfddf42c could not be found. Aug 10 23:07:20.029996 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:07:20.029996 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:07:20.029996 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:07:20.029996 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:07:20.029996 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:07:20.029996 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:07:20.029996 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:07:20.029996 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:07:20.029996 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:07:20.031437 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:07:20.031437 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:07:20.031437 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:07:20.031437 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:07:20.031437 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:07:20.031437 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:07:20.031437 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:07:20.031437 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 092f973f-79e3-44bf-a2e0-f7d3bfddf42c could not be found. Aug 10 23:07:20.031437 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:07:20.031437 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:07:20.031437 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:07:20.031437 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:07:20.031437 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:07:20.031437 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:07:20.031437 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:07:20.031437 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:07:20.031437 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 092f973f-79e3-44bf-a2e0-f7d3bfddf42c could not be found. Aug 10 23:07:20.031437 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:07:20.033945 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-b4fd2e44-5da4-4b89-8004-b8ca0d20cdff tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d235607afb4ba59ed6ac2908c6dc33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5881784cbc4d669ad7fa40880ed9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:20.036236 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:07:20.045417 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-b4fd2e44-5da4-4b89-8004-b8ca0d20cdff tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] 10.222.0.58 "GET /compute/v2.1/servers/a632bb08-327b-4870-9f4e-90f8d0d863d0" status: 200 len: 1268 microversion: 2.1 time: 0.194704 Aug 10 23:07:20.046523 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1268/2574] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:07:19 2022] GET /compute/v2.1/servers/a632bb08-327b-4870-9f4e-90f8d0d863d0 => generated 1268 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:07:20.050205 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-4393c6f8-8ce1-4571-bdd5-75c03fac6235 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Returning 404 to user: Instance 092f973f-79e3-44bf-a2e0-f7d3bfddf42c could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:07:20.051811 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-4393c6f8-8ce1-4571-bdd5-75c03fac6235 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] 10.222.0.58 "GET /compute/v2.1/servers/092f973f-79e3-44bf-a2e0-f7d3bfddf42c" status: 404 len: 111 microversion: 2.1 time: 0.068654 Aug 10 23:07:20.056649 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1307/2575] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:07:19 2022] GET /compute/v2.1/servers/092f973f-79e3-44bf-a2e0-f7d3bfddf42c => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:07:20.069931 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-d068854e-1762-4600-89dd-397e672b4dd8 tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:20.070555 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-d068854e-1762-4600-89dd-397e672b4dd8 tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] [instance: ba82fd6a-d3bf-4fd3-83e0-09103eafca25] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:20.092445 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d068854e-1762-4600-89dd-397e672b4dd8 tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:20.092933 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d068854e-1762-4600-89dd-397e672b4dd8 tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:20.093584 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d068854e-1762-4600-89dd-397e672b4dd8 tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:20.095211 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d068854e-1762-4600-89dd-397e672b4dd8 tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:20.095834 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d068854e-1762-4600-89dd-397e672b4dd8 tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:20.096427 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d068854e-1762-4600-89dd-397e672b4dd8 tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:20.567563 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c6469b47-3b88-4936-94ec-07dec6a6a8e3 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:20.568702 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-c6469b47-3b88-4936-94ec-07dec6a6a8e3 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] [instance: 85c138c8-9302-453b-8dc1-8f0002d79f1a] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:20.580938 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c6469b47-3b88-4936-94ec-07dec6a6a8e3 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:20.584074 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c6469b47-3b88-4936-94ec-07dec6a6a8e3 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:20.584724 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c6469b47-3b88-4936-94ec-07dec6a6a8e3 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:20.586515 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c6469b47-3b88-4936-94ec-07dec6a6a8e3 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:20.590937 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c6469b47-3b88-4936-94ec-07dec6a6a8e3 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:20.591486 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c6469b47-3b88-4936-94ec-07dec6a6a8e3 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:20.853055 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-c6469b47-3b88-4936-94ec-07dec6a6a8e3 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8899e278c9453fba0ab05c69b0b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46ac8b84bd649fa88897068dbfa5ce6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:20.864887 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-c6469b47-3b88-4936-94ec-07dec6a6a8e3 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] 10.222.0.58 "GET /compute/v2.1/servers/85c138c8-9302-453b-8dc1-8f0002d79f1a" status: 200 len: 1515 microversion: 2.1 time: 0.299613 Aug 10 23:07:20.879878 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1308/2576] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:07:20 2022] GET /compute/v2.1/servers/85c138c8-9302-453b-8dc1-8f0002d79f1a => generated 1515 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:07:20.887470 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-edb74f2a-7d15-49cb-a826-63d06107a418 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:20.888088 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-edb74f2a-7d15-49cb-a826-63d06107a418 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] [instance: 45beadf1-a6da-49ab-9098-6b681b5184c9] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:20.895494 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-edb74f2a-7d15-49cb-a826-63d06107a418 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:20.896198 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-edb74f2a-7d15-49cb-a826-63d06107a418 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:20.896789 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-edb74f2a-7d15-49cb-a826-63d06107a418 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:20.897655 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-edb74f2a-7d15-49cb-a826-63d06107a418 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:20.898266 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-edb74f2a-7d15-49cb-a826-63d06107a418 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:20.898876 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-edb74f2a-7d15-49cb-a826-63d06107a418 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:20.949610 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-d068854e-1762-4600-89dd-397e672b4dd8 tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab18f771541437ca1bda46aec45dda5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4e0ba9683c4e15932b9554d698034e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:20.961203 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-d068854e-1762-4600-89dd-397e672b4dd8 tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] 10.222.0.58 "GET /compute/v2.1/servers/ba82fd6a-d3bf-4fd3-83e0-09103eafca25" status: 200 len: 1529 microversion: 2.1 time: 0.913430 Aug 10 23:07:20.962609 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1269/2577] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:07:20 2022] GET /compute/v2.1/servers/ba82fd6a-d3bf-4fd3-83e0-09103eafca25 => generated 1529 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:07:20.978485 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-20e2c40f-ed86-4b5d-b8ba-b8da222d3a87 req-a1bf7e8f-fbb2-42dd-b725-76b379fe2f35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "092f973f-79e3-44bf-a2e0-f7d3bfddf42c", "name": "network-vif-deleted", "tag": "f77ec6f6-c9b1-47bb-ab17-7f7a3f702dc8"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:07:21.002081 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-20e2c40f-ed86-4b5d-b8ba-b8da222d3a87 req-a1bf7e8f-fbb2-42dd-b725-76b379fe2f35 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:21.002916 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-20e2c40f-ed86-4b5d-b8ba-b8da222d3a87 req-a1bf7e8f-fbb2-42dd-b725-76b379fe2f35 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:21.003360 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-20e2c40f-ed86-4b5d-b8ba-b8da222d3a87 req-a1bf7e8f-fbb2-42dd-b725-76b379fe2f35 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:21.018549 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-20e2c40f-ed86-4b5d-b8ba-b8da222d3a87 req-a1bf7e8f-fbb2-42dd-b725-76b379fe2f35 service nova] Creating event network-vif-deleted:f77ec6f6-c9b1-47bb-ab17-7f7a3f702dc8 for instance 092f973f-79e3-44bf-a2e0-f7d3bfddf42c on n-h1-850468-14 Aug 10 23:07:21.027949 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-20e2c40f-ed86-4b5d-b8ba-b8da222d3a87 req-a1bf7e8f-fbb2-42dd-b725-76b379fe2f35 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063203 Aug 10 23:07:21.029642 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1270/2578] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:07:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:07:21.039698 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-bb9869c6-8180-4b31-9fca-4a284fdfddc0 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:21.045216 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-bb9869c6-8180-4b31-9fca-4a284fdfddc0 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] [instance: 8385348f-0651-486d-9b4a-2c884933edb1] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:21.054816 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bb9869c6-8180-4b31-9fca-4a284fdfddc0 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:21.059745 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bb9869c6-8180-4b31-9fca-4a284fdfddc0 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:21.060725 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bb9869c6-8180-4b31-9fca-4a284fdfddc0 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:21.062381 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bb9869c6-8180-4b31-9fca-4a284fdfddc0 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:21.064366 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bb9869c6-8180-4b31-9fca-4a284fdfddc0 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:21.065493 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bb9869c6-8180-4b31-9fca-4a284fdfddc0 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:21.197329 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-bb9869c6-8180-4b31-9fca-4a284fdfddc0 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d79bf59dabe4c02aa5e27bf3b0bc1ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9af75fc4bbc4b63ae83b5f900f1aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:21.209040 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-bb9869c6-8180-4b31-9fca-4a284fdfddc0 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d79bf59dabe4c02aa5e27bf3b0bc1ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9af75fc4bbc4b63ae83b5f900f1aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:21.211110 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-bb9869c6-8180-4b31-9fca-4a284fdfddc0 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d79bf59dabe4c02aa5e27bf3b0bc1ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9af75fc4bbc4b63ae83b5f900f1aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:21.217962 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-bb9869c6-8180-4b31-9fca-4a284fdfddc0 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] 10.222.0.58 "GET /compute/v2.1/servers/8385348f-0651-486d-9b4a-2c884933edb1" status: 200 len: 1447 microversion: 2.75 time: 0.185955 Aug 10 23:07:21.231622 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1271/2579] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:07:21 2022] GET /compute/v2.1/servers/8385348f-0651-486d-9b4a-2c884933edb1 => generated 1447 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:07:21.238620 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-edb74f2a-7d15-49cb-a826-63d06107a418 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1986185dc9b4df4affcc421365462f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597863bfebdc481188f1f30095da5396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:21.242060 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-80494d80-20ca-4064-9868-bb61bd9c419c tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:21.242692 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-80494d80-20ca-4064-9868-bb61bd9c419c tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] [instance: a632bb08-327b-4870-9f4e-90f8d0d863d0] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:21.250998 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-80494d80-20ca-4064-9868-bb61bd9c419c tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:21.251681 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-80494d80-20ca-4064-9868-bb61bd9c419c tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:21.252131 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-80494d80-20ca-4064-9868-bb61bd9c419c tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:21.252895 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-80494d80-20ca-4064-9868-bb61bd9c419c tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:21.253422 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-80494d80-20ca-4064-9868-bb61bd9c419c tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:21.253849 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-80494d80-20ca-4064-9868-bb61bd9c419c tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:21.262278 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-edb74f2a-7d15-49cb-a826-63d06107a418 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] 10.222.0.58 "GET /compute/v2.1/servers/45beadf1-a6da-49ab-9098-6b681b5184c9" status: 200 len: 1678 microversion: 2.1 time: 0.379673 Aug 10 23:07:21.263253 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1309/2580] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:07:20 2022] GET /compute/v2.1/servers/45beadf1-a6da-49ab-9098-6b681b5184c9 => generated 1678 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:07:21.382104 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-80494d80-20ca-4064-9868-bb61bd9c419c tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d235607afb4ba59ed6ac2908c6dc33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5881784cbc4d669ad7fa40880ed9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:21.393712 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-80494d80-20ca-4064-9868-bb61bd9c419c tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] 10.222.0.58 "GET /compute/v2.1/servers/a632bb08-327b-4870-9f4e-90f8d0d863d0" status: 200 len: 1274 microversion: 2.1 time: 0.160794 Aug 10 23:07:21.394901 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1272/2581] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:07:21 2022] GET /compute/v2.1/servers/a632bb08-327b-4870-9f4e-90f8d0d863d0 => generated 1274 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:07:21.889899 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-a741a1f8-b444-4b62-975e-880ef6f1a878 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:21.892045 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-a741a1f8-b444-4b62-975e-880ef6f1a878 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] [instance: 85c138c8-9302-453b-8dc1-8f0002d79f1a] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:21.907240 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a741a1f8-b444-4b62-975e-880ef6f1a878 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:21.908755 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a741a1f8-b444-4b62-975e-880ef6f1a878 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:21.915312 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a741a1f8-b444-4b62-975e-880ef6f1a878 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:21.916390 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a741a1f8-b444-4b62-975e-880ef6f1a878 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:21.918759 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a741a1f8-b444-4b62-975e-880ef6f1a878 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:21.919888 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a741a1f8-b444-4b62-975e-880ef6f1a878 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:22.004175 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-5d786e69-1b7b-4c7e-a42c-97581d2b1c73 tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:22.008759 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-5d786e69-1b7b-4c7e-a42c-97581d2b1c73 tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] [instance: ba82fd6a-d3bf-4fd3-83e0-09103eafca25] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:22.027049 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5d786e69-1b7b-4c7e-a42c-97581d2b1c73 tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:22.029587 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5d786e69-1b7b-4c7e-a42c-97581d2b1c73 tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:22.031035 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5d786e69-1b7b-4c7e-a42c-97581d2b1c73 tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:22.033159 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5d786e69-1b7b-4c7e-a42c-97581d2b1c73 tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:22.034013 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5d786e69-1b7b-4c7e-a42c-97581d2b1c73 tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:22.034711 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5d786e69-1b7b-4c7e-a42c-97581d2b1c73 tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:22.411387 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-a741a1f8-b444-4b62-975e-880ef6f1a878 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8899e278c9453fba0ab05c69b0b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46ac8b84bd649fa88897068dbfa5ce6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:22.435181 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-a741a1f8-b444-4b62-975e-880ef6f1a878 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] 10.222.0.58 "GET /compute/v2.1/servers/85c138c8-9302-453b-8dc1-8f0002d79f1a" status: 200 len: 1515 microversion: 2.1 time: 0.545037 Aug 10 23:07:22.437277 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1310/2582] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:07:21 2022] GET /compute/v2.1/servers/85c138c8-9302-453b-8dc1-8f0002d79f1a => generated 1515 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:07:22.466599 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-04191769-6c4a-455d-93e7-67b900e1deca tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:22.468120 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-04191769-6c4a-455d-93e7-67b900e1deca tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] [instance: 8385348f-0651-486d-9b4a-2c884933edb1] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:22.476049 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-04191769-6c4a-455d-93e7-67b900e1deca tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:22.476834 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-04191769-6c4a-455d-93e7-67b900e1deca tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:22.477072 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-04191769-6c4a-455d-93e7-67b900e1deca tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:22.478494 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-04191769-6c4a-455d-93e7-67b900e1deca tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:22.479291 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-04191769-6c4a-455d-93e7-67b900e1deca tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:22.479758 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-04191769-6c4a-455d-93e7-67b900e1deca tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:22.576693 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-5d786e69-1b7b-4c7e-a42c-97581d2b1c73 tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab18f771541437ca1bda46aec45dda5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4e0ba9683c4e15932b9554d698034e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:22.596684 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-5d786e69-1b7b-4c7e-a42c-97581d2b1c73 tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] 10.222.0.58 "GET /compute/v2.1/servers/ba82fd6a-d3bf-4fd3-83e0-09103eafca25" status: 200 len: 1529 microversion: 2.1 time: 0.596052 Aug 10 23:07:22.596684 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1273/2583] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:07:21 2022] GET /compute/v2.1/servers/ba82fd6a-d3bf-4fd3-83e0-09103eafca25 => generated 1529 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:07:22.614848 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-02f35e42-2af5-4234-b06f-9fd22f5737ba tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:22.615769 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-02f35e42-2af5-4234-b06f-9fd22f5737ba tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] [instance: 45beadf1-a6da-49ab-9098-6b681b5184c9] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:22.624636 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-02f35e42-2af5-4234-b06f-9fd22f5737ba tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:22.625379 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-02f35e42-2af5-4234-b06f-9fd22f5737ba tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:22.625979 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-02f35e42-2af5-4234-b06f-9fd22f5737ba tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:22.626952 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-02f35e42-2af5-4234-b06f-9fd22f5737ba tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:22.627570 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-02f35e42-2af5-4234-b06f-9fd22f5737ba tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:22.628180 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-02f35e42-2af5-4234-b06f-9fd22f5737ba tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:22.644985 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-04191769-6c4a-455d-93e7-67b900e1deca tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d79bf59dabe4c02aa5e27bf3b0bc1ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9af75fc4bbc4b63ae83b5f900f1aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:22.661300 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-04191769-6c4a-455d-93e7-67b900e1deca tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d79bf59dabe4c02aa5e27bf3b0bc1ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9af75fc4bbc4b63ae83b5f900f1aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:22.665118 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-04191769-6c4a-455d-93e7-67b900e1deca tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d79bf59dabe4c02aa5e27bf3b0bc1ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9af75fc4bbc4b63ae83b5f900f1aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:22.677459 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-04191769-6c4a-455d-93e7-67b900e1deca tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] 10.222.0.58 "GET /compute/v2.1/servers/8385348f-0651-486d-9b4a-2c884933edb1" status: 200 len: 1447 microversion: 2.75 time: 0.222429 Aug 10 23:07:22.682058 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1311/2584] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:07:22 2022] GET /compute/v2.1/servers/8385348f-0651-486d-9b4a-2c884933edb1 => generated 1447 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:07:22.697219 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-fdf62c1e-9636-4621-87ee-423d4f9130ad tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:22.700296 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-fdf62c1e-9636-4621-87ee-423d4f9130ad tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] [instance: a632bb08-327b-4870-9f4e-90f8d0d863d0] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:22.715272 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fdf62c1e-9636-4621-87ee-423d4f9130ad tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:22.717572 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fdf62c1e-9636-4621-87ee-423d4f9130ad tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:22.721629 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fdf62c1e-9636-4621-87ee-423d4f9130ad tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:22.723036 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fdf62c1e-9636-4621-87ee-423d4f9130ad tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:22.723707 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fdf62c1e-9636-4621-87ee-423d4f9130ad tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:22.724775 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fdf62c1e-9636-4621-87ee-423d4f9130ad tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:22.896201 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-fdf62c1e-9636-4621-87ee-423d4f9130ad tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d235607afb4ba59ed6ac2908c6dc33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5881784cbc4d669ad7fa40880ed9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:22.904495 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-fdf62c1e-9636-4621-87ee-423d4f9130ad tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] 10.222.0.58 "GET /compute/v2.1/servers/a632bb08-327b-4870-9f4e-90f8d0d863d0" status: 200 len: 1274 microversion: 2.1 time: 0.221276 Aug 10 23:07:22.908445 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1312/2585] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:07:22 2022] GET /compute/v2.1/servers/a632bb08-327b-4870-9f4e-90f8d0d863d0 => generated 1274 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:07:22.923334 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-03cb0521-5ae2-409f-a44e-0ea797e7b189 req-f2fcbc6d-98f4-44ef-b85e-2fd186b1caa9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba82fd6a-d3bf-4fd3-83e0-09103eafca25", "name": "network-vif-deleted", "tag": "61f2915c-3e11-4b73-bce4-1886d764dd44"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:07:22.936289 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-03cb0521-5ae2-409f-a44e-0ea797e7b189 req-f2fcbc6d-98f4-44ef-b85e-2fd186b1caa9 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:22.956472 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-03cb0521-5ae2-409f-a44e-0ea797e7b189 req-f2fcbc6d-98f4-44ef-b85e-2fd186b1caa9 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:22.957189 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-03cb0521-5ae2-409f-a44e-0ea797e7b189 req-f2fcbc6d-98f4-44ef-b85e-2fd186b1caa9 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:22.987846 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-03cb0521-5ae2-409f-a44e-0ea797e7b189 req-f2fcbc6d-98f4-44ef-b85e-2fd186b1caa9 service nova] Creating event network-vif-deleted:61f2915c-3e11-4b73-bce4-1886d764dd44 for instance ba82fd6a-d3bf-4fd3-83e0-09103eafca25 on n-h2-850468-14 Aug 10 23:07:23.010365 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-03cb0521-5ae2-409f-a44e-0ea797e7b189 req-f2fcbc6d-98f4-44ef-b85e-2fd186b1caa9 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091243 Aug 10 23:07:23.011354 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1313/2586] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:07:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 23:07:23.382465 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-02f35e42-2af5-4234-b06f-9fd22f5737ba tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1986185dc9b4df4affcc421365462f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597863bfebdc481188f1f30095da5396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:23.393575 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-02f35e42-2af5-4234-b06f-9fd22f5737ba tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] 10.222.0.58 "GET /compute/v2.1/servers/45beadf1-a6da-49ab-9098-6b681b5184c9" status: 200 len: 1678 microversion: 2.1 time: 0.798060 Aug 10 23:07:23.394178 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1274/2587] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:07:22 2022] GET /compute/v2.1/servers/45beadf1-a6da-49ab-9098-6b681b5184c9 => generated 1678 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:07:23.462339 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-9c359b3a-ea7f-4bdb-8330-712533350eb5 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:23.463322 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-9c359b3a-ea7f-4bdb-8330-712533350eb5 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] [instance: 85c138c8-9302-453b-8dc1-8f0002d79f1a] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:23.478156 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9c359b3a-ea7f-4bdb-8330-712533350eb5 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:23.480475 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9c359b3a-ea7f-4bdb-8330-712533350eb5 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:23.481084 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9c359b3a-ea7f-4bdb-8330-712533350eb5 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:23.481851 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9c359b3a-ea7f-4bdb-8330-712533350eb5 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:23.482316 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9c359b3a-ea7f-4bdb-8330-712533350eb5 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:23.482745 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9c359b3a-ea7f-4bdb-8330-712533350eb5 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:23.616682 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-8a590686-141b-464b-b5d3-b61a509a4d15 tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:23.617361 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-8a590686-141b-464b-b5d3-b61a509a4d15 tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] [instance: ba82fd6a-d3bf-4fd3-83e0-09103eafca25] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:23.634362 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8a590686-141b-464b-b5d3-b61a509a4d15 tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:23.634914 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8a590686-141b-464b-b5d3-b61a509a4d15 tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:23.636651 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8a590686-141b-464b-b5d3-b61a509a4d15 tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:23.643185 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8a590686-141b-464b-b5d3-b61a509a4d15 tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:23.643853 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8a590686-141b-464b-b5d3-b61a509a4d15 tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:23.644304 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8a590686-141b-464b-b5d3-b61a509a4d15 tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:23.711136 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8a590686-141b-464b-b5d3-b61a509a4d15 tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:23.711906 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8a590686-141b-464b-b5d3-b61a509a4d15 tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:23.712498 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8a590686-141b-464b-b5d3-b61a509a4d15 tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:23.713107 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.objects.instance [None req-8a590686-141b-464b-b5d3-b61a509a4d15 tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] Lazy-loading 'fault' on Instance uuid ba82fd6a-d3bf-4fd3-83e0-09103eafca25 {{(pid=122632) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:07:23.809469 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-8a590686-141b-464b-b5d3-b61a509a4d15 tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eab18f771541437ca1bda46aec45dda5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2f4e0ba9683c4e15932b9554d698034e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:23.816720 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-8a590686-141b-464b-b5d3-b61a509a4d15 tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] 10.222.0.58 "GET /compute/v2.1/servers/ba82fd6a-d3bf-4fd3-83e0-09103eafca25" status: 200 len: 1315 microversion: 2.1 time: 0.204616 Aug 10 23:07:23.817578 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1275/2588] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:07:23 2022] GET /compute/v2.1/servers/ba82fd6a-d3bf-4fd3-83e0-09103eafca25 => generated 1315 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:07:23.838868 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-a42ad4ad-d3ca-4812-bd6c-9024b5c2a52e tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:23.840039 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-a42ad4ad-d3ca-4812-bd6c-9024b5c2a52e tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] [instance: 8385348f-0651-486d-9b4a-2c884933edb1] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:23.851349 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a42ad4ad-d3ca-4812-bd6c-9024b5c2a52e tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:23.852155 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a42ad4ad-d3ca-4812-bd6c-9024b5c2a52e tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:23.853541 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a42ad4ad-d3ca-4812-bd6c-9024b5c2a52e tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:23.854596 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a42ad4ad-d3ca-4812-bd6c-9024b5c2a52e tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:23.855255 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a42ad4ad-d3ca-4812-bd6c-9024b5c2a52e tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:23.855843 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a42ad4ad-d3ca-4812-bd6c-9024b5c2a52e tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:24.046685 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-a42ad4ad-d3ca-4812-bd6c-9024b5c2a52e tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d79bf59dabe4c02aa5e27bf3b0bc1ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9af75fc4bbc4b63ae83b5f900f1aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:24.055753 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-a42ad4ad-d3ca-4812-bd6c-9024b5c2a52e tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d79bf59dabe4c02aa5e27bf3b0bc1ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9af75fc4bbc4b63ae83b5f900f1aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:24.057148 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-a42ad4ad-d3ca-4812-bd6c-9024b5c2a52e tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d79bf59dabe4c02aa5e27bf3b0bc1ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9af75fc4bbc4b63ae83b5f900f1aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:24.078257 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-a42ad4ad-d3ca-4812-bd6c-9024b5c2a52e tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] 10.222.0.58 "GET /compute/v2.1/servers/8385348f-0651-486d-9b4a-2c884933edb1" status: 200 len: 1447 microversion: 2.75 time: 0.259449 Aug 10 23:07:24.078886 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1276/2589] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:07:23 2022] GET /compute/v2.1/servers/8385348f-0651-486d-9b4a-2c884933edb1 => generated 1447 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:07:24.083930 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-60e5ed74-03a3-4bff-a950-5453554a040d tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:24.084722 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-60e5ed74-03a3-4bff-a950-5453554a040d tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] [instance: a632bb08-327b-4870-9f4e-90f8d0d863d0] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:24.101893 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-60e5ed74-03a3-4bff-a950-5453554a040d tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:24.103325 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-60e5ed74-03a3-4bff-a950-5453554a040d tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:24.103859 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-60e5ed74-03a3-4bff-a950-5453554a040d tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:24.104641 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-60e5ed74-03a3-4bff-a950-5453554a040d tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:24.105103 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-60e5ed74-03a3-4bff-a950-5453554a040d tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:24.105530 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-60e5ed74-03a3-4bff-a950-5453554a040d tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:24.264883 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-9c359b3a-ea7f-4bdb-8330-712533350eb5 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8899e278c9453fba0ab05c69b0b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46ac8b84bd649fa88897068dbfa5ce6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:24.284137 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-9c359b3a-ea7f-4bdb-8330-712533350eb5 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] 10.222.0.58 "GET /compute/v2.1/servers/85c138c8-9302-453b-8dc1-8f0002d79f1a" status: 200 len: 1515 microversion: 2.1 time: 0.826484 Aug 10 23:07:24.301423 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1314/2590] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:07:23 2022] GET /compute/v2.1/servers/85c138c8-9302-453b-8dc1-8f0002d79f1a => generated 1515 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:07:24.424848 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-094d649e-652e-4a22-aa37-1678d46ee97e tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:24.425475 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-094d649e-652e-4a22-aa37-1678d46ee97e tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] [instance: 45beadf1-a6da-49ab-9098-6b681b5184c9] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:24.439297 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-094d649e-652e-4a22-aa37-1678d46ee97e tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:24.439826 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-094d649e-652e-4a22-aa37-1678d46ee97e tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:24.441624 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-094d649e-652e-4a22-aa37-1678d46ee97e tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:24.445391 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-094d649e-652e-4a22-aa37-1678d46ee97e tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:24.448269 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-094d649e-652e-4a22-aa37-1678d46ee97e tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:24.462525 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-094d649e-652e-4a22-aa37-1678d46ee97e tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:24.619914 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-60e5ed74-03a3-4bff-a950-5453554a040d tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d235607afb4ba59ed6ac2908c6dc33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5881784cbc4d669ad7fa40880ed9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:24.630534 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-60e5ed74-03a3-4bff-a950-5453554a040d tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] 10.222.0.58 "GET /compute/v2.1/servers/a632bb08-327b-4870-9f4e-90f8d0d863d0" status: 200 len: 1316 microversion: 2.1 time: 0.550373 Aug 10 23:07:24.631173 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1277/2591] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:07:24 2022] GET /compute/v2.1/servers/a632bb08-327b-4870-9f4e-90f8d0d863d0 => generated 1316 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:07:24.840507 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-19e8ab01-cc9c-46e3-96e7-25fce9373435 tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:24.844490 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-094d649e-652e-4a22-aa37-1678d46ee97e tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1986185dc9b4df4affcc421365462f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597863bfebdc481188f1f30095da5396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:24.847970 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-19e8ab01-cc9c-46e3-96e7-25fce9373435 tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] [instance: ba82fd6a-d3bf-4fd3-83e0-09103eafca25] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:24.857636 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-094d649e-652e-4a22-aa37-1678d46ee97e tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] 10.222.0.58 "GET /compute/v2.1/servers/45beadf1-a6da-49ab-9098-6b681b5184c9" status: 200 len: 1678 microversion: 2.1 time: 0.437845 Aug 10 23:07:24.874807 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1315/2592] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:07:24 2022] GET /compute/v2.1/servers/45beadf1-a6da-49ab-9098-6b681b5184c9 => generated 1678 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:07:24.875573 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-19e8ab01-cc9c-46e3-96e7-25fce9373435 tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:24.875573 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-19e8ab01-cc9c-46e3-96e7-25fce9373435 tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:24.875573 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-19e8ab01-cc9c-46e3-96e7-25fce9373435 tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:24.875573 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-19e8ab01-cc9c-46e3-96e7-25fce9373435 tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:24.875917 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-19e8ab01-cc9c-46e3-96e7-25fce9373435 tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:24.875917 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-19e8ab01-cc9c-46e3-96e7-25fce9373435 tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:24.909523 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-19e8ab01-cc9c-46e3-96e7-25fce9373435 tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] HTTP exception thrown: Instance ba82fd6a-d3bf-4fd3-83e0-09103eafca25 could not be found. Aug 10 23:07:24.912842 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-19e8ab01-cc9c-46e3-96e7-25fce9373435 tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] Request method failure captured: Aug 10 23:07:24.912842 n-d-850468-14 devstack@n-api.service[122632]: request: GET /compute/v2.1/servers/ba82fd6a-d3bf-4fd3-83e0-09103eafca25 HTTP/1.1 Aug 10 23:07:24.912842 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:07:24.912842 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:07:24.912842 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:07:24.912842 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 23:07:24.912842 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:07:24.912842 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:07:24.912842 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:07:24.912842 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:07:24.912842 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9DoTzRGdUOhPfRFTnRTvOv3XzFnoAt1RCafPDtQM_w7HWrUkplr_wrmytRRsbLmZ8JsRNTqrOzPuvTsv-eRdzMD0k9IrTqN1mbBG4B-N0bAdGyxMetFkAhwPYT7HHfyKeg1SSN8NfPtWEvyY8cnUJ_ZsKmxEnvagPNuHeVpGY9cgpiA Aug 10 23:07:24.912842 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:07:24.912842 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:07:24.912842 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:07:24.912842 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:07:24.912842 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:07:24.912842 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:07:24.912842 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 2f4e0ba9683c4e15932b9554d698034e Aug 10 23:07:24.912842 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-608216130 Aug 10 23:07:24.912842 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:07:24.912842 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:07:24.914208 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2f4e0ba9683c4e15932b9554d698034e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2f4e0ba9683c4e15932b9554d698034e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2f4e0ba9683c4e15932b9554d698034e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2f4e0ba9683c4e15932b9554d698034e", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:07:24.914208 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-608216130 Aug 10 23:07:24.914208 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 2f4e0ba9683c4e15932b9554d698034e Aug 10 23:07:24.914208 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-608216130 Aug 10 23:07:24.914208 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-InstanceActionsNegativeTestJSON-608216130-project Aug 10 23:07:24.914208 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:07:24.914208 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:07:24.914208 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: eab18f771541437ca1bda46aec45dda5 Aug 10 23:07:24.914208 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-608216130-project Aug 10 23:07:24.914208 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:07:24.914208 n-d-850468-14 devstack@n-api.service[122632]: exception: Instance ba82fd6a-d3bf-4fd3-83e0-09103eafca25 could not be found. Aug 10 23:07:24.914208 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': 'ba82fd6a-d3bf-4fd3-83e0-09103eafca25'} Aug 10 23:07:24.915103 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:07:24.915103 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:07:24.915103 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:07:24.915103 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:07:24.915103 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:07:24.915103 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:07:24.915103 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:07:24.915103 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:07:24.915103 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:07:24.915103 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:07:24.915103 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba82fd6a-d3bf-4fd3-83e0-09103eafca25 could not be found. Aug 10 23:07:24.915103 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:07:24.915103 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:07:24.915103 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:07:24.915103 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:07:24.915103 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:07:24.915103 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:07:24.915103 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:07:24.915103 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:07:24.915103 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:07:24.916257 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:07:24.916257 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:07:24.916257 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:07:24.916257 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:07:24.916257 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:07:24.916257 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:07:24.916257 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:07:24.916257 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba82fd6a-d3bf-4fd3-83e0-09103eafca25 could not be found. Aug 10 23:07:24.916257 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:07:24.916257 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:07:24.916257 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:07:24.916257 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:07:24.916257 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:07:24.916257 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:07:24.916257 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:07:24.916257 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:07:24.916257 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba82fd6a-d3bf-4fd3-83e0-09103eafca25 could not be found. Aug 10 23:07:24.916257 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:07:24.917311 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-19e8ab01-cc9c-46e3-96e7-25fce9373435 tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] Returning 404 to user: Instance ba82fd6a-d3bf-4fd3-83e0-09103eafca25 could not be found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:07:24.917311 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-19e8ab01-cc9c-46e3-96e7-25fce9373435 tempest-InstanceActionsNegativeTestJSON-608216130 tempest-InstanceActionsNegativeTestJSON-608216130-project] 10.222.0.58 "GET /compute/v2.1/servers/ba82fd6a-d3bf-4fd3-83e0-09103eafca25" status: 404 len: 111 microversion: 2.1 time: 0.079086 Aug 10 23:07:24.917311 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1278/2593] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:07:24 2022] GET /compute/v2.1/servers/ba82fd6a-d3bf-4fd3-83e0-09103eafca25 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:07:25.106338 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-49880170-9ec1-4bc6-a7c0-170c9da39f6d tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:25.106993 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-49880170-9ec1-4bc6-a7c0-170c9da39f6d tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] [instance: 8385348f-0651-486d-9b4a-2c884933edb1] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:25.121836 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-49880170-9ec1-4bc6-a7c0-170c9da39f6d tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:25.122336 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-49880170-9ec1-4bc6-a7c0-170c9da39f6d tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:25.122795 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-49880170-9ec1-4bc6-a7c0-170c9da39f6d tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:25.123532 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-49880170-9ec1-4bc6-a7c0-170c9da39f6d tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:25.123987 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-49880170-9ec1-4bc6-a7c0-170c9da39f6d tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:25.126388 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-49880170-9ec1-4bc6-a7c0-170c9da39f6d tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:25.305509 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-ee65692c-e7e4-42cc-8ccf-923212a4a2ea tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:25.307115 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-ee65692c-e7e4-42cc-8ccf-923212a4a2ea tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] [instance: 85c138c8-9302-453b-8dc1-8f0002d79f1a] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:25.331442 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ee65692c-e7e4-42cc-8ccf-923212a4a2ea tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:25.332230 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ee65692c-e7e4-42cc-8ccf-923212a4a2ea tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:25.333014 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ee65692c-e7e4-42cc-8ccf-923212a4a2ea tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:25.333936 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ee65692c-e7e4-42cc-8ccf-923212a4a2ea tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:25.337190 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ee65692c-e7e4-42cc-8ccf-923212a4a2ea tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:25.338227 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ee65692c-e7e4-42cc-8ccf-923212a4a2ea tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:25.390024 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-49880170-9ec1-4bc6-a7c0-170c9da39f6d tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d79bf59dabe4c02aa5e27bf3b0bc1ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9af75fc4bbc4b63ae83b5f900f1aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:25.399641 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-49880170-9ec1-4bc6-a7c0-170c9da39f6d tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d79bf59dabe4c02aa5e27bf3b0bc1ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9af75fc4bbc4b63ae83b5f900f1aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:25.406822 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-49880170-9ec1-4bc6-a7c0-170c9da39f6d tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d79bf59dabe4c02aa5e27bf3b0bc1ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9af75fc4bbc4b63ae83b5f900f1aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:25.418668 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-49880170-9ec1-4bc6-a7c0-170c9da39f6d tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] 10.222.0.58 "GET /compute/v2.1/servers/8385348f-0651-486d-9b4a-2c884933edb1" status: 200 len: 1447 microversion: 2.75 time: 0.316856 Aug 10 23:07:25.437811 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1316/2594] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:07:25 2022] GET /compute/v2.1/servers/8385348f-0651-486d-9b4a-2c884933edb1 => generated 1447 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:07:25.654966 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-be69d18f-6bb4-4865-8176-f998d3485fff tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:25.656970 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-be69d18f-6bb4-4865-8176-f998d3485fff tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] [instance: a632bb08-327b-4870-9f4e-90f8d0d863d0] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:25.662059 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-ee65692c-e7e4-42cc-8ccf-923212a4a2ea tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8899e278c9453fba0ab05c69b0b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46ac8b84bd649fa88897068dbfa5ce6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:25.669124 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-be69d18f-6bb4-4865-8176-f998d3485fff tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:25.670330 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-be69d18f-6bb4-4865-8176-f998d3485fff tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:25.671030 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-be69d18f-6bb4-4865-8176-f998d3485fff tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:25.672551 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-be69d18f-6bb4-4865-8176-f998d3485fff tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:25.673750 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-be69d18f-6bb4-4865-8176-f998d3485fff tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:25.674580 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-ee65692c-e7e4-42cc-8ccf-923212a4a2ea tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] 10.222.0.58 "GET /compute/v2.1/servers/85c138c8-9302-453b-8dc1-8f0002d79f1a" status: 200 len: 1515 microversion: 2.1 time: 0.372909 Aug 10 23:07:25.675001 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-be69d18f-6bb4-4865-8176-f998d3485fff tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:25.679187 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1279/2595] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:07:25 2022] GET /compute/v2.1/servers/85c138c8-9302-453b-8dc1-8f0002d79f1a => generated 1515 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:07:25.795487 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-5c957854-f14d-4995-a649-3357d247b6fb req-ca285c3f-85de-4cfb-af82-63c16ffe905c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a632bb08-327b-4870-9f4e-90f8d0d863d0", "tag": "c03a409d-cb49-445d-9fc1-ff05f4b1ff2b"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:07:25.832314 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-5c957854-f14d-4995-a649-3357d247b6fb req-ca285c3f-85de-4cfb-af82-63c16ffe905c service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:25.837211 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-5c957854-f14d-4995-a649-3357d247b6fb req-ca285c3f-85de-4cfb-af82-63c16ffe905c service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:25.838581 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-5c957854-f14d-4995-a649-3357d247b6fb req-ca285c3f-85de-4cfb-af82-63c16ffe905c service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:25.885327 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-5c957854-f14d-4995-a649-3357d247b6fb req-ca285c3f-85de-4cfb-af82-63c16ffe905c service nova] Creating event network-changed:c03a409d-cb49-445d-9fc1-ff05f4b1ff2b for instance a632bb08-327b-4870-9f4e-90f8d0d863d0 on n-h1-850468-14 Aug 10 23:07:25.894610 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-5c957854-f14d-4995-a649-3357d247b6fb req-ca285c3f-85de-4cfb-af82-63c16ffe905c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103618 Aug 10 23:07:25.896434 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1280/2596] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:07:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:07:25.903874 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-f0355c1b-a3a9-4b4c-b4db-4dbb407ca7bb tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:25.904943 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-f0355c1b-a3a9-4b4c-b4db-4dbb407ca7bb tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] [instance: 45beadf1-a6da-49ab-9098-6b681b5184c9] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:25.915844 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f0355c1b-a3a9-4b4c-b4db-4dbb407ca7bb tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:25.916615 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f0355c1b-a3a9-4b4c-b4db-4dbb407ca7bb tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:25.917244 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f0355c1b-a3a9-4b4c-b4db-4dbb407ca7bb tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:25.918306 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f0355c1b-a3a9-4b4c-b4db-4dbb407ca7bb tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:25.919076 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f0355c1b-a3a9-4b4c-b4db-4dbb407ca7bb tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:25.920938 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f0355c1b-a3a9-4b4c-b4db-4dbb407ca7bb tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:26.105960 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-be69d18f-6bb4-4865-8176-f998d3485fff tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d235607afb4ba59ed6ac2908c6dc33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5881784cbc4d669ad7fa40880ed9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:26.120290 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-be69d18f-6bb4-4865-8176-f998d3485fff tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] 10.222.0.58 "GET /compute/v2.1/servers/a632bb08-327b-4870-9f4e-90f8d0d863d0" status: 200 len: 1316 microversion: 2.1 time: 0.470718 Aug 10 23:07:26.122453 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1317/2597] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:07:25 2022] GET /compute/v2.1/servers/a632bb08-327b-4870-9f4e-90f8d0d863d0 => generated 1316 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:07:26.428372 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-f0355c1b-a3a9-4b4c-b4db-4dbb407ca7bb tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1986185dc9b4df4affcc421365462f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597863bfebdc481188f1f30095da5396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:26.440900 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-f0355c1b-a3a9-4b4c-b4db-4dbb407ca7bb tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] 10.222.0.58 "GET /compute/v2.1/servers/45beadf1-a6da-49ab-9098-6b681b5184c9" status: 200 len: 1655 microversion: 2.1 time: 0.542148 Aug 10 23:07:26.443155 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1281/2598] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:07:25 2022] GET /compute/v2.1/servers/45beadf1-a6da-49ab-9098-6b681b5184c9 => generated 1655 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:07:26.457064 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-27db97c1-06eb-42f8-b0f7-b4d11c3cb2e3 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:26.458546 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-27db97c1-06eb-42f8-b0f7-b4d11c3cb2e3 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] [instance: 8385348f-0651-486d-9b4a-2c884933edb1] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:26.464436 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-d45cb9ff-4daa-442a-b723-5b68fb86a1c1 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:07:26.471059 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d45cb9ff-4daa-442a-b723-5b68fb86a1c1 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:26.471789 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d45cb9ff-4daa-442a-b723-5b68fb86a1c1 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:26.472250 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-27db97c1-06eb-42f8-b0f7-b4d11c3cb2e3 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:26.472664 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d45cb9ff-4daa-442a-b723-5b68fb86a1c1 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:26.474131 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-27db97c1-06eb-42f8-b0f7-b4d11c3cb2e3 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:26.474711 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-27db97c1-06eb-42f8-b0f7-b4d11c3cb2e3 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:26.475579 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-27db97c1-06eb-42f8-b0f7-b4d11c3cb2e3 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:26.477122 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-27db97c1-06eb-42f8-b0f7-b4d11c3cb2e3 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:26.492724 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-27db97c1-06eb-42f8-b0f7-b4d11c3cb2e3 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:26.501621 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-d45cb9ff-4daa-442a-b723-5b68fb86a1c1 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] [instance: 45beadf1-a6da-49ab-9098-6b681b5184c9] Going to try to start instance {{(pid=122632) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 10 23:07:26.601659 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-d45cb9ff-4daa-442a-b723-5b68fb86a1c1 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] 10.222.0.58 "POST /compute/v2.1/servers/45beadf1-a6da-49ab-9098-6b681b5184c9/action" status: 202 len: 0 microversion: 2.1 time: 0.141971 Aug 10 23:07:26.608162 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1282/2599] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:07:26 2022] POST /compute/v2.1/servers/45beadf1-a6da-49ab-9098-6b681b5184c9/action => generated 0 bytes in 149 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:07:26.615780 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-115cb998-566e-4240-a391-2f791b1729e2 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:26.617281 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-115cb998-566e-4240-a391-2f791b1729e2 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] [instance: 45beadf1-a6da-49ab-9098-6b681b5184c9] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:26.626591 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-115cb998-566e-4240-a391-2f791b1729e2 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:26.627241 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-115cb998-566e-4240-a391-2f791b1729e2 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:26.627790 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-115cb998-566e-4240-a391-2f791b1729e2 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:26.628583 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-115cb998-566e-4240-a391-2f791b1729e2 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:26.629104 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-115cb998-566e-4240-a391-2f791b1729e2 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:26.629594 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-115cb998-566e-4240-a391-2f791b1729e2 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:26.670772 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-27db97c1-06eb-42f8-b0f7-b4d11c3cb2e3 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d79bf59dabe4c02aa5e27bf3b0bc1ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9af75fc4bbc4b63ae83b5f900f1aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:26.684767 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-27db97c1-06eb-42f8-b0f7-b4d11c3cb2e3 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d79bf59dabe4c02aa5e27bf3b0bc1ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9af75fc4bbc4b63ae83b5f900f1aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:26.690836 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-27db97c1-06eb-42f8-b0f7-b4d11c3cb2e3 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d79bf59dabe4c02aa5e27bf3b0bc1ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9af75fc4bbc4b63ae83b5f900f1aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:26.698546 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-27db97c1-06eb-42f8-b0f7-b4d11c3cb2e3 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] 10.222.0.58 "GET /compute/v2.1/servers/8385348f-0651-486d-9b4a-2c884933edb1" status: 200 len: 1453 microversion: 2.75 time: 0.253142 Aug 10 23:07:26.712685 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1318/2600] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:07:26 2022] GET /compute/v2.1/servers/8385348f-0651-486d-9b4a-2c884933edb1 => generated 1453 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:07:26.726328 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c8d1e431-a810-43e2-a738-b6151a02b204 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:26.728128 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-c8d1e431-a810-43e2-a738-b6151a02b204 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] [instance: 85c138c8-9302-453b-8dc1-8f0002d79f1a] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:26.737159 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c8d1e431-a810-43e2-a738-b6151a02b204 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:26.738049 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c8d1e431-a810-43e2-a738-b6151a02b204 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:26.738711 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c8d1e431-a810-43e2-a738-b6151a02b204 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:26.739692 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c8d1e431-a810-43e2-a738-b6151a02b204 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:26.740548 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c8d1e431-a810-43e2-a738-b6151a02b204 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:26.741332 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c8d1e431-a810-43e2-a738-b6151a02b204 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:27.207085 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-c8d1e431-a810-43e2-a738-b6151a02b204 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8899e278c9453fba0ab05c69b0b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46ac8b84bd649fa88897068dbfa5ce6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:27.228070 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-c8d1e431-a810-43e2-a738-b6151a02b204 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] 10.222.0.58 "GET /compute/v2.1/servers/85c138c8-9302-453b-8dc1-8f0002d79f1a" status: 200 len: 1515 microversion: 2.1 time: 0.507270 Aug 10 23:07:27.232054 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1319/2601] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:07:26 2022] GET /compute/v2.1/servers/85c138c8-9302-453b-8dc1-8f0002d79f1a => generated 1515 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:07:27.237264 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-bb8970cb-17a4-4ac8-abf2-36a82913888f tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:27.238190 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-bb8970cb-17a4-4ac8-abf2-36a82913888f tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] [instance: a632bb08-327b-4870-9f4e-90f8d0d863d0] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:27.246348 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bb8970cb-17a4-4ac8-abf2-36a82913888f tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:27.247391 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bb8970cb-17a4-4ac8-abf2-36a82913888f tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:27.248304 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bb8970cb-17a4-4ac8-abf2-36a82913888f tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:27.249247 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bb8970cb-17a4-4ac8-abf2-36a82913888f tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:27.249916 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bb8970cb-17a4-4ac8-abf2-36a82913888f tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:27.250552 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bb8970cb-17a4-4ac8-abf2-36a82913888f tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:27.504812 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-bb8970cb-17a4-4ac8-abf2-36a82913888f tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d235607afb4ba59ed6ac2908c6dc33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5881784cbc4d669ad7fa40880ed9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:27.513205 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-bb8970cb-17a4-4ac8-abf2-36a82913888f tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] 10.222.0.58 "GET /compute/v2.1/servers/a632bb08-327b-4870-9f4e-90f8d0d863d0" status: 200 len: 1316 microversion: 2.1 time: 0.279647 Aug 10 23:07:27.527492 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1320/2602] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:07:27 2022] GET /compute/v2.1/servers/a632bb08-327b-4870-9f4e-90f8d0d863d0 => generated 1316 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:07:27.625327 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-115cb998-566e-4240-a391-2f791b1729e2 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1986185dc9b4df4affcc421365462f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597863bfebdc481188f1f30095da5396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:27.638287 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-115cb998-566e-4240-a391-2f791b1729e2 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] 10.222.0.58 "GET /compute/v2.1/servers/45beadf1-a6da-49ab-9098-6b681b5184c9" status: 200 len: 1664 microversion: 2.1 time: 1.028473 Aug 10 23:07:27.654117 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1283/2603] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:07:26 2022] GET /compute/v2.1/servers/45beadf1-a6da-49ab-9098-6b681b5184c9 => generated 1664 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:07:27.729387 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c7b21fdd-153b-4f3c-8abd-11913e9b7681 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:27.737436 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-c7b21fdd-153b-4f3c-8abd-11913e9b7681 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] [instance: 8385348f-0651-486d-9b4a-2c884933edb1] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:27.749068 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c7b21fdd-153b-4f3c-8abd-11913e9b7681 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:27.749811 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c7b21fdd-153b-4f3c-8abd-11913e9b7681 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:27.750497 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c7b21fdd-153b-4f3c-8abd-11913e9b7681 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:27.752389 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c7b21fdd-153b-4f3c-8abd-11913e9b7681 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:27.753094 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c7b21fdd-153b-4f3c-8abd-11913e9b7681 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:27.753729 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c7b21fdd-153b-4f3c-8abd-11913e9b7681 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:27.840827 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-c7b21fdd-153b-4f3c-8abd-11913e9b7681 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d79bf59dabe4c02aa5e27bf3b0bc1ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9af75fc4bbc4b63ae83b5f900f1aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:27.850285 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-c7b21fdd-153b-4f3c-8abd-11913e9b7681 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d79bf59dabe4c02aa5e27bf3b0bc1ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9af75fc4bbc4b63ae83b5f900f1aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:27.852777 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-c7b21fdd-153b-4f3c-8abd-11913e9b7681 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d79bf59dabe4c02aa5e27bf3b0bc1ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9af75fc4bbc4b63ae83b5f900f1aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:27.859594 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-c7b21fdd-153b-4f3c-8abd-11913e9b7681 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] 10.222.0.58 "GET /compute/v2.1/servers/8385348f-0651-486d-9b4a-2c884933edb1" status: 200 len: 1453 microversion: 2.75 time: 0.136014 Aug 10 23:07:27.860465 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1321/2604] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:07:27 2022] GET /compute/v2.1/servers/8385348f-0651-486d-9b4a-2c884933edb1 => generated 1453 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:07:28.276784 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-62ea85db-26a8-4c0d-a6c6-35de7852da27 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:28.279650 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-62ea85db-26a8-4c0d-a6c6-35de7852da27 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] [instance: 85c138c8-9302-453b-8dc1-8f0002d79f1a] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:28.285296 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=2 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:07:28.301528 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-62ea85db-26a8-4c0d-a6c6-35de7852da27 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:28.302031 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-62ea85db-26a8-4c0d-a6c6-35de7852da27 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:28.302527 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-62ea85db-26a8-4c0d-a6c6-35de7852da27 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:28.307244 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-62ea85db-26a8-4c0d-a6c6-35de7852da27 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:28.307753 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-62ea85db-26a8-4c0d-a6c6-35de7852da27 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:28.308195 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-62ea85db-26a8-4c0d-a6c6-35de7852da27 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:28.535303 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-5d6cf8d6-9d3b-45d2-b637-a2d380baac3d tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:28.536196 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-5d6cf8d6-9d3b-45d2-b637-a2d380baac3d tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] [instance: a632bb08-327b-4870-9f4e-90f8d0d863d0] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:28.546774 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5d6cf8d6-9d3b-45d2-b637-a2d380baac3d tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:28.547299 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5d6cf8d6-9d3b-45d2-b637-a2d380baac3d tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:28.547734 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5d6cf8d6-9d3b-45d2-b637-a2d380baac3d tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:28.548896 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5d6cf8d6-9d3b-45d2-b637-a2d380baac3d tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:28.549355 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5d6cf8d6-9d3b-45d2-b637-a2d380baac3d tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:28.549814 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5d6cf8d6-9d3b-45d2-b637-a2d380baac3d tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:28.554351 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:07:28.824033 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=8 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:07:28.939335 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-62ea85db-26a8-4c0d-a6c6-35de7852da27 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8899e278c9453fba0ab05c69b0b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46ac8b84bd649fa88897068dbfa5ce6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:28.952173 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-62ea85db-26a8-4c0d-a6c6-35de7852da27 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] 10.222.0.58 "GET /compute/v2.1/servers/85c138c8-9302-453b-8dc1-8f0002d79f1a" status: 200 len: 1515 microversion: 2.1 time: 0.703641 Aug 10 23:07:28.954902 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1284/2605] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:07:28 2022] GET /compute/v2.1/servers/85c138c8-9302-453b-8dc1-8f0002d79f1a => generated 1515 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:07:28.960567 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-2004a252-64fe-4a65-976c-7cd8b63cdfc5 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:28.961404 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-2004a252-64fe-4a65-976c-7cd8b63cdfc5 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] [instance: 45beadf1-a6da-49ab-9098-6b681b5184c9] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:28.976237 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2004a252-64fe-4a65-976c-7cd8b63cdfc5 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:28.977054 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2004a252-64fe-4a65-976c-7cd8b63cdfc5 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:28.977863 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2004a252-64fe-4a65-976c-7cd8b63cdfc5 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:28.979257 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2004a252-64fe-4a65-976c-7cd8b63cdfc5 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:28.979864 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2004a252-64fe-4a65-976c-7cd8b63cdfc5 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:28.980669 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2004a252-64fe-4a65-976c-7cd8b63cdfc5 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:29.011884 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-5d6cf8d6-9d3b-45d2-b637-a2d380baac3d tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d235607afb4ba59ed6ac2908c6dc33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5881784cbc4d669ad7fa40880ed9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:29.021923 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-5d6cf8d6-9d3b-45d2-b637-a2d380baac3d tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] 10.222.0.58 "GET /compute/v2.1/servers/a632bb08-327b-4870-9f4e-90f8d0d863d0" status: 200 len: 1316 microversion: 2.1 time: 0.491563 Aug 10 23:07:29.022620 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1322/2606] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:07:28 2022] GET /compute/v2.1/servers/a632bb08-327b-4870-9f4e-90f8d0d863d0 => generated 1316 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:07:29.028528 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-51f8fa68-42b6-415d-a1dc-8ac3ea8d01ff tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:29.029764 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-51f8fa68-42b6-415d-a1dc-8ac3ea8d01ff tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] [instance: 8385348f-0651-486d-9b4a-2c884933edb1] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:29.037244 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-51f8fa68-42b6-415d-a1dc-8ac3ea8d01ff tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:29.037760 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-51f8fa68-42b6-415d-a1dc-8ac3ea8d01ff tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:29.038212 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-51f8fa68-42b6-415d-a1dc-8ac3ea8d01ff tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:29.039092 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-51f8fa68-42b6-415d-a1dc-8ac3ea8d01ff tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:29.040138 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-51f8fa68-42b6-415d-a1dc-8ac3ea8d01ff tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:29.040704 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-51f8fa68-42b6-415d-a1dc-8ac3ea8d01ff tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:29.121788 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-51f8fa68-42b6-415d-a1dc-8ac3ea8d01ff tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d79bf59dabe4c02aa5e27bf3b0bc1ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9af75fc4bbc4b63ae83b5f900f1aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:29.132574 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-51f8fa68-42b6-415d-a1dc-8ac3ea8d01ff tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d79bf59dabe4c02aa5e27bf3b0bc1ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9af75fc4bbc4b63ae83b5f900f1aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:29.135267 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-51f8fa68-42b6-415d-a1dc-8ac3ea8d01ff tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d79bf59dabe4c02aa5e27bf3b0bc1ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9af75fc4bbc4b63ae83b5f900f1aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:29.145320 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-51f8fa68-42b6-415d-a1dc-8ac3ea8d01ff tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] 10.222.0.58 "GET /compute/v2.1/servers/8385348f-0651-486d-9b4a-2c884933edb1" status: 200 len: 1438 microversion: 2.75 time: 0.121346 Aug 10 23:07:29.146214 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1323/2607] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:07:29 2022] GET /compute/v2.1/servers/8385348f-0651-486d-9b4a-2c884933edb1 => generated 1438 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:07:29.498292 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-7ffdcf52-37e4-4e34-9f2d-401d009e4409 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed"}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:07:29.503197 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-7ffdcf52-37e4-4e34-9f2d-401d009e4409 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] [instance: 8385348f-0651-486d-9b4a-2c884933edb1] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:29.515105 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7ffdcf52-37e4-4e34-9f2d-401d009e4409 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:29.515105 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7ffdcf52-37e4-4e34-9f2d-401d009e4409 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:29.515105 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7ffdcf52-37e4-4e34-9f2d-401d009e4409 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:29.515105 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7ffdcf52-37e4-4e34-9f2d-401d009e4409 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:29.518601 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7ffdcf52-37e4-4e34-9f2d-401d009e4409 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:29.518601 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7ffdcf52-37e4-4e34-9f2d-401d009e4409 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:29.668910 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-7ffdcf52-37e4-4e34-9f2d-401d009e4409 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Flavor limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:07:29.669719 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-7ffdcf52-37e4-4e34-9f2d-401d009e4409 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Image limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:07:29.670401 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-7ffdcf52-37e4-4e34-9f2d-401d009e4409 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Flavor pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:07:29.670992 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-7ffdcf52-37e4-4e34-9f2d-401d009e4409 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Image pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:07:29.671567 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-7ffdcf52-37e4-4e34-9f2d-401d009e4409 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:07:29.752026 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-7ffdcf52-37e4-4e34-9f2d-401d009e4409 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] [instance: 8385348f-0651-486d-9b4a-2c884933edb1] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:29.761935 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7ffdcf52-37e4-4e34-9f2d-401d009e4409 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:29.764235 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7ffdcf52-37e4-4e34-9f2d-401d009e4409 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:29.765080 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7ffdcf52-37e4-4e34-9f2d-401d009e4409 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:29.766595 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7ffdcf52-37e4-4e34-9f2d-401d009e4409 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:29.767375 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7ffdcf52-37e4-4e34-9f2d-401d009e4409 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:29.768075 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7ffdcf52-37e4-4e34-9f2d-401d009e4409 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:30.117486 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-2004a252-64fe-4a65-976c-7cd8b63cdfc5 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1986185dc9b4df4affcc421365462f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597863bfebdc481188f1f30095da5396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:30.131507 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.objects.instance [None req-7ffdcf52-37e4-4e34-9f2d-401d009e4409 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Lazy-loading 'services' on Instance uuid 8385348f-0651-486d-9b4a-2c884933edb1 {{(pid=122633) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:07:30.218127 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-2004a252-64fe-4a65-976c-7cd8b63cdfc5 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] 10.222.0.58 "GET /compute/v2.1/servers/45beadf1-a6da-49ab-9098-6b681b5184c9" status: 200 len: 1668 microversion: 2.1 time: 1.261419 Aug 10 23:07:30.220216 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-7ffdcf52-37e4-4e34-9f2d-401d009e4409 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/8385348f-0651-486d-9b4a-2c884933edb1/action" status: 202 len: 1944 microversion: 2.75 time: 1.030542 Aug 10 23:07:30.224560 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1324/2608] 10.222.0.58 () {62 vars in 1319 bytes} [Wed Aug 10 23:07:29 2022] POST /compute/v2.1/servers/8385348f-0651-486d-9b4a-2c884933edb1/action => generated 1944 bytes in 1035 msecs (HTTP/1.1 202) 10 headers in 454 bytes (2 switches on core 0) Aug 10 23:07:30.240672 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-93dda750-4112-41c8-bf1c-080f808ddcbc tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:30.242556 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-93dda750-4112-41c8-bf1c-080f808ddcbc tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] [instance: 85c138c8-9302-453b-8dc1-8f0002d79f1a] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:30.266138 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-93dda750-4112-41c8-bf1c-080f808ddcbc tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:30.270905 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-93dda750-4112-41c8-bf1c-080f808ddcbc tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:30.271643 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-93dda750-4112-41c8-bf1c-080f808ddcbc tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:30.272320 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1285/2609] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:07:28 2022] GET /compute/v2.1/servers/45beadf1-a6da-49ab-9098-6b681b5184c9 => generated 1668 bytes in 1317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:07:30.275919 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-93dda750-4112-41c8-bf1c-080f808ddcbc tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:30.277518 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-93dda750-4112-41c8-bf1c-080f808ddcbc tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:30.278508 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-93dda750-4112-41c8-bf1c-080f808ddcbc tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:30.288683 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-bdba770a-a375-445d-9f03-a50c087b6d2b tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:30.293849 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-bdba770a-a375-445d-9f03-a50c087b6d2b tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] [instance: a632bb08-327b-4870-9f4e-90f8d0d863d0] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:30.325262 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bdba770a-a375-445d-9f03-a50c087b6d2b tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:30.326894 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bdba770a-a375-445d-9f03-a50c087b6d2b tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:30.328637 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bdba770a-a375-445d-9f03-a50c087b6d2b tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:30.331263 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bdba770a-a375-445d-9f03-a50c087b6d2b tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:30.331975 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bdba770a-a375-445d-9f03-a50c087b6d2b tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:30.334098 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bdba770a-a375-445d-9f03-a50c087b6d2b tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:30.347814 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:07:30.626000 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-93dda750-4112-41c8-bf1c-080f808ddcbc tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8899e278c9453fba0ab05c69b0b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46ac8b84bd649fa88897068dbfa5ce6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:30.640466 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-93dda750-4112-41c8-bf1c-080f808ddcbc tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] 10.222.0.58 "GET /compute/v2.1/servers/85c138c8-9302-453b-8dc1-8f0002d79f1a" status: 200 len: 1515 microversion: 2.1 time: 0.414780 Aug 10 23:07:30.641816 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1325/2610] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:07:30 2022] GET /compute/v2.1/servers/85c138c8-9302-453b-8dc1-8f0002d79f1a => generated 1515 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:07:30.647642 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-6001bd2e-cc5d-42d4-9f7d-3ade4e76f160 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:30.648773 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-6001bd2e-cc5d-42d4-9f7d-3ade4e76f160 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] [instance: 8385348f-0651-486d-9b4a-2c884933edb1] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:30.657806 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6001bd2e-cc5d-42d4-9f7d-3ade4e76f160 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:30.658612 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6001bd2e-cc5d-42d4-9f7d-3ade4e76f160 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:30.659486 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6001bd2e-cc5d-42d4-9f7d-3ade4e76f160 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:30.660685 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6001bd2e-cc5d-42d4-9f7d-3ade4e76f160 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:30.661357 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6001bd2e-cc5d-42d4-9f7d-3ade4e76f160 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:30.662025 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6001bd2e-cc5d-42d4-9f7d-3ade4e76f160 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:30.748554 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.objects.instance [None req-6001bd2e-cc5d-42d4-9f7d-3ade4e76f160 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Lazy-loading 'services' on Instance uuid 8385348f-0651-486d-9b4a-2c884933edb1 {{(pid=122633) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:07:30.769231 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-6001bd2e-cc5d-42d4-9f7d-3ade4e76f160 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/8385348f-0651-486d-9b4a-2c884933edb1" status: 200 len: 1931 microversion: 2.75 time: 0.125946 Aug 10 23:07:30.770945 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1326/2611] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:07:30 2022] GET /compute/v2.1/servers/8385348f-0651-486d-9b4a-2c884933edb1 => generated 1931 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:07:31.494478 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-bdba770a-a375-445d-9f03-a50c087b6d2b tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d235607afb4ba59ed6ac2908c6dc33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5881784cbc4d669ad7fa40880ed9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:31.537278 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-bdba770a-a375-445d-9f03-a50c087b6d2b tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] 10.222.0.58 "GET /compute/v2.1/servers/a632bb08-327b-4870-9f4e-90f8d0d863d0" status: 200 len: 1316 microversion: 2.1 time: 1.263723 Aug 10 23:07:31.537873 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1286/2612] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:07:30 2022] GET /compute/v2.1/servers/a632bb08-327b-4870-9f4e-90f8d0d863d0 => generated 1316 bytes in 1265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:07:31.663259 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-d7bba970-1069-4c52-bc9a-99458131b523 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:31.664599 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-d7bba970-1069-4c52-bc9a-99458131b523 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] [instance: 85c138c8-9302-453b-8dc1-8f0002d79f1a] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:31.678889 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d7bba970-1069-4c52-bc9a-99458131b523 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:31.683765 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d7bba970-1069-4c52-bc9a-99458131b523 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:31.684476 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d7bba970-1069-4c52-bc9a-99458131b523 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:31.685411 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d7bba970-1069-4c52-bc9a-99458131b523 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:31.687452 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d7bba970-1069-4c52-bc9a-99458131b523 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:31.688077 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d7bba970-1069-4c52-bc9a-99458131b523 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:31.801160 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c532bf85-48b1-41eb-b5b9-5e25b75a1e62 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:31.803719 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-c532bf85-48b1-41eb-b5b9-5e25b75a1e62 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] [instance: 8385348f-0651-486d-9b4a-2c884933edb1] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:31.817320 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c532bf85-48b1-41eb-b5b9-5e25b75a1e62 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:31.819073 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c532bf85-48b1-41eb-b5b9-5e25b75a1e62 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:31.819714 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c532bf85-48b1-41eb-b5b9-5e25b75a1e62 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:31.824471 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c532bf85-48b1-41eb-b5b9-5e25b75a1e62 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:31.825658 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c532bf85-48b1-41eb-b5b9-5e25b75a1e62 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:31.826253 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c532bf85-48b1-41eb-b5b9-5e25b75a1e62 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:31.988126 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-d7bba970-1069-4c52-bc9a-99458131b523 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8899e278c9453fba0ab05c69b0b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46ac8b84bd649fa88897068dbfa5ce6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:32.000970 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-d7bba970-1069-4c52-bc9a-99458131b523 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] 10.222.0.58 "GET /compute/v2.1/servers/85c138c8-9302-453b-8dc1-8f0002d79f1a" status: 200 len: 1533 microversion: 2.1 time: 0.343238 Aug 10 23:07:32.002974 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1327/2613] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:07:31 2022] GET /compute/v2.1/servers/85c138c8-9302-453b-8dc1-8f0002d79f1a => generated 1533 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:07:32.191438 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.objects.instance [None req-c532bf85-48b1-41eb-b5b9-5e25b75a1e62 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Lazy-loading 'services' on Instance uuid 8385348f-0651-486d-9b4a-2c884933edb1 {{(pid=122632) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:07:32.241987 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-c532bf85-48b1-41eb-b5b9-5e25b75a1e62 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/8385348f-0651-486d-9b4a-2c884933edb1" status: 200 len: 1931 microversion: 2.75 time: 0.444633 Aug 10 23:07:32.242595 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1287/2614] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:07:31 2022] GET /compute/v2.1/servers/8385348f-0651-486d-9b4a-2c884933edb1 => generated 1931 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 23:07:32.561008 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-a829fb20-335c-4ab5-9d78-931708b26117 tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:32.561554 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-a829fb20-335c-4ab5-9d78-931708b26117 tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] [instance: a632bb08-327b-4870-9f4e-90f8d0d863d0] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:32.579122 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a829fb20-335c-4ab5-9d78-931708b26117 tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:32.580200 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a829fb20-335c-4ab5-9d78-931708b26117 tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:32.584104 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a829fb20-335c-4ab5-9d78-931708b26117 tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:32.587737 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a829fb20-335c-4ab5-9d78-931708b26117 tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:32.591978 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a829fb20-335c-4ab5-9d78-931708b26117 tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:32.593064 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a829fb20-335c-4ab5-9d78-931708b26117 tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:32.684866 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-9638b728-2c27-4e54-8cf8-336bcc9acd1d tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-893540413", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452", "networks": [{"uuid": "e5fd0b77-7856-4164-ad13-b6df1e05954f"}, {"uuid": "862771f3-6062-4e7f-8cfb-514bb4d957bf"}]}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:07:32.816249 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.network.neutron [None req-9638b728-2c27-4e54-8cf8-336bcc9acd1d tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] validate_networks() for [('e5fd0b77-7856-4164-ad13-b6df1e05954f', None, None, None, None, None), ('862771f3-6062-4e7f-8cfb-514bb4d957bf', None, None, None, None, None)] {{(pid=122632) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 23:07:33.285058 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-a829fb20-335c-4ab5-9d78-931708b26117 tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d235607afb4ba59ed6ac2908c6dc33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5881784cbc4d669ad7fa40880ed9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:33.294669 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-a829fb20-335c-4ab5-9d78-931708b26117 tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] 10.222.0.58 "GET /compute/v2.1/servers/a632bb08-327b-4870-9f4e-90f8d0d863d0" status: 200 len: 1316 microversion: 2.1 time: 0.738017 Aug 10 23:07:33.310225 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1328/2615] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:07:32 2022] GET /compute/v2.1/servers/a632bb08-327b-4870-9f4e-90f8d0d863d0 => generated 1316 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:07:33.316841 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-d9d9f147-9f36-40c0-9719-ed14e87ad741 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:33.319020 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-d9d9f147-9f36-40c0-9719-ed14e87ad741 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] [instance: 85c138c8-9302-453b-8dc1-8f0002d79f1a] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:33.342126 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d9d9f147-9f36-40c0-9719-ed14e87ad741 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:33.344142 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d9d9f147-9f36-40c0-9719-ed14e87ad741 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:33.344783 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d9d9f147-9f36-40c0-9719-ed14e87ad741 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:33.345717 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d9d9f147-9f36-40c0-9719-ed14e87ad741 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:33.346709 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d9d9f147-9f36-40c0-9719-ed14e87ad741 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:33.347351 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d9d9f147-9f36-40c0-9719-ed14e87ad741 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:34.276030 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-d9d9f147-9f36-40c0-9719-ed14e87ad741 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8899e278c9453fba0ab05c69b0b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46ac8b84bd649fa88897068dbfa5ce6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:34.286338 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-d9d9f147-9f36-40c0-9719-ed14e87ad741 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] 10.222.0.58 "GET /compute/v2.1/servers/85c138c8-9302-453b-8dc1-8f0002d79f1a" status: 200 len: 1521 microversion: 2.1 time: 0.974766 Aug 10 23:07:34.291736 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1329/2616] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:07:33 2022] GET /compute/v2.1/servers/85c138c8-9302-453b-8dc1-8f0002d79f1a => generated 1521 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:07:34.301688 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-d029f479-d3c9-446f-a660-e12a523b609d tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:34.303463 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-d029f479-d3c9-446f-a660-e12a523b609d tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] [instance: 8385348f-0651-486d-9b4a-2c884933edb1] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:34.336822 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d029f479-d3c9-446f-a660-e12a523b609d tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:34.337394 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d029f479-d3c9-446f-a660-e12a523b609d tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:34.337844 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d029f479-d3c9-446f-a660-e12a523b609d tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:34.338602 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d029f479-d3c9-446f-a660-e12a523b609d tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:34.339083 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d029f479-d3c9-446f-a660-e12a523b609d tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:34.342723 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d029f479-d3c9-446f-a660-e12a523b609d tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:34.555935 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.objects.instance [None req-d029f479-d3c9-446f-a660-e12a523b609d tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Lazy-loading 'services' on Instance uuid 8385348f-0651-486d-9b4a-2c884933edb1 {{(pid=122633) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:07:34.639440 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-d029f479-d3c9-446f-a660-e12a523b609d tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/8385348f-0651-486d-9b4a-2c884933edb1" status: 200 len: 1931 microversion: 2.75 time: 0.337339 Aug 10 23:07:34.641381 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1330/2617] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:07:34 2022] GET /compute/v2.1/servers/8385348f-0651-486d-9b4a-2c884933edb1 => generated 1931 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:07:34.646364 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-ac8edc0d-4e0a-4e7d-b8f0-b56cf277ca12 req-7c08f9c0-3e9f-4a10-9800-f9a99c0d2622 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a632bb08-327b-4870-9f4e-90f8d0d863d0", "name": "network-vif-plugged", "status": "completed", "tag": "c03a409d-cb49-445d-9fc1-ff05f4b1ff2b"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:07:34.657251 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-ac8edc0d-4e0a-4e7d-b8f0-b56cf277ca12 req-7c08f9c0-3e9f-4a10-9800-f9a99c0d2622 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:34.658098 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-ac8edc0d-4e0a-4e7d-b8f0-b56cf277ca12 req-7c08f9c0-3e9f-4a10-9800-f9a99c0d2622 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:34.658760 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-ac8edc0d-4e0a-4e7d-b8f0-b56cf277ca12 req-7c08f9c0-3e9f-4a10-9800-f9a99c0d2622 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:34.686646 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-ac8edc0d-4e0a-4e7d-b8f0-b56cf277ca12 req-7c08f9c0-3e9f-4a10-9800-f9a99c0d2622 service nova] Creating event network-vif-plugged:c03a409d-cb49-445d-9fc1-ff05f4b1ff2b for instance a632bb08-327b-4870-9f4e-90f8d0d863d0 on n-h1-850468-14 Aug 10 23:07:34.703426 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-ac8edc0d-4e0a-4e7d-b8f0-b56cf277ca12 req-7c08f9c0-3e9f-4a10-9800-f9a99c0d2622 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060436 Aug 10 23:07:34.704472 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1331/2618] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:07:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:07:34.709894 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-76f3586d-f475-47ee-a458-11538eb080ce tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:34.715048 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-76f3586d-f475-47ee-a458-11538eb080ce tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] [instance: a632bb08-327b-4870-9f4e-90f8d0d863d0] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:34.728747 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-76f3586d-f475-47ee-a458-11538eb080ce tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:34.733818 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-76f3586d-f475-47ee-a458-11538eb080ce tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:34.734706 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-76f3586d-f475-47ee-a458-11538eb080ce tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:34.735707 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-76f3586d-f475-47ee-a458-11538eb080ce tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:34.739708 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-76f3586d-f475-47ee-a458-11538eb080ce tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:34.740277 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-76f3586d-f475-47ee-a458-11538eb080ce tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:34.778689 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-9638b728-2c27-4e54-8cf8-336bcc9acd1d tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Flavor limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:07:34.779323 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-9638b728-2c27-4e54-8cf8-336bcc9acd1d tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Image limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:07:34.779592 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-9638b728-2c27-4e54-8cf8-336bcc9acd1d tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Flavor pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:07:34.779999 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-9638b728-2c27-4e54-8cf8-336bcc9acd1d tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Image pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:07:34.780587 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-9638b728-2c27-4e54-8cf8-336bcc9acd1d tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:07:34.795816 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9638b728-2c27-4e54-8cf8-336bcc9acd1d tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:34.799651 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9638b728-2c27-4e54-8cf8-336bcc9acd1d tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:34.800176 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9638b728-2c27-4e54-8cf8-336bcc9acd1d tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:34.803343 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9638b728-2c27-4e54-8cf8-336bcc9acd1d tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:34.803928 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9638b728-2c27-4e54-8cf8-336bcc9acd1d tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:34.804466 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9638b728-2c27-4e54-8cf8-336bcc9acd1d tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:34.858891 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-9638b728-2c27-4e54-8cf8-336bcc9acd1d tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Getting quotas for project c6473e36eada44e6bca8dc568e5ee330. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:07:34.870131 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-9638b728-2c27-4e54-8cf8-336bcc9acd1d tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Getting quotas for user a1c6e1f505b8409ea38f8a07bad870a8 and project c6473e36eada44e6bca8dc568e5ee330. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:07:34.895764 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-9638b728-2c27-4e54-8cf8-336bcc9acd1d tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Going to run 1 instances... {{(pid=122632) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 23:07:34.898442 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-9638b728-2c27-4e54-8cf8-336bcc9acd1d tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] [instance: 6fe68649-0e9b-4059-afb6-cc44844ff476] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78ad8905-f66f-4733-8be9-2b260f1fabed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122632) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 23:07:35.021302 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-9638b728-2c27-4e54-8cf8-336bcc9acd1d tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.341398 Aug 10 23:07:35.022677 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1288/2619] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 23:07:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 2343 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 10 23:07:35.034958 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-f88801ba-9220-4697-87e8-4956a6cb41a1 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:35.036123 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-f88801ba-9220-4697-87e8-4956a6cb41a1 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] [instance: 6fe68649-0e9b-4059-afb6-cc44844ff476] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:35.140028 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-76f3586d-f475-47ee-a458-11538eb080ce tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d235607afb4ba59ed6ac2908c6dc33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5881784cbc4d669ad7fa40880ed9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:35.151776 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-76f3586d-f475-47ee-a458-11538eb080ce tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] 10.222.0.58 "GET /compute/v2.1/servers/a632bb08-327b-4870-9f4e-90f8d0d863d0" status: 200 len: 1316 microversion: 2.1 time: 0.445863 Aug 10 23:07:35.152632 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1332/2620] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:07:34 2022] GET /compute/v2.1/servers/a632bb08-327b-4870-9f4e-90f8d0d863d0 => generated 1316 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:07:35.225363 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-f88801ba-9220-4697-87e8-4956a6cb41a1 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c6e1f505b8409ea38f8a07bad870a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6473e36eada44e6bca8dc568e5ee330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:35.244462 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-f88801ba-9220-4697-87e8-4956a6cb41a1 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] 10.222.0.58 "GET /compute/v2.1/servers/6fe68649-0e9b-4059-afb6-cc44844ff476" status: 200 len: 1212 microversion: 2.1 time: 0.214421 Aug 10 23:07:35.248079 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1289/2621] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:07:35 2022] GET /compute/v2.1/servers/6fe68649-0e9b-4059-afb6-cc44844ff476 => generated 1212 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:07:35.316875 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-bcce8318-3a50-4432-8f7c-25622cc52c51 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:35.318172 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-bcce8318-3a50-4432-8f7c-25622cc52c51 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] [instance: 85c138c8-9302-453b-8dc1-8f0002d79f1a] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:35.330876 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bcce8318-3a50-4432-8f7c-25622cc52c51 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:35.331657 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bcce8318-3a50-4432-8f7c-25622cc52c51 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:35.337604 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bcce8318-3a50-4432-8f7c-25622cc52c51 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:35.346909 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bcce8318-3a50-4432-8f7c-25622cc52c51 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:35.348357 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bcce8318-3a50-4432-8f7c-25622cc52c51 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:35.349092 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bcce8318-3a50-4432-8f7c-25622cc52c51 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:35.668963 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-9a66a074-a9ab-4772-b194-0ffec782b0b5 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:35.669816 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-9a66a074-a9ab-4772-b194-0ffec782b0b5 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] [instance: 8385348f-0651-486d-9b4a-2c884933edb1] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:35.681585 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9a66a074-a9ab-4772-b194-0ffec782b0b5 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:35.682923 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9a66a074-a9ab-4772-b194-0ffec782b0b5 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:35.684082 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9a66a074-a9ab-4772-b194-0ffec782b0b5 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:35.686261 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9a66a074-a9ab-4772-b194-0ffec782b0b5 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:35.688043 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9a66a074-a9ab-4772-b194-0ffec782b0b5 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:35.688492 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9a66a074-a9ab-4772-b194-0ffec782b0b5 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:35.742718 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-bcce8318-3a50-4432-8f7c-25622cc52c51 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8899e278c9453fba0ab05c69b0b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46ac8b84bd649fa88897068dbfa5ce6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:35.754508 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-bcce8318-3a50-4432-8f7c-25622cc52c51 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] 10.222.0.58 "GET /compute/v2.1/servers/85c138c8-9302-453b-8dc1-8f0002d79f1a" status: 200 len: 1521 microversion: 2.1 time: 0.442002 Aug 10 23:07:35.755611 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1333/2622] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:07:35 2022] GET /compute/v2.1/servers/85c138c8-9302-453b-8dc1-8f0002d79f1a => generated 1521 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:07:36.183720 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-652ffac8-6c54-4019-8482-8d02c2ebdb89 tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:36.184601 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-652ffac8-6c54-4019-8482-8d02c2ebdb89 tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] [instance: a632bb08-327b-4870-9f4e-90f8d0d863d0] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:36.203767 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-652ffac8-6c54-4019-8482-8d02c2ebdb89 tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:36.209200 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-652ffac8-6c54-4019-8482-8d02c2ebdb89 tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:36.210892 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-652ffac8-6c54-4019-8482-8d02c2ebdb89 tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:36.220281 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-652ffac8-6c54-4019-8482-8d02c2ebdb89 tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:36.220793 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-652ffac8-6c54-4019-8482-8d02c2ebdb89 tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:36.221426 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-652ffac8-6c54-4019-8482-8d02c2ebdb89 tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:36.371010 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.objects.instance [None req-9a66a074-a9ab-4772-b194-0ffec782b0b5 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Lazy-loading 'services' on Instance uuid 8385348f-0651-486d-9b4a-2c884933edb1 {{(pid=122632) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:07:36.433129 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-9a66a074-a9ab-4772-b194-0ffec782b0b5 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/8385348f-0651-486d-9b4a-2c884933edb1" status: 200 len: 1931 microversion: 2.75 time: 0.768251 Aug 10 23:07:36.436622 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1290/2623] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:07:35 2022] GET /compute/v2.1/servers/8385348f-0651-486d-9b4a-2c884933edb1 => generated 1931 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 23:07:36.450603 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-85abfd72-527d-4b01-b596-4da9f2ddada8 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:36.453191 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-85abfd72-527d-4b01-b596-4da9f2ddada8 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] [instance: 6fe68649-0e9b-4059-afb6-cc44844ff476] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:36.503838 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-85abfd72-527d-4b01-b596-4da9f2ddada8 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:36.504643 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-85abfd72-527d-4b01-b596-4da9f2ddada8 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:36.507930 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-85abfd72-527d-4b01-b596-4da9f2ddada8 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:36.514911 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-85abfd72-527d-4b01-b596-4da9f2ddada8 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:36.516313 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-85abfd72-527d-4b01-b596-4da9f2ddada8 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:36.517660 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-85abfd72-527d-4b01-b596-4da9f2ddada8 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:36.766391 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-85abfd72-527d-4b01-b596-4da9f2ddada8 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c6e1f505b8409ea38f8a07bad870a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6473e36eada44e6bca8dc568e5ee330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:36.782966 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-85abfd72-527d-4b01-b596-4da9f2ddada8 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] 10.222.0.58 "GET /compute/v2.1/servers/6fe68649-0e9b-4059-afb6-cc44844ff476" status: 200 len: 1208 microversion: 2.1 time: 0.345248 Aug 10 23:07:36.796161 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1291/2624] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:07:36 2022] GET /compute/v2.1/servers/6fe68649-0e9b-4059-afb6-cc44844ff476 => generated 1208 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:07:36.808632 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-4989d268-8b53-4f5f-86c7-68b166c33288 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:36.809892 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-4989d268-8b53-4f5f-86c7-68b166c33288 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] [instance: 85c138c8-9302-453b-8dc1-8f0002d79f1a] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:36.817891 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4989d268-8b53-4f5f-86c7-68b166c33288 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:36.818762 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4989d268-8b53-4f5f-86c7-68b166c33288 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:36.820005 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4989d268-8b53-4f5f-86c7-68b166c33288 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:36.821514 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4989d268-8b53-4f5f-86c7-68b166c33288 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:36.822234 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4989d268-8b53-4f5f-86c7-68b166c33288 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:36.823007 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4989d268-8b53-4f5f-86c7-68b166c33288 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:36.944747 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-652ffac8-6c54-4019-8482-8d02c2ebdb89 tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d235607afb4ba59ed6ac2908c6dc33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5881784cbc4d669ad7fa40880ed9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:36.967959 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-652ffac8-6c54-4019-8482-8d02c2ebdb89 tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] 10.222.0.58 "GET /compute/v2.1/servers/a632bb08-327b-4870-9f4e-90f8d0d863d0" status: 200 len: 1466 microversion: 2.1 time: 0.794479 Aug 10 23:07:36.969924 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1334/2625] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:07:36 2022] GET /compute/v2.1/servers/a632bb08-327b-4870-9f4e-90f8d0d863d0 => generated 1466 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:07:37.013775 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-0e9a826d-fb54-4d94-9eb0-d41ab690df54 tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-1057342130", "metadata": {"image_type": "test"}}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:07:37.019031 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-0e9a826d-fb54-4d94-9eb0-d41ab690df54 tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] [instance: a632bb08-327b-4870-9f4e-90f8d0d863d0] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:37.027588 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0e9a826d-fb54-4d94-9eb0-d41ab690df54 tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:37.028274 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0e9a826d-fb54-4d94-9eb0-d41ab690df54 tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:37.028878 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0e9a826d-fb54-4d94-9eb0-d41ab690df54 tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:37.029755 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0e9a826d-fb54-4d94-9eb0-d41ab690df54 tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:37.038995 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0e9a826d-fb54-4d94-9eb0-d41ab690df54 tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:37.039901 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0e9a826d-fb54-4d94-9eb0-d41ab690df54 tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:37.137883 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-0e9a826d-fb54-4d94-9eb0-d41ab690df54 tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Getting quotas for project de5881784cbc4d669ad7fa40880ed9c0. Resources: dict_keys(['metadata_items']) {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:07:37.144304 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-0e9a826d-fb54-4d94-9eb0-d41ab690df54 tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Getting quotas for user 10d235607afb4ba59ed6ac2908c6dc33 and project de5881784cbc4d669ad7fa40880ed9c0. Resources: dict_keys(['metadata_items']) {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:07:37.154840 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:07:37.220524 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-4989d268-8b53-4f5f-86c7-68b166c33288 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8899e278c9453fba0ab05c69b0b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46ac8b84bd649fa88897068dbfa5ce6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:37.233479 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-4989d268-8b53-4f5f-86c7-68b166c33288 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] 10.222.0.58 "GET /compute/v2.1/servers/85c138c8-9302-453b-8dc1-8f0002d79f1a" status: 200 len: 1521 microversion: 2.1 time: 0.435639 Aug 10 23:07:37.246677 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1292/2626] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:07:36 2022] GET /compute/v2.1/servers/85c138c8-9302-453b-8dc1-8f0002d79f1a => generated 1521 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:07:37.466227 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-6b1be583-25ab-4627-add9-404744bd8ed6 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:37.467765 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-6b1be583-25ab-4627-add9-404744bd8ed6 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] [instance: 8385348f-0651-486d-9b4a-2c884933edb1] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:37.510209 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6b1be583-25ab-4627-add9-404744bd8ed6 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:37.510774 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6b1be583-25ab-4627-add9-404744bd8ed6 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:37.511266 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6b1be583-25ab-4627-add9-404744bd8ed6 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:37.518376 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6b1be583-25ab-4627-add9-404744bd8ed6 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:37.519404 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6b1be583-25ab-4627-add9-404744bd8ed6 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:37.526630 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6b1be583-25ab-4627-add9-404744bd8ed6 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:37.670845 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-0e9a826d-fb54-4d94-9eb0-d41ab690df54 tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] 10.222.0.58 "POST /compute/v2.1/servers/a632bb08-327b-4870-9f4e-90f8d0d863d0/action" status: 202 len: 0 microversion: 2.1 time: 0.669067 Aug 10 23:07:37.671795 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1335/2627] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:07:36 2022] POST /compute/v2.1/servers/a632bb08-327b-4870-9f4e-90f8d0d863d0/action => generated 0 bytes in 672 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 10 23:07:37.707612 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-699a5ada-4fb9-4e5e-b3e8-14ce6bc6148c tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Calling method '.version_select at 0x7f847c8da160>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:37.787956 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-699a5ada-4fb9-4e5e-b3e8-14ce6bc6148c tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] 10.222.0.58 "GET /compute/v2.1/images/0f967916-982b-4b7c-bb3c-1ec6b8c4dd57" status: 200 len: 1422 microversion: 2.1 time: 0.103183 Aug 10 23:07:37.791107 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1336/2628] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 10 23:07:37 2022] GET /compute/v2.1/images/0f967916-982b-4b7c-bb3c-1ec6b8c4dd57 => generated 1422 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:07:37.810269 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-72175829-4588-4b34-9b1a-ac2fdfb4673c tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:37.812869 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-72175829-4588-4b34-9b1a-ac2fdfb4673c tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] [instance: 6fe68649-0e9b-4059-afb6-cc44844ff476] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:37.830565 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-72175829-4588-4b34-9b1a-ac2fdfb4673c tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:37.832238 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-72175829-4588-4b34-9b1a-ac2fdfb4673c tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:37.834915 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-72175829-4588-4b34-9b1a-ac2fdfb4673c tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:37.836403 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-72175829-4588-4b34-9b1a-ac2fdfb4673c tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:37.837942 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-72175829-4588-4b34-9b1a-ac2fdfb4673c tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:37.840158 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-72175829-4588-4b34-9b1a-ac2fdfb4673c tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:37.998839 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-72175829-4588-4b34-9b1a-ac2fdfb4673c tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c6e1f505b8409ea38f8a07bad870a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6473e36eada44e6bca8dc568e5ee330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:38.010324 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-72175829-4588-4b34-9b1a-ac2fdfb4673c tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] 10.222.0.58 "GET /compute/v2.1/servers/6fe68649-0e9b-4059-afb6-cc44844ff476" status: 200 len: 1270 microversion: 2.1 time: 0.204373 Aug 10 23:07:38.016284 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1337/2629] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:07:37 2022] GET /compute/v2.1/servers/6fe68649-0e9b-4059-afb6-cc44844ff476 => generated 1270 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:07:38.097259 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.objects.instance [None req-6b1be583-25ab-4627-add9-404744bd8ed6 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Lazy-loading 'services' on Instance uuid 8385348f-0651-486d-9b4a-2c884933edb1 {{(pid=122632) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:07:38.147406 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-6b1be583-25ab-4627-add9-404744bd8ed6 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/8385348f-0651-486d-9b4a-2c884933edb1" status: 200 len: 1931 microversion: 2.75 time: 0.688330 Aug 10 23:07:38.171000 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1293/2630] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:07:37 2022] GET /compute/v2.1/servers/8385348f-0651-486d-9b4a-2c884933edb1 => generated 1931 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 23:07:38.267689 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c0b8620c-bb43-442e-9667-0defcae0ced1 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:38.268333 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-c0b8620c-bb43-442e-9667-0defcae0ced1 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] [instance: 85c138c8-9302-453b-8dc1-8f0002d79f1a] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:38.281521 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c0b8620c-bb43-442e-9667-0defcae0ced1 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:38.282013 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c0b8620c-bb43-442e-9667-0defcae0ced1 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:38.282448 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c0b8620c-bb43-442e-9667-0defcae0ced1 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:38.283181 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c0b8620c-bb43-442e-9667-0defcae0ced1 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:38.283812 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c0b8620c-bb43-442e-9667-0defcae0ced1 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:38.284395 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c0b8620c-bb43-442e-9667-0defcae0ced1 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:38.806305 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-a61dc4d9-c58e-4572-8a17-235265d87d71 tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Calling method '.version_select at 0x7f847d1f3d30>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:38.895952 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-a61dc4d9-c58e-4572-8a17-235265d87d71 tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] 10.222.0.58 "GET /compute/v2.1/images/0f967916-982b-4b7c-bb3c-1ec6b8c4dd57" status: 200 len: 1422 microversion: 2.1 time: 0.094517 Aug 10 23:07:38.903679 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1294/2631] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 10 23:07:38 2022] GET /compute/v2.1/images/0f967916-982b-4b7c-bb3c-1ec6b8c4dd57 => generated 1422 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:07:39.037321 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-b1b20aa2-4803-4ecc-be27-cbd998409751 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:39.038100 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-b1b20aa2-4803-4ecc-be27-cbd998409751 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] [instance: 6fe68649-0e9b-4059-afb6-cc44844ff476] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:39.049572 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b1b20aa2-4803-4ecc-be27-cbd998409751 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:39.059503 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b1b20aa2-4803-4ecc-be27-cbd998409751 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:39.060120 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b1b20aa2-4803-4ecc-be27-cbd998409751 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:39.061114 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b1b20aa2-4803-4ecc-be27-cbd998409751 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:39.061685 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b1b20aa2-4803-4ecc-be27-cbd998409751 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:39.062219 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b1b20aa2-4803-4ecc-be27-cbd998409751 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:39.086051 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-c0b8620c-bb43-442e-9667-0defcae0ced1 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8899e278c9453fba0ab05c69b0b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46ac8b84bd649fa88897068dbfa5ce6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:39.100641 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-c0b8620c-bb43-442e-9667-0defcae0ced1 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] 10.222.0.58 "GET /compute/v2.1/servers/85c138c8-9302-453b-8dc1-8f0002d79f1a" status: 200 len: 1521 microversion: 2.1 time: 0.836775 Aug 10 23:07:39.109239 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1338/2632] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:07:38 2022] GET /compute/v2.1/servers/85c138c8-9302-453b-8dc1-8f0002d79f1a => generated 1521 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:07:39.175039 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-d1d9051f-1deb-47e8-a973-ca3d2a13dadf tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:39.176070 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-d1d9051f-1deb-47e8-a973-ca3d2a13dadf tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] [instance: 8385348f-0651-486d-9b4a-2c884933edb1] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:39.203407 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d1d9051f-1deb-47e8-a973-ca3d2a13dadf tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:39.205805 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d1d9051f-1deb-47e8-a973-ca3d2a13dadf tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:39.208528 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d1d9051f-1deb-47e8-a973-ca3d2a13dadf tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:39.212883 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d1d9051f-1deb-47e8-a973-ca3d2a13dadf tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:39.215169 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d1d9051f-1deb-47e8-a973-ca3d2a13dadf tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:39.216115 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d1d9051f-1deb-47e8-a973-ca3d2a13dadf tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:39.375774 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-b1b20aa2-4803-4ecc-be27-cbd998409751 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c6e1f505b8409ea38f8a07bad870a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6473e36eada44e6bca8dc568e5ee330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:39.391087 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-b1b20aa2-4803-4ecc-be27-cbd998409751 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] 10.222.0.58 "GET /compute/v2.1/servers/6fe68649-0e9b-4059-afb6-cc44844ff476" status: 200 len: 1312 microversion: 2.1 time: 0.357905 Aug 10 23:07:39.392080 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1295/2633] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:07:39 2022] GET /compute/v2.1/servers/6fe68649-0e9b-4059-afb6-cc44844ff476 => generated 1312 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:07:39.449603 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.objects.instance [None req-d1d9051f-1deb-47e8-a973-ca3d2a13dadf tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Lazy-loading 'services' on Instance uuid 8385348f-0651-486d-9b4a-2c884933edb1 {{(pid=122633) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:07:39.480954 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-95989bd0-22c8-441a-83d2-2f61a60f3d27 req-bed0c49a-a757-46a3-959b-61aa935c2665 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85c138c8-9302-453b-8dc1-8f0002d79f1a", "name": "network-vif-plugged", "status": "completed", "tag": "23b5445e-4fcc-47d3-96d2-0cd88c2ec431"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:07:39.500748 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-95989bd0-22c8-441a-83d2-2f61a60f3d27 req-bed0c49a-a757-46a3-959b-61aa935c2665 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:39.503710 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-95989bd0-22c8-441a-83d2-2f61a60f3d27 req-bed0c49a-a757-46a3-959b-61aa935c2665 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:39.504300 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-95989bd0-22c8-441a-83d2-2f61a60f3d27 req-bed0c49a-a757-46a3-959b-61aa935c2665 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:39.558676 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-d1d9051f-1deb-47e8-a973-ca3d2a13dadf tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/8385348f-0651-486d-9b4a-2c884933edb1" status: 200 len: 1931 microversion: 2.75 time: 0.387234 Aug 10 23:07:39.567002 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1339/2634] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:07:39 2022] GET /compute/v2.1/servers/8385348f-0651-486d-9b4a-2c884933edb1 => generated 1931 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 23:07:39.580663 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-95989bd0-22c8-441a-83d2-2f61a60f3d27 req-bed0c49a-a757-46a3-959b-61aa935c2665 service nova] Creating event network-vif-plugged:23b5445e-4fcc-47d3-96d2-0cd88c2ec431 for instance 85c138c8-9302-453b-8dc1-8f0002d79f1a on n-h2-850468-14 Aug 10 23:07:39.596112 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-95989bd0-22c8-441a-83d2-2f61a60f3d27 req-bed0c49a-a757-46a3-959b-61aa935c2665 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119670 Aug 10 23:07:39.604356 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1296/2635] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:07:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:07:39.913675 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-135e435e-c57d-43f6-beea-e739c7ba35c2 tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Calling method '.version_select at 0x7f847c5700d0>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:40.035711 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-135e435e-c57d-43f6-beea-e739c7ba35c2 tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] 10.222.0.58 "GET /compute/v2.1/images/0f967916-982b-4b7c-bb3c-1ec6b8c4dd57" status: 200 len: 1422 microversion: 2.1 time: 0.128582 Aug 10 23:07:40.036522 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1340/2636] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 10 23:07:39 2022] GET /compute/v2.1/images/0f967916-982b-4b7c-bb3c-1ec6b8c4dd57 => generated 1422 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:07:40.130865 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-2941c495-46cd-4c13-bfdf-5fc0ca067050 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:40.132247 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-2941c495-46cd-4c13-bfdf-5fc0ca067050 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] [instance: 85c138c8-9302-453b-8dc1-8f0002d79f1a] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:40.142459 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2941c495-46cd-4c13-bfdf-5fc0ca067050 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:40.143417 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2941c495-46cd-4c13-bfdf-5fc0ca067050 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:40.144192 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2941c495-46cd-4c13-bfdf-5fc0ca067050 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:40.146636 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2941c495-46cd-4c13-bfdf-5fc0ca067050 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:40.147503 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2941c495-46cd-4c13-bfdf-5fc0ca067050 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:40.148383 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2941c495-46cd-4c13-bfdf-5fc0ca067050 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:40.413763 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-cc7fdb32-1b5a-4017-aab0-0e869e3b327e tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:40.416216 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-cc7fdb32-1b5a-4017-aab0-0e869e3b327e tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] [instance: 6fe68649-0e9b-4059-afb6-cc44844ff476] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:40.427942 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-2941c495-46cd-4c13-bfdf-5fc0ca067050 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8899e278c9453fba0ab05c69b0b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46ac8b84bd649fa88897068dbfa5ce6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:40.429816 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:07:40.439403 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cc7fdb32-1b5a-4017-aab0-0e869e3b327e tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:40.439928 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cc7fdb32-1b5a-4017-aab0-0e869e3b327e tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:40.442549 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cc7fdb32-1b5a-4017-aab0-0e869e3b327e tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:40.443549 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cc7fdb32-1b5a-4017-aab0-0e869e3b327e tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:40.446084 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cc7fdb32-1b5a-4017-aab0-0e869e3b327e tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:40.446877 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cc7fdb32-1b5a-4017-aab0-0e869e3b327e tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:40.447530 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-2941c495-46cd-4c13-bfdf-5fc0ca067050 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] 10.222.0.58 "GET /compute/v2.1/servers/85c138c8-9302-453b-8dc1-8f0002d79f1a" status: 200 len: 1521 microversion: 2.1 time: 0.320380 Aug 10 23:07:40.467555 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1297/2637] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:07:40 2022] GET /compute/v2.1/servers/85c138c8-9302-453b-8dc1-8f0002d79f1a => generated 1521 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:07:40.722021 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-22cf1de9-25a0-4d91-9556-469a271b9bbd tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-315108774", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452", "networks": [{"uuid": "a39e9883-f478-46d6-a0c8-5018e7a936ff"}]}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:07:40.732300 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-cc7fdb32-1b5a-4017-aab0-0e869e3b327e tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c6e1f505b8409ea38f8a07bad870a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6473e36eada44e6bca8dc568e5ee330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:40.740009 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-cc7fdb32-1b5a-4017-aab0-0e869e3b327e tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] 10.222.0.58 "GET /compute/v2.1/servers/6fe68649-0e9b-4059-afb6-cc44844ff476" status: 200 len: 1312 microversion: 2.1 time: 0.331582 Aug 10 23:07:40.745947 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1341/2638] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:07:40 2022] GET /compute/v2.1/servers/6fe68649-0e9b-4059-afb6-cc44844ff476 => generated 1312 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:07:40.794561 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.network.neutron [None req-22cf1de9-25a0-4d91-9556-469a271b9bbd tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] validate_networks() for [('a39e9883-f478-46d6-a0c8-5018e7a936ff', None, None, None, None, None)] {{(pid=122632) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 23:07:40.855074 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-14bd66f3-4a86-44fc-9414-47bd3f32cdb3 tempest-MultipleCreateNegativeTestJSON-4633273 tempest-MultipleCreateNegativeTestJSON-4633273-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1822122527", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:07:40.858521 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-14bd66f3-4a86-44fc-9414-47bd3f32cdb3 tempest-MultipleCreateNegativeTestJSON-4633273 tempest-MultipleCreateNegativeTestJSON-4633273-project] HTTP exception thrown: min_count must be <= max_count Aug 10 23:07:40.862574 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-14bd66f3-4a86-44fc-9414-47bd3f32cdb3 tempest-MultipleCreateNegativeTestJSON-4633273 tempest-MultipleCreateNegativeTestJSON-4633273-project] Request method failure captured: Aug 10 23:07:40.862574 n-d-850468-14 devstack@n-api.service[122633]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 10 23:07:40.862574 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:07:40.862574 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:07:40.862574 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:07:40.862574 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 184 Aug 10 23:07:40.862574 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:07:40.862574 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:07:40.862574 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:07:40.862574 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:07:40.862574 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9Do80YYTYt5e845nnGYNuyx8muB88JmQkIWx88pQ9_oO2pchGBT3Gx4nN_18ra1Y2jrn7KVXqYvMtFafA0ppPlfKv3LOfZjeaRXmkdQUuKFaJVxJ9e5ikQzDE0QBZdCDUhSOeKJI092hF3AB3slDChrylYOWjcNgTScwQsza_rn28Fc Aug 10 23:07:40.862574 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:07:40.862574 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:07:40.862574 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:07:40.862574 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:07:40.862574 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:07:40.862574 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:07:40.862574 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 521624161d324e4aa0ad3b651113cfa8 Aug 10 23:07:40.862574 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-4633273 Aug 10 23:07:40.862574 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:07:40.862574 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:07:40.863999 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/521624161d324e4aa0ad3b651113cfa8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/521624161d324e4aa0ad3b651113cfa8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/521624161d324e4aa0ad3b651113cfa8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_521624161d324e4aa0ad3b651113cfa8", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:07:40.863999 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-4633273 Aug 10 23:07:40.863999 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 521624161d324e4aa0ad3b651113cfa8 Aug 10 23:07:40.863999 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-4633273 Aug 10 23:07:40.863999 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-MultipleCreateNegativeTestJSON-4633273-project Aug 10 23:07:40.863999 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:07:40.863999 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:07:40.863999 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: ea5051d93fe5499283c33584fd2d256d Aug 10 23:07:40.863999 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-4633273-project Aug 10 23:07:40.863999 n-d-850468-14 devstack@n-api.service[122633]: Aug 10 23:07:40.863999 n-d-850468-14 devstack@n-api.service[122633]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1822122527", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452", "min_count": 3, "max_count": 2}} Aug 10 23:07:40.864735 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:07:40.864735 n-d-850468-14 devstack@n-api.service[122633]: exception: min_count must be <= max_count Aug 10 23:07:40.864735 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1822122527', 'imageRef': '78ad8905-f66f-4733-8be9-2b260f1fabed', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Aug 10 23:07:40.864735 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:07:40.864735 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:07:40.864735 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:07:40.864735 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:07:40.864735 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:07:40.864735 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:07:40.864735 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:07:40.864735 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:07:40.864735 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 23:07:40.864735 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 23:07:40.864735 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 23:07:40.864735 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 23:07:40.864735 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 23:07:40.864735 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 23:07:40.864735 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 23:07:40.864735 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Aug 10 23:07:40.865995 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Aug 10 23:07:40.865995 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Aug 10 23:07:40.865995 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:07:40.865995 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:07:40.865995 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:07:40.865995 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:07:40.865995 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:07:40.865995 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:07:40.865995 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:07:40.865995 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:07:40.865995 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Aug 10 23:07:40.865995 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:07:40.875465 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-14bd66f3-4a86-44fc-9414-47bd3f32cdb3 tempest-MultipleCreateNegativeTestJSON-4633273 tempest-MultipleCreateNegativeTestJSON-4633273-project] Returning 400 to user: min_count must be <= max_count {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:07:40.877054 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-14bd66f3-4a86-44fc-9414-47bd3f32cdb3 tempest-MultipleCreateNegativeTestJSON-4633273 tempest-MultipleCreateNegativeTestJSON-4633273-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.129970 Aug 10 23:07:40.877765 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1342/2639] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 23:07:40 2022] POST /compute/v2.1/servers => generated 74 bytes in 131 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 10 23:07:40.892698 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-a381ef84-6fcc-42cb-9da0-87b97b632395 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:40.893431 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-a381ef84-6fcc-42cb-9da0-87b97b632395 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] [instance: 8385348f-0651-486d-9b4a-2c884933edb1] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:40.904596 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a381ef84-6fcc-42cb-9da0-87b97b632395 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:40.905893 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a381ef84-6fcc-42cb-9da0-87b97b632395 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:40.907740 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a381ef84-6fcc-42cb-9da0-87b97b632395 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:40.910889 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a381ef84-6fcc-42cb-9da0-87b97b632395 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:40.911712 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a381ef84-6fcc-42cb-9da0-87b97b632395 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:40.914223 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a381ef84-6fcc-42cb-9da0-87b97b632395 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:41.146763 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.objects.instance [None req-a381ef84-6fcc-42cb-9da0-87b97b632395 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Lazy-loading 'services' on Instance uuid 8385348f-0651-486d-9b4a-2c884933edb1 {{(pid=122633) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:07:41.183485 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-a381ef84-6fcc-42cb-9da0-87b97b632395 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/8385348f-0651-486d-9b4a-2c884933edb1" status: 200 len: 1931 microversion: 2.75 time: 0.304213 Aug 10 23:07:41.184688 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1343/2640] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:07:40 2022] GET /compute/v2.1/servers/8385348f-0651-486d-9b4a-2c884933edb1 => generated 1931 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:07:41.189644 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-62b02c9a-deb9-4dce-a4d5-9fa1123a058f tempest-MultipleCreateNegativeTestJSON-4633273 tempest-MultipleCreateNegativeTestJSON-4633273-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-352294578", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452", "max_count": 0}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:07:41.194813 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-62b02c9a-deb9-4dce-a4d5-9fa1123a058f tempest-MultipleCreateNegativeTestJSON-4633273 tempest-MultipleCreateNegativeTestJSON-4633273-project] Request method failure captured: Aug 10 23:07:41.194813 n-d-850468-14 devstack@n-api.service[122633]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 10 23:07:41.194813 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:07:41.194813 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:07:41.194813 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:07:41.194813 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 167 Aug 10 23:07:41.194813 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:07:41.194813 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:07:41.194813 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:07:41.194813 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:07:41.194813 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9Do80YYTYt5e845nnGYNuyx8muB88JmQkIWx88pQ9_oO2pchGBT3Gx4nN_18ra1Y2jrn7KVXqYvMtFafA0ppPlfKv3LOfZjeaRXmkdQUuKFaJVxJ9e5ikQzDE0QBZdCDUhSOeKJI092hF3AB3slDChrylYOWjcNgTScwQsza_rn28Fc Aug 10 23:07:41.194813 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:07:41.194813 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:07:41.194813 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:07:41.194813 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:07:41.194813 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:07:41.194813 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:07:41.194813 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 521624161d324e4aa0ad3b651113cfa8 Aug 10 23:07:41.194813 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-4633273 Aug 10 23:07:41.194813 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:07:41.194813 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:07:41.196493 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/521624161d324e4aa0ad3b651113cfa8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/521624161d324e4aa0ad3b651113cfa8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/521624161d324e4aa0ad3b651113cfa8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_521624161d324e4aa0ad3b651113cfa8", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:07:41.196493 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-4633273 Aug 10 23:07:41.196493 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 521624161d324e4aa0ad3b651113cfa8 Aug 10 23:07:41.196493 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-4633273 Aug 10 23:07:41.196493 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-MultipleCreateNegativeTestJSON-4633273-project Aug 10 23:07:41.196493 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:07:41.196493 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:07:41.196493 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: ea5051d93fe5499283c33584fd2d256d Aug 10 23:07:41.196493 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-4633273-project Aug 10 23:07:41.196493 n-d-850468-14 devstack@n-api.service[122633]: Aug 10 23:07:41.196493 n-d-850468-14 devstack@n-api.service[122633]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-352294578", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452", "max_count": 0}} Aug 10 23:07:41.196493 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:07:41.197323 n-d-850468-14 devstack@n-api.service[122633]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Aug 10 23:07:41.197323 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-352294578', 'imageRef': '78ad8905-f66f-4733-8be9-2b260f1fabed', 'flavorRef': '452', 'max_count': 0}}} Aug 10 23:07:41.197323 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:07:41.197323 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:07:41.197323 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 10 23:07:41.197323 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 10 23:07:41.197323 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 10 23:07:41.197323 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise error Aug 10 23:07:41.197323 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 10 23:07:41.197323 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:07:41.197323 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Aug 10 23:07:41.197323 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 10 23:07:41.197323 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi 'minimum': 1, Aug 10 23:07:41.197323 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 10 23:07:41.197323 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 10 23:07:41.197323 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:07:41.197323 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 10 23:07:41.197323 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi 0 Aug 10 23:07:41.197323 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:07:41.197323 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:07:41.197323 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:07:41.197323 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:07:41.197323 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:07:41.199122 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:07:41.199122 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:07:41.199122 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:07:41.199122 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:07:41.199122 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:07:41.199122 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 23:07:41.199122 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 23:07:41.199122 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 10 23:07:41.199122 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 10 23:07:41.199122 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 10 23:07:41.199122 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 10 23:07:41.199122 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 10 23:07:41.199122 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 10 23:07:41.199122 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Aug 10 23:07:41.199122 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:07:41.199122 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:07:41.199122 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:07:41.199122 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:07:41.199122 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:07:41.199122 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:07:41.200555 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 10 23:07:41.200555 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 10 23:07:41.200555 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Aug 10 23:07:41.200555 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:07:41.201595 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-62b02c9a-deb9-4dce-a4d5-9fa1123a058f tempest-MultipleCreateNegativeTestJSON-4633273 tempest-MultipleCreateNegativeTestJSON-4633273-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:07:41.202763 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-62b02c9a-deb9-4dce-a4d5-9fa1123a058f tempest-MultipleCreateNegativeTestJSON-4633273 tempest-MultipleCreateNegativeTestJSON-4633273-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.016907 Aug 10 23:07:41.203881 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1344/2641] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 23:07:41 2022] POST /compute/v2.1/servers => generated 130 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 10 23:07:41.234128 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-196835a5-5b0e-42be-846f-0a9adcb782dc tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Calling method '.version_select at 0x7f847c559ee0>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:41.368981 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-196835a5-5b0e-42be-846f-0a9adcb782dc tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] 10.222.0.58 "GET /compute/v2.1/images/0f967916-982b-4b7c-bb3c-1ec6b8c4dd57" status: 200 len: 1422 microversion: 2.1 time: 0.163798 Aug 10 23:07:41.369921 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1345/2642] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 10 23:07:41 2022] GET /compute/v2.1/images/0f967916-982b-4b7c-bb3c-1ec6b8c4dd57 => generated 1422 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:07:41.376974 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-3bcf29df-bbee-441e-a5c1-4167617fcb88 tempest-MultipleCreateNegativeTestJSON-4633273 tempest-MultipleCreateNegativeTestJSON-4633273-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-28611668", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452", "max_count": 2.5}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:07:41.387954 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-3bcf29df-bbee-441e-a5c1-4167617fcb88 tempest-MultipleCreateNegativeTestJSON-4633273 tempest-MultipleCreateNegativeTestJSON-4633273-project] Request method failure captured: Aug 10 23:07:41.387954 n-d-850468-14 devstack@n-api.service[122633]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 10 23:07:41.387954 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:07:41.387954 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:07:41.387954 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:07:41.387954 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 168 Aug 10 23:07:41.387954 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:07:41.387954 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:07:41.387954 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:07:41.387954 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:07:41.387954 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9Do80YYTYt5e845nnGYNuyx8muB88JmQkIWx88pQ9_oO2pchGBT3Gx4nN_18ra1Y2jrn7KVXqYvMtFafA0ppPlfKv3LOfZjeaRXmkdQUuKFaJVxJ9e5ikQzDE0QBZdCDUhSOeKJI092hF3AB3slDChrylYOWjcNgTScwQsza_rn28Fc Aug 10 23:07:41.387954 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:07:41.387954 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:07:41.387954 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:07:41.387954 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:07:41.387954 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:07:41.387954 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:07:41.387954 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 521624161d324e4aa0ad3b651113cfa8 Aug 10 23:07:41.387954 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-4633273 Aug 10 23:07:41.387954 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:07:41.387954 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:07:41.389630 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/521624161d324e4aa0ad3b651113cfa8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/521624161d324e4aa0ad3b651113cfa8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/521624161d324e4aa0ad3b651113cfa8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_521624161d324e4aa0ad3b651113cfa8", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:07:41.389630 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-4633273 Aug 10 23:07:41.389630 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 521624161d324e4aa0ad3b651113cfa8 Aug 10 23:07:41.389630 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-4633273 Aug 10 23:07:41.389630 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-MultipleCreateNegativeTestJSON-4633273-project Aug 10 23:07:41.389630 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:07:41.389630 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:07:41.389630 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: ea5051d93fe5499283c33584fd2d256d Aug 10 23:07:41.389630 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-4633273-project Aug 10 23:07:41.389630 n-d-850468-14 devstack@n-api.service[122633]: Aug 10 23:07:41.389630 n-d-850468-14 devstack@n-api.service[122633]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-28611668", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452", "max_count": 2.5}} Aug 10 23:07:41.389630 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:07:41.390554 n-d-850468-14 devstack@n-api.service[122633]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 10 23:07:41.390554 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-28611668', 'imageRef': '78ad8905-f66f-4733-8be9-2b260f1fabed', 'flavorRef': '452', 'max_count': 2.5}}} Aug 10 23:07:41.390554 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:07:41.390554 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:07:41.390554 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 10 23:07:41.390554 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 10 23:07:41.390554 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 10 23:07:41.390554 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise error Aug 10 23:07:41.390554 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Aug 10 23:07:41.390554 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:07:41.390554 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Aug 10 23:07:41.390554 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 10 23:07:41.390554 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi 'minimum': 1, Aug 10 23:07:41.390554 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 10 23:07:41.390554 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 10 23:07:41.390554 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:07:41.390554 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 10 23:07:41.390554 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi 2.5 Aug 10 23:07:41.390554 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:07:41.390554 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:07:41.390554 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:07:41.390554 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:07:41.390554 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:07:41.392212 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:07:41.392212 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:07:41.392212 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:07:41.392212 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:07:41.392212 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:07:41.392212 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 23:07:41.392212 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 23:07:41.392212 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 10 23:07:41.392212 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 10 23:07:41.392212 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 10 23:07:41.392212 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 10 23:07:41.392212 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 10 23:07:41.392212 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 10 23:07:41.392212 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 10 23:07:41.392212 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:07:41.392212 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:07:41.392212 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:07:41.392212 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:07:41.392212 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:07:41.392212 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:07:41.393596 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 10 23:07:41.393596 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 10 23:07:41.393596 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 10 23:07:41.393596 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:07:41.394984 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-3bcf29df-bbee-441e-a5c1-4167617fcb88 tempest-MultipleCreateNegativeTestJSON-4633273 tempest-MultipleCreateNegativeTestJSON-4633273-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:07:41.396030 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-3bcf29df-bbee-441e-a5c1-4167617fcb88 tempest-MultipleCreateNegativeTestJSON-4633273 tempest-MultipleCreateNegativeTestJSON-4633273-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.022869 Aug 10 23:07:41.411838 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1346/2643] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 23:07:41 2022] POST /compute/v2.1/servers => generated 139 bytes in 41 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 10 23:07:41.469215 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-d70a2a5a-85be-40fd-ad21-8db8ce731eb0 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:41.471053 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-d70a2a5a-85be-40fd-ad21-8db8ce731eb0 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] [instance: 85c138c8-9302-453b-8dc1-8f0002d79f1a] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:41.489820 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d70a2a5a-85be-40fd-ad21-8db8ce731eb0 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:41.492172 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d70a2a5a-85be-40fd-ad21-8db8ce731eb0 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:41.500016 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d70a2a5a-85be-40fd-ad21-8db8ce731eb0 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:41.501507 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d70a2a5a-85be-40fd-ad21-8db8ce731eb0 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:41.503648 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d70a2a5a-85be-40fd-ad21-8db8ce731eb0 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:41.504856 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d70a2a5a-85be-40fd-ad21-8db8ce731eb0 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:41.608651 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-22cf1de9-25a0-4d91-9556-469a271b9bbd tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Flavor limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:07:41.609197 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-22cf1de9-25a0-4d91-9556-469a271b9bbd tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Image limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:07:41.609529 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-22cf1de9-25a0-4d91-9556-469a271b9bbd tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Flavor pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:07:41.609933 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-22cf1de9-25a0-4d91-9556-469a271b9bbd tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Image pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:07:41.610338 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-22cf1de9-25a0-4d91-9556-469a271b9bbd tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:07:41.615621 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:07:41.627180 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-22cf1de9-25a0-4d91-9556-469a271b9bbd tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:41.631163 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-22cf1de9-25a0-4d91-9556-469a271b9bbd tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:41.631663 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-22cf1de9-25a0-4d91-9556-469a271b9bbd tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:41.632471 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-22cf1de9-25a0-4d91-9556-469a271b9bbd tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:41.632934 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-22cf1de9-25a0-4d91-9556-469a271b9bbd tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:41.637087 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-22cf1de9-25a0-4d91-9556-469a271b9bbd tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:41.676276 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-22cf1de9-25a0-4d91-9556-469a271b9bbd tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Getting quotas for project 708f8d4c4ed6432d85e0bf6a9bac7677. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:07:41.685752 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-22cf1de9-25a0-4d91-9556-469a271b9bbd tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Getting quotas for user 55bbb4f184e4409d9eed51e0b98dfb29 and project 708f8d4c4ed6432d85e0bf6a9bac7677. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:07:41.741965 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-22cf1de9-25a0-4d91-9556-469a271b9bbd tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Going to run 1 instances... {{(pid=122632) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 23:07:41.760152 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-22cf1de9-25a0-4d91-9556-469a271b9bbd tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] [instance: eea0fab7-447d-4f5f-8577-6ef8df500499] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78ad8905-f66f-4733-8be9-2b260f1fabed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122632) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 23:07:41.841718 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-22cf1de9-25a0-4d91-9556-469a271b9bbd tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.372911 Aug 10 23:07:41.848917 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1298/2644] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 23:07:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 1381 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 23:07:41.855958 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-4f532e48-a07e-4a75-a6e4-58aef4b48ab8 tempest-MultipleCreateNegativeTestJSON-4633273 tempest-MultipleCreateNegativeTestJSON-4633273-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1571909656", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452", "min_count": 0}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:07:41.862664 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-4f532e48-a07e-4a75-a6e4-58aef4b48ab8 tempest-MultipleCreateNegativeTestJSON-4633273 tempest-MultipleCreateNegativeTestJSON-4633273-project] Request method failure captured: Aug 10 23:07:41.862664 n-d-850468-14 devstack@n-api.service[122632]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 10 23:07:41.862664 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:07:41.862664 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:07:41.862664 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:07:41.862664 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 168 Aug 10 23:07:41.862664 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:07:41.862664 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:07:41.862664 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:07:41.862664 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:07:41.862664 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9Do80YYTYt5e845nnGYNuyx8muB88JmQkIWx88pQ9_oO2pchGBT3Gx4nN_18ra1Y2jrn7KVXqYvMtFafA0ppPlfKv3LOfZjeaRXmkdQUuKFaJVxJ9e5ikQzDE0QBZdCDUhSOeKJI092hF3AB3slDChrylYOWjcNgTScwQsza_rn28Fc Aug 10 23:07:41.862664 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:07:41.862664 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:07:41.862664 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:07:41.862664 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:07:41.862664 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:07:41.862664 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:07:41.862664 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 521624161d324e4aa0ad3b651113cfa8 Aug 10 23:07:41.862664 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-4633273 Aug 10 23:07:41.862664 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:07:41.862664 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:07:41.864233 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/521624161d324e4aa0ad3b651113cfa8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/521624161d324e4aa0ad3b651113cfa8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/521624161d324e4aa0ad3b651113cfa8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_521624161d324e4aa0ad3b651113cfa8", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:07:41.864233 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-4633273 Aug 10 23:07:41.864233 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 521624161d324e4aa0ad3b651113cfa8 Aug 10 23:07:41.864233 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-4633273 Aug 10 23:07:41.864233 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-MultipleCreateNegativeTestJSON-4633273-project Aug 10 23:07:41.864233 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:07:41.864233 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:07:41.864233 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: ea5051d93fe5499283c33584fd2d256d Aug 10 23:07:41.864233 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-4633273-project Aug 10 23:07:41.864233 n-d-850468-14 devstack@n-api.service[122632]: Aug 10 23:07:41.864233 n-d-850468-14 devstack@n-api.service[122632]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1571909656", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452", "min_count": 0}} Aug 10 23:07:41.864233 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:07:41.865108 n-d-850468-14 devstack@n-api.service[122632]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Aug 10 23:07:41.865108 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1571909656', 'imageRef': '78ad8905-f66f-4733-8be9-2b260f1fabed', 'flavorRef': '452', 'min_count': 0}}} Aug 10 23:07:41.865108 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:07:41.865108 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:07:41.865108 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 10 23:07:41.865108 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 10 23:07:41.865108 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 10 23:07:41.865108 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise error Aug 10 23:07:41.865108 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 10 23:07:41.865108 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:07:41.865108 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Aug 10 23:07:41.865108 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 10 23:07:41.865108 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi 'minimum': 1, Aug 10 23:07:41.865108 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 10 23:07:41.865108 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 10 23:07:41.865108 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:07:41.865108 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 10 23:07:41.865108 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi 0 Aug 10 23:07:41.865108 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:07:41.865108 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:07:41.865108 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:07:41.865108 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:07:41.865108 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:07:41.866774 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:07:41.866774 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:07:41.866774 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:07:41.866774 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:07:41.866774 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:07:41.866774 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 23:07:41.866774 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 23:07:41.866774 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 10 23:07:41.866774 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 10 23:07:41.866774 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 10 23:07:41.866774 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 10 23:07:41.866774 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 10 23:07:41.866774 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 10 23:07:41.866774 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Aug 10 23:07:41.866774 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:07:41.866774 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:07:41.866774 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:07:41.866774 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:07:41.866774 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:07:41.866774 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:07:41.868450 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 10 23:07:41.868450 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 10 23:07:41.868450 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Aug 10 23:07:41.868450 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:07:41.869655 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-4f532e48-a07e-4a75-a6e4-58aef4b48ab8 tempest-MultipleCreateNegativeTestJSON-4633273 tempest-MultipleCreateNegativeTestJSON-4633273-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:07:41.870687 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-4f532e48-a07e-4a75-a6e4-58aef4b48ab8 tempest-MultipleCreateNegativeTestJSON-4633273 tempest-MultipleCreateNegativeTestJSON-4633273-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.020530 Aug 10 23:07:41.871760 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1299/2645] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 23:07:41 2022] POST /compute/v2.1/servers => generated 130 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 10 23:07:41.877699 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-21a75cea-57b8-4147-872e-57b4da27fe43 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:41.882237 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-21a75cea-57b8-4147-872e-57b4da27fe43 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] [instance: 6fe68649-0e9b-4059-afb6-cc44844ff476] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:41.892987 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-21a75cea-57b8-4147-872e-57b4da27fe43 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:41.893704 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-21a75cea-57b8-4147-872e-57b4da27fe43 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:41.894300 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-21a75cea-57b8-4147-872e-57b4da27fe43 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:41.895214 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-21a75cea-57b8-4147-872e-57b4da27fe43 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:41.896062 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-21a75cea-57b8-4147-872e-57b4da27fe43 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:41.896658 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-21a75cea-57b8-4147-872e-57b4da27fe43 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:42.023251 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-d70a2a5a-85be-40fd-ad21-8db8ce731eb0 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8899e278c9453fba0ab05c69b0b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46ac8b84bd649fa88897068dbfa5ce6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:42.037819 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-d70a2a5a-85be-40fd-ad21-8db8ce731eb0 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] 10.222.0.58 "GET /compute/v2.1/servers/85c138c8-9302-453b-8dc1-8f0002d79f1a" status: 200 len: 1506 microversion: 2.1 time: 0.572820 Aug 10 23:07:42.051517 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1347/2646] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:07:41 2022] GET /compute/v2.1/servers/85c138c8-9302-453b-8dc1-8f0002d79f1a => generated 1506 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:07:42.064261 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c877244c-75ef-4ee0-afb3-4c2a99e22d46 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:42.067053 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-c877244c-75ef-4ee0-afb3-4c2a99e22d46 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] [instance: eea0fab7-447d-4f5f-8577-6ef8df500499] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:42.179931 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-c877244c-75ef-4ee0-afb3-4c2a99e22d46 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bbb4f184e4409d9eed51e0b98dfb29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708f8d4c4ed6432d85e0bf6a9bac7677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:42.186374 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-21a75cea-57b8-4147-872e-57b4da27fe43 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c6e1f505b8409ea38f8a07bad870a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6473e36eada44e6bca8dc568e5ee330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:42.191137 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-c877244c-75ef-4ee0-afb3-4c2a99e22d46 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] 10.222.0.58 "GET /compute/v2.1/servers/eea0fab7-447d-4f5f-8577-6ef8df500499" status: 200 len: 1224 microversion: 2.1 time: 0.138283 Aug 10 23:07:42.196575 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-21a75cea-57b8-4147-872e-57b4da27fe43 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] 10.222.0.58 "GET /compute/v2.1/servers/6fe68649-0e9b-4059-afb6-cc44844ff476" status: 200 len: 1333 microversion: 2.1 time: 0.322067 Aug 10 23:07:42.197340 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1300/2647] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:07:41 2022] GET /compute/v2.1/servers/6fe68649-0e9b-4059-afb6-cc44844ff476 => generated 1333 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:07:42.203544 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1348/2648] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:07:42 2022] GET /compute/v2.1/servers/eea0fab7-447d-4f5f-8577-6ef8df500499 => generated 1224 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:07:42.207942 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-11f48ebf-4ed3-4170-ad25-e6f74ce08d17 tempest-MultipleCreateNegativeTestJSON-4633273 tempest-MultipleCreateNegativeTestJSON-4633273-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-733926316", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452", "min_count": 2.5}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:07:42.214176 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-a010becb-e05b-48c6-a566-18f0af28855d tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:42.215680 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-a010becb-e05b-48c6-a566-18f0af28855d tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] [instance: 85c138c8-9302-453b-8dc1-8f0002d79f1a] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:42.220048 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-11f48ebf-4ed3-4170-ad25-e6f74ce08d17 tempest-MultipleCreateNegativeTestJSON-4633273 tempest-MultipleCreateNegativeTestJSON-4633273-project] Request method failure captured: Aug 10 23:07:42.220048 n-d-850468-14 devstack@n-api.service[122632]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 10 23:07:42.220048 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:07:42.220048 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:07:42.220048 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:07:42.220048 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 169 Aug 10 23:07:42.220048 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:07:42.220048 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:07:42.220048 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:07:42.220048 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:07:42.220048 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9Do80YYTYt5e845nnGYNuyx8muB88JmQkIWx88pQ9_oO2pchGBT3Gx4nN_18ra1Y2jrn7KVXqYvMtFafA0ppPlfKv3LOfZjeaRXmkdQUuKFaJVxJ9e5ikQzDE0QBZdCDUhSOeKJI092hF3AB3slDChrylYOWjcNgTScwQsza_rn28Fc Aug 10 23:07:42.220048 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:07:42.220048 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:07:42.220048 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:07:42.220048 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:07:42.220048 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:07:42.220048 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:07:42.220048 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 521624161d324e4aa0ad3b651113cfa8 Aug 10 23:07:42.220048 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-4633273 Aug 10 23:07:42.220048 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:07:42.220048 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:07:42.221632 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/521624161d324e4aa0ad3b651113cfa8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/521624161d324e4aa0ad3b651113cfa8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/521624161d324e4aa0ad3b651113cfa8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_521624161d324e4aa0ad3b651113cfa8", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:07:42.221632 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-4633273 Aug 10 23:07:42.221632 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 521624161d324e4aa0ad3b651113cfa8 Aug 10 23:07:42.221632 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-4633273 Aug 10 23:07:42.221632 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-MultipleCreateNegativeTestJSON-4633273-project Aug 10 23:07:42.221632 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:07:42.221632 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:07:42.221632 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: ea5051d93fe5499283c33584fd2d256d Aug 10 23:07:42.221632 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-4633273-project Aug 10 23:07:42.221632 n-d-850468-14 devstack@n-api.service[122632]: Aug 10 23:07:42.221632 n-d-850468-14 devstack@n-api.service[122632]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-733926316", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452", "min_count": 2.5}} Aug 10 23:07:42.221632 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:07:42.222488 n-d-850468-14 devstack@n-api.service[122632]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 10 23:07:42.222488 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-733926316', 'imageRef': '78ad8905-f66f-4733-8be9-2b260f1fabed', 'flavorRef': '452', 'min_count': 2.5}}} Aug 10 23:07:42.222488 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:07:42.222488 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:07:42.222488 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 10 23:07:42.222488 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 10 23:07:42.222488 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 10 23:07:42.222488 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise error Aug 10 23:07:42.222488 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Aug 10 23:07:42.222488 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:07:42.222488 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Aug 10 23:07:42.222488 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 10 23:07:42.222488 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi 'minimum': 1, Aug 10 23:07:42.222488 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 10 23:07:42.222488 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 10 23:07:42.222488 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:07:42.222488 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 10 23:07:42.222488 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi 2.5 Aug 10 23:07:42.222488 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:07:42.222488 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:07:42.222488 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:07:42.222488 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:07:42.222488 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:07:42.224920 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:07:42.224920 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:07:42.224920 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:07:42.224920 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:07:42.224920 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:07:42.224920 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 23:07:42.224920 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 23:07:42.224920 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 10 23:07:42.224920 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 10 23:07:42.224920 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 10 23:07:42.224920 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 10 23:07:42.224920 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 10 23:07:42.224920 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 10 23:07:42.224920 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 10 23:07:42.224920 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:07:42.224920 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:07:42.224920 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:07:42.224920 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:07:42.224920 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:07:42.224920 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:07:42.227570 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 10 23:07:42.227570 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 10 23:07:42.227570 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 10 23:07:42.227570 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:07:42.227570 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-11f48ebf-4ed3-4170-ad25-e6f74ce08d17 tempest-MultipleCreateNegativeTestJSON-4633273 tempest-MultipleCreateNegativeTestJSON-4633273-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:07:42.227570 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-11f48ebf-4ed3-4170-ad25-e6f74ce08d17 tempest-MultipleCreateNegativeTestJSON-4633273 tempest-MultipleCreateNegativeTestJSON-4633273-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.022378 Aug 10 23:07:42.227570 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1301/2649] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 23:07:42 2022] POST /compute/v2.1/servers => generated 139 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 10 23:07:42.232878 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a010becb-e05b-48c6-a566-18f0af28855d tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:42.233175 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-b8ec7b7f-c54d-4ba8-825f-4b9999fbab28 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:42.233889 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-b8ec7b7f-c54d-4ba8-825f-4b9999fbab28 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] [instance: 8385348f-0651-486d-9b4a-2c884933edb1] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:42.234536 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a010becb-e05b-48c6-a566-18f0af28855d tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:42.235930 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a010becb-e05b-48c6-a566-18f0af28855d tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:42.241175 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b8ec7b7f-c54d-4ba8-825f-4b9999fbab28 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:42.241804 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b8ec7b7f-c54d-4ba8-825f-4b9999fbab28 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:42.243184 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b8ec7b7f-c54d-4ba8-825f-4b9999fbab28 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:42.244498 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b8ec7b7f-c54d-4ba8-825f-4b9999fbab28 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:42.245403 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b8ec7b7f-c54d-4ba8-825f-4b9999fbab28 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:42.245828 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a010becb-e05b-48c6-a566-18f0af28855d tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:42.246427 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a010becb-e05b-48c6-a566-18f0af28855d tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:42.246717 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b8ec7b7f-c54d-4ba8-825f-4b9999fbab28 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:42.247164 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a010becb-e05b-48c6-a566-18f0af28855d tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:42.422360 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.objects.instance [None req-b8ec7b7f-c54d-4ba8-825f-4b9999fbab28 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Lazy-loading 'services' on Instance uuid 8385348f-0651-486d-9b4a-2c884933edb1 {{(pid=122632) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:07:42.507116 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-b8ec7b7f-c54d-4ba8-825f-4b9999fbab28 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/8385348f-0651-486d-9b4a-2c884933edb1" status: 200 len: 1931 microversion: 2.75 time: 0.278060 Aug 10 23:07:42.511119 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1302/2650] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:07:42 2022] GET /compute/v2.1/servers/8385348f-0651-486d-9b4a-2c884933edb1 => generated 1931 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:07:42.516096 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-7db5f1ca-2f32-4064-bbd3-cfa101fe18e7 tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Calling method '.version_select at 0x7f847d927d30>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:42.610205 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-7db5f1ca-2f32-4064-bbd3-cfa101fe18e7 tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] 10.222.0.58 "GET /compute/v2.1/images/0f967916-982b-4b7c-bb3c-1ec6b8c4dd57" status: 200 len: 1422 microversion: 2.1 time: 0.096888 Aug 10 23:07:42.612999 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1303/2651] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 10 23:07:42 2022] GET /compute/v2.1/images/0f967916-982b-4b7c-bb3c-1ec6b8c4dd57 => generated 1422 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:07:42.787578 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-a010becb-e05b-48c6-a566-18f0af28855d tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8899e278c9453fba0ab05c69b0b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46ac8b84bd649fa88897068dbfa5ce6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:42.796832 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-a010becb-e05b-48c6-a566-18f0af28855d tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] 10.222.0.58 "GET /compute/v2.1/servers/85c138c8-9302-453b-8dc1-8f0002d79f1a" status: 200 len: 1506 microversion: 2.1 time: 0.592148 Aug 10 23:07:42.799495 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1349/2652] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:07:42 2022] GET /compute/v2.1/servers/85c138c8-9302-453b-8dc1-8f0002d79f1a => generated 1506 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:07:42.826218 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-8a6af2ea-d1ad-4a2a-b5e0-3306aa96f778 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:42.826973 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-8a6af2ea-d1ad-4a2a-b5e0-3306aa96f778 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] [instance: 85c138c8-9302-453b-8dc1-8f0002d79f1a] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:42.866478 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8a6af2ea-d1ad-4a2a-b5e0-3306aa96f778 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:42.870214 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8a6af2ea-d1ad-4a2a-b5e0-3306aa96f778 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:42.870732 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8a6af2ea-d1ad-4a2a-b5e0-3306aa96f778 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:42.878488 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8a6af2ea-d1ad-4a2a-b5e0-3306aa96f778 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:42.881852 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8a6af2ea-d1ad-4a2a-b5e0-3306aa96f778 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:42.882888 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8a6af2ea-d1ad-4a2a-b5e0-3306aa96f778 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:42.981623 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-8a6af2ea-d1ad-4a2a-b5e0-3306aa96f778 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] [instance: 85c138c8-9302-453b-8dc1-8f0002d79f1a] Going to try to terminate instance {{(pid=122632) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:07:43.218313 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-4eb7cd85-f7e4-4a22-bf54-9a7d52cb0a99 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:43.219432 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-4eb7cd85-f7e4-4a22-bf54-9a7d52cb0a99 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] [instance: eea0fab7-447d-4f5f-8577-6ef8df500499] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:43.229434 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-8a6af2ea-d1ad-4a2a-b5e0-3306aa96f778 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] 10.222.0.58 "DELETE /compute/v2.1/servers/85c138c8-9302-453b-8dc1-8f0002d79f1a" status: 204 len: 0 microversion: 2.1 time: 0.408711 Aug 10 23:07:43.233767 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4eb7cd85-f7e4-4a22-bf54-9a7d52cb0a99 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:43.236277 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1304/2653] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:07:42 2022] DELETE /compute/v2.1/servers/85c138c8-9302-453b-8dc1-8f0002d79f1a => generated 0 bytes in 413 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:07:43.239500 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4eb7cd85-f7e4-4a22-bf54-9a7d52cb0a99 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:43.240800 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4eb7cd85-f7e4-4a22-bf54-9a7d52cb0a99 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:43.241711 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4eb7cd85-f7e4-4a22-bf54-9a7d52cb0a99 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:43.242317 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4eb7cd85-f7e4-4a22-bf54-9a7d52cb0a99 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:43.243262 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4eb7cd85-f7e4-4a22-bf54-9a7d52cb0a99 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:43.272502 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-775596c3-86e6-4d46-af81-a12a41c46046 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:43.275536 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-775596c3-86e6-4d46-af81-a12a41c46046 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] [instance: 6fe68649-0e9b-4059-afb6-cc44844ff476] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:43.295393 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-775596c3-86e6-4d46-af81-a12a41c46046 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:43.299261 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-775596c3-86e6-4d46-af81-a12a41c46046 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:43.300769 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-775596c3-86e6-4d46-af81-a12a41c46046 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:43.302087 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-775596c3-86e6-4d46-af81-a12a41c46046 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:43.303745 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-775596c3-86e6-4d46-af81-a12a41c46046 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:43.304839 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-775596c3-86e6-4d46-af81-a12a41c46046 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:43.624804 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-4eb7cd85-f7e4-4a22-bf54-9a7d52cb0a99 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bbb4f184e4409d9eed51e0b98dfb29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708f8d4c4ed6432d85e0bf6a9bac7677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:43.636234 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-4eb7cd85-f7e4-4a22-bf54-9a7d52cb0a99 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] 10.222.0.58 "GET /compute/v2.1/servers/eea0fab7-447d-4f5f-8577-6ef8df500499" status: 200 len: 1228 microversion: 2.1 time: 0.421839 Aug 10 23:07:43.637352 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1350/2654] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:07:43 2022] GET /compute/v2.1/servers/eea0fab7-447d-4f5f-8577-6ef8df500499 => generated 1228 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:07:43.642373 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-16b79e67-7a67-4a4d-8bb3-7a311979eaa1 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-897540024", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452", "networks": [{"uuid": "72c3c713-0909-4c2e-939f-b2db0ad09ba6"}]}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:07:43.754830 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.network.neutron [None req-16b79e67-7a67-4a4d-8bb3-7a311979eaa1 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] validate_networks() for [('72c3c713-0909-4c2e-939f-b2db0ad09ba6', None, None, None, None, None)] {{(pid=122633) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 23:07:43.808260 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-775596c3-86e6-4d46-af81-a12a41c46046 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c6e1f505b8409ea38f8a07bad870a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6473e36eada44e6bca8dc568e5ee330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:43.834457 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-775596c3-86e6-4d46-af81-a12a41c46046 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] 10.222.0.58 "GET /compute/v2.1/servers/6fe68649-0e9b-4059-afb6-cc44844ff476" status: 200 len: 1333 microversion: 2.1 time: 0.573735 Aug 10 23:07:43.839139 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1305/2655] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:07:43 2022] GET /compute/v2.1/servers/6fe68649-0e9b-4059-afb6-cc44844ff476 => generated 1333 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:07:43.849454 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-52537916-d523-4d00-ac5b-67f495cb9380 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:43.850410 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-52537916-d523-4d00-ac5b-67f495cb9380 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] [instance: 8385348f-0651-486d-9b4a-2c884933edb1] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:43.867576 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-52537916-d523-4d00-ac5b-67f495cb9380 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:43.869128 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-52537916-d523-4d00-ac5b-67f495cb9380 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:43.871333 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-52537916-d523-4d00-ac5b-67f495cb9380 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:43.872254 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-52537916-d523-4d00-ac5b-67f495cb9380 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:43.876761 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-52537916-d523-4d00-ac5b-67f495cb9380 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:43.877700 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-52537916-d523-4d00-ac5b-67f495cb9380 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:44.321270 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:07:44.342410 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.objects.instance [None req-52537916-d523-4d00-ac5b-67f495cb9380 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Lazy-loading 'services' on Instance uuid 8385348f-0651-486d-9b4a-2c884933edb1 {{(pid=122632) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:07:44.405633 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-52537916-d523-4d00-ac5b-67f495cb9380 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/8385348f-0651-486d-9b4a-2c884933edb1" status: 200 len: 1931 microversion: 2.75 time: 0.565064 Aug 10 23:07:44.406277 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1306/2656] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:07:43 2022] GET /compute/v2.1/servers/8385348f-0651-486d-9b4a-2c884933edb1 => generated 1931 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:07:44.433759 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-3c67c255-29b3-48c5-b6ff-72f2e5065cca req-124a5d71-cd1c-4c84-b53d-7accb0809572 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6fe68649-0e9b-4059-afb6-cc44844ff476", "tag": "63f7aab2-326b-45a5-92a2-d01e6f4959f3"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:07:44.445976 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-3c67c255-29b3-48c5-b6ff-72f2e5065cca req-124a5d71-cd1c-4c84-b53d-7accb0809572 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:44.459988 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-3c67c255-29b3-48c5-b6ff-72f2e5065cca req-124a5d71-cd1c-4c84-b53d-7accb0809572 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:44.463163 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-3c67c255-29b3-48c5-b6ff-72f2e5065cca req-124a5d71-cd1c-4c84-b53d-7accb0809572 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:44.504400 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-3c67c255-29b3-48c5-b6ff-72f2e5065cca req-124a5d71-cd1c-4c84-b53d-7accb0809572 service nova] Creating event network-changed:63f7aab2-326b-45a5-92a2-d01e6f4959f3 for instance 6fe68649-0e9b-4059-afb6-cc44844ff476 on n-h2-850468-14 Aug 10 23:07:44.510847 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-3c67c255-29b3-48c5-b6ff-72f2e5065cca req-124a5d71-cd1c-4c84-b53d-7accb0809572 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087331 Aug 10 23:07:44.512325 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1307/2657] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:07:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:07:44.531731 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-2e8624f6-0b48-464b-bedc-64fb774c58bc tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Calling method '.version_select at 0x7f847d028310>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:44.610091 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-2e8624f6-0b48-464b-bedc-64fb774c58bc tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] 10.222.0.58 "GET /compute/v2.1/images/0f967916-982b-4b7c-bb3c-1ec6b8c4dd57" status: 200 len: 1422 microversion: 2.1 time: 0.096330 Aug 10 23:07:44.610690 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1308/2658] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 10 23:07:44 2022] GET /compute/v2.1/images/0f967916-982b-4b7c-bb3c-1ec6b8c4dd57 => generated 1422 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:07:44.647646 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-21eba97e-c855-48cb-abd7-139ff45c5967 req-9bd84082-6823-4fe0-891c-b94c6c163951 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a632bb08-327b-4870-9f4e-90f8d0d863d0", "name": "network-vif-plugged", "status": "completed", "tag": "c03a409d-cb49-445d-9fc1-ff05f4b1ff2b"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:07:44.706652 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-21eba97e-c855-48cb-abd7-139ff45c5967 req-9bd84082-6823-4fe0-891c-b94c6c163951 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:44.707583 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-21eba97e-c855-48cb-abd7-139ff45c5967 req-9bd84082-6823-4fe0-891c-b94c6c163951 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:44.708255 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-21eba97e-c855-48cb-abd7-139ff45c5967 req-9bd84082-6823-4fe0-891c-b94c6c163951 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:44.721853 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-21eba97e-c855-48cb-abd7-139ff45c5967 req-9bd84082-6823-4fe0-891c-b94c6c163951 service nova] Creating event network-vif-plugged:c03a409d-cb49-445d-9fc1-ff05f4b1ff2b for instance a632bb08-327b-4870-9f4e-90f8d0d863d0 on n-h1-850468-14 Aug 10 23:07:44.729894 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-21eba97e-c855-48cb-abd7-139ff45c5967 req-9bd84082-6823-4fe0-891c-b94c6c163951 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117877 Aug 10 23:07:44.731177 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1309/2659] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:07:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:07:44.738144 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-36944ec6-ab62-4f93-b5b1-425dc94fcec4 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:44.739321 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-36944ec6-ab62-4f93-b5b1-425dc94fcec4 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] [instance: eea0fab7-447d-4f5f-8577-6ef8df500499] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:44.751670 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-36944ec6-ab62-4f93-b5b1-425dc94fcec4 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:44.752563 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-36944ec6-ab62-4f93-b5b1-425dc94fcec4 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:44.753238 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-36944ec6-ab62-4f93-b5b1-425dc94fcec4 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:44.754194 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-36944ec6-ab62-4f93-b5b1-425dc94fcec4 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:44.754900 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-36944ec6-ab62-4f93-b5b1-425dc94fcec4 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:44.755919 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-36944ec6-ab62-4f93-b5b1-425dc94fcec4 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:45.002468 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-36944ec6-ab62-4f93-b5b1-425dc94fcec4 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bbb4f184e4409d9eed51e0b98dfb29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708f8d4c4ed6432d85e0bf6a9bac7677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:45.016342 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-36944ec6-ab62-4f93-b5b1-425dc94fcec4 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] 10.222.0.58 "GET /compute/v2.1/servers/eea0fab7-447d-4f5f-8577-6ef8df500499" status: 200 len: 1282 microversion: 2.1 time: 0.283684 Aug 10 23:07:45.017202 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1310/2660] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:07:44 2022] GET /compute/v2.1/servers/eea0fab7-447d-4f5f-8577-6ef8df500499 => generated 1282 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:07:45.038010 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-f429e847-ff56-481a-89ea-734a34f4381c tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:45.038634 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-f429e847-ff56-481a-89ea-734a34f4381c tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] [instance: 6fe68649-0e9b-4059-afb6-cc44844ff476] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:45.050326 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f429e847-ff56-481a-89ea-734a34f4381c tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:45.051869 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f429e847-ff56-481a-89ea-734a34f4381c tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:45.052335 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f429e847-ff56-481a-89ea-734a34f4381c tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:45.053046 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f429e847-ff56-481a-89ea-734a34f4381c tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:45.053497 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f429e847-ff56-481a-89ea-734a34f4381c tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:45.062563 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f429e847-ff56-481a-89ea-734a34f4381c tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:45.810003 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-16b79e67-7a67-4a4d-8bb3-7a311979eaa1 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Flavor limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:07:45.811318 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-16b79e67-7a67-4a4d-8bb3-7a311979eaa1 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Image limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:07:45.812033 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-16b79e67-7a67-4a4d-8bb3-7a311979eaa1 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Flavor pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:07:45.812984 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-16b79e67-7a67-4a4d-8bb3-7a311979eaa1 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Image pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:07:45.813641 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-16b79e67-7a67-4a4d-8bb3-7a311979eaa1 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:07:45.844437 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-16b79e67-7a67-4a4d-8bb3-7a311979eaa1 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:45.846902 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-16b79e67-7a67-4a4d-8bb3-7a311979eaa1 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:45.850605 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-16b79e67-7a67-4a4d-8bb3-7a311979eaa1 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:45.851704 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-16b79e67-7a67-4a4d-8bb3-7a311979eaa1 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:45.852643 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-16b79e67-7a67-4a4d-8bb3-7a311979eaa1 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:45.854473 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-16b79e67-7a67-4a4d-8bb3-7a311979eaa1 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:45.950643 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-16b79e67-7a67-4a4d-8bb3-7a311979eaa1 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Getting quotas for project b46ac8b84bd649fa88897068dbfa5ce6. Resources: {'instances', 'cores', 'ram'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:07:45.975794 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-16b79e67-7a67-4a4d-8bb3-7a311979eaa1 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Getting quotas for user 1b8899e278c9453fba0ab05c69b0b0b9 and project b46ac8b84bd649fa88897068dbfa5ce6. Resources: {'instances', 'cores', 'ram'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:07:46.018880 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-16b79e67-7a67-4a4d-8bb3-7a311979eaa1 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Going to run 1 instances... {{(pid=122633) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 23:07:46.032990 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-16b79e67-7a67-4a4d-8bb3-7a311979eaa1 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] [instance: 3aa229ba-7292-41ee-922a-32c281be9f42] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78ad8905-f66f-4733-8be9-2b260f1fabed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122633) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 23:07:46.164050 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-16b79e67-7a67-4a4d-8bb3-7a311979eaa1 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.515333 Aug 10 23:07:46.169529 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1351/2661] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 23:07:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 2531 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 23:07:46.178282 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-6d64fee1-3d90-4f70-860a-bba2dacfd074 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:46.183058 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-6d64fee1-3d90-4f70-860a-bba2dacfd074 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] [instance: 8385348f-0651-486d-9b4a-2c884933edb1] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:46.197832 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6d64fee1-3d90-4f70-860a-bba2dacfd074 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:46.200085 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6d64fee1-3d90-4f70-860a-bba2dacfd074 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:46.202337 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6d64fee1-3d90-4f70-860a-bba2dacfd074 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:46.205846 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6d64fee1-3d90-4f70-860a-bba2dacfd074 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:46.206898 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6d64fee1-3d90-4f70-860a-bba2dacfd074 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:46.208937 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6d64fee1-3d90-4f70-860a-bba2dacfd074 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:46.574254 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.objects.instance [None req-6d64fee1-3d90-4f70-860a-bba2dacfd074 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Lazy-loading 'services' on Instance uuid 8385348f-0651-486d-9b4a-2c884933edb1 {{(pid=122633) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:07:46.627253 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-6d64fee1-3d90-4f70-860a-bba2dacfd074 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/8385348f-0651-486d-9b4a-2c884933edb1" status: 200 len: 1931 microversion: 2.75 time: 0.456079 Aug 10 23:07:46.638811 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1352/2662] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:07:46 2022] GET /compute/v2.1/servers/8385348f-0651-486d-9b4a-2c884933edb1 => generated 1931 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:07:46.644034 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-767f994a-41e9-4985-8d69-3a4eba967dc0 tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Calling method '.version_select at 0x7f847c559a60>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:46.746422 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-767f994a-41e9-4985-8d69-3a4eba967dc0 tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] 10.222.0.58 "GET /compute/v2.1/images/0f967916-982b-4b7c-bb3c-1ec6b8c4dd57" status: 200 len: 1422 microversion: 2.1 time: 0.115828 Aug 10 23:07:46.747094 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1353/2663] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 10 23:07:46 2022] GET /compute/v2.1/images/0f967916-982b-4b7c-bb3c-1ec6b8c4dd57 => generated 1422 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:07:46.801264 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-184ab456-e1e0-405e-9484-66743db1af9c tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:46.808232 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-184ab456-e1e0-405e-9484-66743db1af9c tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] [instance: eea0fab7-447d-4f5f-8577-6ef8df500499] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:46.829550 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-184ab456-e1e0-405e-9484-66743db1af9c tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:46.831729 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-184ab456-e1e0-405e-9484-66743db1af9c tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:46.833732 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-184ab456-e1e0-405e-9484-66743db1af9c tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:46.834722 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-184ab456-e1e0-405e-9484-66743db1af9c tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:46.836061 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-184ab456-e1e0-405e-9484-66743db1af9c tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:46.836617 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-184ab456-e1e0-405e-9484-66743db1af9c tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:46.860055 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-f429e847-ff56-481a-89ea-734a34f4381c tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c6e1f505b8409ea38f8a07bad870a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6473e36eada44e6bca8dc568e5ee330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:46.876787 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-f429e847-ff56-481a-89ea-734a34f4381c tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] 10.222.0.58 "GET /compute/v2.1/servers/6fe68649-0e9b-4059-afb6-cc44844ff476" status: 200 len: 1333 microversion: 2.1 time: 1.843278 Aug 10 23:07:46.890882 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1311/2664] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:07:45 2022] GET /compute/v2.1/servers/6fe68649-0e9b-4059-afb6-cc44844ff476 => generated 1333 bytes in 1873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:07:46.917173 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-55515d55-cecf-42c5-9a34-86b27dc51e3e tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:46.917797 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-55515d55-cecf-42c5-9a34-86b27dc51e3e tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] [instance: 3aa229ba-7292-41ee-922a-32c281be9f42] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:47.132664 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-184ab456-e1e0-405e-9484-66743db1af9c tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bbb4f184e4409d9eed51e0b98dfb29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708f8d4c4ed6432d85e0bf6a9bac7677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:47.142055 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-184ab456-e1e0-405e-9484-66743db1af9c tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] 10.222.0.58 "GET /compute/v2.1/servers/eea0fab7-447d-4f5f-8577-6ef8df500499" status: 200 len: 1282 microversion: 2.1 time: 0.381419 Aug 10 23:07:47.142650 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1354/2665] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:07:46 2022] GET /compute/v2.1/servers/eea0fab7-447d-4f5f-8577-6ef8df500499 => generated 1282 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:07:47.159749 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-59bdab31-504f-461a-b3a9-2e37ac336281 req-1dc2fcd6-f523-46bd-a1d4-afc4321cda4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6fe68649-0e9b-4059-afb6-cc44844ff476", "tag": "8df81506-7d26-470f-b8be-99340c977e96"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:07:47.200199 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-59bdab31-504f-461a-b3a9-2e37ac336281 req-1dc2fcd6-f523-46bd-a1d4-afc4321cda4a service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:47.200907 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-59bdab31-504f-461a-b3a9-2e37ac336281 req-1dc2fcd6-f523-46bd-a1d4-afc4321cda4a service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:47.201816 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-59bdab31-504f-461a-b3a9-2e37ac336281 req-1dc2fcd6-f523-46bd-a1d4-afc4321cda4a service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:47.232830 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-59bdab31-504f-461a-b3a9-2e37ac336281 req-1dc2fcd6-f523-46bd-a1d4-afc4321cda4a service nova] Creating event network-changed:8df81506-7d26-470f-b8be-99340c977e96 for instance 6fe68649-0e9b-4059-afb6-cc44844ff476 on n-h2-850468-14 Aug 10 23:07:47.271885 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-59bdab31-504f-461a-b3a9-2e37ac336281 req-1dc2fcd6-f523-46bd-a1d4-afc4321cda4a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114770 Aug 10 23:07:47.272958 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1355/2666] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:07:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:07:47.278862 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-31376b6c-e201-4dcf-b76a-33d68caf1ac9 req-8b03659c-7c78-40ec-80ee-d50242f119d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85c138c8-9302-453b-8dc1-8f0002d79f1a", "name": "network-vif-deleted", "tag": "23b5445e-4fcc-47d3-96d2-0cd88c2ec431"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:07:47.295410 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-31376b6c-e201-4dcf-b76a-33d68caf1ac9 req-8b03659c-7c78-40ec-80ee-d50242f119d8 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:47.296062 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-31376b6c-e201-4dcf-b76a-33d68caf1ac9 req-8b03659c-7c78-40ec-80ee-d50242f119d8 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:47.296556 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-31376b6c-e201-4dcf-b76a-33d68caf1ac9 req-8b03659c-7c78-40ec-80ee-d50242f119d8 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:47.335073 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-31376b6c-e201-4dcf-b76a-33d68caf1ac9 req-8b03659c-7c78-40ec-80ee-d50242f119d8 service nova] Creating event network-vif-deleted:23b5445e-4fcc-47d3-96d2-0cd88c2ec431 for instance 85c138c8-9302-453b-8dc1-8f0002d79f1a on n-h2-850468-14 Aug 10 23:07:47.344215 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-31376b6c-e201-4dcf-b76a-33d68caf1ac9 req-8b03659c-7c78-40ec-80ee-d50242f119d8 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068917 Aug 10 23:07:47.345479 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1356/2667] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:07:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:07:47.413116 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-55515d55-cecf-42c5-9a34-86b27dc51e3e tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8899e278c9453fba0ab05c69b0b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46ac8b84bd649fa88897068dbfa5ce6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:47.425175 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-55515d55-cecf-42c5-9a34-86b27dc51e3e tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] 10.222.0.58 "GET /compute/v2.1/servers/3aa229ba-7292-41ee-922a-32c281be9f42" status: 200 len: 1217 microversion: 2.1 time: 0.530599 Aug 10 23:07:47.447537 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1312/2668] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:07:46 2022] GET /compute/v2.1/servers/3aa229ba-7292-41ee-922a-32c281be9f42 => generated 1217 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:07:47.657799 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-ea449962-9d5f-43ac-9cc8-9083a4387c76 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:47.659525 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-ea449962-9d5f-43ac-9cc8-9083a4387c76 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] [instance: 8385348f-0651-486d-9b4a-2c884933edb1] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:47.668103 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ea449962-9d5f-43ac-9cc8-9083a4387c76 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:47.669034 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ea449962-9d5f-43ac-9cc8-9083a4387c76 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:47.669875 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ea449962-9d5f-43ac-9cc8-9083a4387c76 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:47.671396 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ea449962-9d5f-43ac-9cc8-9083a4387c76 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:47.672337 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ea449962-9d5f-43ac-9cc8-9083a4387c76 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:47.673029 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ea449962-9d5f-43ac-9cc8-9083a4387c76 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:47.765861 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-0b1fbc6c-baaf-4915-ac36-cdb80478fe32 tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Calling method '.version_select at 0x7f847d7c2f70>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:47.900045 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-0b1fbc6c-baaf-4915-ac36-cdb80478fe32 tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] 10.222.0.58 "GET /compute/v2.1/images/0f967916-982b-4b7c-bb3c-1ec6b8c4dd57" status: 200 len: 1422 microversion: 2.1 time: 0.142058 Aug 10 23:07:47.904423 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1313/2669] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 10 23:07:47 2022] GET /compute/v2.1/images/0f967916-982b-4b7c-bb3c-1ec6b8c4dd57 => generated 1422 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:07:47.922526 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-f8e72e8c-3f94-4083-b4b2-4a94b523d268 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:47.934206 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-f8e72e8c-3f94-4083-b4b2-4a94b523d268 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] [instance: 6fe68649-0e9b-4059-afb6-cc44844ff476] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:47.967902 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f8e72e8c-3f94-4083-b4b2-4a94b523d268 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:47.973763 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f8e72e8c-3f94-4083-b4b2-4a94b523d268 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:47.974423 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f8e72e8c-3f94-4083-b4b2-4a94b523d268 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:47.984393 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f8e72e8c-3f94-4083-b4b2-4a94b523d268 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:47.987386 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f8e72e8c-3f94-4083-b4b2-4a94b523d268 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:47.989333 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f8e72e8c-3f94-4083-b4b2-4a94b523d268 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:48.007625 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.objects.instance [None req-ea449962-9d5f-43ac-9cc8-9083a4387c76 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Lazy-loading 'services' on Instance uuid 8385348f-0651-486d-9b4a-2c884933edb1 {{(pid=122633) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:07:48.096439 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-ea449962-9d5f-43ac-9cc8-9083a4387c76 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/8385348f-0651-486d-9b4a-2c884933edb1" status: 200 len: 1931 microversion: 2.75 time: 0.440009 Aug 10 23:07:48.099961 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1357/2670] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:07:47 2022] GET /compute/v2.1/servers/8385348f-0651-486d-9b4a-2c884933edb1 => generated 1931 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:07:48.168505 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-4f28cf33-65b4-4858-9a1e-bec228055e0a tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:48.169138 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-4f28cf33-65b4-4858-9a1e-bec228055e0a tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] [instance: eea0fab7-447d-4f5f-8577-6ef8df500499] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:48.191332 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4f28cf33-65b4-4858-9a1e-bec228055e0a tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:48.192832 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4f28cf33-65b4-4858-9a1e-bec228055e0a tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:48.196736 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4f28cf33-65b4-4858-9a1e-bec228055e0a tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:48.200670 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4f28cf33-65b4-4858-9a1e-bec228055e0a tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:48.204251 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4f28cf33-65b4-4858-9a1e-bec228055e0a tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:48.207934 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4f28cf33-65b4-4858-9a1e-bec228055e0a tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:49.311548 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-f8e72e8c-3f94-4083-b4b2-4a94b523d268 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c6e1f505b8409ea38f8a07bad870a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6473e36eada44e6bca8dc568e5ee330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:49.334222 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-f8e72e8c-3f94-4083-b4b2-4a94b523d268 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] 10.222.0.58 "GET /compute/v2.1/servers/6fe68649-0e9b-4059-afb6-cc44844ff476" status: 200 len: 1333 microversion: 2.1 time: 1.421289 Aug 10 23:07:49.341120 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1314/2671] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:07:47 2022] GET /compute/v2.1/servers/6fe68649-0e9b-4059-afb6-cc44844ff476 => generated 1333 bytes in 1430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:07:49.352893 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-33aa45ab-91df-44f8-aead-8de977a9f98b tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:49.358237 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-33aa45ab-91df-44f8-aead-8de977a9f98b tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] [instance: 3aa229ba-7292-41ee-922a-32c281be9f42] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:49.388968 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-33aa45ab-91df-44f8-aead-8de977a9f98b tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:49.403574 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-33aa45ab-91df-44f8-aead-8de977a9f98b tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:49.404303 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-33aa45ab-91df-44f8-aead-8de977a9f98b tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:49.408136 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-33aa45ab-91df-44f8-aead-8de977a9f98b tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:49.413255 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-33aa45ab-91df-44f8-aead-8de977a9f98b tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:49.417393 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-33aa45ab-91df-44f8-aead-8de977a9f98b tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:49.476534 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-4f28cf33-65b4-4858-9a1e-bec228055e0a tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bbb4f184e4409d9eed51e0b98dfb29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708f8d4c4ed6432d85e0bf6a9bac7677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:49.494500 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-4f28cf33-65b4-4858-9a1e-bec228055e0a tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] 10.222.0.58 "GET /compute/v2.1/servers/eea0fab7-447d-4f5f-8577-6ef8df500499" status: 200 len: 1324 microversion: 2.1 time: 1.323996 Aug 10 23:07:49.505389 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1358/2672] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:07:48 2022] GET /compute/v2.1/servers/eea0fab7-447d-4f5f-8577-6ef8df500499 => generated 1324 bytes in 1343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:07:49.528469 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-401730ba-4013-43c1-98a4-8b9974ce4476 tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Calling method '.version_select at 0x7f847d292040>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:49.635944 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-401730ba-4013-43c1-98a4-8b9974ce4476 tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] 10.222.0.58 "GET /compute/v2.1/images/0f967916-982b-4b7c-bb3c-1ec6b8c4dd57" status: 200 len: 1422 microversion: 2.1 time: 0.129346 Aug 10 23:07:49.636677 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1359/2673] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 10 23:07:49 2022] GET /compute/v2.1/images/0f967916-982b-4b7c-bb3c-1ec6b8c4dd57 => generated 1422 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:07:49.643458 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-6958b9d4-27ea-4706-a95b-af609ef2b6df tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:49.654029 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-6958b9d4-27ea-4706-a95b-af609ef2b6df tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] [instance: 8385348f-0651-486d-9b4a-2c884933edb1] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:49.655135 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-33aa45ab-91df-44f8-aead-8de977a9f98b tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8899e278c9453fba0ab05c69b0b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46ac8b84bd649fa88897068dbfa5ce6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:49.664952 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-33aa45ab-91df-44f8-aead-8de977a9f98b tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] 10.222.0.58 "GET /compute/v2.1/servers/3aa229ba-7292-41ee-922a-32c281be9f42" status: 200 len: 1275 microversion: 2.1 time: 0.321583 Aug 10 23:07:49.686116 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1315/2674] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:07:49 2022] GET /compute/v2.1/servers/3aa229ba-7292-41ee-922a-32c281be9f42 => generated 1275 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:07:49.687681 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6958b9d4-27ea-4706-a95b-af609ef2b6df tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:49.690564 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6958b9d4-27ea-4706-a95b-af609ef2b6df tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:49.691210 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6958b9d4-27ea-4706-a95b-af609ef2b6df tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:49.692142 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6958b9d4-27ea-4706-a95b-af609ef2b6df tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:49.692768 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6958b9d4-27ea-4706-a95b-af609ef2b6df tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:49.693481 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6958b9d4-27ea-4706-a95b-af609ef2b6df tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:49.751438 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:07:49.931767 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.objects.instance [None req-6958b9d4-27ea-4706-a95b-af609ef2b6df tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Lazy-loading 'services' on Instance uuid 8385348f-0651-486d-9b4a-2c884933edb1 {{(pid=122633) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:07:49.986451 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-6958b9d4-27ea-4706-a95b-af609ef2b6df tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/8385348f-0651-486d-9b4a-2c884933edb1" status: 200 len: 1931 microversion: 2.75 time: 0.348297 Aug 10 23:07:49.987174 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1360/2675] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:07:49 2022] GET /compute/v2.1/servers/8385348f-0651-486d-9b4a-2c884933edb1 => generated 1931 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:07:50.370226 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-5b6f3d45-4a73-450b-bc1f-9a45f8d203f9 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:50.371735 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-5b6f3d45-4a73-450b-bc1f-9a45f8d203f9 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] [instance: 6fe68649-0e9b-4059-afb6-cc44844ff476] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:50.383251 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5b6f3d45-4a73-450b-bc1f-9a45f8d203f9 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:50.383741 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5b6f3d45-4a73-450b-bc1f-9a45f8d203f9 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:50.389789 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5b6f3d45-4a73-450b-bc1f-9a45f8d203f9 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:50.390909 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5b6f3d45-4a73-450b-bc1f-9a45f8d203f9 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:50.391909 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5b6f3d45-4a73-450b-bc1f-9a45f8d203f9 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:50.392526 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5b6f3d45-4a73-450b-bc1f-9a45f8d203f9 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:50.520569 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-32ceba1a-b148-491e-9376-6841a4b7fb06 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:50.521914 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-32ceba1a-b148-491e-9376-6841a4b7fb06 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] [instance: eea0fab7-447d-4f5f-8577-6ef8df500499] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:50.540032 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-32ceba1a-b148-491e-9376-6841a4b7fb06 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:50.540032 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-32ceba1a-b148-491e-9376-6841a4b7fb06 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:50.540032 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-32ceba1a-b148-491e-9376-6841a4b7fb06 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:50.543129 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-32ceba1a-b148-491e-9376-6841a4b7fb06 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:50.543769 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-32ceba1a-b148-491e-9376-6841a4b7fb06 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:50.544081 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-32ceba1a-b148-491e-9376-6841a4b7fb06 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:51.364817 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-5b6f3d45-4a73-450b-bc1f-9a45f8d203f9 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c6e1f505b8409ea38f8a07bad870a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6473e36eada44e6bca8dc568e5ee330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:51.376392 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-5b6f3d45-4a73-450b-bc1f-9a45f8d203f9 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] 10.222.0.58 "GET /compute/v2.1/servers/6fe68649-0e9b-4059-afb6-cc44844ff476" status: 200 len: 1333 microversion: 2.1 time: 1.010587 Aug 10 23:07:51.389827 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1316/2676] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:07:50 2022] GET /compute/v2.1/servers/6fe68649-0e9b-4059-afb6-cc44844ff476 => generated 1333 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:07:51.390175 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-32ceba1a-b148-491e-9376-6841a4b7fb06 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bbb4f184e4409d9eed51e0b98dfb29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708f8d4c4ed6432d85e0bf6a9bac7677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:51.390175 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-32ceba1a-b148-491e-9376-6841a4b7fb06 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] 10.222.0.58 "GET /compute/v2.1/servers/eea0fab7-447d-4f5f-8577-6ef8df500499" status: 200 len: 1324 microversion: 2.1 time: 0.872079 Aug 10 23:07:51.391091 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1361/2677] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:07:50 2022] GET /compute/v2.1/servers/eea0fab7-447d-4f5f-8577-6ef8df500499 => generated 1324 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:07:51.392859 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-9d43ecf5-7f5c-4843-8116-61e909af4835 tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Calling method '.version_select at 0x7f847d1f3b80>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:51.407246 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-e3b3a3bd-420b-47d7-8df4-2c16176c6a90 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:51.409995 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-e3b3a3bd-420b-47d7-8df4-2c16176c6a90 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] [instance: 3aa229ba-7292-41ee-922a-32c281be9f42] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:51.440055 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e3b3a3bd-420b-47d7-8df4-2c16176c6a90 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:51.440833 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e3b3a3bd-420b-47d7-8df4-2c16176c6a90 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:51.444668 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e3b3a3bd-420b-47d7-8df4-2c16176c6a90 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:51.449500 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e3b3a3bd-420b-47d7-8df4-2c16176c6a90 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:51.454089 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e3b3a3bd-420b-47d7-8df4-2c16176c6a90 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:51.456671 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e3b3a3bd-420b-47d7-8df4-2c16176c6a90 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:51.520541 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-9d43ecf5-7f5c-4843-8116-61e909af4835 tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] 10.222.0.58 "GET /compute/v2.1/images/0f967916-982b-4b7c-bb3c-1ec6b8c4dd57" status: 200 len: 1422 microversion: 2.1 time: 0.138459 Aug 10 23:07:51.524713 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1317/2678] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 10 23:07:51 2022] GET /compute/v2.1/images/0f967916-982b-4b7c-bb3c-1ec6b8c4dd57 => generated 1422 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:07:51.554276 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c4a56ad3-ace5-4f05-a275-fab24b2d8148 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:51.555666 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-c4a56ad3-ace5-4f05-a275-fab24b2d8148 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] [instance: 8385348f-0651-486d-9b4a-2c884933edb1] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:51.580712 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c4a56ad3-ace5-4f05-a275-fab24b2d8148 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:51.586491 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c4a56ad3-ace5-4f05-a275-fab24b2d8148 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:51.589639 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c4a56ad3-ace5-4f05-a275-fab24b2d8148 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:51.590597 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c4a56ad3-ace5-4f05-a275-fab24b2d8148 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:51.591260 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c4a56ad3-ace5-4f05-a275-fab24b2d8148 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:51.594946 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c4a56ad3-ace5-4f05-a275-fab24b2d8148 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:51.692630 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=4 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:07:51.838018 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.objects.instance [None req-c4a56ad3-ace5-4f05-a275-fab24b2d8148 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Lazy-loading 'services' on Instance uuid 8385348f-0651-486d-9b4a-2c884933edb1 {{(pid=122632) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:07:51.898140 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-c4a56ad3-ace5-4f05-a275-fab24b2d8148 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/8385348f-0651-486d-9b4a-2c884933edb1" status: 200 len: 1931 microversion: 2.75 time: 0.363763 Aug 10 23:07:51.899075 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1318/2679] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:07:51 2022] GET /compute/v2.1/servers/8385348f-0651-486d-9b4a-2c884933edb1 => generated 1931 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:07:52.027327 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-e3b3a3bd-420b-47d7-8df4-2c16176c6a90 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8899e278c9453fba0ab05c69b0b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46ac8b84bd649fa88897068dbfa5ce6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:52.041981 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-e3b3a3bd-420b-47d7-8df4-2c16176c6a90 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] 10.222.0.58 "GET /compute/v2.1/servers/3aa229ba-7292-41ee-922a-32c281be9f42" status: 200 len: 1317 microversion: 2.1 time: 0.649405 Aug 10 23:07:52.046449 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1362/2680] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:07:51 2022] GET /compute/v2.1/servers/3aa229ba-7292-41ee-922a-32c281be9f42 => generated 1317 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:07:52.276841 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-d2e90d32-174c-4028-8469-14554ca0cab2 req-80515eb9-1f57-41f9-a9b8-a04e9c5313d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eea0fab7-447d-4f5f-8577-6ef8df500499", "tag": "c28daca8-af14-4727-818b-5bb0398c4dc4"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:07:52.304618 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-d2e90d32-174c-4028-8469-14554ca0cab2 req-80515eb9-1f57-41f9-a9b8-a04e9c5313d4 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:52.306232 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-d2e90d32-174c-4028-8469-14554ca0cab2 req-80515eb9-1f57-41f9-a9b8-a04e9c5313d4 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:52.307549 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-d2e90d32-174c-4028-8469-14554ca0cab2 req-80515eb9-1f57-41f9-a9b8-a04e9c5313d4 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:52.341830 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-d2e90d32-174c-4028-8469-14554ca0cab2 req-80515eb9-1f57-41f9-a9b8-a04e9c5313d4 service nova] Creating event network-changed:c28daca8-af14-4727-818b-5bb0398c4dc4 for instance eea0fab7-447d-4f5f-8577-6ef8df500499 on n-h1-850468-14 Aug 10 23:07:52.353100 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-d2e90d32-174c-4028-8469-14554ca0cab2 req-80515eb9-1f57-41f9-a9b8-a04e9c5313d4 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078876 Aug 10 23:07:52.356395 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1319/2681] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:07:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:07:52.402113 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-07d86c11-7fec-497d-92fb-58474bacfc83 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:52.404163 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-07d86c11-7fec-497d-92fb-58474bacfc83 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] [instance: 6fe68649-0e9b-4059-afb6-cc44844ff476] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:52.413645 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-07d86c11-7fec-497d-92fb-58474bacfc83 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:52.417577 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-07d86c11-7fec-497d-92fb-58474bacfc83 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:52.417808 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-47c19a2e-87fd-46ad-b9df-f041c9ea392d tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:52.418464 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-47c19a2e-87fd-46ad-b9df-f041c9ea392d tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] [instance: eea0fab7-447d-4f5f-8577-6ef8df500499] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:52.420699 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-07d86c11-7fec-497d-92fb-58474bacfc83 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:52.421484 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-07d86c11-7fec-497d-92fb-58474bacfc83 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:52.425533 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-07d86c11-7fec-497d-92fb-58474bacfc83 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:52.426188 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-07d86c11-7fec-497d-92fb-58474bacfc83 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:52.437026 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-47c19a2e-87fd-46ad-b9df-f041c9ea392d tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:52.446751 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-47c19a2e-87fd-46ad-b9df-f041c9ea392d tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:52.447615 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-47c19a2e-87fd-46ad-b9df-f041c9ea392d tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:52.448618 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-47c19a2e-87fd-46ad-b9df-f041c9ea392d tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:52.450615 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-47c19a2e-87fd-46ad-b9df-f041c9ea392d tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:52.453886 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-47c19a2e-87fd-46ad-b9df-f041c9ea392d tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:52.899651 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-07d86c11-7fec-497d-92fb-58474bacfc83 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c6e1f505b8409ea38f8a07bad870a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6473e36eada44e6bca8dc568e5ee330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:52.916203 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-07d86c11-7fec-497d-92fb-58474bacfc83 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] 10.222.0.58 "GET /compute/v2.1/servers/6fe68649-0e9b-4059-afb6-cc44844ff476" status: 200 len: 1333 microversion: 2.1 time: 0.518244 Aug 10 23:07:52.917017 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1363/2682] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:07:52 2022] GET /compute/v2.1/servers/6fe68649-0e9b-4059-afb6-cc44844ff476 => generated 1333 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:07:52.930921 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-5433b920-86b4-42fb-8a8f-5ce99b94b555 tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Calling method '.version_select at 0x7f847c570310>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:53.040658 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-5433b920-86b4-42fb-8a8f-5ce99b94b555 tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] 10.222.0.58 "GET /compute/v2.1/images/0f967916-982b-4b7c-bb3c-1ec6b8c4dd57" status: 200 len: 1422 microversion: 2.1 time: 0.120795 Aug 10 23:07:53.042332 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1364/2683] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 10 23:07:52 2022] GET /compute/v2.1/images/0f967916-982b-4b7c-bb3c-1ec6b8c4dd57 => generated 1422 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:07:53.049959 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-7be44cd9-7dc0-47f1-b0ce-81b67b2db615 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:53.059292 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-7be44cd9-7dc0-47f1-b0ce-81b67b2db615 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] [instance: 8385348f-0651-486d-9b4a-2c884933edb1] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:53.075260 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7be44cd9-7dc0-47f1-b0ce-81b67b2db615 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:53.076211 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7be44cd9-7dc0-47f1-b0ce-81b67b2db615 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:53.076785 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7be44cd9-7dc0-47f1-b0ce-81b67b2db615 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:53.077746 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7be44cd9-7dc0-47f1-b0ce-81b67b2db615 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:53.078417 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7be44cd9-7dc0-47f1-b0ce-81b67b2db615 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:53.079087 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7be44cd9-7dc0-47f1-b0ce-81b67b2db615 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:53.185388 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.objects.instance [None req-7be44cd9-7dc0-47f1-b0ce-81b67b2db615 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Lazy-loading 'services' on Instance uuid 8385348f-0651-486d-9b4a-2c884933edb1 {{(pid=122633) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:07:53.220843 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-7be44cd9-7dc0-47f1-b0ce-81b67b2db615 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/8385348f-0651-486d-9b4a-2c884933edb1" status: 200 len: 1931 microversion: 2.75 time: 0.173860 Aug 10 23:07:53.221998 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1365/2684] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:07:53 2022] GET /compute/v2.1/servers/8385348f-0651-486d-9b4a-2c884933edb1 => generated 1931 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:07:53.227133 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-f4f9738e-d786-447f-8807-ab950c9f725f tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:53.228197 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-f4f9738e-d786-447f-8807-ab950c9f725f tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] [instance: 3aa229ba-7292-41ee-922a-32c281be9f42] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:53.236110 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f4f9738e-d786-447f-8807-ab950c9f725f tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:53.237301 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f4f9738e-d786-447f-8807-ab950c9f725f tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:53.238246 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f4f9738e-d786-447f-8807-ab950c9f725f tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:53.240191 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f4f9738e-d786-447f-8807-ab950c9f725f tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:53.241264 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f4f9738e-d786-447f-8807-ab950c9f725f tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:53.241926 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f4f9738e-d786-447f-8807-ab950c9f725f tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:53.531643 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-f4f9738e-d786-447f-8807-ab950c9f725f tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8899e278c9453fba0ab05c69b0b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46ac8b84bd649fa88897068dbfa5ce6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:53.544019 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-f4f9738e-d786-447f-8807-ab950c9f725f tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] 10.222.0.58 "GET /compute/v2.1/servers/3aa229ba-7292-41ee-922a-32c281be9f42" status: 200 len: 1317 microversion: 2.1 time: 0.320691 Aug 10 23:07:53.547743 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1366/2685] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:07:53 2022] GET /compute/v2.1/servers/3aa229ba-7292-41ee-922a-32c281be9f42 => generated 1317 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:07:53.702452 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-47c19a2e-87fd-46ad-b9df-f041c9ea392d tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bbb4f184e4409d9eed51e0b98dfb29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708f8d4c4ed6432d85e0bf6a9bac7677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:53.732242 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-47c19a2e-87fd-46ad-b9df-f041c9ea392d tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] 10.222.0.58 "GET /compute/v2.1/servers/eea0fab7-447d-4f5f-8577-6ef8df500499" status: 200 len: 1324 microversion: 2.1 time: 1.309505 Aug 10 23:07:53.761432 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1320/2686] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:07:52 2022] GET /compute/v2.1/servers/eea0fab7-447d-4f5f-8577-6ef8df500499 => generated 1324 bytes in 1349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:07:53.944261 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-6900a2f6-7b23-4624-b308-f108688fc5e0 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:53.946458 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-6900a2f6-7b23-4624-b308-f108688fc5e0 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] [instance: 6fe68649-0e9b-4059-afb6-cc44844ff476] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:53.974271 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6900a2f6-7b23-4624-b308-f108688fc5e0 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:53.974943 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6900a2f6-7b23-4624-b308-f108688fc5e0 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:53.975602 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6900a2f6-7b23-4624-b308-f108688fc5e0 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:53.977723 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6900a2f6-7b23-4624-b308-f108688fc5e0 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:53.979819 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6900a2f6-7b23-4624-b308-f108688fc5e0 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:53.983263 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6900a2f6-7b23-4624-b308-f108688fc5e0 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:54.056948 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-f9113052-1818-42cb-aa94-0c9ef5eb8463 tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Calling method '.version_select at 0x7f847d370790>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:54.145047 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-f9113052-1818-42cb-aa94-0c9ef5eb8463 tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] 10.222.0.58 "GET /compute/v2.1/images/0f967916-982b-4b7c-bb3c-1ec6b8c4dd57" status: 200 len: 1422 microversion: 2.1 time: 0.093128 Aug 10 23:07:54.147183 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1321/2687] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 10 23:07:54 2022] GET /compute/v2.1/images/0f967916-982b-4b7c-bb3c-1ec6b8c4dd57 => generated 1422 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:07:54.251126 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-168c02bb-493a-4c05-b108-f6e0c7b98e3d tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:54.252130 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-168c02bb-493a-4c05-b108-f6e0c7b98e3d tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] [instance: 8385348f-0651-486d-9b4a-2c884933edb1] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:54.267916 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-168c02bb-493a-4c05-b108-f6e0c7b98e3d tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:54.268839 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-168c02bb-493a-4c05-b108-f6e0c7b98e3d tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:54.269667 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-168c02bb-493a-4c05-b108-f6e0c7b98e3d tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:54.270672 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-168c02bb-493a-4c05-b108-f6e0c7b98e3d tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:54.271655 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-168c02bb-493a-4c05-b108-f6e0c7b98e3d tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:54.273203 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-168c02bb-493a-4c05-b108-f6e0c7b98e3d tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:54.362394 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-6900a2f6-7b23-4624-b308-f108688fc5e0 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c6e1f505b8409ea38f8a07bad870a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6473e36eada44e6bca8dc568e5ee330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:54.375484 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-6900a2f6-7b23-4624-b308-f108688fc5e0 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] 10.222.0.58 "GET /compute/v2.1/servers/6fe68649-0e9b-4059-afb6-cc44844ff476" status: 200 len: 1333 microversion: 2.1 time: 0.437173 Aug 10 23:07:54.400676 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1367/2688] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:07:53 2022] GET /compute/v2.1/servers/6fe68649-0e9b-4059-afb6-cc44844ff476 => generated 1333 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:07:54.573283 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-24fca66c-b94f-4cb2-96f5-42d635f06ea6 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:54.581121 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-24fca66c-b94f-4cb2-96f5-42d635f06ea6 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] [instance: 3aa229ba-7292-41ee-922a-32c281be9f42] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:54.591733 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-24fca66c-b94f-4cb2-96f5-42d635f06ea6 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:54.592944 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-24fca66c-b94f-4cb2-96f5-42d635f06ea6 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:54.593621 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-24fca66c-b94f-4cb2-96f5-42d635f06ea6 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:54.594541 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-24fca66c-b94f-4cb2-96f5-42d635f06ea6 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:54.595232 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-24fca66c-b94f-4cb2-96f5-42d635f06ea6 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:54.595888 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-24fca66c-b94f-4cb2-96f5-42d635f06ea6 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:54.657449 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.objects.instance [None req-168c02bb-493a-4c05-b108-f6e0c7b98e3d tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Lazy-loading 'services' on Instance uuid 8385348f-0651-486d-9b4a-2c884933edb1 {{(pid=122632) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:07:54.740418 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-168c02bb-493a-4c05-b108-f6e0c7b98e3d tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/8385348f-0651-486d-9b4a-2c884933edb1" status: 200 len: 1931 microversion: 2.75 time: 0.493377 Aug 10 23:07:54.741362 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1322/2689] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:07:54 2022] GET /compute/v2.1/servers/8385348f-0651-486d-9b4a-2c884933edb1 => generated 1931 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:07:54.762506 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-6ea9f15a-cdd2-44ef-820d-6bd31096e982 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:54.763209 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-6ea9f15a-cdd2-44ef-820d-6bd31096e982 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] [instance: eea0fab7-447d-4f5f-8577-6ef8df500499] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:54.774561 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6ea9f15a-cdd2-44ef-820d-6bd31096e982 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:54.775342 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6ea9f15a-cdd2-44ef-820d-6bd31096e982 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:54.776113 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6ea9f15a-cdd2-44ef-820d-6bd31096e982 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:54.777550 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6ea9f15a-cdd2-44ef-820d-6bd31096e982 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:54.778161 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6ea9f15a-cdd2-44ef-820d-6bd31096e982 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:54.778653 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6ea9f15a-cdd2-44ef-820d-6bd31096e982 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:54.809816 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-24fca66c-b94f-4cb2-96f5-42d635f06ea6 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8899e278c9453fba0ab05c69b0b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46ac8b84bd649fa88897068dbfa5ce6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:54.827956 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-24fca66c-b94f-4cb2-96f5-42d635f06ea6 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] 10.222.0.58 "GET /compute/v2.1/servers/3aa229ba-7292-41ee-922a-32c281be9f42" status: 200 len: 1317 microversion: 2.1 time: 0.263689 Aug 10 23:07:54.829665 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1368/2690] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:07:54 2022] GET /compute/v2.1/servers/3aa229ba-7292-41ee-922a-32c281be9f42 => generated 1317 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:07:55.126735 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-7f743d9a-e293-450e-bbb3-711576ca7159 req-7e9c9623-fc47-44fd-825a-eb9b27a1ae24 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3aa229ba-7292-41ee-922a-32c281be9f42", "tag": "34dd8ab6-09ba-4c97-9c08-880d9b727e0e"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:07:55.146088 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-7f743d9a-e293-450e-bbb3-711576ca7159 req-7e9c9623-fc47-44fd-825a-eb9b27a1ae24 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:55.146738 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-7f743d9a-e293-450e-bbb3-711576ca7159 req-7e9c9623-fc47-44fd-825a-eb9b27a1ae24 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:55.148206 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-7f743d9a-e293-450e-bbb3-711576ca7159 req-7e9c9623-fc47-44fd-825a-eb9b27a1ae24 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:55.163584 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-7f743d9a-e293-450e-bbb3-711576ca7159 req-7e9c9623-fc47-44fd-825a-eb9b27a1ae24 service nova] Creating event network-changed:34dd8ab6-09ba-4c97-9c08-880d9b727e0e for instance 3aa229ba-7292-41ee-922a-32c281be9f42 on n-h2-850468-14 Aug 10 23:07:55.170342 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-7f743d9a-e293-450e-bbb3-711576ca7159 req-7e9c9623-fc47-44fd-825a-eb9b27a1ae24 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048113 Aug 10 23:07:55.174066 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1369/2691] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:07:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 23:07:55.180238 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-afae3936-f303-48a7-a4ae-7c5a8b012599 tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Calling method '.version_select at 0x7f847d107280>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:55.263294 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-afae3936-f303-48a7-a4ae-7c5a8b012599 tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] 10.222.0.58 "GET /compute/v2.1/images/0f967916-982b-4b7c-bb3c-1ec6b8c4dd57" status: 200 len: 1422 microversion: 2.1 time: 0.087546 Aug 10 23:07:55.264116 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1370/2692] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 10 23:07:55 2022] GET /compute/v2.1/images/0f967916-982b-4b7c-bb3c-1ec6b8c4dd57 => generated 1422 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:07:55.336803 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-6ea9f15a-cdd2-44ef-820d-6bd31096e982 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bbb4f184e4409d9eed51e0b98dfb29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708f8d4c4ed6432d85e0bf6a9bac7677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:55.352788 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-6ea9f15a-cdd2-44ef-820d-6bd31096e982 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] 10.222.0.58 "GET /compute/v2.1/servers/eea0fab7-447d-4f5f-8577-6ef8df500499" status: 200 len: 1324 microversion: 2.1 time: 0.595022 Aug 10 23:07:55.354620 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1323/2693] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:07:54 2022] GET /compute/v2.1/servers/eea0fab7-447d-4f5f-8577-6ef8df500499 => generated 1324 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:07:55.405400 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-b7eeb275-3ce7-43b0-bca6-6e1c0165fbc5 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:55.406876 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-b7eeb275-3ce7-43b0-bca6-6e1c0165fbc5 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] [instance: 6fe68649-0e9b-4059-afb6-cc44844ff476] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:55.419009 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b7eeb275-3ce7-43b0-bca6-6e1c0165fbc5 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:55.419774 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b7eeb275-3ce7-43b0-bca6-6e1c0165fbc5 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:55.420391 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b7eeb275-3ce7-43b0-bca6-6e1c0165fbc5 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:55.421255 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b7eeb275-3ce7-43b0-bca6-6e1c0165fbc5 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:55.421863 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b7eeb275-3ce7-43b0-bca6-6e1c0165fbc5 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:55.422441 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b7eeb275-3ce7-43b0-bca6-6e1c0165fbc5 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:55.630355 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-b7eeb275-3ce7-43b0-bca6-6e1c0165fbc5 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c6e1f505b8409ea38f8a07bad870a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6473e36eada44e6bca8dc568e5ee330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:55.642392 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-b7eeb275-3ce7-43b0-bca6-6e1c0165fbc5 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] 10.222.0.58 "GET /compute/v2.1/servers/6fe68649-0e9b-4059-afb6-cc44844ff476" status: 200 len: 1333 microversion: 2.1 time: 0.242314 Aug 10 23:07:55.644450 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1371/2694] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:07:55 2022] GET /compute/v2.1/servers/6fe68649-0e9b-4059-afb6-cc44844ff476 => generated 1333 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:07:55.774372 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-76f88730-b21f-4200-b840-f9062cd80d8d tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:55.775554 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-76f88730-b21f-4200-b840-f9062cd80d8d tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] [instance: 8385348f-0651-486d-9b4a-2c884933edb1] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:55.814875 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-76f88730-b21f-4200-b840-f9062cd80d8d tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:55.815906 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-76f88730-b21f-4200-b840-f9062cd80d8d tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:55.833334 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-76f88730-b21f-4200-b840-f9062cd80d8d tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:55.835405 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-76f88730-b21f-4200-b840-f9062cd80d8d tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:55.836388 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-76f88730-b21f-4200-b840-f9062cd80d8d tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:55.836982 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-76f88730-b21f-4200-b840-f9062cd80d8d tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:55.849921 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-3575da76-1dd4-46e3-b9e3-2527f762fceb tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:55.850948 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-3575da76-1dd4-46e3-b9e3-2527f762fceb tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] [instance: 3aa229ba-7292-41ee-922a-32c281be9f42] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:55.888359 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3575da76-1dd4-46e3-b9e3-2527f762fceb tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:55.889198 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3575da76-1dd4-46e3-b9e3-2527f762fceb tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:55.889916 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3575da76-1dd4-46e3-b9e3-2527f762fceb tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:55.890961 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3575da76-1dd4-46e3-b9e3-2527f762fceb tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:55.891621 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3575da76-1dd4-46e3-b9e3-2527f762fceb tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:55.892866 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3575da76-1dd4-46e3-b9e3-2527f762fceb tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:55.907283 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=2 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:07:56.000620 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=8 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:07:56.205609 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-3575da76-1dd4-46e3-b9e3-2527f762fceb tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8899e278c9453fba0ab05c69b0b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46ac8b84bd649fa88897068dbfa5ce6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:56.215957 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-3575da76-1dd4-46e3-b9e3-2527f762fceb tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] 10.222.0.58 "GET /compute/v2.1/servers/3aa229ba-7292-41ee-922a-32c281be9f42" status: 200 len: 1317 microversion: 2.1 time: 0.370142 Aug 10 23:07:56.234827 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1372/2695] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:07:55 2022] GET /compute/v2.1/servers/3aa229ba-7292-41ee-922a-32c281be9f42 => generated 1317 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:07:56.277793 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-923de777-e110-4ca8-9b04-dfb681b41683 tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Calling method '.version_select at 0x7f8482395550>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:56.419732 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-923de777-e110-4ca8-9b04-dfb681b41683 tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] 10.222.0.58 "GET /compute/v2.1/images/0f967916-982b-4b7c-bb3c-1ec6b8c4dd57" status: 200 len: 1422 microversion: 2.1 time: 0.145766 Aug 10 23:07:56.420999 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1373/2696] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 10 23:07:56 2022] GET /compute/v2.1/images/0f967916-982b-4b7c-bb3c-1ec6b8c4dd57 => generated 1422 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:07:56.432573 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-c075879c-ca89-403f-8075-da5c7874e5e6 req-44e55e33-cab1-4da3-b900-95d949dc042a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6fe68649-0e9b-4059-afb6-cc44844ff476", "name": "network-vif-plugged", "status": "completed", "tag": "8df81506-7d26-470f-b8be-99340c977e96"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:07:56.478109 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-c075879c-ca89-403f-8075-da5c7874e5e6 req-44e55e33-cab1-4da3-b900-95d949dc042a service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:56.487509 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-c075879c-ca89-403f-8075-da5c7874e5e6 req-44e55e33-cab1-4da3-b900-95d949dc042a service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:56.488254 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-c075879c-ca89-403f-8075-da5c7874e5e6 req-44e55e33-cab1-4da3-b900-95d949dc042a service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:56.520481 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-c075879c-ca89-403f-8075-da5c7874e5e6 req-44e55e33-cab1-4da3-b900-95d949dc042a service nova] Creating event network-vif-plugged:8df81506-7d26-470f-b8be-99340c977e96 for instance 6fe68649-0e9b-4059-afb6-cc44844ff476 on n-h2-850468-14 Aug 10 23:07:56.537267 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-c075879c-ca89-403f-8075-da5c7874e5e6 req-44e55e33-cab1-4da3-b900-95d949dc042a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114808 Aug 10 23:07:56.538452 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1374/2697] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:07:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:07:56.556290 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-cac34c6a-6552-4a69-a0e4-3903ca9cefcf tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:56.561221 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-cac34c6a-6552-4a69-a0e4-3903ca9cefcf tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] [instance: eea0fab7-447d-4f5f-8577-6ef8df500499] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:56.576882 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cac34c6a-6552-4a69-a0e4-3903ca9cefcf tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:56.577579 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cac34c6a-6552-4a69-a0e4-3903ca9cefcf tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:56.578751 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cac34c6a-6552-4a69-a0e4-3903ca9cefcf tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:56.581839 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cac34c6a-6552-4a69-a0e4-3903ca9cefcf tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:56.582482 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cac34c6a-6552-4a69-a0e4-3903ca9cefcf tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:56.588966 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.objects.instance [None req-76f88730-b21f-4200-b840-f9062cd80d8d tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Lazy-loading 'services' on Instance uuid 8385348f-0651-486d-9b4a-2c884933edb1 {{(pid=122632) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:07:56.589440 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cac34c6a-6552-4a69-a0e4-3903ca9cefcf tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:56.646835 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-76f88730-b21f-4200-b840-f9062cd80d8d tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/8385348f-0651-486d-9b4a-2c884933edb1" status: 200 len: 1931 microversion: 2.75 time: 0.881942 Aug 10 23:07:56.668557 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1324/2698] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:07:55 2022] GET /compute/v2.1/servers/8385348f-0651-486d-9b4a-2c884933edb1 => generated 1931 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:07:56.675527 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-f5ae15b9-6495-4fe2-a206-ae405e120c3c tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:56.676340 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-f5ae15b9-6495-4fe2-a206-ae405e120c3c tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] [instance: 6fe68649-0e9b-4059-afb6-cc44844ff476] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:56.686681 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f5ae15b9-6495-4fe2-a206-ae405e120c3c tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:56.687636 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f5ae15b9-6495-4fe2-a206-ae405e120c3c tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:56.688237 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f5ae15b9-6495-4fe2-a206-ae405e120c3c tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:56.689750 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f5ae15b9-6495-4fe2-a206-ae405e120c3c tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:56.690649 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f5ae15b9-6495-4fe2-a206-ae405e120c3c tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:56.691260 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f5ae15b9-6495-4fe2-a206-ae405e120c3c tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:56.957274 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-cac34c6a-6552-4a69-a0e4-3903ca9cefcf tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bbb4f184e4409d9eed51e0b98dfb29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708f8d4c4ed6432d85e0bf6a9bac7677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:56.972045 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-cac34c6a-6552-4a69-a0e4-3903ca9cefcf tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] 10.222.0.58 "GET /compute/v2.1/servers/eea0fab7-447d-4f5f-8577-6ef8df500499" status: 200 len: 1324 microversion: 2.1 time: 0.432081 Aug 10 23:07:56.972869 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1375/2699] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:07:56 2022] GET /compute/v2.1/servers/eea0fab7-447d-4f5f-8577-6ef8df500499 => generated 1324 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:07:57.241960 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-f5ae15b9-6495-4fe2-a206-ae405e120c3c tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c6e1f505b8409ea38f8a07bad870a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6473e36eada44e6bca8dc568e5ee330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:57.246638 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-a8613119-a307-4883-bafb-93613e64f01f tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:57.253428 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-f5ae15b9-6495-4fe2-a206-ae405e120c3c tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] 10.222.0.58 "GET /compute/v2.1/servers/6fe68649-0e9b-4059-afb6-cc44844ff476" status: 200 len: 1333 microversion: 2.1 time: 0.583428 Aug 10 23:07:57.254739 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1325/2700] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:07:56 2022] GET /compute/v2.1/servers/6fe68649-0e9b-4059-afb6-cc44844ff476 => generated 1333 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:07:57.256827 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-a8613119-a307-4883-bafb-93613e64f01f tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] [instance: 3aa229ba-7292-41ee-922a-32c281be9f42] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:57.271757 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a8613119-a307-4883-bafb-93613e64f01f tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:57.272503 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a8613119-a307-4883-bafb-93613e64f01f tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:57.273128 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a8613119-a307-4883-bafb-93613e64f01f tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:57.275462 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a8613119-a307-4883-bafb-93613e64f01f tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:57.276155 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a8613119-a307-4883-bafb-93613e64f01f tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:57.276742 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a8613119-a307-4883-bafb-93613e64f01f tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:57.438374 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-99201673-e8e4-45cd-951d-c19301ebbbf5 tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Calling method '.version_select at 0x7f847db49160>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:57.453746 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=16 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:07:57.545518 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-a8613119-a307-4883-bafb-93613e64f01f tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8899e278c9453fba0ab05c69b0b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46ac8b84bd649fa88897068dbfa5ce6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:57.558277 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-a8613119-a307-4883-bafb-93613e64f01f tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] 10.222.0.58 "GET /compute/v2.1/servers/3aa229ba-7292-41ee-922a-32c281be9f42" status: 200 len: 1317 microversion: 2.1 time: 0.321460 Aug 10 23:07:57.559553 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1376/2701] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:07:57 2022] GET /compute/v2.1/servers/3aa229ba-7292-41ee-922a-32c281be9f42 => generated 1317 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:07:57.574185 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-99201673-e8e4-45cd-951d-c19301ebbbf5 tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] 10.222.0.58 "GET /compute/v2.1/images/0f967916-982b-4b7c-bb3c-1ec6b8c4dd57" status: 200 len: 1422 microversion: 2.1 time: 0.141350 Aug 10 23:07:57.578841 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1326/2702] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 10 23:07:57 2022] GET /compute/v2.1/images/0f967916-982b-4b7c-bb3c-1ec6b8c4dd57 => generated 1422 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:07:57.677861 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-732096fc-c627-4581-a72f-e539ff482ac3 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:57.678529 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-732096fc-c627-4581-a72f-e539ff482ac3 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] [instance: 8385348f-0651-486d-9b4a-2c884933edb1] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:57.690374 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-732096fc-c627-4581-a72f-e539ff482ac3 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:57.690901 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-732096fc-c627-4581-a72f-e539ff482ac3 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:57.691338 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-732096fc-c627-4581-a72f-e539ff482ac3 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:57.692222 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-732096fc-c627-4581-a72f-e539ff482ac3 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:57.692835 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-732096fc-c627-4581-a72f-e539ff482ac3 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:57.693421 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-732096fc-c627-4581-a72f-e539ff482ac3 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:57.862448 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.objects.instance [None req-732096fc-c627-4581-a72f-e539ff482ac3 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Lazy-loading 'services' on Instance uuid 8385348f-0651-486d-9b4a-2c884933edb1 {{(pid=122633) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:07:57.904660 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-732096fc-c627-4581-a72f-e539ff482ac3 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/8385348f-0651-486d-9b4a-2c884933edb1" status: 200 len: 1931 microversion: 2.75 time: 0.231769 Aug 10 23:07:57.915212 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1377/2703] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:07:57 2022] GET /compute/v2.1/servers/8385348f-0651-486d-9b4a-2c884933edb1 => generated 1931 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:07:57.994589 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-7ee60c9f-550a-43ad-afdf-13f072e1d11b tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:57.995766 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-7ee60c9f-550a-43ad-afdf-13f072e1d11b tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] [instance: eea0fab7-447d-4f5f-8577-6ef8df500499] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:58.010524 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7ee60c9f-550a-43ad-afdf-13f072e1d11b tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:58.015496 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7ee60c9f-550a-43ad-afdf-13f072e1d11b tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:58.016227 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7ee60c9f-550a-43ad-afdf-13f072e1d11b tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:58.021949 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7ee60c9f-550a-43ad-afdf-13f072e1d11b tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:58.022701 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7ee60c9f-550a-43ad-afdf-13f072e1d11b tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:58.023937 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7ee60c9f-550a-43ad-afdf-13f072e1d11b tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:58.285759 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-b5f3c347-4147-4584-879e-17b7472465da tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:58.286485 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-b5f3c347-4147-4584-879e-17b7472465da tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] [instance: 6fe68649-0e9b-4059-afb6-cc44844ff476] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:58.300670 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b5f3c347-4147-4584-879e-17b7472465da tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:58.311540 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b5f3c347-4147-4584-879e-17b7472465da tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:58.314373 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b5f3c347-4147-4584-879e-17b7472465da tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:58.318568 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b5f3c347-4147-4584-879e-17b7472465da tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:58.321908 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b5f3c347-4147-4584-879e-17b7472465da tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:58.325154 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b5f3c347-4147-4584-879e-17b7472465da tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:58.333919 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-7ee60c9f-550a-43ad-afdf-13f072e1d11b tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bbb4f184e4409d9eed51e0b98dfb29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708f8d4c4ed6432d85e0bf6a9bac7677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:58.351962 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-7ee60c9f-550a-43ad-afdf-13f072e1d11b tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] 10.222.0.58 "GET /compute/v2.1/servers/eea0fab7-447d-4f5f-8577-6ef8df500499" status: 200 len: 1324 microversion: 2.1 time: 0.353609 Aug 10 23:07:58.355401 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1327/2704] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:07:57 2022] GET /compute/v2.1/servers/eea0fab7-447d-4f5f-8577-6ef8df500499 => generated 1324 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:07:58.581495 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-640c9317-1b91-434f-925f-ea28df325c52 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:58.582482 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-640c9317-1b91-434f-925f-ea28df325c52 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] [instance: 3aa229ba-7292-41ee-922a-32c281be9f42] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:58.591234 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-640c9317-1b91-434f-925f-ea28df325c52 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:58.591988 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-640c9317-1b91-434f-925f-ea28df325c52 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:58.592747 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-640c9317-1b91-434f-925f-ea28df325c52 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:58.593570 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-640c9317-1b91-434f-925f-ea28df325c52 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:58.594879 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-640c9317-1b91-434f-925f-ea28df325c52 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:58.597256 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-640c9317-1b91-434f-925f-ea28df325c52 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:58.911356 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-640c9317-1b91-434f-925f-ea28df325c52 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8899e278c9453fba0ab05c69b0b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46ac8b84bd649fa88897068dbfa5ce6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:58.919449 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-640c9317-1b91-434f-925f-ea28df325c52 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] 10.222.0.58 "GET /compute/v2.1/servers/3aa229ba-7292-41ee-922a-32c281be9f42" status: 200 len: 1317 microversion: 2.1 time: 0.341604 Aug 10 23:07:58.927487 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-b5f3c347-4147-4584-879e-17b7472465da tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c6e1f505b8409ea38f8a07bad870a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6473e36eada44e6bca8dc568e5ee330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:58.939633 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1328/2705] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:07:58 2022] GET /compute/v2.1/servers/3aa229ba-7292-41ee-922a-32c281be9f42 => generated 1317 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:07:58.942923 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-b5f3c347-4147-4584-879e-17b7472465da tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] 10.222.0.58 "GET /compute/v2.1/servers/6fe68649-0e9b-4059-afb6-cc44844ff476" status: 200 len: 1333 microversion: 2.1 time: 0.657357 Aug 10 23:07:58.948286 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-06a8ec73-68dd-49c8-bc0b-3174b7a2e82c tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Calling method '.version_select at 0x7f847de48310>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:58.957340 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1378/2706] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:07:58 2022] GET /compute/v2.1/servers/6fe68649-0e9b-4059-afb6-cc44844ff476 => generated 1333 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:07:58.965908 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-83daa60a-bae7-4866-a52c-9d82f6d95286 req-a59657fb-1a9c-4d87-b7d1-77bd5c067d1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6fe68649-0e9b-4059-afb6-cc44844ff476", "name": "network-vif-plugged", "status": "completed", "tag": "63f7aab2-326b-45a5-92a2-d01e6f4959f3"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:07:58.979003 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-83daa60a-bae7-4866-a52c-9d82f6d95286 req-a59657fb-1a9c-4d87-b7d1-77bd5c067d1e service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:58.979745 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-83daa60a-bae7-4866-a52c-9d82f6d95286 req-a59657fb-1a9c-4d87-b7d1-77bd5c067d1e service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:58.980364 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-83daa60a-bae7-4866-a52c-9d82f6d95286 req-a59657fb-1a9c-4d87-b7d1-77bd5c067d1e service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:58.995320 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-83daa60a-bae7-4866-a52c-9d82f6d95286 req-a59657fb-1a9c-4d87-b7d1-77bd5c067d1e service nova] Creating event network-vif-plugged:63f7aab2-326b-45a5-92a2-d01e6f4959f3 for instance 6fe68649-0e9b-4059-afb6-cc44844ff476 on n-h2-850468-14 Aug 10 23:07:59.002544 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-83daa60a-bae7-4866-a52c-9d82f6d95286 req-a59657fb-1a9c-4d87-b7d1-77bd5c067d1e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043789 Aug 10 23:07:59.003440 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1379/2707] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:07:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:07:59.010840 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-de69392d-8348-40c5-ab96-bc5e79ea4161 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:59.012710 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-de69392d-8348-40c5-ab96-bc5e79ea4161 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] [instance: 8385348f-0651-486d-9b4a-2c884933edb1] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:59.021068 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-de69392d-8348-40c5-ab96-bc5e79ea4161 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:59.021916 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-de69392d-8348-40c5-ab96-bc5e79ea4161 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:59.022540 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-de69392d-8348-40c5-ab96-bc5e79ea4161 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:59.024070 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-de69392d-8348-40c5-ab96-bc5e79ea4161 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:59.025408 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-de69392d-8348-40c5-ab96-bc5e79ea4161 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:59.026421 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-de69392d-8348-40c5-ab96-bc5e79ea4161 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:59.042079 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-06a8ec73-68dd-49c8-bc0b-3174b7a2e82c tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] 10.222.0.58 "GET /compute/v2.1/images/0f967916-982b-4b7c-bb3c-1ec6b8c4dd57" status: 200 len: 1422 microversion: 2.1 time: 0.100552 Aug 10 23:07:59.042976 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1329/2708] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 10 23:07:58 2022] GET /compute/v2.1/images/0f967916-982b-4b7c-bb3c-1ec6b8c4dd57 => generated 1422 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:07:59.189869 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.objects.instance [None req-de69392d-8348-40c5-ab96-bc5e79ea4161 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Lazy-loading 'services' on Instance uuid 8385348f-0651-486d-9b4a-2c884933edb1 {{(pid=122633) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:07:59.222185 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=100 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:07:59.249986 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-de69392d-8348-40c5-ab96-bc5e79ea4161 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/8385348f-0651-486d-9b4a-2c884933edb1" status: 200 len: 1931 microversion: 2.75 time: 0.243885 Aug 10 23:07:59.252149 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1380/2709] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:07:59 2022] GET /compute/v2.1/servers/8385348f-0651-486d-9b4a-2c884933edb1 => generated 1931 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:07:59.379782 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-104d7b1c-4739-49ef-b504-1efacadcb426 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:59.381669 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-104d7b1c-4739-49ef-b504-1efacadcb426 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] [instance: eea0fab7-447d-4f5f-8577-6ef8df500499] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:59.392619 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-104d7b1c-4739-49ef-b504-1efacadcb426 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:59.393255 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-104d7b1c-4739-49ef-b504-1efacadcb426 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:59.393807 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-104d7b1c-4739-49ef-b504-1efacadcb426 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:59.394808 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-104d7b1c-4739-49ef-b504-1efacadcb426 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:59.395522 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-104d7b1c-4739-49ef-b504-1efacadcb426 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:59.396078 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-104d7b1c-4739-49ef-b504-1efacadcb426 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:59.619329 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-104d7b1c-4739-49ef-b504-1efacadcb426 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bbb4f184e4409d9eed51e0b98dfb29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708f8d4c4ed6432d85e0bf6a9bac7677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:07:59.631129 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-104d7b1c-4739-49ef-b504-1efacadcb426 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] 10.222.0.58 "GET /compute/v2.1/servers/eea0fab7-447d-4f5f-8577-6ef8df500499" status: 200 len: 1324 microversion: 2.1 time: 0.255187 Aug 10 23:07:59.632490 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1330/2710] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:07:59 2022] GET /compute/v2.1/servers/eea0fab7-447d-4f5f-8577-6ef8df500499 => generated 1324 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:07:59.951606 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-00b89f99-21db-40ee-827f-f5107576c7e3 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:59.952950 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-00b89f99-21db-40ee-827f-f5107576c7e3 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] [instance: 3aa229ba-7292-41ee-922a-32c281be9f42] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:59.962690 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-00b89f99-21db-40ee-827f-f5107576c7e3 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:59.963776 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-00b89f99-21db-40ee-827f-f5107576c7e3 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:59.966415 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-00b89f99-21db-40ee-827f-f5107576c7e3 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:59.967395 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-00b89f99-21db-40ee-827f-f5107576c7e3 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:59.968032 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-00b89f99-21db-40ee-827f-f5107576c7e3 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:59.968635 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-00b89f99-21db-40ee-827f-f5107576c7e3 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:59.972214 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-4c76427f-8f21-407d-b4fd-d9cc73d1591e tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:07:59.972987 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-4c76427f-8f21-407d-b4fd-d9cc73d1591e tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] [instance: 6fe68649-0e9b-4059-afb6-cc44844ff476] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:07:59.983804 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4c76427f-8f21-407d-b4fd-d9cc73d1591e tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:59.985708 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4c76427f-8f21-407d-b4fd-d9cc73d1591e tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:59.986268 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4c76427f-8f21-407d-b4fd-d9cc73d1591e tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:07:59.988531 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4c76427f-8f21-407d-b4fd-d9cc73d1591e tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:07:59.990972 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4c76427f-8f21-407d-b4fd-d9cc73d1591e tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:07:59.991463 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4c76427f-8f21-407d-b4fd-d9cc73d1591e tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:00.038458 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=100 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:08:00.165944 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-00b89f99-21db-40ee-827f-f5107576c7e3 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8899e278c9453fba0ab05c69b0b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46ac8b84bd649fa88897068dbfa5ce6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:08:00.174613 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-00b89f99-21db-40ee-827f-f5107576c7e3 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] 10.222.0.58 "GET /compute/v2.1/servers/3aa229ba-7292-41ee-922a-32c281be9f42" status: 200 len: 1317 microversion: 2.1 time: 0.227142 Aug 10 23:08:00.198880 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1381/2711] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:07:59 2022] GET /compute/v2.1/servers/3aa229ba-7292-41ee-922a-32c281be9f42 => generated 1317 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:08:00.204622 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c1f7f6e0-d4f4-483b-96db-d6791c5478af tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Calling method '.version_select at 0x7f847c570160>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:08:00.241079 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-4c76427f-8f21-407d-b4fd-d9cc73d1591e tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c6e1f505b8409ea38f8a07bad870a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6473e36eada44e6bca8dc568e5ee330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:08:00.260287 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-4c76427f-8f21-407d-b4fd-d9cc73d1591e tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] 10.222.0.58 "GET /compute/v2.1/servers/6fe68649-0e9b-4059-afb6-cc44844ff476" status: 200 len: 1333 microversion: 2.1 time: 0.292420 Aug 10 23:08:00.270818 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1331/2712] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:07:59 2022] GET /compute/v2.1/servers/6fe68649-0e9b-4059-afb6-cc44844ff476 => generated 1333 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:08:00.278166 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-c1f7f6e0-d4f4-483b-96db-d6791c5478af tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] 10.222.0.58 "GET /compute/v2.1/images/0f967916-982b-4b7c-bb3c-1ec6b8c4dd57" status: 200 len: 1422 microversion: 2.1 time: 0.077987 Aug 10 23:08:00.278731 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1382/2713] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 10 23:08:00 2022] GET /compute/v2.1/images/0f967916-982b-4b7c-bb3c-1ec6b8c4dd57 => generated 1422 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:08:00.280019 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-20d178fa-b575-43d3-bb87-8d4d357d3fda tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:08:00.280800 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-20d178fa-b575-43d3-bb87-8d4d357d3fda tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] [instance: 8385348f-0651-486d-9b4a-2c884933edb1] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:08:00.296851 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-20d178fa-b575-43d3-bb87-8d4d357d3fda tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:00.297482 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-20d178fa-b575-43d3-bb87-8d4d357d3fda tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:00.298023 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-20d178fa-b575-43d3-bb87-8d4d357d3fda tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:00.298975 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-20d178fa-b575-43d3-bb87-8d4d357d3fda tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:00.300197 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-20d178fa-b575-43d3-bb87-8d4d357d3fda tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:00.300711 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-20d178fa-b575-43d3-bb87-8d4d357d3fda tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:00.448978 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.objects.instance [None req-20d178fa-b575-43d3-bb87-8d4d357d3fda tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Lazy-loading 'services' on Instance uuid 8385348f-0651-486d-9b4a-2c884933edb1 {{(pid=122632) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:08:00.493337 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-20d178fa-b575-43d3-bb87-8d4d357d3fda tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/8385348f-0651-486d-9b4a-2c884933edb1" status: 200 len: 1931 microversion: 2.75 time: 0.217317 Aug 10 23:08:00.497932 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1332/2714] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:08:00 2022] GET /compute/v2.1/servers/8385348f-0651-486d-9b4a-2c884933edb1 => generated 1931 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 23:08:00.655528 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-2b48fa2a-95f7-44ae-8e71-eadb7f608555 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:08:00.659639 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-2b48fa2a-95f7-44ae-8e71-eadb7f608555 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] [instance: eea0fab7-447d-4f5f-8577-6ef8df500499] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:08:00.668023 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2b48fa2a-95f7-44ae-8e71-eadb7f608555 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:00.668629 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2b48fa2a-95f7-44ae-8e71-eadb7f608555 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:00.669171 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2b48fa2a-95f7-44ae-8e71-eadb7f608555 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:00.669988 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2b48fa2a-95f7-44ae-8e71-eadb7f608555 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:00.670546 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2b48fa2a-95f7-44ae-8e71-eadb7f608555 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:00.671694 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2b48fa2a-95f7-44ae-8e71-eadb7f608555 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:00.971114 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-2b48fa2a-95f7-44ae-8e71-eadb7f608555 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bbb4f184e4409d9eed51e0b98dfb29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708f8d4c4ed6432d85e0bf6a9bac7677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:08:00.982105 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-2b48fa2a-95f7-44ae-8e71-eadb7f608555 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] 10.222.0.58 "GET /compute/v2.1/servers/eea0fab7-447d-4f5f-8577-6ef8df500499" status: 200 len: 1324 microversion: 2.1 time: 0.330247 Aug 10 23:08:00.983070 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1383/2715] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:08:00 2022] GET /compute/v2.1/servers/eea0fab7-447d-4f5f-8577-6ef8df500499 => generated 1324 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:08:01.193416 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-6f7866b0-1fc8-4a52-a23e-1b515cdc0d60 req-c9393556-25f8-4c64-9705-4c1c710c2d9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eea0fab7-447d-4f5f-8577-6ef8df500499", "name": "network-vif-plugged", "status": "completed", "tag": "c28daca8-af14-4727-818b-5bb0398c4dc4"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:08:01.218660 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-8ca40cb7-3d48-466d-a5d3-854d3661e6f8 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:08:01.221158 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-8ca40cb7-3d48-466d-a5d3-854d3661e6f8 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] [instance: 3aa229ba-7292-41ee-922a-32c281be9f42] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:08:01.233099 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8ca40cb7-3d48-466d-a5d3-854d3661e6f8 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:01.233912 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8ca40cb7-3d48-466d-a5d3-854d3661e6f8 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:01.234720 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8ca40cb7-3d48-466d-a5d3-854d3661e6f8 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:01.235721 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8ca40cb7-3d48-466d-a5d3-854d3661e6f8 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:01.236398 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8ca40cb7-3d48-466d-a5d3-854d3661e6f8 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:01.237055 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8ca40cb7-3d48-466d-a5d3-854d3661e6f8 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:01.239371 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-6f7866b0-1fc8-4a52-a23e-1b515cdc0d60 req-c9393556-25f8-4c64-9705-4c1c710c2d9a service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:01.240098 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-6f7866b0-1fc8-4a52-a23e-1b515cdc0d60 req-c9393556-25f8-4c64-9705-4c1c710c2d9a service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:01.240495 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-6f7866b0-1fc8-4a52-a23e-1b515cdc0d60 req-c9393556-25f8-4c64-9705-4c1c710c2d9a service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:01.260546 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-6f7866b0-1fc8-4a52-a23e-1b515cdc0d60 req-c9393556-25f8-4c64-9705-4c1c710c2d9a service nova] Creating event network-vif-plugged:c28daca8-af14-4727-818b-5bb0398c4dc4 for instance eea0fab7-447d-4f5f-8577-6ef8df500499 on n-h1-850468-14 Aug 10 23:08:01.267793 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-6f7866b0-1fc8-4a52-a23e-1b515cdc0d60 req-c9393556-25f8-4c64-9705-4c1c710c2d9a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088556 Aug 10 23:08:01.268960 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1333/2716] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:08:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:08:01.293807 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-76370cb1-96c4-4f1f-b720-f121857c6451 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:08:01.294766 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-76370cb1-96c4-4f1f-b720-f121857c6451 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] [instance: 6fe68649-0e9b-4059-afb6-cc44844ff476] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:08:01.305599 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-76370cb1-96c4-4f1f-b720-f121857c6451 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:01.306559 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-76370cb1-96c4-4f1f-b720-f121857c6451 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:01.307189 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-76370cb1-96c4-4f1f-b720-f121857c6451 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:01.308102 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-76370cb1-96c4-4f1f-b720-f121857c6451 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:01.308559 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-76370cb1-96c4-4f1f-b720-f121857c6451 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:01.308985 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-76370cb1-96c4-4f1f-b720-f121857c6451 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:01.543373 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-8ca40cb7-3d48-466d-a5d3-854d3661e6f8 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8899e278c9453fba0ab05c69b0b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46ac8b84bd649fa88897068dbfa5ce6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:08:01.558774 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-8ca40cb7-3d48-466d-a5d3-854d3661e6f8 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] 10.222.0.58 "GET /compute/v2.1/servers/3aa229ba-7292-41ee-922a-32c281be9f42" status: 200 len: 1317 microversion: 2.1 time: 0.357455 Aug 10 23:08:01.560645 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1384/2717] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:08:01 2022] GET /compute/v2.1/servers/3aa229ba-7292-41ee-922a-32c281be9f42 => generated 1317 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:08:01.565523 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-9323a8de-ccfa-45fa-9751-bddfb4dbfdf1 tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Calling method '.version_select at 0x7f847c5443a0>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:08:01.645710 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-9323a8de-ccfa-45fa-9751-bddfb4dbfdf1 tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] 10.222.0.58 "GET /compute/v2.1/images/0f967916-982b-4b7c-bb3c-1ec6b8c4dd57" status: 200 len: 1422 microversion: 2.1 time: 0.083832 Aug 10 23:08:01.646299 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1385/2718] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 10 23:08:01 2022] GET /compute/v2.1/images/0f967916-982b-4b7c-bb3c-1ec6b8c4dd57 => generated 1422 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:08:01.658769 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-275dd73c-62d1-4cbf-ab7e-25d66f6bcada tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:08:01.659439 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-275dd73c-62d1-4cbf-ab7e-25d66f6bcada tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] [instance: 8385348f-0651-486d-9b4a-2c884933edb1] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:08:01.669109 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-76370cb1-96c4-4f1f-b720-f121857c6451 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c6e1f505b8409ea38f8a07bad870a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6473e36eada44e6bca8dc568e5ee330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:08:01.675661 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-275dd73c-62d1-4cbf-ab7e-25d66f6bcada tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:01.676395 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-275dd73c-62d1-4cbf-ab7e-25d66f6bcada tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:01.677026 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-275dd73c-62d1-4cbf-ab7e-25d66f6bcada tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:01.679942 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-275dd73c-62d1-4cbf-ab7e-25d66f6bcada tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:01.680618 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-275dd73c-62d1-4cbf-ab7e-25d66f6bcada tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:01.681534 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-275dd73c-62d1-4cbf-ab7e-25d66f6bcada tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:01.686747 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-76370cb1-96c4-4f1f-b720-f121857c6451 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] 10.222.0.58 "GET /compute/v2.1/servers/6fe68649-0e9b-4059-afb6-cc44844ff476" status: 200 len: 1667 microversion: 2.1 time: 0.396383 Aug 10 23:08:01.687960 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1334/2719] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:08:01 2022] GET /compute/v2.1/servers/6fe68649-0e9b-4059-afb6-cc44844ff476 => generated 1667 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:08:01.827230 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.objects.instance [None req-275dd73c-62d1-4cbf-ab7e-25d66f6bcada tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Lazy-loading 'services' on Instance uuid 8385348f-0651-486d-9b4a-2c884933edb1 {{(pid=122633) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:08:01.890118 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:08:01.894717 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-275dd73c-62d1-4cbf-ab7e-25d66f6bcada tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/8385348f-0651-486d-9b4a-2c884933edb1" status: 200 len: 1931 microversion: 2.75 time: 0.237891 Aug 10 23:08:01.895730 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1386/2720] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:08:01 2022] GET /compute/v2.1/servers/8385348f-0651-486d-9b4a-2c884933edb1 => generated 1931 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:08:01.911308 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-0e3d5949-6e9e-42e8-a3a5-2d15a832ce1b tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:08:01.912024 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-0e3d5949-6e9e-42e8-a3a5-2d15a832ce1b tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] [instance: 6fe68649-0e9b-4059-afb6-cc44844ff476] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:08:01.929900 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0e3d5949-6e9e-42e8-a3a5-2d15a832ce1b tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:01.931835 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0e3d5949-6e9e-42e8-a3a5-2d15a832ce1b tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:01.932204 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0e3d5949-6e9e-42e8-a3a5-2d15a832ce1b tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:01.933389 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0e3d5949-6e9e-42e8-a3a5-2d15a832ce1b tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:01.935916 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0e3d5949-6e9e-42e8-a3a5-2d15a832ce1b tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:01.939787 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0e3d5949-6e9e-42e8-a3a5-2d15a832ce1b tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:02.045733 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-5cde8dfc-4b00-4c5d-b730-91ed6cbe5847 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-377622726", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:08:02.046104 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-0e3d5949-6e9e-42e8-a3a5-2d15a832ce1b tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] 10.222.0.58 "GET /compute/v2.1/servers/6fe68649-0e9b-4059-afb6-cc44844ff476/ips" status: 200 len: 178 microversion: 2.1 time: 0.147718 Aug 10 23:08:02.047387 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1387/2721] 10.222.0.58 () {58 vars in 1248 bytes} [Wed Aug 10 23:08:01 2022] GET /compute/v2.1/servers/6fe68649-0e9b-4059-afb6-cc44844ff476/ips => generated 178 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:08:02.061721 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-409c0292-d5fe-4e96-9c77-f0983bcb9b43 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:08:02.064039 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-409c0292-d5fe-4e96-9c77-f0983bcb9b43 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] [instance: eea0fab7-447d-4f5f-8577-6ef8df500499] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:08:02.080332 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-409c0292-d5fe-4e96-9c77-f0983bcb9b43 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:02.083458 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-409c0292-d5fe-4e96-9c77-f0983bcb9b43 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:02.083914 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-409c0292-d5fe-4e96-9c77-f0983bcb9b43 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:02.084647 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-409c0292-d5fe-4e96-9c77-f0983bcb9b43 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:02.085102 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-409c0292-d5fe-4e96-9c77-f0983bcb9b43 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:02.085522 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-409c0292-d5fe-4e96-9c77-f0983bcb9b43 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:02.161548 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.network.neutron [None req-5cde8dfc-4b00-4c5d-b730-91ed6cbe5847 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] validate_networks() for [('07bfb2f7-51b9-4172-a9a7-422d66f84c9d', None, None, None, None, None)] {{(pid=122632) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 23:08:02.393534 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-409c0292-d5fe-4e96-9c77-f0983bcb9b43 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bbb4f184e4409d9eed51e0b98dfb29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708f8d4c4ed6432d85e0bf6a9bac7677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:08:02.403383 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-409c0292-d5fe-4e96-9c77-f0983bcb9b43 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] 10.222.0.58 "GET /compute/v2.1/servers/eea0fab7-447d-4f5f-8577-6ef8df500499" status: 200 len: 1324 microversion: 2.1 time: 0.354181 Aug 10 23:08:02.404372 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1388/2722] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:08:02 2022] GET /compute/v2.1/servers/eea0fab7-447d-4f5f-8577-6ef8df500499 => generated 1324 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:08:02.410303 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-f61e888e-aaf7-4683-9af9-662d0d935dba tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:08:02.411084 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-f61e888e-aaf7-4683-9af9-662d0d935dba tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] [instance: 6fe68649-0e9b-4059-afb6-cc44844ff476] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:08:02.417988 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f61e888e-aaf7-4683-9af9-662d0d935dba tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:02.418756 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f61e888e-aaf7-4683-9af9-662d0d935dba tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:02.419877 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f61e888e-aaf7-4683-9af9-662d0d935dba tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:02.420763 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f61e888e-aaf7-4683-9af9-662d0d935dba tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:02.421510 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f61e888e-aaf7-4683-9af9-662d0d935dba tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:02.422106 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f61e888e-aaf7-4683-9af9-662d0d935dba tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:02.459391 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-f61e888e-aaf7-4683-9af9-662d0d935dba tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] [instance: 6fe68649-0e9b-4059-afb6-cc44844ff476] Going to try to terminate instance {{(pid=122633) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:08:02.629035 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-f61e888e-aaf7-4683-9af9-662d0d935dba tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] 10.222.0.58 "DELETE /compute/v2.1/servers/6fe68649-0e9b-4059-afb6-cc44844ff476" status: 204 len: 0 microversion: 2.1 time: 0.222341 Aug 10 23:08:02.632472 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1389/2723] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:08:02 2022] DELETE /compute/v2.1/servers/6fe68649-0e9b-4059-afb6-cc44844ff476 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:08:02.644631 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-5d9074c3-2e0d-4062-9610-b8268a161149 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:08:02.645362 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-5d9074c3-2e0d-4062-9610-b8268a161149 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] [instance: 3aa229ba-7292-41ee-922a-32c281be9f42] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:08:02.653394 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5d9074c3-2e0d-4062-9610-b8268a161149 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:02.655047 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5d9074c3-2e0d-4062-9610-b8268a161149 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:02.655607 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5d9074c3-2e0d-4062-9610-b8268a161149 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:02.656624 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5d9074c3-2e0d-4062-9610-b8268a161149 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:02.657703 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5d9074c3-2e0d-4062-9610-b8268a161149 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:02.658254 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5d9074c3-2e0d-4062-9610-b8268a161149 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:02.951821 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-5d9074c3-2e0d-4062-9610-b8268a161149 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8899e278c9453fba0ab05c69b0b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46ac8b84bd649fa88897068dbfa5ce6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:08:02.963902 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-5d9074c3-2e0d-4062-9610-b8268a161149 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] 10.222.0.58 "GET /compute/v2.1/servers/3aa229ba-7292-41ee-922a-32c281be9f42" status: 200 len: 1317 microversion: 2.1 time: 0.322939 Aug 10 23:08:02.965777 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1390/2724] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:08:02 2022] GET /compute/v2.1/servers/3aa229ba-7292-41ee-922a-32c281be9f42 => generated 1317 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:08:02.975660 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-10b2bd59-84da-42ff-b72b-f543ff3ed5cc tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:08:02.983732 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-10b2bd59-84da-42ff-b72b-f543ff3ed5cc tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] [instance: 6fe68649-0e9b-4059-afb6-cc44844ff476] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:08:03.001242 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-10b2bd59-84da-42ff-b72b-f543ff3ed5cc tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:03.001752 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-10b2bd59-84da-42ff-b72b-f543ff3ed5cc tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:03.002202 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-10b2bd59-84da-42ff-b72b-f543ff3ed5cc tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:03.002963 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-10b2bd59-84da-42ff-b72b-f543ff3ed5cc tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:03.003735 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-10b2bd59-84da-42ff-b72b-f543ff3ed5cc tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:03.004865 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-10b2bd59-84da-42ff-b72b-f543ff3ed5cc tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:03.318024 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-10b2bd59-84da-42ff-b72b-f543ff3ed5cc tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c6e1f505b8409ea38f8a07bad870a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6473e36eada44e6bca8dc568e5ee330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:08:03.332281 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-10b2bd59-84da-42ff-b72b-f543ff3ed5cc tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] 10.222.0.58 "GET /compute/v2.1/servers/6fe68649-0e9b-4059-afb6-cc44844ff476" status: 200 len: 1673 microversion: 2.1 time: 0.364492 Aug 10 23:08:03.333343 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1391/2725] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:08:02 2022] GET /compute/v2.1/servers/6fe68649-0e9b-4059-afb6-cc44844ff476 => generated 1673 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:08:03.345092 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-501daf5d-0e65-49dd-bece-00b75634b9f7 tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Calling method '.version_select at 0x7f847c5b4310>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:08:03.455079 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-501daf5d-0e65-49dd-bece-00b75634b9f7 tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] 10.222.0.58 "GET /compute/v2.1/images/0f967916-982b-4b7c-bb3c-1ec6b8c4dd57" status: 200 len: 1422 microversion: 2.1 time: 0.111437 Aug 10 23:08:03.479172 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1392/2726] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 10 23:08:03 2022] GET /compute/v2.1/images/0f967916-982b-4b7c-bb3c-1ec6b8c4dd57 => generated 1422 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:08:03.486725 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-9559d992-8005-4c78-bb26-eaaee7e70ea8 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:08:03.488802 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-9559d992-8005-4c78-bb26-eaaee7e70ea8 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] [instance: 8385348f-0651-486d-9b4a-2c884933edb1] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:08:03.502762 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9559d992-8005-4c78-bb26-eaaee7e70ea8 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:03.503557 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9559d992-8005-4c78-bb26-eaaee7e70ea8 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:03.504340 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9559d992-8005-4c78-bb26-eaaee7e70ea8 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:03.506334 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9559d992-8005-4c78-bb26-eaaee7e70ea8 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:03.507319 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9559d992-8005-4c78-bb26-eaaee7e70ea8 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:03.508083 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9559d992-8005-4c78-bb26-eaaee7e70ea8 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:03.568686 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-5cde8dfc-4b00-4c5d-b730-91ed6cbe5847 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Flavor limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:08:03.569830 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-5cde8dfc-4b00-4c5d-b730-91ed6cbe5847 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Image limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:08:03.572150 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-5cde8dfc-4b00-4c5d-b730-91ed6cbe5847 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Flavor pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:08:03.573654 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-5cde8dfc-4b00-4c5d-b730-91ed6cbe5847 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Image pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:08:03.575713 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-5cde8dfc-4b00-4c5d-b730-91ed6cbe5847 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:08:03.621459 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5cde8dfc-4b00-4c5d-b730-91ed6cbe5847 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:03.622068 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5cde8dfc-4b00-4c5d-b730-91ed6cbe5847 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:03.623903 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5cde8dfc-4b00-4c5d-b730-91ed6cbe5847 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:03.625449 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5cde8dfc-4b00-4c5d-b730-91ed6cbe5847 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:03.625449 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5cde8dfc-4b00-4c5d-b730-91ed6cbe5847 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:03.625703 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5cde8dfc-4b00-4c5d-b730-91ed6cbe5847 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:03.680055 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-5cde8dfc-4b00-4c5d-b730-91ed6cbe5847 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Getting quotas for project 01ab3ad5c0ef448aaa1282112bf20d83. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:08:03.695903 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-5cde8dfc-4b00-4c5d-b730-91ed6cbe5847 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Getting quotas for user c84e70c3ea5347e79ba5aee661b15ce4 and project 01ab3ad5c0ef448aaa1282112bf20d83. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:08:03.715661 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.objects.instance [None req-9559d992-8005-4c78-bb26-eaaee7e70ea8 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Lazy-loading 'services' on Instance uuid 8385348f-0651-486d-9b4a-2c884933edb1 {{(pid=122633) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:08:03.728690 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-5cde8dfc-4b00-4c5d-b730-91ed6cbe5847 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Going to run 1 instances... {{(pid=122632) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 23:08:03.739557 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-5cde8dfc-4b00-4c5d-b730-91ed6cbe5847 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] [instance: 325d9b10-716d-4961-91d1-70962403fef4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78ad8905-f66f-4733-8be9-2b260f1fabed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122632) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 23:08:03.750330 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-9559d992-8005-4c78-bb26-eaaee7e70ea8 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/8385348f-0651-486d-9b4a-2c884933edb1" status: 200 len: 1937 microversion: 2.75 time: 0.269212 Aug 10 23:08:03.771264 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1393/2727] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:08:03 2022] GET /compute/v2.1/servers/8385348f-0651-486d-9b4a-2c884933edb1 => generated 1937 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:08:03.784177 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:08:03.791244 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-17daec29-fde3-406f-bc12-24109996675b req-0aef4e0c-70b3-469c-846d-eb82690581c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3aa229ba-7292-41ee-922a-32c281be9f42", "name": "network-vif-plugged", "status": "completed", "tag": "34dd8ab6-09ba-4c97-9c08-880d9b727e0e"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:08:03.805757 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-17daec29-fde3-406f-bc12-24109996675b req-0aef4e0c-70b3-469c-846d-eb82690581c0 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:03.807393 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-17daec29-fde3-406f-bc12-24109996675b req-0aef4e0c-70b3-469c-846d-eb82690581c0 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:03.808070 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-17daec29-fde3-406f-bc12-24109996675b req-0aef4e0c-70b3-469c-846d-eb82690581c0 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:03.823646 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-17daec29-fde3-406f-bc12-24109996675b req-0aef4e0c-70b3-469c-846d-eb82690581c0 service nova] Creating event network-vif-plugged:34dd8ab6-09ba-4c97-9c08-880d9b727e0e for instance 3aa229ba-7292-41ee-922a-32c281be9f42 on n-h2-850468-14 Aug 10 23:08:03.826908 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-5cde8dfc-4b00-4c5d-b730-91ed6cbe5847 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.134007 Aug 10 23:08:03.827573 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1335/2728] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 23:08:01 2022] POST /compute/v2.1/servers => generated 383 bytes in 2136 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 23:08:03.839373 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-1a57aee2-8dc6-4aa5-9487-30b7fc9e60f8 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:08:03.839996 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-1a57aee2-8dc6-4aa5-9487-30b7fc9e60f8 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] [instance: eea0fab7-447d-4f5f-8577-6ef8df500499] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:08:03.845615 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-17daec29-fde3-406f-bc12-24109996675b req-0aef4e0c-70b3-469c-846d-eb82690581c0 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070909 Aug 10 23:08:03.846655 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1394/2729] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:08:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:08:03.853666 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-2a032b72-a730-463c-b67c-32619fb5f9c4 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:08:03.854851 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-2a032b72-a730-463c-b67c-32619fb5f9c4 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] [instance: 325d9b10-716d-4961-91d1-70962403fef4] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:08:03.910418 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1a57aee2-8dc6-4aa5-9487-30b7fc9e60f8 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:03.911327 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1a57aee2-8dc6-4aa5-9487-30b7fc9e60f8 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:03.912033 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1a57aee2-8dc6-4aa5-9487-30b7fc9e60f8 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:03.912994 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1a57aee2-8dc6-4aa5-9487-30b7fc9e60f8 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:03.916173 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1a57aee2-8dc6-4aa5-9487-30b7fc9e60f8 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:03.920161 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1a57aee2-8dc6-4aa5-9487-30b7fc9e60f8 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:04.057771 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-2a032b72-a730-463c-b67c-32619fb5f9c4 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84e70c3ea5347e79ba5aee661b15ce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ab3ad5c0ef448aaa1282112bf20d83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:08:04.076532 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-2a032b72-a730-463c-b67c-32619fb5f9c4 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] 10.222.0.58 "GET /compute/v2.1/servers/325d9b10-716d-4961-91d1-70962403fef4" status: 200 len: 1222 microversion: 2.1 time: 0.228446 Aug 10 23:08:04.077511 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1395/2730] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:08:03 2022] GET /compute/v2.1/servers/325d9b10-716d-4961-91d1-70962403fef4 => generated 1222 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:08:04.083884 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-4671f7c3-78be-470e-ad4b-01c5ac161135 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:08:04.084502 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-4671f7c3-78be-470e-ad4b-01c5ac161135 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] [instance: 3aa229ba-7292-41ee-922a-32c281be9f42] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:08:04.107676 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4671f7c3-78be-470e-ad4b-01c5ac161135 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:04.108186 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4671f7c3-78be-470e-ad4b-01c5ac161135 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:04.108628 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4671f7c3-78be-470e-ad4b-01c5ac161135 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:04.109390 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4671f7c3-78be-470e-ad4b-01c5ac161135 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:04.109849 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4671f7c3-78be-470e-ad4b-01c5ac161135 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:04.110278 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4671f7c3-78be-470e-ad4b-01c5ac161135 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:04.322681 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-1a57aee2-8dc6-4aa5-9487-30b7fc9e60f8 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bbb4f184e4409d9eed51e0b98dfb29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708f8d4c4ed6432d85e0bf6a9bac7677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:08:04.337960 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-1a57aee2-8dc6-4aa5-9487-30b7fc9e60f8 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] 10.222.0.58 "GET /compute/v2.1/servers/eea0fab7-447d-4f5f-8577-6ef8df500499" status: 200 len: 1324 microversion: 2.1 time: 0.505949 Aug 10 23:08:04.339731 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1336/2731] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:08:03 2022] GET /compute/v2.1/servers/eea0fab7-447d-4f5f-8577-6ef8df500499 => generated 1324 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:08:04.359248 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-f408a648-17c8-4d42-a97c-448193861b6c tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:08:04.360133 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-f408a648-17c8-4d42-a97c-448193861b6c tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] [instance: 6fe68649-0e9b-4059-afb6-cc44844ff476] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:08:04.380223 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f408a648-17c8-4d42-a97c-448193861b6c tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:04.381643 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f408a648-17c8-4d42-a97c-448193861b6c tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:04.383311 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f408a648-17c8-4d42-a97c-448193861b6c tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:04.384663 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f408a648-17c8-4d42-a97c-448193861b6c tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:04.386521 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f408a648-17c8-4d42-a97c-448193861b6c tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:04.387782 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f408a648-17c8-4d42-a97c-448193861b6c tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:04.455061 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-4671f7c3-78be-470e-ad4b-01c5ac161135 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8899e278c9453fba0ab05c69b0b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46ac8b84bd649fa88897068dbfa5ce6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:08:04.465504 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-4671f7c3-78be-470e-ad4b-01c5ac161135 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] 10.222.0.58 "GET /compute/v2.1/servers/3aa229ba-7292-41ee-922a-32c281be9f42" status: 200 len: 1317 microversion: 2.1 time: 0.386847 Aug 10 23:08:04.466240 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1396/2732] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:08:04 2022] GET /compute/v2.1/servers/3aa229ba-7292-41ee-922a-32c281be9f42 => generated 1317 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:08:04.479148 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-08fb7aaa-de8b-4632-8591-5fc30a3e0bdf tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Calling method '.version_select at 0x7f847c559700>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:08:04.542546 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-08fb7aaa-de8b-4632-8591-5fc30a3e0bdf tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] 10.222.0.58 "GET /compute/v2.1/images/0f967916-982b-4b7c-bb3c-1ec6b8c4dd57" status: 200 len: 1431 microversion: 2.1 time: 0.074739 Aug 10 23:08:04.543756 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1397/2733] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 10 23:08:04 2022] GET /compute/v2.1/images/0f967916-982b-4b7c-bb3c-1ec6b8c4dd57 => generated 1431 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:08:04.560659 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-726eb6ba-7038-4f01-b030-b77574354e0a tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Calling method '.version_select at 0x7f847c514c10>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:08:04.636728 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-f408a648-17c8-4d42-a97c-448193861b6c tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c6e1f505b8409ea38f8a07bad870a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6473e36eada44e6bca8dc568e5ee330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:08:04.642057 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-726eb6ba-7038-4f01-b030-b77574354e0a tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] 10.222.0.58 "GET /compute/v2.1/images/0f967916-982b-4b7c-bb3c-1ec6b8c4dd57" status: 200 len: 1431 microversion: 2.1 time: 0.089120 Aug 10 23:08:04.654504 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1398/2734] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 10 23:08:04 2022] GET /compute/v2.1/images/0f967916-982b-4b7c-bb3c-1ec6b8c4dd57 => generated 1431 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:08:04.655465 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-f408a648-17c8-4d42-a97c-448193861b6c tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] 10.222.0.58 "GET /compute/v2.1/servers/6fe68649-0e9b-4059-afb6-cc44844ff476" status: 200 len: 1673 microversion: 2.1 time: 0.301969 Aug 10 23:08:04.656429 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1337/2735] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:08:04 2022] GET /compute/v2.1/servers/6fe68649-0e9b-4059-afb6-cc44844ff476 => generated 1673 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:08:04.662506 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c303e45f-924a-4db9-8187-9cec073ef022 tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:08:04.668520 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-c303e45f-924a-4db9-8187-9cec073ef022 tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] [instance: a632bb08-327b-4870-9f4e-90f8d0d863d0] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:08:04.683539 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c303e45f-924a-4db9-8187-9cec073ef022 tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:04.686662 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c303e45f-924a-4db9-8187-9cec073ef022 tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:04.687158 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c303e45f-924a-4db9-8187-9cec073ef022 tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:04.687889 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c303e45f-924a-4db9-8187-9cec073ef022 tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:04.688354 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c303e45f-924a-4db9-8187-9cec073ef022 tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:04.689010 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c303e45f-924a-4db9-8187-9cec073ef022 tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:04.790665 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-ef4b8669-49f5-481f-aa0a-824461fc3540 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:08:04.791538 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-ef4b8669-49f5-481f-aa0a-824461fc3540 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] [instance: 8385348f-0651-486d-9b4a-2c884933edb1] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:08:04.816177 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ef4b8669-49f5-481f-aa0a-824461fc3540 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:04.817851 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ef4b8669-49f5-481f-aa0a-824461fc3540 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:04.819091 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ef4b8669-49f5-481f-aa0a-824461fc3540 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:04.820747 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ef4b8669-49f5-481f-aa0a-824461fc3540 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:04.821223 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ef4b8669-49f5-481f-aa0a-824461fc3540 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:04.821733 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ef4b8669-49f5-481f-aa0a-824461fc3540 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:04.929290 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.objects.instance [None req-ef4b8669-49f5-481f-aa0a-824461fc3540 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Lazy-loading 'services' on Instance uuid 8385348f-0651-486d-9b4a-2c884933edb1 {{(pid=122632) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:08:04.956726 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-ef4b8669-49f5-481f-aa0a-824461fc3540 tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/8385348f-0651-486d-9b4a-2c884933edb1" status: 200 len: 1937 microversion: 2.75 time: 0.171709 Aug 10 23:08:04.971359 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1338/2736] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:08:04 2022] GET /compute/v2.1/servers/8385348f-0651-486d-9b4a-2c884933edb1 => generated 1937 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 23:08:05.100429 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-ec9af33b-cbb7-496e-941d-6ecce9cdfe86 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:08:05.101175 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-ec9af33b-cbb7-496e-941d-6ecce9cdfe86 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] [instance: 325d9b10-716d-4961-91d1-70962403fef4] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:08:05.114360 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-c303e45f-924a-4db9-8187-9cec073ef022 tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d235607afb4ba59ed6ac2908c6dc33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5881784cbc4d669ad7fa40880ed9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:08:05.117302 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ec9af33b-cbb7-496e-941d-6ecce9cdfe86 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:05.118079 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ec9af33b-cbb7-496e-941d-6ecce9cdfe86 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:05.121946 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ec9af33b-cbb7-496e-941d-6ecce9cdfe86 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:05.123615 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ec9af33b-cbb7-496e-941d-6ecce9cdfe86 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:05.126130 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-c303e45f-924a-4db9-8187-9cec073ef022 tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] 10.222.0.58 "GET /compute/v2.1/servers/a632bb08-327b-4870-9f4e-90f8d0d863d0" status: 200 len: 1479 microversion: 2.1 time: 0.465490 Aug 10 23:08:05.127059 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1399/2737] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:08:04 2022] GET /compute/v2.1/servers/a632bb08-327b-4870-9f4e-90f8d0d863d0 => generated 1479 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:08:05.139647 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ec9af33b-cbb7-496e-941d-6ecce9cdfe86 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:05.140303 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ec9af33b-cbb7-496e-941d-6ecce9cdfe86 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:05.272396 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-ec9af33b-cbb7-496e-941d-6ecce9cdfe86 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84e70c3ea5347e79ba5aee661b15ce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ab3ad5c0ef448aaa1282112bf20d83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:08:05.286851 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-ec9af33b-cbb7-496e-941d-6ecce9cdfe86 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] 10.222.0.58 "GET /compute/v2.1/servers/325d9b10-716d-4961-91d1-70962403fef4" status: 200 len: 1226 microversion: 2.1 time: 0.190588 Aug 10 23:08:05.287457 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1339/2738] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:08:05 2022] GET /compute/v2.1/servers/325d9b10-716d-4961-91d1-70962403fef4 => generated 1226 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:08:05.362476 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-0f3a1ffd-e0a9-44f5-a08f-2c293ac57742 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:08:05.363128 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-0f3a1ffd-e0a9-44f5-a08f-2c293ac57742 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] [instance: eea0fab7-447d-4f5f-8577-6ef8df500499] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:08:05.384233 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0f3a1ffd-e0a9-44f5-a08f-2c293ac57742 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:05.388554 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0f3a1ffd-e0a9-44f5-a08f-2c293ac57742 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:05.389164 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0f3a1ffd-e0a9-44f5-a08f-2c293ac57742 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:05.389937 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0f3a1ffd-e0a9-44f5-a08f-2c293ac57742 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:05.395463 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0f3a1ffd-e0a9-44f5-a08f-2c293ac57742 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:05.396102 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0f3a1ffd-e0a9-44f5-a08f-2c293ac57742 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:05.490059 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-261b2a3c-daff-4005-82ed-3b094a0d0d22 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:08:05.490695 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-261b2a3c-daff-4005-82ed-3b094a0d0d22 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] [instance: 3aa229ba-7292-41ee-922a-32c281be9f42] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:08:05.507411 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-261b2a3c-daff-4005-82ed-3b094a0d0d22 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:05.508009 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-261b2a3c-daff-4005-82ed-3b094a0d0d22 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:05.508637 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-261b2a3c-daff-4005-82ed-3b094a0d0d22 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:05.509388 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-261b2a3c-daff-4005-82ed-3b094a0d0d22 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:05.509916 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-261b2a3c-daff-4005-82ed-3b094a0d0d22 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:05.510405 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-261b2a3c-daff-4005-82ed-3b094a0d0d22 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:05.882955 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-261b2a3c-daff-4005-82ed-3b094a0d0d22 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8899e278c9453fba0ab05c69b0b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46ac8b84bd649fa88897068dbfa5ce6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:08:05.891538 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-261b2a3c-daff-4005-82ed-3b094a0d0d22 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] 10.222.0.58 "GET /compute/v2.1/servers/3aa229ba-7292-41ee-922a-32c281be9f42" status: 200 len: 1317 microversion: 2.1 time: 0.409507 Aug 10 23:08:05.891799 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1340/2739] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:08:05 2022] GET /compute/v2.1/servers/3aa229ba-7292-41ee-922a-32c281be9f42 => generated 1317 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:08:05.907676 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-79ac74eb-8302-4c59-ad91-2a7eac76fae4 req-1187c1c3-051a-4810-b1db-28aee72b8838 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6fe68649-0e9b-4059-afb6-cc44844ff476", "name": "network-vif-deleted", "tag": "8df81506-7d26-470f-b8be-99340c977e96"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:08:05.921651 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-79ac74eb-8302-4c59-ad91-2a7eac76fae4 req-1187c1c3-051a-4810-b1db-28aee72b8838 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:05.922719 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-79ac74eb-8302-4c59-ad91-2a7eac76fae4 req-1187c1c3-051a-4810-b1db-28aee72b8838 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:05.923842 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-79ac74eb-8302-4c59-ad91-2a7eac76fae4 req-1187c1c3-051a-4810-b1db-28aee72b8838 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:05.970435 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-79ac74eb-8302-4c59-ad91-2a7eac76fae4 req-1187c1c3-051a-4810-b1db-28aee72b8838 service nova] Creating event network-vif-deleted:8df81506-7d26-470f-b8be-99340c977e96 for instance 6fe68649-0e9b-4059-afb6-cc44844ff476 on n-h2-850468-14 Aug 10 23:08:05.978860 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-0f3a1ffd-e0a9-44f5-a08f-2c293ac57742 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bbb4f184e4409d9eed51e0b98dfb29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708f8d4c4ed6432d85e0bf6a9bac7677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:08:05.989296 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-0f3a1ffd-e0a9-44f5-a08f-2c293ac57742 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] 10.222.0.58 "GET /compute/v2.1/servers/eea0fab7-447d-4f5f-8577-6ef8df500499" status: 200 len: 1521 microversion: 2.1 time: 0.631554 Aug 10 23:08:05.989911 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1400/2740] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:08:05 2022] GET /compute/v2.1/servers/eea0fab7-447d-4f5f-8577-6ef8df500499 => generated 1521 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:08:05.997809 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-85b89ae0-f67d-4921-aefb-e921df5a3f64 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:08:05.998497 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-85b89ae0-f67d-4921-aefb-e921df5a3f64 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] [instance: 6fe68649-0e9b-4059-afb6-cc44844ff476] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:08:06.015536 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-79ac74eb-8302-4c59-ad91-2a7eac76fae4 req-1187c1c3-051a-4810-b1db-28aee72b8838 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111415 Aug 10 23:08:06.016236 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1341/2741] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:08:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:08:06.019695 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-85b89ae0-f67d-4921-aefb-e921df5a3f64 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:06.025517 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-85b89ae0-f67d-4921-aefb-e921df5a3f64 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:06.026312 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-85b89ae0-f67d-4921-aefb-e921df5a3f64 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:06.027521 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-85b89ae0-f67d-4921-aefb-e921df5a3f64 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:06.030033 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-ea676e69-803f-4768-a2d8-4a8edccbe907 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:08:06.030775 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-85b89ae0-f67d-4921-aefb-e921df5a3f64 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:06.031242 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-85b89ae0-f67d-4921-aefb-e921df5a3f64 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:06.036430 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-ea676e69-803f-4768-a2d8-4a8edccbe907 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] [instance: 45beadf1-a6da-49ab-9098-6b681b5184c9] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:08:06.053363 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ea676e69-803f-4768-a2d8-4a8edccbe907 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:06.053996 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ea676e69-803f-4768-a2d8-4a8edccbe907 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:06.055675 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ea676e69-803f-4768-a2d8-4a8edccbe907 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:06.056614 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ea676e69-803f-4768-a2d8-4a8edccbe907 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:06.060541 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ea676e69-803f-4768-a2d8-4a8edccbe907 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:06.061152 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ea676e69-803f-4768-a2d8-4a8edccbe907 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:06.121554 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-ea676e69-803f-4768-a2d8-4a8edccbe907 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] 10.222.0.58 "GET /compute/v2.1/servers/45beadf1-a6da-49ab-9098-6b681b5184c9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.099910 Aug 10 23:08:06.122098 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1342/2742] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 10 23:08:06 2022] GET /compute/v2.1/servers/45beadf1-a6da-49ab-9098-6b681b5184c9/os-volume_attachments => generated 25 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 23:08:06.136345 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-aefeb281-7ef6-4264-916f-d3bb0fde772a tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:08:06.136959 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-aefeb281-7ef6-4264-916f-d3bb0fde772a tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] [instance: 8385348f-0651-486d-9b4a-2c884933edb1] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:08:06.153459 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-aefeb281-7ef6-4264-916f-d3bb0fde772a tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:06.153961 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-aefeb281-7ef6-4264-916f-d3bb0fde772a tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:06.154406 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-aefeb281-7ef6-4264-916f-d3bb0fde772a tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:06.155817 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-aefeb281-7ef6-4264-916f-d3bb0fde772a tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:06.156282 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-aefeb281-7ef6-4264-916f-d3bb0fde772a tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:06.156761 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-aefeb281-7ef6-4264-916f-d3bb0fde772a tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:06.338434 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.objects.instance [None req-aefeb281-7ef6-4264-916f-d3bb0fde772a tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] Lazy-loading 'services' on Instance uuid 8385348f-0651-486d-9b4a-2c884933edb1 {{(pid=122632) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:08:06.396012 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-85b89ae0-f67d-4921-aefb-e921df5a3f64 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c6e1f505b8409ea38f8a07bad870a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6473e36eada44e6bca8dc568e5ee330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:08:06.403908 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-aefeb281-7ef6-4264-916f-d3bb0fde772a tempest-ServersAdmin275Test-385244931 tempest-ServersAdmin275Test-385244931-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/8385348f-0651-486d-9b4a-2c884933edb1" status: 200 len: 1922 microversion: 2.75 time: 0.274168 Aug 10 23:08:06.407027 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1343/2743] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:08:06 2022] GET /compute/v2.1/servers/8385348f-0651-486d-9b4a-2c884933edb1 => generated 1922 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:08:06.415693 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-85b89ae0-f67d-4921-aefb-e921df5a3f64 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] 10.222.0.58 "GET /compute/v2.1/servers/6fe68649-0e9b-4059-afb6-cc44844ff476" status: 200 len: 1495 microversion: 2.1 time: 0.424639 Aug 10 23:08:06.416950 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1401/2744] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:08:05 2022] GET /compute/v2.1/servers/6fe68649-0e9b-4059-afb6-cc44844ff476 => generated 1495 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:08:06.420063 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-e7130f96-fe5c-4be3-bc80-b0f5e42d63a5 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:08:06.422019 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-e7130f96-fe5c-4be3-bc80-b0f5e42d63a5 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] [instance: eea0fab7-447d-4f5f-8577-6ef8df500499] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:08:06.436504 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e7130f96-fe5c-4be3-bc80-b0f5e42d63a5 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:06.437339 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e7130f96-fe5c-4be3-bc80-b0f5e42d63a5 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:06.438032 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e7130f96-fe5c-4be3-bc80-b0f5e42d63a5 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:06.444033 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e7130f96-fe5c-4be3-bc80-b0f5e42d63a5 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:06.444716 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e7130f96-fe5c-4be3-bc80-b0f5e42d63a5 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:06.446943 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e7130f96-fe5c-4be3-bc80-b0f5e42d63a5 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:06.447586 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-40a9dbd3-935c-4368-9ade-0feb7d30b0c6 tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:08:06.450073 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-40a9dbd3-935c-4368-9ade-0feb7d30b0c6 tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] [instance: a632bb08-327b-4870-9f4e-90f8d0d863d0] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:08:06.467531 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-40a9dbd3-935c-4368-9ade-0feb7d30b0c6 tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:06.469489 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-40a9dbd3-935c-4368-9ade-0feb7d30b0c6 tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:06.473394 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-40a9dbd3-935c-4368-9ade-0feb7d30b0c6 tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:06.477625 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-40a9dbd3-935c-4368-9ade-0feb7d30b0c6 tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:06.478247 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-40a9dbd3-935c-4368-9ade-0feb7d30b0c6 tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:06.478906 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-40a9dbd3-935c-4368-9ade-0feb7d30b0c6 tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:06.521232 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:08:06.795773 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-40a9dbd3-935c-4368-9ade-0feb7d30b0c6 tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d235607afb4ba59ed6ac2908c6dc33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5881784cbc4d669ad7fa40880ed9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:08:06.830602 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-e7130f96-fe5c-4be3-bc80-b0f5e42d63a5 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bbb4f184e4409d9eed51e0b98dfb29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708f8d4c4ed6432d85e0bf6a9bac7677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:08:06.840917 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-e7130f96-fe5c-4be3-bc80-b0f5e42d63a5 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] 10.222.0.58 "GET /compute/v2.1/servers/eea0fab7-447d-4f5f-8577-6ef8df500499" status: 200 len: 1521 microversion: 2.1 time: 0.430073 Aug 10 23:08:06.841836 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1344/2745] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:08:06 2022] GET /compute/v2.1/servers/eea0fab7-447d-4f5f-8577-6ef8df500499 => generated 1521 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:08:06.855028 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-40a9dbd3-935c-4368-9ade-0feb7d30b0c6 tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] 10.222.0.58 "GET /compute/v2.1/servers/a632bb08-327b-4870-9f4e-90f8d0d863d0" status: 200 len: 1466 microversion: 2.1 time: 0.424582 Aug 10 23:08:06.855028 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1402/2746] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:08:06 2022] GET /compute/v2.1/servers/a632bb08-327b-4870-9f4e-90f8d0d863d0 => generated 1466 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:08:06.855028 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-85324501-50ca-4daa-b54d-0c4b5cba9533 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:08:06.855028 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-85324501-50ca-4daa-b54d-0c4b5cba9533 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] [instance: 45beadf1-a6da-49ab-9098-6b681b5184c9] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:08:06.865268 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-85324501-50ca-4daa-b54d-0c4b5cba9533 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:06.868835 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-85324501-50ca-4daa-b54d-0c4b5cba9533 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:06.871067 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-85324501-50ca-4daa-b54d-0c4b5cba9533 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:06.873700 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-85324501-50ca-4daa-b54d-0c4b5cba9533 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:06.880114 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-b7d6eb74-5bad-4877-8161-ceb11de859af tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:08:06.881019 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-b7d6eb74-5bad-4877-8161-ceb11de859af tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] [instance: 325d9b10-716d-4961-91d1-70962403fef4] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:08:06.882396 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-85324501-50ca-4daa-b54d-0c4b5cba9533 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:06.883579 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-85324501-50ca-4daa-b54d-0c4b5cba9533 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:06.894223 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b7d6eb74-5bad-4877-8161-ceb11de859af tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:06.897408 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b7d6eb74-5bad-4877-8161-ceb11de859af tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:06.897737 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b7d6eb74-5bad-4877-8161-ceb11de859af tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:06.898592 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b7d6eb74-5bad-4877-8161-ceb11de859af tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:06.903010 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b7d6eb74-5bad-4877-8161-ceb11de859af tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:06.903496 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b7d6eb74-5bad-4877-8161-ceb11de859af tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:06.948450 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-85324501-50ca-4daa-b54d-0c4b5cba9533 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] [instance: 45beadf1-a6da-49ab-9098-6b681b5184c9] Going to try to terminate instance {{(pid=122633) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:08:07.127086 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-85324501-50ca-4daa-b54d-0c4b5cba9533 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] 10.222.0.58 "DELETE /compute/v2.1/servers/45beadf1-a6da-49ab-9098-6b681b5184c9" status: 204 len: 0 microversion: 2.1 time: 0.282149 Aug 10 23:08:07.128902 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1403/2747] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:08:06 2022] DELETE /compute/v2.1/servers/45beadf1-a6da-49ab-9098-6b681b5184c9 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:08:07.142564 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-af848a71-ad0c-4ac4-b1b6-9ba47fc29a22 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:08:07.143384 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-af848a71-ad0c-4ac4-b1b6-9ba47fc29a22 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] [instance: 8385348f-0651-486d-9b4a-2c884933edb1] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:08:07.149417 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-b7d6eb74-5bad-4877-8161-ceb11de859af tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84e70c3ea5347e79ba5aee661b15ce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ab3ad5c0ef448aaa1282112bf20d83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:08:07.154223 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-af848a71-ad0c-4ac4-b1b6-9ba47fc29a22 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:07.154941 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-af848a71-ad0c-4ac4-b1b6-9ba47fc29a22 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:07.155870 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-af848a71-ad0c-4ac4-b1b6-9ba47fc29a22 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:07.156902 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-af848a71-ad0c-4ac4-b1b6-9ba47fc29a22 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:07.157757 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-af848a71-ad0c-4ac4-b1b6-9ba47fc29a22 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:07.160239 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-b7d6eb74-5bad-4877-8161-ceb11de859af tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] 10.222.0.58 "GET /compute/v2.1/servers/325d9b10-716d-4961-91d1-70962403fef4" status: 200 len: 1280 microversion: 2.1 time: 0.298167 Aug 10 23:08:07.161291 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1345/2748] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:08:06 2022] GET /compute/v2.1/servers/325d9b10-716d-4961-91d1-70962403fef4 => generated 1280 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:08:07.168045 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-02d32eb9-bb07-4aad-95d5-24fe1365127e tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1343298178", "metadata": {"": ""}}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:08:07.172488 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-02d32eb9-bb07-4aad-95d5-24fe1365127e tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Request method failure captured: Aug 10 23:08:07.172488 n-d-850468-14 devstack@n-api.service[122632]: request: POST /compute/v2.1/servers/eea0fab7-447d-4f5f-8577-6ef8df500499/action HTTP/1.1 Aug 10 23:08:07.172488 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:08:07.172488 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:08:07.172488 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:08:07.172488 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 107 Aug 10 23:08:07.172488 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:08:07.172488 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:08:07.172488 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:08:07.172488 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:08:07.172488 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9Do81XwGOyJYZzjDqBUm67v_Q0362_4xQUvU3HvIWmFkKXGTToH86-ip4fxXuu0oxmkucX-Et277q0Z5R4ChTe5MWC8zJ89hWAklZmH6m-N_CAseQK0eUiUfLbiJpjdB2S78hj0EntCCqH4mBVhce2-q9auCyId7qlhsdrU7MIxxCSQ Aug 10 23:08:07.172488 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:08:07.172488 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:08:07.172488 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:08:07.172488 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:08:07.172488 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:08:07.172488 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:08:07.172488 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 708f8d4c4ed6432d85e0bf6a9bac7677 Aug 10 23:08:07.172488 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2080454436 Aug 10 23:08:07.172488 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:08:07.172488 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:08:07.173902 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/708f8d4c4ed6432d85e0bf6a9bac7677"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/708f8d4c4ed6432d85e0bf6a9bac7677"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/708f8d4c4ed6432d85e0bf6a9bac7677"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_708f8d4c4ed6432d85e0bf6a9bac7677", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:08:07.173902 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2080454436 Aug 10 23:08:07.173902 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 708f8d4c4ed6432d85e0bf6a9bac7677 Aug 10 23:08:07.173902 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2080454436 Aug 10 23:08:07.173902 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-ImagesOneServerNegativeTestJSON-2080454436-project Aug 10 23:08:07.173902 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:08:07.173902 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:08:07.173902 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: 55bbb4f184e4409d9eed51e0b98dfb29 Aug 10 23:08:07.173902 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2080454436-project Aug 10 23:08:07.173902 n-d-850468-14 devstack@n-api.service[122632]: Aug 10 23:08:07.173902 n-d-850468-14 devstack@n-api.service[122632]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1343298178", "metadata": {"": ""}}} Aug 10 23:08:07.173902 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:08:07.174664 n-d-850468-14 devstack@n-api.service[122632]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 10 23:08:07.174664 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': 'eea0fab7-447d-4f5f-8577-6ef8df500499', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1343298178', 'metadata': {'': ''}}}} Aug 10 23:08:07.174664 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:08:07.174664 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:08:07.174664 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 10 23:08:07.174664 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 10 23:08:07.174664 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 10 23:08:07.174664 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise error Aug 10 23:08:07.174664 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 10 23:08:07.174664 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:08:07.174664 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Aug 10 23:08:07.174664 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 10 23:08:07.174664 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 10 23:08:07.174664 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 10 23:08:07.174664 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 10 23:08:07.174664 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:08:07.174664 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi On instance['createImage']: Aug 10 23:08:07.174664 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi {'': ''} Aug 10 23:08:07.174664 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:08:07.174664 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:08:07.174664 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:08:07.175981 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:08:07.175981 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:08:07.175981 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:08:07.175981 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:08:07.175981 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:08:07.175981 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:08:07.175981 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:08:07.175981 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 23:08:07.175981 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 23:08:07.175981 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 10 23:08:07.175981 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 10 23:08:07.175981 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 10 23:08:07.175981 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 10 23:08:07.175981 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 10 23:08:07.175981 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 10 23:08:07.175981 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 10 23:08:07.175981 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:08:07.175981 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:08:07.175981 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:08:07.175981 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:08:07.177300 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:08:07.177300 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:08:07.177300 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 10 23:08:07.177300 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 10 23:08:07.177300 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 10 23:08:07.177300 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:08:07.177709 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-af848a71-ad0c-4ac4-b1b6-9ba47fc29a22 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:07.189786 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-02d32eb9-bb07-4aad-95d5-24fe1365127e tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:08:07.196643 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-02d32eb9-bb07-4aad-95d5-24fe1365127e tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] 10.222.0.58 "POST /compute/v2.1/servers/eea0fab7-447d-4f5f-8577-6ef8df500499/action" status: 400 len: 170 microversion: 2.1 time: 0.033764 Aug 10 23:08:07.197636 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1346/2749] 10.222.0.58 () {60 vars in 1279 bytes} [Wed Aug 10 23:08:07 2022] POST /compute/v2.1/servers/eea0fab7-447d-4f5f-8577-6ef8df500499/action => generated 170 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 10 23:08:07.218597 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-460bd55f-4b22-454c-9e69-ad066880c4ca tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Calling method '.version_select at 0x7f847d8c38b0>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:08:07.243545 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-af848a71-ad0c-4ac4-b1b6-9ba47fc29a22 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] [instance: 8385348f-0651-486d-9b4a-2c884933edb1] Going to try to terminate instance {{(pid=122633) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:08:07.350715 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-460bd55f-4b22-454c-9e69-ad066880c4ca tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] 10.222.0.58 "GET /compute/v2.1/images/78ad8905-f66f-4733-8be9-2b260f1fabed" status: 200 len: 784 microversion: 2.1 time: 0.136765 Aug 10 23:08:07.352947 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1347/2750] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 10 23:08:07 2022] GET /compute/v2.1/images/78ad8905-f66f-4733-8be9-2b260f1fabed => generated 784 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:08:07.362490 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-0b4b4986-c5d9-452c-8443-8b986fa3baad tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:08:07.363256 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-0b4b4986-c5d9-452c-8443-8b986fa3baad tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] [instance: 3aa229ba-7292-41ee-922a-32c281be9f42] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:08:07.371519 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0b4b4986-c5d9-452c-8443-8b986fa3baad tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:07.372437 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0b4b4986-c5d9-452c-8443-8b986fa3baad tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:07.373143 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0b4b4986-c5d9-452c-8443-8b986fa3baad tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:07.374284 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0b4b4986-c5d9-452c-8443-8b986fa3baad tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:07.375031 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0b4b4986-c5d9-452c-8443-8b986fa3baad tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:07.376304 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0b4b4986-c5d9-452c-8443-8b986fa3baad tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:07.452205 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-af848a71-ad0c-4ac4-b1b6-9ba47fc29a22 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] 10.222.0.58 "DELETE /compute/v2.1/servers/8385348f-0651-486d-9b4a-2c884933edb1" status: 204 len: 0 microversion: 2.75 time: 0.313409 Aug 10 23:08:07.454542 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1404/2751] 10.222.0.58 () {60 vars in 1280 bytes} [Wed Aug 10 23:08:07 2022] DELETE /compute/v2.1/servers/8385348f-0651-486d-9b4a-2c884933edb1 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 10 23:08:07.464703 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-9911b2bd-a0a0-480c-9a10-fa072f11a026 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:08:07.466979 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-9911b2bd-a0a0-480c-9a10-fa072f11a026 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] [instance: 45beadf1-a6da-49ab-9098-6b681b5184c9] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:08:07.484815 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9911b2bd-a0a0-480c-9a10-fa072f11a026 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:07.487226 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9911b2bd-a0a0-480c-9a10-fa072f11a026 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:07.488229 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9911b2bd-a0a0-480c-9a10-fa072f11a026 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:07.489536 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9911b2bd-a0a0-480c-9a10-fa072f11a026 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:07.493655 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9911b2bd-a0a0-480c-9a10-fa072f11a026 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:07.495174 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9911b2bd-a0a0-480c-9a10-fa072f11a026 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:07.666089 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-9911b2bd-a0a0-480c-9a10-fa072f11a026 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1986185dc9b4df4affcc421365462f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597863bfebdc481188f1f30095da5396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:08:07.675020 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-9911b2bd-a0a0-480c-9a10-fa072f11a026 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] 10.222.0.58 "GET /compute/v2.1/servers/45beadf1-a6da-49ab-9098-6b681b5184c9" status: 200 len: 1674 microversion: 2.1 time: 0.217386 Aug 10 23:08:07.675612 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1405/2752] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:08:07 2022] GET /compute/v2.1/servers/45beadf1-a6da-49ab-9098-6b681b5184c9 => generated 1674 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:08:07.693192 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-2ad50ff7-c1bb-4c93-80ad-aec6db5c9c3f tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:08:07.693900 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-2ad50ff7-c1bb-4c93-80ad-aec6db5c9c3f tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] [instance: eea0fab7-447d-4f5f-8577-6ef8df500499] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:08:07.702814 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2ad50ff7-c1bb-4c93-80ad-aec6db5c9c3f tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:07.703869 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2ad50ff7-c1bb-4c93-80ad-aec6db5c9c3f tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:07.704484 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2ad50ff7-c1bb-4c93-80ad-aec6db5c9c3f tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:07.705384 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2ad50ff7-c1bb-4c93-80ad-aec6db5c9c3f tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:07.705838 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2ad50ff7-c1bb-4c93-80ad-aec6db5c9c3f tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:07.706261 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2ad50ff7-c1bb-4c93-80ad-aec6db5c9c3f tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:07.786516 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-0b4b4986-c5d9-452c-8443-8b986fa3baad tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8899e278c9453fba0ab05c69b0b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46ac8b84bd649fa88897068dbfa5ce6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:08:07.797648 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-0b4b4986-c5d9-452c-8443-8b986fa3baad tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] 10.222.0.58 "GET /compute/v2.1/servers/3aa229ba-7292-41ee-922a-32c281be9f42" status: 200 len: 1506 microversion: 2.1 time: 0.443449 Aug 10 23:08:07.800924 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1348/2753] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:08:07 2022] GET /compute/v2.1/servers/3aa229ba-7292-41ee-922a-32c281be9f42 => generated 1506 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:08:07.809461 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-9569be69-89f6-49da-aba7-40d3b931ea4c tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:08:07.826435 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-9569be69-89f6-49da-aba7-40d3b931ea4c tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] 10.222.0.58 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.024143 Aug 10 23:08:07.833061 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1349/2754] 10.222.0.58 () {58 vars in 1137 bytes} [Wed Aug 10 23:08:07 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:08:07.838268 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-71175a27-011b-423b-83cd-1d51affcb858 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:08:07.838995 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-71175a27-011b-423b-83cd-1d51affcb858 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] [instance: 6fe68649-0e9b-4059-afb6-cc44844ff476] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:08:07.852085 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-71175a27-011b-423b-83cd-1d51affcb858 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:07.853012 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-71175a27-011b-423b-83cd-1d51affcb858 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:07.853899 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-71175a27-011b-423b-83cd-1d51affcb858 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:07.854874 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-71175a27-011b-423b-83cd-1d51affcb858 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:07.858466 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-71175a27-011b-423b-83cd-1d51affcb858 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:07.859242 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-71175a27-011b-423b-83cd-1d51affcb858 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:07.899128 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-2ad50ff7-c1bb-4c93-80ad-aec6db5c9c3f tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bbb4f184e4409d9eed51e0b98dfb29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708f8d4c4ed6432d85e0bf6a9bac7677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:08:07.907879 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-2ad50ff7-c1bb-4c93-80ad-aec6db5c9c3f tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] 10.222.0.58 "GET /compute/v2.1/servers/eea0fab7-447d-4f5f-8577-6ef8df500499" status: 200 len: 1521 microversion: 2.1 time: 0.230747 Aug 10 23:08:07.908483 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1406/2755] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:08:07 2022] GET /compute/v2.1/servers/eea0fab7-447d-4f5f-8577-6ef8df500499 => generated 1521 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:08:07.913180 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-44ab0015-425f-42f2-93fe-516127c59114 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:08:07.913840 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-44ab0015-425f-42f2-93fe-516127c59114 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] [instance: 8385348f-0651-486d-9b4a-2c884933edb1] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:08:07.937237 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-44ab0015-425f-42f2-93fe-516127c59114 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:07.937739 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-44ab0015-425f-42f2-93fe-516127c59114 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:07.938181 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-44ab0015-425f-42f2-93fe-516127c59114 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:07.938934 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-44ab0015-425f-42f2-93fe-516127c59114 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:07.939389 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-44ab0015-425f-42f2-93fe-516127c59114 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:07.940031 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-44ab0015-425f-42f2-93fe-516127c59114 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:07.953619 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-71175a27-011b-423b-83cd-1d51affcb858 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:07.959369 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-71175a27-011b-423b-83cd-1d51affcb858 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:07.964393 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-71175a27-011b-423b-83cd-1d51affcb858 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:07.965625 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.objects.instance [None req-71175a27-011b-423b-83cd-1d51affcb858 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lazy-loading 'fault' on Instance uuid 6fe68649-0e9b-4059-afb6-cc44844ff476 {{(pid=122632) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:08:08.018637 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-44ab0015-425f-42f2-93fe-516127c59114 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d79bf59dabe4c02aa5e27bf3b0bc1ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9af75fc4bbc4b63ae83b5f900f1aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:08:08.028653 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-44ab0015-425f-42f2-93fe-516127c59114 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d79bf59dabe4c02aa5e27bf3b0bc1ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9af75fc4bbc4b63ae83b5f900f1aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:08:08.030441 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-44ab0015-425f-42f2-93fe-516127c59114 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d79bf59dabe4c02aa5e27bf3b0bc1ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9af75fc4bbc4b63ae83b5f900f1aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:08:08.039206 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-44ab0015-425f-42f2-93fe-516127c59114 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] 10.222.0.58 "GET /compute/v2.1/servers/8385348f-0651-486d-9b4a-2c884933edb1" status: 200 len: 1444 microversion: 2.75 time: 0.129628 Aug 10 23:08:08.040374 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1407/2756] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:08:07 2022] GET /compute/v2.1/servers/8385348f-0651-486d-9b4a-2c884933edb1 => generated 1444 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:08:08.045110 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-81a42e4f-50f4-4fe0-b2a9-8a54ce46485e tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:08:08.046677 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-81a42e4f-50f4-4fe0-b2a9-8a54ce46485e tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] [instance: 3aa229ba-7292-41ee-922a-32c281be9f42] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:08:08.063094 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-71175a27-011b-423b-83cd-1d51affcb858 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1c6e1f505b8409ea38f8a07bad870a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6473e36eada44e6bca8dc568e5ee330', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:08:08.073600 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-71175a27-011b-423b-83cd-1d51affcb858 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] 10.222.0.58 "GET /compute/v2.1/servers/6fe68649-0e9b-4059-afb6-cc44844ff476" status: 200 len: 1302 microversion: 2.1 time: 0.239255 Aug 10 23:08:08.075377 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1350/2757] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:08:07 2022] GET /compute/v2.1/servers/6fe68649-0e9b-4059-afb6-cc44844ff476 => generated 1302 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:08:08.078477 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-81a42e4f-50f4-4fe0-b2a9-8a54ce46485e tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:08.079008 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-81a42e4f-50f4-4fe0-b2a9-8a54ce46485e tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:08.079453 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-81a42e4f-50f4-4fe0-b2a9-8a54ce46485e tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:08.080160 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-81a42e4f-50f4-4fe0-b2a9-8a54ce46485e tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:08.080604 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-81a42e4f-50f4-4fe0-b2a9-8a54ce46485e tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:08.081323 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-77e8490f-c3d6-4004-9da7-4a9cef77ae0b tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Calling method '.version_select at 0x7f847d390040>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:08:08.088475 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-81a42e4f-50f4-4fe0-b2a9-8a54ce46485e tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:08.259676 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-81a42e4f-50f4-4fe0-b2a9-8a54ce46485e tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8899e278c9453fba0ab05c69b0b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46ac8b84bd649fa88897068dbfa5ce6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:08:08.269638 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-81a42e4f-50f4-4fe0-b2a9-8a54ce46485e tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] 10.222.0.58 "GET /compute/v2.1/servers/3aa229ba-7292-41ee-922a-32c281be9f42" status: 200 len: 1506 microversion: 2.1 time: 0.227605 Aug 10 23:08:08.280595 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1408/2758] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:08:08 2022] GET /compute/v2.1/servers/3aa229ba-7292-41ee-922a-32c281be9f42 => generated 1506 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:08:08.287769 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-1c9cc569-cc67-49e4-895a-740dff15e345 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:08:08.288388 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-1c9cc569-cc67-49e4-895a-740dff15e345 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] [instance: eea0fab7-447d-4f5f-8577-6ef8df500499] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:08:08.308403 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1c9cc569-cc67-49e4-895a-740dff15e345 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:08.309961 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1c9cc569-cc67-49e4-895a-740dff15e345 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:08.310607 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1c9cc569-cc67-49e4-895a-740dff15e345 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:08.312253 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1c9cc569-cc67-49e4-895a-740dff15e345 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:08.312253 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1c9cc569-cc67-49e4-895a-740dff15e345 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:08.312490 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1c9cc569-cc67-49e4-895a-740dff15e345 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:08.476462 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-1c9cc569-cc67-49e4-895a-740dff15e345 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bbb4f184e4409d9eed51e0b98dfb29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708f8d4c4ed6432d85e0bf6a9bac7677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:08:08.485053 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-1c9cc569-cc67-49e4-895a-740dff15e345 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] 10.222.0.58 "GET /compute/v2.1/servers/eea0fab7-447d-4f5f-8577-6ef8df500499" status: 200 len: 1521 microversion: 2.1 time: 0.202608 Aug 10 23:08:08.485391 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1409/2759] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:08:08 2022] GET /compute/v2.1/servers/eea0fab7-447d-4f5f-8577-6ef8df500499 => generated 1521 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:08:08.495886 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-04bdf5b0-2c35-4769-8f2a-032e9d67a129 req-9a2effca-7528-4010-a5b5-803c83d92903 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6fe68649-0e9b-4059-afb6-cc44844ff476", "name": "network-vif-deleted", "tag": "63f7aab2-326b-45a5-92a2-d01e6f4959f3"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:08:08.508999 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-04bdf5b0-2c35-4769-8f2a-032e9d67a129 req-9a2effca-7528-4010-a5b5-803c83d92903 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:08.509444 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-04bdf5b0-2c35-4769-8f2a-032e9d67a129 req-9a2effca-7528-4010-a5b5-803c83d92903 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:08.509885 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-04bdf5b0-2c35-4769-8f2a-032e9d67a129 req-9a2effca-7528-4010-a5b5-803c83d92903 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:08.522373 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-04bdf5b0-2c35-4769-8f2a-032e9d67a129 req-9a2effca-7528-4010-a5b5-803c83d92903 service nova] Creating event network-vif-deleted:63f7aab2-326b-45a5-92a2-d01e6f4959f3 for instance 6fe68649-0e9b-4059-afb6-cc44844ff476 on n-h2-850468-14 Aug 10 23:08:08.527493 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-04bdf5b0-2c35-4769-8f2a-032e9d67a129 req-9a2effca-7528-4010-a5b5-803c83d92903 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040627 Aug 10 23:08:08.528942 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1410/2760] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:08:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:08:08.534494 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-d16e16d2-caca-484c-a79d-6460c38657f5 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:08:08.535258 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-d16e16d2-caca-484c-a79d-6460c38657f5 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] [instance: 325d9b10-716d-4961-91d1-70962403fef4] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:08:08.541576 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d16e16d2-caca-484c-a79d-6460c38657f5 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:08.542065 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d16e16d2-caca-484c-a79d-6460c38657f5 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:08.542506 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d16e16d2-caca-484c-a79d-6460c38657f5 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:08.543313 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d16e16d2-caca-484c-a79d-6460c38657f5 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:08.543767 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d16e16d2-caca-484c-a79d-6460c38657f5 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:08.544230 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d16e16d2-caca-484c-a79d-6460c38657f5 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:08.703141 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-d16e16d2-caca-484c-a79d-6460c38657f5 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84e70c3ea5347e79ba5aee661b15ce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ab3ad5c0ef448aaa1282112bf20d83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:08:08.713192 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-d16e16d2-caca-484c-a79d-6460c38657f5 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] 10.222.0.58 "GET /compute/v2.1/servers/325d9b10-716d-4961-91d1-70962403fef4" status: 200 len: 1322 microversion: 2.1 time: 0.182886 Aug 10 23:08:08.713855 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1411/2761] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:08:08 2022] GET /compute/v2.1/servers/325d9b10-716d-4961-91d1-70962403fef4 => generated 1322 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:08:08.724384 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-d90d2a96-7eca-420e-826d-f29383024a97 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:08:08.728077 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-d90d2a96-7eca-420e-826d-f29383024a97 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] [instance: 3aa229ba-7292-41ee-922a-32c281be9f42] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:08:08.734626 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d90d2a96-7eca-420e-826d-f29383024a97 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:08.735179 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d90d2a96-7eca-420e-826d-f29383024a97 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:08.735611 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d90d2a96-7eca-420e-826d-f29383024a97 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:08.736374 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d90d2a96-7eca-420e-826d-f29383024a97 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:08.736837 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d90d2a96-7eca-420e-826d-f29383024a97 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:08.737255 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d90d2a96-7eca-420e-826d-f29383024a97 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:08.780397 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-77e8490f-c3d6-4004-9da7-4a9cef77ae0b tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] 10.222.0.58 "DELETE /compute/v2.1/images/0f967916-982b-4b7c-bb3c-1ec6b8c4dd57" status: 204 len: 0 microversion: 2.1 time: 0.703095 Aug 10 23:08:08.781161 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1351/2762] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:08:08 2022] DELETE /compute/v2.1/images/0f967916-982b-4b7c-bb3c-1ec6b8c4dd57 => generated 0 bytes in 705 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:08:08.786492 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-f790745d-383e-4736-83ec-9fc9b35a59b1 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-560222198", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:08:08.791966 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-f790745d-383e-4736-83ec-9fc9b35a59b1 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Request method failure captured: Aug 10 23:08:08.791966 n-d-850468-14 devstack@n-api.service[122632]: request: POST /compute/v2.1/servers/eea0fab7-447d-4f5f-8577-6ef8df500499/action HTTP/1.1 Aug 10 23:08:08.791966 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:08:08.791966 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:08:08.791966 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:08:08.791966 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 618 Aug 10 23:08:08.791966 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:08:08.791966 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:08:08.791966 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:08:08.791966 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:08:08.791966 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9Do81XwGOyJYZzjDqBUm67v_Q0362_4xQUvU3HvIWmFkKXGTToH86-ip4fxXuu0oxmkucX-Et277q0Z5R4ChTe5MWC8zJ89hWAklZmH6m-N_CAseQK0eUiUfLbiJpjdB2S78hj0EntCCqH4mBVhce2-q9auCyId7qlhsdrU7MIxxCSQ Aug 10 23:08:08.791966 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:08:08.791966 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:08:08.791966 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:08:08.791966 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:08:08.791966 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:08:08.791966 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:08:08.791966 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 708f8d4c4ed6432d85e0bf6a9bac7677 Aug 10 23:08:08.791966 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2080454436 Aug 10 23:08:08.791966 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:08:08.791966 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:08:08.793372 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/708f8d4c4ed6432d85e0bf6a9bac7677"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/708f8d4c4ed6432d85e0bf6a9bac7677"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/708f8d4c4ed6432d85e0bf6a9bac7677"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_708f8d4c4ed6432d85e0bf6a9bac7677", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:08:08.793372 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2080454436 Aug 10 23:08:08.793372 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 708f8d4c4ed6432d85e0bf6a9bac7677 Aug 10 23:08:08.793372 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2080454436 Aug 10 23:08:08.793372 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-ImagesOneServerNegativeTestJSON-2080454436-project Aug 10 23:08:08.793372 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:08:08.793372 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:08:08.793372 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: 55bbb4f184e4409d9eed51e0b98dfb29 Aug 10 23:08:08.793372 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2080454436-project Aug 10 23:08:08.793372 n-d-850468-14 devstack@n-api.service[122632]: Aug 10 23:08:08.793972 n-d-850468-14 devstack@n-api.service[122632]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-560222198", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Aug 10 23:08:08.793972 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:08:08.793972 n-d-850468-14 devstack@n-api.service[122632]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 10 23:08:08.794186 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': 'eea0fab7-447d-4f5f-8577-6ef8df500499', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-560222198', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Aug 10 23:08:08.794186 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:08:08.794186 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:08:08.794186 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 10 23:08:08.794186 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 10 23:08:08.794186 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 10 23:08:08.794186 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise error Aug 10 23:08:08.794186 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 10 23:08:08.794186 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:08:08.794186 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Aug 10 23:08:08.794186 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 10 23:08:08.794934 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 10 23:08:08.794934 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 10 23:08:08.794934 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 10 23:08:08.794934 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:08:08.794934 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi On instance['createImage']: Aug 10 23:08:08.794934 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Aug 10 23:08:08.794934 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:08:08.794934 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:08:08.794934 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:08:08.794934 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:08:08.794934 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:08:08.794934 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:08:08.794934 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:08:08.794934 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:08:08.794934 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:08:08.794934 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:08:08.794934 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 23:08:08.796133 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 23:08:08.796133 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 10 23:08:08.796133 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 10 23:08:08.796133 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 10 23:08:08.796133 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 10 23:08:08.796133 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 10 23:08:08.796133 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 10 23:08:08.796133 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 10 23:08:08.796133 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:08:08.796133 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:08:08.796133 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:08:08.796133 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:08:08.797000 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:08:08.797000 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:08:08.797000 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 10 23:08:08.797000 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 10 23:08:08.797000 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 10 23:08:08.797000 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:08:08.799168 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-f790745d-383e-4736-83ec-9fc9b35a59b1 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:08:08.800146 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-f790745d-383e-4736-83ec-9fc9b35a59b1 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] 10.222.0.58 "POST /compute/v2.1/servers/eea0fab7-447d-4f5f-8577-6ef8df500499/action" status: 400 len: 938 microversion: 2.1 time: 0.017816 Aug 10 23:08:08.800834 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1352/2763] 10.222.0.58 () {60 vars in 1279 bytes} [Wed Aug 10 23:08:08 2022] POST /compute/v2.1/servers/eea0fab7-447d-4f5f-8577-6ef8df500499/action => generated 938 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 10 23:08:08.808337 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-f275f832-6343-4395-8b95-1d702e6e89ce tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:08:08.810258 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-f275f832-6343-4395-8b95-1d702e6e89ce tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] [instance: 45beadf1-a6da-49ab-9098-6b681b5184c9] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:08:08.810444 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-d90d2a96-7eca-420e-826d-f29383024a97 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] 10.222.0.58 "PUT /compute/v2.1/servers/3aa229ba-7292-41ee-922a-32c281be9f42" status: 200 len: 1078 microversion: 2.1 time: 0.095341 Aug 10 23:08:08.819060 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1412/2764] 10.222.0.58 () {60 vars in 1256 bytes} [Wed Aug 10 23:08:08 2022] PUT /compute/v2.1/servers/3aa229ba-7292-41ee-922a-32c281be9f42 => generated 1078 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:08:08.819216 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f275f832-6343-4395-8b95-1d702e6e89ce tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:08.819216 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f275f832-6343-4395-8b95-1d702e6e89ce tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:08.819216 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f275f832-6343-4395-8b95-1d702e6e89ce tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:08.819216 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f275f832-6343-4395-8b95-1d702e6e89ce tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:08.819540 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f275f832-6343-4395-8b95-1d702e6e89ce tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:08.819540 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f275f832-6343-4395-8b95-1d702e6e89ce tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:08.826680 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-bc2c2b28-8e61-4aba-9877-68aac60987cb tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Calling method '.version_select at 0x7f847c5aa160>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:08:08.837556 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=100 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:08:08.852078 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-bc2c2b28-8e61-4aba-9877-68aac60987cb tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] HTTP exception thrown: Image not found. Aug 10 23:08:08.854342 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-bc2c2b28-8e61-4aba-9877-68aac60987cb tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Request method failure captured: Aug 10 23:08:08.854342 n-d-850468-14 devstack@n-api.service[122633]: request: GET /compute/v2.1/images/0f967916-982b-4b7c-bb3c-1ec6b8c4dd57 HTTP/1.1 Aug 10 23:08:08.854342 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:08:08.854342 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:08:08.854342 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:08:08.854342 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:08:08.854342 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:08:08.854342 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:08:08.854342 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:08:08.854342 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:08:08.854342 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9DokeNMeiboBcHod0DVDkUURTwvtpn7HJKP5tx7M5EdCSsg6x58QQe0n7YdoDGTpztweFjKI6CCh06jNam2UkNuq25elSk8XchgqlShgo_k9VvqntaThhMbZR4SNsj29MfhbIOnvalaEITzobOjvW4fECzJaG8MI_z-RQWJCNK_qZ-I Aug 10 23:08:08.854342 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:08:08.854342 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:08:08.854342 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:08:08.854342 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:08:08.854342 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:08:08.854342 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:08:08.854342 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: de5881784cbc4d669ad7fa40880ed9c0 Aug 10 23:08:08.854342 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-ImagesOneServerTestJSON-435688088 Aug 10 23:08:08.854342 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:08:08.854342 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:08:08.856000 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/de5881784cbc4d669ad7fa40880ed9c0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/de5881784cbc4d669ad7fa40880ed9c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/de5881784cbc4d669ad7fa40880ed9c0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_de5881784cbc4d669ad7fa40880ed9c0", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:08:08.856000 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-ImagesOneServerTestJSON-435688088 Aug 10 23:08:08.856000 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: de5881784cbc4d669ad7fa40880ed9c0 Aug 10 23:08:08.856000 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-435688088 Aug 10 23:08:08.856000 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-ImagesOneServerTestJSON-435688088-project Aug 10 23:08:08.856000 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:08:08.856000 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:08:08.856000 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 10d235607afb4ba59ed6ac2908c6dc33 Aug 10 23:08:08.856000 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-ImagesOneServerTestJSON-435688088-project Aug 10 23:08:08.856000 n-d-850468-14 devstack@n-api.service[122633]: method: Aug 10 23:08:08.856000 n-d-850468-14 devstack@n-api.service[122633]: exception: Image not found. Aug 10 23:08:08.856000 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': '0f967916-982b-4b7c-bb3c-1ec6b8c4dd57'} Aug 10 23:08:08.856000 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:08:08.862279 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:08:08.862279 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 10 23:08:08.862279 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 10 23:08:08.862279 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 10 23:08:08.862279 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 10 23:08:08.862279 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 10 23:08:08.862279 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 10 23:08:08.862279 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 10 23:08:08.862279 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 10 23:08:08.862279 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 10 23:08:08.862279 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 10 23:08:08.862279 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 10 23:08:08.862279 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 10 23:08:08.862279 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 10 23:08:08.862279 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 10 23:08:08.862279 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 10 23:08:08.862279 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 10 23:08:08.862279 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 0f967916-982b-4b7c-bb3c-1ec6b8c4dd57 Aug 10 23:08:08.864111 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:08:08.864111 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:08:08.864111 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:08:08.864111 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:08:08.864111 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Aug 10 23:08:08.864111 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Aug 10 23:08:08.864111 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 10 23:08:08.864111 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 10 23:08:08.864111 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 10 23:08:08.864111 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 10 23:08:08.864111 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 10 23:08:08.864111 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 10 23:08:08.864111 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 10 23:08:08.864111 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 10 23:08:08.864111 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 10 23:08:08.864111 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 10 23:08:08.864111 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 10 23:08:08.864111 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 10 23:08:08.864111 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 10 23:08:08.864111 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 10 23:08:08.865659 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 10 23:08:08.865659 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 10 23:08:08.865659 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 10 23:08:08.865659 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 10 23:08:08.865659 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 10 23:08:08.865659 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 10 23:08:08.865659 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 10 23:08:08.865659 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 10 23:08:08.865659 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 0f967916-982b-4b7c-bb3c-1ec6b8c4dd57 could not be found. Aug 10 23:08:08.865659 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:08:08.865659 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:08:08.865659 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:08:08.865659 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:08:08.865659 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:08:08.865659 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:08:08.865659 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:08:08.865659 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:08:08.865659 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 23:08:08.865659 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 23:08:08.868351 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:08:08.868351 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:08:08.868351 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Aug 10 23:08:08.868351 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 10 23:08:08.868351 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 10 23:08:08.868351 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:08:08.868351 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:08:08.868351 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:08:08.868351 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:08:08.868351 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:08:08.868351 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:08:08.868351 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:08:08.868351 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:08:08.868351 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 10 23:08:08.868351 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:08:08.868351 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-bc2c2b28-8e61-4aba-9877-68aac60987cb tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Returning 404 to user: Image not found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:08:08.868351 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-bc2c2b28-8e61-4aba-9877-68aac60987cb tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] 10.222.0.58 "GET /compute/v2.1/images/0f967916-982b-4b7c-bb3c-1ec6b8c4dd57" status: 404 len: 62 microversion: 2.1 time: 0.043799 Aug 10 23:08:08.870894 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1413/2765] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 10 23:08:08 2022] GET /compute/v2.1/images/0f967916-982b-4b7c-bb3c-1ec6b8c4dd57 => generated 62 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 10 23:08:08.870894 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-d4e27ec7-dd15-4091-9feb-3c80b8735a88 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:08:08.870894 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-d4e27ec7-dd15-4091-9feb-3c80b8735a88 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] [instance: eea0fab7-447d-4f5f-8577-6ef8df500499] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:08:08.872142 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d4e27ec7-dd15-4091-9feb-3c80b8735a88 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:08.872634 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d4e27ec7-dd15-4091-9feb-3c80b8735a88 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:08.873071 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d4e27ec7-dd15-4091-9feb-3c80b8735a88 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:08.873778 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d4e27ec7-dd15-4091-9feb-3c80b8735a88 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:08.874228 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d4e27ec7-dd15-4091-9feb-3c80b8735a88 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:08.874659 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d4e27ec7-dd15-4091-9feb-3c80b8735a88 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:09.065707 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-d4e27ec7-dd15-4091-9feb-3c80b8735a88 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bbb4f184e4409d9eed51e0b98dfb29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708f8d4c4ed6432d85e0bf6a9bac7677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:08:09.087986 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-f275f832-6343-4395-8b95-1d702e6e89ce tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1986185dc9b4df4affcc421365462f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597863bfebdc481188f1f30095da5396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:08:09.101561 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-f275f832-6343-4395-8b95-1d702e6e89ce tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] 10.222.0.58 "GET /compute/v2.1/servers/45beadf1-a6da-49ab-9098-6b681b5184c9" status: 200 len: 1674 microversion: 2.1 time: 0.299403 Aug 10 23:08:09.103773 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-d4e27ec7-dd15-4091-9feb-3c80b8735a88 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] 10.222.0.58 "GET /compute/v2.1/servers/eea0fab7-447d-4f5f-8577-6ef8df500499" status: 200 len: 1521 microversion: 2.1 time: 0.245853 Aug 10 23:08:09.108420 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1353/2766] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:08:08 2022] GET /compute/v2.1/servers/45beadf1-a6da-49ab-9098-6b681b5184c9 => generated 1674 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:08:09.108885 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1414/2767] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:08:08 2022] GET /compute/v2.1/servers/eea0fab7-447d-4f5f-8577-6ef8df500499 => generated 1521 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:08:09.138904 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-154b0625-bb1a-4a6a-9a72-d6e4cdad4b28 tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-1811605942"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:08:09.141383 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-154b0625-bb1a-4a6a-9a72-d6e4cdad4b28 tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] [instance: a632bb08-327b-4870-9f4e-90f8d0d863d0] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:08:09.144312 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-d2fb83bc-15e7-4efd-9623-ca8535c9e861 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:08:09.145079 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-d2fb83bc-15e7-4efd-9623-ca8535c9e861 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] [instance: 3aa229ba-7292-41ee-922a-32c281be9f42] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:08:09.156245 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d2fb83bc-15e7-4efd-9623-ca8535c9e861 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:09.156741 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d2fb83bc-15e7-4efd-9623-ca8535c9e861 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:09.157176 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d2fb83bc-15e7-4efd-9623-ca8535c9e861 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:09.157887 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d2fb83bc-15e7-4efd-9623-ca8535c9e861 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:09.158336 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d2fb83bc-15e7-4efd-9623-ca8535c9e861 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:09.158754 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d2fb83bc-15e7-4efd-9623-ca8535c9e861 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:09.160348 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-154b0625-bb1a-4a6a-9a72-d6e4cdad4b28 tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:09.160900 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-154b0625-bb1a-4a6a-9a72-d6e4cdad4b28 tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:09.161982 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-154b0625-bb1a-4a6a-9a72-d6e4cdad4b28 tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:09.162733 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-154b0625-bb1a-4a6a-9a72-d6e4cdad4b28 tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:09.163216 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-154b0625-bb1a-4a6a-9a72-d6e4cdad4b28 tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:09.163668 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-154b0625-bb1a-4a6a-9a72-d6e4cdad4b28 tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:09.571435 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-154b0625-bb1a-4a6a-9a72-d6e4cdad4b28 tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] 10.222.0.58 "POST /compute/v2.1/servers/a632bb08-327b-4870-9f4e-90f8d0d863d0/action" status: 202 len: 0 microversion: 2.1 time: 0.460769 Aug 10 23:08:09.574372 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1354/2768] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:08:09 2022] POST /compute/v2.1/servers/a632bb08-327b-4870-9f4e-90f8d0d863d0/action => generated 0 bytes in 464 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 10 23:08:09.580928 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c329ad12-6727-4030-828e-dc92fc368db7 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:08:09.582182 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-c329ad12-6727-4030-828e-dc92fc368db7 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] [instance: 8385348f-0651-486d-9b4a-2c884933edb1] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:08:09.590775 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c329ad12-6727-4030-828e-dc92fc368db7 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:09.591665 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c329ad12-6727-4030-828e-dc92fc368db7 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:09.592415 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c329ad12-6727-4030-828e-dc92fc368db7 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:09.593365 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c329ad12-6727-4030-828e-dc92fc368db7 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:09.594080 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c329ad12-6727-4030-828e-dc92fc368db7 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:09.594738 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c329ad12-6727-4030-828e-dc92fc368db7 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:09.701420 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c329ad12-6727-4030-828e-dc92fc368db7 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:09.702460 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c329ad12-6727-4030-828e-dc92fc368db7 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:09.707766 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c329ad12-6727-4030-828e-dc92fc368db7 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:09.709007 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.objects.instance [None req-c329ad12-6727-4030-828e-dc92fc368db7 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Lazy-loading 'fault' on Instance uuid 8385348f-0651-486d-9b4a-2c884933edb1 {{(pid=122632) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:08:09.782285 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-c329ad12-6727-4030-828e-dc92fc368db7 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d79bf59dabe4c02aa5e27bf3b0bc1ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9af75fc4bbc4b63ae83b5f900f1aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:08:09.797651 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-c329ad12-6727-4030-828e-dc92fc368db7 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0d79bf59dabe4c02aa5e27bf3b0bc1ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9af75fc4bbc4b63ae83b5f900f1aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:08:09.799181 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-c329ad12-6727-4030-828e-dc92fc368db7 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0d79bf59dabe4c02aa5e27bf3b0bc1ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9af75fc4bbc4b63ae83b5f900f1aa07', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:08:09.811839 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-c329ad12-6727-4030-828e-dc92fc368db7 tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] 10.222.0.58 "GET /compute/v2.1/servers/8385348f-0651-486d-9b4a-2c884933edb1" status: 200 len: 1449 microversion: 2.75 time: 0.235518 Aug 10 23:08:09.812437 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1355/2769] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:08:09 2022] GET /compute/v2.1/servers/8385348f-0651-486d-9b4a-2c884933edb1 => generated 1449 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:08:09.828887 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-29384a6e-9a05-46f1-a5fc-cdc165a5b078 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:08:09.831204 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-29384a6e-9a05-46f1-a5fc-cdc165a5b078 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] [instance: 6fe68649-0e9b-4059-afb6-cc44844ff476] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:08:09.844177 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-29384a6e-9a05-46f1-a5fc-cdc165a5b078 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:09.847196 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-29384a6e-9a05-46f1-a5fc-cdc165a5b078 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:09.847928 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-29384a6e-9a05-46f1-a5fc-cdc165a5b078 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:09.855837 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-29384a6e-9a05-46f1-a5fc-cdc165a5b078 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:09.856991 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-29384a6e-9a05-46f1-a5fc-cdc165a5b078 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:09.857705 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-29384a6e-9a05-46f1-a5fc-cdc165a5b078 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:09.876431 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-29384a6e-9a05-46f1-a5fc-cdc165a5b078 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] HTTP exception thrown: Instance 6fe68649-0e9b-4059-afb6-cc44844ff476 could not be found. Aug 10 23:08:09.879473 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-29384a6e-9a05-46f1-a5fc-cdc165a5b078 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Request method failure captured: Aug 10 23:08:09.879473 n-d-850468-14 devstack@n-api.service[122632]: request: GET /compute/v2.1/servers/6fe68649-0e9b-4059-afb6-cc44844ff476 HTTP/1.1 Aug 10 23:08:09.879473 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:08:09.879473 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:08:09.879473 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:08:09.879473 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 23:08:09.879473 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:08:09.879473 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:08:09.879473 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:08:09.879473 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:08:09.879473 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9Dnr9qhH8qABr6sGOY8du1SR95rfOClj5ZCkR3wuQSMMB2bcRJmBsw1RKG_rSrVIE8iV42HRXRAxetZmHBzbgzrG_Gv5lN5xvGD0xpsgMpj8ytwRnm7P1y5XfrOqCJhIe4RvCam6acWmEXW2e4PykLV39ynUh-_MtUn4NTKXON0FxOM Aug 10 23:08:09.879473 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:08:09.879473 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:08:09.879473 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:08:09.879473 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:08:09.879473 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:08:09.879473 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:08:09.879473 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: c6473e36eada44e6bca8dc568e5ee330 Aug 10 23:08:09.879473 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-ServersTestMultiNic-1647590367 Aug 10 23:08:09.879473 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:08:09.879473 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:08:09.880846 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c6473e36eada44e6bca8dc568e5ee330"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c6473e36eada44e6bca8dc568e5ee330"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/c6473e36eada44e6bca8dc568e5ee330"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_c6473e36eada44e6bca8dc568e5ee330", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:08:09.880846 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-ServersTestMultiNic-1647590367 Aug 10 23:08:09.880846 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: c6473e36eada44e6bca8dc568e5ee330 Aug 10 23:08:09.880846 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-ServersTestMultiNic-1647590367 Aug 10 23:08:09.880846 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-ServersTestMultiNic-1647590367-project Aug 10 23:08:09.880846 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:08:09.880846 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:08:09.880846 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: a1c6e1f505b8409ea38f8a07bad870a8 Aug 10 23:08:09.880846 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-ServersTestMultiNic-1647590367-project Aug 10 23:08:09.880846 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:08:09.880846 n-d-850468-14 devstack@n-api.service[122632]: exception: Instance 6fe68649-0e9b-4059-afb6-cc44844ff476 could not be found. Aug 10 23:08:09.880846 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': '6fe68649-0e9b-4059-afb6-cc44844ff476'} Aug 10 23:08:09.881592 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:08:09.881592 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:08:09.881592 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:08:09.881592 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:08:09.881592 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:08:09.881592 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:08:09.881592 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:08:09.881592 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:08:09.881592 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:08:09.881592 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:08:09.881592 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6fe68649-0e9b-4059-afb6-cc44844ff476 could not be found. Aug 10 23:08:09.881592 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:08:09.881592 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:08:09.881592 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:08:09.881592 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:08:09.881592 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:08:09.881592 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:08:09.881592 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:08:09.881592 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:08:09.881592 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:08:09.882920 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:08:09.882920 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:08:09.882920 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:08:09.882920 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:08:09.882920 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:08:09.882920 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:08:09.882920 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:08:09.882920 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6fe68649-0e9b-4059-afb6-cc44844ff476 could not be found. Aug 10 23:08:09.882920 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:08:09.882920 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:08:09.882920 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:08:09.882920 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:08:09.882920 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:08:09.882920 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:08:09.882920 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:08:09.882920 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:08:09.882920 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6fe68649-0e9b-4059-afb6-cc44844ff476 could not be found. Aug 10 23:08:09.882920 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:08:09.886307 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-29384a6e-9a05-46f1-a5fc-cdc165a5b078 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Returning 404 to user: Instance 6fe68649-0e9b-4059-afb6-cc44844ff476 could not be found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:08:09.887608 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-29384a6e-9a05-46f1-a5fc-cdc165a5b078 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] 10.222.0.58 "GET /compute/v2.1/servers/6fe68649-0e9b-4059-afb6-cc44844ff476" status: 404 len: 111 microversion: 2.1 time: 0.067958 Aug 10 23:08:09.888413 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1356/2770] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:08:09 2022] GET /compute/v2.1/servers/6fe68649-0e9b-4059-afb6-cc44844ff476 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:08:09.894250 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-159ed365-8025-4245-a6eb-4405ce3cbc1c tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:08:09.895271 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-159ed365-8025-4245-a6eb-4405ce3cbc1c tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] [instance: eea0fab7-447d-4f5f-8577-6ef8df500499] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:08:09.903506 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-159ed365-8025-4245-a6eb-4405ce3cbc1c tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:09.904290 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-159ed365-8025-4245-a6eb-4405ce3cbc1c tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:09.905006 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-159ed365-8025-4245-a6eb-4405ce3cbc1c tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:09.906122 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-159ed365-8025-4245-a6eb-4405ce3cbc1c tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:09.906988 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-159ed365-8025-4245-a6eb-4405ce3cbc1c tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:09.918465 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-159ed365-8025-4245-a6eb-4405ce3cbc1c tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:09.932857 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-d2fb83bc-15e7-4efd-9623-ca8535c9e861 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8899e278c9453fba0ab05c69b0b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46ac8b84bd649fa88897068dbfa5ce6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:08:09.942219 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-d2fb83bc-15e7-4efd-9623-ca8535c9e861 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] 10.222.0.58 "GET /compute/v2.1/servers/3aa229ba-7292-41ee-922a-32c281be9f42" status: 200 len: 1504 microversion: 2.1 time: 0.818079 Aug 10 23:08:09.945663 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1415/2771] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:08:09 2022] GET /compute/v2.1/servers/3aa229ba-7292-41ee-922a-32c281be9f42 => generated 1504 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:08:09.955651 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-23f95762-93ab-440f-9f97-eb086cba1db2 tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Calling method '.version_select at 0x7f847d4a7280>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:08:10.034456 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-23f95762-93ab-440f-9f97-eb086cba1db2 tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] 10.222.0.58 "GET /compute/v2.1/images/6331cdd3-d79a-4aa4-8575-f401a3c11d5b" status: 200 len: 1427 microversion: 2.1 time: 0.082478 Aug 10 23:08:10.036096 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1416/2772] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 10 23:08:09 2022] GET /compute/v2.1/images/6331cdd3-d79a-4aa4-8575-f401a3c11d5b => generated 1427 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:08:10.041950 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-ed0675cb-84f4-4172-80d5-7eaf960f6cdb tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:08:10.043066 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-ed0675cb-84f4-4172-80d5-7eaf960f6cdb tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] [instance: 325d9b10-716d-4961-91d1-70962403fef4] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:08:10.050532 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ed0675cb-84f4-4172-80d5-7eaf960f6cdb tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:10.051560 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ed0675cb-84f4-4172-80d5-7eaf960f6cdb tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:10.059931 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ed0675cb-84f4-4172-80d5-7eaf960f6cdb tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:10.061100 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ed0675cb-84f4-4172-80d5-7eaf960f6cdb tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:10.062576 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ed0675cb-84f4-4172-80d5-7eaf960f6cdb tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:10.063576 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ed0675cb-84f4-4172-80d5-7eaf960f6cdb tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:10.108668 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:08:10.362704 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-ed0675cb-84f4-4172-80d5-7eaf960f6cdb tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84e70c3ea5347e79ba5aee661b15ce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ab3ad5c0ef448aaa1282112bf20d83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:08:10.374196 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-ed0675cb-84f4-4172-80d5-7eaf960f6cdb tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] 10.222.0.58 "GET /compute/v2.1/servers/325d9b10-716d-4961-91d1-70962403fef4" status: 200 len: 1322 microversion: 2.1 time: 0.336561 Aug 10 23:08:10.374853 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1417/2773] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:08:10 2022] GET /compute/v2.1/servers/325d9b10-716d-4961-91d1-70962403fef4 => generated 1322 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:08:10.392253 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-d2f4e97b-762e-4cbe-9121-2641d8804de4 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:08:10.392875 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-d2f4e97b-762e-4cbe-9121-2641d8804de4 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] [instance: 3aa229ba-7292-41ee-922a-32c281be9f42] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:08:10.408962 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d2f4e97b-762e-4cbe-9121-2641d8804de4 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:10.409453 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d2f4e97b-762e-4cbe-9121-2641d8804de4 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:10.409891 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d2f4e97b-762e-4cbe-9121-2641d8804de4 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:10.411233 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d2f4e97b-762e-4cbe-9121-2641d8804de4 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:10.411690 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d2f4e97b-762e-4cbe-9121-2641d8804de4 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:10.412115 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d2f4e97b-762e-4cbe-9121-2641d8804de4 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:10.532493 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-159ed365-8025-4245-a6eb-4405ce3cbc1c tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bbb4f184e4409d9eed51e0b98dfb29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708f8d4c4ed6432d85e0bf6a9bac7677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:08:10.542305 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-159ed365-8025-4245-a6eb-4405ce3cbc1c tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] 10.222.0.58 "GET /compute/v2.1/servers/eea0fab7-447d-4f5f-8577-6ef8df500499" status: 200 len: 1521 microversion: 2.1 time: 0.652479 Aug 10 23:08:10.547002 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1357/2774] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:08:09 2022] GET /compute/v2.1/servers/eea0fab7-447d-4f5f-8577-6ef8df500499 => generated 1521 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:08:10.561706 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-ddf0266c-cfc5-48e4-8464-c4a516d13e6a req-8df7f5a4-87fb-4435-94f5-b4b0aa121177 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "325d9b10-716d-4961-91d1-70962403fef4", "tag": "636830f5-e8dd-4490-8875-671bd1ac26f5"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:08:10.577997 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-ddf0266c-cfc5-48e4-8464-c4a516d13e6a req-8df7f5a4-87fb-4435-94f5-b4b0aa121177 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:10.580631 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-ddf0266c-cfc5-48e4-8464-c4a516d13e6a req-8df7f5a4-87fb-4435-94f5-b4b0aa121177 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:10.581313 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-ddf0266c-cfc5-48e4-8464-c4a516d13e6a req-8df7f5a4-87fb-4435-94f5-b4b0aa121177 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:10.604899 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-ddf0266c-cfc5-48e4-8464-c4a516d13e6a req-8df7f5a4-87fb-4435-94f5-b4b0aa121177 service nova] Creating event network-changed:636830f5-e8dd-4490-8875-671bd1ac26f5 for instance 325d9b10-716d-4961-91d1-70962403fef4 on n-h1-850468-14 Aug 10 23:08:10.610216 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-ddf0266c-cfc5-48e4-8464-c4a516d13e6a req-8df7f5a4-87fb-4435-94f5-b4b0aa121177 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052557 Aug 10 23:08:10.611393 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1358/2775] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:08:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:08:10.616620 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-88c19e4f-7683-4a38-a07a-d65b69512736 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:08:10.619422 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-88c19e4f-7683-4a38-a07a-d65b69512736 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] [instance: 45beadf1-a6da-49ab-9098-6b681b5184c9] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:08:10.626025 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-88c19e4f-7683-4a38-a07a-d65b69512736 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:10.626726 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-88c19e4f-7683-4a38-a07a-d65b69512736 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:10.627353 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-88c19e4f-7683-4a38-a07a-d65b69512736 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:10.628529 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-88c19e4f-7683-4a38-a07a-d65b69512736 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:10.629266 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-88c19e4f-7683-4a38-a07a-d65b69512736 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:10.629884 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-88c19e4f-7683-4a38-a07a-d65b69512736 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:10.731457 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-88c19e4f-7683-4a38-a07a-d65b69512736 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1986185dc9b4df4affcc421365462f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597863bfebdc481188f1f30095da5396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:08:10.755181 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-88c19e4f-7683-4a38-a07a-d65b69512736 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] 10.222.0.58 "GET /compute/v2.1/servers/45beadf1-a6da-49ab-9098-6b681b5184c9" status: 200 len: 1606 microversion: 2.1 time: 0.140651 Aug 10 23:08:10.756471 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1359/2776] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:08:10 2022] GET /compute/v2.1/servers/45beadf1-a6da-49ab-9098-6b681b5184c9 => generated 1606 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:08:10.761666 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-0611f1ee-ff4f-40d4-b992-002033c84a67 req-9bbcc34f-451f-41a8-8f36-0d262d50b1f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a632bb08-327b-4870-9f4e-90f8d0d863d0", "name": "network-vif-unplugged", "status": "completed", "tag": "c03a409d-cb49-445d-9fc1-ff05f4b1ff2b"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:08:10.774647 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-0611f1ee-ff4f-40d4-b992-002033c84a67 req-9bbcc34f-451f-41a8-8f36-0d262d50b1f6 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:10.775933 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-0611f1ee-ff4f-40d4-b992-002033c84a67 req-9bbcc34f-451f-41a8-8f36-0d262d50b1f6 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:10.777658 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-0611f1ee-ff4f-40d4-b992-002033c84a67 req-9bbcc34f-451f-41a8-8f36-0d262d50b1f6 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:10.808476 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-0611f1ee-ff4f-40d4-b992-002033c84a67 req-9bbcc34f-451f-41a8-8f36-0d262d50b1f6 service nova] Creating event network-vif-unplugged:c03a409d-cb49-445d-9fc1-ff05f4b1ff2b for instance a632bb08-327b-4870-9f4e-90f8d0d863d0 on n-h1-850468-14 Aug 10 23:08:10.816530 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-0611f1ee-ff4f-40d4-b992-002033c84a67 req-9bbcc34f-451f-41a8-8f36-0d262d50b1f6 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.057360 Aug 10 23:08:10.817869 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1360/2777] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:08:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:08:10.824732 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-33c02391-3bee-4641-bb58-16eaa210fbd6 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:08:10.830946 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-33c02391-3bee-4641-bb58-16eaa210fbd6 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Request method failure captured: Aug 10 23:08:10.830946 n-d-850468-14 devstack@n-api.service[122632]: request: POST /compute/v2.1/servers/eea0fab7-447d-4f5f-8577-6ef8df500499/action HTTP/1.1 Aug 10 23:08:10.830946 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:08:10.830946 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:08:10.830946 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:08:10.830946 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 285 Aug 10 23:08:10.830946 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:08:10.830946 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:08:10.830946 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:08:10.830946 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:08:10.830946 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9Do81XwGOyJYZzjDqBUm67v_Q0362_4xQUvU3HvIWmFkKXGTToH86-ip4fxXuu0oxmkucX-Et277q0Z5R4ChTe5MWC8zJ89hWAklZmH6m-N_CAseQK0eUiUfLbiJpjdB2S78hj0EntCCqH4mBVhce2-q9auCyId7qlhsdrU7MIxxCSQ Aug 10 23:08:10.830946 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:08:10.830946 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:08:10.830946 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:08:10.830946 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:08:10.830946 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:08:10.830946 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:08:10.830946 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 708f8d4c4ed6432d85e0bf6a9bac7677 Aug 10 23:08:10.830946 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2080454436 Aug 10 23:08:10.830946 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:08:10.830946 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:08:10.832279 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/708f8d4c4ed6432d85e0bf6a9bac7677"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/708f8d4c4ed6432d85e0bf6a9bac7677"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/708f8d4c4ed6432d85e0bf6a9bac7677"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_708f8d4c4ed6432d85e0bf6a9bac7677", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:08:10.832279 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2080454436 Aug 10 23:08:10.832279 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 708f8d4c4ed6432d85e0bf6a9bac7677 Aug 10 23:08:10.832279 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2080454436 Aug 10 23:08:10.832279 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-ImagesOneServerNegativeTestJSON-2080454436-project Aug 10 23:08:10.832279 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:08:10.832279 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:08:10.832279 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: 55bbb4f184e4409d9eed51e0b98dfb29 Aug 10 23:08:10.832279 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2080454436-project Aug 10 23:08:10.832279 n-d-850468-14 devstack@n-api.service[122632]: Aug 10 23:08:10.832279 n-d-850468-14 devstack@n-api.service[122632]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Aug 10 23:08:10.834673 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:08:10.834673 n-d-850468-14 devstack@n-api.service[122632]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 10 23:08:10.834673 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': 'eea0fab7-447d-4f5f-8577-6ef8df500499', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Aug 10 23:08:10.834673 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:08:10.834673 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:08:10.834673 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 10 23:08:10.834673 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 10 23:08:10.834673 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 10 23:08:10.834673 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise error Aug 10 23:08:10.834673 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 10 23:08:10.835518 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:08:10.835518 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Aug 10 23:08:10.835518 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 10 23:08:10.835518 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:08:10.835518 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi On instance['createImage']: Aug 10 23:08:10.835518 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 10 23:08:10.835518 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:08:10.835518 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:08:10.835518 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:08:10.835518 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:08:10.835518 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:08:10.835518 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:08:10.835518 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:08:10.835518 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:08:10.835518 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:08:10.835518 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:08:10.835518 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 23:08:10.835518 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 23:08:10.835518 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 10 23:08:10.835518 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 10 23:08:10.836989 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 10 23:08:10.836989 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 10 23:08:10.836989 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 10 23:08:10.836989 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 10 23:08:10.836989 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 10 23:08:10.836989 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:08:10.836989 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:08:10.836989 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:08:10.836989 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:08:10.836989 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:08:10.836989 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:08:10.836989 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 10 23:08:10.836989 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 10 23:08:10.837966 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 10 23:08:10.837966 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:08:10.840675 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-33c02391-3bee-4641-bb58-16eaa210fbd6 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:08:10.841748 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-33c02391-3bee-4641-bb58-16eaa210fbd6 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] 10.222.0.58 "POST /compute/v2.1/servers/eea0fab7-447d-4f5f-8577-6ef8df500499/action" status: 400 len: 619 microversion: 2.1 time: 0.022275 Aug 10 23:08:10.842482 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1361/2778] 10.222.0.58 () {60 vars in 1279 bytes} [Wed Aug 10 23:08:10 2022] POST /compute/v2.1/servers/eea0fab7-447d-4f5f-8577-6ef8df500499/action => generated 619 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 10 23:08:10.847463 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-b22b846d-474d-499e-b1b0-271b45ad0d8a tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:08:10.849299 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-b22b846d-474d-499e-b1b0-271b45ad0d8a tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] [instance: 8385348f-0651-486d-9b4a-2c884933edb1] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:08:10.859396 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b22b846d-474d-499e-b1b0-271b45ad0d8a tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:10.861794 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b22b846d-474d-499e-b1b0-271b45ad0d8a tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:10.862429 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b22b846d-474d-499e-b1b0-271b45ad0d8a tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:10.863496 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b22b846d-474d-499e-b1b0-271b45ad0d8a tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:10.864301 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b22b846d-474d-499e-b1b0-271b45ad0d8a tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:10.864966 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b22b846d-474d-499e-b1b0-271b45ad0d8a tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:10.900884 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-d2f4e97b-762e-4cbe-9121-2641d8804de4 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8899e278c9453fba0ab05c69b0b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46ac8b84bd649fa88897068dbfa5ce6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:08:10.908391 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-b22b846d-474d-499e-b1b0-271b45ad0d8a tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] HTTP exception thrown: Instance 8385348f-0651-486d-9b4a-2c884933edb1 could not be found. Aug 10 23:08:10.909977 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-d2f4e97b-762e-4cbe-9121-2641d8804de4 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] 10.222.0.58 "GET /compute/v2.1/servers/3aa229ba-7292-41ee-922a-32c281be9f42" status: 200 len: 1504 microversion: 2.1 time: 0.530298 Aug 10 23:08:10.915612 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-b22b846d-474d-499e-b1b0-271b45ad0d8a tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Request method failure captured: Aug 10 23:08:10.915612 n-d-850468-14 devstack@n-api.service[122632]: request: GET /compute/v2.1/servers/8385348f-0651-486d-9b4a-2c884933edb1 HTTP/1.1 Aug 10 23:08:10.915612 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:08:10.915612 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:08:10.915612 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:08:10.915612 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 23:08:10.915612 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:08:10.915612 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:08:10.915612 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:08:10.915612 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:08:10.915612 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9DoKNsN2rHPMvpkXInd9Hs7Rx4HM-hxOKhThhZAMoA5YpdahN61dKR6-qK6zsVmm7nImJZUl-FEusEyWkIL21y1aO3imzLJw7aTbNXS9lWVpj0DcnmAiS_hNtRYm9SGFZ5ni52bvRzA0iYkFx4R2T_VxQP93ab7-h6eIKYSf6eyFUbk Aug 10 23:08:10.915612 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:08:10.915612 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:08:10.915612 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:08:10.915612 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:08:10.915612 n-d-850468-14 devstack@n-api.service[122632]: X-Openstack-Nova-Api-Version: 2.75 Aug 10 23:08:10.915612 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:08:10.915612 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:08:10.915612 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: c9af75fc4bbc4b63ae83b5f900f1aa07 Aug 10 23:08:10.915612 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-ServersAdmin275Test-1076532606 Aug 10 23:08:10.915612 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:08:10.915612 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:08:10.917276 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c9af75fc4bbc4b63ae83b5f900f1aa07"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c9af75fc4bbc4b63ae83b5f900f1aa07"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/c9af75fc4bbc4b63ae83b5f900f1aa07"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_c9af75fc4bbc4b63ae83b5f900f1aa07", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:08:10.917276 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-ServersAdmin275Test-1076532606 Aug 10 23:08:10.917276 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: c9af75fc4bbc4b63ae83b5f900f1aa07 Aug 10 23:08:10.917276 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-ServersAdmin275Test-1076532606 Aug 10 23:08:10.917276 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-ServersAdmin275Test-1076532606-project Aug 10 23:08:10.917276 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:08:10.917276 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:08:10.917276 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: 0d79bf59dabe4c02aa5e27bf3b0bc1ad Aug 10 23:08:10.917276 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-ServersAdmin275Test-1076532606-project Aug 10 23:08:10.917276 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:08:10.917276 n-d-850468-14 devstack@n-api.service[122632]: exception: Instance 8385348f-0651-486d-9b4a-2c884933edb1 could not be found. Aug 10 23:08:10.917276 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': '8385348f-0651-486d-9b4a-2c884933edb1'} Aug 10 23:08:10.918162 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:08:10.918162 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:08:10.918162 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:08:10.918162 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:08:10.918162 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:08:10.918162 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:08:10.918162 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:08:10.918162 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:08:10.918162 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:08:10.918162 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:08:10.918162 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8385348f-0651-486d-9b4a-2c884933edb1 could not be found. Aug 10 23:08:10.918162 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:08:10.918162 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:08:10.918162 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:08:10.918162 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:08:10.918162 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:08:10.918162 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:08:10.918162 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:08:10.918162 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:08:10.918162 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:08:10.920843 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:08:10.920843 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:08:10.920843 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:08:10.920843 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:08:10.920843 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:08:10.920843 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:08:10.920843 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:08:10.920843 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8385348f-0651-486d-9b4a-2c884933edb1 could not be found. Aug 10 23:08:10.920843 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:08:10.920843 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:08:10.920843 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:08:10.920843 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:08:10.920843 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:08:10.920843 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:08:10.920843 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:08:10.920843 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:08:10.920843 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8385348f-0651-486d-9b4a-2c884933edb1 could not be found. Aug 10 23:08:10.920843 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:08:10.923519 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1418/2779] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:08:10 2022] GET /compute/v2.1/servers/3aa229ba-7292-41ee-922a-32c281be9f42 => generated 1504 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:08:10.933830 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-b22b846d-474d-499e-b1b0-271b45ad0d8a tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] Returning 404 to user: Instance 8385348f-0651-486d-9b4a-2c884933edb1 could not be found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:08:10.934362 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-b22b846d-474d-499e-b1b0-271b45ad0d8a tempest-ServersAdmin275Test-1076532606 tempest-ServersAdmin275Test-1076532606-project] 10.222.0.58 "GET /compute/v2.1/servers/8385348f-0651-486d-9b4a-2c884933edb1" status: 404 len: 111 microversion: 2.75 time: 0.090770 Aug 10 23:08:10.935451 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-5b0ff396-111e-4342-a65a-acec5df8bb2b tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:08:10.936849 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-5b0ff396-111e-4342-a65a-acec5df8bb2b tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] [instance: eea0fab7-447d-4f5f-8577-6ef8df500499] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:08:10.949632 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1362/2780] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:08:10 2022] GET /compute/v2.1/servers/8385348f-0651-486d-9b4a-2c884933edb1 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 10 23:08:10.952286 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5b0ff396-111e-4342-a65a-acec5df8bb2b tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:10.952895 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5b0ff396-111e-4342-a65a-acec5df8bb2b tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:10.953434 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5b0ff396-111e-4342-a65a-acec5df8bb2b tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:10.954251 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5b0ff396-111e-4342-a65a-acec5df8bb2b tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:10.954845 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5b0ff396-111e-4342-a65a-acec5df8bb2b tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:10.955503 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5b0ff396-111e-4342-a65a-acec5df8bb2b tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:10.961429 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-a8df7304-3b6e-40e2-8b4a-2a76ffbb6913 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:08:10.971975 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-a8df7304-3b6e-40e2-8b4a-2a76ffbb6913 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] [instance: 3aa229ba-7292-41ee-922a-32c281be9f42] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:08:11.001893 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a8df7304-3b6e-40e2-8b4a-2a76ffbb6913 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:11.004605 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a8df7304-3b6e-40e2-8b4a-2a76ffbb6913 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:11.006152 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a8df7304-3b6e-40e2-8b4a-2a76ffbb6913 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:11.011810 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a8df7304-3b6e-40e2-8b4a-2a76ffbb6913 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:11.012527 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a8df7304-3b6e-40e2-8b4a-2a76ffbb6913 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:11.014028 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a8df7304-3b6e-40e2-8b4a-2a76ffbb6913 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:11.266299 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-a8df7304-3b6e-40e2-8b4a-2a76ffbb6913 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] 10.222.0.58 "PUT /compute/v2.1/servers/3aa229ba-7292-41ee-922a-32c281be9f42" status: 200 len: 1080 microversion: 2.1 time: 0.315393 Aug 10 23:08:11.281132 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1363/2781] 10.222.0.58 () {60 vars in 1256 bytes} [Wed Aug 10 23:08:10 2022] PUT /compute/v2.1/servers/3aa229ba-7292-41ee-922a-32c281be9f42 => generated 1080 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:08:11.299712 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-166e5dfb-3873-454e-aded-87298706c744 tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Calling method '.version_select at 0x7f847d024670>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:08:11.399913 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-166e5dfb-3873-454e-aded-87298706c744 tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] 10.222.0.58 "GET /compute/v2.1/images/6331cdd3-d79a-4aa4-8575-f401a3c11d5b" status: 200 len: 1427 microversion: 2.1 time: 0.116853 Aug 10 23:08:11.400504 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1364/2782] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 10 23:08:11 2022] GET /compute/v2.1/images/6331cdd3-d79a-4aa4-8575-f401a3c11d5b => generated 1427 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:08:11.431245 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-65d23675-4a4a-4d27-a982-851f458e746a tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:08:11.432374 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-65d23675-4a4a-4d27-a982-851f458e746a tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] [instance: 3aa229ba-7292-41ee-922a-32c281be9f42] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:08:11.445055 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-65d23675-4a4a-4d27-a982-851f458e746a tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:11.448283 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-65d23675-4a4a-4d27-a982-851f458e746a tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:11.451620 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-65d23675-4a4a-4d27-a982-851f458e746a tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:11.453021 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-65d23675-4a4a-4d27-a982-851f458e746a tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:11.456530 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-65d23675-4a4a-4d27-a982-851f458e746a tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:11.457159 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-65d23675-4a4a-4d27-a982-851f458e746a tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:11.487405 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-5b0ff396-111e-4342-a65a-acec5df8bb2b tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bbb4f184e4409d9eed51e0b98dfb29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708f8d4c4ed6432d85e0bf6a9bac7677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:08:11.505121 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-5b0ff396-111e-4342-a65a-acec5df8bb2b tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] 10.222.0.58 "GET /compute/v2.1/servers/eea0fab7-447d-4f5f-8577-6ef8df500499" status: 200 len: 1521 microversion: 2.1 time: 0.584134 Aug 10 23:08:11.508108 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1419/2783] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:08:10 2022] GET /compute/v2.1/servers/eea0fab7-447d-4f5f-8577-6ef8df500499 => generated 1521 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:08:11.542447 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-e7faa3e2-46ec-48a5-bb84-5976b8208ee3 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:08:11.543113 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-e7faa3e2-46ec-48a5-bb84-5976b8208ee3 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] [instance: 325d9b10-716d-4961-91d1-70962403fef4] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:08:11.564301 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e7faa3e2-46ec-48a5-bb84-5976b8208ee3 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:11.565445 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e7faa3e2-46ec-48a5-bb84-5976b8208ee3 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:11.566543 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e7faa3e2-46ec-48a5-bb84-5976b8208ee3 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:11.568831 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e7faa3e2-46ec-48a5-bb84-5976b8208ee3 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:11.569599 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e7faa3e2-46ec-48a5-bb84-5976b8208ee3 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:11.570698 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e7faa3e2-46ec-48a5-bb84-5976b8208ee3 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:11.834947 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-e7faa3e2-46ec-48a5-bb84-5976b8208ee3 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84e70c3ea5347e79ba5aee661b15ce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ab3ad5c0ef448aaa1282112bf20d83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:08:11.844451 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-e7faa3e2-46ec-48a5-bb84-5976b8208ee3 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] 10.222.0.58 "GET /compute/v2.1/servers/325d9b10-716d-4961-91d1-70962403fef4" status: 200 len: 1322 microversion: 2.1 time: 0.335027 Aug 10 23:08:11.847529 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1420/2784] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:08:11 2022] GET /compute/v2.1/servers/325d9b10-716d-4961-91d1-70962403fef4 => generated 1322 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:08:11.859781 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-f1928e41-2e70-4165-8667-09fed31853bc req-76188fa7-b631-4ae7-8b26-eab57d2425b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45beadf1-a6da-49ab-9098-6b681b5184c9", "name": "network-vif-deleted", "tag": "896d850e-4103-42f9-83bc-43f3e82924c2"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:08:11.894492 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-f1928e41-2e70-4165-8667-09fed31853bc req-76188fa7-b631-4ae7-8b26-eab57d2425b2 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:11.895039 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-f1928e41-2e70-4165-8667-09fed31853bc req-76188fa7-b631-4ae7-8b26-eab57d2425b2 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:11.898694 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-f1928e41-2e70-4165-8667-09fed31853bc req-76188fa7-b631-4ae7-8b26-eab57d2425b2 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:11.935026 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-f1928e41-2e70-4165-8667-09fed31853bc req-76188fa7-b631-4ae7-8b26-eab57d2425b2 service nova] Creating event network-vif-deleted:896d850e-4103-42f9-83bc-43f3e82924c2 for instance 45beadf1-a6da-49ab-9098-6b681b5184c9 on n-h2-850468-14 Aug 10 23:08:11.948676 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-f1928e41-2e70-4165-8667-09fed31853bc req-76188fa7-b631-4ae7-8b26-eab57d2425b2 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096789 Aug 10 23:08:11.949811 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1421/2785] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:08:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:08:11.967948 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-09a14f10-6d38-4436-aa6f-f97edb5d1390 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:08:11.968688 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-09a14f10-6d38-4436-aa6f-f97edb5d1390 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] [instance: eea0fab7-447d-4f5f-8577-6ef8df500499] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:08:11.981784 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-09a14f10-6d38-4436-aa6f-f97edb5d1390 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:11.984613 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-09a14f10-6d38-4436-aa6f-f97edb5d1390 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:11.985100 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-09a14f10-6d38-4436-aa6f-f97edb5d1390 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:11.988036 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-09a14f10-6d38-4436-aa6f-f97edb5d1390 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:11.988699 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-09a14f10-6d38-4436-aa6f-f97edb5d1390 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:11.989318 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-09a14f10-6d38-4436-aa6f-f97edb5d1390 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:12.165431 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-65d23675-4a4a-4d27-a982-851f458e746a tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8899e278c9453fba0ab05c69b0b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46ac8b84bd649fa88897068dbfa5ce6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:08:12.186454 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-65d23675-4a4a-4d27-a982-851f458e746a tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] 10.222.0.58 "GET /compute/v2.1/servers/3aa229ba-7292-41ee-922a-32c281be9f42" status: 200 len: 1506 microversion: 2.1 time: 0.782387 Aug 10 23:08:12.187098 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1365/2786] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:08:11 2022] GET /compute/v2.1/servers/3aa229ba-7292-41ee-922a-32c281be9f42 => generated 1506 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:08:12.195570 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c23a4aeb-b3a8-4583-b6d5-f7afcff6cf15 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:08:12.196615 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-c23a4aeb-b3a8-4583-b6d5-f7afcff6cf15 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] [instance: 45beadf1-a6da-49ab-9098-6b681b5184c9] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:08:12.240774 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c23a4aeb-b3a8-4583-b6d5-f7afcff6cf15 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:12.244229 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c23a4aeb-b3a8-4583-b6d5-f7afcff6cf15 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:12.245207 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c23a4aeb-b3a8-4583-b6d5-f7afcff6cf15 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:12.246317 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c23a4aeb-b3a8-4583-b6d5-f7afcff6cf15 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:12.247034 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c23a4aeb-b3a8-4583-b6d5-f7afcff6cf15 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:12.247633 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c23a4aeb-b3a8-4583-b6d5-f7afcff6cf15 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:12.268655 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-c23a4aeb-b3a8-4583-b6d5-f7afcff6cf15 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] HTTP exception thrown: Instance 45beadf1-a6da-49ab-9098-6b681b5184c9 could not be found. Aug 10 23:08:12.271234 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c23a4aeb-b3a8-4583-b6d5-f7afcff6cf15 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Request method failure captured: Aug 10 23:08:12.271234 n-d-850468-14 devstack@n-api.service[122632]: request: GET /compute/v2.1/servers/45beadf1-a6da-49ab-9098-6b681b5184c9 HTTP/1.1 Aug 10 23:08:12.271234 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:08:12.271234 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:08:12.271234 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:08:12.271234 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 23:08:12.271234 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:08:12.271234 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:08:12.271234 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:08:12.271234 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:08:12.271234 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9DmBy_JTguncOh9GuBIMdYZxG9QUzBcwS_jXLGnjofrI-W_OX3R4Z5OuE0_icCyDrzKcQZCM5mI0mwZFV2C4_1i2WC483s7WfSWQg7_GotxoNsO0toS_K-yBXFY5hprgonzQ2ZZHnMvRhJYwAQ2SxIHPRTlL0QU-O2cMGZhSWdLxsL0 Aug 10 23:08:12.271234 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:08:12.271234 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:08:12.271234 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:08:12.271234 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:08:12.271234 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:08:12.271234 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:08:12.271234 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 597863bfebdc481188f1f30095da5396 Aug 10 23:08:12.271234 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-AttachVolumeTestJSON-1086920881 Aug 10 23:08:12.271234 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:08:12.271234 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:08:12.272536 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/597863bfebdc481188f1f30095da5396"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/597863bfebdc481188f1f30095da5396"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/597863bfebdc481188f1f30095da5396"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_597863bfebdc481188f1f30095da5396", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:08:12.272536 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-AttachVolumeTestJSON-1086920881 Aug 10 23:08:12.272536 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 597863bfebdc481188f1f30095da5396 Aug 10 23:08:12.272536 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1086920881 Aug 10 23:08:12.272536 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-AttachVolumeTestJSON-1086920881-project Aug 10 23:08:12.272536 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:08:12.272536 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:08:12.272536 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: a1986185dc9b4df4affcc421365462f7 Aug 10 23:08:12.272536 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-AttachVolumeTestJSON-1086920881-project Aug 10 23:08:12.272536 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:08:12.272536 n-d-850468-14 devstack@n-api.service[122632]: exception: Instance 45beadf1-a6da-49ab-9098-6b681b5184c9 could not be found. Aug 10 23:08:12.272536 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': '45beadf1-a6da-49ab-9098-6b681b5184c9'} Aug 10 23:08:12.274194 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:08:12.274194 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:08:12.274194 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:08:12.274194 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:08:12.274194 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:08:12.274194 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:08:12.274194 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:08:12.274194 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:08:12.274194 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:08:12.274194 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:08:12.274194 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45beadf1-a6da-49ab-9098-6b681b5184c9 could not be found. Aug 10 23:08:12.274194 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:08:12.274194 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:08:12.274194 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:08:12.274194 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:08:12.274194 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:08:12.274194 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:08:12.274194 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:08:12.274194 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:08:12.274194 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:08:12.278885 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:08:12.278885 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:08:12.278885 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:08:12.278885 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:08:12.278885 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:08:12.278885 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:08:12.278885 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:08:12.278885 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45beadf1-a6da-49ab-9098-6b681b5184c9 could not be found. Aug 10 23:08:12.278885 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:08:12.278885 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:08:12.278885 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:08:12.278885 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:08:12.278885 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:08:12.278885 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:08:12.278885 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:08:12.278885 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:08:12.278885 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45beadf1-a6da-49ab-9098-6b681b5184c9 could not be found. Aug 10 23:08:12.278885 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:08:12.283240 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c23a4aeb-b3a8-4583-b6d5-f7afcff6cf15 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Returning 404 to user: Instance 45beadf1-a6da-49ab-9098-6b681b5184c9 could not be found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:08:12.284443 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-c23a4aeb-b3a8-4583-b6d5-f7afcff6cf15 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] 10.222.0.58 "GET /compute/v2.1/servers/45beadf1-a6da-49ab-9098-6b681b5184c9" status: 404 len: 111 microversion: 2.1 time: 0.096304 Aug 10 23:08:12.286036 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1366/2787] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:08:12 2022] GET /compute/v2.1/servers/45beadf1-a6da-49ab-9098-6b681b5184c9 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:08:12.291783 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-b78e0b62-4abc-4640-a9a2-c9cea9d073b0 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:08:12.293498 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-b78e0b62-4abc-4640-a9a2-c9cea9d073b0 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] [instance: 3aa229ba-7292-41ee-922a-32c281be9f42] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:08:12.301378 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b78e0b62-4abc-4640-a9a2-c9cea9d073b0 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:12.302354 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b78e0b62-4abc-4640-a9a2-c9cea9d073b0 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:12.302841 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b78e0b62-4abc-4640-a9a2-c9cea9d073b0 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:12.305019 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b78e0b62-4abc-4640-a9a2-c9cea9d073b0 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:12.305797 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b78e0b62-4abc-4640-a9a2-c9cea9d073b0 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:12.306294 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b78e0b62-4abc-4640-a9a2-c9cea9d073b0 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:12.598164 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-09a14f10-6d38-4436-aa6f-f97edb5d1390 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bbb4f184e4409d9eed51e0b98dfb29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708f8d4c4ed6432d85e0bf6a9bac7677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:08:12.610233 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-09a14f10-6d38-4436-aa6f-f97edb5d1390 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] 10.222.0.58 "GET /compute/v2.1/servers/eea0fab7-447d-4f5f-8577-6ef8df500499" status: 200 len: 1521 microversion: 2.1 time: 0.659104 Aug 10 23:08:12.623813 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1422/2788] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:08:11 2022] GET /compute/v2.1/servers/eea0fab7-447d-4f5f-8577-6ef8df500499 => generated 1521 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:08:12.623813 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c4e38f05-7568-47f0-87ff-21d488f896b6 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Calling method '.version_select at 0x7f847c514c10>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:08:12.676947 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-c4e38f05-7568-47f0-87ff-21d488f896b6 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-938102435" status: 202 len: 0 microversion: 2.1 time: 0.064676 Aug 10 23:08:12.677561 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1423/2789] 10.222.0.58 () {58 vars in 1218 bytes} [Wed Aug 10 23:08:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-938102435 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:08:12.688265 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-e42da141-8081-45f1-ae35-e05ba39ef0c0 tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Calling method '.version_select at 0x7f847c4d40d0>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:08:12.805883 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-e42da141-8081-45f1-ae35-e05ba39ef0c0 tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] 10.222.0.58 "GET /compute/v2.1/images/6331cdd3-d79a-4aa4-8575-f401a3c11d5b" status: 200 len: 1427 microversion: 2.1 time: 0.123836 Aug 10 23:08:12.816115 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1424/2790] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 10 23:08:12 2022] GET /compute/v2.1/images/6331cdd3-d79a-4aa4-8575-f401a3c11d5b => generated 1427 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:08:12.825202 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-b78e0b62-4abc-4640-a9a2-c9cea9d073b0 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8899e278c9453fba0ab05c69b0b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46ac8b84bd649fa88897068dbfa5ce6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:08:12.829284 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-1004dd5a-b8ea-4512-9628-9e56147fdefb tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-778871573"}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:08:12.831671 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-1004dd5a-b8ea-4512-9628-9e56147fdefb tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] [instance: eea0fab7-447d-4f5f-8577-6ef8df500499] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:08:12.837783 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-b78e0b62-4abc-4640-a9a2-c9cea9d073b0 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] 10.222.0.58 "GET /compute/v2.1/servers/3aa229ba-7292-41ee-922a-32c281be9f42" status: 200 len: 1506 microversion: 2.1 time: 0.550467 Aug 10 23:08:12.840561 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1367/2791] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:08:12 2022] GET /compute/v2.1/servers/3aa229ba-7292-41ee-922a-32c281be9f42 => generated 1506 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:08:12.856573 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1004dd5a-b8ea-4512-9628-9e56147fdefb tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:12.857094 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1004dd5a-b8ea-4512-9628-9e56147fdefb tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:12.857535 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1004dd5a-b8ea-4512-9628-9e56147fdefb tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:12.858255 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1004dd5a-b8ea-4512-9628-9e56147fdefb tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:12.858710 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1004dd5a-b8ea-4512-9628-9e56147fdefb tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:12.859356 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1004dd5a-b8ea-4512-9628-9e56147fdefb tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:12.860683 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-7fb569af-3cc9-4104-8e75-43f1ee5824ab tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:08:12.862775 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-7fb569af-3cc9-4104-8e75-43f1ee5824ab tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] [instance: 3aa229ba-7292-41ee-922a-32c281be9f42] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:08:12.881393 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7fb569af-3cc9-4104-8e75-43f1ee5824ab tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:12.883884 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7fb569af-3cc9-4104-8e75-43f1ee5824ab tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:12.884238 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7fb569af-3cc9-4104-8e75-43f1ee5824ab tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:12.886286 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7fb569af-3cc9-4104-8e75-43f1ee5824ab tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:12.888176 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7fb569af-3cc9-4104-8e75-43f1ee5824ab tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:12.888911 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7fb569af-3cc9-4104-8e75-43f1ee5824ab tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:12.951505 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-7fb569af-3cc9-4104-8e75-43f1ee5824ab tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] [instance: 3aa229ba-7292-41ee-922a-32c281be9f42] Going to try to terminate instance {{(pid=122632) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:08:13.079467 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-7fb569af-3cc9-4104-8e75-43f1ee5824ab tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] 10.222.0.58 "DELETE /compute/v2.1/servers/3aa229ba-7292-41ee-922a-32c281be9f42" status: 204 len: 0 microversion: 2.1 time: 0.222148 Aug 10 23:08:13.080810 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1368/2792] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:08:12 2022] DELETE /compute/v2.1/servers/3aa229ba-7292-41ee-922a-32c281be9f42 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 10 23:08:13.089169 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-751065a4-6d7e-4aaa-8278-a80052ea4542 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:08:13.090393 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-751065a4-6d7e-4aaa-8278-a80052ea4542 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] [instance: 325d9b10-716d-4961-91d1-70962403fef4] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:08:13.103736 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-751065a4-6d7e-4aaa-8278-a80052ea4542 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:13.105589 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-751065a4-6d7e-4aaa-8278-a80052ea4542 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:13.106249 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-751065a4-6d7e-4aaa-8278-a80052ea4542 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:13.107221 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-751065a4-6d7e-4aaa-8278-a80052ea4542 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:13.107843 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-751065a4-6d7e-4aaa-8278-a80052ea4542 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:13.108517 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-751065a4-6d7e-4aaa-8278-a80052ea4542 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:13.297460 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-1004dd5a-b8ea-4512-9628-9e56147fdefb tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] 10.222.0.58 "POST /compute/v2.1/servers/eea0fab7-447d-4f5f-8577-6ef8df500499/action" status: 202 len: 0 microversion: 2.1 time: 0.480031 Aug 10 23:08:13.299152 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1425/2793] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:08:12 2022] POST /compute/v2.1/servers/eea0fab7-447d-4f5f-8577-6ef8df500499/action => generated 0 bytes in 482 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 10 23:08:13.315905 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-ba423cae-82fd-4832-b2ea-fbe7fd303a77 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:08:13.318132 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-ba423cae-82fd-4832-b2ea-fbe7fd303a77 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] [instance: 3aa229ba-7292-41ee-922a-32c281be9f42] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:08:13.332641 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ba423cae-82fd-4832-b2ea-fbe7fd303a77 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:13.333399 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ba423cae-82fd-4832-b2ea-fbe7fd303a77 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:13.335311 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ba423cae-82fd-4832-b2ea-fbe7fd303a77 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:13.336389 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ba423cae-82fd-4832-b2ea-fbe7fd303a77 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:13.337755 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ba423cae-82fd-4832-b2ea-fbe7fd303a77 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:13.339040 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ba423cae-82fd-4832-b2ea-fbe7fd303a77 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:13.395617 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-ba423cae-82fd-4832-b2ea-fbe7fd303a77 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] [instance: 3aa229ba-7292-41ee-922a-32c281be9f42] Going to try to terminate instance {{(pid=122633) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:08:13.446216 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-751065a4-6d7e-4aaa-8278-a80052ea4542 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84e70c3ea5347e79ba5aee661b15ce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ab3ad5c0ef448aaa1282112bf20d83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:08:13.456430 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-751065a4-6d7e-4aaa-8278-a80052ea4542 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] 10.222.0.58 "GET /compute/v2.1/servers/325d9b10-716d-4961-91d1-70962403fef4" status: 200 len: 1322 microversion: 2.1 time: 0.373928 Aug 10 23:08:13.457032 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1369/2794] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:08:13 2022] GET /compute/v2.1/servers/325d9b10-716d-4961-91d1-70962403fef4 => generated 1322 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:08:13.501452 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.compute.api [None req-ba423cae-82fd-4832-b2ea-fbe7fd303a77 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] [instance: 3aa229ba-7292-41ee-922a-32c281be9f42] Instance is already in deleting state, ignoring this request Aug 10 23:08:13.502458 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-ba423cae-82fd-4832-b2ea-fbe7fd303a77 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] 10.222.0.58 "DELETE /compute/v2.1/servers/3aa229ba-7292-41ee-922a-32c281be9f42" status: 204 len: 0 microversion: 2.1 time: 0.202017 Aug 10 23:08:13.503594 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1426/2795] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:08:13 2022] DELETE /compute/v2.1/servers/3aa229ba-7292-41ee-922a-32c281be9f42 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:08:13.508912 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-859e78cd-a15a-4f1d-86c6-a512085d269b tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1571135070"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:08:13.515832 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-859e78cd-a15a-4f1d-86c6-a512085d269b tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] [instance: eea0fab7-447d-4f5f-8577-6ef8df500499] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:08:13.533816 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-b8d9c472-cb31-4e0a-a86a-bfe68460f275 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:08:13.534652 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-b8d9c472-cb31-4e0a-a86a-bfe68460f275 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] [instance: 3aa229ba-7292-41ee-922a-32c281be9f42] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:08:13.555371 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b8d9c472-cb31-4e0a-a86a-bfe68460f275 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:13.559729 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b8d9c472-cb31-4e0a-a86a-bfe68460f275 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:13.560389 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b8d9c472-cb31-4e0a-a86a-bfe68460f275 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:13.561284 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b8d9c472-cb31-4e0a-a86a-bfe68460f275 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:13.564719 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b8d9c472-cb31-4e0a-a86a-bfe68460f275 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:13.565607 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-859e78cd-a15a-4f1d-86c6-a512085d269b tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:13.565846 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b8d9c472-cb31-4e0a-a86a-bfe68460f275 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:13.578503 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-859e78cd-a15a-4f1d-86c6-a512085d269b tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:13.581423 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-859e78cd-a15a-4f1d-86c6-a512085d269b tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:13.586629 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-859e78cd-a15a-4f1d-86c6-a512085d269b tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:13.588458 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-859e78cd-a15a-4f1d-86c6-a512085d269b tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:13.596012 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-859e78cd-a15a-4f1d-86c6-a512085d269b tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:13.666335 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=2 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:08:13.713413 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=6 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:08:13.727490 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-859e78cd-a15a-4f1d-86c6-a512085d269b tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] HTTP exception thrown: Cannot 'createImage' instance eea0fab7-447d-4f5f-8577-6ef8df500499 while it is in task_state image_snapshot Aug 10 23:08:13.732121 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-859e78cd-a15a-4f1d-86c6-a512085d269b tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Request method failure captured: Aug 10 23:08:13.732121 n-d-850468-14 devstack@n-api.service[122632]: request: POST /compute/v2.1/servers/eea0fab7-447d-4f5f-8577-6ef8df500499/action HTTP/1.1 Aug 10 23:08:13.732121 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:08:13.732121 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:08:13.732121 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:08:13.732121 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 85 Aug 10 23:08:13.732121 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:08:13.732121 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:08:13.732121 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:08:13.732121 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:08:13.732121 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9Do81XwGOyJYZzjDqBUm67v_Q0362_4xQUvU3HvIWmFkKXGTToH86-ip4fxXuu0oxmkucX-Et277q0Z5R4ChTe5MWC8zJ89hWAklZmH6m-N_CAseQK0eUiUfLbiJpjdB2S78hj0EntCCqH4mBVhce2-q9auCyId7qlhsdrU7MIxxCSQ Aug 10 23:08:13.732121 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:08:13.732121 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:08:13.732121 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:08:13.732121 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:08:13.732121 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:08:13.732121 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:08:13.732121 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 708f8d4c4ed6432d85e0bf6a9bac7677 Aug 10 23:08:13.732121 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2080454436 Aug 10 23:08:13.732121 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:08:13.732121 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:08:13.733464 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/708f8d4c4ed6432d85e0bf6a9bac7677"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/708f8d4c4ed6432d85e0bf6a9bac7677"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/708f8d4c4ed6432d85e0bf6a9bac7677"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_708f8d4c4ed6432d85e0bf6a9bac7677", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:08:13.733464 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2080454436 Aug 10 23:08:13.733464 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 708f8d4c4ed6432d85e0bf6a9bac7677 Aug 10 23:08:13.733464 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2080454436 Aug 10 23:08:13.733464 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-ImagesOneServerNegativeTestJSON-2080454436-project Aug 10 23:08:13.733464 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:08:13.733464 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:08:13.733464 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: 55bbb4f184e4409d9eed51e0b98dfb29 Aug 10 23:08:13.733464 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2080454436-project Aug 10 23:08:13.733464 n-d-850468-14 devstack@n-api.service[122632]: Aug 10 23:08:13.733464 n-d-850468-14 devstack@n-api.service[122632]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1571135070"}} Aug 10 23:08:13.733464 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:08:13.734206 n-d-850468-14 devstack@n-api.service[122632]: exception: Cannot 'createImage' instance eea0fab7-447d-4f5f-8577-6ef8df500499 while it is in task_state image_snapshot Aug 10 23:08:13.734206 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': 'eea0fab7-447d-4f5f-8577-6ef8df500499', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1571135070'}}} Aug 10 23:08:13.734206 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:08:13.734206 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:08:13.734206 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1346, in _action_create_image Aug 10 23:08:13.734206 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Aug 10 23:08:13.734206 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 152, in inner Aug 10 23:08:13.734206 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 10 23:08:13.734206 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance eea0fab7-447d-4f5f-8577-6ef8df500499 in task_state image_snapshot. Cannot snapshot while the instance is in this state. Aug 10 23:08:13.734206 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:08:13.734206 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:08:13.734206 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:08:13.734206 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:08:13.734206 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:08:13.734206 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:08:13.734206 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:08:13.734206 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:08:13.734206 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:08:13.734206 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:08:13.735649 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 23:08:13.735649 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 23:08:13.735649 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 23:08:13.735649 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 23:08:13.735649 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1351, in _action_create_image Aug 10 23:08:13.735649 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 10 23:08:13.735649 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 10 23:08:13.735649 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 10 23:08:13.735649 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance eea0fab7-447d-4f5f-8577-6ef8df500499 while it is in task_state image_snapshot Aug 10 23:08:13.735649 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:08:13.735649 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:08:13.735649 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:08:13.735649 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:08:13.735649 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:08:13.735649 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:08:13.735649 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:08:13.735649 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:08:13.735649 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance eea0fab7-447d-4f5f-8577-6ef8df500499 while it is in task_state image_snapshot Aug 10 23:08:13.735649 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:08:13.738288 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-859e78cd-a15a-4f1d-86c6-a512085d269b tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Returning 409 to user: Cannot 'createImage' instance eea0fab7-447d-4f5f-8577-6ef8df500499 while it is in task_state image_snapshot {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:08:13.739629 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-859e78cd-a15a-4f1d-86c6-a512085d269b tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] 10.222.0.58 "POST /compute/v2.1/servers/eea0fab7-447d-4f5f-8577-6ef8df500499/action" status: 409 len: 159 microversion: 2.1 time: 0.252272 Aug 10 23:08:13.746323 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1370/2796] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:08:13 2022] POST /compute/v2.1/servers/eea0fab7-447d-4f5f-8577-6ef8df500499/action => generated 159 bytes in 289 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 10 23:08:13.754398 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-e4222922-3f58-41fe-94f7-3289960f6ab5 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Calling method '.version_select at 0x7f847d206160>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:08:14.016466 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-b8d9c472-cb31-4e0a-a86a-bfe68460f275 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8899e278c9453fba0ab05c69b0b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46ac8b84bd649fa88897068dbfa5ce6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:08:14.025107 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-b8d9c472-cb31-4e0a-a86a-bfe68460f275 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] 10.222.0.58 "GET /compute/v2.1/servers/3aa229ba-7292-41ee-922a-32c281be9f42" status: 200 len: 1512 microversion: 2.1 time: 0.517587 Aug 10 23:08:14.040737 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1427/2797] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:08:13 2022] GET /compute/v2.1/servers/3aa229ba-7292-41ee-922a-32c281be9f42 => generated 1512 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:08:14.053910 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-02a26ae8-5591-4176-b655-d3d57fe4f6b6 tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Calling method '.version_select at 0x7f847c5b4790>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:08:14.072796 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=2 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:08:14.077600 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-e4222922-3f58-41fe-94f7-3289960f6ab5 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] 10.222.0.58 "DELETE /compute/v2.1/images/6beb2bde-6a03-437a-8d45-324201eed3e3" status: 204 len: 0 microversion: 2.1 time: 0.327108 Aug 10 23:08:14.078734 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1371/2798] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:08:13 2022] DELETE /compute/v2.1/images/6beb2bde-6a03-437a-8d45-324201eed3e3 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:08:14.087760 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c6ebd65e-9210-4110-831a-a669aad99fce tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:08:14.088910 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-c6ebd65e-9210-4110-831a-a669aad99fce tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] [instance: eea0fab7-447d-4f5f-8577-6ef8df500499] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:08:14.097165 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c6ebd65e-9210-4110-831a-a669aad99fce tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:14.109838 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c6ebd65e-9210-4110-831a-a669aad99fce tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:14.110371 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c6ebd65e-9210-4110-831a-a669aad99fce tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:14.111488 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c6ebd65e-9210-4110-831a-a669aad99fce tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:14.112017 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c6ebd65e-9210-4110-831a-a669aad99fce tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:14.112514 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c6ebd65e-9210-4110-831a-a669aad99fce tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:14.153112 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-02a26ae8-5591-4176-b655-d3d57fe4f6b6 tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] 10.222.0.58 "GET /compute/v2.1/images/6331cdd3-d79a-4aa4-8575-f401a3c11d5b" status: 200 len: 1427 microversion: 2.1 time: 0.108651 Aug 10 23:08:14.157093 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1428/2799] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 10 23:08:14 2022] GET /compute/v2.1/images/6331cdd3-d79a-4aa4-8575-f401a3c11d5b => generated 1427 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:08:14.169680 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:08:14.478630 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-9b4c76d2-e66e-4abb-992a-35bdb15aaf6d tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:08:14.479264 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-9b4c76d2-e66e-4abb-992a-35bdb15aaf6d tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] [instance: 325d9b10-716d-4961-91d1-70962403fef4] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:08:14.496628 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9b4c76d2-e66e-4abb-992a-35bdb15aaf6d tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:14.497971 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9b4c76d2-e66e-4abb-992a-35bdb15aaf6d tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:14.499579 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9b4c76d2-e66e-4abb-992a-35bdb15aaf6d tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:14.501508 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9b4c76d2-e66e-4abb-992a-35bdb15aaf6d tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:14.502992 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9b4c76d2-e66e-4abb-992a-35bdb15aaf6d tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:14.506068 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9b4c76d2-e66e-4abb-992a-35bdb15aaf6d tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:14.739133 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-c6ebd65e-9210-4110-831a-a669aad99fce tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bbb4f184e4409d9eed51e0b98dfb29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708f8d4c4ed6432d85e0bf6a9bac7677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:08:14.761759 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-c6ebd65e-9210-4110-831a-a669aad99fce tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] 10.222.0.58 "GET /compute/v2.1/servers/eea0fab7-447d-4f5f-8577-6ef8df500499" status: 200 len: 1533 microversion: 2.1 time: 0.667530 Aug 10 23:08:14.761759 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1372/2800] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:08:14 2022] GET /compute/v2.1/servers/eea0fab7-447d-4f5f-8577-6ef8df500499 => generated 1533 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:08:15.063818 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-685ce6a1-cb23-45c2-8743-8aa989884693 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:08:15.064451 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-685ce6a1-cb23-45c2-8743-8aa989884693 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] [instance: 3aa229ba-7292-41ee-922a-32c281be9f42] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:08:15.089768 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-685ce6a1-cb23-45c2-8743-8aa989884693 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:15.090264 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-685ce6a1-cb23-45c2-8743-8aa989884693 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:15.090698 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-685ce6a1-cb23-45c2-8743-8aa989884693 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:15.091425 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-685ce6a1-cb23-45c2-8743-8aa989884693 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:15.092045 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-685ce6a1-cb23-45c2-8743-8aa989884693 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:15.092616 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-685ce6a1-cb23-45c2-8743-8aa989884693 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:15.390441 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-685ce6a1-cb23-45c2-8743-8aa989884693 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8899e278c9453fba0ab05c69b0b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46ac8b84bd649fa88897068dbfa5ce6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:08:15.405703 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-685ce6a1-cb23-45c2-8743-8aa989884693 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] 10.222.0.58 "GET /compute/v2.1/servers/3aa229ba-7292-41ee-922a-32c281be9f42" status: 200 len: 1512 microversion: 2.1 time: 0.344218 Aug 10 23:08:15.406544 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1373/2801] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:08:15 2022] GET /compute/v2.1/servers/3aa229ba-7292-41ee-922a-32c281be9f42 => generated 1512 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:08:15.437237 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-ba950dc0-69ab-4888-9cb8-ae6f6dc8cba1 tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Calling method '.version_select at 0x7f847d24b4c0>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:08:15.437492 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-9b4c76d2-e66e-4abb-992a-35bdb15aaf6d tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84e70c3ea5347e79ba5aee661b15ce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ab3ad5c0ef448aaa1282112bf20d83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:08:15.457708 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-9b4c76d2-e66e-4abb-992a-35bdb15aaf6d tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] 10.222.0.58 "GET /compute/v2.1/servers/325d9b10-716d-4961-91d1-70962403fef4" status: 200 len: 1322 microversion: 2.1 time: 0.981505 Aug 10 23:08:15.461111 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1429/2802] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:08:14 2022] GET /compute/v2.1/servers/325d9b10-716d-4961-91d1-70962403fef4 => generated 1322 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:08:15.471808 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-a80add98-c138-4f25-b2f8-4011940e6f8b tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Action: 'create', calling method: .version_select at 0x7f847c4fcaf0>, body: {"keypair": {"name": "tempest-keypair-280954451", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGooe40P5gmR+Gp4Qj/b3TAiVXNG7AOVb+niiuwiiRM9u0oNUT0vn4kIpWVLmHgdkClxmon3gPlJOpbr+I0Z0T5ZMoEraZJFiZRik6wVkkgKNWJ/z7HE2D+eLT+UKHscOA=="}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:08:15.484199 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:08:15.499271 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-a80add98-c138-4f25-b2f8-4011940e6f8b tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Getting quotas for project 597863bfebdc481188f1f30095da5396. Resources: {'key_pairs'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:08:15.509526 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-a80add98-c138-4f25-b2f8-4011940e6f8b tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Getting quotas for user a1986185dc9b4df4affcc421365462f7 and project 597863bfebdc481188f1f30095da5396. Resources: {'key_pairs'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:08:15.577258 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-ba950dc0-69ab-4888-9cb8-ae6f6dc8cba1 tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] 10.222.0.58 "GET /compute/v2.1/images/6331cdd3-d79a-4aa4-8575-f401a3c11d5b" status: 200 len: 1427 microversion: 2.1 time: 0.157155 Aug 10 23:08:15.586939 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1374/2803] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 10 23:08:15 2022] GET /compute/v2.1/images/6331cdd3-d79a-4aa4-8575-f401a3c11d5b => generated 1427 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:08:15.593575 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-a80add98-c138-4f25-b2f8-4011940e6f8b tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.130863 Aug 10 23:08:15.595172 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1430/2804] 10.222.0.58 () {60 vars in 1159 bytes} [Wed Aug 10 23:08:15 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:08:15.599755 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-d5b49e5c-f3f0-46fc-afbf-66913a5bd061 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:08:15.600265 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-d5b49e5c-f3f0-46fc-afbf-66913a5bd061 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] [instance: 6fe68649-0e9b-4059-afb6-cc44844ff476] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:08:15.619918 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d5b49e5c-f3f0-46fc-afbf-66913a5bd061 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:15.620714 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d5b49e5c-f3f0-46fc-afbf-66913a5bd061 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:15.621333 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d5b49e5c-f3f0-46fc-afbf-66913a5bd061 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:15.622242 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d5b49e5c-f3f0-46fc-afbf-66913a5bd061 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:15.623032 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d5b49e5c-f3f0-46fc-afbf-66913a5bd061 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:15.623775 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d5b49e5c-f3f0-46fc-afbf-66913a5bd061 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:15.657060 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-d5b49e5c-f3f0-46fc-afbf-66913a5bd061 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] HTTP exception thrown: Instance 6fe68649-0e9b-4059-afb6-cc44844ff476 could not be found. Aug 10 23:08:15.661637 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-d5b49e5c-f3f0-46fc-afbf-66913a5bd061 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Request method failure captured: Aug 10 23:08:15.661637 n-d-850468-14 devstack@n-api.service[122632]: request: DELETE /compute/v2.1/servers/6fe68649-0e9b-4059-afb6-cc44844ff476 HTTP/1.1 Aug 10 23:08:15.661637 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:08:15.661637 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:08:15.661637 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:08:15.661637 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 23:08:15.661637 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:08:15.661637 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:08:15.661637 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:08:15.661637 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:08:15.661637 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9Dnr9qhH8qABr6sGOY8du1SR95rfOClj5ZCkR3wuQSMMB2bcRJmBsw1RKG_rSrVIE8iV42HRXRAxetZmHBzbgzrG_Gv5lN5xvGD0xpsgMpj8ytwRnm7P1y5XfrOqCJhIe4RvCam6acWmEXW2e4PykLV39ynUh-_MtUn4NTKXON0FxOM Aug 10 23:08:15.661637 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:08:15.661637 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:08:15.661637 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:08:15.661637 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:08:15.661637 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:08:15.661637 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:08:15.661637 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: c6473e36eada44e6bca8dc568e5ee330 Aug 10 23:08:15.661637 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-ServersTestMultiNic-1647590367 Aug 10 23:08:15.661637 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:08:15.661637 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:08:15.663339 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c6473e36eada44e6bca8dc568e5ee330"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c6473e36eada44e6bca8dc568e5ee330"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/c6473e36eada44e6bca8dc568e5ee330"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_c6473e36eada44e6bca8dc568e5ee330", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:08:15.663339 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-ServersTestMultiNic-1647590367 Aug 10 23:08:15.663339 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: c6473e36eada44e6bca8dc568e5ee330 Aug 10 23:08:15.663339 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-ServersTestMultiNic-1647590367 Aug 10 23:08:15.663339 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-ServersTestMultiNic-1647590367-project Aug 10 23:08:15.663339 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:08:15.663339 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:08:15.663339 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: a1c6e1f505b8409ea38f8a07bad870a8 Aug 10 23:08:15.663339 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-ServersTestMultiNic-1647590367-project Aug 10 23:08:15.663339 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:08:15.663339 n-d-850468-14 devstack@n-api.service[122632]: exception: Instance 6fe68649-0e9b-4059-afb6-cc44844ff476 could not be found. Aug 10 23:08:15.663339 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': '6fe68649-0e9b-4059-afb6-cc44844ff476'} Aug 10 23:08:15.664656 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:08:15.664656 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:08:15.664656 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:08:15.664656 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:08:15.664656 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:08:15.664656 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:08:15.664656 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:08:15.664656 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:08:15.664656 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:08:15.664656 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:08:15.664656 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6fe68649-0e9b-4059-afb6-cc44844ff476 could not be found. Aug 10 23:08:15.664656 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:08:15.664656 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:08:15.664656 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:08:15.664656 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:08:15.664656 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:08:15.664656 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:08:15.664656 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:08:15.664656 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:08:15.664656 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:08:15.667093 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:08:15.667093 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 23:08:15.667093 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 23:08:15.667093 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 23:08:15.667093 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 23:08:15.667093 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:08:15.667093 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:08:15.667093 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:08:15.667093 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:08:15.667093 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6fe68649-0e9b-4059-afb6-cc44844ff476 could not be found. Aug 10 23:08:15.667093 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:08:15.667093 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:08:15.667093 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:08:15.667093 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:08:15.667093 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:08:15.667093 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:08:15.667093 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:08:15.667093 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:08:15.667093 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6fe68649-0e9b-4059-afb6-cc44844ff476 could not be found. Aug 10 23:08:15.667093 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:08:15.687226 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-d5b49e5c-f3f0-46fc-afbf-66913a5bd061 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Returning 404 to user: Instance 6fe68649-0e9b-4059-afb6-cc44844ff476 could not be found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:08:15.690062 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-d5b49e5c-f3f0-46fc-afbf-66913a5bd061 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] 10.222.0.58 "DELETE /compute/v2.1/servers/6fe68649-0e9b-4059-afb6-cc44844ff476" status: 404 len: 111 microversion: 2.1 time: 0.095640 Aug 10 23:08:15.690930 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1375/2805] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:08:15 2022] DELETE /compute/v2.1/servers/6fe68649-0e9b-4059-afb6-cc44844ff476 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:08:15.701550 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-eb25c400-f23a-4fcb-8bff-7f652df05a5d tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:08:15.702557 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-eb25c400-f23a-4fcb-8bff-7f652df05a5d tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] [instance: 6fe68649-0e9b-4059-afb6-cc44844ff476] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:08:15.730723 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-eb25c400-f23a-4fcb-8bff-7f652df05a5d tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:15.733010 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-eb25c400-f23a-4fcb-8bff-7f652df05a5d tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:15.733630 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-eb25c400-f23a-4fcb-8bff-7f652df05a5d tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:15.734406 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-eb25c400-f23a-4fcb-8bff-7f652df05a5d tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:15.734898 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-eb25c400-f23a-4fcb-8bff-7f652df05a5d tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:15.735327 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-eb25c400-f23a-4fcb-8bff-7f652df05a5d tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:15.755994 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-eb25c400-f23a-4fcb-8bff-7f652df05a5d tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] HTTP exception thrown: Instance 6fe68649-0e9b-4059-afb6-cc44844ff476 could not be found. Aug 10 23:08:15.758736 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-eb25c400-f23a-4fcb-8bff-7f652df05a5d tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Request method failure captured: Aug 10 23:08:15.758736 n-d-850468-14 devstack@n-api.service[122633]: request: GET /compute/v2.1/servers/6fe68649-0e9b-4059-afb6-cc44844ff476 HTTP/1.1 Aug 10 23:08:15.758736 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:08:15.758736 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:08:15.758736 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:08:15.758736 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:08:15.758736 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:08:15.758736 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:08:15.758736 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:08:15.758736 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:08:15.758736 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9Dnr9qhH8qABr6sGOY8du1SR95rfOClj5ZCkR3wuQSMMB2bcRJmBsw1RKG_rSrVIE8iV42HRXRAxetZmHBzbgzrG_Gv5lN5xvGD0xpsgMpj8ytwRnm7P1y5XfrOqCJhIe4RvCam6acWmEXW2e4PykLV39ynUh-_MtUn4NTKXON0FxOM Aug 10 23:08:15.758736 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:08:15.758736 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:08:15.758736 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:08:15.758736 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:08:15.758736 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:08:15.758736 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:08:15.758736 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: c6473e36eada44e6bca8dc568e5ee330 Aug 10 23:08:15.758736 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-ServersTestMultiNic-1647590367 Aug 10 23:08:15.758736 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:08:15.758736 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:08:15.760483 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c6473e36eada44e6bca8dc568e5ee330"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c6473e36eada44e6bca8dc568e5ee330"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/c6473e36eada44e6bca8dc568e5ee330"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_c6473e36eada44e6bca8dc568e5ee330", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:08:15.760483 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-ServersTestMultiNic-1647590367 Aug 10 23:08:15.760483 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: c6473e36eada44e6bca8dc568e5ee330 Aug 10 23:08:15.760483 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-ServersTestMultiNic-1647590367 Aug 10 23:08:15.760483 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-ServersTestMultiNic-1647590367-project Aug 10 23:08:15.760483 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:08:15.760483 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:08:15.760483 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: a1c6e1f505b8409ea38f8a07bad870a8 Aug 10 23:08:15.760483 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-ServersTestMultiNic-1647590367-project Aug 10 23:08:15.760483 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:08:15.760483 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance 6fe68649-0e9b-4059-afb6-cc44844ff476 could not be found. Aug 10 23:08:15.760483 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': '6fe68649-0e9b-4059-afb6-cc44844ff476'} Aug 10 23:08:15.761319 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:08:15.761319 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:08:15.761319 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:08:15.761319 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:08:15.761319 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:08:15.761319 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:08:15.761319 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:08:15.761319 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:08:15.761319 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:08:15.761319 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:08:15.761319 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6fe68649-0e9b-4059-afb6-cc44844ff476 could not be found. Aug 10 23:08:15.761319 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:08:15.761319 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:08:15.761319 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:08:15.761319 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:08:15.761319 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:08:15.761319 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:08:15.761319 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:08:15.761319 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:08:15.761319 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:08:15.762750 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:08:15.762750 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:08:15.762750 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:08:15.762750 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:08:15.762750 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:08:15.762750 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:08:15.762750 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:08:15.762750 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6fe68649-0e9b-4059-afb6-cc44844ff476 could not be found. Aug 10 23:08:15.762750 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:08:15.762750 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:08:15.762750 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:08:15.762750 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:08:15.762750 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:08:15.762750 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:08:15.762750 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:08:15.762750 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:08:15.762750 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6fe68649-0e9b-4059-afb6-cc44844ff476 could not be found. Aug 10 23:08:15.762750 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:08:15.764035 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-eb25c400-f23a-4fcb-8bff-7f652df05a5d tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Returning 404 to user: Instance 6fe68649-0e9b-4059-afb6-cc44844ff476 could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:08:15.764035 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-eb25c400-f23a-4fcb-8bff-7f652df05a5d tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] 10.222.0.58 "GET /compute/v2.1/servers/6fe68649-0e9b-4059-afb6-cc44844ff476" status: 404 len: 111 microversion: 2.1 time: 0.065208 Aug 10 23:08:15.764035 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1431/2806] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:08:15 2022] GET /compute/v2.1/servers/6fe68649-0e9b-4059-afb6-cc44844ff476 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:08:15.777567 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-deaeadb8-44e6-4519-9d9a-430d75004b4c tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:08:15.779345 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-deaeadb8-44e6-4519-9d9a-430d75004b4c tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] [instance: 092f973f-79e3-44bf-a2e0-f7d3bfddf42c] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:08:15.826748 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-deaeadb8-44e6-4519-9d9a-430d75004b4c tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:15.829003 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-deaeadb8-44e6-4519-9d9a-430d75004b4c tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:15.829605 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-d1b10fcd-69e4-4eb2-8430-393ffa9dbaa6 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:08:15.833062 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-deaeadb8-44e6-4519-9d9a-430d75004b4c tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:15.833452 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-d1b10fcd-69e4-4eb2-8430-393ffa9dbaa6 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] [instance: eea0fab7-447d-4f5f-8577-6ef8df500499] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:08:15.838417 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-deaeadb8-44e6-4519-9d9a-430d75004b4c tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:15.840111 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-deaeadb8-44e6-4519-9d9a-430d75004b4c tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:15.843300 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-deaeadb8-44e6-4519-9d9a-430d75004b4c tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:15.858611 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d1b10fcd-69e4-4eb2-8430-393ffa9dbaa6 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:15.859361 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d1b10fcd-69e4-4eb2-8430-393ffa9dbaa6 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:15.860009 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d1b10fcd-69e4-4eb2-8430-393ffa9dbaa6 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:15.860945 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d1b10fcd-69e4-4eb2-8430-393ffa9dbaa6 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:15.861581 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d1b10fcd-69e4-4eb2-8430-393ffa9dbaa6 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:15.864815 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d1b10fcd-69e4-4eb2-8430-393ffa9dbaa6 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:15.947617 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-deaeadb8-44e6-4519-9d9a-430d75004b4c tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] HTTP exception thrown: Instance 092f973f-79e3-44bf-a2e0-f7d3bfddf42c could not be found. Aug 10 23:08:15.960189 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-deaeadb8-44e6-4519-9d9a-430d75004b4c tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Request method failure captured: Aug 10 23:08:15.960189 n-d-850468-14 devstack@n-api.service[122632]: request: DELETE /compute/v2.1/servers/092f973f-79e3-44bf-a2e0-f7d3bfddf42c HTTP/1.1 Aug 10 23:08:15.960189 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:08:15.960189 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:08:15.960189 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:08:15.960189 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 23:08:15.960189 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:08:15.960189 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:08:15.960189 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:08:15.960189 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:08:15.960189 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9Dnr9qhH8qABr6sGOY8du1SR95rfOClj5ZCkR3wuQSMMB2bcRJmBsw1RKG_rSrVIE8iV42HRXRAxetZmHBzbgzrG_Gv5lN5xvGD0xpsgMpj8ytwRnm7P1y5XfrOqCJhIe4RvCam6acWmEXW2e4PykLV39ynUh-_MtUn4NTKXON0FxOM Aug 10 23:08:15.960189 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:08:15.960189 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:08:15.960189 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:08:15.960189 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:08:15.960189 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:08:15.960189 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:08:15.960189 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: c6473e36eada44e6bca8dc568e5ee330 Aug 10 23:08:15.960189 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-ServersTestMultiNic-1647590367 Aug 10 23:08:15.960189 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:08:15.960189 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:08:15.961964 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c6473e36eada44e6bca8dc568e5ee330"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c6473e36eada44e6bca8dc568e5ee330"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/c6473e36eada44e6bca8dc568e5ee330"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_c6473e36eada44e6bca8dc568e5ee330", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:08:15.961964 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-ServersTestMultiNic-1647590367 Aug 10 23:08:15.961964 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: c6473e36eada44e6bca8dc568e5ee330 Aug 10 23:08:15.961964 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-ServersTestMultiNic-1647590367 Aug 10 23:08:15.961964 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-ServersTestMultiNic-1647590367-project Aug 10 23:08:15.961964 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:08:15.961964 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:08:15.961964 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: a1c6e1f505b8409ea38f8a07bad870a8 Aug 10 23:08:15.961964 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-ServersTestMultiNic-1647590367-project Aug 10 23:08:15.961964 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:08:15.961964 n-d-850468-14 devstack@n-api.service[122632]: exception: Instance 092f973f-79e3-44bf-a2e0-f7d3bfddf42c could not be found. Aug 10 23:08:15.961964 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': '092f973f-79e3-44bf-a2e0-f7d3bfddf42c'} Aug 10 23:08:15.962869 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:08:15.962869 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:08:15.962869 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:08:15.962869 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:08:15.962869 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:08:15.962869 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:08:15.962869 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:08:15.962869 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:08:15.962869 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:08:15.962869 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:08:15.962869 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 092f973f-79e3-44bf-a2e0-f7d3bfddf42c could not be found. Aug 10 23:08:15.962869 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:08:15.962869 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:08:15.962869 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:08:15.962869 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:08:15.962869 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:08:15.962869 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:08:15.962869 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:08:15.962869 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:08:15.962869 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:08:15.964341 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:08:15.964341 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 23:08:15.964341 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 23:08:15.964341 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 23:08:15.964341 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 23:08:15.964341 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:08:15.964341 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:08:15.964341 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:08:15.964341 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:08:15.964341 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 092f973f-79e3-44bf-a2e0-f7d3bfddf42c could not be found. Aug 10 23:08:15.964341 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:08:15.964341 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:08:15.964341 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:08:15.964341 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:08:15.964341 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:08:15.964341 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:08:15.964341 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:08:15.964341 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:08:15.964341 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 092f973f-79e3-44bf-a2e0-f7d3bfddf42c could not be found. Aug 10 23:08:15.964341 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:08:15.965684 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-deaeadb8-44e6-4519-9d9a-430d75004b4c tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Returning 404 to user: Instance 092f973f-79e3-44bf-a2e0-f7d3bfddf42c could not be found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:08:15.965684 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-deaeadb8-44e6-4519-9d9a-430d75004b4c tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] 10.222.0.58 "DELETE /compute/v2.1/servers/092f973f-79e3-44bf-a2e0-f7d3bfddf42c" status: 404 len: 111 microversion: 2.1 time: 0.196373 Aug 10 23:08:15.971199 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1376/2807] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:08:15 2022] DELETE /compute/v2.1/servers/092f973f-79e3-44bf-a2e0-f7d3bfddf42c => generated 111 bytes in 206 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:08:15.987564 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-32de3df0-7809-4c2d-aee4-73b101a17480 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:08:15.988437 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-32de3df0-7809-4c2d-aee4-73b101a17480 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] [instance: 092f973f-79e3-44bf-a2e0-f7d3bfddf42c] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:08:16.001678 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-32de3df0-7809-4c2d-aee4-73b101a17480 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:16.009883 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-32de3df0-7809-4c2d-aee4-73b101a17480 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:16.010557 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-32de3df0-7809-4c2d-aee4-73b101a17480 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:16.011565 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-32de3df0-7809-4c2d-aee4-73b101a17480 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:16.012275 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-32de3df0-7809-4c2d-aee4-73b101a17480 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:16.012831 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-32de3df0-7809-4c2d-aee4-73b101a17480 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:16.049387 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-32de3df0-7809-4c2d-aee4-73b101a17480 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] HTTP exception thrown: Instance 092f973f-79e3-44bf-a2e0-f7d3bfddf42c could not be found. Aug 10 23:08:16.055652 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-32de3df0-7809-4c2d-aee4-73b101a17480 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Request method failure captured: Aug 10 23:08:16.055652 n-d-850468-14 devstack@n-api.service[122632]: request: GET /compute/v2.1/servers/092f973f-79e3-44bf-a2e0-f7d3bfddf42c HTTP/1.1 Aug 10 23:08:16.055652 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:08:16.055652 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:08:16.055652 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:08:16.055652 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 23:08:16.055652 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:08:16.055652 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:08:16.055652 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:08:16.055652 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:08:16.055652 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9Dnr9qhH8qABr6sGOY8du1SR95rfOClj5ZCkR3wuQSMMB2bcRJmBsw1RKG_rSrVIE8iV42HRXRAxetZmHBzbgzrG_Gv5lN5xvGD0xpsgMpj8ytwRnm7P1y5XfrOqCJhIe4RvCam6acWmEXW2e4PykLV39ynUh-_MtUn4NTKXON0FxOM Aug 10 23:08:16.055652 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:08:16.055652 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:08:16.055652 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:08:16.055652 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:08:16.055652 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:08:16.055652 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:08:16.055652 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: c6473e36eada44e6bca8dc568e5ee330 Aug 10 23:08:16.055652 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-ServersTestMultiNic-1647590367 Aug 10 23:08:16.055652 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:08:16.055652 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:08:16.057322 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c6473e36eada44e6bca8dc568e5ee330"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c6473e36eada44e6bca8dc568e5ee330"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/c6473e36eada44e6bca8dc568e5ee330"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_c6473e36eada44e6bca8dc568e5ee330", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:08:16.057322 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-ServersTestMultiNic-1647590367 Aug 10 23:08:16.057322 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: c6473e36eada44e6bca8dc568e5ee330 Aug 10 23:08:16.057322 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-ServersTestMultiNic-1647590367 Aug 10 23:08:16.057322 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-ServersTestMultiNic-1647590367-project Aug 10 23:08:16.057322 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:08:16.057322 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:08:16.057322 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: a1c6e1f505b8409ea38f8a07bad870a8 Aug 10 23:08:16.057322 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-ServersTestMultiNic-1647590367-project Aug 10 23:08:16.057322 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:08:16.057322 n-d-850468-14 devstack@n-api.service[122632]: exception: Instance 092f973f-79e3-44bf-a2e0-f7d3bfddf42c could not be found. Aug 10 23:08:16.057322 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': '092f973f-79e3-44bf-a2e0-f7d3bfddf42c'} Aug 10 23:08:16.058289 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:08:16.058289 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:08:16.058289 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:08:16.058289 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:08:16.058289 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:08:16.058289 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:08:16.058289 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:08:16.058289 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:08:16.058289 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:08:16.058289 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:08:16.058289 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 092f973f-79e3-44bf-a2e0-f7d3bfddf42c could not be found. Aug 10 23:08:16.058289 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:08:16.058289 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:08:16.058289 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:08:16.058289 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:08:16.058289 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:08:16.058289 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:08:16.058289 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:08:16.058289 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:08:16.058289 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:08:16.059850 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:08:16.059850 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:08:16.059850 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:08:16.059850 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:08:16.059850 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:08:16.059850 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:08:16.059850 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:08:16.059850 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 092f973f-79e3-44bf-a2e0-f7d3bfddf42c could not be found. Aug 10 23:08:16.059850 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:08:16.059850 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:08:16.059850 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:08:16.059850 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:08:16.059850 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:08:16.059850 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:08:16.059850 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:08:16.059850 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:08:16.059850 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 092f973f-79e3-44bf-a2e0-f7d3bfddf42c could not be found. Aug 10 23:08:16.059850 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:08:16.062234 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-32de3df0-7809-4c2d-aee4-73b101a17480 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] Returning 404 to user: Instance 092f973f-79e3-44bf-a2e0-f7d3bfddf42c could not be found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:08:16.065093 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-32de3df0-7809-4c2d-aee4-73b101a17480 tempest-ServersTestMultiNic-1647590367 tempest-ServersTestMultiNic-1647590367-project] 10.222.0.58 "GET /compute/v2.1/servers/092f973f-79e3-44bf-a2e0-f7d3bfddf42c" status: 404 len: 111 microversion: 2.1 time: 0.089015 Aug 10 23:08:16.081555 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1377/2808] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:08:15 2022] GET /compute/v2.1/servers/092f973f-79e3-44bf-a2e0-f7d3bfddf42c => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:08:16.434396 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-580081e6-ab76-4e44-a7b7-6526d6bfd4eb tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:08:16.435382 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-580081e6-ab76-4e44-a7b7-6526d6bfd4eb tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] [instance: 3aa229ba-7292-41ee-922a-32c281be9f42] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:08:16.449604 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-580081e6-ab76-4e44-a7b7-6526d6bfd4eb tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:16.450105 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-580081e6-ab76-4e44-a7b7-6526d6bfd4eb tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:16.450581 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-580081e6-ab76-4e44-a7b7-6526d6bfd4eb tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:16.454604 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-580081e6-ab76-4e44-a7b7-6526d6bfd4eb tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:16.455130 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-580081e6-ab76-4e44-a7b7-6526d6bfd4eb tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:16.458179 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-580081e6-ab76-4e44-a7b7-6526d6bfd4eb tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:16.942073 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-d1b10fcd-69e4-4eb2-8430-393ffa9dbaa6 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bbb4f184e4409d9eed51e0b98dfb29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708f8d4c4ed6432d85e0bf6a9bac7677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:08:16.968203 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-d1b10fcd-69e4-4eb2-8430-393ffa9dbaa6 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] 10.222.0.58 "GET /compute/v2.1/servers/eea0fab7-447d-4f5f-8577-6ef8df500499" status: 200 len: 1539 microversion: 2.1 time: 1.175076 Aug 10 23:08:16.975744 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1432/2809] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:08:15 2022] GET /compute/v2.1/servers/eea0fab7-447d-4f5f-8577-6ef8df500499 => generated 1539 bytes in 1184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:08:16.993337 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-aca3bf35-b141-4965-9915-b763d4542ae0 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:08:16.993969 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-aca3bf35-b141-4965-9915-b763d4542ae0 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] [instance: 325d9b10-716d-4961-91d1-70962403fef4] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:08:17.015931 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-aca3bf35-b141-4965-9915-b763d4542ae0 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:17.018663 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-aca3bf35-b141-4965-9915-b763d4542ae0 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:17.019477 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-aca3bf35-b141-4965-9915-b763d4542ae0 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:17.020426 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-aca3bf35-b141-4965-9915-b763d4542ae0 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:17.025055 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-aca3bf35-b141-4965-9915-b763d4542ae0 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:17.025884 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-aca3bf35-b141-4965-9915-b763d4542ae0 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:17.239566 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-580081e6-ab76-4e44-a7b7-6526d6bfd4eb tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1b8899e278c9453fba0ab05c69b0b0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b46ac8b84bd649fa88897068dbfa5ce6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:08:17.251117 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-580081e6-ab76-4e44-a7b7-6526d6bfd4eb tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] 10.222.0.58 "GET /compute/v2.1/servers/3aa229ba-7292-41ee-922a-32c281be9f42" status: 200 len: 1470 microversion: 2.1 time: 0.825010 Aug 10 23:08:17.267437 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1378/2810] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:08:16 2022] GET /compute/v2.1/servers/3aa229ba-7292-41ee-922a-32c281be9f42 => generated 1470 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:08:17.274394 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-6c542e6e-c173-426b-9738-cbe270a6f302 tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Calling method '.version_select at 0x7f847d24ba60>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:08:17.390972 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-6c542e6e-c173-426b-9738-cbe270a6f302 tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] 10.222.0.58 "GET /compute/v2.1/images/6331cdd3-d79a-4aa4-8575-f401a3c11d5b" status: 200 len: 1427 microversion: 2.1 time: 0.124603 Aug 10 23:08:17.391953 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1379/2811] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 10 23:08:17 2022] GET /compute/v2.1/images/6331cdd3-d79a-4aa4-8575-f401a3c11d5b => generated 1427 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:08:17.396868 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-d0a83a4a-7be1-4a76-901a-c5097e8fa5fb req-6b7d7eee-8d23-4383-bf7e-6836c8dbe8c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3aa229ba-7292-41ee-922a-32c281be9f42", "name": "network-vif-deleted", "tag": "34dd8ab6-09ba-4c97-9c08-880d9b727e0e"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:08:17.427456 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-d0a83a4a-7be1-4a76-901a-c5097e8fa5fb req-6b7d7eee-8d23-4383-bf7e-6836c8dbe8c0 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:17.428734 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-d0a83a4a-7be1-4a76-901a-c5097e8fa5fb req-6b7d7eee-8d23-4383-bf7e-6836c8dbe8c0 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:17.430011 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-d0a83a4a-7be1-4a76-901a-c5097e8fa5fb req-6b7d7eee-8d23-4383-bf7e-6836c8dbe8c0 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:17.464328 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-d0a83a4a-7be1-4a76-901a-c5097e8fa5fb req-6b7d7eee-8d23-4383-bf7e-6836c8dbe8c0 service nova] Creating event network-vif-deleted:34dd8ab6-09ba-4c97-9c08-880d9b727e0e for instance 3aa229ba-7292-41ee-922a-32c281be9f42 on n-h2-850468-14 Aug 10 23:08:17.478564 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-d0a83a4a-7be1-4a76-901a-c5097e8fa5fb req-6b7d7eee-8d23-4383-bf7e-6836c8dbe8c0 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085002 Aug 10 23:08:17.480944 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1380/2812] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:08:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:08:17.488113 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-8c2e25a5-97a3-4df8-b225-9711a0645288 req-8cba4ff4-f67b-4771-9acf-f40bcd4224d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "325d9b10-716d-4961-91d1-70962403fef4", "name": "network-vif-plugged", "status": "completed", "tag": "636830f5-e8dd-4490-8875-671bd1ac26f5"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:08:17.534066 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-8c2e25a5-97a3-4df8-b225-9711a0645288 req-8cba4ff4-f67b-4771-9acf-f40bcd4224d8 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:17.534891 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-8c2e25a5-97a3-4df8-b225-9711a0645288 req-8cba4ff4-f67b-4771-9acf-f40bcd4224d8 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:17.535833 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-8c2e25a5-97a3-4df8-b225-9711a0645288 req-8cba4ff4-f67b-4771-9acf-f40bcd4224d8 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:17.551752 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-8c2e25a5-97a3-4df8-b225-9711a0645288 req-8cba4ff4-f67b-4771-9acf-f40bcd4224d8 service nova] Creating event network-vif-plugged:636830f5-e8dd-4490-8875-671bd1ac26f5 for instance 325d9b10-716d-4961-91d1-70962403fef4 on n-h1-850468-14 Aug 10 23:08:17.558432 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-8c2e25a5-97a3-4df8-b225-9711a0645288 req-8cba4ff4-f67b-4771-9acf-f40bcd4224d8 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074242 Aug 10 23:08:17.559769 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1381/2813] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:08:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:08:17.766598 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-aca3bf35-b141-4965-9915-b763d4542ae0 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84e70c3ea5347e79ba5aee661b15ce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ab3ad5c0ef448aaa1282112bf20d83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:08:17.784888 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-aca3bf35-b141-4965-9915-b763d4542ae0 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] 10.222.0.58 "GET /compute/v2.1/servers/325d9b10-716d-4961-91d1-70962403fef4" status: 200 len: 1322 microversion: 2.1 time: 0.804232 Aug 10 23:08:17.785747 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1433/2814] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:08:16 2022] GET /compute/v2.1/servers/325d9b10-716d-4961-91d1-70962403fef4 => generated 1322 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:08:17.991609 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-d8453f90-1a78-4a30-84e5-088112eaf8d9 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:08:17.992668 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-d8453f90-1a78-4a30-84e5-088112eaf8d9 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] [instance: eea0fab7-447d-4f5f-8577-6ef8df500499] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:08:18.013285 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d8453f90-1a78-4a30-84e5-088112eaf8d9 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:18.017851 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d8453f90-1a78-4a30-84e5-088112eaf8d9 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:18.020032 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d8453f90-1a78-4a30-84e5-088112eaf8d9 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:18.022314 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d8453f90-1a78-4a30-84e5-088112eaf8d9 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:18.023879 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d8453f90-1a78-4a30-84e5-088112eaf8d9 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:18.027872 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d8453f90-1a78-4a30-84e5-088112eaf8d9 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:18.279685 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-ccf002d4-0144-4911-a7c9-1db591e3cb06 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:08:18.280299 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-ccf002d4-0144-4911-a7c9-1db591e3cb06 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] [instance: 3aa229ba-7292-41ee-922a-32c281be9f42] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:08:18.292320 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ccf002d4-0144-4911-a7c9-1db591e3cb06 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:18.295455 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ccf002d4-0144-4911-a7c9-1db591e3cb06 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:18.295913 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ccf002d4-0144-4911-a7c9-1db591e3cb06 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:18.296660 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ccf002d4-0144-4911-a7c9-1db591e3cb06 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:18.297114 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ccf002d4-0144-4911-a7c9-1db591e3cb06 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:18.297557 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ccf002d4-0144-4911-a7c9-1db591e3cb06 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:18.335051 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-ccf002d4-0144-4911-a7c9-1db591e3cb06 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] HTTP exception thrown: Instance 3aa229ba-7292-41ee-922a-32c281be9f42 could not be found. Aug 10 23:08:18.336704 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-ccf002d4-0144-4911-a7c9-1db591e3cb06 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Request method failure captured: Aug 10 23:08:18.336704 n-d-850468-14 devstack@n-api.service[122633]: request: GET /compute/v2.1/servers/3aa229ba-7292-41ee-922a-32c281be9f42 HTTP/1.1 Aug 10 23:08:18.336704 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:08:18.336704 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:08:18.336704 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:08:18.336704 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:08:18.336704 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:08:18.336704 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:08:18.336704 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:08:18.336704 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:08:18.336704 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9DnC9vvEhUURgYEm81hY2Gus_rtCMkH0cQjEc4ZtctGNQ1hR03sPjshEPXVqg6ucHqmcFvKHQL7AuXvGT-CjDKMlj5PJuN8hybQjl1ccJhL3EKujjxHrVXI_TRk7wMlUB9nQxzMT96P9bfOiSyKuTtvVNlFzf4r0GWMl92eRcleeVlk Aug 10 23:08:18.336704 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:08:18.336704 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:08:18.336704 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:08:18.336704 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:08:18.336704 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:08:18.336704 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:08:18.336704 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: b46ac8b84bd649fa88897068dbfa5ce6 Aug 10 23:08:18.336704 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-ServerDiskConfigTestJSON-185566298 Aug 10 23:08:18.336704 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:08:18.336704 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:08:18.338301 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b46ac8b84bd649fa88897068dbfa5ce6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b46ac8b84bd649fa88897068dbfa5ce6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b46ac8b84bd649fa88897068dbfa5ce6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b46ac8b84bd649fa88897068dbfa5ce6", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:08:18.338301 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-ServerDiskConfigTestJSON-185566298 Aug 10 23:08:18.338301 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: b46ac8b84bd649fa88897068dbfa5ce6 Aug 10 23:08:18.338301 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-185566298 Aug 10 23:08:18.338301 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-ServerDiskConfigTestJSON-185566298-project Aug 10 23:08:18.338301 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:08:18.338301 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:08:18.338301 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 1b8899e278c9453fba0ab05c69b0b0b9 Aug 10 23:08:18.338301 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-ServerDiskConfigTestJSON-185566298-project Aug 10 23:08:18.338301 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:08:18.338301 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance 3aa229ba-7292-41ee-922a-32c281be9f42 could not be found. Aug 10 23:08:18.338301 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': '3aa229ba-7292-41ee-922a-32c281be9f42'} Aug 10 23:08:18.339274 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:08:18.339274 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:08:18.339274 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:08:18.339274 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:08:18.339274 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:08:18.339274 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:08:18.339274 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:08:18.339274 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:08:18.339274 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:08:18.339274 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:08:18.339274 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3aa229ba-7292-41ee-922a-32c281be9f42 could not be found. Aug 10 23:08:18.339274 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:08:18.339274 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:08:18.339274 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:08:18.339274 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:08:18.339274 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:08:18.339274 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:08:18.339274 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:08:18.339274 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:08:18.339274 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:08:18.340602 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:08:18.340602 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:08:18.340602 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:08:18.340602 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:08:18.340602 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:08:18.340602 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:08:18.340602 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:08:18.340602 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3aa229ba-7292-41ee-922a-32c281be9f42 could not be found. Aug 10 23:08:18.340602 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:08:18.340602 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:08:18.340602 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:08:18.340602 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:08:18.340602 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:08:18.340602 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:08:18.340602 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:08:18.340602 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:08:18.340602 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3aa229ba-7292-41ee-922a-32c281be9f42 could not be found. Aug 10 23:08:18.340602 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:08:18.342173 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-ccf002d4-0144-4911-a7c9-1db591e3cb06 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Returning 404 to user: Instance 3aa229ba-7292-41ee-922a-32c281be9f42 could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:08:18.342173 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-ccf002d4-0144-4911-a7c9-1db591e3cb06 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] 10.222.0.58 "GET /compute/v2.1/servers/3aa229ba-7292-41ee-922a-32c281be9f42" status: 404 len: 111 microversion: 2.1 time: 0.062358 Aug 10 23:08:18.350642 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1434/2815] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:08:18 2022] GET /compute/v2.1/servers/3aa229ba-7292-41ee-922a-32c281be9f42 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 10 23:08:18.356257 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-26b6e280-c9f1-4665-b2ee-852355560f25 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:08:18.356760 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-26b6e280-c9f1-4665-b2ee-852355560f25 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] [instance: 85c138c8-9302-453b-8dc1-8f0002d79f1a] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:08:18.372579 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-26b6e280-c9f1-4665-b2ee-852355560f25 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:18.373077 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-26b6e280-c9f1-4665-b2ee-852355560f25 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:18.373514 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-26b6e280-c9f1-4665-b2ee-852355560f25 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:18.375606 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-26b6e280-c9f1-4665-b2ee-852355560f25 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:18.378236 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-26b6e280-c9f1-4665-b2ee-852355560f25 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:18.378933 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-26b6e280-c9f1-4665-b2ee-852355560f25 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:18.406499 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-26b6e280-c9f1-4665-b2ee-852355560f25 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] HTTP exception thrown: Instance 85c138c8-9302-453b-8dc1-8f0002d79f1a could not be found. Aug 10 23:08:18.414164 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-26b6e280-c9f1-4665-b2ee-852355560f25 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Request method failure captured: Aug 10 23:08:18.414164 n-d-850468-14 devstack@n-api.service[122633]: request: DELETE /compute/v2.1/servers/85c138c8-9302-453b-8dc1-8f0002d79f1a HTTP/1.1 Aug 10 23:08:18.414164 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:08:18.414164 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:08:18.414164 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:08:18.414164 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:08:18.414164 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:08:18.414164 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:08:18.414164 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:08:18.414164 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:08:18.414164 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9DnC9vvEhUURgYEm81hY2Gus_rtCMkH0cQjEc4ZtctGNQ1hR03sPjshEPXVqg6ucHqmcFvKHQL7AuXvGT-CjDKMlj5PJuN8hybQjl1ccJhL3EKujjxHrVXI_TRk7wMlUB9nQxzMT96P9bfOiSyKuTtvVNlFzf4r0GWMl92eRcleeVlk Aug 10 23:08:18.414164 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:08:18.414164 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:08:18.414164 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:08:18.414164 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:08:18.414164 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:08:18.414164 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:08:18.414164 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: b46ac8b84bd649fa88897068dbfa5ce6 Aug 10 23:08:18.414164 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-ServerDiskConfigTestJSON-185566298 Aug 10 23:08:18.414164 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:08:18.414164 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:08:18.416109 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b46ac8b84bd649fa88897068dbfa5ce6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b46ac8b84bd649fa88897068dbfa5ce6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b46ac8b84bd649fa88897068dbfa5ce6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b46ac8b84bd649fa88897068dbfa5ce6", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:08:18.416109 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-ServerDiskConfigTestJSON-185566298 Aug 10 23:08:18.416109 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: b46ac8b84bd649fa88897068dbfa5ce6 Aug 10 23:08:18.416109 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-185566298 Aug 10 23:08:18.416109 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-ServerDiskConfigTestJSON-185566298-project Aug 10 23:08:18.416109 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:08:18.416109 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:08:18.416109 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 1b8899e278c9453fba0ab05c69b0b0b9 Aug 10 23:08:18.416109 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-ServerDiskConfigTestJSON-185566298-project Aug 10 23:08:18.416109 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:08:18.416109 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance 85c138c8-9302-453b-8dc1-8f0002d79f1a could not be found. Aug 10 23:08:18.416109 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': '85c138c8-9302-453b-8dc1-8f0002d79f1a'} Aug 10 23:08:18.417009 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:08:18.417009 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:08:18.417009 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:08:18.417009 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:08:18.417009 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:08:18.417009 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:08:18.417009 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:08:18.417009 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:08:18.417009 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:08:18.417009 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:08:18.417009 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85c138c8-9302-453b-8dc1-8f0002d79f1a could not be found. Aug 10 23:08:18.417009 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:08:18.417009 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:08:18.417009 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:08:18.417009 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:08:18.417009 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:08:18.417009 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:08:18.417009 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:08:18.417009 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:08:18.417009 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:08:18.418425 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:08:18.418425 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 23:08:18.418425 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 23:08:18.418425 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 23:08:18.418425 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 23:08:18.418425 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:08:18.418425 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:08:18.418425 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:08:18.418425 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:08:18.418425 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85c138c8-9302-453b-8dc1-8f0002d79f1a could not be found. Aug 10 23:08:18.418425 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:08:18.418425 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:08:18.418425 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:08:18.418425 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:08:18.418425 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:08:18.418425 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:08:18.418425 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:08:18.418425 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:08:18.418425 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85c138c8-9302-453b-8dc1-8f0002d79f1a could not be found. Aug 10 23:08:18.418425 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:08:18.419795 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-26b6e280-c9f1-4665-b2ee-852355560f25 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Returning 404 to user: Instance 85c138c8-9302-453b-8dc1-8f0002d79f1a could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:08:18.423251 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-26b6e280-c9f1-4665-b2ee-852355560f25 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] 10.222.0.58 "DELETE /compute/v2.1/servers/85c138c8-9302-453b-8dc1-8f0002d79f1a" status: 404 len: 111 microversion: 2.1 time: 0.062607 Aug 10 23:08:18.424008 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1435/2816] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:08:18 2022] DELETE /compute/v2.1/servers/85c138c8-9302-453b-8dc1-8f0002d79f1a => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:08:18.439427 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-8fad1ba2-9347-4e38-bdf6-fa6f5d6b3594 tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Calling method '.version_select at 0x7f847c4f14c0>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:08:18.534967 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-d8453f90-1a78-4a30-84e5-088112eaf8d9 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bbb4f184e4409d9eed51e0b98dfb29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708f8d4c4ed6432d85e0bf6a9bac7677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:08:18.547414 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-d8453f90-1a78-4a30-84e5-088112eaf8d9 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] 10.222.0.58 "GET /compute/v2.1/servers/eea0fab7-447d-4f5f-8577-6ef8df500499" status: 200 len: 1521 microversion: 2.1 time: 0.561171 Aug 10 23:08:18.550068 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1382/2817] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:08:17 2022] GET /compute/v2.1/servers/eea0fab7-447d-4f5f-8577-6ef8df500499 => generated 1521 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:08:18.564191 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-0b116841-059d-4e46-891e-23d4b4e02f64 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:08:18.565156 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-0b116841-059d-4e46-891e-23d4b4e02f64 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] [instance: 85c138c8-9302-453b-8dc1-8f0002d79f1a] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:08:18.576063 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0b116841-059d-4e46-891e-23d4b4e02f64 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:18.577890 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0b116841-059d-4e46-891e-23d4b4e02f64 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:18.578491 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0b116841-059d-4e46-891e-23d4b4e02f64 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:18.579545 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0b116841-059d-4e46-891e-23d4b4e02f64 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:18.580220 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0b116841-059d-4e46-891e-23d4b4e02f64 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:18.582199 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0b116841-059d-4e46-891e-23d4b4e02f64 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:18.612662 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-0b116841-059d-4e46-891e-23d4b4e02f64 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] HTTP exception thrown: Instance 85c138c8-9302-453b-8dc1-8f0002d79f1a could not be found. Aug 10 23:08:18.619108 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-0b116841-059d-4e46-891e-23d4b4e02f64 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Request method failure captured: Aug 10 23:08:18.619108 n-d-850468-14 devstack@n-api.service[122632]: request: GET /compute/v2.1/servers/85c138c8-9302-453b-8dc1-8f0002d79f1a HTTP/1.1 Aug 10 23:08:18.619108 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:08:18.619108 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:08:18.619108 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:08:18.619108 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 23:08:18.619108 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:08:18.619108 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:08:18.619108 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:08:18.619108 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:08:18.619108 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9DnC9vvEhUURgYEm81hY2Gus_rtCMkH0cQjEc4ZtctGNQ1hR03sPjshEPXVqg6ucHqmcFvKHQL7AuXvGT-CjDKMlj5PJuN8hybQjl1ccJhL3EKujjxHrVXI_TRk7wMlUB9nQxzMT96P9bfOiSyKuTtvVNlFzf4r0GWMl92eRcleeVlk Aug 10 23:08:18.619108 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:08:18.619108 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:08:18.619108 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:08:18.619108 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:08:18.619108 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:08:18.619108 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:08:18.619108 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: b46ac8b84bd649fa88897068dbfa5ce6 Aug 10 23:08:18.619108 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-ServerDiskConfigTestJSON-185566298 Aug 10 23:08:18.619108 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:08:18.619108 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:08:18.620699 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b46ac8b84bd649fa88897068dbfa5ce6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b46ac8b84bd649fa88897068dbfa5ce6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b46ac8b84bd649fa88897068dbfa5ce6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b46ac8b84bd649fa88897068dbfa5ce6", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:08:18.620699 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-ServerDiskConfigTestJSON-185566298 Aug 10 23:08:18.620699 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: b46ac8b84bd649fa88897068dbfa5ce6 Aug 10 23:08:18.620699 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-185566298 Aug 10 23:08:18.620699 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-ServerDiskConfigTestJSON-185566298-project Aug 10 23:08:18.620699 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:08:18.620699 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:08:18.620699 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: 1b8899e278c9453fba0ab05c69b0b0b9 Aug 10 23:08:18.620699 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-ServerDiskConfigTestJSON-185566298-project Aug 10 23:08:18.620699 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:08:18.620699 n-d-850468-14 devstack@n-api.service[122632]: exception: Instance 85c138c8-9302-453b-8dc1-8f0002d79f1a could not be found. Aug 10 23:08:18.620699 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': '85c138c8-9302-453b-8dc1-8f0002d79f1a'} Aug 10 23:08:18.621456 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:08:18.621456 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:08:18.621456 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:08:18.621456 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:08:18.621456 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:08:18.621456 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:08:18.621456 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:08:18.621456 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:08:18.621456 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:08:18.621456 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:08:18.621456 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85c138c8-9302-453b-8dc1-8f0002d79f1a could not be found. Aug 10 23:08:18.621456 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:08:18.621456 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:08:18.621456 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:08:18.621456 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:08:18.621456 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:08:18.621456 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:08:18.621456 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:08:18.621456 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:08:18.621456 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:08:18.622758 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:08:18.622758 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:08:18.622758 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:08:18.622758 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:08:18.622758 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:08:18.622758 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:08:18.622758 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:08:18.622758 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85c138c8-9302-453b-8dc1-8f0002d79f1a could not be found. Aug 10 23:08:18.622758 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:08:18.622758 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:08:18.622758 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:08:18.622758 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:08:18.622758 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:08:18.622758 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:08:18.622758 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:08:18.622758 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:08:18.622758 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85c138c8-9302-453b-8dc1-8f0002d79f1a could not be found. Aug 10 23:08:18.622758 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:08:18.626201 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-0b116841-059d-4e46-891e-23d4b4e02f64 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Returning 404 to user: Instance 85c138c8-9302-453b-8dc1-8f0002d79f1a could not be found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:08:18.629080 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-0b116841-059d-4e46-891e-23d4b4e02f64 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] 10.222.0.58 "GET /compute/v2.1/servers/85c138c8-9302-453b-8dc1-8f0002d79f1a" status: 404 len: 111 microversion: 2.1 time: 0.076411 Aug 10 23:08:18.632690 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1383/2818] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:08:18 2022] GET /compute/v2.1/servers/85c138c8-9302-453b-8dc1-8f0002d79f1a => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:08:18.647930 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-97167d73-0e61-4f31-9609-afdd0d2a1887 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:08:18.650937 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-97167d73-0e61-4f31-9609-afdd0d2a1887 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] [instance: eea0fab7-447d-4f5f-8577-6ef8df500499] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:08:18.670105 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-97167d73-0e61-4f31-9609-afdd0d2a1887 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:18.676602 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-97167d73-0e61-4f31-9609-afdd0d2a1887 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:18.677233 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-97167d73-0e61-4f31-9609-afdd0d2a1887 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:18.678928 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-97167d73-0e61-4f31-9609-afdd0d2a1887 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:18.679975 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-97167d73-0e61-4f31-9609-afdd0d2a1887 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:18.680601 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-97167d73-0e61-4f31-9609-afdd0d2a1887 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:18.732649 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-97167d73-0e61-4f31-9609-afdd0d2a1887 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] [instance: eea0fab7-447d-4f5f-8577-6ef8df500499] Going to try to terminate instance {{(pid=122632) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:08:18.762554 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-8fad1ba2-9347-4e38-bdf6-fa6f5d6b3594 tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] 10.222.0.58 "GET /compute/v2.1/images/6331cdd3-d79a-4aa4-8575-f401a3c11d5b" status: 200 len: 1427 microversion: 2.1 time: 0.334660 Aug 10 23:08:18.763902 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1436/2819] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 10 23:08:18 2022] GET /compute/v2.1/images/6331cdd3-d79a-4aa4-8575-f401a3c11d5b => generated 1427 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:08:18.778750 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-acb9e670-da36-4dd2-8064-de1a98cf8d45 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:08:18.779644 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-acb9e670-da36-4dd2-8064-de1a98cf8d45 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] [instance: 662fba38-a52c-464c-8448-bfe0a1d78dab] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:08:18.794637 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-acb9e670-da36-4dd2-8064-de1a98cf8d45 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:18.796056 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-acb9e670-da36-4dd2-8064-de1a98cf8d45 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:18.796749 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-acb9e670-da36-4dd2-8064-de1a98cf8d45 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:18.798120 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-acb9e670-da36-4dd2-8064-de1a98cf8d45 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:18.800016 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-acb9e670-da36-4dd2-8064-de1a98cf8d45 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:18.801232 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-acb9e670-da36-4dd2-8064-de1a98cf8d45 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:18.838572 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=96,nova_api:UPDATE=1 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:08:18.839285 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-acb9e670-da36-4dd2-8064-de1a98cf8d45 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] HTTP exception thrown: Instance 662fba38-a52c-464c-8448-bfe0a1d78dab could not be found. Aug 10 23:08:18.841196 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-acb9e670-da36-4dd2-8064-de1a98cf8d45 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Request method failure captured: Aug 10 23:08:18.841196 n-d-850468-14 devstack@n-api.service[122633]: request: DELETE /compute/v2.1/servers/662fba38-a52c-464c-8448-bfe0a1d78dab HTTP/1.1 Aug 10 23:08:18.841196 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:08:18.841196 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:08:18.841196 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:08:18.841196 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:08:18.841196 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:08:18.841196 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:08:18.841196 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:08:18.841196 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:08:18.841196 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9DnC9vvEhUURgYEm81hY2Gus_rtCMkH0cQjEc4ZtctGNQ1hR03sPjshEPXVqg6ucHqmcFvKHQL7AuXvGT-CjDKMlj5PJuN8hybQjl1ccJhL3EKujjxHrVXI_TRk7wMlUB9nQxzMT96P9bfOiSyKuTtvVNlFzf4r0GWMl92eRcleeVlk Aug 10 23:08:18.841196 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:08:18.841196 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:08:18.841196 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:08:18.841196 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:08:18.841196 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:08:18.841196 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:08:18.841196 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: b46ac8b84bd649fa88897068dbfa5ce6 Aug 10 23:08:18.841196 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-ServerDiskConfigTestJSON-185566298 Aug 10 23:08:18.841196 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:08:18.841196 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:08:18.842574 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b46ac8b84bd649fa88897068dbfa5ce6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b46ac8b84bd649fa88897068dbfa5ce6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b46ac8b84bd649fa88897068dbfa5ce6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b46ac8b84bd649fa88897068dbfa5ce6", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:08:18.842574 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-ServerDiskConfigTestJSON-185566298 Aug 10 23:08:18.842574 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: b46ac8b84bd649fa88897068dbfa5ce6 Aug 10 23:08:18.842574 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-185566298 Aug 10 23:08:18.842574 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-ServerDiskConfigTestJSON-185566298-project Aug 10 23:08:18.842574 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:08:18.842574 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:08:18.842574 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 1b8899e278c9453fba0ab05c69b0b0b9 Aug 10 23:08:18.842574 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-ServerDiskConfigTestJSON-185566298-project Aug 10 23:08:18.842574 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:08:18.842574 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance 662fba38-a52c-464c-8448-bfe0a1d78dab could not be found. Aug 10 23:08:18.842574 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': '662fba38-a52c-464c-8448-bfe0a1d78dab'} Aug 10 23:08:18.843464 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:08:18.843464 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:08:18.843464 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:08:18.843464 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:08:18.843464 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:08:18.843464 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:08:18.843464 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:08:18.843464 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:08:18.843464 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:08:18.843464 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:08:18.843464 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 662fba38-a52c-464c-8448-bfe0a1d78dab could not be found. Aug 10 23:08:18.843464 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:08:18.843464 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:08:18.843464 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:08:18.843464 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:08:18.843464 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:08:18.843464 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:08:18.843464 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:08:18.843464 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:08:18.843464 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:08:18.844697 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:08:18.844697 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 23:08:18.844697 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 23:08:18.844697 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 23:08:18.844697 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 23:08:18.844697 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:08:18.844697 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:08:18.844697 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:08:18.844697 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:08:18.844697 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 662fba38-a52c-464c-8448-bfe0a1d78dab could not be found. Aug 10 23:08:18.844697 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:08:18.844697 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:08:18.844697 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:08:18.844697 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:08:18.844697 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:08:18.844697 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:08:18.844697 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:08:18.844697 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:08:18.844697 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 662fba38-a52c-464c-8448-bfe0a1d78dab could not be found. Aug 10 23:08:18.844697 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:08:18.849358 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-acb9e670-da36-4dd2-8064-de1a98cf8d45 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Returning 404 to user: Instance 662fba38-a52c-464c-8448-bfe0a1d78dab could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:08:18.851884 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-acb9e670-da36-4dd2-8064-de1a98cf8d45 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] 10.222.0.58 "DELETE /compute/v2.1/servers/662fba38-a52c-464c-8448-bfe0a1d78dab" status: 404 len: 111 microversion: 2.1 time: 0.085829 Aug 10 23:08:18.857476 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1437/2820] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:08:18 2022] DELETE /compute/v2.1/servers/662fba38-a52c-464c-8448-bfe0a1d78dab => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:08:18.864412 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-97167d73-0e61-4f31-9609-afdd0d2a1887 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] 10.222.0.58 "DELETE /compute/v2.1/servers/eea0fab7-447d-4f5f-8577-6ef8df500499" status: 204 len: 0 microversion: 2.1 time: 0.230081 Aug 10 23:08:18.869184 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-5b023b0a-f960-4965-9614-5738bdf896a6 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:08:18.869298 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1384/2821] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:08:18 2022] DELETE /compute/v2.1/servers/eea0fab7-447d-4f5f-8577-6ef8df500499 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:08:18.870650 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-5b023b0a-f960-4965-9614-5738bdf896a6 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] [instance: 325d9b10-716d-4961-91d1-70962403fef4] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:08:18.876070 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-122dbc5f-ba64-4778-8a47-3dbfcf0c3bc2 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:08:18.876844 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-122dbc5f-ba64-4778-8a47-3dbfcf0c3bc2 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] [instance: 662fba38-a52c-464c-8448-bfe0a1d78dab] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:08:18.883935 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-122dbc5f-ba64-4778-8a47-3dbfcf0c3bc2 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:18.884432 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-122dbc5f-ba64-4778-8a47-3dbfcf0c3bc2 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:18.884980 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-122dbc5f-ba64-4778-8a47-3dbfcf0c3bc2 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:18.886188 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-122dbc5f-ba64-4778-8a47-3dbfcf0c3bc2 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:18.886813 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-122dbc5f-ba64-4778-8a47-3dbfcf0c3bc2 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:18.887387 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-122dbc5f-ba64-4778-8a47-3dbfcf0c3bc2 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:18.889815 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5b023b0a-f960-4965-9614-5738bdf896a6 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:18.890906 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5b023b0a-f960-4965-9614-5738bdf896a6 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:18.891744 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5b023b0a-f960-4965-9614-5738bdf896a6 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:18.892665 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5b023b0a-f960-4965-9614-5738bdf896a6 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:18.893305 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5b023b0a-f960-4965-9614-5738bdf896a6 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:18.893920 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5b023b0a-f960-4965-9614-5738bdf896a6 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:18.904311 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-122dbc5f-ba64-4778-8a47-3dbfcf0c3bc2 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] HTTP exception thrown: Instance 662fba38-a52c-464c-8448-bfe0a1d78dab could not be found. Aug 10 23:08:18.905957 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-122dbc5f-ba64-4778-8a47-3dbfcf0c3bc2 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Request method failure captured: Aug 10 23:08:18.905957 n-d-850468-14 devstack@n-api.service[122632]: request: GET /compute/v2.1/servers/662fba38-a52c-464c-8448-bfe0a1d78dab HTTP/1.1 Aug 10 23:08:18.905957 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:08:18.905957 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:08:18.905957 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:08:18.905957 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 23:08:18.905957 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:08:18.905957 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:08:18.905957 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:08:18.905957 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:08:18.905957 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9DnC9vvEhUURgYEm81hY2Gus_rtCMkH0cQjEc4ZtctGNQ1hR03sPjshEPXVqg6ucHqmcFvKHQL7AuXvGT-CjDKMlj5PJuN8hybQjl1ccJhL3EKujjxHrVXI_TRk7wMlUB9nQxzMT96P9bfOiSyKuTtvVNlFzf4r0GWMl92eRcleeVlk Aug 10 23:08:18.905957 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:08:18.905957 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:08:18.905957 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:08:18.905957 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:08:18.905957 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:08:18.905957 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:08:18.905957 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: b46ac8b84bd649fa88897068dbfa5ce6 Aug 10 23:08:18.905957 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-ServerDiskConfigTestJSON-185566298 Aug 10 23:08:18.905957 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:08:18.905957 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:08:18.907305 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b46ac8b84bd649fa88897068dbfa5ce6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b46ac8b84bd649fa88897068dbfa5ce6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b46ac8b84bd649fa88897068dbfa5ce6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b46ac8b84bd649fa88897068dbfa5ce6", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:08:18.907305 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-ServerDiskConfigTestJSON-185566298 Aug 10 23:08:18.907305 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: b46ac8b84bd649fa88897068dbfa5ce6 Aug 10 23:08:18.907305 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-185566298 Aug 10 23:08:18.907305 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-ServerDiskConfigTestJSON-185566298-project Aug 10 23:08:18.907305 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:08:18.907305 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:08:18.907305 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: 1b8899e278c9453fba0ab05c69b0b0b9 Aug 10 23:08:18.907305 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-ServerDiskConfigTestJSON-185566298-project Aug 10 23:08:18.907305 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:08:18.907305 n-d-850468-14 devstack@n-api.service[122632]: exception: Instance 662fba38-a52c-464c-8448-bfe0a1d78dab could not be found. Aug 10 23:08:18.907305 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': '662fba38-a52c-464c-8448-bfe0a1d78dab'} Aug 10 23:08:18.908063 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:08:18.908063 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:08:18.908063 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:08:18.908063 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:08:18.908063 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:08:18.908063 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:08:18.908063 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:08:18.908063 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:08:18.908063 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:08:18.908063 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:08:18.908063 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 662fba38-a52c-464c-8448-bfe0a1d78dab could not be found. Aug 10 23:08:18.908063 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:08:18.908063 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:08:18.908063 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:08:18.908063 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:08:18.908063 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:08:18.908063 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:08:18.908063 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:08:18.908063 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:08:18.908063 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:08:18.909248 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:08:18.909248 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:08:18.909248 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:08:18.909248 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:08:18.909248 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:08:18.909248 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:08:18.909248 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:08:18.909248 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 662fba38-a52c-464c-8448-bfe0a1d78dab could not be found. Aug 10 23:08:18.909248 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:08:18.909248 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:08:18.909248 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:08:18.909248 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:08:18.909248 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:08:18.909248 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:08:18.909248 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:08:18.909248 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:08:18.909248 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 662fba38-a52c-464c-8448-bfe0a1d78dab could not be found. Aug 10 23:08:18.909248 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:08:18.912098 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-122dbc5f-ba64-4778-8a47-3dbfcf0c3bc2 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] Returning 404 to user: Instance 662fba38-a52c-464c-8448-bfe0a1d78dab could not be found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:08:18.912098 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-122dbc5f-ba64-4778-8a47-3dbfcf0c3bc2 tempest-ServerDiskConfigTestJSON-185566298 tempest-ServerDiskConfigTestJSON-185566298-project] 10.222.0.58 "GET /compute/v2.1/servers/662fba38-a52c-464c-8448-bfe0a1d78dab" status: 404 len: 111 microversion: 2.1 time: 0.036954 Aug 10 23:08:18.929868 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1385/2822] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:08:18 2022] GET /compute/v2.1/servers/662fba38-a52c-464c-8448-bfe0a1d78dab => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:08:18.941783 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-6eb213de-de6e-4d2c-8f71-c8b3193712a1 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:08:18.942422 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-6eb213de-de6e-4d2c-8f71-c8b3193712a1 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] [instance: eea0fab7-447d-4f5f-8577-6ef8df500499] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:08:18.968963 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6eb213de-de6e-4d2c-8f71-c8b3193712a1 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:18.969463 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6eb213de-de6e-4d2c-8f71-c8b3193712a1 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:18.969905 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6eb213de-de6e-4d2c-8f71-c8b3193712a1 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:18.974044 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6eb213de-de6e-4d2c-8f71-c8b3193712a1 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:18.975087 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6eb213de-de6e-4d2c-8f71-c8b3193712a1 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:18.975517 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6eb213de-de6e-4d2c-8f71-c8b3193712a1 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:19.267095 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-5b023b0a-f960-4965-9614-5738bdf896a6 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84e70c3ea5347e79ba5aee661b15ce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ab3ad5c0ef448aaa1282112bf20d83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:08:19.281199 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-5b023b0a-f960-4965-9614-5738bdf896a6 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] 10.222.0.58 "GET /compute/v2.1/servers/325d9b10-716d-4961-91d1-70962403fef4" status: 200 len: 1322 microversion: 2.1 time: 0.419860 Aug 10 23:08:19.285310 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1438/2823] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:08:18 2022] GET /compute/v2.1/servers/325d9b10-716d-4961-91d1-70962403fef4 => generated 1322 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:08:19.628944 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-edd53590-7440-422e-b120-0aafe0d7eb0c req-beba2883-07f8-4755-b152-31254fb1d882 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a632bb08-327b-4870-9f4e-90f8d0d863d0", "name": "network-vif-plugged", "status": "completed", "tag": "c03a409d-cb49-445d-9fc1-ff05f4b1ff2b"}, {"server_uuid": "eea0fab7-447d-4f5f-8577-6ef8df500499", "name": "network-vif-plugged", "status": "completed", "tag": "c28daca8-af14-4727-818b-5bb0398c4dc4"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:08:19.689235 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-edd53590-7440-422e-b120-0aafe0d7eb0c req-beba2883-07f8-4755-b152-31254fb1d882 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:19.690855 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-edd53590-7440-422e-b120-0aafe0d7eb0c req-beba2883-07f8-4755-b152-31254fb1d882 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:19.691529 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-edd53590-7440-422e-b120-0aafe0d7eb0c req-beba2883-07f8-4755-b152-31254fb1d882 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:19.723208 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-edd53590-7440-422e-b120-0aafe0d7eb0c req-beba2883-07f8-4755-b152-31254fb1d882 service nova] Creating event network-vif-plugged:c03a409d-cb49-445d-9fc1-ff05f4b1ff2b for instance a632bb08-327b-4870-9f4e-90f8d0d863d0 on n-h1-850468-14 Aug 10 23:08:19.724064 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-edd53590-7440-422e-b120-0aafe0d7eb0c req-beba2883-07f8-4755-b152-31254fb1d882 service nova] Creating event network-vif-plugged:c28daca8-af14-4727-818b-5bb0398c4dc4 for instance eea0fab7-447d-4f5f-8577-6ef8df500499 on n-h1-850468-14 Aug 10 23:08:19.740778 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-edd53590-7440-422e-b120-0aafe0d7eb0c req-beba2883-07f8-4755-b152-31254fb1d882 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.112217 Aug 10 23:08:19.746712 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1439/2824] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:08:19 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Aug 10 23:08:19.748815 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-6eb213de-de6e-4d2c-8f71-c8b3193712a1 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bbb4f184e4409d9eed51e0b98dfb29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708f8d4c4ed6432d85e0bf6a9bac7677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:08:19.765126 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-6eb213de-de6e-4d2c-8f71-c8b3193712a1 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] 10.222.0.58 "GET /compute/v2.1/servers/eea0fab7-447d-4f5f-8577-6ef8df500499" status: 200 len: 1527 microversion: 2.1 time: 0.833121 Aug 10 23:08:19.772412 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1386/2825] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:08:18 2022] GET /compute/v2.1/servers/eea0fab7-447d-4f5f-8577-6ef8df500499 => generated 1527 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:08:19.792282 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-f1e631fa-7225-4c09-a49e-792eeac78946 tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Calling method '.version_select at 0x7f847c4add30>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:08:19.904636 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-f1e631fa-7225-4c09-a49e-792eeac78946 tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] 10.222.0.58 "GET /compute/v2.1/images/6331cdd3-d79a-4aa4-8575-f401a3c11d5b" status: 200 len: 1427 microversion: 2.1 time: 0.120285 Aug 10 23:08:19.905606 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1440/2826] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 10 23:08:19 2022] GET /compute/v2.1/images/6331cdd3-d79a-4aa4-8575-f401a3c11d5b => generated 1427 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:08:20.308067 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-7e873662-19f3-4af7-b102-ee2c0598f752 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:08:20.308803 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-7e873662-19f3-4af7-b102-ee2c0598f752 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] [instance: 325d9b10-716d-4961-91d1-70962403fef4] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:08:20.316934 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7e873662-19f3-4af7-b102-ee2c0598f752 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:20.317709 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7e873662-19f3-4af7-b102-ee2c0598f752 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:20.318326 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7e873662-19f3-4af7-b102-ee2c0598f752 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:20.320494 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7e873662-19f3-4af7-b102-ee2c0598f752 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:20.321253 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7e873662-19f3-4af7-b102-ee2c0598f752 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:20.321943 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7e873662-19f3-4af7-b102-ee2c0598f752 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:20.725380 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-7e873662-19f3-4af7-b102-ee2c0598f752 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84e70c3ea5347e79ba5aee661b15ce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ab3ad5c0ef448aaa1282112bf20d83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:08:20.745259 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-7e873662-19f3-4af7-b102-ee2c0598f752 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] 10.222.0.58 "GET /compute/v2.1/servers/325d9b10-716d-4961-91d1-70962403fef4" status: 200 len: 1322 microversion: 2.1 time: 0.443405 Aug 10 23:08:20.747128 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1387/2827] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:08:20 2022] GET /compute/v2.1/servers/325d9b10-716d-4961-91d1-70962403fef4 => generated 1322 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:08:20.800544 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-fd6676a3-e4d8-44e2-866e-24422cd223bb tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:08:20.801301 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-fd6676a3-e4d8-44e2-866e-24422cd223bb tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] [instance: eea0fab7-447d-4f5f-8577-6ef8df500499] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:08:20.830018 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fd6676a3-e4d8-44e2-866e-24422cd223bb tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:20.830514 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fd6676a3-e4d8-44e2-866e-24422cd223bb tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:20.830998 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fd6676a3-e4d8-44e2-866e-24422cd223bb tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:20.831801 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fd6676a3-e4d8-44e2-866e-24422cd223bb tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:20.836368 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fd6676a3-e4d8-44e2-866e-24422cd223bb tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:20.836860 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fd6676a3-e4d8-44e2-866e-24422cd223bb tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:20.924161 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-d83204b3-4538-47e3-a53c-2ca2e46c1c80 tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Calling method '.version_select at 0x7f847d173550>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:08:20.930059 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:08:21.409339 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-fd6676a3-e4d8-44e2-866e-24422cd223bb tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bbb4f184e4409d9eed51e0b98dfb29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708f8d4c4ed6432d85e0bf6a9bac7677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:08:21.431538 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-fd6676a3-e4d8-44e2-866e-24422cd223bb tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] 10.222.0.58 "GET /compute/v2.1/servers/eea0fab7-447d-4f5f-8577-6ef8df500499" status: 200 len: 1527 microversion: 2.1 time: 0.635944 Aug 10 23:08:21.432074 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1441/2828] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:08:20 2022] GET /compute/v2.1/servers/eea0fab7-447d-4f5f-8577-6ef8df500499 => generated 1527 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:08:21.437571 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-f524787e-f45d-4f5c-9b9c-720cea9d53f2 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1875710514", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b9faafad-d704-47e8-a221-ba688e261596"}], "security_groups": [{"name": "tempest-securitygroup--208343272"}], "key_name": "tempest-keypair-280954451", "user_data": "}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:08:25.532079 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=4 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:08:30.312898 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_api:SELECT=10,nova_api:UPDATE=1 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:08:30.738140 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:08:31.416224 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=2 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:08:31.470450 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:08:41.430912 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-d83204b3-4538-47e3-a53c-2ca2e46c1c80 tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] 10.222.0.58 "GET /compute/v2.1/images/6331cdd3-d79a-4aa4-8575-f401a3c11d5b" status: 200 len: 1436 microversion: 2.1 time: 20.511537 Aug 10 23:08:41.435510 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1388/2829] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 10 23:08:20 2022] GET /compute/v2.1/images/6331cdd3-d79a-4aa4-8575-f401a3c11d5b => generated 1436 bytes in 20517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:08:41.442809 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-fa670699-a7b2-476e-90c4-7921ae91b0df tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:08:41.444330 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-fa670699-a7b2-476e-90c4-7921ae91b0df tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] [instance: 325d9b10-716d-4961-91d1-70962403fef4] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:08:41.456457 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fa670699-a7b2-476e-90c4-7921ae91b0df tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:41.457700 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fa670699-a7b2-476e-90c4-7921ae91b0df tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:41.458547 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fa670699-a7b2-476e-90c4-7921ae91b0df tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:41.461055 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fa670699-a7b2-476e-90c4-7921ae91b0df tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:41.461802 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fa670699-a7b2-476e-90c4-7921ae91b0df tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:41.462590 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fa670699-a7b2-476e-90c4-7921ae91b0df tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:41.613460 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.network.neutron [None req-f524787e-f45d-4f5c-9b9c-720cea9d53f2 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] validate_networks() for [('b9faafad-d704-47e8-a221-ba688e261596', None, None, None, None, None)] {{(pid=122633) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 23:08:42.415128 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-fa670699-a7b2-476e-90c4-7921ae91b0df tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84e70c3ea5347e79ba5aee661b15ce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ab3ad5c0ef448aaa1282112bf20d83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:08:42.431387 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-fa670699-a7b2-476e-90c4-7921ae91b0df tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] 10.222.0.58 "GET /compute/v2.1/servers/325d9b10-716d-4961-91d1-70962403fef4" status: 200 len: 1517 microversion: 2.1 time: 0.993604 Aug 10 23:08:42.434060 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1389/2830] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:08:41 2022] GET /compute/v2.1/servers/325d9b10-716d-4961-91d1-70962403fef4 => generated 1517 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:08:42.447255 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-bbcaf90d-cd6c-459e-9afe-cefa95e75e7c tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:08:42.448661 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-bbcaf90d-cd6c-459e-9afe-cefa95e75e7c tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] [instance: eea0fab7-447d-4f5f-8577-6ef8df500499] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:08:42.461642 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bbcaf90d-cd6c-459e-9afe-cefa95e75e7c tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:42.465374 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bbcaf90d-cd6c-459e-9afe-cefa95e75e7c tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:42.466171 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bbcaf90d-cd6c-459e-9afe-cefa95e75e7c tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:42.469873 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bbcaf90d-cd6c-459e-9afe-cefa95e75e7c tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:42.470579 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bbcaf90d-cd6c-459e-9afe-cefa95e75e7c tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:42.471182 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bbcaf90d-cd6c-459e-9afe-cefa95e75e7c tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:42.501916 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-bbcaf90d-cd6c-459e-9afe-cefa95e75e7c tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] HTTP exception thrown: Instance eea0fab7-447d-4f5f-8577-6ef8df500499 could not be found. Aug 10 23:08:42.507098 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-bbcaf90d-cd6c-459e-9afe-cefa95e75e7c tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Request method failure captured: Aug 10 23:08:42.507098 n-d-850468-14 devstack@n-api.service[122632]: request: GET /compute/v2.1/servers/eea0fab7-447d-4f5f-8577-6ef8df500499 HTTP/1.1 Aug 10 23:08:42.507098 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:08:42.507098 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:08:42.507098 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:08:42.507098 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 23:08:42.507098 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:08:42.507098 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:08:42.507098 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:08:42.507098 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:08:42.507098 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9Do81XwGOyJYZzjDqBUm67v_Q0362_4xQUvU3HvIWmFkKXGTToH86-ip4fxXuu0oxmkucX-Et277q0Z5R4ChTe5MWC8zJ89hWAklZmH6m-N_CAseQK0eUiUfLbiJpjdB2S78hj0EntCCqH4mBVhce2-q9auCyId7qlhsdrU7MIxxCSQ Aug 10 23:08:42.507098 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:08:42.507098 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:08:42.507098 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:08:42.507098 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:08:42.507098 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:08:42.507098 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:08:42.507098 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 708f8d4c4ed6432d85e0bf6a9bac7677 Aug 10 23:08:42.507098 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2080454436 Aug 10 23:08:42.507098 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:08:42.507098 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:08:42.509023 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/708f8d4c4ed6432d85e0bf6a9bac7677"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/708f8d4c4ed6432d85e0bf6a9bac7677"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/708f8d4c4ed6432d85e0bf6a9bac7677"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_708f8d4c4ed6432d85e0bf6a9bac7677", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:08:42.509023 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2080454436 Aug 10 23:08:42.509023 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 708f8d4c4ed6432d85e0bf6a9bac7677 Aug 10 23:08:42.509023 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2080454436 Aug 10 23:08:42.509023 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-ImagesOneServerNegativeTestJSON-2080454436-project Aug 10 23:08:42.509023 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:08:42.509023 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:08:42.509023 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: 55bbb4f184e4409d9eed51e0b98dfb29 Aug 10 23:08:42.509023 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2080454436-project Aug 10 23:08:42.509023 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:08:42.509023 n-d-850468-14 devstack@n-api.service[122632]: exception: Instance eea0fab7-447d-4f5f-8577-6ef8df500499 could not be found. Aug 10 23:08:42.509023 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': 'eea0fab7-447d-4f5f-8577-6ef8df500499'} Aug 10 23:08:42.509982 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:08:42.509982 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:08:42.509982 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:08:42.509982 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:08:42.509982 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:08:42.509982 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:08:42.509982 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:08:42.509982 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:08:42.509982 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:08:42.509982 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:08:42.509982 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eea0fab7-447d-4f5f-8577-6ef8df500499 could not be found. Aug 10 23:08:42.509982 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:08:42.509982 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:08:42.509982 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:08:42.509982 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:08:42.509982 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:08:42.509982 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:08:42.509982 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:08:42.509982 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:08:42.509982 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:08:42.512931 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:08:42.512931 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:08:42.512931 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:08:42.512931 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:08:42.512931 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:08:42.512931 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:08:42.512931 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:08:42.512931 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eea0fab7-447d-4f5f-8577-6ef8df500499 could not be found. Aug 10 23:08:42.512931 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:08:42.512931 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:08:42.512931 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:08:42.512931 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:08:42.512931 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:08:42.512931 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:08:42.512931 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:08:42.512931 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:08:42.512931 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eea0fab7-447d-4f5f-8577-6ef8df500499 could not be found. Aug 10 23:08:42.512931 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:08:42.528443 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-f524787e-f45d-4f5c-9b9c-720cea9d53f2 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Flavor limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:08:42.533411 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-f524787e-f45d-4f5c-9b9c-720cea9d53f2 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Image limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:08:42.534092 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-f524787e-f45d-4f5c-9b9c-720cea9d53f2 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Flavor pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:08:42.534652 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-f524787e-f45d-4f5c-9b9c-720cea9d53f2 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Image pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:08:42.535274 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-f524787e-f45d-4f5c-9b9c-720cea9d53f2 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:08:42.541586 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-bbcaf90d-cd6c-459e-9afe-cefa95e75e7c tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Returning 404 to user: Instance eea0fab7-447d-4f5f-8577-6ef8df500499 could not be found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:08:42.544038 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-bbcaf90d-cd6c-459e-9afe-cefa95e75e7c tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] 10.222.0.58 "GET /compute/v2.1/servers/eea0fab7-447d-4f5f-8577-6ef8df500499" status: 404 len: 111 microversion: 2.1 time: 0.108605 Aug 10 23:08:42.553640 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1390/2831] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:08:42 2022] GET /compute/v2.1/servers/eea0fab7-447d-4f5f-8577-6ef8df500499 => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:08:42.563936 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-662e7121-e4fb-437f-a01c-b7c202ccc486 req-e6699a70-f3d2-4cf6-a88f-d96d532fd085 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eea0fab7-447d-4f5f-8577-6ef8df500499", "name": "network-vif-deleted", "tag": "c28daca8-af14-4727-818b-5bb0398c4dc4"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:08:42.568919 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f524787e-f45d-4f5c-9b9c-720cea9d53f2 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:42.570596 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f524787e-f45d-4f5c-9b9c-720cea9d53f2 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:42.571629 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f524787e-f45d-4f5c-9b9c-720cea9d53f2 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:42.572673 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f524787e-f45d-4f5c-9b9c-720cea9d53f2 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:42.573366 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f524787e-f45d-4f5c-9b9c-720cea9d53f2 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:42.574038 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f524787e-f45d-4f5c-9b9c-720cea9d53f2 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:42.604425 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-f524787e-f45d-4f5c-9b9c-720cea9d53f2 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Getting quotas for project 597863bfebdc481188f1f30095da5396. Resources: {'instances', 'cores', 'ram'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:08:42.619054 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-662e7121-e4fb-437f-a01c-b7c202ccc486 req-e6699a70-f3d2-4cf6-a88f-d96d532fd085 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:42.621626 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-662e7121-e4fb-437f-a01c-b7c202ccc486 req-e6699a70-f3d2-4cf6-a88f-d96d532fd085 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:42.621993 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-f524787e-f45d-4f5c-9b9c-720cea9d53f2 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Getting quotas for user a1986185dc9b4df4affcc421365462f7 and project 597863bfebdc481188f1f30095da5396. Resources: {'instances', 'cores', 'ram'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:08:42.624327 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-662e7121-e4fb-437f-a01c-b7c202ccc486 req-e6699a70-f3d2-4cf6-a88f-d96d532fd085 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:42.656151 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-662e7121-e4fb-437f-a01c-b7c202ccc486 req-e6699a70-f3d2-4cf6-a88f-d96d532fd085 service nova] Creating event network-vif-deleted:c28daca8-af14-4727-818b-5bb0398c4dc4 for instance eea0fab7-447d-4f5f-8577-6ef8df500499 on n-h1-850468-14 Aug 10 23:08:42.656519 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-f524787e-f45d-4f5c-9b9c-720cea9d53f2 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Going to run 1 instances... {{(pid=122633) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 23:08:42.659893 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-f524787e-f45d-4f5c-9b9c-720cea9d53f2 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] [instance: 23452b78-96cd-430d-b95c-aaa98a427d53] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78ad8905-f66f-4733-8be9-2b260f1fabed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122633) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 23:08:42.665515 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-662e7121-e4fb-437f-a01c-b7c202ccc486 req-e6699a70-f3d2-4cf6-a88f-d96d532fd085 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109557 Aug 10 23:08:42.666719 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1391/2832] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:08:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:08:42.762302 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-f524787e-f45d-4f5c-9b9c-720cea9d53f2 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 21.328757 Aug 10 23:08:42.767129 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1442/2833] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 23:08:21 2022] POST /compute/v2.1/servers => generated 401 bytes in 21334 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 23:08:42.779297 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-37f665c7-fff4-497f-9ecb-e62fdc72787a tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Calling method '.version_select at 0x7f847c4ad0d0>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:08:42.883555 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-37f665c7-fff4-497f-9ecb-e62fdc72787a tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] 10.222.0.58 "GET /compute/v2.1/images/6331cdd3-d79a-4aa4-8575-f401a3c11d5b" status: 200 len: 1436 microversion: 2.1 time: 0.115002 Aug 10 23:08:42.889559 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1443/2834] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 10 23:08:42 2022] GET /compute/v2.1/images/6331cdd3-d79a-4aa4-8575-f401a3c11d5b => generated 1436 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:08:42.902034 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-fd256937-1c8e-4c9f-93fd-da5178a376df tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:08:42.908691 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-fd256937-1c8e-4c9f-93fd-da5178a376df tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] [instance: 325d9b10-716d-4961-91d1-70962403fef4] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:08:42.946240 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fd256937-1c8e-4c9f-93fd-da5178a376df tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:42.948296 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fd256937-1c8e-4c9f-93fd-da5178a376df tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:42.948748 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fd256937-1c8e-4c9f-93fd-da5178a376df tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:42.949479 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fd256937-1c8e-4c9f-93fd-da5178a376df tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:42.949937 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fd256937-1c8e-4c9f-93fd-da5178a376df tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:42.950362 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fd256937-1c8e-4c9f-93fd-da5178a376df tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:43.007721 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-acec534f-139f-4d66-9bce-10098ed9b487 tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-1017264384", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452", "networks": [{"uuid": "554d8b60-99a8-4956-bd23-59eb61c37a51"}]}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:08:43.012517 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.objects.instance [None req-fd256937-1c8e-4c9f-93fd-da5178a376df tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Lazy-loading 'flavor' on Instance uuid 325d9b10-716d-4961-91d1-70962403fef4 {{(pid=122633) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:08:43.122556 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.network.neutron [None req-acec534f-139f-4d66-9bce-10098ed9b487 tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] validate_networks() for [('554d8b60-99a8-4956-bd23-59eb61c37a51', None, None, None, None, None)] {{(pid=122632) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 23:08:43.244710 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-fd256937-1c8e-4c9f-93fd-da5178a376df tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] 10.222.0.58 "POST /compute/v2.1/servers/325d9b10-716d-4961-91d1-70962403fef4/action" status: 200 len: 32 microversion: 2.1 time: 0.348649 Aug 10 23:08:43.245396 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1444/2835] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:08:42 2022] POST /compute/v2.1/servers/325d9b10-716d-4961-91d1-70962403fef4/action => generated 32 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 23:08:43.261724 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-a7337fbb-7c52-4366-9378-ce1420cf4336 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Action: 'create', calling method: .version_select at 0x7f847c514280>, body: {"keypair": {"name": "tempest-keypair-1383650922", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFalJ75Z4icTikmA1ahx21IFO4SQe6hYDfVYZf65TH76PvY/jzEIa4GTU4zljLbkbx6yWmxGwspvJiDB8f3GEfd7+kUl1paHXUfwdgAaCUvRs9S7t17gg5qw3RzSDCVCVw=="}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:08:43.295276 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-a7337fbb-7c52-4366-9378-ce1420cf4336 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Getting quotas for project 708f8d4c4ed6432d85e0bf6a9bac7677. Resources: {'key_pairs'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:08:43.302741 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-a7337fbb-7c52-4366-9378-ce1420cf4336 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Getting quotas for user 55bbb4f184e4409d9eed51e0b98dfb29 and project 708f8d4c4ed6432d85e0bf6a9bac7677. Resources: {'key_pairs'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:08:43.357433 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-a7337fbb-7c52-4366-9378-ce1420cf4336 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.110767 Aug 10 23:08:43.361352 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1445/2836] 10.222.0.58 () {60 vars in 1159 bytes} [Wed Aug 10 23:08:43 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:08:43.373635 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-99b74c70-1ef1-468d-a32d-d7c5ec27314c tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:08:43.374252 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-99b74c70-1ef1-468d-a32d-d7c5ec27314c tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] [instance: 23452b78-96cd-430d-b95c-aaa98a427d53] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:08:43.538909 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-99b74c70-1ef1-468d-a32d-d7c5ec27314c tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1986185dc9b4df4affcc421365462f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597863bfebdc481188f1f30095da5396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:08:43.551974 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-99b74c70-1ef1-468d-a32d-d7c5ec27314c tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] 10.222.0.58 "GET /compute/v2.1/servers/23452b78-96cd-430d-b95c-aaa98a427d53" status: 200 len: 1237 microversion: 2.1 time: 0.188512 Aug 10 23:08:43.556167 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1446/2837] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:08:43 2022] GET /compute/v2.1/servers/23452b78-96cd-430d-b95c-aaa98a427d53 => generated 1237 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:08:43.567533 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-ea454783-90c6-4fa1-a091-fc9eabec83f9 tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:08:43.568479 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-ea454783-90c6-4fa1-a091-fc9eabec83f9 tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] [instance: a632bb08-327b-4870-9f4e-90f8d0d863d0] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:08:43.586871 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ea454783-90c6-4fa1-a091-fc9eabec83f9 tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:43.590898 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ea454783-90c6-4fa1-a091-fc9eabec83f9 tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:43.591665 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ea454783-90c6-4fa1-a091-fc9eabec83f9 tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:43.592660 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ea454783-90c6-4fa1-a091-fc9eabec83f9 tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:43.593351 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ea454783-90c6-4fa1-a091-fc9eabec83f9 tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:43.594009 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ea454783-90c6-4fa1-a091-fc9eabec83f9 tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:43.894178 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-ea454783-90c6-4fa1-a091-fc9eabec83f9 tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d235607afb4ba59ed6ac2908c6dc33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5881784cbc4d669ad7fa40880ed9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:08:43.911124 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-ea454783-90c6-4fa1-a091-fc9eabec83f9 tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] 10.222.0.58 "GET /compute/v2.1/servers/a632bb08-327b-4870-9f4e-90f8d0d863d0" status: 200 len: 1466 microversion: 2.1 time: 0.351693 Aug 10 23:08:43.911991 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1447/2838] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:08:43 2022] GET /compute/v2.1/servers/a632bb08-327b-4870-9f4e-90f8d0d863d0 => generated 1466 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:08:43.931280 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-6e01da23-46d9-431d-975d-37fdc80d9bc2 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:08:43.934295 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-6e01da23-46d9-431d-975d-37fdc80d9bc2 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] [instance: 325d9b10-716d-4961-91d1-70962403fef4] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:08:43.953206 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6e01da23-46d9-431d-975d-37fdc80d9bc2 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:43.956329 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6e01da23-46d9-431d-975d-37fdc80d9bc2 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:43.956914 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6e01da23-46d9-431d-975d-37fdc80d9bc2 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:43.961449 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6e01da23-46d9-431d-975d-37fdc80d9bc2 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:43.962052 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6e01da23-46d9-431d-975d-37fdc80d9bc2 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:43.962606 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6e01da23-46d9-431d-975d-37fdc80d9bc2 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:44.502110 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-6e01da23-46d9-431d-975d-37fdc80d9bc2 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84e70c3ea5347e79ba5aee661b15ce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ab3ad5c0ef448aaa1282112bf20d83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:08:44.515076 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-6e01da23-46d9-431d-975d-37fdc80d9bc2 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] 10.222.0.58 "GET /compute/v2.1/servers/325d9b10-716d-4961-91d1-70962403fef4" status: 200 len: 1523 microversion: 2.1 time: 0.596601 Aug 10 23:08:44.517156 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1448/2839] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:08:43 2022] GET /compute/v2.1/servers/325d9b10-716d-4961-91d1-70962403fef4 => generated 1523 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:08:44.529383 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-5e99c3f7-383c-4177-ae4f-1a1e2a2c3867 tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Calling method '.version_select at 0x7f847c507a60>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:08:44.800522 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-acec534f-139f-4d66-9bce-10098ed9b487 tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Flavor limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:08:44.801526 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-acec534f-139f-4d66-9bce-10098ed9b487 tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Image limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:08:44.802585 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-acec534f-139f-4d66-9bce-10098ed9b487 tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Flavor pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:08:44.804499 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-acec534f-139f-4d66-9bce-10098ed9b487 tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Image pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:08:44.805103 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-acec534f-139f-4d66-9bce-10098ed9b487 tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:08:44.830606 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-acec534f-139f-4d66-9bce-10098ed9b487 tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:44.836564 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-acec534f-139f-4d66-9bce-10098ed9b487 tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:44.837272 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-acec534f-139f-4d66-9bce-10098ed9b487 tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:44.838251 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-acec534f-139f-4d66-9bce-10098ed9b487 tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:44.838953 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-acec534f-139f-4d66-9bce-10098ed9b487 tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:44.839648 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-acec534f-139f-4d66-9bce-10098ed9b487 tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:44.949994 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-acec534f-139f-4d66-9bce-10098ed9b487 tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Getting quotas for project 8e4512070fb74a32a9203526a025914e. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:08:44.974335 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-acec534f-139f-4d66-9bce-10098ed9b487 tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Getting quotas for user ca20e8ce3e25491fbe58f97ac5b9250a and project 8e4512070fb74a32a9203526a025914e. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:08:45.084160 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-acec534f-139f-4d66-9bce-10098ed9b487 tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Going to run 1 instances... {{(pid=122632) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 23:08:45.088877 n-d-850468-14 devstack@n-api.service[122632]: WARNING nova.utils [None req-acec534f-139f-4d66-9bce-10098ed9b487 tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Hostname tempest-FloatingIPsAssociationNegativeTestJSON-server-1017264384 is longer than 63, truncate it to tempest-FloatingIPsAssociationNegativeTestJSON-server-101726438 Aug 10 23:08:45.093100 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-acec534f-139f-4d66-9bce-10098ed9b487 tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] [instance: 61e7db28-1e60-444a-b6c0-dd65ef3f5a6b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78ad8905-f66f-4733-8be9-2b260f1fabed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122632) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 23:08:45.275859 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-acec534f-139f-4d66-9bce-10098ed9b487 tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.606779 Aug 10 23:08:45.299895 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1392/2840] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 23:08:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 2632 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 23:08:45.331595 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-3cb8f835-90b1-4024-b634-0a0e088c1209 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:08:45.332239 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-3cb8f835-90b1-4024-b634-0a0e088c1209 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] [instance: 23452b78-96cd-430d-b95c-aaa98a427d53] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:08:45.352291 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3cb8f835-90b1-4024-b634-0a0e088c1209 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:45.354307 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3cb8f835-90b1-4024-b634-0a0e088c1209 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:45.354769 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3cb8f835-90b1-4024-b634-0a0e088c1209 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:45.356793 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3cb8f835-90b1-4024-b634-0a0e088c1209 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:45.359067 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3cb8f835-90b1-4024-b634-0a0e088c1209 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:45.360647 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3cb8f835-90b1-4024-b634-0a0e088c1209 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:45.874879 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-3cb8f835-90b1-4024-b634-0a0e088c1209 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1986185dc9b4df4affcc421365462f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597863bfebdc481188f1f30095da5396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:08:45.899403 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-3cb8f835-90b1-4024-b634-0a0e088c1209 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] 10.222.0.58 "GET /compute/v2.1/servers/23452b78-96cd-430d-b95c-aaa98a427d53" status: 200 len: 1295 microversion: 2.1 time: 0.598059 Aug 10 23:08:45.900161 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1393/2841] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:08:45 2022] GET /compute/v2.1/servers/23452b78-96cd-430d-b95c-aaa98a427d53 => generated 1295 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:08:45.914955 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-098c8093-8e8f-4e85-af11-3d511f362d4b tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:08:45.915766 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-098c8093-8e8f-4e85-af11-3d511f362d4b tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] [instance: 61e7db28-1e60-444a-b6c0-dd65ef3f5a6b] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:08:45.969640 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-5e99c3f7-383c-4177-ae4f-1a1e2a2c3867 tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] 10.222.0.58 "DELETE /compute/v2.1/images/6331cdd3-d79a-4aa4-8575-f401a3c11d5b" status: 204 len: 0 microversion: 2.1 time: 1.449997 Aug 10 23:08:45.970392 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1449/2842] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:08:44 2022] DELETE /compute/v2.1/images/6331cdd3-d79a-4aa4-8575-f401a3c11d5b => generated 0 bytes in 1451 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:08:45.979644 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-f38dbf9e-b3f7-405d-af62-c77527268ce2 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:08:45.981209 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-f38dbf9e-b3f7-405d-af62-c77527268ce2 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] [instance: 325d9b10-716d-4961-91d1-70962403fef4] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:08:46.019568 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f38dbf9e-b3f7-405d-af62-c77527268ce2 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:46.023174 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f38dbf9e-b3f7-405d-af62-c77527268ce2 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:46.031498 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f38dbf9e-b3f7-405d-af62-c77527268ce2 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:46.032647 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f38dbf9e-b3f7-405d-af62-c77527268ce2 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:46.035013 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f38dbf9e-b3f7-405d-af62-c77527268ce2 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:46.035736 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f38dbf9e-b3f7-405d-af62-c77527268ce2 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:46.418011 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-098c8093-8e8f-4e85-af11-3d511f362d4b tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca20e8ce3e25491fbe58f97ac5b9250a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e4512070fb74a32a9203526a025914e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:08:46.429245 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-098c8093-8e8f-4e85-af11-3d511f362d4b tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] 10.222.0.58 "GET /compute/v2.1/servers/61e7db28-1e60-444a-b6c0-dd65ef3f5a6b" status: 200 len: 1232 microversion: 2.1 time: 0.525030 Aug 10 23:08:46.432058 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1394/2843] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:08:45 2022] GET /compute/v2.1/servers/61e7db28-1e60-444a-b6c0-dd65ef3f5a6b => generated 1232 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:08:46.446399 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-8cfc0328-5bd3-4fa2-b6fb-f45a5dc25d03 tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Calling method '.version_select at 0x7f847d055790>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:08:46.490254 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-8cfc0328-5bd3-4fa2-b6fb-f45a5dc25d03 tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] HTTP exception thrown: Image not found. Aug 10 23:08:46.494826 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-8cfc0328-5bd3-4fa2-b6fb-f45a5dc25d03 tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Request method failure captured: Aug 10 23:08:46.494826 n-d-850468-14 devstack@n-api.service[122632]: request: DELETE /compute/v2.1/images/0f967916-982b-4b7c-bb3c-1ec6b8c4dd57 HTTP/1.1 Aug 10 23:08:46.494826 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:08:46.494826 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:08:46.494826 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:08:46.494826 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 23:08:46.494826 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:08:46.494826 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:08:46.494826 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:08:46.494826 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:08:46.494826 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9DokeNMeiboBcHod0DVDkUURTwvtpn7HJKP5tx7M5EdCSsg6x58QQe0n7YdoDGTpztweFjKI6CCh06jNam2UkNuq25elSk8XchgqlShgo_k9VvqntaThhMbZR4SNsj29MfhbIOnvalaEITzobOjvW4fECzJaG8MI_z-RQWJCNK_qZ-I Aug 10 23:08:46.494826 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:08:46.494826 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:08:46.494826 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:08:46.494826 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:08:46.494826 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:08:46.494826 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:08:46.494826 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: de5881784cbc4d669ad7fa40880ed9c0 Aug 10 23:08:46.494826 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-ImagesOneServerTestJSON-435688088 Aug 10 23:08:46.494826 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:08:46.494826 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:08:46.496527 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/de5881784cbc4d669ad7fa40880ed9c0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/de5881784cbc4d669ad7fa40880ed9c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/de5881784cbc4d669ad7fa40880ed9c0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_de5881784cbc4d669ad7fa40880ed9c0", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:08:46.496527 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-ImagesOneServerTestJSON-435688088 Aug 10 23:08:46.496527 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: de5881784cbc4d669ad7fa40880ed9c0 Aug 10 23:08:46.496527 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-435688088 Aug 10 23:08:46.496527 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-ImagesOneServerTestJSON-435688088-project Aug 10 23:08:46.496527 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:08:46.496527 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:08:46.496527 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: 10d235607afb4ba59ed6ac2908c6dc33 Aug 10 23:08:46.496527 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-ImagesOneServerTestJSON-435688088-project Aug 10 23:08:46.496527 n-d-850468-14 devstack@n-api.service[122632]: method: Aug 10 23:08:46.496527 n-d-850468-14 devstack@n-api.service[122632]: exception: Image not found. Aug 10 23:08:46.496527 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': '0f967916-982b-4b7c-bb3c-1ec6b8c4dd57'} Aug 10 23:08:46.496527 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:08:46.497506 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:08:46.497506 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 10 23:08:46.497506 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 10 23:08:46.497506 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 10 23:08:46.497506 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 10 23:08:46.497506 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 10 23:08:46.497506 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 10 23:08:46.497506 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 10 23:08:46.497506 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 10 23:08:46.497506 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 10 23:08:46.497506 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 10 23:08:46.497506 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 10 23:08:46.497506 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 10 23:08:46.497506 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 10 23:08:46.497506 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 10 23:08:46.497506 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 0f967916-982b-4b7c-bb3c-1ec6b8c4dd57 to delete Aug 10 23:08:46.497506 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:08:46.497506 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:08:46.497506 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:08:46.498970 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:08:46.498970 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 10 23:08:46.498970 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 10 23:08:46.498970 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 10 23:08:46.498970 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 10 23:08:46.498970 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 10 23:08:46.498970 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 10 23:08:46.498970 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 0f967916-982b-4b7c-bb3c-1ec6b8c4dd57 could not be found. Aug 10 23:08:46.498970 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:08:46.498970 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:08:46.498970 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:08:46.498970 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:08:46.498970 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:08:46.498970 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:08:46.498970 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:08:46.498970 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:08:46.498970 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 23:08:46.498970 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 23:08:46.498970 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:08:46.498970 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:08:46.500704 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 10 23:08:46.500704 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 10 23:08:46.500704 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 10 23:08:46.500704 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:08:46.500704 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:08:46.500704 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:08:46.500704 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:08:46.500704 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:08:46.500704 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:08:46.500704 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:08:46.500704 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:08:46.500704 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 10 23:08:46.500704 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:08:46.504223 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-8cfc0328-5bd3-4fa2-b6fb-f45a5dc25d03 tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Returning 404 to user: Image not found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:08:46.508647 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-8cfc0328-5bd3-4fa2-b6fb-f45a5dc25d03 tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] 10.222.0.58 "DELETE /compute/v2.1/images/0f967916-982b-4b7c-bb3c-1ec6b8c4dd57" status: 404 len: 62 microversion: 2.1 time: 0.073253 Aug 10 23:08:46.514124 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1395/2844] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:08:46 2022] DELETE /compute/v2.1/images/0f967916-982b-4b7c-bb3c-1ec6b8c4dd57 => generated 62 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 10 23:08:46.694975 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-15b60061-cee6-43f8-9d46-2710bd4665a8 tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-918673411", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "dca78bd6-e5ed-4d53-860b-07b9da7ab161"}]}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:08:46.855673 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.network.neutron [None req-15b60061-cee6-43f8-9d46-2710bd4665a8 tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] validate_networks() for [('dca78bd6-e5ed-4d53-860b-07b9da7ab161', None, None, None, None, None)] {{(pid=122632) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 23:08:46.951300 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-f38dbf9e-b3f7-405d-af62-c77527268ce2 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84e70c3ea5347e79ba5aee661b15ce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ab3ad5c0ef448aaa1282112bf20d83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:08:46.995196 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-f38dbf9e-b3f7-405d-af62-c77527268ce2 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] 10.222.0.58 "GET /compute/v2.1/servers/325d9b10-716d-4961-91d1-70962403fef4" status: 200 len: 1523 microversion: 2.1 time: 1.023307 Aug 10 23:08:47.001464 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1450/2845] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:08:45 2022] GET /compute/v2.1/servers/325d9b10-716d-4961-91d1-70962403fef4 => generated 1523 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:08:47.022867 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-746f3620-7c74-40c1-8447-8da0e09f034c tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:08:47.027660 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-746f3620-7c74-40c1-8447-8da0e09f034c tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] [instance: a632bb08-327b-4870-9f4e-90f8d0d863d0] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:08:47.064647 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-746f3620-7c74-40c1-8447-8da0e09f034c tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:47.069608 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-746f3620-7c74-40c1-8447-8da0e09f034c tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:47.070342 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-746f3620-7c74-40c1-8447-8da0e09f034c tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:47.072695 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-746f3620-7c74-40c1-8447-8da0e09f034c tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:47.081901 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-746f3620-7c74-40c1-8447-8da0e09f034c tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:47.082598 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-746f3620-7c74-40c1-8447-8da0e09f034c tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:47.215540 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-746f3620-7c74-40c1-8447-8da0e09f034c tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] [instance: a632bb08-327b-4870-9f4e-90f8d0d863d0] Going to try to terminate instance {{(pid=122633) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:08:47.438247 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-746f3620-7c74-40c1-8447-8da0e09f034c tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] 10.222.0.58 "DELETE /compute/v2.1/servers/a632bb08-327b-4870-9f4e-90f8d0d863d0" status: 204 len: 0 microversion: 2.1 time: 0.432660 Aug 10 23:08:47.441263 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1451/2846] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:08:47 2022] DELETE /compute/v2.1/servers/a632bb08-327b-4870-9f4e-90f8d0d863d0 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:08:47.450734 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-9cf6a78d-4c26-418b-a464-9ae343d36129 req-feff0218-d768-462a-ace7-4acf5cfd5b00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a632bb08-327b-4870-9f4e-90f8d0d863d0", "name": "network-vif-unplugged", "status": "completed", "tag": "c03a409d-cb49-445d-9fc1-ff05f4b1ff2b"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:08:47.544908 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-9cf6a78d-4c26-418b-a464-9ae343d36129 req-feff0218-d768-462a-ace7-4acf5cfd5b00 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:47.545525 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-9cf6a78d-4c26-418b-a464-9ae343d36129 req-feff0218-d768-462a-ace7-4acf5cfd5b00 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:47.550894 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-9cf6a78d-4c26-418b-a464-9ae343d36129 req-feff0218-d768-462a-ace7-4acf5cfd5b00 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:47.593526 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-9cf6a78d-4c26-418b-a464-9ae343d36129 req-feff0218-d768-462a-ace7-4acf5cfd5b00 service nova] Creating event network-vif-unplugged:c03a409d-cb49-445d-9fc1-ff05f4b1ff2b for instance a632bb08-327b-4870-9f4e-90f8d0d863d0 on n-h1-850468-14 Aug 10 23:08:47.611434 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-9cf6a78d-4c26-418b-a464-9ae343d36129 req-feff0218-d768-462a-ace7-4acf5cfd5b00 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.166190 Aug 10 23:08:47.612441 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1452/2847] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:08:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:08:47.628897 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-fc042712-3bca-4720-9028-7e5babad3db1 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:08:47.632174 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-fc042712-3bca-4720-9028-7e5babad3db1 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] [instance: 23452b78-96cd-430d-b95c-aaa98a427d53] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:08:47.647437 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fc042712-3bca-4720-9028-7e5babad3db1 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:47.648444 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fc042712-3bca-4720-9028-7e5babad3db1 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:47.649093 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fc042712-3bca-4720-9028-7e5babad3db1 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:47.650003 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fc042712-3bca-4720-9028-7e5babad3db1 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:47.652948 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fc042712-3bca-4720-9028-7e5babad3db1 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:47.656646 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fc042712-3bca-4720-9028-7e5babad3db1 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:48.201992 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-15b60061-cee6-43f8-9d46-2710bd4665a8 tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] Flavor limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:08:48.202554 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-15b60061-cee6-43f8-9d46-2710bd4665a8 tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] Image limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:08:48.202951 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-15b60061-cee6-43f8-9d46-2710bd4665a8 tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] Flavor pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:08:48.203371 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-15b60061-cee6-43f8-9d46-2710bd4665a8 tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] Image pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:08:48.203791 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-15b60061-cee6-43f8-9d46-2710bd4665a8 tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:08:48.219040 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-15b60061-cee6-43f8-9d46-2710bd4665a8 tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:48.219538 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-15b60061-cee6-43f8-9d46-2710bd4665a8 tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:48.219991 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-15b60061-cee6-43f8-9d46-2710bd4665a8 tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:48.220798 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-15b60061-cee6-43f8-9d46-2710bd4665a8 tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:48.221173 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-15b60061-cee6-43f8-9d46-2710bd4665a8 tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:48.221606 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-15b60061-cee6-43f8-9d46-2710bd4665a8 tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:48.269338 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-15b60061-cee6-43f8-9d46-2710bd4665a8 tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] Getting quotas for project 7ad554e982ff483098acf8a3b58e3842. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:08:48.293561 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-15b60061-cee6-43f8-9d46-2710bd4665a8 tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] Getting quotas for user 7caa911d519e4711bf9a251b04ebe8dd and project 7ad554e982ff483098acf8a3b58e3842. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:08:48.320367 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-15b60061-cee6-43f8-9d46-2710bd4665a8 tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] Going to run 1 instances... {{(pid=122632) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 23:08:48.323350 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-15b60061-cee6-43f8-9d46-2710bd4665a8 tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] [instance: 3fae69e0-e5f3-4ce8-89b5-5d0a410b7be1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78ad8905-f66f-4733-8be9-2b260f1fabed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122632) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 23:08:48.362701 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-fc042712-3bca-4720-9028-7e5babad3db1 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1986185dc9b4df4affcc421365462f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597863bfebdc481188f1f30095da5396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:08:48.383178 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-fc042712-3bca-4720-9028-7e5babad3db1 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] 10.222.0.58 "GET /compute/v2.1/servers/23452b78-96cd-430d-b95c-aaa98a427d53" status: 200 len: 1295 microversion: 2.1 time: 0.767534 Aug 10 23:08:48.386026 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1453/2848] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:08:47 2022] GET /compute/v2.1/servers/23452b78-96cd-430d-b95c-aaa98a427d53 => generated 1295 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:08:48.397745 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-5484ada6-b241-46d4-992c-c1ab8d9a61a9 tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:08:48.399710 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-5484ada6-b241-46d4-992c-c1ab8d9a61a9 tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] [instance: a632bb08-327b-4870-9f4e-90f8d0d863d0] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:08:48.411953 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-15b60061-cee6-43f8-9d46-2710bd4665a8 tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.895267 Aug 10 23:08:48.419213 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1396/2849] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 23:08:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 1898 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 23:08:48.420009 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-fb0aa3e6-36cd-45a8-8f6c-ee95e007c16e tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:08:48.420009 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-fb0aa3e6-36cd-45a8-8f6c-ee95e007c16e tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] [instance: 61e7db28-1e60-444a-b6c0-dd65ef3f5a6b] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:08:48.434712 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5484ada6-b241-46d4-992c-c1ab8d9a61a9 tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:48.436539 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5484ada6-b241-46d4-992c-c1ab8d9a61a9 tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:48.437835 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5484ada6-b241-46d4-992c-c1ab8d9a61a9 tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:48.439950 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fb0aa3e6-36cd-45a8-8f6c-ee95e007c16e tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:48.441330 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5484ada6-b241-46d4-992c-c1ab8d9a61a9 tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:48.443088 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5484ada6-b241-46d4-992c-c1ab8d9a61a9 tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:48.445900 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5484ada6-b241-46d4-992c-c1ab8d9a61a9 tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:48.446904 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fb0aa3e6-36cd-45a8-8f6c-ee95e007c16e tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:48.447460 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fb0aa3e6-36cd-45a8-8f6c-ee95e007c16e tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:48.449344 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fb0aa3e6-36cd-45a8-8f6c-ee95e007c16e tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:48.450817 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fb0aa3e6-36cd-45a8-8f6c-ee95e007c16e tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:48.451855 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fb0aa3e6-36cd-45a8-8f6c-ee95e007c16e tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:48.583896 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-fb0aa3e6-36cd-45a8-8f6c-ee95e007c16e tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca20e8ce3e25491fbe58f97ac5b9250a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e4512070fb74a32a9203526a025914e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:08:48.606230 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-fb0aa3e6-36cd-45a8-8f6c-ee95e007c16e tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] 10.222.0.58 "GET /compute/v2.1/servers/61e7db28-1e60-444a-b6c0-dd65ef3f5a6b" status: 200 len: 1292 microversion: 2.1 time: 0.191969 Aug 10 23:08:48.630101 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1397/2850] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:08:48 2022] GET /compute/v2.1/servers/61e7db28-1e60-444a-b6c0-dd65ef3f5a6b => generated 1292 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:08:48.658447 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-5008e45b-b766-494f-a8ed-4cfd6ce0a528 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:08:48.662982 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-5008e45b-b766-494f-a8ed-4cfd6ce0a528 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] [instance: 325d9b10-716d-4961-91d1-70962403fef4] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:08:48.678913 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5008e45b-b766-494f-a8ed-4cfd6ce0a528 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:48.683778 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5008e45b-b766-494f-a8ed-4cfd6ce0a528 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:48.685906 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5008e45b-b766-494f-a8ed-4cfd6ce0a528 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:48.686699 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5008e45b-b766-494f-a8ed-4cfd6ce0a528 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:48.689455 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5008e45b-b766-494f-a8ed-4cfd6ce0a528 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:48.689907 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5008e45b-b766-494f-a8ed-4cfd6ce0a528 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:48.801617 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-5484ada6-b241-46d4-992c-c1ab8d9a61a9 tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d235607afb4ba59ed6ac2908c6dc33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5881784cbc4d669ad7fa40880ed9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:08:48.811932 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-5484ada6-b241-46d4-992c-c1ab8d9a61a9 tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] 10.222.0.58 "GET /compute/v2.1/servers/a632bb08-327b-4870-9f4e-90f8d0d863d0" status: 200 len: 1472 microversion: 2.1 time: 0.423581 Aug 10 23:08:48.826076 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1454/2851] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:08:48 2022] GET /compute/v2.1/servers/a632bb08-327b-4870-9f4e-90f8d0d863d0 => generated 1472 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:08:48.836283 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-b17a6aa0-e5a4-497d-9eb1-e6a0a0d2a82d tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:08:48.844642 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-b17a6aa0-e5a4-497d-9eb1-e6a0a0d2a82d tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] [instance: 3fae69e0-e5f3-4ce8-89b5-5d0a410b7be1] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:08:48.919778 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-5008e45b-b766-494f-a8ed-4cfd6ce0a528 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84e70c3ea5347e79ba5aee661b15ce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ab3ad5c0ef448aaa1282112bf20d83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:08:48.932871 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-5008e45b-b766-494f-a8ed-4cfd6ce0a528 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] 10.222.0.58 "GET /compute/v2.1/servers/325d9b10-716d-4961-91d1-70962403fef4" status: 200 len: 1523 microversion: 2.1 time: 0.291671 Aug 10 23:08:48.933509 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1398/2852] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:08:48 2022] GET /compute/v2.1/servers/325d9b10-716d-4961-91d1-70962403fef4 => generated 1523 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:08:49.049480 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-b17a6aa0-e5a4-497d-9eb1-e6a0a0d2a82d tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7caa911d519e4711bf9a251b04ebe8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad554e982ff483098acf8a3b58e3842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:08:49.059949 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-b17a6aa0-e5a4-497d-9eb1-e6a0a0d2a82d tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] 10.222.0.58 "GET /compute/v2.1/servers/3fae69e0-e5f3-4ce8-89b5-5d0a410b7be1" status: 200 len: 1223 microversion: 2.1 time: 0.231705 Aug 10 23:08:49.065674 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1455/2853] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:08:48 2022] GET /compute/v2.1/servers/3fae69e0-e5f3-4ce8-89b5-5d0a410b7be1 => generated 1223 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:08:49.081432 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-3639cd30-0dd5-43ea-a873-6750194e99b5 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1536887510", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:08:49.125082 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-059559c7-f210-43ca-b7a6-affa0d04f663 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-74724784", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "0f74d905-71e6-4aaa-9b67-11dfa71800b3"}]}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:08:49.261038 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.network.neutron [None req-3639cd30-0dd5-43ea-a873-6750194e99b5 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] validate_networks() for [('a39e9883-f478-46d6-a0c8-5018e7a936ff', None, None, None, None, None)] {{(pid=122633) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 23:08:49.278333 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.network.neutron [None req-059559c7-f210-43ca-b7a6-affa0d04f663 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] validate_networks() for [('0f74d905-71e6-4aaa-9b67-11dfa71800b3', None, None, None, None, None)] {{(pid=122632) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 23:08:50.372972 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-3639cd30-0dd5-43ea-a873-6750194e99b5 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Flavor limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:08:50.373521 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-3639cd30-0dd5-43ea-a873-6750194e99b5 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Image limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:08:50.373860 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-3639cd30-0dd5-43ea-a873-6750194e99b5 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Flavor pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:08:50.374274 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-3639cd30-0dd5-43ea-a873-6750194e99b5 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Image pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:08:50.374689 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-3639cd30-0dd5-43ea-a873-6750194e99b5 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:08:50.390474 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3639cd30-0dd5-43ea-a873-6750194e99b5 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:50.390997 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3639cd30-0dd5-43ea-a873-6750194e99b5 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:50.391474 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3639cd30-0dd5-43ea-a873-6750194e99b5 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:50.392204 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3639cd30-0dd5-43ea-a873-6750194e99b5 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:50.392656 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3639cd30-0dd5-43ea-a873-6750194e99b5 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:50.393090 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3639cd30-0dd5-43ea-a873-6750194e99b5 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:50.453367 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-3639cd30-0dd5-43ea-a873-6750194e99b5 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Getting quotas for project 708f8d4c4ed6432d85e0bf6a9bac7677. Resources: {'instances', 'cores', 'ram'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:08:50.470162 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-3639cd30-0dd5-43ea-a873-6750194e99b5 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Getting quotas for user 55bbb4f184e4409d9eed51e0b98dfb29 and project 708f8d4c4ed6432d85e0bf6a9bac7677. Resources: {'instances', 'cores', 'ram'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:08:50.531601 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-3639cd30-0dd5-43ea-a873-6750194e99b5 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Going to run 1 instances... {{(pid=122633) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 23:08:50.546311 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-3639cd30-0dd5-43ea-a873-6750194e99b5 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] [instance: d09d04b1-bc37-4290-873e-ce2adae19eaf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78ad8905-f66f-4733-8be9-2b260f1fabed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122633) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 23:08:50.702354 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-3639cd30-0dd5-43ea-a873-6750194e99b5 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.634179 Aug 10 23:08:50.705185 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1456/2854] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 23:08:49 2022] POST /compute/v2.1/servers => generated 383 bytes in 1639 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 23:08:50.720293 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-825eb64b-e3f2-448f-a9df-f48feba11c36 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:08:50.721259 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-825eb64b-e3f2-448f-a9df-f48feba11c36 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] [instance: 23452b78-96cd-430d-b95c-aaa98a427d53] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:08:50.740027 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-825eb64b-e3f2-448f-a9df-f48feba11c36 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:50.743430 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-825eb64b-e3f2-448f-a9df-f48feba11c36 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:50.745053 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-825eb64b-e3f2-448f-a9df-f48feba11c36 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:50.746184 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-825eb64b-e3f2-448f-a9df-f48feba11c36 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:50.746922 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-825eb64b-e3f2-448f-a9df-f48feba11c36 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:50.747578 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-825eb64b-e3f2-448f-a9df-f48feba11c36 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:51.184053 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-825eb64b-e3f2-448f-a9df-f48feba11c36 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1986185dc9b4df4affcc421365462f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597863bfebdc481188f1f30095da5396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:08:51.212145 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-825eb64b-e3f2-448f-a9df-f48feba11c36 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] 10.222.0.58 "GET /compute/v2.1/servers/23452b78-96cd-430d-b95c-aaa98a427d53" status: 200 len: 1362 microversion: 2.1 time: 0.505547 Aug 10 23:08:51.215255 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1457/2855] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:08:50 2022] GET /compute/v2.1/servers/23452b78-96cd-430d-b95c-aaa98a427d53 => generated 1362 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:08:51.230494 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-b54ad109-8b93-4b32-922b-91ee4d1aa465 tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:08:51.240096 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-b54ad109-8b93-4b32-922b-91ee4d1aa465 tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] [instance: 61e7db28-1e60-444a-b6c0-dd65ef3f5a6b] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:08:51.255427 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b54ad109-8b93-4b32-922b-91ee4d1aa465 tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:51.258252 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b54ad109-8b93-4b32-922b-91ee4d1aa465 tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:51.261235 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b54ad109-8b93-4b32-922b-91ee4d1aa465 tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:51.262497 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b54ad109-8b93-4b32-922b-91ee4d1aa465 tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:51.263582 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b54ad109-8b93-4b32-922b-91ee4d1aa465 tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:51.264440 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b54ad109-8b93-4b32-922b-91ee4d1aa465 tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:51.656556 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-b54ad109-8b93-4b32-922b-91ee4d1aa465 tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca20e8ce3e25491fbe58f97ac5b9250a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e4512070fb74a32a9203526a025914e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:08:51.681153 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-b54ad109-8b93-4b32-922b-91ee4d1aa465 tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] 10.222.0.58 "GET /compute/v2.1/servers/61e7db28-1e60-444a-b6c0-dd65ef3f5a6b" status: 200 len: 1290 microversion: 2.1 time: 0.464589 Aug 10 23:08:51.681779 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1458/2856] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:08:51 2022] GET /compute/v2.1/servers/61e7db28-1e60-444a-b6c0-dd65ef3f5a6b => generated 1290 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:08:51.706258 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-10f63084-428b-4a0f-9130-e8a5a6b274ab tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:08:51.710890 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-10f63084-428b-4a0f-9130-e8a5a6b274ab tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] [instance: a632bb08-327b-4870-9f4e-90f8d0d863d0] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:08:51.739128 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-10f63084-428b-4a0f-9130-e8a5a6b274ab tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:51.741277 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-10f63084-428b-4a0f-9130-e8a5a6b274ab tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:51.742570 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-10f63084-428b-4a0f-9130-e8a5a6b274ab tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:51.748513 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-10f63084-428b-4a0f-9130-e8a5a6b274ab tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:51.749787 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-10f63084-428b-4a0f-9130-e8a5a6b274ab tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:51.751126 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-10f63084-428b-4a0f-9130-e8a5a6b274ab tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:52.470326 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-059559c7-f210-43ca-b7a6-affa0d04f663 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Flavor limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:08:52.471054 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-059559c7-f210-43ca-b7a6-affa0d04f663 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Image limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:08:52.471627 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-059559c7-f210-43ca-b7a6-affa0d04f663 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Flavor pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:08:52.472303 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-059559c7-f210-43ca-b7a6-affa0d04f663 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Image pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:08:52.472917 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-059559c7-f210-43ca-b7a6-affa0d04f663 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:08:52.491746 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-059559c7-f210-43ca-b7a6-affa0d04f663 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:52.494929 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-059559c7-f210-43ca-b7a6-affa0d04f663 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:52.495498 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-059559c7-f210-43ca-b7a6-affa0d04f663 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:52.496389 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-059559c7-f210-43ca-b7a6-affa0d04f663 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:52.496957 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-059559c7-f210-43ca-b7a6-affa0d04f663 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:52.499681 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-059559c7-f210-43ca-b7a6-affa0d04f663 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:52.554946 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-059559c7-f210-43ca-b7a6-affa0d04f663 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Getting quotas for project a7f70700e035444c9f2c9fa491c5c41a. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:08:52.563774 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-059559c7-f210-43ca-b7a6-affa0d04f663 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Getting quotas for user 1ca7d06f2acb44558d405a3b35a59550 and project a7f70700e035444c9f2c9fa491c5c41a. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:08:52.583875 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-059559c7-f210-43ca-b7a6-affa0d04f663 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Going to run 2 instances... {{(pid=122632) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 23:08:52.587173 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-059559c7-f210-43ca-b7a6-affa0d04f663 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] [instance: d884a052-b397-41de-93d5-577428e292c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78ad8905-f66f-4733-8be9-2b260f1fabed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122632) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 23:08:52.741528 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-059559c7-f210-43ca-b7a6-affa0d04f663 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] [instance: 5ea8116b-d76a-4b57-9d22-c6a3b8b10867] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78ad8905-f66f-4733-8be9-2b260f1fabed',instance=,instance_uuid=d884a052-b397-41de-93d5-577428e292c1,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122632) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 23:08:52.759429 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-10f63084-428b-4a0f-9130-e8a5a6b274ab tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d235607afb4ba59ed6ac2908c6dc33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5881784cbc4d669ad7fa40880ed9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:08:52.808409 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-10f63084-428b-4a0f-9130-e8a5a6b274ab tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] 10.222.0.58 "GET /compute/v2.1/servers/a632bb08-327b-4870-9f4e-90f8d0d863d0" status: 200 len: 1472 microversion: 2.1 time: 1.099795 Aug 10 23:08:52.810763 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1459/2857] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:08:51 2022] GET /compute/v2.1/servers/a632bb08-327b-4870-9f4e-90f8d0d863d0 => generated 1472 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:08:52.835462 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-ca8c48bc-d3d2-4629-ad7f-1478660887ea tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:08:52.837795 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-ca8c48bc-d3d2-4629-ad7f-1478660887ea tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] [instance: 325d9b10-716d-4961-91d1-70962403fef4] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:08:52.850777 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ca8c48bc-d3d2-4629-ad7f-1478660887ea tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:52.852074 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ca8c48bc-d3d2-4629-ad7f-1478660887ea tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:52.852848 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ca8c48bc-d3d2-4629-ad7f-1478660887ea tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:52.854157 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ca8c48bc-d3d2-4629-ad7f-1478660887ea tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:52.854973 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ca8c48bc-d3d2-4629-ad7f-1478660887ea tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:52.855925 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ca8c48bc-d3d2-4629-ad7f-1478660887ea tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:52.922708 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-059559c7-f210-43ca-b7a6-affa0d04f663 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.984822 Aug 10 23:08:52.929948 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1399/2858] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 23:08:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 3995 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 23:08:52.948207 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-e79990d0-3246-4648-b84b-27ac89bbf435 tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:08:52.955154 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-e79990d0-3246-4648-b84b-27ac89bbf435 tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] [instance: 3fae69e0-e5f3-4ce8-89b5-5d0a410b7be1] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:08:52.983737 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e79990d0-3246-4648-b84b-27ac89bbf435 tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:52.984601 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e79990d0-3246-4648-b84b-27ac89bbf435 tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:52.985244 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e79990d0-3246-4648-b84b-27ac89bbf435 tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:52.992011 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e79990d0-3246-4648-b84b-27ac89bbf435 tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:52.992775 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e79990d0-3246-4648-b84b-27ac89bbf435 tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:52.993375 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e79990d0-3246-4648-b84b-27ac89bbf435 tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:53.206110 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-ca8c48bc-d3d2-4629-ad7f-1478660887ea tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84e70c3ea5347e79ba5aee661b15ce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ab3ad5c0ef448aaa1282112bf20d83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:08:53.221398 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-ca8c48bc-d3d2-4629-ad7f-1478660887ea tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] 10.222.0.58 "GET /compute/v2.1/servers/325d9b10-716d-4961-91d1-70962403fef4" status: 200 len: 1523 microversion: 2.1 time: 0.409089 Aug 10 23:08:53.252000 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1460/2859] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:08:52 2022] GET /compute/v2.1/servers/325d9b10-716d-4961-91d1-70962403fef4 => generated 1523 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:08:53.274326 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-ebc15196-4e94-4ac4-9f5a-3a8126cdc050 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:08:53.277409 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-ebc15196-4e94-4ac4-9f5a-3a8126cdc050 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] [instance: d09d04b1-bc37-4290-873e-ce2adae19eaf] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:08:53.303646 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ebc15196-4e94-4ac4-9f5a-3a8126cdc050 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:53.304319 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ebc15196-4e94-4ac4-9f5a-3a8126cdc050 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:53.305596 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ebc15196-4e94-4ac4-9f5a-3a8126cdc050 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:53.306386 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ebc15196-4e94-4ac4-9f5a-3a8126cdc050 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:53.310572 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ebc15196-4e94-4ac4-9f5a-3a8126cdc050 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:53.311278 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ebc15196-4e94-4ac4-9f5a-3a8126cdc050 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:53.469695 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-ebc15196-4e94-4ac4-9f5a-3a8126cdc050 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bbb4f184e4409d9eed51e0b98dfb29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708f8d4c4ed6432d85e0bf6a9bac7677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:08:53.474287 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:08:53.523847 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-ebc15196-4e94-4ac4-9f5a-3a8126cdc050 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] 10.222.0.58 "GET /compute/v2.1/servers/d09d04b1-bc37-4290-873e-ce2adae19eaf" status: 200 len: 1295 microversion: 2.1 time: 0.269325 Aug 10 23:08:53.532069 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1461/2860] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:08:53 2022] GET /compute/v2.1/servers/d09d04b1-bc37-4290-873e-ce2adae19eaf => generated 1295 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:08:53.539983 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-cd951c3f-f67c-478f-9262-990b2cdc5110 req-653e7e77-a478-4b70-bae0-9ed4a2de43fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23452b78-96cd-430d-b95c-aaa98a427d53", "tag": "a958a4d3-19d0-46d8-bea8-676cb2161b89"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:08:53.552881 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-cd951c3f-f67c-478f-9262-990b2cdc5110 req-653e7e77-a478-4b70-bae0-9ed4a2de43fd service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:53.554533 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-cd951c3f-f67c-478f-9262-990b2cdc5110 req-653e7e77-a478-4b70-bae0-9ed4a2de43fd service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:53.555353 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-cd951c3f-f67c-478f-9262-990b2cdc5110 req-653e7e77-a478-4b70-bae0-9ed4a2de43fd service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:53.569603 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-cd951c3f-f67c-478f-9262-990b2cdc5110 req-653e7e77-a478-4b70-bae0-9ed4a2de43fd service nova] Creating event network-changed:a958a4d3-19d0-46d8-bea8-676cb2161b89 for instance 23452b78-96cd-430d-b95c-aaa98a427d53 on n-h2-850468-14 Aug 10 23:08:53.576598 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-cd951c3f-f67c-478f-9262-990b2cdc5110 req-653e7e77-a478-4b70-bae0-9ed4a2de43fd service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042253 Aug 10 23:08:53.583002 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1462/2861] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:08:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:08:53.588932 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-68fd203a-7fb8-41d9-b550-53ef7cdb76ff tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:08:53.590181 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-68fd203a-7fb8-41d9-b550-53ef7cdb76ff tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] [instance: 23452b78-96cd-430d-b95c-aaa98a427d53] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:08:53.605601 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-68fd203a-7fb8-41d9-b550-53ef7cdb76ff tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:53.606441 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-68fd203a-7fb8-41d9-b550-53ef7cdb76ff tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:53.607774 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-68fd203a-7fb8-41d9-b550-53ef7cdb76ff tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:53.608927 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-68fd203a-7fb8-41d9-b550-53ef7cdb76ff tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:53.609700 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-68fd203a-7fb8-41d9-b550-53ef7cdb76ff tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:53.610380 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-68fd203a-7fb8-41d9-b550-53ef7cdb76ff tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:53.637879 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-e79990d0-3246-4648-b84b-27ac89bbf435 tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7caa911d519e4711bf9a251b04ebe8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad554e982ff483098acf8a3b58e3842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:08:53.653976 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-e79990d0-3246-4648-b84b-27ac89bbf435 tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] 10.222.0.58 "GET /compute/v2.1/servers/3fae69e0-e5f3-4ce8-89b5-5d0a410b7be1" status: 200 len: 1281 microversion: 2.1 time: 0.720179 Aug 10 23:08:53.657955 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1400/2862] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:08:52 2022] GET /compute/v2.1/servers/3fae69e0-e5f3-4ce8-89b5-5d0a410b7be1 => generated 1281 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:08:53.689622 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-fa93761d-a802-4790-b282-57fb0d4f2c38 tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:08:53.695789 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-fa93761d-a802-4790-b282-57fb0d4f2c38 tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] [instance: 61e7db28-1e60-444a-b6c0-dd65ef3f5a6b] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:08:53.719991 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fa93761d-a802-4790-b282-57fb0d4f2c38 tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:53.720517 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fa93761d-a802-4790-b282-57fb0d4f2c38 tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:53.722818 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fa93761d-a802-4790-b282-57fb0d4f2c38 tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:53.724889 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fa93761d-a802-4790-b282-57fb0d4f2c38 tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:53.728089 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fa93761d-a802-4790-b282-57fb0d4f2c38 tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:53.732011 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fa93761d-a802-4790-b282-57fb0d4f2c38 tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:53.858643 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-68fd203a-7fb8-41d9-b550-53ef7cdb76ff tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1986185dc9b4df4affcc421365462f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597863bfebdc481188f1f30095da5396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:08:53.867722 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-68fd203a-7fb8-41d9-b550-53ef7cdb76ff tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] 10.222.0.58 "GET /compute/v2.1/servers/23452b78-96cd-430d-b95c-aaa98a427d53" status: 200 len: 1362 microversion: 2.1 time: 0.283079 Aug 10 23:08:53.869384 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1463/2863] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:08:53 2022] GET /compute/v2.1/servers/23452b78-96cd-430d-b95c-aaa98a427d53 => generated 1362 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:08:53.909659 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-9ae546d1-9e63-455a-8c6b-60bffafa3fd8 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:08:53.923339 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-9ae546d1-9e63-455a-8c6b-60bffafa3fd8 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1ca7d06f2acb44558d405a3b35a59550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7f70700e035444c9f2c9fa491c5c41a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:08:53.926088 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-9ae546d1-9e63-455a-8c6b-60bffafa3fd8 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Searching by: {'deleted': False, 'project_id': 'a7f70700e035444c9f2c9fa491c5c41a'} {{(pid=122633) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 10 23:08:53.979842 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9ae546d1-9e63-455a-8c6b-60bffafa3fd8 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:53.981585 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9ae546d1-9e63-455a-8c6b-60bffafa3fd8 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:53.983305 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9ae546d1-9e63-455a-8c6b-60bffafa3fd8 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:53.986112 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9ae546d1-9e63-455a-8c6b-60bffafa3fd8 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:53.992445 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9ae546d1-9e63-455a-8c6b-60bffafa3fd8 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:53.994299 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9ae546d1-9e63-455a-8c6b-60bffafa3fd8 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:54.050414 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-9ae546d1-9e63-455a-8c6b-60bffafa3fd8 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] 10.222.0.58 "GET /compute/v2.1/servers" status: 200 len: 673 microversion: 2.1 time: 0.176662 Aug 10 23:08:54.051253 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1464/2864] 10.222.0.58 () {58 vars in 1125 bytes} [Wed Aug 10 23:08:53 2022] GET /compute/v2.1/servers => generated 673 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:08:54.066931 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-75f30d6a-967d-4e45-a9f4-be70ee9467cd tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:08:54.068468 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-75f30d6a-967d-4e45-a9f4-be70ee9467cd tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] [instance: a632bb08-327b-4870-9f4e-90f8d0d863d0] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:08:54.080039 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-75f30d6a-967d-4e45-a9f4-be70ee9467cd tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:54.081290 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-75f30d6a-967d-4e45-a9f4-be70ee9467cd tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:54.082030 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-75f30d6a-967d-4e45-a9f4-be70ee9467cd tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:54.083291 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-75f30d6a-967d-4e45-a9f4-be70ee9467cd tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:54.083914 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-75f30d6a-967d-4e45-a9f4-be70ee9467cd tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:54.086469 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-75f30d6a-967d-4e45-a9f4-be70ee9467cd tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:54.244862 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-75f30d6a-967d-4e45-a9f4-be70ee9467cd tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10d235607afb4ba59ed6ac2908c6dc33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de5881784cbc4d669ad7fa40880ed9c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:08:54.256871 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-75f30d6a-967d-4e45-a9f4-be70ee9467cd tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] 10.222.0.58 "GET /compute/v2.1/servers/a632bb08-327b-4870-9f4e-90f8d0d863d0" status: 200 len: 1430 microversion: 2.1 time: 0.196341 Aug 10 23:08:54.259444 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1465/2865] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:08:54 2022] GET /compute/v2.1/servers/a632bb08-327b-4870-9f4e-90f8d0d863d0 => generated 1430 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:08:54.267075 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-94067cd5-6112-4e49-989c-6ea7c942823a tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:08:54.275171 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-94067cd5-6112-4e49-989c-6ea7c942823a tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] [instance: 5ea8116b-d76a-4b57-9d22-c6a3b8b10867] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:08:54.488402 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-94067cd5-6112-4e49-989c-6ea7c942823a tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca7d06f2acb44558d405a3b35a59550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7f70700e035444c9f2c9fa491c5c41a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:08:54.499260 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-94067cd5-6112-4e49-989c-6ea7c942823a tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] 10.222.0.58 "GET /compute/v2.1/servers/5ea8116b-d76a-4b57-9d22-c6a3b8b10867" status: 200 len: 1218 microversion: 2.1 time: 0.236470 Aug 10 23:08:54.499903 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1466/2866] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:08:54 2022] GET /compute/v2.1/servers/5ea8116b-d76a-4b57-9d22-c6a3b8b10867 => generated 1218 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:08:54.513368 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-4ac06aec-d8ed-466a-9e55-eceaf9e13f93 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:08:54.513368 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-4ac06aec-d8ed-466a-9e55-eceaf9e13f93 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] [instance: 325d9b10-716d-4961-91d1-70962403fef4] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:08:54.551889 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4ac06aec-d8ed-466a-9e55-eceaf9e13f93 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:54.555907 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4ac06aec-d8ed-466a-9e55-eceaf9e13f93 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:54.556526 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4ac06aec-d8ed-466a-9e55-eceaf9e13f93 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:54.559572 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4ac06aec-d8ed-466a-9e55-eceaf9e13f93 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:54.560356 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4ac06aec-d8ed-466a-9e55-eceaf9e13f93 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:54.561804 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4ac06aec-d8ed-466a-9e55-eceaf9e13f93 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:54.935525 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-fa93761d-a802-4790-b282-57fb0d4f2c38 tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca20e8ce3e25491fbe58f97ac5b9250a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e4512070fb74a32a9203526a025914e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:08:54.975023 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-fa93761d-a802-4790-b282-57fb0d4f2c38 tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] 10.222.0.58 "GET /compute/v2.1/servers/61e7db28-1e60-444a-b6c0-dd65ef3f5a6b" status: 200 len: 1332 microversion: 2.1 time: 1.303014 Aug 10 23:08:54.984765 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1401/2867] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:08:53 2022] GET /compute/v2.1/servers/61e7db28-1e60-444a-b6c0-dd65ef3f5a6b => generated 1332 bytes in 1326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:08:55.010654 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-43378558-0dee-4a93-809b-e9dc8a00f535 req-d5370998-7175-4192-8e29-eba31a8ac16e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a632bb08-327b-4870-9f4e-90f8d0d863d0", "name": "network-vif-deleted", "tag": "c03a409d-cb49-445d-9fc1-ff05f4b1ff2b"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:08:55.044938 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-43378558-0dee-4a93-809b-e9dc8a00f535 req-d5370998-7175-4192-8e29-eba31a8ac16e service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:55.059570 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-43378558-0dee-4a93-809b-e9dc8a00f535 req-d5370998-7175-4192-8e29-eba31a8ac16e service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:55.063782 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-43378558-0dee-4a93-809b-e9dc8a00f535 req-d5370998-7175-4192-8e29-eba31a8ac16e service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:55.089179 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-4ac06aec-d8ed-466a-9e55-eceaf9e13f93 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84e70c3ea5347e79ba5aee661b15ce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ab3ad5c0ef448aaa1282112bf20d83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:08:55.104103 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-4ac06aec-d8ed-466a-9e55-eceaf9e13f93 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] 10.222.0.58 "GET /compute/v2.1/servers/325d9b10-716d-4961-91d1-70962403fef4" status: 200 len: 1503 microversion: 2.1 time: 0.603113 Aug 10 23:08:55.119747 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1467/2868] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:08:54 2022] GET /compute/v2.1/servers/325d9b10-716d-4961-91d1-70962403fef4 => generated 1503 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:08:55.133051 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-43378558-0dee-4a93-809b-e9dc8a00f535 req-d5370998-7175-4192-8e29-eba31a8ac16e service nova] Creating event network-vif-deleted:c03a409d-cb49-445d-9fc1-ff05f4b1ff2b for instance a632bb08-327b-4870-9f4e-90f8d0d863d0 on n-h1-850468-14 Aug 10 23:08:55.135907 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-fce57d71-2c36-401c-88b8-66dbd3de6a3f tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:08:55.139019 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-fce57d71-2c36-401c-88b8-66dbd3de6a3f tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] [instance: d09d04b1-bc37-4290-873e-ce2adae19eaf] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:08:55.142226 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:08:55.146136 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fce57d71-2c36-401c-88b8-66dbd3de6a3f tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:55.146636 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fce57d71-2c36-401c-88b8-66dbd3de6a3f tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:55.147209 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fce57d71-2c36-401c-88b8-66dbd3de6a3f tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:55.148672 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fce57d71-2c36-401c-88b8-66dbd3de6a3f tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:55.149153 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fce57d71-2c36-401c-88b8-66dbd3de6a3f tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:55.149622 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fce57d71-2c36-401c-88b8-66dbd3de6a3f tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:55.164784 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-43378558-0dee-4a93-809b-e9dc8a00f535 req-d5370998-7175-4192-8e29-eba31a8ac16e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.172909 Aug 10 23:08:55.166618 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1402/2869] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:08:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:08:55.186824 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-97e41e21-e538-4f7e-8954-c56d9c6454ff tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:08:55.195859 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-97e41e21-e538-4f7e-8954-c56d9c6454ff tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] [instance: 3fae69e0-e5f3-4ce8-89b5-5d0a410b7be1] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:08:55.227365 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-97e41e21-e538-4f7e-8954-c56d9c6454ff tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:55.227870 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-97e41e21-e538-4f7e-8954-c56d9c6454ff tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:55.228311 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-97e41e21-e538-4f7e-8954-c56d9c6454ff tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:55.229035 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-97e41e21-e538-4f7e-8954-c56d9c6454ff tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:55.232789 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-97e41e21-e538-4f7e-8954-c56d9c6454ff tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:55.233403 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-97e41e21-e538-4f7e-8954-c56d9c6454ff tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:55.322188 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-fce57d71-2c36-401c-88b8-66dbd3de6a3f tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bbb4f184e4409d9eed51e0b98dfb29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708f8d4c4ed6432d85e0bf6a9bac7677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:08:55.333493 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-fce57d71-2c36-401c-88b8-66dbd3de6a3f tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] 10.222.0.58 "GET /compute/v2.1/servers/d09d04b1-bc37-4290-873e-ce2adae19eaf" status: 200 len: 1283 microversion: 2.1 time: 0.212600 Aug 10 23:08:55.337452 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1468/2870] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:08:55 2022] GET /compute/v2.1/servers/d09d04b1-bc37-4290-873e-ce2adae19eaf => generated 1283 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:08:55.349121 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c8c7a48c-236b-4380-9770-d1d64c8a7052 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:08:55.353172 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-c8c7a48c-236b-4380-9770-d1d64c8a7052 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] [instance: 23452b78-96cd-430d-b95c-aaa98a427d53] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:08:55.371364 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c8c7a48c-236b-4380-9770-d1d64c8a7052 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:55.375464 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c8c7a48c-236b-4380-9770-d1d64c8a7052 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:55.377926 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c8c7a48c-236b-4380-9770-d1d64c8a7052 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:55.380613 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c8c7a48c-236b-4380-9770-d1d64c8a7052 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:55.384171 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c8c7a48c-236b-4380-9770-d1d64c8a7052 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:55.384899 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c8c7a48c-236b-4380-9770-d1d64c8a7052 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:55.751684 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-c8c7a48c-236b-4380-9770-d1d64c8a7052 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1986185dc9b4df4affcc421365462f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597863bfebdc481188f1f30095da5396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:08:55.761158 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-c8c7a48c-236b-4380-9770-d1d64c8a7052 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] 10.222.0.58 "GET /compute/v2.1/servers/23452b78-96cd-430d-b95c-aaa98a427d53" status: 200 len: 1362 microversion: 2.1 time: 0.421823 Aug 10 23:08:55.765167 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1469/2871] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:08:55 2022] GET /compute/v2.1/servers/23452b78-96cd-430d-b95c-aaa98a427d53 => generated 1362 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:08:55.778711 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-7de9ea67-ae70-412b-b6c2-5b9ab120e64f tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Action: 'create', calling method: .version_select at 0x7f847c4f14c0>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1471933599", "description": "tempest-description-1380294817"}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:08:56.550202 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-97e41e21-e538-4f7e-8954-c56d9c6454ff tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7caa911d519e4711bf9a251b04ebe8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad554e982ff483098acf8a3b58e3842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:08:56.564106 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-97e41e21-e538-4f7e-8954-c56d9c6454ff tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] 10.222.0.58 "GET /compute/v2.1/servers/3fae69e0-e5f3-4ce8-89b5-5d0a410b7be1" status: 200 len: 1323 microversion: 2.1 time: 1.396193 Aug 10 23:08:56.570120 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1403/2872] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:08:55 2022] GET /compute/v2.1/servers/3fae69e0-e5f3-4ce8-89b5-5d0a410b7be1 => generated 1323 bytes in 1403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:08:56.587316 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-d14a1234-a147-44f5-ba0d-13b5c5b47d00 tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:08:56.588373 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-d14a1234-a147-44f5-ba0d-13b5c5b47d00 tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] [instance: a632bb08-327b-4870-9f4e-90f8d0d863d0] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:08:56.608885 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d14a1234-a147-44f5-ba0d-13b5c5b47d00 tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:56.616403 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d14a1234-a147-44f5-ba0d-13b5c5b47d00 tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:56.617973 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d14a1234-a147-44f5-ba0d-13b5c5b47d00 tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:56.619019 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d14a1234-a147-44f5-ba0d-13b5c5b47d00 tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:56.621176 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d14a1234-a147-44f5-ba0d-13b5c5b47d00 tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:56.624883 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d14a1234-a147-44f5-ba0d-13b5c5b47d00 tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:56.661934 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-d14a1234-a147-44f5-ba0d-13b5c5b47d00 tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] HTTP exception thrown: Instance a632bb08-327b-4870-9f4e-90f8d0d863d0 could not be found. Aug 10 23:08:56.668468 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-d14a1234-a147-44f5-ba0d-13b5c5b47d00 tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Request method failure captured: Aug 10 23:08:56.668468 n-d-850468-14 devstack@n-api.service[122632]: request: GET /compute/v2.1/servers/a632bb08-327b-4870-9f4e-90f8d0d863d0 HTTP/1.1 Aug 10 23:08:56.668468 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:08:56.668468 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:08:56.668468 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:08:56.668468 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 23:08:56.668468 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:08:56.668468 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:08:56.668468 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:08:56.668468 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:08:56.668468 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9DokeNMeiboBcHod0DVDkUURTwvtpn7HJKP5tx7M5EdCSsg6x58QQe0n7YdoDGTpztweFjKI6CCh06jNam2UkNuq25elSk8XchgqlShgo_k9VvqntaThhMbZR4SNsj29MfhbIOnvalaEITzobOjvW4fECzJaG8MI_z-RQWJCNK_qZ-I Aug 10 23:08:56.668468 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:08:56.668468 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:08:56.668468 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:08:56.668468 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:08:56.668468 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:08:56.668468 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:08:56.668468 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: de5881784cbc4d669ad7fa40880ed9c0 Aug 10 23:08:56.668468 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-ImagesOneServerTestJSON-435688088 Aug 10 23:08:56.668468 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:08:56.668468 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:08:56.669798 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/de5881784cbc4d669ad7fa40880ed9c0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/de5881784cbc4d669ad7fa40880ed9c0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/de5881784cbc4d669ad7fa40880ed9c0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_de5881784cbc4d669ad7fa40880ed9c0", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:08:56.669798 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-ImagesOneServerTestJSON-435688088 Aug 10 23:08:56.669798 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: de5881784cbc4d669ad7fa40880ed9c0 Aug 10 23:08:56.669798 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-435688088 Aug 10 23:08:56.669798 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-ImagesOneServerTestJSON-435688088-project Aug 10 23:08:56.669798 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:08:56.669798 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:08:56.669798 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: 10d235607afb4ba59ed6ac2908c6dc33 Aug 10 23:08:56.669798 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-ImagesOneServerTestJSON-435688088-project Aug 10 23:08:56.669798 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:08:56.669798 n-d-850468-14 devstack@n-api.service[122632]: exception: Instance a632bb08-327b-4870-9f4e-90f8d0d863d0 could not be found. Aug 10 23:08:56.669798 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': 'a632bb08-327b-4870-9f4e-90f8d0d863d0'} Aug 10 23:08:56.670533 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:08:56.670533 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:08:56.670533 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:08:56.670533 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:08:56.670533 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:08:56.670533 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:08:56.670533 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:08:56.670533 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:08:56.670533 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:08:56.670533 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:08:56.670533 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a632bb08-327b-4870-9f4e-90f8d0d863d0 could not be found. Aug 10 23:08:56.670533 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:08:56.670533 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:08:56.670533 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:08:56.670533 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:08:56.670533 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:08:56.670533 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:08:56.670533 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:08:56.670533 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:08:56.670533 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:08:56.671804 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:08:56.671804 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:08:56.671804 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:08:56.671804 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:08:56.671804 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:08:56.671804 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:08:56.671804 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:08:56.671804 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a632bb08-327b-4870-9f4e-90f8d0d863d0 could not be found. Aug 10 23:08:56.671804 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:08:56.671804 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:08:56.671804 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:08:56.671804 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:08:56.671804 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:08:56.671804 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:08:56.671804 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:08:56.671804 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:08:56.671804 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a632bb08-327b-4870-9f4e-90f8d0d863d0 could not be found. Aug 10 23:08:56.671804 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:08:56.677519 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-d14a1234-a147-44f5-ba0d-13b5c5b47d00 tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] Returning 404 to user: Instance a632bb08-327b-4870-9f4e-90f8d0d863d0 could not be found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:08:56.678929 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-d14a1234-a147-44f5-ba0d-13b5c5b47d00 tempest-ImagesOneServerTestJSON-435688088 tempest-ImagesOneServerTestJSON-435688088-project] 10.222.0.58 "GET /compute/v2.1/servers/a632bb08-327b-4870-9f4e-90f8d0d863d0" status: 404 len: 111 microversion: 2.1 time: 0.102941 Aug 10 23:08:56.682107 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1404/2873] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:08:56 2022] GET /compute/v2.1/servers/a632bb08-327b-4870-9f4e-90f8d0d863d0 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:08:56.683120 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-7de9ea67-ae70-412b-b6c2-5b9ab120e64f tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] 10.222.0.58 "POST /compute/v2.1/os-security-groups" status: 200 len: 251 microversion: 2.1 time: 0.915681 Aug 10 23:08:56.683967 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1470/2874] 10.222.0.58 () {60 vars in 1180 bytes} [Wed Aug 10 23:08:55 2022] POST /compute/v2.1/os-security-groups => generated 251 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:08:56.688575 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-215b051b-d1e7-401c-8cf0-9d885399cf29 tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:08:56.689186 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-215b051b-d1e7-401c-8cf0-9d885399cf29 tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] [instance: 61e7db28-1e60-444a-b6c0-dd65ef3f5a6b] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:08:56.702109 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-215b051b-d1e7-401c-8cf0-9d885399cf29 tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:56.702612 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-215b051b-d1e7-401c-8cf0-9d885399cf29 tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:56.707273 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-215b051b-d1e7-401c-8cf0-9d885399cf29 tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:56.708080 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-215b051b-d1e7-401c-8cf0-9d885399cf29 tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:56.708567 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-215b051b-d1e7-401c-8cf0-9d885399cf29 tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:56.709008 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-215b051b-d1e7-401c-8cf0-9d885399cf29 tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:56.711075 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-3730afd7-893b-48e5-bbcc-d1c6e07d9077 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:08:56.724212 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-3730afd7-893b-48e5-bbcc-d1c6e07d9077 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] [instance: 5ea8116b-d76a-4b57-9d22-c6a3b8b10867] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:08:56.749391 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3730afd7-893b-48e5-bbcc-d1c6e07d9077 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:56.753804 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3730afd7-893b-48e5-bbcc-d1c6e07d9077 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:56.754613 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3730afd7-893b-48e5-bbcc-d1c6e07d9077 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:56.757156 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3730afd7-893b-48e5-bbcc-d1c6e07d9077 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:56.767807 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3730afd7-893b-48e5-bbcc-d1c6e07d9077 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:56.769660 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3730afd7-893b-48e5-bbcc-d1c6e07d9077 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:57.136567 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-215b051b-d1e7-401c-8cf0-9d885399cf29 tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca20e8ce3e25491fbe58f97ac5b9250a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e4512070fb74a32a9203526a025914e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:08:57.146440 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-215b051b-d1e7-401c-8cf0-9d885399cf29 tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] 10.222.0.58 "GET /compute/v2.1/servers/61e7db28-1e60-444a-b6c0-dd65ef3f5a6b" status: 200 len: 1332 microversion: 2.1 time: 0.461403 Aug 10 23:08:57.154508 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1471/2875] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:08:56 2022] GET /compute/v2.1/servers/61e7db28-1e60-444a-b6c0-dd65ef3f5a6b => generated 1332 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:08:57.169050 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-d7d25845-6b3b-46c9-88f4-b716ab941eb9 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:08:57.173972 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-d7d25845-6b3b-46c9-88f4-b716ab941eb9 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] [instance: d09d04b1-bc37-4290-873e-ce2adae19eaf] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:08:57.186574 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d7d25845-6b3b-46c9-88f4-b716ab941eb9 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:57.188090 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d7d25845-6b3b-46c9-88f4-b716ab941eb9 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:57.188712 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d7d25845-6b3b-46c9-88f4-b716ab941eb9 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:57.191221 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d7d25845-6b3b-46c9-88f4-b716ab941eb9 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:57.192120 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d7d25845-6b3b-46c9-88f4-b716ab941eb9 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:57.192743 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d7d25845-6b3b-46c9-88f4-b716ab941eb9 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:57.695431 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-d7d25845-6b3b-46c9-88f4-b716ab941eb9 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bbb4f184e4409d9eed51e0b98dfb29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708f8d4c4ed6432d85e0bf6a9bac7677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:08:57.705554 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-d7d25845-6b3b-46c9-88f4-b716ab941eb9 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] 10.222.0.58 "GET /compute/v2.1/servers/d09d04b1-bc37-4290-873e-ce2adae19eaf" status: 200 len: 1325 microversion: 2.1 time: 0.549596 Aug 10 23:08:57.706161 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1472/2876] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:08:57 2022] GET /compute/v2.1/servers/d09d04b1-bc37-4290-873e-ce2adae19eaf => generated 1325 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:08:57.724454 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-7de7c8fc-441a-4122-aa42-e8abf4262850 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1471933599"}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:08:57.725906 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-7de7c8fc-441a-4122-aa42-e8abf4262850 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] [instance: 325d9b10-716d-4961-91d1-70962403fef4] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:08:57.739785 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7de7c8fc-441a-4122-aa42-e8abf4262850 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:57.741349 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7de7c8fc-441a-4122-aa42-e8abf4262850 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:57.743818 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7de7c8fc-441a-4122-aa42-e8abf4262850 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:57.749930 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7de7c8fc-441a-4122-aa42-e8abf4262850 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:57.750426 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7de7c8fc-441a-4122-aa42-e8abf4262850 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:57.751119 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7de7c8fc-441a-4122-aa42-e8abf4262850 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:57.770295 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-3730afd7-893b-48e5-bbcc-d1c6e07d9077 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca7d06f2acb44558d405a3b35a59550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7f70700e035444c9f2c9fa491c5c41a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:08:57.781407 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-3730afd7-893b-48e5-bbcc-d1c6e07d9077 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] 10.222.0.58 "GET /compute/v2.1/servers/5ea8116b-d76a-4b57-9d22-c6a3b8b10867" status: 200 len: 1276 microversion: 2.1 time: 1.096897 Aug 10 23:08:57.786703 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1405/2877] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:08:56 2022] GET /compute/v2.1/servers/5ea8116b-d76a-4b57-9d22-c6a3b8b10867 => generated 1276 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:08:57.795678 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-4b952beb-b7bb-4665-8de5-ca7746594056 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:08:57.801643 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-4b952beb-b7bb-4665-8de5-ca7746594056 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] [instance: 23452b78-96cd-430d-b95c-aaa98a427d53] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:08:57.811971 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4b952beb-b7bb-4665-8de5-ca7746594056 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:57.812466 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4b952beb-b7bb-4665-8de5-ca7746594056 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:57.819390 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4b952beb-b7bb-4665-8de5-ca7746594056 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:57.820233 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4b952beb-b7bb-4665-8de5-ca7746594056 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:57.820720 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4b952beb-b7bb-4665-8de5-ca7746594056 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:57.821167 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4b952beb-b7bb-4665-8de5-ca7746594056 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:58.116246 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.network.security_group_api [None req-7de7c8fc-441a-4122-aa42-e8abf4262850 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Adding security group 2b250132-528a-44eb-ba2d-36012444bfc6 to port 636830f5-e8dd-4490-8875-671bd1ac26f5 Aug 10 23:08:58.887957 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-4b952beb-b7bb-4665-8de5-ca7746594056 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1986185dc9b4df4affcc421365462f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597863bfebdc481188f1f30095da5396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:08:58.905311 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-4b952beb-b7bb-4665-8de5-ca7746594056 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] 10.222.0.58 "GET /compute/v2.1/servers/23452b78-96cd-430d-b95c-aaa98a427d53" status: 200 len: 1362 microversion: 2.1 time: 1.115196 Aug 10 23:08:58.906341 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1406/2878] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:08:57 2022] GET /compute/v2.1/servers/23452b78-96cd-430d-b95c-aaa98a427d53 => generated 1362 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:08:58.926002 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-d2f1e390-b2dd-4d7e-8f52-068bf17b65b9 tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:08:58.929920 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-d2f1e390-b2dd-4d7e-8f52-068bf17b65b9 tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] [instance: 3fae69e0-e5f3-4ce8-89b5-5d0a410b7be1] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:08:58.957493 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d2f1e390-b2dd-4d7e-8f52-068bf17b65b9 tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:58.959888 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d2f1e390-b2dd-4d7e-8f52-068bf17b65b9 tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:58.960709 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d2f1e390-b2dd-4d7e-8f52-068bf17b65b9 tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:58.963076 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d2f1e390-b2dd-4d7e-8f52-068bf17b65b9 tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:58.969020 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d2f1e390-b2dd-4d7e-8f52-068bf17b65b9 tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:58.972210 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d2f1e390-b2dd-4d7e-8f52-068bf17b65b9 tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:59.246073 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-7de7c8fc-441a-4122-aa42-e8abf4262850 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] 10.222.0.58 "POST /compute/v2.1/servers/325d9b10-716d-4961-91d1-70962403fef4/action" status: 202 len: 0 microversion: 2.1 time: 1.535714 Aug 10 23:08:59.247334 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1473/2879] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:08:57 2022] POST /compute/v2.1/servers/325d9b10-716d-4961-91d1-70962403fef4/action => generated 0 bytes in 1538 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:08:59.255566 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-7ec7b36c-0ec9-490f-93fb-ddecbdeb6a1c tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:08:59.256254 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-7ec7b36c-0ec9-490f-93fb-ddecbdeb6a1c tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] [instance: 61e7db28-1e60-444a-b6c0-dd65ef3f5a6b] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:08:59.264832 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7ec7b36c-0ec9-490f-93fb-ddecbdeb6a1c tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:59.265674 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7ec7b36c-0ec9-490f-93fb-ddecbdeb6a1c tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:59.266285 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7ec7b36c-0ec9-490f-93fb-ddecbdeb6a1c tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:59.268057 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7ec7b36c-0ec9-490f-93fb-ddecbdeb6a1c tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:59.269813 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7ec7b36c-0ec9-490f-93fb-ddecbdeb6a1c tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:59.270414 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7ec7b36c-0ec9-490f-93fb-ddecbdeb6a1c tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:59.602874 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-7ec7b36c-0ec9-490f-93fb-ddecbdeb6a1c tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca20e8ce3e25491fbe58f97ac5b9250a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e4512070fb74a32a9203526a025914e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:08:59.613336 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-7ec7b36c-0ec9-490f-93fb-ddecbdeb6a1c tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] 10.222.0.58 "GET /compute/v2.1/servers/61e7db28-1e60-444a-b6c0-dd65ef3f5a6b" status: 200 len: 1332 microversion: 2.1 time: 0.364726 Aug 10 23:08:59.613929 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1474/2880] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:08:59 2022] GET /compute/v2.1/servers/61e7db28-1e60-444a-b6c0-dd65ef3f5a6b => generated 1332 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:08:59.631576 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-4c294b67-bae7-411d-b7a9-c377718d5a89 req-a5787ea9-7d68-47d3-8432-76d453b348b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23452b78-96cd-430d-b95c-aaa98a427d53", "name": "network-vif-plugged", "status": "completed", "tag": "a958a4d3-19d0-46d8-bea8-676cb2161b89"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:08:59.642673 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-4c294b67-bae7-411d-b7a9-c377718d5a89 req-a5787ea9-7d68-47d3-8432-76d453b348b1 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:59.643470 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-4c294b67-bae7-411d-b7a9-c377718d5a89 req-a5787ea9-7d68-47d3-8432-76d453b348b1 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:59.644070 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-4c294b67-bae7-411d-b7a9-c377718d5a89 req-a5787ea9-7d68-47d3-8432-76d453b348b1 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:59.681035 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-4c294b67-bae7-411d-b7a9-c377718d5a89 req-a5787ea9-7d68-47d3-8432-76d453b348b1 service nova] Creating event network-vif-plugged:a958a4d3-19d0-46d8-bea8-676cb2161b89 for instance 23452b78-96cd-430d-b95c-aaa98a427d53 on n-h2-850468-14 Aug 10 23:08:59.686409 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-4c294b67-bae7-411d-b7a9-c377718d5a89 req-a5787ea9-7d68-47d3-8432-76d453b348b1 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068969 Aug 10 23:08:59.687352 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1475/2881] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:08:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:08:59.694345 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-8b7e1f1e-3606-439d-8f7c-463ad20979d8 req-6fe7d181-8d0d-46e0-877d-c93b9ebf257b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61e7db28-1e60-444a-b6c0-dd65ef3f5a6b", "tag": "993de175-c53f-4b4e-a8ba-348ecebfaf8f"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:08:59.707638 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-8b7e1f1e-3606-439d-8f7c-463ad20979d8 req-6fe7d181-8d0d-46e0-877d-c93b9ebf257b service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:59.708732 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-8b7e1f1e-3606-439d-8f7c-463ad20979d8 req-6fe7d181-8d0d-46e0-877d-c93b9ebf257b service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:59.709452 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-8b7e1f1e-3606-439d-8f7c-463ad20979d8 req-6fe7d181-8d0d-46e0-877d-c93b9ebf257b service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:59.723405 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-8b7e1f1e-3606-439d-8f7c-463ad20979d8 req-6fe7d181-8d0d-46e0-877d-c93b9ebf257b service nova] Creating event network-changed:993de175-c53f-4b4e-a8ba-348ecebfaf8f for instance 61e7db28-1e60-444a-b6c0-dd65ef3f5a6b on n-h1-850468-14 Aug 10 23:08:59.729908 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-8b7e1f1e-3606-439d-8f7c-463ad20979d8 req-6fe7d181-8d0d-46e0-877d-c93b9ebf257b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040632 Aug 10 23:08:59.731055 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1476/2882] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:08:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:08:59.737055 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-b9578c58-02fb-4f46-8514-4c1b6c68d432 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:08:59.738065 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-b9578c58-02fb-4f46-8514-4c1b6c68d432 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] [instance: d09d04b1-bc37-4290-873e-ce2adae19eaf] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:08:59.745291 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b9578c58-02fb-4f46-8514-4c1b6c68d432 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:59.746185 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b9578c58-02fb-4f46-8514-4c1b6c68d432 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:59.746839 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b9578c58-02fb-4f46-8514-4c1b6c68d432 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:59.748135 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b9578c58-02fb-4f46-8514-4c1b6c68d432 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:59.749210 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b9578c58-02fb-4f46-8514-4c1b6c68d432 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:59.749804 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b9578c58-02fb-4f46-8514-4c1b6c68d432 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:59.778437 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-d2f1e390-b2dd-4d7e-8f52-068bf17b65b9 tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7caa911d519e4711bf9a251b04ebe8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad554e982ff483098acf8a3b58e3842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:08:59.794734 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-d2f1e390-b2dd-4d7e-8f52-068bf17b65b9 tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] 10.222.0.58 "GET /compute/v2.1/servers/3fae69e0-e5f3-4ce8-89b5-5d0a410b7be1" status: 200 len: 1323 microversion: 2.1 time: 0.883776 Aug 10 23:08:59.795343 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1407/2883] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:08:58 2022] GET /compute/v2.1/servers/3fae69e0-e5f3-4ce8-89b5-5d0a410b7be1 => generated 1323 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:08:59.807018 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-3588f850-7c6f-40d7-bdb9-5d240dd0ab04 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:08:59.807935 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-3588f850-7c6f-40d7-bdb9-5d240dd0ab04 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] [instance: 5ea8116b-d76a-4b57-9d22-c6a3b8b10867] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:08:59.824452 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3588f850-7c6f-40d7-bdb9-5d240dd0ab04 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:59.824992 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3588f850-7c6f-40d7-bdb9-5d240dd0ab04 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:59.825389 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3588f850-7c6f-40d7-bdb9-5d240dd0ab04 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:59.826107 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3588f850-7c6f-40d7-bdb9-5d240dd0ab04 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:59.828051 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3588f850-7c6f-40d7-bdb9-5d240dd0ab04 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:59.828652 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3588f850-7c6f-40d7-bdb9-5d240dd0ab04 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:59.961155 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-b9578c58-02fb-4f46-8514-4c1b6c68d432 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bbb4f184e4409d9eed51e0b98dfb29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708f8d4c4ed6432d85e0bf6a9bac7677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:08:59.973523 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-b9578c58-02fb-4f46-8514-4c1b6c68d432 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] 10.222.0.58 "GET /compute/v2.1/servers/d09d04b1-bc37-4290-873e-ce2adae19eaf" status: 200 len: 1325 microversion: 2.1 time: 0.240959 Aug 10 23:08:59.974117 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1477/2884] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:08:59 2022] GET /compute/v2.1/servers/d09d04b1-bc37-4290-873e-ce2adae19eaf => generated 1325 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:08:59.979919 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-4a7ef557-e2d6-4ea2-a9d9-fa0ada5a7c56 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1471933599"}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:08:59.980664 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-4a7ef557-e2d6-4ea2-a9d9-fa0ada5a7c56 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] [instance: 325d9b10-716d-4961-91d1-70962403fef4] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:08:59.988853 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4a7ef557-e2d6-4ea2-a9d9-fa0ada5a7c56 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:59.990005 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4a7ef557-e2d6-4ea2-a9d9-fa0ada5a7c56 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:59.991142 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4a7ef557-e2d6-4ea2-a9d9-fa0ada5a7c56 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:08:59.992099 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4a7ef557-e2d6-4ea2-a9d9-fa0ada5a7c56 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:08:59.992631 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4a7ef557-e2d6-4ea2-a9d9-fa0ada5a7c56 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:08:59.993154 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4a7ef557-e2d6-4ea2-a9d9-fa0ada5a7c56 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:00.032766 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-3588f850-7c6f-40d7-bdb9-5d240dd0ab04 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca7d06f2acb44558d405a3b35a59550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7f70700e035444c9f2c9fa491c5c41a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:09:00.042250 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-3588f850-7c6f-40d7-bdb9-5d240dd0ab04 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] 10.222.0.58 "GET /compute/v2.1/servers/5ea8116b-d76a-4b57-9d22-c6a3b8b10867" status: 200 len: 1276 microversion: 2.1 time: 0.245682 Aug 10 23:09:00.055011 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1408/2885] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:08:59 2022] GET /compute/v2.1/servers/5ea8116b-d76a-4b57-9d22-c6a3b8b10867 => generated 1276 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:09:00.062355 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-69abfc98-a262-4d52-bcba-1d0073fc45b1 req-477201b0-abb3-4759-b50f-de652f96bd61 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "325d9b10-716d-4961-91d1-70962403fef4", "tag": "636830f5-e8dd-4490-8875-671bd1ac26f5"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:09:00.082307 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-69abfc98-a262-4d52-bcba-1d0073fc45b1 req-477201b0-abb3-4759-b50f-de652f96bd61 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:00.083116 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-69abfc98-a262-4d52-bcba-1d0073fc45b1 req-477201b0-abb3-4759-b50f-de652f96bd61 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:00.083736 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-69abfc98-a262-4d52-bcba-1d0073fc45b1 req-477201b0-abb3-4759-b50f-de652f96bd61 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:00.102663 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-69abfc98-a262-4d52-bcba-1d0073fc45b1 req-477201b0-abb3-4759-b50f-de652f96bd61 service nova] Creating event network-changed:636830f5-e8dd-4490-8875-671bd1ac26f5 for instance 325d9b10-716d-4961-91d1-70962403fef4 on n-h1-850468-14 Aug 10 23:09:00.108685 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-69abfc98-a262-4d52-bcba-1d0073fc45b1 req-477201b0-abb3-4759-b50f-de652f96bd61 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052104 Aug 10 23:09:00.109819 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1409/2886] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:09:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:09:00.268672 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.network.security_group_api [None req-4a7ef557-e2d6-4ea2-a9d9-fa0ada5a7c56 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Removing security group 2b250132-528a-44eb-ba2d-36012444bfc6 from port 636830f5-e8dd-4490-8875-671bd1ac26f5 Aug 10 23:09:00.346880 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-28887241-fbbc-416f-a765-18c824b4dd12 tempest-KeyPairsV2TestJSON-1954713352 tempest-KeyPairsV2TestJSON-1954713352-project] Action: 'create', calling method: .version_select at 0x7f847d084040>, body: {"keypair": {"name": "tempest-keypair-806039227", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNwbAFtED4k7xmAGHikDkEUhTi4107fMciKYEB5ziYTSl4oaxo+vaLjumi8jFRrD9Gb9cnnIbSygrayenXdoTj2KzTHqTQLohAGKENIY8eS/YVF0Bu6uqGj2FlAKf14SNw=="}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:09:00.383528 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-28887241-fbbc-416f-a765-18c824b4dd12 tempest-KeyPairsV2TestJSON-1954713352 tempest-KeyPairsV2TestJSON-1954713352-project] Getting quotas for project ef135fd725df4dfc9c841c24516dee02. Resources: {'key_pairs'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:09:00.392903 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-28887241-fbbc-416f-a765-18c824b4dd12 tempest-KeyPairsV2TestJSON-1954713352 tempest-KeyPairsV2TestJSON-1954713352-project] Getting quotas for user f5d3e1b0ef4d4c2c9b7e0f43848aed93 and project ef135fd725df4dfc9c841c24516dee02. Resources: {'key_pairs'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:09:00.421205 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=13 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:09:00.431982 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-28887241-fbbc-416f-a765-18c824b4dd12 tempest-KeyPairsV2TestJSON-1954713352 tempest-KeyPairsV2TestJSON-1954713352-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.320947 Aug 10 23:09:00.432600 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1410/2887] 10.222.0.58 () {60 vars in 1159 bytes} [Wed Aug 10 23:09:00 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:09:00.437133 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-8f916490-4cbe-4b8e-bbc5-dbd35b49a439 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:09:00.437879 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-8f916490-4cbe-4b8e-bbc5-dbd35b49a439 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] [instance: 23452b78-96cd-430d-b95c-aaa98a427d53] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:09:00.446358 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8f916490-4cbe-4b8e-bbc5-dbd35b49a439 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:00.446946 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8f916490-4cbe-4b8e-bbc5-dbd35b49a439 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:00.447389 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8f916490-4cbe-4b8e-bbc5-dbd35b49a439 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:00.448098 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8f916490-4cbe-4b8e-bbc5-dbd35b49a439 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:00.448549 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8f916490-4cbe-4b8e-bbc5-dbd35b49a439 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:00.448973 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8f916490-4cbe-4b8e-bbc5-dbd35b49a439 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:00.873825 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-8f916490-4cbe-4b8e-bbc5-dbd35b49a439 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1986185dc9b4df4affcc421365462f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597863bfebdc481188f1f30095da5396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:09:00.885026 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-8f916490-4cbe-4b8e-bbc5-dbd35b49a439 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] 10.222.0.58 "GET /compute/v2.1/servers/23452b78-96cd-430d-b95c-aaa98a427d53" status: 200 len: 1362 microversion: 2.1 time: 0.451089 Aug 10 23:09:00.898061 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1411/2888] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:09:00 2022] GET /compute/v2.1/servers/23452b78-96cd-430d-b95c-aaa98a427d53 => generated 1362 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:09:00.908123 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-b4f98d32-0be4-4f44-b295-204195fd1dd3 tempest-KeyPairsV2TestJSON-1954713352 tempest-KeyPairsV2TestJSON-1954713352-project] Calling method '.version_select at 0x7f847cfea9d0>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:09:00.928337 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-b4f98d32-0be4-4f44-b295-204195fd1dd3 tempest-KeyPairsV2TestJSON-1954713352 tempest-KeyPairsV2TestJSON-1954713352-project] 10.222.0.58 "GET /compute/v2.1/os-keypairs/tempest-keypair-806039227" status: 200 len: 497 microversion: 2.1 time: 0.028786 Aug 10 23:09:00.931596 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1412/2889] 10.222.0.58 () {58 vars in 1215 bytes} [Wed Aug 10 23:09:00 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-806039227 => generated 497 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:09:00.936900 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-4d31f42e-7cca-4611-810c-37ec7bf1506c tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:09:00.937848 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-4d31f42e-7cca-4611-810c-37ec7bf1506c tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] [instance: 61e7db28-1e60-444a-b6c0-dd65ef3f5a6b] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:09:00.945899 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4d31f42e-7cca-4611-810c-37ec7bf1506c tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:00.947917 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4d31f42e-7cca-4611-810c-37ec7bf1506c tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:00.948660 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4d31f42e-7cca-4611-810c-37ec7bf1506c tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:00.949583 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4d31f42e-7cca-4611-810c-37ec7bf1506c tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:00.950045 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4d31f42e-7cca-4611-810c-37ec7bf1506c tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:00.950937 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4d31f42e-7cca-4611-810c-37ec7bf1506c tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:01.026901 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-4a7ef557-e2d6-4ea2-a9d9-fa0ada5a7c56 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] 10.222.0.58 "POST /compute/v2.1/servers/325d9b10-716d-4961-91d1-70962403fef4/action" status: 202 len: 0 microversion: 2.1 time: 1.050794 Aug 10 23:09:01.032630 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1478/2890] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:08:59 2022] POST /compute/v2.1/servers/325d9b10-716d-4961-91d1-70962403fef4/action => generated 0 bytes in 1058 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:09:01.038347 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-015d44dd-9bb5-493c-9ded-91cce23417ae tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:09:01.039006 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-015d44dd-9bb5-493c-9ded-91cce23417ae tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] [instance: 3fae69e0-e5f3-4ce8-89b5-5d0a410b7be1] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:09:01.057023 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-015d44dd-9bb5-493c-9ded-91cce23417ae tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:01.057801 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-015d44dd-9bb5-493c-9ded-91cce23417ae tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:01.058462 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-015d44dd-9bb5-493c-9ded-91cce23417ae tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:01.059766 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-015d44dd-9bb5-493c-9ded-91cce23417ae tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:01.060639 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-015d44dd-9bb5-493c-9ded-91cce23417ae tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:01.062406 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-015d44dd-9bb5-493c-9ded-91cce23417ae tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:01.383559 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-4d31f42e-7cca-4611-810c-37ec7bf1506c tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca20e8ce3e25491fbe58f97ac5b9250a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e4512070fb74a32a9203526a025914e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:09:01.393993 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-4d31f42e-7cca-4611-810c-37ec7bf1506c tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] 10.222.0.58 "GET /compute/v2.1/servers/61e7db28-1e60-444a-b6c0-dd65ef3f5a6b" status: 200 len: 1332 microversion: 2.1 time: 0.463280 Aug 10 23:09:01.394831 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1413/2891] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:09:00 2022] GET /compute/v2.1/servers/61e7db28-1e60-444a-b6c0-dd65ef3f5a6b => generated 1332 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:09:01.400757 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-d3ad486d-2615-4b80-8aa0-a1cfe635aed3 tempest-KeyPairsV2TestJSON-1954713352 tempest-KeyPairsV2TestJSON-1954713352-project] Calling method '.version_select at 0x7f847d1c6700>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:09:01.450023 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-d3ad486d-2615-4b80-8aa0-a1cfe635aed3 tempest-KeyPairsV2TestJSON-1954713352 tempest-KeyPairsV2TestJSON-1954713352-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-806039227" status: 202 len: 0 microversion: 2.1 time: 0.052789 Aug 10 23:09:01.451036 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1414/2892] 10.222.0.58 () {58 vars in 1218 bytes} [Wed Aug 10 23:09:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-806039227 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:09:01.457453 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-a4fb3840-f437-43b5-af54-770ab99aa1f6 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:09:01.462899 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-a4fb3840-f437-43b5-af54-770ab99aa1f6 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] [instance: d09d04b1-bc37-4290-873e-ce2adae19eaf] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:09:01.474216 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a4fb3840-f437-43b5-af54-770ab99aa1f6 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:01.479236 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a4fb3840-f437-43b5-af54-770ab99aa1f6 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:01.479897 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a4fb3840-f437-43b5-af54-770ab99aa1f6 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:01.480844 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a4fb3840-f437-43b5-af54-770ab99aa1f6 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:01.481455 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a4fb3840-f437-43b5-af54-770ab99aa1f6 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:01.482037 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a4fb3840-f437-43b5-af54-770ab99aa1f6 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:01.613772 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-015d44dd-9bb5-493c-9ded-91cce23417ae tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7caa911d519e4711bf9a251b04ebe8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad554e982ff483098acf8a3b58e3842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:09:01.637753 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-015d44dd-9bb5-493c-9ded-91cce23417ae tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] 10.222.0.58 "GET /compute/v2.1/servers/3fae69e0-e5f3-4ce8-89b5-5d0a410b7be1" status: 200 len: 1323 microversion: 2.1 time: 0.603856 Aug 10 23:09:01.638359 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1479/2893] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:09:01 2022] GET /compute/v2.1/servers/3fae69e0-e5f3-4ce8-89b5-5d0a410b7be1 => generated 1323 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:09:01.656752 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-9e8b19ba-3607-4353-b0e1-d7e2265d809b tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Action: 'create', calling method: .version_select at 0x7f847c5b4f70>, body: {"pool": null} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:09:02.498129 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-a4fb3840-f437-43b5-af54-770ab99aa1f6 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bbb4f184e4409d9eed51e0b98dfb29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708f8d4c4ed6432d85e0bf6a9bac7677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:09:02.504849 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=100 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:09:02.538102 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=6 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:09:02.549687 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-a4fb3840-f437-43b5-af54-770ab99aa1f6 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] 10.222.0.58 "GET /compute/v2.1/servers/d09d04b1-bc37-4290-873e-ce2adae19eaf" status: 200 len: 1325 microversion: 2.1 time: 1.097383 Aug 10 23:09:02.554478 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1415/2894] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:09:01 2022] GET /compute/v2.1/servers/d09d04b1-bc37-4290-873e-ce2adae19eaf => generated 1325 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:09:02.560525 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-d2d9b34e-4de7-4cd6-802c-6764d6d945c7 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:09:02.562418 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-d2d9b34e-4de7-4cd6-802c-6764d6d945c7 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] [instance: 5ea8116b-d76a-4b57-9d22-c6a3b8b10867] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:09:02.590025 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d2d9b34e-4de7-4cd6-802c-6764d6d945c7 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:02.591258 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d2d9b34e-4de7-4cd6-802c-6764d6d945c7 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:02.593504 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d2d9b34e-4de7-4cd6-802c-6764d6d945c7 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:02.596737 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d2d9b34e-4de7-4cd6-802c-6764d6d945c7 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:02.599156 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d2d9b34e-4de7-4cd6-802c-6764d6d945c7 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:02.601678 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d2d9b34e-4de7-4cd6-802c-6764d6d945c7 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:03.187847 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-d2d9b34e-4de7-4cd6-802c-6764d6d945c7 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca7d06f2acb44558d405a3b35a59550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7f70700e035444c9f2c9fa491c5c41a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:09:03.211898 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-d2d9b34e-4de7-4cd6-802c-6764d6d945c7 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] 10.222.0.58 "GET /compute/v2.1/servers/5ea8116b-d76a-4b57-9d22-c6a3b8b10867" status: 200 len: 1318 microversion: 2.1 time: 0.649942 Aug 10 23:09:03.230515 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1416/2895] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:09:02 2022] GET /compute/v2.1/servers/5ea8116b-d76a-4b57-9d22-c6a3b8b10867 => generated 1318 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:09:03.243372 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-413a267b-8eb3-4150-94e4-09e3cfa1810b tempest-KeyPairsV2TestJSON-1954713352 tempest-KeyPairsV2TestJSON-1954713352-project] Action: 'create', calling method: .version_select at 0x7f847df989d0>, body: {"keypair": {"name": "tempest-keypair-630929728", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCCcWjTPCtf7fH+rTv0QcezTUB3LB0CzEl9WN8eZq4JuhIM98mYs0QjA7yMpL/PydsYLNgtWoOudVvjBPr1vC9ZrTWDR19ZBjq2DBxfqBToulU5MLjJQ2vYd4OYzSZClSg=="}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:09:03.271675 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-413a267b-8eb3-4150-94e4-09e3cfa1810b tempest-KeyPairsV2TestJSON-1954713352 tempest-KeyPairsV2TestJSON-1954713352-project] Getting quotas for project ef135fd725df4dfc9c841c24516dee02. Resources: {'key_pairs'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:09:03.284886 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-413a267b-8eb3-4150-94e4-09e3cfa1810b tempest-KeyPairsV2TestJSON-1954713352 tempest-KeyPairsV2TestJSON-1954713352-project] Getting quotas for user f5d3e1b0ef4d4c2c9b7e0f43848aed93 and project ef135fd725df4dfc9c841c24516dee02. Resources: {'key_pairs'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:09:03.324542 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-413a267b-8eb3-4150-94e4-09e3cfa1810b tempest-KeyPairsV2TestJSON-1954713352 tempest-KeyPairsV2TestJSON-1954713352-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.091885 Aug 10 23:09:03.331361 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1417/2896] 10.222.0.58 () {60 vars in 1159 bytes} [Wed Aug 10 23:09:03 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:09:03.336728 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-87a20bf3-6e95-425d-8469-514f07c00b8d tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:09:03.337838 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-87a20bf3-6e95-425d-8469-514f07c00b8d tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] [instance: 23452b78-96cd-430d-b95c-aaa98a427d53] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:09:03.345292 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-87a20bf3-6e95-425d-8469-514f07c00b8d tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:03.346145 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-87a20bf3-6e95-425d-8469-514f07c00b8d tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:03.347365 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-87a20bf3-6e95-425d-8469-514f07c00b8d tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:03.348211 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-87a20bf3-6e95-425d-8469-514f07c00b8d tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:03.348686 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-87a20bf3-6e95-425d-8469-514f07c00b8d tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:03.349120 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-87a20bf3-6e95-425d-8469-514f07c00b8d tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:03.668530 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-9e8b19ba-3607-4353-b0e1-d7e2265d809b tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] 10.222.0.58 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.026951 Aug 10 23:09:03.669318 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1480/2897] 10.222.0.58 () {60 vars in 1170 bytes} [Wed Aug 10 23:09:01 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2028 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:09:03.674907 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-214b6180-430a-4e81-afa9-ffe1f062dc37 req-e2e1cd26-c20b-4031-8e21-6d7fca91fc39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3fae69e0-e5f3-4ce8-89b5-5d0a410b7be1", "tag": "da2ce90a-71d7-4814-80a4-becf56274e9d"}, {"name": "network-changed", "server_uuid": "d09d04b1-bc37-4290-873e-ce2adae19eaf", "tag": "7c24b140-f5ee-4079-a313-c307f5d3865b"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:09:03.688720 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-214b6180-430a-4e81-afa9-ffe1f062dc37 req-e2e1cd26-c20b-4031-8e21-6d7fca91fc39 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:03.689201 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-214b6180-430a-4e81-afa9-ffe1f062dc37 req-e2e1cd26-c20b-4031-8e21-6d7fca91fc39 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:03.689626 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-214b6180-430a-4e81-afa9-ffe1f062dc37 req-e2e1cd26-c20b-4031-8e21-6d7fca91fc39 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:03.702434 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-214b6180-430a-4e81-afa9-ffe1f062dc37 req-e2e1cd26-c20b-4031-8e21-6d7fca91fc39 service nova] Creating event network-changed:da2ce90a-71d7-4814-80a4-becf56274e9d for instance 3fae69e0-e5f3-4ce8-89b5-5d0a410b7be1 on n-h2-850468-14 Aug 10 23:09:03.703283 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-214b6180-430a-4e81-afa9-ffe1f062dc37 req-e2e1cd26-c20b-4031-8e21-6d7fca91fc39 service nova] Creating event network-changed:7c24b140-f5ee-4079-a313-c307f5d3865b for instance d09d04b1-bc37-4290-873e-ce2adae19eaf on n-h1-850468-14 Aug 10 23:09:03.716242 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-214b6180-430a-4e81-afa9-ffe1f062dc37 req-e2e1cd26-c20b-4031-8e21-6d7fca91fc39 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.045545 Aug 10 23:09:03.717567 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1481/2898] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:09:03 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:09:03.723379 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-b4f68edb-b20e-41e8-b287-77e82a345722 req-a0769331-4085-4f2a-9a8c-2fc598519e08 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "325d9b10-716d-4961-91d1-70962403fef4", "tag": "636830f5-e8dd-4490-8875-671bd1ac26f5"}, {"name": "network-changed", "server_uuid": "d884a052-b397-41de-93d5-577428e292c1", "tag": "bcc20647-ddf4-4615-ad16-a1db09bc1caa"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:09:03.735759 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-b4f68edb-b20e-41e8-b287-77e82a345722 req-a0769331-4085-4f2a-9a8c-2fc598519e08 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:03.736235 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-b4f68edb-b20e-41e8-b287-77e82a345722 req-a0769331-4085-4f2a-9a8c-2fc598519e08 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:03.736668 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-b4f68edb-b20e-41e8-b287-77e82a345722 req-a0769331-4085-4f2a-9a8c-2fc598519e08 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:03.753654 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-b4f68edb-b20e-41e8-b287-77e82a345722 req-a0769331-4085-4f2a-9a8c-2fc598519e08 service nova] Creating event network-changed:636830f5-e8dd-4490-8875-671bd1ac26f5 for instance 325d9b10-716d-4961-91d1-70962403fef4 on n-h1-850468-14 Aug 10 23:09:03.754159 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-b4f68edb-b20e-41e8-b287-77e82a345722 req-a0769331-4085-4f2a-9a8c-2fc598519e08 service nova] Creating event network-changed:bcc20647-ddf4-4615-ad16-a1db09bc1caa for instance d884a052-b397-41de-93d5-577428e292c1 on n-h2-850468-14 Aug 10 23:09:03.764494 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-b4f68edb-b20e-41e8-b287-77e82a345722 req-a0769331-4085-4f2a-9a8c-2fc598519e08 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.045756 Aug 10 23:09:03.765414 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1482/2899] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:09:03 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:09:03.770752 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-2cc12334-818a-4abc-8187-a5f19e1c22d6 tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:09:03.772339 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-2cc12334-818a-4abc-8187-a5f19e1c22d6 tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] [instance: 61e7db28-1e60-444a-b6c0-dd65ef3f5a6b] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:09:03.779676 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2cc12334-818a-4abc-8187-a5f19e1c22d6 tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:03.780276 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2cc12334-818a-4abc-8187-a5f19e1c22d6 tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:03.780973 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2cc12334-818a-4abc-8187-a5f19e1c22d6 tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:03.781792 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2cc12334-818a-4abc-8187-a5f19e1c22d6 tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:03.782341 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2cc12334-818a-4abc-8187-a5f19e1c22d6 tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:03.782910 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2cc12334-818a-4abc-8187-a5f19e1c22d6 tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:03.804733 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-87a20bf3-6e95-425d-8469-514f07c00b8d tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1986185dc9b4df4affcc421365462f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597863bfebdc481188f1f30095da5396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:09:03.815590 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-87a20bf3-6e95-425d-8469-514f07c00b8d tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] 10.222.0.58 "GET /compute/v2.1/servers/23452b78-96cd-430d-b95c-aaa98a427d53" status: 200 len: 1548 microversion: 2.1 time: 0.482812 Aug 10 23:09:03.816454 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1418/2900] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:09:03 2022] GET /compute/v2.1/servers/23452b78-96cd-430d-b95c-aaa98a427d53 => generated 1548 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:09:03.822225 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-37edfadf-7da4-44ba-aa91-75a7c00deed8 tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:09:03.823340 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-37edfadf-7da4-44ba-aa91-75a7c00deed8 tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] [instance: 3fae69e0-e5f3-4ce8-89b5-5d0a410b7be1] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:09:03.829718 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-37edfadf-7da4-44ba-aa91-75a7c00deed8 tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:03.830459 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-37edfadf-7da4-44ba-aa91-75a7c00deed8 tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:03.831511 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-37edfadf-7da4-44ba-aa91-75a7c00deed8 tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:03.832633 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-37edfadf-7da4-44ba-aa91-75a7c00deed8 tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:03.833445 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-37edfadf-7da4-44ba-aa91-75a7c00deed8 tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:03.835307 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-37edfadf-7da4-44ba-aa91-75a7c00deed8 tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:04.004420 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-2cc12334-818a-4abc-8187-a5f19e1c22d6 tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca20e8ce3e25491fbe58f97ac5b9250a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e4512070fb74a32a9203526a025914e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:09:04.014656 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-2cc12334-818a-4abc-8187-a5f19e1c22d6 tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] 10.222.0.58 "GET /compute/v2.1/servers/61e7db28-1e60-444a-b6c0-dd65ef3f5a6b" status: 200 len: 1332 microversion: 2.1 time: 0.247835 Aug 10 23:09:04.027162 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1483/2901] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:09:03 2022] GET /compute/v2.1/servers/61e7db28-1e60-444a-b6c0-dd65ef3f5a6b => generated 1332 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:09:04.034585 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-84750774-2833-4912-b688-a8d0da8e1fd2 tempest-KeyPairsV2TestJSON-1954713352 tempest-KeyPairsV2TestJSON-1954713352-project] Calling method '.version_select at 0x7f847c514160>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:09:04.044758 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=6 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:09:04.058528 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-84750774-2833-4912-b688-a8d0da8e1fd2 tempest-KeyPairsV2TestJSON-1954713352 tempest-KeyPairsV2TestJSON-1954713352-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-630929728" status: 202 len: 0 microversion: 2.1 time: 0.029888 Aug 10 23:09:04.059853 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1484/2902] 10.222.0.58 () {58 vars in 1218 bytes} [Wed Aug 10 23:09:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-630929728 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:09:04.068463 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-910682f3-8a00-4ab5-b94d-a86036c1b02f tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:09:04.069473 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-910682f3-8a00-4ab5-b94d-a86036c1b02f tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] [instance: d09d04b1-bc37-4290-873e-ce2adae19eaf] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:09:04.076948 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-910682f3-8a00-4ab5-b94d-a86036c1b02f tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:04.077738 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-910682f3-8a00-4ab5-b94d-a86036c1b02f tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:04.078375 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-910682f3-8a00-4ab5-b94d-a86036c1b02f tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:04.079458 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-910682f3-8a00-4ab5-b94d-a86036c1b02f tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:04.080043 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-910682f3-8a00-4ab5-b94d-a86036c1b02f tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:04.080698 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-910682f3-8a00-4ab5-b94d-a86036c1b02f tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:04.120169 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-37edfadf-7da4-44ba-aa91-75a7c00deed8 tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7caa911d519e4711bf9a251b04ebe8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad554e982ff483098acf8a3b58e3842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:09:04.130108 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-37edfadf-7da4-44ba-aa91-75a7c00deed8 tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] 10.222.0.58 "GET /compute/v2.1/servers/3fae69e0-e5f3-4ce8-89b5-5d0a410b7be1" status: 200 len: 1323 microversion: 2.1 time: 0.312365 Aug 10 23:09:04.131437 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1419/2903] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:09:03 2022] GET /compute/v2.1/servers/3fae69e0-e5f3-4ce8-89b5-5d0a410b7be1 => generated 1323 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:09:04.138615 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-a97194fa-4b31-49ba-a581-fef58a6708e1 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.2.120"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:09:04.141397 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-a97194fa-4b31-49ba-a581-fef58a6708e1 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] [instance: 325d9b10-716d-4961-91d1-70962403fef4] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:09:04.150595 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a97194fa-4b31-49ba-a581-fef58a6708e1 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:04.152146 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a97194fa-4b31-49ba-a581-fef58a6708e1 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:04.152851 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a97194fa-4b31-49ba-a581-fef58a6708e1 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:04.154248 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a97194fa-4b31-49ba-a581-fef58a6708e1 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:04.154997 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a97194fa-4b31-49ba-a581-fef58a6708e1 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:04.156102 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a97194fa-4b31-49ba-a581-fef58a6708e1 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:04.191226 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a97194fa-4b31-49ba-a581-fef58a6708e1 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Acquiring lock "refresh_cache-325d9b10-716d-4961-91d1-70962403fef4" {{(pid=122632) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 10 23:09:04.192003 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a97194fa-4b31-49ba-a581-fef58a6708e1 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Acquired lock "refresh_cache-325d9b10-716d-4961-91d1-70962403fef4" {{(pid=122632) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 10 23:09:04.246664 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-910682f3-8a00-4ab5-b94d-a86036c1b02f tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bbb4f184e4409d9eed51e0b98dfb29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708f8d4c4ed6432d85e0bf6a9bac7677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:09:04.255284 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-910682f3-8a00-4ab5-b94d-a86036c1b02f tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] 10.222.0.58 "GET /compute/v2.1/servers/d09d04b1-bc37-4290-873e-ce2adae19eaf" status: 200 len: 1325 microversion: 2.1 time: 0.194144 Aug 10 23:09:04.256702 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1485/2904] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:09:04 2022] GET /compute/v2.1/servers/d09d04b1-bc37-4290-873e-ce2adae19eaf => generated 1325 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:09:04.265746 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-27f22013-6011-4186-868a-a9ed01780103 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:09:04.266249 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-27f22013-6011-4186-868a-a9ed01780103 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] [instance: 23452b78-96cd-430d-b95c-aaa98a427d53] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:09:04.274668 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-27f22013-6011-4186-868a-a9ed01780103 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:04.276114 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-27f22013-6011-4186-868a-a9ed01780103 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:04.276600 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-27f22013-6011-4186-868a-a9ed01780103 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:04.278104 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-27f22013-6011-4186-868a-a9ed01780103 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:04.279289 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-27f22013-6011-4186-868a-a9ed01780103 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:04.279887 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-27f22013-6011-4186-868a-a9ed01780103 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:04.376938 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-27f22013-6011-4186-868a-a9ed01780103 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] 10.222.0.58 "GET /compute/v2.1/servers/23452b78-96cd-430d-b95c-aaa98a427d53/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.118695 Aug 10 23:09:04.377625 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1486/2905] 10.222.0.58 () {58 vars in 1275 bytes} [Wed Aug 10 23:09:04 2022] GET /compute/v2.1/servers/23452b78-96cd-430d-b95c-aaa98a427d53/os-interface => generated 285 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:09:04.384709 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-67efb6f6-1f8a-49c5-9eca-f1cfbd5317a3 tempest-KeyPairsV2TestJSON-1954713352 tempest-KeyPairsV2TestJSON-1954713352-project] Action: 'create', calling method: .version_select at 0x7f847c5140d0>, body: {"keypair": {"name": "tempest-keypair-26257551", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:09:04.404219 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-67efb6f6-1f8a-49c5-9eca-f1cfbd5317a3 tempest-KeyPairsV2TestJSON-1954713352 tempest-KeyPairsV2TestJSON-1954713352-project] Getting quotas for project ef135fd725df4dfc9c841c24516dee02. Resources: {'key_pairs'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:09:04.411119 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-67efb6f6-1f8a-49c5-9eca-f1cfbd5317a3 tempest-KeyPairsV2TestJSON-1954713352 tempest-KeyPairsV2TestJSON-1954713352-project] Getting quotas for user f5d3e1b0ef4d4c2c9b7e0f43848aed93 and project ef135fd725df4dfc9c841c24516dee02. Resources: {'key_pairs'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:09:04.440616 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-67efb6f6-1f8a-49c5-9eca-f1cfbd5317a3 tempest-KeyPairsV2TestJSON-1954713352 tempest-KeyPairsV2TestJSON-1954713352-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 572 microversion: 2.1 time: 0.061343 Aug 10 23:09:04.441656 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1487/2906] 10.222.0.58 () {60 vars in 1159 bytes} [Wed Aug 10 23:09:04 2022] POST /compute/v2.1/os-keypairs => generated 572 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:09:04.448701 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-4f31f917-f453-4945-ad76-b972e61f8878 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:09:04.449557 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-4f31f917-f453-4945-ad76-b972e61f8878 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] [instance: 5ea8116b-d76a-4b57-9d22-c6a3b8b10867] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:09:04.463722 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4f31f917-f453-4945-ad76-b972e61f8878 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:04.464229 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4f31f917-f453-4945-ad76-b972e61f8878 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:04.464678 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4f31f917-f453-4945-ad76-b972e61f8878 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:04.468050 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4f31f917-f453-4945-ad76-b972e61f8878 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:04.468664 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4f31f917-f453-4945-ad76-b972e61f8878 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:04.469068 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4f31f917-f453-4945-ad76-b972e61f8878 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:04.509473 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=100 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:09:04.942025 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-4f31f917-f453-4945-ad76-b972e61f8878 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca7d06f2acb44558d405a3b35a59550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7f70700e035444c9f2c9fa491c5c41a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:09:04.951384 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-4f31f917-f453-4945-ad76-b972e61f8878 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] 10.222.0.58 "GET /compute/v2.1/servers/5ea8116b-d76a-4b57-9d22-c6a3b8b10867" status: 200 len: 1318 microversion: 2.1 time: 0.508336 Aug 10 23:09:04.952460 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1488/2907] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:09:04 2022] GET /compute/v2.1/servers/5ea8116b-d76a-4b57-9d22-c6a3b8b10867 => generated 1318 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:09:04.969007 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-1349b41e-d463-4b13-9ef7-1eb9bb0d191c tempest-KeyPairsV2TestJSON-1954713352 tempest-KeyPairsV2TestJSON-1954713352-project] Calling method '.version_select at 0x7f847c92a670>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:09:05.004249 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-1349b41e-d463-4b13-9ef7-1eb9bb0d191c tempest-KeyPairsV2TestJSON-1954713352 tempest-KeyPairsV2TestJSON-1954713352-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-26257551" status: 202 len: 0 microversion: 2.1 time: 0.050557 Aug 10 23:09:05.005317 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1489/2908] 10.222.0.58 () {58 vars in 1215 bytes} [Wed Aug 10 23:09:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-26257551 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:09:05.017528 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-2a0f861d-5333-4bd8-b2e2-e01a10263eae req-454edc5c-b602-4e94-a007-c9d7082833da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61e7db28-1e60-444a-b6c0-dd65ef3f5a6b", "name": "network-vif-plugged", "status": "completed", "tag": "993de175-c53f-4b4e-a8ba-348ecebfaf8f"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:09:05.056565 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-2a0f861d-5333-4bd8-b2e2-e01a10263eae req-454edc5c-b602-4e94-a007-c9d7082833da service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:05.058096 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-2a0f861d-5333-4bd8-b2e2-e01a10263eae req-454edc5c-b602-4e94-a007-c9d7082833da service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:05.059049 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-2a0f861d-5333-4bd8-b2e2-e01a10263eae req-454edc5c-b602-4e94-a007-c9d7082833da service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:05.078618 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-2a0f861d-5333-4bd8-b2e2-e01a10263eae req-454edc5c-b602-4e94-a007-c9d7082833da service nova] Creating event network-vif-plugged:993de175-c53f-4b4e-a8ba-348ecebfaf8f for instance 61e7db28-1e60-444a-b6c0-dd65ef3f5a6b on n-h1-850468-14 Aug 10 23:09:05.097660 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-2a0f861d-5333-4bd8-b2e2-e01a10263eae req-454edc5c-b602-4e94-a007-c9d7082833da service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089047 Aug 10 23:09:05.101049 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1490/2909] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:09:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:09:05.117393 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-ee40b5f2-c254-439b-ab60-0ce6bb8aa064 tempest-KeyPairsV2TestJSON-1954713352 tempest-KeyPairsV2TestJSON-1954713352-project] Action: 'create', calling method: .version_select at 0x7f847d308940>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1011170603", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB1Is7G58bgMD/R/Uoif4es8d/J8cOFLXuFGAeuo8l7zOc9+fMOb++G28ENb4QOBvX+Nyp7hCwJb4kxIRT30BHKCwVy22X7jb9DiU6WSY9qusybYWxsIVZ8Ct6Wy4OawFw=="}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:09:05.170538 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-ee40b5f2-c254-439b-ab60-0ce6bb8aa064 tempest-KeyPairsV2TestJSON-1954713352 tempest-KeyPairsV2TestJSON-1954713352-project] Getting quotas for project ef135fd725df4dfc9c841c24516dee02. Resources: {'key_pairs'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:09:05.187250 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-ee40b5f2-c254-439b-ab60-0ce6bb8aa064 tempest-KeyPairsV2TestJSON-1954713352 tempest-KeyPairsV2TestJSON-1954713352-project] Getting quotas for user f5d3e1b0ef4d4c2c9b7e0f43848aed93 and project ef135fd725df4dfc9c841c24516dee02. Resources: {'key_pairs'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:09:05.221904 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-ee40b5f2-c254-439b-ab60-0ce6bb8aa064 tempest-KeyPairsV2TestJSON-1954713352 tempest-KeyPairsV2TestJSON-1954713352-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.118321 Aug 10 23:09:05.223047 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1491/2910] 10.222.0.58 () {60 vars in 1159 bytes} [Wed Aug 10 23:09:05 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:09:05.237769 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-d232c7dd-751e-4dfa-99aa-dbf9c28f837d tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:09:05.238593 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-d232c7dd-751e-4dfa-99aa-dbf9c28f837d tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] [instance: 61e7db28-1e60-444a-b6c0-dd65ef3f5a6b] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:09:05.250037 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d232c7dd-751e-4dfa-99aa-dbf9c28f837d tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:05.251054 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d232c7dd-751e-4dfa-99aa-dbf9c28f837d tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:05.251502 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d232c7dd-751e-4dfa-99aa-dbf9c28f837d tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:05.252228 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d232c7dd-751e-4dfa-99aa-dbf9c28f837d tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:05.252682 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d232c7dd-751e-4dfa-99aa-dbf9c28f837d tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:05.253215 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d232c7dd-751e-4dfa-99aa-dbf9c28f837d tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:06.009680 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-d232c7dd-751e-4dfa-99aa-dbf9c28f837d tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca20e8ce3e25491fbe58f97ac5b9250a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e4512070fb74a32a9203526a025914e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:09:06.023949 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-d232c7dd-751e-4dfa-99aa-dbf9c28f837d tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] 10.222.0.58 "GET /compute/v2.1/servers/61e7db28-1e60-444a-b6c0-dd65ef3f5a6b" status: 200 len: 1332 microversion: 2.1 time: 0.799080 Aug 10 23:09:06.025500 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1492/2911] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:09:05 2022] GET /compute/v2.1/servers/61e7db28-1e60-444a-b6c0-dd65ef3f5a6b => generated 1332 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:09:06.031563 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-5f051a94-0c3a-4289-a6ed-5ff72018bb90 tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:09:06.032343 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-5f051a94-0c3a-4289-a6ed-5ff72018bb90 tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] [instance: 3fae69e0-e5f3-4ce8-89b5-5d0a410b7be1] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:09:06.040500 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5f051a94-0c3a-4289-a6ed-5ff72018bb90 tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:06.041214 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5f051a94-0c3a-4289-a6ed-5ff72018bb90 tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:06.041810 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5f051a94-0c3a-4289-a6ed-5ff72018bb90 tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:06.042770 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5f051a94-0c3a-4289-a6ed-5ff72018bb90 tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:06.043406 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5f051a94-0c3a-4289-a6ed-5ff72018bb90 tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:06.043993 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5f051a94-0c3a-4289-a6ed-5ff72018bb90 tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:06.644720 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-5f051a94-0c3a-4289-a6ed-5ff72018bb90 tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7caa911d519e4711bf9a251b04ebe8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad554e982ff483098acf8a3b58e3842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:09:06.655354 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-5f051a94-0c3a-4289-a6ed-5ff72018bb90 tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] 10.222.0.58 "GET /compute/v2.1/servers/3fae69e0-e5f3-4ce8-89b5-5d0a410b7be1" status: 200 len: 1323 microversion: 2.1 time: 0.628491 Aug 10 23:09:06.656162 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1493/2912] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:09:06 2022] GET /compute/v2.1/servers/3fae69e0-e5f3-4ce8-89b5-5d0a410b7be1 => generated 1323 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:09:06.671270 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-a9113228-4425-4d82-95b2-eb11e24a3fce tempest-KeyPairsV2TestJSON-1954713352 tempest-KeyPairsV2TestJSON-1954713352-project] Action: 'create', calling method: .version_select at 0x7f847c5445e0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1399894436", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLXXvR6+ASy3g6qKtPXiLY98HjQWwu1WlBuRl3rQg4/AGX44SRSqmDnA8laKpVSe/U48ICqG076rYrX4UAnRj061yHsRTrDccPzYTsiVeCPBAwLxhuf+OexFK2lUwKv/VA=="}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:09:06.704505 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=31 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:09:06.705543 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-a9113228-4425-4d82-95b2-eb11e24a3fce tempest-KeyPairsV2TestJSON-1954713352 tempest-KeyPairsV2TestJSON-1954713352-project] Getting quotas for project ef135fd725df4dfc9c841c24516dee02. Resources: {'key_pairs'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:09:06.725403 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-a9113228-4425-4d82-95b2-eb11e24a3fce tempest-KeyPairsV2TestJSON-1954713352 tempest-KeyPairsV2TestJSON-1954713352-project] Getting quotas for user f5d3e1b0ef4d4c2c9b7e0f43848aed93 and project ef135fd725df4dfc9c841c24516dee02. Resources: {'key_pairs'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:09:06.763388 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-a9113228-4425-4d82-95b2-eb11e24a3fce tempest-KeyPairsV2TestJSON-1954713352 tempest-KeyPairsV2TestJSON-1954713352-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.104888 Aug 10 23:09:06.770064 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1494/2913] 10.222.0.58 () {60 vars in 1159 bytes} [Wed Aug 10 23:09:06 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:09:06.784848 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-4c16821b-aac3-48ca-afdf-7ec7f95d4764 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:09:06.786163 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-4c16821b-aac3-48ca-afdf-7ec7f95d4764 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] [instance: d09d04b1-bc37-4290-873e-ce2adae19eaf] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:09:06.806126 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4c16821b-aac3-48ca-afdf-7ec7f95d4764 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:06.809385 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4c16821b-aac3-48ca-afdf-7ec7f95d4764 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:06.809730 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4c16821b-aac3-48ca-afdf-7ec7f95d4764 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:06.810810 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4c16821b-aac3-48ca-afdf-7ec7f95d4764 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:06.811544 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4c16821b-aac3-48ca-afdf-7ec7f95d4764 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:06.811937 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4c16821b-aac3-48ca-afdf-7ec7f95d4764 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:07.183394 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.network.neutron [None req-a97194fa-4b31-49ba-a581-fef58a6708e1 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] [instance: 325d9b10-716d-4961-91d1-70962403fef4] Building network info cache for instance {{(pid=122632) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 10 23:09:07.222062 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-4c16821b-aac3-48ca-afdf-7ec7f95d4764 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bbb4f184e4409d9eed51e0b98dfb29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708f8d4c4ed6432d85e0bf6a9bac7677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:09:07.235160 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-4c16821b-aac3-48ca-afdf-7ec7f95d4764 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] 10.222.0.58 "GET /compute/v2.1/servers/d09d04b1-bc37-4290-873e-ce2adae19eaf" status: 200 len: 1325 microversion: 2.1 time: 0.464183 Aug 10 23:09:07.237793 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1495/2914] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:09:06 2022] GET /compute/v2.1/servers/d09d04b1-bc37-4290-873e-ce2adae19eaf => generated 1325 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:09:07.264543 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-234e3888-d7f5-45ed-b26f-e97264941a7e req-0993b8d3-1b09-4a16-bcfb-82fd3587ac90 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ea8116b-d76a-4b57-9d22-c6a3b8b10867", "tag": "a3c41df0-52c7-490e-8544-bb0663ab5e7b"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:09:07.284773 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-234e3888-d7f5-45ed-b26f-e97264941a7e req-0993b8d3-1b09-4a16-bcfb-82fd3587ac90 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:07.288256 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-234e3888-d7f5-45ed-b26f-e97264941a7e req-0993b8d3-1b09-4a16-bcfb-82fd3587ac90 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:07.289281 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-234e3888-d7f5-45ed-b26f-e97264941a7e req-0993b8d3-1b09-4a16-bcfb-82fd3587ac90 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:07.322165 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-234e3888-d7f5-45ed-b26f-e97264941a7e req-0993b8d3-1b09-4a16-bcfb-82fd3587ac90 service nova] Creating event network-changed:a3c41df0-52c7-490e-8544-bb0663ab5e7b for instance 5ea8116b-d76a-4b57-9d22-c6a3b8b10867 on n-h1-850468-14 Aug 10 23:09:07.331907 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-234e3888-d7f5-45ed-b26f-e97264941a7e req-0993b8d3-1b09-4a16-bcfb-82fd3587ac90 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076786 Aug 10 23:09:07.341019 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1496/2915] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:09:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:09:07.347438 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-3fb04fea-da5f-4e39-81e3-af37ab57cde0 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:09:07.348588 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-3fb04fea-da5f-4e39-81e3-af37ab57cde0 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] [instance: 5ea8116b-d76a-4b57-9d22-c6a3b8b10867] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:09:07.364736 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3fb04fea-da5f-4e39-81e3-af37ab57cde0 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:07.367837 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3fb04fea-da5f-4e39-81e3-af37ab57cde0 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:07.372020 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3fb04fea-da5f-4e39-81e3-af37ab57cde0 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:07.373112 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3fb04fea-da5f-4e39-81e3-af37ab57cde0 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:07.374223 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3fb04fea-da5f-4e39-81e3-af37ab57cde0 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:07.374769 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3fb04fea-da5f-4e39-81e3-af37ab57cde0 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:07.669654 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-3fb04fea-da5f-4e39-81e3-af37ab57cde0 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca7d06f2acb44558d405a3b35a59550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7f70700e035444c9f2c9fa491c5c41a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:09:07.679289 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-3fb04fea-da5f-4e39-81e3-af37ab57cde0 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] 10.222.0.58 "GET /compute/v2.1/servers/5ea8116b-d76a-4b57-9d22-c6a3b8b10867" status: 200 len: 1318 microversion: 2.1 time: 0.336707 Aug 10 23:09:07.680572 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1497/2916] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:09:07 2022] GET /compute/v2.1/servers/5ea8116b-d76a-4b57-9d22-c6a3b8b10867 => generated 1318 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:09:07.686195 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-b51eadcd-f168-4b30-b84c-f3ebc521c593 tempest-KeyPairsV2TestJSON-1954713352 tempest-KeyPairsV2TestJSON-1954713352-project] Action: 'create', calling method: .version_select at 0x7f847c92ad30>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1846371190", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEHS/vRl2/xtG9uCjCQzVR+lw7FjFtri7BOERU2Yb+C1yAvvCWFNXCv7h0/RPS566+CbvY85sR2ZuWp5X4A9zYvNfjXGlNSIBciMS6AZQqzLc/bhdEvG/YkUmoXm0vf81w=="}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:09:07.723856 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-b51eadcd-f168-4b30-b84c-f3ebc521c593 tempest-KeyPairsV2TestJSON-1954713352 tempest-KeyPairsV2TestJSON-1954713352-project] Getting quotas for project ef135fd725df4dfc9c841c24516dee02. Resources: {'key_pairs'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:09:07.741465 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-b51eadcd-f168-4b30-b84c-f3ebc521c593 tempest-KeyPairsV2TestJSON-1954713352 tempest-KeyPairsV2TestJSON-1954713352-project] Getting quotas for user f5d3e1b0ef4d4c2c9b7e0f43848aed93 and project ef135fd725df4dfc9c841c24516dee02. Resources: {'key_pairs'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:09:07.800095 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=2,nova_api:INSERT=4 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:09:07.824198 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-b51eadcd-f168-4b30-b84c-f3ebc521c593 tempest-KeyPairsV2TestJSON-1954713352 tempest-KeyPairsV2TestJSON-1954713352-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.141681 Aug 10 23:09:07.831328 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1498/2917] 10.222.0.58 () {60 vars in 1159 bytes} [Wed Aug 10 23:09:07 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:09:07.843173 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c0770d92-3171-4631-8380-8d3dd8b16edf tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:09:07.848784 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-c0770d92-3171-4631-8380-8d3dd8b16edf tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] [instance: 61e7db28-1e60-444a-b6c0-dd65ef3f5a6b] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:09:07.864331 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c0770d92-3171-4631-8380-8d3dd8b16edf tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:07.864825 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c0770d92-3171-4631-8380-8d3dd8b16edf tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:07.865308 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c0770d92-3171-4631-8380-8d3dd8b16edf tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:07.866147 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c0770d92-3171-4631-8380-8d3dd8b16edf tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:07.866611 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c0770d92-3171-4631-8380-8d3dd8b16edf tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:07.872640 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c0770d92-3171-4631-8380-8d3dd8b16edf tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:08.141859 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-c0770d92-3171-4631-8380-8d3dd8b16edf tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca20e8ce3e25491fbe58f97ac5b9250a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e4512070fb74a32a9203526a025914e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:09:08.152100 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-c0770d92-3171-4631-8380-8d3dd8b16edf tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] 10.222.0.58 "GET /compute/v2.1/servers/61e7db28-1e60-444a-b6c0-dd65ef3f5a6b" status: 200 len: 1537 microversion: 2.1 time: 0.319441 Aug 10 23:09:08.153428 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1499/2918] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:09:07 2022] GET /compute/v2.1/servers/61e7db28-1e60-444a-b6c0-dd65ef3f5a6b => generated 1537 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:09:08.158640 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-af2e204e-b364-49d1-b119-1bb087ad8db9 req-50be72e8-a0d3-46f9-8687-8807a93fe2a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23452b78-96cd-430d-b95c-aaa98a427d53", "tag": "a958a4d3-19d0-46d8-bea8-676cb2161b89"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:09:08.175906 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-af2e204e-b364-49d1-b119-1bb087ad8db9 req-50be72e8-a0d3-46f9-8687-8807a93fe2a5 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:08.176816 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-af2e204e-b364-49d1-b119-1bb087ad8db9 req-50be72e8-a0d3-46f9-8687-8807a93fe2a5 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:08.177416 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-af2e204e-b364-49d1-b119-1bb087ad8db9 req-50be72e8-a0d3-46f9-8687-8807a93fe2a5 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:08.197226 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-af2e204e-b364-49d1-b119-1bb087ad8db9 req-50be72e8-a0d3-46f9-8687-8807a93fe2a5 service nova] Creating event network-changed:a958a4d3-19d0-46d8-bea8-676cb2161b89 for instance 23452b78-96cd-430d-b95c-aaa98a427d53 on n-h2-850468-14 Aug 10 23:09:08.203288 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-af2e204e-b364-49d1-b119-1bb087ad8db9 req-50be72e8-a0d3-46f9-8687-8807a93fe2a5 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048148 Aug 10 23:09:08.204856 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1500/2919] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:09:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:09:08.226451 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-778db981-7b6c-4ec1-9487-d77c0257deaf tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:09:08.228280 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-778db981-7b6c-4ec1-9487-d77c0257deaf tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] [instance: 3fae69e0-e5f3-4ce8-89b5-5d0a410b7be1] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:09:08.237903 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-778db981-7b6c-4ec1-9487-d77c0257deaf tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:08.238669 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-778db981-7b6c-4ec1-9487-d77c0257deaf tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:08.240117 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-778db981-7b6c-4ec1-9487-d77c0257deaf tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:08.241279 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-778db981-7b6c-4ec1-9487-d77c0257deaf tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:08.241964 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-778db981-7b6c-4ec1-9487-d77c0257deaf tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:08.243028 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-778db981-7b6c-4ec1-9487-d77c0257deaf tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:08.371423 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.network.neutron [None req-a97194fa-4b31-49ba-a581-fef58a6708e1 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] [instance: 325d9b10-716d-4961-91d1-70962403fef4] Updating instance_info_cache with network_info: [{"id": "636830f5-e8dd-4490-8875-671bd1ac26f5", "address": "fa:16:3e:c1:bc:31", "network": {"id": "07bfb2f7-51b9-4172-a9a7-422d66f84c9d", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-2080469274-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.2.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "01ab3ad5c0ef448aaa1282112bf20d83", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap636830f5-e8", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122632) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 10 23:09:08.386540 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a97194fa-4b31-49ba-a581-fef58a6708e1 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Releasing lock "refresh_cache-325d9b10-716d-4961-91d1-70962403fef4" {{(pid=122632) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 10 23:09:08.387548 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-a97194fa-4b31-49ba-a581-fef58a6708e1 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] 10.222.0.58 "POST /compute/v2.1/servers/325d9b10-716d-4961-91d1-70962403fef4/action" status: 202 len: 0 microversion: 2.1 time: 4.254483 Aug 10 23:09:08.388614 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1420/2920] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:09:04 2022] POST /compute/v2.1/servers/325d9b10-716d-4961-91d1-70962403fef4/action => generated 0 bytes in 4256 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 10 23:09:08.397523 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-10ed182e-b046-43fa-966f-515f2cea42ba tempest-KeyPairsV2TestJSON-1954713352 tempest-KeyPairsV2TestJSON-1954713352-project] Calling method '.version_select at 0x7f847d1733a0>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:09:08.410339 n-d-850468-14 devstack@n-api.service[122632]: WARNING oslo_db.sqlalchemy.utils [None req-10ed182e-b046-43fa-966f-515f2cea42ba tempest-KeyPairsV2TestJSON-1954713352 tempest-KeyPairsV2TestJSON-1954713352-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 10 23:09:08.421447 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-10ed182e-b046-43fa-966f-515f2cea42ba tempest-KeyPairsV2TestJSON-1954713352 tempest-KeyPairsV2TestJSON-1954713352-project] 10.222.0.58 "GET /compute/v2.1/os-keypairs" status: 200 len: 1094 microversion: 2.1 time: 0.031667 Aug 10 23:09:08.428384 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1421/2921] 10.222.0.58 () {58 vars in 1137 bytes} [Wed Aug 10 23:09:08 2022] GET /compute/v2.1/os-keypairs => generated 1094 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:09:08.437804 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-3442b6e4-d29f-4372-9c79-fc68c9293e7d tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Action: 'create', calling method: .version_select at 0x7f847dd8ad30>, body: {"pool": "be521539-5d5d-4685-a1fe-5d99a84b809e"} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:09:08.681721 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-778db981-7b6c-4ec1-9487-d77c0257deaf tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7caa911d519e4711bf9a251b04ebe8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad554e982ff483098acf8a3b58e3842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:09:08.694069 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-778db981-7b6c-4ec1-9487-d77c0257deaf tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] 10.222.0.58 "GET /compute/v2.1/servers/3fae69e0-e5f3-4ce8-89b5-5d0a410b7be1" status: 200 len: 1323 microversion: 2.1 time: 0.486945 Aug 10 23:09:08.709299 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1501/2922] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:09:08 2022] GET /compute/v2.1/servers/3fae69e0-e5f3-4ce8-89b5-5d0a410b7be1 => generated 1323 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:09:08.709299 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-432ab4ce-ee97-4fac-b4c7-b8f525120859 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:09:08.709299 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-432ab4ce-ee97-4fac-b4c7-b8f525120859 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] [instance: d09d04b1-bc37-4290-873e-ce2adae19eaf] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:09:08.722656 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-432ab4ce-ee97-4fac-b4c7-b8f525120859 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:08.723194 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-432ab4ce-ee97-4fac-b4c7-b8f525120859 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:08.723642 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-432ab4ce-ee97-4fac-b4c7-b8f525120859 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:08.724949 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-432ab4ce-ee97-4fac-b4c7-b8f525120859 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:08.725599 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-432ab4ce-ee97-4fac-b4c7-b8f525120859 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:08.726194 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-432ab4ce-ee97-4fac-b4c7-b8f525120859 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:08.991653 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-432ab4ce-ee97-4fac-b4c7-b8f525120859 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bbb4f184e4409d9eed51e0b98dfb29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708f8d4c4ed6432d85e0bf6a9bac7677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:09:09.004670 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-432ab4ce-ee97-4fac-b4c7-b8f525120859 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] 10.222.0.58 "GET /compute/v2.1/servers/d09d04b1-bc37-4290-873e-ce2adae19eaf" status: 200 len: 1325 microversion: 2.1 time: 0.306378 Aug 10 23:09:09.005467 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1502/2923] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:09:08 2022] GET /compute/v2.1/servers/d09d04b1-bc37-4290-873e-ce2adae19eaf => generated 1325 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:09:09.031064 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-254db0c9-c1e5-47c6-8645-f8a73954adf0 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Action: 'action', calling method: .version_select at 0x7f847ff7be50>, body: {"removeFloatingIp": {"address": "172.25.2.120"}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:09:09.289983 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-254db0c9-c1e5-47c6-8645-f8a73954adf0 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] [instance: 325d9b10-716d-4961-91d1-70962403fef4] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:09:09.299463 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-254db0c9-c1e5-47c6-8645-f8a73954adf0 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:09.299964 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-254db0c9-c1e5-47c6-8645-f8a73954adf0 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:09.300403 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-254db0c9-c1e5-47c6-8645-f8a73954adf0 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:09.301142 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-254db0c9-c1e5-47c6-8645-f8a73954adf0 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:09.301594 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-254db0c9-c1e5-47c6-8645-f8a73954adf0 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:09.302023 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-254db0c9-c1e5-47c6-8645-f8a73954adf0 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:09.763966 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-254db0c9-c1e5-47c6-8645-f8a73954adf0 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Acquiring lock "refresh_cache-325d9b10-716d-4961-91d1-70962403fef4" {{(pid=122633) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 10 23:09:09.764411 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-254db0c9-c1e5-47c6-8645-f8a73954adf0 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Acquired lock "refresh_cache-325d9b10-716d-4961-91d1-70962403fef4" {{(pid=122633) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 10 23:09:10.994652 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-3442b6e4-d29f-4372-9c79-fc68c9293e7d tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] 10.222.0.58 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.564806 Aug 10 23:09:11.002735 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1422/2924] 10.222.0.58 () {60 vars in 1170 bytes} [Wed Aug 10 23:09:08 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2574 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:09:11.008041 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c40d552b-01d3-4f9b-8160-99e993e1acac tempest-KeyPairsV2TestJSON-1954713352 tempest-KeyPairsV2TestJSON-1954713352-project] Calling method '.version_select at 0x7f847d3879d0>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:09:11.029181 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-c40d552b-01d3-4f9b-8160-99e993e1acac tempest-KeyPairsV2TestJSON-1954713352 tempest-KeyPairsV2TestJSON-1954713352-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1846371190" status: 202 len: 0 microversion: 2.1 time: 0.024374 Aug 10 23:09:11.029729 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1423/2925] 10.222.0.58 () {58 vars in 1278 bytes} [Wed Aug 10 23:09:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1846371190 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:09:11.034710 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-0fff5301-b965-43aa-bc99-b519b82d6d92 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:09:11.035590 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-0fff5301-b965-43aa-bc99-b519b82d6d92 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] [instance: 5ea8116b-d76a-4b57-9d22-c6a3b8b10867] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:09:11.042986 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0fff5301-b965-43aa-bc99-b519b82d6d92 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:11.043611 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0fff5301-b965-43aa-bc99-b519b82d6d92 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:11.044255 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0fff5301-b965-43aa-bc99-b519b82d6d92 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:11.045213 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0fff5301-b965-43aa-bc99-b519b82d6d92 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:11.045983 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0fff5301-b965-43aa-bc99-b519b82d6d92 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:11.046568 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0fff5301-b965-43aa-bc99-b519b82d6d92 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:11.191156 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-0fff5301-b965-43aa-bc99-b519b82d6d92 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca7d06f2acb44558d405a3b35a59550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7f70700e035444c9f2c9fa491c5c41a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:09:11.201755 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-0fff5301-b965-43aa-bc99-b519b82d6d92 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] 10.222.0.58 "GET /compute/v2.1/servers/5ea8116b-d76a-4b57-9d22-c6a3b8b10867" status: 200 len: 1318 microversion: 2.1 time: 0.170793 Aug 10 23:09:11.202509 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1424/2926] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:09:11 2022] GET /compute/v2.1/servers/5ea8116b-d76a-4b57-9d22-c6a3b8b10867 => generated 1318 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:09:11.221405 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-85eeff85-b283-434d-8d1b-c0d5ab0453cf req-d81c1f3e-c991-4ded-a07f-9c5b66636348 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "325d9b10-716d-4961-91d1-70962403fef4", "tag": "636830f5-e8dd-4490-8875-671bd1ac26f5"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:09:11.231627 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-85eeff85-b283-434d-8d1b-c0d5ab0453cf req-d81c1f3e-c991-4ded-a07f-9c5b66636348 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:11.232367 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-85eeff85-b283-434d-8d1b-c0d5ab0453cf req-d81c1f3e-c991-4ded-a07f-9c5b66636348 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:11.232961 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-85eeff85-b283-434d-8d1b-c0d5ab0453cf req-d81c1f3e-c991-4ded-a07f-9c5b66636348 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:11.247682 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-85eeff85-b283-434d-8d1b-c0d5ab0453cf req-d81c1f3e-c991-4ded-a07f-9c5b66636348 service nova] Creating event network-changed:636830f5-e8dd-4490-8875-671bd1ac26f5 for instance 325d9b10-716d-4961-91d1-70962403fef4 on n-h1-850468-14 Aug 10 23:09:11.252966 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-85eeff85-b283-434d-8d1b-c0d5ab0453cf req-d81c1f3e-c991-4ded-a07f-9c5b66636348 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036442 Aug 10 23:09:11.253774 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1425/2927] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:09:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:09:11.260476 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-58fbdeca-a415-4be3-90f0-7e8075821cf8 tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:09:11.261175 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-58fbdeca-a415-4be3-90f0-7e8075821cf8 tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] [instance: 3fae69e0-e5f3-4ce8-89b5-5d0a410b7be1] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:09:11.267574 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-58fbdeca-a415-4be3-90f0-7e8075821cf8 tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:11.268156 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-58fbdeca-a415-4be3-90f0-7e8075821cf8 tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:11.268785 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-58fbdeca-a415-4be3-90f0-7e8075821cf8 tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:11.269659 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-58fbdeca-a415-4be3-90f0-7e8075821cf8 tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:11.270108 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-58fbdeca-a415-4be3-90f0-7e8075821cf8 tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:11.270527 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-58fbdeca-a415-4be3-90f0-7e8075821cf8 tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:11.513570 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-58fbdeca-a415-4be3-90f0-7e8075821cf8 tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7caa911d519e4711bf9a251b04ebe8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad554e982ff483098acf8a3b58e3842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:09:11.523816 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-58fbdeca-a415-4be3-90f0-7e8075821cf8 tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] 10.222.0.58 "GET /compute/v2.1/servers/3fae69e0-e5f3-4ce8-89b5-5d0a410b7be1" status: 200 len: 1323 microversion: 2.1 time: 0.268666 Aug 10 23:09:11.528371 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1426/2928] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:09:11 2022] GET /compute/v2.1/servers/3fae69e0-e5f3-4ce8-89b5-5d0a410b7be1 => generated 1323 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:09:11.539757 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-69c016f5-fa6a-4ad4-aee8-d104392cc0ee req-2bae4c0b-58d1-4b8a-958f-35d034a77917 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d884a052-b397-41de-93d5-577428e292c1", "name": "network-vif-plugged", "status": "completed", "tag": "bcc20647-ddf4-4615-ad16-a1db09bc1caa"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:09:11.540459 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.network.neutron [None req-254db0c9-c1e5-47c6-8645-f8a73954adf0 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] [instance: 325d9b10-716d-4961-91d1-70962403fef4] Building network info cache for instance {{(pid=122633) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 10 23:09:11.554976 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-69c016f5-fa6a-4ad4-aee8-d104392cc0ee req-2bae4c0b-58d1-4b8a-958f-35d034a77917 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:11.555462 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-69c016f5-fa6a-4ad4-aee8-d104392cc0ee req-2bae4c0b-58d1-4b8a-958f-35d034a77917 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:11.555896 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-69c016f5-fa6a-4ad4-aee8-d104392cc0ee req-2bae4c0b-58d1-4b8a-958f-35d034a77917 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:11.577415 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-69c016f5-fa6a-4ad4-aee8-d104392cc0ee req-2bae4c0b-58d1-4b8a-958f-35d034a77917 service nova] Creating event network-vif-plugged:bcc20647-ddf4-4615-ad16-a1db09bc1caa for instance d884a052-b397-41de-93d5-577428e292c1 on n-h2-850468-14 Aug 10 23:09:11.586770 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-69c016f5-fa6a-4ad4-aee8-d104392cc0ee req-2bae4c0b-58d1-4b8a-958f-35d034a77917 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057065 Aug 10 23:09:11.588763 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1427/2929] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:09:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:09:11.608335 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-f3628047-b3f5-4cd5-92a8-af00a7175668 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:09:11.609152 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-f3628047-b3f5-4cd5-92a8-af00a7175668 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] [instance: d09d04b1-bc37-4290-873e-ce2adae19eaf] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:09:11.616918 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f3628047-b3f5-4cd5-92a8-af00a7175668 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:11.617822 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f3628047-b3f5-4cd5-92a8-af00a7175668 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:11.618269 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f3628047-b3f5-4cd5-92a8-af00a7175668 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:11.619159 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f3628047-b3f5-4cd5-92a8-af00a7175668 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:11.619855 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f3628047-b3f5-4cd5-92a8-af00a7175668 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:11.620020 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f3628047-b3f5-4cd5-92a8-af00a7175668 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:11.902353 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-f3628047-b3f5-4cd5-92a8-af00a7175668 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bbb4f184e4409d9eed51e0b98dfb29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708f8d4c4ed6432d85e0bf6a9bac7677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:09:11.911237 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-f3628047-b3f5-4cd5-92a8-af00a7175668 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] 10.222.0.58 "GET /compute/v2.1/servers/d09d04b1-bc37-4290-873e-ce2adae19eaf" status: 200 len: 1325 microversion: 2.1 time: 0.318791 Aug 10 23:09:11.918138 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1428/2930] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:09:11 2022] GET /compute/v2.1/servers/d09d04b1-bc37-4290-873e-ce2adae19eaf => generated 1325 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:09:11.926957 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-0420f793-29d7-43bc-8714-3c3519d7f2c3 tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.2.231"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:09:11.930072 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-0420f793-29d7-43bc-8714-3c3519d7f2c3 tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] [instance: 61e7db28-1e60-444a-b6c0-dd65ef3f5a6b] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:09:11.946329 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0420f793-29d7-43bc-8714-3c3519d7f2c3 tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:11.946850 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0420f793-29d7-43bc-8714-3c3519d7f2c3 tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:11.950468 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0420f793-29d7-43bc-8714-3c3519d7f2c3 tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:11.951603 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0420f793-29d7-43bc-8714-3c3519d7f2c3 tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:11.952250 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0420f793-29d7-43bc-8714-3c3519d7f2c3 tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:11.953026 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0420f793-29d7-43bc-8714-3c3519d7f2c3 tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:12.027996 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0420f793-29d7-43bc-8714-3c3519d7f2c3 tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Acquiring lock "refresh_cache-61e7db28-1e60-444a-b6c0-dd65ef3f5a6b" {{(pid=122632) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 10 23:09:12.028647 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0420f793-29d7-43bc-8714-3c3519d7f2c3 tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Acquired lock "refresh_cache-61e7db28-1e60-444a-b6c0-dd65ef3f5a6b" {{(pid=122632) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 10 23:09:12.276786 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.network.neutron [None req-254db0c9-c1e5-47c6-8645-f8a73954adf0 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] [instance: 325d9b10-716d-4961-91d1-70962403fef4] Updating instance_info_cache with network_info: [{"id": "636830f5-e8dd-4490-8875-671bd1ac26f5", "address": "fa:16:3e:c1:bc:31", "network": {"id": "07bfb2f7-51b9-4172-a9a7-422d66f84c9d", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-2080469274-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "01ab3ad5c0ef448aaa1282112bf20d83", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap636830f5-e8", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122633) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 10 23:09:12.286304 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-254db0c9-c1e5-47c6-8645-f8a73954adf0 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Releasing lock "refresh_cache-325d9b10-716d-4961-91d1-70962403fef4" {{(pid=122633) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 10 23:09:12.288468 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-254db0c9-c1e5-47c6-8645-f8a73954adf0 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] 10.222.0.58 "POST /compute/v2.1/servers/325d9b10-716d-4961-91d1-70962403fef4/action" status: 202 len: 0 microversion: 2.1 time: 3.268224 Aug 10 23:09:12.289727 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1503/2931] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:09:09 2022] POST /compute/v2.1/servers/325d9b10-716d-4961-91d1-70962403fef4/action => generated 0 bytes in 3284 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 10 23:09:12.295495 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-6d71967b-59c4-451b-8a74-db18408e883f tempest-KeyPairsV2TestJSON-1954713352 tempest-KeyPairsV2TestJSON-1954713352-project] Calling method '.version_select at 0x7f847c5141f0>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:09:12.330524 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-6d71967b-59c4-451b-8a74-db18408e883f tempest-KeyPairsV2TestJSON-1954713352 tempest-KeyPairsV2TestJSON-1954713352-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1399894436" status: 202 len: 0 microversion: 2.1 time: 0.039317 Aug 10 23:09:12.332457 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1504/2932] 10.222.0.58 () {58 vars in 1278 bytes} [Wed Aug 10 23:09:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1399894436 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:09:12.348107 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-c61e5d4f-920f-401d-91f6-2f0923c5d67f req-661fb3b1-36fd-4d3a-85e6-bb9714254c06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "325d9b10-716d-4961-91d1-70962403fef4", "tag": "636830f5-e8dd-4490-8875-671bd1ac26f5"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:09:12.363935 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-c61e5d4f-920f-401d-91f6-2f0923c5d67f req-661fb3b1-36fd-4d3a-85e6-bb9714254c06 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:12.364710 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-c61e5d4f-920f-401d-91f6-2f0923c5d67f req-661fb3b1-36fd-4d3a-85e6-bb9714254c06 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:12.366136 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-c61e5d4f-920f-401d-91f6-2f0923c5d67f req-661fb3b1-36fd-4d3a-85e6-bb9714254c06 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:12.380876 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-c61e5d4f-920f-401d-91f6-2f0923c5d67f req-661fb3b1-36fd-4d3a-85e6-bb9714254c06 service nova] Creating event network-changed:636830f5-e8dd-4490-8875-671bd1ac26f5 for instance 325d9b10-716d-4961-91d1-70962403fef4 on n-h1-850468-14 Aug 10 23:09:12.387610 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-c61e5d4f-920f-401d-91f6-2f0923c5d67f req-661fb3b1-36fd-4d3a-85e6-bb9714254c06 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053174 Aug 10 23:09:12.388997 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1505/2933] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:09:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:09:12.400535 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-e33a7d09-1778-47a3-be46-d49f03027991 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:09:12.401788 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-e33a7d09-1778-47a3-be46-d49f03027991 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] [instance: 5ea8116b-d76a-4b57-9d22-c6a3b8b10867] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:09:12.410077 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e33a7d09-1778-47a3-be46-d49f03027991 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:12.410815 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e33a7d09-1778-47a3-be46-d49f03027991 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:12.411565 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e33a7d09-1778-47a3-be46-d49f03027991 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:12.413272 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e33a7d09-1778-47a3-be46-d49f03027991 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:12.413958 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e33a7d09-1778-47a3-be46-d49f03027991 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:12.414693 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e33a7d09-1778-47a3-be46-d49f03027991 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:12.585414 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-e33a7d09-1778-47a3-be46-d49f03027991 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca7d06f2acb44558d405a3b35a59550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7f70700e035444c9f2c9fa491c5c41a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:09:12.594188 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-e33a7d09-1778-47a3-be46-d49f03027991 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] 10.222.0.58 "GET /compute/v2.1/servers/5ea8116b-d76a-4b57-9d22-c6a3b8b10867" status: 200 len: 1318 microversion: 2.1 time: 0.198641 Aug 10 23:09:12.608041 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1506/2934] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:09:12 2022] GET /compute/v2.1/servers/5ea8116b-d76a-4b57-9d22-c6a3b8b10867 => generated 1318 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:09:12.616333 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-af985d03-a2ca-4721-b1da-896a82f25659 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Calling method '.version_select at 0x7f847d308310>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:09:13.299455 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=28 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:09:13.727139 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-af985d03-a2ca-4721-b1da-896a82f25659 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] 10.222.0.58 "DELETE /compute/v2.1/os-floating-ips/ff43c0db-4df2-42c2-9cbc-afb60fa3b642" status: 202 len: 0 microversion: 2.1 time: 1.117549 Aug 10 23:09:13.728267 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1507/2935] 10.222.0.58 () {58 vars in 1263 bytes} [Wed Aug 10 23:09:12 2022] DELETE /compute/v2.1/os-floating-ips/ff43c0db-4df2-42c2-9cbc-afb60fa3b642 => generated 0 bytes in 1119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:09:13.735173 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-20e62638-61ee-4b47-8d3e-f9f7d5f67c8a tempest-KeyPairsV2TestJSON-1954713352 tempest-KeyPairsV2TestJSON-1954713352-project] Calling method '.version_select at 0x7f847d308670>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:09:13.756544 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-20e62638-61ee-4b47-8d3e-f9f7d5f67c8a tempest-KeyPairsV2TestJSON-1954713352 tempest-KeyPairsV2TestJSON-1954713352-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1011170603" status: 202 len: 0 microversion: 2.1 time: 0.026300 Aug 10 23:09:13.761129 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1508/2936] 10.222.0.58 () {58 vars in 1278 bytes} [Wed Aug 10 23:09:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1011170603 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:09:13.763323 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-ce83be83-5cbc-4dbf-8c80-df62b1ab96a2 tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:09:13.763569 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-ce83be83-5cbc-4dbf-8c80-df62b1ab96a2 tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] [instance: 3fae69e0-e5f3-4ce8-89b5-5d0a410b7be1] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:09:13.770936 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ce83be83-5cbc-4dbf-8c80-df62b1ab96a2 tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:13.772388 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ce83be83-5cbc-4dbf-8c80-df62b1ab96a2 tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:13.773018 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ce83be83-5cbc-4dbf-8c80-df62b1ab96a2 tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:13.774037 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ce83be83-5cbc-4dbf-8c80-df62b1ab96a2 tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:13.774659 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ce83be83-5cbc-4dbf-8c80-df62b1ab96a2 tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:13.775413 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ce83be83-5cbc-4dbf-8c80-df62b1ab96a2 tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:13.937019 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.network.neutron [None req-0420f793-29d7-43bc-8714-3c3519d7f2c3 tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] [instance: 61e7db28-1e60-444a-b6c0-dd65ef3f5a6b] Building network info cache for instance {{(pid=122632) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 10 23:09:13.970611 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-ce83be83-5cbc-4dbf-8c80-df62b1ab96a2 tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7caa911d519e4711bf9a251b04ebe8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad554e982ff483098acf8a3b58e3842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:09:13.980104 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-ce83be83-5cbc-4dbf-8c80-df62b1ab96a2 tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] 10.222.0.58 "GET /compute/v2.1/servers/3fae69e0-e5f3-4ce8-89b5-5d0a410b7be1" status: 200 len: 1323 microversion: 2.1 time: 0.221481 Aug 10 23:09:13.981360 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1509/2937] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:09:13 2022] GET /compute/v2.1/servers/3fae69e0-e5f3-4ce8-89b5-5d0a410b7be1 => generated 1323 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:09:13.999437 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-e359376b-4ecf-4c77-bc20-81f06e53a050 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:09:14.000371 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-e359376b-4ecf-4c77-bc20-81f06e53a050 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] [instance: d09d04b1-bc37-4290-873e-ce2adae19eaf] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:09:14.008438 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e359376b-4ecf-4c77-bc20-81f06e53a050 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:14.009303 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e359376b-4ecf-4c77-bc20-81f06e53a050 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:14.009959 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e359376b-4ecf-4c77-bc20-81f06e53a050 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:14.010730 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e359376b-4ecf-4c77-bc20-81f06e53a050 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:14.011392 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e359376b-4ecf-4c77-bc20-81f06e53a050 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:14.012121 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e359376b-4ecf-4c77-bc20-81f06e53a050 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:14.226115 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-e359376b-4ecf-4c77-bc20-81f06e53a050 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bbb4f184e4409d9eed51e0b98dfb29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708f8d4c4ed6432d85e0bf6a9bac7677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:09:14.242086 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-e359376b-4ecf-4c77-bc20-81f06e53a050 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] 10.222.0.58 "GET /compute/v2.1/servers/d09d04b1-bc37-4290-873e-ce2adae19eaf" status: 200 len: 1325 microversion: 2.1 time: 0.259327 Aug 10 23:09:14.245230 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1510/2938] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:09:13 2022] GET /compute/v2.1/servers/d09d04b1-bc37-4290-873e-ce2adae19eaf => generated 1325 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:09:14.250243 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-b21482c4-f95b-4e65-936d-b4863f39245e req-33051739-6060-416b-aed3-b04b880bcaa0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d09d04b1-bc37-4290-873e-ce2adae19eaf", "name": "network-vif-plugged", "status": "completed", "tag": "7c24b140-f5ee-4079-a313-c307f5d3865b"}, {"server_uuid": "3fae69e0-e5f3-4ce8-89b5-5d0a410b7be1", "name": "network-vif-plugged", "status": "completed", "tag": "da2ce90a-71d7-4814-80a4-becf56274e9d"}, {"server_uuid": "5ea8116b-d76a-4b57-9d22-c6a3b8b10867", "name": "network-vif-plugged", "status": "completed", "tag": "a3c41df0-52c7-490e-8544-bb0663ab5e7b"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:09:14.263658 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-b21482c4-f95b-4e65-936d-b4863f39245e req-33051739-6060-416b-aed3-b04b880bcaa0 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:14.264485 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-b21482c4-f95b-4e65-936d-b4863f39245e req-33051739-6060-416b-aed3-b04b880bcaa0 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:14.265082 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-b21482c4-f95b-4e65-936d-b4863f39245e req-33051739-6060-416b-aed3-b04b880bcaa0 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:14.302759 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-b21482c4-f95b-4e65-936d-b4863f39245e req-33051739-6060-416b-aed3-b04b880bcaa0 service nova] Creating event network-vif-plugged:7c24b140-f5ee-4079-a313-c307f5d3865b for instance d09d04b1-bc37-4290-873e-ce2adae19eaf on n-h1-850468-14 Aug 10 23:09:14.303981 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-b21482c4-f95b-4e65-936d-b4863f39245e req-33051739-6060-416b-aed3-b04b880bcaa0 service nova] Creating event network-vif-plugged:da2ce90a-71d7-4814-80a4-becf56274e9d for instance 3fae69e0-e5f3-4ce8-89b5-5d0a410b7be1 on n-h2-850468-14 Aug 10 23:09:14.304658 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-b21482c4-f95b-4e65-936d-b4863f39245e req-33051739-6060-416b-aed3-b04b880bcaa0 service nova] Creating event network-vif-plugged:a3c41df0-52c7-490e-8544-bb0663ab5e7b for instance 5ea8116b-d76a-4b57-9d22-c6a3b8b10867 on n-h1-850468-14 Aug 10 23:09:14.318352 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-b21482c4-f95b-4e65-936d-b4863f39245e req-33051739-6060-416b-aed3-b04b880bcaa0 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.071652 Aug 10 23:09:14.319526 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1511/2939] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:09:14 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:09:14.326424 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-23b26254-097f-4db3-9940-557d1f8286ae tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:09:14.327929 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-23b26254-097f-4db3-9940-557d1f8286ae tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] [instance: 5ea8116b-d76a-4b57-9d22-c6a3b8b10867] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:09:14.336328 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-23b26254-097f-4db3-9940-557d1f8286ae tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:14.337156 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-23b26254-097f-4db3-9940-557d1f8286ae tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:14.337652 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-23b26254-097f-4db3-9940-557d1f8286ae tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:14.338413 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-23b26254-097f-4db3-9940-557d1f8286ae tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:14.339045 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-23b26254-097f-4db3-9940-557d1f8286ae tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:14.340169 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-23b26254-097f-4db3-9940-557d1f8286ae tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:14.609658 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-23b26254-097f-4db3-9940-557d1f8286ae tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca7d06f2acb44558d405a3b35a59550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7f70700e035444c9f2c9fa491c5c41a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:09:14.619307 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-23b26254-097f-4db3-9940-557d1f8286ae tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] 10.222.0.58 "GET /compute/v2.1/servers/5ea8116b-d76a-4b57-9d22-c6a3b8b10867" status: 200 len: 1318 microversion: 2.1 time: 0.298123 Aug 10 23:09:14.623577 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1512/2940] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:09:14 2022] GET /compute/v2.1/servers/5ea8116b-d76a-4b57-9d22-c6a3b8b10867 => generated 1318 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:09:14.639831 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c2ad5b96-8a1e-477a-974b-310530629418 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Calling method '.version_select at 0x7f847d278280>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:09:15.056459 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.network.neutron [None req-0420f793-29d7-43bc-8714-3c3519d7f2c3 tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] [instance: 61e7db28-1e60-444a-b6c0-dd65ef3f5a6b] Updating instance_info_cache with network_info: [{"id": "993de175-c53f-4b4e-a8ba-348ecebfaf8f", "address": "fa:16:3e:3d:2d:da", "network": {"id": "554d8b60-99a8-4956-bd23-59eb61c37a51", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1140502993-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.2.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "8e4512070fb74a32a9203526a025914e", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap993de175-c5", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122632) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 10 23:09:15.072423 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0420f793-29d7-43bc-8714-3c3519d7f2c3 tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Releasing lock "refresh_cache-61e7db28-1e60-444a-b6c0-dd65ef3f5a6b" {{(pid=122632) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 10 23:09:15.073471 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-0420f793-29d7-43bc-8714-3c3519d7f2c3 tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] 10.222.0.58 "POST /compute/v2.1/servers/61e7db28-1e60-444a-b6c0-dd65ef3f5a6b/action" status: 202 len: 0 microversion: 2.1 time: 3.154423 Aug 10 23:09:15.074098 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1429/2941] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:09:11 2022] POST /compute/v2.1/servers/61e7db28-1e60-444a-b6c0-dd65ef3f5a6b/action => generated 0 bytes in 3156 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 10 23:09:15.095636 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-3df65868-088e-4e77-8c33-b32dc16c5d71 req-aee4932e-4f28-480c-8d0d-90df7278f06f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61e7db28-1e60-444a-b6c0-dd65ef3f5a6b", "tag": "993de175-c53f-4b4e-a8ba-348ecebfaf8f"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:09:15.112810 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-3df65868-088e-4e77-8c33-b32dc16c5d71 req-aee4932e-4f28-480c-8d0d-90df7278f06f service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:15.113513 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-3df65868-088e-4e77-8c33-b32dc16c5d71 req-aee4932e-4f28-480c-8d0d-90df7278f06f service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:15.114136 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-3df65868-088e-4e77-8c33-b32dc16c5d71 req-aee4932e-4f28-480c-8d0d-90df7278f06f service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:15.128710 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-3df65868-088e-4e77-8c33-b32dc16c5d71 req-aee4932e-4f28-480c-8d0d-90df7278f06f service nova] Creating event network-changed:993de175-c53f-4b4e-a8ba-348ecebfaf8f for instance 61e7db28-1e60-444a-b6c0-dd65ef3f5a6b on n-h1-850468-14 Aug 10 23:09:15.134961 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-3df65868-088e-4e77-8c33-b32dc16c5d71 req-aee4932e-4f28-480c-8d0d-90df7278f06f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049673 Aug 10 23:09:15.135811 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1430/2942] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:09:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:09:15.142523 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-fcf46328-19ef-48ef-a54e-b4a49676b98c tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:09:15.143547 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-fcf46328-19ef-48ef-a54e-b4a49676b98c tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] [instance: 3fae69e0-e5f3-4ce8-89b5-5d0a410b7be1] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:09:15.150676 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fcf46328-19ef-48ef-a54e-b4a49676b98c tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:15.151333 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fcf46328-19ef-48ef-a54e-b4a49676b98c tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:15.151775 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fcf46328-19ef-48ef-a54e-b4a49676b98c tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:15.152480 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fcf46328-19ef-48ef-a54e-b4a49676b98c tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:15.152932 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fcf46328-19ef-48ef-a54e-b4a49676b98c tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:15.153864 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fcf46328-19ef-48ef-a54e-b4a49676b98c tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:15.354479 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-c2ad5b96-8a1e-477a-974b-310530629418 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/2b250132-528a-44eb-ba2d-36012444bfc6" status: 202 len: 0 microversion: 2.1 time: 0.718375 Aug 10 23:09:15.356045 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1513/2943] 10.222.0.58 () {58 vars in 1272 bytes} [Wed Aug 10 23:09:14 2022] DELETE /compute/v2.1/os-security-groups/2b250132-528a-44eb-ba2d-36012444bfc6 => generated 0 bytes in 721 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:09:15.362290 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-25dbb736-cebc-432a-8c7f-8c523df3e847 tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Action: 'create', calling method: .version_select at 0x7f847d1db1f0>, body: {"pool": "be521539-5d5d-4685-a1fe-5d99a84b809e"} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:09:15.865973 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-fcf46328-19ef-48ef-a54e-b4a49676b98c tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7caa911d519e4711bf9a251b04ebe8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad554e982ff483098acf8a3b58e3842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:09:15.877579 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-fcf46328-19ef-48ef-a54e-b4a49676b98c tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] 10.222.0.58 "GET /compute/v2.1/servers/3fae69e0-e5f3-4ce8-89b5-5d0a410b7be1" status: 200 len: 1323 microversion: 2.1 time: 0.740012 Aug 10 23:09:15.904215 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1431/2944] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:09:15 2022] GET /compute/v2.1/servers/3fae69e0-e5f3-4ce8-89b5-5d0a410b7be1 => generated 1323 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:09:15.936693 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-2ecf3cb0-3e3b-4499-81f8-1d1268bec117 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:09:15.941249 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-2ecf3cb0-3e3b-4499-81f8-1d1268bec117 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] [instance: d09d04b1-bc37-4290-873e-ce2adae19eaf] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:09:15.953076 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2ecf3cb0-3e3b-4499-81f8-1d1268bec117 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:15.954046 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2ecf3cb0-3e3b-4499-81f8-1d1268bec117 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:15.956665 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2ecf3cb0-3e3b-4499-81f8-1d1268bec117 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:15.958041 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2ecf3cb0-3e3b-4499-81f8-1d1268bec117 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:15.967913 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2ecf3cb0-3e3b-4499-81f8-1d1268bec117 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:15.970716 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2ecf3cb0-3e3b-4499-81f8-1d1268bec117 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:16.365653 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-2ecf3cb0-3e3b-4499-81f8-1d1268bec117 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bbb4f184e4409d9eed51e0b98dfb29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708f8d4c4ed6432d85e0bf6a9bac7677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:09:16.374546 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-2ecf3cb0-3e3b-4499-81f8-1d1268bec117 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] 10.222.0.58 "GET /compute/v2.1/servers/d09d04b1-bc37-4290-873e-ce2adae19eaf" status: 200 len: 1325 microversion: 2.1 time: 0.446878 Aug 10 23:09:16.375521 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1432/2945] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:09:15 2022] GET /compute/v2.1/servers/d09d04b1-bc37-4290-873e-ce2adae19eaf => generated 1325 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:09:16.383708 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-bede1695-c9b7-41f7-80c1-c617b9a6d82d tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:09:16.384518 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-bede1695-c9b7-41f7-80c1-c617b9a6d82d tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] [instance: 325d9b10-716d-4961-91d1-70962403fef4] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:09:16.391492 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bede1695-c9b7-41f7-80c1-c617b9a6d82d tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:16.392201 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bede1695-c9b7-41f7-80c1-c617b9a6d82d tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:16.392895 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bede1695-c9b7-41f7-80c1-c617b9a6d82d tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:16.394059 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bede1695-c9b7-41f7-80c1-c617b9a6d82d tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:16.394711 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bede1695-c9b7-41f7-80c1-c617b9a6d82d tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:16.395304 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bede1695-c9b7-41f7-80c1-c617b9a6d82d tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:16.452600 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-bede1695-c9b7-41f7-80c1-c617b9a6d82d tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] [instance: 325d9b10-716d-4961-91d1-70962403fef4] Going to try to terminate instance {{(pid=122632) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:09:16.659608 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-bede1695-c9b7-41f7-80c1-c617b9a6d82d tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] 10.222.0.58 "DELETE /compute/v2.1/servers/325d9b10-716d-4961-91d1-70962403fef4" status: 204 len: 0 microversion: 2.1 time: 0.280362 Aug 10 23:09:16.660452 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1433/2946] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:09:16 2022] DELETE /compute/v2.1/servers/325d9b10-716d-4961-91d1-70962403fef4 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:09:16.680954 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-d162fcda-ac76-48cc-ae07-047d3bbc75ef tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:09:16.683078 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-d162fcda-ac76-48cc-ae07-047d3bbc75ef tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] [instance: 5ea8116b-d76a-4b57-9d22-c6a3b8b10867] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:09:16.697240 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d162fcda-ac76-48cc-ae07-047d3bbc75ef tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:16.697737 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d162fcda-ac76-48cc-ae07-047d3bbc75ef tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:16.698176 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d162fcda-ac76-48cc-ae07-047d3bbc75ef tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:16.701708 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d162fcda-ac76-48cc-ae07-047d3bbc75ef tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:16.702187 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d162fcda-ac76-48cc-ae07-047d3bbc75ef tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:16.702627 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d162fcda-ac76-48cc-ae07-047d3bbc75ef tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:16.916676 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-d162fcda-ac76-48cc-ae07-047d3bbc75ef tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca7d06f2acb44558d405a3b35a59550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7f70700e035444c9f2c9fa491c5c41a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:09:16.925508 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-d162fcda-ac76-48cc-ae07-047d3bbc75ef tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] 10.222.0.58 "GET /compute/v2.1/servers/5ea8116b-d76a-4b57-9d22-c6a3b8b10867" status: 200 len: 1506 microversion: 2.1 time: 0.261045 Aug 10 23:09:16.926931 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1434/2947] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:09:16 2022] GET /compute/v2.1/servers/5ea8116b-d76a-4b57-9d22-c6a3b8b10867 => generated 1506 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:09:16.944671 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-25fdbb20-2e11-41e9-a73d-4b45b6fe3bef tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:09:16.949489 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-25fdbb20-2e11-41e9-a73d-4b45b6fe3bef tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] [instance: 325d9b10-716d-4961-91d1-70962403fef4] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:09:16.957552 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-25fdbb20-2e11-41e9-a73d-4b45b6fe3bef tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:16.958212 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-25fdbb20-2e11-41e9-a73d-4b45b6fe3bef tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:16.958967 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-25fdbb20-2e11-41e9-a73d-4b45b6fe3bef tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:16.959844 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-25fdbb20-2e11-41e9-a73d-4b45b6fe3bef tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:16.960506 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-25fdbb20-2e11-41e9-a73d-4b45b6fe3bef tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:16.961114 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-25fdbb20-2e11-41e9-a73d-4b45b6fe3bef tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:16.966919 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=92,nova_cell1:SAVEPOINT=2,nova_cell1:UPDATE=3,nova_cell1:RELEASE=2,nova_cell1:INSERT=1 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:09:17.141209 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-25dbb736-cebc-432a-8c7f-8c523df3e847 tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] 10.222.0.58 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 1.783800 Aug 10 23:09:17.142204 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1514/2948] 10.222.0.58 () {60 vars in 1170 bytes} [Wed Aug 10 23:09:15 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 1785 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:09:17.147749 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-3ae2ed7b-7fc0-440c-9b60-8906dc686db5 tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:09:17.148673 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-3ae2ed7b-7fc0-440c-9b60-8906dc686db5 tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] [instance: 3fae69e0-e5f3-4ce8-89b5-5d0a410b7be1] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:09:17.168514 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3ae2ed7b-7fc0-440c-9b60-8906dc686db5 tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:17.169258 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3ae2ed7b-7fc0-440c-9b60-8906dc686db5 tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:17.170154 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3ae2ed7b-7fc0-440c-9b60-8906dc686db5 tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:17.171157 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3ae2ed7b-7fc0-440c-9b60-8906dc686db5 tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:17.171624 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3ae2ed7b-7fc0-440c-9b60-8906dc686db5 tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:17.172064 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3ae2ed7b-7fc0-440c-9b60-8906dc686db5 tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:17.172922 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-25fdbb20-2e11-41e9-a73d-4b45b6fe3bef tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84e70c3ea5347e79ba5aee661b15ce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ab3ad5c0ef448aaa1282112bf20d83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:09:17.181654 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-25fdbb20-2e11-41e9-a73d-4b45b6fe3bef tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] 10.222.0.58 "GET /compute/v2.1/servers/325d9b10-716d-4961-91d1-70962403fef4" status: 200 len: 1509 microversion: 2.1 time: 0.253075 Aug 10 23:09:17.190819 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1435/2949] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:09:16 2022] GET /compute/v2.1/servers/325d9b10-716d-4961-91d1-70962403fef4 => generated 1509 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:09:17.190819 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-a9ba9877-a374-412e-92e6-308d21f64934 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:09:17.190819 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-a9ba9877-a374-412e-92e6-308d21f64934 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] [instance: d884a052-b397-41de-93d5-577428e292c1] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:09:17.195291 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a9ba9877-a374-412e-92e6-308d21f64934 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:17.196044 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a9ba9877-a374-412e-92e6-308d21f64934 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:17.196720 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a9ba9877-a374-412e-92e6-308d21f64934 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:17.197665 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a9ba9877-a374-412e-92e6-308d21f64934 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:17.198225 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a9ba9877-a374-412e-92e6-308d21f64934 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:17.198761 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a9ba9877-a374-412e-92e6-308d21f64934 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:17.341098 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-3ae2ed7b-7fc0-440c-9b60-8906dc686db5 tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7caa911d519e4711bf9a251b04ebe8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad554e982ff483098acf8a3b58e3842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:09:17.354556 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-3ae2ed7b-7fc0-440c-9b60-8906dc686db5 tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] 10.222.0.58 "GET /compute/v2.1/servers/3fae69e0-e5f3-4ce8-89b5-5d0a410b7be1" status: 200 len: 1519 microversion: 2.1 time: 0.210919 Aug 10 23:09:17.366812 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1515/2950] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:09:17 2022] GET /compute/v2.1/servers/3fae69e0-e5f3-4ce8-89b5-5d0a410b7be1 => generated 1519 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:09:17.366812 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-d9f9c3b7-f4ce-4b79-9b5b-60d67fa53502 tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.2.228"}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:09:17.367172 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-a9ba9877-a374-412e-92e6-308d21f64934 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca7d06f2acb44558d405a3b35a59550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7f70700e035444c9f2c9fa491c5c41a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:09:17.367611 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-d9f9c3b7-f4ce-4b79-9b5b-60d67fa53502 tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] [instance: 61e7db28-1e60-444a-b6c0-dd65ef3f5a6b] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:09:17.371007 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d9f9c3b7-f4ce-4b79-9b5b-60d67fa53502 tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:17.371963 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d9f9c3b7-f4ce-4b79-9b5b-60d67fa53502 tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:17.372314 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-a9ba9877-a374-412e-92e6-308d21f64934 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] 10.222.0.58 "GET /compute/v2.1/servers/d884a052-b397-41de-93d5-577428e292c1" status: 200 len: 1507 microversion: 2.1 time: 0.187655 Aug 10 23:09:17.387450 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1436/2951] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:09:17 2022] GET /compute/v2.1/servers/d884a052-b397-41de-93d5-577428e292c1 => generated 1507 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:09:17.387756 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d9f9c3b7-f4ce-4b79-9b5b-60d67fa53502 tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:17.387756 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d9f9c3b7-f4ce-4b79-9b5b-60d67fa53502 tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:17.387756 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d9f9c3b7-f4ce-4b79-9b5b-60d67fa53502 tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:17.388242 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d9f9c3b7-f4ce-4b79-9b5b-60d67fa53502 tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:17.415470 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d9f9c3b7-f4ce-4b79-9b5b-60d67fa53502 tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Acquiring lock "refresh_cache-61e7db28-1e60-444a-b6c0-dd65ef3f5a6b" {{(pid=122633) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 10 23:09:17.415891 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d9f9c3b7-f4ce-4b79-9b5b-60d67fa53502 tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Acquired lock "refresh_cache-61e7db28-1e60-444a-b6c0-dd65ef3f5a6b" {{(pid=122633) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 10 23:09:17.594522 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-16617b83-87c2-41e1-8ee7-1c7dcd4ca498 tempest-KeyPairsV22TestJSON-1733237097 tempest-KeyPairsV22TestJSON-1733237097-project] Action: 'create', calling method: .version_select at 0x7f847d1b70d0>, body: {"keypair": {"name": "tempest-keypair-2017985082", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMj5W+RGbdzQIQuzOJmTtRQYZeR+Mx3HAM9DgVUtKme2YQD51ZAnjl6xkg5yNWrZYpzOz0yHo//pIZ5nFK2yDvUEBn9coML+Fdc0BeSSz5TblXAijf7GqseCHpeffEpPQw=="}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:09:17.613321 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-16617b83-87c2-41e1-8ee7-1c7dcd4ca498 tempest-KeyPairsV22TestJSON-1733237097 tempest-KeyPairsV22TestJSON-1733237097-project] Getting quotas for project 2d273ce09fa34616b5a9b4f5edea6f13. Resources: {'key_pairs'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:09:17.621714 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-16617b83-87c2-41e1-8ee7-1c7dcd4ca498 tempest-KeyPairsV22TestJSON-1733237097 tempest-KeyPairsV22TestJSON-1733237097-project] Getting quotas for user a9b04960b669465983ee87a114e09c5d and project 2d273ce09fa34616b5a9b4f5edea6f13. Resources: {'key_pairs'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:09:17.655960 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-16617b83-87c2-41e1-8ee7-1c7dcd4ca498 tempest-KeyPairsV22TestJSON-1733237097 tempest-KeyPairsV22TestJSON-1733237097-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.281207 Aug 10 23:09:17.662573 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1437/2952] 10.222.0.58 () {62 vars in 1199 bytes} [Wed Aug 10 23:09:17 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 283 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 10 23:09:17.667663 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-71c0efa2-8e34-477c-85f2-8206a296e370 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:09:17.668169 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-71c0efa2-8e34-477c-85f2-8206a296e370 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] [instance: d884a052-b397-41de-93d5-577428e292c1] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:09:17.678622 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-71c0efa2-8e34-477c-85f2-8206a296e370 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:17.679616 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-71c0efa2-8e34-477c-85f2-8206a296e370 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:17.679857 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-71c0efa2-8e34-477c-85f2-8206a296e370 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:17.680760 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-71c0efa2-8e34-477c-85f2-8206a296e370 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:17.681070 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-71c0efa2-8e34-477c-85f2-8206a296e370 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:17.681500 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-71c0efa2-8e34-477c-85f2-8206a296e370 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:17.712023 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-71c0efa2-8e34-477c-85f2-8206a296e370 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] [instance: d884a052-b397-41de-93d5-577428e292c1] Going to try to terminate instance {{(pid=122632) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:09:17.768510 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=7 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:09:17.837033 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-71c0efa2-8e34-477c-85f2-8206a296e370 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] 10.222.0.58 "DELETE /compute/v2.1/servers/d884a052-b397-41de-93d5-577428e292c1" status: 204 len: 0 microversion: 2.1 time: 0.178703 Aug 10 23:09:17.837633 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1438/2953] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:09:17 2022] DELETE /compute/v2.1/servers/d884a052-b397-41de-93d5-577428e292c1 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:09:17.845929 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-54aef058-a5b6-4b0c-b940-e60a158ef1b7 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:09:17.846806 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-54aef058-a5b6-4b0c-b940-e60a158ef1b7 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] [instance: d09d04b1-bc37-4290-873e-ce2adae19eaf] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:09:17.855864 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-54aef058-a5b6-4b0c-b940-e60a158ef1b7 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:17.856490 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-54aef058-a5b6-4b0c-b940-e60a158ef1b7 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:17.857337 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-54aef058-a5b6-4b0c-b940-e60a158ef1b7 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:17.858840 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-54aef058-a5b6-4b0c-b940-e60a158ef1b7 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:17.860400 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-54aef058-a5b6-4b0c-b940-e60a158ef1b7 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:17.861357 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-54aef058-a5b6-4b0c-b940-e60a158ef1b7 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:17.918018 n-d-850468-14 devstack@n-api.service[122633]: DEBUG neutronclient.v2_0.client [None req-d9f9c3b7-f4ce-4b79-9b5b-60d67fa53502 tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.25.2.228 (6454d361-0912-4d45-8e1a-773074cbb379) with port 993de175-c53f-4b4e-a8ba-348ecebfaf8f using fixed IP 172.20.0.11, as that fixed IP already has a floating IP on external network be521539-5d5d-4685-a1fe-5d99a84b809e.", "detail": ""}} {{(pid=122633) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 10 23:09:17.918671 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d9f9c3b7-f4ce-4b79-9b5b-60d67fa53502 tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Releasing lock "refresh_cache-61e7db28-1e60-444a-b6c0-dd65ef3f5a6b" {{(pid=122633) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 10 23:09:17.920092 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-d9f9c3b7-f4ce-4b79-9b5b-60d67fa53502 tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] HTTP exception thrown: Cannot associate floating IP 172.25.2.228 (6454d361-0912-4d45-8e1a-773074cbb379) with port 993de175-c53f-4b4e-a8ba-348ecebfaf8f using fixed IP 172.20.0.11, as that fixed IP already has a floating IP on external network be521539-5d5d-4685-a1fe-5d99a84b809e. Aug 10 23:09:17.920092 n-d-850468-14 devstack@n-api.service[122633]: Neutron server returns request_ids: ['req-d4e10e64-5b61-4173-8041-6461150d0a0e'] Aug 10 23:09:17.923179 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-d9f9c3b7-f4ce-4b79-9b5b-60d67fa53502 tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Request method failure captured: Aug 10 23:09:17.923179 n-d-850468-14 devstack@n-api.service[122633]: request: POST /compute/v2.1/servers/61e7db28-1e60-444a-b6c0-dd65ef3f5a6b/action HTTP/1.1 Aug 10 23:09:17.923179 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:09:17.923179 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:09:17.923179 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:09:17.923179 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 46 Aug 10 23:09:17.923179 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:09:17.923179 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:09:17.923179 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:09:17.923179 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:09:17.923179 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9DpyFta3vOC37XpWrOYeYI8WRURapgf9D1TVPTeiZCPP7bJ6dAEgSW5sr5rDDfzvHGfKPR_6zSaQ6Sg3UuNHumb-U4KLrw_PO-OPVMXucIvyvRb3lYadGDmmqm1c9Lpb_T_BUbmnNb_gdjHtUgRAPzKm9OslTBkkgLXABt1EJFhNgpE Aug 10 23:09:17.923179 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:09:17.923179 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:09:17.923179 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:09:17.923179 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:09:17.923179 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:09:17.923179 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:09:17.923179 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 8e4512070fb74a32a9203526a025914e Aug 10 23:09:17.923179 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-272238324 Aug 10 23:09:17.923179 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:09:17.923179 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:09:17.924584 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8e4512070fb74a32a9203526a025914e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8e4512070fb74a32a9203526a025914e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/8e4512070fb74a32a9203526a025914e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_8e4512070fb74a32a9203526a025914e", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:09:17.924584 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-272238324 Aug 10 23:09:17.924584 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 8e4512070fb74a32a9203526a025914e Aug 10 23:09:17.924584 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-272238324 Aug 10 23:09:17.924584 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project Aug 10 23:09:17.924584 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:09:17.924584 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:09:17.924584 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: ca20e8ce3e25491fbe58f97ac5b9250a Aug 10 23:09:17.924584 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project Aug 10 23:09:17.924584 n-d-850468-14 devstack@n-api.service[122633]: Aug 10 23:09:17.924584 n-d-850468-14 devstack@n-api.service[122633]: {"addFloatingIp": {"address": "172.25.2.228"}} Aug 10 23:09:17.924584 n-d-850468-14 devstack@n-api.service[122633]: method: Aug 10 23:09:17.925376 n-d-850468-14 devstack@n-api.service[122633]: exception: Cannot associate floating IP 172.25.2.228 (6454d361-0912-4d45-8e1a-773074cbb379) with port 993de175-c53f-4b4e-a8ba-348ecebfaf8f using fixed IP 172.20.0.11, as that fixed IP already has a floating IP on external network be521539-5d5d-4685-a1fe-5d99a84b809e. Aug 10 23:09:17.925376 n-d-850468-14 devstack@n-api.service[122633]: Neutron server returns request_ids: ['req-d4e10e64-5b61-4173-8041-6461150d0a0e'] Aug 10 23:09:17.925376 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': '61e7db28-1e60-444a-b6c0-dd65ef3f5a6b', 'body': {'addFloatingIp': {'address': '172.25.2.228'}}} Aug 10 23:09:17.925376 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:09:17.925376 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:09:17.925376 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2706, in associate_floating_ip Aug 10 23:09:17.925376 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Aug 10 23:09:17.925376 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 23:09:17.925376 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 23:09:17.925376 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1014, in update_floatingip Aug 10 23:09:17.925376 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Aug 10 23:09:17.925376 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 23:09:17.925376 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 23:09:17.925376 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2520, in _update_resource Aug 10 23:09:17.925376 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Aug 10 23:09:17.925376 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 23:09:17.925376 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 23:09:17.926491 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Aug 10 23:09:17.926491 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Aug 10 23:09:17.926491 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 23:09:17.926491 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 23:09:17.926491 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 23:09:17.926491 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 23:09:17.926491 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 23:09:17.926491 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 23:09:17.926491 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 10 23:09:17.926491 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 10 23:09:17.926491 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 23:09:17.926491 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 23:09:17.926491 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 10 23:09:17.926491 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 10 23:09:17.926491 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 10 23:09:17.926491 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 10 23:09:17.928117 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.25.2.228 (6454d361-0912-4d45-8e1a-773074cbb379) with port 993de175-c53f-4b4e-a8ba-348ecebfaf8f using fixed IP 172.20.0.11, as that fixed IP already has a floating IP on external network be521539-5d5d-4685-a1fe-5d99a84b809e. Aug 10 23:09:17.928117 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d4e10e64-5b61-4173-8041-6461150d0a0e'] Aug 10 23:09:17.928117 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:09:17.928117 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:09:17.928117 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:09:17.928117 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:09:17.928117 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Aug 10 23:09:17.928117 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Aug 10 23:09:17.928117 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 166, in wrapper Aug 10 23:09:17.928117 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Aug 10 23:09:17.928117 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2708, in associate_floating_ip Aug 10 23:09:17.928117 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Aug 10 23:09:17.928117 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.25.2.228 (6454d361-0912-4d45-8e1a-773074cbb379) with port 993de175-c53f-4b4e-a8ba-348ecebfaf8f using fixed IP 172.20.0.11, as that fixed IP already has a floating IP on external network be521539-5d5d-4685-a1fe-5d99a84b809e. Aug 10 23:09:17.928117 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d4e10e64-5b61-4173-8041-6461150d0a0e'] Aug 10 23:09:17.928117 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:09:17.928117 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:09:17.929180 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:09:17.929180 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:09:17.929180 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:09:17.929180 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:09:17.929180 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:09:17.929180 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:09:17.929180 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 23:09:17.929180 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 23:09:17.929180 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:09:17.929180 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:09:17.929180 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 23:09:17.929180 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 23:09:17.929180 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Aug 10 23:09:17.929180 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Aug 10 23:09:17.929180 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.25.2.228 (6454d361-0912-4d45-8e1a-773074cbb379) with port 993de175-c53f-4b4e-a8ba-348ecebfaf8f using fixed IP 172.20.0.11, as that fixed IP already has a floating IP on external network be521539-5d5d-4685-a1fe-5d99a84b809e. Aug 10 23:09:17.929180 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d4e10e64-5b61-4173-8041-6461150d0a0e'] Aug 10 23:09:17.929180 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:09:17.929180 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:09:17.930720 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:09:17.930720 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:09:17.930720 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:09:17.930720 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:09:17.930720 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:09:17.930720 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:09:17.930720 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.25.2.228 (6454d361-0912-4d45-8e1a-773074cbb379) with port 993de175-c53f-4b4e-a8ba-348ecebfaf8f using fixed IP 172.20.0.11, as that fixed IP already has a floating IP on external network be521539-5d5d-4685-a1fe-5d99a84b809e. Aug 10 23:09:17.930720 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d4e10e64-5b61-4173-8041-6461150d0a0e'] Aug 10 23:09:17.930720 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:09:17.934387 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-d9f9c3b7-f4ce-4b79-9b5b-60d67fa53502 tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Returning 400 to user: Cannot associate floating IP 172.25.2.228 (6454d361-0912-4d45-8e1a-773074cbb379) with port 993de175-c53f-4b4e-a8ba-348ecebfaf8f using fixed IP 172.20.0.11, as that fixed IP already has a floating IP on external network be521539-5d5d-4685-a1fe-5d99a84b809e. Aug 10 23:09:17.934387 n-d-850468-14 devstack@n-api.service[122633]: Neutron server returns request_ids: ['req-d4e10e64-5b61-4173-8041-6461150d0a0e'] {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:09:17.934387 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-d9f9c3b7-f4ce-4b79-9b5b-60d67fa53502 tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] 10.222.0.58 "POST /compute/v2.1/servers/61e7db28-1e60-444a-b6c0-dd65ef3f5a6b/action" status: 400 len: 382 microversion: 2.1 time: 0.576327 Aug 10 23:09:17.934387 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1516/2954] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:09:17 2022] POST /compute/v2.1/servers/61e7db28-1e60-444a-b6c0-dd65ef3f5a6b/action => generated 382 bytes in 578 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 10 23:09:17.941434 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-f28e4ebb-2daa-465d-afaa-0652285d49c5 tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1708072268", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "dca78bd6-e5ed-4d53-860b-07b9da7ab161"}]}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:09:17.947252 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-f28e4ebb-2daa-465d-afaa-0652285d49c5 tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] Request method failure captured: Aug 10 23:09:17.947252 n-d-850468-14 devstack@n-api.service[122633]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 10 23:09:17.947252 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:09:17.947252 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:09:17.947252 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:09:17.947252 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 243 Aug 10 23:09:17.947252 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:09:17.947252 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:09:17.947252 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:09:17.947252 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:09:17.947252 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9Dp-a7pZDXsTpf_JTfgkxwnAaESKCIDrR-PKNvSl4WdjMRZc7Q5fZMNMGxwgl3FE-oEkYYpW_CzsON1kv9C7WGJ_kqrpdRzZCsNREfFaZCNdwGSHaOszgZwYcFIIH2XFUlYjLM4TeKVATI4II8ubMmjcsdXbFkULYtMtD1ucA07mDjI Aug 10 23:09:17.947252 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:09:17.947252 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:09:17.947252 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:09:17.947252 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:09:17.947252 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:09:17.947252 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:09:17.947252 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 7ad554e982ff483098acf8a3b58e3842 Aug 10 23:09:17.947252 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-384625613 Aug 10 23:09:17.947252 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:09:17.947252 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:09:17.948974 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7ad554e982ff483098acf8a3b58e3842"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7ad554e982ff483098acf8a3b58e3842"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7ad554e982ff483098acf8a3b58e3842"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7ad554e982ff483098acf8a3b58e3842", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:09:17.948974 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-384625613 Aug 10 23:09:17.948974 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 7ad554e982ff483098acf8a3b58e3842 Aug 10 23:09:17.948974 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-384625613 Aug 10 23:09:17.948974 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-ServerMetadataNegativeTestJSON-384625613-project Aug 10 23:09:17.948974 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:09:17.948974 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:09:17.948974 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 7caa911d519e4711bf9a251b04ebe8dd Aug 10 23:09:17.948974 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-384625613-project Aug 10 23:09:17.948974 n-d-850468-14 devstack@n-api.service[122633]: Aug 10 23:09:17.948974 n-d-850468-14 devstack@n-api.service[122633]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1708072268", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "dca78bd6-e5ed-4d53-860b-07b9da7ab161"}]}} Aug 10 23:09:17.949831 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:09:17.949831 n-d-850468-14 devstack@n-api.service[122633]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 10 23:09:17.949831 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1708072268', 'imageRef': '78ad8905-f66f-4733-8be9-2b260f1fabed', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': 'dca78bd6-e5ed-4d53-860b-07b9da7ab161'}]}}} Aug 10 23:09:17.949831 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:09:17.949831 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:09:17.949831 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 10 23:09:17.949831 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 10 23:09:17.949831 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 10 23:09:17.949831 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise error Aug 10 23:09:17.949831 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 10 23:09:17.949831 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:09:17.949831 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 10 23:09:17.949831 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 10 23:09:17.949831 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 10 23:09:17.949831 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 10 23:09:17.949831 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 10 23:09:17.949831 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:09:17.949831 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 10 23:09:17.949831 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi {'': 'data1'} Aug 10 23:09:17.951352 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:09:17.951352 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:09:17.951352 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:09:17.951352 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:09:17.951352 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:09:17.951352 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:09:17.951352 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:09:17.951352 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:09:17.951352 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:09:17.951352 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:09:17.951352 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 23:09:17.951352 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 23:09:17.951352 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 10 23:09:17.951352 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 10 23:09:17.951352 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 10 23:09:17.951352 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 10 23:09:17.951352 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 10 23:09:17.951352 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 10 23:09:17.951352 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 10 23:09:17.951352 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:09:17.952866 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:09:17.952866 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:09:17.952866 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:09:17.952866 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:09:17.952866 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:09:17.952866 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 10 23:09:17.952866 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 10 23:09:17.952866 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 10 23:09:17.952866 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:09:17.952866 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-f28e4ebb-2daa-465d-afaa-0652285d49c5 tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:09:17.953894 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-f28e4ebb-2daa-465d-afaa-0652285d49c5 tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.017640 Aug 10 23:09:17.954485 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1517/2955] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 23:09:17 2022] POST /compute/v2.1/servers => generated 175 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 10 23:09:17.966694 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-57392237-93f7-40aa-aaaf-9d5829236511 tempest-KeyPairsV22TestJSON-1733237097 tempest-KeyPairsV22TestJSON-1733237097-project] Calling method '.version_select at 0x7f847c8daf70>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:09:17.977669 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-57392237-93f7-40aa-aaaf-9d5829236511 tempest-KeyPairsV22TestJSON-1733237097 tempest-KeyPairsV22TestJSON-1733237097-project] 10.222.0.58 "GET /compute/v2.1/os-keypairs/tempest-keypair-2017985082" status: 200 len: 513 microversion: 2.2 time: 0.021374 Aug 10 23:09:17.985095 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1518/2956] 10.222.0.58 () {60 vars in 1258 bytes} [Wed Aug 10 23:09:17 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-2017985082 => generated 513 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:09:17.992000 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-4d966fc7-d57c-4a0c-9daa-5069bd75b9b1 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:09:17.992565 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-4d966fc7-d57c-4a0c-9daa-5069bd75b9b1 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] [instance: 5ea8116b-d76a-4b57-9d22-c6a3b8b10867] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:09:18.000543 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4d966fc7-d57c-4a0c-9daa-5069bd75b9b1 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:18.001142 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4d966fc7-d57c-4a0c-9daa-5069bd75b9b1 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:18.001649 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4d966fc7-d57c-4a0c-9daa-5069bd75b9b1 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:18.002424 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4d966fc7-d57c-4a0c-9daa-5069bd75b9b1 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:18.002910 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4d966fc7-d57c-4a0c-9daa-5069bd75b9b1 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:18.003477 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4d966fc7-d57c-4a0c-9daa-5069bd75b9b1 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:18.009904 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=98,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:09:18.033472 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-54aef058-a5b6-4b0c-b940-e60a158ef1b7 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bbb4f184e4409d9eed51e0b98dfb29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708f8d4c4ed6432d85e0bf6a9bac7677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:09:18.042447 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-4d966fc7-d57c-4a0c-9daa-5069bd75b9b1 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] [instance: 5ea8116b-d76a-4b57-9d22-c6a3b8b10867] Going to try to terminate instance {{(pid=122633) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:09:18.043245 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-54aef058-a5b6-4b0c-b940-e60a158ef1b7 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] 10.222.0.58 "GET /compute/v2.1/servers/d09d04b1-bc37-4290-873e-ce2adae19eaf" status: 200 len: 1523 microversion: 2.1 time: 0.202395 Aug 10 23:09:18.054807 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1439/2957] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:09:17 2022] GET /compute/v2.1/servers/d09d04b1-bc37-4290-873e-ce2adae19eaf => generated 1523 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:09:18.054807 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-8a4c566a-b35a-4fb3-9892-509258cd7b2f tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Calling method '.version_select at 0x7f847dd8a280>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:09:18.144456 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-4d966fc7-d57c-4a0c-9daa-5069bd75b9b1 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] 10.222.0.58 "DELETE /compute/v2.1/servers/5ea8116b-d76a-4b57-9d22-c6a3b8b10867" status: 204 len: 0 microversion: 2.1 time: 0.157295 Aug 10 23:09:18.155601 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1519/2958] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:09:17 2022] DELETE /compute/v2.1/servers/5ea8116b-d76a-4b57-9d22-c6a3b8b10867 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:09:18.164522 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-ee517401-c5b5-4d9f-9972-b6971a28aa9f tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:09:18.165230 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-ee517401-c5b5-4d9f-9972-b6971a28aa9f tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] [instance: d5a2dde9-a4a4-441d-8aaa-0af837894471] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:09:18.175282 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-ee517401-c5b5-4d9f-9972-b6971a28aa9f tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] HTTP exception thrown: Instance d5a2dde9-a4a4-441d-8aaa-0af837894471 could not be found. Aug 10 23:09:18.194225 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-ee517401-c5b5-4d9f-9972-b6971a28aa9f tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] Request method failure captured: Aug 10 23:09:18.194225 n-d-850468-14 devstack@n-api.service[122633]: request: GET /compute/v2.1/servers/d5a2dde9-a4a4-441d-8aaa-0af837894471/metadata HTTP/1.1 Aug 10 23:09:18.194225 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:09:18.194225 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:09:18.194225 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:09:18.194225 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:09:18.194225 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:09:18.194225 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:09:18.194225 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:09:18.194225 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:09:18.194225 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9Dp-a7pZDXsTpf_JTfgkxwnAaESKCIDrR-PKNvSl4WdjMRZc7Q5fZMNMGxwgl3FE-oEkYYpW_CzsON1kv9C7WGJ_kqrpdRzZCsNREfFaZCNdwGSHaOszgZwYcFIIH2XFUlYjLM4TeKVATI4II8ubMmjcsdXbFkULYtMtD1ucA07mDjI Aug 10 23:09:18.194225 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:09:18.194225 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:09:18.194225 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:09:18.194225 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:09:18.194225 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:09:18.194225 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:09:18.194225 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 7ad554e982ff483098acf8a3b58e3842 Aug 10 23:09:18.194225 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-384625613 Aug 10 23:09:18.194225 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:09:18.194225 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:09:18.195954 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7ad554e982ff483098acf8a3b58e3842"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7ad554e982ff483098acf8a3b58e3842"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7ad554e982ff483098acf8a3b58e3842"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7ad554e982ff483098acf8a3b58e3842", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:09:18.195954 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-384625613 Aug 10 23:09:18.195954 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 7ad554e982ff483098acf8a3b58e3842 Aug 10 23:09:18.195954 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-384625613 Aug 10 23:09:18.195954 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-ServerMetadataNegativeTestJSON-384625613-project Aug 10 23:09:18.195954 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:09:18.195954 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:09:18.195954 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 7caa911d519e4711bf9a251b04ebe8dd Aug 10 23:09:18.195954 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-384625613-project Aug 10 23:09:18.195954 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:09:18.195954 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance d5a2dde9-a4a4-441d-8aaa-0af837894471 could not be found. Aug 10 23:09:18.196784 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'server_id': 'd5a2dde9-a4a4-441d-8aaa-0af837894471'} Aug 10 23:09:18.196784 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:09:18.196784 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:09:18.196784 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:09:18.196784 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:09:18.196784 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:09:18.196784 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:09:18.196784 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 10 23:09:18.196784 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 10 23:09:18.196784 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5a2dde9-a4a4-441d-8aaa-0af837894471 could not be found. Aug 10 23:09:18.196784 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:09:18.196784 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:09:18.196784 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:09:18.196784 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:09:18.196784 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:09:18.196784 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:09:18.196784 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:09:18.196784 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:09:18.196784 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:09:18.196784 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:09:18.198587 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index Aug 10 23:09:18.198587 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Aug 10 23:09:18.198587 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:09:18.198587 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:09:18.198587 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5a2dde9-a4a4-441d-8aaa-0af837894471 could not be found. Aug 10 23:09:18.198587 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:09:18.198587 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:09:18.198587 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:09:18.198587 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:09:18.198587 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:09:18.198587 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:09:18.198587 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:09:18.198587 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:09:18.198587 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5a2dde9-a4a4-441d-8aaa-0af837894471 could not be found. Aug 10 23:09:18.198587 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:09:18.200956 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-ee517401-c5b5-4d9f-9972-b6971a28aa9f tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] Returning 404 to user: Instance d5a2dde9-a4a4-441d-8aaa-0af837894471 could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:09:18.208200 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-ee517401-c5b5-4d9f-9972-b6971a28aa9f tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] 10.222.0.58 "GET /compute/v2.1/servers/d5a2dde9-a4a4-441d-8aaa-0af837894471/metadata" status: 404 len: 111 microversion: 2.1 time: 0.049012 Aug 10 23:09:18.208930 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1520/2959] 10.222.0.58 () {58 vars in 1263 bytes} [Wed Aug 10 23:09:18 2022] GET /compute/v2.1/servers/d5a2dde9-a4a4-441d-8aaa-0af837894471/metadata => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:09:18.214297 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-9442171e-92b8-4c0d-a9a5-f86743a35dde tempest-KeyPairsV22TestJSON-1733237097 tempest-KeyPairsV22TestJSON-1733237097-project] Calling method '.version_select at 0x7f847c544f70>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:09:18.240944 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-9442171e-92b8-4c0d-a9a5-f86743a35dde tempest-KeyPairsV22TestJSON-1733237097 tempest-KeyPairsV22TestJSON-1733237097-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2017985082" status: 204 len: 0 microversion: 2.2 time: 0.030513 Aug 10 23:09:18.249975 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1521/2960] 10.222.0.58 () {60 vars in 1261 bytes} [Wed Aug 10 23:09:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2017985082 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:09:18.249975 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-a35348bb-8dd9-459b-9c05-58bf162fbed1 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:09:18.249975 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-a35348bb-8dd9-459b-9c05-58bf162fbed1 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] [instance: d09d04b1-bc37-4290-873e-ce2adae19eaf] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:09:18.255666 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a35348bb-8dd9-459b-9c05-58bf162fbed1 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:18.256248 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a35348bb-8dd9-459b-9c05-58bf162fbed1 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:18.256765 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a35348bb-8dd9-459b-9c05-58bf162fbed1 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:18.258021 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a35348bb-8dd9-459b-9c05-58bf162fbed1 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:18.258557 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a35348bb-8dd9-459b-9c05-58bf162fbed1 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:18.259230 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a35348bb-8dd9-459b-9c05-58bf162fbed1 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:18.549610 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-a35348bb-8dd9-459b-9c05-58bf162fbed1 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bbb4f184e4409d9eed51e0b98dfb29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708f8d4c4ed6432d85e0bf6a9bac7677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:09:18.559826 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-a35348bb-8dd9-459b-9c05-58bf162fbed1 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] 10.222.0.58 "GET /compute/v2.1/servers/d09d04b1-bc37-4290-873e-ce2adae19eaf" status: 200 len: 1523 microversion: 2.1 time: 0.316657 Aug 10 23:09:18.561200 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1522/2961] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:09:18 2022] GET /compute/v2.1/servers/d09d04b1-bc37-4290-873e-ce2adae19eaf => generated 1523 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:09:18.567092 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-90c42c27-d557-41d2-945e-e6f5d9782aa9 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:09:18.568616 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-90c42c27-d557-41d2-945e-e6f5d9782aa9 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] [instance: 325d9b10-716d-4961-91d1-70962403fef4] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:09:18.579484 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-90c42c27-d557-41d2-945e-e6f5d9782aa9 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:18.580328 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-90c42c27-d557-41d2-945e-e6f5d9782aa9 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:18.581081 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-90c42c27-d557-41d2-945e-e6f5d9782aa9 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:18.582106 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-90c42c27-d557-41d2-945e-e6f5d9782aa9 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:18.582859 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-90c42c27-d557-41d2-945e-e6f5d9782aa9 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:18.584310 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-90c42c27-d557-41d2-945e-e6f5d9782aa9 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:18.812749 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-90c42c27-d557-41d2-945e-e6f5d9782aa9 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84e70c3ea5347e79ba5aee661b15ce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ab3ad5c0ef448aaa1282112bf20d83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:09:18.824868 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-90c42c27-d557-41d2-945e-e6f5d9782aa9 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] 10.222.0.58 "GET /compute/v2.1/servers/325d9b10-716d-4961-91d1-70962403fef4" status: 200 len: 1509 microversion: 2.1 time: 0.262227 Aug 10 23:09:18.826203 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1523/2962] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:09:18 2022] GET /compute/v2.1/servers/325d9b10-716d-4961-91d1-70962403fef4 => generated 1509 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:09:18.831147 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-929cf926-2c2a-4618-868b-01c9c05f115c tempest-KeyPairsV22TestJSON-1733237097 tempest-KeyPairsV22TestJSON-1733237097-project] Action: 'create', calling method: .version_select at 0x7f847c55f550>, body: {"keypair": {"name": "tempest-keypair-1615393541", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPqBKwRKLQ+NKF+rLosAr8mHopMumAu7vnt6BNGYkrVw5rR3DIs/WUJt0FliSbEz2jjMtF064OGXtvDYfDDZkz/Z1KXSx8NHM+OhoUtS7WeYaNSWLaEXPqN9BKG/vbZAWw=="}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:09:18.849254 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-929cf926-2c2a-4618-868b-01c9c05f115c tempest-KeyPairsV22TestJSON-1733237097 tempest-KeyPairsV22TestJSON-1733237097-project] Getting quotas for project 2d273ce09fa34616b5a9b4f5edea6f13. Resources: {'key_pairs'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:09:18.855709 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-929cf926-2c2a-4618-868b-01c9c05f115c tempest-KeyPairsV22TestJSON-1733237097 tempest-KeyPairsV22TestJSON-1733237097-project] Getting quotas for user a9b04960b669465983ee87a114e09c5d and project 2d273ce09fa34616b5a9b4f5edea6f13. Resources: {'key_pairs'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:09:18.887084 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-929cf926-2c2a-4618-868b-01c9c05f115c tempest-KeyPairsV22TestJSON-1733237097 tempest-KeyPairsV22TestJSON-1733237097-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.059555 Aug 10 23:09:18.889211 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1524/2963] 10.222.0.58 () {62 vars in 1199 bytes} [Wed Aug 10 23:09:18 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 62 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 10 23:09:18.899784 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-f55802d2-b567-47aa-8daa-19a1ec18bd5d tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-2139456739", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "0f74d905-71e6-4aaa-9b67-11dfa71800b3"}]}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:09:18.968323 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.network.neutron [None req-f55802d2-b567-47aa-8daa-19a1ec18bd5d tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] validate_networks() for [('0f74d905-71e6-4aaa-9b67-11dfa71800b3', None, None, None, None, None)] {{(pid=122633) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 23:09:19.127316 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-8a4c566a-b35a-4fb3-9892-509258cd7b2f tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] 10.222.0.58 "DELETE /compute/v2.1/os-floating-ips/6454d361-0912-4d45-8e1a-773074cbb379" status: 202 len: 0 microversion: 2.1 time: 1.081835 Aug 10 23:09:19.131841 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1440/2964] 10.222.0.58 () {58 vars in 1263 bytes} [Wed Aug 10 23:09:18 2022] DELETE /compute/v2.1/os-floating-ips/6454d361-0912-4d45-8e1a-773074cbb379 => generated 0 bytes in 1083 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:09:19.135792 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-1697cae7-7d1b-41f0-ae24-90267ba9e49e tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1869780138", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "dca78bd6-e5ed-4d53-860b-07b9da7ab161"}]}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:09:19.140517 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-1697cae7-7d1b-41f0-ae24-90267ba9e49e tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] Request method failure captured: Aug 10 23:09:19.140517 n-d-850468-14 devstack@n-api.service[122632]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 10 23:09:19.140517 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:09:19.140517 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:09:19.140517 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:09:19.140517 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 499 Aug 10 23:09:19.140517 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:09:19.140517 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:09:19.140517 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:09:19.140517 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:09:19.140517 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9Dp-a7pZDXsTpf_JTfgkxwnAaESKCIDrR-PKNvSl4WdjMRZc7Q5fZMNMGxwgl3FE-oEkYYpW_CzsON1kv9C7WGJ_kqrpdRzZCsNREfFaZCNdwGSHaOszgZwYcFIIH2XFUlYjLM4TeKVATI4II8ubMmjcsdXbFkULYtMtD1ucA07mDjI Aug 10 23:09:19.140517 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:09:19.140517 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:09:19.140517 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:09:19.140517 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:09:19.140517 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:09:19.140517 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:09:19.140517 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 7ad554e982ff483098acf8a3b58e3842 Aug 10 23:09:19.140517 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-384625613 Aug 10 23:09:19.140517 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:09:19.140517 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:09:19.141859 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7ad554e982ff483098acf8a3b58e3842"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7ad554e982ff483098acf8a3b58e3842"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7ad554e982ff483098acf8a3b58e3842"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7ad554e982ff483098acf8a3b58e3842", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:09:19.141859 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-384625613 Aug 10 23:09:19.141859 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 7ad554e982ff483098acf8a3b58e3842 Aug 10 23:09:19.141859 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-384625613 Aug 10 23:09:19.141859 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-ServerMetadataNegativeTestJSON-384625613-project Aug 10 23:09:19.141859 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:09:19.141859 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:09:19.141859 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: 7caa911d519e4711bf9a251b04ebe8dd Aug 10 23:09:19.141859 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-384625613-project Aug 10 23:09:19.141859 n-d-850468-14 devstack@n-api.service[122632]: Aug 10 23:09:19.142479 n-d-850468-14 devstack@n-api.service[122632]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1869780138", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "dca78bd6-e5ed-4d53-860b-07b9da7ab161"}]}} Aug 10 23:09:19.142479 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:09:19.142479 n-d-850468-14 devstack@n-api.service[122632]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 10 23:09:19.142479 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1869780138', 'imageRef': '78ad8905-f66f-4733-8be9-2b260f1fabed', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'dca78bd6-e5ed-4d53-860b-07b9da7ab161'}]}}} Aug 10 23:09:19.142479 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:09:19.142479 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:09:19.142950 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 10 23:09:19.142950 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 10 23:09:19.142950 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 10 23:09:19.142950 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise error Aug 10 23:09:19.142950 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 10 23:09:19.142950 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:09:19.142950 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 10 23:09:19.142950 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 10 23:09:19.142950 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 10 23:09:19.142950 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 10 23:09:19.142950 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 10 23:09:19.142950 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:09:19.142950 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 10 23:09:19.142950 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Aug 10 23:09:19.142950 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:09:19.142950 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:09:19.142950 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:09:19.144126 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:09:19.144126 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:09:19.144126 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:09:19.144126 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:09:19.144126 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:09:19.144126 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:09:19.144126 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:09:19.144126 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 23:09:19.144126 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 23:09:19.144126 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 10 23:09:19.144126 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 10 23:09:19.144126 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 10 23:09:19.144126 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 10 23:09:19.144126 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 10 23:09:19.144126 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 10 23:09:19.145199 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 10 23:09:19.145199 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:09:19.145199 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:09:19.145199 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:09:19.145199 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:09:19.145199 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:09:19.145199 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:09:19.145199 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 10 23:09:19.145199 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 10 23:09:19.145901 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 10 23:09:19.145901 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:09:19.145901 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-1697cae7-7d1b-41f0-ae24-90267ba9e49e tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:09:19.146200 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-1697cae7-7d1b-41f0-ae24-90267ba9e49e tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.012884 Aug 10 23:09:19.152140 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1441/2965] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 23:09:19 2022] POST /compute/v2.1/servers => generated 687 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 10 23:09:19.158594 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-03b6be17-0ebe-488b-9091-b209bb78cfab tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-619434592"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:09:19.160910 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-03b6be17-0ebe-488b-9091-b209bb78cfab tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] [instance: d09d04b1-bc37-4290-873e-ce2adae19eaf] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:09:19.168637 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-03b6be17-0ebe-488b-9091-b209bb78cfab tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:19.169402 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-03b6be17-0ebe-488b-9091-b209bb78cfab tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:19.170156 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-03b6be17-0ebe-488b-9091-b209bb78cfab tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:19.171082 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-03b6be17-0ebe-488b-9091-b209bb78cfab tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:19.171700 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-03b6be17-0ebe-488b-9091-b209bb78cfab tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:19.172308 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-03b6be17-0ebe-488b-9091-b209bb78cfab tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:19.413655 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-03b6be17-0ebe-488b-9091-b209bb78cfab tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] 10.222.0.58 "POST /compute/v2.1/servers/d09d04b1-bc37-4290-873e-ce2adae19eaf/action" status: 202 len: 0 microversion: 2.1 time: 0.259836 Aug 10 23:09:19.419597 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1442/2966] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:09:19 2022] POST /compute/v2.1/servers/d09d04b1-bc37-4290-873e-ce2adae19eaf/action => generated 0 bytes in 267 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 10 23:09:19.425148 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-b934f401-f051-45e7-8c8f-338fdf66bab4 tempest-KeyPairsV22TestJSON-1733237097 tempest-KeyPairsV22TestJSON-1733237097-project] Calling method '.version_select at 0x7f847d1b3820>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:09:19.447558 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-b934f401-f051-45e7-8c8f-338fdf66bab4 tempest-KeyPairsV22TestJSON-1733237097 tempest-KeyPairsV22TestJSON-1733237097-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1615393541" status: 204 len: 0 microversion: 2.2 time: 0.026519 Aug 10 23:09:19.450960 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1443/2967] 10.222.0.58 () {60 vars in 1261 bytes} [Wed Aug 10 23:09:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1615393541 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:09:19.457844 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-b1259f45-ff21-491e-91d2-878b9b17ea88 tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.2.231"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:09:19.656594 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-b1259f45-ff21-491e-91d2-878b9b17ea88 tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] [instance: 61e7db28-1e60-444a-b6c0-dd65ef3f5a6b] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:09:19.665656 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=3,nova_api:INSERT=2,nova_api:UPDATE=2 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:09:19.671309 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b1259f45-ff21-491e-91d2-878b9b17ea88 tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:19.671810 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b1259f45-ff21-491e-91d2-878b9b17ea88 tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:19.672476 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b1259f45-ff21-491e-91d2-878b9b17ea88 tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:19.673203 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b1259f45-ff21-491e-91d2-878b9b17ea88 tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:19.673664 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b1259f45-ff21-491e-91d2-878b9b17ea88 tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:19.674096 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b1259f45-ff21-491e-91d2-878b9b17ea88 tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:19.908664 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b1259f45-ff21-491e-91d2-878b9b17ea88 tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Acquiring lock "refresh_cache-61e7db28-1e60-444a-b6c0-dd65ef3f5a6b" {{(pid=122632) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 10 23:09:19.909074 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b1259f45-ff21-491e-91d2-878b9b17ea88 tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Acquired lock "refresh_cache-61e7db28-1e60-444a-b6c0-dd65ef3f5a6b" {{(pid=122632) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 10 23:09:19.914938 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-f55802d2-b567-47aa-8daa-19a1ec18bd5d tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Flavor limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:09:19.915944 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-f55802d2-b567-47aa-8daa-19a1ec18bd5d tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Image limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:09:19.916438 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-f55802d2-b567-47aa-8daa-19a1ec18bd5d tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Flavor pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:09:19.917023 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-f55802d2-b567-47aa-8daa-19a1ec18bd5d tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Image pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:09:19.918025 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-f55802d2-b567-47aa-8daa-19a1ec18bd5d tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:09:19.935953 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f55802d2-b567-47aa-8daa-19a1ec18bd5d tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:19.937265 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f55802d2-b567-47aa-8daa-19a1ec18bd5d tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:19.938585 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f55802d2-b567-47aa-8daa-19a1ec18bd5d tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:19.941188 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f55802d2-b567-47aa-8daa-19a1ec18bd5d tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:19.941965 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f55802d2-b567-47aa-8daa-19a1ec18bd5d tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:19.942564 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f55802d2-b567-47aa-8daa-19a1ec18bd5d tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:19.969669 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-f55802d2-b567-47aa-8daa-19a1ec18bd5d tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Getting quotas for project a7f70700e035444c9f2c9fa491c5c41a. Resources: {'instances', 'cores', 'ram'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:09:19.977013 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-f55802d2-b567-47aa-8daa-19a1ec18bd5d tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Getting quotas for user 1ca7d06f2acb44558d405a3b35a59550 and project a7f70700e035444c9f2c9fa491c5c41a. Resources: {'instances', 'cores', 'ram'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:09:19.998697 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-f55802d2-b567-47aa-8daa-19a1ec18bd5d tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Going to run 2 instances... {{(pid=122633) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 23:09:20.001316 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-f55802d2-b567-47aa-8daa-19a1ec18bd5d tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] [instance: 06ec3e8e-9e4f-4a9b-8fa7-679d71c3dbf0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78ad8905-f66f-4733-8be9-2b260f1fabed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122633) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 23:09:20.041875 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-f55802d2-b567-47aa-8daa-19a1ec18bd5d tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] [instance: 6bdca10c-38e0-4605-9a5d-002c6333b81f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78ad8905-f66f-4733-8be9-2b260f1fabed',instance=,instance_uuid=06ec3e8e-9e4f-4a9b-8fa7-679d71c3dbf0,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122633) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 23:09:20.110385 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-f55802d2-b567-47aa-8daa-19a1ec18bd5d tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.219178 Aug 10 23:09:20.113186 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1525/2968] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 23:09:18 2022] POST /compute/v2.1/servers => generated 32 bytes in 1223 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Aug 10 23:09:20.120356 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-37a6c10d-dfa4-4fdd-ad65-0eb2e07b5655 tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1540868869", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "dca78bd6-e5ed-4d53-860b-07b9da7ab161"}]}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:09:20.125670 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-37a6c10d-dfa4-4fdd-ad65-0eb2e07b5655 tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] Request method failure captured: Aug 10 23:09:20.125670 n-d-850468-14 devstack@n-api.service[122633]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 10 23:09:20.125670 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:09:20.125670 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:09:20.125670 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:09:20.125670 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 500 Aug 10 23:09:20.125670 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:09:20.125670 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:09:20.125670 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:09:20.125670 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:09:20.125670 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9Dp-a7pZDXsTpf_JTfgkxwnAaESKCIDrR-PKNvSl4WdjMRZc7Q5fZMNMGxwgl3FE-oEkYYpW_CzsON1kv9C7WGJ_kqrpdRzZCsNREfFaZCNdwGSHaOszgZwYcFIIH2XFUlYjLM4TeKVATI4II8ubMmjcsdXbFkULYtMtD1ucA07mDjI Aug 10 23:09:20.125670 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:09:20.125670 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:09:20.125670 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:09:20.125670 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:09:20.125670 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:09:20.125670 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:09:20.125670 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 7ad554e982ff483098acf8a3b58e3842 Aug 10 23:09:20.125670 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-384625613 Aug 10 23:09:20.125670 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:09:20.125670 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:09:20.127087 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7ad554e982ff483098acf8a3b58e3842"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7ad554e982ff483098acf8a3b58e3842"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7ad554e982ff483098acf8a3b58e3842"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7ad554e982ff483098acf8a3b58e3842", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:09:20.127087 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-384625613 Aug 10 23:09:20.127087 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 7ad554e982ff483098acf8a3b58e3842 Aug 10 23:09:20.127087 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-384625613 Aug 10 23:09:20.127087 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-ServerMetadataNegativeTestJSON-384625613-project Aug 10 23:09:20.127087 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:09:20.127087 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:09:20.127087 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 7caa911d519e4711bf9a251b04ebe8dd Aug 10 23:09:20.127087 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-384625613-project Aug 10 23:09:20.127087 n-d-850468-14 devstack@n-api.service[122633]: Aug 10 23:09:20.129065 n-d-850468-14 devstack@n-api.service[122633]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1540868869", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "dca78bd6-e5ed-4d53-860b-07b9da7ab161"}]}} Aug 10 23:09:20.129065 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:09:20.129065 n-d-850468-14 devstack@n-api.service[122633]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 10 23:09:20.129065 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1540868869', 'imageRef': '78ad8905-f66f-4733-8be9-2b260f1fabed', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'dca78bd6-e5ed-4d53-860b-07b9da7ab161'}]}}} Aug 10 23:09:20.129065 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:09:20.129065 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:09:20.129510 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 10 23:09:20.129510 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 10 23:09:20.129510 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 10 23:09:20.129510 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise error Aug 10 23:09:20.129510 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 10 23:09:20.129510 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:09:20.129510 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 10 23:09:20.129510 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 10 23:09:20.129510 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 10 23:09:20.129510 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 10 23:09:20.129510 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 10 23:09:20.129510 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:09:20.129510 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 10 23:09:20.129510 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Aug 10 23:09:20.129510 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:09:20.129510 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:09:20.129510 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:09:20.131200 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:09:20.131200 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:09:20.131200 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:09:20.131200 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:09:20.131200 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:09:20.131200 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:09:20.131200 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:09:20.131200 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 23:09:20.131200 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 23:09:20.131200 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 10 23:09:20.131200 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 10 23:09:20.131200 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 10 23:09:20.131200 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 10 23:09:20.131200 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 10 23:09:20.131200 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 10 23:09:20.132239 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 10 23:09:20.132239 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:09:20.132239 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:09:20.132239 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:09:20.132239 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:09:20.132239 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:09:20.132239 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:09:20.132239 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 10 23:09:20.132239 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 10 23:09:20.132822 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 10 23:09:20.132822 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:09:20.144115 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-37a6c10d-dfa4-4fdd-ad65-0eb2e07b5655 tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:09:20.145520 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-37a6c10d-dfa4-4fdd-ad65-0eb2e07b5655 tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.029433 Aug 10 23:09:20.147051 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1526/2969] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 23:09:20 2022] POST /compute/v2.1/servers => generated 689 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 10 23:09:20.162544 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-6d0d93cf-311b-4d69-a4f7-f80e42c64bc2 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Calling method '.version_select at 0x7f847cf509d0>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:09:20.473528 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-6d0d93cf-311b-4d69-a4f7-f80e42c64bc2 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] 10.222.0.58 "DELETE /compute/v2.1/images/2f9233ae-3836-4ac9-a610-f8c1f48d71f0" status: 204 len: 0 microversion: 2.1 time: 0.325137 Aug 10 23:09:20.474428 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1527/2970] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:09:20 2022] DELETE /compute/v2.1/images/2f9233ae-3836-4ac9-a610-f8c1f48d71f0 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:09:20.480538 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-a2cb3fdb-e1cf-4ec2-8dd7-95dfc4b3956c tempest-KeyPairsV22TestJSON-1733237097 tempest-KeyPairsV22TestJSON-1733237097-project] Action: 'create', calling method: .version_select at 0x7f847cf50f70>, body: {"keypair": {"name": "tempest-keypair-976850437", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:09:20.556939 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-a2cb3fdb-e1cf-4ec2-8dd7-95dfc4b3956c tempest-KeyPairsV22TestJSON-1733237097 tempest-KeyPairsV22TestJSON-1733237097-project] Getting quotas for project 2d273ce09fa34616b5a9b4f5edea6f13. Resources: {'key_pairs'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:09:20.574098 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-a2cb3fdb-e1cf-4ec2-8dd7-95dfc4b3956c tempest-KeyPairsV22TestJSON-1733237097 tempest-KeyPairsV22TestJSON-1733237097-project] Getting quotas for user a9b04960b669465983ee87a114e09c5d and project 2d273ce09fa34616b5a9b4f5edea6f13. Resources: {'key_pairs'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:09:20.610345 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-a2cb3fdb-e1cf-4ec2-8dd7-95dfc4b3956c tempest-KeyPairsV22TestJSON-1733237097 tempest-KeyPairsV22TestJSON-1733237097-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 201 len: 588 microversion: 2.2 time: 0.134498 Aug 10 23:09:20.611494 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1528/2971] 10.222.0.58 () {62 vars in 1199 bytes} [Wed Aug 10 23:09:20 2022] POST /compute/v2.1/os-keypairs => generated 588 bytes in 136 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 10 23:09:20.618607 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-a9e5aa77-86eb-4894-b436-9bf3ae233c78 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:09:20.619420 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-a9e5aa77-86eb-4894-b436-9bf3ae233c78 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] [instance: 325d9b10-716d-4961-91d1-70962403fef4] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:09:20.643200 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_api:SELECT=88,nova_api:DELETE=3,nova_api:UPDATE=1,nova_api:INSERT=8 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:09:20.647793 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a9e5aa77-86eb-4894-b436-9bf3ae233c78 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:20.648712 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a9e5aa77-86eb-4894-b436-9bf3ae233c78 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:20.649355 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a9e5aa77-86eb-4894-b436-9bf3ae233c78 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:20.651131 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a9e5aa77-86eb-4894-b436-9bf3ae233c78 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:20.651755 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a9e5aa77-86eb-4894-b436-9bf3ae233c78 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:20.652375 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a9e5aa77-86eb-4894-b436-9bf3ae233c78 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:20.977088 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-a9e5aa77-86eb-4894-b436-9bf3ae233c78 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84e70c3ea5347e79ba5aee661b15ce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ab3ad5c0ef448aaa1282112bf20d83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:09:20.990758 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-a9e5aa77-86eb-4894-b436-9bf3ae233c78 tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] 10.222.0.58 "GET /compute/v2.1/servers/325d9b10-716d-4961-91d1-70962403fef4" status: 200 len: 1509 microversion: 2.1 time: 0.375533 Aug 10 23:09:20.992979 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1529/2972] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:09:20 2022] GET /compute/v2.1/servers/325d9b10-716d-4961-91d1-70962403fef4 => generated 1509 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:09:21.001752 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-5663a470-94df-4c43-888d-5a07e66ea37c tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:09:21.015858 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-5663a470-94df-4c43-888d-5a07e66ea37c tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1ca7d06f2acb44558d405a3b35a59550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7f70700e035444c9f2c9fa491c5c41a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:09:21.019979 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-5663a470-94df-4c43-888d-5a07e66ea37c tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Searching by: {'deleted': False, 'project_id': 'a7f70700e035444c9f2c9fa491c5c41a'} {{(pid=122633) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 10 23:09:21.058841 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5663a470-94df-4c43-888d-5a07e66ea37c tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:21.059728 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5663a470-94df-4c43-888d-5a07e66ea37c tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:21.060310 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5663a470-94df-4c43-888d-5a07e66ea37c tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:21.061237 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5663a470-94df-4c43-888d-5a07e66ea37c tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:21.061805 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5663a470-94df-4c43-888d-5a07e66ea37c tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:21.062345 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5663a470-94df-4c43-888d-5a07e66ea37c tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:21.132809 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.multi_cell_list [None req-5663a470-94df-4c43-888d-5a07e66ea37c tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Listed batch of 2 results from cell out of 998 limit. Returned 2 total so far. {{(pid=122633) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 10 23:09:21.191225 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-5663a470-94df-4c43-888d-5a07e66ea37c tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] 10.222.0.58 "GET /compute/v2.1/servers" status: 200 len: 1333 microversion: 2.1 time: 0.196300 Aug 10 23:09:21.193408 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1530/2973] 10.222.0.58 () {58 vars in 1125 bytes} [Wed Aug 10 23:09:20 2022] GET /compute/v2.1/servers => generated 1333 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:09:21.206012 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-8e985b49-bcd6-497d-9a64-ced4e5598ecc tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1280914311", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "dca78bd6-e5ed-4d53-860b-07b9da7ab161"}]}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:09:21.213541 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-8e985b49-bcd6-497d-9a64-ced4e5598ecc tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] Request method failure captured: Aug 10 23:09:21.213541 n-d-850468-14 devstack@n-api.service[122633]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 10 23:09:21.213541 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:09:21.213541 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:09:21.213541 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:09:21.213541 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 754 Aug 10 23:09:21.213541 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:09:21.213541 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:09:21.213541 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:09:21.213541 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:09:21.213541 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9Dp-a7pZDXsTpf_JTfgkxwnAaESKCIDrR-PKNvSl4WdjMRZc7Q5fZMNMGxwgl3FE-oEkYYpW_CzsON1kv9C7WGJ_kqrpdRzZCsNREfFaZCNdwGSHaOszgZwYcFIIH2XFUlYjLM4TeKVATI4II8ubMmjcsdXbFkULYtMtD1ucA07mDjI Aug 10 23:09:21.213541 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:09:21.213541 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:09:21.213541 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:09:21.213541 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:09:21.213541 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:09:21.213541 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:09:21.213541 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 7ad554e982ff483098acf8a3b58e3842 Aug 10 23:09:21.213541 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-384625613 Aug 10 23:09:21.213541 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:09:21.213541 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:09:21.215026 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7ad554e982ff483098acf8a3b58e3842"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7ad554e982ff483098acf8a3b58e3842"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7ad554e982ff483098acf8a3b58e3842"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7ad554e982ff483098acf8a3b58e3842", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:09:21.215026 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-384625613 Aug 10 23:09:21.215026 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 7ad554e982ff483098acf8a3b58e3842 Aug 10 23:09:21.215026 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-384625613 Aug 10 23:09:21.215026 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-ServerMetadataNegativeTestJSON-384625613-project Aug 10 23:09:21.215026 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:09:21.215026 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:09:21.215026 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 7caa911d519e4711bf9a251b04ebe8dd Aug 10 23:09:21.215026 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-384625613-project Aug 10 23:09:21.215026 n-d-850468-14 devstack@n-api.service[122633]: Aug 10 23:09:21.215648 n-d-850468-14 devstack@n-api.service[122633]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1280914311", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "dca78bd6-e5ed-4d53-860b-07b9da7ab161"}]}} Aug 10 23:09:21.215648 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:09:21.215648 n-d-850468-14 devstack@n-api.service[122633]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 10 23:09:21.215867 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1280914311', 'imageRef': '78ad8905-f66f-4733-8be9-2b260f1fabed', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'dca78bd6-e5ed-4d53-860b-07b9da7ab161'}]}}} Aug 10 23:09:21.215867 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:09:21.215867 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:09:21.215867 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 10 23:09:21.215867 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 10 23:09:21.215867 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 10 23:09:21.215867 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise error Aug 10 23:09:21.215867 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 10 23:09:21.216411 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:09:21.216411 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 10 23:09:21.216411 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 10 23:09:21.216411 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 10 23:09:21.216411 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 10 23:09:21.216411 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 10 23:09:21.216411 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:09:21.216411 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 10 23:09:21.216411 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Aug 10 23:09:21.216411 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:09:21.216411 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:09:21.216411 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:09:21.216411 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:09:21.216411 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:09:21.216411 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:09:21.216411 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:09:21.216411 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:09:21.217438 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:09:21.217438 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:09:21.217438 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 23:09:21.217438 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 23:09:21.217438 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 10 23:09:21.217438 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 10 23:09:21.217438 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 10 23:09:21.217438 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 10 23:09:21.217438 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 10 23:09:21.217438 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 10 23:09:21.218041 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 10 23:09:21.218041 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:09:21.218041 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:09:21.218041 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:09:21.218041 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:09:21.218041 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:09:21.218041 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:09:21.218041 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 10 23:09:21.218041 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 10 23:09:21.220053 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 10 23:09:21.220053 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:09:21.221964 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-8e985b49-bcd6-497d-9a64-ced4e5598ecc tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:09:21.223607 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-8e985b49-bcd6-497d-9a64-ced4e5598ecc tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.027596 Aug 10 23:09:21.233293 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1531/2974] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 23:09:21 2022] POST /compute/v2.1/servers => generated 1197 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Aug 10 23:09:21.277412 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-495b18be-adc3-49d7-aaf9-01d4d1dd539b tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Calling method '.version_select at 0x7f847c544ca0>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:09:21.323757 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-495b18be-adc3-49d7-aaf9-01d4d1dd539b tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] HTTP exception thrown: Image not found. Aug 10 23:09:21.327431 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-495b18be-adc3-49d7-aaf9-01d4d1dd539b tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Request method failure captured: Aug 10 23:09:21.327431 n-d-850468-14 devstack@n-api.service[122633]: request: GET /compute/v2.1/images/2f9233ae-3836-4ac9-a610-f8c1f48d71f0 HTTP/1.1 Aug 10 23:09:21.327431 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:09:21.327431 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:09:21.327431 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:09:21.327431 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:09:21.327431 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:09:21.327431 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:09:21.327431 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:09:21.327431 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:09:21.327431 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9Do81XwGOyJYZzjDqBUm67v_Q0362_4xQUvU3HvIWmFkKXGTToH86-ip4fxXuu0oxmkucX-Et277q0Z5R4ChTe5MWC8zJ89hWAklZmH6m-N_CAseQK0eUiUfLbiJpjdB2S78hj0EntCCqH4mBVhce2-q9auCyId7qlhsdrU7MIxxCSQ Aug 10 23:09:21.327431 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:09:21.327431 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:09:21.327431 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:09:21.327431 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:09:21.327431 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:09:21.327431 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:09:21.327431 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 708f8d4c4ed6432d85e0bf6a9bac7677 Aug 10 23:09:21.327431 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2080454436 Aug 10 23:09:21.327431 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:09:21.327431 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:09:21.329062 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/708f8d4c4ed6432d85e0bf6a9bac7677"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/708f8d4c4ed6432d85e0bf6a9bac7677"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/708f8d4c4ed6432d85e0bf6a9bac7677"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_708f8d4c4ed6432d85e0bf6a9bac7677", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:09:21.329062 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2080454436 Aug 10 23:09:21.329062 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 708f8d4c4ed6432d85e0bf6a9bac7677 Aug 10 23:09:21.329062 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2080454436 Aug 10 23:09:21.329062 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-ImagesOneServerNegativeTestJSON-2080454436-project Aug 10 23:09:21.329062 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:09:21.329062 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:09:21.329062 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 55bbb4f184e4409d9eed51e0b98dfb29 Aug 10 23:09:21.329062 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2080454436-project Aug 10 23:09:21.329062 n-d-850468-14 devstack@n-api.service[122633]: method: Aug 10 23:09:21.329062 n-d-850468-14 devstack@n-api.service[122633]: exception: Image not found. Aug 10 23:09:21.329062 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': '2f9233ae-3836-4ac9-a610-f8c1f48d71f0'} Aug 10 23:09:21.329062 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:09:21.330065 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:09:21.330065 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 10 23:09:21.330065 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 10 23:09:21.330065 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 10 23:09:21.330065 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 10 23:09:21.330065 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 10 23:09:21.330065 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 10 23:09:21.330065 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 10 23:09:21.330065 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 10 23:09:21.330065 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 10 23:09:21.330065 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 10 23:09:21.330065 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 10 23:09:21.330065 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 10 23:09:21.330065 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 10 23:09:21.330065 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 10 23:09:21.330065 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 10 23:09:21.330065 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 10 23:09:21.330065 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 2f9233ae-3836-4ac9-a610-f8c1f48d71f0 Aug 10 23:09:21.331326 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:09:21.331326 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:09:21.331326 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:09:21.331326 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:09:21.331326 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Aug 10 23:09:21.331326 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Aug 10 23:09:21.331326 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 10 23:09:21.331326 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 10 23:09:21.331326 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 10 23:09:21.331326 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 10 23:09:21.331326 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 10 23:09:21.331326 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 10 23:09:21.331326 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 10 23:09:21.331326 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 10 23:09:21.331326 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 10 23:09:21.331326 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 10 23:09:21.331326 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 10 23:09:21.331326 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 10 23:09:21.331326 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 10 23:09:21.331326 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 10 23:09:21.332617 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 10 23:09:21.332617 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 10 23:09:21.332617 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 10 23:09:21.332617 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 10 23:09:21.332617 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 10 23:09:21.332617 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 10 23:09:21.332617 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 10 23:09:21.332617 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 10 23:09:21.332617 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 2f9233ae-3836-4ac9-a610-f8c1f48d71f0 could not be found. Aug 10 23:09:21.332617 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:09:21.332617 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:09:21.332617 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:09:21.332617 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:09:21.332617 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:09:21.332617 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:09:21.332617 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:09:21.332617 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:09:21.332617 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 23:09:21.332617 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 23:09:21.333799 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:09:21.333799 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:09:21.333799 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Aug 10 23:09:21.333799 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 10 23:09:21.333799 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 10 23:09:21.333799 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:09:21.333799 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:09:21.333799 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:09:21.333799 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:09:21.333799 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:09:21.333799 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:09:21.333799 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:09:21.333799 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:09:21.333799 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 10 23:09:21.333799 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:09:21.338309 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-495b18be-adc3-49d7-aaf9-01d4d1dd539b tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Returning 404 to user: Image not found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:09:21.338309 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-495b18be-adc3-49d7-aaf9-01d4d1dd539b tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] 10.222.0.58 "GET /compute/v2.1/images/2f9233ae-3836-4ac9-a610-f8c1f48d71f0" status: 404 len: 62 microversion: 2.1 time: 0.085264 Aug 10 23:09:21.338309 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1532/2975] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 10 23:09:21 2022] GET /compute/v2.1/images/2f9233ae-3836-4ac9-a610-f8c1f48d71f0 => generated 62 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 10 23:09:21.353913 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-02d91b9b-a22c-4240-b5c4-4365ee95819b tempest-KeyPairsV22TestJSON-1733237097 tempest-KeyPairsV22TestJSON-1733237097-project] Calling method '.version_select at 0x7f847cf91820>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:09:21.395332 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-02d91b9b-a22c-4240-b5c4-4365ee95819b tempest-KeyPairsV22TestJSON-1733237097 tempest-KeyPairsV22TestJSON-1733237097-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-976850437" status: 204 len: 0 microversion: 2.2 time: 0.056715 Aug 10 23:09:21.398333 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1533/2976] 10.222.0.58 () {60 vars in 1258 bytes} [Wed Aug 10 23:09:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-976850437 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:09:21.419614 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-65a2a94a-784f-4f09-92df-42d92573ae97 req-562bfb87-b5e0-4b06-ae79-deebe038cb31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d884a052-b397-41de-93d5-577428e292c1", "name": "network-vif-deleted", "tag": "bcc20647-ddf4-4615-ad16-a1db09bc1caa"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:09:21.452598 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-65a2a94a-784f-4f09-92df-42d92573ae97 req-562bfb87-b5e0-4b06-ae79-deebe038cb31 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:21.455965 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-65a2a94a-784f-4f09-92df-42d92573ae97 req-562bfb87-b5e0-4b06-ae79-deebe038cb31 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:21.457804 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-65a2a94a-784f-4f09-92df-42d92573ae97 req-562bfb87-b5e0-4b06-ae79-deebe038cb31 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:21.476053 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-65a2a94a-784f-4f09-92df-42d92573ae97 req-562bfb87-b5e0-4b06-ae79-deebe038cb31 service nova] Creating event network-vif-deleted:bcc20647-ddf4-4615-ad16-a1db09bc1caa for instance d884a052-b397-41de-93d5-577428e292c1 on n-h2-850468-14 Aug 10 23:09:21.484842 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-65a2a94a-784f-4f09-92df-42d92573ae97 req-562bfb87-b5e0-4b06-ae79-deebe038cb31 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083647 Aug 10 23:09:21.487049 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1534/2977] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:09:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:09:21.493962 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-935fc546-04da-4116-9f72-37930d46b22f tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:09:21.495047 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-935fc546-04da-4116-9f72-37930d46b22f tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] [instance: 6bdca10c-38e0-4605-9a5d-002c6333b81f] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:09:21.598640 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-935fc546-04da-4116-9f72-37930d46b22f tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca7d06f2acb44558d405a3b35a59550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7f70700e035444c9f2c9fa491c5c41a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:09:21.620961 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-935fc546-04da-4116-9f72-37930d46b22f tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] 10.222.0.58 "GET /compute/v2.1/servers/6bdca10c-38e0-4605-9a5d-002c6333b81f" status: 200 len: 1218 microversion: 2.1 time: 0.132261 Aug 10 23:09:21.623820 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1535/2978] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:09:21 2022] GET /compute/v2.1/servers/6bdca10c-38e0-4605-9a5d-002c6333b81f => generated 1218 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:09:21.633532 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-b177ce1c-30ae-4515-bc74-e95f4d2d9c42 tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-2058982540", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "dca78bd6-e5ed-4d53-860b-07b9da7ab161"}]}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:09:21.640295 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-b177ce1c-30ae-4515-bc74-e95f4d2d9c42 tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] Request method failure captured: Aug 10 23:09:21.640295 n-d-850468-14 devstack@n-api.service[122633]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 10 23:09:21.640295 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:09:21.640295 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:09:21.640295 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:09:21.640295 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 1266 Aug 10 23:09:21.640295 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:09:21.640295 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:09:21.640295 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:09:21.640295 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:09:21.640295 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9Dp-a7pZDXsTpf_JTfgkxwnAaESKCIDrR-PKNvSl4WdjMRZc7Q5fZMNMGxwgl3FE-oEkYYpW_CzsON1kv9C7WGJ_kqrpdRzZCsNREfFaZCNdwGSHaOszgZwYcFIIH2XFUlYjLM4TeKVATI4II8ubMmjcsdXbFkULYtMtD1ucA07mDjI Aug 10 23:09:21.640295 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:09:21.640295 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:09:21.640295 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:09:21.640295 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:09:21.640295 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:09:21.640295 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:09:21.640295 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 7ad554e982ff483098acf8a3b58e3842 Aug 10 23:09:21.640295 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-384625613 Aug 10 23:09:21.640295 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:09:21.640295 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:09:21.641991 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7ad554e982ff483098acf8a3b58e3842"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7ad554e982ff483098acf8a3b58e3842"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7ad554e982ff483098acf8a3b58e3842"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7ad554e982ff483098acf8a3b58e3842", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:09:21.641991 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-384625613 Aug 10 23:09:21.641991 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 7ad554e982ff483098acf8a3b58e3842 Aug 10 23:09:21.641991 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-384625613 Aug 10 23:09:21.641991 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-ServerMetadataNegativeTestJSON-384625613-project Aug 10 23:09:21.641991 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:09:21.641991 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:09:21.641991 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 7caa911d519e4711bf9a251b04ebe8dd Aug 10 23:09:21.641991 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-384625613-project Aug 10 23:09:21.641991 n-d-850468-14 devstack@n-api.service[122633]: Aug 10 23:09:21.642730 n-d-850468-14 devstack@n-api.service[122633]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-2058982540", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "dca78bd6-e5ed-4d53-860b-07b9da7ab161"}]}} Aug 10 23:09:21.642730 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:09:21.642953 n-d-850468-14 devstack@n-api.service[122633]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 10 23:09:21.642953 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-2058982540', 'imageRef': '78ad8905-f66f-4733-8be9-2b260f1fabed', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'dca78bd6-e5ed-4d53-860b-07b9da7ab161'}]}}} Aug 10 23:09:21.642953 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:09:21.642953 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:09:21.642953 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 10 23:09:21.642953 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 10 23:09:21.642953 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 10 23:09:21.642953 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise error Aug 10 23:09:21.642953 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 10 23:09:21.642953 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:09:21.642953 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 10 23:09:21.642953 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 10 23:09:21.642953 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 10 23:09:21.642953 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 10 23:09:21.642953 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 10 23:09:21.642953 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:09:21.642953 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 10 23:09:21.644242 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Aug 10 23:09:21.644242 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:09:21.644242 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:09:21.644242 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:09:21.644242 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:09:21.644242 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:09:21.644242 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:09:21.644242 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:09:21.644242 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:09:21.644242 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:09:21.644242 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:09:21.644242 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 23:09:21.644242 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 23:09:21.644242 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 10 23:09:21.644242 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 10 23:09:21.644242 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 10 23:09:21.644242 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 10 23:09:21.644242 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 10 23:09:21.644242 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 10 23:09:21.644242 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 10 23:09:21.644242 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:09:21.644242 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:09:21.644242 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:09:21.644242 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:09:21.644242 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:09:21.644242 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:09:21.644242 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 10 23:09:21.644242 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 10 23:09:21.646925 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 10 23:09:21.646925 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:09:21.653109 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-b177ce1c-30ae-4515-bc74-e95f4d2d9c42 tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:09:21.654720 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-b177ce1c-30ae-4515-bc74-e95f4d2d9c42 tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.029135 Aug 10 23:09:21.656556 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1536/2979] 10.222.0.58 () {60 vars in 1148 bytes} [Wed Aug 10 23:09:21 2022] POST /compute/v2.1/servers => generated 2221 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Aug 10 23:09:21.680286 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-ec4cfee4-2974-4797-80c9-b868f7ad2aa9 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:09:21.681436 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-ec4cfee4-2974-4797-80c9-b868f7ad2aa9 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] [instance: d09d04b1-bc37-4290-873e-ce2adae19eaf] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:09:21.699787 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ec4cfee4-2974-4797-80c9-b868f7ad2aa9 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:21.700391 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ec4cfee4-2974-4797-80c9-b868f7ad2aa9 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:21.702433 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ec4cfee4-2974-4797-80c9-b868f7ad2aa9 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:21.704686 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ec4cfee4-2974-4797-80c9-b868f7ad2aa9 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:21.705491 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ec4cfee4-2974-4797-80c9-b868f7ad2aa9 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:21.706257 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ec4cfee4-2974-4797-80c9-b868f7ad2aa9 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:21.976531 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-ec4cfee4-2974-4797-80c9-b868f7ad2aa9 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bbb4f184e4409d9eed51e0b98dfb29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708f8d4c4ed6432d85e0bf6a9bac7677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:09:21.995529 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-ec4cfee4-2974-4797-80c9-b868f7ad2aa9 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] 10.222.0.58 "GET /compute/v2.1/servers/d09d04b1-bc37-4290-873e-ce2adae19eaf" status: 200 len: 1541 microversion: 2.1 time: 0.337672 Aug 10 23:09:21.996305 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1537/2980] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:09:21 2022] GET /compute/v2.1/servers/d09d04b1-bc37-4290-873e-ce2adae19eaf => generated 1541 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:09:22.001561 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-2a8258cb-106d-473f-b213-90b8c4720d26 tempest-KeyPairsV22TestJSON-1733237097 tempest-KeyPairsV22TestJSON-1733237097-project] Action: 'create', calling method: .version_select at 0x7f847cf91940>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-836864573", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ/4RuOvCYyeJcjacOZbwvYHORIIMEk5Z1WnuBwS8iET8kx2VEWlvoSrPLsKRAqiehTgWzwp39eXUlAtWS5Y9s2rRK4+qnhvqEuSoTJCp4Ldx7GE9mAjVHqFuZRw5EfaMA=="}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:09:22.025911 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.network.neutron [None req-b1259f45-ff21-491e-91d2-878b9b17ea88 tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] [instance: 61e7db28-1e60-444a-b6c0-dd65ef3f5a6b] Building network info cache for instance {{(pid=122632) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 10 23:09:22.033160 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-2a8258cb-106d-473f-b213-90b8c4720d26 tempest-KeyPairsV22TestJSON-1733237097 tempest-KeyPairsV22TestJSON-1733237097-project] Getting quotas for project 2d273ce09fa34616b5a9b4f5edea6f13. Resources: {'key_pairs'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:09:22.050562 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-2a8258cb-106d-473f-b213-90b8c4720d26 tempest-KeyPairsV22TestJSON-1733237097 tempest-KeyPairsV22TestJSON-1733237097-project] Getting quotas for user a9b04960b669465983ee87a114e09c5d and project 2d273ce09fa34616b5a9b4f5edea6f13. Resources: {'key_pairs'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:09:22.092683 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-2a8258cb-106d-473f-b213-90b8c4720d26 tempest-KeyPairsV22TestJSON-1733237097 tempest-KeyPairsV22TestJSON-1733237097-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.094826 Aug 10 23:09:22.093475 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1538/2981] 10.222.0.58 () {62 vars in 1199 bytes} [Wed Aug 10 23:09:21 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 96 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 10 23:09:22.112247 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-ee4ca4cd-2854-4fda-902f-134f08f4b2af tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:09:22.113552 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-ee4ca4cd-2854-4fda-902f-134f08f4b2af tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] [instance: e6e47079-7572-4e03-82e2-217049e05a38] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:09:22.123291 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-ee4ca4cd-2854-4fda-902f-134f08f4b2af tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] HTTP exception thrown: Instance e6e47079-7572-4e03-82e2-217049e05a38 could not be found. Aug 10 23:09:22.125582 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-ee4ca4cd-2854-4fda-902f-134f08f4b2af tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] Request method failure captured: Aug 10 23:09:22.125582 n-d-850468-14 devstack@n-api.service[122633]: request: GET /compute/v2.1/servers/e6e47079-7572-4e03-82e2-217049e05a38/metadata/test2 HTTP/1.1 Aug 10 23:09:22.125582 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:09:22.125582 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:09:22.125582 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:09:22.125582 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:09:22.125582 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:09:22.125582 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:09:22.125582 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:09:22.125582 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:09:22.125582 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9Dp-a7pZDXsTpf_JTfgkxwnAaESKCIDrR-PKNvSl4WdjMRZc7Q5fZMNMGxwgl3FE-oEkYYpW_CzsON1kv9C7WGJ_kqrpdRzZCsNREfFaZCNdwGSHaOszgZwYcFIIH2XFUlYjLM4TeKVATI4II8ubMmjcsdXbFkULYtMtD1ucA07mDjI Aug 10 23:09:22.125582 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:09:22.125582 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:09:22.125582 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:09:22.125582 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:09:22.125582 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:09:22.125582 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:09:22.125582 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 7ad554e982ff483098acf8a3b58e3842 Aug 10 23:09:22.125582 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-384625613 Aug 10 23:09:22.125582 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:09:22.125582 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:09:22.125582 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7ad554e982ff483098acf8a3b58e3842"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7ad554e982ff483098acf8a3b58e3842"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7ad554e982ff483098acf8a3b58e3842"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7ad554e982ff483098acf8a3b58e3842", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:09:22.125582 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-384625613 Aug 10 23:09:22.125582 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 7ad554e982ff483098acf8a3b58e3842 Aug 10 23:09:22.125582 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-384625613 Aug 10 23:09:22.125582 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-ServerMetadataNegativeTestJSON-384625613-project Aug 10 23:09:22.125582 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:09:22.125582 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:09:22.125582 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 7caa911d519e4711bf9a251b04ebe8dd Aug 10 23:09:22.125582 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-384625613-project Aug 10 23:09:22.125582 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:09:22.125582 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance e6e47079-7572-4e03-82e2-217049e05a38 could not be found. Aug 10 23:09:22.125582 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'server_id': 'e6e47079-7572-4e03-82e2-217049e05a38', 'id': 'test2'} Aug 10 23:09:22.125582 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:09:22.125582 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:09:22.125582 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:09:22.125582 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:09:22.125582 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:09:22.125582 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:09:22.125582 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 10 23:09:22.125582 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 10 23:09:22.125582 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6e47079-7572-4e03-82e2-217049e05a38 could not be found. Aug 10 23:09:22.125582 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:09:22.125582 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:09:22.125582 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:09:22.125582 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:09:22.125582 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:09:22.125582 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:09:22.125582 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:09:22.125582 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:09:22.125582 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:09:22.125582 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:09:22.125582 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show Aug 10 23:09:22.125582 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Aug 10 23:09:22.125582 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:09:22.125582 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:09:22.125582 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6e47079-7572-4e03-82e2-217049e05a38 could not be found. Aug 10 23:09:22.125582 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:09:22.125582 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:09:22.125582 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:09:22.125582 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:09:22.125582 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:09:22.125582 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:09:22.130852 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:09:22.130852 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:09:22.130852 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6e47079-7572-4e03-82e2-217049e05a38 could not be found. Aug 10 23:09:22.130852 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:09:22.131990 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-ee4ca4cd-2854-4fda-902f-134f08f4b2af tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] Returning 404 to user: Instance e6e47079-7572-4e03-82e2-217049e05a38 could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:09:22.133035 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-ee4ca4cd-2854-4fda-902f-134f08f4b2af tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] 10.222.0.58 "GET /compute/v2.1/servers/e6e47079-7572-4e03-82e2-217049e05a38/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.038410 Aug 10 23:09:22.134294 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1539/2982] 10.222.0.58 () {58 vars in 1281 bytes} [Wed Aug 10 23:09:22 2022] GET /compute/v2.1/servers/e6e47079-7572-4e03-82e2-217049e05a38/metadata/test2 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:09:22.139154 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-ee617c91-6785-4958-89c7-faa291a74b4d tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:09:22.139768 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-ee617c91-6785-4958-89c7-faa291a74b4d tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] [instance: 325d9b10-716d-4961-91d1-70962403fef4] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:09:22.148769 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ee617c91-6785-4958-89c7-faa291a74b4d tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:22.149490 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ee617c91-6785-4958-89c7-faa291a74b4d tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:22.150129 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ee617c91-6785-4958-89c7-faa291a74b4d tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:22.151043 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ee617c91-6785-4958-89c7-faa291a74b4d tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:22.151685 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ee617c91-6785-4958-89c7-faa291a74b4d tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:22.152282 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ee617c91-6785-4958-89c7-faa291a74b4d tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:22.256838 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-ee617c91-6785-4958-89c7-faa291a74b4d tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c84e70c3ea5347e79ba5aee661b15ce4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01ab3ad5c0ef448aaa1282112bf20d83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:09:22.265467 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-ee617c91-6785-4958-89c7-faa291a74b4d tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] 10.222.0.58 "GET /compute/v2.1/servers/325d9b10-716d-4961-91d1-70962403fef4" status: 200 len: 1467 microversion: 2.1 time: 0.130036 Aug 10 23:09:22.266149 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1540/2983] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:09:22 2022] GET /compute/v2.1/servers/325d9b10-716d-4961-91d1-70962403fef4 => generated 1467 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:09:22.274119 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-f301bf2e-18ef-4309-908e-24771f6cbcbc req-b305ed94-4abb-468c-a031-acc4431a7a9e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61e7db28-1e60-444a-b6c0-dd65ef3f5a6b", "tag": "993de175-c53f-4b4e-a8ba-348ecebfaf8f"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:09:22.285004 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-f301bf2e-18ef-4309-908e-24771f6cbcbc req-b305ed94-4abb-468c-a031-acc4431a7a9e service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:22.285492 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-f301bf2e-18ef-4309-908e-24771f6cbcbc req-b305ed94-4abb-468c-a031-acc4431a7a9e service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:22.285926 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-f301bf2e-18ef-4309-908e-24771f6cbcbc req-b305ed94-4abb-468c-a031-acc4431a7a9e service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:22.299466 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-f301bf2e-18ef-4309-908e-24771f6cbcbc req-b305ed94-4abb-468c-a031-acc4431a7a9e service nova] Creating event network-changed:993de175-c53f-4b4e-a8ba-348ecebfaf8f for instance 61e7db28-1e60-444a-b6c0-dd65ef3f5a6b on n-h1-850468-14 Aug 10 23:09:22.305672 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-f301bf2e-18ef-4309-908e-24771f6cbcbc req-b305ed94-4abb-468c-a031-acc4431a7a9e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038269 Aug 10 23:09:22.306543 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1541/2984] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:09:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:09:22.313049 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-4f2698fb-384f-4de9-95a2-b1baa21bdec6 tempest-KeyPairsV22TestJSON-1733237097 tempest-KeyPairsV22TestJSON-1733237097-project] Action: 'create', calling method: .version_select at 0x7f847c5441f0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-362044315", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIWcXnpJBs9RfaqM2liNxo17IzL999ZinKA+RwFMR+yxS+k3ELmTRKiHfYvDE6VM19fGI0sK4q+evsOmheKbW3pi+mh9hUWCgl9rBaVOUFNLb+AP0I7Hqi5EmSAW39/SlA=="}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:09:22.333391 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-4f2698fb-384f-4de9-95a2-b1baa21bdec6 tempest-KeyPairsV22TestJSON-1733237097 tempest-KeyPairsV22TestJSON-1733237097-project] Getting quotas for project 2d273ce09fa34616b5a9b4f5edea6f13. Resources: {'key_pairs'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:09:22.339614 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-4f2698fb-384f-4de9-95a2-b1baa21bdec6 tempest-KeyPairsV22TestJSON-1733237097 tempest-KeyPairsV22TestJSON-1733237097-project] Getting quotas for user a9b04960b669465983ee87a114e09c5d and project 2d273ce09fa34616b5a9b4f5edea6f13. Resources: {'key_pairs'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:09:22.381777 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-4f2698fb-384f-4de9-95a2-b1baa21bdec6 tempest-KeyPairsV22TestJSON-1733237097 tempest-KeyPairsV22TestJSON-1733237097-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.072190 Aug 10 23:09:22.385138 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1542/2985] 10.222.0.58 () {62 vars in 1199 bytes} [Wed Aug 10 23:09:22 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 78 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 10 23:09:22.391034 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-b69f2e3a-93d0-4a13-8ee3-774a3c096fcc tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:09:22.392081 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-b69f2e3a-93d0-4a13-8ee3-774a3c096fcc tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] [instance: 3fae69e0-e5f3-4ce8-89b5-5d0a410b7be1] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:09:22.404950 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b69f2e3a-93d0-4a13-8ee3-774a3c096fcc tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:22.405902 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b69f2e3a-93d0-4a13-8ee3-774a3c096fcc tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:22.413009 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b69f2e3a-93d0-4a13-8ee3-774a3c096fcc tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:22.414407 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b69f2e3a-93d0-4a13-8ee3-774a3c096fcc tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:22.415253 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b69f2e3a-93d0-4a13-8ee3-774a3c096fcc tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:22.416116 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b69f2e3a-93d0-4a13-8ee3-774a3c096fcc tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:22.460618 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-b69f2e3a-93d0-4a13-8ee3-774a3c096fcc tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] [instance: 3fae69e0-e5f3-4ce8-89b5-5d0a410b7be1] Going to try to terminate instance {{(pid=122633) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:09:22.729907 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-b69f2e3a-93d0-4a13-8ee3-774a3c096fcc tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] 10.222.0.58 "DELETE /compute/v2.1/servers/3fae69e0-e5f3-4ce8-89b5-5d0a410b7be1" status: 204 len: 0 microversion: 2.1 time: 0.343211 Aug 10 23:09:22.731271 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1543/2986] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:09:22 2022] DELETE /compute/v2.1/servers/3fae69e0-e5f3-4ce8-89b5-5d0a410b7be1 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:09:22.738118 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-848a9a4d-26bd-4891-ad7b-18e2c158efe5 tempest-KeyPairsV22TestJSON-1733237097 tempest-KeyPairsV22TestJSON-1733237097-project] Action: 'create', calling method: .version_select at 0x7f847c544e50>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1472417055", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNGWy82PbyBkypHD+kf3Lw/5vfv0hl/v0H/I4hIOKHsiHJbcy4QMtp7/Fda3h+xSOTlQGck3BxJbMVeyKSy0eCaW3AkeEQGMrofzvtHUAZb0uC82PA917OTw5swOnIlPaA=="}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:09:22.798354 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-848a9a4d-26bd-4891-ad7b-18e2c158efe5 tempest-KeyPairsV22TestJSON-1733237097 tempest-KeyPairsV22TestJSON-1733237097-project] Getting quotas for project 2d273ce09fa34616b5a9b4f5edea6f13. Resources: {'key_pairs'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:09:22.811668 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-848a9a4d-26bd-4891-ad7b-18e2c158efe5 tempest-KeyPairsV22TestJSON-1733237097 tempest-KeyPairsV22TestJSON-1733237097-project] Getting quotas for user a9b04960b669465983ee87a114e09c5d and project 2d273ce09fa34616b5a9b4f5edea6f13. Resources: {'key_pairs'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:09:22.862903 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-848a9a4d-26bd-4891-ad7b-18e2c158efe5 tempest-KeyPairsV22TestJSON-1733237097 tempest-KeyPairsV22TestJSON-1733237097-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.123228 Aug 10 23:09:22.862903 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1544/2987] 10.222.0.58 () {62 vars in 1199 bytes} [Wed Aug 10 23:09:22 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 131 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 10 23:09:22.875382 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-a556ae40-a14a-4161-aa2d-2fc47271555c tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:09:22.879172 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-a556ae40-a14a-4161-aa2d-2fc47271555c tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] [instance: 6bdca10c-38e0-4605-9a5d-002c6333b81f] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:09:22.895357 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a556ae40-a14a-4161-aa2d-2fc47271555c tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:22.897595 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a556ae40-a14a-4161-aa2d-2fc47271555c tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:22.900625 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a556ae40-a14a-4161-aa2d-2fc47271555c tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:22.901621 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a556ae40-a14a-4161-aa2d-2fc47271555c tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:22.902212 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a556ae40-a14a-4161-aa2d-2fc47271555c tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:22.904637 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a556ae40-a14a-4161-aa2d-2fc47271555c tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:23.084941 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-a556ae40-a14a-4161-aa2d-2fc47271555c tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca7d06f2acb44558d405a3b35a59550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7f70700e035444c9f2c9fa491c5c41a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:09:23.107580 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-a556ae40-a14a-4161-aa2d-2fc47271555c tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] 10.222.0.58 "GET /compute/v2.1/servers/6bdca10c-38e0-4605-9a5d-002c6333b81f" status: 200 len: 1270 microversion: 2.1 time: 0.235961 Aug 10 23:09:23.109608 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1545/2988] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:09:22 2022] GET /compute/v2.1/servers/6bdca10c-38e0-4605-9a5d-002c6333b81f => generated 1270 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:09:23.128900 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-a643c8f2-d978-4929-a9e9-d69106e94b10 tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:09:23.129568 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-a643c8f2-d978-4929-a9e9-d69106e94b10 tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] [instance: 3fae69e0-e5f3-4ce8-89b5-5d0a410b7be1] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:09:23.150908 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a643c8f2-d978-4929-a9e9-d69106e94b10 tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:23.154464 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a643c8f2-d978-4929-a9e9-d69106e94b10 tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:23.155065 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a643c8f2-d978-4929-a9e9-d69106e94b10 tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:23.155746 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a643c8f2-d978-4929-a9e9-d69106e94b10 tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:23.156292 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a643c8f2-d978-4929-a9e9-d69106e94b10 tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:23.159719 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a643c8f2-d978-4929-a9e9-d69106e94b10 tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:23.538735 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.network.neutron [None req-b1259f45-ff21-491e-91d2-878b9b17ea88 tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] [instance: 61e7db28-1e60-444a-b6c0-dd65ef3f5a6b] Updating instance_info_cache with network_info: [{"id": "993de175-c53f-4b4e-a8ba-348ecebfaf8f", "address": "fa:16:3e:3d:2d:da", "network": {"id": "554d8b60-99a8-4956-bd23-59eb61c37a51", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1140502993-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "8e4512070fb74a32a9203526a025914e", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap993de175-c5", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=122632) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 10 23:09:23.555372 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b1259f45-ff21-491e-91d2-878b9b17ea88 tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Releasing lock "refresh_cache-61e7db28-1e60-444a-b6c0-dd65ef3f5a6b" {{(pid=122632) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 10 23:09:23.556782 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-b1259f45-ff21-491e-91d2-878b9b17ea88 tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] 10.222.0.58 "POST /compute/v2.1/servers/61e7db28-1e60-444a-b6c0-dd65ef3f5a6b/action" status: 202 len: 0 microversion: 2.1 time: 4.107264 Aug 10 23:09:23.557458 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1444/2989] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:09:19 2022] POST /compute/v2.1/servers/61e7db28-1e60-444a-b6c0-dd65ef3f5a6b/action => generated 0 bytes in 4108 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 10 23:09:23.567194 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-caf93be0-75bf-47cf-b244-c238a670056c tempest-KeyPairsV22TestJSON-1733237097 tempest-KeyPairsV22TestJSON-1733237097-project] Calling method '.version_select at 0x7f847db49a60>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:09:23.578545 n-d-850468-14 devstack@n-api.service[122632]: WARNING oslo_db.sqlalchemy.utils [None req-caf93be0-75bf-47cf-b244-c238a670056c tempest-KeyPairsV22TestJSON-1733237097 tempest-KeyPairsV22TestJSON-1733237097-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 10 23:09:23.596761 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-caf93be0-75bf-47cf-b244-c238a670056c tempest-KeyPairsV22TestJSON-1733237097 tempest-KeyPairsV22TestJSON-1733237097-project] 10.222.0.58 "GET /compute/v2.1/os-keypairs" status: 200 len: 1140 microversion: 2.2 time: 0.038192 Aug 10 23:09:23.599507 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1445/2990] 10.222.0.58 () {60 vars in 1177 bytes} [Wed Aug 10 23:09:23 2022] GET /compute/v2.1/os-keypairs => generated 1140 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:09:23.610329 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-b71b5b57-1b12-4de6-8325-d796b496c6f7 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:09:23.611243 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-b71b5b57-1b12-4de6-8325-d796b496c6f7 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] [instance: d09d04b1-bc37-4290-873e-ce2adae19eaf] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:09:23.623146 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b71b5b57-1b12-4de6-8325-d796b496c6f7 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:23.624554 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b71b5b57-1b12-4de6-8325-d796b496c6f7 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:23.626223 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b71b5b57-1b12-4de6-8325-d796b496c6f7 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:23.627605 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b71b5b57-1b12-4de6-8325-d796b496c6f7 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:23.627849 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-a643c8f2-d978-4929-a9e9-d69106e94b10 tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7caa911d519e4711bf9a251b04ebe8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad554e982ff483098acf8a3b58e3842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:09:23.631472 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b71b5b57-1b12-4de6-8325-d796b496c6f7 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:23.632140 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b71b5b57-1b12-4de6-8325-d796b496c6f7 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:23.638083 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-a643c8f2-d978-4929-a9e9-d69106e94b10 tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] 10.222.0.58 "GET /compute/v2.1/servers/3fae69e0-e5f3-4ce8-89b5-5d0a410b7be1" status: 200 len: 1525 microversion: 2.1 time: 0.527404 Aug 10 23:09:23.642557 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1546/2991] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:09:23 2022] GET /compute/v2.1/servers/3fae69e0-e5f3-4ce8-89b5-5d0a410b7be1 => generated 1525 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:09:23.655450 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c9fbfe33-17ff-4f21-8565-4c74fb44191d tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:09:23.656664 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-c9fbfe33-17ff-4f21-8565-4c74fb44191d tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] [instance: 325d9b10-716d-4961-91d1-70962403fef4] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:09:23.672173 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c9fbfe33-17ff-4f21-8565-4c74fb44191d tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:23.672878 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c9fbfe33-17ff-4f21-8565-4c74fb44191d tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:23.673513 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c9fbfe33-17ff-4f21-8565-4c74fb44191d tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:23.674407 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c9fbfe33-17ff-4f21-8565-4c74fb44191d tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:23.675706 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c9fbfe33-17ff-4f21-8565-4c74fb44191d tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:23.679430 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c9fbfe33-17ff-4f21-8565-4c74fb44191d tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:23.744576 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-c9fbfe33-17ff-4f21-8565-4c74fb44191d tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] HTTP exception thrown: Instance 325d9b10-716d-4961-91d1-70962403fef4 could not be found. Aug 10 23:09:23.746324 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c9fbfe33-17ff-4f21-8565-4c74fb44191d tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Request method failure captured: Aug 10 23:09:23.746324 n-d-850468-14 devstack@n-api.service[122633]: request: GET /compute/v2.1/servers/325d9b10-716d-4961-91d1-70962403fef4 HTTP/1.1 Aug 10 23:09:23.746324 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:09:23.746324 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:09:23.746324 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:09:23.746324 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:09:23.746324 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:09:23.746324 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:09:23.746324 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:09:23.746324 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:09:23.746324 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9DpRxNkZlRYGNB-rzpLOgPt6j_BSsa5nuUWWTgCxAjy8fNH3A7JcvEHhe0DrL7hfgNk46JZOO1yhoeqDc7StC2F0yYT96_h1hyLtbcoFc_JYjCpP4xeqJQIPj_9zNc9xScMoxdFt_OV1zQtGI5T3a2FQUYmQFSVhVvra9ZPkVMwOnrc Aug 10 23:09:23.746324 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:09:23.746324 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:09:23.746324 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:09:23.746324 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:09:23.746324 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:09:23.746324 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:09:23.746324 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 01ab3ad5c0ef448aaa1282112bf20d83 Aug 10 23:09:23.746324 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-237018857 Aug 10 23:09:23.746324 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:09:23.746324 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:09:23.746324 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/01ab3ad5c0ef448aaa1282112bf20d83"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/01ab3ad5c0ef448aaa1282112bf20d83"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/01ab3ad5c0ef448aaa1282112bf20d83"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_01ab3ad5c0ef448aaa1282112bf20d83", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:09:23.746324 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-237018857 Aug 10 23:09:23.746324 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 01ab3ad5c0ef448aaa1282112bf20d83 Aug 10 23:09:23.746324 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-237018857 Aug 10 23:09:23.746324 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-ServerRescueTestJSONUnderV235-237018857-project Aug 10 23:09:23.746324 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:09:23.746324 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:09:23.746324 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: c84e70c3ea5347e79ba5aee661b15ce4 Aug 10 23:09:23.746324 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-237018857-project Aug 10 23:09:23.746324 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:09:23.746324 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance 325d9b10-716d-4961-91d1-70962403fef4 could not be found. Aug 10 23:09:23.746324 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': '325d9b10-716d-4961-91d1-70962403fef4'} Aug 10 23:09:23.746324 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:09:23.746324 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:09:23.746324 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:09:23.746324 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:09:23.746324 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:09:23.746324 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:09:23.746324 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:09:23.746324 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:09:23.746324 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:09:23.746324 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:09:23.746324 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 325d9b10-716d-4961-91d1-70962403fef4 could not be found. Aug 10 23:09:23.746324 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:09:23.746324 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:09:23.746324 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:09:23.746324 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:09:23.746324 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:09:23.746324 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:09:23.746324 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:09:23.746324 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:09:23.746324 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:09:23.746324 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:09:23.746324 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:09:23.746324 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:09:23.746324 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:09:23.746324 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:09:23.746324 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:09:23.746324 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:09:23.746324 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 325d9b10-716d-4961-91d1-70962403fef4 could not be found. Aug 10 23:09:23.746324 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:09:23.746324 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:09:23.750509 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:09:23.750509 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:09:23.750509 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:09:23.750509 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:09:23.750509 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:09:23.750509 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:09:23.750509 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 325d9b10-716d-4961-91d1-70962403fef4 could not be found. Aug 10 23:09:23.750509 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:09:23.750509 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c9fbfe33-17ff-4f21-8565-4c74fb44191d tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] Returning 404 to user: Instance 325d9b10-716d-4961-91d1-70962403fef4 could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:09:23.750509 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-c9fbfe33-17ff-4f21-8565-4c74fb44191d tempest-ServerRescueTestJSONUnderV235-237018857 tempest-ServerRescueTestJSONUnderV235-237018857-project] 10.222.0.58 "GET /compute/v2.1/servers/325d9b10-716d-4961-91d1-70962403fef4" status: 404 len: 111 microversion: 2.1 time: 0.106400 Aug 10 23:09:23.752695 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1547/2992] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:09:23 2022] GET /compute/v2.1/servers/325d9b10-716d-4961-91d1-70962403fef4 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:09:23.759987 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-5ada24b6-01ee-4a3d-ac35-aa6ecb86a3bd req-ab794d9a-3aa3-40cf-8e1a-ef97e857d5f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ea8116b-d76a-4b57-9d22-c6a3b8b10867", "name": "network-vif-deleted", "tag": "a3c41df0-52c7-490e-8544-bb0663ab5e7b"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:09:23.793195 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-5ada24b6-01ee-4a3d-ac35-aa6ecb86a3bd req-ab794d9a-3aa3-40cf-8e1a-ef97e857d5f5 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:23.793689 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-5ada24b6-01ee-4a3d-ac35-aa6ecb86a3bd req-ab794d9a-3aa3-40cf-8e1a-ef97e857d5f5 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:23.794132 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-5ada24b6-01ee-4a3d-ac35-aa6ecb86a3bd req-ab794d9a-3aa3-40cf-8e1a-ef97e857d5f5 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:23.843754 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-5ada24b6-01ee-4a3d-ac35-aa6ecb86a3bd req-ab794d9a-3aa3-40cf-8e1a-ef97e857d5f5 service nova] Creating event network-vif-deleted:a3c41df0-52c7-490e-8544-bb0663ab5e7b for instance 5ea8116b-d76a-4b57-9d22-c6a3b8b10867 on n-h1-850468-14 Aug 10 23:09:23.856311 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-5ada24b6-01ee-4a3d-ac35-aa6ecb86a3bd req-ab794d9a-3aa3-40cf-8e1a-ef97e857d5f5 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104333 Aug 10 23:09:23.856937 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1548/2993] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:09:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:09:23.869041 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-77d4bd59-d7a6-4d89-8e8d-1d79bc7cb5a4 tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Calling method '.version_select at 0x7f847cf91ee0>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:09:24.122835 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-b71b5b57-1b12-4de6-8325-d796b496c6f7 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bbb4f184e4409d9eed51e0b98dfb29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708f8d4c4ed6432d85e0bf6a9bac7677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:09:24.131297 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-b71b5b57-1b12-4de6-8325-d796b496c6f7 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] 10.222.0.58 "GET /compute/v2.1/servers/d09d04b1-bc37-4290-873e-ce2adae19eaf" status: 200 len: 1536 microversion: 2.1 time: 0.524565 Aug 10 23:09:24.156463 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1446/2994] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:09:23 2022] GET /compute/v2.1/servers/d09d04b1-bc37-4290-873e-ce2adae19eaf => generated 1536 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:09:24.165943 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-33dbdb88-4894-469b-b90a-807d9e396bad tempest-KeyPairsV22TestJSON-1733237097 tempest-KeyPairsV22TestJSON-1733237097-project] Calling method '.version_select at 0x7f847d1b7d30>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:09:24.196680 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-33dbdb88-4894-469b-b90a-807d9e396bad tempest-KeyPairsV22TestJSON-1733237097 tempest-KeyPairsV22TestJSON-1733237097-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1472417055" status: 204 len: 0 microversion: 2.2 time: 0.038173 Aug 10 23:09:24.197321 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1447/2995] 10.222.0.58 () {60 vars in 1321 bytes} [Wed Aug 10 23:09:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1472417055 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:09:24.205524 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-04198b81-6c7a-4e55-85ba-6360e35202fc tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:09:24.207721 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-04198b81-6c7a-4e55-85ba-6360e35202fc tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] [instance: 6bdca10c-38e0-4605-9a5d-002c6333b81f] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:09:24.220995 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-04198b81-6c7a-4e55-85ba-6360e35202fc tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:24.221974 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-04198b81-6c7a-4e55-85ba-6360e35202fc tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:24.224624 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-04198b81-6c7a-4e55-85ba-6360e35202fc tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:24.225787 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-04198b81-6c7a-4e55-85ba-6360e35202fc tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:24.226414 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-04198b81-6c7a-4e55-85ba-6360e35202fc tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:24.227328 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-04198b81-6c7a-4e55-85ba-6360e35202fc tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:24.436085 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-04198b81-6c7a-4e55-85ba-6360e35202fc tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca7d06f2acb44558d405a3b35a59550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7f70700e035444c9f2c9fa491c5c41a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:09:24.456458 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-04198b81-6c7a-4e55-85ba-6360e35202fc tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] 10.222.0.58 "GET /compute/v2.1/servers/6bdca10c-38e0-4605-9a5d-002c6333b81f" status: 200 len: 1276 microversion: 2.1 time: 0.257638 Aug 10 23:09:24.477703 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1448/2996] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:09:24 2022] GET /compute/v2.1/servers/6bdca10c-38e0-4605-9a5d-002c6333b81f => generated 1276 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:09:24.495459 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-a2ed6619-db05-43b1-b2f3-dc9eeaf25fec tempest-KeyPairsV22TestJSON-1733237097 tempest-KeyPairsV22TestJSON-1733237097-project] Calling method '.version_select at 0x7f847d0ce0d0>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:09:24.576319 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-a2ed6619-db05-43b1-b2f3-dc9eeaf25fec tempest-KeyPairsV22TestJSON-1733237097 tempest-KeyPairsV22TestJSON-1733237097-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-362044315" status: 204 len: 0 microversion: 2.2 time: 0.092541 Aug 10 23:09:24.577413 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1449/2997] 10.222.0.58 () {60 vars in 1318 bytes} [Wed Aug 10 23:09:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-362044315 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:09:24.582409 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-da4f7531-abbe-43ac-9a82-5f68929688dd req-70ddd9b9-82db-4df8-8633-07ba43b0683e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "325d9b10-716d-4961-91d1-70962403fef4", "name": "network-vif-deleted", "tag": "636830f5-e8dd-4490-8875-671bd1ac26f5"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:09:24.593759 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-da4f7531-abbe-43ac-9a82-5f68929688dd req-70ddd9b9-82db-4df8-8633-07ba43b0683e service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:24.607519 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-da4f7531-abbe-43ac-9a82-5f68929688dd req-70ddd9b9-82db-4df8-8633-07ba43b0683e service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:24.608130 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-da4f7531-abbe-43ac-9a82-5f68929688dd req-70ddd9b9-82db-4df8-8633-07ba43b0683e service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:24.625339 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-da4f7531-abbe-43ac-9a82-5f68929688dd req-70ddd9b9-82db-4df8-8633-07ba43b0683e service nova] Creating event network-vif-deleted:636830f5-e8dd-4490-8875-671bd1ac26f5 for instance 325d9b10-716d-4961-91d1-70962403fef4 on n-h1-850468-14 Aug 10 23:09:24.641015 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-da4f7531-abbe-43ac-9a82-5f68929688dd req-70ddd9b9-82db-4df8-8633-07ba43b0683e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062087 Aug 10 23:09:24.642003 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1450/2998] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:09:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:09:24.654965 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-79d7e351-1c47-4927-b887-cd23e9acdb56 tempest-KeyPairsV22TestJSON-1733237097 tempest-KeyPairsV22TestJSON-1733237097-project] Calling method '.version_select at 0x7f847d17b280>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:09:24.693313 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-79d7e351-1c47-4927-b887-cd23e9acdb56 tempest-KeyPairsV22TestJSON-1733237097 tempest-KeyPairsV22TestJSON-1733237097-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-836864573" status: 204 len: 0 microversion: 2.2 time: 0.049576 Aug 10 23:09:24.700868 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1451/2999] 10.222.0.58 () {60 vars in 1318 bytes} [Wed Aug 10 23:09:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-836864573 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:09:24.712777 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-5b50df42-d229-446d-a06a-e247369c257c tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:09:24.713763 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-5b50df42-d229-446d-a06a-e247369c257c tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] [instance: 3fae69e0-e5f3-4ce8-89b5-5d0a410b7be1] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:09:24.726710 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5b50df42-d229-446d-a06a-e247369c257c tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:24.728711 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5b50df42-d229-446d-a06a-e247369c257c tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:24.729349 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5b50df42-d229-446d-a06a-e247369c257c tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:24.730264 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5b50df42-d229-446d-a06a-e247369c257c tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:24.731223 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5b50df42-d229-446d-a06a-e247369c257c tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:24.731982 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5b50df42-d229-446d-a06a-e247369c257c tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:25.186546 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-77d4bd59-d7a6-4d89-8e8d-1d79bc7cb5a4 tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] 10.222.0.58 "DELETE /compute/v2.1/os-floating-ips/1c2d948a-ca98-4f14-9737-50e8ad5aeb98" status: 202 len: 0 microversion: 2.1 time: 1.322294 Aug 10 23:09:25.187534 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1549/3000] 10.222.0.58 () {58 vars in 1263 bytes} [Wed Aug 10 23:09:23 2022] DELETE /compute/v2.1/os-floating-ips/1c2d948a-ca98-4f14-9737-50e8ad5aeb98 => generated 0 bytes in 1330 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:09:25.193174 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-fdcd46be-c51a-497a-9fa8-90cf8b85f840 tempest-KeyPairsV22TestJSON-1733237097 tempest-KeyPairsV22TestJSON-1733237097-project] Action: 'create', calling method: .version_select at 0x7f847c544f70>, body: {"keypair": {"name": "tempest-keypair-1672789766", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCK52HEUSGp8NejTh5nPu/OyEojl4GQ9NIceMYrRjturq+SQx5iOpKndi+zeAIxG5R6jOvvV8knH+f9EijzUPDuthfEnYsitqsn1CRSJb67lWmGVfaEeFh/2BGbTXfIIQg=="}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:09:25.216181 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-fdcd46be-c51a-497a-9fa8-90cf8b85f840 tempest-KeyPairsV22TestJSON-1733237097 tempest-KeyPairsV22TestJSON-1733237097-project] Getting quotas for project 2d273ce09fa34616b5a9b4f5edea6f13. Resources: {'key_pairs'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:09:25.221534 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-fdcd46be-c51a-497a-9fa8-90cf8b85f840 tempest-KeyPairsV22TestJSON-1733237097 tempest-KeyPairsV22TestJSON-1733237097-project] Getting quotas for user a9b04960b669465983ee87a114e09c5d and project 2d273ce09fa34616b5a9b4f5edea6f13. Resources: {'key_pairs'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:09:25.247541 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-fdcd46be-c51a-497a-9fa8-90cf8b85f840 tempest-KeyPairsV22TestJSON-1733237097 tempest-KeyPairsV22TestJSON-1733237097-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.058713 Aug 10 23:09:25.248690 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1550/3001] 10.222.0.58 () {62 vars in 1199 bytes} [Wed Aug 10 23:09:25 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 60 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 10 23:09:25.253233 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-cf701b70-5a01-42cc-b9e5-dc539c608356 req-4bf8c3c1-48ce-4831-9374-3678bec82233 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d09d04b1-bc37-4290-873e-ce2adae19eaf", "name": "network-vif-plugged", "status": "completed", "tag": "7c24b140-f5ee-4079-a313-c307f5d3865b"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:09:25.263966 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-cf701b70-5a01-42cc-b9e5-dc539c608356 req-4bf8c3c1-48ce-4831-9374-3678bec82233 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:25.264367 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-cf701b70-5a01-42cc-b9e5-dc539c608356 req-4bf8c3c1-48ce-4831-9374-3678bec82233 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:25.264798 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-cf701b70-5a01-42cc-b9e5-dc539c608356 req-4bf8c3c1-48ce-4831-9374-3678bec82233 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:25.275839 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-cf701b70-5a01-42cc-b9e5-dc539c608356 req-4bf8c3c1-48ce-4831-9374-3678bec82233 service nova] Creating event network-vif-plugged:7c24b140-f5ee-4079-a313-c307f5d3865b for instance d09d04b1-bc37-4290-873e-ce2adae19eaf on n-h1-850468-14 Aug 10 23:09:25.280903 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-cf701b70-5a01-42cc-b9e5-dc539c608356 req-4bf8c3c1-48ce-4831-9374-3678bec82233 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030900 Aug 10 23:09:25.282292 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1551/3002] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:09:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:09:25.287411 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-e1303fbb-4b02-433d-81d7-a71d5b3b07ed tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:09:25.288119 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-e1303fbb-4b02-433d-81d7-a71d5b3b07ed tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] [instance: d09d04b1-bc37-4290-873e-ce2adae19eaf] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:09:25.294545 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e1303fbb-4b02-433d-81d7-a71d5b3b07ed tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:25.295068 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e1303fbb-4b02-433d-81d7-a71d5b3b07ed tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:25.295522 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e1303fbb-4b02-433d-81d7-a71d5b3b07ed tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:25.296218 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e1303fbb-4b02-433d-81d7-a71d5b3b07ed tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:25.296672 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e1303fbb-4b02-433d-81d7-a71d5b3b07ed tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:25.297100 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e1303fbb-4b02-433d-81d7-a71d5b3b07ed tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:25.435330 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-e1303fbb-4b02-433d-81d7-a71d5b3b07ed tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bbb4f184e4409d9eed51e0b98dfb29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708f8d4c4ed6432d85e0bf6a9bac7677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:09:25.444625 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-e1303fbb-4b02-433d-81d7-a71d5b3b07ed tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] 10.222.0.58 "GET /compute/v2.1/servers/d09d04b1-bc37-4290-873e-ce2adae19eaf" status: 200 len: 1523 microversion: 2.1 time: 0.161044 Aug 10 23:09:25.445227 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1552/3003] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:09:25 2022] GET /compute/v2.1/servers/d09d04b1-bc37-4290-873e-ce2adae19eaf => generated 1523 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:09:25.450498 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c493fe9a-d9b0-4268-a680-bc555e12468e tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": ""}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:09:25.454364 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c493fe9a-d9b0-4268-a680-bc555e12468e tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Request method failure captured: Aug 10 23:09:25.454364 n-d-850468-14 devstack@n-api.service[122633]: request: POST /compute/v2.1/servers/61e7db28-1e60-444a-b6c0-dd65ef3f5a6b/action HTTP/1.1 Aug 10 23:09:25.454364 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:09:25.454364 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:09:25.454364 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:09:25.454364 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 34 Aug 10 23:09:25.454364 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:09:25.454364 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:09:25.454364 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:09:25.454364 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:09:25.454364 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9DpyFta3vOC37XpWrOYeYI8WRURapgf9D1TVPTeiZCPP7bJ6dAEgSW5sr5rDDfzvHGfKPR_6zSaQ6Sg3UuNHumb-U4KLrw_PO-OPVMXucIvyvRb3lYadGDmmqm1c9Lpb_T_BUbmnNb_gdjHtUgRAPzKm9OslTBkkgLXABt1EJFhNgpE Aug 10 23:09:25.454364 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:09:25.454364 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:09:25.454364 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:09:25.454364 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:09:25.454364 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:09:25.454364 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:09:25.454364 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 8e4512070fb74a32a9203526a025914e Aug 10 23:09:25.454364 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-272238324 Aug 10 23:09:25.454364 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:09:25.454364 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:09:25.454364 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8e4512070fb74a32a9203526a025914e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8e4512070fb74a32a9203526a025914e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/8e4512070fb74a32a9203526a025914e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_8e4512070fb74a32a9203526a025914e", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:09:25.454364 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-272238324 Aug 10 23:09:25.454364 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 8e4512070fb74a32a9203526a025914e Aug 10 23:09:25.454364 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-272238324 Aug 10 23:09:25.454364 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project Aug 10 23:09:25.454364 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:09:25.454364 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:09:25.454364 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: ca20e8ce3e25491fbe58f97ac5b9250a Aug 10 23:09:25.454364 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project Aug 10 23:09:25.454364 n-d-850468-14 devstack@n-api.service[122633]: Aug 10 23:09:25.454364 n-d-850468-14 devstack@n-api.service[122633]: {"addFloatingIp": {"address": ""}} Aug 10 23:09:25.454364 n-d-850468-14 devstack@n-api.service[122633]: method: Aug 10 23:09:25.454364 n-d-850468-14 devstack@n-api.service[122633]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Aug 10 23:09:25.454364 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': '61e7db28-1e60-444a-b6c0-dd65ef3f5a6b', 'body': {'addFloatingIp': {'address': ''}}} Aug 10 23:09:25.454364 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:09:25.454364 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:09:25.454364 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 10 23:09:25.454364 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 10 23:09:25.454364 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 10 23:09:25.454364 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise error Aug 10 23:09:25.454364 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Aug 10 23:09:25.454364 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:09:25.454364 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Aug 10 23:09:25.454364 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Aug 10 23:09:25.454364 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:09:25.454364 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Aug 10 23:09:25.454364 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi '' Aug 10 23:09:25.454364 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:09:25.454364 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:09:25.454364 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:09:25.454364 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:09:25.454364 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:09:25.454364 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:09:25.454364 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:09:25.454364 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:09:25.454364 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 23:09:25.454364 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 23:09:25.454364 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:09:25.454364 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:09:25.454364 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 10 23:09:25.454364 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 10 23:09:25.454364 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 10 23:09:25.454364 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 10 23:09:25.454364 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 10 23:09:25.466489 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 10 23:09:25.466489 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Aug 10 23:09:25.466489 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:09:25.466489 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:09:25.466489 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:09:25.466489 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:09:25.466489 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:09:25.466489 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:09:25.466489 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 10 23:09:25.466489 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 10 23:09:25.466489 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Aug 10 23:09:25.466489 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:09:25.466489 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c493fe9a-d9b0-4268-a680-bc555e12468e tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:09:25.466489 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-c493fe9a-d9b0-4268-a680-bc555e12468e tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] 10.222.0.58 "POST /compute/v2.1/servers/61e7db28-1e60-444a-b6c0-dd65ef3f5a6b/action" status: 400 len: 142 microversion: 2.1 time: 0.009598 Aug 10 23:09:25.466489 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1553/3004] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:09:25 2022] POST /compute/v2.1/servers/61e7db28-1e60-444a-b6c0-dd65ef3f5a6b/action => generated 142 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 10 23:09:25.466489 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-188bab5c-59e1-41c9-a6c2-39a504da8e57 tempest-KeyPairsV22TestJSON-1733237097 tempest-KeyPairsV22TestJSON-1733237097-project] Calling method '.version_select at 0x7f847c55fd30>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:09:25.476147 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-188bab5c-59e1-41c9-a6c2-39a504da8e57 tempest-KeyPairsV22TestJSON-1733237097 tempest-KeyPairsV22TestJSON-1733237097-project] 10.222.0.58 "GET /compute/v2.1/os-keypairs/tempest-keypair-1672789766" status: 200 len: 513 microversion: 2.2 time: 0.018689 Aug 10 23:09:25.476658 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1554/3005] 10.222.0.58 () {60 vars in 1258 bytes} [Wed Aug 10 23:09:25 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1672789766 => generated 513 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:09:25.481488 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-bdb34166-2bca-4be5-9aa3-64c0a04ed3fc tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:09:25.483001 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-bdb34166-2bca-4be5-9aa3-64c0a04ed3fc tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] [instance: d09d04b1-bc37-4290-873e-ce2adae19eaf] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:09:25.489826 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bdb34166-2bca-4be5-9aa3-64c0a04ed3fc tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:25.490640 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bdb34166-2bca-4be5-9aa3-64c0a04ed3fc tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:25.491097 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bdb34166-2bca-4be5-9aa3-64c0a04ed3fc tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:25.491801 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bdb34166-2bca-4be5-9aa3-64c0a04ed3fc tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:25.492252 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bdb34166-2bca-4be5-9aa3-64c0a04ed3fc tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:25.492676 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bdb34166-2bca-4be5-9aa3-64c0a04ed3fc tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:25.497401 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:09:25.522115 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-bdb34166-2bca-4be5-9aa3-64c0a04ed3fc tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] [instance: d09d04b1-bc37-4290-873e-ce2adae19eaf] Going to try to terminate instance {{(pid=122633) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:09:25.524851 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-5b50df42-d229-446d-a06a-e247369c257c tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7caa911d519e4711bf9a251b04ebe8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad554e982ff483098acf8a3b58e3842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:09:25.534468 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-5b50df42-d229-446d-a06a-e247369c257c tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] 10.222.0.58 "GET /compute/v2.1/servers/3fae69e0-e5f3-4ce8-89b5-5d0a410b7be1" status: 200 len: 1525 microversion: 2.1 time: 0.831983 Aug 10 23:09:25.535167 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1452/3006] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:09:24 2022] GET /compute/v2.1/servers/3fae69e0-e5f3-4ce8-89b5-5d0a410b7be1 => generated 1525 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:09:25.541495 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-f70bf060-fd94-49d2-ba8d-279372f83b46 tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:09:25.544581 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-f70bf060-fd94-49d2-ba8d-279372f83b46 tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] [instance: 61e7db28-1e60-444a-b6c0-dd65ef3f5a6b] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:09:25.552029 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f70bf060-fd94-49d2-ba8d-279372f83b46 tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:25.552622 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f70bf060-fd94-49d2-ba8d-279372f83b46 tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:25.553240 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f70bf060-fd94-49d2-ba8d-279372f83b46 tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:25.554053 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f70bf060-fd94-49d2-ba8d-279372f83b46 tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:25.554895 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f70bf060-fd94-49d2-ba8d-279372f83b46 tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:25.555401 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f70bf060-fd94-49d2-ba8d-279372f83b46 tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:25.584159 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f70bf060-fd94-49d2-ba8d-279372f83b46 tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Acquiring lock "refresh_cache-61e7db28-1e60-444a-b6c0-dd65ef3f5a6b" {{(pid=122632) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 10 23:09:25.585220 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f70bf060-fd94-49d2-ba8d-279372f83b46 tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Acquired lock "refresh_cache-61e7db28-1e60-444a-b6c0-dd65ef3f5a6b" {{(pid=122632) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 10 23:09:25.613592 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-bdb34166-2bca-4be5-9aa3-64c0a04ed3fc tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] 10.222.0.58 "DELETE /compute/v2.1/servers/d09d04b1-bc37-4290-873e-ce2adae19eaf" status: 204 len: 0 microversion: 2.1 time: 0.135543 Aug 10 23:09:25.616149 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1555/3007] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:09:25 2022] DELETE /compute/v2.1/servers/d09d04b1-bc37-4290-873e-ce2adae19eaf => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:09:25.622245 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-f197f5c6-6902-4bd9-bf81-f63228f6af3f tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:09:25.622976 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-f197f5c6-6902-4bd9-bf81-f63228f6af3f tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] [instance: 6bdca10c-38e0-4605-9a5d-002c6333b81f] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:09:25.625984 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=1,nova_api:INSERT=4,nova_api:UPDATE=2 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:09:25.629554 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f197f5c6-6902-4bd9-bf81-f63228f6af3f tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:25.630060 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f197f5c6-6902-4bd9-bf81-f63228f6af3f tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:25.630653 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f197f5c6-6902-4bd9-bf81-f63228f6af3f tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:25.631698 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f197f5c6-6902-4bd9-bf81-f63228f6af3f tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:25.632153 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f197f5c6-6902-4bd9-bf81-f63228f6af3f tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:25.632576 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f197f5c6-6902-4bd9-bf81-f63228f6af3f tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:25.706150 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-f197f5c6-6902-4bd9-bf81-f63228f6af3f tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca7d06f2acb44558d405a3b35a59550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7f70700e035444c9f2c9fa491c5c41a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:09:25.715181 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-f197f5c6-6902-4bd9-bf81-f63228f6af3f tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] 10.222.0.58 "GET /compute/v2.1/servers/6bdca10c-38e0-4605-9a5d-002c6333b81f" status: 200 len: 1276 microversion: 2.1 time: 0.097294 Aug 10 23:09:25.716529 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1556/3008] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:09:25 2022] GET /compute/v2.1/servers/6bdca10c-38e0-4605-9a5d-002c6333b81f => generated 1276 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:09:25.722222 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-83052386-4aad-4888-817b-d30541dee348 tempest-KeyPairsV22TestJSON-1733237097 tempest-KeyPairsV22TestJSON-1733237097-project] Calling method '.version_select at 0x7f847d3c0700>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:09:25.727554 n-d-850468-14 devstack@n-api.service[122633]: WARNING oslo_db.sqlalchemy.utils [None req-83052386-4aad-4888-817b-d30541dee348 tempest-KeyPairsV22TestJSON-1733237097 tempest-KeyPairsV22TestJSON-1733237097-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 10 23:09:25.732874 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-83052386-4aad-4888-817b-d30541dee348 tempest-KeyPairsV22TestJSON-1733237097 tempest-KeyPairsV22TestJSON-1733237097-project] 10.222.0.58 "GET /compute/v2.1/os-keypairs" status: 200 len: 370 microversion: 2.2 time: 0.015211 Aug 10 23:09:25.733474 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1557/3009] 10.222.0.58 () {60 vars in 1177 bytes} [Wed Aug 10 23:09:25 2022] GET /compute/v2.1/os-keypairs => generated 370 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:09:25.738465 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-7d66166f-02af-4b12-a8d9-98ec73990f21 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:09:25.739285 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-7d66166f-02af-4b12-a8d9-98ec73990f21 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] [instance: d09d04b1-bc37-4290-873e-ce2adae19eaf] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:09:25.747037 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7d66166f-02af-4b12-a8d9-98ec73990f21 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:25.747521 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7d66166f-02af-4b12-a8d9-98ec73990f21 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:25.747954 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7d66166f-02af-4b12-a8d9-98ec73990f21 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:25.748658 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7d66166f-02af-4b12-a8d9-98ec73990f21 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:25.749104 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7d66166f-02af-4b12-a8d9-98ec73990f21 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:25.749523 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7d66166f-02af-4b12-a8d9-98ec73990f21 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:25.785129 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f70bf060-fd94-49d2-ba8d-279372f83b46 tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Releasing lock "refresh_cache-61e7db28-1e60-444a-b6c0-dd65ef3f5a6b" {{(pid=122632) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 10 23:09:25.785691 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-f70bf060-fd94-49d2-ba8d-279372f83b46 tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] HTTP exception thrown: floating IP not found Aug 10 23:09:25.788388 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-f70bf060-fd94-49d2-ba8d-279372f83b46 tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Request method failure captured: Aug 10 23:09:25.788388 n-d-850468-14 devstack@n-api.service[122632]: request: POST /compute/v2.1/servers/61e7db28-1e60-444a-b6c0-dd65ef3f5a6b/action HTTP/1.1 Aug 10 23:09:25.788388 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:09:25.788388 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:09:25.788388 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:09:25.788388 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 41 Aug 10 23:09:25.788388 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:09:25.788388 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:09:25.788388 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:09:25.788388 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:09:25.788388 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9DpyFta3vOC37XpWrOYeYI8WRURapgf9D1TVPTeiZCPP7bJ6dAEgSW5sr5rDDfzvHGfKPR_6zSaQ6Sg3UuNHumb-U4KLrw_PO-OPVMXucIvyvRb3lYadGDmmqm1c9Lpb_T_BUbmnNb_gdjHtUgRAPzKm9OslTBkkgLXABt1EJFhNgpE Aug 10 23:09:25.788388 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:09:25.788388 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:09:25.788388 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:09:25.788388 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:09:25.788388 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:09:25.788388 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:09:25.788388 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 8e4512070fb74a32a9203526a025914e Aug 10 23:09:25.788388 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-272238324 Aug 10 23:09:25.788388 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:09:25.788388 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:09:25.788388 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8e4512070fb74a32a9203526a025914e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8e4512070fb74a32a9203526a025914e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/8e4512070fb74a32a9203526a025914e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_8e4512070fb74a32a9203526a025914e", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:09:25.788388 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-272238324 Aug 10 23:09:25.788388 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 8e4512070fb74a32a9203526a025914e Aug 10 23:09:25.788388 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-272238324 Aug 10 23:09:25.788388 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project Aug 10 23:09:25.788388 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:09:25.788388 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:09:25.788388 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: ca20e8ce3e25491fbe58f97ac5b9250a Aug 10 23:09:25.788388 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project Aug 10 23:09:25.788388 n-d-850468-14 devstack@n-api.service[122632]: Aug 10 23:09:25.788388 n-d-850468-14 devstack@n-api.service[122632]: {"addFloatingIp": {"address": "0.0.0.0"}} Aug 10 23:09:25.788388 n-d-850468-14 devstack@n-api.service[122632]: method: Aug 10 23:09:25.788388 n-d-850468-14 devstack@n-api.service[122632]: exception: floating IP not found Aug 10 23:09:25.788388 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': '61e7db28-1e60-444a-b6c0-dd65ef3f5a6b', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Aug 10 23:09:25.788388 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:09:25.788388 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:09:25.788388 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Aug 10 23:09:25.788388 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Aug 10 23:09:25.788388 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 166, in wrapper Aug 10 23:09:25.788388 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Aug 10 23:09:25.788388 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2702, in associate_floating_ip Aug 10 23:09:25.788388 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Aug 10 23:09:25.788388 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3014, in _get_floating_ip_by_address Aug 10 23:09:25.788388 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Aug 10 23:09:25.788388 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Aug 10 23:09:25.788388 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:09:25.788388 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:09:25.788388 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:09:25.788388 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:09:25.788388 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:09:25.788388 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:09:25.788388 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:09:25.788388 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:09:25.788388 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 23:09:25.788388 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 23:09:25.788388 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:09:25.788388 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:09:25.788388 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 23:09:25.788388 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 23:09:25.788388 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Aug 10 23:09:25.788388 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 10 23:09:25.788388 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Aug 10 23:09:25.788388 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:09:25.795445 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:09:25.795445 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:09:25.795445 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:09:25.795445 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:09:25.795445 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:09:25.795445 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:09:25.795445 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:09:25.795445 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Aug 10 23:09:25.795445 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:09:25.795445 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-f70bf060-fd94-49d2-ba8d-279372f83b46 tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Returning 404 to user: floating IP not found {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:09:25.795445 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-f70bf060-fd94-49d2-ba8d-279372f83b46 tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] 10.222.0.58 "POST /compute/v2.1/servers/61e7db28-1e60-444a-b6c0-dd65ef3f5a6b/action" status: 404 len: 67 microversion: 2.1 time: 0.253277 Aug 10 23:09:25.795445 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1453/3010] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:09:25 2022] POST /compute/v2.1/servers/61e7db28-1e60-444a-b6c0-dd65ef3f5a6b/action => generated 67 bytes in 254 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 10 23:09:25.795445 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-312adf2e-271e-4f78-b550-495c8cab776a tempest-KeyPairsV22TestJSON-1733237097 tempest-KeyPairsV22TestJSON-1733237097-project] Calling method '.version_select at 0x7f847d0ce820>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:09:25.815489 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-312adf2e-271e-4f78-b550-495c8cab776a tempest-KeyPairsV22TestJSON-1733237097 tempest-KeyPairsV22TestJSON-1733237097-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1672789766" status: 204 len: 0 microversion: 2.2 time: 0.023602 Aug 10 23:09:25.816341 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1454/3011] 10.222.0.58 () {60 vars in 1261 bytes} [Wed Aug 10 23:09:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1672789766 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:09:25.824149 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-ac8f285f-3911-4cc1-8e8d-81cd54af6098 tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:09:25.898413 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-7d66166f-02af-4b12-a8d9-98ec73990f21 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bbb4f184e4409d9eed51e0b98dfb29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708f8d4c4ed6432d85e0bf6a9bac7677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:09:25.906201 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-7d66166f-02af-4b12-a8d9-98ec73990f21 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] 10.222.0.58 "GET /compute/v2.1/servers/d09d04b1-bc37-4290-873e-ce2adae19eaf" status: 200 len: 1529 microversion: 2.1 time: 0.171603 Aug 10 23:09:25.906797 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1558/3012] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:09:25 2022] GET /compute/v2.1/servers/d09d04b1-bc37-4290-873e-ce2adae19eaf => generated 1529 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:09:25.911585 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-b8025bd7-4eef-474f-8e86-0268ecee6b3e tempest-KeyPairsV22TestJSON-1733237097 tempest-KeyPairsV22TestJSON-1733237097-project] Action: 'create', calling method: .version_select at 0x7f847c55f550>, body: {"keypair": {"name": "tempest-keypair-475554047", "type": "x509"}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:09:25.927940 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-b8025bd7-4eef-474f-8e86-0268ecee6b3e tempest-KeyPairsV22TestJSON-1733237097 tempest-KeyPairsV22TestJSON-1733237097-project] Getting quotas for project 2d273ce09fa34616b5a9b4f5edea6f13. Resources: {'key_pairs'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:09:25.931062 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-ac8f285f-3911-4cc1-8e8d-81cd54af6098 tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Aug 10 23:09:25.933843 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-b8025bd7-4eef-474f-8e86-0268ecee6b3e tempest-KeyPairsV22TestJSON-1733237097 tempest-KeyPairsV22TestJSON-1733237097-project] Getting quotas for user a9b04960b669465983ee87a114e09c5d and project 2d273ce09fa34616b5a9b4f5edea6f13. Resources: {'key_pairs'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:09:25.934009 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-ac8f285f-3911-4cc1-8e8d-81cd54af6098 tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Request method failure captured: Aug 10 23:09:25.934009 n-d-850468-14 devstack@n-api.service[122632]: request: POST /compute/v2.1/servers/61e7db28-1e60-444a-b6c0-dd65ef3f5a6b/action HTTP/1.1 Aug 10 23:09:25.934009 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:09:25.934009 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:09:25.934009 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:09:25.934009 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 44 Aug 10 23:09:25.934009 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:09:25.934009 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:09:25.934009 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:09:25.934009 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:09:25.934009 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9DpyFta3vOC37XpWrOYeYI8WRURapgf9D1TVPTeiZCPP7bJ6dAEgSW5sr5rDDfzvHGfKPR_6zSaQ6Sg3UuNHumb-U4KLrw_PO-OPVMXucIvyvRb3lYadGDmmqm1c9Lpb_T_BUbmnNb_gdjHtUgRAPzKm9OslTBkkgLXABt1EJFhNgpE Aug 10 23:09:25.934009 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:09:25.934009 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:09:25.934009 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:09:25.934009 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:09:25.934009 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:09:25.934009 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:09:25.934009 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 8e4512070fb74a32a9203526a025914e Aug 10 23:09:25.934009 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-272238324 Aug 10 23:09:25.934009 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:09:25.934009 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:09:25.934009 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8e4512070fb74a32a9203526a025914e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8e4512070fb74a32a9203526a025914e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/8e4512070fb74a32a9203526a025914e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_8e4512070fb74a32a9203526a025914e", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:09:25.934009 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-272238324 Aug 10 23:09:25.934009 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 8e4512070fb74a32a9203526a025914e Aug 10 23:09:25.934009 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-272238324 Aug 10 23:09:25.934009 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project Aug 10 23:09:25.934009 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:09:25.934009 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:09:25.934009 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: ca20e8ce3e25491fbe58f97ac5b9250a Aug 10 23:09:25.934009 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project Aug 10 23:09:25.934009 n-d-850468-14 devstack@n-api.service[122632]: Aug 10 23:09:25.934009 n-d-850468-14 devstack@n-api.service[122632]: {"removeFloatingIp": {"address": "0.0.0.0"}} Aug 10 23:09:25.934009 n-d-850468-14 devstack@n-api.service[122632]: method: Aug 10 23:09:25.934009 n-d-850468-14 devstack@n-api.service[122632]: exception: Floating IP not found for address 0.0.0.0. Aug 10 23:09:25.934009 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': '61e7db28-1e60-444a-b6c0-dd65ef3f5a6b', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Aug 10 23:09:25.934009 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:09:25.934009 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:09:25.934009 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Aug 10 23:09:25.934009 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Aug 10 23:09:25.934009 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2930, in get_instance_id_by_floating_address Aug 10 23:09:25.934009 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Aug 10 23:09:25.934009 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3014, in _get_floating_ip_by_address Aug 10 23:09:25.934009 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Aug 10 23:09:25.934009 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Aug 10 23:09:25.934009 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:09:25.934009 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:09:25.934009 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:09:25.934009 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:09:25.934009 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:09:25.934009 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:09:25.934009 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:09:25.934009 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:09:25.934009 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 23:09:25.934009 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 23:09:25.934009 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:09:25.934009 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:09:25.934009 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 23:09:25.934009 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 23:09:25.934009 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Aug 10 23:09:25.934009 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Aug 10 23:09:25.934009 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Aug 10 23:09:25.934009 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Aug 10 23:09:25.939804 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Aug 10 23:09:25.939804 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:09:25.939804 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:09:25.939804 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:09:25.939804 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:09:25.939804 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:09:25.939804 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:09:25.939804 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:09:25.939804 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:09:25.939804 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Aug 10 23:09:25.939804 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:09:25.939804 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-ac8f285f-3911-4cc1-8e8d-81cd54af6098 tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:09:25.941383 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-ac8f285f-3911-4cc1-8e8d-81cd54af6098 tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] 10.222.0.58 "POST /compute/v2.1/servers/61e7db28-1e60-444a-b6c0-dd65ef3f5a6b/action" status: 404 len: 88 microversion: 2.1 time: 0.124025 Aug 10 23:09:25.943997 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1455/3013] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:09:25 2022] POST /compute/v2.1/servers/61e7db28-1e60-444a-b6c0-dd65ef3f5a6b/action => generated 88 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 10 23:09:25.952500 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.processutils [None req-b8025bd7-4eef-474f-8e86-0268ecee6b3e tempest-KeyPairsV22TestJSON-1733237097 tempest-KeyPairsV22TestJSON-1733237097-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmpfh0owhgv/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpfh0owhgv/temp.key -subj /CN=a9b04960b669465983ee87a114e09c5d -extensions v3_req_client {{(pid=122633) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Aug 10 23:09:25.954110 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-15505da2-0190-46d3-84fb-21759b1bb0a7 tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:09:25.954594 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-15505da2-0190-46d3-84fb-21759b1bb0a7 tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] [instance: 61e7db28-1e60-444a-b6c0-dd65ef3f5a6b] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:09:25.961974 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-15505da2-0190-46d3-84fb-21759b1bb0a7 tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:25.962579 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-15505da2-0190-46d3-84fb-21759b1bb0a7 tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:25.963122 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-15505da2-0190-46d3-84fb-21759b1bb0a7 tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:25.963924 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-15505da2-0190-46d3-84fb-21759b1bb0a7 tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:25.964480 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-15505da2-0190-46d3-84fb-21759b1bb0a7 tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:25.964995 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-15505da2-0190-46d3-84fb-21759b1bb0a7 tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:25.991491 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-15505da2-0190-46d3-84fb-21759b1bb0a7 tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] [instance: 61e7db28-1e60-444a-b6c0-dd65ef3f5a6b] Going to try to terminate instance {{(pid=122632) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:09:26.082714 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-15505da2-0190-46d3-84fb-21759b1bb0a7 tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] 10.222.0.58 "DELETE /compute/v2.1/servers/61e7db28-1e60-444a-b6c0-dd65ef3f5a6b" status: 204 len: 0 microversion: 2.1 time: 0.132397 Aug 10 23:09:26.092279 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1456/3014] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:09:25 2022] DELETE /compute/v2.1/servers/61e7db28-1e60-444a-b6c0-dd65ef3f5a6b => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 10 23:09:26.111011 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-bfea7b0f-8bb8-48b6-abd2-971dd08c781b tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:09:26.111784 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-bfea7b0f-8bb8-48b6-abd2-971dd08c781b tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] [instance: 61e7db28-1e60-444a-b6c0-dd65ef3f5a6b] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:09:26.123795 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bfea7b0f-8bb8-48b6-abd2-971dd08c781b tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:26.124292 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bfea7b0f-8bb8-48b6-abd2-971dd08c781b tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:26.124920 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bfea7b0f-8bb8-48b6-abd2-971dd08c781b tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:26.128955 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bfea7b0f-8bb8-48b6-abd2-971dd08c781b tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:26.129625 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bfea7b0f-8bb8-48b6-abd2-971dd08c781b tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:26.130802 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bfea7b0f-8bb8-48b6-abd2-971dd08c781b tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:26.151292 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=4,nova_cell1:INSERT=3,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:09:26.364130 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.processutils [None req-b8025bd7-4eef-474f-8e86-0268ecee6b3e tempest-KeyPairsV22TestJSON-1733237097 tempest-KeyPairsV22TestJSON-1733237097-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmpfh0owhgv/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpfh0owhgv/temp.key -subj /CN=a9b04960b669465983ee87a114e09c5d -extensions v3_req_client" returned: 0 in 0.411s {{(pid=122633) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Aug 10 23:09:26.367208 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.processutils [None req-b8025bd7-4eef-474f-8e86-0268ecee6b3e tempest-KeyPairsV22TestJSON-1733237097 tempest-KeyPairsV22TestJSON-1733237097-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmpfh0owhgv/temp.key -password pass: {{(pid=122633) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Aug 10 23:09:26.411815 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.processutils [None req-b8025bd7-4eef-474f-8e86-0268ecee6b3e tempest-KeyPairsV22TestJSON-1733237097 tempest-KeyPairsV22TestJSON-1733237097-project] CMD "openssl pkcs12 -export -inkey /tmp/tmpfh0owhgv/temp.key -password pass:" returned: 0 in 0.044s {{(pid=122633) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Aug 10 23:09:26.484086 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-b8025bd7-4eef-474f-8e86-0268ecee6b3e tempest-KeyPairsV22TestJSON-1733237097 tempest-KeyPairsV22TestJSON-1733237097-project] Getting quotas for project 2d273ce09fa34616b5a9b4f5edea6f13. Resources: {'key_pairs'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:09:26.503706 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-b8025bd7-4eef-474f-8e86-0268ecee6b3e tempest-KeyPairsV22TestJSON-1733237097 tempest-KeyPairsV22TestJSON-1733237097-project] Getting quotas for user a9b04960b669465983ee87a114e09c5d and project 2d273ce09fa34616b5a9b4f5edea6f13. Resources: {'key_pairs'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:09:26.548828 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-b8025bd7-4eef-474f-8e86-0268ecee6b3e tempest-KeyPairsV22TestJSON-1733237097 tempest-KeyPairsV22TestJSON-1733237097-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 201 len: 4692 microversion: 2.2 time: 0.640898 Aug 10 23:09:26.555756 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1559/3015] 10.222.0.58 () {62 vars in 1198 bytes} [Wed Aug 10 23:09:25 2022] POST /compute/v2.1/os-keypairs => generated 4692 bytes in 648 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:09:26.575667 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-3f9f9b10-3fd7-4149-8662-6613836ebbef tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:09:26.576865 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-3f9f9b10-3fd7-4149-8662-6613836ebbef tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] [instance: 3fae69e0-e5f3-4ce8-89b5-5d0a410b7be1] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:09:26.595312 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3f9f9b10-3fd7-4149-8662-6613836ebbef tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:26.598505 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3f9f9b10-3fd7-4149-8662-6613836ebbef tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:26.599600 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3f9f9b10-3fd7-4149-8662-6613836ebbef tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:26.605686 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3f9f9b10-3fd7-4149-8662-6613836ebbef tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:26.606292 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3f9f9b10-3fd7-4149-8662-6613836ebbef tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:26.606772 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3f9f9b10-3fd7-4149-8662-6613836ebbef tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:26.742499 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-3f9f9b10-3fd7-4149-8662-6613836ebbef tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7caa911d519e4711bf9a251b04ebe8dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ad554e982ff483098acf8a3b58e3842', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:09:26.755591 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-3f9f9b10-3fd7-4149-8662-6613836ebbef tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] 10.222.0.58 "GET /compute/v2.1/servers/3fae69e0-e5f3-4ce8-89b5-5d0a410b7be1" status: 200 len: 1483 microversion: 2.1 time: 0.197208 Aug 10 23:09:26.775379 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1560/3016] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:09:26 2022] GET /compute/v2.1/servers/3fae69e0-e5f3-4ce8-89b5-5d0a410b7be1 => generated 1483 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:09:26.783376 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-7a501334-fdfc-42fe-b6ff-e4836b660c40 tempest-KeyPairsV22TestJSON-1733237097 tempest-KeyPairsV22TestJSON-1733237097-project] Calling method '.version_select at 0x7f847d3c0670>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:09:26.796838 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-7a501334-fdfc-42fe-b6ff-e4836b660c40 tempest-KeyPairsV22TestJSON-1733237097 tempest-KeyPairsV22TestJSON-1733237097-project] 10.222.0.58 "GET /compute/v2.1/os-keypairs/tempest-keypair-475554047" status: 200 len: 1533 microversion: 2.2 time: 0.019899 Aug 10 23:09:26.798017 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1561/3017] 10.222.0.58 () {60 vars in 1255 bytes} [Wed Aug 10 23:09:26 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-475554047 => generated 1533 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:09:26.808168 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-d418e000-1aa4-4f14-b543-779c828c4fda tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:09:26.808963 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-d418e000-1aa4-4f14-b543-779c828c4fda tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] [instance: 6bdca10c-38e0-4605-9a5d-002c6333b81f] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:09:26.817055 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d418e000-1aa4-4f14-b543-779c828c4fda tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:26.818607 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d418e000-1aa4-4f14-b543-779c828c4fda tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:26.823435 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d418e000-1aa4-4f14-b543-779c828c4fda tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:26.824419 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d418e000-1aa4-4f14-b543-779c828c4fda tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:26.824926 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d418e000-1aa4-4f14-b543-779c828c4fda tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:26.825381 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d418e000-1aa4-4f14-b543-779c828c4fda tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:27.087010 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-bfea7b0f-8bb8-48b6-abd2-971dd08c781b tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca20e8ce3e25491fbe58f97ac5b9250a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e4512070fb74a32a9203526a025914e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:09:27.096794 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-bfea7b0f-8bb8-48b6-abd2-971dd08c781b tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] 10.222.0.58 "GET /compute/v2.1/servers/61e7db28-1e60-444a-b6c0-dd65ef3f5a6b" status: 200 len: 1543 microversion: 2.1 time: 0.991416 Aug 10 23:09:27.100750 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1457/3018] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:09:26 2022] GET /compute/v2.1/servers/61e7db28-1e60-444a-b6c0-dd65ef3f5a6b => generated 1543 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:09:27.105745 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-178acb36-3953-4224-add7-801136d8a649 tempest-KeyPairsV22TestJSON-1733237097 tempest-KeyPairsV22TestJSON-1733237097-project] Calling method '.version_select at 0x7f847d5ea160>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:09:27.112935 n-d-850468-14 devstack@n-api.service[122632]: WARNING oslo_db.sqlalchemy.utils [None req-178acb36-3953-4224-add7-801136d8a649 tempest-KeyPairsV22TestJSON-1733237097 tempest-KeyPairsV22TestJSON-1733237097-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 10 23:09:27.119437 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-178acb36-3953-4224-add7-801136d8a649 tempest-KeyPairsV22TestJSON-1733237097 tempest-KeyPairsV22TestJSON-1733237097-project] 10.222.0.58 "GET /compute/v2.1/os-keypairs" status: 200 len: 1390 microversion: 2.2 time: 0.017350 Aug 10 23:09:27.120026 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1458/3019] 10.222.0.58 () {60 vars in 1177 bytes} [Wed Aug 10 23:09:27 2022] GET /compute/v2.1/os-keypairs => generated 1390 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:09:27.129578 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-b932c8e0-2b40-4578-b1e3-b338cff3e1cc tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:09:27.131045 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-b932c8e0-2b40-4578-b1e3-b338cff3e1cc tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] [instance: d09d04b1-bc37-4290-873e-ce2adae19eaf] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:09:27.137561 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b932c8e0-2b40-4578-b1e3-b338cff3e1cc tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:27.138185 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b932c8e0-2b40-4578-b1e3-b338cff3e1cc tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:27.138629 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b932c8e0-2b40-4578-b1e3-b338cff3e1cc tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:27.139566 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b932c8e0-2b40-4578-b1e3-b338cff3e1cc tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:27.140022 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b932c8e0-2b40-4578-b1e3-b338cff3e1cc tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:27.140447 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b932c8e0-2b40-4578-b1e3-b338cff3e1cc tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:27.200155 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-d418e000-1aa4-4f14-b543-779c828c4fda tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca7d06f2acb44558d405a3b35a59550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7f70700e035444c9f2c9fa491c5c41a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:09:27.213038 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-d418e000-1aa4-4f14-b543-779c828c4fda tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] 10.222.0.58 "GET /compute/v2.1/servers/6bdca10c-38e0-4605-9a5d-002c6333b81f" status: 200 len: 1318 microversion: 2.1 time: 0.413215 Aug 10 23:09:27.213657 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1562/3020] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:09:26 2022] GET /compute/v2.1/servers/6bdca10c-38e0-4605-9a5d-002c6333b81f => generated 1318 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:09:27.221671 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-76d7e32b-6a5d-42e8-b6db-1f9764923041 tempest-KeyPairsV22TestJSON-1733237097 tempest-KeyPairsV22TestJSON-1733237097-project] Calling method '.version_select at 0x7f847d3de820>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:09:27.267338 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-76d7e32b-6a5d-42e8-b6db-1f9764923041 tempest-KeyPairsV22TestJSON-1733237097 tempest-KeyPairsV22TestJSON-1733237097-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-475554047" status: 204 len: 0 microversion: 2.2 time: 0.052505 Aug 10 23:09:27.268468 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1563/3021] 10.222.0.58 () {60 vars in 1258 bytes} [Wed Aug 10 23:09:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-475554047 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:09:27.273885 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-eb114a47-1b55-4279-9d0c-e6427ea3353c req-364b461a-fb6b-4c89-aacc-2db38685afdc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fae69e0-e5f3-4ce8-89b5-5d0a410b7be1", "name": "network-vif-deleted", "tag": "da2ce90a-71d7-4814-80a4-becf56274e9d"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:09:27.295694 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-eb114a47-1b55-4279-9d0c-e6427ea3353c req-364b461a-fb6b-4c89-aacc-2db38685afdc service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:27.298026 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-eb114a47-1b55-4279-9d0c-e6427ea3353c req-364b461a-fb6b-4c89-aacc-2db38685afdc service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:27.304223 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-eb114a47-1b55-4279-9d0c-e6427ea3353c req-364b461a-fb6b-4c89-aacc-2db38685afdc service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:27.319609 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-eb114a47-1b55-4279-9d0c-e6427ea3353c req-364b461a-fb6b-4c89-aacc-2db38685afdc service nova] Creating event network-vif-deleted:da2ce90a-71d7-4814-80a4-becf56274e9d for instance 3fae69e0-e5f3-4ce8-89b5-5d0a410b7be1 on n-h2-850468-14 Aug 10 23:09:27.331578 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-eb114a47-1b55-4279-9d0c-e6427ea3353c req-364b461a-fb6b-4c89-aacc-2db38685afdc service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061984 Aug 10 23:09:27.334697 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1564/3022] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:09:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:09:27.530677 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-b932c8e0-2b40-4578-b1e3-b338cff3e1cc tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bbb4f184e4409d9eed51e0b98dfb29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708f8d4c4ed6432d85e0bf6a9bac7677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:09:27.541961 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-b932c8e0-2b40-4578-b1e3-b338cff3e1cc tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] 10.222.0.58 "GET /compute/v2.1/servers/d09d04b1-bc37-4290-873e-ce2adae19eaf" status: 200 len: 1529 microversion: 2.1 time: 0.417697 Aug 10 23:09:27.543303 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1459/3023] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:09:27 2022] GET /compute/v2.1/servers/d09d04b1-bc37-4290-873e-ce2adae19eaf => generated 1529 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:09:27.783849 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-ef6b73fb-407f-41e1-af0b-fd0ff5512b00 tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:09:27.785425 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-ef6b73fb-407f-41e1-af0b-fd0ff5512b00 tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] [instance: 3fae69e0-e5f3-4ce8-89b5-5d0a410b7be1] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:09:27.798773 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ef6b73fb-407f-41e1-af0b-fd0ff5512b00 tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:27.799292 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ef6b73fb-407f-41e1-af0b-fd0ff5512b00 tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:27.802962 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ef6b73fb-407f-41e1-af0b-fd0ff5512b00 tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:27.806069 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ef6b73fb-407f-41e1-af0b-fd0ff5512b00 tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:27.806565 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ef6b73fb-407f-41e1-af0b-fd0ff5512b00 tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:27.807036 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ef6b73fb-407f-41e1-af0b-fd0ff5512b00 tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:27.844292 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-ef6b73fb-407f-41e1-af0b-fd0ff5512b00 tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] HTTP exception thrown: Instance 3fae69e0-e5f3-4ce8-89b5-5d0a410b7be1 could not be found. Aug 10 23:09:27.846452 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-ef6b73fb-407f-41e1-af0b-fd0ff5512b00 tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] Request method failure captured: Aug 10 23:09:27.846452 n-d-850468-14 devstack@n-api.service[122633]: request: GET /compute/v2.1/servers/3fae69e0-e5f3-4ce8-89b5-5d0a410b7be1 HTTP/1.1 Aug 10 23:09:27.846452 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:09:27.846452 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:09:27.846452 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:09:27.846452 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:09:27.846452 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:09:27.846452 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:09:27.846452 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:09:27.846452 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:09:27.846452 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9Dp-a7pZDXsTpf_JTfgkxwnAaESKCIDrR-PKNvSl4WdjMRZc7Q5fZMNMGxwgl3FE-oEkYYpW_CzsON1kv9C7WGJ_kqrpdRzZCsNREfFaZCNdwGSHaOszgZwYcFIIH2XFUlYjLM4TeKVATI4II8ubMmjcsdXbFkULYtMtD1ucA07mDjI Aug 10 23:09:27.846452 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:09:27.846452 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:09:27.846452 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:09:27.846452 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:09:27.846452 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:09:27.846452 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:09:27.846452 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 7ad554e982ff483098acf8a3b58e3842 Aug 10 23:09:27.846452 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-384625613 Aug 10 23:09:27.846452 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:09:27.846452 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:09:27.846452 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7ad554e982ff483098acf8a3b58e3842"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7ad554e982ff483098acf8a3b58e3842"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7ad554e982ff483098acf8a3b58e3842"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7ad554e982ff483098acf8a3b58e3842", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:09:27.846452 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-384625613 Aug 10 23:09:27.846452 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 7ad554e982ff483098acf8a3b58e3842 Aug 10 23:09:27.846452 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-384625613 Aug 10 23:09:27.846452 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-ServerMetadataNegativeTestJSON-384625613-project Aug 10 23:09:27.846452 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:09:27.846452 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:09:27.846452 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 7caa911d519e4711bf9a251b04ebe8dd Aug 10 23:09:27.846452 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-384625613-project Aug 10 23:09:27.846452 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:09:27.846452 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance 3fae69e0-e5f3-4ce8-89b5-5d0a410b7be1 could not be found. Aug 10 23:09:27.846452 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': '3fae69e0-e5f3-4ce8-89b5-5d0a410b7be1'} Aug 10 23:09:27.846452 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:09:27.846452 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:09:27.846452 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:09:27.846452 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:09:27.846452 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:09:27.846452 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:09:27.846452 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:09:27.846452 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:09:27.846452 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:09:27.846452 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:09:27.846452 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3fae69e0-e5f3-4ce8-89b5-5d0a410b7be1 could not be found. Aug 10 23:09:27.846452 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:09:27.846452 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:09:27.846452 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:09:27.846452 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:09:27.846452 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:09:27.846452 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:09:27.846452 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:09:27.846452 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:09:27.846452 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:09:27.846452 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:09:27.846452 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:09:27.846452 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:09:27.846452 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:09:27.846452 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:09:27.846452 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:09:27.846452 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:09:27.846452 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3fae69e0-e5f3-4ce8-89b5-5d0a410b7be1 could not be found. Aug 10 23:09:27.846452 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:09:27.846452 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:09:27.851960 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:09:27.851960 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:09:27.851960 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:09:27.851960 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:09:27.851960 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:09:27.851960 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:09:27.851960 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3fae69e0-e5f3-4ce8-89b5-5d0a410b7be1 could not be found. Aug 10 23:09:27.851960 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:09:27.851960 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-ef6b73fb-407f-41e1-af0b-fd0ff5512b00 tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] Returning 404 to user: Instance 3fae69e0-e5f3-4ce8-89b5-5d0a410b7be1 could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:09:27.851960 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-ef6b73fb-407f-41e1-af0b-fd0ff5512b00 tempest-ServerMetadataNegativeTestJSON-384625613 tempest-ServerMetadataNegativeTestJSON-384625613-project] 10.222.0.58 "GET /compute/v2.1/servers/3fae69e0-e5f3-4ce8-89b5-5d0a410b7be1" status: 404 len: 111 microversion: 2.1 time: 0.071333 Aug 10 23:09:27.851960 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1565/3024] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:09:27 2022] GET /compute/v2.1/servers/3fae69e0-e5f3-4ce8-89b5-5d0a410b7be1 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:09:28.062054 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-f7580cfc-8541-4f5c-a317-317f09daa918 req-eb4ab73c-55c7-46e6-837b-7029d517d02d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06ec3e8e-9e4f-4a9b-8fa7-679d71c3dbf0", "tag": "c79f1e7c-00d5-41f0-a252-affa5dad3c5c"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:09:28.075361 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=4 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:09:28.084538 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-f7580cfc-8541-4f5c-a317-317f09daa918 req-eb4ab73c-55c7-46e6-837b-7029d517d02d service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:28.086932 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-f7580cfc-8541-4f5c-a317-317f09daa918 req-eb4ab73c-55c7-46e6-837b-7029d517d02d service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:28.088805 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-f7580cfc-8541-4f5c-a317-317f09daa918 req-eb4ab73c-55c7-46e6-837b-7029d517d02d service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:28.119370 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-f7580cfc-8541-4f5c-a317-317f09daa918 req-eb4ab73c-55c7-46e6-837b-7029d517d02d service nova] Creating event network-changed:c79f1e7c-00d5-41f0-a252-affa5dad3c5c for instance 06ec3e8e-9e4f-4a9b-8fa7-679d71c3dbf0 on n-h2-850468-14 Aug 10 23:09:28.123825 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-b50ae46f-91b1-45ae-89ab-b70c620745fd tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:09:28.124691 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-b50ae46f-91b1-45ae-89ab-b70c620745fd tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] [instance: 61e7db28-1e60-444a-b6c0-dd65ef3f5a6b] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:09:28.134881 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-f7580cfc-8541-4f5c-a317-317f09daa918 req-eb4ab73c-55c7-46e6-837b-7029d517d02d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075427 Aug 10 23:09:28.136246 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1460/3025] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:09:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:09:28.138268 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b50ae46f-91b1-45ae-89ab-b70c620745fd tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:28.141154 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b50ae46f-91b1-45ae-89ab-b70c620745fd tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:28.141802 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b50ae46f-91b1-45ae-89ab-b70c620745fd tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:28.143130 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b50ae46f-91b1-45ae-89ab-b70c620745fd tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:28.145347 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b50ae46f-91b1-45ae-89ab-b70c620745fd tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:28.148706 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b50ae46f-91b1-45ae-89ab-b70c620745fd tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:28.242377 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-4987413e-d806-4239-8348-b7b489b6b962 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:09:28.243245 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-4987413e-d806-4239-8348-b7b489b6b962 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] [instance: 6bdca10c-38e0-4605-9a5d-002c6333b81f] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:09:28.257306 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4987413e-d806-4239-8348-b7b489b6b962 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:28.260511 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4987413e-d806-4239-8348-b7b489b6b962 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:28.263697 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4987413e-d806-4239-8348-b7b489b6b962 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:28.264834 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4987413e-d806-4239-8348-b7b489b6b962 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:28.265573 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4987413e-d806-4239-8348-b7b489b6b962 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:28.266952 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4987413e-d806-4239-8348-b7b489b6b962 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:29.373759 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-4987413e-d806-4239-8348-b7b489b6b962 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca7d06f2acb44558d405a3b35a59550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7f70700e035444c9f2c9fa491c5c41a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:09:29.388003 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-4987413e-d806-4239-8348-b7b489b6b962 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] 10.222.0.58 "GET /compute/v2.1/servers/6bdca10c-38e0-4605-9a5d-002c6333b81f" status: 200 len: 1318 microversion: 2.1 time: 1.157892 Aug 10 23:09:29.389117 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1461/3026] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:09:28 2022] GET /compute/v2.1/servers/6bdca10c-38e0-4605-9a5d-002c6333b81f => generated 1318 bytes in 1160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:09:29.394508 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-0cd60213-4fe5-412e-80a9-fc99079cde0c tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:09:29.395314 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-0cd60213-4fe5-412e-80a9-fc99079cde0c tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] [instance: d09d04b1-bc37-4290-873e-ce2adae19eaf] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:09:29.405032 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0cd60213-4fe5-412e-80a9-fc99079cde0c tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:29.405852 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0cd60213-4fe5-412e-80a9-fc99079cde0c tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:29.418473 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0cd60213-4fe5-412e-80a9-fc99079cde0c tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:29.419993 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0cd60213-4fe5-412e-80a9-fc99079cde0c tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:29.421296 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0cd60213-4fe5-412e-80a9-fc99079cde0c tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:29.421909 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0cd60213-4fe5-412e-80a9-fc99079cde0c tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:29.530482 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-b50ae46f-91b1-45ae-89ab-b70c620745fd tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca20e8ce3e25491fbe58f97ac5b9250a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e4512070fb74a32a9203526a025914e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:09:29.575967 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-b50ae46f-91b1-45ae-89ab-b70c620745fd tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] 10.222.0.58 "GET /compute/v2.1/servers/61e7db28-1e60-444a-b6c0-dd65ef3f5a6b" status: 200 len: 1543 microversion: 2.1 time: 1.456553 Aug 10 23:09:29.583242 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1566/3027] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:09:28 2022] GET /compute/v2.1/servers/61e7db28-1e60-444a-b6c0-dd65ef3f5a6b => generated 1543 bytes in 1464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:09:29.594897 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-6d414d5d-fd92-4c48-9b2b-61798998b907 req-de45c14d-bcbe-4e54-b875-13e2eed78b6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d09d04b1-bc37-4290-873e-ce2adae19eaf", "name": "network-vif-unplugged", "status": "completed", "tag": "7c24b140-f5ee-4079-a313-c307f5d3865b"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:09:29.615068 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-6d414d5d-fd92-4c48-9b2b-61798998b907 req-de45c14d-bcbe-4e54-b875-13e2eed78b6b service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:29.616465 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-6d414d5d-fd92-4c48-9b2b-61798998b907 req-de45c14d-bcbe-4e54-b875-13e2eed78b6b service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:29.618719 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-6d414d5d-fd92-4c48-9b2b-61798998b907 req-de45c14d-bcbe-4e54-b875-13e2eed78b6b service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:29.645502 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-6d414d5d-fd92-4c48-9b2b-61798998b907 req-de45c14d-bcbe-4e54-b875-13e2eed78b6b service nova] Creating event network-vif-unplugged:7c24b140-f5ee-4079-a313-c307f5d3865b for instance d09d04b1-bc37-4290-873e-ce2adae19eaf on n-h1-850468-14 Aug 10 23:09:29.658095 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-6d414d5d-fd92-4c48-9b2b-61798998b907 req-de45c14d-bcbe-4e54-b875-13e2eed78b6b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.073043 Aug 10 23:09:29.658716 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1567/3028] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:09:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:09:30.134010 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-0cd60213-4fe5-412e-80a9-fc99079cde0c tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bbb4f184e4409d9eed51e0b98dfb29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708f8d4c4ed6432d85e0bf6a9bac7677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:09:30.152195 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-0cd60213-4fe5-412e-80a9-fc99079cde0c tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] 10.222.0.58 "GET /compute/v2.1/servers/d09d04b1-bc37-4290-873e-ce2adae19eaf" status: 200 len: 1529 microversion: 2.1 time: 0.761618 Aug 10 23:09:30.152939 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1462/3029] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:09:29 2022] GET /compute/v2.1/servers/d09d04b1-bc37-4290-873e-ce2adae19eaf => generated 1529 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:09:30.411562 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c70f5991-6af6-4a3c-992e-c652b4ca4bc0 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:09:30.413454 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-c70f5991-6af6-4a3c-992e-c652b4ca4bc0 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] [instance: 6bdca10c-38e0-4605-9a5d-002c6333b81f] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:09:30.440964 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c70f5991-6af6-4a3c-992e-c652b4ca4bc0 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:30.446654 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c70f5991-6af6-4a3c-992e-c652b4ca4bc0 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:30.447384 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c70f5991-6af6-4a3c-992e-c652b4ca4bc0 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:30.448298 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c70f5991-6af6-4a3c-992e-c652b4ca4bc0 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:30.454808 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-f684b4ef-cc80-4443-b1ab-f34f5bbc46af req-3f8bb82c-b97c-4127-8647-9ec5de211c19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d09d04b1-bc37-4290-873e-ce2adae19eaf", "name": "network-vif-deleted", "tag": "7c24b140-f5ee-4079-a313-c307f5d3865b"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:09:30.455967 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c70f5991-6af6-4a3c-992e-c652b4ca4bc0 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:30.456743 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c70f5991-6af6-4a3c-992e-c652b4ca4bc0 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:30.486478 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-f684b4ef-cc80-4443-b1ab-f34f5bbc46af req-3f8bb82c-b97c-4127-8647-9ec5de211c19 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:30.488775 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-f684b4ef-cc80-4443-b1ab-f34f5bbc46af req-3f8bb82c-b97c-4127-8647-9ec5de211c19 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:30.490745 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-f684b4ef-cc80-4443-b1ab-f34f5bbc46af req-3f8bb82c-b97c-4127-8647-9ec5de211c19 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:30.524381 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-f684b4ef-cc80-4443-b1ab-f34f5bbc46af req-3f8bb82c-b97c-4127-8647-9ec5de211c19 service nova] Creating event network-vif-deleted:7c24b140-f5ee-4079-a313-c307f5d3865b for instance d09d04b1-bc37-4290-873e-ce2adae19eaf on n-h1-850468-14 Aug 10 23:09:30.548744 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-f684b4ef-cc80-4443-b1ab-f34f5bbc46af req-3f8bb82c-b97c-4127-8647-9ec5de211c19 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098763 Aug 10 23:09:30.552058 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1463/3030] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:09:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:09:30.598457 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-000d913e-a001-4b47-a0cb-5b2e2eaadc91 tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:09:30.601172 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-000d913e-a001-4b47-a0cb-5b2e2eaadc91 tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] [instance: 61e7db28-1e60-444a-b6c0-dd65ef3f5a6b] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:09:30.611580 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-000d913e-a001-4b47-a0cb-5b2e2eaadc91 tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:30.614150 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-000d913e-a001-4b47-a0cb-5b2e2eaadc91 tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:30.615202 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-000d913e-a001-4b47-a0cb-5b2e2eaadc91 tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:30.618496 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-000d913e-a001-4b47-a0cb-5b2e2eaadc91 tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:30.619224 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-000d913e-a001-4b47-a0cb-5b2e2eaadc91 tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:30.619911 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-000d913e-a001-4b47-a0cb-5b2e2eaadc91 tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:30.954228 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-000d913e-a001-4b47-a0cb-5b2e2eaadc91 tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca20e8ce3e25491fbe58f97ac5b9250a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8e4512070fb74a32a9203526a025914e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:09:30.963419 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-000d913e-a001-4b47-a0cb-5b2e2eaadc91 tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] 10.222.0.58 "GET /compute/v2.1/servers/61e7db28-1e60-444a-b6c0-dd65ef3f5a6b" status: 200 len: 1501 microversion: 2.1 time: 0.369432 Aug 10 23:09:30.971054 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1464/3031] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:09:30 2022] GET /compute/v2.1/servers/61e7db28-1e60-444a-b6c0-dd65ef3f5a6b => generated 1501 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:09:31.023096 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-17eddb58-0ba9-4ee8-86cc-1ebc98d877d7 req-9797fe33-c215-4d10-8d51-5cbcf5144011 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61e7db28-1e60-444a-b6c0-dd65ef3f5a6b", "name": "network-vif-deleted", "tag": "993de175-c53f-4b4e-a8ba-348ecebfaf8f"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:09:31.063099 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-17eddb58-0ba9-4ee8-86cc-1ebc98d877d7 req-9797fe33-c215-4d10-8d51-5cbcf5144011 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:31.063646 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-17eddb58-0ba9-4ee8-86cc-1ebc98d877d7 req-9797fe33-c215-4d10-8d51-5cbcf5144011 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:31.064087 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-17eddb58-0ba9-4ee8-86cc-1ebc98d877d7 req-9797fe33-c215-4d10-8d51-5cbcf5144011 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:31.086284 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=4 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:09:31.120902 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-17eddb58-0ba9-4ee8-86cc-1ebc98d877d7 req-9797fe33-c215-4d10-8d51-5cbcf5144011 service nova] Creating event network-vif-deleted:993de175-c53f-4b4e-a8ba-348ecebfaf8f for instance 61e7db28-1e60-444a-b6c0-dd65ef3f5a6b on n-h1-850468-14 Aug 10 23:09:31.136268 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-c70f5991-6af6-4a3c-992e-c652b4ca4bc0 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca7d06f2acb44558d405a3b35a59550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7f70700e035444c9f2c9fa491c5c41a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:09:31.150455 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-17eddb58-0ba9-4ee8-86cc-1ebc98d877d7 req-9797fe33-c215-4d10-8d51-5cbcf5144011 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131429 Aug 10 23:09:31.152271 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1465/3032] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:09:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:09:31.152780 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-c70f5991-6af6-4a3c-992e-c652b4ca4bc0 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] 10.222.0.58 "GET /compute/v2.1/servers/6bdca10c-38e0-4605-9a5d-002c6333b81f" status: 200 len: 1318 microversion: 2.1 time: 0.745204 Aug 10 23:09:31.170927 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1568/3033] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:09:30 2022] GET /compute/v2.1/servers/6bdca10c-38e0-4605-9a5d-002c6333b81f => generated 1318 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:09:31.179846 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-68217830-66e7-4640-8930-c2f285c219de tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:09:31.180665 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-68217830-66e7-4640-8930-c2f285c219de tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] [instance: d09d04b1-bc37-4290-873e-ce2adae19eaf] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:09:31.195748 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-68217830-66e7-4640-8930-c2f285c219de tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:31.198273 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-68217830-66e7-4640-8930-c2f285c219de tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:31.200302 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-68217830-66e7-4640-8930-c2f285c219de tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:31.201718 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-68217830-66e7-4640-8930-c2f285c219de tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:31.205825 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-68217830-66e7-4640-8930-c2f285c219de tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:31.208185 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-68217830-66e7-4640-8930-c2f285c219de tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:31.308321 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-68217830-66e7-4640-8930-c2f285c219de tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:31.309495 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-68217830-66e7-4640-8930-c2f285c219de tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:31.309495 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-68217830-66e7-4640-8930-c2f285c219de tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:31.309965 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.objects.instance [None req-68217830-66e7-4640-8930-c2f285c219de tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lazy-loading 'fault' on Instance uuid d09d04b1-bc37-4290-873e-ce2adae19eaf {{(pid=122632) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:09:31.479913 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-68217830-66e7-4640-8930-c2f285c219de tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bbb4f184e4409d9eed51e0b98dfb29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708f8d4c4ed6432d85e0bf6a9bac7677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:09:31.488897 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-68217830-66e7-4640-8930-c2f285c219de tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] 10.222.0.58 "GET /compute/v2.1/servers/d09d04b1-bc37-4290-873e-ce2adae19eaf" status: 200 len: 1315 microversion: 2.1 time: 0.314746 Aug 10 23:09:31.511065 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1466/3034] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:09:31 2022] GET /compute/v2.1/servers/d09d04b1-bc37-4290-873e-ce2adae19eaf => generated 1315 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:09:31.540383 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-8978024a-2697-43c1-b302-e644d32b5bea tempest-AbsoluteLimitsTestJSON-1743795402 tempest-AbsoluteLimitsTestJSON-1743795402-project] Calling method '.version_select at 0x7f847d2958b0>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:09:31.560135 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8978024a-2697-43c1-b302-e644d32b5bea tempest-AbsoluteLimitsTestJSON-1743795402 tempest-AbsoluteLimitsTestJSON-1743795402-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:31.561060 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8978024a-2697-43c1-b302-e644d32b5bea tempest-AbsoluteLimitsTestJSON-1743795402 tempest-AbsoluteLimitsTestJSON-1743795402-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:31.561731 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8978024a-2697-43c1-b302-e644d32b5bea tempest-AbsoluteLimitsTestJSON-1743795402 tempest-AbsoluteLimitsTestJSON-1743795402-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:31.562697 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8978024a-2697-43c1-b302-e644d32b5bea tempest-AbsoluteLimitsTestJSON-1743795402 tempest-AbsoluteLimitsTestJSON-1743795402-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:31.563357 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8978024a-2697-43c1-b302-e644d32b5bea tempest-AbsoluteLimitsTestJSON-1743795402 tempest-AbsoluteLimitsTestJSON-1743795402-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:31.563962 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8978024a-2697-43c1-b302-e644d32b5bea tempest-AbsoluteLimitsTestJSON-1743795402 tempest-AbsoluteLimitsTestJSON-1743795402-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:31.596847 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-8978024a-2697-43c1-b302-e644d32b5bea tempest-AbsoluteLimitsTestJSON-1743795402 tempest-AbsoluteLimitsTestJSON-1743795402-project] 10.222.0.58 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.361806 Aug 10 23:09:31.598511 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1569/3035] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 10 23:09:31 2022] GET /compute/v2.1/limits => generated 511 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 23:09:32.001815 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-596be5f2-fd7f-4cab-8025-5592477be8e4 tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:09:32.005591 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-596be5f2-fd7f-4cab-8025-5592477be8e4 tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] [instance: 61e7db28-1e60-444a-b6c0-dd65ef3f5a6b] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:09:32.039469 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-596be5f2-fd7f-4cab-8025-5592477be8e4 tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:32.042335 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-596be5f2-fd7f-4cab-8025-5592477be8e4 tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:32.043714 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-596be5f2-fd7f-4cab-8025-5592477be8e4 tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:32.046125 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-596be5f2-fd7f-4cab-8025-5592477be8e4 tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:32.047448 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-596be5f2-fd7f-4cab-8025-5592477be8e4 tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:32.048262 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-596be5f2-fd7f-4cab-8025-5592477be8e4 tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:32.071945 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-596be5f2-fd7f-4cab-8025-5592477be8e4 tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] HTTP exception thrown: Instance 61e7db28-1e60-444a-b6c0-dd65ef3f5a6b could not be found. Aug 10 23:09:32.073785 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-596be5f2-fd7f-4cab-8025-5592477be8e4 tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Request method failure captured: Aug 10 23:09:32.073785 n-d-850468-14 devstack@n-api.service[122632]: request: GET /compute/v2.1/servers/61e7db28-1e60-444a-b6c0-dd65ef3f5a6b HTTP/1.1 Aug 10 23:09:32.073785 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:09:32.073785 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:09:32.073785 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:09:32.073785 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 23:09:32.073785 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:09:32.073785 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:09:32.073785 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:09:32.073785 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:09:32.073785 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9DpyFta3vOC37XpWrOYeYI8WRURapgf9D1TVPTeiZCPP7bJ6dAEgSW5sr5rDDfzvHGfKPR_6zSaQ6Sg3UuNHumb-U4KLrw_PO-OPVMXucIvyvRb3lYadGDmmqm1c9Lpb_T_BUbmnNb_gdjHtUgRAPzKm9OslTBkkgLXABt1EJFhNgpE Aug 10 23:09:32.073785 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:09:32.073785 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:09:32.073785 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:09:32.073785 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:09:32.073785 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:09:32.073785 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:09:32.073785 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 8e4512070fb74a32a9203526a025914e Aug 10 23:09:32.073785 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-272238324 Aug 10 23:09:32.073785 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:09:32.073785 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:09:32.073785 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8e4512070fb74a32a9203526a025914e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/8e4512070fb74a32a9203526a025914e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/8e4512070fb74a32a9203526a025914e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_8e4512070fb74a32a9203526a025914e", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:09:32.073785 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-272238324 Aug 10 23:09:32.073785 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 8e4512070fb74a32a9203526a025914e Aug 10 23:09:32.073785 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-272238324 Aug 10 23:09:32.073785 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project Aug 10 23:09:32.073785 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:09:32.073785 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:09:32.073785 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: ca20e8ce3e25491fbe58f97ac5b9250a Aug 10 23:09:32.073785 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project Aug 10 23:09:32.073785 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:09:32.073785 n-d-850468-14 devstack@n-api.service[122632]: exception: Instance 61e7db28-1e60-444a-b6c0-dd65ef3f5a6b could not be found. Aug 10 23:09:32.073785 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': '61e7db28-1e60-444a-b6c0-dd65ef3f5a6b'} Aug 10 23:09:32.073785 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:09:32.073785 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:09:32.073785 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:09:32.073785 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:09:32.073785 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:09:32.073785 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:09:32.073785 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:09:32.073785 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:09:32.073785 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:09:32.073785 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:09:32.073785 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 61e7db28-1e60-444a-b6c0-dd65ef3f5a6b could not be found. Aug 10 23:09:32.073785 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:09:32.073785 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:09:32.073785 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:09:32.073785 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:09:32.073785 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:09:32.073785 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:09:32.073785 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:09:32.073785 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:09:32.073785 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:09:32.073785 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:09:32.073785 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:09:32.073785 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:09:32.073785 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:09:32.073785 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:09:32.073785 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:09:32.073785 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:09:32.073785 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 61e7db28-1e60-444a-b6c0-dd65ef3f5a6b could not be found. Aug 10 23:09:32.073785 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:09:32.077729 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:09:32.077729 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:09:32.077729 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:09:32.077729 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:09:32.077729 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:09:32.077729 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:09:32.077729 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:09:32.077729 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 61e7db28-1e60-444a-b6c0-dd65ef3f5a6b could not be found. Aug 10 23:09:32.077729 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:09:32.080131 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-596be5f2-fd7f-4cab-8025-5592477be8e4 tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] Returning 404 to user: Instance 61e7db28-1e60-444a-b6c0-dd65ef3f5a6b could not be found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:09:32.081265 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-596be5f2-fd7f-4cab-8025-5592477be8e4 tempest-FloatingIPsAssociationNegativeTestJSON-272238324 tempest-FloatingIPsAssociationNegativeTestJSON-272238324-project] 10.222.0.58 "GET /compute/v2.1/servers/61e7db28-1e60-444a-b6c0-dd65ef3f5a6b" status: 404 len: 111 microversion: 2.1 time: 0.090324 Aug 10 23:09:32.082697 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1467/3036] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:09:31 2022] GET /compute/v2.1/servers/61e7db28-1e60-444a-b6c0-dd65ef3f5a6b => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:09:32.213882 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-8adc7aaa-43a8-4cd2-a90a-5fd7066f73f3 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:09:32.215089 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-8adc7aaa-43a8-4cd2-a90a-5fd7066f73f3 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] [instance: 6bdca10c-38e0-4605-9a5d-002c6333b81f] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:09:32.226571 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8adc7aaa-43a8-4cd2-a90a-5fd7066f73f3 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:32.228044 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8adc7aaa-43a8-4cd2-a90a-5fd7066f73f3 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:32.228779 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8adc7aaa-43a8-4cd2-a90a-5fd7066f73f3 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:32.229773 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8adc7aaa-43a8-4cd2-a90a-5fd7066f73f3 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:32.230461 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8adc7aaa-43a8-4cd2-a90a-5fd7066f73f3 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:32.235232 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8adc7aaa-43a8-4cd2-a90a-5fd7066f73f3 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:32.520899 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-f3ccb285-5419-4a8e-8e40-696ccf17a4d6 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:09:32.521719 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-f3ccb285-5419-4a8e-8e40-696ccf17a4d6 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] [instance: d09d04b1-bc37-4290-873e-ce2adae19eaf] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:09:32.531623 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f3ccb285-5419-4a8e-8e40-696ccf17a4d6 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:32.535894 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f3ccb285-5419-4a8e-8e40-696ccf17a4d6 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:32.538365 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f3ccb285-5419-4a8e-8e40-696ccf17a4d6 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:32.540621 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f3ccb285-5419-4a8e-8e40-696ccf17a4d6 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:32.541813 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f3ccb285-5419-4a8e-8e40-696ccf17a4d6 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:32.542926 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f3ccb285-5419-4a8e-8e40-696ccf17a4d6 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:32.589445 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-f3ccb285-5419-4a8e-8e40-696ccf17a4d6 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] HTTP exception thrown: Instance d09d04b1-bc37-4290-873e-ce2adae19eaf could not be found. Aug 10 23:09:32.592408 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-f3ccb285-5419-4a8e-8e40-696ccf17a4d6 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Request method failure captured: Aug 10 23:09:32.592408 n-d-850468-14 devstack@n-api.service[122632]: request: GET /compute/v2.1/servers/d09d04b1-bc37-4290-873e-ce2adae19eaf HTTP/1.1 Aug 10 23:09:32.592408 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:09:32.592408 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:09:32.592408 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:09:32.592408 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 23:09:32.592408 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:09:32.592408 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:09:32.592408 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:09:32.592408 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:09:32.592408 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9Do81XwGOyJYZzjDqBUm67v_Q0362_4xQUvU3HvIWmFkKXGTToH86-ip4fxXuu0oxmkucX-Et277q0Z5R4ChTe5MWC8zJ89hWAklZmH6m-N_CAseQK0eUiUfLbiJpjdB2S78hj0EntCCqH4mBVhce2-q9auCyId7qlhsdrU7MIxxCSQ Aug 10 23:09:32.592408 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:09:32.592408 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:09:32.592408 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:09:32.592408 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:09:32.592408 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:09:32.592408 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:09:32.592408 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 708f8d4c4ed6432d85e0bf6a9bac7677 Aug 10 23:09:32.592408 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2080454436 Aug 10 23:09:32.592408 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:09:32.592408 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:09:32.592408 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/708f8d4c4ed6432d85e0bf6a9bac7677"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/708f8d4c4ed6432d85e0bf6a9bac7677"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/708f8d4c4ed6432d85e0bf6a9bac7677"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_708f8d4c4ed6432d85e0bf6a9bac7677", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:09:32.592408 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2080454436 Aug 10 23:09:32.592408 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 708f8d4c4ed6432d85e0bf6a9bac7677 Aug 10 23:09:32.592408 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2080454436 Aug 10 23:09:32.592408 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-ImagesOneServerNegativeTestJSON-2080454436-project Aug 10 23:09:32.592408 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:09:32.592408 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:09:32.592408 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: 55bbb4f184e4409d9eed51e0b98dfb29 Aug 10 23:09:32.592408 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2080454436-project Aug 10 23:09:32.592408 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:09:32.592408 n-d-850468-14 devstack@n-api.service[122632]: exception: Instance d09d04b1-bc37-4290-873e-ce2adae19eaf could not be found. Aug 10 23:09:32.592408 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': 'd09d04b1-bc37-4290-873e-ce2adae19eaf'} Aug 10 23:09:32.592408 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:09:32.592408 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:09:32.592408 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:09:32.592408 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:09:32.592408 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:09:32.592408 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:09:32.592408 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:09:32.592408 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:09:32.592408 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:09:32.592408 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:09:32.592408 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d09d04b1-bc37-4290-873e-ce2adae19eaf could not be found. Aug 10 23:09:32.592408 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:09:32.592408 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:09:32.592408 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:09:32.592408 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:09:32.592408 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:09:32.592408 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:09:32.592408 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:09:32.592408 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:09:32.592408 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:09:32.592408 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:09:32.592408 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:09:32.592408 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:09:32.592408 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:09:32.592408 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:09:32.592408 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:09:32.592408 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:09:32.592408 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d09d04b1-bc37-4290-873e-ce2adae19eaf could not be found. Aug 10 23:09:32.592408 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:09:32.592408 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:09:32.596670 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:09:32.596670 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:09:32.596670 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:09:32.596670 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:09:32.596670 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:09:32.596670 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:09:32.596670 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d09d04b1-bc37-4290-873e-ce2adae19eaf could not be found. Aug 10 23:09:32.596670 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:09:32.599282 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-f3ccb285-5419-4a8e-8e40-696ccf17a4d6 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Returning 404 to user: Instance d09d04b1-bc37-4290-873e-ce2adae19eaf could not be found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:09:32.607066 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-f3ccb285-5419-4a8e-8e40-696ccf17a4d6 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] 10.222.0.58 "GET /compute/v2.1/servers/d09d04b1-bc37-4290-873e-ce2adae19eaf" status: 404 len: 111 microversion: 2.1 time: 0.083832 Aug 10 23:09:32.607780 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1468/3037] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:09:32 2022] GET /compute/v2.1/servers/d09d04b1-bc37-4290-873e-ce2adae19eaf => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:09:32.798812 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-4e56b952-06bc-4472-b25a-5adb9c47de4f tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1217908687", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:09:32.899091 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.network.neutron [None req-4e56b952-06bc-4472-b25a-5adb9c47de4f tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] validate_networks() for [('a39e9883-f478-46d6-a0c8-5018e7a936ff', None, None, None, None, None)] {{(pid=122632) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 23:09:32.947131 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-8adc7aaa-43a8-4cd2-a90a-5fd7066f73f3 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca7d06f2acb44558d405a3b35a59550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7f70700e035444c9f2c9fa491c5c41a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:09:32.967954 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-8adc7aaa-43a8-4cd2-a90a-5fd7066f73f3 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] 10.222.0.58 "GET /compute/v2.1/servers/6bdca10c-38e0-4605-9a5d-002c6333b81f" status: 200 len: 1318 microversion: 2.1 time: 0.767988 Aug 10 23:09:32.977041 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1570/3038] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:09:32 2022] GET /compute/v2.1/servers/6bdca10c-38e0-4605-9a5d-002c6333b81f => generated 1318 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:09:33.212053 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-5f6b87b6-04cb-42ae-a119-08ab5be7fa94 req-e988526a-d759-4524-befe-33316c1a144b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6bdca10c-38e0-4605-9a5d-002c6333b81f", "tag": "5f5ede08-dd5a-4e1e-a317-9b09504f4ac8"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:09:33.226979 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-5f6b87b6-04cb-42ae-a119-08ab5be7fa94 req-e988526a-d759-4524-befe-33316c1a144b service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:33.228460 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-5f6b87b6-04cb-42ae-a119-08ab5be7fa94 req-e988526a-d759-4524-befe-33316c1a144b service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:33.229111 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-5f6b87b6-04cb-42ae-a119-08ab5be7fa94 req-e988526a-d759-4524-befe-33316c1a144b service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:33.254669 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-5f6b87b6-04cb-42ae-a119-08ab5be7fa94 req-e988526a-d759-4524-befe-33316c1a144b service nova] Creating event network-changed:5f5ede08-dd5a-4e1e-a317-9b09504f4ac8 for instance 6bdca10c-38e0-4605-9a5d-002c6333b81f on n-h1-850468-14 Aug 10 23:09:33.278295 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-5f6b87b6-04cb-42ae-a119-08ab5be7fa94 req-e988526a-d759-4524-befe-33316c1a144b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063033 Aug 10 23:09:33.279617 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1571/3039] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:09:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 23:09:33.990747 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-9c49e4e8-1e13-4211-8fce-895dbe73a414 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:09:33.991417 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-9c49e4e8-1e13-4211-8fce-895dbe73a414 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] [instance: 6bdca10c-38e0-4605-9a5d-002c6333b81f] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:09:34.016453 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9c49e4e8-1e13-4211-8fce-895dbe73a414 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:34.016975 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9c49e4e8-1e13-4211-8fce-895dbe73a414 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:34.017427 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9c49e4e8-1e13-4211-8fce-895dbe73a414 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:34.018164 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9c49e4e8-1e13-4211-8fce-895dbe73a414 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:34.021561 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9c49e4e8-1e13-4211-8fce-895dbe73a414 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:34.022110 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9c49e4e8-1e13-4211-8fce-895dbe73a414 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:34.889936 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-4e56b952-06bc-4472-b25a-5adb9c47de4f tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Flavor limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:09:34.890443 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-4e56b952-06bc-4472-b25a-5adb9c47de4f tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Image limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:09:34.891002 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-4e56b952-06bc-4472-b25a-5adb9c47de4f tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Flavor pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:09:34.891908 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-4e56b952-06bc-4472-b25a-5adb9c47de4f tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Image pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:09:34.892329 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-4e56b952-06bc-4472-b25a-5adb9c47de4f tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:09:34.914850 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4e56b952-06bc-4472-b25a-5adb9c47de4f tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:34.916761 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4e56b952-06bc-4472-b25a-5adb9c47de4f tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:34.919634 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4e56b952-06bc-4472-b25a-5adb9c47de4f tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:34.923793 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4e56b952-06bc-4472-b25a-5adb9c47de4f tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:34.926241 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4e56b952-06bc-4472-b25a-5adb9c47de4f tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:34.934658 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4e56b952-06bc-4472-b25a-5adb9c47de4f tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:35.008537 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-4e56b952-06bc-4472-b25a-5adb9c47de4f tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Getting quotas for project 708f8d4c4ed6432d85e0bf6a9bac7677. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:09:35.017023 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-4e56b952-06bc-4472-b25a-5adb9c47de4f tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Getting quotas for user 55bbb4f184e4409d9eed51e0b98dfb29 and project 708f8d4c4ed6432d85e0bf6a9bac7677. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:09:35.037804 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-4e56b952-06bc-4472-b25a-5adb9c47de4f tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Going to run 1 instances... {{(pid=122632) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 23:09:35.040994 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-4e56b952-06bc-4472-b25a-5adb9c47de4f tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] [instance: 0e60179f-fe8f-48a7-aeb1-9e114e148708] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78ad8905-f66f-4733-8be9-2b260f1fabed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122632) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 23:09:35.047170 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-9c49e4e8-1e13-4211-8fce-895dbe73a414 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca7d06f2acb44558d405a3b35a59550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7f70700e035444c9f2c9fa491c5c41a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:09:35.056658 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-9c49e4e8-1e13-4211-8fce-895dbe73a414 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] 10.222.0.58 "GET /compute/v2.1/servers/6bdca10c-38e0-4605-9a5d-002c6333b81f" status: 200 len: 1318 microversion: 2.1 time: 1.070804 Aug 10 23:09:35.064006 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1572/3040] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:09:33 2022] GET /compute/v2.1/servers/6bdca10c-38e0-4605-9a5d-002c6333b81f => generated 1318 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:09:35.200218 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-4e56b952-06bc-4472-b25a-5adb9c47de4f tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.404943 Aug 10 23:09:35.207692 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1469/3041] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 23:09:32 2022] POST /compute/v2.1/servers => generated 383 bytes in 2414 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 23:09:35.222771 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-398a4770-9064-45e2-927e-034a6eef271a tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:09:35.223826 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-398a4770-9064-45e2-927e-034a6eef271a tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] [instance: 0e60179f-fe8f-48a7-aeb1-9e114e148708] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:09:35.469192 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-398a4770-9064-45e2-927e-034a6eef271a tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bbb4f184e4409d9eed51e0b98dfb29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708f8d4c4ed6432d85e0bf6a9bac7677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:09:35.480189 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-398a4770-9064-45e2-927e-034a6eef271a tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] 10.222.0.58 "GET /compute/v2.1/servers/0e60179f-fe8f-48a7-aeb1-9e114e148708" status: 200 len: 1225 microversion: 2.1 time: 0.270046 Aug 10 23:09:35.483577 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1573/3042] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:09:35 2022] GET /compute/v2.1/servers/0e60179f-fe8f-48a7-aeb1-9e114e148708 => generated 1225 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:09:36.093968 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-ca557a23-8121-4a04-acbc-29d006495e89 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:09:36.095986 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-ca557a23-8121-4a04-acbc-29d006495e89 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] [instance: 6bdca10c-38e0-4605-9a5d-002c6333b81f] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:09:36.127802 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ca557a23-8121-4a04-acbc-29d006495e89 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:36.129031 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ca557a23-8121-4a04-acbc-29d006495e89 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:36.130776 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ca557a23-8121-4a04-acbc-29d006495e89 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:36.132462 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ca557a23-8121-4a04-acbc-29d006495e89 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:36.137488 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ca557a23-8121-4a04-acbc-29d006495e89 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:36.138309 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ca557a23-8121-4a04-acbc-29d006495e89 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:36.509081 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c6166e6f-c4ea-4db9-8ca9-560991ded343 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:09:36.510315 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-c6166e6f-c4ea-4db9-8ca9-560991ded343 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] [instance: 0e60179f-fe8f-48a7-aeb1-9e114e148708] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:09:36.531681 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-ca557a23-8121-4a04-acbc-29d006495e89 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca7d06f2acb44558d405a3b35a59550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7f70700e035444c9f2c9fa491c5c41a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:09:36.542663 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-ca557a23-8121-4a04-acbc-29d006495e89 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] 10.222.0.58 "GET /compute/v2.1/servers/6bdca10c-38e0-4605-9a5d-002c6333b81f" status: 200 len: 1318 microversion: 2.1 time: 0.454813 Aug 10 23:09:36.558901 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1470/3043] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:09:36 2022] GET /compute/v2.1/servers/6bdca10c-38e0-4605-9a5d-002c6333b81f => generated 1318 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:09:36.559097 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c6166e6f-c4ea-4db9-8ca9-560991ded343 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:36.559097 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c6166e6f-c4ea-4db9-8ca9-560991ded343 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:36.559531 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c6166e6f-c4ea-4db9-8ca9-560991ded343 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:36.560645 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c6166e6f-c4ea-4db9-8ca9-560991ded343 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:36.566179 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c6166e6f-c4ea-4db9-8ca9-560991ded343 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:36.570187 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c6166e6f-c4ea-4db9-8ca9-560991ded343 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:36.943240 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-c6166e6f-c4ea-4db9-8ca9-560991ded343 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bbb4f184e4409d9eed51e0b98dfb29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708f8d4c4ed6432d85e0bf6a9bac7677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:09:36.957665 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-c6166e6f-c4ea-4db9-8ca9-560991ded343 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] 10.222.0.58 "GET /compute/v2.1/servers/0e60179f-fe8f-48a7-aeb1-9e114e148708" status: 200 len: 1221 microversion: 2.1 time: 0.455218 Aug 10 23:09:36.960064 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1574/3044] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:09:36 2022] GET /compute/v2.1/servers/0e60179f-fe8f-48a7-aeb1-9e114e148708 => generated 1221 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:09:37.125473 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-4e09b511-b403-488d-b36a-2fd6ae26b0cc req-a814400d-cb7a-470b-b682-a0ecd13851a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06ec3e8e-9e4f-4a9b-8fa7-679d71c3dbf0", "name": "network-vif-plugged", "status": "completed", "tag": "c79f1e7c-00d5-41f0-a252-affa5dad3c5c"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:09:37.133976 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-4e09b511-b403-488d-b36a-2fd6ae26b0cc req-a814400d-cb7a-470b-b682-a0ecd13851a1 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:37.134712 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-4e09b511-b403-488d-b36a-2fd6ae26b0cc req-a814400d-cb7a-470b-b682-a0ecd13851a1 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:37.135670 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-4e09b511-b403-488d-b36a-2fd6ae26b0cc req-a814400d-cb7a-470b-b682-a0ecd13851a1 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:37.160647 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-4e09b511-b403-488d-b36a-2fd6ae26b0cc req-a814400d-cb7a-470b-b682-a0ecd13851a1 service nova] Creating event network-vif-plugged:c79f1e7c-00d5-41f0-a252-affa5dad3c5c for instance 06ec3e8e-9e4f-4a9b-8fa7-679d71c3dbf0 on n-h2-850468-14 Aug 10 23:09:37.170357 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-4e09b511-b403-488d-b36a-2fd6ae26b0cc req-a814400d-cb7a-470b-b682-a0ecd13851a1 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057747 Aug 10 23:09:37.175160 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1471/3045] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:09:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:09:37.524731 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c6166e6f-c4ea-4db9-8ca9-560991ded343 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:09:37.526697 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-c6166e6f-c4ea-4db9-8ca9-560991ded343 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] 10.222.0.58 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002350 Aug 10 23:09:37.527518 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1575/3046] 10.222.0.58 () {56 vars in 886 bytes} [Wed Aug 10 23:09:37 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 10 23:09:37.535257 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-4e09b511-b403-488d-b36a-2fd6ae26b0cc req-a814400d-cb7a-470b-b682-a0ecd13851a1 service nova] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:09:37.537063 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-4e09b511-b403-488d-b36a-2fd6ae26b0cc req-a814400d-cb7a-470b-b682-a0ecd13851a1 service nova] 10.222.0.58 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.002488 Aug 10 23:09:37.538023 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1472/3047] 10.222.0.58 () {54 vars in 1035 bytes} [Wed Aug 10 23:09:37 2022] GET /compute/v2/ => generated 379 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 221 bytes (1 switches on core 0) Aug 10 23:09:37.544856 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c6166e6f-c4ea-4db9-8ca9-560991ded343 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:09:37.546112 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-c6166e6f-c4ea-4db9-8ca9-560991ded343 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] 10.222.0.58 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001715 Aug 10 23:09:37.547014 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1576/3048] 10.222.0.58 () {54 vars in 1041 bytes} [Wed Aug 10 23:09:37 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:09:37.554714 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-4e09b511-b403-488d-b36a-2fd6ae26b0cc req-a814400d-cb7a-470b-b682-a0ecd13851a1 service nova] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:09:37.555965 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-4e09b511-b403-488d-b36a-2fd6ae26b0cc req-a814400d-cb7a-470b-b682-a0ecd13851a1 service nova] 10.222.0.58 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001598 Aug 10 23:09:37.556463 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1473/3049] 10.222.0.58 () {56 vars in 886 bytes} [Wed Aug 10 23:09:37 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 10 23:09:37.571575 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-0ce37078-d47b-4e70-ad7e-e43afdd2e87a tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:09:37.572378 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-0ce37078-d47b-4e70-ad7e-e43afdd2e87a tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] [instance: 6bdca10c-38e0-4605-9a5d-002c6333b81f] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:09:37.581994 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0ce37078-d47b-4e70-ad7e-e43afdd2e87a tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:37.583811 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0ce37078-d47b-4e70-ad7e-e43afdd2e87a tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:37.584488 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0ce37078-d47b-4e70-ad7e-e43afdd2e87a tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:37.585584 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0ce37078-d47b-4e70-ad7e-e43afdd2e87a tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:37.586263 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0ce37078-d47b-4e70-ad7e-e43afdd2e87a tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:37.587263 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0ce37078-d47b-4e70-ad7e-e43afdd2e87a tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:37.981266 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-86972b32-7542-4400-b778-49e8fb867536 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:09:37.982009 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-86972b32-7542-4400-b778-49e8fb867536 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] [instance: 0e60179f-fe8f-48a7-aeb1-9e114e148708] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:09:37.993887 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-86972b32-7542-4400-b778-49e8fb867536 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:37.994406 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-86972b32-7542-4400-b778-49e8fb867536 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:37.998947 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-86972b32-7542-4400-b778-49e8fb867536 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:37.999815 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-86972b32-7542-4400-b778-49e8fb867536 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:38.000301 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-86972b32-7542-4400-b778-49e8fb867536 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:38.000739 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-86972b32-7542-4400-b778-49e8fb867536 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:38.080619 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-0ce37078-d47b-4e70-ad7e-e43afdd2e87a tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca7d06f2acb44558d405a3b35a59550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7f70700e035444c9f2c9fa491c5c41a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:09:38.093155 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-0ce37078-d47b-4e70-ad7e-e43afdd2e87a tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] 10.222.0.58 "GET /compute/v2.1/servers/6bdca10c-38e0-4605-9a5d-002c6333b81f" status: 200 len: 1318 microversion: 2.1 time: 0.525585 Aug 10 23:09:38.101115 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1577/3050] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:09:37 2022] GET /compute/v2.1/servers/6bdca10c-38e0-4605-9a5d-002c6333b81f => generated 1318 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:09:38.171948 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-86972b32-7542-4400-b778-49e8fb867536 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bbb4f184e4409d9eed51e0b98dfb29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708f8d4c4ed6432d85e0bf6a9bac7677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:09:38.184824 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-86972b32-7542-4400-b778-49e8fb867536 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] 10.222.0.58 "GET /compute/v2.1/servers/0e60179f-fe8f-48a7-aeb1-9e114e148708" status: 200 len: 1283 microversion: 2.1 time: 0.208574 Aug 10 23:09:38.201573 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1474/3051] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:09:37 2022] GET /compute/v2.1/servers/0e60179f-fe8f-48a7-aeb1-9e114e148708 => generated 1283 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:09:39.117911 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-630ba198-a8d4-499d-bb7d-38b7fb6f4e54 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:09:39.119321 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-630ba198-a8d4-499d-bb7d-38b7fb6f4e54 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] [instance: 6bdca10c-38e0-4605-9a5d-002c6333b81f] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:09:39.132055 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-630ba198-a8d4-499d-bb7d-38b7fb6f4e54 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:39.133933 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-630ba198-a8d4-499d-bb7d-38b7fb6f4e54 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:39.134606 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-630ba198-a8d4-499d-bb7d-38b7fb6f4e54 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:39.137767 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-630ba198-a8d4-499d-bb7d-38b7fb6f4e54 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:39.140454 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-630ba198-a8d4-499d-bb7d-38b7fb6f4e54 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:39.142838 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-630ba198-a8d4-499d-bb7d-38b7fb6f4e54 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:39.210593 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-8ff73035-0e62-4468-a8b0-1f4b82b32639 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:09:39.211552 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-8ff73035-0e62-4468-a8b0-1f4b82b32639 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] [instance: 0e60179f-fe8f-48a7-aeb1-9e114e148708] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:09:39.225291 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8ff73035-0e62-4468-a8b0-1f4b82b32639 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:39.232020 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8ff73035-0e62-4468-a8b0-1f4b82b32639 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:39.232813 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8ff73035-0e62-4468-a8b0-1f4b82b32639 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:39.233779 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8ff73035-0e62-4468-a8b0-1f4b82b32639 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:39.234459 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8ff73035-0e62-4468-a8b0-1f4b82b32639 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:39.235162 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8ff73035-0e62-4468-a8b0-1f4b82b32639 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:39.933619 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-8ff73035-0e62-4468-a8b0-1f4b82b32639 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bbb4f184e4409d9eed51e0b98dfb29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708f8d4c4ed6432d85e0bf6a9bac7677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:09:39.952346 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-8ff73035-0e62-4468-a8b0-1f4b82b32639 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] 10.222.0.58 "GET /compute/v2.1/servers/0e60179f-fe8f-48a7-aeb1-9e114e148708" status: 200 len: 1325 microversion: 2.1 time: 0.739949 Aug 10 23:09:39.953043 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1475/3052] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:09:39 2022] GET /compute/v2.1/servers/0e60179f-fe8f-48a7-aeb1-9e114e148708 => generated 1325 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:09:39.958470 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-3c07f0dd-e723-468b-98c3-be278d0efbd3 req-d83f9fe1-7006-4d29-8867-928b6144136c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bdca10c-38e0-4605-9a5d-002c6333b81f", "name": "network-vif-plugged", "status": "completed", "tag": "5f5ede08-dd5a-4e1e-a317-9b09504f4ac8"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:09:39.981371 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-3c07f0dd-e723-468b-98c3-be278d0efbd3 req-d83f9fe1-7006-4d29-8867-928b6144136c service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:39.981826 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-3c07f0dd-e723-468b-98c3-be278d0efbd3 req-d83f9fe1-7006-4d29-8867-928b6144136c service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:39.982264 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-3c07f0dd-e723-468b-98c3-be278d0efbd3 req-d83f9fe1-7006-4d29-8867-928b6144136c service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:40.009220 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-3c07f0dd-e723-468b-98c3-be278d0efbd3 req-d83f9fe1-7006-4d29-8867-928b6144136c service nova] Creating event network-vif-plugged:5f5ede08-dd5a-4e1e-a317-9b09504f4ac8 for instance 6bdca10c-38e0-4605-9a5d-002c6333b81f on n-h1-850468-14 Aug 10 23:09:40.025663 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-3c07f0dd-e723-468b-98c3-be278d0efbd3 req-d83f9fe1-7006-4d29-8867-928b6144136c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070632 Aug 10 23:09:40.025663 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1476/3053] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:09:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:09:40.644842 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-630ba198-a8d4-499d-bb7d-38b7fb6f4e54 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca7d06f2acb44558d405a3b35a59550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7f70700e035444c9f2c9fa491c5c41a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:09:40.657106 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-630ba198-a8d4-499d-bb7d-38b7fb6f4e54 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] 10.222.0.58 "GET /compute/v2.1/servers/6bdca10c-38e0-4605-9a5d-002c6333b81f" status: 200 len: 1318 microversion: 2.1 time: 1.543385 Aug 10 23:09:40.657711 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1578/3054] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:09:39 2022] GET /compute/v2.1/servers/6bdca10c-38e0-4605-9a5d-002c6333b81f => generated 1318 bytes in 1545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:09:40.977284 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-be9eb709-168b-475e-b207-fead6507185b tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:09:40.978158 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-be9eb709-168b-475e-b207-fead6507185b tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] [instance: 0e60179f-fe8f-48a7-aeb1-9e114e148708] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:09:40.989423 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-be9eb709-168b-475e-b207-fead6507185b tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:40.989918 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-be9eb709-168b-475e-b207-fead6507185b tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:40.990362 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-be9eb709-168b-475e-b207-fead6507185b tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:40.991109 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-be9eb709-168b-475e-b207-fead6507185b tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:40.991566 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-be9eb709-168b-475e-b207-fead6507185b tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:40.991987 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-be9eb709-168b-475e-b207-fead6507185b tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:41.555978 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-6f1074ce-774a-4726-a22f-9da9ebf9e842 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:09:41.557045 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-6f1074ce-774a-4726-a22f-9da9ebf9e842 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] [instance: 23452b78-96cd-430d-b95c-aaa98a427d53] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:09:41.579379 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6f1074ce-774a-4726-a22f-9da9ebf9e842 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:41.582467 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6f1074ce-774a-4726-a22f-9da9ebf9e842 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:41.583521 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6f1074ce-774a-4726-a22f-9da9ebf9e842 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:41.585084 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6f1074ce-774a-4726-a22f-9da9ebf9e842 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:41.585737 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6f1074ce-774a-4726-a22f-9da9ebf9e842 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:41.587041 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6f1074ce-774a-4726-a22f-9da9ebf9e842 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:41.588648 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=2 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:09:41.637198 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-6f1074ce-774a-4726-a22f-9da9ebf9e842 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] 10.222.0.58 "GET /compute/v2.1/servers/23452b78-96cd-430d-b95c-aaa98a427d53/ips" status: 200 len: 146 microversion: 2.1 time: 0.590965 Aug 10 23:09:41.638649 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1579/3055] 10.222.0.58 () {58 vars in 1248 bytes} [Wed Aug 10 23:09:41 2022] GET /compute/v2.1/servers/23452b78-96cd-430d-b95c-aaa98a427d53/ips => generated 146 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:09:41.706915 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-b7a8a679-5077-41b7-ab38-871c531fea74 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:09:41.717960 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-b7a8a679-5077-41b7-ab38-871c531fea74 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] [instance: 6bdca10c-38e0-4605-9a5d-002c6333b81f] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:09:41.771911 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b7a8a679-5077-41b7-ab38-871c531fea74 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:41.773804 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b7a8a679-5077-41b7-ab38-871c531fea74 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:41.777140 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b7a8a679-5077-41b7-ab38-871c531fea74 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:41.779403 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b7a8a679-5077-41b7-ab38-871c531fea74 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:41.782922 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b7a8a679-5077-41b7-ab38-871c531fea74 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:41.784245 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b7a8a679-5077-41b7-ab38-871c531fea74 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:42.394574 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-b7a8a679-5077-41b7-ab38-871c531fea74 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca7d06f2acb44558d405a3b35a59550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7f70700e035444c9f2c9fa491c5c41a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:09:42.407630 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:09:42.420626 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-b7a8a679-5077-41b7-ab38-871c531fea74 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] 10.222.0.58 "GET /compute/v2.1/servers/6bdca10c-38e0-4605-9a5d-002c6333b81f" status: 200 len: 1318 microversion: 2.1 time: 0.741033 Aug 10 23:09:42.442494 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1580/3056] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:09:41 2022] GET /compute/v2.1/servers/6bdca10c-38e0-4605-9a5d-002c6333b81f => generated 1318 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:09:42.523926 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-be9eb709-168b-475e-b207-fead6507185b tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bbb4f184e4409d9eed51e0b98dfb29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708f8d4c4ed6432d85e0bf6a9bac7677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:09:42.562341 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-be9eb709-168b-475e-b207-fead6507185b tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] 10.222.0.58 "GET /compute/v2.1/servers/0e60179f-fe8f-48a7-aeb1-9e114e148708" status: 200 len: 1325 microversion: 2.1 time: 1.589432 Aug 10 23:09:42.568253 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1477/3057] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:09:40 2022] GET /compute/v2.1/servers/0e60179f-fe8f-48a7-aeb1-9e114e148708 => generated 1325 bytes in 1596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:09:43.446201 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-6a9a55f5-0aa7-406a-b372-b2bff91bf8b7 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:09:43.447749 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-6a9a55f5-0aa7-406a-b372-b2bff91bf8b7 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] [instance: 6bdca10c-38e0-4605-9a5d-002c6333b81f] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:09:43.480517 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6a9a55f5-0aa7-406a-b372-b2bff91bf8b7 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:43.484600 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6a9a55f5-0aa7-406a-b372-b2bff91bf8b7 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:43.485395 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6a9a55f5-0aa7-406a-b372-b2bff91bf8b7 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:43.493302 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6a9a55f5-0aa7-406a-b372-b2bff91bf8b7 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:43.495848 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6a9a55f5-0aa7-406a-b372-b2bff91bf8b7 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:43.497099 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6a9a55f5-0aa7-406a-b372-b2bff91bf8b7 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:43.595982 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-304afb72-9a30-47d7-aa7d-ae4c56368f94 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:09:43.596750 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-304afb72-9a30-47d7-aa7d-ae4c56368f94 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] [instance: 0e60179f-fe8f-48a7-aeb1-9e114e148708] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:09:43.616718 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-304afb72-9a30-47d7-aa7d-ae4c56368f94 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:43.623439 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-304afb72-9a30-47d7-aa7d-ae4c56368f94 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:43.624739 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-304afb72-9a30-47d7-aa7d-ae4c56368f94 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:43.628271 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-304afb72-9a30-47d7-aa7d-ae4c56368f94 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:43.628763 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-304afb72-9a30-47d7-aa7d-ae4c56368f94 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:43.629224 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-304afb72-9a30-47d7-aa7d-ae4c56368f94 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:43.915920 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-6a9a55f5-0aa7-406a-b372-b2bff91bf8b7 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca7d06f2acb44558d405a3b35a59550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7f70700e035444c9f2c9fa491c5c41a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:09:43.928341 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-6a9a55f5-0aa7-406a-b372-b2bff91bf8b7 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] 10.222.0.58 "GET /compute/v2.1/servers/6bdca10c-38e0-4605-9a5d-002c6333b81f" status: 200 len: 1507 microversion: 2.1 time: 0.481829 Aug 10 23:09:43.929020 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1581/3058] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:09:43 2022] GET /compute/v2.1/servers/6bdca10c-38e0-4605-9a5d-002c6333b81f => generated 1507 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:09:43.955706 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-3b49fec2-10e3-4db5-b2c1-f077743a8dd0 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:09:43.956351 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-3b49fec2-10e3-4db5-b2c1-f077743a8dd0 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] [instance: 06ec3e8e-9e4f-4a9b-8fa7-679d71c3dbf0] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:09:43.967301 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3b49fec2-10e3-4db5-b2c1-f077743a8dd0 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:43.967810 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3b49fec2-10e3-4db5-b2c1-f077743a8dd0 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:43.968572 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3b49fec2-10e3-4db5-b2c1-f077743a8dd0 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:43.969320 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3b49fec2-10e3-4db5-b2c1-f077743a8dd0 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:43.969788 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3b49fec2-10e3-4db5-b2c1-f077743a8dd0 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:43.970216 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3b49fec2-10e3-4db5-b2c1-f077743a8dd0 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:44.145804 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-304afb72-9a30-47d7-aa7d-ae4c56368f94 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bbb4f184e4409d9eed51e0b98dfb29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708f8d4c4ed6432d85e0bf6a9bac7677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:09:44.160058 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-304afb72-9a30-47d7-aa7d-ae4c56368f94 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] 10.222.0.58 "GET /compute/v2.1/servers/0e60179f-fe8f-48a7-aeb1-9e114e148708" status: 200 len: 1325 microversion: 2.1 time: 0.572043 Aug 10 23:09:44.164586 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1478/3059] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:09:43 2022] GET /compute/v2.1/servers/0e60179f-fe8f-48a7-aeb1-9e114e148708 => generated 1325 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:09:44.227716 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-3b49fec2-10e3-4db5-b2c1-f077743a8dd0 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca7d06f2acb44558d405a3b35a59550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7f70700e035444c9f2c9fa491c5c41a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:09:44.239518 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-3b49fec2-10e3-4db5-b2c1-f077743a8dd0 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] 10.222.0.58 "GET /compute/v2.1/servers/06ec3e8e-9e4f-4a9b-8fa7-679d71c3dbf0" status: 200 len: 1506 microversion: 2.1 time: 0.287363 Aug 10 23:09:44.244837 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1582/3060] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:09:43 2022] GET /compute/v2.1/servers/06ec3e8e-9e4f-4a9b-8fa7-679d71c3dbf0 => generated 1506 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:09:44.267664 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-1a5d61bf-4e4a-4266-892e-780e3278a770 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:09:44.268439 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-1a5d61bf-4e4a-4266-892e-780e3278a770 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] [instance: 06ec3e8e-9e4f-4a9b-8fa7-679d71c3dbf0] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:09:44.277812 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1a5d61bf-4e4a-4266-892e-780e3278a770 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:44.278989 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1a5d61bf-4e4a-4266-892e-780e3278a770 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:44.279722 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1a5d61bf-4e4a-4266-892e-780e3278a770 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:44.281194 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1a5d61bf-4e4a-4266-892e-780e3278a770 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:44.281970 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1a5d61bf-4e4a-4266-892e-780e3278a770 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:44.282865 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1a5d61bf-4e4a-4266-892e-780e3278a770 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:44.315874 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-1a5d61bf-4e4a-4266-892e-780e3278a770 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] [instance: 06ec3e8e-9e4f-4a9b-8fa7-679d71c3dbf0] Going to try to terminate instance {{(pid=122632) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:09:44.540290 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=4,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:09:44.555946 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-1a5d61bf-4e4a-4266-892e-780e3278a770 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] 10.222.0.58 "DELETE /compute/v2.1/servers/06ec3e8e-9e4f-4a9b-8fa7-679d71c3dbf0" status: 204 len: 0 microversion: 2.1 time: 0.291568 Aug 10 23:09:44.563657 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1479/3061] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:09:44 2022] DELETE /compute/v2.1/servers/06ec3e8e-9e4f-4a9b-8fa7-679d71c3dbf0 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:09:44.573110 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-a627295a-d838-4ed5-b181-e197ac3f748c tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:09:44.573783 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-a627295a-d838-4ed5-b181-e197ac3f748c tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] [instance: 6bdca10c-38e0-4605-9a5d-002c6333b81f] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:09:44.607497 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a627295a-d838-4ed5-b181-e197ac3f748c tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:44.608034 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a627295a-d838-4ed5-b181-e197ac3f748c tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:44.608490 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a627295a-d838-4ed5-b181-e197ac3f748c tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:44.610073 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a627295a-d838-4ed5-b181-e197ac3f748c tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:44.610552 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a627295a-d838-4ed5-b181-e197ac3f748c tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:44.611027 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a627295a-d838-4ed5-b181-e197ac3f748c tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:44.662168 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-a627295a-d838-4ed5-b181-e197ac3f748c tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] [instance: 6bdca10c-38e0-4605-9a5d-002c6333b81f] Going to try to terminate instance {{(pid=122633) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:09:44.819046 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-a627295a-d838-4ed5-b181-e197ac3f748c tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] 10.222.0.58 "DELETE /compute/v2.1/servers/6bdca10c-38e0-4605-9a5d-002c6333b81f" status: 204 len: 0 microversion: 2.1 time: 0.254935 Aug 10 23:09:44.819959 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1583/3062] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:09:44 2022] DELETE /compute/v2.1/servers/6bdca10c-38e0-4605-9a5d-002c6333b81f => generated 0 bytes in 257 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:09:44.834229 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-05a7a14a-606a-4f0a-9257-0aad4ce0a8a7 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:09:44.835000 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-05a7a14a-606a-4f0a-9257-0aad4ce0a8a7 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] [instance: 06ec3e8e-9e4f-4a9b-8fa7-679d71c3dbf0] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:09:44.850360 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-05a7a14a-606a-4f0a-9257-0aad4ce0a8a7 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:44.852081 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-027d8f19-cace-4637-b65e-9d2a276d0536 req-ba3716b8-37db-4c64-927a-6e6b10b1c35b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e60179f-fe8f-48a7-aeb1-9e114e148708", "tag": "b2407ad1-04ea-461c-b13b-0e072f6c5384"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:09:44.854740 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-05a7a14a-606a-4f0a-9257-0aad4ce0a8a7 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:44.855285 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-05a7a14a-606a-4f0a-9257-0aad4ce0a8a7 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:44.863585 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-05a7a14a-606a-4f0a-9257-0aad4ce0a8a7 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:44.864789 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-05a7a14a-606a-4f0a-9257-0aad4ce0a8a7 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:44.865869 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-05a7a14a-606a-4f0a-9257-0aad4ce0a8a7 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:44.878880 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-027d8f19-cace-4637-b65e-9d2a276d0536 req-ba3716b8-37db-4c64-927a-6e6b10b1c35b service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:44.879891 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-027d8f19-cace-4637-b65e-9d2a276d0536 req-ba3716b8-37db-4c64-927a-6e6b10b1c35b service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:44.880577 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-027d8f19-cace-4637-b65e-9d2a276d0536 req-ba3716b8-37db-4c64-927a-6e6b10b1c35b service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:44.904622 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:09:44.908440 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-027d8f19-cace-4637-b65e-9d2a276d0536 req-ba3716b8-37db-4c64-927a-6e6b10b1c35b service nova] Creating event network-changed:b2407ad1-04ea-461c-b13b-0e072f6c5384 for instance 0e60179f-fe8f-48a7-aeb1-9e114e148708 on n-h1-850468-14 Aug 10 23:09:44.930626 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-027d8f19-cace-4637-b65e-9d2a276d0536 req-ba3716b8-37db-4c64-927a-6e6b10b1c35b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083152 Aug 10 23:09:44.937157 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1584/3063] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:09:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:09:44.971496 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=2 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:09:45.028242 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=6 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:09:45.194546 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-e75d3e25-c69c-4d80-8f93-8ce3a5d2b0f9 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:09:45.195887 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-e75d3e25-c69c-4d80-8f93-8ce3a5d2b0f9 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] [instance: 0e60179f-fe8f-48a7-aeb1-9e114e148708] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:09:45.226791 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e75d3e25-c69c-4d80-8f93-8ce3a5d2b0f9 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:45.227708 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e75d3e25-c69c-4d80-8f93-8ce3a5d2b0f9 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:45.228085 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e75d3e25-c69c-4d80-8f93-8ce3a5d2b0f9 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:45.230921 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e75d3e25-c69c-4d80-8f93-8ce3a5d2b0f9 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:45.233197 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e75d3e25-c69c-4d80-8f93-8ce3a5d2b0f9 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:45.234489 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e75d3e25-c69c-4d80-8f93-8ce3a5d2b0f9 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:45.473447 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=44 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:09:45.582234 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-05a7a14a-606a-4f0a-9257-0aad4ce0a8a7 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca7d06f2acb44558d405a3b35a59550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7f70700e035444c9f2c9fa491c5c41a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:09:45.584135 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-e75d3e25-c69c-4d80-8f93-8ce3a5d2b0f9 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bbb4f184e4409d9eed51e0b98dfb29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708f8d4c4ed6432d85e0bf6a9bac7677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:09:45.593046 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-05a7a14a-606a-4f0a-9257-0aad4ce0a8a7 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] 10.222.0.58 "GET /compute/v2.1/servers/06ec3e8e-9e4f-4a9b-8fa7-679d71c3dbf0" status: 200 len: 1512 microversion: 2.1 time: 0.768850 Aug 10 23:09:45.596381 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1480/3064] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:09:44 2022] GET /compute/v2.1/servers/06ec3e8e-9e4f-4a9b-8fa7-679d71c3dbf0 => generated 1512 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:09:45.599931 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-e75d3e25-c69c-4d80-8f93-8ce3a5d2b0f9 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] 10.222.0.58 "GET /compute/v2.1/servers/0e60179f-fe8f-48a7-aeb1-9e114e148708" status: 200 len: 1325 microversion: 2.1 time: 0.414469 Aug 10 23:09:45.603801 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1585/3065] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:09:45 2022] GET /compute/v2.1/servers/0e60179f-fe8f-48a7-aeb1-9e114e148708 => generated 1325 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:09:45.747783 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-5013b0e1-7418-41ff-b1fb-e21579156675 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a22d036c-de48-44b1-b4cb-76c92ea5e7da"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:09:45.750634 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-5013b0e1-7418-41ff-b1fb-e21579156675 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] [instance: 23452b78-96cd-430d-b95c-aaa98a427d53] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:09:45.765729 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5013b0e1-7418-41ff-b1fb-e21579156675 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:45.767132 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5013b0e1-7418-41ff-b1fb-e21579156675 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:45.767837 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5013b0e1-7418-41ff-b1fb-e21579156675 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:45.768898 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5013b0e1-7418-41ff-b1fb-e21579156675 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:45.771207 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5013b0e1-7418-41ff-b1fb-e21579156675 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:45.772136 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5013b0e1-7418-41ff-b1fb-e21579156675 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:46.295996 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-5013b0e1-7418-41ff-b1fb-e21579156675 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] 10.222.0.58 "POST /compute/v2.1/servers/23452b78-96cd-430d-b95c-aaa98a427d53/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.555110 Aug 10 23:09:46.298437 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1481/3066] 10.222.0.58 () {60 vars in 1323 bytes} [Wed Aug 10 23:09:45 2022] POST /compute/v2.1/servers/23452b78-96cd-430d-b95c-aaa98a427d53/os-volume_attachments => generated 194 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:09:46.622951 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-4b40de07-1328-41cc-980e-919d09463bfe tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:09:46.624923 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-4b40de07-1328-41cc-980e-919d09463bfe tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] [instance: 06ec3e8e-9e4f-4a9b-8fa7-679d71c3dbf0] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:09:46.626553 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-844598db-10c5-41d1-b148-c14737d80291 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:09:46.633053 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-844598db-10c5-41d1-b148-c14737d80291 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] [instance: 0e60179f-fe8f-48a7-aeb1-9e114e148708] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:09:46.642576 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-844598db-10c5-41d1-b148-c14737d80291 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:46.643466 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-844598db-10c5-41d1-b148-c14737d80291 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:46.643987 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-844598db-10c5-41d1-b148-c14737d80291 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:46.645797 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-844598db-10c5-41d1-b148-c14737d80291 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:46.655069 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-844598db-10c5-41d1-b148-c14737d80291 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:46.656083 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-844598db-10c5-41d1-b148-c14737d80291 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:46.665146 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4b40de07-1328-41cc-980e-919d09463bfe tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:46.666998 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4b40de07-1328-41cc-980e-919d09463bfe tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:46.668617 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4b40de07-1328-41cc-980e-919d09463bfe tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:46.670075 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4b40de07-1328-41cc-980e-919d09463bfe tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:46.671950 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4b40de07-1328-41cc-980e-919d09463bfe tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:46.675928 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4b40de07-1328-41cc-980e-919d09463bfe tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:46.993930 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-4b40de07-1328-41cc-980e-919d09463bfe tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca7d06f2acb44558d405a3b35a59550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7f70700e035444c9f2c9fa491c5c41a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:09:47.020399 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-4b40de07-1328-41cc-980e-919d09463bfe tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] 10.222.0.58 "GET /compute/v2.1/servers/06ec3e8e-9e4f-4a9b-8fa7-679d71c3dbf0" status: 200 len: 1470 microversion: 2.1 time: 0.407998 Aug 10 23:09:47.024930 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1586/3067] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:09:46 2022] GET /compute/v2.1/servers/06ec3e8e-9e4f-4a9b-8fa7-679d71c3dbf0 => generated 1470 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:09:47.228720 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-d658f4e6-fdd5-4280-a5ee-1263bcda1bb7 req-64674b47-622c-4805-a467-d51736bfdf90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06ec3e8e-9e4f-4a9b-8fa7-679d71c3dbf0", "name": "network-vif-deleted", "tag": "c79f1e7c-00d5-41f0-a252-affa5dad3c5c"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:09:47.272186 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-d658f4e6-fdd5-4280-a5ee-1263bcda1bb7 req-64674b47-622c-4805-a467-d51736bfdf90 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:47.274320 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-d658f4e6-fdd5-4280-a5ee-1263bcda1bb7 req-64674b47-622c-4805-a467-d51736bfdf90 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:47.275687 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-d658f4e6-fdd5-4280-a5ee-1263bcda1bb7 req-64674b47-622c-4805-a467-d51736bfdf90 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:47.311875 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-d658f4e6-fdd5-4280-a5ee-1263bcda1bb7 req-64674b47-622c-4805-a467-d51736bfdf90 service nova] Creating event network-vif-deleted:c79f1e7c-00d5-41f0-a252-affa5dad3c5c for instance 06ec3e8e-9e4f-4a9b-8fa7-679d71c3dbf0 on n-h2-850468-14 Aug 10 23:09:47.336357 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-d658f4e6-fdd5-4280-a5ee-1263bcda1bb7 req-64674b47-622c-4805-a467-d51736bfdf90 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131039 Aug 10 23:09:47.340036 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1587/3068] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:09:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:09:47.501791 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-844598db-10c5-41d1-b148-c14737d80291 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bbb4f184e4409d9eed51e0b98dfb29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708f8d4c4ed6432d85e0bf6a9bac7677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:09:47.513486 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-844598db-10c5-41d1-b148-c14737d80291 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] 10.222.0.58 "GET /compute/v2.1/servers/0e60179f-fe8f-48a7-aeb1-9e114e148708" status: 200 len: 1325 microversion: 2.1 time: 0.890180 Aug 10 23:09:47.518034 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1482/3069] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:09:46 2022] GET /compute/v2.1/servers/0e60179f-fe8f-48a7-aeb1-9e114e148708 => generated 1325 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:09:48.054271 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-b05cfebe-57e6-4bc1-96da-4867f1e81041 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:09:48.055114 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-b05cfebe-57e6-4bc1-96da-4867f1e81041 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] [instance: 06ec3e8e-9e4f-4a9b-8fa7-679d71c3dbf0] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:09:48.077147 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b05cfebe-57e6-4bc1-96da-4867f1e81041 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:48.077732 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b05cfebe-57e6-4bc1-96da-4867f1e81041 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:48.078186 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b05cfebe-57e6-4bc1-96da-4867f1e81041 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:48.078928 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b05cfebe-57e6-4bc1-96da-4867f1e81041 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:48.079387 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b05cfebe-57e6-4bc1-96da-4867f1e81041 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:48.079811 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b05cfebe-57e6-4bc1-96da-4867f1e81041 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:48.117983 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-b05cfebe-57e6-4bc1-96da-4867f1e81041 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] HTTP exception thrown: Instance 06ec3e8e-9e4f-4a9b-8fa7-679d71c3dbf0 could not be found. Aug 10 23:09:48.120349 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-b05cfebe-57e6-4bc1-96da-4867f1e81041 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Request method failure captured: Aug 10 23:09:48.120349 n-d-850468-14 devstack@n-api.service[122633]: request: GET /compute/v2.1/servers/06ec3e8e-9e4f-4a9b-8fa7-679d71c3dbf0 HTTP/1.1 Aug 10 23:09:48.120349 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:09:48.120349 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:09:48.120349 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:09:48.120349 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:09:48.120349 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:09:48.120349 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:09:48.120349 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:09:48.120349 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:09:48.120349 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9DqAWE3wuj91rj8_iqjS1EnMF_5KzbYqRdq35lEsadfV58i5miWrPeJUPoOjHEdVlG0p1EU8PFpV4iij_LSAMLldswa16Bppf5-SvecC0ywuUiOknikhTYbyYtpGsnCXR-fGZz-_5Vi8myenrYzvPplkPWHXTTDyKJg6oZrJjacRJrc Aug 10 23:09:48.120349 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:09:48.120349 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:09:48.120349 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:09:48.120349 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:09:48.120349 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:09:48.120349 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:09:48.120349 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: a7f70700e035444c9f2c9fa491c5c41a Aug 10 23:09:48.120349 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-MultipleCreateTestJSON-1689954718 Aug 10 23:09:48.120349 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:09:48.120349 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:09:48.120349 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a7f70700e035444c9f2c9fa491c5c41a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a7f70700e035444c9f2c9fa491c5c41a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a7f70700e035444c9f2c9fa491c5c41a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a7f70700e035444c9f2c9fa491c5c41a", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:09:48.120349 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-MultipleCreateTestJSON-1689954718 Aug 10 23:09:48.120349 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: a7f70700e035444c9f2c9fa491c5c41a Aug 10 23:09:48.120349 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1689954718 Aug 10 23:09:48.120349 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-MultipleCreateTestJSON-1689954718-project Aug 10 23:09:48.120349 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:09:48.120349 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:09:48.120349 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 1ca7d06f2acb44558d405a3b35a59550 Aug 10 23:09:48.120349 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-MultipleCreateTestJSON-1689954718-project Aug 10 23:09:48.120349 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:09:48.120349 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance 06ec3e8e-9e4f-4a9b-8fa7-679d71c3dbf0 could not be found. Aug 10 23:09:48.120349 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': '06ec3e8e-9e4f-4a9b-8fa7-679d71c3dbf0'} Aug 10 23:09:48.120349 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:09:48.120349 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:09:48.120349 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:09:48.120349 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:09:48.120349 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:09:48.120349 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:09:48.120349 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:09:48.120349 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:09:48.120349 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:09:48.120349 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:09:48.120349 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06ec3e8e-9e4f-4a9b-8fa7-679d71c3dbf0 could not be found. Aug 10 23:09:48.120349 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:09:48.120349 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:09:48.120349 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:09:48.120349 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:09:48.120349 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:09:48.120349 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:09:48.120349 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:09:48.120349 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:09:48.120349 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:09:48.120349 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:09:48.120349 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:09:48.120349 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:09:48.120349 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:09:48.120349 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:09:48.120349 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:09:48.120349 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:09:48.120349 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06ec3e8e-9e4f-4a9b-8fa7-679d71c3dbf0 could not be found. Aug 10 23:09:48.120349 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:09:48.120349 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:09:48.120349 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:09:48.136682 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:09:48.136682 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:09:48.136682 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:09:48.136682 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:09:48.136682 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:09:48.136682 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06ec3e8e-9e4f-4a9b-8fa7-679d71c3dbf0 could not be found. Aug 10 23:09:48.136682 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:09:48.136682 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-b05cfebe-57e6-4bc1-96da-4867f1e81041 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Returning 404 to user: Instance 06ec3e8e-9e4f-4a9b-8fa7-679d71c3dbf0 could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:09:48.136682 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-b05cfebe-57e6-4bc1-96da-4867f1e81041 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] 10.222.0.58 "GET /compute/v2.1/servers/06ec3e8e-9e4f-4a9b-8fa7-679d71c3dbf0" status: 404 len: 111 microversion: 2.1 time: 0.079221 Aug 10 23:09:48.136682 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1588/3070] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:09:48 2022] GET /compute/v2.1/servers/06ec3e8e-9e4f-4a9b-8fa7-679d71c3dbf0 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:09:48.140516 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-997b6375-9e73-4ceb-942a-19917e359769 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:09:48.141544 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-997b6375-9e73-4ceb-942a-19917e359769 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] [instance: 6bdca10c-38e0-4605-9a5d-002c6333b81f] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:09:48.166052 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-997b6375-9e73-4ceb-942a-19917e359769 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:48.169915 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-997b6375-9e73-4ceb-942a-19917e359769 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:48.171882 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-997b6375-9e73-4ceb-942a-19917e359769 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:48.174028 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-997b6375-9e73-4ceb-942a-19917e359769 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:48.176381 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-997b6375-9e73-4ceb-942a-19917e359769 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:48.178302 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-997b6375-9e73-4ceb-942a-19917e359769 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:48.543983 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-f173faae-31d9-4d22-943c-0b5928a55cbf tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:09:48.551333 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-f173faae-31d9-4d22-943c-0b5928a55cbf tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] [instance: 0e60179f-fe8f-48a7-aeb1-9e114e148708] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:09:48.581140 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f173faae-31d9-4d22-943c-0b5928a55cbf tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:48.590734 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f173faae-31d9-4d22-943c-0b5928a55cbf tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:48.591432 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f173faae-31d9-4d22-943c-0b5928a55cbf tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:48.592367 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f173faae-31d9-4d22-943c-0b5928a55cbf tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:48.592989 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f173faae-31d9-4d22-943c-0b5928a55cbf tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:48.593999 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f173faae-31d9-4d22-943c-0b5928a55cbf tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:48.837077 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-997b6375-9e73-4ceb-942a-19917e359769 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca7d06f2acb44558d405a3b35a59550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7f70700e035444c9f2c9fa491c5c41a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:09:48.846638 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-997b6375-9e73-4ceb-942a-19917e359769 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] 10.222.0.58 "GET /compute/v2.1/servers/6bdca10c-38e0-4605-9a5d-002c6333b81f" status: 200 len: 1513 microversion: 2.1 time: 0.714659 Aug 10 23:09:48.849653 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1483/3071] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:09:48 2022] GET /compute/v2.1/servers/6bdca10c-38e0-4605-9a5d-002c6333b81f => generated 1513 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:09:48.981394 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-f173faae-31d9-4d22-943c-0b5928a55cbf tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bbb4f184e4409d9eed51e0b98dfb29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708f8d4c4ed6432d85e0bf6a9bac7677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:09:48.993802 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-f173faae-31d9-4d22-943c-0b5928a55cbf tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] 10.222.0.58 "GET /compute/v2.1/servers/0e60179f-fe8f-48a7-aeb1-9e114e148708" status: 200 len: 1325 microversion: 2.1 time: 0.453775 Aug 10 23:09:49.002101 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1589/3072] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:09:48 2022] GET /compute/v2.1/servers/0e60179f-fe8f-48a7-aeb1-9e114e148708 => generated 1325 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:09:49.500921 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-65242775-ff41-4316-a907-0f0b0cce45f5 tempest-ImagesMetadataTestJSON-471179040 tempest-ImagesMetadataTestJSON-471179040-project] Calling method '.version_select at 0x7f847d7a6ee0>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:09:49.600586 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-65242775-ff41-4316-a907-0f0b0cce45f5 tempest-ImagesMetadataTestJSON-471179040 tempest-ImagesMetadataTestJSON-471179040-project] 10.222.0.58 "GET /compute/v2.1/images/d73d368b-d702-47ac-a71d-161561879ea3" status: 200 len: 636 microversion: 2.1 time: 0.103498 Aug 10 23:09:49.603167 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1484/3073] 10.222.0.58 () {58 vars in 1233 bytes} [Wed Aug 10 23:09:49 2022] GET /compute/v2.1/images/d73d368b-d702-47ac-a71d-161561879ea3 => generated 636 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:09:49.618182 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-361fad93-3002-4974-bc6f-872045f3f79a tempest-ImagesMetadataTestJSON-471179040 tempest-ImagesMetadataTestJSON-471179040-project] Action: 'update_all', calling method: .version_select at 0x7f847c55fd30>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:09:49.797784 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-361fad93-3002-4974-bc6f-872045f3f79a tempest-ImagesMetadataTestJSON-471179040 tempest-ImagesMetadataTestJSON-471179040-project] Getting quotas for project 2dd046cc98754c84aa95f4616d04dcd9. Resources: dict_keys(['metadata_items']) {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:09:49.817417 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-bab59c95-21ac-4519-be8c-02b0d9cb96f2 req-0d83afac-6bce-4d0a-bc0f-cf390e7b273c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bdca10c-38e0-4605-9a5d-002c6333b81f", "name": "network-vif-deleted", "tag": "5f5ede08-dd5a-4e1e-a317-9b09504f4ac8"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:09:49.832367 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=1,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:09:49.837917 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-361fad93-3002-4974-bc6f-872045f3f79a tempest-ImagesMetadataTestJSON-471179040 tempest-ImagesMetadataTestJSON-471179040-project] Getting quotas for user 70ea4e24bf7e440dafb7a264b5e70ecb and project 2dd046cc98754c84aa95f4616d04dcd9. Resources: dict_keys(['metadata_items']) {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:09:49.865560 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-bab59c95-21ac-4519-be8c-02b0d9cb96f2 req-0d83afac-6bce-4d0a-bc0f-cf390e7b273c service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:49.867007 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-bab59c95-21ac-4519-be8c-02b0d9cb96f2 req-0d83afac-6bce-4d0a-bc0f-cf390e7b273c service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:49.868037 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-bab59c95-21ac-4519-be8c-02b0d9cb96f2 req-0d83afac-6bce-4d0a-bc0f-cf390e7b273c service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:49.898303 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-bab59c95-21ac-4519-be8c-02b0d9cb96f2 req-0d83afac-6bce-4d0a-bc0f-cf390e7b273c service nova] Creating event network-vif-deleted:5f5ede08-dd5a-4e1e-a317-9b09504f4ac8 for instance 6bdca10c-38e0-4605-9a5d-002c6333b81f on n-h1-850468-14 Aug 10 23:09:49.923994 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-bab59c95-21ac-4519-be8c-02b0d9cb96f2 req-0d83afac-6bce-4d0a-bc0f-cf390e7b273c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113832 Aug 10 23:09:49.924611 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1485/3074] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:09:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 23:09:49.946023 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-6c00cfec-e0fd-4ed5-b5d2-178e103b4474 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:09:49.948049 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-6c00cfec-e0fd-4ed5-b5d2-178e103b4474 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] [instance: 6bdca10c-38e0-4605-9a5d-002c6333b81f] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:09:49.989984 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6c00cfec-e0fd-4ed5-b5d2-178e103b4474 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:49.990589 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6c00cfec-e0fd-4ed5-b5d2-178e103b4474 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:49.991062 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6c00cfec-e0fd-4ed5-b5d2-178e103b4474 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:49.991817 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6c00cfec-e0fd-4ed5-b5d2-178e103b4474 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:49.992274 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6c00cfec-e0fd-4ed5-b5d2-178e103b4474 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:49.992702 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6c00cfec-e0fd-4ed5-b5d2-178e103b4474 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:50.535074 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-361fad93-3002-4974-bc6f-872045f3f79a tempest-ImagesMetadataTestJSON-471179040 tempest-ImagesMetadataTestJSON-471179040-project] 10.222.0.58 "PUT /compute/v2.1/images/d73d368b-d702-47ac-a71d-161561879ea3/metadata" status: 200 len: 61 microversion: 2.1 time: 0.921321 Aug 10 23:09:50.540730 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1590/3075] 10.222.0.58 () {60 vars in 1280 bytes} [Wed Aug 10 23:09:49 2022] PUT /compute/v2.1/images/d73d368b-d702-47ac-a71d-161561879ea3/metadata => generated 61 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 23:09:50.546470 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-853500bd-ee8c-4e35-9948-7c8a933c6015 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:09:50.549894 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-853500bd-ee8c-4e35-9948-7c8a933c6015 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] [instance: 0e60179f-fe8f-48a7-aeb1-9e114e148708] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:09:50.571213 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-853500bd-ee8c-4e35-9948-7c8a933c6015 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:50.575076 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-853500bd-ee8c-4e35-9948-7c8a933c6015 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:50.575998 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-853500bd-ee8c-4e35-9948-7c8a933c6015 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:50.580050 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-853500bd-ee8c-4e35-9948-7c8a933c6015 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:50.580717 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-853500bd-ee8c-4e35-9948-7c8a933c6015 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:50.585802 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-853500bd-ee8c-4e35-9948-7c8a933c6015 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:50.737619 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-6c00cfec-e0fd-4ed5-b5d2-178e103b4474 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1ca7d06f2acb44558d405a3b35a59550', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7f70700e035444c9f2c9fa491c5c41a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:09:50.749575 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-6c00cfec-e0fd-4ed5-b5d2-178e103b4474 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] 10.222.0.58 "GET /compute/v2.1/servers/6bdca10c-38e0-4605-9a5d-002c6333b81f" status: 200 len: 1303 microversion: 2.1 time: 0.821725 Aug 10 23:09:50.751436 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1486/3076] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:09:49 2022] GET /compute/v2.1/servers/6bdca10c-38e0-4605-9a5d-002c6333b81f => generated 1303 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:09:50.800464 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-adbc3351-60eb-4d3b-962c-5961d4e09dcb tempest-ImagesMetadataTestJSON-471179040 tempest-ImagesMetadataTestJSON-471179040-project] Calling method '.version_select at 0x7f847ca77670>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:09:51.024050 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-853500bd-ee8c-4e35-9948-7c8a933c6015 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bbb4f184e4409d9eed51e0b98dfb29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708f8d4c4ed6432d85e0bf6a9bac7677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:09:51.072224 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-853500bd-ee8c-4e35-9948-7c8a933c6015 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] 10.222.0.58 "GET /compute/v2.1/servers/0e60179f-fe8f-48a7-aeb1-9e114e148708" status: 200 len: 1325 microversion: 2.1 time: 0.522636 Aug 10 23:09:51.074391 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1591/3077] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:09:50 2022] GET /compute/v2.1/servers/0e60179f-fe8f-48a7-aeb1-9e114e148708 => generated 1325 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:09:51.402832 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-adbc3351-60eb-4d3b-962c-5961d4e09dcb tempest-ImagesMetadataTestJSON-471179040 tempest-ImagesMetadataTestJSON-471179040-project] 10.222.0.58 "DELETE /compute/v2.1/images/d73d368b-d702-47ac-a71d-161561879ea3/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.649134 Aug 10 23:09:51.404196 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1487/3078] 10.222.0.58 () {58 vars in 1296 bytes} [Wed Aug 10 23:09:50 2022] DELETE /compute/v2.1/images/d73d368b-d702-47ac-a71d-161561879ea3/metadata/os_version => generated 0 bytes in 651 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:09:51.415236 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-0c8afdae-4a35-41e0-b171-80cd4ae61fc6 tempest-ImagesMetadataTestJSON-471179040 tempest-ImagesMetadataTestJSON-471179040-project] Calling method '.version_select at 0x7f847d4a74c0>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:09:51.475885 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-0c8afdae-4a35-41e0-b171-80cd4ae61fc6 tempest-ImagesMetadataTestJSON-471179040 tempest-ImagesMetadataTestJSON-471179040-project] 10.222.0.58 "GET /compute/v2.1/images/d73d368b-d702-47ac-a71d-161561879ea3/metadata" status: 200 len: 37 microversion: 2.1 time: 0.064552 Aug 10 23:09:51.476664 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1592/3079] 10.222.0.58 () {58 vars in 1260 bytes} [Wed Aug 10 23:09:51 2022] GET /compute/v2.1/images/d73d368b-d702-47ac-a71d-161561879ea3/metadata => generated 37 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 23:09:51.501691 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-309d1e5d-5f42-40b0-87d5-fc81f5691913 tempest-ImagesMetadataTestJSON-471179040 tempest-ImagesMetadataTestJSON-471179040-project] Action: 'update_all', calling method: .version_select at 0x7f847d24b5e0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:09:51.602487 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-309d1e5d-5f42-40b0-87d5-fc81f5691913 tempest-ImagesMetadataTestJSON-471179040 tempest-ImagesMetadataTestJSON-471179040-project] Getting quotas for project 2dd046cc98754c84aa95f4616d04dcd9. Resources: dict_keys(['metadata_items']) {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:09:51.623265 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-309d1e5d-5f42-40b0-87d5-fc81f5691913 tempest-ImagesMetadataTestJSON-471179040 tempest-ImagesMetadataTestJSON-471179040-project] Getting quotas for user 70ea4e24bf7e440dafb7a264b5e70ecb and project 2dd046cc98754c84aa95f4616d04dcd9. Resources: dict_keys(['metadata_items']) {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:09:51.775617 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-fafd0b0f-4390-4371-ab41-5814922774b6 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:09:51.776525 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-fafd0b0f-4390-4371-ab41-5814922774b6 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] [instance: 6bdca10c-38e0-4605-9a5d-002c6333b81f] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:09:51.793955 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fafd0b0f-4390-4371-ab41-5814922774b6 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:51.794694 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fafd0b0f-4390-4371-ab41-5814922774b6 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:51.795231 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fafd0b0f-4390-4371-ab41-5814922774b6 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:51.795645 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fafd0b0f-4390-4371-ab41-5814922774b6 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:51.805862 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fafd0b0f-4390-4371-ab41-5814922774b6 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:51.813206 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fafd0b0f-4390-4371-ab41-5814922774b6 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:51.846931 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-fafd0b0f-4390-4371-ab41-5814922774b6 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] HTTP exception thrown: Instance 6bdca10c-38e0-4605-9a5d-002c6333b81f could not be found. Aug 10 23:09:51.861266 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-fafd0b0f-4390-4371-ab41-5814922774b6 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Request method failure captured: Aug 10 23:09:51.861266 n-d-850468-14 devstack@n-api.service[122633]: request: GET /compute/v2.1/servers/6bdca10c-38e0-4605-9a5d-002c6333b81f HTTP/1.1 Aug 10 23:09:51.861266 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:09:51.861266 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:09:51.861266 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:09:51.861266 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:09:51.861266 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:09:51.861266 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:09:51.861266 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:09:51.861266 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:09:51.861266 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9DqAWE3wuj91rj8_iqjS1EnMF_5KzbYqRdq35lEsadfV58i5miWrPeJUPoOjHEdVlG0p1EU8PFpV4iij_LSAMLldswa16Bppf5-SvecC0ywuUiOknikhTYbyYtpGsnCXR-fGZz-_5Vi8myenrYzvPplkPWHXTTDyKJg6oZrJjacRJrc Aug 10 23:09:51.861266 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:09:51.861266 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:09:51.861266 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:09:51.861266 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:09:51.861266 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:09:51.861266 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:09:51.861266 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: a7f70700e035444c9f2c9fa491c5c41a Aug 10 23:09:51.861266 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-MultipleCreateTestJSON-1689954718 Aug 10 23:09:51.861266 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:09:51.861266 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:09:51.861266 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a7f70700e035444c9f2c9fa491c5c41a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/a7f70700e035444c9f2c9fa491c5c41a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/a7f70700e035444c9f2c9fa491c5c41a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_a7f70700e035444c9f2c9fa491c5c41a", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:09:51.861266 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-MultipleCreateTestJSON-1689954718 Aug 10 23:09:51.861266 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: a7f70700e035444c9f2c9fa491c5c41a Aug 10 23:09:51.861266 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1689954718 Aug 10 23:09:51.861266 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-MultipleCreateTestJSON-1689954718-project Aug 10 23:09:51.861266 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:09:51.861266 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:09:51.861266 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 1ca7d06f2acb44558d405a3b35a59550 Aug 10 23:09:51.861266 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-MultipleCreateTestJSON-1689954718-project Aug 10 23:09:51.861266 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:09:51.861266 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance 6bdca10c-38e0-4605-9a5d-002c6333b81f could not be found. Aug 10 23:09:51.861266 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': '6bdca10c-38e0-4605-9a5d-002c6333b81f'} Aug 10 23:09:51.861266 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:09:51.861266 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:09:51.861266 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:09:51.861266 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:09:51.861266 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:09:51.861266 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:09:51.861266 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:09:51.861266 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:09:51.861266 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:09:51.861266 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:09:51.861266 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6bdca10c-38e0-4605-9a5d-002c6333b81f could not be found. Aug 10 23:09:51.861266 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:09:51.861266 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:09:51.861266 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:09:51.861266 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:09:51.861266 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:09:51.861266 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:09:51.861266 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:09:51.861266 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:09:51.861266 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:09:51.861266 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:09:51.861266 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:09:51.861266 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:09:51.861266 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:09:51.861266 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:09:51.861266 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:09:51.861266 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:09:51.861266 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6bdca10c-38e0-4605-9a5d-002c6333b81f could not be found. Aug 10 23:09:51.861266 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:09:51.861266 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:09:51.861266 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:09:51.867506 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:09:51.867506 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:09:51.867506 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:09:51.867506 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:09:51.867506 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:09:51.867506 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6bdca10c-38e0-4605-9a5d-002c6333b81f could not be found. Aug 10 23:09:51.867506 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:09:51.867506 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-fafd0b0f-4390-4371-ab41-5814922774b6 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] Returning 404 to user: Instance 6bdca10c-38e0-4605-9a5d-002c6333b81f could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:09:51.867506 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-fafd0b0f-4390-4371-ab41-5814922774b6 tempest-MultipleCreateTestJSON-1689954718 tempest-MultipleCreateTestJSON-1689954718-project] 10.222.0.58 "GET /compute/v2.1/servers/6bdca10c-38e0-4605-9a5d-002c6333b81f" status: 404 len: 111 microversion: 2.1 time: 0.094761 Aug 10 23:09:51.867506 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1593/3080] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:09:51 2022] GET /compute/v2.1/servers/6bdca10c-38e0-4605-9a5d-002c6333b81f => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:09:52.113293 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-fde35eca-bcd3-4784-8203-b3d84382f575 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:09:52.115451 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-fde35eca-bcd3-4784-8203-b3d84382f575 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] [instance: 0e60179f-fe8f-48a7-aeb1-9e114e148708] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:09:52.164047 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fde35eca-bcd3-4784-8203-b3d84382f575 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:52.171129 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fde35eca-bcd3-4784-8203-b3d84382f575 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:52.172213 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fde35eca-bcd3-4784-8203-b3d84382f575 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:52.176736 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fde35eca-bcd3-4784-8203-b3d84382f575 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:52.180798 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fde35eca-bcd3-4784-8203-b3d84382f575 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:52.181591 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fde35eca-bcd3-4784-8203-b3d84382f575 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:52.372157 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-309d1e5d-5f42-40b0-87d5-fc81f5691913 tempest-ImagesMetadataTestJSON-471179040 tempest-ImagesMetadataTestJSON-471179040-project] 10.222.0.58 "PUT /compute/v2.1/images/d73d368b-d702-47ac-a71d-161561879ea3/metadata" status: 200 len: 61 microversion: 2.1 time: 0.885820 Aug 10 23:09:52.372797 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1488/3081] 10.222.0.58 () {60 vars in 1280 bytes} [Wed Aug 10 23:09:51 2022] PUT /compute/v2.1/images/d73d368b-d702-47ac-a71d-161561879ea3/metadata => generated 61 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 23:09:52.398886 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-2ce178f5-9519-48f8-bf7c-4e9f5a4a301f tempest-ImagesMetadataTestJSON-471179040 tempest-ImagesMetadataTestJSON-471179040-project] Calling method '.version_select at 0x7f847d15b550>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:09:52.556255 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-2ce178f5-9519-48f8-bf7c-4e9f5a4a301f tempest-ImagesMetadataTestJSON-471179040 tempest-ImagesMetadataTestJSON-471179040-project] 10.222.0.58 "GET /compute/v2.1/images/d73d368b-d702-47ac-a71d-161561879ea3/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.163900 Aug 10 23:09:52.561498 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1489/3082] 10.222.0.58 () {58 vars in 1290 bytes} [Wed Aug 10 23:09:52 2022] GET /compute/v2.1/images/d73d368b-d702-47ac-a71d-161561879ea3/metadata/os_distro => generated 33 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 23:09:52.575821 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-35b0307b-4d8e-43a7-98f5-d3b9e17c4137 tempest-ImagesMetadataTestJSON-471179040 tempest-ImagesMetadataTestJSON-471179040-project] Action: 'update_all', calling method: .version_select at 0x7f848051a550>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:09:52.683080 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-35b0307b-4d8e-43a7-98f5-d3b9e17c4137 tempest-ImagesMetadataTestJSON-471179040 tempest-ImagesMetadataTestJSON-471179040-project] Getting quotas for project 2dd046cc98754c84aa95f4616d04dcd9. Resources: dict_keys(['metadata_items']) {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:09:52.691207 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-35b0307b-4d8e-43a7-98f5-d3b9e17c4137 tempest-ImagesMetadataTestJSON-471179040 tempest-ImagesMetadataTestJSON-471179040-project] Getting quotas for user 70ea4e24bf7e440dafb7a264b5e70ecb and project 2dd046cc98754c84aa95f4616d04dcd9. Resources: dict_keys(['metadata_items']) {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:09:53.085324 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-35b0307b-4d8e-43a7-98f5-d3b9e17c4137 tempest-ImagesMetadataTestJSON-471179040 tempest-ImagesMetadataTestJSON-471179040-project] 10.222.0.58 "PUT /compute/v2.1/images/d73d368b-d702-47ac-a71d-161561879ea3/metadata" status: 200 len: 61 microversion: 2.1 time: 0.514438 Aug 10 23:09:53.085979 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1490/3083] 10.222.0.58 () {60 vars in 1280 bytes} [Wed Aug 10 23:09:52 2022] PUT /compute/v2.1/images/d73d368b-d702-47ac-a71d-161561879ea3/metadata => generated 61 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 10 23:09:53.111925 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-eb468db8-dbd1-474a-8be2-e6567aa065b1 tempest-ImagesMetadataTestJSON-471179040 tempest-ImagesMetadataTestJSON-471179040-project] Calling method '.version_select at 0x7f847d17bca0>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:09:53.237550 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-eb468db8-dbd1-474a-8be2-e6567aa065b1 tempest-ImagesMetadataTestJSON-471179040 tempest-ImagesMetadataTestJSON-471179040-project] 10.222.0.58 "GET /compute/v2.1/images/d73d368b-d702-47ac-a71d-161561879ea3/metadata" status: 200 len: 61 microversion: 2.1 time: 0.139315 Aug 10 23:09:53.243207 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1491/3084] 10.222.0.58 () {58 vars in 1260 bytes} [Wed Aug 10 23:09:53 2022] GET /compute/v2.1/images/d73d368b-d702-47ac-a71d-161561879ea3/metadata => generated 61 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 10 23:09:53.286598 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-981b5d10-fc0d-4745-adb1-370dbff085a1 tempest-ImagesMetadataTestJSON-471179040 tempest-ImagesMetadataTestJSON-471179040-project] Action: 'update_all', calling method: .version_select at 0x7f847ca77e50>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:09:53.419803 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-981b5d10-fc0d-4745-adb1-370dbff085a1 tempest-ImagesMetadataTestJSON-471179040 tempest-ImagesMetadataTestJSON-471179040-project] Getting quotas for project 2dd046cc98754c84aa95f4616d04dcd9. Resources: dict_keys(['metadata_items']) {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:09:53.454163 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-981b5d10-fc0d-4745-adb1-370dbff085a1 tempest-ImagesMetadataTestJSON-471179040 tempest-ImagesMetadataTestJSON-471179040-project] Getting quotas for user 70ea4e24bf7e440dafb7a264b5e70ecb and project 2dd046cc98754c84aa95f4616d04dcd9. Resources: dict_keys(['metadata_items']) {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:09:53.668740 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-fde35eca-bcd3-4784-8203-b3d84382f575 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bbb4f184e4409d9eed51e0b98dfb29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708f8d4c4ed6432d85e0bf6a9bac7677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:09:53.688633 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-fde35eca-bcd3-4784-8203-b3d84382f575 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] 10.222.0.58 "GET /compute/v2.1/servers/0e60179f-fe8f-48a7-aeb1-9e114e148708" status: 200 len: 1325 microversion: 2.1 time: 1.591855 Aug 10 23:09:53.701036 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1594/3085] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:09:52 2022] GET /compute/v2.1/servers/0e60179f-fe8f-48a7-aeb1-9e114e148708 => generated 1325 bytes in 1608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:09:53.819374 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-981b5d10-fc0d-4745-adb1-370dbff085a1 tempest-ImagesMetadataTestJSON-471179040 tempest-ImagesMetadataTestJSON-471179040-project] 10.222.0.58 "PUT /compute/v2.1/images/d73d368b-d702-47ac-a71d-161561879ea3/metadata" status: 200 len: 61 microversion: 2.1 time: 0.565787 Aug 10 23:09:53.820451 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1492/3086] 10.222.0.58 () {60 vars in 1280 bytes} [Wed Aug 10 23:09:53 2022] PUT /compute/v2.1/images/d73d368b-d702-47ac-a71d-161561879ea3/metadata => generated 61 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 10 23:09:53.830247 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-83cf5a9d-b9ed-46a4-94a4-68a6b89bd72f tempest-ImagesMetadataTestJSON-471179040 tempest-ImagesMetadataTestJSON-471179040-project] Action: 'update_all', calling method: .version_select at 0x7f847cf67e50>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:09:53.968295 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-83cf5a9d-b9ed-46a4-94a4-68a6b89bd72f tempest-ImagesMetadataTestJSON-471179040 tempest-ImagesMetadataTestJSON-471179040-project] Getting quotas for project 2dd046cc98754c84aa95f4616d04dcd9. Resources: dict_keys(['metadata_items']) {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:09:54.001367 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-83cf5a9d-b9ed-46a4-94a4-68a6b89bd72f tempest-ImagesMetadataTestJSON-471179040 tempest-ImagesMetadataTestJSON-471179040-project] Getting quotas for user 70ea4e24bf7e440dafb7a264b5e70ecb and project 2dd046cc98754c84aa95f4616d04dcd9. Resources: dict_keys(['metadata_items']) {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:09:54.719280 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-0d3b98dd-4eef-42cf-a20c-af0564358ef1 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:09:54.720225 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-0d3b98dd-4eef-42cf-a20c-af0564358ef1 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] [instance: 0e60179f-fe8f-48a7-aeb1-9e114e148708] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:09:54.735686 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0d3b98dd-4eef-42cf-a20c-af0564358ef1 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:54.746667 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0d3b98dd-4eef-42cf-a20c-af0564358ef1 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:54.765235 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0d3b98dd-4eef-42cf-a20c-af0564358ef1 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:54.772965 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0d3b98dd-4eef-42cf-a20c-af0564358ef1 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:54.773700 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0d3b98dd-4eef-42cf-a20c-af0564358ef1 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:54.775360 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0d3b98dd-4eef-42cf-a20c-af0564358ef1 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:54.990400 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-83cf5a9d-b9ed-46a4-94a4-68a6b89bd72f tempest-ImagesMetadataTestJSON-471179040 tempest-ImagesMetadataTestJSON-471179040-project] 10.222.0.58 "PUT /compute/v2.1/images/d73d368b-d702-47ac-a71d-161561879ea3/metadata" status: 200 len: 64 microversion: 2.1 time: 1.164074 Aug 10 23:09:54.991622 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1595/3087] 10.222.0.58 () {60 vars in 1280 bytes} [Wed Aug 10 23:09:53 2022] PUT /compute/v2.1/images/d73d368b-d702-47ac-a71d-161561879ea3/metadata => generated 64 bytes in 1166 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 23:09:55.006726 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-e0ce68fb-8fcd-4ba0-865b-12229c689c15 tempest-ImagesMetadataTestJSON-471179040 tempest-ImagesMetadataTestJSON-471179040-project] Calling method '.version_select at 0x7f847d2c33a0>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:09:55.219234 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-e0ce68fb-8fcd-4ba0-865b-12229c689c15 tempest-ImagesMetadataTestJSON-471179040 tempest-ImagesMetadataTestJSON-471179040-project] 10.222.0.58 "GET /compute/v2.1/images/d73d368b-d702-47ac-a71d-161561879ea3/metadata" status: 200 len: 64 microversion: 2.1 time: 0.216921 Aug 10 23:09:55.224447 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1596/3088] 10.222.0.58 () {58 vars in 1260 bytes} [Wed Aug 10 23:09:54 2022] GET /compute/v2.1/images/d73d368b-d702-47ac-a71d-161561879ea3/metadata => generated 64 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 23:09:55.248174 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-db94ce96-fa67-48b0-a83e-81d8c252b499 tempest-ImagesMetadataTestJSON-471179040 tempest-ImagesMetadataTestJSON-471179040-project] Action: 'update_all', calling method: .version_select at 0x7f847d2c3d30>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:09:55.455095 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-db94ce96-fa67-48b0-a83e-81d8c252b499 tempest-ImagesMetadataTestJSON-471179040 tempest-ImagesMetadataTestJSON-471179040-project] Getting quotas for project 2dd046cc98754c84aa95f4616d04dcd9. Resources: dict_keys(['metadata_items']) {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:09:55.467810 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-db94ce96-fa67-48b0-a83e-81d8c252b499 tempest-ImagesMetadataTestJSON-471179040 tempest-ImagesMetadataTestJSON-471179040-project] Getting quotas for user 70ea4e24bf7e440dafb7a264b5e70ecb and project 2dd046cc98754c84aa95f4616d04dcd9. Resources: dict_keys(['metadata_items']) {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:09:55.495778 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-0d3b98dd-4eef-42cf-a20c-af0564358ef1 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bbb4f184e4409d9eed51e0b98dfb29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708f8d4c4ed6432d85e0bf6a9bac7677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:09:55.535348 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-0d3b98dd-4eef-42cf-a20c-af0564358ef1 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] 10.222.0.58 "GET /compute/v2.1/servers/0e60179f-fe8f-48a7-aeb1-9e114e148708" status: 200 len: 1325 microversion: 2.1 time: 0.819744 Aug 10 23:09:55.555491 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1493/3089] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:09:54 2022] GET /compute/v2.1/servers/0e60179f-fe8f-48a7-aeb1-9e114e148708 => generated 1325 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:09:56.420939 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-db94ce96-fa67-48b0-a83e-81d8c252b499 tempest-ImagesMetadataTestJSON-471179040 tempest-ImagesMetadataTestJSON-471179040-project] 10.222.0.58 "PUT /compute/v2.1/images/d73d368b-d702-47ac-a71d-161561879ea3/metadata" status: 200 len: 61 microversion: 2.1 time: 1.188282 Aug 10 23:09:56.421891 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1597/3090] 10.222.0.58 () {60 vars in 1280 bytes} [Wed Aug 10 23:09:55 2022] PUT /compute/v2.1/images/d73d368b-d702-47ac-a71d-161561879ea3/metadata => generated 61 bytes in 1191 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 10 23:09:56.460750 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-3b82eb69-f331-4908-8dca-85248eaf9b3d tempest-ImagesMetadataTestJSON-471179040 tempest-ImagesMetadataTestJSON-471179040-project] Action: 'update', calling method: .version_select at 0x7f847c809040>, body: {"meta": {"os_version": "alt"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:09:56.590562 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-3b82eb69-f331-4908-8dca-85248eaf9b3d tempest-ImagesMetadataTestJSON-471179040 tempest-ImagesMetadataTestJSON-471179040-project] Getting quotas for project 2dd046cc98754c84aa95f4616d04dcd9. Resources: dict_keys(['metadata_items']) {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:09:56.610322 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-3b82eb69-f331-4908-8dca-85248eaf9b3d tempest-ImagesMetadataTestJSON-471179040 tempest-ImagesMetadataTestJSON-471179040-project] Getting quotas for user 70ea4e24bf7e440dafb7a264b5e70ecb and project 2dd046cc98754c84aa95f4616d04dcd9. Resources: dict_keys(['metadata_items']) {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:09:56.747100 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c8584a07-a1b3-4603-81cd-5ecdb09669ad tempest-SecurityGroupsNegativeTestJSON-1124336192 tempest-SecurityGroupsNegativeTestJSON-1124336192-project] Calling method '.version_select at 0x7f847cf67ca0>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:09:56.838091 n-d-850468-14 devstack@n-api.service[122633]: DEBUG neutronclient.v2_0.client [None req-c8584a07-a1b3-4603-81cd-5ecdb09669ad tempest-SecurityGroupsNegativeTestJSON-1124336192 tempest-SecurityGroupsNegativeTestJSON-1124336192-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group a8b1a63e-fedc-4d61-85a1-c694a488cd6b does not exist", "detail": ""}} {{(pid=122633) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 10 23:09:56.838821 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.network.security_group_api [None req-c8584a07-a1b3-4603-81cd-5ecdb09669ad tempest-SecurityGroupsNegativeTestJSON-1124336192 tempest-SecurityGroupsNegativeTestJSON-1124336192-project] Neutron security group a8b1a63e-fedc-4d61-85a1-c694a488cd6b not found {{(pid=122633) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 10 23:09:56.839371 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-c8584a07-a1b3-4603-81cd-5ecdb09669ad tempest-SecurityGroupsNegativeTestJSON-1124336192 tempest-SecurityGroupsNegativeTestJSON-1124336192-project] HTTP exception thrown: Security group a8b1a63e-fedc-4d61-85a1-c694a488cd6b does not exist Aug 10 23:09:56.839371 n-d-850468-14 devstack@n-api.service[122633]: Neutron server returns request_ids: ['req-6a17e623-4269-4d50-aa68-237bcd6058cf'] Aug 10 23:09:56.844750 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c8584a07-a1b3-4603-81cd-5ecdb09669ad tempest-SecurityGroupsNegativeTestJSON-1124336192 tempest-SecurityGroupsNegativeTestJSON-1124336192-project] Request method failure captured: Aug 10 23:09:56.844750 n-d-850468-14 devstack@n-api.service[122633]: request: DELETE /compute/v2.1/os-security-groups/a8b1a63e-fedc-4d61-85a1-c694a488cd6b HTTP/1.1 Aug 10 23:09:56.844750 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:09:56.844750 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:09:56.844750 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:09:56.844750 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:09:56.844750 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:09:56.844750 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:09:56.844750 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:09:56.844750 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:09:56.844750 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9DrE6ynVUAnwsNHs_gT42K6en9v02-K_MobJQSscCa-UHl-pW2it64H6tCtEl3TwtpJ5VpvdOPn6W9mQ1PF0Y7PRU6L40KAMTNLr9QzNN8mwIdJd0cJVfY6IThXwkpRX-DodZGiXxPCQ32F1gACl1uhySwYGtU0_vw7x49KyhPzknmw Aug 10 23:09:56.844750 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:09:56.844750 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:09:56.844750 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:09:56.844750 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:09:56.844750 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:09:56.844750 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:09:56.844750 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: c4e81cc6782141129a310121eb2d2187 Aug 10 23:09:56.844750 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1124336192 Aug 10 23:09:56.844750 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:09:56.844750 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:09:56.844750 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c4e81cc6782141129a310121eb2d2187"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c4e81cc6782141129a310121eb2d2187"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/c4e81cc6782141129a310121eb2d2187"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_c4e81cc6782141129a310121eb2d2187", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:09:56.844750 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1124336192 Aug 10 23:09:56.844750 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: c4e81cc6782141129a310121eb2d2187 Aug 10 23:09:56.844750 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1124336192 Aug 10 23:09:56.844750 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-SecurityGroupsNegativeTestJSON-1124336192-project Aug 10 23:09:56.844750 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:09:56.844750 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:09:56.844750 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 84708e528b4f4d638a3ffc647920c5b0 Aug 10 23:09:56.844750 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1124336192-project Aug 10 23:09:56.844750 n-d-850468-14 devstack@n-api.service[122633]: method: Aug 10 23:09:56.844750 n-d-850468-14 devstack@n-api.service[122633]: exception: Security group a8b1a63e-fedc-4d61-85a1-c694a488cd6b does not exist Aug 10 23:09:56.844750 n-d-850468-14 devstack@n-api.service[122633]: Neutron server returns request_ids: ['req-6a17e623-4269-4d50-aa68-237bcd6058cf'] Aug 10 23:09:56.844750 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': 'a8b1a63e-fedc-4d61-85a1-c694a488cd6b'} Aug 10 23:09:56.844750 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:09:56.844750 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:09:56.844750 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 10 23:09:56.844750 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 10 23:09:56.844750 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 23:09:56.844750 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 23:09:56.844750 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 10 23:09:56.844750 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 10 23:09:56.844750 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 23:09:56.844750 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 23:09:56.844750 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 23:09:56.844750 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 23:09:56.844750 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 23:09:56.844750 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 23:09:56.844750 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 23:09:56.844750 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 23:09:56.844750 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 23:09:56.844750 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 23:09:56.844750 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 10 23:09:56.844750 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 10 23:09:56.844750 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 23:09:56.844750 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 23:09:56.844750 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 10 23:09:56.844750 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 10 23:09:56.844750 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 10 23:09:56.844750 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 10 23:09:56.844750 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group a8b1a63e-fedc-4d61-85a1-c694a488cd6b does not exist Aug 10 23:09:56.851525 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6a17e623-4269-4d50-aa68-237bcd6058cf'] Aug 10 23:09:56.851525 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:09:56.851525 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:09:56.851525 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:09:56.851525 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:09:56.851525 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 10 23:09:56.851525 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 10 23:09:56.851525 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 10 23:09:56.851525 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 10 23:09:56.851525 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group a8b1a63e-fedc-4d61-85a1-c694a488cd6b does not exist Aug 10 23:09:56.851525 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6a17e623-4269-4d50-aa68-237bcd6058cf'] Aug 10 23:09:56.851525 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:09:56.851525 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:09:56.851525 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:09:56.851525 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:09:56.851525 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:09:56.851525 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:09:56.851525 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:09:56.851525 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:09:56.851525 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 23:09:56.851525 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 23:09:56.851525 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:09:56.851525 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:09:56.851525 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 10 23:09:56.851525 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 10 23:09:56.851525 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group a8b1a63e-fedc-4d61-85a1-c694a488cd6b does not exist Aug 10 23:09:56.851525 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6a17e623-4269-4d50-aa68-237bcd6058cf'] Aug 10 23:09:56.851525 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:09:56.851525 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:09:56.851525 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:09:56.851525 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:09:56.851525 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:09:56.851525 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:09:56.851525 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:09:56.851525 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:09:56.851525 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group a8b1a63e-fedc-4d61-85a1-c694a488cd6b does not exist Aug 10 23:09:56.851525 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6a17e623-4269-4d50-aa68-237bcd6058cf'] Aug 10 23:09:56.851525 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:09:56.861372 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c8584a07-a1b3-4603-81cd-5ecdb09669ad tempest-SecurityGroupsNegativeTestJSON-1124336192 tempest-SecurityGroupsNegativeTestJSON-1124336192-project] Returning 404 to user: Security group a8b1a63e-fedc-4d61-85a1-c694a488cd6b does not exist Aug 10 23:09:56.861372 n-d-850468-14 devstack@n-api.service[122633]: Neutron server returns request_ids: ['req-6a17e623-4269-4d50-aa68-237bcd6058cf'] {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:09:56.861372 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-c8584a07-a1b3-4603-81cd-5ecdb09669ad tempest-SecurityGroupsNegativeTestJSON-1124336192 tempest-SecurityGroupsNegativeTestJSON-1124336192-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/a8b1a63e-fedc-4d61-85a1-c694a488cd6b" status: 404 len: 194 microversion: 2.1 time: 0.412328 Aug 10 23:09:56.861372 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1598/3091] 10.222.0.58 () {58 vars in 1272 bytes} [Wed Aug 10 23:09:56 2022] DELETE /compute/v2.1/os-security-groups/a8b1a63e-fedc-4d61-85a1-c694a488cd6b => generated 194 bytes in 414 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:09:56.906175 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-51b6dcf4-9b7a-47b9-9c8b-7b8b42cdedc8 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:09:56.906935 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-51b6dcf4-9b7a-47b9-9c8b-7b8b42cdedc8 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] [instance: 0e60179f-fe8f-48a7-aeb1-9e114e148708] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:09:56.917224 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-51b6dcf4-9b7a-47b9-9c8b-7b8b42cdedc8 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:56.918114 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-51b6dcf4-9b7a-47b9-9c8b-7b8b42cdedc8 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:56.920785 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-51b6dcf4-9b7a-47b9-9c8b-7b8b42cdedc8 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:56.921975 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-51b6dcf4-9b7a-47b9-9c8b-7b8b42cdedc8 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:56.923229 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-51b6dcf4-9b7a-47b9-9c8b-7b8b42cdedc8 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:56.923866 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-51b6dcf4-9b7a-47b9-9c8b-7b8b42cdedc8 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:57.205464 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-3b82eb69-f331-4908-8dca-85248eaf9b3d tempest-ImagesMetadataTestJSON-471179040 tempest-ImagesMetadataTestJSON-471179040-project] 10.222.0.58 "PUT /compute/v2.1/images/d73d368b-d702-47ac-a71d-161561879ea3/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.771351 Aug 10 23:09:57.206061 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1494/3092] 10.222.0.58 () {60 vars in 1313 bytes} [Wed Aug 10 23:09:56 2022] PUT /compute/v2.1/images/d73d368b-d702-47ac-a71d-161561879ea3/metadata/os_version => generated 31 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 23:09:57.222368 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-d5c81884-b68c-412a-8e42-12bc5c31dfa5 tempest-SecurityGroupsNegativeTestJSON-1124336192 tempest-SecurityGroupsNegativeTestJSON-1124336192-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.014927 Aug 10 23:09:57.231268 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1495/3093] 10.222.0.58 () {58 vars in 1164 bytes} [Wed Aug 10 23:09:57 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 21 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 10 23:09:57.244399 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-986d6a49-fbad-458c-9464-b67627252f9e tempest-ImagesMetadataTestJSON-471179040 tempest-ImagesMetadataTestJSON-471179040-project] Calling method '.version_select at 0x7f847c8099d0>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:09:57.347003 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-986d6a49-fbad-458c-9464-b67627252f9e tempest-ImagesMetadataTestJSON-471179040 tempest-ImagesMetadataTestJSON-471179040-project] 10.222.0.58 "GET /compute/v2.1/images/d73d368b-d702-47ac-a71d-161561879ea3/metadata" status: 200 len: 58 microversion: 2.1 time: 0.117949 Aug 10 23:09:57.347847 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1496/3094] 10.222.0.58 () {58 vars in 1260 bytes} [Wed Aug 10 23:09:57 2022] GET /compute/v2.1/images/d73d368b-d702-47ac-a71d-161561879ea3/metadata => generated 58 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 23:09:57.352820 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-3496e957-454e-4db7-98d1-a3224bf7d611 tempest-SecurityGroupsNegativeTestJSON-1124336192 tempest-SecurityGroupsNegativeTestJSON-1124336192-project] Calling method '.version_select at 0x7f847c809ee0>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:09:57.694508 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-3496e957-454e-4db7-98d1-a3224bf7d611 tempest-SecurityGroupsNegativeTestJSON-1124336192 tempest-SecurityGroupsNegativeTestJSON-1124336192-project] 10.222.0.58 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 0.345517 Aug 10 23:09:57.703622 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1497/3095] 10.222.0.58 () {58 vars in 1158 bytes} [Wed Aug 10 23:09:57 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:09:57.710086 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-7c5a68b4-8711-4414-b824-8fa63a4ee19f tempest-ImagesMetadataTestJSON-471179040 tempest-ImagesMetadataTestJSON-471179040-project] Action: 'update_all', calling method: .version_select at 0x7f847d5ea1f0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:09:57.787582 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-7c5a68b4-8711-4414-b824-8fa63a4ee19f tempest-ImagesMetadataTestJSON-471179040 tempest-ImagesMetadataTestJSON-471179040-project] Getting quotas for project 2dd046cc98754c84aa95f4616d04dcd9. Resources: dict_keys(['metadata_items']) {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:09:57.804750 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-7c5a68b4-8711-4414-b824-8fa63a4ee19f tempest-ImagesMetadataTestJSON-471179040 tempest-ImagesMetadataTestJSON-471179040-project] Getting quotas for user 70ea4e24bf7e440dafb7a264b5e70ecb and project 2dd046cc98754c84aa95f4616d04dcd9. Resources: dict_keys(['metadata_items']) {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:09:57.949896 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-51b6dcf4-9b7a-47b9-9c8b-7b8b42cdedc8 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bbb4f184e4409d9eed51e0b98dfb29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708f8d4c4ed6432d85e0bf6a9bac7677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:09:57.964654 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-51b6dcf4-9b7a-47b9-9c8b-7b8b42cdedc8 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] 10.222.0.58 "GET /compute/v2.1/servers/0e60179f-fe8f-48a7-aeb1-9e114e148708" status: 200 len: 1325 microversion: 2.1 time: 1.099691 Aug 10 23:09:57.966833 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1599/3096] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:09:56 2022] GET /compute/v2.1/servers/0e60179f-fe8f-48a7-aeb1-9e114e148708 => generated 1325 bytes in 1109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:09:58.002198 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-d63be59e-456a-4544-8e28-03f1d385641e tempest-SecurityGroupsNegativeTestJSON-1124336192 tempest-SecurityGroupsNegativeTestJSON-1124336192-project] Calling method '.version_select at 0x7f847d261040>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:09:58.398233 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-7c5a68b4-8711-4414-b824-8fa63a4ee19f tempest-ImagesMetadataTestJSON-471179040 tempest-ImagesMetadataTestJSON-471179040-project] 10.222.0.58 "PUT /compute/v2.1/images/d73d368b-d702-47ac-a71d-161561879ea3/metadata" status: 200 len: 61 microversion: 2.1 time: 0.693407 Aug 10 23:09:58.404116 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1498/3097] 10.222.0.58 () {60 vars in 1280 bytes} [Wed Aug 10 23:09:57 2022] PUT /compute/v2.1/images/d73d368b-d702-47ac-a71d-161561879ea3/metadata => generated 61 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 23:09:58.409318 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c4f539f8-6d02-43ae-a7be-b8faf743d296 tempest-ImagesMetadataTestJSON-471179040 tempest-ImagesMetadataTestJSON-471179040-project] Action: 'create', calling method: .version_select at 0x7f847c7a1040>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:09:58.549961 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-c4f539f8-6d02-43ae-a7be-b8faf743d296 tempest-ImagesMetadataTestJSON-471179040 tempest-ImagesMetadataTestJSON-471179040-project] Getting quotas for project 2dd046cc98754c84aa95f4616d04dcd9. Resources: dict_keys(['metadata_items']) {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:09:58.564532 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-c4f539f8-6d02-43ae-a7be-b8faf743d296 tempest-ImagesMetadataTestJSON-471179040 tempest-ImagesMetadataTestJSON-471179040-project] Getting quotas for user 70ea4e24bf7e440dafb7a264b5e70ecb and project 2dd046cc98754c84aa95f4616d04dcd9. Resources: dict_keys(['metadata_items']) {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:09:59.258996 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-c4f539f8-6d02-43ae-a7be-b8faf743d296 tempest-ImagesMetadataTestJSON-471179040 tempest-ImagesMetadataTestJSON-471179040-project] 10.222.0.58 "POST /compute/v2.1/images/d73d368b-d702-47ac-a71d-161561879ea3/metadata" status: 200 len: 85 microversion: 2.1 time: 0.853480 Aug 10 23:09:59.265400 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1499/3098] 10.222.0.58 () {60 vars in 1281 bytes} [Wed Aug 10 23:09:58 2022] POST /compute/v2.1/images/d73d368b-d702-47ac-a71d-161561879ea3/metadata => generated 85 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 23:09:59.281986 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-7b688942-467b-417a-ab73-7de153217ceb req-e3dc2856-a310-4192-af81-36e9297daa2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e60179f-fe8f-48a7-aeb1-9e114e148708", "name": "network-vif-plugged", "status": "completed", "tag": "b2407ad1-04ea-461c-b13b-0e072f6c5384"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:09:59.325371 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-7b688942-467b-417a-ab73-7de153217ceb req-e3dc2856-a310-4192-af81-36e9297daa2b service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:59.326462 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-7b688942-467b-417a-ab73-7de153217ceb req-e3dc2856-a310-4192-af81-36e9297daa2b service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:59.327394 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-7b688942-467b-417a-ab73-7de153217ceb req-e3dc2856-a310-4192-af81-36e9297daa2b service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:59.341859 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-7b688942-467b-417a-ab73-7de153217ceb req-e3dc2856-a310-4192-af81-36e9297daa2b service nova] Creating event network-vif-plugged:b2407ad1-04ea-461c-b13b-0e072f6c5384 for instance 0e60179f-fe8f-48a7-aeb1-9e114e148708 on n-h1-850468-14 Aug 10 23:09:59.349121 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-7b688942-467b-417a-ab73-7de153217ceb req-e3dc2856-a310-4192-af81-36e9297daa2b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081940 Aug 10 23:09:59.350675 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1500/3099] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:09:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:09:59.358927 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-eeb04d15-029e-49d5-a848-c9c2137e2bd5 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:09:59.362244 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-eeb04d15-029e-49d5-a848-c9c2137e2bd5 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] [instance: 0e60179f-fe8f-48a7-aeb1-9e114e148708] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:09:59.382712 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-eeb04d15-029e-49d5-a848-c9c2137e2bd5 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:59.384051 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-eeb04d15-029e-49d5-a848-c9c2137e2bd5 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:59.384693 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-eeb04d15-029e-49d5-a848-c9c2137e2bd5 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:59.385682 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-eeb04d15-029e-49d5-a848-c9c2137e2bd5 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:09:59.386331 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-eeb04d15-029e-49d5-a848-c9c2137e2bd5 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:09:59.387866 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-eeb04d15-029e-49d5-a848-c9c2137e2bd5 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:09:59.860201 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-eeb04d15-029e-49d5-a848-c9c2137e2bd5 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bbb4f184e4409d9eed51e0b98dfb29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708f8d4c4ed6432d85e0bf6a9bac7677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:09:59.885573 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-eeb04d15-029e-49d5-a848-c9c2137e2bd5 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] 10.222.0.58 "GET /compute/v2.1/servers/0e60179f-fe8f-48a7-aeb1-9e114e148708" status: 200 len: 1325 microversion: 2.1 time: 0.532966 Aug 10 23:09:59.886034 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1501/3100] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:09:59 2022] GET /compute/v2.1/servers/0e60179f-fe8f-48a7-aeb1-9e114e148708 => generated 1325 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:09:59.897042 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-23f00dce-1ca0-43eb-a534-827ad714982f tempest-ImagesMetadataTestJSON-471179040 tempest-ImagesMetadataTestJSON-471179040-project] Calling method '.version_select at 0x7f84823c9700>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:09:59.913053 n-d-850468-14 devstack@n-api.service[122633]: DEBUG neutronclient.v2_0.client [None req-d63be59e-456a-4544-8e28-03f1d385641e tempest-SecurityGroupsNegativeTestJSON-1124336192 tempest-SecurityGroupsNegativeTestJSON-1124336192-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=122633) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 10 23:09:59.916136 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-d63be59e-456a-4544-8e28-03f1d385641e tempest-SecurityGroupsNegativeTestJSON-1124336192 tempest-SecurityGroupsNegativeTestJSON-1124336192-project] HTTP exception thrown: Insufficient rights for removing default security group. Aug 10 23:09:59.916136 n-d-850468-14 devstack@n-api.service[122633]: Neutron server returns request_ids: ['req-000650c1-ad84-4c08-ae57-c9956fce74b5'] Aug 10 23:09:59.920203 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-d63be59e-456a-4544-8e28-03f1d385641e tempest-SecurityGroupsNegativeTestJSON-1124336192 tempest-SecurityGroupsNegativeTestJSON-1124336192-project] Request method failure captured: Aug 10 23:09:59.920203 n-d-850468-14 devstack@n-api.service[122633]: request: DELETE /compute/v2.1/os-security-groups/facbc2ec-03b4-404e-974d-356d283fa6cd HTTP/1.1 Aug 10 23:09:59.920203 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:09:59.920203 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:09:59.920203 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:09:59.920203 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:09:59.920203 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:09:59.920203 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:09:59.920203 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:09:59.920203 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:09:59.920203 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9DrE6ynVUAnwsNHs_gT42K6en9v02-K_MobJQSscCa-UHl-pW2it64H6tCtEl3TwtpJ5VpvdOPn6W9mQ1PF0Y7PRU6L40KAMTNLr9QzNN8mwIdJd0cJVfY6IThXwkpRX-DodZGiXxPCQ32F1gACl1uhySwYGtU0_vw7x49KyhPzknmw Aug 10 23:09:59.920203 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:09:59.920203 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:09:59.920203 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:09:59.920203 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:09:59.920203 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:09:59.920203 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:09:59.920203 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: c4e81cc6782141129a310121eb2d2187 Aug 10 23:09:59.920203 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1124336192 Aug 10 23:09:59.920203 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:09:59.920203 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:09:59.920203 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c4e81cc6782141129a310121eb2d2187"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c4e81cc6782141129a310121eb2d2187"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/c4e81cc6782141129a310121eb2d2187"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_c4e81cc6782141129a310121eb2d2187", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:09:59.920203 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1124336192 Aug 10 23:09:59.920203 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: c4e81cc6782141129a310121eb2d2187 Aug 10 23:09:59.920203 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1124336192 Aug 10 23:09:59.920203 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-SecurityGroupsNegativeTestJSON-1124336192-project Aug 10 23:09:59.920203 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:09:59.920203 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:09:59.920203 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 84708e528b4f4d638a3ffc647920c5b0 Aug 10 23:09:59.920203 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1124336192-project Aug 10 23:09:59.920203 n-d-850468-14 devstack@n-api.service[122633]: method: Aug 10 23:09:59.920203 n-d-850468-14 devstack@n-api.service[122633]: exception: Insufficient rights for removing default security group. Aug 10 23:09:59.920203 n-d-850468-14 devstack@n-api.service[122633]: Neutron server returns request_ids: ['req-000650c1-ad84-4c08-ae57-c9956fce74b5'] Aug 10 23:09:59.920203 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': 'facbc2ec-03b4-404e-974d-356d283fa6cd'} Aug 10 23:09:59.920203 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:09:59.920203 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:09:59.920203 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Aug 10 23:09:59.920203 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Aug 10 23:09:59.920203 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 23:09:59.920203 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 23:09:59.920203 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Aug 10 23:09:59.920203 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Aug 10 23:09:59.920203 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 23:09:59.920203 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 23:09:59.920203 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Aug 10 23:09:59.920203 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Aug 10 23:09:59.920203 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 23:09:59.920203 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 23:09:59.920203 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 23:09:59.920203 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 23:09:59.920203 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 23:09:59.920203 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 23:09:59.920203 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 10 23:09:59.920203 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 10 23:09:59.920203 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 23:09:59.920203 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 23:09:59.920203 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 10 23:09:59.920203 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 10 23:09:59.920203 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 10 23:09:59.920203 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 10 23:09:59.920203 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Aug 10 23:09:59.926428 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-000650c1-ad84-4c08-ae57-c9956fce74b5'] Aug 10 23:09:59.926428 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:09:59.926428 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:09:59.926428 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:09:59.926428 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:09:59.926428 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Aug 10 23:09:59.926428 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Aug 10 23:09:59.926428 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Aug 10 23:09:59.926428 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Aug 10 23:09:59.926428 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Aug 10 23:09:59.926428 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-000650c1-ad84-4c08-ae57-c9956fce74b5'] Aug 10 23:09:59.926428 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:09:59.926428 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:09:59.926428 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:09:59.926428 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:09:59.926428 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:09:59.926428 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:09:59.926428 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:09:59.926428 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:09:59.926428 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 23:09:59.926428 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 23:09:59.926428 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:09:59.926428 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:09:59.926428 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Aug 10 23:09:59.926428 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 10 23:09:59.926428 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Aug 10 23:09:59.926428 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-000650c1-ad84-4c08-ae57-c9956fce74b5'] Aug 10 23:09:59.926428 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:09:59.926428 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:09:59.926428 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:09:59.926428 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:09:59.926428 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:09:59.926428 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:09:59.926428 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:09:59.926428 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:09:59.926428 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Aug 10 23:09:59.926428 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-000650c1-ad84-4c08-ae57-c9956fce74b5'] Aug 10 23:09:59.926428 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:09:59.926428 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-d63be59e-456a-4544-8e28-03f1d385641e tempest-SecurityGroupsNegativeTestJSON-1124336192 tempest-SecurityGroupsNegativeTestJSON-1124336192-project] Returning 400 to user: Insufficient rights for removing default security group. Aug 10 23:09:59.926428 n-d-850468-14 devstack@n-api.service[122633]: Neutron server returns request_ids: ['req-000650c1-ad84-4c08-ae57-c9956fce74b5'] {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:09:59.926428 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-d63be59e-456a-4544-8e28-03f1d385641e tempest-SecurityGroupsNegativeTestJSON-1124336192 tempest-SecurityGroupsNegativeTestJSON-1124336192-project] 10.222.0.58 "DELETE /compute/v2.1/os-security-groups/facbc2ec-03b4-404e-974d-356d283fa6cd" status: 400 len: 182 microversion: 2.1 time: 1.957462 Aug 10 23:09:59.942309 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1600/3101] 10.222.0.58 () {58 vars in 1272 bytes} [Wed Aug 10 23:09:57 2022] DELETE /compute/v2.1/os-security-groups/facbc2ec-03b4-404e-974d-356d283fa6cd => generated 182 bytes in 1959 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 10 23:09:59.945705 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-4d648161-7ea7-4723-b9b4-cde7becb4f84 tempest-SecurityGroupsNegativeTestJSON-1124336192 tempest-SecurityGroupsNegativeTestJSON-1124336192-project] Calling method '.version_select at 0x7f847d0e8f70>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:09:59.971576 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-23f00dce-1ca0-43eb-a534-827ad714982f tempest-ImagesMetadataTestJSON-471179040 tempest-ImagesMetadataTestJSON-471179040-project] 10.222.0.58 "GET /compute/v2.1/images/d73d368b-d702-47ac-a71d-161561879ea3/metadata" status: 200 len: 85 microversion: 2.1 time: 0.082535 Aug 10 23:09:59.978843 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1502/3102] 10.222.0.58 () {58 vars in 1260 bytes} [Wed Aug 10 23:09:59 2022] GET /compute/v2.1/images/d73d368b-d702-47ac-a71d-161561879ea3/metadata => generated 85 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 23:10:00.120982 n-d-850468-14 devstack@n-api.service[122633]: DEBUG neutronclient.v2_0.client [None req-4d648161-7ea7-4723-b9b4-cde7becb4f84 tempest-SecurityGroupsNegativeTestJSON-1124336192 tempest-SecurityGroupsNegativeTestJSON-1124336192-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 1d8e313f-641e-48e3-9677-787ea0db49dd does not exist", "detail": ""}} {{(pid=122633) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 10 23:10:00.121621 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.network.security_group_api [None req-4d648161-7ea7-4723-b9b4-cde7becb4f84 tempest-SecurityGroupsNegativeTestJSON-1124336192 tempest-SecurityGroupsNegativeTestJSON-1124336192-project] Neutron security group 1d8e313f-641e-48e3-9677-787ea0db49dd not found {{(pid=122633) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 10 23:10:00.122148 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-4d648161-7ea7-4723-b9b4-cde7becb4f84 tempest-SecurityGroupsNegativeTestJSON-1124336192 tempest-SecurityGroupsNegativeTestJSON-1124336192-project] HTTP exception thrown: Security group 1d8e313f-641e-48e3-9677-787ea0db49dd does not exist Aug 10 23:10:00.122148 n-d-850468-14 devstack@n-api.service[122633]: Neutron server returns request_ids: ['req-ac4e5400-2dff-4240-8fd4-194031ded0b3'] Aug 10 23:10:00.127542 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-4d648161-7ea7-4723-b9b4-cde7becb4f84 tempest-SecurityGroupsNegativeTestJSON-1124336192 tempest-SecurityGroupsNegativeTestJSON-1124336192-project] Request method failure captured: Aug 10 23:10:00.127542 n-d-850468-14 devstack@n-api.service[122633]: request: GET /compute/v2.1/os-security-groups/1d8e313f-641e-48e3-9677-787ea0db49dd HTTP/1.1 Aug 10 23:10:00.127542 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:10:00.127542 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:10:00.127542 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:10:00.127542 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:10:00.127542 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:10:00.127542 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:10:00.127542 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:10:00.127542 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:10:00.127542 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9DrE6ynVUAnwsNHs_gT42K6en9v02-K_MobJQSscCa-UHl-pW2it64H6tCtEl3TwtpJ5VpvdOPn6W9mQ1PF0Y7PRU6L40KAMTNLr9QzNN8mwIdJd0cJVfY6IThXwkpRX-DodZGiXxPCQ32F1gACl1uhySwYGtU0_vw7x49KyhPzknmw Aug 10 23:10:00.127542 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:10:00.127542 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:10:00.127542 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:10:00.127542 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:10:00.127542 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:10:00.127542 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:10:00.127542 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: c4e81cc6782141129a310121eb2d2187 Aug 10 23:10:00.127542 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1124336192 Aug 10 23:10:00.127542 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:10:00.127542 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:10:00.127542 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c4e81cc6782141129a310121eb2d2187"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c4e81cc6782141129a310121eb2d2187"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/c4e81cc6782141129a310121eb2d2187"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_c4e81cc6782141129a310121eb2d2187", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:10:00.127542 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1124336192 Aug 10 23:10:00.127542 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: c4e81cc6782141129a310121eb2d2187 Aug 10 23:10:00.127542 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1124336192 Aug 10 23:10:00.127542 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-SecurityGroupsNegativeTestJSON-1124336192-project Aug 10 23:10:00.127542 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:10:00.127542 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:10:00.127542 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 84708e528b4f4d638a3ffc647920c5b0 Aug 10 23:10:00.127542 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1124336192-project Aug 10 23:10:00.127542 n-d-850468-14 devstack@n-api.service[122633]: method: Aug 10 23:10:00.127542 n-d-850468-14 devstack@n-api.service[122633]: exception: Security group 1d8e313f-641e-48e3-9677-787ea0db49dd does not exist Aug 10 23:10:00.127542 n-d-850468-14 devstack@n-api.service[122633]: Neutron server returns request_ids: ['req-ac4e5400-2dff-4240-8fd4-194031ded0b3'] Aug 10 23:10:00.127542 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': '1d8e313f-641e-48e3-9677-787ea0db49dd'} Aug 10 23:10:00.127542 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:10:00.127542 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:10:00.127542 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 10 23:10:00.127542 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 10 23:10:00.127542 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 23:10:00.127542 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 23:10:00.127542 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 10 23:10:00.127542 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 10 23:10:00.127542 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 23:10:00.127542 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 23:10:00.127542 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 23:10:00.127542 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 23:10:00.127542 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 23:10:00.127542 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 23:10:00.127542 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 23:10:00.127542 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 23:10:00.127542 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 23:10:00.127542 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 23:10:00.127542 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 10 23:10:00.127542 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 10 23:10:00.127542 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 23:10:00.127542 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 23:10:00.127542 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 10 23:10:00.127542 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 10 23:10:00.127542 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 10 23:10:00.127542 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 10 23:10:00.127542 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 1d8e313f-641e-48e3-9677-787ea0db49dd does not exist Aug 10 23:10:00.131945 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ac4e5400-2dff-4240-8fd4-194031ded0b3'] Aug 10 23:10:00.131945 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:10:00.131945 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:10:00.131945 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:10:00.131945 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:10:00.131945 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 10 23:10:00.131945 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 10 23:10:00.131945 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 10 23:10:00.131945 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 10 23:10:00.131945 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 1d8e313f-641e-48e3-9677-787ea0db49dd does not exist Aug 10 23:10:00.131945 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ac4e5400-2dff-4240-8fd4-194031ded0b3'] Aug 10 23:10:00.131945 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:10:00.131945 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:10:00.131945 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:10:00.131945 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:10:00.131945 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:10:00.131945 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:10:00.131945 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:10:00.131945 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:10:00.131945 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 23:10:00.131945 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 23:10:00.131945 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:10:00.131945 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:10:00.131945 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 10 23:10:00.131945 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 10 23:10:00.131945 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 1d8e313f-641e-48e3-9677-787ea0db49dd does not exist Aug 10 23:10:00.131945 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ac4e5400-2dff-4240-8fd4-194031ded0b3'] Aug 10 23:10:00.131945 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:10:00.131945 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:10:00.131945 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:10:00.131945 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:10:00.131945 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:10:00.131945 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:10:00.131945 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:10:00.131945 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:10:00.131945 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 1d8e313f-641e-48e3-9677-787ea0db49dd does not exist Aug 10 23:10:00.131945 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ac4e5400-2dff-4240-8fd4-194031ded0b3'] Aug 10 23:10:00.131945 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:10:00.131945 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-4d648161-7ea7-4723-b9b4-cde7becb4f84 tempest-SecurityGroupsNegativeTestJSON-1124336192 tempest-SecurityGroupsNegativeTestJSON-1124336192-project] Returning 404 to user: Security group 1d8e313f-641e-48e3-9677-787ea0db49dd does not exist Aug 10 23:10:00.131945 n-d-850468-14 devstack@n-api.service[122633]: Neutron server returns request_ids: ['req-ac4e5400-2dff-4240-8fd4-194031ded0b3'] {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:10:00.131945 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-4d648161-7ea7-4723-b9b4-cde7becb4f84 tempest-SecurityGroupsNegativeTestJSON-1124336192 tempest-SecurityGroupsNegativeTestJSON-1124336192-project] 10.222.0.58 "GET /compute/v2.1/os-security-groups/1d8e313f-641e-48e3-9677-787ea0db49dd" status: 404 len: 194 microversion: 2.1 time: 0.194764 Aug 10 23:10:00.131945 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1601/3103] 10.222.0.58 () {58 vars in 1269 bytes} [Wed Aug 10 23:09:59 2022] GET /compute/v2.1/os-security-groups/1d8e313f-641e-48e3-9677-787ea0db49dd => generated 194 bytes in 197 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 10 23:10:00.140522 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-adab8d38-8b71-48ae-8136-f983cd955518 tempest-SecurityGroupsNegativeTestJSON-1124336192 tempest-SecurityGroupsNegativeTestJSON-1124336192-project] Action: 'update', calling method: .version_select at 0x7f847d387c10>, body: {"security_group": {"name": "tempest-sg-1858336417", "description": "tempest-description-1009104232"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:10:00.273663 n-d-850468-14 devstack@n-api.service[122632]: DEBUG neutronclient.v2_0.client [None req-adab8d38-8b71-48ae-8136-f983cd955518 tempest-SecurityGroupsNegativeTestJSON-1124336192 tempest-SecurityGroupsNegativeTestJSON-1124336192-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 6d1f907d-ac1d-42d9-a30d-e764c7df6f23 does not exist", "detail": ""}} {{(pid=122632) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 10 23:10:00.274382 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.network.security_group_api [None req-adab8d38-8b71-48ae-8136-f983cd955518 tempest-SecurityGroupsNegativeTestJSON-1124336192 tempest-SecurityGroupsNegativeTestJSON-1124336192-project] Neutron security group 6d1f907d-ac1d-42d9-a30d-e764c7df6f23 not found {{(pid=122632) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 10 23:10:00.274889 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-adab8d38-8b71-48ae-8136-f983cd955518 tempest-SecurityGroupsNegativeTestJSON-1124336192 tempest-SecurityGroupsNegativeTestJSON-1124336192-project] HTTP exception thrown: Security group 6d1f907d-ac1d-42d9-a30d-e764c7df6f23 does not exist Aug 10 23:10:00.274889 n-d-850468-14 devstack@n-api.service[122632]: Neutron server returns request_ids: ['req-eaa2aa5e-198c-40db-8d85-e71af896a8a0'] Aug 10 23:10:00.278452 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-adab8d38-8b71-48ae-8136-f983cd955518 tempest-SecurityGroupsNegativeTestJSON-1124336192 tempest-SecurityGroupsNegativeTestJSON-1124336192-project] Request method failure captured: Aug 10 23:10:00.278452 n-d-850468-14 devstack@n-api.service[122632]: request: PUT /compute/v2.1/os-security-groups/6d1f907d-ac1d-42d9-a30d-e764c7df6f23 HTTP/1.1 Aug 10 23:10:00.278452 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:10:00.278452 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:10:00.278452 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:10:00.278452 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 102 Aug 10 23:10:00.278452 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:10:00.278452 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:10:00.278452 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:10:00.278452 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:10:00.278452 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9DrE6ynVUAnwsNHs_gT42K6en9v02-K_MobJQSscCa-UHl-pW2it64H6tCtEl3TwtpJ5VpvdOPn6W9mQ1PF0Y7PRU6L40KAMTNLr9QzNN8mwIdJd0cJVfY6IThXwkpRX-DodZGiXxPCQ32F1gACl1uhySwYGtU0_vw7x49KyhPzknmw Aug 10 23:10:00.278452 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:10:00.278452 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:10:00.278452 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:10:00.278452 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:10:00.278452 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:10:00.278452 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:10:00.278452 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: c4e81cc6782141129a310121eb2d2187 Aug 10 23:10:00.278452 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1124336192 Aug 10 23:10:00.278452 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:10:00.278452 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:10:00.278452 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c4e81cc6782141129a310121eb2d2187"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/c4e81cc6782141129a310121eb2d2187"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/c4e81cc6782141129a310121eb2d2187"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_c4e81cc6782141129a310121eb2d2187", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:10:00.278452 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1124336192 Aug 10 23:10:00.278452 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: c4e81cc6782141129a310121eb2d2187 Aug 10 23:10:00.278452 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1124336192 Aug 10 23:10:00.278452 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-SecurityGroupsNegativeTestJSON-1124336192-project Aug 10 23:10:00.278452 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:10:00.278452 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:10:00.278452 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: 84708e528b4f4d638a3ffc647920c5b0 Aug 10 23:10:00.278452 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1124336192-project Aug 10 23:10:00.278452 n-d-850468-14 devstack@n-api.service[122632]: Aug 10 23:10:00.278452 n-d-850468-14 devstack@n-api.service[122632]: {"security_group": {"name": "tempest-sg-1858336417", "description": "tempest-description-1009104232"}} Aug 10 23:10:00.278452 n-d-850468-14 devstack@n-api.service[122632]: method: Aug 10 23:10:00.278452 n-d-850468-14 devstack@n-api.service[122632]: exception: Security group 6d1f907d-ac1d-42d9-a30d-e764c7df6f23 does not exist Aug 10 23:10:00.278452 n-d-850468-14 devstack@n-api.service[122632]: Neutron server returns request_ids: ['req-eaa2aa5e-198c-40db-8d85-e71af896a8a0'] Aug 10 23:10:00.278452 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': '6d1f907d-ac1d-42d9-a30d-e764c7df6f23', 'body': {'security_group': {'name': 'tempest-sg-1858336417', 'description': 'tempest-description-1009104232'}}} Aug 10 23:10:00.278452 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:10:00.278452 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:10:00.278452 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 10 23:10:00.278452 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 10 23:10:00.278452 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 23:10:00.278452 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 23:10:00.278452 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 10 23:10:00.278452 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 10 23:10:00.278452 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 23:10:00.278452 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 23:10:00.278452 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 10 23:10:00.278452 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 10 23:10:00.278452 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 23:10:00.278452 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 23:10:00.278452 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 10 23:10:00.278452 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 10 23:10:00.278452 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 23:10:00.278452 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 23:10:00.278452 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 10 23:10:00.278452 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 10 23:10:00.278452 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 23:10:00.278452 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 23:10:00.278452 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 10 23:10:00.278452 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 10 23:10:00.278452 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 10 23:10:00.283197 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 10 23:10:00.283197 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 6d1f907d-ac1d-42d9-a30d-e764c7df6f23 does not exist Aug 10 23:10:00.283197 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-eaa2aa5e-198c-40db-8d85-e71af896a8a0'] Aug 10 23:10:00.283197 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:10:00.283197 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:10:00.283197 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:10:00.283197 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:10:00.283197 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Aug 10 23:10:00.283197 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 10 23:10:00.283197 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 10 23:10:00.283197 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 10 23:10:00.283197 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 6d1f907d-ac1d-42d9-a30d-e764c7df6f23 does not exist Aug 10 23:10:00.283197 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-eaa2aa5e-198c-40db-8d85-e71af896a8a0'] Aug 10 23:10:00.283197 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:10:00.283197 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:10:00.283197 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:10:00.283197 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:10:00.283197 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:10:00.283197 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:10:00.283197 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:10:00.283197 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:10:00.283197 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 23:10:00.283197 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 23:10:00.283197 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:10:00.283197 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:10:00.283197 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Aug 10 23:10:00.283197 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 10 23:10:00.283197 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 6d1f907d-ac1d-42d9-a30d-e764c7df6f23 does not exist Aug 10 23:10:00.283197 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-eaa2aa5e-198c-40db-8d85-e71af896a8a0'] Aug 10 23:10:00.283197 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:10:00.283197 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:10:00.283197 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:10:00.283197 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:10:00.283197 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:10:00.283197 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:10:00.283197 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:10:00.283197 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:10:00.283197 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 6d1f907d-ac1d-42d9-a30d-e764c7df6f23 does not exist Aug 10 23:10:00.283197 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-eaa2aa5e-198c-40db-8d85-e71af896a8a0'] Aug 10 23:10:00.283197 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:10:00.283197 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-adab8d38-8b71-48ae-8136-f983cd955518 tempest-SecurityGroupsNegativeTestJSON-1124336192 tempest-SecurityGroupsNegativeTestJSON-1124336192-project] Returning 404 to user: Security group 6d1f907d-ac1d-42d9-a30d-e764c7df6f23 does not exist Aug 10 23:10:00.283197 n-d-850468-14 devstack@n-api.service[122632]: Neutron server returns request_ids: ['req-eaa2aa5e-198c-40db-8d85-e71af896a8a0'] {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:10:00.283197 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-adab8d38-8b71-48ae-8136-f983cd955518 tempest-SecurityGroupsNegativeTestJSON-1124336192 tempest-SecurityGroupsNegativeTestJSON-1124336192-project] 10.222.0.58 "PUT /compute/v2.1/os-security-groups/6d1f907d-ac1d-42d9-a30d-e764c7df6f23" status: 404 len: 194 microversion: 2.1 time: 0.144114 Aug 10 23:10:00.289902 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1503/3104] 10.222.0.58 () {60 vars in 1290 bytes} [Wed Aug 10 23:10:00 2022] PUT /compute/v2.1/os-security-groups/6d1f907d-ac1d-42d9-a30d-e764c7df6f23 => generated 194 bytes in 154 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 10 23:10:00.907660 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-09e50f0d-7be5-4e3d-88cd-63374e3daa31 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:10:00.908735 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-09e50f0d-7be5-4e3d-88cd-63374e3daa31 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] [instance: 0e60179f-fe8f-48a7-aeb1-9e114e148708] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:10:00.952981 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-09e50f0d-7be5-4e3d-88cd-63374e3daa31 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:10:00.962023 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-09e50f0d-7be5-4e3d-88cd-63374e3daa31 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:10:00.965852 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-09e50f0d-7be5-4e3d-88cd-63374e3daa31 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:10:00.966637 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-09e50f0d-7be5-4e3d-88cd-63374e3daa31 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:10:00.970047 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-09e50f0d-7be5-4e3d-88cd-63374e3daa31 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:10:00.972053 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-09e50f0d-7be5-4e3d-88cd-63374e3daa31 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:10:01.437961 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-09e50f0d-7be5-4e3d-88cd-63374e3daa31 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bbb4f184e4409d9eed51e0b98dfb29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708f8d4c4ed6432d85e0bf6a9bac7677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:10:01.454901 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-09e50f0d-7be5-4e3d-88cd-63374e3daa31 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] 10.222.0.58 "GET /compute/v2.1/servers/0e60179f-fe8f-48a7-aeb1-9e114e148708" status: 200 len: 1522 microversion: 2.1 time: 0.551180 Aug 10 23:10:01.456055 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1602/3105] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:10:00 2022] GET /compute/v2.1/servers/0e60179f-fe8f-48a7-aeb1-9e114e148708 => generated 1522 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:10:01.489394 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-2665ddd9-8f2f-489e-bd95-4e795dcdda3a tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:10:01.490054 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-2665ddd9-8f2f-489e-bd95-4e795dcdda3a tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] [instance: 0e60179f-fe8f-48a7-aeb1-9e114e148708] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:10:01.510492 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2665ddd9-8f2f-489e-bd95-4e795dcdda3a tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:10:01.511086 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2665ddd9-8f2f-489e-bd95-4e795dcdda3a tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:10:01.528538 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2665ddd9-8f2f-489e-bd95-4e795dcdda3a tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:10:01.533514 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2665ddd9-8f2f-489e-bd95-4e795dcdda3a tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:10:01.536456 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2665ddd9-8f2f-489e-bd95-4e795dcdda3a tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:10:01.542810 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2665ddd9-8f2f-489e-bd95-4e795dcdda3a tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:10:01.656658 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-2665ddd9-8f2f-489e-bd95-4e795dcdda3a tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] [instance: 0e60179f-fe8f-48a7-aeb1-9e114e148708] Going to try to terminate instance {{(pid=122632) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:10:01.916819 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-2665ddd9-8f2f-489e-bd95-4e795dcdda3a tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] 10.222.0.58 "DELETE /compute/v2.1/servers/0e60179f-fe8f-48a7-aeb1-9e114e148708" status: 204 len: 0 microversion: 2.1 time: 0.434054 Aug 10 23:10:01.921857 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1504/3106] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:10:01 2022] DELETE /compute/v2.1/servers/0e60179f-fe8f-48a7-aeb1-9e114e148708 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 10 23:10:01.931086 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-f997b838-ec5a-4aae-90c7-e66d5d5717b7 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:10:01.931724 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-f997b838-ec5a-4aae-90c7-e66d5d5717b7 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] [instance: 0e60179f-fe8f-48a7-aeb1-9e114e148708] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:10:01.951977 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f997b838-ec5a-4aae-90c7-e66d5d5717b7 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:10:01.953974 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f997b838-ec5a-4aae-90c7-e66d5d5717b7 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:10:01.954580 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f997b838-ec5a-4aae-90c7-e66d5d5717b7 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:10:01.955228 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f997b838-ec5a-4aae-90c7-e66d5d5717b7 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:10:01.955618 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f997b838-ec5a-4aae-90c7-e66d5d5717b7 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:10:01.963686 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f997b838-ec5a-4aae-90c7-e66d5d5717b7 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:10:02.698208 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-f997b838-ec5a-4aae-90c7-e66d5d5717b7 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bbb4f184e4409d9eed51e0b98dfb29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708f8d4c4ed6432d85e0bf6a9bac7677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:10:02.711733 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-f997b838-ec5a-4aae-90c7-e66d5d5717b7 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] 10.222.0.58 "GET /compute/v2.1/servers/0e60179f-fe8f-48a7-aeb1-9e114e148708" status: 200 len: 1528 microversion: 2.1 time: 0.785781 Aug 10 23:10:02.725703 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1603/3107] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:10:01 2022] GET /compute/v2.1/servers/0e60179f-fe8f-48a7-aeb1-9e114e148708 => generated 1528 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:10:03.748081 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-1495d4ed-4b3b-4df9-a106-08d58845e446 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:10:03.749097 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-1495d4ed-4b3b-4df9-a106-08d58845e446 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] [instance: 0e60179f-fe8f-48a7-aeb1-9e114e148708] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:10:03.764677 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1495d4ed-4b3b-4df9-a106-08d58845e446 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:10:03.765265 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1495d4ed-4b3b-4df9-a106-08d58845e446 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:10:03.765754 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1495d4ed-4b3b-4df9-a106-08d58845e446 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:10:03.766532 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1495d4ed-4b3b-4df9-a106-08d58845e446 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:10:03.767134 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1495d4ed-4b3b-4df9-a106-08d58845e446 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:10:03.767511 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1495d4ed-4b3b-4df9-a106-08d58845e446 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:10:05.419205 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-1495d4ed-4b3b-4df9-a106-08d58845e446 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '55bbb4f184e4409d9eed51e0b98dfb29', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '708f8d4c4ed6432d85e0bf6a9bac7677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:10:05.431736 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-1495d4ed-4b3b-4df9-a106-08d58845e446 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] 10.222.0.58 "GET /compute/v2.1/servers/0e60179f-fe8f-48a7-aeb1-9e114e148708" status: 200 len: 1528 microversion: 2.1 time: 1.688840 Aug 10 23:10:05.438084 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1505/3108] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:10:03 2022] GET /compute/v2.1/servers/0e60179f-fe8f-48a7-aeb1-9e114e148708 => generated 1528 bytes in 1696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:10:05.769681 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-1f7d3729-396f-48df-b38b-1b928795ef29 req-57ffb590-a4a3-4fca-8f52-f824eb5ceb6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e60179f-fe8f-48a7-aeb1-9e114e148708", "name": "network-vif-deleted", "tag": "b2407ad1-04ea-461c-b13b-0e072f6c5384"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:10:05.791986 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=12 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:10:05.808419 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-1f7d3729-396f-48df-b38b-1b928795ef29 req-57ffb590-a4a3-4fca-8f52-f824eb5ceb6f service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:10:05.808936 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-1f7d3729-396f-48df-b38b-1b928795ef29 req-57ffb590-a4a3-4fca-8f52-f824eb5ceb6f service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:10:05.809376 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-1f7d3729-396f-48df-b38b-1b928795ef29 req-57ffb590-a4a3-4fca-8f52-f824eb5ceb6f service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:10:05.859724 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-1f7d3729-396f-48df-b38b-1b928795ef29 req-57ffb590-a4a3-4fca-8f52-f824eb5ceb6f service nova] Creating event network-vif-deleted:b2407ad1-04ea-461c-b13b-0e072f6c5384 for instance 0e60179f-fe8f-48a7-aeb1-9e114e148708 on n-h1-850468-14 Aug 10 23:10:05.878143 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-1f7d3729-396f-48df-b38b-1b928795ef29 req-57ffb590-a4a3-4fca-8f52-f824eb5ceb6f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110035 Aug 10 23:10:05.882419 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1604/3109] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:10:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:10:06.417296 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-269880c9-9a70-4748-a0d7-7f0314877055 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:10:06.424233 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-269880c9-9a70-4748-a0d7-7f0314877055 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] [instance: 23452b78-96cd-430d-b95c-aaa98a427d53] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:10:06.449026 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-269880c9-9a70-4748-a0d7-7f0314877055 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:10:06.449528 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-269880c9-9a70-4748-a0d7-7f0314877055 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:10:06.454988 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-269880c9-9a70-4748-a0d7-7f0314877055 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:10:06.457574 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-269880c9-9a70-4748-a0d7-7f0314877055 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:10:06.460938 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-269880c9-9a70-4748-a0d7-7f0314877055 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:10:06.462954 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-269880c9-9a70-4748-a0d7-7f0314877055 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:10:06.596565 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-269880c9-9a70-4748-a0d7-7f0314877055 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] 10.222.0.58 "GET /compute/v2.1/servers/23452b78-96cd-430d-b95c-aaa98a427d53/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.187427 Aug 10 23:10:06.603146 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1605/3110] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 10 23:10:06 2022] GET /compute/v2.1/servers/23452b78-96cd-430d-b95c-aaa98a427d53/os-volume_attachments => generated 197 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:10:06.626519 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c6bca8bf-dd25-414c-a1a9-c86f99c2d98c tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:10:06.627191 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-c6bca8bf-dd25-414c-a1a9-c86f99c2d98c tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] [instance: 0e60179f-fe8f-48a7-aeb1-9e114e148708] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:10:06.642764 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c6bca8bf-dd25-414c-a1a9-c86f99c2d98c tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:10:06.643297 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c6bca8bf-dd25-414c-a1a9-c86f99c2d98c tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:10:06.643738 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c6bca8bf-dd25-414c-a1a9-c86f99c2d98c tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:10:06.644724 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c6bca8bf-dd25-414c-a1a9-c86f99c2d98c tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:10:06.645192 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c6bca8bf-dd25-414c-a1a9-c86f99c2d98c tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:10:06.645628 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c6bca8bf-dd25-414c-a1a9-c86f99c2d98c tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:10:06.696815 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-ac748bc7-ffe7-439b-912e-644446913e7f tempest-AbsoluteLimitsNegativeTestJSON-1895124698 tempest-AbsoluteLimitsNegativeTestJSON-1895124698-project] Calling method '.version_select at 0x7f847c79c040>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:10:06.703963 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-c6bca8bf-dd25-414c-a1a9-c86f99c2d98c tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] HTTP exception thrown: Instance 0e60179f-fe8f-48a7-aeb1-9e114e148708 could not be found. Aug 10 23:10:06.705663 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c6bca8bf-dd25-414c-a1a9-c86f99c2d98c tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Request method failure captured: Aug 10 23:10:06.705663 n-d-850468-14 devstack@n-api.service[122633]: request: GET /compute/v2.1/servers/0e60179f-fe8f-48a7-aeb1-9e114e148708 HTTP/1.1 Aug 10 23:10:06.705663 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:10:06.705663 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:10:06.705663 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:10:06.705663 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:10:06.705663 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:10:06.705663 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:10:06.705663 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:10:06.705663 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:10:06.705663 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9Do81XwGOyJYZzjDqBUm67v_Q0362_4xQUvU3HvIWmFkKXGTToH86-ip4fxXuu0oxmkucX-Et277q0Z5R4ChTe5MWC8zJ89hWAklZmH6m-N_CAseQK0eUiUfLbiJpjdB2S78hj0EntCCqH4mBVhce2-q9auCyId7qlhsdrU7MIxxCSQ Aug 10 23:10:06.705663 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:10:06.705663 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:10:06.705663 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:10:06.705663 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:10:06.705663 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:10:06.705663 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:10:06.705663 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 708f8d4c4ed6432d85e0bf6a9bac7677 Aug 10 23:10:06.705663 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2080454436 Aug 10 23:10:06.705663 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:10:06.705663 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:10:06.705663 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/708f8d4c4ed6432d85e0bf6a9bac7677"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/708f8d4c4ed6432d85e0bf6a9bac7677"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/708f8d4c4ed6432d85e0bf6a9bac7677"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_708f8d4c4ed6432d85e0bf6a9bac7677", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:10:06.705663 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2080454436 Aug 10 23:10:06.705663 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 708f8d4c4ed6432d85e0bf6a9bac7677 Aug 10 23:10:06.705663 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2080454436 Aug 10 23:10:06.705663 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-ImagesOneServerNegativeTestJSON-2080454436-project Aug 10 23:10:06.705663 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:10:06.705663 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:10:06.705663 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 55bbb4f184e4409d9eed51e0b98dfb29 Aug 10 23:10:06.705663 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2080454436-project Aug 10 23:10:06.705663 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:10:06.705663 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance 0e60179f-fe8f-48a7-aeb1-9e114e148708 could not be found. Aug 10 23:10:06.705663 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': '0e60179f-fe8f-48a7-aeb1-9e114e148708'} Aug 10 23:10:06.705663 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:10:06.705663 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:10:06.705663 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:10:06.705663 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:10:06.705663 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:10:06.705663 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:10:06.705663 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:10:06.705663 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:10:06.705663 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:10:06.705663 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:10:06.705663 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e60179f-fe8f-48a7-aeb1-9e114e148708 could not be found. Aug 10 23:10:06.705663 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:10:06.705663 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:10:06.705663 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:10:06.705663 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:10:06.705663 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:10:06.705663 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:10:06.705663 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:10:06.705663 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:10:06.705663 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:10:06.705663 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:10:06.705663 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:10:06.705663 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:10:06.705663 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:10:06.705663 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:10:06.705663 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:10:06.705663 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:10:06.705663 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e60179f-fe8f-48a7-aeb1-9e114e148708 could not be found. Aug 10 23:10:06.705663 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:10:06.705663 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:10:06.711219 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:10:06.711219 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:10:06.711219 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:10:06.711219 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:10:06.711219 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:10:06.711219 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:10:06.711219 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e60179f-fe8f-48a7-aeb1-9e114e148708 could not be found. Aug 10 23:10:06.711219 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:10:06.721616 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c6bca8bf-dd25-414c-a1a9-c86f99c2d98c tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Returning 404 to user: Instance 0e60179f-fe8f-48a7-aeb1-9e114e148708 could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:10:06.727319 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-c6bca8bf-dd25-414c-a1a9-c86f99c2d98c tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] 10.222.0.58 "GET /compute/v2.1/servers/0e60179f-fe8f-48a7-aeb1-9e114e148708" status: 404 len: 111 microversion: 2.1 time: 0.116544 Aug 10 23:10:06.729229 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1606/3111] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:10:06 2022] GET /compute/v2.1/servers/0e60179f-fe8f-48a7-aeb1-9e114e148708 => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:10:06.750041 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ac748bc7-ffe7-439b-912e-644446913e7f tempest-AbsoluteLimitsNegativeTestJSON-1895124698 tempest-AbsoluteLimitsNegativeTestJSON-1895124698-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:10:06.750555 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ac748bc7-ffe7-439b-912e-644446913e7f tempest-AbsoluteLimitsNegativeTestJSON-1895124698 tempest-AbsoluteLimitsNegativeTestJSON-1895124698-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:10:06.751032 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ac748bc7-ffe7-439b-912e-644446913e7f tempest-AbsoluteLimitsNegativeTestJSON-1895124698 tempest-AbsoluteLimitsNegativeTestJSON-1895124698-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:10:06.756526 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-6b167337-bae1-423d-a1cc-0d0ce99e5e18 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:10:06.757042 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-6b167337-bae1-423d-a1cc-0d0ce99e5e18 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] [instance: 23452b78-96cd-430d-b95c-aaa98a427d53] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:10:06.758194 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ac748bc7-ffe7-439b-912e-644446913e7f tempest-AbsoluteLimitsNegativeTestJSON-1895124698 tempest-AbsoluteLimitsNegativeTestJSON-1895124698-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:10:06.758704 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ac748bc7-ffe7-439b-912e-644446913e7f tempest-AbsoluteLimitsNegativeTestJSON-1895124698 tempest-AbsoluteLimitsNegativeTestJSON-1895124698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:10:06.761557 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ac748bc7-ffe7-439b-912e-644446913e7f tempest-AbsoluteLimitsNegativeTestJSON-1895124698 tempest-AbsoluteLimitsNegativeTestJSON-1895124698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:10:06.787073 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6b167337-bae1-423d-a1cc-0d0ce99e5e18 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:10:06.788874 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6b167337-bae1-423d-a1cc-0d0ce99e5e18 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:10:06.792178 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6b167337-bae1-423d-a1cc-0d0ce99e5e18 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:10:06.793046 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6b167337-bae1-423d-a1cc-0d0ce99e5e18 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:10:06.793529 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6b167337-bae1-423d-a1cc-0d0ce99e5e18 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:10:06.799153 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6b167337-bae1-423d-a1cc-0d0ce99e5e18 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:10:06.853090 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-ac748bc7-ffe7-439b-912e-644446913e7f tempest-AbsoluteLimitsNegativeTestJSON-1895124698 tempest-AbsoluteLimitsNegativeTestJSON-1895124698-project] 10.222.0.58 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.651052 Aug 10 23:10:06.858725 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1506/3112] 10.222.0.58 () {58 vars in 1122 bytes} [Wed Aug 10 23:10:06 2022] GET /compute/v2.1/limits => generated 511 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:10:06.879261 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-842b1c7d-a13c-4903-809f-c29d229f274c tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Calling method '.version_select at 0x7f847c79cf70>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:10:06.932527 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-842b1c7d-a13c-4903-809f-c29d229f274c tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] HTTP exception thrown: Image not found. Aug 10 23:10:06.934897 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-842b1c7d-a13c-4903-809f-c29d229f274c tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Request method failure captured: Aug 10 23:10:06.934897 n-d-850468-14 devstack@n-api.service[122632]: request: DELETE /compute/v2.1/images/2f9233ae-3836-4ac9-a610-f8c1f48d71f0 HTTP/1.1 Aug 10 23:10:06.934897 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:10:06.934897 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:10:06.934897 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:10:06.934897 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 23:10:06.934897 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:10:06.934897 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:10:06.934897 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:10:06.934897 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:10:06.934897 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9Do81XwGOyJYZzjDqBUm67v_Q0362_4xQUvU3HvIWmFkKXGTToH86-ip4fxXuu0oxmkucX-Et277q0Z5R4ChTe5MWC8zJ89hWAklZmH6m-N_CAseQK0eUiUfLbiJpjdB2S78hj0EntCCqH4mBVhce2-q9auCyId7qlhsdrU7MIxxCSQ Aug 10 23:10:06.934897 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:10:06.934897 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:10:06.934897 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:10:06.934897 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:10:06.934897 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:10:06.934897 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:10:06.934897 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 708f8d4c4ed6432d85e0bf6a9bac7677 Aug 10 23:10:06.934897 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2080454436 Aug 10 23:10:06.934897 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:10:06.934897 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:10:06.934897 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/708f8d4c4ed6432d85e0bf6a9bac7677"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/708f8d4c4ed6432d85e0bf6a9bac7677"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/708f8d4c4ed6432d85e0bf6a9bac7677"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_708f8d4c4ed6432d85e0bf6a9bac7677", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:10:06.934897 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2080454436 Aug 10 23:10:06.934897 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 708f8d4c4ed6432d85e0bf6a9bac7677 Aug 10 23:10:06.934897 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2080454436 Aug 10 23:10:06.934897 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-ImagesOneServerNegativeTestJSON-2080454436-project Aug 10 23:10:06.934897 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:10:06.934897 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:10:06.934897 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: 55bbb4f184e4409d9eed51e0b98dfb29 Aug 10 23:10:06.934897 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2080454436-project Aug 10 23:10:06.934897 n-d-850468-14 devstack@n-api.service[122632]: method: Aug 10 23:10:06.934897 n-d-850468-14 devstack@n-api.service[122632]: exception: Image not found. Aug 10 23:10:06.934897 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': '2f9233ae-3836-4ac9-a610-f8c1f48d71f0'} Aug 10 23:10:06.934897 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:10:06.934897 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:10:06.934897 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 10 23:10:06.934897 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 10 23:10:06.934897 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 10 23:10:06.934897 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 10 23:10:06.934897 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 10 23:10:06.934897 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 10 23:10:06.934897 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 10 23:10:06.934897 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 10 23:10:06.934897 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 10 23:10:06.934897 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 10 23:10:06.934897 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 10 23:10:06.934897 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 10 23:10:06.934897 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 10 23:10:06.934897 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 10 23:10:06.934897 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 2f9233ae-3836-4ac9-a610-f8c1f48d71f0 to delete Aug 10 23:10:06.934897 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:10:06.934897 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:10:06.934897 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:10:06.934897 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:10:06.934897 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 10 23:10:06.934897 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 10 23:10:06.934897 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 10 23:10:06.934897 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 10 23:10:06.934897 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 10 23:10:06.934897 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 10 23:10:06.934897 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 2f9233ae-3836-4ac9-a610-f8c1f48d71f0 could not be found. Aug 10 23:10:06.934897 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:10:06.934897 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:10:06.934897 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:10:06.940820 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:10:06.940820 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:10:06.940820 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:10:06.940820 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:10:06.940820 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:10:06.940820 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 23:10:06.940820 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 23:10:06.940820 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:10:06.940820 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:10:06.940820 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 10 23:10:06.940820 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 10 23:10:06.940820 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 10 23:10:06.940820 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:10:06.940820 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:10:06.940820 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:10:06.940820 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:10:06.940820 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:10:06.940820 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:10:06.940820 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:10:06.940820 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:10:06.940820 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 10 23:10:06.940820 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:10:06.946731 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-842b1c7d-a13c-4903-809f-c29d229f274c tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Returning 404 to user: Image not found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:10:06.947673 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:10:06.948145 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-842b1c7d-a13c-4903-809f-c29d229f274c tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] 10.222.0.58 "DELETE /compute/v2.1/images/2f9233ae-3836-4ac9-a610-f8c1f48d71f0" status: 404 len: 62 microversion: 2.1 time: 0.086829 Aug 10 23:10:06.948909 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1507/3113] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:10:06 2022] DELETE /compute/v2.1/images/2f9233ae-3836-4ac9-a610-f8c1f48d71f0 => generated 62 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 10 23:10:06.955058 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-6b167337-bae1-423d-a1cc-0d0ce99e5e18 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] 10.222.0.58 "GET /compute/v2.1/servers/23452b78-96cd-430d-b95c-aaa98a427d53/os-volume_attachments/a22d036c-de48-44b1-b4cb-76c92ea5e7da" status: 200 len: 194 microversion: 2.1 time: 0.223462 Aug 10 23:10:06.960995 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-a0597793-8809-434d-8371-3b59780bf400 tempest-AbsoluteLimitsNegativeTestJSON-1895124698 tempest-AbsoluteLimitsNegativeTestJSON-1895124698-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-387318949", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:10:06.974551 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1607/3114] 10.222.0.58 () {58 vars in 1413 bytes} [Wed Aug 10 23:10:06 2022] GET /compute/v2.1/servers/23452b78-96cd-430d-b95c-aaa98a427d53/os-volume_attachments/a22d036c-de48-44b1-b4cb-76c92ea5e7da => generated 194 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:10:06.997890 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-27fc09d1-3735-4cac-a579-c7067061dd30 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:10:06.998417 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-27fc09d1-3735-4cac-a579-c7067061dd30 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] [instance: d09d04b1-bc37-4290-873e-ce2adae19eaf] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:10:07.028340 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-27fc09d1-3735-4cac-a579-c7067061dd30 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:10:07.028940 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-27fc09d1-3735-4cac-a579-c7067061dd30 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:10:07.029356 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-27fc09d1-3735-4cac-a579-c7067061dd30 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:10:07.032545 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-27fc09d1-3735-4cac-a579-c7067061dd30 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:10:07.033040 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-27fc09d1-3735-4cac-a579-c7067061dd30 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:10:07.037095 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-27fc09d1-3735-4cac-a579-c7067061dd30 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:10:07.166765 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-27fc09d1-3735-4cac-a579-c7067061dd30 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] HTTP exception thrown: Instance d09d04b1-bc37-4290-873e-ce2adae19eaf could not be found. Aug 10 23:10:07.188566 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-27fc09d1-3735-4cac-a579-c7067061dd30 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Request method failure captured: Aug 10 23:10:07.188566 n-d-850468-14 devstack@n-api.service[122633]: request: DELETE /compute/v2.1/servers/d09d04b1-bc37-4290-873e-ce2adae19eaf HTTP/1.1 Aug 10 23:10:07.188566 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:10:07.188566 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:10:07.188566 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:10:07.188566 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:10:07.188566 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:10:07.188566 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:10:07.188566 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:10:07.188566 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:10:07.188566 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9Do81XwGOyJYZzjDqBUm67v_Q0362_4xQUvU3HvIWmFkKXGTToH86-ip4fxXuu0oxmkucX-Et277q0Z5R4ChTe5MWC8zJ89hWAklZmH6m-N_CAseQK0eUiUfLbiJpjdB2S78hj0EntCCqH4mBVhce2-q9auCyId7qlhsdrU7MIxxCSQ Aug 10 23:10:07.188566 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:10:07.188566 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:10:07.188566 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:10:07.188566 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:10:07.188566 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:10:07.188566 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:10:07.188566 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 708f8d4c4ed6432d85e0bf6a9bac7677 Aug 10 23:10:07.188566 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2080454436 Aug 10 23:10:07.188566 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:10:07.188566 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:10:07.188566 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/708f8d4c4ed6432d85e0bf6a9bac7677"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/708f8d4c4ed6432d85e0bf6a9bac7677"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/708f8d4c4ed6432d85e0bf6a9bac7677"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_708f8d4c4ed6432d85e0bf6a9bac7677", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:10:07.188566 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2080454436 Aug 10 23:10:07.188566 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 708f8d4c4ed6432d85e0bf6a9bac7677 Aug 10 23:10:07.188566 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2080454436 Aug 10 23:10:07.188566 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-ImagesOneServerNegativeTestJSON-2080454436-project Aug 10 23:10:07.188566 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:10:07.188566 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:10:07.188566 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 55bbb4f184e4409d9eed51e0b98dfb29 Aug 10 23:10:07.188566 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2080454436-project Aug 10 23:10:07.188566 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:10:07.188566 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance d09d04b1-bc37-4290-873e-ce2adae19eaf could not be found. Aug 10 23:10:07.188566 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': 'd09d04b1-bc37-4290-873e-ce2adae19eaf'} Aug 10 23:10:07.188566 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:10:07.188566 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:10:07.188566 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:10:07.188566 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:10:07.188566 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:10:07.188566 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:10:07.188566 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:10:07.188566 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:10:07.188566 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:10:07.188566 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:10:07.188566 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d09d04b1-bc37-4290-873e-ce2adae19eaf could not be found. Aug 10 23:10:07.188566 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:10:07.188566 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:10:07.188566 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:10:07.188566 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:10:07.188566 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:10:07.188566 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:10:07.188566 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:10:07.188566 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:10:07.188566 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:10:07.188566 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:10:07.188566 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 23:10:07.188566 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 23:10:07.188566 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 23:10:07.188566 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 23:10:07.188566 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:10:07.188566 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:10:07.188566 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:10:07.188566 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:10:07.193613 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d09d04b1-bc37-4290-873e-ce2adae19eaf could not be found. Aug 10 23:10:07.193613 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:10:07.193613 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:10:07.193613 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:10:07.193613 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:10:07.193613 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:10:07.193613 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:10:07.193613 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:10:07.193613 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:10:07.193613 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d09d04b1-bc37-4290-873e-ce2adae19eaf could not be found. Aug 10 23:10:07.193613 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:10:07.193613 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-27fc09d1-3735-4cac-a579-c7067061dd30 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Returning 404 to user: Instance d09d04b1-bc37-4290-873e-ce2adae19eaf could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:10:07.197318 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-27fc09d1-3735-4cac-a579-c7067061dd30 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] 10.222.0.58 "DELETE /compute/v2.1/servers/d09d04b1-bc37-4290-873e-ce2adae19eaf" status: 404 len: 111 microversion: 2.1 time: 0.221400 Aug 10 23:10:07.197947 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1608/3115] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:10:06 2022] DELETE /compute/v2.1/servers/d09d04b1-bc37-4290-873e-ce2adae19eaf => generated 111 bytes in 223 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:10:07.227243 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.network.neutron [None req-a0597793-8809-434d-8371-3b59780bf400 tempest-AbsoluteLimitsNegativeTestJSON-1895124698 tempest-AbsoluteLimitsNegativeTestJSON-1895124698-project] validate_networks() for None {{(pid=122632) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 23:10:07.245567 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-33246c65-b101-4693-8b65-d86f97dfd3fd tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:10:07.246297 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-33246c65-b101-4693-8b65-d86f97dfd3fd tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] [instance: d09d04b1-bc37-4290-873e-ce2adae19eaf] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:10:07.277674 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-33246c65-b101-4693-8b65-d86f97dfd3fd tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:10:07.281514 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-33246c65-b101-4693-8b65-d86f97dfd3fd tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:10:07.283912 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-33246c65-b101-4693-8b65-d86f97dfd3fd tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:10:07.285747 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-33246c65-b101-4693-8b65-d86f97dfd3fd tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:10:07.293101 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-33246c65-b101-4693-8b65-d86f97dfd3fd tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:10:07.293614 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-33246c65-b101-4693-8b65-d86f97dfd3fd tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:10:07.361125 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-33246c65-b101-4693-8b65-d86f97dfd3fd tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] HTTP exception thrown: Instance d09d04b1-bc37-4290-873e-ce2adae19eaf could not be found. Aug 10 23:10:07.364529 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-33246c65-b101-4693-8b65-d86f97dfd3fd tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Request method failure captured: Aug 10 23:10:07.364529 n-d-850468-14 devstack@n-api.service[122633]: request: GET /compute/v2.1/servers/d09d04b1-bc37-4290-873e-ce2adae19eaf HTTP/1.1 Aug 10 23:10:07.364529 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:10:07.364529 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:10:07.364529 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:10:07.364529 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:10:07.364529 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:10:07.364529 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:10:07.364529 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:10:07.364529 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:10:07.364529 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9Do81XwGOyJYZzjDqBUm67v_Q0362_4xQUvU3HvIWmFkKXGTToH86-ip4fxXuu0oxmkucX-Et277q0Z5R4ChTe5MWC8zJ89hWAklZmH6m-N_CAseQK0eUiUfLbiJpjdB2S78hj0EntCCqH4mBVhce2-q9auCyId7qlhsdrU7MIxxCSQ Aug 10 23:10:07.364529 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:10:07.364529 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:10:07.364529 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:10:07.364529 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:10:07.364529 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:10:07.364529 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:10:07.364529 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 708f8d4c4ed6432d85e0bf6a9bac7677 Aug 10 23:10:07.364529 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2080454436 Aug 10 23:10:07.364529 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:10:07.364529 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:10:07.364529 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/708f8d4c4ed6432d85e0bf6a9bac7677"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/708f8d4c4ed6432d85e0bf6a9bac7677"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/708f8d4c4ed6432d85e0bf6a9bac7677"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_708f8d4c4ed6432d85e0bf6a9bac7677", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:10:07.364529 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2080454436 Aug 10 23:10:07.364529 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 708f8d4c4ed6432d85e0bf6a9bac7677 Aug 10 23:10:07.364529 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2080454436 Aug 10 23:10:07.364529 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-ImagesOneServerNegativeTestJSON-2080454436-project Aug 10 23:10:07.364529 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:10:07.364529 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:10:07.364529 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 55bbb4f184e4409d9eed51e0b98dfb29 Aug 10 23:10:07.364529 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2080454436-project Aug 10 23:10:07.364529 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:10:07.364529 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance d09d04b1-bc37-4290-873e-ce2adae19eaf could not be found. Aug 10 23:10:07.364529 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': 'd09d04b1-bc37-4290-873e-ce2adae19eaf'} Aug 10 23:10:07.364529 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:10:07.364529 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:10:07.364529 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:10:07.364529 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:10:07.364529 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:10:07.364529 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:10:07.364529 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:10:07.364529 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:10:07.364529 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:10:07.364529 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:10:07.364529 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d09d04b1-bc37-4290-873e-ce2adae19eaf could not be found. Aug 10 23:10:07.364529 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:10:07.364529 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:10:07.364529 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:10:07.364529 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:10:07.364529 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:10:07.364529 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:10:07.364529 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:10:07.364529 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:10:07.364529 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:10:07.364529 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:10:07.364529 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:10:07.364529 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:10:07.364529 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:10:07.364529 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:10:07.364529 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:10:07.364529 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:10:07.364529 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d09d04b1-bc37-4290-873e-ce2adae19eaf could not be found. Aug 10 23:10:07.364529 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:10:07.364529 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:10:07.368732 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:10:07.368732 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:10:07.368732 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:10:07.368732 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:10:07.368732 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:10:07.368732 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:10:07.368732 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d09d04b1-bc37-4290-873e-ce2adae19eaf could not be found. Aug 10 23:10:07.368732 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:10:07.373290 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-33246c65-b101-4693-8b65-d86f97dfd3fd tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Returning 404 to user: Instance d09d04b1-bc37-4290-873e-ce2adae19eaf could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:10:07.375596 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-33246c65-b101-4693-8b65-d86f97dfd3fd tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] 10.222.0.58 "GET /compute/v2.1/servers/d09d04b1-bc37-4290-873e-ce2adae19eaf" status: 404 len: 111 microversion: 2.1 time: 0.171524 Aug 10 23:10:07.380379 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1609/3116] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:10:07 2022] GET /compute/v2.1/servers/d09d04b1-bc37-4290-873e-ce2adae19eaf => generated 111 bytes in 176 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:10:07.397980 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-a36be91d-f6e0-4d7b-9a22-8cef6464479c tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Calling method '.version_select at 0x7f847d107430>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:10:07.477355 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-a36be91d-f6e0-4d7b-9a22-8cef6464479c tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1383650922" status: 202 len: 0 microversion: 2.1 time: 0.090991 Aug 10 23:10:07.480260 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1610/3117] 10.222.0.58 () {58 vars in 1221 bytes} [Wed Aug 10 23:10:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1383650922 => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:10:09.105915 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-a0597793-8809-434d-8371-3b59780bf400 tempest-AbsoluteLimitsNegativeTestJSON-1895124698 tempest-AbsoluteLimitsNegativeTestJSON-1895124698-project] Getting quotas for project ae3aaebfda7642909b903ba331f9bf4d. Resources: dict_keys(['metadata_items']) {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:10:09.126574 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-a0597793-8809-434d-8371-3b59780bf400 tempest-AbsoluteLimitsNegativeTestJSON-1895124698 tempest-AbsoluteLimitsNegativeTestJSON-1895124698-project] Getting quotas for user 5546e4fd783c4fecbcd38ba61a16ed5e and project ae3aaebfda7642909b903ba331f9bf4d. Resources: dict_keys(['metadata_items']) {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:10:09.174051 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-a0597793-8809-434d-8371-3b59780bf400 tempest-AbsoluteLimitsNegativeTestJSON-1895124698 tempest-AbsoluteLimitsNegativeTestJSON-1895124698-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Aug 10 23:10:09.177302 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-a0597793-8809-434d-8371-3b59780bf400 tempest-AbsoluteLimitsNegativeTestJSON-1895124698 tempest-AbsoluteLimitsNegativeTestJSON-1895124698-project] Request method failure captured: Aug 10 23:10:09.177302 n-d-850468-14 devstack@n-api.service[122632]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 10 23:10:09.177302 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:10:09.177302 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:10:09.177302 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:10:09.177302 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 1751 Aug 10 23:10:09.177302 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:10:09.177302 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:10:09.177302 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:10:09.177302 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:10:09.177302 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9DrNf8utRVe6XaNstQ4mrxKSfg2HErkAZyeqWgysNcmZswWcBgykaGyYA1CVOwjBzCIdGNENobuSR9ACCwY2yuUzpstjiLWn0NYuMC2wfdAmfJDYHWHAsueYqVNTyD5JZwS6mRnsUgOwnRCIbWyaTvQ5t10FNomoMopoVxzOE97r5-I Aug 10 23:10:09.177302 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:10:09.177302 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:10:09.177302 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:10:09.177302 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:10:09.177302 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:10:09.177302 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:10:09.177302 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: ae3aaebfda7642909b903ba331f9bf4d Aug 10 23:10:09.177302 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-1895124698 Aug 10 23:10:09.177302 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:10:09.177302 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:10:09.177302 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ae3aaebfda7642909b903ba331f9bf4d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ae3aaebfda7642909b903ba331f9bf4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ae3aaebfda7642909b903ba331f9bf4d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ae3aaebfda7642909b903ba331f9bf4d", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:10:09.177302 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-1895124698 Aug 10 23:10:09.177302 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: ae3aaebfda7642909b903ba331f9bf4d Aug 10 23:10:09.177302 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-1895124698 Aug 10 23:10:09.177302 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-1895124698-project Aug 10 23:10:09.177302 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:10:09.177302 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:10:09.177302 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: 5546e4fd783c4fecbcd38ba61a16ed5e Aug 10 23:10:09.177302 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-1895124698-project Aug 10 23:10:09.177302 n-d-850468-14 devstack@n-api.service[122632]: Aug 10 23:10:09.177302 n-d-850468-14 devstack@n-api.service[122632]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-387318949", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Aug 10 23:10:09.177302 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:10:09.177302 n-d-850468-14 devstack@n-api.service[122632]: exception: Maximum number of metadata items exceeds 128 Aug 10 23:10:09.179828 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-387318949', 'imageRef': '78ad8905-f66f-4733-8be9-2b260f1fabed', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Aug 10 23:10:09.179828 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:10:09.179828 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:10:09.179828 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 464, in _check_metadata_properties_quota Aug 10 23:10:09.179828 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Aug 10 23:10:09.179828 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 10 23:10:09.179828 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 10 23:10:09.179828 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Aug 10 23:10:09.179828 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Aug 10 23:10:09.179828 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Aug 10 23:10:09.179828 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Aug 10 23:10:09.179828 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Aug 10 23:10:09.179828 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Aug 10 23:10:09.179828 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Aug 10 23:10:09.179828 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:10:09.179828 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:10:09.179828 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:10:09.179828 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:10:09.179828 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 23:10:09.179828 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 23:10:09.179828 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 23:10:09.179828 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 23:10:09.179828 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 10 23:10:09.179828 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Aug 10 23:10:09.179828 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1004, in _checks_for_create_and_rebuild Aug 10 23:10:09.179828 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Aug 10 23:10:09.179828 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 471, in _check_metadata_properties_quota Aug 10 23:10:09.179828 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Aug 10 23:10:09.179828 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Aug 10 23:10:09.179828 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:10:09.179828 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:10:09.179828 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:10:09.179828 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:10:09.179828 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:10:09.179828 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:10:09.179828 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:10:09.179828 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:10:09.179828 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:10:09.179828 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:10:09.179828 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 23:10:09.179828 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 23:10:09.179828 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 23:10:09.179828 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 23:10:09.179828 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 23:10:09.184186 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 23:10:09.184186 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 23:10:09.184186 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Aug 10 23:10:09.184186 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 10 23:10:09.184186 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Aug 10 23:10:09.184186 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:10:09.184186 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:10:09.184186 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:10:09.184186 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:10:09.184186 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:10:09.184186 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:10:09.184186 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:10:09.184186 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:10:09.184186 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Aug 10 23:10:09.184186 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:10:09.184186 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-a0597793-8809-434d-8371-3b59780bf400 tempest-AbsoluteLimitsNegativeTestJSON-1895124698 tempest-AbsoluteLimitsNegativeTestJSON-1895124698-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:10:09.184186 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-a0597793-8809-434d-8371-3b59780bf400 tempest-AbsoluteLimitsNegativeTestJSON-1895124698 tempest-AbsoluteLimitsNegativeTestJSON-1895124698-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 2.232429 Aug 10 23:10:09.185628 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1508/3118] 10.222.0.58 () {60 vars in 1148 bytes} [Wed Aug 10 23:10:06 2022] POST /compute/v2.1/servers => generated 87 bytes in 2235 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) Aug 10 23:10:10.835402 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-e5b94c2f-a400-4e59-9335-116094041536 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Calling method '.version_select at 0x7f847d3dedc0>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:10:10.906146 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-e5b94c2f-a400-4e59-9335-116094041536 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] HTTP exception thrown: Image not found. Aug 10 23:10:10.909043 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-e5b94c2f-a400-4e59-9335-116094041536 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Request method failure captured: Aug 10 23:10:10.909043 n-d-850468-14 devstack@n-api.service[122633]: request: DELETE /compute/v2.1/images/6beb2bde-6a03-437a-8d45-324201eed3e3 HTTP/1.1 Aug 10 23:10:10.909043 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:10:10.909043 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:10:10.909043 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:10:10.909043 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:10:10.909043 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:10:10.909043 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:10:10.909043 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:10:10.909043 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:10:10.909043 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9Do81XwGOyJYZzjDqBUm67v_Q0362_4xQUvU3HvIWmFkKXGTToH86-ip4fxXuu0oxmkucX-Et277q0Z5R4ChTe5MWC8zJ89hWAklZmH6m-N_CAseQK0eUiUfLbiJpjdB2S78hj0EntCCqH4mBVhce2-q9auCyId7qlhsdrU7MIxxCSQ Aug 10 23:10:10.909043 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:10:10.909043 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:10:10.909043 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:10:10.909043 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:10:10.909043 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:10:10.909043 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:10:10.909043 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 708f8d4c4ed6432d85e0bf6a9bac7677 Aug 10 23:10:10.909043 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2080454436 Aug 10 23:10:10.909043 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:10:10.909043 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:10:10.909043 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/708f8d4c4ed6432d85e0bf6a9bac7677"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/708f8d4c4ed6432d85e0bf6a9bac7677"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/708f8d4c4ed6432d85e0bf6a9bac7677"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_708f8d4c4ed6432d85e0bf6a9bac7677", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:10:10.909043 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2080454436 Aug 10 23:10:10.909043 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 708f8d4c4ed6432d85e0bf6a9bac7677 Aug 10 23:10:10.909043 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2080454436 Aug 10 23:10:10.909043 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-ImagesOneServerNegativeTestJSON-2080454436-project Aug 10 23:10:10.909043 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:10:10.909043 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:10:10.909043 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 55bbb4f184e4409d9eed51e0b98dfb29 Aug 10 23:10:10.909043 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2080454436-project Aug 10 23:10:10.909043 n-d-850468-14 devstack@n-api.service[122633]: method: Aug 10 23:10:10.909043 n-d-850468-14 devstack@n-api.service[122633]: exception: Image not found. Aug 10 23:10:10.909043 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': '6beb2bde-6a03-437a-8d45-324201eed3e3'} Aug 10 23:10:10.909043 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:10:10.909043 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:10:10.909043 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 10 23:10:10.909043 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 10 23:10:10.909043 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 10 23:10:10.909043 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 10 23:10:10.909043 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 10 23:10:10.909043 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 10 23:10:10.909043 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 10 23:10:10.909043 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 10 23:10:10.909043 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 10 23:10:10.909043 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 10 23:10:10.909043 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 10 23:10:10.909043 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 10 23:10:10.909043 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 10 23:10:10.909043 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 10 23:10:10.909043 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 6beb2bde-6a03-437a-8d45-324201eed3e3 to delete Aug 10 23:10:10.909043 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:10:10.909043 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:10:10.909043 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:10:10.909043 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:10:10.909043 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 10 23:10:10.909043 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 10 23:10:10.909043 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 10 23:10:10.909043 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 10 23:10:10.909043 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 10 23:10:10.909043 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 10 23:10:10.909043 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 6beb2bde-6a03-437a-8d45-324201eed3e3 could not be found. Aug 10 23:10:10.909043 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:10:10.909043 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:10:10.909043 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:10:10.914044 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:10:10.914044 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:10:10.914044 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:10:10.914044 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:10:10.914044 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:10:10.914044 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 23:10:10.914044 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 23:10:10.914044 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:10:10.914044 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:10:10.914044 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 10 23:10:10.914044 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 10 23:10:10.914044 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 10 23:10:10.914044 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:10:10.914044 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:10:10.914044 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:10:10.914044 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:10:10.914044 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:10:10.914044 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:10:10.914044 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:10:10.914044 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:10:10.914044 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 10 23:10:10.914044 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:10:10.914044 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-e5b94c2f-a400-4e59-9335-116094041536 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Returning 404 to user: Image not found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:10:10.914044 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-e5b94c2f-a400-4e59-9335-116094041536 tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] 10.222.0.58 "DELETE /compute/v2.1/images/6beb2bde-6a03-437a-8d45-324201eed3e3" status: 404 len: 62 microversion: 2.1 time: 0.081373 Aug 10 23:10:10.915720 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1611/3119] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:10:10 2022] DELETE /compute/v2.1/images/6beb2bde-6a03-437a-8d45-324201eed3e3 => generated 62 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 10 23:10:10.921910 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-8d66cafd-8b29-42d0-ae67-bd85a9496ddf tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:10:10.922573 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-8d66cafd-8b29-42d0-ae67-bd85a9496ddf tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] [instance: eea0fab7-447d-4f5f-8577-6ef8df500499] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:10:10.945560 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8d66cafd-8b29-42d0-ae67-bd85a9496ddf tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:10:10.946063 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8d66cafd-8b29-42d0-ae67-bd85a9496ddf tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:10:10.946521 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8d66cafd-8b29-42d0-ae67-bd85a9496ddf tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:10:10.947491 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8d66cafd-8b29-42d0-ae67-bd85a9496ddf tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:10:10.947949 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8d66cafd-8b29-42d0-ae67-bd85a9496ddf tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:10:10.948381 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8d66cafd-8b29-42d0-ae67-bd85a9496ddf tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:10:10.996701 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-8d66cafd-8b29-42d0-ae67-bd85a9496ddf tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] HTTP exception thrown: Instance eea0fab7-447d-4f5f-8577-6ef8df500499 could not be found. Aug 10 23:10:11.001617 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-8d66cafd-8b29-42d0-ae67-bd85a9496ddf tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Request method failure captured: Aug 10 23:10:11.001617 n-d-850468-14 devstack@n-api.service[122632]: request: DELETE /compute/v2.1/servers/eea0fab7-447d-4f5f-8577-6ef8df500499 HTTP/1.1 Aug 10 23:10:11.001617 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:10:11.001617 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:10:11.001617 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:10:11.001617 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 23:10:11.001617 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:10:11.001617 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:10:11.001617 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:10:11.001617 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:10:11.001617 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9Do81XwGOyJYZzjDqBUm67v_Q0362_4xQUvU3HvIWmFkKXGTToH86-ip4fxXuu0oxmkucX-Et277q0Z5R4ChTe5MWC8zJ89hWAklZmH6m-N_CAseQK0eUiUfLbiJpjdB2S78hj0EntCCqH4mBVhce2-q9auCyId7qlhsdrU7MIxxCSQ Aug 10 23:10:11.001617 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:10:11.001617 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:10:11.001617 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:10:11.001617 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:10:11.001617 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:10:11.001617 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:10:11.001617 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 708f8d4c4ed6432d85e0bf6a9bac7677 Aug 10 23:10:11.001617 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2080454436 Aug 10 23:10:11.001617 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:10:11.001617 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:10:11.001617 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/708f8d4c4ed6432d85e0bf6a9bac7677"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/708f8d4c4ed6432d85e0bf6a9bac7677"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/708f8d4c4ed6432d85e0bf6a9bac7677"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_708f8d4c4ed6432d85e0bf6a9bac7677", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:10:11.001617 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2080454436 Aug 10 23:10:11.001617 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 708f8d4c4ed6432d85e0bf6a9bac7677 Aug 10 23:10:11.001617 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2080454436 Aug 10 23:10:11.001617 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-ImagesOneServerNegativeTestJSON-2080454436-project Aug 10 23:10:11.001617 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:10:11.001617 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:10:11.001617 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: 55bbb4f184e4409d9eed51e0b98dfb29 Aug 10 23:10:11.001617 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2080454436-project Aug 10 23:10:11.001617 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:10:11.001617 n-d-850468-14 devstack@n-api.service[122632]: exception: Instance eea0fab7-447d-4f5f-8577-6ef8df500499 could not be found. Aug 10 23:10:11.001617 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': 'eea0fab7-447d-4f5f-8577-6ef8df500499'} Aug 10 23:10:11.001617 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:10:11.001617 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:10:11.001617 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:10:11.001617 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:10:11.001617 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:10:11.001617 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:10:11.001617 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:10:11.001617 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:10:11.001617 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:10:11.001617 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:10:11.001617 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eea0fab7-447d-4f5f-8577-6ef8df500499 could not be found. Aug 10 23:10:11.001617 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:10:11.001617 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:10:11.001617 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:10:11.001617 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:10:11.001617 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:10:11.001617 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:10:11.001617 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:10:11.001617 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:10:11.001617 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:10:11.001617 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:10:11.001617 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 23:10:11.001617 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 23:10:11.001617 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 23:10:11.001617 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 23:10:11.001617 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:10:11.001617 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:10:11.001617 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:10:11.001617 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:10:11.006593 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eea0fab7-447d-4f5f-8577-6ef8df500499 could not be found. Aug 10 23:10:11.006593 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:10:11.006593 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:10:11.006593 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:10:11.006593 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:10:11.006593 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:10:11.006593 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:10:11.006593 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:10:11.006593 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:10:11.006593 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eea0fab7-447d-4f5f-8577-6ef8df500499 could not be found. Aug 10 23:10:11.006593 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:10:11.006593 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-8d66cafd-8b29-42d0-ae67-bd85a9496ddf tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Returning 404 to user: Instance eea0fab7-447d-4f5f-8577-6ef8df500499 could not be found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:10:11.008851 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-8d66cafd-8b29-42d0-ae67-bd85a9496ddf tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] 10.222.0.58 "DELETE /compute/v2.1/servers/eea0fab7-447d-4f5f-8577-6ef8df500499" status: 404 len: 111 microversion: 2.1 time: 0.090787 Aug 10 23:10:11.009627 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1509/3120] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:10:10 2022] DELETE /compute/v2.1/servers/eea0fab7-447d-4f5f-8577-6ef8df500499 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:10:11.018308 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-0d52ce9c-9a0d-4c83-84c1-b43797225d7b tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:10:11.018877 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-0d52ce9c-9a0d-4c83-84c1-b43797225d7b tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] [instance: eea0fab7-447d-4f5f-8577-6ef8df500499] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:10:11.031984 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0d52ce9c-9a0d-4c83-84c1-b43797225d7b tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:10:11.032492 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0d52ce9c-9a0d-4c83-84c1-b43797225d7b tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:10:11.032942 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0d52ce9c-9a0d-4c83-84c1-b43797225d7b tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:10:11.033700 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0d52ce9c-9a0d-4c83-84c1-b43797225d7b tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:10:11.034186 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0d52ce9c-9a0d-4c83-84c1-b43797225d7b tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:10:11.035215 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0d52ce9c-9a0d-4c83-84c1-b43797225d7b tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:10:11.109398 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-0d52ce9c-9a0d-4c83-84c1-b43797225d7b tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] HTTP exception thrown: Instance eea0fab7-447d-4f5f-8577-6ef8df500499 could not be found. Aug 10 23:10:11.115760 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-0d52ce9c-9a0d-4c83-84c1-b43797225d7b tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Request method failure captured: Aug 10 23:10:11.115760 n-d-850468-14 devstack@n-api.service[122633]: request: GET /compute/v2.1/servers/eea0fab7-447d-4f5f-8577-6ef8df500499 HTTP/1.1 Aug 10 23:10:11.115760 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:10:11.115760 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:10:11.115760 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:10:11.115760 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:10:11.115760 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:10:11.115760 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:10:11.115760 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:10:11.115760 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:10:11.115760 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9Do81XwGOyJYZzjDqBUm67v_Q0362_4xQUvU3HvIWmFkKXGTToH86-ip4fxXuu0oxmkucX-Et277q0Z5R4ChTe5MWC8zJ89hWAklZmH6m-N_CAseQK0eUiUfLbiJpjdB2S78hj0EntCCqH4mBVhce2-q9auCyId7qlhsdrU7MIxxCSQ Aug 10 23:10:11.115760 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:10:11.115760 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:10:11.115760 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:10:11.115760 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:10:11.115760 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:10:11.115760 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:10:11.115760 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 708f8d4c4ed6432d85e0bf6a9bac7677 Aug 10 23:10:11.115760 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-2080454436 Aug 10 23:10:11.115760 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:10:11.115760 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:10:11.115760 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/708f8d4c4ed6432d85e0bf6a9bac7677"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/708f8d4c4ed6432d85e0bf6a9bac7677"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/708f8d4c4ed6432d85e0bf6a9bac7677"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_708f8d4c4ed6432d85e0bf6a9bac7677", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:10:11.115760 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-2080454436 Aug 10 23:10:11.115760 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 708f8d4c4ed6432d85e0bf6a9bac7677 Aug 10 23:10:11.115760 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-2080454436 Aug 10 23:10:11.115760 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-ImagesOneServerNegativeTestJSON-2080454436-project Aug 10 23:10:11.115760 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:10:11.115760 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:10:11.115760 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 55bbb4f184e4409d9eed51e0b98dfb29 Aug 10 23:10:11.115760 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-2080454436-project Aug 10 23:10:11.115760 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:10:11.115760 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance eea0fab7-447d-4f5f-8577-6ef8df500499 could not be found. Aug 10 23:10:11.115760 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': 'eea0fab7-447d-4f5f-8577-6ef8df500499'} Aug 10 23:10:11.115760 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:10:11.115760 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:10:11.115760 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:10:11.115760 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:10:11.115760 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:10:11.115760 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:10:11.115760 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:10:11.115760 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:10:11.115760 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:10:11.115760 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:10:11.115760 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eea0fab7-447d-4f5f-8577-6ef8df500499 could not be found. Aug 10 23:10:11.115760 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:10:11.115760 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:10:11.115760 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:10:11.115760 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:10:11.115760 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:10:11.115760 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:10:11.115760 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:10:11.115760 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:10:11.115760 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:10:11.115760 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:10:11.115760 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:10:11.115760 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:10:11.115760 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:10:11.115760 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:10:11.115760 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:10:11.115760 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:10:11.115760 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eea0fab7-447d-4f5f-8577-6ef8df500499 could not be found. Aug 10 23:10:11.115760 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:10:11.115760 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:10:11.120064 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:10:11.120064 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:10:11.120064 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:10:11.120064 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:10:11.120064 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:10:11.120064 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:10:11.120064 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eea0fab7-447d-4f5f-8577-6ef8df500499 could not be found. Aug 10 23:10:11.120064 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:10:11.121905 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-0d52ce9c-9a0d-4c83-84c1-b43797225d7b tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] Returning 404 to user: Instance eea0fab7-447d-4f5f-8577-6ef8df500499 could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:10:11.124346 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-0d52ce9c-9a0d-4c83-84c1-b43797225d7b tempest-ImagesOneServerNegativeTestJSON-2080454436 tempest-ImagesOneServerNegativeTestJSON-2080454436-project] 10.222.0.58 "GET /compute/v2.1/servers/eea0fab7-447d-4f5f-8577-6ef8df500499" status: 404 len: 111 microversion: 2.1 time: 0.110754 Aug 10 23:10:11.131054 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1612/3121] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:10:11 2022] GET /compute/v2.1/servers/eea0fab7-447d-4f5f-8577-6ef8df500499 => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:10:11.407941 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-720c74c0-497d-495b-9d9a-4fb15db58328 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0398ab6a-e4dd-4b85-a953-a8767b9babe3"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:10:11.417703 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-720c74c0-497d-495b-9d9a-4fb15db58328 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] [instance: 23452b78-96cd-430d-b95c-aaa98a427d53] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:10:11.447177 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-720c74c0-497d-495b-9d9a-4fb15db58328 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:10:11.451473 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-720c74c0-497d-495b-9d9a-4fb15db58328 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:10:11.458122 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-720c74c0-497d-495b-9d9a-4fb15db58328 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:10:11.461848 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-720c74c0-497d-495b-9d9a-4fb15db58328 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:10:11.462585 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-720c74c0-497d-495b-9d9a-4fb15db58328 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:10:11.463310 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-720c74c0-497d-495b-9d9a-4fb15db58328 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:10:12.010465 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-4bec3daf-6aa4-440d-a434-444f622bb4fb tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-1607183928", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452", "networks": [{"uuid": "227540ff-e3db-4a79-a3bd-4ee90b0d7aed"}]}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:10:12.058872 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-720c74c0-497d-495b-9d9a-4fb15db58328 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] 10.222.0.58 "POST /compute/v2.1/servers/23452b78-96cd-430d-b95c-aaa98a427d53/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.655976 Aug 10 23:10:12.072012 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1510/3122] 10.222.0.58 () {60 vars in 1323 bytes} [Wed Aug 10 23:10:11 2022] POST /compute/v2.1/servers/23452b78-96cd-430d-b95c-aaa98a427d53/os-volume_attachments => generated 194 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:10:12.156754 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.network.neutron [None req-4bec3daf-6aa4-440d-a434-444f622bb4fb tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] validate_networks() for [('227540ff-e3db-4a79-a3bd-4ee90b0d7aed', None, None, None, None, None)] {{(pid=122633) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 23:10:13.465185 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-4bec3daf-6aa4-440d-a434-444f622bb4fb tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] Flavor limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:10:13.465185 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-4bec3daf-6aa4-440d-a434-444f622bb4fb tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] Image limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:10:13.465877 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-4bec3daf-6aa4-440d-a434-444f622bb4fb tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] Flavor pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:10:13.465877 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-4bec3daf-6aa4-440d-a434-444f622bb4fb tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] Image pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:10:13.466448 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-4bec3daf-6aa4-440d-a434-444f622bb4fb tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:10:13.486649 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4bec3daf-6aa4-440d-a434-444f622bb4fb tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:10:13.487180 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4bec3daf-6aa4-440d-a434-444f622bb4fb tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:10:13.487840 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4bec3daf-6aa4-440d-a434-444f622bb4fb tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:10:13.488592 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4bec3daf-6aa4-440d-a434-444f622bb4fb tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:10:13.497940 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4bec3daf-6aa4-440d-a434-444f622bb4fb tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:10:13.500338 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4bec3daf-6aa4-440d-a434-444f622bb4fb tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:10:13.589157 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-4bec3daf-6aa4-440d-a434-444f622bb4fb tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] Getting quotas for project b00b4016aae8425e96b7046388f0a7de. Resources: {'instances', 'cores', 'ram'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:10:13.612457 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-4bec3daf-6aa4-440d-a434-444f622bb4fb tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] Getting quotas for user 1724aec95222440888977c15a7ed043c and project b00b4016aae8425e96b7046388f0a7de. Resources: {'instances', 'cores', 'ram'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:10:13.657771 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-4bec3daf-6aa4-440d-a434-444f622bb4fb tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] Going to run 1 instances... {{(pid=122633) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 23:10:13.661969 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-4bec3daf-6aa4-440d-a434-444f622bb4fb tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] [instance: 1305bc15-3da1-4fac-886e-29b42b7eedee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78ad8905-f66f-4733-8be9-2b260f1fabed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122633) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 23:10:13.854345 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-4bec3daf-6aa4-440d-a434-444f622bb4fb tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.433322 Aug 10 23:10:13.855413 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1613/3123] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 23:10:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 2446 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 10 23:10:13.868297 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-3f16868f-234c-4f7a-ba14-df89fd27933a tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:10:13.870075 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-3f16868f-234c-4f7a-ba14-df89fd27933a tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] [instance: 1305bc15-3da1-4fac-886e-29b42b7eedee] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:10:13.910656 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:10:14.137336 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-3f16868f-234c-4f7a-ba14-df89fd27933a tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1724aec95222440888977c15a7ed043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b00b4016aae8425e96b7046388f0a7de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:10:14.155227 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-3f16868f-234c-4f7a-ba14-df89fd27933a tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] 10.222.0.58 "GET /compute/v2.1/servers/1305bc15-3da1-4fac-886e-29b42b7eedee" status: 200 len: 1216 microversion: 2.1 time: 0.292894 Aug 10 23:10:14.160452 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1511/3124] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:10:13 2022] GET /compute/v2.1/servers/1305bc15-3da1-4fac-886e-29b42b7eedee => generated 1216 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:10:15.177930 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-6a7b3a90-bc57-4718-979e-705af8e9e0b1 tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:10:15.179198 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-6a7b3a90-bc57-4718-979e-705af8e9e0b1 tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] [instance: 1305bc15-3da1-4fac-886e-29b42b7eedee] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:10:15.203305 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6a7b3a90-bc57-4718-979e-705af8e9e0b1 tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:10:15.203909 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6a7b3a90-bc57-4718-979e-705af8e9e0b1 tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:10:15.206454 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6a7b3a90-bc57-4718-979e-705af8e9e0b1 tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:10:15.207744 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6a7b3a90-bc57-4718-979e-705af8e9e0b1 tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:10:15.208229 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6a7b3a90-bc57-4718-979e-705af8e9e0b1 tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:10:15.208670 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6a7b3a90-bc57-4718-979e-705af8e9e0b1 tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:10:15.599547 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-6a7b3a90-bc57-4718-979e-705af8e9e0b1 tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1724aec95222440888977c15a7ed043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b00b4016aae8425e96b7046388f0a7de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:10:15.611804 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-6a7b3a90-bc57-4718-979e-705af8e9e0b1 tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] 10.222.0.58 "GET /compute/v2.1/servers/1305bc15-3da1-4fac-886e-29b42b7eedee" status: 200 len: 1212 microversion: 2.1 time: 0.439081 Aug 10 23:10:15.613032 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1614/3125] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:10:15 2022] GET /compute/v2.1/servers/1305bc15-3da1-4fac-886e-29b42b7eedee => generated 1212 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:10:16.633021 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-4c07b94e-22d7-474b-a2cf-935f1483ed38 tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:10:16.636585 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-4c07b94e-22d7-474b-a2cf-935f1483ed38 tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] [instance: 1305bc15-3da1-4fac-886e-29b42b7eedee] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:10:16.658621 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4c07b94e-22d7-474b-a2cf-935f1483ed38 tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:10:16.666025 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4c07b94e-22d7-474b-a2cf-935f1483ed38 tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:10:16.669871 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4c07b94e-22d7-474b-a2cf-935f1483ed38 tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:10:16.672242 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4c07b94e-22d7-474b-a2cf-935f1483ed38 tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:10:16.672944 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4c07b94e-22d7-474b-a2cf-935f1483ed38 tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:10:16.676236 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4c07b94e-22d7-474b-a2cf-935f1483ed38 tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:10:16.739648 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:10:16.797422 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=2 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:10:17.167946 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-4c07b94e-22d7-474b-a2cf-935f1483ed38 tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1724aec95222440888977c15a7ed043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b00b4016aae8425e96b7046388f0a7de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:10:17.181166 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-4c07b94e-22d7-474b-a2cf-935f1483ed38 tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] 10.222.0.58 "GET /compute/v2.1/servers/1305bc15-3da1-4fac-886e-29b42b7eedee" status: 200 len: 1274 microversion: 2.1 time: 0.552731 Aug 10 23:10:17.184896 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1512/3126] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:10:16 2022] GET /compute/v2.1/servers/1305bc15-3da1-4fac-886e-29b42b7eedee => generated 1274 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:10:18.211242 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-07f28365-3321-448c-9181-efbc8d6b4eb9 tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:10:18.212034 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-07f28365-3321-448c-9181-efbc8d6b4eb9 tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] [instance: 1305bc15-3da1-4fac-886e-29b42b7eedee] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:10:18.239166 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-07f28365-3321-448c-9181-efbc8d6b4eb9 tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:10:18.247566 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-07f28365-3321-448c-9181-efbc8d6b4eb9 tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:10:18.251334 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-07f28365-3321-448c-9181-efbc8d6b4eb9 tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:10:18.252676 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-07f28365-3321-448c-9181-efbc8d6b4eb9 tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:10:18.257759 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-07f28365-3321-448c-9181-efbc8d6b4eb9 tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:10:18.260642 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-07f28365-3321-448c-9181-efbc8d6b4eb9 tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:10:19.327610 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-07f28365-3321-448c-9181-efbc8d6b4eb9 tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1724aec95222440888977c15a7ed043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b00b4016aae8425e96b7046388f0a7de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:10:19.344010 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-07f28365-3321-448c-9181-efbc8d6b4eb9 tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] 10.222.0.58 "GET /compute/v2.1/servers/1305bc15-3da1-4fac-886e-29b42b7eedee" status: 200 len: 1316 microversion: 2.1 time: 1.133888 Aug 10 23:10:19.349862 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1615/3127] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:10:18 2022] GET /compute/v2.1/servers/1305bc15-3da1-4fac-886e-29b42b7eedee => generated 1316 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:10:20.371001 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-e3dcbbfe-fb8a-4404-8ef6-06b2830f8f58 tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:10:20.371615 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-e3dcbbfe-fb8a-4404-8ef6-06b2830f8f58 tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] [instance: 1305bc15-3da1-4fac-886e-29b42b7eedee] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:10:20.393478 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e3dcbbfe-fb8a-4404-8ef6-06b2830f8f58 tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:10:20.394909 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e3dcbbfe-fb8a-4404-8ef6-06b2830f8f58 tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:10:20.395461 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e3dcbbfe-fb8a-4404-8ef6-06b2830f8f58 tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:10:20.396194 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e3dcbbfe-fb8a-4404-8ef6-06b2830f8f58 tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:10:20.396759 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e3dcbbfe-fb8a-4404-8ef6-06b2830f8f58 tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:10:20.399758 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e3dcbbfe-fb8a-4404-8ef6-06b2830f8f58 tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:10:21.938819 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-d7cf4c68-9ff0-49f7-a1d2-b682b4b2434c req-ab2ac93c-a32c-4352-a954-632a2b06cb51 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1305bc15-3da1-4fac-886e-29b42b7eedee", "tag": "1dd777d0-696c-45ae-946b-2427e186f7f2"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:10:21.970428 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_api:SELECT=67,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:10:21.973885 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-d7cf4c68-9ff0-49f7-a1d2-b682b4b2434c req-ab2ac93c-a32c-4352-a954-632a2b06cb51 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:10:21.974772 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-d7cf4c68-9ff0-49f7-a1d2-b682b4b2434c req-ab2ac93c-a32c-4352-a954-632a2b06cb51 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:10:21.975731 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-d7cf4c68-9ff0-49f7-a1d2-b682b4b2434c req-ab2ac93c-a32c-4352-a954-632a2b06cb51 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:10:22.029888 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-d7cf4c68-9ff0-49f7-a1d2-b682b4b2434c req-ab2ac93c-a32c-4352-a954-632a2b06cb51 service nova] Creating event network-changed:1dd777d0-696c-45ae-946b-2427e186f7f2 for instance 1305bc15-3da1-4fac-886e-29b42b7eedee on n-h1-850468-14 Aug 10 23:10:22.054549 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-d7cf4c68-9ff0-49f7-a1d2-b682b4b2434c req-ab2ac93c-a32c-4352-a954-632a2b06cb51 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117632 Aug 10 23:10:22.056516 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1616/3128] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:10:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:10:22.122499 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-e3dcbbfe-fb8a-4404-8ef6-06b2830f8f58 tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1724aec95222440888977c15a7ed043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b00b4016aae8425e96b7046388f0a7de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:10:22.145063 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-e3dcbbfe-fb8a-4404-8ef6-06b2830f8f58 tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] 10.222.0.58 "GET /compute/v2.1/servers/1305bc15-3da1-4fac-886e-29b42b7eedee" status: 200 len: 1316 microversion: 2.1 time: 1.775705 Aug 10 23:10:22.147109 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1513/3129] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:10:20 2022] GET /compute/v2.1/servers/1305bc15-3da1-4fac-886e-29b42b7eedee => generated 1316 bytes in 1780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:10:23.171748 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-39236df3-d521-4f4a-b3be-9b803e6357c6 tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:10:23.173103 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-39236df3-d521-4f4a-b3be-9b803e6357c6 tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] [instance: 1305bc15-3da1-4fac-886e-29b42b7eedee] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:10:23.185883 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-39236df3-d521-4f4a-b3be-9b803e6357c6 tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:10:23.186715 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-39236df3-d521-4f4a-b3be-9b803e6357c6 tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:10:23.187803 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-39236df3-d521-4f4a-b3be-9b803e6357c6 tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:10:23.188945 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-39236df3-d521-4f4a-b3be-9b803e6357c6 tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:10:23.190195 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-39236df3-d521-4f4a-b3be-9b803e6357c6 tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:10:23.192139 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-39236df3-d521-4f4a-b3be-9b803e6357c6 tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:10:23.558693 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=2 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:10:23.636403 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=6 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:10:24.438019 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-39236df3-d521-4f4a-b3be-9b803e6357c6 tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1724aec95222440888977c15a7ed043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b00b4016aae8425e96b7046388f0a7de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:10:24.478253 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-39236df3-d521-4f4a-b3be-9b803e6357c6 tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] 10.222.0.58 "GET /compute/v2.1/servers/1305bc15-3da1-4fac-886e-29b42b7eedee" status: 200 len: 1316 microversion: 2.1 time: 1.314911 Aug 10 23:10:24.480147 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1617/3130] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:10:23 2022] GET /compute/v2.1/servers/1305bc15-3da1-4fac-886e-29b42b7eedee => generated 1316 bytes in 1318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:10:25.509071 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-950b50b7-8397-48c7-b8e9-d106a3e24588 tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:10:25.511988 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-950b50b7-8397-48c7-b8e9-d106a3e24588 tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] [instance: 1305bc15-3da1-4fac-886e-29b42b7eedee] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:10:25.537692 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=32 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:10:25.556542 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-950b50b7-8397-48c7-b8e9-d106a3e24588 tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:10:25.557992 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-950b50b7-8397-48c7-b8e9-d106a3e24588 tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:10:25.558676 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-950b50b7-8397-48c7-b8e9-d106a3e24588 tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:10:25.561635 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-950b50b7-8397-48c7-b8e9-d106a3e24588 tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:10:25.562404 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-950b50b7-8397-48c7-b8e9-d106a3e24588 tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:10:25.563357 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-950b50b7-8397-48c7-b8e9-d106a3e24588 tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:10:26.859300 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-950b50b7-8397-48c7-b8e9-d106a3e24588 tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1724aec95222440888977c15a7ed043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b00b4016aae8425e96b7046388f0a7de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:10:26.880208 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-950b50b7-8397-48c7-b8e9-d106a3e24588 tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] 10.222.0.58 "GET /compute/v2.1/servers/1305bc15-3da1-4fac-886e-29b42b7eedee" status: 200 len: 1316 microversion: 2.1 time: 1.381650 Aug 10 23:10:26.881119 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1514/3131] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:10:25 2022] GET /compute/v2.1/servers/1305bc15-3da1-4fac-886e-29b42b7eedee => generated 1316 bytes in 1385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:10:27.907089 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-2aee3e45-b232-4997-8421-83367b64e9b2 tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:10:27.908335 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-2aee3e45-b232-4997-8421-83367b64e9b2 tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] [instance: 1305bc15-3da1-4fac-886e-29b42b7eedee] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:10:27.927922 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2aee3e45-b232-4997-8421-83367b64e9b2 tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:10:27.928514 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2aee3e45-b232-4997-8421-83367b64e9b2 tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:10:27.929170 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2aee3e45-b232-4997-8421-83367b64e9b2 tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:10:27.930171 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2aee3e45-b232-4997-8421-83367b64e9b2 tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:10:27.930830 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2aee3e45-b232-4997-8421-83367b64e9b2 tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:10:27.931434 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2aee3e45-b232-4997-8421-83367b64e9b2 tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:10:29.262062 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-2aee3e45-b232-4997-8421-83367b64e9b2 tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1724aec95222440888977c15a7ed043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b00b4016aae8425e96b7046388f0a7de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:10:29.276016 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-2aee3e45-b232-4997-8421-83367b64e9b2 tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] 10.222.0.58 "GET /compute/v2.1/servers/1305bc15-3da1-4fac-886e-29b42b7eedee" status: 200 len: 1316 microversion: 2.1 time: 1.375551 Aug 10 23:10:29.279916 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1618/3132] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:10:27 2022] GET /compute/v2.1/servers/1305bc15-3da1-4fac-886e-29b42b7eedee => generated 1316 bytes in 1380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:10:30.302942 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-d1527714-c717-4616-873b-7b8e61dba042 tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:10:30.303758 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-d1527714-c717-4616-873b-7b8e61dba042 tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] [instance: 1305bc15-3da1-4fac-886e-29b42b7eedee] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:10:30.338680 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d1527714-c717-4616-873b-7b8e61dba042 tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:10:30.340422 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d1527714-c717-4616-873b-7b8e61dba042 tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:10:30.356657 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d1527714-c717-4616-873b-7b8e61dba042 tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:10:30.360678 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d1527714-c717-4616-873b-7b8e61dba042 tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:10:30.365350 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d1527714-c717-4616-873b-7b8e61dba042 tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:10:30.369890 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d1527714-c717-4616-873b-7b8e61dba042 tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:10:30.859873 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-11d522b9-ec43-4d52-b819-12958bdf2584 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:10:30.863747 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-11d522b9-ec43-4d52-b819-12958bdf2584 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] [instance: 23452b78-96cd-430d-b95c-aaa98a427d53] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:10:30.883065 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-11d522b9-ec43-4d52-b819-12958bdf2584 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:10:30.885044 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-11d522b9-ec43-4d52-b819-12958bdf2584 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:10:30.887753 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-11d522b9-ec43-4d52-b819-12958bdf2584 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:10:30.890320 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-11d522b9-ec43-4d52-b819-12958bdf2584 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:10:30.895177 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-11d522b9-ec43-4d52-b819-12958bdf2584 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:10:30.896268 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-11d522b9-ec43-4d52-b819-12958bdf2584 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:10:30.994296 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-d1527714-c717-4616-873b-7b8e61dba042 tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1724aec95222440888977c15a7ed043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b00b4016aae8425e96b7046388f0a7de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:10:31.004570 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-d1527714-c717-4616-873b-7b8e61dba042 tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] 10.222.0.58 "GET /compute/v2.1/servers/1305bc15-3da1-4fac-886e-29b42b7eedee" status: 200 len: 1316 microversion: 2.1 time: 0.707174 Aug 10 23:10:31.004726 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-11d522b9-ec43-4d52-b819-12958bdf2584 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] 10.222.0.58 "GET /compute/v2.1/servers/23452b78-96cd-430d-b95c-aaa98a427d53/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.151906 Aug 10 23:10:31.005170 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1515/3133] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:10:30 2022] GET /compute/v2.1/servers/1305bc15-3da1-4fac-886e-29b42b7eedee => generated 1316 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:10:31.015852 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1619/3134] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 10 23:10:30 2022] GET /compute/v2.1/servers/23452b78-96cd-430d-b95c-aaa98a427d53/os-volume_attachments => generated 371 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:10:31.165902 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-6309ed7e-b8b7-4c8f-ba2b-b0988fc0eb89 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:10:31.167897 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-6309ed7e-b8b7-4c8f-ba2b-b0988fc0eb89 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] [instance: 23452b78-96cd-430d-b95c-aaa98a427d53] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:10:31.191560 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6309ed7e-b8b7-4c8f-ba2b-b0988fc0eb89 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:10:31.194622 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6309ed7e-b8b7-4c8f-ba2b-b0988fc0eb89 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:10:31.195975 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6309ed7e-b8b7-4c8f-ba2b-b0988fc0eb89 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:10:31.200519 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6309ed7e-b8b7-4c8f-ba2b-b0988fc0eb89 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:10:31.203336 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6309ed7e-b8b7-4c8f-ba2b-b0988fc0eb89 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:10:31.204110 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6309ed7e-b8b7-4c8f-ba2b-b0988fc0eb89 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:10:31.294055 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-6309ed7e-b8b7-4c8f-ba2b-b0988fc0eb89 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] 10.222.0.58 "GET /compute/v2.1/servers/23452b78-96cd-430d-b95c-aaa98a427d53/os-volume_attachments/a22d036c-de48-44b1-b4cb-76c92ea5e7da" status: 200 len: 194 microversion: 2.1 time: 0.142951 Aug 10 23:10:31.295213 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1516/3135] 10.222.0.58 () {58 vars in 1413 bytes} [Wed Aug 10 23:10:31 2022] GET /compute/v2.1/servers/23452b78-96cd-430d-b95c-aaa98a427d53/os-volume_attachments/a22d036c-de48-44b1-b4cb-76c92ea5e7da => generated 194 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:10:31.305748 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-45643b7f-51a7-4966-8b80-dae2a1ac0d07 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:10:31.306257 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-45643b7f-51a7-4966-8b80-dae2a1ac0d07 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] [instance: 23452b78-96cd-430d-b95c-aaa98a427d53] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:10:31.324869 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-45643b7f-51a7-4966-8b80-dae2a1ac0d07 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:10:31.325543 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-45643b7f-51a7-4966-8b80-dae2a1ac0d07 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:10:31.325543 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-45643b7f-51a7-4966-8b80-dae2a1ac0d07 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:10:31.327269 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-45643b7f-51a7-4966-8b80-dae2a1ac0d07 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:10:31.327733 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-45643b7f-51a7-4966-8b80-dae2a1ac0d07 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:10:31.330341 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-45643b7f-51a7-4966-8b80-dae2a1ac0d07 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:10:31.507832 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-06c5d6aa-8e60-4ef5-b434-57bf8fe55da1 req-58fd1845-e032-4e4e-8c25-95326d550d75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1305bc15-3da1-4fac-886e-29b42b7eedee", "name": "network-vif-plugged", "status": "completed", "tag": "1dd777d0-696c-45ae-946b-2427e186f7f2"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:10:31.542282 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-06c5d6aa-8e60-4ef5-b434-57bf8fe55da1 req-58fd1845-e032-4e4e-8c25-95326d550d75 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:10:31.542770 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-06c5d6aa-8e60-4ef5-b434-57bf8fe55da1 req-58fd1845-e032-4e4e-8c25-95326d550d75 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:10:31.543234 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-06c5d6aa-8e60-4ef5-b434-57bf8fe55da1 req-58fd1845-e032-4e4e-8c25-95326d550d75 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:10:31.573374 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-06c5d6aa-8e60-4ef5-b434-57bf8fe55da1 req-58fd1845-e032-4e4e-8c25-95326d550d75 service nova] Creating event network-vif-plugged:1dd777d0-696c-45ae-946b-2427e186f7f2 for instance 1305bc15-3da1-4fac-886e-29b42b7eedee on n-h1-850468-14 Aug 10 23:10:31.584461 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.objects.instance [None req-45643b7f-51a7-4966-8b80-dae2a1ac0d07 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lazy-loading 'services' on Instance uuid 23452b78-96cd-430d-b95c-aaa98a427d53 {{(pid=122633) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:10:31.598953 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-06c5d6aa-8e60-4ef5-b434-57bf8fe55da1 req-58fd1845-e032-4e4e-8c25-95326d550d75 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095925 Aug 10 23:10:31.604675 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1517/3136] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:10:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 23:10:31.778475 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-45643b7f-51a7-4966-8b80-dae2a1ac0d07 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] 10.222.0.58 "DELETE /compute/v2.1/servers/23452b78-96cd-430d-b95c-aaa98a427d53/os-volume_attachments/a22d036c-de48-44b1-b4cb-76c92ea5e7da" status: 202 len: 0 microversion: 2.1 time: 0.476798 Aug 10 23:10:31.781283 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1620/3137] 10.222.0.58 () {58 vars in 1416 bytes} [Wed Aug 10 23:10:31 2022] DELETE /compute/v2.1/servers/23452b78-96cd-430d-b95c-aaa98a427d53/os-volume_attachments/a22d036c-de48-44b1-b4cb-76c92ea5e7da => generated 0 bytes in 480 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:10:32.033701 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-2f2f5a9f-dd3a-42c7-bdb3-1d8ff78b55cc tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:10:32.036079 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-2f2f5a9f-dd3a-42c7-bdb3-1d8ff78b55cc tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] [instance: 1305bc15-3da1-4fac-886e-29b42b7eedee] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:10:32.048815 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2f2f5a9f-dd3a-42c7-bdb3-1d8ff78b55cc tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:10:32.050107 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2f2f5a9f-dd3a-42c7-bdb3-1d8ff78b55cc tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:10:32.051069 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2f2f5a9f-dd3a-42c7-bdb3-1d8ff78b55cc tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:10:32.052532 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2f2f5a9f-dd3a-42c7-bdb3-1d8ff78b55cc tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:10:32.053219 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2f2f5a9f-dd3a-42c7-bdb3-1d8ff78b55cc tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:10:32.053842 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2f2f5a9f-dd3a-42c7-bdb3-1d8ff78b55cc tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:10:33.817836 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-2f2f5a9f-dd3a-42c7-bdb3-1d8ff78b55cc tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1724aec95222440888977c15a7ed043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b00b4016aae8425e96b7046388f0a7de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:10:33.849555 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-2f2f5a9f-dd3a-42c7-bdb3-1d8ff78b55cc tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] 10.222.0.58 "GET /compute/v2.1/servers/1305bc15-3da1-4fac-886e-29b42b7eedee" status: 200 len: 1316 microversion: 2.1 time: 1.820986 Aug 10 23:10:33.866495 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1518/3138] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:10:32 2022] GET /compute/v2.1/servers/1305bc15-3da1-4fac-886e-29b42b7eedee => generated 1316 bytes in 1828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:10:34.884875 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-3ed3bcf5-360e-400a-9aa9-e459a21d8fb3 tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:10:34.886383 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-3ed3bcf5-360e-400a-9aa9-e459a21d8fb3 tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] [instance: 1305bc15-3da1-4fac-886e-29b42b7eedee] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:10:34.899662 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3ed3bcf5-360e-400a-9aa9-e459a21d8fb3 tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:10:34.906894 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3ed3bcf5-360e-400a-9aa9-e459a21d8fb3 tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:10:34.910072 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3ed3bcf5-360e-400a-9aa9-e459a21d8fb3 tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:10:34.912554 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3ed3bcf5-360e-400a-9aa9-e459a21d8fb3 tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:10:34.914914 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3ed3bcf5-360e-400a-9aa9-e459a21d8fb3 tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:10:34.915987 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3ed3bcf5-360e-400a-9aa9-e459a21d8fb3 tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:10:35.209164 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-b664532f-0df8-4111-bf3d-431426199e53 tempest-KeyPairsNegativeTestJSON-1035250135 tempest-KeyPairsNegativeTestJSON-1035250135-project] Action: 'create', calling method: .version_select at 0x7f847cf211f0>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAPt7101hlfxy9zjsczeCuKR8vUdl99TVS0qugjeIhVSlXTWDzSjCbcjh9DHSsi3BBCqzT5uaRHQcXSWyBV38PGJaGPADXANA0xZBOqEim8or14P5sGNu1HDfKb7VVglWQ=="}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:10:35.214749 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-b664532f-0df8-4111-bf3d-431426199e53 tempest-KeyPairsNegativeTestJSON-1035250135 tempest-KeyPairsNegativeTestJSON-1035250135-project] Request method failure captured: Aug 10 23:10:35.214749 n-d-850468-14 devstack@n-api.service[122633]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 10 23:10:35.214749 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:10:35.214749 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:10:35.214749 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:10:35.214749 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 257 Aug 10 23:10:35.214749 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:10:35.214749 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:10:35.214749 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:10:35.214749 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:10:35.214749 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9DrqpsiHcdvhtNWcCz3D6NdRJLQNV5bQ5CDJabqFZOFJGL72MibuJpEHW_T7PzEsFEU7zKxgNTqmVf4Tzk-woaa2HZbuvuKMYNqz7fLMLTSV7uwKf6T3auuT1OZy4MA7Kakw5NNE5pzkFiuUBKO6rOmpz3kme0u4PKbz-4obfo54Xbo Aug 10 23:10:35.214749 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:10:35.214749 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:10:35.214749 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:10:35.214749 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:10:35.214749 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:10:35.214749 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:10:35.214749 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 5f33c16b6f5b4ab0a8dfaaa92e363f0f Aug 10 23:10:35.214749 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1035250135 Aug 10 23:10:35.214749 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:10:35.214749 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:10:35.214749 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5f33c16b6f5b4ab0a8dfaaa92e363f0f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5f33c16b6f5b4ab0a8dfaaa92e363f0f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/5f33c16b6f5b4ab0a8dfaaa92e363f0f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_5f33c16b6f5b4ab0a8dfaaa92e363f0f", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:10:35.214749 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1035250135 Aug 10 23:10:35.214749 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 5f33c16b6f5b4ab0a8dfaaa92e363f0f Aug 10 23:10:35.214749 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1035250135 Aug 10 23:10:35.214749 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-KeyPairsNegativeTestJSON-1035250135-project Aug 10 23:10:35.214749 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:10:35.214749 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:10:35.214749 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 328e45be94f343c0b26583a12456ecca Aug 10 23:10:35.214749 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1035250135-project Aug 10 23:10:35.214749 n-d-850468-14 devstack@n-api.service[122633]: Aug 10 23:10:35.214749 n-d-850468-14 devstack@n-api.service[122633]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAPt7101hlfxy9zjsczeCuKR8vUdl99TVS0qugjeIhVSlXTWDzSjCbcjh9DHSsi3BBCqzT5uaRHQcXSWyBV38PGJaGPADXANA0xZBOqEim8or14P5sGNu1HDfKb7VVglWQ=="}} Aug 10 23:10:35.214749 n-d-850468-14 devstack@n-api.service[122633]: method: Aug 10 23:10:35.214749 n-d-850468-14 devstack@n-api.service[122633]: exception: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Aug 10 23:10:35.214749 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAPt7101hlfxy9zjsczeCuKR8vUdl99TVS0qugjeIhVSlXTWDzSjCbcjh9DHSsi3BBCqzT5uaRHQcXSWyBV38PGJaGPADXANA0xZBOqEim8or14P5sGNu1HDfKb7VVglWQ=='}}} Aug 10 23:10:35.214749 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:10:35.214749 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:10:35.214749 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Aug 10 23:10:35.214749 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi result = func(instance) Aug 10 23:10:35.214749 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 161, in _validate_keypair_name_20 Aug 10 23:10:35.214749 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return _validate_keypair_name(keypair_name, safe_chars) Aug 10 23:10:35.214749 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 175, in _validate_keypair_name Aug 10 23:10:35.214749 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InvalidName(reason=reason) Aug 10 23:10:35.214749 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InvalidName: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Aug 10 23:10:35.214749 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:10:35.214749 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 10 23:10:35.214749 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:10:35.214749 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:10:35.214749 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 10 23:10:35.214749 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 10 23:10:35.214749 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 10 23:10:35.214749 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise error Aug 10 23:10:35.214749 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'key_/.\\@:' is not a 'keypair_name_20' Aug 10 23:10:35.214749 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:10:35.214749 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['keypair']['properties']['name']['allOf'][1]: Aug 10 23:10:35.214749 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi {'format': 'keypair_name_20', Aug 10 23:10:35.214749 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi 'maxLength': 255, Aug 10 23:10:35.214749 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi 'minLength': 1, Aug 10 23:10:35.214749 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi 'type': 'string'} Aug 10 23:10:35.214749 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:10:35.214749 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi On instance['keypair']['name']: Aug 10 23:10:35.214749 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi 'key_/.\\@:' Aug 10 23:10:35.214749 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:10:35.220249 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:10:35.220249 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:10:35.220249 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:10:35.220249 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:10:35.220249 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:10:35.220249 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:10:35.220249 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:10:35.220249 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 23:10:35.220249 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 23:10:35.220249 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:10:35.220249 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:10:35.220249 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 23:10:35.220249 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 23:10:35.220249 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 10 23:10:35.220249 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 10 23:10:35.220249 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 10 23:10:35.220249 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 10 23:10:35.220249 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 10 23:10:35.220249 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 10 23:10:35.220249 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Aug 10 23:10:35.220249 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:10:35.220249 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:10:35.220249 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:10:35.220249 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:10:35.220249 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:10:35.220249 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:10:35.220249 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 10 23:10:35.220249 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 10 23:10:35.220249 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Aug 10 23:10:35.220249 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:10:35.220249 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-b664532f-0df8-4111-bf3d-431426199e53 tempest-KeyPairsNegativeTestJSON-1035250135 tempest-KeyPairsNegativeTestJSON-1035250135-project] Returning 400 to user: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:10:35.227938 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-b664532f-0df8-4111-bf3d-431426199e53 tempest-KeyPairsNegativeTestJSON-1035250135 tempest-KeyPairsNegativeTestJSON-1035250135-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 400 len: 193 microversion: 2.1 time: 0.760784 Aug 10 23:10:35.228554 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1621/3139] 10.222.0.58 () {60 vars in 1159 bytes} [Wed Aug 10 23:10:34 2022] POST /compute/v2.1/os-keypairs => generated 193 bytes in 763 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 10 23:10:35.273407 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-1ea2db52-0b40-4bec-9f48-faf183dd047d tempest-KeyPairsNegativeTestJSON-1035250135 tempest-KeyPairsNegativeTestJSON-1035250135-project] Action: 'create', calling method: .version_select at 0x7f847d075040>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1079475384", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:10:35.341180 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-1ea2db52-0b40-4bec-9f48-faf183dd047d tempest-KeyPairsNegativeTestJSON-1035250135 tempest-KeyPairsNegativeTestJSON-1035250135-project] Getting quotas for project 5f33c16b6f5b4ab0a8dfaaa92e363f0f. Resources: {'key_pairs'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:10:35.368943 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-1ea2db52-0b40-4bec-9f48-faf183dd047d tempest-KeyPairsNegativeTestJSON-1035250135 tempest-KeyPairsNegativeTestJSON-1035250135-project] Getting quotas for user 328e45be94f343c0b26583a12456ecca and project 5f33c16b6f5b4ab0a8dfaaa92e363f0f. Resources: {'key_pairs'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:10:35.452812 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-1ea2db52-0b40-4bec-9f48-faf183dd047d tempest-KeyPairsNegativeTestJSON-1035250135 tempest-KeyPairsNegativeTestJSON-1035250135-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Aug 10 23:10:35.473646 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-1ea2db52-0b40-4bec-9f48-faf183dd047d tempest-KeyPairsNegativeTestJSON-1035250135 tempest-KeyPairsNegativeTestJSON-1035250135-project] Request method failure captured: Aug 10 23:10:35.473646 n-d-850468-14 devstack@n-api.service[122633]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 10 23:10:35.473646 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:10:35.473646 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:10:35.473646 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:10:35.473646 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 2167 Aug 10 23:10:35.473646 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:10:35.473646 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:10:35.473646 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:10:35.473646 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:10:35.473646 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9DrqpsiHcdvhtNWcCz3D6NdRJLQNV5bQ5CDJabqFZOFJGL72MibuJpEHW_T7PzEsFEU7zKxgNTqmVf4Tzk-woaa2HZbuvuKMYNqz7fLMLTSV7uwKf6T3auuT1OZy4MA7Kakw5NNE5pzkFiuUBKO6rOmpz3kme0u4PKbz-4obfo54Xbo Aug 10 23:10:35.473646 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:10:35.473646 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:10:35.473646 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:10:35.473646 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:10:35.473646 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:10:35.473646 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:10:35.473646 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 5f33c16b6f5b4ab0a8dfaaa92e363f0f Aug 10 23:10:35.473646 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1035250135 Aug 10 23:10:35.473646 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:10:35.473646 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:10:35.473646 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5f33c16b6f5b4ab0a8dfaaa92e363f0f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5f33c16b6f5b4ab0a8dfaaa92e363f0f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/5f33c16b6f5b4ab0a8dfaaa92e363f0f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_5f33c16b6f5b4ab0a8dfaaa92e363f0f", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:10:35.473646 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1035250135 Aug 10 23:10:35.473646 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 5f33c16b6f5b4ab0a8dfaaa92e363f0f Aug 10 23:10:35.473646 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1035250135 Aug 10 23:10:35.473646 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-KeyPairsNegativeTestJSON-1035250135-project Aug 10 23:10:35.473646 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:10:35.473646 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:10:35.473646 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 328e45be94f343c0b26583a12456ecca Aug 10 23:10:35.473646 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1035250135-project Aug 10 23:10:35.473646 n-d-850468-14 devstack@n-api.service[122633]: Aug 10 23:10:35.473646 n-d-850468-14 devstack@n-api.service[122633]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1079475384", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Aug 10 23:10:35.473646 n-d-850468-14 devstack@n-api.service[122633]: method: Aug 10 23:10:35.473646 n-d-850468-14 devstack@n-api.service[122633]: exception: Keypair data is invalid: failed to generate fingerprint Aug 10 23:10:35.483006 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1079475384', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Aug 10 23:10:35.483006 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:10:35.483006 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:10:35.483006 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Aug 10 23:10:35.483006 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Aug 10 23:10:35.483006 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Aug 10 23:10:35.483006 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Aug 10 23:10:35.483006 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Aug 10 23:10:35.483006 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:10:35.483006 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:10:35.483006 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:10:35.483006 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:10:35.483006 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Aug 10 23:10:35.483006 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Aug 10 23:10:35.483006 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 10 23:10:35.483006 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 10 23:10:35.483006 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 10 23:10:35.483006 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 10 23:10:35.483006 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 10 23:10:35.483006 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise self.value Aug 10 23:10:35.483006 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 10 23:10:35.483006 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 10 23:10:35.483006 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6740, in import_key_pair Aug 10 23:10:35.483006 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Aug 10 23:10:35.483006 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6813, in _generate_fingerprint Aug 10 23:10:35.483006 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Aug 10 23:10:35.483006 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Aug 10 23:10:35.483006 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Aug 10 23:10:35.483006 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Aug 10 23:10:35.483006 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:10:35.483006 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:10:35.483006 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:10:35.483006 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:10:35.483006 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:10:35.483006 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:10:35.483006 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:10:35.483006 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:10:35.483006 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 23:10:35.483006 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 23:10:35.483006 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:10:35.483006 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:10:35.485889 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 23:10:35.485889 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 23:10:35.485889 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 23:10:35.485889 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 23:10:35.485889 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Aug 10 23:10:35.485889 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return self._create(req, body) Aug 10 23:10:35.485889 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Aug 10 23:10:35.485889 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Aug 10 23:10:35.485889 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Aug 10 23:10:35.485889 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:10:35.485889 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:10:35.485889 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:10:35.485889 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:10:35.485889 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:10:35.485889 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:10:35.485889 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:10:35.485889 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:10:35.485889 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Aug 10 23:10:35.485889 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:10:35.485889 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-1ea2db52-0b40-4bec-9f48-faf183dd047d tempest-KeyPairsNegativeTestJSON-1035250135 tempest-KeyPairsNegativeTestJSON-1035250135-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:10:35.485889 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-1ea2db52-0b40-4bec-9f48-faf183dd047d tempest-KeyPairsNegativeTestJSON-1035250135 tempest-KeyPairsNegativeTestJSON-1035250135-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.239316 Aug 10 23:10:35.485889 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1622/3140] 10.222.0.58 () {60 vars in 1160 bytes} [Wed Aug 10 23:10:35 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 240 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 10 23:10:35.492683 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-b4df1b73-726e-46e6-8284-1e67d2aeda51 tempest-KeyPairsNegativeTestJSON-1035250135 tempest-KeyPairsNegativeTestJSON-1035250135-project] Action: 'create', calling method: .version_select at 0x7f847d098670>, body: {"keypair": {"name": "tempest-keypair-742557809", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLJ3RHJ+04IofkVYXl92++8p7mk4iWWKcTnXZGwZ/ZoIHCYgN9R9Qb5ygM6g9KFQkMdWNyaHO394Gg48u4lslnbNLt3DyMON6DsQe+0Tp4Qnr0EUVEtlw42FM8aIPvcJLA=="}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:10:35.601795 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-b4df1b73-726e-46e6-8284-1e67d2aeda51 tempest-KeyPairsNegativeTestJSON-1035250135 tempest-KeyPairsNegativeTestJSON-1035250135-project] Getting quotas for project 5f33c16b6f5b4ab0a8dfaaa92e363f0f. Resources: {'key_pairs'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:10:35.633594 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-b4df1b73-726e-46e6-8284-1e67d2aeda51 tempest-KeyPairsNegativeTestJSON-1035250135 tempest-KeyPairsNegativeTestJSON-1035250135-project] Getting quotas for user 328e45be94f343c0b26583a12456ecca and project 5f33c16b6f5b4ab0a8dfaaa92e363f0f. Resources: {'key_pairs'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:10:35.690942 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-b4df1b73-726e-46e6-8284-1e67d2aeda51 tempest-KeyPairsNegativeTestJSON-1035250135 tempest-KeyPairsNegativeTestJSON-1035250135-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.205939 Aug 10 23:10:35.691881 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1623/3141] 10.222.0.58 () {60 vars in 1159 bytes} [Wed Aug 10 23:10:35 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:10:35.704961 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-24553b3d-dc6e-4904-8a71-5beba25b5e35 tempest-KeyPairsNegativeTestJSON-1035250135 tempest-KeyPairsNegativeTestJSON-1035250135-project] Action: 'create', calling method: .version_select at 0x7f847d0984c0>, body: {"keypair": {"name": "tempest-keypair-742557809", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCoKUyzqws2+O+HGiscO2Jm1T9zgI6XJ+qm6Y/aTRFo2WBLhLvS6R1z5/AxdPLjeCxRawCya+AWjDB1y/F3C2zKInleg8gCALynEAhuCtVooowUicOgKol3B9D+mNWftIQ=="}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:10:35.756026 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-24553b3d-dc6e-4904-8a71-5beba25b5e35 tempest-KeyPairsNegativeTestJSON-1035250135 tempest-KeyPairsNegativeTestJSON-1035250135-project] Getting quotas for project 5f33c16b6f5b4ab0a8dfaaa92e363f0f. Resources: {'key_pairs'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:10:35.779643 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-3ed3bcf5-360e-400a-9aa9-e459a21d8fb3 tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1724aec95222440888977c15a7ed043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b00b4016aae8425e96b7046388f0a7de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:10:35.781089 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-24553b3d-dc6e-4904-8a71-5beba25b5e35 tempest-KeyPairsNegativeTestJSON-1035250135 tempest-KeyPairsNegativeTestJSON-1035250135-project] Getting quotas for user 328e45be94f343c0b26583a12456ecca and project 5f33c16b6f5b4ab0a8dfaaa92e363f0f. Resources: {'key_pairs'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:10:35.791390 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-3ed3bcf5-360e-400a-9aa9-e459a21d8fb3 tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] 10.222.0.58 "GET /compute/v2.1/servers/1305bc15-3da1-4fac-886e-29b42b7eedee" status: 200 len: 1504 microversion: 2.1 time: 0.915395 Aug 10 23:10:35.823770 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1519/3142] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:10:34 2022] GET /compute/v2.1/servers/1305bc15-3da1-4fac-886e-29b42b7eedee => generated 1504 bytes in 949 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:10:35.839304 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-1fb2efe8-44f5-4ddd-b96c-8c23dc1d7fdf tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:10:35.843836 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-1fb2efe8-44f5-4ddd-b96c-8c23dc1d7fdf tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] [instance: 1305bc15-3da1-4fac-886e-29b42b7eedee] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:10:35.860788 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-24553b3d-dc6e-4904-8a71-5beba25b5e35 tempest-KeyPairsNegativeTestJSON-1035250135 tempest-KeyPairsNegativeTestJSON-1035250135-project] HTTP exception thrown: Key pair 'tempest-keypair-742557809' already exists. Aug 10 23:10:35.870664 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-24553b3d-dc6e-4904-8a71-5beba25b5e35 tempest-KeyPairsNegativeTestJSON-1035250135 tempest-KeyPairsNegativeTestJSON-1035250135-project] Request method failure captured: Aug 10 23:10:35.870664 n-d-850468-14 devstack@n-api.service[122633]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 10 23:10:35.870664 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:10:35.870664 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:10:35.870664 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:10:35.870664 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 272 Aug 10 23:10:35.870664 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:10:35.870664 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:10:35.870664 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:10:35.870664 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:10:35.870664 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9DrqpsiHcdvhtNWcCz3D6NdRJLQNV5bQ5CDJabqFZOFJGL72MibuJpEHW_T7PzEsFEU7zKxgNTqmVf4Tzk-woaa2HZbuvuKMYNqz7fLMLTSV7uwKf6T3auuT1OZy4MA7Kakw5NNE5pzkFiuUBKO6rOmpz3kme0u4PKbz-4obfo54Xbo Aug 10 23:10:35.870664 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:10:35.870664 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:10:35.870664 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:10:35.870664 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:10:35.870664 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:10:35.870664 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:10:35.870664 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 5f33c16b6f5b4ab0a8dfaaa92e363f0f Aug 10 23:10:35.870664 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1035250135 Aug 10 23:10:35.870664 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:10:35.870664 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:10:35.870664 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5f33c16b6f5b4ab0a8dfaaa92e363f0f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5f33c16b6f5b4ab0a8dfaaa92e363f0f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/5f33c16b6f5b4ab0a8dfaaa92e363f0f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_5f33c16b6f5b4ab0a8dfaaa92e363f0f", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:10:35.870664 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1035250135 Aug 10 23:10:35.870664 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 5f33c16b6f5b4ab0a8dfaaa92e363f0f Aug 10 23:10:35.870664 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1035250135 Aug 10 23:10:35.870664 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-KeyPairsNegativeTestJSON-1035250135-project Aug 10 23:10:35.870664 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:10:35.870664 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:10:35.870664 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 328e45be94f343c0b26583a12456ecca Aug 10 23:10:35.870664 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1035250135-project Aug 10 23:10:35.870664 n-d-850468-14 devstack@n-api.service[122633]: Aug 10 23:10:35.870664 n-d-850468-14 devstack@n-api.service[122633]: {"keypair": {"name": "tempest-keypair-742557809", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCoKUyzqws2+O+HGiscO2Jm1T9zgI6XJ+qm6Y/aTRFo2WBLhLvS6R1z5/AxdPLjeCxRawCya+AWjDB1y/F3C2zKInleg8gCALynEAhuCtVooowUicOgKol3B9D+mNWftIQ=="}} Aug 10 23:10:35.870664 n-d-850468-14 devstack@n-api.service[122633]: method: Aug 10 23:10:35.870664 n-d-850468-14 devstack@n-api.service[122633]: exception: Key pair 'tempest-keypair-742557809' already exists. Aug 10 23:10:35.870664 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-742557809', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCoKUyzqws2+O+HGiscO2Jm1T9zgI6XJ+qm6Y/aTRFo2WBLhLvS6R1z5/AxdPLjeCxRawCya+AWjDB1y/F3C2zKInleg8gCALynEAhuCtVooowUicOgKol3B9D+mNWftIQ=='}}} Aug 10 23:10:35.870664 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:10:35.870664 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:10:35.870664 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 10 23:10:35.870664 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 10 23:10:35.870664 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 10 23:10:35.870664 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 10 23:10:35.870664 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 10 23:10:35.870664 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 10 23:10:35.870664 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 10 23:10:35.870664 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 10 23:10:35.870664 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 10 23:10:35.870664 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 10 23:10:35.870664 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 10 23:10:35.870664 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi result.read() Aug 10 23:10:35.870664 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 10 23:10:35.870664 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 10 23:10:35.870664 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 10 23:10:35.870664 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 10 23:10:35.870664 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 10 23:10:35.870664 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 10 23:10:35.870664 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 10 23:10:35.870664 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 10 23:10:35.870664 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '328e45be94f343c0b26583a12456ecca-tempest-keypair-742557809' for key 'key_pairs.uniq_key_pairs0user_id0name'") Aug 10 23:10:35.870664 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:10:35.877007 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 10 23:10:35.877007 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:10:35.877007 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:10:35.877007 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Aug 10 23:10:35.877007 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi kp.save(context.session) Aug 10 23:10:35.877007 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Aug 10 23:10:35.877007 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi session.flush() Aug 10 23:10:35.877007 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 10 23:10:35.877007 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi self._flush(objects) Aug 10 23:10:35.877007 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 10 23:10:35.877007 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Aug 10 23:10:35.877007 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 10 23:10:35.877007 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi compat.raise_( Aug 10 23:10:35.877007 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 10 23:10:35.877007 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception Aug 10 23:10:35.877007 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 10 23:10:35.877007 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi flush_context.execute() Aug 10 23:10:35.877007 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 10 23:10:35.877007 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi rec.execute(self) Aug 10 23:10:35.877007 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 10 23:10:35.877007 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Aug 10 23:10:35.877007 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 10 23:10:35.877007 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Aug 10 23:10:35.877007 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 10 23:10:35.877007 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Aug 10 23:10:35.877007 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 10 23:10:35.877007 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Aug 10 23:10:35.877007 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 10 23:10:35.877007 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Aug 10 23:10:35.877007 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 10 23:10:35.877007 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Aug 10 23:10:35.877007 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 10 23:10:35.877007 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Aug 10 23:10:35.877007 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 10 23:10:35.877007 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 10 23:10:35.877007 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 10 23:10:35.877007 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception Aug 10 23:10:35.877007 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 10 23:10:35.877007 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 10 23:10:35.877007 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 10 23:10:35.877007 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 10 23:10:35.877007 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 10 23:10:35.877007 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 10 23:10:35.877007 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 10 23:10:35.877007 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 10 23:10:35.877007 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 10 23:10:35.877007 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 10 23:10:35.877007 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 10 23:10:35.877007 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi result.read() Aug 10 23:10:35.877007 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 10 23:10:35.877007 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 10 23:10:35.877007 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 10 23:10:35.877007 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 10 23:10:35.877007 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 10 23:10:35.877007 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 10 23:10:35.877007 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 10 23:10:35.886958 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 10 23:10:35.886958 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '328e45be94f343c0b26583a12456ecca-tempest-keypair-742557809' for key 'key_pairs.uniq_key_pairs0user_id0name'") Aug 10 23:10:35.886958 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Aug 10 23:10:35.886958 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 8, 10, 23, 10, 35, 840215), 'updated_at': None, 'name': 'tempest-keypair-742557809', 'user_id': '328e45be94f343c0b26583a12456ecca', 'fingerprint': '35:4e:67:f9:b5:f7:1e:ca:84:9c:69:b1:0d:ff:41:3f', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCoKUyzqws2+O+HGiscO2Jm1T9zgI6XJ+qm6Y/aTRFo2WBLhLvS6R1z5/AxdPLjeCxRawCya+AWjDB1y/F3C2zKInleg8gCALynEAhuCtVooowUicOgKol3B9D+mNWftIQ==', 'type': 'ssh'}] Aug 10 23:10:35.886958 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 10 23:10:35.886958 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:10:35.886958 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:10:35.886958 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:10:35.886958 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:10:35.886958 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Aug 10 23:10:35.886958 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Aug 10 23:10:35.886958 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 10 23:10:35.886958 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 10 23:10:35.886958 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 10 23:10:35.886958 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 10 23:10:35.886958 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 10 23:10:35.886958 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise self.value Aug 10 23:10:35.886958 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 10 23:10:35.886958 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 10 23:10:35.886958 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6743, in import_key_pair Aug 10 23:10:35.886958 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi keypair.create() Aug 10 23:10:35.886958 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 10 23:10:35.886958 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 10 23:10:35.886958 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Aug 10 23:10:35.886958 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi self._create() Aug 10 23:10:35.886958 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Aug 10 23:10:35.886958 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Aug 10 23:10:35.886958 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Aug 10 23:10:35.886958 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Aug 10 23:10:35.886958 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 10 23:10:35.886958 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 10 23:10:35.886958 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Aug 10 23:10:35.886958 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Aug 10 23:10:35.886958 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-742557809' already exists. Aug 10 23:10:35.886958 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:10:35.886958 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:10:35.886958 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:10:35.886958 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:10:35.886958 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:10:35.886958 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:10:35.886958 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:10:35.886958 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:10:35.886958 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 23:10:35.886958 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 23:10:35.886958 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:10:35.886958 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:10:35.886958 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 23:10:35.886958 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 23:10:35.886958 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 23:10:35.886958 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 23:10:35.886958 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Aug 10 23:10:35.886958 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return self._create(req, body) Aug 10 23:10:35.886958 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 132, in _create Aug 10 23:10:35.886958 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Aug 10 23:10:35.886958 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-742557809' already exists. Aug 10 23:10:35.897186 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:10:35.897186 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:10:35.897186 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:10:35.897186 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:10:35.897186 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:10:35.897186 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:10:35.897186 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:10:35.897186 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:10:35.897186 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-742557809' already exists. Aug 10 23:10:35.897186 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:10:35.899274 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1fb2efe8-44f5-4ddd-b96c-8c23dc1d7fdf tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:10:35.899274 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1fb2efe8-44f5-4ddd-b96c-8c23dc1d7fdf tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:10:35.899274 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1fb2efe8-44f5-4ddd-b96c-8c23dc1d7fdf tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:10:35.899274 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1fb2efe8-44f5-4ddd-b96c-8c23dc1d7fdf tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:10:35.899274 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1fb2efe8-44f5-4ddd-b96c-8c23dc1d7fdf tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:10:35.899274 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1fb2efe8-44f5-4ddd-b96c-8c23dc1d7fdf tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:10:35.901456 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-24553b3d-dc6e-4904-8a71-5beba25b5e35 tempest-KeyPairsNegativeTestJSON-1035250135 tempest-KeyPairsNegativeTestJSON-1035250135-project] Returning 409 to user: Key pair 'tempest-keypair-742557809' already exists. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:10:35.903969 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-24553b3d-dc6e-4904-8a71-5beba25b5e35 tempest-KeyPairsNegativeTestJSON-1035250135 tempest-KeyPairsNegativeTestJSON-1035250135-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 409 len: 104 microversion: 2.1 time: 0.202898 Aug 10 23:10:35.907983 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1624/3143] 10.222.0.58 () {60 vars in 1159 bytes} [Wed Aug 10 23:10:35 2022] POST /compute/v2.1/os-keypairs => generated 104 bytes in 207 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 10 23:10:35.917526 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-cc671e81-59d6-4ec3-8c46-505d11ac3d3c tempest-KeyPairsNegativeTestJSON-1035250135 tempest-KeyPairsNegativeTestJSON-1035250135-project] Calling method '.version_select at 0x7f847d2985e0>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:10:35.946223 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-cc671e81-59d6-4ec3-8c46-505d11ac3d3c tempest-KeyPairsNegativeTestJSON-1035250135 tempest-KeyPairsNegativeTestJSON-1035250135-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-742557809" status: 202 len: 0 microversion: 2.1 time: 0.033362 Aug 10 23:10:35.947735 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1625/3144] 10.222.0.58 () {58 vars in 1218 bytes} [Wed Aug 10 23:10:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-742557809 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 10 23:10:35.973470 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-0e5e7e9f-8f51-41e8-a98a-572c1dfaa14c tempest-KeyPairsNegativeTestJSON-1035250135 tempest-KeyPairsNegativeTestJSON-1035250135-project] Action: 'create', calling method: .version_select at 0x7f847d0988b0>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDv/8WkOHnbHZFSco5YUzBDL3mI3BaMqn8kD4iJ+hstOXQyCw7AFYybnDtwLK7DWj6hK38R9fpZSqkyMJc/ojb10qNerIgeHOTFCo5SIufOjycOCse1fqieen39uTBRulw=="}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:10:35.997205 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-0e5e7e9f-8f51-41e8-a98a-572c1dfaa14c tempest-KeyPairsNegativeTestJSON-1035250135 tempest-KeyPairsNegativeTestJSON-1035250135-project] Request method failure captured: Aug 10 23:10:35.997205 n-d-850468-14 devstack@n-api.service[122633]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 10 23:10:35.997205 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:10:35.997205 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:10:35.997205 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:10:35.997205 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 247 Aug 10 23:10:35.997205 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:10:35.997205 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:10:35.997205 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:10:35.997205 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:10:35.997205 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9DrqpsiHcdvhtNWcCz3D6NdRJLQNV5bQ5CDJabqFZOFJGL72MibuJpEHW_T7PzEsFEU7zKxgNTqmVf4Tzk-woaa2HZbuvuKMYNqz7fLMLTSV7uwKf6T3auuT1OZy4MA7Kakw5NNE5pzkFiuUBKO6rOmpz3kme0u4PKbz-4obfo54Xbo Aug 10 23:10:35.997205 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:10:35.997205 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:10:35.997205 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:10:35.997205 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:10:35.997205 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:10:35.997205 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:10:35.997205 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 5f33c16b6f5b4ab0a8dfaaa92e363f0f Aug 10 23:10:35.997205 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1035250135 Aug 10 23:10:35.997205 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:10:35.997205 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:10:35.997205 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5f33c16b6f5b4ab0a8dfaaa92e363f0f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5f33c16b6f5b4ab0a8dfaaa92e363f0f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/5f33c16b6f5b4ab0a8dfaaa92e363f0f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_5f33c16b6f5b4ab0a8dfaaa92e363f0f", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:10:35.997205 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1035250135 Aug 10 23:10:35.997205 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 5f33c16b6f5b4ab0a8dfaaa92e363f0f Aug 10 23:10:35.997205 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1035250135 Aug 10 23:10:35.997205 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-KeyPairsNegativeTestJSON-1035250135-project Aug 10 23:10:35.997205 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:10:35.997205 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:10:35.997205 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 328e45be94f343c0b26583a12456ecca Aug 10 23:10:35.997205 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1035250135-project Aug 10 23:10:35.997205 n-d-850468-14 devstack@n-api.service[122633]: Aug 10 23:10:35.997205 n-d-850468-14 devstack@n-api.service[122633]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDv/8WkOHnbHZFSco5YUzBDL3mI3BaMqn8kD4iJ+hstOXQyCw7AFYybnDtwLK7DWj6hK38R9fpZSqkyMJc/ojb10qNerIgeHOTFCo5SIufOjycOCse1fqieen39uTBRulw=="}} Aug 10 23:10:35.997205 n-d-850468-14 devstack@n-api.service[122633]: method: Aug 10 23:10:35.997205 n-d-850468-14 devstack@n-api.service[122633]: exception: Invalid input for field/attribute name. Value: . '' is too short Aug 10 23:10:35.997205 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDv/8WkOHnbHZFSco5YUzBDL3mI3BaMqn8kD4iJ+hstOXQyCw7AFYybnDtwLK7DWj6hK38R9fpZSqkyMJc/ojb10qNerIgeHOTFCo5SIufOjycOCse1fqieen39uTBRulw=='}}} Aug 10 23:10:35.997205 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:10:35.997205 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:10:35.997205 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 10 23:10:35.997205 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 10 23:10:35.997205 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 10 23:10:35.997205 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise error Aug 10 23:10:35.997205 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 10 23:10:35.997205 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:10:35.997205 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Aug 10 23:10:35.997205 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 10 23:10:35.997205 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:10:35.997205 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi On instance['keypair']: Aug 10 23:10:35.997205 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi '' Aug 10 23:10:35.997205 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:10:35.997205 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:10:35.997205 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:10:35.997205 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:10:35.997205 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:10:35.997205 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:10:35.997205 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:10:35.997205 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:10:35.997205 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 23:10:35.997205 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 23:10:35.997205 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:10:35.997205 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:10:35.997205 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 23:10:35.997205 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 23:10:35.997205 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 10 23:10:35.997205 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 10 23:10:36.002162 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 10 23:10:36.002162 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 10 23:10:36.002162 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 10 23:10:36.002162 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 10 23:10:36.002162 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Aug 10 23:10:36.002162 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:10:36.002162 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:10:36.002162 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:10:36.002162 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:10:36.002162 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:10:36.002162 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:10:36.002162 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 10 23:10:36.002162 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 10 23:10:36.002162 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Aug 10 23:10:36.002162 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:10:36.007881 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-0e5e7e9f-8f51-41e8-a98a-572c1dfaa14c tempest-KeyPairsNegativeTestJSON-1035250135 tempest-KeyPairsNegativeTestJSON-1035250135-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:10:36.009117 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-0e5e7e9f-8f51-41e8-a98a-572c1dfaa14c tempest-KeyPairsNegativeTestJSON-1035250135 tempest-KeyPairsNegativeTestJSON-1035250135-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.051517 Aug 10 23:10:36.010194 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1626/3145] 10.222.0.58 () {60 vars in 1159 bytes} [Wed Aug 10 23:10:35 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 53 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 10 23:10:36.030183 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-3a53c68d-e335-45a0-bfef-9303942869c4 tempest-KeyPairsNegativeTestJSON-1035250135 tempest-KeyPairsNegativeTestJSON-1035250135-project] Action: 'create', calling method: .version_select at 0x7f847d2c30d0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-491518386", "public_key": " "}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:10:36.109994 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-3a53c68d-e335-45a0-bfef-9303942869c4 tempest-KeyPairsNegativeTestJSON-1035250135 tempest-KeyPairsNegativeTestJSON-1035250135-project] Getting quotas for project 5f33c16b6f5b4ab0a8dfaaa92e363f0f. Resources: {'key_pairs'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:10:36.136198 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-3a53c68d-e335-45a0-bfef-9303942869c4 tempest-KeyPairsNegativeTestJSON-1035250135 tempest-KeyPairsNegativeTestJSON-1035250135-project] Getting quotas for user 328e45be94f343c0b26583a12456ecca and project 5f33c16b6f5b4ab0a8dfaaa92e363f0f. Resources: {'key_pairs'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:10:36.150282 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-1fb2efe8-44f5-4ddd-b96c-8c23dc1d7fdf tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] 10.222.0.58 "DELETE /compute/v2.1/servers/1305bc15-3da1-4fac-886e-29b42b7eedee/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.322715 Aug 10 23:10:36.152632 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1520/3146] 10.222.0.58 () {58 vars in 1296 bytes} [Wed Aug 10 23:10:35 2022] DELETE /compute/v2.1/servers/1305bc15-3da1-4fac-886e-29b42b7eedee/os-server-password => generated 0 bytes in 328 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:10:36.172730 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-81146263-a8e1-43d4-9b74-f997075054f6 tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:10:36.180692 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-81146263-a8e1-43d4-9b74-f997075054f6 tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] [instance: 1305bc15-3da1-4fac-886e-29b42b7eedee] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:10:36.204924 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-81146263-a8e1-43d4-9b74-f997075054f6 tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:10:36.206104 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-81146263-a8e1-43d4-9b74-f997075054f6 tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:10:36.207351 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-3a53c68d-e335-45a0-bfef-9303942869c4 tempest-KeyPairsNegativeTestJSON-1035250135 tempest-KeyPairsNegativeTestJSON-1035250135-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Aug 10 23:10:36.212772 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-81146263-a8e1-43d4-9b74-f997075054f6 tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:10:36.215249 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-81146263-a8e1-43d4-9b74-f997075054f6 tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:10:36.215862 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-81146263-a8e1-43d4-9b74-f997075054f6 tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:10:36.217932 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-81146263-a8e1-43d4-9b74-f997075054f6 tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:10:36.218970 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-3a53c68d-e335-45a0-bfef-9303942869c4 tempest-KeyPairsNegativeTestJSON-1035250135 tempest-KeyPairsNegativeTestJSON-1035250135-project] Request method failure captured: Aug 10 23:10:36.218970 n-d-850468-14 devstack@n-api.service[122633]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 10 23:10:36.218970 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:10:36.218970 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:10:36.218970 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:10:36.218970 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 94 Aug 10 23:10:36.218970 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:10:36.218970 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:10:36.218970 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:10:36.218970 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:10:36.218970 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9DrqpsiHcdvhtNWcCz3D6NdRJLQNV5bQ5CDJabqFZOFJGL72MibuJpEHW_T7PzEsFEU7zKxgNTqmVf4Tzk-woaa2HZbuvuKMYNqz7fLMLTSV7uwKf6T3auuT1OZy4MA7Kakw5NNE5pzkFiuUBKO6rOmpz3kme0u4PKbz-4obfo54Xbo Aug 10 23:10:36.218970 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:10:36.218970 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:10:36.218970 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:10:36.218970 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:10:36.218970 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:10:36.218970 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:10:36.218970 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 5f33c16b6f5b4ab0a8dfaaa92e363f0f Aug 10 23:10:36.218970 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1035250135 Aug 10 23:10:36.218970 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:10:36.218970 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:10:36.218970 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5f33c16b6f5b4ab0a8dfaaa92e363f0f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5f33c16b6f5b4ab0a8dfaaa92e363f0f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/5f33c16b6f5b4ab0a8dfaaa92e363f0f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_5f33c16b6f5b4ab0a8dfaaa92e363f0f", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:10:36.218970 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1035250135 Aug 10 23:10:36.218970 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 5f33c16b6f5b4ab0a8dfaaa92e363f0f Aug 10 23:10:36.218970 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1035250135 Aug 10 23:10:36.218970 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-KeyPairsNegativeTestJSON-1035250135-project Aug 10 23:10:36.218970 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:10:36.218970 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:10:36.218970 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 328e45be94f343c0b26583a12456ecca Aug 10 23:10:36.218970 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1035250135-project Aug 10 23:10:36.218970 n-d-850468-14 devstack@n-api.service[122633]: Aug 10 23:10:36.218970 n-d-850468-14 devstack@n-api.service[122633]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-491518386", "public_key": " "}} Aug 10 23:10:36.218970 n-d-850468-14 devstack@n-api.service[122633]: method: Aug 10 23:10:36.218970 n-d-850468-14 devstack@n-api.service[122633]: exception: Keypair data is invalid: failed to generate fingerprint Aug 10 23:10:36.218970 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-491518386', 'public_key': ' '}}} Aug 10 23:10:36.218970 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:10:36.218970 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:10:36.218970 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Aug 10 23:10:36.218970 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Aug 10 23:10:36.218970 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Aug 10 23:10:36.218970 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Aug 10 23:10:36.218970 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Aug 10 23:10:36.218970 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:10:36.218970 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:10:36.218970 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:10:36.218970 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:10:36.218970 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Aug 10 23:10:36.218970 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Aug 10 23:10:36.218970 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 10 23:10:36.218970 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 10 23:10:36.218970 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 10 23:10:36.218970 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 10 23:10:36.218970 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 10 23:10:36.218970 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise self.value Aug 10 23:10:36.218970 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 10 23:10:36.218970 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 10 23:10:36.218970 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6740, in import_key_pair Aug 10 23:10:36.218970 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Aug 10 23:10:36.218970 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6813, in _generate_fingerprint Aug 10 23:10:36.218970 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Aug 10 23:10:36.218970 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Aug 10 23:10:36.218970 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Aug 10 23:10:36.218970 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Aug 10 23:10:36.218970 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:10:36.218970 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:10:36.218970 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:10:36.236142 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:10:36.236142 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:10:36.236142 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:10:36.236142 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:10:36.236142 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:10:36.236142 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 23:10:36.236142 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 23:10:36.236142 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:10:36.236142 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:10:36.236142 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 23:10:36.236142 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 23:10:36.236142 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 23:10:36.236142 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 23:10:36.236142 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Aug 10 23:10:36.236142 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return self._create(req, body) Aug 10 23:10:36.236142 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Aug 10 23:10:36.236142 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Aug 10 23:10:36.236142 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Aug 10 23:10:36.236142 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:10:36.236142 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:10:36.236142 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:10:36.236142 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:10:36.236142 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:10:36.236142 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:10:36.236142 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:10:36.236142 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:10:36.236142 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Aug 10 23:10:36.236142 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:10:36.236142 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-3a53c68d-e335-45a0-bfef-9303942869c4 tempest-KeyPairsNegativeTestJSON-1035250135 tempest-KeyPairsNegativeTestJSON-1035250135-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:10:36.236142 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-3a53c68d-e335-45a0-bfef-9303942869c4 tempest-KeyPairsNegativeTestJSON-1035250135 tempest-KeyPairsNegativeTestJSON-1035250135-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.203471 Aug 10 23:10:36.236142 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1627/3147] 10.222.0.58 () {60 vars in 1158 bytes} [Wed Aug 10 23:10:36 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 213 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Aug 10 23:10:36.245365 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-469acf28-823e-4394-829c-6eda8f44225f tempest-KeyPairsNegativeTestJSON-1035250135 tempest-KeyPairsNegativeTestJSON-1035250135-project] Action: 'create', calling method: .version_select at 0x7f847d30e700>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBANhFfTNal8FjxoXZraf4pkwww7govGz5TenF7K4xSzQbbh/Ik3WxgrZwNZxWcPThpHBdybXqGi9Ob4MsXwk/fomEL3TOatPyViNCDDSUjZrdq4PUoXRp9HL9bok8WOskg=="}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:10:36.267138 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-469acf28-823e-4394-829c-6eda8f44225f tempest-KeyPairsNegativeTestJSON-1035250135 tempest-KeyPairsNegativeTestJSON-1035250135-project] Request method failure captured: Aug 10 23:10:36.267138 n-d-850468-14 devstack@n-api.service[122633]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 10 23:10:36.267138 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:10:36.267138 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:10:36.267138 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:10:36.267138 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 507 Aug 10 23:10:36.267138 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:10:36.267138 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:10:36.267138 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:10:36.267138 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:10:36.267138 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9DrqpsiHcdvhtNWcCz3D6NdRJLQNV5bQ5CDJabqFZOFJGL72MibuJpEHW_T7PzEsFEU7zKxgNTqmVf4Tzk-woaa2HZbuvuKMYNqz7fLMLTSV7uwKf6T3auuT1OZy4MA7Kakw5NNE5pzkFiuUBKO6rOmpz3kme0u4PKbz-4obfo54Xbo Aug 10 23:10:36.267138 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:10:36.267138 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:10:36.267138 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:10:36.267138 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:10:36.267138 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:10:36.267138 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:10:36.267138 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 5f33c16b6f5b4ab0a8dfaaa92e363f0f Aug 10 23:10:36.267138 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1035250135 Aug 10 23:10:36.267138 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:10:36.267138 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:10:36.267138 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5f33c16b6f5b4ab0a8dfaaa92e363f0f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5f33c16b6f5b4ab0a8dfaaa92e363f0f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/5f33c16b6f5b4ab0a8dfaaa92e363f0f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_5f33c16b6f5b4ab0a8dfaaa92e363f0f", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:10:36.267138 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1035250135 Aug 10 23:10:36.267138 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 5f33c16b6f5b4ab0a8dfaaa92e363f0f Aug 10 23:10:36.267138 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1035250135 Aug 10 23:10:36.267138 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-KeyPairsNegativeTestJSON-1035250135-project Aug 10 23:10:36.267138 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:10:36.267138 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:10:36.267138 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 328e45be94f343c0b26583a12456ecca Aug 10 23:10:36.267138 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1035250135-project Aug 10 23:10:36.267138 n-d-850468-14 devstack@n-api.service[122633]: Aug 10 23:10:36.267138 n-d-850468-14 devstack@n-api.service[122633]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBANhFfTNal8FjxoXZraf4pkwww7govGz5TenF7K4xSzQbbh/Ik3WxgrZwNZxWcPThpHBdybXqGi9Ob4MsXwk/fomEL3TOatPyViNCDDSUjZrdq4PUoXRp9HL9bok8WOskg=="}} Aug 10 23:10:36.267138 n-d-850468-14 devstack@n-api.service[122633]: method: Aug 10 23:10:36.267138 n-d-850468-14 devstack@n-api.service[122633]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Aug 10 23:10:36.267138 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBANhFfTNal8FjxoXZraf4pkwww7govGz5TenF7K4xSzQbbh/Ik3WxgrZwNZxWcPThpHBdybXqGi9Ob4MsXwk/fomEL3TOatPyViNCDDSUjZrdq4PUoXRp9HL9bok8WOskg=='}}} Aug 10 23:10:36.267138 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:10:36.267138 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:10:36.267138 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 10 23:10:36.267138 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 10 23:10:36.267138 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 10 23:10:36.267138 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise error Aug 10 23:10:36.267138 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Aug 10 23:10:36.267138 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:10:36.267138 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Aug 10 23:10:36.267138 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 10 23:10:36.267138 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:10:36.267138 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi On instance['keypair']: Aug 10 23:10:36.267138 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Aug 10 23:10:36.271505 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:10:36.271505 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:10:36.271505 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:10:36.271505 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:10:36.271505 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:10:36.271505 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:10:36.271505 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:10:36.271505 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:10:36.271505 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 23:10:36.271505 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 23:10:36.271505 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:10:36.271505 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:10:36.271505 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 23:10:36.271505 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 23:10:36.271505 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 10 23:10:36.271505 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 10 23:10:36.271505 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 10 23:10:36.271505 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 10 23:10:36.271505 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 10 23:10:36.271505 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 10 23:10:36.271505 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Aug 10 23:10:36.271505 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:10:36.271505 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:10:36.271505 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:10:36.271505 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:10:36.271505 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:10:36.271505 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:10:36.271505 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 10 23:10:36.271505 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 10 23:10:36.271505 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Aug 10 23:10:36.271505 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:10:36.271505 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-469acf28-823e-4394-829c-6eda8f44225f tempest-KeyPairsNegativeTestJSON-1035250135 tempest-KeyPairsNegativeTestJSON-1035250135-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:10:36.271505 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-469acf28-823e-4394-829c-6eda8f44225f tempest-KeyPairsNegativeTestJSON-1035250135 tempest-KeyPairsNegativeTestJSON-1035250135-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.036092 Aug 10 23:10:36.276880 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1628/3148] 10.222.0.58 () {60 vars in 1159 bytes} [Wed Aug 10 23:10:36 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 43 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 10 23:10:36.283184 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-afe299f7-3aeb-43b8-9f4b-d0953d1ef4ce tempest-KeyPairsNegativeTestJSON-1035250135 tempest-KeyPairsNegativeTestJSON-1035250135-project] Action: 'create', calling method: .version_select at 0x7f847d0988b0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-751076050", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:10:36.324264 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-afe299f7-3aeb-43b8-9f4b-d0953d1ef4ce tempest-KeyPairsNegativeTestJSON-1035250135 tempest-KeyPairsNegativeTestJSON-1035250135-project] Getting quotas for project 5f33c16b6f5b4ab0a8dfaaa92e363f0f. Resources: {'key_pairs'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:10:36.330726 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-81146263-a8e1-43d4-9b74-f997075054f6 tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] 10.222.0.58 "GET /compute/v2.1/servers/1305bc15-3da1-4fac-886e-29b42b7eedee/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.172490 Aug 10 23:10:36.332810 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-afe299f7-3aeb-43b8-9f4b-d0953d1ef4ce tempest-KeyPairsNegativeTestJSON-1035250135 tempest-KeyPairsNegativeTestJSON-1035250135-project] Getting quotas for user 328e45be94f343c0b26583a12456ecca and project 5f33c16b6f5b4ab0a8dfaaa92e363f0f. Resources: {'key_pairs'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:10:36.334159 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1521/3149] 10.222.0.58 () {58 vars in 1293 bytes} [Wed Aug 10 23:10:36 2022] GET /compute/v2.1/servers/1305bc15-3da1-4fac-886e-29b42b7eedee/os-server-password => generated 16 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 23:10:36.352154 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-0ea56c5f-ae57-472d-8826-e941608f72f7 tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:10:36.352710 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-0ea56c5f-ae57-472d-8826-e941608f72f7 tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] [instance: 1305bc15-3da1-4fac-886e-29b42b7eedee] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:10:36.378804 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-afe299f7-3aeb-43b8-9f4b-d0953d1ef4ce tempest-KeyPairsNegativeTestJSON-1035250135 tempest-KeyPairsNegativeTestJSON-1035250135-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Aug 10 23:10:36.381214 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-afe299f7-3aeb-43b8-9f4b-d0953d1ef4ce tempest-KeyPairsNegativeTestJSON-1035250135 tempest-KeyPairsNegativeTestJSON-1035250135-project] Request method failure captured: Aug 10 23:10:36.381214 n-d-850468-14 devstack@n-api.service[122633]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 10 23:10:36.381214 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:10:36.381214 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:10:36.381214 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:10:36.381214 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 117 Aug 10 23:10:36.381214 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:10:36.381214 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:10:36.381214 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:10:36.381214 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:10:36.381214 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9DrqpsiHcdvhtNWcCz3D6NdRJLQNV5bQ5CDJabqFZOFJGL72MibuJpEHW_T7PzEsFEU7zKxgNTqmVf4Tzk-woaa2HZbuvuKMYNqz7fLMLTSV7uwKf6T3auuT1OZy4MA7Kakw5NNE5pzkFiuUBKO6rOmpz3kme0u4PKbz-4obfo54Xbo Aug 10 23:10:36.381214 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:10:36.381214 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:10:36.381214 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:10:36.381214 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:10:36.381214 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:10:36.381214 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:10:36.381214 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 5f33c16b6f5b4ab0a8dfaaa92e363f0f Aug 10 23:10:36.381214 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1035250135 Aug 10 23:10:36.381214 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:10:36.381214 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:10:36.381214 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5f33c16b6f5b4ab0a8dfaaa92e363f0f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5f33c16b6f5b4ab0a8dfaaa92e363f0f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/5f33c16b6f5b4ab0a8dfaaa92e363f0f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_5f33c16b6f5b4ab0a8dfaaa92e363f0f", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:10:36.381214 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1035250135 Aug 10 23:10:36.381214 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 5f33c16b6f5b4ab0a8dfaaa92e363f0f Aug 10 23:10:36.381214 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1035250135 Aug 10 23:10:36.381214 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-KeyPairsNegativeTestJSON-1035250135-project Aug 10 23:10:36.381214 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:10:36.381214 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:10:36.381214 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 328e45be94f343c0b26583a12456ecca Aug 10 23:10:36.381214 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1035250135-project Aug 10 23:10:36.381214 n-d-850468-14 devstack@n-api.service[122633]: Aug 10 23:10:36.381214 n-d-850468-14 devstack@n-api.service[122633]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-751076050", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Aug 10 23:10:36.381214 n-d-850468-14 devstack@n-api.service[122633]: method: Aug 10 23:10:36.381214 n-d-850468-14 devstack@n-api.service[122633]: exception: Keypair data is invalid: failed to generate fingerprint Aug 10 23:10:36.381214 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-751076050', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Aug 10 23:10:36.381214 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:10:36.381214 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:10:36.381214 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Aug 10 23:10:36.381214 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Aug 10 23:10:36.381214 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Aug 10 23:10:36.381214 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Aug 10 23:10:36.381214 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Aug 10 23:10:36.381214 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Aug 10 23:10:36.381214 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Aug 10 23:10:36.381214 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Aug 10 23:10:36.381214 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Aug 10 23:10:36.381214 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:10:36.381214 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:10:36.381214 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:10:36.381214 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:10:36.381214 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Aug 10 23:10:36.381214 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Aug 10 23:10:36.381214 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 10 23:10:36.381214 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 10 23:10:36.381214 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 10 23:10:36.381214 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 10 23:10:36.381214 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 10 23:10:36.381214 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise self.value Aug 10 23:10:36.381214 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 10 23:10:36.381214 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 10 23:10:36.381214 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6740, in import_key_pair Aug 10 23:10:36.381214 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Aug 10 23:10:36.381214 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6813, in _generate_fingerprint Aug 10 23:10:36.381214 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Aug 10 23:10:36.386636 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Aug 10 23:10:36.386636 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Aug 10 23:10:36.386636 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Aug 10 23:10:36.386636 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:10:36.386636 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:10:36.386636 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:10:36.386636 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:10:36.386636 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:10:36.386636 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:10:36.386636 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:10:36.386636 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:10:36.386636 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 23:10:36.386636 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 23:10:36.386636 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:10:36.386636 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:10:36.386636 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 23:10:36.386636 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 23:10:36.386636 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 23:10:36.386636 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 23:10:36.386636 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Aug 10 23:10:36.386636 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return self._create(req, body) Aug 10 23:10:36.386636 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Aug 10 23:10:36.386636 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Aug 10 23:10:36.386636 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Aug 10 23:10:36.386636 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:10:36.386636 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:10:36.386636 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:10:36.386636 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:10:36.386636 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:10:36.386636 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:10:36.386636 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:10:36.386636 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:10:36.386636 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Aug 10 23:10:36.386636 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:10:36.390129 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0ea56c5f-ae57-472d-8826-e941608f72f7 tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:10:36.390129 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0ea56c5f-ae57-472d-8826-e941608f72f7 tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:10:36.390129 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0ea56c5f-ae57-472d-8826-e941608f72f7 tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:10:36.391297 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0ea56c5f-ae57-472d-8826-e941608f72f7 tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:10:36.391824 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0ea56c5f-ae57-472d-8826-e941608f72f7 tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:10:36.392103 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-afe299f7-3aeb-43b8-9f4b-d0953d1ef4ce tempest-KeyPairsNegativeTestJSON-1035250135 tempest-KeyPairsNegativeTestJSON-1035250135-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:10:36.392298 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0ea56c5f-ae57-472d-8826-e941608f72f7 tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:10:36.393578 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-afe299f7-3aeb-43b8-9f4b-d0953d1ef4ce tempest-KeyPairsNegativeTestJSON-1035250135 tempest-KeyPairsNegativeTestJSON-1035250135-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.115135 Aug 10 23:10:36.395370 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1629/3150] 10.222.0.58 () {60 vars in 1159 bytes} [Wed Aug 10 23:10:36 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 118 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 10 23:10:36.407865 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-0c5674cb-d184-43c4-a45e-c4e014d25611 tempest-KeyPairsNegativeTestJSON-1035250135 tempest-KeyPairsNegativeTestJSON-1035250135-project] Calling method '.version_select at 0x7f847d30e280>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:10:36.435022 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-0c5674cb-d184-43c4-a45e-c4e014d25611 tempest-KeyPairsNegativeTestJSON-1035250135 tempest-KeyPairsNegativeTestJSON-1035250135-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-356509337 not found for user 328e45be94f343c0b26583a12456ecca Aug 10 23:10:36.438482 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-0c5674cb-d184-43c4-a45e-c4e014d25611 tempest-KeyPairsNegativeTestJSON-1035250135 tempest-KeyPairsNegativeTestJSON-1035250135-project] Request method failure captured: Aug 10 23:10:36.438482 n-d-850468-14 devstack@n-api.service[122633]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-356509337 HTTP/1.1 Aug 10 23:10:36.438482 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:10:36.438482 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:10:36.438482 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:10:36.438482 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:10:36.438482 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:10:36.438482 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:10:36.438482 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:10:36.438482 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:10:36.438482 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9DrqpsiHcdvhtNWcCz3D6NdRJLQNV5bQ5CDJabqFZOFJGL72MibuJpEHW_T7PzEsFEU7zKxgNTqmVf4Tzk-woaa2HZbuvuKMYNqz7fLMLTSV7uwKf6T3auuT1OZy4MA7Kakw5NNE5pzkFiuUBKO6rOmpz3kme0u4PKbz-4obfo54Xbo Aug 10 23:10:36.438482 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:10:36.438482 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:10:36.438482 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:10:36.438482 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:10:36.438482 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:10:36.438482 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:10:36.438482 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 5f33c16b6f5b4ab0a8dfaaa92e363f0f Aug 10 23:10:36.438482 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-1035250135 Aug 10 23:10:36.438482 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:10:36.438482 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:10:36.438482 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5f33c16b6f5b4ab0a8dfaaa92e363f0f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5f33c16b6f5b4ab0a8dfaaa92e363f0f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/5f33c16b6f5b4ab0a8dfaaa92e363f0f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_5f33c16b6f5b4ab0a8dfaaa92e363f0f", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:10:36.438482 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-KeyPairsNegativeTestJSON-1035250135 Aug 10 23:10:36.438482 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 5f33c16b6f5b4ab0a8dfaaa92e363f0f Aug 10 23:10:36.438482 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-1035250135 Aug 10 23:10:36.438482 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-KeyPairsNegativeTestJSON-1035250135-project Aug 10 23:10:36.438482 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:10:36.438482 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:10:36.438482 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 328e45be94f343c0b26583a12456ecca Aug 10 23:10:36.438482 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-KeyPairsNegativeTestJSON-1035250135-project Aug 10 23:10:36.438482 n-d-850468-14 devstack@n-api.service[122633]: method: Aug 10 23:10:36.438482 n-d-850468-14 devstack@n-api.service[122633]: exception: Keypair tempest-keypair-non-existent-356509337 not found for user 328e45be94f343c0b26583a12456ecca Aug 10 23:10:36.438482 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': 'tempest-keypair-non-existent-356509337'} Aug 10 23:10:36.438482 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:10:36.438482 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:10:36.438482 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 170, in _delete Aug 10 23:10:36.438482 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Aug 10 23:10:36.438482 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 10 23:10:36.438482 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 10 23:10:36.438482 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 10 23:10:36.438482 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 10 23:10:36.438482 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 10 23:10:36.438482 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise self.value Aug 10 23:10:36.438482 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 10 23:10:36.438482 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 10 23:10:36.438482 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6827, in delete_key_pair Aug 10 23:10:36.438482 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Aug 10 23:10:36.438482 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6848, in get_key_pair Aug 10 23:10:36.438482 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Aug 10 23:10:36.438482 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 10 23:10:36.438482 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 10 23:10:36.438482 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Aug 10 23:10:36.438482 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Aug 10 23:10:36.438482 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Aug 10 23:10:36.438482 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Aug 10 23:10:36.438482 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 10 23:10:36.438482 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 10 23:10:36.438482 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Aug 10 23:10:36.438482 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Aug 10 23:10:36.438482 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-356509337 not found for user 328e45be94f343c0b26583a12456ecca Aug 10 23:10:36.438482 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:10:36.438482 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:10:36.445507 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:10:36.445507 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:10:36.445507 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:10:36.445507 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:10:36.445507 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:10:36.445507 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:10:36.445507 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 23:10:36.445507 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 23:10:36.445507 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 10 23:10:36.445507 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 23:10:36.445507 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:10:36.445507 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:10:36.445507 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 143, in delete Aug 10 23:10:36.445507 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi self._delete(req, id) Aug 10 23:10:36.445507 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 172, in _delete Aug 10 23:10:36.445507 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Aug 10 23:10:36.445507 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-356509337 not found for user 328e45be94f343c0b26583a12456ecca Aug 10 23:10:36.445507 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:10:36.445507 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:10:36.445507 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:10:36.445507 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:10:36.445507 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:10:36.445507 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:10:36.445507 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:10:36.445507 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:10:36.445507 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-356509337 not found for user 328e45be94f343c0b26583a12456ecca Aug 10 23:10:36.445507 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:10:36.451335 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-0c5674cb-d184-43c4-a45e-c4e014d25611 tempest-KeyPairsNegativeTestJSON-1035250135 tempest-KeyPairsNegativeTestJSON-1035250135-project] Returning 404 to user: Keypair tempest-keypair-non-existent-356509337 not found for user 328e45be94f343c0b26583a12456ecca {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:10:36.453023 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-0c5674cb-d184-43c4-a45e-c4e014d25611 tempest-KeyPairsNegativeTestJSON-1035250135 tempest-KeyPairsNegativeTestJSON-1035250135-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-356509337" status: 404 len: 144 microversion: 2.1 time: 0.049851 Aug 10 23:10:36.453959 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1630/3151] 10.222.0.58 () {58 vars in 1257 bytes} [Wed Aug 10 23:10:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-356509337 => generated 144 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:10:36.494748 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-0ea56c5f-ae57-472d-8826-e941608f72f7 tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] [instance: 1305bc15-3da1-4fac-886e-29b42b7eedee] Going to try to terminate instance {{(pid=122632) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:10:36.850746 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-0ea56c5f-ae57-472d-8826-e941608f72f7 tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] 10.222.0.58 "DELETE /compute/v2.1/servers/1305bc15-3da1-4fac-886e-29b42b7eedee" status: 204 len: 0 microversion: 2.1 time: 0.510394 Aug 10 23:10:36.855401 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1522/3152] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:10:36 2022] DELETE /compute/v2.1/servers/1305bc15-3da1-4fac-886e-29b42b7eedee => generated 0 bytes in 515 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:10:36.864807 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-32defdac-9968-4b47-8340-da1c5c7da514 tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:10:36.883683 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-32defdac-9968-4b47-8340-da1c5c7da514 tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] [instance: 1305bc15-3da1-4fac-886e-29b42b7eedee] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:10:36.891267 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-f6c6c80d-4c9e-4af5-a740-1dda301cd526 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1194360040", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452", "networks": [{"uuid": "042efc3d-5a07-4ef1-a5d1-285928545eba"}]}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:10:36.910011 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-32defdac-9968-4b47-8340-da1c5c7da514 tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:10:36.911253 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-32defdac-9968-4b47-8340-da1c5c7da514 tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:10:36.911937 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-32defdac-9968-4b47-8340-da1c5c7da514 tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:10:36.918246 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-32defdac-9968-4b47-8340-da1c5c7da514 tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:10:36.920791 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-32defdac-9968-4b47-8340-da1c5c7da514 tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:10:36.922930 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-32defdac-9968-4b47-8340-da1c5c7da514 tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:10:37.709397 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.network.neutron [None req-f6c6c80d-4c9e-4af5-a740-1dda301cd526 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] validate_networks() for [('042efc3d-5a07-4ef1-a5d1-285928545eba', None, None, None, None, None)] {{(pid=122633) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 23:10:39.585655 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-32defdac-9968-4b47-8340-da1c5c7da514 tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1724aec95222440888977c15a7ed043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b00b4016aae8425e96b7046388f0a7de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:10:39.632889 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-32defdac-9968-4b47-8340-da1c5c7da514 tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] 10.222.0.58 "GET /compute/v2.1/servers/1305bc15-3da1-4fac-886e-29b42b7eedee" status: 200 len: 1510 microversion: 2.1 time: 2.770575 Aug 10 23:10:39.635985 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1523/3153] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:10:36 2022] GET /compute/v2.1/servers/1305bc15-3da1-4fac-886e-29b42b7eedee => generated 1510 bytes in 2777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:10:39.723159 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-f6c6c80d-4c9e-4af5-a740-1dda301cd526 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Flavor limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:10:39.725316 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-f6c6c80d-4c9e-4af5-a740-1dda301cd526 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Image limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:10:39.725986 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-f6c6c80d-4c9e-4af5-a740-1dda301cd526 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Flavor pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:10:39.726638 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-f6c6c80d-4c9e-4af5-a740-1dda301cd526 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Image pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:10:39.727252 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-f6c6c80d-4c9e-4af5-a740-1dda301cd526 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:10:39.748433 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f6c6c80d-4c9e-4af5-a740-1dda301cd526 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:10:39.749418 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f6c6c80d-4c9e-4af5-a740-1dda301cd526 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:10:39.751177 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f6c6c80d-4c9e-4af5-a740-1dda301cd526 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:10:39.753206 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f6c6c80d-4c9e-4af5-a740-1dda301cd526 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:10:39.754509 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f6c6c80d-4c9e-4af5-a740-1dda301cd526 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:10:39.759281 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f6c6c80d-4c9e-4af5-a740-1dda301cd526 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:10:39.773614 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=50,nova_cell1:INSERT=1 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:10:39.792119 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-f6c6c80d-4c9e-4af5-a740-1dda301cd526 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Getting quotas for project 7d90f8a58ad047fa8f347d6474e4d673. Resources: {'instances', 'cores', 'ram'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:10:39.800663 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-f6c6c80d-4c9e-4af5-a740-1dda301cd526 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Getting quotas for user 3c6160c7a42740efbe3613380933fa15 and project 7d90f8a58ad047fa8f347d6474e4d673. Resources: {'instances', 'cores', 'ram'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:10:39.836442 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-f6c6c80d-4c9e-4af5-a740-1dda301cd526 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Going to run 1 instances... {{(pid=122633) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 23:10:39.852116 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-f6c6c80d-4c9e-4af5-a740-1dda301cd526 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: 59ecfba7-b76a-4b71-9821-bd330a20922f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78ad8905-f66f-4733-8be9-2b260f1fabed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122633) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 23:10:40.047797 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-f6c6c80d-4c9e-4af5-a740-1dda301cd526 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.573506 Aug 10 23:10:40.051571 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1631/3154] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 23:10:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 3579 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 23:10:40.062960 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-580e824b-1fac-4b1b-a23b-1cd4748adf7a tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:10:40.063949 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-580e824b-1fac-4b1b-a23b-1cd4748adf7a tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: 59ecfba7-b76a-4b71-9821-bd330a20922f] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:10:40.913615 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-580e824b-1fac-4b1b-a23b-1cd4748adf7a tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6160c7a42740efbe3613380933fa15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d90f8a58ad047fa8f347d6474e4d673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:10:40.934087 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-580e824b-1fac-4b1b-a23b-1cd4748adf7a tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "GET /compute/v2.1/servers/59ecfba7-b76a-4b71-9821-bd330a20922f" status: 200 len: 1215 microversion: 2.1 time: 0.866258 Aug 10 23:10:40.938514 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1524/3155] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:10:40 2022] GET /compute/v2.1/servers/59ecfba7-b76a-4b71-9821-bd330a20922f => generated 1215 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:10:40.977883 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-16f1ed06-8e98-4876-b651-7efd06b58ae6 tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:10:40.983675 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-16f1ed06-8e98-4876-b651-7efd06b58ae6 tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] [instance: 1305bc15-3da1-4fac-886e-29b42b7eedee] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:10:41.002664 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-16f1ed06-8e98-4876-b651-7efd06b58ae6 tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:10:41.017299 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-16f1ed06-8e98-4876-b651-7efd06b58ae6 tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:10:41.019355 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-16f1ed06-8e98-4876-b651-7efd06b58ae6 tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:10:41.034169 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-16f1ed06-8e98-4876-b651-7efd06b58ae6 tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:10:41.041447 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-16f1ed06-8e98-4876-b651-7efd06b58ae6 tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:10:41.043479 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-16f1ed06-8e98-4876-b651-7efd06b58ae6 tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:10:41.280189 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-4b97482c-fbc4-48ad-ae85-e0039b7afec1 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Action: 'create', calling method: .version_select at 0x7f847cf67d30>, body: {"keypair": {"name": "tempest-keypair-323861283", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOT2s0j2qM9d6GFGkfKeEx0ILODQhyNR0dnbi3mo/csPgqYwaCtWpaID9p4tJSNKu8FS6m8At+mlWs3O72bLBsD6MEj5LezEMLGdVmoCTBANDBEn8zqC2P+1Y2lHs4xPZA=="}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:10:41.358157 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-4b97482c-fbc4-48ad-ae85-e0039b7afec1 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Getting quotas for project 1eb12683ada249bfa2ca7bf5cf730ca3. Resources: {'key_pairs'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:10:41.369967 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-4b97482c-fbc4-48ad-ae85-e0039b7afec1 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Getting quotas for user 2ea96841d5b64d2390d18b3eb5da8b73 and project 1eb12683ada249bfa2ca7bf5cf730ca3. Resources: {'key_pairs'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:10:41.460231 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-4b97482c-fbc4-48ad-ae85-e0039b7afec1 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.927792 Aug 10 23:10:41.461320 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1632/3156] 10.222.0.58 () {60 vars in 1159 bytes} [Wed Aug 10 23:10:40 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 23:10:41.964453 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-62f40958-3831-4e3b-8709-73e888b4593a tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:10:41.965130 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-62f40958-3831-4e3b-8709-73e888b4593a tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: 59ecfba7-b76a-4b71-9821-bd330a20922f] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:10:41.984634 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-62f40958-3831-4e3b-8709-73e888b4593a tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:10:41.985228 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-62f40958-3831-4e3b-8709-73e888b4593a tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:10:41.987765 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-62f40958-3831-4e3b-8709-73e888b4593a tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:10:41.990422 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-62f40958-3831-4e3b-8709-73e888b4593a tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:10:41.998913 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-62f40958-3831-4e3b-8709-73e888b4593a tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:10:42.001332 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-62f40958-3831-4e3b-8709-73e888b4593a tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:10:42.331232 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-62f40958-3831-4e3b-8709-73e888b4593a tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6160c7a42740efbe3613380933fa15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d90f8a58ad047fa8f347d6474e4d673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:10:42.331859 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-16f1ed06-8e98-4876-b651-7efd06b58ae6 tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1724aec95222440888977c15a7ed043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b00b4016aae8425e96b7046388f0a7de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:10:42.340254 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-16f1ed06-8e98-4876-b651-7efd06b58ae6 tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] 10.222.0.58 "GET /compute/v2.1/servers/1305bc15-3da1-4fac-886e-29b42b7eedee" status: 200 len: 1510 microversion: 2.1 time: 1.400338 Aug 10 23:10:42.340593 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-62f40958-3831-4e3b-8709-73e888b4593a tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "GET /compute/v2.1/servers/59ecfba7-b76a-4b71-9821-bd330a20922f" status: 200 len: 1211 microversion: 2.1 time: 0.381749 Aug 10 23:10:42.343194 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1525/3157] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:10:40 2022] GET /compute/v2.1/servers/1305bc15-3da1-4fac-886e-29b42b7eedee => generated 1510 bytes in 1404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:10:42.354931 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1633/3158] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:10:41 2022] GET /compute/v2.1/servers/59ecfba7-b76a-4b71-9821-bd330a20922f => generated 1211 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:10:43.113366 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-2fd941e2-6ecc-4d76-ba42-40a31147a17b req-5cc1db8c-8d15-432d-8204-74bad3d8f4bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1305bc15-3da1-4fac-886e-29b42b7eedee", "name": "network-vif-deleted", "tag": "1dd777d0-696c-45ae-946b-2427e186f7f2"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:10:43.152887 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-2fd941e2-6ecc-4d76-ba42-40a31147a17b req-5cc1db8c-8d15-432d-8204-74bad3d8f4bf service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:10:43.156467 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-2fd941e2-6ecc-4d76-ba42-40a31147a17b req-5cc1db8c-8d15-432d-8204-74bad3d8f4bf service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:10:43.157157 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-2fd941e2-6ecc-4d76-ba42-40a31147a17b req-5cc1db8c-8d15-432d-8204-74bad3d8f4bf service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:10:43.203424 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-2fd941e2-6ecc-4d76-ba42-40a31147a17b req-5cc1db8c-8d15-432d-8204-74bad3d8f4bf service nova] Creating event network-vif-deleted:1dd777d0-696c-45ae-946b-2427e186f7f2 for instance 1305bc15-3da1-4fac-886e-29b42b7eedee on n-h1-850468-14 Aug 10 23:10:43.220335 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-2fd941e2-6ecc-4d76-ba42-40a31147a17b req-5cc1db8c-8d15-432d-8204-74bad3d8f4bf service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119102 Aug 10 23:10:43.224874 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1526/3159] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:10:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:10:43.368123 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-b1e38ad2-6b18-4b76-b930-87d13d764ae3 tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:10:43.370095 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-b1e38ad2-6b18-4b76-b930-87d13d764ae3 tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] [instance: 1305bc15-3da1-4fac-886e-29b42b7eedee] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:10:43.384863 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-49c7b259-a287-472a-a5e1-be0cc85fa11e tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:10:43.387335 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-49c7b259-a287-472a-a5e1-be0cc85fa11e tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: 59ecfba7-b76a-4b71-9821-bd330a20922f] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:10:43.392382 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:10:43.412811 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-49c7b259-a287-472a-a5e1-be0cc85fa11e tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:10:43.416550 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-49c7b259-a287-472a-a5e1-be0cc85fa11e tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:10:43.417614 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b1e38ad2-6b18-4b76-b930-87d13d764ae3 tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:10:43.418460 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-49c7b259-a287-472a-a5e1-be0cc85fa11e tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:10:43.419165 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b1e38ad2-6b18-4b76-b930-87d13d764ae3 tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:10:43.420091 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-49c7b259-a287-472a-a5e1-be0cc85fa11e tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:10:43.420710 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b1e38ad2-6b18-4b76-b930-87d13d764ae3 tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:10:43.421347 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-49c7b259-a287-472a-a5e1-be0cc85fa11e tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:10:43.423093 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b1e38ad2-6b18-4b76-b930-87d13d764ae3 tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:10:43.423700 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-49c7b259-a287-472a-a5e1-be0cc85fa11e tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:10:43.426073 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b1e38ad2-6b18-4b76-b930-87d13d764ae3 tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:10:43.428829 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b1e38ad2-6b18-4b76-b930-87d13d764ae3 tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:10:43.614025 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b1e38ad2-6b18-4b76-b930-87d13d764ae3 tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:10:43.618165 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b1e38ad2-6b18-4b76-b930-87d13d764ae3 tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:10:43.619252 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b1e38ad2-6b18-4b76-b930-87d13d764ae3 tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:10:43.622278 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.objects.instance [None req-b1e38ad2-6b18-4b76-b930-87d13d764ae3 tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] Lazy-loading 'fault' on Instance uuid 1305bc15-3da1-4fac-886e-29b42b7eedee {{(pid=122633) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:10:43.892157 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-b1e38ad2-6b18-4b76-b930-87d13d764ae3 tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1724aec95222440888977c15a7ed043c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b00b4016aae8425e96b7046388f0a7de', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:10:43.900444 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-49c7b259-a287-472a-a5e1-be0cc85fa11e tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6160c7a42740efbe3613380933fa15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d90f8a58ad047fa8f347d6474e4d673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:10:43.914259 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-49c7b259-a287-472a-a5e1-be0cc85fa11e tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "GET /compute/v2.1/servers/59ecfba7-b76a-4b71-9821-bd330a20922f" status: 200 len: 1273 microversion: 2.1 time: 0.535869 Aug 10 23:10:43.917344 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1527/3160] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:10:43 2022] GET /compute/v2.1/servers/59ecfba7-b76a-4b71-9821-bd330a20922f => generated 1273 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:10:43.925777 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-b1e38ad2-6b18-4b76-b930-87d13d764ae3 tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] 10.222.0.58 "GET /compute/v2.1/servers/1305bc15-3da1-4fac-886e-29b42b7eedee" status: 200 len: 1306 microversion: 2.1 time: 0.553710 Aug 10 23:10:43.926762 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1634/3161] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:10:43 2022] GET /compute/v2.1/servers/1305bc15-3da1-4fac-886e-29b42b7eedee => generated 1306 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:10:44.865924 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-ec427d49-fcfd-416a-a140-0e8ae39ee27e tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Action: 'create', calling method: .version_select at 0x7f847c79ce50>, body: {"keypair": {"name": "tempest-keypair-565326783", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD41BE3DeKMckXFflK/fjRDXfVVIQDChspz7ZAcW0SJvi8jr2pwI8b9owwnQVs7PkEh0k7p4EULlbzzN52uPXdMIqSLHhK1laH4EMK9JTWmvoNeIRbu7lquqZst9XwZ/OA=="}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:10:44.888780 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:10:44.923601 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-ec427d49-fcfd-416a-a140-0e8ae39ee27e tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Getting quotas for project 0acff29ee63244cf901723175cbee173. Resources: {'key_pairs'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:10:44.937697 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-4193bce5-6080-4977-920b-e638b9173e8b tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:10:44.938342 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-4193bce5-6080-4977-920b-e638b9173e8b tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: 59ecfba7-b76a-4b71-9821-bd330a20922f] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:10:44.949827 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-ec427d49-fcfd-416a-a140-0e8ae39ee27e tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Getting quotas for user ecc806dca6c64050b7f0e33fdb9c109c and project 0acff29ee63244cf901723175cbee173. Resources: {'key_pairs'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:10:44.952765 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4193bce5-6080-4977-920b-e638b9173e8b tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:10:44.953269 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4193bce5-6080-4977-920b-e638b9173e8b tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:10:44.953714 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4193bce5-6080-4977-920b-e638b9173e8b tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:10:44.954470 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4193bce5-6080-4977-920b-e638b9173e8b tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:10:44.959867 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4193bce5-6080-4977-920b-e638b9173e8b tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:10:44.960383 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4193bce5-6080-4977-920b-e638b9173e8b tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:10:45.025349 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-ec427d49-fcfd-416a-a140-0e8ae39ee27e tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.330928 Aug 10 23:10:45.033782 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1528/3162] 10.222.0.58 () {60 vars in 1159 bytes} [Wed Aug 10 23:10:44 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:10:45.047383 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-b0866c6d-6068-42da-8228-4b79c3650b86 tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:10:45.052009 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-b0866c6d-6068-42da-8228-4b79c3650b86 tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] [instance: 1305bc15-3da1-4fac-886e-29b42b7eedee] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:10:45.073260 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b0866c6d-6068-42da-8228-4b79c3650b86 tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:10:45.076529 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b0866c6d-6068-42da-8228-4b79c3650b86 tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:10:45.077211 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b0866c6d-6068-42da-8228-4b79c3650b86 tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:10:45.078237 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b0866c6d-6068-42da-8228-4b79c3650b86 tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:10:45.081249 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b0866c6d-6068-42da-8228-4b79c3650b86 tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:10:45.082211 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b0866c6d-6068-42da-8228-4b79c3650b86 tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:10:45.123203 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-b0866c6d-6068-42da-8228-4b79c3650b86 tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] HTTP exception thrown: Instance 1305bc15-3da1-4fac-886e-29b42b7eedee could not be found. Aug 10 23:10:45.125092 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-b0866c6d-6068-42da-8228-4b79c3650b86 tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] Request method failure captured: Aug 10 23:10:45.125092 n-d-850468-14 devstack@n-api.service[122632]: request: GET /compute/v2.1/servers/1305bc15-3da1-4fac-886e-29b42b7eedee HTTP/1.1 Aug 10 23:10:45.125092 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:10:45.125092 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:10:45.125092 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:10:45.125092 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 23:10:45.125092 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:10:45.125092 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:10:45.125092 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:10:45.125092 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:10:45.125092 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9DrS3mr3Ksj2rmUr0xpewtDBiGTog9ceKz1AV3LSqvLueQozww-GtQMmsJxYCLiwbbUTHHo4OLSka1t49tVohJPU26Caf4vo5R2AdEEGwZBBozipr2oTFbQSDMFZP_wYcU58c66fBj-v52fvLufEvjmKCVrWJKlpe6hWoxZc_v3l-n0 Aug 10 23:10:45.125092 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:10:45.125092 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:10:45.125092 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:10:45.125092 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:10:45.125092 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:10:45.125092 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:10:45.125092 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: b00b4016aae8425e96b7046388f0a7de Aug 10 23:10:45.125092 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-ServerPasswordTestJSON-1078112504 Aug 10 23:10:45.125092 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:10:45.125092 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:10:45.125092 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b00b4016aae8425e96b7046388f0a7de"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b00b4016aae8425e96b7046388f0a7de"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b00b4016aae8425e96b7046388f0a7de"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b00b4016aae8425e96b7046388f0a7de", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:10:45.125092 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-ServerPasswordTestJSON-1078112504 Aug 10 23:10:45.125092 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: b00b4016aae8425e96b7046388f0a7de Aug 10 23:10:45.125092 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-ServerPasswordTestJSON-1078112504 Aug 10 23:10:45.125092 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-ServerPasswordTestJSON-1078112504-project Aug 10 23:10:45.125092 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:10:45.125092 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:10:45.125092 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: 1724aec95222440888977c15a7ed043c Aug 10 23:10:45.125092 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-ServerPasswordTestJSON-1078112504-project Aug 10 23:10:45.125092 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:10:45.125092 n-d-850468-14 devstack@n-api.service[122632]: exception: Instance 1305bc15-3da1-4fac-886e-29b42b7eedee could not be found. Aug 10 23:10:45.125092 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': '1305bc15-3da1-4fac-886e-29b42b7eedee'} Aug 10 23:10:45.125092 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:10:45.125092 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:10:45.125092 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:10:45.125092 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:10:45.125092 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:10:45.125092 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:10:45.125092 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:10:45.125092 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:10:45.125092 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:10:45.125092 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:10:45.125092 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1305bc15-3da1-4fac-886e-29b42b7eedee could not be found. Aug 10 23:10:45.125092 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:10:45.125092 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:10:45.125092 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:10:45.125092 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:10:45.125092 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:10:45.125092 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:10:45.125092 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:10:45.125092 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:10:45.125092 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:10:45.125092 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:10:45.125092 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:10:45.125092 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:10:45.125092 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:10:45.125092 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:10:45.125092 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:10:45.125092 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:10:45.125092 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1305bc15-3da1-4fac-886e-29b42b7eedee could not be found. Aug 10 23:10:45.125092 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:10:45.125092 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:10:45.125092 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:10:45.130572 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:10:45.130572 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:10:45.130572 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:10:45.130572 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:10:45.130572 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:10:45.130572 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1305bc15-3da1-4fac-886e-29b42b7eedee could not be found. Aug 10 23:10:45.130572 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:10:45.134131 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-b0866c6d-6068-42da-8228-4b79c3650b86 tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] Returning 404 to user: Instance 1305bc15-3da1-4fac-886e-29b42b7eedee could not be found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:10:45.134131 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-b0866c6d-6068-42da-8228-4b79c3650b86 tempest-ServerPasswordTestJSON-1078112504 tempest-ServerPasswordTestJSON-1078112504-project] 10.222.0.58 "GET /compute/v2.1/servers/1305bc15-3da1-4fac-886e-29b42b7eedee" status: 404 len: 111 microversion: 2.1 time: 0.098126 Aug 10 23:10:45.134690 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1529/3163] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:10:45 2022] GET /compute/v2.1/servers/1305bc15-3da1-4fac-886e-29b42b7eedee => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:10:45.343657 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-4193bce5-6080-4977-920b-e638b9173e8b tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6160c7a42740efbe3613380933fa15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d90f8a58ad047fa8f347d6474e4d673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:10:45.354829 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-4193bce5-6080-4977-920b-e638b9173e8b tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "GET /compute/v2.1/servers/59ecfba7-b76a-4b71-9821-bd330a20922f" status: 200 len: 1273 microversion: 2.1 time: 0.421602 Aug 10 23:10:45.358475 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1635/3164] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:10:44 2022] GET /compute/v2.1/servers/59ecfba7-b76a-4b71-9821-bd330a20922f => generated 1273 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:10:46.391716 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-5284bff0-3154-4007-9095-7f2cac47a205 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:10:46.397640 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-5284bff0-3154-4007-9095-7f2cac47a205 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: 59ecfba7-b76a-4b71-9821-bd330a20922f] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:10:46.414986 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5284bff0-3154-4007-9095-7f2cac47a205 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:10:46.416705 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5284bff0-3154-4007-9095-7f2cac47a205 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:10:46.419291 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5284bff0-3154-4007-9095-7f2cac47a205 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:10:46.423647 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5284bff0-3154-4007-9095-7f2cac47a205 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:10:46.425164 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5284bff0-3154-4007-9095-7f2cac47a205 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:10:46.426093 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5284bff0-3154-4007-9095-7f2cac47a205 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:10:46.458273 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=2,nova_cell1:INSERT=5 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:10:46.788886 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-453fe930-1a99-47d4-9787-abc0f0218bfd tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-347053353", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9e4068f0-b1bd-443a-a951-7f332436087d"}], "security_groups": [{"name": "tempest-securitygroup--721140823"}], "key_name": "tempest-keypair-323861283", "user_data": "}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:10:46.821805 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-5284bff0-3154-4007-9095-7f2cac47a205 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6160c7a42740efbe3613380933fa15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d90f8a58ad047fa8f347d6474e4d673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:10:46.830665 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-5284bff0-3154-4007-9095-7f2cac47a205 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "GET /compute/v2.1/servers/59ecfba7-b76a-4b71-9821-bd330a20922f" status: 200 len: 1273 microversion: 2.1 time: 0.444909 Aug 10 23:10:46.837560 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1530/3165] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:10:46 2022] GET /compute/v2.1/servers/59ecfba7-b76a-4b71-9821-bd330a20922f => generated 1273 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:10:47.081331 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.network.neutron [None req-453fe930-1a99-47d4-9787-abc0f0218bfd tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] validate_networks() for [('9e4068f0-b1bd-443a-a951-7f332436087d', None, None, None, None, None)] {{(pid=122633) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 23:10:47.235330 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-acfc3c99-c01e-435f-96d8-9838c2221a51 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:10:47.235747 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-acfc3c99-c01e-435f-96d8-9838c2221a51 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] [instance: 23452b78-96cd-430d-b95c-aaa98a427d53] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:10:47.248518 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-acfc3c99-c01e-435f-96d8-9838c2221a51 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:10:47.249008 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-acfc3c99-c01e-435f-96d8-9838c2221a51 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:10:47.249869 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-acfc3c99-c01e-435f-96d8-9838c2221a51 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:10:47.250615 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-acfc3c99-c01e-435f-96d8-9838c2221a51 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:10:47.258216 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-acfc3c99-c01e-435f-96d8-9838c2221a51 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:10:47.258725 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-acfc3c99-c01e-435f-96d8-9838c2221a51 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:10:47.352239 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-acfc3c99-c01e-435f-96d8-9838c2221a51 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] 10.222.0.58 "GET /compute/v2.1/servers/23452b78-96cd-430d-b95c-aaa98a427d53/os-volume_attachments/0398ab6a-e4dd-4b85-a953-a8767b9babe3" status: 200 len: 194 microversion: 2.1 time: 0.120740 Aug 10 23:10:47.366614 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1531/3166] 10.222.0.58 () {58 vars in 1413 bytes} [Wed Aug 10 23:10:47 2022] GET /compute/v2.1/servers/23452b78-96cd-430d-b95c-aaa98a427d53/os-volume_attachments/0398ab6a-e4dd-4b85-a953-a8767b9babe3 => generated 194 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 23:10:47.378153 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-e73a876c-fb24-4bcf-b6ad-eb67093d975e tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:10:47.380529 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-e73a876c-fb24-4bcf-b6ad-eb67093d975e tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] [instance: 23452b78-96cd-430d-b95c-aaa98a427d53] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:10:47.389060 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e73a876c-fb24-4bcf-b6ad-eb67093d975e tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:10:47.389898 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e73a876c-fb24-4bcf-b6ad-eb67093d975e tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:10:47.390495 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e73a876c-fb24-4bcf-b6ad-eb67093d975e tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:10:47.391930 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e73a876c-fb24-4bcf-b6ad-eb67093d975e tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:10:47.394305 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e73a876c-fb24-4bcf-b6ad-eb67093d975e tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:10:47.395632 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e73a876c-fb24-4bcf-b6ad-eb67093d975e tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:10:47.549815 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.objects.instance [None req-e73a876c-fb24-4bcf-b6ad-eb67093d975e tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lazy-loading 'services' on Instance uuid 23452b78-96cd-430d-b95c-aaa98a427d53 {{(pid=122632) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:10:47.696521 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-e73a876c-fb24-4bcf-b6ad-eb67093d975e tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] 10.222.0.58 "DELETE /compute/v2.1/servers/23452b78-96cd-430d-b95c-aaa98a427d53/os-volume_attachments/0398ab6a-e4dd-4b85-a953-a8767b9babe3" status: 202 len: 0 microversion: 2.1 time: 0.325769 Aug 10 23:10:47.700072 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1532/3167] 10.222.0.58 () {58 vars in 1416 bytes} [Wed Aug 10 23:10:47 2022] DELETE /compute/v2.1/servers/23452b78-96cd-430d-b95c-aaa98a427d53/os-volume_attachments/0398ab6a-e4dd-4b85-a953-a8767b9babe3 => generated 0 bytes in 332 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:10:47.863802 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-86f46a53-b21a-4b50-a7ab-3ee107639e15 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:10:47.865073 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-86f46a53-b21a-4b50-a7ab-3ee107639e15 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: 59ecfba7-b76a-4b71-9821-bd330a20922f] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:10:47.901485 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-86f46a53-b21a-4b50-a7ab-3ee107639e15 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:10:47.902364 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-86f46a53-b21a-4b50-a7ab-3ee107639e15 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:10:47.903889 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-86f46a53-b21a-4b50-a7ab-3ee107639e15 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:10:47.911285 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-86f46a53-b21a-4b50-a7ab-3ee107639e15 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:10:47.916012 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-86f46a53-b21a-4b50-a7ab-3ee107639e15 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:10:47.916930 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-86f46a53-b21a-4b50-a7ab-3ee107639e15 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:10:49.037947 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-86f46a53-b21a-4b50-a7ab-3ee107639e15 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6160c7a42740efbe3613380933fa15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d90f8a58ad047fa8f347d6474e4d673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:10:49.046032 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-86f46a53-b21a-4b50-a7ab-3ee107639e15 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "GET /compute/v2.1/servers/59ecfba7-b76a-4b71-9821-bd330a20922f" status: 200 len: 1315 microversion: 2.1 time: 1.188008 Aug 10 23:10:49.061799 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1533/3168] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:10:47 2022] GET /compute/v2.1/servers/59ecfba7-b76a-4b71-9821-bd330a20922f => generated 1315 bytes in 1206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:10:49.774326 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=2 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:10:49.930624 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-453fe930-1a99-47d4-9787-abc0f0218bfd tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Flavor limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:10:49.931370 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-453fe930-1a99-47d4-9787-abc0f0218bfd tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Image limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:10:49.932219 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-453fe930-1a99-47d4-9787-abc0f0218bfd tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Flavor pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:10:49.933007 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-453fe930-1a99-47d4-9787-abc0f0218bfd tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Image pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:10:49.933586 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-453fe930-1a99-47d4-9787-abc0f0218bfd tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:10:49.956946 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-453fe930-1a99-47d4-9787-abc0f0218bfd tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:10:49.957520 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-453fe930-1a99-47d4-9787-abc0f0218bfd tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:10:49.958120 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-453fe930-1a99-47d4-9787-abc0f0218bfd tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:10:49.959102 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-453fe930-1a99-47d4-9787-abc0f0218bfd tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:10:49.959568 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-453fe930-1a99-47d4-9787-abc0f0218bfd tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:10:49.968194 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-453fe930-1a99-47d4-9787-abc0f0218bfd tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:10:50.053342 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-453fe930-1a99-47d4-9787-abc0f0218bfd tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Getting quotas for project 1eb12683ada249bfa2ca7bf5cf730ca3. Resources: {'instances', 'cores', 'ram'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:10:50.069814 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-453fe930-1a99-47d4-9787-abc0f0218bfd tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Getting quotas for user 2ea96841d5b64d2390d18b3eb5da8b73 and project 1eb12683ada249bfa2ca7bf5cf730ca3. Resources: {'instances', 'cores', 'ram'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:10:50.074458 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-7ef5d956-66a3-4abd-b09c-1a66a6585584 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:10:50.075143 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-7ef5d956-66a3-4abd-b09c-1a66a6585584 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: 59ecfba7-b76a-4b71-9821-bd330a20922f] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:10:50.096713 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7ef5d956-66a3-4abd-b09c-1a66a6585584 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:10:50.097255 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7ef5d956-66a3-4abd-b09c-1a66a6585584 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:10:50.104593 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7ef5d956-66a3-4abd-b09c-1a66a6585584 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:10:50.106211 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7ef5d956-66a3-4abd-b09c-1a66a6585584 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:10:50.109757 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7ef5d956-66a3-4abd-b09c-1a66a6585584 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:10:50.110263 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7ef5d956-66a3-4abd-b09c-1a66a6585584 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:10:50.118926 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-453fe930-1a99-47d4-9787-abc0f0218bfd tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Going to run 1 instances... {{(pid=122633) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 23:10:50.121119 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-453fe930-1a99-47d4-9787-abc0f0218bfd tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: fa9dfd3a-a636-48ce-ae15-0ed51baee954] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78ad8905-f66f-4733-8be9-2b260f1fabed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122633) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 23:10:50.239911 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-453fe930-1a99-47d4-9787-abc0f0218bfd tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 3.457051 Aug 10 23:10:50.241250 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1636/3169] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 23:10:46 2022] POST /compute/v2.1/servers => generated 408 bytes in 3459 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 23:10:50.252361 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-069fdffc-26fa-4dc6-8472-2f1e558efd23 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:10:50.253403 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-069fdffc-26fa-4dc6-8472-2f1e558efd23 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: fa9dfd3a-a636-48ce-ae15-0ed51baee954] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:10:50.974179 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-069fdffc-26fa-4dc6-8472-2f1e558efd23 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:10:50.988964 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-069fdffc-26fa-4dc6-8472-2f1e558efd23 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954" status: 200 len: 1237 microversion: 2.1 time: 0.740564 Aug 10 23:10:50.989755 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1637/3170] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:10:50 2022] GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954 => generated 1237 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:10:51.114829 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-7ef5d956-66a3-4abd-b09c-1a66a6585584 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6160c7a42740efbe3613380933fa15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d90f8a58ad047fa8f347d6474e4d673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:10:51.135840 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-7ef5d956-66a3-4abd-b09c-1a66a6585584 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "GET /compute/v2.1/servers/59ecfba7-b76a-4b71-9821-bd330a20922f" status: 200 len: 1315 microversion: 2.1 time: 1.063108 Aug 10 23:10:51.151646 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1534/3171] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:10:50 2022] GET /compute/v2.1/servers/59ecfba7-b76a-4b71-9821-bd330a20922f => generated 1315 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:10:51.494453 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-48abd7af-690f-4dbf-92af-401aae61c75a tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "b93cb3c4-84a8-495b-a08c-78cef18ffbb9"}], "security_groups": [{"name": "tempest-securitygroup--1286728160"}], "key_name": "tempest-keypair-565326783", "user_data": "}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:10:51.888584 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.network.neutron [None req-48abd7af-690f-4dbf-92af-401aae61c75a tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] validate_networks() for [('b93cb3c4-84a8-495b-a08c-78cef18ffbb9', None, None, None, None, None)] {{(pid=122633) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 23:10:52.015235 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-ec22afa7-2be8-4dab-bb27-f77f7e58d902 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:10:52.016054 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-ec22afa7-2be8-4dab-bb27-f77f7e58d902 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: fa9dfd3a-a636-48ce-ae15-0ed51baee954] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:10:52.045943 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ec22afa7-2be8-4dab-bb27-f77f7e58d902 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:10:52.055489 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ec22afa7-2be8-4dab-bb27-f77f7e58d902 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:10:52.056853 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ec22afa7-2be8-4dab-bb27-f77f7e58d902 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:10:52.066188 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ec22afa7-2be8-4dab-bb27-f77f7e58d902 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:10:52.083951 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ec22afa7-2be8-4dab-bb27-f77f7e58d902 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:10:52.085118 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ec22afa7-2be8-4dab-bb27-f77f7e58d902 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:10:52.540061 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-ec22afa7-2be8-4dab-bb27-f77f7e58d902 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:10:52.583189 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-ec22afa7-2be8-4dab-bb27-f77f7e58d902 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954" status: 200 len: 1233 microversion: 2.1 time: 0.572905 Aug 10 23:10:52.586335 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1535/3172] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:10:52 2022] GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954 => generated 1233 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:10:52.616252 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-586454e9-cb6e-4270-960a-140d37fcbad2 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:10:52.617540 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-586454e9-cb6e-4270-960a-140d37fcbad2 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: 59ecfba7-b76a-4b71-9821-bd330a20922f] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:10:52.626310 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-586454e9-cb6e-4270-960a-140d37fcbad2 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:10:52.627644 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-586454e9-cb6e-4270-960a-140d37fcbad2 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:10:52.628337 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-586454e9-cb6e-4270-960a-140d37fcbad2 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:10:52.629487 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-586454e9-cb6e-4270-960a-140d37fcbad2 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:10:52.630099 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-586454e9-cb6e-4270-960a-140d37fcbad2 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:10:52.630642 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-586454e9-cb6e-4270-960a-140d37fcbad2 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:10:52.761055 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-48abd7af-690f-4dbf-92af-401aae61c75a tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Flavor limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:10:52.762300 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-48abd7af-690f-4dbf-92af-401aae61c75a tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Image limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:10:52.765338 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-48abd7af-690f-4dbf-92af-401aae61c75a tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Flavor pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:10:52.765996 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-48abd7af-690f-4dbf-92af-401aae61c75a tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Image pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:10:52.766587 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-48abd7af-690f-4dbf-92af-401aae61c75a tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:10:52.818524 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-48abd7af-690f-4dbf-92af-401aae61c75a tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:10:52.819305 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-48abd7af-690f-4dbf-92af-401aae61c75a tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:10:52.819932 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-48abd7af-690f-4dbf-92af-401aae61c75a tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:10:52.820866 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-48abd7af-690f-4dbf-92af-401aae61c75a tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:10:52.821502 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-48abd7af-690f-4dbf-92af-401aae61c75a tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:10:52.829696 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-48abd7af-690f-4dbf-92af-401aae61c75a tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:10:52.884130 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-48abd7af-690f-4dbf-92af-401aae61c75a tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Getting quotas for project 0acff29ee63244cf901723175cbee173. Resources: {'instances', 'cores', 'ram'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:10:52.903124 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-48abd7af-690f-4dbf-92af-401aae61c75a tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Getting quotas for user ecc806dca6c64050b7f0e33fdb9c109c and project 0acff29ee63244cf901723175cbee173. Resources: {'instances', 'cores', 'ram'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:10:52.943787 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-48abd7af-690f-4dbf-92af-401aae61c75a tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Going to run 1 instances... {{(pid=122633) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 23:10:52.952424 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-48abd7af-690f-4dbf-92af-401aae61c75a tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] [instance: 23c5c205-bafa-414f-8c1c-d3b78eb82538] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78ad8905-f66f-4733-8be9-2b260f1fabed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122633) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 23:10:53.121007 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-48abd7af-690f-4dbf-92af-401aae61c75a tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.632280 Aug 10 23:10:53.133390 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1638/3173] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 23:10:51 2022] POST /compute/v2.1/servers => generated 409 bytes in 1647 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 23:10:53.142234 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-ec8317c5-100c-4b60-9271-9e44139adb35 tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:10:53.148917 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-ec8317c5-100c-4b60-9271-9e44139adb35 tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] [instance: 23c5c205-bafa-414f-8c1c-d3b78eb82538] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:10:53.469700 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-ec8317c5-100c-4b60-9271-9e44139adb35 tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc806dca6c64050b7f0e33fdb9c109c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acff29ee63244cf901723175cbee173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:10:53.483208 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-ec8317c5-100c-4b60-9271-9e44139adb35 tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] 10.222.0.58 "GET /compute/v2.1/servers/23c5c205-bafa-414f-8c1c-d3b78eb82538" status: 200 len: 1225 microversion: 2.1 time: 0.348264 Aug 10 23:10:53.488730 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1639/3174] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:10:53 2022] GET /compute/v2.1/servers/23c5c205-bafa-414f-8c1c-d3b78eb82538 => generated 1225 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:10:53.610480 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-0bc80eb1-49a2-45c8-beee-548ffb478378 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:10:53.614237 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-0bc80eb1-49a2-45c8-beee-548ffb478378 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: fa9dfd3a-a636-48ce-ae15-0ed51baee954] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:10:53.640229 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0bc80eb1-49a2-45c8-beee-548ffb478378 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:10:53.641191 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0bc80eb1-49a2-45c8-beee-548ffb478378 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:10:53.644999 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0bc80eb1-49a2-45c8-beee-548ffb478378 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:10:53.649469 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0bc80eb1-49a2-45c8-beee-548ffb478378 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:10:53.650708 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0bc80eb1-49a2-45c8-beee-548ffb478378 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:10:53.657062 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0bc80eb1-49a2-45c8-beee-548ffb478378 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:10:53.909331 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-0bc80eb1-49a2-45c8-beee-548ffb478378 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:10:53.949352 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-0bc80eb1-49a2-45c8-beee-548ffb478378 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954" status: 200 len: 1295 microversion: 2.1 time: 0.342036 Aug 10 23:10:53.969668 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1640/3175] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:10:53 2022] GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954 => generated 1295 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:10:54.508257 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-541c118e-5d66-44e1-b7ab-e4625a35dac7 tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:10:54.509586 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-541c118e-5d66-44e1-b7ab-e4625a35dac7 tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] [instance: 23c5c205-bafa-414f-8c1c-d3b78eb82538] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:10:54.526558 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-541c118e-5d66-44e1-b7ab-e4625a35dac7 tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:10:54.532241 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-541c118e-5d66-44e1-b7ab-e4625a35dac7 tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:10:54.532710 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-541c118e-5d66-44e1-b7ab-e4625a35dac7 tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:10:54.539742 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-541c118e-5d66-44e1-b7ab-e4625a35dac7 tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:10:54.540259 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-541c118e-5d66-44e1-b7ab-e4625a35dac7 tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:10:54.540897 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-541c118e-5d66-44e1-b7ab-e4625a35dac7 tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:10:54.852709 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-541c118e-5d66-44e1-b7ab-e4625a35dac7 tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc806dca6c64050b7f0e33fdb9c109c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acff29ee63244cf901723175cbee173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:10:54.862742 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-541c118e-5d66-44e1-b7ab-e4625a35dac7 tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] 10.222.0.58 "GET /compute/v2.1/servers/23c5c205-bafa-414f-8c1c-d3b78eb82538" status: 200 len: 1229 microversion: 2.1 time: 0.360933 Aug 10 23:10:54.876134 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1641/3176] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:10:54 2022] GET /compute/v2.1/servers/23c5c205-bafa-414f-8c1c-d3b78eb82538 => generated 1229 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:10:54.975254 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-b9d5c944-699b-4a8b-a7e7-667be7863172 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:10:54.976095 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-b9d5c944-699b-4a8b-a7e7-667be7863172 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: fa9dfd3a-a636-48ce-ae15-0ed51baee954] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:10:54.982558 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=6 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:10:54.994529 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b9d5c944-699b-4a8b-a7e7-667be7863172 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:10:54.995354 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b9d5c944-699b-4a8b-a7e7-667be7863172 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:10:54.999171 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b9d5c944-699b-4a8b-a7e7-667be7863172 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:10:55.000593 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b9d5c944-699b-4a8b-a7e7-667be7863172 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:10:55.001257 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b9d5c944-699b-4a8b-a7e7-667be7863172 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:10:55.003877 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b9d5c944-699b-4a8b-a7e7-667be7863172 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:10:55.390534 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-586454e9-cb6e-4270-960a-140d37fcbad2 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6160c7a42740efbe3613380933fa15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d90f8a58ad047fa8f347d6474e4d673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:10:55.411015 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-586454e9-cb6e-4270-960a-140d37fcbad2 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "GET /compute/v2.1/servers/59ecfba7-b76a-4b71-9821-bd330a20922f" status: 200 len: 1315 microversion: 2.1 time: 2.810664 Aug 10 23:10:55.412012 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1536/3177] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:10:52 2022] GET /compute/v2.1/servers/59ecfba7-b76a-4b71-9821-bd330a20922f => generated 1315 bytes in 2825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:10:55.556295 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-b9d5c944-699b-4a8b-a7e7-667be7863172 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:10:55.575369 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-b9d5c944-699b-4a8b-a7e7-667be7863172 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954" status: 200 len: 1362 microversion: 2.1 time: 0.596949 Aug 10 23:10:55.583096 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1642/3178] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:10:54 2022] GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954 => generated 1362 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:10:55.884179 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-19153966-18d4-44ac-80a9-dd578ea33337 tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:10:55.884820 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-19153966-18d4-44ac-80a9-dd578ea33337 tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] [instance: 23c5c205-bafa-414f-8c1c-d3b78eb82538] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:10:55.907334 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-19153966-18d4-44ac-80a9-dd578ea33337 tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:10:55.908883 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-19153966-18d4-44ac-80a9-dd578ea33337 tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:10:55.909347 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-19153966-18d4-44ac-80a9-dd578ea33337 tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:10:55.910081 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-19153966-18d4-44ac-80a9-dd578ea33337 tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:10:55.910544 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-19153966-18d4-44ac-80a9-dd578ea33337 tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:10:55.911008 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-19153966-18d4-44ac-80a9-dd578ea33337 tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:10:56.184370 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-19153966-18d4-44ac-80a9-dd578ea33337 tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc806dca6c64050b7f0e33fdb9c109c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acff29ee63244cf901723175cbee173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:10:56.195333 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-19153966-18d4-44ac-80a9-dd578ea33337 tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] 10.222.0.58 "GET /compute/v2.1/servers/23c5c205-bafa-414f-8c1c-d3b78eb82538" status: 200 len: 1283 microversion: 2.1 time: 0.315258 Aug 10 23:10:56.195900 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1537/3179] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:10:55 2022] GET /compute/v2.1/servers/23c5c205-bafa-414f-8c1c-d3b78eb82538 => generated 1283 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:10:56.294718 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-c323600e-a839-4e81-ba89-ec8f52762305 req-d33f6010-088f-4c07-81b8-ad3c8f088388 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa9dfd3a-a636-48ce-ae15-0ed51baee954", "tag": "456f7ca7-21c6-4b5d-8993-9a7c329acf12"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:10:56.317796 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-c323600e-a839-4e81-ba89-ec8f52762305 req-d33f6010-088f-4c07-81b8-ad3c8f088388 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:10:56.324655 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-c323600e-a839-4e81-ba89-ec8f52762305 req-d33f6010-088f-4c07-81b8-ad3c8f088388 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:10:56.328301 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-c323600e-a839-4e81-ba89-ec8f52762305 req-d33f6010-088f-4c07-81b8-ad3c8f088388 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:10:56.330529 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-3d574883-17c0-4567-85b0-66b42d664c8e req-77dae82d-2f1f-4dda-84b5-34b43c3860fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59ecfba7-b76a-4b71-9821-bd330a20922f", "tag": "fc0713b3-97ad-48e6-b43b-97aa6ce32c32"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:10:56.349992 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-3d574883-17c0-4567-85b0-66b42d664c8e req-77dae82d-2f1f-4dda-84b5-34b43c3860fc service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:10:56.350920 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-3d574883-17c0-4567-85b0-66b42d664c8e req-77dae82d-2f1f-4dda-84b5-34b43c3860fc service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:10:56.351582 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-3d574883-17c0-4567-85b0-66b42d664c8e req-77dae82d-2f1f-4dda-84b5-34b43c3860fc service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:10:56.367928 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-3d574883-17c0-4567-85b0-66b42d664c8e req-77dae82d-2f1f-4dda-84b5-34b43c3860fc service nova] Creating event network-changed:fc0713b3-97ad-48e6-b43b-97aa6ce32c32 for instance 59ecfba7-b76a-4b71-9821-bd330a20922f on n-h1-850468-14 Aug 10 23:10:56.375126 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-c323600e-a839-4e81-ba89-ec8f52762305 req-d33f6010-088f-4c07-81b8-ad3c8f088388 service nova] Creating event network-changed:456f7ca7-21c6-4b5d-8993-9a7c329acf12 for instance fa9dfd3a-a636-48ce-ae15-0ed51baee954 on n-h2-850468-14 Aug 10 23:10:56.381989 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-3d574883-17c0-4567-85b0-66b42d664c8e req-77dae82d-2f1f-4dda-84b5-34b43c3860fc service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055552 Aug 10 23:10:56.382617 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1538/3180] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:10:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 23:10:56.395342 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-c323600e-a839-4e81-ba89-ec8f52762305 req-d33f6010-088f-4c07-81b8-ad3c8f088388 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107776 Aug 10 23:10:56.395985 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1643/3181] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:10:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:10:56.433768 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-ec5856cc-cce4-40f8-8ff5-a20c6814f9c7 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:10:56.434946 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-ec5856cc-cce4-40f8-8ff5-a20c6814f9c7 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: 59ecfba7-b76a-4b71-9821-bd330a20922f] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:10:56.448340 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ec5856cc-cce4-40f8-8ff5-a20c6814f9c7 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:10:56.452401 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ec5856cc-cce4-40f8-8ff5-a20c6814f9c7 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:10:56.453186 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ec5856cc-cce4-40f8-8ff5-a20c6814f9c7 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:10:56.455827 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ec5856cc-cce4-40f8-8ff5-a20c6814f9c7 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:10:56.459063 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ec5856cc-cce4-40f8-8ff5-a20c6814f9c7 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:10:56.459627 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ec5856cc-cce4-40f8-8ff5-a20c6814f9c7 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:10:56.598738 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c220a98a-4994-4eb8-bf70-9317925e08b8 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:10:56.599757 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-c220a98a-4994-4eb8-bf70-9317925e08b8 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: fa9dfd3a-a636-48ce-ae15-0ed51baee954] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:10:56.612063 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c220a98a-4994-4eb8-bf70-9317925e08b8 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:10:56.613423 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c220a98a-4994-4eb8-bf70-9317925e08b8 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:10:56.614115 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c220a98a-4994-4eb8-bf70-9317925e08b8 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:10:56.615287 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c220a98a-4994-4eb8-bf70-9317925e08b8 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:10:56.616106 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c220a98a-4994-4eb8-bf70-9317925e08b8 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:10:56.616754 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c220a98a-4994-4eb8-bf70-9317925e08b8 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:10:56.913119 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-c220a98a-4994-4eb8-bf70-9317925e08b8 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:10:56.925670 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-c220a98a-4994-4eb8-bf70-9317925e08b8 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954" status: 200 len: 1362 microversion: 2.1 time: 0.332722 Aug 10 23:10:56.928185 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1644/3182] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:10:56 2022] GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954 => generated 1362 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:10:57.195610 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-ec5856cc-cce4-40f8-8ff5-a20c6814f9c7 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6160c7a42740efbe3613380933fa15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d90f8a58ad047fa8f347d6474e4d673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:10:57.220330 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-ffabd9ce-95e1-4d1c-aae2-49bc7d36b64c tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:10:57.223114 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-ffabd9ce-95e1-4d1c-aae2-49bc7d36b64c tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] [instance: 23c5c205-bafa-414f-8c1c-d3b78eb82538] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:10:57.271080 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ffabd9ce-95e1-4d1c-aae2-49bc7d36b64c tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:10:57.272278 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-ec5856cc-cce4-40f8-8ff5-a20c6814f9c7 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "GET /compute/v2.1/servers/59ecfba7-b76a-4b71-9821-bd330a20922f" status: 200 len: 1315 microversion: 2.1 time: 0.810172 Aug 10 23:10:57.273262 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1539/3183] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:10:56 2022] GET /compute/v2.1/servers/59ecfba7-b76a-4b71-9821-bd330a20922f => generated 1315 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:10:57.275232 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ffabd9ce-95e1-4d1c-aae2-49bc7d36b64c tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:10:57.277225 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ffabd9ce-95e1-4d1c-aae2-49bc7d36b64c tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:10:57.278263 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ffabd9ce-95e1-4d1c-aae2-49bc7d36b64c tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:10:57.284624 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ffabd9ce-95e1-4d1c-aae2-49bc7d36b64c tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:10:57.285635 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ffabd9ce-95e1-4d1c-aae2-49bc7d36b64c tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:10:57.415058 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-ffabd9ce-95e1-4d1c-aae2-49bc7d36b64c tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc806dca6c64050b7f0e33fdb9c109c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acff29ee63244cf901723175cbee173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:10:57.427052 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-ffabd9ce-95e1-4d1c-aae2-49bc7d36b64c tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] 10.222.0.58 "GET /compute/v2.1/servers/23c5c205-bafa-414f-8c1c-d3b78eb82538" status: 200 len: 1283 microversion: 2.1 time: 0.213387 Aug 10 23:10:57.441166 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1645/3184] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:10:57 2022] GET /compute/v2.1/servers/23c5c205-bafa-414f-8c1c-d3b78eb82538 => generated 1283 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:10:57.950920 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-125d904d-9f69-49f7-9e89-23aef4d725b2 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:10:57.952153 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-125d904d-9f69-49f7-9e89-23aef4d725b2 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: fa9dfd3a-a636-48ce-ae15-0ed51baee954] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:10:57.987923 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-125d904d-9f69-49f7-9e89-23aef4d725b2 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:10:57.988872 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-125d904d-9f69-49f7-9e89-23aef4d725b2 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:10:57.990775 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-125d904d-9f69-49f7-9e89-23aef4d725b2 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:10:57.992589 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-125d904d-9f69-49f7-9e89-23aef4d725b2 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:10:57.998569 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-125d904d-9f69-49f7-9e89-23aef4d725b2 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:10:58.000120 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-125d904d-9f69-49f7-9e89-23aef4d725b2 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:10:58.294097 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-16440c90-f993-4fa1-974a-572cea8f8ffd tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:10:58.294952 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-16440c90-f993-4fa1-974a-572cea8f8ffd tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: 59ecfba7-b76a-4b71-9821-bd330a20922f] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:10:58.304770 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-16440c90-f993-4fa1-974a-572cea8f8ffd tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:10:58.305440 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-16440c90-f993-4fa1-974a-572cea8f8ffd tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:10:58.306339 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-16440c90-f993-4fa1-974a-572cea8f8ffd tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:10:58.307245 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-16440c90-f993-4fa1-974a-572cea8f8ffd tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:10:58.307806 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-16440c90-f993-4fa1-974a-572cea8f8ffd tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:10:58.308308 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-16440c90-f993-4fa1-974a-572cea8f8ffd tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:10:58.606529 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-16440c90-f993-4fa1-974a-572cea8f8ffd tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6160c7a42740efbe3613380933fa15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d90f8a58ad047fa8f347d6474e4d673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:10:58.620004 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-16440c90-f993-4fa1-974a-572cea8f8ffd tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "GET /compute/v2.1/servers/59ecfba7-b76a-4b71-9821-bd330a20922f" status: 200 len: 1315 microversion: 2.1 time: 0.330109 Aug 10 23:10:58.621145 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1646/3185] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:10:58 2022] GET /compute/v2.1/servers/59ecfba7-b76a-4b71-9821-bd330a20922f => generated 1315 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:10:58.634143 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-9dbd7b53-b851-4f85-8385-afd161cb2b6e tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:10:58.635093 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-9dbd7b53-b851-4f85-8385-afd161cb2b6e tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] [instance: 23c5c205-bafa-414f-8c1c-d3b78eb82538] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:10:58.649150 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9dbd7b53-b851-4f85-8385-afd161cb2b6e tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:10:58.649490 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9dbd7b53-b851-4f85-8385-afd161cb2b6e tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:10:58.651421 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9dbd7b53-b851-4f85-8385-afd161cb2b6e tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:10:58.652725 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9dbd7b53-b851-4f85-8385-afd161cb2b6e tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:10:58.653197 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9dbd7b53-b851-4f85-8385-afd161cb2b6e tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:10:58.656781 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9dbd7b53-b851-4f85-8385-afd161cb2b6e tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:10:58.816843 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-9dbd7b53-b851-4f85-8385-afd161cb2b6e tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc806dca6c64050b7f0e33fdb9c109c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acff29ee63244cf901723175cbee173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:10:58.832004 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-9dbd7b53-b851-4f85-8385-afd161cb2b6e tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] 10.222.0.58 "GET /compute/v2.1/servers/23c5c205-bafa-414f-8c1c-d3b78eb82538" status: 200 len: 1283 microversion: 2.1 time: 0.208709 Aug 10 23:10:58.832618 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1647/3186] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:10:58 2022] GET /compute/v2.1/servers/23c5c205-bafa-414f-8c1c-d3b78eb82538 => generated 1283 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:10:58.944428 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-125d904d-9f69-49f7-9e89-23aef4d725b2 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:10:58.957273 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-125d904d-9f69-49f7-9e89-23aef4d725b2 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954" status: 200 len: 1362 microversion: 2.1 time: 1.007277 Aug 10 23:10:58.958851 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1540/3187] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:10:57 2022] GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954 => generated 1362 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:10:59.552754 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-25f932d7-79a5-483b-b37a-cca856fd8269 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:10:59.559351 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-25f932d7-79a5-483b-b37a-cca856fd8269 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] [instance: 23452b78-96cd-430d-b95c-aaa98a427d53] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:10:59.577597 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-25f932d7-79a5-483b-b37a-cca856fd8269 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:10:59.580606 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-25f932d7-79a5-483b-b37a-cca856fd8269 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:10:59.581948 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-25f932d7-79a5-483b-b37a-cca856fd8269 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:10:59.584236 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-25f932d7-79a5-483b-b37a-cca856fd8269 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:10:59.584962 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-25f932d7-79a5-483b-b37a-cca856fd8269 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:10:59.586200 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-25f932d7-79a5-483b-b37a-cca856fd8269 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:10:59.643851 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-e500b9d4-8468-4376-ba90-477f6e556214 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:10:59.645278 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-e500b9d4-8468-4376-ba90-477f6e556214 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: 59ecfba7-b76a-4b71-9821-bd330a20922f] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:10:59.683283 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e500b9d4-8468-4376-ba90-477f6e556214 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:10:59.684424 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e500b9d4-8468-4376-ba90-477f6e556214 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:10:59.685111 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e500b9d4-8468-4376-ba90-477f6e556214 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:10:59.686074 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e500b9d4-8468-4376-ba90-477f6e556214 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:10:59.686745 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e500b9d4-8468-4376-ba90-477f6e556214 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:10:59.688105 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e500b9d4-8468-4376-ba90-477f6e556214 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:10:59.709118 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-25f932d7-79a5-483b-b37a-cca856fd8269 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] 10.222.0.58 "GET /compute/v2.1/servers/23452b78-96cd-430d-b95c-aaa98a427d53/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.174707 Aug 10 23:10:59.718623 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1648/3188] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 10 23:10:59 2022] GET /compute/v2.1/servers/23452b78-96cd-430d-b95c-aaa98a427d53/os-volume_attachments => generated 25 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 23:10:59.870189 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-15e59846-4df1-4f53-857f-2257da80cbab tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:10:59.871876 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-15e59846-4df1-4f53-857f-2257da80cbab tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] [instance: 23c5c205-bafa-414f-8c1c-d3b78eb82538] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:10:59.899571 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-15e59846-4df1-4f53-857f-2257da80cbab tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:10:59.903294 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-15e59846-4df1-4f53-857f-2257da80cbab tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:10:59.904048 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-15e59846-4df1-4f53-857f-2257da80cbab tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:10:59.906084 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-15e59846-4df1-4f53-857f-2257da80cbab tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:10:59.910046 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-15e59846-4df1-4f53-857f-2257da80cbab tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:10:59.911524 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-15e59846-4df1-4f53-857f-2257da80cbab tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:00.014377 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-e500b9d4-8468-4376-ba90-477f6e556214 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6160c7a42740efbe3613380933fa15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d90f8a58ad047fa8f347d6474e4d673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:11:00.031459 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-e500b9d4-8468-4376-ba90-477f6e556214 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "GET /compute/v2.1/servers/59ecfba7-b76a-4b71-9821-bd330a20922f" status: 200 len: 1315 microversion: 2.1 time: 0.393629 Aug 10 23:11:00.033259 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1541/3189] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:10:59 2022] GET /compute/v2.1/servers/59ecfba7-b76a-4b71-9821-bd330a20922f => generated 1315 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:11:00.040440 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-ae3b52af-689c-4045-a569-d15b05ce2216 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:11:00.042907 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-ae3b52af-689c-4045-a569-d15b05ce2216 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: fa9dfd3a-a636-48ce-ae15-0ed51baee954] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:11:00.058797 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ae3b52af-689c-4045-a569-d15b05ce2216 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:00.059723 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ae3b52af-689c-4045-a569-d15b05ce2216 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:00.060407 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ae3b52af-689c-4045-a569-d15b05ce2216 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:00.061416 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ae3b52af-689c-4045-a569-d15b05ce2216 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:00.063108 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ae3b52af-689c-4045-a569-d15b05ce2216 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:00.063823 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ae3b52af-689c-4045-a569-d15b05ce2216 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:00.471804 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-ae3b52af-689c-4045-a569-d15b05ce2216 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:11:00.491891 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-ae3b52af-689c-4045-a569-d15b05ce2216 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954" status: 200 len: 1362 microversion: 2.1 time: 0.457215 Aug 10 23:11:00.506231 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1542/3190] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:11:00 2022] GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954 => generated 1362 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:11:00.511516 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-bf335e54-1d3c-4a89-af67-5eff3747eb70 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:11:00.513751 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-bf335e54-1d3c-4a89-af67-5eff3747eb70 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] [instance: 23452b78-96cd-430d-b95c-aaa98a427d53] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:11:00.530826 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bf335e54-1d3c-4a89-af67-5eff3747eb70 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:00.531361 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bf335e54-1d3c-4a89-af67-5eff3747eb70 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:00.531848 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bf335e54-1d3c-4a89-af67-5eff3747eb70 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:00.532708 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bf335e54-1d3c-4a89-af67-5eff3747eb70 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:00.533321 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bf335e54-1d3c-4a89-af67-5eff3747eb70 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:00.533862 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bf335e54-1d3c-4a89-af67-5eff3747eb70 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:00.595854 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-bf335e54-1d3c-4a89-af67-5eff3747eb70 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] 10.222.0.58 "GET /compute/v2.1/servers/23452b78-96cd-430d-b95c-aaa98a427d53/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.087884 Aug 10 23:11:00.598276 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1543/3191] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 10 23:11:00 2022] GET /compute/v2.1/servers/23452b78-96cd-430d-b95c-aaa98a427d53/os-volume_attachments => generated 25 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 23:11:00.686209 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-f19b058a-0a17-48f1-9eef-e328cfd99fe6 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:11:00.686981 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-f19b058a-0a17-48f1-9eef-e328cfd99fe6 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] [instance: 23452b78-96cd-430d-b95c-aaa98a427d53] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:11:00.696462 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f19b058a-0a17-48f1-9eef-e328cfd99fe6 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:00.697214 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f19b058a-0a17-48f1-9eef-e328cfd99fe6 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:00.697819 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f19b058a-0a17-48f1-9eef-e328cfd99fe6 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:00.698748 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f19b058a-0a17-48f1-9eef-e328cfd99fe6 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:00.699464 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f19b058a-0a17-48f1-9eef-e328cfd99fe6 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:00.700260 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f19b058a-0a17-48f1-9eef-e328cfd99fe6 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:00.739084 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-f19b058a-0a17-48f1-9eef-e328cfd99fe6 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] [instance: 23452b78-96cd-430d-b95c-aaa98a427d53] Going to try to terminate instance {{(pid=122632) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:11:00.875597 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-f19b058a-0a17-48f1-9eef-e328cfd99fe6 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] 10.222.0.58 "DELETE /compute/v2.1/servers/23452b78-96cd-430d-b95c-aaa98a427d53" status: 204 len: 0 microversion: 2.1 time: 0.191948 Aug 10 23:11:00.876870 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1544/3192] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:11:00 2022] DELETE /compute/v2.1/servers/23452b78-96cd-430d-b95c-aaa98a427d53 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 10 23:11:00.886611 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-0fc955ff-9e65-46e2-a945-4ec1505c6528 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:11:00.887697 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-0fc955ff-9e65-46e2-a945-4ec1505c6528 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] [instance: 23452b78-96cd-430d-b95c-aaa98a427d53] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:11:00.895153 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0fc955ff-9e65-46e2-a945-4ec1505c6528 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:00.896113 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0fc955ff-9e65-46e2-a945-4ec1505c6528 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:00.896826 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0fc955ff-9e65-46e2-a945-4ec1505c6528 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:00.897790 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0fc955ff-9e65-46e2-a945-4ec1505c6528 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:00.898471 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0fc955ff-9e65-46e2-a945-4ec1505c6528 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:00.899165 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0fc955ff-9e65-46e2-a945-4ec1505c6528 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:00.902599 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:11:01.051473 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-15e59846-4df1-4f53-857f-2257da80cbab tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc806dca6c64050b7f0e33fdb9c109c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acff29ee63244cf901723175cbee173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:11:01.073431 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-15e59846-4df1-4f53-857f-2257da80cbab tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] 10.222.0.58 "GET /compute/v2.1/servers/23c5c205-bafa-414f-8c1c-d3b78eb82538" status: 200 len: 1351 microversion: 2.1 time: 1.214898 Aug 10 23:11:01.074997 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1649/3193] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:10:59 2022] GET /compute/v2.1/servers/23c5c205-bafa-414f-8c1c-d3b78eb82538 => generated 1351 bytes in 1219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:11:01.084640 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-8814c3ad-b884-4798-aff6-526e4c8b6efb tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:11:01.085575 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-8814c3ad-b884-4798-aff6-526e4c8b6efb tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: 59ecfba7-b76a-4b71-9821-bd330a20922f] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:11:01.127028 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8814c3ad-b884-4798-aff6-526e4c8b6efb tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:01.140916 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8814c3ad-b884-4798-aff6-526e4c8b6efb tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:01.143699 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8814c3ad-b884-4798-aff6-526e4c8b6efb tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:01.146218 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8814c3ad-b884-4798-aff6-526e4c8b6efb tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:01.148733 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8814c3ad-b884-4798-aff6-526e4c8b6efb tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:01.151258 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8814c3ad-b884-4798-aff6-526e4c8b6efb tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:01.686968 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-8814c3ad-b884-4798-aff6-526e4c8b6efb tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6160c7a42740efbe3613380933fa15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d90f8a58ad047fa8f347d6474e4d673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:11:01.706452 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-8814c3ad-b884-4798-aff6-526e4c8b6efb tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "GET /compute/v2.1/servers/59ecfba7-b76a-4b71-9821-bd330a20922f" status: 200 len: 1315 microversion: 2.1 time: 0.619565 Aug 10 23:11:01.707685 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1650/3194] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:11:01 2022] GET /compute/v2.1/servers/59ecfba7-b76a-4b71-9821-bd330a20922f => generated 1315 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:11:01.713164 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-be10ad6e-687c-4ea2-860d-c3f0952f037d tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:11:01.713799 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-be10ad6e-687c-4ea2-860d-c3f0952f037d tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: fa9dfd3a-a636-48ce-ae15-0ed51baee954] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:11:01.726539 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-0fc955ff-9e65-46e2-a945-4ec1505c6528 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1986185dc9b4df4affcc421365462f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597863bfebdc481188f1f30095da5396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:11:01.730806 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-be10ad6e-687c-4ea2-860d-c3f0952f037d tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:01.731340 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-be10ad6e-687c-4ea2-860d-c3f0952f037d tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:01.731787 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-be10ad6e-687c-4ea2-860d-c3f0952f037d tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:01.732509 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-be10ad6e-687c-4ea2-860d-c3f0952f037d tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:01.732973 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-be10ad6e-687c-4ea2-860d-c3f0952f037d tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:01.733406 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-be10ad6e-687c-4ea2-860d-c3f0952f037d tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:01.741898 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-0fc955ff-9e65-46e2-a945-4ec1505c6528 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] 10.222.0.58 "GET /compute/v2.1/servers/23452b78-96cd-430d-b95c-aaa98a427d53" status: 200 len: 1673 microversion: 2.1 time: 0.860169 Aug 10 23:11:01.761111 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1545/3195] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:11:00 2022] GET /compute/v2.1/servers/23452b78-96cd-430d-b95c-aaa98a427d53 => generated 1673 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:11:02.097365 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-35c86acc-5282-41e3-b959-739ad226bdd5 tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:11:02.097820 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-35c86acc-5282-41e3-b959-739ad226bdd5 tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] [instance: 23c5c205-bafa-414f-8c1c-d3b78eb82538] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:11:02.115092 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-35c86acc-5282-41e3-b959-739ad226bdd5 tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:02.116317 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-35c86acc-5282-41e3-b959-739ad226bdd5 tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:02.117932 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-35c86acc-5282-41e3-b959-739ad226bdd5 tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:02.119398 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-35c86acc-5282-41e3-b959-739ad226bdd5 tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:02.121017 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-be10ad6e-687c-4ea2-860d-c3f0952f037d tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:11:02.121964 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-35c86acc-5282-41e3-b959-739ad226bdd5 tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:02.122576 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-35c86acc-5282-41e3-b959-739ad226bdd5 tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:02.135368 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-be10ad6e-687c-4ea2-860d-c3f0952f037d tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954" status: 200 len: 1362 microversion: 2.1 time: 0.426521 Aug 10 23:11:02.135992 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1651/3196] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:11:01 2022] GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954 => generated 1362 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:11:02.339301 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-51c6870d-dbd0-485a-83ab-d9005b1f7b20 req-daf26854-d1a1-460d-9463-bd3649ccfc49 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23c5c205-bafa-414f-8c1c-d3b78eb82538", "tag": "ae1586eb-94d4-44e8-8de7-48abc323a0b2"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:11:02.355196 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-51c6870d-dbd0-485a-83ab-d9005b1f7b20 req-daf26854-d1a1-460d-9463-bd3649ccfc49 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:02.355704 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-51c6870d-dbd0-485a-83ab-d9005b1f7b20 req-daf26854-d1a1-460d-9463-bd3649ccfc49 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:02.356134 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-51c6870d-dbd0-485a-83ab-d9005b1f7b20 req-daf26854-d1a1-460d-9463-bd3649ccfc49 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:02.399460 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-51c6870d-dbd0-485a-83ab-d9005b1f7b20 req-daf26854-d1a1-460d-9463-bd3649ccfc49 service nova] Creating event network-changed:ae1586eb-94d4-44e8-8de7-48abc323a0b2 for instance 23c5c205-bafa-414f-8c1c-d3b78eb82538 on n-h1-850468-14 Aug 10 23:11:02.412835 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-51c6870d-dbd0-485a-83ab-d9005b1f7b20 req-daf26854-d1a1-460d-9463-bd3649ccfc49 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078167 Aug 10 23:11:02.413455 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1652/3197] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:11:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 23:11:02.599555 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-35c86acc-5282-41e3-b959-739ad226bdd5 tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc806dca6c64050b7f0e33fdb9c109c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acff29ee63244cf901723175cbee173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:11:02.602409 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-35c86acc-5282-41e3-b959-739ad226bdd5 tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] 10.222.0.58 "GET /compute/v2.1/servers/23c5c205-bafa-414f-8c1c-d3b78eb82538" status: 200 len: 1351 microversion: 2.1 time: 0.509568 Aug 10 23:11:02.615048 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1546/3198] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:11:02 2022] GET /compute/v2.1/servers/23c5c205-bafa-414f-8c1c-d3b78eb82538 => generated 1351 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:11:02.731212 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-800896ec-2e3a-4c9f-967a-2919a7cda16f tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:11:02.731950 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-800896ec-2e3a-4c9f-967a-2919a7cda16f tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: 59ecfba7-b76a-4b71-9821-bd330a20922f] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:11:02.756011 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-800896ec-2e3a-4c9f-967a-2919a7cda16f tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:02.756543 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-800896ec-2e3a-4c9f-967a-2919a7cda16f tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:02.760819 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-800896ec-2e3a-4c9f-967a-2919a7cda16f tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:02.762420 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-800896ec-2e3a-4c9f-967a-2919a7cda16f tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:02.764364 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-800896ec-2e3a-4c9f-967a-2919a7cda16f tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:02.764873 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-800896ec-2e3a-4c9f-967a-2919a7cda16f tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:02.772980 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-648bae42-f77e-426d-8fec-b52fc63c5912 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:11:02.773589 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-648bae42-f77e-426d-8fec-b52fc63c5912 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] [instance: 23452b78-96cd-430d-b95c-aaa98a427d53] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:11:02.785285 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-648bae42-f77e-426d-8fec-b52fc63c5912 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:02.790051 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-648bae42-f77e-426d-8fec-b52fc63c5912 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:02.790763 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-648bae42-f77e-426d-8fec-b52fc63c5912 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:02.791953 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-648bae42-f77e-426d-8fec-b52fc63c5912 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:02.792888 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-648bae42-f77e-426d-8fec-b52fc63c5912 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:02.793757 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-648bae42-f77e-426d-8fec-b52fc63c5912 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:02.853292 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=4 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:11:03.481407 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=46 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:11:03.506282 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-648bae42-f77e-426d-8fec-b52fc63c5912 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1986185dc9b4df4affcc421365462f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597863bfebdc481188f1f30095da5396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:11:03.530853 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-648bae42-f77e-426d-8fec-b52fc63c5912 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] 10.222.0.58 "GET /compute/v2.1/servers/23452b78-96cd-430d-b95c-aaa98a427d53" status: 200 len: 1673 microversion: 2.1 time: 0.760628 Aug 10 23:11:03.538615 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1547/3199] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:11:02 2022] GET /compute/v2.1/servers/23452b78-96cd-430d-b95c-aaa98a427d53 => generated 1673 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:11:03.544445 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-fad3a443-12a2-442c-82f1-f602142a68c8 req-77c387cc-6ffb-4ce9-b2ee-f11fe7da251c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa9dfd3a-a636-48ce-ae15-0ed51baee954", "name": "network-vif-plugged", "status": "completed", "tag": "456f7ca7-21c6-4b5d-8993-9a7c329acf12"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:11:03.564672 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-fad3a443-12a2-442c-82f1-f602142a68c8 req-77c387cc-6ffb-4ce9-b2ee-f11fe7da251c service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:03.566714 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-fad3a443-12a2-442c-82f1-f602142a68c8 req-77c387cc-6ffb-4ce9-b2ee-f11fe7da251c service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:03.567474 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-fad3a443-12a2-442c-82f1-f602142a68c8 req-77c387cc-6ffb-4ce9-b2ee-f11fe7da251c service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:03.580374 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-fad3a443-12a2-442c-82f1-f602142a68c8 req-77c387cc-6ffb-4ce9-b2ee-f11fe7da251c service nova] Creating event network-vif-plugged:456f7ca7-21c6-4b5d-8993-9a7c329acf12 for instance fa9dfd3a-a636-48ce-ae15-0ed51baee954 on n-h2-850468-14 Aug 10 23:11:03.586902 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-fad3a443-12a2-442c-82f1-f602142a68c8 req-77c387cc-6ffb-4ce9-b2ee-f11fe7da251c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046711 Aug 10 23:11:03.587844 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1548/3200] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:11:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:11:03.593469 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-3be0ee1b-5003-4c4f-b073-8a2411688655 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:11:03.594509 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-3be0ee1b-5003-4c4f-b073-8a2411688655 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: fa9dfd3a-a636-48ce-ae15-0ed51baee954] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:11:03.602655 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3be0ee1b-5003-4c4f-b073-8a2411688655 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:03.604688 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3be0ee1b-5003-4c4f-b073-8a2411688655 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:03.605894 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3be0ee1b-5003-4c4f-b073-8a2411688655 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:03.607321 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3be0ee1b-5003-4c4f-b073-8a2411688655 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:03.608045 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3be0ee1b-5003-4c4f-b073-8a2411688655 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:03.608719 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3be0ee1b-5003-4c4f-b073-8a2411688655 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:04.058151 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-800896ec-2e3a-4c9f-967a-2919a7cda16f tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6160c7a42740efbe3613380933fa15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d90f8a58ad047fa8f347d6474e4d673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:11:04.061765 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=100 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:11:04.082738 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-800896ec-2e3a-4c9f-967a-2919a7cda16f tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "GET /compute/v2.1/servers/59ecfba7-b76a-4b71-9821-bd330a20922f" status: 200 len: 1315 microversion: 2.1 time: 1.356490 Aug 10 23:11:04.090683 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1653/3201] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:11:02 2022] GET /compute/v2.1/servers/59ecfba7-b76a-4b71-9821-bd330a20922f => generated 1315 bytes in 1365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:11:04.105027 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-a0da9fc3-a79d-40c1-8234-4882c91a81ad tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:11:04.108372 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-a0da9fc3-a79d-40c1-8234-4882c91a81ad tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] [instance: 23c5c205-bafa-414f-8c1c-d3b78eb82538] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:11:04.125525 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a0da9fc3-a79d-40c1-8234-4882c91a81ad tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:04.126993 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a0da9fc3-a79d-40c1-8234-4882c91a81ad tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:04.128247 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a0da9fc3-a79d-40c1-8234-4882c91a81ad tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:04.129230 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a0da9fc3-a79d-40c1-8234-4882c91a81ad tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:04.130035 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a0da9fc3-a79d-40c1-8234-4882c91a81ad tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:04.130682 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a0da9fc3-a79d-40c1-8234-4882c91a81ad tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:04.271747 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-3be0ee1b-5003-4c4f-b073-8a2411688655 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:11:04.289096 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-3be0ee1b-5003-4c4f-b073-8a2411688655 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954" status: 200 len: 1362 microversion: 2.1 time: 0.699326 Aug 10 23:11:04.291888 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1549/3202] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:11:03 2022] GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954 => generated 1362 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:11:04.459944 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-a0da9fc3-a79d-40c1-8234-4882c91a81ad tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc806dca6c64050b7f0e33fdb9c109c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acff29ee63244cf901723175cbee173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:11:04.468645 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-a0da9fc3-a79d-40c1-8234-4882c91a81ad tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] 10.222.0.58 "GET /compute/v2.1/servers/23c5c205-bafa-414f-8c1c-d3b78eb82538" status: 200 len: 1351 microversion: 2.1 time: 0.376755 Aug 10 23:11:04.469482 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1654/3203] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:11:04 2022] GET /compute/v2.1/servers/23c5c205-bafa-414f-8c1c-d3b78eb82538 => generated 1351 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:11:04.565870 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-5b881c35-685d-4636-9ab8-4158643ef806 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:11:04.566602 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-5b881c35-685d-4636-9ab8-4158643ef806 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] [instance: 23452b78-96cd-430d-b95c-aaa98a427d53] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:11:04.575973 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5b881c35-685d-4636-9ab8-4158643ef806 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:04.581392 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5b881c35-685d-4636-9ab8-4158643ef806 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:04.582232 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5b881c35-685d-4636-9ab8-4158643ef806 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:04.584813 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5b881c35-685d-4636-9ab8-4158643ef806 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:04.585827 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5b881c35-685d-4636-9ab8-4158643ef806 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:04.586490 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5b881c35-685d-4636-9ab8-4158643ef806 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:05.011705 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-5b881c35-685d-4636-9ab8-4158643ef806 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1986185dc9b4df4affcc421365462f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597863bfebdc481188f1f30095da5396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:11:05.023160 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-5b881c35-685d-4636-9ab8-4158643ef806 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] 10.222.0.58 "GET /compute/v2.1/servers/23452b78-96cd-430d-b95c-aaa98a427d53" status: 200 len: 1673 microversion: 2.1 time: 0.466808 Aug 10 23:11:05.027195 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1550/3204] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:11:04 2022] GET /compute/v2.1/servers/23452b78-96cd-430d-b95c-aaa98a427d53 => generated 1673 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:11:05.113636 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-b918863c-a0f1-4a7a-a8a0-01ddaa6666d0 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:11:05.114431 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-b918863c-a0f1-4a7a-a8a0-01ddaa6666d0 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: 59ecfba7-b76a-4b71-9821-bd330a20922f] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:11:05.129240 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b918863c-a0f1-4a7a-a8a0-01ddaa6666d0 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:05.131446 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b918863c-a0f1-4a7a-a8a0-01ddaa6666d0 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:05.132048 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b918863c-a0f1-4a7a-a8a0-01ddaa6666d0 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:05.133393 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b918863c-a0f1-4a7a-a8a0-01ddaa6666d0 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:05.135175 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b918863c-a0f1-4a7a-a8a0-01ddaa6666d0 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:05.136433 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b918863c-a0f1-4a7a-a8a0-01ddaa6666d0 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:05.320162 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-e4f7a5cd-4ced-40c8-87c2-91f5b82b77ce tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:11:05.322256 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-e4f7a5cd-4ced-40c8-87c2-91f5b82b77ce tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: fa9dfd3a-a636-48ce-ae15-0ed51baee954] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:11:05.346229 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e4f7a5cd-4ced-40c8-87c2-91f5b82b77ce tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:05.349729 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e4f7a5cd-4ced-40c8-87c2-91f5b82b77ce tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:05.352813 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e4f7a5cd-4ced-40c8-87c2-91f5b82b77ce tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:05.353934 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e4f7a5cd-4ced-40c8-87c2-91f5b82b77ce tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:05.356717 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e4f7a5cd-4ced-40c8-87c2-91f5b82b77ce tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:05.357722 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e4f7a5cd-4ced-40c8-87c2-91f5b82b77ce tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:05.649750 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-b918863c-a0f1-4a7a-a8a0-01ddaa6666d0 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6160c7a42740efbe3613380933fa15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d90f8a58ad047fa8f347d6474e4d673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:11:05.663313 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-b918863c-a0f1-4a7a-a8a0-01ddaa6666d0 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "GET /compute/v2.1/servers/59ecfba7-b76a-4b71-9821-bd330a20922f" status: 200 len: 1315 microversion: 2.1 time: 0.555317 Aug 10 23:11:05.671889 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1655/3205] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:11:05 2022] GET /compute/v2.1/servers/59ecfba7-b76a-4b71-9821-bd330a20922f => generated 1315 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:11:05.694244 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-86c89033-b521-4e05-a1d8-57785da0f1ce tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:11:05.697408 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-86c89033-b521-4e05-a1d8-57785da0f1ce tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] [instance: 23c5c205-bafa-414f-8c1c-d3b78eb82538] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:11:05.722411 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-86c89033-b521-4e05-a1d8-57785da0f1ce tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:05.733713 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-86c89033-b521-4e05-a1d8-57785da0f1ce tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:05.737915 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-86c89033-b521-4e05-a1d8-57785da0f1ce tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:05.739598 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-86c89033-b521-4e05-a1d8-57785da0f1ce tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:05.740393 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-86c89033-b521-4e05-a1d8-57785da0f1ce tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:05.741388 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-86c89033-b521-4e05-a1d8-57785da0f1ce tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:05.803341 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-e4f7a5cd-4ced-40c8-87c2-91f5b82b77ce tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:11:05.820030 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-e4f7a5cd-4ced-40c8-87c2-91f5b82b77ce tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954" status: 200 len: 1548 microversion: 2.1 time: 0.499744 Aug 10 23:11:05.823183 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1551/3206] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:11:05 2022] GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954 => generated 1548 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:11:06.208355 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-86c89033-b521-4e05-a1d8-57785da0f1ce tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc806dca6c64050b7f0e33fdb9c109c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acff29ee63244cf901723175cbee173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:11:06.228457 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-86c89033-b521-4e05-a1d8-57785da0f1ce tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] 10.222.0.58 "GET /compute/v2.1/servers/23c5c205-bafa-414f-8c1c-d3b78eb82538" status: 200 len: 1351 microversion: 2.1 time: 0.552791 Aug 10 23:11:06.235225 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1656/3207] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:11:05 2022] GET /compute/v2.1/servers/23c5c205-bafa-414f-8c1c-d3b78eb82538 => generated 1351 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:11:06.242526 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-3d7dc206-b051-4bfb-8183-4768748cb563 req-03f5dbef-d2a8-457a-b9d8-96e997f3cb96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59ecfba7-b76a-4b71-9821-bd330a20922f", "name": "network-vif-plugged", "status": "completed", "tag": "fc0713b3-97ad-48e6-b43b-97aa6ce32c32"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:11:06.284198 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-3d7dc206-b051-4bfb-8183-4768748cb563 req-03f5dbef-d2a8-457a-b9d8-96e997f3cb96 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:06.285981 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-3d7dc206-b051-4bfb-8183-4768748cb563 req-03f5dbef-d2a8-457a-b9d8-96e997f3cb96 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:06.289054 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-3d7dc206-b051-4bfb-8183-4768748cb563 req-03f5dbef-d2a8-457a-b9d8-96e997f3cb96 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:06.312016 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-3d7dc206-b051-4bfb-8183-4768748cb563 req-03f5dbef-d2a8-457a-b9d8-96e997f3cb96 service nova] Creating event network-vif-plugged:fc0713b3-97ad-48e6-b43b-97aa6ce32c32 for instance 59ecfba7-b76a-4b71-9821-bd330a20922f on n-h1-850468-14 Aug 10 23:11:06.328959 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-3d7dc206-b051-4bfb-8183-4768748cb563 req-03f5dbef-d2a8-457a-b9d8-96e997f3cb96 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091135 Aug 10 23:11:06.332208 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1657/3208] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:11:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:11:06.359857 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-9a826b6b-eed6-4090-ab82-be0dae1d6d6f tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:11:06.362198 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-9a826b6b-eed6-4090-ab82-be0dae1d6d6f tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: fa9dfd3a-a636-48ce-ae15-0ed51baee954] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:11:06.382093 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9a826b6b-eed6-4090-ab82-be0dae1d6d6f tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:06.386821 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9a826b6b-eed6-4090-ab82-be0dae1d6d6f tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:06.390326 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9a826b6b-eed6-4090-ab82-be0dae1d6d6f tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:06.393535 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9a826b6b-eed6-4090-ab82-be0dae1d6d6f tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:06.406540 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9a826b6b-eed6-4090-ab82-be0dae1d6d6f tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:06.407860 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9a826b6b-eed6-4090-ab82-be0dae1d6d6f tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:06.420445 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-8352289b-34e1-4a35-b3cb-83c95ce2cda0 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Action: 'create', calling method: .version_select at 0x7f847c7a6790>, body: {"keypair": {"name": "tempest-keypair-921357370", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHACaoB7SeP0c/ciiVCKtJDgAQVqrowwXfphPHqEZU8kzc32KUB2DbB3AXP0qnV5t4mgzhKf2erlEO9qxo3zdCmFBfhbqWW1hFPFIkHZhVgRM5HqxLTlClwrjonEoFSw1Q=="}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:11:06.535855 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-8352289b-34e1-4a35-b3cb-83c95ce2cda0 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Getting quotas for project 0d39cab5115d4818b73ea24cb0987a3b. Resources: {'key_pairs'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:11:06.572371 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-8352289b-34e1-4a35-b3cb-83c95ce2cda0 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Getting quotas for user d879a42349cf4570aaaf88ba90492f6c and project 0d39cab5115d4818b73ea24cb0987a3b. Resources: {'key_pairs'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:11:06.586133 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-9a826b6b-eed6-4090-ab82-be0dae1d6d6f tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.252340 Aug 10 23:11:06.596039 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1658/3209] 10.222.0.58 () {58 vars in 1275 bytes} [Wed Aug 10 23:11:06 2022] GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954/os-interface => generated 284 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:11:06.601698 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-2fcd8c9a-8eb3-461c-b8b8-e159296de66e tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:11:06.602758 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-2fcd8c9a-8eb3-461c-b8b8-e159296de66e tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] [instance: 23452b78-96cd-430d-b95c-aaa98a427d53] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:11:06.629871 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2fcd8c9a-8eb3-461c-b8b8-e159296de66e tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:06.631708 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2fcd8c9a-8eb3-461c-b8b8-e159296de66e tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:06.633416 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2fcd8c9a-8eb3-461c-b8b8-e159296de66e tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:06.634140 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-8352289b-34e1-4a35-b3cb-83c95ce2cda0 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.795176 Aug 10 23:11:06.634840 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1552/3210] 10.222.0.58 () {60 vars in 1159 bytes} [Wed Aug 10 23:11:05 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:11:06.636452 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2fcd8c9a-8eb3-461c-b8b8-e159296de66e tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:06.639669 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2fcd8c9a-8eb3-461c-b8b8-e159296de66e tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:06.640545 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2fcd8c9a-8eb3-461c-b8b8-e159296de66e tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:06.691242 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-4413e451-b558-4534-a747-73cab59f65f9 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:11:06.692055 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-4413e451-b558-4534-a747-73cab59f65f9 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: 59ecfba7-b76a-4b71-9821-bd330a20922f] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:11:06.708776 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4413e451-b558-4534-a747-73cab59f65f9 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:06.712672 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4413e451-b558-4534-a747-73cab59f65f9 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:06.713982 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4413e451-b558-4534-a747-73cab59f65f9 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:06.717290 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4413e451-b558-4534-a747-73cab59f65f9 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:06.720769 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4413e451-b558-4534-a747-73cab59f65f9 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:06.722735 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4413e451-b558-4534-a747-73cab59f65f9 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:07.498985 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-4413e451-b558-4534-a747-73cab59f65f9 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6160c7a42740efbe3613380933fa15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d90f8a58ad047fa8f347d6474e4d673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:11:07.509836 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-4413e451-b558-4534-a747-73cab59f65f9 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "GET /compute/v2.1/servers/59ecfba7-b76a-4b71-9821-bd330a20922f" status: 200 len: 1315 microversion: 2.1 time: 0.823359 Aug 10 23:11:07.511193 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1553/3211] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:11:06 2022] GET /compute/v2.1/servers/59ecfba7-b76a-4b71-9821-bd330a20922f => generated 1315 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:11:07.516209 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-bc4c96a4-8033-4868-b1b6-ce4d2f83638f req-7b6c6083-ae03-46c7-be6f-1751b9f1f205 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23452b78-96cd-430d-b95c-aaa98a427d53", "name": "network-vif-deleted", "tag": "a958a4d3-19d0-46d8-bea8-676cb2161b89"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:11:07.542950 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-bc4c96a4-8033-4868-b1b6-ce4d2f83638f req-7b6c6083-ae03-46c7-be6f-1751b9f1f205 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:07.545591 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-bc4c96a4-8033-4868-b1b6-ce4d2f83638f req-7b6c6083-ae03-46c7-be6f-1751b9f1f205 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:07.547590 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-bc4c96a4-8033-4868-b1b6-ce4d2f83638f req-7b6c6083-ae03-46c7-be6f-1751b9f1f205 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:07.578472 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-bc4c96a4-8033-4868-b1b6-ce4d2f83638f req-7b6c6083-ae03-46c7-be6f-1751b9f1f205 service nova] Creating event network-vif-deleted:a958a4d3-19d0-46d8-bea8-676cb2161b89 for instance 23452b78-96cd-430d-b95c-aaa98a427d53 on n-h2-850468-14 Aug 10 23:11:07.600220 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-bc4c96a4-8033-4868-b1b6-ce4d2f83638f req-7b6c6083-ae03-46c7-be6f-1751b9f1f205 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087407 Aug 10 23:11:07.609387 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1554/3212] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:11:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:11:07.625942 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-f25fa1d7-e799-44e1-9271-3563d9212aa2 tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:11:07.630210 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-f25fa1d7-e799-44e1-9271-3563d9212aa2 tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] [instance: 23c5c205-bafa-414f-8c1c-d3b78eb82538] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:11:07.655549 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f25fa1d7-e799-44e1-9271-3563d9212aa2 tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:07.660129 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f25fa1d7-e799-44e1-9271-3563d9212aa2 tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:07.661349 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f25fa1d7-e799-44e1-9271-3563d9212aa2 tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:07.663191 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f25fa1d7-e799-44e1-9271-3563d9212aa2 tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:07.664101 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f25fa1d7-e799-44e1-9271-3563d9212aa2 tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:07.666150 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f25fa1d7-e799-44e1-9271-3563d9212aa2 tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:08.330826 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-f25fa1d7-e799-44e1-9271-3563d9212aa2 tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc806dca6c64050b7f0e33fdb9c109c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acff29ee63244cf901723175cbee173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:11:08.342658 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-f25fa1d7-e799-44e1-9271-3563d9212aa2 tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] 10.222.0.58 "GET /compute/v2.1/servers/23c5c205-bafa-414f-8c1c-d3b78eb82538" status: 200 len: 1351 microversion: 2.1 time: 0.731798 Aug 10 23:11:08.343620 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1555/3213] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:11:07 2022] GET /compute/v2.1/servers/23c5c205-bafa-414f-8c1c-d3b78eb82538 => generated 1351 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:11:08.427981 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-2fcd8c9a-8eb3-461c-b8b8-e159296de66e tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1986185dc9b4df4affcc421365462f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '597863bfebdc481188f1f30095da5396', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:11:08.436422 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-2fcd8c9a-8eb3-461c-b8b8-e159296de66e tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] 10.222.0.58 "GET /compute/v2.1/servers/23452b78-96cd-430d-b95c-aaa98a427d53" status: 200 len: 1606 microversion: 2.1 time: 1.838683 Aug 10 23:11:08.451356 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1659/3214] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:11:06 2022] GET /compute/v2.1/servers/23452b78-96cd-430d-b95c-aaa98a427d53 => generated 1606 bytes in 1854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:11:08.536239 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-40ad7a54-02ad-47f1-80da-886ddfa4bcdb tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:11:08.537620 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-40ad7a54-02ad-47f1-80da-886ddfa4bcdb tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: 59ecfba7-b76a-4b71-9821-bd330a20922f] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:11:08.554940 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-40ad7a54-02ad-47f1-80da-886ddfa4bcdb tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:08.558079 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-40ad7a54-02ad-47f1-80da-886ddfa4bcdb tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:08.560520 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-40ad7a54-02ad-47f1-80da-886ddfa4bcdb tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:08.561530 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-40ad7a54-02ad-47f1-80da-886ddfa4bcdb tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:08.568144 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-40ad7a54-02ad-47f1-80da-886ddfa4bcdb tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:08.569539 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-40ad7a54-02ad-47f1-80da-886ddfa4bcdb tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:08.962552 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-40ad7a54-02ad-47f1-80da-886ddfa4bcdb tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6160c7a42740efbe3613380933fa15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d90f8a58ad047fa8f347d6474e4d673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:11:08.977080 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-40ad7a54-02ad-47f1-80da-886ddfa4bcdb tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "GET /compute/v2.1/servers/59ecfba7-b76a-4b71-9821-bd330a20922f" status: 200 len: 1501 microversion: 2.1 time: 0.446650 Aug 10 23:11:08.980109 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1556/3215] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:11:08 2022] GET /compute/v2.1/servers/59ecfba7-b76a-4b71-9821-bd330a20922f => generated 1501 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:11:09.012866 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-02ab00df-fe8a-4ac6-9d72-f8cc06b30518 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:11:09.015096 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-02ab00df-fe8a-4ac6-9d72-f8cc06b30518 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: 59ecfba7-b76a-4b71-9821-bd330a20922f] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:11:09.035704 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-02ab00df-fe8a-4ac6-9d72-f8cc06b30518 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:09.036927 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-02ab00df-fe8a-4ac6-9d72-f8cc06b30518 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:09.037807 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-02ab00df-fe8a-4ac6-9d72-f8cc06b30518 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:09.040224 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-02ab00df-fe8a-4ac6-9d72-f8cc06b30518 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:09.044340 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-02ab00df-fe8a-4ac6-9d72-f8cc06b30518 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:09.045188 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-02ab00df-fe8a-4ac6-9d72-f8cc06b30518 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:09.135646 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-02ab00df-fe8a-4ac6-9d72-f8cc06b30518 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: 59ecfba7-b76a-4b71-9821-bd330a20922f] Going to try to terminate instance {{(pid=122633) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:11:09.287579 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-02ab00df-fe8a-4ac6-9d72-f8cc06b30518 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "DELETE /compute/v2.1/servers/59ecfba7-b76a-4b71-9821-bd330a20922f" status: 204 len: 0 microversion: 2.1 time: 0.288991 Aug 10 23:11:09.289188 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1660/3216] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:11:08 2022] DELETE /compute/v2.1/servers/59ecfba7-b76a-4b71-9821-bd330a20922f => generated 0 bytes in 292 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:11:09.298405 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-972c5892-6bfa-45cd-a4b7-8ec71a4a1526 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:11:09.299118 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-972c5892-6bfa-45cd-a4b7-8ec71a4a1526 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: 59ecfba7-b76a-4b71-9821-bd330a20922f] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:11:09.308689 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-972c5892-6bfa-45cd-a4b7-8ec71a4a1526 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:09.309214 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-972c5892-6bfa-45cd-a4b7-8ec71a4a1526 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:09.309693 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-972c5892-6bfa-45cd-a4b7-8ec71a4a1526 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:09.310487 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-972c5892-6bfa-45cd-a4b7-8ec71a4a1526 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:09.311031 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-972c5892-6bfa-45cd-a4b7-8ec71a4a1526 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:09.311492 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-972c5892-6bfa-45cd-a4b7-8ec71a4a1526 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:09.368830 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-3417a5ec-0943-414a-b28e-b77f86f4cc86 tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:11:09.370674 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-3417a5ec-0943-414a-b28e-b77f86f4cc86 tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] [instance: 23c5c205-bafa-414f-8c1c-d3b78eb82538] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:11:09.383693 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3417a5ec-0943-414a-b28e-b77f86f4cc86 tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:09.386760 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3417a5ec-0943-414a-b28e-b77f86f4cc86 tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:09.387678 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3417a5ec-0943-414a-b28e-b77f86f4cc86 tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:09.389270 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3417a5ec-0943-414a-b28e-b77f86f4cc86 tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:09.395148 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3417a5ec-0943-414a-b28e-b77f86f4cc86 tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:09.395629 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3417a5ec-0943-414a-b28e-b77f86f4cc86 tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:09.757831 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-972c5892-6bfa-45cd-a4b7-8ec71a4a1526 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6160c7a42740efbe3613380933fa15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d90f8a58ad047fa8f347d6474e4d673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:11:09.771601 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-972c5892-6bfa-45cd-a4b7-8ec71a4a1526 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "GET /compute/v2.1/servers/59ecfba7-b76a-4b71-9821-bd330a20922f" status: 200 len: 1507 microversion: 2.1 time: 0.477631 Aug 10 23:11:09.774772 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1557/3217] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:11:09 2022] GET /compute/v2.1/servers/59ecfba7-b76a-4b71-9821-bd330a20922f => generated 1507 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:11:09.780015 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-3095dda7-1ed5-4830-81d6-9b52013d6fdc tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:11:09.785597 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-3095dda7-1ed5-4830-81d6-9b52013d6fdc tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] [instance: 23452b78-96cd-430d-b95c-aaa98a427d53] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:11:09.825550 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3095dda7-1ed5-4830-81d6-9b52013d6fdc tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:09.826145 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3095dda7-1ed5-4830-81d6-9b52013d6fdc tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:09.826656 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3095dda7-1ed5-4830-81d6-9b52013d6fdc tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:09.827479 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3095dda7-1ed5-4830-81d6-9b52013d6fdc tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:09.828003 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3095dda7-1ed5-4830-81d6-9b52013d6fdc tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:09.828658 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3095dda7-1ed5-4830-81d6-9b52013d6fdc tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:09.852506 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-3095dda7-1ed5-4830-81d6-9b52013d6fdc tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] HTTP exception thrown: Instance 23452b78-96cd-430d-b95c-aaa98a427d53 could not be found. Aug 10 23:11:09.854555 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-3095dda7-1ed5-4830-81d6-9b52013d6fdc tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Request method failure captured: Aug 10 23:11:09.854555 n-d-850468-14 devstack@n-api.service[122632]: request: GET /compute/v2.1/servers/23452b78-96cd-430d-b95c-aaa98a427d53 HTTP/1.1 Aug 10 23:11:09.854555 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:11:09.854555 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:11:09.854555 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:11:09.854555 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 23:11:09.854555 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:11:09.854555 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:11:09.854555 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:11:09.854555 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:11:09.854555 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9DmBy_JTguncOh9GuBIMdYZxG9QUzBcwS_jXLGnjofrI-W_OX3R4Z5OuE0_icCyDrzKcQZCM5mI0mwZFV2C4_1i2WC483s7WfSWQg7_GotxoNsO0toS_K-yBXFY5hprgonzQ2ZZHnMvRhJYwAQ2SxIHPRTlL0QU-O2cMGZhSWdLxsL0 Aug 10 23:11:09.854555 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:11:09.854555 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:11:09.854555 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:11:09.854555 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:11:09.854555 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:11:09.854555 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:11:09.854555 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 597863bfebdc481188f1f30095da5396 Aug 10 23:11:09.854555 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-AttachVolumeTestJSON-1086920881 Aug 10 23:11:09.854555 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:11:09.854555 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:11:09.854555 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/597863bfebdc481188f1f30095da5396"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/597863bfebdc481188f1f30095da5396"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/597863bfebdc481188f1f30095da5396"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_597863bfebdc481188f1f30095da5396", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:11:09.854555 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-AttachVolumeTestJSON-1086920881 Aug 10 23:11:09.854555 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 597863bfebdc481188f1f30095da5396 Aug 10 23:11:09.854555 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1086920881 Aug 10 23:11:09.854555 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-AttachVolumeTestJSON-1086920881-project Aug 10 23:11:09.854555 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:11:09.854555 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:11:09.854555 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: a1986185dc9b4df4affcc421365462f7 Aug 10 23:11:09.854555 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-AttachVolumeTestJSON-1086920881-project Aug 10 23:11:09.854555 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:11:09.854555 n-d-850468-14 devstack@n-api.service[122632]: exception: Instance 23452b78-96cd-430d-b95c-aaa98a427d53 could not be found. Aug 10 23:11:09.854555 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': '23452b78-96cd-430d-b95c-aaa98a427d53'} Aug 10 23:11:09.854555 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:11:09.854555 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:11:09.854555 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:11:09.854555 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:11:09.854555 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:11:09.854555 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:11:09.854555 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:11:09.854555 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:11:09.854555 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:11:09.854555 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:11:09.854555 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23452b78-96cd-430d-b95c-aaa98a427d53 could not be found. Aug 10 23:11:09.854555 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:11:09.854555 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:11:09.854555 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:11:09.854555 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:11:09.854555 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:11:09.854555 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:11:09.854555 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:11:09.854555 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:11:09.854555 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:11:09.854555 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:11:09.854555 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:11:09.854555 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:11:09.854555 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:11:09.854555 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:11:09.854555 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:11:09.854555 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:11:09.854555 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23452b78-96cd-430d-b95c-aaa98a427d53 could not be found. Aug 10 23:11:09.854555 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:11:09.854555 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:11:09.854555 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:11:09.862304 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:11:09.862304 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:11:09.862304 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:11:09.862304 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:11:09.862304 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:11:09.862304 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23452b78-96cd-430d-b95c-aaa98a427d53 could not be found. Aug 10 23:11:09.862304 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:11:09.862304 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-3095dda7-1ed5-4830-81d6-9b52013d6fdc tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Returning 404 to user: Instance 23452b78-96cd-430d-b95c-aaa98a427d53 could not be found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:11:09.862304 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-3095dda7-1ed5-4830-81d6-9b52013d6fdc tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] 10.222.0.58 "GET /compute/v2.1/servers/23452b78-96cd-430d-b95c-aaa98a427d53" status: 404 len: 111 microversion: 2.1 time: 0.079960 Aug 10 23:11:09.862304 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1558/3218] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:11:09 2022] GET /compute/v2.1/servers/23452b78-96cd-430d-b95c-aaa98a427d53 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:11:09.867690 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-7379f43e-c533-4672-aead-22762a02603e tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Calling method '.version_select at 0x7f847c7bbb80>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:11:09.937549 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-7379f43e-c533-4672-aead-22762a02603e tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-280954451" status: 202 len: 0 microversion: 2.1 time: 0.074852 Aug 10 23:11:09.938497 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1559/3219] 10.222.0.58 () {58 vars in 1218 bytes} [Wed Aug 10 23:11:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-280954451 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:11:10.421078 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-e9910612-6f12-4ad4-b21f-930a8e4f7a97 req-13e02a05-fae8-4c62-94d4-5aac9bbfd4bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa9dfd3a-a636-48ce-ae15-0ed51baee954", "tag": "456f7ca7-21c6-4b5d-8993-9a7c329acf12"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:11:10.464516 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-e9910612-6f12-4ad4-b21f-930a8e4f7a97 req-13e02a05-fae8-4c62-94d4-5aac9bbfd4bb service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:10.465134 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-e9910612-6f12-4ad4-b21f-930a8e4f7a97 req-13e02a05-fae8-4c62-94d4-5aac9bbfd4bb service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:10.465597 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-e9910612-6f12-4ad4-b21f-930a8e4f7a97 req-13e02a05-fae8-4c62-94d4-5aac9bbfd4bb service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:10.505756 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-e9910612-6f12-4ad4-b21f-930a8e4f7a97 req-13e02a05-fae8-4c62-94d4-5aac9bbfd4bb service nova] Creating event network-changed:456f7ca7-21c6-4b5d-8993-9a7c329acf12 for instance fa9dfd3a-a636-48ce-ae15-0ed51baee954 on n-h2-850468-14 Aug 10 23:11:10.514269 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-e9910612-6f12-4ad4-b21f-930a8e4f7a97 req-13e02a05-fae8-4c62-94d4-5aac9bbfd4bb service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098037 Aug 10 23:11:10.515234 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1560/3220] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:11:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:11:10.675395 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-3417a5ec-0943-414a-b28e-b77f86f4cc86 tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc806dca6c64050b7f0e33fdb9c109c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acff29ee63244cf901723175cbee173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:11:10.691326 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-3417a5ec-0943-414a-b28e-b77f86f4cc86 tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] 10.222.0.58 "GET /compute/v2.1/servers/23c5c205-bafa-414f-8c1c-d3b78eb82538" status: 200 len: 1351 microversion: 2.1 time: 1.329995 Aug 10 23:11:10.692926 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1661/3221] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:11:09 2022] GET /compute/v2.1/servers/23c5c205-bafa-414f-8c1c-d3b78eb82538 => generated 1351 bytes in 1332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:11:10.795277 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-28541e7a-2ab3-4f2a-801e-56bb0b88112f tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:11:10.795951 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-28541e7a-2ab3-4f2a-801e-56bb0b88112f tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: 59ecfba7-b76a-4b71-9821-bd330a20922f] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:11:10.814023 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-28541e7a-2ab3-4f2a-801e-56bb0b88112f tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:10.820425 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-28541e7a-2ab3-4f2a-801e-56bb0b88112f tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:10.821165 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-28541e7a-2ab3-4f2a-801e-56bb0b88112f tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:10.822316 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-28541e7a-2ab3-4f2a-801e-56bb0b88112f tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:10.824470 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-28541e7a-2ab3-4f2a-801e-56bb0b88112f tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:10.835519 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-28541e7a-2ab3-4f2a-801e-56bb0b88112f tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:11.584285 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-e62e57e0-2ca8-4fc8-8577-9b8b989d8622 tempest-PortsAdminExtendedAttrsIpV6TestJSON-529030115 tempest-PortsAdminExtendedAttrsIpV6TestJSON-529030115-project-admin] Calling method '.version_select at 0x7f847d32dca0>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:11:11.585908 n-d-850468-14 devstack@n-api.service[122633]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 23:11:11.585908 n-d-850468-14 devstack@n-api.service[122633]: warnings.warn(msg) Aug 10 23:11:11.587452 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e62e57e0-2ca8-4fc8-8577-9b8b989d8622 tempest-PortsAdminExtendedAttrsIpV6TestJSON-529030115 tempest-PortsAdminExtendedAttrsIpV6TestJSON-529030115-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:11.588323 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e62e57e0-2ca8-4fc8-8577-9b8b989d8622 tempest-PortsAdminExtendedAttrsIpV6TestJSON-529030115 tempest-PortsAdminExtendedAttrsIpV6TestJSON-529030115-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:11.594629 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e62e57e0-2ca8-4fc8-8577-9b8b989d8622 tempest-PortsAdminExtendedAttrsIpV6TestJSON-529030115 tempest-PortsAdminExtendedAttrsIpV6TestJSON-529030115-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:11.638986 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:11:11.651937 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e62e57e0-2ca8-4fc8-8577-9b8b989d8622 tempest-PortsAdminExtendedAttrsIpV6TestJSON-529030115 tempest-PortsAdminExtendedAttrsIpV6TestJSON-529030115-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:11.652937 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e62e57e0-2ca8-4fc8-8577-9b8b989d8622 tempest-PortsAdminExtendedAttrsIpV6TestJSON-529030115 tempest-PortsAdminExtendedAttrsIpV6TestJSON-529030115-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:11.658290 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e62e57e0-2ca8-4fc8-8577-9b8b989d8622 tempest-PortsAdminExtendedAttrsIpV6TestJSON-529030115 tempest-PortsAdminExtendedAttrsIpV6TestJSON-529030115-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:11.697548 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e62e57e0-2ca8-4fc8-8577-9b8b989d8622 tempest-PortsAdminExtendedAttrsIpV6TestJSON-529030115 tempest-PortsAdminExtendedAttrsIpV6TestJSON-529030115-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:11.698124 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e62e57e0-2ca8-4fc8-8577-9b8b989d8622 tempest-PortsAdminExtendedAttrsIpV6TestJSON-529030115 tempest-PortsAdminExtendedAttrsIpV6TestJSON-529030115-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:11.703218 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e62e57e0-2ca8-4fc8-8577-9b8b989d8622 tempest-PortsAdminExtendedAttrsIpV6TestJSON-529030115 tempest-PortsAdminExtendedAttrsIpV6TestJSON-529030115-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:11.713321 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-e62e57e0-2ca8-4fc8-8577-9b8b989d8622 tempest-PortsAdminExtendedAttrsIpV6TestJSON-529030115 tempest-PortsAdminExtendedAttrsIpV6TestJSON-529030115-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.428000 Aug 10 23:11:11.713943 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1662/3222] 10.222.0.58 () {58 vars in 1146 bytes} [Wed Aug 10 23:11:11 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:11:11.725780 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-d828cb78-1d6c-49fa-8d65-1dff7ffffac0 tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:11:11.730256 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-d828cb78-1d6c-49fa-8d65-1dff7ffffac0 tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] [instance: 23c5c205-bafa-414f-8c1c-d3b78eb82538] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:11:11.760601 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d828cb78-1d6c-49fa-8d65-1dff7ffffac0 tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:11.761495 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d828cb78-1d6c-49fa-8d65-1dff7ffffac0 tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:11.762166 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d828cb78-1d6c-49fa-8d65-1dff7ffffac0 tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:11.763177 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d828cb78-1d6c-49fa-8d65-1dff7ffffac0 tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:11.765013 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d828cb78-1d6c-49fa-8d65-1dff7ffffac0 tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:11.767760 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d828cb78-1d6c-49fa-8d65-1dff7ffffac0 tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:12.399579 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-d828cb78-1d6c-49fa-8d65-1dff7ffffac0 tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc806dca6c64050b7f0e33fdb9c109c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acff29ee63244cf901723175cbee173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:11:12.431310 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-d828cb78-1d6c-49fa-8d65-1dff7ffffac0 tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] 10.222.0.58 "GET /compute/v2.1/servers/23c5c205-bafa-414f-8c1c-d3b78eb82538" status: 200 len: 1351 microversion: 2.1 time: 0.710224 Aug 10 23:11:12.435099 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1663/3223] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:11:11 2022] GET /compute/v2.1/servers/23c5c205-bafa-414f-8c1c-d3b78eb82538 => generated 1351 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:11:12.456046 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-a0dd3dd8-8796-4633-8e80-e628f00f6d67 req-175c5d73-c8e4-42ff-ac99-10a5530742ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23c5c205-bafa-414f-8c1c-d3b78eb82538", "name": "network-vif-plugged", "status": "completed", "tag": "ae1586eb-94d4-44e8-8de7-48abc323a0b2"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:11:12.477037 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-a0dd3dd8-8796-4633-8e80-e628f00f6d67 req-175c5d73-c8e4-42ff-ac99-10a5530742ff service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:12.477870 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-a0dd3dd8-8796-4633-8e80-e628f00f6d67 req-175c5d73-c8e4-42ff-ac99-10a5530742ff service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:12.480169 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-a0dd3dd8-8796-4633-8e80-e628f00f6d67 req-175c5d73-c8e4-42ff-ac99-10a5530742ff service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:12.495275 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-a0dd3dd8-8796-4633-8e80-e628f00f6d67 req-175c5d73-c8e4-42ff-ac99-10a5530742ff service nova] Creating event network-vif-plugged:ae1586eb-94d4-44e8-8de7-48abc323a0b2 for instance 23c5c205-bafa-414f-8c1c-d3b78eb82538 on n-h1-850468-14 Aug 10 23:11:12.502945 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-a0dd3dd8-8796-4633-8e80-e628f00f6d67 req-175c5d73-c8e4-42ff-ac99-10a5530742ff service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051647 Aug 10 23:11:12.510590 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1664/3224] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:11:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:11:12.858237 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-28541e7a-2ab3-4f2a-801e-56bb0b88112f tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6160c7a42740efbe3613380933fa15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d90f8a58ad047fa8f347d6474e4d673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:11:12.877232 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-28541e7a-2ab3-4f2a-801e-56bb0b88112f tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "GET /compute/v2.1/servers/59ecfba7-b76a-4b71-9821-bd330a20922f" status: 200 len: 1507 microversion: 2.1 time: 2.086887 Aug 10 23:11:12.878990 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1561/3225] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:11:10 2022] GET /compute/v2.1/servers/59ecfba7-b76a-4b71-9821-bd330a20922f => generated 1507 bytes in 2090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:11:13.466178 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-fc63028f-c068-4041-ab9c-9dd034e84340 tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:11:13.466978 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-fc63028f-c068-4041-ab9c-9dd034e84340 tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] [instance: 23c5c205-bafa-414f-8c1c-d3b78eb82538] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:11:13.481787 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fc63028f-c068-4041-ab9c-9dd034e84340 tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:13.483621 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fc63028f-c068-4041-ab9c-9dd034e84340 tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:13.484083 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fc63028f-c068-4041-ab9c-9dd034e84340 tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:13.486893 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fc63028f-c068-4041-ab9c-9dd034e84340 tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:13.487452 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fc63028f-c068-4041-ab9c-9dd034e84340 tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:13.487896 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fc63028f-c068-4041-ab9c-9dd034e84340 tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:13.890620 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-fc63028f-c068-4041-ab9c-9dd034e84340 tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc806dca6c64050b7f0e33fdb9c109c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acff29ee63244cf901723175cbee173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:11:13.899825 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-72f43227-7465-4d60-9a97-1711ad6f3b3e tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:11:13.900427 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-72f43227-7465-4d60-9a97-1711ad6f3b3e tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: 59ecfba7-b76a-4b71-9821-bd330a20922f] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:11:13.910517 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-fc63028f-c068-4041-ab9c-9dd034e84340 tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] 10.222.0.58 "GET /compute/v2.1/servers/23c5c205-bafa-414f-8c1c-d3b78eb82538" status: 200 len: 1351 microversion: 2.1 time: 0.452377 Aug 10 23:11:13.911937 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1665/3226] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:11:13 2022] GET /compute/v2.1/servers/23c5c205-bafa-414f-8c1c-d3b78eb82538 => generated 1351 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:11:13.914626 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-72f43227-7465-4d60-9a97-1711ad6f3b3e tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:13.915151 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-72f43227-7465-4d60-9a97-1711ad6f3b3e tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:13.915596 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-72f43227-7465-4d60-9a97-1711ad6f3b3e tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:13.923914 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-72f43227-7465-4d60-9a97-1711ad6f3b3e tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:13.924396 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-72f43227-7465-4d60-9a97-1711ad6f3b3e tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:13.925037 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-72f43227-7465-4d60-9a97-1711ad6f3b3e tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:14.585514 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-72f43227-7465-4d60-9a97-1711ad6f3b3e tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6160c7a42740efbe3613380933fa15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d90f8a58ad047fa8f347d6474e4d673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:11:14.605180 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-72f43227-7465-4d60-9a97-1711ad6f3b3e tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "GET /compute/v2.1/servers/59ecfba7-b76a-4b71-9821-bd330a20922f" status: 200 len: 1507 microversion: 2.1 time: 0.709109 Aug 10 23:11:14.606433 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1562/3227] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:11:13 2022] GET /compute/v2.1/servers/59ecfba7-b76a-4b71-9821-bd330a20922f => generated 1507 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:11:14.731578 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-e3f7e598-1346-45fe-a640-8687a75db77a req-05435f13-4aca-40df-84c2-2e28c260c007 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59ecfba7-b76a-4b71-9821-bd330a20922f", "name": "network-vif-deleted", "tag": "fc0713b3-97ad-48e6-b43b-97aa6ce32c32"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:11:14.769953 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-e3f7e598-1346-45fe-a640-8687a75db77a req-05435f13-4aca-40df-84c2-2e28c260c007 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:14.776166 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-e3f7e598-1346-45fe-a640-8687a75db77a req-05435f13-4aca-40df-84c2-2e28c260c007 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:14.776716 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-e3f7e598-1346-45fe-a640-8687a75db77a req-05435f13-4aca-40df-84c2-2e28c260c007 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:14.847977 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-e3f7e598-1346-45fe-a640-8687a75db77a req-05435f13-4aca-40df-84c2-2e28c260c007 service nova] Creating event network-vif-deleted:fc0713b3-97ad-48e6-b43b-97aa6ce32c32 for instance 59ecfba7-b76a-4b71-9821-bd330a20922f on n-h1-850468-14 Aug 10 23:11:14.886000 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-e3f7e598-1346-45fe-a640-8687a75db77a req-05435f13-4aca-40df-84c2-2e28c260c007 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.147538 Aug 10 23:11:14.888249 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1666/3228] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:11:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:11:14.931738 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-5696953b-faf2-4bda-8045-904b50a51c93 tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:11:14.932433 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-5696953b-faf2-4bda-8045-904b50a51c93 tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] [instance: 23c5c205-bafa-414f-8c1c-d3b78eb82538] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:11:14.949483 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5696953b-faf2-4bda-8045-904b50a51c93 tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:14.951639 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5696953b-faf2-4bda-8045-904b50a51c93 tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:14.952270 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5696953b-faf2-4bda-8045-904b50a51c93 tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:14.953188 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5696953b-faf2-4bda-8045-904b50a51c93 tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:14.954335 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5696953b-faf2-4bda-8045-904b50a51c93 tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:14.955652 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5696953b-faf2-4bda-8045-904b50a51c93 tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:15.241291 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-5696953b-faf2-4bda-8045-904b50a51c93 tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc806dca6c64050b7f0e33fdb9c109c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acff29ee63244cf901723175cbee173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:11:15.255051 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-5696953b-faf2-4bda-8045-904b50a51c93 tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] 10.222.0.58 "GET /compute/v2.1/servers/23c5c205-bafa-414f-8c1c-d3b78eb82538" status: 200 len: 1541 microversion: 2.1 time: 0.326429 Aug 10 23:11:15.259678 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1563/3229] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:11:14 2022] GET /compute/v2.1/servers/23c5c205-bafa-414f-8c1c-d3b78eb82538 => generated 1541 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:11:15.277911 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-01409be1-2cfa-4730-b9d1-ceb3b52d0f48 tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:11:15.278815 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-01409be1-2cfa-4730-b9d1-ceb3b52d0f48 tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] [instance: 23c5c205-bafa-414f-8c1c-d3b78eb82538] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:11:15.287435 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-01409be1-2cfa-4730-b9d1-ceb3b52d0f48 tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:15.288563 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-01409be1-2cfa-4730-b9d1-ceb3b52d0f48 tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:15.289455 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-01409be1-2cfa-4730-b9d1-ceb3b52d0f48 tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:15.290408 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-01409be1-2cfa-4730-b9d1-ceb3b52d0f48 tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:15.291055 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-01409be1-2cfa-4730-b9d1-ceb3b52d0f48 tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:15.291684 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-01409be1-2cfa-4730-b9d1-ceb3b52d0f48 tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:15.502713 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-01409be1-2cfa-4730-b9d1-ceb3b52d0f48 tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] 10.222.0.58 "GET /compute/v2.1/servers/23c5c205-bafa-414f-8c1c-d3b78eb82538/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.230099 Aug 10 23:11:15.503590 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1667/3230] 10.222.0.58 () {58 vars in 1275 bytes} [Wed Aug 10 23:11:15 2022] GET /compute/v2.1/servers/23c5c205-bafa-414f-8c1c-d3b78eb82538/os-interface => generated 284 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:11:15.630994 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-eb06ad6a-674b-493f-b19c-a5cacfe1a775 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:11:15.631956 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-eb06ad6a-674b-493f-b19c-a5cacfe1a775 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: 59ecfba7-b76a-4b71-9821-bd330a20922f] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:11:15.634155 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=2,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:11:15.651073 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-eb06ad6a-674b-493f-b19c-a5cacfe1a775 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:15.651880 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-eb06ad6a-674b-493f-b19c-a5cacfe1a775 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:15.652473 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-eb06ad6a-674b-493f-b19c-a5cacfe1a775 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:15.653377 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-eb06ad6a-674b-493f-b19c-a5cacfe1a775 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:15.653992 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-eb06ad6a-674b-493f-b19c-a5cacfe1a775 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:15.654576 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-eb06ad6a-674b-493f-b19c-a5cacfe1a775 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:15.674312 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-eb06ad6a-674b-493f-b19c-a5cacfe1a775 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] HTTP exception thrown: Instance 59ecfba7-b76a-4b71-9821-bd330a20922f could not be found. Aug 10 23:11:15.676600 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-eb06ad6a-674b-493f-b19c-a5cacfe1a775 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Request method failure captured: Aug 10 23:11:15.676600 n-d-850468-14 devstack@n-api.service[122632]: request: GET /compute/v2.1/servers/59ecfba7-b76a-4b71-9821-bd330a20922f HTTP/1.1 Aug 10 23:11:15.676600 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:11:15.676600 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:11:15.676600 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:11:15.676600 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 23:11:15.676600 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:11:15.676600 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:11:15.676600 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:11:15.676600 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:11:15.676600 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9Drr3r82npWIkz1ccNiKcah17mvrMR2EU4HCxqxnaGEEIkGANcRcrX2nHMsvmCLf0usmykCLye_MMWubAbqGw1RDJdO9uNXXKIzwnkO3-8RDYkeEsX4dAb-XLWqGpnC4lB_RQ_yXrj9zJ0yoaNBALi5oi6cnoUgwIrYxNetinerHaU0 Aug 10 23:11:15.676600 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:11:15.676600 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:11:15.676600 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:11:15.676600 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:11:15.676600 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:11:15.676600 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:11:15.676600 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 7d90f8a58ad047fa8f347d6474e4d673 Aug 10 23:11:15.676600 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-DeleteServersTestJSON-311075827 Aug 10 23:11:15.676600 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:11:15.676600 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:11:15.676600 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7d90f8a58ad047fa8f347d6474e4d673"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7d90f8a58ad047fa8f347d6474e4d673"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7d90f8a58ad047fa8f347d6474e4d673"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7d90f8a58ad047fa8f347d6474e4d673", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:11:15.676600 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-DeleteServersTestJSON-311075827 Aug 10 23:11:15.676600 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 7d90f8a58ad047fa8f347d6474e4d673 Aug 10 23:11:15.676600 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-DeleteServersTestJSON-311075827 Aug 10 23:11:15.676600 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-DeleteServersTestJSON-311075827-project Aug 10 23:11:15.676600 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:11:15.676600 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:11:15.676600 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: 3c6160c7a42740efbe3613380933fa15 Aug 10 23:11:15.676600 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-DeleteServersTestJSON-311075827-project Aug 10 23:11:15.676600 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:11:15.676600 n-d-850468-14 devstack@n-api.service[122632]: exception: Instance 59ecfba7-b76a-4b71-9821-bd330a20922f could not be found. Aug 10 23:11:15.676600 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': '59ecfba7-b76a-4b71-9821-bd330a20922f'} Aug 10 23:11:15.676600 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:11:15.676600 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:11:15.676600 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:11:15.676600 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:11:15.676600 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:11:15.676600 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:11:15.676600 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:11:15.676600 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:11:15.676600 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:11:15.676600 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:11:15.676600 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59ecfba7-b76a-4b71-9821-bd330a20922f could not be found. Aug 10 23:11:15.676600 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:11:15.676600 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:11:15.676600 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:11:15.676600 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:11:15.676600 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:11:15.676600 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:11:15.676600 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:11:15.676600 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:11:15.676600 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:11:15.676600 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:11:15.676600 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:11:15.676600 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:11:15.676600 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:11:15.676600 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:11:15.676600 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:11:15.676600 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:11:15.676600 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59ecfba7-b76a-4b71-9821-bd330a20922f could not be found. Aug 10 23:11:15.676600 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:11:15.676600 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:11:15.676600 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:11:15.681861 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:11:15.681861 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:11:15.681861 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:11:15.681861 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:11:15.681861 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:11:15.681861 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59ecfba7-b76a-4b71-9821-bd330a20922f could not be found. Aug 10 23:11:15.681861 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:11:15.683219 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-eb06ad6a-674b-493f-b19c-a5cacfe1a775 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Returning 404 to user: Instance 59ecfba7-b76a-4b71-9821-bd330a20922f could not be found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:11:15.684250 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-eb06ad6a-674b-493f-b19c-a5cacfe1a775 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "GET /compute/v2.1/servers/59ecfba7-b76a-4b71-9821-bd330a20922f" status: 404 len: 111 microversion: 2.1 time: 0.057559 Aug 10 23:11:15.685359 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1564/3231] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:11:15 2022] GET /compute/v2.1/servers/59ecfba7-b76a-4b71-9821-bd330a20922f => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:11:15.908739 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-e8b3f1bf-b102-48f4-9111-1a0995a27247 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-643743723", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452", "networks": [{"uuid": "042efc3d-5a07-4ef1-a5d1-285928545eba"}]}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:11:16.090078 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.network.neutron [None req-e8b3f1bf-b102-48f4-9111-1a0995a27247 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] validate_networks() for [('042efc3d-5a07-4ef1-a5d1-285928545eba', None, None, None, None, None)] {{(pid=122633) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 23:11:17.897661 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-e8b3f1bf-b102-48f4-9111-1a0995a27247 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Flavor limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:11:17.898249 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-e8b3f1bf-b102-48f4-9111-1a0995a27247 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Image limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:11:17.898585 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-e8b3f1bf-b102-48f4-9111-1a0995a27247 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Flavor pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:11:17.899020 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-e8b3f1bf-b102-48f4-9111-1a0995a27247 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Image pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:11:17.900143 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-e8b3f1bf-b102-48f4-9111-1a0995a27247 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:11:17.923239 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e8b3f1bf-b102-48f4-9111-1a0995a27247 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:17.923728 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e8b3f1bf-b102-48f4-9111-1a0995a27247 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:17.929044 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e8b3f1bf-b102-48f4-9111-1a0995a27247 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:17.930542 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e8b3f1bf-b102-48f4-9111-1a0995a27247 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:17.931519 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e8b3f1bf-b102-48f4-9111-1a0995a27247 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:17.932160 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e8b3f1bf-b102-48f4-9111-1a0995a27247 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:17.984742 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-e8b3f1bf-b102-48f4-9111-1a0995a27247 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Getting quotas for project 7d90f8a58ad047fa8f347d6474e4d673. Resources: {'instances', 'cores', 'ram'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:11:17.998409 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-e8b3f1bf-b102-48f4-9111-1a0995a27247 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Getting quotas for user 3c6160c7a42740efbe3613380933fa15 and project 7d90f8a58ad047fa8f347d6474e4d673. Resources: {'instances', 'cores', 'ram'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:11:18.052191 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-e8b3f1bf-b102-48f4-9111-1a0995a27247 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Going to run 1 instances... {{(pid=122633) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 23:11:18.054423 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-e8b3f1bf-b102-48f4-9111-1a0995a27247 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: 6777bc8c-cfdf-4264-a776-09e8df2dc13b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78ad8905-f66f-4733-8be9-2b260f1fabed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122633) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 23:11:18.273980 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-e8b3f1bf-b102-48f4-9111-1a0995a27247 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.376804 Aug 10 23:11:18.274948 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1668/3232] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 23:11:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 2378 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 23:11:18.295773 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-777d18e1-5db1-492d-a182-2059b60d9c57 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:11:18.296413 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-777d18e1-5db1-492d-a182-2059b60d9c57 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: 6777bc8c-cfdf-4264-a776-09e8df2dc13b] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:11:18.323621 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=4 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:11:18.766098 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-777d18e1-5db1-492d-a182-2059b60d9c57 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6160c7a42740efbe3613380933fa15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d90f8a58ad047fa8f347d6474e4d673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:11:18.783190 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-777d18e1-5db1-492d-a182-2059b60d9c57 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "GET /compute/v2.1/servers/6777bc8c-cfdf-4264-a776-09e8df2dc13b" status: 200 len: 1214 microversion: 2.1 time: 0.497960 Aug 10 23:11:18.784247 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1565/3233] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:11:18 2022] GET /compute/v2.1/servers/6777bc8c-cfdf-4264-a776-09e8df2dc13b => generated 1214 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:11:19.315565 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-25c42ef4-6282-4e29-98ae-ce74ff238ead req-4266a131-4e23-4741-b245-f083349725e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23c5c205-bafa-414f-8c1c-d3b78eb82538", "tag": "ae1586eb-94d4-44e8-8de7-48abc323a0b2"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:11:19.346670 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-25c42ef4-6282-4e29-98ae-ce74ff238ead req-4266a131-4e23-4741-b245-f083349725e0 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:19.352143 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-25c42ef4-6282-4e29-98ae-ce74ff238ead req-4266a131-4e23-4741-b245-f083349725e0 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:19.353446 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-25c42ef4-6282-4e29-98ae-ce74ff238ead req-4266a131-4e23-4741-b245-f083349725e0 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:19.375894 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-25c42ef4-6282-4e29-98ae-ce74ff238ead req-4266a131-4e23-4741-b245-f083349725e0 service nova] Creating event network-changed:ae1586eb-94d4-44e8-8de7-48abc323a0b2 for instance 23c5c205-bafa-414f-8c1c-d3b78eb82538 on n-h1-850468-14 Aug 10 23:11:19.382693 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-25c42ef4-6282-4e29-98ae-ce74ff238ead req-4266a131-4e23-4741-b245-f083349725e0 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072391 Aug 10 23:11:19.383733 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1669/3234] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:11:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 23:11:19.809214 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-530fa829-4ac5-4769-9c04-d7f24563b148 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:11:19.809816 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-530fa829-4ac5-4769-9c04-d7f24563b148 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: 6777bc8c-cfdf-4264-a776-09e8df2dc13b] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:11:19.844948 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-530fa829-4ac5-4769-9c04-d7f24563b148 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:19.847781 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-530fa829-4ac5-4769-9c04-d7f24563b148 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:19.851781 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-530fa829-4ac5-4769-9c04-d7f24563b148 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:19.855848 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-530fa829-4ac5-4769-9c04-d7f24563b148 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:19.857250 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-530fa829-4ac5-4769-9c04-d7f24563b148 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:19.876333 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-530fa829-4ac5-4769-9c04-d7f24563b148 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:20.331991 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-530fa829-4ac5-4769-9c04-d7f24563b148 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6160c7a42740efbe3613380933fa15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d90f8a58ad047fa8f347d6474e4d673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:11:20.347527 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-530fa829-4ac5-4769-9c04-d7f24563b148 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "GET /compute/v2.1/servers/6777bc8c-cfdf-4264-a776-09e8df2dc13b" status: 200 len: 1210 microversion: 2.1 time: 0.542121 Aug 10 23:11:20.366731 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1566/3235] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:11:19 2022] GET /compute/v2.1/servers/6777bc8c-cfdf-4264-a776-09e8df2dc13b => generated 1210 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:11:21.387139 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-33ef09e5-cb56-4115-9416-0a4f01fc4d89 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:11:21.389620 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-33ef09e5-cb56-4115-9416-0a4f01fc4d89 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: 6777bc8c-cfdf-4264-a776-09e8df2dc13b] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:11:21.411674 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-33ef09e5-cb56-4115-9416-0a4f01fc4d89 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:21.418119 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-33ef09e5-cb56-4115-9416-0a4f01fc4d89 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:21.424179 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-33ef09e5-cb56-4115-9416-0a4f01fc4d89 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:21.427646 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-33ef09e5-cb56-4115-9416-0a4f01fc4d89 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:21.428363 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-33ef09e5-cb56-4115-9416-0a4f01fc4d89 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:21.429542 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-33ef09e5-cb56-4115-9416-0a4f01fc4d89 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:21.683009 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-33ef09e5-cb56-4115-9416-0a4f01fc4d89 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6160c7a42740efbe3613380933fa15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d90f8a58ad047fa8f347d6474e4d673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:11:21.698114 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-33ef09e5-cb56-4115-9416-0a4f01fc4d89 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "GET /compute/v2.1/servers/6777bc8c-cfdf-4264-a776-09e8df2dc13b" status: 200 len: 1272 microversion: 2.1 time: 0.322453 Aug 10 23:11:21.703131 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1670/3236] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:11:21 2022] GET /compute/v2.1/servers/6777bc8c-cfdf-4264-a776-09e8df2dc13b => generated 1272 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:11:22.729301 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-92aefc4a-11ff-4ef4-ba05-69c97ee1db2f tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:11:22.730678 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-92aefc4a-11ff-4ef4-ba05-69c97ee1db2f tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: 6777bc8c-cfdf-4264-a776-09e8df2dc13b] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:11:22.743168 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-92aefc4a-11ff-4ef4-ba05-69c97ee1db2f tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:22.746669 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-92aefc4a-11ff-4ef4-ba05-69c97ee1db2f tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:22.747348 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-92aefc4a-11ff-4ef4-ba05-69c97ee1db2f tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:22.748251 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-92aefc4a-11ff-4ef4-ba05-69c97ee1db2f tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:22.749236 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-92aefc4a-11ff-4ef4-ba05-69c97ee1db2f tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:22.749669 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-92aefc4a-11ff-4ef4-ba05-69c97ee1db2f tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:22.942330 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-92aefc4a-11ff-4ef4-ba05-69c97ee1db2f tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6160c7a42740efbe3613380933fa15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d90f8a58ad047fa8f347d6474e4d673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:11:22.955906 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-92aefc4a-11ff-4ef4-ba05-69c97ee1db2f tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "GET /compute/v2.1/servers/6777bc8c-cfdf-4264-a776-09e8df2dc13b" status: 200 len: 1272 microversion: 2.1 time: 0.231751 Aug 10 23:11:22.957381 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1567/3237] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:11:22 2022] GET /compute/v2.1/servers/6777bc8c-cfdf-4264-a776-09e8df2dc13b => generated 1272 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:11:23.983085 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-ef5399a3-1dd9-4a6b-92c7-99a624765741 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:11:23.983708 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-ef5399a3-1dd9-4a6b-92c7-99a624765741 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: 6777bc8c-cfdf-4264-a776-09e8df2dc13b] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:11:24.027200 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ef5399a3-1dd9-4a6b-92c7-99a624765741 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:24.029430 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ef5399a3-1dd9-4a6b-92c7-99a624765741 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:24.038978 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ef5399a3-1dd9-4a6b-92c7-99a624765741 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:24.041018 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ef5399a3-1dd9-4a6b-92c7-99a624765741 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:24.042907 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ef5399a3-1dd9-4a6b-92c7-99a624765741 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:24.044656 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ef5399a3-1dd9-4a6b-92c7-99a624765741 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:24.459707 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-ef5399a3-1dd9-4a6b-92c7-99a624765741 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6160c7a42740efbe3613380933fa15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d90f8a58ad047fa8f347d6474e4d673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:11:24.468667 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-ef5399a3-1dd9-4a6b-92c7-99a624765741 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "GET /compute/v2.1/servers/6777bc8c-cfdf-4264-a776-09e8df2dc13b" status: 200 len: 1314 microversion: 2.1 time: 0.494866 Aug 10 23:11:24.483084 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1671/3238] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:11:23 2022] GET /compute/v2.1/servers/6777bc8c-cfdf-4264-a776-09e8df2dc13b => generated 1314 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:11:25.332500 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-9de6cba3-f8b3-432b-8635-2362caa7485d tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:11:25.332974 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-9de6cba3-f8b3-432b-8635-2362caa7485d tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] [instance: 23452b78-96cd-430d-b95c-aaa98a427d53] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:11:25.350729 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9de6cba3-f8b3-432b-8635-2362caa7485d tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:25.351475 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9de6cba3-f8b3-432b-8635-2362caa7485d tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:25.352078 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9de6cba3-f8b3-432b-8635-2362caa7485d tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:25.354675 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9de6cba3-f8b3-432b-8635-2362caa7485d tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:25.355354 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9de6cba3-f8b3-432b-8635-2362caa7485d tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:25.356955 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9de6cba3-f8b3-432b-8635-2362caa7485d tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:25.385017 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=100 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:11:25.390751 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-9de6cba3-f8b3-432b-8635-2362caa7485d tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] HTTP exception thrown: Instance 23452b78-96cd-430d-b95c-aaa98a427d53 could not be found. Aug 10 23:11:25.397845 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-9de6cba3-f8b3-432b-8635-2362caa7485d tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Request method failure captured: Aug 10 23:11:25.397845 n-d-850468-14 devstack@n-api.service[122632]: request: DELETE /compute/v2.1/servers/23452b78-96cd-430d-b95c-aaa98a427d53 HTTP/1.1 Aug 10 23:11:25.397845 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:11:25.397845 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:11:25.397845 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:11:25.397845 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 23:11:25.397845 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:11:25.397845 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:11:25.397845 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:11:25.397845 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:11:25.397845 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9DmBy_JTguncOh9GuBIMdYZxG9QUzBcwS_jXLGnjofrI-W_OX3R4Z5OuE0_icCyDrzKcQZCM5mI0mwZFV2C4_1i2WC483s7WfSWQg7_GotxoNsO0toS_K-yBXFY5hprgonzQ2ZZHnMvRhJYwAQ2SxIHPRTlL0QU-O2cMGZhSWdLxsL0 Aug 10 23:11:25.397845 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:11:25.397845 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:11:25.397845 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:11:25.397845 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:11:25.397845 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:11:25.397845 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:11:25.397845 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 597863bfebdc481188f1f30095da5396 Aug 10 23:11:25.397845 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-AttachVolumeTestJSON-1086920881 Aug 10 23:11:25.397845 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:11:25.397845 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:11:25.397845 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/597863bfebdc481188f1f30095da5396"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/597863bfebdc481188f1f30095da5396"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/597863bfebdc481188f1f30095da5396"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_597863bfebdc481188f1f30095da5396", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:11:25.397845 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-AttachVolumeTestJSON-1086920881 Aug 10 23:11:25.397845 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 597863bfebdc481188f1f30095da5396 Aug 10 23:11:25.397845 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1086920881 Aug 10 23:11:25.397845 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-AttachVolumeTestJSON-1086920881-project Aug 10 23:11:25.397845 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:11:25.397845 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:11:25.397845 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: a1986185dc9b4df4affcc421365462f7 Aug 10 23:11:25.397845 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-AttachVolumeTestJSON-1086920881-project Aug 10 23:11:25.397845 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:11:25.397845 n-d-850468-14 devstack@n-api.service[122632]: exception: Instance 23452b78-96cd-430d-b95c-aaa98a427d53 could not be found. Aug 10 23:11:25.397845 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': '23452b78-96cd-430d-b95c-aaa98a427d53'} Aug 10 23:11:25.397845 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:11:25.397845 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:11:25.397845 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:11:25.397845 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:11:25.397845 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:11:25.397845 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:11:25.397845 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:11:25.397845 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:11:25.397845 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:11:25.397845 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:11:25.397845 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23452b78-96cd-430d-b95c-aaa98a427d53 could not be found. Aug 10 23:11:25.397845 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:11:25.397845 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:11:25.397845 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:11:25.397845 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:11:25.397845 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:11:25.397845 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:11:25.397845 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:11:25.397845 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:11:25.397845 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:11:25.397845 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:11:25.397845 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 23:11:25.397845 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 23:11:25.397845 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 23:11:25.397845 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 23:11:25.397845 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:11:25.397845 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:11:25.397845 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:11:25.397845 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:11:25.402972 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23452b78-96cd-430d-b95c-aaa98a427d53 could not be found. Aug 10 23:11:25.402972 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:11:25.402972 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:11:25.402972 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:11:25.402972 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:11:25.402972 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:11:25.402972 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:11:25.402972 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:11:25.402972 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:11:25.402972 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23452b78-96cd-430d-b95c-aaa98a427d53 could not be found. Aug 10 23:11:25.402972 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:11:25.405312 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-9de6cba3-f8b3-432b-8635-2362caa7485d tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Returning 404 to user: Instance 23452b78-96cd-430d-b95c-aaa98a427d53 could not be found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:11:25.409377 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-9de6cba3-f8b3-432b-8635-2362caa7485d tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] 10.222.0.58 "DELETE /compute/v2.1/servers/23452b78-96cd-430d-b95c-aaa98a427d53" status: 404 len: 111 microversion: 2.1 time: 0.080748 Aug 10 23:11:25.412538 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1568/3239] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:11:25 2022] DELETE /compute/v2.1/servers/23452b78-96cd-430d-b95c-aaa98a427d53 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:11:25.420661 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-5ce0a904-c721-4681-b80d-a25c37d41cd2 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:11:25.421428 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-5ce0a904-c721-4681-b80d-a25c37d41cd2 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] [instance: 23452b78-96cd-430d-b95c-aaa98a427d53] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:11:25.452381 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5ce0a904-c721-4681-b80d-a25c37d41cd2 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:25.455461 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5ce0a904-c721-4681-b80d-a25c37d41cd2 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:25.456546 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5ce0a904-c721-4681-b80d-a25c37d41cd2 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:25.457573 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5ce0a904-c721-4681-b80d-a25c37d41cd2 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:25.458306 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5ce0a904-c721-4681-b80d-a25c37d41cd2 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:25.460781 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5ce0a904-c721-4681-b80d-a25c37d41cd2 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:25.498443 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-8e8aaf1d-ba3b-49d6-879f-78ab209e2889 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:11:25.499489 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-8e8aaf1d-ba3b-49d6-879f-78ab209e2889 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: 6777bc8c-cfdf-4264-a776-09e8df2dc13b] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:11:25.520376 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8e8aaf1d-ba3b-49d6-879f-78ab209e2889 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:25.525017 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-5ce0a904-c721-4681-b80d-a25c37d41cd2 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] HTTP exception thrown: Instance 23452b78-96cd-430d-b95c-aaa98a427d53 could not be found. Aug 10 23:11:25.529984 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8e8aaf1d-ba3b-49d6-879f-78ab209e2889 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:25.530663 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8e8aaf1d-ba3b-49d6-879f-78ab209e2889 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:25.531182 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-5ce0a904-c721-4681-b80d-a25c37d41cd2 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Request method failure captured: Aug 10 23:11:25.531182 n-d-850468-14 devstack@n-api.service[122633]: request: GET /compute/v2.1/servers/23452b78-96cd-430d-b95c-aaa98a427d53 HTTP/1.1 Aug 10 23:11:25.531182 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:11:25.531182 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:11:25.531182 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:11:25.531182 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:11:25.531182 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:11:25.531182 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:11:25.531182 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:11:25.531182 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:11:25.531182 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9DmBy_JTguncOh9GuBIMdYZxG9QUzBcwS_jXLGnjofrI-W_OX3R4Z5OuE0_icCyDrzKcQZCM5mI0mwZFV2C4_1i2WC483s7WfSWQg7_GotxoNsO0toS_K-yBXFY5hprgonzQ2ZZHnMvRhJYwAQ2SxIHPRTlL0QU-O2cMGZhSWdLxsL0 Aug 10 23:11:25.531182 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:11:25.531182 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:11:25.531182 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:11:25.531182 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:11:25.531182 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:11:25.531182 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:11:25.531182 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 597863bfebdc481188f1f30095da5396 Aug 10 23:11:25.531182 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-AttachVolumeTestJSON-1086920881 Aug 10 23:11:25.531182 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:11:25.531182 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:11:25.531182 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/597863bfebdc481188f1f30095da5396"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/597863bfebdc481188f1f30095da5396"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/597863bfebdc481188f1f30095da5396"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_597863bfebdc481188f1f30095da5396", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:11:25.531182 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-AttachVolumeTestJSON-1086920881 Aug 10 23:11:25.531182 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 597863bfebdc481188f1f30095da5396 Aug 10 23:11:25.531182 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1086920881 Aug 10 23:11:25.531182 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-AttachVolumeTestJSON-1086920881-project Aug 10 23:11:25.531182 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:11:25.531182 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:11:25.531182 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: a1986185dc9b4df4affcc421365462f7 Aug 10 23:11:25.531182 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-AttachVolumeTestJSON-1086920881-project Aug 10 23:11:25.531182 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:11:25.531182 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance 23452b78-96cd-430d-b95c-aaa98a427d53 could not be found. Aug 10 23:11:25.531182 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': '23452b78-96cd-430d-b95c-aaa98a427d53'} Aug 10 23:11:25.531182 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:11:25.531182 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:11:25.531182 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:11:25.531182 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:11:25.531182 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:11:25.531182 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:11:25.531182 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:11:25.531182 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:11:25.531182 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:11:25.531182 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:11:25.531182 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23452b78-96cd-430d-b95c-aaa98a427d53 could not be found. Aug 10 23:11:25.531182 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:11:25.531182 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:11:25.531182 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:11:25.531182 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:11:25.531182 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:11:25.531182 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:11:25.531182 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:11:25.531182 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:11:25.531182 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:11:25.531182 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:11:25.531182 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:11:25.531182 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:11:25.531182 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:11:25.531182 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:11:25.531182 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:11:25.531182 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:11:25.531182 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23452b78-96cd-430d-b95c-aaa98a427d53 could not be found. Aug 10 23:11:25.531182 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:11:25.531182 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:11:25.531182 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:11:25.537521 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:11:25.537521 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:11:25.537521 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:11:25.537521 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:11:25.537521 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:11:25.537521 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23452b78-96cd-430d-b95c-aaa98a427d53 could not be found. Aug 10 23:11:25.537521 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:11:25.537521 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-5ce0a904-c721-4681-b80d-a25c37d41cd2 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Returning 404 to user: Instance 23452b78-96cd-430d-b95c-aaa98a427d53 could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:11:25.537521 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-5ce0a904-c721-4681-b80d-a25c37d41cd2 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] 10.222.0.58 "GET /compute/v2.1/servers/23452b78-96cd-430d-b95c-aaa98a427d53" status: 404 len: 111 microversion: 2.1 time: 0.118597 Aug 10 23:11:25.537521 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1672/3240] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:11:25 2022] GET /compute/v2.1/servers/23452b78-96cd-430d-b95c-aaa98a427d53 => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:11:25.542245 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8e8aaf1d-ba3b-49d6-879f-78ab209e2889 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:25.544383 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8e8aaf1d-ba3b-49d6-879f-78ab209e2889 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:25.547062 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8e8aaf1d-ba3b-49d6-879f-78ab209e2889 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:26.236899 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-8e8aaf1d-ba3b-49d6-879f-78ab209e2889 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6160c7a42740efbe3613380933fa15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d90f8a58ad047fa8f347d6474e4d673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:11:26.252333 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-8e8aaf1d-ba3b-49d6-879f-78ab209e2889 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "GET /compute/v2.1/servers/6777bc8c-cfdf-4264-a776-09e8df2dc13b" status: 200 len: 1314 microversion: 2.1 time: 0.764830 Aug 10 23:11:26.255706 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1569/3241] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:11:25 2022] GET /compute/v2.1/servers/6777bc8c-cfdf-4264-a776-09e8df2dc13b => generated 1314 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:11:26.262286 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-adce78c6-f3c2-4cc6-9da1-56a188f38e3b tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-391207468", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:11:26.452980 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.network.neutron [None req-adce78c6-f3c2-4cc6-9da1-56a188f38e3b tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] validate_networks() for [('87bdb5bf-764d-4a2f-bcbe-1f935836fb5a', None, None, None, None, None)] {{(pid=122633) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 23:11:26.712363 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-d0a0b33f-6290-4762-8d60-ce270cd470cd req-3568c0d9-bca4-46e5-98fe-957f4a97d112 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6777bc8c-cfdf-4264-a776-09e8df2dc13b", "tag": "2e13ba2b-526a-4014-a24e-53a0e4600576"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:11:26.754251 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-d0a0b33f-6290-4762-8d60-ce270cd470cd req-3568c0d9-bca4-46e5-98fe-957f4a97d112 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:26.755512 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-d0a0b33f-6290-4762-8d60-ce270cd470cd req-3568c0d9-bca4-46e5-98fe-957f4a97d112 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:26.755970 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-d0a0b33f-6290-4762-8d60-ce270cd470cd req-3568c0d9-bca4-46e5-98fe-957f4a97d112 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:26.780604 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-d0a0b33f-6290-4762-8d60-ce270cd470cd req-3568c0d9-bca4-46e5-98fe-957f4a97d112 service nova] Creating event network-changed:2e13ba2b-526a-4014-a24e-53a0e4600576 for instance 6777bc8c-cfdf-4264-a776-09e8df2dc13b on n-h2-850468-14 Aug 10 23:11:26.849360 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-d0a0b33f-6290-4762-8d60-ce270cd470cd req-3568c0d9-bca4-46e5-98fe-957f4a97d112 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.141352 Aug 10 23:11:26.862402 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1570/3242] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:11:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 23:11:27.287119 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-a7c11282-d883-4dca-a287-c7d7a74c0756 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:11:27.287828 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-a7c11282-d883-4dca-a287-c7d7a74c0756 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: 6777bc8c-cfdf-4264-a776-09e8df2dc13b] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:11:27.303240 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a7c11282-d883-4dca-a287-c7d7a74c0756 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:27.303739 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a7c11282-d883-4dca-a287-c7d7a74c0756 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:27.304175 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a7c11282-d883-4dca-a287-c7d7a74c0756 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:27.327541 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a7c11282-d883-4dca-a287-c7d7a74c0756 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:27.328043 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a7c11282-d883-4dca-a287-c7d7a74c0756 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:27.330999 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a7c11282-d883-4dca-a287-c7d7a74c0756 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:27.642186 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-adce78c6-f3c2-4cc6-9da1-56a188f38e3b tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Flavor limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:11:27.643708 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-adce78c6-f3c2-4cc6-9da1-56a188f38e3b tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Image limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:11:27.644434 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-adce78c6-f3c2-4cc6-9da1-56a188f38e3b tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Flavor pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:11:27.645078 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-adce78c6-f3c2-4cc6-9da1-56a188f38e3b tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Image pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:11:27.645869 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-adce78c6-f3c2-4cc6-9da1-56a188f38e3b tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:11:27.676655 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-adce78c6-f3c2-4cc6-9da1-56a188f38e3b tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:27.678195 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-adce78c6-f3c2-4cc6-9da1-56a188f38e3b tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:27.679146 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-adce78c6-f3c2-4cc6-9da1-56a188f38e3b tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:27.685476 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-adce78c6-f3c2-4cc6-9da1-56a188f38e3b tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:27.686179 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-adce78c6-f3c2-4cc6-9da1-56a188f38e3b tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:27.690486 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-adce78c6-f3c2-4cc6-9da1-56a188f38e3b tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:27.773073 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-adce78c6-f3c2-4cc6-9da1-56a188f38e3b tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Getting quotas for project 6aa264849a1d4a908907421eed683fab. Resources: {'instances', 'cores', 'ram'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:11:27.790069 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-adce78c6-f3c2-4cc6-9da1-56a188f38e3b tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Getting quotas for user 2848edf3f7674fa9b8a3c408b2479f5a and project 6aa264849a1d4a908907421eed683fab. Resources: {'instances', 'cores', 'ram'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:11:27.790567 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-a7c11282-d883-4dca-a287-c7d7a74c0756 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6160c7a42740efbe3613380933fa15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d90f8a58ad047fa8f347d6474e4d673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:11:27.806140 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-a7c11282-d883-4dca-a287-c7d7a74c0756 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "GET /compute/v2.1/servers/6777bc8c-cfdf-4264-a776-09e8df2dc13b" status: 200 len: 1314 microversion: 2.1 time: 0.524693 Aug 10 23:11:27.807293 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1571/3243] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:11:27 2022] GET /compute/v2.1/servers/6777bc8c-cfdf-4264-a776-09e8df2dc13b => generated 1314 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:11:27.833150 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-adce78c6-f3c2-4cc6-9da1-56a188f38e3b tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Going to run 1 instances... {{(pid=122633) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 23:11:27.839118 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-adce78c6-f3c2-4cc6-9da1-56a188f38e3b tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] [instance: 371c934a-2685-4d6f-b385-3b86f4a542e0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78ad8905-f66f-4733-8be9-2b260f1fabed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122633) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 23:11:27.985134 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-adce78c6-f3c2-4cc6-9da1-56a188f38e3b tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.094883 Aug 10 23:11:27.985975 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1673/3244] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 23:11:25 2022] POST /compute/v2.1/servers => generated 383 bytes in 2097 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 10 23:11:28.000030 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c046e0b7-b926-4c09-9131-23a8620b3115 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:11:28.000767 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-c046e0b7-b926-4c09-9131-23a8620b3115 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] [instance: 371c934a-2685-4d6f-b385-3b86f4a542e0] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:11:28.210287 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-c046e0b7-b926-4c09-9131-23a8620b3115 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2848edf3f7674fa9b8a3c408b2479f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aa264849a1d4a908907421eed683fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:11:28.222189 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-c046e0b7-b926-4c09-9131-23a8620b3115 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] 10.222.0.58 "GET /compute/v2.1/servers/371c934a-2685-4d6f-b385-3b86f4a542e0" status: 200 len: 1213 microversion: 2.1 time: 0.225608 Aug 10 23:11:28.236788 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1572/3245] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:11:27 2022] GET /compute/v2.1/servers/371c934a-2685-4d6f-b385-3b86f4a542e0 => generated 1213 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:11:28.840288 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-ce1caf3b-a09a-40e8-8216-4ca6ae322afc tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:11:28.846214 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-ce1caf3b-a09a-40e8-8216-4ca6ae322afc tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: 6777bc8c-cfdf-4264-a776-09e8df2dc13b] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:11:28.863909 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ce1caf3b-a09a-40e8-8216-4ca6ae322afc tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:28.864416 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ce1caf3b-a09a-40e8-8216-4ca6ae322afc tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:28.864865 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ce1caf3b-a09a-40e8-8216-4ca6ae322afc tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:28.868448 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ce1caf3b-a09a-40e8-8216-4ca6ae322afc tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:28.871161 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ce1caf3b-a09a-40e8-8216-4ca6ae322afc tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:28.873358 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ce1caf3b-a09a-40e8-8216-4ca6ae322afc tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:28.895323 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:11:29.245344 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-2cc30231-eeb1-4461-a6f8-6b8092b06d37 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:11:29.245891 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-2cc30231-eeb1-4461-a6f8-6b8092b06d37 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] [instance: 371c934a-2685-4d6f-b385-3b86f4a542e0] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:11:29.267531 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2cc30231-eeb1-4461-a6f8-6b8092b06d37 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:29.268600 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2cc30231-eeb1-4461-a6f8-6b8092b06d37 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:29.269057 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2cc30231-eeb1-4461-a6f8-6b8092b06d37 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:29.269812 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2cc30231-eeb1-4461-a6f8-6b8092b06d37 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:29.274489 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2cc30231-eeb1-4461-a6f8-6b8092b06d37 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:29.275141 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2cc30231-eeb1-4461-a6f8-6b8092b06d37 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:29.282429 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-ce1caf3b-a09a-40e8-8216-4ca6ae322afc tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6160c7a42740efbe3613380933fa15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d90f8a58ad047fa8f347d6474e4d673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:11:29.336422 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-ce1caf3b-a09a-40e8-8216-4ca6ae322afc tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "GET /compute/v2.1/servers/6777bc8c-cfdf-4264-a776-09e8df2dc13b" status: 200 len: 1314 microversion: 2.1 time: 0.509004 Aug 10 23:11:29.340313 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1674/3246] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:11:28 2022] GET /compute/v2.1/servers/6777bc8c-cfdf-4264-a776-09e8df2dc13b => generated 1314 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:11:29.540039 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-2cc30231-eeb1-4461-a6f8-6b8092b06d37 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2848edf3f7674fa9b8a3c408b2479f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aa264849a1d4a908907421eed683fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:11:29.560814 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-2cc30231-eeb1-4461-a6f8-6b8092b06d37 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] 10.222.0.58 "GET /compute/v2.1/servers/371c934a-2685-4d6f-b385-3b86f4a542e0" status: 200 len: 1209 microversion: 2.1 time: 0.319845 Aug 10 23:11:29.561438 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1573/3247] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:11:29 2022] GET /compute/v2.1/servers/371c934a-2685-4d6f-b385-3b86f4a542e0 => generated 1209 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:11:30.361744 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-e559db79-c7c1-42e4-8e5f-0b82a8335150 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:11:30.362343 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-e559db79-c7c1-42e4-8e5f-0b82a8335150 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: 6777bc8c-cfdf-4264-a776-09e8df2dc13b] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:11:30.394908 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e559db79-c7c1-42e4-8e5f-0b82a8335150 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:30.396466 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e559db79-c7c1-42e4-8e5f-0b82a8335150 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:30.397423 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e559db79-c7c1-42e4-8e5f-0b82a8335150 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:30.398646 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e559db79-c7c1-42e4-8e5f-0b82a8335150 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:30.399398 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e559db79-c7c1-42e4-8e5f-0b82a8335150 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:30.400088 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e559db79-c7c1-42e4-8e5f-0b82a8335150 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:30.588528 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-47089dff-19f9-48f4-8ee9-380bbb388409 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:11:30.589815 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-47089dff-19f9-48f4-8ee9-380bbb388409 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] [instance: 371c934a-2685-4d6f-b385-3b86f4a542e0] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:11:30.602623 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-47089dff-19f9-48f4-8ee9-380bbb388409 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:30.603181 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-47089dff-19f9-48f4-8ee9-380bbb388409 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:30.603628 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-47089dff-19f9-48f4-8ee9-380bbb388409 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:30.605568 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-47089dff-19f9-48f4-8ee9-380bbb388409 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:30.606038 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-47089dff-19f9-48f4-8ee9-380bbb388409 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:30.606474 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-47089dff-19f9-48f4-8ee9-380bbb388409 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:30.680892 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-e559db79-c7c1-42e4-8e5f-0b82a8335150 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6160c7a42740efbe3613380933fa15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d90f8a58ad047fa8f347d6474e4d673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:11:30.720355 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-e559db79-c7c1-42e4-8e5f-0b82a8335150 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "GET /compute/v2.1/servers/6777bc8c-cfdf-4264-a776-09e8df2dc13b" status: 200 len: 1314 microversion: 2.1 time: 0.363704 Aug 10 23:11:30.721006 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1675/3248] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:11:30 2022] GET /compute/v2.1/servers/6777bc8c-cfdf-4264-a776-09e8df2dc13b => generated 1314 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:11:30.860649 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-47089dff-19f9-48f4-8ee9-380bbb388409 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2848edf3f7674fa9b8a3c408b2479f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aa264849a1d4a908907421eed683fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:11:30.873786 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-47089dff-19f9-48f4-8ee9-380bbb388409 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] 10.222.0.58 "GET /compute/v2.1/servers/371c934a-2685-4d6f-b385-3b86f4a542e0" status: 200 len: 1271 microversion: 2.1 time: 0.290493 Aug 10 23:11:30.887013 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1574/3249] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:11:30 2022] GET /compute/v2.1/servers/371c934a-2685-4d6f-b385-3b86f4a542e0 => generated 1271 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:11:31.747053 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-a326ca4f-8ac8-4af6-ac2b-92c420b012f9 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:11:31.747693 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-a326ca4f-8ac8-4af6-ac2b-92c420b012f9 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: 6777bc8c-cfdf-4264-a776-09e8df2dc13b] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:11:31.758480 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a326ca4f-8ac8-4af6-ac2b-92c420b012f9 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:31.761662 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a326ca4f-8ac8-4af6-ac2b-92c420b012f9 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:31.764199 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a326ca4f-8ac8-4af6-ac2b-92c420b012f9 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:31.768618 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a326ca4f-8ac8-4af6-ac2b-92c420b012f9 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:31.770635 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a326ca4f-8ac8-4af6-ac2b-92c420b012f9 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:31.772585 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a326ca4f-8ac8-4af6-ac2b-92c420b012f9 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:31.903838 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-264142a2-df3b-475e-bb5f-1d1dce8f1515 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:11:31.904471 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-264142a2-df3b-475e-bb5f-1d1dce8f1515 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] [instance: 371c934a-2685-4d6f-b385-3b86f4a542e0] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:11:31.934622 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-264142a2-df3b-475e-bb5f-1d1dce8f1515 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:31.935208 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-264142a2-df3b-475e-bb5f-1d1dce8f1515 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:31.935661 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-264142a2-df3b-475e-bb5f-1d1dce8f1515 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:31.936403 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-264142a2-df3b-475e-bb5f-1d1dce8f1515 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:31.936866 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-264142a2-df3b-475e-bb5f-1d1dce8f1515 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:31.937297 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-264142a2-df3b-475e-bb5f-1d1dce8f1515 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:32.202277 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-a326ca4f-8ac8-4af6-ac2b-92c420b012f9 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6160c7a42740efbe3613380933fa15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d90f8a58ad047fa8f347d6474e4d673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:11:32.216018 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-a326ca4f-8ac8-4af6-ac2b-92c420b012f9 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "GET /compute/v2.1/servers/6777bc8c-cfdf-4264-a776-09e8df2dc13b" status: 200 len: 1314 microversion: 2.1 time: 0.469103 Aug 10 23:11:32.217256 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1676/3250] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:11:31 2022] GET /compute/v2.1/servers/6777bc8c-cfdf-4264-a776-09e8df2dc13b => generated 1314 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:11:32.483121 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-264142a2-df3b-475e-bb5f-1d1dce8f1515 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2848edf3f7674fa9b8a3c408b2479f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aa264849a1d4a908907421eed683fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:11:32.503126 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-264142a2-df3b-475e-bb5f-1d1dce8f1515 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] 10.222.0.58 "GET /compute/v2.1/servers/371c934a-2685-4d6f-b385-3b86f4a542e0" status: 200 len: 1313 microversion: 2.1 time: 0.602864 Aug 10 23:11:32.504606 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1575/3251] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:11:31 2022] GET /compute/v2.1/servers/371c934a-2685-4d6f-b385-3b86f4a542e0 => generated 1313 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:11:33.238676 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-7826b589-9054-498a-91a2-1c27e8855d4b tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:11:33.240063 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-7826b589-9054-498a-91a2-1c27e8855d4b tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: 6777bc8c-cfdf-4264-a776-09e8df2dc13b] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:11:33.269393 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7826b589-9054-498a-91a2-1c27e8855d4b tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:33.270182 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7826b589-9054-498a-91a2-1c27e8855d4b tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:33.271434 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7826b589-9054-498a-91a2-1c27e8855d4b tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:33.273868 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7826b589-9054-498a-91a2-1c27e8855d4b tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:33.278327 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7826b589-9054-498a-91a2-1c27e8855d4b tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:33.282327 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7826b589-9054-498a-91a2-1c27e8855d4b tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:33.486526 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-8267bb1f-d2ce-4c53-a2a6-fd2a867390c4 req-eeffbf28-a73d-42cd-9f52-a18b521bb35f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6777bc8c-cfdf-4264-a776-09e8df2dc13b", "name": "network-vif-plugged", "status": "completed", "tag": "2e13ba2b-526a-4014-a24e-53a0e4600576"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:11:33.517949 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-8267bb1f-d2ce-4c53-a2a6-fd2a867390c4 req-eeffbf28-a73d-42cd-9f52-a18b521bb35f service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:33.521330 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-8267bb1f-d2ce-4c53-a2a6-fd2a867390c4 req-eeffbf28-a73d-42cd-9f52-a18b521bb35f service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:33.522083 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-8267bb1f-d2ce-4c53-a2a6-fd2a867390c4 req-eeffbf28-a73d-42cd-9f52-a18b521bb35f service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:33.558114 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-8267bb1f-d2ce-4c53-a2a6-fd2a867390c4 req-eeffbf28-a73d-42cd-9f52-a18b521bb35f service nova] Creating event network-vif-plugged:2e13ba2b-526a-4014-a24e-53a0e4600576 for instance 6777bc8c-cfdf-4264-a776-09e8df2dc13b on n-h2-850468-14 Aug 10 23:11:33.568679 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-8267bb1f-d2ce-4c53-a2a6-fd2a867390c4 req-eeffbf28-a73d-42cd-9f52-a18b521bb35f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.445398 Aug 10 23:11:33.571634 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1677/3252] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:11:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:11:33.588524 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-394a8169-b29e-4b8e-b177-1956732e6ad8 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:11:33.589743 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-394a8169-b29e-4b8e-b177-1956732e6ad8 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] [instance: 371c934a-2685-4d6f-b385-3b86f4a542e0] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:11:33.614183 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-394a8169-b29e-4b8e-b177-1956732e6ad8 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:33.616492 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-394a8169-b29e-4b8e-b177-1956732e6ad8 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:33.623204 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-394a8169-b29e-4b8e-b177-1956732e6ad8 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:33.625227 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-394a8169-b29e-4b8e-b177-1956732e6ad8 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:33.626599 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-394a8169-b29e-4b8e-b177-1956732e6ad8 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:33.627431 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-394a8169-b29e-4b8e-b177-1956732e6ad8 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:34.148760 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-394a8169-b29e-4b8e-b177-1956732e6ad8 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2848edf3f7674fa9b8a3c408b2479f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aa264849a1d4a908907421eed683fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:11:34.158914 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-394a8169-b29e-4b8e-b177-1956732e6ad8 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] 10.222.0.58 "GET /compute/v2.1/servers/371c934a-2685-4d6f-b385-3b86f4a542e0" status: 200 len: 1313 microversion: 2.1 time: 0.584334 Aug 10 23:11:34.159515 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1678/3253] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:11:33 2022] GET /compute/v2.1/servers/371c934a-2685-4d6f-b385-3b86f4a542e0 => generated 1313 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:11:34.176285 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-7830a488-9233-4421-8e00-bd7fbf2c9ee2 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:11:34.188385 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-7830a488-9233-4421-8e00-bd7fbf2c9ee2 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] [instance: 45beadf1-a6da-49ab-9098-6b681b5184c9] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:11:34.202463 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7830a488-9233-4421-8e00-bd7fbf2c9ee2 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:34.205429 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7830a488-9233-4421-8e00-bd7fbf2c9ee2 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:34.207646 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7830a488-9233-4421-8e00-bd7fbf2c9ee2 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:34.210965 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7830a488-9233-4421-8e00-bd7fbf2c9ee2 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:34.213971 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7830a488-9233-4421-8e00-bd7fbf2c9ee2 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:34.215397 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7830a488-9233-4421-8e00-bd7fbf2c9ee2 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:34.254607 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-7830a488-9233-4421-8e00-bd7fbf2c9ee2 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] HTTP exception thrown: Instance 45beadf1-a6da-49ab-9098-6b681b5184c9 could not be found. Aug 10 23:11:34.256478 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-7830a488-9233-4421-8e00-bd7fbf2c9ee2 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Request method failure captured: Aug 10 23:11:34.256478 n-d-850468-14 devstack@n-api.service[122633]: request: DELETE /compute/v2.1/servers/45beadf1-a6da-49ab-9098-6b681b5184c9 HTTP/1.1 Aug 10 23:11:34.256478 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:11:34.256478 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:11:34.256478 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:11:34.256478 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:11:34.256478 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:11:34.256478 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:11:34.256478 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:11:34.256478 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:11:34.256478 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9DmBy_JTguncOh9GuBIMdYZxG9QUzBcwS_jXLGnjofrI-W_OX3R4Z5OuE0_icCyDrzKcQZCM5mI0mwZFV2C4_1i2WC483s7WfSWQg7_GotxoNsO0toS_K-yBXFY5hprgonzQ2ZZHnMvRhJYwAQ2SxIHPRTlL0QU-O2cMGZhSWdLxsL0 Aug 10 23:11:34.256478 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:11:34.256478 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:11:34.256478 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:11:34.256478 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:11:34.256478 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:11:34.256478 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:11:34.256478 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 597863bfebdc481188f1f30095da5396 Aug 10 23:11:34.256478 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-AttachVolumeTestJSON-1086920881 Aug 10 23:11:34.256478 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:11:34.256478 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:11:34.256478 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/597863bfebdc481188f1f30095da5396"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/597863bfebdc481188f1f30095da5396"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/597863bfebdc481188f1f30095da5396"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_597863bfebdc481188f1f30095da5396", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:11:34.256478 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-AttachVolumeTestJSON-1086920881 Aug 10 23:11:34.256478 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 597863bfebdc481188f1f30095da5396 Aug 10 23:11:34.256478 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1086920881 Aug 10 23:11:34.256478 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-AttachVolumeTestJSON-1086920881-project Aug 10 23:11:34.256478 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:11:34.256478 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:11:34.256478 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: a1986185dc9b4df4affcc421365462f7 Aug 10 23:11:34.256478 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-AttachVolumeTestJSON-1086920881-project Aug 10 23:11:34.256478 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:11:34.256478 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance 45beadf1-a6da-49ab-9098-6b681b5184c9 could not be found. Aug 10 23:11:34.256478 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': '45beadf1-a6da-49ab-9098-6b681b5184c9'} Aug 10 23:11:34.256478 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:11:34.256478 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:11:34.256478 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:11:34.256478 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:11:34.256478 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:11:34.256478 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:11:34.256478 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:11:34.256478 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:11:34.256478 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:11:34.256478 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:11:34.256478 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45beadf1-a6da-49ab-9098-6b681b5184c9 could not be found. Aug 10 23:11:34.256478 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:11:34.256478 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:11:34.256478 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:11:34.256478 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:11:34.256478 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:11:34.256478 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:11:34.256478 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:11:34.256478 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:11:34.256478 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:11:34.256478 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:11:34.256478 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 23:11:34.256478 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 23:11:34.256478 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 23:11:34.256478 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 23:11:34.256478 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:11:34.256478 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:11:34.256478 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:11:34.256478 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:11:34.261362 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45beadf1-a6da-49ab-9098-6b681b5184c9 could not be found. Aug 10 23:11:34.261362 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:11:34.261362 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:11:34.261362 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:11:34.261362 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:11:34.261362 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:11:34.261362 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:11:34.261362 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:11:34.261362 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:11:34.261362 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45beadf1-a6da-49ab-9098-6b681b5184c9 could not be found. Aug 10 23:11:34.261362 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:11:34.261362 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-7830a488-9233-4421-8e00-bd7fbf2c9ee2 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Returning 404 to user: Instance 45beadf1-a6da-49ab-9098-6b681b5184c9 could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:11:34.261362 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-7830a488-9233-4421-8e00-bd7fbf2c9ee2 tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] 10.222.0.58 "DELETE /compute/v2.1/servers/45beadf1-a6da-49ab-9098-6b681b5184c9" status: 404 len: 111 microversion: 2.1 time: 0.086663 Aug 10 23:11:34.261362 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1679/3254] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:11:34 2022] DELETE /compute/v2.1/servers/45beadf1-a6da-49ab-9098-6b681b5184c9 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:11:34.270149 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-2a473b9d-32aa-4192-823a-564ac099aedb tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:11:34.270776 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-2a473b9d-32aa-4192-823a-564ac099aedb tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] [instance: 45beadf1-a6da-49ab-9098-6b681b5184c9] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:11:34.291774 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2a473b9d-32aa-4192-823a-564ac099aedb tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:34.292531 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2a473b9d-32aa-4192-823a-564ac099aedb tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:34.293162 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2a473b9d-32aa-4192-823a-564ac099aedb tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:34.294485 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2a473b9d-32aa-4192-823a-564ac099aedb tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:34.295154 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2a473b9d-32aa-4192-823a-564ac099aedb tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:34.295757 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2a473b9d-32aa-4192-823a-564ac099aedb tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:34.320035 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-2a473b9d-32aa-4192-823a-564ac099aedb tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] HTTP exception thrown: Instance 45beadf1-a6da-49ab-9098-6b681b5184c9 could not be found. Aug 10 23:11:34.322307 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-2a473b9d-32aa-4192-823a-564ac099aedb tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Request method failure captured: Aug 10 23:11:34.322307 n-d-850468-14 devstack@n-api.service[122633]: request: GET /compute/v2.1/servers/45beadf1-a6da-49ab-9098-6b681b5184c9 HTTP/1.1 Aug 10 23:11:34.322307 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:11:34.322307 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:11:34.322307 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:11:34.322307 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:11:34.322307 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:11:34.322307 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:11:34.322307 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:11:34.322307 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:11:34.322307 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9DmBy_JTguncOh9GuBIMdYZxG9QUzBcwS_jXLGnjofrI-W_OX3R4Z5OuE0_icCyDrzKcQZCM5mI0mwZFV2C4_1i2WC483s7WfSWQg7_GotxoNsO0toS_K-yBXFY5hprgonzQ2ZZHnMvRhJYwAQ2SxIHPRTlL0QU-O2cMGZhSWdLxsL0 Aug 10 23:11:34.322307 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:11:34.322307 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:11:34.322307 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:11:34.322307 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:11:34.322307 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:11:34.322307 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:11:34.322307 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 597863bfebdc481188f1f30095da5396 Aug 10 23:11:34.322307 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-AttachVolumeTestJSON-1086920881 Aug 10 23:11:34.322307 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:11:34.322307 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:11:34.322307 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/597863bfebdc481188f1f30095da5396"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/597863bfebdc481188f1f30095da5396"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/597863bfebdc481188f1f30095da5396"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_597863bfebdc481188f1f30095da5396", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:11:34.322307 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-AttachVolumeTestJSON-1086920881 Aug 10 23:11:34.322307 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 597863bfebdc481188f1f30095da5396 Aug 10 23:11:34.322307 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1086920881 Aug 10 23:11:34.322307 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-AttachVolumeTestJSON-1086920881-project Aug 10 23:11:34.322307 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:11:34.322307 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:11:34.322307 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: a1986185dc9b4df4affcc421365462f7 Aug 10 23:11:34.322307 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-AttachVolumeTestJSON-1086920881-project Aug 10 23:11:34.322307 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:11:34.322307 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance 45beadf1-a6da-49ab-9098-6b681b5184c9 could not be found. Aug 10 23:11:34.322307 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': '45beadf1-a6da-49ab-9098-6b681b5184c9'} Aug 10 23:11:34.322307 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:11:34.322307 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:11:34.322307 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:11:34.322307 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:11:34.322307 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:11:34.322307 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:11:34.322307 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:11:34.322307 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:11:34.322307 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:11:34.322307 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:11:34.322307 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45beadf1-a6da-49ab-9098-6b681b5184c9 could not be found. Aug 10 23:11:34.322307 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:11:34.322307 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:11:34.322307 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:11:34.322307 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:11:34.322307 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:11:34.322307 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:11:34.322307 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:11:34.322307 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:11:34.322307 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:11:34.322307 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:11:34.322307 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:11:34.322307 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:11:34.322307 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:11:34.322307 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:11:34.322307 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:11:34.322307 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:11:34.322307 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45beadf1-a6da-49ab-9098-6b681b5184c9 could not be found. Aug 10 23:11:34.322307 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:11:34.322307 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:11:34.322307 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:11:34.327285 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:11:34.327285 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:11:34.327285 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:11:34.327285 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:11:34.327285 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:11:34.327285 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45beadf1-a6da-49ab-9098-6b681b5184c9 could not be found. Aug 10 23:11:34.327285 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:11:34.331121 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-2a473b9d-32aa-4192-823a-564ac099aedb tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] Returning 404 to user: Instance 45beadf1-a6da-49ab-9098-6b681b5184c9 could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:11:34.331383 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-2a473b9d-32aa-4192-823a-564ac099aedb tempest-AttachVolumeTestJSON-1086920881 tempest-AttachVolumeTestJSON-1086920881-project] 10.222.0.58 "GET /compute/v2.1/servers/45beadf1-a6da-49ab-9098-6b681b5184c9" status: 404 len: 111 microversion: 2.1 time: 0.064917 Aug 10 23:11:34.331791 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1680/3255] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:11:34 2022] GET /compute/v2.1/servers/45beadf1-a6da-49ab-9098-6b681b5184c9 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:11:34.559972 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-7826b589-9054-498a-91a2-1c27e8855d4b tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6160c7a42740efbe3613380933fa15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d90f8a58ad047fa8f347d6474e4d673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:11:34.572196 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-7826b589-9054-498a-91a2-1c27e8855d4b tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "GET /compute/v2.1/servers/6777bc8c-cfdf-4264-a776-09e8df2dc13b" status: 200 len: 1314 microversion: 2.1 time: 1.338086 Aug 10 23:11:34.574048 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1576/3256] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:11:33 2022] GET /compute/v2.1/servers/6777bc8c-cfdf-4264-a776-09e8df2dc13b => generated 1314 bytes in 1340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:11:34.838293 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-110fbdbc-d10b-47e6-ae38-949829163b1a req-00ecc86b-9958-4b5e-a394-9a3a42cb117a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "371c934a-2685-4d6f-b385-3b86f4a542e0", "tag": "47d51f63-9a40-4727-83cc-8e4dd0bfc19e"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:11:34.858839 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-110fbdbc-d10b-47e6-ae38-949829163b1a req-00ecc86b-9958-4b5e-a394-9a3a42cb117a service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:34.859434 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-110fbdbc-d10b-47e6-ae38-949829163b1a req-00ecc86b-9958-4b5e-a394-9a3a42cb117a service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:34.859976 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-110fbdbc-d10b-47e6-ae38-949829163b1a req-00ecc86b-9958-4b5e-a394-9a3a42cb117a service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:34.893228 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-110fbdbc-d10b-47e6-ae38-949829163b1a req-00ecc86b-9958-4b5e-a394-9a3a42cb117a service nova] Creating event network-changed:47d51f63-9a40-4727-83cc-8e4dd0bfc19e for instance 371c934a-2685-4d6f-b385-3b86f4a542e0 on n-h1-850468-14 Aug 10 23:11:34.904256 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-110fbdbc-d10b-47e6-ae38-949829163b1a req-00ecc86b-9958-4b5e-a394-9a3a42cb117a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072284 Aug 10 23:11:34.905274 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1681/3257] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:11:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:11:35.189313 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c4f4accd-3dd5-41be-beef-6141541a918b tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:11:35.189945 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-c4f4accd-3dd5-41be-beef-6141541a918b tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] [instance: 371c934a-2685-4d6f-b385-3b86f4a542e0] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:11:35.201063 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c4f4accd-3dd5-41be-beef-6141541a918b tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:35.203563 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c4f4accd-3dd5-41be-beef-6141541a918b tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:35.204301 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c4f4accd-3dd5-41be-beef-6141541a918b tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:35.206280 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c4f4accd-3dd5-41be-beef-6141541a918b tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:35.208058 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c4f4accd-3dd5-41be-beef-6141541a918b tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:35.211813 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c4f4accd-3dd5-41be-beef-6141541a918b tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:35.586190 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-c4f4accd-3dd5-41be-beef-6141541a918b tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2848edf3f7674fa9b8a3c408b2479f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aa264849a1d4a908907421eed683fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:11:35.597209 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-694fb1d0-c6ac-44b8-917d-18550981d866 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:11:35.598396 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-694fb1d0-c6ac-44b8-917d-18550981d866 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: 6777bc8c-cfdf-4264-a776-09e8df2dc13b] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:11:35.605258 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-c4f4accd-3dd5-41be-beef-6141541a918b tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] 10.222.0.58 "GET /compute/v2.1/servers/371c934a-2685-4d6f-b385-3b86f4a542e0" status: 200 len: 1313 microversion: 2.1 time: 0.424636 Aug 10 23:11:35.613154 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-694fb1d0-c6ac-44b8-917d-18550981d866 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:35.614286 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-694fb1d0-c6ac-44b8-917d-18550981d866 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:35.616347 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-694fb1d0-c6ac-44b8-917d-18550981d866 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:35.617570 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-694fb1d0-c6ac-44b8-917d-18550981d866 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:35.618472 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-694fb1d0-c6ac-44b8-917d-18550981d866 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:35.619216 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1577/3258] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:11:35 2022] GET /compute/v2.1/servers/371c934a-2685-4d6f-b385-3b86f4a542e0 => generated 1313 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:11:35.620800 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-694fb1d0-c6ac-44b8-917d-18550981d866 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:35.992558 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-694fb1d0-c6ac-44b8-917d-18550981d866 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6160c7a42740efbe3613380933fa15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d90f8a58ad047fa8f347d6474e4d673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:11:36.005208 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-694fb1d0-c6ac-44b8-917d-18550981d866 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "GET /compute/v2.1/servers/6777bc8c-cfdf-4264-a776-09e8df2dc13b" status: 200 len: 1500 microversion: 2.1 time: 0.414445 Aug 10 23:11:36.006410 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1682/3259] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:11:35 2022] GET /compute/v2.1/servers/6777bc8c-cfdf-4264-a776-09e8df2dc13b => generated 1500 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:11:36.633249 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-7d8ade8c-2734-4ed5-997f-65a367b598bd tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:11:36.633857 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-7d8ade8c-2734-4ed5-997f-65a367b598bd tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] [instance: 371c934a-2685-4d6f-b385-3b86f4a542e0] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:11:36.647820 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7d8ade8c-2734-4ed5-997f-65a367b598bd tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:36.648316 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7d8ade8c-2734-4ed5-997f-65a367b598bd tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:36.648756 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7d8ade8c-2734-4ed5-997f-65a367b598bd tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:36.649472 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7d8ade8c-2734-4ed5-997f-65a367b598bd tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:36.649923 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7d8ade8c-2734-4ed5-997f-65a367b598bd tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:36.650342 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7d8ade8c-2734-4ed5-997f-65a367b598bd tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:36.958459 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-7d8ade8c-2734-4ed5-997f-65a367b598bd tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2848edf3f7674fa9b8a3c408b2479f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aa264849a1d4a908907421eed683fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:11:36.993203 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-7d8ade8c-2734-4ed5-997f-65a367b598bd tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] 10.222.0.58 "GET /compute/v2.1/servers/371c934a-2685-4d6f-b385-3b86f4a542e0" status: 200 len: 1313 microversion: 2.1 time: 0.363470 Aug 10 23:11:36.993680 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1578/3260] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:11:36 2022] GET /compute/v2.1/servers/371c934a-2685-4d6f-b385-3b86f4a542e0 => generated 1313 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:11:38.019666 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-730ada04-7d56-4e7e-8fd8-c9ac86103a23 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:11:38.026197 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-730ada04-7d56-4e7e-8fd8-c9ac86103a23 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] [instance: 371c934a-2685-4d6f-b385-3b86f4a542e0] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:11:38.040141 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=4 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:11:38.043200 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=12 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:11:38.063238 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-730ada04-7d56-4e7e-8fd8-c9ac86103a23 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:38.066369 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-730ada04-7d56-4e7e-8fd8-c9ac86103a23 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:38.073739 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-730ada04-7d56-4e7e-8fd8-c9ac86103a23 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:38.075421 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-730ada04-7d56-4e7e-8fd8-c9ac86103a23 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:38.076091 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-730ada04-7d56-4e7e-8fd8-c9ac86103a23 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:38.077170 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-730ada04-7d56-4e7e-8fd8-c9ac86103a23 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:38.465100 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-730ada04-7d56-4e7e-8fd8-c9ac86103a23 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2848edf3f7674fa9b8a3c408b2479f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aa264849a1d4a908907421eed683fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:11:38.474448 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-730ada04-7d56-4e7e-8fd8-c9ac86103a23 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] 10.222.0.58 "GET /compute/v2.1/servers/371c934a-2685-4d6f-b385-3b86f4a542e0" status: 200 len: 1313 microversion: 2.1 time: 0.463835 Aug 10 23:11:38.475385 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1683/3261] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:11:38 2022] GET /compute/v2.1/servers/371c934a-2685-4d6f-b385-3b86f4a542e0 => generated 1313 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:11:38.706959 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-77248235-8c06-4ba1-8788-361dfdf66545 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "758934a2-fd05-4acd-8d1f-7d76ff1fe96f"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:11:38.710923 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-77248235-8c06-4ba1-8788-361dfdf66545 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: 6777bc8c-cfdf-4264-a776-09e8df2dc13b] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:11:38.720234 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=4 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:11:38.729899 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-77248235-8c06-4ba1-8788-361dfdf66545 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:38.730753 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-77248235-8c06-4ba1-8788-361dfdf66545 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:38.731494 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-77248235-8c06-4ba1-8788-361dfdf66545 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:38.732785 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-77248235-8c06-4ba1-8788-361dfdf66545 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:38.734527 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-77248235-8c06-4ba1-8788-361dfdf66545 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:38.736840 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-77248235-8c06-4ba1-8788-361dfdf66545 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:39.191210 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-77248235-8c06-4ba1-8788-361dfdf66545 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "POST /compute/v2.1/servers/6777bc8c-cfdf-4264-a776-09e8df2dc13b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.488866 Aug 10 23:11:39.200050 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1579/3262] 10.222.0.58 () {60 vars in 1323 bytes} [Wed Aug 10 23:11:38 2022] POST /compute/v2.1/servers/6777bc8c-cfdf-4264-a776-09e8df2dc13b/os-volume_attachments => generated 194 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:11:39.501229 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-06047ff7-3f02-4c9b-b0ea-56e70c63dc81 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:11:39.502584 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-06047ff7-3f02-4c9b-b0ea-56e70c63dc81 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] [instance: 371c934a-2685-4d6f-b385-3b86f4a542e0] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:11:39.518757 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-06047ff7-3f02-4c9b-b0ea-56e70c63dc81 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:39.519893 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-06047ff7-3f02-4c9b-b0ea-56e70c63dc81 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:39.521395 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-06047ff7-3f02-4c9b-b0ea-56e70c63dc81 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:39.524444 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-06047ff7-3f02-4c9b-b0ea-56e70c63dc81 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:39.525089 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-06047ff7-3f02-4c9b-b0ea-56e70c63dc81 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:39.527348 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-06047ff7-3f02-4c9b-b0ea-56e70c63dc81 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:39.783425 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-e1db8295-1030-4743-9d82-1dc6a5c284e6 req-102ef8dd-c5d8-4aae-b65f-fd75ad1ea87a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "371c934a-2685-4d6f-b385-3b86f4a542e0", "name": "network-vif-plugged", "status": "completed", "tag": "47d51f63-9a40-4727-83cc-8e4dd0bfc19e"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:11:39.806298 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-e1db8295-1030-4743-9d82-1dc6a5c284e6 req-102ef8dd-c5d8-4aae-b65f-fd75ad1ea87a service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:39.806777 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-e1db8295-1030-4743-9d82-1dc6a5c284e6 req-102ef8dd-c5d8-4aae-b65f-fd75ad1ea87a service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:39.808848 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-e1db8295-1030-4743-9d82-1dc6a5c284e6 req-102ef8dd-c5d8-4aae-b65f-fd75ad1ea87a service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:39.831530 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-e1db8295-1030-4743-9d82-1dc6a5c284e6 req-102ef8dd-c5d8-4aae-b65f-fd75ad1ea87a service nova] Creating event network-vif-plugged:47d51f63-9a40-4727-83cc-8e4dd0bfc19e for instance 371c934a-2685-4d6f-b385-3b86f4a542e0 on n-h1-850468-14 Aug 10 23:11:39.836765 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-e1db8295-1030-4743-9d82-1dc6a5c284e6 req-102ef8dd-c5d8-4aae-b65f-fd75ad1ea87a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059362 Aug 10 23:11:39.837885 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1580/3263] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:11:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 23:11:40.212485 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-06047ff7-3f02-4c9b-b0ea-56e70c63dc81 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2848edf3f7674fa9b8a3c408b2479f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aa264849a1d4a908907421eed683fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:11:40.224268 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-06047ff7-3f02-4c9b-b0ea-56e70c63dc81 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] 10.222.0.58 "GET /compute/v2.1/servers/371c934a-2685-4d6f-b385-3b86f4a542e0" status: 200 len: 1313 microversion: 2.1 time: 0.730392 Aug 10 23:11:40.247403 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1684/3264] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:11:39 2022] GET /compute/v2.1/servers/371c934a-2685-4d6f-b385-3b86f4a542e0 => generated 1313 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:11:41.248776 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-dab3467e-eb3b-4351-991a-61f8d4935f2f tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:11:41.250507 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-dab3467e-eb3b-4351-991a-61f8d4935f2f tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] [instance: 371c934a-2685-4d6f-b385-3b86f4a542e0] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:11:41.260094 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dab3467e-eb3b-4351-991a-61f8d4935f2f tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:41.267907 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dab3467e-eb3b-4351-991a-61f8d4935f2f tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:41.268850 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dab3467e-eb3b-4351-991a-61f8d4935f2f tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:41.272915 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dab3467e-eb3b-4351-991a-61f8d4935f2f tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:41.275036 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dab3467e-eb3b-4351-991a-61f8d4935f2f tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:41.276009 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dab3467e-eb3b-4351-991a-61f8d4935f2f tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:41.852339 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-dab3467e-eb3b-4351-991a-61f8d4935f2f tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2848edf3f7674fa9b8a3c408b2479f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aa264849a1d4a908907421eed683fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:11:41.860925 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-dab3467e-eb3b-4351-991a-61f8d4935f2f tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] 10.222.0.58 "GET /compute/v2.1/servers/371c934a-2685-4d6f-b385-3b86f4a542e0" status: 200 len: 1313 microversion: 2.1 time: 0.617731 Aug 10 23:11:41.862147 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1581/3265] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:11:41 2022] GET /compute/v2.1/servers/371c934a-2685-4d6f-b385-3b86f4a542e0 => generated 1313 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:11:42.898981 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-b38e5926-f3a3-4ec2-9185-d6e97606b4f8 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:11:42.900049 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-b38e5926-f3a3-4ec2-9185-d6e97606b4f8 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] [instance: 371c934a-2685-4d6f-b385-3b86f4a542e0] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:11:42.903050 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=6 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:11:42.926316 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b38e5926-f3a3-4ec2-9185-d6e97606b4f8 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:42.927030 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b38e5926-f3a3-4ec2-9185-d6e97606b4f8 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:42.927608 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b38e5926-f3a3-4ec2-9185-d6e97606b4f8 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:42.934219 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b38e5926-f3a3-4ec2-9185-d6e97606b4f8 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:42.934838 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b38e5926-f3a3-4ec2-9185-d6e97606b4f8 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:42.935797 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b38e5926-f3a3-4ec2-9185-d6e97606b4f8 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:43.130123 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-853a234e-a973-454d-8296-6b0dfed506c9 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:11:43.134580 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-853a234e-a973-454d-8296-6b0dfed506c9 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: fa9dfd3a-a636-48ce-ae15-0ed51baee954] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:11:43.177873 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-853a234e-a973-454d-8296-6b0dfed506c9 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:43.178402 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-853a234e-a973-454d-8296-6b0dfed506c9 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:43.181678 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-853a234e-a973-454d-8296-6b0dfed506c9 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:43.184281 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-853a234e-a973-454d-8296-6b0dfed506c9 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:43.184951 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-853a234e-a973-454d-8296-6b0dfed506c9 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:43.186301 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-853a234e-a973-454d-8296-6b0dfed506c9 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:43.488888 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-b38e5926-f3a3-4ec2-9185-d6e97606b4f8 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2848edf3f7674fa9b8a3c408b2479f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aa264849a1d4a908907421eed683fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:11:43.497248 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-b38e5926-f3a3-4ec2-9185-d6e97606b4f8 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] 10.222.0.58 "GET /compute/v2.1/servers/371c934a-2685-4d6f-b385-3b86f4a542e0" status: 200 len: 1500 microversion: 2.1 time: 0.617894 Aug 10 23:11:43.498578 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1685/3266] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:11:42 2022] GET /compute/v2.1/servers/371c934a-2685-4d6f-b385-3b86f4a542e0 => generated 1500 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:11:43.506326 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-853a234e-a973-454d-8296-6b0dfed506c9 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:11:43.534956 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-853a234e-a973-454d-8296-6b0dfed506c9 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954" status: 200 len: 1667 microversion: 2.1 time: 0.420306 Aug 10 23:11:43.536258 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-880567f1-5984-4e65-ba62-b8120247c114 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:11:43.537676 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1582/3267] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:11:43 2022] GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954 => generated 1667 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:11:43.538647 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-880567f1-5984-4e65-ba62-b8120247c114 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] [instance: 371c934a-2685-4d6f-b385-3b86f4a542e0] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:11:43.556869 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-a16929c0-2008-40ab-aacf-62c0e7bb48f5 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:11:43.557772 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-a16929c0-2008-40ab-aacf-62c0e7bb48f5 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: fa9dfd3a-a636-48ce-ae15-0ed51baee954] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:11:43.564794 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a16929c0-2008-40ab-aacf-62c0e7bb48f5 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:43.565661 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a16929c0-2008-40ab-aacf-62c0e7bb48f5 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:43.566341 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a16929c0-2008-40ab-aacf-62c0e7bb48f5 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:43.567318 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a16929c0-2008-40ab-aacf-62c0e7bb48f5 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:43.567778 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-880567f1-5984-4e65-ba62-b8120247c114 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:43.568248 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a16929c0-2008-40ab-aacf-62c0e7bb48f5 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:43.568373 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-880567f1-5984-4e65-ba62-b8120247c114 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:43.568742 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-880567f1-5984-4e65-ba62-b8120247c114 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:43.569304 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a16929c0-2008-40ab-aacf-62c0e7bb48f5 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:43.569463 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-880567f1-5984-4e65-ba62-b8120247c114 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:43.576737 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-880567f1-5984-4e65-ba62-b8120247c114 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:43.579018 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-880567f1-5984-4e65-ba62-b8120247c114 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:43.622500 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.objects.instance [None req-880567f1-5984-4e65-ba62-b8120247c114 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lazy-loading 'flavor' on Instance uuid 371c934a-2685-4d6f-b385-3b86f4a542e0 {{(pid=122633) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:11:43.782924 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-880567f1-5984-4e65-ba62-b8120247c114 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] 10.222.0.58 "POST /compute/v2.1/servers/371c934a-2685-4d6f-b385-3b86f4a542e0/action" status: 200 len: 32 microversion: 2.1 time: 0.258096 Aug 10 23:11:43.788746 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1686/3268] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:11:43 2022] POST /compute/v2.1/servers/371c934a-2685-4d6f-b385-3b86f4a542e0/action => generated 32 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 23:11:43.819292 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-35d8a537-ef47-41ca-a198-818b8c2d3d35 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:11:43.822265 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-35d8a537-ef47-41ca-a198-818b8c2d3d35 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] [instance: 371c934a-2685-4d6f-b385-3b86f4a542e0] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:11:43.833892 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-35d8a537-ef47-41ca-a198-818b8c2d3d35 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:43.840250 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-35d8a537-ef47-41ca-a198-818b8c2d3d35 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:43.841530 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-35d8a537-ef47-41ca-a198-818b8c2d3d35 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:43.851034 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-35d8a537-ef47-41ca-a198-818b8c2d3d35 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:43.851798 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-35d8a537-ef47-41ca-a198-818b8c2d3d35 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:43.852454 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-35d8a537-ef47-41ca-a198-818b8c2d3d35 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:44.157237 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-a16929c0-2008-40ab-aacf-62c0e7bb48f5 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:11:44.176650 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-a16929c0-2008-40ab-aacf-62c0e7bb48f5 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954" status: 200 len: 1667 microversion: 2.1 time: 0.623741 Aug 10 23:11:44.182051 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1583/3269] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:11:43 2022] GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954 => generated 1667 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:11:44.208149 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c796ee6d-49f6-431b-b09a-95bea4bc9d83 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:11:44.214039 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-c796ee6d-49f6-431b-b09a-95bea4bc9d83 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: fa9dfd3a-a636-48ce-ae15-0ed51baee954] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:11:44.220805 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c796ee6d-49f6-431b-b09a-95bea4bc9d83 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:44.221547 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c796ee6d-49f6-431b-b09a-95bea4bc9d83 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:44.222256 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c796ee6d-49f6-431b-b09a-95bea4bc9d83 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:44.223367 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c796ee6d-49f6-431b-b09a-95bea4bc9d83 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:44.223988 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c796ee6d-49f6-431b-b09a-95bea4bc9d83 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:44.224572 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c796ee6d-49f6-431b-b09a-95bea4bc9d83 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:44.595282 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-35d8a537-ef47-41ca-a198-818b8c2d3d35 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2848edf3f7674fa9b8a3c408b2479f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aa264849a1d4a908907421eed683fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:11:44.610401 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-35d8a537-ef47-41ca-a198-818b8c2d3d35 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] 10.222.0.58 "GET /compute/v2.1/servers/371c934a-2685-4d6f-b385-3b86f4a542e0" status: 200 len: 1506 microversion: 2.1 time: 0.809220 Aug 10 23:11:44.611316 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1687/3270] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:11:43 2022] GET /compute/v2.1/servers/371c934a-2685-4d6f-b385-3b86f4a542e0 => generated 1506 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:11:44.772990 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-c796ee6d-49f6-431b-b09a-95bea4bc9d83 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:11:44.788902 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-c796ee6d-49f6-431b-b09a-95bea4bc9d83 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954" status: 200 len: 1667 microversion: 2.1 time: 0.586034 Aug 10 23:11:44.791741 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1584/3271] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:11:44 2022] GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954 => generated 1667 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:11:44.817648 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-3bef9c78-c7d8-4d61-8706-8ab3f0609996 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1571679194"}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:11:44.820124 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-3bef9c78-c7d8-4d61-8706-8ab3f0609996 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: fa9dfd3a-a636-48ce-ae15-0ed51baee954] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:11:44.844784 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3bef9c78-c7d8-4d61-8706-8ab3f0609996 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:44.845224 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3bef9c78-c7d8-4d61-8706-8ab3f0609996 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:44.845677 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3bef9c78-c7d8-4d61-8706-8ab3f0609996 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:44.846417 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3bef9c78-c7d8-4d61-8706-8ab3f0609996 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:44.846911 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3bef9c78-c7d8-4d61-8706-8ab3f0609996 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:44.847349 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3bef9c78-c7d8-4d61-8706-8ab3f0609996 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:45.392858 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-3bef9c78-c7d8-4d61-8706-8ab3f0609996 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "POST /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954/action" status: 202 len: 0 microversion: 2.1 time: 0.579295 Aug 10 23:11:45.395365 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1688/3272] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:11:44 2022] POST /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954/action => generated 0 bytes in 582 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Aug 10 23:11:45.647446 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-0b1ea94e-bbab-4fc3-b907-08cb0fd3188e tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:11:45.648784 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-0b1ea94e-bbab-4fc3-b907-08cb0fd3188e tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] [instance: 371c934a-2685-4d6f-b385-3b86f4a542e0] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:11:45.662023 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0b1ea94e-bbab-4fc3-b907-08cb0fd3188e tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:45.663582 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0b1ea94e-bbab-4fc3-b907-08cb0fd3188e tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:45.664250 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0b1ea94e-bbab-4fc3-b907-08cb0fd3188e tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:45.665448 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0b1ea94e-bbab-4fc3-b907-08cb0fd3188e tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:45.666106 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0b1ea94e-bbab-4fc3-b907-08cb0fd3188e tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:45.667691 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0b1ea94e-bbab-4fc3-b907-08cb0fd3188e tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:46.077958 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-0b1ea94e-bbab-4fc3-b907-08cb0fd3188e tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2848edf3f7674fa9b8a3c408b2479f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aa264849a1d4a908907421eed683fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:11:46.103913 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-0b1ea94e-bbab-4fc3-b907-08cb0fd3188e tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] 10.222.0.58 "GET /compute/v2.1/servers/371c934a-2685-4d6f-b385-3b86f4a542e0" status: 200 len: 1506 microversion: 2.1 time: 0.461180 Aug 10 23:11:46.104849 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1585/3273] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:11:45 2022] GET /compute/v2.1/servers/371c934a-2685-4d6f-b385-3b86f4a542e0 => generated 1506 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:11:47.127907 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-28f65976-fac0-4eba-aa56-613ffc47168b tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:11:47.128617 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-28f65976-fac0-4eba-aa56-613ffc47168b tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] [instance: 371c934a-2685-4d6f-b385-3b86f4a542e0] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:11:47.154455 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-28f65976-fac0-4eba-aa56-613ffc47168b tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:47.156299 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-28f65976-fac0-4eba-aa56-613ffc47168b tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:47.158272 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-28f65976-fac0-4eba-aa56-613ffc47168b tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:47.162097 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-28f65976-fac0-4eba-aa56-613ffc47168b tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:47.163412 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-28f65976-fac0-4eba-aa56-613ffc47168b tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:47.165556 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-28f65976-fac0-4eba-aa56-613ffc47168b tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:47.547536 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-28f65976-fac0-4eba-aa56-613ffc47168b tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2848edf3f7674fa9b8a3c408b2479f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aa264849a1d4a908907421eed683fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:11:47.564361 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-28f65976-fac0-4eba-aa56-613ffc47168b tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] 10.222.0.58 "GET /compute/v2.1/servers/371c934a-2685-4d6f-b385-3b86f4a542e0" status: 200 len: 1506 microversion: 2.1 time: 0.442221 Aug 10 23:11:47.569917 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1689/3274] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:11:47 2022] GET /compute/v2.1/servers/371c934a-2685-4d6f-b385-3b86f4a542e0 => generated 1506 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:11:48.593526 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-8a611469-41d5-4c3c-ba5d-b5291d575c6d tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:11:48.596141 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-8a611469-41d5-4c3c-ba5d-b5291d575c6d tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] [instance: 371c934a-2685-4d6f-b385-3b86f4a542e0] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:11:48.607584 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_api:SELECT=48 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:11:48.610347 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8a611469-41d5-4c3c-ba5d-b5291d575c6d tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:48.612793 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8a611469-41d5-4c3c-ba5d-b5291d575c6d tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:48.613596 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8a611469-41d5-4c3c-ba5d-b5291d575c6d tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:48.617116 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8a611469-41d5-4c3c-ba5d-b5291d575c6d tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:48.617973 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8a611469-41d5-4c3c-ba5d-b5291d575c6d tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:48.619639 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8a611469-41d5-4c3c-ba5d-b5291d575c6d tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:48.675103 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:11:49.176012 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-8a611469-41d5-4c3c-ba5d-b5291d575c6d tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2848edf3f7674fa9b8a3c408b2479f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aa264849a1d4a908907421eed683fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:11:49.198413 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-8a611469-41d5-4c3c-ba5d-b5291d575c6d tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] 10.222.0.58 "GET /compute/v2.1/servers/371c934a-2685-4d6f-b385-3b86f4a542e0" status: 200 len: 1506 microversion: 2.1 time: 0.608138 Aug 10 23:11:49.206748 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1586/3275] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:11:48 2022] GET /compute/v2.1/servers/371c934a-2685-4d6f-b385-3b86f4a542e0 => generated 1506 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:11:50.229357 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-84e287a9-7eb4-48a5-85e2-b535af833d1d tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:11:50.230318 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-84e287a9-7eb4-48a5-85e2-b535af833d1d tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] [instance: 371c934a-2685-4d6f-b385-3b86f4a542e0] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:11:50.289993 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-84e287a9-7eb4-48a5-85e2-b535af833d1d tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:50.299331 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-84e287a9-7eb4-48a5-85e2-b535af833d1d tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:50.302659 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-84e287a9-7eb4-48a5-85e2-b535af833d1d tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:50.303620 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-84e287a9-7eb4-48a5-85e2-b535af833d1d tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:50.305527 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-84e287a9-7eb4-48a5-85e2-b535af833d1d tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:50.309052 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-84e287a9-7eb4-48a5-85e2-b535af833d1d tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:50.371595 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:11:51.933887 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-394d6ac8-4ebd-4e8c-83b9-48266a2d5c70 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-1895074819", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "a368011c-f3cb-4cfc-86b5-00033ef4a50f"}], "security_groups": [{"name": "tempest-securitygroup--657612839"}], "key_name": "tempest-keypair-921357370", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "59d0cfc2-dc6c-43f6-9615-018c76246b06", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:11:52.328153 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.network.neutron [None req-394d6ac8-4ebd-4e8c-83b9-48266a2d5c70 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] validate_networks() for [('a368011c-f3cb-4cfc-86b5-00033ef4a50f', None, None, None, None, None)] {{(pid=122632) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 23:11:52.345229 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-84e287a9-7eb4-48a5-85e2-b535af833d1d tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2848edf3f7674fa9b8a3c408b2479f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aa264849a1d4a908907421eed683fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:11:52.353607 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-84e287a9-7eb4-48a5-85e2-b535af833d1d tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] 10.222.0.58 "GET /compute/v2.1/servers/371c934a-2685-4d6f-b385-3b86f4a542e0" status: 200 len: 1506 microversion: 2.1 time: 2.134393 Aug 10 23:11:52.370179 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1690/3276] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:11:50 2022] GET /compute/v2.1/servers/371c934a-2685-4d6f-b385-3b86f4a542e0 => generated 1506 bytes in 2152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:11:52.778184 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-81ff200d-9a04-4f3c-af29-caa0b06a17b8 tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:11:52.778703 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-81ff200d-9a04-4f3c-af29-caa0b06a17b8 tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] [instance: 23c5c205-bafa-414f-8c1c-d3b78eb82538] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:11:52.817046 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-81ff200d-9a04-4f3c-af29-caa0b06a17b8 tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:52.817559 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-81ff200d-9a04-4f3c-af29-caa0b06a17b8 tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:52.818016 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-81ff200d-9a04-4f3c-af29-caa0b06a17b8 tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:52.818768 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-81ff200d-9a04-4f3c-af29-caa0b06a17b8 tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:52.827679 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-81ff200d-9a04-4f3c-af29-caa0b06a17b8 tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:52.828144 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-81ff200d-9a04-4f3c-af29-caa0b06a17b8 tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:52.915022 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-81ff200d-9a04-4f3c-af29-caa0b06a17b8 tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] [instance: 23c5c205-bafa-414f-8c1c-d3b78eb82538] Going to try to terminate instance {{(pid=122633) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:11:53.051043 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-81ff200d-9a04-4f3c-af29-caa0b06a17b8 tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] 10.222.0.58 "DELETE /compute/v2.1/servers/23c5c205-bafa-414f-8c1c-d3b78eb82538" status: 204 len: 0 microversion: 2.1 time: 0.279655 Aug 10 23:11:53.053675 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1691/3277] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:11:52 2022] DELETE /compute/v2.1/servers/23c5c205-bafa-414f-8c1c-d3b78eb82538 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:11:53.100770 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-394d6ac8-4ebd-4e8c-83b9-48266a2d5c70 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Getting quotas for project 0d39cab5115d4818b73ea24cb0987a3b. Resources: dict_keys(['metadata_items']) {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:11:53.108882 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-bad6729b-cef1-4ba9-a98a-022730123248 tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:11:53.114670 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-bad6729b-cef1-4ba9-a98a-022730123248 tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] [instance: 23c5c205-bafa-414f-8c1c-d3b78eb82538] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:11:53.118458 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-394d6ac8-4ebd-4e8c-83b9-48266a2d5c70 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Getting quotas for user d879a42349cf4570aaaf88ba90492f6c and project 0d39cab5115d4818b73ea24cb0987a3b. Resources: dict_keys(['metadata_items']) {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:11:53.138466 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bad6729b-cef1-4ba9-a98a-022730123248 tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:53.140492 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bad6729b-cef1-4ba9-a98a-022730123248 tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:53.142954 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bad6729b-cef1-4ba9-a98a-022730123248 tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:53.144738 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bad6729b-cef1-4ba9-a98a-022730123248 tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:53.145293 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bad6729b-cef1-4ba9-a98a-022730123248 tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:53.148494 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bad6729b-cef1-4ba9-a98a-022730123248 tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:53.166299 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-394d6ac8-4ebd-4e8c-83b9-48266a2d5c70 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Flavor limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:11:53.168062 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-394d6ac8-4ebd-4e8c-83b9-48266a2d5c70 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Image limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:11:53.170065 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-394d6ac8-4ebd-4e8c-83b9-48266a2d5c70 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Flavor pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:11:53.171863 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-394d6ac8-4ebd-4e8c-83b9-48266a2d5c70 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Image pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:11:53.172665 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-394d6ac8-4ebd-4e8c-83b9-48266a2d5c70 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:11:53.195152 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-394d6ac8-4ebd-4e8c-83b9-48266a2d5c70 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:53.196012 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-394d6ac8-4ebd-4e8c-83b9-48266a2d5c70 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:53.198558 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-394d6ac8-4ebd-4e8c-83b9-48266a2d5c70 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:53.199574 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-394d6ac8-4ebd-4e8c-83b9-48266a2d5c70 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:53.200245 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-394d6ac8-4ebd-4e8c-83b9-48266a2d5c70 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:53.202874 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-394d6ac8-4ebd-4e8c-83b9-48266a2d5c70 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:53.274824 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-394d6ac8-4ebd-4e8c-83b9-48266a2d5c70 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Getting quotas for project 0d39cab5115d4818b73ea24cb0987a3b. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:11:53.290461 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-394d6ac8-4ebd-4e8c-83b9-48266a2d5c70 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Getting quotas for user d879a42349cf4570aaaf88ba90492f6c and project 0d39cab5115d4818b73ea24cb0987a3b. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:11:53.428643 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-394d6ac8-4ebd-4e8c-83b9-48266a2d5c70 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Going to run 1 instances... {{(pid=122632) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 23:11:53.432579 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-394d6ac8-4ebd-4e8c-83b9-48266a2d5c70 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] [instance: 20d2cf25-e240-4abb-908a-e0ea2bd6e2d6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='59d0cfc2-dc6c-43f6-9615-018c76246b06',volume_size=None,volume_type=None)] {{(pid=122632) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 23:11:53.722143 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-bad6729b-cef1-4ba9-a98a-022730123248 tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc806dca6c64050b7f0e33fdb9c109c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acff29ee63244cf901723175cbee173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:11:53.739204 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-394d6ac8-4ebd-4e8c-83b9-48266a2d5c70 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.811160 Aug 10 23:11:53.740978 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1587/3278] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 23:11:51 2022] POST /compute/v2.1/servers => generated 406 bytes in 1814 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 23:11:53.743826 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-bad6729b-cef1-4ba9-a98a-022730123248 tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] 10.222.0.58 "GET /compute/v2.1/servers/23c5c205-bafa-414f-8c1c-d3b78eb82538" status: 200 len: 1666 microversion: 2.1 time: 0.659296 Aug 10 23:11:53.744920 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1692/3279] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:11:53 2022] GET /compute/v2.1/servers/23c5c205-bafa-414f-8c1c-d3b78eb82538 => generated 1666 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:11:53.751357 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-7af9047f-e8a6-4e6f-bcbd-1e1a360d2599 req-38079afe-e3df-47fc-91e0-a1f1c7aaefb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa9dfd3a-a636-48ce-ae15-0ed51baee954", "name": "network-vif-plugged", "status": "completed", "tag": "456f7ca7-21c6-4b5d-8993-9a7c329acf12"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:11:53.762004 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-59029da2-7c1f-457e-a9e4-c039c8a951cb tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:11:53.762643 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-59029da2-7c1f-457e-a9e4-c039c8a951cb tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] [instance: 371c934a-2685-4d6f-b385-3b86f4a542e0] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:11:53.766676 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-7af9047f-e8a6-4e6f-bcbd-1e1a360d2599 req-38079afe-e3df-47fc-91e0-a1f1c7aaefb3 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:53.767449 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-7af9047f-e8a6-4e6f-bcbd-1e1a360d2599 req-38079afe-e3df-47fc-91e0-a1f1c7aaefb3 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:53.768691 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-7af9047f-e8a6-4e6f-bcbd-1e1a360d2599 req-38079afe-e3df-47fc-91e0-a1f1c7aaefb3 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:53.783726 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-59029da2-7c1f-457e-a9e4-c039c8a951cb tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:53.784513 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-59029da2-7c1f-457e-a9e4-c039c8a951cb tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:53.787039 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-59029da2-7c1f-457e-a9e4-c039c8a951cb tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:53.787316 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-7af9047f-e8a6-4e6f-bcbd-1e1a360d2599 req-38079afe-e3df-47fc-91e0-a1f1c7aaefb3 service nova] Creating event network-vif-plugged:456f7ca7-21c6-4b5d-8993-9a7c329acf12 for instance fa9dfd3a-a636-48ce-ae15-0ed51baee954 on n-h2-850468-14 Aug 10 23:11:53.788329 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-59029da2-7c1f-457e-a9e4-c039c8a951cb tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:53.790000 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-59029da2-7c1f-457e-a9e4-c039c8a951cb tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:53.791194 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-59029da2-7c1f-457e-a9e4-c039c8a951cb tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:53.809650 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-7af9047f-e8a6-4e6f-bcbd-1e1a360d2599 req-38079afe-e3df-47fc-91e0-a1f1c7aaefb3 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048594 Aug 10 23:11:53.812282 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1693/3280] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:11:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:11:53.824898 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-0378b80c-3580-4d24-9193-d3dd7266fe29 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:11:53.825461 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-0378b80c-3580-4d24-9193-d3dd7266fe29 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] [instance: 20d2cf25-e240-4abb-908a-e0ea2bd6e2d6] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:11:53.978554 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-0378b80c-3580-4d24-9193-d3dd7266fe29 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd879a42349cf4570aaaf88ba90492f6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d39cab5115d4818b73ea24cb0987a3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:11:53.996828 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-0378b80c-3580-4d24-9193-d3dd7266fe29 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] 10.222.0.58 "GET /compute/v2.1/servers/20d2cf25-e240-4abb-908a-e0ea2bd6e2d6" status: 200 len: 1121 microversion: 2.1 time: 0.182235 Aug 10 23:11:54.013921 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1694/3281] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:11:53 2022] GET /compute/v2.1/servers/20d2cf25-e240-4abb-908a-e0ea2bd6e2d6 => generated 1121 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:11:54.098208 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-59029da2-7c1f-457e-a9e4-c039c8a951cb tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2848edf3f7674fa9b8a3c408b2479f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aa264849a1d4a908907421eed683fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:11:54.118533 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-59029da2-7c1f-457e-a9e4-c039c8a951cb tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] 10.222.0.58 "GET /compute/v2.1/servers/371c934a-2685-4d6f-b385-3b86f4a542e0" status: 200 len: 1506 microversion: 2.1 time: 0.376273 Aug 10 23:11:54.119272 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1588/3282] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:11:53 2022] GET /compute/v2.1/servers/371c934a-2685-4d6f-b385-3b86f4a542e0 => generated 1506 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:11:54.768679 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-e4b643fc-b1ad-45cf-8422-ee89dddfede9 tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:11:54.769613 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-e4b643fc-b1ad-45cf-8422-ee89dddfede9 tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] [instance: 23c5c205-bafa-414f-8c1c-d3b78eb82538] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:11:54.791200 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e4b643fc-b1ad-45cf-8422-ee89dddfede9 tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:54.791904 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e4b643fc-b1ad-45cf-8422-ee89dddfede9 tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:54.801488 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e4b643fc-b1ad-45cf-8422-ee89dddfede9 tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:54.802431 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e4b643fc-b1ad-45cf-8422-ee89dddfede9 tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:54.806001 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e4b643fc-b1ad-45cf-8422-ee89dddfede9 tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:54.809346 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e4b643fc-b1ad-45cf-8422-ee89dddfede9 tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:55.023337 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-f3d06f4c-4880-4887-8108-c8f6fc16fe2b tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:11:55.024479 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-f3d06f4c-4880-4887-8108-c8f6fc16fe2b tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] [instance: 20d2cf25-e240-4abb-908a-e0ea2bd6e2d6] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:11:55.048539 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f3d06f4c-4880-4887-8108-c8f6fc16fe2b tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:55.051244 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f3d06f4c-4880-4887-8108-c8f6fc16fe2b tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:55.054821 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f3d06f4c-4880-4887-8108-c8f6fc16fe2b tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:55.056390 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f3d06f4c-4880-4887-8108-c8f6fc16fe2b tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:55.060023 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f3d06f4c-4880-4887-8108-c8f6fc16fe2b tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:55.066939 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f3d06f4c-4880-4887-8108-c8f6fc16fe2b tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:55.244899 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-e4b643fc-b1ad-45cf-8422-ee89dddfede9 tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc806dca6c64050b7f0e33fdb9c109c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acff29ee63244cf901723175cbee173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:11:55.249032 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-f3d06f4c-4880-4887-8108-c8f6fc16fe2b tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd879a42349cf4570aaaf88ba90492f6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d39cab5115d4818b73ea24cb0987a3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:11:55.258655 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-e4b643fc-b1ad-45cf-8422-ee89dddfede9 tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] 10.222.0.58 "GET /compute/v2.1/servers/23c5c205-bafa-414f-8c1c-d3b78eb82538" status: 200 len: 1666 microversion: 2.1 time: 0.495128 Aug 10 23:11:55.260235 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1695/3283] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:11:54 2022] GET /compute/v2.1/servers/23c5c205-bafa-414f-8c1c-d3b78eb82538 => generated 1666 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:11:55.279095 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-8584721b-8d47-4054-9656-d092609b0076 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:11:55.279640 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-f3d06f4c-4880-4887-8108-c8f6fc16fe2b tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] 10.222.0.58 "GET /compute/v2.1/servers/20d2cf25-e240-4abb-908a-e0ea2bd6e2d6" status: 200 len: 1163 microversion: 2.1 time: 0.261788 Aug 10 23:11:55.281277 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-8584721b-8d47-4054-9656-d092609b0076 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] [instance: 371c934a-2685-4d6f-b385-3b86f4a542e0] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:11:55.285297 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1589/3284] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:11:55 2022] GET /compute/v2.1/servers/20d2cf25-e240-4abb-908a-e0ea2bd6e2d6 => generated 1163 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:11:55.306129 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8584721b-8d47-4054-9656-d092609b0076 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:55.306629 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8584721b-8d47-4054-9656-d092609b0076 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:55.307109 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8584721b-8d47-4054-9656-d092609b0076 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:55.310129 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8584721b-8d47-4054-9656-d092609b0076 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:55.310616 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8584721b-8d47-4054-9656-d092609b0076 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:55.311093 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8584721b-8d47-4054-9656-d092609b0076 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:56.283918 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-aad7b287-a306-4e74-9bd6-0c43149edd88 tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:11:56.285100 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-aad7b287-a306-4e74-9bd6-0c43149edd88 tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] [instance: 23c5c205-bafa-414f-8c1c-d3b78eb82538] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:11:56.303714 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-aad7b287-a306-4e74-9bd6-0c43149edd88 tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:56.309742 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-aad7b287-a306-4e74-9bd6-0c43149edd88 tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:56.310964 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-aad7b287-a306-4e74-9bd6-0c43149edd88 tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:56.315029 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-aad7b287-a306-4e74-9bd6-0c43149edd88 tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:56.318193 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-aad7b287-a306-4e74-9bd6-0c43149edd88 tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:56.320465 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-aad7b287-a306-4e74-9bd6-0c43149edd88 tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:56.376798 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-8584721b-8d47-4054-9656-d092609b0076 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2848edf3f7674fa9b8a3c408b2479f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aa264849a1d4a908907421eed683fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:11:56.392405 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-8584721b-8d47-4054-9656-d092609b0076 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] 10.222.0.58 "GET /compute/v2.1/servers/371c934a-2685-4d6f-b385-3b86f4a542e0" status: 200 len: 1506 microversion: 2.1 time: 1.123554 Aug 10 23:11:56.407283 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1696/3285] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:11:55 2022] GET /compute/v2.1/servers/371c934a-2685-4d6f-b385-3b86f4a542e0 => generated 1506 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:11:56.431253 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-9fa3ff99-6089-49cc-9e88-d844c979b08c tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:11:56.435142 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-9fa3ff99-6089-49cc-9e88-d844c979b08c tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] [instance: 20d2cf25-e240-4abb-908a-e0ea2bd6e2d6] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:11:56.464131 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9fa3ff99-6089-49cc-9e88-d844c979b08c tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:56.464628 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9fa3ff99-6089-49cc-9e88-d844c979b08c tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:56.465070 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9fa3ff99-6089-49cc-9e88-d844c979b08c tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:56.471910 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9fa3ff99-6089-49cc-9e88-d844c979b08c tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:56.472412 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9fa3ff99-6089-49cc-9e88-d844c979b08c tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:56.474078 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9fa3ff99-6089-49cc-9e88-d844c979b08c tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:56.735264 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-9fa3ff99-6089-49cc-9e88-d844c979b08c tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd879a42349cf4570aaaf88ba90492f6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d39cab5115d4818b73ea24cb0987a3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:11:56.747688 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-9fa3ff99-6089-49cc-9e88-d844c979b08c tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] 10.222.0.58 "GET /compute/v2.1/servers/20d2cf25-e240-4abb-908a-e0ea2bd6e2d6" status: 200 len: 1237 microversion: 2.1 time: 0.335469 Aug 10 23:11:56.754261 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1697/3286] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:11:56 2022] GET /compute/v2.1/servers/20d2cf25-e240-4abb-908a-e0ea2bd6e2d6 => generated 1237 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:11:56.762721 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-eaff8c9d-f217-476b-9b77-9543349bc54e tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:11:56.766345 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-eaff8c9d-f217-476b-9b77-9543349bc54e tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: 6777bc8c-cfdf-4264-a776-09e8df2dc13b] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:11:56.785912 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-eaff8c9d-f217-476b-9b77-9543349bc54e tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:56.786860 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-eaff8c9d-f217-476b-9b77-9543349bc54e tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:56.794801 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-eaff8c9d-f217-476b-9b77-9543349bc54e tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:56.796012 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-eaff8c9d-f217-476b-9b77-9543349bc54e tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:56.796809 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-eaff8c9d-f217-476b-9b77-9543349bc54e tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:56.797422 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-eaff8c9d-f217-476b-9b77-9543349bc54e tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:56.825553 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-aad7b287-a306-4e74-9bd6-0c43149edd88 tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc806dca6c64050b7f0e33fdb9c109c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acff29ee63244cf901723175cbee173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:11:56.840883 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-aad7b287-a306-4e74-9bd6-0c43149edd88 tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] 10.222.0.58 "GET /compute/v2.1/servers/23c5c205-bafa-414f-8c1c-d3b78eb82538" status: 200 len: 1666 microversion: 2.1 time: 0.558792 Aug 10 23:11:56.843169 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1590/3287] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:11:56 2022] GET /compute/v2.1/servers/23c5c205-bafa-414f-8c1c-d3b78eb82538 => generated 1666 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:11:56.901895 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-eaff8c9d-f217-476b-9b77-9543349bc54e tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: 6777bc8c-cfdf-4264-a776-09e8df2dc13b] Going to try to terminate instance {{(pid=122633) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:11:57.196990 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-eaff8c9d-f217-476b-9b77-9543349bc54e tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "DELETE /compute/v2.1/servers/6777bc8c-cfdf-4264-a776-09e8df2dc13b" status: 204 len: 0 microversion: 2.1 time: 0.439755 Aug 10 23:11:57.198609 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1698/3288] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:11:56 2022] DELETE /compute/v2.1/servers/6777bc8c-cfdf-4264-a776-09e8df2dc13b => generated 0 bytes in 443 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:11:57.209148 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-f4141936-cdbd-4839-914a-66b755bce325 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:11:57.210093 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-f4141936-cdbd-4839-914a-66b755bce325 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: 6777bc8c-cfdf-4264-a776-09e8df2dc13b] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:11:57.220375 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f4141936-cdbd-4839-914a-66b755bce325 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:57.222347 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f4141936-cdbd-4839-914a-66b755bce325 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:57.225362 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f4141936-cdbd-4839-914a-66b755bce325 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:57.226308 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f4141936-cdbd-4839-914a-66b755bce325 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:57.227898 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f4141936-cdbd-4839-914a-66b755bce325 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:57.229141 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f4141936-cdbd-4839-914a-66b755bce325 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:57.414773 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-58db863c-883f-4d46-8ffa-2b59e51c7e2d tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:11:57.415708 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-58db863c-883f-4d46-8ffa-2b59e51c7e2d tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] [instance: 371c934a-2685-4d6f-b385-3b86f4a542e0] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:11:57.445231 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-58db863c-883f-4d46-8ffa-2b59e51c7e2d tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:57.445739 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-58db863c-883f-4d46-8ffa-2b59e51c7e2d tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:57.446182 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-58db863c-883f-4d46-8ffa-2b59e51c7e2d tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:57.446929 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-58db863c-883f-4d46-8ffa-2b59e51c7e2d tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:57.447386 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-58db863c-883f-4d46-8ffa-2b59e51c7e2d tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:57.447813 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-58db863c-883f-4d46-8ffa-2b59e51c7e2d tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:58.552520 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-f4141936-cdbd-4839-914a-66b755bce325 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6160c7a42740efbe3613380933fa15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d90f8a58ad047fa8f347d6474e4d673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:11:58.566740 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-f4141936-cdbd-4839-914a-66b755bce325 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "GET /compute/v2.1/servers/6777bc8c-cfdf-4264-a776-09e8df2dc13b" status: 200 len: 1552 microversion: 2.1 time: 1.362583 Aug 10 23:11:58.570968 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1591/3289] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:11:57 2022] GET /compute/v2.1/servers/6777bc8c-cfdf-4264-a776-09e8df2dc13b => generated 1552 bytes in 1367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:11:58.590137 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-9afb3be1-a8bd-4846-9992-826debc50a59 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:11:58.597307 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-9afb3be1-a8bd-4846-9992-826debc50a59 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] [instance: 20d2cf25-e240-4abb-908a-e0ea2bd6e2d6] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:11:58.620320 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9afb3be1-a8bd-4846-9992-826debc50a59 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:58.620835 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9afb3be1-a8bd-4846-9992-826debc50a59 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:58.625585 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9afb3be1-a8bd-4846-9992-826debc50a59 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:58.628936 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9afb3be1-a8bd-4846-9992-826debc50a59 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:58.631958 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9afb3be1-a8bd-4846-9992-826debc50a59 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:58.636046 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9afb3be1-a8bd-4846-9992-826debc50a59 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:58.759915 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-58db863c-883f-4d46-8ffa-2b59e51c7e2d tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2848edf3f7674fa9b8a3c408b2479f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aa264849a1d4a908907421eed683fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:11:58.781199 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-58db863c-883f-4d46-8ffa-2b59e51c7e2d tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] 10.222.0.58 "GET /compute/v2.1/servers/371c934a-2685-4d6f-b385-3b86f4a542e0" status: 200 len: 1506 microversion: 2.1 time: 1.366084 Aug 10 23:11:58.786130 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1699/3290] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:11:57 2022] GET /compute/v2.1/servers/371c934a-2685-4d6f-b385-3b86f4a542e0 => generated 1506 bytes in 1377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:11:58.802730 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-905eaf0a-1ad3-4de5-8295-aa61a1934e41 tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:11:58.803376 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-905eaf0a-1ad3-4de5-8295-aa61a1934e41 tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] [instance: 23c5c205-bafa-414f-8c1c-d3b78eb82538] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:11:58.847981 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-905eaf0a-1ad3-4de5-8295-aa61a1934e41 tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:58.848483 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-905eaf0a-1ad3-4de5-8295-aa61a1934e41 tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:58.848927 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-905eaf0a-1ad3-4de5-8295-aa61a1934e41 tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:58.854110 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-905eaf0a-1ad3-4de5-8295-aa61a1934e41 tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:58.854603 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-905eaf0a-1ad3-4de5-8295-aa61a1934e41 tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:58.856848 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-905eaf0a-1ad3-4de5-8295-aa61a1934e41 tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:58.871543 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-9afb3be1-a8bd-4846-9992-826debc50a59 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd879a42349cf4570aaaf88ba90492f6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d39cab5115d4818b73ea24cb0987a3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:11:58.888751 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-9afb3be1-a8bd-4846-9992-826debc50a59 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] 10.222.0.58 "GET /compute/v2.1/servers/20d2cf25-e240-4abb-908a-e0ea2bd6e2d6" status: 200 len: 1237 microversion: 2.1 time: 0.317185 Aug 10 23:11:58.894826 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1592/3291] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:11:58 2022] GET /compute/v2.1/servers/20d2cf25-e240-4abb-908a-e0ea2bd6e2d6 => generated 1237 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:11:59.316220 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-905eaf0a-1ad3-4de5-8295-aa61a1934e41 tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc806dca6c64050b7f0e33fdb9c109c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acff29ee63244cf901723175cbee173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:11:59.316220 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-905eaf0a-1ad3-4de5-8295-aa61a1934e41 tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] 10.222.0.58 "GET /compute/v2.1/servers/23c5c205-bafa-414f-8c1c-d3b78eb82538" status: 200 len: 1598 microversion: 2.1 time: 0.516344 Aug 10 23:11:59.316220 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1700/3292] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:11:58 2022] GET /compute/v2.1/servers/23c5c205-bafa-414f-8c1c-d3b78eb82538 => generated 1598 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:11:59.598909 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-68fcb2fe-8082-44fb-99d1-594dc9e60e96 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:11:59.600501 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-68fcb2fe-8082-44fb-99d1-594dc9e60e96 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: 6777bc8c-cfdf-4264-a776-09e8df2dc13b] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:11:59.628139 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-68fcb2fe-8082-44fb-99d1-594dc9e60e96 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:59.632146 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-68fcb2fe-8082-44fb-99d1-594dc9e60e96 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:59.635868 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-68fcb2fe-8082-44fb-99d1-594dc9e60e96 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:59.638803 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-68fcb2fe-8082-44fb-99d1-594dc9e60e96 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:59.641400 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-68fcb2fe-8082-44fb-99d1-594dc9e60e96 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:59.643229 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-68fcb2fe-8082-44fb-99d1-594dc9e60e96 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:59.809677 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-3585598d-d416-4cc3-b2bb-34e338eb2db1 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:11:59.810477 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-3585598d-d416-4cc3-b2bb-34e338eb2db1 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] [instance: 371c934a-2685-4d6f-b385-3b86f4a542e0] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:11:59.822078 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3585598d-d416-4cc3-b2bb-34e338eb2db1 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:59.824195 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3585598d-d416-4cc3-b2bb-34e338eb2db1 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:59.826014 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3585598d-d416-4cc3-b2bb-34e338eb2db1 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:11:59.827665 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3585598d-d416-4cc3-b2bb-34e338eb2db1 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:11:59.831191 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3585598d-d416-4cc3-b2bb-34e338eb2db1 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:11:59.831900 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3585598d-d416-4cc3-b2bb-34e338eb2db1 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:00.367404 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-3585598d-d416-4cc3-b2bb-34e338eb2db1 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2848edf3f7674fa9b8a3c408b2479f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aa264849a1d4a908907421eed683fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:12:00.396783 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-3585598d-d416-4cc3-b2bb-34e338eb2db1 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] 10.222.0.58 "GET /compute/v2.1/servers/371c934a-2685-4d6f-b385-3b86f4a542e0" status: 200 len: 1506 microversion: 2.1 time: 0.590076 Aug 10 23:12:00.414395 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1701/3293] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:11:59 2022] GET /compute/v2.1/servers/371c934a-2685-4d6f-b385-3b86f4a542e0 => generated 1506 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:12:00.426709 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-25754389-6c3c-4193-a89d-4bcb9c71f756 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:12:00.430226 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-25754389-6c3c-4193-a89d-4bcb9c71f756 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] [instance: 20d2cf25-e240-4abb-908a-e0ea2bd6e2d6] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:12:00.457583 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-25754389-6c3c-4193-a89d-4bcb9c71f756 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:00.462929 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-25754389-6c3c-4193-a89d-4bcb9c71f756 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:00.463675 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-25754389-6c3c-4193-a89d-4bcb9c71f756 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:00.464985 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-25754389-6c3c-4193-a89d-4bcb9c71f756 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:00.467412 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-25754389-6c3c-4193-a89d-4bcb9c71f756 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:00.468730 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-25754389-6c3c-4193-a89d-4bcb9c71f756 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:00.812581 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-68fcb2fe-8082-44fb-99d1-594dc9e60e96 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6160c7a42740efbe3613380933fa15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d90f8a58ad047fa8f347d6474e4d673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:12:00.826702 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-68fcb2fe-8082-44fb-99d1-594dc9e60e96 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "GET /compute/v2.1/servers/6777bc8c-cfdf-4264-a776-09e8df2dc13b" status: 200 len: 1552 microversion: 2.1 time: 1.238823 Aug 10 23:12:00.837032 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1593/3294] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:11:59 2022] GET /compute/v2.1/servers/6777bc8c-cfdf-4264-a776-09e8df2dc13b => generated 1552 bytes in 1250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:12:00.856622 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-09b2457c-f981-4c20-9d29-52dd57157aae tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:12:00.857694 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-09b2457c-f981-4c20-9d29-52dd57157aae tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] [instance: 23c5c205-bafa-414f-8c1c-d3b78eb82538] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:12:00.884190 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-09b2457c-f981-4c20-9d29-52dd57157aae tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:00.884688 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-09b2457c-f981-4c20-9d29-52dd57157aae tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:00.885127 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-09b2457c-f981-4c20-9d29-52dd57157aae tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:00.885843 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-09b2457c-f981-4c20-9d29-52dd57157aae tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:00.889960 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-09b2457c-f981-4c20-9d29-52dd57157aae tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:00.902138 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-09b2457c-f981-4c20-9d29-52dd57157aae tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:01.002933 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-09b2457c-f981-4c20-9d29-52dd57157aae tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:01.003758 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-09b2457c-f981-4c20-9d29-52dd57157aae tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:01.004440 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-09b2457c-f981-4c20-9d29-52dd57157aae tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:01.005152 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.objects.instance [None req-09b2457c-f981-4c20-9d29-52dd57157aae tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Lazy-loading 'fault' on Instance uuid 23c5c205-bafa-414f-8c1c-d3b78eb82538 {{(pid=122632) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:12:01.024033 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-25754389-6c3c-4193-a89d-4bcb9c71f756 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd879a42349cf4570aaaf88ba90492f6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d39cab5115d4818b73ea24cb0987a3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:12:01.037871 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-25754389-6c3c-4193-a89d-4bcb9c71f756 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] 10.222.0.58 "GET /compute/v2.1/servers/20d2cf25-e240-4abb-908a-e0ea2bd6e2d6" status: 200 len: 1304 microversion: 2.1 time: 0.621831 Aug 10 23:12:01.038476 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1702/3295] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:12:00 2022] GET /compute/v2.1/servers/20d2cf25-e240-4abb-908a-e0ea2bd6e2d6 => generated 1304 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:12:01.240126 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-09b2457c-f981-4c20-9d29-52dd57157aae tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ecc806dca6c64050b7f0e33fdb9c109c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0acff29ee63244cf901723175cbee173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:12:01.255799 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-09b2457c-f981-4c20-9d29-52dd57157aae tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] 10.222.0.58 "GET /compute/v2.1/servers/23c5c205-bafa-414f-8c1c-d3b78eb82538" status: 200 len: 1315 microversion: 2.1 time: 0.414714 Aug 10 23:12:01.257254 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1594/3296] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:12:00 2022] GET /compute/v2.1/servers/23c5c205-bafa-414f-8c1c-d3b78eb82538 => generated 1315 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:12:01.348568 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-4d13d4b2-71f3-4090-a03b-311fc159df38 req-6d03a70b-73d6-4495-953e-5e7fdae9d182 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6777bc8c-cfdf-4264-a776-09e8df2dc13b", "name": "network-vif-deleted", "tag": "2e13ba2b-526a-4014-a24e-53a0e4600576"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:12:01.383903 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-4d13d4b2-71f3-4090-a03b-311fc159df38 req-6d03a70b-73d6-4495-953e-5e7fdae9d182 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:01.387911 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-4d13d4b2-71f3-4090-a03b-311fc159df38 req-6d03a70b-73d6-4495-953e-5e7fdae9d182 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:01.388377 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-4d13d4b2-71f3-4090-a03b-311fc159df38 req-6d03a70b-73d6-4495-953e-5e7fdae9d182 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:01.453878 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-4d13d4b2-71f3-4090-a03b-311fc159df38 req-6d03a70b-73d6-4495-953e-5e7fdae9d182 service nova] Creating event network-vif-deleted:2e13ba2b-526a-4014-a24e-53a0e4600576 for instance 6777bc8c-cfdf-4264-a776-09e8df2dc13b on n-h2-850468-14 Aug 10 23:12:01.478095 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-4d13d4b2-71f3-4090-a03b-311fc159df38 req-6d03a70b-73d6-4495-953e-5e7fdae9d182 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.433430 Aug 10 23:12:01.480105 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1703/3297] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:12:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:12:01.535308 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-b96e8c2e-b0e6-4683-b21e-a5aa8aebf3fe tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:12:01.538216 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-b96e8c2e-b0e6-4683-b21e-a5aa8aebf3fe tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] [instance: 371c934a-2685-4d6f-b385-3b86f4a542e0] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:12:01.573488 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b96e8c2e-b0e6-4683-b21e-a5aa8aebf3fe tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:01.579728 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b96e8c2e-b0e6-4683-b21e-a5aa8aebf3fe tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:01.585984 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b96e8c2e-b0e6-4683-b21e-a5aa8aebf3fe tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:01.587310 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b96e8c2e-b0e6-4683-b21e-a5aa8aebf3fe tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:01.588012 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b96e8c2e-b0e6-4683-b21e-a5aa8aebf3fe tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:01.589166 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b96e8c2e-b0e6-4683-b21e-a5aa8aebf3fe tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:01.649075 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-1ca72347-46a8-4134-8a31-575deb2416f5 req-7860bfb6-e0f1-4f51-8a3f-22fae962917d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23c5c205-bafa-414f-8c1c-d3b78eb82538", "name": "network-vif-deleted", "tag": "ae1586eb-94d4-44e8-8de7-48abc323a0b2"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:12:01.666969 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-1ca72347-46a8-4134-8a31-575deb2416f5 req-7860bfb6-e0f1-4f51-8a3f-22fae962917d service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:01.667451 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-1ca72347-46a8-4134-8a31-575deb2416f5 req-7860bfb6-e0f1-4f51-8a3f-22fae962917d service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:01.667891 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-1ca72347-46a8-4134-8a31-575deb2416f5 req-7860bfb6-e0f1-4f51-8a3f-22fae962917d service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:01.708223 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-1ca72347-46a8-4134-8a31-575deb2416f5 req-7860bfb6-e0f1-4f51-8a3f-22fae962917d service nova] Creating event network-vif-deleted:ae1586eb-94d4-44e8-8de7-48abc323a0b2 for instance 23c5c205-bafa-414f-8c1c-d3b78eb82538 on n-h1-850468-14 Aug 10 23:12:01.720530 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-1ca72347-46a8-4134-8a31-575deb2416f5 req-7860bfb6-e0f1-4f51-8a3f-22fae962917d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.458197 Aug 10 23:12:01.723477 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1595/3298] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:12:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:12:01.860307 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-55f5dbfa-cc04-4490-927b-480e3b32f018 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:12:01.861811 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-55f5dbfa-cc04-4490-927b-480e3b32f018 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: 6777bc8c-cfdf-4264-a776-09e8df2dc13b] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:12:01.878423 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-55f5dbfa-cc04-4490-927b-480e3b32f018 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:01.879468 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-55f5dbfa-cc04-4490-927b-480e3b32f018 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:01.880232 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-55f5dbfa-cc04-4490-927b-480e3b32f018 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:01.882307 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-55f5dbfa-cc04-4490-927b-480e3b32f018 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:01.884069 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-55f5dbfa-cc04-4490-927b-480e3b32f018 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:01.885304 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-55f5dbfa-cc04-4490-927b-480e3b32f018 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:02.055453 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-b96e8c2e-b0e6-4683-b21e-a5aa8aebf3fe tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2848edf3f7674fa9b8a3c408b2479f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aa264849a1d4a908907421eed683fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:12:02.069334 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-b96e8c2e-b0e6-4683-b21e-a5aa8aebf3fe tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] 10.222.0.58 "GET /compute/v2.1/servers/371c934a-2685-4d6f-b385-3b86f4a542e0" status: 200 len: 1506 microversion: 2.1 time: 0.587035 Aug 10 23:12:02.070197 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1704/3299] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:12:01 2022] GET /compute/v2.1/servers/371c934a-2685-4d6f-b385-3b86f4a542e0 => generated 1506 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:12:02.088188 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-78fab0d0-33e1-4702-988e-9d954c589f88 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:12:02.089230 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-78fab0d0-33e1-4702-988e-9d954c589f88 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] [instance: 20d2cf25-e240-4abb-908a-e0ea2bd6e2d6] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:12:02.105907 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-78fab0d0-33e1-4702-988e-9d954c589f88 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:02.106657 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-78fab0d0-33e1-4702-988e-9d954c589f88 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:02.107337 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-78fab0d0-33e1-4702-988e-9d954c589f88 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:02.108702 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-78fab0d0-33e1-4702-988e-9d954c589f88 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:02.109585 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-78fab0d0-33e1-4702-988e-9d954c589f88 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:02.110549 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-78fab0d0-33e1-4702-988e-9d954c589f88 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:02.378456 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-55f5dbfa-cc04-4490-927b-480e3b32f018 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6160c7a42740efbe3613380933fa15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d90f8a58ad047fa8f347d6474e4d673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:12:02.385178 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-78fab0d0-33e1-4702-988e-9d954c589f88 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd879a42349cf4570aaaf88ba90492f6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d39cab5115d4818b73ea24cb0987a3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:12:02.389889 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:12:02.398578 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-55f5dbfa-cc04-4490-927b-480e3b32f018 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "GET /compute/v2.1/servers/6777bc8c-cfdf-4264-a776-09e8df2dc13b" status: 200 len: 1345 microversion: 2.1 time: 0.543918 Aug 10 23:12:02.401454 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1596/3300] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:12:01 2022] GET /compute/v2.1/servers/6777bc8c-cfdf-4264-a776-09e8df2dc13b => generated 1345 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:12:02.418518 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-78fab0d0-33e1-4702-988e-9d954c589f88 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] 10.222.0.58 "GET /compute/v2.1/servers/20d2cf25-e240-4abb-908a-e0ea2bd6e2d6" status: 200 len: 1304 microversion: 2.1 time: 0.346157 Aug 10 23:12:02.419738 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1705/3301] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:12:02 2022] GET /compute/v2.1/servers/20d2cf25-e240-4abb-908a-e0ea2bd6e2d6 => generated 1304 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:12:02.425858 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c2167b89-fd90-4ec4-9532-dd23f6d67083 tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:12:02.426798 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-c2167b89-fd90-4ec4-9532-dd23f6d67083 tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] [instance: 23c5c205-bafa-414f-8c1c-d3b78eb82538] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:12:02.442743 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c2167b89-fd90-4ec4-9532-dd23f6d67083 tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:02.447106 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c2167b89-fd90-4ec4-9532-dd23f6d67083 tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:02.448315 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c2167b89-fd90-4ec4-9532-dd23f6d67083 tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:02.450406 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c2167b89-fd90-4ec4-9532-dd23f6d67083 tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:02.451595 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c2167b89-fd90-4ec4-9532-dd23f6d67083 tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:02.454976 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c2167b89-fd90-4ec4-9532-dd23f6d67083 tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:02.495715 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-c2167b89-fd90-4ec4-9532-dd23f6d67083 tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] HTTP exception thrown: Instance 23c5c205-bafa-414f-8c1c-d3b78eb82538 could not be found. Aug 10 23:12:02.501157 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c2167b89-fd90-4ec4-9532-dd23f6d67083 tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Request method failure captured: Aug 10 23:12:02.501157 n-d-850468-14 devstack@n-api.service[122633]: request: GET /compute/v2.1/servers/23c5c205-bafa-414f-8c1c-d3b78eb82538 HTTP/1.1 Aug 10 23:12:02.501157 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:12:02.501157 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:12:02.501157 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:12:02.501157 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:12:02.501157 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:12:02.501157 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:12:02.501157 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:12:02.501157 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:12:02.501157 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9Dr0TW5i8EqrM0hxfmkVu0dIKHb1i7cMrhM7ofQujbKraFtvMoRJ5WfStRVt_F4y6yNWOev2yygavh9yx3RzLjfRcdmRvFVOoF83YIUM0Gh_tIjvxiR99M4DzA3hkJMtWdg3ux89RqDCkmBoQ4I-9uxHNyHatkHHx5NM6OOCFic4zKk Aug 10 23:12:02.501157 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:12:02.501157 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:12:02.501157 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:12:02.501157 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:12:02.501157 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:12:02.501157 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:12:02.501157 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 0acff29ee63244cf901723175cbee173 Aug 10 23:12:02.501157 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-ServersTestFqdnHostnames-721497674 Aug 10 23:12:02.501157 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:12:02.501157 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:12:02.501157 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0acff29ee63244cf901723175cbee173"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0acff29ee63244cf901723175cbee173"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/0acff29ee63244cf901723175cbee173"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_0acff29ee63244cf901723175cbee173", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:12:02.501157 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-ServersTestFqdnHostnames-721497674 Aug 10 23:12:02.501157 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 0acff29ee63244cf901723175cbee173 Aug 10 23:12:02.501157 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-721497674 Aug 10 23:12:02.501157 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-ServersTestFqdnHostnames-721497674-project Aug 10 23:12:02.501157 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:12:02.501157 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:12:02.501157 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: ecc806dca6c64050b7f0e33fdb9c109c Aug 10 23:12:02.501157 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-ServersTestFqdnHostnames-721497674-project Aug 10 23:12:02.501157 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:12:02.501157 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance 23c5c205-bafa-414f-8c1c-d3b78eb82538 could not be found. Aug 10 23:12:02.501157 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': '23c5c205-bafa-414f-8c1c-d3b78eb82538'} Aug 10 23:12:02.501157 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:12:02.501157 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:12:02.501157 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:12:02.501157 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:12:02.501157 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:12:02.501157 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:12:02.501157 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:12:02.501157 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:12:02.501157 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:12:02.501157 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:12:02.501157 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23c5c205-bafa-414f-8c1c-d3b78eb82538 could not be found. Aug 10 23:12:02.501157 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:12:02.501157 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:12:02.501157 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:12:02.501157 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:12:02.501157 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:12:02.501157 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:12:02.501157 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:12:02.501157 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:12:02.501157 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:12:02.501157 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:12:02.501157 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:12:02.501157 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:12:02.501157 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:12:02.501157 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:12:02.501157 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:12:02.501157 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:12:02.501157 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23c5c205-bafa-414f-8c1c-d3b78eb82538 could not be found. Aug 10 23:12:02.501157 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:12:02.501157 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:12:02.501157 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:12:02.506081 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:12:02.506081 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:12:02.506081 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:12:02.506081 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:12:02.506081 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:12:02.506081 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23c5c205-bafa-414f-8c1c-d3b78eb82538 could not be found. Aug 10 23:12:02.506081 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:12:02.508562 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c2167b89-fd90-4ec4-9532-dd23f6d67083 tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Returning 404 to user: Instance 23c5c205-bafa-414f-8c1c-d3b78eb82538 could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:12:02.512010 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-c2167b89-fd90-4ec4-9532-dd23f6d67083 tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] 10.222.0.58 "GET /compute/v2.1/servers/23c5c205-bafa-414f-8c1c-d3b78eb82538" status: 404 len: 111 microversion: 2.1 time: 0.090392 Aug 10 23:12:02.516895 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1706/3302] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:12:02 2022] GET /compute/v2.1/servers/23c5c205-bafa-414f-8c1c-d3b78eb82538 => generated 111 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:12:02.527865 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c06ab630-1ce9-48bb-8b06-252a56e1b9a8 tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] Calling method '.version_select at 0x7f847d31d820>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:12:02.574624 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-c06ab630-1ce9-48bb-8b06-252a56e1b9a8 tempest-ServersTestFqdnHostnames-721497674 tempest-ServersTestFqdnHostnames-721497674-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-565326783" status: 202 len: 0 microversion: 2.1 time: 0.053318 Aug 10 23:12:02.575563 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1707/3303] 10.222.0.58 () {58 vars in 1218 bytes} [Wed Aug 10 23:12:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-565326783 => generated 0 bytes in 55 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 10 23:12:03.094557 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-5e4f434c-e4f7-44f0-a836-890077d598dc tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:12:03.095988 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-5e4f434c-e4f7-44f0-a836-890077d598dc tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] [instance: 371c934a-2685-4d6f-b385-3b86f4a542e0] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:12:03.108802 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-4a4a3e5d-3c61-4c83-950f-4520b30ea1f5 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Action: 'create', calling method: .version_select at 0x7f847d055b80>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-154155458", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHib198ULzUWyB/As/lj7pQnXLXYmPgrQq1g3a/7++OpkR1DquWJuk4oBKXw4DgZgRqKoOSJ/qGjkBexBtN9JVgAMCLFIBsOs1MgBy/CbJqobyLoCUO9TnsWYbrqDF0jbw=="}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:12:03.113455 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5e4f434c-e4f7-44f0-a836-890077d598dc tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:03.115019 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5e4f434c-e4f7-44f0-a836-890077d598dc tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:03.115487 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5e4f434c-e4f7-44f0-a836-890077d598dc tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:03.116280 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5e4f434c-e4f7-44f0-a836-890077d598dc tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:03.116751 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5e4f434c-e4f7-44f0-a836-890077d598dc tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:03.119715 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5e4f434c-e4f7-44f0-a836-890077d598dc tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:03.157208 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-4a4a3e5d-3c61-4c83-950f-4520b30ea1f5 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Getting quotas for project 25abd63376614081a9d484f3c9ae950d. Resources: {'key_pairs'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:12:03.734116 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=2 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:12:03.740452 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-4a4a3e5d-3c61-4c83-950f-4520b30ea1f5 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Getting quotas for user 5899b2ad9f1046caaf7c6073e408eeee and project 25abd63376614081a9d484f3c9ae950d. Resources: {'key_pairs'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:12:03.798832 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-4a4a3e5d-3c61-4c83-950f-4520b30ea1f5 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 1.394758 Aug 10 23:12:03.800974 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1597/3304] 10.222.0.58 () {60 vars in 1159 bytes} [Wed Aug 10 23:12:02 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 1399 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:12:03.812015 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-f0f40230-4473-4a35-bc90-ae97a554ab51 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:12:03.814697 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-f0f40230-4473-4a35-bc90-ae97a554ab51 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: 6777bc8c-cfdf-4264-a776-09e8df2dc13b] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:12:03.829083 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f0f40230-4473-4a35-bc90-ae97a554ab51 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:03.831889 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f0f40230-4473-4a35-bc90-ae97a554ab51 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:03.832355 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f0f40230-4473-4a35-bc90-ae97a554ab51 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:03.833092 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f0f40230-4473-4a35-bc90-ae97a554ab51 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:03.834679 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f0f40230-4473-4a35-bc90-ae97a554ab51 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:03.835936 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f0f40230-4473-4a35-bc90-ae97a554ab51 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:03.877779 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-5e4f434c-e4f7-44f0-a836-890077d598dc tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2848edf3f7674fa9b8a3c408b2479f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aa264849a1d4a908907421eed683fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:12:03.891125 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-5e4f434c-e4f7-44f0-a836-890077d598dc tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] 10.222.0.58 "GET /compute/v2.1/servers/371c934a-2685-4d6f-b385-3b86f4a542e0" status: 200 len: 1506 microversion: 2.1 time: 0.802299 Aug 10 23:12:03.892311 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1708/3305] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:12:03 2022] GET /compute/v2.1/servers/371c934a-2685-4d6f-b385-3b86f4a542e0 => generated 1506 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:12:03.902004 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-d349d34d-ca90-492b-9672-aa6e50520683 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:12:03.903460 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-d349d34d-ca90-492b-9672-aa6e50520683 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] [instance: 20d2cf25-e240-4abb-908a-e0ea2bd6e2d6] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:12:03.924553 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d349d34d-ca90-492b-9672-aa6e50520683 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:03.925334 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d349d34d-ca90-492b-9672-aa6e50520683 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:03.927697 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d349d34d-ca90-492b-9672-aa6e50520683 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:03.928678 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d349d34d-ca90-492b-9672-aa6e50520683 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:03.931694 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d349d34d-ca90-492b-9672-aa6e50520683 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:03.933071 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d349d34d-ca90-492b-9672-aa6e50520683 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:03.992338 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=2 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:12:04.176793 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-f0f40230-4473-4a35-bc90-ae97a554ab51 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6160c7a42740efbe3613380933fa15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d90f8a58ad047fa8f347d6474e4d673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:12:04.188038 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-f0f40230-4473-4a35-bc90-ae97a554ab51 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "GET /compute/v2.1/servers/6777bc8c-cfdf-4264-a776-09e8df2dc13b" status: 200 len: 1345 microversion: 2.1 time: 0.384742 Aug 10 23:12:04.202842 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1598/3306] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:12:03 2022] GET /compute/v2.1/servers/6777bc8c-cfdf-4264-a776-09e8df2dc13b => generated 1345 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:12:04.203496 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-07a83cd1-eed9-49d1-91ab-3f53c4ca3dce req-1f15067b-2fcb-4239-a8bc-1f279fbce01a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20d2cf25-e240-4abb-908a-e0ea2bd6e2d6", "tag": "7b0dfe00-d481-425c-97c7-1a83e3dc3589"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:12:04.216508 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-d349d34d-ca90-492b-9672-aa6e50520683 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd879a42349cf4570aaaf88ba90492f6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d39cab5115d4818b73ea24cb0987a3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:12:04.226198 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-d349d34d-ca90-492b-9672-aa6e50520683 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] 10.222.0.58 "GET /compute/v2.1/servers/20d2cf25-e240-4abb-908a-e0ea2bd6e2d6" status: 200 len: 1304 microversion: 2.1 time: 0.332283 Aug 10 23:12:04.230410 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1709/3307] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:12:03 2022] GET /compute/v2.1/servers/20d2cf25-e240-4abb-908a-e0ea2bd6e2d6 => generated 1304 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:12:04.236146 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-07a83cd1-eed9-49d1-91ab-3f53c4ca3dce req-1f15067b-2fcb-4239-a8bc-1f279fbce01a service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:04.241474 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-07a83cd1-eed9-49d1-91ab-3f53c4ca3dce req-1f15067b-2fcb-4239-a8bc-1f279fbce01a service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:04.242121 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-07a83cd1-eed9-49d1-91ab-3f53c4ca3dce req-1f15067b-2fcb-4239-a8bc-1f279fbce01a service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:04.261614 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-07a83cd1-eed9-49d1-91ab-3f53c4ca3dce req-1f15067b-2fcb-4239-a8bc-1f279fbce01a service nova] Creating event network-changed:7b0dfe00-d481-425c-97c7-1a83e3dc3589 for instance 20d2cf25-e240-4abb-908a-e0ea2bd6e2d6 on n-h2-850468-14 Aug 10 23:12:04.271743 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-07a83cd1-eed9-49d1-91ab-3f53c4ca3dce req-1f15067b-2fcb-4239-a8bc-1f279fbce01a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077668 Aug 10 23:12:04.272355 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1599/3308] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:12:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:12:04.913913 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-48204d25-ed92-47b5-b90b-32c45a748939 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:12:04.914751 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-48204d25-ed92-47b5-b90b-32c45a748939 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] [instance: 371c934a-2685-4d6f-b385-3b86f4a542e0] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:12:04.926927 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-48204d25-ed92-47b5-b90b-32c45a748939 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:04.927577 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-48204d25-ed92-47b5-b90b-32c45a748939 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:04.928135 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-48204d25-ed92-47b5-b90b-32c45a748939 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:04.928968 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-48204d25-ed92-47b5-b90b-32c45a748939 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:04.930030 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-48204d25-ed92-47b5-b90b-32c45a748939 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:04.930747 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-48204d25-ed92-47b5-b90b-32c45a748939 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:05.215552 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-17de8790-47e5-4c36-b2a7-ab4c85f2f3a7 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:12:05.216180 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-17de8790-47e5-4c36-b2a7-ab4c85f2f3a7 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: 6777bc8c-cfdf-4264-a776-09e8df2dc13b] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:12:05.238373 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-17de8790-47e5-4c36-b2a7-ab4c85f2f3a7 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:05.239226 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-17de8790-47e5-4c36-b2a7-ab4c85f2f3a7 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:05.239832 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-17de8790-47e5-4c36-b2a7-ab4c85f2f3a7 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:05.240721 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-17de8790-47e5-4c36-b2a7-ab4c85f2f3a7 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:05.241345 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-17de8790-47e5-4c36-b2a7-ab4c85f2f3a7 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:05.241958 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-17de8790-47e5-4c36-b2a7-ab4c85f2f3a7 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:05.554359 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-17de8790-47e5-4c36-b2a7-ab4c85f2f3a7 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6160c7a42740efbe3613380933fa15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d90f8a58ad047fa8f347d6474e4d673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:12:05.564104 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-17de8790-47e5-4c36-b2a7-ab4c85f2f3a7 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "GET /compute/v2.1/servers/6777bc8c-cfdf-4264-a776-09e8df2dc13b" status: 200 len: 1345 microversion: 2.1 time: 0.353439 Aug 10 23:12:05.568367 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-48204d25-ed92-47b5-b90b-32c45a748939 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2848edf3f7674fa9b8a3c408b2479f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aa264849a1d4a908907421eed683fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:12:05.579098 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1600/3309] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:12:05 2022] GET /compute/v2.1/servers/6777bc8c-cfdf-4264-a776-09e8df2dc13b => generated 1345 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:12:05.583440 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-48204d25-ed92-47b5-b90b-32c45a748939 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] 10.222.0.58 "GET /compute/v2.1/servers/371c934a-2685-4d6f-b385-3b86f4a542e0" status: 200 len: 1506 microversion: 2.1 time: 0.674806 Aug 10 23:12:05.585396 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-97f9ca0b-2ea3-44c2-93d5-db25eb2c330d tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:12:05.586188 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-97f9ca0b-2ea3-44c2-93d5-db25eb2c330d tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] [instance: 20d2cf25-e240-4abb-908a-e0ea2bd6e2d6] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:12:05.589312 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1710/3310] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:12:04 2022] GET /compute/v2.1/servers/371c934a-2685-4d6f-b385-3b86f4a542e0 => generated 1506 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:12:05.613999 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-97f9ca0b-2ea3-44c2-93d5-db25eb2c330d tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:05.615054 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-97f9ca0b-2ea3-44c2-93d5-db25eb2c330d tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:05.615824 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-97f9ca0b-2ea3-44c2-93d5-db25eb2c330d tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:05.616941 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-97f9ca0b-2ea3-44c2-93d5-db25eb2c330d tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:05.618624 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-97f9ca0b-2ea3-44c2-93d5-db25eb2c330d tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:05.619416 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-97f9ca0b-2ea3-44c2-93d5-db25eb2c330d tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:06.285988 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-97f9ca0b-2ea3-44c2-93d5-db25eb2c330d tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd879a42349cf4570aaaf88ba90492f6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d39cab5115d4818b73ea24cb0987a3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:12:06.298519 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-97f9ca0b-2ea3-44c2-93d5-db25eb2c330d tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] 10.222.0.58 "GET /compute/v2.1/servers/20d2cf25-e240-4abb-908a-e0ea2bd6e2d6" status: 200 len: 1304 microversion: 2.1 time: 0.716698 Aug 10 23:12:06.299451 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1601/3311] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:12:05 2022] GET /compute/v2.1/servers/20d2cf25-e240-4abb-908a-e0ea2bd6e2d6 => generated 1304 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:12:06.585815 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-a84ea437-8bf4-41b4-8ae5-5fa4fc5b44ee tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:12:06.587949 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-a84ea437-8bf4-41b4-8ae5-5fa4fc5b44ee tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: 6777bc8c-cfdf-4264-a776-09e8df2dc13b] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:12:06.602646 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a84ea437-8bf4-41b4-8ae5-5fa4fc5b44ee tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:06.603556 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a84ea437-8bf4-41b4-8ae5-5fa4fc5b44ee tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:06.613265 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-72a3ef22-6950-4631-b6b1-7b71b2813531 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:12:06.619958 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-72a3ef22-6950-4631-b6b1-7b71b2813531 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] [instance: 371c934a-2685-4d6f-b385-3b86f4a542e0] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:12:06.630311 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a84ea437-8bf4-41b4-8ae5-5fa4fc5b44ee tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:06.631927 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a84ea437-8bf4-41b4-8ae5-5fa4fc5b44ee tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:06.636614 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a84ea437-8bf4-41b4-8ae5-5fa4fc5b44ee tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:06.642664 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a84ea437-8bf4-41b4-8ae5-5fa4fc5b44ee tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:06.643536 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-72a3ef22-6950-4631-b6b1-7b71b2813531 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:06.647675 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-72a3ef22-6950-4631-b6b1-7b71b2813531 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:06.651012 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-72a3ef22-6950-4631-b6b1-7b71b2813531 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:06.652760 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-72a3ef22-6950-4631-b6b1-7b71b2813531 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:06.655171 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-72a3ef22-6950-4631-b6b1-7b71b2813531 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:06.659872 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-72a3ef22-6950-4631-b6b1-7b71b2813531 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:06.836263 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-a84ea437-8bf4-41b4-8ae5-5fa4fc5b44ee tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6160c7a42740efbe3613380933fa15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d90f8a58ad047fa8f347d6474e4d673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:12:06.849549 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-a84ea437-8bf4-41b4-8ae5-5fa4fc5b44ee tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "GET /compute/v2.1/servers/6777bc8c-cfdf-4264-a776-09e8df2dc13b" status: 200 len: 1345 microversion: 2.1 time: 0.268223 Aug 10 23:12:06.852093 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1711/3312] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:12:06 2022] GET /compute/v2.1/servers/6777bc8c-cfdf-4264-a776-09e8df2dc13b => generated 1345 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:12:07.322668 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-4ed31e97-b670-4488-83c4-08b1e94e8668 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:12:07.323523 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-4ed31e97-b670-4488-83c4-08b1e94e8668 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] [instance: 20d2cf25-e240-4abb-908a-e0ea2bd6e2d6] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:12:07.332588 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4ed31e97-b670-4488-83c4-08b1e94e8668 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:07.335233 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4ed31e97-b670-4488-83c4-08b1e94e8668 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:07.335775 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4ed31e97-b670-4488-83c4-08b1e94e8668 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:07.337568 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4ed31e97-b670-4488-83c4-08b1e94e8668 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:07.341543 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4ed31e97-b670-4488-83c4-08b1e94e8668 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:07.343042 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4ed31e97-b670-4488-83c4-08b1e94e8668 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:07.570767 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-72a3ef22-6950-4631-b6b1-7b71b2813531 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2848edf3f7674fa9b8a3c408b2479f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aa264849a1d4a908907421eed683fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:12:07.585640 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-72a3ef22-6950-4631-b6b1-7b71b2813531 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] 10.222.0.58 "GET /compute/v2.1/servers/371c934a-2685-4d6f-b385-3b86f4a542e0" status: 200 len: 1506 microversion: 2.1 time: 0.976148 Aug 10 23:12:07.600869 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1602/3313] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:12:06 2022] GET /compute/v2.1/servers/371c934a-2685-4d6f-b385-3b86f4a542e0 => generated 1506 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:12:07.850877 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-4ed31e97-b670-4488-83c4-08b1e94e8668 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd879a42349cf4570aaaf88ba90492f6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d39cab5115d4818b73ea24cb0987a3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:12:07.868760 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-4ed31e97-b670-4488-83c4-08b1e94e8668 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] 10.222.0.58 "GET /compute/v2.1/servers/20d2cf25-e240-4abb-908a-e0ea2bd6e2d6" status: 200 len: 1304 microversion: 2.1 time: 0.548530 Aug 10 23:12:07.899128 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-9ca05d5b-8308-4252-af93-12d3ea57a7cd tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:12:07.901461 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-9ca05d5b-8308-4252-af93-12d3ea57a7cd tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: 6777bc8c-cfdf-4264-a776-09e8df2dc13b] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:12:07.911603 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1712/3314] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:12:07 2022] GET /compute/v2.1/servers/20d2cf25-e240-4abb-908a-e0ea2bd6e2d6 => generated 1304 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:12:07.925136 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9ca05d5b-8308-4252-af93-12d3ea57a7cd tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:07.925644 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9ca05d5b-8308-4252-af93-12d3ea57a7cd tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:07.926095 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9ca05d5b-8308-4252-af93-12d3ea57a7cd tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:07.926859 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9ca05d5b-8308-4252-af93-12d3ea57a7cd tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:07.982156 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9ca05d5b-8308-4252-af93-12d3ea57a7cd tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:07.985965 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9ca05d5b-8308-4252-af93-12d3ea57a7cd tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.055s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:08.269100 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-9ca05d5b-8308-4252-af93-12d3ea57a7cd tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6160c7a42740efbe3613380933fa15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d90f8a58ad047fa8f347d6474e4d673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:12:08.287843 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-9ca05d5b-8308-4252-af93-12d3ea57a7cd tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "GET /compute/v2.1/servers/6777bc8c-cfdf-4264-a776-09e8df2dc13b" status: 200 len: 1345 microversion: 2.1 time: 0.410864 Aug 10 23:12:08.291342 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1603/3315] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:12:07 2022] GET /compute/v2.1/servers/6777bc8c-cfdf-4264-a776-09e8df2dc13b => generated 1345 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:12:08.613620 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-4ee7fe80-ab71-4c87-ab5a-51081226dadf tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:12:08.616122 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-4ee7fe80-ab71-4c87-ab5a-51081226dadf tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] [instance: 371c934a-2685-4d6f-b385-3b86f4a542e0] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:12:08.629977 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4ee7fe80-ab71-4c87-ab5a-51081226dadf tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:08.631745 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4ee7fe80-ab71-4c87-ab5a-51081226dadf tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:08.632100 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4ee7fe80-ab71-4c87-ab5a-51081226dadf tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:08.633315 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4ee7fe80-ab71-4c87-ab5a-51081226dadf tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:08.634048 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4ee7fe80-ab71-4c87-ab5a-51081226dadf tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:08.634838 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4ee7fe80-ab71-4c87-ab5a-51081226dadf tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:08.899858 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-5cdbd11a-2410-4fa7-b625-1a7a48a88689 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:12:08.909948 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-5cdbd11a-2410-4fa7-b625-1a7a48a88689 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] [instance: 20d2cf25-e240-4abb-908a-e0ea2bd6e2d6] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:12:08.940723 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5cdbd11a-2410-4fa7-b625-1a7a48a88689 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:08.941690 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5cdbd11a-2410-4fa7-b625-1a7a48a88689 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:08.943951 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5cdbd11a-2410-4fa7-b625-1a7a48a88689 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:08.947159 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5cdbd11a-2410-4fa7-b625-1a7a48a88689 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:08.948575 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5cdbd11a-2410-4fa7-b625-1a7a48a88689 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:08.950773 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5cdbd11a-2410-4fa7-b625-1a7a48a88689 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:09.206618 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-4ee7fe80-ab71-4c87-ab5a-51081226dadf tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2848edf3f7674fa9b8a3c408b2479f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aa264849a1d4a908907421eed683fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:12:09.221770 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-4ee7fe80-ab71-4c87-ab5a-51081226dadf tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] 10.222.0.58 "GET /compute/v2.1/servers/371c934a-2685-4d6f-b385-3b86f4a542e0" status: 200 len: 1506 microversion: 2.1 time: 0.615620 Aug 10 23:12:09.240471 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1713/3316] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:12:08 2022] GET /compute/v2.1/servers/371c934a-2685-4d6f-b385-3b86f4a542e0 => generated 1506 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:12:09.316365 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-63c0803e-014d-4a40-9b01-ed957d7030fb tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:12:09.317479 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-63c0803e-014d-4a40-9b01-ed957d7030fb tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: 6777bc8c-cfdf-4264-a776-09e8df2dc13b] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:12:09.337806 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-63c0803e-014d-4a40-9b01-ed957d7030fb tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:09.339854 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-63c0803e-014d-4a40-9b01-ed957d7030fb tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:09.343992 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-63c0803e-014d-4a40-9b01-ed957d7030fb tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:09.346860 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-63c0803e-014d-4a40-9b01-ed957d7030fb tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:09.347594 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-63c0803e-014d-4a40-9b01-ed957d7030fb tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:09.348751 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-63c0803e-014d-4a40-9b01-ed957d7030fb tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:09.731267 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-63c0803e-014d-4a40-9b01-ed957d7030fb tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6160c7a42740efbe3613380933fa15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d90f8a58ad047fa8f347d6474e4d673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:12:09.746407 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-63c0803e-014d-4a40-9b01-ed957d7030fb tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "GET /compute/v2.1/servers/6777bc8c-cfdf-4264-a776-09e8df2dc13b" status: 200 len: 1345 microversion: 2.1 time: 0.434830 Aug 10 23:12:09.750396 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1714/3317] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:12:09 2022] GET /compute/v2.1/servers/6777bc8c-cfdf-4264-a776-09e8df2dc13b => generated 1345 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:12:09.924891 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-5cdbd11a-2410-4fa7-b625-1a7a48a88689 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd879a42349cf4570aaaf88ba90492f6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d39cab5115d4818b73ea24cb0987a3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:12:09.938658 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-5cdbd11a-2410-4fa7-b625-1a7a48a88689 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] 10.222.0.58 "GET /compute/v2.1/servers/20d2cf25-e240-4abb-908a-e0ea2bd6e2d6" status: 200 len: 1304 microversion: 2.1 time: 1.046402 Aug 10 23:12:09.944474 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1604/3318] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:12:08 2022] GET /compute/v2.1/servers/20d2cf25-e240-4abb-908a-e0ea2bd6e2d6 => generated 1304 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:12:10.249407 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-1d8b7263-e3f0-4220-99d0-fd011278646c tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:12:10.250434 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-1d8b7263-e3f0-4220-99d0-fd011278646c tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] [instance: 371c934a-2685-4d6f-b385-3b86f4a542e0] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:12:10.270461 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1d8b7263-e3f0-4220-99d0-fd011278646c tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:10.273006 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1d8b7263-e3f0-4220-99d0-fd011278646c tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:10.273886 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1d8b7263-e3f0-4220-99d0-fd011278646c tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:10.275975 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1d8b7263-e3f0-4220-99d0-fd011278646c tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:10.277928 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1d8b7263-e3f0-4220-99d0-fd011278646c tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:10.283302 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1d8b7263-e3f0-4220-99d0-fd011278646c tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:10.771836 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-66f1f470-ac64-4096-8dab-1475c48635ff tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:12:10.772740 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-66f1f470-ac64-4096-8dab-1475c48635ff tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: 6777bc8c-cfdf-4264-a776-09e8df2dc13b] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:12:10.800544 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-66f1f470-ac64-4096-8dab-1475c48635ff tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:10.802306 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-66f1f470-ac64-4096-8dab-1475c48635ff tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:10.803359 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-66f1f470-ac64-4096-8dab-1475c48635ff tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:10.807740 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-66f1f470-ac64-4096-8dab-1475c48635ff tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:10.808442 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-66f1f470-ac64-4096-8dab-1475c48635ff tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:10.809068 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-66f1f470-ac64-4096-8dab-1475c48635ff tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:10.831137 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-1d8b7263-e3f0-4220-99d0-fd011278646c tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2848edf3f7674fa9b8a3c408b2479f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aa264849a1d4a908907421eed683fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:12:10.847698 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-1d8b7263-e3f0-4220-99d0-fd011278646c tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] 10.222.0.58 "GET /compute/v2.1/servers/371c934a-2685-4d6f-b385-3b86f4a542e0" status: 200 len: 1506 microversion: 2.1 time: 0.603322 Aug 10 23:12:10.849517 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1715/3319] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:12:10 2022] GET /compute/v2.1/servers/371c934a-2685-4d6f-b385-3b86f4a542e0 => generated 1506 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:12:10.966713 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-d537c245-2eee-426c-8587-10fbf3cf60ba tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:12:10.968314 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-d537c245-2eee-426c-8587-10fbf3cf60ba tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] [instance: 20d2cf25-e240-4abb-908a-e0ea2bd6e2d6] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:12:10.986826 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d537c245-2eee-426c-8587-10fbf3cf60ba tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:10.987343 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d537c245-2eee-426c-8587-10fbf3cf60ba tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:10.987798 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d537c245-2eee-426c-8587-10fbf3cf60ba tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:10.992954 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d537c245-2eee-426c-8587-10fbf3cf60ba tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:11.001859 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d537c245-2eee-426c-8587-10fbf3cf60ba tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:11.002590 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d537c245-2eee-426c-8587-10fbf3cf60ba tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:11.091247 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-66f1f470-ac64-4096-8dab-1475c48635ff tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6160c7a42740efbe3613380933fa15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d90f8a58ad047fa8f347d6474e4d673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:12:11.093697 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=100 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:12:11.114499 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-66f1f470-ac64-4096-8dab-1475c48635ff tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "GET /compute/v2.1/servers/6777bc8c-cfdf-4264-a776-09e8df2dc13b" status: 200 len: 1345 microversion: 2.1 time: 0.348899 Aug 10 23:12:11.120810 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1605/3320] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:12:10 2022] GET /compute/v2.1/servers/6777bc8c-cfdf-4264-a776-09e8df2dc13b => generated 1345 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:12:11.543584 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-d537c245-2eee-426c-8587-10fbf3cf60ba tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd879a42349cf4570aaaf88ba90492f6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d39cab5115d4818b73ea24cb0987a3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:12:11.554549 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-d537c245-2eee-426c-8587-10fbf3cf60ba tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] 10.222.0.58 "GET /compute/v2.1/servers/20d2cf25-e240-4abb-908a-e0ea2bd6e2d6" status: 200 len: 1304 microversion: 2.1 time: 0.592627 Aug 10 23:12:11.556814 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1716/3321] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:12:10 2022] GET /compute/v2.1/servers/20d2cf25-e240-4abb-908a-e0ea2bd6e2d6 => generated 1304 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:12:11.874144 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-3d263d9b-2fea-4a65-9851-dc39c3ccf100 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:12:11.875348 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-3d263d9b-2fea-4a65-9851-dc39c3ccf100 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] [instance: 371c934a-2685-4d6f-b385-3b86f4a542e0] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:12:11.895315 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3d263d9b-2fea-4a65-9851-dc39c3ccf100 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:11.895912 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3d263d9b-2fea-4a65-9851-dc39c3ccf100 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:11.896521 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3d263d9b-2fea-4a65-9851-dc39c3ccf100 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:11.897328 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3d263d9b-2fea-4a65-9851-dc39c3ccf100 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:11.898012 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3d263d9b-2fea-4a65-9851-dc39c3ccf100 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:11.898754 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3d263d9b-2fea-4a65-9851-dc39c3ccf100 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:12.141402 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-09ad7a93-adde-41be-bcfb-648460f3d2b2 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:12:12.142329 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-09ad7a93-adde-41be-bcfb-648460f3d2b2 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: 6777bc8c-cfdf-4264-a776-09e8df2dc13b] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:12:12.154976 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-09ad7a93-adde-41be-bcfb-648460f3d2b2 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:12.155753 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-09ad7a93-adde-41be-bcfb-648460f3d2b2 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:12.156395 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-09ad7a93-adde-41be-bcfb-648460f3d2b2 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:12.157303 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-09ad7a93-adde-41be-bcfb-648460f3d2b2 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:12.157933 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-09ad7a93-adde-41be-bcfb-648460f3d2b2 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:12.158531 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-09ad7a93-adde-41be-bcfb-648460f3d2b2 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:12.451377 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-09ad7a93-adde-41be-bcfb-648460f3d2b2 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6160c7a42740efbe3613380933fa15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d90f8a58ad047fa8f347d6474e4d673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:12:12.465727 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-09ad7a93-adde-41be-bcfb-648460f3d2b2 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "GET /compute/v2.1/servers/6777bc8c-cfdf-4264-a776-09e8df2dc13b" status: 200 len: 1345 microversion: 2.1 time: 0.329288 Aug 10 23:12:12.483767 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1717/3322] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:12:12 2022] GET /compute/v2.1/servers/6777bc8c-cfdf-4264-a776-09e8df2dc13b => generated 1345 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:12:12.582047 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-843b89ec-0980-4d09-a664-654c83a6efd2 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:12:12.582612 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-843b89ec-0980-4d09-a664-654c83a6efd2 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] [instance: 20d2cf25-e240-4abb-908a-e0ea2bd6e2d6] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:12:12.593427 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-843b89ec-0980-4d09-a664-654c83a6efd2 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:12.594108 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-843b89ec-0980-4d09-a664-654c83a6efd2 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:12.594551 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-843b89ec-0980-4d09-a664-654c83a6efd2 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:12.599412 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-843b89ec-0980-4d09-a664-654c83a6efd2 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:12.600471 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-843b89ec-0980-4d09-a664-654c83a6efd2 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:12.603354 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-843b89ec-0980-4d09-a664-654c83a6efd2 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:12.984479 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-3d263d9b-2fea-4a65-9851-dc39c3ccf100 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2848edf3f7674fa9b8a3c408b2479f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aa264849a1d4a908907421eed683fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:12:12.993765 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-3d263d9b-2fea-4a65-9851-dc39c3ccf100 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] 10.222.0.58 "GET /compute/v2.1/servers/371c934a-2685-4d6f-b385-3b86f4a542e0" status: 200 len: 1506 microversion: 2.1 time: 1.126063 Aug 10 23:12:13.002465 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1606/3323] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:12:11 2022] GET /compute/v2.1/servers/371c934a-2685-4d6f-b385-3b86f4a542e0 => generated 1506 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:12:13.304784 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-843b89ec-0980-4d09-a664-654c83a6efd2 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd879a42349cf4570aaaf88ba90492f6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d39cab5115d4818b73ea24cb0987a3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:12:13.357466 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-843b89ec-0980-4d09-a664-654c83a6efd2 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] 10.222.0.58 "GET /compute/v2.1/servers/20d2cf25-e240-4abb-908a-e0ea2bd6e2d6" status: 200 len: 1304 microversion: 2.1 time: 0.782664 Aug 10 23:12:13.374158 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1718/3324] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:12:12 2022] GET /compute/v2.1/servers/20d2cf25-e240-4abb-908a-e0ea2bd6e2d6 => generated 1304 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:12:13.491748 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-59f9b78f-4bc9-45ac-860a-2e83cc108a5e tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:12:13.492409 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-59f9b78f-4bc9-45ac-860a-2e83cc108a5e tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: 6777bc8c-cfdf-4264-a776-09e8df2dc13b] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:12:13.502528 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-59f9b78f-4bc9-45ac-860a-2e83cc108a5e tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:13.503763 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-59f9b78f-4bc9-45ac-860a-2e83cc108a5e tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:13.504437 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-59f9b78f-4bc9-45ac-860a-2e83cc108a5e tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:13.505382 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-59f9b78f-4bc9-45ac-860a-2e83cc108a5e tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:13.506010 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-59f9b78f-4bc9-45ac-860a-2e83cc108a5e tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:13.507196 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-59f9b78f-4bc9-45ac-860a-2e83cc108a5e tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:13.701816 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-59f9b78f-4bc9-45ac-860a-2e83cc108a5e tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6160c7a42740efbe3613380933fa15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d90f8a58ad047fa8f347d6474e4d673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:12:13.715052 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-59f9b78f-4bc9-45ac-860a-2e83cc108a5e tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "GET /compute/v2.1/servers/6777bc8c-cfdf-4264-a776-09e8df2dc13b" status: 200 len: 1345 microversion: 2.1 time: 0.228497 Aug 10 23:12:13.721692 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1607/3325] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:12:13 2022] GET /compute/v2.1/servers/6777bc8c-cfdf-4264-a776-09e8df2dc13b => generated 1345 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:12:14.023673 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c41a9bbd-1f9a-4a4d-9124-d03519a14bba tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:12:14.024267 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-c41a9bbd-1f9a-4a4d-9124-d03519a14bba tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] [instance: 371c934a-2685-4d6f-b385-3b86f4a542e0] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:12:14.026246 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:12:14.032972 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c41a9bbd-1f9a-4a4d-9124-d03519a14bba tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:14.033463 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c41a9bbd-1f9a-4a4d-9124-d03519a14bba tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:14.033904 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c41a9bbd-1f9a-4a4d-9124-d03519a14bba tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:14.034608 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c41a9bbd-1f9a-4a4d-9124-d03519a14bba tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:14.068777 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c41a9bbd-1f9a-4a4d-9124-d03519a14bba tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:14.069644 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c41a9bbd-1f9a-4a4d-9124-d03519a14bba tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.035s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:14.386715 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-e5558ef3-f0cc-4b2d-a88e-437d4f41d52e tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:12:14.387379 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-e5558ef3-f0cc-4b2d-a88e-437d4f41d52e tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] [instance: 20d2cf25-e240-4abb-908a-e0ea2bd6e2d6] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:12:14.403617 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=14 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:12:14.422278 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e5558ef3-f0cc-4b2d-a88e-437d4f41d52e tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:14.423495 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e5558ef3-f0cc-4b2d-a88e-437d4f41d52e tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:14.425820 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e5558ef3-f0cc-4b2d-a88e-437d4f41d52e tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:14.426931 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e5558ef3-f0cc-4b2d-a88e-437d4f41d52e tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:14.428926 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e5558ef3-f0cc-4b2d-a88e-437d4f41d52e tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:14.429708 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e5558ef3-f0cc-4b2d-a88e-437d4f41d52e tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:14.476664 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-c41a9bbd-1f9a-4a4d-9124-d03519a14bba tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2848edf3f7674fa9b8a3c408b2479f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aa264849a1d4a908907421eed683fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:12:14.488751 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-c41a9bbd-1f9a-4a4d-9124-d03519a14bba tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] 10.222.0.58 "GET /compute/v2.1/servers/371c934a-2685-4d6f-b385-3b86f4a542e0" status: 200 len: 1486 microversion: 2.1 time: 0.468844 Aug 10 23:12:14.502843 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1719/3326] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:12:14 2022] GET /compute/v2.1/servers/371c934a-2685-4d6f-b385-3b86f4a542e0 => generated 1486 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:12:14.691722 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-5b10bfc3-1ccc-42eb-a304-86767c6b5809 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-726394325", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:12:14.820377 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.network.neutron [None req-5b10bfc3-1ccc-42eb-a304-86767c6b5809 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] validate_networks() for [('87bdb5bf-764d-4a2f-bcbe-1f935836fb5a', None, None, None, None, None)] {{(pid=122633) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 23:12:14.887948 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-e5558ef3-f0cc-4b2d-a88e-437d4f41d52e tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd879a42349cf4570aaaf88ba90492f6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d39cab5115d4818b73ea24cb0987a3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:12:14.899985 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-e5558ef3-f0cc-4b2d-a88e-437d4f41d52e tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] 10.222.0.58 "GET /compute/v2.1/servers/20d2cf25-e240-4abb-908a-e0ea2bd6e2d6" status: 200 len: 1304 microversion: 2.1 time: 0.521778 Aug 10 23:12:14.903385 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1608/3327] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:12:14 2022] GET /compute/v2.1/servers/20d2cf25-e240-4abb-908a-e0ea2bd6e2d6 => generated 1304 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:12:14.913071 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-5bef1167-52b4-4016-8195-bd3f7d57c9b9 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:12:14.915905 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-5bef1167-52b4-4016-8195-bd3f7d57c9b9 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: 6777bc8c-cfdf-4264-a776-09e8df2dc13b] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:12:14.936826 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5bef1167-52b4-4016-8195-bd3f7d57c9b9 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:14.937650 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5bef1167-52b4-4016-8195-bd3f7d57c9b9 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:14.938515 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5bef1167-52b4-4016-8195-bd3f7d57c9b9 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:14.942138 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5bef1167-52b4-4016-8195-bd3f7d57c9b9 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:14.942806 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5bef1167-52b4-4016-8195-bd3f7d57c9b9 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:14.943407 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5bef1167-52b4-4016-8195-bd3f7d57c9b9 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:14.975654 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-5bef1167-52b4-4016-8195-bd3f7d57c9b9 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] HTTP exception thrown: Instance 6777bc8c-cfdf-4264-a776-09e8df2dc13b could not be found. Aug 10 23:12:14.977700 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-5bef1167-52b4-4016-8195-bd3f7d57c9b9 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Request method failure captured: Aug 10 23:12:14.977700 n-d-850468-14 devstack@n-api.service[122632]: request: GET /compute/v2.1/servers/6777bc8c-cfdf-4264-a776-09e8df2dc13b HTTP/1.1 Aug 10 23:12:14.977700 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:12:14.977700 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:12:14.977700 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:12:14.977700 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 23:12:14.977700 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:12:14.977700 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:12:14.977700 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:12:14.977700 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:12:14.977700 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9Drr3r82npWIkz1ccNiKcah17mvrMR2EU4HCxqxnaGEEIkGANcRcrX2nHMsvmCLf0usmykCLye_MMWubAbqGw1RDJdO9uNXXKIzwnkO3-8RDYkeEsX4dAb-XLWqGpnC4lB_RQ_yXrj9zJ0yoaNBALi5oi6cnoUgwIrYxNetinerHaU0 Aug 10 23:12:14.977700 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:12:14.977700 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:12:14.977700 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:12:14.977700 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:12:14.977700 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:12:14.977700 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:12:14.977700 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 7d90f8a58ad047fa8f347d6474e4d673 Aug 10 23:12:14.977700 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-DeleteServersTestJSON-311075827 Aug 10 23:12:14.977700 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:12:14.977700 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:12:14.977700 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7d90f8a58ad047fa8f347d6474e4d673"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7d90f8a58ad047fa8f347d6474e4d673"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7d90f8a58ad047fa8f347d6474e4d673"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7d90f8a58ad047fa8f347d6474e4d673", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:12:14.977700 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-DeleteServersTestJSON-311075827 Aug 10 23:12:14.977700 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 7d90f8a58ad047fa8f347d6474e4d673 Aug 10 23:12:14.977700 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-DeleteServersTestJSON-311075827 Aug 10 23:12:14.977700 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-DeleteServersTestJSON-311075827-project Aug 10 23:12:14.977700 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:12:14.977700 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:12:14.977700 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: 3c6160c7a42740efbe3613380933fa15 Aug 10 23:12:14.977700 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-DeleteServersTestJSON-311075827-project Aug 10 23:12:14.977700 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:12:14.977700 n-d-850468-14 devstack@n-api.service[122632]: exception: Instance 6777bc8c-cfdf-4264-a776-09e8df2dc13b could not be found. Aug 10 23:12:14.977700 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': '6777bc8c-cfdf-4264-a776-09e8df2dc13b'} Aug 10 23:12:14.977700 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:12:14.977700 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:12:14.977700 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:12:14.977700 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:12:14.977700 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:12:14.977700 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:12:14.977700 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:12:14.977700 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:12:14.977700 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:12:14.977700 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:12:14.977700 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6777bc8c-cfdf-4264-a776-09e8df2dc13b could not be found. Aug 10 23:12:14.977700 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:12:14.977700 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:12:14.977700 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:12:14.977700 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:12:14.977700 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:12:14.977700 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:12:14.977700 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:12:14.977700 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:12:14.977700 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:12:14.977700 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:12:14.977700 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:12:14.977700 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:12:14.977700 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:12:14.977700 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:12:14.977700 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:12:14.977700 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:12:14.977700 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6777bc8c-cfdf-4264-a776-09e8df2dc13b could not be found. Aug 10 23:12:14.977700 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:12:14.977700 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:12:14.977700 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:12:14.986141 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:12:14.986141 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:12:14.986141 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:12:14.986141 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:12:14.986141 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:12:14.986141 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6777bc8c-cfdf-4264-a776-09e8df2dc13b could not be found. Aug 10 23:12:14.986141 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:12:14.999737 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-5bef1167-52b4-4016-8195-bd3f7d57c9b9 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Returning 404 to user: Instance 6777bc8c-cfdf-4264-a776-09e8df2dc13b could not be found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:12:15.000987 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-5bef1167-52b4-4016-8195-bd3f7d57c9b9 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "GET /compute/v2.1/servers/6777bc8c-cfdf-4264-a776-09e8df2dc13b" status: 404 len: 111 microversion: 2.1 time: 0.093924 Aug 10 23:12:15.001781 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1609/3328] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:12:14 2022] GET /compute/v2.1/servers/6777bc8c-cfdf-4264-a776-09e8df2dc13b => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:12:15.204698 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-7d0cde6b-afe0-42fe-905d-7d930cc89254 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:12:15.207126 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-7d0cde6b-afe0-42fe-905d-7d930cc89254 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: 6777bc8c-cfdf-4264-a776-09e8df2dc13b] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:12:15.235091 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7d0cde6b-afe0-42fe-905d-7d930cc89254 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:15.238431 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7d0cde6b-afe0-42fe-905d-7d930cc89254 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:15.240400 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7d0cde6b-afe0-42fe-905d-7d930cc89254 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:15.248428 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7d0cde6b-afe0-42fe-905d-7d930cc89254 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:15.250033 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7d0cde6b-afe0-42fe-905d-7d930cc89254 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:15.250776 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7d0cde6b-afe0-42fe-905d-7d930cc89254 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:15.288329 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-7d0cde6b-afe0-42fe-905d-7d930cc89254 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] HTTP exception thrown: Instance 6777bc8c-cfdf-4264-a776-09e8df2dc13b could not be found. Aug 10 23:12:15.290215 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-7d0cde6b-afe0-42fe-905d-7d930cc89254 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Request method failure captured: Aug 10 23:12:15.290215 n-d-850468-14 devstack@n-api.service[122632]: request: GET /compute/v2.1/servers/6777bc8c-cfdf-4264-a776-09e8df2dc13b/os-volume_attachments HTTP/1.1 Aug 10 23:12:15.290215 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:12:15.290215 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:12:15.290215 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:12:15.290215 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 23:12:15.290215 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:12:15.290215 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:12:15.290215 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:12:15.290215 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:12:15.290215 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9Drr3r82npWIkz1ccNiKcah17mvrMR2EU4HCxqxnaGEEIkGANcRcrX2nHMsvmCLf0usmykCLye_MMWubAbqGw1RDJdO9uNXXKIzwnkO3-8RDYkeEsX4dAb-XLWqGpnC4lB_RQ_yXrj9zJ0yoaNBALi5oi6cnoUgwIrYxNetinerHaU0 Aug 10 23:12:15.290215 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:12:15.290215 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:12:15.290215 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:12:15.290215 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:12:15.290215 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:12:15.290215 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:12:15.290215 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 7d90f8a58ad047fa8f347d6474e4d673 Aug 10 23:12:15.290215 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-DeleteServersTestJSON-311075827 Aug 10 23:12:15.290215 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:12:15.290215 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:12:15.290215 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7d90f8a58ad047fa8f347d6474e4d673"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7d90f8a58ad047fa8f347d6474e4d673"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7d90f8a58ad047fa8f347d6474e4d673"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7d90f8a58ad047fa8f347d6474e4d673", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:12:15.290215 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-DeleteServersTestJSON-311075827 Aug 10 23:12:15.290215 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 7d90f8a58ad047fa8f347d6474e4d673 Aug 10 23:12:15.290215 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-DeleteServersTestJSON-311075827 Aug 10 23:12:15.290215 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-DeleteServersTestJSON-311075827-project Aug 10 23:12:15.290215 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:12:15.290215 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:12:15.290215 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: 3c6160c7a42740efbe3613380933fa15 Aug 10 23:12:15.290215 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-DeleteServersTestJSON-311075827-project Aug 10 23:12:15.290215 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:12:15.290215 n-d-850468-14 devstack@n-api.service[122632]: exception: Instance 6777bc8c-cfdf-4264-a776-09e8df2dc13b could not be found. Aug 10 23:12:15.290215 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'server_id': '6777bc8c-cfdf-4264-a776-09e8df2dc13b'} Aug 10 23:12:15.290215 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:12:15.290215 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:12:15.290215 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:12:15.290215 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:12:15.290215 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:12:15.290215 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:12:15.290215 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:12:15.290215 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:12:15.290215 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:12:15.290215 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:12:15.290215 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6777bc8c-cfdf-4264-a776-09e8df2dc13b could not be found. Aug 10 23:12:15.290215 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:12:15.290215 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:12:15.290215 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:12:15.290215 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:12:15.290215 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:12:15.290215 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:12:15.290215 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:12:15.290215 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:12:15.290215 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:12:15.290215 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:12:15.290215 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 10 23:12:15.290215 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 23:12:15.290215 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 10 23:12:15.290215 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 23:12:15.290215 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 10 23:12:15.290215 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 10 23:12:15.290215 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:12:15.290215 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:12:15.295369 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6777bc8c-cfdf-4264-a776-09e8df2dc13b could not be found. Aug 10 23:12:15.295369 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:12:15.295369 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:12:15.295369 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:12:15.295369 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:12:15.295369 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:12:15.295369 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:12:15.295369 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:12:15.295369 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:12:15.295369 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6777bc8c-cfdf-4264-a776-09e8df2dc13b could not be found. Aug 10 23:12:15.295369 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:12:15.309067 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-7d0cde6b-afe0-42fe-905d-7d930cc89254 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Returning 404 to user: Instance 6777bc8c-cfdf-4264-a776-09e8df2dc13b could not be found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:12:15.310394 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-7d0cde6b-afe0-42fe-905d-7d930cc89254 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "GET /compute/v2.1/servers/6777bc8c-cfdf-4264-a776-09e8df2dc13b/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.110563 Aug 10 23:12:15.311968 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1610/3329] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 10 23:12:15 2022] GET /compute/v2.1/servers/6777bc8c-cfdf-4264-a776-09e8df2dc13b/os-volume_attachments => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 10 23:12:15.807727 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-e7ad6a9a-eb75-4b54-9da6-8e6e86dd8896 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1521015654", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452", "networks": [{"uuid": "042efc3d-5a07-4ef1-a5d1-285928545eba"}]}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:12:15.934522 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.network.neutron [None req-e7ad6a9a-eb75-4b54-9da6-8e6e86dd8896 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] validate_networks() for [('042efc3d-5a07-4ef1-a5d1-285928545eba', None, None, None, None, None)] {{(pid=122632) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 23:12:16.245671 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-5b10bfc3-1ccc-42eb-a304-86767c6b5809 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Flavor limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:12:16.246266 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-5b10bfc3-1ccc-42eb-a304-86767c6b5809 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Image limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:12:16.246542 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-5b10bfc3-1ccc-42eb-a304-86767c6b5809 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Flavor pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:12:16.247496 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-5b10bfc3-1ccc-42eb-a304-86767c6b5809 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Image pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:12:16.248679 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-5b10bfc3-1ccc-42eb-a304-86767c6b5809 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:12:16.266028 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5b10bfc3-1ccc-42eb-a304-86767c6b5809 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:16.268973 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5b10bfc3-1ccc-42eb-a304-86767c6b5809 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:16.270689 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5b10bfc3-1ccc-42eb-a304-86767c6b5809 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:16.271706 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5b10bfc3-1ccc-42eb-a304-86767c6b5809 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:16.273603 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5b10bfc3-1ccc-42eb-a304-86767c6b5809 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:16.274273 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5b10bfc3-1ccc-42eb-a304-86767c6b5809 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:16.333012 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-5b10bfc3-1ccc-42eb-a304-86767c6b5809 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Getting quotas for project 6aa264849a1d4a908907421eed683fab. Resources: {'instances', 'cores', 'ram'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:12:16.358384 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-5b10bfc3-1ccc-42eb-a304-86767c6b5809 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Getting quotas for user 2848edf3f7674fa9b8a3c408b2479f5a and project 6aa264849a1d4a908907421eed683fab. Resources: {'instances', 'cores', 'ram'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:12:16.406930 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-5b10bfc3-1ccc-42eb-a304-86767c6b5809 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Going to run 1 instances... {{(pid=122633) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 23:12:16.412489 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-5b10bfc3-1ccc-42eb-a304-86767c6b5809 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] [instance: 8b45f99b-7717-489f-9507-9190a9402f47] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78ad8905-f66f-4733-8be9-2b260f1fabed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122633) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 23:12:16.574210 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-5b10bfc3-1ccc-42eb-a304-86767c6b5809 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.887016 Aug 10 23:12:16.581864 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1720/3330] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 23:12:14 2022] POST /compute/v2.1/servers => generated 383 bytes in 1892 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 10 23:12:16.598181 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-6b097c05-ed80-4b89-9279-4e8a02da559d tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:12:16.601084 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-6b097c05-ed80-4b89-9279-4e8a02da559d tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] [instance: 20d2cf25-e240-4abb-908a-e0ea2bd6e2d6] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:12:16.624412 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6b097c05-ed80-4b89-9279-4e8a02da559d tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:16.626559 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6b097c05-ed80-4b89-9279-4e8a02da559d tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:16.630147 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6b097c05-ed80-4b89-9279-4e8a02da559d tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:16.632045 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6b097c05-ed80-4b89-9279-4e8a02da559d tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:16.650109 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6b097c05-ed80-4b89-9279-4e8a02da559d tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:16.651328 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6b097c05-ed80-4b89-9279-4e8a02da559d tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:17.249736 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-6b097c05-ed80-4b89-9279-4e8a02da559d tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd879a42349cf4570aaaf88ba90492f6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d39cab5115d4818b73ea24cb0987a3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:12:17.264716 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-6b097c05-ed80-4b89-9279-4e8a02da559d tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] 10.222.0.58 "GET /compute/v2.1/servers/20d2cf25-e240-4abb-908a-e0ea2bd6e2d6" status: 200 len: 1304 microversion: 2.1 time: 0.677701 Aug 10 23:12:17.266536 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1721/3331] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:12:16 2022] GET /compute/v2.1/servers/20d2cf25-e240-4abb-908a-e0ea2bd6e2d6 => generated 1304 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:12:17.274625 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-b9ecc056-4d74-4304-91b5-d0fce2781f58 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:12:17.275945 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-b9ecc056-4d74-4304-91b5-d0fce2781f58 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] [instance: 8b45f99b-7717-489f-9507-9190a9402f47] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:12:17.314836 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-e7ad6a9a-eb75-4b54-9da6-8e6e86dd8896 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Flavor limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:12:17.315959 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-e7ad6a9a-eb75-4b54-9da6-8e6e86dd8896 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Image limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:12:17.316660 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-e7ad6a9a-eb75-4b54-9da6-8e6e86dd8896 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Flavor pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:12:17.317332 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-e7ad6a9a-eb75-4b54-9da6-8e6e86dd8896 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Image pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:12:17.317910 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-e7ad6a9a-eb75-4b54-9da6-8e6e86dd8896 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:12:17.349424 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e7ad6a9a-eb75-4b54-9da6-8e6e86dd8896 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:17.352877 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e7ad6a9a-eb75-4b54-9da6-8e6e86dd8896 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:17.354651 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e7ad6a9a-eb75-4b54-9da6-8e6e86dd8896 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:17.360313 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e7ad6a9a-eb75-4b54-9da6-8e6e86dd8896 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:17.364353 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e7ad6a9a-eb75-4b54-9da6-8e6e86dd8896 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:17.364815 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e7ad6a9a-eb75-4b54-9da6-8e6e86dd8896 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:17.377953 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-b9ecc056-4d74-4304-91b5-d0fce2781f58 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2848edf3f7674fa9b8a3c408b2479f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aa264849a1d4a908907421eed683fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:12:17.388470 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-b9ecc056-4d74-4304-91b5-d0fce2781f58 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] 10.222.0.58 "GET /compute/v2.1/servers/8b45f99b-7717-489f-9507-9190a9402f47" status: 200 len: 1213 microversion: 2.1 time: 0.119447 Aug 10 23:12:17.391885 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1722/3332] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:12:17 2022] GET /compute/v2.1/servers/8b45f99b-7717-489f-9507-9190a9402f47 => generated 1213 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:12:17.446602 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-e7ad6a9a-eb75-4b54-9da6-8e6e86dd8896 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Getting quotas for project 7d90f8a58ad047fa8f347d6474e4d673. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:12:17.462960 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-e7ad6a9a-eb75-4b54-9da6-8e6e86dd8896 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Getting quotas for user 3c6160c7a42740efbe3613380933fa15 and project 7d90f8a58ad047fa8f347d6474e4d673. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:12:17.528242 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-e7ad6a9a-eb75-4b54-9da6-8e6e86dd8896 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Going to run 1 instances... {{(pid=122632) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 23:12:17.531186 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-e7ad6a9a-eb75-4b54-9da6-8e6e86dd8896 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: 2c366301-48bf-4dbe-a779-7ed93d827dbd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78ad8905-f66f-4733-8be9-2b260f1fabed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122632) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 23:12:17.609392 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:12:17.658718 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-e7ad6a9a-eb75-4b54-9da6-8e6e86dd8896 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.857004 Aug 10 23:12:17.662212 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1611/3333] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 23:12:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 1861 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 10 23:12:17.674909 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-0d3d5ef5-4444-4ad6-a863-cade98c1c1d8 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:12:17.675980 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-0d3d5ef5-4444-4ad6-a863-cade98c1c1d8 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: 2c366301-48bf-4dbe-a779-7ed93d827dbd] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:12:18.012859 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-0d3d5ef5-4444-4ad6-a863-cade98c1c1d8 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6160c7a42740efbe3613380933fa15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d90f8a58ad047fa8f347d6474e4d673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:12:18.034045 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-0d3d5ef5-4444-4ad6-a863-cade98c1c1d8 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "GET /compute/v2.1/servers/2c366301-48bf-4dbe-a779-7ed93d827dbd" status: 200 len: 1215 microversion: 2.1 time: 0.363373 Aug 10 23:12:18.037610 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1723/3334] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:12:17 2022] GET /compute/v2.1/servers/2c366301-48bf-4dbe-a779-7ed93d827dbd => generated 1215 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:12:18.059547 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-a2e6e854-d61e-491a-84bc-440bb749e768 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:12:18.060322 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-a2e6e854-d61e-491a-84bc-440bb749e768 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: 2c366301-48bf-4dbe-a779-7ed93d827dbd] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:12:18.087378 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-a2e6e854-d61e-491a-84bc-440bb749e768 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: 2c366301-48bf-4dbe-a779-7ed93d827dbd] Going to try to terminate instance {{(pid=122632) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:12:18.294098 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-a678f1a9-b5a4-45d0-a7a0-2200813a1743 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:12:18.296477 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-a678f1a9-b5a4-45d0-a7a0-2200813a1743 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] [instance: 20d2cf25-e240-4abb-908a-e0ea2bd6e2d6] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:12:18.315119 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a678f1a9-b5a4-45d0-a7a0-2200813a1743 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:18.316031 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a678f1a9-b5a4-45d0-a7a0-2200813a1743 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:18.318201 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a678f1a9-b5a4-45d0-a7a0-2200813a1743 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:18.319267 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a678f1a9-b5a4-45d0-a7a0-2200813a1743 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:18.320047 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a678f1a9-b5a4-45d0-a7a0-2200813a1743 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:18.320662 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a678f1a9-b5a4-45d0-a7a0-2200813a1743 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:18.970004 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.compute.api [None req-a2e6e854-d61e-491a-84bc-440bb749e768 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: 2c366301-48bf-4dbe-a779-7ed93d827dbd] Instance Mapping does not exist while attempting local delete cleanup. Aug 10 23:12:18.971628 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-a2e6e854-d61e-491a-84bc-440bb749e768 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "DELETE /compute/v2.1/servers/2c366301-48bf-4dbe-a779-7ed93d827dbd" status: 204 len: 0 microversion: 2.1 time: 0.916316 Aug 10 23:12:18.973051 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1612/3335] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:12:18 2022] DELETE /compute/v2.1/servers/2c366301-48bf-4dbe-a779-7ed93d827dbd => generated 0 bytes in 918 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:12:18.994289 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-3e975647-49c7-4b7c-b200-4dfc6509a52f tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:12:18.994961 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-3e975647-49c7-4b7c-b200-4dfc6509a52f tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] [instance: 8b45f99b-7717-489f-9507-9190a9402f47] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:12:19.015862 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3e975647-49c7-4b7c-b200-4dfc6509a52f tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:19.016978 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3e975647-49c7-4b7c-b200-4dfc6509a52f tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:19.018307 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3e975647-49c7-4b7c-b200-4dfc6509a52f tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:19.019517 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3e975647-49c7-4b7c-b200-4dfc6509a52f tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:19.020308 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3e975647-49c7-4b7c-b200-4dfc6509a52f tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:19.021198 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3e975647-49c7-4b7c-b200-4dfc6509a52f tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:19.171143 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-a678f1a9-b5a4-45d0-a7a0-2200813a1743 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd879a42349cf4570aaaf88ba90492f6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d39cab5115d4818b73ea24cb0987a3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:12:19.182097 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-a678f1a9-b5a4-45d0-a7a0-2200813a1743 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] 10.222.0.58 "GET /compute/v2.1/servers/20d2cf25-e240-4abb-908a-e0ea2bd6e2d6" status: 200 len: 1292 microversion: 2.1 time: 0.898748 Aug 10 23:12:19.186899 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1724/3336] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:12:18 2022] GET /compute/v2.1/servers/20d2cf25-e240-4abb-908a-e0ea2bd6e2d6 => generated 1292 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:12:19.197881 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-9facaba7-1f1e-4d7f-be61-e884bdf7042a tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:12:19.198510 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-9facaba7-1f1e-4d7f-be61-e884bdf7042a tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: 2c366301-48bf-4dbe-a779-7ed93d827dbd] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:12:19.218712 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-9facaba7-1f1e-4d7f-be61-e884bdf7042a tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] HTTP exception thrown: Instance 2c366301-48bf-4dbe-a779-7ed93d827dbd could not be found. Aug 10 23:12:19.220457 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-9facaba7-1f1e-4d7f-be61-e884bdf7042a tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Request method failure captured: Aug 10 23:12:19.220457 n-d-850468-14 devstack@n-api.service[122633]: request: GET /compute/v2.1/servers/2c366301-48bf-4dbe-a779-7ed93d827dbd HTTP/1.1 Aug 10 23:12:19.220457 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:12:19.220457 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:12:19.220457 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:12:19.220457 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:12:19.220457 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:12:19.220457 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:12:19.220457 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:12:19.220457 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:12:19.220457 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9Drr3r82npWIkz1ccNiKcah17mvrMR2EU4HCxqxnaGEEIkGANcRcrX2nHMsvmCLf0usmykCLye_MMWubAbqGw1RDJdO9uNXXKIzwnkO3-8RDYkeEsX4dAb-XLWqGpnC4lB_RQ_yXrj9zJ0yoaNBALi5oi6cnoUgwIrYxNetinerHaU0 Aug 10 23:12:19.220457 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:12:19.220457 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:12:19.220457 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:12:19.220457 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:12:19.220457 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:12:19.220457 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:12:19.220457 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 7d90f8a58ad047fa8f347d6474e4d673 Aug 10 23:12:19.220457 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-DeleteServersTestJSON-311075827 Aug 10 23:12:19.220457 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:12:19.220457 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:12:19.220457 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7d90f8a58ad047fa8f347d6474e4d673"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7d90f8a58ad047fa8f347d6474e4d673"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7d90f8a58ad047fa8f347d6474e4d673"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7d90f8a58ad047fa8f347d6474e4d673", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:12:19.220457 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-DeleteServersTestJSON-311075827 Aug 10 23:12:19.220457 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 7d90f8a58ad047fa8f347d6474e4d673 Aug 10 23:12:19.220457 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-DeleteServersTestJSON-311075827 Aug 10 23:12:19.220457 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-DeleteServersTestJSON-311075827-project Aug 10 23:12:19.220457 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:12:19.220457 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:12:19.220457 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 3c6160c7a42740efbe3613380933fa15 Aug 10 23:12:19.220457 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-DeleteServersTestJSON-311075827-project Aug 10 23:12:19.220457 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:12:19.220457 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance 2c366301-48bf-4dbe-a779-7ed93d827dbd could not be found. Aug 10 23:12:19.220457 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': '2c366301-48bf-4dbe-a779-7ed93d827dbd'} Aug 10 23:12:19.220457 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:12:19.220457 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:12:19.220457 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:12:19.220457 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:12:19.220457 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:12:19.220457 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:12:19.220457 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 10 23:12:19.220457 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 10 23:12:19.220457 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c366301-48bf-4dbe-a779-7ed93d827dbd could not be found. Aug 10 23:12:19.220457 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:12:19.220457 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:12:19.220457 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:12:19.220457 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:12:19.220457 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:12:19.220457 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:12:19.220457 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:12:19.220457 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:12:19.220457 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:12:19.220457 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:12:19.220457 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:12:19.220457 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:12:19.220457 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:12:19.220457 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:12:19.220457 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:12:19.220457 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:12:19.220457 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c366301-48bf-4dbe-a779-7ed93d827dbd could not be found. Aug 10 23:12:19.220457 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:12:19.220457 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:12:19.220457 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:12:19.220457 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:12:19.220457 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:12:19.226562 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:12:19.226562 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:12:19.226562 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:12:19.226562 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c366301-48bf-4dbe-a779-7ed93d827dbd could not be found. Aug 10 23:12:19.226562 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:12:19.226562 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-9facaba7-1f1e-4d7f-be61-e884bdf7042a tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Returning 404 to user: Instance 2c366301-48bf-4dbe-a779-7ed93d827dbd could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:12:19.226562 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-9facaba7-1f1e-4d7f-be61-e884bdf7042a tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "GET /compute/v2.1/servers/2c366301-48bf-4dbe-a779-7ed93d827dbd" status: 404 len: 111 microversion: 2.1 time: 0.033907 Aug 10 23:12:19.235437 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1725/3337] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:12:19 2022] GET /compute/v2.1/servers/2c366301-48bf-4dbe-a779-7ed93d827dbd => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:12:19.403478 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-bff7e21a-b336-4115-96a6-21c159e4fffa tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-428849345", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452", "networks": [{"uuid": "042efc3d-5a07-4ef1-a5d1-285928545eba"}]}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:12:19.562944 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.network.neutron [None req-bff7e21a-b336-4115-96a6-21c159e4fffa tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] validate_networks() for [('042efc3d-5a07-4ef1-a5d1-285928545eba', None, None, None, None, None)] {{(pid=122633) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 23:12:19.678844 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-3e975647-49c7-4b7c-b200-4dfc6509a52f tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2848edf3f7674fa9b8a3c408b2479f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aa264849a1d4a908907421eed683fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:12:19.700226 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-3e975647-49c7-4b7c-b200-4dfc6509a52f tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] 10.222.0.58 "GET /compute/v2.1/servers/8b45f99b-7717-489f-9507-9190a9402f47" status: 200 len: 1271 microversion: 2.1 time: 0.719390 Aug 10 23:12:19.718313 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1613/3338] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:12:18 2022] GET /compute/v2.1/servers/8b45f99b-7717-489f-9507-9190a9402f47 => generated 1271 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:12:19.731949 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-ea0ecd39-7664-406e-8554-813d1a15d754 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:12:19.736129 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-ea0ecd39-7664-406e-8554-813d1a15d754 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: fa9dfd3a-a636-48ce-ae15-0ed51baee954] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:12:19.757367 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ea0ecd39-7664-406e-8554-813d1a15d754 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:19.760578 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ea0ecd39-7664-406e-8554-813d1a15d754 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:19.761461 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ea0ecd39-7664-406e-8554-813d1a15d754 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:19.765886 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ea0ecd39-7664-406e-8554-813d1a15d754 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:19.768257 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ea0ecd39-7664-406e-8554-813d1a15d754 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:19.769078 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ea0ecd39-7664-406e-8554-813d1a15d754 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:20.061825 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-ea0ecd39-7664-406e-8554-813d1a15d754 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:12:20.073419 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-ea0ecd39-7664-406e-8554-813d1a15d754 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954" status: 200 len: 1667 microversion: 2.1 time: 0.346417 Aug 10 23:12:20.075557 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1614/3339] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:12:19 2022] GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954 => generated 1667 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:12:20.095798 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-bec40c78-43ea-4bd4-a28f-4432e3fbd190 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-2118241524"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:12:20.098605 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-bec40c78-43ea-4bd4-a28f-4432e3fbd190 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: fa9dfd3a-a636-48ce-ae15-0ed51baee954] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:12:20.117035 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bec40c78-43ea-4bd4-a28f-4432e3fbd190 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:20.117913 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bec40c78-43ea-4bd4-a28f-4432e3fbd190 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:20.119261 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bec40c78-43ea-4bd4-a28f-4432e3fbd190 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:20.120252 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bec40c78-43ea-4bd4-a28f-4432e3fbd190 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:20.121240 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bec40c78-43ea-4bd4-a28f-4432e3fbd190 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:20.122097 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bec40c78-43ea-4bd4-a28f-4432e3fbd190 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:20.433918 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-bec40c78-43ea-4bd4-a28f-4432e3fbd190 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "POST /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954/action" status: 202 len: 0 microversion: 2.1 time: 0.342664 Aug 10 23:12:20.436402 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1615/3340] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:12:20 2022] POST /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954/action => generated 0 bytes in 346 msecs (HTTP/1.1 202) 10 headers in 456 bytes (2 switches on core 0) Aug 10 23:12:20.468146 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-967175b8-1bbe-4a09-b5a1-36e6de08ba75 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:12:20.470034 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-967175b8-1bbe-4a09-b5a1-36e6de08ba75 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] [instance: 20d2cf25-e240-4abb-908a-e0ea2bd6e2d6] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:12:20.479658 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-967175b8-1bbe-4a09-b5a1-36e6de08ba75 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:20.480603 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-967175b8-1bbe-4a09-b5a1-36e6de08ba75 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:20.481716 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-967175b8-1bbe-4a09-b5a1-36e6de08ba75 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:20.483674 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-967175b8-1bbe-4a09-b5a1-36e6de08ba75 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:20.485023 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-967175b8-1bbe-4a09-b5a1-36e6de08ba75 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:20.485861 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-967175b8-1bbe-4a09-b5a1-36e6de08ba75 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:21.286838 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-967175b8-1bbe-4a09-b5a1-36e6de08ba75 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd879a42349cf4570aaaf88ba90492f6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d39cab5115d4818b73ea24cb0987a3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:12:21.297871 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-967175b8-1bbe-4a09-b5a1-36e6de08ba75 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] 10.222.0.58 "GET /compute/v2.1/servers/20d2cf25-e240-4abb-908a-e0ea2bd6e2d6" status: 200 len: 1292 microversion: 2.1 time: 0.859593 Aug 10 23:12:21.298496 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1616/3341] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:12:20 2022] GET /compute/v2.1/servers/20d2cf25-e240-4abb-908a-e0ea2bd6e2d6 => generated 1292 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:12:21.316112 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-386bfd1a-aae5-42b6-9e85-e81aded2697e tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:12:21.316742 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-386bfd1a-aae5-42b6-9e85-e81aded2697e tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] [instance: 8b45f99b-7717-489f-9507-9190a9402f47] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:12:21.332193 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-386bfd1a-aae5-42b6-9e85-e81aded2697e tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:21.332695 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-386bfd1a-aae5-42b6-9e85-e81aded2697e tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:21.333131 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-386bfd1a-aae5-42b6-9e85-e81aded2697e tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:21.337751 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-386bfd1a-aae5-42b6-9e85-e81aded2697e tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:21.338436 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-386bfd1a-aae5-42b6-9e85-e81aded2697e tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:21.339064 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-386bfd1a-aae5-42b6-9e85-e81aded2697e tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:21.651637 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-386bfd1a-aae5-42b6-9e85-e81aded2697e tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2848edf3f7674fa9b8a3c408b2479f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aa264849a1d4a908907421eed683fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:12:21.662040 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-386bfd1a-aae5-42b6-9e85-e81aded2697e tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] 10.222.0.58 "GET /compute/v2.1/servers/8b45f99b-7717-489f-9507-9190a9402f47" status: 200 len: 1313 microversion: 2.1 time: 0.350793 Aug 10 23:12:21.663256 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1617/3342] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:12:21 2022] GET /compute/v2.1/servers/8b45f99b-7717-489f-9507-9190a9402f47 => generated 1313 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:12:21.916464 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-bff7e21a-b336-4115-96a6-21c159e4fffa tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Flavor limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:12:21.916945 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-bff7e21a-b336-4115-96a6-21c159e4fffa tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Image limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:12:21.917373 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-bff7e21a-b336-4115-96a6-21c159e4fffa tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Flavor pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:12:21.917789 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-bff7e21a-b336-4115-96a6-21c159e4fffa tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Image pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:12:21.918220 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-bff7e21a-b336-4115-96a6-21c159e4fffa tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:12:21.954001 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bff7e21a-b336-4115-96a6-21c159e4fffa tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:21.960183 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bff7e21a-b336-4115-96a6-21c159e4fffa tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:21.960950 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bff7e21a-b336-4115-96a6-21c159e4fffa tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:21.968834 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bff7e21a-b336-4115-96a6-21c159e4fffa tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:21.970263 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bff7e21a-b336-4115-96a6-21c159e4fffa tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:21.970727 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bff7e21a-b336-4115-96a6-21c159e4fffa tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:22.028164 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-bff7e21a-b336-4115-96a6-21c159e4fffa tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Getting quotas for project 7d90f8a58ad047fa8f347d6474e4d673. Resources: {'instances', 'cores', 'ram'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:12:22.044053 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-bff7e21a-b336-4115-96a6-21c159e4fffa tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Getting quotas for user 3c6160c7a42740efbe3613380933fa15 and project 7d90f8a58ad047fa8f347d6474e4d673. Resources: {'instances', 'cores', 'ram'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:12:22.062959 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-bff7e21a-b336-4115-96a6-21c159e4fffa tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Going to run 1 instances... {{(pid=122633) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 23:12:22.065865 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-bff7e21a-b336-4115-96a6-21c159e4fffa tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: 018fdc62-66af-42a9-b97a-b3c1bb37b04a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78ad8905-f66f-4733-8be9-2b260f1fabed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122633) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 23:12:22.128096 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-bff7e21a-b336-4115-96a6-21c159e4fffa tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.730817 Aug 10 23:12:22.129435 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1726/3343] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 23:12:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 2733 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 23:12:22.140924 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-f727aa94-94a9-4a39-84d7-7882c6d999da tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:12:22.141846 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-f727aa94-94a9-4a39-84d7-7882c6d999da tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: 018fdc62-66af-42a9-b97a-b3c1bb37b04a] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:12:22.319530 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-5b568b1a-f3c8-4666-a8f3-0c8747e471d7 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:12:22.320540 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-5b568b1a-f3c8-4666-a8f3-0c8747e471d7 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] [instance: 20d2cf25-e240-4abb-908a-e0ea2bd6e2d6] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:12:22.331082 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5b568b1a-f3c8-4666-a8f3-0c8747e471d7 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:22.332527 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5b568b1a-f3c8-4666-a8f3-0c8747e471d7 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:22.333422 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-f727aa94-94a9-4a39-84d7-7882c6d999da tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6160c7a42740efbe3613380933fa15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d90f8a58ad047fa8f347d6474e4d673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:12:22.334549 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5b568b1a-f3c8-4666-a8f3-0c8747e471d7 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:22.336884 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5b568b1a-f3c8-4666-a8f3-0c8747e471d7 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:22.337968 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5b568b1a-f3c8-4666-a8f3-0c8747e471d7 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:22.339986 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5b568b1a-f3c8-4666-a8f3-0c8747e471d7 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:22.345481 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-f727aa94-94a9-4a39-84d7-7882c6d999da tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "GET /compute/v2.1/servers/018fdc62-66af-42a9-b97a-b3c1bb37b04a" status: 200 len: 1214 microversion: 2.1 time: 0.209378 Aug 10 23:12:22.353475 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1618/3344] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:12:22 2022] GET /compute/v2.1/servers/018fdc62-66af-42a9-b97a-b3c1bb37b04a => generated 1214 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:12:22.690343 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-939ddc49-22ad-4629-817d-19a2834b9a67 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:12:22.692655 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-939ddc49-22ad-4629-817d-19a2834b9a67 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] [instance: 8b45f99b-7717-489f-9507-9190a9402f47] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:12:22.712046 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-939ddc49-22ad-4629-817d-19a2834b9a67 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:22.736851 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-939ddc49-22ad-4629-817d-19a2834b9a67 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:22.737523 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-939ddc49-22ad-4629-817d-19a2834b9a67 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:22.740032 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-939ddc49-22ad-4629-817d-19a2834b9a67 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:22.742002 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-939ddc49-22ad-4629-817d-19a2834b9a67 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:22.744357 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-939ddc49-22ad-4629-817d-19a2834b9a67 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:23.120709 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-5b568b1a-f3c8-4666-a8f3-0c8747e471d7 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd879a42349cf4570aaaf88ba90492f6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d39cab5115d4818b73ea24cb0987a3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:12:23.133378 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-5b568b1a-f3c8-4666-a8f3-0c8747e471d7 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] 10.222.0.58 "GET /compute/v2.1/servers/20d2cf25-e240-4abb-908a-e0ea2bd6e2d6" status: 200 len: 1292 microversion: 2.1 time: 0.817917 Aug 10 23:12:23.134978 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1727/3345] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:12:22 2022] GET /compute/v2.1/servers/20d2cf25-e240-4abb-908a-e0ea2bd6e2d6 => generated 1292 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:12:23.210050 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-939ddc49-22ad-4629-817d-19a2834b9a67 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2848edf3f7674fa9b8a3c408b2479f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aa264849a1d4a908907421eed683fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:12:23.221466 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-939ddc49-22ad-4629-817d-19a2834b9a67 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] 10.222.0.58 "GET /compute/v2.1/servers/8b45f99b-7717-489f-9507-9190a9402f47" status: 200 len: 1313 microversion: 2.1 time: 0.539406 Aug 10 23:12:23.222065 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1619/3346] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:12:22 2022] GET /compute/v2.1/servers/8b45f99b-7717-489f-9507-9190a9402f47 => generated 1313 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:12:23.379254 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-3cd5b153-17c4-421a-9ac6-6cf04a832f89 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:12:23.380440 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-3cd5b153-17c4-421a-9ac6-6cf04a832f89 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: 018fdc62-66af-42a9-b97a-b3c1bb37b04a] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:12:23.391799 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3cd5b153-17c4-421a-9ac6-6cf04a832f89 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:23.393608 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3cd5b153-17c4-421a-9ac6-6cf04a832f89 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:23.408989 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3cd5b153-17c4-421a-9ac6-6cf04a832f89 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:23.413681 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3cd5b153-17c4-421a-9ac6-6cf04a832f89 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:23.415263 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3cd5b153-17c4-421a-9ac6-6cf04a832f89 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:23.418402 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3cd5b153-17c4-421a-9ac6-6cf04a832f89 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:23.437698 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=100 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:12:23.543405 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-3cd5b153-17c4-421a-9ac6-6cf04a832f89 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6160c7a42740efbe3613380933fa15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d90f8a58ad047fa8f347d6474e4d673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:12:23.554738 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-3cd5b153-17c4-421a-9ac6-6cf04a832f89 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "GET /compute/v2.1/servers/018fdc62-66af-42a9-b97a-b3c1bb37b04a" status: 200 len: 1218 microversion: 2.1 time: 0.180257 Aug 10 23:12:23.572814 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1728/3347] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:12:23 2022] GET /compute/v2.1/servers/018fdc62-66af-42a9-b97a-b3c1bb37b04a => generated 1218 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:12:23.727856 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-b958a0e1-48b6-43a5-b5ba-b23e21f9acc7 req-25f61495-ecdf-478a-9a37-02e8912f5832 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8b45f99b-7717-489f-9507-9190a9402f47", "tag": "1f8105d9-27f2-4e73-a7c6-1bd2eabcce21"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:12:23.751583 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-b958a0e1-48b6-43a5-b5ba-b23e21f9acc7 req-25f61495-ecdf-478a-9a37-02e8912f5832 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:23.752421 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-b958a0e1-48b6-43a5-b5ba-b23e21f9acc7 req-25f61495-ecdf-478a-9a37-02e8912f5832 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:23.753318 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-b958a0e1-48b6-43a5-b5ba-b23e21f9acc7 req-25f61495-ecdf-478a-9a37-02e8912f5832 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:23.779835 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-b958a0e1-48b6-43a5-b5ba-b23e21f9acc7 req-25f61495-ecdf-478a-9a37-02e8912f5832 service nova] Creating event network-changed:1f8105d9-27f2-4e73-a7c6-1bd2eabcce21 for instance 8b45f99b-7717-489f-9507-9190a9402f47 on n-h1-850468-14 Aug 10 23:12:23.790135 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-b958a0e1-48b6-43a5-b5ba-b23e21f9acc7 req-25f61495-ecdf-478a-9a37-02e8912f5832 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065850 Aug 10 23:12:23.792464 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1620/3348] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:12:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:12:24.157854 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-4f8495a6-7e51-48a6-a7e5-246b079c5c2e tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:12:24.158485 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-4f8495a6-7e51-48a6-a7e5-246b079c5c2e tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] [instance: 20d2cf25-e240-4abb-908a-e0ea2bd6e2d6] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:12:24.173651 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4f8495a6-7e51-48a6-a7e5-246b079c5c2e tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:24.177397 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4f8495a6-7e51-48a6-a7e5-246b079c5c2e tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:24.179670 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4f8495a6-7e51-48a6-a7e5-246b079c5c2e tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:24.180755 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4f8495a6-7e51-48a6-a7e5-246b079c5c2e tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:24.183017 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4f8495a6-7e51-48a6-a7e5-246b079c5c2e tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:24.184296 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4f8495a6-7e51-48a6-a7e5-246b079c5c2e tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:24.245650 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-5fc6474a-8ae5-495c-b42c-abef03526d05 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:12:24.246472 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-5fc6474a-8ae5-495c-b42c-abef03526d05 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] [instance: 8b45f99b-7717-489f-9507-9190a9402f47] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:12:24.263842 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5fc6474a-8ae5-495c-b42c-abef03526d05 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:24.265130 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5fc6474a-8ae5-495c-b42c-abef03526d05 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:24.269274 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5fc6474a-8ae5-495c-b42c-abef03526d05 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:24.271524 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5fc6474a-8ae5-495c-b42c-abef03526d05 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:24.273930 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5fc6474a-8ae5-495c-b42c-abef03526d05 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:24.274613 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5fc6474a-8ae5-495c-b42c-abef03526d05 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:25.584009 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-5fc6474a-8ae5-495c-b42c-abef03526d05 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2848edf3f7674fa9b8a3c408b2479f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aa264849a1d4a908907421eed683fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:12:25.590400 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-4f8495a6-7e51-48a6-a7e5-246b079c5c2e tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd879a42349cf4570aaaf88ba90492f6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d39cab5115d4818b73ea24cb0987a3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:12:25.601306 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-5fc6474a-8ae5-495c-b42c-abef03526d05 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] 10.222.0.58 "GET /compute/v2.1/servers/8b45f99b-7717-489f-9507-9190a9402f47" status: 200 len: 1313 microversion: 2.1 time: 1.361021 Aug 10 23:12:25.609970 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1621/3349] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:12:24 2022] GET /compute/v2.1/servers/8b45f99b-7717-489f-9507-9190a9402f47 => generated 1313 bytes in 1370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:12:25.610198 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-4f8495a6-7e51-48a6-a7e5-246b079c5c2e tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] 10.222.0.58 "GET /compute/v2.1/servers/20d2cf25-e240-4abb-908a-e0ea2bd6e2d6" status: 200 len: 1292 microversion: 2.1 time: 1.451213 Aug 10 23:12:25.613610 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1729/3350] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:12:24 2022] GET /compute/v2.1/servers/20d2cf25-e240-4abb-908a-e0ea2bd6e2d6 => generated 1292 bytes in 1464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:12:25.624544 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-d7b31a23-23d6-40fd-9f07-d9e93b934b45 req-90df51ff-d738-4c36-a42b-a5190ee83a9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa9dfd3a-a636-48ce-ae15-0ed51baee954", "name": "network-vif-unplugged", "status": "completed", "tag": "456f7ca7-21c6-4b5d-8993-9a7c329acf12"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:12:25.640952 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-05fa06d1-d31c-4203-b3b9-a712b0f09248 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:12:25.642752 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-05fa06d1-d31c-4203-b3b9-a712b0f09248 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: 018fdc62-66af-42a9-b97a-b3c1bb37b04a] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:12:25.651381 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-05fa06d1-d31c-4203-b3b9-a712b0f09248 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:25.652178 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-05fa06d1-d31c-4203-b3b9-a712b0f09248 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:25.652799 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-05fa06d1-d31c-4203-b3b9-a712b0f09248 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:25.654479 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-05fa06d1-d31c-4203-b3b9-a712b0f09248 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:25.655777 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-05fa06d1-d31c-4203-b3b9-a712b0f09248 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:25.656553 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-05fa06d1-d31c-4203-b3b9-a712b0f09248 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:25.674312 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-d7b31a23-23d6-40fd-9f07-d9e93b934b45 req-90df51ff-d738-4c36-a42b-a5190ee83a9c service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:25.675370 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-d7b31a23-23d6-40fd-9f07-d9e93b934b45 req-90df51ff-d738-4c36-a42b-a5190ee83a9c service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:25.675917 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-d7b31a23-23d6-40fd-9f07-d9e93b934b45 req-90df51ff-d738-4c36-a42b-a5190ee83a9c service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:25.721296 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-d7b31a23-23d6-40fd-9f07-d9e93b934b45 req-90df51ff-d738-4c36-a42b-a5190ee83a9c service nova] Creating event network-vif-unplugged:456f7ca7-21c6-4b5d-8993-9a7c329acf12 for instance fa9dfd3a-a636-48ce-ae15-0ed51baee954 on n-h2-850468-14 Aug 10 23:12:25.748337 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-d7b31a23-23d6-40fd-9f07-d9e93b934b45 req-90df51ff-d738-4c36-a42b-a5190ee83a9c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.135898 Aug 10 23:12:25.764461 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1622/3351] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:12:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:12:25.987652 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-05fa06d1-d31c-4203-b3b9-a712b0f09248 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6160c7a42740efbe3613380933fa15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d90f8a58ad047fa8f347d6474e4d673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:12:25.998402 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-05fa06d1-d31c-4203-b3b9-a712b0f09248 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "GET /compute/v2.1/servers/018fdc62-66af-42a9-b97a-b3c1bb37b04a" status: 200 len: 1272 microversion: 2.1 time: 0.383311 Aug 10 23:12:26.020082 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1730/3352] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:12:25 2022] GET /compute/v2.1/servers/018fdc62-66af-42a9-b97a-b3c1bb37b04a => generated 1272 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:12:26.634958 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-03edacca-9c36-4eba-a347-8c4e5e081f29 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:12:26.636035 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-03edacca-9c36-4eba-a347-8c4e5e081f29 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] [instance: 20d2cf25-e240-4abb-908a-e0ea2bd6e2d6] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:12:26.636221 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-45302b07-d93d-47f9-9573-9754b2cb920c tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:12:26.637360 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-45302b07-d93d-47f9-9573-9754b2cb920c tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] [instance: 8b45f99b-7717-489f-9507-9190a9402f47] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:12:26.661585 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-45302b07-d93d-47f9-9573-9754b2cb920c tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:26.664168 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-03edacca-9c36-4eba-a347-8c4e5e081f29 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:26.664798 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-03edacca-9c36-4eba-a347-8c4e5e081f29 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:26.665227 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-45302b07-d93d-47f9-9573-9754b2cb920c tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:26.666239 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-45302b07-d93d-47f9-9573-9754b2cb920c tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:26.671050 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-45302b07-d93d-47f9-9573-9754b2cb920c tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:26.671469 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-45302b07-d93d-47f9-9573-9754b2cb920c tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:26.672181 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-03edacca-9c36-4eba-a347-8c4e5e081f29 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:26.673699 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-45302b07-d93d-47f9-9573-9754b2cb920c tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:26.673845 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-03edacca-9c36-4eba-a347-8c4e5e081f29 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:26.704662 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-03edacca-9c36-4eba-a347-8c4e5e081f29 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:26.705612 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-03edacca-9c36-4eba-a347-8c4e5e081f29 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:27.392766 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-45302b07-d93d-47f9-9573-9754b2cb920c tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2848edf3f7674fa9b8a3c408b2479f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aa264849a1d4a908907421eed683fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:12:27.397669 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=2 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:12:27.415108 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-45302b07-d93d-47f9-9573-9754b2cb920c tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] 10.222.0.58 "GET /compute/v2.1/servers/8b45f99b-7717-489f-9507-9190a9402f47" status: 200 len: 1313 microversion: 2.1 time: 0.784850 Aug 10 23:12:27.416208 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1623/3353] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:12:26 2022] GET /compute/v2.1/servers/8b45f99b-7717-489f-9507-9190a9402f47 => generated 1313 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:12:27.461763 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-82002402-6dd2-42b4-bbd9-79db307e08a9 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:12:27.465490 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-82002402-6dd2-42b4-bbd9-79db307e08a9 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: 018fdc62-66af-42a9-b97a-b3c1bb37b04a] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:12:27.509705 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-82002402-6dd2-42b4-bbd9-79db307e08a9 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:27.528499 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-82002402-6dd2-42b4-bbd9-79db307e08a9 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:27.529397 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-82002402-6dd2-42b4-bbd9-79db307e08a9 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:27.531997 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-82002402-6dd2-42b4-bbd9-79db307e08a9 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:27.536425 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-82002402-6dd2-42b4-bbd9-79db307e08a9 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:27.540761 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-82002402-6dd2-42b4-bbd9-79db307e08a9 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:27.940329 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-03edacca-9c36-4eba-a347-8c4e5e081f29 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd879a42349cf4570aaaf88ba90492f6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d39cab5115d4818b73ea24cb0987a3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:12:27.961640 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-03edacca-9c36-4eba-a347-8c4e5e081f29 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] 10.222.0.58 "GET /compute/v2.1/servers/20d2cf25-e240-4abb-908a-e0ea2bd6e2d6" status: 200 len: 1292 microversion: 2.1 time: 1.327014 Aug 10 23:12:27.962605 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1731/3354] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:12:26 2022] GET /compute/v2.1/servers/20d2cf25-e240-4abb-908a-e0ea2bd6e2d6 => generated 1292 bytes in 1333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:12:28.444998 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-954e0c44-a3a4-436b-9dc3-99d03f2cf4ee tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:12:28.447149 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-954e0c44-a3a4-436b-9dc3-99d03f2cf4ee tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] [instance: 8b45f99b-7717-489f-9507-9190a9402f47] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:12:28.459442 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-954e0c44-a3a4-436b-9dc3-99d03f2cf4ee tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:28.467728 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-954e0c44-a3a4-436b-9dc3-99d03f2cf4ee tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:28.468448 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-954e0c44-a3a4-436b-9dc3-99d03f2cf4ee tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:28.469370 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-954e0c44-a3a4-436b-9dc3-99d03f2cf4ee tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:28.469999 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-954e0c44-a3a4-436b-9dc3-99d03f2cf4ee tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:28.471769 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-954e0c44-a3a4-436b-9dc3-99d03f2cf4ee tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:29.212471 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-82002402-6dd2-42b4-bbd9-79db307e08a9 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6160c7a42740efbe3613380933fa15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d90f8a58ad047fa8f347d6474e4d673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:12:29.222567 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-82002402-6dd2-42b4-bbd9-79db307e08a9 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "GET /compute/v2.1/servers/018fdc62-66af-42a9-b97a-b3c1bb37b04a" status: 200 len: 1314 microversion: 2.1 time: 1.779472 Aug 10 23:12:29.225563 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1624/3355] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:12:27 2022] GET /compute/v2.1/servers/018fdc62-66af-42a9-b97a-b3c1bb37b04a => generated 1314 bytes in 1783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:12:29.245685 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-ddc63668-1e13-42aa-a825-0bfc97695a54 req-a5c8ea44-aabd-4f6b-8e10-1dc5df87a853 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa9dfd3a-a636-48ce-ae15-0ed51baee954", "name": "network-vif-plugged", "status": "completed", "tag": "456f7ca7-21c6-4b5d-8993-9a7c329acf12"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:12:29.294154 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-ddc63668-1e13-42aa-a825-0bfc97695a54 req-a5c8ea44-aabd-4f6b-8e10-1dc5df87a853 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:29.297056 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-ddc63668-1e13-42aa-a825-0bfc97695a54 req-a5c8ea44-aabd-4f6b-8e10-1dc5df87a853 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:29.301084 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-ddc63668-1e13-42aa-a825-0bfc97695a54 req-a5c8ea44-aabd-4f6b-8e10-1dc5df87a853 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:29.356647 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-ddc63668-1e13-42aa-a825-0bfc97695a54 req-a5c8ea44-aabd-4f6b-8e10-1dc5df87a853 service nova] Creating event network-vif-plugged:456f7ca7-21c6-4b5d-8993-9a7c329acf12 for instance fa9dfd3a-a636-48ce-ae15-0ed51baee954 on n-h2-850468-14 Aug 10 23:12:29.391365 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-ddc63668-1e13-42aa-a825-0bfc97695a54 req-a5c8ea44-aabd-4f6b-8e10-1dc5df87a853 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.155303 Aug 10 23:12:29.396270 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1625/3356] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:12:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:12:29.424877 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-b62d8ab8-e368-4497-8068-e5dfc56a0c8f tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:12:29.425615 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-b62d8ab8-e368-4497-8068-e5dfc56a0c8f tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] [instance: 20d2cf25-e240-4abb-908a-e0ea2bd6e2d6] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:12:29.441882 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b62d8ab8-e368-4497-8068-e5dfc56a0c8f tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:29.442303 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b62d8ab8-e368-4497-8068-e5dfc56a0c8f tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:29.442910 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b62d8ab8-e368-4497-8068-e5dfc56a0c8f tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:29.443965 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b62d8ab8-e368-4497-8068-e5dfc56a0c8f tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:29.449004 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b62d8ab8-e368-4497-8068-e5dfc56a0c8f tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:29.449449 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b62d8ab8-e368-4497-8068-e5dfc56a0c8f tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:29.785134 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-b62d8ab8-e368-4497-8068-e5dfc56a0c8f tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd879a42349cf4570aaaf88ba90492f6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d39cab5115d4818b73ea24cb0987a3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:12:29.794210 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-b62d8ab8-e368-4497-8068-e5dfc56a0c8f tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] 10.222.0.58 "GET /compute/v2.1/servers/20d2cf25-e240-4abb-908a-e0ea2bd6e2d6" status: 200 len: 1292 microversion: 2.1 time: 0.392579 Aug 10 23:12:29.796657 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1626/3357] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:12:29 2022] GET /compute/v2.1/servers/20d2cf25-e240-4abb-908a-e0ea2bd6e2d6 => generated 1292 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:12:29.828361 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-954e0c44-a3a4-436b-9dc3-99d03f2cf4ee tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2848edf3f7674fa9b8a3c408b2479f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aa264849a1d4a908907421eed683fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:12:29.838401 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-954e0c44-a3a4-436b-9dc3-99d03f2cf4ee tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] 10.222.0.58 "GET /compute/v2.1/servers/8b45f99b-7717-489f-9507-9190a9402f47" status: 200 len: 1313 microversion: 2.1 time: 1.400894 Aug 10 23:12:29.852836 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1732/3358] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:12:28 2022] GET /compute/v2.1/servers/8b45f99b-7717-489f-9507-9190a9402f47 => generated 1313 bytes in 1416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:12:30.261074 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-d891efbf-b522-4e69-b7cc-62af9fc5a78a tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:12:30.262307 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-d891efbf-b522-4e69-b7cc-62af9fc5a78a tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: 018fdc62-66af-42a9-b97a-b3c1bb37b04a] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:12:30.301948 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d891efbf-b522-4e69-b7cc-62af9fc5a78a tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:30.302713 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d891efbf-b522-4e69-b7cc-62af9fc5a78a tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:30.303698 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d891efbf-b522-4e69-b7cc-62af9fc5a78a tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:30.306454 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d891efbf-b522-4e69-b7cc-62af9fc5a78a tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:30.313561 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d891efbf-b522-4e69-b7cc-62af9fc5a78a tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:30.318092 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d891efbf-b522-4e69-b7cc-62af9fc5a78a tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:30.323068 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:12:30.415155 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-aa01d634-a0fd-4c9d-adae-02d6f8dde2d4 req-c399487a-9164-4fe6-89fc-06f247cf696c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "018fdc62-66af-42a9-b97a-b3c1bb37b04a", "tag": "17fbbb98-6493-45e4-bcb7-a44f7ea26adf"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:12:30.436467 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-aa01d634-a0fd-4c9d-adae-02d6f8dde2d4 req-c399487a-9164-4fe6-89fc-06f247cf696c service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:30.439903 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-aa01d634-a0fd-4c9d-adae-02d6f8dde2d4 req-c399487a-9164-4fe6-89fc-06f247cf696c service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:30.440503 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-aa01d634-a0fd-4c9d-adae-02d6f8dde2d4 req-c399487a-9164-4fe6-89fc-06f247cf696c service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:30.467158 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-aa01d634-a0fd-4c9d-adae-02d6f8dde2d4 req-c399487a-9164-4fe6-89fc-06f247cf696c service nova] Creating event network-changed:17fbbb98-6493-45e4-bcb7-a44f7ea26adf for instance 018fdc62-66af-42a9-b97a-b3c1bb37b04a on n-h2-850468-14 Aug 10 23:12:30.479917 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-aa01d634-a0fd-4c9d-adae-02d6f8dde2d4 req-c399487a-9164-4fe6-89fc-06f247cf696c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069230 Aug 10 23:12:30.486300 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1733/3359] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:12:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 23:12:30.818760 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-ff9638a4-628c-4434-8dc9-a1642d30bfe3 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:12:30.819676 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-ff9638a4-628c-4434-8dc9-a1642d30bfe3 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] [instance: 20d2cf25-e240-4abb-908a-e0ea2bd6e2d6] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:12:30.835965 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ff9638a4-628c-4434-8dc9-a1642d30bfe3 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:30.836652 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ff9638a4-628c-4434-8dc9-a1642d30bfe3 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:30.842926 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ff9638a4-628c-4434-8dc9-a1642d30bfe3 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:30.843883 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ff9638a4-628c-4434-8dc9-a1642d30bfe3 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:30.844480 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ff9638a4-628c-4434-8dc9-a1642d30bfe3 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:30.845046 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ff9638a4-628c-4434-8dc9-a1642d30bfe3 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:31.113249 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-d891efbf-b522-4e69-b7cc-62af9fc5a78a tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6160c7a42740efbe3613380933fa15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d90f8a58ad047fa8f347d6474e4d673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:12:31.127241 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-d891efbf-b522-4e69-b7cc-62af9fc5a78a tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "GET /compute/v2.1/servers/018fdc62-66af-42a9-b97a-b3c1bb37b04a" status: 200 len: 1314 microversion: 2.1 time: 0.867874 Aug 10 23:12:31.130205 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1627/3360] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:12:30 2022] GET /compute/v2.1/servers/018fdc62-66af-42a9-b97a-b3c1bb37b04a => generated 1314 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:12:31.148322 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-8e832620-05a9-4aa6-b3bc-8cc9e92cbee7 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:12:31.149250 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-8e832620-05a9-4aa6-b3bc-8cc9e92cbee7 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] [instance: 8b45f99b-7717-489f-9507-9190a9402f47] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:12:31.163991 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8e832620-05a9-4aa6-b3bc-8cc9e92cbee7 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:31.164493 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8e832620-05a9-4aa6-b3bc-8cc9e92cbee7 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:31.164931 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8e832620-05a9-4aa6-b3bc-8cc9e92cbee7 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:31.165653 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8e832620-05a9-4aa6-b3bc-8cc9e92cbee7 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:31.166107 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8e832620-05a9-4aa6-b3bc-8cc9e92cbee7 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:31.166531 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8e832620-05a9-4aa6-b3bc-8cc9e92cbee7 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:31.466514 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-8e832620-05a9-4aa6-b3bc-8cc9e92cbee7 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2848edf3f7674fa9b8a3c408b2479f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aa264849a1d4a908907421eed683fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:12:31.478395 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-8e832620-05a9-4aa6-b3bc-8cc9e92cbee7 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] 10.222.0.58 "GET /compute/v2.1/servers/8b45f99b-7717-489f-9507-9190a9402f47" status: 200 len: 1313 microversion: 2.1 time: 0.344718 Aug 10 23:12:31.480075 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1628/3361] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:12:31 2022] GET /compute/v2.1/servers/8b45f99b-7717-489f-9507-9190a9402f47 => generated 1313 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:12:31.486744 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-3ff497d1-db99-472d-9a24-f8a3076a3923 req-ede200ac-0373-447e-869e-c8ef774ae96e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20d2cf25-e240-4abb-908a-e0ea2bd6e2d6", "name": "network-vif-plugged", "status": "completed", "tag": "7b0dfe00-d481-425c-97c7-1a83e3dc3589"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:12:31.504234 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-3ff497d1-db99-472d-9a24-f8a3076a3923 req-ede200ac-0373-447e-869e-c8ef774ae96e service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:31.504974 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-3ff497d1-db99-472d-9a24-f8a3076a3923 req-ede200ac-0373-447e-869e-c8ef774ae96e service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:31.505623 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-3ff497d1-db99-472d-9a24-f8a3076a3923 req-ede200ac-0373-447e-869e-c8ef774ae96e service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:31.565242 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-3ff497d1-db99-472d-9a24-f8a3076a3923 req-ede200ac-0373-447e-869e-c8ef774ae96e service nova] Creating event network-vif-plugged:7b0dfe00-d481-425c-97c7-1a83e3dc3589 for instance 20d2cf25-e240-4abb-908a-e0ea2bd6e2d6 on n-h2-850468-14 Aug 10 23:12:31.577962 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-3ff497d1-db99-472d-9a24-f8a3076a3923 req-ede200ac-0373-447e-869e-c8ef774ae96e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095381 Aug 10 23:12:31.579091 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1629/3362] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:12:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:12:31.923502 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-ff9638a4-628c-4434-8dc9-a1642d30bfe3 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd879a42349cf4570aaaf88ba90492f6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d39cab5115d4818b73ea24cb0987a3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:12:31.942610 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-ff9638a4-628c-4434-8dc9-a1642d30bfe3 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] 10.222.0.58 "GET /compute/v2.1/servers/20d2cf25-e240-4abb-908a-e0ea2bd6e2d6" status: 200 len: 1292 microversion: 2.1 time: 1.125559 Aug 10 23:12:31.943078 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1734/3363] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:12:30 2022] GET /compute/v2.1/servers/20d2cf25-e240-4abb-908a-e0ea2bd6e2d6 => generated 1292 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:12:32.077524 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-d043a030-d1db-4b36-b61c-1ba0ceb730bb tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-571970712", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452", "networks": [{"uuid": "f59e9886-29f6-4d7c-8c57-eb61c3cd6221"}], "key_name": "tempest-TestNetworkAdvancedServerOps-154155458", "security_groups": [{"name": "tempest-secgroup-smoke-379243040"}]}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:12:32.159136 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-b31eaa28-aaaf-41dd-b70d-e259ebc79aa6 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:12:32.159750 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-b31eaa28-aaaf-41dd-b70d-e259ebc79aa6 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: 018fdc62-66af-42a9-b97a-b3c1bb37b04a] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:12:32.161999 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=4 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:12:32.162665 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=16 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:12:32.189183 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b31eaa28-aaaf-41dd-b70d-e259ebc79aa6 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:32.189687 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b31eaa28-aaaf-41dd-b70d-e259ebc79aa6 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:32.190125 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b31eaa28-aaaf-41dd-b70d-e259ebc79aa6 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:32.202266 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b31eaa28-aaaf-41dd-b70d-e259ebc79aa6 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:32.210773 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b31eaa28-aaaf-41dd-b70d-e259ebc79aa6 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:32.213757 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b31eaa28-aaaf-41dd-b70d-e259ebc79aa6 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:32.345551 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=10 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:12:32.901069 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-b31eaa28-aaaf-41dd-b70d-e259ebc79aa6 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6160c7a42740efbe3613380933fa15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d90f8a58ad047fa8f347d6474e4d673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:12:32.909768 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-b31eaa28-aaaf-41dd-b70d-e259ebc79aa6 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "GET /compute/v2.1/servers/018fdc62-66af-42a9-b97a-b3c1bb37b04a" status: 200 len: 1314 microversion: 2.1 time: 0.756068 Aug 10 23:12:32.910356 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1735/3364] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:12:32 2022] GET /compute/v2.1/servers/018fdc62-66af-42a9-b97a-b3c1bb37b04a => generated 1314 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:12:32.934293 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.network.neutron [None req-d043a030-d1db-4b36-b61c-1ba0ceb730bb tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] validate_networks() for [('f59e9886-29f6-4d7c-8c57-eb61c3cd6221', None, None, None, None, None)] {{(pid=122632) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 23:12:32.950057 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-30500bfc-fddd-49f9-b106-03b78cbafa84 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:12:32.951279 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-30500bfc-fddd-49f9-b106-03b78cbafa84 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] [instance: 8b45f99b-7717-489f-9507-9190a9402f47] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:12:32.996495 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-30500bfc-fddd-49f9-b106-03b78cbafa84 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:32.999107 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-30500bfc-fddd-49f9-b106-03b78cbafa84 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:32.999975 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-30500bfc-fddd-49f9-b106-03b78cbafa84 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:33.002478 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-30500bfc-fddd-49f9-b106-03b78cbafa84 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:33.004932 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-30500bfc-fddd-49f9-b106-03b78cbafa84 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:33.008611 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-30500bfc-fddd-49f9-b106-03b78cbafa84 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:33.515962 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-30500bfc-fddd-49f9-b106-03b78cbafa84 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2848edf3f7674fa9b8a3c408b2479f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aa264849a1d4a908907421eed683fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:12:33.530394 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-30500bfc-fddd-49f9-b106-03b78cbafa84 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] 10.222.0.58 "GET /compute/v2.1/servers/8b45f99b-7717-489f-9507-9190a9402f47" status: 200 len: 1313 microversion: 2.1 time: 0.618876 Aug 10 23:12:33.554111 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1736/3365] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:12:32 2022] GET /compute/v2.1/servers/8b45f99b-7717-489f-9507-9190a9402f47 => generated 1313 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:12:33.566501 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-3e6e18ff-529d-4252-a504-0af3650f3532 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:12:33.567186 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-3e6e18ff-529d-4252-a504-0af3650f3532 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] [instance: 20d2cf25-e240-4abb-908a-e0ea2bd6e2d6] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:12:33.600133 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3e6e18ff-529d-4252-a504-0af3650f3532 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:33.601065 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3e6e18ff-529d-4252-a504-0af3650f3532 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:33.601538 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3e6e18ff-529d-4252-a504-0af3650f3532 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:33.602302 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3e6e18ff-529d-4252-a504-0af3650f3532 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:33.602766 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3e6e18ff-529d-4252-a504-0af3650f3532 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:33.603261 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3e6e18ff-529d-4252-a504-0af3650f3532 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:33.964832 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-3e6e18ff-529d-4252-a504-0af3650f3532 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd879a42349cf4570aaaf88ba90492f6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d39cab5115d4818b73ea24cb0987a3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:12:33.984619 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-3e6e18ff-529d-4252-a504-0af3650f3532 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] 10.222.0.58 "GET /compute/v2.1/servers/20d2cf25-e240-4abb-908a-e0ea2bd6e2d6" status: 200 len: 1292 microversion: 2.1 time: 0.439223 Aug 10 23:12:33.986028 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1737/3366] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:12:33 2022] GET /compute/v2.1/servers/20d2cf25-e240-4abb-908a-e0ea2bd6e2d6 => generated 1292 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:12:34.009051 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-a5886d2b-ad71-4cfd-b327-b274f90ad301 req-351e8cbd-1fb5-48f2-9c2c-9c437a64d530 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b45f99b-7717-489f-9507-9190a9402f47", "name": "network-vif-plugged", "status": "completed", "tag": "1f8105d9-27f2-4e73-a7c6-1bd2eabcce21"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:12:34.086381 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-a5886d2b-ad71-4cfd-b327-b274f90ad301 req-351e8cbd-1fb5-48f2-9c2c-9c437a64d530 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:34.087411 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-a5886d2b-ad71-4cfd-b327-b274f90ad301 req-351e8cbd-1fb5-48f2-9c2c-9c437a64d530 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:34.089332 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-a5886d2b-ad71-4cfd-b327-b274f90ad301 req-351e8cbd-1fb5-48f2-9c2c-9c437a64d530 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:34.121686 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-a5886d2b-ad71-4cfd-b327-b274f90ad301 req-351e8cbd-1fb5-48f2-9c2c-9c437a64d530 service nova] Creating event network-vif-plugged:1f8105d9-27f2-4e73-a7c6-1bd2eabcce21 for instance 8b45f99b-7717-489f-9507-9190a9402f47 on n-h1-850468-14 Aug 10 23:12:34.137706 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-a5886d2b-ad71-4cfd-b327-b274f90ad301 req-351e8cbd-1fb5-48f2-9c2c-9c437a64d530 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.148174 Aug 10 23:12:34.141624 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1738/3367] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:12:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:12:34.153633 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-b77ad766-f54e-46c9-af63-d4658e0e10fc tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:12:34.160406 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-b77ad766-f54e-46c9-af63-d4658e0e10fc tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: 018fdc62-66af-42a9-b97a-b3c1bb37b04a] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:12:34.178148 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b77ad766-f54e-46c9-af63-d4658e0e10fc tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:34.180208 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b77ad766-f54e-46c9-af63-d4658e0e10fc tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:34.181797 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b77ad766-f54e-46c9-af63-d4658e0e10fc tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:34.185914 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b77ad766-f54e-46c9-af63-d4658e0e10fc tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:34.186723 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b77ad766-f54e-46c9-af63-d4658e0e10fc tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:34.188507 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b77ad766-f54e-46c9-af63-d4658e0e10fc tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:34.656208 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-b77ad766-f54e-46c9-af63-d4658e0e10fc tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6160c7a42740efbe3613380933fa15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d90f8a58ad047fa8f347d6474e4d673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:12:34.665642 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-b77ad766-f54e-46c9-af63-d4658e0e10fc tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "GET /compute/v2.1/servers/018fdc62-66af-42a9-b97a-b3c1bb37b04a" status: 200 len: 1314 microversion: 2.1 time: 0.521086 Aug 10 23:12:34.666242 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1739/3368] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:12:34 2022] GET /compute/v2.1/servers/018fdc62-66af-42a9-b97a-b3c1bb37b04a => generated 1314 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:12:34.683538 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-09b0a8c7-4eb8-4555-968d-3b506da06546 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:12:34.684218 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-09b0a8c7-4eb8-4555-968d-3b506da06546 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] [instance: 8b45f99b-7717-489f-9507-9190a9402f47] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:12:34.702353 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-09b0a8c7-4eb8-4555-968d-3b506da06546 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:34.702909 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-09b0a8c7-4eb8-4555-968d-3b506da06546 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:34.703361 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-09b0a8c7-4eb8-4555-968d-3b506da06546 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:34.706773 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-09b0a8c7-4eb8-4555-968d-3b506da06546 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:34.707291 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-09b0a8c7-4eb8-4555-968d-3b506da06546 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:34.707733 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-09b0a8c7-4eb8-4555-968d-3b506da06546 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:35.155474 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-09b0a8c7-4eb8-4555-968d-3b506da06546 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2848edf3f7674fa9b8a3c408b2479f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aa264849a1d4a908907421eed683fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:12:35.170176 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-09b0a8c7-4eb8-4555-968d-3b506da06546 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] 10.222.0.58 "GET /compute/v2.1/servers/8b45f99b-7717-489f-9507-9190a9402f47" status: 200 len: 1313 microversion: 2.1 time: 0.502299 Aug 10 23:12:35.173252 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1740/3369] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:12:34 2022] GET /compute/v2.1/servers/8b45f99b-7717-489f-9507-9190a9402f47 => generated 1313 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:12:35.186227 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-49b3c88c-43cf-4d8b-ae4e-0de0fe0c1b56 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:12:35.191706 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-49b3c88c-43cf-4d8b-ae4e-0de0fe0c1b56 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] [instance: 20d2cf25-e240-4abb-908a-e0ea2bd6e2d6] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:12:35.215027 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-49b3c88c-43cf-4d8b-ae4e-0de0fe0c1b56 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:35.215839 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-49b3c88c-43cf-4d8b-ae4e-0de0fe0c1b56 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:35.217179 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-49b3c88c-43cf-4d8b-ae4e-0de0fe0c1b56 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:35.218465 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-49b3c88c-43cf-4d8b-ae4e-0de0fe0c1b56 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:35.230750 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-49b3c88c-43cf-4d8b-ae4e-0de0fe0c1b56 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:35.232069 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-49b3c88c-43cf-4d8b-ae4e-0de0fe0c1b56 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:35.549215 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-49b3c88c-43cf-4d8b-ae4e-0de0fe0c1b56 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd879a42349cf4570aaaf88ba90492f6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d39cab5115d4818b73ea24cb0987a3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:12:35.561649 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-49b3c88c-43cf-4d8b-ae4e-0de0fe0c1b56 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] 10.222.0.58 "GET /compute/v2.1/servers/20d2cf25-e240-4abb-908a-e0ea2bd6e2d6" status: 200 len: 1483 microversion: 2.1 time: 0.387090 Aug 10 23:12:35.566847 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1741/3370] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:12:35 2022] GET /compute/v2.1/servers/20d2cf25-e240-4abb-908a-e0ea2bd6e2d6 => generated 1483 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:12:35.585921 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-38c5d8af-a315-44c4-a941-0d9063742ce2 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:12:35.586900 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-38c5d8af-a315-44c4-a941-0d9063742ce2 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] [instance: 20d2cf25-e240-4abb-908a-e0ea2bd6e2d6] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:12:35.595977 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-38c5d8af-a315-44c4-a941-0d9063742ce2 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:35.596891 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-38c5d8af-a315-44c4-a941-0d9063742ce2 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:35.597568 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-38c5d8af-a315-44c4-a941-0d9063742ce2 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:35.598522 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-38c5d8af-a315-44c4-a941-0d9063742ce2 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:35.599239 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-38c5d8af-a315-44c4-a941-0d9063742ce2 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:35.600478 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-38c5d8af-a315-44c4-a941-0d9063742ce2 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:35.739271 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-38c5d8af-a315-44c4-a941-0d9063742ce2 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] 10.222.0.58 "GET /compute/v2.1/servers/20d2cf25-e240-4abb-908a-e0ea2bd6e2d6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.159245 Aug 10 23:12:35.740613 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1742/3371] 10.222.0.58 () {58 vars in 1275 bytes} [Wed Aug 10 23:12:35 2022] GET /compute/v2.1/servers/20d2cf25-e240-4abb-908a-e0ea2bd6e2d6/os-interface => generated 284 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 23:12:35.745906 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c0b7fd70-0894-49a2-8eec-a1f498d1ccae tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:12:35.747736 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-c0b7fd70-0894-49a2-8eec-a1f498d1ccae tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: 018fdc62-66af-42a9-b97a-b3c1bb37b04a] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:12:35.763163 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c0b7fd70-0894-49a2-8eec-a1f498d1ccae tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:35.765468 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c0b7fd70-0894-49a2-8eec-a1f498d1ccae tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:35.767412 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c0b7fd70-0894-49a2-8eec-a1f498d1ccae tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:35.769469 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c0b7fd70-0894-49a2-8eec-a1f498d1ccae tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:35.774106 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c0b7fd70-0894-49a2-8eec-a1f498d1ccae tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:35.774987 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c0b7fd70-0894-49a2-8eec-a1f498d1ccae tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:36.442884 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-c0b7fd70-0894-49a2-8eec-a1f498d1ccae tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6160c7a42740efbe3613380933fa15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d90f8a58ad047fa8f347d6474e4d673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:12:36.455184 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-c0b7fd70-0894-49a2-8eec-a1f498d1ccae tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "GET /compute/v2.1/servers/018fdc62-66af-42a9-b97a-b3c1bb37b04a" status: 200 len: 1314 microversion: 2.1 time: 0.712775 Aug 10 23:12:36.456285 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1743/3372] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:12:35 2022] GET /compute/v2.1/servers/018fdc62-66af-42a9-b97a-b3c1bb37b04a => generated 1314 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:12:36.485758 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-03fec92e-004e-495c-8041-feefacf28822 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:12:36.486946 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-03fec92e-004e-495c-8041-feefacf28822 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] [instance: 8b45f99b-7717-489f-9507-9190a9402f47] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:12:36.504097 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-03fec92e-004e-495c-8041-feefacf28822 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:36.507371 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-03fec92e-004e-495c-8041-feefacf28822 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:36.507845 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-03fec92e-004e-495c-8041-feefacf28822 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:36.508613 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-03fec92e-004e-495c-8041-feefacf28822 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:36.509083 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-03fec92e-004e-495c-8041-feefacf28822 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:36.509514 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-03fec92e-004e-495c-8041-feefacf28822 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:36.756298 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-d043a030-d1db-4b36-b61c-1ba0ceb730bb tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Flavor limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:12:36.756919 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-d043a030-d1db-4b36-b61c-1ba0ceb730bb tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Image limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:12:36.757236 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-d043a030-d1db-4b36-b61c-1ba0ceb730bb tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Flavor pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:12:36.757936 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-d043a030-d1db-4b36-b61c-1ba0ceb730bb tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Image pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:12:36.759509 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-d043a030-d1db-4b36-b61c-1ba0ceb730bb tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:12:36.795785 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d043a030-d1db-4b36-b61c-1ba0ceb730bb tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:36.796294 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d043a030-d1db-4b36-b61c-1ba0ceb730bb tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:36.796784 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d043a030-d1db-4b36-b61c-1ba0ceb730bb tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:36.797487 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d043a030-d1db-4b36-b61c-1ba0ceb730bb tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:36.797950 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d043a030-d1db-4b36-b61c-1ba0ceb730bb tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:36.798385 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d043a030-d1db-4b36-b61c-1ba0ceb730bb tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:36.880905 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-d043a030-d1db-4b36-b61c-1ba0ceb730bb tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Getting quotas for project 25abd63376614081a9d484f3c9ae950d. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:12:36.900092 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-d043a030-d1db-4b36-b61c-1ba0ceb730bb tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Getting quotas for user 5899b2ad9f1046caaf7c6073e408eeee and project 25abd63376614081a9d484f3c9ae950d. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:12:36.925269 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-d043a030-d1db-4b36-b61c-1ba0ceb730bb tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Going to run 1 instances... {{(pid=122632) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 23:12:36.929037 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-d043a030-d1db-4b36-b61c-1ba0ceb730bb tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] [instance: f4dc6241-b173-4cbf-b76c-7da3fac7edcc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78ad8905-f66f-4733-8be9-2b260f1fabed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122632) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 23:12:37.131733 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-d043a030-d1db-4b36-b61c-1ba0ceb730bb tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 5.059340 Aug 10 23:12:37.136845 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1630/3373] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 23:12:32 2022] POST /compute/v2.1/servers => generated 405 bytes in 5065 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 23:12:37.140642 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-03fec92e-004e-495c-8041-feefacf28822 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2848edf3f7674fa9b8a3c408b2479f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aa264849a1d4a908907421eed683fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:12:37.151531 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-03fec92e-004e-495c-8041-feefacf28822 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] 10.222.0.58 "GET /compute/v2.1/servers/8b45f99b-7717-489f-9507-9190a9402f47" status: 200 len: 1499 microversion: 2.1 time: 0.693226 Aug 10 23:12:37.152411 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1744/3374] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:12:36 2022] GET /compute/v2.1/servers/8b45f99b-7717-489f-9507-9190a9402f47 => generated 1499 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:12:37.188699 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c9858479-b29a-49fe-b313-46928d13ef1b tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:12:37.189486 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-c9858479-b29a-49fe-b313-46928d13ef1b tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] [instance: f4dc6241-b173-4cbf-b76c-7da3fac7edcc] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:12:37.193217 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-3d31e299-7e8f-4062-a888-8e9979399964 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:12:37.196939 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-3d31e299-7e8f-4062-a888-8e9979399964 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] [instance: 8b45f99b-7717-489f-9507-9190a9402f47] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:12:37.217983 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3d31e299-7e8f-4062-a888-8e9979399964 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:37.221095 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3d31e299-7e8f-4062-a888-8e9979399964 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:37.223632 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3d31e299-7e8f-4062-a888-8e9979399964 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:37.227236 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3d31e299-7e8f-4062-a888-8e9979399964 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:37.227935 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3d31e299-7e8f-4062-a888-8e9979399964 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:37.229183 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3d31e299-7e8f-4062-a888-8e9979399964 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:37.294824 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.objects.instance [None req-3d31e299-7e8f-4062-a888-8e9979399964 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lazy-loading 'flavor' on Instance uuid 8b45f99b-7717-489f-9507-9190a9402f47 {{(pid=122633) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:12:37.404017 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:12:37.568502 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-3d31e299-7e8f-4062-a888-8e9979399964 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] 10.222.0.58 "POST /compute/v2.1/servers/8b45f99b-7717-489f-9507-9190a9402f47/action" status: 200 len: 32 microversion: 2.1 time: 0.393950 Aug 10 23:12:37.578017 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1745/3375] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:12:37 2022] POST /compute/v2.1/servers/8b45f99b-7717-489f-9507-9190a9402f47/action => generated 32 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 23:12:37.593093 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-011293b5-bc7a-4c88-ba80-b39b3d9877a5 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:12:37.596317 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-011293b5-bc7a-4c88-ba80-b39b3d9877a5 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: 018fdc62-66af-42a9-b97a-b3c1bb37b04a] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:12:37.621520 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-011293b5-bc7a-4c88-ba80-b39b3d9877a5 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:37.622429 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-011293b5-bc7a-4c88-ba80-b39b3d9877a5 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:37.624405 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-011293b5-bc7a-4c88-ba80-b39b3d9877a5 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:37.626503 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-011293b5-bc7a-4c88-ba80-b39b3d9877a5 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:37.629317 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-011293b5-bc7a-4c88-ba80-b39b3d9877a5 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:37.630516 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-011293b5-bc7a-4c88-ba80-b39b3d9877a5 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:38.225867 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-c9858479-b29a-49fe-b313-46928d13ef1b tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5899b2ad9f1046caaf7c6073e408eeee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25abd63376614081a9d484f3c9ae950d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:12:38.235585 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-c9858479-b29a-49fe-b313-46928d13ef1b tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "GET /compute/v2.1/servers/f4dc6241-b173-4cbf-b76c-7da3fac7edcc" status: 200 len: 1265 microversion: 2.1 time: 1.091549 Aug 10 23:12:38.236180 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1631/3376] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:12:37 2022] GET /compute/v2.1/servers/f4dc6241-b173-4cbf-b76c-7da3fac7edcc => generated 1265 bytes in 1093 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:12:38.263452 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-3ee5571b-8bff-4882-854a-e2c787130a18 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:12:38.264107 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-3ee5571b-8bff-4882-854a-e2c787130a18 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] [instance: 8b45f99b-7717-489f-9507-9190a9402f47] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:12:38.286773 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3ee5571b-8bff-4882-854a-e2c787130a18 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:38.287302 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3ee5571b-8bff-4882-854a-e2c787130a18 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:38.287747 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3ee5571b-8bff-4882-854a-e2c787130a18 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:38.288521 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3ee5571b-8bff-4882-854a-e2c787130a18 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:38.295628 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3ee5571b-8bff-4882-854a-e2c787130a18 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:38.296781 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3ee5571b-8bff-4882-854a-e2c787130a18 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:39.202254 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-011293b5-bc7a-4c88-ba80-b39b3d9877a5 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6160c7a42740efbe3613380933fa15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d90f8a58ad047fa8f347d6474e4d673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:12:39.218605 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-011293b5-bc7a-4c88-ba80-b39b3d9877a5 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "GET /compute/v2.1/servers/018fdc62-66af-42a9-b97a-b3c1bb37b04a" status: 200 len: 1314 microversion: 2.1 time: 1.632761 Aug 10 23:12:39.235528 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1746/3377] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:12:37 2022] GET /compute/v2.1/servers/018fdc62-66af-42a9-b97a-b3c1bb37b04a => generated 1314 bytes in 1657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:12:39.243091 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-01b64fc1-7dce-4776-92b3-89b3176fb0f4 req-e74c22fb-12a8-4f78-91ae-b7c1f881e248 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "018fdc62-66af-42a9-b97a-b3c1bb37b04a", "name": "network-vif-plugged", "status": "completed", "tag": "17fbbb98-6493-45e4-bcb7-a44f7ea26adf"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:12:39.255352 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-01b64fc1-7dce-4776-92b3-89b3176fb0f4 req-e74c22fb-12a8-4f78-91ae-b7c1f881e248 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:39.256106 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-01b64fc1-7dce-4776-92b3-89b3176fb0f4 req-e74c22fb-12a8-4f78-91ae-b7c1f881e248 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:39.256723 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-01b64fc1-7dce-4776-92b3-89b3176fb0f4 req-e74c22fb-12a8-4f78-91ae-b7c1f881e248 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:39.270936 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-01b64fc1-7dce-4776-92b3-89b3176fb0f4 req-e74c22fb-12a8-4f78-91ae-b7c1f881e248 service nova] Creating event network-vif-plugged:17fbbb98-6493-45e4-bcb7-a44f7ea26adf for instance 018fdc62-66af-42a9-b97a-b3c1bb37b04a on n-h2-850468-14 Aug 10 23:12:39.276544 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-01b64fc1-7dce-4776-92b3-89b3176fb0f4 req-e74c22fb-12a8-4f78-91ae-b7c1f881e248 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039489 Aug 10 23:12:39.277385 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1747/3378] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:12:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:12:39.285813 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-9b6f661a-9ec9-45cc-9f90-e620442504ba tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:12:39.288627 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-9b6f661a-9ec9-45cc-9f90-e620442504ba tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] [instance: f4dc6241-b173-4cbf-b76c-7da3fac7edcc] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:12:39.303417 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9b6f661a-9ec9-45cc-9f90-e620442504ba tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:39.307484 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9b6f661a-9ec9-45cc-9f90-e620442504ba tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:39.308382 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9b6f661a-9ec9-45cc-9f90-e620442504ba tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:39.309311 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9b6f661a-9ec9-45cc-9f90-e620442504ba tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:39.315685 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9b6f661a-9ec9-45cc-9f90-e620442504ba tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:39.316453 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9b6f661a-9ec9-45cc-9f90-e620442504ba tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:39.447616 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-3ee5571b-8bff-4882-854a-e2c787130a18 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2848edf3f7674fa9b8a3c408b2479f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aa264849a1d4a908907421eed683fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:12:39.463868 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-3ee5571b-8bff-4882-854a-e2c787130a18 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] 10.222.0.58 "GET /compute/v2.1/servers/8b45f99b-7717-489f-9507-9190a9402f47" status: 200 len: 1505 microversion: 2.1 time: 1.222783 Aug 10 23:12:39.465040 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1632/3379] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:12:38 2022] GET /compute/v2.1/servers/8b45f99b-7717-489f-9507-9190a9402f47 => generated 1505 bytes in 1225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:12:39.505672 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-9b6f661a-9ec9-45cc-9f90-e620442504ba tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5899b2ad9f1046caaf7c6073e408eeee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25abd63376614081a9d484f3c9ae950d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:12:39.514848 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-9b6f661a-9ec9-45cc-9f90-e620442504ba tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "GET /compute/v2.1/servers/f4dc6241-b173-4cbf-b76c-7da3fac7edcc" status: 200 len: 1317 microversion: 2.1 time: 0.235493 Aug 10 23:12:39.521127 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1748/3380] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:12:39 2022] GET /compute/v2.1/servers/f4dc6241-b173-4cbf-b76c-7da3fac7edcc => generated 1317 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:12:39.861200 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-ee3c537c-4802-45eb-94f5-2c5ee636d391 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:12:39.861836 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-ee3c537c-4802-45eb-94f5-2c5ee636d391 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] [instance: 20d2cf25-e240-4abb-908a-e0ea2bd6e2d6] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:12:39.875826 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-3477e9a6-76c8-41b5-8fb2-a67b49348e05 req-f1227da3-234b-4fb6-8254-ff6619e93fa6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "20d2cf25-e240-4abb-908a-e0ea2bd6e2d6", "tag": "7b0dfe00-d481-425c-97c7-1a83e3dc3589"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:12:39.892926 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-3477e9a6-76c8-41b5-8fb2-a67b49348e05 req-f1227da3-234b-4fb6-8254-ff6619e93fa6 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:39.893694 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-3477e9a6-76c8-41b5-8fb2-a67b49348e05 req-f1227da3-234b-4fb6-8254-ff6619e93fa6 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:39.894336 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-3477e9a6-76c8-41b5-8fb2-a67b49348e05 req-f1227da3-234b-4fb6-8254-ff6619e93fa6 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:39.901117 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ee3c537c-4802-45eb-94f5-2c5ee636d391 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:39.901633 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ee3c537c-4802-45eb-94f5-2c5ee636d391 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:39.902087 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ee3c537c-4802-45eb-94f5-2c5ee636d391 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:39.909652 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-3477e9a6-76c8-41b5-8fb2-a67b49348e05 req-f1227da3-234b-4fb6-8254-ff6619e93fa6 service nova] Creating event network-changed:7b0dfe00-d481-425c-97c7-1a83e3dc3589 for instance 20d2cf25-e240-4abb-908a-e0ea2bd6e2d6 on n-h2-850468-14 Aug 10 23:12:39.911048 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ee3c537c-4802-45eb-94f5-2c5ee636d391 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:39.912885 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ee3c537c-4802-45eb-94f5-2c5ee636d391 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:39.914495 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ee3c537c-4802-45eb-94f5-2c5ee636d391 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:39.927876 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-3477e9a6-76c8-41b5-8fb2-a67b49348e05 req-f1227da3-234b-4fb6-8254-ff6619e93fa6 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061319 Aug 10 23:12:39.935480 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1749/3381] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:12:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:12:40.242104 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-583c3430-f85d-4d42-8d1f-d0c0ca23a42d tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:12:40.244941 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-583c3430-f85d-4d42-8d1f-d0c0ca23a42d tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: 018fdc62-66af-42a9-b97a-b3c1bb37b04a] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:12:40.266519 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-583c3430-f85d-4d42-8d1f-d0c0ca23a42d tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:40.267512 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-583c3430-f85d-4d42-8d1f-d0c0ca23a42d tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:40.268439 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-583c3430-f85d-4d42-8d1f-d0c0ca23a42d tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:40.269456 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-583c3430-f85d-4d42-8d1f-d0c0ca23a42d tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:40.270307 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-583c3430-f85d-4d42-8d1f-d0c0ca23a42d tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:40.270893 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-583c3430-f85d-4d42-8d1f-d0c0ca23a42d tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:40.633223 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-583c3430-f85d-4d42-8d1f-d0c0ca23a42d tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6160c7a42740efbe3613380933fa15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d90f8a58ad047fa8f347d6474e4d673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:12:40.644925 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-583c3430-f85d-4d42-8d1f-d0c0ca23a42d tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "GET /compute/v2.1/servers/018fdc62-66af-42a9-b97a-b3c1bb37b04a" status: 200 len: 1314 microversion: 2.1 time: 0.406907 Aug 10 23:12:40.656870 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1750/3382] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:12:40 2022] GET /compute/v2.1/servers/018fdc62-66af-42a9-b97a-b3c1bb37b04a => generated 1314 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:12:40.662377 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-adce46f6-4ea8-4d14-a6cf-356fbbd51c9a tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:12:40.663342 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-adce46f6-4ea8-4d14-a6cf-356fbbd51c9a tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] [instance: 8b45f99b-7717-489f-9507-9190a9402f47] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:12:40.680534 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-adce46f6-4ea8-4d14-a6cf-356fbbd51c9a tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:40.681434 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-adce46f6-4ea8-4d14-a6cf-356fbbd51c9a tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:40.682117 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-adce46f6-4ea8-4d14-a6cf-356fbbd51c9a tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:40.683113 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-adce46f6-4ea8-4d14-a6cf-356fbbd51c9a tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:40.683898 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-adce46f6-4ea8-4d14-a6cf-356fbbd51c9a tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:40.684662 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-adce46f6-4ea8-4d14-a6cf-356fbbd51c9a tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:41.003061 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-adce46f6-4ea8-4d14-a6cf-356fbbd51c9a tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2848edf3f7674fa9b8a3c408b2479f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aa264849a1d4a908907421eed683fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:12:41.014477 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-adce46f6-4ea8-4d14-a6cf-356fbbd51c9a tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] 10.222.0.58 "GET /compute/v2.1/servers/8b45f99b-7717-489f-9507-9190a9402f47" status: 200 len: 1505 microversion: 2.1 time: 0.356026 Aug 10 23:12:41.015770 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1751/3383] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:12:40 2022] GET /compute/v2.1/servers/8b45f99b-7717-489f-9507-9190a9402f47 => generated 1505 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:12:41.024734 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-045aefd7-d165-45a4-aaff-a8f6350cba64 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:12:41.030386 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-045aefd7-d165-45a4-aaff-a8f6350cba64 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] [instance: f4dc6241-b173-4cbf-b76c-7da3fac7edcc] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:12:41.043310 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-045aefd7-d165-45a4-aaff-a8f6350cba64 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:41.051094 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-045aefd7-d165-45a4-aaff-a8f6350cba64 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:41.051651 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-045aefd7-d165-45a4-aaff-a8f6350cba64 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:41.052477 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-045aefd7-d165-45a4-aaff-a8f6350cba64 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:41.053164 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-045aefd7-d165-45a4-aaff-a8f6350cba64 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:41.053797 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-045aefd7-d165-45a4-aaff-a8f6350cba64 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:41.177265 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-ee3c537c-4802-45eb-94f5-2c5ee636d391 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd879a42349cf4570aaaf88ba90492f6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d39cab5115d4818b73ea24cb0987a3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:12:41.187359 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-ee3c537c-4802-45eb-94f5-2c5ee636d391 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] 10.222.0.58 "GET /compute/v2.1/servers/20d2cf25-e240-4abb-908a-e0ea2bd6e2d6" status: 200 len: 1483 microversion: 2.1 time: 1.333144 Aug 10 23:12:41.192827 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1633/3384] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:12:39 2022] GET /compute/v2.1/servers/20d2cf25-e240-4abb-908a-e0ea2bd6e2d6 => generated 1483 bytes in 1339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:12:41.679760 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-7b3d3703-798f-4ef8-a82d-109939737782 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:12:41.680367 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-7b3d3703-798f-4ef8-a82d-109939737782 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: 018fdc62-66af-42a9-b97a-b3c1bb37b04a] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:12:41.693457 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7b3d3703-798f-4ef8-a82d-109939737782 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:41.693956 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7b3d3703-798f-4ef8-a82d-109939737782 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:41.694399 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7b3d3703-798f-4ef8-a82d-109939737782 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:41.695144 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7b3d3703-798f-4ef8-a82d-109939737782 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:41.695599 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7b3d3703-798f-4ef8-a82d-109939737782 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:41.696026 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7b3d3703-798f-4ef8-a82d-109939737782 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:42.133459 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-045aefd7-d165-45a4-aaff-a8f6350cba64 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5899b2ad9f1046caaf7c6073e408eeee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25abd63376614081a9d484f3c9ae950d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:12:42.148765 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-045aefd7-d165-45a4-aaff-a8f6350cba64 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "GET /compute/v2.1/servers/f4dc6241-b173-4cbf-b76c-7da3fac7edcc" status: 200 len: 1390 microversion: 2.1 time: 1.131674 Aug 10 23:12:42.160561 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1752/3385] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:12:41 2022] GET /compute/v2.1/servers/f4dc6241-b173-4cbf-b76c-7da3fac7edcc => generated 1390 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:12:42.172170 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-48bf3967-0f1d-49a4-9c35-32c2b63f9f64 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:12:42.176400 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-48bf3967-0f1d-49a4-9c35-32c2b63f9f64 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] [instance: 8b45f99b-7717-489f-9507-9190a9402f47] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:12:42.190608 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:12:42.194321 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-48bf3967-0f1d-49a4-9c35-32c2b63f9f64 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:42.197516 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-48bf3967-0f1d-49a4-9c35-32c2b63f9f64 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:42.198138 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-48bf3967-0f1d-49a4-9c35-32c2b63f9f64 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:42.206144 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-48bf3967-0f1d-49a4-9c35-32c2b63f9f64 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:42.206861 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-48bf3967-0f1d-49a4-9c35-32c2b63f9f64 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:42.207445 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-48bf3967-0f1d-49a4-9c35-32c2b63f9f64 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:42.542678 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-7b3d3703-798f-4ef8-a82d-109939737782 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6160c7a42740efbe3613380933fa15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d90f8a58ad047fa8f347d6474e4d673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:12:42.557824 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-7b3d3703-798f-4ef8-a82d-109939737782 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "GET /compute/v2.1/servers/018fdc62-66af-42a9-b97a-b3c1bb37b04a" status: 200 len: 1500 microversion: 2.1 time: 0.879528 Aug 10 23:12:42.559783 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1634/3386] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:12:41 2022] GET /compute/v2.1/servers/018fdc62-66af-42a9-b97a-b3c1bb37b04a => generated 1500 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:12:42.581447 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-48bf3967-0f1d-49a4-9c35-32c2b63f9f64 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2848edf3f7674fa9b8a3c408b2479f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aa264849a1d4a908907421eed683fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:12:42.588652 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-75540da6-ef84-4e37-95dc-8ea0c06b638e tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:12:42.593824 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-75540da6-ef84-4e37-95dc-8ea0c06b638e tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: 018fdc62-66af-42a9-b97a-b3c1bb37b04a] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:12:42.595738 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-48bf3967-0f1d-49a4-9c35-32c2b63f9f64 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] 10.222.0.58 "GET /compute/v2.1/servers/8b45f99b-7717-489f-9507-9190a9402f47" status: 200 len: 1505 microversion: 2.1 time: 0.429767 Aug 10 23:12:42.596606 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1753/3387] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:12:42 2022] GET /compute/v2.1/servers/8b45f99b-7717-489f-9507-9190a9402f47 => generated 1505 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:12:42.606128 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-75540da6-ef84-4e37-95dc-8ea0c06b638e tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:42.607196 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-75540da6-ef84-4e37-95dc-8ea0c06b638e tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:42.607688 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-75540da6-ef84-4e37-95dc-8ea0c06b638e tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:42.608469 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-75540da6-ef84-4e37-95dc-8ea0c06b638e tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:42.621011 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-75540da6-ef84-4e37-95dc-8ea0c06b638e tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:42.622364 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-75540da6-ef84-4e37-95dc-8ea0c06b638e tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:42.800258 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-75540da6-ef84-4e37-95dc-8ea0c06b638e tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "POST /compute/v2.1/servers/018fdc62-66af-42a9-b97a-b3c1bb37b04a/action" status: 202 len: 0 microversion: 2.1 time: 0.218306 Aug 10 23:12:42.803643 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1635/3388] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:12:42 2022] POST /compute/v2.1/servers/018fdc62-66af-42a9-b97a-b3c1bb37b04a/action => generated 0 bytes in 223 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 10 23:12:42.812642 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-720f3d65-9fad-4e2d-a40b-a9861ca7887a tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:12:42.813822 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-720f3d65-9fad-4e2d-a40b-a9861ca7887a tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: 018fdc62-66af-42a9-b97a-b3c1bb37b04a] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:12:42.822631 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-720f3d65-9fad-4e2d-a40b-a9861ca7887a tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:42.823743 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-720f3d65-9fad-4e2d-a40b-a9861ca7887a tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:42.824715 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-720f3d65-9fad-4e2d-a40b-a9861ca7887a tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:42.826807 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-720f3d65-9fad-4e2d-a40b-a9861ca7887a tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:42.827867 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-720f3d65-9fad-4e2d-a40b-a9861ca7887a tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:42.828507 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-720f3d65-9fad-4e2d-a40b-a9861ca7887a tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:43.148930 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-720f3d65-9fad-4e2d-a40b-a9861ca7887a tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6160c7a42740efbe3613380933fa15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d90f8a58ad047fa8f347d6474e4d673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:12:43.158269 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-720f3d65-9fad-4e2d-a40b-a9861ca7887a tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "GET /compute/v2.1/servers/018fdc62-66af-42a9-b97a-b3c1bb37b04a" status: 200 len: 1505 microversion: 2.1 time: 0.350343 Aug 10 23:12:43.160720 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1754/3389] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:12:42 2022] GET /compute/v2.1/servers/018fdc62-66af-42a9-b97a-b3c1bb37b04a => generated 1505 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:12:43.175277 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-42b1d516-798a-4f53-9406-f5fad2b901ac tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:12:43.175990 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-42b1d516-798a-4f53-9406-f5fad2b901ac tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] [instance: f4dc6241-b173-4cbf-b76c-7da3fac7edcc] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:12:43.189011 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-42b1d516-798a-4f53-9406-f5fad2b901ac tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:43.189534 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-42b1d516-798a-4f53-9406-f5fad2b901ac tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:43.189994 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-42b1d516-798a-4f53-9406-f5fad2b901ac tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:43.190718 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-42b1d516-798a-4f53-9406-f5fad2b901ac tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:43.191220 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-42b1d516-798a-4f53-9406-f5fad2b901ac tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:43.191647 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-42b1d516-798a-4f53-9406-f5fad2b901ac tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:43.365029 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-d4a63563-3462-4349-a5b5-7ee8f2ecc289 req-ef43a2ec-4c5b-4abf-853a-7801528f96a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4dc6241-b173-4cbf-b76c-7da3fac7edcc", "tag": "d3cf5f02-4cda-4d1b-9314-92bc05402960"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:12:43.391770 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-d4a63563-3462-4349-a5b5-7ee8f2ecc289 req-ef43a2ec-4c5b-4abf-853a-7801528f96a2 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:43.392664 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-d4a63563-3462-4349-a5b5-7ee8f2ecc289 req-ef43a2ec-4c5b-4abf-853a-7801528f96a2 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:43.393252 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-d4a63563-3462-4349-a5b5-7ee8f2ecc289 req-ef43a2ec-4c5b-4abf-853a-7801528f96a2 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:43.413517 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-d4a63563-3462-4349-a5b5-7ee8f2ecc289 req-ef43a2ec-4c5b-4abf-853a-7801528f96a2 service nova] Creating event network-changed:d3cf5f02-4cda-4d1b-9314-92bc05402960 for instance f4dc6241-b173-4cbf-b76c-7da3fac7edcc on n-h1-850468-14 Aug 10 23:12:43.422410 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-d4a63563-3462-4349-a5b5-7ee8f2ecc289 req-ef43a2ec-4c5b-4abf-853a-7801528f96a2 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061575 Aug 10 23:12:43.423662 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1755/3390] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:12:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:12:43.628079 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-6b9d0527-19f2-43cd-b653-770ab9547089 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:12:43.628817 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-6b9d0527-19f2-43cd-b653-770ab9547089 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] [instance: 8b45f99b-7717-489f-9507-9190a9402f47] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:12:43.644854 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6b9d0527-19f2-43cd-b653-770ab9547089 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:43.648233 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6b9d0527-19f2-43cd-b653-770ab9547089 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:43.648755 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6b9d0527-19f2-43cd-b653-770ab9547089 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:43.649604 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6b9d0527-19f2-43cd-b653-770ab9547089 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:43.651179 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6b9d0527-19f2-43cd-b653-770ab9547089 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:43.651888 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6b9d0527-19f2-43cd-b653-770ab9547089 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:43.657867 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-42b1d516-798a-4f53-9406-f5fad2b901ac tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5899b2ad9f1046caaf7c6073e408eeee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25abd63376614081a9d484f3c9ae950d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:12:43.672551 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-42b1d516-798a-4f53-9406-f5fad2b901ac tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "GET /compute/v2.1/servers/f4dc6241-b173-4cbf-b76c-7da3fac7edcc" status: 200 len: 1390 microversion: 2.1 time: 0.501694 Aug 10 23:12:43.691200 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1636/3391] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:12:43 2022] GET /compute/v2.1/servers/f4dc6241-b173-4cbf-b76c-7da3fac7edcc => generated 1390 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:12:43.964035 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-6b9d0527-19f2-43cd-b653-770ab9547089 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2848edf3f7674fa9b8a3c408b2479f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aa264849a1d4a908907421eed683fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:12:43.974523 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-6b9d0527-19f2-43cd-b653-770ab9547089 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] 10.222.0.58 "GET /compute/v2.1/servers/8b45f99b-7717-489f-9507-9190a9402f47" status: 200 len: 1505 microversion: 2.1 time: 0.355836 Aug 10 23:12:43.992961 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1756/3392] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:12:43 2022] GET /compute/v2.1/servers/8b45f99b-7717-489f-9507-9190a9402f47 => generated 1505 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:12:44.187234 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-98ac99d3-fc07-4e80-9013-49aaa45007e2 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:12:44.188131 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-98ac99d3-fc07-4e80-9013-49aaa45007e2 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: 018fdc62-66af-42a9-b97a-b3c1bb37b04a] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:12:44.209806 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-98ac99d3-fc07-4e80-9013-49aaa45007e2 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:44.213743 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-98ac99d3-fc07-4e80-9013-49aaa45007e2 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:44.214624 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-98ac99d3-fc07-4e80-9013-49aaa45007e2 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:44.217340 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-98ac99d3-fc07-4e80-9013-49aaa45007e2 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:44.219550 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-98ac99d3-fc07-4e80-9013-49aaa45007e2 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:44.219997 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-98ac99d3-fc07-4e80-9013-49aaa45007e2 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:44.685078 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-98ac99d3-fc07-4e80-9013-49aaa45007e2 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6160c7a42740efbe3613380933fa15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d90f8a58ad047fa8f347d6474e4d673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:12:44.696441 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-98ac99d3-fc07-4e80-9013-49aaa45007e2 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "GET /compute/v2.1/servers/018fdc62-66af-42a9-b97a-b3c1bb37b04a" status: 200 len: 1485 microversion: 2.1 time: 0.512165 Aug 10 23:12:44.696653 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-f15d8550-708c-433c-8428-a7f12e010062 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:12:44.698224 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-f15d8550-708c-433c-8428-a7f12e010062 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] [instance: f4dc6241-b173-4cbf-b76c-7da3fac7edcc] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:12:44.698585 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1637/3393] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:12:44 2022] GET /compute/v2.1/servers/018fdc62-66af-42a9-b97a-b3c1bb37b04a => generated 1485 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:12:44.709465 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f15d8550-708c-433c-8428-a7f12e010062 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:44.723181 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-3546853f-f140-4790-b11e-440f9f5b5f61 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:12:44.723691 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f15d8550-708c-433c-8428-a7f12e010062 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:44.724078 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-3546853f-f140-4790-b11e-440f9f5b5f61 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: 018fdc62-66af-42a9-b97a-b3c1bb37b04a] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:12:44.724757 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f15d8550-708c-433c-8428-a7f12e010062 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:44.725513 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f15d8550-708c-433c-8428-a7f12e010062 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:44.725981 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f15d8550-708c-433c-8428-a7f12e010062 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:44.729345 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f15d8550-708c-433c-8428-a7f12e010062 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:44.737482 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3546853f-f140-4790-b11e-440f9f5b5f61 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:44.741957 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3546853f-f140-4790-b11e-440f9f5b5f61 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:44.742688 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3546853f-f140-4790-b11e-440f9f5b5f61 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:44.744399 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3546853f-f140-4790-b11e-440f9f5b5f61 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:44.750518 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3546853f-f140-4790-b11e-440f9f5b5f61 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:44.751111 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3546853f-f140-4790-b11e-440f9f5b5f61 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:44.815491 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-3546853f-f140-4790-b11e-440f9f5b5f61 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: 018fdc62-66af-42a9-b97a-b3c1bb37b04a] Going to try to terminate instance {{(pid=122632) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:12:44.989094 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-3546853f-f140-4790-b11e-440f9f5b5f61 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "DELETE /compute/v2.1/servers/018fdc62-66af-42a9-b97a-b3c1bb37b04a" status: 204 len: 0 microversion: 2.1 time: 0.273120 Aug 10 23:12:44.990648 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1638/3394] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:12:44 2022] DELETE /compute/v2.1/servers/018fdc62-66af-42a9-b97a-b3c1bb37b04a => generated 0 bytes in 276 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:12:45.165140 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-0113d0d7-7cb3-407a-a4a3-d19f47c18169 tempest-ServerGroup264TestJSON-887725849 tempest-ServerGroup264TestJSON-887725849-project] Action: 'create', calling method: .version_select at 0x7f847d1e2550>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:12:45.194738 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-0113d0d7-7cb3-407a-a4a3-d19f47c18169 tempest-ServerGroup264TestJSON-887725849 tempest-ServerGroup264TestJSON-887725849-project] Getting quotas for project 51c8ac6a5e7a4d68841ea8ebd85203ff. Resources: {'server_groups'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:12:45.203026 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-0113d0d7-7cb3-407a-a4a3-d19f47c18169 tempest-ServerGroup264TestJSON-887725849 tempest-ServerGroup264TestJSON-887725849-project] Getting quotas for user ee0c6c9a83f3455bb040086d7cd461fc and project 51c8ac6a5e7a4d68841ea8ebd85203ff. Resources: {'server_groups'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:12:45.207681 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=94,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:12:45.277483 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-0113d0d7-7cb3-407a-a4a3-d19f47c18169 tempest-ServerGroup264TestJSON-887725849 tempest-ServerGroup264TestJSON-887725849-project] Getting quotas for project 51c8ac6a5e7a4d68841ea8ebd85203ff. Resources: {'server_groups'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:12:45.287416 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-0113d0d7-7cb3-407a-a4a3-d19f47c18169 tempest-ServerGroup264TestJSON-887725849 tempest-ServerGroup264TestJSON-887725849-project] Getting quotas for user ee0c6c9a83f3455bb040086d7cd461fc and project 51c8ac6a5e7a4d68841ea8ebd85203ff. Resources: {'server_groups'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:12:45.305947 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-0113d0d7-7cb3-407a-a4a3-d19f47c18169 tempest-ServerGroup264TestJSON-887725849 tempest-ServerGroup264TestJSON-887725849-project] 10.222.0.58 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.313550 Aug 10 23:12:45.307058 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1639/3395] 10.222.0.58 () {62 vars in 1214 bytes} [Wed Aug 10 23:12:44 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 23:12:45.313244 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-5722c1df-123b-44e0-85f4-fcec501ed8d1 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:12:45.314448 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-5722c1df-123b-44e0-85f4-fcec501ed8d1 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: 018fdc62-66af-42a9-b97a-b3c1bb37b04a] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:12:45.322174 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5722c1df-123b-44e0-85f4-fcec501ed8d1 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:45.323206 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5722c1df-123b-44e0-85f4-fcec501ed8d1 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:45.324160 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5722c1df-123b-44e0-85f4-fcec501ed8d1 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:45.325732 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5722c1df-123b-44e0-85f4-fcec501ed8d1 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:45.326522 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5722c1df-123b-44e0-85f4-fcec501ed8d1 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:45.327324 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5722c1df-123b-44e0-85f4-fcec501ed8d1 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:45.631769 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-f15d8550-708c-433c-8428-a7f12e010062 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5899b2ad9f1046caaf7c6073e408eeee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25abd63376614081a9d484f3c9ae950d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:12:45.637962 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-5722c1df-123b-44e0-85f4-fcec501ed8d1 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6160c7a42740efbe3613380933fa15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d90f8a58ad047fa8f347d6474e4d673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:12:45.641956 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-f15d8550-708c-433c-8428-a7f12e010062 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "GET /compute/v2.1/servers/f4dc6241-b173-4cbf-b76c-7da3fac7edcc" status: 200 len: 1390 microversion: 2.1 time: 0.949386 Aug 10 23:12:45.651126 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-5722c1df-123b-44e0-85f4-fcec501ed8d1 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "GET /compute/v2.1/servers/018fdc62-66af-42a9-b97a-b3c1bb37b04a" status: 200 len: 1491 microversion: 2.1 time: 0.342242 Aug 10 23:12:45.651611 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1757/3396] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:12:44 2022] GET /compute/v2.1/servers/f4dc6241-b173-4cbf-b76c-7da3fac7edcc => generated 1390 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:12:45.666073 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1640/3397] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:12:45 2022] GET /compute/v2.1/servers/018fdc62-66af-42a9-b97a-b3c1bb37b04a => generated 1491 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:12:45.683422 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-d7945ac0-d1e2-4270-8917-339c3dc94711 tempest-ServerGroup264TestJSON-887725849 tempest-ServerGroup264TestJSON-887725849-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:12:45.685504 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-2f2c0627-f211-4f73-b329-3b4fecfbab6d tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:12:45.686452 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-2f2c0627-f211-4f73-b329-3b4fecfbab6d tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] [instance: 8b45f99b-7717-489f-9507-9190a9402f47] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:12:45.707597 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-d7945ac0-d1e2-4270-8917-339c3dc94711 tempest-ServerGroup264TestJSON-887725849 tempest-ServerGroup264TestJSON-887725849-project] 10.222.0.58 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.040328 Aug 10 23:12:45.709137 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1641/3398] 10.222.0.58 () {60 vars in 1193 bytes} [Wed Aug 10 23:12:45 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 23:12:45.717451 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2f2c0627-f211-4f73-b329-3b4fecfbab6d tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:45.717971 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2f2c0627-f211-4f73-b329-3b4fecfbab6d tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:45.718396 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2f2c0627-f211-4f73-b329-3b4fecfbab6d tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:45.719156 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2f2c0627-f211-4f73-b329-3b4fecfbab6d tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:45.719633 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2f2c0627-f211-4f73-b329-3b4fecfbab6d tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:45.720100 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2f2c0627-f211-4f73-b329-3b4fecfbab6d tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:45.732684 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-9a3cb71f-5502-4f5a-a571-68512c3429c0 tempest-ServerGroup264TestJSON-887725849 tempest-ServerGroup264TestJSON-887725849-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:12:45.745723 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-9a3cb71f-5502-4f5a-a571-68512c3429c0 tempest-ServerGroup264TestJSON-887725849 tempest-ServerGroup264TestJSON-887725849-project] 10.222.0.58 "GET /compute/v2.1/os-server-groups/c4e81564-5fef-43f0-b13c-f270dc0ed76f" status: 200 len: 235 microversion: 2.64 time: 0.024507 Aug 10 23:12:45.746769 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1642/3399] 10.222.0.58 () {60 vars in 1304 bytes} [Wed Aug 10 23:12:45 2022] GET /compute/v2.1/os-server-groups/c4e81564-5fef-43f0-b13c-f270dc0ed76f => generated 235 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 23:12:45.765680 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-415f3341-f6f7-4318-b476-df2bbe3dec11 tempest-ServerGroup264TestJSON-887725849 tempest-ServerGroup264TestJSON-887725849-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:12:45.839928 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-415f3341-f6f7-4318-b476-df2bbe3dec11 tempest-ServerGroup264TestJSON-887725849 tempest-ServerGroup264TestJSON-887725849-project] 10.222.0.58 "DELETE /compute/v2.1/os-server-groups/c4e81564-5fef-43f0-b13c-f270dc0ed76f" status: 204 len: 0 microversion: 2.64 time: 0.079761 Aug 10 23:12:45.855072 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1643/3400] 10.222.0.58 () {60 vars in 1307 bytes} [Wed Aug 10 23:12:45 2022] DELETE /compute/v2.1/os-server-groups/c4e81564-5fef-43f0-b13c-f270dc0ed76f => generated 0 bytes in 91 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 10 23:12:45.863947 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-a66a1795-97c5-4d93-97be-27b21bca8277 tempest-ServerGroup264TestJSON-887725849 tempest-ServerGroup264TestJSON-887725849-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:12:45.876017 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-a66a1795-97c5-4d93-97be-27b21bca8277 tempest-ServerGroup264TestJSON-887725849 tempest-ServerGroup264TestJSON-887725849-project] HTTP exception thrown: Instance group c4e81564-5fef-43f0-b13c-f270dc0ed76f could not be found. Aug 10 23:12:45.886970 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-a66a1795-97c5-4d93-97be-27b21bca8277 tempest-ServerGroup264TestJSON-887725849 tempest-ServerGroup264TestJSON-887725849-project] Request method failure captured: Aug 10 23:12:45.886970 n-d-850468-14 devstack@n-api.service[122632]: request: DELETE /compute/v2.1/os-server-groups/c4e81564-5fef-43f0-b13c-f270dc0ed76f HTTP/1.1 Aug 10 23:12:45.886970 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:12:45.886970 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:12:45.886970 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:12:45.886970 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 23:12:45.886970 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:12:45.886970 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:12:45.886970 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:12:45.886970 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:12:45.886970 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9DtsThRZMmKxnxqx1vVutqTflV5LDvsgBhHE5aXxNCmRsEPYplyiNQfUH6Sa7R26QR-gjQpn_pfO_-nWDiGZAXey9QRXDY6OlsVLjkWA0-jjV831AcMnUISjjNBoSfbQj_hYiPVShWi4xo01btm0PqFfnh3_oh0svh2AtxmK5OK64a0 Aug 10 23:12:45.886970 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:12:45.886970 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:12:45.886970 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:12:45.886970 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:12:45.886970 n-d-850468-14 devstack@n-api.service[122632]: X-Openstack-Nova-Api-Version: 2.64 Aug 10 23:12:45.886970 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:12:45.886970 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:12:45.886970 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 51c8ac6a5e7a4d68841ea8ebd85203ff Aug 10 23:12:45.886970 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-ServerGroup264TestJSON-887725849 Aug 10 23:12:45.886970 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:12:45.886970 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:12:45.886970 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/51c8ac6a5e7a4d68841ea8ebd85203ff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/51c8ac6a5e7a4d68841ea8ebd85203ff"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/51c8ac6a5e7a4d68841ea8ebd85203ff"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_51c8ac6a5e7a4d68841ea8ebd85203ff", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:12:45.886970 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-ServerGroup264TestJSON-887725849 Aug 10 23:12:45.886970 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 51c8ac6a5e7a4d68841ea8ebd85203ff Aug 10 23:12:45.886970 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-ServerGroup264TestJSON-887725849 Aug 10 23:12:45.886970 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-ServerGroup264TestJSON-887725849-project Aug 10 23:12:45.886970 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:12:45.886970 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:12:45.886970 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: ee0c6c9a83f3455bb040086d7cd461fc Aug 10 23:12:45.886970 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-ServerGroup264TestJSON-887725849-project Aug 10 23:12:45.886970 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:12:45.886970 n-d-850468-14 devstack@n-api.service[122632]: exception: Instance group c4e81564-5fef-43f0-b13c-f270dc0ed76f could not be found. Aug 10 23:12:45.886970 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': 'c4e81564-5fef-43f0-b13c-f270dc0ed76f'} Aug 10 23:12:45.886970 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:12:45.886970 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:12:45.886970 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 10 23:12:45.886970 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 10 23:12:45.886970 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 10 23:12:45.886970 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 10 23:12:45.886970 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 10 23:12:45.886970 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 10 23:12:45.886970 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 10 23:12:45.886970 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 10 23:12:45.886970 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 10 23:12:45.886970 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 10 23:12:45.886970 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group c4e81564-5fef-43f0-b13c-f270dc0ed76f could not be found. Aug 10 23:12:45.886970 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:12:45.886970 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:12:45.886970 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:12:45.886970 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:12:45.886970 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:12:45.886970 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:12:45.886970 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:12:45.886970 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:12:45.886970 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:12:45.886970 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:12:45.886970 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 10 23:12:45.886970 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:12:45.886970 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group c4e81564-5fef-43f0-b13c-f270dc0ed76f could not be found. Aug 10 23:12:45.886970 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:12:45.886970 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:12:45.886970 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:12:45.886970 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:12:45.894185 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:12:45.894185 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:12:45.894185 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:12:45.894185 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:12:45.894185 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group c4e81564-5fef-43f0-b13c-f270dc0ed76f could not be found. Aug 10 23:12:45.894185 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:12:45.894185 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-a66a1795-97c5-4d93-97be-27b21bca8277 tempest-ServerGroup264TestJSON-887725849 tempest-ServerGroup264TestJSON-887725849-project] Returning 404 to user: Instance group c4e81564-5fef-43f0-b13c-f270dc0ed76f could not be found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:12:45.894185 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-a66a1795-97c5-4d93-97be-27b21bca8277 tempest-ServerGroup264TestJSON-887725849 tempest-ServerGroup264TestJSON-887725849-project] 10.222.0.58 "DELETE /compute/v2.1/os-server-groups/c4e81564-5fef-43f0-b13c-f270dc0ed76f" status: 404 len: 117 microversion: 2.64 time: 0.029246 Aug 10 23:12:45.894185 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1644/3401] 10.222.0.58 () {60 vars in 1307 bytes} [Wed Aug 10 23:12:45 2022] DELETE /compute/v2.1/os-server-groups/c4e81564-5fef-43f0-b13c-f270dc0ed76f => generated 117 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 10 23:12:46.673243 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c8515bf6-1d3c-4394-bce8-f314e8890d9f tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:12:46.673863 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-c8515bf6-1d3c-4394-bce8-f314e8890d9f tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] [instance: f4dc6241-b173-4cbf-b76c-7da3fac7edcc] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:12:46.688520 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c8515bf6-1d3c-4394-bce8-f314e8890d9f tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:46.689031 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c8515bf6-1d3c-4394-bce8-f314e8890d9f tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:46.689480 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c8515bf6-1d3c-4394-bce8-f314e8890d9f tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:46.690193 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c8515bf6-1d3c-4394-bce8-f314e8890d9f tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:46.691190 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c8515bf6-1d3c-4394-bce8-f314e8890d9f tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:46.691190 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c8515bf6-1d3c-4394-bce8-f314e8890d9f tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:46.736803 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-2f2c0627-f211-4f73-b329-3b4fecfbab6d tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2848edf3f7674fa9b8a3c408b2479f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aa264849a1d4a908907421eed683fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:12:46.773120 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-2f2c0627-f211-4f73-b329-3b4fecfbab6d tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] 10.222.0.58 "GET /compute/v2.1/servers/8b45f99b-7717-489f-9507-9190a9402f47" status: 200 len: 1505 microversion: 2.1 time: 1.112484 Aug 10 23:12:46.773943 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1758/3402] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:12:45 2022] GET /compute/v2.1/servers/8b45f99b-7717-489f-9507-9190a9402f47 => generated 1505 bytes in 1122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:12:46.809848 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-73ec810e-a736-4e83-8577-5938b3f82755 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:12:46.816906 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-73ec810e-a736-4e83-8577-5938b3f82755 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: 018fdc62-66af-42a9-b97a-b3c1bb37b04a] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:12:46.833512 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-73ec810e-a736-4e83-8577-5938b3f82755 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:46.834728 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-73ec810e-a736-4e83-8577-5938b3f82755 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:46.836410 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-73ec810e-a736-4e83-8577-5938b3f82755 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:46.837536 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-73ec810e-a736-4e83-8577-5938b3f82755 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:46.839658 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-73ec810e-a736-4e83-8577-5938b3f82755 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:46.842687 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-73ec810e-a736-4e83-8577-5938b3f82755 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:46.843658 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=2 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:12:47.128055 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-73ec810e-a736-4e83-8577-5938b3f82755 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6160c7a42740efbe3613380933fa15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d90f8a58ad047fa8f347d6474e4d673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:12:47.142098 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-73ec810e-a736-4e83-8577-5938b3f82755 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "GET /compute/v2.1/servers/018fdc62-66af-42a9-b97a-b3c1bb37b04a" status: 200 len: 1491 microversion: 2.1 time: 0.357186 Aug 10 23:12:47.145463 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1759/3403] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:12:46 2022] GET /compute/v2.1/servers/018fdc62-66af-42a9-b97a-b3c1bb37b04a => generated 1491 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:12:47.624428 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-c8515bf6-1d3c-4394-bce8-f314e8890d9f tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5899b2ad9f1046caaf7c6073e408eeee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25abd63376614081a9d484f3c9ae950d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:12:47.641772 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-c8515bf6-1d3c-4394-bce8-f314e8890d9f tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "GET /compute/v2.1/servers/f4dc6241-b173-4cbf-b76c-7da3fac7edcc" status: 200 len: 1390 microversion: 2.1 time: 0.973786 Aug 10 23:12:47.655168 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1645/3404] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:12:46 2022] GET /compute/v2.1/servers/f4dc6241-b173-4cbf-b76c-7da3fac7edcc => generated 1390 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:12:47.800111 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-f2efabfa-95f0-4156-936a-189562c89e00 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:12:47.801598 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-f2efabfa-95f0-4156-936a-189562c89e00 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] [instance: 8b45f99b-7717-489f-9507-9190a9402f47] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:12:47.834002 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f2efabfa-95f0-4156-936a-189562c89e00 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:47.834518 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f2efabfa-95f0-4156-936a-189562c89e00 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:47.835057 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f2efabfa-95f0-4156-936a-189562c89e00 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:47.835968 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f2efabfa-95f0-4156-936a-189562c89e00 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:47.845621 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f2efabfa-95f0-4156-936a-189562c89e00 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:47.847974 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f2efabfa-95f0-4156-936a-189562c89e00 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:48.039030 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-655d756e-479b-4ccb-900a-62e894a898e5 req-ed1ec7c7-2fc9-4843-af0a-f673aca7d628 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "018fdc62-66af-42a9-b97a-b3c1bb37b04a", "name": "network-vif-deleted", "tag": "17fbbb98-6493-45e4-bcb7-a44f7ea26adf"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:12:48.127317 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-655d756e-479b-4ccb-900a-62e894a898e5 req-ed1ec7c7-2fc9-4843-af0a-f673aca7d628 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:48.131743 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-655d756e-479b-4ccb-900a-62e894a898e5 req-ed1ec7c7-2fc9-4843-af0a-f673aca7d628 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:48.132209 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-655d756e-479b-4ccb-900a-62e894a898e5 req-ed1ec7c7-2fc9-4843-af0a-f673aca7d628 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:48.192211 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-655d756e-479b-4ccb-900a-62e894a898e5 req-ed1ec7c7-2fc9-4843-af0a-f673aca7d628 service nova] Creating event network-vif-deleted:17fbbb98-6493-45e4-bcb7-a44f7ea26adf for instance 018fdc62-66af-42a9-b97a-b3c1bb37b04a on n-h2-850468-14 Aug 10 23:12:48.208192 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-655d756e-479b-4ccb-900a-62e894a898e5 req-ed1ec7c7-2fc9-4843-af0a-f673aca7d628 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.175251 Aug 10 23:12:48.217357 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1646/3405] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:12:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:12:48.226352 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-0c570908-3d69-4a31-913d-231af53d99e9 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:12:48.232715 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-0c570908-3d69-4a31-913d-231af53d99e9 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: 018fdc62-66af-42a9-b97a-b3c1bb37b04a] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:12:48.253830 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0c570908-3d69-4a31-913d-231af53d99e9 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:48.261885 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0c570908-3d69-4a31-913d-231af53d99e9 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:48.263171 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0c570908-3d69-4a31-913d-231af53d99e9 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:48.264121 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0c570908-3d69-4a31-913d-231af53d99e9 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:48.264999 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0c570908-3d69-4a31-913d-231af53d99e9 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:48.265621 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0c570908-3d69-4a31-913d-231af53d99e9 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:48.354977 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0c570908-3d69-4a31-913d-231af53d99e9 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:48.355644 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0c570908-3d69-4a31-913d-231af53d99e9 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:48.356222 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0c570908-3d69-4a31-913d-231af53d99e9 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:48.356703 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.objects.instance [None req-0c570908-3d69-4a31-913d-231af53d99e9 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lazy-loading 'fault' on Instance uuid 018fdc62-66af-42a9-b97a-b3c1bb37b04a {{(pid=122632) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:12:48.485976 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-f2efabfa-95f0-4156-936a-189562c89e00 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2848edf3f7674fa9b8a3c408b2479f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aa264849a1d4a908907421eed683fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:12:48.504429 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-f2efabfa-95f0-4156-936a-189562c89e00 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] 10.222.0.58 "GET /compute/v2.1/servers/8b45f99b-7717-489f-9507-9190a9402f47" status: 200 len: 1505 microversion: 2.1 time: 0.708951 Aug 10 23:12:48.506354 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1760/3406] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:12:47 2022] GET /compute/v2.1/servers/8b45f99b-7717-489f-9507-9190a9402f47 => generated 1505 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:12:48.665082 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-5158df92-de75-48ae-bf9b-621274dcfa90 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:12:48.666437 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-5158df92-de75-48ae-bf9b-621274dcfa90 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] [instance: f4dc6241-b173-4cbf-b76c-7da3fac7edcc] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:12:48.683036 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5158df92-de75-48ae-bf9b-621274dcfa90 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:48.683928 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5158df92-de75-48ae-bf9b-621274dcfa90 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:48.685628 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5158df92-de75-48ae-bf9b-621274dcfa90 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:48.688226 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5158df92-de75-48ae-bf9b-621274dcfa90 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:48.694981 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5158df92-de75-48ae-bf9b-621274dcfa90 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:48.695936 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5158df92-de75-48ae-bf9b-621274dcfa90 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:48.734546 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-0c570908-3d69-4a31-913d-231af53d99e9 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6160c7a42740efbe3613380933fa15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d90f8a58ad047fa8f347d6474e4d673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:12:48.758109 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-0c570908-3d69-4a31-913d-231af53d99e9 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "GET /compute/v2.1/servers/018fdc62-66af-42a9-b97a-b3c1bb37b04a" status: 200 len: 1304 microversion: 2.1 time: 0.539527 Aug 10 23:12:48.759277 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1647/3407] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:12:48 2022] GET /compute/v2.1/servers/018fdc62-66af-42a9-b97a-b3c1bb37b04a => generated 1304 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:12:49.488360 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-5158df92-de75-48ae-bf9b-621274dcfa90 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5899b2ad9f1046caaf7c6073e408eeee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25abd63376614081a9d484f3c9ae950d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:12:49.506052 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-5158df92-de75-48ae-bf9b-621274dcfa90 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "GET /compute/v2.1/servers/f4dc6241-b173-4cbf-b76c-7da3fac7edcc" status: 200 len: 1390 microversion: 2.1 time: 0.837658 Aug 10 23:12:49.509681 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1761/3408] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:12:48 2022] GET /compute/v2.1/servers/f4dc6241-b173-4cbf-b76c-7da3fac7edcc => generated 1390 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:12:49.529035 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-1b70614f-cdba-42be-be04-82f5c619e9fa tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:12:49.529777 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-1b70614f-cdba-42be-be04-82f5c619e9fa tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] [instance: 8b45f99b-7717-489f-9507-9190a9402f47] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:12:49.545349 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1b70614f-cdba-42be-be04-82f5c619e9fa tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:49.547541 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1b70614f-cdba-42be-be04-82f5c619e9fa tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:49.548897 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1b70614f-cdba-42be-be04-82f5c619e9fa tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:49.551669 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1b70614f-cdba-42be-be04-82f5c619e9fa tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:49.553363 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1b70614f-cdba-42be-be04-82f5c619e9fa tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:49.554677 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1b70614f-cdba-42be-be04-82f5c619e9fa tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:49.790612 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-8d08483b-cb88-440b-a2bb-41e0c9d0998f tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:12:49.793216 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-8d08483b-cb88-440b-a2bb-41e0c9d0998f tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: 018fdc62-66af-42a9-b97a-b3c1bb37b04a] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:12:49.817378 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8d08483b-cb88-440b-a2bb-41e0c9d0998f tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:49.818308 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8d08483b-cb88-440b-a2bb-41e0c9d0998f tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:49.818753 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8d08483b-cb88-440b-a2bb-41e0c9d0998f tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:49.828789 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8d08483b-cb88-440b-a2bb-41e0c9d0998f tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:49.833351 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8d08483b-cb88-440b-a2bb-41e0c9d0998f tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:49.834069 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8d08483b-cb88-440b-a2bb-41e0c9d0998f tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:49.879251 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-8d08483b-cb88-440b-a2bb-41e0c9d0998f tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] HTTP exception thrown: Instance 018fdc62-66af-42a9-b97a-b3c1bb37b04a could not be found. Aug 10 23:12:49.884445 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-8d08483b-cb88-440b-a2bb-41e0c9d0998f tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Request method failure captured: Aug 10 23:12:49.884445 n-d-850468-14 devstack@n-api.service[122633]: request: GET /compute/v2.1/servers/018fdc62-66af-42a9-b97a-b3c1bb37b04a HTTP/1.1 Aug 10 23:12:49.884445 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:12:49.884445 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:12:49.884445 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:12:49.884445 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:12:49.884445 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:12:49.884445 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:12:49.884445 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:12:49.884445 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:12:49.884445 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9Drr3r82npWIkz1ccNiKcah17mvrMR2EU4HCxqxnaGEEIkGANcRcrX2nHMsvmCLf0usmykCLye_MMWubAbqGw1RDJdO9uNXXKIzwnkO3-8RDYkeEsX4dAb-XLWqGpnC4lB_RQ_yXrj9zJ0yoaNBALi5oi6cnoUgwIrYxNetinerHaU0 Aug 10 23:12:49.884445 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:12:49.884445 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:12:49.884445 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:12:49.884445 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:12:49.884445 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:12:49.884445 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:12:49.884445 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 7d90f8a58ad047fa8f347d6474e4d673 Aug 10 23:12:49.884445 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-DeleteServersTestJSON-311075827 Aug 10 23:12:49.884445 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:12:49.884445 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:12:49.884445 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7d90f8a58ad047fa8f347d6474e4d673"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7d90f8a58ad047fa8f347d6474e4d673"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7d90f8a58ad047fa8f347d6474e4d673"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7d90f8a58ad047fa8f347d6474e4d673", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:12:49.884445 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-DeleteServersTestJSON-311075827 Aug 10 23:12:49.884445 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 7d90f8a58ad047fa8f347d6474e4d673 Aug 10 23:12:49.884445 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-DeleteServersTestJSON-311075827 Aug 10 23:12:49.884445 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-DeleteServersTestJSON-311075827-project Aug 10 23:12:49.884445 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:12:49.884445 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:12:49.884445 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 3c6160c7a42740efbe3613380933fa15 Aug 10 23:12:49.884445 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-DeleteServersTestJSON-311075827-project Aug 10 23:12:49.884445 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:12:49.884445 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance 018fdc62-66af-42a9-b97a-b3c1bb37b04a could not be found. Aug 10 23:12:49.884445 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': '018fdc62-66af-42a9-b97a-b3c1bb37b04a'} Aug 10 23:12:49.884445 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:12:49.884445 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:12:49.884445 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:12:49.884445 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:12:49.884445 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:12:49.884445 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:12:49.884445 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:12:49.884445 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:12:49.884445 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:12:49.884445 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:12:49.884445 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 018fdc62-66af-42a9-b97a-b3c1bb37b04a could not be found. Aug 10 23:12:49.884445 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:12:49.884445 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:12:49.884445 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:12:49.884445 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:12:49.884445 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:12:49.884445 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:12:49.884445 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:12:49.884445 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:12:49.884445 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:12:49.884445 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:12:49.884445 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:12:49.884445 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:12:49.884445 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:12:49.884445 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:12:49.884445 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:12:49.884445 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:12:49.884445 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 018fdc62-66af-42a9-b97a-b3c1bb37b04a could not be found. Aug 10 23:12:49.884445 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:12:49.884445 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:12:49.884445 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:12:49.888799 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:12:49.888799 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:12:49.888799 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:12:49.888799 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:12:49.888799 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:12:49.888799 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 018fdc62-66af-42a9-b97a-b3c1bb37b04a could not be found. Aug 10 23:12:49.888799 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:12:49.888799 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-8d08483b-cb88-440b-a2bb-41e0c9d0998f tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Returning 404 to user: Instance 018fdc62-66af-42a9-b97a-b3c1bb37b04a could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:12:49.888799 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-8d08483b-cb88-440b-a2bb-41e0c9d0998f tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "GET /compute/v2.1/servers/018fdc62-66af-42a9-b97a-b3c1bb37b04a" status: 404 len: 111 microversion: 2.1 time: 0.108330 Aug 10 23:12:49.907338 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1762/3409] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:12:49 2022] GET /compute/v2.1/servers/018fdc62-66af-42a9-b97a-b3c1bb37b04a => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:12:50.093472 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-1b70614f-cdba-42be-be04-82f5c619e9fa tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2848edf3f7674fa9b8a3c408b2479f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aa264849a1d4a908907421eed683fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:12:50.110809 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:12:50.114383 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-1b70614f-cdba-42be-be04-82f5c619e9fa tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] 10.222.0.58 "GET /compute/v2.1/servers/8b45f99b-7717-489f-9507-9190a9402f47" status: 200 len: 1505 microversion: 2.1 time: 0.590970 Aug 10 23:12:50.116066 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1648/3410] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:12:49 2022] GET /compute/v2.1/servers/8b45f99b-7717-489f-9507-9190a9402f47 => generated 1505 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:12:50.179542 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-b27b1273-bd80-4ab1-bada-275958967be1 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-398123168", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452", "networks": [{"uuid": "042efc3d-5a07-4ef1-a5d1-285928545eba"}]}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:12:50.276150 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.network.neutron [None req-b27b1273-bd80-4ab1-bada-275958967be1 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] validate_networks() for [('042efc3d-5a07-4ef1-a5d1-285928545eba', None, None, None, None, None)] {{(pid=122633) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 23:12:50.530946 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-54ba5eb1-c032-4043-a81c-d2557425e213 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:12:50.531722 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-54ba5eb1-c032-4043-a81c-d2557425e213 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] [instance: f4dc6241-b173-4cbf-b76c-7da3fac7edcc] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:12:50.542669 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-54ba5eb1-c032-4043-a81c-d2557425e213 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:50.543408 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-54ba5eb1-c032-4043-a81c-d2557425e213 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:50.544012 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-54ba5eb1-c032-4043-a81c-d2557425e213 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:50.545221 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-54ba5eb1-c032-4043-a81c-d2557425e213 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:50.554308 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-54ba5eb1-c032-4043-a81c-d2557425e213 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:50.555083 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-54ba5eb1-c032-4043-a81c-d2557425e213 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:51.015979 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-54ba5eb1-c032-4043-a81c-d2557425e213 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5899b2ad9f1046caaf7c6073e408eeee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25abd63376614081a9d484f3c9ae950d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:12:51.035699 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-54ba5eb1-c032-4043-a81c-d2557425e213 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "GET /compute/v2.1/servers/f4dc6241-b173-4cbf-b76c-7da3fac7edcc" status: 200 len: 1390 microversion: 2.1 time: 0.509406 Aug 10 23:12:51.039130 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1649/3411] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:12:50 2022] GET /compute/v2.1/servers/f4dc6241-b173-4cbf-b76c-7da3fac7edcc => generated 1390 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:12:51.142553 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-d6a8b4fb-b9da-40e0-bd7f-dc4a0bfac986 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:12:51.143611 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-d6a8b4fb-b9da-40e0-bd7f-dc4a0bfac986 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] [instance: 8b45f99b-7717-489f-9507-9190a9402f47] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:12:51.177920 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d6a8b4fb-b9da-40e0-bd7f-dc4a0bfac986 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:51.178525 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d6a8b4fb-b9da-40e0-bd7f-dc4a0bfac986 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:51.179084 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d6a8b4fb-b9da-40e0-bd7f-dc4a0bfac986 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:51.179890 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d6a8b4fb-b9da-40e0-bd7f-dc4a0bfac986 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:51.180950 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d6a8b4fb-b9da-40e0-bd7f-dc4a0bfac986 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:51.181363 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d6a8b4fb-b9da-40e0-bd7f-dc4a0bfac986 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:51.244569 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-b27b1273-bd80-4ab1-bada-275958967be1 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Flavor limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:12:51.245054 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-b27b1273-bd80-4ab1-bada-275958967be1 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Image limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:12:51.245488 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-b27b1273-bd80-4ab1-bada-275958967be1 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Flavor pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:12:51.245905 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-b27b1273-bd80-4ab1-bada-275958967be1 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Image pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:12:51.246332 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-b27b1273-bd80-4ab1-bada-275958967be1 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:12:51.265607 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b27b1273-bd80-4ab1-bada-275958967be1 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:51.266267 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b27b1273-bd80-4ab1-bada-275958967be1 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:51.266888 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b27b1273-bd80-4ab1-bada-275958967be1 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:51.267729 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b27b1273-bd80-4ab1-bada-275958967be1 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:51.268201 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b27b1273-bd80-4ab1-bada-275958967be1 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:51.268638 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b27b1273-bd80-4ab1-bada-275958967be1 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:51.291128 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-b27b1273-bd80-4ab1-bada-275958967be1 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Getting quotas for project 7d90f8a58ad047fa8f347d6474e4d673. Resources: {'instances', 'cores', 'ram'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:12:51.298330 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-b27b1273-bd80-4ab1-bada-275958967be1 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Getting quotas for user 3c6160c7a42740efbe3613380933fa15 and project 7d90f8a58ad047fa8f347d6474e4d673. Resources: {'instances', 'cores', 'ram'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:12:51.334453 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-b27b1273-bd80-4ab1-bada-275958967be1 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Going to run 1 instances... {{(pid=122633) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 23:12:51.338775 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-b27b1273-bd80-4ab1-bada-275958967be1 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: da69cf1f-ff76-4a68-afe9-fc491b31e8a9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78ad8905-f66f-4733-8be9-2b260f1fabed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122633) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 23:12:51.422878 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-b27b1273-bd80-4ab1-bada-275958967be1 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.247579 Aug 10 23:12:51.423898 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1763/3412] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 23:12:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 1249 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 23:12:51.439434 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-12283ac0-687f-45a3-9700-1c5d0c47de0f tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:12:51.440389 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-12283ac0-687f-45a3-9700-1c5d0c47de0f tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: da69cf1f-ff76-4a68-afe9-fc491b31e8a9] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:12:51.514313 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-12283ac0-687f-45a3-9700-1c5d0c47de0f tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6160c7a42740efbe3613380933fa15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d90f8a58ad047fa8f347d6474e4d673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:12:51.527286 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-12283ac0-687f-45a3-9700-1c5d0c47de0f tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "GET /compute/v2.1/servers/da69cf1f-ff76-4a68-afe9-fc491b31e8a9" status: 200 len: 1214 microversion: 2.1 time: 0.094194 Aug 10 23:12:51.530076 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1764/3413] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:12:51 2022] GET /compute/v2.1/servers/da69cf1f-ff76-4a68-afe9-fc491b31e8a9 => generated 1214 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:12:51.690718 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-d6a8b4fb-b9da-40e0-bd7f-dc4a0bfac986 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2848edf3f7674fa9b8a3c408b2479f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aa264849a1d4a908907421eed683fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:12:51.699305 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-d6a8b4fb-b9da-40e0-bd7f-dc4a0bfac986 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] 10.222.0.58 "GET /compute/v2.1/servers/8b45f99b-7717-489f-9507-9190a9402f47" status: 200 len: 1505 microversion: 2.1 time: 0.565882 Aug 10 23:12:51.700463 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1650/3414] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:12:51 2022] GET /compute/v2.1/servers/8b45f99b-7717-489f-9507-9190a9402f47 => generated 1505 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:12:52.041420 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-12badf52-cb4c-4bc6-99f6-25c05427d289 req-d21ff967-322d-4a52-9f92-49166c76e299 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4dc6241-b173-4cbf-b76c-7da3fac7edcc", "name": "network-vif-plugged", "status": "completed", "tag": "d3cf5f02-4cda-4d1b-9314-92bc05402960"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:12:52.063205 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-42236776-a9f9-4cef-a734-6875c7a19086 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:12:52.064023 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-42236776-a9f9-4cef-a734-6875c7a19086 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] [instance: f4dc6241-b173-4cbf-b76c-7da3fac7edcc] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:12:52.085415 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-12badf52-cb4c-4bc6-99f6-25c05427d289 req-d21ff967-322d-4a52-9f92-49166c76e299 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:52.085673 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-42236776-a9f9-4cef-a734-6875c7a19086 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:52.086445 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-42236776-a9f9-4cef-a734-6875c7a19086 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:52.087069 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-42236776-a9f9-4cef-a734-6875c7a19086 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:52.089232 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-42236776-a9f9-4cef-a734-6875c7a19086 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:52.090924 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-12badf52-cb4c-4bc6-99f6-25c05427d289 req-d21ff967-322d-4a52-9f92-49166c76e299 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:52.092064 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-42236776-a9f9-4cef-a734-6875c7a19086 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:52.092665 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-42236776-a9f9-4cef-a734-6875c7a19086 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:52.093724 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-12badf52-cb4c-4bc6-99f6-25c05427d289 req-d21ff967-322d-4a52-9f92-49166c76e299 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:52.120506 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-12badf52-cb4c-4bc6-99f6-25c05427d289 req-d21ff967-322d-4a52-9f92-49166c76e299 service nova] Creating event network-vif-plugged:d3cf5f02-4cda-4d1b-9314-92bc05402960 for instance f4dc6241-b173-4cbf-b76c-7da3fac7edcc on n-h1-850468-14 Aug 10 23:12:52.159515 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-12badf52-cb4c-4bc6-99f6-25c05427d289 req-d21ff967-322d-4a52-9f92-49166c76e299 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121767 Aug 10 23:12:52.199884 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1765/3415] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:12:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:12:52.244725 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-0fe34feb-dfac-4043-82bb-3cdcb700f955 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:12:52.245442 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-0fe34feb-dfac-4043-82bb-3cdcb700f955 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: fa9dfd3a-a636-48ce-ae15-0ed51baee954] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:12:52.295173 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0fe34feb-dfac-4043-82bb-3cdcb700f955 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:52.295785 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0fe34feb-dfac-4043-82bb-3cdcb700f955 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:52.296243 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0fe34feb-dfac-4043-82bb-3cdcb700f955 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:52.297215 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0fe34feb-dfac-4043-82bb-3cdcb700f955 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:52.297658 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0fe34feb-dfac-4043-82bb-3cdcb700f955 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:52.298083 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0fe34feb-dfac-4043-82bb-3cdcb700f955 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:52.329605 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:12:52.518953 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-42236776-a9f9-4cef-a734-6875c7a19086 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5899b2ad9f1046caaf7c6073e408eeee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25abd63376614081a9d484f3c9ae950d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:12:52.532128 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-0fe34feb-dfac-4043-82bb-3cdcb700f955 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:12:52.533922 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-42236776-a9f9-4cef-a734-6875c7a19086 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "GET /compute/v2.1/servers/f4dc6241-b173-4cbf-b76c-7da3fac7edcc" status: 200 len: 1390 microversion: 2.1 time: 0.476220 Aug 10 23:12:52.534495 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1651/3416] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:12:52 2022] GET /compute/v2.1/servers/f4dc6241-b173-4cbf-b76c-7da3fac7edcc => generated 1390 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:12:52.547153 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-0fe34feb-dfac-4043-82bb-3cdcb700f955 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954" status: 200 len: 1667 microversion: 2.1 time: 0.316225 Aug 10 23:12:52.561900 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1766/3417] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:12:52 2022] GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954 => generated 1667 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:12:52.564658 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-46b97ca1-6b49-42b0-8952-f60ea65e4994 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:12:52.567558 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-46b97ca1-6b49-42b0-8952-f60ea65e4994 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: da69cf1f-ff76-4a68-afe9-fc491b31e8a9] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:12:52.577048 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-46b97ca1-6b49-42b0-8952-f60ea65e4994 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:52.577764 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-46b97ca1-6b49-42b0-8952-f60ea65e4994 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:52.578340 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-46b97ca1-6b49-42b0-8952-f60ea65e4994 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:52.579284 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-46b97ca1-6b49-42b0-8952-f60ea65e4994 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:52.579923 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-46b97ca1-6b49-42b0-8952-f60ea65e4994 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:52.580491 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-46b97ca1-6b49-42b0-8952-f60ea65e4994 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:52.580712 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-0b3983e4-e191-4750-8393-9d225f2eb9da tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-710378332"}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:12:52.587976 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-0b3983e4-e191-4750-8393-9d225f2eb9da tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: fa9dfd3a-a636-48ce-ae15-0ed51baee954] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:12:52.611787 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0b3983e4-e191-4750-8393-9d225f2eb9da tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:52.612679 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0b3983e4-e191-4750-8393-9d225f2eb9da tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:52.613503 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0b3983e4-e191-4750-8393-9d225f2eb9da tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:52.614475 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0b3983e4-e191-4750-8393-9d225f2eb9da tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:52.614980 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0b3983e4-e191-4750-8393-9d225f2eb9da tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:52.615408 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0b3983e4-e191-4750-8393-9d225f2eb9da tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:52.736731 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-46b97ca1-6b49-42b0-8952-f60ea65e4994 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6160c7a42740efbe3613380933fa15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d90f8a58ad047fa8f347d6474e4d673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:12:52.747912 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-46b97ca1-6b49-42b0-8952-f60ea65e4994 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "GET /compute/v2.1/servers/da69cf1f-ff76-4a68-afe9-fc491b31e8a9" status: 200 len: 1266 microversion: 2.1 time: 0.197958 Aug 10 23:12:52.749048 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1652/3418] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:12:52 2022] GET /compute/v2.1/servers/da69cf1f-ff76-4a68-afe9-fc491b31e8a9 => generated 1266 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:12:52.754627 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-f29faf08-fccb-40f3-bc64-5f2238dd8a6f tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:12:52.755530 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-f29faf08-fccb-40f3-bc64-5f2238dd8a6f tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] [instance: 8b45f99b-7717-489f-9507-9190a9402f47] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:12:52.768279 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f29faf08-fccb-40f3-bc64-5f2238dd8a6f tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:52.769111 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f29faf08-fccb-40f3-bc64-5f2238dd8a6f tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:52.769928 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f29faf08-fccb-40f3-bc64-5f2238dd8a6f tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:52.770890 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f29faf08-fccb-40f3-bc64-5f2238dd8a6f tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:52.771835 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f29faf08-fccb-40f3-bc64-5f2238dd8a6f tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:52.772438 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f29faf08-fccb-40f3-bc64-5f2238dd8a6f tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:52.965764 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-0b3983e4-e191-4750-8393-9d225f2eb9da tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "POST /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954/action" status: 202 len: 0 microversion: 2.1 time: 0.392911 Aug 10 23:12:52.967454 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1767/3419] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:12:52 2022] POST /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954/action => generated 0 bytes in 397 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Aug 10 23:12:52.989945 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-477752c8-0d97-451d-84d6-cc73658deca0 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:12:52.991497 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-477752c8-0d97-451d-84d6-cc73658deca0 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: fa9dfd3a-a636-48ce-ae15-0ed51baee954] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:12:53.003233 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-477752c8-0d97-451d-84d6-cc73658deca0 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:53.004102 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-477752c8-0d97-451d-84d6-cc73658deca0 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:53.004775 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-477752c8-0d97-451d-84d6-cc73658deca0 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:53.006009 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-477752c8-0d97-451d-84d6-cc73658deca0 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:53.006884 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-477752c8-0d97-451d-84d6-cc73658deca0 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:53.007584 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-477752c8-0d97-451d-84d6-cc73658deca0 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:53.202054 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-f29faf08-fccb-40f3-bc64-5f2238dd8a6f tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2848edf3f7674fa9b8a3c408b2479f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aa264849a1d4a908907421eed683fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:12:53.210333 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-f29faf08-fccb-40f3-bc64-5f2238dd8a6f tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] 10.222.0.58 "GET /compute/v2.1/servers/8b45f99b-7717-489f-9507-9190a9402f47" status: 200 len: 1505 microversion: 2.1 time: 0.459999 Aug 10 23:12:53.210953 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1653/3420] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:12:52 2022] GET /compute/v2.1/servers/8b45f99b-7717-489f-9507-9190a9402f47 => generated 1505 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:12:53.354081 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-477752c8-0d97-451d-84d6-cc73658deca0 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:12:53.363882 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-477752c8-0d97-451d-84d6-cc73658deca0 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954" status: 200 len: 1677 microversion: 2.1 time: 0.387326 Aug 10 23:12:53.364588 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1768/3421] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:12:52 2022] GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954 => generated 1677 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:12:53.563269 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-b7f8ce7e-b727-4447-a202-5881f02ce961 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:12:53.564342 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-b7f8ce7e-b727-4447-a202-5881f02ce961 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] [instance: f4dc6241-b173-4cbf-b76c-7da3fac7edcc] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:12:53.574444 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b7f8ce7e-b727-4447-a202-5881f02ce961 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:53.575569 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b7f8ce7e-b727-4447-a202-5881f02ce961 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:53.576073 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b7f8ce7e-b727-4447-a202-5881f02ce961 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:53.576771 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b7f8ce7e-b727-4447-a202-5881f02ce961 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:53.577940 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b7f8ce7e-b727-4447-a202-5881f02ce961 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:53.578552 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b7f8ce7e-b727-4447-a202-5881f02ce961 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:53.770006 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-79925f90-7300-43e6-a19b-03a03fd46027 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:12:53.771516 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-79925f90-7300-43e6-a19b-03a03fd46027 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: da69cf1f-ff76-4a68-afe9-fc491b31e8a9] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:12:53.779218 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-79925f90-7300-43e6-a19b-03a03fd46027 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:53.780110 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-79925f90-7300-43e6-a19b-03a03fd46027 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:53.780560 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-79925f90-7300-43e6-a19b-03a03fd46027 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:53.781273 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-79925f90-7300-43e6-a19b-03a03fd46027 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:53.782342 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-79925f90-7300-43e6-a19b-03a03fd46027 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:53.782774 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-79925f90-7300-43e6-a19b-03a03fd46027 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:53.918817 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-79925f90-7300-43e6-a19b-03a03fd46027 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6160c7a42740efbe3613380933fa15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d90f8a58ad047fa8f347d6474e4d673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:12:53.923734 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-b7f8ce7e-b727-4447-a202-5881f02ce961 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5899b2ad9f1046caaf7c6073e408eeee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25abd63376614081a9d484f3c9ae950d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:12:53.929498 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-79925f90-7300-43e6-a19b-03a03fd46027 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "GET /compute/v2.1/servers/da69cf1f-ff76-4a68-afe9-fc491b31e8a9" status: 200 len: 1272 microversion: 2.1 time: 0.163636 Aug 10 23:12:53.930745 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1769/3422] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:12:53 2022] GET /compute/v2.1/servers/da69cf1f-ff76-4a68-afe9-fc491b31e8a9 => generated 1272 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:12:53.939593 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-b7f8ce7e-b727-4447-a202-5881f02ce961 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "GET /compute/v2.1/servers/f4dc6241-b173-4cbf-b76c-7da3fac7edcc" status: 200 len: 1390 microversion: 2.1 time: 0.383089 Aug 10 23:12:53.940517 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1654/3423] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:12:53 2022] GET /compute/v2.1/servers/f4dc6241-b173-4cbf-b76c-7da3fac7edcc => generated 1390 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:12:54.239426 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-7538467c-a384-484c-9871-772bb4c36214 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:12:54.242942 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-7538467c-a384-484c-9871-772bb4c36214 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] [instance: 8b45f99b-7717-489f-9507-9190a9402f47] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:12:54.257788 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7538467c-a384-484c-9871-772bb4c36214 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:54.259709 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7538467c-a384-484c-9871-772bb4c36214 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:54.260384 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7538467c-a384-484c-9871-772bb4c36214 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:54.261670 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7538467c-a384-484c-9871-772bb4c36214 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:54.269178 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7538467c-a384-484c-9871-772bb4c36214 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:54.269802 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7538467c-a384-484c-9871-772bb4c36214 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:54.387174 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c5be5e7a-f688-4e0d-ad1b-f328611b4e52 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:12:54.387854 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-c5be5e7a-f688-4e0d-ad1b-f328611b4e52 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: fa9dfd3a-a636-48ce-ae15-0ed51baee954] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:12:54.399470 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c5be5e7a-f688-4e0d-ad1b-f328611b4e52 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:54.400205 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c5be5e7a-f688-4e0d-ad1b-f328611b4e52 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:54.400803 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c5be5e7a-f688-4e0d-ad1b-f328611b4e52 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:54.404057 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c5be5e7a-f688-4e0d-ad1b-f328611b4e52 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:54.406101 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c5be5e7a-f688-4e0d-ad1b-f328611b4e52 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:54.410684 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c5be5e7a-f688-4e0d-ad1b-f328611b4e52 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:54.568726 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-7538467c-a384-484c-9871-772bb4c36214 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2848edf3f7674fa9b8a3c408b2479f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aa264849a1d4a908907421eed683fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:12:54.581204 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-7538467c-a384-484c-9871-772bb4c36214 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] 10.222.0.58 "GET /compute/v2.1/servers/8b45f99b-7717-489f-9507-9190a9402f47" status: 200 len: 1505 microversion: 2.1 time: 0.352728 Aug 10 23:12:54.596998 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1770/3424] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:12:54 2022] GET /compute/v2.1/servers/8b45f99b-7717-489f-9507-9190a9402f47 => generated 1505 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:12:54.872602 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-c5be5e7a-f688-4e0d-ad1b-f328611b4e52 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:12:54.882339 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-c5be5e7a-f688-4e0d-ad1b-f328611b4e52 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954" status: 200 len: 1677 microversion: 2.1 time: 0.499226 Aug 10 23:12:54.884565 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1655/3425] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:12:54 2022] GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954 => generated 1677 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:12:54.955154 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-0ae4f642-0506-43b2-ac01-aa6e8d114557 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:12:54.956063 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-0ae4f642-0506-43b2-ac01-aa6e8d114557 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: da69cf1f-ff76-4a68-afe9-fc491b31e8a9] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:12:54.971174 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0ae4f642-0506-43b2-ac01-aa6e8d114557 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:54.971823 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0ae4f642-0506-43b2-ac01-aa6e8d114557 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:54.972493 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0ae4f642-0506-43b2-ac01-aa6e8d114557 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:54.973355 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0ae4f642-0506-43b2-ac01-aa6e8d114557 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:54.975642 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0ae4f642-0506-43b2-ac01-aa6e8d114557 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:54.977156 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0ae4f642-0506-43b2-ac01-aa6e8d114557 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:54.979424 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-14056808-4dd0-4c09-995c-b245148b06b3 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:12:54.980611 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-14056808-4dd0-4c09-995c-b245148b06b3 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] [instance: f4dc6241-b173-4cbf-b76c-7da3fac7edcc] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:12:54.993922 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-14056808-4dd0-4c09-995c-b245148b06b3 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:55.000905 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-14056808-4dd0-4c09-995c-b245148b06b3 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:55.001613 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-14056808-4dd0-4c09-995c-b245148b06b3 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:55.003066 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-14056808-4dd0-4c09-995c-b245148b06b3 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:55.003681 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-14056808-4dd0-4c09-995c-b245148b06b3 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:55.005787 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-14056808-4dd0-4c09-995c-b245148b06b3 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:55.300298 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=16 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:12:55.473994 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-14056808-4dd0-4c09-995c-b245148b06b3 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5899b2ad9f1046caaf7c6073e408eeee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25abd63376614081a9d484f3c9ae950d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:12:55.482005 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-14056808-4dd0-4c09-995c-b245148b06b3 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "GET /compute/v2.1/servers/f4dc6241-b173-4cbf-b76c-7da3fac7edcc" status: 200 len: 1563 microversion: 2.1 time: 0.519892 Aug 10 23:12:55.487098 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1656/3426] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:12:54 2022] GET /compute/v2.1/servers/f4dc6241-b173-4cbf-b76c-7da3fac7edcc => generated 1563 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:12:55.504647 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-f0a668b0-99be-45bf-a293-4aa51edc2f0e tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:12:55.505292 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-f0a668b0-99be-45bf-a293-4aa51edc2f0e tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] [instance: f4dc6241-b173-4cbf-b76c-7da3fac7edcc] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:12:55.512505 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f0a668b0-99be-45bf-a293-4aa51edc2f0e tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:55.521808 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f0a668b0-99be-45bf-a293-4aa51edc2f0e tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:55.522556 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f0a668b0-99be-45bf-a293-4aa51edc2f0e tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:55.523361 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f0a668b0-99be-45bf-a293-4aa51edc2f0e tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:55.523836 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f0a668b0-99be-45bf-a293-4aa51edc2f0e tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:55.524269 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f0a668b0-99be-45bf-a293-4aa51edc2f0e tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:55.702987 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-0ae4f642-0506-43b2-ac01-aa6e8d114557 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6160c7a42740efbe3613380933fa15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d90f8a58ad047fa8f347d6474e4d673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:12:55.715025 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-0ae4f642-0506-43b2-ac01-aa6e8d114557 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "GET /compute/v2.1/servers/da69cf1f-ff76-4a68-afe9-fc491b31e8a9" status: 200 len: 1314 microversion: 2.1 time: 0.766064 Aug 10 23:12:55.716696 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1771/3427] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:12:54 2022] GET /compute/v2.1/servers/da69cf1f-ff76-4a68-afe9-fc491b31e8a9 => generated 1314 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:12:55.721786 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-ae142b3d-3c04-4439-bd3a-b6a1f4174d1f tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:12:55.722706 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-ae142b3d-3c04-4439-bd3a-b6a1f4174d1f tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] [instance: 8b45f99b-7717-489f-9507-9190a9402f47] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:12:55.732934 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ae142b3d-3c04-4439-bd3a-b6a1f4174d1f tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:55.733954 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ae142b3d-3c04-4439-bd3a-b6a1f4174d1f tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:55.734633 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ae142b3d-3c04-4439-bd3a-b6a1f4174d1f tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:55.735712 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ae142b3d-3c04-4439-bd3a-b6a1f4174d1f tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:55.736676 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ae142b3d-3c04-4439-bd3a-b6a1f4174d1f tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:55.737458 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ae142b3d-3c04-4439-bd3a-b6a1f4174d1f tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:55.974081 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-f0a668b0-99be-45bf-a293-4aa51edc2f0e tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5899b2ad9f1046caaf7c6073e408eeee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25abd63376614081a9d484f3c9ae950d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:12:55.987748 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-f0a668b0-99be-45bf-a293-4aa51edc2f0e tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "GET /compute/v2.1/servers/f4dc6241-b173-4cbf-b76c-7da3fac7edcc" status: 200 len: 1563 microversion: 2.1 time: 0.486020 Aug 10 23:12:55.990170 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1657/3428] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:12:55 2022] GET /compute/v2.1/servers/f4dc6241-b173-4cbf-b76c-7da3fac7edcc => generated 1563 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:12:56.006376 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-b8d3e497-8e1d-4430-9090-01f85adba260 req-0d103e13-2882-4304-910d-f2d3b35f01de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da69cf1f-ff76-4a68-afe9-fc491b31e8a9", "tag": "1fe8c8ad-aad0-4a76-a5ed-01061f46152f"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:12:56.019856 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-b8d3e497-8e1d-4430-9090-01f85adba260 req-0d103e13-2882-4304-910d-f2d3b35f01de service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:56.023073 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-b8d3e497-8e1d-4430-9090-01f85adba260 req-0d103e13-2882-4304-910d-f2d3b35f01de service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:56.023801 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-b8d3e497-8e1d-4430-9090-01f85adba260 req-0d103e13-2882-4304-910d-f2d3b35f01de service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:56.034769 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-ae142b3d-3c04-4439-bd3a-b6a1f4174d1f tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2848edf3f7674fa9b8a3c408b2479f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aa264849a1d4a908907421eed683fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:12:56.041453 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-b8d3e497-8e1d-4430-9090-01f85adba260 req-0d103e13-2882-4304-910d-f2d3b35f01de service nova] Creating event network-changed:1fe8c8ad-aad0-4a76-a5ed-01061f46152f for instance da69cf1f-ff76-4a68-afe9-fc491b31e8a9 on n-h2-850468-14 Aug 10 23:12:56.043596 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-ae142b3d-3c04-4439-bd3a-b6a1f4174d1f tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] 10.222.0.58 "GET /compute/v2.1/servers/8b45f99b-7717-489f-9507-9190a9402f47" status: 200 len: 1505 microversion: 2.1 time: 0.325382 Aug 10 23:12:56.049153 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1772/3429] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:12:55 2022] GET /compute/v2.1/servers/8b45f99b-7717-489f-9507-9190a9402f47 => generated 1505 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:12:56.063215 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-b8d3e497-8e1d-4430-9090-01f85adba260 req-0d103e13-2882-4304-910d-f2d3b35f01de service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057523 Aug 10 23:12:56.063215 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1658/3430] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:12:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:12:56.063361 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-d0c024e5-250e-4a35-bb2c-4b2ea7d8353b tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:12:56.063361 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-d0c024e5-250e-4a35-bb2c-4b2ea7d8353b tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: fa9dfd3a-a636-48ce-ae15-0ed51baee954] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:12:56.068616 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d0c024e5-250e-4a35-bb2c-4b2ea7d8353b tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:56.069122 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d0c024e5-250e-4a35-bb2c-4b2ea7d8353b tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:56.070021 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d0c024e5-250e-4a35-bb2c-4b2ea7d8353b tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:56.070418 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d0c024e5-250e-4a35-bb2c-4b2ea7d8353b tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:56.070916 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d0c024e5-250e-4a35-bb2c-4b2ea7d8353b tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:56.071340 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d0c024e5-250e-4a35-bb2c-4b2ea7d8353b tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:56.409072 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-d0c024e5-250e-4a35-bb2c-4b2ea7d8353b tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:12:56.426537 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-d0c024e5-250e-4a35-bb2c-4b2ea7d8353b tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954" status: 200 len: 1685 microversion: 2.1 time: 0.376229 Aug 10 23:12:56.447657 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1773/3431] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:12:56 2022] GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954 => generated 1685 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:12:56.739435 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-d3716a6e-0ea9-430a-9dde-31a6d98e32b9 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:12:56.740050 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-d3716a6e-0ea9-430a-9dde-31a6d98e32b9 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: da69cf1f-ff76-4a68-afe9-fc491b31e8a9] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:12:56.748373 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d3716a6e-0ea9-430a-9dde-31a6d98e32b9 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:56.749083 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d3716a6e-0ea9-430a-9dde-31a6d98e32b9 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:56.749515 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d3716a6e-0ea9-430a-9dde-31a6d98e32b9 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:56.750928 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d3716a6e-0ea9-430a-9dde-31a6d98e32b9 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:56.751525 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d3716a6e-0ea9-430a-9dde-31a6d98e32b9 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:56.752243 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d3716a6e-0ea9-430a-9dde-31a6d98e32b9 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:57.079783 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-cc6518e0-075c-432d-b884-9908ccc2eb3a tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:12:57.080965 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-cc6518e0-075c-432d-b884-9908ccc2eb3a tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] [instance: 8b45f99b-7717-489f-9507-9190a9402f47] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:12:57.086027 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-d3716a6e-0ea9-430a-9dde-31a6d98e32b9 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6160c7a42740efbe3613380933fa15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d90f8a58ad047fa8f347d6474e4d673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:12:57.113976 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-d3716a6e-0ea9-430a-9dde-31a6d98e32b9 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "GET /compute/v2.1/servers/da69cf1f-ff76-4a68-afe9-fc491b31e8a9" status: 200 len: 1314 microversion: 2.1 time: 0.365362 Aug 10 23:12:57.114814 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1659/3432] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:12:56 2022] GET /compute/v2.1/servers/da69cf1f-ff76-4a68-afe9-fc491b31e8a9 => generated 1314 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:12:57.119295 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cc6518e0-075c-432d-b884-9908ccc2eb3a tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:57.122276 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cc6518e0-075c-432d-b884-9908ccc2eb3a tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:57.124139 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cc6518e0-075c-432d-b884-9908ccc2eb3a tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:57.133057 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cc6518e0-075c-432d-b884-9908ccc2eb3a tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:57.134578 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cc6518e0-075c-432d-b884-9908ccc2eb3a tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:57.138389 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cc6518e0-075c-432d-b884-9908ccc2eb3a tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:57.458372 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-85ccf9cd-5327-40c8-877e-33d77b7bdd61 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:12:57.459235 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-85ccf9cd-5327-40c8-877e-33d77b7bdd61 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: fa9dfd3a-a636-48ce-ae15-0ed51baee954] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:12:57.473214 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-85ccf9cd-5327-40c8-877e-33d77b7bdd61 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:57.476379 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-85ccf9cd-5327-40c8-877e-33d77b7bdd61 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:57.479902 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-85ccf9cd-5327-40c8-877e-33d77b7bdd61 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:57.482949 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-85ccf9cd-5327-40c8-877e-33d77b7bdd61 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:57.484892 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-85ccf9cd-5327-40c8-877e-33d77b7bdd61 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:57.488847 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-85ccf9cd-5327-40c8-877e-33d77b7bdd61 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:57.653496 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-cc6518e0-075c-432d-b884-9908ccc2eb3a tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2848edf3f7674fa9b8a3c408b2479f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aa264849a1d4a908907421eed683fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:12:57.670106 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-cc6518e0-075c-432d-b884-9908ccc2eb3a tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] 10.222.0.58 "GET /compute/v2.1/servers/8b45f99b-7717-489f-9507-9190a9402f47" status: 200 len: 1505 microversion: 2.1 time: 0.596240 Aug 10 23:12:57.682813 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1774/3433] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:12:57 2022] GET /compute/v2.1/servers/8b45f99b-7717-489f-9507-9190a9402f47 => generated 1505 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:12:57.930998 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-85ccf9cd-5327-40c8-877e-33d77b7bdd61 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:12:57.948751 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-85ccf9cd-5327-40c8-877e-33d77b7bdd61 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954" status: 200 len: 1680 microversion: 2.1 time: 0.499665 Aug 10 23:12:57.951281 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1660/3434] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:12:57 2022] GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954 => generated 1680 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:12:58.031610 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-92fb9aff-2cdc-4a84-97da-ec2c79385ddf req-9708df68-a53c-4aae-8b52-94c5f9353c70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa9dfd3a-a636-48ce-ae15-0ed51baee954", "name": "network-vif-unplugged", "status": "completed", "tag": "456f7ca7-21c6-4b5d-8993-9a7c329acf12"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:12:58.045689 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-92fb9aff-2cdc-4a84-97da-ec2c79385ddf req-9708df68-a53c-4aae-8b52-94c5f9353c70 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:58.046175 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-92fb9aff-2cdc-4a84-97da-ec2c79385ddf req-9708df68-a53c-4aae-8b52-94c5f9353c70 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:58.046611 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-92fb9aff-2cdc-4a84-97da-ec2c79385ddf req-9708df68-a53c-4aae-8b52-94c5f9353c70 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:58.080098 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-92fb9aff-2cdc-4a84-97da-ec2c79385ddf req-9708df68-a53c-4aae-8b52-94c5f9353c70 service nova] Creating event network-vif-unplugged:456f7ca7-21c6-4b5d-8993-9a7c329acf12 for instance fa9dfd3a-a636-48ce-ae15-0ed51baee954 on n-h2-850468-14 Aug 10 23:12:58.093695 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-92fb9aff-2cdc-4a84-97da-ec2c79385ddf req-9708df68-a53c-4aae-8b52-94c5f9353c70 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.066246 Aug 10 23:12:58.095019 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1775/3435] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:12:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:12:58.139427 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-951d6416-3e5b-41bb-931e-54b42c98b143 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:12:58.140058 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-951d6416-3e5b-41bb-931e-54b42c98b143 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: da69cf1f-ff76-4a68-afe9-fc491b31e8a9] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:12:58.171338 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-951d6416-3e5b-41bb-931e-54b42c98b143 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:58.174181 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-951d6416-3e5b-41bb-931e-54b42c98b143 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:58.176677 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-951d6416-3e5b-41bb-931e-54b42c98b143 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:58.177625 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-951d6416-3e5b-41bb-931e-54b42c98b143 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:58.182681 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-951d6416-3e5b-41bb-931e-54b42c98b143 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:58.184321 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-951d6416-3e5b-41bb-931e-54b42c98b143 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:58.692446 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-f0ab2438-59c9-4c93-acad-86e94186f4ac tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:12:58.693147 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-f0ab2438-59c9-4c93-acad-86e94186f4ac tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] [instance: 8b45f99b-7717-489f-9507-9190a9402f47] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:12:58.709744 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f0ab2438-59c9-4c93-acad-86e94186f4ac tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:58.710245 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f0ab2438-59c9-4c93-acad-86e94186f4ac tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:58.710686 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f0ab2438-59c9-4c93-acad-86e94186f4ac tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:58.711434 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f0ab2438-59c9-4c93-acad-86e94186f4ac tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:58.711931 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f0ab2438-59c9-4c93-acad-86e94186f4ac tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:58.712356 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f0ab2438-59c9-4c93-acad-86e94186f4ac tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:58.967994 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-f0ab2438-59c9-4c93-acad-86e94186f4ac tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2848edf3f7674fa9b8a3c408b2479f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aa264849a1d4a908907421eed683fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:12:58.985332 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-f0ab2438-59c9-4c93-acad-86e94186f4ac tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] 10.222.0.58 "GET /compute/v2.1/servers/8b45f99b-7717-489f-9507-9190a9402f47" status: 200 len: 1505 microversion: 2.1 time: 0.292443 Aug 10 23:12:58.987483 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1776/3436] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:12:58 2022] GET /compute/v2.1/servers/8b45f99b-7717-489f-9507-9190a9402f47 => generated 1505 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:12:59.008503 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-aa10d75f-62e1-4c35-902f-eaf2fb225e16 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:12:59.009431 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-aa10d75f-62e1-4c35-902f-eaf2fb225e16 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: fa9dfd3a-a636-48ce-ae15-0ed51baee954] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:12:59.027055 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-aa10d75f-62e1-4c35-902f-eaf2fb225e16 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:59.028451 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-aa10d75f-62e1-4c35-902f-eaf2fb225e16 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:59.029106 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-aa10d75f-62e1-4c35-902f-eaf2fb225e16 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:59.030046 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-aa10d75f-62e1-4c35-902f-eaf2fb225e16 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:12:59.030734 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-aa10d75f-62e1-4c35-902f-eaf2fb225e16 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:12:59.031375 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-aa10d75f-62e1-4c35-902f-eaf2fb225e16 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:12:59.259270 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-aa10d75f-62e1-4c35-902f-eaf2fb225e16 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:12:59.276959 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-aa10d75f-62e1-4c35-902f-eaf2fb225e16 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954" status: 200 len: 1680 microversion: 2.1 time: 0.283575 Aug 10 23:12:59.277916 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1777/3437] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:12:58 2022] GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954 => generated 1680 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:12:59.305053 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-951d6416-3e5b-41bb-931e-54b42c98b143 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6160c7a42740efbe3613380933fa15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d90f8a58ad047fa8f347d6474e4d673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:12:59.320296 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-951d6416-3e5b-41bb-931e-54b42c98b143 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "GET /compute/v2.1/servers/da69cf1f-ff76-4a68-afe9-fc491b31e8a9" status: 200 len: 1314 microversion: 2.1 time: 1.187264 Aug 10 23:12:59.321675 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1661/3438] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:12:58 2022] GET /compute/v2.1/servers/da69cf1f-ff76-4a68-afe9-fc491b31e8a9 => generated 1314 bytes in 1189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:13:00.021883 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-4438d215-d864-4989-b0b0-139b0298f965 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:00.022717 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-4438d215-d864-4989-b0b0-139b0298f965 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] [instance: 8b45f99b-7717-489f-9507-9190a9402f47] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:00.036970 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4438d215-d864-4989-b0b0-139b0298f965 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:00.038495 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4438d215-d864-4989-b0b0-139b0298f965 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:00.039181 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4438d215-d864-4989-b0b0-139b0298f965 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:00.040941 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4438d215-d864-4989-b0b0-139b0298f965 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:00.041697 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4438d215-d864-4989-b0b0-139b0298f965 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:00.042387 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4438d215-d864-4989-b0b0-139b0298f965 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:00.166459 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-f11616d2-c330-4d3b-ab9c-467a8af352f1 req-f6d616f2-6a11-4c5e-a218-3d27a2f83459 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa9dfd3a-a636-48ce-ae15-0ed51baee954", "name": "network-vif-plugged", "status": "completed", "tag": "456f7ca7-21c6-4b5d-8993-9a7c329acf12"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:13:00.192133 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-f11616d2-c330-4d3b-ab9c-467a8af352f1 req-f6d616f2-6a11-4c5e-a218-3d27a2f83459 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:00.192943 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-f11616d2-c330-4d3b-ab9c-467a8af352f1 req-f6d616f2-6a11-4c5e-a218-3d27a2f83459 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:00.193528 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-f11616d2-c330-4d3b-ab9c-467a8af352f1 req-f6d616f2-6a11-4c5e-a218-3d27a2f83459 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:00.253294 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-f11616d2-c330-4d3b-ab9c-467a8af352f1 req-f6d616f2-6a11-4c5e-a218-3d27a2f83459 service nova] Creating event network-vif-plugged:456f7ca7-21c6-4b5d-8993-9a7c329acf12 for instance fa9dfd3a-a636-48ce-ae15-0ed51baee954 on n-h2-850468-14 Aug 10 23:13:00.270537 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-f11616d2-c330-4d3b-ab9c-467a8af352f1 req-f6d616f2-6a11-4c5e-a218-3d27a2f83459 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128807 Aug 10 23:13:00.271208 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1662/3439] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:13:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:13:00.302001 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-f5be9d96-ccc9-4a61-ab8c-02ee2d616602 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:00.302689 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-f5be9d96-ccc9-4a61-ab8c-02ee2d616602 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: fa9dfd3a-a636-48ce-ae15-0ed51baee954] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:00.321558 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f5be9d96-ccc9-4a61-ab8c-02ee2d616602 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:00.322881 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f5be9d96-ccc9-4a61-ab8c-02ee2d616602 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:00.323528 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f5be9d96-ccc9-4a61-ab8c-02ee2d616602 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:00.325664 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f5be9d96-ccc9-4a61-ab8c-02ee2d616602 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:00.326405 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f5be9d96-ccc9-4a61-ab8c-02ee2d616602 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:00.327085 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f5be9d96-ccc9-4a61-ab8c-02ee2d616602 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:00.354122 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-4438d215-d864-4989-b0b0-139b0298f965 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2848edf3f7674fa9b8a3c408b2479f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aa264849a1d4a908907421eed683fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:00.365931 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-4438d215-d864-4989-b0b0-139b0298f965 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] 10.222.0.58 "GET /compute/v2.1/servers/8b45f99b-7717-489f-9507-9190a9402f47" status: 200 len: 1505 microversion: 2.1 time: 0.354214 Aug 10 23:13:00.367438 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1778/3440] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:00 2022] GET /compute/v2.1/servers/8b45f99b-7717-489f-9507-9190a9402f47 => generated 1505 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:13:00.376350 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-bcc47c6c-89f5-4c0e-87bd-a24c77fb227b tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:00.377290 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-bcc47c6c-89f5-4c0e-87bd-a24c77fb227b tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: da69cf1f-ff76-4a68-afe9-fc491b31e8a9] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:00.391040 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bcc47c6c-89f5-4c0e-87bd-a24c77fb227b tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:00.393065 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bcc47c6c-89f5-4c0e-87bd-a24c77fb227b tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:00.394708 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bcc47c6c-89f5-4c0e-87bd-a24c77fb227b tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:00.395716 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bcc47c6c-89f5-4c0e-87bd-a24c77fb227b tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:00.409923 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bcc47c6c-89f5-4c0e-87bd-a24c77fb227b tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:00.413584 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bcc47c6c-89f5-4c0e-87bd-a24c77fb227b tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:00.711046 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-bcc47c6c-89f5-4c0e-87bd-a24c77fb227b tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6160c7a42740efbe3613380933fa15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d90f8a58ad047fa8f347d6474e4d673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:00.735240 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-bcc47c6c-89f5-4c0e-87bd-a24c77fb227b tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "GET /compute/v2.1/servers/da69cf1f-ff76-4a68-afe9-fc491b31e8a9" status: 200 len: 1314 microversion: 2.1 time: 0.354450 Aug 10 23:13:00.739195 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1779/3441] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:00 2022] GET /compute/v2.1/servers/da69cf1f-ff76-4a68-afe9-fc491b31e8a9 => generated 1314 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:13:00.820257 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-f5be9d96-ccc9-4a61-ab8c-02ee2d616602 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:00.838131 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-f5be9d96-ccc9-4a61-ab8c-02ee2d616602 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954" status: 200 len: 1680 microversion: 2.1 time: 0.537051 Aug 10 23:13:00.841345 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1663/3442] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:00 2022] GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954 => generated 1680 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:13:01.409082 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-b1027351-22c3-472b-8b57-7146f43fa844 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:01.410374 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-b1027351-22c3-472b-8b57-7146f43fa844 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] [instance: 8b45f99b-7717-489f-9507-9190a9402f47] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:01.456062 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-faf28639-3c7a-49e7-9f4c-bd13173d8dbe tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:01.456580 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=2 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:13:01.457068 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-faf28639-3c7a-49e7-9f4c-bd13173d8dbe tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] [instance: f4dc6241-b173-4cbf-b76c-7da3fac7edcc] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:01.466256 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-faf28639-3c7a-49e7-9f4c-bd13173d8dbe tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:01.467331 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-faf28639-3c7a-49e7-9f4c-bd13173d8dbe tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:01.468174 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-faf28639-3c7a-49e7-9f4c-bd13173d8dbe tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:01.469395 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-faf28639-3c7a-49e7-9f4c-bd13173d8dbe tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:01.469814 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b1027351-22c3-472b-8b57-7146f43fa844 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:01.470673 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-faf28639-3c7a-49e7-9f4c-bd13173d8dbe tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:01.471373 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-faf28639-3c7a-49e7-9f4c-bd13173d8dbe tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:01.471506 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b1027351-22c3-472b-8b57-7146f43fa844 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:01.472646 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b1027351-22c3-472b-8b57-7146f43fa844 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:01.475980 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b1027351-22c3-472b-8b57-7146f43fa844 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:01.478269 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b1027351-22c3-472b-8b57-7146f43fa844 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:01.479936 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b1027351-22c3-472b-8b57-7146f43fa844 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:01.548708 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=8 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:13:01.752713 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-b1027351-22c3-472b-8b57-7146f43fa844 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2848edf3f7674fa9b8a3c408b2479f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aa264849a1d4a908907421eed683fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:01.765852 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-b1027351-22c3-472b-8b57-7146f43fa844 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] 10.222.0.58 "GET /compute/v2.1/servers/8b45f99b-7717-489f-9507-9190a9402f47" status: 200 len: 1505 microversion: 2.1 time: 0.380024 Aug 10 23:13:01.777650 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1780/3443] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:01 2022] GET /compute/v2.1/servers/8b45f99b-7717-489f-9507-9190a9402f47 => generated 1505 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:13:01.786773 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-8059772b-fc23-4060-9efe-c46a51a04465 req-f66d953c-3f75-484a-8509-12234462d63f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4dc6241-b173-4cbf-b76c-7da3fac7edcc", "tag": "d3cf5f02-4cda-4d1b-9314-92bc05402960"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:13:01.798611 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-8059772b-fc23-4060-9efe-c46a51a04465 req-f66d953c-3f75-484a-8509-12234462d63f service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:01.799546 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-8059772b-fc23-4060-9efe-c46a51a04465 req-f66d953c-3f75-484a-8509-12234462d63f service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:01.800217 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-8059772b-fc23-4060-9efe-c46a51a04465 req-f66d953c-3f75-484a-8509-12234462d63f service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:01.814500 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-8059772b-fc23-4060-9efe-c46a51a04465 req-f66d953c-3f75-484a-8509-12234462d63f service nova] Creating event network-changed:d3cf5f02-4cda-4d1b-9314-92bc05402960 for instance f4dc6241-b173-4cbf-b76c-7da3fac7edcc on n-h1-850468-14 Aug 10 23:13:01.820259 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-8059772b-fc23-4060-9efe-c46a51a04465 req-f66d953c-3f75-484a-8509-12234462d63f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038305 Aug 10 23:13:01.821186 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1781/3444] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:13:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:13:01.827648 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-5d9e9b57-4dfc-4c46-9e0f-6ef7ecc371f2 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:01.828708 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-5d9e9b57-4dfc-4c46-9e0f-6ef7ecc371f2 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: da69cf1f-ff76-4a68-afe9-fc491b31e8a9] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:01.836447 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5d9e9b57-4dfc-4c46-9e0f-6ef7ecc371f2 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:01.837296 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5d9e9b57-4dfc-4c46-9e0f-6ef7ecc371f2 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:01.837949 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5d9e9b57-4dfc-4c46-9e0f-6ef7ecc371f2 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:01.839009 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5d9e9b57-4dfc-4c46-9e0f-6ef7ecc371f2 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:01.840305 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5d9e9b57-4dfc-4c46-9e0f-6ef7ecc371f2 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:01.840961 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5d9e9b57-4dfc-4c46-9e0f-6ef7ecc371f2 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:02.338552 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-5d9e9b57-4dfc-4c46-9e0f-6ef7ecc371f2 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6160c7a42740efbe3613380933fa15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d90f8a58ad047fa8f347d6474e4d673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:02.353781 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-5d9e9b57-4dfc-4c46-9e0f-6ef7ecc371f2 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "GET /compute/v2.1/servers/da69cf1f-ff76-4a68-afe9-fc491b31e8a9" status: 200 len: 1314 microversion: 2.1 time: 0.530965 Aug 10 23:13:02.354704 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1782/3445] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:01 2022] GET /compute/v2.1/servers/da69cf1f-ff76-4a68-afe9-fc491b31e8a9 => generated 1314 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:13:02.370229 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-faf28639-3c7a-49e7-9f4c-bd13173d8dbe tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5899b2ad9f1046caaf7c6073e408eeee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25abd63376614081a9d484f3c9ae950d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:02.371987 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-db04ce39-4751-4c78-9a47-249cb3152629 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:02.372667 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-db04ce39-4751-4c78-9a47-249cb3152629 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: fa9dfd3a-a636-48ce-ae15-0ed51baee954] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:02.382538 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-faf28639-3c7a-49e7-9f4c-bd13173d8dbe tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "GET /compute/v2.1/servers/f4dc6241-b173-4cbf-b76c-7da3fac7edcc" status: 200 len: 1563 microversion: 2.1 time: 0.929398 Aug 10 23:13:02.385041 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1664/3446] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:01 2022] GET /compute/v2.1/servers/f4dc6241-b173-4cbf-b76c-7da3fac7edcc => generated 1563 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:13:02.390760 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-db04ce39-4751-4c78-9a47-249cb3152629 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:02.391278 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-db04ce39-4751-4c78-9a47-249cb3152629 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:02.391733 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-db04ce39-4751-4c78-9a47-249cb3152629 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:02.392521 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-db04ce39-4751-4c78-9a47-249cb3152629 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:02.393694 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-db04ce39-4751-4c78-9a47-249cb3152629 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:02.394170 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-db04ce39-4751-4c78-9a47-249cb3152629 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:02.397568 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:13:02.789128 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-b2397444-47d7-4d48-9556-024c63c162bf tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:02.789921 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-b2397444-47d7-4d48-9556-024c63c162bf tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] [instance: 8b45f99b-7717-489f-9507-9190a9402f47] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:02.797491 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-db04ce39-4751-4c78-9a47-249cb3152629 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:02.803042 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b2397444-47d7-4d48-9556-024c63c162bf tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:02.803653 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b2397444-47d7-4d48-9556-024c63c162bf tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:02.807177 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b2397444-47d7-4d48-9556-024c63c162bf tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:02.808056 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b2397444-47d7-4d48-9556-024c63c162bf tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:02.809927 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b2397444-47d7-4d48-9556-024c63c162bf tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:02.810503 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b2397444-47d7-4d48-9556-024c63c162bf tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:02.818420 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-db04ce39-4751-4c78-9a47-249cb3152629 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954" status: 200 len: 1680 microversion: 2.1 time: 0.462063 Aug 10 23:13:02.819622 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1783/3447] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:02 2022] GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954 => generated 1680 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:13:03.155759 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-b2397444-47d7-4d48-9556-024c63c162bf tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2848edf3f7674fa9b8a3c408b2479f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aa264849a1d4a908907421eed683fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:03.186571 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-b2397444-47d7-4d48-9556-024c63c162bf tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] 10.222.0.58 "GET /compute/v2.1/servers/8b45f99b-7717-489f-9507-9190a9402f47" status: 200 len: 1505 microversion: 2.1 time: 0.398202 Aug 10 23:13:03.199583 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1665/3448] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:02 2022] GET /compute/v2.1/servers/8b45f99b-7717-489f-9507-9190a9402f47 => generated 1505 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:13:03.291918 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-ced05597-6c67-4bf3-a822-3b983ff23d58 req-c434a60e-d250-446d-9d9b-d89c688a16e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da69cf1f-ff76-4a68-afe9-fc491b31e8a9", "name": "network-vif-plugged", "status": "completed", "tag": "1fe8c8ad-aad0-4a76-a5ed-01061f46152f"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:13:03.322677 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-ced05597-6c67-4bf3-a822-3b983ff23d58 req-c434a60e-d250-446d-9d9b-d89c688a16e5 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:03.323354 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-ced05597-6c67-4bf3-a822-3b983ff23d58 req-c434a60e-d250-446d-9d9b-d89c688a16e5 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:03.325156 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-ced05597-6c67-4bf3-a822-3b983ff23d58 req-c434a60e-d250-446d-9d9b-d89c688a16e5 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:03.360817 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-ced05597-6c67-4bf3-a822-3b983ff23d58 req-c434a60e-d250-446d-9d9b-d89c688a16e5 service nova] Creating event network-vif-plugged:1fe8c8ad-aad0-4a76-a5ed-01061f46152f for instance da69cf1f-ff76-4a68-afe9-fc491b31e8a9 on n-h2-850468-14 Aug 10 23:13:03.376152 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-ced05597-6c67-4bf3-a822-3b983ff23d58 req-c434a60e-d250-446d-9d9b-d89c688a16e5 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088275 Aug 10 23:13:03.377096 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1784/3449] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:13:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:13:03.381005 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-0ade0f65-1148-45e7-99d8-dcec472e10f1 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:03.381670 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-0ade0f65-1148-45e7-99d8-dcec472e10f1 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: da69cf1f-ff76-4a68-afe9-fc491b31e8a9] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:03.394585 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0ade0f65-1148-45e7-99d8-dcec472e10f1 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:03.395172 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0ade0f65-1148-45e7-99d8-dcec472e10f1 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:03.395716 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0ade0f65-1148-45e7-99d8-dcec472e10f1 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:03.396446 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0ade0f65-1148-45e7-99d8-dcec472e10f1 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:03.396905 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0ade0f65-1148-45e7-99d8-dcec472e10f1 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:03.397336 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0ade0f65-1148-45e7-99d8-dcec472e10f1 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:03.845053 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-0dceda84-ded1-4f26-b5b0-21e98f1b8043 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:03.846629 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-0dceda84-ded1-4f26-b5b0-21e98f1b8043 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: fa9dfd3a-a636-48ce-ae15-0ed51baee954] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:03.852199 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-0ade0f65-1148-45e7-99d8-dcec472e10f1 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6160c7a42740efbe3613380933fa15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d90f8a58ad047fa8f347d6474e4d673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:03.857645 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=100 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:13:03.862729 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-0ade0f65-1148-45e7-99d8-dcec472e10f1 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "GET /compute/v2.1/servers/da69cf1f-ff76-4a68-afe9-fc491b31e8a9" status: 200 len: 1314 microversion: 2.1 time: 0.485724 Aug 10 23:13:03.877191 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0dceda84-ded1-4f26-b5b0-21e98f1b8043 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:03.887811 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0dceda84-ded1-4f26-b5b0-21e98f1b8043 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:03.887811 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0dceda84-ded1-4f26-b5b0-21e98f1b8043 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:03.887811 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0dceda84-ded1-4f26-b5b0-21e98f1b8043 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:03.887811 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0dceda84-ded1-4f26-b5b0-21e98f1b8043 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:03.887811 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0dceda84-ded1-4f26-b5b0-21e98f1b8043 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:03.888453 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1666/3450] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:03 2022] GET /compute/v2.1/servers/da69cf1f-ff76-4a68-afe9-fc491b31e8a9 => generated 1314 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:13:04.215099 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-d78373ce-cec4-4d62-b47e-54774221556e tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:04.215711 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-d78373ce-cec4-4d62-b47e-54774221556e tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] [instance: 8b45f99b-7717-489f-9507-9190a9402f47] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:04.258425 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d78373ce-cec4-4d62-b47e-54774221556e tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:04.258994 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d78373ce-cec4-4d62-b47e-54774221556e tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:04.264221 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d78373ce-cec4-4d62-b47e-54774221556e tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:04.267420 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d78373ce-cec4-4d62-b47e-54774221556e tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:04.269339 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d78373ce-cec4-4d62-b47e-54774221556e tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:04.269975 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d78373ce-cec4-4d62-b47e-54774221556e tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:04.453493 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-0dceda84-ded1-4f26-b5b0-21e98f1b8043 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:04.462592 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-0dceda84-ded1-4f26-b5b0-21e98f1b8043 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954" status: 200 len: 1680 microversion: 2.1 time: 0.623120 Aug 10 23:13:04.467301 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1785/3451] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:03 2022] GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954 => generated 1680 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:13:04.906944 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-3f3353fc-326f-4385-8fd7-bb75496e25b3 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:04.907653 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-3f3353fc-326f-4385-8fd7-bb75496e25b3 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: da69cf1f-ff76-4a68-afe9-fc491b31e8a9] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:04.929661 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3f3353fc-326f-4385-8fd7-bb75496e25b3 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:04.930162 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3f3353fc-326f-4385-8fd7-bb75496e25b3 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:04.930601 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3f3353fc-326f-4385-8fd7-bb75496e25b3 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:04.931385 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3f3353fc-326f-4385-8fd7-bb75496e25b3 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:04.959636 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3f3353fc-326f-4385-8fd7-bb75496e25b3 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:04.961444 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3f3353fc-326f-4385-8fd7-bb75496e25b3 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:05.539027 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-3f3353fc-326f-4385-8fd7-bb75496e25b3 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6160c7a42740efbe3613380933fa15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d90f8a58ad047fa8f347d6474e4d673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:05.553140 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-3f3353fc-326f-4385-8fd7-bb75496e25b3 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "GET /compute/v2.1/servers/da69cf1f-ff76-4a68-afe9-fc491b31e8a9" status: 200 len: 1314 microversion: 2.1 time: 0.650562 Aug 10 23:13:05.558889 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1786/3452] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:04 2022] GET /compute/v2.1/servers/da69cf1f-ff76-4a68-afe9-fc491b31e8a9 => generated 1314 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:13:05.568276 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-ff968b56-7341-4a91-98dd-5f830eb46e5b tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:05.568897 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-ff968b56-7341-4a91-98dd-5f830eb46e5b tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: fa9dfd3a-a636-48ce-ae15-0ed51baee954] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:05.612549 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ff968b56-7341-4a91-98dd-5f830eb46e5b tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:05.613569 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ff968b56-7341-4a91-98dd-5f830eb46e5b tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:05.614393 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ff968b56-7341-4a91-98dd-5f830eb46e5b tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:05.615511 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ff968b56-7341-4a91-98dd-5f830eb46e5b tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:05.616200 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ff968b56-7341-4a91-98dd-5f830eb46e5b tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:05.616944 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ff968b56-7341-4a91-98dd-5f830eb46e5b tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:05.809570 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-d78373ce-cec4-4d62-b47e-54774221556e tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2848edf3f7674fa9b8a3c408b2479f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aa264849a1d4a908907421eed683fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:05.821188 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-d78373ce-cec4-4d62-b47e-54774221556e tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] 10.222.0.58 "GET /compute/v2.1/servers/8b45f99b-7717-489f-9507-9190a9402f47" status: 200 len: 1505 microversion: 2.1 time: 1.611104 Aug 10 23:13:05.823751 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1667/3453] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:04 2022] GET /compute/v2.1/servers/8b45f99b-7717-489f-9507-9190a9402f47 => generated 1505 bytes in 1614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:13:05.866822 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-ff968b56-7341-4a91-98dd-5f830eb46e5b tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:05.883059 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-ff968b56-7341-4a91-98dd-5f830eb46e5b tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954" status: 200 len: 1680 microversion: 2.1 time: 0.322856 Aug 10 23:13:05.883845 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1787/3454] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:05 2022] GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954 => generated 1680 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:13:06.577864 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-2ebb4606-f4ba-4e91-a283-a06ebba1d9cd tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:06.578657 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-2ebb4606-f4ba-4e91-a283-a06ebba1d9cd tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: da69cf1f-ff76-4a68-afe9-fc491b31e8a9] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:06.591534 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2ebb4606-f4ba-4e91-a283-a06ebba1d9cd tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:06.594571 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2ebb4606-f4ba-4e91-a283-a06ebba1d9cd tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:06.595193 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2ebb4606-f4ba-4e91-a283-a06ebba1d9cd tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:06.596029 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2ebb4606-f4ba-4e91-a283-a06ebba1d9cd tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:06.598647 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2ebb4606-f4ba-4e91-a283-a06ebba1d9cd tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:06.599280 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2ebb4606-f4ba-4e91-a283-a06ebba1d9cd tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:06.846916 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c749c319-0392-4b23-8df7-8958ac18a2d2 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:06.847742 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-c749c319-0392-4b23-8df7-8958ac18a2d2 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] [instance: 8b45f99b-7717-489f-9507-9190a9402f47] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:06.903045 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c749c319-0392-4b23-8df7-8958ac18a2d2 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:06.905285 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c749c319-0392-4b23-8df7-8958ac18a2d2 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:06.905917 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c749c319-0392-4b23-8df7-8958ac18a2d2 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:06.912285 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c749c319-0392-4b23-8df7-8958ac18a2d2 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:06.912999 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c749c319-0392-4b23-8df7-8958ac18a2d2 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:06.915851 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c749c319-0392-4b23-8df7-8958ac18a2d2 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:07.037865 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-2ebb4606-f4ba-4e91-a283-a06ebba1d9cd tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6160c7a42740efbe3613380933fa15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d90f8a58ad047fa8f347d6474e4d673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:07.049829 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-2ebb4606-f4ba-4e91-a283-a06ebba1d9cd tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "GET /compute/v2.1/servers/da69cf1f-ff76-4a68-afe9-fc491b31e8a9" status: 200 len: 1501 microversion: 2.1 time: 0.476051 Aug 10 23:13:07.064181 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1668/3455] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:06 2022] GET /compute/v2.1/servers/da69cf1f-ff76-4a68-afe9-fc491b31e8a9 => generated 1501 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:13:07.064181 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-83223de8-6e83-4b15-9779-fb9a0afc686f tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:07.064181 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-83223de8-6e83-4b15-9779-fb9a0afc686f tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: fa9dfd3a-a636-48ce-ae15-0ed51baee954] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:07.072166 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-83223de8-6e83-4b15-9779-fb9a0afc686f tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:07.073039 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-83223de8-6e83-4b15-9779-fb9a0afc686f tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:07.074489 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-83223de8-6e83-4b15-9779-fb9a0afc686f tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:07.076735 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-83223de8-6e83-4b15-9779-fb9a0afc686f tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:07.077640 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-83223de8-6e83-4b15-9779-fb9a0afc686f tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:07.078284 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-83223de8-6e83-4b15-9779-fb9a0afc686f tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:07.378554 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-83223de8-6e83-4b15-9779-fb9a0afc686f tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:07.412789 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-83223de8-6e83-4b15-9779-fb9a0afc686f tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954" status: 200 len: 1680 microversion: 2.1 time: 0.351773 Aug 10 23:13:07.415674 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1669/3456] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:07 2022] GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954 => generated 1680 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:13:07.423985 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c9f8da14-3d05-4587-a2d6-24d31415ef2c tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:13:07.427494 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-c9f8da14-3d05-4587-a2d6-24d31415ef2c tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: da69cf1f-ff76-4a68-afe9-fc491b31e8a9] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:07.446327 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c9f8da14-3d05-4587-a2d6-24d31415ef2c tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:07.447928 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c9f8da14-3d05-4587-a2d6-24d31415ef2c tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:07.451115 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c9f8da14-3d05-4587-a2d6-24d31415ef2c tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:07.452164 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c9f8da14-3d05-4587-a2d6-24d31415ef2c tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:07.453191 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c9f8da14-3d05-4587-a2d6-24d31415ef2c tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:07.457490 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c9f8da14-3d05-4587-a2d6-24d31415ef2c tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:07.480783 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-c749c319-0392-4b23-8df7-8958ac18a2d2 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2848edf3f7674fa9b8a3c408b2479f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aa264849a1d4a908907421eed683fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:07.492267 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-c749c319-0392-4b23-8df7-8958ac18a2d2 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] 10.222.0.58 "GET /compute/v2.1/servers/8b45f99b-7717-489f-9507-9190a9402f47" status: 200 len: 1505 microversion: 2.1 time: 0.650546 Aug 10 23:13:07.503758 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1788/3457] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:06 2022] GET /compute/v2.1/servers/8b45f99b-7717-489f-9507-9190a9402f47 => generated 1505 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:13:07.548401 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.objects.instance [None req-c9f8da14-3d05-4587-a2d6-24d31415ef2c tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lazy-loading 'flavor' on Instance uuid da69cf1f-ff76-4a68-afe9-fc491b31e8a9 {{(pid=122632) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:13:08.130827 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-c9f8da14-3d05-4587-a2d6-24d31415ef2c tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "POST /compute/v2.1/servers/da69cf1f-ff76-4a68-afe9-fc491b31e8a9/action" status: 202 len: 0 microversion: 2.1 time: 0.712302 Aug 10 23:13:08.139272 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1670/3458] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:13:07 2022] POST /compute/v2.1/servers/da69cf1f-ff76-4a68-afe9-fc491b31e8a9/action => generated 0 bytes in 723 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:13:08.144179 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-df93c3f6-7f2d-4d74-8bb0-6ab667b93cc4 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:08.144833 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-df93c3f6-7f2d-4d74-8bb0-6ab667b93cc4 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: da69cf1f-ff76-4a68-afe9-fc491b31e8a9] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:08.194346 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-df93c3f6-7f2d-4d74-8bb0-6ab667b93cc4 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:08.194854 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-df93c3f6-7f2d-4d74-8bb0-6ab667b93cc4 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:08.195357 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-df93c3f6-7f2d-4d74-8bb0-6ab667b93cc4 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:08.196181 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-df93c3f6-7f2d-4d74-8bb0-6ab667b93cc4 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:08.196671 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-df93c3f6-7f2d-4d74-8bb0-6ab667b93cc4 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:08.197122 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-df93c3f6-7f2d-4d74-8bb0-6ab667b93cc4 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:08.454755 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-1c6064e8-d56b-47f2-92f8-1563ae3bdb3b tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:08.455773 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-1c6064e8-d56b-47f2-92f8-1563ae3bdb3b tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: fa9dfd3a-a636-48ce-ae15-0ed51baee954] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:08.498754 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1c6064e8-d56b-47f2-92f8-1563ae3bdb3b tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:08.502475 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1c6064e8-d56b-47f2-92f8-1563ae3bdb3b tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:08.505552 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1c6064e8-d56b-47f2-92f8-1563ae3bdb3b tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:08.518251 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1c6064e8-d56b-47f2-92f8-1563ae3bdb3b tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:08.519170 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1c6064e8-d56b-47f2-92f8-1563ae3bdb3b tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:08.520186 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1c6064e8-d56b-47f2-92f8-1563ae3bdb3b tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:08.764512 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-df93c3f6-7f2d-4d74-8bb0-6ab667b93cc4 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6160c7a42740efbe3613380933fa15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d90f8a58ad047fa8f347d6474e4d673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:08.773192 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-df93c3f6-7f2d-4d74-8bb0-6ab667b93cc4 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "GET /compute/v2.1/servers/da69cf1f-ff76-4a68-afe9-fc491b31e8a9" status: 200 len: 1507 microversion: 2.1 time: 0.633812 Aug 10 23:13:08.781570 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1789/3459] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:08 2022] GET /compute/v2.1/servers/da69cf1f-ff76-4a68-afe9-fc491b31e8a9 => generated 1507 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:13:08.818098 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-97d9e2f4-1dc8-4b95-a611-a7ab0c78a247 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:08.818910 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-97d9e2f4-1dc8-4b95-a611-a7ab0c78a247 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] [instance: 8b45f99b-7717-489f-9507-9190a9402f47] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:08.845631 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-97d9e2f4-1dc8-4b95-a611-a7ab0c78a247 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:08.846319 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-97d9e2f4-1dc8-4b95-a611-a7ab0c78a247 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:08.847117 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-97d9e2f4-1dc8-4b95-a611-a7ab0c78a247 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:08.848314 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-97d9e2f4-1dc8-4b95-a611-a7ab0c78a247 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:08.849062 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-97d9e2f4-1dc8-4b95-a611-a7ab0c78a247 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:08.849762 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-97d9e2f4-1dc8-4b95-a611-a7ab0c78a247 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:09.140762 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-1c6064e8-d56b-47f2-92f8-1563ae3bdb3b tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:09.149039 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-1c6064e8-d56b-47f2-92f8-1563ae3bdb3b tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954" status: 200 len: 1680 microversion: 2.1 time: 0.711688 Aug 10 23:13:09.149647 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1671/3460] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:08 2022] GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954 => generated 1680 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:13:09.591607 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-97d9e2f4-1dc8-4b95-a611-a7ab0c78a247 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2848edf3f7674fa9b8a3c408b2479f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aa264849a1d4a908907421eed683fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:09.616234 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-97d9e2f4-1dc8-4b95-a611-a7ab0c78a247 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] 10.222.0.58 "GET /compute/v2.1/servers/8b45f99b-7717-489f-9507-9190a9402f47" status: 200 len: 1505 microversion: 2.1 time: 0.833389 Aug 10 23:13:09.620978 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1790/3461] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:08 2022] GET /compute/v2.1/servers/8b45f99b-7717-489f-9507-9190a9402f47 => generated 1505 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:13:09.800274 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-78bfcca0-e5a3-4688-bc87-c36a1a066f24 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:09.801375 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-78bfcca0-e5a3-4688-bc87-c36a1a066f24 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: da69cf1f-ff76-4a68-afe9-fc491b31e8a9] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:09.813243 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-78bfcca0-e5a3-4688-bc87-c36a1a066f24 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:09.816982 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-78bfcca0-e5a3-4688-bc87-c36a1a066f24 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:09.818942 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-78bfcca0-e5a3-4688-bc87-c36a1a066f24 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:09.820278 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-78bfcca0-e5a3-4688-bc87-c36a1a066f24 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:09.822631 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-78bfcca0-e5a3-4688-bc87-c36a1a066f24 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:09.825343 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-78bfcca0-e5a3-4688-bc87-c36a1a066f24 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:10.177421 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-a46d9a60-391f-4f5a-bf0a-5ec33d063849 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:10.178661 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-a46d9a60-391f-4f5a-bf0a-5ec33d063849 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: fa9dfd3a-a636-48ce-ae15-0ed51baee954] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:10.215814 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a46d9a60-391f-4f5a-bf0a-5ec33d063849 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:10.217548 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a46d9a60-391f-4f5a-bf0a-5ec33d063849 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:10.219501 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a46d9a60-391f-4f5a-bf0a-5ec33d063849 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:10.221348 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a46d9a60-391f-4f5a-bf0a-5ec33d063849 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:10.224086 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a46d9a60-391f-4f5a-bf0a-5ec33d063849 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:10.225564 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a46d9a60-391f-4f5a-bf0a-5ec33d063849 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:10.668525 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-78bfcca0-e5a3-4688-bc87-c36a1a066f24 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6160c7a42740efbe3613380933fa15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d90f8a58ad047fa8f347d6474e4d673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:10.687824 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-78bfcca0-e5a3-4688-bc87-c36a1a066f24 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "GET /compute/v2.1/servers/da69cf1f-ff76-4a68-afe9-fc491b31e8a9" status: 200 len: 1507 microversion: 2.1 time: 0.891243 Aug 10 23:13:10.692571 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1672/3462] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:09 2022] GET /compute/v2.1/servers/da69cf1f-ff76-4a68-afe9-fc491b31e8a9 => generated 1507 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:13:10.714367 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-e8903b22-8380-4eb4-b221-847431144c71 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:10.714946 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-e8903b22-8380-4eb4-b221-847431144c71 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] [instance: 8b45f99b-7717-489f-9507-9190a9402f47] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:10.733604 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e8903b22-8380-4eb4-b221-847431144c71 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:10.734375 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e8903b22-8380-4eb4-b221-847431144c71 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:10.735073 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e8903b22-8380-4eb4-b221-847431144c71 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:10.736097 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e8903b22-8380-4eb4-b221-847431144c71 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:10.737469 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e8903b22-8380-4eb4-b221-847431144c71 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:10.738040 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e8903b22-8380-4eb4-b221-847431144c71 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:11.025639 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-a46d9a60-391f-4f5a-bf0a-5ec33d063849 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:11.044963 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-a46d9a60-391f-4f5a-bf0a-5ec33d063849 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954" status: 200 len: 1680 microversion: 2.1 time: 0.869278 Aug 10 23:13:11.050224 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1791/3463] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:10 2022] GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954 => generated 1680 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:13:11.169643 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-e8903b22-8380-4eb4-b221-847431144c71 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2848edf3f7674fa9b8a3c408b2479f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aa264849a1d4a908907421eed683fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:11.178382 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-e8903b22-8380-4eb4-b221-847431144c71 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] 10.222.0.58 "GET /compute/v2.1/servers/8b45f99b-7717-489f-9507-9190a9402f47" status: 200 len: 1485 microversion: 2.1 time: 0.483001 Aug 10 23:13:11.185980 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1673/3464] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:10 2022] GET /compute/v2.1/servers/8b45f99b-7717-489f-9507-9190a9402f47 => generated 1485 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:13:11.213929 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-696b750e-1d84-467e-98d4-c13637b193a1 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:13:11.214608 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-696b750e-1d84-467e-98d4-c13637b193a1 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] [instance: 8b45f99b-7717-489f-9507-9190a9402f47] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:11.247921 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-696b750e-1d84-467e-98d4-c13637b193a1 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:11.248482 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-696b750e-1d84-467e-98d4-c13637b193a1 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:11.248933 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-696b750e-1d84-467e-98d4-c13637b193a1 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:11.255611 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-696b750e-1d84-467e-98d4-c13637b193a1 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:11.256150 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-696b750e-1d84-467e-98d4-c13637b193a1 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:11.256604 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-696b750e-1d84-467e-98d4-c13637b193a1 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:11.539072 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-696b750e-1d84-467e-98d4-c13637b193a1 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] 10.222.0.58 "POST /compute/v2.1/servers/8b45f99b-7717-489f-9507-9190a9402f47/action" status: 202 len: 0 microversion: 2.1 time: 0.323318 Aug 10 23:13:11.543196 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1792/3465] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:13:11 2022] POST /compute/v2.1/servers/8b45f99b-7717-489f-9507-9190a9402f47/action => generated 0 bytes in 337 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:13:11.553370 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-2fd6b358-19d7-4a4f-bdf2-ece58fa0fca1 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:11.555595 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-2fd6b358-19d7-4a4f-bdf2-ece58fa0fca1 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] [instance: 8b45f99b-7717-489f-9507-9190a9402f47] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:11.569988 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2fd6b358-19d7-4a4f-bdf2-ece58fa0fca1 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:11.580042 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2fd6b358-19d7-4a4f-bdf2-ece58fa0fca1 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:11.580998 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2fd6b358-19d7-4a4f-bdf2-ece58fa0fca1 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:11.582066 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2fd6b358-19d7-4a4f-bdf2-ece58fa0fca1 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:11.582858 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2fd6b358-19d7-4a4f-bdf2-ece58fa0fca1 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:11.583439 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2fd6b358-19d7-4a4f-bdf2-ece58fa0fca1 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:11.744170 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-6d0c0a1f-f71f-415f-8a6a-30c201e27064 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:11.747744 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-6d0c0a1f-f71f-415f-8a6a-30c201e27064 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: da69cf1f-ff76-4a68-afe9-fc491b31e8a9] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:11.758096 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6d0c0a1f-f71f-415f-8a6a-30c201e27064 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:11.759236 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6d0c0a1f-f71f-415f-8a6a-30c201e27064 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:11.760732 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6d0c0a1f-f71f-415f-8a6a-30c201e27064 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:11.763979 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6d0c0a1f-f71f-415f-8a6a-30c201e27064 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:11.765703 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6d0c0a1f-f71f-415f-8a6a-30c201e27064 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:11.768880 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6d0c0a1f-f71f-415f-8a6a-30c201e27064 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:11.864662 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-2fd6b358-19d7-4a4f-bdf2-ece58fa0fca1 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2848edf3f7674fa9b8a3c408b2479f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aa264849a1d4a908907421eed683fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:11.889458 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-2fd6b358-19d7-4a4f-bdf2-ece58fa0fca1 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] 10.222.0.58 "GET /compute/v2.1/servers/8b45f99b-7717-489f-9507-9190a9402f47" status: 200 len: 1493 microversion: 2.1 time: 0.343165 Aug 10 23:13:11.891535 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1674/3466] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:11 2022] GET /compute/v2.1/servers/8b45f99b-7717-489f-9507-9190a9402f47 => generated 1493 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:13:12.072974 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-43f7f783-164d-43c5-886a-5128ebb822ff tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:12.076215 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-43f7f783-164d-43c5-886a-5128ebb822ff tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: fa9dfd3a-a636-48ce-ae15-0ed51baee954] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:12.082721 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-43f7f783-164d-43c5-886a-5128ebb822ff tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:12.084590 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-43f7f783-164d-43c5-886a-5128ebb822ff tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:12.085538 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-43f7f783-164d-43c5-886a-5128ebb822ff tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:12.088628 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-43f7f783-164d-43c5-886a-5128ebb822ff tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:12.090313 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-43f7f783-164d-43c5-886a-5128ebb822ff tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:12.092949 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-43f7f783-164d-43c5-886a-5128ebb822ff tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:12.428984 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-6d0c0a1f-f71f-415f-8a6a-30c201e27064 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6160c7a42740efbe3613380933fa15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d90f8a58ad047fa8f347d6474e4d673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:12.463184 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-6d0c0a1f-f71f-415f-8a6a-30c201e27064 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "GET /compute/v2.1/servers/da69cf1f-ff76-4a68-afe9-fc491b31e8a9" status: 200 len: 1507 microversion: 2.1 time: 0.720734 Aug 10 23:13:12.467394 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1793/3467] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:11 2022] GET /compute/v2.1/servers/da69cf1f-ff76-4a68-afe9-fc491b31e8a9 => generated 1507 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:13:12.625788 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-43f7f783-164d-43c5-886a-5128ebb822ff tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:12.641064 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-43f7f783-164d-43c5-886a-5128ebb822ff tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954" status: 200 len: 1680 microversion: 2.1 time: 0.570705 Aug 10 23:13:12.653458 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1675/3468] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:12 2022] GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954 => generated 1680 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:13:12.916386 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-9463df7d-cc9d-44e5-8780-ee513e2cd86e tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:12.918621 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-9463df7d-cc9d-44e5-8780-ee513e2cd86e tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] [instance: 8b45f99b-7717-489f-9507-9190a9402f47] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:12.927956 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=2,nova_api:DELETE=3 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:13:12.934009 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9463df7d-cc9d-44e5-8780-ee513e2cd86e tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:12.939471 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9463df7d-cc9d-44e5-8780-ee513e2cd86e tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:12.940293 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9463df7d-cc9d-44e5-8780-ee513e2cd86e tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:12.941216 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9463df7d-cc9d-44e5-8780-ee513e2cd86e tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:12.941814 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9463df7d-cc9d-44e5-8780-ee513e2cd86e tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:12.942371 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9463df7d-cc9d-44e5-8780-ee513e2cd86e tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:13.034579 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-446bfc41-9571-4835-92df-ae41d80ff3bb tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1762209848", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452", "networks": [{"uuid": "91d0258a-9486-4479-91e9-a6d9339a2e0a"}]}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:13:13.054025 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:13:13.176752 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.network.neutron [None req-446bfc41-9571-4835-92df-ae41d80ff3bb tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] validate_networks() for [('91d0258a-9486-4479-91e9-a6d9339a2e0a', None, None, None, None, None)] {{(pid=122633) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 23:13:13.567462 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-9463df7d-cc9d-44e5-8780-ee513e2cd86e tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2848edf3f7674fa9b8a3c408b2479f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aa264849a1d4a908907421eed683fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:13.578476 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-9463df7d-cc9d-44e5-8780-ee513e2cd86e tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] 10.222.0.58 "GET /compute/v2.1/servers/8b45f99b-7717-489f-9507-9190a9402f47" status: 200 len: 1493 microversion: 2.1 time: 0.666283 Aug 10 23:13:13.583395 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1676/3469] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:12 2022] GET /compute/v2.1/servers/8b45f99b-7717-489f-9507-9190a9402f47 => generated 1493 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:13:13.592037 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-1363bb44-9e22-4299-ab36-b24a5d361e42 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:13.593003 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-1363bb44-9e22-4299-ab36-b24a5d361e42 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: da69cf1f-ff76-4a68-afe9-fc491b31e8a9] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:13.616528 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1363bb44-9e22-4299-ab36-b24a5d361e42 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:13.618972 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1363bb44-9e22-4299-ab36-b24a5d361e42 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:13.621167 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1363bb44-9e22-4299-ab36-b24a5d361e42 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:13.622217 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1363bb44-9e22-4299-ab36-b24a5d361e42 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:13.624750 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1363bb44-9e22-4299-ab36-b24a5d361e42 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:13.625439 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1363bb44-9e22-4299-ab36-b24a5d361e42 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:13.894042 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-1363bb44-9e22-4299-ab36-b24a5d361e42 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6160c7a42740efbe3613380933fa15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d90f8a58ad047fa8f347d6474e4d673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:13.909114 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-1363bb44-9e22-4299-ab36-b24a5d361e42 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "GET /compute/v2.1/servers/da69cf1f-ff76-4a68-afe9-fc491b31e8a9" status: 200 len: 1507 microversion: 2.1 time: 0.322815 Aug 10 23:13:13.918120 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1677/3470] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:13 2022] GET /compute/v2.1/servers/da69cf1f-ff76-4a68-afe9-fc491b31e8a9 => generated 1507 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:13:13.931478 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-7d55c7af-fb36-4106-a841-a1f0c4f4aedd tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:13.933456 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-7d55c7af-fb36-4106-a841-a1f0c4f4aedd tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: fa9dfd3a-a636-48ce-ae15-0ed51baee954] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:13.953190 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7d55c7af-fb36-4106-a841-a1f0c4f4aedd tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:13.955722 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7d55c7af-fb36-4106-a841-a1f0c4f4aedd tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:13.959355 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7d55c7af-fb36-4106-a841-a1f0c4f4aedd tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:13.960611 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7d55c7af-fb36-4106-a841-a1f0c4f4aedd tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:13.961290 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7d55c7af-fb36-4106-a841-a1f0c4f4aedd tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:13.962072 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7d55c7af-fb36-4106-a841-a1f0c4f4aedd tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:14.321433 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-7d55c7af-fb36-4106-a841-a1f0c4f4aedd tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:14.336533 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-7d55c7af-fb36-4106-a841-a1f0c4f4aedd tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954" status: 200 len: 1680 microversion: 2.1 time: 0.416418 Aug 10 23:13:14.352405 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1678/3471] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:13 2022] GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954 => generated 1680 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:13:14.504796 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-446bfc41-9571-4835-92df-ae41d80ff3bb tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Flavor limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:13:14.505263 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-446bfc41-9571-4835-92df-ae41d80ff3bb tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Image limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:13:14.505694 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-446bfc41-9571-4835-92df-ae41d80ff3bb tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Flavor pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:13:14.506110 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-446bfc41-9571-4835-92df-ae41d80ff3bb tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Image pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:13:14.506524 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-446bfc41-9571-4835-92df-ae41d80ff3bb tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:13:14.536990 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-446bfc41-9571-4835-92df-ae41d80ff3bb tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:14.537466 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-446bfc41-9571-4835-92df-ae41d80ff3bb tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:14.537906 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-446bfc41-9571-4835-92df-ae41d80ff3bb tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:14.538843 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-446bfc41-9571-4835-92df-ae41d80ff3bb tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:14.539467 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-446bfc41-9571-4835-92df-ae41d80ff3bb tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:14.541047 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-446bfc41-9571-4835-92df-ae41d80ff3bb tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:14.579869 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-446bfc41-9571-4835-92df-ae41d80ff3bb tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Getting quotas for project d11bbb3e87f4463787da56ab19108822. Resources: {'instances', 'cores', 'ram'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:13:14.587431 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-446bfc41-9571-4835-92df-ae41d80ff3bb tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Getting quotas for user f284ec2a4bf546b58c1c1adaf880e1fb and project d11bbb3e87f4463787da56ab19108822. Resources: {'instances', 'cores', 'ram'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:13:14.607456 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-7be0c214-9ea5-4c4a-aa53-3ae0d3bbd3ac tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:14.609531 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-7be0c214-9ea5-4c4a-aa53-3ae0d3bbd3ac tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] [instance: 8b45f99b-7717-489f-9507-9190a9402f47] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:14.629970 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7be0c214-9ea5-4c4a-aa53-3ae0d3bbd3ac tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:14.630808 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7be0c214-9ea5-4c4a-aa53-3ae0d3bbd3ac tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:14.632013 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7be0c214-9ea5-4c4a-aa53-3ae0d3bbd3ac tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:14.633080 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-446bfc41-9571-4835-92df-ae41d80ff3bb tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Going to run 1 instances... {{(pid=122633) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 23:13:14.634967 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7be0c214-9ea5-4c4a-aa53-3ae0d3bbd3ac tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:14.636443 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7be0c214-9ea5-4c4a-aa53-3ae0d3bbd3ac tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:14.638148 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7be0c214-9ea5-4c4a-aa53-3ae0d3bbd3ac tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:14.641699 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-446bfc41-9571-4835-92df-ae41d80ff3bb tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78ad8905-f66f-4733-8be9-2b260f1fabed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122633) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 23:13:14.720135 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-446bfc41-9571-4835-92df-ae41d80ff3bb tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.979169 Aug 10 23:13:14.724086 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1794/3472] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 23:13:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 1984 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 23:13:14.751097 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-7e29fc49-881a-4d61-aff4-4c8fdbf7f818 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:14.757780 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-7e29fc49-881a-4d61-aff4-4c8fdbf7f818 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:14.972975 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-7e29fc49-881a-4d61-aff4-4c8fdbf7f818 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:14.982043 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-7e29fc49-881a-4d61-aff4-4c8fdbf7f818 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b" status: 200 len: 1217 microversion: 2.1 time: 0.246711 Aug 10 23:13:14.993661 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1795/3473] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:14 2022] GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b => generated 1217 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:13:15.002777 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-b1f16c47-feb0-4e80-8339-3fe947d41bbb tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:15.003438 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-b1f16c47-feb0-4e80-8339-3fe947d41bbb tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: da69cf1f-ff76-4a68-afe9-fc491b31e8a9] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:15.038323 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b1f16c47-feb0-4e80-8339-3fe947d41bbb tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:15.039164 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b1f16c47-feb0-4e80-8339-3fe947d41bbb tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:15.039502 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b1f16c47-feb0-4e80-8339-3fe947d41bbb tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:15.040234 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b1f16c47-feb0-4e80-8339-3fe947d41bbb tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:15.040699 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b1f16c47-feb0-4e80-8339-3fe947d41bbb tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:15.041134 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b1f16c47-feb0-4e80-8339-3fe947d41bbb tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:15.415102 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-7be0c214-9ea5-4c4a-aa53-3ae0d3bbd3ac tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2848edf3f7674fa9b8a3c408b2479f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aa264849a1d4a908907421eed683fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:15.459652 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-7be0c214-9ea5-4c4a-aa53-3ae0d3bbd3ac tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] 10.222.0.58 "GET /compute/v2.1/servers/8b45f99b-7717-489f-9507-9190a9402f47" status: 200 len: 1493 microversion: 2.1 time: 0.846928 Aug 10 23:13:15.462233 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1679/3474] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:14 2022] GET /compute/v2.1/servers/8b45f99b-7717-489f-9507-9190a9402f47 => generated 1493 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:13:15.482547 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-018768cd-1099-4306-a883-4479be6c1a75 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:15.483234 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-018768cd-1099-4306-a883-4479be6c1a75 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: fa9dfd3a-a636-48ce-ae15-0ed51baee954] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:15.494953 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-b1f16c47-feb0-4e80-8339-3fe947d41bbb tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6160c7a42740efbe3613380933fa15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d90f8a58ad047fa8f347d6474e4d673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:15.504150 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-018768cd-1099-4306-a883-4479be6c1a75 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:15.505810 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-018768cd-1099-4306-a883-4479be6c1a75 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:15.506424 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-018768cd-1099-4306-a883-4479be6c1a75 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:15.507283 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-b1f16c47-feb0-4e80-8339-3fe947d41bbb tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "GET /compute/v2.1/servers/da69cf1f-ff76-4a68-afe9-fc491b31e8a9" status: 200 len: 1507 microversion: 2.1 time: 0.512373 Aug 10 23:13:15.508822 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1796/3475] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:14 2022] GET /compute/v2.1/servers/da69cf1f-ff76-4a68-afe9-fc491b31e8a9 => generated 1507 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:13:15.509522 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-018768cd-1099-4306-a883-4479be6c1a75 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:15.510067 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-018768cd-1099-4306-a883-4479be6c1a75 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:15.510508 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-018768cd-1099-4306-a883-4479be6c1a75 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:16.014797 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-d51c8f35-ff0a-4412-b0bf-9fedca763b1e tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:16.016061 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-d51c8f35-ff0a-4412-b0bf-9fedca763b1e tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:16.049096 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d51c8f35-ff0a-4412-b0bf-9fedca763b1e tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:16.049968 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d51c8f35-ff0a-4412-b0bf-9fedca763b1e tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:16.050736 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d51c8f35-ff0a-4412-b0bf-9fedca763b1e tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:16.056673 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d51c8f35-ff0a-4412-b0bf-9fedca763b1e tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:16.057349 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d51c8f35-ff0a-4412-b0bf-9fedca763b1e tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:16.064166 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d51c8f35-ff0a-4412-b0bf-9fedca763b1e tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:16.195564 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-d51c8f35-ff0a-4412-b0bf-9fedca763b1e tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:16.208399 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-d51c8f35-ff0a-4412-b0bf-9fedca763b1e tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b" status: 200 len: 1221 microversion: 2.1 time: 0.199306 Aug 10 23:13:16.209719 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1797/3476] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:16 2022] GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b => generated 1221 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:13:16.225621 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-018768cd-1099-4306-a883-4479be6c1a75 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:16.236095 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-018768cd-1099-4306-a883-4479be6c1a75 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954" status: 200 len: 1680 microversion: 2.1 time: 0.772599 Aug 10 23:13:16.241646 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1680/3477] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:15 2022] GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954 => generated 1680 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:13:16.486726 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-2538811d-99e1-4886-aaa2-ddd8549f76ae tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:16.487434 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-2538811d-99e1-4886-aaa2-ddd8549f76ae tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] [instance: 8b45f99b-7717-489f-9507-9190a9402f47] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:16.514202 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2538811d-99e1-4886-aaa2-ddd8549f76ae tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:16.515564 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2538811d-99e1-4886-aaa2-ddd8549f76ae tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:16.519050 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2538811d-99e1-4886-aaa2-ddd8549f76ae tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:16.533278 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-945833fe-18aa-4bbf-8778-91fc3c6bd5ce tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:16.535627 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-945833fe-18aa-4bbf-8778-91fc3c6bd5ce tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: da69cf1f-ff76-4a68-afe9-fc491b31e8a9] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:16.538307 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2538811d-99e1-4886-aaa2-ddd8549f76ae tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:16.540946 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2538811d-99e1-4886-aaa2-ddd8549f76ae tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:16.543802 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2538811d-99e1-4886-aaa2-ddd8549f76ae tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:16.555150 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-945833fe-18aa-4bbf-8778-91fc3c6bd5ce tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:16.565430 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-945833fe-18aa-4bbf-8778-91fc3c6bd5ce tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:16.571309 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-945833fe-18aa-4bbf-8778-91fc3c6bd5ce tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:16.579499 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-945833fe-18aa-4bbf-8778-91fc3c6bd5ce tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:16.583118 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-945833fe-18aa-4bbf-8778-91fc3c6bd5ce tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:16.584885 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-945833fe-18aa-4bbf-8778-91fc3c6bd5ce tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:16.654114 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:13:17.042487 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-945833fe-18aa-4bbf-8778-91fc3c6bd5ce tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6160c7a42740efbe3613380933fa15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d90f8a58ad047fa8f347d6474e4d673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:17.052296 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-945833fe-18aa-4bbf-8778-91fc3c6bd5ce tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "GET /compute/v2.1/servers/da69cf1f-ff76-4a68-afe9-fc491b31e8a9" status: 200 len: 1507 microversion: 2.1 time: 0.525182 Aug 10 23:13:17.061558 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1681/3478] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:16 2022] GET /compute/v2.1/servers/da69cf1f-ff76-4a68-afe9-fc491b31e8a9 => generated 1507 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:13:17.111690 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-2538811d-99e1-4886-aaa2-ddd8549f76ae tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2848edf3f7674fa9b8a3c408b2479f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aa264849a1d4a908907421eed683fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:17.128800 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-2538811d-99e1-4886-aaa2-ddd8549f76ae tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] 10.222.0.58 "GET /compute/v2.1/servers/8b45f99b-7717-489f-9507-9190a9402f47" status: 200 len: 1499 microversion: 2.1 time: 0.646962 Aug 10 23:13:17.129742 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1798/3479] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:16 2022] GET /compute/v2.1/servers/8b45f99b-7717-489f-9507-9190a9402f47 => generated 1499 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:13:17.159781 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-50745a23-68aa-41b3-abd7-e40011b087e6 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:17.160263 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-50745a23-68aa-41b3-abd7-e40011b087e6 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] [instance: 8b45f99b-7717-489f-9507-9190a9402f47] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:17.172362 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-50745a23-68aa-41b3-abd7-e40011b087e6 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:17.172865 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-50745a23-68aa-41b3-abd7-e40011b087e6 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:17.173316 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-50745a23-68aa-41b3-abd7-e40011b087e6 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:17.188081 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-50745a23-68aa-41b3-abd7-e40011b087e6 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:17.191548 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-50745a23-68aa-41b3-abd7-e40011b087e6 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:17.194312 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-50745a23-68aa-41b3-abd7-e40011b087e6 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:17.243944 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-89689670-7acc-497a-a2e6-c4c2eed1814b tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:17.246710 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-89689670-7acc-497a-a2e6-c4c2eed1814b tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:17.255234 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-89689670-7acc-497a-a2e6-c4c2eed1814b tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:17.256073 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-89689670-7acc-497a-a2e6-c4c2eed1814b tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:17.256960 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-89689670-7acc-497a-a2e6-c4c2eed1814b tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:17.261216 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-89689670-7acc-497a-a2e6-c4c2eed1814b tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:17.262905 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-89689670-7acc-497a-a2e6-c4c2eed1814b tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:17.264485 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-89689670-7acc-497a-a2e6-c4c2eed1814b tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:17.327279 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-50745a23-68aa-41b3-abd7-e40011b087e6 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] [instance: 8b45f99b-7717-489f-9507-9190a9402f47] Going to try to terminate instance {{(pid=122632) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:13:17.479050 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-89689670-7acc-497a-a2e6-c4c2eed1814b tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:17.522291 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-89689670-7acc-497a-a2e6-c4c2eed1814b tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b" status: 200 len: 1275 microversion: 2.1 time: 0.292435 Aug 10 23:13:17.531172 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-50745a23-68aa-41b3-abd7-e40011b087e6 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] 10.222.0.58 "DELETE /compute/v2.1/servers/8b45f99b-7717-489f-9507-9190a9402f47" status: 204 len: 0 microversion: 2.1 time: 0.373757 Aug 10 23:13:17.533937 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1682/3480] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:13:17 2022] DELETE /compute/v2.1/servers/8b45f99b-7717-489f-9507-9190a9402f47 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:13:17.547755 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-142f19c7-0d79-4294-bea8-10239c07105a tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:17.551701 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-142f19c7-0d79-4294-bea8-10239c07105a tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: fa9dfd3a-a636-48ce-ae15-0ed51baee954] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:17.552497 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1799/3481] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:17 2022] GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b => generated 1275 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:13:17.567242 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-142f19c7-0d79-4294-bea8-10239c07105a tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:17.568343 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-142f19c7-0d79-4294-bea8-10239c07105a tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:17.569071 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-142f19c7-0d79-4294-bea8-10239c07105a tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:17.570016 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-142f19c7-0d79-4294-bea8-10239c07105a tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:17.576910 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-142f19c7-0d79-4294-bea8-10239c07105a tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:17.577938 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-142f19c7-0d79-4294-bea8-10239c07105a tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:17.581075 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-e7becf10-be90-49f4-9865-5f4e4e264bb9 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:17.582493 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-e7becf10-be90-49f4-9865-5f4e4e264bb9 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] [instance: 8b45f99b-7717-489f-9507-9190a9402f47] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:17.611625 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e7becf10-be90-49f4-9865-5f4e4e264bb9 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:17.613365 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e7becf10-be90-49f4-9865-5f4e4e264bb9 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:17.615313 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e7becf10-be90-49f4-9865-5f4e4e264bb9 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:17.616252 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e7becf10-be90-49f4-9865-5f4e4e264bb9 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:17.619645 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e7becf10-be90-49f4-9865-5f4e4e264bb9 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:17.620787 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e7becf10-be90-49f4-9865-5f4e4e264bb9 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:17.930757 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-e7becf10-be90-49f4-9865-5f4e4e264bb9 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2848edf3f7674fa9b8a3c408b2479f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aa264849a1d4a908907421eed683fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:17.944217 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-e7becf10-be90-49f4-9865-5f4e4e264bb9 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] 10.222.0.58 "GET /compute/v2.1/servers/8b45f99b-7717-489f-9507-9190a9402f47" status: 200 len: 1505 microversion: 2.1 time: 0.386415 Aug 10 23:13:17.947337 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1800/3482] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:17 2022] GET /compute/v2.1/servers/8b45f99b-7717-489f-9507-9190a9402f47 => generated 1505 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:13:18.090109 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-22c92e52-8a42-4256-9f0a-376cf9c9fb43 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:18.091434 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-22c92e52-8a42-4256-9f0a-376cf9c9fb43 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: da69cf1f-ff76-4a68-afe9-fc491b31e8a9] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:18.102347 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-22c92e52-8a42-4256-9f0a-376cf9c9fb43 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:18.105097 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-22c92e52-8a42-4256-9f0a-376cf9c9fb43 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:18.105806 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-22c92e52-8a42-4256-9f0a-376cf9c9fb43 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:18.106806 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-22c92e52-8a42-4256-9f0a-376cf9c9fb43 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:18.108766 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-22c92e52-8a42-4256-9f0a-376cf9c9fb43 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:18.110620 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-22c92e52-8a42-4256-9f0a-376cf9c9fb43 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:18.131625 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:13:18.384794 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-142f19c7-0d79-4294-bea8-10239c07105a tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:18.404790 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-142f19c7-0d79-4294-bea8-10239c07105a tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954" status: 200 len: 1680 microversion: 2.1 time: 0.863704 Aug 10 23:13:18.420459 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1683/3483] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:17 2022] GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954 => generated 1680 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:13:18.529557 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-22c92e52-8a42-4256-9f0a-376cf9c9fb43 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6160c7a42740efbe3613380933fa15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d90f8a58ad047fa8f347d6474e4d673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:18.545501 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-22c92e52-8a42-4256-9f0a-376cf9c9fb43 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "GET /compute/v2.1/servers/da69cf1f-ff76-4a68-afe9-fc491b31e8a9" status: 200 len: 1507 microversion: 2.1 time: 0.459537 Aug 10 23:13:18.549156 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1801/3484] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:18 2022] GET /compute/v2.1/servers/da69cf1f-ff76-4a68-afe9-fc491b31e8a9 => generated 1507 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:13:18.576488 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-bf925219-0593-4658-a847-60f707ab7f47 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:18.577126 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-bf925219-0593-4658-a847-60f707ab7f47 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:18.601502 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bf925219-0593-4658-a847-60f707ab7f47 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:18.602655 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bf925219-0593-4658-a847-60f707ab7f47 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:18.603318 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bf925219-0593-4658-a847-60f707ab7f47 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:18.605791 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bf925219-0593-4658-a847-60f707ab7f47 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:18.613581 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bf925219-0593-4658-a847-60f707ab7f47 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:18.614887 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bf925219-0593-4658-a847-60f707ab7f47 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:18.900466 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-70170d6f-4d9e-4645-a616-fe08013907a5 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:18.911985 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-70170d6f-4d9e-4645-a616-fe08013907a5 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd879a42349cf4570aaaf88ba90492f6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d39cab5115d4818b73ea24cb0987a3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:18.919613 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-70170d6f-4d9e-4645-a616-fe08013907a5 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Searching by: {'deleted': False, 'project_id': '0d39cab5115d4818b73ea24cb0987a3b'} {{(pid=122633) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 10 23:13:18.939205 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-70170d6f-4d9e-4645-a616-fe08013907a5 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:18.939938 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-70170d6f-4d9e-4645-a616-fe08013907a5 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:18.940531 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-70170d6f-4d9e-4645-a616-fe08013907a5 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:18.941432 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-70170d6f-4d9e-4645-a616-fe08013907a5 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:18.942056 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-70170d6f-4d9e-4645-a616-fe08013907a5 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:18.946492 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-70170d6f-4d9e-4645-a616-fe08013907a5 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:19.009928 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.multi_cell_list [None req-70170d6f-4d9e-4645-a616-fe08013907a5 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122633) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 10 23:13:19.108042 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-70170d6f-4d9e-4645-a616-fe08013907a5 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] 10.222.0.58 "GET /compute/v2.1/servers" status: 200 len: 344 microversion: 2.1 time: 0.224325 Aug 10 23:13:19.109623 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1802/3485] 10.222.0.58 () {58 vars in 1125 bytes} [Wed Aug 10 23:13:18 2022] GET /compute/v2.1/servers => generated 344 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:13:19.127256 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-2131b97e-1e37-4138-95c4-61bcb4de4084 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:19.127877 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-2131b97e-1e37-4138-95c4-61bcb4de4084 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] [instance: 8b45f99b-7717-489f-9507-9190a9402f47] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:19.142976 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2131b97e-1e37-4138-95c4-61bcb4de4084 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:19.148601 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2131b97e-1e37-4138-95c4-61bcb4de4084 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:19.149239 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2131b97e-1e37-4138-95c4-61bcb4de4084 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:19.150143 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2131b97e-1e37-4138-95c4-61bcb4de4084 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:19.150834 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2131b97e-1e37-4138-95c4-61bcb4de4084 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:19.152287 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2131b97e-1e37-4138-95c4-61bcb4de4084 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:19.208247 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-bf925219-0593-4658-a847-60f707ab7f47 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:19.225560 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-bf925219-0593-4658-a847-60f707ab7f47 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b" status: 200 len: 1317 microversion: 2.1 time: 0.673124 Aug 10 23:13:19.243903 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1684/3486] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:18 2022] GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b => generated 1317 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:13:19.270011 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c414cc2a-5393-4fc3-be4c-052fd8a72eb9 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:19.304702 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-c414cc2a-5393-4fc3-be4c-052fd8a72eb9 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd879a42349cf4570aaaf88ba90492f6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d39cab5115d4818b73ea24cb0987a3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:19.317561 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-c414cc2a-5393-4fc3-be4c-052fd8a72eb9 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Searching by: {'deleted': False, 'project_id': '0d39cab5115d4818b73ea24cb0987a3b'} {{(pid=122632) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 10 23:13:19.342804 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c414cc2a-5393-4fc3-be4c-052fd8a72eb9 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:19.346320 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c414cc2a-5393-4fc3-be4c-052fd8a72eb9 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:19.349475 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c414cc2a-5393-4fc3-be4c-052fd8a72eb9 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:19.353640 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c414cc2a-5393-4fc3-be4c-052fd8a72eb9 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:19.355585 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c414cc2a-5393-4fc3-be4c-052fd8a72eb9 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:19.356844 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c414cc2a-5393-4fc3-be4c-052fd8a72eb9 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:19.517821 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.multi_cell_list [None req-c414cc2a-5393-4fc3-be4c-052fd8a72eb9 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122632) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 10 23:13:19.612460 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-2131b97e-1e37-4138-95c4-61bcb4de4084 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2848edf3f7674fa9b8a3c408b2479f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aa264849a1d4a908907421eed683fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:19.631336 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-c414cc2a-5393-4fc3-be4c-052fd8a72eb9 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd879a42349cf4570aaaf88ba90492f6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d39cab5115d4818b73ea24cb0987a3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:19.633970 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-2131b97e-1e37-4138-95c4-61bcb4de4084 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] 10.222.0.58 "GET /compute/v2.1/servers/8b45f99b-7717-489f-9507-9190a9402f47" status: 200 len: 1505 microversion: 2.1 time: 0.522467 Aug 10 23:13:19.637083 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1803/3487] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:19 2022] GET /compute/v2.1/servers/8b45f99b-7717-489f-9507-9190a9402f47 => generated 1505 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:13:19.642135 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c414cc2a-5393-4fc3-be4c-052fd8a72eb9 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:19.643244 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c414cc2a-5393-4fc3-be4c-052fd8a72eb9 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:19.644047 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c414cc2a-5393-4fc3-be4c-052fd8a72eb9 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:19.647455 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-58b5162c-058a-400f-b84f-2f5921c75bd8 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:19.653530 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-58b5162c-058a-400f-b84f-2f5921c75bd8 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: fa9dfd3a-a636-48ce-ae15-0ed51baee954] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:19.684756 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-58b5162c-058a-400f-b84f-2f5921c75bd8 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:19.686122 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-58b5162c-058a-400f-b84f-2f5921c75bd8 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:19.688163 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-58b5162c-058a-400f-b84f-2f5921c75bd8 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:19.690361 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-58b5162c-058a-400f-b84f-2f5921c75bd8 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:19.690892 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-58b5162c-058a-400f-b84f-2f5921c75bd8 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:19.692230 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-58b5162c-058a-400f-b84f-2f5921c75bd8 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:20.146693 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-c414cc2a-5393-4fc3-be4c-052fd8a72eb9 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] 10.222.0.58 "GET /compute/v2.1/servers/detail" status: 200 len: 1605 microversion: 2.1 time: 0.897696 Aug 10 23:13:20.147700 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1685/3488] 10.222.0.58 () {58 vars in 1146 bytes} [Wed Aug 10 23:13:19 2022] GET /compute/v2.1/servers/detail => generated 1605 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:13:20.154635 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-8bc71455-429e-4c4a-a27c-84fc01b63c72 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:20.157469 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-8bc71455-429e-4c4a-a27c-84fc01b63c72 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: da69cf1f-ff76-4a68-afe9-fc491b31e8a9] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:20.178697 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8bc71455-429e-4c4a-a27c-84fc01b63c72 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:20.179276 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8bc71455-429e-4c4a-a27c-84fc01b63c72 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:20.179733 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8bc71455-429e-4c4a-a27c-84fc01b63c72 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:20.193849 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8bc71455-429e-4c4a-a27c-84fc01b63c72 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:20.194453 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8bc71455-429e-4c4a-a27c-84fc01b63c72 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:20.194974 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8bc71455-429e-4c4a-a27c-84fc01b63c72 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:20.330547 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-58b5162c-058a-400f-b84f-2f5921c75bd8 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:20.339180 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-58b5162c-058a-400f-b84f-2f5921c75bd8 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954" status: 200 len: 1680 microversion: 2.1 time: 0.700573 Aug 10 23:13:20.339773 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1804/3489] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:19 2022] GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954 => generated 1680 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:13:20.366774 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-d2ad1df3-c2fc-413d-bc32-15d30b6e6d09 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:20.383795 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-d2ad1df3-c2fc-413d-bc32-15d30b6e6d09 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] 10.222.0.58 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.021345 Aug 10 23:13:20.384855 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1805/3490] 10.222.0.58 () {58 vars in 1137 bytes} [Wed Aug 10 23:13:20 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:13:20.398999 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-5f47543c-f1a2-4700-a530-9197b19a4c37 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:20.399962 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-5f47543c-f1a2-4700-a530-9197b19a4c37 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:20.407291 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5f47543c-f1a2-4700-a530-9197b19a4c37 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:20.408133 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5f47543c-f1a2-4700-a530-9197b19a4c37 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:20.408808 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5f47543c-f1a2-4700-a530-9197b19a4c37 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:20.409742 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5f47543c-f1a2-4700-a530-9197b19a4c37 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:20.410418 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5f47543c-f1a2-4700-a530-9197b19a4c37 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:20.411083 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5f47543c-f1a2-4700-a530-9197b19a4c37 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:20.931434 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-5f47543c-f1a2-4700-a530-9197b19a4c37 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:20.942107 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-5f47543c-f1a2-4700-a530-9197b19a4c37 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b" status: 200 len: 1317 microversion: 2.1 time: 0.547460 Aug 10 23:13:20.961969 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1806/3491] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:20 2022] GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b => generated 1317 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:13:20.967886 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c526574c-38a9-4ee6-b94a-76b418df7866 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:13:21.006381 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-c526574c-38a9-4ee6-b94a-76b418df7866 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] [instance: f4dc6241-b173-4cbf-b76c-7da3fac7edcc] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:21.037142 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c526574c-38a9-4ee6-b94a-76b418df7866 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:21.049672 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c526574c-38a9-4ee6-b94a-76b418df7866 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:21.050245 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c526574c-38a9-4ee6-b94a-76b418df7866 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:21.051186 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c526574c-38a9-4ee6-b94a-76b418df7866 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:21.051829 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c526574c-38a9-4ee6-b94a-76b418df7866 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:21.052486 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c526574c-38a9-4ee6-b94a-76b418df7866 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:21.128631 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-8bc71455-429e-4c4a-a27c-84fc01b63c72 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6160c7a42740efbe3613380933fa15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d90f8a58ad047fa8f347d6474e4d673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:21.133861 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-c526574c-38a9-4ee6-b94a-76b418df7866 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "POST /compute/v2.1/servers/f4dc6241-b173-4cbf-b76c-7da3fac7edcc/action" status: 200 len: 24572 microversion: 2.1 time: 0.170242 Aug 10 23:13:21.143097 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-8bc71455-429e-4c4a-a27c-84fc01b63c72 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "GET /compute/v2.1/servers/da69cf1f-ff76-4a68-afe9-fc491b31e8a9" status: 200 len: 1507 microversion: 2.1 time: 0.990128 Aug 10 23:13:21.143097 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1686/3492] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:20 2022] GET /compute/v2.1/servers/da69cf1f-ff76-4a68-afe9-fc491b31e8a9 => generated 1507 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:13:21.147343 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1807/3493] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:13:20 2022] POST /compute/v2.1/servers/f4dc6241-b173-4cbf-b76c-7da3fac7edcc/action => generated 24572 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 23:13:21.155082 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c79d9056-16bf-45bf-8e11-3adc7cf19cb9 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:21.158179 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-c79d9056-16bf-45bf-8e11-3adc7cf19cb9 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] [instance: 8b45f99b-7717-489f-9507-9190a9402f47] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:21.166167 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c79d9056-16bf-45bf-8e11-3adc7cf19cb9 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:21.167294 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c79d9056-16bf-45bf-8e11-3adc7cf19cb9 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:21.167975 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c79d9056-16bf-45bf-8e11-3adc7cf19cb9 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:21.168902 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c79d9056-16bf-45bf-8e11-3adc7cf19cb9 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:21.169144 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-91497599-e3ea-4b90-9473-a9e81b0bec52 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:21.169795 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c79d9056-16bf-45bf-8e11-3adc7cf19cb9 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:21.170429 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c79d9056-16bf-45bf-8e11-3adc7cf19cb9 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:21.171495 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-91497599-e3ea-4b90-9473-a9e81b0bec52 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] [instance: 20d2cf25-e240-4abb-908a-e0ea2bd6e2d6] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:21.198750 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-91497599-e3ea-4b90-9473-a9e81b0bec52 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:21.199973 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-91497599-e3ea-4b90-9473-a9e81b0bec52 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:21.200432 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-91497599-e3ea-4b90-9473-a9e81b0bec52 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:21.204409 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-91497599-e3ea-4b90-9473-a9e81b0bec52 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:21.205144 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-91497599-e3ea-4b90-9473-a9e81b0bec52 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:21.205769 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-91497599-e3ea-4b90-9473-a9e81b0bec52 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:21.286559 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-91497599-e3ea-4b90-9473-a9e81b0bec52 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] [instance: 20d2cf25-e240-4abb-908a-e0ea2bd6e2d6] Going to try to terminate instance {{(pid=122633) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:13:21.480036 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-91497599-e3ea-4b90-9473-a9e81b0bec52 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] 10.222.0.58 "DELETE /compute/v2.1/servers/20d2cf25-e240-4abb-908a-e0ea2bd6e2d6" status: 204 len: 0 microversion: 2.1 time: 0.329340 Aug 10 23:13:21.481068 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1808/3494] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:13:21 2022] DELETE /compute/v2.1/servers/20d2cf25-e240-4abb-908a-e0ea2bd6e2d6 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:13:21.491077 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-ab98affe-f7c7-46df-a77e-8aade1e1c655 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:21.492864 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-ab98affe-f7c7-46df-a77e-8aade1e1c655 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: fa9dfd3a-a636-48ce-ae15-0ed51baee954] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:21.502269 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ab98affe-f7c7-46df-a77e-8aade1e1c655 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:21.505994 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ab98affe-f7c7-46df-a77e-8aade1e1c655 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:21.507403 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ab98affe-f7c7-46df-a77e-8aade1e1c655 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:21.509407 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ab98affe-f7c7-46df-a77e-8aade1e1c655 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:21.510370 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ab98affe-f7c7-46df-a77e-8aade1e1c655 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:21.511078 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ab98affe-f7c7-46df-a77e-8aade1e1c655 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:21.810964 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-c79d9056-16bf-45bf-8e11-3adc7cf19cb9 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2848edf3f7674fa9b8a3c408b2479f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aa264849a1d4a908907421eed683fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:21.832423 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-c79d9056-16bf-45bf-8e11-3adc7cf19cb9 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] 10.222.0.58 "GET /compute/v2.1/servers/8b45f99b-7717-489f-9507-9190a9402f47" status: 200 len: 1505 microversion: 2.1 time: 0.687629 Aug 10 23:13:21.834484 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1687/3495] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:21 2022] GET /compute/v2.1/servers/8b45f99b-7717-489f-9507-9190a9402f47 => generated 1505 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:13:21.858552 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-0b53c358-af9b-45f6-8b8a-6ec526c8debd tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:21.860295 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-0b53c358-af9b-45f6-8b8a-6ec526c8debd tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] [instance: 20d2cf25-e240-4abb-908a-e0ea2bd6e2d6] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:21.875123 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0b53c358-af9b-45f6-8b8a-6ec526c8debd tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:21.875791 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0b53c358-af9b-45f6-8b8a-6ec526c8debd tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:21.876328 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0b53c358-af9b-45f6-8b8a-6ec526c8debd tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:21.880572 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0b53c358-af9b-45f6-8b8a-6ec526c8debd tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:21.881247 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0b53c358-af9b-45f6-8b8a-6ec526c8debd tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:21.881836 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0b53c358-af9b-45f6-8b8a-6ec526c8debd tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:22.036652 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-ab98affe-f7c7-46df-a77e-8aade1e1c655 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:22.050553 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-ab98affe-f7c7-46df-a77e-8aade1e1c655 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954" status: 200 len: 1680 microversion: 2.1 time: 0.564822 Aug 10 23:13:22.052131 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1809/3496] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:21 2022] GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954 => generated 1680 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:13:22.064972 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-dea712bb-0c1b-4b6a-8196-233e721df618 req-7c58c48b-9a6d-4106-80ad-cb5c11fec474 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23bbe055-4a92-4b96-8b89-c941229bfb0b", "tag": "6f537f41-6630-4a1c-b82e-c0862b0fc22c"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:13:22.079252 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-dea712bb-0c1b-4b6a-8196-233e721df618 req-7c58c48b-9a6d-4106-80ad-cb5c11fec474 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:22.080143 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-dea712bb-0c1b-4b6a-8196-233e721df618 req-7c58c48b-9a6d-4106-80ad-cb5c11fec474 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:22.080783 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-dea712bb-0c1b-4b6a-8196-233e721df618 req-7c58c48b-9a6d-4106-80ad-cb5c11fec474 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:22.098749 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-dea712bb-0c1b-4b6a-8196-233e721df618 req-7c58c48b-9a6d-4106-80ad-cb5c11fec474 service nova] Creating event network-changed:6f537f41-6630-4a1c-b82e-c0862b0fc22c for instance 23bbe055-4a92-4b96-8b89-c941229bfb0b on n-h2-850468-14 Aug 10 23:13:22.105572 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-dea712bb-0c1b-4b6a-8196-233e721df618 req-7c58c48b-9a6d-4106-80ad-cb5c11fec474 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049651 Aug 10 23:13:22.112082 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1810/3497] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:13:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:13:22.120697 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-dc03f687-809c-4831-b0fe-4001b958ab81 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:22.122607 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-dc03f687-809c-4831-b0fe-4001b958ab81 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:22.131084 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dc03f687-809c-4831-b0fe-4001b958ab81 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:22.131931 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dc03f687-809c-4831-b0fe-4001b958ab81 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:22.132650 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dc03f687-809c-4831-b0fe-4001b958ab81 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:22.133730 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dc03f687-809c-4831-b0fe-4001b958ab81 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:22.134679 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dc03f687-809c-4831-b0fe-4001b958ab81 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:22.135352 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dc03f687-809c-4831-b0fe-4001b958ab81 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:22.395871 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-dc03f687-809c-4831-b0fe-4001b958ab81 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:22.407129 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-dc03f687-809c-4831-b0fe-4001b958ab81 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b" status: 200 len: 1317 microversion: 2.1 time: 0.292711 Aug 10 23:13:22.407852 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1811/3498] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:22 2022] GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b => generated 1317 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:13:22.418823 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-0e5fc88b-cd59-4746-80e3-32727738daca tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:22.422380 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-0e5fc88b-cd59-4746-80e3-32727738daca tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: da69cf1f-ff76-4a68-afe9-fc491b31e8a9] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:22.450190 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0e5fc88b-cd59-4746-80e3-32727738daca tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:22.450561 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0e5fc88b-cd59-4746-80e3-32727738daca tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:22.451095 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0e5fc88b-cd59-4746-80e3-32727738daca tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:22.452009 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0e5fc88b-cd59-4746-80e3-32727738daca tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:22.453868 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0e5fc88b-cd59-4746-80e3-32727738daca tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:22.454875 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0e5fc88b-cd59-4746-80e3-32727738daca tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:22.665287 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-0b53c358-af9b-45f6-8b8a-6ec526c8debd tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd879a42349cf4570aaaf88ba90492f6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d39cab5115d4818b73ea24cb0987a3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:22.676580 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-0b53c358-af9b-45f6-8b8a-6ec526c8debd tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] 10.222.0.58 "GET /compute/v2.1/servers/20d2cf25-e240-4abb-908a-e0ea2bd6e2d6" status: 200 len: 1608 microversion: 2.1 time: 0.840676 Aug 10 23:13:22.700581 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1688/3499] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:21 2022] GET /compute/v2.1/servers/20d2cf25-e240-4abb-908a-e0ea2bd6e2d6 => generated 1608 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:13:22.865829 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-168a1992-b1dd-4b35-96e1-47938c235bb9 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:22.867728 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-168a1992-b1dd-4b35-96e1-47938c235bb9 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] [instance: 8b45f99b-7717-489f-9507-9190a9402f47] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:22.874983 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-168a1992-b1dd-4b35-96e1-47938c235bb9 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:22.875600 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-168a1992-b1dd-4b35-96e1-47938c235bb9 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:22.876127 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-168a1992-b1dd-4b35-96e1-47938c235bb9 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:22.876985 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-168a1992-b1dd-4b35-96e1-47938c235bb9 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:22.877542 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-168a1992-b1dd-4b35-96e1-47938c235bb9 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:22.878039 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-168a1992-b1dd-4b35-96e1-47938c235bb9 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:22.896802 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-168a1992-b1dd-4b35-96e1-47938c235bb9 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] HTTP exception thrown: Instance 8b45f99b-7717-489f-9507-9190a9402f47 could not be found. Aug 10 23:13:22.898889 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-168a1992-b1dd-4b35-96e1-47938c235bb9 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Request method failure captured: Aug 10 23:13:22.898889 n-d-850468-14 devstack@n-api.service[122632]: request: GET /compute/v2.1/servers/8b45f99b-7717-489f-9507-9190a9402f47 HTTP/1.1 Aug 10 23:13:22.898889 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:13:22.898889 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:13:22.898889 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:13:22.898889 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 23:13:22.898889 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:13:22.898889 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:13:22.898889 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:13:22.898889 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:13:22.898889 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9DsdnFB16636vQpR8jkMn1ex2mbZwNO2CPZkDlruV0YBDruA93cwInB7tQbD3HLm5nQDtfIh3GHFUGWf0ZyUer5izP9u1wH5wFRW3Iia94BdCkH72m5XrZV1PR7DlbmdjjWUzwZkXH3ysYUPfdoHtjk8B7vUtdzwgOiWfJcptXjiPFU Aug 10 23:13:22.898889 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:13:22.898889 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:13:22.898889 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:13:22.898889 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:13:22.898889 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:13:22.898889 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:13:22.898889 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 6aa264849a1d4a908907421eed683fab Aug 10 23:13:22.898889 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-ServerRescueTestJSON-735485422 Aug 10 23:13:22.898889 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:13:22.898889 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:13:22.898889 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6aa264849a1d4a908907421eed683fab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6aa264849a1d4a908907421eed683fab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/6aa264849a1d4a908907421eed683fab"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_6aa264849a1d4a908907421eed683fab", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:13:22.898889 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-ServerRescueTestJSON-735485422 Aug 10 23:13:22.898889 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 6aa264849a1d4a908907421eed683fab Aug 10 23:13:22.898889 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-ServerRescueTestJSON-735485422 Aug 10 23:13:22.898889 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-ServerRescueTestJSON-735485422-project Aug 10 23:13:22.898889 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:13:22.898889 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:13:22.898889 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: 2848edf3f7674fa9b8a3c408b2479f5a Aug 10 23:13:22.898889 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-ServerRescueTestJSON-735485422-project Aug 10 23:13:22.898889 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:13:22.898889 n-d-850468-14 devstack@n-api.service[122632]: exception: Instance 8b45f99b-7717-489f-9507-9190a9402f47 could not be found. Aug 10 23:13:22.898889 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': '8b45f99b-7717-489f-9507-9190a9402f47'} Aug 10 23:13:22.898889 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:13:22.898889 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:13:22.898889 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:13:22.898889 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:13:22.898889 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:13:22.898889 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:13:22.898889 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:13:22.898889 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:13:22.898889 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:13:22.898889 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:13:22.898889 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8b45f99b-7717-489f-9507-9190a9402f47 could not be found. Aug 10 23:13:22.898889 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:13:22.898889 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:13:22.898889 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:13:22.898889 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:13:22.898889 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:13:22.898889 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:13:22.898889 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:13:22.898889 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:13:22.898889 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:13:22.898889 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:13:22.898889 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:13:22.898889 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:13:22.898889 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:13:22.898889 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:13:22.898889 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:13:22.898889 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:13:22.898889 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8b45f99b-7717-489f-9507-9190a9402f47 could not be found. Aug 10 23:13:22.898889 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:13:22.898889 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:13:22.898889 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:13:22.904147 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:13:22.904147 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:13:22.904147 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:13:22.904147 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:13:22.904147 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:13:22.904147 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8b45f99b-7717-489f-9507-9190a9402f47 could not be found. Aug 10 23:13:22.904147 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:13:22.904147 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-168a1992-b1dd-4b35-96e1-47938c235bb9 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Returning 404 to user: Instance 8b45f99b-7717-489f-9507-9190a9402f47 could not be found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:13:22.904147 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-168a1992-b1dd-4b35-96e1-47938c235bb9 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] 10.222.0.58 "GET /compute/v2.1/servers/8b45f99b-7717-489f-9507-9190a9402f47" status: 404 len: 111 microversion: 2.1 time: 0.040955 Aug 10 23:13:22.904147 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1689/3500] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:22 2022] GET /compute/v2.1/servers/8b45f99b-7717-489f-9507-9190a9402f47 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:13:22.912696 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-63e9a366-987f-4a07-999a-cfcd99c875d1 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:22.913324 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-63e9a366-987f-4a07-999a-cfcd99c875d1 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] [instance: 371c934a-2685-4d6f-b385-3b86f4a542e0] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:22.921205 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-63e9a366-987f-4a07-999a-cfcd99c875d1 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:22.921833 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-63e9a366-987f-4a07-999a-cfcd99c875d1 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:22.922347 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-63e9a366-987f-4a07-999a-cfcd99c875d1 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:22.923288 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-63e9a366-987f-4a07-999a-cfcd99c875d1 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:22.923790 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-63e9a366-987f-4a07-999a-cfcd99c875d1 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:22.924301 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-63e9a366-987f-4a07-999a-cfcd99c875d1 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:22.960401 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-63e9a366-987f-4a07-999a-cfcd99c875d1 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] [instance: 371c934a-2685-4d6f-b385-3b86f4a542e0] Going to try to terminate instance {{(pid=122632) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:13:23.052484 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-0e5fc88b-cd59-4746-80e3-32727738daca tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6160c7a42740efbe3613380933fa15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d90f8a58ad047fa8f347d6474e4d673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:23.063079 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-0e5fc88b-cd59-4746-80e3-32727738daca tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "GET /compute/v2.1/servers/da69cf1f-ff76-4a68-afe9-fc491b31e8a9" status: 200 len: 1507 microversion: 2.1 time: 0.653742 Aug 10 23:13:23.063673 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1812/3501] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:22 2022] GET /compute/v2.1/servers/da69cf1f-ff76-4a68-afe9-fc491b31e8a9 => generated 1507 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:13:23.065356 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-63e9a366-987f-4a07-999a-cfcd99c875d1 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] 10.222.0.58 "DELETE /compute/v2.1/servers/371c934a-2685-4d6f-b385-3b86f4a542e0" status: 204 len: 0 microversion: 2.1 time: 0.157359 Aug 10 23:13:23.066139 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1690/3502] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:13:22 2022] DELETE /compute/v2.1/servers/371c934a-2685-4d6f-b385-3b86f4a542e0 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 10 23:13:23.082984 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-5053d76c-cb27-429d-a26c-54f75ee6ed76 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:23.083687 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-d9e32fd7-bc15-44c3-8955-b00c8fec1a5a tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:23.084367 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-5053d76c-cb27-429d-a26c-54f75ee6ed76 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: fa9dfd3a-a636-48ce-ae15-0ed51baee954] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:23.084695 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-d9e32fd7-bc15-44c3-8955-b00c8fec1a5a tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] [instance: 371c934a-2685-4d6f-b385-3b86f4a542e0] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:23.092222 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d9e32fd7-bc15-44c3-8955-b00c8fec1a5a tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:23.092532 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5053d76c-cb27-429d-a26c-54f75ee6ed76 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:23.092733 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d9e32fd7-bc15-44c3-8955-b00c8fec1a5a tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:23.093211 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d9e32fd7-bc15-44c3-8955-b00c8fec1a5a tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:23.093699 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5053d76c-cb27-429d-a26c-54f75ee6ed76 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:23.093874 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d9e32fd7-bc15-44c3-8955-b00c8fec1a5a tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:23.094319 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d9e32fd7-bc15-44c3-8955-b00c8fec1a5a tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:23.094695 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5053d76c-cb27-429d-a26c-54f75ee6ed76 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:23.094822 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d9e32fd7-bc15-44c3-8955-b00c8fec1a5a tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:23.095698 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5053d76c-cb27-429d-a26c-54f75ee6ed76 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:23.096331 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5053d76c-cb27-429d-a26c-54f75ee6ed76 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:23.096934 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5053d76c-cb27-429d-a26c-54f75ee6ed76 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:23.393566 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-5053d76c-cb27-429d-a26c-54f75ee6ed76 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:23.404504 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-5053d76c-cb27-429d-a26c-54f75ee6ed76 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954" status: 200 len: 1680 microversion: 2.1 time: 0.325643 Aug 10 23:13:23.405644 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1691/3503] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:23 2022] GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954 => generated 1680 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:13:23.438364 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-fb44a471-27bc-4d5c-96fa-0c9475257805 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:23.439563 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-fb44a471-27bc-4d5c-96fa-0c9475257805 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:23.448708 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fb44a471-27bc-4d5c-96fa-0c9475257805 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:23.451528 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fb44a471-27bc-4d5c-96fa-0c9475257805 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:23.452359 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fb44a471-27bc-4d5c-96fa-0c9475257805 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:23.453743 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fb44a471-27bc-4d5c-96fa-0c9475257805 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:23.454408 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fb44a471-27bc-4d5c-96fa-0c9475257805 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:23.455048 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fb44a471-27bc-4d5c-96fa-0c9475257805 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:23.802449 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-d9e32fd7-bc15-44c3-8955-b00c8fec1a5a tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2848edf3f7674fa9b8a3c408b2479f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aa264849a1d4a908907421eed683fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:23.815056 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-d9e32fd7-bc15-44c3-8955-b00c8fec1a5a tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] 10.222.0.58 "GET /compute/v2.1/servers/371c934a-2685-4d6f-b385-3b86f4a542e0" status: 200 len: 1492 microversion: 2.1 time: 0.736500 Aug 10 23:13:23.816003 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1813/3504] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:23 2022] GET /compute/v2.1/servers/371c934a-2685-4d6f-b385-3b86f4a542e0 => generated 1492 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:13:23.820654 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-cd76a3bb-c1e2-4597-92c3-d1c4db438458 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:23.821162 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-cd76a3bb-c1e2-4597-92c3-d1c4db438458 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] [instance: 20d2cf25-e240-4abb-908a-e0ea2bd6e2d6] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:23.847259 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cd76a3bb-c1e2-4597-92c3-d1c4db438458 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:23.848050 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cd76a3bb-c1e2-4597-92c3-d1c4db438458 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:23.848798 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cd76a3bb-c1e2-4597-92c3-d1c4db438458 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:23.852659 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cd76a3bb-c1e2-4597-92c3-d1c4db438458 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:23.853168 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cd76a3bb-c1e2-4597-92c3-d1c4db438458 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:23.853676 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cd76a3bb-c1e2-4597-92c3-d1c4db438458 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:23.923827 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-fb44a471-27bc-4d5c-96fa-0c9475257805 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:23.941078 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-fb44a471-27bc-4d5c-96fa-0c9475257805 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b" status: 200 len: 1317 microversion: 2.1 time: 0.512658 Aug 10 23:13:23.941711 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1692/3505] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:23 2022] GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b => generated 1317 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:13:24.085517 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-7b8265fd-460e-4bdd-802d-ecf54c386843 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:24.086258 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-7b8265fd-460e-4bdd-802d-ecf54c386843 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: da69cf1f-ff76-4a68-afe9-fc491b31e8a9] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:24.099081 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7b8265fd-460e-4bdd-802d-ecf54c386843 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:24.099644 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7b8265fd-460e-4bdd-802d-ecf54c386843 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:24.100102 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7b8265fd-460e-4bdd-802d-ecf54c386843 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:24.100839 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7b8265fd-460e-4bdd-802d-ecf54c386843 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:24.101295 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7b8265fd-460e-4bdd-802d-ecf54c386843 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:24.101721 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7b8265fd-460e-4bdd-802d-ecf54c386843 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:24.201685 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-cd76a3bb-c1e2-4597-92c3-d1c4db438458 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd879a42349cf4570aaaf88ba90492f6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d39cab5115d4818b73ea24cb0987a3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:24.209758 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-cd76a3bb-c1e2-4597-92c3-d1c4db438458 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] 10.222.0.58 "GET /compute/v2.1/servers/20d2cf25-e240-4abb-908a-e0ea2bd6e2d6" status: 200 len: 1608 microversion: 2.1 time: 0.392708 Aug 10 23:13:24.210356 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1814/3506] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:23 2022] GET /compute/v2.1/servers/20d2cf25-e240-4abb-908a-e0ea2bd6e2d6 => generated 1608 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:13:24.221266 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-334f919f-b977-4340-8972-eb4f4296adae req-a002a566-f6f8-40e1-9460-62ec5db072bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8b45f99b-7717-489f-9507-9190a9402f47", "name": "network-vif-deleted", "tag": "1f8105d9-27f2-4e73-a7c6-1bd2eabcce21"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:13:24.240724 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-334f919f-b977-4340-8972-eb4f4296adae req-a002a566-f6f8-40e1-9460-62ec5db072bc service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:24.241522 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-334f919f-b977-4340-8972-eb4f4296adae req-a002a566-f6f8-40e1-9460-62ec5db072bc service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:24.252462 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-334f919f-b977-4340-8972-eb4f4296adae req-a002a566-f6f8-40e1-9460-62ec5db072bc service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:24.288724 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-334f919f-b977-4340-8972-eb4f4296adae req-a002a566-f6f8-40e1-9460-62ec5db072bc service nova] Creating event network-vif-deleted:1f8105d9-27f2-4e73-a7c6-1bd2eabcce21 for instance 8b45f99b-7717-489f-9507-9190a9402f47 on n-h1-850468-14 Aug 10 23:13:24.299704 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-334f919f-b977-4340-8972-eb4f4296adae req-a002a566-f6f8-40e1-9460-62ec5db072bc service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084047 Aug 10 23:13:24.306363 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1815/3507] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:13:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:13:24.429146 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-ae0185d0-5124-45d8-9810-1d86dd954fc1 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:24.431461 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-ae0185d0-5124-45d8-9810-1d86dd954fc1 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: fa9dfd3a-a636-48ce-ae15-0ed51baee954] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:24.440101 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-7b8265fd-460e-4bdd-802d-ecf54c386843 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6160c7a42740efbe3613380933fa15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d90f8a58ad047fa8f347d6474e4d673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:24.443294 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ae0185d0-5124-45d8-9810-1d86dd954fc1 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:24.443796 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ae0185d0-5124-45d8-9810-1d86dd954fc1 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:24.445816 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ae0185d0-5124-45d8-9810-1d86dd954fc1 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:24.451260 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ae0185d0-5124-45d8-9810-1d86dd954fc1 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:24.451939 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ae0185d0-5124-45d8-9810-1d86dd954fc1 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:24.452402 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ae0185d0-5124-45d8-9810-1d86dd954fc1 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:24.453159 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-7b8265fd-460e-4bdd-802d-ecf54c386843 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "GET /compute/v2.1/servers/da69cf1f-ff76-4a68-afe9-fc491b31e8a9" status: 200 len: 1507 microversion: 2.1 time: 0.373000 Aug 10 23:13:24.470147 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1693/3508] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:24 2022] GET /compute/v2.1/servers/da69cf1f-ff76-4a68-afe9-fc491b31e8a9 => generated 1507 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:13:24.778662 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-ae0185d0-5124-45d8-9810-1d86dd954fc1 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:24.818996 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-ae0185d0-5124-45d8-9810-1d86dd954fc1 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954" status: 200 len: 1667 microversion: 2.1 time: 0.394610 Aug 10 23:13:24.820204 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1816/3509] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:24 2022] GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954 => generated 1667 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:13:24.846685 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-90f28df2-dc66-408a-870e-5cba38882a0f tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:24.847636 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-90f28df2-dc66-408a-870e-5cba38882a0f tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] [instance: 371c934a-2685-4d6f-b385-3b86f4a542e0] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:24.857727 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-90f28df2-dc66-408a-870e-5cba38882a0f tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:24.858403 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-90f28df2-dc66-408a-870e-5cba38882a0f tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:24.859123 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-90f28df2-dc66-408a-870e-5cba38882a0f tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:24.860649 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-90f28df2-dc66-408a-870e-5cba38882a0f tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:24.861386 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-90f28df2-dc66-408a-870e-5cba38882a0f tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:24.862953 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-90f28df2-dc66-408a-870e-5cba38882a0f tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:24.962594 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-daa1d404-79cd-44c8-b67c-6b54ecc5a2a2 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:24.963335 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-daa1d404-79cd-44c8-b67c-6b54ecc5a2a2 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:24.970032 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-daa1d404-79cd-44c8-b67c-6b54ecc5a2a2 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:24.970878 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-daa1d404-79cd-44c8-b67c-6b54ecc5a2a2 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:24.971618 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-daa1d404-79cd-44c8-b67c-6b54ecc5a2a2 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:24.972842 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-daa1d404-79cd-44c8-b67c-6b54ecc5a2a2 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:24.973627 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-daa1d404-79cd-44c8-b67c-6b54ecc5a2a2 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:24.974336 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-daa1d404-79cd-44c8-b67c-6b54ecc5a2a2 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:24.979739 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=8 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:13:25.361599 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-daa1d404-79cd-44c8-b67c-6b54ecc5a2a2 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:25.383588 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-daa1d404-79cd-44c8-b67c-6b54ecc5a2a2 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b" status: 200 len: 1317 microversion: 2.1 time: 0.425120 Aug 10 23:13:25.395481 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1817/3510] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:24 2022] GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b => generated 1317 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:13:25.413197 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c6b112fd-90e5-4350-8842-f8df072906b9 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:25.416148 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-c6b112fd-90e5-4350-8842-f8df072906b9 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] [instance: 20d2cf25-e240-4abb-908a-e0ea2bd6e2d6] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:25.427119 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c6b112fd-90e5-4350-8842-f8df072906b9 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:25.427886 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c6b112fd-90e5-4350-8842-f8df072906b9 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:25.429159 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c6b112fd-90e5-4350-8842-f8df072906b9 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:25.430151 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c6b112fd-90e5-4350-8842-f8df072906b9 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:25.430769 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c6b112fd-90e5-4350-8842-f8df072906b9 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:25.431460 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c6b112fd-90e5-4350-8842-f8df072906b9 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:25.456272 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:13:25.605674 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-c6b112fd-90e5-4350-8842-f8df072906b9 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd879a42349cf4570aaaf88ba90492f6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d39cab5115d4818b73ea24cb0987a3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:25.628840 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-c6b112fd-90e5-4350-8842-f8df072906b9 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] 10.222.0.58 "GET /compute/v2.1/servers/20d2cf25-e240-4abb-908a-e0ea2bd6e2d6" status: 200 len: 1541 microversion: 2.1 time: 0.231774 Aug 10 23:13:25.630126 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1818/3511] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:25 2022] GET /compute/v2.1/servers/20d2cf25-e240-4abb-908a-e0ea2bd6e2d6 => generated 1541 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:13:25.635560 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-d1ef98b0-9ac0-4c6f-80cb-c1c839cafdfa tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:25.636683 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-d1ef98b0-9ac0-4c6f-80cb-c1c839cafdfa tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: da69cf1f-ff76-4a68-afe9-fc491b31e8a9] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:25.645267 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d1ef98b0-9ac0-4c6f-80cb-c1c839cafdfa tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:25.645930 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d1ef98b0-9ac0-4c6f-80cb-c1c839cafdfa tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:25.646557 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d1ef98b0-9ac0-4c6f-80cb-c1c839cafdfa tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:25.647466 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d1ef98b0-9ac0-4c6f-80cb-c1c839cafdfa tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:25.648076 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d1ef98b0-9ac0-4c6f-80cb-c1c839cafdfa tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:25.648658 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d1ef98b0-9ac0-4c6f-80cb-c1c839cafdfa tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:25.773620 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-90f28df2-dc66-408a-870e-5cba38882a0f tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2848edf3f7674fa9b8a3c408b2479f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aa264849a1d4a908907421eed683fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:25.777532 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:13:25.787866 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-90f28df2-dc66-408a-870e-5cba38882a0f tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] 10.222.0.58 "GET /compute/v2.1/servers/371c934a-2685-4d6f-b385-3b86f4a542e0" status: 200 len: 1492 microversion: 2.1 time: 0.952269 Aug 10 23:13:25.790187 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1694/3512] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:24 2022] GET /compute/v2.1/servers/371c934a-2685-4d6f-b385-3b86f4a542e0 => generated 1492 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:13:25.909136 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-d1ef98b0-9ac0-4c6f-80cb-c1c839cafdfa tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6160c7a42740efbe3613380933fa15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d90f8a58ad047fa8f347d6474e4d673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:25.933560 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-d1ef98b0-9ac0-4c6f-80cb-c1c839cafdfa tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "GET /compute/v2.1/servers/da69cf1f-ff76-4a68-afe9-fc491b31e8a9" status: 200 len: 1507 microversion: 2.1 time: 0.301832 Aug 10 23:13:25.934420 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1819/3513] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:25 2022] GET /compute/v2.1/servers/da69cf1f-ff76-4a68-afe9-fc491b31e8a9 => generated 1507 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:13:26.011918 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-fefab85a-7bf8-42d9-a79b-ad8f6855bb28 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:26.012573 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-fefab85a-7bf8-42d9-a79b-ad8f6855bb28 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: fa9dfd3a-a636-48ce-ae15-0ed51baee954] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:26.028034 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fefab85a-7bf8-42d9-a79b-ad8f6855bb28 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:26.028034 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fefab85a-7bf8-42d9-a79b-ad8f6855bb28 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:26.028034 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fefab85a-7bf8-42d9-a79b-ad8f6855bb28 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:26.028034 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fefab85a-7bf8-42d9-a79b-ad8f6855bb28 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:26.028034 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fefab85a-7bf8-42d9-a79b-ad8f6855bb28 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:26.028034 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fefab85a-7bf8-42d9-a79b-ad8f6855bb28 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:26.363172 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-59bcfc81-af0b-4d63-b24d-0dd2996f4b1f req-25acd451-2b5f-4bc8-9fe5-0a3646cc56fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "371c934a-2685-4d6f-b385-3b86f4a542e0", "name": "network-vif-deleted", "tag": "47d51f63-9a40-4727-83cc-8e4dd0bfc19e"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:13:26.388697 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-fefab85a-7bf8-42d9-a79b-ad8f6855bb28 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:26.398830 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-59bcfc81-af0b-4d63-b24d-0dd2996f4b1f req-25acd451-2b5f-4bc8-9fe5-0a3646cc56fa service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:26.399715 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-59bcfc81-af0b-4d63-b24d-0dd2996f4b1f req-25acd451-2b5f-4bc8-9fe5-0a3646cc56fa service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:26.401064 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-fefab85a-7bf8-42d9-a79b-ad8f6855bb28 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954" status: 200 len: 1667 microversion: 2.1 time: 0.394575 Aug 10 23:13:26.401670 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1695/3514] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:26 2022] GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954 => generated 1667 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:13:26.403203 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-59bcfc81-af0b-4d63-b24d-0dd2996f4b1f req-25acd451-2b5f-4bc8-9fe5-0a3646cc56fa service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:26.420843 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-59bcfc81-af0b-4d63-b24d-0dd2996f4b1f req-25acd451-2b5f-4bc8-9fe5-0a3646cc56fa service nova] Creating event network-vif-deleted:47d51f63-9a40-4727-83cc-8e4dd0bfc19e for instance 371c934a-2685-4d6f-b385-3b86f4a542e0 on n-h1-850468-14 Aug 10 23:13:26.429584 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-59bcfc81-af0b-4d63-b24d-0dd2996f4b1f req-25acd451-2b5f-4bc8-9fe5-0a3646cc56fa service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069305 Aug 10 23:13:26.430933 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1820/3515] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:13:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:13:26.439539 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-b1e1b634-e042-46e4-a1ae-6884059d94db req-0196c12d-051f-4558-8ec4-9b81166e0c30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "20d2cf25-e240-4abb-908a-e0ea2bd6e2d6", "name": "network-vif-deleted", "tag": "7b0dfe00-d481-425c-97c7-1a83e3dc3589"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:13:26.440766 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-966f7400-882c-4644-aba0-4f2bb7fde499 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:26.442166 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-966f7400-882c-4644-aba0-4f2bb7fde499 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:26.456657 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-966f7400-882c-4644-aba0-4f2bb7fde499 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:26.457617 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-966f7400-882c-4644-aba0-4f2bb7fde499 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:26.458273 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-966f7400-882c-4644-aba0-4f2bb7fde499 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:26.459251 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-966f7400-882c-4644-aba0-4f2bb7fde499 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:26.460717 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-966f7400-882c-4644-aba0-4f2bb7fde499 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:26.461618 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-966f7400-882c-4644-aba0-4f2bb7fde499 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:26.500686 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-b1e1b634-e042-46e4-a1ae-6884059d94db req-0196c12d-051f-4558-8ec4-9b81166e0c30 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:26.511388 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-b1e1b634-e042-46e4-a1ae-6884059d94db req-0196c12d-051f-4558-8ec4-9b81166e0c30 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:26.531375 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-b1e1b634-e042-46e4-a1ae-6884059d94db req-0196c12d-051f-4558-8ec4-9b81166e0c30 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:26.546284 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-b1e1b634-e042-46e4-a1ae-6884059d94db req-0196c12d-051f-4558-8ec4-9b81166e0c30 service nova] Creating event network-vif-deleted:7b0dfe00-d481-425c-97c7-1a83e3dc3589 for instance 20d2cf25-e240-4abb-908a-e0ea2bd6e2d6 on n-h2-850468-14 Aug 10 23:13:26.554597 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-b1e1b634-e042-46e4-a1ae-6884059d94db req-0196c12d-051f-4558-8ec4-9b81166e0c30 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.147284 Aug 10 23:13:26.556066 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1696/3516] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:13:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:13:26.666248 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-3831dcd2-a305-4b4b-9d09-1cc85ed19323 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:26.674984 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-3831dcd2-a305-4b4b-9d09-1cc85ed19323 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] [instance: 20d2cf25-e240-4abb-908a-e0ea2bd6e2d6] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:26.717070 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3831dcd2-a305-4b4b-9d09-1cc85ed19323 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:26.720038 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3831dcd2-a305-4b4b-9d09-1cc85ed19323 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:26.721488 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3831dcd2-a305-4b4b-9d09-1cc85ed19323 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:26.725901 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3831dcd2-a305-4b4b-9d09-1cc85ed19323 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:26.728557 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3831dcd2-a305-4b4b-9d09-1cc85ed19323 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:26.730844 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3831dcd2-a305-4b4b-9d09-1cc85ed19323 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:26.832990 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-966f7400-882c-4644-aba0-4f2bb7fde499 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:26.842483 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-966f7400-882c-4644-aba0-4f2bb7fde499 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b" status: 200 len: 1317 microversion: 2.1 time: 0.409623 Aug 10 23:13:26.845960 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1821/3517] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:26 2022] GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b => generated 1317 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:13:26.857953 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-98356110-b1cc-48d4-bd27-d1f628dcdc76 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:26.859720 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-98356110-b1cc-48d4-bd27-d1f628dcdc76 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] [instance: 371c934a-2685-4d6f-b385-3b86f4a542e0] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:26.866659 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-98356110-b1cc-48d4-bd27-d1f628dcdc76 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:26.867362 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-98356110-b1cc-48d4-bd27-d1f628dcdc76 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:26.868084 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-98356110-b1cc-48d4-bd27-d1f628dcdc76 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:26.869193 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-98356110-b1cc-48d4-bd27-d1f628dcdc76 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:26.870533 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-98356110-b1cc-48d4-bd27-d1f628dcdc76 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:26.871350 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-98356110-b1cc-48d4-bd27-d1f628dcdc76 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:26.923407 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-98356110-b1cc-48d4-bd27-d1f628dcdc76 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:26.924128 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-98356110-b1cc-48d4-bd27-d1f628dcdc76 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:26.924717 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-98356110-b1cc-48d4-bd27-d1f628dcdc76 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:26.926936 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.objects.instance [None req-98356110-b1cc-48d4-bd27-d1f628dcdc76 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lazy-loading 'fault' on Instance uuid 371c934a-2685-4d6f-b385-3b86f4a542e0 {{(pid=122633) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:13:26.992296 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-3831dcd2-a305-4b4b-9d09-1cc85ed19323 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd879a42349cf4570aaaf88ba90492f6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d39cab5115d4818b73ea24cb0987a3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:27.008344 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-3831dcd2-a305-4b4b-9d09-1cc85ed19323 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] 10.222.0.58 "GET /compute/v2.1/servers/20d2cf25-e240-4abb-908a-e0ea2bd6e2d6" status: 200 len: 1252 microversion: 2.1 time: 0.358466 Aug 10 23:13:27.018198 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1697/3518] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:26 2022] GET /compute/v2.1/servers/20d2cf25-e240-4abb-908a-e0ea2bd6e2d6 => generated 1252 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:13:27.033627 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-04702d96-24c3-4508-be76-79fe535328bb tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:27.044330 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-04702d96-24c3-4508-be76-79fe535328bb tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: da69cf1f-ff76-4a68-afe9-fc491b31e8a9] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:27.044637 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-98356110-b1cc-48d4-bd27-d1f628dcdc76 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2848edf3f7674fa9b8a3c408b2479f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aa264849a1d4a908907421eed683fab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:27.061468 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-04702d96-24c3-4508-be76-79fe535328bb tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:27.062357 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-04702d96-24c3-4508-be76-79fe535328bb tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:27.062819 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-04702d96-24c3-4508-be76-79fe535328bb tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:27.065773 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-04702d96-24c3-4508-be76-79fe535328bb tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:27.066248 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-04702d96-24c3-4508-be76-79fe535328bb tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:27.066683 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-04702d96-24c3-4508-be76-79fe535328bb tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:27.067352 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-98356110-b1cc-48d4-bd27-d1f628dcdc76 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] 10.222.0.58 "GET /compute/v2.1/servers/371c934a-2685-4d6f-b385-3b86f4a542e0" status: 200 len: 1303 microversion: 2.1 time: 0.213503 Aug 10 23:13:27.080342 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1822/3519] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:26 2022] GET /compute/v2.1/servers/371c934a-2685-4d6f-b385-3b86f4a542e0 => generated 1303 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:13:27.491133 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-04702d96-24c3-4508-be76-79fe535328bb tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6160c7a42740efbe3613380933fa15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d90f8a58ad047fa8f347d6474e4d673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:27.510592 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-04702d96-24c3-4508-be76-79fe535328bb tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "GET /compute/v2.1/servers/da69cf1f-ff76-4a68-afe9-fc491b31e8a9" status: 200 len: 1507 microversion: 2.1 time: 0.490861 Aug 10 23:13:27.511525 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1698/3520] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:27 2022] GET /compute/v2.1/servers/da69cf1f-ff76-4a68-afe9-fc491b31e8a9 => generated 1507 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:13:27.866976 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-d2cf8eb9-4425-41cf-8a64-969c31f18dcf tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:27.867667 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-d2cf8eb9-4425-41cf-8a64-969c31f18dcf tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:27.886703 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d2cf8eb9-4425-41cf-8a64-969c31f18dcf tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:27.887641 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d2cf8eb9-4425-41cf-8a64-969c31f18dcf tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:27.888117 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d2cf8eb9-4425-41cf-8a64-969c31f18dcf tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:27.888888 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d2cf8eb9-4425-41cf-8a64-969c31f18dcf tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:27.889354 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d2cf8eb9-4425-41cf-8a64-969c31f18dcf tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:27.889788 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d2cf8eb9-4425-41cf-8a64-969c31f18dcf tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:28.029866 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-e12c50c1-e3c3-42d1-b023-636648b73cac tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:28.030500 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-e12c50c1-e3c3-42d1-b023-636648b73cac tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] [instance: 20d2cf25-e240-4abb-908a-e0ea2bd6e2d6] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:28.041317 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e12c50c1-e3c3-42d1-b023-636648b73cac tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:28.042703 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e12c50c1-e3c3-42d1-b023-636648b73cac tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:28.044032 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e12c50c1-e3c3-42d1-b023-636648b73cac tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:28.061159 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e12c50c1-e3c3-42d1-b023-636648b73cac tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:28.061758 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e12c50c1-e3c3-42d1-b023-636648b73cac tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:28.064676 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e12c50c1-e3c3-42d1-b023-636648b73cac tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:28.223832 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-e12c50c1-e3c3-42d1-b023-636648b73cac tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd879a42349cf4570aaaf88ba90492f6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d39cab5115d4818b73ea24cb0987a3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:28.240055 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-e12c50c1-e3c3-42d1-b023-636648b73cac tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] 10.222.0.58 "GET /compute/v2.1/servers/20d2cf25-e240-4abb-908a-e0ea2bd6e2d6" status: 200 len: 1252 microversion: 2.1 time: 0.212902 Aug 10 23:13:28.241199 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1699/3521] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:28 2022] GET /compute/v2.1/servers/20d2cf25-e240-4abb-908a-e0ea2bd6e2d6 => generated 1252 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:13:28.252491 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-b69069f8-e33c-408a-a54f-95b4fcc08e03 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:28.255830 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-b69069f8-e33c-408a-a54f-95b4fcc08e03 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] [instance: 371c934a-2685-4d6f-b385-3b86f4a542e0] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:28.271537 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b69069f8-e33c-408a-a54f-95b4fcc08e03 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:28.273159 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b69069f8-e33c-408a-a54f-95b4fcc08e03 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:28.274903 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b69069f8-e33c-408a-a54f-95b4fcc08e03 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:28.276356 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b69069f8-e33c-408a-a54f-95b4fcc08e03 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:28.279501 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b69069f8-e33c-408a-a54f-95b4fcc08e03 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:28.282712 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b69069f8-e33c-408a-a54f-95b4fcc08e03 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:28.322735 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-b69069f8-e33c-408a-a54f-95b4fcc08e03 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] HTTP exception thrown: Instance 371c934a-2685-4d6f-b385-3b86f4a542e0 could not be found. Aug 10 23:13:28.332019 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-b69069f8-e33c-408a-a54f-95b4fcc08e03 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Request method failure captured: Aug 10 23:13:28.332019 n-d-850468-14 devstack@n-api.service[122632]: request: GET /compute/v2.1/servers/371c934a-2685-4d6f-b385-3b86f4a542e0 HTTP/1.1 Aug 10 23:13:28.332019 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:13:28.332019 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:13:28.332019 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:13:28.332019 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 23:13:28.332019 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:13:28.332019 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:13:28.332019 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:13:28.332019 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:13:28.332019 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9DsdnFB16636vQpR8jkMn1ex2mbZwNO2CPZkDlruV0YBDruA93cwInB7tQbD3HLm5nQDtfIh3GHFUGWf0ZyUer5izP9u1wH5wFRW3Iia94BdCkH72m5XrZV1PR7DlbmdjjWUzwZkXH3ysYUPfdoHtjk8B7vUtdzwgOiWfJcptXjiPFU Aug 10 23:13:28.332019 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:13:28.332019 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:13:28.332019 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:13:28.332019 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:13:28.332019 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:13:28.332019 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:13:28.332019 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 6aa264849a1d4a908907421eed683fab Aug 10 23:13:28.332019 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-ServerRescueTestJSON-735485422 Aug 10 23:13:28.332019 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:13:28.332019 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:13:28.332019 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6aa264849a1d4a908907421eed683fab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6aa264849a1d4a908907421eed683fab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/6aa264849a1d4a908907421eed683fab"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_6aa264849a1d4a908907421eed683fab", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:13:28.332019 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-ServerRescueTestJSON-735485422 Aug 10 23:13:28.332019 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 6aa264849a1d4a908907421eed683fab Aug 10 23:13:28.332019 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-ServerRescueTestJSON-735485422 Aug 10 23:13:28.332019 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-ServerRescueTestJSON-735485422-project Aug 10 23:13:28.332019 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:13:28.332019 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:13:28.332019 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: 2848edf3f7674fa9b8a3c408b2479f5a Aug 10 23:13:28.332019 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-ServerRescueTestJSON-735485422-project Aug 10 23:13:28.332019 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:13:28.332019 n-d-850468-14 devstack@n-api.service[122632]: exception: Instance 371c934a-2685-4d6f-b385-3b86f4a542e0 could not be found. Aug 10 23:13:28.332019 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': '371c934a-2685-4d6f-b385-3b86f4a542e0'} Aug 10 23:13:28.332019 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:13:28.332019 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:13:28.332019 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:13:28.332019 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:13:28.332019 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:13:28.332019 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:13:28.332019 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:13:28.332019 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:13:28.332019 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:13:28.332019 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:13:28.332019 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 371c934a-2685-4d6f-b385-3b86f4a542e0 could not be found. Aug 10 23:13:28.332019 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:13:28.332019 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:13:28.332019 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:13:28.332019 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:13:28.332019 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:13:28.332019 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:13:28.332019 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:13:28.332019 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:13:28.332019 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:13:28.332019 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:13:28.332019 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:13:28.332019 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:13:28.332019 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:13:28.332019 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:13:28.332019 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:13:28.332019 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:13:28.332019 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 371c934a-2685-4d6f-b385-3b86f4a542e0 could not be found. Aug 10 23:13:28.332019 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:13:28.332019 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:13:28.332019 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:13:28.336594 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:13:28.336594 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:13:28.336594 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:13:28.336594 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:13:28.336594 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:13:28.336594 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 371c934a-2685-4d6f-b385-3b86f4a542e0 could not be found. Aug 10 23:13:28.336594 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:13:28.336594 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-b69069f8-e33c-408a-a54f-95b4fcc08e03 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] Returning 404 to user: Instance 371c934a-2685-4d6f-b385-3b86f4a542e0 could not be found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:13:28.339066 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-b69069f8-e33c-408a-a54f-95b4fcc08e03 tempest-ServerRescueTestJSON-735485422 tempest-ServerRescueTestJSON-735485422-project] 10.222.0.58 "GET /compute/v2.1/servers/371c934a-2685-4d6f-b385-3b86f4a542e0" status: 404 len: 111 microversion: 2.1 time: 0.091174 Aug 10 23:13:28.343588 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1700/3522] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:28 2022] GET /compute/v2.1/servers/371c934a-2685-4d6f-b385-3b86f4a542e0 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:13:28.355167 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-76f6ba97-141f-479d-8334-ff6e259943e7 req-d8a59213-5a1d-45be-8334-c1f6af3f4f3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa9dfd3a-a636-48ce-ae15-0ed51baee954", "name": "network-vif-unplugged", "status": "completed", "tag": "456f7ca7-21c6-4b5d-8993-9a7c329acf12"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:13:28.376465 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-76f6ba97-141f-479d-8334-ff6e259943e7 req-d8a59213-5a1d-45be-8334-c1f6af3f4f3e service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:28.381709 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-76f6ba97-141f-479d-8334-ff6e259943e7 req-d8a59213-5a1d-45be-8334-c1f6af3f4f3e service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:28.382356 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-76f6ba97-141f-479d-8334-ff6e259943e7 req-d8a59213-5a1d-45be-8334-c1f6af3f4f3e service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:28.410682 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-76f6ba97-141f-479d-8334-ff6e259943e7 req-d8a59213-5a1d-45be-8334-c1f6af3f4f3e service nova] Creating event network-vif-unplugged:456f7ca7-21c6-4b5d-8993-9a7c329acf12 for instance fa9dfd3a-a636-48ce-ae15-0ed51baee954 on n-h2-850468-14 Aug 10 23:13:28.432902 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-76f6ba97-141f-479d-8334-ff6e259943e7 req-d8a59213-5a1d-45be-8334-c1f6af3f4f3e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.081614 Aug 10 23:13:28.433511 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1701/3523] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:13:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:13:28.498659 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-d2cf8eb9-4425-41cf-8a64-969c31f18dcf tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:28.544492 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-d2cf8eb9-4425-41cf-8a64-969c31f18dcf tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b" status: 200 len: 1317 microversion: 2.1 time: 0.672897 Aug 10 23:13:28.544492 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1823/3524] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:27 2022] GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b => generated 1317 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:13:28.547217 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-a64b577d-664f-49ba-8c41-90b5457047c9 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:28.548316 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-a64b577d-664f-49ba-8c41-90b5457047c9 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: da69cf1f-ff76-4a68-afe9-fc491b31e8a9] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:28.572085 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a64b577d-664f-49ba-8c41-90b5457047c9 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:28.576984 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a64b577d-664f-49ba-8c41-90b5457047c9 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:28.581088 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a64b577d-664f-49ba-8c41-90b5457047c9 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:28.583093 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a64b577d-664f-49ba-8c41-90b5457047c9 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:28.586067 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a64b577d-664f-49ba-8c41-90b5457047c9 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:28.586945 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a64b577d-664f-49ba-8c41-90b5457047c9 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:28.876744 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-235e727b-2d76-4740-a2b4-4d1a95480601 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:28.877425 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-235e727b-2d76-4740-a2b4-4d1a95480601 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: fa9dfd3a-a636-48ce-ae15-0ed51baee954] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:28.894685 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-235e727b-2d76-4740-a2b4-4d1a95480601 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:28.895859 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-235e727b-2d76-4740-a2b4-4d1a95480601 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:28.896848 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-235e727b-2d76-4740-a2b4-4d1a95480601 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:28.898356 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-235e727b-2d76-4740-a2b4-4d1a95480601 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:28.899325 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-235e727b-2d76-4740-a2b4-4d1a95480601 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:28.900335 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-235e727b-2d76-4740-a2b4-4d1a95480601 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:28.975104 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=4 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:13:29.136894 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-235e727b-2d76-4740-a2b4-4d1a95480601 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:29.146451 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-235e727b-2d76-4740-a2b4-4d1a95480601 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954" status: 200 len: 1667 microversion: 2.1 time: 0.274069 Aug 10 23:13:29.147042 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1824/3525] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:28 2022] GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954 => generated 1667 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:13:29.177003 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-ed15b63a-bf41-4a96-8d18-eda7729f9cce tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:29.179425 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-ed15b63a-bf41-4a96-8d18-eda7729f9cce tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: fa9dfd3a-a636-48ce-ae15-0ed51baee954] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:29.192253 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ed15b63a-bf41-4a96-8d18-eda7729f9cce tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:29.194489 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ed15b63a-bf41-4a96-8d18-eda7729f9cce tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:29.195409 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ed15b63a-bf41-4a96-8d18-eda7729f9cce tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:29.196787 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ed15b63a-bf41-4a96-8d18-eda7729f9cce tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:29.200317 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ed15b63a-bf41-4a96-8d18-eda7729f9cce tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:29.201052 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ed15b63a-bf41-4a96-8d18-eda7729f9cce tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:29.330010 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-a64b577d-664f-49ba-8c41-90b5457047c9 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6160c7a42740efbe3613380933fa15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d90f8a58ad047fa8f347d6474e4d673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:29.340832 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-a64b577d-664f-49ba-8c41-90b5457047c9 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "GET /compute/v2.1/servers/da69cf1f-ff76-4a68-afe9-fc491b31e8a9" status: 200 len: 1507 microversion: 2.1 time: 0.806844 Aug 10 23:13:29.344696 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1702/3526] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:28 2022] GET /compute/v2.1/servers/da69cf1f-ff76-4a68-afe9-fc491b31e8a9 => generated 1507 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:13:29.355272 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-81f12576-f60e-49c8-97b6-c1550f1cd599 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:29.355907 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-81f12576-f60e-49c8-97b6-c1550f1cd599 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] [instance: 20d2cf25-e240-4abb-908a-e0ea2bd6e2d6] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:29.374547 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-81f12576-f60e-49c8-97b6-c1550f1cd599 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:29.375261 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-81f12576-f60e-49c8-97b6-c1550f1cd599 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:29.375707 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-81f12576-f60e-49c8-97b6-c1550f1cd599 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:29.376520 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-81f12576-f60e-49c8-97b6-c1550f1cd599 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:29.376869 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-81f12576-f60e-49c8-97b6-c1550f1cd599 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:29.377303 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-81f12576-f60e-49c8-97b6-c1550f1cd599 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:29.428385 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=2 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:13:29.428707 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-ed15b63a-bf41-4a96-8d18-eda7729f9cce tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:29.440118 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-ed15b63a-bf41-4a96-8d18-eda7729f9cce tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954" status: 200 len: 1667 microversion: 2.1 time: 0.276524 Aug 10 23:13:29.458424 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1825/3527] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:29 2022] GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954 => generated 1667 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:13:29.465241 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-a95055ad-a2fa-4e5c-bc59-4952ab1e99e0 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:29.466283 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-a95055ad-a2fa-4e5c-bc59-4952ab1e99e0 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: fa9dfd3a-a636-48ce-ae15-0ed51baee954] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:29.473131 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a95055ad-a2fa-4e5c-bc59-4952ab1e99e0 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:29.473982 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a95055ad-a2fa-4e5c-bc59-4952ab1e99e0 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:29.474596 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a95055ad-a2fa-4e5c-bc59-4952ab1e99e0 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:29.475591 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a95055ad-a2fa-4e5c-bc59-4952ab1e99e0 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:29.476200 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a95055ad-a2fa-4e5c-bc59-4952ab1e99e0 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:29.476778 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a95055ad-a2fa-4e5c-bc59-4952ab1e99e0 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:29.542560 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-81f12576-f60e-49c8-97b6-c1550f1cd599 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd879a42349cf4570aaaf88ba90492f6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d39cab5115d4818b73ea24cb0987a3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:29.550942 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-81f12576-f60e-49c8-97b6-c1550f1cd599 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] 10.222.0.58 "GET /compute/v2.1/servers/20d2cf25-e240-4abb-908a-e0ea2bd6e2d6" status: 200 len: 1252 microversion: 2.1 time: 0.205114 Aug 10 23:13:29.560772 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1703/3528] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:29 2022] GET /compute/v2.1/servers/20d2cf25-e240-4abb-908a-e0ea2bd6e2d6 => generated 1252 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:13:29.566219 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-09e06dde-1b11-4ff3-89df-0a15582cd4d4 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:29.567154 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-09e06dde-1b11-4ff3-89df-0a15582cd4d4 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:29.580876 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-09e06dde-1b11-4ff3-89df-0a15582cd4d4 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:29.581646 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-09e06dde-1b11-4ff3-89df-0a15582cd4d4 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:29.582246 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-09e06dde-1b11-4ff3-89df-0a15582cd4d4 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:29.591858 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-09e06dde-1b11-4ff3-89df-0a15582cd4d4 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:29.592438 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-09e06dde-1b11-4ff3-89df-0a15582cd4d4 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:29.592907 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-09e06dde-1b11-4ff3-89df-0a15582cd4d4 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:29.642445 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=2 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:13:29.837036 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-a95055ad-a2fa-4e5c-bc59-4952ab1e99e0 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:29.860848 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-a95055ad-a2fa-4e5c-bc59-4952ab1e99e0 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954" status: 200 len: 1667 microversion: 2.1 time: 0.401040 Aug 10 23:13:29.863111 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1826/3529] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:29 2022] GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954 => generated 1667 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:13:29.896867 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-eeeb20ce-4990-45bf-a311-5f87700583bb tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:13:29.906990 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-eeeb20ce-4990-45bf-a311-5f87700583bb tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: fa9dfd3a-a636-48ce-ae15-0ed51baee954] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:29.921484 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-eeeb20ce-4990-45bf-a311-5f87700583bb tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:29.923004 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-eeeb20ce-4990-45bf-a311-5f87700583bb tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:29.923455 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-eeeb20ce-4990-45bf-a311-5f87700583bb tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:29.924188 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-eeeb20ce-4990-45bf-a311-5f87700583bb tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:29.928064 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-eeeb20ce-4990-45bf-a311-5f87700583bb tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:29.928584 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-eeeb20ce-4990-45bf-a311-5f87700583bb tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:29.980058 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-09e06dde-1b11-4ff3-89df-0a15582cd4d4 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:29.992152 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-09e06dde-1b11-4ff3-89df-0a15582cd4d4 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b" status: 200 len: 1317 microversion: 2.1 time: 0.428833 Aug 10 23:13:29.997641 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1704/3530] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:29 2022] GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b => generated 1317 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:13:30.194514 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-eeeb20ce-4990-45bf-a311-5f87700583bb tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "POST /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954/action" status: 202 len: 0 microversion: 2.1 time: 0.305794 Aug 10 23:13:30.199943 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1827/3531] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:13:29 2022] POST /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954/action => generated 0 bytes in 317 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:13:30.212866 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-ef489d47-7d57-48d3-848b-371aec721e86 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:30.214334 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-ef489d47-7d57-48d3-848b-371aec721e86 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: fa9dfd3a-a636-48ce-ae15-0ed51baee954] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:30.241340 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ef489d47-7d57-48d3-848b-371aec721e86 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:30.244600 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ef489d47-7d57-48d3-848b-371aec721e86 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:30.246120 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ef489d47-7d57-48d3-848b-371aec721e86 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:30.249838 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ef489d47-7d57-48d3-848b-371aec721e86 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:30.250890 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ef489d47-7d57-48d3-848b-371aec721e86 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:30.251550 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ef489d47-7d57-48d3-848b-371aec721e86 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:30.364426 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-435b8550-2191-4442-9a9d-fec9bf23ef56 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:30.365151 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-435b8550-2191-4442-9a9d-fec9bf23ef56 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: da69cf1f-ff76-4a68-afe9-fc491b31e8a9] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:30.378371 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-435b8550-2191-4442-9a9d-fec9bf23ef56 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:30.378913 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-435b8550-2191-4442-9a9d-fec9bf23ef56 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:30.379317 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-435b8550-2191-4442-9a9d-fec9bf23ef56 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:30.380173 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-435b8550-2191-4442-9a9d-fec9bf23ef56 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:30.434717 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-435b8550-2191-4442-9a9d-fec9bf23ef56 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.054s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:30.435204 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-435b8550-2191-4442-9a9d-fec9bf23ef56 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:30.661856 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-435b8550-2191-4442-9a9d-fec9bf23ef56 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6160c7a42740efbe3613380933fa15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d90f8a58ad047fa8f347d6474e4d673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:30.675779 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-435b8550-2191-4442-9a9d-fec9bf23ef56 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "GET /compute/v2.1/servers/da69cf1f-ff76-4a68-afe9-fc491b31e8a9" status: 200 len: 1507 microversion: 2.1 time: 0.314327 Aug 10 23:13:30.676767 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1828/3532] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:30 2022] GET /compute/v2.1/servers/da69cf1f-ff76-4a68-afe9-fc491b31e8a9 => generated 1507 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:13:30.687639 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-6486f351-ba32-49f9-a3dc-1e7423770d43 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:30.688271 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-6486f351-ba32-49f9-a3dc-1e7423770d43 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] [instance: 20d2cf25-e240-4abb-908a-e0ea2bd6e2d6] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:30.702732 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6486f351-ba32-49f9-a3dc-1e7423770d43 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:30.707786 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6486f351-ba32-49f9-a3dc-1e7423770d43 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:30.708352 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6486f351-ba32-49f9-a3dc-1e7423770d43 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:30.709551 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6486f351-ba32-49f9-a3dc-1e7423770d43 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:30.723587 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6486f351-ba32-49f9-a3dc-1e7423770d43 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:30.725042 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6486f351-ba32-49f9-a3dc-1e7423770d43 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:30.836432 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-6486f351-ba32-49f9-a3dc-1e7423770d43 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd879a42349cf4570aaaf88ba90492f6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d39cab5115d4818b73ea24cb0987a3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:30.848045 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-6486f351-ba32-49f9-a3dc-1e7423770d43 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] 10.222.0.58 "GET /compute/v2.1/servers/20d2cf25-e240-4abb-908a-e0ea2bd6e2d6" status: 200 len: 1252 microversion: 2.1 time: 0.169939 Aug 10 23:13:30.858860 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1829/3533] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:30 2022] GET /compute/v2.1/servers/20d2cf25-e240-4abb-908a-e0ea2bd6e2d6 => generated 1252 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:13:30.858860 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-65b33f13-c3bd-4325-b407-c8bbc4ed93f0 req-c72e0dd1-74e4-4862-9309-0707b5b10a8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23bbe055-4a92-4b96-8b89-c941229bfb0b", "name": "network-vif-plugged", "status": "completed", "tag": "6f537f41-6630-4a1c-b82e-c0862b0fc22c"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:13:30.865918 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-65b33f13-c3bd-4325-b407-c8bbc4ed93f0 req-c72e0dd1-74e4-4862-9309-0707b5b10a8a service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:30.866430 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-65b33f13-c3bd-4325-b407-c8bbc4ed93f0 req-c72e0dd1-74e4-4862-9309-0707b5b10a8a service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:30.866941 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-65b33f13-c3bd-4325-b407-c8bbc4ed93f0 req-c72e0dd1-74e4-4862-9309-0707b5b10a8a service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:30.889435 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-65b33f13-c3bd-4325-b407-c8bbc4ed93f0 req-c72e0dd1-74e4-4862-9309-0707b5b10a8a service nova] Creating event network-vif-plugged:6f537f41-6630-4a1c-b82e-c0862b0fc22c for instance 23bbe055-4a92-4b96-8b89-c941229bfb0b on n-h2-850468-14 Aug 10 23:13:30.893431 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-ef489d47-7d57-48d3-848b-371aec721e86 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:30.895618 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-65b33f13-c3bd-4325-b407-c8bbc4ed93f0 req-c72e0dd1-74e4-4862-9309-0707b5b10a8a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045056 Aug 10 23:13:30.896243 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1830/3534] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:13:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:13:30.905128 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-ef489d47-7d57-48d3-848b-371aec721e86 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954" status: 200 len: 1669 microversion: 2.1 time: 0.700032 Aug 10 23:13:30.906414 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1705/3535] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:30 2022] GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954 => generated 1669 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:13:31.029437 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-0035190c-ce2b-4c40-8ae6-46c755301289 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:31.031995 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-0035190c-ce2b-4c40-8ae6-46c755301289 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:31.040156 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0035190c-ce2b-4c40-8ae6-46c755301289 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:31.040645 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0035190c-ce2b-4c40-8ae6-46c755301289 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:31.041898 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0035190c-ce2b-4c40-8ae6-46c755301289 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:31.045825 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0035190c-ce2b-4c40-8ae6-46c755301289 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:31.046342 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0035190c-ce2b-4c40-8ae6-46c755301289 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:31.046877 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0035190c-ce2b-4c40-8ae6-46c755301289 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:31.280640 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-0035190c-ce2b-4c40-8ae6-46c755301289 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:31.291222 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-0035190c-ce2b-4c40-8ae6-46c755301289 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b" status: 200 len: 1317 microversion: 2.1 time: 0.276989 Aug 10 23:13:31.294387 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1831/3536] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:31 2022] GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b => generated 1317 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:13:31.699693 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-109097d1-62f3-4dec-a868-d9e45af8a6ae tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:31.701350 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-109097d1-62f3-4dec-a868-d9e45af8a6ae tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: da69cf1f-ff76-4a68-afe9-fc491b31e8a9] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:31.723036 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-109097d1-62f3-4dec-a868-d9e45af8a6ae tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:31.725609 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-109097d1-62f3-4dec-a868-d9e45af8a6ae tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:31.726441 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-109097d1-62f3-4dec-a868-d9e45af8a6ae tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:31.727533 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-109097d1-62f3-4dec-a868-d9e45af8a6ae tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:31.730523 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-109097d1-62f3-4dec-a868-d9e45af8a6ae tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:31.731199 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-109097d1-62f3-4dec-a868-d9e45af8a6ae tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:31.875179 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-079995b2-383a-4183-bef8-f92b5075d037 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:31.875882 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-079995b2-383a-4183-bef8-f92b5075d037 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] [instance: 20d2cf25-e240-4abb-908a-e0ea2bd6e2d6] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:31.881696 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:13:31.883616 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-079995b2-383a-4183-bef8-f92b5075d037 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:31.884373 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-079995b2-383a-4183-bef8-f92b5075d037 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:31.885145 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-079995b2-383a-4183-bef8-f92b5075d037 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:31.886051 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-079995b2-383a-4183-bef8-f92b5075d037 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:31.886622 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-079995b2-383a-4183-bef8-f92b5075d037 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:31.887899 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-079995b2-383a-4183-bef8-f92b5075d037 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:32.043072 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-079995b2-383a-4183-bef8-f92b5075d037 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd879a42349cf4570aaaf88ba90492f6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d39cab5115d4818b73ea24cb0987a3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:32.064155 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-079995b2-383a-4183-bef8-f92b5075d037 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] 10.222.0.58 "GET /compute/v2.1/servers/20d2cf25-e240-4abb-908a-e0ea2bd6e2d6" status: 200 len: 1252 microversion: 2.1 time: 0.191961 Aug 10 23:13:32.065831 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1832/3537] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:31 2022] GET /compute/v2.1/servers/20d2cf25-e240-4abb-908a-e0ea2bd6e2d6 => generated 1252 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:13:32.075845 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-88c4d412-97dd-4abb-a528-742692098b42 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:32.076578 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-88c4d412-97dd-4abb-a528-742692098b42 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: fa9dfd3a-a636-48ce-ae15-0ed51baee954] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:32.085418 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-88c4d412-97dd-4abb-a528-742692098b42 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:32.086016 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-88c4d412-97dd-4abb-a528-742692098b42 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:32.086606 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-88c4d412-97dd-4abb-a528-742692098b42 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:32.088731 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-88c4d412-97dd-4abb-a528-742692098b42 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:32.093881 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-88c4d412-97dd-4abb-a528-742692098b42 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:32.094575 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-88c4d412-97dd-4abb-a528-742692098b42 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:32.556288 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-109097d1-62f3-4dec-a868-d9e45af8a6ae tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6160c7a42740efbe3613380933fa15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d90f8a58ad047fa8f347d6474e4d673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:32.571808 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-109097d1-62f3-4dec-a868-d9e45af8a6ae tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "GET /compute/v2.1/servers/da69cf1f-ff76-4a68-afe9-fc491b31e8a9" status: 200 len: 1507 microversion: 2.1 time: 0.877471 Aug 10 23:13:32.574264 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1706/3538] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:31 2022] GET /compute/v2.1/servers/da69cf1f-ff76-4a68-afe9-fc491b31e8a9 => generated 1507 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:13:32.599631 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-956cebe5-3ad0-4f3e-8aec-c42581d41bab tempest-TestNetworkAdvancedServerOps-1638906998 tempest-TestNetworkAdvancedServerOps-1638906998-project-admin] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:32.600569 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-956cebe5-3ad0-4f3e-8aec-c42581d41bab tempest-TestNetworkAdvancedServerOps-1638906998 tempest-TestNetworkAdvancedServerOps-1638906998-project-admin] [instance: f4dc6241-b173-4cbf-b76c-7da3fac7edcc] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:32.633948 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-956cebe5-3ad0-4f3e-8aec-c42581d41bab tempest-TestNetworkAdvancedServerOps-1638906998 tempest-TestNetworkAdvancedServerOps-1638906998-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:32.640017 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-956cebe5-3ad0-4f3e-8aec-c42581d41bab tempest-TestNetworkAdvancedServerOps-1638906998 tempest-TestNetworkAdvancedServerOps-1638906998-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:32.642441 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-956cebe5-3ad0-4f3e-8aec-c42581d41bab tempest-TestNetworkAdvancedServerOps-1638906998 tempest-TestNetworkAdvancedServerOps-1638906998-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:32.653998 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-956cebe5-3ad0-4f3e-8aec-c42581d41bab tempest-TestNetworkAdvancedServerOps-1638906998 tempest-TestNetworkAdvancedServerOps-1638906998-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:32.656475 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-956cebe5-3ad0-4f3e-8aec-c42581d41bab tempest-TestNetworkAdvancedServerOps-1638906998 tempest-TestNetworkAdvancedServerOps-1638906998-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:32.657109 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-956cebe5-3ad0-4f3e-8aec-c42581d41bab tempest-TestNetworkAdvancedServerOps-1638906998 tempest-TestNetworkAdvancedServerOps-1638906998-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:32.807382 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-88c4d412-97dd-4abb-a528-742692098b42 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:32.817584 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-88c4d412-97dd-4abb-a528-742692098b42 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954" status: 200 len: 1669 microversion: 2.1 time: 0.748885 Aug 10 23:13:32.828919 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1833/3539] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:32 2022] GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954 => generated 1669 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:13:32.833821 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-b4ea18c5-ee96-415e-be60-c163b6ac758f tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:32.834432 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-b4ea18c5-ee96-415e-be60-c163b6ac758f tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:32.858548 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b4ea18c5-ee96-415e-be60-c163b6ac758f tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:32.859062 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b4ea18c5-ee96-415e-be60-c163b6ac758f tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:32.859497 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b4ea18c5-ee96-415e-be60-c163b6ac758f tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:32.860206 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b4ea18c5-ee96-415e-be60-c163b6ac758f tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:32.860659 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b4ea18c5-ee96-415e-be60-c163b6ac758f tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:32.861076 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b4ea18c5-ee96-415e-be60-c163b6ac758f tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:33.306382 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-b4ea18c5-ee96-415e-be60-c163b6ac758f tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:33.322291 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-b4ea18c5-ee96-415e-be60-c163b6ac758f tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b" status: 200 len: 1506 microversion: 2.1 time: 0.492197 Aug 10 23:13:33.334687 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1834/3540] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:32 2022] GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b => generated 1506 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:13:33.338830 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c15b21ff-8e1a-472e-9dea-efb7f29a17f8 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:33.355848 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-c15b21ff-8e1a-472e-9dea-efb7f29a17f8 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] [instance: 20d2cf25-e240-4abb-908a-e0ea2bd6e2d6] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:33.380700 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c15b21ff-8e1a-472e-9dea-efb7f29a17f8 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:33.384068 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c15b21ff-8e1a-472e-9dea-efb7f29a17f8 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:33.384655 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c15b21ff-8e1a-472e-9dea-efb7f29a17f8 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:33.385967 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c15b21ff-8e1a-472e-9dea-efb7f29a17f8 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:33.386956 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c15b21ff-8e1a-472e-9dea-efb7f29a17f8 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:33.390653 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c15b21ff-8e1a-472e-9dea-efb7f29a17f8 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:33.404303 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:13:33.732664 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-c15b21ff-8e1a-472e-9dea-efb7f29a17f8 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd879a42349cf4570aaaf88ba90492f6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d39cab5115d4818b73ea24cb0987a3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:33.735300 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-956cebe5-3ad0-4f3e-8aec-c42581d41bab tempest-TestNetworkAdvancedServerOps-1638906998 tempest-TestNetworkAdvancedServerOps-1638906998-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/f4dc6241-b173-4cbf-b76c-7da3fac7edcc" status: 200 len: 1834 microversion: 2.1 time: 1.156226 Aug 10 23:13:33.742334 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-c15b21ff-8e1a-472e-9dea-efb7f29a17f8 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] 10.222.0.58 "GET /compute/v2.1/servers/20d2cf25-e240-4abb-908a-e0ea2bd6e2d6" status: 200 len: 1252 microversion: 2.1 time: 0.407879 Aug 10 23:13:33.755276 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1835/3542] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:33 2022] GET /compute/v2.1/servers/20d2cf25-e240-4abb-908a-e0ea2bd6e2d6 => generated 1252 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:13:33.755469 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1707/3542] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:32 2022] GET /compute/v2.1/servers/f4dc6241-b173-4cbf-b76c-7da3fac7edcc => generated 1834 bytes in 1175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:13:33.762913 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-76866b9e-d619-4bb4-9446-1c0e443bbd41 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:33.763759 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-76866b9e-d619-4bb4-9446-1c0e443bbd41 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: da69cf1f-ff76-4a68-afe9-fc491b31e8a9] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:33.768440 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-159c5c7f-6830-44ca-b0d8-c5a9c857323c tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1288158862", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452", "networks": [{"uuid": "91d0258a-9486-4479-91e9-a6d9339a2e0a"}]}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:13:33.770562 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-76866b9e-d619-4bb4-9446-1c0e443bbd41 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:33.771310 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-76866b9e-d619-4bb4-9446-1c0e443bbd41 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:33.771901 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-76866b9e-d619-4bb4-9446-1c0e443bbd41 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:33.772767 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-76866b9e-d619-4bb4-9446-1c0e443bbd41 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:33.773371 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-76866b9e-d619-4bb4-9446-1c0e443bbd41 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:33.773946 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-76866b9e-d619-4bb4-9446-1c0e443bbd41 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:33.878308 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.network.neutron [None req-159c5c7f-6830-44ca-b0d8-c5a9c857323c tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] validate_networks() for [('91d0258a-9486-4479-91e9-a6d9339a2e0a', None, None, None, None, None)] {{(pid=122632) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 23:13:34.062641 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-76866b9e-d619-4bb4-9446-1c0e443bbd41 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6160c7a42740efbe3613380933fa15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d90f8a58ad047fa8f347d6474e4d673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:34.070820 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-76866b9e-d619-4bb4-9446-1c0e443bbd41 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "GET /compute/v2.1/servers/da69cf1f-ff76-4a68-afe9-fc491b31e8a9" status: 200 len: 1507 microversion: 2.1 time: 0.314098 Aug 10 23:13:34.077352 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1836/3543] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:33 2022] GET /compute/v2.1/servers/da69cf1f-ff76-4a68-afe9-fc491b31e8a9 => generated 1507 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:13:34.095132 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-0a644a90-2f5f-47bd-b853-9341cdc9a7a8 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:34.098761 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-0a644a90-2f5f-47bd-b853-9341cdc9a7a8 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] [instance: f4dc6241-b173-4cbf-b76c-7da3fac7edcc] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:34.113013 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0a644a90-2f5f-47bd-b853-9341cdc9a7a8 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:34.113767 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0a644a90-2f5f-47bd-b853-9341cdc9a7a8 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:34.114370 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0a644a90-2f5f-47bd-b853-9341cdc9a7a8 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:34.115290 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0a644a90-2f5f-47bd-b853-9341cdc9a7a8 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:34.115908 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0a644a90-2f5f-47bd-b853-9341cdc9a7a8 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:34.116836 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0a644a90-2f5f-47bd-b853-9341cdc9a7a8 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:34.885298 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-159c5c7f-6830-44ca-b0d8-c5a9c857323c tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Flavor limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:13:34.886381 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-159c5c7f-6830-44ca-b0d8-c5a9c857323c tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Image limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:13:34.886381 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-159c5c7f-6830-44ca-b0d8-c5a9c857323c tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Flavor pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:13:34.886650 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-159c5c7f-6830-44ca-b0d8-c5a9c857323c tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Image pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:13:34.887102 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-159c5c7f-6830-44ca-b0d8-c5a9c857323c tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:13:34.898175 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-159c5c7f-6830-44ca-b0d8-c5a9c857323c tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:34.898937 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-159c5c7f-6830-44ca-b0d8-c5a9c857323c tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:34.899562 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-159c5c7f-6830-44ca-b0d8-c5a9c857323c tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:34.901086 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-159c5c7f-6830-44ca-b0d8-c5a9c857323c tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:34.902054 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-159c5c7f-6830-44ca-b0d8-c5a9c857323c tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:34.902737 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-159c5c7f-6830-44ca-b0d8-c5a9c857323c tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:34.924151 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-159c5c7f-6830-44ca-b0d8-c5a9c857323c tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Getting quotas for project d11bbb3e87f4463787da56ab19108822. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:13:34.931463 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-159c5c7f-6830-44ca-b0d8-c5a9c857323c tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Getting quotas for user f284ec2a4bf546b58c1c1adaf880e1fb and project d11bbb3e87f4463787da56ab19108822. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:13:34.951212 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-159c5c7f-6830-44ca-b0d8-c5a9c857323c tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Going to run 1 instances... {{(pid=122632) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 23:13:34.953390 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-0a644a90-2f5f-47bd-b853-9341cdc9a7a8 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5899b2ad9f1046caaf7c6073e408eeee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25abd63376614081a9d484f3c9ae950d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:34.954625 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-159c5c7f-6830-44ca-b0d8-c5a9c857323c tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 6dc592cb-94c7-4918-8103-023db604fd70] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78ad8905-f66f-4733-8be9-2b260f1fabed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122632) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 23:13:34.962424 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-0a644a90-2f5f-47bd-b853-9341cdc9a7a8 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "GET /compute/v2.1/servers/f4dc6241-b173-4cbf-b76c-7da3fac7edcc" status: 200 len: 1681 microversion: 2.1 time: 0.883618 Aug 10 23:13:34.965643 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1837/3544] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:34 2022] GET /compute/v2.1/servers/f4dc6241-b173-4cbf-b76c-7da3fac7edcc => generated 1681 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:13:34.976113 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-7011fff1-86cf-45f3-be3d-cc5218568e4a tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:34.981741 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-7011fff1-86cf-45f3-be3d-cc5218568e4a tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: fa9dfd3a-a636-48ce-ae15-0ed51baee954] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:34.993115 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7011fff1-86cf-45f3-be3d-cc5218568e4a tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:34.997194 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7011fff1-86cf-45f3-be3d-cc5218568e4a tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:34.997882 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7011fff1-86cf-45f3-be3d-cc5218568e4a tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:34.998845 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7011fff1-86cf-45f3-be3d-cc5218568e4a tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:35.001664 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7011fff1-86cf-45f3-be3d-cc5218568e4a tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:35.002375 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7011fff1-86cf-45f3-be3d-cc5218568e4a tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:35.050259 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-159c5c7f-6830-44ca-b0d8-c5a9c857323c tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.293574 Aug 10 23:13:35.060473 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1708/3545] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 23:13:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 1304 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 23:13:35.070916 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-f719a0d3-bf2f-429d-8943-74ff5edde342 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:35.071555 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-f719a0d3-bf2f-429d-8943-74ff5edde342 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] [instance: 20d2cf25-e240-4abb-908a-e0ea2bd6e2d6] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:35.089484 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f719a0d3-bf2f-429d-8943-74ff5edde342 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:35.092070 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f719a0d3-bf2f-429d-8943-74ff5edde342 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:35.094452 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f719a0d3-bf2f-429d-8943-74ff5edde342 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:35.095414 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f719a0d3-bf2f-429d-8943-74ff5edde342 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:35.112157 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f719a0d3-bf2f-429d-8943-74ff5edde342 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:35.112676 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f719a0d3-bf2f-429d-8943-74ff5edde342 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:35.163471 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-f719a0d3-bf2f-429d-8943-74ff5edde342 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] HTTP exception thrown: Instance 20d2cf25-e240-4abb-908a-e0ea2bd6e2d6 could not be found. Aug 10 23:13:35.165466 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-f719a0d3-bf2f-429d-8943-74ff5edde342 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Request method failure captured: Aug 10 23:13:35.165466 n-d-850468-14 devstack@n-api.service[122632]: request: GET /compute/v2.1/servers/20d2cf25-e240-4abb-908a-e0ea2bd6e2d6 HTTP/1.1 Aug 10 23:13:35.165466 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:13:35.165466 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:13:35.165466 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:13:35.165466 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 23:13:35.165466 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:13:35.165466 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:13:35.165466 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:13:35.165466 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:13:35.165466 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9DsJ2STDPOUEBbutfM7NQI88GI0QCa1OgJjkA2RWvhp1jO9McVcaLO6meGaZa4l6xbr3hc19ZXXQnd3F8s1NOXcm11Mzr6iKPMdVyzefLLUD4jpizje-LT77Uggs_5EvujGbowY-e10m2n9BFwa6vg2a3RBq2Omf2knFwXvyNy_KdsI Aug 10 23:13:35.165466 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:13:35.165466 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:13:35.165466 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:13:35.165466 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:13:35.165466 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:13:35.165466 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:13:35.165466 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 0d39cab5115d4818b73ea24cb0987a3b Aug 10 23:13:35.165466 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-ServersTestBootFromVolume-1884732919 Aug 10 23:13:35.165466 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:13:35.165466 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:13:35.165466 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0d39cab5115d4818b73ea24cb0987a3b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0d39cab5115d4818b73ea24cb0987a3b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/0d39cab5115d4818b73ea24cb0987a3b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_0d39cab5115d4818b73ea24cb0987a3b", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:13:35.165466 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-ServersTestBootFromVolume-1884732919 Aug 10 23:13:35.165466 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 0d39cab5115d4818b73ea24cb0987a3b Aug 10 23:13:35.165466 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-ServersTestBootFromVolume-1884732919 Aug 10 23:13:35.165466 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-ServersTestBootFromVolume-1884732919-project Aug 10 23:13:35.165466 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:13:35.165466 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:13:35.165466 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: d879a42349cf4570aaaf88ba90492f6c Aug 10 23:13:35.165466 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-ServersTestBootFromVolume-1884732919-project Aug 10 23:13:35.165466 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:13:35.165466 n-d-850468-14 devstack@n-api.service[122632]: exception: Instance 20d2cf25-e240-4abb-908a-e0ea2bd6e2d6 could not be found. Aug 10 23:13:35.165466 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': '20d2cf25-e240-4abb-908a-e0ea2bd6e2d6'} Aug 10 23:13:35.165466 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:13:35.165466 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:13:35.165466 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:13:35.165466 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:13:35.165466 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:13:35.165466 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:13:35.165466 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:13:35.165466 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:13:35.165466 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:13:35.165466 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:13:35.165466 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20d2cf25-e240-4abb-908a-e0ea2bd6e2d6 could not be found. Aug 10 23:13:35.165466 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:13:35.165466 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:13:35.165466 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:13:35.165466 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:13:35.165466 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:13:35.165466 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:13:35.165466 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:13:35.165466 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:13:35.165466 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:13:35.165466 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:13:35.165466 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:13:35.165466 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:13:35.165466 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:13:35.165466 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:13:35.165466 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:13:35.165466 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:13:35.165466 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20d2cf25-e240-4abb-908a-e0ea2bd6e2d6 could not be found. Aug 10 23:13:35.165466 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:13:35.165466 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:13:35.165466 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:13:35.169691 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:13:35.169691 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:13:35.169691 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:13:35.169691 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:13:35.169691 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:13:35.169691 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20d2cf25-e240-4abb-908a-e0ea2bd6e2d6 could not be found. Aug 10 23:13:35.169691 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:13:35.169691 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-f719a0d3-bf2f-429d-8943-74ff5edde342 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Returning 404 to user: Instance 20d2cf25-e240-4abb-908a-e0ea2bd6e2d6 could not be found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:13:35.169691 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-f719a0d3-bf2f-429d-8943-74ff5edde342 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] 10.222.0.58 "GET /compute/v2.1/servers/20d2cf25-e240-4abb-908a-e0ea2bd6e2d6" status: 404 len: 111 microversion: 2.1 time: 0.105698 Aug 10 23:13:35.174738 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1709/3546] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:35 2022] GET /compute/v2.1/servers/20d2cf25-e240-4abb-908a-e0ea2bd6e2d6 => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:13:35.185151 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-04ebc76a-00d6-4c3d-98d0-f7d6d0475174 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:35.187170 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-04ebc76a-00d6-4c3d-98d0-f7d6d0475174 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 6dc592cb-94c7-4918-8103-023db604fd70] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:35.308989 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-04ebc76a-00d6-4c3d-98d0-f7d6d0475174 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:35.324334 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-04ebc76a-00d6-4c3d-98d0-f7d6d0475174 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/6dc592cb-94c7-4918-8103-023db604fd70" status: 200 len: 1217 microversion: 2.1 time: 0.144168 Aug 10 23:13:35.327548 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1710/3547] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:35 2022] GET /compute/v2.1/servers/6dc592cb-94c7-4918-8103-023db604fd70 => generated 1217 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:13:35.341957 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-4d010a4a-0c32-4eb7-96bf-a52ca2db4544 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] Calling method '.version_select at 0x7f847d390e50>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:35.366312 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:13:35.411204 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-4d010a4a-0c32-4eb7-96bf-a52ca2db4544 tempest-ServersTestBootFromVolume-1884732919 tempest-ServersTestBootFromVolume-1884732919-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-921357370" status: 202 len: 0 microversion: 2.1 time: 0.081295 Aug 10 23:13:35.424838 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1711/3548] 10.222.0.58 () {58 vars in 1218 bytes} [Wed Aug 10 23:13:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-921357370 => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:13:35.442271 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-71915975-a15c-4453-8716-63994faf847e tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:35.449975 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-71915975-a15c-4453-8716-63994faf847e tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: da69cf1f-ff76-4a68-afe9-fc491b31e8a9] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:35.471921 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-71915975-a15c-4453-8716-63994faf847e tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:35.473285 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-71915975-a15c-4453-8716-63994faf847e tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:35.476026 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-71915975-a15c-4453-8716-63994faf847e tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:35.477348 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-71915975-a15c-4453-8716-63994faf847e tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:35.483248 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-71915975-a15c-4453-8716-63994faf847e tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:35.483938 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-71915975-a15c-4453-8716-63994faf847e tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:35.688397 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-7011fff1-86cf-45f3-be3d-cc5218568e4a tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:35.719522 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-7011fff1-86cf-45f3-be3d-cc5218568e4a tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954" status: 200 len: 1667 microversion: 2.1 time: 0.747447 Aug 10 23:13:35.720142 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1838/3549] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:34 2022] GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954 => generated 1667 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:13:35.758687 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-9b63e5e0-6727-4cc4-a5d7-d25372e16f4c tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:13:35.761205 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-9b63e5e0-6727-4cc4-a5d7-d25372e16f4c tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] [instance: f4dc6241-b173-4cbf-b76c-7da3fac7edcc] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:35.780167 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9b63e5e0-6727-4cc4-a5d7-d25372e16f4c tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:35.780667 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9b63e5e0-6727-4cc4-a5d7-d25372e16f4c tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:35.781111 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9b63e5e0-6727-4cc4-a5d7-d25372e16f4c tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:35.781824 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9b63e5e0-6727-4cc4-a5d7-d25372e16f4c tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:35.782282 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9b63e5e0-6727-4cc4-a5d7-d25372e16f4c tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:35.789074 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9b63e5e0-6727-4cc4-a5d7-d25372e16f4c tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:35.880522 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-9b63e5e0-6727-4cc4-a5d7-d25372e16f4c tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "POST /compute/v2.1/servers/f4dc6241-b173-4cbf-b76c-7da3fac7edcc/action" status: 200 len: 32634 microversion: 2.1 time: 0.158476 Aug 10 23:13:35.881135 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1839/3550] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:13:35 2022] POST /compute/v2.1/servers/f4dc6241-b173-4cbf-b76c-7da3fac7edcc/action => generated 32634 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 23:13:35.893014 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-33680527-a2de-4d6a-a438-b7ce5dcff755 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:13:35.903326 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-33680527-a2de-4d6a-a438-b7ce5dcff755 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: fa9dfd3a-a636-48ce-ae15-0ed51baee954] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:35.923716 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-33680527-a2de-4d6a-a438-b7ce5dcff755 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:35.925373 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-33680527-a2de-4d6a-a438-b7ce5dcff755 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:35.928685 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-33680527-a2de-4d6a-a438-b7ce5dcff755 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:35.929604 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-33680527-a2de-4d6a-a438-b7ce5dcff755 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:35.930896 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-33680527-a2de-4d6a-a438-b7ce5dcff755 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:35.931030 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-71915975-a15c-4453-8716-63994faf847e tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6160c7a42740efbe3613380933fa15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d90f8a58ad047fa8f347d6474e4d673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:35.935330 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-33680527-a2de-4d6a-a438-b7ce5dcff755 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:35.944021 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-71915975-a15c-4453-8716-63994faf847e tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "GET /compute/v2.1/servers/da69cf1f-ff76-4a68-afe9-fc491b31e8a9" status: 200 len: 1507 microversion: 2.1 time: 0.514398 Aug 10 23:13:35.944919 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1712/3551] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:35 2022] GET /compute/v2.1/servers/da69cf1f-ff76-4a68-afe9-fc491b31e8a9 => generated 1507 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:13:36.043010 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-8ad126d2-ec72-4f83-bf84-b4db3588456a tempest-TestNetworkAdvancedServerOps-1638906998 tempest-TestNetworkAdvancedServerOps-1638906998-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:13:36.043838 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-8ad126d2-ec72-4f83-bf84-b4db3588456a tempest-TestNetworkAdvancedServerOps-1638906998 tempest-TestNetworkAdvancedServerOps-1638906998-project-admin] [instance: f4dc6241-b173-4cbf-b76c-7da3fac7edcc] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:36.045074 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-33680527-a2de-4d6a-a438-b7ce5dcff755 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "POST /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954/action" status: 200 len: 321 microversion: 2.1 time: 0.162145 Aug 10 23:13:36.046203 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1840/3552] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:13:35 2022] POST /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954/action => generated 321 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:13:36.055713 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8ad126d2-ec72-4f83-bf84-b4db3588456a tempest-TestNetworkAdvancedServerOps-1638906998 tempest-TestNetworkAdvancedServerOps-1638906998-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:36.056460 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8ad126d2-ec72-4f83-bf84-b4db3588456a tempest-TestNetworkAdvancedServerOps-1638906998 tempest-TestNetworkAdvancedServerOps-1638906998-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:36.059044 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-a8aadbf4-0512-4c36-9075-ab39d8eeb88c tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:36.060169 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-a8aadbf4-0512-4c36-9075-ab39d8eeb88c tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: fa9dfd3a-a636-48ce-ae15-0ed51baee954] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:36.060417 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8ad126d2-ec72-4f83-bf84-b4db3588456a tempest-TestNetworkAdvancedServerOps-1638906998 tempest-TestNetworkAdvancedServerOps-1638906998-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:36.061323 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8ad126d2-ec72-4f83-bf84-b4db3588456a tempest-TestNetworkAdvancedServerOps-1638906998 tempest-TestNetworkAdvancedServerOps-1638906998-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:36.062192 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8ad126d2-ec72-4f83-bf84-b4db3588456a tempest-TestNetworkAdvancedServerOps-1638906998 tempest-TestNetworkAdvancedServerOps-1638906998-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:36.064716 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8ad126d2-ec72-4f83-bf84-b4db3588456a tempest-TestNetworkAdvancedServerOps-1638906998 tempest-TestNetworkAdvancedServerOps-1638906998-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:36.079534 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a8aadbf4-0512-4c36-9075-ab39d8eeb88c tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:36.084002 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a8aadbf4-0512-4c36-9075-ab39d8eeb88c tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:36.084002 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a8aadbf4-0512-4c36-9075-ab39d8eeb88c tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:36.084759 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a8aadbf4-0512-4c36-9075-ab39d8eeb88c tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:36.085105 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a8aadbf4-0512-4c36-9075-ab39d8eeb88c tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:36.085529 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a8aadbf4-0512-4c36-9075-ab39d8eeb88c tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:36.180639 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-8ad126d2-ec72-4f83-bf84-b4db3588456a tempest-TestNetworkAdvancedServerOps-1638906998 tempest-TestNetworkAdvancedServerOps-1638906998-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '65a256e981ee4d93a6de8367b08ecfe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '037d8874e06345d794e8d5b85d773054', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:36.181266 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-8ad126d2-ec72-4f83-bf84-b4db3588456a tempest-TestNetworkAdvancedServerOps-1638906998 tempest-TestNetworkAdvancedServerOps-1638906998-project-admin] [instance: f4dc6241-b173-4cbf-b76c-7da3fac7edcc] flavor_id is None. Assuming migration. {{(pid=122632) resize /opt/stack/nova/nova/compute/api.py:4144}} Aug 10 23:13:36.181756 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-8ad126d2-ec72-4f83-bf84-b4db3588456a tempest-TestNetworkAdvancedServerOps-1638906998 tempest-TestNetworkAdvancedServerOps-1638906998-project-admin] [instance: f4dc6241-b173-4cbf-b76c-7da3fac7edcc] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=122632) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 10 23:13:37.005140 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-8ad126d2-ec72-4f83-bf84-b4db3588456a tempest-TestNetworkAdvancedServerOps-1638906998 tempest-TestNetworkAdvancedServerOps-1638906998-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/f4dc6241-b173-4cbf-b76c-7da3fac7edcc/action" status: 202 len: 0 microversion: 2.1 time: 0.965050 Aug 10 23:13:37.011523 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1713/3553] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:13:36 2022] POST /compute/v2.1/servers/f4dc6241-b173-4cbf-b76c-7da3fac7edcc/action => generated 0 bytes in 974 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:13:37.022954 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-363bb11d-73cc-415c-8f4e-95d0abc9b02e tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:37.027236 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-363bb11d-73cc-415c-8f4e-95d0abc9b02e tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 6dc592cb-94c7-4918-8103-023db604fd70] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:37.043075 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-363bb11d-73cc-415c-8f4e-95d0abc9b02e tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:37.044022 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-363bb11d-73cc-415c-8f4e-95d0abc9b02e tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:37.045119 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-363bb11d-73cc-415c-8f4e-95d0abc9b02e tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:37.052472 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-363bb11d-73cc-415c-8f4e-95d0abc9b02e tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:37.054760 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-363bb11d-73cc-415c-8f4e-95d0abc9b02e tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:37.056913 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-363bb11d-73cc-415c-8f4e-95d0abc9b02e tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:37.063108 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-a8aadbf4-0512-4c36-9075-ab39d8eeb88c tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:37.090930 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-a8aadbf4-0512-4c36-9075-ab39d8eeb88c tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954" status: 200 len: 1667 microversion: 2.1 time: 1.034456 Aug 10 23:13:37.092098 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1841/3554] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:36 2022] GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954 => generated 1667 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:13:37.114723 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-e3d83490-bff0-4aaf-b5f7-3c5569f5f444 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:37.116457 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-e3d83490-bff0-4aaf-b5f7-3c5569f5f444 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: da69cf1f-ff76-4a68-afe9-fc491b31e8a9] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:37.127261 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e3d83490-bff0-4aaf-b5f7-3c5569f5f444 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:37.130850 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e3d83490-bff0-4aaf-b5f7-3c5569f5f444 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:37.131612 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e3d83490-bff0-4aaf-b5f7-3c5569f5f444 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:37.132579 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e3d83490-bff0-4aaf-b5f7-3c5569f5f444 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:37.136443 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e3d83490-bff0-4aaf-b5f7-3c5569f5f444 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:37.137468 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e3d83490-bff0-4aaf-b5f7-3c5569f5f444 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:37.259442 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-363bb11d-73cc-415c-8f4e-95d0abc9b02e tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:37.270533 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-363bb11d-73cc-415c-8f4e-95d0abc9b02e tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/6dc592cb-94c7-4918-8103-023db604fd70" status: 200 len: 1269 microversion: 2.1 time: 0.256855 Aug 10 23:13:37.271610 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1714/3555] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:37 2022] GET /compute/v2.1/servers/6dc592cb-94c7-4918-8103-023db604fd70 => generated 1269 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:13:37.282499 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-06bce963-289a-4111-9195-4158b23ce681 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:37.283313 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-06bce963-289a-4111-9195-4158b23ce681 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] [instance: f4dc6241-b173-4cbf-b76c-7da3fac7edcc] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:37.298778 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-06bce963-289a-4111-9195-4158b23ce681 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:37.299350 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-06bce963-289a-4111-9195-4158b23ce681 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:37.299828 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-06bce963-289a-4111-9195-4158b23ce681 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:37.300574 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-06bce963-289a-4111-9195-4158b23ce681 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:37.301037 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-06bce963-289a-4111-9195-4158b23ce681 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:37.301470 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-06bce963-289a-4111-9195-4158b23ce681 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:37.304737 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:13:37.889860 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-e3d83490-bff0-4aaf-b5f7-3c5569f5f444 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6160c7a42740efbe3613380933fa15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d90f8a58ad047fa8f347d6474e4d673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:37.902775 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-e3d83490-bff0-4aaf-b5f7-3c5569f5f444 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "GET /compute/v2.1/servers/da69cf1f-ff76-4a68-afe9-fc491b31e8a9" status: 200 len: 1507 microversion: 2.1 time: 0.806833 Aug 10 23:13:37.907583 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1842/3556] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:37 2022] GET /compute/v2.1/servers/da69cf1f-ff76-4a68-afe9-fc491b31e8a9 => generated 1507 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:13:37.914699 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-43863441-231d-4f20-af63-cc002fbc1687 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:37.915617 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-43863441-231d-4f20-af63-cc002fbc1687 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: fa9dfd3a-a636-48ce-ae15-0ed51baee954] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:37.929618 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-43863441-231d-4f20-af63-cc002fbc1687 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:37.930381 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-43863441-231d-4f20-af63-cc002fbc1687 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:37.931068 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-43863441-231d-4f20-af63-cc002fbc1687 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:37.932765 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-43863441-231d-4f20-af63-cc002fbc1687 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:37.933458 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-43863441-231d-4f20-af63-cc002fbc1687 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:37.934103 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-43863441-231d-4f20-af63-cc002fbc1687 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:38.364278 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-43863441-231d-4f20-af63-cc002fbc1687 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:38.378584 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-43863441-231d-4f20-af63-cc002fbc1687 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954" status: 200 len: 1667 microversion: 2.1 time: 0.469481 Aug 10 23:13:38.384364 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1843/3557] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:37 2022] GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954 => generated 1667 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:13:38.395100 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-f36401b6-49b7-4048-b1bc-bca400754e9f tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:38.396435 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-f36401b6-49b7-4048-b1bc-bca400754e9f tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 6dc592cb-94c7-4918-8103-023db604fd70] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:38.414847 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f36401b6-49b7-4048-b1bc-bca400754e9f tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:38.415401 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f36401b6-49b7-4048-b1bc-bca400754e9f tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:38.415851 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f36401b6-49b7-4048-b1bc-bca400754e9f tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:38.420601 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f36401b6-49b7-4048-b1bc-bca400754e9f tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:38.421099 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f36401b6-49b7-4048-b1bc-bca400754e9f tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:38.421547 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f36401b6-49b7-4048-b1bc-bca400754e9f tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:38.566005 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-f36401b6-49b7-4048-b1bc-bca400754e9f tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:38.580893 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-f36401b6-49b7-4048-b1bc-bca400754e9f tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/6dc592cb-94c7-4918-8103-023db604fd70" status: 200 len: 1275 microversion: 2.1 time: 0.193810 Aug 10 23:13:38.581331 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-06bce963-289a-4111-9195-4158b23ce681 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5899b2ad9f1046caaf7c6073e408eeee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25abd63376614081a9d484f3c9ae950d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:38.581829 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1844/3558] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:38 2022] GET /compute/v2.1/servers/6dc592cb-94c7-4918-8103-023db604fd70 => generated 1275 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:13:38.592317 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-06bce963-289a-4111-9195-4158b23ce681 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "GET /compute/v2.1/servers/f4dc6241-b173-4cbf-b76c-7da3fac7edcc" status: 200 len: 1690 microversion: 2.1 time: 1.319487 Aug 10 23:13:38.593127 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1715/3559] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:37 2022] GET /compute/v2.1/servers/f4dc6241-b173-4cbf-b76c-7da3fac7edcc => generated 1690 bytes in 1321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:13:38.599978 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-7858726a-9d09-480f-9116-43d8334a9e38 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:38.600609 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-7858726a-9d09-480f-9116-43d8334a9e38 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: fa9dfd3a-a636-48ce-ae15-0ed51baee954] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:38.610854 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7858726a-9d09-480f-9116-43d8334a9e38 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:38.611510 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7858726a-9d09-480f-9116-43d8334a9e38 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:38.612120 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7858726a-9d09-480f-9116-43d8334a9e38 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:38.613433 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7858726a-9d09-480f-9116-43d8334a9e38 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:38.614052 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7858726a-9d09-480f-9116-43d8334a9e38 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:38.615398 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7858726a-9d09-480f-9116-43d8334a9e38 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:38.926467 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-2c925a2c-4f35-4e1c-9df4-aa484aadbefc tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:38.927691 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-2c925a2c-4f35-4e1c-9df4-aa484aadbefc tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: da69cf1f-ff76-4a68-afe9-fc491b31e8a9] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:38.931789 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-7858726a-9d09-480f-9116-43d8334a9e38 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:38.945100 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2c925a2c-4f35-4e1c-9df4-aa484aadbefc tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:38.946048 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2c925a2c-4f35-4e1c-9df4-aa484aadbefc tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:38.948881 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2c925a2c-4f35-4e1c-9df4-aa484aadbefc tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:38.950386 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2c925a2c-4f35-4e1c-9df4-aa484aadbefc tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:38.952498 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2c925a2c-4f35-4e1c-9df4-aa484aadbefc tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:38.953341 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2c925a2c-4f35-4e1c-9df4-aa484aadbefc tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:38.955354 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-7858726a-9d09-480f-9116-43d8334a9e38 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954" status: 200 len: 1667 microversion: 2.1 time: 0.363266 Aug 10 23:13:38.959025 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1845/3560] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:38 2022] GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954 => generated 1667 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:13:38.977902 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-9936fa1f-05b6-461c-afe9-5f5a640e147a tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:38.978560 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-9936fa1f-05b6-461c-afe9-5f5a640e147a tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: fa9dfd3a-a636-48ce-ae15-0ed51baee954] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:38.986651 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9936fa1f-05b6-461c-afe9-5f5a640e147a tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:38.987197 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9936fa1f-05b6-461c-afe9-5f5a640e147a tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:38.987695 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9936fa1f-05b6-461c-afe9-5f5a640e147a tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:38.988419 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9936fa1f-05b6-461c-afe9-5f5a640e147a tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:38.988877 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9936fa1f-05b6-461c-afe9-5f5a640e147a tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:38.989312 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9936fa1f-05b6-461c-afe9-5f5a640e147a tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:39.449619 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-2c925a2c-4f35-4e1c-9df4-aa484aadbefc tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6160c7a42740efbe3613380933fa15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d90f8a58ad047fa8f347d6474e4d673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:39.458359 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-2c925a2c-4f35-4e1c-9df4-aa484aadbefc tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "GET /compute/v2.1/servers/da69cf1f-ff76-4a68-afe9-fc491b31e8a9" status: 200 len: 1528 microversion: 2.1 time: 0.536881 Aug 10 23:13:39.458888 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1716/3561] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:38 2022] GET /compute/v2.1/servers/da69cf1f-ff76-4a68-afe9-fc491b31e8a9 => generated 1528 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:13:39.603793 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-816d57e2-2b2b-46e1-a3c8-4760ff0b0581 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:39.605246 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-816d57e2-2b2b-46e1-a3c8-4760ff0b0581 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 6dc592cb-94c7-4918-8103-023db604fd70] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:39.628825 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-816d57e2-2b2b-46e1-a3c8-4760ff0b0581 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:39.630473 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-816d57e2-2b2b-46e1-a3c8-4760ff0b0581 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:39.632830 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-816d57e2-2b2b-46e1-a3c8-4760ff0b0581 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:39.633914 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-816d57e2-2b2b-46e1-a3c8-4760ff0b0581 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:39.636468 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-816d57e2-2b2b-46e1-a3c8-4760ff0b0581 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:39.637522 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-816d57e2-2b2b-46e1-a3c8-4760ff0b0581 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:39.797885 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-9936fa1f-05b6-461c-afe9-5f5a640e147a tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:39.811007 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-9936fa1f-05b6-461c-afe9-5f5a640e147a tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954" status: 200 len: 1667 microversion: 2.1 time: 0.836879 Aug 10 23:13:39.819965 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-816d57e2-2b2b-46e1-a3c8-4760ff0b0581 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:39.827191 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1846/3562] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:38 2022] GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954 => generated 1667 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:13:39.829923 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-816d57e2-2b2b-46e1-a3c8-4760ff0b0581 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/6dc592cb-94c7-4918-8103-023db604fd70" status: 200 len: 1275 microversion: 2.1 time: 0.231529 Aug 10 23:13:39.834053 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1717/3563] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:39 2022] GET /compute/v2.1/servers/6dc592cb-94c7-4918-8103-023db604fd70 => generated 1275 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:13:39.840938 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-dba8cf48-7d46-411e-adb7-842203df9aaa tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:39.841486 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-dba8cf48-7d46-411e-adb7-842203df9aaa tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] [instance: f4dc6241-b173-4cbf-b76c-7da3fac7edcc] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:39.863153 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dba8cf48-7d46-411e-adb7-842203df9aaa tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:39.863659 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dba8cf48-7d46-411e-adb7-842203df9aaa tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:39.864095 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dba8cf48-7d46-411e-adb7-842203df9aaa tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:39.866186 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dba8cf48-7d46-411e-adb7-842203df9aaa tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:39.866842 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dba8cf48-7d46-411e-adb7-842203df9aaa tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:39.867502 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dba8cf48-7d46-411e-adb7-842203df9aaa tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:40.067832 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-9406d42e-fad3-4c63-89b5-a7e4a088c321 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-435414495", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452", "networks": [{"uuid": "9e4068f0-b1bd-443a-a951-7f332436087d"}]}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:13:40.172368 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.network.neutron [None req-9406d42e-fad3-4c63-89b5-a7e4a088c321 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] validate_networks() for [('9e4068f0-b1bd-443a-a951-7f332436087d', None, None, None, None, None)] {{(pid=122632) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 23:13:40.853549 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-dba8cf48-7d46-411e-adb7-842203df9aaa tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5899b2ad9f1046caaf7c6073e408eeee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25abd63376614081a9d484f3c9ae950d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:40.863339 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-dba8cf48-7d46-411e-adb7-842203df9aaa tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "GET /compute/v2.1/servers/f4dc6241-b173-4cbf-b76c-7da3fac7edcc" status: 200 len: 1690 microversion: 2.1 time: 1.034915 Aug 10 23:13:40.867854 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1847/3564] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:39 2022] GET /compute/v2.1/servers/f4dc6241-b173-4cbf-b76c-7da3fac7edcc => generated 1690 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:13:40.884411 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c77014c6-0484-4017-8010-ea32121d7089 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:40.887316 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-c77014c6-0484-4017-8010-ea32121d7089 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: da69cf1f-ff76-4a68-afe9-fc491b31e8a9] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:40.908111 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c77014c6-0484-4017-8010-ea32121d7089 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:40.908980 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c77014c6-0484-4017-8010-ea32121d7089 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:40.909645 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c77014c6-0484-4017-8010-ea32121d7089 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:40.910995 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c77014c6-0484-4017-8010-ea32121d7089 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:40.914640 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c77014c6-0484-4017-8010-ea32121d7089 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:40.918686 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c77014c6-0484-4017-8010-ea32121d7089 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:41.043222 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-9406d42e-fad3-4c63-89b5-a7e4a088c321 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Flavor limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:13:41.043869 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-9406d42e-fad3-4c63-89b5-a7e4a088c321 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Image limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:13:41.045275 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-9406d42e-fad3-4c63-89b5-a7e4a088c321 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Flavor pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:13:41.045870 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-9406d42e-fad3-4c63-89b5-a7e4a088c321 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Image pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:13:41.046331 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-9406d42e-fad3-4c63-89b5-a7e4a088c321 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:13:41.063762 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9406d42e-fad3-4c63-89b5-a7e4a088c321 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:41.064375 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9406d42e-fad3-4c63-89b5-a7e4a088c321 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:41.065842 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9406d42e-fad3-4c63-89b5-a7e4a088c321 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:41.067985 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9406d42e-fad3-4c63-89b5-a7e4a088c321 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:41.071651 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9406d42e-fad3-4c63-89b5-a7e4a088c321 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:41.072312 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9406d42e-fad3-4c63-89b5-a7e4a088c321 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:41.121427 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-9406d42e-fad3-4c63-89b5-a7e4a088c321 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Getting quotas for project 1eb12683ada249bfa2ca7bf5cf730ca3. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:13:41.140533 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-9406d42e-fad3-4c63-89b5-a7e4a088c321 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Getting quotas for user 2ea96841d5b64d2390d18b3eb5da8b73 and project 1eb12683ada249bfa2ca7bf5cf730ca3. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:13:41.178659 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-9406d42e-fad3-4c63-89b5-a7e4a088c321 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Going to run 1 instances... {{(pid=122632) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 23:13:41.181418 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-9406d42e-fad3-4c63-89b5-a7e4a088c321 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: 3efc12c9-baf5-40e4-9d98-e72d28377db6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78ad8905-f66f-4733-8be9-2b260f1fabed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122632) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 23:13:41.306429 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-9406d42e-fad3-4c63-89b5-a7e4a088c321 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.242823 Aug 10 23:13:41.307600 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1718/3565] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 23:13:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 1245 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 10 23:13:41.324925 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-591e86f8-b995-4669-942b-e31fd8cd1947 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:41.325808 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-591e86f8-b995-4669-942b-e31fd8cd1947 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 6dc592cb-94c7-4918-8103-023db604fd70] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:41.343492 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-591e86f8-b995-4669-942b-e31fd8cd1947 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:41.344286 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-591e86f8-b995-4669-942b-e31fd8cd1947 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:41.344968 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-591e86f8-b995-4669-942b-e31fd8cd1947 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:41.345878 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-591e86f8-b995-4669-942b-e31fd8cd1947 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:41.347210 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-591e86f8-b995-4669-942b-e31fd8cd1947 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:41.347688 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-591e86f8-b995-4669-942b-e31fd8cd1947 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:41.945909 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-c77014c6-0484-4017-8010-ea32121d7089 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6160c7a42740efbe3613380933fa15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d90f8a58ad047fa8f347d6474e4d673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:41.954949 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-c77014c6-0484-4017-8010-ea32121d7089 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "GET /compute/v2.1/servers/da69cf1f-ff76-4a68-afe9-fc491b31e8a9" status: 200 len: 1523 microversion: 2.1 time: 1.082798 Aug 10 23:13:41.959849 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1848/3566] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:40 2022] GET /compute/v2.1/servers/da69cf1f-ff76-4a68-afe9-fc491b31e8a9 => generated 1523 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:13:41.976284 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-d2a4eada-42b3-44ab-9742-1073d1324eac tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:41.977262 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-d2a4eada-42b3-44ab-9742-1073d1324eac tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: 3efc12c9-baf5-40e4-9d98-e72d28377db6] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:42.209678 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-d2a4eada-42b3-44ab-9742-1073d1324eac tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:42.255937 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-d2a4eada-42b3-44ab-9742-1073d1324eac tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/3efc12c9-baf5-40e4-9d98-e72d28377db6" status: 200 len: 1214 microversion: 2.1 time: 0.281636 Aug 10 23:13:42.260401 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1849/3567] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:41 2022] GET /compute/v2.1/servers/3efc12c9-baf5-40e4-9d98-e72d28377db6 => generated 1214 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:13:42.283766 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-240e3cd5-2123-47a4-8b74-f02d36d2041c tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:42.289384 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-240e3cd5-2123-47a4-8b74-f02d36d2041c tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] [instance: f4dc6241-b173-4cbf-b76c-7da3fac7edcc] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:42.333360 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-240e3cd5-2123-47a4-8b74-f02d36d2041c tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:42.339416 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-240e3cd5-2123-47a4-8b74-f02d36d2041c tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:42.346484 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-240e3cd5-2123-47a4-8b74-f02d36d2041c tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:42.355282 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-240e3cd5-2123-47a4-8b74-f02d36d2041c tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:42.357819 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-240e3cd5-2123-47a4-8b74-f02d36d2041c tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:42.359491 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-240e3cd5-2123-47a4-8b74-f02d36d2041c tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:42.854931 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-591e86f8-b995-4669-942b-e31fd8cd1947 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:42.874536 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-591e86f8-b995-4669-942b-e31fd8cd1947 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/6dc592cb-94c7-4918-8103-023db604fd70" status: 200 len: 1317 microversion: 2.1 time: 1.565046 Aug 10 23:13:42.886870 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1719/3568] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:41 2022] GET /compute/v2.1/servers/6dc592cb-94c7-4918-8103-023db604fd70 => generated 1317 bytes in 1570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:13:42.892480 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-4ace07e0-34f3-4cf6-bf5c-522e40322c27 req-7ca5100c-81e4-44ee-b325-59ad2b093951 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da69cf1f-ff76-4a68-afe9-fc491b31e8a9", "name": "network-vif-plugged", "status": "completed", "tag": "1fe8c8ad-aad0-4a76-a5ed-01061f46152f"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:13:42.915270 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-4ace07e0-34f3-4cf6-bf5c-522e40322c27 req-7ca5100c-81e4-44ee-b325-59ad2b093951 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:42.916290 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-4ace07e0-34f3-4cf6-bf5c-522e40322c27 req-7ca5100c-81e4-44ee-b325-59ad2b093951 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:42.917091 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-4ace07e0-34f3-4cf6-bf5c-522e40322c27 req-7ca5100c-81e4-44ee-b325-59ad2b093951 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:42.936182 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-4ace07e0-34f3-4cf6-bf5c-522e40322c27 req-7ca5100c-81e4-44ee-b325-59ad2b093951 service nova] Creating event network-vif-plugged:1fe8c8ad-aad0-4a76-a5ed-01061f46152f for instance da69cf1f-ff76-4a68-afe9-fc491b31e8a9 on n-h2-850468-14 Aug 10 23:13:42.942427 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-4ace07e0-34f3-4cf6-bf5c-522e40322c27 req-7ca5100c-81e4-44ee-b325-59ad2b093951 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063354 Aug 10 23:13:42.943741 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1720/3569] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:13:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:13:42.982695 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-1e8f29a9-e92a-4619-a089-ab6ba6e65ce3 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:42.983870 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-1e8f29a9-e92a-4619-a089-ab6ba6e65ce3 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: da69cf1f-ff76-4a68-afe9-fc491b31e8a9] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:42.997624 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1e8f29a9-e92a-4619-a089-ab6ba6e65ce3 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:42.998376 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1e8f29a9-e92a-4619-a089-ab6ba6e65ce3 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:43.000799 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1e8f29a9-e92a-4619-a089-ab6ba6e65ce3 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:43.001776 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1e8f29a9-e92a-4619-a089-ab6ba6e65ce3 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:43.002481 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1e8f29a9-e92a-4619-a089-ab6ba6e65ce3 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:43.005246 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1e8f29a9-e92a-4619-a089-ab6ba6e65ce3 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:43.270814 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-240e3cd5-2123-47a4-8b74-f02d36d2041c tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5899b2ad9f1046caaf7c6073e408eeee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25abd63376614081a9d484f3c9ae950d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:43.297568 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-240e3cd5-2123-47a4-8b74-f02d36d2041c tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "GET /compute/v2.1/servers/f4dc6241-b173-4cbf-b76c-7da3fac7edcc" status: 200 len: 1690 microversion: 2.1 time: 1.033053 Aug 10 23:13:43.298636 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1850/3570] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:42 2022] GET /compute/v2.1/servers/f4dc6241-b173-4cbf-b76c-7da3fac7edcc => generated 1690 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:13:43.318063 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-fefffcc3-1ce1-401a-837f-439732e82feb req-2ea2bc53-d46c-42a5-9430-01e9057f4a02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6dc592cb-94c7-4918-8103-023db604fd70", "tag": "2b99192d-6b32-4802-864a-09a3ba0a3010"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:13:43.359720 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-fefffcc3-1ce1-401a-837f-439732e82feb req-2ea2bc53-d46c-42a5-9430-01e9057f4a02 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:43.363301 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-fefffcc3-1ce1-401a-837f-439732e82feb req-2ea2bc53-d46c-42a5-9430-01e9057f4a02 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:43.363955 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-fefffcc3-1ce1-401a-837f-439732e82feb req-2ea2bc53-d46c-42a5-9430-01e9057f4a02 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:43.406457 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-fefffcc3-1ce1-401a-837f-439732e82feb req-2ea2bc53-d46c-42a5-9430-01e9057f4a02 service nova] Creating event network-changed:2b99192d-6b32-4802-864a-09a3ba0a3010 for instance 6dc592cb-94c7-4918-8103-023db604fd70 on n-h1-850468-14 Aug 10 23:13:43.421774 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-fefffcc3-1ce1-401a-837f-439732e82feb req-2ea2bc53-d46c-42a5-9430-01e9057f4a02 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111157 Aug 10 23:13:43.423776 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1851/3571] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:13:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:13:43.451857 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-bd0c15a8-cacf-40a0-b754-d1e0d9084c21 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:43.452862 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-bd0c15a8-cacf-40a0-b754-d1e0d9084c21 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: 3efc12c9-baf5-40e4-9d98-e72d28377db6] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:43.473364 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bd0c15a8-cacf-40a0-b754-d1e0d9084c21 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:43.483301 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bd0c15a8-cacf-40a0-b754-d1e0d9084c21 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:43.484216 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bd0c15a8-cacf-40a0-b754-d1e0d9084c21 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:43.485323 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bd0c15a8-cacf-40a0-b754-d1e0d9084c21 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:43.486045 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bd0c15a8-cacf-40a0-b754-d1e0d9084c21 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:43.489709 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bd0c15a8-cacf-40a0-b754-d1e0d9084c21 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:43.577349 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-1e8f29a9-e92a-4619-a089-ab6ba6e65ce3 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6160c7a42740efbe3613380933fa15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d90f8a58ad047fa8f347d6474e4d673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:43.587985 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-1e8f29a9-e92a-4619-a089-ab6ba6e65ce3 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "GET /compute/v2.1/servers/da69cf1f-ff76-4a68-afe9-fc491b31e8a9" status: 200 len: 1523 microversion: 2.1 time: 0.609942 Aug 10 23:13:43.589007 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1721/3572] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:42 2022] GET /compute/v2.1/servers/da69cf1f-ff76-4a68-afe9-fc491b31e8a9 => generated 1523 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:13:43.765624 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-bd0c15a8-cacf-40a0-b754-d1e0d9084c21 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:43.781411 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-bd0c15a8-cacf-40a0-b754-d1e0d9084c21 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/3efc12c9-baf5-40e4-9d98-e72d28377db6" status: 200 len: 1284 microversion: 2.1 time: 0.353062 Aug 10 23:13:43.782345 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1852/3573] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:43 2022] GET /compute/v2.1/servers/3efc12c9-baf5-40e4-9d98-e72d28377db6 => generated 1284 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:13:43.899916 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-9c44db93-b7ea-486a-88f7-4776514ad057 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:43.901357 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-9c44db93-b7ea-486a-88f7-4776514ad057 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 6dc592cb-94c7-4918-8103-023db604fd70] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:43.914142 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9c44db93-b7ea-486a-88f7-4776514ad057 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:43.914634 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9c44db93-b7ea-486a-88f7-4776514ad057 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:43.918050 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9c44db93-b7ea-486a-88f7-4776514ad057 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:43.919188 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9c44db93-b7ea-486a-88f7-4776514ad057 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:43.919812 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9c44db93-b7ea-486a-88f7-4776514ad057 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:43.920423 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9c44db93-b7ea-486a-88f7-4776514ad057 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:44.321587 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-b627e332-c437-4dfb-b34d-b8b23466df23 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:44.322910 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-b627e332-c437-4dfb-b34d-b8b23466df23 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] [instance: f4dc6241-b173-4cbf-b76c-7da3fac7edcc] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:44.342291 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b627e332-c437-4dfb-b34d-b8b23466df23 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:44.350442 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b627e332-c437-4dfb-b34d-b8b23466df23 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:44.351661 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b627e332-c437-4dfb-b34d-b8b23466df23 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:44.355184 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b627e332-c437-4dfb-b34d-b8b23466df23 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:44.356752 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b627e332-c437-4dfb-b34d-b8b23466df23 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:44.359756 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b627e332-c437-4dfb-b34d-b8b23466df23 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:44.768463 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-9c44db93-b7ea-486a-88f7-4776514ad057 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:44.780589 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-9c44db93-b7ea-486a-88f7-4776514ad057 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/6dc592cb-94c7-4918-8103-023db604fd70" status: 200 len: 1317 microversion: 2.1 time: 0.884645 Aug 10 23:13:44.781740 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1722/3574] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:43 2022] GET /compute/v2.1/servers/6dc592cb-94c7-4918-8103-023db604fd70 => generated 1317 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:13:44.797754 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-906fb982-bfaf-42b2-9355-21b4958a4b4d tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:44.800975 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-906fb982-bfaf-42b2-9355-21b4958a4b4d tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: da69cf1f-ff76-4a68-afe9-fc491b31e8a9] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:44.828247 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-906fb982-bfaf-42b2-9355-21b4958a4b4d tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:44.832145 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-906fb982-bfaf-42b2-9355-21b4958a4b4d tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:44.832910 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-906fb982-bfaf-42b2-9355-21b4958a4b4d tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:44.833836 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-906fb982-bfaf-42b2-9355-21b4958a4b4d tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:44.834468 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-906fb982-bfaf-42b2-9355-21b4958a4b4d tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:44.835062 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-906fb982-bfaf-42b2-9355-21b4958a4b4d tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:45.339485 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-b627e332-c437-4dfb-b34d-b8b23466df23 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5899b2ad9f1046caaf7c6073e408eeee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25abd63376614081a9d484f3c9ae950d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:45.350033 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-b627e332-c437-4dfb-b34d-b8b23466df23 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "GET /compute/v2.1/servers/f4dc6241-b173-4cbf-b76c-7da3fac7edcc" status: 200 len: 1690 microversion: 2.1 time: 1.032793 Aug 10 23:13:45.361334 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1853/3575] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:44 2022] GET /compute/v2.1/servers/f4dc6241-b173-4cbf-b76c-7da3fac7edcc => generated 1690 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:13:45.382455 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-180f1b29-ca12-4ab6-8ed1-d58dbe5808d3 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:45.388462 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-180f1b29-ca12-4ab6-8ed1-d58dbe5808d3 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: 3efc12c9-baf5-40e4-9d98-e72d28377db6] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:45.403406 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-180f1b29-ca12-4ab6-8ed1-d58dbe5808d3 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:45.406594 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-180f1b29-ca12-4ab6-8ed1-d58dbe5808d3 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:45.408212 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-180f1b29-ca12-4ab6-8ed1-d58dbe5808d3 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:45.409145 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-180f1b29-ca12-4ab6-8ed1-d58dbe5808d3 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:45.410085 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-180f1b29-ca12-4ab6-8ed1-d58dbe5808d3 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:45.412508 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-180f1b29-ca12-4ab6-8ed1-d58dbe5808d3 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:45.418134 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=100 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:13:45.506330 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-906fb982-bfaf-42b2-9355-21b4958a4b4d tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6160c7a42740efbe3613380933fa15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d90f8a58ad047fa8f347d6474e4d673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:45.531334 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-906fb982-bfaf-42b2-9355-21b4958a4b4d tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "GET /compute/v2.1/servers/da69cf1f-ff76-4a68-afe9-fc491b31e8a9" status: 200 len: 1523 microversion: 2.1 time: 0.748034 Aug 10 23:13:45.548156 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1723/3576] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:44 2022] GET /compute/v2.1/servers/da69cf1f-ff76-4a68-afe9-fc491b31e8a9 => generated 1523 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:13:45.611031 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-180f1b29-ca12-4ab6-8ed1-d58dbe5808d3 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:45.624677 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-180f1b29-ca12-4ab6-8ed1-d58dbe5808d3 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/3efc12c9-baf5-40e4-9d98-e72d28377db6" status: 200 len: 1272 microversion: 2.1 time: 0.258783 Aug 10 23:13:45.625866 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1854/3577] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:45 2022] GET /compute/v2.1/servers/3efc12c9-baf5-40e4-9d98-e72d28377db6 => generated 1272 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:13:45.808630 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c46dbbbd-fc6a-4ee6-9366-a9c6c1f32b2f tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:45.809702 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-c46dbbbd-fc6a-4ee6-9366-a9c6c1f32b2f tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 6dc592cb-94c7-4918-8103-023db604fd70] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:45.835940 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c46dbbbd-fc6a-4ee6-9366-a9c6c1f32b2f tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:45.840332 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c46dbbbd-fc6a-4ee6-9366-a9c6c1f32b2f tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:45.841947 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c46dbbbd-fc6a-4ee6-9366-a9c6c1f32b2f tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:45.844397 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c46dbbbd-fc6a-4ee6-9366-a9c6c1f32b2f tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:45.845419 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c46dbbbd-fc6a-4ee6-9366-a9c6c1f32b2f tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:45.846067 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c46dbbbd-fc6a-4ee6-9366-a9c6c1f32b2f tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:46.383225 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-d0a6840c-3bbb-445b-b60a-43962df49747 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:46.384547 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-d0a6840c-3bbb-445b-b60a-43962df49747 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] [instance: f4dc6241-b173-4cbf-b76c-7da3fac7edcc] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:46.408706 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d0a6840c-3bbb-445b-b60a-43962df49747 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:46.413696 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d0a6840c-3bbb-445b-b60a-43962df49747 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:46.417120 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d0a6840c-3bbb-445b-b60a-43962df49747 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:46.418251 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d0a6840c-3bbb-445b-b60a-43962df49747 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:46.420733 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d0a6840c-3bbb-445b-b60a-43962df49747 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:46.421531 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d0a6840c-3bbb-445b-b60a-43962df49747 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:47.006030 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-d0a6840c-3bbb-445b-b60a-43962df49747 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5899b2ad9f1046caaf7c6073e408eeee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25abd63376614081a9d484f3c9ae950d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:47.015446 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-d0a6840c-3bbb-445b-b60a-43962df49747 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "GET /compute/v2.1/servers/f4dc6241-b173-4cbf-b76c-7da3fac7edcc" status: 200 len: 1695 microversion: 2.1 time: 0.637641 Aug 10 23:13:47.025953 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1855/3578] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:46 2022] GET /compute/v2.1/servers/f4dc6241-b173-4cbf-b76c-7da3fac7edcc => generated 1695 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:13:47.047393 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-1b9a04fd-875f-4234-9a47-39fae787209b tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:47.048282 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-1b9a04fd-875f-4234-9a47-39fae787209b tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: da69cf1f-ff76-4a68-afe9-fc491b31e8a9] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:47.058529 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1b9a04fd-875f-4234-9a47-39fae787209b tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:47.066553 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1b9a04fd-875f-4234-9a47-39fae787209b tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:47.067447 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1b9a04fd-875f-4234-9a47-39fae787209b tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:47.069573 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1b9a04fd-875f-4234-9a47-39fae787209b tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:47.075810 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1b9a04fd-875f-4234-9a47-39fae787209b tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:47.076701 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1b9a04fd-875f-4234-9a47-39fae787209b tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:47.399745 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-c46dbbbd-fc6a-4ee6-9366-a9c6c1f32b2f tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:47.412239 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-c46dbbbd-fc6a-4ee6-9366-a9c6c1f32b2f tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/6dc592cb-94c7-4918-8103-023db604fd70" status: 200 len: 1317 microversion: 2.1 time: 1.610239 Aug 10 23:13:47.412846 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1724/3579] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:45 2022] GET /compute/v2.1/servers/6dc592cb-94c7-4918-8103-023db604fd70 => generated 1317 bytes in 1612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:13:47.469116 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-67b82950-64ca-4df9-a5cd-eb5e82b41903 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:47.469806 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-67b82950-64ca-4df9-a5cd-eb5e82b41903 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: 3efc12c9-baf5-40e4-9d98-e72d28377db6] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:47.499126 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-67b82950-64ca-4df9-a5cd-eb5e82b41903 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:47.499557 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-67b82950-64ca-4df9-a5cd-eb5e82b41903 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:47.500006 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-67b82950-64ca-4df9-a5cd-eb5e82b41903 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:47.500771 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-67b82950-64ca-4df9-a5cd-eb5e82b41903 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:47.501176 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-67b82950-64ca-4df9-a5cd-eb5e82b41903 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:47.501604 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-67b82950-64ca-4df9-a5cd-eb5e82b41903 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:47.999911 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-1b9a04fd-875f-4234-9a47-39fae787209b tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6160c7a42740efbe3613380933fa15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d90f8a58ad047fa8f347d6474e4d673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:48.008667 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-1b9a04fd-875f-4234-9a47-39fae787209b tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "GET /compute/v2.1/servers/da69cf1f-ff76-4a68-afe9-fc491b31e8a9" status: 200 len: 1523 microversion: 2.1 time: 0.977554 Aug 10 23:13:48.015464 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1856/3580] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:47 2022] GET /compute/v2.1/servers/da69cf1f-ff76-4a68-afe9-fc491b31e8a9 => generated 1523 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:13:48.057210 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-7f158b2a-1f14-4214-b1cb-bfab78cea016 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:48.058412 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-7f158b2a-1f14-4214-b1cb-bfab78cea016 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] [instance: f4dc6241-b173-4cbf-b76c-7da3fac7edcc] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:48.076716 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7f158b2a-1f14-4214-b1cb-bfab78cea016 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:48.082842 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7f158b2a-1f14-4214-b1cb-bfab78cea016 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:48.083668 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7f158b2a-1f14-4214-b1cb-bfab78cea016 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:48.090734 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7f158b2a-1f14-4214-b1cb-bfab78cea016 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:48.091269 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7f158b2a-1f14-4214-b1cb-bfab78cea016 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:48.091757 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7f158b2a-1f14-4214-b1cb-bfab78cea016 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:48.803167 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-67b82950-64ca-4df9-a5cd-eb5e82b41903 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:48.812565 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-67b82950-64ca-4df9-a5cd-eb5e82b41903 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/3efc12c9-baf5-40e4-9d98-e72d28377db6" status: 200 len: 1314 microversion: 2.1 time: 1.365477 Aug 10 23:13:48.817157 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1725/3581] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:47 2022] GET /compute/v2.1/servers/3efc12c9-baf5-40e4-9d98-e72d28377db6 => generated 1314 bytes in 1371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:13:48.831596 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-916db588-cbe1-4718-a7cc-c5a6b2d92177 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:48.832493 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-916db588-cbe1-4718-a7cc-c5a6b2d92177 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 6dc592cb-94c7-4918-8103-023db604fd70] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:48.858136 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-916db588-cbe1-4718-a7cc-c5a6b2d92177 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:48.860273 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-916db588-cbe1-4718-a7cc-c5a6b2d92177 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:48.860736 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-916db588-cbe1-4718-a7cc-c5a6b2d92177 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:48.861477 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-916db588-cbe1-4718-a7cc-c5a6b2d92177 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:48.861941 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-916db588-cbe1-4718-a7cc-c5a6b2d92177 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:48.863334 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-916db588-cbe1-4718-a7cc-c5a6b2d92177 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:49.721224 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-7f158b2a-1f14-4214-b1cb-bfab78cea016 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5899b2ad9f1046caaf7c6073e408eeee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25abd63376614081a9d484f3c9ae950d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:49.750915 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-7f158b2a-1f14-4214-b1cb-bfab78cea016 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "GET /compute/v2.1/servers/f4dc6241-b173-4cbf-b76c-7da3fac7edcc" status: 200 len: 1695 microversion: 2.1 time: 1.691980 Aug 10 23:13:49.753984 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1857/3582] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:48 2022] GET /compute/v2.1/servers/f4dc6241-b173-4cbf-b76c-7da3fac7edcc => generated 1695 bytes in 1704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:13:49.767052 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-d29863ab-1f77-4beb-8e5e-214aae60145b tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:49.768488 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-d29863ab-1f77-4beb-8e5e-214aae60145b tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: da69cf1f-ff76-4a68-afe9-fc491b31e8a9] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:49.775902 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-916db588-cbe1-4718-a7cc-c5a6b2d92177 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:49.784401 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d29863ab-1f77-4beb-8e5e-214aae60145b tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:49.785174 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d29863ab-1f77-4beb-8e5e-214aae60145b tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:49.785832 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d29863ab-1f77-4beb-8e5e-214aae60145b tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:49.786710 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d29863ab-1f77-4beb-8e5e-214aae60145b tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:49.787354 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d29863ab-1f77-4beb-8e5e-214aae60145b tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:49.788095 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d29863ab-1f77-4beb-8e5e-214aae60145b tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:49.791091 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-916db588-cbe1-4718-a7cc-c5a6b2d92177 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/6dc592cb-94c7-4918-8103-023db604fd70" status: 200 len: 1317 microversion: 2.1 time: 0.972051 Aug 10 23:13:49.804284 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1726/3583] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:48 2022] GET /compute/v2.1/servers/6dc592cb-94c7-4918-8103-023db604fd70 => generated 1317 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:13:49.840027 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-333fae00-a893-4ba8-a08b-120781d762f9 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:49.841253 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-333fae00-a893-4ba8-a08b-120781d762f9 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: 3efc12c9-baf5-40e4-9d98-e72d28377db6] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:49.864273 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-333fae00-a893-4ba8-a08b-120781d762f9 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:49.867121 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-333fae00-a893-4ba8-a08b-120781d762f9 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:49.872318 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-333fae00-a893-4ba8-a08b-120781d762f9 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:49.876030 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-333fae00-a893-4ba8-a08b-120781d762f9 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:49.878276 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-333fae00-a893-4ba8-a08b-120781d762f9 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:49.878903 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-333fae00-a893-4ba8-a08b-120781d762f9 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:50.327800 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-d29863ab-1f77-4beb-8e5e-214aae60145b tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6160c7a42740efbe3613380933fa15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d90f8a58ad047fa8f347d6474e4d673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:50.340318 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-d29863ab-1f77-4beb-8e5e-214aae60145b tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "GET /compute/v2.1/servers/da69cf1f-ff76-4a68-afe9-fc491b31e8a9" status: 200 len: 1523 microversion: 2.1 time: 0.584420 Aug 10 23:13:50.346577 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1858/3584] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:49 2022] GET /compute/v2.1/servers/da69cf1f-ff76-4a68-afe9-fc491b31e8a9 => generated 1523 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:13:50.580934 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-333fae00-a893-4ba8-a08b-120781d762f9 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:50.598587 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-333fae00-a893-4ba8-a08b-120781d762f9 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/3efc12c9-baf5-40e4-9d98-e72d28377db6" status: 200 len: 1314 microversion: 2.1 time: 0.759570 Aug 10 23:13:50.610811 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1727/3585] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:49 2022] GET /compute/v2.1/servers/3efc12c9-baf5-40e4-9d98-e72d28377db6 => generated 1314 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:13:50.778347 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-b8d14042-7e6a-4453-9039-bd1f62f90eb2 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:50.778934 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-b8d14042-7e6a-4453-9039-bd1f62f90eb2 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] [instance: f4dc6241-b173-4cbf-b76c-7da3fac7edcc] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:50.788350 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b8d14042-7e6a-4453-9039-bd1f62f90eb2 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:50.789304 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b8d14042-7e6a-4453-9039-bd1f62f90eb2 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:50.790161 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b8d14042-7e6a-4453-9039-bd1f62f90eb2 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:50.791643 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b8d14042-7e6a-4453-9039-bd1f62f90eb2 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:50.792337 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b8d14042-7e6a-4453-9039-bd1f62f90eb2 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:50.793024 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b8d14042-7e6a-4453-9039-bd1f62f90eb2 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:50.819783 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-4f817209-c654-48c9-be7b-dc4cb9b5ec89 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:50.830571 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-4f817209-c654-48c9-be7b-dc4cb9b5ec89 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 6dc592cb-94c7-4918-8103-023db604fd70] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:50.843807 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4f817209-c654-48c9-be7b-dc4cb9b5ec89 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:50.844891 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4f817209-c654-48c9-be7b-dc4cb9b5ec89 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:50.846072 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4f817209-c654-48c9-be7b-dc4cb9b5ec89 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:50.849765 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4f817209-c654-48c9-be7b-dc4cb9b5ec89 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:50.850440 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4f817209-c654-48c9-be7b-dc4cb9b5ec89 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:50.851064 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4f817209-c654-48c9-be7b-dc4cb9b5ec89 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:51.091657 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=4 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:13:51.160693 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-b8d14042-7e6a-4453-9039-bd1f62f90eb2 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5899b2ad9f1046caaf7c6073e408eeee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25abd63376614081a9d484f3c9ae950d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:51.168179 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=14 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:13:51.184817 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-b8d14042-7e6a-4453-9039-bd1f62f90eb2 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "GET /compute/v2.1/servers/f4dc6241-b173-4cbf-b76c-7da3fac7edcc" status: 200 len: 1695 microversion: 2.1 time: 0.412247 Aug 10 23:13:51.188007 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1859/3586] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:50 2022] GET /compute/v2.1/servers/f4dc6241-b173-4cbf-b76c-7da3fac7edcc => generated 1695 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:13:51.373998 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-33502542-940a-4211-95cb-9ca14ea26b17 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:51.376857 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-33502542-940a-4211-95cb-9ca14ea26b17 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: da69cf1f-ff76-4a68-afe9-fc491b31e8a9] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:51.418372 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-33502542-940a-4211-95cb-9ca14ea26b17 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:51.421131 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-33502542-940a-4211-95cb-9ca14ea26b17 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:51.421656 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-33502542-940a-4211-95cb-9ca14ea26b17 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:51.424773 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-33502542-940a-4211-95cb-9ca14ea26b17 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:51.425465 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-33502542-940a-4211-95cb-9ca14ea26b17 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:51.426059 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-33502542-940a-4211-95cb-9ca14ea26b17 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:51.787356 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-4f817209-c654-48c9-be7b-dc4cb9b5ec89 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:51.796835 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-4f817209-c654-48c9-be7b-dc4cb9b5ec89 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/6dc592cb-94c7-4918-8103-023db604fd70" status: 200 len: 1317 microversion: 2.1 time: 0.980842 Aug 10 23:13:51.801327 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1728/3587] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:50 2022] GET /compute/v2.1/servers/6dc592cb-94c7-4918-8103-023db604fd70 => generated 1317 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:13:51.823508 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-f3578e3f-c265-4eff-b9ad-5a41787f9935 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:51.824914 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-f3578e3f-c265-4eff-b9ad-5a41787f9935 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: 3efc12c9-baf5-40e4-9d98-e72d28377db6] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:51.831424 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f3578e3f-c265-4eff-b9ad-5a41787f9935 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:51.832200 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f3578e3f-c265-4eff-b9ad-5a41787f9935 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:51.832841 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f3578e3f-c265-4eff-b9ad-5a41787f9935 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:51.833741 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f3578e3f-c265-4eff-b9ad-5a41787f9935 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:51.847588 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f3578e3f-c265-4eff-b9ad-5a41787f9935 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:51.848382 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f3578e3f-c265-4eff-b9ad-5a41787f9935 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:51.865738 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-33502542-940a-4211-95cb-9ca14ea26b17 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6160c7a42740efbe3613380933fa15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d90f8a58ad047fa8f347d6474e4d673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:51.881304 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-33502542-940a-4211-95cb-9ca14ea26b17 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "GET /compute/v2.1/servers/da69cf1f-ff76-4a68-afe9-fc491b31e8a9" status: 200 len: 1523 microversion: 2.1 time: 0.516418 Aug 10 23:13:51.886935 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1860/3588] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:51 2022] GET /compute/v2.1/servers/da69cf1f-ff76-4a68-afe9-fc491b31e8a9 => generated 1523 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:13:51.897061 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-b714b52f-a59f-421b-9a22-82ea0455ed44 req-af6347bf-0cd4-4190-895a-8b30631d8612 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3efc12c9-baf5-40e4-9d98-e72d28377db6", "tag": "2917009e-0d0a-40bd-81cf-b2967c8c2f2e"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:13:51.921160 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-b714b52f-a59f-421b-9a22-82ea0455ed44 req-af6347bf-0cd4-4190-895a-8b30631d8612 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:51.922859 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-b714b52f-a59f-421b-9a22-82ea0455ed44 req-af6347bf-0cd4-4190-895a-8b30631d8612 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:51.923638 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-b714b52f-a59f-421b-9a22-82ea0455ed44 req-af6347bf-0cd4-4190-895a-8b30631d8612 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:51.952927 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-b714b52f-a59f-421b-9a22-82ea0455ed44 req-af6347bf-0cd4-4190-895a-8b30631d8612 service nova] Creating event network-changed:2917009e-0d0a-40bd-81cf-b2967c8c2f2e for instance 3efc12c9-baf5-40e4-9d98-e72d28377db6 on n-h1-850468-14 Aug 10 23:13:51.961666 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-b714b52f-a59f-421b-9a22-82ea0455ed44 req-af6347bf-0cd4-4190-895a-8b30631d8612 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072739 Aug 10 23:13:51.967218 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1861/3589] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:13:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:13:52.212677 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-4025d8f8-4131-454e-92df-dee968e08924 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:52.213451 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-4025d8f8-4131-454e-92df-dee968e08924 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] [instance: f4dc6241-b173-4cbf-b76c-7da3fac7edcc] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:52.227541 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4025d8f8-4131-454e-92df-dee968e08924 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:52.228105 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4025d8f8-4131-454e-92df-dee968e08924 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:52.228553 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4025d8f8-4131-454e-92df-dee968e08924 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:52.248487 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4025d8f8-4131-454e-92df-dee968e08924 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:52.249168 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4025d8f8-4131-454e-92df-dee968e08924 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:52.249689 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4025d8f8-4131-454e-92df-dee968e08924 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:52.250402 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=2 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:13:52.499918 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-f3578e3f-c265-4eff-b9ad-5a41787f9935 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:52.507666 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-f3578e3f-c265-4eff-b9ad-5a41787f9935 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/3efc12c9-baf5-40e4-9d98-e72d28377db6" status: 200 len: 1314 microversion: 2.1 time: 0.704992 Aug 10 23:13:52.508266 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1729/3590] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:51 2022] GET /compute/v2.1/servers/3efc12c9-baf5-40e4-9d98-e72d28377db6 => generated 1314 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:13:52.787447 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-4025d8f8-4131-454e-92df-dee968e08924 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5899b2ad9f1046caaf7c6073e408eeee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25abd63376614081a9d484f3c9ae950d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:52.805230 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-4025d8f8-4131-454e-92df-dee968e08924 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "GET /compute/v2.1/servers/f4dc6241-b173-4cbf-b76c-7da3fac7edcc" status: 200 len: 1695 microversion: 2.1 time: 0.597157 Aug 10 23:13:52.806822 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1862/3591] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:52 2022] GET /compute/v2.1/servers/f4dc6241-b173-4cbf-b76c-7da3fac7edcc => generated 1695 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:13:52.829980 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-f78b0bf7-cc59-48d5-9f96-c08fce97e9ed tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:52.831397 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-f78b0bf7-cc59-48d5-9f96-c08fce97e9ed tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 6dc592cb-94c7-4918-8103-023db604fd70] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:52.843399 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f78b0bf7-cc59-48d5-9f96-c08fce97e9ed tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:52.845685 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f78b0bf7-cc59-48d5-9f96-c08fce97e9ed tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:52.847349 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f78b0bf7-cc59-48d5-9f96-c08fce97e9ed tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:52.848363 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f78b0bf7-cc59-48d5-9f96-c08fce97e9ed tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:52.854175 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f78b0bf7-cc59-48d5-9f96-c08fce97e9ed tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:52.855033 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f78b0bf7-cc59-48d5-9f96-c08fce97e9ed tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:52.906105 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-e5e3a266-24cc-4e86-a93f-68fa4453dc69 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:52.907345 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-e5e3a266-24cc-4e86-a93f-68fa4453dc69 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: da69cf1f-ff76-4a68-afe9-fc491b31e8a9] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:52.919434 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e5e3a266-24cc-4e86-a93f-68fa4453dc69 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:52.923401 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e5e3a266-24cc-4e86-a93f-68fa4453dc69 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:52.924396 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e5e3a266-24cc-4e86-a93f-68fa4453dc69 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:52.927488 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e5e3a266-24cc-4e86-a93f-68fa4453dc69 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:52.932317 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e5e3a266-24cc-4e86-a93f-68fa4453dc69 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:52.934761 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e5e3a266-24cc-4e86-a93f-68fa4453dc69 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:53.857621 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-e5e3a266-24cc-4e86-a93f-68fa4453dc69 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6160c7a42740efbe3613380933fa15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d90f8a58ad047fa8f347d6474e4d673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:53.888414 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-e5e3a266-24cc-4e86-a93f-68fa4453dc69 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "GET /compute/v2.1/servers/da69cf1f-ff76-4a68-afe9-fc491b31e8a9" status: 200 len: 1523 microversion: 2.1 time: 0.986327 Aug 10 23:13:53.897859 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1863/3592] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:52 2022] GET /compute/v2.1/servers/da69cf1f-ff76-4a68-afe9-fc491b31e8a9 => generated 1523 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:13:53.903067 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-6de13cd2-190f-4de5-947a-6fa17399e0b0 req-7ca19488-a60c-48d9-8ef7-8e260e7b3ba3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6dc592cb-94c7-4918-8103-023db604fd70", "name": "network-vif-plugged", "status": "completed", "tag": "2b99192d-6b32-4802-864a-09a3ba0a3010"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:13:53.938372 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-6de13cd2-190f-4de5-947a-6fa17399e0b0 req-7ca19488-a60c-48d9-8ef7-8e260e7b3ba3 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:53.938944 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-6de13cd2-190f-4de5-947a-6fa17399e0b0 req-7ca19488-a60c-48d9-8ef7-8e260e7b3ba3 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:53.939310 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-6de13cd2-190f-4de5-947a-6fa17399e0b0 req-7ca19488-a60c-48d9-8ef7-8e260e7b3ba3 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:53.995227 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-6de13cd2-190f-4de5-947a-6fa17399e0b0 req-7ca19488-a60c-48d9-8ef7-8e260e7b3ba3 service nova] Creating event network-vif-plugged:2b99192d-6b32-4802-864a-09a3ba0a3010 for instance 6dc592cb-94c7-4918-8103-023db604fd70 on n-h1-850468-14 Aug 10 23:13:54.019926 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-6de13cd2-190f-4de5-947a-6fa17399e0b0 req-7ca19488-a60c-48d9-8ef7-8e260e7b3ba3 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119696 Aug 10 23:13:54.023736 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1864/3593] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:13:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:13:54.042024 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c1c9fef2-4d37-4890-9fdf-c8d114580605 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:54.049788 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-c1c9fef2-4d37-4890-9fdf-c8d114580605 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: 3efc12c9-baf5-40e4-9d98-e72d28377db6] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:54.079397 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c1c9fef2-4d37-4890-9fdf-c8d114580605 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:54.079917 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c1c9fef2-4d37-4890-9fdf-c8d114580605 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:54.080365 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c1c9fef2-4d37-4890-9fdf-c8d114580605 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:54.081112 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c1c9fef2-4d37-4890-9fdf-c8d114580605 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:54.081257 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-f78b0bf7-cc59-48d5-9f96-c08fce97e9ed tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:54.081666 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c1c9fef2-4d37-4890-9fdf-c8d114580605 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:54.081985 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c1c9fef2-4d37-4890-9fdf-c8d114580605 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:54.096443 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-f78b0bf7-cc59-48d5-9f96-c08fce97e9ed tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/6dc592cb-94c7-4918-8103-023db604fd70" status: 200 len: 1317 microversion: 2.1 time: 1.270989 Aug 10 23:13:54.101602 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1730/3594] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:52 2022] GET /compute/v2.1/servers/6dc592cb-94c7-4918-8103-023db604fd70 => generated 1317 bytes in 1277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:13:54.111351 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-fb552f26-238b-4d8d-b4e9-43960197f2c3 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:54.111980 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-fb552f26-238b-4d8d-b4e9-43960197f2c3 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] [instance: f4dc6241-b173-4cbf-b76c-7da3fac7edcc] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:54.120629 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fb552f26-238b-4d8d-b4e9-43960197f2c3 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:54.121137 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fb552f26-238b-4d8d-b4e9-43960197f2c3 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:54.121583 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fb552f26-238b-4d8d-b4e9-43960197f2c3 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:54.122303 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fb552f26-238b-4d8d-b4e9-43960197f2c3 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:54.122760 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fb552f26-238b-4d8d-b4e9-43960197f2c3 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:54.123219 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fb552f26-238b-4d8d-b4e9-43960197f2c3 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:54.867633 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-c1c9fef2-4d37-4890-9fdf-c8d114580605 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:54.875883 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-fb552f26-238b-4d8d-b4e9-43960197f2c3 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5899b2ad9f1046caaf7c6073e408eeee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25abd63376614081a9d484f3c9ae950d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:54.884829 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-c1c9fef2-4d37-4890-9fdf-c8d114580605 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/3efc12c9-baf5-40e4-9d98-e72d28377db6" status: 200 len: 1314 microversion: 2.1 time: 0.858983 Aug 10 23:13:54.885436 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1865/3595] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:54 2022] GET /compute/v2.1/servers/3efc12c9-baf5-40e4-9d98-e72d28377db6 => generated 1314 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:13:54.892259 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-fb552f26-238b-4d8d-b4e9-43960197f2c3 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "GET /compute/v2.1/servers/f4dc6241-b173-4cbf-b76c-7da3fac7edcc" status: 200 len: 1695 microversion: 2.1 time: 0.786480 Aug 10 23:13:54.898120 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1731/3596] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:54 2022] GET /compute/v2.1/servers/f4dc6241-b173-4cbf-b76c-7da3fac7edcc => generated 1695 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:13:54.918095 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-de63af57-196a-4fe1-9830-cfffb1558e65 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:54.918719 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-de63af57-196a-4fe1-9830-cfffb1558e65 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: da69cf1f-ff76-4a68-afe9-fc491b31e8a9] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:54.934772 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-de63af57-196a-4fe1-9830-cfffb1558e65 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:54.935298 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-de63af57-196a-4fe1-9830-cfffb1558e65 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:54.935740 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-de63af57-196a-4fe1-9830-cfffb1558e65 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:54.936706 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-de63af57-196a-4fe1-9830-cfffb1558e65 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:54.937168 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-de63af57-196a-4fe1-9830-cfffb1558e65 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:54.937593 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-de63af57-196a-4fe1-9830-cfffb1558e65 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:55.131027 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-e6a76e5a-0136-4c47-9db1-1386908af79a tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:55.131651 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-e6a76e5a-0136-4c47-9db1-1386908af79a tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 6dc592cb-94c7-4918-8103-023db604fd70] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:55.139263 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e6a76e5a-0136-4c47-9db1-1386908af79a tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:55.139806 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e6a76e5a-0136-4c47-9db1-1386908af79a tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:55.148560 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e6a76e5a-0136-4c47-9db1-1386908af79a tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:55.154160 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e6a76e5a-0136-4c47-9db1-1386908af79a tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:55.154965 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e6a76e5a-0136-4c47-9db1-1386908af79a tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:55.155591 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e6a76e5a-0136-4c47-9db1-1386908af79a tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:55.348218 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-de63af57-196a-4fe1-9830-cfffb1558e65 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6160c7a42740efbe3613380933fa15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d90f8a58ad047fa8f347d6474e4d673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:55.368118 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-de63af57-196a-4fe1-9830-cfffb1558e65 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "GET /compute/v2.1/servers/da69cf1f-ff76-4a68-afe9-fc491b31e8a9" status: 200 len: 1523 microversion: 2.1 time: 0.454372 Aug 10 23:13:55.373348 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1866/3597] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:54 2022] GET /compute/v2.1/servers/da69cf1f-ff76-4a68-afe9-fc491b31e8a9 => generated 1523 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:13:55.911595 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-154b7b1a-1a63-4adf-b4be-0ef92807a2a2 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:55.912356 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-154b7b1a-1a63-4adf-b4be-0ef92807a2a2 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: 3efc12c9-baf5-40e4-9d98-e72d28377db6] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:55.929430 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-154b7b1a-1a63-4adf-b4be-0ef92807a2a2 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:55.930736 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-154b7b1a-1a63-4adf-b4be-0ef92807a2a2 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:55.932312 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-154b7b1a-1a63-4adf-b4be-0ef92807a2a2 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:55.936212 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-154b7b1a-1a63-4adf-b4be-0ef92807a2a2 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:55.938083 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-154b7b1a-1a63-4adf-b4be-0ef92807a2a2 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:55.939974 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-154b7b1a-1a63-4adf-b4be-0ef92807a2a2 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:56.523354 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-e6a76e5a-0136-4c47-9db1-1386908af79a tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:56.533102 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-e6a76e5a-0136-4c47-9db1-1386908af79a tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/6dc592cb-94c7-4918-8103-023db604fd70" status: 200 len: 1317 microversion: 2.1 time: 1.406987 Aug 10 23:13:56.551479 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1732/3598] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:55 2022] GET /compute/v2.1/servers/6dc592cb-94c7-4918-8103-023db604fd70 => generated 1317 bytes in 1427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:13:56.560102 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-4ece6005-01d5-4052-8cda-2f2bc3a67fb7 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:56.565324 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-4ece6005-01d5-4052-8cda-2f2bc3a67fb7 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] [instance: f4dc6241-b173-4cbf-b76c-7da3fac7edcc] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:56.582555 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4ece6005-01d5-4052-8cda-2f2bc3a67fb7 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:56.583698 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4ece6005-01d5-4052-8cda-2f2bc3a67fb7 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:56.586554 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4ece6005-01d5-4052-8cda-2f2bc3a67fb7 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:56.588179 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4ece6005-01d5-4052-8cda-2f2bc3a67fb7 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:56.592609 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4ece6005-01d5-4052-8cda-2f2bc3a67fb7 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:56.593298 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4ece6005-01d5-4052-8cda-2f2bc3a67fb7 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:56.652673 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=100 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:13:56.765478 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-154b7b1a-1a63-4adf-b4be-0ef92807a2a2 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:56.785003 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-154b7b1a-1a63-4adf-b4be-0ef92807a2a2 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/3efc12c9-baf5-40e4-9d98-e72d28377db6" status: 200 len: 1314 microversion: 2.1 time: 0.880876 Aug 10 23:13:56.786336 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1867/3599] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:55 2022] GET /compute/v2.1/servers/3efc12c9-baf5-40e4-9d98-e72d28377db6 => generated 1314 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:13:56.798566 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-e220d0e2-fed1-4941-80a9-11f341ba647e tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:56.799749 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-e220d0e2-fed1-4941-80a9-11f341ba647e tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: da69cf1f-ff76-4a68-afe9-fc491b31e8a9] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:56.813470 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e220d0e2-fed1-4941-80a9-11f341ba647e tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:56.815319 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e220d0e2-fed1-4941-80a9-11f341ba647e tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:56.824401 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e220d0e2-fed1-4941-80a9-11f341ba647e tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:56.825559 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e220d0e2-fed1-4941-80a9-11f341ba647e tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:56.826247 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e220d0e2-fed1-4941-80a9-11f341ba647e tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:56.826922 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e220d0e2-fed1-4941-80a9-11f341ba647e tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:57.608506 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-e220d0e2-fed1-4941-80a9-11f341ba647e tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6160c7a42740efbe3613380933fa15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d90f8a58ad047fa8f347d6474e4d673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:57.619565 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-e220d0e2-fed1-4941-80a9-11f341ba647e tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "GET /compute/v2.1/servers/da69cf1f-ff76-4a68-afe9-fc491b31e8a9" status: 200 len: 1523 microversion: 2.1 time: 0.831681 Aug 10 23:13:57.628689 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1868/3600] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:56 2022] GET /compute/v2.1/servers/da69cf1f-ff76-4a68-afe9-fc491b31e8a9 => generated 1523 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:13:57.640239 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-af68d18c-118d-4e99-86c9-db7c2a1b5492 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:57.654257 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-af68d18c-118d-4e99-86c9-db7c2a1b5492 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 6dc592cb-94c7-4918-8103-023db604fd70] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:57.675620 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-af68d18c-118d-4e99-86c9-db7c2a1b5492 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:57.679432 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-af68d18c-118d-4e99-86c9-db7c2a1b5492 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:57.680154 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-af68d18c-118d-4e99-86c9-db7c2a1b5492 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:57.681303 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-af68d18c-118d-4e99-86c9-db7c2a1b5492 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:57.681991 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-af68d18c-118d-4e99-86c9-db7c2a1b5492 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:57.683100 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-af68d18c-118d-4e99-86c9-db7c2a1b5492 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:57.950692 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-4ece6005-01d5-4052-8cda-2f2bc3a67fb7 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5899b2ad9f1046caaf7c6073e408eeee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25abd63376614081a9d484f3c9ae950d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:57.969824 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-4ece6005-01d5-4052-8cda-2f2bc3a67fb7 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "GET /compute/v2.1/servers/f4dc6241-b173-4cbf-b76c-7da3fac7edcc" status: 200 len: 1695 microversion: 2.1 time: 1.407263 Aug 10 23:13:57.971092 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1733/3601] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:56 2022] GET /compute/v2.1/servers/f4dc6241-b173-4cbf-b76c-7da3fac7edcc => generated 1695 bytes in 1419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:13:57.976006 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-27c5ce87-569d-4183-8c9b-b3b6ddc7f6fe tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:57.996998 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-27c5ce87-569d-4183-8c9b-b3b6ddc7f6fe tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: 3efc12c9-baf5-40e4-9d98-e72d28377db6] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:58.008559 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-27c5ce87-569d-4183-8c9b-b3b6ddc7f6fe tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:58.009881 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-27c5ce87-569d-4183-8c9b-b3b6ddc7f6fe tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:58.010493 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-27c5ce87-569d-4183-8c9b-b3b6ddc7f6fe tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:58.015844 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-27c5ce87-569d-4183-8c9b-b3b6ddc7f6fe tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:58.016580 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-27c5ce87-569d-4183-8c9b-b3b6ddc7f6fe tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:58.017206 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-27c5ce87-569d-4183-8c9b-b3b6ddc7f6fe tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:58.157938 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-af68d18c-118d-4e99-86c9-db7c2a1b5492 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:58.189222 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-af68d18c-118d-4e99-86c9-db7c2a1b5492 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/6dc592cb-94c7-4918-8103-023db604fd70" status: 200 len: 1506 microversion: 2.1 time: 0.558820 Aug 10 23:13:58.191987 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1869/3602] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:57 2022] GET /compute/v2.1/servers/6dc592cb-94c7-4918-8103-023db604fd70 => generated 1506 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:13:58.216016 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-0d5e3cd4-4c4a-4ffd-a771-adb7a3e7f89c tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:58.217454 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-0d5e3cd4-4c4a-4ffd-a771-adb7a3e7f89c tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 6dc592cb-94c7-4918-8103-023db604fd70] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:58.225881 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0d5e3cd4-4c4a-4ffd-a771-adb7a3e7f89c tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:58.227246 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0d5e3cd4-4c4a-4ffd-a771-adb7a3e7f89c tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:58.228726 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0d5e3cd4-4c4a-4ffd-a771-adb7a3e7f89c tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:58.230271 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0d5e3cd4-4c4a-4ffd-a771-adb7a3e7f89c tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:58.230923 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0d5e3cd4-4c4a-4ffd-a771-adb7a3e7f89c tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:58.231998 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0d5e3cd4-4c4a-4ffd-a771-adb7a3e7f89c tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:58.270867 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-0d5e3cd4-4c4a-4ffd-a771-adb7a3e7f89c tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 6dc592cb-94c7-4918-8103-023db604fd70] Going to try to terminate instance {{(pid=122633) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:13:58.338882 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:13:58.404905 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-0d5e3cd4-4c4a-4ffd-a771-adb7a3e7f89c tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "DELETE /compute/v2.1/servers/6dc592cb-94c7-4918-8103-023db604fd70" status: 204 len: 0 microversion: 2.1 time: 0.195022 Aug 10 23:13:58.410537 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1870/3603] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:13:58 2022] DELETE /compute/v2.1/servers/6dc592cb-94c7-4918-8103-023db604fd70 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 10 23:13:58.423837 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-cb080c4c-c105-47a4-8ae6-d546ceaa93f1 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:58.425232 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-cb080c4c-c105-47a4-8ae6-d546ceaa93f1 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 6dc592cb-94c7-4918-8103-023db604fd70] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:58.440439 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cb080c4c-c105-47a4-8ae6-d546ceaa93f1 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:58.441304 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cb080c4c-c105-47a4-8ae6-d546ceaa93f1 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:58.442130 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cb080c4c-c105-47a4-8ae6-d546ceaa93f1 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:58.443186 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cb080c4c-c105-47a4-8ae6-d546ceaa93f1 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:58.445544 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cb080c4c-c105-47a4-8ae6-d546ceaa93f1 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:58.446871 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cb080c4c-c105-47a4-8ae6-d546ceaa93f1 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:58.888821 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-cb080c4c-c105-47a4-8ae6-d546ceaa93f1 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:58.899181 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-cb080c4c-c105-47a4-8ae6-d546ceaa93f1 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/6dc592cb-94c7-4918-8103-023db604fd70" status: 200 len: 1512 microversion: 2.1 time: 0.486829 Aug 10 23:13:58.902143 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1871/3604] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:58 2022] GET /compute/v2.1/servers/6dc592cb-94c7-4918-8103-023db604fd70 => generated 1512 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:13:58.908842 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-51693629-edc0-41d9-a096-9042209443e5 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:58.909467 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-51693629-edc0-41d9-a096-9042209443e5 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: da69cf1f-ff76-4a68-afe9-fc491b31e8a9] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:58.927825 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-51693629-edc0-41d9-a096-9042209443e5 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:58.928322 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-51693629-edc0-41d9-a096-9042209443e5 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:58.928743 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-51693629-edc0-41d9-a096-9042209443e5 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:58.929449 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-51693629-edc0-41d9-a096-9042209443e5 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:58.929898 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-51693629-edc0-41d9-a096-9042209443e5 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:58.930318 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-51693629-edc0-41d9-a096-9042209443e5 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:59.066139 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-27c5ce87-569d-4183-8c9b-b3b6ddc7f6fe tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:59.079479 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-27c5ce87-569d-4183-8c9b-b3b6ddc7f6fe tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/3efc12c9-baf5-40e4-9d98-e72d28377db6" status: 200 len: 1314 microversion: 2.1 time: 1.107028 Aug 10 23:13:59.080342 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1734/3605] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:57 2022] GET /compute/v2.1/servers/3efc12c9-baf5-40e4-9d98-e72d28377db6 => generated 1314 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:13:59.105254 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-7175da4e-e382-45f1-bf9d-408b711cf7f5 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:59.105863 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-7175da4e-e382-45f1-bf9d-408b711cf7f5 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] [instance: f4dc6241-b173-4cbf-b76c-7da3fac7edcc] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:59.128876 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7175da4e-e382-45f1-bf9d-408b711cf7f5 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:59.129614 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7175da4e-e382-45f1-bf9d-408b711cf7f5 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:59.130297 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7175da4e-e382-45f1-bf9d-408b711cf7f5 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:59.136547 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7175da4e-e382-45f1-bf9d-408b711cf7f5 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:59.137475 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7175da4e-e382-45f1-bf9d-408b711cf7f5 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:59.138324 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7175da4e-e382-45f1-bf9d-408b711cf7f5 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:59.624446 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-7175da4e-e382-45f1-bf9d-408b711cf7f5 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5899b2ad9f1046caaf7c6073e408eeee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25abd63376614081a9d484f3c9ae950d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:59.632382 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-7175da4e-e382-45f1-bf9d-408b711cf7f5 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "GET /compute/v2.1/servers/f4dc6241-b173-4cbf-b76c-7da3fac7edcc" status: 200 len: 1695 microversion: 2.1 time: 0.535024 Aug 10 23:13:59.647320 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1735/3606] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:59 2022] GET /compute/v2.1/servers/f4dc6241-b173-4cbf-b76c-7da3fac7edcc => generated 1695 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:13:59.846177 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-51693629-edc0-41d9-a096-9042209443e5 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6160c7a42740efbe3613380933fa15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d90f8a58ad047fa8f347d6474e4d673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:13:59.857918 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-51693629-edc0-41d9-a096-9042209443e5 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "GET /compute/v2.1/servers/da69cf1f-ff76-4a68-afe9-fc491b31e8a9" status: 200 len: 1523 microversion: 2.1 time: 0.952860 Aug 10 23:13:59.861305 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1872/3607] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:58 2022] GET /compute/v2.1/servers/da69cf1f-ff76-4a68-afe9-fc491b31e8a9 => generated 1523 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:13:59.929957 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-ffd9468e-f1dc-4d61-b117-897aaaecddf9 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:13:59.933126 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-ffd9468e-f1dc-4d61-b117-897aaaecddf9 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 6dc592cb-94c7-4918-8103-023db604fd70] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:13:59.944126 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ffd9468e-f1dc-4d61-b117-897aaaecddf9 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:59.945440 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ffd9468e-f1dc-4d61-b117-897aaaecddf9 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:59.946624 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ffd9468e-f1dc-4d61-b117-897aaaecddf9 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:13:59.947605 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ffd9468e-f1dc-4d61-b117-897aaaecddf9 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:13:59.948438 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ffd9468e-f1dc-4d61-b117-897aaaecddf9 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:13:59.949197 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ffd9468e-f1dc-4d61-b117-897aaaecddf9 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:00.107900 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-df5ebc76-7215-4314-a24b-203c8bcad343 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:00.108747 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-df5ebc76-7215-4314-a24b-203c8bcad343 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: 3efc12c9-baf5-40e4-9d98-e72d28377db6] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:00.126418 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-df5ebc76-7215-4314-a24b-203c8bcad343 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:00.129470 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-df5ebc76-7215-4314-a24b-203c8bcad343 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:00.131307 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-df5ebc76-7215-4314-a24b-203c8bcad343 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:00.132604 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-df5ebc76-7215-4314-a24b-203c8bcad343 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:00.139136 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-df5ebc76-7215-4314-a24b-203c8bcad343 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:00.139892 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-df5ebc76-7215-4314-a24b-203c8bcad343 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:00.633947 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-df5ebc76-7215-4314-a24b-203c8bcad343 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:00.654820 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-df5ebc76-7215-4314-a24b-203c8bcad343 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/3efc12c9-baf5-40e4-9d98-e72d28377db6" status: 200 len: 1314 microversion: 2.1 time: 0.540851 Aug 10 23:14:00.654820 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1873/3608] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:00 2022] GET /compute/v2.1/servers/3efc12c9-baf5-40e4-9d98-e72d28377db6 => generated 1314 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:00.662542 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-bdf4abae-c005-42bc-ad4c-8f3887036424 req-efe66f5e-427b-41ce-9936-e80f92c3a059 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3efc12c9-baf5-40e4-9d98-e72d28377db6", "name": "network-vif-plugged", "status": "completed", "tag": "2917009e-0d0a-40bd-81cf-b2967c8c2f2e"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:14:00.698518 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-bdf4abae-c005-42bc-ad4c-8f3887036424 req-efe66f5e-427b-41ce-9936-e80f92c3a059 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:00.699044 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-bdf4abae-c005-42bc-ad4c-8f3887036424 req-efe66f5e-427b-41ce-9936-e80f92c3a059 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:00.699515 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-bdf4abae-c005-42bc-ad4c-8f3887036424 req-efe66f5e-427b-41ce-9936-e80f92c3a059 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:00.735380 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-ffd9468e-f1dc-4d61-b117-897aaaecddf9 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:00.748120 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-ffd9468e-f1dc-4d61-b117-897aaaecddf9 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/6dc592cb-94c7-4918-8103-023db604fd70" status: 200 len: 1512 microversion: 2.1 time: 0.826461 Aug 10 23:14:00.751787 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1736/3609] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:13:59 2022] GET /compute/v2.1/servers/6dc592cb-94c7-4918-8103-023db604fd70 => generated 1512 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:14:00.767222 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-bdf4abae-c005-42bc-ad4c-8f3887036424 req-efe66f5e-427b-41ce-9936-e80f92c3a059 service nova] Creating event network-vif-plugged:2917009e-0d0a-40bd-81cf-b2967c8c2f2e for instance 3efc12c9-baf5-40e4-9d98-e72d28377db6 on n-h1-850468-14 Aug 10 23:14:00.770195 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-55b07f4b-c4d1-49ff-8188-711724946730 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:00.772776 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-55b07f4b-c4d1-49ff-8188-711724946730 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] [instance: f4dc6241-b173-4cbf-b76c-7da3fac7edcc] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:00.783074 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-bdf4abae-c005-42bc-ad4c-8f3887036424 req-efe66f5e-427b-41ce-9936-e80f92c3a059 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137994 Aug 10 23:14:00.784048 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1874/3610] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:14:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:14:00.793298 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-55b07f4b-c4d1-49ff-8188-711724946730 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:00.793681 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-55b07f4b-c4d1-49ff-8188-711724946730 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:00.795440 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-55b07f4b-c4d1-49ff-8188-711724946730 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:00.796704 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-55b07f4b-c4d1-49ff-8188-711724946730 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:00.798003 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-55b07f4b-c4d1-49ff-8188-711724946730 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:00.799052 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-55b07f4b-c4d1-49ff-8188-711724946730 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:00.889725 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-4246c047-fea7-420d-8d55-52c64d7e0b3b tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:00.890472 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-4246c047-fea7-420d-8d55-52c64d7e0b3b tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: da69cf1f-ff76-4a68-afe9-fc491b31e8a9] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:00.908576 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4246c047-fea7-420d-8d55-52c64d7e0b3b tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:00.912708 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4246c047-fea7-420d-8d55-52c64d7e0b3b tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:00.913229 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4246c047-fea7-420d-8d55-52c64d7e0b3b tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:00.913995 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4246c047-fea7-420d-8d55-52c64d7e0b3b tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:00.914493 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4246c047-fea7-420d-8d55-52c64d7e0b3b tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:00.923349 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4246c047-fea7-420d-8d55-52c64d7e0b3b tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:01.481162 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-4246c047-fea7-420d-8d55-52c64d7e0b3b tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6160c7a42740efbe3613380933fa15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d90f8a58ad047fa8f347d6474e4d673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:01.490673 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-4246c047-fea7-420d-8d55-52c64d7e0b3b tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "GET /compute/v2.1/servers/da69cf1f-ff76-4a68-afe9-fc491b31e8a9" status: 200 len: 1523 microversion: 2.1 time: 0.607230 Aug 10 23:14:01.496072 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1875/3611] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:00 2022] GET /compute/v2.1/servers/da69cf1f-ff76-4a68-afe9-fc491b31e8a9 => generated 1523 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:14:01.501839 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-55b07f4b-c4d1-49ff-8188-711724946730 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5899b2ad9f1046caaf7c6073e408eeee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25abd63376614081a9d484f3c9ae950d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:01.523504 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-55b07f4b-c4d1-49ff-8188-711724946730 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "GET /compute/v2.1/servers/f4dc6241-b173-4cbf-b76c-7da3fac7edcc" status: 200 len: 1695 microversion: 2.1 time: 0.768684 Aug 10 23:14:01.524236 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1737/3612] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:00 2022] GET /compute/v2.1/servers/f4dc6241-b173-4cbf-b76c-7da3fac7edcc => generated 1695 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:01.669775 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-7b0d4ce1-c08c-4062-bb90-5ab1101c56a3 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:01.670766 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-7b0d4ce1-c08c-4062-bb90-5ab1101c56a3 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: 3efc12c9-baf5-40e4-9d98-e72d28377db6] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:01.688678 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7b0d4ce1-c08c-4062-bb90-5ab1101c56a3 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:01.689553 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7b0d4ce1-c08c-4062-bb90-5ab1101c56a3 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:01.690217 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7b0d4ce1-c08c-4062-bb90-5ab1101c56a3 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:01.691176 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7b0d4ce1-c08c-4062-bb90-5ab1101c56a3 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:01.691839 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7b0d4ce1-c08c-4062-bb90-5ab1101c56a3 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:01.692471 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7b0d4ce1-c08c-4062-bb90-5ab1101c56a3 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:01.775753 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-29fa0fb4-3669-4240-9548-eff36c3d4b98 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:01.777537 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-29fa0fb4-3669-4240-9548-eff36c3d4b98 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 6dc592cb-94c7-4918-8103-023db604fd70] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:01.815525 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-29fa0fb4-3669-4240-9548-eff36c3d4b98 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:01.819207 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-29fa0fb4-3669-4240-9548-eff36c3d4b98 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:01.822426 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-29fa0fb4-3669-4240-9548-eff36c3d4b98 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:01.824723 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-29fa0fb4-3669-4240-9548-eff36c3d4b98 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:01.826916 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-29fa0fb4-3669-4240-9548-eff36c3d4b98 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:01.827628 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-29fa0fb4-3669-4240-9548-eff36c3d4b98 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:02.924852 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-7b0d4ce1-c08c-4062-bb90-5ab1101c56a3 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:02.952509 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-7b0d4ce1-c08c-4062-bb90-5ab1101c56a3 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/3efc12c9-baf5-40e4-9d98-e72d28377db6" status: 200 len: 1314 microversion: 2.1 time: 1.286614 Aug 10 23:14:02.957406 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1876/3613] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:01 2022] GET /compute/v2.1/servers/3efc12c9-baf5-40e4-9d98-e72d28377db6 => generated 1314 bytes in 1292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:02.979776 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-919b7e93-7c5d-4298-b10e-fd7759283d91 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:02.980721 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-919b7e93-7c5d-4298-b10e-fd7759283d91 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: da69cf1f-ff76-4a68-afe9-fc491b31e8a9] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:02.989687 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:14:03.002496 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-919b7e93-7c5d-4298-b10e-fd7759283d91 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:03.003089 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-919b7e93-7c5d-4298-b10e-fd7759283d91 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:03.006361 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-919b7e93-7c5d-4298-b10e-fd7759283d91 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:03.009043 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-919b7e93-7c5d-4298-b10e-fd7759283d91 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:03.012166 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-919b7e93-7c5d-4298-b10e-fd7759283d91 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:03.013044 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-919b7e93-7c5d-4298-b10e-fd7759283d91 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:03.041037 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-29fa0fb4-3669-4240-9548-eff36c3d4b98 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:03.057638 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-29fa0fb4-3669-4240-9548-eff36c3d4b98 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/6dc592cb-94c7-4918-8103-023db604fd70" status: 200 len: 1512 microversion: 2.1 time: 1.288034 Aug 10 23:14:03.062151 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1738/3614] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:01 2022] GET /compute/v2.1/servers/6dc592cb-94c7-4918-8103-023db604fd70 => generated 1512 bytes in 1291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:03.079591 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c1610404-2efd-4e51-b33a-2b51827ac94d tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:03.082136 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-c1610404-2efd-4e51-b33a-2b51827ac94d tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] [instance: f4dc6241-b173-4cbf-b76c-7da3fac7edcc] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:03.102864 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c1610404-2efd-4e51-b33a-2b51827ac94d tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:03.103367 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c1610404-2efd-4e51-b33a-2b51827ac94d tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:03.103810 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c1610404-2efd-4e51-b33a-2b51827ac94d tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:03.120086 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c1610404-2efd-4e51-b33a-2b51827ac94d tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:03.121077 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c1610404-2efd-4e51-b33a-2b51827ac94d tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:03.121586 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c1610404-2efd-4e51-b33a-2b51827ac94d tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:03.790668 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-919b7e93-7c5d-4298-b10e-fd7759283d91 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6160c7a42740efbe3613380933fa15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d90f8a58ad047fa8f347d6474e4d673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:03.825024 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-919b7e93-7c5d-4298-b10e-fd7759283d91 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "GET /compute/v2.1/servers/da69cf1f-ff76-4a68-afe9-fc491b31e8a9" status: 200 len: 1523 microversion: 2.1 time: 0.862202 Aug 10 23:14:03.828352 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1877/3615] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:02 2022] GET /compute/v2.1/servers/da69cf1f-ff76-4a68-afe9-fc491b31e8a9 => generated 1523 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:03.846864 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-6c348f27-3e07-4c77-a7a2-d9e954551501 req-4cdf9804-d949-429e-9974-779659b85297 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6dc592cb-94c7-4918-8103-023db604fd70", "name": "network-vif-deleted", "tag": "2b99192d-6b32-4802-864a-09a3ba0a3010"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:14:03.876876 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-6c348f27-3e07-4c77-a7a2-d9e954551501 req-4cdf9804-d949-429e-9974-779659b85297 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:03.879533 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-6c348f27-3e07-4c77-a7a2-d9e954551501 req-4cdf9804-d949-429e-9974-779659b85297 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:03.880279 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-6c348f27-3e07-4c77-a7a2-d9e954551501 req-4cdf9804-d949-429e-9974-779659b85297 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:03.928773 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-6c348f27-3e07-4c77-a7a2-d9e954551501 req-4cdf9804-d949-429e-9974-779659b85297 service nova] Creating event network-vif-deleted:2b99192d-6b32-4802-864a-09a3ba0a3010 for instance 6dc592cb-94c7-4918-8103-023db604fd70 on n-h1-850468-14 Aug 10 23:14:03.952350 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-6c348f27-3e07-4c77-a7a2-d9e954551501 req-4cdf9804-d949-429e-9974-779659b85297 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119161 Aug 10 23:14:03.952979 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1878/3616] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:14:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:14:03.979202 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-0eb65bc9-c05d-48fd-b871-1bfb69496aad tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:03.980743 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-0eb65bc9-c05d-48fd-b871-1bfb69496aad tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: 3efc12c9-baf5-40e4-9d98-e72d28377db6] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:04.012940 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-c1610404-2efd-4e51-b33a-2b51827ac94d tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5899b2ad9f1046caaf7c6073e408eeee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25abd63376614081a9d484f3c9ae950d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:04.026543 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0eb65bc9-c05d-48fd-b871-1bfb69496aad tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:04.031403 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-c1610404-2efd-4e51-b33a-2b51827ac94d tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "GET /compute/v2.1/servers/f4dc6241-b173-4cbf-b76c-7da3fac7edcc" status: 200 len: 1694 microversion: 2.1 time: 0.962907 Aug 10 23:14:04.032502 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1739/3617] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:03 2022] GET /compute/v2.1/servers/f4dc6241-b173-4cbf-b76c-7da3fac7edcc => generated 1694 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:04.033432 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0eb65bc9-c05d-48fd-b871-1bfb69496aad tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:04.036985 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0eb65bc9-c05d-48fd-b871-1bfb69496aad tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:04.042225 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0eb65bc9-c05d-48fd-b871-1bfb69496aad tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:04.044943 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0eb65bc9-c05d-48fd-b871-1bfb69496aad tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:04.046560 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0eb65bc9-c05d-48fd-b871-1bfb69496aad tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:04.082509 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-63a206de-b4a5-440b-9eb3-cb2df6975aff tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:04.083755 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-63a206de-b4a5-440b-9eb3-cb2df6975aff tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 6dc592cb-94c7-4918-8103-023db604fd70] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:04.104109 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-63a206de-b4a5-440b-9eb3-cb2df6975aff tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:04.106013 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-63a206de-b4a5-440b-9eb3-cb2df6975aff tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:04.106613 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-63a206de-b4a5-440b-9eb3-cb2df6975aff tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:04.108139 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-63a206de-b4a5-440b-9eb3-cb2df6975aff tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:04.110171 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-63a206de-b4a5-440b-9eb3-cb2df6975aff tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:04.113701 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-63a206de-b4a5-440b-9eb3-cb2df6975aff tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:04.213188 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-63a206de-b4a5-440b-9eb3-cb2df6975aff tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:04.213693 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-63a206de-b4a5-440b-9eb3-cb2df6975aff tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:04.214135 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-63a206de-b4a5-440b-9eb3-cb2df6975aff tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:04.216140 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.objects.instance [None req-63a206de-b4a5-440b-9eb3-cb2df6975aff tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lazy-loading 'fault' on Instance uuid 6dc592cb-94c7-4918-8103-023db604fd70 {{(pid=122632) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:14:04.555395 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-63a206de-b4a5-440b-9eb3-cb2df6975aff tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:04.577271 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-63a206de-b4a5-440b-9eb3-cb2df6975aff tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/6dc592cb-94c7-4918-8103-023db604fd70" status: 200 len: 1307 microversion: 2.1 time: 0.488873 Aug 10 23:14:04.578911 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1740/3618] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:04 2022] GET /compute/v2.1/servers/6dc592cb-94c7-4918-8103-023db604fd70 => generated 1307 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:04.657441 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-0eb65bc9-c05d-48fd-b871-1bfb69496aad tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:04.671103 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-0eb65bc9-c05d-48fd-b871-1bfb69496aad tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/3efc12c9-baf5-40e4-9d98-e72d28377db6" status: 200 len: 1314 microversion: 2.1 time: 0.700273 Aug 10 23:14:04.675268 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1879/3619] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:03 2022] GET /compute/v2.1/servers/3efc12c9-baf5-40e4-9d98-e72d28377db6 => generated 1314 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:04.849781 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-d12c4e0c-311f-4021-a478-ff4458458081 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:04.851061 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-d12c4e0c-311f-4021-a478-ff4458458081 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: da69cf1f-ff76-4a68-afe9-fc491b31e8a9] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:04.861016 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d12c4e0c-311f-4021-a478-ff4458458081 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:04.864479 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d12c4e0c-311f-4021-a478-ff4458458081 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:04.865108 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d12c4e0c-311f-4021-a478-ff4458458081 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:04.865999 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d12c4e0c-311f-4021-a478-ff4458458081 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:04.867335 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d12c4e0c-311f-4021-a478-ff4458458081 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:04.872556 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d12c4e0c-311f-4021-a478-ff4458458081 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:05.053960 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-5e2668ea-a1ce-4376-a322-718bd70f11a1 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:05.054628 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-5e2668ea-a1ce-4376-a322-718bd70f11a1 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] [instance: f4dc6241-b173-4cbf-b76c-7da3fac7edcc] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:05.072168 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5e2668ea-a1ce-4376-a322-718bd70f11a1 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:05.072839 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5e2668ea-a1ce-4376-a322-718bd70f11a1 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:05.077472 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5e2668ea-a1ce-4376-a322-718bd70f11a1 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:05.078344 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5e2668ea-a1ce-4376-a322-718bd70f11a1 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:05.082055 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5e2668ea-a1ce-4376-a322-718bd70f11a1 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:05.082558 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5e2668ea-a1ce-4376-a322-718bd70f11a1 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:05.563768 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-5e2668ea-a1ce-4376-a322-718bd70f11a1 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5899b2ad9f1046caaf7c6073e408eeee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25abd63376614081a9d484f3c9ae950d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:05.577266 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-5e2668ea-a1ce-4376-a322-718bd70f11a1 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "GET /compute/v2.1/servers/f4dc6241-b173-4cbf-b76c-7da3fac7edcc" status: 200 len: 1694 microversion: 2.1 time: 0.527245 Aug 10 23:14:05.580396 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1880/3620] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:05 2022] GET /compute/v2.1/servers/f4dc6241-b173-4cbf-b76c-7da3fac7edcc => generated 1694 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:05.604498 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-7da4ab4b-4443-4bf9-92bd-70ff1db66bd4 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:05.605125 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-7da4ab4b-4443-4bf9-92bd-70ff1db66bd4 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 6dc592cb-94c7-4918-8103-023db604fd70] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:05.616721 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7da4ab4b-4443-4bf9-92bd-70ff1db66bd4 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:05.619485 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7da4ab4b-4443-4bf9-92bd-70ff1db66bd4 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:05.625468 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7da4ab4b-4443-4bf9-92bd-70ff1db66bd4 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:05.626466 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7da4ab4b-4443-4bf9-92bd-70ff1db66bd4 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:05.627138 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7da4ab4b-4443-4bf9-92bd-70ff1db66bd4 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:05.627717 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7da4ab4b-4443-4bf9-92bd-70ff1db66bd4 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:05.663144 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-7da4ab4b-4443-4bf9-92bd-70ff1db66bd4 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] HTTP exception thrown: Instance 6dc592cb-94c7-4918-8103-023db604fd70 could not be found. Aug 10 23:14:05.672051 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-7da4ab4b-4443-4bf9-92bd-70ff1db66bd4 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Request method failure captured: Aug 10 23:14:05.672051 n-d-850468-14 devstack@n-api.service[122633]: request: GET /compute/v2.1/servers/6dc592cb-94c7-4918-8103-023db604fd70 HTTP/1.1 Aug 10 23:14:05.672051 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:14:05.672051 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:14:05.672051 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:14:05.672051 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:14:05.672051 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:14:05.672051 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:14:05.672051 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:14:05.672051 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:14:05.672051 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9DuIKrfOsS8tKST0PsIPrvuNPfsVISfOPvUoe9ddkVcTJKj7rDjd3OuH9u-DTT1aypj1AUoUKtajD98eDOUOHSpPisBSdRlSCov30lHf1uZq-XZLyBIVg5kAG8-SuXk2s1TL7EnRcjjMARSkm95dZDnXaBXRT3M4f8UoMDwqu7xK7gQ Aug 10 23:14:05.672051 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:14:05.672051 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:14:05.672051 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:14:05.672051 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:14:05.672051 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:14:05.672051 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:14:05.672051 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: d11bbb3e87f4463787da56ab19108822 Aug 10 23:14:05.672051 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-ServersNegativeTestJSON-1216728002 Aug 10 23:14:05.672051 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:14:05.672051 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:14:05.672051 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d11bbb3e87f4463787da56ab19108822"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d11bbb3e87f4463787da56ab19108822"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d11bbb3e87f4463787da56ab19108822"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d11bbb3e87f4463787da56ab19108822", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:14:05.672051 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-ServersNegativeTestJSON-1216728002 Aug 10 23:14:05.672051 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: d11bbb3e87f4463787da56ab19108822 Aug 10 23:14:05.672051 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1216728002 Aug 10 23:14:05.672051 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-ServersNegativeTestJSON-1216728002-project Aug 10 23:14:05.672051 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:14:05.672051 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:14:05.672051 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: f284ec2a4bf546b58c1c1adaf880e1fb Aug 10 23:14:05.672051 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-ServersNegativeTestJSON-1216728002-project Aug 10 23:14:05.672051 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:14:05.672051 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance 6dc592cb-94c7-4918-8103-023db604fd70 could not be found. Aug 10 23:14:05.672051 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': '6dc592cb-94c7-4918-8103-023db604fd70'} Aug 10 23:14:05.672051 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:14:05.672051 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:14:05.672051 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:14:05.672051 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:14:05.672051 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:14:05.672051 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:14:05.672051 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:14:05.672051 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:14:05.672051 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:14:05.672051 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:14:05.672051 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6dc592cb-94c7-4918-8103-023db604fd70 could not be found. Aug 10 23:14:05.672051 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:14:05.672051 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:14:05.672051 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:14:05.672051 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:14:05.672051 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:14:05.672051 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:14:05.672051 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:14:05.672051 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:14:05.672051 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:14:05.672051 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:14:05.672051 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:14:05.672051 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:14:05.672051 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:14:05.672051 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:14:05.672051 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:14:05.672051 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:14:05.672051 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6dc592cb-94c7-4918-8103-023db604fd70 could not be found. Aug 10 23:14:05.672051 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:14:05.672051 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:14:05.672051 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:14:05.676776 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:14:05.676776 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:14:05.676776 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:14:05.676776 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:14:05.676776 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:14:05.676776 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6dc592cb-94c7-4918-8103-023db604fd70 could not be found. Aug 10 23:14:05.676776 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:14:05.678218 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-7da4ab4b-4443-4bf9-92bd-70ff1db66bd4 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Returning 404 to user: Instance 6dc592cb-94c7-4918-8103-023db604fd70 could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:14:05.679361 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-7da4ab4b-4443-4bf9-92bd-70ff1db66bd4 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/6dc592cb-94c7-4918-8103-023db604fd70" status: 404 len: 111 microversion: 2.1 time: 0.079700 Aug 10 23:14:05.681510 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1881/3621] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:05 2022] GET /compute/v2.1/servers/6dc592cb-94c7-4918-8103-023db604fd70 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:14:05.698901 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-afe4a746-ac0e-46a5-80f8-440160880fa3 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:05.712594 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-afe4a746-ac0e-46a5-80f8-440160880fa3 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:05.725111 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-afe4a746-ac0e-46a5-80f8-440160880fa3 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:05.734422 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-afe4a746-ac0e-46a5-80f8-440160880fa3 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:05.735283 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-afe4a746-ac0e-46a5-80f8-440160880fa3 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:05.736077 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-afe4a746-ac0e-46a5-80f8-440160880fa3 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:05.736566 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-afe4a746-ac0e-46a5-80f8-440160880fa3 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:05.737019 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-afe4a746-ac0e-46a5-80f8-440160880fa3 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:06.172299 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-afe4a746-ac0e-46a5-80f8-440160880fa3 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:06.183610 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-d12c4e0c-311f-4021-a478-ff4458458081 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6160c7a42740efbe3613380933fa15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d90f8a58ad047fa8f347d6474e4d673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:06.194403 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-afe4a746-ac0e-46a5-80f8-440160880fa3 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b" status: 200 len: 1506 microversion: 2.1 time: 0.507102 Aug 10 23:14:06.196676 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-d12c4e0c-311f-4021-a478-ff4458458081 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "GET /compute/v2.1/servers/da69cf1f-ff76-4a68-afe9-fc491b31e8a9" status: 200 len: 1523 microversion: 2.1 time: 1.351131 Aug 10 23:14:06.197861 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1741/3622] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:04 2022] GET /compute/v2.1/servers/da69cf1f-ff76-4a68-afe9-fc491b31e8a9 => generated 1523 bytes in 1353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:06.204317 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1882/3623] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:05 2022] GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b => generated 1506 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:14:06.207774 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-eb61fad3-1784-4092-81f4-d15436d1001a tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:06.208650 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-eb61fad3-1784-4092-81f4-d15436d1001a tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: 3efc12c9-baf5-40e4-9d98-e72d28377db6] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:06.215327 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_api:SELECT=77,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:14:06.217980 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-eb61fad3-1784-4092-81f4-d15436d1001a tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:06.220121 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-eb61fad3-1784-4092-81f4-d15436d1001a tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:06.223090 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-eb61fad3-1784-4092-81f4-d15436d1001a tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:06.224297 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-eb61fad3-1784-4092-81f4-d15436d1001a tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:06.225003 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-eb61fad3-1784-4092-81f4-d15436d1001a tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:06.227116 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-eb61fad3-1784-4092-81f4-d15436d1001a tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:06.448848 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-9f7ec9be-0a28-4816-98e9-cec19332c343 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452", "networks": [{"uuid": "91d0258a-9486-4479-91e9-a6d9339a2e0a"}]}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:14:06.453154 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-9f7ec9be-0a28-4816-98e9-cec19332c343 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Request method failure captured: Aug 10 23:14:06.453154 n-d-850468-14 devstack@n-api.service[122633]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 10 23:14:06.453154 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:14:06.453154 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:14:06.453154 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:14:06.453154 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 163 Aug 10 23:14:06.453154 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:14:06.453154 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:14:06.453154 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:14:06.453154 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:14:06.453154 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9DuIKrfOsS8tKST0PsIPrvuNPfsVISfOPvUoe9ddkVcTJKj7rDjd3OuH9u-DTT1aypj1AUoUKtajD98eDOUOHSpPisBSdRlSCov30lHf1uZq-XZLyBIVg5kAG8-SuXk2s1TL7EnRcjjMARSkm95dZDnXaBXRT3M4f8UoMDwqu7xK7gQ Aug 10 23:14:06.453154 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:14:06.453154 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:14:06.453154 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:14:06.453154 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:14:06.453154 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:14:06.453154 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:14:06.453154 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: d11bbb3e87f4463787da56ab19108822 Aug 10 23:14:06.453154 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-ServersNegativeTestJSON-1216728002 Aug 10 23:14:06.453154 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:14:06.453154 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:14:06.453154 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d11bbb3e87f4463787da56ab19108822"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d11bbb3e87f4463787da56ab19108822"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d11bbb3e87f4463787da56ab19108822"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d11bbb3e87f4463787da56ab19108822", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:14:06.453154 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-ServersNegativeTestJSON-1216728002 Aug 10 23:14:06.453154 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: d11bbb3e87f4463787da56ab19108822 Aug 10 23:14:06.453154 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1216728002 Aug 10 23:14:06.453154 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-ServersNegativeTestJSON-1216728002-project Aug 10 23:14:06.453154 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:14:06.453154 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:14:06.453154 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: f284ec2a4bf546b58c1c1adaf880e1fb Aug 10 23:14:06.453154 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-ServersNegativeTestJSON-1216728002-project Aug 10 23:14:06.453154 n-d-850468-14 devstack@n-api.service[122633]: Aug 10 23:14:06.453154 n-d-850468-14 devstack@n-api.service[122633]: {"server": {"name": 12345, "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452", "networks": [{"uuid": "91d0258a-9486-4479-91e9-a6d9339a2e0a"}]}} Aug 10 23:14:06.453154 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:14:06.453154 n-d-850468-14 devstack@n-api.service[122633]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Aug 10 23:14:06.453154 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'body': {'server': {'name': 12345, 'imageRef': '78ad8905-f66f-4733-8be9-2b260f1fabed', 'flavorRef': '452', 'networks': [{'uuid': '91d0258a-9486-4479-91e9-a6d9339a2e0a'}]}}} Aug 10 23:14:06.453154 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:14:06.453154 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:14:06.453154 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 10 23:14:06.453154 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 10 23:14:06.453154 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 10 23:14:06.453154 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise error Aug 10 23:14:06.453154 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' Aug 10 23:14:06.453154 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:14:06.453154 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: Aug 10 23:14:06.453154 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 10 23:14:06.453154 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:14:06.453154 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 10 23:14:06.453154 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi 12345 Aug 10 23:14:06.453154 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:14:06.453154 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:14:06.453154 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:14:06.453154 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:14:06.453154 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:14:06.453154 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:14:06.453154 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:14:06.453154 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:14:06.453154 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:14:06.453154 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:14:06.453154 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 23:14:06.453154 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 23:14:06.453154 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 10 23:14:06.453154 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 10 23:14:06.453154 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 10 23:14:06.453154 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 10 23:14:06.453154 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 10 23:14:06.457576 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 10 23:14:06.457576 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Aug 10 23:14:06.457576 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:14:06.457576 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:14:06.457576 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:14:06.457576 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:14:06.457576 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:14:06.457576 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:14:06.457576 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 10 23:14:06.457576 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 10 23:14:06.457576 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Aug 10 23:14:06.457576 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:14:06.468674 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-9f7ec9be-0a28-4816-98e9-cec19332c343 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:14:06.470456 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-9f7ec9be-0a28-4816-98e9-cec19332c343 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.026273 Aug 10 23:14:06.471604 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1883/3624] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 23:14:06 2022] POST /compute/v2.1/servers => generated 127 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 10 23:14:06.483039 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-3a19c1dd-8aa5-4621-8cde-15a49cc8f3bd tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:06.484019 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-3a19c1dd-8aa5-4621-8cde-15a49cc8f3bd tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:06.491752 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3a19c1dd-8aa5-4621-8cde-15a49cc8f3bd tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:06.492559 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3a19c1dd-8aa5-4621-8cde-15a49cc8f3bd tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:06.493785 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3a19c1dd-8aa5-4621-8cde-15a49cc8f3bd tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:06.494909 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3a19c1dd-8aa5-4621-8cde-15a49cc8f3bd tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:06.495564 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3a19c1dd-8aa5-4621-8cde-15a49cc8f3bd tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:06.496185 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3a19c1dd-8aa5-4621-8cde-15a49cc8f3bd tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:06.932752 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-3a19c1dd-8aa5-4621-8cde-15a49cc8f3bd tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:06.949181 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-3a19c1dd-8aa5-4621-8cde-15a49cc8f3bd tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b" status: 200 len: 1506 microversion: 2.1 time: 0.471377 Aug 10 23:14:06.950101 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1884/3625] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:06 2022] GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b => generated 1506 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:06.964264 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-ef7c951f-6276-427e-bc2b-c7b5fb951a49 req-81cd832e-e3c1-47dc-abb7-70a9ba536ab9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4dc6241-b173-4cbf-b76c-7da3fac7edcc", "name": "network-vif-unplugged", "status": "completed", "tag": "d3cf5f02-4cda-4d1b-9314-92bc05402960"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:14:06.986546 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-ef7c951f-6276-427e-bc2b-c7b5fb951a49 req-81cd832e-e3c1-47dc-abb7-70a9ba536ab9 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:06.987082 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-ef7c951f-6276-427e-bc2b-c7b5fb951a49 req-81cd832e-e3c1-47dc-abb7-70a9ba536ab9 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:06.987527 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-ef7c951f-6276-427e-bc2b-c7b5fb951a49 req-81cd832e-e3c1-47dc-abb7-70a9ba536ab9 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:07.014145 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-ef7c951f-6276-427e-bc2b-c7b5fb951a49 req-81cd832e-e3c1-47dc-abb7-70a9ba536ab9 service nova] Creating event network-vif-unplugged:d3cf5f02-4cda-4d1b-9314-92bc05402960 for instance f4dc6241-b173-4cbf-b76c-7da3fac7edcc on n-h2-850468-14 Aug 10 23:14:07.020470 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [req-ef7c951f-6276-427e-bc2b-c7b5fb951a49 req-81cd832e-e3c1-47dc-abb7-70a9ba536ab9 service nova] Instance f4dc6241-b173-4cbf-b76c-7da3fac7edcc is migrating within the same cell, copying events to all relevant hosts: {'n-h1-850468-14', 'n-h2-850468-14'} {{(pid=122633) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5901}} Aug 10 23:14:07.045939 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-ef7c951f-6276-427e-bc2b-c7b5fb951a49 req-81cd832e-e3c1-47dc-abb7-70a9ba536ab9 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.090456 Aug 10 23:14:07.047122 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1885/3626] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:14:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:14:07.055893 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-57c51fc5-c772-4b7c-907b-e8bec802dc09 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:07.057282 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-57c51fc5-c772-4b7c-907b-e8bec802dc09 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] [instance: f4dc6241-b173-4cbf-b76c-7da3fac7edcc] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:07.065836 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-57c51fc5-c772-4b7c-907b-e8bec802dc09 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:07.066745 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-57c51fc5-c772-4b7c-907b-e8bec802dc09 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:07.067395 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-57c51fc5-c772-4b7c-907b-e8bec802dc09 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:07.068320 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-57c51fc5-c772-4b7c-907b-e8bec802dc09 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:07.068935 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-57c51fc5-c772-4b7c-907b-e8bec802dc09 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:07.069524 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-57c51fc5-c772-4b7c-907b-e8bec802dc09 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:07.453312 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-57c51fc5-c772-4b7c-907b-e8bec802dc09 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5899b2ad9f1046caaf7c6073e408eeee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25abd63376614081a9d484f3c9ae950d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:07.471384 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-57c51fc5-c772-4b7c-907b-e8bec802dc09 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "GET /compute/v2.1/servers/f4dc6241-b173-4cbf-b76c-7da3fac7edcc" status: 200 len: 1694 microversion: 2.1 time: 0.422162 Aug 10 23:14:07.472723 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1886/3627] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:07 2022] GET /compute/v2.1/servers/f4dc6241-b173-4cbf-b76c-7da3fac7edcc => generated 1694 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:07.483749 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-b95b44e1-82ea-4107-8683-4fbc01e22b9a tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:07.484873 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-b95b44e1-82ea-4107-8683-4fbc01e22b9a tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:07.497890 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b95b44e1-82ea-4107-8683-4fbc01e22b9a tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:07.498974 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b95b44e1-82ea-4107-8683-4fbc01e22b9a tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:07.500020 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b95b44e1-82ea-4107-8683-4fbc01e22b9a tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:07.502300 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b95b44e1-82ea-4107-8683-4fbc01e22b9a tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:07.503126 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b95b44e1-82ea-4107-8683-4fbc01e22b9a tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:07.503771 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b95b44e1-82ea-4107-8683-4fbc01e22b9a tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:07.575731 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-eb61fad3-1784-4092-81f4-d15436d1001a tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:07.594349 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-eb61fad3-1784-4092-81f4-d15436d1001a tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/3efc12c9-baf5-40e4-9d98-e72d28377db6" status: 200 len: 1501 microversion: 2.1 time: 1.395156 Aug 10 23:14:07.601492 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1742/3628] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:06 2022] GET /compute/v2.1/servers/3efc12c9-baf5-40e4-9d98-e72d28377db6 => generated 1501 bytes in 1403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:07.612408 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-e8b77a4e-c009-4cda-a9e2-ec9e8847362a tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:07.615555 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-e8b77a4e-c009-4cda-a9e2-ec9e8847362a tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: da69cf1f-ff76-4a68-afe9-fc491b31e8a9] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:07.630169 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e8b77a4e-c009-4cda-a9e2-ec9e8847362a tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:07.630696 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e8b77a4e-c009-4cda-a9e2-ec9e8847362a tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:07.636547 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e8b77a4e-c009-4cda-a9e2-ec9e8847362a tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:07.637323 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e8b77a4e-c009-4cda-a9e2-ec9e8847362a tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:07.637984 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e8b77a4e-c009-4cda-a9e2-ec9e8847362a tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:07.638466 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e8b77a4e-c009-4cda-a9e2-ec9e8847362a tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:08.138242 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-b95b44e1-82ea-4107-8683-4fbc01e22b9a tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:08.146969 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-b95b44e1-82ea-4107-8683-4fbc01e22b9a tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b" status: 200 len: 1506 microversion: 2.1 time: 0.672553 Aug 10 23:14:08.147568 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1887/3629] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:07 2022] GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b => generated 1506 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:08.184585 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-f2cab6f6-9f51-4565-8470-c5593ea380bc tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:14:08.206298 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f2cab6f6-9f51-4565-8470-c5593ea380bc tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:08.207156 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f2cab6f6-9f51-4565-8470-c5593ea380bc tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:08.209315 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f2cab6f6-9f51-4565-8470-c5593ea380bc tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:08.264498 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-f2cab6f6-9f51-4565-8470-c5593ea380bc tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: 3efc12c9-baf5-40e4-9d98-e72d28377db6] Going to try to stop instance {{(pid=122633) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 10 23:14:08.338967 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-f2cab6f6-9f51-4565-8470-c5593ea380bc tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "POST /compute/v2.1/servers/3efc12c9-baf5-40e4-9d98-e72d28377db6/action" status: 202 len: 0 microversion: 2.1 time: 0.160013 Aug 10 23:14:08.340587 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1888/3630] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:14:08 2022] POST /compute/v2.1/servers/3efc12c9-baf5-40e4-9d98-e72d28377db6/action => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:14:08.357802 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-1cb9f1d5-55ec-4da3-8830-cb8b41139081 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:08.362451 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-1cb9f1d5-55ec-4da3-8830-cb8b41139081 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: 3efc12c9-baf5-40e4-9d98-e72d28377db6] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:08.367462 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-e8b77a4e-c009-4cda-a9e2-ec9e8847362a tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6160c7a42740efbe3613380933fa15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d90f8a58ad047fa8f347d6474e4d673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:08.392320 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1cb9f1d5-55ec-4da3-8830-cb8b41139081 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:08.395711 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1cb9f1d5-55ec-4da3-8830-cb8b41139081 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:08.396332 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1cb9f1d5-55ec-4da3-8830-cb8b41139081 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:08.398172 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1cb9f1d5-55ec-4da3-8830-cb8b41139081 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:08.398856 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1cb9f1d5-55ec-4da3-8830-cb8b41139081 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:08.401613 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1cb9f1d5-55ec-4da3-8830-cb8b41139081 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:08.402921 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-e8b77a4e-c009-4cda-a9e2-ec9e8847362a tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "GET /compute/v2.1/servers/da69cf1f-ff76-4a68-afe9-fc491b31e8a9" status: 200 len: 1505 microversion: 2.1 time: 0.798414 Aug 10 23:14:08.420034 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1743/3631] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:07 2022] GET /compute/v2.1/servers/da69cf1f-ff76-4a68-afe9-fc491b31e8a9 => generated 1505 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:08.495075 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-8ccf0469-68c9-4b0e-b956-8311c994aa96 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:08.496102 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-8ccf0469-68c9-4b0e-b956-8311c994aa96 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] [instance: f4dc6241-b173-4cbf-b76c-7da3fac7edcc] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:08.500202 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:14:08.510004 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8ccf0469-68c9-4b0e-b956-8311c994aa96 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:08.512195 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8ccf0469-68c9-4b0e-b956-8311c994aa96 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:08.513884 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8ccf0469-68c9-4b0e-b956-8311c994aa96 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:08.517495 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8ccf0469-68c9-4b0e-b956-8311c994aa96 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:08.518495 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8ccf0469-68c9-4b0e-b956-8311c994aa96 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:08.519543 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8ccf0469-68c9-4b0e-b956-8311c994aa96 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:09.416530 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-8ccf0469-68c9-4b0e-b956-8311c994aa96 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5899b2ad9f1046caaf7c6073e408eeee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25abd63376614081a9d484f3c9ae950d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:09.437373 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-8ccf0469-68c9-4b0e-b956-8311c994aa96 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "GET /compute/v2.1/servers/f4dc6241-b173-4cbf-b76c-7da3fac7edcc" status: 200 len: 1694 microversion: 2.1 time: 0.946690 Aug 10 23:14:09.437981 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1744/3632] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:08 2022] GET /compute/v2.1/servers/f4dc6241-b173-4cbf-b76c-7da3fac7edcc => generated 1694 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:14:09.450554 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-83bd4823-9465-4b36-b43e-c34a46a3050b tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:09.454198 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-83bd4823-9465-4b36-b43e-c34a46a3050b tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: da69cf1f-ff76-4a68-afe9-fc491b31e8a9] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:09.473635 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-83bd4823-9465-4b36-b43e-c34a46a3050b tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:09.474148 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-83bd4823-9465-4b36-b43e-c34a46a3050b tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:09.474681 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-83bd4823-9465-4b36-b43e-c34a46a3050b tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:09.475442 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-83bd4823-9465-4b36-b43e-c34a46a3050b tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:09.477737 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-83bd4823-9465-4b36-b43e-c34a46a3050b tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:09.479709 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-83bd4823-9465-4b36-b43e-c34a46a3050b tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:10.132573 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-1cb9f1d5-55ec-4da3-8830-cb8b41139081 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:10.158270 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-1cb9f1d5-55ec-4da3-8830-cb8b41139081 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/3efc12c9-baf5-40e4-9d98-e72d28377db6" status: 200 len: 1511 microversion: 2.1 time: 1.809558 Aug 10 23:14:10.168299 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1889/3633] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:08 2022] GET /compute/v2.1/servers/3efc12c9-baf5-40e4-9d98-e72d28377db6 => generated 1511 bytes in 1824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:10.177443 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-3bbe4497-3946-45e1-849f-a100cfb6417d req-7afd7883-8fa7-41f5-876c-801674d35c19 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4dc6241-b173-4cbf-b76c-7da3fac7edcc", "tag": "d3cf5f02-4cda-4d1b-9314-92bc05402960"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:14:10.220253 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-3bbe4497-3946-45e1-849f-a100cfb6417d req-7afd7883-8fa7-41f5-876c-801674d35c19 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:10.221586 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-3bbe4497-3946-45e1-849f-a100cfb6417d req-7afd7883-8fa7-41f5-876c-801674d35c19 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:10.222601 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-3bbe4497-3946-45e1-849f-a100cfb6417d req-7afd7883-8fa7-41f5-876c-801674d35c19 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:10.273661 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-3bbe4497-3946-45e1-849f-a100cfb6417d req-7afd7883-8fa7-41f5-876c-801674d35c19 service nova] Creating event network-changed:d3cf5f02-4cda-4d1b-9314-92bc05402960 for instance f4dc6241-b173-4cbf-b76c-7da3fac7edcc on n-h2-850468-14 Aug 10 23:14:10.299222 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [req-3bbe4497-3946-45e1-849f-a100cfb6417d req-7afd7883-8fa7-41f5-876c-801674d35c19 service nova] Instance f4dc6241-b173-4cbf-b76c-7da3fac7edcc is migrating within the same cell, copying events to all relevant hosts: {'n-h1-850468-14', 'n-h2-850468-14'} {{(pid=122633) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5901}} Aug 10 23:14:10.332213 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-3bbe4497-3946-45e1-849f-a100cfb6417d req-7afd7883-8fa7-41f5-876c-801674d35c19 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.161703 Aug 10 23:14:10.337373 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1890/3634] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:14:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:14:10.435751 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-a2304d2b-3adf-415b-b0c1-b23a72771407 req-6d2a43bd-8fb1-486a-a0af-2cdb8f8040bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da69cf1f-ff76-4a68-afe9-fc491b31e8a9", "name": "network-vif-unplugged", "status": "completed", "tag": "1fe8c8ad-aad0-4a76-a5ed-01061f46152f"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:14:10.450093 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-a2304d2b-3adf-415b-b0c1-b23a72771407 req-6d2a43bd-8fb1-486a-a0af-2cdb8f8040bf service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:10.450969 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-a2304d2b-3adf-415b-b0c1-b23a72771407 req-6d2a43bd-8fb1-486a-a0af-2cdb8f8040bf service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:10.470620 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-a2304d2b-3adf-415b-b0c1-b23a72771407 req-6d2a43bd-8fb1-486a-a0af-2cdb8f8040bf service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:10.512964 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-a2304d2b-3adf-415b-b0c1-b23a72771407 req-6d2a43bd-8fb1-486a-a0af-2cdb8f8040bf service nova] Creating event network-vif-unplugged:1fe8c8ad-aad0-4a76-a5ed-01061f46152f for instance da69cf1f-ff76-4a68-afe9-fc491b31e8a9 on n-h2-850468-14 Aug 10 23:14:10.539752 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-a2304d2b-3adf-415b-b0c1-b23a72771407 req-6d2a43bd-8fb1-486a-a0af-2cdb8f8040bf service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.102742 Aug 10 23:14:10.541224 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1891/3635] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:14:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:14:10.547461 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-ae785abd-b1c7-4444-8f98-c5e074841c67 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:10.548500 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-ae785abd-b1c7-4444-8f98-c5e074841c67 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] [instance: f4dc6241-b173-4cbf-b76c-7da3fac7edcc] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:10.556474 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ae785abd-b1c7-4444-8f98-c5e074841c67 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:10.557347 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ae785abd-b1c7-4444-8f98-c5e074841c67 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:10.559007 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ae785abd-b1c7-4444-8f98-c5e074841c67 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:10.564300 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ae785abd-b1c7-4444-8f98-c5e074841c67 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:10.565219 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ae785abd-b1c7-4444-8f98-c5e074841c67 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:10.566328 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ae785abd-b1c7-4444-8f98-c5e074841c67 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:10.706833 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-83bd4823-9465-4b36-b43e-c34a46a3050b tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6160c7a42740efbe3613380933fa15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d90f8a58ad047fa8f347d6474e4d673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:10.718270 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-83bd4823-9465-4b36-b43e-c34a46a3050b tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "GET /compute/v2.1/servers/da69cf1f-ff76-4a68-afe9-fc491b31e8a9" status: 200 len: 1505 microversion: 2.1 time: 1.279167 Aug 10 23:14:10.719379 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1745/3636] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:09 2022] GET /compute/v2.1/servers/da69cf1f-ff76-4a68-afe9-fc491b31e8a9 => generated 1505 bytes in 1281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:11.028298 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-ae785abd-b1c7-4444-8f98-c5e074841c67 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5899b2ad9f1046caaf7c6073e408eeee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25abd63376614081a9d484f3c9ae950d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:11.036331 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-ae785abd-b1c7-4444-8f98-c5e074841c67 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "GET /compute/v2.1/servers/f4dc6241-b173-4cbf-b76c-7da3fac7edcc" status: 200 len: 1694 microversion: 2.1 time: 0.493689 Aug 10 23:14:11.047992 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1892/3637] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:10 2022] GET /compute/v2.1/servers/f4dc6241-b173-4cbf-b76c-7da3fac7edcc => generated 1694 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:11.212052 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-b50e9500-7d48-4208-8e25-98b52b00420d tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:11.212887 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-b50e9500-7d48-4208-8e25-98b52b00420d tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: 3efc12c9-baf5-40e4-9d98-e72d28377db6] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:11.228755 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b50e9500-7d48-4208-8e25-98b52b00420d tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:11.229046 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b50e9500-7d48-4208-8e25-98b52b00420d tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:11.229418 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b50e9500-7d48-4208-8e25-98b52b00420d tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:11.230135 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b50e9500-7d48-4208-8e25-98b52b00420d tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:11.230585 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b50e9500-7d48-4208-8e25-98b52b00420d tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:11.231038 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b50e9500-7d48-4208-8e25-98b52b00420d tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:11.339815 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-ef6579a1-b116-4ae0-8435-12652d2a1370 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-737329037", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "a72c97c1-6c5d-4274-875a-01ed6a8dba48", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "91d0258a-9486-4479-91e9-a6d9339a2e0a"}]}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:14:11.409078 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-ef6579a1-b116-4ae0-8435-12652d2a1370 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] HTTP exception thrown: Block Device a72c97c1-6c5d-4274-875a-01ed6a8dba48 is not bootable. Aug 10 23:14:11.425657 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-ef6579a1-b116-4ae0-8435-12652d2a1370 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Request method failure captured: Aug 10 23:14:11.425657 n-d-850468-14 devstack@n-api.service[122633]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 10 23:14:11.425657 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:14:11.425657 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:14:11.425657 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:14:11.425657 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 357 Aug 10 23:14:11.425657 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:14:11.425657 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:14:11.425657 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:14:11.425657 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:14:11.425657 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9DuIKrfOsS8tKST0PsIPrvuNPfsVISfOPvUoe9ddkVcTJKj7rDjd3OuH9u-DTT1aypj1AUoUKtajD98eDOUOHSpPisBSdRlSCov30lHf1uZq-XZLyBIVg5kAG8-SuXk2s1TL7EnRcjjMARSkm95dZDnXaBXRT3M4f8UoMDwqu7xK7gQ Aug 10 23:14:11.425657 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:14:11.425657 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:14:11.425657 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:14:11.425657 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:14:11.425657 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:14:11.425657 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:14:11.425657 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: d11bbb3e87f4463787da56ab19108822 Aug 10 23:14:11.425657 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-ServersNegativeTestJSON-1216728002 Aug 10 23:14:11.425657 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:14:11.425657 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:14:11.425657 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d11bbb3e87f4463787da56ab19108822"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d11bbb3e87f4463787da56ab19108822"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d11bbb3e87f4463787da56ab19108822"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d11bbb3e87f4463787da56ab19108822", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:14:11.425657 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-ServersNegativeTestJSON-1216728002 Aug 10 23:14:11.425657 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: d11bbb3e87f4463787da56ab19108822 Aug 10 23:14:11.425657 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1216728002 Aug 10 23:14:11.425657 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-ServersNegativeTestJSON-1216728002-project Aug 10 23:14:11.425657 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:14:11.425657 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:14:11.425657 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: f284ec2a4bf546b58c1c1adaf880e1fb Aug 10 23:14:11.425657 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-ServersNegativeTestJSON-1216728002-project Aug 10 23:14:11.425657 n-d-850468-14 devstack@n-api.service[122633]: Aug 10 23:14:11.425657 n-d-850468-14 devstack@n-api.service[122633]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-737329037", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "a72c97c1-6c5d-4274-875a-01ed6a8dba48", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "91d0258a-9486-4479-91e9-a6d9339a2e0a"}]}} Aug 10 23:14:11.425657 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:14:11.425657 n-d-850468-14 devstack@n-api.service[122633]: exception: Block Device a72c97c1-6c5d-4274-875a-01ed6a8dba48 is not bootable. Aug 10 23:14:11.425657 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-737329037', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': 'a72c97c1-6c5d-4274-875a-01ed6a8dba48'}], 'networks': [{'uuid': '91d0258a-9486-4479-91e9-a6d9339a2e0a'}]}}} Aug 10 23:14:11.425657 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:14:11.425657 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:14:11.425657 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 23:14:11.425657 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 23:14:11.425657 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 23:14:11.425657 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 23:14:11.425657 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1624, in _create_instance Aug 10 23:14:11.425657 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Aug 10 23:14:11.425657 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 662, in get_bdm_image_metadata Aug 10 23:14:11.425657 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Aug 10 23:14:11.425657 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device a72c97c1-6c5d-4274-875a-01ed6a8dba48 is not bootable. Aug 10 23:14:11.425657 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:14:11.425657 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:14:11.425657 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:14:11.425657 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:14:11.425657 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:14:11.425657 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:14:11.425657 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:14:11.425657 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:14:11.425657 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:14:11.425657 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:14:11.425657 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 23:14:11.425657 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 23:14:11.425657 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 23:14:11.429799 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 23:14:11.429799 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 23:14:11.429799 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 23:14:11.429799 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 23:14:11.429799 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Aug 10 23:14:11.429799 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 10 23:14:11.429799 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device a72c97c1-6c5d-4274-875a-01ed6a8dba48 is not bootable. Aug 10 23:14:11.429799 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:14:11.429799 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:14:11.429799 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:14:11.429799 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:14:11.429799 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:14:11.429799 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:14:11.429799 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:14:11.429799 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:14:11.429799 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device a72c97c1-6c5d-4274-875a-01ed6a8dba48 is not bootable. Aug 10 23:14:11.429799 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:14:11.433190 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-ef6579a1-b116-4ae0-8435-12652d2a1370 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Returning 400 to user: Block Device a72c97c1-6c5d-4274-875a-01ed6a8dba48 is not bootable. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:14:11.434088 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-ef6579a1-b116-4ae0-8435-12652d2a1370 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.098608 Aug 10 23:14:11.438748 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1893/3638] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 23:14:11 2022] POST /compute/v2.1/servers => generated 110 bytes in 104 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 10 23:14:11.446060 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-190c9572-f095-451a-8242-46f31c98b34b tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:11.447050 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-190c9572-f095-451a-8242-46f31c98b34b tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:11.453531 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-190c9572-f095-451a-8242-46f31c98b34b tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:11.454023 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-190c9572-f095-451a-8242-46f31c98b34b tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:11.454464 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-190c9572-f095-451a-8242-46f31c98b34b tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:11.455409 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-190c9572-f095-451a-8242-46f31c98b34b tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:11.455865 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-190c9572-f095-451a-8242-46f31c98b34b tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:11.456290 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-190c9572-f095-451a-8242-46f31c98b34b tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:11.884688 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-190c9572-f095-451a-8242-46f31c98b34b tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:11.924511 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-b50e9500-7d48-4208-8e25-98b52b00420d tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:11.933550 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-b50e9500-7d48-4208-8e25-98b52b00420d tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/3efc12c9-baf5-40e4-9d98-e72d28377db6" status: 200 len: 1511 microversion: 2.1 time: 0.725527 Aug 10 23:14:11.936400 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-190c9572-f095-451a-8242-46f31c98b34b tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b" status: 200 len: 1506 microversion: 2.1 time: 0.493086 Aug 10 23:14:11.937500 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1746/3639] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:11 2022] GET /compute/v2.1/servers/3efc12c9-baf5-40e4-9d98-e72d28377db6 => generated 1511 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:11.949155 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1894/3640] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:11 2022] GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b => generated 1506 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:11.951036 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-073da490-776b-447b-b9f2-114f3beb47c4 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:11.951667 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-073da490-776b-447b-b9f2-114f3beb47c4 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: da69cf1f-ff76-4a68-afe9-fc491b31e8a9] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:11.970579 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-073da490-776b-447b-b9f2-114f3beb47c4 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:11.971101 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-073da490-776b-447b-b9f2-114f3beb47c4 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:11.971547 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-073da490-776b-447b-b9f2-114f3beb47c4 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:11.972259 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-073da490-776b-447b-b9f2-114f3beb47c4 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:11.972716 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-073da490-776b-447b-b9f2-114f3beb47c4 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:11.973144 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-073da490-776b-447b-b9f2-114f3beb47c4 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:11.976256 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-3959f45d-803a-4890-8ed5-b2685d05cc37 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:11.977920 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-3959f45d-803a-4890-8ed5-b2685d05cc37 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:11.984504 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3959f45d-803a-4890-8ed5-b2685d05cc37 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:11.985345 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3959f45d-803a-4890-8ed5-b2685d05cc37 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:11.986045 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3959f45d-803a-4890-8ed5-b2685d05cc37 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:11.987162 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3959f45d-803a-4890-8ed5-b2685d05cc37 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:11.987974 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3959f45d-803a-4890-8ed5-b2685d05cc37 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:11.988723 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3959f45d-803a-4890-8ed5-b2685d05cc37 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:12.433543 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-3959f45d-803a-4890-8ed5-b2685d05cc37 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:12.449675 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-3959f45d-803a-4890-8ed5-b2685d05cc37 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b" status: 200 len: 1506 microversion: 2.1 time: 0.477214 Aug 10 23:14:12.450351 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1895/3641] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:11 2022] GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b => generated 1506 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:12.455117 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-552d832f-8e30-4f6b-86f7-3e9a0ed13303 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:12.467771 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-552d832f-8e30-4f6b-86f7-3e9a0ed13303 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] [instance: f4dc6241-b173-4cbf-b76c-7da3fac7edcc] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:12.475118 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-552d832f-8e30-4f6b-86f7-3e9a0ed13303 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:12.475473 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-552d832f-8e30-4f6b-86f7-3e9a0ed13303 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:12.477390 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-552d832f-8e30-4f6b-86f7-3e9a0ed13303 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:12.477928 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-552d832f-8e30-4f6b-86f7-3e9a0ed13303 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:12.478479 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-552d832f-8e30-4f6b-86f7-3e9a0ed13303 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:12.479082 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-552d832f-8e30-4f6b-86f7-3e9a0ed13303 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:13.262862 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-552d832f-8e30-4f6b-86f7-3e9a0ed13303 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5899b2ad9f1046caaf7c6073e408eeee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25abd63376614081a9d484f3c9ae950d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:13.271669 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-552d832f-8e30-4f6b-86f7-3e9a0ed13303 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "GET /compute/v2.1/servers/f4dc6241-b173-4cbf-b76c-7da3fac7edcc" status: 200 len: 1694 microversion: 2.1 time: 0.820020 Aug 10 23:14:13.276155 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1896/3642] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:12 2022] GET /compute/v2.1/servers/f4dc6241-b173-4cbf-b76c-7da3fac7edcc => generated 1694 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:13.281459 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-67053fa9-9ecb-4e7a-941b-54eeda700112 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:13.291371 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-67053fa9-9ecb-4e7a-941b-54eeda700112 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: 3efc12c9-baf5-40e4-9d98-e72d28377db6] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:13.313329 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-67053fa9-9ecb-4e7a-941b-54eeda700112 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:13.314311 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-67053fa9-9ecb-4e7a-941b-54eeda700112 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:13.314956 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-67053fa9-9ecb-4e7a-941b-54eeda700112 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:13.317228 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-67053fa9-9ecb-4e7a-941b-54eeda700112 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:13.319359 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-67053fa9-9ecb-4e7a-941b-54eeda700112 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:13.319973 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-67053fa9-9ecb-4e7a-941b-54eeda700112 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:13.638167 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-073da490-776b-447b-b9f2-114f3beb47c4 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6160c7a42740efbe3613380933fa15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d90f8a58ad047fa8f347d6474e4d673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:13.656004 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-073da490-776b-447b-b9f2-114f3beb47c4 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "GET /compute/v2.1/servers/da69cf1f-ff76-4a68-afe9-fc491b31e8a9" status: 200 len: 1448 microversion: 2.1 time: 1.715975 Aug 10 23:14:13.656924 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1747/3643] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:11 2022] GET /compute/v2.1/servers/da69cf1f-ff76-4a68-afe9-fc491b31e8a9 => generated 1448 bytes in 1719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:13.684222 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-b6c49394-a2f5-4ce7-9304-8af35a724c7f tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:13.685065 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-b6c49394-a2f5-4ce7-9304-8af35a724c7f tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: da69cf1f-ff76-4a68-afe9-fc491b31e8a9] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:13.714575 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b6c49394-a2f5-4ce7-9304-8af35a724c7f tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:13.715585 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b6c49394-a2f5-4ce7-9304-8af35a724c7f tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:13.716323 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b6c49394-a2f5-4ce7-9304-8af35a724c7f tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:13.717450 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b6c49394-a2f5-4ce7-9304-8af35a724c7f tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:13.718279 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b6c49394-a2f5-4ce7-9304-8af35a724c7f tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:13.720388 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b6c49394-a2f5-4ce7-9304-8af35a724c7f tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:13.797251 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-b6c49394-a2f5-4ce7-9304-8af35a724c7f tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: da69cf1f-ff76-4a68-afe9-fc491b31e8a9] Going to try to terminate instance {{(pid=122632) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:14:13.812840 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.compute.api [None req-b6c49394-a2f5-4ce7-9304-8af35a724c7f tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: da69cf1f-ff76-4a68-afe9-fc491b31e8a9] Working on deleting snapshot 0e204183-e541-44d4-8a10-e8c249ff5c0e from shelved instance... Aug 10 23:14:14.059289 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-67053fa9-9ecb-4e7a-941b-54eeda700112 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:14.069309 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-67053fa9-9ecb-4e7a-941b-54eeda700112 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/3efc12c9-baf5-40e4-9d98-e72d28377db6" status: 200 len: 1511 microversion: 2.1 time: 0.791825 Aug 10 23:14:14.072105 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1897/3644] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:13 2022] GET /compute/v2.1/servers/3efc12c9-baf5-40e4-9d98-e72d28377db6 => generated 1511 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:14.295501 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-97ae3919-415b-49f6-bbed-bc322c8dcbc5 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:14.296370 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-97ae3919-415b-49f6-bbed-bc322c8dcbc5 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] [instance: f4dc6241-b173-4cbf-b76c-7da3fac7edcc] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:14.306585 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-97ae3919-415b-49f6-bbed-bc322c8dcbc5 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:14.308343 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-97ae3919-415b-49f6-bbed-bc322c8dcbc5 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:14.310058 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-97ae3919-415b-49f6-bbed-bc322c8dcbc5 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:14.313923 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-97ae3919-415b-49f6-bbed-bc322c8dcbc5 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:14.316104 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-97ae3919-415b-49f6-bbed-bc322c8dcbc5 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:14.316749 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-97ae3919-415b-49f6-bbed-bc322c8dcbc5 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:14.894442 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=100 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:14:15.003491 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-b6c49394-a2f5-4ce7-9304-8af35a724c7f tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: da69cf1f-ff76-4a68-afe9-fc491b31e8a9] Doing local delete in cell c9127db4-59f9-48ac-9ab2-b5d6690bb85f(cell1) {{(pid=122632) _delete /opt/stack/nova/nova/compute/api.py:2491}} Aug 10 23:14:15.004319 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b6c49394-a2f5-4ce7-9304-8af35a724c7f tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:15.005930 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b6c49394-a2f5-4ce7-9304-8af35a724c7f tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:15.006396 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b6c49394-a2f5-4ce7-9304-8af35a724c7f tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:15.006855 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.compute.api [None req-b6c49394-a2f5-4ce7-9304-8af35a724c7f tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: da69cf1f-ff76-4a68-afe9-fc491b31e8a9] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Aug 10 23:14:15.021292 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.network.neutron [None req-b6c49394-a2f5-4ce7-9304-8af35a724c7f tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: da69cf1f-ff76-4a68-afe9-fc491b31e8a9] deallocate_for_instance() {{(pid=122632) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Aug 10 23:14:15.122388 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-97ae3919-415b-49f6-bbed-bc322c8dcbc5 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5899b2ad9f1046caaf7c6073e408eeee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25abd63376614081a9d484f3c9ae950d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:15.137584 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-97ae3919-415b-49f6-bbed-bc322c8dcbc5 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "GET /compute/v2.1/servers/f4dc6241-b173-4cbf-b76c-7da3fac7edcc" status: 200 len: 1692 microversion: 2.1 time: 0.845731 Aug 10 23:14:15.154262 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1898/3645] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:14 2022] GET /compute/v2.1/servers/f4dc6241-b173-4cbf-b76c-7da3fac7edcc => generated 1692 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:14:15.444069 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-9a9fe15d-43d7-4d63-b4c0-6eaa9b35fc32 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1540132096", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:14:15.544070 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.network.neutron [None req-9a9fe15d-43d7-4d63-b4c0-6eaa9b35fc32 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] validate_networks() for [('6cf41fc6-d8ed-4aac-8496-23731f15bebe', None, None, None, None, None)] {{(pid=122633) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 23:14:16.464543 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.network.neutron [None req-b6c49394-a2f5-4ce7-9304-8af35a724c7f tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: da69cf1f-ff76-4a68-afe9-fc491b31e8a9] Updating instance_info_cache with network_info: [] {{(pid=122632) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 10 23:14:16.824042 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-b6c49394-a2f5-4ce7-9304-8af35a724c7f tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "DELETE /compute/v2.1/servers/da69cf1f-ff76-4a68-afe9-fc491b31e8a9" status: 204 len: 0 microversion: 2.1 time: 3.147567 Aug 10 23:14:16.827811 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1748/3646] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:14:13 2022] DELETE /compute/v2.1/servers/da69cf1f-ff76-4a68-afe9-fc491b31e8a9 => generated 0 bytes in 3150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:14:16.841061 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-71607938-e996-4e18-8aef-f65662dbbcd5 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:16.841711 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-71607938-e996-4e18-8aef-f65662dbbcd5 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: 3efc12c9-baf5-40e4-9d98-e72d28377db6] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:16.858280 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-71607938-e996-4e18-8aef-f65662dbbcd5 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:16.860771 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-71607938-e996-4e18-8aef-f65662dbbcd5 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:16.861647 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-71607938-e996-4e18-8aef-f65662dbbcd5 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:16.864121 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-71607938-e996-4e18-8aef-f65662dbbcd5 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:16.865688 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-71607938-e996-4e18-8aef-f65662dbbcd5 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:16.887595 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-71607938-e996-4e18-8aef-f65662dbbcd5 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:17.147786 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-71607938-e996-4e18-8aef-f65662dbbcd5 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:17.167067 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-71607938-e996-4e18-8aef-f65662dbbcd5 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/3efc12c9-baf5-40e4-9d98-e72d28377db6" status: 200 len: 1511 microversion: 2.1 time: 0.339293 Aug 10 23:14:17.167749 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1749/3647] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:16 2022] GET /compute/v2.1/servers/3efc12c9-baf5-40e4-9d98-e72d28377db6 => generated 1511 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:17.186436 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-fe7a4144-6ec5-4923-8642-c99413665a0f tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-762414165", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "78ad8905-f66f-4733-8be9-2b260f1fabed", "destination_type": "local"}, {"source_type": "volume", "uuid": "bf71a278-6d25-4a44-b7b1-e9ad617967fb", "destination_type": "invalid"}], "networks": [{"uuid": "91d0258a-9486-4479-91e9-a6d9339a2e0a"}]}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:14:17.191119 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-fe7a4144-6ec5-4923-8642-c99413665a0f tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Request method failure captured: Aug 10 23:14:17.191119 n-d-850468-14 devstack@n-api.service[122632]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 10 23:14:17.191119 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:14:17.191119 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:14:17.191119 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:14:17.191119 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 494 Aug 10 23:14:17.191119 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:14:17.191119 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:14:17.191119 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:14:17.191119 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:14:17.191119 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9DuIKrfOsS8tKST0PsIPrvuNPfsVISfOPvUoe9ddkVcTJKj7rDjd3OuH9u-DTT1aypj1AUoUKtajD98eDOUOHSpPisBSdRlSCov30lHf1uZq-XZLyBIVg5kAG8-SuXk2s1TL7EnRcjjMARSkm95dZDnXaBXRT3M4f8UoMDwqu7xK7gQ Aug 10 23:14:17.191119 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:14:17.191119 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:14:17.191119 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:14:17.191119 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:14:17.191119 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:14:17.191119 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:14:17.191119 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: d11bbb3e87f4463787da56ab19108822 Aug 10 23:14:17.191119 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-ServersNegativeTestJSON-1216728002 Aug 10 23:14:17.191119 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:14:17.191119 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:14:17.191119 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d11bbb3e87f4463787da56ab19108822"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d11bbb3e87f4463787da56ab19108822"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d11bbb3e87f4463787da56ab19108822"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d11bbb3e87f4463787da56ab19108822", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:14:17.191119 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-ServersNegativeTestJSON-1216728002 Aug 10 23:14:17.191119 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: d11bbb3e87f4463787da56ab19108822 Aug 10 23:14:17.191119 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1216728002 Aug 10 23:14:17.191119 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-ServersNegativeTestJSON-1216728002-project Aug 10 23:14:17.191119 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:14:17.191119 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:14:17.191119 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: f284ec2a4bf546b58c1c1adaf880e1fb Aug 10 23:14:17.191119 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-ServersNegativeTestJSON-1216728002-project Aug 10 23:14:17.191119 n-d-850468-14 devstack@n-api.service[122632]: Aug 10 23:14:17.191119 n-d-850468-14 devstack@n-api.service[122632]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-762414165", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "78ad8905-f66f-4733-8be9-2b260f1fabed", "destination_type": "local"}, {"source_type": "volume", "uuid": "bf71a278-6d25-4a44-b7b1-e9ad617967fb", "destination_type": "invalid"}], "networks": [{"uuid": "91d0258a-9486-4479-91e9-a6d9339a2e0a"}]}} Aug 10 23:14:17.191119 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:14:17.191119 n-d-850468-14 devstack@n-api.service[122632]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Aug 10 23:14:17.191119 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-762414165', 'imageRef': '78ad8905-f66f-4733-8be9-2b260f1fabed', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': '78ad8905-f66f-4733-8be9-2b260f1fabed', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': 'bf71a278-6d25-4a44-b7b1-e9ad617967fb', 'destination_type': 'invalid'}], 'networks': [{'uuid': '91d0258a-9486-4479-91e9-a6d9339a2e0a'}]}}} Aug 10 23:14:17.191119 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:14:17.191119 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:14:17.191119 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 10 23:14:17.191119 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 10 23:14:17.191119 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 10 23:14:17.191119 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise error Aug 10 23:14:17.191119 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Aug 10 23:14:17.191119 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:14:17.191119 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Aug 10 23:14:17.191119 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Aug 10 23:14:17.191119 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:14:17.191119 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Aug 10 23:14:17.191119 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi 'invalid' Aug 10 23:14:17.191119 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:14:17.191119 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:14:17.191119 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:14:17.191119 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:14:17.191119 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:14:17.191119 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:14:17.191119 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:14:17.191119 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:14:17.191119 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:14:17.194353 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:14:17.194353 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 23:14:17.194353 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 23:14:17.194353 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 10 23:14:17.194353 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 10 23:14:17.194353 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 10 23:14:17.194353 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 10 23:14:17.194353 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 10 23:14:17.194353 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 10 23:14:17.194353 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Aug 10 23:14:17.194353 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:14:17.194353 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:14:17.194353 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:14:17.194353 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:14:17.194353 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:14:17.194353 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:14:17.194353 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 10 23:14:17.194353 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 10 23:14:17.194353 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Aug 10 23:14:17.194353 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:14:17.197645 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-fe7a4144-6ec5-4923-8642-c99413665a0f tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:14:17.198761 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-fe7a4144-6ec5-4923-8642-c99413665a0f tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.019159 Aug 10 23:14:17.199596 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1750/3648] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 23:14:17 2022] POST /compute/v2.1/servers => generated 155 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 10 23:14:17.204528 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-548c1bb9-6545-4840-bedb-77b369a0213e tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:17.205223 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-548c1bb9-6545-4840-bedb-77b369a0213e tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] [instance: f4dc6241-b173-4cbf-b76c-7da3fac7edcc] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:17.214882 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-548c1bb9-6545-4840-bedb-77b369a0213e tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:17.215427 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-548c1bb9-6545-4840-bedb-77b369a0213e tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:17.215856 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-548c1bb9-6545-4840-bedb-77b369a0213e tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:17.216583 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-548c1bb9-6545-4840-bedb-77b369a0213e tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:17.217040 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-548c1bb9-6545-4840-bedb-77b369a0213e tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:17.217743 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-548c1bb9-6545-4840-bedb-77b369a0213e tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:17.375014 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-548c1bb9-6545-4840-bedb-77b369a0213e tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5899b2ad9f1046caaf7c6073e408eeee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25abd63376614081a9d484f3c9ae950d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:17.384086 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-548c1bb9-6545-4840-bedb-77b369a0213e tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "GET /compute/v2.1/servers/f4dc6241-b173-4cbf-b76c-7da3fac7edcc" status: 200 len: 1689 microversion: 2.1 time: 0.183279 Aug 10 23:14:17.385878 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1751/3649] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:17 2022] GET /compute/v2.1/servers/f4dc6241-b173-4cbf-b76c-7da3fac7edcc => generated 1689 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:17.391141 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-7e9b70d6-c2ec-4846-b52e-ab6838522199 req-787c1950-7d40-4f56-a116-14690fb2b482 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da69cf1f-ff76-4a68-afe9-fc491b31e8a9", "name": "network-vif-deleted", "tag": "1fe8c8ad-aad0-4a76-a5ed-01061f46152f"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:14:17.401790 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-7e9b70d6-c2ec-4846-b52e-ab6838522199 req-787c1950-7d40-4f56-a116-14690fb2b482 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:17.402659 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-7e9b70d6-c2ec-4846-b52e-ab6838522199 req-787c1950-7d40-4f56-a116-14690fb2b482 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:17.403316 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-7e9b70d6-c2ec-4846-b52e-ab6838522199 req-787c1950-7d40-4f56-a116-14690fb2b482 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:17.423160 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.compute.server_external_events [req-7e9b70d6-c2ec-4846-b52e-ab6838522199 req-787c1950-7d40-4f56-a116-14690fb2b482 service nova] Unable to find a host for instance da69cf1f-ff76-4a68-afe9-fc491b31e8a9. Dropping event network-vif-deleted {{(pid=122632) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 10 23:14:17.424677 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-7e9b70d6-c2ec-4846-b52e-ab6838522199 req-787c1950-7d40-4f56-a116-14690fb2b482 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.037533 Aug 10 23:14:17.427176 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1752/3650] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:14:17 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 40 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 10 23:14:17.442121 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-d9355397-3649-4759-9ba1-e2a00dce7f6a tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:17.442745 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-d9355397-3649-4759-9ba1-e2a00dce7f6a tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: da69cf1f-ff76-4a68-afe9-fc491b31e8a9] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:17.452511 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d9355397-3649-4759-9ba1-e2a00dce7f6a tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:17.453330 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d9355397-3649-4759-9ba1-e2a00dce7f6a tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:17.453931 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d9355397-3649-4759-9ba1-e2a00dce7f6a tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:17.454825 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d9355397-3649-4759-9ba1-e2a00dce7f6a tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:17.455425 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d9355397-3649-4759-9ba1-e2a00dce7f6a tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:17.455988 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d9355397-3649-4759-9ba1-e2a00dce7f6a tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:17.474478 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-d9355397-3649-4759-9ba1-e2a00dce7f6a tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] HTTP exception thrown: Instance da69cf1f-ff76-4a68-afe9-fc491b31e8a9 could not be found. Aug 10 23:14:17.477094 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-d9355397-3649-4759-9ba1-e2a00dce7f6a tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Request method failure captured: Aug 10 23:14:17.477094 n-d-850468-14 devstack@n-api.service[122632]: request: GET /compute/v2.1/servers/da69cf1f-ff76-4a68-afe9-fc491b31e8a9 HTTP/1.1 Aug 10 23:14:17.477094 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:14:17.477094 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:14:17.477094 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:14:17.477094 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 23:14:17.477094 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:14:17.477094 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:14:17.477094 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:14:17.477094 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:14:17.477094 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9Drr3r82npWIkz1ccNiKcah17mvrMR2EU4HCxqxnaGEEIkGANcRcrX2nHMsvmCLf0usmykCLye_MMWubAbqGw1RDJdO9uNXXKIzwnkO3-8RDYkeEsX4dAb-XLWqGpnC4lB_RQ_yXrj9zJ0yoaNBALi5oi6cnoUgwIrYxNetinerHaU0 Aug 10 23:14:17.477094 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:14:17.477094 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:14:17.477094 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:14:17.477094 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:14:17.477094 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:14:17.477094 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:14:17.477094 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 7d90f8a58ad047fa8f347d6474e4d673 Aug 10 23:14:17.477094 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-DeleteServersTestJSON-311075827 Aug 10 23:14:17.477094 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:14:17.477094 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:14:17.477094 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7d90f8a58ad047fa8f347d6474e4d673"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7d90f8a58ad047fa8f347d6474e4d673"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7d90f8a58ad047fa8f347d6474e4d673"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7d90f8a58ad047fa8f347d6474e4d673", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:14:17.477094 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-DeleteServersTestJSON-311075827 Aug 10 23:14:17.477094 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 7d90f8a58ad047fa8f347d6474e4d673 Aug 10 23:14:17.477094 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-DeleteServersTestJSON-311075827 Aug 10 23:14:17.477094 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-DeleteServersTestJSON-311075827-project Aug 10 23:14:17.477094 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:14:17.477094 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:14:17.477094 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: 3c6160c7a42740efbe3613380933fa15 Aug 10 23:14:17.477094 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-DeleteServersTestJSON-311075827-project Aug 10 23:14:17.477094 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:14:17.477094 n-d-850468-14 devstack@n-api.service[122632]: exception: Instance da69cf1f-ff76-4a68-afe9-fc491b31e8a9 could not be found. Aug 10 23:14:17.477094 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': 'da69cf1f-ff76-4a68-afe9-fc491b31e8a9'} Aug 10 23:14:17.477094 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:14:17.477094 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:14:17.477094 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:14:17.477094 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:14:17.477094 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:14:17.477094 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:14:17.477094 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:14:17.477094 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:14:17.477094 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:14:17.477094 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:14:17.477094 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da69cf1f-ff76-4a68-afe9-fc491b31e8a9 could not be found. Aug 10 23:14:17.477094 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:14:17.477094 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:14:17.477094 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:14:17.477094 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:14:17.477094 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:14:17.477094 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:14:17.477094 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:14:17.477094 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:14:17.477094 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:14:17.477094 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:14:17.477094 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:14:17.477094 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:14:17.477094 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:14:17.477094 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:14:17.477094 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:14:17.477094 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:14:17.477094 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da69cf1f-ff76-4a68-afe9-fc491b31e8a9 could not be found. Aug 10 23:14:17.477094 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:14:17.477094 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:14:17.477094 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:14:17.481344 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:14:17.481344 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:14:17.481344 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:14:17.481344 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:14:17.481344 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:14:17.481344 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da69cf1f-ff76-4a68-afe9-fc491b31e8a9 could not be found. Aug 10 23:14:17.481344 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:14:17.482966 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-d9355397-3649-4759-9ba1-e2a00dce7f6a tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Returning 404 to user: Instance da69cf1f-ff76-4a68-afe9-fc491b31e8a9 could not be found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:14:17.484020 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-d9355397-3649-4759-9ba1-e2a00dce7f6a tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "GET /compute/v2.1/servers/da69cf1f-ff76-4a68-afe9-fc491b31e8a9" status: 404 len: 111 microversion: 2.1 time: 0.055744 Aug 10 23:14:17.485273 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1753/3651] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:17 2022] GET /compute/v2.1/servers/da69cf1f-ff76-4a68-afe9-fc491b31e8a9 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:14:17.636620 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-5e1bb420-4bf5-4e94-9232-d043262633b2 tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-1252080188", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452", "networks": [{"uuid": "a4d78ab3-1d4e-469c-a7d7-75497e4a40a6"}]}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:14:17.751304 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.network.neutron [None req-5e1bb420-4bf5-4e94-9232-d043262633b2 tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] validate_networks() for [('a4d78ab3-1d4e-469c-a7d7-75497e4a40a6', None, None, None, None, None)] {{(pid=122632) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 23:14:17.885603 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-9a9fe15d-43d7-4d63-b4c0-6eaa9b35fc32 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Flavor limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:14:17.886718 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-9a9fe15d-43d7-4d63-b4c0-6eaa9b35fc32 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Image limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:14:17.887429 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-9a9fe15d-43d7-4d63-b4c0-6eaa9b35fc32 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Flavor pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:14:17.891823 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-9a9fe15d-43d7-4d63-b4c0-6eaa9b35fc32 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Image pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:14:17.892541 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-9a9fe15d-43d7-4d63-b4c0-6eaa9b35fc32 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:14:17.909931 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9a9fe15d-43d7-4d63-b4c0-6eaa9b35fc32 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:17.920577 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9a9fe15d-43d7-4d63-b4c0-6eaa9b35fc32 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:17.921391 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9a9fe15d-43d7-4d63-b4c0-6eaa9b35fc32 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:17.922420 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9a9fe15d-43d7-4d63-b4c0-6eaa9b35fc32 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:17.924710 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9a9fe15d-43d7-4d63-b4c0-6eaa9b35fc32 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:17.932795 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9a9fe15d-43d7-4d63-b4c0-6eaa9b35fc32 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:18.006815 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-9a9fe15d-43d7-4d63-b4c0-6eaa9b35fc32 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Getting quotas for project 395d7c4077e54c43bb95288db3942b0a. Resources: {'instances', 'cores', 'ram'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:14:18.030388 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-9a9fe15d-43d7-4d63-b4c0-6eaa9b35fc32 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Getting quotas for user f07c94ebf0954cdea12b9a689538d96d and project 395d7c4077e54c43bb95288db3942b0a. Resources: {'instances', 'cores', 'ram'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:14:18.060980 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-9a9fe15d-43d7-4d63-b4c0-6eaa9b35fc32 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Going to run 1 instances... {{(pid=122633) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 23:14:18.063548 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-9a9fe15d-43d7-4d63-b4c0-6eaa9b35fc32 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] [instance: 27dd09d6-47ed-4b55-bd02-baad36a28429] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78ad8905-f66f-4733-8be9-2b260f1fabed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122633) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 23:14:18.184863 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-9a9fe15d-43d7-4d63-b4c0-6eaa9b35fc32 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.038323 Aug 10 23:14:18.186907 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1899/3652] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 23:14:15 2022] POST /compute/v2.1/servers => generated 383 bytes in 3042 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 23:14:18.207486 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-152ccb09-69a7-4b40-9aae-b75b5d480f03 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:18.211573 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-152ccb09-69a7-4b40-9aae-b75b5d480f03 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:18.225237 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-152ccb09-69a7-4b40-9aae-b75b5d480f03 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:18.225750 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-152ccb09-69a7-4b40-9aae-b75b5d480f03 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:18.226249 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-152ccb09-69a7-4b40-9aae-b75b5d480f03 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:18.228299 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-152ccb09-69a7-4b40-9aae-b75b5d480f03 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:18.228986 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-152ccb09-69a7-4b40-9aae-b75b5d480f03 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:18.229554 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-152ccb09-69a7-4b40-9aae-b75b5d480f03 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:18.651357 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-5e1bb420-4bf5-4e94-9232-d043262633b2 tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Flavor limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:14:18.652054 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-5e1bb420-4bf5-4e94-9232-d043262633b2 tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Image limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:14:18.652729 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-5e1bb420-4bf5-4e94-9232-d043262633b2 tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Flavor pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:14:18.653276 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-5e1bb420-4bf5-4e94-9232-d043262633b2 tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Image pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:14:18.653814 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-5e1bb420-4bf5-4e94-9232-d043262633b2 tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:14:18.675033 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5e1bb420-4bf5-4e94-9232-d043262633b2 tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:18.675522 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5e1bb420-4bf5-4e94-9232-d043262633b2 tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:18.676393 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5e1bb420-4bf5-4e94-9232-d043262633b2 tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:18.679038 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5e1bb420-4bf5-4e94-9232-d043262633b2 tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:18.679576 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5e1bb420-4bf5-4e94-9232-d043262633b2 tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:18.681241 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5e1bb420-4bf5-4e94-9232-d043262633b2 tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:18.710356 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-152ccb09-69a7-4b40-9aae-b75b5d480f03 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:18.720917 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-5e1bb420-4bf5-4e94-9232-d043262633b2 tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Getting quotas for project ee72843cb8064834bdbc02d8a5417f71. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:14:18.724102 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-152ccb09-69a7-4b40-9aae-b75b5d480f03 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b" status: 200 len: 1506 microversion: 2.1 time: 0.529144 Aug 10 23:14:18.740805 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-5e1bb420-4bf5-4e94-9232-d043262633b2 tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Getting quotas for user c39eef3efd444a6d8192f405cba67f86 and project ee72843cb8064834bdbc02d8a5417f71. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:14:18.744603 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1900/3653] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:18 2022] GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b => generated 1506 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:18.753352 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c62d76e8-67a4-4f8c-acbd-436a68cad33b tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:14:18.764662 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-5e1bb420-4bf5-4e94-9232-d043262633b2 tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Going to run 1 instances... {{(pid=122632) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 23:14:18.767000 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-5e1bb420-4bf5-4e94-9232-d043262633b2 tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] [instance: 325ce83e-53e6-4021-b1a1-548ff5057761] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78ad8905-f66f-4733-8be9-2b260f1fabed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122632) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 23:14:18.769503 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-c62d76e8-67a4-4f8c-acbd-436a68cad33b tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] [instance: f4dc6241-b173-4cbf-b76c-7da3fac7edcc] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:18.789454 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c62d76e8-67a4-4f8c-acbd-436a68cad33b tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:18.797919 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c62d76e8-67a4-4f8c-acbd-436a68cad33b tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:18.800793 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c62d76e8-67a4-4f8c-acbd-436a68cad33b tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:18.801804 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c62d76e8-67a4-4f8c-acbd-436a68cad33b tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:18.802356 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c62d76e8-67a4-4f8c-acbd-436a68cad33b tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:18.811428 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c62d76e8-67a4-4f8c-acbd-436a68cad33b tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:18.965754 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-5e1bb420-4bf5-4e94-9232-d043262633b2 tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 1.479013 Aug 10 23:14:18.966429 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1754/3654] 10.222.0.58 () {62 vars in 1188 bytes} [Wed Aug 10 23:14:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 1480 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 10 23:14:19.000908 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-aa25f9cd-5852-429b-8324-55e198f16692 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-456267660", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452", "networks": [{"uuid": "042efc3d-5a07-4ef1-a5d1-285928545eba"}]}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:14:19.090055 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-c62d76e8-67a4-4f8c-acbd-436a68cad33b tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "POST /compute/v2.1/servers/f4dc6241-b173-4cbf-b76c-7da3fac7edcc/action" status: 204 len: 0 microversion: 2.1 time: 0.341716 Aug 10 23:14:19.097751 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1901/3655] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:14:18 2022] POST /compute/v2.1/servers/f4dc6241-b173-4cbf-b76c-7da3fac7edcc/action => generated 0 bytes in 349 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:14:19.105879 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-3cfeed44-8bd2-4fe3-aad3-42ce7302adf6 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:19.106676 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-3cfeed44-8bd2-4fe3-aad3-42ce7302adf6 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: 3efc12c9-baf5-40e4-9d98-e72d28377db6] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:19.116021 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3cfeed44-8bd2-4fe3-aad3-42ce7302adf6 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:19.116787 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3cfeed44-8bd2-4fe3-aad3-42ce7302adf6 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:19.119118 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3cfeed44-8bd2-4fe3-aad3-42ce7302adf6 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:19.120368 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3cfeed44-8bd2-4fe3-aad3-42ce7302adf6 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:19.135882 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3cfeed44-8bd2-4fe3-aad3-42ce7302adf6 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:19.136770 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3cfeed44-8bd2-4fe3-aad3-42ce7302adf6 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:19.187779 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.network.neutron [None req-aa25f9cd-5852-429b-8324-55e198f16692 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] validate_networks() for [('042efc3d-5a07-4ef1-a5d1-285928545eba', None, None, None, None, None)] {{(pid=122632) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 23:14:19.849951 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-3cfeed44-8bd2-4fe3-aad3-42ce7302adf6 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:19.861021 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-3cfeed44-8bd2-4fe3-aad3-42ce7302adf6 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/3efc12c9-baf5-40e4-9d98-e72d28377db6" status: 200 len: 1511 microversion: 2.1 time: 0.761435 Aug 10 23:14:19.869460 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1902/3656] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:19 2022] GET /compute/v2.1/servers/3efc12c9-baf5-40e4-9d98-e72d28377db6 => generated 1511 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:19.888860 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-03c072ee-7c84-43ed-91cd-e7117482469a tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:19.889481 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-03c072ee-7c84-43ed-91cd-e7117482469a tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] [instance: 27dd09d6-47ed-4b55-bd02-baad36a28429] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:19.903978 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-03c072ee-7c84-43ed-91cd-e7117482469a tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:19.909125 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-03c072ee-7c84-43ed-91cd-e7117482469a tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:19.909711 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-03c072ee-7c84-43ed-91cd-e7117482469a tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:19.910488 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-03c072ee-7c84-43ed-91cd-e7117482469a tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:19.910998 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-03c072ee-7c84-43ed-91cd-e7117482469a tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:19.911436 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-03c072ee-7c84-43ed-91cd-e7117482469a tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:20.051649 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-03c072ee-7c84-43ed-91cd-e7117482469a tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07c94ebf0954cdea12b9a689538d96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395d7c4077e54c43bb95288db3942b0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:20.069615 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-03c072ee-7c84-43ed-91cd-e7117482469a tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] 10.222.0.58 "GET /compute/v2.1/servers/27dd09d6-47ed-4b55-bd02-baad36a28429" status: 200 len: 1274 microversion: 2.1 time: 0.184871 Aug 10 23:14:20.087795 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1903/3657] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:19 2022] GET /compute/v2.1/servers/27dd09d6-47ed-4b55-bd02-baad36a28429 => generated 1274 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:20.087795 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-0eaa43a3-343b-47a2-921e-68fda80421c8 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:20.087795 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-0eaa43a3-343b-47a2-921e-68fda80421c8 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:20.132371 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0eaa43a3-343b-47a2-921e-68fda80421c8 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:20.136114 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0eaa43a3-343b-47a2-921e-68fda80421c8 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:20.136841 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0eaa43a3-343b-47a2-921e-68fda80421c8 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:20.141728 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0eaa43a3-343b-47a2-921e-68fda80421c8 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:20.143376 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0eaa43a3-343b-47a2-921e-68fda80421c8 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:20.145304 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0eaa43a3-343b-47a2-921e-68fda80421c8 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:20.884665 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-0eaa43a3-343b-47a2-921e-68fda80421c8 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:20.901646 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-0eaa43a3-343b-47a2-921e-68fda80421c8 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b" status: 200 len: 1506 microversion: 2.1 time: 0.829586 Aug 10 23:14:20.902874 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1904/3658] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:20 2022] GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b => generated 1506 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:20.922409 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-723b9f51-e7db-4b35-a1c0-f96b99634d97 tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:20.923337 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-723b9f51-e7db-4b35-a1c0-f96b99634d97 tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] [instance: 325ce83e-53e6-4021-b1a1-548ff5057761] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:20.933928 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-723b9f51-e7db-4b35-a1c0-f96b99634d97 tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:20.935839 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-723b9f51-e7db-4b35-a1c0-f96b99634d97 tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:20.936713 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-723b9f51-e7db-4b35-a1c0-f96b99634d97 tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:20.945970 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-723b9f51-e7db-4b35-a1c0-f96b99634d97 tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:20.946633 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-723b9f51-e7db-4b35-a1c0-f96b99634d97 tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:20.947291 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-723b9f51-e7db-4b35-a1c0-f96b99634d97 tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:21.192796 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-723b9f51-e7db-4b35-a1c0-f96b99634d97 tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39eef3efd444a6d8192f405cba67f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee72843cb8064834bdbc02d8a5417f71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:21.239230 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-723b9f51-e7db-4b35-a1c0-f96b99634d97 tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39eef3efd444a6d8192f405cba67f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee72843cb8064834bdbc02d8a5417f71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:21.241045 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-723b9f51-e7db-4b35-a1c0-f96b99634d97 tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39eef3efd444a6d8192f405cba67f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee72843cb8064834bdbc02d8a5417f71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:21.242319 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-723b9f51-e7db-4b35-a1c0-f96b99634d97 tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] 10.222.0.58 "GET /compute/v2.1/servers/325ce83e-53e6-4021-b1a1-548ff5057761" status: 200 len: 1311 microversion: 2.21 time: 0.338186 Aug 10 23:14:21.249631 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1905/3659] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:14:20 2022] GET /compute/v2.1/servers/325ce83e-53e6-4021-b1a1-548ff5057761 => generated 1311 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:14:21.263331 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-3e42f9ad-d23a-4557-a2ea-4665d5643cda tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:21.264217 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-3e42f9ad-d23a-4557-a2ea-4665d5643cda tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] [instance: f4dc6241-b173-4cbf-b76c-7da3fac7edcc] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:21.270646 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3e42f9ad-d23a-4557-a2ea-4665d5643cda tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:21.271184 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3e42f9ad-d23a-4557-a2ea-4665d5643cda tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:21.271631 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3e42f9ad-d23a-4557-a2ea-4665d5643cda tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:21.272337 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3e42f9ad-d23a-4557-a2ea-4665d5643cda tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:21.273009 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3e42f9ad-d23a-4557-a2ea-4665d5643cda tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:21.273522 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3e42f9ad-d23a-4557-a2ea-4665d5643cda tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:21.591197 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-aa25f9cd-5852-429b-8324-55e198f16692 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Flavor limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:14:21.599640 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-aa25f9cd-5852-429b-8324-55e198f16692 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Image limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:14:21.600556 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-aa25f9cd-5852-429b-8324-55e198f16692 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Flavor pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:14:21.601398 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-aa25f9cd-5852-429b-8324-55e198f16692 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Image pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:14:21.602591 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-aa25f9cd-5852-429b-8324-55e198f16692 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:14:21.616671 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-aa25f9cd-5852-429b-8324-55e198f16692 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:21.617789 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-aa25f9cd-5852-429b-8324-55e198f16692 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:21.618656 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-aa25f9cd-5852-429b-8324-55e198f16692 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:21.619722 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-aa25f9cd-5852-429b-8324-55e198f16692 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:21.620442 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-aa25f9cd-5852-429b-8324-55e198f16692 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:21.621090 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-aa25f9cd-5852-429b-8324-55e198f16692 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:21.662689 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-aa25f9cd-5852-429b-8324-55e198f16692 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Getting quotas for project 7d90f8a58ad047fa8f347d6474e4d673. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:14:21.674546 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-aa25f9cd-5852-429b-8324-55e198f16692 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Getting quotas for user 3c6160c7a42740efbe3613380933fa15 and project 7d90f8a58ad047fa8f347d6474e4d673. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:14:21.696546 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-aa25f9cd-5852-429b-8324-55e198f16692 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Going to run 1 instances... {{(pid=122632) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 23:14:21.699206 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-aa25f9cd-5852-429b-8324-55e198f16692 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: 7a8f8d36-4744-43b7-9d42-e50fb5fabe60] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78ad8905-f66f-4733-8be9-2b260f1fabed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122632) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 23:14:21.759476 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-aa25f9cd-5852-429b-8324-55e198f16692 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.791523 Aug 10 23:14:21.761064 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1755/3660] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 23:14:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 2794 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 23:14:21.767899 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-77df1d8c-5a9b-4eb7-ad6f-1380904a3392 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1203314874", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:14:21.842518 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.network.neutron [None req-77df1d8c-5a9b-4eb7-ad6f-1380904a3392 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] validate_networks() for [('6cf41fc6-d8ed-4aac-8496-23731f15bebe', None, None, None, None, None)] {{(pid=122632) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 23:14:22.474552 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-3e42f9ad-d23a-4557-a2ea-4665d5643cda tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5899b2ad9f1046caaf7c6073e408eeee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25abd63376614081a9d484f3c9ae950d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:22.488019 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-3e42f9ad-d23a-4557-a2ea-4665d5643cda tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "GET /compute/v2.1/servers/f4dc6241-b173-4cbf-b76c-7da3fac7edcc" status: 200 len: 1689 microversion: 2.1 time: 1.236477 Aug 10 23:14:22.488794 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1906/3661] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:21 2022] GET /compute/v2.1/servers/f4dc6241-b173-4cbf-b76c-7da3fac7edcc => generated 1689 bytes in 1238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:22.494908 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-5ee2d46c-c3a7-41aa-96f9-27d536dad367 req-4a2eb574-4c75-40b3-befd-dcb5ca3849d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4dc6241-b173-4cbf-b76c-7da3fac7edcc", "name": "network-vif-plugged", "status": "completed", "tag": "d3cf5f02-4cda-4d1b-9314-92bc05402960"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:14:22.531784 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-5ee2d46c-c3a7-41aa-96f9-27d536dad367 req-4a2eb574-4c75-40b3-befd-dcb5ca3849d2 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:22.532502 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-5ee2d46c-c3a7-41aa-96f9-27d536dad367 req-4a2eb574-4c75-40b3-befd-dcb5ca3849d2 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:22.534239 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-5ee2d46c-c3a7-41aa-96f9-27d536dad367 req-4a2eb574-4c75-40b3-befd-dcb5ca3849d2 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:22.556253 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-5ee2d46c-c3a7-41aa-96f9-27d536dad367 req-4a2eb574-4c75-40b3-befd-dcb5ca3849d2 service nova] Creating event network-vif-plugged:d3cf5f02-4cda-4d1b-9314-92bc05402960 for instance f4dc6241-b173-4cbf-b76c-7da3fac7edcc on n-h2-850468-14 Aug 10 23:14:22.562329 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:14:22.567568 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [req-5ee2d46c-c3a7-41aa-96f9-27d536dad367 req-4a2eb574-4c75-40b3-befd-dcb5ca3849d2 service nova] Instance f4dc6241-b173-4cbf-b76c-7da3fac7edcc is migrating within the same cell, copying events to all relevant hosts: {'n-h1-850468-14', 'n-h2-850468-14'} {{(pid=122633) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5901}} Aug 10 23:14:22.581770 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-5ee2d46c-c3a7-41aa-96f9-27d536dad367 req-4a2eb574-4c75-40b3-befd-dcb5ca3849d2 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091447 Aug 10 23:14:22.582908 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1907/3662] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:14:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:14:22.590761 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-8c250da5-2369-4e2e-9144-d3f4ae0bb69e tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:22.591700 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-8c250da5-2369-4e2e-9144-d3f4ae0bb69e tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: 3efc12c9-baf5-40e4-9d98-e72d28377db6] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:22.599309 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8c250da5-2369-4e2e-9144-d3f4ae0bb69e tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:22.599801 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8c250da5-2369-4e2e-9144-d3f4ae0bb69e tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:22.600305 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8c250da5-2369-4e2e-9144-d3f4ae0bb69e tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:22.601677 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8c250da5-2369-4e2e-9144-d3f4ae0bb69e tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:22.602725 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8c250da5-2369-4e2e-9144-d3f4ae0bb69e tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:22.603185 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8c250da5-2369-4e2e-9144-d3f4ae0bb69e tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:23.225924 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-8c250da5-2369-4e2e-9144-d3f4ae0bb69e tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:23.241666 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-8c250da5-2369-4e2e-9144-d3f4ae0bb69e tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/3efc12c9-baf5-40e4-9d98-e72d28377db6" status: 200 len: 1511 microversion: 2.1 time: 0.657382 Aug 10 23:14:23.242567 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1908/3663] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:22 2022] GET /compute/v2.1/servers/3efc12c9-baf5-40e4-9d98-e72d28377db6 => generated 1511 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:23.259500 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-860dce0c-4338-409e-ba0b-075c118d93fa tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-587264386", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "91d0258a-9486-4479-91e9-a6d9339a2e0a"}]}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:14:23.264020 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-860dce0c-4338-409e-ba0b-075c118d93fa tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Request method failure captured: Aug 10 23:14:23.264020 n-d-850468-14 devstack@n-api.service[122633]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 10 23:14:23.264020 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:14:23.264020 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:14:23.264020 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:14:23.264020 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 491 Aug 10 23:14:23.264020 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:14:23.264020 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:14:23.264020 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:14:23.264020 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:14:23.264020 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9DuIKrfOsS8tKST0PsIPrvuNPfsVISfOPvUoe9ddkVcTJKj7rDjd3OuH9u-DTT1aypj1AUoUKtajD98eDOUOHSpPisBSdRlSCov30lHf1uZq-XZLyBIVg5kAG8-SuXk2s1TL7EnRcjjMARSkm95dZDnXaBXRT3M4f8UoMDwqu7xK7gQ Aug 10 23:14:23.264020 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:14:23.264020 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:14:23.264020 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:14:23.264020 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:14:23.264020 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:14:23.264020 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:14:23.264020 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: d11bbb3e87f4463787da56ab19108822 Aug 10 23:14:23.264020 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-ServersNegativeTestJSON-1216728002 Aug 10 23:14:23.264020 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:14:23.264020 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:14:23.264020 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d11bbb3e87f4463787da56ab19108822"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d11bbb3e87f4463787da56ab19108822"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d11bbb3e87f4463787da56ab19108822"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d11bbb3e87f4463787da56ab19108822", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:14:23.264020 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-ServersNegativeTestJSON-1216728002 Aug 10 23:14:23.264020 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: d11bbb3e87f4463787da56ab19108822 Aug 10 23:14:23.264020 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1216728002 Aug 10 23:14:23.264020 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-ServersNegativeTestJSON-1216728002-project Aug 10 23:14:23.264020 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:14:23.264020 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:14:23.264020 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: f284ec2a4bf546b58c1c1adaf880e1fb Aug 10 23:14:23.264020 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-ServersNegativeTestJSON-1216728002-project Aug 10 23:14:23.264020 n-d-850468-14 devstack@n-api.service[122633]: Aug 10 23:14:23.264020 n-d-850468-14 devstack@n-api.service[122633]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-587264386", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "91d0258a-9486-4479-91e9-a6d9339a2e0a"}]}} Aug 10 23:14:23.264020 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:14:23.264020 n-d-850468-14 devstack@n-api.service[122633]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Aug 10 23:14:23.264020 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-587264386', 'imageRef': '78ad8905-f66f-4733-8be9-2b260f1fabed', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': '91d0258a-9486-4479-91e9-a6d9339a2e0a'}]}}} Aug 10 23:14:23.264020 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:14:23.264020 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:14:23.264020 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 10 23:14:23.264020 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 10 23:14:23.264020 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 10 23:14:23.264020 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise error Aug 10 23:14:23.264020 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Aug 10 23:14:23.264020 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:14:23.264020 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: Aug 10 23:14:23.264020 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} Aug 10 23:14:23.264020 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:14:23.264020 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: Aug 10 23:14:23.267252 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' Aug 10 23:14:23.267252 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:14:23.267252 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:14:23.267252 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:14:23.267252 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:14:23.267252 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:14:23.267252 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:14:23.267252 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:14:23.267252 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:14:23.267252 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:14:23.267252 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:14:23.267252 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 23:14:23.267252 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 23:14:23.267252 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 10 23:14:23.267252 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 10 23:14:23.267252 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 10 23:14:23.267252 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 10 23:14:23.267252 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 10 23:14:23.267252 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 10 23:14:23.267252 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Aug 10 23:14:23.267252 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:14:23.267252 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:14:23.267252 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:14:23.267252 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:14:23.267252 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:14:23.267252 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:14:23.267252 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 10 23:14:23.267252 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 10 23:14:23.267252 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Aug 10 23:14:23.267252 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:14:23.269940 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-860dce0c-4338-409e-ba0b-075c118d93fa tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:14:23.271970 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-860dce0c-4338-409e-ba0b-075c118d93fa tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.028281 Aug 10 23:14:23.283817 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1909/3664] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 23:14:23 2022] POST /compute/v2.1/servers => generated 624 bytes in 40 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 10 23:14:23.290151 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-484638bc-0f14-455a-a574-1db29e51bac6 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:23.291239 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-484638bc-0f14-455a-a574-1db29e51bac6 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: 7a8f8d36-4744-43b7-9d42-e50fb5fabe60] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:23.311838 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-484638bc-0f14-455a-a574-1db29e51bac6 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:23.312576 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-484638bc-0f14-455a-a574-1db29e51bac6 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:23.313211 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-484638bc-0f14-455a-a574-1db29e51bac6 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:23.314138 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-484638bc-0f14-455a-a574-1db29e51bac6 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:23.314803 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-484638bc-0f14-455a-a574-1db29e51bac6 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:23.315423 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-484638bc-0f14-455a-a574-1db29e51bac6 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:23.331311 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-77df1d8c-5a9b-4eb7-ad6f-1380904a3392 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Flavor limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:14:23.333579 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-77df1d8c-5a9b-4eb7-ad6f-1380904a3392 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Image limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:14:23.335103 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-77df1d8c-5a9b-4eb7-ad6f-1380904a3392 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Flavor pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:14:23.337055 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-77df1d8c-5a9b-4eb7-ad6f-1380904a3392 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Image pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:14:23.338011 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-77df1d8c-5a9b-4eb7-ad6f-1380904a3392 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:14:23.365502 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-77df1d8c-5a9b-4eb7-ad6f-1380904a3392 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:23.366946 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-77df1d8c-5a9b-4eb7-ad6f-1380904a3392 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:23.370172 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-77df1d8c-5a9b-4eb7-ad6f-1380904a3392 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:23.371273 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-77df1d8c-5a9b-4eb7-ad6f-1380904a3392 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:23.372266 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-77df1d8c-5a9b-4eb7-ad6f-1380904a3392 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:23.372881 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-77df1d8c-5a9b-4eb7-ad6f-1380904a3392 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:23.413320 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-77df1d8c-5a9b-4eb7-ad6f-1380904a3392 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Getting quotas for project 395d7c4077e54c43bb95288db3942b0a. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:14:23.424357 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-77df1d8c-5a9b-4eb7-ad6f-1380904a3392 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Getting quotas for user f07c94ebf0954cdea12b9a689538d96d and project 395d7c4077e54c43bb95288db3942b0a. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:14:23.444674 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-77df1d8c-5a9b-4eb7-ad6f-1380904a3392 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Going to run 1 instances... {{(pid=122632) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 23:14:23.448099 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-77df1d8c-5a9b-4eb7-ad6f-1380904a3392 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] [instance: 7df225be-2dbc-4ef6-aeec-9a3de33a0006] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78ad8905-f66f-4733-8be9-2b260f1fabed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122632) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 23:14:23.474827 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-484638bc-0f14-455a-a574-1db29e51bac6 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6160c7a42740efbe3613380933fa15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d90f8a58ad047fa8f347d6474e4d673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:23.492646 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-484638bc-0f14-455a-a574-1db29e51bac6 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "GET /compute/v2.1/servers/7a8f8d36-4744-43b7-9d42-e50fb5fabe60" status: 200 len: 1284 microversion: 2.1 time: 0.206733 Aug 10 23:14:23.495099 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1910/3665] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:23 2022] GET /compute/v2.1/servers/7a8f8d36-4744-43b7-9d42-e50fb5fabe60 => generated 1284 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:23.504601 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-22d0c3a1-dd36-4771-b0f8-d9b42fde816e tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:23.505542 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-22d0c3a1-dd36-4771-b0f8-d9b42fde816e tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] [instance: 325ce83e-53e6-4021-b1a1-548ff5057761] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:23.521701 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-77df1d8c-5a9b-4eb7-ad6f-1380904a3392 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.759307 Aug 10 23:14:23.522643 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1756/3666] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 23:14:21 2022] POST /compute/v2.1/servers => generated 383 bytes in 1761 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 23:14:23.528652 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-57313c3e-bfa0-4fa8-b778-319190147d70 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:23.529481 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-57313c3e-bfa0-4fa8-b778-319190147d70 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:23.535836 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-22d0c3a1-dd36-4771-b0f8-d9b42fde816e tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:23.539792 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-22d0c3a1-dd36-4771-b0f8-d9b42fde816e tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:23.540032 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-57313c3e-bfa0-4fa8-b778-319190147d70 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:23.540675 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-57313c3e-bfa0-4fa8-b778-319190147d70 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:23.541261 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-22d0c3a1-dd36-4771-b0f8-d9b42fde816e tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:23.541403 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-57313c3e-bfa0-4fa8-b778-319190147d70 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:23.542371 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-57313c3e-bfa0-4fa8-b778-319190147d70 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:23.543017 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-57313c3e-bfa0-4fa8-b778-319190147d70 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:23.543635 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-57313c3e-bfa0-4fa8-b778-319190147d70 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:23.545101 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-22d0c3a1-dd36-4771-b0f8-d9b42fde816e tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:23.546819 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-22d0c3a1-dd36-4771-b0f8-d9b42fde816e tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:23.547424 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-22d0c3a1-dd36-4771-b0f8-d9b42fde816e tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:23.689062 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-22d0c3a1-dd36-4771-b0f8-d9b42fde816e tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39eef3efd444a6d8192f405cba67f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee72843cb8064834bdbc02d8a5417f71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:23.702896 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-22d0c3a1-dd36-4771-b0f8-d9b42fde816e tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39eef3efd444a6d8192f405cba67f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee72843cb8064834bdbc02d8a5417f71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:23.707343 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-22d0c3a1-dd36-4771-b0f8-d9b42fde816e tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39eef3efd444a6d8192f405cba67f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee72843cb8064834bdbc02d8a5417f71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:23.709813 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-22d0c3a1-dd36-4771-b0f8-d9b42fde816e tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] 10.222.0.58 "GET /compute/v2.1/servers/325ce83e-53e6-4021-b1a1-548ff5057761" status: 200 len: 1317 microversion: 2.21 time: 0.209480 Aug 10 23:14:23.714730 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1911/3667] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:14:23 2022] GET /compute/v2.1/servers/325ce83e-53e6-4021-b1a1-548ff5057761 => generated 1317 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:14:23.720043 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-23908973-5335-4eb3-95c4-bdc4ccec8413 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:23.723824 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-23908973-5335-4eb3-95c4-bdc4ccec8413 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] [instance: f4dc6241-b173-4cbf-b76c-7da3fac7edcc] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:23.743422 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-23908973-5335-4eb3-95c4-bdc4ccec8413 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:23.744040 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-23908973-5335-4eb3-95c4-bdc4ccec8413 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:23.744914 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-23908973-5335-4eb3-95c4-bdc4ccec8413 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:23.745913 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-23908973-5335-4eb3-95c4-bdc4ccec8413 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:23.746472 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-23908973-5335-4eb3-95c4-bdc4ccec8413 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:23.747157 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-23908973-5335-4eb3-95c4-bdc4ccec8413 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:24.188179 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-57313c3e-bfa0-4fa8-b778-319190147d70 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:24.196759 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-57313c3e-bfa0-4fa8-b778-319190147d70 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b" status: 200 len: 1506 microversion: 2.1 time: 0.672763 Aug 10 23:14:24.197769 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1757/3668] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:23 2022] GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b => generated 1506 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:24.218270 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-2bb7814c-ed85-48a8-aca8-00f98ad20a3d tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:24.219182 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-2bb7814c-ed85-48a8-aca8-00f98ad20a3d tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] [instance: 7df225be-2dbc-4ef6-aeec-9a3de33a0006] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:24.225822 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2bb7814c-ed85-48a8-aca8-00f98ad20a3d tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:24.227109 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2bb7814c-ed85-48a8-aca8-00f98ad20a3d tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:24.227708 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2bb7814c-ed85-48a8-aca8-00f98ad20a3d tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:24.228597 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2bb7814c-ed85-48a8-aca8-00f98ad20a3d tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:24.229219 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2bb7814c-ed85-48a8-aca8-00f98ad20a3d tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:24.229825 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2bb7814c-ed85-48a8-aca8-00f98ad20a3d tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:24.383629 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-2bb7814c-ed85-48a8-aca8-00f98ad20a3d tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07c94ebf0954cdea12b9a689538d96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395d7c4077e54c43bb95288db3942b0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:24.391519 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-2bb7814c-ed85-48a8-aca8-00f98ad20a3d tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] 10.222.0.58 "GET /compute/v2.1/servers/7df225be-2dbc-4ef6-aeec-9a3de33a0006" status: 200 len: 1226 microversion: 2.1 time: 0.179108 Aug 10 23:14:24.396671 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1758/3669] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:24 2022] GET /compute/v2.1/servers/7df225be-2dbc-4ef6-aeec-9a3de33a0006 => generated 1226 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:24.402624 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-84473a81-aa45-49d6-8254-e8a1b563aee8 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:24.412800 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-84473a81-aa45-49d6-8254-e8a1b563aee8 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:24.433795 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-84473a81-aa45-49d6-8254-e8a1b563aee8 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:24.437448 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-84473a81-aa45-49d6-8254-e8a1b563aee8 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:24.438290 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-84473a81-aa45-49d6-8254-e8a1b563aee8 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:24.441425 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-84473a81-aa45-49d6-8254-e8a1b563aee8 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:24.442094 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-84473a81-aa45-49d6-8254-e8a1b563aee8 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:24.442686 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-84473a81-aa45-49d6-8254-e8a1b563aee8 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:24.478526 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-23908973-5335-4eb3-95c4-bdc4ccec8413 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5899b2ad9f1046caaf7c6073e408eeee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25abd63376614081a9d484f3c9ae950d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:24.489688 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-23908973-5335-4eb3-95c4-bdc4ccec8413 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "GET /compute/v2.1/servers/f4dc6241-b173-4cbf-b76c-7da3fac7edcc" status: 200 len: 1681 microversion: 2.1 time: 0.773604 Aug 10 23:14:24.495221 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1912/3670] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:23 2022] GET /compute/v2.1/servers/f4dc6241-b173-4cbf-b76c-7da3fac7edcc => generated 1681 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:24.509787 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-683de95a-9e2d-41a6-b05b-e14bc6f760f8 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:24.510605 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-683de95a-9e2d-41a6-b05b-e14bc6f760f8 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: 3efc12c9-baf5-40e4-9d98-e72d28377db6] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:24.532547 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-683de95a-9e2d-41a6-b05b-e14bc6f760f8 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:24.533406 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-683de95a-9e2d-41a6-b05b-e14bc6f760f8 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:24.534090 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-683de95a-9e2d-41a6-b05b-e14bc6f760f8 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:24.547203 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-683de95a-9e2d-41a6-b05b-e14bc6f760f8 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:24.548194 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-683de95a-9e2d-41a6-b05b-e14bc6f760f8 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:24.548850 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-683de95a-9e2d-41a6-b05b-e14bc6f760f8 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:24.935285 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-84473a81-aa45-49d6-8254-e8a1b563aee8 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:24.950567 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-84473a81-aa45-49d6-8254-e8a1b563aee8 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b" status: 200 len: 1506 microversion: 2.1 time: 0.551456 Aug 10 23:14:24.951224 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1759/3671] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:24 2022] GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b => generated 1506 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:24.967387 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c3db10ff-ae66-4644-b35f-8a57b772e95f tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:24.967387 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-c3db10ff-ae66-4644-b35f-8a57b772e95f tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: 7a8f8d36-4744-43b7-9d42-e50fb5fabe60] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:24.982288 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c3db10ff-ae66-4644-b35f-8a57b772e95f tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:24.982856 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c3db10ff-ae66-4644-b35f-8a57b772e95f tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:24.983297 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c3db10ff-ae66-4644-b35f-8a57b772e95f tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:24.990100 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c3db10ff-ae66-4644-b35f-8a57b772e95f tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:24.990847 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c3db10ff-ae66-4644-b35f-8a57b772e95f tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:24.991444 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c3db10ff-ae66-4644-b35f-8a57b772e95f tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:25.835834 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-c3db10ff-ae66-4644-b35f-8a57b772e95f tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6160c7a42740efbe3613380933fa15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d90f8a58ad047fa8f347d6474e4d673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:25.846362 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-c3db10ff-ae66-4644-b35f-8a57b772e95f tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "GET /compute/v2.1/servers/7a8f8d36-4744-43b7-9d42-e50fb5fabe60" status: 200 len: 1314 microversion: 2.1 time: 0.892894 Aug 10 23:14:25.855267 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1760/3672] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:24 2022] GET /compute/v2.1/servers/7a8f8d36-4744-43b7-9d42-e50fb5fabe60 => generated 1314 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:25.861240 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-67ef5f8c-8501-46aa-b096-1cb79180d5d5 tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:25.865598 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-67ef5f8c-8501-46aa-b096-1cb79180d5d5 tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] [instance: 325ce83e-53e6-4021-b1a1-548ff5057761] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:25.881357 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-683de95a-9e2d-41a6-b05b-e14bc6f760f8 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:25.883767 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-67ef5f8c-8501-46aa-b096-1cb79180d5d5 tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:25.884161 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-67ef5f8c-8501-46aa-b096-1cb79180d5d5 tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:25.884697 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-67ef5f8c-8501-46aa-b096-1cb79180d5d5 tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:25.885627 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-67ef5f8c-8501-46aa-b096-1cb79180d5d5 tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:25.886277 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-67ef5f8c-8501-46aa-b096-1cb79180d5d5 tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:25.886867 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-67ef5f8c-8501-46aa-b096-1cb79180d5d5 tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:25.897575 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-683de95a-9e2d-41a6-b05b-e14bc6f760f8 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/3efc12c9-baf5-40e4-9d98-e72d28377db6" status: 200 len: 1511 microversion: 2.1 time: 1.399945 Aug 10 23:14:25.901485 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1913/3673] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:24 2022] GET /compute/v2.1/servers/3efc12c9-baf5-40e4-9d98-e72d28377db6 => generated 1511 bytes in 1406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:25.919410 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-78da79d5-f335-4759-9265-c7eac0b2e94c tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452", "networks": [{"uuid": "91d0258a-9486-4479-91e9-a6d9339a2e0a"}]}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:14:25.924801 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-78da79d5-f335-4759-9265-c7eac0b2e94c tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Request method failure captured: Aug 10 23:14:25.924801 n-d-850468-14 devstack@n-api.service[122633]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 10 23:14:25.924801 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:14:25.924801 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:14:25.924801 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:14:25.924801 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 416 Aug 10 23:14:25.924801 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:14:25.924801 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:14:25.924801 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:14:25.924801 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:14:25.924801 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9DuIKrfOsS8tKST0PsIPrvuNPfsVISfOPvUoe9ddkVcTJKj7rDjd3OuH9u-DTT1aypj1AUoUKtajD98eDOUOHSpPisBSdRlSCov30lHf1uZq-XZLyBIVg5kAG8-SuXk2s1TL7EnRcjjMARSkm95dZDnXaBXRT3M4f8UoMDwqu7xK7gQ Aug 10 23:14:25.924801 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:14:25.924801 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:14:25.924801 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:14:25.924801 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:14:25.924801 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:14:25.924801 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:14:25.924801 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: d11bbb3e87f4463787da56ab19108822 Aug 10 23:14:25.924801 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-ServersNegativeTestJSON-1216728002 Aug 10 23:14:25.924801 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:14:25.924801 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:14:25.924801 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d11bbb3e87f4463787da56ab19108822"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d11bbb3e87f4463787da56ab19108822"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d11bbb3e87f4463787da56ab19108822"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d11bbb3e87f4463787da56ab19108822", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:14:25.924801 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-ServersNegativeTestJSON-1216728002 Aug 10 23:14:25.924801 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: d11bbb3e87f4463787da56ab19108822 Aug 10 23:14:25.924801 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1216728002 Aug 10 23:14:25.924801 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-ServersNegativeTestJSON-1216728002-project Aug 10 23:14:25.924801 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:14:25.924801 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:14:25.924801 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: f284ec2a4bf546b58c1c1adaf880e1fb Aug 10 23:14:25.924801 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-ServersNegativeTestJSON-1216728002-project Aug 10 23:14:25.924801 n-d-850468-14 devstack@n-api.service[122633]: Aug 10 23:14:25.924801 n-d-850468-14 devstack@n-api.service[122633]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452", "networks": [{"uuid": "91d0258a-9486-4479-91e9-a6d9339a2e0a"}]}} Aug 10 23:14:25.924801 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:14:25.924801 n-d-850468-14 devstack@n-api.service[122633]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 10 23:14:25.924801 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': '78ad8905-f66f-4733-8be9-2b260f1fabed', 'flavorRef': '452', 'networks': [{'uuid': '91d0258a-9486-4479-91e9-a6d9339a2e0a'}]}}} Aug 10 23:14:25.924801 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:14:25.924801 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:14:25.924801 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 10 23:14:25.924801 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 10 23:14:25.924801 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 10 23:14:25.924801 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise error Aug 10 23:14:25.924801 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 10 23:14:25.924801 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:14:25.924801 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Aug 10 23:14:25.924801 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 10 23:14:25.924801 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:14:25.924801 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 10 23:14:25.924801 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 10 23:14:25.924801 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:14:25.924801 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:14:25.928324 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:14:25.928324 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:14:25.928324 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:14:25.928324 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:14:25.928324 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:14:25.928324 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:14:25.928324 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:14:25.928324 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:14:25.928324 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 23:14:25.928324 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 23:14:25.928324 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 10 23:14:25.928324 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 10 23:14:25.928324 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 10 23:14:25.928324 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 10 23:14:25.928324 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 10 23:14:25.928324 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 10 23:14:25.928324 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 10 23:14:25.928324 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:14:25.928324 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:14:25.928324 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:14:25.928324 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:14:25.928324 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:14:25.928324 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:14:25.928324 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 10 23:14:25.928324 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 10 23:14:25.928324 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 10 23:14:25.928324 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:14:25.932593 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-78da79d5-f335-4759-9265-c7eac0b2e94c tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:14:25.935024 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-78da79d5-f335-4759-9265-c7eac0b2e94c tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.029371 Aug 10 23:14:25.939709 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1914/3674] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 23:14:25 2022] POST /compute/v2.1/servers => generated 619 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 10 23:14:25.947791 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-58e17b6d-bb70-4d72-b3cf-468f3f3c08d4 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:25.948765 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-58e17b6d-bb70-4d72-b3cf-468f3f3c08d4 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] [instance: 7df225be-2dbc-4ef6-aeec-9a3de33a0006] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:25.958140 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-58e17b6d-bb70-4d72-b3cf-468f3f3c08d4 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:25.959513 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-58e17b6d-bb70-4d72-b3cf-468f3f3c08d4 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:25.960992 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-58e17b6d-bb70-4d72-b3cf-468f3f3c08d4 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:25.962110 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-58e17b6d-bb70-4d72-b3cf-468f3f3c08d4 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:25.963520 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-58e17b6d-bb70-4d72-b3cf-468f3f3c08d4 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:25.964634 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-58e17b6d-bb70-4d72-b3cf-468f3f3c08d4 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:26.274255 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-58e17b6d-bb70-4d72-b3cf-468f3f3c08d4 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07c94ebf0954cdea12b9a689538d96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395d7c4077e54c43bb95288db3942b0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:26.285640 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-58e17b6d-bb70-4d72-b3cf-468f3f3c08d4 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] 10.222.0.58 "GET /compute/v2.1/servers/7df225be-2dbc-4ef6-aeec-9a3de33a0006" status: 200 len: 1280 microversion: 2.1 time: 0.344573 Aug 10 23:14:26.286502 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1915/3675] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:25 2022] GET /compute/v2.1/servers/7df225be-2dbc-4ef6-aeec-9a3de33a0006 => generated 1280 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:26.303017 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-582be0a5-d761-4fb8-a5a2-26cf10c3776d tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:26.303609 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-582be0a5-d761-4fb8-a5a2-26cf10c3776d tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:26.316928 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-582be0a5-d761-4fb8-a5a2-26cf10c3776d tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:26.320078 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-582be0a5-d761-4fb8-a5a2-26cf10c3776d tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:26.321188 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-582be0a5-d761-4fb8-a5a2-26cf10c3776d tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:26.322984 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-582be0a5-d761-4fb8-a5a2-26cf10c3776d tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:26.323505 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-582be0a5-d761-4fb8-a5a2-26cf10c3776d tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:26.324809 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-582be0a5-d761-4fb8-a5a2-26cf10c3776d tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:26.880671 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-67ef5f8c-8501-46aa-b096-1cb79180d5d5 tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39eef3efd444a6d8192f405cba67f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee72843cb8064834bdbc02d8a5417f71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:26.899140 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-67ef5f8c-8501-46aa-b096-1cb79180d5d5 tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39eef3efd444a6d8192f405cba67f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee72843cb8064834bdbc02d8a5417f71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:26.902245 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-67ef5f8c-8501-46aa-b096-1cb79180d5d5 tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39eef3efd444a6d8192f405cba67f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee72843cb8064834bdbc02d8a5417f71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:26.903725 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-67ef5f8c-8501-46aa-b096-1cb79180d5d5 tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] 10.222.0.58 "GET /compute/v2.1/servers/325ce83e-53e6-4021-b1a1-548ff5057761" status: 200 len: 1359 microversion: 2.21 time: 1.047328 Aug 10 23:14:26.905135 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1761/3676] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:14:25 2022] GET /compute/v2.1/servers/325ce83e-53e6-4021-b1a1-548ff5057761 => generated 1359 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:14:26.913217 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-b7c88cda-bc75-467f-99bd-89fa63664ae1 req-8ecf0470-b521-4430-b4d1-064056adbeef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27dd09d6-47ed-4b55-bd02-baad36a28429", "tag": "be28e077-8bcf-4598-b8d5-d46262e4d7fb"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:14:26.932041 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-b7c88cda-bc75-467f-99bd-89fa63664ae1 req-8ecf0470-b521-4430-b4d1-064056adbeef service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:26.932858 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-b7c88cda-bc75-467f-99bd-89fa63664ae1 req-8ecf0470-b521-4430-b4d1-064056adbeef service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:26.933724 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-b7c88cda-bc75-467f-99bd-89fa63664ae1 req-8ecf0470-b521-4430-b4d1-064056adbeef service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:26.969730 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-b7c88cda-bc75-467f-99bd-89fa63664ae1 req-8ecf0470-b521-4430-b4d1-064056adbeef service nova] Creating event network-changed:be28e077-8bcf-4598-b8d5-d46262e4d7fb for instance 27dd09d6-47ed-4b55-bd02-baad36a28429 on n-h2-850468-14 Aug 10 23:14:26.983953 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-b7c88cda-bc75-467f-99bd-89fa63664ae1 req-8ecf0470-b521-4430-b4d1-064056adbeef service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075654 Aug 10 23:14:26.984597 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1762/3677] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:14:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:14:26.991418 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-4a938677-085b-453b-ad89-2877ca5ef1b0 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:26.992182 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-4a938677-085b-453b-ad89-2877ca5ef1b0 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: 7a8f8d36-4744-43b7-9d42-e50fb5fabe60] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:27.005953 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4a938677-085b-453b-ad89-2877ca5ef1b0 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:27.006553 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4a938677-085b-453b-ad89-2877ca5ef1b0 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:27.008556 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4a938677-085b-453b-ad89-2877ca5ef1b0 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:27.009979 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4a938677-085b-453b-ad89-2877ca5ef1b0 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:27.010634 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4a938677-085b-453b-ad89-2877ca5ef1b0 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:27.011255 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4a938677-085b-453b-ad89-2877ca5ef1b0 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:27.089134 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-582be0a5-d761-4fb8-a5a2-26cf10c3776d tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:27.097401 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-582be0a5-d761-4fb8-a5a2-26cf10c3776d tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b" status: 200 len: 1506 microversion: 2.1 time: 0.809496 Aug 10 23:14:27.098263 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1916/3678] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:26 2022] GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b => generated 1506 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:27.125546 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-5ac23c8c-5e34-4f2c-8087-fb93a9d512c9 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:27.126476 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-5ac23c8c-5e34-4f2c-8087-fb93a9d512c9 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: 3efc12c9-baf5-40e4-9d98-e72d28377db6] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:27.137289 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5ac23c8c-5e34-4f2c-8087-fb93a9d512c9 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:27.138195 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5ac23c8c-5e34-4f2c-8087-fb93a9d512c9 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:27.139188 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5ac23c8c-5e34-4f2c-8087-fb93a9d512c9 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:27.140446 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5ac23c8c-5e34-4f2c-8087-fb93a9d512c9 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:27.141115 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5ac23c8c-5e34-4f2c-8087-fb93a9d512c9 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:27.141750 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5ac23c8c-5e34-4f2c-8087-fb93a9d512c9 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:27.376899 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-4a938677-085b-453b-ad89-2877ca5ef1b0 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6160c7a42740efbe3613380933fa15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d90f8a58ad047fa8f347d6474e4d673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:27.388001 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-4a938677-085b-453b-ad89-2877ca5ef1b0 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "GET /compute/v2.1/servers/7a8f8d36-4744-43b7-9d42-e50fb5fabe60" status: 200 len: 1314 microversion: 2.1 time: 0.401569 Aug 10 23:14:27.403807 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1763/3679] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:26 2022] GET /compute/v2.1/servers/7a8f8d36-4744-43b7-9d42-e50fb5fabe60 => generated 1314 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:27.411552 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-1c180077-9a0a-4381-a815-558cf1a5be3d tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:27.412176 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-1c180077-9a0a-4381-a815-558cf1a5be3d tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:27.419475 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1c180077-9a0a-4381-a815-558cf1a5be3d tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:27.420189 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1c180077-9a0a-4381-a815-558cf1a5be3d tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:27.420629 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1c180077-9a0a-4381-a815-558cf1a5be3d tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:27.421326 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1c180077-9a0a-4381-a815-558cf1a5be3d tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:27.421914 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1c180077-9a0a-4381-a815-558cf1a5be3d tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:27.422185 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1c180077-9a0a-4381-a815-558cf1a5be3d tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:27.748729 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-5ac23c8c-5e34-4f2c-8087-fb93a9d512c9 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:27.774870 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-5ac23c8c-5e34-4f2c-8087-fb93a9d512c9 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/3efc12c9-baf5-40e4-9d98-e72d28377db6" status: 200 len: 1511 microversion: 2.1 time: 0.654585 Aug 10 23:14:27.775848 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1917/3680] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:27 2022] GET /compute/v2.1/servers/3efc12c9-baf5-40e4-9d98-e72d28377db6 => generated 1511 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:27.781336 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-e8f7ccd9-4af2-45bb-9680-d904ec3b9e57 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:27.793852 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-e8f7ccd9-4af2-45bb-9680-d904ec3b9e57 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] [instance: 7df225be-2dbc-4ef6-aeec-9a3de33a0006] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:27.804907 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e8f7ccd9-4af2-45bb-9680-d904ec3b9e57 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:27.805783 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e8f7ccd9-4af2-45bb-9680-d904ec3b9e57 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:27.806322 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e8f7ccd9-4af2-45bb-9680-d904ec3b9e57 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:27.807324 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e8f7ccd9-4af2-45bb-9680-d904ec3b9e57 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:27.808091 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e8f7ccd9-4af2-45bb-9680-d904ec3b9e57 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:27.808740 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e8f7ccd9-4af2-45bb-9680-d904ec3b9e57 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:27.820807 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-1c180077-9a0a-4381-a815-558cf1a5be3d tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:27.828392 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=16,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:14:27.837271 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-1c180077-9a0a-4381-a815-558cf1a5be3d tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b" status: 200 len: 1506 microversion: 2.1 time: 0.431509 Aug 10 23:14:27.852489 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1764/3681] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:27 2022] GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b => generated 1506 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:27.928886 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-0cca297d-73cd-4f4b-b2f3-b23aa66ac929 tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:27.931892 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-0cca297d-73cd-4f4b-b2f3-b23aa66ac929 tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] [instance: 325ce83e-53e6-4021-b1a1-548ff5057761] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:27.944692 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0cca297d-73cd-4f4b-b2f3-b23aa66ac929 tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:27.946894 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0cca297d-73cd-4f4b-b2f3-b23aa66ac929 tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:27.947607 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0cca297d-73cd-4f4b-b2f3-b23aa66ac929 tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:27.949484 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0cca297d-73cd-4f4b-b2f3-b23aa66ac929 tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:27.949952 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0cca297d-73cd-4f4b-b2f3-b23aa66ac929 tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:27.950678 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0cca297d-73cd-4f4b-b2f3-b23aa66ac929 tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:27.971149 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=2 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:14:28.043806 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=6 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:14:28.091410 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-e8f7ccd9-4af2-45bb-9680-d904ec3b9e57 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07c94ebf0954cdea12b9a689538d96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395d7c4077e54c43bb95288db3942b0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:28.099474 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-e8f7ccd9-4af2-45bb-9680-d904ec3b9e57 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] 10.222.0.58 "GET /compute/v2.1/servers/7df225be-2dbc-4ef6-aeec-9a3de33a0006" status: 200 len: 1280 microversion: 2.1 time: 0.322452 Aug 10 23:14:28.100332 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1918/3682] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:27 2022] GET /compute/v2.1/servers/7df225be-2dbc-4ef6-aeec-9a3de33a0006 => generated 1280 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:28.105981 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-0ff011c2-51d8-445a-b09f-6c9a644bebf0 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1297939476", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": -1, "networks": [{"uuid": "91d0258a-9486-4479-91e9-a6d9339a2e0a"}]}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:14:28.121631 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-0ff011c2-51d8-445a-b09f-6c9a644bebf0 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] HTTP exception thrown: Flavor -1 could not be found. Aug 10 23:14:28.123917 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-0ff011c2-51d8-445a-b09f-6c9a644bebf0 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Request method failure captured: Aug 10 23:14:28.123917 n-d-850468-14 devstack@n-api.service[122633]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 10 23:14:28.123917 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:14:28.123917 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:14:28.123917 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:14:28.123917 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 206 Aug 10 23:14:28.123917 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:14:28.123917 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:14:28.123917 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:14:28.123917 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:14:28.123917 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9DuIKrfOsS8tKST0PsIPrvuNPfsVISfOPvUoe9ddkVcTJKj7rDjd3OuH9u-DTT1aypj1AUoUKtajD98eDOUOHSpPisBSdRlSCov30lHf1uZq-XZLyBIVg5kAG8-SuXk2s1TL7EnRcjjMARSkm95dZDnXaBXRT3M4f8UoMDwqu7xK7gQ Aug 10 23:14:28.123917 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:14:28.123917 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:14:28.123917 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:14:28.123917 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:14:28.123917 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:14:28.123917 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:14:28.123917 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: d11bbb3e87f4463787da56ab19108822 Aug 10 23:14:28.123917 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-ServersNegativeTestJSON-1216728002 Aug 10 23:14:28.123917 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:14:28.123917 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:14:28.123917 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d11bbb3e87f4463787da56ab19108822"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d11bbb3e87f4463787da56ab19108822"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d11bbb3e87f4463787da56ab19108822"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d11bbb3e87f4463787da56ab19108822", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:14:28.123917 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-ServersNegativeTestJSON-1216728002 Aug 10 23:14:28.123917 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: d11bbb3e87f4463787da56ab19108822 Aug 10 23:14:28.123917 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1216728002 Aug 10 23:14:28.123917 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-ServersNegativeTestJSON-1216728002-project Aug 10 23:14:28.123917 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:14:28.123917 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:14:28.123917 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: f284ec2a4bf546b58c1c1adaf880e1fb Aug 10 23:14:28.123917 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-ServersNegativeTestJSON-1216728002-project Aug 10 23:14:28.123917 n-d-850468-14 devstack@n-api.service[122633]: Aug 10 23:14:28.123917 n-d-850468-14 devstack@n-api.service[122633]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1297939476", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": -1, "networks": [{"uuid": "91d0258a-9486-4479-91e9-a6d9339a2e0a"}]}} Aug 10 23:14:28.123917 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:14:28.123917 n-d-850468-14 devstack@n-api.service[122633]: exception: Flavor -1 could not be found. Aug 10 23:14:28.123917 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1297939476', 'imageRef': '78ad8905-f66f-4733-8be9-2b260f1fabed', 'flavorRef': -1, 'networks': [{'uuid': '91d0258a-9486-4479-91e9-a6d9339a2e0a'}]}}} Aug 10 23:14:28.123917 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:14:28.123917 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:14:28.123917 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Aug 10 23:14:28.123917 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Aug 10 23:14:28.123917 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 10 23:14:28.123917 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 10 23:14:28.123917 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 10 23:14:28.123917 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 10 23:14:28.123917 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 10 23:14:28.123917 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 10 23:14:28.123917 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 10 23:14:28.123917 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:14:28.123917 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 10 23:14:28.123917 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 10 23:14:28.123917 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. Aug 10 23:14:28.123917 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:14:28.123917 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:14:28.123917 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:14:28.123917 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:14:28.123917 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:14:28.123917 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:14:28.123917 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:14:28.123917 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:14:28.123917 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:14:28.123917 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:14:28.123917 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 23:14:28.123917 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 23:14:28.128096 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 23:14:28.128096 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 23:14:28.128096 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 23:14:28.128096 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 23:14:28.128096 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 23:14:28.128096 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Aug 10 23:14:28.128096 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 10 23:14:28.128096 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. Aug 10 23:14:28.128096 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:14:28.128096 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:14:28.128096 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:14:28.128096 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:14:28.128096 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:14:28.128096 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:14:28.128096 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:14:28.128096 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:14:28.128096 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. Aug 10 23:14:28.128096 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:14:28.128096 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-0ff011c2-51d8-445a-b09f-6c9a644bebf0 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:14:28.128096 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-0ff011c2-51d8-445a-b09f-6c9a644bebf0 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.023453 Aug 10 23:14:28.128096 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1919/3683] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 23:14:28 2022] POST /compute/v2.1/servers => generated 73 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 10 23:14:28.135344 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-a82a3c91-4cb6-4a59-b2cf-d03b473e722b tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:28.136105 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-a82a3c91-4cb6-4a59-b2cf-d03b473e722b tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:28.144062 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a82a3c91-4cb6-4a59-b2cf-d03b473e722b tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:28.144939 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a82a3c91-4cb6-4a59-b2cf-d03b473e722b tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:28.145478 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a82a3c91-4cb6-4a59-b2cf-d03b473e722b tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:28.146475 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a82a3c91-4cb6-4a59-b2cf-d03b473e722b tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:28.147157 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a82a3c91-4cb6-4a59-b2cf-d03b473e722b tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:28.147788 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a82a3c91-4cb6-4a59-b2cf-d03b473e722b tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:28.352173 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-0cca297d-73cd-4f4b-b2f3-b23aa66ac929 tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39eef3efd444a6d8192f405cba67f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee72843cb8064834bdbc02d8a5417f71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:28.367722 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-0cca297d-73cd-4f4b-b2f3-b23aa66ac929 tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39eef3efd444a6d8192f405cba67f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee72843cb8064834bdbc02d8a5417f71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:28.369347 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-0cca297d-73cd-4f4b-b2f3-b23aa66ac929 tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39eef3efd444a6d8192f405cba67f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee72843cb8064834bdbc02d8a5417f71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:28.370731 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-0cca297d-73cd-4f4b-b2f3-b23aa66ac929 tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] 10.222.0.58 "GET /compute/v2.1/servers/325ce83e-53e6-4021-b1a1-548ff5057761" status: 200 len: 1359 microversion: 2.21 time: 0.447428 Aug 10 23:14:28.371323 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1765/3684] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:14:27 2022] GET /compute/v2.1/servers/325ce83e-53e6-4021-b1a1-548ff5057761 => generated 1359 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:14:28.416377 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-db971204-cd48-40ec-81d7-ac084290878e tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:28.416992 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-db971204-cd48-40ec-81d7-ac084290878e tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: 7a8f8d36-4744-43b7-9d42-e50fb5fabe60] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:28.424416 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-db971204-cd48-40ec-81d7-ac084290878e tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:28.424897 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-db971204-cd48-40ec-81d7-ac084290878e tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:28.425514 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-db971204-cd48-40ec-81d7-ac084290878e tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:28.426266 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-db971204-cd48-40ec-81d7-ac084290878e tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:28.426901 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-db971204-cd48-40ec-81d7-ac084290878e tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:28.427330 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-db971204-cd48-40ec-81d7-ac084290878e tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:28.802885 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-a82a3c91-4cb6-4a59-b2cf-d03b473e722b tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:28.819489 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-a82a3c91-4cb6-4a59-b2cf-d03b473e722b tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b" status: 200 len: 1506 microversion: 2.1 time: 0.688376 Aug 10 23:14:28.851622 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1920/3685] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:28 2022] GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b => generated 1506 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:28.871121 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-db971204-cd48-40ec-81d7-ac084290878e tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6160c7a42740efbe3613380933fa15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d90f8a58ad047fa8f347d6474e4d673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:28.877233 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-0b1213ce-dccb-4691-897d-647a0d9404dc tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:28.878556 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-0b1213ce-dccb-4691-897d-647a0d9404dc tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: 3efc12c9-baf5-40e4-9d98-e72d28377db6] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:28.880629 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-db971204-cd48-40ec-81d7-ac084290878e tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "GET /compute/v2.1/servers/7a8f8d36-4744-43b7-9d42-e50fb5fabe60" status: 200 len: 1314 microversion: 2.1 time: 0.468966 Aug 10 23:14:28.887199 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1766/3686] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:28 2022] GET /compute/v2.1/servers/7a8f8d36-4744-43b7-9d42-e50fb5fabe60 => generated 1314 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:14:28.902742 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-e3d6f6ab-2e00-4d12-b8f3-16f535b075c2 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:28.903772 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-e3d6f6ab-2e00-4d12-b8f3-16f535b075c2 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:28.904293 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0b1213ce-dccb-4691-897d-647a0d9404dc tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:28.917516 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e3d6f6ab-2e00-4d12-b8f3-16f535b075c2 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:28.918130 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e3d6f6ab-2e00-4d12-b8f3-16f535b075c2 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:28.925693 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0b1213ce-dccb-4691-897d-647a0d9404dc tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:28.926070 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e3d6f6ab-2e00-4d12-b8f3-16f535b075c2 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:28.927444 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0b1213ce-dccb-4691-897d-647a0d9404dc tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:28.928244 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0b1213ce-dccb-4691-897d-647a0d9404dc tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:28.928729 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0b1213ce-dccb-4691-897d-647a0d9404dc tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:28.929743 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e3d6f6ab-2e00-4d12-b8f3-16f535b075c2 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:28.932777 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e3d6f6ab-2e00-4d12-b8f3-16f535b075c2 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:28.933455 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e3d6f6ab-2e00-4d12-b8f3-16f535b075c2 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:28.935315 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0b1213ce-dccb-4691-897d-647a0d9404dc tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:29.330082 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-e3d6f6ab-2e00-4d12-b8f3-16f535b075c2 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:29.345777 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-e3d6f6ab-2e00-4d12-b8f3-16f535b075c2 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b" status: 200 len: 1506 microversion: 2.1 time: 0.456923 Aug 10 23:14:29.349703 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1767/3687] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:28 2022] GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b => generated 1506 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:29.364647 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-649f24db-7d98-4be1-9f9d-6da7379fdcbc req-5bfba1c6-c1f3-482c-a5e8-b86e09fa9e6b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a8f8d36-4744-43b7-9d42-e50fb5fabe60", "tag": "e13e25ef-a098-467e-a71b-fe5918abb3b3"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:14:29.423182 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=1,nova_api:INSERT=9 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:14:29.430558 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-649f24db-7d98-4be1-9f9d-6da7379fdcbc req-5bfba1c6-c1f3-482c-a5e8-b86e09fa9e6b service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:29.431094 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-649f24db-7d98-4be1-9f9d-6da7379fdcbc req-5bfba1c6-c1f3-482c-a5e8-b86e09fa9e6b service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:29.439638 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-649f24db-7d98-4be1-9f9d-6da7379fdcbc req-5bfba1c6-c1f3-482c-a5e8-b86e09fa9e6b service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:29.482993 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-649f24db-7d98-4be1-9f9d-6da7379fdcbc req-5bfba1c6-c1f3-482c-a5e8-b86e09fa9e6b service nova] Creating event network-changed:e13e25ef-a098-467e-a71b-fe5918abb3b3 for instance 7a8f8d36-4744-43b7-9d42-e50fb5fabe60 on n-h1-850468-14 Aug 10 23:14:29.492387 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-649f24db-7d98-4be1-9f9d-6da7379fdcbc req-5bfba1c6-c1f3-482c-a5e8-b86e09fa9e6b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.137962 Aug 10 23:14:29.493832 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1768/3688] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:14:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:14:29.500059 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-e4179144-a456-4cac-8cde-c5565aa605cf req-ebc3216f-0a8e-41da-9ac8-a5dca60c489d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "325ce83e-53e6-4021-b1a1-548ff5057761", "tag": "9a221529-858a-43c9-af54-8f34801606f1"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:14:29.546651 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-e4179144-a456-4cac-8cde-c5565aa605cf req-ebc3216f-0a8e-41da-9ac8-a5dca60c489d service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:29.547385 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-e4179144-a456-4cac-8cde-c5565aa605cf req-ebc3216f-0a8e-41da-9ac8-a5dca60c489d service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:29.548355 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-e4179144-a456-4cac-8cde-c5565aa605cf req-ebc3216f-0a8e-41da-9ac8-a5dca60c489d service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:29.583127 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-e4179144-a456-4cac-8cde-c5565aa605cf req-ebc3216f-0a8e-41da-9ac8-a5dca60c489d service nova] Creating event network-changed:9a221529-858a-43c9-af54-8f34801606f1 for instance 325ce83e-53e6-4021-b1a1-548ff5057761 on n-h2-850468-14 Aug 10 23:14:29.588986 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-e4179144-a456-4cac-8cde-c5565aa605cf req-ebc3216f-0a8e-41da-9ac8-a5dca60c489d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093434 Aug 10 23:14:29.590316 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1769/3689] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:14:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:14:29.595798 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-43a9ff60-fbaa-4ecb-a1b8-5f23508470b8 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:29.602896 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-43a9ff60-fbaa-4ecb-a1b8-5f23508470b8 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] [instance: 7df225be-2dbc-4ef6-aeec-9a3de33a0006] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:29.618139 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-43a9ff60-fbaa-4ecb-a1b8-5f23508470b8 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:29.618743 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-43a9ff60-fbaa-4ecb-a1b8-5f23508470b8 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:29.619329 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-43a9ff60-fbaa-4ecb-a1b8-5f23508470b8 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:29.620227 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-43a9ff60-fbaa-4ecb-a1b8-5f23508470b8 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:29.623144 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-43a9ff60-fbaa-4ecb-a1b8-5f23508470b8 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:29.623763 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-43a9ff60-fbaa-4ecb-a1b8-5f23508470b8 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:29.759712 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-0b1213ce-dccb-4691-897d-647a0d9404dc tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:29.778649 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-0b1213ce-dccb-4691-897d-647a0d9404dc tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/3efc12c9-baf5-40e4-9d98-e72d28377db6" status: 200 len: 1511 microversion: 2.1 time: 0.924697 Aug 10 23:14:29.781109 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1921/3690] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:28 2022] GET /compute/v2.1/servers/3efc12c9-baf5-40e4-9d98-e72d28377db6 => generated 1511 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:29.790723 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-f509f6ab-f68e-4fb1-b750-48afdaf71dfd tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:29.791586 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-f509f6ab-f68e-4fb1-b750-48afdaf71dfd tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] [instance: 325ce83e-53e6-4021-b1a1-548ff5057761] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:29.799895 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f509f6ab-f68e-4fb1-b750-48afdaf71dfd tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:29.800657 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f509f6ab-f68e-4fb1-b750-48afdaf71dfd tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:29.801405 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f509f6ab-f68e-4fb1-b750-48afdaf71dfd tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:29.802447 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f509f6ab-f68e-4fb1-b750-48afdaf71dfd tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:29.803183 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f509f6ab-f68e-4fb1-b750-48afdaf71dfd tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:29.805617 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f509f6ab-f68e-4fb1-b750-48afdaf71dfd tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:29.897708 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-43a9ff60-fbaa-4ecb-a1b8-5f23508470b8 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07c94ebf0954cdea12b9a689538d96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395d7c4077e54c43bb95288db3942b0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:29.909823 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-43a9ff60-fbaa-4ecb-a1b8-5f23508470b8 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] 10.222.0.58 "GET /compute/v2.1/servers/7df225be-2dbc-4ef6-aeec-9a3de33a0006" status: 200 len: 1322 microversion: 2.1 time: 0.318040 Aug 10 23:14:29.910911 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1770/3691] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:29 2022] GET /compute/v2.1/servers/7df225be-2dbc-4ef6-aeec-9a3de33a0006 => generated 1322 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:29.916468 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-dec42bff-6373-46c7-9f26-a00033cc5510 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-840466417", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "91d0258a-9486-4479-91e9-a6d9339a2e0a"}]}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:14:29.921831 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-dec42bff-6373-46c7-9f26-a00033cc5510 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Request method failure captured: Aug 10 23:14:29.921831 n-d-850468-14 devstack@n-api.service[122632]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 10 23:14:29.921831 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:14:29.921831 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:14:29.921831 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:14:29.921831 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 172 Aug 10 23:14:29.921831 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:14:29.921831 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:14:29.921831 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:14:29.921831 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:14:29.921831 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9DuIKrfOsS8tKST0PsIPrvuNPfsVISfOPvUoe9ddkVcTJKj7rDjd3OuH9u-DTT1aypj1AUoUKtajD98eDOUOHSpPisBSdRlSCov30lHf1uZq-XZLyBIVg5kAG8-SuXk2s1TL7EnRcjjMARSkm95dZDnXaBXRT3M4f8UoMDwqu7xK7gQ Aug 10 23:14:29.921831 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:14:29.921831 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:14:29.921831 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:14:29.921831 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:14:29.921831 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:14:29.921831 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:14:29.921831 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: d11bbb3e87f4463787da56ab19108822 Aug 10 23:14:29.921831 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-ServersNegativeTestJSON-1216728002 Aug 10 23:14:29.921831 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:14:29.921831 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:14:29.921831 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d11bbb3e87f4463787da56ab19108822"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d11bbb3e87f4463787da56ab19108822"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d11bbb3e87f4463787da56ab19108822"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d11bbb3e87f4463787da56ab19108822", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:14:29.921831 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-ServersNegativeTestJSON-1216728002 Aug 10 23:14:29.921831 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: d11bbb3e87f4463787da56ab19108822 Aug 10 23:14:29.921831 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1216728002 Aug 10 23:14:29.921831 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-ServersNegativeTestJSON-1216728002-project Aug 10 23:14:29.921831 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:14:29.921831 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:14:29.921831 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: f284ec2a4bf546b58c1c1adaf880e1fb Aug 10 23:14:29.921831 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-ServersNegativeTestJSON-1216728002-project Aug 10 23:14:29.921831 n-d-850468-14 devstack@n-api.service[122632]: Aug 10 23:14:29.921831 n-d-850468-14 devstack@n-api.service[122632]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-840466417", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "91d0258a-9486-4479-91e9-a6d9339a2e0a"}]}} Aug 10 23:14:29.921831 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:14:29.921831 n-d-850468-14 devstack@n-api.service[122632]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Aug 10 23:14:29.921831 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-840466417', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': '91d0258a-9486-4479-91e9-a6d9339a2e0a'}]}}} Aug 10 23:14:29.921831 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:14:29.921831 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:14:29.921831 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 10 23:14:29.921831 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 10 23:14:29.921831 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 10 23:14:29.921831 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise error Aug 10 23:14:29.921831 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas Aug 10 23:14:29.921831 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:14:29.921831 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: Aug 10 23:14:29.921831 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, Aug 10 23:14:29.921831 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} Aug 10 23:14:29.921831 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:14:29.921831 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 10 23:14:29.921831 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi -1 Aug 10 23:14:29.921831 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:14:29.921831 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:14:29.921831 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:14:29.921831 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:14:29.921831 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:14:29.921831 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:14:29.921831 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:14:29.921831 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:14:29.921831 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:14:29.921831 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:14:29.921831 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 23:14:29.921831 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 23:14:29.921831 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 10 23:14:29.921831 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 10 23:14:29.921831 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 10 23:14:29.925493 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 10 23:14:29.925493 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 10 23:14:29.925493 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 10 23:14:29.925493 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Aug 10 23:14:29.925493 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:14:29.925493 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:14:29.925493 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:14:29.925493 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:14:29.925493 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:14:29.925493 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:14:29.925493 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 10 23:14:29.925493 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 10 23:14:29.925493 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Aug 10 23:14:29.925493 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:14:29.925493 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-dec42bff-6373-46c7-9f26-a00033cc5510 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:14:29.925493 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-dec42bff-6373-46c7-9f26-a00033cc5510 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.011424 Aug 10 23:14:29.925493 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1771/3692] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 23:14:29 2022] POST /compute/v2.1/servers => generated 145 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 10 23:14:29.945957 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-fc974663-4458-4fd1-8a5c-cd13d117ff1a tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:29.946598 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-fc974663-4458-4fd1-8a5c-cd13d117ff1a tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: 7a8f8d36-4744-43b7-9d42-e50fb5fabe60] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:29.955652 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fc974663-4458-4fd1-8a5c-cd13d117ff1a tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:29.956365 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fc974663-4458-4fd1-8a5c-cd13d117ff1a tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:29.956982 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fc974663-4458-4fd1-8a5c-cd13d117ff1a tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:29.957850 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fc974663-4458-4fd1-8a5c-cd13d117ff1a tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:29.958451 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fc974663-4458-4fd1-8a5c-cd13d117ff1a tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:29.959519 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fc974663-4458-4fd1-8a5c-cd13d117ff1a tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:30.419437 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-f509f6ab-f68e-4fb1-b750-48afdaf71dfd tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39eef3efd444a6d8192f405cba67f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee72843cb8064834bdbc02d8a5417f71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:30.428121 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-f509f6ab-f68e-4fb1-b750-48afdaf71dfd tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39eef3efd444a6d8192f405cba67f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee72843cb8064834bdbc02d8a5417f71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:30.430725 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-f509f6ab-f68e-4fb1-b750-48afdaf71dfd tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39eef3efd444a6d8192f405cba67f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee72843cb8064834bdbc02d8a5417f71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:30.432100 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-f509f6ab-f68e-4fb1-b750-48afdaf71dfd tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] 10.222.0.58 "GET /compute/v2.1/servers/325ce83e-53e6-4021-b1a1-548ff5057761" status: 200 len: 1359 microversion: 2.21 time: 0.649622 Aug 10 23:14:30.432843 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1922/3693] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:14:29 2022] GET /compute/v2.1/servers/325ce83e-53e6-4021-b1a1-548ff5057761 => generated 1359 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:14:30.438189 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-9c3e1d72-9fbc-4c4e-b4ee-49290e81bbad tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:30.439007 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-9c3e1d72-9fbc-4c4e-b4ee-49290e81bbad tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:30.444309 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:14:30.446219 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9c3e1d72-9fbc-4c4e-b4ee-49290e81bbad tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:30.446853 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9c3e1d72-9fbc-4c4e-b4ee-49290e81bbad tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:30.449532 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9c3e1d72-9fbc-4c4e-b4ee-49290e81bbad tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:30.450517 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9c3e1d72-9fbc-4c4e-b4ee-49290e81bbad tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:30.451085 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9c3e1d72-9fbc-4c4e-b4ee-49290e81bbad tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:30.454721 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9c3e1d72-9fbc-4c4e-b4ee-49290e81bbad tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:30.670576 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-fc974663-4458-4fd1-8a5c-cd13d117ff1a tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6160c7a42740efbe3613380933fa15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d90f8a58ad047fa8f347d6474e4d673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:30.689126 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-fc974663-4458-4fd1-8a5c-cd13d117ff1a tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "GET /compute/v2.1/servers/7a8f8d36-4744-43b7-9d42-e50fb5fabe60" status: 200 len: 1314 microversion: 2.1 time: 0.763286 Aug 10 23:14:30.690024 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1772/3694] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:29 2022] GET /compute/v2.1/servers/7a8f8d36-4744-43b7-9d42-e50fb5fabe60 => generated 1314 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:30.807889 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-6d0043f8-cca0-49df-bad2-0db6fb0cf10c tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:30.808840 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-6d0043f8-cca0-49df-bad2-0db6fb0cf10c tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: 3efc12c9-baf5-40e4-9d98-e72d28377db6] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:30.818494 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6d0043f8-cca0-49df-bad2-0db6fb0cf10c tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:30.820165 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6d0043f8-cca0-49df-bad2-0db6fb0cf10c tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:30.821114 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6d0043f8-cca0-49df-bad2-0db6fb0cf10c tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:30.821819 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6d0043f8-cca0-49df-bad2-0db6fb0cf10c tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:30.822494 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6d0043f8-cca0-49df-bad2-0db6fb0cf10c tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:30.823752 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6d0043f8-cca0-49df-bad2-0db6fb0cf10c tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:30.962301 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-9c3e1d72-9fbc-4c4e-b4ee-49290e81bbad tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:30.974058 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-9c3e1d72-9fbc-4c4e-b4ee-49290e81bbad tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b" status: 200 len: 1506 microversion: 2.1 time: 0.540011 Aug 10 23:14:30.977774 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1923/3695] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:30 2022] GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b => generated 1506 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:30.982394 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-a578125e-b8ac-42c1-8eb7-b85d27c95f64 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:30.983033 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-a578125e-b8ac-42c1-8eb7-b85d27c95f64 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] [instance: 7df225be-2dbc-4ef6-aeec-9a3de33a0006] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:31.025765 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a578125e-b8ac-42c1-8eb7-b85d27c95f64 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:31.026265 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a578125e-b8ac-42c1-8eb7-b85d27c95f64 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:31.026705 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a578125e-b8ac-42c1-8eb7-b85d27c95f64 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:31.027443 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a578125e-b8ac-42c1-8eb7-b85d27c95f64 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:31.027898 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a578125e-b8ac-42c1-8eb7-b85d27c95f64 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:31.028315 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a578125e-b8ac-42c1-8eb7-b85d27c95f64 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:31.488953 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-a578125e-b8ac-42c1-8eb7-b85d27c95f64 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07c94ebf0954cdea12b9a689538d96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395d7c4077e54c43bb95288db3942b0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:31.503552 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-a578125e-b8ac-42c1-8eb7-b85d27c95f64 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] 10.222.0.58 "GET /compute/v2.1/servers/7df225be-2dbc-4ef6-aeec-9a3de33a0006" status: 200 len: 1322 microversion: 2.1 time: 0.524709 Aug 10 23:14:31.504155 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1924/3696] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:30 2022] GET /compute/v2.1/servers/7df225be-2dbc-4ef6-aeec-9a3de33a0006 => generated 1322 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:31.512480 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c9d24c56-83d5-4d39-9499-1bb8b02a5a85 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:31.518394 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-c9d24c56-83d5-4d39-9499-1bb8b02a5a85 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:31.530407 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c9d24c56-83d5-4d39-9499-1bb8b02a5a85 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:31.532982 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c9d24c56-83d5-4d39-9499-1bb8b02a5a85 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:31.533756 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c9d24c56-83d5-4d39-9499-1bb8b02a5a85 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:31.540022 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c9d24c56-83d5-4d39-9499-1bb8b02a5a85 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:31.540513 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c9d24c56-83d5-4d39-9499-1bb8b02a5a85 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:31.540957 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c9d24c56-83d5-4d39-9499-1bb8b02a5a85 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:31.563977 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-6d0043f8-cca0-49df-bad2-0db6fb0cf10c tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:31.578205 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-6d0043f8-cca0-49df-bad2-0db6fb0cf10c tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/3efc12c9-baf5-40e4-9d98-e72d28377db6" status: 200 len: 1511 microversion: 2.1 time: 0.772157 Aug 10 23:14:31.579713 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1773/3697] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:30 2022] GET /compute/v2.1/servers/3efc12c9-baf5-40e4-9d98-e72d28377db6 => generated 1511 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:14:31.597111 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-3bfdcf9d-8b67-4a7a-ba26-291bf84a7061 tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:31.598084 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-3bfdcf9d-8b67-4a7a-ba26-291bf84a7061 tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] [instance: 325ce83e-53e6-4021-b1a1-548ff5057761] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:31.606480 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3bfdcf9d-8b67-4a7a-ba26-291bf84a7061 tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:31.607005 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3bfdcf9d-8b67-4a7a-ba26-291bf84a7061 tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:31.607442 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3bfdcf9d-8b67-4a7a-ba26-291bf84a7061 tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:31.608150 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3bfdcf9d-8b67-4a7a-ba26-291bf84a7061 tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:31.608601 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3bfdcf9d-8b67-4a7a-ba26-291bf84a7061 tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:31.609206 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3bfdcf9d-8b67-4a7a-ba26-291bf84a7061 tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:31.916943 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-c9d24c56-83d5-4d39-9499-1bb8b02a5a85 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:31.927357 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-3bfdcf9d-8b67-4a7a-ba26-291bf84a7061 tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39eef3efd444a6d8192f405cba67f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee72843cb8064834bdbc02d8a5417f71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:31.943164 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-c9d24c56-83d5-4d39-9499-1bb8b02a5a85 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b" status: 200 len: 1506 microversion: 2.1 time: 0.437265 Aug 10 23:14:31.944870 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1925/3698] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:31 2022] GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b => generated 1506 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:31.952956 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-3bfdcf9d-8b67-4a7a-ba26-291bf84a7061 tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39eef3efd444a6d8192f405cba67f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee72843cb8064834bdbc02d8a5417f71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:31.958010 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-b54f6ce1-2f17-46eb-9540-e99bcaa0ebfc tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:31.958969 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-b54f6ce1-2f17-46eb-9540-e99bcaa0ebfc tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: 7a8f8d36-4744-43b7-9d42-e50fb5fabe60] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:31.959999 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-3bfdcf9d-8b67-4a7a-ba26-291bf84a7061 tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39eef3efd444a6d8192f405cba67f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee72843cb8064834bdbc02d8a5417f71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:31.961861 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-3bfdcf9d-8b67-4a7a-ba26-291bf84a7061 tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] 10.222.0.58 "GET /compute/v2.1/servers/325ce83e-53e6-4021-b1a1-548ff5057761" status: 200 len: 1359 microversion: 2.21 time: 0.381071 Aug 10 23:14:31.962835 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1774/3699] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:14:31 2022] GET /compute/v2.1/servers/325ce83e-53e6-4021-b1a1-548ff5057761 => generated 1359 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:14:31.986077 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b54f6ce1-2f17-46eb-9540-e99bcaa0ebfc tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:31.988216 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b54f6ce1-2f17-46eb-9540-e99bcaa0ebfc tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:31.988815 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b54f6ce1-2f17-46eb-9540-e99bcaa0ebfc tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:31.990267 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b54f6ce1-2f17-46eb-9540-e99bcaa0ebfc tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:31.992583 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b54f6ce1-2f17-46eb-9540-e99bcaa0ebfc tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:31.993720 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b54f6ce1-2f17-46eb-9540-e99bcaa0ebfc tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:32.060666 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-f645b613-7dea-42fc-9447-0c1b5f7a22e7 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2029160091", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:14:32.082747 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-f645b613-7dea-42fc-9447-0c1b5f7a22e7 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Aug 10 23:14:32.084363 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-f645b613-7dea-42fc-9447-0c1b5f7a22e7 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Request method failure captured: Aug 10 23:14:32.084363 n-d-850468-14 devstack@n-api.service[122632]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 10 23:14:32.084363 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:14:32.084363 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:14:32.084363 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:14:32.084363 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 216 Aug 10 23:14:32.084363 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:14:32.084363 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:14:32.084363 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:14:32.084363 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:14:32.084363 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9DuIKrfOsS8tKST0PsIPrvuNPfsVISfOPvUoe9ddkVcTJKj7rDjd3OuH9u-DTT1aypj1AUoUKtajD98eDOUOHSpPisBSdRlSCov30lHf1uZq-XZLyBIVg5kAG8-SuXk2s1TL7EnRcjjMARSkm95dZDnXaBXRT3M4f8UoMDwqu7xK7gQ Aug 10 23:14:32.084363 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:14:32.084363 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:14:32.084363 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:14:32.084363 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:14:32.084363 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:14:32.084363 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:14:32.084363 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: d11bbb3e87f4463787da56ab19108822 Aug 10 23:14:32.084363 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-ServersNegativeTestJSON-1216728002 Aug 10 23:14:32.084363 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:14:32.084363 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:14:32.084363 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d11bbb3e87f4463787da56ab19108822"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d11bbb3e87f4463787da56ab19108822"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d11bbb3e87f4463787da56ab19108822"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d11bbb3e87f4463787da56ab19108822", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:14:32.084363 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-ServersNegativeTestJSON-1216728002 Aug 10 23:14:32.084363 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: d11bbb3e87f4463787da56ab19108822 Aug 10 23:14:32.084363 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1216728002 Aug 10 23:14:32.084363 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-ServersNegativeTestJSON-1216728002-project Aug 10 23:14:32.084363 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:14:32.084363 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:14:32.084363 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: f284ec2a4bf546b58c1c1adaf880e1fb Aug 10 23:14:32.084363 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-ServersNegativeTestJSON-1216728002-project Aug 10 23:14:32.084363 n-d-850468-14 devstack@n-api.service[122632]: Aug 10 23:14:32.084363 n-d-850468-14 devstack@n-api.service[122632]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2029160091", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} Aug 10 23:14:32.084363 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:14:32.084363 n-d-850468-14 devstack@n-api.service[122632]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Aug 10 23:14:32.084363 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-2029160091', 'imageRef': '78ad8905-f66f-4733-8be9-2b260f1fabed', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} Aug 10 23:14:32.084363 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:14:32.084363 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:14:32.084363 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:14:32.084363 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:14:32.084363 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:14:32.084363 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:14:32.084363 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:14:32.084363 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:14:32.084363 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 23:14:32.084363 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 23:14:32.084363 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 23:14:32.084363 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 23:14:32.084363 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 23:14:32.084363 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 23:14:32.084363 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 23:14:32.084363 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create Aug 10 23:14:32.084363 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( Aug 10 23:14:32.084363 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create Aug 10 23:14:32.084363 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( Aug 10 23:14:32.084363 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks Aug 10 23:14:32.084363 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi self._validate_network_id( Aug 10 23:14:32.084363 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id Aug 10 23:14:32.084363 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Aug 10 23:14:32.084363 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Aug 10 23:14:32.084363 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:14:32.084363 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:14:32.089276 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:14:32.089276 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:14:32.089276 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:14:32.089276 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:14:32.089276 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:14:32.089276 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:14:32.089276 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Aug 10 23:14:32.089276 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:14:32.089276 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-f645b613-7dea-42fc-9447-0c1b5f7a22e7 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:14:32.089276 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-f645b613-7dea-42fc-9447-0c1b5f7a22e7 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.032149 Aug 10 23:14:32.098609 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1775/3700] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 23:14:32 2022] POST /compute/v2.1/servers => generated 123 bytes in 45 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 10 23:14:32.116197 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-e62a1bb6-c5b1-46dc-a3d1-2418cd0e0b83 req-811ba11e-9cca-436b-a4a1-f0b794d5f2f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7df225be-2dbc-4ef6-aeec-9a3de33a0006", "tag": "54202e59-d171-4a05-91d4-e187250d698c"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:14:32.145717 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-e62a1bb6-c5b1-46dc-a3d1-2418cd0e0b83 req-811ba11e-9cca-436b-a4a1-f0b794d5f2f3 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:32.148589 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-e62a1bb6-c5b1-46dc-a3d1-2418cd0e0b83 req-811ba11e-9cca-436b-a4a1-f0b794d5f2f3 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:32.149376 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-e62a1bb6-c5b1-46dc-a3d1-2418cd0e0b83 req-811ba11e-9cca-436b-a4a1-f0b794d5f2f3 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:32.180879 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-e62a1bb6-c5b1-46dc-a3d1-2418cd0e0b83 req-811ba11e-9cca-436b-a4a1-f0b794d5f2f3 service nova] Creating event network-changed:54202e59-d171-4a05-91d4-e187250d698c for instance 7df225be-2dbc-4ef6-aeec-9a3de33a0006 on n-h2-850468-14 Aug 10 23:14:32.195921 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-e62a1bb6-c5b1-46dc-a3d1-2418cd0e0b83 req-811ba11e-9cca-436b-a4a1-f0b794d5f2f3 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095831 Aug 10 23:14:32.201791 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1776/3701] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:14:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:14:32.211211 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-bb31c688-5dc1-42ce-ac3e-ceff702e9950 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:32.212256 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-bb31c688-5dc1-42ce-ac3e-ceff702e9950 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:32.233142 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bb31c688-5dc1-42ce-ac3e-ceff702e9950 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:32.239578 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bb31c688-5dc1-42ce-ac3e-ceff702e9950 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:32.240268 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bb31c688-5dc1-42ce-ac3e-ceff702e9950 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:32.241179 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bb31c688-5dc1-42ce-ac3e-ceff702e9950 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:32.241891 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bb31c688-5dc1-42ce-ac3e-ceff702e9950 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:32.242503 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bb31c688-5dc1-42ce-ac3e-ceff702e9950 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:32.873785 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-bb31c688-5dc1-42ce-ac3e-ceff702e9950 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:32.886769 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-bb31c688-5dc1-42ce-ac3e-ceff702e9950 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b" status: 200 len: 1506 microversion: 2.1 time: 0.683185 Aug 10 23:14:32.887508 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1777/3702] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:32 2022] GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b => generated 1506 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:32.907254 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-10a4c577-3fd1-48f7-94af-8c09bad4d867 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:32.908257 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-10a4c577-3fd1-48f7-94af-8c09bad4d867 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] [instance: 7df225be-2dbc-4ef6-aeec-9a3de33a0006] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:32.921863 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-10a4c577-3fd1-48f7-94af-8c09bad4d867 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:32.923755 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-10a4c577-3fd1-48f7-94af-8c09bad4d867 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:32.924330 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-10a4c577-3fd1-48f7-94af-8c09bad4d867 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:32.925502 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-10a4c577-3fd1-48f7-94af-8c09bad4d867 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:32.929762 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-10a4c577-3fd1-48f7-94af-8c09bad4d867 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:32.931550 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-10a4c577-3fd1-48f7-94af-8c09bad4d867 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:33.174303 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-b54f6ce1-2f17-46eb-9540-e99bcaa0ebfc tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6160c7a42740efbe3613380933fa15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d90f8a58ad047fa8f347d6474e4d673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:33.186483 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-b54f6ce1-2f17-46eb-9540-e99bcaa0ebfc tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "GET /compute/v2.1/servers/7a8f8d36-4744-43b7-9d42-e50fb5fabe60" status: 200 len: 1314 microversion: 2.1 time: 1.237853 Aug 10 23:14:33.192390 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1926/3703] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:31 2022] GET /compute/v2.1/servers/7a8f8d36-4744-43b7-9d42-e50fb5fabe60 => generated 1314 bytes in 1247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:33.197599 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-16b2afe3-18b1-4b73-aa04-903be48b0204 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:33.207468 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-16b2afe3-18b1-4b73-aa04-903be48b0204 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: 3efc12c9-baf5-40e4-9d98-e72d28377db6] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:33.214115 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-16b2afe3-18b1-4b73-aa04-903be48b0204 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:33.214900 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-16b2afe3-18b1-4b73-aa04-903be48b0204 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:33.215572 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-16b2afe3-18b1-4b73-aa04-903be48b0204 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:33.216590 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-16b2afe3-18b1-4b73-aa04-903be48b0204 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:33.218039 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-16b2afe3-18b1-4b73-aa04-903be48b0204 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:33.218840 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-16b2afe3-18b1-4b73-aa04-903be48b0204 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:33.264243 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=100 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:14:33.390546 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=6 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:14:33.438536 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=18 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:14:33.549623 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-10a4c577-3fd1-48f7-94af-8c09bad4d867 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07c94ebf0954cdea12b9a689538d96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395d7c4077e54c43bb95288db3942b0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:33.562943 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-10a4c577-3fd1-48f7-94af-8c09bad4d867 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] 10.222.0.58 "GET /compute/v2.1/servers/7df225be-2dbc-4ef6-aeec-9a3de33a0006" status: 200 len: 1322 microversion: 2.1 time: 0.674080 Aug 10 23:14:33.563544 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1778/3704] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:32 2022] GET /compute/v2.1/servers/7df225be-2dbc-4ef6-aeec-9a3de33a0006 => generated 1322 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:33.597131 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-c4f16c04-7308-4b88-a8a0-6d7db2ef898a req-fb6bf816-916c-46b4-9f85-28d21ccffa28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27dd09d6-47ed-4b55-bd02-baad36a28429", "name": "network-vif-plugged", "status": "completed", "tag": "be28e077-8bcf-4598-b8d5-d46262e4d7fb"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:14:33.631653 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-c4f16c04-7308-4b88-a8a0-6d7db2ef898a req-fb6bf816-916c-46b4-9f85-28d21ccffa28 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:33.633885 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-c4f16c04-7308-4b88-a8a0-6d7db2ef898a req-fb6bf816-916c-46b4-9f85-28d21ccffa28 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:33.634496 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-c4f16c04-7308-4b88-a8a0-6d7db2ef898a req-fb6bf816-916c-46b4-9f85-28d21ccffa28 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:33.656742 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-c4f16c04-7308-4b88-a8a0-6d7db2ef898a req-fb6bf816-916c-46b4-9f85-28d21ccffa28 service nova] Creating event network-vif-plugged:be28e077-8bcf-4598-b8d5-d46262e4d7fb for instance 27dd09d6-47ed-4b55-bd02-baad36a28429 on n-h2-850468-14 Aug 10 23:14:33.672050 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-c4f16c04-7308-4b88-a8a0-6d7db2ef898a req-fb6bf816-916c-46b4-9f85-28d21ccffa28 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088645 Aug 10 23:14:33.673221 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1779/3705] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:14:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:14:33.680480 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-3a4f618f-0074-4711-b254-1b18e2c86c0e tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:33.681400 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-3a4f618f-0074-4711-b254-1b18e2c86c0e tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:33.689095 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3a4f618f-0074-4711-b254-1b18e2c86c0e tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:33.689689 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3a4f618f-0074-4711-b254-1b18e2c86c0e tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:33.690598 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3a4f618f-0074-4711-b254-1b18e2c86c0e tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:33.691559 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3a4f618f-0074-4711-b254-1b18e2c86c0e tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:33.692265 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3a4f618f-0074-4711-b254-1b18e2c86c0e tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:33.692847 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3a4f618f-0074-4711-b254-1b18e2c86c0e tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:33.996749 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-16b2afe3-18b1-4b73-aa04-903be48b0204 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:34.009424 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-16b2afe3-18b1-4b73-aa04-903be48b0204 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/3efc12c9-baf5-40e4-9d98-e72d28377db6" status: 200 len: 1511 microversion: 2.1 time: 0.814292 Aug 10 23:14:34.010735 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1927/3706] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:33 2022] GET /compute/v2.1/servers/3efc12c9-baf5-40e4-9d98-e72d28377db6 => generated 1511 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:34.017329 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-229daf4b-e470-4db2-926d-63affed234f4 tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:34.020480 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-229daf4b-e470-4db2-926d-63affed234f4 tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] [instance: 325ce83e-53e6-4021-b1a1-548ff5057761] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:34.030434 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-229daf4b-e470-4db2-926d-63affed234f4 tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:34.031312 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-229daf4b-e470-4db2-926d-63affed234f4 tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:34.032973 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-229daf4b-e470-4db2-926d-63affed234f4 tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:34.034254 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-229daf4b-e470-4db2-926d-63affed234f4 tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:34.034978 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-229daf4b-e470-4db2-926d-63affed234f4 tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:34.035884 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-229daf4b-e470-4db2-926d-63affed234f4 tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:34.041349 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-3a4f618f-0074-4711-b254-1b18e2c86c0e tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:34.061546 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-3a4f618f-0074-4711-b254-1b18e2c86c0e tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b" status: 200 len: 1506 microversion: 2.1 time: 0.381408 Aug 10 23:14:34.062573 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1780/3707] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:33 2022] GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b => generated 1506 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:34.134249 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-1163ea8a-e681-48e5-a2c7-aa1dd737e4a9 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-498918926", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452", "key_name": "tempest-key-57434326", "networks": [{"uuid": "91d0258a-9486-4479-91e9-a6d9339a2e0a"}]}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:14:34.215767 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.network.neutron [None req-1163ea8a-e681-48e5-a2c7-aa1dd737e4a9 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] validate_networks() for [('91d0258a-9486-4479-91e9-a6d9339a2e0a', None, None, None, None, None)] {{(pid=122632) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 23:14:34.545447 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-229daf4b-e470-4db2-926d-63affed234f4 tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39eef3efd444a6d8192f405cba67f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee72843cb8064834bdbc02d8a5417f71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:34.558770 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-1163ea8a-e681-48e5-a2c7-aa1dd737e4a9 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] HTTP exception thrown: Invalid key_name provided. Aug 10 23:14:34.562021 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-1163ea8a-e681-48e5-a2c7-aa1dd737e4a9 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Request method failure captured: Aug 10 23:14:34.562021 n-d-850468-14 devstack@n-api.service[122632]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 10 23:14:34.562021 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:14:34.562021 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:14:34.562021 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:14:34.562021 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 244 Aug 10 23:14:34.562021 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:14:34.562021 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:14:34.562021 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:14:34.562021 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:14:34.562021 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9DuIKrfOsS8tKST0PsIPrvuNPfsVISfOPvUoe9ddkVcTJKj7rDjd3OuH9u-DTT1aypj1AUoUKtajD98eDOUOHSpPisBSdRlSCov30lHf1uZq-XZLyBIVg5kAG8-SuXk2s1TL7EnRcjjMARSkm95dZDnXaBXRT3M4f8UoMDwqu7xK7gQ Aug 10 23:14:34.562021 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:14:34.562021 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:14:34.562021 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:14:34.562021 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:14:34.562021 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:14:34.562021 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:14:34.562021 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: d11bbb3e87f4463787da56ab19108822 Aug 10 23:14:34.562021 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-ServersNegativeTestJSON-1216728002 Aug 10 23:14:34.562021 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:14:34.562021 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:14:34.562021 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d11bbb3e87f4463787da56ab19108822"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d11bbb3e87f4463787da56ab19108822"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d11bbb3e87f4463787da56ab19108822"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d11bbb3e87f4463787da56ab19108822", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:14:34.562021 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-ServersNegativeTestJSON-1216728002 Aug 10 23:14:34.562021 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: d11bbb3e87f4463787da56ab19108822 Aug 10 23:14:34.562021 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1216728002 Aug 10 23:14:34.562021 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-ServersNegativeTestJSON-1216728002-project Aug 10 23:14:34.562021 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:14:34.562021 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:14:34.562021 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: f284ec2a4bf546b58c1c1adaf880e1fb Aug 10 23:14:34.562021 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-ServersNegativeTestJSON-1216728002-project Aug 10 23:14:34.562021 n-d-850468-14 devstack@n-api.service[122632]: Aug 10 23:14:34.562021 n-d-850468-14 devstack@n-api.service[122632]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-498918926", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452", "key_name": "tempest-key-57434326", "networks": [{"uuid": "91d0258a-9486-4479-91e9-a6d9339a2e0a"}]}} Aug 10 23:14:34.562021 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:14:34.562021 n-d-850468-14 devstack@n-api.service[122632]: exception: Invalid key_name provided. Aug 10 23:14:34.562021 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-498918926', 'imageRef': '78ad8905-f66f-4733-8be9-2b260f1fabed', 'flavorRef': '452', 'key_name': 'tempest-key-57434326', 'networks': [{'uuid': '91d0258a-9486-4479-91e9-a6d9339a2e0a'}]}}} Aug 10 23:14:34.562021 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:14:34.562021 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:14:34.562021 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 23:14:34.562021 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 23:14:34.562021 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 23:14:34.562021 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 23:14:34.562021 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 23:14:34.562021 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 23:14:34.562021 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1077, in _validate_and_build_base_options Aug 10 23:14:34.562021 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, Aug 10 23:14:34.562021 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 10 23:14:34.562021 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 10 23:14:34.562021 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Aug 10 23:14:34.562021 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Aug 10 23:14:34.562021 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Aug 10 23:14:34.562021 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Aug 10 23:14:34.562021 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 10 23:14:34.562021 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 10 23:14:34.562021 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Aug 10 23:14:34.562021 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Aug 10 23:14:34.562021 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-57434326 not found for user f284ec2a4bf546b58c1c1adaf880e1fb Aug 10 23:14:34.562021 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:14:34.562021 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:14:34.562021 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:14:34.562021 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:14:34.562021 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:14:34.565496 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:14:34.565496 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:14:34.565496 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:14:34.565496 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:14:34.565496 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:14:34.565496 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 23:14:34.565496 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 23:14:34.565496 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 23:14:34.565496 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 23:14:34.565496 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 23:14:34.565496 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 23:14:34.565496 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 23:14:34.565496 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create Aug 10 23:14:34.565496 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Aug 10 23:14:34.565496 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. Aug 10 23:14:34.565496 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:14:34.565496 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:14:34.565496 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:14:34.565496 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:14:34.565496 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:14:34.565496 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:14:34.565496 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:14:34.565496 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:14:34.565496 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. Aug 10 23:14:34.565496 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:14:34.569250 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-1163ea8a-e681-48e5-a2c7-aa1dd737e4a9 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Returning 400 to user: Invalid key_name provided. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:14:34.570964 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-1163ea8a-e681-48e5-a2c7-aa1dd737e4a9 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 0.441836 Aug 10 23:14:34.572072 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1781/3708] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 23:14:34 2022] POST /compute/v2.1/servers => generated 70 bytes in 444 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 10 23:14:34.573122 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-229daf4b-e470-4db2-926d-63affed234f4 tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39eef3efd444a6d8192f405cba67f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee72843cb8064834bdbc02d8a5417f71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:34.576837 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-229daf4b-e470-4db2-926d-63affed234f4 tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39eef3efd444a6d8192f405cba67f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee72843cb8064834bdbc02d8a5417f71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:34.578032 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-229daf4b-e470-4db2-926d-63affed234f4 tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] 10.222.0.58 "GET /compute/v2.1/servers/325ce83e-53e6-4021-b1a1-548ff5057761" status: 200 len: 1359 microversion: 2.21 time: 0.565631 Aug 10 23:14:34.578649 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-a202de7a-3a56-4088-911e-d7ef80d00bba tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:34.580100 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-a202de7a-3a56-4088-911e-d7ef80d00bba tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: 7a8f8d36-4744-43b7-9d42-e50fb5fabe60] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:34.588582 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a202de7a-3a56-4088-911e-d7ef80d00bba tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:34.589117 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a202de7a-3a56-4088-911e-d7ef80d00bba tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:34.590173 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a202de7a-3a56-4088-911e-d7ef80d00bba tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:34.590957 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1928/3709] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:14:34 2022] GET /compute/v2.1/servers/325ce83e-53e6-4021-b1a1-548ff5057761 => generated 1359 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:14:34.591104 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a202de7a-3a56-4088-911e-d7ef80d00bba tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:34.591505 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a202de7a-3a56-4088-911e-d7ef80d00bba tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:34.591937 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a202de7a-3a56-4088-911e-d7ef80d00bba tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:34.598923 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-cdbaa2e9-8d3c-4f64-b36f-bee6afcd13b3 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:34.599799 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-cdbaa2e9-8d3c-4f64-b36f-bee6afcd13b3 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:34.607037 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cdbaa2e9-8d3c-4f64-b36f-bee6afcd13b3 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:34.607749 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cdbaa2e9-8d3c-4f64-b36f-bee6afcd13b3 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:34.608452 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cdbaa2e9-8d3c-4f64-b36f-bee6afcd13b3 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:34.609314 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cdbaa2e9-8d3c-4f64-b36f-bee6afcd13b3 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:34.609934 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cdbaa2e9-8d3c-4f64-b36f-bee6afcd13b3 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:34.610512 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cdbaa2e9-8d3c-4f64-b36f-bee6afcd13b3 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:34.772062 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-a202de7a-3a56-4088-911e-d7ef80d00bba tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6160c7a42740efbe3613380933fa15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d90f8a58ad047fa8f347d6474e4d673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:34.782032 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-a202de7a-3a56-4088-911e-d7ef80d00bba tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "GET /compute/v2.1/servers/7a8f8d36-4744-43b7-9d42-e50fb5fabe60" status: 200 len: 1314 microversion: 2.1 time: 0.208653 Aug 10 23:14:34.784706 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1782/3710] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:34 2022] GET /compute/v2.1/servers/7a8f8d36-4744-43b7-9d42-e50fb5fabe60 => generated 1314 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:34.790168 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-851197db-17b8-4442-a23f-9fc32f4e1638 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:34.791011 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-851197db-17b8-4442-a23f-9fc32f4e1638 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] [instance: 7df225be-2dbc-4ef6-aeec-9a3de33a0006] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:34.797801 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-851197db-17b8-4442-a23f-9fc32f4e1638 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:34.798534 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-851197db-17b8-4442-a23f-9fc32f4e1638 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:34.799173 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-851197db-17b8-4442-a23f-9fc32f4e1638 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:34.800089 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-851197db-17b8-4442-a23f-9fc32f4e1638 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:34.800694 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-851197db-17b8-4442-a23f-9fc32f4e1638 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:34.801866 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-851197db-17b8-4442-a23f-9fc32f4e1638 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:34.949964 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-cdbaa2e9-8d3c-4f64-b36f-bee6afcd13b3 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:34.965143 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-cdbaa2e9-8d3c-4f64-b36f-bee6afcd13b3 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b" status: 200 len: 1506 microversion: 2.1 time: 0.372976 Aug 10 23:14:34.974876 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1929/3711] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:34 2022] GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b => generated 1506 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:34.989252 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-65820dc2-e424-4b5c-a154-a9550343e55e tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:34.989901 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-65820dc2-e424-4b5c-a154-a9550343e55e tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:34.996869 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-65820dc2-e424-4b5c-a154-a9550343e55e tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:34.997639 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-65820dc2-e424-4b5c-a154-a9550343e55e tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:34.998268 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-65820dc2-e424-4b5c-a154-a9550343e55e tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:34.999209 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-65820dc2-e424-4b5c-a154-a9550343e55e tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:34.999824 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-65820dc2-e424-4b5c-a154-a9550343e55e tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:35.000446 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-65820dc2-e424-4b5c-a154-a9550343e55e tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:35.006418 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-851197db-17b8-4442-a23f-9fc32f4e1638 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07c94ebf0954cdea12b9a689538d96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395d7c4077e54c43bb95288db3942b0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:35.016694 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-851197db-17b8-4442-a23f-9fc32f4e1638 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] 10.222.0.58 "GET /compute/v2.1/servers/7df225be-2dbc-4ef6-aeec-9a3de33a0006" status: 200 len: 1322 microversion: 2.1 time: 0.230320 Aug 10 23:14:35.017807 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1783/3712] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:34 2022] GET /compute/v2.1/servers/7df225be-2dbc-4ef6-aeec-9a3de33a0006 => generated 1322 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:35.034062 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-d3aac1de-62d5-443a-8cad-242f557e21ab tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:35.034673 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-d3aac1de-62d5-443a-8cad-242f557e21ab tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: 3efc12c9-baf5-40e4-9d98-e72d28377db6] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:35.043171 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d3aac1de-62d5-443a-8cad-242f557e21ab tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:35.044423 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d3aac1de-62d5-443a-8cad-242f557e21ab tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:35.045185 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d3aac1de-62d5-443a-8cad-242f557e21ab tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:35.046044 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d3aac1de-62d5-443a-8cad-242f557e21ab tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:35.046640 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d3aac1de-62d5-443a-8cad-242f557e21ab tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:35.047226 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d3aac1de-62d5-443a-8cad-242f557e21ab tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:35.205448 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-d3aac1de-62d5-443a-8cad-242f557e21ab tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:35.221886 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-d3aac1de-62d5-443a-8cad-242f557e21ab tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/3efc12c9-baf5-40e4-9d98-e72d28377db6" status: 200 len: 1488 microversion: 2.1 time: 0.193598 Aug 10 23:14:35.223219 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1784/3713] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:35 2022] GET /compute/v2.1/servers/3efc12c9-baf5-40e4-9d98-e72d28377db6 => generated 1488 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:35.248611 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-8d1f2f38-06f1-4c23-a6db-fc6065bc9a86 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:14:35.252018 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-8d1f2f38-06f1-4c23-a6db-fc6065bc9a86 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: fa9dfd3a-a636-48ce-ae15-0ed51baee954] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:35.260467 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8d1f2f38-06f1-4c23-a6db-fc6065bc9a86 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:35.260973 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8d1f2f38-06f1-4c23-a6db-fc6065bc9a86 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:35.261419 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8d1f2f38-06f1-4c23-a6db-fc6065bc9a86 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:35.262132 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8d1f2f38-06f1-4c23-a6db-fc6065bc9a86 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:35.262754 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8d1f2f38-06f1-4c23-a6db-fc6065bc9a86 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:35.263495 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8d1f2f38-06f1-4c23-a6db-fc6065bc9a86 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:35.389661 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-65820dc2-e424-4b5c-a154-a9550343e55e tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:35.413114 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-65820dc2-e424-4b5c-a154-a9550343e55e tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b" status: 200 len: 1506 microversion: 2.1 time: 0.426756 Aug 10 23:14:35.418295 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1930/3714] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:34 2022] GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b => generated 1506 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:14:35.493929 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-a9f42f6e-0dcd-4d78-a2c2-711d05ae8c01 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1169243963", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "91d0258a-9486-4479-91e9-a6d9339a2e0a"}]}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:14:36.039256 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.network.security_group_api [None req-a9f42f6e-0dcd-4d78-a2c2-711d05ae8c01 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Neutron security group does_not_exist not found {{(pid=122633) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Aug 10 23:14:36.042108 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-a9f42f6e-0dcd-4d78-a2c2-711d05ae8c01 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Aug 10 23:14:36.068727 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-a9f42f6e-0dcd-4d78-a2c2-711d05ae8c01 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Request method failure captured: Aug 10 23:14:36.068727 n-d-850468-14 devstack@n-api.service[122633]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 10 23:14:36.068727 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:14:36.068727 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:14:36.068727 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:14:36.068727 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 258 Aug 10 23:14:36.068727 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:14:36.068727 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:14:36.068727 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:14:36.068727 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:14:36.068727 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9DuIKrfOsS8tKST0PsIPrvuNPfsVISfOPvUoe9ddkVcTJKj7rDjd3OuH9u-DTT1aypj1AUoUKtajD98eDOUOHSpPisBSdRlSCov30lHf1uZq-XZLyBIVg5kAG8-SuXk2s1TL7EnRcjjMARSkm95dZDnXaBXRT3M4f8UoMDwqu7xK7gQ Aug 10 23:14:36.068727 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:14:36.068727 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:14:36.068727 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:14:36.068727 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:14:36.068727 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:14:36.068727 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:14:36.068727 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: d11bbb3e87f4463787da56ab19108822 Aug 10 23:14:36.068727 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-ServersNegativeTestJSON-1216728002 Aug 10 23:14:36.068727 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:14:36.068727 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:14:36.068727 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d11bbb3e87f4463787da56ab19108822"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d11bbb3e87f4463787da56ab19108822"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d11bbb3e87f4463787da56ab19108822"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d11bbb3e87f4463787da56ab19108822", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:14:36.068727 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-ServersNegativeTestJSON-1216728002 Aug 10 23:14:36.068727 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: d11bbb3e87f4463787da56ab19108822 Aug 10 23:14:36.068727 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1216728002 Aug 10 23:14:36.068727 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-ServersNegativeTestJSON-1216728002-project Aug 10 23:14:36.068727 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:14:36.068727 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:14:36.068727 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: f284ec2a4bf546b58c1c1adaf880e1fb Aug 10 23:14:36.068727 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-ServersNegativeTestJSON-1216728002-project Aug 10 23:14:36.068727 n-d-850468-14 devstack@n-api.service[122633]: Aug 10 23:14:36.068727 n-d-850468-14 devstack@n-api.service[122633]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1169243963", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "91d0258a-9486-4479-91e9-a6d9339a2e0a"}]}} Aug 10 23:14:36.068727 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:14:36.068727 n-d-850468-14 devstack@n-api.service[122633]: exception: Unable to find security_group with name or id 'does_not_exist' Aug 10 23:14:36.068727 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1169243963', 'imageRef': '78ad8905-f66f-4733-8be9-2b260f1fabed', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': '91d0258a-9486-4479-91e9-a6d9339a2e0a'}]}}} Aug 10 23:14:36.068727 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:14:36.068727 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:14:36.068727 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Aug 10 23:14:36.068727 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, Aug 10 23:14:36.068727 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 23:14:36.068727 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 23:14:36.068727 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Aug 10 23:14:36.068727 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Aug 10 23:14:36.068727 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' Aug 10 23:14:36.068727 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:14:36.068727 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:14:36.068727 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:14:36.068727 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:14:36.068727 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Aug 10 23:14:36.068727 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( Aug 10 23:14:36.068727 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 23:14:36.068727 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 23:14:36.068727 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name Aug 10 23:14:36.068727 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Aug 10 23:14:36.068727 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' Aug 10 23:14:36.068727 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:14:36.068727 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:14:36.068727 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:14:36.068727 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:14:36.068727 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Aug 10 23:14:36.068727 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( Aug 10 23:14:36.072970 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Aug 10 23:14:36.072970 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, Aug 10 23:14:36.072970 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Aug 10 23:14:36.072970 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, Aug 10 23:14:36.072970 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 10 23:14:36.072970 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 10 23:14:36.072970 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource Aug 10 23:14:36.072970 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( Aug 10 23:14:36.072970 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' Aug 10 23:14:36.072970 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:14:36.072970 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:14:36.072970 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:14:36.072970 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:14:36.072970 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 10 23:14:36.072970 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 10 23:14:36.072970 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2151, in create Aug 10 23:14:36.072970 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 10 23:14:36.072970 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1634, in _create_instance Aug 10 23:14:36.072970 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 10 23:14:36.072970 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1062, in _validate_and_build_base_options Aug 10 23:14:36.072970 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( Aug 10 23:14:36.072970 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 509, in _check_requested_secgroups Aug 10 23:14:36.072970 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) Aug 10 23:14:36.072970 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name Aug 10 23:14:36.072970 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 10 23:14:36.072970 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' Aug 10 23:14:36.072970 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:14:36.072970 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:14:36.072970 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:14:36.072970 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:14:36.072970 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:14:36.072970 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:14:36.072970 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:14:36.072970 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:14:36.072970 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:14:36.072970 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:14:36.072970 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 23:14:36.072970 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 23:14:36.072970 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 23:14:36.072970 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 23:14:36.072970 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 23:14:36.072970 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 23:14:36.072970 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 10 23:14:36.072970 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Aug 10 23:14:36.072970 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 10 23:14:36.072970 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' Aug 10 23:14:36.072970 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:14:36.072970 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:14:36.072970 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:14:36.072970 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:14:36.072970 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:14:36.072970 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:14:36.072970 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:14:36.072970 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:14:36.072970 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' Aug 10 23:14:36.072970 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:14:36.085914 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-8d1f2f38-06f1-4c23-a6db-fc6065bc9a86 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "POST /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954/action" status: 200 len: 139 microversion: 2.1 time: 0.839552 Aug 10 23:14:36.085914 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1785/3715] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:14:35 2022] POST /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954/action => generated 139 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:14:36.089962 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-f53cf04c-b438-44ed-b74f-dfc097aa5415 tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:36.090233 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-a9f42f6e-0dcd-4d78-a2c2-711d05ae8c01 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:14:36.090687 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-f53cf04c-b438-44ed-b74f-dfc097aa5415 tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] [instance: 325ce83e-53e6-4021-b1a1-548ff5057761] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:36.093361 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-a9f42f6e-0dcd-4d78-a2c2-711d05ae8c01 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.602151 Aug 10 23:14:36.094581 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1931/3716] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 23:14:35 2022] POST /compute/v2.1/servers => generated 106 bytes in 606 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 10 23:14:36.114604 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-d0ba173d-20e0-4162-bd7a-1745f1d9b285 req-125315f3-531f-49f8-a9de-05719b9e7d5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a8f8d36-4744-43b7-9d42-e50fb5fabe60", "name": "network-vif-plugged", "status": "completed", "tag": "e13e25ef-a098-467e-a71b-fe5918abb3b3"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:14:36.115363 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f53cf04c-b438-44ed-b74f-dfc097aa5415 tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:36.115914 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f53cf04c-b438-44ed-b74f-dfc097aa5415 tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:36.116560 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f53cf04c-b438-44ed-b74f-dfc097aa5415 tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:36.117458 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f53cf04c-b438-44ed-b74f-dfc097aa5415 tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:36.117901 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f53cf04c-b438-44ed-b74f-dfc097aa5415 tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:36.118361 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f53cf04c-b438-44ed-b74f-dfc097aa5415 tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:36.154202 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-d0ba173d-20e0-4162-bd7a-1745f1d9b285 req-125315f3-531f-49f8-a9de-05719b9e7d5f service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:36.157019 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-d0ba173d-20e0-4162-bd7a-1745f1d9b285 req-125315f3-531f-49f8-a9de-05719b9e7d5f service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:36.158006 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-d0ba173d-20e0-4162-bd7a-1745f1d9b285 req-125315f3-531f-49f8-a9de-05719b9e7d5f service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:36.203567 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-d0ba173d-20e0-4162-bd7a-1745f1d9b285 req-125315f3-531f-49f8-a9de-05719b9e7d5f service nova] Creating event network-vif-plugged:e13e25ef-a098-467e-a71b-fe5918abb3b3 for instance 7a8f8d36-4744-43b7-9d42-e50fb5fabe60 on n-h1-850468-14 Aug 10 23:14:36.215932 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-d0ba173d-20e0-4162-bd7a-1745f1d9b285 req-125315f3-531f-49f8-a9de-05719b9e7d5f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118804 Aug 10 23:14:36.217771 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1932/3717] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:14:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:14:36.235514 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-42101984-7869-45e5-a933-b028c9612075 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:36.236795 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-42101984-7869-45e5-a933-b028c9612075 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: 7a8f8d36-4744-43b7-9d42-e50fb5fabe60] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:36.256090 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-42101984-7869-45e5-a933-b028c9612075 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:36.256595 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-42101984-7869-45e5-a933-b028c9612075 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:36.258287 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-42101984-7869-45e5-a933-b028c9612075 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:36.258287 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-42101984-7869-45e5-a933-b028c9612075 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:36.259157 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-42101984-7869-45e5-a933-b028c9612075 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:36.259270 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-42101984-7869-45e5-a933-b028c9612075 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:36.368587 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-f53cf04c-b438-44ed-b74f-dfc097aa5415 tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39eef3efd444a6d8192f405cba67f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee72843cb8064834bdbc02d8a5417f71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:36.378947 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-f53cf04c-b438-44ed-b74f-dfc097aa5415 tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39eef3efd444a6d8192f405cba67f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee72843cb8064834bdbc02d8a5417f71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:36.380781 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-f53cf04c-b438-44ed-b74f-dfc097aa5415 tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39eef3efd444a6d8192f405cba67f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee72843cb8064834bdbc02d8a5417f71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:36.382657 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-f53cf04c-b438-44ed-b74f-dfc097aa5415 tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] 10.222.0.58 "GET /compute/v2.1/servers/325ce83e-53e6-4021-b1a1-548ff5057761" status: 200 len: 1359 microversion: 2.21 time: 0.299513 Aug 10 23:14:36.399582 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1786/3718] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:14:36 2022] GET /compute/v2.1/servers/325ce83e-53e6-4021-b1a1-548ff5057761 => generated 1359 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:14:36.404760 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-1aba17b8-fbb4-49a6-b588-ce66d17a4c74 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:36.405695 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-1aba17b8-fbb4-49a6-b588-ce66d17a4c74 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] [instance: 7df225be-2dbc-4ef6-aeec-9a3de33a0006] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:36.413577 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1aba17b8-fbb4-49a6-b588-ce66d17a4c74 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:36.414931 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1aba17b8-fbb4-49a6-b588-ce66d17a4c74 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:36.415603 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1aba17b8-fbb4-49a6-b588-ce66d17a4c74 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:36.416521 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1aba17b8-fbb4-49a6-b588-ce66d17a4c74 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:36.417173 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1aba17b8-fbb4-49a6-b588-ce66d17a4c74 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:36.417777 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1aba17b8-fbb4-49a6-b588-ce66d17a4c74 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:36.442748 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=100 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:14:36.565777 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-1aba17b8-fbb4-49a6-b588-ce66d17a4c74 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07c94ebf0954cdea12b9a689538d96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395d7c4077e54c43bb95288db3942b0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:36.574425 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-1aba17b8-fbb4-49a6-b588-ce66d17a4c74 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] 10.222.0.58 "GET /compute/v2.1/servers/7df225be-2dbc-4ef6-aeec-9a3de33a0006" status: 200 len: 1322 microversion: 2.1 time: 0.173398 Aug 10 23:14:36.575440 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1787/3719] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:36 2022] GET /compute/v2.1/servers/7df225be-2dbc-4ef6-aeec-9a3de33a0006 => generated 1322 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:36.581101 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-46fd37ca-333c-4be3-a7ae-d80e9f3582c7 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:36.582074 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-46fd37ca-333c-4be3-a7ae-d80e9f3582c7 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: fa9dfd3a-a636-48ce-ae15-0ed51baee954] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:36.589221 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-46fd37ca-333c-4be3-a7ae-d80e9f3582c7 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:36.589715 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-46fd37ca-333c-4be3-a7ae-d80e9f3582c7 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:36.590158 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-46fd37ca-333c-4be3-a7ae-d80e9f3582c7 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:36.590911 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-46fd37ca-333c-4be3-a7ae-d80e9f3582c7 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:36.591374 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-46fd37ca-333c-4be3-a7ae-d80e9f3582c7 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:36.591821 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-46fd37ca-333c-4be3-a7ae-d80e9f3582c7 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:36.732986 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-46fd37ca-333c-4be3-a7ae-d80e9f3582c7 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:36.740827 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-46fd37ca-333c-4be3-a7ae-d80e9f3582c7 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954" status: 200 len: 1667 microversion: 2.1 time: 0.164342 Aug 10 23:14:36.742310 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1788/3720] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:36 2022] GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954 => generated 1667 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:36.747318 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-3ca863b9-e892-4d05-bb8a-d6812fb9eabc tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:36.747996 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-3ca863b9-e892-4d05-bb8a-d6812fb9eabc tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:36.754383 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3ca863b9-e892-4d05-bb8a-d6812fb9eabc tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:36.754801 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3ca863b9-e892-4d05-bb8a-d6812fb9eabc tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:36.755234 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3ca863b9-e892-4d05-bb8a-d6812fb9eabc tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:36.755921 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3ca863b9-e892-4d05-bb8a-d6812fb9eabc tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:36.756528 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3ca863b9-e892-4d05-bb8a-d6812fb9eabc tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:36.757173 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3ca863b9-e892-4d05-bb8a-d6812fb9eabc tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:36.863868 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-42101984-7869-45e5-a933-b028c9612075 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6160c7a42740efbe3613380933fa15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d90f8a58ad047fa8f347d6474e4d673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:36.873414 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-42101984-7869-45e5-a933-b028c9612075 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "GET /compute/v2.1/servers/7a8f8d36-4744-43b7-9d42-e50fb5fabe60" status: 200 len: 1314 microversion: 2.1 time: 0.651165 Aug 10 23:14:36.883244 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1933/3721] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:36 2022] GET /compute/v2.1/servers/7a8f8d36-4744-43b7-9d42-e50fb5fabe60 => generated 1314 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:36.901035 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-b57b52f1-b882-4794-8dc6-abc74176662a tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:36.902679 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-b57b52f1-b882-4794-8dc6-abc74176662a tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: fa9dfd3a-a636-48ce-ae15-0ed51baee954] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:36.911951 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b57b52f1-b882-4794-8dc6-abc74176662a tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:36.915513 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b57b52f1-b882-4794-8dc6-abc74176662a tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:36.916044 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b57b52f1-b882-4794-8dc6-abc74176662a tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:36.917546 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b57b52f1-b882-4794-8dc6-abc74176662a tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:36.917936 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b57b52f1-b882-4794-8dc6-abc74176662a tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:36.918470 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b57b52f1-b882-4794-8dc6-abc74176662a tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:36.948441 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-3ca863b9-e892-4d05-bb8a-d6812fb9eabc tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:36.957952 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-3ca863b9-e892-4d05-bb8a-d6812fb9eabc tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b" status: 200 len: 1506 microversion: 2.1 time: 0.214863 Aug 10 23:14:36.958748 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1789/3722] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:36 2022] GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b => generated 1506 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:36.981454 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-4e91b02e-4dd7-46fd-82cb-169b4c1b2edd tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:36.982084 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-4e91b02e-4dd7-46fd-82cb-169b4c1b2edd tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:36.988305 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4e91b02e-4dd7-46fd-82cb-169b4c1b2edd tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:36.989171 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4e91b02e-4dd7-46fd-82cb-169b4c1b2edd tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:36.989687 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4e91b02e-4dd7-46fd-82cb-169b4c1b2edd tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:36.990615 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4e91b02e-4dd7-46fd-82cb-169b4c1b2edd tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:36.992397 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4e91b02e-4dd7-46fd-82cb-169b4c1b2edd tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:36.993628 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4e91b02e-4dd7-46fd-82cb-169b4c1b2edd tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:37.242975 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-4e91b02e-4dd7-46fd-82cb-169b4c1b2edd tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:37.243594 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-b57b52f1-b882-4794-8dc6-abc74176662a tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:37.254020 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-b57b52f1-b882-4794-8dc6-abc74176662a tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954" status: 200 len: 1667 microversion: 2.1 time: 0.371001 Aug 10 23:14:37.254631 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1934/3723] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:36 2022] GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954 => generated 1667 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:37.255164 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-4e91b02e-4dd7-46fd-82cb-169b4c1b2edd tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b" status: 200 len: 1506 microversion: 2.1 time: 0.278098 Aug 10 23:14:37.274678 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1790/3724] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:36 2022] GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b => generated 1506 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:37.279885 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-5d768a14-e686-4cab-a8ef-5820ce035ec3 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:37.280547 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-5d768a14-e686-4cab-a8ef-5820ce035ec3 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: fa9dfd3a-a636-48ce-ae15-0ed51baee954] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:37.284928 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-5856da3c-6d2c-458c-b0b5-c8f2295f7277 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:37.285513 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-5856da3c-6d2c-458c-b0b5-c8f2295f7277 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 5faa1ca6-e6fd-4291-bb9c-904eb8f377d4] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:37.290901 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5d768a14-e686-4cab-a8ef-5820ce035ec3 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:37.291655 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-5856da3c-6d2c-458c-b0b5-c8f2295f7277 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] HTTP exception thrown: Instance 5faa1ca6-e6fd-4291-bb9c-904eb8f377d4 could not be found. Aug 10 23:14:37.291794 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5d768a14-e686-4cab-a8ef-5820ce035ec3 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:37.292252 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5d768a14-e686-4cab-a8ef-5820ce035ec3 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:37.293031 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5d768a14-e686-4cab-a8ef-5820ce035ec3 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:37.293896 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5d768a14-e686-4cab-a8ef-5820ce035ec3 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:37.294329 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-5856da3c-6d2c-458c-b0b5-c8f2295f7277 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Request method failure captured: Aug 10 23:14:37.294329 n-d-850468-14 devstack@n-api.service[122632]: request: DELETE /compute/v2.1/servers/5faa1ca6-e6fd-4291-bb9c-904eb8f377d4 HTTP/1.1 Aug 10 23:14:37.294329 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:14:37.294329 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:14:37.294329 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:14:37.294329 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 23:14:37.294329 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:14:37.294329 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:14:37.294329 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:14:37.294329 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:14:37.294329 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9DuIKrfOsS8tKST0PsIPrvuNPfsVISfOPvUoe9ddkVcTJKj7rDjd3OuH9u-DTT1aypj1AUoUKtajD98eDOUOHSpPisBSdRlSCov30lHf1uZq-XZLyBIVg5kAG8-SuXk2s1TL7EnRcjjMARSkm95dZDnXaBXRT3M4f8UoMDwqu7xK7gQ Aug 10 23:14:37.294329 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:14:37.294329 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:14:37.294329 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:14:37.294329 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:14:37.294329 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:14:37.294329 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:14:37.294329 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: d11bbb3e87f4463787da56ab19108822 Aug 10 23:14:37.294329 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-ServersNegativeTestJSON-1216728002 Aug 10 23:14:37.294329 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:14:37.294329 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:14:37.294329 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d11bbb3e87f4463787da56ab19108822"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d11bbb3e87f4463787da56ab19108822"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d11bbb3e87f4463787da56ab19108822"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d11bbb3e87f4463787da56ab19108822", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:14:37.294329 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-ServersNegativeTestJSON-1216728002 Aug 10 23:14:37.294329 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: d11bbb3e87f4463787da56ab19108822 Aug 10 23:14:37.294329 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1216728002 Aug 10 23:14:37.294329 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-ServersNegativeTestJSON-1216728002-project Aug 10 23:14:37.294329 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:14:37.294329 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:14:37.294329 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: f284ec2a4bf546b58c1c1adaf880e1fb Aug 10 23:14:37.294329 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-ServersNegativeTestJSON-1216728002-project Aug 10 23:14:37.294329 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:14:37.294329 n-d-850468-14 devstack@n-api.service[122632]: exception: Instance 5faa1ca6-e6fd-4291-bb9c-904eb8f377d4 could not be found. Aug 10 23:14:37.294329 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': '5faa1ca6-e6fd-4291-bb9c-904eb8f377d4'} Aug 10 23:14:37.294329 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:14:37.294329 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:14:37.294329 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:14:37.294329 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:14:37.294329 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:14:37.294329 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:14:37.294329 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 10 23:14:37.294329 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 10 23:14:37.294329 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5faa1ca6-e6fd-4291-bb9c-904eb8f377d4 could not be found. Aug 10 23:14:37.294329 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:14:37.294329 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:14:37.294329 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:14:37.294329 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:14:37.294329 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:14:37.294329 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:14:37.294329 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:14:37.294329 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:14:37.294329 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:14:37.294329 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:14:37.294329 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 23:14:37.294329 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 23:14:37.294329 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 23:14:37.294329 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 23:14:37.294329 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:14:37.294329 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:14:37.294329 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:14:37.294329 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:14:37.294329 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5faa1ca6-e6fd-4291-bb9c-904eb8f377d4 could not be found. Aug 10 23:14:37.294329 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:14:37.294329 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:14:37.298977 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:14:37.298977 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:14:37.298977 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:14:37.298977 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:14:37.298977 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:14:37.298977 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:14:37.298977 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5faa1ca6-e6fd-4291-bb9c-904eb8f377d4 could not be found. Aug 10 23:14:37.298977 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:14:37.299957 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5d768a14-e686-4cab-a8ef-5820ce035ec3 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:37.300809 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-5856da3c-6d2c-458c-b0b5-c8f2295f7277 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Returning 404 to user: Instance 5faa1ca6-e6fd-4291-bb9c-904eb8f377d4 could not be found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:14:37.301884 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-5856da3c-6d2c-458c-b0b5-c8f2295f7277 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "DELETE /compute/v2.1/servers/5faa1ca6-e6fd-4291-bb9c-904eb8f377d4" status: 404 len: 111 microversion: 2.1 time: 0.021871 Aug 10 23:14:37.306584 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1791/3725] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:14:37 2022] DELETE /compute/v2.1/servers/5faa1ca6-e6fd-4291-bb9c-904eb8f377d4 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:14:37.311867 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-8368d958-2dc7-4c17-9198-0492bc82a08a tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:37.312566 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-8368d958-2dc7-4c17-9198-0492bc82a08a tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:37.322326 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8368d958-2dc7-4c17-9198-0492bc82a08a tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:37.323063 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8368d958-2dc7-4c17-9198-0492bc82a08a tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:37.323744 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8368d958-2dc7-4c17-9198-0492bc82a08a tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:37.324768 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8368d958-2dc7-4c17-9198-0492bc82a08a tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:37.326073 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8368d958-2dc7-4c17-9198-0492bc82a08a tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:37.326953 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8368d958-2dc7-4c17-9198-0492bc82a08a tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:37.580092 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-8368d958-2dc7-4c17-9198-0492bc82a08a tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:37.589483 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-8368d958-2dc7-4c17-9198-0492bc82a08a tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b" status: 200 len: 1506 microversion: 2.1 time: 0.281679 Aug 10 23:14:37.595279 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-5d768a14-e686-4cab-a8ef-5820ce035ec3 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:37.604271 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1792/3726] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:37 2022] GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b => generated 1506 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:37.612182 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-7c1a5c96-07fc-45c3-bdba-ff247334b289 tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:37.612803 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-7c1a5c96-07fc-45c3-bdba-ff247334b289 tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] [instance: 325ce83e-53e6-4021-b1a1-548ff5057761] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:37.619595 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7c1a5c96-07fc-45c3-bdba-ff247334b289 tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:37.620081 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7c1a5c96-07fc-45c3-bdba-ff247334b289 tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:37.620946 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7c1a5c96-07fc-45c3-bdba-ff247334b289 tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:37.621845 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7c1a5c96-07fc-45c3-bdba-ff247334b289 tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:37.622480 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7c1a5c96-07fc-45c3-bdba-ff247334b289 tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:37.623148 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7c1a5c96-07fc-45c3-bdba-ff247334b289 tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:37.628796 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-5d768a14-e686-4cab-a8ef-5820ce035ec3 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954" status: 200 len: 1667 microversion: 2.1 time: 0.352784 Aug 10 23:14:37.632449 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1935/3727] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:37 2022] GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954 => generated 1667 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:14:37.643532 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-e5a1d7d2-b8be-4e85-8a2d-9980379c6597 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:37.646920 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-e5a1d7d2-b8be-4e85-8a2d-9980379c6597 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] [instance: 7df225be-2dbc-4ef6-aeec-9a3de33a0006] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:37.664841 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e5a1d7d2-b8be-4e85-8a2d-9980379c6597 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:37.665623 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e5a1d7d2-b8be-4e85-8a2d-9980379c6597 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:37.666090 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e5a1d7d2-b8be-4e85-8a2d-9980379c6597 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:37.666847 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e5a1d7d2-b8be-4e85-8a2d-9980379c6597 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:37.667311 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e5a1d7d2-b8be-4e85-8a2d-9980379c6597 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:37.667737 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e5a1d7d2-b8be-4e85-8a2d-9980379c6597 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:37.920093 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-7c1a5c96-07fc-45c3-bdba-ff247334b289 tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39eef3efd444a6d8192f405cba67f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee72843cb8064834bdbc02d8a5417f71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:37.940232 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-e5a1d7d2-b8be-4e85-8a2d-9980379c6597 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07c94ebf0954cdea12b9a689538d96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395d7c4077e54c43bb95288db3942b0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:37.942433 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-7c1a5c96-07fc-45c3-bdba-ff247334b289 tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39eef3efd444a6d8192f405cba67f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee72843cb8064834bdbc02d8a5417f71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:37.948480 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-e5a1d7d2-b8be-4e85-8a2d-9980379c6597 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] 10.222.0.58 "GET /compute/v2.1/servers/7df225be-2dbc-4ef6-aeec-9a3de33a0006" status: 200 len: 1322 microversion: 2.1 time: 0.313839 Aug 10 23:14:37.948834 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-7c1a5c96-07fc-45c3-bdba-ff247334b289 tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39eef3efd444a6d8192f405cba67f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee72843cb8064834bdbc02d8a5417f71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:37.949077 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1936/3728] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:37 2022] GET /compute/v2.1/servers/7df225be-2dbc-4ef6-aeec-9a3de33a0006 => generated 1322 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:37.950749 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-7c1a5c96-07fc-45c3-bdba-ff247334b289 tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] 10.222.0.58 "GET /compute/v2.1/servers/325ce83e-53e6-4021-b1a1-548ff5057761" status: 200 len: 1359 microversion: 2.21 time: 0.345377 Aug 10 23:14:37.952217 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1793/3729] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:14:37 2022] GET /compute/v2.1/servers/325ce83e-53e6-4021-b1a1-548ff5057761 => generated 1359 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:14:37.959349 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-180cf440-650d-4ec3-8576-1f091391e1c7 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:37.967848 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-e6b5dff2-07dc-4fbc-9ff7-c255c6068227 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:37.968467 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-e6b5dff2-07dc-4fbc-9ff7-c255c6068227 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: fa9dfd3a-a636-48ce-ae15-0ed51baee954] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:37.970968 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-180cf440-650d-4ec3-8576-1f091391e1c7 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:37.980891 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e6b5dff2-07dc-4fbc-9ff7-c255c6068227 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:37.983713 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-180cf440-650d-4ec3-8576-1f091391e1c7 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:37.984222 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-180cf440-650d-4ec3-8576-1f091391e1c7 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:37.984540 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e6b5dff2-07dc-4fbc-9ff7-c255c6068227 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:37.984661 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-180cf440-650d-4ec3-8576-1f091391e1c7 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:37.985222 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e6b5dff2-07dc-4fbc-9ff7-c255c6068227 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:37.985354 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-180cf440-650d-4ec3-8576-1f091391e1c7 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:37.985827 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-180cf440-650d-4ec3-8576-1f091391e1c7 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:37.986257 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-180cf440-650d-4ec3-8576-1f091391e1c7 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:37.987562 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e6b5dff2-07dc-4fbc-9ff7-c255c6068227 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:37.992791 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e6b5dff2-07dc-4fbc-9ff7-c255c6068227 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:38.001645 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e6b5dff2-07dc-4fbc-9ff7-c255c6068227 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:38.278986 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-180cf440-650d-4ec3-8576-1f091391e1c7 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:38.288850 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-180cf440-650d-4ec3-8576-1f091391e1c7 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b" status: 200 len: 1506 microversion: 2.1 time: 0.338612 Aug 10 23:14:38.293264 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-e6b5dff2-07dc-4fbc-9ff7-c255c6068227 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:38.298887 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1937/3730] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:37 2022] GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b => generated 1506 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:38.325067 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-e6b5dff2-07dc-4fbc-9ff7-c255c6068227 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954" status: 200 len: 1667 microversion: 2.1 time: 0.370910 Aug 10 23:14:38.326329 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-3abb2bcc-285f-4a6e-922d-4264f576d42d tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:38.326975 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-3abb2bcc-285f-4a6e-922d-4264f576d42d tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: 7a8f8d36-4744-43b7-9d42-e50fb5fabe60] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:38.336612 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1794/3731] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:37 2022] GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954 => generated 1667 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:38.357629 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-a189b77d-4250-4584-9627-ab329b7740bc req-645aef98-e76e-444f-91b6-ae8961b9e545 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "325ce83e-53e6-4021-b1a1-548ff5057761", "name": "network-vif-plugged", "status": "completed", "tag": "9a221529-858a-43c9-af54-8f34801606f1"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:14:38.361797 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3abb2bcc-285f-4a6e-922d-4264f576d42d tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:38.362615 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3abb2bcc-285f-4a6e-922d-4264f576d42d tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:38.363710 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3abb2bcc-285f-4a6e-922d-4264f576d42d tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:38.367646 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3abb2bcc-285f-4a6e-922d-4264f576d42d tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:38.368385 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3abb2bcc-285f-4a6e-922d-4264f576d42d tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:38.370886 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3abb2bcc-285f-4a6e-922d-4264f576d42d tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:38.389750 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-a189b77d-4250-4584-9627-ab329b7740bc req-645aef98-e76e-444f-91b6-ae8961b9e545 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:38.391744 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-a189b77d-4250-4584-9627-ab329b7740bc req-645aef98-e76e-444f-91b6-ae8961b9e545 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:38.392995 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-a189b77d-4250-4584-9627-ab329b7740bc req-645aef98-e76e-444f-91b6-ae8961b9e545 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:38.424245 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-a189b77d-4250-4584-9627-ab329b7740bc req-645aef98-e76e-444f-91b6-ae8961b9e545 service nova] Creating event network-vif-plugged:9a221529-858a-43c9-af54-8f34801606f1 for instance 325ce83e-53e6-4021-b1a1-548ff5057761 on n-h2-850468-14 Aug 10 23:14:38.433350 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-a189b77d-4250-4584-9627-ab329b7740bc req-645aef98-e76e-444f-91b6-ae8961b9e545 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094798 Aug 10 23:14:38.439346 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1795/3732] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:14:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:14:38.452394 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-1f316690-571c-4329-8f7e-7748da95f894 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:38.453048 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-1f316690-571c-4329-8f7e-7748da95f894 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Failed to fetch instance by id 9223372036854775808 {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2928}} Aug 10 23:14:38.453889 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-1f316690-571c-4329-8f7e-7748da95f894 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Aug 10 23:14:38.457044 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-1f316690-571c-4329-8f7e-7748da95f894 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Request method failure captured: Aug 10 23:14:38.457044 n-d-850468-14 devstack@n-api.service[122632]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 Aug 10 23:14:38.457044 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:14:38.457044 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:14:38.457044 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:14:38.457044 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 23:14:38.457044 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:14:38.457044 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:14:38.457044 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:14:38.457044 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:14:38.457044 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9DuIKrfOsS8tKST0PsIPrvuNPfsVISfOPvUoe9ddkVcTJKj7rDjd3OuH9u-DTT1aypj1AUoUKtajD98eDOUOHSpPisBSdRlSCov30lHf1uZq-XZLyBIVg5kAG8-SuXk2s1TL7EnRcjjMARSkm95dZDnXaBXRT3M4f8UoMDwqu7xK7gQ Aug 10 23:14:38.457044 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:14:38.457044 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:14:38.457044 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:14:38.457044 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:14:38.457044 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:14:38.457044 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:14:38.457044 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: d11bbb3e87f4463787da56ab19108822 Aug 10 23:14:38.457044 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-ServersNegativeTestJSON-1216728002 Aug 10 23:14:38.457044 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:14:38.457044 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:14:38.457044 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d11bbb3e87f4463787da56ab19108822"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d11bbb3e87f4463787da56ab19108822"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d11bbb3e87f4463787da56ab19108822"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d11bbb3e87f4463787da56ab19108822", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:14:38.457044 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-ServersNegativeTestJSON-1216728002 Aug 10 23:14:38.457044 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: d11bbb3e87f4463787da56ab19108822 Aug 10 23:14:38.457044 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1216728002 Aug 10 23:14:38.457044 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-ServersNegativeTestJSON-1216728002-project Aug 10 23:14:38.457044 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:14:38.457044 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:14:38.457044 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: f284ec2a4bf546b58c1c1adaf880e1fb Aug 10 23:14:38.457044 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-ServersNegativeTestJSON-1216728002-project Aug 10 23:14:38.457044 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:14:38.457044 n-d-850468-14 devstack@n-api.service[122632]: exception: Instance 9223372036854775808 could not be found. Aug 10 23:14:38.457044 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': '9223372036854775808'} Aug 10 23:14:38.457044 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:14:38.457044 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:14:38.457044 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:14:38.457044 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:14:38.457044 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2929, in get Aug 10 23:14:38.457044 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 10 23:14:38.457044 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. Aug 10 23:14:38.457044 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:14:38.457044 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:14:38.457044 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:14:38.457044 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:14:38.457044 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:14:38.457044 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:14:38.457044 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:14:38.457044 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:14:38.457044 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:14:38.457044 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:14:38.457044 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 23:14:38.457044 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 23:14:38.457044 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 23:14:38.457044 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 23:14:38.457044 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:14:38.457044 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:14:38.457044 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:14:38.457044 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:14:38.457044 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. Aug 10 23:14:38.457044 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:14:38.457044 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:14:38.457044 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:14:38.457044 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:14:38.457044 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:14:38.463334 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:14:38.463334 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:14:38.463334 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:14:38.463334 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. Aug 10 23:14:38.463334 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:14:38.465234 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-1f316690-571c-4329-8f7e-7748da95f894 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:14:38.466647 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-1f316690-571c-4329-8f7e-7748da95f894 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.022098 Aug 10 23:14:38.467454 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1796/3733] 10.222.0.58 () {58 vars in 1188 bytes} [Wed Aug 10 23:14:38 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 10 23:14:38.483002 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-88631e3c-9c1b-4e03-b450-0e924244f95c tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:38.483875 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-88631e3c-9c1b-4e03-b450-0e924244f95c tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:38.490919 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-88631e3c-9c1b-4e03-b450-0e924244f95c tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:38.491792 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-88631e3c-9c1b-4e03-b450-0e924244f95c tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:38.492427 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-88631e3c-9c1b-4e03-b450-0e924244f95c tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:38.493445 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-88631e3c-9c1b-4e03-b450-0e924244f95c tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:38.494023 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-88631e3c-9c1b-4e03-b450-0e924244f95c tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:38.494570 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-88631e3c-9c1b-4e03-b450-0e924244f95c tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:38.722903 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-88631e3c-9c1b-4e03-b450-0e924244f95c tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:38.733274 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-88631e3c-9c1b-4e03-b450-0e924244f95c tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b" status: 200 len: 1506 microversion: 2.1 time: 0.256636 Aug 10 23:14:38.734448 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1797/3734] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:38 2022] GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b => generated 1506 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:38.739591 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-3e0b5e67-e61c-457f-b7a6-cd40c455f0df tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1015038356", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452", "networks": [{"uuid": "9e4068f0-b1bd-443a-a951-7f332436087d"}]}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:14:38.796819 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.network.neutron [None req-3e0b5e67-e61c-457f-b7a6-cd40c455f0df tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] validate_networks() for [('9e4068f0-b1bd-443a-a951-7f332436087d', None, None, None, None, None)] {{(pid=122632) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 23:14:39.150915 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-3abb2bcc-285f-4a6e-922d-4264f576d42d tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6160c7a42740efbe3613380933fa15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d90f8a58ad047fa8f347d6474e4d673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:39.159983 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-3abb2bcc-285f-4a6e-922d-4264f576d42d tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "GET /compute/v2.1/servers/7a8f8d36-4744-43b7-9d42-e50fb5fabe60" status: 200 len: 1500 microversion: 2.1 time: 0.846414 Aug 10 23:14:39.161001 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1938/3735] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:38 2022] GET /compute/v2.1/servers/7a8f8d36-4744-43b7-9d42-e50fb5fabe60 => generated 1500 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:39.181491 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-cdb8df0a-2c9d-4356-aff5-d906b055b835 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:39.182351 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-cdb8df0a-2c9d-4356-aff5-d906b055b835 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:39.189364 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cdb8df0a-2c9d-4356-aff5-d906b055b835 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:39.190045 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cdb8df0a-2c9d-4356-aff5-d906b055b835 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:39.190493 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cdb8df0a-2c9d-4356-aff5-d906b055b835 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:39.191235 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cdb8df0a-2c9d-4356-aff5-d906b055b835 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:39.191693 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cdb8df0a-2c9d-4356-aff5-d906b055b835 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:39.192150 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cdb8df0a-2c9d-4356-aff5-d906b055b835 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:39.207635 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-3e0b5e67-e61c-457f-b7a6-cd40c455f0df tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Flavor limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:14:39.208155 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-3e0b5e67-e61c-457f-b7a6-cd40c455f0df tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Image limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:14:39.208738 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-3e0b5e67-e61c-457f-b7a6-cd40c455f0df tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Flavor pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:14:39.210962 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-3e0b5e67-e61c-457f-b7a6-cd40c455f0df tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Image pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:14:39.212150 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-3e0b5e67-e61c-457f-b7a6-cd40c455f0df tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:14:39.222504 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3e0b5e67-e61c-457f-b7a6-cd40c455f0df tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:39.223119 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3e0b5e67-e61c-457f-b7a6-cd40c455f0df tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:39.223667 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3e0b5e67-e61c-457f-b7a6-cd40c455f0df tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:39.224494 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3e0b5e67-e61c-457f-b7a6-cd40c455f0df tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:39.225048 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3e0b5e67-e61c-457f-b7a6-cd40c455f0df tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:39.225607 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3e0b5e67-e61c-457f-b7a6-cd40c455f0df tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:39.244936 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-3e0b5e67-e61c-457f-b7a6-cd40c455f0df tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Getting quotas for project 1eb12683ada249bfa2ca7bf5cf730ca3. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:14:39.250516 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-3e0b5e67-e61c-457f-b7a6-cd40c455f0df tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Getting quotas for user 2ea96841d5b64d2390d18b3eb5da8b73 and project 1eb12683ada249bfa2ca7bf5cf730ca3. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:14:39.264975 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-3e0b5e67-e61c-457f-b7a6-cd40c455f0df tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Going to run 1 instances... {{(pid=122632) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 23:14:39.267303 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-3e0b5e67-e61c-457f-b7a6-cd40c455f0df tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: 1da4d99f-4cb0-4533-bda8-3bda03205e07] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78ad8905-f66f-4733-8be9-2b260f1fabed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122632) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 23:14:39.315932 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-3e0b5e67-e61c-457f-b7a6-cd40c455f0df tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.580339 Aug 10 23:14:39.316950 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1798/3736] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 23:14:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 582 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 23:14:39.323061 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-b145073b-fc14-46e2-b1f1-2e0e19f608d7 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:39.323609 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-b145073b-fc14-46e2-b1f1-2e0e19f608d7 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] [instance: 7df225be-2dbc-4ef6-aeec-9a3de33a0006] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:39.330638 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b145073b-fc14-46e2-b1f1-2e0e19f608d7 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:39.331134 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b145073b-fc14-46e2-b1f1-2e0e19f608d7 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:39.331586 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b145073b-fc14-46e2-b1f1-2e0e19f608d7 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:39.332293 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b145073b-fc14-46e2-b1f1-2e0e19f608d7 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:39.332749 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b145073b-fc14-46e2-b1f1-2e0e19f608d7 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:39.333174 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b145073b-fc14-46e2-b1f1-2e0e19f608d7 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:39.482709 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-b145073b-fc14-46e2-b1f1-2e0e19f608d7 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07c94ebf0954cdea12b9a689538d96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395d7c4077e54c43bb95288db3942b0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:39.494118 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-b145073b-fc14-46e2-b1f1-2e0e19f608d7 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] 10.222.0.58 "GET /compute/v2.1/servers/7df225be-2dbc-4ef6-aeec-9a3de33a0006" status: 200 len: 1322 microversion: 2.1 time: 0.175978 Aug 10 23:14:39.503027 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1799/3737] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:39 2022] GET /compute/v2.1/servers/7df225be-2dbc-4ef6-aeec-9a3de33a0006 => generated 1322 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:39.503027 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-b89e44e9-c543-4d8d-897f-f0ca2e6ca6ea tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:39.503027 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-b89e44e9-c543-4d8d-897f-f0ca2e6ca6ea tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] [instance: 325ce83e-53e6-4021-b1a1-548ff5057761] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:39.512248 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b89e44e9-c543-4d8d-897f-f0ca2e6ca6ea tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:39.512248 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b89e44e9-c543-4d8d-897f-f0ca2e6ca6ea tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:39.512248 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b89e44e9-c543-4d8d-897f-f0ca2e6ca6ea tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:39.512248 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b89e44e9-c543-4d8d-897f-f0ca2e6ca6ea tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:39.512248 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b89e44e9-c543-4d8d-897f-f0ca2e6ca6ea tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:39.512248 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b89e44e9-c543-4d8d-897f-f0ca2e6ca6ea tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:39.521953 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-cdb8df0a-2c9d-4356-aff5-d906b055b835 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:39.531007 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-cdb8df0a-2c9d-4356-aff5-d906b055b835 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b" status: 200 len: 1506 microversion: 2.1 time: 0.353275 Aug 10 23:14:39.532631 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1939/3738] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:39 2022] GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b => generated 1506 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:39.542364 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-16bf306a-37be-4b29-98f2-bc24f8c51823 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:14:39.555986 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-16bf306a-37be-4b29-98f2-bc24f8c51823 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:39.556584 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-16bf306a-37be-4b29-98f2-bc24f8c51823 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:39.556978 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-16bf306a-37be-4b29-98f2-bc24f8c51823 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:39.594688 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-16bf306a-37be-4b29-98f2-bc24f8c51823 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: 7a8f8d36-4744-43b7-9d42-e50fb5fabe60] Going to try to stop instance {{(pid=122633) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 10 23:14:39.665161 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-16bf306a-37be-4b29-98f2-bc24f8c51823 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "POST /compute/v2.1/servers/7a8f8d36-4744-43b7-9d42-e50fb5fabe60/action" status: 202 len: 0 microversion: 2.1 time: 0.130684 Aug 10 23:14:39.666353 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1940/3739] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:14:39 2022] POST /compute/v2.1/servers/7a8f8d36-4744-43b7-9d42-e50fb5fabe60/action => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:14:39.673837 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-88151f71-4450-43a0-9eb0-c3010580ee77 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:39.675872 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-88151f71-4450-43a0-9eb0-c3010580ee77 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: 1da4d99f-4cb0-4533-bda8-3bda03205e07] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:39.705200 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-b89e44e9-c543-4d8d-897f-f0ca2e6ca6ea tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39eef3efd444a6d8192f405cba67f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee72843cb8064834bdbc02d8a5417f71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:39.717263 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-b89e44e9-c543-4d8d-897f-f0ca2e6ca6ea tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39eef3efd444a6d8192f405cba67f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee72843cb8064834bdbc02d8a5417f71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:39.720483 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-b89e44e9-c543-4d8d-897f-f0ca2e6ca6ea tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39eef3efd444a6d8192f405cba67f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee72843cb8064834bdbc02d8a5417f71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:39.721506 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-b89e44e9-c543-4d8d-897f-f0ca2e6ca6ea tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] 10.222.0.58 "GET /compute/v2.1/servers/325ce83e-53e6-4021-b1a1-548ff5057761" status: 200 len: 1359 microversion: 2.21 time: 0.225668 Aug 10 23:14:39.736557 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1800/3740] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:14:39 2022] GET /compute/v2.1/servers/325ce83e-53e6-4021-b1a1-548ff5057761 => generated 1359 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:14:39.741869 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-fed7baa9-bd5d-44ff-a947-ac05e4c89e8e tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:39.742628 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-fed7baa9-bd5d-44ff-a947-ac05e4c89e8e tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Failed to fetch instance by id -1 {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2928}} Aug 10 23:14:39.743334 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-fed7baa9-bd5d-44ff-a947-ac05e4c89e8e tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] HTTP exception thrown: Instance -1 could not be found. Aug 10 23:14:39.744900 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-fed7baa9-bd5d-44ff-a947-ac05e4c89e8e tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Request method failure captured: Aug 10 23:14:39.744900 n-d-850468-14 devstack@n-api.service[122632]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 Aug 10 23:14:39.744900 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:14:39.744900 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:14:39.744900 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:14:39.744900 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 23:14:39.744900 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:14:39.744900 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:14:39.744900 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:14:39.744900 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:14:39.744900 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9DuIKrfOsS8tKST0PsIPrvuNPfsVISfOPvUoe9ddkVcTJKj7rDjd3OuH9u-DTT1aypj1AUoUKtajD98eDOUOHSpPisBSdRlSCov30lHf1uZq-XZLyBIVg5kAG8-SuXk2s1TL7EnRcjjMARSkm95dZDnXaBXRT3M4f8UoMDwqu7xK7gQ Aug 10 23:14:39.744900 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:14:39.744900 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:14:39.744900 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:14:39.744900 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:14:39.744900 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:14:39.744900 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:14:39.744900 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: d11bbb3e87f4463787da56ab19108822 Aug 10 23:14:39.744900 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-ServersNegativeTestJSON-1216728002 Aug 10 23:14:39.744900 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:14:39.744900 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:14:39.744900 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d11bbb3e87f4463787da56ab19108822"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d11bbb3e87f4463787da56ab19108822"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d11bbb3e87f4463787da56ab19108822"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d11bbb3e87f4463787da56ab19108822", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:14:39.744900 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-ServersNegativeTestJSON-1216728002 Aug 10 23:14:39.744900 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: d11bbb3e87f4463787da56ab19108822 Aug 10 23:14:39.744900 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1216728002 Aug 10 23:14:39.744900 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-ServersNegativeTestJSON-1216728002-project Aug 10 23:14:39.744900 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:14:39.744900 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:14:39.744900 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: f284ec2a4bf546b58c1c1adaf880e1fb Aug 10 23:14:39.744900 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-ServersNegativeTestJSON-1216728002-project Aug 10 23:14:39.744900 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:14:39.744900 n-d-850468-14 devstack@n-api.service[122632]: exception: Instance -1 could not be found. Aug 10 23:14:39.744900 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': '-1'} Aug 10 23:14:39.744900 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:14:39.744900 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:14:39.744900 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:14:39.744900 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:14:39.744900 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2929, in get Aug 10 23:14:39.744900 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 10 23:14:39.744900 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. Aug 10 23:14:39.744900 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:14:39.744900 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:14:39.744900 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:14:39.744900 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:14:39.744900 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:14:39.744900 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:14:39.744900 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:14:39.744900 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:14:39.744900 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:14:39.744900 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:14:39.744900 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 23:14:39.744900 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 23:14:39.744900 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 23:14:39.744900 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 23:14:39.744900 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:14:39.744900 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:14:39.744900 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:14:39.744900 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:14:39.744900 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. Aug 10 23:14:39.744900 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:14:39.744900 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:14:39.744900 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:14:39.744900 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:14:39.744900 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:14:39.744900 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:14:39.749369 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:14:39.749369 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:14:39.749369 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. Aug 10 23:14:39.749369 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:14:39.749369 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-fed7baa9-bd5d-44ff-a947-ac05e4c89e8e tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Returning 404 to user: Instance -1 could not be found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:14:39.749968 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-fed7baa9-bd5d-44ff-a947-ac05e4c89e8e tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.025731 Aug 10 23:14:39.750944 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1801/3741] 10.222.0.58 () {58 vars in 1137 bytes} [Wed Aug 10 23:14:39 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 10 23:14:39.755801 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-27e1af93-185a-488b-9991-b6d67dded836 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:39.756507 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-27e1af93-185a-488b-9991-b6d67dded836 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: 7a8f8d36-4744-43b7-9d42-e50fb5fabe60] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:39.764902 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-27e1af93-185a-488b-9991-b6d67dded836 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:39.765553 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-27e1af93-185a-488b-9991-b6d67dded836 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:39.766197 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-27e1af93-185a-488b-9991-b6d67dded836 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:39.767008 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-27e1af93-185a-488b-9991-b6d67dded836 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:39.767545 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-27e1af93-185a-488b-9991-b6d67dded836 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:39.768066 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-27e1af93-185a-488b-9991-b6d67dded836 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:39.785824 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-88151f71-4450-43a0-9eb0-c3010580ee77 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:39.797554 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-88151f71-4450-43a0-9eb0-c3010580ee77 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/1da4d99f-4cb0-4533-bda8-3bda03205e07" status: 200 len: 1215 microversion: 2.1 time: 0.129485 Aug 10 23:14:39.811071 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1941/3742] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:39 2022] GET /compute/v2.1/servers/1da4d99f-4cb0-4533-bda8-3bda03205e07 => generated 1215 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:39.825170 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-ec786b16-a02f-4b3a-a56a-087e37329656 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:39.826983 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-ec786b16-a02f-4b3a-a56a-087e37329656 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:39.846726 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ec786b16-a02f-4b3a-a56a-087e37329656 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:39.858950 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ec786b16-a02f-4b3a-a56a-087e37329656 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:39.859731 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ec786b16-a02f-4b3a-a56a-087e37329656 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:39.860698 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ec786b16-a02f-4b3a-a56a-087e37329656 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:39.861514 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ec786b16-a02f-4b3a-a56a-087e37329656 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:39.862131 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ec786b16-a02f-4b3a-a56a-087e37329656 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:39.975180 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-27e1af93-185a-488b-9991-b6d67dded836 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6160c7a42740efbe3613380933fa15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d90f8a58ad047fa8f347d6474e4d673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:39.987739 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-27e1af93-185a-488b-9991-b6d67dded836 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "GET /compute/v2.1/servers/7a8f8d36-4744-43b7-9d42-e50fb5fabe60" status: 200 len: 1510 microversion: 2.1 time: 0.235465 Aug 10 23:14:39.992094 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1802/3743] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:39 2022] GET /compute/v2.1/servers/7a8f8d36-4744-43b7-9d42-e50fb5fabe60 => generated 1510 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:40.464608 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-5533b95f-188c-4a6d-a39f-f7768f1cb15d req-962ff856-f678-4055-8052-fcc53eef8362 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7df225be-2dbc-4ef6-aeec-9a3de33a0006", "name": "network-vif-plugged", "status": "completed", "tag": "54202e59-d171-4a05-91d4-e187250d698c"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:14:40.483818 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-5533b95f-188c-4a6d-a39f-f7768f1cb15d req-962ff856-f678-4055-8052-fcc53eef8362 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:40.487394 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-5533b95f-188c-4a6d-a39f-f7768f1cb15d req-962ff856-f678-4055-8052-fcc53eef8362 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:40.488101 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-5533b95f-188c-4a6d-a39f-f7768f1cb15d req-962ff856-f678-4055-8052-fcc53eef8362 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:40.503149 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-5533b95f-188c-4a6d-a39f-f7768f1cb15d req-962ff856-f678-4055-8052-fcc53eef8362 service nova] Creating event network-vif-plugged:54202e59-d171-4a05-91d4-e187250d698c for instance 7df225be-2dbc-4ef6-aeec-9a3de33a0006 on n-h2-850468-14 Aug 10 23:14:40.517336 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-5533b95f-188c-4a6d-a39f-f7768f1cb15d req-962ff856-f678-4055-8052-fcc53eef8362 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057030 Aug 10 23:14:40.530113 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1803/3744] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:14:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:14:40.532826 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-ec786b16-a02f-4b3a-a56a-087e37329656 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:40.546509 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-ec786b16-a02f-4b3a-a56a-087e37329656 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b" status: 200 len: 1506 microversion: 2.1 time: 0.746778 Aug 10 23:14:40.548499 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-5066a64f-c6da-44bc-8996-f2c3b8e8223a tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:40.549414 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-5066a64f-c6da-44bc-8996-f2c3b8e8223a tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] [instance: 7df225be-2dbc-4ef6-aeec-9a3de33a0006] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:40.551599 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1942/3745] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:39 2022] GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b => generated 1506 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:40.564659 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5066a64f-c6da-44bc-8996-f2c3b8e8223a tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:40.567979 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5066a64f-c6da-44bc-8996-f2c3b8e8223a tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:40.567979 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5066a64f-c6da-44bc-8996-f2c3b8e8223a tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:40.567979 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5066a64f-c6da-44bc-8996-f2c3b8e8223a tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:40.567979 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5066a64f-c6da-44bc-8996-f2c3b8e8223a tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:40.567979 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5066a64f-c6da-44bc-8996-f2c3b8e8223a tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:40.573139 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-d0aa71d2-0bb2-4954-8fc1-b6f7064d75a5 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:40.573950 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-d0aa71d2-0bb2-4954-8fc1-b6f7064d75a5 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:40.581389 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d0aa71d2-0bb2-4954-8fc1-b6f7064d75a5 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:40.582229 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d0aa71d2-0bb2-4954-8fc1-b6f7064d75a5 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:40.582915 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d0aa71d2-0bb2-4954-8fc1-b6f7064d75a5 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:40.583852 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d0aa71d2-0bb2-4954-8fc1-b6f7064d75a5 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:40.584553 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d0aa71d2-0bb2-4954-8fc1-b6f7064d75a5 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:40.586086 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d0aa71d2-0bb2-4954-8fc1-b6f7064d75a5 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:40.927330 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-5066a64f-c6da-44bc-8996-f2c3b8e8223a tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07c94ebf0954cdea12b9a689538d96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395d7c4077e54c43bb95288db3942b0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:40.946044 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-5066a64f-c6da-44bc-8996-f2c3b8e8223a tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] 10.222.0.58 "GET /compute/v2.1/servers/7df225be-2dbc-4ef6-aeec-9a3de33a0006" status: 200 len: 1322 microversion: 2.1 time: 0.413880 Aug 10 23:14:40.959592 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1804/3746] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:40 2022] GET /compute/v2.1/servers/7df225be-2dbc-4ef6-aeec-9a3de33a0006 => generated 1322 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:40.975276 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-a572a4f2-86da-4b8e-9e6d-639125c0da4a tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:40.978169 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-a572a4f2-86da-4b8e-9e6d-639125c0da4a tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] [instance: 325ce83e-53e6-4021-b1a1-548ff5057761] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:40.986258 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a572a4f2-86da-4b8e-9e6d-639125c0da4a tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:40.987303 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a572a4f2-86da-4b8e-9e6d-639125c0da4a tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:40.988035 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a572a4f2-86da-4b8e-9e6d-639125c0da4a tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:40.988743 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a572a4f2-86da-4b8e-9e6d-639125c0da4a tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:40.989198 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a572a4f2-86da-4b8e-9e6d-639125c0da4a tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:40.989693 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a572a4f2-86da-4b8e-9e6d-639125c0da4a tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:41.242699 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-a572a4f2-86da-4b8e-9e6d-639125c0da4a tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39eef3efd444a6d8192f405cba67f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee72843cb8064834bdbc02d8a5417f71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:41.257377 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-d0aa71d2-0bb2-4954-8fc1-b6f7064d75a5 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:41.260821 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-a572a4f2-86da-4b8e-9e6d-639125c0da4a tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39eef3efd444a6d8192f405cba67f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee72843cb8064834bdbc02d8a5417f71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:41.262999 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-a572a4f2-86da-4b8e-9e6d-639125c0da4a tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39eef3efd444a6d8192f405cba67f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee72843cb8064834bdbc02d8a5417f71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:41.264737 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-a572a4f2-86da-4b8e-9e6d-639125c0da4a tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] 10.222.0.58 "GET /compute/v2.1/servers/325ce83e-53e6-4021-b1a1-548ff5057761" status: 200 len: 1551 microversion: 2.21 time: 0.302540 Aug 10 23:14:41.266414 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1805/3747] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:14:40 2022] GET /compute/v2.1/servers/325ce83e-53e6-4021-b1a1-548ff5057761 => generated 1551 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:14:41.272785 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-e5d3b1e5-7aff-4ab2-96b3-8293cbc0abaf tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:41.273776 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-e5d3b1e5-7aff-4ab2-96b3-8293cbc0abaf tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: 1da4d99f-4cb0-4533-bda8-3bda03205e07] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:41.274102 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-d0aa71d2-0bb2-4954-8fc1-b6f7064d75a5 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b" status: 200 len: 1506 microversion: 2.1 time: 0.705666 Aug 10 23:14:41.276576 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1943/3748] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:40 2022] GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b => generated 1506 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:41.298561 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c540a304-b428-464b-ac18-5365fdca5945 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:41.299451 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-c540a304-b428-464b-ac18-5365fdca5945 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: 7a8f8d36-4744-43b7-9d42-e50fb5fabe60] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:41.308579 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e5d3b1e5-7aff-4ab2-96b3-8293cbc0abaf tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:41.309170 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e5d3b1e5-7aff-4ab2-96b3-8293cbc0abaf tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:41.309629 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e5d3b1e5-7aff-4ab2-96b3-8293cbc0abaf tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:41.310376 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e5d3b1e5-7aff-4ab2-96b3-8293cbc0abaf tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:41.311187 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e5d3b1e5-7aff-4ab2-96b3-8293cbc0abaf tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:41.311869 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c540a304-b428-464b-ac18-5365fdca5945 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:41.312718 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c540a304-b428-464b-ac18-5365fdca5945 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:41.313463 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c540a304-b428-464b-ac18-5365fdca5945 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:41.314629 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e5d3b1e5-7aff-4ab2-96b3-8293cbc0abaf tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:41.315611 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c540a304-b428-464b-ac18-5365fdca5945 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:41.316187 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c540a304-b428-464b-ac18-5365fdca5945 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:41.316973 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c540a304-b428-464b-ac18-5365fdca5945 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:41.443438 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-e5d3b1e5-7aff-4ab2-96b3-8293cbc0abaf tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:41.459362 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-e5d3b1e5-7aff-4ab2-96b3-8293cbc0abaf tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/1da4d99f-4cb0-4533-bda8-3bda03205e07" status: 200 len: 1273 microversion: 2.1 time: 0.191410 Aug 10 23:14:41.461840 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1806/3749] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:41 2022] GET /compute/v2.1/servers/1da4d99f-4cb0-4533-bda8-3bda03205e07 => generated 1273 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:41.466475 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-f7c5d17e-fb45-4854-bf76-5543f181fce2 tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:41.467074 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-f7c5d17e-fb45-4854-bf76-5543f181fce2 tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] [instance: 325ce83e-53e6-4021-b1a1-548ff5057761] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:41.488337 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f7c5d17e-fb45-4854-bf76-5543f181fce2 tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:41.489697 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f7c5d17e-fb45-4854-bf76-5543f181fce2 tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:41.490363 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f7c5d17e-fb45-4854-bf76-5543f181fce2 tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:41.492245 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f7c5d17e-fb45-4854-bf76-5543f181fce2 tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:41.493200 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f7c5d17e-fb45-4854-bf76-5543f181fce2 tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:41.493880 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f7c5d17e-fb45-4854-bf76-5543f181fce2 tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:41.555267 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-f7c5d17e-fb45-4854-bf76-5543f181fce2 tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] [instance: 325ce83e-53e6-4021-b1a1-548ff5057761] Going to try to terminate instance {{(pid=122632) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:14:41.614035 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-c540a304-b428-464b-ac18-5365fdca5945 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6160c7a42740efbe3613380933fa15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d90f8a58ad047fa8f347d6474e4d673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:41.624096 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:14:41.632098 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-c540a304-b428-464b-ac18-5365fdca5945 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "GET /compute/v2.1/servers/7a8f8d36-4744-43b7-9d42-e50fb5fabe60" status: 200 len: 1510 microversion: 2.1 time: 0.351940 Aug 10 23:14:41.632737 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1944/3750] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:41 2022] GET /compute/v2.1/servers/7a8f8d36-4744-43b7-9d42-e50fb5fabe60 => generated 1510 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:41.638007 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-4a2fa790-6838-4b40-a2bc-496628ffb280 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:14:41.638903 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-4a2fa790-6838-4b40-a2bc-496628ffb280 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 12260503-9331-4fc7-a9b5-727844fcb626] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:41.655445 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-4a2fa790-6838-4b40-a2bc-496628ffb280 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] HTTP exception thrown: Instance 12260503-9331-4fc7-a9b5-727844fcb626 could not be found. Aug 10 23:14:41.663055 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-4a2fa790-6838-4b40-a2bc-496628ffb280 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Request method failure captured: Aug 10 23:14:41.663055 n-d-850468-14 devstack@n-api.service[122633]: request: POST /compute/v2.1/servers/12260503-9331-4fc7-a9b5-727844fcb626/action HTTP/1.1 Aug 10 23:14:41.663055 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:14:41.663055 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:14:41.663055 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:14:41.663055 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 19 Aug 10 23:14:41.663055 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:14:41.663055 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:14:41.663055 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:14:41.663055 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:14:41.663055 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9DuIKrfOsS8tKST0PsIPrvuNPfsVISfOPvUoe9ddkVcTJKj7rDjd3OuH9u-DTT1aypj1AUoUKtajD98eDOUOHSpPisBSdRlSCov30lHf1uZq-XZLyBIVg5kAG8-SuXk2s1TL7EnRcjjMARSkm95dZDnXaBXRT3M4f8UoMDwqu7xK7gQ Aug 10 23:14:41.663055 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:14:41.663055 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:14:41.663055 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:14:41.663055 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:14:41.663055 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:14:41.663055 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:14:41.663055 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: d11bbb3e87f4463787da56ab19108822 Aug 10 23:14:41.663055 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-ServersNegativeTestJSON-1216728002 Aug 10 23:14:41.663055 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:14:41.663055 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:14:41.663055 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d11bbb3e87f4463787da56ab19108822"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d11bbb3e87f4463787da56ab19108822"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d11bbb3e87f4463787da56ab19108822"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d11bbb3e87f4463787da56ab19108822", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:14:41.663055 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-ServersNegativeTestJSON-1216728002 Aug 10 23:14:41.663055 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: d11bbb3e87f4463787da56ab19108822 Aug 10 23:14:41.663055 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1216728002 Aug 10 23:14:41.663055 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-ServersNegativeTestJSON-1216728002-project Aug 10 23:14:41.663055 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:14:41.663055 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:14:41.663055 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: f284ec2a4bf546b58c1c1adaf880e1fb Aug 10 23:14:41.663055 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-ServersNegativeTestJSON-1216728002-project Aug 10 23:14:41.663055 n-d-850468-14 devstack@n-api.service[122633]: Aug 10 23:14:41.663055 n-d-850468-14 devstack@n-api.service[122633]: {"forceDelete": {}} Aug 10 23:14:41.663055 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:14:41.663055 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance 12260503-9331-4fc7-a9b5-727844fcb626 could not be found. Aug 10 23:14:41.663055 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': '12260503-9331-4fc7-a9b5-727844fcb626', 'body': {'forceDelete': {}}} Aug 10 23:14:41.663055 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:14:41.663055 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:14:41.663055 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:14:41.663055 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:14:41.663055 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:14:41.663055 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:14:41.663055 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 10 23:14:41.663055 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 10 23:14:41.663055 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12260503-9331-4fc7-a9b5-727844fcb626 could not be found. Aug 10 23:14:41.663055 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:14:41.663055 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:14:41.663055 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:14:41.663055 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:14:41.663055 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:14:41.663055 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:14:41.663055 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:14:41.663055 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:14:41.663055 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:14:41.663055 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:14:41.663055 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete Aug 10 23:14:41.663055 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 10 23:14:41.663055 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:14:41.663055 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:14:41.663055 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12260503-9331-4fc7-a9b5-727844fcb626 could not be found. Aug 10 23:14:41.663055 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:14:41.663055 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:14:41.663055 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:14:41.663055 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:14:41.663055 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:14:41.663055 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:14:41.666841 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:14:41.666841 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:14:41.666841 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12260503-9331-4fc7-a9b5-727844fcb626 could not be found. Aug 10 23:14:41.666841 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:14:41.670535 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-f7c5d17e-fb45-4854-bf76-5543f181fce2 tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] 10.222.0.58 "DELETE /compute/v2.1/servers/325ce83e-53e6-4021-b1a1-548ff5057761" status: 204 len: 0 microversion: 2.21 time: 0.202794 Aug 10 23:14:41.670535 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1807/3751] 10.222.0.58 () {60 vars in 1280 bytes} [Wed Aug 10 23:14:41 2022] DELETE /compute/v2.1/servers/325ce83e-53e6-4021-b1a1-548ff5057761 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 10 23:14:41.671680 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-4a2fa790-6838-4b40-a2bc-496628ffb280 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Returning 404 to user: Instance 12260503-9331-4fc7-a9b5-727844fcb626 could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:14:41.672769 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-4a2fa790-6838-4b40-a2bc-496628ffb280 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "POST /compute/v2.1/servers/12260503-9331-4fc7-a9b5-727844fcb626/action" status: 404 len: 111 microversion: 2.1 time: 0.038871 Aug 10 23:14:41.673746 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1945/3752] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:14:41 2022] POST /compute/v2.1/servers/12260503-9331-4fc7-a9b5-727844fcb626/action => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:14:41.676783 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-9fb7f3e3-0f16-4efe-97c3-45d1b4cdebcd tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:41.677828 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-9fb7f3e3-0f16-4efe-97c3-45d1b4cdebcd tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] [instance: 325ce83e-53e6-4021-b1a1-548ff5057761] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:41.683247 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-8d902ee0-1178-4c5f-b4af-f981d76e2cfd tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:41.684101 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-8d902ee0-1178-4c5f-b4af-f981d76e2cfd tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:41.689012 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9fb7f3e3-0f16-4efe-97c3-45d1b4cdebcd tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:41.692034 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9fb7f3e3-0f16-4efe-97c3-45d1b4cdebcd tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:41.692741 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9fb7f3e3-0f16-4efe-97c3-45d1b4cdebcd tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:41.693892 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9fb7f3e3-0f16-4efe-97c3-45d1b4cdebcd tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:41.695322 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9fb7f3e3-0f16-4efe-97c3-45d1b4cdebcd tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:41.696029 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9fb7f3e3-0f16-4efe-97c3-45d1b4cdebcd tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:41.697630 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8d902ee0-1178-4c5f-b4af-f981d76e2cfd tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:41.707603 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8d902ee0-1178-4c5f-b4af-f981d76e2cfd tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:41.708356 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8d902ee0-1178-4c5f-b4af-f981d76e2cfd tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:41.709264 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8d902ee0-1178-4c5f-b4af-f981d76e2cfd tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:41.709919 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8d902ee0-1178-4c5f-b4af-f981d76e2cfd tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:41.710524 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8d902ee0-1178-4c5f-b4af-f981d76e2cfd tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:42.037256 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-8d902ee0-1178-4c5f-b4af-f981d76e2cfd tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:42.041739 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:14:42.052430 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-8d902ee0-1178-4c5f-b4af-f981d76e2cfd tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b" status: 200 len: 1506 microversion: 2.1 time: 0.374194 Aug 10 23:14:42.055003 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1946/3753] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:41 2022] GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b => generated 1506 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:42.066089 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-da9d3914-fe41-4578-a71b-0029ddad8326 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:42.071709 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-da9d3914-fe41-4578-a71b-0029ddad8326 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] [instance: 7df225be-2dbc-4ef6-aeec-9a3de33a0006] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:42.078608 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-da9d3914-fe41-4578-a71b-0029ddad8326 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:42.079483 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-da9d3914-fe41-4578-a71b-0029ddad8326 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:42.080123 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-da9d3914-fe41-4578-a71b-0029ddad8326 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:42.081083 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-da9d3914-fe41-4578-a71b-0029ddad8326 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:42.081764 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-da9d3914-fe41-4578-a71b-0029ddad8326 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:42.082402 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-da9d3914-fe41-4578-a71b-0029ddad8326 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:42.250006 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-9fb7f3e3-0f16-4efe-97c3-45d1b4cdebcd tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39eef3efd444a6d8192f405cba67f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee72843cb8064834bdbc02d8a5417f71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:42.263797 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-9fb7f3e3-0f16-4efe-97c3-45d1b4cdebcd tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39eef3efd444a6d8192f405cba67f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee72843cb8064834bdbc02d8a5417f71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:42.267434 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-9fb7f3e3-0f16-4efe-97c3-45d1b4cdebcd tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39eef3efd444a6d8192f405cba67f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee72843cb8064834bdbc02d8a5417f71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:42.269449 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-9fb7f3e3-0f16-4efe-97c3-45d1b4cdebcd tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] 10.222.0.58 "GET /compute/v2.1/servers/325ce83e-53e6-4021-b1a1-548ff5057761" status: 200 len: 1557 microversion: 2.21 time: 0.597780 Aug 10 23:14:42.270365 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1808/3754] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:14:41 2022] GET /compute/v2.1/servers/325ce83e-53e6-4021-b1a1-548ff5057761 => generated 1557 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:14:42.280859 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-dce10e38-4249-4df8-862a-072a30d96248 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:42.282725 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-dce10e38-4249-4df8-862a-072a30d96248 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:42.292998 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dce10e38-4249-4df8-862a-072a30d96248 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:42.294881 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dce10e38-4249-4df8-862a-072a30d96248 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:42.295242 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dce10e38-4249-4df8-862a-072a30d96248 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:42.296279 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dce10e38-4249-4df8-862a-072a30d96248 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:42.297535 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dce10e38-4249-4df8-862a-072a30d96248 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:42.298018 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dce10e38-4249-4df8-862a-072a30d96248 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:42.378706 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-da9d3914-fe41-4578-a71b-0029ddad8326 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07c94ebf0954cdea12b9a689538d96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395d7c4077e54c43bb95288db3942b0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:42.391523 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-da9d3914-fe41-4578-a71b-0029ddad8326 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] 10.222.0.58 "GET /compute/v2.1/servers/7df225be-2dbc-4ef6-aeec-9a3de33a0006" status: 200 len: 1322 microversion: 2.1 time: 0.334103 Aug 10 23:14:42.407124 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1947/3755] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:42 2022] GET /compute/v2.1/servers/7df225be-2dbc-4ef6-aeec-9a3de33a0006 => generated 1322 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:42.495611 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-5bbf70e9-dcea-459c-9568-12679cb7bf90 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:42.496327 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-5bbf70e9-dcea-459c-9568-12679cb7bf90 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: 1da4d99f-4cb0-4533-bda8-3bda03205e07] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:42.506558 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5bbf70e9-dcea-459c-9568-12679cb7bf90 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:42.508913 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5bbf70e9-dcea-459c-9568-12679cb7bf90 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:42.509570 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5bbf70e9-dcea-459c-9568-12679cb7bf90 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:42.514810 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5bbf70e9-dcea-459c-9568-12679cb7bf90 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:42.515528 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5bbf70e9-dcea-459c-9568-12679cb7bf90 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:42.516125 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5bbf70e9-dcea-459c-9568-12679cb7bf90 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:42.588071 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-dce10e38-4249-4df8-862a-072a30d96248 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:42.603580 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-dce10e38-4249-4df8-862a-072a30d96248 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b" status: 200 len: 1506 microversion: 2.1 time: 0.332252 Aug 10 23:14:42.604694 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1809/3756] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:42 2022] GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b => generated 1506 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:42.626653 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c3b36c58-e690-40a9-993f-cf44bc0506dc tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:14:42.629592 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-c3b36c58-e690-40a9-993f-cf44bc0506dc tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 9ff66c3c-284d-42d1-8c31-93cca515c46d] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:42.641644 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-c3b36c58-e690-40a9-993f-cf44bc0506dc tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] HTTP exception thrown: Instance 9ff66c3c-284d-42d1-8c31-93cca515c46d could not be found. Aug 10 23:14:42.651141 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c3b36c58-e690-40a9-993f-cf44bc0506dc tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Request method failure captured: Aug 10 23:14:42.651141 n-d-850468-14 devstack@n-api.service[122632]: request: POST /compute/v2.1/servers/9ff66c3c-284d-42d1-8c31-93cca515c46d/action HTTP/1.1 Aug 10 23:14:42.651141 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:14:42.651141 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:14:42.651141 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:14:42.651141 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 39 Aug 10 23:14:42.651141 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:14:42.651141 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:14:42.651141 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:14:42.651141 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:14:42.651141 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9DuIKrfOsS8tKST0PsIPrvuNPfsVISfOPvUoe9ddkVcTJKj7rDjd3OuH9u-DTT1aypj1AUoUKtajD98eDOUOHSpPisBSdRlSCov30lHf1uZq-XZLyBIVg5kAG8-SuXk2s1TL7EnRcjjMARSkm95dZDnXaBXRT3M4f8UoMDwqu7xK7gQ Aug 10 23:14:42.651141 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:14:42.651141 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:14:42.651141 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:14:42.651141 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:14:42.651141 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:14:42.651141 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:14:42.651141 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: d11bbb3e87f4463787da56ab19108822 Aug 10 23:14:42.651141 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-ServersNegativeTestJSON-1216728002 Aug 10 23:14:42.651141 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:14:42.651141 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:14:42.651141 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d11bbb3e87f4463787da56ab19108822"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d11bbb3e87f4463787da56ab19108822"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d11bbb3e87f4463787da56ab19108822"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d11bbb3e87f4463787da56ab19108822", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:14:42.651141 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-ServersNegativeTestJSON-1216728002 Aug 10 23:14:42.651141 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: d11bbb3e87f4463787da56ab19108822 Aug 10 23:14:42.651141 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1216728002 Aug 10 23:14:42.651141 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-ServersNegativeTestJSON-1216728002-project Aug 10 23:14:42.651141 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:14:42.651141 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:14:42.651141 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: f284ec2a4bf546b58c1c1adaf880e1fb Aug 10 23:14:42.651141 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-ServersNegativeTestJSON-1216728002-project Aug 10 23:14:42.651141 n-d-850468-14 devstack@n-api.service[122632]: Aug 10 23:14:42.651141 n-d-850468-14 devstack@n-api.service[122632]: {"os-getConsoleOutput": {"length": 10}} Aug 10 23:14:42.651141 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:14:42.651141 n-d-850468-14 devstack@n-api.service[122632]: exception: Instance 9ff66c3c-284d-42d1-8c31-93cca515c46d could not be found. Aug 10 23:14:42.651141 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': '9ff66c3c-284d-42d1-8c31-93cca515c46d', 'body': {'os-getConsoleOutput': {'length': 10}}} Aug 10 23:14:42.651141 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:14:42.651141 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:14:42.651141 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:14:42.651141 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:14:42.651141 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:14:42.651141 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:14:42.651141 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 10 23:14:42.651141 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 10 23:14:42.651141 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ff66c3c-284d-42d1-8c31-93cca515c46d could not be found. Aug 10 23:14:42.651141 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:14:42.651141 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:14:42.651141 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:14:42.651141 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:14:42.651141 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:14:42.651141 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:14:42.651141 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:14:42.651141 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:14:42.651141 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:14:42.651141 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:14:42.651141 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 23:14:42.651141 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 23:14:42.651141 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output Aug 10 23:14:42.651141 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 10 23:14:42.651141 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:14:42.651141 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:14:42.651141 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ff66c3c-284d-42d1-8c31-93cca515c46d could not be found. Aug 10 23:14:42.651141 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:14:42.651141 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:14:42.651141 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:14:42.651141 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:14:42.656133 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:14:42.656133 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:14:42.656133 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:14:42.656133 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:14:42.656133 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ff66c3c-284d-42d1-8c31-93cca515c46d could not be found. Aug 10 23:14:42.656133 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:14:42.659123 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c3b36c58-e690-40a9-993f-cf44bc0506dc tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Returning 404 to user: Instance 9ff66c3c-284d-42d1-8c31-93cca515c46d could not be found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:14:42.661629 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-c3b36c58-e690-40a9-993f-cf44bc0506dc tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "POST /compute/v2.1/servers/9ff66c3c-284d-42d1-8c31-93cca515c46d/action" status: 404 len: 111 microversion: 2.1 time: 0.038672 Aug 10 23:14:42.666873 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1810/3757] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:14:42 2022] POST /compute/v2.1/servers/9ff66c3c-284d-42d1-8c31-93cca515c46d/action => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 10 23:14:42.677380 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-57b65c26-4272-47c7-b222-6f796084ab73 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:42.679983 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-57b65c26-4272-47c7-b222-6f796084ab73 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: 7a8f8d36-4744-43b7-9d42-e50fb5fabe60] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:42.683822 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:14:42.697003 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-57b65c26-4272-47c7-b222-6f796084ab73 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:42.698436 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-57b65c26-4272-47c7-b222-6f796084ab73 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:42.699441 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-57b65c26-4272-47c7-b222-6f796084ab73 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:42.701151 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-57b65c26-4272-47c7-b222-6f796084ab73 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:42.702258 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-57b65c26-4272-47c7-b222-6f796084ab73 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:42.702706 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-57b65c26-4272-47c7-b222-6f796084ab73 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:43.021023 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-57b65c26-4272-47c7-b222-6f796084ab73 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6160c7a42740efbe3613380933fa15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d90f8a58ad047fa8f347d6474e4d673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:43.030413 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-5bbf70e9-dcea-459c-9568-12679cb7bf90 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:43.031901 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-57b65c26-4272-47c7-b222-6f796084ab73 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "GET /compute/v2.1/servers/7a8f8d36-4744-43b7-9d42-e50fb5fabe60" status: 200 len: 1510 microversion: 2.1 time: 0.363032 Aug 10 23:14:43.046705 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1811/3758] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:42 2022] GET /compute/v2.1/servers/7a8f8d36-4744-43b7-9d42-e50fb5fabe60 => generated 1510 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:43.046705 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-9bd2b7fc-7a6a-4132-ad4b-c317937ee2ff tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:43.046705 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-9bd2b7fc-7a6a-4132-ad4b-c317937ee2ff tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:43.056591 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9bd2b7fc-7a6a-4132-ad4b-c317937ee2ff tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:43.056842 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9bd2b7fc-7a6a-4132-ad4b-c317937ee2ff tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:43.057289 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9bd2b7fc-7a6a-4132-ad4b-c317937ee2ff tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:43.058009 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9bd2b7fc-7a6a-4132-ad4b-c317937ee2ff tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:43.058464 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9bd2b7fc-7a6a-4132-ad4b-c317937ee2ff tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:43.060812 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9bd2b7fc-7a6a-4132-ad4b-c317937ee2ff tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:43.069004 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-5bbf70e9-dcea-459c-9568-12679cb7bf90 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/1da4d99f-4cb0-4533-bda8-3bda03205e07" status: 200 len: 1315 microversion: 2.1 time: 0.578673 Aug 10 23:14:43.070128 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1948/3759] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:42 2022] GET /compute/v2.1/servers/1da4d99f-4cb0-4533-bda8-3bda03205e07 => generated 1315 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:43.294018 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-4df71f54-6520-48dd-8a99-3b09f1de4bef tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:43.294767 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-4df71f54-6520-48dd-8a99-3b09f1de4bef tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] [instance: 325ce83e-53e6-4021-b1a1-548ff5057761] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:43.301495 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4df71f54-6520-48dd-8a99-3b09f1de4bef tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:43.301983 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4df71f54-6520-48dd-8a99-3b09f1de4bef tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:43.302446 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4df71f54-6520-48dd-8a99-3b09f1de4bef tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:43.304122 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4df71f54-6520-48dd-8a99-3b09f1de4bef tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:43.304968 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4df71f54-6520-48dd-8a99-3b09f1de4bef tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:43.305841 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4df71f54-6520-48dd-8a99-3b09f1de4bef tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:43.472831 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-9bd2b7fc-7a6a-4132-ad4b-c317937ee2ff tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:43.483960 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-9bd2b7fc-7a6a-4132-ad4b-c317937ee2ff tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b" status: 200 len: 1506 microversion: 2.1 time: 0.449865 Aug 10 23:14:43.484642 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1812/3760] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:43 2022] GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b => generated 1506 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:43.491716 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c9917c5e-f208-4388-b8a4-0a9b7fb5b355 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:43.493041 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-c9917c5e-f208-4388-b8a4-0a9b7fb5b355 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] [instance: 7df225be-2dbc-4ef6-aeec-9a3de33a0006] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:43.502267 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c9917c5e-f208-4388-b8a4-0a9b7fb5b355 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:43.503363 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c9917c5e-f208-4388-b8a4-0a9b7fb5b355 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:43.504114 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c9917c5e-f208-4388-b8a4-0a9b7fb5b355 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:43.505141 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c9917c5e-f208-4388-b8a4-0a9b7fb5b355 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:43.505838 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c9917c5e-f208-4388-b8a4-0a9b7fb5b355 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:43.507608 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c9917c5e-f208-4388-b8a4-0a9b7fb5b355 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:43.733920 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-4df71f54-6520-48dd-8a99-3b09f1de4bef tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39eef3efd444a6d8192f405cba67f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee72843cb8064834bdbc02d8a5417f71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:43.743425 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-4df71f54-6520-48dd-8a99-3b09f1de4bef tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39eef3efd444a6d8192f405cba67f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee72843cb8064834bdbc02d8a5417f71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:43.745434 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-4df71f54-6520-48dd-8a99-3b09f1de4bef tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39eef3efd444a6d8192f405cba67f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee72843cb8064834bdbc02d8a5417f71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:43.746686 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-4df71f54-6520-48dd-8a99-3b09f1de4bef tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] 10.222.0.58 "GET /compute/v2.1/servers/325ce83e-53e6-4021-b1a1-548ff5057761" status: 200 len: 1557 microversion: 2.21 time: 0.456707 Aug 10 23:14:43.761583 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1949/3761] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:14:43 2022] GET /compute/v2.1/servers/325ce83e-53e6-4021-b1a1-548ff5057761 => generated 1557 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 23:14:43.767326 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-a36598d0-e11b-4df2-ad96-2405f270e236 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:14:43.773106 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-a36598d0-e11b-4df2-ad96-2405f270e236 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] [instance: f4dc6241-b173-4cbf-b76c-7da3fac7edcc] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:43.782322 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a36598d0-e11b-4df2-ad96-2405f270e236 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:43.783327 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a36598d0-e11b-4df2-ad96-2405f270e236 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:43.783850 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a36598d0-e11b-4df2-ad96-2405f270e236 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:43.784647 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a36598d0-e11b-4df2-ad96-2405f270e236 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:43.785190 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a36598d0-e11b-4df2-ad96-2405f270e236 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:43.785698 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a36598d0-e11b-4df2-ad96-2405f270e236 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:43.795888 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-c9917c5e-f208-4388-b8a4-0a9b7fb5b355 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07c94ebf0954cdea12b9a689538d96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395d7c4077e54c43bb95288db3942b0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:43.811479 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-c9917c5e-f208-4388-b8a4-0a9b7fb5b355 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] 10.222.0.58 "GET /compute/v2.1/servers/7df225be-2dbc-4ef6-aeec-9a3de33a0006" status: 200 len: 1322 microversion: 2.1 time: 0.325526 Aug 10 23:14:43.812398 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1813/3762] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:43 2022] GET /compute/v2.1/servers/7df225be-2dbc-4ef6-aeec-9a3de33a0006 => generated 1322 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:43.829122 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-201b1134-b29c-4b52-92c7-11b36bdad714 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:43.830051 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-201b1134-b29c-4b52-92c7-11b36bdad714 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:43.836997 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-201b1134-b29c-4b52-92c7-11b36bdad714 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:43.837771 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-201b1134-b29c-4b52-92c7-11b36bdad714 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:43.838422 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-201b1134-b29c-4b52-92c7-11b36bdad714 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:43.839164 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-201b1134-b29c-4b52-92c7-11b36bdad714 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:43.839618 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-201b1134-b29c-4b52-92c7-11b36bdad714 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:43.840042 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-201b1134-b29c-4b52-92c7-11b36bdad714 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:43.868704 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-a36598d0-e11b-4df2-ad96-2405f270e236 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "POST /compute/v2.1/servers/f4dc6241-b173-4cbf-b76c-7da3fac7edcc/action" status: 200 len: 24544 microversion: 2.1 time: 0.104873 Aug 10 23:14:43.870850 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1950/3763] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:14:43 2022] POST /compute/v2.1/servers/f4dc6241-b173-4cbf-b76c-7da3fac7edcc/action => generated 24544 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 23:14:44.062200 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-8630e4a4-0105-453d-802b-8b6fb2f593f9 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:44.064113 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-201b1134-b29c-4b52-92c7-11b36bdad714 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:44.067605 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-8630e4a4-0105-453d-802b-8b6fb2f593f9 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: 7a8f8d36-4744-43b7-9d42-e50fb5fabe60] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:44.077654 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-201b1134-b29c-4b52-92c7-11b36bdad714 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b" status: 200 len: 1506 microversion: 2.1 time: 0.252285 Aug 10 23:14:44.097155 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1814/3764] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:43 2022] GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b => generated 1506 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:44.103074 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-ffb47ade-d5f6-4182-b230-0b5e4a765c00 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:44.104921 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-ffb47ade-d5f6-4182-b230-0b5e4a765c00 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: 1da4d99f-4cb0-4533-bda8-3bda03205e07] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:44.106671 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8630e4a4-0105-453d-802b-8b6fb2f593f9 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:44.107367 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8630e4a4-0105-453d-802b-8b6fb2f593f9 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:44.107955 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8630e4a4-0105-453d-802b-8b6fb2f593f9 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:44.108846 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8630e4a4-0105-453d-802b-8b6fb2f593f9 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:44.111255 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8630e4a4-0105-453d-802b-8b6fb2f593f9 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:44.111935 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8630e4a4-0105-453d-802b-8b6fb2f593f9 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:44.124448 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ffb47ade-d5f6-4182-b230-0b5e4a765c00 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:44.126527 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ffb47ade-d5f6-4182-b230-0b5e4a765c00 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:44.127422 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ffb47ade-d5f6-4182-b230-0b5e4a765c00 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:44.139450 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ffb47ade-d5f6-4182-b230-0b5e4a765c00 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:44.140309 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ffb47ade-d5f6-4182-b230-0b5e4a765c00 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:44.140961 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ffb47ade-d5f6-4182-b230-0b5e4a765c00 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:44.376032 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-ffb47ade-d5f6-4182-b230-0b5e4a765c00 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:44.385849 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-ffb47ade-d5f6-4182-b230-0b5e4a765c00 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/1da4d99f-4cb0-4533-bda8-3bda03205e07" status: 200 len: 1315 microversion: 2.1 time: 0.287303 Aug 10 23:14:44.387514 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1815/3765] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:44 2022] GET /compute/v2.1/servers/1da4d99f-4cb0-4533-bda8-3bda03205e07 => generated 1315 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:44.393700 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-8e2e27e6-b746-429c-8a82-5751ff00428e tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:44.394470 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-8e2e27e6-b746-429c-8a82-5751ff00428e tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: bd88bc32-1b4e-4d2c-91cf-1fc0bb2fc454] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:44.403650 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-8e2e27e6-b746-429c-8a82-5751ff00428e tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] HTTP exception thrown: Instance bd88bc32-1b4e-4d2c-91cf-1fc0bb2fc454 could not be found. Aug 10 23:14:44.410911 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-8e2e27e6-b746-429c-8a82-5751ff00428e tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Request method failure captured: Aug 10 23:14:44.410911 n-d-850468-14 devstack@n-api.service[122632]: request: GET /compute/v2.1/servers/bd88bc32-1b4e-4d2c-91cf-1fc0bb2fc454 HTTP/1.1 Aug 10 23:14:44.410911 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:14:44.410911 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:14:44.410911 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:14:44.410911 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 23:14:44.410911 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:14:44.410911 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:14:44.410911 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:14:44.410911 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:14:44.410911 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9DuIKrfOsS8tKST0PsIPrvuNPfsVISfOPvUoe9ddkVcTJKj7rDjd3OuH9u-DTT1aypj1AUoUKtajD98eDOUOHSpPisBSdRlSCov30lHf1uZq-XZLyBIVg5kAG8-SuXk2s1TL7EnRcjjMARSkm95dZDnXaBXRT3M4f8UoMDwqu7xK7gQ Aug 10 23:14:44.410911 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:14:44.410911 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:14:44.410911 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:14:44.410911 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:14:44.410911 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:14:44.410911 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:14:44.410911 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: d11bbb3e87f4463787da56ab19108822 Aug 10 23:14:44.410911 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-ServersNegativeTestJSON-1216728002 Aug 10 23:14:44.410911 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:14:44.410911 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:14:44.410911 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d11bbb3e87f4463787da56ab19108822"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d11bbb3e87f4463787da56ab19108822"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d11bbb3e87f4463787da56ab19108822"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d11bbb3e87f4463787da56ab19108822", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:14:44.410911 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-ServersNegativeTestJSON-1216728002 Aug 10 23:14:44.410911 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: d11bbb3e87f4463787da56ab19108822 Aug 10 23:14:44.410911 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1216728002 Aug 10 23:14:44.410911 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-ServersNegativeTestJSON-1216728002-project Aug 10 23:14:44.410911 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:14:44.410911 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:14:44.410911 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: f284ec2a4bf546b58c1c1adaf880e1fb Aug 10 23:14:44.410911 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-ServersNegativeTestJSON-1216728002-project Aug 10 23:14:44.410911 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:14:44.410911 n-d-850468-14 devstack@n-api.service[122632]: exception: Instance bd88bc32-1b4e-4d2c-91cf-1fc0bb2fc454 could not be found. Aug 10 23:14:44.410911 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': 'bd88bc32-1b4e-4d2c-91cf-1fc0bb2fc454'} Aug 10 23:14:44.410911 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:14:44.410911 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:14:44.410911 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:14:44.410911 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:14:44.410911 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:14:44.410911 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:14:44.410911 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 10 23:14:44.410911 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 10 23:14:44.410911 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd88bc32-1b4e-4d2c-91cf-1fc0bb2fc454 could not be found. Aug 10 23:14:44.410911 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:14:44.410911 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:14:44.410911 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:14:44.410911 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:14:44.410911 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:14:44.410911 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:14:44.410911 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:14:44.410911 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:14:44.410911 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:14:44.410911 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:14:44.410911 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:14:44.410911 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:14:44.410911 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:14:44.410911 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:14:44.410911 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:14:44.410911 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:14:44.410911 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd88bc32-1b4e-4d2c-91cf-1fc0bb2fc454 could not be found. Aug 10 23:14:44.410911 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:14:44.410911 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:14:44.410911 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:14:44.410911 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:14:44.410911 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:14:44.415900 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:14:44.415900 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:14:44.415900 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:14:44.415900 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd88bc32-1b4e-4d2c-91cf-1fc0bb2fc454 could not be found. Aug 10 23:14:44.415900 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:14:44.417670 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-8e2e27e6-b746-429c-8a82-5751ff00428e tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Returning 404 to user: Instance bd88bc32-1b4e-4d2c-91cf-1fc0bb2fc454 could not be found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:14:44.418557 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-8e2e27e6-b746-429c-8a82-5751ff00428e tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/bd88bc32-1b4e-4d2c-91cf-1fc0bb2fc454" status: 404 len: 111 microversion: 2.1 time: 0.029332 Aug 10 23:14:44.419812 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1816/3766] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:44 2022] GET /compute/v2.1/servers/bd88bc32-1b4e-4d2c-91cf-1fc0bb2fc454 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:14:44.433548 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-5b0edd16-ed84-4dd7-9d79-22beba4cacf4 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:44.434699 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-5b0edd16-ed84-4dd7-9d79-22beba4cacf4 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:44.448714 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5b0edd16-ed84-4dd7-9d79-22beba4cacf4 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:44.449216 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5b0edd16-ed84-4dd7-9d79-22beba4cacf4 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:44.450962 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5b0edd16-ed84-4dd7-9d79-22beba4cacf4 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:44.452060 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5b0edd16-ed84-4dd7-9d79-22beba4cacf4 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:44.452682 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5b0edd16-ed84-4dd7-9d79-22beba4cacf4 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:44.453294 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5b0edd16-ed84-4dd7-9d79-22beba4cacf4 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:44.717228 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-5b0edd16-ed84-4dd7-9d79-22beba4cacf4 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:44.724939 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-5b0edd16-ed84-4dd7-9d79-22beba4cacf4 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b" status: 200 len: 1506 microversion: 2.1 time: 0.299442 Aug 10 23:14:44.725606 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1817/3767] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:44 2022] GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b => generated 1506 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:44.749538 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-67024de9-e814-491a-8650-6f8839ad5f98 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:44.750359 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-67024de9-e814-491a-8650-6f8839ad5f98 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:44.758698 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-67024de9-e814-491a-8650-6f8839ad5f98 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:44.759301 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-67024de9-e814-491a-8650-6f8839ad5f98 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:44.759990 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-67024de9-e814-491a-8650-6f8839ad5f98 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:44.760861 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-67024de9-e814-491a-8650-6f8839ad5f98 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:44.761603 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-67024de9-e814-491a-8650-6f8839ad5f98 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:44.762183 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-67024de9-e814-491a-8650-6f8839ad5f98 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:44.766278 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-8630e4a4-0105-453d-802b-8b6fb2f593f9 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6160c7a42740efbe3613380933fa15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d90f8a58ad047fa8f347d6474e4d673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:44.776296 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-8630e4a4-0105-453d-802b-8b6fb2f593f9 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "GET /compute/v2.1/servers/7a8f8d36-4744-43b7-9d42-e50fb5fabe60" status: 200 len: 1510 microversion: 2.1 time: 0.718418 Aug 10 23:14:44.777491 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1951/3768] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:44 2022] GET /compute/v2.1/servers/7a8f8d36-4744-43b7-9d42-e50fb5fabe60 => generated 1510 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:44.783898 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-476ca515-1bac-41a9-a21f-c06b45ccb6e9 tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:44.784724 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-476ca515-1bac-41a9-a21f-c06b45ccb6e9 tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] [instance: 325ce83e-53e6-4021-b1a1-548ff5057761] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:44.792128 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-476ca515-1bac-41a9-a21f-c06b45ccb6e9 tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:44.793149 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-476ca515-1bac-41a9-a21f-c06b45ccb6e9 tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:44.793750 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-476ca515-1bac-41a9-a21f-c06b45ccb6e9 tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:44.794689 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-476ca515-1bac-41a9-a21f-c06b45ccb6e9 tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:44.796153 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-476ca515-1bac-41a9-a21f-c06b45ccb6e9 tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:44.796818 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-476ca515-1bac-41a9-a21f-c06b45ccb6e9 tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:45.011375 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-67024de9-e814-491a-8650-6f8839ad5f98 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:45.025866 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-67024de9-e814-491a-8650-6f8839ad5f98 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b" status: 200 len: 1506 microversion: 2.1 time: 0.282283 Aug 10 23:14:45.026926 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1818/3769] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:44 2022] GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b => generated 1506 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:14:45.046101 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-20e02a51-c8df-43b2-9f2f-35d2a86db1d3 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:45.047136 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-20e02a51-c8df-43b2-9f2f-35d2a86db1d3 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] [instance: 7df225be-2dbc-4ef6-aeec-9a3de33a0006] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:45.057372 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-20e02a51-c8df-43b2-9f2f-35d2a86db1d3 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:45.058349 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-20e02a51-c8df-43b2-9f2f-35d2a86db1d3 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:45.058970 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-20e02a51-c8df-43b2-9f2f-35d2a86db1d3 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:45.061601 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-20e02a51-c8df-43b2-9f2f-35d2a86db1d3 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:45.062875 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-20e02a51-c8df-43b2-9f2f-35d2a86db1d3 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:45.064788 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-20e02a51-c8df-43b2-9f2f-35d2a86db1d3 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:45.292669 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-20e02a51-c8df-43b2-9f2f-35d2a86db1d3 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07c94ebf0954cdea12b9a689538d96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395d7c4077e54c43bb95288db3942b0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:45.301661 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-20e02a51-c8df-43b2-9f2f-35d2a86db1d3 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] 10.222.0.58 "GET /compute/v2.1/servers/7df225be-2dbc-4ef6-aeec-9a3de33a0006" status: 200 len: 1516 microversion: 2.1 time: 0.261100 Aug 10 23:14:45.302248 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1819/3770] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:45 2022] GET /compute/v2.1/servers/7df225be-2dbc-4ef6-aeec-9a3de33a0006 => generated 1516 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:45.323034 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-b3c1818e-ef40-474c-9243-ca97fbba9284 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-213194551", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "91d0258a-9486-4479-91e9-a6d9339a2e0a"}]}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:14:45.338698 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-476ca515-1bac-41a9-a21f-c06b45ccb6e9 tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c39eef3efd444a6d8192f405cba67f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee72843cb8064834bdbc02d8a5417f71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:45.344959 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-b3c1818e-ef40-474c-9243-ca97fbba9284 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Request method failure captured: Aug 10 23:14:45.344959 n-d-850468-14 devstack@n-api.service[122632]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 10 23:14:45.344959 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:14:45.344959 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:14:45.344959 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:14:45.344959 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 237 Aug 10 23:14:45.344959 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:14:45.344959 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:14:45.344959 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:14:45.344959 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:14:45.344959 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9DuIKrfOsS8tKST0PsIPrvuNPfsVISfOPvUoe9ddkVcTJKj7rDjd3OuH9u-DTT1aypj1AUoUKtajD98eDOUOHSpPisBSdRlSCov30lHf1uZq-XZLyBIVg5kAG8-SuXk2s1TL7EnRcjjMARSkm95dZDnXaBXRT3M4f8UoMDwqu7xK7gQ Aug 10 23:14:45.344959 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:14:45.344959 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:14:45.344959 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:14:45.344959 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:14:45.344959 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:14:45.344959 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:14:45.344959 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: d11bbb3e87f4463787da56ab19108822 Aug 10 23:14:45.344959 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-ServersNegativeTestJSON-1216728002 Aug 10 23:14:45.344959 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:14:45.344959 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:14:45.344959 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d11bbb3e87f4463787da56ab19108822"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d11bbb3e87f4463787da56ab19108822"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d11bbb3e87f4463787da56ab19108822"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d11bbb3e87f4463787da56ab19108822", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:14:45.344959 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-ServersNegativeTestJSON-1216728002 Aug 10 23:14:45.344959 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: d11bbb3e87f4463787da56ab19108822 Aug 10 23:14:45.344959 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1216728002 Aug 10 23:14:45.344959 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-ServersNegativeTestJSON-1216728002-project Aug 10 23:14:45.344959 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:14:45.344959 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:14:45.344959 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: f284ec2a4bf546b58c1c1adaf880e1fb Aug 10 23:14:45.344959 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-ServersNegativeTestJSON-1216728002-project Aug 10 23:14:45.344959 n-d-850468-14 devstack@n-api.service[122632]: Aug 10 23:14:45.344959 n-d-850468-14 devstack@n-api.service[122632]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-213194551", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "91d0258a-9486-4479-91e9-a6d9339a2e0a"}]}} Aug 10 23:14:45.344959 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:14:45.344959 n-d-850468-14 devstack@n-api.service[122632]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Aug 10 23:14:45.344959 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-213194551', 'imageRef': '78ad8905-f66f-4733-8be9-2b260f1fabed', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': '91d0258a-9486-4479-91e9-a6d9339a2e0a'}]}}} Aug 10 23:14:45.344959 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:14:45.344959 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:14:45.344959 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Aug 10 23:14:45.344959 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi result = func(instance) Aug 10 23:14:45.344959 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 236, in is_ipv4 Aug 10 23:14:45.344959 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return bool(ipaddress.IPv4Address(instance)) Aug 10 23:14:45.344959 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1257, in __init__ Aug 10 23:14:45.344959 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Aug 10 23:14:45.344959 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1144, in _ip_int_from_string Aug 10 23:14:45.344959 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise AddressValueError("Expected 4 octets in %r" % ip_str) Aug 10 23:14:45.344959 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: Expected 4 octets in '1.1.1.1.1.1' Aug 10 23:14:45.344959 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:14:45.344959 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 10 23:14:45.344959 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:14:45.344959 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:14:45.344959 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 10 23:14:45.344959 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 10 23:14:45.344959 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 10 23:14:45.344959 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise error Aug 10 23:14:45.344959 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' Aug 10 23:14:45.344959 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:14:45.344959 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: Aug 10 23:14:45.344959 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} Aug 10 23:14:45.344959 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:14:45.344959 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 10 23:14:45.344959 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' Aug 10 23:14:45.344959 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:14:45.344959 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:14:45.344959 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:14:45.344959 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:14:45.348568 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:14:45.348568 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:14:45.348568 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:14:45.348568 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:14:45.348568 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:14:45.348568 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:14:45.348568 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 23:14:45.348568 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 23:14:45.348568 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 10 23:14:45.348568 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 10 23:14:45.348568 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 10 23:14:45.348568 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 10 23:14:45.348568 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 10 23:14:45.348568 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 10 23:14:45.348568 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Aug 10 23:14:45.348568 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:14:45.348568 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:14:45.348568 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:14:45.348568 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:14:45.348568 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:14:45.348568 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:14:45.348568 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 10 23:14:45.348568 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 10 23:14:45.348568 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Aug 10 23:14:45.348568 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:14:45.349876 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-476ca515-1bac-41a9-a21f-c06b45ccb6e9 tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c39eef3efd444a6d8192f405cba67f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee72843cb8064834bdbc02d8a5417f71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:45.349876 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-476ca515-1bac-41a9-a21f-c06b45ccb6e9 tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c39eef3efd444a6d8192f405cba67f86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee72843cb8064834bdbc02d8a5417f71', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:45.352015 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-476ca515-1bac-41a9-a21f-c06b45ccb6e9 tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] 10.222.0.58 "GET /compute/v2.1/servers/325ce83e-53e6-4021-b1a1-548ff5057761" status: 200 len: 1557 microversion: 2.21 time: 0.572636 Aug 10 23:14:45.353147 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1952/3771] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:14:44 2022] GET /compute/v2.1/servers/325ce83e-53e6-4021-b1a1-548ff5057761 => generated 1557 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:14:45.353359 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-b3c1818e-ef40-474c-9243-ca97fbba9284 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:14:45.354537 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-b3c1818e-ef40-474c-9243-ca97fbba9284 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.038701 Aug 10 23:14:45.355602 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1820/3772] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 23:14:45 2022] POST /compute/v2.1/servers => generated 139 bytes in 40 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 10 23:14:45.358832 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-160dd22c-a756-4545-8d30-a41316d4fa82 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:14:45.362252 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-160dd22c-a756-4545-8d30-a41316d4fa82 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] [instance: 7df225be-2dbc-4ef6-aeec-9a3de33a0006] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:45.373406 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-17e9b125-d284-4e74-81ee-29724382da05 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:45.374018 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-17e9b125-d284-4e74-81ee-29724382da05 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:45.380834 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-160dd22c-a756-4545-8d30-a41316d4fa82 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:45.381390 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-160dd22c-a756-4545-8d30-a41316d4fa82 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:45.381835 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-160dd22c-a756-4545-8d30-a41316d4fa82 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:45.382704 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-160dd22c-a756-4545-8d30-a41316d4fa82 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:45.383393 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-160dd22c-a756-4545-8d30-a41316d4fa82 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:45.383824 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-160dd22c-a756-4545-8d30-a41316d4fa82 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:45.386572 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-17e9b125-d284-4e74-81ee-29724382da05 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:45.387222 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-17e9b125-d284-4e74-81ee-29724382da05 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:45.387771 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-17e9b125-d284-4e74-81ee-29724382da05 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:45.388820 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-17e9b125-d284-4e74-81ee-29724382da05 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:45.389413 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-17e9b125-d284-4e74-81ee-29724382da05 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:45.389946 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-17e9b125-d284-4e74-81ee-29724382da05 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:45.411925 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.objects.instance [None req-160dd22c-a756-4545-8d30-a41316d4fa82 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lazy-loading 'flavor' on Instance uuid 7df225be-2dbc-4ef6-aeec-9a3de33a0006 {{(pid=122633) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:14:45.532153 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-160dd22c-a756-4545-8d30-a41316d4fa82 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] 10.222.0.58 "POST /compute/v2.1/servers/7df225be-2dbc-4ef6-aeec-9a3de33a0006/action" status: 200 len: 32 microversion: 2.1 time: 0.177503 Aug 10 23:14:45.532889 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1953/3773] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:14:45 2022] POST /compute/v2.1/servers/7df225be-2dbc-4ef6-aeec-9a3de33a0006/action => generated 32 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 23:14:45.544007 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-d9e9ddf1-ad1e-404a-bfa9-9aaea8b4c2cd tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:45.547123 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-d9e9ddf1-ad1e-404a-bfa9-9aaea8b4c2cd tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: 1da4d99f-4cb0-4533-bda8-3bda03205e07] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:45.565523 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d9e9ddf1-ad1e-404a-bfa9-9aaea8b4c2cd tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:45.566016 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d9e9ddf1-ad1e-404a-bfa9-9aaea8b4c2cd tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:45.566467 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d9e9ddf1-ad1e-404a-bfa9-9aaea8b4c2cd tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:45.567221 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d9e9ddf1-ad1e-404a-bfa9-9aaea8b4c2cd tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:45.567682 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d9e9ddf1-ad1e-404a-bfa9-9aaea8b4c2cd tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:45.570862 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d9e9ddf1-ad1e-404a-bfa9-9aaea8b4c2cd tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:45.841975 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-17e9b125-d284-4e74-81ee-29724382da05 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:45.860227 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-17e9b125-d284-4e74-81ee-29724382da05 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b" status: 200 len: 1506 microversion: 2.1 time: 0.491695 Aug 10 23:14:45.872509 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1821/3774] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:45 2022] GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b => generated 1506 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:14:45.881460 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-64abee1b-b602-41b4-a8d6-1801a5fcb065 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:45.882451 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-64abee1b-b602-41b4-a8d6-1801a5fcb065 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] [instance: 7df225be-2dbc-4ef6-aeec-9a3de33a0006] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:45.890310 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-64abee1b-b602-41b4-a8d6-1801a5fcb065 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:45.890730 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-64abee1b-b602-41b4-a8d6-1801a5fcb065 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:45.891205 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-64abee1b-b602-41b4-a8d6-1801a5fcb065 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:45.891927 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-64abee1b-b602-41b4-a8d6-1801a5fcb065 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:45.892385 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-64abee1b-b602-41b4-a8d6-1801a5fcb065 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:45.892819 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-64abee1b-b602-41b4-a8d6-1801a5fcb065 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:46.150493 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-64abee1b-b602-41b4-a8d6-1801a5fcb065 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07c94ebf0954cdea12b9a689538d96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395d7c4077e54c43bb95288db3942b0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:46.158848 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-64abee1b-b602-41b4-a8d6-1801a5fcb065 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] 10.222.0.58 "GET /compute/v2.1/servers/7df225be-2dbc-4ef6-aeec-9a3de33a0006" status: 200 len: 1522 microversion: 2.1 time: 0.283260 Aug 10 23:14:46.171337 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1822/3775] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:45 2022] GET /compute/v2.1/servers/7df225be-2dbc-4ef6-aeec-9a3de33a0006 => generated 1522 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:46.176426 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-172ed0f0-2497-45de-9b7c-c2299f323efe tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:46.177263 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-172ed0f0-2497-45de-9b7c-c2299f323efe tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: 7a8f8d36-4744-43b7-9d42-e50fb5fabe60] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:46.183763 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-172ed0f0-2497-45de-9b7c-c2299f323efe tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:46.184251 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-172ed0f0-2497-45de-9b7c-c2299f323efe tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:46.184693 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-172ed0f0-2497-45de-9b7c-c2299f323efe tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:46.185392 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-172ed0f0-2497-45de-9b7c-c2299f323efe tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:46.186102 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-172ed0f0-2497-45de-9b7c-c2299f323efe tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:46.187463 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-172ed0f0-2497-45de-9b7c-c2299f323efe tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:46.371703 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-172ed0f0-2497-45de-9b7c-c2299f323efe tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6160c7a42740efbe3613380933fa15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d90f8a58ad047fa8f347d6474e4d673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:46.381895 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-172ed0f0-2497-45de-9b7c-c2299f323efe tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "GET /compute/v2.1/servers/7a8f8d36-4744-43b7-9d42-e50fb5fabe60" status: 200 len: 1510 microversion: 2.1 time: 0.209122 Aug 10 23:14:46.383386 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1823/3776] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:46 2022] GET /compute/v2.1/servers/7a8f8d36-4744-43b7-9d42-e50fb5fabe60 => generated 1510 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:46.399352 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-32358969-af35-4c73-b54d-cd6422705287 req-fee740e3-dc4a-4b9f-8d47-b4e9078cad8a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1da4d99f-4cb0-4533-bda8-3bda03205e07", "tag": "00538a30-d023-4ceb-a5db-4e41b89bea2b"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:14:46.422057 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-32358969-af35-4c73-b54d-cd6422705287 req-fee740e3-dc4a-4b9f-8d47-b4e9078cad8a service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:46.422649 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-32358969-af35-4c73-b54d-cd6422705287 req-fee740e3-dc4a-4b9f-8d47-b4e9078cad8a service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:46.423777 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-32358969-af35-4c73-b54d-cd6422705287 req-fee740e3-dc4a-4b9f-8d47-b4e9078cad8a service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:46.437458 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-32358969-af35-4c73-b54d-cd6422705287 req-fee740e3-dc4a-4b9f-8d47-b4e9078cad8a service nova] Creating event network-changed:00538a30-d023-4ceb-a5db-4e41b89bea2b for instance 1da4d99f-4cb0-4533-bda8-3bda03205e07 on n-h1-850468-14 Aug 10 23:14:46.443544 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-32358969-af35-4c73-b54d-cd6422705287 req-fee740e3-dc4a-4b9f-8d47-b4e9078cad8a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058335 Aug 10 23:14:46.445283 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1824/3777] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:14:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:14:46.450434 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-eabf9e59-7f20-48cf-99dd-a02d0b41800b tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:46.451545 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-eabf9e59-7f20-48cf-99dd-a02d0b41800b tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:46.458728 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-eabf9e59-7f20-48cf-99dd-a02d0b41800b tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:46.460066 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-eabf9e59-7f20-48cf-99dd-a02d0b41800b tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:46.460550 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-eabf9e59-7f20-48cf-99dd-a02d0b41800b tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:46.461243 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-eabf9e59-7f20-48cf-99dd-a02d0b41800b tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:46.461724 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-eabf9e59-7f20-48cf-99dd-a02d0b41800b tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:46.462169 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-eabf9e59-7f20-48cf-99dd-a02d0b41800b tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:46.559354 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-d9e9ddf1-ad1e-404a-bfa9-9aaea8b4c2cd tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:46.574380 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-d9e9ddf1-ad1e-404a-bfa9-9aaea8b4c2cd tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/1da4d99f-4cb0-4533-bda8-3bda03205e07" status: 200 len: 1315 microversion: 2.1 time: 1.039342 Aug 10 23:14:46.588001 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1954/3778] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:45 2022] GET /compute/v2.1/servers/1da4d99f-4cb0-4533-bda8-3bda03205e07 => generated 1315 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:46.588001 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-e70b394e-4978-4a46-8d0b-274691a47e94 tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:46.588001 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-e70b394e-4978-4a46-8d0b-274691a47e94 tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] [instance: 325ce83e-53e6-4021-b1a1-548ff5057761] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:46.599513 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e70b394e-4978-4a46-8d0b-274691a47e94 tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:46.600758 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e70b394e-4978-4a46-8d0b-274691a47e94 tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:46.601480 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e70b394e-4978-4a46-8d0b-274691a47e94 tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:46.602496 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e70b394e-4978-4a46-8d0b-274691a47e94 tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:46.603121 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e70b394e-4978-4a46-8d0b-274691a47e94 tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:46.603761 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e70b394e-4978-4a46-8d0b-274691a47e94 tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:46.623079 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-e70b394e-4978-4a46-8d0b-274691a47e94 tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] HTTP exception thrown: Instance 325ce83e-53e6-4021-b1a1-548ff5057761 could not be found. Aug 10 23:14:46.625506 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-e70b394e-4978-4a46-8d0b-274691a47e94 tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Request method failure captured: Aug 10 23:14:46.625506 n-d-850468-14 devstack@n-api.service[122633]: request: GET /compute/v2.1/servers/325ce83e-53e6-4021-b1a1-548ff5057761 HTTP/1.1 Aug 10 23:14:46.625506 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:14:46.625506 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:14:46.625506 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:14:46.625506 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:14:46.625506 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:14:46.625506 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:14:46.625506 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:14:46.625506 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:14:46.625506 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9DvI7xeHGNK4xT8osvkmyqHn-ae68VPc0SLTiT2AG5T5KfFmyji1cFBIcDrLt2wjYBLLfKiWR3-S-Ts9EPXiSfgmsb86rOgUwc7qIj4x8dyL_6vrCEQvWwku1CL_5IWj2268zugI19iYOUeeMX8SewPM9MP-NfQklRAfawUZFHmCTyE Aug 10 23:14:46.625506 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:14:46.625506 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:14:46.625506 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:14:46.625506 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:14:46.625506 n-d-850468-14 devstack@n-api.service[122633]: X-Openstack-Nova-Api-Version: 2.21 Aug 10 23:14:46.625506 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:14:46.625506 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:14:46.625506 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: ee72843cb8064834bdbc02d8a5417f71 Aug 10 23:14:46.625506 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1282257034 Aug 10 23:14:46.625506 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:14:46.625506 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:14:46.625506 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ee72843cb8064834bdbc02d8a5417f71"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ee72843cb8064834bdbc02d8a5417f71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ee72843cb8064834bdbc02d8a5417f71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ee72843cb8064834bdbc02d8a5417f71", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:14:46.625506 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-InstanceActionsV221TestJSON-1282257034 Aug 10 23:14:46.625506 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: ee72843cb8064834bdbc02d8a5417f71 Aug 10 23:14:46.625506 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1282257034 Aug 10 23:14:46.625506 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-InstanceActionsV221TestJSON-1282257034-project Aug 10 23:14:46.625506 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:14:46.625506 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:14:46.625506 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: c39eef3efd444a6d8192f405cba67f86 Aug 10 23:14:46.625506 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-InstanceActionsV221TestJSON-1282257034-project Aug 10 23:14:46.625506 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:14:46.625506 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance 325ce83e-53e6-4021-b1a1-548ff5057761 could not be found. Aug 10 23:14:46.625506 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': '325ce83e-53e6-4021-b1a1-548ff5057761'} Aug 10 23:14:46.625506 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:14:46.625506 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:14:46.625506 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:14:46.625506 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:14:46.625506 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:14:46.625506 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:14:46.625506 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:14:46.625506 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:14:46.625506 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:14:46.625506 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:14:46.625506 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 325ce83e-53e6-4021-b1a1-548ff5057761 could not be found. Aug 10 23:14:46.625506 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:14:46.625506 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:14:46.625506 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:14:46.625506 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:14:46.625506 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:14:46.625506 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:14:46.625506 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:14:46.625506 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:14:46.625506 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:14:46.625506 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:14:46.625506 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:14:46.625506 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:14:46.625506 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:14:46.625506 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:14:46.625506 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:14:46.625506 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:14:46.625506 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 325ce83e-53e6-4021-b1a1-548ff5057761 could not be found. Aug 10 23:14:46.625506 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:14:46.625506 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:14:46.630006 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:14:46.630006 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:14:46.630006 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:14:46.630006 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:14:46.630006 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:14:46.630006 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:14:46.630006 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 325ce83e-53e6-4021-b1a1-548ff5057761 could not be found. Aug 10 23:14:46.630006 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:14:46.631171 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-e70b394e-4978-4a46-8d0b-274691a47e94 tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Returning 404 to user: Instance 325ce83e-53e6-4021-b1a1-548ff5057761 could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:14:46.632744 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-e70b394e-4978-4a46-8d0b-274691a47e94 tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] 10.222.0.58 "GET /compute/v2.1/servers/325ce83e-53e6-4021-b1a1-548ff5057761" status: 404 len: 111 microversion: 2.21 time: 0.055803 Aug 10 23:14:46.633752 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1955/3779] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:14:46 2022] GET /compute/v2.1/servers/325ce83e-53e6-4021-b1a1-548ff5057761 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 10 23:14:46.643573 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-7f24ea0d-c1f8-422a-b25e-0be2209848ea tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Calling method '.version_select at 0x7f847c51b0d0>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:46.645222 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-7f24ea0d-c1f8-422a-b25e-0be2209848ea tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] [instance: 325ce83e-53e6-4021-b1a1-548ff5057761] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:46.652843 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7f24ea0d-c1f8-422a-b25e-0be2209848ea tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:46.653691 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7f24ea0d-c1f8-422a-b25e-0be2209848ea tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:46.654224 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7f24ea0d-c1f8-422a-b25e-0be2209848ea tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:46.655042 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7f24ea0d-c1f8-422a-b25e-0be2209848ea tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:46.655746 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7f24ea0d-c1f8-422a-b25e-0be2209848ea tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:46.656247 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7f24ea0d-c1f8-422a-b25e-0be2209848ea tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:46.712922 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-eabf9e59-7f20-48cf-99dd-a02d0b41800b tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:46.725588 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-eabf9e59-7f20-48cf-99dd-a02d0b41800b tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b" status: 200 len: 1506 microversion: 2.1 time: 0.278490 Aug 10 23:14:46.744473 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-7f24ea0d-c1f8-422a-b25e-0be2209848ea tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] 10.222.0.58 "GET /compute/v2.1/servers/325ce83e-53e6-4021-b1a1-548ff5057761/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.105882 Aug 10 23:14:46.745737 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1956/3781] 10.222.0.58 () {60 vars in 1337 bytes} [Wed Aug 10 23:14:46 2022] GET /compute/v2.1/servers/325ce83e-53e6-4021-b1a1-548ff5057761/os-instance-actions => generated 611 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 23:14:46.757961 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1825/3781] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:46 2022] GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b => generated 1506 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:46.761280 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-21568a81-06bd-4b2a-91e8-b05da77c2f25 tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:46.761807 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-21568a81-06bd-4b2a-91e8-b05da77c2f25 tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] [instance: 325ce83e-53e6-4021-b1a1-548ff5057761] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:46.768413 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-21568a81-06bd-4b2a-91e8-b05da77c2f25 tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:46.768914 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-21568a81-06bd-4b2a-91e8-b05da77c2f25 tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:46.769359 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-21568a81-06bd-4b2a-91e8-b05da77c2f25 tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:46.770080 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-21568a81-06bd-4b2a-91e8-b05da77c2f25 tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:46.770537 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-21568a81-06bd-4b2a-91e8-b05da77c2f25 tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:46.771014 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-21568a81-06bd-4b2a-91e8-b05da77c2f25 tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:46.787207 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-21568a81-06bd-4b2a-91e8-b05da77c2f25 tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] HTTP exception thrown: Instance 325ce83e-53e6-4021-b1a1-548ff5057761 could not be found. Aug 10 23:14:46.788932 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-21568a81-06bd-4b2a-91e8-b05da77c2f25 tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Request method failure captured: Aug 10 23:14:46.788932 n-d-850468-14 devstack@n-api.service[122633]: request: DELETE /compute/v2.1/servers/325ce83e-53e6-4021-b1a1-548ff5057761 HTTP/1.1 Aug 10 23:14:46.788932 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:14:46.788932 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:14:46.788932 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:14:46.788932 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:14:46.788932 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:14:46.788932 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:14:46.788932 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:14:46.788932 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:14:46.788932 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9DvI7xeHGNK4xT8osvkmyqHn-ae68VPc0SLTiT2AG5T5KfFmyji1cFBIcDrLt2wjYBLLfKiWR3-S-Ts9EPXiSfgmsb86rOgUwc7qIj4x8dyL_6vrCEQvWwku1CL_5IWj2268zugI19iYOUeeMX8SewPM9MP-NfQklRAfawUZFHmCTyE Aug 10 23:14:46.788932 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:14:46.788932 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:14:46.788932 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:14:46.788932 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:14:46.788932 n-d-850468-14 devstack@n-api.service[122633]: X-Openstack-Nova-Api-Version: 2.21 Aug 10 23:14:46.788932 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:14:46.788932 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:14:46.788932 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: ee72843cb8064834bdbc02d8a5417f71 Aug 10 23:14:46.788932 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1282257034 Aug 10 23:14:46.788932 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:14:46.788932 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:14:46.788932 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ee72843cb8064834bdbc02d8a5417f71"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ee72843cb8064834bdbc02d8a5417f71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ee72843cb8064834bdbc02d8a5417f71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ee72843cb8064834bdbc02d8a5417f71", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:14:46.788932 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-InstanceActionsV221TestJSON-1282257034 Aug 10 23:14:46.788932 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: ee72843cb8064834bdbc02d8a5417f71 Aug 10 23:14:46.788932 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1282257034 Aug 10 23:14:46.788932 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-InstanceActionsV221TestJSON-1282257034-project Aug 10 23:14:46.788932 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:14:46.788932 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:14:46.788932 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: c39eef3efd444a6d8192f405cba67f86 Aug 10 23:14:46.788932 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-InstanceActionsV221TestJSON-1282257034-project Aug 10 23:14:46.788932 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:14:46.788932 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance 325ce83e-53e6-4021-b1a1-548ff5057761 could not be found. Aug 10 23:14:46.788932 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': '325ce83e-53e6-4021-b1a1-548ff5057761'} Aug 10 23:14:46.788932 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:14:46.788932 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:14:46.788932 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:14:46.788932 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:14:46.788932 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:14:46.788932 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:14:46.788932 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:14:46.788932 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:14:46.788932 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:14:46.788932 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:14:46.788932 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 325ce83e-53e6-4021-b1a1-548ff5057761 could not be found. Aug 10 23:14:46.788932 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:14:46.788932 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:14:46.788932 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:14:46.788932 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:14:46.788932 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:14:46.788932 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:14:46.788932 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:14:46.788932 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:14:46.788932 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:14:46.788932 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:14:46.788932 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 23:14:46.788932 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 23:14:46.788932 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 23:14:46.788932 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 23:14:46.788932 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:14:46.788932 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:14:46.788932 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:14:46.788932 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:14:46.793020 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 325ce83e-53e6-4021-b1a1-548ff5057761 could not be found. Aug 10 23:14:46.793020 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:14:46.793020 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:14:46.793020 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:14:46.793020 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:14:46.793020 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:14:46.793020 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:14:46.793020 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:14:46.793020 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:14:46.793020 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 325ce83e-53e6-4021-b1a1-548ff5057761 could not be found. Aug 10 23:14:46.793020 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:14:46.793020 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-21568a81-06bd-4b2a-91e8-b05da77c2f25 tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Returning 404 to user: Instance 325ce83e-53e6-4021-b1a1-548ff5057761 could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:14:46.793020 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-21568a81-06bd-4b2a-91e8-b05da77c2f25 tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] 10.222.0.58 "DELETE /compute/v2.1/servers/325ce83e-53e6-4021-b1a1-548ff5057761" status: 404 len: 111 microversion: 2.21 time: 0.034408 Aug 10 23:14:46.793020 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1957/3782] 10.222.0.58 () {60 vars in 1280 bytes} [Wed Aug 10 23:14:46 2022] DELETE /compute/v2.1/servers/325ce83e-53e6-4021-b1a1-548ff5057761 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 10 23:14:46.800739 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-ba201e54-3248-4128-943b-5f37e66bfa5a tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:46.801599 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-ba201e54-3248-4128-943b-5f37e66bfa5a tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] [instance: 325ce83e-53e6-4021-b1a1-548ff5057761] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:46.809262 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ba201e54-3248-4128-943b-5f37e66bfa5a tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:46.810726 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ba201e54-3248-4128-943b-5f37e66bfa5a tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:46.811368 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ba201e54-3248-4128-943b-5f37e66bfa5a tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:46.812466 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ba201e54-3248-4128-943b-5f37e66bfa5a tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:46.813128 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ba201e54-3248-4128-943b-5f37e66bfa5a tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:46.813253 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-afc4ec2e-2ca1-4ef6-b50b-f4a6aa18420e tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1903191214", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "91d0258a-9486-4479-91e9-a6d9339a2e0a"}]}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:14:46.813834 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ba201e54-3248-4128-943b-5f37e66bfa5a tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:46.821973 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-afc4ec2e-2ca1-4ef6-b50b-f4a6aa18420e tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Request method failure captured: Aug 10 23:14:46.821973 n-d-850468-14 devstack@n-api.service[122633]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 10 23:14:46.821973 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:14:46.821973 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:14:46.821973 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:14:46.821973 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 235 Aug 10 23:14:46.821973 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:14:46.821973 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:14:46.821973 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:14:46.821973 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:14:46.821973 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9DuIKrfOsS8tKST0PsIPrvuNPfsVISfOPvUoe9ddkVcTJKj7rDjd3OuH9u-DTT1aypj1AUoUKtajD98eDOUOHSpPisBSdRlSCov30lHf1uZq-XZLyBIVg5kAG8-SuXk2s1TL7EnRcjjMARSkm95dZDnXaBXRT3M4f8UoMDwqu7xK7gQ Aug 10 23:14:46.821973 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:14:46.821973 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:14:46.821973 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:14:46.821973 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:14:46.821973 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:14:46.821973 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:14:46.821973 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: d11bbb3e87f4463787da56ab19108822 Aug 10 23:14:46.821973 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-ServersNegativeTestJSON-1216728002 Aug 10 23:14:46.821973 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:14:46.821973 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:14:46.821973 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d11bbb3e87f4463787da56ab19108822"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d11bbb3e87f4463787da56ab19108822"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d11bbb3e87f4463787da56ab19108822"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d11bbb3e87f4463787da56ab19108822", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:14:46.821973 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-ServersNegativeTestJSON-1216728002 Aug 10 23:14:46.821973 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: d11bbb3e87f4463787da56ab19108822 Aug 10 23:14:46.821973 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1216728002 Aug 10 23:14:46.821973 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-ServersNegativeTestJSON-1216728002-project Aug 10 23:14:46.821973 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:14:46.821973 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:14:46.821973 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: f284ec2a4bf546b58c1c1adaf880e1fb Aug 10 23:14:46.821973 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-ServersNegativeTestJSON-1216728002-project Aug 10 23:14:46.821973 n-d-850468-14 devstack@n-api.service[122633]: Aug 10 23:14:46.821973 n-d-850468-14 devstack@n-api.service[122633]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1903191214", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "91d0258a-9486-4479-91e9-a6d9339a2e0a"}]}} Aug 10 23:14:46.821973 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:14:46.821973 n-d-850468-14 devstack@n-api.service[122633]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Aug 10 23:14:46.821973 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1903191214', 'imageRef': '78ad8905-f66f-4733-8be9-2b260f1fabed', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': '91d0258a-9486-4479-91e9-a6d9339a2e0a'}]}}} Aug 10 23:14:46.821973 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:14:46.821973 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:14:46.821973 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Aug 10 23:14:46.821973 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi result = func(instance) Aug 10 23:14:46.821973 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 243, in is_ipv6 Aug 10 23:14:46.821973 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi address = ipaddress.IPv6Address(instance) Aug 10 23:14:46.821973 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1844, in __init__ Aug 10 23:14:46.821973 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Aug 10 23:14:46.821973 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1581, in _ip_int_from_string Aug 10 23:14:46.821973 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise AddressValueError(msg) Aug 10 23:14:46.821973 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: At least 3 parts expected in 'notvalid' Aug 10 23:14:46.821973 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:14:46.821973 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 10 23:14:46.821973 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:14:46.821973 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:14:46.821973 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 10 23:14:46.821973 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 10 23:14:46.821973 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 10 23:14:46.821973 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise error Aug 10 23:14:46.821973 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' Aug 10 23:14:46.821973 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:14:46.821973 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: Aug 10 23:14:46.821973 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} Aug 10 23:14:46.821973 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:14:46.821973 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 10 23:14:46.821973 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi 'notvalid' Aug 10 23:14:46.821973 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:14:46.821973 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:14:46.821973 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:14:46.821973 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:14:46.826434 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:14:46.826434 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:14:46.826434 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:14:46.826434 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:14:46.826434 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:14:46.826434 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:14:46.826434 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 23:14:46.826434 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 23:14:46.826434 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 10 23:14:46.826434 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 10 23:14:46.826434 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 10 23:14:46.826434 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 10 23:14:46.826434 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 10 23:14:46.826434 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 10 23:14:46.826434 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Aug 10 23:14:46.826434 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:14:46.826434 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:14:46.826434 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:14:46.826434 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:14:46.826434 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:14:46.826434 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:14:46.826434 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 10 23:14:46.826434 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 10 23:14:46.826434 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Aug 10 23:14:46.826434 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:14:46.826434 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-afc4ec2e-2ca1-4ef6-b50b-f4a6aa18420e tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:14:46.826434 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-afc4ec2e-2ca1-4ef6-b50b-f4a6aa18420e tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.015894 Aug 10 23:14:46.828809 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1958/3783] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 23:14:46 2022] POST /compute/v2.1/servers => generated 133 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 10 23:14:46.833169 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-78e61b5b-c08c-477d-b71c-336f34fd6430 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:46.833790 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-78e61b5b-c08c-477d-b71c-336f34fd6430 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:46.841019 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-ba201e54-3248-4128-943b-5f37e66bfa5a tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] HTTP exception thrown: Instance 325ce83e-53e6-4021-b1a1-548ff5057761 could not be found. Aug 10 23:14:46.843101 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-ba201e54-3248-4128-943b-5f37e66bfa5a tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Request method failure captured: Aug 10 23:14:46.843101 n-d-850468-14 devstack@n-api.service[122632]: request: GET /compute/v2.1/servers/325ce83e-53e6-4021-b1a1-548ff5057761 HTTP/1.1 Aug 10 23:14:46.843101 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:14:46.843101 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:14:46.843101 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:14:46.843101 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 23:14:46.843101 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:14:46.843101 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:14:46.843101 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:14:46.843101 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:14:46.843101 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9DvI7xeHGNK4xT8osvkmyqHn-ae68VPc0SLTiT2AG5T5KfFmyji1cFBIcDrLt2wjYBLLfKiWR3-S-Ts9EPXiSfgmsb86rOgUwc7qIj4x8dyL_6vrCEQvWwku1CL_5IWj2268zugI19iYOUeeMX8SewPM9MP-NfQklRAfawUZFHmCTyE Aug 10 23:14:46.843101 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:14:46.843101 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:14:46.843101 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:14:46.843101 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:14:46.843101 n-d-850468-14 devstack@n-api.service[122632]: X-Openstack-Nova-Api-Version: 2.21 Aug 10 23:14:46.843101 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:14:46.843101 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:14:46.843101 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: ee72843cb8064834bdbc02d8a5417f71 Aug 10 23:14:46.843101 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1282257034 Aug 10 23:14:46.843101 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:14:46.843101 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:14:46.843101 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ee72843cb8064834bdbc02d8a5417f71"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ee72843cb8064834bdbc02d8a5417f71"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ee72843cb8064834bdbc02d8a5417f71"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ee72843cb8064834bdbc02d8a5417f71", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:14:46.843101 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-InstanceActionsV221TestJSON-1282257034 Aug 10 23:14:46.843101 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: ee72843cb8064834bdbc02d8a5417f71 Aug 10 23:14:46.843101 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1282257034 Aug 10 23:14:46.843101 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-InstanceActionsV221TestJSON-1282257034-project Aug 10 23:14:46.843101 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:14:46.843101 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:14:46.843101 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: c39eef3efd444a6d8192f405cba67f86 Aug 10 23:14:46.843101 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-InstanceActionsV221TestJSON-1282257034-project Aug 10 23:14:46.843101 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:14:46.843101 n-d-850468-14 devstack@n-api.service[122632]: exception: Instance 325ce83e-53e6-4021-b1a1-548ff5057761 could not be found. Aug 10 23:14:46.843101 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': '325ce83e-53e6-4021-b1a1-548ff5057761'} Aug 10 23:14:46.843101 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:14:46.843101 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:14:46.843101 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:14:46.843101 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:14:46.843101 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:14:46.843101 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:14:46.843101 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:14:46.843101 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:14:46.843101 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:14:46.843101 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:14:46.843101 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 325ce83e-53e6-4021-b1a1-548ff5057761 could not be found. Aug 10 23:14:46.843101 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:14:46.843101 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:14:46.843101 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:14:46.843101 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:14:46.843101 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:14:46.843101 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:14:46.843101 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:14:46.843101 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:14:46.843101 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:14:46.843101 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:14:46.843101 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:14:46.843101 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:14:46.843101 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:14:46.843101 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:14:46.843101 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:14:46.843101 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:14:46.843101 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 325ce83e-53e6-4021-b1a1-548ff5057761 could not be found. Aug 10 23:14:46.843101 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:14:46.843101 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:14:46.847130 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:14:46.847130 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:14:46.847130 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:14:46.847130 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:14:46.847130 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:14:46.847130 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:14:46.847130 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 325ce83e-53e6-4021-b1a1-548ff5057761 could not be found. Aug 10 23:14:46.847130 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:14:46.847708 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-78e61b5b-c08c-477d-b71c-336f34fd6430 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:46.847708 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-78e61b5b-c08c-477d-b71c-336f34fd6430 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:46.847708 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-78e61b5b-c08c-477d-b71c-336f34fd6430 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:46.847708 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-78e61b5b-c08c-477d-b71c-336f34fd6430 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:46.847708 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-78e61b5b-c08c-477d-b71c-336f34fd6430 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:46.847708 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-78e61b5b-c08c-477d-b71c-336f34fd6430 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:46.862391 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-ba201e54-3248-4128-943b-5f37e66bfa5a tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] Returning 404 to user: Instance 325ce83e-53e6-4021-b1a1-548ff5057761 could not be found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:14:46.863811 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-ba201e54-3248-4128-943b-5f37e66bfa5a tempest-InstanceActionsV221TestJSON-1282257034 tempest-InstanceActionsV221TestJSON-1282257034-project] 10.222.0.58 "GET /compute/v2.1/servers/325ce83e-53e6-4021-b1a1-548ff5057761" status: 404 len: 111 microversion: 2.21 time: 0.067860 Aug 10 23:14:46.869146 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1826/3784] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:14:46 2022] GET /compute/v2.1/servers/325ce83e-53e6-4021-b1a1-548ff5057761 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 10 23:14:47.185834 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-e33a28a4-f26c-4ff5-9390-22c34d531401 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:47.187203 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-e33a28a4-f26c-4ff5-9390-22c34d531401 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] [instance: 7df225be-2dbc-4ef6-aeec-9a3de33a0006] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:47.194221 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e33a28a4-f26c-4ff5-9390-22c34d531401 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:47.194688 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e33a28a4-f26c-4ff5-9390-22c34d531401 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:47.195156 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e33a28a4-f26c-4ff5-9390-22c34d531401 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:47.195863 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e33a28a4-f26c-4ff5-9390-22c34d531401 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:47.196317 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e33a28a4-f26c-4ff5-9390-22c34d531401 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:47.196739 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e33a28a4-f26c-4ff5-9390-22c34d531401 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:47.370767 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-78e61b5b-c08c-477d-b71c-336f34fd6430 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:47.382979 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-78e61b5b-c08c-477d-b71c-336f34fd6430 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b" status: 200 len: 1506 microversion: 2.1 time: 0.553942 Aug 10 23:14:47.383797 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1959/3785] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:46 2022] GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b => generated 1506 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:47.404828 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-fb689979-1931-4197-8f2b-b0edf0b45584 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:47.405440 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-fb689979-1931-4197-8f2b-b0edf0b45584 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:47.412138 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fb689979-1931-4197-8f2b-b0edf0b45584 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:47.414335 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fb689979-1931-4197-8f2b-b0edf0b45584 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:47.414824 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fb689979-1931-4197-8f2b-b0edf0b45584 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:47.415548 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fb689979-1931-4197-8f2b-b0edf0b45584 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:47.416005 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fb689979-1931-4197-8f2b-b0edf0b45584 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:47.416419 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fb689979-1931-4197-8f2b-b0edf0b45584 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:47.438856 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-e33a28a4-f26c-4ff5-9390-22c34d531401 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07c94ebf0954cdea12b9a689538d96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395d7c4077e54c43bb95288db3942b0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:47.448927 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-e33a28a4-f26c-4ff5-9390-22c34d531401 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] 10.222.0.58 "GET /compute/v2.1/servers/7df225be-2dbc-4ef6-aeec-9a3de33a0006" status: 200 len: 1522 microversion: 2.1 time: 0.267912 Aug 10 23:14:47.464572 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1827/3786] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:47 2022] GET /compute/v2.1/servers/7df225be-2dbc-4ef6-aeec-9a3de33a0006 => generated 1522 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:14:47.470351 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-50aaf3a6-00c5-468d-bcf0-6d96451324ce tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:47.471470 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-50aaf3a6-00c5-468d-bcf0-6d96451324ce tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: 7a8f8d36-4744-43b7-9d42-e50fb5fabe60] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:47.478980 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-50aaf3a6-00c5-468d-bcf0-6d96451324ce tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:47.479688 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-50aaf3a6-00c5-468d-bcf0-6d96451324ce tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:47.480286 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-50aaf3a6-00c5-468d-bcf0-6d96451324ce tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:47.481179 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-50aaf3a6-00c5-468d-bcf0-6d96451324ce tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:47.481608 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-50aaf3a6-00c5-468d-bcf0-6d96451324ce tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:47.482190 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-50aaf3a6-00c5-468d-bcf0-6d96451324ce tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:47.512979 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:14:47.701662 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-50aaf3a6-00c5-468d-bcf0-6d96451324ce tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6160c7a42740efbe3613380933fa15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d90f8a58ad047fa8f347d6474e4d673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:47.710885 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-50aaf3a6-00c5-468d-bcf0-6d96451324ce tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "GET /compute/v2.1/servers/7a8f8d36-4744-43b7-9d42-e50fb5fabe60" status: 200 len: 1510 microversion: 2.1 time: 0.244629 Aug 10 23:14:47.711428 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1828/3787] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:47 2022] GET /compute/v2.1/servers/7a8f8d36-4744-43b7-9d42-e50fb5fabe60 => generated 1510 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:47.721031 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-0862f7e6-2d2b-478a-9149-6c95839998a7 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:47.721959 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-0862f7e6-2d2b-478a-9149-6c95839998a7 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: 1da4d99f-4cb0-4533-bda8-3bda03205e07] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:47.730417 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0862f7e6-2d2b-478a-9149-6c95839998a7 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:47.730925 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0862f7e6-2d2b-478a-9149-6c95839998a7 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:47.731532 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0862f7e6-2d2b-478a-9149-6c95839998a7 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:47.732235 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0862f7e6-2d2b-478a-9149-6c95839998a7 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:47.732882 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0862f7e6-2d2b-478a-9149-6c95839998a7 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:47.733306 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0862f7e6-2d2b-478a-9149-6c95839998a7 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:47.806847 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-fb689979-1931-4197-8f2b-b0edf0b45584 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:47.818106 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-fb689979-1931-4197-8f2b-b0edf0b45584 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b" status: 200 len: 1506 microversion: 2.1 time: 0.417072 Aug 10 23:14:47.820661 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1960/3788] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:47 2022] GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b => generated 1506 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:47.844241 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-efbc34ab-4c17-406a-8160-a45f1d5b0694 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:14:47.844977 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-efbc34ab-4c17-406a-8160-a45f1d5b0694 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 909d26d3-f677-4ebe-b185-e96def31f2c8] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:47.853687 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-efbc34ab-4c17-406a-8160-a45f1d5b0694 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] HTTP exception thrown: Instance 909d26d3-f677-4ebe-b185-e96def31f2c8 could not be found. Aug 10 23:14:47.863027 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-efbc34ab-4c17-406a-8160-a45f1d5b0694 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Request method failure captured: Aug 10 23:14:47.863027 n-d-850468-14 devstack@n-api.service[122633]: request: POST /compute/v2.1/servers/909d26d3-f677-4ebe-b185-e96def31f2c8/action HTTP/1.1 Aug 10 23:14:47.863027 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:14:47.863027 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:14:47.863027 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:14:47.863027 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 13 Aug 10 23:14:47.863027 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:14:47.863027 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:14:47.863027 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:14:47.863027 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:14:47.863027 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9DuIKrfOsS8tKST0PsIPrvuNPfsVISfOPvUoe9ddkVcTJKj7rDjd3OuH9u-DTT1aypj1AUoUKtajD98eDOUOHSpPisBSdRlSCov30lHf1uZq-XZLyBIVg5kAG8-SuXk2s1TL7EnRcjjMARSkm95dZDnXaBXRT3M4f8UoMDwqu7xK7gQ Aug 10 23:14:47.863027 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:14:47.863027 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:14:47.863027 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:14:47.863027 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:14:47.863027 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:14:47.863027 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:14:47.863027 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: d11bbb3e87f4463787da56ab19108822 Aug 10 23:14:47.863027 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-ServersNegativeTestJSON-1216728002 Aug 10 23:14:47.863027 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:14:47.863027 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:14:47.863027 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d11bbb3e87f4463787da56ab19108822"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d11bbb3e87f4463787da56ab19108822"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d11bbb3e87f4463787da56ab19108822"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d11bbb3e87f4463787da56ab19108822", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:14:47.863027 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-ServersNegativeTestJSON-1216728002 Aug 10 23:14:47.863027 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: d11bbb3e87f4463787da56ab19108822 Aug 10 23:14:47.863027 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1216728002 Aug 10 23:14:47.863027 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-ServersNegativeTestJSON-1216728002-project Aug 10 23:14:47.863027 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:14:47.863027 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:14:47.863027 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: f284ec2a4bf546b58c1c1adaf880e1fb Aug 10 23:14:47.863027 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-ServersNegativeTestJSON-1216728002-project Aug 10 23:14:47.863027 n-d-850468-14 devstack@n-api.service[122633]: Aug 10 23:14:47.863027 n-d-850468-14 devstack@n-api.service[122633]: {"pause": {}} Aug 10 23:14:47.863027 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:14:47.863027 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance 909d26d3-f677-4ebe-b185-e96def31f2c8 could not be found. Aug 10 23:14:47.863027 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': '909d26d3-f677-4ebe-b185-e96def31f2c8', 'body': {'pause': {}}} Aug 10 23:14:47.863027 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:14:47.863027 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:14:47.863027 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:14:47.863027 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:14:47.863027 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:14:47.863027 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:14:47.863027 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 10 23:14:47.863027 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 10 23:14:47.863027 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 909d26d3-f677-4ebe-b185-e96def31f2c8 could not be found. Aug 10 23:14:47.863027 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:14:47.863027 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:14:47.863027 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:14:47.863027 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:14:47.863027 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:14:47.863027 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:14:47.863027 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:14:47.863027 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:14:47.863027 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:14:47.863027 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:14:47.863027 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause Aug 10 23:14:47.863027 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Aug 10 23:14:47.863027 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:14:47.863027 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:14:47.863027 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 909d26d3-f677-4ebe-b185-e96def31f2c8 could not be found. Aug 10 23:14:47.863027 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:14:47.863027 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:14:47.863027 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:14:47.863027 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:14:47.863027 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:14:47.863027 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:14:47.871659 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:14:47.871659 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:14:47.871659 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 909d26d3-f677-4ebe-b185-e96def31f2c8 could not be found. Aug 10 23:14:47.871659 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:14:47.871659 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-efbc34ab-4c17-406a-8160-a45f1d5b0694 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Returning 404 to user: Instance 909d26d3-f677-4ebe-b185-e96def31f2c8 could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:14:47.871659 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-efbc34ab-4c17-406a-8160-a45f1d5b0694 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "POST /compute/v2.1/servers/909d26d3-f677-4ebe-b185-e96def31f2c8/action" status: 404 len: 111 microversion: 2.1 time: 0.025961 Aug 10 23:14:47.871659 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1961/3789] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:14:47 2022] POST /compute/v2.1/servers/909d26d3-f677-4ebe-b185-e96def31f2c8/action => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:14:47.874889 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-576f0b46-d61d-442d-bf68-e0ac73e1b22e tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:47.875665 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-576f0b46-d61d-442d-bf68-e0ac73e1b22e tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:47.884281 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-576f0b46-d61d-442d-bf68-e0ac73e1b22e tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:47.884778 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-576f0b46-d61d-442d-bf68-e0ac73e1b22e tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:47.885225 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-576f0b46-d61d-442d-bf68-e0ac73e1b22e tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:47.885932 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-576f0b46-d61d-442d-bf68-e0ac73e1b22e tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:47.886389 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-576f0b46-d61d-442d-bf68-e0ac73e1b22e tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:47.887202 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-576f0b46-d61d-442d-bf68-e0ac73e1b22e tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:48.009875 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-0862f7e6-2d2b-478a-9149-6c95839998a7 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:48.026328 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-0862f7e6-2d2b-478a-9149-6c95839998a7 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/1da4d99f-4cb0-4533-bda8-3bda03205e07" status: 200 len: 1315 microversion: 2.1 time: 0.313413 Aug 10 23:14:48.027325 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1829/3790] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:47 2022] GET /compute/v2.1/servers/1da4d99f-4cb0-4533-bda8-3bda03205e07 => generated 1315 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:48.206693 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-576f0b46-d61d-442d-bf68-e0ac73e1b22e tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:48.215625 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-576f0b46-d61d-442d-bf68-e0ac73e1b22e tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b" status: 200 len: 1506 microversion: 2.1 time: 0.344932 Aug 10 23:14:48.216313 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1962/3791] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:47 2022] GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b => generated 1506 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:14:48.239967 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-53abb3cf-e155-403b-b3ce-831f5720da70 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:48.239967 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-53abb3cf-e155-403b-b3ce-831f5720da70 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:48.246275 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-53abb3cf-e155-403b-b3ce-831f5720da70 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:48.246913 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-53abb3cf-e155-403b-b3ce-831f5720da70 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:48.247483 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-53abb3cf-e155-403b-b3ce-831f5720da70 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:48.248344 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-53abb3cf-e155-403b-b3ce-831f5720da70 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:48.249079 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-53abb3cf-e155-403b-b3ce-831f5720da70 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:48.249943 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-53abb3cf-e155-403b-b3ce-831f5720da70 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:48.475973 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-13b28d30-8d94-4dd2-894c-98a9fa5db9f6 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:48.476881 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-13b28d30-8d94-4dd2-894c-98a9fa5db9f6 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] [instance: 7df225be-2dbc-4ef6-aeec-9a3de33a0006] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:48.487784 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-53abb3cf-e155-403b-b3ce-831f5720da70 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:48.491936 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-13b28d30-8d94-4dd2-894c-98a9fa5db9f6 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:48.492925 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-13b28d30-8d94-4dd2-894c-98a9fa5db9f6 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:48.493839 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-13b28d30-8d94-4dd2-894c-98a9fa5db9f6 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:48.495482 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-13b28d30-8d94-4dd2-894c-98a9fa5db9f6 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:48.497738 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-13b28d30-8d94-4dd2-894c-98a9fa5db9f6 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:48.498444 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-13b28d30-8d94-4dd2-894c-98a9fa5db9f6 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:48.508646 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-53abb3cf-e155-403b-b3ce-831f5720da70 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b" status: 200 len: 1506 microversion: 2.1 time: 0.273072 Aug 10 23:14:48.512005 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1830/3792] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:48 2022] GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b => generated 1506 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:48.545308 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-869b8cd3-3058-47c0-b2fe-d9fb4ee80aed tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:14:48.546279 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-869b8cd3-3058-47c0-b2fe-d9fb4ee80aed tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:48.553582 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-869b8cd3-3058-47c0-b2fe-d9fb4ee80aed tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:48.554722 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-869b8cd3-3058-47c0-b2fe-d9fb4ee80aed tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:48.555526 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-869b8cd3-3058-47c0-b2fe-d9fb4ee80aed tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:48.556453 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-869b8cd3-3058-47c0-b2fe-d9fb4ee80aed tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:48.557138 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-869b8cd3-3058-47c0-b2fe-d9fb4ee80aed tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:48.557776 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-869b8cd3-3058-47c0-b2fe-d9fb4ee80aed tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:48.639349 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-869b8cd3-3058-47c0-b2fe-d9fb4ee80aed tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "POST /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b/action" status: 202 len: 0 microversion: 2.1 time: 0.100807 Aug 10 23:14:48.640409 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1831/3793] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:14:48 2022] POST /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b/action => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:14:48.650999 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-bc6fc785-684f-4183-b175-21e9ad21538b req-6132414a-2f4c-4ca0-9185-978d87aa8343 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "325ce83e-53e6-4021-b1a1-548ff5057761", "name": "network-vif-deleted", "tag": "9a221529-858a-43c9-af54-8f34801606f1"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:14:48.666627 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-bc6fc785-684f-4183-b175-21e9ad21538b req-6132414a-2f4c-4ca0-9185-978d87aa8343 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:48.667149 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-bc6fc785-684f-4183-b175-21e9ad21538b req-6132414a-2f4c-4ca0-9185-978d87aa8343 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:48.667924 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-bc6fc785-684f-4183-b175-21e9ad21538b req-6132414a-2f4c-4ca0-9185-978d87aa8343 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:48.681829 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-bc6fc785-684f-4183-b175-21e9ad21538b req-6132414a-2f4c-4ca0-9185-978d87aa8343 service nova] Creating event network-vif-deleted:9a221529-858a-43c9-af54-8f34801606f1 for instance 325ce83e-53e6-4021-b1a1-548ff5057761 on n-h2-850468-14 Aug 10 23:14:48.688437 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-bc6fc785-684f-4183-b175-21e9ad21538b req-6132414a-2f4c-4ca0-9185-978d87aa8343 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045707 Aug 10 23:14:48.689475 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1832/3794] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:14:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:14:48.697680 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-d934d708-2c9e-4bb4-9237-882b34cb694d tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:48.698382 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-d934d708-2c9e-4bb4-9237-882b34cb694d tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:48.706112 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d934d708-2c9e-4bb4-9237-882b34cb694d tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:48.706593 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d934d708-2c9e-4bb4-9237-882b34cb694d tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:48.707063 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d934d708-2c9e-4bb4-9237-882b34cb694d tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:48.707943 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d934d708-2c9e-4bb4-9237-882b34cb694d tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:48.708522 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d934d708-2c9e-4bb4-9237-882b34cb694d tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:48.709077 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d934d708-2c9e-4bb4-9237-882b34cb694d tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:48.929179 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-d934d708-2c9e-4bb4-9237-882b34cb694d tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:48.939025 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-d934d708-2c9e-4bb4-9237-882b34cb694d tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b" status: 200 len: 1511 microversion: 2.1 time: 0.247498 Aug 10 23:14:48.951257 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1833/3795] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:48 2022] GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b => generated 1511 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:48.951257 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-28da7c9e-f3bd-4519-b9d4-711e8a296757 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:48.951257 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-28da7c9e-f3bd-4519-b9d4-711e8a296757 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: 7a8f8d36-4744-43b7-9d42-e50fb5fabe60] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:48.962136 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-28da7c9e-f3bd-4519-b9d4-711e8a296757 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:48.965044 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-28da7c9e-f3bd-4519-b9d4-711e8a296757 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:48.965044 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-28da7c9e-f3bd-4519-b9d4-711e8a296757 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:48.966097 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-28da7c9e-f3bd-4519-b9d4-711e8a296757 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:48.966543 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-28da7c9e-f3bd-4519-b9d4-711e8a296757 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:48.967018 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-28da7c9e-f3bd-4519-b9d4-711e8a296757 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:49.023401 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-13b28d30-8d94-4dd2-894c-98a9fa5db9f6 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07c94ebf0954cdea12b9a689538d96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395d7c4077e54c43bb95288db3942b0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:49.032136 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-13b28d30-8d94-4dd2-894c-98a9fa5db9f6 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] 10.222.0.58 "GET /compute/v2.1/servers/7df225be-2dbc-4ef6-aeec-9a3de33a0006" status: 200 len: 1522 microversion: 2.1 time: 0.561892 Aug 10 23:14:49.032723 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1963/3796] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:48 2022] GET /compute/v2.1/servers/7df225be-2dbc-4ef6-aeec-9a3de33a0006 => generated 1522 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:14:49.051080 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-6aa4c49b-099c-405e-8b27-8d9d928ffb4d tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:49.051707 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-6aa4c49b-099c-405e-8b27-8d9d928ffb4d tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: 1da4d99f-4cb0-4533-bda8-3bda03205e07] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:49.059693 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6aa4c49b-099c-405e-8b27-8d9d928ffb4d tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:49.060326 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6aa4c49b-099c-405e-8b27-8d9d928ffb4d tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:49.061040 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6aa4c49b-099c-405e-8b27-8d9d928ffb4d tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:49.061749 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6aa4c49b-099c-405e-8b27-8d9d928ffb4d tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:49.062208 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6aa4c49b-099c-405e-8b27-8d9d928ffb4d tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:49.063208 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6aa4c49b-099c-405e-8b27-8d9d928ffb4d tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:49.217944 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-28da7c9e-f3bd-4519-b9d4-711e8a296757 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6160c7a42740efbe3613380933fa15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d90f8a58ad047fa8f347d6474e4d673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:49.227469 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-28da7c9e-f3bd-4519-b9d4-711e8a296757 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "GET /compute/v2.1/servers/7a8f8d36-4744-43b7-9d42-e50fb5fabe60" status: 200 len: 1510 microversion: 2.1 time: 0.286313 Aug 10 23:14:49.228312 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1834/3797] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:48 2022] GET /compute/v2.1/servers/7a8f8d36-4744-43b7-9d42-e50fb5fabe60 => generated 1510 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:49.782254 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-6aa4c49b-099c-405e-8b27-8d9d928ffb4d tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:49.791678 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-6aa4c49b-099c-405e-8b27-8d9d928ffb4d tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/1da4d99f-4cb0-4533-bda8-3bda03205e07" status: 200 len: 1315 microversion: 2.1 time: 0.747133 Aug 10 23:14:49.805411 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1964/3798] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:49 2022] GET /compute/v2.1/servers/1da4d99f-4cb0-4533-bda8-3bda03205e07 => generated 1315 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:14:49.961441 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-7e43b997-05cc-4893-bc97-ce1de47cdd40 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:49.962201 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-7e43b997-05cc-4893-bc97-ce1de47cdd40 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:49.968088 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=2 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:14:49.968648 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=6 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:14:50.000876 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7e43b997-05cc-4893-bc97-ce1de47cdd40 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:50.000974 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7e43b997-05cc-4893-bc97-ce1de47cdd40 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:50.002848 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7e43b997-05cc-4893-bc97-ce1de47cdd40 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:50.003844 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7e43b997-05cc-4893-bc97-ce1de47cdd40 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:50.016765 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7e43b997-05cc-4893-bc97-ce1de47cdd40 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:50.018602 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7e43b997-05cc-4893-bc97-ce1de47cdd40 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:50.055536 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-a1b41e70-63a1-46bf-9a13-421ed6eb3a02 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:50.057299 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-a1b41e70-63a1-46bf-9a13-421ed6eb3a02 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] [instance: 7df225be-2dbc-4ef6-aeec-9a3de33a0006] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:50.070324 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=2 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:14:50.073589 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a1b41e70-63a1-46bf-9a13-421ed6eb3a02 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:50.074267 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a1b41e70-63a1-46bf-9a13-421ed6eb3a02 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:50.075633 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a1b41e70-63a1-46bf-9a13-421ed6eb3a02 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:50.078070 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a1b41e70-63a1-46bf-9a13-421ed6eb3a02 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:50.081060 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a1b41e70-63a1-46bf-9a13-421ed6eb3a02 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:50.081750 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a1b41e70-63a1-46bf-9a13-421ed6eb3a02 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:50.126343 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:14:50.411412 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-a1b41e70-63a1-46bf-9a13-421ed6eb3a02 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07c94ebf0954cdea12b9a689538d96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395d7c4077e54c43bb95288db3942b0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:50.423101 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-a1b41e70-63a1-46bf-9a13-421ed6eb3a02 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] 10.222.0.58 "GET /compute/v2.1/servers/7df225be-2dbc-4ef6-aeec-9a3de33a0006" status: 200 len: 1522 microversion: 2.1 time: 0.372134 Aug 10 23:14:50.438612 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1965/3799] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:50 2022] GET /compute/v2.1/servers/7df225be-2dbc-4ef6-aeec-9a3de33a0006 => generated 1522 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:50.444241 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-8b0bc453-6699-4780-9b8b-bd2dcd4c5f3c tempest-TestNetworkAdvancedServerOps-1638906998 tempest-TestNetworkAdvancedServerOps-1638906998-project-admin] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:50.445212 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-8b0bc453-6699-4780-9b8b-bd2dcd4c5f3c tempest-TestNetworkAdvancedServerOps-1638906998 tempest-TestNetworkAdvancedServerOps-1638906998-project-admin] [instance: f4dc6241-b173-4cbf-b76c-7da3fac7edcc] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:50.450153 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-7e43b997-05cc-4893-bc97-ce1de47cdd40 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:50.452435 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8b0bc453-6699-4780-9b8b-bd2dcd4c5f3c tempest-TestNetworkAdvancedServerOps-1638906998 tempest-TestNetworkAdvancedServerOps-1638906998-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:50.453113 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8b0bc453-6699-4780-9b8b-bd2dcd4c5f3c tempest-TestNetworkAdvancedServerOps-1638906998 tempest-TestNetworkAdvancedServerOps-1638906998-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:50.453717 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8b0bc453-6699-4780-9b8b-bd2dcd4c5f3c tempest-TestNetworkAdvancedServerOps-1638906998 tempest-TestNetworkAdvancedServerOps-1638906998-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:50.455161 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8b0bc453-6699-4780-9b8b-bd2dcd4c5f3c tempest-TestNetworkAdvancedServerOps-1638906998 tempest-TestNetworkAdvancedServerOps-1638906998-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:50.455786 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8b0bc453-6699-4780-9b8b-bd2dcd4c5f3c tempest-TestNetworkAdvancedServerOps-1638906998 tempest-TestNetworkAdvancedServerOps-1638906998-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:50.456212 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8b0bc453-6699-4780-9b8b-bd2dcd4c5f3c tempest-TestNetworkAdvancedServerOps-1638906998 tempest-TestNetworkAdvancedServerOps-1638906998-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:50.466403 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-7e43b997-05cc-4893-bc97-ce1de47cdd40 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b" status: 200 len: 1491 microversion: 2.1 time: 0.509272 Aug 10 23:14:50.470164 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1835/3800] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:49 2022] GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b => generated 1491 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:50.480973 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-bef5087c-78e7-4407-9305-454945857bd2 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:50.481688 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-bef5087c-78e7-4407-9305-454945857bd2 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: 7a8f8d36-4744-43b7-9d42-e50fb5fabe60] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:50.501193 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bef5087c-78e7-4407-9305-454945857bd2 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:50.501691 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bef5087c-78e7-4407-9305-454945857bd2 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:50.502132 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bef5087c-78e7-4407-9305-454945857bd2 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:50.502861 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bef5087c-78e7-4407-9305-454945857bd2 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:50.503319 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bef5087c-78e7-4407-9305-454945857bd2 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:50.503742 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bef5087c-78e7-4407-9305-454945857bd2 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:50.742518 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-8b0bc453-6699-4780-9b8b-bd2dcd4c5f3c tempest-TestNetworkAdvancedServerOps-1638906998 tempest-TestNetworkAdvancedServerOps-1638906998-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/f4dc6241-b173-4cbf-b76c-7da3fac7edcc" status: 200 len: 1834 microversion: 2.1 time: 0.302450 Aug 10 23:14:50.744112 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1966/3801] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:50 2022] GET /compute/v2.1/servers/f4dc6241-b173-4cbf-b76c-7da3fac7edcc => generated 1834 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:50.750371 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-f88cb856-8211-49e9-ab94-4cf8bbfa1c44 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:14:50.751144 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-f88cb856-8211-49e9-ab94-4cf8bbfa1c44 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:50.759730 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f88cb856-8211-49e9-ab94-4cf8bbfa1c44 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:50.760722 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f88cb856-8211-49e9-ab94-4cf8bbfa1c44 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:50.761375 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f88cb856-8211-49e9-ab94-4cf8bbfa1c44 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:50.762244 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f88cb856-8211-49e9-ab94-4cf8bbfa1c44 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:50.762881 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f88cb856-8211-49e9-ab94-4cf8bbfa1c44 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:50.763560 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f88cb856-8211-49e9-ab94-4cf8bbfa1c44 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:50.802164 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-f88cb856-8211-49e9-ab94-4cf8bbfa1c44 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] HTTP exception thrown: Cannot 'pause' instance 23bbe055-4a92-4b96-8b89-c941229bfb0b while it is in vm_state paused Aug 10 23:14:50.804219 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-f88cb856-8211-49e9-ab94-4cf8bbfa1c44 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Request method failure captured: Aug 10 23:14:50.804219 n-d-850468-14 devstack@n-api.service[122633]: request: POST /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b/action HTTP/1.1 Aug 10 23:14:50.804219 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:14:50.804219 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:14:50.804219 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:14:50.804219 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 13 Aug 10 23:14:50.804219 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:14:50.804219 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:14:50.804219 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:14:50.804219 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:14:50.804219 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9DuIKrfOsS8tKST0PsIPrvuNPfsVISfOPvUoe9ddkVcTJKj7rDjd3OuH9u-DTT1aypj1AUoUKtajD98eDOUOHSpPisBSdRlSCov30lHf1uZq-XZLyBIVg5kAG8-SuXk2s1TL7EnRcjjMARSkm95dZDnXaBXRT3M4f8UoMDwqu7xK7gQ Aug 10 23:14:50.804219 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:14:50.804219 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:14:50.804219 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:14:50.804219 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:14:50.804219 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:14:50.804219 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:14:50.804219 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: d11bbb3e87f4463787da56ab19108822 Aug 10 23:14:50.804219 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-ServersNegativeTestJSON-1216728002 Aug 10 23:14:50.804219 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:14:50.804219 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:14:50.804219 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d11bbb3e87f4463787da56ab19108822"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d11bbb3e87f4463787da56ab19108822"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d11bbb3e87f4463787da56ab19108822"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d11bbb3e87f4463787da56ab19108822", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:14:50.804219 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-ServersNegativeTestJSON-1216728002 Aug 10 23:14:50.804219 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: d11bbb3e87f4463787da56ab19108822 Aug 10 23:14:50.804219 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1216728002 Aug 10 23:14:50.804219 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-ServersNegativeTestJSON-1216728002-project Aug 10 23:14:50.804219 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:14:50.804219 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:14:50.804219 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: f284ec2a4bf546b58c1c1adaf880e1fb Aug 10 23:14:50.804219 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-ServersNegativeTestJSON-1216728002-project Aug 10 23:14:50.804219 n-d-850468-14 devstack@n-api.service[122633]: Aug 10 23:14:50.804219 n-d-850468-14 devstack@n-api.service[122633]: {"pause": {}} Aug 10 23:14:50.804219 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:14:50.804219 n-d-850468-14 devstack@n-api.service[122633]: exception: Cannot 'pause' instance 23bbe055-4a92-4b96-8b89-c941229bfb0b while it is in vm_state paused Aug 10 23:14:50.804219 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': '23bbe055-4a92-4b96-8b89-c941229bfb0b', 'body': {'pause': {}}} Aug 10 23:14:50.804219 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:14:50.804219 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:14:50.804219 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause Aug 10 23:14:50.804219 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) Aug 10 23:14:50.804219 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 10 23:14:50.804219 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 10 23:14:50.804219 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 10 23:14:50.804219 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 10 23:14:50.804219 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 23bbe055-4a92-4b96-8b89-c941229bfb0b in vm_state paused. Cannot pause while the instance is in this state. Aug 10 23:14:50.804219 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:14:50.804219 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:14:50.804219 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:14:50.804219 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:14:50.804219 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:14:50.804219 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:14:50.804219 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:14:50.804219 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:14:50.804219 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:14:50.804219 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:14:50.804219 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause Aug 10 23:14:50.804219 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 10 23:14:50.804219 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 10 23:14:50.804219 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 10 23:14:50.804219 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance 23bbe055-4a92-4b96-8b89-c941229bfb0b while it is in vm_state paused Aug 10 23:14:50.804219 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:14:50.804219 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:14:50.804219 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:14:50.804219 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:14:50.804219 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:14:50.808973 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:14:50.808973 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:14:50.808973 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:14:50.808973 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance 23bbe055-4a92-4b96-8b89-c941229bfb0b while it is in vm_state paused Aug 10 23:14:50.808973 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:14:50.811624 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-f88cb856-8211-49e9-ab94-4cf8bbfa1c44 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Returning 409 to user: Cannot 'pause' instance 23bbe055-4a92-4b96-8b89-c941229bfb0b while it is in vm_state paused {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:14:50.812515 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-f88cb856-8211-49e9-ab94-4cf8bbfa1c44 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "POST /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b/action" status: 409 len: 143 microversion: 2.1 time: 0.067229 Aug 10 23:14:50.813828 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1967/3802] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:14:50 2022] POST /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b/action => generated 143 bytes in 68 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 10 23:14:50.817719 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-44ea2d83-d994-4482-bcd6-1559273c33fe tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:50.818332 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-44ea2d83-d994-4482-bcd6-1559273c33fe tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: 1da4d99f-4cb0-4533-bda8-3bda03205e07] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:50.838353 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-44ea2d83-d994-4482-bcd6-1559273c33fe tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:50.839319 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-44ea2d83-d994-4482-bcd6-1559273c33fe tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:50.840131 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-44ea2d83-d994-4482-bcd6-1559273c33fe tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:50.841376 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-44ea2d83-d994-4482-bcd6-1559273c33fe tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:50.842279 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-44ea2d83-d994-4482-bcd6-1559273c33fe tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:50.844144 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-44ea2d83-d994-4482-bcd6-1559273c33fe tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:50.907445 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-bef5087c-78e7-4407-9305-454945857bd2 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6160c7a42740efbe3613380933fa15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d90f8a58ad047fa8f347d6474e4d673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:50.916440 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-bef5087c-78e7-4407-9305-454945857bd2 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "GET /compute/v2.1/servers/7a8f8d36-4744-43b7-9d42-e50fb5fabe60" status: 200 len: 1510 microversion: 2.1 time: 0.445151 Aug 10 23:14:50.925645 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1836/3803] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:50 2022] GET /compute/v2.1/servers/7a8f8d36-4744-43b7-9d42-e50fb5fabe60 => generated 1510 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:50.933539 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-6372845d-def5-4ca8-a9bd-1441e925546a tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:14:50.934284 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-6372845d-def5-4ca8-a9bd-1441e925546a tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:50.954633 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6372845d-def5-4ca8-a9bd-1441e925546a tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:50.954955 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6372845d-def5-4ca8-a9bd-1441e925546a tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:50.955279 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6372845d-def5-4ca8-a9bd-1441e925546a tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:50.955988 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6372845d-def5-4ca8-a9bd-1441e925546a tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:50.956440 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6372845d-def5-4ca8-a9bd-1441e925546a tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:50.956865 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6372845d-def5-4ca8-a9bd-1441e925546a tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:51.089475 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-6372845d-def5-4ca8-a9bd-1441e925546a tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "POST /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b/action" status: 202 len: 0 microversion: 2.1 time: 0.161606 Aug 10 23:14:51.092117 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1837/3804] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:14:50 2022] POST /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b/action => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:14:51.112443 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-b9c36de3-3c04-4dc8-9f58-c35d91c6db4e tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:51.118258 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-b9c36de3-3c04-4dc8-9f58-c35d91c6db4e tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:51.154536 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b9c36de3-3c04-4dc8-9f58-c35d91c6db4e tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:51.155131 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b9c36de3-3c04-4dc8-9f58-c35d91c6db4e tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:51.158873 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b9c36de3-3c04-4dc8-9f58-c35d91c6db4e tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:51.159762 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b9c36de3-3c04-4dc8-9f58-c35d91c6db4e tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:51.163019 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b9c36de3-3c04-4dc8-9f58-c35d91c6db4e tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:51.163019 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b9c36de3-3c04-4dc8-9f58-c35d91c6db4e tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:51.394907 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-44ea2d83-d994-4482-bcd6-1559273c33fe tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:51.404682 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-44ea2d83-d994-4482-bcd6-1559273c33fe tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/1da4d99f-4cb0-4533-bda8-3bda03205e07" status: 200 len: 1315 microversion: 2.1 time: 0.590478 Aug 10 23:14:51.415498 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1968/3805] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:50 2022] GET /compute/v2.1/servers/1da4d99f-4cb0-4533-bda8-3bda03205e07 => generated 1315 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:51.446662 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-87055b81-7878-4796-a1e0-4d270151224e tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:51.447593 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-87055b81-7878-4796-a1e0-4d270151224e tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] [instance: 7df225be-2dbc-4ef6-aeec-9a3de33a0006] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:51.456209 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-87055b81-7878-4796-a1e0-4d270151224e tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:51.456967 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-87055b81-7878-4796-a1e0-4d270151224e tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:51.457586 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-87055b81-7878-4796-a1e0-4d270151224e tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:51.458492 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-87055b81-7878-4796-a1e0-4d270151224e tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:51.459139 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-87055b81-7878-4796-a1e0-4d270151224e tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:51.459769 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-87055b81-7878-4796-a1e0-4d270151224e tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:51.750499 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-b9c36de3-3c04-4dc8-9f58-c35d91c6db4e tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:51.767076 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-b9c36de3-3c04-4dc8-9f58-c35d91c6db4e tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b" status: 200 len: 1498 microversion: 2.1 time: 0.670402 Aug 10 23:14:51.770669 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1838/3806] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:51 2022] GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b => generated 1498 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:51.934602 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-87055b81-7878-4796-a1e0-4d270151224e tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07c94ebf0954cdea12b9a689538d96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395d7c4077e54c43bb95288db3942b0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:51.938814 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c39a9681-d508-413d-b70d-ec56713fdf06 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:51.939076 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-c39a9681-d508-413d-b70d-ec56713fdf06 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: 7a8f8d36-4744-43b7-9d42-e50fb5fabe60] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:51.945152 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-87055b81-7878-4796-a1e0-4d270151224e tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] 10.222.0.58 "GET /compute/v2.1/servers/7df225be-2dbc-4ef6-aeec-9a3de33a0006" status: 200 len: 1522 microversion: 2.1 time: 0.503587 Aug 10 23:14:51.945948 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1969/3807] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:51 2022] GET /compute/v2.1/servers/7df225be-2dbc-4ef6-aeec-9a3de33a0006 => generated 1522 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:14:51.950032 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c39a9681-d508-413d-b70d-ec56713fdf06 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:51.951141 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c39a9681-d508-413d-b70d-ec56713fdf06 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:51.951721 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c39a9681-d508-413d-b70d-ec56713fdf06 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:51.952588 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c39a9681-d508-413d-b70d-ec56713fdf06 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:51.953176 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c39a9681-d508-413d-b70d-ec56713fdf06 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:51.953752 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c39a9681-d508-413d-b70d-ec56713fdf06 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:52.309328 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-c39a9681-d508-413d-b70d-ec56713fdf06 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6160c7a42740efbe3613380933fa15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d90f8a58ad047fa8f347d6474e4d673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:52.321920 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-c39a9681-d508-413d-b70d-ec56713fdf06 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "GET /compute/v2.1/servers/7a8f8d36-4744-43b7-9d42-e50fb5fabe60" status: 200 len: 1510 microversion: 2.1 time: 0.388148 Aug 10 23:14:52.322833 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1839/3808] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:51 2022] GET /compute/v2.1/servers/7a8f8d36-4744-43b7-9d42-e50fb5fabe60 => generated 1510 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:14:52.429046 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-26213610-fb25-4038-b2ed-68e8696a2756 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:52.429880 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-26213610-fb25-4038-b2ed-68e8696a2756 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: 1da4d99f-4cb0-4533-bda8-3bda03205e07] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:52.442651 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-26213610-fb25-4038-b2ed-68e8696a2756 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:52.444858 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-26213610-fb25-4038-b2ed-68e8696a2756 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:52.445861 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-26213610-fb25-4038-b2ed-68e8696a2756 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:52.446931 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-26213610-fb25-4038-b2ed-68e8696a2756 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:52.447613 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-26213610-fb25-4038-b2ed-68e8696a2756 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:52.448255 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-26213610-fb25-4038-b2ed-68e8696a2756 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:52.799470 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-fa3e9833-bec6-4d1f-b3e8-c0d84f9fd28a tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:52.800953 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-fa3e9833-bec6-4d1f-b3e8-c0d84f9fd28a tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:52.818662 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fa3e9833-bec6-4d1f-b3e8-c0d84f9fd28a tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:52.819936 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fa3e9833-bec6-4d1f-b3e8-c0d84f9fd28a tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:52.820966 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fa3e9833-bec6-4d1f-b3e8-c0d84f9fd28a tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:52.823337 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fa3e9833-bec6-4d1f-b3e8-c0d84f9fd28a tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:52.824448 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fa3e9833-bec6-4d1f-b3e8-c0d84f9fd28a tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:52.825562 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fa3e9833-bec6-4d1f-b3e8-c0d84f9fd28a tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:52.981709 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-26213610-fb25-4038-b2ed-68e8696a2756 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:52.996669 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-26213610-fb25-4038-b2ed-68e8696a2756 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/1da4d99f-4cb0-4533-bda8-3bda03205e07" status: 200 len: 1315 microversion: 2.1 time: 0.571652 Aug 10 23:14:53.011007 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1970/3809] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:52 2022] GET /compute/v2.1/servers/1da4d99f-4cb0-4533-bda8-3bda03205e07 => generated 1315 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:53.017873 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-7a139e54-2a43-4867-a76f-9b290b72519b req-c2bf24a7-5ae5-4d3b-870d-47091d768f1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1da4d99f-4cb0-4533-bda8-3bda03205e07", "name": "network-vif-plugged", "status": "completed", "tag": "00538a30-d023-4ceb-a5db-4e41b89bea2b"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:14:53.033264 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-7a139e54-2a43-4867-a76f-9b290b72519b req-c2bf24a7-5ae5-4d3b-870d-47091d768f1a service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:53.034769 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-7a139e54-2a43-4867-a76f-9b290b72519b req-c2bf24a7-5ae5-4d3b-870d-47091d768f1a service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:53.036634 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-7a139e54-2a43-4867-a76f-9b290b72519b req-c2bf24a7-5ae5-4d3b-870d-47091d768f1a service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:53.060872 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-7a139e54-2a43-4867-a76f-9b290b72519b req-c2bf24a7-5ae5-4d3b-870d-47091d768f1a service nova] Creating event network-vif-plugged:00538a30-d023-4ceb-a5db-4e41b89bea2b for instance 1da4d99f-4cb0-4533-bda8-3bda03205e07 on n-h1-850468-14 Aug 10 23:14:53.068467 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-7a139e54-2a43-4867-a76f-9b290b72519b req-c2bf24a7-5ae5-4d3b-870d-47091d768f1a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054851 Aug 10 23:14:53.069850 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1971/3810] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:14:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:14:53.080599 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-4c1d0d02-390e-4ab5-ac58-a6db9d804312 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:53.082119 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-4c1d0d02-390e-4ab5-ac58-a6db9d804312 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] [instance: 7df225be-2dbc-4ef6-aeec-9a3de33a0006] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:53.098828 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4c1d0d02-390e-4ab5-ac58-a6db9d804312 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:53.099339 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4c1d0d02-390e-4ab5-ac58-a6db9d804312 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:53.099879 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4c1d0d02-390e-4ab5-ac58-a6db9d804312 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:53.100706 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4c1d0d02-390e-4ab5-ac58-a6db9d804312 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:53.101444 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4c1d0d02-390e-4ab5-ac58-a6db9d804312 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:53.101732 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4c1d0d02-390e-4ab5-ac58-a6db9d804312 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:53.372210 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-fa3e9833-bec6-4d1f-b3e8-c0d84f9fd28a tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:53.385587 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-fa3e9833-bec6-4d1f-b3e8-c0d84f9fd28a tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b" status: 200 len: 1506 microversion: 2.1 time: 0.595240 Aug 10 23:14:53.389349 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1840/3811] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:52 2022] GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b => generated 1506 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:14:53.398750 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-f853981b-2567-441e-a1fa-a0d3a67029d5 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:53.398750 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-f853981b-2567-441e-a1fa-a0d3a67029d5 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: 7a8f8d36-4744-43b7-9d42-e50fb5fabe60] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:53.407438 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f853981b-2567-441e-a1fa-a0d3a67029d5 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:53.408104 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f853981b-2567-441e-a1fa-a0d3a67029d5 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:53.408664 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f853981b-2567-441e-a1fa-a0d3a67029d5 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:53.409510 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f853981b-2567-441e-a1fa-a0d3a67029d5 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:53.410083 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f853981b-2567-441e-a1fa-a0d3a67029d5 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:53.411196 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f853981b-2567-441e-a1fa-a0d3a67029d5 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:53.747752 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-4c1d0d02-390e-4ab5-ac58-a6db9d804312 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07c94ebf0954cdea12b9a689538d96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395d7c4077e54c43bb95288db3942b0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:53.761327 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-4c1d0d02-390e-4ab5-ac58-a6db9d804312 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] 10.222.0.58 "GET /compute/v2.1/servers/7df225be-2dbc-4ef6-aeec-9a3de33a0006" status: 200 len: 1522 microversion: 2.1 time: 0.685660 Aug 10 23:14:53.761926 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1972/3812] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:53 2022] GET /compute/v2.1/servers/7df225be-2dbc-4ef6-aeec-9a3de33a0006 => generated 1522 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:53.767025 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-e56d9b41-d164-4b6d-ac55-6cc5fd04a721 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:53.767635 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-e56d9b41-d164-4b6d-ac55-6cc5fd04a721 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:53.770626 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_api:SELECT=100 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:14:53.777510 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e56d9b41-d164-4b6d-ac55-6cc5fd04a721 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:53.777962 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e56d9b41-d164-4b6d-ac55-6cc5fd04a721 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:53.778399 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e56d9b41-d164-4b6d-ac55-6cc5fd04a721 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:53.779134 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e56d9b41-d164-4b6d-ac55-6cc5fd04a721 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:53.779590 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e56d9b41-d164-4b6d-ac55-6cc5fd04a721 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:53.780016 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e56d9b41-d164-4b6d-ac55-6cc5fd04a721 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:53.922436 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-f853981b-2567-441e-a1fa-a0d3a67029d5 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6160c7a42740efbe3613380933fa15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d90f8a58ad047fa8f347d6474e4d673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:53.932764 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-f853981b-2567-441e-a1fa-a0d3a67029d5 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "GET /compute/v2.1/servers/7a8f8d36-4744-43b7-9d42-e50fb5fabe60" status: 200 len: 1510 microversion: 2.1 time: 0.541933 Aug 10 23:14:53.935788 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1841/3813] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:53 2022] GET /compute/v2.1/servers/7a8f8d36-4744-43b7-9d42-e50fb5fabe60 => generated 1510 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:54.024553 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-fb157c00-26d7-4a43-82ad-a478090dd592 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:54.025288 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-fb157c00-26d7-4a43-82ad-a478090dd592 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: 1da4d99f-4cb0-4533-bda8-3bda03205e07] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:54.033209 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fb157c00-26d7-4a43-82ad-a478090dd592 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:54.033806 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fb157c00-26d7-4a43-82ad-a478090dd592 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:54.034319 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fb157c00-26d7-4a43-82ad-a478090dd592 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:54.035376 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fb157c00-26d7-4a43-82ad-a478090dd592 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:54.035952 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fb157c00-26d7-4a43-82ad-a478090dd592 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:54.036454 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fb157c00-26d7-4a43-82ad-a478090dd592 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:54.157645 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-e56d9b41-d164-4b6d-ac55-6cc5fd04a721 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:54.175940 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-e56d9b41-d164-4b6d-ac55-6cc5fd04a721 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b" status: 200 len: 1506 microversion: 2.1 time: 0.412339 Aug 10 23:14:54.179529 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1973/3814] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:53 2022] GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b => generated 1506 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:54.206010 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-33e2dbb6-b07e-4f37-95b4-f8dcdc64780c tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:14:54.208125 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-33e2dbb6-b07e-4f37-95b4-f8dcdc64780c tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 6dc592cb-94c7-4918-8103-023db604fd70] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:54.225068 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-33e2dbb6-b07e-4f37-95b4-f8dcdc64780c tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:54.225784 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-33e2dbb6-b07e-4f37-95b4-f8dcdc64780c tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:54.226298 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-33e2dbb6-b07e-4f37-95b4-f8dcdc64780c tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:54.227001 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-33e2dbb6-b07e-4f37-95b4-f8dcdc64780c tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:54.227805 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-33e2dbb6-b07e-4f37-95b4-f8dcdc64780c tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:54.228407 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-33e2dbb6-b07e-4f37-95b4-f8dcdc64780c tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:54.251858 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-33e2dbb6-b07e-4f37-95b4-f8dcdc64780c tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] HTTP exception thrown: Instance 6dc592cb-94c7-4918-8103-023db604fd70 could not be found. Aug 10 23:14:54.261893 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-33e2dbb6-b07e-4f37-95b4-f8dcdc64780c tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Request method failure captured: Aug 10 23:14:54.261893 n-d-850468-14 devstack@n-api.service[122633]: request: POST /compute/v2.1/servers/6dc592cb-94c7-4918-8103-023db604fd70/action HTTP/1.1 Aug 10 23:14:54.261893 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:14:54.261893 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:14:54.261893 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:14:54.261893 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 28 Aug 10 23:14:54.261893 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:14:54.261893 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:14:54.261893 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:14:54.261893 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:14:54.261893 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9DuIKrfOsS8tKST0PsIPrvuNPfsVISfOPvUoe9ddkVcTJKj7rDjd3OuH9u-DTT1aypj1AUoUKtajD98eDOUOHSpPisBSdRlSCov30lHf1uZq-XZLyBIVg5kAG8-SuXk2s1TL7EnRcjjMARSkm95dZDnXaBXRT3M4f8UoMDwqu7xK7gQ Aug 10 23:14:54.261893 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:14:54.261893 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:14:54.261893 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:14:54.261893 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:14:54.261893 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:14:54.261893 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:14:54.261893 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: d11bbb3e87f4463787da56ab19108822 Aug 10 23:14:54.261893 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-ServersNegativeTestJSON-1216728002 Aug 10 23:14:54.261893 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:14:54.261893 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:14:54.261893 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d11bbb3e87f4463787da56ab19108822"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d11bbb3e87f4463787da56ab19108822"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d11bbb3e87f4463787da56ab19108822"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d11bbb3e87f4463787da56ab19108822", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:14:54.261893 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-ServersNegativeTestJSON-1216728002 Aug 10 23:14:54.261893 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: d11bbb3e87f4463787da56ab19108822 Aug 10 23:14:54.261893 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1216728002 Aug 10 23:14:54.261893 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-ServersNegativeTestJSON-1216728002-project Aug 10 23:14:54.261893 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:14:54.261893 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:14:54.261893 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: f284ec2a4bf546b58c1c1adaf880e1fb Aug 10 23:14:54.261893 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-ServersNegativeTestJSON-1216728002-project Aug 10 23:14:54.261893 n-d-850468-14 devstack@n-api.service[122633]: Aug 10 23:14:54.261893 n-d-850468-14 devstack@n-api.service[122633]: {"reboot": {"type": "SOFT"}} Aug 10 23:14:54.261893 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:14:54.261893 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance 6dc592cb-94c7-4918-8103-023db604fd70 could not be found. Aug 10 23:14:54.261893 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': '6dc592cb-94c7-4918-8103-023db604fd70', 'body': {'reboot': {'type': 'SOFT'}}} Aug 10 23:14:54.261893 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:14:54.261893 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:14:54.261893 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:14:54.261893 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:14:54.261893 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:14:54.261893 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:14:54.261893 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:14:54.261893 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:14:54.261893 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:14:54.261893 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:14:54.261893 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6dc592cb-94c7-4918-8103-023db604fd70 could not be found. Aug 10 23:14:54.261893 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:14:54.261893 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:14:54.261893 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:14:54.261893 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:14:54.261893 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:14:54.261893 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:14:54.261893 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:14:54.261893 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:14:54.261893 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:14:54.261893 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:14:54.261893 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 23:14:54.261893 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 23:14:54.261893 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Aug 10 23:14:54.261893 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 10 23:14:54.261893 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:14:54.261893 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:14:54.261893 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:14:54.261893 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:14:54.266581 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6dc592cb-94c7-4918-8103-023db604fd70 could not be found. Aug 10 23:14:54.266581 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:14:54.266581 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:14:54.266581 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:14:54.266581 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:14:54.266581 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:14:54.266581 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:14:54.266581 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:14:54.266581 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:14:54.266581 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6dc592cb-94c7-4918-8103-023db604fd70 could not be found. Aug 10 23:14:54.266581 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:14:54.266581 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-33e2dbb6-b07e-4f37-95b4-f8dcdc64780c tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Returning 404 to user: Instance 6dc592cb-94c7-4918-8103-023db604fd70 could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:14:54.266581 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-33e2dbb6-b07e-4f37-95b4-f8dcdc64780c tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "POST /compute/v2.1/servers/6dc592cb-94c7-4918-8103-023db604fd70/action" status: 404 len: 111 microversion: 2.1 time: 0.059597 Aug 10 23:14:54.266581 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1974/3815] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:14:54 2022] POST /compute/v2.1/servers/6dc592cb-94c7-4918-8103-023db604fd70/action => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:14:54.279374 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-e99baec0-a645-4f0b-a64a-c04f04c67927 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:54.280307 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-e99baec0-a645-4f0b-a64a-c04f04c67927 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:54.288055 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e99baec0-a645-4f0b-a64a-c04f04c67927 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:54.289554 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e99baec0-a645-4f0b-a64a-c04f04c67927 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:54.290206 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e99baec0-a645-4f0b-a64a-c04f04c67927 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:54.291630 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e99baec0-a645-4f0b-a64a-c04f04c67927 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:54.292330 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e99baec0-a645-4f0b-a64a-c04f04c67927 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:54.293033 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e99baec0-a645-4f0b-a64a-c04f04c67927 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:54.480052 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-e99baec0-a645-4f0b-a64a-c04f04c67927 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:54.493322 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-e99baec0-a645-4f0b-a64a-c04f04c67927 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b" status: 200 len: 1506 microversion: 2.1 time: 0.221410 Aug 10 23:14:54.506856 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1975/3816] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:54 2022] GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b => generated 1506 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:54.506856 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-00841308-4988-4a69-b12b-3fb37a746a6f tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:54.506856 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-00841308-4988-4a69-b12b-3fb37a746a6f tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] [instance: f4dc6241-b173-4cbf-b76c-7da3fac7edcc] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:54.510052 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-00841308-4988-4a69-b12b-3fb37a746a6f tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:54.510052 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-00841308-4988-4a69-b12b-3fb37a746a6f tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:54.510434 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-00841308-4988-4a69-b12b-3fb37a746a6f tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:54.515058 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-00841308-4988-4a69-b12b-3fb37a746a6f tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:54.515058 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-00841308-4988-4a69-b12b-3fb37a746a6f tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:54.515058 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-00841308-4988-4a69-b12b-3fb37a746a6f tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:54.543981 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-00841308-4988-4a69-b12b-3fb37a746a6f tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] [instance: f4dc6241-b173-4cbf-b76c-7da3fac7edcc] Going to try to terminate instance {{(pid=122633) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:14:54.558356 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-fb157c00-26d7-4a43-82ad-a478090dd592 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:54.581580 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-fb157c00-26d7-4a43-82ad-a478090dd592 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/1da4d99f-4cb0-4533-bda8-3bda03205e07" status: 200 len: 1315 microversion: 2.1 time: 0.562155 Aug 10 23:14:54.583070 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1842/3817] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:54 2022] GET /compute/v2.1/servers/1da4d99f-4cb0-4533-bda8-3bda03205e07 => generated 1315 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:54.597860 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-21a67358-ab84-4f86-8717-f92795a9769b req-52564427-5b5c-4d0f-a28f-896f91a6d7c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4dc6241-b173-4cbf-b76c-7da3fac7edcc", "tag": "d3cf5f02-4cda-4d1b-9314-92bc05402960"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:14:54.609779 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-21a67358-ab84-4f86-8717-f92795a9769b req-52564427-5b5c-4d0f-a28f-896f91a6d7c4 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:54.610877 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-21a67358-ab84-4f86-8717-f92795a9769b req-52564427-5b5c-4d0f-a28f-896f91a6d7c4 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:54.611551 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-21a67358-ab84-4f86-8717-f92795a9769b req-52564427-5b5c-4d0f-a28f-896f91a6d7c4 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:54.633609 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-21a67358-ab84-4f86-8717-f92795a9769b req-52564427-5b5c-4d0f-a28f-896f91a6d7c4 service nova] Creating event network-changed:d3cf5f02-4cda-4d1b-9314-92bc05402960 for instance f4dc6241-b173-4cbf-b76c-7da3fac7edcc on n-h2-850468-14 Aug 10 23:14:54.640027 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-21a67358-ab84-4f86-8717-f92795a9769b req-52564427-5b5c-4d0f-a28f-896f91a6d7c4 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054313 Aug 10 23:14:54.641894 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1843/3818] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:14:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:14:54.651843 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-fdf69df4-09da-40e2-9871-2b4fb0e5415c tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:54.653095 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-fdf69df4-09da-40e2-9871-2b4fb0e5415c tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:54.661854 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fdf69df4-09da-40e2-9871-2b4fb0e5415c tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:54.663355 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fdf69df4-09da-40e2-9871-2b4fb0e5415c tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:54.664158 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fdf69df4-09da-40e2-9871-2b4fb0e5415c tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:54.665820 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fdf69df4-09da-40e2-9871-2b4fb0e5415c tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:54.666557 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fdf69df4-09da-40e2-9871-2b4fb0e5415c tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:54.667551 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fdf69df4-09da-40e2-9871-2b4fb0e5415c tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:54.671023 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-00841308-4988-4a69-b12b-3fb37a746a6f tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "DELETE /compute/v2.1/servers/f4dc6241-b173-4cbf-b76c-7da3fac7edcc" status: 204 len: 0 microversion: 2.1 time: 0.172577 Aug 10 23:14:54.675110 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1976/3819] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:14:54 2022] DELETE /compute/v2.1/servers/f4dc6241-b173-4cbf-b76c-7da3fac7edcc => generated 0 bytes in 180 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:14:54.686071 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:14:54.688240 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-06265357-b067-4e24-b143-bda0deeb024c tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:54.689221 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-06265357-b067-4e24-b143-bda0deeb024c tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] [instance: f4dc6241-b173-4cbf-b76c-7da3fac7edcc] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:54.698278 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-06265357-b067-4e24-b143-bda0deeb024c tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:54.699193 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-06265357-b067-4e24-b143-bda0deeb024c tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:54.700063 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-06265357-b067-4e24-b143-bda0deeb024c tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:54.702209 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-06265357-b067-4e24-b143-bda0deeb024c tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:54.703117 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-06265357-b067-4e24-b143-bda0deeb024c tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:54.703714 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-06265357-b067-4e24-b143-bda0deeb024c tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:54.931395 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-06265357-b067-4e24-b143-bda0deeb024c tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5899b2ad9f1046caaf7c6073e408eeee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25abd63376614081a9d484f3c9ae950d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:54.944538 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-06265357-b067-4e24-b143-bda0deeb024c tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "GET /compute/v2.1/servers/f4dc6241-b173-4cbf-b76c-7da3fac7edcc" status: 200 len: 1687 microversion: 2.1 time: 0.262217 Aug 10 23:14:54.945938 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1977/3820] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:54 2022] GET /compute/v2.1/servers/f4dc6241-b173-4cbf-b76c-7da3fac7edcc => generated 1687 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:14:54.953319 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-39594ff7-1a27-4446-9cbc-bd9e440fa26c tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:54.955054 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-39594ff7-1a27-4446-9cbc-bd9e440fa26c tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] [instance: 7df225be-2dbc-4ef6-aeec-9a3de33a0006] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:54.970271 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-39594ff7-1a27-4446-9cbc-bd9e440fa26c tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:54.971323 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-39594ff7-1a27-4446-9cbc-bd9e440fa26c tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:54.972490 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-39594ff7-1a27-4446-9cbc-bd9e440fa26c tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:54.973560 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-39594ff7-1a27-4446-9cbc-bd9e440fa26c tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:54.976505 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-39594ff7-1a27-4446-9cbc-bd9e440fa26c tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:54.977316 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-39594ff7-1a27-4446-9cbc-bd9e440fa26c tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:55.084694 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-fdf69df4-09da-40e2-9871-2b4fb0e5415c tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:55.103700 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-fdf69df4-09da-40e2-9871-2b4fb0e5415c tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b" status: 200 len: 1506 microversion: 2.1 time: 0.459651 Aug 10 23:14:55.104293 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1844/3821] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:54 2022] GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b => generated 1506 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:55.109068 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-e6f4fbf9-8c8f-406c-83a1-e3ad7dade7f0 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:55.109886 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-e6f4fbf9-8c8f-406c-83a1-e3ad7dade7f0 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: 7a8f8d36-4744-43b7-9d42-e50fb5fabe60] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:55.126437 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e6f4fbf9-8c8f-406c-83a1-e3ad7dade7f0 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:55.126972 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e6f4fbf9-8c8f-406c-83a1-e3ad7dade7f0 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:55.127464 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e6f4fbf9-8c8f-406c-83a1-e3ad7dade7f0 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:55.128186 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e6f4fbf9-8c8f-406c-83a1-e3ad7dade7f0 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:55.128642 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e6f4fbf9-8c8f-406c-83a1-e3ad7dade7f0 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:55.129070 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e6f4fbf9-8c8f-406c-83a1-e3ad7dade7f0 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:55.236265 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-39594ff7-1a27-4446-9cbc-bd9e440fa26c tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07c94ebf0954cdea12b9a689538d96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395d7c4077e54c43bb95288db3942b0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:55.252611 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-39594ff7-1a27-4446-9cbc-bd9e440fa26c tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] 10.222.0.58 "GET /compute/v2.1/servers/7df225be-2dbc-4ef6-aeec-9a3de33a0006" status: 200 len: 1522 microversion: 2.1 time: 0.301460 Aug 10 23:14:55.268179 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1978/3822] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:54 2022] GET /compute/v2.1/servers/7df225be-2dbc-4ef6-aeec-9a3de33a0006 => generated 1522 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:55.276141 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-fa8067a6-723a-408d-937e-27898f07c05c tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:14:55.283394 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-fa8067a6-723a-408d-937e-27898f07c05c tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 750ee992-8f9d-4f31-9cf3-949abc369789] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:55.293908 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-fa8067a6-723a-408d-937e-27898f07c05c tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] HTTP exception thrown: Instance 750ee992-8f9d-4f31-9cf3-949abc369789 could not be found. Aug 10 23:14:55.296154 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-fa8067a6-723a-408d-937e-27898f07c05c tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Request method failure captured: Aug 10 23:14:55.296154 n-d-850468-14 devstack@n-api.service[122633]: request: POST /compute/v2.1/servers/750ee992-8f9d-4f31-9cf3-949abc369789/action HTTP/1.1 Aug 10 23:14:55.296154 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:14:55.296154 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:14:55.296154 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:14:55.296154 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 28 Aug 10 23:14:55.296154 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:14:55.296154 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:14:55.296154 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:14:55.296154 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:14:55.296154 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9DuIKrfOsS8tKST0PsIPrvuNPfsVISfOPvUoe9ddkVcTJKj7rDjd3OuH9u-DTT1aypj1AUoUKtajD98eDOUOHSpPisBSdRlSCov30lHf1uZq-XZLyBIVg5kAG8-SuXk2s1TL7EnRcjjMARSkm95dZDnXaBXRT3M4f8UoMDwqu7xK7gQ Aug 10 23:14:55.296154 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:14:55.296154 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:14:55.296154 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:14:55.296154 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:14:55.296154 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:14:55.296154 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:14:55.296154 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: d11bbb3e87f4463787da56ab19108822 Aug 10 23:14:55.296154 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-ServersNegativeTestJSON-1216728002 Aug 10 23:14:55.296154 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:14:55.296154 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:14:55.296154 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d11bbb3e87f4463787da56ab19108822"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d11bbb3e87f4463787da56ab19108822"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d11bbb3e87f4463787da56ab19108822"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d11bbb3e87f4463787da56ab19108822", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:14:55.296154 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-ServersNegativeTestJSON-1216728002 Aug 10 23:14:55.296154 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: d11bbb3e87f4463787da56ab19108822 Aug 10 23:14:55.296154 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1216728002 Aug 10 23:14:55.296154 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-ServersNegativeTestJSON-1216728002-project Aug 10 23:14:55.296154 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:14:55.296154 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:14:55.296154 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: f284ec2a4bf546b58c1c1adaf880e1fb Aug 10 23:14:55.296154 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-ServersNegativeTestJSON-1216728002-project Aug 10 23:14:55.296154 n-d-850468-14 devstack@n-api.service[122633]: Aug 10 23:14:55.296154 n-d-850468-14 devstack@n-api.service[122633]: {"reboot": {"type": "SOFT"}} Aug 10 23:14:55.296154 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:14:55.296154 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance 750ee992-8f9d-4f31-9cf3-949abc369789 could not be found. Aug 10 23:14:55.296154 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': '750ee992-8f9d-4f31-9cf3-949abc369789', 'body': {'reboot': {'type': 'SOFT'}}} Aug 10 23:14:55.296154 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:14:55.296154 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:14:55.296154 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:14:55.296154 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:14:55.296154 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:14:55.296154 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:14:55.296154 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 10 23:14:55.296154 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 10 23:14:55.296154 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 750ee992-8f9d-4f31-9cf3-949abc369789 could not be found. Aug 10 23:14:55.296154 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:14:55.296154 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:14:55.296154 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:14:55.296154 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:14:55.296154 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:14:55.296154 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:14:55.296154 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:14:55.296154 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:14:55.296154 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:14:55.296154 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:14:55.296154 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 23:14:55.296154 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 23:14:55.296154 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Aug 10 23:14:55.296154 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 10 23:14:55.296154 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:14:55.296154 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:14:55.296154 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:14:55.296154 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:14:55.296154 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 750ee992-8f9d-4f31-9cf3-949abc369789 could not be found. Aug 10 23:14:55.296154 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:14:55.299894 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:14:55.299894 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:14:55.299894 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:14:55.299894 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:14:55.299894 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:14:55.299894 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:14:55.299894 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:14:55.299894 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 750ee992-8f9d-4f31-9cf3-949abc369789 could not be found. Aug 10 23:14:55.299894 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:14:55.300385 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-fa8067a6-723a-408d-937e-27898f07c05c tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Returning 404 to user: Instance 750ee992-8f9d-4f31-9cf3-949abc369789 could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:14:55.301135 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-fa8067a6-723a-408d-937e-27898f07c05c tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "POST /compute/v2.1/servers/750ee992-8f9d-4f31-9cf3-949abc369789/action" status: 404 len: 111 microversion: 2.1 time: 0.029784 Aug 10 23:14:55.301600 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1979/3823] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:14:55 2022] POST /compute/v2.1/servers/750ee992-8f9d-4f31-9cf3-949abc369789/action => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:14:55.311786 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-0a143eee-4277-4c6c-865e-7520baa5face tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:55.313021 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-0a143eee-4277-4c6c-865e-7520baa5face tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:55.322276 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0a143eee-4277-4c6c-865e-7520baa5face tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:55.323067 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0a143eee-4277-4c6c-865e-7520baa5face tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:55.323667 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0a143eee-4277-4c6c-865e-7520baa5face tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:55.324404 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0a143eee-4277-4c6c-865e-7520baa5face tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:55.325054 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0a143eee-4277-4c6c-865e-7520baa5face tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:55.325496 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0a143eee-4277-4c6c-865e-7520baa5face tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:55.459881 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-e6f4fbf9-8c8f-406c-83a1-e3ad7dade7f0 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6160c7a42740efbe3613380933fa15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d90f8a58ad047fa8f347d6474e4d673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:55.471828 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-e6f4fbf9-8c8f-406c-83a1-e3ad7dade7f0 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "GET /compute/v2.1/servers/7a8f8d36-4744-43b7-9d42-e50fb5fabe60" status: 200 len: 1510 microversion: 2.1 time: 0.366258 Aug 10 23:14:55.472422 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1845/3824] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:55 2022] GET /compute/v2.1/servers/7a8f8d36-4744-43b7-9d42-e50fb5fabe60 => generated 1510 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:55.607177 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-bcf4b25f-64e1-4dca-8552-86e80cc354d6 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:55.608571 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-bcf4b25f-64e1-4dca-8552-86e80cc354d6 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: 1da4d99f-4cb0-4533-bda8-3bda03205e07] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:55.618838 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bcf4b25f-64e1-4dca-8552-86e80cc354d6 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:55.620634 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bcf4b25f-64e1-4dca-8552-86e80cc354d6 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:55.621240 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bcf4b25f-64e1-4dca-8552-86e80cc354d6 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:55.623691 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bcf4b25f-64e1-4dca-8552-86e80cc354d6 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:55.624378 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bcf4b25f-64e1-4dca-8552-86e80cc354d6 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:55.625589 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bcf4b25f-64e1-4dca-8552-86e80cc354d6 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:55.634641 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-0a143eee-4277-4c6c-865e-7520baa5face tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:55.647896 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-0a143eee-4277-4c6c-865e-7520baa5face tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b" status: 200 len: 1506 microversion: 2.1 time: 0.340929 Aug 10 23:14:55.675906 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1980/3825] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:55 2022] GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b => generated 1506 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:14:55.686248 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-70979505-039a-458c-bac3-a6f039249b43 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:55.686889 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-70979505-039a-458c-bac3-a6f039249b43 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:55.702503 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-70979505-039a-458c-bac3-a6f039249b43 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:55.703046 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-70979505-039a-458c-bac3-a6f039249b43 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:55.703495 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-70979505-039a-458c-bac3-a6f039249b43 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:55.704212 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-70979505-039a-458c-bac3-a6f039249b43 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:55.704922 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-70979505-039a-458c-bac3-a6f039249b43 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:55.705566 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-70979505-039a-458c-bac3-a6f039249b43 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:56.013172 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-70979505-039a-458c-bac3-a6f039249b43 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:56.024131 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-70979505-039a-458c-bac3-a6f039249b43 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b" status: 200 len: 1506 microversion: 2.1 time: 0.341828 Aug 10 23:14:56.041237 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-bcf4b25f-64e1-4dca-8552-86e80cc354d6 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:56.047277 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1981/3826] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:55 2022] GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b => generated 1506 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:56.052174 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-bcf4b25f-64e1-4dca-8552-86e80cc354d6 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/1da4d99f-4cb0-4533-bda8-3bda03205e07" status: 200 len: 1502 microversion: 2.1 time: 0.450612 Aug 10 23:14:56.055100 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-5cef0c27-4f43-4e14-af7f-7f26fbbb7ef5 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:56.055607 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1846/3827] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:55 2022] GET /compute/v2.1/servers/1da4d99f-4cb0-4533-bda8-3bda03205e07 => generated 1502 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:14:56.055778 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-5cef0c27-4f43-4e14-af7f-7f26fbbb7ef5 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] [instance: f4dc6241-b173-4cbf-b76c-7da3fac7edcc] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:56.065198 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5cef0c27-4f43-4e14-af7f-7f26fbbb7ef5 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:56.065699 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5cef0c27-4f43-4e14-af7f-7f26fbbb7ef5 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:56.066462 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5cef0c27-4f43-4e14-af7f-7f26fbbb7ef5 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:56.067386 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5cef0c27-4f43-4e14-af7f-7f26fbbb7ef5 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:56.067788 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-0d9c2328-3e58-4825-9c06-2c14f94f2970 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:14:56.067907 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5cef0c27-4f43-4e14-af7f-7f26fbbb7ef5 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:56.072226 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-0d9c2328-3e58-4825-9c06-2c14f94f2970 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 6dc592cb-94c7-4918-8103-023db604fd70] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:56.073224 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5cef0c27-4f43-4e14-af7f-7f26fbbb7ef5 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:56.088280 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0d9c2328-3e58-4825-9c06-2c14f94f2970 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:56.092052 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0d9c2328-3e58-4825-9c06-2c14f94f2970 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:56.092663 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0d9c2328-3e58-4825-9c06-2c14f94f2970 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:56.093577 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0d9c2328-3e58-4825-9c06-2c14f94f2970 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:56.096966 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0d9c2328-3e58-4825-9c06-2c14f94f2970 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:56.097598 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0d9c2328-3e58-4825-9c06-2c14f94f2970 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:56.121982 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-0d9c2328-3e58-4825-9c06-2c14f94f2970 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] HTTP exception thrown: Instance 6dc592cb-94c7-4918-8103-023db604fd70 could not be found. Aug 10 23:14:56.123835 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-0d9c2328-3e58-4825-9c06-2c14f94f2970 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Request method failure captured: Aug 10 23:14:56.123835 n-d-850468-14 devstack@n-api.service[122632]: request: POST /compute/v2.1/servers/6dc592cb-94c7-4918-8103-023db604fd70/action HTTP/1.1 Aug 10 23:14:56.123835 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:14:56.123835 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:14:56.123835 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:14:56.123835 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 65 Aug 10 23:14:56.123835 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:14:56.123835 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:14:56.123835 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:14:56.123835 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:14:56.123835 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9DuIKrfOsS8tKST0PsIPrvuNPfsVISfOPvUoe9ddkVcTJKj7rDjd3OuH9u-DTT1aypj1AUoUKtajD98eDOUOHSpPisBSdRlSCov30lHf1uZq-XZLyBIVg5kAG8-SuXk2s1TL7EnRcjjMARSkm95dZDnXaBXRT3M4f8UoMDwqu7xK7gQ Aug 10 23:14:56.123835 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:14:56.123835 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:14:56.123835 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:14:56.123835 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:14:56.123835 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:14:56.123835 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:14:56.123835 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: d11bbb3e87f4463787da56ab19108822 Aug 10 23:14:56.123835 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-ServersNegativeTestJSON-1216728002 Aug 10 23:14:56.123835 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:14:56.123835 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:14:56.123835 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d11bbb3e87f4463787da56ab19108822"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d11bbb3e87f4463787da56ab19108822"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d11bbb3e87f4463787da56ab19108822"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d11bbb3e87f4463787da56ab19108822", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:14:56.123835 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-ServersNegativeTestJSON-1216728002 Aug 10 23:14:56.123835 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: d11bbb3e87f4463787da56ab19108822 Aug 10 23:14:56.123835 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1216728002 Aug 10 23:14:56.123835 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-ServersNegativeTestJSON-1216728002-project Aug 10 23:14:56.123835 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:14:56.123835 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:14:56.123835 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: f284ec2a4bf546b58c1c1adaf880e1fb Aug 10 23:14:56.123835 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-ServersNegativeTestJSON-1216728002-project Aug 10 23:14:56.123835 n-d-850468-14 devstack@n-api.service[122632]: Aug 10 23:14:56.123835 n-d-850468-14 devstack@n-api.service[122632]: {"rebuild": {"imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed"}} Aug 10 23:14:56.123835 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:14:56.123835 n-d-850468-14 devstack@n-api.service[122632]: exception: Instance 6dc592cb-94c7-4918-8103-023db604fd70 could not be found. Aug 10 23:14:56.123835 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': '6dc592cb-94c7-4918-8103-023db604fd70', 'body': {'rebuild': {'imageRef': '78ad8905-f66f-4733-8be9-2b260f1fabed'}}} Aug 10 23:14:56.123835 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:14:56.123835 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:14:56.123835 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:14:56.123835 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:14:56.123835 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:14:56.123835 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:14:56.123835 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:14:56.123835 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:14:56.123835 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:14:56.123835 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:14:56.123835 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6dc592cb-94c7-4918-8103-023db604fd70 could not be found. Aug 10 23:14:56.123835 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:14:56.123835 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:14:56.123835 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:14:56.123835 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:14:56.123835 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:14:56.123835 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:14:56.123835 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:14:56.123835 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:14:56.123835 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:14:56.123835 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:14:56.123835 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 23:14:56.123835 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 23:14:56.123835 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 23:14:56.123835 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 23:14:56.123835 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 23:14:56.123835 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 23:14:56.123835 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Aug 10 23:14:56.123835 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Aug 10 23:14:56.127710 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 10 23:14:56.127710 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:14:56.127710 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:14:56.127710 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:14:56.127710 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:14:56.127710 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6dc592cb-94c7-4918-8103-023db604fd70 could not be found. Aug 10 23:14:56.127710 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:14:56.127710 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:14:56.127710 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:14:56.127710 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:14:56.127710 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:14:56.127710 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:14:56.127710 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:14:56.127710 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:14:56.127710 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6dc592cb-94c7-4918-8103-023db604fd70 could not be found. Aug 10 23:14:56.127710 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:14:56.127710 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-0d9c2328-3e58-4825-9c06-2c14f94f2970 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Returning 404 to user: Instance 6dc592cb-94c7-4918-8103-023db604fd70 could not be found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:14:56.127710 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-0d9c2328-3e58-4825-9c06-2c14f94f2970 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "POST /compute/v2.1/servers/6dc592cb-94c7-4918-8103-023db604fd70/action" status: 404 len: 111 microversion: 2.1 time: 0.066467 Aug 10 23:14:56.127710 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1847/3828] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:14:56 2022] POST /compute/v2.1/servers/6dc592cb-94c7-4918-8103-023db604fd70/action => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:14:56.136270 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c222d4e2-783f-4484-b27d-e6852ad8fdb6 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:14:56.138554 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-c222d4e2-783f-4484-b27d-e6852ad8fdb6 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: 1da4d99f-4cb0-4533-bda8-3bda03205e07] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:56.147747 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c222d4e2-783f-4484-b27d-e6852ad8fdb6 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:56.148293 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c222d4e2-783f-4484-b27d-e6852ad8fdb6 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:56.148725 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c222d4e2-783f-4484-b27d-e6852ad8fdb6 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:56.150063 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c222d4e2-783f-4484-b27d-e6852ad8fdb6 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:56.151584 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c222d4e2-783f-4484-b27d-e6852ad8fdb6 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:56.152202 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c222d4e2-783f-4484-b27d-e6852ad8fdb6 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:56.204433 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-c222d4e2-783f-4484-b27d-e6852ad8fdb6 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "POST /compute/v2.1/servers/1da4d99f-4cb0-4533-bda8-3bda03205e07/action" status: 200 len: 14 microversion: 2.1 time: 0.076732 Aug 10 23:14:56.205809 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1848/3829] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:14:56 2022] POST /compute/v2.1/servers/1da4d99f-4cb0-4533-bda8-3bda03205e07/action => generated 14 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 23:14:56.212392 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-141b6c68-736d-4507-ac49-4012c1ed9ecf tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:56.213713 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-141b6c68-736d-4507-ac49-4012c1ed9ecf tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:56.222520 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-141b6c68-736d-4507-ac49-4012c1ed9ecf tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:56.223657 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-141b6c68-736d-4507-ac49-4012c1ed9ecf tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:56.224294 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-141b6c68-736d-4507-ac49-4012c1ed9ecf tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:56.226216 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-141b6c68-736d-4507-ac49-4012c1ed9ecf tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:56.226893 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-141b6c68-736d-4507-ac49-4012c1ed9ecf tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:56.227493 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-141b6c68-736d-4507-ac49-4012c1ed9ecf tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:56.392811 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-5cef0c27-4f43-4e14-af7f-7f26fbbb7ef5 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5899b2ad9f1046caaf7c6073e408eeee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25abd63376614081a9d484f3c9ae950d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:56.396920 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:14:56.402397 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-5cef0c27-4f43-4e14-af7f-7f26fbbb7ef5 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "GET /compute/v2.1/servers/f4dc6241-b173-4cbf-b76c-7da3fac7edcc" status: 200 len: 1687 microversion: 2.1 time: 0.353980 Aug 10 23:14:56.403604 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1982/3830] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:56 2022] GET /compute/v2.1/servers/f4dc6241-b173-4cbf-b76c-7da3fac7edcc => generated 1687 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:56.409304 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-f256ba37-6aa2-44c7-8dfd-b5c318bd27d7 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:56.410231 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-f256ba37-6aa2-44c7-8dfd-b5c318bd27d7 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] [instance: 7df225be-2dbc-4ef6-aeec-9a3de33a0006] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:56.425593 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f256ba37-6aa2-44c7-8dfd-b5c318bd27d7 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:56.426147 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f256ba37-6aa2-44c7-8dfd-b5c318bd27d7 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:56.426969 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f256ba37-6aa2-44c7-8dfd-b5c318bd27d7 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:56.428579 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f256ba37-6aa2-44c7-8dfd-b5c318bd27d7 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:56.429330 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f256ba37-6aa2-44c7-8dfd-b5c318bd27d7 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:56.430013 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f256ba37-6aa2-44c7-8dfd-b5c318bd27d7 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:56.733167 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-f256ba37-6aa2-44c7-8dfd-b5c318bd27d7 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07c94ebf0954cdea12b9a689538d96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395d7c4077e54c43bb95288db3942b0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:56.742876 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-f256ba37-6aa2-44c7-8dfd-b5c318bd27d7 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] 10.222.0.58 "GET /compute/v2.1/servers/7df225be-2dbc-4ef6-aeec-9a3de33a0006" status: 200 len: 1522 microversion: 2.1 time: 0.337996 Aug 10 23:14:56.743580 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1983/3831] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:56 2022] GET /compute/v2.1/servers/7df225be-2dbc-4ef6-aeec-9a3de33a0006 => generated 1522 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:56.752197 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-3c7e22d2-b0c5-4b27-8e85-9e22146fd353 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:56.753136 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-3c7e22d2-b0c5-4b27-8e85-9e22146fd353 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: 7a8f8d36-4744-43b7-9d42-e50fb5fabe60] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:56.763499 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3c7e22d2-b0c5-4b27-8e85-9e22146fd353 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:56.764124 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3c7e22d2-b0c5-4b27-8e85-9e22146fd353 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:56.765384 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3c7e22d2-b0c5-4b27-8e85-9e22146fd353 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:56.766326 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3c7e22d2-b0c5-4b27-8e85-9e22146fd353 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:56.766774 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3c7e22d2-b0c5-4b27-8e85-9e22146fd353 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:56.767627 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3c7e22d2-b0c5-4b27-8e85-9e22146fd353 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:56.907536 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-141b6c68-736d-4507-ac49-4012c1ed9ecf tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:56.925644 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-141b6c68-736d-4507-ac49-4012c1ed9ecf tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b" status: 200 len: 1506 microversion: 2.1 time: 0.718368 Aug 10 23:14:56.926556 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1849/3832] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:56 2022] GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b => generated 1506 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:56.963213 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-258ad732-9a99-479b-8838-67989d9cc233 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:56.965813 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-258ad732-9a99-479b-8838-67989d9cc233 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:56.978507 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-258ad732-9a99-479b-8838-67989d9cc233 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:56.979381 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-258ad732-9a99-479b-8838-67989d9cc233 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:56.980077 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-258ad732-9a99-479b-8838-67989d9cc233 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:56.982112 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-258ad732-9a99-479b-8838-67989d9cc233 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:56.983280 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-258ad732-9a99-479b-8838-67989d9cc233 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:56.984043 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-258ad732-9a99-479b-8838-67989d9cc233 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:57.125631 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-3c7e22d2-b0c5-4b27-8e85-9e22146fd353 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6160c7a42740efbe3613380933fa15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d90f8a58ad047fa8f347d6474e4d673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:57.142464 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-3c7e22d2-b0c5-4b27-8e85-9e22146fd353 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "GET /compute/v2.1/servers/7a8f8d36-4744-43b7-9d42-e50fb5fabe60" status: 200 len: 1510 microversion: 2.1 time: 0.397235 Aug 10 23:14:57.143954 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1984/3833] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:56 2022] GET /compute/v2.1/servers/7a8f8d36-4744-43b7-9d42-e50fb5fabe60 => generated 1510 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:57.220776 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-b43197e6-7037-45ab-aef1-f4b87dfb9a12 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:14:57.223736 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-b43197e6-7037-45ab-aef1-f4b87dfb9a12 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: 1da4d99f-4cb0-4533-bda8-3bda03205e07] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:57.234546 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b43197e6-7037-45ab-aef1-f4b87dfb9a12 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:57.235344 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b43197e6-7037-45ab-aef1-f4b87dfb9a12 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:57.236092 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b43197e6-7037-45ab-aef1-f4b87dfb9a12 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:57.237193 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b43197e6-7037-45ab-aef1-f4b87dfb9a12 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:57.237927 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b43197e6-7037-45ab-aef1-f4b87dfb9a12 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:57.238361 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b43197e6-7037-45ab-aef1-f4b87dfb9a12 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:57.293364 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-b43197e6-7037-45ab-aef1-f4b87dfb9a12 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "POST /compute/v2.1/servers/1da4d99f-4cb0-4533-bda8-3bda03205e07/action" status: 200 len: 14 microversion: 2.1 time: 0.077426 Aug 10 23:14:57.294551 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1985/3834] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:14:57 2022] POST /compute/v2.1/servers/1da4d99f-4cb0-4533-bda8-3bda03205e07/action => generated 14 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 23:14:57.433632 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-48311599-b2e5-4582-b3c4-59226657d0c1 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:57.434888 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-48311599-b2e5-4582-b3c4-59226657d0c1 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] [instance: f4dc6241-b173-4cbf-b76c-7da3fac7edcc] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:57.446351 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-48311599-b2e5-4582-b3c4-59226657d0c1 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:57.447071 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-48311599-b2e5-4582-b3c4-59226657d0c1 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:57.447705 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-48311599-b2e5-4582-b3c4-59226657d0c1 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:57.448902 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-48311599-b2e5-4582-b3c4-59226657d0c1 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:57.449505 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-48311599-b2e5-4582-b3c4-59226657d0c1 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:57.450069 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-48311599-b2e5-4582-b3c4-59226657d0c1 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:57.556742 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-258ad732-9a99-479b-8838-67989d9cc233 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:57.569149 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-258ad732-9a99-479b-8838-67989d9cc233 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b" status: 200 len: 1506 microversion: 2.1 time: 0.619762 Aug 10 23:14:57.570532 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1850/3835] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:56 2022] GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b => generated 1506 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:57.596202 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-62b02980-16be-4386-9258-9659a6407294 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:14:57.608634 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-62b02980-16be-4386-9258-9659a6407294 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 44e185ee-a752-4faf-9fff-b3d51ec06f72] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:57.615843 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-62b02980-16be-4386-9258-9659a6407294 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] HTTP exception thrown: Instance 44e185ee-a752-4faf-9fff-b3d51ec06f72 could not be found. Aug 10 23:14:57.619356 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-62b02980-16be-4386-9258-9659a6407294 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Request method failure captured: Aug 10 23:14:57.619356 n-d-850468-14 devstack@n-api.service[122632]: request: POST /compute/v2.1/servers/44e185ee-a752-4faf-9fff-b3d51ec06f72/action HTTP/1.1 Aug 10 23:14:57.619356 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:14:57.619356 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:14:57.619356 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:14:57.619356 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 65 Aug 10 23:14:57.619356 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:14:57.619356 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:14:57.619356 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:14:57.619356 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:14:57.619356 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9DuIKrfOsS8tKST0PsIPrvuNPfsVISfOPvUoe9ddkVcTJKj7rDjd3OuH9u-DTT1aypj1AUoUKtajD98eDOUOHSpPisBSdRlSCov30lHf1uZq-XZLyBIVg5kAG8-SuXk2s1TL7EnRcjjMARSkm95dZDnXaBXRT3M4f8UoMDwqu7xK7gQ Aug 10 23:14:57.619356 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:14:57.619356 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:14:57.619356 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:14:57.619356 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:14:57.619356 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:14:57.619356 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:14:57.619356 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: d11bbb3e87f4463787da56ab19108822 Aug 10 23:14:57.619356 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-ServersNegativeTestJSON-1216728002 Aug 10 23:14:57.619356 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:14:57.619356 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:14:57.619356 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d11bbb3e87f4463787da56ab19108822"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d11bbb3e87f4463787da56ab19108822"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d11bbb3e87f4463787da56ab19108822"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d11bbb3e87f4463787da56ab19108822", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:14:57.619356 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-ServersNegativeTestJSON-1216728002 Aug 10 23:14:57.619356 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: d11bbb3e87f4463787da56ab19108822 Aug 10 23:14:57.619356 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1216728002 Aug 10 23:14:57.619356 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-ServersNegativeTestJSON-1216728002-project Aug 10 23:14:57.619356 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:14:57.619356 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:14:57.619356 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: f284ec2a4bf546b58c1c1adaf880e1fb Aug 10 23:14:57.619356 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-ServersNegativeTestJSON-1216728002-project Aug 10 23:14:57.619356 n-d-850468-14 devstack@n-api.service[122632]: Aug 10 23:14:57.619356 n-d-850468-14 devstack@n-api.service[122632]: {"rebuild": {"imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed"}} Aug 10 23:14:57.619356 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:14:57.619356 n-d-850468-14 devstack@n-api.service[122632]: exception: Instance 44e185ee-a752-4faf-9fff-b3d51ec06f72 could not be found. Aug 10 23:14:57.619356 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': '44e185ee-a752-4faf-9fff-b3d51ec06f72', 'body': {'rebuild': {'imageRef': '78ad8905-f66f-4733-8be9-2b260f1fabed'}}} Aug 10 23:14:57.619356 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:14:57.619356 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:14:57.619356 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:14:57.619356 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:14:57.619356 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:14:57.619356 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:14:57.619356 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 10 23:14:57.619356 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 10 23:14:57.619356 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44e185ee-a752-4faf-9fff-b3d51ec06f72 could not be found. Aug 10 23:14:57.619356 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:14:57.619356 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:14:57.619356 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:14:57.619356 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:14:57.619356 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:14:57.619356 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:14:57.619356 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:14:57.619356 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:14:57.619356 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:14:57.619356 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:14:57.619356 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 23:14:57.619356 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 23:14:57.619356 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 23:14:57.619356 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 23:14:57.619356 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 23:14:57.619356 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 23:14:57.619356 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Aug 10 23:14:57.619356 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Aug 10 23:14:57.619356 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 10 23:14:57.619356 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:14:57.623634 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:14:57.623634 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:14:57.623634 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:14:57.623634 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44e185ee-a752-4faf-9fff-b3d51ec06f72 could not be found. Aug 10 23:14:57.623634 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:14:57.623634 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:14:57.623634 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:14:57.623634 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:14:57.623634 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:14:57.623634 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:14:57.623634 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:14:57.623634 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:14:57.623634 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44e185ee-a752-4faf-9fff-b3d51ec06f72 could not be found. Aug 10 23:14:57.623634 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:14:57.623634 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-62b02980-16be-4386-9258-9659a6407294 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Returning 404 to user: Instance 44e185ee-a752-4faf-9fff-b3d51ec06f72 could not be found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:14:57.623634 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-62b02980-16be-4386-9258-9659a6407294 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "POST /compute/v2.1/servers/44e185ee-a752-4faf-9fff-b3d51ec06f72/action" status: 404 len: 111 microversion: 2.1 time: 0.032246 Aug 10 23:14:57.625134 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1851/3836] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:14:57 2022] POST /compute/v2.1/servers/44e185ee-a752-4faf-9fff-b3d51ec06f72/action => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:14:57.636733 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-1e0d8245-e0e0-48fb-a176-7e4cc29227b0 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:57.637413 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-1e0d8245-e0e0-48fb-a176-7e4cc29227b0 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:57.655840 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1e0d8245-e0e0-48fb-a176-7e4cc29227b0 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:57.656304 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1e0d8245-e0e0-48fb-a176-7e4cc29227b0 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:57.656989 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1e0d8245-e0e0-48fb-a176-7e4cc29227b0 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:57.657997 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1e0d8245-e0e0-48fb-a176-7e4cc29227b0 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:57.658777 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1e0d8245-e0e0-48fb-a176-7e4cc29227b0 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:57.660917 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1e0d8245-e0e0-48fb-a176-7e4cc29227b0 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:57.838854 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-48311599-b2e5-4582-b3c4-59226657d0c1 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5899b2ad9f1046caaf7c6073e408eeee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25abd63376614081a9d484f3c9ae950d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:57.872746 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-48311599-b2e5-4582-b3c4-59226657d0c1 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "GET /compute/v2.1/servers/f4dc6241-b173-4cbf-b76c-7da3fac7edcc" status: 200 len: 1620 microversion: 2.1 time: 0.446390 Aug 10 23:14:57.874963 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1986/3837] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:57 2022] GET /compute/v2.1/servers/f4dc6241-b173-4cbf-b76c-7da3fac7edcc => generated 1620 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:57.882157 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-380ba999-3f77-4191-9a11-8d1ce69979bf tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:57.883087 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-380ba999-3f77-4191-9a11-8d1ce69979bf tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] [instance: 7df225be-2dbc-4ef6-aeec-9a3de33a0006] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:57.919885 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-380ba999-3f77-4191-9a11-8d1ce69979bf tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:57.920504 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-380ba999-3f77-4191-9a11-8d1ce69979bf tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:57.921138 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-380ba999-3f77-4191-9a11-8d1ce69979bf tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:57.927983 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-380ba999-3f77-4191-9a11-8d1ce69979bf tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:57.928568 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-380ba999-3f77-4191-9a11-8d1ce69979bf tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:57.929018 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-380ba999-3f77-4191-9a11-8d1ce69979bf tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:58.172883 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-1e0d8245-e0e0-48fb-a176-7e4cc29227b0 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:58.184536 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-1e0d8245-e0e0-48fb-a176-7e4cc29227b0 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b" status: 200 len: 1506 microversion: 2.1 time: 0.555481 Aug 10 23:14:58.199268 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1852/3838] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:57 2022] GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b => generated 1506 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:58.207090 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-380ba999-3f77-4191-9a11-8d1ce69979bf tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07c94ebf0954cdea12b9a689538d96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395d7c4077e54c43bb95288db3942b0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:58.210752 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-23205045-1257-4415-a7c6-2fbbeb8f4262 req-e2a3820d-1d75-41e8-87c8-3cfa6f57d286 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4dc6241-b173-4cbf-b76c-7da3fac7edcc", "name": "network-vif-deleted", "tag": "d3cf5f02-4cda-4d1b-9314-92bc05402960"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:14:58.216215 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-380ba999-3f77-4191-9a11-8d1ce69979bf tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] 10.222.0.58 "GET /compute/v2.1/servers/7df225be-2dbc-4ef6-aeec-9a3de33a0006" status: 200 len: 1522 microversion: 2.1 time: 0.339161 Aug 10 23:14:58.217079 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1987/3839] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:57 2022] GET /compute/v2.1/servers/7df225be-2dbc-4ef6-aeec-9a3de33a0006 => generated 1522 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:58.220981 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-23205045-1257-4415-a7c6-2fbbeb8f4262 req-e2a3820d-1d75-41e8-87c8-3cfa6f57d286 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:58.221529 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-23205045-1257-4415-a7c6-2fbbeb8f4262 req-e2a3820d-1d75-41e8-87c8-3cfa6f57d286 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:58.222194 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-23205045-1257-4415-a7c6-2fbbeb8f4262 req-e2a3820d-1d75-41e8-87c8-3cfa6f57d286 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:58.235184 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-73573cd7-858d-4eaf-b684-c1ef8c06e695 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:58.237713 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-73573cd7-858d-4eaf-b684-c1ef8c06e695 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: 7a8f8d36-4744-43b7-9d42-e50fb5fabe60] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:58.238831 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-23205045-1257-4415-a7c6-2fbbeb8f4262 req-e2a3820d-1d75-41e8-87c8-3cfa6f57d286 service nova] Creating event network-vif-deleted:d3cf5f02-4cda-4d1b-9314-92bc05402960 for instance f4dc6241-b173-4cbf-b76c-7da3fac7edcc on n-h2-850468-14 Aug 10 23:14:58.244654 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-23205045-1257-4415-a7c6-2fbbeb8f4262 req-e2a3820d-1d75-41e8-87c8-3cfa6f57d286 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043904 Aug 10 23:14:58.245545 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1853/3840] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:14:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:14:58.250824 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-798f8661-4c7e-45a5-912a-de7db41af7e1 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:58.251826 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-798f8661-4c7e-45a5-912a-de7db41af7e1 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:58.254993 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-73573cd7-858d-4eaf-b684-c1ef8c06e695 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:58.255983 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-73573cd7-858d-4eaf-b684-c1ef8c06e695 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:58.257651 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-73573cd7-858d-4eaf-b684-c1ef8c06e695 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:58.259318 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-73573cd7-858d-4eaf-b684-c1ef8c06e695 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:58.259607 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-798f8661-4c7e-45a5-912a-de7db41af7e1 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:58.259788 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-73573cd7-858d-4eaf-b684-c1ef8c06e695 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:58.260397 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-798f8661-4c7e-45a5-912a-de7db41af7e1 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:58.260940 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-798f8661-4c7e-45a5-912a-de7db41af7e1 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:58.261578 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-73573cd7-858d-4eaf-b684-c1ef8c06e695 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:58.261851 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-798f8661-4c7e-45a5-912a-de7db41af7e1 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:58.262420 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-798f8661-4c7e-45a5-912a-de7db41af7e1 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:58.263047 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-798f8661-4c7e-45a5-912a-de7db41af7e1 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:58.573607 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-798f8661-4c7e-45a5-912a-de7db41af7e1 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:58.585061 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-798f8661-4c7e-45a5-912a-de7db41af7e1 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b" status: 200 len: 1506 microversion: 2.1 time: 0.338108 Aug 10 23:14:58.589270 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1854/3841] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:58 2022] GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b => generated 1506 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:58.617905 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-2593d922-5727-447e-a182-988ad2bb8bfc tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:14:58.620528 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-2593d922-5727-447e-a182-988ad2bb8bfc tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: 1da4d99f-4cb0-4533-bda8-3bda03205e07] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:58.628824 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2593d922-5727-447e-a182-988ad2bb8bfc tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:58.629606 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2593d922-5727-447e-a182-988ad2bb8bfc tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:58.630672 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2593d922-5727-447e-a182-988ad2bb8bfc tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:58.631951 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2593d922-5727-447e-a182-988ad2bb8bfc tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:58.632606 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2593d922-5727-447e-a182-988ad2bb8bfc tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:58.633040 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2593d922-5727-447e-a182-988ad2bb8bfc tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:58.698620 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-73573cd7-858d-4eaf-b684-c1ef8c06e695 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6160c7a42740efbe3613380933fa15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d90f8a58ad047fa8f347d6474e4d673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:58.706620 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-2593d922-5727-447e-a182-988ad2bb8bfc tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "POST /compute/v2.1/servers/1da4d99f-4cb0-4533-bda8-3bda03205e07/action" status: 200 len: 14 microversion: 2.1 time: 0.094249 Aug 10 23:14:58.707335 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1855/3842] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:14:58 2022] POST /compute/v2.1/servers/1da4d99f-4cb0-4533-bda8-3bda03205e07/action => generated 14 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 23:14:58.714104 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-73573cd7-858d-4eaf-b684-c1ef8c06e695 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "GET /compute/v2.1/servers/7a8f8d36-4744-43b7-9d42-e50fb5fabe60" status: 200 len: 1510 microversion: 2.1 time: 0.493785 Aug 10 23:14:58.714282 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-144bb796-3026-4327-90d4-6c95771be54a tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:14:58.715121 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-144bb796-3026-4327-90d4-6c95771be54a tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: bab520b3-872c-4782-bc73-3b3c9a27bc35] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:58.719300 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1988/3843] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:58 2022] GET /compute/v2.1/servers/7a8f8d36-4744-43b7-9d42-e50fb5fabe60 => generated 1510 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:58.728787 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-144bb796-3026-4327-90d4-6c95771be54a tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] HTTP exception thrown: Instance bab520b3-872c-4782-bc73-3b3c9a27bc35 could not be found. Aug 10 23:14:58.730637 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-144bb796-3026-4327-90d4-6c95771be54a tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Request method failure captured: Aug 10 23:14:58.730637 n-d-850468-14 devstack@n-api.service[122632]: request: POST /compute/v2.1/servers/bab520b3-872c-4782-bc73-3b3c9a27bc35/action HTTP/1.1 Aug 10 23:14:58.730637 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:14:58.730637 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:14:58.730637 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:14:58.730637 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 15 Aug 10 23:14:58.730637 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:14:58.730637 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:14:58.730637 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:14:58.730637 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:14:58.730637 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9DuIKrfOsS8tKST0PsIPrvuNPfsVISfOPvUoe9ddkVcTJKj7rDjd3OuH9u-DTT1aypj1AUoUKtajD98eDOUOHSpPisBSdRlSCov30lHf1uZq-XZLyBIVg5kAG8-SuXk2s1TL7EnRcjjMARSkm95dZDnXaBXRT3M4f8UoMDwqu7xK7gQ Aug 10 23:14:58.730637 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:14:58.730637 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:14:58.730637 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:14:58.730637 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:14:58.730637 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:14:58.730637 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:14:58.730637 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: d11bbb3e87f4463787da56ab19108822 Aug 10 23:14:58.730637 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-ServersNegativeTestJSON-1216728002 Aug 10 23:14:58.730637 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:14:58.730637 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:14:58.730637 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d11bbb3e87f4463787da56ab19108822"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d11bbb3e87f4463787da56ab19108822"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d11bbb3e87f4463787da56ab19108822"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d11bbb3e87f4463787da56ab19108822", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:14:58.730637 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-ServersNegativeTestJSON-1216728002 Aug 10 23:14:58.730637 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: d11bbb3e87f4463787da56ab19108822 Aug 10 23:14:58.730637 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1216728002 Aug 10 23:14:58.730637 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-ServersNegativeTestJSON-1216728002-project Aug 10 23:14:58.730637 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:14:58.730637 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:14:58.730637 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: f284ec2a4bf546b58c1c1adaf880e1fb Aug 10 23:14:58.730637 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-ServersNegativeTestJSON-1216728002-project Aug 10 23:14:58.730637 n-d-850468-14 devstack@n-api.service[122632]: Aug 10 23:14:58.730637 n-d-850468-14 devstack@n-api.service[122632]: {"restore": {}} Aug 10 23:14:58.730637 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:14:58.730637 n-d-850468-14 devstack@n-api.service[122632]: exception: Instance bab520b3-872c-4782-bc73-3b3c9a27bc35 could not be found. Aug 10 23:14:58.730637 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': 'bab520b3-872c-4782-bc73-3b3c9a27bc35', 'body': {'restore': {}}} Aug 10 23:14:58.730637 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:14:58.730637 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:14:58.730637 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:14:58.730637 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:14:58.730637 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:14:58.730637 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:14:58.730637 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 10 23:14:58.730637 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 10 23:14:58.730637 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bab520b3-872c-4782-bc73-3b3c9a27bc35 could not be found. Aug 10 23:14:58.730637 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:14:58.730637 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:14:58.730637 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:14:58.730637 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:14:58.730637 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:14:58.730637 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:14:58.730637 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:14:58.730637 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:14:58.730637 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:14:58.730637 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:14:58.730637 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore Aug 10 23:14:58.730637 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 10 23:14:58.730637 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:14:58.730637 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:14:58.730637 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bab520b3-872c-4782-bc73-3b3c9a27bc35 could not be found. Aug 10 23:14:58.730637 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:14:58.730637 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:14:58.730637 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:14:58.730637 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:14:58.730637 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:14:58.730637 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:14:58.734447 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:14:58.734447 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:14:58.734447 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bab520b3-872c-4782-bc73-3b3c9a27bc35 could not be found. Aug 10 23:14:58.734447 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:14:58.734447 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-144bb796-3026-4327-90d4-6c95771be54a tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Returning 404 to user: Instance bab520b3-872c-4782-bc73-3b3c9a27bc35 could not be found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:14:58.734447 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-144bb796-3026-4327-90d4-6c95771be54a tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "POST /compute/v2.1/servers/bab520b3-872c-4782-bc73-3b3c9a27bc35/action" status: 404 len: 111 microversion: 2.1 time: 0.024644 Aug 10 23:14:58.734447 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1856/3844] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:14:58 2022] POST /compute/v2.1/servers/bab520b3-872c-4782-bc73-3b3c9a27bc35/action => generated 111 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:14:58.745141 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-41343331-13fc-4569-b8d0-5c3b44b742ab tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:58.746282 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-41343331-13fc-4569-b8d0-5c3b44b742ab tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:58.756508 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-41343331-13fc-4569-b8d0-5c3b44b742ab tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:58.758141 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-41343331-13fc-4569-b8d0-5c3b44b742ab tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:58.758866 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-41343331-13fc-4569-b8d0-5c3b44b742ab tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:58.763763 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-41343331-13fc-4569-b8d0-5c3b44b742ab tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:58.764930 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-41343331-13fc-4569-b8d0-5c3b44b742ab tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:58.771046 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-41343331-13fc-4569-b8d0-5c3b44b742ab tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:58.901812 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-5a8b50b3-df17-47e0-8c30-66086ef7b6a2 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:58.902706 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-5a8b50b3-df17-47e0-8c30-66086ef7b6a2 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] [instance: f4dc6241-b173-4cbf-b76c-7da3fac7edcc] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:58.914214 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5a8b50b3-df17-47e0-8c30-66086ef7b6a2 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:58.915257 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5a8b50b3-df17-47e0-8c30-66086ef7b6a2 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:58.915870 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5a8b50b3-df17-47e0-8c30-66086ef7b6a2 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:58.917079 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5a8b50b3-df17-47e0-8c30-66086ef7b6a2 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:58.918002 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5a8b50b3-df17-47e0-8c30-66086ef7b6a2 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:58.918731 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5a8b50b3-df17-47e0-8c30-66086ef7b6a2 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:58.938201 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-5a8b50b3-df17-47e0-8c30-66086ef7b6a2 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] HTTP exception thrown: Instance f4dc6241-b173-4cbf-b76c-7da3fac7edcc could not be found. Aug 10 23:14:58.940502 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-5a8b50b3-df17-47e0-8c30-66086ef7b6a2 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Request method failure captured: Aug 10 23:14:58.940502 n-d-850468-14 devstack@n-api.service[122632]: request: GET /compute/v2.1/servers/f4dc6241-b173-4cbf-b76c-7da3fac7edcc HTTP/1.1 Aug 10 23:14:58.940502 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:14:58.940502 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:14:58.940502 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:14:58.940502 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 23:14:58.940502 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:14:58.940502 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:14:58.940502 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:14:58.940502 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:14:58.940502 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9Ds_i3PDzfY831LhvXxRQTuETlpkVlxLBcxw-fA_3Rgh7BtMKg49t93n4W60rS-OkNCaJLSeSll4L6S-Ea6OzN1bcIzb1fgJBbur3wde6WJsUVM5pLO1qLazxYPdl_aqZKKVBhxsJX3P2s11u3EZ1kQF4iZz3H2MFzZDIBqiyZ7kxOA Aug 10 23:14:58.940502 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:14:58.940502 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:14:58.940502 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:14:58.940502 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:14:58.940502 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:14:58.940502 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:14:58.940502 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 25abd63376614081a9d484f3c9ae950d Aug 10 23:14:58.940502 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1591694610 Aug 10 23:14:58.940502 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:14:58.940502 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:14:58.940502 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/25abd63376614081a9d484f3c9ae950d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/25abd63376614081a9d484f3c9ae950d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/25abd63376614081a9d484f3c9ae950d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_25abd63376614081a9d484f3c9ae950d", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:14:58.940502 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1591694610 Aug 10 23:14:58.940502 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 25abd63376614081a9d484f3c9ae950d Aug 10 23:14:58.940502 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1591694610 Aug 10 23:14:58.940502 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-TestNetworkAdvancedServerOps-1591694610-project Aug 10 23:14:58.940502 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:14:58.940502 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:14:58.940502 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: 5899b2ad9f1046caaf7c6073e408eeee Aug 10 23:14:58.940502 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1591694610-project Aug 10 23:14:58.940502 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:14:58.940502 n-d-850468-14 devstack@n-api.service[122632]: exception: Instance f4dc6241-b173-4cbf-b76c-7da3fac7edcc could not be found. Aug 10 23:14:58.940502 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': 'f4dc6241-b173-4cbf-b76c-7da3fac7edcc'} Aug 10 23:14:58.940502 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:14:58.940502 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:14:58.940502 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:14:58.940502 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:14:58.940502 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:14:58.940502 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:14:58.940502 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:14:58.940502 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:14:58.940502 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:14:58.940502 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:14:58.940502 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4dc6241-b173-4cbf-b76c-7da3fac7edcc could not be found. Aug 10 23:14:58.940502 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:14:58.940502 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:14:58.940502 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:14:58.940502 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:14:58.940502 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:14:58.940502 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:14:58.940502 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:14:58.940502 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:14:58.940502 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:14:58.940502 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:14:58.940502 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:14:58.940502 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:14:58.940502 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:14:58.940502 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:14:58.940502 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:14:58.940502 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:14:58.940502 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4dc6241-b173-4cbf-b76c-7da3fac7edcc could not be found. Aug 10 23:14:58.940502 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:14:58.940502 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:14:58.945636 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:14:58.945636 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:14:58.945636 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:14:58.945636 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:14:58.945636 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:14:58.945636 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:14:58.945636 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4dc6241-b173-4cbf-b76c-7da3fac7edcc could not be found. Aug 10 23:14:58.945636 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:14:58.947312 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-5a8b50b3-df17-47e0-8c30-66086ef7b6a2 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Returning 404 to user: Instance f4dc6241-b173-4cbf-b76c-7da3fac7edcc could not be found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:14:58.948405 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-5a8b50b3-df17-47e0-8c30-66086ef7b6a2 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "GET /compute/v2.1/servers/f4dc6241-b173-4cbf-b76c-7da3fac7edcc" status: 404 len: 111 microversion: 2.1 time: 0.055835 Aug 10 23:14:58.949687 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1857/3845] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:58 2022] GET /compute/v2.1/servers/f4dc6241-b173-4cbf-b76c-7da3fac7edcc => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:14:59.182375 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-41343331-13fc-4569-b8d0-5c3b44b742ab tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:59.197503 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-41343331-13fc-4569-b8d0-5c3b44b742ab tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b" status: 200 len: 1506 microversion: 2.1 time: 0.457762 Aug 10 23:14:59.202101 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1989/3846] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:58 2022] GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b => generated 1506 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:59.223504 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-b83f6370-5970-4cb9-92b7-6ad6e318e25a tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:59.224103 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-b83f6370-5970-4cb9-92b7-6ad6e318e25a tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:59.243991 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-aa8ba88e-2b8a-41a0-bc1f-fa7205ea2c25 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:59.244578 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b83f6370-5970-4cb9-92b7-6ad6e318e25a tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:59.244710 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-aa8ba88e-2b8a-41a0-bc1f-fa7205ea2c25 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] [instance: 7df225be-2dbc-4ef6-aeec-9a3de33a0006] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:59.246508 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b83f6370-5970-4cb9-92b7-6ad6e318e25a tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:59.248149 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b83f6370-5970-4cb9-92b7-6ad6e318e25a tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:59.249447 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b83f6370-5970-4cb9-92b7-6ad6e318e25a tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:59.253514 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b83f6370-5970-4cb9-92b7-6ad6e318e25a tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:59.258094 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-aa8ba88e-2b8a-41a0-bc1f-fa7205ea2c25 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:59.258094 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-aa8ba88e-2b8a-41a0-bc1f-fa7205ea2c25 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:59.258094 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-aa8ba88e-2b8a-41a0-bc1f-fa7205ea2c25 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:59.258094 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-aa8ba88e-2b8a-41a0-bc1f-fa7205ea2c25 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:59.261029 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-aa8ba88e-2b8a-41a0-bc1f-fa7205ea2c25 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:59.261375 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b83f6370-5970-4cb9-92b7-6ad6e318e25a tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:59.261528 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-aa8ba88e-2b8a-41a0-bc1f-fa7205ea2c25 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:59.573909 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-b83f6370-5970-4cb9-92b7-6ad6e318e25a tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:59.584814 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-b83f6370-5970-4cb9-92b7-6ad6e318e25a tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b" status: 200 len: 1506 microversion: 2.1 time: 0.364960 Aug 10 23:14:59.585389 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1858/3847] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:59 2022] GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b => generated 1506 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:59.617725 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-ae1bc6b6-438b-417d-b34c-412dc90f4546 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:14:59.618985 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-ae1bc6b6-438b-417d-b34c-412dc90f4546 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:59.637941 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ae1bc6b6-438b-417d-b34c-412dc90f4546 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:59.638353 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ae1bc6b6-438b-417d-b34c-412dc90f4546 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:59.643238 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ae1bc6b6-438b-417d-b34c-412dc90f4546 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:59.646665 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ae1bc6b6-438b-417d-b34c-412dc90f4546 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:59.662381 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ae1bc6b6-438b-417d-b34c-412dc90f4546 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:59.663161 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ae1bc6b6-438b-417d-b34c-412dc90f4546 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:59.686291 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-aa8ba88e-2b8a-41a0-bc1f-fa7205ea2c25 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07c94ebf0954cdea12b9a689538d96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395d7c4077e54c43bb95288db3942b0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:14:59.695876 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-aa8ba88e-2b8a-41a0-bc1f-fa7205ea2c25 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] 10.222.0.58 "GET /compute/v2.1/servers/7df225be-2dbc-4ef6-aeec-9a3de33a0006" status: 200 len: 1522 microversion: 2.1 time: 0.457821 Aug 10 23:14:59.697041 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1990/3848] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:59 2022] GET /compute/v2.1/servers/7df225be-2dbc-4ef6-aeec-9a3de33a0006 => generated 1522 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:14:59.719165 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-9c3e73cf-963a-469d-aa59-6c54b9c52d8e tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:14:59.722812 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-9c3e73cf-963a-469d-aa59-6c54b9c52d8e tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: 1da4d99f-4cb0-4533-bda8-3bda03205e07] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:59.723288 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-ae1bc6b6-438b-417d-b34c-412dc90f4546 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] HTTP exception thrown: Cannot 'restore' instance 23bbe055-4a92-4b96-8b89-c941229bfb0b while it is in vm_state active Aug 10 23:14:59.726629 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-ae1bc6b6-438b-417d-b34c-412dc90f4546 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Request method failure captured: Aug 10 23:14:59.726629 n-d-850468-14 devstack@n-api.service[122632]: request: POST /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b/action HTTP/1.1 Aug 10 23:14:59.726629 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:14:59.726629 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:14:59.726629 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:14:59.726629 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 15 Aug 10 23:14:59.726629 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:14:59.726629 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:14:59.726629 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:14:59.726629 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:14:59.726629 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9DuIKrfOsS8tKST0PsIPrvuNPfsVISfOPvUoe9ddkVcTJKj7rDjd3OuH9u-DTT1aypj1AUoUKtajD98eDOUOHSpPisBSdRlSCov30lHf1uZq-XZLyBIVg5kAG8-SuXk2s1TL7EnRcjjMARSkm95dZDnXaBXRT3M4f8UoMDwqu7xK7gQ Aug 10 23:14:59.726629 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:14:59.726629 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:14:59.726629 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:14:59.726629 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:14:59.726629 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:14:59.726629 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:14:59.726629 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: d11bbb3e87f4463787da56ab19108822 Aug 10 23:14:59.726629 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-ServersNegativeTestJSON-1216728002 Aug 10 23:14:59.726629 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:14:59.726629 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:14:59.726629 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d11bbb3e87f4463787da56ab19108822"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d11bbb3e87f4463787da56ab19108822"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d11bbb3e87f4463787da56ab19108822"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d11bbb3e87f4463787da56ab19108822", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:14:59.726629 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-ServersNegativeTestJSON-1216728002 Aug 10 23:14:59.726629 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: d11bbb3e87f4463787da56ab19108822 Aug 10 23:14:59.726629 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1216728002 Aug 10 23:14:59.726629 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-ServersNegativeTestJSON-1216728002-project Aug 10 23:14:59.726629 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:14:59.726629 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:14:59.726629 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: f284ec2a4bf546b58c1c1adaf880e1fb Aug 10 23:14:59.726629 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-ServersNegativeTestJSON-1216728002-project Aug 10 23:14:59.726629 n-d-850468-14 devstack@n-api.service[122632]: Aug 10 23:14:59.726629 n-d-850468-14 devstack@n-api.service[122632]: {"restore": {}} Aug 10 23:14:59.726629 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:14:59.726629 n-d-850468-14 devstack@n-api.service[122632]: exception: Cannot 'restore' instance 23bbe055-4a92-4b96-8b89-c941229bfb0b while it is in vm_state active Aug 10 23:14:59.726629 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': '23bbe055-4a92-4b96-8b89-c941229bfb0b', 'body': {'restore': {}}} Aug 10 23:14:59.726629 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:14:59.726629 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:14:59.726629 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore Aug 10 23:14:59.726629 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) Aug 10 23:14:59.726629 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 10 23:14:59.726629 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 10 23:14:59.726629 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 10 23:14:59.726629 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 10 23:14:59.726629 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 23bbe055-4a92-4b96-8b89-c941229bfb0b in vm_state active. Cannot restore while the instance is in this state. Aug 10 23:14:59.726629 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:14:59.726629 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:14:59.726629 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:14:59.726629 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:14:59.726629 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:14:59.726629 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:14:59.726629 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:14:59.726629 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:14:59.726629 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:14:59.726629 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:14:59.726629 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore Aug 10 23:14:59.726629 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 10 23:14:59.726629 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 10 23:14:59.726629 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 10 23:14:59.726629 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance 23bbe055-4a92-4b96-8b89-c941229bfb0b while it is in vm_state active Aug 10 23:14:59.726629 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:14:59.726629 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:14:59.726629 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:14:59.726629 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:14:59.726629 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:14:59.731165 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:14:59.731165 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:14:59.731165 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:14:59.731165 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance 23bbe055-4a92-4b96-8b89-c941229bfb0b while it is in vm_state active Aug 10 23:14:59.731165 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:14:59.732910 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-ae1bc6b6-438b-417d-b34c-412dc90f4546 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Returning 409 to user: Cannot 'restore' instance 23bbe055-4a92-4b96-8b89-c941229bfb0b while it is in vm_state active {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:14:59.733946 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-ae1bc6b6-438b-417d-b34c-412dc90f4546 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "POST /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b/action" status: 409 len: 145 microversion: 2.1 time: 0.130874 Aug 10 23:14:59.736231 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1859/3849] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:14:59 2022] POST /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b/action => generated 145 bytes in 134 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 10 23:14:59.742687 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9c3e73cf-963a-469d-aa59-6c54b9c52d8e tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:59.743484 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9c3e73cf-963a-469d-aa59-6c54b9c52d8e tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:59.744966 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9c3e73cf-963a-469d-aa59-6c54b9c52d8e tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:59.745932 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-74e882d1-f670-4df4-a6ab-6eef2d701db9 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:59.746622 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-74e882d1-f670-4df4-a6ab-6eef2d701db9 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: 7a8f8d36-4744-43b7-9d42-e50fb5fabe60] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:59.751279 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9c3e73cf-963a-469d-aa59-6c54b9c52d8e tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:59.752057 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9c3e73cf-963a-469d-aa59-6c54b9c52d8e tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:59.752732 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9c3e73cf-963a-469d-aa59-6c54b9c52d8e tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:59.753172 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-74e882d1-f670-4df4-a6ab-6eef2d701db9 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:59.753727 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-74e882d1-f670-4df4-a6ab-6eef2d701db9 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:59.754228 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-74e882d1-f670-4df4-a6ab-6eef2d701db9 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:59.755026 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-74e882d1-f670-4df4-a6ab-6eef2d701db9 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:59.756399 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-74e882d1-f670-4df4-a6ab-6eef2d701db9 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:59.757159 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-74e882d1-f670-4df4-a6ab-6eef2d701db9 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:59.832039 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-9c3e73cf-963a-469d-aa59-6c54b9c52d8e tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "POST /compute/v2.1/servers/1da4d99f-4cb0-4533-bda8-3bda03205e07/action" status: 200 len: 14 microversion: 2.1 time: 0.116744 Aug 10 23:14:59.836144 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1991/3850] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:14:59 2022] POST /compute/v2.1/servers/1da4d99f-4cb0-4533-bda8-3bda03205e07/action => generated 14 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 23:14:59.848936 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-9942e3b2-9f92-4312-a103-47286f47871f tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:14:59.849810 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-9942e3b2-9f92-4312-a103-47286f47871f tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:14:59.857716 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9942e3b2-9f92-4312-a103-47286f47871f tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:59.858208 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9942e3b2-9f92-4312-a103-47286f47871f tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:59.858862 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9942e3b2-9f92-4312-a103-47286f47871f tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:14:59.859576 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9942e3b2-9f92-4312-a103-47286f47871f tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:14:59.860372 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9942e3b2-9f92-4312-a103-47286f47871f tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:14:59.860798 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9942e3b2-9f92-4312-a103-47286f47871f tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:00.136663 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-9942e3b2-9f92-4312-a103-47286f47871f tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:00.147356 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-9942e3b2-9f92-4312-a103-47286f47871f tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b" status: 200 len: 1506 microversion: 2.1 time: 0.308504 Aug 10 23:15:00.147964 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1992/3851] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:59 2022] GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b => generated 1506 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:00.171534 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-4b9d0b09-5024-42fa-b510-a31d2cfed392 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:00.172695 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-4b9d0b09-5024-42fa-b510-a31d2cfed392 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:00.179496 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4b9d0b09-5024-42fa-b510-a31d2cfed392 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:00.180454 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4b9d0b09-5024-42fa-b510-a31d2cfed392 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:00.180969 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4b9d0b09-5024-42fa-b510-a31d2cfed392 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:00.181765 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4b9d0b09-5024-42fa-b510-a31d2cfed392 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:00.182449 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4b9d0b09-5024-42fa-b510-a31d2cfed392 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:00.182986 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4b9d0b09-5024-42fa-b510-a31d2cfed392 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:00.216158 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-74e882d1-f670-4df4-a6ab-6eef2d701db9 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6160c7a42740efbe3613380933fa15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d90f8a58ad047fa8f347d6474e4d673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:00.227722 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-74e882d1-f670-4df4-a6ab-6eef2d701db9 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "GET /compute/v2.1/servers/7a8f8d36-4744-43b7-9d42-e50fb5fabe60" status: 200 len: 1510 microversion: 2.1 time: 0.487693 Aug 10 23:15:00.231092 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1860/3852] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:14:59 2022] GET /compute/v2.1/servers/7a8f8d36-4744-43b7-9d42-e50fb5fabe60 => generated 1510 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:00.524227 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-4b9d0b09-5024-42fa-b510-a31d2cfed392 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:00.532822 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-4b9d0b09-5024-42fa-b510-a31d2cfed392 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b" status: 200 len: 1506 microversion: 2.1 time: 0.366498 Aug 10 23:15:00.533684 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1993/3853] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:00 2022] GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b => generated 1506 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:00.554071 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-29774d1a-a7eb-4870-9f6f-70b17092fbd4 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:15:00.554620 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-29774d1a-a7eb-4870-9f6f-70b17092fbd4 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 03ae4332-708e-4a07-936e-c62804cbd2ed] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:00.561960 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-29774d1a-a7eb-4870-9f6f-70b17092fbd4 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] HTTP exception thrown: Instance 03ae4332-708e-4a07-936e-c62804cbd2ed could not be found. Aug 10 23:15:00.572094 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-29774d1a-a7eb-4870-9f6f-70b17092fbd4 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Request method failure captured: Aug 10 23:15:00.572094 n-d-850468-14 devstack@n-api.service[122632]: request: POST /compute/v2.1/servers/03ae4332-708e-4a07-936e-c62804cbd2ed/action HTTP/1.1 Aug 10 23:15:00.572094 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:15:00.572094 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:15:00.572094 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:15:00.572094 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 14 Aug 10 23:15:00.572094 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:15:00.572094 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:15:00.572094 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:15:00.572094 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:15:00.572094 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9DuIKrfOsS8tKST0PsIPrvuNPfsVISfOPvUoe9ddkVcTJKj7rDjd3OuH9u-DTT1aypj1AUoUKtajD98eDOUOHSpPisBSdRlSCov30lHf1uZq-XZLyBIVg5kAG8-SuXk2s1TL7EnRcjjMARSkm95dZDnXaBXRT3M4f8UoMDwqu7xK7gQ Aug 10 23:15:00.572094 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:15:00.572094 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:15:00.572094 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:15:00.572094 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:15:00.572094 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:15:00.572094 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:15:00.572094 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: d11bbb3e87f4463787da56ab19108822 Aug 10 23:15:00.572094 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-ServersNegativeTestJSON-1216728002 Aug 10 23:15:00.572094 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:15:00.572094 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:15:00.572094 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d11bbb3e87f4463787da56ab19108822"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d11bbb3e87f4463787da56ab19108822"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d11bbb3e87f4463787da56ab19108822"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d11bbb3e87f4463787da56ab19108822", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:15:00.572094 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-ServersNegativeTestJSON-1216728002 Aug 10 23:15:00.572094 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: d11bbb3e87f4463787da56ab19108822 Aug 10 23:15:00.572094 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1216728002 Aug 10 23:15:00.572094 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-ServersNegativeTestJSON-1216728002-project Aug 10 23:15:00.572094 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:15:00.572094 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:15:00.572094 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: f284ec2a4bf546b58c1c1adaf880e1fb Aug 10 23:15:00.572094 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-ServersNegativeTestJSON-1216728002-project Aug 10 23:15:00.572094 n-d-850468-14 devstack@n-api.service[122632]: Aug 10 23:15:00.572094 n-d-850468-14 devstack@n-api.service[122632]: {"resume": {}} Aug 10 23:15:00.572094 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:15:00.572094 n-d-850468-14 devstack@n-api.service[122632]: exception: Instance 03ae4332-708e-4a07-936e-c62804cbd2ed could not be found. Aug 10 23:15:00.572094 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': '03ae4332-708e-4a07-936e-c62804cbd2ed', 'body': {'resume': {}}} Aug 10 23:15:00.572094 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:15:00.572094 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:15:00.572094 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:15:00.572094 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:15:00.572094 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:15:00.572094 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:15:00.572094 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 10 23:15:00.572094 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 10 23:15:00.572094 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03ae4332-708e-4a07-936e-c62804cbd2ed could not be found. Aug 10 23:15:00.572094 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:15:00.572094 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:15:00.572094 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:15:00.572094 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:15:00.572094 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:15:00.572094 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:15:00.572094 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:15:00.572094 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:15:00.572094 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:15:00.572094 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:15:00.572094 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume Aug 10 23:15:00.572094 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Aug 10 23:15:00.572094 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:15:00.572094 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:15:00.572094 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03ae4332-708e-4a07-936e-c62804cbd2ed could not be found. Aug 10 23:15:00.572094 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:15:00.572094 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:15:00.572094 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:15:00.572094 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:15:00.572094 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:15:00.572094 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:15:00.575744 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:15:00.575744 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:15:00.575744 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03ae4332-708e-4a07-936e-c62804cbd2ed could not be found. Aug 10 23:15:00.575744 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:15:00.575744 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-29774d1a-a7eb-4870-9f6f-70b17092fbd4 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Returning 404 to user: Instance 03ae4332-708e-4a07-936e-c62804cbd2ed could not be found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:15:00.575744 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-29774d1a-a7eb-4870-9f6f-70b17092fbd4 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "POST /compute/v2.1/servers/03ae4332-708e-4a07-936e-c62804cbd2ed/action" status: 404 len: 111 microversion: 2.1 time: 0.024646 Aug 10 23:15:00.575744 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1861/3854] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:15:00 2022] POST /compute/v2.1/servers/03ae4332-708e-4a07-936e-c62804cbd2ed/action => generated 111 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:15:00.582769 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-2f078b0f-601a-433f-ba47-1b5e8eb734c2 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:00.583412 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-2f078b0f-601a-433f-ba47-1b5e8eb734c2 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:00.590617 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2f078b0f-601a-433f-ba47-1b5e8eb734c2 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:00.591410 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2f078b0f-601a-433f-ba47-1b5e8eb734c2 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:00.591850 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2f078b0f-601a-433f-ba47-1b5e8eb734c2 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:00.592601 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2f078b0f-601a-433f-ba47-1b5e8eb734c2 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:00.593263 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2f078b0f-601a-433f-ba47-1b5e8eb734c2 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:00.593736 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2f078b0f-601a-433f-ba47-1b5e8eb734c2 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:00.717581 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-02fdf5b9-80b4-4380-96dd-3176a1776844 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:00.718497 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-02fdf5b9-80b4-4380-96dd-3176a1776844 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] [instance: 7df225be-2dbc-4ef6-aeec-9a3de33a0006] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:00.722623 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_api:SELECT=100 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:15:00.727592 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-02fdf5b9-80b4-4380-96dd-3176a1776844 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:00.728614 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-02fdf5b9-80b4-4380-96dd-3176a1776844 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:00.729938 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-02fdf5b9-80b4-4380-96dd-3176a1776844 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:00.730808 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-02fdf5b9-80b4-4380-96dd-3176a1776844 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:00.731372 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-02fdf5b9-80b4-4380-96dd-3176a1776844 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:00.731931 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-02fdf5b9-80b4-4380-96dd-3176a1776844 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:00.858529 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-2f078b0f-601a-433f-ba47-1b5e8eb734c2 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:00.870667 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-2f078b0f-601a-433f-ba47-1b5e8eb734c2 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b" status: 200 len: 1506 microversion: 2.1 time: 0.291368 Aug 10 23:15:00.871920 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1994/3855] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:00 2022] GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b => generated 1506 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:00.881266 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-4c58bafb-13e1-480b-81d9-ff2bdcc4cb46 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:15:00.884259 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-4c58bafb-13e1-480b-81d9-ff2bdcc4cb46 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: 1da4d99f-4cb0-4533-bda8-3bda03205e07] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:00.894502 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4c58bafb-13e1-480b-81d9-ff2bdcc4cb46 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:00.895514 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4c58bafb-13e1-480b-81d9-ff2bdcc4cb46 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:00.896306 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4c58bafb-13e1-480b-81d9-ff2bdcc4cb46 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:00.898492 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4c58bafb-13e1-480b-81d9-ff2bdcc4cb46 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:00.899200 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4c58bafb-13e1-480b-81d9-ff2bdcc4cb46 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:00.899844 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4c58bafb-13e1-480b-81d9-ff2bdcc4cb46 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:00.953378 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-4c58bafb-13e1-480b-81d9-ff2bdcc4cb46 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "POST /compute/v2.1/servers/1da4d99f-4cb0-4533-bda8-3bda03205e07/action" status: 200 len: 14 microversion: 2.1 time: 0.079572 Aug 10 23:15:00.954847 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1995/3856] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:15:00 2022] POST /compute/v2.1/servers/1da4d99f-4cb0-4533-bda8-3bda03205e07/action => generated 14 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 23:15:00.964382 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-812b37ea-23b1-4508-b148-b15d11040da9 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:00.967234 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-812b37ea-23b1-4508-b148-b15d11040da9 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:00.977314 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-812b37ea-23b1-4508-b148-b15d11040da9 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:00.978157 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-812b37ea-23b1-4508-b148-b15d11040da9 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:00.978771 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-812b37ea-23b1-4508-b148-b15d11040da9 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:00.979651 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-812b37ea-23b1-4508-b148-b15d11040da9 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:00.980273 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-812b37ea-23b1-4508-b148-b15d11040da9 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:00.980846 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-812b37ea-23b1-4508-b148-b15d11040da9 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:01.219273 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-812b37ea-23b1-4508-b148-b15d11040da9 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:01.228806 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-812b37ea-23b1-4508-b148-b15d11040da9 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b" status: 200 len: 1506 microversion: 2.1 time: 0.272416 Aug 10 23:15:01.229718 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1996/3857] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:00 2022] GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b => generated 1506 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:01.251004 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c0f88372-82bf-48b7-a8fb-b79ab22ad884 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:15:01.251219 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-c0f88372-82bf-48b7-a8fb-b79ab22ad884 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:01.258089 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c0f88372-82bf-48b7-a8fb-b79ab22ad884 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:01.258583 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c0f88372-82bf-48b7-a8fb-b79ab22ad884 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:01.259058 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c0f88372-82bf-48b7-a8fb-b79ab22ad884 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:01.259774 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c0f88372-82bf-48b7-a8fb-b79ab22ad884 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:01.260256 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c0f88372-82bf-48b7-a8fb-b79ab22ad884 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:01.260683 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c0f88372-82bf-48b7-a8fb-b79ab22ad884 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:01.288579 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-c0f88372-82bf-48b7-a8fb-b79ab22ad884 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] HTTP exception thrown: Cannot 'resume' instance 23bbe055-4a92-4b96-8b89-c941229bfb0b while it is in vm_state active Aug 10 23:15:01.290432 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c0f88372-82bf-48b7-a8fb-b79ab22ad884 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Request method failure captured: Aug 10 23:15:01.290432 n-d-850468-14 devstack@n-api.service[122633]: request: POST /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b/action HTTP/1.1 Aug 10 23:15:01.290432 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:15:01.290432 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:15:01.290432 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:15:01.290432 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 14 Aug 10 23:15:01.290432 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:15:01.290432 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:15:01.290432 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:15:01.290432 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:15:01.290432 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9DuIKrfOsS8tKST0PsIPrvuNPfsVISfOPvUoe9ddkVcTJKj7rDjd3OuH9u-DTT1aypj1AUoUKtajD98eDOUOHSpPisBSdRlSCov30lHf1uZq-XZLyBIVg5kAG8-SuXk2s1TL7EnRcjjMARSkm95dZDnXaBXRT3M4f8UoMDwqu7xK7gQ Aug 10 23:15:01.290432 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:15:01.290432 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:15:01.290432 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:15:01.290432 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:15:01.290432 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:15:01.290432 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:15:01.290432 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: d11bbb3e87f4463787da56ab19108822 Aug 10 23:15:01.290432 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-ServersNegativeTestJSON-1216728002 Aug 10 23:15:01.290432 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:15:01.290432 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:15:01.290432 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d11bbb3e87f4463787da56ab19108822"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d11bbb3e87f4463787da56ab19108822"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d11bbb3e87f4463787da56ab19108822"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d11bbb3e87f4463787da56ab19108822", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:15:01.290432 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-ServersNegativeTestJSON-1216728002 Aug 10 23:15:01.290432 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: d11bbb3e87f4463787da56ab19108822 Aug 10 23:15:01.290432 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1216728002 Aug 10 23:15:01.290432 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-ServersNegativeTestJSON-1216728002-project Aug 10 23:15:01.290432 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:15:01.290432 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:15:01.290432 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: f284ec2a4bf546b58c1c1adaf880e1fb Aug 10 23:15:01.290432 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-ServersNegativeTestJSON-1216728002-project Aug 10 23:15:01.290432 n-d-850468-14 devstack@n-api.service[122633]: Aug 10 23:15:01.290432 n-d-850468-14 devstack@n-api.service[122633]: {"resume": {}} Aug 10 23:15:01.290432 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:15:01.290432 n-d-850468-14 devstack@n-api.service[122633]: exception: Cannot 'resume' instance 23bbe055-4a92-4b96-8b89-c941229bfb0b while it is in vm_state active Aug 10 23:15:01.290432 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': '23bbe055-4a92-4b96-8b89-c941229bfb0b', 'body': {'resume': {}}} Aug 10 23:15:01.290432 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:15:01.290432 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:15:01.290432 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume Aug 10 23:15:01.290432 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) Aug 10 23:15:01.290432 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 10 23:15:01.290432 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 10 23:15:01.290432 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 10 23:15:01.290432 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 10 23:15:01.290432 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 23bbe055-4a92-4b96-8b89-c941229bfb0b in vm_state active. Cannot resume while the instance is in this state. Aug 10 23:15:01.290432 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:15:01.290432 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:15:01.290432 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:15:01.290432 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:15:01.290432 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:15:01.290432 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:15:01.290432 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:15:01.290432 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:15:01.290432 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:15:01.290432 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:15:01.290432 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume Aug 10 23:15:01.290432 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 10 23:15:01.290432 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 10 23:15:01.290432 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 10 23:15:01.290432 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance 23bbe055-4a92-4b96-8b89-c941229bfb0b while it is in vm_state active Aug 10 23:15:01.290432 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:15:01.290432 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:15:01.290432 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:15:01.290432 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:15:01.290432 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:15:01.294026 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:15:01.294026 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:15:01.294026 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:15:01.294026 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance 23bbe055-4a92-4b96-8b89-c941229bfb0b while it is in vm_state active Aug 10 23:15:01.294026 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:15:01.294026 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c0f88372-82bf-48b7-a8fb-b79ab22ad884 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Returning 409 to user: Cannot 'resume' instance 23bbe055-4a92-4b96-8b89-c941229bfb0b while it is in vm_state active {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:15:01.294026 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-c0f88372-82bf-48b7-a8fb-b79ab22ad884 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "POST /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b/action" status: 409 len: 144 microversion: 2.1 time: 0.046061 Aug 10 23:15:01.295799 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1997/3858] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:15:01 2022] POST /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b/action => generated 144 bytes in 51 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 10 23:15:01.300644 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-0e3ffca7-fb9a-4d66-9a73-8ff6b03a3150 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:01.301255 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-0e3ffca7-fb9a-4d66-9a73-8ff6b03a3150 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: 7a8f8d36-4744-43b7-9d42-e50fb5fabe60] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:01.307936 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0e3ffca7-fb9a-4d66-9a73-8ff6b03a3150 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:01.308435 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0e3ffca7-fb9a-4d66-9a73-8ff6b03a3150 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:01.308879 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0e3ffca7-fb9a-4d66-9a73-8ff6b03a3150 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:01.309600 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0e3ffca7-fb9a-4d66-9a73-8ff6b03a3150 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:01.310063 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0e3ffca7-fb9a-4d66-9a73-8ff6b03a3150 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:01.310751 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0e3ffca7-fb9a-4d66-9a73-8ff6b03a3150 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:01.534851 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-02fdf5b9-80b4-4380-96dd-3176a1776844 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07c94ebf0954cdea12b9a689538d96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395d7c4077e54c43bb95288db3942b0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:01.547157 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-02fdf5b9-80b4-4380-96dd-3176a1776844 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] 10.222.0.58 "GET /compute/v2.1/servers/7df225be-2dbc-4ef6-aeec-9a3de33a0006" status: 200 len: 1522 microversion: 2.1 time: 0.833391 Aug 10 23:15:01.547735 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1862/3859] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:00 2022] GET /compute/v2.1/servers/7df225be-2dbc-4ef6-aeec-9a3de33a0006 => generated 1522 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:15:01.566675 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-41463df0-7be6-420a-9690-34f1ccfe827f tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:01.567447 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-41463df0-7be6-420a-9690-34f1ccfe827f tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:01.575864 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-41463df0-7be6-420a-9690-34f1ccfe827f tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:01.576577 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-41463df0-7be6-420a-9690-34f1ccfe827f tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:01.577224 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-41463df0-7be6-420a-9690-34f1ccfe827f tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:01.578867 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-41463df0-7be6-420a-9690-34f1ccfe827f tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:01.579551 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-41463df0-7be6-420a-9690-34f1ccfe827f tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:01.580789 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-41463df0-7be6-420a-9690-34f1ccfe827f tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:01.613056 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-0e3ffca7-fb9a-4d66-9a73-8ff6b03a3150 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6160c7a42740efbe3613380933fa15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d90f8a58ad047fa8f347d6474e4d673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:01.626544 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-0e3ffca7-fb9a-4d66-9a73-8ff6b03a3150 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "GET /compute/v2.1/servers/7a8f8d36-4744-43b7-9d42-e50fb5fabe60" status: 200 len: 1510 microversion: 2.1 time: 0.329555 Aug 10 23:15:01.627453 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1998/3860] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:01 2022] GET /compute/v2.1/servers/7a8f8d36-4744-43b7-9d42-e50fb5fabe60 => generated 1510 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:01.968497 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-572a2de5-18e2-4f0c-80f5-e841edd809ee tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:15:01.971122 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-572a2de5-18e2-4f0c-80f5-e841edd809ee tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: 1da4d99f-4cb0-4533-bda8-3bda03205e07] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:01.978996 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-572a2de5-18e2-4f0c-80f5-e841edd809ee tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:01.979721 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-572a2de5-18e2-4f0c-80f5-e841edd809ee tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:01.980643 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-572a2de5-18e2-4f0c-80f5-e841edd809ee tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:01.981690 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-572a2de5-18e2-4f0c-80f5-e841edd809ee tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:01.982302 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-572a2de5-18e2-4f0c-80f5-e841edd809ee tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:01.983316 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-572a2de5-18e2-4f0c-80f5-e841edd809ee tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:02.033165 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-572a2de5-18e2-4f0c-80f5-e841edd809ee tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "POST /compute/v2.1/servers/1da4d99f-4cb0-4533-bda8-3bda03205e07/action" status: 200 len: 14 microversion: 2.1 time: 0.069763 Aug 10 23:15:02.039451 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 1999/3861] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:15:01 2022] POST /compute/v2.1/servers/1da4d99f-4cb0-4533-bda8-3bda03205e07/action => generated 14 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 23:15:02.051743 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-41463df0-7be6-420a-9690-34f1ccfe827f tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:02.063244 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-41463df0-7be6-420a-9690-34f1ccfe827f tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b" status: 200 len: 1506 microversion: 2.1 time: 0.513976 Aug 10 23:15:02.066174 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1863/3862] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:01 2022] GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b => generated 1506 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:02.087538 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-54253928-62d7-4412-ab33-533d0b28f73f tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:02.088973 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-54253928-62d7-4412-ab33-533d0b28f73f tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:02.098186 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-54253928-62d7-4412-ab33-533d0b28f73f tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:02.098693 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-54253928-62d7-4412-ab33-533d0b28f73f tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:02.099174 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-54253928-62d7-4412-ab33-533d0b28f73f tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:02.099931 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-54253928-62d7-4412-ab33-533d0b28f73f tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:02.100573 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-54253928-62d7-4412-ab33-533d0b28f73f tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:02.101015 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-54253928-62d7-4412-ab33-533d0b28f73f tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:02.529752 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-54253928-62d7-4412-ab33-533d0b28f73f tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:02.547585 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-54253928-62d7-4412-ab33-533d0b28f73f tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b" status: 200 len: 1506 microversion: 2.1 time: 0.465715 Aug 10 23:15:02.548533 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2000/3863] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:02 2022] GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b => generated 1506 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:02.574245 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c38957be-6549-4f6a-9ae1-a6c3913ed890 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:02.574850 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-c38957be-6549-4f6a-9ae1-a6c3913ed890 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] [instance: 7df225be-2dbc-4ef6-aeec-9a3de33a0006] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:02.586331 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c38957be-6549-4f6a-9ae1-a6c3913ed890 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:02.586848 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c38957be-6549-4f6a-9ae1-a6c3913ed890 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:02.587297 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c38957be-6549-4f6a-9ae1-a6c3913ed890 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:02.588103 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c38957be-6549-4f6a-9ae1-a6c3913ed890 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:02.588450 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c38957be-6549-4f6a-9ae1-a6c3913ed890 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:02.588876 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c38957be-6549-4f6a-9ae1-a6c3913ed890 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:02.649363 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-28afc451-e802-4a9a-b9be-6b20a8f46b37 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:02.649983 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-28afc451-e802-4a9a-b9be-6b20a8f46b37 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: 7a8f8d36-4744-43b7-9d42-e50fb5fabe60] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:02.660613 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-28afc451-e802-4a9a-b9be-6b20a8f46b37 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:02.661157 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-28afc451-e802-4a9a-b9be-6b20a8f46b37 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:02.661631 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-28afc451-e802-4a9a-b9be-6b20a8f46b37 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:02.662351 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-28afc451-e802-4a9a-b9be-6b20a8f46b37 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:02.671855 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-28afc451-e802-4a9a-b9be-6b20a8f46b37 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:02.673186 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-28afc451-e802-4a9a-b9be-6b20a8f46b37 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:02.680152 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=100 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:15:02.979678 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-28afc451-e802-4a9a-b9be-6b20a8f46b37 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6160c7a42740efbe3613380933fa15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d90f8a58ad047fa8f347d6474e4d673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:02.989459 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-28afc451-e802-4a9a-b9be-6b20a8f46b37 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "GET /compute/v2.1/servers/7a8f8d36-4744-43b7-9d42-e50fb5fabe60" status: 200 len: 1510 microversion: 2.1 time: 0.344402 Aug 10 23:15:02.994216 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2001/3864] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:02 2022] GET /compute/v2.1/servers/7a8f8d36-4744-43b7-9d42-e50fb5fabe60 => generated 1510 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:03.008218 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-d6b0393b-216c-4e94-bc7c-912d7ff047c6 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452", "networks": [{"uuid": "91d0258a-9486-4479-91e9-a6d9339a2e0a"}]}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:15:03.021663 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-d6b0393b-216c-4e94-bc7c-912d7ff047c6 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Request method failure captured: Aug 10 23:15:03.021663 n-d-850468-14 devstack@n-api.service[122633]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 10 23:15:03.021663 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:15:03.021663 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:15:03.021663 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:15:03.021663 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 160 Aug 10 23:15:03.021663 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:15:03.021663 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:15:03.021663 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:15:03.021663 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:15:03.021663 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9DuIKrfOsS8tKST0PsIPrvuNPfsVISfOPvUoe9ddkVcTJKj7rDjd3OuH9u-DTT1aypj1AUoUKtajD98eDOUOHSpPisBSdRlSCov30lHf1uZq-XZLyBIVg5kAG8-SuXk2s1TL7EnRcjjMARSkm95dZDnXaBXRT3M4f8UoMDwqu7xK7gQ Aug 10 23:15:03.021663 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:15:03.021663 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:15:03.021663 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:15:03.021663 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:15:03.021663 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:15:03.021663 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:15:03.021663 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: d11bbb3e87f4463787da56ab19108822 Aug 10 23:15:03.021663 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-ServersNegativeTestJSON-1216728002 Aug 10 23:15:03.021663 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:15:03.021663 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:15:03.021663 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d11bbb3e87f4463787da56ab19108822"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d11bbb3e87f4463787da56ab19108822"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d11bbb3e87f4463787da56ab19108822"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d11bbb3e87f4463787da56ab19108822", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:15:03.021663 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-ServersNegativeTestJSON-1216728002 Aug 10 23:15:03.021663 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: d11bbb3e87f4463787da56ab19108822 Aug 10 23:15:03.021663 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1216728002 Aug 10 23:15:03.021663 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-ServersNegativeTestJSON-1216728002-project Aug 10 23:15:03.021663 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:15:03.021663 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:15:03.021663 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: f284ec2a4bf546b58c1c1adaf880e1fb Aug 10 23:15:03.021663 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-ServersNegativeTestJSON-1216728002-project Aug 10 23:15:03.021663 n-d-850468-14 devstack@n-api.service[122633]: Aug 10 23:15:03.021663 n-d-850468-14 devstack@n-api.service[122633]: {"server": {"name": "", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452", "networks": [{"uuid": "91d0258a-9486-4479-91e9-a6d9339a2e0a"}]}} Aug 10 23:15:03.021663 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:15:03.021663 n-d-850468-14 devstack@n-api.service[122633]: exception: Invalid input for field/attribute name. Value: . '' is too short Aug 10 23:15:03.021663 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'body': {'server': {'name': '', 'imageRef': '78ad8905-f66f-4733-8be9-2b260f1fabed', 'flavorRef': '452', 'networks': [{'uuid': '91d0258a-9486-4479-91e9-a6d9339a2e0a'}]}}} Aug 10 23:15:03.021663 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:15:03.021663 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:15:03.021663 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 10 23:15:03.021663 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 10 23:15:03.021663 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 10 23:15:03.021663 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise error Aug 10 23:15:03.021663 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 10 23:15:03.021663 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:15:03.021663 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Aug 10 23:15:03.021663 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 10 23:15:03.021663 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:15:03.021663 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 10 23:15:03.021663 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi '' Aug 10 23:15:03.021663 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:15:03.021663 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:15:03.021663 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:15:03.021663 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:15:03.021663 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:15:03.021663 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:15:03.021663 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:15:03.021663 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:15:03.021663 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:15:03.021663 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:15:03.021663 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 23:15:03.021663 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 23:15:03.021663 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 10 23:15:03.021663 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 10 23:15:03.021663 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 10 23:15:03.021663 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 10 23:15:03.021663 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 10 23:15:03.051405 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 10 23:15:03.051405 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Aug 10 23:15:03.051405 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:15:03.051405 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:15:03.051405 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:15:03.051405 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:15:03.051405 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:15:03.051405 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:15:03.051405 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 10 23:15:03.051405 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 10 23:15:03.051405 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Aug 10 23:15:03.051405 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:15:03.051405 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-d6b0393b-216c-4e94-bc7c-912d7ff047c6 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:15:03.051405 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-d6b0393b-216c-4e94-bc7c-912d7ff047c6 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.038391 Aug 10 23:15:03.051405 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2002/3865] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 23:15:02 2022] POST /compute/v2.1/servers => generated 108 bytes in 40 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 10 23:15:03.059720 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-c38957be-6549-4f6a-9ae1-a6c3913ed890 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07c94ebf0954cdea12b9a689538d96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395d7c4077e54c43bb95288db3942b0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:03.091824 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-c38957be-6549-4f6a-9ae1-a6c3913ed890 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] 10.222.0.58 "GET /compute/v2.1/servers/7df225be-2dbc-4ef6-aeec-9a3de33a0006" status: 200 len: 1522 microversion: 2.1 time: 0.519856 Aug 10 23:15:03.096632 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1864/3866] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:02 2022] GET /compute/v2.1/servers/7df225be-2dbc-4ef6-aeec-9a3de33a0006 => generated 1522 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:03.125425 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-2f8b31a1-27b0-4c83-a106-4fe469ce52e0 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:03.126149 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-2f8b31a1-27b0-4c83-a106-4fe469ce52e0 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:03.140670 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2f8b31a1-27b0-4c83-a106-4fe469ce52e0 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:03.141166 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2f8b31a1-27b0-4c83-a106-4fe469ce52e0 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:03.149979 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2f8b31a1-27b0-4c83-a106-4fe469ce52e0 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:03.152808 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2f8b31a1-27b0-4c83-a106-4fe469ce52e0 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:03.155813 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2f8b31a1-27b0-4c83-a106-4fe469ce52e0 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:03.156322 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2f8b31a1-27b0-4c83-a106-4fe469ce52e0 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:03.430811 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-2a7b5866-3f4f-4288-b85b-48b24c084da3 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1523915528", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452", "networks": [{"uuid": "160706c8-901f-4f25-9966-5313bee0e064"}]}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:15:03.523390 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-2f8b31a1-27b0-4c83-a106-4fe469ce52e0 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:03.536247 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-2f8b31a1-27b0-4c83-a106-4fe469ce52e0 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b" status: 200 len: 1506 microversion: 2.1 time: 0.429428 Aug 10 23:15:03.543233 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1865/3867] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:03 2022] GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b => generated 1506 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:03.558640 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-05d3df8a-a5ce-4f6a-aefc-1d3b9d83bcc5 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:15:03.576145 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.network.neutron [None req-2a7b5866-3f4f-4288-b85b-48b24c084da3 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] validate_networks() for [('160706c8-901f-4f25-9966-5313bee0e064', None, None, None, None, None)] {{(pid=122633) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 23:15:03.587033 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-05d3df8a-a5ce-4f6a-aefc-1d3b9d83bcc5 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: 1da4d99f-4cb0-4533-bda8-3bda03205e07] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:03.616306 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-05d3df8a-a5ce-4f6a-aefc-1d3b9d83bcc5 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:03.620625 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-05d3df8a-a5ce-4f6a-aefc-1d3b9d83bcc5 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:03.621159 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-05d3df8a-a5ce-4f6a-aefc-1d3b9d83bcc5 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:03.621921 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-05d3df8a-a5ce-4f6a-aefc-1d3b9d83bcc5 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:03.623565 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-05d3df8a-a5ce-4f6a-aefc-1d3b9d83bcc5 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:03.624765 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-05d3df8a-a5ce-4f6a-aefc-1d3b9d83bcc5 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:03.707377 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-05d3df8a-a5ce-4f6a-aefc-1d3b9d83bcc5 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "POST /compute/v2.1/servers/1da4d99f-4cb0-4533-bda8-3bda03205e07/action" status: 200 len: 14 microversion: 2.1 time: 0.149710 Aug 10 23:15:03.708313 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1866/3868] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:15:03 2022] POST /compute/v2.1/servers/1da4d99f-4cb0-4533-bda8-3bda03205e07/action => generated 14 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 23:15:03.733611 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-09ef28c9-8738-4068-8eb2-e6385fffc1ff tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:03.745829 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-09ef28c9-8738-4068-8eb2-e6385fffc1ff tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:03.762164 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-09ef28c9-8738-4068-8eb2-e6385fffc1ff tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:03.762863 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-09ef28c9-8738-4068-8eb2-e6385fffc1ff tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:03.763519 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-09ef28c9-8738-4068-8eb2-e6385fffc1ff tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:03.764638 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-09ef28c9-8738-4068-8eb2-e6385fffc1ff tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:03.765328 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-09ef28c9-8738-4068-8eb2-e6385fffc1ff tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:03.765903 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-09ef28c9-8738-4068-8eb2-e6385fffc1ff tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:03.810818 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=100 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:15:04.203922 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-09ef28c9-8738-4068-8eb2-e6385fffc1ff tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:04.212959 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-09ef28c9-8738-4068-8eb2-e6385fffc1ff tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b" status: 200 len: 1506 microversion: 2.1 time: 0.502652 Aug 10 23:15:04.213549 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1867/3869] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:03 2022] GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b => generated 1506 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:04.238399 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-f7914187-b356-4115-992c-96f6318d30c6 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:04.242491 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-f7914187-b356-4115-992c-96f6318d30c6 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: 7a8f8d36-4744-43b7-9d42-e50fb5fabe60] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:04.254522 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f7914187-b356-4115-992c-96f6318d30c6 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:04.257439 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f7914187-b356-4115-992c-96f6318d30c6 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:04.257883 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f7914187-b356-4115-992c-96f6318d30c6 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:04.258681 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f7914187-b356-4115-992c-96f6318d30c6 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:04.260163 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f7914187-b356-4115-992c-96f6318d30c6 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:04.260693 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f7914187-b356-4115-992c-96f6318d30c6 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:04.663216 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-2a7b5866-3f4f-4288-b85b-48b24c084da3 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Flavor limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:15:04.667019 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-2a7b5866-3f4f-4288-b85b-48b24c084da3 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Image limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:15:04.668770 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-2a7b5866-3f4f-4288-b85b-48b24c084da3 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Flavor pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:15:04.670080 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-2a7b5866-3f4f-4288-b85b-48b24c084da3 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Image pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:15:04.670953 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-2a7b5866-3f4f-4288-b85b-48b24c084da3 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:15:04.672390 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-f7914187-b356-4115-992c-96f6318d30c6 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6160c7a42740efbe3613380933fa15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d90f8a58ad047fa8f347d6474e4d673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:04.684697 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-f7914187-b356-4115-992c-96f6318d30c6 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "GET /compute/v2.1/servers/7a8f8d36-4744-43b7-9d42-e50fb5fabe60" status: 200 len: 1510 microversion: 2.1 time: 0.452327 Aug 10 23:15:04.685553 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1868/3870] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:04 2022] GET /compute/v2.1/servers/7a8f8d36-4744-43b7-9d42-e50fb5fabe60 => generated 1510 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:04.705670 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-2a2b2430-a7b7-4774-9089-a55394d80e88 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:04.706293 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-2a2b2430-a7b7-4774-9089-a55394d80e88 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] [instance: 7df225be-2dbc-4ef6-aeec-9a3de33a0006] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:04.714010 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2a2b2430-a7b7-4774-9089-a55394d80e88 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:04.714500 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2a2b2430-a7b7-4774-9089-a55394d80e88 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:04.715454 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2a2b2430-a7b7-4774-9089-a55394d80e88 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:04.717941 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2a2b2430-a7b7-4774-9089-a55394d80e88 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:04.718939 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2a2b2430-a7b7-4774-9089-a55394d80e88 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:04.720068 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2a2b2430-a7b7-4774-9089-a55394d80e88 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:04.723219 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2a7b5866-3f4f-4288-b85b-48b24c084da3 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:04.726150 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2a7b5866-3f4f-4288-b85b-48b24c084da3 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:04.726735 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2a7b5866-3f4f-4288-b85b-48b24c084da3 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:04.727659 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2a7b5866-3f4f-4288-b85b-48b24c084da3 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:04.730101 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2a7b5866-3f4f-4288-b85b-48b24c084da3 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:04.736812 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2a7b5866-3f4f-4288-b85b-48b24c084da3 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:04.772618 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-2a7b5866-3f4f-4288-b85b-48b24c084da3 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Getting quotas for project 578d8e62013d43c5ad4d9a6d92e1f201. Resources: {'instances', 'cores', 'ram'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:15:04.800638 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-2a7b5866-3f4f-4288-b85b-48b24c084da3 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Getting quotas for user 06cc4167255044d29a70c12a5a44d800 and project 578d8e62013d43c5ad4d9a6d92e1f201. Resources: {'instances', 'cores', 'ram'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:15:04.832341 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-2a7b5866-3f4f-4288-b85b-48b24c084da3 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Going to run 1 instances... {{(pid=122633) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 23:15:04.836198 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-2a7b5866-3f4f-4288-b85b-48b24c084da3 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] [instance: fdd1f85d-95db-477c-a173-a6fca94f58b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78ad8905-f66f-4733-8be9-2b260f1fabed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122633) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 23:15:04.938959 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-2a7b5866-3f4f-4288-b85b-48b24c084da3 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.896877 Aug 10 23:15:04.942744 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2003/3871] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 23:15:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 1907 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 23:15:04.953697 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-1c9423e4-90f4-4d22-8b88-92e783cfad45 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:15:04.957902 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-1c9423e4-90f4-4d22-8b88-92e783cfad45 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: ab3c3e56-e114-4cd7-8755-bff7482e3449] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:04.986011 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-1c9423e4-90f4-4d22-8b88-92e783cfad45 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] HTTP exception thrown: Instance ab3c3e56-e114-4cd7-8755-bff7482e3449 could not be found. Aug 10 23:15:04.995653 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-1c9423e4-90f4-4d22-8b88-92e783cfad45 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Request method failure captured: Aug 10 23:15:04.995653 n-d-850468-14 devstack@n-api.service[122633]: request: POST /compute/v2.1/servers/ab3c3e56-e114-4cd7-8755-bff7482e3449/action HTTP/1.1 Aug 10 23:15:04.995653 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:15:04.995653 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:15:04.995653 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:15:04.995653 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 14 Aug 10 23:15:04.995653 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:15:04.995653 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:15:04.995653 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:15:04.995653 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:15:04.995653 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9DuIKrfOsS8tKST0PsIPrvuNPfsVISfOPvUoe9ddkVcTJKj7rDjd3OuH9u-DTT1aypj1AUoUKtajD98eDOUOHSpPisBSdRlSCov30lHf1uZq-XZLyBIVg5kAG8-SuXk2s1TL7EnRcjjMARSkm95dZDnXaBXRT3M4f8UoMDwqu7xK7gQ Aug 10 23:15:04.995653 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:15:04.995653 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:15:04.995653 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:15:04.995653 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:15:04.995653 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:15:04.995653 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:15:04.995653 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: d11bbb3e87f4463787da56ab19108822 Aug 10 23:15:04.995653 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-ServersNegativeTestJSON-1216728002 Aug 10 23:15:04.995653 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:15:04.995653 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:15:04.995653 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d11bbb3e87f4463787da56ab19108822"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d11bbb3e87f4463787da56ab19108822"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d11bbb3e87f4463787da56ab19108822"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d11bbb3e87f4463787da56ab19108822", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:15:04.995653 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-ServersNegativeTestJSON-1216728002 Aug 10 23:15:04.995653 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: d11bbb3e87f4463787da56ab19108822 Aug 10 23:15:04.995653 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1216728002 Aug 10 23:15:04.995653 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-ServersNegativeTestJSON-1216728002-project Aug 10 23:15:04.995653 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:15:04.995653 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:15:04.995653 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: f284ec2a4bf546b58c1c1adaf880e1fb Aug 10 23:15:04.995653 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-ServersNegativeTestJSON-1216728002-project Aug 10 23:15:04.995653 n-d-850468-14 devstack@n-api.service[122633]: Aug 10 23:15:04.995653 n-d-850468-14 devstack@n-api.service[122633]: {"shelve": {}} Aug 10 23:15:04.995653 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:15:04.995653 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance ab3c3e56-e114-4cd7-8755-bff7482e3449 could not be found. Aug 10 23:15:04.995653 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': 'ab3c3e56-e114-4cd7-8755-bff7482e3449', 'body': {'shelve': {}}} Aug 10 23:15:04.995653 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:15:04.995653 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:15:04.995653 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:15:04.995653 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:15:04.995653 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:15:04.995653 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:15:04.995653 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 10 23:15:04.995653 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 10 23:15:04.995653 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab3c3e56-e114-4cd7-8755-bff7482e3449 could not be found. Aug 10 23:15:04.995653 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:15:04.995653 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:15:04.995653 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:15:04.995653 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:15:04.995653 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:15:04.995653 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:15:04.995653 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:15:04.995653 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:15:04.995653 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:15:04.995653 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:15:04.995653 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve Aug 10 23:15:04.995653 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 10 23:15:04.995653 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:15:04.995653 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:15:04.995653 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab3c3e56-e114-4cd7-8755-bff7482e3449 could not be found. Aug 10 23:15:04.995653 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:15:04.995653 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:15:04.995653 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:15:04.995653 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:15:04.995653 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:15:04.995653 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:15:05.002260 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:15:05.002260 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:15:05.002260 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab3c3e56-e114-4cd7-8755-bff7482e3449 could not be found. Aug 10 23:15:05.002260 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:15:05.002260 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-1c9423e4-90f4-4d22-8b88-92e783cfad45 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Returning 404 to user: Instance ab3c3e56-e114-4cd7-8755-bff7482e3449 could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:15:05.002260 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-1c9423e4-90f4-4d22-8b88-92e783cfad45 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "POST /compute/v2.1/servers/ab3c3e56-e114-4cd7-8755-bff7482e3449/action" status: 404 len: 111 microversion: 2.1 time: 0.052789 Aug 10 23:15:05.005162 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2004/3872] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:15:04 2022] POST /compute/v2.1/servers/ab3c3e56-e114-4cd7-8755-bff7482e3449/action => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:15:05.022265 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-ecdcfd40-6d66-4b20-bec6-1f34645fa7bb tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:15:05.044341 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-ecdcfd40-6d66-4b20-bec6-1f34645fa7bb tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: 1da4d99f-4cb0-4533-bda8-3bda03205e07] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:05.396337 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-2a2b2430-a7b7-4774-9089-a55394d80e88 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07c94ebf0954cdea12b9a689538d96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395d7c4077e54c43bb95288db3942b0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:05.408873 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-2a2b2430-a7b7-4774-9089-a55394d80e88 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] 10.222.0.58 "GET /compute/v2.1/servers/7df225be-2dbc-4ef6-aeec-9a3de33a0006" status: 200 len: 1522 microversion: 2.1 time: 0.719639 Aug 10 23:15:05.411150 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1869/3873] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:04 2022] GET /compute/v2.1/servers/7df225be-2dbc-4ef6-aeec-9a3de33a0006 => generated 1522 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:05.417998 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-802e96bf-f1e9-49f6-84b1-6712db5f37cc tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:05.418960 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-802e96bf-f1e9-49f6-84b1-6712db5f37cc tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:05.426001 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-802e96bf-f1e9-49f6-84b1-6712db5f37cc tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:05.426840 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-802e96bf-f1e9-49f6-84b1-6712db5f37cc tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:05.429369 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-802e96bf-f1e9-49f6-84b1-6712db5f37cc tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:05.430853 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-802e96bf-f1e9-49f6-84b1-6712db5f37cc tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:05.431657 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-802e96bf-f1e9-49f6-84b1-6712db5f37cc tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:05.433120 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-802e96bf-f1e9-49f6-84b1-6712db5f37cc tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:05.572154 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ecdcfd40-6d66-4b20-bec6-1f34645fa7bb tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:05.572663 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ecdcfd40-6d66-4b20-bec6-1f34645fa7bb tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:05.573185 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ecdcfd40-6d66-4b20-bec6-1f34645fa7bb tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:05.573820 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ecdcfd40-6d66-4b20-bec6-1f34645fa7bb tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:05.574344 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ecdcfd40-6d66-4b20-bec6-1f34645fa7bb tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:05.574880 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ecdcfd40-6d66-4b20-bec6-1f34645fa7bb tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:05.622984 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-ecdcfd40-6d66-4b20-bec6-1f34645fa7bb tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "POST /compute/v2.1/servers/1da4d99f-4cb0-4533-bda8-3bda03205e07/action" status: 200 len: 14 microversion: 2.1 time: 0.616035 Aug 10 23:15:05.623708 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2005/3874] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:15:05 2022] POST /compute/v2.1/servers/1da4d99f-4cb0-4533-bda8-3bda03205e07/action => generated 14 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 23:15:05.629211 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-9c9f2f0d-ec20-4839-9edb-8280e96670d1 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-2086885579", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452", "networks": [{"uuid": "160706c8-901f-4f25-9966-5313bee0e064"}]}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:15:05.698761 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.network.neutron [None req-9c9f2f0d-ec20-4839-9edb-8280e96670d1 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] validate_networks() for [('160706c8-901f-4f25-9966-5313bee0e064', None, None, None, None, None)] {{(pid=122633) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 23:15:05.963779 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-802e96bf-f1e9-49f6-84b1-6712db5f37cc tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:05.977554 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-802e96bf-f1e9-49f6-84b1-6712db5f37cc tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b" status: 200 len: 1506 microversion: 2.1 time: 0.564220 Aug 10 23:15:05.980003 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1870/3875] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:05 2022] GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b => generated 1506 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:06.014147 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-82886e49-12af-4fc0-8e97-644ca166484c tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:06.015740 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-82886e49-12af-4fc0-8e97-644ca166484c tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: 7a8f8d36-4744-43b7-9d42-e50fb5fabe60] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:06.041148 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-82886e49-12af-4fc0-8e97-644ca166484c tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:06.042252 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-82886e49-12af-4fc0-8e97-644ca166484c tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:06.045694 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-82886e49-12af-4fc0-8e97-644ca166484c tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:06.046684 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-82886e49-12af-4fc0-8e97-644ca166484c tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:06.048658 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-82886e49-12af-4fc0-8e97-644ca166484c tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:06.050689 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-82886e49-12af-4fc0-8e97-644ca166484c tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:06.595793 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-82886e49-12af-4fc0-8e97-644ca166484c tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6160c7a42740efbe3613380933fa15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d90f8a58ad047fa8f347d6474e4d673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:06.610928 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-82886e49-12af-4fc0-8e97-644ca166484c tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "GET /compute/v2.1/servers/7a8f8d36-4744-43b7-9d42-e50fb5fabe60" status: 200 len: 1487 microversion: 2.1 time: 0.610742 Aug 10 23:15:06.612315 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1871/3876] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:05 2022] GET /compute/v2.1/servers/7a8f8d36-4744-43b7-9d42-e50fb5fabe60 => generated 1487 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:06.622667 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-1edd7ae1-7a7b-4ac5-9efc-be6b7687572b tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:06.623334 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-1edd7ae1-7a7b-4ac5-9efc-be6b7687572b tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:06.632932 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1edd7ae1-7a7b-4ac5-9efc-be6b7687572b tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:06.633554 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1edd7ae1-7a7b-4ac5-9efc-be6b7687572b tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:06.634143 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1edd7ae1-7a7b-4ac5-9efc-be6b7687572b tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:06.634939 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1edd7ae1-7a7b-4ac5-9efc-be6b7687572b tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:06.635628 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1edd7ae1-7a7b-4ac5-9efc-be6b7687572b tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:06.636211 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1edd7ae1-7a7b-4ac5-9efc-be6b7687572b tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:07.023374 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-1edd7ae1-7a7b-4ac5-9efc-be6b7687572b tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:07.037513 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-1edd7ae1-7a7b-4ac5-9efc-be6b7687572b tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b" status: 200 len: 1506 microversion: 2.1 time: 0.423210 Aug 10 23:15:07.045422 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1872/3877] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:06 2022] GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b => generated 1506 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:07.051517 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-bacbf7bc-b958-4999-810c-37c9ac3cc843 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:07.052375 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-bacbf7bc-b958-4999-810c-37c9ac3cc843 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] [instance: 7df225be-2dbc-4ef6-aeec-9a3de33a0006] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:07.066531 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bacbf7bc-b958-4999-810c-37c9ac3cc843 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:07.067413 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bacbf7bc-b958-4999-810c-37c9ac3cc843 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:07.069497 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bacbf7bc-b958-4999-810c-37c9ac3cc843 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:07.070422 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bacbf7bc-b958-4999-810c-37c9ac3cc843 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:07.071114 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bacbf7bc-b958-4999-810c-37c9ac3cc843 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:07.071757 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bacbf7bc-b958-4999-810c-37c9ac3cc843 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:07.215167 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-9c9f2f0d-ec20-4839-9edb-8280e96670d1 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Flavor limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:15:07.215698 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-9c9f2f0d-ec20-4839-9edb-8280e96670d1 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Image limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:15:07.216052 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-9c9f2f0d-ec20-4839-9edb-8280e96670d1 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Flavor pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:15:07.216694 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-9c9f2f0d-ec20-4839-9edb-8280e96670d1 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Image pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:15:07.217364 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-9c9f2f0d-ec20-4839-9edb-8280e96670d1 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:15:07.233096 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9c9f2f0d-ec20-4839-9edb-8280e96670d1 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:07.233478 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9c9f2f0d-ec20-4839-9edb-8280e96670d1 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:07.233899 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9c9f2f0d-ec20-4839-9edb-8280e96670d1 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:07.243002 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9c9f2f0d-ec20-4839-9edb-8280e96670d1 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:07.243523 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9c9f2f0d-ec20-4839-9edb-8280e96670d1 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:07.243983 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9c9f2f0d-ec20-4839-9edb-8280e96670d1 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:07.280515 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-9c9f2f0d-ec20-4839-9edb-8280e96670d1 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Getting quotas for project 578d8e62013d43c5ad4d9a6d92e1f201. Resources: {'instances', 'cores', 'ram'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:15:07.289604 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-9c9f2f0d-ec20-4839-9edb-8280e96670d1 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Getting quotas for user 06cc4167255044d29a70c12a5a44d800 and project 578d8e62013d43c5ad4d9a6d92e1f201. Resources: {'instances', 'cores', 'ram'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:15:07.319129 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-9c9f2f0d-ec20-4839-9edb-8280e96670d1 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Going to run 1 instances... {{(pid=122633) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 23:15:07.335524 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-9c9f2f0d-ec20-4839-9edb-8280e96670d1 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] [instance: c679e2a4-89de-4fcf-aed1-273220fdb2e8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78ad8905-f66f-4733-8be9-2b260f1fabed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122633) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 23:15:07.412074 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-9c9f2f0d-ec20-4839-9edb-8280e96670d1 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.786310 Aug 10 23:15:07.425679 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2006/3878] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 23:15:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1801 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 23:15:07.434233 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-9f254a2d-6dff-49f4-acae-9d6a09dc4fb4 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:07.436239 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-9f254a2d-6dff-49f4-acae-9d6a09dc4fb4 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: 7a8f8d36-4744-43b7-9d42-e50fb5fabe60] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:07.448283 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:15:07.450619 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9f254a2d-6dff-49f4-acae-9d6a09dc4fb4 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:07.451832 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9f254a2d-6dff-49f4-acae-9d6a09dc4fb4 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:07.452870 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9f254a2d-6dff-49f4-acae-9d6a09dc4fb4 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:07.453814 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9f254a2d-6dff-49f4-acae-9d6a09dc4fb4 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:07.454436 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9f254a2d-6dff-49f4-acae-9d6a09dc4fb4 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:07.455125 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9f254a2d-6dff-49f4-acae-9d6a09dc4fb4 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:07.496373 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-9f254a2d-6dff-49f4-acae-9d6a09dc4fb4 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: 7a8f8d36-4744-43b7-9d42-e50fb5fabe60] Going to try to terminate instance {{(pid=122633) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:15:07.574044 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-bacbf7bc-b958-4999-810c-37c9ac3cc843 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07c94ebf0954cdea12b9a689538d96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395d7c4077e54c43bb95288db3942b0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:07.588173 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-bacbf7bc-b958-4999-810c-37c9ac3cc843 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] 10.222.0.58 "GET /compute/v2.1/servers/7df225be-2dbc-4ef6-aeec-9a3de33a0006" status: 200 len: 1522 microversion: 2.1 time: 0.541147 Aug 10 23:15:07.589376 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1873/3879] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:07 2022] GET /compute/v2.1/servers/7df225be-2dbc-4ef6-aeec-9a3de33a0006 => generated 1522 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:07.595673 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-a5ca7698-94cf-4d3b-aa83-0f5dd799ec99 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:15:07.602754 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-a5ca7698-94cf-4d3b-aa83-0f5dd799ec99 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: 1da4d99f-4cb0-4533-bda8-3bda03205e07] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:07.623682 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a5ca7698-94cf-4d3b-aa83-0f5dd799ec99 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:07.625140 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a5ca7698-94cf-4d3b-aa83-0f5dd799ec99 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:07.625906 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a5ca7698-94cf-4d3b-aa83-0f5dd799ec99 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:07.639967 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a5ca7698-94cf-4d3b-aa83-0f5dd799ec99 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:07.640639 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a5ca7698-94cf-4d3b-aa83-0f5dd799ec99 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:07.641280 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a5ca7698-94cf-4d3b-aa83-0f5dd799ec99 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:07.643713 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-9f254a2d-6dff-49f4-acae-9d6a09dc4fb4 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "DELETE /compute/v2.1/servers/7a8f8d36-4744-43b7-9d42-e50fb5fabe60" status: 204 len: 0 microversion: 2.1 time: 0.214419 Aug 10 23:15:07.645316 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2007/3880] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:15:07 2022] DELETE /compute/v2.1/servers/7a8f8d36-4744-43b7-9d42-e50fb5fabe60 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:15:07.664800 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-7947882b-1842-4aa7-84f6-02f9c67677c4 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:15:07.665610 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-7947882b-1842-4aa7-84f6-02f9c67677c4 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:07.694497 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7947882b-1842-4aa7-84f6-02f9c67677c4 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:07.695143 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7947882b-1842-4aa7-84f6-02f9c67677c4 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:07.695611 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7947882b-1842-4aa7-84f6-02f9c67677c4 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:07.698796 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7947882b-1842-4aa7-84f6-02f9c67677c4 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:07.699464 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7947882b-1842-4aa7-84f6-02f9c67677c4 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:07.699934 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7947882b-1842-4aa7-84f6-02f9c67677c4 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:07.777357 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.objects.instance [None req-7947882b-1842-4aa7-84f6-02f9c67677c4 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lazy-loading 'flavor' on Instance uuid 23bbe055-4a92-4b96-8b89-c941229bfb0b {{(pid=122633) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:15:08.083399 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-7947882b-1842-4aa7-84f6-02f9c67677c4 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "POST /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b/action" status: 202 len: 0 microversion: 2.1 time: 0.433575 Aug 10 23:15:08.089772 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2008/3881] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:15:07 2022] POST /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b/action => generated 0 bytes in 444 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:15:08.096972 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-dd767f87-6b1b-439e-a270-8a8829b70826 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1755422763", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "451", "networks": [{"uuid": "160706c8-901f-4f25-9966-5313bee0e064"}]}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:15:08.175805 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.network.neutron [None req-dd767f87-6b1b-439e-a270-8a8829b70826 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] validate_networks() for [('160706c8-901f-4f25-9966-5313bee0e064', None, None, None, None, None)] {{(pid=122633) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 23:15:08.785471 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-a5ca7698-94cf-4d3b-aa83-0f5dd799ec99 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "POST /compute/v2.1/servers/1da4d99f-4cb0-4533-bda8-3bda03205e07/action" status: 200 len: 8202 microversion: 2.1 time: 1.193285 Aug 10 23:15:08.794614 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1874/3882] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:15:07 2022] POST /compute/v2.1/servers/1da4d99f-4cb0-4533-bda8-3bda03205e07/action => generated 8202 bytes in 1204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:08.801143 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-2f3bd1a1-e7ec-44dd-b90b-7e4dbddfd88b tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:08.802246 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-2f3bd1a1-e7ec-44dd-b90b-7e4dbddfd88b tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: 7a8f8d36-4744-43b7-9d42-e50fb5fabe60] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:08.809837 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2f3bd1a1-e7ec-44dd-b90b-7e4dbddfd88b tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:08.810889 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2f3bd1a1-e7ec-44dd-b90b-7e4dbddfd88b tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:08.811488 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2f3bd1a1-e7ec-44dd-b90b-7e4dbddfd88b tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:08.812355 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2f3bd1a1-e7ec-44dd-b90b-7e4dbddfd88b tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:08.812965 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2f3bd1a1-e7ec-44dd-b90b-7e4dbddfd88b tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:08.813544 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2f3bd1a1-e7ec-44dd-b90b-7e4dbddfd88b tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:09.248288 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-dd767f87-6b1b-439e-a270-8a8829b70826 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Flavor limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:15:09.248811 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-dd767f87-6b1b-439e-a270-8a8829b70826 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Image limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:15:09.249395 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-dd767f87-6b1b-439e-a270-8a8829b70826 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Flavor pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:15:09.249600 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-dd767f87-6b1b-439e-a270-8a8829b70826 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Image pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:15:09.250018 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-dd767f87-6b1b-439e-a270-8a8829b70826 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:15:09.263276 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dd767f87-6b1b-439e-a270-8a8829b70826 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:09.264525 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dd767f87-6b1b-439e-a270-8a8829b70826 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:09.265379 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dd767f87-6b1b-439e-a270-8a8829b70826 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:09.266335 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dd767f87-6b1b-439e-a270-8a8829b70826 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:09.267121 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dd767f87-6b1b-439e-a270-8a8829b70826 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:09.267710 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dd767f87-6b1b-439e-a270-8a8829b70826 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:09.299668 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-dd767f87-6b1b-439e-a270-8a8829b70826 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Getting quotas for project 578d8e62013d43c5ad4d9a6d92e1f201. Resources: {'instances', 'cores', 'ram'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:15:09.306412 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-dd767f87-6b1b-439e-a270-8a8829b70826 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Getting quotas for user 06cc4167255044d29a70c12a5a44d800 and project 578d8e62013d43c5ad4d9a6d92e1f201. Resources: {'instances', 'cores', 'ram'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:15:09.330435 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-dd767f87-6b1b-439e-a270-8a8829b70826 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Going to run 1 instances... {{(pid=122633) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 23:15:09.335327 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-dd767f87-6b1b-439e-a270-8a8829b70826 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] [instance: 1c71b2c8-4cbd-4c02-bb74-ba27adb70325] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78ad8905-f66f-4733-8be9-2b260f1fabed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122633) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 23:15:09.410315 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-dd767f87-6b1b-439e-a270-8a8829b70826 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.318172 Aug 10 23:15:09.417019 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2009/3883] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 23:15:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 1326 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 23:15:09.440942 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-e07d7e60-439f-4659-afb7-071805e972ef tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:09.442143 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-e07d7e60-439f-4659-afb7-071805e972ef tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:09.454023 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e07d7e60-439f-4659-afb7-071805e972ef tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:09.459348 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e07d7e60-439f-4659-afb7-071805e972ef tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:09.460264 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e07d7e60-439f-4659-afb7-071805e972ef tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:09.461279 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e07d7e60-439f-4659-afb7-071805e972ef tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:09.461985 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e07d7e60-439f-4659-afb7-071805e972ef tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:09.462647 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e07d7e60-439f-4659-afb7-071805e972ef tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:09.809837 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-2f3bd1a1-e7ec-44dd-b90b-7e4dbddfd88b tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6160c7a42740efbe3613380933fa15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d90f8a58ad047fa8f347d6474e4d673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:09.826695 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-2f3bd1a1-e7ec-44dd-b90b-7e4dbddfd88b tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "GET /compute/v2.1/servers/7a8f8d36-4744-43b7-9d42-e50fb5fabe60" status: 200 len: 1493 microversion: 2.1 time: 1.030552 Aug 10 23:15:09.830259 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1875/3884] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:08 2022] GET /compute/v2.1/servers/7a8f8d36-4744-43b7-9d42-e50fb5fabe60 => generated 1493 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:09.835367 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-0f9cd142-ee34-4405-bf58-1381dd9c3bad tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Calling method '.version_select at 0x7f847c9b30d0>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:09.865594 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-0f9cd142-ee34-4405-bf58-1381dd9c3bad tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-154155458" status: 202 len: 0 microversion: 2.1 time: 0.033761 Aug 10 23:15:09.867703 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1876/3885] 10.222.0.58 () {58 vars in 1281 bytes} [Wed Aug 10 23:15:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-154155458 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:15:09.886308 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-8b046477-8d2e-45d0-8d5e-ab166472b858 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:09.887428 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-8b046477-8d2e-45d0-8d5e-ab166472b858 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] [instance: 7df225be-2dbc-4ef6-aeec-9a3de33a0006] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:09.903406 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8b046477-8d2e-45d0-8d5e-ab166472b858 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:09.904174 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8b046477-8d2e-45d0-8d5e-ab166472b858 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:09.904626 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8b046477-8d2e-45d0-8d5e-ab166472b858 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:09.905835 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8b046477-8d2e-45d0-8d5e-ab166472b858 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:09.906338 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8b046477-8d2e-45d0-8d5e-ab166472b858 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:09.906993 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8b046477-8d2e-45d0-8d5e-ab166472b858 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:10.231489 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-8b046477-8d2e-45d0-8d5e-ab166472b858 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07c94ebf0954cdea12b9a689538d96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395d7c4077e54c43bb95288db3942b0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:10.242761 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-8b046477-8d2e-45d0-8d5e-ab166472b858 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] 10.222.0.58 "GET /compute/v2.1/servers/7df225be-2dbc-4ef6-aeec-9a3de33a0006" status: 200 len: 1522 microversion: 2.1 time: 0.373208 Aug 10 23:15:10.244208 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1877/3886] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:09 2022] GET /compute/v2.1/servers/7df225be-2dbc-4ef6-aeec-9a3de33a0006 => generated 1522 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:10.250507 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-9f63b138-c8d5-42bb-ba2e-10c0045d5cff tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:10.251580 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-9f63b138-c8d5-42bb-ba2e-10c0045d5cff tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: fa9dfd3a-a636-48ce-ae15-0ed51baee954] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:10.257439 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-e07d7e60-439f-4659-afb7-071805e972ef tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:10.268195 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-e07d7e60-439f-4659-afb7-071805e972ef tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b" status: 200 len: 1512 microversion: 2.1 time: 0.849474 Aug 10 23:15:10.268752 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9f63b138-c8d5-42bb-ba2e-10c0045d5cff tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:10.269220 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2010/3887] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:09 2022] GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b => generated 1512 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:10.281506 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9f63b138-c8d5-42bb-ba2e-10c0045d5cff tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:10.281506 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9f63b138-c8d5-42bb-ba2e-10c0045d5cff tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:10.281506 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9f63b138-c8d5-42bb-ba2e-10c0045d5cff tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:10.281506 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9f63b138-c8d5-42bb-ba2e-10c0045d5cff tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:10.281506 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9f63b138-c8d5-42bb-ba2e-10c0045d5cff tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:10.295322 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-da2aca59-d116-4f4e-bcf8-e6a5a2b2a955 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:10.296519 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-da2aca59-d116-4f4e-bcf8-e6a5a2b2a955 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] [instance: 1c71b2c8-4cbd-4c02-bb74-ba27adb70325] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:10.306723 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-da2aca59-d116-4f4e-bcf8-e6a5a2b2a955 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:10.308808 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-da2aca59-d116-4f4e-bcf8-e6a5a2b2a955 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:10.310529 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-da2aca59-d116-4f4e-bcf8-e6a5a2b2a955 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:10.311614 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-da2aca59-d116-4f4e-bcf8-e6a5a2b2a955 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:10.312373 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-da2aca59-d116-4f4e-bcf8-e6a5a2b2a955 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:10.313695 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-da2aca59-d116-4f4e-bcf8-e6a5a2b2a955 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:10.421105 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-da2aca59-d116-4f4e-bcf8-e6a5a2b2a955 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cc4167255044d29a70c12a5a44d800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578d8e62013d43c5ad4d9a6d92e1f201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:10.438381 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-da2aca59-d116-4f4e-bcf8-e6a5a2b2a955 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] 10.222.0.58 "GET /compute/v2.1/servers/1c71b2c8-4cbd-4c02-bb74-ba27adb70325" status: 200 len: 1273 microversion: 2.1 time: 0.140950 Aug 10 23:15:10.444723 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2011/3888] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:10 2022] GET /compute/v2.1/servers/1c71b2c8-4cbd-4c02-bb74-ba27adb70325 => generated 1273 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:10.466028 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-d323f154-c60e-4cbc-85ee-8836b4ff01fb tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Action: 'create', calling method: .version_select at 0x7f847c38f310>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1298304459", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ772TeqjkuCDseLpQ16mtObJNUxsMZsxR70njs+32+XUeORufEkBpe4U23LzkTxFrcrukA5/e5ByYo6v3e4z3sNn9L7U++QIKmIS7bDEAs7c+341+fX5Dbxlv2/ByFgbA=="}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:15:10.488948 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-d323f154-c60e-4cbc-85ee-8836b4ff01fb tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Getting quotas for project 25abd63376614081a9d484f3c9ae950d. Resources: {'key_pairs'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:15:10.497072 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-d323f154-c60e-4cbc-85ee-8836b4ff01fb tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Getting quotas for user 5899b2ad9f1046caaf7c6073e408eeee and project 25abd63376614081a9d484f3c9ae950d. Resources: {'key_pairs'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:15:10.563372 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-d323f154-c60e-4cbc-85ee-8836b4ff01fb tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.116539 Aug 10 23:15:10.564435 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2012/3889] 10.222.0.58 () {60 vars in 1159 bytes} [Wed Aug 10 23:15:10 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:15:10.854817 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c6915f01-7081-44ac-90c2-9dec9b0edbca tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:10.855381 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-c6915f01-7081-44ac-90c2-9dec9b0edbca tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: 7a8f8d36-4744-43b7-9d42-e50fb5fabe60] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:10.866463 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c6915f01-7081-44ac-90c2-9dec9b0edbca tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:10.867800 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c6915f01-7081-44ac-90c2-9dec9b0edbca tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:10.868524 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c6915f01-7081-44ac-90c2-9dec9b0edbca tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:10.870179 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c6915f01-7081-44ac-90c2-9dec9b0edbca tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:10.871075 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c6915f01-7081-44ac-90c2-9dec9b0edbca tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:10.871875 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c6915f01-7081-44ac-90c2-9dec9b0edbca tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:11.022367 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-c6915f01-7081-44ac-90c2-9dec9b0edbca tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6160c7a42740efbe3613380933fa15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d90f8a58ad047fa8f347d6474e4d673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:11.032818 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-c6915f01-7081-44ac-90c2-9dec9b0edbca tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "GET /compute/v2.1/servers/7a8f8d36-4744-43b7-9d42-e50fb5fabe60" status: 200 len: 1451 microversion: 2.1 time: 0.186152 Aug 10 23:15:11.037229 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-9f63b138-c8d5-42bb-ba2e-10c0045d5cff tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:11.047631 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2013/3890] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:10 2022] GET /compute/v2.1/servers/7a8f8d36-4744-43b7-9d42-e50fb5fabe60 => generated 1451 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:15:11.050881 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-9f63b138-c8d5-42bb-ba2e-10c0045d5cff tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954" status: 200 len: 1667 microversion: 2.1 time: 0.805011 Aug 10 23:15:11.051733 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1878/3891] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:10 2022] GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954 => generated 1667 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:11.059376 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-ae953ce8-23d8-42b7-b9f6-dd4a2f6dd2e1 req-7774c42e-6e10-40f4-8804-7dfa81df4343 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a8f8d36-4744-43b7-9d42-e50fb5fabe60", "name": "network-vif-deleted", "tag": "e13e25ef-a098-467e-a71b-fe5918abb3b3"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:15:11.073613 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-176c66e0-9780-4a8d-9957-cb647569b12e req-73bdaaa3-1552-41c3-a8e3-aa8e5122bb42 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fdd1f85d-95db-477c-a173-a6fca94f58b1", "tag": "a46ccf0f-4a14-45f7-82c0-e8964c2eb19e"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:15:11.119029 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-ae953ce8-23d8-42b7-b9f6-dd4a2f6dd2e1 req-7774c42e-6e10-40f4-8804-7dfa81df4343 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:11.119540 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-ae953ce8-23d8-42b7-b9f6-dd4a2f6dd2e1 req-7774c42e-6e10-40f4-8804-7dfa81df4343 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:11.119971 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-ae953ce8-23d8-42b7-b9f6-dd4a2f6dd2e1 req-7774c42e-6e10-40f4-8804-7dfa81df4343 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:11.141824 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-176c66e0-9780-4a8d-9957-cb647569b12e req-73bdaaa3-1552-41c3-a8e3-aa8e5122bb42 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:11.142319 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-176c66e0-9780-4a8d-9957-cb647569b12e req-73bdaaa3-1552-41c3-a8e3-aa8e5122bb42 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:11.142749 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-176c66e0-9780-4a8d-9957-cb647569b12e req-73bdaaa3-1552-41c3-a8e3-aa8e5122bb42 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:11.159967 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-ae953ce8-23d8-42b7-b9f6-dd4a2f6dd2e1 req-7774c42e-6e10-40f4-8804-7dfa81df4343 service nova] Creating event network-vif-deleted:e13e25ef-a098-467e-a71b-fe5918abb3b3 for instance 7a8f8d36-4744-43b7-9d42-e50fb5fabe60 on n-h1-850468-14 Aug 10 23:15:11.175757 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-ae953ce8-23d8-42b7-b9f6-dd4a2f6dd2e1 req-7774c42e-6e10-40f4-8804-7dfa81df4343 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126545 Aug 10 23:15:11.177808 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-176c66e0-9780-4a8d-9957-cb647569b12e req-73bdaaa3-1552-41c3-a8e3-aa8e5122bb42 service nova] Creating event network-changed:a46ccf0f-4a14-45f7-82c0-e8964c2eb19e for instance fdd1f85d-95db-477c-a173-a6fca94f58b1 on n-h1-850468-14 Aug 10 23:15:11.178354 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2014/3892] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:15:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:15:11.187355 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-f57ffacf-98e4-4725-ac7d-d389baeb14d4 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:11.189335 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-176c66e0-9780-4a8d-9957-cb647569b12e req-73bdaaa3-1552-41c3-a8e3-aa8e5122bb42 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121385 Aug 10 23:15:11.191330 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1879/3893] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:15:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 23:15:11.192000 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-f57ffacf-98e4-4725-ac7d-d389baeb14d4 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: fa9dfd3a-a636-48ce-ae15-0ed51baee954] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:11.200430 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f57ffacf-98e4-4725-ac7d-d389baeb14d4 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:11.201130 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f57ffacf-98e4-4725-ac7d-d389baeb14d4 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:11.201731 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f57ffacf-98e4-4725-ac7d-d389baeb14d4 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:11.202664 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f57ffacf-98e4-4725-ac7d-d389baeb14d4 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:11.203344 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f57ffacf-98e4-4725-ac7d-d389baeb14d4 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:11.203966 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f57ffacf-98e4-4725-ac7d-d389baeb14d4 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:11.266163 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-b59206c1-1e2a-4a7f-8899-ad73eacfa370 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:11.266894 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-b59206c1-1e2a-4a7f-8899-ad73eacfa370 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] [instance: 7df225be-2dbc-4ef6-aeec-9a3de33a0006] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:11.274101 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b59206c1-1e2a-4a7f-8899-ad73eacfa370 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:11.275137 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b59206c1-1e2a-4a7f-8899-ad73eacfa370 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:11.276133 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b59206c1-1e2a-4a7f-8899-ad73eacfa370 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:11.277255 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b59206c1-1e2a-4a7f-8899-ad73eacfa370 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:11.277905 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b59206c1-1e2a-4a7f-8899-ad73eacfa370 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:11.278731 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b59206c1-1e2a-4a7f-8899-ad73eacfa370 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:11.385783 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-f57ffacf-98e4-4725-ac7d-d389baeb14d4 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:11.397271 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-f57ffacf-98e4-4725-ac7d-d389baeb14d4 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954" status: 200 len: 1667 microversion: 2.1 time: 0.217327 Aug 10 23:15:11.398840 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2015/3894] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:11 2022] GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954 => generated 1667 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:11.405161 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-f031c7c8-0b5b-437c-89da-dd050f88c114 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:11.406028 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-f031c7c8-0b5b-437c-89da-dd050f88c114 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:11.413673 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f031c7c8-0b5b-437c-89da-dd050f88c114 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:11.414425 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f031c7c8-0b5b-437c-89da-dd050f88c114 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:11.415567 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f031c7c8-0b5b-437c-89da-dd050f88c114 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:11.416305 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f031c7c8-0b5b-437c-89da-dd050f88c114 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:11.416774 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f031c7c8-0b5b-437c-89da-dd050f88c114 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:11.417207 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f031c7c8-0b5b-437c-89da-dd050f88c114 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:11.755312 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-f031c7c8-0b5b-437c-89da-dd050f88c114 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:11.765955 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-f031c7c8-0b5b-437c-89da-dd050f88c114 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b" status: 200 len: 1512 microversion: 2.1 time: 0.365819 Aug 10 23:15:11.767405 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2016/3895] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:11 2022] GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b => generated 1512 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:11.774415 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-cade8b3c-1418-42a2-ad1a-e937d4516289 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:11.775558 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-cade8b3c-1418-42a2-ad1a-e937d4516289 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: fa9dfd3a-a636-48ce-ae15-0ed51baee954] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:11.787867 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cade8b3c-1418-42a2-ad1a-e937d4516289 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:11.788484 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cade8b3c-1418-42a2-ad1a-e937d4516289 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:11.789074 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cade8b3c-1418-42a2-ad1a-e937d4516289 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:11.794268 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cade8b3c-1418-42a2-ad1a-e937d4516289 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:11.794268 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cade8b3c-1418-42a2-ad1a-e937d4516289 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:11.794461 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cade8b3c-1418-42a2-ad1a-e937d4516289 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:11.832728 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-b59206c1-1e2a-4a7f-8899-ad73eacfa370 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07c94ebf0954cdea12b9a689538d96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395d7c4077e54c43bb95288db3942b0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:11.844129 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-b59206c1-1e2a-4a7f-8899-ad73eacfa370 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] 10.222.0.58 "GET /compute/v2.1/servers/7df225be-2dbc-4ef6-aeec-9a3de33a0006" status: 200 len: 1522 microversion: 2.1 time: 0.582112 Aug 10 23:15:11.860093 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1880/3896] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:11 2022] GET /compute/v2.1/servers/7df225be-2dbc-4ef6-aeec-9a3de33a0006 => generated 1522 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:15:11.870494 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-b8131415-0b67-4129-bf04-da87579d71ff tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:11.871545 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-b8131415-0b67-4129-bf04-da87579d71ff tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] [instance: 1c71b2c8-4cbd-4c02-bb74-ba27adb70325] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:11.882316 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b8131415-0b67-4129-bf04-da87579d71ff tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:11.883156 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b8131415-0b67-4129-bf04-da87579d71ff tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:11.883595 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b8131415-0b67-4129-bf04-da87579d71ff tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:11.884295 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b8131415-0b67-4129-bf04-da87579d71ff tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:11.884907 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b8131415-0b67-4129-bf04-da87579d71ff tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:11.885330 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b8131415-0b67-4129-bf04-da87579d71ff tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:12.032980 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-b8131415-0b67-4129-bf04-da87579d71ff tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cc4167255044d29a70c12a5a44d800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578d8e62013d43c5ad4d9a6d92e1f201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:12.046106 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-b8131415-0b67-4129-bf04-da87579d71ff tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] 10.222.0.58 "GET /compute/v2.1/servers/1c71b2c8-4cbd-4c02-bb74-ba27adb70325" status: 200 len: 1279 microversion: 2.1 time: 0.183380 Aug 10 23:15:12.047603 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1881/3897] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:11 2022] GET /compute/v2.1/servers/1c71b2c8-4cbd-4c02-bb74-ba27adb70325 => generated 1279 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:12.116703 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c0a7a11d-88cf-4ac0-9201-2bfdf4aa98cc tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:12.117752 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-c0a7a11d-88cf-4ac0-9201-2bfdf4aa98cc tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: 7a8f8d36-4744-43b7-9d42-e50fb5fabe60] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:12.143700 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c0a7a11d-88cf-4ac0-9201-2bfdf4aa98cc tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:12.144351 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c0a7a11d-88cf-4ac0-9201-2bfdf4aa98cc tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:12.144990 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c0a7a11d-88cf-4ac0-9201-2bfdf4aa98cc tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:12.150730 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c0a7a11d-88cf-4ac0-9201-2bfdf4aa98cc tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:12.151470 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c0a7a11d-88cf-4ac0-9201-2bfdf4aa98cc tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:12.152750 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c0a7a11d-88cf-4ac0-9201-2bfdf4aa98cc tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:12.173253 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-c0a7a11d-88cf-4ac0-9201-2bfdf4aa98cc tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] HTTP exception thrown: Instance 7a8f8d36-4744-43b7-9d42-e50fb5fabe60 could not be found. Aug 10 23:15:12.177189 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c0a7a11d-88cf-4ac0-9201-2bfdf4aa98cc tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Request method failure captured: Aug 10 23:15:12.177189 n-d-850468-14 devstack@n-api.service[122632]: request: GET /compute/v2.1/servers/7a8f8d36-4744-43b7-9d42-e50fb5fabe60 HTTP/1.1 Aug 10 23:15:12.177189 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:15:12.177189 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:15:12.177189 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:15:12.177189 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 23:15:12.177189 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:15:12.177189 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:15:12.177189 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:15:12.177189 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:15:12.177189 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9Drr3r82npWIkz1ccNiKcah17mvrMR2EU4HCxqxnaGEEIkGANcRcrX2nHMsvmCLf0usmykCLye_MMWubAbqGw1RDJdO9uNXXKIzwnkO3-8RDYkeEsX4dAb-XLWqGpnC4lB_RQ_yXrj9zJ0yoaNBALi5oi6cnoUgwIrYxNetinerHaU0 Aug 10 23:15:12.177189 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:15:12.177189 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:15:12.177189 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:15:12.177189 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:15:12.177189 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:15:12.177189 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:15:12.177189 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 7d90f8a58ad047fa8f347d6474e4d673 Aug 10 23:15:12.177189 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-DeleteServersTestJSON-311075827 Aug 10 23:15:12.177189 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:15:12.177189 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:15:12.177189 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7d90f8a58ad047fa8f347d6474e4d673"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7d90f8a58ad047fa8f347d6474e4d673"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7d90f8a58ad047fa8f347d6474e4d673"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7d90f8a58ad047fa8f347d6474e4d673", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:15:12.177189 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-DeleteServersTestJSON-311075827 Aug 10 23:15:12.177189 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 7d90f8a58ad047fa8f347d6474e4d673 Aug 10 23:15:12.177189 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-DeleteServersTestJSON-311075827 Aug 10 23:15:12.177189 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-DeleteServersTestJSON-311075827-project Aug 10 23:15:12.177189 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:15:12.177189 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:15:12.177189 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: 3c6160c7a42740efbe3613380933fa15 Aug 10 23:15:12.177189 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-DeleteServersTestJSON-311075827-project Aug 10 23:15:12.177189 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:15:12.177189 n-d-850468-14 devstack@n-api.service[122632]: exception: Instance 7a8f8d36-4744-43b7-9d42-e50fb5fabe60 could not be found. Aug 10 23:15:12.177189 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': '7a8f8d36-4744-43b7-9d42-e50fb5fabe60'} Aug 10 23:15:12.177189 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:15:12.177189 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:15:12.177189 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:15:12.177189 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:15:12.177189 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:15:12.177189 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:15:12.177189 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:15:12.177189 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:15:12.177189 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:15:12.177189 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:15:12.177189 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a8f8d36-4744-43b7-9d42-e50fb5fabe60 could not be found. Aug 10 23:15:12.177189 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:15:12.177189 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:15:12.177189 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:15:12.177189 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:15:12.177189 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:15:12.177189 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:15:12.177189 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:15:12.177189 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:15:12.177189 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:15:12.177189 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:15:12.177189 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:15:12.177189 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:15:12.177189 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:15:12.177189 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:15:12.177189 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:15:12.177189 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:15:12.177189 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a8f8d36-4744-43b7-9d42-e50fb5fabe60 could not be found. Aug 10 23:15:12.177189 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:15:12.177189 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:15:12.177189 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:15:12.181343 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:15:12.181343 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:15:12.181343 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:15:12.181343 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:15:12.181343 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:15:12.181343 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a8f8d36-4744-43b7-9d42-e50fb5fabe60 could not be found. Aug 10 23:15:12.181343 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:15:12.184534 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c0a7a11d-88cf-4ac0-9201-2bfdf4aa98cc tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Returning 404 to user: Instance 7a8f8d36-4744-43b7-9d42-e50fb5fabe60 could not be found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:15:12.186189 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-c0a7a11d-88cf-4ac0-9201-2bfdf4aa98cc tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "GET /compute/v2.1/servers/7a8f8d36-4744-43b7-9d42-e50fb5fabe60" status: 404 len: 111 microversion: 2.1 time: 0.087068 Aug 10 23:15:12.187567 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1882/3898] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:12 2022] GET /compute/v2.1/servers/7a8f8d36-4744-43b7-9d42-e50fb5fabe60 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:15:12.202806 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-cade8b3c-1418-42a2-ad1a-e937d4516289 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:12.214269 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-cade8b3c-1418-42a2-ad1a-e937d4516289 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954" status: 200 len: 1667 microversion: 2.1 time: 0.445584 Aug 10 23:15:12.215153 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2017/3899] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:11 2022] GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954 => generated 1667 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:12.249217 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-97c9b0bb-ba07-47ec-9284-e7f8e242ecb9 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:12.250100 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-97c9b0bb-ba07-47ec-9284-e7f8e242ecb9 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: fa9dfd3a-a636-48ce-ae15-0ed51baee954] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:12.271054 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-97c9b0bb-ba07-47ec-9284-e7f8e242ecb9 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:12.272257 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-97c9b0bb-ba07-47ec-9284-e7f8e242ecb9 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:12.272852 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-97c9b0bb-ba07-47ec-9284-e7f8e242ecb9 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:12.274031 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-97c9b0bb-ba07-47ec-9284-e7f8e242ecb9 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:12.275493 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-97c9b0bb-ba07-47ec-9284-e7f8e242ecb9 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:12.276236 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-97c9b0bb-ba07-47ec-9284-e7f8e242ecb9 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:12.446884 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-1c96fb1c-0afb-4ec6-ab4f-e65ef633b280 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2134954284", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452", "networks": [{"uuid": "042efc3d-5a07-4ef1-a5d1-285928545eba"}]}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:15:12.536879 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.network.neutron [None req-1c96fb1c-0afb-4ec6-ab4f-e65ef633b280 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] validate_networks() for [('042efc3d-5a07-4ef1-a5d1-285928545eba', None, None, None, None, None)] {{(pid=122633) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 23:15:12.762406 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-97c9b0bb-ba07-47ec-9284-e7f8e242ecb9 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:12.772519 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-97c9b0bb-ba07-47ec-9284-e7f8e242ecb9 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954" status: 200 len: 1667 microversion: 2.1 time: 0.527764 Aug 10 23:15:12.773903 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1883/3900] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:12 2022] GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954 => generated 1667 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:12.796150 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-b08a89b4-0418-46a0-b263-60c9fb36d672 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:12.797052 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-b08a89b4-0418-46a0-b263-60c9fb36d672 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:12.804090 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b08a89b4-0418-46a0-b263-60c9fb36d672 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:12.804934 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b08a89b4-0418-46a0-b263-60c9fb36d672 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:12.805574 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b08a89b4-0418-46a0-b263-60c9fb36d672 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:12.806485 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b08a89b4-0418-46a0-b263-60c9fb36d672 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:12.807151 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b08a89b4-0418-46a0-b263-60c9fb36d672 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:12.807760 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b08a89b4-0418-46a0-b263-60c9fb36d672 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:13.392928 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-1c96fb1c-0afb-4ec6-ab4f-e65ef633b280 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Flavor limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:15:13.393549 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-1c96fb1c-0afb-4ec6-ab4f-e65ef633b280 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Image limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:15:13.394205 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-1c96fb1c-0afb-4ec6-ab4f-e65ef633b280 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Flavor pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:15:13.394762 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-1c96fb1c-0afb-4ec6-ab4f-e65ef633b280 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Image pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:15:13.396173 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-1c96fb1c-0afb-4ec6-ab4f-e65ef633b280 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:15:13.421576 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1c96fb1c-0afb-4ec6-ab4f-e65ef633b280 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:13.422359 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1c96fb1c-0afb-4ec6-ab4f-e65ef633b280 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:13.422997 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1c96fb1c-0afb-4ec6-ab4f-e65ef633b280 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:13.423911 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1c96fb1c-0afb-4ec6-ab4f-e65ef633b280 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:13.424545 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1c96fb1c-0afb-4ec6-ab4f-e65ef633b280 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:13.425128 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1c96fb1c-0afb-4ec6-ab4f-e65ef633b280 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:13.471705 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-1c96fb1c-0afb-4ec6-ab4f-e65ef633b280 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Getting quotas for project 7d90f8a58ad047fa8f347d6474e4d673. Resources: {'instances', 'cores', 'ram'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:15:13.479537 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-1c96fb1c-0afb-4ec6-ab4f-e65ef633b280 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Getting quotas for user 3c6160c7a42740efbe3613380933fa15 and project 7d90f8a58ad047fa8f347d6474e4d673. Resources: {'instances', 'cores', 'ram'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:15:13.508032 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-1c96fb1c-0afb-4ec6-ab4f-e65ef633b280 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Going to run 1 instances... {{(pid=122633) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 23:15:13.510821 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-1c96fb1c-0afb-4ec6-ab4f-e65ef633b280 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: 1cd977e1-410c-4c5f-a8fa-a9f9033bc512] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78ad8905-f66f-4733-8be9-2b260f1fabed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122633) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 23:15:13.570985 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-1c96fb1c-0afb-4ec6-ab4f-e65ef633b280 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.129302 Aug 10 23:15:13.572200 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2018/3901] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 23:15:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 1131 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 23:15:13.579737 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-2afddf76-4cdb-4e01-b491-668f9992fed0 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:15:13.580757 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-2afddf76-4cdb-4e01-b491-668f9992fed0 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: fa9dfd3a-a636-48ce-ae15-0ed51baee954] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:13.590854 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2afddf76-4cdb-4e01-b491-668f9992fed0 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:13.591650 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2afddf76-4cdb-4e01-b491-668f9992fed0 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:13.592434 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2afddf76-4cdb-4e01-b491-668f9992fed0 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:13.593569 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2afddf76-4cdb-4e01-b491-668f9992fed0 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:13.594553 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2afddf76-4cdb-4e01-b491-668f9992fed0 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:13.595301 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2afddf76-4cdb-4e01-b491-668f9992fed0 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:13.731842 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-2afddf76-4cdb-4e01-b491-668f9992fed0 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: fa9dfd3a-a636-48ce-ae15-0ed51baee954] Locking {{(pid=122633) lock /opt/stack/nova/nova/compute/api.py:4794}} Aug 10 23:15:13.750191 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=4,nova_cell1:INSERT=4 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:15:13.810386 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-b08a89b4-0418-46a0-b263-60c9fb36d672 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:13.821306 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-b08a89b4-0418-46a0-b263-60c9fb36d672 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b" status: 200 len: 1512 microversion: 2.1 time: 1.029000 Aug 10 23:15:13.829714 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1884/3902] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:12 2022] GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b => generated 1512 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:15:13.838542 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-25b1ee94-1d70-4542-8232-ff641c6208ee tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:13.839174 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-25b1ee94-1d70-4542-8232-ff641c6208ee tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] [instance: 7df225be-2dbc-4ef6-aeec-9a3de33a0006] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:13.849207 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-25b1ee94-1d70-4542-8232-ff641c6208ee tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:13.849697 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-25b1ee94-1d70-4542-8232-ff641c6208ee tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:13.850127 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-25b1ee94-1d70-4542-8232-ff641c6208ee tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:13.850851 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-25b1ee94-1d70-4542-8232-ff641c6208ee tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:13.851300 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-25b1ee94-1d70-4542-8232-ff641c6208ee tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:13.851717 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-25b1ee94-1d70-4542-8232-ff641c6208ee tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:13.878037 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-2afddf76-4cdb-4e01-b491-668f9992fed0 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "POST /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954/action" status: 202 len: 0 microversion: 2.1 time: 0.303837 Aug 10 23:15:13.878818 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2019/3903] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:15:13 2022] POST /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954/action => generated 0 bytes in 306 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:15:13.888190 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-7f8e43fe-21e6-468e-8590-0bdb06a03068 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:13.888887 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-7f8e43fe-21e6-468e-8590-0bdb06a03068 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] [instance: 1c71b2c8-4cbd-4c02-bb74-ba27adb70325] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:13.899588 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7f8e43fe-21e6-468e-8590-0bdb06a03068 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:13.900103 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7f8e43fe-21e6-468e-8590-0bdb06a03068 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:13.900617 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7f8e43fe-21e6-468e-8590-0bdb06a03068 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:13.901398 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7f8e43fe-21e6-468e-8590-0bdb06a03068 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:13.901866 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7f8e43fe-21e6-468e-8590-0bdb06a03068 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:13.902298 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7f8e43fe-21e6-468e-8590-0bdb06a03068 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:14.257835 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-7f8e43fe-21e6-468e-8590-0bdb06a03068 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cc4167255044d29a70c12a5a44d800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578d8e62013d43c5ad4d9a6d92e1f201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:14.275255 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-7f8e43fe-21e6-468e-8590-0bdb06a03068 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] 10.222.0.58 "GET /compute/v2.1/servers/1c71b2c8-4cbd-4c02-bb74-ba27adb70325" status: 200 len: 1321 microversion: 2.1 time: 0.394018 Aug 10 23:15:14.275912 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2020/3904] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:13 2022] GET /compute/v2.1/servers/1c71b2c8-4cbd-4c02-bb74-ba27adb70325 => generated 1321 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:14.298855 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-6cc40cff-0789-4e22-8e91-808eda660969 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:14.300184 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-6cc40cff-0789-4e22-8e91-808eda660969 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: 1cd977e1-410c-4c5f-a8fa-a9f9033bc512] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:14.308761 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6cc40cff-0789-4e22-8e91-808eda660969 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:14.309335 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6cc40cff-0789-4e22-8e91-808eda660969 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:14.310129 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6cc40cff-0789-4e22-8e91-808eda660969 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:14.311205 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6cc40cff-0789-4e22-8e91-808eda660969 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:14.311494 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6cc40cff-0789-4e22-8e91-808eda660969 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:14.312184 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6cc40cff-0789-4e22-8e91-808eda660969 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:14.373117 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-25b1ee94-1d70-4542-8232-ff641c6208ee tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07c94ebf0954cdea12b9a689538d96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395d7c4077e54c43bb95288db3942b0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:14.386207 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-25b1ee94-1d70-4542-8232-ff641c6208ee tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] 10.222.0.58 "GET /compute/v2.1/servers/7df225be-2dbc-4ef6-aeec-9a3de33a0006" status: 200 len: 1522 microversion: 2.1 time: 0.555044 Aug 10 23:15:14.387422 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1885/3905] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:13 2022] GET /compute/v2.1/servers/7df225be-2dbc-4ef6-aeec-9a3de33a0006 => generated 1522 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:14.407208 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-e104deaf-6144-473f-bcc8-361412d2cd7a tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:14.408821 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-e104deaf-6144-473f-bcc8-361412d2cd7a tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: fa9dfd3a-a636-48ce-ae15-0ed51baee954] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:14.423842 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e104deaf-6144-473f-bcc8-361412d2cd7a tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:14.424705 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e104deaf-6144-473f-bcc8-361412d2cd7a tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:14.425346 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e104deaf-6144-473f-bcc8-361412d2cd7a tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:14.426564 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e104deaf-6144-473f-bcc8-361412d2cd7a tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:14.427866 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e104deaf-6144-473f-bcc8-361412d2cd7a tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:14.428764 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e104deaf-6144-473f-bcc8-361412d2cd7a tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:14.486964 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-6cc40cff-0789-4e22-8e91-808eda660969 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6160c7a42740efbe3613380933fa15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d90f8a58ad047fa8f347d6474e4d673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:14.502186 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-6cc40cff-0789-4e22-8e91-808eda660969 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "GET /compute/v2.1/servers/1cd977e1-410c-4c5f-a8fa-a9f9033bc512" status: 200 len: 1219 microversion: 2.1 time: 0.224821 Aug 10 23:15:14.503439 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2021/3906] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:14 2022] GET /compute/v2.1/servers/1cd977e1-410c-4c5f-a8fa-a9f9033bc512 => generated 1219 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:14.761951 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-bf44565c-66b6-492a-b8cb-26656ccc992a req-4f612167-4ec6-40a0-a606-6fef392d7562 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c679e2a4-89de-4fcf-aed1-273220fdb2e8", "tag": "1321852d-7dbc-4643-9a94-9bd2f2a028f2"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:15:14.773635 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-bf44565c-66b6-492a-b8cb-26656ccc992a req-4f612167-4ec6-40a0-a606-6fef392d7562 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:14.774326 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-bf44565c-66b6-492a-b8cb-26656ccc992a req-4f612167-4ec6-40a0-a606-6fef392d7562 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:14.775165 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-bf44565c-66b6-492a-b8cb-26656ccc992a req-4f612167-4ec6-40a0-a606-6fef392d7562 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:14.790157 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-bf44565c-66b6-492a-b8cb-26656ccc992a req-4f612167-4ec6-40a0-a606-6fef392d7562 service nova] Creating event network-changed:1321852d-7dbc-4643-9a94-9bd2f2a028f2 for instance c679e2a4-89de-4fcf-aed1-273220fdb2e8 on n-h2-850468-14 Aug 10 23:15:14.797600 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-bf44565c-66b6-492a-b8cb-26656ccc992a req-4f612167-4ec6-40a0-a606-6fef392d7562 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039104 Aug 10 23:15:14.799802 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2022/3907] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:15:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 23:15:14.854999 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-0942b723-17af-4562-8c70-ff608e4b5871 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:14.855703 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-0942b723-17af-4562-8c70-ff608e4b5871 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:14.863786 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-e104deaf-6144-473f-bcc8-361412d2cd7a tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:14.866707 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=100 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:15:14.875196 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0942b723-17af-4562-8c70-ff608e4b5871 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:14.876634 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0942b723-17af-4562-8c70-ff608e4b5871 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:14.877429 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-e104deaf-6144-473f-bcc8-361412d2cd7a tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954" status: 200 len: 1667 microversion: 2.1 time: 0.488693 Aug 10 23:15:14.878023 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0942b723-17af-4562-8c70-ff608e4b5871 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:14.879566 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0942b723-17af-4562-8c70-ff608e4b5871 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:14.880156 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1886/3908] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:14 2022] GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954 => generated 1667 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:14.880985 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0942b723-17af-4562-8c70-ff608e4b5871 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:14.881584 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0942b723-17af-4562-8c70-ff608e4b5871 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:14.903665 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-5957455b-ef39-41fe-a499-d33064b1e4f7 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:15:14.919116 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5957455b-ef39-41fe-a499-d33064b1e4f7 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:14.922972 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5957455b-ef39-41fe-a499-d33064b1e4f7 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:14.923696 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5957455b-ef39-41fe-a499-d33064b1e4f7 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:14.966129 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-5957455b-ef39-41fe-a499-d33064b1e4f7 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] HTTP exception thrown: Instance fa9dfd3a-a636-48ce-ae15-0ed51baee954 is locked Aug 10 23:15:14.968048 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-5957455b-ef39-41fe-a499-d33064b1e4f7 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Request method failure captured: Aug 10 23:15:14.968048 n-d-850468-14 devstack@n-api.service[122632]: request: POST /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954/action HTTP/1.1 Aug 10 23:15:14.968048 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:15:14.968048 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:15:14.968048 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:15:14.968048 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 15 Aug 10 23:15:14.968048 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:15:14.968048 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:15:14.968048 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:15:14.968048 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:15:14.968048 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9Drw0c2MsNlQk2xhClSBMImCg12_8SYgkoaKQkzmFSrheNUqLDbfnKYZ8D3mVjR4fUdjKeuub5tXKPuyho3Qbzr6min3JWaqN44jGsCPGM23nBipHIYVBpHQxUCRbFIS5jN95f9E_tT0WyV4NvgkZnorl71EuxY70xL3GkCDAg5oTLs Aug 10 23:15:14.968048 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:15:14.968048 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:15:14.968048 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:15:14.968048 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:15:14.968048 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:15:14.968048 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:15:14.968048 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 1eb12683ada249bfa2ca7bf5cf730ca3 Aug 10 23:15:14.968048 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-ServerActionsTestJSON-819186707 Aug 10 23:15:14.968048 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:15:14.968048 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:15:14.968048 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1eb12683ada249bfa2ca7bf5cf730ca3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1eb12683ada249bfa2ca7bf5cf730ca3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/1eb12683ada249bfa2ca7bf5cf730ca3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_1eb12683ada249bfa2ca7bf5cf730ca3", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:15:14.968048 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-ServerActionsTestJSON-819186707 Aug 10 23:15:14.968048 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 1eb12683ada249bfa2ca7bf5cf730ca3 Aug 10 23:15:14.968048 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-ServerActionsTestJSON-819186707 Aug 10 23:15:14.968048 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-ServerActionsTestJSON-819186707-project Aug 10 23:15:14.968048 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:15:14.968048 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:15:14.968048 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: 2ea96841d5b64d2390d18b3eb5da8b73 Aug 10 23:15:14.968048 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-ServerActionsTestJSON-819186707-project Aug 10 23:15:14.968048 n-d-850468-14 devstack@n-api.service[122632]: Aug 10 23:15:14.968048 n-d-850468-14 devstack@n-api.service[122632]: {"os-stop": {}} Aug 10 23:15:14.968048 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:15:14.968048 n-d-850468-14 devstack@n-api.service[122632]: exception: Instance fa9dfd3a-a636-48ce-ae15-0ed51baee954 is locked Aug 10 23:15:14.968048 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': 'fa9dfd3a-a636-48ce-ae15-0ed51baee954', 'body': {'os-stop': {}}} Aug 10 23:15:14.968048 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:15:14.968048 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:15:14.968048 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1446, in _stop_server Aug 10 23:15:14.968048 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) Aug 10 23:15:14.968048 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 237, in inner Aug 10 23:15:14.968048 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) Aug 10 23:15:14.968048 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance fa9dfd3a-a636-48ce-ae15-0ed51baee954 is locked Aug 10 23:15:14.968048 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:15:14.968048 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:15:14.968048 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:15:14.968048 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:15:14.968048 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:15:14.968048 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:15:14.968048 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:15:14.968048 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:15:14.968048 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:15:14.968048 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:15:14.968048 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1448, in _stop_server Aug 10 23:15:14.968048 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) Aug 10 23:15:14.968048 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance fa9dfd3a-a636-48ce-ae15-0ed51baee954 is locked Aug 10 23:15:14.968048 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:15:14.968048 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:15:14.968048 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:15:14.968048 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:15:14.968048 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:15:14.968048 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:15:14.968048 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:15:14.968048 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:15:14.968048 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa9dfd3a-a636-48ce-ae15-0ed51baee954 is locked Aug 10 23:15:14.968048 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:15:14.975599 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-5957455b-ef39-41fe-a499-d33064b1e4f7 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Returning 409 to user: Instance fa9dfd3a-a636-48ce-ae15-0ed51baee954 is locked {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:15:14.977016 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-5957455b-ef39-41fe-a499-d33064b1e4f7 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "POST /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954/action" status: 409 len: 107 microversion: 2.1 time: 0.079540 Aug 10 23:15:14.978085 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1887/3909] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:15:14 2022] POST /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954/action => generated 107 bytes in 81 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 10 23:15:14.987367 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-4856b883-a504-40bb-aa4a-375992b319cb tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:15:14.988462 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-4856b883-a504-40bb-aa4a-375992b319cb tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: fa9dfd3a-a636-48ce-ae15-0ed51baee954] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:14.996278 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4856b883-a504-40bb-aa4a-375992b319cb tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:14.997093 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4856b883-a504-40bb-aa4a-375992b319cb tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:14.998038 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4856b883-a504-40bb-aa4a-375992b319cb tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:14.999005 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4856b883-a504-40bb-aa4a-375992b319cb tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:14.999883 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4856b883-a504-40bb-aa4a-375992b319cb tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:15.000643 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4856b883-a504-40bb-aa4a-375992b319cb tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:15.062282 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-4856b883-a504-40bb-aa4a-375992b319cb tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: fa9dfd3a-a636-48ce-ae15-0ed51baee954] Unlocking {{(pid=122632) unlock /opt/stack/nova/nova/compute/api.py:4823}} Aug 10 23:15:15.132837 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-4856b883-a504-40bb-aa4a-375992b319cb tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "POST /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954/action" status: 202 len: 0 microversion: 2.1 time: 0.150200 Aug 10 23:15:15.140008 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1888/3910] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:15:14 2022] POST /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954/action => generated 0 bytes in 152 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:15:15.142990 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-132cc3c9-b150-4e2e-942a-e0ab87abdf2a tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:15:15.150712 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-132cc3c9-b150-4e2e-942a-e0ab87abdf2a tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:15.151392 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-132cc3c9-b150-4e2e-942a-e0ab87abdf2a tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:15.151918 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-132cc3c9-b150-4e2e-942a-e0ab87abdf2a tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:15.178685 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-132cc3c9-b150-4e2e-942a-e0ab87abdf2a tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: fa9dfd3a-a636-48ce-ae15-0ed51baee954] Going to try to stop instance {{(pid=122632) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 10 23:15:15.250830 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-132cc3c9-b150-4e2e-942a-e0ab87abdf2a tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "POST /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954/action" status: 202 len: 0 microversion: 2.1 time: 0.112211 Aug 10 23:15:15.254673 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1889/3911] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:15:15 2022] POST /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 10 23:15:15.271982 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-f3764903-cb2a-4dc5-af1d-c0644f6d7483 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:15.273206 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-f3764903-cb2a-4dc5-af1d-c0644f6d7483 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: fa9dfd3a-a636-48ce-ae15-0ed51baee954] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:15.285297 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f3764903-cb2a-4dc5-af1d-c0644f6d7483 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:15.285822 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f3764903-cb2a-4dc5-af1d-c0644f6d7483 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:15.287633 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f3764903-cb2a-4dc5-af1d-c0644f6d7483 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:15.287633 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f3764903-cb2a-4dc5-af1d-c0644f6d7483 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:15.288094 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f3764903-cb2a-4dc5-af1d-c0644f6d7483 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:15.288536 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f3764903-cb2a-4dc5-af1d-c0644f6d7483 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:15.586162 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-0942b723-17af-4562-8c70-ff608e4b5871 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:15.595524 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-0942b723-17af-4562-8c70-ff608e4b5871 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b" status: 200 len: 1512 microversion: 2.1 time: 0.744819 Aug 10 23:15:15.610185 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2023/3912] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:14 2022] GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b => generated 1512 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:15.616424 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-87a9fc05-a49a-4891-b6b7-8e0fd1d3d32f tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:15.617180 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-87a9fc05-a49a-4891-b6b7-8e0fd1d3d32f tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] [instance: 1c71b2c8-4cbd-4c02-bb74-ba27adb70325] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:15.625047 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-87a9fc05-a49a-4891-b6b7-8e0fd1d3d32f tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:15.625583 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-87a9fc05-a49a-4891-b6b7-8e0fd1d3d32f tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:15.626374 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-87a9fc05-a49a-4891-b6b7-8e0fd1d3d32f tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:15.627445 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-87a9fc05-a49a-4891-b6b7-8e0fd1d3d32f tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:15.628222 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-87a9fc05-a49a-4891-b6b7-8e0fd1d3d32f tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:15.628802 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-87a9fc05-a49a-4891-b6b7-8e0fd1d3d32f tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:15.696926 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-f3764903-cb2a-4dc5-af1d-c0644f6d7483 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:15.710604 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-f3764903-cb2a-4dc5-af1d-c0644f6d7483 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954" status: 200 len: 1677 microversion: 2.1 time: 0.454008 Aug 10 23:15:15.711946 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1890/3913] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:15 2022] GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954 => generated 1677 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:15.730110 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-689a1bb0-e252-4997-ad13-2426cd5f0730 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:15.732597 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-689a1bb0-e252-4997-ad13-2426cd5f0730 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] [instance: 7df225be-2dbc-4ef6-aeec-9a3de33a0006] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:15.744888 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-689a1bb0-e252-4997-ad13-2426cd5f0730 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:15.745645 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-689a1bb0-e252-4997-ad13-2426cd5f0730 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:15.746267 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-689a1bb0-e252-4997-ad13-2426cd5f0730 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:15.747150 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-689a1bb0-e252-4997-ad13-2426cd5f0730 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:15.748072 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-689a1bb0-e252-4997-ad13-2426cd5f0730 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:15.748510 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-689a1bb0-e252-4997-ad13-2426cd5f0730 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:15.966446 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-87a9fc05-a49a-4891-b6b7-8e0fd1d3d32f tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cc4167255044d29a70c12a5a44d800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578d8e62013d43c5ad4d9a6d92e1f201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:15.983135 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-87a9fc05-a49a-4891-b6b7-8e0fd1d3d32f tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] 10.222.0.58 "GET /compute/v2.1/servers/1c71b2c8-4cbd-4c02-bb74-ba27adb70325" status: 200 len: 1321 microversion: 2.1 time: 0.367419 Aug 10 23:15:15.984367 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2024/3914] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:15 2022] GET /compute/v2.1/servers/1c71b2c8-4cbd-4c02-bb74-ba27adb70325 => generated 1321 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:15.993883 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-6420a8fe-8595-414a-9b4a-29c781bdf530 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:15.995138 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-6420a8fe-8595-414a-9b4a-29c781bdf530 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: 1cd977e1-410c-4c5f-a8fa-a9f9033bc512] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:16.009175 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6420a8fe-8595-414a-9b4a-29c781bdf530 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:16.009772 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6420a8fe-8595-414a-9b4a-29c781bdf530 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:16.010684 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6420a8fe-8595-414a-9b4a-29c781bdf530 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:16.011674 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6420a8fe-8595-414a-9b4a-29c781bdf530 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:16.012477 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6420a8fe-8595-414a-9b4a-29c781bdf530 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:16.013029 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6420a8fe-8595-414a-9b4a-29c781bdf530 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:16.135624 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-6420a8fe-8595-414a-9b4a-29c781bdf530 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6160c7a42740efbe3613380933fa15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d90f8a58ad047fa8f347d6474e4d673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:16.146488 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-6420a8fe-8595-414a-9b4a-29c781bdf530 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "GET /compute/v2.1/servers/1cd977e1-410c-4c5f-a8fa-a9f9033bc512" status: 200 len: 1273 microversion: 2.1 time: 0.160670 Aug 10 23:15:16.147458 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2025/3915] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:15 2022] GET /compute/v2.1/servers/1cd977e1-410c-4c5f-a8fa-a9f9033bc512 => generated 1273 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:16.395297 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-689a1bb0-e252-4997-ad13-2426cd5f0730 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07c94ebf0954cdea12b9a689538d96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395d7c4077e54c43bb95288db3942b0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:16.425495 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-689a1bb0-e252-4997-ad13-2426cd5f0730 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] 10.222.0.58 "GET /compute/v2.1/servers/7df225be-2dbc-4ef6-aeec-9a3de33a0006" status: 200 len: 1522 microversion: 2.1 time: 0.711350 Aug 10 23:15:16.449831 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1891/3916] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:15 2022] GET /compute/v2.1/servers/7df225be-2dbc-4ef6-aeec-9a3de33a0006 => generated 1522 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:16.621158 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-99c647b9-e479-4686-9c5a-7b2a295db3ef tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:16.622517 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-99c647b9-e479-4686-9c5a-7b2a295db3ef tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:16.641487 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-99c647b9-e479-4686-9c5a-7b2a295db3ef tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:16.643750 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-99c647b9-e479-4686-9c5a-7b2a295db3ef tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:16.645124 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-99c647b9-e479-4686-9c5a-7b2a295db3ef tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:16.653002 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-99c647b9-e479-4686-9c5a-7b2a295db3ef tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:16.653948 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-99c647b9-e479-4686-9c5a-7b2a295db3ef tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:16.654615 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-99c647b9-e479-4686-9c5a-7b2a295db3ef tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:16.735547 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-0a9b1645-666c-4be3-a4f9-8f414c840e4f tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:16.736254 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-0a9b1645-666c-4be3-a4f9-8f414c840e4f tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: fa9dfd3a-a636-48ce-ae15-0ed51baee954] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:16.750701 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0a9b1645-666c-4be3-a4f9-8f414c840e4f tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:16.752114 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0a9b1645-666c-4be3-a4f9-8f414c840e4f tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:16.757224 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0a9b1645-666c-4be3-a4f9-8f414c840e4f tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:16.758404 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0a9b1645-666c-4be3-a4f9-8f414c840e4f tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:16.759468 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0a9b1645-666c-4be3-a4f9-8f414c840e4f tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:16.761452 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0a9b1645-666c-4be3-a4f9-8f414c840e4f tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:17.321293 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-99c647b9-e479-4686-9c5a-7b2a295db3ef tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:17.332123 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-99c647b9-e479-4686-9c5a-7b2a295db3ef tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b" status: 200 len: 1512 microversion: 2.1 time: 0.718302 Aug 10 23:15:17.339910 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2026/3917] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:16 2022] GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b => generated 1512 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:17.347964 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-81481e7e-6093-449f-9c7e-81c40ab7298c req-c749998b-1e71-4ee0-937e-ef673c686e43 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c71b2c8-4cbd-4c02-bb74-ba27adb70325", "tag": "37cbcd6f-0afe-4ca8-a522-a0291c6e237d"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:15:17.359092 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-81481e7e-6093-449f-9c7e-81c40ab7298c req-c749998b-1e71-4ee0-937e-ef673c686e43 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:17.359575 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-81481e7e-6093-449f-9c7e-81c40ab7298c req-c749998b-1e71-4ee0-937e-ef673c686e43 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:17.360307 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-81481e7e-6093-449f-9c7e-81c40ab7298c req-c749998b-1e71-4ee0-937e-ef673c686e43 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:17.373841 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-81481e7e-6093-449f-9c7e-81c40ab7298c req-c749998b-1e71-4ee0-937e-ef673c686e43 service nova] Creating event network-changed:37cbcd6f-0afe-4ca8-a522-a0291c6e237d for instance 1c71b2c8-4cbd-4c02-bb74-ba27adb70325 on n-h1-850468-14 Aug 10 23:15:17.379423 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-81481e7e-6093-449f-9c7e-81c40ab7298c req-c749998b-1e71-4ee0-937e-ef673c686e43 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036654 Aug 10 23:15:17.381422 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2027/3918] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:15:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:15:17.386798 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-cdfdf424-cdc0-41b1-b867-2066e20b3b3c tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:17.387719 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-cdfdf424-cdc0-41b1-b867-2066e20b3b3c tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] [instance: 1c71b2c8-4cbd-4c02-bb74-ba27adb70325] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:17.394806 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cdfdf424-cdc0-41b1-b867-2066e20b3b3c tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:17.396626 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cdfdf424-cdc0-41b1-b867-2066e20b3b3c tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:17.397433 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cdfdf424-cdc0-41b1-b867-2066e20b3b3c tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:17.398586 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cdfdf424-cdc0-41b1-b867-2066e20b3b3c tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:17.399098 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cdfdf424-cdc0-41b1-b867-2066e20b3b3c tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:17.399776 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cdfdf424-cdc0-41b1-b867-2066e20b3b3c tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:17.554667 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-0a9b1645-666c-4be3-a4f9-8f414c840e4f tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:17.565316 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-0a9b1645-666c-4be3-a4f9-8f414c840e4f tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954" status: 200 len: 1677 microversion: 2.1 time: 0.836097 Aug 10 23:15:17.566072 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1892/3919] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:16 2022] GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954 => generated 1677 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:15:17.586552 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-072bff60-39ce-47dc-b3c6-675e7fff062b tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:17.587355 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-072bff60-39ce-47dc-b3c6-675e7fff062b tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: 1cd977e1-410c-4c5f-a8fa-a9f9033bc512] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:17.595933 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-072bff60-39ce-47dc-b3c6-675e7fff062b tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:17.596781 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-072bff60-39ce-47dc-b3c6-675e7fff062b tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:17.597316 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-072bff60-39ce-47dc-b3c6-675e7fff062b tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:17.598273 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-072bff60-39ce-47dc-b3c6-675e7fff062b tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:17.599025 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-072bff60-39ce-47dc-b3c6-675e7fff062b tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:17.600413 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-072bff60-39ce-47dc-b3c6-675e7fff062b tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:17.696179 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-cdfdf424-cdc0-41b1-b867-2066e20b3b3c tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cc4167255044d29a70c12a5a44d800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578d8e62013d43c5ad4d9a6d92e1f201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:17.704992 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-cdfdf424-cdc0-41b1-b867-2066e20b3b3c tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] 10.222.0.58 "GET /compute/v2.1/servers/1c71b2c8-4cbd-4c02-bb74-ba27adb70325" status: 200 len: 1321 microversion: 2.1 time: 0.322181 Aug 10 23:15:17.705583 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2028/3920] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:17 2022] GET /compute/v2.1/servers/1c71b2c8-4cbd-4c02-bb74-ba27adb70325 => generated 1321 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:17.711394 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-7b68092b-39f4-4e34-b1e2-562b7602c0bf tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:17.712240 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-7b68092b-39f4-4e34-b1e2-562b7602c0bf tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] [instance: 7df225be-2dbc-4ef6-aeec-9a3de33a0006] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:17.718428 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7b68092b-39f4-4e34-b1e2-562b7602c0bf tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:17.719153 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7b68092b-39f4-4e34-b1e2-562b7602c0bf tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:17.719863 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7b68092b-39f4-4e34-b1e2-562b7602c0bf tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:17.720723 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7b68092b-39f4-4e34-b1e2-562b7602c0bf tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:17.721565 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7b68092b-39f4-4e34-b1e2-562b7602c0bf tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:17.722144 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7b68092b-39f4-4e34-b1e2-562b7602c0bf tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:17.958568 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-7b68092b-39f4-4e34-b1e2-562b7602c0bf tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07c94ebf0954cdea12b9a689538d96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395d7c4077e54c43bb95288db3942b0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:17.967921 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-7b68092b-39f4-4e34-b1e2-562b7602c0bf tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] 10.222.0.58 "GET /compute/v2.1/servers/7df225be-2dbc-4ef6-aeec-9a3de33a0006" status: 200 len: 1522 microversion: 2.1 time: 0.261100 Aug 10 23:15:17.968791 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2029/3921] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:17 2022] GET /compute/v2.1/servers/7df225be-2dbc-4ef6-aeec-9a3de33a0006 => generated 1522 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:18.049665 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-c5c215ae-100f-41e6-b73e-a1c4ead52da5 req-7332f456-2445-4d78-b902-eb41d62193ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1cd977e1-410c-4c5f-a8fa-a9f9033bc512", "tag": "a7efb403-a557-4888-b47e-036a0a6d5c76"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:15:18.061572 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-c5c215ae-100f-41e6-b73e-a1c4ead52da5 req-7332f456-2445-4d78-b902-eb41d62193ad service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:18.062288 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-c5c215ae-100f-41e6-b73e-a1c4ead52da5 req-7332f456-2445-4d78-b902-eb41d62193ad service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:18.063150 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-c5c215ae-100f-41e6-b73e-a1c4ead52da5 req-7332f456-2445-4d78-b902-eb41d62193ad service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:18.076793 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-c5c215ae-100f-41e6-b73e-a1c4ead52da5 req-7332f456-2445-4d78-b902-eb41d62193ad service nova] Creating event network-changed:a7efb403-a557-4888-b47e-036a0a6d5c76 for instance 1cd977e1-410c-4c5f-a8fa-a9f9033bc512 on n-h2-850468-14 Aug 10 23:15:18.082134 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-c5c215ae-100f-41e6-b73e-a1c4ead52da5 req-7332f456-2445-4d78-b902-eb41d62193ad service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036537 Aug 10 23:15:18.083446 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2030/3922] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:15:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:15:18.356762 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-64d41596-6015-4a5a-bd8e-b493cdd49bec tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:18.357487 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-64d41596-6015-4a5a-bd8e-b493cdd49bec tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:18.364046 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-64d41596-6015-4a5a-bd8e-b493cdd49bec tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:18.364783 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-64d41596-6015-4a5a-bd8e-b493cdd49bec tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:18.365425 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-64d41596-6015-4a5a-bd8e-b493cdd49bec tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:18.366319 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-64d41596-6015-4a5a-bd8e-b493cdd49bec tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:18.366995 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-64d41596-6015-4a5a-bd8e-b493cdd49bec tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:18.367598 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-64d41596-6015-4a5a-bd8e-b493cdd49bec tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:18.425947 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-072bff60-39ce-47dc-b3c6-675e7fff062b tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6160c7a42740efbe3613380933fa15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d90f8a58ad047fa8f347d6474e4d673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:18.441189 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-072bff60-39ce-47dc-b3c6-675e7fff062b tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "GET /compute/v2.1/servers/1cd977e1-410c-4c5f-a8fa-a9f9033bc512" status: 200 len: 1315 microversion: 2.1 time: 0.858247 Aug 10 23:15:18.442190 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1893/3923] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:17 2022] GET /compute/v2.1/servers/1cd977e1-410c-4c5f-a8fa-a9f9033bc512 => generated 1315 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:18.588175 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-d19c1439-2b6b-47c7-bf10-f900bb200d21 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:18.588829 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-d19c1439-2b6b-47c7-bf10-f900bb200d21 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: fa9dfd3a-a636-48ce-ae15-0ed51baee954] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:18.603466 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d19c1439-2b6b-47c7-bf10-f900bb200d21 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:18.604314 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d19c1439-2b6b-47c7-bf10-f900bb200d21 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:18.605212 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d19c1439-2b6b-47c7-bf10-f900bb200d21 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:18.606266 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d19c1439-2b6b-47c7-bf10-f900bb200d21 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:18.606856 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d19c1439-2b6b-47c7-bf10-f900bb200d21 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:18.611476 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d19c1439-2b6b-47c7-bf10-f900bb200d21 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:18.678400 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-64d41596-6015-4a5a-bd8e-b493cdd49bec tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:18.687202 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-64d41596-6015-4a5a-bd8e-b493cdd49bec tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b" status: 200 len: 1512 microversion: 2.1 time: 0.335107 Aug 10 23:15:18.702263 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2031/3924] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:18 2022] GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b => generated 1512 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:18.708108 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-aea106d7-bcb2-4103-8d58-2348c57fd806 req-b4616221-866b-403b-8464-b520d58645df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdd1f85d-95db-477c-a173-a6fca94f58b1", "name": "network-vif-plugged", "status": "completed", "tag": "a46ccf0f-4a14-45f7-82c0-e8964c2eb19e"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:15:18.720312 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-aea106d7-bcb2-4103-8d58-2348c57fd806 req-b4616221-866b-403b-8464-b520d58645df service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:18.720790 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-aea106d7-bcb2-4103-8d58-2348c57fd806 req-b4616221-866b-403b-8464-b520d58645df service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:18.721933 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-aea106d7-bcb2-4103-8d58-2348c57fd806 req-b4616221-866b-403b-8464-b520d58645df service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:18.735566 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-aea106d7-bcb2-4103-8d58-2348c57fd806 req-b4616221-866b-403b-8464-b520d58645df service nova] Creating event network-vif-plugged:a46ccf0f-4a14-45f7-82c0-e8964c2eb19e for instance fdd1f85d-95db-477c-a173-a6fca94f58b1 on n-h1-850468-14 Aug 10 23:15:18.742703 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-aea106d7-bcb2-4103-8d58-2348c57fd806 req-b4616221-866b-403b-8464-b520d58645df service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037264 Aug 10 23:15:18.743707 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2032/3925] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:15:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:15:18.751843 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-6b8ba8a5-177a-4abe-a95e-48ecb75d82a2 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:18.752656 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-6b8ba8a5-177a-4abe-a95e-48ecb75d82a2 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] [instance: 1c71b2c8-4cbd-4c02-bb74-ba27adb70325] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:18.760668 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6b8ba8a5-177a-4abe-a95e-48ecb75d82a2 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:18.761330 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6b8ba8a5-177a-4abe-a95e-48ecb75d82a2 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:18.762004 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6b8ba8a5-177a-4abe-a95e-48ecb75d82a2 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:18.762985 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6b8ba8a5-177a-4abe-a95e-48ecb75d82a2 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:18.763543 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6b8ba8a5-177a-4abe-a95e-48ecb75d82a2 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:18.764183 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6b8ba8a5-177a-4abe-a95e-48ecb75d82a2 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:18.934583 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-d19c1439-2b6b-47c7-bf10-f900bb200d21 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:18.946276 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-d19c1439-2b6b-47c7-bf10-f900bb200d21 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954" status: 200 len: 1677 microversion: 2.1 time: 0.361541 Aug 10 23:15:18.947197 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1894/3926] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:18 2022] GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954 => generated 1677 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:18.990991 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-4696acdb-34a4-4109-bd7c-f959eabedfb0 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:18.991918 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-4696acdb-34a4-4109-bd7c-f959eabedfb0 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] [instance: 7df225be-2dbc-4ef6-aeec-9a3de33a0006] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:19.001790 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4696acdb-34a4-4109-bd7c-f959eabedfb0 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:19.003309 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4696acdb-34a4-4109-bd7c-f959eabedfb0 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:19.003941 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4696acdb-34a4-4109-bd7c-f959eabedfb0 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:19.005295 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4696acdb-34a4-4109-bd7c-f959eabedfb0 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:19.006637 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4696acdb-34a4-4109-bd7c-f959eabedfb0 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:19.007344 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4696acdb-34a4-4109-bd7c-f959eabedfb0 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:19.012333 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-6b8ba8a5-177a-4abe-a95e-48ecb75d82a2 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cc4167255044d29a70c12a5a44d800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578d8e62013d43c5ad4d9a6d92e1f201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:19.034399 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-6b8ba8a5-177a-4abe-a95e-48ecb75d82a2 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] 10.222.0.58 "GET /compute/v2.1/servers/1c71b2c8-4cbd-4c02-bb74-ba27adb70325" status: 200 len: 1321 microversion: 2.1 time: 0.283243 Aug 10 23:15:19.049701 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2033/3927] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:18 2022] GET /compute/v2.1/servers/1c71b2c8-4cbd-4c02-bb74-ba27adb70325 => generated 1321 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:19.481519 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-25c05835-4654-43fc-ac9f-54958d4ad4ef tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:19.483643 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-25c05835-4654-43fc-ac9f-54958d4ad4ef tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: 1cd977e1-410c-4c5f-a8fa-a9f9033bc512] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:19.496919 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-25c05835-4654-43fc-ac9f-54958d4ad4ef tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:19.497820 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-25c05835-4654-43fc-ac9f-54958d4ad4ef tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:19.498968 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-25c05835-4654-43fc-ac9f-54958d4ad4ef tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:19.500446 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-25c05835-4654-43fc-ac9f-54958d4ad4ef tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:19.501456 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-25c05835-4654-43fc-ac9f-54958d4ad4ef tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:19.505610 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-25c05835-4654-43fc-ac9f-54958d4ad4ef tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:19.549961 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-4696acdb-34a4-4109-bd7c-f959eabedfb0 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07c94ebf0954cdea12b9a689538d96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395d7c4077e54c43bb95288db3942b0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:19.584598 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-4696acdb-34a4-4109-bd7c-f959eabedfb0 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] 10.222.0.58 "GET /compute/v2.1/servers/7df225be-2dbc-4ef6-aeec-9a3de33a0006" status: 200 len: 1522 microversion: 2.1 time: 0.598375 Aug 10 23:15:19.586838 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1895/3928] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:18 2022] GET /compute/v2.1/servers/7df225be-2dbc-4ef6-aeec-9a3de33a0006 => generated 1522 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:15:19.715197 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-aed149de-6ba8-4aca-b7bd-edc2522fae18 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:19.717160 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-aed149de-6ba8-4aca-b7bd-edc2522fae18 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:19.736304 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-aed149de-6ba8-4aca-b7bd-edc2522fae18 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:19.736807 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-aed149de-6ba8-4aca-b7bd-edc2522fae18 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:19.737249 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-aed149de-6ba8-4aca-b7bd-edc2522fae18 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:19.743063 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-aed149de-6ba8-4aca-b7bd-edc2522fae18 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:19.745049 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-aed149de-6ba8-4aca-b7bd-edc2522fae18 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:19.745942 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-aed149de-6ba8-4aca-b7bd-edc2522fae18 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:19.865220 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-25c05835-4654-43fc-ac9f-54958d4ad4ef tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6160c7a42740efbe3613380933fa15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d90f8a58ad047fa8f347d6474e4d673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:19.878328 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-25c05835-4654-43fc-ac9f-54958d4ad4ef tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "GET /compute/v2.1/servers/1cd977e1-410c-4c5f-a8fa-a9f9033bc512" status: 200 len: 1315 microversion: 2.1 time: 0.416256 Aug 10 23:15:19.881108 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2034/3929] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:19 2022] GET /compute/v2.1/servers/1cd977e1-410c-4c5f-a8fa-a9f9033bc512 => generated 1315 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:15:19.970045 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-f6b5d67b-08ac-4130-8c9a-3d1d15022b44 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:19.971406 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-f6b5d67b-08ac-4130-8c9a-3d1d15022b44 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: fa9dfd3a-a636-48ce-ae15-0ed51baee954] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:19.975112 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:INSERT=7 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:15:19.981320 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f6b5d67b-08ac-4130-8c9a-3d1d15022b44 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:19.981859 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f6b5d67b-08ac-4130-8c9a-3d1d15022b44 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:19.982699 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f6b5d67b-08ac-4130-8c9a-3d1d15022b44 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:19.983710 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f6b5d67b-08ac-4130-8c9a-3d1d15022b44 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:19.984458 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f6b5d67b-08ac-4130-8c9a-3d1d15022b44 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:19.985124 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f6b5d67b-08ac-4130-8c9a-3d1d15022b44 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:20.188302 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-f6b5d67b-08ac-4130-8c9a-3d1d15022b44 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:20.201303 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-f6b5d67b-08ac-4130-8c9a-3d1d15022b44 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954" status: 200 len: 1677 microversion: 2.1 time: 0.236922 Aug 10 23:15:20.202552 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2035/3930] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:19 2022] GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954 => generated 1677 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:20.212679 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-0551be8e-3dfd-4f46-9af7-c30c49b034c4 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:20.213583 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-0551be8e-3dfd-4f46-9af7-c30c49b034c4 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] [instance: 1c71b2c8-4cbd-4c02-bb74-ba27adb70325] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:20.222713 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0551be8e-3dfd-4f46-9af7-c30c49b034c4 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:20.223582 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0551be8e-3dfd-4f46-9af7-c30c49b034c4 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:20.224576 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0551be8e-3dfd-4f46-9af7-c30c49b034c4 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:20.225699 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0551be8e-3dfd-4f46-9af7-c30c49b034c4 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:20.226239 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0551be8e-3dfd-4f46-9af7-c30c49b034c4 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:20.226853 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0551be8e-3dfd-4f46-9af7-c30c49b034c4 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:20.379013 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-0551be8e-3dfd-4f46-9af7-c30c49b034c4 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cc4167255044d29a70c12a5a44d800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578d8e62013d43c5ad4d9a6d92e1f201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:20.388345 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-0551be8e-3dfd-4f46-9af7-c30c49b034c4 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] 10.222.0.58 "GET /compute/v2.1/servers/1c71b2c8-4cbd-4c02-bb74-ba27adb70325" status: 200 len: 1321 microversion: 2.1 time: 0.181115 Aug 10 23:15:20.392075 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2036/3931] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:20 2022] GET /compute/v2.1/servers/1c71b2c8-4cbd-4c02-bb74-ba27adb70325 => generated 1321 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:20.544883 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-aed149de-6ba8-4aca-b7bd-edc2522fae18 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:20.555212 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-aed149de-6ba8-4aca-b7bd-edc2522fae18 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b" status: 200 len: 1512 microversion: 2.1 time: 0.850541 Aug 10 23:15:20.556208 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1896/3932] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:19 2022] GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b => generated 1512 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:20.612298 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-d646023c-0749-4c85-83dc-4ed629069ea2 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:20.613025 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-d646023c-0749-4c85-83dc-4ed629069ea2 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] [instance: 7df225be-2dbc-4ef6-aeec-9a3de33a0006] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:20.623284 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d646023c-0749-4c85-83dc-4ed629069ea2 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:20.623796 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d646023c-0749-4c85-83dc-4ed629069ea2 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:20.624242 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d646023c-0749-4c85-83dc-4ed629069ea2 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:20.625082 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d646023c-0749-4c85-83dc-4ed629069ea2 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:20.625571 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d646023c-0749-4c85-83dc-4ed629069ea2 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:20.626261 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d646023c-0749-4c85-83dc-4ed629069ea2 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:20.785127 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-d646023c-0749-4c85-83dc-4ed629069ea2 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07c94ebf0954cdea12b9a689538d96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395d7c4077e54c43bb95288db3942b0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:20.788782 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=3 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:15:20.795993 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-d646023c-0749-4c85-83dc-4ed629069ea2 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] 10.222.0.58 "GET /compute/v2.1/servers/7df225be-2dbc-4ef6-aeec-9a3de33a0006" status: 200 len: 1522 microversion: 2.1 time: 0.187749 Aug 10 23:15:20.799313 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2037/3933] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:20 2022] GET /compute/v2.1/servers/7df225be-2dbc-4ef6-aeec-9a3de33a0006 => generated 1522 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:20.902757 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-f7bee63c-2830-409f-ada0-f9c3c6a66449 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:20.903516 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-f7bee63c-2830-409f-ada0-f9c3c6a66449 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: 1cd977e1-410c-4c5f-a8fa-a9f9033bc512] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:20.911736 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f7bee63c-2830-409f-ada0-f9c3c6a66449 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:20.912382 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f7bee63c-2830-409f-ada0-f9c3c6a66449 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:20.912837 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f7bee63c-2830-409f-ada0-f9c3c6a66449 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:20.914300 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f7bee63c-2830-409f-ada0-f9c3c6a66449 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:20.914771 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f7bee63c-2830-409f-ada0-f9c3c6a66449 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:20.915229 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f7bee63c-2830-409f-ada0-f9c3c6a66449 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:21.230589 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-7328969e-5e6c-4861-9fa5-40d07f46b0d4 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:21.231824 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-7328969e-5e6c-4861-9fa5-40d07f46b0d4 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: fa9dfd3a-a636-48ce-ae15-0ed51baee954] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:21.239975 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7328969e-5e6c-4861-9fa5-40d07f46b0d4 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:21.240779 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7328969e-5e6c-4861-9fa5-40d07f46b0d4 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:21.241387 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7328969e-5e6c-4861-9fa5-40d07f46b0d4 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:21.242285 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7328969e-5e6c-4861-9fa5-40d07f46b0d4 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:21.242942 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7328969e-5e6c-4861-9fa5-40d07f46b0d4 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:21.243534 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7328969e-5e6c-4861-9fa5-40d07f46b0d4 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:21.497883 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-7328969e-5e6c-4861-9fa5-40d07f46b0d4 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:21.519321 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-7328969e-5e6c-4861-9fa5-40d07f46b0d4 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954" status: 200 len: 1677 microversion: 2.1 time: 0.294656 Aug 10 23:15:21.523147 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2038/3934] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:21 2022] GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954 => generated 1677 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:15:21.542911 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-b588f8aa-33d9-4475-b2d8-03ce029b0802 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:21.548347 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-b588f8aa-33d9-4475-b2d8-03ce029b0802 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] [instance: 1c71b2c8-4cbd-4c02-bb74-ba27adb70325] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:21.578632 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b588f8aa-33d9-4475-b2d8-03ce029b0802 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:21.579645 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b588f8aa-33d9-4475-b2d8-03ce029b0802 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:21.580262 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b588f8aa-33d9-4475-b2d8-03ce029b0802 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:21.581158 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b588f8aa-33d9-4475-b2d8-03ce029b0802 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:21.581988 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b588f8aa-33d9-4475-b2d8-03ce029b0802 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:21.583149 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b588f8aa-33d9-4475-b2d8-03ce029b0802 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:21.815248 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-b588f8aa-33d9-4475-b2d8-03ce029b0802 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cc4167255044d29a70c12a5a44d800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578d8e62013d43c5ad4d9a6d92e1f201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:21.824551 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-b588f8aa-33d9-4475-b2d8-03ce029b0802 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] 10.222.0.58 "GET /compute/v2.1/servers/1c71b2c8-4cbd-4c02-bb74-ba27adb70325" status: 200 len: 1321 microversion: 2.1 time: 0.290429 Aug 10 23:15:21.825290 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2039/3935] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:21 2022] GET /compute/v2.1/servers/1c71b2c8-4cbd-4c02-bb74-ba27adb70325 => generated 1321 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:21.832609 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-b24d489d-61d6-46f7-bd25-42f53f650ec7 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:21.835038 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-b24d489d-61d6-46f7-bd25-42f53f650ec7 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:21.845436 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b24d489d-61d6-46f7-bd25-42f53f650ec7 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:21.846764 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b24d489d-61d6-46f7-bd25-42f53f650ec7 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:21.847882 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b24d489d-61d6-46f7-bd25-42f53f650ec7 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:21.850965 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b24d489d-61d6-46f7-bd25-42f53f650ec7 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:21.852161 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b24d489d-61d6-46f7-bd25-42f53f650ec7 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:21.853132 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b24d489d-61d6-46f7-bd25-42f53f650ec7 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:21.976085 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-f7bee63c-2830-409f-ada0-f9c3c6a66449 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6160c7a42740efbe3613380933fa15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d90f8a58ad047fa8f347d6474e4d673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:21.992416 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-f7bee63c-2830-409f-ada0-f9c3c6a66449 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "GET /compute/v2.1/servers/1cd977e1-410c-4c5f-a8fa-a9f9033bc512" status: 200 len: 1315 microversion: 2.1 time: 1.093306 Aug 10 23:15:22.013191 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1897/3936] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:20 2022] GET /compute/v2.1/servers/1cd977e1-410c-4c5f-a8fa-a9f9033bc512 => generated 1315 bytes in 1111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:22.019687 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-5524924b-ebbe-4e68-888a-fc69959c8226 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:22.021118 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-b24d489d-61d6-46f7-bd25-42f53f650ec7 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:22.022888 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-5524924b-ebbe-4e68-888a-fc69959c8226 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] [instance: 7df225be-2dbc-4ef6-aeec-9a3de33a0006] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:22.030620 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-b24d489d-61d6-46f7-bd25-42f53f650ec7 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b" status: 200 len: 1512 microversion: 2.1 time: 0.204261 Aug 10 23:15:22.034505 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2040/3937] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:21 2022] GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b => generated 1512 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:22.044107 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5524924b-ebbe-4e68-888a-fc69959c8226 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:22.045525 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5524924b-ebbe-4e68-888a-fc69959c8226 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:22.047357 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5524924b-ebbe-4e68-888a-fc69959c8226 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:22.050189 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5524924b-ebbe-4e68-888a-fc69959c8226 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:22.052016 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5524924b-ebbe-4e68-888a-fc69959c8226 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:22.056285 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5524924b-ebbe-4e68-888a-fc69959c8226 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:22.544841 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-9ce0ce76-6334-4222-8111-083935e16772 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:22.546079 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-9ce0ce76-6334-4222-8111-083935e16772 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: fa9dfd3a-a636-48ce-ae15-0ed51baee954] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:22.553677 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9ce0ce76-6334-4222-8111-083935e16772 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:22.554361 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9ce0ce76-6334-4222-8111-083935e16772 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:22.555036 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9ce0ce76-6334-4222-8111-083935e16772 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:22.555984 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9ce0ce76-6334-4222-8111-083935e16772 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:22.556622 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9ce0ce76-6334-4222-8111-083935e16772 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:22.557222 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9ce0ce76-6334-4222-8111-083935e16772 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:22.561643 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-5524924b-ebbe-4e68-888a-fc69959c8226 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07c94ebf0954cdea12b9a689538d96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395d7c4077e54c43bb95288db3942b0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:22.573445 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-5524924b-ebbe-4e68-888a-fc69959c8226 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] 10.222.0.58 "GET /compute/v2.1/servers/7df225be-2dbc-4ef6-aeec-9a3de33a0006" status: 200 len: 1502 microversion: 2.1 time: 0.558589 Aug 10 23:15:22.578291 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1898/3938] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:22 2022] GET /compute/v2.1/servers/7df225be-2dbc-4ef6-aeec-9a3de33a0006 => generated 1502 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:22.603590 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-2b237827-bf47-4e4c-8d49-74c09a87af8f tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:22.604272 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-2b237827-bf47-4e4c-8d49-74c09a87af8f tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] [instance: 27dd09d6-47ed-4b55-bd02-baad36a28429] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:22.613272 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2b237827-bf47-4e4c-8d49-74c09a87af8f tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:22.613948 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2b237827-bf47-4e4c-8d49-74c09a87af8f tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:22.614595 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2b237827-bf47-4e4c-8d49-74c09a87af8f tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:22.615365 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2b237827-bf47-4e4c-8d49-74c09a87af8f tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:22.615824 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2b237827-bf47-4e4c-8d49-74c09a87af8f tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:22.616254 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2b237827-bf47-4e4c-8d49-74c09a87af8f tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:22.852144 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-9ce0ce76-6334-4222-8111-083935e16772 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:22.864274 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-9ce0ce76-6334-4222-8111-083935e16772 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954" status: 200 len: 1677 microversion: 2.1 time: 0.322659 Aug 10 23:15:22.867261 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2041/3939] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:22 2022] GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954 => generated 1677 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:15:22.882750 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-4f18291f-f8ac-4cd7-9fa0-669c04ea6d7b tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:22.883734 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-4f18291f-f8ac-4cd7-9fa0-669c04ea6d7b tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] [instance: 1c71b2c8-4cbd-4c02-bb74-ba27adb70325] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:22.902000 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4f18291f-f8ac-4cd7-9fa0-669c04ea6d7b tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:22.902740 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4f18291f-f8ac-4cd7-9fa0-669c04ea6d7b tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:22.903473 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4f18291f-f8ac-4cd7-9fa0-669c04ea6d7b tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:22.907652 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4f18291f-f8ac-4cd7-9fa0-669c04ea6d7b tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:22.908392 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4f18291f-f8ac-4cd7-9fa0-669c04ea6d7b tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:22.909455 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4f18291f-f8ac-4cd7-9fa0-669c04ea6d7b tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:23.116685 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-2b237827-bf47-4e4c-8d49-74c09a87af8f tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07c94ebf0954cdea12b9a689538d96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395d7c4077e54c43bb95288db3942b0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:23.135249 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-2b237827-bf47-4e4c-8d49-74c09a87af8f tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] 10.222.0.58 "GET /compute/v2.1/servers/27dd09d6-47ed-4b55-bd02-baad36a28429" status: 200 len: 1515 microversion: 2.1 time: 0.536306 Aug 10 23:15:23.138756 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1899/3940] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:22 2022] GET /compute/v2.1/servers/27dd09d6-47ed-4b55-bd02-baad36a28429 => generated 1515 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:15:23.153760 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-f729fc95-6b14-444c-a2ff-ba1c7042883b tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:23.160606 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-f729fc95-6b14-444c-a2ff-ba1c7042883b tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: 1cd977e1-410c-4c5f-a8fa-a9f9033bc512] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:23.170664 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f729fc95-6b14-444c-a2ff-ba1c7042883b tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:23.171529 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f729fc95-6b14-444c-a2ff-ba1c7042883b tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:23.172360 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f729fc95-6b14-444c-a2ff-ba1c7042883b tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:23.173312 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f729fc95-6b14-444c-a2ff-ba1c7042883b tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:23.174095 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f729fc95-6b14-444c-a2ff-ba1c7042883b tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:23.174915 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f729fc95-6b14-444c-a2ff-ba1c7042883b tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:23.181990 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:15:23.299081 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-4f18291f-f8ac-4cd7-9fa0-669c04ea6d7b tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cc4167255044d29a70c12a5a44d800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578d8e62013d43c5ad4d9a6d92e1f201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:23.321064 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-4f18291f-f8ac-4cd7-9fa0-669c04ea6d7b tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] 10.222.0.58 "GET /compute/v2.1/servers/1c71b2c8-4cbd-4c02-bb74-ba27adb70325" status: 200 len: 1321 microversion: 2.1 time: 0.446764 Aug 10 23:15:23.326750 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2042/3941] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:22 2022] GET /compute/v2.1/servers/1c71b2c8-4cbd-4c02-bb74-ba27adb70325 => generated 1321 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:23.337326 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-f205fe3d-460f-48ec-827b-a86aae026344 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:23.348107 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-f205fe3d-460f-48ec-827b-a86aae026344 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:23.370443 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f205fe3d-460f-48ec-827b-a86aae026344 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:23.370899 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f205fe3d-460f-48ec-827b-a86aae026344 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:23.371350 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f205fe3d-460f-48ec-827b-a86aae026344 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:23.372100 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f205fe3d-460f-48ec-827b-a86aae026344 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:23.372596 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f205fe3d-460f-48ec-827b-a86aae026344 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:23.377043 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f205fe3d-460f-48ec-827b-a86aae026344 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:23.465527 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=8 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:15:23.489449 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=28 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:15:23.611259 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-f729fc95-6b14-444c-a2ff-ba1c7042883b tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6160c7a42740efbe3613380933fa15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d90f8a58ad047fa8f347d6474e4d673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:23.621190 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-f729fc95-6b14-444c-a2ff-ba1c7042883b tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "GET /compute/v2.1/servers/1cd977e1-410c-4c5f-a8fa-a9f9033bc512" status: 200 len: 1315 microversion: 2.1 time: 0.481169 Aug 10 23:15:23.636163 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1900/3942] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:23 2022] GET /compute/v2.1/servers/1cd977e1-410c-4c5f-a8fa-a9f9033bc512 => generated 1315 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:23.641968 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-3e1355f8-98c1-4c1d-b6bf-fd7ad4f0ad8d tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:15:23.645426 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-3e1355f8-98c1-4c1d-b6bf-fd7ad4f0ad8d tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] [instance: 8579c26e-076f-404a-bbe5-38d609e69acc] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:23.660411 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-3e1355f8-98c1-4c1d-b6bf-fd7ad4f0ad8d tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] HTTP exception thrown: Instance 8579c26e-076f-404a-bbe5-38d609e69acc could not be found. Aug 10 23:15:23.677643 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-3e1355f8-98c1-4c1d-b6bf-fd7ad4f0ad8d tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Request method failure captured: Aug 10 23:15:23.677643 n-d-850468-14 devstack@n-api.service[122632]: request: POST /compute/v2.1/servers/8579c26e-076f-404a-bbe5-38d609e69acc/action HTTP/1.1 Aug 10 23:15:23.677643 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:15:23.677643 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:15:23.677643 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:15:23.677643 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 14 Aug 10 23:15:23.677643 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:15:23.677643 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:15:23.677643 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:15:23.677643 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:15:23.677643 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9DvG6mPOp_bU6YQakEzMuJf91N1YrPRgIEe5ouB8tWtrXuOeLQgeJ0ouDTrtP31JIWcz1wQJ17PTz3JUAbF_FaF35I1F09nIb2lkQ0GhE880fsA2K13MCP_yKxqm-kv_hQLiQB8UzdyMBwb04C68j2QYpbobWhHyceARqBEeITDqyg0 Aug 10 23:15:23.677643 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:15:23.677643 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:15:23.677643 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:15:23.677643 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:15:23.677643 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:15:23.677643 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:15:23.677643 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 395d7c4077e54c43bb95288db3942b0a Aug 10 23:15:23.677643 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1029565464 Aug 10 23:15:23.677643 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:15:23.677643 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:15:23.677643 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/395d7c4077e54c43bb95288db3942b0a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/395d7c4077e54c43bb95288db3942b0a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/395d7c4077e54c43bb95288db3942b0a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_395d7c4077e54c43bb95288db3942b0a", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:15:23.677643 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1029565464 Aug 10 23:15:23.677643 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 395d7c4077e54c43bb95288db3942b0a Aug 10 23:15:23.677643 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1029565464 Aug 10 23:15:23.677643 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-ServerRescueNegativeTestJSON-1029565464-project Aug 10 23:15:23.677643 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:15:23.677643 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:15:23.677643 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: f07c94ebf0954cdea12b9a689538d96d Aug 10 23:15:23.677643 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1029565464-project Aug 10 23:15:23.677643 n-d-850468-14 devstack@n-api.service[122632]: Aug 10 23:15:23.677643 n-d-850468-14 devstack@n-api.service[122632]: {"rescue": {}} Aug 10 23:15:23.677643 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:15:23.677643 n-d-850468-14 devstack@n-api.service[122632]: exception: Instance 8579c26e-076f-404a-bbe5-38d609e69acc could not be found. Aug 10 23:15:23.677643 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': '8579c26e-076f-404a-bbe5-38d609e69acc', 'body': {'rescue': {}}} Aug 10 23:15:23.677643 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:15:23.677643 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:15:23.677643 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:15:23.677643 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:15:23.677643 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:15:23.677643 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:15:23.677643 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 10 23:15:23.677643 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 10 23:15:23.677643 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8579c26e-076f-404a-bbe5-38d609e69acc could not be found. Aug 10 23:15:23.677643 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:15:23.677643 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:15:23.677643 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:15:23.677643 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:15:23.677643 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:15:23.677643 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:15:23.677643 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:15:23.677643 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:15:23.677643 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:15:23.677643 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:15:23.677643 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 23:15:23.677643 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 23:15:23.677643 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue Aug 10 23:15:23.677643 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 10 23:15:23.677643 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:15:23.677643 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:15:23.677643 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8579c26e-076f-404a-bbe5-38d609e69acc could not be found. Aug 10 23:15:23.677643 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:15:23.677643 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:15:23.677643 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:15:23.677643 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:15:23.682481 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:15:23.682481 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:15:23.682481 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:15:23.682481 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:15:23.682481 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8579c26e-076f-404a-bbe5-38d609e69acc could not be found. Aug 10 23:15:23.682481 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:15:23.684366 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-3e1355f8-98c1-4c1d-b6bf-fd7ad4f0ad8d tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Returning 404 to user: Instance 8579c26e-076f-404a-bbe5-38d609e69acc could not be found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:15:23.685726 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-3e1355f8-98c1-4c1d-b6bf-fd7ad4f0ad8d tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] 10.222.0.58 "POST /compute/v2.1/servers/8579c26e-076f-404a-bbe5-38d609e69acc/action" status: 404 len: 111 microversion: 2.1 time: 0.048569 Aug 10 23:15:23.686630 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1901/3943] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:15:23 2022] POST /compute/v2.1/servers/8579c26e-076f-404a-bbe5-38d609e69acc/action => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:15:23.698705 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-f636c0ba-1195-4107-8a51-d8b3314e4cbe tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:15:23.699474 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-f636c0ba-1195-4107-8a51-d8b3314e4cbe tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] [instance: 27dd09d6-47ed-4b55-bd02-baad36a28429] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:23.718776 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f636c0ba-1195-4107-8a51-d8b3314e4cbe tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:23.719776 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f636c0ba-1195-4107-8a51-d8b3314e4cbe tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:23.720606 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f636c0ba-1195-4107-8a51-d8b3314e4cbe tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:23.721662 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f636c0ba-1195-4107-8a51-d8b3314e4cbe tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:23.722273 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f636c0ba-1195-4107-8a51-d8b3314e4cbe tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:23.722879 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f636c0ba-1195-4107-8a51-d8b3314e4cbe tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:23.814938 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-f205fe3d-460f-48ec-827b-a86aae026344 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:23.828769 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-f636c0ba-1195-4107-8a51-d8b3314e4cbe tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] 10.222.0.58 "POST /compute/v2.1/servers/27dd09d6-47ed-4b55-bd02-baad36a28429/action" status: 202 len: 0 microversion: 2.1 time: 0.133826 Aug 10 23:15:23.829736 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-f205fe3d-460f-48ec-827b-a86aae026344 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b" status: 200 len: 1512 microversion: 2.1 time: 0.501512 Aug 10 23:15:23.830225 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1902/3944] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:15:23 2022] POST /compute/v2.1/servers/27dd09d6-47ed-4b55-bd02-baad36a28429/action => generated 0 bytes in 136 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:15:23.830771 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2043/3945] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:23 2022] GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b => generated 1512 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:23.842447 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-d7af2348-03ff-456a-b1e0-dcd1414a68b3 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:23.853151 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-d7af2348-03ff-456a-b1e0-dcd1414a68b3 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] [instance: 27dd09d6-47ed-4b55-bd02-baad36a28429] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:23.873890 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d7af2348-03ff-456a-b1e0-dcd1414a68b3 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:23.874292 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d7af2348-03ff-456a-b1e0-dcd1414a68b3 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:23.874987 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d7af2348-03ff-456a-b1e0-dcd1414a68b3 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:23.876381 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d7af2348-03ff-456a-b1e0-dcd1414a68b3 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:23.877102 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d7af2348-03ff-456a-b1e0-dcd1414a68b3 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:23.877684 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d7af2348-03ff-456a-b1e0-dcd1414a68b3 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:23.897195 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-3f86b1fe-c429-4cdd-8a81-08d0d27e68ab tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:23.899327 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-3f86b1fe-c429-4cdd-8a81-08d0d27e68ab tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: fa9dfd3a-a636-48ce-ae15-0ed51baee954] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:23.913530 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3f86b1fe-c429-4cdd-8a81-08d0d27e68ab tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:23.916024 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3f86b1fe-c429-4cdd-8a81-08d0d27e68ab tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:23.917824 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3f86b1fe-c429-4cdd-8a81-08d0d27e68ab tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:23.920508 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3f86b1fe-c429-4cdd-8a81-08d0d27e68ab tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:23.921862 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3f86b1fe-c429-4cdd-8a81-08d0d27e68ab tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:23.923090 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3f86b1fe-c429-4cdd-8a81-08d0d27e68ab tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:24.199971 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-3f86b1fe-c429-4cdd-8a81-08d0d27e68ab tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:24.209396 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-3f86b1fe-c429-4cdd-8a81-08d0d27e68ab tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954" status: 200 len: 1677 microversion: 2.1 time: 0.321365 Aug 10 23:15:24.215805 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2044/3946] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:23 2022] GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954 => generated 1677 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:24.329283 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-d7af2348-03ff-456a-b1e0-dcd1414a68b3 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07c94ebf0954cdea12b9a689538d96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395d7c4077e54c43bb95288db3942b0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:24.345550 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c50cd9b2-e1a0-4884-bc4b-125e329d1f2a tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:24.346680 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-c50cd9b2-e1a0-4884-bc4b-125e329d1f2a tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] [instance: 1c71b2c8-4cbd-4c02-bb74-ba27adb70325] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:24.360545 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-d7af2348-03ff-456a-b1e0-dcd1414a68b3 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] 10.222.0.58 "GET /compute/v2.1/servers/27dd09d6-47ed-4b55-bd02-baad36a28429" status: 200 len: 1520 microversion: 2.1 time: 0.526002 Aug 10 23:15:24.369160 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1903/3947] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:23 2022] GET /compute/v2.1/servers/27dd09d6-47ed-4b55-bd02-baad36a28429 => generated 1520 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:15:24.371695 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c50cd9b2-e1a0-4884-bc4b-125e329d1f2a tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:24.372476 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c50cd9b2-e1a0-4884-bc4b-125e329d1f2a tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:24.372933 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c50cd9b2-e1a0-4884-bc4b-125e329d1f2a tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:24.373664 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c50cd9b2-e1a0-4884-bc4b-125e329d1f2a tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:24.374135 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c50cd9b2-e1a0-4884-bc4b-125e329d1f2a tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:24.374820 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c50cd9b2-e1a0-4884-bc4b-125e329d1f2a tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:24.643719 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-13f9e2f5-c9e6-4dd5-ac0d-e8b1ce969e88 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:24.645763 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-13f9e2f5-c9e6-4dd5-ac0d-e8b1ce969e88 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: 1cd977e1-410c-4c5f-a8fa-a9f9033bc512] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:24.667635 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-13f9e2f5-c9e6-4dd5-ac0d-e8b1ce969e88 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:24.671528 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-13f9e2f5-c9e6-4dd5-ac0d-e8b1ce969e88 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:24.672326 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-13f9e2f5-c9e6-4dd5-ac0d-e8b1ce969e88 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:24.673310 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-13f9e2f5-c9e6-4dd5-ac0d-e8b1ce969e88 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:24.674004 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-13f9e2f5-c9e6-4dd5-ac0d-e8b1ce969e88 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:24.674641 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-13f9e2f5-c9e6-4dd5-ac0d-e8b1ce969e88 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:24.734185 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-c50cd9b2-e1a0-4884-bc4b-125e329d1f2a tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cc4167255044d29a70c12a5a44d800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578d8e62013d43c5ad4d9a6d92e1f201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:24.743962 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-c50cd9b2-e1a0-4884-bc4b-125e329d1f2a tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] 10.222.0.58 "GET /compute/v2.1/servers/1c71b2c8-4cbd-4c02-bb74-ba27adb70325" status: 200 len: 1321 microversion: 2.1 time: 0.403726 Aug 10 23:15:24.744560 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2045/3948] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:24 2022] GET /compute/v2.1/servers/1c71b2c8-4cbd-4c02-bb74-ba27adb70325 => generated 1321 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:24.753418 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-4e145c2a-724c-4178-ba6b-26fce23078d0 req-5fcc3b5e-7c02-4f3f-9b74-593b10c1443f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c679e2a4-89de-4fcf-aed1-273220fdb2e8", "name": "network-vif-plugged", "status": "completed", "tag": "1321852d-7dbc-4643-9a94-9bd2f2a028f2"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:15:24.783127 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-4e145c2a-724c-4178-ba6b-26fce23078d0 req-5fcc3b5e-7c02-4f3f-9b74-593b10c1443f service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:24.783954 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-4e145c2a-724c-4178-ba6b-26fce23078d0 req-5fcc3b5e-7c02-4f3f-9b74-593b10c1443f service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:24.785254 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-4e145c2a-724c-4178-ba6b-26fce23078d0 req-5fcc3b5e-7c02-4f3f-9b74-593b10c1443f service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:24.838572 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-4e145c2a-724c-4178-ba6b-26fce23078d0 req-5fcc3b5e-7c02-4f3f-9b74-593b10c1443f service nova] Creating event network-vif-plugged:1321852d-7dbc-4643-9a94-9bd2f2a028f2 for instance c679e2a4-89de-4fcf-aed1-273220fdb2e8 on n-h2-850468-14 Aug 10 23:15:24.858275 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-4e145c2a-724c-4178-ba6b-26fce23078d0 req-5fcc3b5e-7c02-4f3f-9b74-593b10c1443f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108720 Aug 10 23:15:24.860280 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2046/3949] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:15:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:15:24.889671 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-0c240de8-ee88-45aa-ac95-a28a190d96d4 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:24.894122 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-0c240de8-ee88-45aa-ac95-a28a190d96d4 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:24.910423 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0c240de8-ee88-45aa-ac95-a28a190d96d4 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:24.915929 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0c240de8-ee88-45aa-ac95-a28a190d96d4 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:24.916768 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0c240de8-ee88-45aa-ac95-a28a190d96d4 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:24.917794 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0c240de8-ee88-45aa-ac95-a28a190d96d4 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:24.918458 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0c240de8-ee88-45aa-ac95-a28a190d96d4 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:24.919274 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0c240de8-ee88-45aa-ac95-a28a190d96d4 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:25.182588 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-13f9e2f5-c9e6-4dd5-ac0d-e8b1ce969e88 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6160c7a42740efbe3613380933fa15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d90f8a58ad047fa8f347d6474e4d673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:25.190974 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-13f9e2f5-c9e6-4dd5-ac0d-e8b1ce969e88 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "GET /compute/v2.1/servers/1cd977e1-410c-4c5f-a8fa-a9f9033bc512" status: 200 len: 1315 microversion: 2.1 time: 0.551922 Aug 10 23:15:25.195952 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1904/3950] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:24 2022] GET /compute/v2.1/servers/1cd977e1-410c-4c5f-a8fa-a9f9033bc512 => generated 1315 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:25.248803 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-64e79482-ecf0-4d61-90ad-42b40b5d30ca tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:25.249436 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-64e79482-ecf0-4d61-90ad-42b40b5d30ca tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: fa9dfd3a-a636-48ce-ae15-0ed51baee954] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:25.275951 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-64e79482-ecf0-4d61-90ad-42b40b5d30ca tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:25.276806 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-64e79482-ecf0-4d61-90ad-42b40b5d30ca tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:25.277446 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-64e79482-ecf0-4d61-90ad-42b40b5d30ca tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:25.278715 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-64e79482-ecf0-4d61-90ad-42b40b5d30ca tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:25.279381 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-64e79482-ecf0-4d61-90ad-42b40b5d30ca tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:25.280009 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-64e79482-ecf0-4d61-90ad-42b40b5d30ca tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:25.425046 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-0c240de8-ee88-45aa-ac95-a28a190d96d4 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:25.436237 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-0c240de8-ee88-45aa-ac95-a28a190d96d4 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b" status: 200 len: 1512 microversion: 2.1 time: 0.574649 Aug 10 23:15:25.443985 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2047/3951] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:24 2022] GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b => generated 1512 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:25.459215 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-b44a9c99-4cbb-403d-8815-02ca336cff30 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:25.459982 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-b44a9c99-4cbb-403d-8815-02ca336cff30 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] [instance: 27dd09d6-47ed-4b55-bd02-baad36a28429] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:25.469020 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b44a9c99-4cbb-403d-8815-02ca336cff30 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:25.470359 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b44a9c99-4cbb-403d-8815-02ca336cff30 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:25.471019 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b44a9c99-4cbb-403d-8815-02ca336cff30 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:25.471914 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b44a9c99-4cbb-403d-8815-02ca336cff30 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:25.472533 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b44a9c99-4cbb-403d-8815-02ca336cff30 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:25.474500 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b44a9c99-4cbb-403d-8815-02ca336cff30 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:25.681013 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-b44a9c99-4cbb-403d-8815-02ca336cff30 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07c94ebf0954cdea12b9a689538d96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395d7c4077e54c43bb95288db3942b0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:25.697578 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-b44a9c99-4cbb-403d-8815-02ca336cff30 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] 10.222.0.58 "GET /compute/v2.1/servers/27dd09d6-47ed-4b55-bd02-baad36a28429" status: 200 len: 1500 microversion: 2.1 time: 0.251553 Aug 10 23:15:25.700686 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2048/3952] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:25 2022] GET /compute/v2.1/servers/27dd09d6-47ed-4b55-bd02-baad36a28429 => generated 1500 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:25.728660 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-8c8aa0fe-de53-4794-af43-50d40917c864 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:15:25.731812 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-8c8aa0fe-de53-4794-af43-50d40917c864 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] [instance: 27dd09d6-47ed-4b55-bd02-baad36a28429] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:25.743045 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8c8aa0fe-de53-4794-af43-50d40917c864 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:25.744378 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8c8aa0fe-de53-4794-af43-50d40917c864 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:25.745145 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8c8aa0fe-de53-4794-af43-50d40917c864 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:25.746890 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8c8aa0fe-de53-4794-af43-50d40917c864 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:25.747387 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8c8aa0fe-de53-4794-af43-50d40917c864 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:25.747870 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8c8aa0fe-de53-4794-af43-50d40917c864 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:25.784877 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.objects.instance [None req-8c8aa0fe-de53-4794-af43-50d40917c864 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lazy-loading 'flavor' on Instance uuid 27dd09d6-47ed-4b55-bd02-baad36a28429 {{(pid=122633) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:15:25.805665 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-8c8aa0fe-de53-4794-af43-50d40917c864 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] HTTP exception thrown: Cannot 'rescue' instance 27dd09d6-47ed-4b55-bd02-baad36a28429 while it is in vm_state paused Aug 10 23:15:25.808779 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-8c8aa0fe-de53-4794-af43-50d40917c864 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Request method failure captured: Aug 10 23:15:25.808779 n-d-850468-14 devstack@n-api.service[122633]: request: POST /compute/v2.1/servers/27dd09d6-47ed-4b55-bd02-baad36a28429/action HTTP/1.1 Aug 10 23:15:25.808779 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:15:25.808779 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:15:25.808779 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:15:25.808779 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 14 Aug 10 23:15:25.808779 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:15:25.808779 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:15:25.808779 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:15:25.808779 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:15:25.808779 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9DvG6mPOp_bU6YQakEzMuJf91N1YrPRgIEe5ouB8tWtrXuOeLQgeJ0ouDTrtP31JIWcz1wQJ17PTz3JUAbF_FaF35I1F09nIb2lkQ0GhE880fsA2K13MCP_yKxqm-kv_hQLiQB8UzdyMBwb04C68j2QYpbobWhHyceARqBEeITDqyg0 Aug 10 23:15:25.808779 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:15:25.808779 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:15:25.808779 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:15:25.808779 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:15:25.808779 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:15:25.808779 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:15:25.808779 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 395d7c4077e54c43bb95288db3942b0a Aug 10 23:15:25.808779 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1029565464 Aug 10 23:15:25.808779 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:15:25.808779 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:15:25.808779 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/395d7c4077e54c43bb95288db3942b0a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/395d7c4077e54c43bb95288db3942b0a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/395d7c4077e54c43bb95288db3942b0a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_395d7c4077e54c43bb95288db3942b0a", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:15:25.808779 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1029565464 Aug 10 23:15:25.808779 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 395d7c4077e54c43bb95288db3942b0a Aug 10 23:15:25.808779 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1029565464 Aug 10 23:15:25.808779 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-ServerRescueNegativeTestJSON-1029565464-project Aug 10 23:15:25.808779 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:15:25.808779 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:15:25.808779 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: f07c94ebf0954cdea12b9a689538d96d Aug 10 23:15:25.808779 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1029565464-project Aug 10 23:15:25.808779 n-d-850468-14 devstack@n-api.service[122633]: Aug 10 23:15:25.808779 n-d-850468-14 devstack@n-api.service[122633]: {"rescue": {}} Aug 10 23:15:25.808779 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:15:25.808779 n-d-850468-14 devstack@n-api.service[122633]: exception: Cannot 'rescue' instance 27dd09d6-47ed-4b55-bd02-baad36a28429 while it is in vm_state paused Aug 10 23:15:25.808779 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': '27dd09d6-47ed-4b55-bd02-baad36a28429', 'body': {'rescue': {}}} Aug 10 23:15:25.808779 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:15:25.808779 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:15:25.808779 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue Aug 10 23:15:25.808779 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, Aug 10 23:15:25.808779 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Aug 10 23:15:25.808779 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 10 23:15:25.808779 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 10 23:15:25.808779 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 10 23:15:25.808779 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 10 23:15:25.808779 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 10 23:15:25.808779 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 27dd09d6-47ed-4b55-bd02-baad36a28429 in vm_state paused. Cannot rescue while the instance is in this state. Aug 10 23:15:25.808779 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:15:25.808779 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:15:25.808779 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:15:25.808779 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:15:25.808779 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:15:25.808779 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:15:25.808779 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:15:25.808779 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:15:25.808779 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:15:25.808779 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:15:25.808779 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 23:15:25.808779 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 23:15:25.808779 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue Aug 10 23:15:25.808779 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Aug 10 23:15:25.808779 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 10 23:15:25.808779 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 10 23:15:25.808779 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance 27dd09d6-47ed-4b55-bd02-baad36a28429 while it is in vm_state paused Aug 10 23:15:25.808779 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:15:25.814996 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:15:25.814996 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:15:25.814996 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:15:25.814996 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:15:25.814996 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:15:25.814996 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:15:25.814996 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:15:25.814996 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance 27dd09d6-47ed-4b55-bd02-baad36a28429 while it is in vm_state paused Aug 10 23:15:25.814996 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:15:25.816033 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-64e79482-ecf0-4d61-90ad-42b40b5d30ca tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:25.818424 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-8c8aa0fe-de53-4794-af43-50d40917c864 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Returning 409 to user: Cannot 'rescue' instance 27dd09d6-47ed-4b55-bd02-baad36a28429 while it is in vm_state paused {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:15:25.819868 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-8c8aa0fe-de53-4794-af43-50d40917c864 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] 10.222.0.58 "POST /compute/v2.1/servers/27dd09d6-47ed-4b55-bd02-baad36a28429/action" status: 409 len: 144 microversion: 2.1 time: 0.099675 Aug 10 23:15:25.820913 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2049/3953] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:15:25 2022] POST /compute/v2.1/servers/27dd09d6-47ed-4b55-bd02-baad36a28429/action => generated 144 bytes in 102 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 10 23:15:25.825349 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-64e79482-ecf0-4d61-90ad-42b40b5d30ca tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954" status: 200 len: 1677 microversion: 2.1 time: 0.586370 Aug 10 23:15:25.825349 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1905/3954] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:25 2022] GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954 => generated 1677 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:25.830190 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-6f660190-3b3a-4477-b0e5-91301f17ea1a tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:15:25.830773 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-6f660190-3b3a-4477-b0e5-91301f17ea1a tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] [instance: 27dd09d6-47ed-4b55-bd02-baad36a28429] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:25.841710 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c1a7fa4f-06fd-4148-a31b-bb9a5d6f09d4 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:25.842297 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6f660190-3b3a-4477-b0e5-91301f17ea1a tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:25.842798 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-c1a7fa4f-06fd-4148-a31b-bb9a5d6f09d4 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] [instance: 1c71b2c8-4cbd-4c02-bb74-ba27adb70325] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:25.842926 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6f660190-3b3a-4477-b0e5-91301f17ea1a tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:25.843617 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6f660190-3b3a-4477-b0e5-91301f17ea1a tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:25.844541 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6f660190-3b3a-4477-b0e5-91301f17ea1a tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:25.845194 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6f660190-3b3a-4477-b0e5-91301f17ea1a tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:25.845843 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6f660190-3b3a-4477-b0e5-91301f17ea1a tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:25.860097 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c1a7fa4f-06fd-4148-a31b-bb9a5d6f09d4 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:25.860597 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c1a7fa4f-06fd-4148-a31b-bb9a5d6f09d4 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:25.861036 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c1a7fa4f-06fd-4148-a31b-bb9a5d6f09d4 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:25.861739 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c1a7fa4f-06fd-4148-a31b-bb9a5d6f09d4 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:25.862434 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c1a7fa4f-06fd-4148-a31b-bb9a5d6f09d4 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:25.869799 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c1a7fa4f-06fd-4148-a31b-bb9a5d6f09d4 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:25.972627 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-6f660190-3b3a-4477-b0e5-91301f17ea1a tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] 10.222.0.58 "POST /compute/v2.1/servers/27dd09d6-47ed-4b55-bd02-baad36a28429/action" status: 202 len: 0 microversion: 2.1 time: 0.146008 Aug 10 23:15:25.974066 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2050/3955] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:15:25 2022] POST /compute/v2.1/servers/27dd09d6-47ed-4b55-bd02-baad36a28429/action => generated 0 bytes in 148 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:15:25.983604 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-595dce86-97d8-4aac-b324-e3687de0c776 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:25.984313 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-595dce86-97d8-4aac-b324-e3687de0c776 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] [instance: 27dd09d6-47ed-4b55-bd02-baad36a28429] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:25.991040 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-595dce86-97d8-4aac-b324-e3687de0c776 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:25.991845 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-595dce86-97d8-4aac-b324-e3687de0c776 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:25.992478 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-595dce86-97d8-4aac-b324-e3687de0c776 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:25.993376 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-595dce86-97d8-4aac-b324-e3687de0c776 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:25.993994 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-595dce86-97d8-4aac-b324-e3687de0c776 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:25.994661 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-595dce86-97d8-4aac-b324-e3687de0c776 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:26.204702 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-595dce86-97d8-4aac-b324-e3687de0c776 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07c94ebf0954cdea12b9a689538d96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395d7c4077e54c43bb95288db3942b0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:26.219102 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-595dce86-97d8-4aac-b324-e3687de0c776 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] 10.222.0.58 "GET /compute/v2.1/servers/27dd09d6-47ed-4b55-bd02-baad36a28429" status: 200 len: 1507 microversion: 2.1 time: 0.239560 Aug 10 23:15:26.220804 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2051/3956] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:25 2022] GET /compute/v2.1/servers/27dd09d6-47ed-4b55-bd02-baad36a28429 => generated 1507 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:26.230341 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-cd76142c-3007-45ff-9d7c-219564b21190 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:26.233201 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-cd76142c-3007-45ff-9d7c-219564b21190 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: 1cd977e1-410c-4c5f-a8fa-a9f9033bc512] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:26.243498 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cd76142c-3007-45ff-9d7c-219564b21190 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:26.244344 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cd76142c-3007-45ff-9d7c-219564b21190 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:26.245083 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cd76142c-3007-45ff-9d7c-219564b21190 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:26.246035 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cd76142c-3007-45ff-9d7c-219564b21190 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:26.247618 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cd76142c-3007-45ff-9d7c-219564b21190 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:26.248577 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cd76142c-3007-45ff-9d7c-219564b21190 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:26.554665 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-cd76142c-3007-45ff-9d7c-219564b21190 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6160c7a42740efbe3613380933fa15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d90f8a58ad047fa8f347d6474e4d673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:26.573560 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-cd76142c-3007-45ff-9d7c-219564b21190 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "GET /compute/v2.1/servers/1cd977e1-410c-4c5f-a8fa-a9f9033bc512" status: 200 len: 1315 microversion: 2.1 time: 0.345571 Aug 10 23:15:26.588086 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2052/3957] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:26 2022] GET /compute/v2.1/servers/1cd977e1-410c-4c5f-a8fa-a9f9033bc512 => generated 1315 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:26.599602 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-fc135131-aacf-4349-88a8-7fbba417407e tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:26.600513 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-fc135131-aacf-4349-88a8-7fbba417407e tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:26.612467 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fc135131-aacf-4349-88a8-7fbba417407e tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:26.613022 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fc135131-aacf-4349-88a8-7fbba417407e tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:26.614206 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fc135131-aacf-4349-88a8-7fbba417407e tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:26.615516 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fc135131-aacf-4349-88a8-7fbba417407e tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:26.616089 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fc135131-aacf-4349-88a8-7fbba417407e tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:26.616654 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fc135131-aacf-4349-88a8-7fbba417407e tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:26.849928 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-fc135131-aacf-4349-88a8-7fbba417407e tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:26.860517 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-fc135131-aacf-4349-88a8-7fbba417407e tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b" status: 200 len: 1512 microversion: 2.1 time: 0.271098 Aug 10 23:15:26.867684 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2053/3958] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:26 2022] GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b => generated 1512 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:26.876670 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-e2e9fbb9-5f80-4fae-b7f7-2953dc81da2c tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:26.877337 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-e2e9fbb9-5f80-4fae-b7f7-2953dc81da2c tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: fa9dfd3a-a636-48ce-ae15-0ed51baee954] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:26.890902 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e2e9fbb9-5f80-4fae-b7f7-2953dc81da2c tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:26.891780 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e2e9fbb9-5f80-4fae-b7f7-2953dc81da2c tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:26.892264 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e2e9fbb9-5f80-4fae-b7f7-2953dc81da2c tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:26.892987 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e2e9fbb9-5f80-4fae-b7f7-2953dc81da2c tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:26.893454 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e2e9fbb9-5f80-4fae-b7f7-2953dc81da2c tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:26.894034 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e2e9fbb9-5f80-4fae-b7f7-2953dc81da2c tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:26.899069 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:15:27.076576 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-c1a7fa4f-06fd-4148-a31b-bb9a5d6f09d4 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cc4167255044d29a70c12a5a44d800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578d8e62013d43c5ad4d9a6d92e1f201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:27.088753 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-c1a7fa4f-06fd-4148-a31b-bb9a5d6f09d4 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] 10.222.0.58 "GET /compute/v2.1/servers/1c71b2c8-4cbd-4c02-bb74-ba27adb70325" status: 200 len: 1321 microversion: 2.1 time: 1.263192 Aug 10 23:15:27.090138 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1906/3959] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:25 2022] GET /compute/v2.1/servers/1c71b2c8-4cbd-4c02-bb74-ba27adb70325 => generated 1321 bytes in 1265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:27.102371 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-97ee4fc4-7054-4dbf-9fe3-087760a9cbe5 req-cbf8ab21-b4d4-4e77-aacf-6f5646a9a577 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c71b2c8-4cbd-4c02-bb74-ba27adb70325", "name": "network-vif-plugged", "status": "completed", "tag": "37cbcd6f-0afe-4ca8-a522-a0291c6e237d"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:15:27.114903 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-97ee4fc4-7054-4dbf-9fe3-087760a9cbe5 req-cbf8ab21-b4d4-4e77-aacf-6f5646a9a577 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:27.115541 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-97ee4fc4-7054-4dbf-9fe3-087760a9cbe5 req-cbf8ab21-b4d4-4e77-aacf-6f5646a9a577 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:27.116051 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-97ee4fc4-7054-4dbf-9fe3-087760a9cbe5 req-cbf8ab21-b4d4-4e77-aacf-6f5646a9a577 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:27.142694 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-97ee4fc4-7054-4dbf-9fe3-087760a9cbe5 req-cbf8ab21-b4d4-4e77-aacf-6f5646a9a577 service nova] Creating event network-vif-plugged:37cbcd6f-0afe-4ca8-a522-a0291c6e237d for instance 1c71b2c8-4cbd-4c02-bb74-ba27adb70325 on n-h1-850468-14 Aug 10 23:15:27.149598 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-97ee4fc4-7054-4dbf-9fe3-087760a9cbe5 req-cbf8ab21-b4d4-4e77-aacf-6f5646a9a577 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057847 Aug 10 23:15:27.151302 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1907/3960] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:15:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:15:27.251997 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-65fefaf2-4baf-491a-b869-d3b967619cea tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:27.252847 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-65fefaf2-4baf-491a-b869-d3b967619cea tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] [instance: 27dd09d6-47ed-4b55-bd02-baad36a28429] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:27.265958 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-65fefaf2-4baf-491a-b869-d3b967619cea tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:27.266775 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-65fefaf2-4baf-491a-b869-d3b967619cea tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:27.283553 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-65fefaf2-4baf-491a-b869-d3b967619cea tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:27.284600 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-65fefaf2-4baf-491a-b869-d3b967619cea tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:27.285310 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-65fefaf2-4baf-491a-b869-d3b967619cea tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:27.286592 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-65fefaf2-4baf-491a-b869-d3b967619cea tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:27.567178 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-65fefaf2-4baf-491a-b869-d3b967619cea tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07c94ebf0954cdea12b9a689538d96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395d7c4077e54c43bb95288db3942b0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:27.569227 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-e2e9fbb9-5f80-4fae-b7f7-2953dc81da2c tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:27.577387 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-e2e9fbb9-5f80-4fae-b7f7-2953dc81da2c tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954" status: 200 len: 1654 microversion: 2.1 time: 0.708305 Aug 10 23:15:27.577983 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2054/3961] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:26 2022] GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954 => generated 1654 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:27.589752 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-65fefaf2-4baf-491a-b869-d3b967619cea tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] 10.222.0.58 "GET /compute/v2.1/servers/27dd09d6-47ed-4b55-bd02-baad36a28429" status: 200 len: 1515 microversion: 2.1 time: 0.346909 Aug 10 23:15:27.591694 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1908/3962] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:27 2022] GET /compute/v2.1/servers/27dd09d6-47ed-4b55-bd02-baad36a28429 => generated 1515 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:15:27.625114 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-2b2f1543-6a5d-4352-9fa4-3431af344587 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:27.626271 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-2b2f1543-6a5d-4352-9fa4-3431af344587 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: 1cd977e1-410c-4c5f-a8fa-a9f9033bc512] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:27.638405 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-18dc382c-6cea-40d7-a483-2c7e49cfaf8e tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:15:27.649695 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2b2f1543-6a5d-4352-9fa4-3431af344587 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:27.650594 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2b2f1543-6a5d-4352-9fa4-3431af344587 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:27.655376 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2b2f1543-6a5d-4352-9fa4-3431af344587 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:27.661125 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2b2f1543-6a5d-4352-9fa4-3431af344587 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:27.663885 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2b2f1543-6a5d-4352-9fa4-3431af344587 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:27.665931 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2b2f1543-6a5d-4352-9fa4-3431af344587 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:27.667470 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-18dc382c-6cea-40d7-a483-2c7e49cfaf8e tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:27.674130 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-18dc382c-6cea-40d7-a483-2c7e49cfaf8e tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:27.679491 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-18dc382c-6cea-40d7-a483-2c7e49cfaf8e tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:27.758720 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-18dc382c-6cea-40d7-a483-2c7e49cfaf8e tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: fa9dfd3a-a636-48ce-ae15-0ed51baee954] Going to try to start instance {{(pid=122632) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 10 23:15:27.837542 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-18dc382c-6cea-40d7-a483-2c7e49cfaf8e tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "POST /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954/action" status: 202 len: 0 microversion: 2.1 time: 0.212810 Aug 10 23:15:27.843459 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1909/3963] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:15:27 2022] POST /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954/action => generated 0 bytes in 219 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:15:27.865307 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-4ec0099a-1459-4c2b-b6b3-7ba2ac85d18e tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:27.868311 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-4ec0099a-1459-4c2b-b6b3-7ba2ac85d18e tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: fa9dfd3a-a636-48ce-ae15-0ed51baee954] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:27.889715 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4ec0099a-1459-4c2b-b6b3-7ba2ac85d18e tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:27.892058 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4ec0099a-1459-4c2b-b6b3-7ba2ac85d18e tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:27.893098 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4ec0099a-1459-4c2b-b6b3-7ba2ac85d18e tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:27.897034 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4ec0099a-1459-4c2b-b6b3-7ba2ac85d18e tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:27.897876 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4ec0099a-1459-4c2b-b6b3-7ba2ac85d18e tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:27.898728 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4ec0099a-1459-4c2b-b6b3-7ba2ac85d18e tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:28.267388 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-2b2f1543-6a5d-4352-9fa4-3431af344587 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6160c7a42740efbe3613380933fa15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d90f8a58ad047fa8f347d6474e4d673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:28.307474 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-2b2f1543-6a5d-4352-9fa4-3431af344587 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "GET /compute/v2.1/servers/1cd977e1-410c-4c5f-a8fa-a9f9033bc512" status: 200 len: 1315 microversion: 2.1 time: 0.693273 Aug 10 23:15:28.310129 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2055/3964] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:27 2022] GET /compute/v2.1/servers/1cd977e1-410c-4c5f-a8fa-a9f9033bc512 => generated 1315 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:28.335863 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-028968e9-12c5-49cc-985e-f9e0fcae50aa tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:28.337238 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-028968e9-12c5-49cc-985e-f9e0fcae50aa tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:28.351803 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-028968e9-12c5-49cc-985e-f9e0fcae50aa tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:28.353810 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-028968e9-12c5-49cc-985e-f9e0fcae50aa tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:28.354498 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-028968e9-12c5-49cc-985e-f9e0fcae50aa tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:28.356421 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-028968e9-12c5-49cc-985e-f9e0fcae50aa tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:28.357695 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-028968e9-12c5-49cc-985e-f9e0fcae50aa tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:28.358456 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-028968e9-12c5-49cc-985e-f9e0fcae50aa tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:28.405328 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-4ec0099a-1459-4c2b-b6b3-7ba2ac85d18e tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:28.421256 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-4ec0099a-1459-4c2b-b6b3-7ba2ac85d18e tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954" status: 200 len: 1663 microversion: 2.1 time: 0.568007 Aug 10 23:15:28.438035 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1910/3965] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:27 2022] GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954 => generated 1663 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:28.449343 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-5fe6db45-cb89-425e-b1e7-11fe526c4a6d tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:28.450829 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-5fe6db45-cb89-425e-b1e7-11fe526c4a6d tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] [instance: 1c71b2c8-4cbd-4c02-bb74-ba27adb70325] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:28.465341 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_api:SELECT=99,nova_api:DELETE=1 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:15:28.475136 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5fe6db45-cb89-425e-b1e7-11fe526c4a6d tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:28.475972 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5fe6db45-cb89-425e-b1e7-11fe526c4a6d tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:28.477279 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5fe6db45-cb89-425e-b1e7-11fe526c4a6d tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:28.479018 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5fe6db45-cb89-425e-b1e7-11fe526c4a6d tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:28.480050 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5fe6db45-cb89-425e-b1e7-11fe526c4a6d tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:28.480728 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5fe6db45-cb89-425e-b1e7-11fe526c4a6d tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:28.692279 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-028968e9-12c5-49cc-985e-f9e0fcae50aa tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:28.708602 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-028968e9-12c5-49cc-985e-f9e0fcae50aa tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b" status: 200 len: 1512 microversion: 2.1 time: 0.395025 Aug 10 23:15:28.709550 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2056/3966] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:28 2022] GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b => generated 1512 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:29.331290 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-1acefaaa-b489-4931-8ed7-6126eb84f4bb tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:29.332079 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-1acefaaa-b489-4931-8ed7-6126eb84f4bb tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: 1cd977e1-410c-4c5f-a8fa-a9f9033bc512] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:29.343869 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1acefaaa-b489-4931-8ed7-6126eb84f4bb tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:29.344231 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1acefaaa-b489-4931-8ed7-6126eb84f4bb tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:29.344683 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1acefaaa-b489-4931-8ed7-6126eb84f4bb tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:29.348587 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1acefaaa-b489-4931-8ed7-6126eb84f4bb tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:29.349191 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1acefaaa-b489-4931-8ed7-6126eb84f4bb tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:29.349668 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1acefaaa-b489-4931-8ed7-6126eb84f4bb tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:29.394269 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-5fe6db45-cb89-425e-b1e7-11fe526c4a6d tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cc4167255044d29a70c12a5a44d800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578d8e62013d43c5ad4d9a6d92e1f201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:29.412918 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-5fe6db45-cb89-425e-b1e7-11fe526c4a6d tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] 10.222.0.58 "GET /compute/v2.1/servers/1c71b2c8-4cbd-4c02-bb74-ba27adb70325" status: 200 len: 1321 microversion: 2.1 time: 0.970180 Aug 10 23:15:29.427750 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1911/3967] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:28 2022] GET /compute/v2.1/servers/1c71b2c8-4cbd-4c02-bb74-ba27adb70325 => generated 1321 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:29.449544 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-50132b47-89a0-4c1c-9c4e-692b5674bc3c tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:29.450733 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-50132b47-89a0-4c1c-9c4e-692b5674bc3c tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: fa9dfd3a-a636-48ce-ae15-0ed51baee954] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:29.461607 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-50132b47-89a0-4c1c-9c4e-692b5674bc3c tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:29.462108 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-50132b47-89a0-4c1c-9c4e-692b5674bc3c tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:29.462551 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-50132b47-89a0-4c1c-9c4e-692b5674bc3c tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:29.463348 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-50132b47-89a0-4c1c-9c4e-692b5674bc3c tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:29.466390 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-50132b47-89a0-4c1c-9c4e-692b5674bc3c tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:29.466971 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-50132b47-89a0-4c1c-9c4e-692b5674bc3c tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:29.642574 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-1acefaaa-b489-4931-8ed7-6126eb84f4bb tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6160c7a42740efbe3613380933fa15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d90f8a58ad047fa8f347d6474e4d673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:29.652834 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-1acefaaa-b489-4931-8ed7-6126eb84f4bb tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "GET /compute/v2.1/servers/1cd977e1-410c-4c5f-a8fa-a9f9033bc512" status: 200 len: 1315 microversion: 2.1 time: 0.325841 Aug 10 23:15:29.653440 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2057/3968] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:29 2022] GET /compute/v2.1/servers/1cd977e1-410c-4c5f-a8fa-a9f9033bc512 => generated 1315 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:15:29.734518 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-512006cf-639b-43a1-9e95-c4df5550ee80 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:29.735663 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-512006cf-639b-43a1-9e95-c4df5550ee80 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:29.744273 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-512006cf-639b-43a1-9e95-c4df5550ee80 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:29.745648 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-512006cf-639b-43a1-9e95-c4df5550ee80 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:29.746325 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-512006cf-639b-43a1-9e95-c4df5550ee80 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:29.747329 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-512006cf-639b-43a1-9e95-c4df5550ee80 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:29.748184 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-512006cf-639b-43a1-9e95-c4df5550ee80 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:29.748870 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-512006cf-639b-43a1-9e95-c4df5550ee80 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:29.928792 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-512006cf-639b-43a1-9e95-c4df5550ee80 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:29.945646 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-512006cf-639b-43a1-9e95-c4df5550ee80 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b" status: 200 len: 1533 microversion: 2.1 time: 0.217878 Aug 10 23:15:29.961783 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2058/3969] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:29 2022] GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b => generated 1533 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:30.434084 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-fdffedeb-16d3-4a3d-b008-9a40d83304de tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:30.435074 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-fdffedeb-16d3-4a3d-b008-9a40d83304de tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] [instance: 1c71b2c8-4cbd-4c02-bb74-ba27adb70325] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:30.445814 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fdffedeb-16d3-4a3d-b008-9a40d83304de tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:30.446315 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fdffedeb-16d3-4a3d-b008-9a40d83304de tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:30.446756 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fdffedeb-16d3-4a3d-b008-9a40d83304de tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:30.447523 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fdffedeb-16d3-4a3d-b008-9a40d83304de tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:30.447977 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fdffedeb-16d3-4a3d-b008-9a40d83304de tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:30.460117 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fdffedeb-16d3-4a3d-b008-9a40d83304de tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:30.600787 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-50132b47-89a0-4c1c-9c4e-692b5674bc3c tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:30.621351 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-50132b47-89a0-4c1c-9c4e-692b5674bc3c tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954" status: 200 len: 1663 microversion: 2.1 time: 1.175874 Aug 10 23:15:30.623969 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1912/3970] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:29 2022] GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954 => generated 1663 bytes in 1179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:15:30.674219 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-7fe174e1-d992-4715-9a4c-88de65c3a4fe tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:30.677999 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-7fe174e1-d992-4715-9a4c-88de65c3a4fe tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: 1cd977e1-410c-4c5f-a8fa-a9f9033bc512] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:30.681183 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-fdffedeb-16d3-4a3d-b008-9a40d83304de tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cc4167255044d29a70c12a5a44d800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578d8e62013d43c5ad4d9a6d92e1f201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:30.685601 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7fe174e1-d992-4715-9a4c-88de65c3a4fe tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:30.687114 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7fe174e1-d992-4715-9a4c-88de65c3a4fe tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:30.688122 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7fe174e1-d992-4715-9a4c-88de65c3a4fe tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:30.689039 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7fe174e1-d992-4715-9a4c-88de65c3a4fe tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:30.689761 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-fdffedeb-16d3-4a3d-b008-9a40d83304de tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] 10.222.0.58 "GET /compute/v2.1/servers/1c71b2c8-4cbd-4c02-bb74-ba27adb70325" status: 200 len: 1512 microversion: 2.1 time: 0.259745 Aug 10 23:15:30.690096 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7fe174e1-d992-4715-9a4c-88de65c3a4fe tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:30.690722 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7fe174e1-d992-4715-9a4c-88de65c3a4fe tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:30.692356 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2059/3971] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:30 2022] GET /compute/v2.1/servers/1c71b2c8-4cbd-4c02-bb74-ba27adb70325 => generated 1512 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:15:30.715849 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-4b31de06-48cc-4736-b42f-103ca53d080d tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:30.718455 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-4b31de06-48cc-4736-b42f-103ca53d080d tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] [instance: fdd1f85d-95db-477c-a173-a6fca94f58b1] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:30.737605 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4b31de06-48cc-4736-b42f-103ca53d080d tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:30.741545 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4b31de06-48cc-4736-b42f-103ca53d080d tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:30.742071 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4b31de06-48cc-4736-b42f-103ca53d080d tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:30.742861 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4b31de06-48cc-4736-b42f-103ca53d080d tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:30.745661 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4b31de06-48cc-4736-b42f-103ca53d080d tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:30.746407 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4b31de06-48cc-4736-b42f-103ca53d080d tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:30.972355 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-4b31de06-48cc-4736-b42f-103ca53d080d tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cc4167255044d29a70c12a5a44d800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578d8e62013d43c5ad4d9a6d92e1f201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:30.991616 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-4b31de06-48cc-4736-b42f-103ca53d080d tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] 10.222.0.58 "GET /compute/v2.1/servers/fdd1f85d-95db-477c-a173-a6fca94f58b1" status: 200 len: 1513 microversion: 2.1 time: 0.282974 Aug 10 23:15:30.992216 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2060/3972] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:30 2022] GET /compute/v2.1/servers/fdd1f85d-95db-477c-a173-a6fca94f58b1 => generated 1513 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:31.001668 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-e7713224-a950-4d62-af75-228c7ef916f7 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:15:31.005044 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-e7713224-a950-4d62-af75-228c7ef916f7 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] [instance: 27dd09d6-47ed-4b55-bd02-baad36a28429] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:31.024344 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e7713224-a950-4d62-af75-228c7ef916f7 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:31.025873 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e7713224-a950-4d62-af75-228c7ef916f7 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:31.026836 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e7713224-a950-4d62-af75-228c7ef916f7 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:31.027846 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e7713224-a950-4d62-af75-228c7ef916f7 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:31.028912 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e7713224-a950-4d62-af75-228c7ef916f7 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:31.029427 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e7713224-a950-4d62-af75-228c7ef916f7 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:31.062406 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.objects.instance [None req-e7713224-a950-4d62-af75-228c7ef916f7 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lazy-loading 'flavor' on Instance uuid 27dd09d6-47ed-4b55-bd02-baad36a28429 {{(pid=122633) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:15:31.239410 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-e7713224-a950-4d62-af75-228c7ef916f7 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] 10.222.0.58 "POST /compute/v2.1/servers/27dd09d6-47ed-4b55-bd02-baad36a28429/action" status: 200 len: 32 microversion: 2.1 time: 0.245203 Aug 10 23:15:31.245419 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2061/3973] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:15:30 2022] POST /compute/v2.1/servers/27dd09d6-47ed-4b55-bd02-baad36a28429/action => generated 32 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 23:15:31.251493 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-da1acf99-7fcd-40a7-8be8-360fa3fe8208 req-5683d58a-4f50-420f-a904-5e93509da196 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1cd977e1-410c-4c5f-a8fa-a9f9033bc512", "name": "network-vif-plugged", "status": "completed", "tag": "a7efb403-a557-4888-b47e-036a0a6d5c76"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:15:31.263673 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-da1acf99-7fcd-40a7-8be8-360fa3fe8208 req-5683d58a-4f50-420f-a904-5e93509da196 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:31.264483 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-da1acf99-7fcd-40a7-8be8-360fa3fe8208 req-5683d58a-4f50-420f-a904-5e93509da196 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:31.265110 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-da1acf99-7fcd-40a7-8be8-360fa3fe8208 req-5683d58a-4f50-420f-a904-5e93509da196 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:31.279960 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-da1acf99-7fcd-40a7-8be8-360fa3fe8208 req-5683d58a-4f50-420f-a904-5e93509da196 service nova] Creating event network-vif-plugged:a7efb403-a557-4888-b47e-036a0a6d5c76 for instance 1cd977e1-410c-4c5f-a8fa-a9f9033bc512 on n-h2-850468-14 Aug 10 23:15:31.286390 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-da1acf99-7fcd-40a7-8be8-360fa3fe8208 req-5683d58a-4f50-420f-a904-5e93509da196 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039122 Aug 10 23:15:31.287372 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2062/3974] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:15:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:15:31.288765 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-7fe174e1-d992-4715-9a4c-88de65c3a4fe tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6160c7a42740efbe3613380933fa15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d90f8a58ad047fa8f347d6474e4d673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:31.292903 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-1ef54c59-06e7-4010-b5fc-aa3f52b298e7 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:31.293948 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-1ef54c59-06e7-4010-b5fc-aa3f52b298e7 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:31.317553 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1ef54c59-06e7-4010-b5fc-aa3f52b298e7 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:31.318428 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1ef54c59-06e7-4010-b5fc-aa3f52b298e7 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:31.319162 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1ef54c59-06e7-4010-b5fc-aa3f52b298e7 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:31.320092 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1ef54c59-06e7-4010-b5fc-aa3f52b298e7 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:31.320753 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1ef54c59-06e7-4010-b5fc-aa3f52b298e7 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:31.321379 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1ef54c59-06e7-4010-b5fc-aa3f52b298e7 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:31.359745 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-7fe174e1-d992-4715-9a4c-88de65c3a4fe tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "GET /compute/v2.1/servers/1cd977e1-410c-4c5f-a8fa-a9f9033bc512" status: 200 len: 1315 microversion: 2.1 time: 0.686024 Aug 10 23:15:31.384962 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1913/3975] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:30 2022] GET /compute/v2.1/servers/1cd977e1-410c-4c5f-a8fa-a9f9033bc512 => generated 1315 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:31.404267 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-7beee8bc-a427-499c-be6d-c09b4aecf4ad tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:31.415139 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-7beee8bc-a427-499c-be6d-c09b4aecf4ad tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] [instance: c679e2a4-89de-4fcf-aed1-273220fdb2e8] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:31.441485 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7beee8bc-a427-499c-be6d-c09b4aecf4ad tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:31.443927 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7beee8bc-a427-499c-be6d-c09b4aecf4ad tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:31.451653 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7beee8bc-a427-499c-be6d-c09b4aecf4ad tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:31.456058 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7beee8bc-a427-499c-be6d-c09b4aecf4ad tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:31.456880 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7beee8bc-a427-499c-be6d-c09b4aecf4ad tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:31.458375 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7beee8bc-a427-499c-be6d-c09b4aecf4ad tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:32.824951 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-1ef54c59-06e7-4010-b5fc-aa3f52b298e7 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:32.837554 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-1ef54c59-06e7-4010-b5fc-aa3f52b298e7 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b" status: 200 len: 1528 microversion: 2.1 time: 1.548689 Aug 10 23:15:32.843439 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2063/3976] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:31 2022] GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b => generated 1528 bytes in 1555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:32.863931 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-dbbd84e3-343e-47e9-a23b-d5c9b3441cd8 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:32.868509 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-dbbd84e3-343e-47e9-a23b-d5c9b3441cd8 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] [instance: 27dd09d6-47ed-4b55-bd02-baad36a28429] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:32.896708 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dbbd84e3-343e-47e9-a23b-d5c9b3441cd8 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:32.898050 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dbbd84e3-343e-47e9-a23b-d5c9b3441cd8 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:32.900660 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dbbd84e3-343e-47e9-a23b-d5c9b3441cd8 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:32.904547 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dbbd84e3-343e-47e9-a23b-d5c9b3441cd8 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:32.908097 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dbbd84e3-343e-47e9-a23b-d5c9b3441cd8 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:32.911289 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dbbd84e3-343e-47e9-a23b-d5c9b3441cd8 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:33.239066 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-7beee8bc-a427-499c-be6d-c09b4aecf4ad tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cc4167255044d29a70c12a5a44d800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578d8e62013d43c5ad4d9a6d92e1f201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:33.249103 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-7beee8bc-a427-499c-be6d-c09b4aecf4ad tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] 10.222.0.58 "GET /compute/v2.1/servers/c679e2a4-89de-4fcf-aed1-273220fdb2e8" status: 200 len: 1512 microversion: 2.1 time: 1.860491 Aug 10 23:15:33.249695 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1914/3977] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:31 2022] GET /compute/v2.1/servers/c679e2a4-89de-4fcf-aed1-273220fdb2e8 => generated 1512 bytes in 1864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:33.268577 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c269f059-6c03-46ba-bcbc-ec15332567e6 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:33.269430 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-c269f059-6c03-46ba-bcbc-ec15332567e6 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: fa9dfd3a-a636-48ce-ae15-0ed51baee954] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:33.288661 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c269f059-6c03-46ba-bcbc-ec15332567e6 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:33.289198 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c269f059-6c03-46ba-bcbc-ec15332567e6 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:33.289647 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c269f059-6c03-46ba-bcbc-ec15332567e6 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:33.290386 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c269f059-6c03-46ba-bcbc-ec15332567e6 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:33.290894 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c269f059-6c03-46ba-bcbc-ec15332567e6 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:33.299615 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c269f059-6c03-46ba-bcbc-ec15332567e6 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:33.379455 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-dbbd84e3-343e-47e9-a23b-d5c9b3441cd8 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07c94ebf0954cdea12b9a689538d96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395d7c4077e54c43bb95288db3942b0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:33.421119 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-dbbd84e3-343e-47e9-a23b-d5c9b3441cd8 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] 10.222.0.58 "GET /compute/v2.1/servers/27dd09d6-47ed-4b55-bd02-baad36a28429" status: 200 len: 1521 microversion: 2.1 time: 0.576167 Aug 10 23:15:33.422595 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2064/3978] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:32 2022] GET /compute/v2.1/servers/27dd09d6-47ed-4b55-bd02-baad36a28429 => generated 1521 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:33.431041 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-71bef84f-7610-4b06-8f7d-b6eb6cab9889 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:33.432180 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-71bef84f-7610-4b06-8f7d-b6eb6cab9889 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: 1cd977e1-410c-4c5f-a8fa-a9f9033bc512] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:33.449466 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-71bef84f-7610-4b06-8f7d-b6eb6cab9889 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:33.450332 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-71bef84f-7610-4b06-8f7d-b6eb6cab9889 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:33.451817 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-71bef84f-7610-4b06-8f7d-b6eb6cab9889 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:33.453277 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-71bef84f-7610-4b06-8f7d-b6eb6cab9889 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:33.454224 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-71bef84f-7610-4b06-8f7d-b6eb6cab9889 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:33.455488 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-71bef84f-7610-4b06-8f7d-b6eb6cab9889 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:33.742720 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-c269f059-6c03-46ba-bcbc-ec15332567e6 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:33.762849 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-c269f059-6c03-46ba-bcbc-ec15332567e6 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954" status: 200 len: 1667 microversion: 2.1 time: 0.505557 Aug 10 23:15:33.770634 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1915/3979] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:33 2022] GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954 => generated 1667 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:33.787943 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-71bef84f-7610-4b06-8f7d-b6eb6cab9889 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6160c7a42740efbe3613380933fa15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d90f8a58ad047fa8f347d6474e4d673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:33.796027 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-5af831dc-3f22-4385-90a5-a55e43f9d07f tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:33.799246 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-71bef84f-7610-4b06-8f7d-b6eb6cab9889 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "GET /compute/v2.1/servers/1cd977e1-410c-4c5f-a8fa-a9f9033bc512" status: 200 len: 1315 microversion: 2.1 time: 0.375226 Aug 10 23:15:33.800999 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-5af831dc-3f22-4385-90a5-a55e43f9d07f tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '06cc4167255044d29a70c12a5a44d800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578d8e62013d43c5ad4d9a6d92e1f201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:33.801892 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-5af831dc-3f22-4385-90a5-a55e43f9d07f tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '578d8e62013d43c5ad4d9a6d92e1f201'} {{(pid=122632) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 10 23:15:33.803345 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2065/3980] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:33 2022] GET /compute/v2.1/servers/1cd977e1-410c-4c5f-a8fa-a9f9033bc512 => generated 1315 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:33.834261 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-f7b55dc0-3ba4-4dd3-8be9-6f2f1d7b59da tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:33.838290 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5af831dc-3f22-4385-90a5-a55e43f9d07f tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:33.838804 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5af831dc-3f22-4385-90a5-a55e43f9d07f tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:33.839261 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5af831dc-3f22-4385-90a5-a55e43f9d07f tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:33.839536 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-f7b55dc0-3ba4-4dd3-8be9-6f2f1d7b59da tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: fa9dfd3a-a636-48ce-ae15-0ed51baee954] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:33.840000 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5af831dc-3f22-4385-90a5-a55e43f9d07f tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:33.840575 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5af831dc-3f22-4385-90a5-a55e43f9d07f tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:33.840971 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5af831dc-3f22-4385-90a5-a55e43f9d07f tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:33.854246 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f7b55dc0-3ba4-4dd3-8be9-6f2f1d7b59da tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:33.854749 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f7b55dc0-3ba4-4dd3-8be9-6f2f1d7b59da tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:33.855273 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f7b55dc0-3ba4-4dd3-8be9-6f2f1d7b59da tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:33.871371 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f7b55dc0-3ba4-4dd3-8be9-6f2f1d7b59da tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:33.872025 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f7b55dc0-3ba4-4dd3-8be9-6f2f1d7b59da tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:33.872502 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f7b55dc0-3ba4-4dd3-8be9-6f2f1d7b59da tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:34.064488 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.multi_cell_list [None req-5af831dc-3f22-4385-90a5-a55e43f9d07f tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122632) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 10 23:15:34.077510 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:15:34.241481 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-5af831dc-3f22-4385-90a5-a55e43f9d07f tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cc4167255044d29a70c12a5a44d800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578d8e62013d43c5ad4d9a6d92e1f201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:34.264305 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5af831dc-3f22-4385-90a5-a55e43f9d07f tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:34.265025 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5af831dc-3f22-4385-90a5-a55e43f9d07f tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:34.265667 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5af831dc-3f22-4385-90a5-a55e43f9d07f tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:34.307949 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-f7b55dc0-3ba4-4dd3-8be9-6f2f1d7b59da tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:34.326719 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-f7b55dc0-3ba4-4dd3-8be9-6f2f1d7b59da tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954" status: 200 len: 1667 microversion: 2.1 time: 0.503161 Aug 10 23:15:34.327358 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2066/3981] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:33 2022] GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954 => generated 1667 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:34.367398 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-3893ac4a-bc90-402b-88dd-980ebd6286de tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:34.369128 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-3893ac4a-bc90-402b-88dd-980ebd6286de tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:34.384302 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3893ac4a-bc90-402b-88dd-980ebd6286de tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:34.384811 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3893ac4a-bc90-402b-88dd-980ebd6286de tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:34.385265 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3893ac4a-bc90-402b-88dd-980ebd6286de tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:34.385993 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3893ac4a-bc90-402b-88dd-980ebd6286de tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:34.386459 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3893ac4a-bc90-402b-88dd-980ebd6286de tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:34.386934 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3893ac4a-bc90-402b-88dd-980ebd6286de tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:34.648826 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-3893ac4a-bc90-402b-88dd-980ebd6286de tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:34.659688 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-3893ac4a-bc90-402b-88dd-980ebd6286de tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b" status: 200 len: 1528 microversion: 2.1 time: 0.307429 Aug 10 23:15:34.679520 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2067/3982] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:34 2022] GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b => generated 1528 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:34.689753 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-88033f2b-30b5-4d55-9782-8297ada1c348 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:15:34.690653 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-88033f2b-30b5-4d55-9782-8297ada1c348 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: fa9dfd3a-a636-48ce-ae15-0ed51baee954] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:34.702735 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-88033f2b-30b5-4d55-9782-8297ada1c348 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:34.704566 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-88033f2b-30b5-4d55-9782-8297ada1c348 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:34.706538 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-88033f2b-30b5-4d55-9782-8297ada1c348 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:34.709573 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-88033f2b-30b5-4d55-9782-8297ada1c348 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:34.711924 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-88033f2b-30b5-4d55-9782-8297ada1c348 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:34.712619 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-88033f2b-30b5-4d55-9782-8297ada1c348 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:34.789715 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:15:34.814652 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-88033f2b-30b5-4d55-9782-8297ada1c348 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: fa9dfd3a-a636-48ce-ae15-0ed51baee954] Unlocking {{(pid=122633) unlock /opt/stack/nova/nova/compute/api.py:4823}} Aug 10 23:15:34.928036 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-88033f2b-30b5-4d55-9782-8297ada1c348 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "POST /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954/action" status: 202 len: 0 microversion: 2.1 time: 0.246984 Aug 10 23:15:34.935205 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2068/3983] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:15:34 2022] POST /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954/action => generated 0 bytes in 255 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:15:34.940351 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-1fce2614-b300-445d-b429-460cd6aa8708 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:34.943480 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-1fce2614-b300-445d-b429-460cd6aa8708 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] [instance: 27dd09d6-47ed-4b55-bd02-baad36a28429] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:34.958134 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1fce2614-b300-445d-b429-460cd6aa8708 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:34.958980 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1fce2614-b300-445d-b429-460cd6aa8708 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:34.959600 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1fce2614-b300-445d-b429-460cd6aa8708 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:34.960498 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1fce2614-b300-445d-b429-460cd6aa8708 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:34.961123 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1fce2614-b300-445d-b429-460cd6aa8708 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:34.961739 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1fce2614-b300-445d-b429-460cd6aa8708 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:35.181931 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-1fce2614-b300-445d-b429-460cd6aa8708 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07c94ebf0954cdea12b9a689538d96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395d7c4077e54c43bb95288db3942b0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:35.195379 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-1fce2614-b300-445d-b429-460cd6aa8708 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] 10.222.0.58 "GET /compute/v2.1/servers/27dd09d6-47ed-4b55-bd02-baad36a28429" status: 200 len: 1521 microversion: 2.1 time: 0.258658 Aug 10 23:15:35.212073 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2069/3984] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:34 2022] GET /compute/v2.1/servers/27dd09d6-47ed-4b55-bd02-baad36a28429 => generated 1521 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:35.218361 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-2318a397-9460-4fd7-beb6-81143e2051b7 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:35.219257 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-2318a397-9460-4fd7-beb6-81143e2051b7 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: 1cd977e1-410c-4c5f-a8fa-a9f9033bc512] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:35.227163 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2318a397-9460-4fd7-beb6-81143e2051b7 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:35.233051 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2318a397-9460-4fd7-beb6-81143e2051b7 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:35.233538 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2318a397-9460-4fd7-beb6-81143e2051b7 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:35.235714 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2318a397-9460-4fd7-beb6-81143e2051b7 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:35.237051 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2318a397-9460-4fd7-beb6-81143e2051b7 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:35.237815 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2318a397-9460-4fd7-beb6-81143e2051b7 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:35.414635 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-5af831dc-3f22-4385-90a5-a55e43f9d07f tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] 10.222.0.58 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1515 microversion: 2.1 time: 1.641954 Aug 10 23:15:35.415273 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1916/3985] 10.222.0.58 () {58 vars in 1167 bytes} [Wed Aug 10 23:15:33 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1515 bytes in 1643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:35.444490 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-59b0eebe-08e8-43e9-85ab-9712e16d1ef9 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:35.445797 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-59b0eebe-08e8-43e9-85ab-9712e16d1ef9 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: fa9dfd3a-a636-48ce-ae15-0ed51baee954] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:35.458080 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-59b0eebe-08e8-43e9-85ab-9712e16d1ef9 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:35.460077 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-59b0eebe-08e8-43e9-85ab-9712e16d1ef9 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:35.463911 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-59b0eebe-08e8-43e9-85ab-9712e16d1ef9 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:35.465349 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-59b0eebe-08e8-43e9-85ab-9712e16d1ef9 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:35.471536 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-59b0eebe-08e8-43e9-85ab-9712e16d1ef9 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:35.472335 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-59b0eebe-08e8-43e9-85ab-9712e16d1ef9 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:35.733339 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-2318a397-9460-4fd7-beb6-81143e2051b7 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6160c7a42740efbe3613380933fa15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d90f8a58ad047fa8f347d6474e4d673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:35.742928 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-2318a397-9460-4fd7-beb6-81143e2051b7 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "GET /compute/v2.1/servers/1cd977e1-410c-4c5f-a8fa-a9f9033bc512" status: 200 len: 1502 microversion: 2.1 time: 0.529629 Aug 10 23:15:35.759446 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2070/3986] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:35 2022] GET /compute/v2.1/servers/1cd977e1-410c-4c5f-a8fa-a9f9033bc512 => generated 1502 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:35.759446 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-36bc816c-aed6-4cd7-99c7-31996df9d8d2 req-06b5913a-efbd-4727-8204-7f9b94e525d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23bbe055-4a92-4b96-8b89-c941229bfb0b", "name": "network-vif-plugged", "status": "completed", "tag": "6f537f41-6630-4a1c-b82e-c0862b0fc22c"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:15:35.784697 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-36bc816c-aed6-4cd7-99c7-31996df9d8d2 req-06b5913a-efbd-4727-8204-7f9b94e525d8 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:35.799086 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-36bc816c-aed6-4cd7-99c7-31996df9d8d2 req-06b5913a-efbd-4727-8204-7f9b94e525d8 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:35.801679 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-36bc816c-aed6-4cd7-99c7-31996df9d8d2 req-06b5913a-efbd-4727-8204-7f9b94e525d8 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:35.804448 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-59b0eebe-08e8-43e9-85ab-9712e16d1ef9 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:35.821427 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-59b0eebe-08e8-43e9-85ab-9712e16d1ef9 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954" status: 200 len: 1667 microversion: 2.1 time: 0.383284 Aug 10 23:15:35.823718 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-36bc816c-aed6-4cd7-99c7-31996df9d8d2 req-06b5913a-efbd-4727-8204-7f9b94e525d8 service nova] Creating event network-vif-plugged:6f537f41-6630-4a1c-b82e-c0862b0fc22c for instance 23bbe055-4a92-4b96-8b89-c941229bfb0b on n-h2-850468-14 Aug 10 23:15:35.825909 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1917/3987] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:35 2022] GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954 => generated 1667 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:35.829311 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-36bc816c-aed6-4cd7-99c7-31996df9d8d2 req-06b5913a-efbd-4727-8204-7f9b94e525d8 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079926 Aug 10 23:15:35.830213 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2071/3988] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:15:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:15:35.836828 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-a31cd70a-c065-417d-a835-f43075ac565f tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:35.837807 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-a31cd70a-c065-417d-a835-f43075ac565f tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:35.839947 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-3bbf55ba-23a6-4419-bcbc-b6c67cbf3fb3 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:35.844999 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a31cd70a-c065-417d-a835-f43075ac565f tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:35.845829 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a31cd70a-c065-417d-a835-f43075ac565f tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:35.846497 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a31cd70a-c065-417d-a835-f43075ac565f tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:35.847622 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a31cd70a-c065-417d-a835-f43075ac565f tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:35.848433 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a31cd70a-c065-417d-a835-f43075ac565f tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:35.849357 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a31cd70a-c065-417d-a835-f43075ac565f tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:35.858569 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-3bbf55ba-23a6-4419-bcbc-b6c67cbf3fb3 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '06cc4167255044d29a70c12a5a44d800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578d8e62013d43c5ad4d9a6d92e1f201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:35.859830 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-3bbf55ba-23a6-4419-bcbc-b6c67cbf3fb3 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1523915528', 'deleted': False, 'project_id': '578d8e62013d43c5ad4d9a6d92e1f201'} {{(pid=122632) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 10 23:15:35.872085 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3bbf55ba-23a6-4419-bcbc-b6c67cbf3fb3 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:35.874679 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3bbf55ba-23a6-4419-bcbc-b6c67cbf3fb3 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:35.876806 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3bbf55ba-23a6-4419-bcbc-b6c67cbf3fb3 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:35.879435 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3bbf55ba-23a6-4419-bcbc-b6c67cbf3fb3 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:35.882939 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3bbf55ba-23a6-4419-bcbc-b6c67cbf3fb3 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:35.886366 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3bbf55ba-23a6-4419-bcbc-b6c67cbf3fb3 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:36.095170 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.multi_cell_list [None req-3bbf55ba-23a6-4419-bcbc-b6c67cbf3fb3 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122632) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 10 23:15:36.232685 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-3bbf55ba-23a6-4419-bcbc-b6c67cbf3fb3 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cc4167255044d29a70c12a5a44d800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578d8e62013d43c5ad4d9a6d92e1f201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:36.242568 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3bbf55ba-23a6-4419-bcbc-b6c67cbf3fb3 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:36.243201 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3bbf55ba-23a6-4419-bcbc-b6c67cbf3fb3 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:36.244069 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3bbf55ba-23a6-4419-bcbc-b6c67cbf3fb3 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:36.458158 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-a31cd70a-c065-417d-a835-f43075ac565f tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:36.468920 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-a31cd70a-c065-417d-a835-f43075ac565f tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b" status: 200 len: 1528 microversion: 2.1 time: 0.637276 Aug 10 23:15:36.487456 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2072/3989] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:35 2022] GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b => generated 1528 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:36.508381 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-6813102f-743a-46c4-a534-3d497e5a8b96 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:15:36.508381 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-6813102f-743a-46c4-a534-3d497e5a8b96 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: 1cd977e1-410c-4c5f-a8fa-a9f9033bc512] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:36.522655 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6813102f-743a-46c4-a534-3d497e5a8b96 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:36.523204 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6813102f-743a-46c4-a534-3d497e5a8b96 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:36.523752 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6813102f-743a-46c4-a534-3d497e5a8b96 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:36.524863 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6813102f-743a-46c4-a534-3d497e5a8b96 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:36.527906 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6813102f-743a-46c4-a534-3d497e5a8b96 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:36.528585 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6813102f-743a-46c4-a534-3d497e5a8b96 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:36.596935 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.objects.instance [None req-6813102f-743a-46c4-a534-3d497e5a8b96 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lazy-loading 'flavor' on Instance uuid 1cd977e1-410c-4c5f-a8fa-a9f9033bc512 {{(pid=122633) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:15:36.754575 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-6813102f-743a-46c4-a534-3d497e5a8b96 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "POST /compute/v2.1/servers/1cd977e1-410c-4c5f-a8fa-a9f9033bc512/action" status: 202 len: 0 microversion: 2.1 time: 0.263832 Aug 10 23:15:36.756401 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2073/3990] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:15:36 2022] POST /compute/v2.1/servers/1cd977e1-410c-4c5f-a8fa-a9f9033bc512/action => generated 0 bytes in 268 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:15:36.764954 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-43ad2a73-f378-41b9-afb2-5111cc402875 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:36.766559 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-43ad2a73-f378-41b9-afb2-5111cc402875 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: fa9dfd3a-a636-48ce-ae15-0ed51baee954] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:36.777189 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-43ad2a73-f378-41b9-afb2-5111cc402875 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:36.778133 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-43ad2a73-f378-41b9-afb2-5111cc402875 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:36.778940 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-43ad2a73-f378-41b9-afb2-5111cc402875 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:36.779950 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-43ad2a73-f378-41b9-afb2-5111cc402875 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:36.780729 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-43ad2a73-f378-41b9-afb2-5111cc402875 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:36.781364 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-43ad2a73-f378-41b9-afb2-5111cc402875 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:36.789355 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-3bbf55ba-23a6-4419-bcbc-b6c67cbf3fb3 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] 10.222.0.58 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1523915528" status: 200 len: 1516 microversion: 2.1 time: 0.962104 Aug 10 23:15:36.811993 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1918/3991] 10.222.0.58 () {58 vars in 1263 bytes} [Wed Aug 10 23:15:35 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1523915528 => generated 1516 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:36.818132 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-31f53afb-baf2-49f9-a5ea-36b53e527161 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-212048097", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452", "networks": [{"uuid": "d108a2cd-4a54-4239-b9d1-213170efd874"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1298304459", "security_groups": [{"name": "tempest-secgroup-smoke-1609118493"}]}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:15:37.406314 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.network.neutron [None req-31f53afb-baf2-49f9-a5ea-36b53e527161 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] validate_networks() for [('d108a2cd-4a54-4239-b9d1-213170efd874', None, None, None, None, None)] {{(pid=122632) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 23:15:37.777393 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-43ad2a73-f378-41b9-afb2-5111cc402875 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:37.786192 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-43ad2a73-f378-41b9-afb2-5111cc402875 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954" status: 200 len: 1667 microversion: 2.1 time: 1.027781 Aug 10 23:15:37.790482 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2074/3992] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:36 2022] GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954 => generated 1667 bytes in 1033 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:37.802055 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-115a3fae-d576-436f-b6a5-c4f8a723764c tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:37.803289 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-115a3fae-d576-436f-b6a5-c4f8a723764c tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] [instance: 27dd09d6-47ed-4b55-bd02-baad36a28429] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:37.812517 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-115a3fae-d576-436f-b6a5-c4f8a723764c tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:37.813517 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-115a3fae-d576-436f-b6a5-c4f8a723764c tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:37.814200 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-115a3fae-d576-436f-b6a5-c4f8a723764c tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:37.815895 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-115a3fae-d576-436f-b6a5-c4f8a723764c tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:37.819243 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-115a3fae-d576-436f-b6a5-c4f8a723764c tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:37.819962 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-115a3fae-d576-436f-b6a5-c4f8a723764c tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:38.227176 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-115a3fae-d576-436f-b6a5-c4f8a723764c tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07c94ebf0954cdea12b9a689538d96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395d7c4077e54c43bb95288db3942b0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:38.237336 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-115a3fae-d576-436f-b6a5-c4f8a723764c tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] 10.222.0.58 "GET /compute/v2.1/servers/27dd09d6-47ed-4b55-bd02-baad36a28429" status: 200 len: 1521 microversion: 2.1 time: 0.444252 Aug 10 23:15:38.238030 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2075/3993] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:37 2022] GET /compute/v2.1/servers/27dd09d6-47ed-4b55-bd02-baad36a28429 => generated 1521 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:38.624944 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-a5c97116-5cac-4871-a358-54645cf2cb53 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:38.625787 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-a5c97116-5cac-4871-a358-54645cf2cb53 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: 1cd977e1-410c-4c5f-a8fa-a9f9033bc512] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:38.639079 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a5c97116-5cac-4871-a358-54645cf2cb53 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:38.642164 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a5c97116-5cac-4871-a358-54645cf2cb53 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:38.648903 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a5c97116-5cac-4871-a358-54645cf2cb53 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:38.649939 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a5c97116-5cac-4871-a358-54645cf2cb53 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:38.650586 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a5c97116-5cac-4871-a358-54645cf2cb53 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:38.651212 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a5c97116-5cac-4871-a358-54645cf2cb53 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:38.967053 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-a5c97116-5cac-4871-a358-54645cf2cb53 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6160c7a42740efbe3613380933fa15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d90f8a58ad047fa8f347d6474e4d673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:38.983245 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-a5c97116-5cac-4871-a358-54645cf2cb53 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "GET /compute/v2.1/servers/1cd977e1-410c-4c5f-a8fa-a9f9033bc512" status: 200 len: 1493 microversion: 2.1 time: 0.744075 Aug 10 23:15:38.986809 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2076/3994] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:38 2022] GET /compute/v2.1/servers/1cd977e1-410c-4c5f-a8fa-a9f9033bc512 => generated 1493 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:38.992838 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-ceba845b-a7b8-47e6-a6bb-4b6cb388ea9f tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:38.998180 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-ceba845b-a7b8-47e6-a6bb-4b6cb388ea9f tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '06cc4167255044d29a70c12a5a44d800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578d8e62013d43c5ad4d9a6d92e1f201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:38.999731 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-ceba845b-a7b8-47e6-a6bb-4b6cb388ea9f tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '578d8e62013d43c5ad4d9a6d92e1f201'} {{(pid=122633) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 10 23:15:39.022742 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ceba845b-a7b8-47e6-a6bb-4b6cb388ea9f tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:39.022929 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ceba845b-a7b8-47e6-a6bb-4b6cb388ea9f tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:39.023308 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ceba845b-a7b8-47e6-a6bb-4b6cb388ea9f tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:39.024141 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ceba845b-a7b8-47e6-a6bb-4b6cb388ea9f tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:39.027185 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ceba845b-a7b8-47e6-a6bb-4b6cb388ea9f tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:39.030386 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ceba845b-a7b8-47e6-a6bb-4b6cb388ea9f tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:39.342451 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.multi_cell_list [None req-ceba845b-a7b8-47e6-a6bb-4b6cb388ea9f tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122633) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 10 23:15:39.417672 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-31f53afb-baf2-49f9-a5ea-36b53e527161 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Flavor limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:15:39.418521 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-31f53afb-baf2-49f9-a5ea-36b53e527161 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Image limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:15:39.418628 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-31f53afb-baf2-49f9-a5ea-36b53e527161 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Flavor pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:15:39.418985 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-31f53afb-baf2-49f9-a5ea-36b53e527161 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Image pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:15:39.419730 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-31f53afb-baf2-49f9-a5ea-36b53e527161 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:15:39.436502 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-ceba845b-a7b8-47e6-a6bb-4b6cb388ea9f tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cc4167255044d29a70c12a5a44d800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578d8e62013d43c5ad4d9a6d92e1f201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:39.436837 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-31f53afb-baf2-49f9-a5ea-36b53e527161 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:39.438134 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-31f53afb-baf2-49f9-a5ea-36b53e527161 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:39.438593 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-31f53afb-baf2-49f9-a5ea-36b53e527161 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:39.439482 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-31f53afb-baf2-49f9-a5ea-36b53e527161 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:39.441624 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-31f53afb-baf2-49f9-a5ea-36b53e527161 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:39.442072 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-31f53afb-baf2-49f9-a5ea-36b53e527161 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:39.446551 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ceba845b-a7b8-47e6-a6bb-4b6cb388ea9f tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:39.447304 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ceba845b-a7b8-47e6-a6bb-4b6cb388ea9f tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:39.447907 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ceba845b-a7b8-47e6-a6bb-4b6cb388ea9f tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:39.484274 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-31f53afb-baf2-49f9-a5ea-36b53e527161 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Getting quotas for project 25abd63376614081a9d484f3c9ae950d. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:15:39.495230 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-31f53afb-baf2-49f9-a5ea-36b53e527161 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Getting quotas for user 5899b2ad9f1046caaf7c6073e408eeee and project 25abd63376614081a9d484f3c9ae950d. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:15:39.511533 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-31f53afb-baf2-49f9-a5ea-36b53e527161 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Going to run 1 instances... {{(pid=122632) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 23:15:39.514041 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-31f53afb-baf2-49f9-a5ea-36b53e527161 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] [instance: 250395b5-5be8-420a-8709-dcf8b4241a4e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78ad8905-f66f-4733-8be9-2b260f1fabed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122632) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 23:15:39.575605 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-31f53afb-baf2-49f9-a5ea-36b53e527161 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.762349 Aug 10 23:15:39.576984 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1919/3995] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 23:15:36 2022] POST /compute/v2.1/servers => generated 406 bytes in 2764 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 23:15:39.594958 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-b3034d4b-7911-44af-98e6-bdc504c3ca5a tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:39.600502 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-b3034d4b-7911-44af-98e6-bdc504c3ca5a tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:39.624575 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b3034d4b-7911-44af-98e6-bdc504c3ca5a tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:39.628224 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b3034d4b-7911-44af-98e6-bdc504c3ca5a tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:39.630684 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b3034d4b-7911-44af-98e6-bdc504c3ca5a tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:39.631959 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b3034d4b-7911-44af-98e6-bdc504c3ca5a tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:39.632555 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b3034d4b-7911-44af-98e6-bdc504c3ca5a tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:39.636688 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b3034d4b-7911-44af-98e6-bdc504c3ca5a tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:39.993896 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-b3034d4b-7911-44af-98e6-bdc504c3ca5a tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:40.003969 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-b3034d4b-7911-44af-98e6-bdc504c3ca5a tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b" status: 200 len: 1528 microversion: 2.1 time: 0.425593 Aug 10 23:15:40.005433 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1920/3996] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:39 2022] GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b => generated 1528 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:40.172137 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-ceba845b-a7b8-47e6-a6bb-4b6cb388ea9f tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] 10.222.0.58 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4520 microversion: 2.1 time: 1.183678 Aug 10 23:15:40.172990 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2077/3997] 10.222.0.58 () {58 vars in 1173 bytes} [Wed Aug 10 23:15:38 2022] GET /compute/v2.1/servers/detail?status=active => generated 4520 bytes in 1185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:40.181075 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-4d2df6aa-5ca6-4056-b3f7-ee0ebf2dab0b tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:40.182354 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-4d2df6aa-5ca6-4056-b3f7-ee0ebf2dab0b tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: 1cd977e1-410c-4c5f-a8fa-a9f9033bc512] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:40.216106 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4d2df6aa-5ca6-4056-b3f7-ee0ebf2dab0b tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:40.218631 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4d2df6aa-5ca6-4056-b3f7-ee0ebf2dab0b tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:40.221816 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4d2df6aa-5ca6-4056-b3f7-ee0ebf2dab0b tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:40.223942 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4d2df6aa-5ca6-4056-b3f7-ee0ebf2dab0b tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:40.228119 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4d2df6aa-5ca6-4056-b3f7-ee0ebf2dab0b tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:40.228773 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4d2df6aa-5ca6-4056-b3f7-ee0ebf2dab0b tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:40.357552 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-4d2df6aa-5ca6-4056-b3f7-ee0ebf2dab0b tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: 1cd977e1-410c-4c5f-a8fa-a9f9033bc512] Going to try to terminate instance {{(pid=122633) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:15:40.635651 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-4d2df6aa-5ca6-4056-b3f7-ee0ebf2dab0b tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "DELETE /compute/v2.1/servers/1cd977e1-410c-4c5f-a8fa-a9f9033bc512" status: 204 len: 0 microversion: 2.1 time: 0.461012 Aug 10 23:15:40.637047 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2078/3998] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:15:40 2022] DELETE /compute/v2.1/servers/1cd977e1-410c-4c5f-a8fa-a9f9033bc512 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:15:40.646611 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-31899013-c548-49e7-b0e8-dfd7e06db6a4 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:40.647741 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-31899013-c548-49e7-b0e8-dfd7e06db6a4 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] [instance: 27dd09d6-47ed-4b55-bd02-baad36a28429] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:40.662820 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-31899013-c548-49e7-b0e8-dfd7e06db6a4 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:40.669844 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-31899013-c548-49e7-b0e8-dfd7e06db6a4 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:40.670556 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-31899013-c548-49e7-b0e8-dfd7e06db6a4 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:40.671701 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-31899013-c548-49e7-b0e8-dfd7e06db6a4 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:40.672537 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-31899013-c548-49e7-b0e8-dfd7e06db6a4 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:40.674201 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-31899013-c548-49e7-b0e8-dfd7e06db6a4 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:40.732173 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-3e3c88bc-42eb-48b6-a2d5-3bcb8aa3dc2f tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:40.732883 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-3e3c88bc-42eb-48b6-a2d5-3bcb8aa3dc2f tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: fa9dfd3a-a636-48ce-ae15-0ed51baee954] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:40.752477 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3e3c88bc-42eb-48b6-a2d5-3bcb8aa3dc2f tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:40.752477 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3e3c88bc-42eb-48b6-a2d5-3bcb8aa3dc2f tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:40.755362 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3e3c88bc-42eb-48b6-a2d5-3bcb8aa3dc2f tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:40.756255 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3e3c88bc-42eb-48b6-a2d5-3bcb8aa3dc2f tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:40.756733 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3e3c88bc-42eb-48b6-a2d5-3bcb8aa3dc2f tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:40.757171 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3e3c88bc-42eb-48b6-a2d5-3bcb8aa3dc2f tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:41.201534 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-3e3c88bc-42eb-48b6-a2d5-3bcb8aa3dc2f tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:41.217588 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-3e3c88bc-42eb-48b6-a2d5-3bcb8aa3dc2f tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954" status: 200 len: 1667 microversion: 2.1 time: 1.210837 Aug 10 23:15:41.219240 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1921/3999] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:40 2022] GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954 => generated 1667 bytes in 1213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:41.236347 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-62ae4aec-1d89-4463-a76b-f8ce4915fbaa tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:41.239382 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-62ae4aec-1d89-4463-a76b-f8ce4915fbaa tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] [instance: 250395b5-5be8-420a-8709-dcf8b4241a4e] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:41.260387 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-31899013-c548-49e7-b0e8-dfd7e06db6a4 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07c94ebf0954cdea12b9a689538d96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395d7c4077e54c43bb95288db3942b0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:41.276815 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-62ae4aec-1d89-4463-a76b-f8ce4915fbaa tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:41.280179 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-62ae4aec-1d89-4463-a76b-f8ce4915fbaa tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:41.280914 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-31899013-c548-49e7-b0e8-dfd7e06db6a4 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] 10.222.0.58 "GET /compute/v2.1/servers/27dd09d6-47ed-4b55-bd02-baad36a28429" status: 200 len: 1521 microversion: 2.1 time: 0.641207 Aug 10 23:15:41.282971 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-62ae4aec-1d89-4463-a76b-f8ce4915fbaa tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:41.283976 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2079/4000] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:40 2022] GET /compute/v2.1/servers/27dd09d6-47ed-4b55-bd02-baad36a28429 => generated 1521 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:41.291984 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-62ae4aec-1d89-4463-a76b-f8ce4915fbaa tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:41.292814 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-62ae4aec-1d89-4463-a76b-f8ce4915fbaa tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:41.293503 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-62ae4aec-1d89-4463-a76b-f8ce4915fbaa tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:41.308866 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-09b3a3f3-edfc-4d7e-bb20-79943493e733 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:41.343111 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-09b3a3f3-edfc-4d7e-bb20-79943493e733 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '06cc4167255044d29a70c12a5a44d800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578d8e62013d43c5ad4d9a6d92e1f201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:41.343111 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.compute.servers [None req-09b3a3f3-edfc-4d7e-bb20-79943493e733 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Removing options 'limit' from query {{(pid=122633) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 10 23:15:41.343111 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-09b3a3f3-edfc-4d7e-bb20-79943493e733 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Searching by: {'deleted': False, 'project_id': '578d8e62013d43c5ad4d9a6d92e1f201'} {{(pid=122633) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 10 23:15:41.357330 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-09b3a3f3-edfc-4d7e-bb20-79943493e733 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:41.358323 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-09b3a3f3-edfc-4d7e-bb20-79943493e733 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:41.358323 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-09b3a3f3-edfc-4d7e-bb20-79943493e733 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:41.359031 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-09b3a3f3-edfc-4d7e-bb20-79943493e733 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:41.359497 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-09b3a3f3-edfc-4d7e-bb20-79943493e733 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:41.370465 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-09b3a3f3-edfc-4d7e-bb20-79943493e733 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:41.414570 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:INSERT=3,nova_cell1:SELECT=91,nova_cell1:UPDATE=6 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:15:41.468120 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-09b3a3f3-edfc-4d7e-bb20-79943493e733 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cc4167255044d29a70c12a5a44d800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578d8e62013d43c5ad4d9a6d92e1f201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:41.486095 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:15:41.490547 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-09b3a3f3-edfc-4d7e-bb20-79943493e733 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:41.492513 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-09b3a3f3-edfc-4d7e-bb20-79943493e733 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:41.493926 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-09b3a3f3-edfc-4d7e-bb20-79943493e733 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:41.747823 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-09b3a3f3-edfc-4d7e-bb20-79943493e733 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] 10.222.0.58 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1661 microversion: 2.1 time: 0.457124 Aug 10 23:15:41.748421 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2080/4001] 10.222.0.58 () {58 vars in 1161 bytes} [Wed Aug 10 23:15:41 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1661 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:41.766577 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-50bd2294-c8ae-405f-9659-ceb9784871cd tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:41.775463 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-50bd2294-c8ae-405f-9659-ceb9784871cd tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: 1cd977e1-410c-4c5f-a8fa-a9f9033bc512] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:41.783549 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-50bd2294-c8ae-405f-9659-ceb9784871cd tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:41.784191 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-50bd2294-c8ae-405f-9659-ceb9784871cd tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:41.785052 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-50bd2294-c8ae-405f-9659-ceb9784871cd tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:41.786817 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-50bd2294-c8ae-405f-9659-ceb9784871cd tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:41.786817 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-50bd2294-c8ae-405f-9659-ceb9784871cd tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:41.787090 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-50bd2294-c8ae-405f-9659-ceb9784871cd tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:42.144822 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-50bd2294-c8ae-405f-9659-ceb9784871cd tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6160c7a42740efbe3613380933fa15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d90f8a58ad047fa8f347d6474e4d673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:42.152851 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-50bd2294-c8ae-405f-9659-ceb9784871cd tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "GET /compute/v2.1/servers/1cd977e1-410c-4c5f-a8fa-a9f9033bc512" status: 200 len: 1499 microversion: 2.1 time: 0.390139 Aug 10 23:15:42.153451 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2081/4002] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:41 2022] GET /compute/v2.1/servers/1cd977e1-410c-4c5f-a8fa-a9f9033bc512 => generated 1499 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:42.165157 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-2bc8c107-466b-4f32-9bca-6b6cfc06a961 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:42.167283 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-2bc8c107-466b-4f32-9bca-6b6cfc06a961 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:42.181132 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2bc8c107-466b-4f32-9bca-6b6cfc06a961 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:42.182512 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2bc8c107-466b-4f32-9bca-6b6cfc06a961 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:42.185375 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2bc8c107-466b-4f32-9bca-6b6cfc06a961 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:42.187335 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2bc8c107-466b-4f32-9bca-6b6cfc06a961 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:42.190212 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2bc8c107-466b-4f32-9bca-6b6cfc06a961 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:42.195022 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2bc8c107-466b-4f32-9bca-6b6cfc06a961 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:42.340782 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-62ae4aec-1d89-4463-a76b-f8ce4915fbaa tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5899b2ad9f1046caaf7c6073e408eeee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25abd63376614081a9d484f3c9ae950d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:42.351389 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-62ae4aec-1d89-4463-a76b-f8ce4915fbaa tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "GET /compute/v2.1/servers/250395b5-5be8-420a-8709-dcf8b4241a4e" status: 200 len: 1262 microversion: 2.1 time: 1.131042 Aug 10 23:15:42.351988 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1922/4003] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:41 2022] GET /compute/v2.1/servers/250395b5-5be8-420a-8709-dcf8b4241a4e => generated 1262 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:42.384193 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-3933ea69-cbc3-453b-97e6-dcacd6a50c76 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:15:42.403714 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-3933ea69-cbc3-453b-97e6-dcacd6a50c76 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: fa9dfd3a-a636-48ce-ae15-0ed51baee954] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:42.421390 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3933ea69-cbc3-453b-97e6-dcacd6a50c76 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:42.421768 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3933ea69-cbc3-453b-97e6-dcacd6a50c76 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:42.422215 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3933ea69-cbc3-453b-97e6-dcacd6a50c76 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:42.424939 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3933ea69-cbc3-453b-97e6-dcacd6a50c76 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:42.425493 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3933ea69-cbc3-453b-97e6-dcacd6a50c76 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:42.425909 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3933ea69-cbc3-453b-97e6-dcacd6a50c76 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:42.460815 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-2bc8c107-466b-4f32-9bca-6b6cfc06a961 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:42.473772 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-2bc8c107-466b-4f32-9bca-6b6cfc06a961 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b" status: 200 len: 1528 microversion: 2.1 time: 0.315585 Aug 10 23:15:42.477434 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2082/4004] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:42 2022] GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b => generated 1528 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:42.485796 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-d383601a-1c23-446d-9d8f-660636b5c551 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:42.501197 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-d383601a-1c23-446d-9d8f-660636b5c551 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '06cc4167255044d29a70c12a5a44d800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578d8e62013d43c5ad4d9a6d92e1f201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:42.507621 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-d383601a-1c23-446d-9d8f-660636b5c551 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '578d8e62013d43c5ad4d9a6d92e1f201'} {{(pid=122633) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 10 23:15:42.513456 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d383601a-1c23-446d-9d8f-660636b5c551 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:42.517533 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d383601a-1c23-446d-9d8f-660636b5c551 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:42.521950 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d383601a-1c23-446d-9d8f-660636b5c551 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:42.525896 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d383601a-1c23-446d-9d8f-660636b5c551 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:42.527013 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d383601a-1c23-446d-9d8f-660636b5c551 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:42.546850 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d383601a-1c23-446d-9d8f-660636b5c551 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:42.580743 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-3933ea69-cbc3-453b-97e6-dcacd6a50c76 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "POST /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954/action" status: 202 len: 0 microversion: 2.1 time: 0.226530 Aug 10 23:15:42.584116 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1923/4005] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:15:42 2022] POST /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954/action => generated 0 bytes in 231 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:15:42.598531 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-9786fb1c-f02a-4a63-81d5-62dd745c85e3 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:42.599792 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-9786fb1c-f02a-4a63-81d5-62dd745c85e3 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] [instance: 27dd09d6-47ed-4b55-bd02-baad36a28429] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:42.609370 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9786fb1c-f02a-4a63-81d5-62dd745c85e3 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:42.611067 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9786fb1c-f02a-4a63-81d5-62dd745c85e3 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:42.612120 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9786fb1c-f02a-4a63-81d5-62dd745c85e3 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:42.613153 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9786fb1c-f02a-4a63-81d5-62dd745c85e3 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:42.614015 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9786fb1c-f02a-4a63-81d5-62dd745c85e3 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:42.614719 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9786fb1c-f02a-4a63-81d5-62dd745c85e3 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:42.706569 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.multi_cell_list [None req-d383601a-1c23-446d-9d8f-660636b5c551 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122633) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 10 23:15:42.830985 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-d383601a-1c23-446d-9d8f-660636b5c551 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] 10.222.0.58 "GET /compute/v2.1/servers?status=active" status: 200 len: 1012 microversion: 2.1 time: 0.351199 Aug 10 23:15:42.832134 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2083/4006] 10.222.0.58 () {58 vars in 1152 bytes} [Wed Aug 10 23:15:42 2022] GET /compute/v2.1/servers?status=active => generated 1012 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:42.851293 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c6a6a3e4-5db6-40f3-bab7-34bd123b77a5 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:42.852132 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-c6a6a3e4-5db6-40f3-bab7-34bd123b77a5 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: fa9dfd3a-a636-48ce-ae15-0ed51baee954] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:42.860598 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c6a6a3e4-5db6-40f3-bab7-34bd123b77a5 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:42.861239 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c6a6a3e4-5db6-40f3-bab7-34bd123b77a5 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:42.861770 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c6a6a3e4-5db6-40f3-bab7-34bd123b77a5 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:42.862588 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c6a6a3e4-5db6-40f3-bab7-34bd123b77a5 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:42.864001 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c6a6a3e4-5db6-40f3-bab7-34bd123b77a5 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:42.864652 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c6a6a3e4-5db6-40f3-bab7-34bd123b77a5 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:43.197171 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-c6a6a3e4-5db6-40f3-bab7-34bd123b77a5 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:43.206425 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-c6a6a3e4-5db6-40f3-bab7-34bd123b77a5 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954" status: 200 len: 1672 microversion: 2.1 time: 0.373044 Aug 10 23:15:43.224666 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2084/4007] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:42 2022] GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954 => generated 1672 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:43.239128 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-75332c47-9b51-46e3-b647-4850994c9f01 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:43.246266 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-75332c47-9b51-46e3-b647-4850994c9f01 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '06cc4167255044d29a70c12a5a44d800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578d8e62013d43c5ad4d9a6d92e1f201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:43.247064 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.compute.servers [None req-75332c47-9b51-46e3-b647-4850994c9f01 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Removing options 'limit' from query {{(pid=122633) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 10 23:15:43.247953 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-75332c47-9b51-46e3-b647-4850994c9f01 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Searching by: {'deleted': False, 'project_id': '578d8e62013d43c5ad4d9a6d92e1f201'} {{(pid=122633) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 10 23:15:43.253737 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-75332c47-9b51-46e3-b647-4850994c9f01 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:43.254829 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-75332c47-9b51-46e3-b647-4850994c9f01 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:43.255512 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-75332c47-9b51-46e3-b647-4850994c9f01 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:43.256504 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-75332c47-9b51-46e3-b647-4850994c9f01 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:43.257193 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-75332c47-9b51-46e3-b647-4850994c9f01 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:43.257849 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-75332c47-9b51-46e3-b647-4850994c9f01 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:43.328279 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.multi_cell_list [None req-75332c47-9b51-46e3-b647-4850994c9f01 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122633) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 10 23:15:43.401342 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-75332c47-9b51-46e3-b647-4850994c9f01 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] 10.222.0.58 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1012 microversion: 2.1 time: 0.175220 Aug 10 23:15:43.402375 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2085/4008] 10.222.0.58 () {58 vars in 1150 bytes} [Wed Aug 10 23:15:43 2022] GET /compute/v2.1/servers?limit=100000 => generated 1012 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:43.408139 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-9882800f-d8de-44ae-9f90-3ad7cd62753c tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:43.419760 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-9882800f-d8de-44ae-9f90-3ad7cd62753c tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: 1cd977e1-410c-4c5f-a8fa-a9f9033bc512] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:43.437986 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9882800f-d8de-44ae-9f90-3ad7cd62753c tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:43.438602 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9882800f-d8de-44ae-9f90-3ad7cd62753c tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:43.439196 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9882800f-d8de-44ae-9f90-3ad7cd62753c tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:43.440185 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9882800f-d8de-44ae-9f90-3ad7cd62753c tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:43.442624 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9882800f-d8de-44ae-9f90-3ad7cd62753c tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:43.443342 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9882800f-d8de-44ae-9f90-3ad7cd62753c tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:43.704803 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-9786fb1c-f02a-4a63-81d5-62dd745c85e3 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07c94ebf0954cdea12b9a689538d96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395d7c4077e54c43bb95288db3942b0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:43.714497 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-9786fb1c-f02a-4a63-81d5-62dd745c85e3 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] 10.222.0.58 "GET /compute/v2.1/servers/27dd09d6-47ed-4b55-bd02-baad36a28429" status: 200 len: 1521 microversion: 2.1 time: 1.122128 Aug 10 23:15:43.720021 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1924/4009] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:42 2022] GET /compute/v2.1/servers/27dd09d6-47ed-4b55-bd02-baad36a28429 => generated 1521 bytes in 1135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:43.725320 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-8d2c10e9-8fc8-45b4-b677-1818b21bb31a tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:43.731237 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-8d2c10e9-8fc8-45b4-b677-1818b21bb31a tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] [instance: 250395b5-5be8-420a-8709-dcf8b4241a4e] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:43.749174 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8d2c10e9-8fc8-45b4-b677-1818b21bb31a tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:43.754977 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8d2c10e9-8fc8-45b4-b677-1818b21bb31a tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:43.755682 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8d2c10e9-8fc8-45b4-b677-1818b21bb31a tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:43.756632 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8d2c10e9-8fc8-45b4-b677-1818b21bb31a tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:43.757258 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8d2c10e9-8fc8-45b4-b677-1818b21bb31a tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:43.757852 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8d2c10e9-8fc8-45b4-b677-1818b21bb31a tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:43.868937 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-9882800f-d8de-44ae-9f90-3ad7cd62753c tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3c6160c7a42740efbe3613380933fa15', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d90f8a58ad047fa8f347d6474e4d673', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:43.877455 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-9882800f-d8de-44ae-9f90-3ad7cd62753c tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "GET /compute/v2.1/servers/1cd977e1-410c-4c5f-a8fa-a9f9033bc512" status: 200 len: 1457 microversion: 2.1 time: 0.472975 Aug 10 23:15:43.881365 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2086/4010] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:43 2022] GET /compute/v2.1/servers/1cd977e1-410c-4c5f-a8fa-a9f9033bc512 => generated 1457 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:43.911285 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-e75e9681-d91b-4d67-8fd7-f39fac119ab4 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:43.922940 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-e75e9681-d91b-4d67-8fd7-f39fac119ab4 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '06cc4167255044d29a70c12a5a44d800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578d8e62013d43c5ad4d9a6d92e1f201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:43.924775 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-e75e9681-d91b-4d67-8fd7-f39fac119ab4 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Searching by: {'deleted': False, 'project_id': '578d8e62013d43c5ad4d9a6d92e1f201'} {{(pid=122633) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 10 23:15:43.940625 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e75e9681-d91b-4d67-8fd7-f39fac119ab4 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:43.941486 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e75e9681-d91b-4d67-8fd7-f39fac119ab4 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:43.942182 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e75e9681-d91b-4d67-8fd7-f39fac119ab4 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:43.943436 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e75e9681-d91b-4d67-8fd7-f39fac119ab4 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:43.944107 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e75e9681-d91b-4d67-8fd7-f39fac119ab4 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:43.944764 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e75e9681-d91b-4d67-8fd7-f39fac119ab4 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:43.987651 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.multi_cell_list [None req-e75e9681-d91b-4d67-8fd7-f39fac119ab4 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122633) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 10 23:15:44.022763 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-e75e9681-d91b-4d67-8fd7-f39fac119ab4 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] 10.222.0.58 "GET /compute/v2.1/servers" status: 200 len: 1012 microversion: 2.1 time: 0.122293 Aug 10 23:15:44.032156 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2087/4011] 10.222.0.58 () {58 vars in 1125 bytes} [Wed Aug 10 23:15:43 2022] GET /compute/v2.1/servers => generated 1012 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:44.039881 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-79e1bce3-ad4e-4757-ae43-f4044a583f8a tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:44.042275 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-79e1bce3-ad4e-4757-ae43-f4044a583f8a tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:44.049674 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-79e1bce3-ad4e-4757-ae43-f4044a583f8a tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:44.051237 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-79e1bce3-ad4e-4757-ae43-f4044a583f8a tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:44.052043 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-79e1bce3-ad4e-4757-ae43-f4044a583f8a tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:44.053168 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-79e1bce3-ad4e-4757-ae43-f4044a583f8a tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:44.053799 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-79e1bce3-ad4e-4757-ae43-f4044a583f8a tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:44.054431 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-79e1bce3-ad4e-4757-ae43-f4044a583f8a tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:44.132467 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-8d2c10e9-8fc8-45b4-b677-1818b21bb31a tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5899b2ad9f1046caaf7c6073e408eeee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25abd63376614081a9d484f3c9ae950d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:44.141584 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-8d2c10e9-8fc8-45b4-b677-1818b21bb31a tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "GET /compute/v2.1/servers/250395b5-5be8-420a-8709-dcf8b4241a4e" status: 200 len: 1324 microversion: 2.1 time: 0.420116 Aug 10 23:15:44.148152 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1925/4012] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:43 2022] GET /compute/v2.1/servers/250395b5-5be8-420a-8709-dcf8b4241a4e => generated 1324 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:44.168588 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-5983081c-3f69-4cdf-8c8a-be9c8b2019ca tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:44.184784 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-5983081c-3f69-4cdf-8c8a-be9c8b2019ca tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '06cc4167255044d29a70c12a5a44d800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578d8e62013d43c5ad4d9a6d92e1f201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:44.186301 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-5983081c-3f69-4cdf-8c8a-be9c8b2019ca tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '578d8e62013d43c5ad4d9a6d92e1f201'} {{(pid=122632) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 10 23:15:44.235884 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5983081c-3f69-4cdf-8c8a-be9c8b2019ca tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:44.239385 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5983081c-3f69-4cdf-8c8a-be9c8b2019ca tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:44.241787 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5983081c-3f69-4cdf-8c8a-be9c8b2019ca tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:44.244401 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5983081c-3f69-4cdf-8c8a-be9c8b2019ca tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:44.246553 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5983081c-3f69-4cdf-8c8a-be9c8b2019ca tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:44.248180 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5983081c-3f69-4cdf-8c8a-be9c8b2019ca tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:44.528831 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.multi_cell_list [None req-5983081c-3f69-4cdf-8c8a-be9c8b2019ca tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122632) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 10 23:15:44.645910 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-5983081c-3f69-4cdf-8c8a-be9c8b2019ca tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] 10.222.0.58 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 346 microversion: 2.1 time: 0.490686 Aug 10 23:15:44.651367 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1926/4013] 10.222.0.58 () {58 vars in 1146 bytes} [Wed Aug 10 23:15:44 2022] GET /compute/v2.1/servers?flavor=451 => generated 346 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:15:44.660106 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-e7c6ab88-5d94-4dae-b0f5-b2619e43571a req-719d1d62-b6b7-465c-8dbe-acd609fa3aa3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1cd977e1-410c-4c5f-a8fa-a9f9033bc512", "name": "network-vif-deleted", "tag": "a7efb403-a557-4888-b47e-036a0a6d5c76"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:15:44.698631 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-e7c6ab88-5d94-4dae-b0f5-b2619e43571a req-719d1d62-b6b7-465c-8dbe-acd609fa3aa3 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:44.699500 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-e7c6ab88-5d94-4dae-b0f5-b2619e43571a req-719d1d62-b6b7-465c-8dbe-acd609fa3aa3 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:44.700202 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-e7c6ab88-5d94-4dae-b0f5-b2619e43571a req-719d1d62-b6b7-465c-8dbe-acd609fa3aa3 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:44.714966 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-e7c6ab88-5d94-4dae-b0f5-b2619e43571a req-719d1d62-b6b7-465c-8dbe-acd609fa3aa3 service nova] Creating event network-vif-deleted:a7efb403-a557-4888-b47e-036a0a6d5c76 for instance 1cd977e1-410c-4c5f-a8fa-a9f9033bc512 on n-h2-850468-14 Aug 10 23:15:44.721234 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-e7c6ab88-5d94-4dae-b0f5-b2619e43571a req-719d1d62-b6b7-465c-8dbe-acd609fa3aa3 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065345 Aug 10 23:15:44.724004 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1927/4014] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:15:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:15:44.731240 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-1110775a-1dc1-456f-9d52-d4bee55bbb0c tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:44.731914 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-1110775a-1dc1-456f-9d52-d4bee55bbb0c tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: fa9dfd3a-a636-48ce-ae15-0ed51baee954] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:44.739042 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1110775a-1dc1-456f-9d52-d4bee55bbb0c tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:44.739818 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1110775a-1dc1-456f-9d52-d4bee55bbb0c tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:44.740436 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1110775a-1dc1-456f-9d52-d4bee55bbb0c tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:44.741760 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1110775a-1dc1-456f-9d52-d4bee55bbb0c tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:44.742380 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1110775a-1dc1-456f-9d52-d4bee55bbb0c tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:44.742984 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1110775a-1dc1-456f-9d52-d4bee55bbb0c tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:45.040311 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-79e1bce3-ad4e-4757-ae43-f4044a583f8a tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:45.052368 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-79e1bce3-ad4e-4757-ae43-f4044a583f8a tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b" status: 200 len: 1528 microversion: 2.1 time: 1.015587 Aug 10 23:15:45.053207 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2088/4015] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:44 2022] GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b => generated 1528 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:45.091019 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-4c4e0baa-acf0-449a-af91-988274693198 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:45.112443 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-4c4e0baa-acf0-449a-af91-988274693198 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '06cc4167255044d29a70c12a5a44d800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578d8e62013d43c5ad4d9a6d92e1f201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:45.117093 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.compute.servers [None req-4c4e0baa-acf0-449a-af91-988274693198 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Removing options 'limit' from query {{(pid=122633) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 10 23:15:45.118011 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-4c4e0baa-acf0-449a-af91-988274693198 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Searching by: {'deleted': False, 'project_id': '578d8e62013d43c5ad4d9a6d92e1f201'} {{(pid=122633) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 10 23:15:45.145834 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4c4e0baa-acf0-449a-af91-988274693198 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:45.146362 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4c4e0baa-acf0-449a-af91-988274693198 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:45.146859 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4c4e0baa-acf0-449a-af91-988274693198 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:45.147707 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4c4e0baa-acf0-449a-af91-988274693198 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:45.156547 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4c4e0baa-acf0-449a-af91-988274693198 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:45.157286 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4c4e0baa-acf0-449a-af91-988274693198 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:45.229180 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-4c4e0baa-acf0-449a-af91-988274693198 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] 10.222.0.58 "GET /compute/v2.1/servers?limit=1" status: 200 len: 485 microversion: 2.1 time: 0.154827 Aug 10 23:15:45.234490 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2089/4016] 10.222.0.58 () {58 vars in 1140 bytes} [Wed Aug 10 23:15:45 2022] GET /compute/v2.1/servers?limit=1 => generated 485 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:15:45.241648 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-b9e2cfac-18c1-454f-852f-312675da342a tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:45.252219 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-b9e2cfac-18c1-454f-852f-312675da342a tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] [instance: 27dd09d6-47ed-4b55-bd02-baad36a28429] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:45.275571 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b9e2cfac-18c1-454f-852f-312675da342a tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:45.276706 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b9e2cfac-18c1-454f-852f-312675da342a tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:45.277343 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b9e2cfac-18c1-454f-852f-312675da342a tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:45.279717 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b9e2cfac-18c1-454f-852f-312675da342a tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:45.280368 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b9e2cfac-18c1-454f-852f-312675da342a tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:45.280965 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b9e2cfac-18c1-454f-852f-312675da342a tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:45.352078 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-1110775a-1dc1-456f-9d52-d4bee55bbb0c tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:45.363981 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-1110775a-1dc1-456f-9d52-d4bee55bbb0c tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954" status: 200 len: 1652 microversion: 2.1 time: 0.638165 Aug 10 23:15:45.369870 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1928/4017] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:44 2022] GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954 => generated 1652 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:45.384331 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-0e98b8a6-18a7-4e34-9943-5a9460784cfe tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:45.391101 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-0e98b8a6-18a7-4e34-9943-5a9460784cfe tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: 1cd977e1-410c-4c5f-a8fa-a9f9033bc512] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:45.404455 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0e98b8a6-18a7-4e34-9943-5a9460784cfe tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:45.407782 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0e98b8a6-18a7-4e34-9943-5a9460784cfe tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:45.411654 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0e98b8a6-18a7-4e34-9943-5a9460784cfe tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:45.412656 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0e98b8a6-18a7-4e34-9943-5a9460784cfe tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:45.413288 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0e98b8a6-18a7-4e34-9943-5a9460784cfe tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:45.413892 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0e98b8a6-18a7-4e34-9943-5a9460784cfe tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:45.437294 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-0e98b8a6-18a7-4e34-9943-5a9460784cfe tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] HTTP exception thrown: Instance 1cd977e1-410c-4c5f-a8fa-a9f9033bc512 could not be found. Aug 10 23:15:45.439936 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-0e98b8a6-18a7-4e34-9943-5a9460784cfe tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Request method failure captured: Aug 10 23:15:45.439936 n-d-850468-14 devstack@n-api.service[122632]: request: GET /compute/v2.1/servers/1cd977e1-410c-4c5f-a8fa-a9f9033bc512 HTTP/1.1 Aug 10 23:15:45.439936 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:15:45.439936 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:15:45.439936 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:15:45.439936 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 23:15:45.439936 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:15:45.439936 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:15:45.439936 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:15:45.439936 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:15:45.439936 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9Drr3r82npWIkz1ccNiKcah17mvrMR2EU4HCxqxnaGEEIkGANcRcrX2nHMsvmCLf0usmykCLye_MMWubAbqGw1RDJdO9uNXXKIzwnkO3-8RDYkeEsX4dAb-XLWqGpnC4lB_RQ_yXrj9zJ0yoaNBALi5oi6cnoUgwIrYxNetinerHaU0 Aug 10 23:15:45.439936 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:15:45.439936 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:15:45.439936 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:15:45.439936 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:15:45.439936 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:15:45.439936 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:15:45.439936 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 7d90f8a58ad047fa8f347d6474e4d673 Aug 10 23:15:45.439936 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-DeleteServersTestJSON-311075827 Aug 10 23:15:45.439936 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:15:45.439936 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:15:45.439936 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7d90f8a58ad047fa8f347d6474e4d673"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7d90f8a58ad047fa8f347d6474e4d673"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7d90f8a58ad047fa8f347d6474e4d673"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7d90f8a58ad047fa8f347d6474e4d673", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:15:45.439936 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-DeleteServersTestJSON-311075827 Aug 10 23:15:45.439936 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 7d90f8a58ad047fa8f347d6474e4d673 Aug 10 23:15:45.439936 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-DeleteServersTestJSON-311075827 Aug 10 23:15:45.439936 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-DeleteServersTestJSON-311075827-project Aug 10 23:15:45.439936 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:15:45.439936 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:15:45.439936 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: 3c6160c7a42740efbe3613380933fa15 Aug 10 23:15:45.439936 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-DeleteServersTestJSON-311075827-project Aug 10 23:15:45.439936 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:15:45.439936 n-d-850468-14 devstack@n-api.service[122632]: exception: Instance 1cd977e1-410c-4c5f-a8fa-a9f9033bc512 could not be found. Aug 10 23:15:45.439936 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': '1cd977e1-410c-4c5f-a8fa-a9f9033bc512'} Aug 10 23:15:45.439936 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:15:45.439936 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:15:45.439936 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:15:45.439936 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:15:45.439936 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:15:45.439936 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:15:45.439936 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:15:45.439936 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:15:45.439936 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:15:45.439936 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:15:45.439936 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1cd977e1-410c-4c5f-a8fa-a9f9033bc512 could not be found. Aug 10 23:15:45.439936 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:15:45.439936 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:15:45.439936 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:15:45.439936 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:15:45.439936 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:15:45.439936 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:15:45.439936 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:15:45.439936 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:15:45.439936 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:15:45.439936 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:15:45.439936 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:15:45.439936 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:15:45.439936 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:15:45.439936 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:15:45.439936 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:15:45.439936 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:15:45.439936 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1cd977e1-410c-4c5f-a8fa-a9f9033bc512 could not be found. Aug 10 23:15:45.439936 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:15:45.439936 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:15:45.439936 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:15:45.445373 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:15:45.445373 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:15:45.445373 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:15:45.445373 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:15:45.445373 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:15:45.445373 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1cd977e1-410c-4c5f-a8fa-a9f9033bc512 could not be found. Aug 10 23:15:45.445373 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:15:45.447190 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-0e98b8a6-18a7-4e34-9943-5a9460784cfe tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Returning 404 to user: Instance 1cd977e1-410c-4c5f-a8fa-a9f9033bc512 could not be found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:15:45.448356 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-0e98b8a6-18a7-4e34-9943-5a9460784cfe tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "GET /compute/v2.1/servers/1cd977e1-410c-4c5f-a8fa-a9f9033bc512" status: 404 len: 111 microversion: 2.1 time: 0.072764 Aug 10 23:15:45.449197 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1929/4018] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:45 2022] GET /compute/v2.1/servers/1cd977e1-410c-4c5f-a8fa-a9f9033bc512 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:15:45.454373 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-375920ec-7b7e-4f24-ba39-d401665fd27a tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:45.455623 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-375920ec-7b7e-4f24-ba39-d401665fd27a tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] [instance: 250395b5-5be8-420a-8709-dcf8b4241a4e] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:45.463701 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-375920ec-7b7e-4f24-ba39-d401665fd27a tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:45.464456 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-375920ec-7b7e-4f24-ba39-d401665fd27a tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:45.465058 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-375920ec-7b7e-4f24-ba39-d401665fd27a tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:45.465935 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-375920ec-7b7e-4f24-ba39-d401665fd27a tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:45.466688 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-375920ec-7b7e-4f24-ba39-d401665fd27a tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:45.467561 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-375920ec-7b7e-4f24-ba39-d401665fd27a tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:46.015098 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-375920ec-7b7e-4f24-ba39-d401665fd27a tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5899b2ad9f1046caaf7c6073e408eeee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25abd63376614081a9d484f3c9ae950d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:46.026348 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-375920ec-7b7e-4f24-ba39-d401665fd27a tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "GET /compute/v2.1/servers/250395b5-5be8-420a-8709-dcf8b4241a4e" status: 200 len: 1392 microversion: 2.1 time: 0.575457 Aug 10 23:15:46.027133 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1930/4019] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:45 2022] GET /compute/v2.1/servers/250395b5-5be8-420a-8709-dcf8b4241a4e => generated 1392 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:46.058202 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-7971b631-9684-44b6-9d42-508db2b49c4a tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:46.112646 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-7971b631-9684-44b6-9d42-508db2b49c4a tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '06cc4167255044d29a70c12a5a44d800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578d8e62013d43c5ad4d9a6d92e1f201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:46.114991 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-7971b631-9684-44b6-9d42-508db2b49c4a tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1523915528', 'deleted': False, 'project_id': '578d8e62013d43c5ad4d9a6d92e1f201'} {{(pid=122632) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 10 23:15:46.132802 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7971b631-9684-44b6-9d42-508db2b49c4a tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:46.136462 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7971b631-9684-44b6-9d42-508db2b49c4a tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:46.137000 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7971b631-9684-44b6-9d42-508db2b49c4a tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:46.137887 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7971b631-9684-44b6-9d42-508db2b49c4a tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:46.139649 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7971b631-9684-44b6-9d42-508db2b49c4a tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:46.142703 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7971b631-9684-44b6-9d42-508db2b49c4a tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:46.947055 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.multi_cell_list [None req-7971b631-9684-44b6-9d42-508db2b49c4a tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122632) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 10 23:15:47.077599 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-7971b631-9684-44b6-9d42-508db2b49c4a tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] 10.222.0.58 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1523915528" status: 200 len: 346 microversion: 2.1 time: 1.047651 Aug 10 23:15:47.098517 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1931/4020] 10.222.0.58 () {58 vars in 1242 bytes} [Wed Aug 10 23:15:46 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1523915528 => generated 346 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:15:47.109314 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-8025c930-9931-4f2b-9473-8981bd689b1d tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:15:47.109883 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-8025c930-9931-4f2b-9473-8981bd689b1d tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: fa9dfd3a-a636-48ce-ae15-0ed51baee954] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:47.122577 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8025c930-9931-4f2b-9473-8981bd689b1d tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:47.123125 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8025c930-9931-4f2b-9473-8981bd689b1d tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:47.123578 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8025c930-9931-4f2b-9473-8981bd689b1d tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:47.124302 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8025c930-9931-4f2b-9473-8981bd689b1d tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:47.124764 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8025c930-9931-4f2b-9473-8981bd689b1d tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:47.125198 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8025c930-9931-4f2b-9473-8981bd689b1d tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:47.140771 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:15:47.177977 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-b9e2cfac-18c1-454f-852f-312675da342a tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07c94ebf0954cdea12b9a689538d96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395d7c4077e54c43bb95288db3942b0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:47.203544 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-b9e2cfac-18c1-454f-852f-312675da342a tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] 10.222.0.58 "GET /compute/v2.1/servers/27dd09d6-47ed-4b55-bd02-baad36a28429" status: 200 len: 1521 microversion: 2.1 time: 1.964242 Aug 10 23:15:47.210035 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2090/4021] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:45 2022] GET /compute/v2.1/servers/27dd09d6-47ed-4b55-bd02-baad36a28429 => generated 1521 bytes in 1973 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:47.221750 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-a87bc80a-9ff6-476e-bb52-ef5524e8be8f tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:47.223747 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-a87bc80a-9ff6-476e-bb52-ef5524e8be8f tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: 1cd977e1-410c-4c5f-a8fa-a9f9033bc512] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:47.249603 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a87bc80a-9ff6-476e-bb52-ef5524e8be8f tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:47.250764 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a87bc80a-9ff6-476e-bb52-ef5524e8be8f tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:47.251531 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a87bc80a-9ff6-476e-bb52-ef5524e8be8f tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:47.252838 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a87bc80a-9ff6-476e-bb52-ef5524e8be8f tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:47.256602 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a87bc80a-9ff6-476e-bb52-ef5524e8be8f tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:47.258553 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a87bc80a-9ff6-476e-bb52-ef5524e8be8f tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:47.293308 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-a87bc80a-9ff6-476e-bb52-ef5524e8be8f tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] HTTP exception thrown: Instance 1cd977e1-410c-4c5f-a8fa-a9f9033bc512 could not be found. Aug 10 23:15:47.299240 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-a87bc80a-9ff6-476e-bb52-ef5524e8be8f tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Request method failure captured: Aug 10 23:15:47.299240 n-d-850468-14 devstack@n-api.service[122633]: request: DELETE /compute/v2.1/servers/1cd977e1-410c-4c5f-a8fa-a9f9033bc512 HTTP/1.1 Aug 10 23:15:47.299240 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:15:47.299240 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:15:47.299240 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:15:47.299240 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:15:47.299240 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:15:47.299240 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:15:47.299240 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:15:47.299240 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:15:47.299240 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9Drr3r82npWIkz1ccNiKcah17mvrMR2EU4HCxqxnaGEEIkGANcRcrX2nHMsvmCLf0usmykCLye_MMWubAbqGw1RDJdO9uNXXKIzwnkO3-8RDYkeEsX4dAb-XLWqGpnC4lB_RQ_yXrj9zJ0yoaNBALi5oi6cnoUgwIrYxNetinerHaU0 Aug 10 23:15:47.299240 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:15:47.299240 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:15:47.299240 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:15:47.299240 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:15:47.299240 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:15:47.299240 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:15:47.299240 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 7d90f8a58ad047fa8f347d6474e4d673 Aug 10 23:15:47.299240 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-DeleteServersTestJSON-311075827 Aug 10 23:15:47.299240 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:15:47.299240 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:15:47.299240 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7d90f8a58ad047fa8f347d6474e4d673"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7d90f8a58ad047fa8f347d6474e4d673"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7d90f8a58ad047fa8f347d6474e4d673"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7d90f8a58ad047fa8f347d6474e4d673", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:15:47.299240 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-DeleteServersTestJSON-311075827 Aug 10 23:15:47.299240 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 7d90f8a58ad047fa8f347d6474e4d673 Aug 10 23:15:47.299240 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-DeleteServersTestJSON-311075827 Aug 10 23:15:47.299240 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-DeleteServersTestJSON-311075827-project Aug 10 23:15:47.299240 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:15:47.299240 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:15:47.299240 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 3c6160c7a42740efbe3613380933fa15 Aug 10 23:15:47.299240 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-DeleteServersTestJSON-311075827-project Aug 10 23:15:47.299240 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:15:47.299240 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance 1cd977e1-410c-4c5f-a8fa-a9f9033bc512 could not be found. Aug 10 23:15:47.299240 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': '1cd977e1-410c-4c5f-a8fa-a9f9033bc512'} Aug 10 23:15:47.299240 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:15:47.299240 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:15:47.299240 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:15:47.299240 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:15:47.299240 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:15:47.299240 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:15:47.299240 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:15:47.299240 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:15:47.299240 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:15:47.299240 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:15:47.299240 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1cd977e1-410c-4c5f-a8fa-a9f9033bc512 could not be found. Aug 10 23:15:47.299240 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:15:47.299240 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:15:47.299240 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:15:47.299240 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:15:47.299240 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:15:47.299240 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:15:47.299240 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:15:47.299240 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:15:47.299240 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:15:47.299240 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:15:47.299240 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 23:15:47.299240 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 23:15:47.299240 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 23:15:47.299240 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 23:15:47.299240 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:15:47.299240 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:15:47.299240 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:15:47.299240 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:15:47.304140 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1cd977e1-410c-4c5f-a8fa-a9f9033bc512 could not be found. Aug 10 23:15:47.304140 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:15:47.304140 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:15:47.304140 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:15:47.304140 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:15:47.304140 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:15:47.304140 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:15:47.304140 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:15:47.304140 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:15:47.304140 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1cd977e1-410c-4c5f-a8fa-a9f9033bc512 could not be found. Aug 10 23:15:47.304140 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:15:47.304140 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-a87bc80a-9ff6-476e-bb52-ef5524e8be8f tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Returning 404 to user: Instance 1cd977e1-410c-4c5f-a8fa-a9f9033bc512 could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:15:47.304140 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-a87bc80a-9ff6-476e-bb52-ef5524e8be8f tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "DELETE /compute/v2.1/servers/1cd977e1-410c-4c5f-a8fa-a9f9033bc512" status: 404 len: 111 microversion: 2.1 time: 0.090356 Aug 10 23:15:47.307898 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2091/4022] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:15:47 2022] DELETE /compute/v2.1/servers/1cd977e1-410c-4c5f-a8fa-a9f9033bc512 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:15:47.319918 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-02029377-febb-4303-aa9f-8523db6d58c8 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:47.328839 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-02029377-febb-4303-aa9f-8523db6d58c8 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:47.360177 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-02029377-febb-4303-aa9f-8523db6d58c8 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:47.360923 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-02029377-febb-4303-aa9f-8523db6d58c8 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:47.365107 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-02029377-febb-4303-aa9f-8523db6d58c8 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:47.366065 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-02029377-febb-4303-aa9f-8523db6d58c8 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:47.366428 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-02029377-febb-4303-aa9f-8523db6d58c8 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:47.366892 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-02029377-febb-4303-aa9f-8523db6d58c8 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:47.368046 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-8025c930-9931-4f2b-9473-8981bd689b1d tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "POST /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954/action" status: 202 len: 0 microversion: 2.1 time: 0.268114 Aug 10 23:15:47.368819 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1932/4023] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:15:47 2022] POST /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954/action => generated 0 bytes in 270 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:15:47.382071 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-e6364440-55e8-4e3f-8f9f-d044cdf73cb1 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:47.408485 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-e6364440-55e8-4e3f-8f9f-d044cdf73cb1 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] [instance: 250395b5-5be8-420a-8709-dcf8b4241a4e] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:47.434942 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e6364440-55e8-4e3f-8f9f-d044cdf73cb1 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:47.435360 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e6364440-55e8-4e3f-8f9f-d044cdf73cb1 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:47.442811 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e6364440-55e8-4e3f-8f9f-d044cdf73cb1 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:47.444911 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e6364440-55e8-4e3f-8f9f-d044cdf73cb1 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:47.451478 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e6364440-55e8-4e3f-8f9f-d044cdf73cb1 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:47.457826 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e6364440-55e8-4e3f-8f9f-d044cdf73cb1 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:47.848783 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-02029377-febb-4303-aa9f-8523db6d58c8 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:47.858163 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-02029377-febb-4303-aa9f-8523db6d58c8 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b" status: 200 len: 1528 microversion: 2.1 time: 0.549093 Aug 10 23:15:47.890971 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2092/4024] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:47 2022] GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b => generated 1528 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:47.902500 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-59e2e427-e0f3-4e78-826f-f3e86a86f68c tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:15:47.915576 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-59e2e427-e0f3-4e78-826f-f3e86a86f68c tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:47.917852 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-59e2e427-e0f3-4e78-826f-f3e86a86f68c tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:47.923505 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-59e2e427-e0f3-4e78-826f-f3e86a86f68c tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:47.980071 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-59e2e427-e0f3-4e78-826f-f3e86a86f68c tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] [instance: fdd1f85d-95db-477c-a173-a6fca94f58b1] Going to try to stop instance {{(pid=122633) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 10 23:15:48.043185 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-59e2e427-e0f3-4e78-826f-f3e86a86f68c tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] 10.222.0.58 "POST /compute/v2.1/servers/fdd1f85d-95db-477c-a173-a6fca94f58b1/action" status: 202 len: 0 microversion: 2.1 time: 0.150176 Aug 10 23:15:48.045266 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2093/4025] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:15:47 2022] POST /compute/v2.1/servers/fdd1f85d-95db-477c-a173-a6fca94f58b1/action => generated 0 bytes in 153 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:15:48.054458 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-ff13dfcd-c6a7-48c1-a088-46ed2fc52193 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:48.055769 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-ff13dfcd-c6a7-48c1-a088-46ed2fc52193 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: 1cd977e1-410c-4c5f-a8fa-a9f9033bc512] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:48.063821 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ff13dfcd-c6a7-48c1-a088-46ed2fc52193 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:48.065409 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ff13dfcd-c6a7-48c1-a088-46ed2fc52193 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:48.067733 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ff13dfcd-c6a7-48c1-a088-46ed2fc52193 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:48.069070 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ff13dfcd-c6a7-48c1-a088-46ed2fc52193 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:48.070074 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ff13dfcd-c6a7-48c1-a088-46ed2fc52193 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:48.070726 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ff13dfcd-c6a7-48c1-a088-46ed2fc52193 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:48.092711 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-ff13dfcd-c6a7-48c1-a088-46ed2fc52193 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] HTTP exception thrown: Instance 1cd977e1-410c-4c5f-a8fa-a9f9033bc512 could not be found. Aug 10 23:15:48.095641 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-ff13dfcd-c6a7-48c1-a088-46ed2fc52193 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Request method failure captured: Aug 10 23:15:48.095641 n-d-850468-14 devstack@n-api.service[122633]: request: GET /compute/v2.1/servers/1cd977e1-410c-4c5f-a8fa-a9f9033bc512 HTTP/1.1 Aug 10 23:15:48.095641 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:15:48.095641 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:15:48.095641 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:15:48.095641 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:15:48.095641 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:15:48.095641 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:15:48.095641 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:15:48.095641 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:15:48.095641 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9Drr3r82npWIkz1ccNiKcah17mvrMR2EU4HCxqxnaGEEIkGANcRcrX2nHMsvmCLf0usmykCLye_MMWubAbqGw1RDJdO9uNXXKIzwnkO3-8RDYkeEsX4dAb-XLWqGpnC4lB_RQ_yXrj9zJ0yoaNBALi5oi6cnoUgwIrYxNetinerHaU0 Aug 10 23:15:48.095641 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:15:48.095641 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:15:48.095641 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:15:48.095641 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:15:48.095641 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:15:48.095641 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:15:48.095641 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 7d90f8a58ad047fa8f347d6474e4d673 Aug 10 23:15:48.095641 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-DeleteServersTestJSON-311075827 Aug 10 23:15:48.095641 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:15:48.095641 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:15:48.095641 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7d90f8a58ad047fa8f347d6474e4d673"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7d90f8a58ad047fa8f347d6474e4d673"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7d90f8a58ad047fa8f347d6474e4d673"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7d90f8a58ad047fa8f347d6474e4d673", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:15:48.095641 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-DeleteServersTestJSON-311075827 Aug 10 23:15:48.095641 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 7d90f8a58ad047fa8f347d6474e4d673 Aug 10 23:15:48.095641 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-DeleteServersTestJSON-311075827 Aug 10 23:15:48.095641 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-DeleteServersTestJSON-311075827-project Aug 10 23:15:48.095641 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:15:48.095641 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:15:48.095641 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 3c6160c7a42740efbe3613380933fa15 Aug 10 23:15:48.095641 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-DeleteServersTestJSON-311075827-project Aug 10 23:15:48.095641 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:15:48.095641 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance 1cd977e1-410c-4c5f-a8fa-a9f9033bc512 could not be found. Aug 10 23:15:48.095641 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': '1cd977e1-410c-4c5f-a8fa-a9f9033bc512'} Aug 10 23:15:48.095641 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:15:48.095641 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:15:48.095641 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:15:48.095641 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:15:48.095641 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:15:48.095641 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:15:48.095641 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:15:48.095641 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:15:48.095641 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:15:48.095641 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:15:48.095641 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1cd977e1-410c-4c5f-a8fa-a9f9033bc512 could not be found. Aug 10 23:15:48.095641 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:15:48.095641 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:15:48.095641 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:15:48.095641 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:15:48.095641 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:15:48.095641 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:15:48.095641 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:15:48.095641 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:15:48.095641 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:15:48.095641 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:15:48.095641 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:15:48.095641 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:15:48.095641 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:15:48.095641 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:15:48.095641 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:15:48.095641 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:15:48.095641 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1cd977e1-410c-4c5f-a8fa-a9f9033bc512 could not be found. Aug 10 23:15:48.095641 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:15:48.095641 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:15:48.095641 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:15:48.100996 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:15:48.100996 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:15:48.100996 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:15:48.100996 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:15:48.100996 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:15:48.100996 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1cd977e1-410c-4c5f-a8fa-a9f9033bc512 could not be found. Aug 10 23:15:48.100996 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:15:48.102928 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-ff13dfcd-c6a7-48c1-a088-46ed2fc52193 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Returning 404 to user: Instance 1cd977e1-410c-4c5f-a8fa-a9f9033bc512 could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:15:48.104160 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-ff13dfcd-c6a7-48c1-a088-46ed2fc52193 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "GET /compute/v2.1/servers/1cd977e1-410c-4c5f-a8fa-a9f9033bc512" status: 404 len: 111 microversion: 2.1 time: 0.056309 Aug 10 23:15:48.106306 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2094/4026] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:48 2022] GET /compute/v2.1/servers/1cd977e1-410c-4c5f-a8fa-a9f9033bc512 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:15:48.113040 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-7ceaa547-0290-4a0e-9ae3-c9fa846ad8a8 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:48.114086 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-7ceaa547-0290-4a0e-9ae3-c9fa846ad8a8 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: fa9dfd3a-a636-48ce-ae15-0ed51baee954] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:48.122737 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7ceaa547-0290-4a0e-9ae3-c9fa846ad8a8 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:48.123625 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7ceaa547-0290-4a0e-9ae3-c9fa846ad8a8 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:48.124319 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7ceaa547-0290-4a0e-9ae3-c9fa846ad8a8 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:48.125801 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7ceaa547-0290-4a0e-9ae3-c9fa846ad8a8 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:48.126527 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7ceaa547-0290-4a0e-9ae3-c9fa846ad8a8 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:48.127450 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7ceaa547-0290-4a0e-9ae3-c9fa846ad8a8 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:48.251616 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-e6364440-55e8-4e3f-8f9f-d044cdf73cb1 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5899b2ad9f1046caaf7c6073e408eeee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25abd63376614081a9d484f3c9ae950d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:48.286856 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-e6364440-55e8-4e3f-8f9f-d044cdf73cb1 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "GET /compute/v2.1/servers/250395b5-5be8-420a-8709-dcf8b4241a4e" status: 200 len: 1392 microversion: 2.1 time: 0.915642 Aug 10 23:15:48.294933 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1933/4027] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:47 2022] GET /compute/v2.1/servers/250395b5-5be8-420a-8709-dcf8b4241a4e => generated 1392 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:48.321821 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-29709a2e-9551-46f8-a2a0-6f051221e036 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:48.323397 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-29709a2e-9551-46f8-a2a0-6f051221e036 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] [instance: fdd1f85d-95db-477c-a173-a6fca94f58b1] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:48.372448 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-29709a2e-9551-46f8-a2a0-6f051221e036 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:48.372961 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-29709a2e-9551-46f8-a2a0-6f051221e036 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:48.373414 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-29709a2e-9551-46f8-a2a0-6f051221e036 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:48.374143 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-29709a2e-9551-46f8-a2a0-6f051221e036 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:48.374606 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-29709a2e-9551-46f8-a2a0-6f051221e036 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:48.381582 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-29709a2e-9551-46f8-a2a0-6f051221e036 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:48.680765 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-7ceaa547-0290-4a0e-9ae3-c9fa846ad8a8 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:48.692334 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-7ceaa547-0290-4a0e-9ae3-c9fa846ad8a8 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954" status: 200 len: 1667 microversion: 2.1 time: 0.584630 Aug 10 23:15:48.692916 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2095/4028] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:48 2022] GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954 => generated 1667 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:48.703767 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-21494082-0f8d-437c-8421-ec852dbbda0d tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:48.704503 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-21494082-0f8d-437c-8421-ec852dbbda0d tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: 7a8f8d36-4744-43b7-9d42-e50fb5fabe60] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:48.713129 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-21494082-0f8d-437c-8421-ec852dbbda0d tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:48.713617 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-21494082-0f8d-437c-8421-ec852dbbda0d tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:48.714235 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-21494082-0f8d-437c-8421-ec852dbbda0d tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:48.715343 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-21494082-0f8d-437c-8421-ec852dbbda0d tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:48.715950 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-21494082-0f8d-437c-8421-ec852dbbda0d tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:48.716524 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-21494082-0f8d-437c-8421-ec852dbbda0d tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:48.734702 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-21494082-0f8d-437c-8421-ec852dbbda0d tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] HTTP exception thrown: Instance 7a8f8d36-4744-43b7-9d42-e50fb5fabe60 could not be found. Aug 10 23:15:48.737041 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-21494082-0f8d-437c-8421-ec852dbbda0d tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Request method failure captured: Aug 10 23:15:48.737041 n-d-850468-14 devstack@n-api.service[122633]: request: DELETE /compute/v2.1/servers/7a8f8d36-4744-43b7-9d42-e50fb5fabe60 HTTP/1.1 Aug 10 23:15:48.737041 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:15:48.737041 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:15:48.737041 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:15:48.737041 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:15:48.737041 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:15:48.737041 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:15:48.737041 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:15:48.737041 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:15:48.737041 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9Drr3r82npWIkz1ccNiKcah17mvrMR2EU4HCxqxnaGEEIkGANcRcrX2nHMsvmCLf0usmykCLye_MMWubAbqGw1RDJdO9uNXXKIzwnkO3-8RDYkeEsX4dAb-XLWqGpnC4lB_RQ_yXrj9zJ0yoaNBALi5oi6cnoUgwIrYxNetinerHaU0 Aug 10 23:15:48.737041 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:15:48.737041 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:15:48.737041 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:15:48.737041 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:15:48.737041 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:15:48.737041 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:15:48.737041 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 7d90f8a58ad047fa8f347d6474e4d673 Aug 10 23:15:48.737041 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-DeleteServersTestJSON-311075827 Aug 10 23:15:48.737041 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:15:48.737041 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:15:48.737041 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7d90f8a58ad047fa8f347d6474e4d673"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7d90f8a58ad047fa8f347d6474e4d673"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7d90f8a58ad047fa8f347d6474e4d673"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7d90f8a58ad047fa8f347d6474e4d673", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:15:48.737041 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-DeleteServersTestJSON-311075827 Aug 10 23:15:48.737041 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 7d90f8a58ad047fa8f347d6474e4d673 Aug 10 23:15:48.737041 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-DeleteServersTestJSON-311075827 Aug 10 23:15:48.737041 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-DeleteServersTestJSON-311075827-project Aug 10 23:15:48.737041 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:15:48.737041 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:15:48.737041 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 3c6160c7a42740efbe3613380933fa15 Aug 10 23:15:48.737041 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-DeleteServersTestJSON-311075827-project Aug 10 23:15:48.737041 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:15:48.737041 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance 7a8f8d36-4744-43b7-9d42-e50fb5fabe60 could not be found. Aug 10 23:15:48.737041 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': '7a8f8d36-4744-43b7-9d42-e50fb5fabe60'} Aug 10 23:15:48.737041 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:15:48.737041 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:15:48.737041 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:15:48.737041 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:15:48.737041 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:15:48.737041 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:15:48.737041 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:15:48.737041 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:15:48.737041 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:15:48.737041 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:15:48.737041 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a8f8d36-4744-43b7-9d42-e50fb5fabe60 could not be found. Aug 10 23:15:48.737041 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:15:48.737041 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:15:48.737041 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:15:48.737041 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:15:48.737041 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:15:48.737041 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:15:48.737041 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:15:48.737041 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:15:48.737041 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:15:48.737041 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:15:48.737041 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 23:15:48.737041 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 23:15:48.737041 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 23:15:48.737041 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 23:15:48.737041 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:15:48.737041 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:15:48.737041 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:15:48.737041 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:15:48.743828 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a8f8d36-4744-43b7-9d42-e50fb5fabe60 could not be found. Aug 10 23:15:48.743828 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:15:48.743828 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:15:48.743828 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:15:48.743828 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:15:48.743828 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:15:48.743828 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:15:48.743828 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:15:48.743828 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:15:48.743828 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a8f8d36-4744-43b7-9d42-e50fb5fabe60 could not be found. Aug 10 23:15:48.743828 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:15:48.745514 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-21494082-0f8d-437c-8421-ec852dbbda0d tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Returning 404 to user: Instance 7a8f8d36-4744-43b7-9d42-e50fb5fabe60 could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:15:48.747451 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-21494082-0f8d-437c-8421-ec852dbbda0d tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "DELETE /compute/v2.1/servers/7a8f8d36-4744-43b7-9d42-e50fb5fabe60" status: 404 len: 111 microversion: 2.1 time: 0.053585 Aug 10 23:15:48.749045 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2096/4029] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:15:48 2022] DELETE /compute/v2.1/servers/7a8f8d36-4744-43b7-9d42-e50fb5fabe60 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:15:48.757029 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-3a336951-7c2a-463d-92ff-7c7b77833256 req-406eacbf-ee19-4b75-9e43-5554a8ccc71a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "250395b5-5be8-420a-8709-dcf8b4241a4e", "tag": "fb6df67c-3dbb-4a0f-98f0-c602e1eaa615"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:15:48.769148 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-3a336951-7c2a-463d-92ff-7c7b77833256 req-406eacbf-ee19-4b75-9e43-5554a8ccc71a service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:48.770387 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-3a336951-7c2a-463d-92ff-7c7b77833256 req-406eacbf-ee19-4b75-9e43-5554a8ccc71a service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:48.771022 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-3a336951-7c2a-463d-92ff-7c7b77833256 req-406eacbf-ee19-4b75-9e43-5554a8ccc71a service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:48.788253 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-3a336951-7c2a-463d-92ff-7c7b77833256 req-406eacbf-ee19-4b75-9e43-5554a8ccc71a service nova] Creating event network-changed:fb6df67c-3dbb-4a0f-98f0-c602e1eaa615 for instance 250395b5-5be8-420a-8709-dcf8b4241a4e on n-h1-850468-14 Aug 10 23:15:48.794028 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-3a336951-7c2a-463d-92ff-7c7b77833256 req-406eacbf-ee19-4b75-9e43-5554a8ccc71a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043193 Aug 10 23:15:48.795173 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2097/4030] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:15:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:15:48.801386 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-08f3fbc7-3796-41d2-a521-a01f3e03c495 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:48.802165 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-08f3fbc7-3796-41d2-a521-a01f3e03c495 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] [instance: 27dd09d6-47ed-4b55-bd02-baad36a28429] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:48.810089 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-08f3fbc7-3796-41d2-a521-a01f3e03c495 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:48.810911 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-08f3fbc7-3796-41d2-a521-a01f3e03c495 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:48.811536 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-08f3fbc7-3796-41d2-a521-a01f3e03c495 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:48.812425 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-08f3fbc7-3796-41d2-a521-a01f3e03c495 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:48.813032 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-08f3fbc7-3796-41d2-a521-a01f3e03c495 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:48.813628 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-08f3fbc7-3796-41d2-a521-a01f3e03c495 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:48.822255 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:15:48.995857 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-29709a2e-9551-46f8-a2a0-6f051221e036 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cc4167255044d29a70c12a5a44d800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578d8e62013d43c5ad4d9a6d92e1f201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:49.005642 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-29709a2e-9551-46f8-a2a0-6f051221e036 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] 10.222.0.58 "GET /compute/v2.1/servers/fdd1f85d-95db-477c-a173-a6fca94f58b1" status: 200 len: 1523 microversion: 2.1 time: 0.709224 Aug 10 23:15:49.007449 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1934/4031] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:48 2022] GET /compute/v2.1/servers/fdd1f85d-95db-477c-a173-a6fca94f58b1 => generated 1523 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:49.023599 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-a3cfdfb2-939c-48ba-8338-2bc934df010c tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:49.024159 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-a3cfdfb2-939c-48ba-8338-2bc934df010c tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: fa9dfd3a-a636-48ce-ae15-0ed51baee954] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:49.030650 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a3cfdfb2-939c-48ba-8338-2bc934df010c tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:49.031179 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a3cfdfb2-939c-48ba-8338-2bc934df010c tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:49.031624 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a3cfdfb2-939c-48ba-8338-2bc934df010c tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:49.032397 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a3cfdfb2-939c-48ba-8338-2bc934df010c tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:49.032786 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a3cfdfb2-939c-48ba-8338-2bc934df010c tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:49.033210 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a3cfdfb2-939c-48ba-8338-2bc934df010c tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:49.040147 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-08f3fbc7-3796-41d2-a521-a01f3e03c495 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07c94ebf0954cdea12b9a689538d96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395d7c4077e54c43bb95288db3942b0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:49.051876 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-08f3fbc7-3796-41d2-a521-a01f3e03c495 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] 10.222.0.58 "GET /compute/v2.1/servers/27dd09d6-47ed-4b55-bd02-baad36a28429" status: 200 len: 1521 microversion: 2.1 time: 0.255471 Aug 10 23:15:49.057326 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2098/4032] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:48 2022] GET /compute/v2.1/servers/27dd09d6-47ed-4b55-bd02-baad36a28429 => generated 1521 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:49.066995 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-21fa4c25-1f8c-4dfa-b506-51e344258e19 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:49.067643 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-21fa4c25-1f8c-4dfa-b506-51e344258e19 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: 7a8f8d36-4744-43b7-9d42-e50fb5fabe60] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:49.076101 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-21fa4c25-1f8c-4dfa-b506-51e344258e19 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:49.076991 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-21fa4c25-1f8c-4dfa-b506-51e344258e19 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:49.077604 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-21fa4c25-1f8c-4dfa-b506-51e344258e19 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:49.078571 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-21fa4c25-1f8c-4dfa-b506-51e344258e19 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:49.079254 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-21fa4c25-1f8c-4dfa-b506-51e344258e19 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:49.079850 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-21fa4c25-1f8c-4dfa-b506-51e344258e19 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:49.099080 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-21fa4c25-1f8c-4dfa-b506-51e344258e19 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] HTTP exception thrown: Instance 7a8f8d36-4744-43b7-9d42-e50fb5fabe60 could not be found. Aug 10 23:15:49.101252 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-21fa4c25-1f8c-4dfa-b506-51e344258e19 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Request method failure captured: Aug 10 23:15:49.101252 n-d-850468-14 devstack@n-api.service[122633]: request: GET /compute/v2.1/servers/7a8f8d36-4744-43b7-9d42-e50fb5fabe60 HTTP/1.1 Aug 10 23:15:49.101252 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:15:49.101252 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:15:49.101252 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:15:49.101252 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:15:49.101252 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:15:49.101252 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:15:49.101252 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:15:49.101252 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:15:49.101252 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9Drr3r82npWIkz1ccNiKcah17mvrMR2EU4HCxqxnaGEEIkGANcRcrX2nHMsvmCLf0usmykCLye_MMWubAbqGw1RDJdO9uNXXKIzwnkO3-8RDYkeEsX4dAb-XLWqGpnC4lB_RQ_yXrj9zJ0yoaNBALi5oi6cnoUgwIrYxNetinerHaU0 Aug 10 23:15:49.101252 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:15:49.101252 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:15:49.101252 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:15:49.101252 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:15:49.101252 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:15:49.101252 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:15:49.101252 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 7d90f8a58ad047fa8f347d6474e4d673 Aug 10 23:15:49.101252 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-DeleteServersTestJSON-311075827 Aug 10 23:15:49.101252 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:15:49.101252 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:15:49.101252 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7d90f8a58ad047fa8f347d6474e4d673"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7d90f8a58ad047fa8f347d6474e4d673"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7d90f8a58ad047fa8f347d6474e4d673"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7d90f8a58ad047fa8f347d6474e4d673", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:15:49.101252 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-DeleteServersTestJSON-311075827 Aug 10 23:15:49.101252 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 7d90f8a58ad047fa8f347d6474e4d673 Aug 10 23:15:49.101252 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-DeleteServersTestJSON-311075827 Aug 10 23:15:49.101252 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-DeleteServersTestJSON-311075827-project Aug 10 23:15:49.101252 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:15:49.101252 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:15:49.101252 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 3c6160c7a42740efbe3613380933fa15 Aug 10 23:15:49.101252 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-DeleteServersTestJSON-311075827-project Aug 10 23:15:49.101252 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:15:49.101252 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance 7a8f8d36-4744-43b7-9d42-e50fb5fabe60 could not be found. Aug 10 23:15:49.101252 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': '7a8f8d36-4744-43b7-9d42-e50fb5fabe60'} Aug 10 23:15:49.101252 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:15:49.101252 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:15:49.101252 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:15:49.101252 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:15:49.101252 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:15:49.101252 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:15:49.101252 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:15:49.101252 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:15:49.101252 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:15:49.101252 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:15:49.101252 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a8f8d36-4744-43b7-9d42-e50fb5fabe60 could not be found. Aug 10 23:15:49.101252 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:15:49.101252 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:15:49.101252 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:15:49.101252 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:15:49.101252 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:15:49.101252 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:15:49.101252 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:15:49.101252 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:15:49.101252 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:15:49.101252 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:15:49.101252 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:15:49.101252 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:15:49.101252 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:15:49.101252 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:15:49.101252 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:15:49.101252 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:15:49.101252 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a8f8d36-4744-43b7-9d42-e50fb5fabe60 could not be found. Aug 10 23:15:49.101252 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:15:49.101252 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:15:49.101252 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:15:49.106085 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:15:49.106085 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:15:49.106085 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:15:49.106085 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:15:49.106085 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:15:49.106085 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a8f8d36-4744-43b7-9d42-e50fb5fabe60 could not be found. Aug 10 23:15:49.106085 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:15:49.107907 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-21fa4c25-1f8c-4dfa-b506-51e344258e19 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Returning 404 to user: Instance 7a8f8d36-4744-43b7-9d42-e50fb5fabe60 could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:15:49.109069 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-21fa4c25-1f8c-4dfa-b506-51e344258e19 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "GET /compute/v2.1/servers/7a8f8d36-4744-43b7-9d42-e50fb5fabe60" status: 404 len: 111 microversion: 2.1 time: 0.049258 Aug 10 23:15:49.113769 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2099/4033] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:49 2022] GET /compute/v2.1/servers/7a8f8d36-4744-43b7-9d42-e50fb5fabe60 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:15:49.119685 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-321b8364-2ffa-40d3-b1fd-c3e16d28b84f tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:49.120555 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-321b8364-2ffa-40d3-b1fd-c3e16d28b84f tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:49.129075 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-321b8364-2ffa-40d3-b1fd-c3e16d28b84f tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:49.129973 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-321b8364-2ffa-40d3-b1fd-c3e16d28b84f tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:49.131329 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-321b8364-2ffa-40d3-b1fd-c3e16d28b84f tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:49.132397 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-321b8364-2ffa-40d3-b1fd-c3e16d28b84f tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:49.133083 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-321b8364-2ffa-40d3-b1fd-c3e16d28b84f tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:49.134001 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-321b8364-2ffa-40d3-b1fd-c3e16d28b84f tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:49.409470 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-a3cfdfb2-939c-48ba-8338-2bc934df010c tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:49.420229 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-a3cfdfb2-939c-48ba-8338-2bc934df010c tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954" status: 200 len: 1667 microversion: 2.1 time: 0.411629 Aug 10 23:15:49.423247 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1935/4034] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:49 2022] GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954 => generated 1667 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:49.429359 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-a489040a-b110-4e91-9fb4-9902ee4b38ec tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:49.430097 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-a489040a-b110-4e91-9fb4-9902ee4b38ec tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: da69cf1f-ff76-4a68-afe9-fc491b31e8a9] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:49.455025 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a489040a-b110-4e91-9fb4-9902ee4b38ec tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:49.459283 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a489040a-b110-4e91-9fb4-9902ee4b38ec tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:49.462398 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-321b8364-2ffa-40d3-b1fd-c3e16d28b84f tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:49.463063 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a489040a-b110-4e91-9fb4-9902ee4b38ec tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:49.463926 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a489040a-b110-4e91-9fb4-9902ee4b38ec tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:49.464424 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a489040a-b110-4e91-9fb4-9902ee4b38ec tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:49.464851 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a489040a-b110-4e91-9fb4-9902ee4b38ec tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:49.472851 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-321b8364-2ffa-40d3-b1fd-c3e16d28b84f tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b" status: 200 len: 1528 microversion: 2.1 time: 0.357731 Aug 10 23:15:49.473488 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2100/4035] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:49 2022] GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b => generated 1528 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:49.478118 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-b1bd3a41-dc73-47e3-8c14-839ed7c80648 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:49.478725 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-b1bd3a41-dc73-47e3-8c14-839ed7c80648 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] [instance: 250395b5-5be8-420a-8709-dcf8b4241a4e] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:49.493260 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b1bd3a41-dc73-47e3-8c14-839ed7c80648 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:49.493769 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b1bd3a41-dc73-47e3-8c14-839ed7c80648 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:49.494335 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b1bd3a41-dc73-47e3-8c14-839ed7c80648 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:49.495183 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b1bd3a41-dc73-47e3-8c14-839ed7c80648 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:49.495617 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b1bd3a41-dc73-47e3-8c14-839ed7c80648 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:49.496167 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b1bd3a41-dc73-47e3-8c14-839ed7c80648 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:49.497329 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-a489040a-b110-4e91-9fb4-9902ee4b38ec tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] HTTP exception thrown: Instance da69cf1f-ff76-4a68-afe9-fc491b31e8a9 could not be found. Aug 10 23:15:49.499084 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-a489040a-b110-4e91-9fb4-9902ee4b38ec tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Request method failure captured: Aug 10 23:15:49.499084 n-d-850468-14 devstack@n-api.service[122632]: request: DELETE /compute/v2.1/servers/da69cf1f-ff76-4a68-afe9-fc491b31e8a9 HTTP/1.1 Aug 10 23:15:49.499084 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:15:49.499084 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:15:49.499084 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:15:49.499084 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 23:15:49.499084 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:15:49.499084 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:15:49.499084 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:15:49.499084 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:15:49.499084 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9Drr3r82npWIkz1ccNiKcah17mvrMR2EU4HCxqxnaGEEIkGANcRcrX2nHMsvmCLf0usmykCLye_MMWubAbqGw1RDJdO9uNXXKIzwnkO3-8RDYkeEsX4dAb-XLWqGpnC4lB_RQ_yXrj9zJ0yoaNBALi5oi6cnoUgwIrYxNetinerHaU0 Aug 10 23:15:49.499084 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:15:49.499084 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:15:49.499084 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:15:49.499084 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:15:49.499084 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:15:49.499084 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:15:49.499084 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 7d90f8a58ad047fa8f347d6474e4d673 Aug 10 23:15:49.499084 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-DeleteServersTestJSON-311075827 Aug 10 23:15:49.499084 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:15:49.499084 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:15:49.499084 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7d90f8a58ad047fa8f347d6474e4d673"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7d90f8a58ad047fa8f347d6474e4d673"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7d90f8a58ad047fa8f347d6474e4d673"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7d90f8a58ad047fa8f347d6474e4d673", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:15:49.499084 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-DeleteServersTestJSON-311075827 Aug 10 23:15:49.499084 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 7d90f8a58ad047fa8f347d6474e4d673 Aug 10 23:15:49.499084 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-DeleteServersTestJSON-311075827 Aug 10 23:15:49.499084 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-DeleteServersTestJSON-311075827-project Aug 10 23:15:49.499084 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:15:49.499084 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:15:49.499084 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: 3c6160c7a42740efbe3613380933fa15 Aug 10 23:15:49.499084 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-DeleteServersTestJSON-311075827-project Aug 10 23:15:49.499084 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:15:49.499084 n-d-850468-14 devstack@n-api.service[122632]: exception: Instance da69cf1f-ff76-4a68-afe9-fc491b31e8a9 could not be found. Aug 10 23:15:49.499084 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': 'da69cf1f-ff76-4a68-afe9-fc491b31e8a9'} Aug 10 23:15:49.499084 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:15:49.499084 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:15:49.499084 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:15:49.499084 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:15:49.499084 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:15:49.499084 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:15:49.499084 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:15:49.499084 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:15:49.499084 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:15:49.499084 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:15:49.499084 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da69cf1f-ff76-4a68-afe9-fc491b31e8a9 could not be found. Aug 10 23:15:49.499084 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:15:49.499084 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:15:49.499084 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:15:49.499084 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:15:49.499084 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:15:49.499084 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:15:49.499084 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:15:49.499084 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:15:49.499084 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:15:49.499084 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:15:49.499084 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 23:15:49.499084 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 23:15:49.499084 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 23:15:49.499084 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 23:15:49.499084 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:15:49.499084 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:15:49.499084 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:15:49.499084 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:15:49.504042 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da69cf1f-ff76-4a68-afe9-fc491b31e8a9 could not be found. Aug 10 23:15:49.504042 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:15:49.504042 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:15:49.504042 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:15:49.504042 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:15:49.504042 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:15:49.504042 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:15:49.504042 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:15:49.504042 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:15:49.504042 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da69cf1f-ff76-4a68-afe9-fc491b31e8a9 could not be found. Aug 10 23:15:49.504042 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:15:49.504042 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-a489040a-b110-4e91-9fb4-9902ee4b38ec tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Returning 404 to user: Instance da69cf1f-ff76-4a68-afe9-fc491b31e8a9 could not be found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:15:49.504042 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-a489040a-b110-4e91-9fb4-9902ee4b38ec tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "DELETE /compute/v2.1/servers/da69cf1f-ff76-4a68-afe9-fc491b31e8a9" status: 404 len: 111 microversion: 2.1 time: 0.076041 Aug 10 23:15:49.504042 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1936/4036] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:15:49 2022] DELETE /compute/v2.1/servers/da69cf1f-ff76-4a68-afe9-fc491b31e8a9 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:15:49.530975 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-69fd8362-d9c0-4601-8398-91c11099b8d2 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:49.536103 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-69fd8362-d9c0-4601-8398-91c11099b8d2 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: fa9dfd3a-a636-48ce-ae15-0ed51baee954] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:49.569182 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=10 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:15:49.575139 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-69fd8362-d9c0-4601-8398-91c11099b8d2 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:49.575657 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-69fd8362-d9c0-4601-8398-91c11099b8d2 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:49.576100 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-69fd8362-d9c0-4601-8398-91c11099b8d2 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:49.576818 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-69fd8362-d9c0-4601-8398-91c11099b8d2 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:49.577294 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-69fd8362-d9c0-4601-8398-91c11099b8d2 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:49.577704 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-69fd8362-d9c0-4601-8398-91c11099b8d2 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:49.679882 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-b1bd3a41-dc73-47e3-8c14-839ed7c80648 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5899b2ad9f1046caaf7c6073e408eeee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25abd63376614081a9d484f3c9ae950d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:49.693731 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-b1bd3a41-dc73-47e3-8c14-839ed7c80648 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "GET /compute/v2.1/servers/250395b5-5be8-420a-8709-dcf8b4241a4e" status: 200 len: 1392 microversion: 2.1 time: 0.218812 Aug 10 23:15:49.700213 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2101/4037] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:49 2022] GET /compute/v2.1/servers/250395b5-5be8-420a-8709-dcf8b4241a4e => generated 1392 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:49.716883 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-07b59fd4-e893-41a3-8133-7c292f063d9d tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:49.717521 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-07b59fd4-e893-41a3-8133-7c292f063d9d tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: da69cf1f-ff76-4a68-afe9-fc491b31e8a9] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:49.732087 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-07b59fd4-e893-41a3-8133-7c292f063d9d tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:49.734357 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-07b59fd4-e893-41a3-8133-7c292f063d9d tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:49.735122 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-07b59fd4-e893-41a3-8133-7c292f063d9d tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:49.736370 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-07b59fd4-e893-41a3-8133-7c292f063d9d tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:49.739569 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-07b59fd4-e893-41a3-8133-7c292f063d9d tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:49.741369 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-07b59fd4-e893-41a3-8133-7c292f063d9d tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:49.777534 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-07b59fd4-e893-41a3-8133-7c292f063d9d tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] HTTP exception thrown: Instance da69cf1f-ff76-4a68-afe9-fc491b31e8a9 could not be found. Aug 10 23:15:49.783383 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-07b59fd4-e893-41a3-8133-7c292f063d9d tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Request method failure captured: Aug 10 23:15:49.783383 n-d-850468-14 devstack@n-api.service[122633]: request: GET /compute/v2.1/servers/da69cf1f-ff76-4a68-afe9-fc491b31e8a9 HTTP/1.1 Aug 10 23:15:49.783383 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:15:49.783383 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:15:49.783383 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:15:49.783383 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:15:49.783383 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:15:49.783383 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:15:49.783383 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:15:49.783383 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:15:49.783383 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9Drr3r82npWIkz1ccNiKcah17mvrMR2EU4HCxqxnaGEEIkGANcRcrX2nHMsvmCLf0usmykCLye_MMWubAbqGw1RDJdO9uNXXKIzwnkO3-8RDYkeEsX4dAb-XLWqGpnC4lB_RQ_yXrj9zJ0yoaNBALi5oi6cnoUgwIrYxNetinerHaU0 Aug 10 23:15:49.783383 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:15:49.783383 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:15:49.783383 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:15:49.783383 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:15:49.783383 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:15:49.783383 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:15:49.783383 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 7d90f8a58ad047fa8f347d6474e4d673 Aug 10 23:15:49.783383 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-DeleteServersTestJSON-311075827 Aug 10 23:15:49.783383 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:15:49.783383 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:15:49.783383 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7d90f8a58ad047fa8f347d6474e4d673"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7d90f8a58ad047fa8f347d6474e4d673"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7d90f8a58ad047fa8f347d6474e4d673"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7d90f8a58ad047fa8f347d6474e4d673", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:15:49.783383 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-DeleteServersTestJSON-311075827 Aug 10 23:15:49.783383 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 7d90f8a58ad047fa8f347d6474e4d673 Aug 10 23:15:49.783383 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-DeleteServersTestJSON-311075827 Aug 10 23:15:49.783383 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-DeleteServersTestJSON-311075827-project Aug 10 23:15:49.783383 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:15:49.783383 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:15:49.783383 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 3c6160c7a42740efbe3613380933fa15 Aug 10 23:15:49.783383 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-DeleteServersTestJSON-311075827-project Aug 10 23:15:49.783383 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:15:49.783383 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance da69cf1f-ff76-4a68-afe9-fc491b31e8a9 could not be found. Aug 10 23:15:49.783383 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': 'da69cf1f-ff76-4a68-afe9-fc491b31e8a9'} Aug 10 23:15:49.783383 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:15:49.783383 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:15:49.783383 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:15:49.783383 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:15:49.783383 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:15:49.783383 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:15:49.783383 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:15:49.783383 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:15:49.783383 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:15:49.783383 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:15:49.783383 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da69cf1f-ff76-4a68-afe9-fc491b31e8a9 could not be found. Aug 10 23:15:49.783383 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:15:49.783383 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:15:49.783383 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:15:49.783383 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:15:49.783383 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:15:49.783383 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:15:49.783383 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:15:49.783383 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:15:49.783383 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:15:49.783383 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:15:49.783383 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:15:49.783383 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:15:49.783383 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:15:49.783383 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:15:49.783383 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:15:49.783383 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:15:49.783383 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da69cf1f-ff76-4a68-afe9-fc491b31e8a9 could not be found. Aug 10 23:15:49.783383 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:15:49.783383 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:15:49.783383 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:15:49.790161 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:15:49.790161 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:15:49.790161 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:15:49.790161 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:15:49.790161 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:15:49.790161 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da69cf1f-ff76-4a68-afe9-fc491b31e8a9 could not be found. Aug 10 23:15:49.790161 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:15:49.795506 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-07b59fd4-e893-41a3-8133-7c292f063d9d tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Returning 404 to user: Instance da69cf1f-ff76-4a68-afe9-fc491b31e8a9 could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:15:49.796694 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-07b59fd4-e893-41a3-8133-7c292f063d9d tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "GET /compute/v2.1/servers/da69cf1f-ff76-4a68-afe9-fc491b31e8a9" status: 404 len: 111 microversion: 2.1 time: 0.095017 Aug 10 23:15:49.799040 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2102/4038] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:49 2022] GET /compute/v2.1/servers/da69cf1f-ff76-4a68-afe9-fc491b31e8a9 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:15:49.812150 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-a3b381c0-f50b-490b-89ea-4b534ee87e5e tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:49.813289 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-a3b381c0-f50b-490b-89ea-4b534ee87e5e tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: 018fdc62-66af-42a9-b97a-b3c1bb37b04a] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:49.830253 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a3b381c0-f50b-490b-89ea-4b534ee87e5e tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:49.831724 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a3b381c0-f50b-490b-89ea-4b534ee87e5e tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:49.834643 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a3b381c0-f50b-490b-89ea-4b534ee87e5e tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:49.836293 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a3b381c0-f50b-490b-89ea-4b534ee87e5e tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:49.838510 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a3b381c0-f50b-490b-89ea-4b534ee87e5e tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:49.840618 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a3b381c0-f50b-490b-89ea-4b534ee87e5e tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:49.881340 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-a3b381c0-f50b-490b-89ea-4b534ee87e5e tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] HTTP exception thrown: Instance 018fdc62-66af-42a9-b97a-b3c1bb37b04a could not be found. Aug 10 23:15:49.888964 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-a3b381c0-f50b-490b-89ea-4b534ee87e5e tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Request method failure captured: Aug 10 23:15:49.888964 n-d-850468-14 devstack@n-api.service[122633]: request: DELETE /compute/v2.1/servers/018fdc62-66af-42a9-b97a-b3c1bb37b04a HTTP/1.1 Aug 10 23:15:49.888964 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:15:49.888964 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:15:49.888964 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:15:49.888964 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:15:49.888964 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:15:49.888964 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:15:49.888964 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:15:49.888964 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:15:49.888964 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9Drr3r82npWIkz1ccNiKcah17mvrMR2EU4HCxqxnaGEEIkGANcRcrX2nHMsvmCLf0usmykCLye_MMWubAbqGw1RDJdO9uNXXKIzwnkO3-8RDYkeEsX4dAb-XLWqGpnC4lB_RQ_yXrj9zJ0yoaNBALi5oi6cnoUgwIrYxNetinerHaU0 Aug 10 23:15:49.888964 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:15:49.888964 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:15:49.888964 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:15:49.888964 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:15:49.888964 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:15:49.888964 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:15:49.888964 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 7d90f8a58ad047fa8f347d6474e4d673 Aug 10 23:15:49.888964 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-DeleteServersTestJSON-311075827 Aug 10 23:15:49.888964 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:15:49.888964 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:15:49.888964 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7d90f8a58ad047fa8f347d6474e4d673"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7d90f8a58ad047fa8f347d6474e4d673"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7d90f8a58ad047fa8f347d6474e4d673"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7d90f8a58ad047fa8f347d6474e4d673", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:15:49.888964 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-DeleteServersTestJSON-311075827 Aug 10 23:15:49.888964 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 7d90f8a58ad047fa8f347d6474e4d673 Aug 10 23:15:49.888964 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-DeleteServersTestJSON-311075827 Aug 10 23:15:49.888964 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-DeleteServersTestJSON-311075827-project Aug 10 23:15:49.888964 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:15:49.888964 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:15:49.888964 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 3c6160c7a42740efbe3613380933fa15 Aug 10 23:15:49.888964 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-DeleteServersTestJSON-311075827-project Aug 10 23:15:49.888964 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:15:49.888964 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance 018fdc62-66af-42a9-b97a-b3c1bb37b04a could not be found. Aug 10 23:15:49.888964 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': '018fdc62-66af-42a9-b97a-b3c1bb37b04a'} Aug 10 23:15:49.888964 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:15:49.888964 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:15:49.888964 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:15:49.888964 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:15:49.888964 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:15:49.888964 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:15:49.888964 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:15:49.888964 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:15:49.888964 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:15:49.888964 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:15:49.888964 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 018fdc62-66af-42a9-b97a-b3c1bb37b04a could not be found. Aug 10 23:15:49.888964 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:15:49.888964 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:15:49.888964 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:15:49.888964 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:15:49.888964 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:15:49.888964 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:15:49.888964 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:15:49.888964 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:15:49.888964 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:15:49.888964 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:15:49.888964 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 23:15:49.888964 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 23:15:49.888964 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 23:15:49.888964 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 23:15:49.888964 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:15:49.888964 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:15:49.888964 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:15:49.888964 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:15:49.893400 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 018fdc62-66af-42a9-b97a-b3c1bb37b04a could not be found. Aug 10 23:15:49.893400 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:15:49.893400 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:15:49.893400 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:15:49.893400 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:15:49.893400 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:15:49.893400 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:15:49.893400 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:15:49.893400 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:15:49.893400 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 018fdc62-66af-42a9-b97a-b3c1bb37b04a could not be found. Aug 10 23:15:49.893400 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:15:49.896619 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-a3b381c0-f50b-490b-89ea-4b534ee87e5e tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Returning 404 to user: Instance 018fdc62-66af-42a9-b97a-b3c1bb37b04a could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:15:49.902076 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-a3b381c0-f50b-490b-89ea-4b534ee87e5e tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "DELETE /compute/v2.1/servers/018fdc62-66af-42a9-b97a-b3c1bb37b04a" status: 404 len: 111 microversion: 2.1 time: 0.096490 Aug 10 23:15:49.907790 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2103/4039] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:15:49 2022] DELETE /compute/v2.1/servers/018fdc62-66af-42a9-b97a-b3c1bb37b04a => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:15:49.917303 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c2ef5879-0ca7-4e4a-9015-e6af3599b751 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:49.918224 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-c2ef5879-0ca7-4e4a-9015-e6af3599b751 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: 018fdc62-66af-42a9-b97a-b3c1bb37b04a] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:49.922768 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-69fd8362-d9c0-4601-8398-91c11099b8d2 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:49.925739 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c2ef5879-0ca7-4e4a-9015-e6af3599b751 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:49.929392 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c2ef5879-0ca7-4e4a-9015-e6af3599b751 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:49.932631 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c2ef5879-0ca7-4e4a-9015-e6af3599b751 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:49.949350 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-69fd8362-d9c0-4601-8398-91c11099b8d2 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954" status: 200 len: 1667 microversion: 2.1 time: 0.422661 Aug 10 23:15:49.951077 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1937/4040] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:49 2022] GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954 => generated 1667 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:49.952076 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c2ef5879-0ca7-4e4a-9015-e6af3599b751 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:49.954572 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c2ef5879-0ca7-4e4a-9015-e6af3599b751 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:49.955170 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c2ef5879-0ca7-4e4a-9015-e6af3599b751 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:49.977466 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-5c279f7d-69b3-4b26-90f2-249d7099564f tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:49.979839 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-5c279f7d-69b3-4b26-90f2-249d7099564f tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: fa9dfd3a-a636-48ce-ae15-0ed51baee954] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:49.994669 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-c2ef5879-0ca7-4e4a-9015-e6af3599b751 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] HTTP exception thrown: Instance 018fdc62-66af-42a9-b97a-b3c1bb37b04a could not be found. Aug 10 23:15:49.996001 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5c279f7d-69b3-4b26-90f2-249d7099564f tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:49.996816 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5c279f7d-69b3-4b26-90f2-249d7099564f tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:49.997515 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5c279f7d-69b3-4b26-90f2-249d7099564f tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:50.000775 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c2ef5879-0ca7-4e4a-9015-e6af3599b751 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Request method failure captured: Aug 10 23:15:50.000775 n-d-850468-14 devstack@n-api.service[122633]: request: GET /compute/v2.1/servers/018fdc62-66af-42a9-b97a-b3c1bb37b04a HTTP/1.1 Aug 10 23:15:50.000775 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:15:50.000775 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:15:50.000775 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:15:50.000775 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:15:50.000775 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:15:50.000775 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:15:50.000775 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:15:50.000775 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:15:50.000775 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9Drr3r82npWIkz1ccNiKcah17mvrMR2EU4HCxqxnaGEEIkGANcRcrX2nHMsvmCLf0usmykCLye_MMWubAbqGw1RDJdO9uNXXKIzwnkO3-8RDYkeEsX4dAb-XLWqGpnC4lB_RQ_yXrj9zJ0yoaNBALi5oi6cnoUgwIrYxNetinerHaU0 Aug 10 23:15:50.000775 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:15:50.000775 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:15:50.000775 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:15:50.000775 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:15:50.000775 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:15:50.000775 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:15:50.000775 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 7d90f8a58ad047fa8f347d6474e4d673 Aug 10 23:15:50.000775 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-DeleteServersTestJSON-311075827 Aug 10 23:15:50.000775 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:15:50.000775 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:15:50.000775 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7d90f8a58ad047fa8f347d6474e4d673"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7d90f8a58ad047fa8f347d6474e4d673"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7d90f8a58ad047fa8f347d6474e4d673"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7d90f8a58ad047fa8f347d6474e4d673", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:15:50.000775 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-DeleteServersTestJSON-311075827 Aug 10 23:15:50.000775 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 7d90f8a58ad047fa8f347d6474e4d673 Aug 10 23:15:50.000775 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-DeleteServersTestJSON-311075827 Aug 10 23:15:50.000775 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-DeleteServersTestJSON-311075827-project Aug 10 23:15:50.000775 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:15:50.000775 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:15:50.000775 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 3c6160c7a42740efbe3613380933fa15 Aug 10 23:15:50.000775 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-DeleteServersTestJSON-311075827-project Aug 10 23:15:50.000775 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:15:50.000775 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance 018fdc62-66af-42a9-b97a-b3c1bb37b04a could not be found. Aug 10 23:15:50.000775 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': '018fdc62-66af-42a9-b97a-b3c1bb37b04a'} Aug 10 23:15:50.000775 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:15:50.000775 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:15:50.000775 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:15:50.000775 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:15:50.000775 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:15:50.000775 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:15:50.000775 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:15:50.000775 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:15:50.000775 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:15:50.000775 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:15:50.000775 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 018fdc62-66af-42a9-b97a-b3c1bb37b04a could not be found. Aug 10 23:15:50.000775 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:15:50.000775 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:15:50.000775 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:15:50.000775 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:15:50.000775 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:15:50.000775 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:15:50.000775 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:15:50.000775 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:15:50.000775 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:15:50.000775 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:15:50.000775 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:15:50.000775 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:15:50.000775 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:15:50.000775 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:15:50.000775 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:15:50.000775 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:15:50.000775 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 018fdc62-66af-42a9-b97a-b3c1bb37b04a could not be found. Aug 10 23:15:50.000775 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:15:50.000775 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:15:50.000775 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:15:50.009697 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:15:50.009697 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:15:50.009697 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:15:50.009697 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:15:50.009697 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:15:50.009697 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 018fdc62-66af-42a9-b97a-b3c1bb37b04a could not be found. Aug 10 23:15:50.009697 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:15:50.009697 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c2ef5879-0ca7-4e4a-9015-e6af3599b751 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Returning 404 to user: Instance 018fdc62-66af-42a9-b97a-b3c1bb37b04a could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:15:50.009697 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-c2ef5879-0ca7-4e4a-9015-e6af3599b751 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "GET /compute/v2.1/servers/018fdc62-66af-42a9-b97a-b3c1bb37b04a" status: 404 len: 111 microversion: 2.1 time: 0.089751 Aug 10 23:15:50.010249 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5c279f7d-69b3-4b26-90f2-249d7099564f tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:50.010249 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5c279f7d-69b3-4b26-90f2-249d7099564f tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:50.011710 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2104/4041] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:49 2022] GET /compute/v2.1/servers/018fdc62-66af-42a9-b97a-b3c1bb37b04a => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:15:50.015747 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5c279f7d-69b3-4b26-90f2-249d7099564f tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:50.028993 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-e6325e73-0bf0-41e9-ab25-74f3fe8c24d3 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:50.030625 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-e6325e73-0bf0-41e9-ab25-74f3fe8c24d3 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: 2c366301-48bf-4dbe-a779-7ed93d827dbd] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:50.080979 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-e6325e73-0bf0-41e9-ab25-74f3fe8c24d3 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] HTTP exception thrown: Instance 2c366301-48bf-4dbe-a779-7ed93d827dbd could not be found. Aug 10 23:15:50.084097 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-e6325e73-0bf0-41e9-ab25-74f3fe8c24d3 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Request method failure captured: Aug 10 23:15:50.084097 n-d-850468-14 devstack@n-api.service[122633]: request: DELETE /compute/v2.1/servers/2c366301-48bf-4dbe-a779-7ed93d827dbd HTTP/1.1 Aug 10 23:15:50.084097 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:15:50.084097 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:15:50.084097 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:15:50.084097 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:15:50.084097 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:15:50.084097 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:15:50.084097 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:15:50.084097 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:15:50.084097 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9Drr3r82npWIkz1ccNiKcah17mvrMR2EU4HCxqxnaGEEIkGANcRcrX2nHMsvmCLf0usmykCLye_MMWubAbqGw1RDJdO9uNXXKIzwnkO3-8RDYkeEsX4dAb-XLWqGpnC4lB_RQ_yXrj9zJ0yoaNBALi5oi6cnoUgwIrYxNetinerHaU0 Aug 10 23:15:50.084097 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:15:50.084097 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:15:50.084097 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:15:50.084097 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:15:50.084097 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:15:50.084097 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:15:50.084097 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 7d90f8a58ad047fa8f347d6474e4d673 Aug 10 23:15:50.084097 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-DeleteServersTestJSON-311075827 Aug 10 23:15:50.084097 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:15:50.084097 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:15:50.084097 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7d90f8a58ad047fa8f347d6474e4d673"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7d90f8a58ad047fa8f347d6474e4d673"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7d90f8a58ad047fa8f347d6474e4d673"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7d90f8a58ad047fa8f347d6474e4d673", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:15:50.084097 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-DeleteServersTestJSON-311075827 Aug 10 23:15:50.084097 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 7d90f8a58ad047fa8f347d6474e4d673 Aug 10 23:15:50.084097 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-DeleteServersTestJSON-311075827 Aug 10 23:15:50.084097 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-DeleteServersTestJSON-311075827-project Aug 10 23:15:50.084097 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:15:50.084097 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:15:50.084097 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 3c6160c7a42740efbe3613380933fa15 Aug 10 23:15:50.084097 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-DeleteServersTestJSON-311075827-project Aug 10 23:15:50.084097 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:15:50.084097 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance 2c366301-48bf-4dbe-a779-7ed93d827dbd could not be found. Aug 10 23:15:50.084097 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': '2c366301-48bf-4dbe-a779-7ed93d827dbd'} Aug 10 23:15:50.084097 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:15:50.084097 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:15:50.084097 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:15:50.084097 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:15:50.084097 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:15:50.084097 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:15:50.084097 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 10 23:15:50.084097 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 10 23:15:50.084097 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c366301-48bf-4dbe-a779-7ed93d827dbd could not be found. Aug 10 23:15:50.084097 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:15:50.084097 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:15:50.084097 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:15:50.084097 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:15:50.084097 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:15:50.084097 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:15:50.084097 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:15:50.084097 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:15:50.084097 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:15:50.084097 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:15:50.084097 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 23:15:50.084097 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 23:15:50.084097 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 23:15:50.084097 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 23:15:50.084097 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:15:50.084097 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:15:50.084097 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:15:50.084097 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:15:50.084097 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c366301-48bf-4dbe-a779-7ed93d827dbd could not be found. Aug 10 23:15:50.084097 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:15:50.084097 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:15:50.084097 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:15:50.088023 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:15:50.088023 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:15:50.088023 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:15:50.088023 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:15:50.088023 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:15:50.088023 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c366301-48bf-4dbe-a779-7ed93d827dbd could not be found. Aug 10 23:15:50.088023 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:15:50.088023 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-e6325e73-0bf0-41e9-ab25-74f3fe8c24d3 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Returning 404 to user: Instance 2c366301-48bf-4dbe-a779-7ed93d827dbd could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:15:50.096228 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-e6325e73-0bf0-41e9-ab25-74f3fe8c24d3 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "DELETE /compute/v2.1/servers/2c366301-48bf-4dbe-a779-7ed93d827dbd" status: 404 len: 111 microversion: 2.1 time: 0.082885 Aug 10 23:15:50.112500 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2105/4042] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:15:50 2022] DELETE /compute/v2.1/servers/2c366301-48bf-4dbe-a779-7ed93d827dbd => generated 111 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:15:50.120817 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-20a9308e-ee3e-497d-99a5-d047b9fabee0 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:50.133250 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-20a9308e-ee3e-497d-99a5-d047b9fabee0 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] [instance: fdd1f85d-95db-477c-a173-a6fca94f58b1] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:50.165049 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-20a9308e-ee3e-497d-99a5-d047b9fabee0 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:50.167851 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-20a9308e-ee3e-497d-99a5-d047b9fabee0 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:50.168673 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-20a9308e-ee3e-497d-99a5-d047b9fabee0 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:50.174664 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-20a9308e-ee3e-497d-99a5-d047b9fabee0 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:50.175562 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-20a9308e-ee3e-497d-99a5-d047b9fabee0 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:50.176261 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-20a9308e-ee3e-497d-99a5-d047b9fabee0 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:50.370142 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-5c279f7d-69b3-4b26-90f2-249d7099564f tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:50.381577 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-5c279f7d-69b3-4b26-90f2-249d7099564f tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954" status: 200 len: 1667 microversion: 2.1 time: 0.413061 Aug 10 23:15:50.382837 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1938/4043] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:49 2022] GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954 => generated 1667 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:15:50.388233 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-3f96bbd2-b8c0-4163-bdfc-0fe5530d5713 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:50.389739 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-3f96bbd2-b8c0-4163-bdfc-0fe5530d5713 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] [instance: 27dd09d6-47ed-4b55-bd02-baad36a28429] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:50.397412 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3f96bbd2-b8c0-4163-bdfc-0fe5530d5713 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:50.398308 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3f96bbd2-b8c0-4163-bdfc-0fe5530d5713 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:50.399161 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3f96bbd2-b8c0-4163-bdfc-0fe5530d5713 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:50.400149 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3f96bbd2-b8c0-4163-bdfc-0fe5530d5713 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:50.403441 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3f96bbd2-b8c0-4163-bdfc-0fe5530d5713 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:50.404202 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3f96bbd2-b8c0-4163-bdfc-0fe5530d5713 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:50.618178 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-20a9308e-ee3e-497d-99a5-d047b9fabee0 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cc4167255044d29a70c12a5a44d800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578d8e62013d43c5ad4d9a6d92e1f201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:50.631271 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-20a9308e-ee3e-497d-99a5-d047b9fabee0 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] 10.222.0.58 "GET /compute/v2.1/servers/fdd1f85d-95db-477c-a173-a6fca94f58b1" status: 200 len: 1523 microversion: 2.1 time: 0.517142 Aug 10 23:15:50.636707 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2106/4044] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:50 2022] GET /compute/v2.1/servers/fdd1f85d-95db-477c-a173-a6fca94f58b1 => generated 1523 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:50.663959 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-e0dd0681-1c73-451b-ab35-340371c565e7 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:50.667769 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-e0dd0681-1c73-451b-ab35-340371c565e7 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: 2c366301-48bf-4dbe-a779-7ed93d827dbd] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:50.685343 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-e0dd0681-1c73-451b-ab35-340371c565e7 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] HTTP exception thrown: Instance 2c366301-48bf-4dbe-a779-7ed93d827dbd could not be found. Aug 10 23:15:50.687329 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-e0dd0681-1c73-451b-ab35-340371c565e7 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Request method failure captured: Aug 10 23:15:50.687329 n-d-850468-14 devstack@n-api.service[122633]: request: GET /compute/v2.1/servers/2c366301-48bf-4dbe-a779-7ed93d827dbd HTTP/1.1 Aug 10 23:15:50.687329 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:15:50.687329 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:15:50.687329 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:15:50.687329 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:15:50.687329 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:15:50.687329 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:15:50.687329 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:15:50.687329 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:15:50.687329 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9Drr3r82npWIkz1ccNiKcah17mvrMR2EU4HCxqxnaGEEIkGANcRcrX2nHMsvmCLf0usmykCLye_MMWubAbqGw1RDJdO9uNXXKIzwnkO3-8RDYkeEsX4dAb-XLWqGpnC4lB_RQ_yXrj9zJ0yoaNBALi5oi6cnoUgwIrYxNetinerHaU0 Aug 10 23:15:50.687329 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:15:50.687329 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:15:50.687329 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:15:50.687329 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:15:50.687329 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:15:50.687329 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:15:50.687329 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 7d90f8a58ad047fa8f347d6474e4d673 Aug 10 23:15:50.687329 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-DeleteServersTestJSON-311075827 Aug 10 23:15:50.687329 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:15:50.687329 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:15:50.687329 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7d90f8a58ad047fa8f347d6474e4d673"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7d90f8a58ad047fa8f347d6474e4d673"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7d90f8a58ad047fa8f347d6474e4d673"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7d90f8a58ad047fa8f347d6474e4d673", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:15:50.687329 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-DeleteServersTestJSON-311075827 Aug 10 23:15:50.687329 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 7d90f8a58ad047fa8f347d6474e4d673 Aug 10 23:15:50.687329 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-DeleteServersTestJSON-311075827 Aug 10 23:15:50.687329 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-DeleteServersTestJSON-311075827-project Aug 10 23:15:50.687329 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:15:50.687329 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:15:50.687329 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 3c6160c7a42740efbe3613380933fa15 Aug 10 23:15:50.687329 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-DeleteServersTestJSON-311075827-project Aug 10 23:15:50.687329 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:15:50.687329 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance 2c366301-48bf-4dbe-a779-7ed93d827dbd could not be found. Aug 10 23:15:50.687329 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': '2c366301-48bf-4dbe-a779-7ed93d827dbd'} Aug 10 23:15:50.687329 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:15:50.687329 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:15:50.687329 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:15:50.687329 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:15:50.687329 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:15:50.687329 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:15:50.687329 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 10 23:15:50.687329 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 10 23:15:50.687329 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c366301-48bf-4dbe-a779-7ed93d827dbd could not be found. Aug 10 23:15:50.687329 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:15:50.687329 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:15:50.687329 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:15:50.687329 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:15:50.687329 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:15:50.687329 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:15:50.687329 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:15:50.687329 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:15:50.687329 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:15:50.687329 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:15:50.687329 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:15:50.687329 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:15:50.687329 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:15:50.687329 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:15:50.687329 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:15:50.687329 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:15:50.687329 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c366301-48bf-4dbe-a779-7ed93d827dbd could not be found. Aug 10 23:15:50.687329 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:15:50.687329 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:15:50.687329 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:15:50.687329 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:15:50.687329 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:15:50.692820 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:15:50.692820 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:15:50.692820 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:15:50.692820 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c366301-48bf-4dbe-a779-7ed93d827dbd could not be found. Aug 10 23:15:50.692820 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:15:50.695328 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-e0dd0681-1c73-451b-ab35-340371c565e7 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Returning 404 to user: Instance 2c366301-48bf-4dbe-a779-7ed93d827dbd could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:15:50.698629 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-e0dd0681-1c73-451b-ab35-340371c565e7 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "GET /compute/v2.1/servers/2c366301-48bf-4dbe-a779-7ed93d827dbd" status: 404 len: 111 microversion: 2.1 time: 0.060663 Aug 10 23:15:50.702247 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2107/4045] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:50 2022] GET /compute/v2.1/servers/2c366301-48bf-4dbe-a779-7ed93d827dbd => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:15:50.711885 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-9aba0cd2-ba3d-4df6-8659-b963c46abaa6 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:50.712597 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-9aba0cd2-ba3d-4df6-8659-b963c46abaa6 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: fa9dfd3a-a636-48ce-ae15-0ed51baee954] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:50.729692 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-3f96bbd2-b8c0-4163-bdfc-0fe5530d5713 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07c94ebf0954cdea12b9a689538d96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395d7c4077e54c43bb95288db3942b0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:50.739356 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-3f96bbd2-b8c0-4163-bdfc-0fe5530d5713 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] 10.222.0.58 "GET /compute/v2.1/servers/27dd09d6-47ed-4b55-bd02-baad36a28429" status: 200 len: 1521 microversion: 2.1 time: 0.355055 Aug 10 23:15:50.746175 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9aba0cd2-ba3d-4df6-8659-b963c46abaa6 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:50.747819 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1939/4046] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:50 2022] GET /compute/v2.1/servers/27dd09d6-47ed-4b55-bd02-baad36a28429 => generated 1521 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:50.748460 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9aba0cd2-ba3d-4df6-8659-b963c46abaa6 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:50.749054 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9aba0cd2-ba3d-4df6-8659-b963c46abaa6 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:50.750080 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9aba0cd2-ba3d-4df6-8659-b963c46abaa6 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:50.751351 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9aba0cd2-ba3d-4df6-8659-b963c46abaa6 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:50.752031 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9aba0cd2-ba3d-4df6-8659-b963c46abaa6 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:50.786058 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-7e8df72a-8124-450a-bc80-401a32b0e8c4 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:50.795873 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-7e8df72a-8124-450a-bc80-401a32b0e8c4 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:50.831921 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7e8df72a-8124-450a-bc80-401a32b0e8c4 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:50.832343 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7e8df72a-8124-450a-bc80-401a32b0e8c4 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:50.843521 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7e8df72a-8124-450a-bc80-401a32b0e8c4 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:50.844883 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7e8df72a-8124-450a-bc80-401a32b0e8c4 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:50.845901 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7e8df72a-8124-450a-bc80-401a32b0e8c4 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:50.846666 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7e8df72a-8124-450a-bc80-401a32b0e8c4 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:51.187103 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-9aba0cd2-ba3d-4df6-8659-b963c46abaa6 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:51.199849 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-9aba0cd2-ba3d-4df6-8659-b963c46abaa6 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954" status: 200 len: 1667 microversion: 2.1 time: 0.496127 Aug 10 23:15:51.203515 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2108/4047] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:50 2022] GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954 => generated 1667 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:51.215951 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-d24f2894-25c9-400b-b53d-588469317734 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:51.217024 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-d24f2894-25c9-400b-b53d-588469317734 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] [instance: 250395b5-5be8-420a-8709-dcf8b4241a4e] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:51.234375 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d24f2894-25c9-400b-b53d-588469317734 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:51.235218 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d24f2894-25c9-400b-b53d-588469317734 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:51.235888 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d24f2894-25c9-400b-b53d-588469317734 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:51.243115 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d24f2894-25c9-400b-b53d-588469317734 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:51.243735 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d24f2894-25c9-400b-b53d-588469317734 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:51.244376 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d24f2894-25c9-400b-b53d-588469317734 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:51.384886 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-7e8df72a-8124-450a-bc80-401a32b0e8c4 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:51.392731 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-7e8df72a-8124-450a-bc80-401a32b0e8c4 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b" status: 200 len: 1528 microversion: 2.1 time: 0.630007 Aug 10 23:15:51.393318 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1940/4048] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:50 2022] GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b => generated 1528 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:51.422968 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-8f5a45b0-8c30-46e6-8437-e17e9c1113c3 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:51.423611 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-8f5a45b0-8c30-46e6-8437-e17e9c1113c3 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: fa9dfd3a-a636-48ce-ae15-0ed51baee954] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:51.435023 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8f5a45b0-8c30-46e6-8437-e17e9c1113c3 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:51.435792 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8f5a45b0-8c30-46e6-8437-e17e9c1113c3 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:51.436423 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8f5a45b0-8c30-46e6-8437-e17e9c1113c3 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:51.447477 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8f5a45b0-8c30-46e6-8437-e17e9c1113c3 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:51.454412 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8f5a45b0-8c30-46e6-8437-e17e9c1113c3 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:51.455175 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8f5a45b0-8c30-46e6-8437-e17e9c1113c3 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:51.462902 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=4 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:15:51.669304 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-d24f2894-25c9-400b-b53d-588469317734 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5899b2ad9f1046caaf7c6073e408eeee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25abd63376614081a9d484f3c9ae950d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:51.680688 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-d24f2894-25c9-400b-b53d-588469317734 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "GET /compute/v2.1/servers/250395b5-5be8-420a-8709-dcf8b4241a4e" status: 200 len: 1392 microversion: 2.1 time: 0.475831 Aug 10 23:15:51.693382 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2109/4049] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:51 2022] GET /compute/v2.1/servers/250395b5-5be8-420a-8709-dcf8b4241a4e => generated 1392 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:51.700034 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-3694c3f1-871f-486e-a87e-9243eb781e71 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:51.701684 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-3694c3f1-871f-486e-a87e-9243eb781e71 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] [instance: fdd1f85d-95db-477c-a173-a6fca94f58b1] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:51.714461 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3694c3f1-871f-486e-a87e-9243eb781e71 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:51.716091 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3694c3f1-871f-486e-a87e-9243eb781e71 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:51.717436 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3694c3f1-871f-486e-a87e-9243eb781e71 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:51.718799 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3694c3f1-871f-486e-a87e-9243eb781e71 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:51.720093 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3694c3f1-871f-486e-a87e-9243eb781e71 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:51.720792 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3694c3f1-871f-486e-a87e-9243eb781e71 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:52.000105 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-8f5a45b0-8c30-46e6-8437-e17e9c1113c3 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:52.011291 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-8f5a45b0-8c30-46e6-8437-e17e9c1113c3 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954" status: 200 len: 1667 microversion: 2.1 time: 0.592366 Aug 10 23:15:52.012163 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1941/4050] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:51 2022] GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954 => generated 1667 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:52.037585 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-ce7af21f-ba8f-4699-b8d7-2660cc4afd10 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:52.038304 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-ce7af21f-ba8f-4699-b8d7-2660cc4afd10 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] [instance: 27dd09d6-47ed-4b55-bd02-baad36a28429] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:52.071448 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ce7af21f-ba8f-4699-b8d7-2660cc4afd10 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:52.072208 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ce7af21f-ba8f-4699-b8d7-2660cc4afd10 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:52.072964 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ce7af21f-ba8f-4699-b8d7-2660cc4afd10 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:52.076691 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ce7af21f-ba8f-4699-b8d7-2660cc4afd10 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:52.077449 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ce7af21f-ba8f-4699-b8d7-2660cc4afd10 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:52.078982 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ce7af21f-ba8f-4699-b8d7-2660cc4afd10 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:52.385122 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-ce7af21f-ba8f-4699-b8d7-2660cc4afd10 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07c94ebf0954cdea12b9a689538d96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395d7c4077e54c43bb95288db3942b0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:52.395423 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-ce7af21f-ba8f-4699-b8d7-2660cc4afd10 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] 10.222.0.58 "GET /compute/v2.1/servers/27dd09d6-47ed-4b55-bd02-baad36a28429" status: 200 len: 1521 microversion: 2.1 time: 0.374093 Aug 10 23:15:52.404838 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1942/4051] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:52 2022] GET /compute/v2.1/servers/27dd09d6-47ed-4b55-bd02-baad36a28429 => generated 1521 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:52.420299 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-400087d0-aaf3-42e6-930d-c38597a7340e tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:52.421078 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-3694c3f1-871f-486e-a87e-9243eb781e71 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cc4167255044d29a70c12a5a44d800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578d8e62013d43c5ad4d9a6d92e1f201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:52.431096 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-400087d0-aaf3-42e6-930d-c38597a7340e tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:52.433106 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-3694c3f1-871f-486e-a87e-9243eb781e71 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] 10.222.0.58 "GET /compute/v2.1/servers/fdd1f85d-95db-477c-a173-a6fca94f58b1" status: 200 len: 1523 microversion: 2.1 time: 0.737578 Aug 10 23:15:52.454280 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2110/4052] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:51 2022] GET /compute/v2.1/servers/fdd1f85d-95db-477c-a173-a6fca94f58b1 => generated 1523 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:52.461692 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-400087d0-aaf3-42e6-930d-c38597a7340e tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:52.463595 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-400087d0-aaf3-42e6-930d-c38597a7340e tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:52.469976 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-400087d0-aaf3-42e6-930d-c38597a7340e tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:52.474544 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-400087d0-aaf3-42e6-930d-c38597a7340e tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:52.476800 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-400087d0-aaf3-42e6-930d-c38597a7340e tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:52.480053 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-400087d0-aaf3-42e6-930d-c38597a7340e tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:52.704204 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-0ec9ece8-947d-4ad1-a275-7d1115a433f1 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:52.705609 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-0ec9ece8-947d-4ad1-a275-7d1115a433f1 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] [instance: 250395b5-5be8-420a-8709-dcf8b4241a4e] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:52.726107 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0ec9ece8-947d-4ad1-a275-7d1115a433f1 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:52.727142 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0ec9ece8-947d-4ad1-a275-7d1115a433f1 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:52.729414 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0ec9ece8-947d-4ad1-a275-7d1115a433f1 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:52.731798 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0ec9ece8-947d-4ad1-a275-7d1115a433f1 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:52.733912 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0ec9ece8-947d-4ad1-a275-7d1115a433f1 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:52.736526 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0ec9ece8-947d-4ad1-a275-7d1115a433f1 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:52.944471 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-400087d0-aaf3-42e6-930d-c38597a7340e tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:52.968643 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-400087d0-aaf3-42e6-930d-c38597a7340e tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b" status: 200 len: 1528 microversion: 2.1 time: 0.557698 Aug 10 23:15:52.975101 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1943/4053] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:52 2022] GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b => generated 1528 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:53.031560 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-0ec9ece8-947d-4ad1-a275-7d1115a433f1 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5899b2ad9f1046caaf7c6073e408eeee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25abd63376614081a9d484f3c9ae950d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:53.047408 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-0ec9ece8-947d-4ad1-a275-7d1115a433f1 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "GET /compute/v2.1/servers/250395b5-5be8-420a-8709-dcf8b4241a4e" status: 200 len: 1392 microversion: 2.1 time: 0.344332 Aug 10 23:15:53.063462 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2111/4054] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:52 2022] GET /compute/v2.1/servers/250395b5-5be8-420a-8709-dcf8b4241a4e => generated 1392 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:53.429155 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-95872804-56f1-463b-9941-77d1f72d9447 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:53.429837 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-95872804-56f1-463b-9941-77d1f72d9447 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] [instance: 27dd09d6-47ed-4b55-bd02-baad36a28429] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:53.450524 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-95872804-56f1-463b-9941-77d1f72d9447 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:53.452544 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-95872804-56f1-463b-9941-77d1f72d9447 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:53.454199 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-95872804-56f1-463b-9941-77d1f72d9447 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:53.454199 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-95872804-56f1-463b-9941-77d1f72d9447 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:53.455302 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-95872804-56f1-463b-9941-77d1f72d9447 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:53.455744 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-95872804-56f1-463b-9941-77d1f72d9447 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:53.462855 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-23f01465-340c-4079-bfd1-e87ef763dca8 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:53.463707 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-23f01465-340c-4079-bfd1-e87ef763dca8 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] [instance: fdd1f85d-95db-477c-a173-a6fca94f58b1] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:53.481990 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-23f01465-340c-4079-bfd1-e87ef763dca8 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:53.483039 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-23f01465-340c-4079-bfd1-e87ef763dca8 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:53.483708 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-23f01465-340c-4079-bfd1-e87ef763dca8 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:53.484825 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-23f01465-340c-4079-bfd1-e87ef763dca8 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:53.485553 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-23f01465-340c-4079-bfd1-e87ef763dca8 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:53.486283 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-23f01465-340c-4079-bfd1-e87ef763dca8 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:53.765011 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-95872804-56f1-463b-9941-77d1f72d9447 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07c94ebf0954cdea12b9a689538d96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395d7c4077e54c43bb95288db3942b0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:53.783846 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-95872804-56f1-463b-9941-77d1f72d9447 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] 10.222.0.58 "GET /compute/v2.1/servers/27dd09d6-47ed-4b55-bd02-baad36a28429" status: 200 len: 1521 microversion: 2.1 time: 0.359585 Aug 10 23:15:53.785009 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1944/4055] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:53 2022] GET /compute/v2.1/servers/27dd09d6-47ed-4b55-bd02-baad36a28429 => generated 1521 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:53.990935 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-8b3c0ea6-8933-4bf9-b9cb-b1ae4d1c8ed6 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:53.991710 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-8b3c0ea6-8933-4bf9-b9cb-b1ae4d1c8ed6 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:54.010369 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8b3c0ea6-8933-4bf9-b9cb-b1ae4d1c8ed6 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:54.011291 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8b3c0ea6-8933-4bf9-b9cb-b1ae4d1c8ed6 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:54.011961 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8b3c0ea6-8933-4bf9-b9cb-b1ae4d1c8ed6 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:54.024253 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8b3c0ea6-8933-4bf9-b9cb-b1ae4d1c8ed6 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:54.025176 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8b3c0ea6-8933-4bf9-b9cb-b1ae4d1c8ed6 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:54.028103 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8b3c0ea6-8933-4bf9-b9cb-b1ae4d1c8ed6 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:54.216208 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-23f01465-340c-4079-bfd1-e87ef763dca8 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cc4167255044d29a70c12a5a44d800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578d8e62013d43c5ad4d9a6d92e1f201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:54.235692 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-23f01465-340c-4079-bfd1-e87ef763dca8 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] 10.222.0.58 "GET /compute/v2.1/servers/fdd1f85d-95db-477c-a173-a6fca94f58b1" status: 200 len: 1523 microversion: 2.1 time: 0.777723 Aug 10 23:15:54.236288 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2112/4056] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:53 2022] GET /compute/v2.1/servers/fdd1f85d-95db-477c-a173-a6fca94f58b1 => generated 1523 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:54.250110 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-2b3d0f86-53ee-4853-a80b-6fc3817a7913 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:54.250719 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-2b3d0f86-53ee-4853-a80b-6fc3817a7913 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] [instance: 250395b5-5be8-420a-8709-dcf8b4241a4e] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:54.269815 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2b3d0f86-53ee-4853-a80b-6fc3817a7913 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:54.270592 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2b3d0f86-53ee-4853-a80b-6fc3817a7913 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:54.272775 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2b3d0f86-53ee-4853-a80b-6fc3817a7913 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:54.273565 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2b3d0f86-53ee-4853-a80b-6fc3817a7913 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:54.279406 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2b3d0f86-53ee-4853-a80b-6fc3817a7913 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:54.279874 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2b3d0f86-53ee-4853-a80b-6fc3817a7913 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:54.422504 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-8b3c0ea6-8933-4bf9-b9cb-b1ae4d1c8ed6 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:54.435295 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-8b3c0ea6-8933-4bf9-b9cb-b1ae4d1c8ed6 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b" status: 200 len: 1528 microversion: 2.1 time: 0.444245 Aug 10 23:15:54.437886 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1945/4057] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:53 2022] GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b => generated 1528 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:15:54.810229 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-d711b5e8-3aa1-4b8c-ae77-df8b690a142d tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:54.810896 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-d711b5e8-3aa1-4b8c-ae77-df8b690a142d tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] [instance: 27dd09d6-47ed-4b55-bd02-baad36a28429] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:54.824226 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d711b5e8-3aa1-4b8c-ae77-df8b690a142d tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:54.824729 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d711b5e8-3aa1-4b8c-ae77-df8b690a142d tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:54.825382 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d711b5e8-3aa1-4b8c-ae77-df8b690a142d tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:54.827421 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d711b5e8-3aa1-4b8c-ae77-df8b690a142d tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:54.828100 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d711b5e8-3aa1-4b8c-ae77-df8b690a142d tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:54.833217 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d711b5e8-3aa1-4b8c-ae77-df8b690a142d tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:55.129303 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-2b3d0f86-53ee-4853-a80b-6fc3817a7913 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5899b2ad9f1046caaf7c6073e408eeee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25abd63376614081a9d484f3c9ae950d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:55.138528 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-2b3d0f86-53ee-4853-a80b-6fc3817a7913 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "GET /compute/v2.1/servers/250395b5-5be8-420a-8709-dcf8b4241a4e" status: 200 len: 1392 microversion: 2.1 time: 0.898533 Aug 10 23:15:55.154836 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2113/4058] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:54 2022] GET /compute/v2.1/servers/250395b5-5be8-420a-8709-dcf8b4241a4e => generated 1392 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:55.158609 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-d711b5e8-3aa1-4b8c-ae77-df8b690a142d tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07c94ebf0954cdea12b9a689538d96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395d7c4077e54c43bb95288db3942b0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:55.170689 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-d711b5e8-3aa1-4b8c-ae77-df8b690a142d tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] 10.222.0.58 "GET /compute/v2.1/servers/27dd09d6-47ed-4b55-bd02-baad36a28429" status: 200 len: 1501 microversion: 2.1 time: 0.364573 Aug 10 23:15:55.181244 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1946/4059] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:54 2022] GET /compute/v2.1/servers/27dd09d6-47ed-4b55-bd02-baad36a28429 => generated 1501 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:15:55.201231 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-d8874cf3-4b4d-46a6-a3ed-fa0c5dde9e57 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "67078f12-14de-484d-a36e-716b640e4c5a"}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:15:55.204098 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-d8874cf3-4b4d-46a6-a3ed-fa0c5dde9e57 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] [instance: 27dd09d6-47ed-4b55-bd02-baad36a28429] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:55.214398 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=12 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:15:55.216609 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d8874cf3-4b4d-46a6-a3ed-fa0c5dde9e57 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:55.219802 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d8874cf3-4b4d-46a6-a3ed-fa0c5dde9e57 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:55.220479 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d8874cf3-4b4d-46a6-a3ed-fa0c5dde9e57 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:55.221403 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d8874cf3-4b4d-46a6-a3ed-fa0c5dde9e57 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:55.223360 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d8874cf3-4b4d-46a6-a3ed-fa0c5dde9e57 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:55.224004 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d8874cf3-4b4d-46a6-a3ed-fa0c5dde9e57 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:55.257850 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-60397a8f-6bfa-465f-af7e-1ed8db8a312e tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:55.258808 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-60397a8f-6bfa-465f-af7e-1ed8db8a312e tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] [instance: fdd1f85d-95db-477c-a173-a6fca94f58b1] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:55.271830 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-60397a8f-6bfa-465f-af7e-1ed8db8a312e tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:55.277093 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-60397a8f-6bfa-465f-af7e-1ed8db8a312e tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:55.277819 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-60397a8f-6bfa-465f-af7e-1ed8db8a312e tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:55.278758 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-60397a8f-6bfa-465f-af7e-1ed8db8a312e tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:55.280629 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-60397a8f-6bfa-465f-af7e-1ed8db8a312e tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:55.281240 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-60397a8f-6bfa-465f-af7e-1ed8db8a312e tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:55.316653 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-d8874cf3-4b4d-46a6-a3ed-fa0c5dde9e57 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] HTTP exception thrown: Cannot 'attach_volume' instance 27dd09d6-47ed-4b55-bd02-baad36a28429 while it is in vm_state rescued Aug 10 23:15:55.325199 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-d8874cf3-4b4d-46a6-a3ed-fa0c5dde9e57 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Request method failure captured: Aug 10 23:15:55.325199 n-d-850468-14 devstack@n-api.service[122633]: request: POST /compute/v2.1/servers/27dd09d6-47ed-4b55-bd02-baad36a28429/os-volume_attachments HTTP/1.1 Aug 10 23:15:55.325199 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:15:55.325199 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:15:55.325199 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:15:55.325199 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 74 Aug 10 23:15:55.325199 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:15:55.325199 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:15:55.325199 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:15:55.325199 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:15:55.325199 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9DvG6mPOp_bU6YQakEzMuJf91N1YrPRgIEe5ouB8tWtrXuOeLQgeJ0ouDTrtP31JIWcz1wQJ17PTz3JUAbF_FaF35I1F09nIb2lkQ0GhE880fsA2K13MCP_yKxqm-kv_hQLiQB8UzdyMBwb04C68j2QYpbobWhHyceARqBEeITDqyg0 Aug 10 23:15:55.325199 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:15:55.325199 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:15:55.325199 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:15:55.325199 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:15:55.325199 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:15:55.325199 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:15:55.325199 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 395d7c4077e54c43bb95288db3942b0a Aug 10 23:15:55.325199 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1029565464 Aug 10 23:15:55.325199 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:15:55.325199 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:15:55.325199 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/395d7c4077e54c43bb95288db3942b0a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/395d7c4077e54c43bb95288db3942b0a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/395d7c4077e54c43bb95288db3942b0a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_395d7c4077e54c43bb95288db3942b0a", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:15:55.325199 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1029565464 Aug 10 23:15:55.325199 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 395d7c4077e54c43bb95288db3942b0a Aug 10 23:15:55.325199 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1029565464 Aug 10 23:15:55.325199 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-ServerRescueNegativeTestJSON-1029565464-project Aug 10 23:15:55.325199 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:15:55.325199 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:15:55.325199 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: f07c94ebf0954cdea12b9a689538d96d Aug 10 23:15:55.325199 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1029565464-project Aug 10 23:15:55.325199 n-d-850468-14 devstack@n-api.service[122633]: Aug 10 23:15:55.325199 n-d-850468-14 devstack@n-api.service[122633]: {"volumeAttachment": {"volumeId": "67078f12-14de-484d-a36e-716b640e4c5a"}} Aug 10 23:15:55.325199 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:15:55.325199 n-d-850468-14 devstack@n-api.service[122633]: exception: Cannot 'attach_volume' instance 27dd09d6-47ed-4b55-bd02-baad36a28429 while it is in vm_state rescued Aug 10 23:15:55.325199 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'server_id': '27dd09d6-47ed-4b55-bd02-baad36a28429', 'body': {'volumeAttachment': {'volumeId': '67078f12-14de-484d-a36e-716b640e4c5a'}}} Aug 10 23:15:55.325199 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:15:55.325199 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:15:55.325199 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 10 23:15:55.325199 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 10 23:15:55.325199 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 10 23:15:55.325199 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 10 23:15:55.325199 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 10 23:15:55.325199 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 10 23:15:55.325199 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 27dd09d6-47ed-4b55-bd02-baad36a28429 in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 10 23:15:55.325199 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:15:55.325199 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:15:55.325199 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:15:55.325199 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:15:55.325199 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:15:55.325199 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:15:55.325199 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:15:55.325199 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:15:55.325199 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:15:55.325199 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:15:55.325199 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 23:15:55.325199 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 23:15:55.325199 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 23:15:55.325199 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 23:15:55.325199 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 23:15:55.325199 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 23:15:55.325199 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 10 23:15:55.325199 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 10 23:15:55.329470 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 10 23:15:55.329470 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 10 23:15:55.329470 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 27dd09d6-47ed-4b55-bd02-baad36a28429 while it is in vm_state rescued Aug 10 23:15:55.329470 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:15:55.329470 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:15:55.329470 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:15:55.329470 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:15:55.329470 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:15:55.329470 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:15:55.329470 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:15:55.329470 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:15:55.329470 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 27dd09d6-47ed-4b55-bd02-baad36a28429 while it is in vm_state rescued Aug 10 23:15:55.329470 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:15:55.332268 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-d8874cf3-4b4d-46a6-a3ed-fa0c5dde9e57 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Returning 409 to user: Cannot 'attach_volume' instance 27dd09d6-47ed-4b55-bd02-baad36a28429 while it is in vm_state rescued {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:15:55.335659 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-d8874cf3-4b4d-46a6-a3ed-fa0c5dde9e57 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] 10.222.0.58 "POST /compute/v2.1/servers/27dd09d6-47ed-4b55-bd02-baad36a28429/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.139185 Aug 10 23:15:55.340140 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2114/4060] 10.222.0.58 () {60 vars in 1323 bytes} [Wed Aug 10 23:15:55 2022] POST /compute/v2.1/servers/27dd09d6-47ed-4b55-bd02-baad36a28429/os-volume_attachments => generated 152 bytes in 144 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 10 23:15:55.350203 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-f43f6490-9c40-4599-8bd5-726c82d23a6a tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:15:55.353468 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-f43f6490-9c40-4599-8bd5-726c82d23a6a tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] [instance: 27dd09d6-47ed-4b55-bd02-baad36a28429] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:55.365716 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f43f6490-9c40-4599-8bd5-726c82d23a6a tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:55.366574 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f43f6490-9c40-4599-8bd5-726c82d23a6a tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:55.374916 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f43f6490-9c40-4599-8bd5-726c82d23a6a tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:55.376988 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f43f6490-9c40-4599-8bd5-726c82d23a6a tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:55.383511 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f43f6490-9c40-4599-8bd5-726c82d23a6a tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:55.384464 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f43f6490-9c40-4599-8bd5-726c82d23a6a tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:55.644558 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-f43f6490-9c40-4599-8bd5-726c82d23a6a tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] 10.222.0.58 "POST /compute/v2.1/servers/27dd09d6-47ed-4b55-bd02-baad36a28429/action" status: 202 len: 0 microversion: 2.1 time: 0.297745 Aug 10 23:15:55.645848 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2115/4061] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:15:55 2022] POST /compute/v2.1/servers/27dd09d6-47ed-4b55-bd02-baad36a28429/action => generated 0 bytes in 301 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 10 23:15:55.663679 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-51ac7fd2-beb5-4497-9468-acc8b9f8410f tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:55.670006 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-51ac7fd2-beb5-4497-9468-acc8b9f8410f tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:55.712714 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-51ac7fd2-beb5-4497-9468-acc8b9f8410f tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:55.713578 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-51ac7fd2-beb5-4497-9468-acc8b9f8410f tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:55.714333 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-51ac7fd2-beb5-4497-9468-acc8b9f8410f tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:55.715584 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-51ac7fd2-beb5-4497-9468-acc8b9f8410f tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:55.715844 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-60397a8f-6bfa-465f-af7e-1ed8db8a312e tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cc4167255044d29a70c12a5a44d800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578d8e62013d43c5ad4d9a6d92e1f201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:55.716325 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-51ac7fd2-beb5-4497-9468-acc8b9f8410f tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:55.716792 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-51ac7fd2-beb5-4497-9468-acc8b9f8410f tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:55.731419 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-60397a8f-6bfa-465f-af7e-1ed8db8a312e tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] 10.222.0.58 "GET /compute/v2.1/servers/fdd1f85d-95db-477c-a173-a6fca94f58b1" status: 200 len: 1523 microversion: 2.1 time: 0.474903 Aug 10 23:15:55.734701 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1947/4062] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:55 2022] GET /compute/v2.1/servers/fdd1f85d-95db-477c-a173-a6fca94f58b1 => generated 1523 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:55.755487 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-23482ba2-a527-4c48-9495-51109a2b8457 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:55.771151 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-23482ba2-a527-4c48-9495-51109a2b8457 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] [instance: 27dd09d6-47ed-4b55-bd02-baad36a28429] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:55.812222 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-23482ba2-a527-4c48-9495-51109a2b8457 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:55.817949 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-23482ba2-a527-4c48-9495-51109a2b8457 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:55.818822 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-23482ba2-a527-4c48-9495-51109a2b8457 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:55.823022 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-23482ba2-a527-4c48-9495-51109a2b8457 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:55.824446 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-23482ba2-a527-4c48-9495-51109a2b8457 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:55.824900 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-23482ba2-a527-4c48-9495-51109a2b8457 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:55.895144 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:15:56.096778 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-23482ba2-a527-4c48-9495-51109a2b8457 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07c94ebf0954cdea12b9a689538d96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395d7c4077e54c43bb95288db3942b0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:56.105966 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-23482ba2-a527-4c48-9495-51109a2b8457 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] 10.222.0.58 "GET /compute/v2.1/servers/27dd09d6-47ed-4b55-bd02-baad36a28429" status: 200 len: 1509 microversion: 2.1 time: 0.367635 Aug 10 23:15:56.115696 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1948/4063] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:55 2022] GET /compute/v2.1/servers/27dd09d6-47ed-4b55-bd02-baad36a28429 => generated 1509 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:56.120754 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-ceb86de4-98ed-4c29-88c0-7e6019fe1cd7 req-f54054f8-fb84-47a7-9896-82c22078b5b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "250395b5-5be8-420a-8709-dcf8b4241a4e", "name": "network-vif-plugged", "status": "completed", "tag": "fb6df67c-3dbb-4a0f-98f0-c602e1eaa615"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:15:56.125817 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:15:56.143975 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-ceb86de4-98ed-4c29-88c0-7e6019fe1cd7 req-f54054f8-fb84-47a7-9896-82c22078b5b0 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:56.144459 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-ceb86de4-98ed-4c29-88c0-7e6019fe1cd7 req-f54054f8-fb84-47a7-9896-82c22078b5b0 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:56.144904 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-ceb86de4-98ed-4c29-88c0-7e6019fe1cd7 req-f54054f8-fb84-47a7-9896-82c22078b5b0 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:56.182258 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-ceb86de4-98ed-4c29-88c0-7e6019fe1cd7 req-f54054f8-fb84-47a7-9896-82c22078b5b0 service nova] Creating event network-vif-plugged:fb6df67c-3dbb-4a0f-98f0-c602e1eaa615 for instance 250395b5-5be8-420a-8709-dcf8b4241a4e on n-h1-850468-14 Aug 10 23:15:56.189190 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-ceb86de4-98ed-4c29-88c0-7e6019fe1cd7 req-f54054f8-fb84-47a7-9896-82c22078b5b0 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072150 Aug 10 23:15:56.189766 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1949/4064] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:15:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:15:56.213781 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-53a7be45-8284-4773-9875-508e5003850a tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:56.214343 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-53a7be45-8284-4773-9875-508e5003850a tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] [instance: 250395b5-5be8-420a-8709-dcf8b4241a4e] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:56.248860 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-53a7be45-8284-4773-9875-508e5003850a tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:56.249648 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-53a7be45-8284-4773-9875-508e5003850a tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:56.250270 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-53a7be45-8284-4773-9875-508e5003850a tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:56.251889 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-53a7be45-8284-4773-9875-508e5003850a tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:56.252519 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-53a7be45-8284-4773-9875-508e5003850a tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:56.253810 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-53a7be45-8284-4773-9875-508e5003850a tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:56.347802 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-51ac7fd2-beb5-4497-9468-acc8b9f8410f tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:56.360975 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-51ac7fd2-beb5-4497-9468-acc8b9f8410f tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b" status: 200 len: 1528 microversion: 2.1 time: 0.712332 Aug 10 23:15:56.361762 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2116/4065] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:55 2022] GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b => generated 1528 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:56.760341 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-84a0d143-78ac-458a-bf8c-d21df143bdd4 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:56.761223 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-84a0d143-78ac-458a-bf8c-d21df143bdd4 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] [instance: fdd1f85d-95db-477c-a173-a6fca94f58b1] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:56.773115 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-84a0d143-78ac-458a-bf8c-d21df143bdd4 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:56.787822 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-84a0d143-78ac-458a-bf8c-d21df143bdd4 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:56.788354 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-84a0d143-78ac-458a-bf8c-d21df143bdd4 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:56.789126 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-84a0d143-78ac-458a-bf8c-d21df143bdd4 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:56.789596 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-84a0d143-78ac-458a-bf8c-d21df143bdd4 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:56.790034 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-84a0d143-78ac-458a-bf8c-d21df143bdd4 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:56.798472 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-53a7be45-8284-4773-9875-508e5003850a tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5899b2ad9f1046caaf7c6073e408eeee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25abd63376614081a9d484f3c9ae950d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:56.806072 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=10 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:15:56.818905 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-53a7be45-8284-4773-9875-508e5003850a tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "GET /compute/v2.1/servers/250395b5-5be8-420a-8709-dcf8b4241a4e" status: 200 len: 1392 microversion: 2.1 time: 0.624059 Aug 10 23:15:56.820235 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1950/4066] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:56 2022] GET /compute/v2.1/servers/250395b5-5be8-420a-8709-dcf8b4241a4e => generated 1392 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:57.150302 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-9aa497b8-acf5-4e6a-997c-2f66850e67f7 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:57.152654 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-9aa497b8-acf5-4e6a-997c-2f66850e67f7 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] [instance: 27dd09d6-47ed-4b55-bd02-baad36a28429] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:57.152831 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-84a0d143-78ac-458a-bf8c-d21df143bdd4 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cc4167255044d29a70c12a5a44d800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578d8e62013d43c5ad4d9a6d92e1f201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:57.167836 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9aa497b8-acf5-4e6a-997c-2f66850e67f7 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:57.169167 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9aa497b8-acf5-4e6a-997c-2f66850e67f7 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:57.169996 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9aa497b8-acf5-4e6a-997c-2f66850e67f7 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:57.175769 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9aa497b8-acf5-4e6a-997c-2f66850e67f7 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:57.176037 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-84a0d143-78ac-458a-bf8c-d21df143bdd4 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] 10.222.0.58 "GET /compute/v2.1/servers/fdd1f85d-95db-477c-a173-a6fca94f58b1" status: 200 len: 1523 microversion: 2.1 time: 0.415729 Aug 10 23:15:57.177518 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2117/4067] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:56 2022] GET /compute/v2.1/servers/fdd1f85d-95db-477c-a173-a6fca94f58b1 => generated 1523 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:57.179035 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9aa497b8-acf5-4e6a-997c-2f66850e67f7 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:57.183839 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9aa497b8-acf5-4e6a-997c-2f66850e67f7 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:57.388408 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-24694da7-bea5-4305-99bb-a92414f470fe tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:57.394357 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-24694da7-bea5-4305-99bb-a92414f470fe tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:57.480160 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-24694da7-bea5-4305-99bb-a92414f470fe tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:57.482605 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-24694da7-bea5-4305-99bb-a92414f470fe tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:57.483762 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-24694da7-bea5-4305-99bb-a92414f470fe tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:57.485549 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-24694da7-bea5-4305-99bb-a92414f470fe tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:57.486842 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-24694da7-bea5-4305-99bb-a92414f470fe tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:57.488500 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-24694da7-bea5-4305-99bb-a92414f470fe tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:57.659430 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-9aa497b8-acf5-4e6a-997c-2f66850e67f7 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07c94ebf0954cdea12b9a689538d96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395d7c4077e54c43bb95288db3942b0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:57.677529 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-9aa497b8-acf5-4e6a-997c-2f66850e67f7 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] 10.222.0.58 "GET /compute/v2.1/servers/27dd09d6-47ed-4b55-bd02-baad36a28429" status: 200 len: 1509 microversion: 2.1 time: 0.535057 Aug 10 23:15:57.678434 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1951/4068] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:57 2022] GET /compute/v2.1/servers/27dd09d6-47ed-4b55-bd02-baad36a28429 => generated 1509 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:57.850325 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-df9d8857-bf7e-410b-ba02-3430052e4b98 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:57.851067 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-df9d8857-bf7e-410b-ba02-3430052e4b98 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] [instance: 250395b5-5be8-420a-8709-dcf8b4241a4e] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:57.868534 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-df9d8857-bf7e-410b-ba02-3430052e4b98 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:57.869077 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-df9d8857-bf7e-410b-ba02-3430052e4b98 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:57.869540 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-df9d8857-bf7e-410b-ba02-3430052e4b98 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:57.870293 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-df9d8857-bf7e-410b-ba02-3430052e4b98 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:57.870755 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-df9d8857-bf7e-410b-ba02-3430052e4b98 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:57.871211 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-df9d8857-bf7e-410b-ba02-3430052e4b98 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:58.237560 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-24694da7-bea5-4305-99bb-a92414f470fe tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:58.247605 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:15:58.257403 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-24694da7-bea5-4305-99bb-a92414f470fe tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b" status: 200 len: 1528 microversion: 2.1 time: 0.877732 Aug 10 23:15:58.264635 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2118/4069] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:57 2022] GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b => generated 1528 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:58.276207 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-08238132-8005-4f60-a319-4f500365aced tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:58.277047 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-08238132-8005-4f60-a319-4f500365aced tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: 6777bc8c-cfdf-4264-a776-09e8df2dc13b] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:58.282361 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-df9d8857-bf7e-410b-ba02-3430052e4b98 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5899b2ad9f1046caaf7c6073e408eeee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25abd63376614081a9d484f3c9ae950d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:58.293723 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-08238132-8005-4f60-a319-4f500365aced tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:58.295255 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-df9d8857-bf7e-410b-ba02-3430052e4b98 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "GET /compute/v2.1/servers/250395b5-5be8-420a-8709-dcf8b4241a4e" status: 200 len: 1563 microversion: 2.1 time: 0.449859 Aug 10 23:15:58.297169 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-08238132-8005-4f60-a319-4f500365aced tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:58.297589 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1952/4070] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:57 2022] GET /compute/v2.1/servers/250395b5-5be8-420a-8709-dcf8b4241a4e => generated 1563 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:58.298814 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-08238132-8005-4f60-a319-4f500365aced tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:58.302160 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-08238132-8005-4f60-a319-4f500365aced tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:58.303029 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-08238132-8005-4f60-a319-4f500365aced tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:58.303762 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-08238132-8005-4f60-a319-4f500365aced tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:58.305083 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c3f28f42-1397-40a3-9468-26226e77f00c tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:58.305771 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-c3f28f42-1397-40a3-9468-26226e77f00c tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] [instance: fdd1f85d-95db-477c-a173-a6fca94f58b1] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:58.312773 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c3f28f42-1397-40a3-9468-26226e77f00c tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:58.313427 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c3f28f42-1397-40a3-9468-26226e77f00c tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:58.313774 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c3f28f42-1397-40a3-9468-26226e77f00c tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:58.314714 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c3f28f42-1397-40a3-9468-26226e77f00c tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:58.315478 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c3f28f42-1397-40a3-9468-26226e77f00c tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:58.315879 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c3f28f42-1397-40a3-9468-26226e77f00c tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:58.358279 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-08238132-8005-4f60-a319-4f500365aced tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] HTTP exception thrown: Instance 6777bc8c-cfdf-4264-a776-09e8df2dc13b could not be found. Aug 10 23:15:58.360241 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-08238132-8005-4f60-a319-4f500365aced tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Request method failure captured: Aug 10 23:15:58.360241 n-d-850468-14 devstack@n-api.service[122633]: request: DELETE /compute/v2.1/servers/6777bc8c-cfdf-4264-a776-09e8df2dc13b HTTP/1.1 Aug 10 23:15:58.360241 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:15:58.360241 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:15:58.360241 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:15:58.360241 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:15:58.360241 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:15:58.360241 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:15:58.360241 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:15:58.360241 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:15:58.360241 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9Drr3r82npWIkz1ccNiKcah17mvrMR2EU4HCxqxnaGEEIkGANcRcrX2nHMsvmCLf0usmykCLye_MMWubAbqGw1RDJdO9uNXXKIzwnkO3-8RDYkeEsX4dAb-XLWqGpnC4lB_RQ_yXrj9zJ0yoaNBALi5oi6cnoUgwIrYxNetinerHaU0 Aug 10 23:15:58.360241 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:15:58.360241 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:15:58.360241 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:15:58.360241 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:15:58.360241 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:15:58.360241 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:15:58.360241 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 7d90f8a58ad047fa8f347d6474e4d673 Aug 10 23:15:58.360241 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-DeleteServersTestJSON-311075827 Aug 10 23:15:58.360241 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:15:58.360241 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:15:58.360241 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7d90f8a58ad047fa8f347d6474e4d673"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7d90f8a58ad047fa8f347d6474e4d673"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7d90f8a58ad047fa8f347d6474e4d673"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7d90f8a58ad047fa8f347d6474e4d673", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:15:58.360241 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-DeleteServersTestJSON-311075827 Aug 10 23:15:58.360241 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 7d90f8a58ad047fa8f347d6474e4d673 Aug 10 23:15:58.360241 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-DeleteServersTestJSON-311075827 Aug 10 23:15:58.360241 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-DeleteServersTestJSON-311075827-project Aug 10 23:15:58.360241 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:15:58.360241 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:15:58.360241 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 3c6160c7a42740efbe3613380933fa15 Aug 10 23:15:58.360241 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-DeleteServersTestJSON-311075827-project Aug 10 23:15:58.360241 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:15:58.360241 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance 6777bc8c-cfdf-4264-a776-09e8df2dc13b could not be found. Aug 10 23:15:58.360241 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': '6777bc8c-cfdf-4264-a776-09e8df2dc13b'} Aug 10 23:15:58.360241 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:15:58.360241 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:15:58.360241 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:15:58.360241 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:15:58.360241 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:15:58.360241 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:15:58.360241 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:15:58.360241 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:15:58.360241 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:15:58.360241 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:15:58.360241 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6777bc8c-cfdf-4264-a776-09e8df2dc13b could not be found. Aug 10 23:15:58.360241 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:15:58.360241 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:15:58.360241 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:15:58.360241 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:15:58.360241 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:15:58.360241 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:15:58.360241 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:15:58.360241 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:15:58.360241 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:15:58.360241 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:15:58.360241 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 23:15:58.360241 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 23:15:58.360241 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 23:15:58.360241 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 23:15:58.360241 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:15:58.360241 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:15:58.360241 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:15:58.360241 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:15:58.370034 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6777bc8c-cfdf-4264-a776-09e8df2dc13b could not be found. Aug 10 23:15:58.370034 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:15:58.370034 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:15:58.370034 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:15:58.370034 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:15:58.370034 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:15:58.370034 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:15:58.370034 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:15:58.370034 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:15:58.370034 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6777bc8c-cfdf-4264-a776-09e8df2dc13b could not be found. Aug 10 23:15:58.370034 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:15:58.370034 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-08238132-8005-4f60-a319-4f500365aced tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Returning 404 to user: Instance 6777bc8c-cfdf-4264-a776-09e8df2dc13b could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:15:58.370034 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-08238132-8005-4f60-a319-4f500365aced tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "DELETE /compute/v2.1/servers/6777bc8c-cfdf-4264-a776-09e8df2dc13b" status: 404 len: 111 microversion: 2.1 time: 0.095008 Aug 10 23:15:58.370034 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2119/4071] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:15:58 2022] DELETE /compute/v2.1/servers/6777bc8c-cfdf-4264-a776-09e8df2dc13b => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:15:58.381394 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-a52f6492-2429-4df6-9425-c6811fe81828 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:58.382144 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-a52f6492-2429-4df6-9425-c6811fe81828 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] [instance: 250395b5-5be8-420a-8709-dcf8b4241a4e] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:58.399980 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a52f6492-2429-4df6-9425-c6811fe81828 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:58.401322 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a52f6492-2429-4df6-9425-c6811fe81828 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:58.402038 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a52f6492-2429-4df6-9425-c6811fe81828 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:58.403057 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a52f6492-2429-4df6-9425-c6811fe81828 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:58.403748 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a52f6492-2429-4df6-9425-c6811fe81828 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:58.404480 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a52f6492-2429-4df6-9425-c6811fe81828 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:58.723313 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-a52f6492-2429-4df6-9425-c6811fe81828 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5899b2ad9f1046caaf7c6073e408eeee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25abd63376614081a9d484f3c9ae950d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:58.731880 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-a52f6492-2429-4df6-9425-c6811fe81828 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "GET /compute/v2.1/servers/250395b5-5be8-420a-8709-dcf8b4241a4e" status: 200 len: 1563 microversion: 2.1 time: 0.361841 Aug 10 23:15:58.733861 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2120/4072] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:58 2022] GET /compute/v2.1/servers/250395b5-5be8-420a-8709-dcf8b4241a4e => generated 1563 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:58.739409 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-af82ebe7-0a8c-4635-aba3-7b391a379951 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:58.740351 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-af82ebe7-0a8c-4635-aba3-7b391a379951 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: 6777bc8c-cfdf-4264-a776-09e8df2dc13b] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:58.747026 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-af82ebe7-0a8c-4635-aba3-7b391a379951 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:58.747848 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-af82ebe7-0a8c-4635-aba3-7b391a379951 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:58.762215 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-af82ebe7-0a8c-4635-aba3-7b391a379951 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:58.763337 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-af82ebe7-0a8c-4635-aba3-7b391a379951 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:58.764872 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-af82ebe7-0a8c-4635-aba3-7b391a379951 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:58.765578 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-af82ebe7-0a8c-4635-aba3-7b391a379951 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:58.826195 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-af82ebe7-0a8c-4635-aba3-7b391a379951 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] HTTP exception thrown: Instance 6777bc8c-cfdf-4264-a776-09e8df2dc13b could not be found. Aug 10 23:15:58.831890 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-af82ebe7-0a8c-4635-aba3-7b391a379951 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Request method failure captured: Aug 10 23:15:58.831890 n-d-850468-14 devstack@n-api.service[122633]: request: GET /compute/v2.1/servers/6777bc8c-cfdf-4264-a776-09e8df2dc13b HTTP/1.1 Aug 10 23:15:58.831890 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:15:58.831890 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:15:58.831890 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:15:58.831890 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:15:58.831890 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:15:58.831890 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:15:58.831890 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:15:58.831890 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:15:58.831890 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9Drr3r82npWIkz1ccNiKcah17mvrMR2EU4HCxqxnaGEEIkGANcRcrX2nHMsvmCLf0usmykCLye_MMWubAbqGw1RDJdO9uNXXKIzwnkO3-8RDYkeEsX4dAb-XLWqGpnC4lB_RQ_yXrj9zJ0yoaNBALi5oi6cnoUgwIrYxNetinerHaU0 Aug 10 23:15:58.831890 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:15:58.831890 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:15:58.831890 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:15:58.831890 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:15:58.831890 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:15:58.831890 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:15:58.831890 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 7d90f8a58ad047fa8f347d6474e4d673 Aug 10 23:15:58.831890 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-DeleteServersTestJSON-311075827 Aug 10 23:15:58.831890 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:15:58.831890 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:15:58.831890 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7d90f8a58ad047fa8f347d6474e4d673"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7d90f8a58ad047fa8f347d6474e4d673"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7d90f8a58ad047fa8f347d6474e4d673"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7d90f8a58ad047fa8f347d6474e4d673", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:15:58.831890 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-DeleteServersTestJSON-311075827 Aug 10 23:15:58.831890 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 7d90f8a58ad047fa8f347d6474e4d673 Aug 10 23:15:58.831890 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-DeleteServersTestJSON-311075827 Aug 10 23:15:58.831890 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-DeleteServersTestJSON-311075827-project Aug 10 23:15:58.831890 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:15:58.831890 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:15:58.831890 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 3c6160c7a42740efbe3613380933fa15 Aug 10 23:15:58.831890 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-DeleteServersTestJSON-311075827-project Aug 10 23:15:58.831890 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:15:58.831890 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance 6777bc8c-cfdf-4264-a776-09e8df2dc13b could not be found. Aug 10 23:15:58.831890 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': '6777bc8c-cfdf-4264-a776-09e8df2dc13b'} Aug 10 23:15:58.831890 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:15:58.831890 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:15:58.831890 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:15:58.831890 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:15:58.831890 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:15:58.831890 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:15:58.831890 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:15:58.831890 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:15:58.831890 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:15:58.831890 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:15:58.831890 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6777bc8c-cfdf-4264-a776-09e8df2dc13b could not be found. Aug 10 23:15:58.831890 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:15:58.831890 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:15:58.831890 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:15:58.831890 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:15:58.831890 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:15:58.831890 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:15:58.831890 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:15:58.831890 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:15:58.831890 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:15:58.831890 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:15:58.831890 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:15:58.831890 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:15:58.831890 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:15:58.831890 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:15:58.831890 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:15:58.831890 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:15:58.831890 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6777bc8c-cfdf-4264-a776-09e8df2dc13b could not be found. Aug 10 23:15:58.831890 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:15:58.831890 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:15:58.831890 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:15:58.836612 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:15:58.836612 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:15:58.836612 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:15:58.836612 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:15:58.836612 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:15:58.836612 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6777bc8c-cfdf-4264-a776-09e8df2dc13b could not be found. Aug 10 23:15:58.836612 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:15:58.839202 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-af82ebe7-0a8c-4635-aba3-7b391a379951 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Returning 404 to user: Instance 6777bc8c-cfdf-4264-a776-09e8df2dc13b could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:15:58.840472 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-af82ebe7-0a8c-4635-aba3-7b391a379951 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "GET /compute/v2.1/servers/6777bc8c-cfdf-4264-a776-09e8df2dc13b" status: 404 len: 111 microversion: 2.1 time: 0.105209 Aug 10 23:15:58.841577 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2121/4073] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:58 2022] GET /compute/v2.1/servers/6777bc8c-cfdf-4264-a776-09e8df2dc13b => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:15:58.847862 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c138e6e3-577e-4fd2-978f-272cae0c5c8a tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:58.849828 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-c138e6e3-577e-4fd2-978f-272cae0c5c8a tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] [instance: 27dd09d6-47ed-4b55-bd02-baad36a28429] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:58.857478 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c138e6e3-577e-4fd2-978f-272cae0c5c8a tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:58.859222 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c138e6e3-577e-4fd2-978f-272cae0c5c8a tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:58.859855 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c138e6e3-577e-4fd2-978f-272cae0c5c8a tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:58.860913 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c138e6e3-577e-4fd2-978f-272cae0c5c8a tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:58.861900 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c138e6e3-577e-4fd2-978f-272cae0c5c8a tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:58.862507 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c138e6e3-577e-4fd2-978f-272cae0c5c8a tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:58.903043 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-c3f28f42-1397-40a3-9468-26226e77f00c tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cc4167255044d29a70c12a5a44d800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578d8e62013d43c5ad4d9a6d92e1f201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:58.915678 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-c3f28f42-1397-40a3-9468-26226e77f00c tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] 10.222.0.58 "GET /compute/v2.1/servers/fdd1f85d-95db-477c-a173-a6fca94f58b1" status: 200 len: 1523 microversion: 2.1 time: 0.616149 Aug 10 23:15:58.921886 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1953/4074] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:58 2022] GET /compute/v2.1/servers/fdd1f85d-95db-477c-a173-a6fca94f58b1 => generated 1523 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:58.930815 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-e70ca917-e1ec-4b7a-a278-fe21decb41d1 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:58.931544 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-e70ca917-e1ec-4b7a-a278-fe21decb41d1 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: 59ecfba7-b76a-4b71-9821-bd330a20922f] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:58.938762 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e70ca917-e1ec-4b7a-a278-fe21decb41d1 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:58.939487 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e70ca917-e1ec-4b7a-a278-fe21decb41d1 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:58.940153 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e70ca917-e1ec-4b7a-a278-fe21decb41d1 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:58.942023 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e70ca917-e1ec-4b7a-a278-fe21decb41d1 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:58.942676 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e70ca917-e1ec-4b7a-a278-fe21decb41d1 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:58.943321 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e70ca917-e1ec-4b7a-a278-fe21decb41d1 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:59.002360 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-e70ca917-e1ec-4b7a-a278-fe21decb41d1 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] HTTP exception thrown: Instance 59ecfba7-b76a-4b71-9821-bd330a20922f could not be found. Aug 10 23:15:59.017399 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-e70ca917-e1ec-4b7a-a278-fe21decb41d1 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Request method failure captured: Aug 10 23:15:59.017399 n-d-850468-14 devstack@n-api.service[122632]: request: DELETE /compute/v2.1/servers/59ecfba7-b76a-4b71-9821-bd330a20922f HTTP/1.1 Aug 10 23:15:59.017399 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:15:59.017399 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:15:59.017399 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:15:59.017399 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 23:15:59.017399 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:15:59.017399 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:15:59.017399 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:15:59.017399 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:15:59.017399 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9Drr3r82npWIkz1ccNiKcah17mvrMR2EU4HCxqxnaGEEIkGANcRcrX2nHMsvmCLf0usmykCLye_MMWubAbqGw1RDJdO9uNXXKIzwnkO3-8RDYkeEsX4dAb-XLWqGpnC4lB_RQ_yXrj9zJ0yoaNBALi5oi6cnoUgwIrYxNetinerHaU0 Aug 10 23:15:59.017399 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:15:59.017399 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:15:59.017399 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:15:59.017399 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:15:59.017399 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:15:59.017399 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:15:59.017399 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 7d90f8a58ad047fa8f347d6474e4d673 Aug 10 23:15:59.017399 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-DeleteServersTestJSON-311075827 Aug 10 23:15:59.017399 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:15:59.017399 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:15:59.017399 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7d90f8a58ad047fa8f347d6474e4d673"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7d90f8a58ad047fa8f347d6474e4d673"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7d90f8a58ad047fa8f347d6474e4d673"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7d90f8a58ad047fa8f347d6474e4d673", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:15:59.017399 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-DeleteServersTestJSON-311075827 Aug 10 23:15:59.017399 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 7d90f8a58ad047fa8f347d6474e4d673 Aug 10 23:15:59.017399 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-DeleteServersTestJSON-311075827 Aug 10 23:15:59.017399 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-DeleteServersTestJSON-311075827-project Aug 10 23:15:59.017399 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:15:59.017399 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:15:59.017399 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: 3c6160c7a42740efbe3613380933fa15 Aug 10 23:15:59.017399 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-DeleteServersTestJSON-311075827-project Aug 10 23:15:59.017399 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:15:59.017399 n-d-850468-14 devstack@n-api.service[122632]: exception: Instance 59ecfba7-b76a-4b71-9821-bd330a20922f could not be found. Aug 10 23:15:59.017399 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': '59ecfba7-b76a-4b71-9821-bd330a20922f'} Aug 10 23:15:59.017399 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:15:59.017399 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:15:59.017399 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:15:59.017399 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:15:59.017399 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:15:59.017399 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:15:59.017399 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:15:59.017399 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:15:59.017399 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:15:59.017399 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:15:59.017399 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59ecfba7-b76a-4b71-9821-bd330a20922f could not be found. Aug 10 23:15:59.017399 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:15:59.017399 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:15:59.017399 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:15:59.017399 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:15:59.017399 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:15:59.017399 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:15:59.017399 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:15:59.017399 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:15:59.017399 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:15:59.017399 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:15:59.017399 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 23:15:59.017399 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 23:15:59.017399 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 23:15:59.017399 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 23:15:59.017399 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:15:59.017399 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:15:59.017399 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:15:59.017399 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:15:59.023002 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59ecfba7-b76a-4b71-9821-bd330a20922f could not be found. Aug 10 23:15:59.023002 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:15:59.023002 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:15:59.023002 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:15:59.023002 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:15:59.023002 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:15:59.023002 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:15:59.023002 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:15:59.023002 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:15:59.023002 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59ecfba7-b76a-4b71-9821-bd330a20922f could not be found. Aug 10 23:15:59.023002 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:15:59.030653 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-e70ca917-e1ec-4b7a-a278-fe21decb41d1 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Returning 404 to user: Instance 59ecfba7-b76a-4b71-9821-bd330a20922f could not be found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:15:59.033803 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-e70ca917-e1ec-4b7a-a278-fe21decb41d1 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "DELETE /compute/v2.1/servers/59ecfba7-b76a-4b71-9821-bd330a20922f" status: 404 len: 111 microversion: 2.1 time: 0.109838 Aug 10 23:15:59.039552 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1954/4075] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:15:58 2022] DELETE /compute/v2.1/servers/59ecfba7-b76a-4b71-9821-bd330a20922f => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:15:59.059382 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-4af4a60a-9715-42fa-acd1-5c8af44c8068 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:59.070587 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-4af4a60a-9715-42fa-acd1-5c8af44c8068 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] [instance: 59ecfba7-b76a-4b71-9821-bd330a20922f] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:59.098546 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4af4a60a-9715-42fa-acd1-5c8af44c8068 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:59.099033 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4af4a60a-9715-42fa-acd1-5c8af44c8068 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:59.099481 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4af4a60a-9715-42fa-acd1-5c8af44c8068 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:59.116368 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4af4a60a-9715-42fa-acd1-5c8af44c8068 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:59.116893 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4af4a60a-9715-42fa-acd1-5c8af44c8068 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:59.117354 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4af4a60a-9715-42fa-acd1-5c8af44c8068 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:59.125934 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-c138e6e3-577e-4fd2-978f-272cae0c5c8a tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07c94ebf0954cdea12b9a689538d96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395d7c4077e54c43bb95288db3942b0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:15:59.134695 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-c138e6e3-577e-4fd2-978f-272cae0c5c8a tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] 10.222.0.58 "GET /compute/v2.1/servers/27dd09d6-47ed-4b55-bd02-baad36a28429" status: 200 len: 1509 microversion: 2.1 time: 0.291795 Aug 10 23:15:59.136775 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2122/4076] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:58 2022] GET /compute/v2.1/servers/27dd09d6-47ed-4b55-bd02-baad36a28429 => generated 1509 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:15:59.170932 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-4af4a60a-9715-42fa-acd1-5c8af44c8068 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] HTTP exception thrown: Instance 59ecfba7-b76a-4b71-9821-bd330a20922f could not be found. Aug 10 23:15:59.173390 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-4af4a60a-9715-42fa-acd1-5c8af44c8068 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Request method failure captured: Aug 10 23:15:59.173390 n-d-850468-14 devstack@n-api.service[122632]: request: GET /compute/v2.1/servers/59ecfba7-b76a-4b71-9821-bd330a20922f HTTP/1.1 Aug 10 23:15:59.173390 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:15:59.173390 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:15:59.173390 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:15:59.173390 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 23:15:59.173390 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:15:59.173390 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:15:59.173390 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:15:59.173390 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:15:59.173390 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9Drr3r82npWIkz1ccNiKcah17mvrMR2EU4HCxqxnaGEEIkGANcRcrX2nHMsvmCLf0usmykCLye_MMWubAbqGw1RDJdO9uNXXKIzwnkO3-8RDYkeEsX4dAb-XLWqGpnC4lB_RQ_yXrj9zJ0yoaNBALi5oi6cnoUgwIrYxNetinerHaU0 Aug 10 23:15:59.173390 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:15:59.173390 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:15:59.173390 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:15:59.173390 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:15:59.173390 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:15:59.173390 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:15:59.173390 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 7d90f8a58ad047fa8f347d6474e4d673 Aug 10 23:15:59.173390 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-DeleteServersTestJSON-311075827 Aug 10 23:15:59.173390 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:15:59.173390 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:15:59.173390 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7d90f8a58ad047fa8f347d6474e4d673"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7d90f8a58ad047fa8f347d6474e4d673"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7d90f8a58ad047fa8f347d6474e4d673"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7d90f8a58ad047fa8f347d6474e4d673", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:15:59.173390 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-DeleteServersTestJSON-311075827 Aug 10 23:15:59.173390 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 7d90f8a58ad047fa8f347d6474e4d673 Aug 10 23:15:59.173390 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-DeleteServersTestJSON-311075827 Aug 10 23:15:59.173390 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-DeleteServersTestJSON-311075827-project Aug 10 23:15:59.173390 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:15:59.173390 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:15:59.173390 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: 3c6160c7a42740efbe3613380933fa15 Aug 10 23:15:59.173390 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-DeleteServersTestJSON-311075827-project Aug 10 23:15:59.173390 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:15:59.173390 n-d-850468-14 devstack@n-api.service[122632]: exception: Instance 59ecfba7-b76a-4b71-9821-bd330a20922f could not be found. Aug 10 23:15:59.173390 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': '59ecfba7-b76a-4b71-9821-bd330a20922f'} Aug 10 23:15:59.173390 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:15:59.173390 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:15:59.173390 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:15:59.173390 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:15:59.173390 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:15:59.173390 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:15:59.173390 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:15:59.173390 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:15:59.173390 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:15:59.173390 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:15:59.173390 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59ecfba7-b76a-4b71-9821-bd330a20922f could not be found. Aug 10 23:15:59.173390 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:15:59.173390 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:15:59.173390 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:15:59.173390 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:15:59.173390 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:15:59.173390 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:15:59.173390 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:15:59.173390 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:15:59.173390 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:15:59.173390 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:15:59.173390 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:15:59.173390 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:15:59.173390 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:15:59.173390 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:15:59.173390 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:15:59.173390 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:15:59.173390 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59ecfba7-b76a-4b71-9821-bd330a20922f could not be found. Aug 10 23:15:59.173390 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:15:59.173390 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:15:59.173390 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:15:59.178348 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:15:59.178348 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:15:59.178348 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:15:59.178348 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:15:59.178348 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:15:59.178348 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59ecfba7-b76a-4b71-9821-bd330a20922f could not be found. Aug 10 23:15:59.178348 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:15:59.179880 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-4af4a60a-9715-42fa-acd1-5c8af44c8068 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] Returning 404 to user: Instance 59ecfba7-b76a-4b71-9821-bd330a20922f could not be found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:15:59.180924 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-4af4a60a-9715-42fa-acd1-5c8af44c8068 tempest-DeleteServersTestJSON-311075827 tempest-DeleteServersTestJSON-311075827-project] 10.222.0.58 "GET /compute/v2.1/servers/59ecfba7-b76a-4b71-9821-bd330a20922f" status: 404 len: 111 microversion: 2.1 time: 0.138718 Aug 10 23:15:59.184786 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1955/4077] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:59 2022] GET /compute/v2.1/servers/59ecfba7-b76a-4b71-9821-bd330a20922f => generated 111 bytes in 143 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:15:59.293842 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-cd887ca3-22c6-4701-8bbd-a5c91ae517a1 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:59.294871 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-cd887ca3-22c6-4701-8bbd-a5c91ae517a1 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:59.323887 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cd887ca3-22c6-4701-8bbd-a5c91ae517a1 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:59.324734 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cd887ca3-22c6-4701-8bbd-a5c91ae517a1 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:59.330192 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cd887ca3-22c6-4701-8bbd-a5c91ae517a1 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:59.334688 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cd887ca3-22c6-4701-8bbd-a5c91ae517a1 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:59.342409 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cd887ca3-22c6-4701-8bbd-a5c91ae517a1 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:59.343352 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cd887ca3-22c6-4701-8bbd-a5c91ae517a1 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:59.945962 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-cebaba1d-5530-496b-a2a2-94efd32ae182 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:15:59.947622 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-cebaba1d-5530-496b-a2a2-94efd32ae182 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] [instance: fdd1f85d-95db-477c-a173-a6fca94f58b1] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:15:59.967455 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cebaba1d-5530-496b-a2a2-94efd32ae182 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:59.968892 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cebaba1d-5530-496b-a2a2-94efd32ae182 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:59.970916 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cebaba1d-5530-496b-a2a2-94efd32ae182 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:15:59.973597 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cebaba1d-5530-496b-a2a2-94efd32ae182 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:15:59.975029 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cebaba1d-5530-496b-a2a2-94efd32ae182 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:15:59.976986 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cebaba1d-5530-496b-a2a2-94efd32ae182 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:00.545544 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-cd887ca3-22c6-4701-8bbd-a5c91ae517a1 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:16:00.560945 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-cd887ca3-22c6-4701-8bbd-a5c91ae517a1 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b" status: 200 len: 1528 microversion: 2.1 time: 1.276436 Aug 10 23:16:00.567398 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2123/4078] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:59 2022] GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b => generated 1528 bytes in 1284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:16:00.576523 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-f79917b8-2e4f-403d-9c42-3819951fbeb9 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:16:00.577151 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-f79917b8-2e4f-403d-9c42-3819951fbeb9 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] [instance: 27dd09d6-47ed-4b55-bd02-baad36a28429] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:16:00.602686 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f79917b8-2e4f-403d-9c42-3819951fbeb9 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:00.603256 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f79917b8-2e4f-403d-9c42-3819951fbeb9 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:00.603713 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f79917b8-2e4f-403d-9c42-3819951fbeb9 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:00.604448 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f79917b8-2e4f-403d-9c42-3819951fbeb9 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:00.604912 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f79917b8-2e4f-403d-9c42-3819951fbeb9 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:00.605350 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f79917b8-2e4f-403d-9c42-3819951fbeb9 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:00.801250 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-cebaba1d-5530-496b-a2a2-94efd32ae182 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cc4167255044d29a70c12a5a44d800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578d8e62013d43c5ad4d9a6d92e1f201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:16:00.822308 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-cebaba1d-5530-496b-a2a2-94efd32ae182 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] 10.222.0.58 "GET /compute/v2.1/servers/fdd1f85d-95db-477c-a173-a6fca94f58b1" status: 200 len: 1500 microversion: 2.1 time: 0.883749 Aug 10 23:16:00.823521 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1956/4079] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:15:59 2022] GET /compute/v2.1/servers/fdd1f85d-95db-477c-a173-a6fca94f58b1 => generated 1500 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:16:00.847041 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-eaf70c56-86fd-43d9-ac55-d6c0e2b4c007 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:16:00.852026 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-eaf70c56-86fd-43d9-ac55-d6c0e2b4c007 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '06cc4167255044d29a70c12a5a44d800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578d8e62013d43c5ad4d9a6d92e1f201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:16:00.852878 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-eaf70c56-86fd-43d9-ac55-d6c0e2b4c007 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': '578d8e62013d43c5ad4d9a6d92e1f201'} {{(pid=122632) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 10 23:16:00.884998 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-eaf70c56-86fd-43d9-ac55-d6c0e2b4c007 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:00.886898 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-eaf70c56-86fd-43d9-ac55-d6c0e2b4c007 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:00.890694 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-eaf70c56-86fd-43d9-ac55-d6c0e2b4c007 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:00.892930 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-eaf70c56-86fd-43d9-ac55-d6c0e2b4c007 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:00.896228 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-eaf70c56-86fd-43d9-ac55-d6c0e2b4c007 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:00.898144 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-eaf70c56-86fd-43d9-ac55-d6c0e2b4c007 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:01.085816 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.multi_cell_list [None req-eaf70c56-86fd-43d9-ac55-d6c0e2b4c007 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122632) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 10 23:16:01.088170 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-f79917b8-2e4f-403d-9c42-3819951fbeb9 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07c94ebf0954cdea12b9a689538d96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395d7c4077e54c43bb95288db3942b0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:16:01.102242 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-f79917b8-2e4f-403d-9c42-3819951fbeb9 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] 10.222.0.58 "GET /compute/v2.1/servers/27dd09d6-47ed-4b55-bd02-baad36a28429" status: 200 len: 1509 microversion: 2.1 time: 0.533647 Aug 10 23:16:01.105089 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2124/4080] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:16:00 2022] GET /compute/v2.1/servers/27dd09d6-47ed-4b55-bd02-baad36a28429 => generated 1509 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:16:01.203196 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-eaf70c56-86fd-43d9-ac55-d6c0e2b4c007 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] 10.222.0.58 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 346 microversion: 2.1 time: 0.361471 Aug 10 23:16:01.204389 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1957/4081] 10.222.0.58 () {58 vars in 1154 bytes} [Wed Aug 10 23:16:00 2022] GET /compute/v2.1/servers?status=shutoff => generated 346 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 23:16:01.217186 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-a6e04625-3cbc-4dbe-915b-6399d5f35910 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:16:01.228088 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a6e04625-3cbc-4dbe-915b-6399d5f35910 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:01.228999 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a6e04625-3cbc-4dbe-915b-6399d5f35910 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:01.229919 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a6e04625-3cbc-4dbe-915b-6399d5f35910 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:01.256885 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-a6e04625-3cbc-4dbe-915b-6399d5f35910 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] [instance: fdd1f85d-95db-477c-a173-a6fca94f58b1] Going to try to start instance {{(pid=122633) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 10 23:16:01.343009 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-a6e04625-3cbc-4dbe-915b-6399d5f35910 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] 10.222.0.58 "POST /compute/v2.1/servers/fdd1f85d-95db-477c-a173-a6fca94f58b1/action" status: 202 len: 0 microversion: 2.1 time: 0.130667 Aug 10 23:16:01.353392 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2125/4082] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:16:01 2022] POST /compute/v2.1/servers/fdd1f85d-95db-477c-a173-a6fca94f58b1/action => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:16:01.354742 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-a03c3d5a-a154-4d71-842d-6b8849ba754d tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:16:01.355393 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-a03c3d5a-a154-4d71-842d-6b8849ba754d tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] [instance: fdd1f85d-95db-477c-a173-a6fca94f58b1] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:16:01.364129 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a03c3d5a-a154-4d71-842d-6b8849ba754d tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:01.365611 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a03c3d5a-a154-4d71-842d-6b8849ba754d tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:01.367276 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a03c3d5a-a154-4d71-842d-6b8849ba754d tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:01.385459 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a03c3d5a-a154-4d71-842d-6b8849ba754d tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:01.389189 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a03c3d5a-a154-4d71-842d-6b8849ba754d tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:01.390583 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a03c3d5a-a154-4d71-842d-6b8849ba754d tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:01.583253 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c4d10c4c-e98c-4c34-940d-bb54b8c7b6f2 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:16:01.584096 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-c4d10c4c-e98c-4c34-940d-bb54b8c7b6f2 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:16:01.594818 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c4d10c4c-e98c-4c34-940d-bb54b8c7b6f2 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:01.601159 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c4d10c4c-e98c-4c34-940d-bb54b8c7b6f2 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:01.601879 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c4d10c4c-e98c-4c34-940d-bb54b8c7b6f2 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:01.602848 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c4d10c4c-e98c-4c34-940d-bb54b8c7b6f2 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:01.603475 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c4d10c4c-e98c-4c34-940d-bb54b8c7b6f2 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:01.604101 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c4d10c4c-e98c-4c34-940d-bb54b8c7b6f2 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:02.050911 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-a03c3d5a-a154-4d71-842d-6b8849ba754d tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cc4167255044d29a70c12a5a44d800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578d8e62013d43c5ad4d9a6d92e1f201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:16:02.069973 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-a03c3d5a-a154-4d71-842d-6b8849ba754d tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] 10.222.0.58 "GET /compute/v2.1/servers/fdd1f85d-95db-477c-a173-a6fca94f58b1" status: 200 len: 1509 microversion: 2.1 time: 0.720466 Aug 10 23:16:02.071467 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1958/4083] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:16:01 2022] GET /compute/v2.1/servers/fdd1f85d-95db-477c-a173-a6fca94f58b1 => generated 1509 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:16:02.129267 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-e981c963-28a8-4c7c-b798-00e63b5bc496 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:16:02.130681 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-e981c963-28a8-4c7c-b798-00e63b5bc496 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] [instance: 27dd09d6-47ed-4b55-bd02-baad36a28429] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:16:02.135839 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-c4d10c4c-e98c-4c34-940d-bb54b8c7b6f2 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:16:02.144896 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e981c963-28a8-4c7c-b798-00e63b5bc496 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:02.145726 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e981c963-28a8-4c7c-b798-00e63b5bc496 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:02.146376 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e981c963-28a8-4c7c-b798-00e63b5bc496 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:02.147312 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e981c963-28a8-4c7c-b798-00e63b5bc496 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:02.148818 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-c4d10c4c-e98c-4c34-940d-bb54b8c7b6f2 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b" status: 200 len: 1510 microversion: 2.1 time: 0.569658 Aug 10 23:16:02.149519 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2126/4084] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:16:01 2022] GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b => generated 1510 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:16:02.162639 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e981c963-28a8-4c7c-b798-00e63b5bc496 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:02.163523 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e981c963-28a8-4c7c-b798-00e63b5bc496 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:02.576375 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-e981c963-28a8-4c7c-b798-00e63b5bc496 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07c94ebf0954cdea12b9a689538d96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395d7c4077e54c43bb95288db3942b0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:16:02.590605 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-e981c963-28a8-4c7c-b798-00e63b5bc496 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] 10.222.0.58 "GET /compute/v2.1/servers/27dd09d6-47ed-4b55-bd02-baad36a28429" status: 200 len: 1515 microversion: 2.1 time: 0.464095 Aug 10 23:16:02.591644 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1959/4085] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:16:02 2022] GET /compute/v2.1/servers/27dd09d6-47ed-4b55-bd02-baad36a28429 => generated 1515 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:16:03.109456 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-51761b27-0652-49f8-aff6-b8dbb24b4343 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:16:03.114415 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-51761b27-0652-49f8-aff6-b8dbb24b4343 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] [instance: fdd1f85d-95db-477c-a173-a6fca94f58b1] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:16:03.140755 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-51761b27-0652-49f8-aff6-b8dbb24b4343 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:03.157022 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-51761b27-0652-49f8-aff6-b8dbb24b4343 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:03.157778 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-51761b27-0652-49f8-aff6-b8dbb24b4343 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:03.158826 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-51761b27-0652-49f8-aff6-b8dbb24b4343 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:03.162602 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-51761b27-0652-49f8-aff6-b8dbb24b4343 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:03.163430 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-51761b27-0652-49f8-aff6-b8dbb24b4343 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:03.170673 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-785200b1-f4e4-4674-bf68-a65ef88dd03e tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:16:03.173210 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-785200b1-f4e4-4674-bf68-a65ef88dd03e tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:16:03.180596 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-785200b1-f4e4-4674-bf68-a65ef88dd03e tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:03.181772 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-785200b1-f4e4-4674-bf68-a65ef88dd03e tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:03.182320 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-785200b1-f4e4-4674-bf68-a65ef88dd03e tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:03.183537 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-785200b1-f4e4-4674-bf68-a65ef88dd03e tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:03.184477 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-785200b1-f4e4-4674-bf68-a65ef88dd03e tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:03.185128 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-785200b1-f4e4-4674-bf68-a65ef88dd03e tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:03.484809 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-785200b1-f4e4-4674-bf68-a65ef88dd03e tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:16:03.505206 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-785200b1-f4e4-4674-bf68-a65ef88dd03e tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b" status: 200 len: 1510 microversion: 2.1 time: 0.338389 Aug 10 23:16:03.507160 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1960/4086] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:16:03 2022] GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b => generated 1510 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:16:03.709067 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-51761b27-0652-49f8-aff6-b8dbb24b4343 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cc4167255044d29a70c12a5a44d800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578d8e62013d43c5ad4d9a6d92e1f201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:16:03.720410 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-51761b27-0652-49f8-aff6-b8dbb24b4343 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] 10.222.0.58 "GET /compute/v2.1/servers/fdd1f85d-95db-477c-a173-a6fca94f58b1" status: 200 len: 1509 microversion: 2.1 time: 0.629259 Aug 10 23:16:03.731115 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2127/4087] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:16:03 2022] GET /compute/v2.1/servers/fdd1f85d-95db-477c-a173-a6fca94f58b1 => generated 1509 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:16:04.371872 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-4a79f638-464d-4cd3-8ef7-4b644fbd3538 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:16:04.372630 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-4a79f638-464d-4cd3-8ef7-4b644fbd3538 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] [instance: 250395b5-5be8-420a-8709-dcf8b4241a4e] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:16:04.381797 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-000012ce-577d-4fe4-bd24-e3efb6dad19c req-408f00c8-8f5f-4386-8f86-a42cd6f0c7dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "250395b5-5be8-420a-8709-dcf8b4241a4e", "tag": "fb6df67c-3dbb-4a0f-98f0-c602e1eaa615"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:16:04.404942 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4a79f638-464d-4cd3-8ef7-4b644fbd3538 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:04.405859 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4a79f638-464d-4cd3-8ef7-4b644fbd3538 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:04.410930 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4a79f638-464d-4cd3-8ef7-4b644fbd3538 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:04.414739 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4a79f638-464d-4cd3-8ef7-4b644fbd3538 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:04.416424 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4a79f638-464d-4cd3-8ef7-4b644fbd3538 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:04.416940 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-000012ce-577d-4fe4-bd24-e3efb6dad19c req-408f00c8-8f5f-4386-8f86-a42cd6f0c7dc service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:04.417491 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4a79f638-464d-4cd3-8ef7-4b644fbd3538 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:04.419261 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-000012ce-577d-4fe4-bd24-e3efb6dad19c req-408f00c8-8f5f-4386-8f86-a42cd6f0c7dc service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:04.424265 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-000012ce-577d-4fe4-bd24-e3efb6dad19c req-408f00c8-8f5f-4386-8f86-a42cd6f0c7dc service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:04.457185 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-000012ce-577d-4fe4-bd24-e3efb6dad19c req-408f00c8-8f5f-4386-8f86-a42cd6f0c7dc service nova] Creating event network-changed:fb6df67c-3dbb-4a0f-98f0-c602e1eaa615 for instance 250395b5-5be8-420a-8709-dcf8b4241a4e on n-h1-850468-14 Aug 10 23:16:04.462664 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-000012ce-577d-4fe4-bd24-e3efb6dad19c req-408f00c8-8f5f-4386-8f86-a42cd6f0c7dc service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085510 Aug 10 23:16:04.463938 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2128/4088] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:16:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 23:16:04.528685 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-39e88bfd-ecf0-4526-b30d-187f61d1c43c tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:16:04.529980 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-39e88bfd-ecf0-4526-b30d-187f61d1c43c tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:16:04.545733 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-39e88bfd-ecf0-4526-b30d-187f61d1c43c tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:04.546542 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-39e88bfd-ecf0-4526-b30d-187f61d1c43c tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:04.547346 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-39e88bfd-ecf0-4526-b30d-187f61d1c43c tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:04.548182 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-39e88bfd-ecf0-4526-b30d-187f61d1c43c tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:04.548765 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-39e88bfd-ecf0-4526-b30d-187f61d1c43c tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:04.549994 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-39e88bfd-ecf0-4526-b30d-187f61d1c43c tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:04.973685 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-4a79f638-464d-4cd3-8ef7-4b644fbd3538 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5899b2ad9f1046caaf7c6073e408eeee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25abd63376614081a9d484f3c9ae950d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:16:04.985977 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-4a79f638-464d-4cd3-8ef7-4b644fbd3538 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "GET /compute/v2.1/servers/250395b5-5be8-420a-8709-dcf8b4241a4e" status: 200 len: 1563 microversion: 2.1 time: 0.617601 Aug 10 23:16:04.989209 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1961/4089] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:16:04 2022] GET /compute/v2.1/servers/250395b5-5be8-420a-8709-dcf8b4241a4e => generated 1563 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:16:05.004807 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-15feb501-1f79-4e9e-8646-5deb688586c0 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:16:05.005940 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-15feb501-1f79-4e9e-8646-5deb688586c0 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] [instance: fdd1f85d-95db-477c-a173-a6fca94f58b1] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:16:05.023486 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-15feb501-1f79-4e9e-8646-5deb688586c0 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:05.026559 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-15feb501-1f79-4e9e-8646-5deb688586c0 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:05.027363 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-15feb501-1f79-4e9e-8646-5deb688586c0 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:05.028491 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-15feb501-1f79-4e9e-8646-5deb688586c0 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:05.031322 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-15feb501-1f79-4e9e-8646-5deb688586c0 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:05.032099 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-15feb501-1f79-4e9e-8646-5deb688586c0 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:05.540588 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-15feb501-1f79-4e9e-8646-5deb688586c0 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cc4167255044d29a70c12a5a44d800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578d8e62013d43c5ad4d9a6d92e1f201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:16:05.553568 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-15feb501-1f79-4e9e-8646-5deb688586c0 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] 10.222.0.58 "GET /compute/v2.1/servers/fdd1f85d-95db-477c-a173-a6fca94f58b1" status: 200 len: 1513 microversion: 2.1 time: 0.561918 Aug 10 23:16:05.557649 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1962/4090] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:16:04 2022] GET /compute/v2.1/servers/fdd1f85d-95db-477c-a173-a6fca94f58b1 => generated 1513 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:16:05.581912 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-bc75b373-263a-4dbf-b459-e37a2819eee9 req-5bdf4c81-a0b4-4fe5-96e4-22b82ccf1596 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23bbe055-4a92-4b96-8b89-c941229bfb0b", "name": "network-vif-unplugged", "status": "completed", "tag": "6f537f41-6630-4a1c-b82e-c0862b0fc22c"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:16:05.611150 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-bc75b373-263a-4dbf-b459-e37a2819eee9 req-5bdf4c81-a0b4-4fe5-96e4-22b82ccf1596 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:05.617393 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-bc75b373-263a-4dbf-b459-e37a2819eee9 req-5bdf4c81-a0b4-4fe5-96e4-22b82ccf1596 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:05.618213 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-bc75b373-263a-4dbf-b459-e37a2819eee9 req-5bdf4c81-a0b4-4fe5-96e4-22b82ccf1596 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:05.653880 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-bc75b373-263a-4dbf-b459-e37a2819eee9 req-5bdf4c81-a0b4-4fe5-96e4-22b82ccf1596 service nova] Creating event network-vif-unplugged:6f537f41-6630-4a1c-b82e-c0862b0fc22c for instance 23bbe055-4a92-4b96-8b89-c941229bfb0b on n-h2-850468-14 Aug 10 23:16:05.670912 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-bc75b373-263a-4dbf-b459-e37a2819eee9 req-5bdf4c81-a0b4-4fe5-96e4-22b82ccf1596 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.108199 Aug 10 23:16:05.673298 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1963/4091] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:16:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:16:05.678593 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-39e88bfd-ecf0-4526-b30d-187f61d1c43c tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:16:05.686745 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-1125b65d-d626-4187-9a23-b3c54f8272fb tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Action: 'create', calling method: .version_select at 0x7f8482441670>, body: {"keypair": {"name": "tempest-keypair-1159157016", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBACZCkJiS4f4yB4pE9s692jHL21kXhVAm64+e9cWVymbH3K9AAYkQZdlGCnXun2vNT/hIu/1y+5QgckUpCE5Hy7vVfn12jAEM5SNR+a0xZ9BsKktE0kzIXwZ7BSv88bwNw=="}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:16:05.688262 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-39e88bfd-ecf0-4526-b30d-187f61d1c43c tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b" status: 200 len: 1510 microversion: 2.1 time: 1.164056 Aug 10 23:16:05.694238 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2129/4092] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:16:04 2022] GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b => generated 1510 bytes in 1171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:16:05.712216 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-d2e6afd5-eb2d-40ee-bc5b-22ea933fb9c3 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:16:05.730625 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-1125b65d-d626-4187-9a23-b3c54f8272fb tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Getting quotas for project 395d7c4077e54c43bb95288db3942b0a. Resources: {'key_pairs'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:16:05.737621 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-d2e6afd5-eb2d-40ee-bc5b-22ea933fb9c3 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '06cc4167255044d29a70c12a5a44d800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578d8e62013d43c5ad4d9a6d92e1f201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:16:05.739488 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-1125b65d-d626-4187-9a23-b3c54f8272fb tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Getting quotas for user f07c94ebf0954cdea12b9a689538d96d and project 395d7c4077e54c43bb95288db3942b0a. Resources: {'key_pairs'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:16:05.743844 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.compute.servers [None req-d2e6afd5-eb2d-40ee-bc5b-22ea933fb9c3 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Removing options 'limit' from query {{(pid=122633) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 10 23:16:05.747388 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-d2e6afd5-eb2d-40ee-bc5b-22ea933fb9c3 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Searching by: {'deleted': False, 'project_id': '578d8e62013d43c5ad4d9a6d92e1f201'} {{(pid=122633) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 10 23:16:05.748599 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d2e6afd5-eb2d-40ee-bc5b-22ea933fb9c3 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:05.749098 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d2e6afd5-eb2d-40ee-bc5b-22ea933fb9c3 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:05.749543 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d2e6afd5-eb2d-40ee-bc5b-22ea933fb9c3 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:05.750291 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d2e6afd5-eb2d-40ee-bc5b-22ea933fb9c3 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:05.750749 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d2e6afd5-eb2d-40ee-bc5b-22ea933fb9c3 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:05.751251 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d2e6afd5-eb2d-40ee-bc5b-22ea933fb9c3 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:05.752759 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-d2e6afd5-eb2d-40ee-bc5b-22ea933fb9c3 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] 10.222.0.58 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.055894 Aug 10 23:16:05.765076 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2130/4093] 10.222.0.58 () {58 vars in 1140 bytes} [Wed Aug 10 23:16:05 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 23:16:05.788223 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-1125b65d-d626-4187-9a23-b3c54f8272fb tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.110256 Aug 10 23:16:05.792533 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1964/4094] 10.222.0.58 () {60 vars in 1159 bytes} [Wed Aug 10 23:16:05 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:16:05.792969 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-18485c36-7364-4c16-bc97-540c8edf21b2 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:16:05.794967 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-18485c36-7364-4c16-bc97-540c8edf21b2 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] [instance: fdd1f85d-95db-477c-a173-a6fca94f58b1] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:16:05.805645 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_api:SELECT=100 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:16:05.818811 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-18485c36-7364-4c16-bc97-540c8edf21b2 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:05.819741 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-18485c36-7364-4c16-bc97-540c8edf21b2 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:05.821067 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-18485c36-7364-4c16-bc97-540c8edf21b2 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:05.824498 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-18485c36-7364-4c16-bc97-540c8edf21b2 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:05.827067 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-18485c36-7364-4c16-bc97-540c8edf21b2 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:05.828732 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-18485c36-7364-4c16-bc97-540c8edf21b2 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:06.096852 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-18485c36-7364-4c16-bc97-540c8edf21b2 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cc4167255044d29a70c12a5a44d800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578d8e62013d43c5ad4d9a6d92e1f201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:16:06.107400 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-18485c36-7364-4c16-bc97-540c8edf21b2 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] 10.222.0.58 "GET /compute/v2.1/servers/fdd1f85d-95db-477c-a173-a6fca94f58b1" status: 200 len: 1513 microversion: 2.1 time: 0.328539 Aug 10 23:16:06.108490 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2131/4095] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:16:05 2022] GET /compute/v2.1/servers/fdd1f85d-95db-477c-a173-a6fca94f58b1 => generated 1513 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:16:06.135330 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-38eb7036-0ce4-4fcf-910a-ae06ab67e788 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:16:06.136434 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-38eb7036-0ce4-4fcf-910a-ae06ab67e788 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] [instance: c679e2a4-89de-4fcf-aed1-273220fdb2e8] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:16:06.143514 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-38eb7036-0ce4-4fcf-910a-ae06ab67e788 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:06.144087 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-38eb7036-0ce4-4fcf-910a-ae06ab67e788 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:06.144734 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-38eb7036-0ce4-4fcf-910a-ae06ab67e788 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:06.145514 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-38eb7036-0ce4-4fcf-910a-ae06ab67e788 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:06.146039 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-38eb7036-0ce4-4fcf-910a-ae06ab67e788 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:06.146535 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-38eb7036-0ce4-4fcf-910a-ae06ab67e788 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:06.362610 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-38eb7036-0ce4-4fcf-910a-ae06ab67e788 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cc4167255044d29a70c12a5a44d800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578d8e62013d43c5ad4d9a6d92e1f201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:16:06.410581 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-38eb7036-0ce4-4fcf-910a-ae06ab67e788 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] 10.222.0.58 "GET /compute/v2.1/servers/c679e2a4-89de-4fcf-aed1-273220fdb2e8" status: 200 len: 1512 microversion: 2.1 time: 0.282535 Aug 10 23:16:06.428521 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1965/4096] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:16:06 2022] GET /compute/v2.1/servers/c679e2a4-89de-4fcf-aed1-273220fdb2e8 => generated 1512 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:16:06.486449 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-3034af04-704f-423e-a9d9-455dd9a2b9e9 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:16:06.492919 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-3034af04-704f-423e-a9d9-455dd9a2b9e9 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] [instance: 1c71b2c8-4cbd-4c02-bb74-ba27adb70325] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:16:06.517136 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3034af04-704f-423e-a9d9-455dd9a2b9e9 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:06.518190 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3034af04-704f-423e-a9d9-455dd9a2b9e9 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:06.518966 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3034af04-704f-423e-a9d9-455dd9a2b9e9 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:06.519703 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3034af04-704f-423e-a9d9-455dd9a2b9e9 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:06.520153 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3034af04-704f-423e-a9d9-455dd9a2b9e9 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:06.520588 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3034af04-704f-423e-a9d9-455dd9a2b9e9 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:06.735363 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-b5279324-9228-48ef-9bca-bf186fe12db4 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:16:06.740279 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-b5279324-9228-48ef-9bca-bf186fe12db4 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:16:06.780932 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b5279324-9228-48ef-9bca-bf186fe12db4 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:06.784659 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b5279324-9228-48ef-9bca-bf186fe12db4 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:06.788443 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b5279324-9228-48ef-9bca-bf186fe12db4 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:06.791306 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b5279324-9228-48ef-9bca-bf186fe12db4 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:06.793233 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b5279324-9228-48ef-9bca-bf186fe12db4 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:06.796073 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b5279324-9228-48ef-9bca-bf186fe12db4 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:06.974094 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-3034af04-704f-423e-a9d9-455dd9a2b9e9 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cc4167255044d29a70c12a5a44d800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578d8e62013d43c5ad4d9a6d92e1f201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:16:07.012770 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-3034af04-704f-423e-a9d9-455dd9a2b9e9 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] 10.222.0.58 "GET /compute/v2.1/servers/1c71b2c8-4cbd-4c02-bb74-ba27adb70325" status: 200 len: 1512 microversion: 2.1 time: 0.557423 Aug 10 23:16:07.013267 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2132/4097] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:16:06 2022] GET /compute/v2.1/servers/1c71b2c8-4cbd-4c02-bb74-ba27adb70325 => generated 1512 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:16:07.062964 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-b19ec643-6d53-4d5c-a2b3-582098725955 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:16:07.073584 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-b19ec643-6d53-4d5c-a2b3-582098725955 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '06cc4167255044d29a70c12a5a44d800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578d8e62013d43c5ad4d9a6d92e1f201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:16:07.081986 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-b19ec643-6d53-4d5c-a2b3-582098725955 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Searching by: {'ip': '172.20.0.11', 'deleted': False, 'project_id': '578d8e62013d43c5ad4d9a6d92e1f201'} {{(pid=122633) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 10 23:16:07.179801 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-b5279324-9228-48ef-9bca-bf186fe12db4 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:16:07.193313 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-b5279324-9228-48ef-9bca-bf186fe12db4 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b" status: 200 len: 1453 microversion: 2.1 time: 0.474543 Aug 10 23:16:07.209473 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1966/4098] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:16:06 2022] GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b => generated 1453 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:16:07.221770 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-d4865cb8-7152-49bf-b068-8f3f18ab2d5c tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:16:07.222402 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-d4865cb8-7152-49bf-b068-8f3f18ab2d5c tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:16:07.233842 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d4865cb8-7152-49bf-b068-8f3f18ab2d5c tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:07.234691 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d4865cb8-7152-49bf-b068-8f3f18ab2d5c tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:07.235467 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d4865cb8-7152-49bf-b068-8f3f18ab2d5c tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:07.237847 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d4865cb8-7152-49bf-b068-8f3f18ab2d5c tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:07.239453 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d4865cb8-7152-49bf-b068-8f3f18ab2d5c tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:07.240174 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d4865cb8-7152-49bf-b068-8f3f18ab2d5c tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:07.348517 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b19ec643-6d53-4d5c-a2b3-582098725955 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:07.350658 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b19ec643-6d53-4d5c-a2b3-582098725955 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:07.352408 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b19ec643-6d53-4d5c-a2b3-582098725955 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:07.369186 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b19ec643-6d53-4d5c-a2b3-582098725955 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:07.372176 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b19ec643-6d53-4d5c-a2b3-582098725955 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:07.373517 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b19ec643-6d53-4d5c-a2b3-582098725955 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:07.733402 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-d4865cb8-7152-49bf-b068-8f3f18ab2d5c tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:16:07.738543 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.multi_cell_list [None req-b19ec643-6d53-4d5c-a2b3-582098725955 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122633) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 10 23:16:07.747963 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-d4865cb8-7152-49bf-b068-8f3f18ab2d5c tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b" status: 200 len: 1453 microversion: 2.1 time: 0.535769 Aug 10 23:16:07.794891 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1967/4099] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:16:07 2022] GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b => generated 1453 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:16:07.850515 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-4aba2f58-7dee-490b-be86-6d29528f6df5 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:16:07.851362 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-4aba2f58-7dee-490b-be86-6d29528f6df5 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:16:07.864559 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4aba2f58-7dee-490b-be86-6d29528f6df5 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:07.865538 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4aba2f58-7dee-490b-be86-6d29528f6df5 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:07.866203 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4aba2f58-7dee-490b-be86-6d29528f6df5 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:07.871126 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4aba2f58-7dee-490b-be86-6d29528f6df5 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:07.871933 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4aba2f58-7dee-490b-be86-6d29528f6df5 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:07.872585 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4aba2f58-7dee-490b-be86-6d29528f6df5 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:07.908937 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=100 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:16:07.912620 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-b19ec643-6d53-4d5c-a2b3-582098725955 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] 10.222.0.58 "GET /compute/v2.1/servers?ip=172.20.0.11" status: 200 len: 346 microversion: 2.1 time: 0.863612 Aug 10 23:16:07.917043 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2133/4100] 10.222.0.58 () {58 vars in 1154 bytes} [Wed Aug 10 23:16:07 2022] GET /compute/v2.1/servers?ip=172.20.0.11 => generated 346 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 23:16:07.930521 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-d428f4d2-b880-4082-bb35-fc9b40b1d75b tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:16:07.931184 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-d428f4d2-b880-4082-bb35-fc9b40b1d75b tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] [instance: fdd1f85d-95db-477c-a173-a6fca94f58b1] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:16:07.933336 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.objects.instance [None req-4aba2f58-7dee-490b-be86-6d29528f6df5 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lazy-loading 'flavor' on Instance uuid 23bbe055-4a92-4b96-8b89-c941229bfb0b {{(pid=122632) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:16:07.941519 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d428f4d2-b880-4082-bb35-fc9b40b1d75b tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:07.947379 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d428f4d2-b880-4082-bb35-fc9b40b1d75b tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:07.947971 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d428f4d2-b880-4082-bb35-fc9b40b1d75b tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:07.949048 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d428f4d2-b880-4082-bb35-fc9b40b1d75b tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:07.949727 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d428f4d2-b880-4082-bb35-fc9b40b1d75b tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:07.951424 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d428f4d2-b880-4082-bb35-fc9b40b1d75b tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:07.960224 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-4aba2f58-7dee-490b-be86-6d29528f6df5 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] HTTP exception thrown: Cannot 'shelve' instance 23bbe055-4a92-4b96-8b89-c941229bfb0b while it is in vm_state shelved_offloaded Aug 10 23:16:07.962744 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-4aba2f58-7dee-490b-be86-6d29528f6df5 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Request method failure captured: Aug 10 23:16:07.962744 n-d-850468-14 devstack@n-api.service[122632]: request: POST /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b/action HTTP/1.1 Aug 10 23:16:07.962744 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:16:07.962744 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:16:07.962744 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:16:07.962744 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 14 Aug 10 23:16:07.962744 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:16:07.962744 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:16:07.962744 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:16:07.962744 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:16:07.962744 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9DuIKrfOsS8tKST0PsIPrvuNPfsVISfOPvUoe9ddkVcTJKj7rDjd3OuH9u-DTT1aypj1AUoUKtajD98eDOUOHSpPisBSdRlSCov30lHf1uZq-XZLyBIVg5kAG8-SuXk2s1TL7EnRcjjMARSkm95dZDnXaBXRT3M4f8UoMDwqu7xK7gQ Aug 10 23:16:07.962744 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:16:07.962744 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:16:07.962744 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:16:07.962744 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:16:07.962744 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:16:07.962744 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:16:07.962744 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: d11bbb3e87f4463787da56ab19108822 Aug 10 23:16:07.962744 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-ServersNegativeTestJSON-1216728002 Aug 10 23:16:07.962744 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:16:07.962744 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:16:07.962744 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d11bbb3e87f4463787da56ab19108822"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d11bbb3e87f4463787da56ab19108822"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d11bbb3e87f4463787da56ab19108822"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d11bbb3e87f4463787da56ab19108822", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:16:07.962744 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-ServersNegativeTestJSON-1216728002 Aug 10 23:16:07.962744 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: d11bbb3e87f4463787da56ab19108822 Aug 10 23:16:07.962744 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1216728002 Aug 10 23:16:07.962744 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-ServersNegativeTestJSON-1216728002-project Aug 10 23:16:07.962744 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:16:07.962744 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:16:07.962744 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: f284ec2a4bf546b58c1c1adaf880e1fb Aug 10 23:16:07.962744 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-ServersNegativeTestJSON-1216728002-project Aug 10 23:16:07.962744 n-d-850468-14 devstack@n-api.service[122632]: Aug 10 23:16:07.962744 n-d-850468-14 devstack@n-api.service[122632]: {"shelve": {}} Aug 10 23:16:07.962744 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:16:07.962744 n-d-850468-14 devstack@n-api.service[122632]: exception: Cannot 'shelve' instance 23bbe055-4a92-4b96-8b89-c941229bfb0b while it is in vm_state shelved_offloaded Aug 10 23:16:07.962744 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': '23bbe055-4a92-4b96-8b89-c941229bfb0b', 'body': {'shelve': {}}} Aug 10 23:16:07.962744 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:16:07.962744 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:16:07.962744 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve Aug 10 23:16:07.962744 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) Aug 10 23:16:07.962744 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Aug 10 23:16:07.962744 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 10 23:16:07.962744 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Aug 10 23:16:07.962744 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 10 23:16:07.962744 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Aug 10 23:16:07.962744 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 10 23:16:07.962744 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Aug 10 23:16:07.962744 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 10 23:16:07.962744 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 10 23:16:07.962744 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 10 23:16:07.962744 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 10 23:16:07.962744 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 10 23:16:07.962744 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 23bbe055-4a92-4b96-8b89-c941229bfb0b in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. Aug 10 23:16:07.962744 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:16:07.962744 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:16:07.962744 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:16:07.962744 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:16:07.962744 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:16:07.962744 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:16:07.962744 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:16:07.962744 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:16:07.962744 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:16:07.962744 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:16:07.962744 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve Aug 10 23:16:07.962744 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 10 23:16:07.968268 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 10 23:16:07.968268 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 10 23:16:07.968268 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance 23bbe055-4a92-4b96-8b89-c941229bfb0b while it is in vm_state shelved_offloaded Aug 10 23:16:07.968268 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:16:07.968268 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:16:07.968268 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:16:07.968268 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:16:07.968268 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:16:07.968268 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:16:07.968268 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:16:07.968268 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:16:07.968268 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance 23bbe055-4a92-4b96-8b89-c941229bfb0b while it is in vm_state shelved_offloaded Aug 10 23:16:07.968268 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:16:07.974871 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-4aba2f58-7dee-490b-be86-6d29528f6df5 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Returning 409 to user: Cannot 'shelve' instance 23bbe055-4a92-4b96-8b89-c941229bfb0b while it is in vm_state shelved_offloaded {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:16:07.975988 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-4aba2f58-7dee-490b-be86-6d29528f6df5 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "POST /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b/action" status: 409 len: 155 microversion: 2.1 time: 0.130433 Aug 10 23:16:07.976798 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1968/4101] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:16:07 2022] POST /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b/action => generated 155 bytes in 132 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 10 23:16:07.988040 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-cd014773-ae5f-478d-9e6d-00a139433122 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:16:07.989807 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-cd014773-ae5f-478d-9e6d-00a139433122 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:16:08.002540 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cd014773-ae5f-478d-9e6d-00a139433122 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:08.008899 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cd014773-ae5f-478d-9e6d-00a139433122 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:08.009766 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cd014773-ae5f-478d-9e6d-00a139433122 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:08.010739 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cd014773-ae5f-478d-9e6d-00a139433122 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:08.011440 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cd014773-ae5f-478d-9e6d-00a139433122 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:08.012099 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cd014773-ae5f-478d-9e6d-00a139433122 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:08.097182 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-cd014773-ae5f-478d-9e6d-00a139433122 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=122632) unshelve /opt/stack/nova/nova/compute/api.py:4544}} Aug 10 23:16:08.349920 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-cd014773-ae5f-478d-9e6d-00a139433122 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "POST /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b/action" status: 202 len: 0 microversion: 2.1 time: 0.366943 Aug 10 23:16:08.352247 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1969/4102] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:16:07 2022] POST /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b/action => generated 0 bytes in 370 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 10 23:16:08.371967 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-ba6f8777-6fe2-4777-8ec7-c1a50a4b7cc6 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:16:08.371967 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-ba6f8777-6fe2-4777-8ec7-c1a50a4b7cc6 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:16:08.379177 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ba6f8777-6fe2-4777-8ec7-c1a50a4b7cc6 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:08.379893 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ba6f8777-6fe2-4777-8ec7-c1a50a4b7cc6 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:08.380512 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ba6f8777-6fe2-4777-8ec7-c1a50a4b7cc6 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:08.381406 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ba6f8777-6fe2-4777-8ec7-c1a50a4b7cc6 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:08.382018 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ba6f8777-6fe2-4777-8ec7-c1a50a4b7cc6 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:08.382600 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ba6f8777-6fe2-4777-8ec7-c1a50a4b7cc6 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:08.383192 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-d428f4d2-b880-4082-bb35-fc9b40b1d75b tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cc4167255044d29a70c12a5a44d800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578d8e62013d43c5ad4d9a6d92e1f201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:16:08.393553 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-d428f4d2-b880-4082-bb35-fc9b40b1d75b tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] 10.222.0.58 "GET /compute/v2.1/servers/fdd1f85d-95db-477c-a173-a6fca94f58b1" status: 200 len: 1513 microversion: 2.1 time: 0.467193 Aug 10 23:16:08.410817 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2134/4103] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:16:07 2022] GET /compute/v2.1/servers/fdd1f85d-95db-477c-a173-a6fca94f58b1 => generated 1513 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:16:08.428499 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-a48f51f1-4f4f-4443-9461-16262e45fcdc tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:16:08.435217 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-a48f51f1-4f4f-4443-9461-16262e45fcdc tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] [instance: c679e2a4-89de-4fcf-aed1-273220fdb2e8] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:16:08.461943 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a48f51f1-4f4f-4443-9461-16262e45fcdc tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:08.462443 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a48f51f1-4f4f-4443-9461-16262e45fcdc tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:08.462957 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a48f51f1-4f4f-4443-9461-16262e45fcdc tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:08.463694 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a48f51f1-4f4f-4443-9461-16262e45fcdc tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:08.464161 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a48f51f1-4f4f-4443-9461-16262e45fcdc tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:08.465706 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a48f51f1-4f4f-4443-9461-16262e45fcdc tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:08.835919 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-a48f51f1-4f4f-4443-9461-16262e45fcdc tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cc4167255044d29a70c12a5a44d800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578d8e62013d43c5ad4d9a6d92e1f201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:16:08.844863 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-a48f51f1-4f4f-4443-9461-16262e45fcdc tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] 10.222.0.58 "GET /compute/v2.1/servers/c679e2a4-89de-4fcf-aed1-273220fdb2e8" status: 200 len: 1512 microversion: 2.1 time: 0.425108 Aug 10 23:16:08.851162 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2135/4104] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:16:08 2022] GET /compute/v2.1/servers/c679e2a4-89de-4fcf-aed1-273220fdb2e8 => generated 1512 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:16:08.869708 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-1102169e-7b46-4463-9f41-5881bff6fe4b tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:16:08.870707 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-1102169e-7b46-4463-9f41-5881bff6fe4b tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] [instance: 1c71b2c8-4cbd-4c02-bb74-ba27adb70325] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:16:08.878354 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1102169e-7b46-4463-9f41-5881bff6fe4b tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:08.879201 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1102169e-7b46-4463-9f41-5881bff6fe4b tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:08.879838 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1102169e-7b46-4463-9f41-5881bff6fe4b tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:08.880776 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1102169e-7b46-4463-9f41-5881bff6fe4b tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:08.882283 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1102169e-7b46-4463-9f41-5881bff6fe4b tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:08.883184 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1102169e-7b46-4463-9f41-5881bff6fe4b tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:08.961563 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-ba6f8777-6fe2-4777-8ec7-c1a50a4b7cc6 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:16:08.975915 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-ba6f8777-6fe2-4777-8ec7-c1a50a4b7cc6 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b" status: 200 len: 1461 microversion: 2.1 time: 0.619608 Aug 10 23:16:08.977869 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1970/4105] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:16:08 2022] GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b => generated 1461 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:16:09.122827 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-1102169e-7b46-4463-9f41-5881bff6fe4b tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cc4167255044d29a70c12a5a44d800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578d8e62013d43c5ad4d9a6d92e1f201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:16:09.139561 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-1102169e-7b46-4463-9f41-5881bff6fe4b tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] 10.222.0.58 "GET /compute/v2.1/servers/1c71b2c8-4cbd-4c02-bb74-ba27adb70325" status: 200 len: 1512 microversion: 2.1 time: 0.273663 Aug 10 23:16:09.140728 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2136/4106] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:16:08 2022] GET /compute/v2.1/servers/1c71b2c8-4cbd-4c02-bb74-ba27adb70325 => generated 1512 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:16:09.173787 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-b1e19cb5-8853-4cff-a9f6-b50db7d3d12c tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:16:09.184318 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-b1e19cb5-8853-4cff-a9f6-b50db7d3d12c tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '06cc4167255044d29a70c12a5a44d800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578d8e62013d43c5ad4d9a6d92e1f201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:16:09.202180 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-b1e19cb5-8853-4cff-a9f6-b50db7d3d12c tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Searching by: {'deleted': False, 'project_id': '578d8e62013d43c5ad4d9a6d92e1f201'} {{(pid=122632) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 10 23:16:09.212139 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b1e19cb5-8853-4cff-a9f6-b50db7d3d12c tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:09.212868 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b1e19cb5-8853-4cff-a9f6-b50db7d3d12c tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:09.214144 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b1e19cb5-8853-4cff-a9f6-b50db7d3d12c tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:09.215767 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b1e19cb5-8853-4cff-a9f6-b50db7d3d12c tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:09.217035 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b1e19cb5-8853-4cff-a9f6-b50db7d3d12c tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:09.218305 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b1e19cb5-8853-4cff-a9f6-b50db7d3d12c tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:09.302354 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.multi_cell_list [None req-b1e19cb5-8853-4cff-a9f6-b50db7d3d12c tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122632) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 10 23:16:09.376042 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-b1e19cb5-8853-4cff-a9f6-b50db7d3d12c tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cc4167255044d29a70c12a5a44d800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578d8e62013d43c5ad4d9a6d92e1f201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:16:09.418260 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b1e19cb5-8853-4cff-a9f6-b50db7d3d12c tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:09.420314 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b1e19cb5-8853-4cff-a9f6-b50db7d3d12c tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:09.420932 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b1e19cb5-8853-4cff-a9f6-b50db7d3d12c tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:09.998054 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-88ddc68d-b878-4cca-a507-15ba35e32b28 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:16:09.998674 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-88ddc68d-b878-4cca-a507-15ba35e32b28 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:16:10.009395 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-88ddc68d-b878-4cca-a507-15ba35e32b28 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:10.019452 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-88ddc68d-b878-4cca-a507-15ba35e32b28 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:10.020233 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-88ddc68d-b878-4cca-a507-15ba35e32b28 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:10.021211 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-88ddc68d-b878-4cca-a507-15ba35e32b28 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:10.021878 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-88ddc68d-b878-4cca-a507-15ba35e32b28 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:10.022508 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-88ddc68d-b878-4cca-a507-15ba35e32b28 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:10.027553 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:16:10.570526 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-b1e19cb5-8853-4cff-a9f6-b50db7d3d12c tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] 10.222.0.58 "GET /compute/v2.1/servers/detail" status: 200 len: 4520 microversion: 2.1 time: 1.409224 Aug 10 23:16:10.571815 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1971/4107] 10.222.0.58 () {58 vars in 1146 bytes} [Wed Aug 10 23:16:09 2022] GET /compute/v2.1/servers/detail => generated 4520 bytes in 1412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:16:10.596309 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-40321f77-0c2e-4314-ba06-d516c5f17c50 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:16:10.608345 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-40321f77-0c2e-4314-ba06-d516c5f17c50 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '06cc4167255044d29a70c12a5a44d800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578d8e62013d43c5ad4d9a6d92e1f201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:16:10.618366 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-40321f77-0c2e-4314-ba06-d516c5f17c50 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': '578d8e62013d43c5ad4d9a6d92e1f201'} {{(pid=122632) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 10 23:16:10.865256 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-88ddc68d-b878-4cca-a507-15ba35e32b28 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:16:10.901043 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-88ddc68d-b878-4cca-a507-15ba35e32b28 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b" status: 200 len: 1461 microversion: 2.1 time: 0.905946 Aug 10 23:16:10.905814 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2137/4108] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:16:09 2022] GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b => generated 1461 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:16:10.934411 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-40321f77-0c2e-4314-ba06-d516c5f17c50 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:10.937069 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-37cbfb9f-9ef5-49f3-a089-e3fa540c0844 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1832492048", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6cf41fc6-d8ed-4aac-8496-23731f15bebe"}], "security_groups": [{"name": "tempest-securitygroup--2092384362"}], "key_name": "tempest-keypair-1159157016", "user_data": "}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:16:10.938253 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-40321f77-0c2e-4314-ba06-d516c5f17c50 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:10.938729 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-40321f77-0c2e-4314-ba06-d516c5f17c50 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:10.942176 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-40321f77-0c2e-4314-ba06-d516c5f17c50 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:10.942678 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-40321f77-0c2e-4314-ba06-d516c5f17c50 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:10.945239 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-40321f77-0c2e-4314-ba06-d516c5f17c50 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:11.098360 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.multi_cell_list [None req-40321f77-0c2e-4314-ba06-d516c5f17c50 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122632) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 10 23:16:11.167482 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-40321f77-0c2e-4314-ba06-d516c5f17c50 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] 10.222.0.58 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1012 microversion: 2.1 time: 0.575419 Aug 10 23:16:11.168222 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1972/4109] 10.222.0.58 () {58 vars in 1150 bytes} [Wed Aug 10 23:16:10 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1012 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:16:11.184247 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-3a474d3b-e4ec-4640-94bf-52d238066083 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:16:11.192514 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-3a474d3b-e4ec-4640-94bf-52d238066083 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '06cc4167255044d29a70c12a5a44d800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578d8e62013d43c5ad4d9a6d92e1f201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:16:11.193202 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-3a474d3b-e4ec-4640-94bf-52d238066083 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': '578d8e62013d43c5ad4d9a6d92e1f201'} {{(pid=122632) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 10 23:16:11.198998 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3a474d3b-e4ec-4640-94bf-52d238066083 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:11.199509 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3a474d3b-e4ec-4640-94bf-52d238066083 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:11.199944 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3a474d3b-e4ec-4640-94bf-52d238066083 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:11.200665 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3a474d3b-e4ec-4640-94bf-52d238066083 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:11.201111 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3a474d3b-e4ec-4640-94bf-52d238066083 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:11.201529 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3a474d3b-e4ec-4640-94bf-52d238066083 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:11.284390 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.network.neutron [None req-37cbfb9f-9ef5-49f3-a089-e3fa540c0844 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] validate_networks() for [('6cf41fc6-d8ed-4aac-8496-23731f15bebe', None, None, None, None, None)] {{(pid=122633) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 23:16:11.294708 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.multi_cell_list [None req-3a474d3b-e4ec-4640-94bf-52d238066083 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122632) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 10 23:16:11.359580 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-3a474d3b-e4ec-4640-94bf-52d238066083 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] 10.222.0.58 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1012 microversion: 2.1 time: 0.179548 Aug 10 23:16:11.360134 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1973/4110] 10.222.0.58 () {58 vars in 1212 bytes} [Wed Aug 10 23:16:11 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1012 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:16:11.372298 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-3aeaf409-4083-439b-a710-38eebe4489fd tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:16:11.377711 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-3aeaf409-4083-439b-a710-38eebe4489fd tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '06cc4167255044d29a70c12a5a44d800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578d8e62013d43c5ad4d9a6d92e1f201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:16:11.378528 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-3aeaf409-4083-439b-a710-38eebe4489fd tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': '578d8e62013d43c5ad4d9a6d92e1f201'} {{(pid=122632) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 10 23:16:11.383975 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3aeaf409-4083-439b-a710-38eebe4489fd tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:11.384452 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3aeaf409-4083-439b-a710-38eebe4489fd tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:11.384880 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3aeaf409-4083-439b-a710-38eebe4489fd tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:11.385591 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3aeaf409-4083-439b-a710-38eebe4489fd tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:11.386035 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3aeaf409-4083-439b-a710-38eebe4489fd tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:11.386450 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3aeaf409-4083-439b-a710-38eebe4489fd tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:11.486922 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.multi_cell_list [None req-3aeaf409-4083-439b-a710-38eebe4489fd tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122632) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 10 23:16:11.572797 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-3aeaf409-4083-439b-a710-38eebe4489fd tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] 10.222.0.58 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1012 microversion: 2.1 time: 0.203930 Aug 10 23:16:11.580821 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1974/4111] 10.222.0.58 () {58 vars in 1196 bytes} [Wed Aug 10 23:16:11 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1012 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:16:11.588730 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-a5ee697e-4655-4c8e-8fe9-5e35fc76e4ed tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:16:11.596959 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-a5ee697e-4655-4c8e-8fe9-5e35fc76e4ed tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '06cc4167255044d29a70c12a5a44d800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578d8e62013d43c5ad4d9a6d92e1f201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:16:11.599798 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-a5ee697e-4655-4c8e-8fe9-5e35fc76e4ed tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Searching by: {'name': '1523915528', 'deleted': False, 'project_id': '578d8e62013d43c5ad4d9a6d92e1f201'} {{(pid=122632) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 10 23:16:11.608335 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a5ee697e-4655-4c8e-8fe9-5e35fc76e4ed tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:11.615995 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a5ee697e-4655-4c8e-8fe9-5e35fc76e4ed tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:11.616651 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a5ee697e-4655-4c8e-8fe9-5e35fc76e4ed tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:11.617681 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a5ee697e-4655-4c8e-8fe9-5e35fc76e4ed tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:11.618211 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a5ee697e-4655-4c8e-8fe9-5e35fc76e4ed tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:11.618834 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a5ee697e-4655-4c8e-8fe9-5e35fc76e4ed tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:11.826999 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.multi_cell_list [None req-a5ee697e-4655-4c8e-8fe9-5e35fc76e4ed tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122632) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 10 23:16:11.959162 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-a5ee697e-4655-4c8e-8fe9-5e35fc76e4ed tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] 10.222.0.58 "GET /compute/v2.1/servers?name=1523915528" status: 200 len: 346 microversion: 2.1 time: 0.376452 Aug 10 23:16:11.960463 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1975/4112] 10.222.0.58 () {58 vars in 1156 bytes} [Wed Aug 10 23:16:11 2022] GET /compute/v2.1/servers?name=1523915528 => generated 346 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:16:11.968051 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-e1e654e9-9275-4b5e-84ee-2bc330ccc26d tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:16:11.969247 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-e1e654e9-9275-4b5e-84ee-2bc330ccc26d tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:16:11.977186 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e1e654e9-9275-4b5e-84ee-2bc330ccc26d tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:11.978039 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e1e654e9-9275-4b5e-84ee-2bc330ccc26d tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:11.978699 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e1e654e9-9275-4b5e-84ee-2bc330ccc26d tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:11.979773 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e1e654e9-9275-4b5e-84ee-2bc330ccc26d tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:11.980446 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e1e654e9-9275-4b5e-84ee-2bc330ccc26d tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:11.981092 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e1e654e9-9275-4b5e-84ee-2bc330ccc26d tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:12.219019 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-e1e654e9-9275-4b5e-84ee-2bc330ccc26d tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:16:12.234819 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-e1e654e9-9275-4b5e-84ee-2bc330ccc26d tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b" status: 200 len: 1519 microversion: 2.1 time: 0.272146 Aug 10 23:16:12.235928 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1976/4113] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:16:11 2022] GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b => generated 1519 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:16:12.243341 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-2811bb52-8118-4544-a339-f1b021463b79 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:16:12.252907 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-2811bb52-8118-4544-a339-f1b021463b79 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '06cc4167255044d29a70c12a5a44d800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578d8e62013d43c5ad4d9a6d92e1f201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:16:12.254039 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-2811bb52-8118-4544-a339-f1b021463b79 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': '578d8e62013d43c5ad4d9a6d92e1f201'} {{(pid=122632) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 10 23:16:12.261663 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2811bb52-8118-4544-a339-f1b021463b79 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:12.262712 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2811bb52-8118-4544-a339-f1b021463b79 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:12.263462 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2811bb52-8118-4544-a339-f1b021463b79 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:12.264405 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2811bb52-8118-4544-a339-f1b021463b79 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:12.265069 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2811bb52-8118-4544-a339-f1b021463b79 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:12.265746 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2811bb52-8118-4544-a339-f1b021463b79 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:12.385732 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.multi_cell_list [None req-2811bb52-8118-4544-a339-f1b021463b79 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=122632) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 10 23:16:12.464538 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-2811bb52-8118-4544-a339-f1b021463b79 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] 10.222.0.58 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1012 microversion: 2.1 time: 0.226184 Aug 10 23:16:12.465702 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1977/4114] 10.222.0.58 () {58 vars in 1154 bytes} [Wed Aug 10 23:16:12 2022] GET /compute/v2.1/servers?name=-instance => generated 1012 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:16:12.483459 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-bf81ff4c-5162-4b55-a2e2-aa2a48ae83d2 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:16:12.498390 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-bf81ff4c-5162-4b55-a2e2-aa2a48ae83d2 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '06cc4167255044d29a70c12a5a44d800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578d8e62013d43c5ad4d9a6d92e1f201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:16:12.499708 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-bf81ff4c-5162-4b55-a2e2-aa2a48ae83d2 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-152391552', 'deleted': False, 'project_id': '578d8e62013d43c5ad4d9a6d92e1f201'} {{(pid=122632) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 10 23:16:12.509969 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bf81ff4c-5162-4b55-a2e2-aa2a48ae83d2 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:12.510882 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bf81ff4c-5162-4b55-a2e2-aa2a48ae83d2 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:12.511685 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bf81ff4c-5162-4b55-a2e2-aa2a48ae83d2 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:12.513510 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bf81ff4c-5162-4b55-a2e2-aa2a48ae83d2 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:12.514960 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bf81ff4c-5162-4b55-a2e2-aa2a48ae83d2 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:12.515606 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bf81ff4c-5162-4b55-a2e2-aa2a48ae83d2 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:12.644979 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.multi_cell_list [None req-bf81ff4c-5162-4b55-a2e2-aa2a48ae83d2 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122632) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 10 23:16:12.698653 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-37cbfb9f-9ef5-49f3-a089-e3fa540c0844 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Flavor limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:16:12.699210 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-37cbfb9f-9ef5-49f3-a089-e3fa540c0844 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Image limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:16:12.699506 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-37cbfb9f-9ef5-49f3-a089-e3fa540c0844 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Flavor pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:16:12.699930 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-37cbfb9f-9ef5-49f3-a089-e3fa540c0844 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Image pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:16:12.700484 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-37cbfb9f-9ef5-49f3-a089-e3fa540c0844 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:16:12.724664 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-37cbfb9f-9ef5-49f3-a089-e3fa540c0844 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:12.725125 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-37cbfb9f-9ef5-49f3-a089-e3fa540c0844 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:12.725565 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-37cbfb9f-9ef5-49f3-a089-e3fa540c0844 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:12.726300 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-37cbfb9f-9ef5-49f3-a089-e3fa540c0844 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:12.726752 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-37cbfb9f-9ef5-49f3-a089-e3fa540c0844 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:12.727207 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-37cbfb9f-9ef5-49f3-a089-e3fa540c0844 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:12.771488 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-bf81ff4c-5162-4b55-a2e2-aa2a48ae83d2 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] 10.222.0.58 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-152391552" status: 200 len: 346 microversion: 2.1 time: 0.295842 Aug 10 23:16:12.774198 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1978/4115] 10.222.0.58 () {58 vars in 1228 bytes} [Wed Aug 10 23:16:12 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-152391552 => generated 346 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:16:12.780159 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-37cbfb9f-9ef5-49f3-a089-e3fa540c0844 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Getting quotas for project 395d7c4077e54c43bb95288db3942b0a. Resources: {'instances', 'cores', 'ram'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:16:12.786840 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-37cbfb9f-9ef5-49f3-a089-e3fa540c0844 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Getting quotas for user f07c94ebf0954cdea12b9a689538d96d and project 395d7c4077e54c43bb95288db3942b0a. Resources: {'instances', 'cores', 'ram'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:16:12.791108 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-151cdcad-6bfc-428e-9bfd-fce149eecaab tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:16:12.791664 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-151cdcad-6bfc-428e-9bfd-fce149eecaab tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] [instance: 1c71b2c8-4cbd-4c02-bb74-ba27adb70325] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:16:12.805631 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-151cdcad-6bfc-428e-9bfd-fce149eecaab tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:12.806463 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-151cdcad-6bfc-428e-9bfd-fce149eecaab tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:12.806999 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-151cdcad-6bfc-428e-9bfd-fce149eecaab tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:12.807764 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-37cbfb9f-9ef5-49f3-a089-e3fa540c0844 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Going to run 1 instances... {{(pid=122633) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 23:16:12.808185 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-151cdcad-6bfc-428e-9bfd-fce149eecaab tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:12.809094 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-151cdcad-6bfc-428e-9bfd-fce149eecaab tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:12.809585 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-151cdcad-6bfc-428e-9bfd-fce149eecaab tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:12.822133 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-37cbfb9f-9ef5-49f3-a089-e3fa540c0844 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] [instance: 3ecbcf63-5592-4074-a3f7-d2caf3c58969] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78ad8905-f66f-4733-8be9-2b260f1fabed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122633) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 23:16:12.875385 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-151cdcad-6bfc-428e-9bfd-fce149eecaab tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] [instance: 1c71b2c8-4cbd-4c02-bb74-ba27adb70325] Going to try to terminate instance {{(pid=122632) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:16:12.905931 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-37cbfb9f-9ef5-49f3-a089-e3fa540c0844 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.982255 Aug 10 23:16:12.907880 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2138/4116] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 23:16:10 2022] POST /compute/v2.1/servers => generated 409 bytes in 1986 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 23:16:12.919728 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-5d76514e-ae72-4dc1-b1af-cf5b3183312a tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:16:12.921125 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-5d76514e-ae72-4dc1-b1af-cf5b3183312a tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] [instance: 3ecbcf63-5592-4074-a3f7-d2caf3c58969] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:16:12.988429 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:16:13.035305 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-5d76514e-ae72-4dc1-b1af-cf5b3183312a tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07c94ebf0954cdea12b9a689538d96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395d7c4077e54c43bb95288db3942b0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:16:13.042707 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-151cdcad-6bfc-428e-9bfd-fce149eecaab tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] 10.222.0.58 "DELETE /compute/v2.1/servers/1c71b2c8-4cbd-4c02-bb74-ba27adb70325" status: 204 len: 0 microversion: 2.1 time: 0.255023 Aug 10 23:16:13.045219 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1979/4117] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:16:12 2022] DELETE /compute/v2.1/servers/1c71b2c8-4cbd-4c02-bb74-ba27adb70325 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:16:13.054998 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-5d76514e-ae72-4dc1-b1af-cf5b3183312a tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] 10.222.0.58 "GET /compute/v2.1/servers/3ecbcf63-5592-4074-a3f7-d2caf3c58969" status: 200 len: 1246 microversion: 2.1 time: 0.137127 Aug 10 23:16:13.057413 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-8bfa1c05-e291-4343-9aa4-a1c4c49cdd54 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:16:13.057728 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2139/4118] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:16:12 2022] GET /compute/v2.1/servers/3ecbcf63-5592-4074-a3f7-d2caf3c58969 => generated 1246 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:16:13.058346 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-8bfa1c05-e291-4343-9aa4-a1c4c49cdd54 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] [instance: 1c71b2c8-4cbd-4c02-bb74-ba27adb70325] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:16:13.067533 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8bfa1c05-e291-4343-9aa4-a1c4c49cdd54 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:13.068027 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8bfa1c05-e291-4343-9aa4-a1c4c49cdd54 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:13.068562 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8bfa1c05-e291-4343-9aa4-a1c4c49cdd54 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:13.069388 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8bfa1c05-e291-4343-9aa4-a1c4c49cdd54 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:13.069821 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8bfa1c05-e291-4343-9aa4-a1c4c49cdd54 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:13.070243 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8bfa1c05-e291-4343-9aa4-a1c4c49cdd54 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:13.262113 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c30cae54-387f-4a8c-aa74-996364abab5c tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:16:13.262741 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-c30cae54-387f-4a8c-aa74-996364abab5c tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:16:13.273969 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c30cae54-387f-4a8c-aa74-996364abab5c tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:13.278112 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-8bfa1c05-e291-4343-9aa4-a1c4c49cdd54 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cc4167255044d29a70c12a5a44d800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578d8e62013d43c5ad4d9a6d92e1f201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:16:13.279459 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c30cae54-387f-4a8c-aa74-996364abab5c tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:13.279945 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c30cae54-387f-4a8c-aa74-996364abab5c tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:13.288286 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c30cae54-387f-4a8c-aa74-996364abab5c tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:13.289730 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c30cae54-387f-4a8c-aa74-996364abab5c tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:13.290190 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c30cae54-387f-4a8c-aa74-996364abab5c tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:13.291120 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-8bfa1c05-e291-4343-9aa4-a1c4c49cdd54 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] 10.222.0.58 "GET /compute/v2.1/servers/1c71b2c8-4cbd-4c02-bb74-ba27adb70325" status: 200 len: 1518 microversion: 2.1 time: 0.240795 Aug 10 23:16:13.303049 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1980/4119] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:16:13 2022] GET /compute/v2.1/servers/1c71b2c8-4cbd-4c02-bb74-ba27adb70325 => generated 1518 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:16:13.864038 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-c30cae54-387f-4a8c-aa74-996364abab5c tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:16:13.877782 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-c30cae54-387f-4a8c-aa74-996364abab5c tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b" status: 200 len: 1519 microversion: 2.1 time: 0.619922 Aug 10 23:16:13.880089 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2140/4120] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:16:13 2022] GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b => generated 1519 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:16:14.084191 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-71f73829-69ed-4837-9517-1948fda17e0d tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:16:14.084815 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-71f73829-69ed-4837-9517-1948fda17e0d tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] [instance: 3ecbcf63-5592-4074-a3f7-d2caf3c58969] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:16:14.104398 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-71f73829-69ed-4837-9517-1948fda17e0d tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:14.106524 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-71f73829-69ed-4837-9517-1948fda17e0d tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:14.111902 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-71f73829-69ed-4837-9517-1948fda17e0d tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:14.113253 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-71f73829-69ed-4837-9517-1948fda17e0d tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:14.113627 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-71f73829-69ed-4837-9517-1948fda17e0d tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:14.114068 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-71f73829-69ed-4837-9517-1948fda17e0d tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:14.272722 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-71f73829-69ed-4837-9517-1948fda17e0d tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07c94ebf0954cdea12b9a689538d96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395d7c4077e54c43bb95288db3942b0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:16:14.281353 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-71f73829-69ed-4837-9517-1948fda17e0d tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] 10.222.0.58 "GET /compute/v2.1/servers/3ecbcf63-5592-4074-a3f7-d2caf3c58969" status: 200 len: 1250 microversion: 2.1 time: 0.203362 Aug 10 23:16:14.285897 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1981/4121] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:16:14 2022] GET /compute/v2.1/servers/3ecbcf63-5592-4074-a3f7-d2caf3c58969 => generated 1250 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:16:14.315849 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-d63e6a51-8fb5-4a30-ac2c-82cae5c7d21f tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:16:14.317039 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-d63e6a51-8fb5-4a30-ac2c-82cae5c7d21f tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] [instance: 1c71b2c8-4cbd-4c02-bb74-ba27adb70325] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:16:14.336150 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d63e6a51-8fb5-4a30-ac2c-82cae5c7d21f tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:14.338612 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d63e6a51-8fb5-4a30-ac2c-82cae5c7d21f tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:14.342885 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d63e6a51-8fb5-4a30-ac2c-82cae5c7d21f tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:14.347789 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d63e6a51-8fb5-4a30-ac2c-82cae5c7d21f tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:14.350058 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d63e6a51-8fb5-4a30-ac2c-82cae5c7d21f tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:14.350762 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d63e6a51-8fb5-4a30-ac2c-82cae5c7d21f tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:14.721524 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-d63e6a51-8fb5-4a30-ac2c-82cae5c7d21f tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cc4167255044d29a70c12a5a44d800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578d8e62013d43c5ad4d9a6d92e1f201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:16:14.756686 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-d63e6a51-8fb5-4a30-ac2c-82cae5c7d21f tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] 10.222.0.58 "GET /compute/v2.1/servers/1c71b2c8-4cbd-4c02-bb74-ba27adb70325" status: 200 len: 1518 microversion: 2.1 time: 0.443284 Aug 10 23:16:14.777471 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2141/4122] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:16:14 2022] GET /compute/v2.1/servers/1c71b2c8-4cbd-4c02-bb74-ba27adb70325 => generated 1518 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:16:14.901084 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-59184c9d-0ae0-4000-a81d-7ed8db5b276c tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:16:14.902055 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-59184c9d-0ae0-4000-a81d-7ed8db5b276c tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:16:14.915781 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-59184c9d-0ae0-4000-a81d-7ed8db5b276c tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:14.916986 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-59184c9d-0ae0-4000-a81d-7ed8db5b276c tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:14.917700 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-59184c9d-0ae0-4000-a81d-7ed8db5b276c tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:14.919006 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-59184c9d-0ae0-4000-a81d-7ed8db5b276c tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:14.923165 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-59184c9d-0ae0-4000-a81d-7ed8db5b276c tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:14.923896 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-59184c9d-0ae0-4000-a81d-7ed8db5b276c tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:15.309629 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-098633fc-afe2-4d09-8a73-f625532a3ec6 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:16:15.311894 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-098633fc-afe2-4d09-8a73-f625532a3ec6 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] [instance: 3ecbcf63-5592-4074-a3f7-d2caf3c58969] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:16:15.336886 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-098633fc-afe2-4d09-8a73-f625532a3ec6 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:15.339946 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-098633fc-afe2-4d09-8a73-f625532a3ec6 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:15.341322 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-098633fc-afe2-4d09-8a73-f625532a3ec6 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:15.343564 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-098633fc-afe2-4d09-8a73-f625532a3ec6 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:15.348042 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-098633fc-afe2-4d09-8a73-f625532a3ec6 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:15.349064 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-098633fc-afe2-4d09-8a73-f625532a3ec6 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:15.691661 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-098633fc-afe2-4d09-8a73-f625532a3ec6 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07c94ebf0954cdea12b9a689538d96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395d7c4077e54c43bb95288db3942b0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:16:15.704556 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-098633fc-afe2-4d09-8a73-f625532a3ec6 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] 10.222.0.58 "GET /compute/v2.1/servers/3ecbcf63-5592-4074-a3f7-d2caf3c58969" status: 200 len: 1316 microversion: 2.1 time: 0.401564 Aug 10 23:16:15.735315 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2142/4123] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:16:15 2022] GET /compute/v2.1/servers/3ecbcf63-5592-4074-a3f7-d2caf3c58969 => generated 1316 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:16:15.801735 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-5478afa1-9001-42b9-9d5e-b65832b099b2 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:16:15.802653 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-5478afa1-9001-42b9-9d5e-b65832b099b2 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] [instance: 1c71b2c8-4cbd-4c02-bb74-ba27adb70325] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:16:15.810662 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5478afa1-9001-42b9-9d5e-b65832b099b2 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:15.818430 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5478afa1-9001-42b9-9d5e-b65832b099b2 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:15.823043 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5478afa1-9001-42b9-9d5e-b65832b099b2 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:15.824517 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5478afa1-9001-42b9-9d5e-b65832b099b2 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:15.826142 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5478afa1-9001-42b9-9d5e-b65832b099b2 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:15.827609 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5478afa1-9001-42b9-9d5e-b65832b099b2 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:15.932953 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-59184c9d-0ae0-4000-a81d-7ed8db5b276c tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:16:15.941474 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-59184c9d-0ae0-4000-a81d-7ed8db5b276c tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b" status: 200 len: 1519 microversion: 2.1 time: 1.045122 Aug 10 23:16:15.957241 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1982/4124] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:16:14 2022] GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b => generated 1519 bytes in 1061 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:16:16.749507 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-1891331d-547f-4632-87c5-c9872eab7a08 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:16:16.750130 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-1891331d-547f-4632-87c5-c9872eab7a08 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] [instance: 3ecbcf63-5592-4074-a3f7-d2caf3c58969] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:16:16.776673 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1891331d-547f-4632-87c5-c9872eab7a08 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:16.778310 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1891331d-547f-4632-87c5-c9872eab7a08 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:16.785694 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1891331d-547f-4632-87c5-c9872eab7a08 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:16.786667 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1891331d-547f-4632-87c5-c9872eab7a08 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:16.788345 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1891331d-547f-4632-87c5-c9872eab7a08 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:16.788838 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1891331d-547f-4632-87c5-c9872eab7a08 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:16.860166 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-5478afa1-9001-42b9-9d5e-b65832b099b2 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cc4167255044d29a70c12a5a44d800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578d8e62013d43c5ad4d9a6d92e1f201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:16:16.871665 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-5478afa1-9001-42b9-9d5e-b65832b099b2 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] 10.222.0.58 "GET /compute/v2.1/servers/1c71b2c8-4cbd-4c02-bb74-ba27adb70325" status: 200 len: 1518 microversion: 2.1 time: 1.074952 Aug 10 23:16:16.872270 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2143/4125] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:16:15 2022] GET /compute/v2.1/servers/1c71b2c8-4cbd-4c02-bb74-ba27adb70325 => generated 1518 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:16:16.969149 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-39e28454-e7f2-4633-9716-3b5aad478427 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:16:16.975721 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-39e28454-e7f2-4633-9716-3b5aad478427 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:16:16.997786 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-39e28454-e7f2-4633-9716-3b5aad478427 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:17.001682 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-39e28454-e7f2-4633-9716-3b5aad478427 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:17.008030 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-39e28454-e7f2-4633-9716-3b5aad478427 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:17.011174 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-39e28454-e7f2-4633-9716-3b5aad478427 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:17.015379 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-39e28454-e7f2-4633-9716-3b5aad478427 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:17.015838 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-39e28454-e7f2-4633-9716-3b5aad478427 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:17.340852 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-1891331d-547f-4632-87c5-c9872eab7a08 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07c94ebf0954cdea12b9a689538d96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395d7c4077e54c43bb95288db3942b0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:16:17.353431 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-1891331d-547f-4632-87c5-c9872eab7a08 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] 10.222.0.58 "GET /compute/v2.1/servers/3ecbcf63-5592-4074-a3f7-d2caf3c58969" status: 200 len: 1304 microversion: 2.1 time: 0.607716 Aug 10 23:16:17.361763 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1983/4126] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:16:16 2022] GET /compute/v2.1/servers/3ecbcf63-5592-4074-a3f7-d2caf3c58969 => generated 1304 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:16:17.464017 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-9833b36f-8649-41d8-a32c-d5b7b7b3ac4d req-6879977c-0cc8-42b0-aeb6-91365abddd5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c71b2c8-4cbd-4c02-bb74-ba27adb70325", "name": "network-vif-deleted", "tag": "37cbcd6f-0afe-4ca8-a522-a0291c6e237d"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:16:17.498036 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-9833b36f-8649-41d8-a32c-d5b7b7b3ac4d req-6879977c-0cc8-42b0-aeb6-91365abddd5d service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:17.498801 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-9833b36f-8649-41d8-a32c-d5b7b7b3ac4d req-6879977c-0cc8-42b0-aeb6-91365abddd5d service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:17.501101 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-9833b36f-8649-41d8-a32c-d5b7b7b3ac4d req-6879977c-0cc8-42b0-aeb6-91365abddd5d service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:17.558711 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-9833b36f-8649-41d8-a32c-d5b7b7b3ac4d req-6879977c-0cc8-42b0-aeb6-91365abddd5d service nova] Creating event network-vif-deleted:37cbcd6f-0afe-4ca8-a522-a0291c6e237d for instance 1c71b2c8-4cbd-4c02-bb74-ba27adb70325 on n-h1-850468-14 Aug 10 23:16:17.579305 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-9833b36f-8649-41d8-a32c-d5b7b7b3ac4d req-6879977c-0cc8-42b0-aeb6-91365abddd5d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114158 Aug 10 23:16:17.580923 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1984/4127] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:16:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 23:16:17.796560 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-39e28454-e7f2-4633-9716-3b5aad478427 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:16:17.817258 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-39e28454-e7f2-4633-9716-3b5aad478427 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b" status: 200 len: 1519 microversion: 2.1 time: 0.854233 Aug 10 23:16:17.818101 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2144/4128] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:16:16 2022] GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b => generated 1519 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:16:17.897757 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-6f7b43ea-03dc-4ff4-a7e1-51134082852f tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:16:17.898559 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-6f7b43ea-03dc-4ff4-a7e1-51134082852f tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] [instance: 1c71b2c8-4cbd-4c02-bb74-ba27adb70325] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:16:17.925114 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6f7b43ea-03dc-4ff4-a7e1-51134082852f tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:17.925718 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6f7b43ea-03dc-4ff4-a7e1-51134082852f tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:17.926235 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6f7b43ea-03dc-4ff4-a7e1-51134082852f tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:17.927091 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6f7b43ea-03dc-4ff4-a7e1-51134082852f tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:17.927614 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6f7b43ea-03dc-4ff4-a7e1-51134082852f tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:17.928115 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6f7b43ea-03dc-4ff4-a7e1-51134082852f tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:18.044682 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6f7b43ea-03dc-4ff4-a7e1-51134082852f tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:18.045175 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6f7b43ea-03dc-4ff4-a7e1-51134082852f tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:18.045617 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6f7b43ea-03dc-4ff4-a7e1-51134082852f tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:18.046078 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.objects.instance [None req-6f7b43ea-03dc-4ff4-a7e1-51134082852f tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lazy-loading 'fault' on Instance uuid 1c71b2c8-4cbd-4c02-bb74-ba27adb70325 {{(pid=122632) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:16:18.282090 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-6f7b43ea-03dc-4ff4-a7e1-51134082852f tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cc4167255044d29a70c12a5a44d800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578d8e62013d43c5ad4d9a6d92e1f201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:16:18.299757 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-6f7b43ea-03dc-4ff4-a7e1-51134082852f tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] 10.222.0.58 "GET /compute/v2.1/servers/1c71b2c8-4cbd-4c02-bb74-ba27adb70325" status: 200 len: 1311 microversion: 2.1 time: 0.407348 Aug 10 23:16:18.300363 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1985/4129] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:16:17 2022] GET /compute/v2.1/servers/1c71b2c8-4cbd-4c02-bb74-ba27adb70325 => generated 1311 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:16:18.380673 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-5d11833f-fdc2-43d3-953d-9f0ad8555c03 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:16:18.381979 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-5d11833f-fdc2-43d3-953d-9f0ad8555c03 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] [instance: 3ecbcf63-5592-4074-a3f7-d2caf3c58969] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:16:18.406202 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5d11833f-fdc2-43d3-953d-9f0ad8555c03 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:18.407137 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5d11833f-fdc2-43d3-953d-9f0ad8555c03 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:18.407974 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5d11833f-fdc2-43d3-953d-9f0ad8555c03 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:18.409240 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5d11833f-fdc2-43d3-953d-9f0ad8555c03 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:18.415562 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5d11833f-fdc2-43d3-953d-9f0ad8555c03 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:18.419490 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5d11833f-fdc2-43d3-953d-9f0ad8555c03 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:18.839868 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c60b23dd-316a-497b-b9b0-929e404f737c tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:16:18.840551 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-c60b23dd-316a-497b-b9b0-929e404f737c tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:16:18.869106 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c60b23dd-316a-497b-b9b0-929e404f737c tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:18.869650 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c60b23dd-316a-497b-b9b0-929e404f737c tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:18.870062 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c60b23dd-316a-497b-b9b0-929e404f737c tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:18.870839 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c60b23dd-316a-497b-b9b0-929e404f737c tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:18.871297 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c60b23dd-316a-497b-b9b0-929e404f737c tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:18.871752 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c60b23dd-316a-497b-b9b0-929e404f737c tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:19.072108 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-5d11833f-fdc2-43d3-953d-9f0ad8555c03 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07c94ebf0954cdea12b9a689538d96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395d7c4077e54c43bb95288db3942b0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:16:19.099836 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-5d11833f-fdc2-43d3-953d-9f0ad8555c03 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] 10.222.0.58 "GET /compute/v2.1/servers/3ecbcf63-5592-4074-a3f7-d2caf3c58969" status: 200 len: 1372 microversion: 2.1 time: 0.723434 Aug 10 23:16:19.115263 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2145/4130] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:16:18 2022] GET /compute/v2.1/servers/3ecbcf63-5592-4074-a3f7-d2caf3c58969 => generated 1372 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:16:19.325612 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-b72b5e4d-7539-496b-988c-8234ac680e2b tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:16:19.326450 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-b72b5e4d-7539-496b-988c-8234ac680e2b tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] [instance: 1c71b2c8-4cbd-4c02-bb74-ba27adb70325] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:16:19.340877 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b72b5e4d-7539-496b-988c-8234ac680e2b tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:19.341774 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b72b5e4d-7539-496b-988c-8234ac680e2b tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:19.342466 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b72b5e4d-7539-496b-988c-8234ac680e2b tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:19.343456 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b72b5e4d-7539-496b-988c-8234ac680e2b tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:19.349835 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b72b5e4d-7539-496b-988c-8234ac680e2b tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:19.351348 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b72b5e4d-7539-496b-988c-8234ac680e2b tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:19.361701 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=6 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:16:19.397215 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-b72b5e4d-7539-496b-988c-8234ac680e2b tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] HTTP exception thrown: Instance 1c71b2c8-4cbd-4c02-bb74-ba27adb70325 could not be found. Aug 10 23:16:19.399359 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-b72b5e4d-7539-496b-988c-8234ac680e2b tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Request method failure captured: Aug 10 23:16:19.399359 n-d-850468-14 devstack@n-api.service[122633]: request: GET /compute/v2.1/servers/1c71b2c8-4cbd-4c02-bb74-ba27adb70325 HTTP/1.1 Aug 10 23:16:19.399359 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:16:19.399359 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:16:19.399359 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:16:19.399359 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:16:19.399359 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:16:19.399359 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:16:19.399359 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:16:19.399359 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:16:19.399359 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9Dv2WB9UmvQB8pV9RI6BR4C0Kcs9bcD9A2s9uljbH_u19UW9hY5svVGdr7XwHDnAlMSSubbs6uragOBxV7NaefYhCQ9W2P_bDAL9XWY54zBcQelSeUixd-527PamrI7k1QLvdTufYhyABiIcubnyY_0LdE8ePb7VFjIz5fDa0tw2QfM Aug 10 23:16:19.399359 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:16:19.399359 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:16:19.399359 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:16:19.399359 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:16:19.399359 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:16:19.399359 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:16:19.399359 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 578d8e62013d43c5ad4d9a6d92e1f201 Aug 10 23:16:19.399359 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-ListServerFiltersTestJSON-1455134698 Aug 10 23:16:19.399359 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:16:19.399359 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:16:19.399359 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/578d8e62013d43c5ad4d9a6d92e1f201"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/578d8e62013d43c5ad4d9a6d92e1f201"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/578d8e62013d43c5ad4d9a6d92e1f201"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_578d8e62013d43c5ad4d9a6d92e1f201", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:16:19.399359 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-ListServerFiltersTestJSON-1455134698 Aug 10 23:16:19.399359 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 578d8e62013d43c5ad4d9a6d92e1f201 Aug 10 23:16:19.399359 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1455134698 Aug 10 23:16:19.399359 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-ListServerFiltersTestJSON-1455134698-project Aug 10 23:16:19.399359 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:16:19.399359 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:16:19.399359 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 06cc4167255044d29a70c12a5a44d800 Aug 10 23:16:19.399359 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-ListServerFiltersTestJSON-1455134698-project Aug 10 23:16:19.399359 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:16:19.399359 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance 1c71b2c8-4cbd-4c02-bb74-ba27adb70325 could not be found. Aug 10 23:16:19.399359 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': '1c71b2c8-4cbd-4c02-bb74-ba27adb70325'} Aug 10 23:16:19.399359 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:16:19.399359 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:16:19.399359 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:16:19.399359 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:16:19.399359 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:16:19.399359 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:16:19.399359 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:16:19.399359 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:16:19.399359 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:16:19.399359 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:16:19.399359 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c71b2c8-4cbd-4c02-bb74-ba27adb70325 could not be found. Aug 10 23:16:19.399359 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:16:19.399359 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:16:19.399359 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:16:19.399359 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:16:19.399359 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:16:19.399359 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:16:19.399359 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:16:19.399359 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:16:19.399359 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:16:19.399359 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:16:19.399359 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:16:19.399359 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:16:19.399359 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:16:19.399359 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:16:19.399359 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:16:19.399359 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:16:19.399359 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c71b2c8-4cbd-4c02-bb74-ba27adb70325 could not be found. Aug 10 23:16:19.399359 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:16:19.399359 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:16:19.399359 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:16:19.404766 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:16:19.404766 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:16:19.404766 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:16:19.404766 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:16:19.404766 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:16:19.404766 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c71b2c8-4cbd-4c02-bb74-ba27adb70325 could not be found. Aug 10 23:16:19.404766 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:16:19.406444 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-b72b5e4d-7539-496b-988c-8234ac680e2b tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Returning 404 to user: Instance 1c71b2c8-4cbd-4c02-bb74-ba27adb70325 could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:16:19.408362 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-b72b5e4d-7539-496b-988c-8234ac680e2b tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] 10.222.0.58 "GET /compute/v2.1/servers/1c71b2c8-4cbd-4c02-bb74-ba27adb70325" status: 404 len: 111 microversion: 2.1 time: 0.086191 Aug 10 23:16:19.412324 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2146/4131] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:16:19 2022] GET /compute/v2.1/servers/1c71b2c8-4cbd-4c02-bb74-ba27adb70325 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:16:19.425720 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-75232db1-80b6-40f9-a454-8a9f3f160ebb tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:16:19.426570 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-75232db1-80b6-40f9-a454-8a9f3f160ebb tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] [instance: c679e2a4-89de-4fcf-aed1-273220fdb2e8] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:16:19.439859 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-75232db1-80b6-40f9-a454-8a9f3f160ebb tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:19.446133 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-75232db1-80b6-40f9-a454-8a9f3f160ebb tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:19.447044 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-75232db1-80b6-40f9-a454-8a9f3f160ebb tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:19.449494 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-75232db1-80b6-40f9-a454-8a9f3f160ebb tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:19.450863 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-75232db1-80b6-40f9-a454-8a9f3f160ebb tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:19.451522 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-75232db1-80b6-40f9-a454-8a9f3f160ebb tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:19.553848 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-75232db1-80b6-40f9-a454-8a9f3f160ebb tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] [instance: c679e2a4-89de-4fcf-aed1-273220fdb2e8] Going to try to terminate instance {{(pid=122633) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:16:19.721913 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-75232db1-80b6-40f9-a454-8a9f3f160ebb tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] 10.222.0.58 "DELETE /compute/v2.1/servers/c679e2a4-89de-4fcf-aed1-273220fdb2e8" status: 204 len: 0 microversion: 2.1 time: 0.307282 Aug 10 23:16:19.723029 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2147/4132] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:16:19 2022] DELETE /compute/v2.1/servers/c679e2a4-89de-4fcf-aed1-273220fdb2e8 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:16:19.733582 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-7ab8ce8c-f51c-4567-8672-85256277d4b3 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:16:19.738828 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-7ab8ce8c-f51c-4567-8672-85256277d4b3 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] [instance: c679e2a4-89de-4fcf-aed1-273220fdb2e8] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:16:19.755861 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7ab8ce8c-f51c-4567-8672-85256277d4b3 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:19.756735 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7ab8ce8c-f51c-4567-8672-85256277d4b3 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:19.759005 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7ab8ce8c-f51c-4567-8672-85256277d4b3 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:19.760037 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7ab8ce8c-f51c-4567-8672-85256277d4b3 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:19.763532 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7ab8ce8c-f51c-4567-8672-85256277d4b3 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:19.764344 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7ab8ce8c-f51c-4567-8672-85256277d4b3 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:20.044741 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-c60b23dd-316a-497b-b9b0-929e404f737c tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:16:20.060353 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-c60b23dd-316a-497b-b9b0-929e404f737c tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b" status: 200 len: 1519 microversion: 2.1 time: 1.225480 Aug 10 23:16:20.061018 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1986/4133] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:16:18 2022] GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b => generated 1519 bytes in 1227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:16:20.124708 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-4be21ee0-f799-42d0-a58f-ce86e4fadc50 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:16:20.126147 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-4be21ee0-f799-42d0-a58f-ce86e4fadc50 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] [instance: 3ecbcf63-5592-4074-a3f7-d2caf3c58969] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:16:20.131667 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=1,nova_api:UPDATE=2 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:16:20.147901 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4be21ee0-f799-42d0-a58f-ce86e4fadc50 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:20.148703 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4be21ee0-f799-42d0-a58f-ce86e4fadc50 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:20.149554 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4be21ee0-f799-42d0-a58f-ce86e4fadc50 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:20.151492 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4be21ee0-f799-42d0-a58f-ce86e4fadc50 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:20.152194 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4be21ee0-f799-42d0-a58f-ce86e4fadc50 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:20.153766 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4be21ee0-f799-42d0-a58f-ce86e4fadc50 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:20.414067 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-7ab8ce8c-f51c-4567-8672-85256277d4b3 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cc4167255044d29a70c12a5a44d800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578d8e62013d43c5ad4d9a6d92e1f201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:16:20.425532 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-7ab8ce8c-f51c-4567-8672-85256277d4b3 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] 10.222.0.58 "GET /compute/v2.1/servers/c679e2a4-89de-4fcf-aed1-273220fdb2e8" status: 200 len: 1518 microversion: 2.1 time: 0.698119 Aug 10 23:16:20.431504 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2148/4134] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:16:19 2022] GET /compute/v2.1/servers/c679e2a4-89de-4fcf-aed1-273220fdb2e8 => generated 1518 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:16:20.447342 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-71b7b871-c458-4fb2-8d2a-7a728935f684 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:16:20.450834 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-71b7b871-c458-4fb2-8d2a-7a728935f684 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: fa9dfd3a-a636-48ce-ae15-0ed51baee954] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:16:20.473896 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-71b7b871-c458-4fb2-8d2a-7a728935f684 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:20.474687 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-71b7b871-c458-4fb2-8d2a-7a728935f684 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:20.475372 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-71b7b871-c458-4fb2-8d2a-7a728935f684 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:20.476314 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-71b7b871-c458-4fb2-8d2a-7a728935f684 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:20.476942 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-71b7b871-c458-4fb2-8d2a-7a728935f684 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:20.477540 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-71b7b871-c458-4fb2-8d2a-7a728935f684 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:20.625297 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-4be21ee0-f799-42d0-a58f-ce86e4fadc50 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07c94ebf0954cdea12b9a689538d96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395d7c4077e54c43bb95288db3942b0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:16:20.637790 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-4be21ee0-f799-42d0-a58f-ce86e4fadc50 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] 10.222.0.58 "GET /compute/v2.1/servers/3ecbcf63-5592-4074-a3f7-d2caf3c58969" status: 200 len: 1372 microversion: 2.1 time: 0.518389 Aug 10 23:16:20.650809 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-71b7b871-c458-4fb2-8d2a-7a728935f684 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "POST /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954/action" status: 202 len: 0 microversion: 2.1 time: 0.206266 Aug 10 23:16:20.651181 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1987/4135] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:16:20 2022] GET /compute/v2.1/servers/3ecbcf63-5592-4074-a3f7-d2caf3c58969 => generated 1372 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:16:20.651271 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2149/4136] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:16:20 2022] POST /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954/action => generated 0 bytes in 208 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:16:20.651356 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-de736552-2eda-4b15-bbdc-48a395c72f28 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:16:20.651356 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-de736552-2eda-4b15-bbdc-48a395c72f28 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: fa9dfd3a-a636-48ce-ae15-0ed51baee954] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:16:20.667059 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-de736552-2eda-4b15-bbdc-48a395c72f28 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:20.667524 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-de736552-2eda-4b15-bbdc-48a395c72f28 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:20.668356 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-de736552-2eda-4b15-bbdc-48a395c72f28 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:20.669885 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-de736552-2eda-4b15-bbdc-48a395c72f28 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:20.670374 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-de736552-2eda-4b15-bbdc-48a395c72f28 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:20.673764 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-de736552-2eda-4b15-bbdc-48a395c72f28 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:21.085707 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-03905d5e-dd9c-4e86-861d-aa8dcf813ffc tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:16:21.085991 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-de736552-2eda-4b15-bbdc-48a395c72f28 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:16:21.087477 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-03905d5e-dd9c-4e86-861d-aa8dcf813ffc tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:16:21.100253 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-de736552-2eda-4b15-bbdc-48a395c72f28 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954" status: 200 len: 1669 microversion: 2.1 time: 0.450046 Aug 10 23:16:21.100929 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1988/4137] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:16:20 2022] GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954 => generated 1669 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:16:21.117505 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-03905d5e-dd9c-4e86-861d-aa8dcf813ffc tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:21.118018 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-03905d5e-dd9c-4e86-861d-aa8dcf813ffc tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:21.118536 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-03905d5e-dd9c-4e86-861d-aa8dcf813ffc tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:21.119675 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-03905d5e-dd9c-4e86-861d-aa8dcf813ffc tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:21.120194 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-03905d5e-dd9c-4e86-861d-aa8dcf813ffc tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:21.123532 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-03905d5e-dd9c-4e86-861d-aa8dcf813ffc tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:21.459186 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-fae9c8eb-2a2b-47db-855d-260872f0f08e tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:16:21.459818 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-fae9c8eb-2a2b-47db-855d-260872f0f08e tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] [instance: c679e2a4-89de-4fcf-aed1-273220fdb2e8] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:16:21.481211 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fae9c8eb-2a2b-47db-855d-260872f0f08e tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:21.483456 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fae9c8eb-2a2b-47db-855d-260872f0f08e tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:21.484099 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fae9c8eb-2a2b-47db-855d-260872f0f08e tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:21.485012 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fae9c8eb-2a2b-47db-855d-260872f0f08e tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:21.487639 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fae9c8eb-2a2b-47db-855d-260872f0f08e tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:21.488250 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fae9c8eb-2a2b-47db-855d-260872f0f08e tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:21.564990 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-03905d5e-dd9c-4e86-861d-aa8dcf813ffc tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:16:21.588845 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-03905d5e-dd9c-4e86-861d-aa8dcf813ffc tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b" status: 200 len: 1519 microversion: 2.1 time: 0.510234 Aug 10 23:16:21.613705 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2150/4138] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:16:21 2022] GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b => generated 1519 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:16:21.613705 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-70078aef-88ce-4bf1-a348-cf92d981145b req-79539847-a0b1-4d4c-b685-5399b74d05d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ecbcf63-5592-4074-a3f7-d2caf3c58969", "tag": "4640966a-83e6-4989-a8a2-bbd72226c336"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:16:21.651611 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-70078aef-88ce-4bf1-a348-cf92d981145b req-79539847-a0b1-4d4c-b685-5399b74d05d7 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:21.663591 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-70078aef-88ce-4bf1-a348-cf92d981145b req-79539847-a0b1-4d4c-b685-5399b74d05d7 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:21.664381 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-70078aef-88ce-4bf1-a348-cf92d981145b req-79539847-a0b1-4d4c-b685-5399b74d05d7 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:21.698100 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-70078aef-88ce-4bf1-a348-cf92d981145b req-79539847-a0b1-4d4c-b685-5399b74d05d7 service nova] Creating event network-changed:4640966a-83e6-4989-a8a2-bbd72226c336 for instance 3ecbcf63-5592-4074-a3f7-d2caf3c58969 on n-h1-850468-14 Aug 10 23:16:21.707966 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-70078aef-88ce-4bf1-a348-cf92d981145b req-79539847-a0b1-4d4c-b685-5399b74d05d7 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107036 Aug 10 23:16:21.721904 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2151/4139] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:16:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:16:21.733964 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-ba606dc9-af35-4a01-936d-f1bd64052de7 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:16:21.743680 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-ba606dc9-af35-4a01-936d-f1bd64052de7 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] [instance: 3ecbcf63-5592-4074-a3f7-d2caf3c58969] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:16:21.762419 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ba606dc9-af35-4a01-936d-f1bd64052de7 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:21.765367 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ba606dc9-af35-4a01-936d-f1bd64052de7 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:21.765872 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ba606dc9-af35-4a01-936d-f1bd64052de7 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:21.766670 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ba606dc9-af35-4a01-936d-f1bd64052de7 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:21.773337 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ba606dc9-af35-4a01-936d-f1bd64052de7 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:21.773820 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ba606dc9-af35-4a01-936d-f1bd64052de7 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:22.562761 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=16 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:16:22.770160 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=4 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:16:23.043769 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=8 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:16:23.260793 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-fae9c8eb-2a2b-47db-855d-260872f0f08e tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cc4167255044d29a70c12a5a44d800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578d8e62013d43c5ad4d9a6d92e1f201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:16:23.279156 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-fae9c8eb-2a2b-47db-855d-260872f0f08e tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] 10.222.0.58 "GET /compute/v2.1/servers/c679e2a4-89de-4fcf-aed1-273220fdb2e8" status: 200 len: 1518 microversion: 2.1 time: 1.826625 Aug 10 23:16:23.279981 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1989/4140] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:16:21 2022] GET /compute/v2.1/servers/c679e2a4-89de-4fcf-aed1-273220fdb2e8 => generated 1518 bytes in 1828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:16:23.357866 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-b0685cca-cf2d-4803-9ae0-e93e94c1469c tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:16:23.358645 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-b0685cca-cf2d-4803-9ae0-e93e94c1469c tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: fa9dfd3a-a636-48ce-ae15-0ed51baee954] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:16:23.385517 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b0685cca-cf2d-4803-9ae0-e93e94c1469c tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:23.401212 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b0685cca-cf2d-4803-9ae0-e93e94c1469c tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:23.402494 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b0685cca-cf2d-4803-9ae0-e93e94c1469c tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:23.403503 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b0685cca-cf2d-4803-9ae0-e93e94c1469c tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:23.408160 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b0685cca-cf2d-4803-9ae0-e93e94c1469c tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:23.409148 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b0685cca-cf2d-4803-9ae0-e93e94c1469c tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:24.238850 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-ba606dc9-af35-4a01-936d-f1bd64052de7 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07c94ebf0954cdea12b9a689538d96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395d7c4077e54c43bb95288db3942b0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:16:24.263680 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-ba606dc9-af35-4a01-936d-f1bd64052de7 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] 10.222.0.58 "GET /compute/v2.1/servers/3ecbcf63-5592-4074-a3f7-d2caf3c58969" status: 200 len: 1372 microversion: 2.1 time: 2.539865 Aug 10 23:16:24.264482 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2152/4141] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:16:21 2022] GET /compute/v2.1/servers/3ecbcf63-5592-4074-a3f7-d2caf3c58969 => generated 1372 bytes in 2542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:16:24.277850 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-9030239c-aed8-4f07-99e6-d136ce8a54b3 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:16:24.278532 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-9030239c-aed8-4f07-99e6-d136ce8a54b3 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:16:24.299775 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9030239c-aed8-4f07-99e6-d136ce8a54b3 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:24.300361 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9030239c-aed8-4f07-99e6-d136ce8a54b3 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:24.300801 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9030239c-aed8-4f07-99e6-d136ce8a54b3 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:24.301798 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9030239c-aed8-4f07-99e6-d136ce8a54b3 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:24.302462 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9030239c-aed8-4f07-99e6-d136ce8a54b3 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:24.303061 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9030239c-aed8-4f07-99e6-d136ce8a54b3 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:24.401938 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-b0685cca-cf2d-4803-9ae0-e93e94c1469c tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:16:24.422073 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-b0685cca-cf2d-4803-9ae0-e93e94c1469c tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954" status: 200 len: 1669 microversion: 2.1 time: 1.123721 Aug 10 23:16:24.423518 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1990/4142] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:16:23 2022] GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954 => generated 1669 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:16:24.458182 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-f70eea87-1903-4836-a113-e2dbed8a1d9b tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:16:24.459344 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-f70eea87-1903-4836-a113-e2dbed8a1d9b tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] [instance: c679e2a4-89de-4fcf-aed1-273220fdb2e8] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:16:24.491423 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f70eea87-1903-4836-a113-e2dbed8a1d9b tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:24.492336 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f70eea87-1903-4836-a113-e2dbed8a1d9b tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:24.493106 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f70eea87-1903-4836-a113-e2dbed8a1d9b tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:24.494067 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f70eea87-1903-4836-a113-e2dbed8a1d9b tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:24.494738 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f70eea87-1903-4836-a113-e2dbed8a1d9b tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:24.495442 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f70eea87-1903-4836-a113-e2dbed8a1d9b tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:24.697073 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-9030239c-aed8-4f07-99e6-d136ce8a54b3 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:16:24.709743 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-9030239c-aed8-4f07-99e6-d136ce8a54b3 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b" status: 200 len: 1519 microversion: 2.1 time: 0.440968 Aug 10 23:16:24.714993 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2153/4143] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:16:24 2022] GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b => generated 1519 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:16:25.239326 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-f70eea87-1903-4836-a113-e2dbed8a1d9b tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cc4167255044d29a70c12a5a44d800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578d8e62013d43c5ad4d9a6d92e1f201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:16:25.269640 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-f70eea87-1903-4836-a113-e2dbed8a1d9b tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] 10.222.0.58 "GET /compute/v2.1/servers/c679e2a4-89de-4fcf-aed1-273220fdb2e8" status: 200 len: 1518 microversion: 2.1 time: 0.828748 Aug 10 23:16:25.281050 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-95d7628d-2d5e-42d7-a51b-624fae978360 req-d49200fa-d508-441b-99ff-d8d95e5d885c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c679e2a4-89de-4fcf-aed1-273220fdb2e8", "name": "network-vif-deleted", "tag": "1321852d-7dbc-4643-9a94-9bd2f2a028f2"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:16:25.285714 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1991/4144] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:16:24 2022] GET /compute/v2.1/servers/c679e2a4-89de-4fcf-aed1-273220fdb2e8 => generated 1518 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:16:25.344213 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-95d7628d-2d5e-42d7-a51b-624fae978360 req-d49200fa-d508-441b-99ff-d8d95e5d885c service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:25.344741 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-95d7628d-2d5e-42d7-a51b-624fae978360 req-d49200fa-d508-441b-99ff-d8d95e5d885c service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:25.345280 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-95d7628d-2d5e-42d7-a51b-624fae978360 req-d49200fa-d508-441b-99ff-d8d95e5d885c service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:25.347892 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-4d6e8fb4-5ce2-4d48-b31e-166623454994 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:16:25.348536 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-4d6e8fb4-5ce2-4d48-b31e-166623454994 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] [instance: 3ecbcf63-5592-4074-a3f7-d2caf3c58969] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:16:25.388460 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4d6e8fb4-5ce2-4d48-b31e-166623454994 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:25.389016 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4d6e8fb4-5ce2-4d48-b31e-166623454994 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:25.390812 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4d6e8fb4-5ce2-4d48-b31e-166623454994 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:25.391539 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4d6e8fb4-5ce2-4d48-b31e-166623454994 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:25.399082 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4d6e8fb4-5ce2-4d48-b31e-166623454994 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:25.399900 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4d6e8fb4-5ce2-4d48-b31e-166623454994 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:25.409238 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:16:25.418748 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-95d7628d-2d5e-42d7-a51b-624fae978360 req-d49200fa-d508-441b-99ff-d8d95e5d885c service nova] Creating event network-vif-deleted:1321852d-7dbc-4643-9a94-9bd2f2a028f2 for instance c679e2a4-89de-4fcf-aed1-273220fdb2e8 on n-h2-850468-14 Aug 10 23:16:25.462432 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-95d7628d-2d5e-42d7-a51b-624fae978360 req-d49200fa-d508-441b-99ff-d8d95e5d885c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.187971 Aug 10 23:16:25.466747 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2154/4145] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:16:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:16:25.482817 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-24e874e2-d29d-48d1-8648-65fae31732bc tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:16:25.487000 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-24e874e2-d29d-48d1-8648-65fae31732bc tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: fa9dfd3a-a636-48ce-ae15-0ed51baee954] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:16:25.550865 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-24e874e2-d29d-48d1-8648-65fae31732bc tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:25.555922 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-24e874e2-d29d-48d1-8648-65fae31732bc tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:25.557851 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-24e874e2-d29d-48d1-8648-65fae31732bc tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:25.560707 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-24e874e2-d29d-48d1-8648-65fae31732bc tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:25.561576 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-24e874e2-d29d-48d1-8648-65fae31732bc tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:25.565574 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-24e874e2-d29d-48d1-8648-65fae31732bc tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:26.160321 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-4d6e8fb4-5ce2-4d48-b31e-166623454994 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07c94ebf0954cdea12b9a689538d96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395d7c4077e54c43bb95288db3942b0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:16:26.172543 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-4d6e8fb4-5ce2-4d48-b31e-166623454994 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] 10.222.0.58 "GET /compute/v2.1/servers/3ecbcf63-5592-4074-a3f7-d2caf3c58969" status: 200 len: 1372 microversion: 2.1 time: 0.866715 Aug 10 23:16:26.173609 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1992/4146] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:16:25 2022] GET /compute/v2.1/servers/3ecbcf63-5592-4074-a3f7-d2caf3c58969 => generated 1372 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:16:26.192883 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-35bd68ca-6ee2-4aa7-89bd-e8783be8531e tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:16:26.208891 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-35bd68ca-6ee2-4aa7-89bd-e8783be8531e tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] [instance: 250395b5-5be8-420a-8709-dcf8b4241a4e] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:16:26.229087 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-35bd68ca-6ee2-4aa7-89bd-e8783be8531e tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:26.229579 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-35bd68ca-6ee2-4aa7-89bd-e8783be8531e tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:26.230020 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-35bd68ca-6ee2-4aa7-89bd-e8783be8531e tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:26.230738 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-35bd68ca-6ee2-4aa7-89bd-e8783be8531e tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:26.231224 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-35bd68ca-6ee2-4aa7-89bd-e8783be8531e tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:26.231655 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-35bd68ca-6ee2-4aa7-89bd-e8783be8531e tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:26.373044 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-35bd68ca-6ee2-4aa7-89bd-e8783be8531e tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "POST /compute/v2.1/servers/250395b5-5be8-420a-8709-dcf8b4241a4e/action" status: 200 len: 24552 microversion: 2.1 time: 0.198005 Aug 10 23:16:26.374701 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1993/4147] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:16:26 2022] POST /compute/v2.1/servers/250395b5-5be8-420a-8709-dcf8b4241a4e/action => generated 24552 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 23:16:26.391858 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-038b2858-f31b-4168-ae46-762b121a5fa4 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:16:26.396640 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-038b2858-f31b-4168-ae46-762b121a5fa4 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:16:26.397822 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-24e874e2-d29d-48d1-8648-65fae31732bc tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:16:26.412478 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-24e874e2-d29d-48d1-8648-65fae31732bc tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954" status: 200 len: 1669 microversion: 2.1 time: 0.943436 Aug 10 23:16:26.427178 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2155/4148] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:16:25 2022] GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954 => generated 1669 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:16:26.435182 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-d9559993-7265-4c85-980e-8deb2463ab61 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:16:26.445355 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-038b2858-f31b-4168-ae46-762b121a5fa4 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:26.446552 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-d9559993-7265-4c85-980e-8deb2463ab61 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] [instance: c679e2a4-89de-4fcf-aed1-273220fdb2e8] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:16:26.449326 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-038b2858-f31b-4168-ae46-762b121a5fa4 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:26.454136 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-038b2858-f31b-4168-ae46-762b121a5fa4 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:26.455216 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d9559993-7265-4c85-980e-8deb2463ab61 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:26.463701 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d9559993-7265-4c85-980e-8deb2463ab61 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:26.464451 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d9559993-7265-4c85-980e-8deb2463ab61 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:26.465384 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d9559993-7265-4c85-980e-8deb2463ab61 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:26.466079 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d9559993-7265-4c85-980e-8deb2463ab61 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:26.466737 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d9559993-7265-4c85-980e-8deb2463ab61 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:26.475388 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-038b2858-f31b-4168-ae46-762b121a5fa4 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:26.475933 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-038b2858-f31b-4168-ae46-762b121a5fa4 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:26.476390 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-038b2858-f31b-4168-ae46-762b121a5fa4 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:26.580220 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d9559993-7265-4c85-980e-8deb2463ab61 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:26.580747 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d9559993-7265-4c85-980e-8deb2463ab61 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:26.581211 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d9559993-7265-4c85-980e-8deb2463ab61 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:26.581715 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.objects.instance [None req-d9559993-7265-4c85-980e-8deb2463ab61 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lazy-loading 'fault' on Instance uuid c679e2a4-89de-4fcf-aed1-273220fdb2e8 {{(pid=122633) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:16:27.169553 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-d9559993-7265-4c85-980e-8deb2463ab61 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cc4167255044d29a70c12a5a44d800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578d8e62013d43c5ad4d9a6d92e1f201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:16:27.200184 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-d9559993-7265-4c85-980e-8deb2463ab61 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] 10.222.0.58 "GET /compute/v2.1/servers/c679e2a4-89de-4fcf-aed1-273220fdb2e8" status: 200 len: 1311 microversion: 2.1 time: 0.767825 Aug 10 23:16:27.205344 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2156/4149] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:16:26 2022] GET /compute/v2.1/servers/c679e2a4-89de-4fcf-aed1-273220fdb2e8 => generated 1311 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:16:27.216634 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-2dd84e07-281f-485b-a452-27843e3dc0e4 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:16:27.219580 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-2dd84e07-281f-485b-a452-27843e3dc0e4 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] [instance: 3ecbcf63-5592-4074-a3f7-d2caf3c58969] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:16:27.235407 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2dd84e07-281f-485b-a452-27843e3dc0e4 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:27.239006 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2dd84e07-281f-485b-a452-27843e3dc0e4 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:27.242557 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2dd84e07-281f-485b-a452-27843e3dc0e4 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:27.245295 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2dd84e07-281f-485b-a452-27843e3dc0e4 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:27.249854 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2dd84e07-281f-485b-a452-27843e3dc0e4 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:27.250493 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2dd84e07-281f-485b-a452-27843e3dc0e4 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:27.369016 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-038b2858-f31b-4168-ae46-762b121a5fa4 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:16:27.380052 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-038b2858-f31b-4168-ae46-762b121a5fa4 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b" status: 200 len: 1519 microversion: 2.1 time: 1.002170 Aug 10 23:16:27.389770 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1994/4150] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:16:26 2022] GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b => generated 1519 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:16:27.444595 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-e629dcc5-4534-4d05-bd74-2354cbc6ef5c tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:16:27.446306 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-e629dcc5-4534-4d05-bd74-2354cbc6ef5c tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: fa9dfd3a-a636-48ce-ae15-0ed51baee954] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:16:27.468037 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e629dcc5-4534-4d05-bd74-2354cbc6ef5c tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:27.468545 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e629dcc5-4534-4d05-bd74-2354cbc6ef5c tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:27.468991 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e629dcc5-4534-4d05-bd74-2354cbc6ef5c tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:27.474815 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e629dcc5-4534-4d05-bd74-2354cbc6ef5c tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:27.478499 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e629dcc5-4534-4d05-bd74-2354cbc6ef5c tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:27.481345 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e629dcc5-4534-4d05-bd74-2354cbc6ef5c tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:27.745719 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-2dd84e07-281f-485b-a452-27843e3dc0e4 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07c94ebf0954cdea12b9a689538d96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395d7c4077e54c43bb95288db3942b0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:16:27.761439 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-2dd84e07-281f-485b-a452-27843e3dc0e4 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] 10.222.0.58 "GET /compute/v2.1/servers/3ecbcf63-5592-4074-a3f7-d2caf3c58969" status: 200 len: 1372 microversion: 2.1 time: 0.554616 Aug 10 23:16:27.762362 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2157/4151] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:16:27 2022] GET /compute/v2.1/servers/3ecbcf63-5592-4074-a3f7-d2caf3c58969 => generated 1372 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:16:28.045740 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-e629dcc5-4534-4d05-bd74-2354cbc6ef5c tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:16:28.058840 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-e629dcc5-4534-4d05-bd74-2354cbc6ef5c tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954" status: 200 len: 1667 microversion: 2.1 time: 0.622830 Aug 10 23:16:28.066834 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1995/4152] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:16:27 2022] GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954 => generated 1667 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:16:28.227412 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-a1fbdd50-905f-4760-95d4-20d3eee661d9 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:16:28.228492 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-a1fbdd50-905f-4760-95d4-20d3eee661d9 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] [instance: c679e2a4-89de-4fcf-aed1-273220fdb2e8] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:16:28.241392 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a1fbdd50-905f-4760-95d4-20d3eee661d9 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:28.241900 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a1fbdd50-905f-4760-95d4-20d3eee661d9 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:28.242340 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a1fbdd50-905f-4760-95d4-20d3eee661d9 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:28.244227 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a1fbdd50-905f-4760-95d4-20d3eee661d9 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:28.244501 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a1fbdd50-905f-4760-95d4-20d3eee661d9 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:28.244943 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a1fbdd50-905f-4760-95d4-20d3eee661d9 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:28.277350 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-a1fbdd50-905f-4760-95d4-20d3eee661d9 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] HTTP exception thrown: Instance c679e2a4-89de-4fcf-aed1-273220fdb2e8 could not be found. Aug 10 23:16:28.279637 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-a1fbdd50-905f-4760-95d4-20d3eee661d9 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Request method failure captured: Aug 10 23:16:28.279637 n-d-850468-14 devstack@n-api.service[122633]: request: GET /compute/v2.1/servers/c679e2a4-89de-4fcf-aed1-273220fdb2e8 HTTP/1.1 Aug 10 23:16:28.279637 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:16:28.279637 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:16:28.279637 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:16:28.279637 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:16:28.279637 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:16:28.279637 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:16:28.279637 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:16:28.279637 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:16:28.279637 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9Dv2WB9UmvQB8pV9RI6BR4C0Kcs9bcD9A2s9uljbH_u19UW9hY5svVGdr7XwHDnAlMSSubbs6uragOBxV7NaefYhCQ9W2P_bDAL9XWY54zBcQelSeUixd-527PamrI7k1QLvdTufYhyABiIcubnyY_0LdE8ePb7VFjIz5fDa0tw2QfM Aug 10 23:16:28.279637 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:16:28.279637 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:16:28.279637 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:16:28.279637 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:16:28.279637 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:16:28.279637 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:16:28.279637 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 578d8e62013d43c5ad4d9a6d92e1f201 Aug 10 23:16:28.279637 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-ListServerFiltersTestJSON-1455134698 Aug 10 23:16:28.279637 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:16:28.279637 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:16:28.279637 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/578d8e62013d43c5ad4d9a6d92e1f201"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/578d8e62013d43c5ad4d9a6d92e1f201"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/578d8e62013d43c5ad4d9a6d92e1f201"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_578d8e62013d43c5ad4d9a6d92e1f201", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:16:28.279637 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-ListServerFiltersTestJSON-1455134698 Aug 10 23:16:28.279637 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 578d8e62013d43c5ad4d9a6d92e1f201 Aug 10 23:16:28.279637 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1455134698 Aug 10 23:16:28.279637 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-ListServerFiltersTestJSON-1455134698-project Aug 10 23:16:28.279637 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:16:28.279637 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:16:28.279637 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 06cc4167255044d29a70c12a5a44d800 Aug 10 23:16:28.279637 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-ListServerFiltersTestJSON-1455134698-project Aug 10 23:16:28.279637 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:16:28.279637 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance c679e2a4-89de-4fcf-aed1-273220fdb2e8 could not be found. Aug 10 23:16:28.279637 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': 'c679e2a4-89de-4fcf-aed1-273220fdb2e8'} Aug 10 23:16:28.279637 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:16:28.279637 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:16:28.279637 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:16:28.279637 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:16:28.279637 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:16:28.279637 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:16:28.279637 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:16:28.279637 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:16:28.279637 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:16:28.279637 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:16:28.279637 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c679e2a4-89de-4fcf-aed1-273220fdb2e8 could not be found. Aug 10 23:16:28.279637 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:16:28.279637 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:16:28.279637 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:16:28.279637 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:16:28.279637 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:16:28.279637 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:16:28.279637 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:16:28.279637 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:16:28.279637 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:16:28.279637 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:16:28.279637 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:16:28.279637 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:16:28.279637 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:16:28.279637 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:16:28.279637 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:16:28.279637 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:16:28.279637 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c679e2a4-89de-4fcf-aed1-273220fdb2e8 could not be found. Aug 10 23:16:28.279637 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:16:28.279637 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:16:28.279637 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:16:28.284881 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:16:28.284881 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:16:28.284881 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:16:28.284881 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:16:28.284881 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:16:28.284881 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c679e2a4-89de-4fcf-aed1-273220fdb2e8 could not be found. Aug 10 23:16:28.284881 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:16:28.286580 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-a1fbdd50-905f-4760-95d4-20d3eee661d9 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Returning 404 to user: Instance c679e2a4-89de-4fcf-aed1-273220fdb2e8 could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:16:28.287652 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-a1fbdd50-905f-4760-95d4-20d3eee661d9 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] 10.222.0.58 "GET /compute/v2.1/servers/c679e2a4-89de-4fcf-aed1-273220fdb2e8" status: 404 len: 111 microversion: 2.1 time: 0.065440 Aug 10 23:16:28.292067 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2158/4153] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:16:28 2022] GET /compute/v2.1/servers/c679e2a4-89de-4fcf-aed1-273220fdb2e8 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:16:28.296941 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-505f439c-ef6d-4959-900a-6563233ea5e7 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:16:28.297643 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-505f439c-ef6d-4959-900a-6563233ea5e7 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] [instance: fdd1f85d-95db-477c-a173-a6fca94f58b1] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:16:28.308769 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-505f439c-ef6d-4959-900a-6563233ea5e7 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:28.309267 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-505f439c-ef6d-4959-900a-6563233ea5e7 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:28.309705 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-505f439c-ef6d-4959-900a-6563233ea5e7 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:28.314459 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-505f439c-ef6d-4959-900a-6563233ea5e7 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:28.316930 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-505f439c-ef6d-4959-900a-6563233ea5e7 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:28.320257 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-505f439c-ef6d-4959-900a-6563233ea5e7 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:28.393720 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-505f439c-ef6d-4959-900a-6563233ea5e7 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] [instance: fdd1f85d-95db-477c-a173-a6fca94f58b1] Going to try to terminate instance {{(pid=122632) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:16:28.413750 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-06de4cc9-0cef-4239-8b58-8357570c1ad6 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:16:28.414468 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-06de4cc9-0cef-4239-8b58-8357570c1ad6 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:16:28.425990 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-06de4cc9-0cef-4239-8b58-8357570c1ad6 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:28.426906 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-06de4cc9-0cef-4239-8b58-8357570c1ad6 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:28.427610 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-06de4cc9-0cef-4239-8b58-8357570c1ad6 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:28.428582 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-06de4cc9-0cef-4239-8b58-8357570c1ad6 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:28.432868 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=100 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:16:28.434136 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-06de4cc9-0cef-4239-8b58-8357570c1ad6 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:28.435003 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-06de4cc9-0cef-4239-8b58-8357570c1ad6 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:28.654733 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-505f439c-ef6d-4959-900a-6563233ea5e7 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] 10.222.0.58 "DELETE /compute/v2.1/servers/fdd1f85d-95db-477c-a173-a6fca94f58b1" status: 204 len: 0 microversion: 2.1 time: 0.357546 Aug 10 23:16:28.655413 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1996/4154] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:16:28 2022] DELETE /compute/v2.1/servers/fdd1f85d-95db-477c-a173-a6fca94f58b1 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:16:28.681073 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-e43ee771-e368-4b02-b99e-a0c57300df65 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:16:28.695369 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-e43ee771-e368-4b02-b99e-a0c57300df65 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] [instance: fdd1f85d-95db-477c-a173-a6fca94f58b1] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:16:28.731451 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e43ee771-e368-4b02-b99e-a0c57300df65 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:28.734311 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e43ee771-e368-4b02-b99e-a0c57300df65 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:28.734760 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e43ee771-e368-4b02-b99e-a0c57300df65 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:28.740494 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e43ee771-e368-4b02-b99e-a0c57300df65 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:28.744210 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e43ee771-e368-4b02-b99e-a0c57300df65 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:28.747505 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e43ee771-e368-4b02-b99e-a0c57300df65 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:28.753599 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-06de4cc9-0cef-4239-8b58-8357570c1ad6 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:16:28.775695 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-06de4cc9-0cef-4239-8b58-8357570c1ad6 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b" status: 200 len: 1519 microversion: 2.1 time: 0.361134 Aug 10 23:16:28.793442 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2159/4155] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:16:28 2022] GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b => generated 1519 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:16:28.799162 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-7ca3e5f0-ab8c-4b50-91bc-4712fb10fef7 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:16:28.800124 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-7ca3e5f0-ab8c-4b50-91bc-4712fb10fef7 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] [instance: 3ecbcf63-5592-4074-a3f7-d2caf3c58969] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:16:28.809382 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7ca3e5f0-ab8c-4b50-91bc-4712fb10fef7 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:28.810159 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7ca3e5f0-ab8c-4b50-91bc-4712fb10fef7 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:28.810979 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7ca3e5f0-ab8c-4b50-91bc-4712fb10fef7 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:28.812054 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7ca3e5f0-ab8c-4b50-91bc-4712fb10fef7 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:28.812784 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7ca3e5f0-ab8c-4b50-91bc-4712fb10fef7 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:28.813597 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7ca3e5f0-ab8c-4b50-91bc-4712fb10fef7 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:29.164531 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-7ca3e5f0-ab8c-4b50-91bc-4712fb10fef7 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07c94ebf0954cdea12b9a689538d96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395d7c4077e54c43bb95288db3942b0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:16:29.183662 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-7ca3e5f0-ab8c-4b50-91bc-4712fb10fef7 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] 10.222.0.58 "GET /compute/v2.1/servers/3ecbcf63-5592-4074-a3f7-d2caf3c58969" status: 200 len: 1372 microversion: 2.1 time: 0.379742 Aug 10 23:16:29.211505 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2160/4156] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:16:28 2022] GET /compute/v2.1/servers/3ecbcf63-5592-4074-a3f7-d2caf3c58969 => generated 1372 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:16:29.551043 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-e43ee771-e368-4b02-b99e-a0c57300df65 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cc4167255044d29a70c12a5a44d800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578d8e62013d43c5ad4d9a6d92e1f201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:16:29.567263 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-e43ee771-e368-4b02-b99e-a0c57300df65 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] 10.222.0.58 "GET /compute/v2.1/servers/fdd1f85d-95db-477c-a173-a6fca94f58b1" status: 200 len: 1519 microversion: 2.1 time: 0.900699 Aug 10 23:16:29.567938 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1997/4157] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:16:28 2022] GET /compute/v2.1/servers/fdd1f85d-95db-477c-a173-a6fca94f58b1 => generated 1519 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:16:29.803061 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-7c142379-169a-4ae4-900b-c722b5bf1de3 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:16:29.805699 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-7c142379-169a-4ae4-900b-c722b5bf1de3 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:16:29.816938 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7c142379-169a-4ae4-900b-c722b5bf1de3 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:29.817728 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7c142379-169a-4ae4-900b-c722b5bf1de3 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:29.818314 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7c142379-169a-4ae4-900b-c722b5bf1de3 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:29.819456 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7c142379-169a-4ae4-900b-c722b5bf1de3 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:29.820204 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7c142379-169a-4ae4-900b-c722b5bf1de3 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:29.821246 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7c142379-169a-4ae4-900b-c722b5bf1de3 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:30.174733 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-7c142379-169a-4ae4-900b-c722b5bf1de3 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:16:30.191044 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-7c142379-169a-4ae4-900b-c722b5bf1de3 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b" status: 200 len: 1519 microversion: 2.1 time: 0.394132 Aug 10 23:16:30.211709 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2161/4158] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:16:29 2022] GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b => generated 1519 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:16:30.217925 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-0c46babd-973e-4ffa-959d-4d9b99d12fa0 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:16:30.218686 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-0c46babd-973e-4ffa-959d-4d9b99d12fa0 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] [instance: 3ecbcf63-5592-4074-a3f7-d2caf3c58969] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:16:30.233332 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0c46babd-973e-4ffa-959d-4d9b99d12fa0 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:30.233852 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0c46babd-973e-4ffa-959d-4d9b99d12fa0 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:30.234761 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0c46babd-973e-4ffa-959d-4d9b99d12fa0 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:30.236021 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0c46babd-973e-4ffa-959d-4d9b99d12fa0 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:30.238761 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0c46babd-973e-4ffa-959d-4d9b99d12fa0 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:30.239876 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0c46babd-973e-4ffa-959d-4d9b99d12fa0 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:30.589119 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-fa91feab-4137-4880-9627-951dc3bc71b5 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:16:30.589734 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-fa91feab-4137-4880-9627-951dc3bc71b5 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] [instance: fdd1f85d-95db-477c-a173-a6fca94f58b1] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:16:30.599420 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fa91feab-4137-4880-9627-951dc3bc71b5 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:30.602355 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fa91feab-4137-4880-9627-951dc3bc71b5 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:30.603307 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fa91feab-4137-4880-9627-951dc3bc71b5 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:30.604327 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fa91feab-4137-4880-9627-951dc3bc71b5 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:30.609829 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fa91feab-4137-4880-9627-951dc3bc71b5 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:30.610872 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fa91feab-4137-4880-9627-951dc3bc71b5 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:31.582800 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-fa91feab-4137-4880-9627-951dc3bc71b5 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cc4167255044d29a70c12a5a44d800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578d8e62013d43c5ad4d9a6d92e1f201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:16:31.603247 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-fa91feab-4137-4880-9627-951dc3bc71b5 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] 10.222.0.58 "GET /compute/v2.1/servers/fdd1f85d-95db-477c-a173-a6fca94f58b1" status: 200 len: 1519 microversion: 2.1 time: 1.018213 Aug 10 23:16:31.604107 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2162/4159] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:16:30 2022] GET /compute/v2.1/servers/fdd1f85d-95db-477c-a173-a6fca94f58b1 => generated 1519 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:16:31.638725 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-d8d89a7f-721d-4975-936d-e4853bbc584b tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:16:31.639653 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-d8d89a7f-721d-4975-936d-e4853bbc584b tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:16:31.652174 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d8d89a7f-721d-4975-936d-e4853bbc584b tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:31.659610 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d8d89a7f-721d-4975-936d-e4853bbc584b tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:31.660358 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d8d89a7f-721d-4975-936d-e4853bbc584b tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:31.661290 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d8d89a7f-721d-4975-936d-e4853bbc584b tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:31.661907 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d8d89a7f-721d-4975-936d-e4853bbc584b tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:31.662522 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d8d89a7f-721d-4975-936d-e4853bbc584b tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:31.758335 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-0c46babd-973e-4ffa-959d-4d9b99d12fa0 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07c94ebf0954cdea12b9a689538d96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395d7c4077e54c43bb95288db3942b0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:16:31.767170 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-0c46babd-973e-4ffa-959d-4d9b99d12fa0 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] 10.222.0.58 "GET /compute/v2.1/servers/3ecbcf63-5592-4074-a3f7-d2caf3c58969" status: 200 len: 1372 microversion: 2.1 time: 1.555595 Aug 10 23:16:31.770152 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1998/4160] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:16:30 2022] GET /compute/v2.1/servers/3ecbcf63-5592-4074-a3f7-d2caf3c58969 => generated 1372 bytes in 1559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:16:32.163013 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-d8d89a7f-721d-4975-936d-e4853bbc584b tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:16:32.183416 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-d8d89a7f-721d-4975-936d-e4853bbc584b tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b" status: 200 len: 1519 microversion: 2.1 time: 0.563442 Aug 10 23:16:32.184359 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2163/4161] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:16:31 2022] GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b => generated 1519 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:16:32.654924 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-21f516fe-e739-4554-ae9c-51750c559485 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:16:32.657628 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-21f516fe-e739-4554-ae9c-51750c559485 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] [instance: fdd1f85d-95db-477c-a173-a6fca94f58b1] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:16:32.673705 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-cd70a866-8651-486c-9017-c1990db57f06 req-658ff7eb-004d-41ef-9a05-f87f6020692c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fdd1f85d-95db-477c-a173-a6fca94f58b1", "name": "network-vif-deleted", "tag": "a46ccf0f-4a14-45f7-82c0-e8964c2eb19e"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:16:32.717793 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-21f516fe-e739-4554-ae9c-51750c559485 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:32.722065 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-21f516fe-e739-4554-ae9c-51750c559485 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:32.722770 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-21f516fe-e739-4554-ae9c-51750c559485 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:32.724603 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-21f516fe-e739-4554-ae9c-51750c559485 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:32.726323 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-21f516fe-e739-4554-ae9c-51750c559485 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:32.726521 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-cd70a866-8651-486c-9017-c1990db57f06 req-658ff7eb-004d-41ef-9a05-f87f6020692c service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:32.727039 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-cd70a866-8651-486c-9017-c1990db57f06 req-658ff7eb-004d-41ef-9a05-f87f6020692c service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:32.727475 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-cd70a866-8651-486c-9017-c1990db57f06 req-658ff7eb-004d-41ef-9a05-f87f6020692c service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:32.728166 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-21f516fe-e739-4554-ae9c-51750c559485 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:32.797454 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-cd70a866-8651-486c-9017-c1990db57f06 req-658ff7eb-004d-41ef-9a05-f87f6020692c service nova] Creating event network-vif-deleted:a46ccf0f-4a14-45f7-82c0-e8964c2eb19e for instance fdd1f85d-95db-477c-a173-a6fca94f58b1 on n-h1-850468-14 Aug 10 23:16:32.838342 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-cd70a866-8651-486c-9017-c1990db57f06 req-658ff7eb-004d-41ef-9a05-f87f6020692c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.161946 Aug 10 23:16:32.847189 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2164/4162] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:16:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 23:16:32.862606 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-268eda5a-cdbd-40a3-9509-fb5a0668eaf3 tempest-TestNetworkAdvancedServerOps-1638906998 tempest-TestNetworkAdvancedServerOps-1638906998-project-admin] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:16:32.883387 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-268eda5a-cdbd-40a3-9509-fb5a0668eaf3 tempest-TestNetworkAdvancedServerOps-1638906998 tempest-TestNetworkAdvancedServerOps-1638906998-project-admin] [instance: 250395b5-5be8-420a-8709-dcf8b4241a4e] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:16:32.907871 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-268eda5a-cdbd-40a3-9509-fb5a0668eaf3 tempest-TestNetworkAdvancedServerOps-1638906998 tempest-TestNetworkAdvancedServerOps-1638906998-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:32.913917 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-268eda5a-cdbd-40a3-9509-fb5a0668eaf3 tempest-TestNetworkAdvancedServerOps-1638906998 tempest-TestNetworkAdvancedServerOps-1638906998-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:32.916876 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-268eda5a-cdbd-40a3-9509-fb5a0668eaf3 tempest-TestNetworkAdvancedServerOps-1638906998 tempest-TestNetworkAdvancedServerOps-1638906998-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:32.924965 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-268eda5a-cdbd-40a3-9509-fb5a0668eaf3 tempest-TestNetworkAdvancedServerOps-1638906998 tempest-TestNetworkAdvancedServerOps-1638906998-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:32.929083 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-268eda5a-cdbd-40a3-9509-fb5a0668eaf3 tempest-TestNetworkAdvancedServerOps-1638906998 tempest-TestNetworkAdvancedServerOps-1638906998-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:32.932281 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-268eda5a-cdbd-40a3-9509-fb5a0668eaf3 tempest-TestNetworkAdvancedServerOps-1638906998 tempest-TestNetworkAdvancedServerOps-1638906998-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:33.173277 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-21f516fe-e739-4554-ae9c-51750c559485 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06cc4167255044d29a70c12a5a44d800', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '578d8e62013d43c5ad4d9a6d92e1f201', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:16:33.196793 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-21f516fe-e739-4554-ae9c-51750c559485 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] 10.222.0.58 "GET /compute/v2.1/servers/fdd1f85d-95db-477c-a173-a6fca94f58b1" status: 200 len: 1306 microversion: 2.1 time: 0.575420 Aug 10 23:16:33.197507 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 1999/4163] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:16:32 2022] GET /compute/v2.1/servers/fdd1f85d-95db-477c-a173-a6fca94f58b1 => generated 1306 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:16:33.226427 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-93efd60c-4d53-43f3-9658-55e2d561f26c tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:16:33.228004 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-93efd60c-4d53-43f3-9658-55e2d561f26c tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] [instance: 3ecbcf63-5592-4074-a3f7-d2caf3c58969] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:16:33.244475 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-93efd60c-4d53-43f3-9658-55e2d561f26c tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:33.250191 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-93efd60c-4d53-43f3-9658-55e2d561f26c tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:33.253409 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-93efd60c-4d53-43f3-9658-55e2d561f26c tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:33.254406 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-93efd60c-4d53-43f3-9658-55e2d561f26c tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:33.255073 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-93efd60c-4d53-43f3-9658-55e2d561f26c tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:33.257434 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-93efd60c-4d53-43f3-9658-55e2d561f26c tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:33.340157 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-268eda5a-cdbd-40a3-9509-fb5a0668eaf3 tempest-TestNetworkAdvancedServerOps-1638906998 tempest-TestNetworkAdvancedServerOps-1638906998-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/250395b5-5be8-420a-8709-dcf8b4241a4e" status: 200 len: 1835 microversion: 2.1 time: 0.491565 Aug 10 23:16:33.342359 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2165/4164] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:16:32 2022] GET /compute/v2.1/servers/250395b5-5be8-420a-8709-dcf8b4241a4e => generated 1835 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:16:33.348126 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-a87b614b-a505-4cf8-aaaf-dccd9387da96 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:16:33.363767 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-a87b614b-a505-4cf8-aaaf-dccd9387da96 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:16:33.379000 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a87b614b-a505-4cf8-aaaf-dccd9387da96 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:33.382283 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a87b614b-a505-4cf8-aaaf-dccd9387da96 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:33.382960 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a87b614b-a505-4cf8-aaaf-dccd9387da96 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:33.383883 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a87b614b-a505-4cf8-aaaf-dccd9387da96 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:33.384350 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a87b614b-a505-4cf8-aaaf-dccd9387da96 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:33.384787 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a87b614b-a505-4cf8-aaaf-dccd9387da96 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:33.800728 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-a87b614b-a505-4cf8-aaaf-dccd9387da96 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:16:33.811096 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-a87b614b-a505-4cf8-aaaf-dccd9387da96 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b" status: 200 len: 1519 microversion: 2.1 time: 0.467308 Aug 10 23:16:33.812729 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2166/4165] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:16:33 2022] GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b => generated 1519 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:16:33.824327 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-526bb83c-5b18-498b-9932-f8c79c258935 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:16:33.827506 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-526bb83c-5b18-498b-9932-f8c79c258935 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] [instance: 250395b5-5be8-420a-8709-dcf8b4241a4e] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:16:33.854088 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-526bb83c-5b18-498b-9932-f8c79c258935 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:33.854392 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-526bb83c-5b18-498b-9932-f8c79c258935 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:33.854936 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-526bb83c-5b18-498b-9932-f8c79c258935 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:33.856457 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-526bb83c-5b18-498b-9932-f8c79c258935 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:33.857299 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-526bb83c-5b18-498b-9932-f8c79c258935 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:33.857965 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-526bb83c-5b18-498b-9932-f8c79c258935 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:34.123834 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-526bb83c-5b18-498b-9932-f8c79c258935 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5899b2ad9f1046caaf7c6073e408eeee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25abd63376614081a9d484f3c9ae950d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:16:34.134177 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-526bb83c-5b18-498b-9932-f8c79c258935 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "GET /compute/v2.1/servers/250395b5-5be8-420a-8709-dcf8b4241a4e" status: 200 len: 1682 microversion: 2.1 time: 0.319234 Aug 10 23:16:34.135942 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2167/4166] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:16:33 2022] GET /compute/v2.1/servers/250395b5-5be8-420a-8709-dcf8b4241a4e => generated 1682 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:16:34.201931 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-93efd60c-4d53-43f3-9658-55e2d561f26c tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07c94ebf0954cdea12b9a689538d96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395d7c4077e54c43bb95288db3942b0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:16:34.213717 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-93efd60c-4d53-43f3-9658-55e2d561f26c tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] 10.222.0.58 "GET /compute/v2.1/servers/3ecbcf63-5592-4074-a3f7-d2caf3c58969" status: 200 len: 1372 microversion: 2.1 time: 1.015086 Aug 10 23:16:34.218525 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2000/4167] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:16:33 2022] GET /compute/v2.1/servers/3ecbcf63-5592-4074-a3f7-d2caf3c58969 => generated 1372 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:16:34.222669 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-0a4caf6f-67c5-47a8-a414-af75baae57a6 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:16:34.223638 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-0a4caf6f-67c5-47a8-a414-af75baae57a6 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] [instance: fdd1f85d-95db-477c-a173-a6fca94f58b1] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:16:34.245500 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0a4caf6f-67c5-47a8-a414-af75baae57a6 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:34.246186 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0a4caf6f-67c5-47a8-a414-af75baae57a6 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:34.248788 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0a4caf6f-67c5-47a8-a414-af75baae57a6 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:34.251513 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0a4caf6f-67c5-47a8-a414-af75baae57a6 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:34.256241 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0a4caf6f-67c5-47a8-a414-af75baae57a6 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:34.257006 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0a4caf6f-67c5-47a8-a414-af75baae57a6 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:34.296658 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-78f9f72e-6f60-4296-9296-b3f8c4842e4f tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:16:34.304847 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-78f9f72e-6f60-4296-9296-b3f8c4842e4f tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] [instance: 250395b5-5be8-420a-8709-dcf8b4241a4e] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:16:34.320709 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-0a4caf6f-67c5-47a8-a414-af75baae57a6 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] HTTP exception thrown: Instance fdd1f85d-95db-477c-a173-a6fca94f58b1 could not be found. Aug 10 23:16:34.334149 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-0a4caf6f-67c5-47a8-a414-af75baae57a6 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Request method failure captured: Aug 10 23:16:34.334149 n-d-850468-14 devstack@n-api.service[122633]: request: GET /compute/v2.1/servers/fdd1f85d-95db-477c-a173-a6fca94f58b1 HTTP/1.1 Aug 10 23:16:34.334149 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:16:34.334149 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:16:34.334149 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:16:34.334149 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:16:34.334149 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:16:34.334149 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:16:34.334149 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:16:34.334149 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:16:34.334149 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9Dv2WB9UmvQB8pV9RI6BR4C0Kcs9bcD9A2s9uljbH_u19UW9hY5svVGdr7XwHDnAlMSSubbs6uragOBxV7NaefYhCQ9W2P_bDAL9XWY54zBcQelSeUixd-527PamrI7k1QLvdTufYhyABiIcubnyY_0LdE8ePb7VFjIz5fDa0tw2QfM Aug 10 23:16:34.334149 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:16:34.334149 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:16:34.334149 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:16:34.334149 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:16:34.334149 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:16:34.334149 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:16:34.334149 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 578d8e62013d43c5ad4d9a6d92e1f201 Aug 10 23:16:34.334149 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-ListServerFiltersTestJSON-1455134698 Aug 10 23:16:34.334149 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:16:34.334149 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:16:34.334149 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/578d8e62013d43c5ad4d9a6d92e1f201"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/578d8e62013d43c5ad4d9a6d92e1f201"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/578d8e62013d43c5ad4d9a6d92e1f201"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_578d8e62013d43c5ad4d9a6d92e1f201", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:16:34.334149 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-ListServerFiltersTestJSON-1455134698 Aug 10 23:16:34.334149 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 578d8e62013d43c5ad4d9a6d92e1f201 Aug 10 23:16:34.334149 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-1455134698 Aug 10 23:16:34.334149 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-ListServerFiltersTestJSON-1455134698-project Aug 10 23:16:34.334149 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:16:34.334149 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:16:34.334149 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 06cc4167255044d29a70c12a5a44d800 Aug 10 23:16:34.334149 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-ListServerFiltersTestJSON-1455134698-project Aug 10 23:16:34.334149 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:16:34.334149 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance fdd1f85d-95db-477c-a173-a6fca94f58b1 could not be found. Aug 10 23:16:34.334149 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': 'fdd1f85d-95db-477c-a173-a6fca94f58b1'} Aug 10 23:16:34.334149 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:16:34.334149 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:16:34.334149 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:16:34.334149 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:16:34.334149 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:16:34.334149 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:16:34.334149 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:16:34.334149 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:16:34.334149 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:16:34.334149 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:16:34.334149 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fdd1f85d-95db-477c-a173-a6fca94f58b1 could not be found. Aug 10 23:16:34.334149 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:16:34.334149 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:16:34.334149 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:16:34.334149 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:16:34.334149 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:16:34.334149 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:16:34.334149 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:16:34.334149 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:16:34.334149 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:16:34.334149 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:16:34.334149 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:16:34.334149 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:16:34.334149 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:16:34.334149 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:16:34.334149 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:16:34.334149 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:16:34.334149 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fdd1f85d-95db-477c-a173-a6fca94f58b1 could not be found. Aug 10 23:16:34.334149 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:16:34.334149 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:16:34.334149 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:16:34.340188 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:16:34.340188 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:16:34.340188 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:16:34.340188 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:16:34.340188 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:16:34.340188 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fdd1f85d-95db-477c-a173-a6fca94f58b1 could not be found. Aug 10 23:16:34.340188 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:16:34.341318 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-78f9f72e-6f60-4296-9296-b3f8c4842e4f tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:34.341488 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-0a4caf6f-67c5-47a8-a414-af75baae57a6 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] Returning 404 to user: Instance fdd1f85d-95db-477c-a173-a6fca94f58b1 could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:16:34.342875 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-78f9f72e-6f60-4296-9296-b3f8c4842e4f tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:34.344346 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-0a4caf6f-67c5-47a8-a414-af75baae57a6 tempest-ListServerFiltersTestJSON-1455134698 tempest-ListServerFiltersTestJSON-1455134698-project] 10.222.0.58 "GET /compute/v2.1/servers/fdd1f85d-95db-477c-a173-a6fca94f58b1" status: 404 len: 111 microversion: 2.1 time: 0.128826 Aug 10 23:16:34.346732 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-78f9f72e-6f60-4296-9296-b3f8c4842e4f tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:34.350148 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-78f9f72e-6f60-4296-9296-b3f8c4842e4f tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:34.351043 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2168/4168] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:16:34 2022] GET /compute/v2.1/servers/fdd1f85d-95db-477c-a173-a6fca94f58b1 => generated 111 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 10 23:16:34.355745 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-78f9f72e-6f60-4296-9296-b3f8c4842e4f tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:34.359867 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-78f9f72e-6f60-4296-9296-b3f8c4842e4f tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:34.468255 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-78f9f72e-6f60-4296-9296-b3f8c4842e4f tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "POST /compute/v2.1/servers/250395b5-5be8-420a-8709-dcf8b4241a4e/action" status: 200 len: 32617 microversion: 2.1 time: 0.176463 Aug 10 23:16:34.470493 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2001/4169] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:16:34 2022] POST /compute/v2.1/servers/250395b5-5be8-420a-8709-dcf8b4241a4e/action => generated 32617 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 23:16:34.721636 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-67a65d45-9763-4cc7-a842-eaa79a246cbd tempest-TestNetworkAdvancedServerOps-1638906998 tempest-TestNetworkAdvancedServerOps-1638906998-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:16:34.722306 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-67a65d45-9763-4cc7-a842-eaa79a246cbd tempest-TestNetworkAdvancedServerOps-1638906998 tempest-TestNetworkAdvancedServerOps-1638906998-project-admin] [instance: 250395b5-5be8-420a-8709-dcf8b4241a4e] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:16:34.738892 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-67a65d45-9763-4cc7-a842-eaa79a246cbd tempest-TestNetworkAdvancedServerOps-1638906998 tempest-TestNetworkAdvancedServerOps-1638906998-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:34.750202 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-67a65d45-9763-4cc7-a842-eaa79a246cbd tempest-TestNetworkAdvancedServerOps-1638906998 tempest-TestNetworkAdvancedServerOps-1638906998-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:34.751227 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-67a65d45-9763-4cc7-a842-eaa79a246cbd tempest-TestNetworkAdvancedServerOps-1638906998 tempest-TestNetworkAdvancedServerOps-1638906998-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:34.752038 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-67a65d45-9763-4cc7-a842-eaa79a246cbd tempest-TestNetworkAdvancedServerOps-1638906998 tempest-TestNetworkAdvancedServerOps-1638906998-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:34.752500 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-67a65d45-9763-4cc7-a842-eaa79a246cbd tempest-TestNetworkAdvancedServerOps-1638906998 tempest-TestNetworkAdvancedServerOps-1638906998-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:34.755432 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-67a65d45-9763-4cc7-a842-eaa79a246cbd tempest-TestNetworkAdvancedServerOps-1638906998 tempest-TestNetworkAdvancedServerOps-1638906998-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:34.841818 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-c042ddb4-1eb4-4927-8f25-3ea7bd3165f8 req-eab268bd-5ce1-403d-bb36-6e8ad7ea7200 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ecbcf63-5592-4074-a3f7-d2caf3c58969", "name": "network-vif-plugged", "status": "completed", "tag": "4640966a-83e6-4989-a8a2-bbd72226c336"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:16:34.852557 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:16:34.864805 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-c042ddb4-1eb4-4927-8f25-3ea7bd3165f8 req-eab268bd-5ce1-403d-bb36-6e8ad7ea7200 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:34.866167 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-c042ddb4-1eb4-4927-8f25-3ea7bd3165f8 req-eab268bd-5ce1-403d-bb36-6e8ad7ea7200 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:34.867772 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-c042ddb4-1eb4-4927-8f25-3ea7bd3165f8 req-eab268bd-5ce1-403d-bb36-6e8ad7ea7200 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:34.880664 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-67a65d45-9763-4cc7-a842-eaa79a246cbd tempest-TestNetworkAdvancedServerOps-1638906998 tempest-TestNetworkAdvancedServerOps-1638906998-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '65a256e981ee4d93a6de8367b08ecfe1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '037d8874e06345d794e8d5b85d773054', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:16:34.892335 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-67a65d45-9763-4cc7-a842-eaa79a246cbd tempest-TestNetworkAdvancedServerOps-1638906998 tempest-TestNetworkAdvancedServerOps-1638906998-project-admin] [instance: 250395b5-5be8-420a-8709-dcf8b4241a4e] flavor_id is None. Assuming migration. {{(pid=122632) resize /opt/stack/nova/nova/compute/api.py:4144}} Aug 10 23:16:34.892945 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-c042ddb4-1eb4-4927-8f25-3ea7bd3165f8 req-eab268bd-5ce1-403d-bb36-6e8ad7ea7200 service nova] Creating event network-vif-plugged:4640966a-83e6-4989-a8a2-bbd72226c336 for instance 3ecbcf63-5592-4074-a3f7-d2caf3c58969 on n-h1-850468-14 Aug 10 23:16:34.893072 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-67a65d45-9763-4cc7-a842-eaa79a246cbd tempest-TestNetworkAdvancedServerOps-1638906998 tempest-TestNetworkAdvancedServerOps-1638906998-project-admin] [instance: 250395b5-5be8-420a-8709-dcf8b4241a4e] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=122632) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 10 23:16:34.899263 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-c042ddb4-1eb4-4927-8f25-3ea7bd3165f8 req-eab268bd-5ce1-403d-bb36-6e8ad7ea7200 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.545758 Aug 10 23:16:34.900155 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2169/4170] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:16:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:16:34.908610 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-b43c2812-665f-4884-962c-5d89a5556a84 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:16:34.916025 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-b43c2812-665f-4884-962c-5d89a5556a84 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:16:34.934459 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b43c2812-665f-4884-962c-5d89a5556a84 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:34.934578 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b43c2812-665f-4884-962c-5d89a5556a84 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:34.935042 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b43c2812-665f-4884-962c-5d89a5556a84 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:34.936435 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b43c2812-665f-4884-962c-5d89a5556a84 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:34.936926 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b43c2812-665f-4884-962c-5d89a5556a84 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:34.937366 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b43c2812-665f-4884-962c-5d89a5556a84 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:35.227274 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-67a65d45-9763-4cc7-a842-eaa79a246cbd tempest-TestNetworkAdvancedServerOps-1638906998 tempest-TestNetworkAdvancedServerOps-1638906998-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/250395b5-5be8-420a-8709-dcf8b4241a4e/action" status: 202 len: 0 microversion: 2.1 time: 0.510538 Aug 10 23:16:35.239310 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2002/4171] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:16:34 2022] POST /compute/v2.1/servers/250395b5-5be8-420a-8709-dcf8b4241a4e/action => generated 0 bytes in 523 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:16:35.246136 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-f75aeee2-1230-4c96-8335-f4a399a3d08c tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:16:35.247082 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-f75aeee2-1230-4c96-8335-f4a399a3d08c tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] [instance: 250395b5-5be8-420a-8709-dcf8b4241a4e] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:16:35.263750 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f75aeee2-1230-4c96-8335-f4a399a3d08c tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:35.264666 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f75aeee2-1230-4c96-8335-f4a399a3d08c tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:35.270088 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f75aeee2-1230-4c96-8335-f4a399a3d08c tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:35.271434 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f75aeee2-1230-4c96-8335-f4a399a3d08c tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:35.272339 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f75aeee2-1230-4c96-8335-f4a399a3d08c tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:35.273059 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f75aeee2-1230-4c96-8335-f4a399a3d08c tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:35.434728 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-b43c2812-665f-4884-962c-5d89a5556a84 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:16:35.496962 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-b43c2812-665f-4884-962c-5d89a5556a84 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b" status: 200 len: 1519 microversion: 2.1 time: 0.593448 Aug 10 23:16:35.505079 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2170/4172] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:16:34 2022] GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b => generated 1519 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:16:35.516092 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-5aa23e54-3014-4a0f-badf-c9cd1a8608ca tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:16:35.521559 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-5aa23e54-3014-4a0f-badf-c9cd1a8608ca tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] [instance: 3ecbcf63-5592-4074-a3f7-d2caf3c58969] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:16:35.541259 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5aa23e54-3014-4a0f-badf-c9cd1a8608ca tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:35.541776 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5aa23e54-3014-4a0f-badf-c9cd1a8608ca tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:35.542352 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5aa23e54-3014-4a0f-badf-c9cd1a8608ca tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:35.543093 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5aa23e54-3014-4a0f-badf-c9cd1a8608ca tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:35.543555 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5aa23e54-3014-4a0f-badf-c9cd1a8608ca tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:35.543989 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5aa23e54-3014-4a0f-badf-c9cd1a8608ca tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:35.915650 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-5aa23e54-3014-4a0f-badf-c9cd1a8608ca tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07c94ebf0954cdea12b9a689538d96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395d7c4077e54c43bb95288db3942b0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:16:35.940683 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-5aa23e54-3014-4a0f-badf-c9cd1a8608ca tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] 10.222.0.58 "GET /compute/v2.1/servers/3ecbcf63-5592-4074-a3f7-d2caf3c58969" status: 200 len: 1372 microversion: 2.1 time: 0.431339 Aug 10 23:16:35.941360 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2171/4173] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:16:35 2022] GET /compute/v2.1/servers/3ecbcf63-5592-4074-a3f7-d2caf3c58969 => generated 1372 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:16:36.526485 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-55bd71a2-e5e5-4c05-ab06-0869d812d9ab tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:16:36.527348 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-55bd71a2-e5e5-4c05-ab06-0869d812d9ab tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:16:36.554177 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-55bd71a2-e5e5-4c05-ab06-0869d812d9ab tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:36.555955 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-55bd71a2-e5e5-4c05-ab06-0869d812d9ab tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:36.556413 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-55bd71a2-e5e5-4c05-ab06-0869d812d9ab tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:36.560208 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-55bd71a2-e5e5-4c05-ab06-0869d812d9ab tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:36.560701 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-55bd71a2-e5e5-4c05-ab06-0869d812d9ab tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:36.567730 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-55bd71a2-e5e5-4c05-ab06-0869d812d9ab tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:36.627571 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-f75aeee2-1230-4c96-8335-f4a399a3d08c tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5899b2ad9f1046caaf7c6073e408eeee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25abd63376614081a9d484f3c9ae950d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:16:36.650094 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-f75aeee2-1230-4c96-8335-f4a399a3d08c tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "GET /compute/v2.1/servers/250395b5-5be8-420a-8709-dcf8b4241a4e" status: 200 len: 1691 microversion: 2.1 time: 1.409165 Aug 10 23:16:36.664226 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2003/4174] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:16:35 2022] GET /compute/v2.1/servers/250395b5-5be8-420a-8709-dcf8b4241a4e => generated 1691 bytes in 1424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:16:36.971065 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-a52d98f5-902f-4a33-afd3-1b71b6e52f20 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:16:36.971700 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-a52d98f5-902f-4a33-afd3-1b71b6e52f20 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] [instance: 3ecbcf63-5592-4074-a3f7-d2caf3c58969] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:16:36.995677 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a52d98f5-902f-4a33-afd3-1b71b6e52f20 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:36.996194 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a52d98f5-902f-4a33-afd3-1b71b6e52f20 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:36.996644 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a52d98f5-902f-4a33-afd3-1b71b6e52f20 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:36.999674 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a52d98f5-902f-4a33-afd3-1b71b6e52f20 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:37.001422 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a52d98f5-902f-4a33-afd3-1b71b6e52f20 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:37.001930 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a52d98f5-902f-4a33-afd3-1b71b6e52f20 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:37.483678 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-a52d98f5-902f-4a33-afd3-1b71b6e52f20 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07c94ebf0954cdea12b9a689538d96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395d7c4077e54c43bb95288db3942b0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:16:37.497772 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-a52d98f5-902f-4a33-afd3-1b71b6e52f20 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] 10.222.0.58 "GET /compute/v2.1/servers/3ecbcf63-5592-4074-a3f7-d2caf3c58969" status: 200 len: 1566 microversion: 2.1 time: 0.534005 Aug 10 23:16:37.498364 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2004/4175] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:16:36 2022] GET /compute/v2.1/servers/3ecbcf63-5592-4074-a3f7-d2caf3c58969 => generated 1566 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:16:37.522028 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-9bc9e7e4-d7c5-433d-9ef9-80589759a7cb tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:16:37.524375 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-9bc9e7e4-d7c5-433d-9ef9-80589759a7cb tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] [instance: 3ecbcf63-5592-4074-a3f7-d2caf3c58969] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:16:37.534277 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9bc9e7e4-d7c5-433d-9ef9-80589759a7cb tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:37.534772 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9bc9e7e4-d7c5-433d-9ef9-80589759a7cb tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:37.535416 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9bc9e7e4-d7c5-433d-9ef9-80589759a7cb tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:37.536299 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9bc9e7e4-d7c5-433d-9ef9-80589759a7cb tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:37.536984 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9bc9e7e4-d7c5-433d-9ef9-80589759a7cb tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:37.537690 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9bc9e7e4-d7c5-433d-9ef9-80589759a7cb tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:37.644830 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-55bd71a2-e5e5-4c05-ab06-0869d812d9ab tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:16:37.659030 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-9bc9e7e4-d7c5-433d-9ef9-80589759a7cb tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] 10.222.0.58 "GET /compute/v2.1/servers/3ecbcf63-5592-4074-a3f7-d2caf3c58969/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.140961 Aug 10 23:16:37.659650 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2005/4176] 10.222.0.58 () {58 vars in 1275 bytes} [Wed Aug 10 23:16:37 2022] GET /compute/v2.1/servers/3ecbcf63-5592-4074-a3f7-d2caf3c58969/os-interface => generated 285 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:16:37.664865 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-55bd71a2-e5e5-4c05-ab06-0869d812d9ab tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b" status: 200 len: 1519 microversion: 2.1 time: 1.144737 Aug 10 23:16:37.675058 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2172/4177] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:16:36 2022] GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b => generated 1519 bytes in 1156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:16:37.678211 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-f27db02c-276c-4344-8cad-74889954f64e tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:16:37.678870 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-f27db02c-276c-4344-8cad-74889954f64e tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] [instance: 250395b5-5be8-420a-8709-dcf8b4241a4e] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:16:37.689830 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f27db02c-276c-4344-8cad-74889954f64e tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:37.690335 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f27db02c-276c-4344-8cad-74889954f64e tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:37.690810 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f27db02c-276c-4344-8cad-74889954f64e tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:37.699864 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f27db02c-276c-4344-8cad-74889954f64e tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:37.700355 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f27db02c-276c-4344-8cad-74889954f64e tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:37.700918 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f27db02c-276c-4344-8cad-74889954f64e tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:37.977704 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-e91eb881-5520-43ad-98d9-0eb2aea86e1f req-06b11d10-88e6-4e10-a38c-258bf7f8dd18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23bbe055-4a92-4b96-8b89-c941229bfb0b", "name": "network-vif-plugged", "status": "completed", "tag": "6f537f41-6630-4a1c-b82e-c0862b0fc22c"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:16:38.044162 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-e91eb881-5520-43ad-98d9-0eb2aea86e1f req-06b11d10-88e6-4e10-a38c-258bf7f8dd18 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:38.049589 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-e91eb881-5520-43ad-98d9-0eb2aea86e1f req-06b11d10-88e6-4e10-a38c-258bf7f8dd18 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:38.050610 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-e91eb881-5520-43ad-98d9-0eb2aea86e1f req-06b11d10-88e6-4e10-a38c-258bf7f8dd18 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:38.069096 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-e91eb881-5520-43ad-98d9-0eb2aea86e1f req-06b11d10-88e6-4e10-a38c-258bf7f8dd18 service nova] Creating event network-vif-plugged:6f537f41-6630-4a1c-b82e-c0862b0fc22c for instance 23bbe055-4a92-4b96-8b89-c941229bfb0b on n-h2-850468-14 Aug 10 23:16:38.075788 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-e91eb881-5520-43ad-98d9-0eb2aea86e1f req-06b11d10-88e6-4e10-a38c-258bf7f8dd18 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114281 Aug 10 23:16:38.085543 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2173/4178] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:16:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:16:38.101046 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-f27db02c-276c-4344-8cad-74889954f64e tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5899b2ad9f1046caaf7c6073e408eeee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25abd63376614081a9d484f3c9ae950d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:16:38.114436 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-f27db02c-276c-4344-8cad-74889954f64e tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "GET /compute/v2.1/servers/250395b5-5be8-420a-8709-dcf8b4241a4e" status: 200 len: 1691 microversion: 2.1 time: 0.439091 Aug 10 23:16:38.115647 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2006/4179] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:16:37 2022] GET /compute/v2.1/servers/250395b5-5be8-420a-8709-dcf8b4241a4e => generated 1691 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:16:38.697606 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-7b4228a0-0f08-47ec-aa82-2d3144ae9893 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:16:38.698570 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-7b4228a0-0f08-47ec-aa82-2d3144ae9893 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:16:38.713530 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7b4228a0-0f08-47ec-aa82-2d3144ae9893 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:38.714199 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7b4228a0-0f08-47ec-aa82-2d3144ae9893 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:38.717304 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7b4228a0-0f08-47ec-aa82-2d3144ae9893 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:38.718128 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7b4228a0-0f08-47ec-aa82-2d3144ae9893 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:38.718584 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7b4228a0-0f08-47ec-aa82-2d3144ae9893 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:38.719245 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7b4228a0-0f08-47ec-aa82-2d3144ae9893 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:38.779643 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=100 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:16:39.136973 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-1e2c5248-f9f4-4663-9dfd-4c6787ec6444 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:16:39.138440 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-1e2c5248-f9f4-4663-9dfd-4c6787ec6444 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] [instance: 250395b5-5be8-420a-8709-dcf8b4241a4e] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:16:39.150554 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1e2c5248-f9f4-4663-9dfd-4c6787ec6444 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:39.154702 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1e2c5248-f9f4-4663-9dfd-4c6787ec6444 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:39.158776 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1e2c5248-f9f4-4663-9dfd-4c6787ec6444 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:39.185054 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1e2c5248-f9f4-4663-9dfd-4c6787ec6444 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:39.185691 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1e2c5248-f9f4-4663-9dfd-4c6787ec6444 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:39.191500 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1e2c5248-f9f4-4663-9dfd-4c6787ec6444 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:39.774368 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-1e2c5248-f9f4-4663-9dfd-4c6787ec6444 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5899b2ad9f1046caaf7c6073e408eeee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25abd63376614081a9d484f3c9ae950d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:16:39.787794 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-1e2c5248-f9f4-4663-9dfd-4c6787ec6444 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "GET /compute/v2.1/servers/250395b5-5be8-420a-8709-dcf8b4241a4e" status: 200 len: 1691 microversion: 2.1 time: 0.654938 Aug 10 23:16:39.789175 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2007/4180] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:16:39 2022] GET /compute/v2.1/servers/250395b5-5be8-420a-8709-dcf8b4241a4e => generated 1691 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:16:40.182417 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-7b4228a0-0f08-47ec-aa82-2d3144ae9893 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:16:40.196656 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-7b4228a0-0f08-47ec-aa82-2d3144ae9893 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b" status: 200 len: 1519 microversion: 2.1 time: 1.503657 Aug 10 23:16:40.199494 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2174/4181] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:16:38 2022] GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b => generated 1519 bytes in 1508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:16:40.822700 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-e46bc1bc-0102-4bb4-8d0d-09b535b5461d tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:16:40.826696 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-e46bc1bc-0102-4bb4-8d0d-09b535b5461d tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] [instance: 250395b5-5be8-420a-8709-dcf8b4241a4e] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:16:40.860831 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e46bc1bc-0102-4bb4-8d0d-09b535b5461d tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:40.861248 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e46bc1bc-0102-4bb4-8d0d-09b535b5461d tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:40.861693 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e46bc1bc-0102-4bb4-8d0d-09b535b5461d tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:40.862411 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e46bc1bc-0102-4bb4-8d0d-09b535b5461d tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:40.862891 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e46bc1bc-0102-4bb4-8d0d-09b535b5461d tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:40.863316 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e46bc1bc-0102-4bb4-8d0d-09b535b5461d tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:41.136118 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-e46bc1bc-0102-4bb4-8d0d-09b535b5461d tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5899b2ad9f1046caaf7c6073e408eeee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25abd63376614081a9d484f3c9ae950d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:16:41.148145 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-e46bc1bc-0102-4bb4-8d0d-09b535b5461d tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "GET /compute/v2.1/servers/250395b5-5be8-420a-8709-dcf8b4241a4e" status: 200 len: 1696 microversion: 2.1 time: 0.341681 Aug 10 23:16:41.155404 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2008/4182] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:16:40 2022] GET /compute/v2.1/servers/250395b5-5be8-420a-8709-dcf8b4241a4e => generated 1696 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:16:41.223718 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-299e0f83-1f57-42be-9361-8f24a27aa1d9 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:16:41.225091 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-299e0f83-1f57-42be-9361-8f24a27aa1d9 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:16:41.240874 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-299e0f83-1f57-42be-9361-8f24a27aa1d9 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:41.241471 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-299e0f83-1f57-42be-9361-8f24a27aa1d9 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:41.242013 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-299e0f83-1f57-42be-9361-8f24a27aa1d9 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:41.276885 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-299e0f83-1f57-42be-9361-8f24a27aa1d9 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:41.277632 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-299e0f83-1f57-42be-9361-8f24a27aa1d9 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.034s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:41.278181 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-299e0f83-1f57-42be-9361-8f24a27aa1d9 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:42.178098 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-cb65099b-1f18-4fde-ade0-6c5ab416580c tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:16:42.178873 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-cb65099b-1f18-4fde-ade0-6c5ab416580c tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] [instance: 250395b5-5be8-420a-8709-dcf8b4241a4e] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:16:42.190876 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-299e0f83-1f57-42be-9361-8f24a27aa1d9 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:16:42.199042 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-299e0f83-1f57-42be-9361-8f24a27aa1d9 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b" status: 200 len: 1519 microversion: 2.1 time: 0.980892 Aug 10 23:16:42.203954 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2175/4183] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:16:41 2022] GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b => generated 1519 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:16:42.221672 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cb65099b-1f18-4fde-ade0-6c5ab416580c tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:42.222260 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cb65099b-1f18-4fde-ade0-6c5ab416580c tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:42.228836 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cb65099b-1f18-4fde-ade0-6c5ab416580c tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:42.230599 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cb65099b-1f18-4fde-ade0-6c5ab416580c tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:42.234880 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cb65099b-1f18-4fde-ade0-6c5ab416580c tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:42.237342 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cb65099b-1f18-4fde-ade0-6c5ab416580c tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:42.680423 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-4892a7e8-8838-46bc-90e0-7084d4d3bf40 req-1d9d4ec4-dc0f-4c36-8af6-d285521a00a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ecbcf63-5592-4074-a3f7-d2caf3c58969", "tag": "4640966a-83e6-4989-a8a2-bbd72226c336"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:16:42.700377 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-4892a7e8-8838-46bc-90e0-7084d4d3bf40 req-1d9d4ec4-dc0f-4c36-8af6-d285521a00a9 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:42.705270 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-4892a7e8-8838-46bc-90e0-7084d4d3bf40 req-1d9d4ec4-dc0f-4c36-8af6-d285521a00a9 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:42.706044 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-4892a7e8-8838-46bc-90e0-7084d4d3bf40 req-1d9d4ec4-dc0f-4c36-8af6-d285521a00a9 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:42.753864 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-4892a7e8-8838-46bc-90e0-7084d4d3bf40 req-1d9d4ec4-dc0f-4c36-8af6-d285521a00a9 service nova] Creating event network-changed:4640966a-83e6-4989-a8a2-bbd72226c336 for instance 3ecbcf63-5592-4074-a3f7-d2caf3c58969 on n-h1-850468-14 Aug 10 23:16:42.762504 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-4892a7e8-8838-46bc-90e0-7084d4d3bf40 req-1d9d4ec4-dc0f-4c36-8af6-d285521a00a9 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082676 Aug 10 23:16:42.763649 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2176/4184] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:16:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:16:42.921296 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-cb65099b-1f18-4fde-ade0-6c5ab416580c tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5899b2ad9f1046caaf7c6073e408eeee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25abd63376614081a9d484f3c9ae950d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:16:42.933256 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-cb65099b-1f18-4fde-ade0-6c5ab416580c tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "GET /compute/v2.1/servers/250395b5-5be8-420a-8709-dcf8b4241a4e" status: 200 len: 1696 microversion: 2.1 time: 0.762341 Aug 10 23:16:42.933844 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2009/4185] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:16:42 2022] GET /compute/v2.1/servers/250395b5-5be8-420a-8709-dcf8b4241a4e => generated 1696 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:16:43.225408 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-ed9c0e36-7994-4801-ad5f-e16cad1cb5b9 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:16:43.226400 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-ed9c0e36-7994-4801-ad5f-e16cad1cb5b9 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:16:43.236442 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ed9c0e36-7994-4801-ad5f-e16cad1cb5b9 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:43.237217 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ed9c0e36-7994-4801-ad5f-e16cad1cb5b9 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:43.238041 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ed9c0e36-7994-4801-ad5f-e16cad1cb5b9 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:43.239002 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ed9c0e36-7994-4801-ad5f-e16cad1cb5b9 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:43.239637 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ed9c0e36-7994-4801-ad5f-e16cad1cb5b9 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:43.246418 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ed9c0e36-7994-4801-ad5f-e16cad1cb5b9 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:43.960565 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-a6d55c54-6e99-4e79-8238-5d7ae6705154 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:16:43.962568 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-a6d55c54-6e99-4e79-8238-5d7ae6705154 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] [instance: 250395b5-5be8-420a-8709-dcf8b4241a4e] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:16:43.980713 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a6d55c54-6e99-4e79-8238-5d7ae6705154 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:43.982287 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a6d55c54-6e99-4e79-8238-5d7ae6705154 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:43.985611 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a6d55c54-6e99-4e79-8238-5d7ae6705154 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:43.988428 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a6d55c54-6e99-4e79-8238-5d7ae6705154 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:43.989816 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a6d55c54-6e99-4e79-8238-5d7ae6705154 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:43.991150 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a6d55c54-6e99-4e79-8238-5d7ae6705154 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:44.297987 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-ed9c0e36-7994-4801-ad5f-e16cad1cb5b9 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:16:44.327270 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-ed9c0e36-7994-4801-ad5f-e16cad1cb5b9 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b" status: 200 len: 1506 microversion: 2.1 time: 1.105659 Aug 10 23:16:44.342880 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2177/4186] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:16:43 2022] GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b => generated 1506 bytes in 1120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:16:44.352782 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-b1c5e78e-a1eb-4799-b878-2c128e8cda4e tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:16:44.353527 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-b1c5e78e-a1eb-4799-b878-2c128e8cda4e tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:16:44.417215 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b1c5e78e-a1eb-4799-b878-2c128e8cda4e tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:44.417910 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b1c5e78e-a1eb-4799-b878-2c128e8cda4e tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.028s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:44.418358 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b1c5e78e-a1eb-4799-b878-2c128e8cda4e tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:44.428077 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b1c5e78e-a1eb-4799-b878-2c128e8cda4e tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:44.428618 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b1c5e78e-a1eb-4799-b878-2c128e8cda4e tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:44.429062 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b1c5e78e-a1eb-4799-b878-2c128e8cda4e tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:44.708239 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-a6d55c54-6e99-4e79-8238-5d7ae6705154 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5899b2ad9f1046caaf7c6073e408eeee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25abd63376614081a9d484f3c9ae950d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:16:44.723246 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-a6d55c54-6e99-4e79-8238-5d7ae6705154 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "GET /compute/v2.1/servers/250395b5-5be8-420a-8709-dcf8b4241a4e" status: 200 len: 1696 microversion: 2.1 time: 0.768483 Aug 10 23:16:44.724415 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2010/4187] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:16:43 2022] GET /compute/v2.1/servers/250395b5-5be8-420a-8709-dcf8b4241a4e => generated 1696 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:16:45.071784 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-b1c5e78e-a1eb-4799-b878-2c128e8cda4e tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:16:45.089271 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-b1c5e78e-a1eb-4799-b878-2c128e8cda4e tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b" status: 200 len: 1506 microversion: 2.1 time: 0.739486 Aug 10 23:16:45.105425 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2178/4188] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:16:44 2022] GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b => generated 1506 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:16:45.123241 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c7b3fba2-2d11-48ff-8927-cd87992ebe6b tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:16:45.123855 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-c7b3fba2-2d11-48ff-8927-cd87992ebe6b tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:16:45.136269 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c7b3fba2-2d11-48ff-8927-cd87992ebe6b tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:45.136750 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c7b3fba2-2d11-48ff-8927-cd87992ebe6b tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:45.137188 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c7b3fba2-2d11-48ff-8927-cd87992ebe6b tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:45.137892 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c7b3fba2-2d11-48ff-8927-cd87992ebe6b tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:45.138352 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c7b3fba2-2d11-48ff-8927-cd87992ebe6b tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:45.138762 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c7b3fba2-2d11-48ff-8927-cd87992ebe6b tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:45.144030 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:16:45.749015 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-90488d35-0b0a-4a15-986f-cb2419539b90 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:16:45.750729 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-90488d35-0b0a-4a15-986f-cb2419539b90 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] [instance: 250395b5-5be8-420a-8709-dcf8b4241a4e] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:16:45.767743 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-90488d35-0b0a-4a15-986f-cb2419539b90 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:45.768786 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-90488d35-0b0a-4a15-986f-cb2419539b90 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:45.769392 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-90488d35-0b0a-4a15-986f-cb2419539b90 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:45.770290 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-90488d35-0b0a-4a15-986f-cb2419539b90 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:45.770967 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-90488d35-0b0a-4a15-986f-cb2419539b90 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:45.771896 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-90488d35-0b0a-4a15-986f-cb2419539b90 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:46.096303 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-c7b3fba2-2d11-48ff-8927-cd87992ebe6b tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:16:46.110001 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-c7b3fba2-2d11-48ff-8927-cd87992ebe6b tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b" status: 200 len: 1506 microversion: 2.1 time: 0.990572 Aug 10 23:16:46.111540 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2011/4189] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:16:45 2022] GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b => generated 1506 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:16:46.139348 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-9638b05b-ecae-490d-8d2c-a506cc5978e5 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:16:46.159101 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-9638b05b-ecae-490d-8d2c-a506cc5978e5 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] HTTP exception thrown: Instance d48ea82d-56a5-40a7-b80b-6eaefae5a850 has no mapping to a cell. Aug 10 23:16:46.175977 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-9638b05b-ecae-490d-8d2c-a506cc5978e5 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Request method failure captured: Aug 10 23:16:46.175977 n-d-850468-14 devstack@n-api.service[122632]: request: POST /compute/v2.1/servers/d48ea82d-56a5-40a7-b80b-6eaefae5a850/action HTTP/1.1 Aug 10 23:16:46.175977 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:16:46.175977 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:16:46.175977 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:16:46.175977 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 15 Aug 10 23:16:46.175977 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:16:46.175977 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:16:46.175977 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:16:46.175977 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:16:46.175977 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9DuIKrfOsS8tKST0PsIPrvuNPfsVISfOPvUoe9ddkVcTJKj7rDjd3OuH9u-DTT1aypj1AUoUKtajD98eDOUOHSpPisBSdRlSCov30lHf1uZq-XZLyBIVg5kAG8-SuXk2s1TL7EnRcjjMARSkm95dZDnXaBXRT3M4f8UoMDwqu7xK7gQ Aug 10 23:16:46.175977 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:16:46.175977 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:16:46.175977 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:16:46.175977 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:16:46.175977 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:16:46.175977 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:16:46.175977 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: d11bbb3e87f4463787da56ab19108822 Aug 10 23:16:46.175977 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-ServersNegativeTestJSON-1216728002 Aug 10 23:16:46.175977 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:16:46.175977 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:16:46.175977 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d11bbb3e87f4463787da56ab19108822"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d11bbb3e87f4463787da56ab19108822"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d11bbb3e87f4463787da56ab19108822"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d11bbb3e87f4463787da56ab19108822", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:16:46.175977 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-ServersNegativeTestJSON-1216728002 Aug 10 23:16:46.175977 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: d11bbb3e87f4463787da56ab19108822 Aug 10 23:16:46.175977 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1216728002 Aug 10 23:16:46.175977 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-ServersNegativeTestJSON-1216728002-project Aug 10 23:16:46.175977 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:16:46.175977 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:16:46.175977 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: f284ec2a4bf546b58c1c1adaf880e1fb Aug 10 23:16:46.175977 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-ServersNegativeTestJSON-1216728002-project Aug 10 23:16:46.175977 n-d-850468-14 devstack@n-api.service[122632]: Aug 10 23:16:46.175977 n-d-850468-14 devstack@n-api.service[122632]: {"os-stop": {}} Aug 10 23:16:46.175977 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:16:46.175977 n-d-850468-14 devstack@n-api.service[122632]: exception: Instance d48ea82d-56a5-40a7-b80b-6eaefae5a850 has no mapping to a cell. Aug 10 23:16:46.175977 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': 'd48ea82d-56a5-40a7-b80b-6eaefae5a850', 'body': {'os-stop': {}}} Aug 10 23:16:46.175977 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:16:46.175977 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:16:46.175977 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1408, in _get_instance Aug 10 23:16:46.175977 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( Aug 10 23:16:46.175977 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 10 23:16:46.175977 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 10 23:16:46.175977 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid Aug 10 23:16:46.175977 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) Aug 10 23:16:46.175977 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 10 23:16:46.175977 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 10 23:16:46.175977 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db Aug 10 23:16:46.175977 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) Aug 10 23:16:46.175977 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance d48ea82d-56a5-40a7-b80b-6eaefae5a850 has no mapping to a cell. Aug 10 23:16:46.175977 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:16:46.175977 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:16:46.175977 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:16:46.175977 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:16:46.175977 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:16:46.175977 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:16:46.175977 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:16:46.175977 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:16:46.175977 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:16:46.175977 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:16:46.175977 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1441, in _stop_server Aug 10 23:16:46.175977 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) Aug 10 23:16:46.175977 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1415, in _get_instance Aug 10 23:16:46.175977 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:16:46.175977 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d48ea82d-56a5-40a7-b80b-6eaefae5a850 has no mapping to a cell. Aug 10 23:16:46.181143 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:16:46.181143 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:16:46.181143 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:16:46.181143 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:16:46.181143 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:16:46.181143 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:16:46.181143 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:16:46.181143 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:16:46.181143 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d48ea82d-56a5-40a7-b80b-6eaefae5a850 has no mapping to a cell. Aug 10 23:16:46.181143 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:16:46.183857 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-9638b05b-ecae-490d-8d2c-a506cc5978e5 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Returning 404 to user: Instance d48ea82d-56a5-40a7-b80b-6eaefae5a850 has no mapping to a cell. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:16:46.185049 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-9638b05b-ecae-490d-8d2c-a506cc5978e5 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "POST /compute/v2.1/servers/d48ea82d-56a5-40a7-b80b-6eaefae5a850/action" status: 404 len: 117 microversion: 2.1 time: 0.057227 Aug 10 23:16:46.185808 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2012/4190] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:16:46 2022] POST /compute/v2.1/servers/d48ea82d-56a5-40a7-b80b-6eaefae5a850/action => generated 117 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:16:46.194658 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-bcb49033-9ecb-4106-9660-c9c5f2d8e750 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:16:46.197434 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-bcb49033-9ecb-4106-9660-c9c5f2d8e750 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:16:46.211826 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bcb49033-9ecb-4106-9660-c9c5f2d8e750 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:46.212580 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bcb49033-9ecb-4106-9660-c9c5f2d8e750 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:46.214889 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bcb49033-9ecb-4106-9660-c9c5f2d8e750 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:46.216018 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bcb49033-9ecb-4106-9660-c9c5f2d8e750 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:46.216655 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bcb49033-9ecb-4106-9660-c9c5f2d8e750 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:46.217249 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bcb49033-9ecb-4106-9660-c9c5f2d8e750 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:46.471821 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-90488d35-0b0a-4a15-986f-cb2419539b90 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5899b2ad9f1046caaf7c6073e408eeee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25abd63376614081a9d484f3c9ae950d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:16:46.483860 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-90488d35-0b0a-4a15-986f-cb2419539b90 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "GET /compute/v2.1/servers/250395b5-5be8-420a-8709-dcf8b4241a4e" status: 200 len: 1696 microversion: 2.1 time: 0.738820 Aug 10 23:16:46.484566 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2179/4191] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:16:45 2022] GET /compute/v2.1/servers/250395b5-5be8-420a-8709-dcf8b4241a4e => generated 1696 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:16:47.004580 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-bcb49033-9ecb-4106-9660-c9c5f2d8e750 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:16:47.017383 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-bcb49033-9ecb-4106-9660-c9c5f2d8e750 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b" status: 200 len: 1506 microversion: 2.1 time: 0.826684 Aug 10 23:16:47.022067 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2013/4192] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:16:46 2022] GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b => generated 1506 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:16:47.049121 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-516700b2-9e8c-461d-a45d-d6882be0c1e6 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:16:47.050472 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-516700b2-9e8c-461d-a45d-d6882be0c1e6 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:16:47.069183 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-516700b2-9e8c-461d-a45d-d6882be0c1e6 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:47.070737 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-516700b2-9e8c-461d-a45d-d6882be0c1e6 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:47.071700 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-516700b2-9e8c-461d-a45d-d6882be0c1e6 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:47.073298 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-516700b2-9e8c-461d-a45d-d6882be0c1e6 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:47.075168 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-516700b2-9e8c-461d-a45d-d6882be0c1e6 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:47.076522 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-516700b2-9e8c-461d-a45d-d6882be0c1e6 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:47.508766 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-f0bb49d8-11c3-4b0a-862e-579ae90cdc62 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:16:47.510162 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-f0bb49d8-11c3-4b0a-862e-579ae90cdc62 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] [instance: 250395b5-5be8-420a-8709-dcf8b4241a4e] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:16:47.527823 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f0bb49d8-11c3-4b0a-862e-579ae90cdc62 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:47.528469 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f0bb49d8-11c3-4b0a-862e-579ae90cdc62 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:47.530243 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f0bb49d8-11c3-4b0a-862e-579ae90cdc62 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:47.531661 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f0bb49d8-11c3-4b0a-862e-579ae90cdc62 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:47.534813 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f0bb49d8-11c3-4b0a-862e-579ae90cdc62 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:47.535405 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f0bb49d8-11c3-4b0a-862e-579ae90cdc62 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:47.915886 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-f0bb49d8-11c3-4b0a-862e-579ae90cdc62 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5899b2ad9f1046caaf7c6073e408eeee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25abd63376614081a9d484f3c9ae950d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:16:47.932101 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-f0bb49d8-11c3-4b0a-862e-579ae90cdc62 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "GET /compute/v2.1/servers/250395b5-5be8-420a-8709-dcf8b4241a4e" status: 200 len: 1696 microversion: 2.1 time: 0.429456 Aug 10 23:16:47.933332 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2014/4193] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:16:47 2022] GET /compute/v2.1/servers/250395b5-5be8-420a-8709-dcf8b4241a4e => generated 1696 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:16:48.074645 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-516700b2-9e8c-461d-a45d-d6882be0c1e6 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:16:48.085711 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-516700b2-9e8c-461d-a45d-d6882be0c1e6 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b" status: 200 len: 1506 microversion: 2.1 time: 1.041756 Aug 10 23:16:48.095962 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2180/4194] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:16:47 2022] GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b => generated 1506 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:16:48.111299 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-2b97889e-f1db-44d2-ad2f-b482d4601865 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:16:48.112093 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-2b97889e-f1db-44d2-ad2f-b482d4601865 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 13a509d6-bf4f-497d-ba6a-fb33033f2d48] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:16:48.121501 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-2b97889e-f1db-44d2-ad2f-b482d4601865 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] HTTP exception thrown: Instance 13a509d6-bf4f-497d-ba6a-fb33033f2d48 could not be found. Aug 10 23:16:48.123826 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-2b97889e-f1db-44d2-ad2f-b482d4601865 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Request method failure captured: Aug 10 23:16:48.123826 n-d-850468-14 devstack@n-api.service[122632]: request: POST /compute/v2.1/servers/13a509d6-bf4f-497d-ba6a-fb33033f2d48/action HTTP/1.1 Aug 10 23:16:48.123826 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:16:48.123826 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:16:48.123826 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:16:48.123826 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 15 Aug 10 23:16:48.123826 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:16:48.123826 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:16:48.123826 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:16:48.123826 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:16:48.123826 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9DuIKrfOsS8tKST0PsIPrvuNPfsVISfOPvUoe9ddkVcTJKj7rDjd3OuH9u-DTT1aypj1AUoUKtajD98eDOUOHSpPisBSdRlSCov30lHf1uZq-XZLyBIVg5kAG8-SuXk2s1TL7EnRcjjMARSkm95dZDnXaBXRT3M4f8UoMDwqu7xK7gQ Aug 10 23:16:48.123826 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:16:48.123826 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:16:48.123826 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:16:48.123826 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:16:48.123826 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:16:48.123826 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:16:48.123826 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: d11bbb3e87f4463787da56ab19108822 Aug 10 23:16:48.123826 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-ServersNegativeTestJSON-1216728002 Aug 10 23:16:48.123826 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:16:48.123826 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:16:48.123826 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d11bbb3e87f4463787da56ab19108822"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d11bbb3e87f4463787da56ab19108822"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d11bbb3e87f4463787da56ab19108822"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d11bbb3e87f4463787da56ab19108822", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:16:48.123826 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-ServersNegativeTestJSON-1216728002 Aug 10 23:16:48.123826 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: d11bbb3e87f4463787da56ab19108822 Aug 10 23:16:48.123826 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1216728002 Aug 10 23:16:48.123826 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-ServersNegativeTestJSON-1216728002-project Aug 10 23:16:48.123826 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:16:48.123826 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:16:48.123826 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: f284ec2a4bf546b58c1c1adaf880e1fb Aug 10 23:16:48.123826 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-ServersNegativeTestJSON-1216728002-project Aug 10 23:16:48.123826 n-d-850468-14 devstack@n-api.service[122632]: Aug 10 23:16:48.123826 n-d-850468-14 devstack@n-api.service[122632]: {"suspend": {}} Aug 10 23:16:48.123826 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:16:48.123826 n-d-850468-14 devstack@n-api.service[122632]: exception: Instance 13a509d6-bf4f-497d-ba6a-fb33033f2d48 could not be found. Aug 10 23:16:48.123826 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': '13a509d6-bf4f-497d-ba6a-fb33033f2d48', 'body': {'suspend': {}}} Aug 10 23:16:48.123826 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:16:48.123826 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:16:48.123826 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:16:48.123826 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:16:48.123826 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:16:48.123826 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:16:48.123826 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 10 23:16:48.123826 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 10 23:16:48.123826 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13a509d6-bf4f-497d-ba6a-fb33033f2d48 could not be found. Aug 10 23:16:48.123826 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:16:48.123826 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:16:48.123826 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:16:48.123826 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:16:48.123826 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:16:48.123826 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:16:48.123826 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:16:48.123826 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:16:48.123826 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:16:48.123826 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:16:48.123826 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend Aug 10 23:16:48.123826 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Aug 10 23:16:48.123826 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:16:48.123826 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:16:48.123826 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13a509d6-bf4f-497d-ba6a-fb33033f2d48 could not be found. Aug 10 23:16:48.123826 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:16:48.123826 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:16:48.123826 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:16:48.123826 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:16:48.123826 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:16:48.123826 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:16:48.130244 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:16:48.130244 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:16:48.130244 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13a509d6-bf4f-497d-ba6a-fb33033f2d48 could not be found. Aug 10 23:16:48.130244 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:16:48.135278 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-2b97889e-f1db-44d2-ad2f-b482d4601865 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Returning 404 to user: Instance 13a509d6-bf4f-497d-ba6a-fb33033f2d48 could not be found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:16:48.140371 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-2b97889e-f1db-44d2-ad2f-b482d4601865 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "POST /compute/v2.1/servers/13a509d6-bf4f-497d-ba6a-fb33033f2d48/action" status: 404 len: 111 microversion: 2.1 time: 0.033944 Aug 10 23:16:48.144623 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2015/4195] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:16:48 2022] POST /compute/v2.1/servers/13a509d6-bf4f-497d-ba6a-fb33033f2d48/action => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:16:48.160748 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-f1a3dfaf-aad3-4f98-a89b-c501bfa89813 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:16:48.161715 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-f1a3dfaf-aad3-4f98-a89b-c501bfa89813 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:16:48.171880 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f1a3dfaf-aad3-4f98-a89b-c501bfa89813 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:48.172866 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f1a3dfaf-aad3-4f98-a89b-c501bfa89813 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:48.173398 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f1a3dfaf-aad3-4f98-a89b-c501bfa89813 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:48.174207 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f1a3dfaf-aad3-4f98-a89b-c501bfa89813 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:48.174675 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f1a3dfaf-aad3-4f98-a89b-c501bfa89813 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:48.175641 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f1a3dfaf-aad3-4f98-a89b-c501bfa89813 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:48.771033 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-f1a3dfaf-aad3-4f98-a89b-c501bfa89813 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:16:48.779029 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-f1a3dfaf-aad3-4f98-a89b-c501bfa89813 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b" status: 200 len: 1506 microversion: 2.1 time: 0.631040 Aug 10 23:16:48.791921 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2181/4196] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:16:48 2022] GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b => generated 1506 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:16:48.814104 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-32fe6225-5d4e-4c54-8655-44d04977e99d tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:16:48.814722 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-32fe6225-5d4e-4c54-8655-44d04977e99d tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:16:48.834958 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-32fe6225-5d4e-4c54-8655-44d04977e99d tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:48.835529 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-32fe6225-5d4e-4c54-8655-44d04977e99d tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:48.835867 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-32fe6225-5d4e-4c54-8655-44d04977e99d tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:48.842434 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-32fe6225-5d4e-4c54-8655-44d04977e99d tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:48.842434 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-32fe6225-5d4e-4c54-8655-44d04977e99d tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:48.842434 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-32fe6225-5d4e-4c54-8655-44d04977e99d tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:48.953477 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-9284eb49-077b-4bc1-a988-21cbf6d0ce2f tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:16:48.954456 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-9284eb49-077b-4bc1-a988-21cbf6d0ce2f tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] [instance: 250395b5-5be8-420a-8709-dcf8b4241a4e] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:16:48.961862 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9284eb49-077b-4bc1-a988-21cbf6d0ce2f tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:48.962350 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9284eb49-077b-4bc1-a988-21cbf6d0ce2f tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:48.962799 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9284eb49-077b-4bc1-a988-21cbf6d0ce2f tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:48.963500 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9284eb49-077b-4bc1-a988-21cbf6d0ce2f tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:48.963971 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9284eb49-077b-4bc1-a988-21cbf6d0ce2f tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:48.964390 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9284eb49-077b-4bc1-a988-21cbf6d0ce2f tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:49.050635 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-32fe6225-5d4e-4c54-8655-44d04977e99d tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:16:49.060469 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-32fe6225-5d4e-4c54-8655-44d04977e99d tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b" status: 200 len: 1506 microversion: 2.1 time: 0.249416 Aug 10 23:16:49.064173 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2016/4197] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:16:48 2022] GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b => generated 1506 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:16:49.089950 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-6e8d9d78-33f2-41c0-972a-52b3b7f6240b tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:16:49.091884 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-6e8d9d78-33f2-41c0-972a-52b3b7f6240b tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:16:49.106808 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6e8d9d78-33f2-41c0-972a-52b3b7f6240b tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:49.107517 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6e8d9d78-33f2-41c0-972a-52b3b7f6240b tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:49.108408 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6e8d9d78-33f2-41c0-972a-52b3b7f6240b tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:49.111097 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6e8d9d78-33f2-41c0-972a-52b3b7f6240b tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:49.114234 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6e8d9d78-33f2-41c0-972a-52b3b7f6240b tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:49.114692 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6e8d9d78-33f2-41c0-972a-52b3b7f6240b tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:49.202511 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.objects.instance [None req-6e8d9d78-33f2-41c0-972a-52b3b7f6240b tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lazy-loading 'flavor' on Instance uuid 23bbe055-4a92-4b96-8b89-c941229bfb0b {{(pid=122632) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:16:49.317247 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-6e8d9d78-33f2-41c0-972a-52b3b7f6240b tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "POST /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b/action" status: 202 len: 0 microversion: 2.1 time: 0.235389 Aug 10 23:16:49.319536 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2017/4198] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:16:49 2022] POST /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b/action => generated 0 bytes in 240 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:16:49.336423 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-29a9d898-8fd4-46a6-b133-d8ecfb761b40 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:16:49.338530 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-29a9d898-8fd4-46a6-b133-d8ecfb761b40 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:16:49.361953 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-29a9d898-8fd4-46a6-b133-d8ecfb761b40 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:49.362657 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-29a9d898-8fd4-46a6-b133-d8ecfb761b40 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:49.363394 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-29a9d898-8fd4-46a6-b133-d8ecfb761b40 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:49.364530 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-29a9d898-8fd4-46a6-b133-d8ecfb761b40 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:49.366093 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-29a9d898-8fd4-46a6-b133-d8ecfb761b40 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:49.366812 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-29a9d898-8fd4-46a6-b133-d8ecfb761b40 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:49.546573 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-9284eb49-077b-4bc1-a988-21cbf6d0ce2f tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5899b2ad9f1046caaf7c6073e408eeee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25abd63376614081a9d484f3c9ae950d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:16:49.558468 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-9284eb49-077b-4bc1-a988-21cbf6d0ce2f tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "GET /compute/v2.1/servers/250395b5-5be8-420a-8709-dcf8b4241a4e" status: 200 len: 1696 microversion: 2.1 time: 0.608828 Aug 10 23:16:49.559084 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2182/4199] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:16:48 2022] GET /compute/v2.1/servers/250395b5-5be8-420a-8709-dcf8b4241a4e => generated 1696 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:16:49.600017 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-29a9d898-8fd4-46a6-b133-d8ecfb761b40 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:16:49.607847 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-29a9d898-8fd4-46a6-b133-d8ecfb761b40 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b" status: 200 len: 1514 microversion: 2.1 time: 0.283412 Aug 10 23:16:49.621579 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2018/4200] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:16:49 2022] GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b => generated 1514 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:16:50.580709 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-7fe2c7ba-e332-479b-ab12-d1d227af252b tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:16:50.581332 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-7fe2c7ba-e332-479b-ab12-d1d227af252b tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] [instance: 250395b5-5be8-420a-8709-dcf8b4241a4e] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:16:50.591411 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7fe2c7ba-e332-479b-ab12-d1d227af252b tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:50.591944 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7fe2c7ba-e332-479b-ab12-d1d227af252b tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:50.592987 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7fe2c7ba-e332-479b-ab12-d1d227af252b tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:50.595618 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7fe2c7ba-e332-479b-ab12-d1d227af252b tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:50.596357 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7fe2c7ba-e332-479b-ab12-d1d227af252b tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:50.597079 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7fe2c7ba-e332-479b-ab12-d1d227af252b tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:50.630317 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-e7a08097-ddde-4e27-be20-d365b17d9666 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:16:50.631085 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-e7a08097-ddde-4e27-be20-d365b17d9666 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:16:50.639042 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=1 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:16:50.642024 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e7a08097-ddde-4e27-be20-d365b17d9666 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:50.642873 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e7a08097-ddde-4e27-be20-d365b17d9666 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:50.644070 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e7a08097-ddde-4e27-be20-d365b17d9666 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:50.648159 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e7a08097-ddde-4e27-be20-d365b17d9666 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:50.648923 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e7a08097-ddde-4e27-be20-d365b17d9666 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:50.649571 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e7a08097-ddde-4e27-be20-d365b17d9666 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:50.889022 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-e7a08097-ddde-4e27-be20-d365b17d9666 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:16:50.907798 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-e7a08097-ddde-4e27-be20-d365b17d9666 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b" status: 200 len: 1497 microversion: 2.1 time: 0.282258 Aug 10 23:16:50.921253 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2019/4201] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:16:50 2022] GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b => generated 1497 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:16:50.933200 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-6acd91e9-3512-4e72-9edc-d4c8b6c5466c tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:16:50.933756 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-6acd91e9-3512-4e72-9edc-d4c8b6c5466c tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:16:50.957609 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6acd91e9-3512-4e72-9edc-d4c8b6c5466c tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:50.958021 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6acd91e9-3512-4e72-9edc-d4c8b6c5466c tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:50.958486 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6acd91e9-3512-4e72-9edc-d4c8b6c5466c tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:50.960581 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6acd91e9-3512-4e72-9edc-d4c8b6c5466c tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:50.969303 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6acd91e9-3512-4e72-9edc-d4c8b6c5466c tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:50.969564 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6acd91e9-3512-4e72-9edc-d4c8b6c5466c tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:51.026442 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.objects.instance [None req-6acd91e9-3512-4e72-9edc-d4c8b6c5466c tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lazy-loading 'flavor' on Instance uuid 23bbe055-4a92-4b96-8b89-c941229bfb0b {{(pid=122632) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:16:51.046429 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-6acd91e9-3512-4e72-9edc-d4c8b6c5466c tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] HTTP exception thrown: Cannot 'suspend' instance 23bbe055-4a92-4b96-8b89-c941229bfb0b while it is in vm_state suspended Aug 10 23:16:51.049631 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-6acd91e9-3512-4e72-9edc-d4c8b6c5466c tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Request method failure captured: Aug 10 23:16:51.049631 n-d-850468-14 devstack@n-api.service[122632]: request: POST /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b/action HTTP/1.1 Aug 10 23:16:51.049631 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:16:51.049631 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:16:51.049631 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:16:51.049631 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 15 Aug 10 23:16:51.049631 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:16:51.049631 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:16:51.049631 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:16:51.049631 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:16:51.049631 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9DuIKrfOsS8tKST0PsIPrvuNPfsVISfOPvUoe9ddkVcTJKj7rDjd3OuH9u-DTT1aypj1AUoUKtajD98eDOUOHSpPisBSdRlSCov30lHf1uZq-XZLyBIVg5kAG8-SuXk2s1TL7EnRcjjMARSkm95dZDnXaBXRT3M4f8UoMDwqu7xK7gQ Aug 10 23:16:51.049631 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:16:51.049631 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:16:51.049631 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:16:51.049631 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:16:51.049631 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:16:51.049631 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:16:51.049631 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: d11bbb3e87f4463787da56ab19108822 Aug 10 23:16:51.049631 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-ServersNegativeTestJSON-1216728002 Aug 10 23:16:51.049631 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:16:51.049631 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:16:51.049631 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d11bbb3e87f4463787da56ab19108822"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d11bbb3e87f4463787da56ab19108822"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d11bbb3e87f4463787da56ab19108822"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d11bbb3e87f4463787da56ab19108822", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:16:51.049631 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-ServersNegativeTestJSON-1216728002 Aug 10 23:16:51.049631 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: d11bbb3e87f4463787da56ab19108822 Aug 10 23:16:51.049631 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1216728002 Aug 10 23:16:51.049631 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-ServersNegativeTestJSON-1216728002-project Aug 10 23:16:51.049631 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:16:51.049631 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:16:51.049631 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: f284ec2a4bf546b58c1c1adaf880e1fb Aug 10 23:16:51.049631 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-ServersNegativeTestJSON-1216728002-project Aug 10 23:16:51.049631 n-d-850468-14 devstack@n-api.service[122632]: Aug 10 23:16:51.049631 n-d-850468-14 devstack@n-api.service[122632]: {"suspend": {}} Aug 10 23:16:51.049631 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:16:51.049631 n-d-850468-14 devstack@n-api.service[122632]: exception: Cannot 'suspend' instance 23bbe055-4a92-4b96-8b89-c941229bfb0b while it is in vm_state suspended Aug 10 23:16:51.049631 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': '23bbe055-4a92-4b96-8b89-c941229bfb0b', 'body': {'suspend': {}}} Aug 10 23:16:51.049631 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:16:51.049631 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:16:51.049631 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend Aug 10 23:16:51.049631 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) Aug 10 23:16:51.049631 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Aug 10 23:16:51.049631 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 10 23:16:51.049631 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Aug 10 23:16:51.049631 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 10 23:16:51.049631 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Aug 10 23:16:51.049631 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 10 23:16:51.049631 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner Aug 10 23:16:51.049631 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 10 23:16:51.049631 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 10 23:16:51.049631 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 10 23:16:51.049631 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 10 23:16:51.049631 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 10 23:16:51.049631 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 23bbe055-4a92-4b96-8b89-c941229bfb0b in vm_state suspended. Cannot suspend while the instance is in this state. Aug 10 23:16:51.049631 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:16:51.049631 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:16:51.049631 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:16:51.049631 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:16:51.049631 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:16:51.049631 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:16:51.049631 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:16:51.049631 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:16:51.049631 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:16:51.049631 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:16:51.049631 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend Aug 10 23:16:51.049631 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 10 23:16:51.055879 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 10 23:16:51.055879 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 10 23:16:51.055879 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance 23bbe055-4a92-4b96-8b89-c941229bfb0b while it is in vm_state suspended Aug 10 23:16:51.055879 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:16:51.055879 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:16:51.055879 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:16:51.055879 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:16:51.055879 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:16:51.055879 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:16:51.055879 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:16:51.055879 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:16:51.055879 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance 23bbe055-4a92-4b96-8b89-c941229bfb0b while it is in vm_state suspended Aug 10 23:16:51.055879 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:16:51.055879 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-6acd91e9-3512-4e72-9edc-d4c8b6c5466c tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Returning 409 to user: Cannot 'suspend' instance 23bbe055-4a92-4b96-8b89-c941229bfb0b while it is in vm_state suspended {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:16:51.055879 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-6acd91e9-3512-4e72-9edc-d4c8b6c5466c tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "POST /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b/action" status: 409 len: 148 microversion: 2.1 time: 0.127648 Aug 10 23:16:51.055879 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2020/4202] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:16:50 2022] POST /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b/action => generated 148 bytes in 129 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 10 23:16:51.065952 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-885a3760-c354-4390-9bfe-e84eef545e0d tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:16:51.066821 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-885a3760-c354-4390-9bfe-e84eef545e0d tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:16:51.074169 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-885a3760-c354-4390-9bfe-e84eef545e0d tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:51.074976 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-885a3760-c354-4390-9bfe-e84eef545e0d tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:51.075743 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-885a3760-c354-4390-9bfe-e84eef545e0d tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:51.076886 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-885a3760-c354-4390-9bfe-e84eef545e0d tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:51.077428 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-885a3760-c354-4390-9bfe-e84eef545e0d tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:51.078641 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-885a3760-c354-4390-9bfe-e84eef545e0d tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:51.253638 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-885a3760-c354-4390-9bfe-e84eef545e0d tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "POST /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b/action" status: 202 len: 0 microversion: 2.1 time: 0.187272 Aug 10 23:16:51.255373 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2021/4203] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:16:51 2022] POST /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b/action => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:16:51.270755 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-7433593a-a5d6-4696-b965-ad57967c3d62 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:16:51.272181 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-7433593a-a5d6-4696-b965-ad57967c3d62 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:16:51.294711 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7433593a-a5d6-4696-b965-ad57967c3d62 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:51.295763 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7433593a-a5d6-4696-b965-ad57967c3d62 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:51.298272 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7433593a-a5d6-4696-b965-ad57967c3d62 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:51.299670 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7433593a-a5d6-4696-b965-ad57967c3d62 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:51.300347 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7433593a-a5d6-4696-b965-ad57967c3d62 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:51.303253 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7433593a-a5d6-4696-b965-ad57967c3d62 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:51.310423 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-7fe2c7ba-e332-479b-ab12-d1d227af252b tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5899b2ad9f1046caaf7c6073e408eeee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25abd63376614081a9d484f3c9ae950d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:16:51.330404 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-7fe2c7ba-e332-479b-ab12-d1d227af252b tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "GET /compute/v2.1/servers/250395b5-5be8-420a-8709-dcf8b4241a4e" status: 200 len: 1696 microversion: 2.1 time: 0.754335 Aug 10 23:16:51.335436 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2183/4204] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:16:50 2022] GET /compute/v2.1/servers/250395b5-5be8-420a-8709-dcf8b4241a4e => generated 1696 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:16:51.900148 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-7433593a-a5d6-4696-b965-ad57967c3d62 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:16:51.911595 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-7433593a-a5d6-4696-b965-ad57967c3d62 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b" status: 200 len: 1503 microversion: 2.1 time: 0.650657 Aug 10 23:16:51.912475 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2022/4205] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:16:51 2022] GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b => generated 1503 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:16:52.361100 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-e04dd0e1-95b7-46c3-abdf-1986bc53f6f3 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:16:52.361772 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-e04dd0e1-95b7-46c3-abdf-1986bc53f6f3 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] [instance: 250395b5-5be8-420a-8709-dcf8b4241a4e] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:16:52.384049 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e04dd0e1-95b7-46c3-abdf-1986bc53f6f3 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:52.384635 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e04dd0e1-95b7-46c3-abdf-1986bc53f6f3 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:52.385085 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e04dd0e1-95b7-46c3-abdf-1986bc53f6f3 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:52.387483 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e04dd0e1-95b7-46c3-abdf-1986bc53f6f3 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:52.392886 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e04dd0e1-95b7-46c3-abdf-1986bc53f6f3 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:52.394086 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e04dd0e1-95b7-46c3-abdf-1986bc53f6f3 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:52.863745 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-e04dd0e1-95b7-46c3-abdf-1986bc53f6f3 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5899b2ad9f1046caaf7c6073e408eeee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25abd63376614081a9d484f3c9ae950d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:16:52.915068 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-e04dd0e1-95b7-46c3-abdf-1986bc53f6f3 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "GET /compute/v2.1/servers/250395b5-5be8-420a-8709-dcf8b4241a4e" status: 200 len: 1696 microversion: 2.1 time: 0.562642 Aug 10 23:16:52.919478 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2184/4206] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:16:52 2022] GET /compute/v2.1/servers/250395b5-5be8-420a-8709-dcf8b4241a4e => generated 1696 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:16:52.934049 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-dd2c591f-9e16-48d5-922d-6f35e4824b2e tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:16:52.938180 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-dd2c591f-9e16-48d5-922d-6f35e4824b2e tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:16:52.959111 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dd2c591f-9e16-48d5-922d-6f35e4824b2e tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:52.959619 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dd2c591f-9e16-48d5-922d-6f35e4824b2e tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:52.961224 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dd2c591f-9e16-48d5-922d-6f35e4824b2e tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:52.972320 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dd2c591f-9e16-48d5-922d-6f35e4824b2e tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:52.973569 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dd2c591f-9e16-48d5-922d-6f35e4824b2e tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:52.974188 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dd2c591f-9e16-48d5-922d-6f35e4824b2e tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:53.937984 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-54a935ea-5bf8-4fef-82eb-bd6bcc956a66 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:16:53.938661 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-54a935ea-5bf8-4fef-82eb-bd6bcc956a66 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] [instance: 250395b5-5be8-420a-8709-dcf8b4241a4e] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:16:53.953051 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-54a935ea-5bf8-4fef-82eb-bd6bcc956a66 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:53.953790 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-54a935ea-5bf8-4fef-82eb-bd6bcc956a66 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:53.954401 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-54a935ea-5bf8-4fef-82eb-bd6bcc956a66 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:53.955305 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-54a935ea-5bf8-4fef-82eb-bd6bcc956a66 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:53.955919 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-54a935ea-5bf8-4fef-82eb-bd6bcc956a66 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:53.957751 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-54a935ea-5bf8-4fef-82eb-bd6bcc956a66 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:54.059072 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-dd2c591f-9e16-48d5-922d-6f35e4824b2e tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:16:54.076786 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-dd2c591f-9e16-48d5-922d-6f35e4824b2e tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b" status: 200 len: 1503 microversion: 2.1 time: 1.141560 Aug 10 23:16:54.081126 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2023/4207] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:16:52 2022] GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b => generated 1503 bytes in 1152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:16:54.359419 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-54a935ea-5bf8-4fef-82eb-bd6bcc956a66 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5899b2ad9f1046caaf7c6073e408eeee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25abd63376614081a9d484f3c9ae950d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:16:54.375333 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-54a935ea-5bf8-4fef-82eb-bd6bcc956a66 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "GET /compute/v2.1/servers/250395b5-5be8-420a-8709-dcf8b4241a4e" status: 200 len: 1696 microversion: 2.1 time: 0.441580 Aug 10 23:16:54.399153 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2185/4208] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:16:53 2022] GET /compute/v2.1/servers/250395b5-5be8-420a-8709-dcf8b4241a4e => generated 1696 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:16:55.103695 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-984af212-5d96-4de9-8b14-fb8860116801 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:16:55.104555 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-984af212-5d96-4de9-8b14-fb8860116801 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:16:55.135487 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-984af212-5d96-4de9-8b14-fb8860116801 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:55.136508 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-984af212-5d96-4de9-8b14-fb8860116801 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:55.137426 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-984af212-5d96-4de9-8b14-fb8860116801 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:55.138452 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-984af212-5d96-4de9-8b14-fb8860116801 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:55.139167 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-984af212-5d96-4de9-8b14-fb8860116801 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:55.140185 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-984af212-5d96-4de9-8b14-fb8860116801 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:55.402308 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-edabd948-0fd6-41b3-a02c-6451e6c529ac tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:16:55.403056 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-edabd948-0fd6-41b3-a02c-6451e6c529ac tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] [instance: 250395b5-5be8-420a-8709-dcf8b4241a4e] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:16:55.429430 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-edabd948-0fd6-41b3-a02c-6451e6c529ac tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:55.433737 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-edabd948-0fd6-41b3-a02c-6451e6c529ac tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:55.436252 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-edabd948-0fd6-41b3-a02c-6451e6c529ac tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:55.449772 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-edabd948-0fd6-41b3-a02c-6451e6c529ac tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:55.451909 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-edabd948-0fd6-41b3-a02c-6451e6c529ac tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:55.453263 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-edabd948-0fd6-41b3-a02c-6451e6c529ac tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:55.705717 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-984af212-5d96-4de9-8b14-fb8860116801 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:16:55.719287 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-984af212-5d96-4de9-8b14-fb8860116801 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b" status: 200 len: 1506 microversion: 2.1 time: 0.622071 Aug 10 23:16:55.721836 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2024/4209] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:16:55 2022] GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b => generated 1506 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:16:55.748694 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-d6f06149-e01e-41a7-8683-9cee4c09a89e tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:16:55.752829 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-d6f06149-e01e-41a7-8683-9cee4c09a89e tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:16:55.775880 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d6f06149-e01e-41a7-8683-9cee4c09a89e tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:55.780497 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d6f06149-e01e-41a7-8683-9cee4c09a89e tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:55.781788 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d6f06149-e01e-41a7-8683-9cee4c09a89e tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:55.783653 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d6f06149-e01e-41a7-8683-9cee4c09a89e tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:55.784943 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d6f06149-e01e-41a7-8683-9cee4c09a89e tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:55.788223 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d6f06149-e01e-41a7-8683-9cee4c09a89e tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:55.997018 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-edabd948-0fd6-41b3-a02c-6451e6c529ac tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5899b2ad9f1046caaf7c6073e408eeee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25abd63376614081a9d484f3c9ae950d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:16:56.010768 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-edabd948-0fd6-41b3-a02c-6451e6c529ac tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "GET /compute/v2.1/servers/250395b5-5be8-420a-8709-dcf8b4241a4e" status: 200 len: 1696 microversion: 2.1 time: 0.617103 Aug 10 23:16:56.013097 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2186/4210] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:16:55 2022] GET /compute/v2.1/servers/250395b5-5be8-420a-8709-dcf8b4241a4e => generated 1696 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:16:56.213504 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-d6f06149-e01e-41a7-8683-9cee4c09a89e tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:16:56.228415 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-d6f06149-e01e-41a7-8683-9cee4c09a89e tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b" status: 200 len: 1506 microversion: 2.1 time: 0.485337 Aug 10 23:16:56.230518 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2025/4211] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:16:55 2022] GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b => generated 1506 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:16:56.257260 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-5ca26a39-2e05-4757-a595-d8279f5092af tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:16:56.258251 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-5ca26a39-2e05-4757-a595-d8279f5092af tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 7a4a81fc-d55f-42d9-bb75-82955ef962dd] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:16:56.276715 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-5ca26a39-2e05-4757-a595-d8279f5092af tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] HTTP exception thrown: Instance 7a4a81fc-d55f-42d9-bb75-82955ef962dd could not be found. Aug 10 23:16:56.278438 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-5ca26a39-2e05-4757-a595-d8279f5092af tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Request method failure captured: Aug 10 23:16:56.278438 n-d-850468-14 devstack@n-api.service[122633]: request: POST /compute/v2.1/servers/7a4a81fc-d55f-42d9-bb75-82955ef962dd/action HTTP/1.1 Aug 10 23:16:56.278438 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:16:56.278438 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:16:56.278438 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:16:56.278438 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 15 Aug 10 23:16:56.278438 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:16:56.278438 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:16:56.278438 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:16:56.278438 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:16:56.278438 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9DuIKrfOsS8tKST0PsIPrvuNPfsVISfOPvUoe9ddkVcTJKj7rDjd3OuH9u-DTT1aypj1AUoUKtajD98eDOUOHSpPisBSdRlSCov30lHf1uZq-XZLyBIVg5kAG8-SuXk2s1TL7EnRcjjMARSkm95dZDnXaBXRT3M4f8UoMDwqu7xK7gQ Aug 10 23:16:56.278438 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:16:56.278438 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:16:56.278438 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:16:56.278438 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:16:56.278438 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:16:56.278438 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:16:56.278438 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: d11bbb3e87f4463787da56ab19108822 Aug 10 23:16:56.278438 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-ServersNegativeTestJSON-1216728002 Aug 10 23:16:56.278438 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:16:56.278438 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:16:56.278438 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d11bbb3e87f4463787da56ab19108822"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d11bbb3e87f4463787da56ab19108822"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d11bbb3e87f4463787da56ab19108822"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d11bbb3e87f4463787da56ab19108822", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:16:56.278438 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-ServersNegativeTestJSON-1216728002 Aug 10 23:16:56.278438 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: d11bbb3e87f4463787da56ab19108822 Aug 10 23:16:56.278438 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1216728002 Aug 10 23:16:56.278438 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-ServersNegativeTestJSON-1216728002-project Aug 10 23:16:56.278438 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:16:56.278438 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:16:56.278438 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: f284ec2a4bf546b58c1c1adaf880e1fb Aug 10 23:16:56.278438 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-ServersNegativeTestJSON-1216728002-project Aug 10 23:16:56.278438 n-d-850468-14 devstack@n-api.service[122633]: Aug 10 23:16:56.278438 n-d-850468-14 devstack@n-api.service[122633]: {"unpause": {}} Aug 10 23:16:56.278438 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:16:56.278438 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance 7a4a81fc-d55f-42d9-bb75-82955ef962dd could not be found. Aug 10 23:16:56.278438 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': '7a4a81fc-d55f-42d9-bb75-82955ef962dd', 'body': {'unpause': {}}} Aug 10 23:16:56.278438 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:16:56.278438 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:16:56.278438 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:16:56.278438 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:16:56.278438 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:16:56.278438 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:16:56.278438 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 10 23:16:56.278438 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 10 23:16:56.278438 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a4a81fc-d55f-42d9-bb75-82955ef962dd could not be found. Aug 10 23:16:56.278438 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:16:56.278438 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:16:56.278438 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:16:56.278438 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:16:56.278438 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:16:56.278438 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:16:56.278438 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:16:56.278438 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:16:56.278438 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:16:56.278438 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:16:56.278438 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause Aug 10 23:16:56.278438 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Aug 10 23:16:56.278438 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:16:56.278438 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:16:56.278438 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a4a81fc-d55f-42d9-bb75-82955ef962dd could not be found. Aug 10 23:16:56.278438 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:16:56.278438 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:16:56.278438 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:16:56.278438 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:16:56.278438 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:16:56.278438 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:16:56.285326 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:16:56.285326 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:16:56.285326 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a4a81fc-d55f-42d9-bb75-82955ef962dd could not be found. Aug 10 23:16:56.285326 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:16:56.285326 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-5ca26a39-2e05-4757-a595-d8279f5092af tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Returning 404 to user: Instance 7a4a81fc-d55f-42d9-bb75-82955ef962dd could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:16:56.285326 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-5ca26a39-2e05-4757-a595-d8279f5092af tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "POST /compute/v2.1/servers/7a4a81fc-d55f-42d9-bb75-82955ef962dd/action" status: 404 len: 111 microversion: 2.1 time: 0.031673 Aug 10 23:16:56.285326 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2187/4212] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:16:56 2022] POST /compute/v2.1/servers/7a4a81fc-d55f-42d9-bb75-82955ef962dd/action => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:16:56.289780 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-99b865e6-a8f6-497b-bcce-09c2ba9164f3 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:16:56.290417 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-99b865e6-a8f6-497b-bcce-09c2ba9164f3 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:16:56.299020 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-99b865e6-a8f6-497b-bcce-09c2ba9164f3 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:56.299832 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-99b865e6-a8f6-497b-bcce-09c2ba9164f3 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:56.300428 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-99b865e6-a8f6-497b-bcce-09c2ba9164f3 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:56.301359 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-99b865e6-a8f6-497b-bcce-09c2ba9164f3 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:56.301995 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-99b865e6-a8f6-497b-bcce-09c2ba9164f3 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:56.302577 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-99b865e6-a8f6-497b-bcce-09c2ba9164f3 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:56.613388 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-99b865e6-a8f6-497b-bcce-09c2ba9164f3 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:16:56.624138 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-99b865e6-a8f6-497b-bcce-09c2ba9164f3 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b" status: 200 len: 1506 microversion: 2.1 time: 0.338680 Aug 10 23:16:56.634175 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2026/4213] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:16:56 2022] GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b => generated 1506 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:16:56.669437 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-995488a4-f691-4f8e-8a3c-c278c8e40812 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:16:56.670055 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-995488a4-f691-4f8e-8a3c-c278c8e40812 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:16:56.689877 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-995488a4-f691-4f8e-8a3c-c278c8e40812 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:56.691013 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-995488a4-f691-4f8e-8a3c-c278c8e40812 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:56.692023 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-995488a4-f691-4f8e-8a3c-c278c8e40812 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:56.693042 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-995488a4-f691-4f8e-8a3c-c278c8e40812 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:56.693792 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-995488a4-f691-4f8e-8a3c-c278c8e40812 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:56.694471 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-995488a4-f691-4f8e-8a3c-c278c8e40812 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:57.188069 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-6f408ae6-ef9e-44ec-bd2d-30dad9d5069e tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-1074907711", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452", "networks": [{"uuid": "f74f96d7-a483-419c-9c39-0eb568770af8"}]}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:16:57.333185 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.network.neutron [None req-6f408ae6-ef9e-44ec-bd2d-30dad9d5069e tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] validate_networks() for [('f74f96d7-a483-419c-9c39-0eb568770af8', None, None, None, None, None)] {{(pid=122632) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 23:16:57.531277 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-995488a4-f691-4f8e-8a3c-c278c8e40812 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:16:57.555650 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-995488a4-f691-4f8e-8a3c-c278c8e40812 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b" status: 200 len: 1506 microversion: 2.1 time: 0.895680 Aug 10 23:16:57.576378 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2188/4214] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:16:56 2022] GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b => generated 1506 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:16:57.586851 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-641bc57b-2f6f-4f48-afae-ad3c9569d7cf tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:16:57.592209 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-641bc57b-2f6f-4f48-afae-ad3c9569d7cf tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] [instance: 250395b5-5be8-420a-8709-dcf8b4241a4e] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:16:57.620300 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-641bc57b-2f6f-4f48-afae-ad3c9569d7cf tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:57.625536 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-641bc57b-2f6f-4f48-afae-ad3c9569d7cf tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:57.628601 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-641bc57b-2f6f-4f48-afae-ad3c9569d7cf tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:57.630538 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-641bc57b-2f6f-4f48-afae-ad3c9569d7cf tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:57.631708 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-641bc57b-2f6f-4f48-afae-ad3c9569d7cf tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:57.634624 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-641bc57b-2f6f-4f48-afae-ad3c9569d7cf tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:58.148944 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-641bc57b-2f6f-4f48-afae-ad3c9569d7cf tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5899b2ad9f1046caaf7c6073e408eeee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25abd63376614081a9d484f3c9ae950d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:16:58.158701 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-641bc57b-2f6f-4f48-afae-ad3c9569d7cf tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "GET /compute/v2.1/servers/250395b5-5be8-420a-8709-dcf8b4241a4e" status: 200 len: 1696 microversion: 2.1 time: 0.580873 Aug 10 23:16:58.160629 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2189/4215] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:16:57 2022] GET /compute/v2.1/servers/250395b5-5be8-420a-8709-dcf8b4241a4e => generated 1696 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:16:58.177687 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-fab68124-7b59-4644-afde-531c3492bdc0 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:16:58.189381 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-fab68124-7b59-4644-afde-531c3492bdc0 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:16:58.218396 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fab68124-7b59-4644-afde-531c3492bdc0 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:58.226733 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fab68124-7b59-4644-afde-531c3492bdc0 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:58.227347 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fab68124-7b59-4644-afde-531c3492bdc0 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:58.228419 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fab68124-7b59-4644-afde-531c3492bdc0 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:58.228911 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fab68124-7b59-4644-afde-531c3492bdc0 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:58.229768 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fab68124-7b59-4644-afde-531c3492bdc0 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:58.301036 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-fab68124-7b59-4644-afde-531c3492bdc0 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] HTTP exception thrown: Cannot 'unpause' instance 23bbe055-4a92-4b96-8b89-c941229bfb0b while it is in vm_state active Aug 10 23:16:58.307213 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-fab68124-7b59-4644-afde-531c3492bdc0 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Request method failure captured: Aug 10 23:16:58.307213 n-d-850468-14 devstack@n-api.service[122633]: request: POST /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b/action HTTP/1.1 Aug 10 23:16:58.307213 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:16:58.307213 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:16:58.307213 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:16:58.307213 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 15 Aug 10 23:16:58.307213 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:16:58.307213 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:16:58.307213 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:16:58.307213 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:16:58.307213 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9DuIKrfOsS8tKST0PsIPrvuNPfsVISfOPvUoe9ddkVcTJKj7rDjd3OuH9u-DTT1aypj1AUoUKtajD98eDOUOHSpPisBSdRlSCov30lHf1uZq-XZLyBIVg5kAG8-SuXk2s1TL7EnRcjjMARSkm95dZDnXaBXRT3M4f8UoMDwqu7xK7gQ Aug 10 23:16:58.307213 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:16:58.307213 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:16:58.307213 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:16:58.307213 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:16:58.307213 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:16:58.307213 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:16:58.307213 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: d11bbb3e87f4463787da56ab19108822 Aug 10 23:16:58.307213 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-ServersNegativeTestJSON-1216728002 Aug 10 23:16:58.307213 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:16:58.307213 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:16:58.307213 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d11bbb3e87f4463787da56ab19108822"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d11bbb3e87f4463787da56ab19108822"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d11bbb3e87f4463787da56ab19108822"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d11bbb3e87f4463787da56ab19108822", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:16:58.307213 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-ServersNegativeTestJSON-1216728002 Aug 10 23:16:58.307213 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: d11bbb3e87f4463787da56ab19108822 Aug 10 23:16:58.307213 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1216728002 Aug 10 23:16:58.307213 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-ServersNegativeTestJSON-1216728002-project Aug 10 23:16:58.307213 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:16:58.307213 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:16:58.307213 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: f284ec2a4bf546b58c1c1adaf880e1fb Aug 10 23:16:58.307213 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-ServersNegativeTestJSON-1216728002-project Aug 10 23:16:58.307213 n-d-850468-14 devstack@n-api.service[122633]: Aug 10 23:16:58.307213 n-d-850468-14 devstack@n-api.service[122633]: {"unpause": {}} Aug 10 23:16:58.307213 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:16:58.307213 n-d-850468-14 devstack@n-api.service[122633]: exception: Cannot 'unpause' instance 23bbe055-4a92-4b96-8b89-c941229bfb0b while it is in vm_state active Aug 10 23:16:58.307213 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': '23bbe055-4a92-4b96-8b89-c941229bfb0b', 'body': {'unpause': {}}} Aug 10 23:16:58.307213 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:16:58.307213 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:16:58.307213 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause Aug 10 23:16:58.307213 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) Aug 10 23:16:58.307213 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 10 23:16:58.307213 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 10 23:16:58.307213 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 10 23:16:58.307213 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 10 23:16:58.307213 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 23bbe055-4a92-4b96-8b89-c941229bfb0b in vm_state active. Cannot unpause while the instance is in this state. Aug 10 23:16:58.307213 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:16:58.307213 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:16:58.307213 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:16:58.307213 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:16:58.307213 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:16:58.307213 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:16:58.307213 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:16:58.307213 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:16:58.307213 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:16:58.307213 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:16:58.307213 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause Aug 10 23:16:58.307213 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 10 23:16:58.307213 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 10 23:16:58.307213 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 10 23:16:58.307213 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance 23bbe055-4a92-4b96-8b89-c941229bfb0b while it is in vm_state active Aug 10 23:16:58.307213 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:16:58.307213 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:16:58.307213 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:16:58.307213 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:16:58.307213 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:16:58.311532 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:16:58.311532 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:16:58.311532 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:16:58.311532 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance 23bbe055-4a92-4b96-8b89-c941229bfb0b while it is in vm_state active Aug 10 23:16:58.311532 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:16:58.311532 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-fab68124-7b59-4644-afde-531c3492bdc0 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Returning 409 to user: Cannot 'unpause' instance 23bbe055-4a92-4b96-8b89-c941229bfb0b while it is in vm_state active {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:16:58.311532 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-fab68124-7b59-4644-afde-531c3492bdc0 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "POST /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b/action" status: 409 len: 145 microversion: 2.1 time: 0.147182 Aug 10 23:16:58.323533 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2190/4216] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:16:58 2022] POST /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b/action => generated 145 bytes in 162 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 10 23:16:58.333127 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-b88ea63e-8009-45b7-98ce-4283db7a2f6e tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:16:58.334927 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-b88ea63e-8009-45b7-98ce-4283db7a2f6e tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:16:58.355201 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b88ea63e-8009-45b7-98ce-4283db7a2f6e tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:58.358387 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b88ea63e-8009-45b7-98ce-4283db7a2f6e tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:58.360819 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b88ea63e-8009-45b7-98ce-4283db7a2f6e tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:58.363035 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b88ea63e-8009-45b7-98ce-4283db7a2f6e tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:58.363809 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b88ea63e-8009-45b7-98ce-4283db7a2f6e tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:58.364566 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b88ea63e-8009-45b7-98ce-4283db7a2f6e tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:58.871201 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-b88ea63e-8009-45b7-98ce-4283db7a2f6e tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:16:58.882251 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-b88ea63e-8009-45b7-98ce-4283db7a2f6e tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b" status: 200 len: 1506 microversion: 2.1 time: 0.557134 Aug 10 23:16:58.885548 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2191/4217] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:16:58 2022] GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b => generated 1506 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:16:58.913979 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-83d6d82e-18c0-4598-8d31-7d15867c33c1 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:16:58.914852 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-83d6d82e-18c0-4598-8d31-7d15867c33c1 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:16:58.928504 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-83d6d82e-18c0-4598-8d31-7d15867c33c1 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:58.929341 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-83d6d82e-18c0-4598-8d31-7d15867c33c1 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:58.930102 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-83d6d82e-18c0-4598-8d31-7d15867c33c1 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:58.931038 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-83d6d82e-18c0-4598-8d31-7d15867c33c1 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:58.933011 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-83d6d82e-18c0-4598-8d31-7d15867c33c1 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:58.934290 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-83d6d82e-18c0-4598-8d31-7d15867c33c1 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:58.985398 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-6f408ae6-ef9e-44ec-bd2d-30dad9d5069e tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Flavor limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:16:58.986877 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-6f408ae6-ef9e-44ec-bd2d-30dad9d5069e tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Image limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:16:58.987584 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-6f408ae6-ef9e-44ec-bd2d-30dad9d5069e tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Flavor pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:16:58.988231 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-6f408ae6-ef9e-44ec-bd2d-30dad9d5069e tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Image pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:16:58.988855 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-6f408ae6-ef9e-44ec-bd2d-30dad9d5069e tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:16:59.006271 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6f408ae6-ef9e-44ec-bd2d-30dad9d5069e tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:59.009685 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6f408ae6-ef9e-44ec-bd2d-30dad9d5069e tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:59.010394 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6f408ae6-ef9e-44ec-bd2d-30dad9d5069e tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:59.011467 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6f408ae6-ef9e-44ec-bd2d-30dad9d5069e tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:59.012159 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6f408ae6-ef9e-44ec-bd2d-30dad9d5069e tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:59.013636 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6f408ae6-ef9e-44ec-bd2d-30dad9d5069e tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:59.035529 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:16:59.083027 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-6f408ae6-ef9e-44ec-bd2d-30dad9d5069e tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Getting quotas for project b5049eb227494da1b8b328d8ff28d570. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:16:59.098351 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-6f408ae6-ef9e-44ec-bd2d-30dad9d5069e tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Getting quotas for user 82a9184aa6c9405f8534e151e6508335 and project b5049eb227494da1b8b328d8ff28d570. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:16:59.141334 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-6f408ae6-ef9e-44ec-bd2d-30dad9d5069e tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Going to run 1 instances... {{(pid=122632) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 23:16:59.149985 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-6f408ae6-ef9e-44ec-bd2d-30dad9d5069e tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] [instance: 8410ad7d-396e-45d4-b0a4-92405d95fa8a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78ad8905-f66f-4733-8be9-2b260f1fabed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122632) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 23:16:59.299140 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-6f408ae6-ef9e-44ec-bd2d-30dad9d5069e tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 2.409194 Aug 10 23:16:59.299864 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2027/4218] 10.222.0.58 () {62 vars in 1188 bytes} [Wed Aug 10 23:16:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 2415 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 10 23:16:59.320593 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-1ffd6b5f-aac4-42c1-b7d3-b711dfeae624 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:16:59.321218 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-1ffd6b5f-aac4-42c1-b7d3-b711dfeae624 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] [instance: 250395b5-5be8-420a-8709-dcf8b4241a4e] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:16:59.346122 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1ffd6b5f-aac4-42c1-b7d3-b711dfeae624 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:59.357196 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1ffd6b5f-aac4-42c1-b7d3-b711dfeae624 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:59.358067 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1ffd6b5f-aac4-42c1-b7d3-b711dfeae624 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:59.362138 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1ffd6b5f-aac4-42c1-b7d3-b711dfeae624 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:16:59.366373 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1ffd6b5f-aac4-42c1-b7d3-b711dfeae624 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:16:59.368880 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1ffd6b5f-aac4-42c1-b7d3-b711dfeae624 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:16:59.588127 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-83d6d82e-18c0-4598-8d31-7d15867c33c1 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:16:59.616333 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-83d6d82e-18c0-4598-8d31-7d15867c33c1 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b" status: 200 len: 1506 microversion: 2.1 time: 0.708668 Aug 10 23:16:59.626429 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2192/4219] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:16:58 2022] GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b => generated 1506 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:16:59.639356 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-9775847a-8103-447d-b3e9-8f153785590b tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:16:59.647742 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-9775847a-8103-447d-b3e9-8f153785590b tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] [instance: 8410ad7d-396e-45d4-b0a4-92405d95fa8a] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:16:59.844843 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-9775847a-8103-447d-b3e9-8f153785590b tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82a9184aa6c9405f8534e151e6508335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5049eb227494da1b8b328d8ff28d570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:16:59.858121 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-9775847a-8103-447d-b3e9-8f153785590b tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '82a9184aa6c9405f8534e151e6508335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5049eb227494da1b8b328d8ff28d570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:16:59.868307 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-9775847a-8103-447d-b3e9-8f153785590b tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '82a9184aa6c9405f8534e151e6508335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5049eb227494da1b8b328d8ff28d570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:16:59.872223 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-9775847a-8103-447d-b3e9-8f153785590b tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] 10.222.0.58 "GET /compute/v2.1/servers/8410ad7d-396e-45d4-b0a4-92405d95fa8a" status: 200 len: 1262 microversion: 2.26 time: 0.244387 Aug 10 23:16:59.891185 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2193/4220] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:16:59 2022] GET /compute/v2.1/servers/8410ad7d-396e-45d4-b0a4-92405d95fa8a => generated 1262 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:16:59.904902 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-a228be60-52bb-4673-b894-c5a3b5dde03e tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:16:59.907038 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-a228be60-52bb-4673-b894-c5a3b5dde03e tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: a89af003-77a2-42ed-983a-ce0c8d36bab4] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:16:59.933719 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-a228be60-52bb-4673-b894-c5a3b5dde03e tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] HTTP exception thrown: Instance a89af003-77a2-42ed-983a-ce0c8d36bab4 could not be found. Aug 10 23:16:59.943912 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-a228be60-52bb-4673-b894-c5a3b5dde03e tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Request method failure captured: Aug 10 23:16:59.943912 n-d-850468-14 devstack@n-api.service[122633]: request: POST /compute/v2.1/servers/a89af003-77a2-42ed-983a-ce0c8d36bab4/action HTTP/1.1 Aug 10 23:16:59.943912 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:16:59.943912 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:16:59.943912 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:16:59.943912 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 18 Aug 10 23:16:59.943912 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:16:59.943912 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:16:59.943912 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:16:59.943912 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:16:59.943912 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9DuIKrfOsS8tKST0PsIPrvuNPfsVISfOPvUoe9ddkVcTJKj7rDjd3OuH9u-DTT1aypj1AUoUKtajD98eDOUOHSpPisBSdRlSCov30lHf1uZq-XZLyBIVg5kAG8-SuXk2s1TL7EnRcjjMARSkm95dZDnXaBXRT3M4f8UoMDwqu7xK7gQ Aug 10 23:16:59.943912 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:16:59.943912 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:16:59.943912 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:16:59.943912 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:16:59.943912 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:16:59.943912 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:16:59.943912 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: d11bbb3e87f4463787da56ab19108822 Aug 10 23:16:59.943912 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-ServersNegativeTestJSON-1216728002 Aug 10 23:16:59.943912 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:16:59.943912 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:16:59.943912 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d11bbb3e87f4463787da56ab19108822"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d11bbb3e87f4463787da56ab19108822"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d11bbb3e87f4463787da56ab19108822"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d11bbb3e87f4463787da56ab19108822", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:16:59.943912 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-ServersNegativeTestJSON-1216728002 Aug 10 23:16:59.943912 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: d11bbb3e87f4463787da56ab19108822 Aug 10 23:16:59.943912 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1216728002 Aug 10 23:16:59.943912 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-ServersNegativeTestJSON-1216728002-project Aug 10 23:16:59.943912 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:16:59.943912 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:16:59.943912 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: f284ec2a4bf546b58c1c1adaf880e1fb Aug 10 23:16:59.943912 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-ServersNegativeTestJSON-1216728002-project Aug 10 23:16:59.943912 n-d-850468-14 devstack@n-api.service[122633]: Aug 10 23:16:59.943912 n-d-850468-14 devstack@n-api.service[122633]: {"unshelve": null} Aug 10 23:16:59.943912 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:16:59.943912 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance a89af003-77a2-42ed-983a-ce0c8d36bab4 could not be found. Aug 10 23:16:59.943912 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': 'a89af003-77a2-42ed-983a-ce0c8d36bab4', 'body': {'unshelve': None}} Aug 10 23:16:59.943912 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:16:59.943912 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:16:59.943912 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:16:59.943912 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:16:59.943912 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:16:59.943912 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:16:59.943912 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 10 23:16:59.943912 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 10 23:16:59.943912 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a89af003-77a2-42ed-983a-ce0c8d36bab4 could not be found. Aug 10 23:16:59.943912 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:16:59.943912 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:16:59.943912 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:16:59.943912 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:16:59.943912 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:16:59.943912 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:16:59.943912 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:16:59.943912 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:16:59.943912 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:16:59.943912 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:16:59.943912 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 23:16:59.943912 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 23:16:59.943912 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 23:16:59.943912 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 23:16:59.943912 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 102, in _unshelve Aug 10 23:16:59.943912 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 10 23:16:59.943912 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:16:59.943912 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:16:59.943912 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a89af003-77a2-42ed-983a-ce0c8d36bab4 could not be found. Aug 10 23:16:59.943912 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:16:59.943912 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:16:59.950156 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:16:59.950156 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:16:59.950156 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:16:59.950156 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:16:59.950156 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:16:59.950156 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:16:59.950156 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a89af003-77a2-42ed-983a-ce0c8d36bab4 could not be found. Aug 10 23:16:59.950156 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:16:59.950156 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-a228be60-52bb-4673-b894-c5a3b5dde03e tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Returning 404 to user: Instance a89af003-77a2-42ed-983a-ce0c8d36bab4 could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:16:59.955438 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-a228be60-52bb-4673-b894-c5a3b5dde03e tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "POST /compute/v2.1/servers/a89af003-77a2-42ed-983a-ce0c8d36bab4/action" status: 404 len: 111 microversion: 2.1 time: 0.071728 Aug 10 23:16:59.956584 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2194/4221] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:16:59 2022] POST /compute/v2.1/servers/a89af003-77a2-42ed-983a-ce0c8d36bab4/action => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:16:59.987665 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-ac87ee9c-6229-4f9e-96f7-f6de41ed085a req-a651661c-114b-4202-a731-b62c25fc84d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "250395b5-5be8-420a-8709-dcf8b4241a4e", "name": "network-vif-unplugged", "status": "completed", "tag": "fb6df67c-3dbb-4a0f-98f0-c602e1eaa615"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:17:00.031515 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-ac87ee9c-6229-4f9e-96f7-f6de41ed085a req-a651661c-114b-4202-a731-b62c25fc84d5 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:00.038908 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-ac87ee9c-6229-4f9e-96f7-f6de41ed085a req-a651661c-114b-4202-a731-b62c25fc84d5 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:00.041376 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-ac87ee9c-6229-4f9e-96f7-f6de41ed085a req-a651661c-114b-4202-a731-b62c25fc84d5 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:00.091783 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=100 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:17:00.105741 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-ac87ee9c-6229-4f9e-96f7-f6de41ed085a req-a651661c-114b-4202-a731-b62c25fc84d5 service nova] Creating event network-vif-unplugged:fb6df67c-3dbb-4a0f-98f0-c602e1eaa615 for instance 250395b5-5be8-420a-8709-dcf8b4241a4e on n-h2-850468-14 Aug 10 23:17:00.148953 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [req-ac87ee9c-6229-4f9e-96f7-f6de41ed085a req-a651661c-114b-4202-a731-b62c25fc84d5 service nova] Instance 250395b5-5be8-420a-8709-dcf8b4241a4e is migrating within the same cell, copying events to all relevant hosts: {'n-h1-850468-14', 'n-h2-850468-14'} {{(pid=122633) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5901}} Aug 10 23:17:00.184607 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-ac87ee9c-6229-4f9e-96f7-f6de41ed085a req-a651661c-114b-4202-a731-b62c25fc84d5 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.223440 Aug 10 23:17:00.185311 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2195/4222] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:16:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:17:00.197885 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-284a3b7c-c6b5-44ef-a258-3e7bc33b385a tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:00.200522 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-284a3b7c-c6b5-44ef-a258-3e7bc33b385a tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:00.217563 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-284a3b7c-c6b5-44ef-a258-3e7bc33b385a tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:00.218732 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-284a3b7c-c6b5-44ef-a258-3e7bc33b385a tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:00.219322 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-284a3b7c-c6b5-44ef-a258-3e7bc33b385a tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:00.220177 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-284a3b7c-c6b5-44ef-a258-3e7bc33b385a tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:00.220795 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-284a3b7c-c6b5-44ef-a258-3e7bc33b385a tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:00.222062 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-284a3b7c-c6b5-44ef-a258-3e7bc33b385a tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:00.695984 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-284a3b7c-c6b5-44ef-a258-3e7bc33b385a tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:00.705378 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-284a3b7c-c6b5-44ef-a258-3e7bc33b385a tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b" status: 200 len: 1506 microversion: 2.1 time: 0.518595 Aug 10 23:17:00.724725 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2196/4223] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:17:00 2022] GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b => generated 1506 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:17:00.752665 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-7de13694-8947-40d6-a450-e381e2329f2b tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:00.756470 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-7de13694-8947-40d6-a450-e381e2329f2b tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:00.772832 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7de13694-8947-40d6-a450-e381e2329f2b tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:00.773869 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7de13694-8947-40d6-a450-e381e2329f2b tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:00.774474 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7de13694-8947-40d6-a450-e381e2329f2b tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:00.776788 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7de13694-8947-40d6-a450-e381e2329f2b tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:00.777470 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7de13694-8947-40d6-a450-e381e2329f2b tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:00.778282 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7de13694-8947-40d6-a450-e381e2329f2b tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:01.913706 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-1ffd6b5f-aac4-42c1-b7d3-b711dfeae624 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5899b2ad9f1046caaf7c6073e408eeee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25abd63376614081a9d484f3c9ae950d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:01.929932 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-1ffd6b5f-aac4-42c1-b7d3-b711dfeae624 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "GET /compute/v2.1/servers/250395b5-5be8-420a-8709-dcf8b4241a4e" status: 200 len: 1695 microversion: 2.1 time: 2.625960 Aug 10 23:17:01.933337 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2028/4224] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:16:59 2022] GET /compute/v2.1/servers/250395b5-5be8-420a-8709-dcf8b4241a4e => generated 1695 bytes in 2632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:17:01.943601 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-5a78a75a-08c8-43dc-847d-99b166b11f3b tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:01.946088 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-5a78a75a-08c8-43dc-847d-99b166b11f3b tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] [instance: 8410ad7d-396e-45d4-b0a4-92405d95fa8a] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:01.959959 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5a78a75a-08c8-43dc-847d-99b166b11f3b tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:01.960573 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5a78a75a-08c8-43dc-847d-99b166b11f3b tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:01.961017 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5a78a75a-08c8-43dc-847d-99b166b11f3b tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:01.965654 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5a78a75a-08c8-43dc-847d-99b166b11f3b tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:01.966383 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5a78a75a-08c8-43dc-847d-99b166b11f3b tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:01.973328 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5a78a75a-08c8-43dc-847d-99b166b11f3b tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:02.091344 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-7de13694-8947-40d6-a450-e381e2329f2b tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:02.111569 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-7de13694-8947-40d6-a450-e381e2329f2b tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b" status: 200 len: 1506 microversion: 2.1 time: 1.367951 Aug 10 23:17:02.135624 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2197/4225] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:17:00 2022] GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b => generated 1506 bytes in 1394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:17:02.158668 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-a4251402-d7d0-4edc-9ce3-6b29a75b074e tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:17:02.163220 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-a4251402-d7d0-4edc-9ce3-6b29a75b074e tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:02.181580 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a4251402-d7d0-4edc-9ce3-6b29a75b074e tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:02.184740 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a4251402-d7d0-4edc-9ce3-6b29a75b074e tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:02.189362 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a4251402-d7d0-4edc-9ce3-6b29a75b074e tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:02.192347 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a4251402-d7d0-4edc-9ce3-6b29a75b074e tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:02.193012 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a4251402-d7d0-4edc-9ce3-6b29a75b074e tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:02.193609 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a4251402-d7d0-4edc-9ce3-6b29a75b074e tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:02.304159 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-a4251402-d7d0-4edc-9ce3-6b29a75b074e tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] HTTP exception thrown: Cannot 'unshelve' instance 23bbe055-4a92-4b96-8b89-c941229bfb0b while it is in vm_state active Aug 10 23:17:02.307105 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-a4251402-d7d0-4edc-9ce3-6b29a75b074e tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Request method failure captured: Aug 10 23:17:02.307105 n-d-850468-14 devstack@n-api.service[122633]: request: POST /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b/action HTTP/1.1 Aug 10 23:17:02.307105 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:17:02.307105 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:17:02.307105 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:17:02.307105 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 18 Aug 10 23:17:02.307105 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:17:02.307105 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:17:02.307105 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:17:02.307105 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:17:02.307105 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9DuIKrfOsS8tKST0PsIPrvuNPfsVISfOPvUoe9ddkVcTJKj7rDjd3OuH9u-DTT1aypj1AUoUKtajD98eDOUOHSpPisBSdRlSCov30lHf1uZq-XZLyBIVg5kAG8-SuXk2s1TL7EnRcjjMARSkm95dZDnXaBXRT3M4f8UoMDwqu7xK7gQ Aug 10 23:17:02.307105 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:17:02.307105 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:17:02.307105 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:17:02.307105 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:17:02.307105 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:17:02.307105 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:17:02.307105 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: d11bbb3e87f4463787da56ab19108822 Aug 10 23:17:02.307105 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-ServersNegativeTestJSON-1216728002 Aug 10 23:17:02.307105 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:17:02.307105 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:17:02.307105 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d11bbb3e87f4463787da56ab19108822"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d11bbb3e87f4463787da56ab19108822"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d11bbb3e87f4463787da56ab19108822"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d11bbb3e87f4463787da56ab19108822", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:17:02.307105 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-ServersNegativeTestJSON-1216728002 Aug 10 23:17:02.307105 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: d11bbb3e87f4463787da56ab19108822 Aug 10 23:17:02.307105 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1216728002 Aug 10 23:17:02.307105 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-ServersNegativeTestJSON-1216728002-project Aug 10 23:17:02.307105 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:17:02.307105 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:17:02.307105 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: f284ec2a4bf546b58c1c1adaf880e1fb Aug 10 23:17:02.307105 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-ServersNegativeTestJSON-1216728002-project Aug 10 23:17:02.307105 n-d-850468-14 devstack@n-api.service[122633]: Aug 10 23:17:02.307105 n-d-850468-14 devstack@n-api.service[122633]: {"unshelve": null} Aug 10 23:17:02.307105 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:17:02.307105 n-d-850468-14 devstack@n-api.service[122633]: exception: Cannot 'unshelve' instance 23bbe055-4a92-4b96-8b89-c941229bfb0b while it is in vm_state active Aug 10 23:17:02.307105 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': '23bbe055-4a92-4b96-8b89-c941229bfb0b', 'body': {'unshelve': None}} Aug 10 23:17:02.307105 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:17:02.307105 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:17:02.307105 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 124, in _unshelve Aug 10 23:17:02.307105 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve( Aug 10 23:17:02.307105 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Aug 10 23:17:02.307105 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 10 23:17:02.307105 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 10 23:17:02.307105 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 10 23:17:02.307105 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 10 23:17:02.307105 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 10 23:17:02.307105 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 23bbe055-4a92-4b96-8b89-c941229bfb0b in vm_state active. Cannot unshelve while the instance is in this state. Aug 10 23:17:02.307105 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:17:02.307105 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:17:02.307105 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:17:02.307105 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:17:02.307105 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:17:02.307105 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:17:02.307105 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:17:02.307105 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:17:02.307105 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:17:02.307105 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:17:02.307105 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 23:17:02.307105 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 23:17:02.307105 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 23:17:02.307105 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 23:17:02.307105 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 137, in _unshelve Aug 10 23:17:02.307105 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Aug 10 23:17:02.307105 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 10 23:17:02.307105 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 10 23:17:02.312931 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance 23bbe055-4a92-4b96-8b89-c941229bfb0b while it is in vm_state active Aug 10 23:17:02.312931 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:17:02.312931 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:17:02.312931 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:17:02.312931 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:17:02.312931 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:17:02.312931 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:17:02.312931 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:17:02.312931 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:17:02.312931 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance 23bbe055-4a92-4b96-8b89-c941229bfb0b while it is in vm_state active Aug 10 23:17:02.312931 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:17:02.312931 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-a4251402-d7d0-4edc-9ce3-6b29a75b074e tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Returning 409 to user: Cannot 'unshelve' instance 23bbe055-4a92-4b96-8b89-c941229bfb0b while it is in vm_state active {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:17:02.312931 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-a4251402-d7d0-4edc-9ce3-6b29a75b074e tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "POST /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b/action" status: 409 len: 146 microversion: 2.1 time: 0.172455 Aug 10 23:17:02.312931 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2198/4226] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:17:02 2022] POST /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b/action => generated 146 bytes in 174 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 10 23:17:02.328718 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-5a78a75a-08c8-43dc-847d-99b166b11f3b tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82a9184aa6c9405f8534e151e6508335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5049eb227494da1b8b328d8ff28d570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:02.331432 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-b7f1aa9f-04dc-4d9e-a062-298adc272c93 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:02.337405 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-b7f1aa9f-04dc-4d9e-a062-298adc272c93 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:02.341262 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-5a78a75a-08c8-43dc-847d-99b166b11f3b tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '82a9184aa6c9405f8534e151e6508335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5049eb227494da1b8b328d8ff28d570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:02.342765 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-5a78a75a-08c8-43dc-847d-99b166b11f3b tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '82a9184aa6c9405f8534e151e6508335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5049eb227494da1b8b328d8ff28d570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:02.355167 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b7f1aa9f-04dc-4d9e-a062-298adc272c93 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:02.357550 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-5a78a75a-08c8-43dc-847d-99b166b11f3b tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] 10.222.0.58 "GET /compute/v2.1/servers/8410ad7d-396e-45d4-b0a4-92405d95fa8a" status: 200 len: 1320 microversion: 2.26 time: 0.422737 Aug 10 23:17:02.357723 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b7f1aa9f-04dc-4d9e-a062-298adc272c93 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:02.362085 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b7f1aa9f-04dc-4d9e-a062-298adc272c93 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:02.364390 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b7f1aa9f-04dc-4d9e-a062-298adc272c93 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:02.366823 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b7f1aa9f-04dc-4d9e-a062-298adc272c93 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:02.368513 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b7f1aa9f-04dc-4d9e-a062-298adc272c93 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:02.378592 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2029/4227] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:17:01 2022] GET /compute/v2.1/servers/8410ad7d-396e-45d4-b0a4-92405d95fa8a => generated 1320 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:17:02.913802 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-b7f1aa9f-04dc-4d9e-a062-298adc272c93 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:02.935178 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-b7f1aa9f-04dc-4d9e-a062-298adc272c93 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b" status: 200 len: 1506 microversion: 2.1 time: 0.614554 Aug 10 23:17:02.941114 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2199/4228] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:17:02 2022] GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b => generated 1506 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:17:02.957592 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-9d914d82-9a76-48c6-bde9-789127d76265 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:02.958693 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-9d914d82-9a76-48c6-bde9-789127d76265 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] [instance: 250395b5-5be8-420a-8709-dcf8b4241a4e] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:02.980372 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9d914d82-9a76-48c6-bde9-789127d76265 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:02.981275 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9d914d82-9a76-48c6-bde9-789127d76265 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:02.981968 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9d914d82-9a76-48c6-bde9-789127d76265 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:02.982970 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9d914d82-9a76-48c6-bde9-789127d76265 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:02.985826 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9d914d82-9a76-48c6-bde9-789127d76265 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:02.992225 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-41a00ff1-5ff4-45b5-8989-a3014f6875fa req-e5f27b5a-152a-475d-b0e8-4e5fdf08aa2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "250395b5-5be8-420a-8709-dcf8b4241a4e", "tag": "fb6df67c-3dbb-4a0f-98f0-c602e1eaa615"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:17:02.998300 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9d914d82-9a76-48c6-bde9-789127d76265 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:03.021563 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-41a00ff1-5ff4-45b5-8989-a3014f6875fa req-e5f27b5a-152a-475d-b0e8-4e5fdf08aa2b service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:03.026418 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-41a00ff1-5ff4-45b5-8989-a3014f6875fa req-e5f27b5a-152a-475d-b0e8-4e5fdf08aa2b service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:03.030051 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-41a00ff1-5ff4-45b5-8989-a3014f6875fa req-e5f27b5a-152a-475d-b0e8-4e5fdf08aa2b service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:03.079769 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-41a00ff1-5ff4-45b5-8989-a3014f6875fa req-e5f27b5a-152a-475d-b0e8-4e5fdf08aa2b service nova] Creating event network-changed:fb6df67c-3dbb-4a0f-98f0-c602e1eaa615 for instance 250395b5-5be8-420a-8709-dcf8b4241a4e on n-h2-850468-14 Aug 10 23:17:03.097384 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [req-41a00ff1-5ff4-45b5-8989-a3014f6875fa req-e5f27b5a-152a-475d-b0e8-4e5fdf08aa2b service nova] Instance 250395b5-5be8-420a-8709-dcf8b4241a4e is migrating within the same cell, copying events to all relevant hosts: {'n-h1-850468-14', 'n-h2-850468-14'} {{(pid=122632) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5901}} Aug 10 23:17:03.130531 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-41a00ff1-5ff4-45b5-8989-a3014f6875fa req-e5f27b5a-152a-475d-b0e8-4e5fdf08aa2b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.660335 Aug 10 23:17:03.131604 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2030/4229] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:17:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:17:03.143627 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-f8e23ee5-076c-4672-8403-4efa8d48f416 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:03.144342 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-f8e23ee5-076c-4672-8403-4efa8d48f416 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:03.178120 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f8e23ee5-076c-4672-8403-4efa8d48f416 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:03.178689 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f8e23ee5-076c-4672-8403-4efa8d48f416 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:03.179160 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f8e23ee5-076c-4672-8403-4efa8d48f416 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:03.190933 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f8e23ee5-076c-4672-8403-4efa8d48f416 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:03.191986 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f8e23ee5-076c-4672-8403-4efa8d48f416 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:03.193386 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f8e23ee5-076c-4672-8403-4efa8d48f416 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:03.797315 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-f8e23ee5-076c-4672-8403-4efa8d48f416 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:03.836998 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-f8e23ee5-076c-4672-8403-4efa8d48f416 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b" status: 200 len: 1506 microversion: 2.1 time: 0.701199 Aug 10 23:17:03.839215 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2031/4230] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:17:03 2022] GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b => generated 1506 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:17:03.856532 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-3e54b242-5fc1-42e5-80ff-ba734c3a27d8 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:03.859366 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-3e54b242-5fc1-42e5-80ff-ba734c3a27d8 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] [instance: 8410ad7d-396e-45d4-b0a4-92405d95fa8a] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:03.868750 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3e54b242-5fc1-42e5-80ff-ba734c3a27d8 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:03.869460 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3e54b242-5fc1-42e5-80ff-ba734c3a27d8 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:03.870189 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3e54b242-5fc1-42e5-80ff-ba734c3a27d8 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:03.871369 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3e54b242-5fc1-42e5-80ff-ba734c3a27d8 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:03.872259 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3e54b242-5fc1-42e5-80ff-ba734c3a27d8 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:03.875096 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3e54b242-5fc1-42e5-80ff-ba734c3a27d8 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:04.078376 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-3e54b242-5fc1-42e5-80ff-ba734c3a27d8 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82a9184aa6c9405f8534e151e6508335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5049eb227494da1b8b328d8ff28d570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:04.098442 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-3e54b242-5fc1-42e5-80ff-ba734c3a27d8 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '82a9184aa6c9405f8534e151e6508335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5049eb227494da1b8b328d8ff28d570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:04.101824 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-3e54b242-5fc1-42e5-80ff-ba734c3a27d8 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '82a9184aa6c9405f8534e151e6508335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5049eb227494da1b8b328d8ff28d570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:04.103329 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-3e54b242-5fc1-42e5-80ff-ba734c3a27d8 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] 10.222.0.58 "GET /compute/v2.1/servers/8410ad7d-396e-45d4-b0a4-92405d95fa8a" status: 200 len: 1320 microversion: 2.26 time: 0.262902 Aug 10 23:17:04.104104 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2032/4231] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:17:03 2022] GET /compute/v2.1/servers/8410ad7d-396e-45d4-b0a4-92405d95fa8a => generated 1320 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:17:04.110561 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-469915e8-b4b1-40f4-8d58-8540e65db39e tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:04.111432 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-469915e8-b4b1-40f4-8d58-8540e65db39e tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: fa9dfd3a-a636-48ce-ae15-0ed51baee954] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:04.120185 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-469915e8-b4b1-40f4-8d58-8540e65db39e tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:04.121214 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-469915e8-b4b1-40f4-8d58-8540e65db39e tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:04.122538 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-469915e8-b4b1-40f4-8d58-8540e65db39e tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:04.123561 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-469915e8-b4b1-40f4-8d58-8540e65db39e tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:04.124488 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-469915e8-b4b1-40f4-8d58-8540e65db39e tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:04.125365 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-469915e8-b4b1-40f4-8d58-8540e65db39e tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:04.573732 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-469915e8-b4b1-40f4-8d58-8540e65db39e tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:04.586498 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-469915e8-b4b1-40f4-8d58-8540e65db39e tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954" status: 200 len: 1667 microversion: 2.1 time: 0.480345 Aug 10 23:17:04.587143 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2033/4232] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:17:04 2022] GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954 => generated 1667 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:17:04.601870 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-cdc346e4-caad-4666-9bc2-cf357adeef74 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2029833108_updated"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:17:04.609138 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-cdc346e4-caad-4666-9bc2-cf357adeef74 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 42cb3d9e-66eb-4505-8121-1a030ce0db1c] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:04.620619 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-cdc346e4-caad-4666-9bc2-cf357adeef74 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] HTTP exception thrown: Instance 42cb3d9e-66eb-4505-8121-1a030ce0db1c could not be found. Aug 10 23:17:04.626315 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-cdc346e4-caad-4666-9bc2-cf357adeef74 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Request method failure captured: Aug 10 23:17:04.626315 n-d-850468-14 devstack@n-api.service[122632]: request: PUT /compute/v2.1/servers/42cb3d9e-66eb-4505-8121-1a030ce0db1c HTTP/1.1 Aug 10 23:17:04.626315 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:17:04.626315 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:17:04.626315 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:17:04.626315 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 81 Aug 10 23:17:04.626315 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:17:04.626315 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:17:04.626315 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:17:04.626315 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:17:04.626315 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9DuIKrfOsS8tKST0PsIPrvuNPfsVISfOPvUoe9ddkVcTJKj7rDjd3OuH9u-DTT1aypj1AUoUKtajD98eDOUOHSpPisBSdRlSCov30lHf1uZq-XZLyBIVg5kAG8-SuXk2s1TL7EnRcjjMARSkm95dZDnXaBXRT3M4f8UoMDwqu7xK7gQ Aug 10 23:17:04.626315 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:17:04.626315 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:17:04.626315 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:17:04.626315 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:17:04.626315 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:17:04.626315 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:17:04.626315 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: d11bbb3e87f4463787da56ab19108822 Aug 10 23:17:04.626315 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-ServersNegativeTestJSON-1216728002 Aug 10 23:17:04.626315 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:17:04.626315 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:17:04.626315 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d11bbb3e87f4463787da56ab19108822"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d11bbb3e87f4463787da56ab19108822"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d11bbb3e87f4463787da56ab19108822"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d11bbb3e87f4463787da56ab19108822", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:17:04.626315 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-ServersNegativeTestJSON-1216728002 Aug 10 23:17:04.626315 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: d11bbb3e87f4463787da56ab19108822 Aug 10 23:17:04.626315 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1216728002 Aug 10 23:17:04.626315 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-ServersNegativeTestJSON-1216728002-project Aug 10 23:17:04.626315 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:17:04.626315 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:17:04.626315 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: f284ec2a4bf546b58c1c1adaf880e1fb Aug 10 23:17:04.626315 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-ServersNegativeTestJSON-1216728002-project Aug 10 23:17:04.626315 n-d-850468-14 devstack@n-api.service[122632]: Aug 10 23:17:04.626315 n-d-850468-14 devstack@n-api.service[122632]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2029833108_updated"}} Aug 10 23:17:04.626315 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:17:04.626315 n-d-850468-14 devstack@n-api.service[122632]: exception: Instance 42cb3d9e-66eb-4505-8121-1a030ce0db1c could not be found. Aug 10 23:17:04.626315 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': '42cb3d9e-66eb-4505-8121-1a030ce0db1c', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-2029833108_updated'}}} Aug 10 23:17:04.626315 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:17:04.626315 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:17:04.626315 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:17:04.626315 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:17:04.626315 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:17:04.626315 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:17:04.626315 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 10 23:17:04.626315 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 10 23:17:04.626315 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42cb3d9e-66eb-4505-8121-1a030ce0db1c could not be found. Aug 10 23:17:04.626315 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:17:04.626315 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:17:04.626315 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:17:04.626315 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:17:04.626315 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:17:04.626315 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:17:04.626315 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:17:04.626315 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:17:04.626315 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:17:04.626315 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:17:04.626315 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 23:17:04.626315 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 23:17:04.626315 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 23:17:04.626315 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 23:17:04.626315 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 23:17:04.626315 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 23:17:04.626315 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 10 23:17:04.626315 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Aug 10 23:17:04.626315 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Aug 10 23:17:04.626315 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:17:04.631489 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:17:04.631489 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:17:04.631489 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:17:04.631489 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42cb3d9e-66eb-4505-8121-1a030ce0db1c could not be found. Aug 10 23:17:04.631489 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:17:04.631489 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:17:04.631489 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:17:04.631489 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:17:04.631489 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:17:04.631489 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:17:04.631489 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:17:04.631489 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:17:04.631489 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42cb3d9e-66eb-4505-8121-1a030ce0db1c could not be found. Aug 10 23:17:04.631489 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:17:04.640941 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-cdc346e4-caad-4666-9bc2-cf357adeef74 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Returning 404 to user: Instance 42cb3d9e-66eb-4505-8121-1a030ce0db1c could not be found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:17:04.642262 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-cdc346e4-caad-4666-9bc2-cf357adeef74 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "PUT /compute/v2.1/servers/42cb3d9e-66eb-4505-8121-1a030ce0db1c" status: 404 len: 111 microversion: 2.1 time: 0.050969 Aug 10 23:17:04.644951 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2034/4233] 10.222.0.58 () {60 vars in 1256 bytes} [Wed Aug 10 23:17:04 2022] PUT /compute/v2.1/servers/42cb3d9e-66eb-4505-8121-1a030ce0db1c => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:17:04.668867 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c69645f1-13b6-407b-8fba-da38f3142506 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:04.669810 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-c69645f1-13b6-407b-8fba-da38f3142506 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: fa9dfd3a-a636-48ce-ae15-0ed51baee954] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:04.687486 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c69645f1-13b6-407b-8fba-da38f3142506 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:04.688514 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c69645f1-13b6-407b-8fba-da38f3142506 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:04.689128 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c69645f1-13b6-407b-8fba-da38f3142506 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:04.690172 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c69645f1-13b6-407b-8fba-da38f3142506 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:04.690826 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c69645f1-13b6-407b-8fba-da38f3142506 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:04.696209 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c69645f1-13b6-407b-8fba-da38f3142506 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:04.973668 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-c69645f1-13b6-407b-8fba-da38f3142506 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:04.987905 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-c69645f1-13b6-407b-8fba-da38f3142506 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954" status: 200 len: 1667 microversion: 2.1 time: 0.341564 Aug 10 23:17:04.990046 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2035/4234] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:17:04 2022] GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954 => generated 1667 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:17:05.000657 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-9d914d82-9a76-48c6-bde9-789127d76265 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5899b2ad9f1046caaf7c6073e408eeee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25abd63376614081a9d484f3c9ae950d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:05.015613 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-9d914d82-9a76-48c6-bde9-789127d76265 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "GET /compute/v2.1/servers/250395b5-5be8-420a-8709-dcf8b4241a4e" status: 200 len: 1695 microversion: 2.1 time: 2.057434 Aug 10 23:17:05.019040 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-b5d73929-53a9-477e-9f3f-b7f20a20de6b tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:05.019824 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2200/4235] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:17:02 2022] GET /compute/v2.1/servers/250395b5-5be8-420a-8709-dcf8b4241a4e => generated 1695 bytes in 2066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:17:05.022428 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-b5d73929-53a9-477e-9f3f-b7f20a20de6b tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:05.028019 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-00cb0142-abf5-4778-9810-dc987bee8588 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:05.032852 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-00cb0142-abf5-4778-9810-dc987bee8588 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: fa9dfd3a-a636-48ce-ae15-0ed51baee954] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:05.046969 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_api:SELECT=66 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:17:05.049992 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b5d73929-53a9-477e-9f3f-b7f20a20de6b tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:05.050265 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-00cb0142-abf5-4778-9810-dc987bee8588 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:05.050520 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b5d73929-53a9-477e-9f3f-b7f20a20de6b tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:05.052769 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-00cb0142-abf5-4778-9810-dc987bee8588 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:05.053658 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-00cb0142-abf5-4778-9810-dc987bee8588 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:05.054568 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-00cb0142-abf5-4778-9810-dc987bee8588 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:05.056503 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b5d73929-53a9-477e-9f3f-b7f20a20de6b tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:05.057753 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-00cb0142-abf5-4778-9810-dc987bee8588 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:05.058725 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-00cb0142-abf5-4778-9810-dc987bee8588 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:05.059389 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b5d73929-53a9-477e-9f3f-b7f20a20de6b tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:05.061064 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b5d73929-53a9-477e-9f3f-b7f20a20de6b tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:05.064485 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b5d73929-53a9-477e-9f3f-b7f20a20de6b tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:05.622776 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-b5d73929-53a9-477e-9f3f-b7f20a20de6b tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:05.649944 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-b5d73929-53a9-477e-9f3f-b7f20a20de6b tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b" status: 200 len: 1506 microversion: 2.1 time: 0.642095 Aug 10 23:17:05.651298 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2036/4236] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:17:04 2022] GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b => generated 1506 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:17:05.658299 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-75c633f2-ee78-4102-b35a-8458b3eb9fd7 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:05.659243 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-75c633f2-ee78-4102-b35a-8458b3eb9fd7 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] [instance: 8410ad7d-396e-45d4-b0a4-92405d95fa8a] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:05.666742 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-75c633f2-ee78-4102-b35a-8458b3eb9fd7 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:05.667567 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-75c633f2-ee78-4102-b35a-8458b3eb9fd7 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:05.668194 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-75c633f2-ee78-4102-b35a-8458b3eb9fd7 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:05.669355 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-75c633f2-ee78-4102-b35a-8458b3eb9fd7 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:05.672513 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-75c633f2-ee78-4102-b35a-8458b3eb9fd7 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:05.673321 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-75c633f2-ee78-4102-b35a-8458b3eb9fd7 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:05.912088 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-00cb0142-abf5-4778-9810-dc987bee8588 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:05.925877 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-00cb0142-abf5-4778-9810-dc987bee8588 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954" status: 200 len: 1667 microversion: 2.1 time: 0.899957 Aug 10 23:17:05.928291 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2201/4237] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:17:05 2022] GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954 => generated 1667 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:17:05.945746 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-a383c7dd-194e-4c19-9ff5-f2ab3fb584df tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:05.956964 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-a383c7dd-194e-4c19-9ff5-f2ab3fb584df tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:05.986720 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a383c7dd-194e-4c19-9ff5-f2ab3fb584df tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:05.987258 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a383c7dd-194e-4c19-9ff5-f2ab3fb584df tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:05.987703 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a383c7dd-194e-4c19-9ff5-f2ab3fb584df tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:05.993408 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a383c7dd-194e-4c19-9ff5-f2ab3fb584df tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:05.995090 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a383c7dd-194e-4c19-9ff5-f2ab3fb584df tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:05.997617 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a383c7dd-194e-4c19-9ff5-f2ab3fb584df tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:06.229714 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-75c633f2-ee78-4102-b35a-8458b3eb9fd7 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82a9184aa6c9405f8534e151e6508335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5049eb227494da1b8b328d8ff28d570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:06.253457 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-75c633f2-ee78-4102-b35a-8458b3eb9fd7 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '82a9184aa6c9405f8534e151e6508335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5049eb227494da1b8b328d8ff28d570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:06.255555 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-75c633f2-ee78-4102-b35a-8458b3eb9fd7 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '82a9184aa6c9405f8534e151e6508335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5049eb227494da1b8b328d8ff28d570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:06.267625 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-75c633f2-ee78-4102-b35a-8458b3eb9fd7 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] 10.222.0.58 "GET /compute/v2.1/servers/8410ad7d-396e-45d4-b0a4-92405d95fa8a" status: 200 len: 1362 microversion: 2.26 time: 0.606025 Aug 10 23:17:06.269160 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2037/4238] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:17:05 2022] GET /compute/v2.1/servers/8410ad7d-396e-45d4-b0a4-92405d95fa8a => generated 1362 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:17:06.274254 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-0fb1b82c-348d-4311-b1e8-55c0f2f54d09 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:06.275175 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-0fb1b82c-348d-4311-b1e8-55c0f2f54d09 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: fa9dfd3a-a636-48ce-ae15-0ed51baee954] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:06.285499 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0fb1b82c-348d-4311-b1e8-55c0f2f54d09 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:06.286383 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0fb1b82c-348d-4311-b1e8-55c0f2f54d09 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:06.287088 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0fb1b82c-348d-4311-b1e8-55c0f2f54d09 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:06.288238 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0fb1b82c-348d-4311-b1e8-55c0f2f54d09 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:06.288921 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0fb1b82c-348d-4311-b1e8-55c0f2f54d09 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:06.289565 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0fb1b82c-348d-4311-b1e8-55c0f2f54d09 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:06.739690 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-a383c7dd-194e-4c19-9ff5-f2ab3fb584df tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:06.742950 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-0fb1b82c-348d-4311-b1e8-55c0f2f54d09 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:06.749870 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-a383c7dd-194e-4c19-9ff5-f2ab3fb584df tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b" status: 200 len: 1506 microversion: 2.1 time: 0.818062 Aug 10 23:17:06.755067 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2202/4239] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:17:05 2022] GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b => generated 1506 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:17:06.767619 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-93dc2f86-fcf7-46b9-b914-6da3bf3e0584 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:06.768503 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-93dc2f86-fcf7-46b9-b914-6da3bf3e0584 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] [instance: 250395b5-5be8-420a-8709-dcf8b4241a4e] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:06.774626 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-0fb1b82c-348d-4311-b1e8-55c0f2f54d09 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954" status: 200 len: 1667 microversion: 2.1 time: 0.482821 Aug 10 23:17:06.775979 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2038/4240] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:17:06 2022] GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954 => generated 1667 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:17:06.784388 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-93dc2f86-fcf7-46b9-b914-6da3bf3e0584 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:06.791614 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-93dc2f86-fcf7-46b9-b914-6da3bf3e0584 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:06.795565 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-93dc2f86-fcf7-46b9-b914-6da3bf3e0584 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:06.796895 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-93dc2f86-fcf7-46b9-b914-6da3bf3e0584 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:06.799254 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-93dc2f86-fcf7-46b9-b914-6da3bf3e0584 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:06.799995 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-93dc2f86-fcf7-46b9-b914-6da3bf3e0584 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:06.810628 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-eb8cd707-a39a-4405-870b-287f4b5f608c tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:17:06.815695 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-eb8cd707-a39a-4405-870b-287f4b5f608c tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Request method failure captured: Aug 10 23:17:06.815695 n-d-850468-14 devstack@n-api.service[122632]: request: PUT /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b HTTP/1.1 Aug 10 23:17:06.815695 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:17:06.815695 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:17:06.815695 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:17:06.815695 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 280 Aug 10 23:17:06.815695 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:17:06.815695 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:17:06.815695 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:17:06.815695 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:17:06.815695 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9DuIKrfOsS8tKST0PsIPrvuNPfsVISfOPvUoe9ddkVcTJKj7rDjd3OuH9u-DTT1aypj1AUoUKtajD98eDOUOHSpPisBSdRlSCov30lHf1uZq-XZLyBIVg5kAG8-SuXk2s1TL7EnRcjjMARSkm95dZDnXaBXRT3M4f8UoMDwqu7xK7gQ Aug 10 23:17:06.815695 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:17:06.815695 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:17:06.815695 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:17:06.815695 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:17:06.815695 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:17:06.815695 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:17:06.815695 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: d11bbb3e87f4463787da56ab19108822 Aug 10 23:17:06.815695 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-ServersNegativeTestJSON-1216728002 Aug 10 23:17:06.815695 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:17:06.815695 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:17:06.815695 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d11bbb3e87f4463787da56ab19108822"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d11bbb3e87f4463787da56ab19108822"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d11bbb3e87f4463787da56ab19108822"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d11bbb3e87f4463787da56ab19108822", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:17:06.815695 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-ServersNegativeTestJSON-1216728002 Aug 10 23:17:06.815695 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: d11bbb3e87f4463787da56ab19108822 Aug 10 23:17:06.815695 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1216728002 Aug 10 23:17:06.815695 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-ServersNegativeTestJSON-1216728002-project Aug 10 23:17:06.815695 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:17:06.815695 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:17:06.815695 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: f284ec2a4bf546b58c1c1adaf880e1fb Aug 10 23:17:06.815695 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-ServersNegativeTestJSON-1216728002-project Aug 10 23:17:06.815695 n-d-850468-14 devstack@n-api.service[122632]: Aug 10 23:17:06.815695 n-d-850468-14 devstack@n-api.service[122632]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Aug 10 23:17:06.815695 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:17:06.815695 n-d-850468-14 devstack@n-api.service[122632]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 10 23:17:06.815695 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': '23bbe055-4a92-4b96-8b89-c941229bfb0b', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Aug 10 23:17:06.815695 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:17:06.815695 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:17:06.815695 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 10 23:17:06.815695 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 10 23:17:06.815695 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 10 23:17:06.815695 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise error Aug 10 23:17:06.815695 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 10 23:17:06.815695 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:17:06.815695 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Aug 10 23:17:06.815695 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 10 23:17:06.815695 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:17:06.815695 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 10 23:17:06.815695 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 10 23:17:06.815695 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:17:06.815695 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:17:06.815695 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:17:06.815695 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:17:06.819427 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:17:06.819427 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:17:06.819427 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:17:06.819427 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:17:06.819427 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:17:06.819427 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:17:06.819427 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 23:17:06.819427 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 23:17:06.819427 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 10 23:17:06.819427 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 10 23:17:06.819427 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 10 23:17:06.819427 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 10 23:17:06.819427 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 10 23:17:06.819427 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 10 23:17:06.819427 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 10 23:17:06.819427 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:17:06.819427 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:17:06.819427 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:17:06.819427 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:17:06.819427 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:17:06.819427 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:17:06.819427 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 10 23:17:06.819427 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 10 23:17:06.819427 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 10 23:17:06.819427 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:17:06.825197 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-eb8cd707-a39a-4405-870b-287f4b5f608c tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:17:06.826650 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-eb8cd707-a39a-4405-870b-287f4b5f608c tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "PUT /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b" status: 400 len: 619 microversion: 2.1 time: 0.046081 Aug 10 23:17:06.828029 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2039/4241] 10.222.0.58 () {60 vars in 1257 bytes} [Wed Aug 10 23:17:06 2022] PUT /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b => generated 619 bytes in 48 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 10 23:17:06.837628 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-e348d7ca-4dc5-4aed-a55e-51e3dfbd315b tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:06.838660 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-e348d7ca-4dc5-4aed-a55e-51e3dfbd315b tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:06.848281 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e348d7ca-4dc5-4aed-a55e-51e3dfbd315b tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:06.849170 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e348d7ca-4dc5-4aed-a55e-51e3dfbd315b tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:06.850147 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e348d7ca-4dc5-4aed-a55e-51e3dfbd315b tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:06.851419 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e348d7ca-4dc5-4aed-a55e-51e3dfbd315b tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:06.852108 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e348d7ca-4dc5-4aed-a55e-51e3dfbd315b tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:06.852757 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e348d7ca-4dc5-4aed-a55e-51e3dfbd315b tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:07.170589 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-e348d7ca-4dc5-4aed-a55e-51e3dfbd315b tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:07.185034 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-e348d7ca-4dc5-4aed-a55e-51e3dfbd315b tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b" status: 200 len: 1506 microversion: 2.1 time: 0.352064 Aug 10 23:17:07.207196 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2040/4242] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:17:06 2022] GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b => generated 1506 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:17:07.215044 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-1e4ae9c7-ab50-4cef-83ea-4ebbbe11e2ca tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1170395931", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452", "networks": [{"uuid": "9e4068f0-b1bd-443a-a951-7f332436087d"}]}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:17:07.295047 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.network.neutron [None req-1e4ae9c7-ab50-4cef-83ea-4ebbbe11e2ca tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] validate_networks() for [('9e4068f0-b1bd-443a-a951-7f332436087d', None, None, None, None, None)] {{(pid=122632) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 23:17:07.316473 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-93dc2f86-fcf7-46b9-b914-6da3bf3e0584 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5899b2ad9f1046caaf7c6073e408eeee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25abd63376614081a9d484f3c9ae950d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:07.326445 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-93dc2f86-fcf7-46b9-b914-6da3bf3e0584 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "GET /compute/v2.1/servers/250395b5-5be8-420a-8709-dcf8b4241a4e" status: 200 len: 1690 microversion: 2.1 time: 0.569373 Aug 10 23:17:07.328114 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2203/4243] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:17:06 2022] GET /compute/v2.1/servers/250395b5-5be8-420a-8709-dcf8b4241a4e => generated 1690 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:17:07.337059 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-dc45c4e5-6096-4ffe-b62d-3cfbfb57b232 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:07.337675 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-dc45c4e5-6096-4ffe-b62d-3cfbfb57b232 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:07.362897 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dc45c4e5-6096-4ffe-b62d-3cfbfb57b232 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:07.363650 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dc45c4e5-6096-4ffe-b62d-3cfbfb57b232 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:07.364239 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dc45c4e5-6096-4ffe-b62d-3cfbfb57b232 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:07.366818 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dc45c4e5-6096-4ffe-b62d-3cfbfb57b232 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:07.367476 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dc45c4e5-6096-4ffe-b62d-3cfbfb57b232 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:07.368073 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dc45c4e5-6096-4ffe-b62d-3cfbfb57b232 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:07.721847 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-dc45c4e5-6096-4ffe-b62d-3cfbfb57b232 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:07.738370 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-dc45c4e5-6096-4ffe-b62d-3cfbfb57b232 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b" status: 200 len: 1506 microversion: 2.1 time: 0.406539 Aug 10 23:17:07.744847 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2204/4244] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:17:07 2022] GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b => generated 1506 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:17:07.751777 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-17fe7b78-8bba-4424-91df-451146ce03df tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:07.752625 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-17fe7b78-8bba-4424-91df-451146ce03df tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] [instance: 8410ad7d-396e-45d4-b0a4-92405d95fa8a] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:07.760826 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-17fe7b78-8bba-4424-91df-451146ce03df tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:07.761541 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-17fe7b78-8bba-4424-91df-451146ce03df tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:07.762142 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-17fe7b78-8bba-4424-91df-451146ce03df tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:07.763703 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-17fe7b78-8bba-4424-91df-451146ce03df tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:07.764320 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-17fe7b78-8bba-4424-91df-451146ce03df tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:07.765746 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-17fe7b78-8bba-4424-91df-451146ce03df tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:08.206672 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-1e4ae9c7-ab50-4cef-83ea-4ebbbe11e2ca tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Flavor limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:17:08.207399 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-1e4ae9c7-ab50-4cef-83ea-4ebbbe11e2ca tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Image limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:17:08.208023 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-1e4ae9c7-ab50-4cef-83ea-4ebbbe11e2ca tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Flavor pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:17:08.208441 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-1e4ae9c7-ab50-4cef-83ea-4ebbbe11e2ca tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Image pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:17:08.208858 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-1e4ae9c7-ab50-4cef-83ea-4ebbbe11e2ca tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:17:08.231798 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1e4ae9c7-ab50-4cef-83ea-4ebbbe11e2ca tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:08.232354 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1e4ae9c7-ab50-4cef-83ea-4ebbbe11e2ca tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:08.232797 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1e4ae9c7-ab50-4cef-83ea-4ebbbe11e2ca tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:08.234150 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1e4ae9c7-ab50-4cef-83ea-4ebbbe11e2ca tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:08.234844 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1e4ae9c7-ab50-4cef-83ea-4ebbbe11e2ca tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:08.239271 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1e4ae9c7-ab50-4cef-83ea-4ebbbe11e2ca tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:08.272729 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-1e4ae9c7-ab50-4cef-83ea-4ebbbe11e2ca tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Getting quotas for project 1eb12683ada249bfa2ca7bf5cf730ca3. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:17:08.281502 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-1e4ae9c7-ab50-4cef-83ea-4ebbbe11e2ca tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Getting quotas for user 2ea96841d5b64d2390d18b3eb5da8b73 and project 1eb12683ada249bfa2ca7bf5cf730ca3. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:17:08.303059 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-1e4ae9c7-ab50-4cef-83ea-4ebbbe11e2ca tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Going to run 1 instances... {{(pid=122632) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 23:17:08.305977 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-1e4ae9c7-ab50-4cef-83ea-4ebbbe11e2ca tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: 0a5d7302-9eab-4c27-9a4b-7c705e06c290] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78ad8905-f66f-4733-8be9-2b260f1fabed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122632) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 23:17:08.387419 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-17fe7b78-8bba-4424-91df-451146ce03df tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82a9184aa6c9405f8534e151e6508335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5049eb227494da1b8b328d8ff28d570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:08.387591 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-1e4ae9c7-ab50-4cef-83ea-4ebbbe11e2ca tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.183107 Aug 10 23:17:08.388075 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2041/4245] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 23:17:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 1184 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 23:17:08.399721 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-17fe7b78-8bba-4424-91df-451146ce03df tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '82a9184aa6c9405f8534e151e6508335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5049eb227494da1b8b328d8ff28d570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:08.401041 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-a0f29ac0-57aa-43f1-877e-e08ec96fad30 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:17:08.404476 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-17fe7b78-8bba-4424-91df-451146ce03df tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '82a9184aa6c9405f8534e151e6508335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5049eb227494da1b8b328d8ff28d570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:08.408797 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-17fe7b78-8bba-4424-91df-451146ce03df tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] 10.222.0.58 "GET /compute/v2.1/servers/8410ad7d-396e-45d4-b0a4-92405d95fa8a" status: 200 len: 1362 microversion: 2.26 time: 0.661910 Aug 10 23:17:08.423587 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-a0f29ac0-57aa-43f1-877e-e08ec96fad30 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] [instance: 250395b5-5be8-420a-8709-dcf8b4241a4e] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:08.428150 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a0f29ac0-57aa-43f1-877e-e08ec96fad30 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:08.429360 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2205/4246] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:17:07 2022] GET /compute/v2.1/servers/8410ad7d-396e-45d4-b0a4-92405d95fa8a => generated 1362 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:17:08.431550 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a0f29ac0-57aa-43f1-877e-e08ec96fad30 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:08.433659 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a0f29ac0-57aa-43f1-877e-e08ec96fad30 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:08.434597 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a0f29ac0-57aa-43f1-877e-e08ec96fad30 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:08.434999 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-0c921415-86ab-4a70-a1df-a39b89f98d8f tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:17:08.435609 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a0f29ac0-57aa-43f1-877e-e08ec96fad30 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:08.436616 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a0f29ac0-57aa-43f1-877e-e08ec96fad30 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:08.449239 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-0c921415-86ab-4a70-a1df-a39b89f98d8f tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Request method failure captured: Aug 10 23:17:08.449239 n-d-850468-14 devstack@n-api.service[122633]: request: PUT /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b HTTP/1.1 Aug 10 23:17:08.449239 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:17:08.449239 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:17:08.449239 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:17:08.449239 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 24 Aug 10 23:17:08.449239 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:17:08.449239 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:17:08.449239 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:17:08.449239 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:17:08.449239 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9DuIKrfOsS8tKST0PsIPrvuNPfsVISfOPvUoe9ddkVcTJKj7rDjd3OuH9u-DTT1aypj1AUoUKtajD98eDOUOHSpPisBSdRlSCov30lHf1uZq-XZLyBIVg5kAG8-SuXk2s1TL7EnRcjjMARSkm95dZDnXaBXRT3M4f8UoMDwqu7xK7gQ Aug 10 23:17:08.449239 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:17:08.449239 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:17:08.449239 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:17:08.449239 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:17:08.449239 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:17:08.449239 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:17:08.449239 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: d11bbb3e87f4463787da56ab19108822 Aug 10 23:17:08.449239 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-ServersNegativeTestJSON-1216728002 Aug 10 23:17:08.449239 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:17:08.449239 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:17:08.449239 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d11bbb3e87f4463787da56ab19108822"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d11bbb3e87f4463787da56ab19108822"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d11bbb3e87f4463787da56ab19108822"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d11bbb3e87f4463787da56ab19108822", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:17:08.449239 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-ServersNegativeTestJSON-1216728002 Aug 10 23:17:08.449239 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: d11bbb3e87f4463787da56ab19108822 Aug 10 23:17:08.449239 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1216728002 Aug 10 23:17:08.449239 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-ServersNegativeTestJSON-1216728002-project Aug 10 23:17:08.449239 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:17:08.449239 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:17:08.449239 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: f284ec2a4bf546b58c1c1adaf880e1fb Aug 10 23:17:08.449239 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-ServersNegativeTestJSON-1216728002-project Aug 10 23:17:08.449239 n-d-850468-14 devstack@n-api.service[122633]: Aug 10 23:17:08.449239 n-d-850468-14 devstack@n-api.service[122633]: {"server": {"name": ""}} Aug 10 23:17:08.449239 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:17:08.449239 n-d-850468-14 devstack@n-api.service[122633]: exception: Invalid input for field/attribute name. Value: . '' is too short Aug 10 23:17:08.449239 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': '23bbe055-4a92-4b96-8b89-c941229bfb0b', 'body': {'server': {'name': ''}}} Aug 10 23:17:08.449239 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:17:08.449239 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:17:08.449239 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 10 23:17:08.449239 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 10 23:17:08.449239 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 10 23:17:08.449239 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise error Aug 10 23:17:08.449239 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 10 23:17:08.449239 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:17:08.449239 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Aug 10 23:17:08.449239 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 10 23:17:08.449239 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:17:08.449239 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 10 23:17:08.449239 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi '' Aug 10 23:17:08.449239 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:17:08.449239 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:17:08.449239 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:17:08.449239 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:17:08.449239 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:17:08.449239 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:17:08.449239 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:17:08.449239 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:17:08.449239 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:17:08.449239 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:17:08.449239 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 23:17:08.449239 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 23:17:08.449239 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 10 23:17:08.449239 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 10 23:17:08.449239 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 10 23:17:08.449239 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 10 23:17:08.449239 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 10 23:17:08.449239 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 10 23:17:08.453946 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Aug 10 23:17:08.453946 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:17:08.453946 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:17:08.453946 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:17:08.453946 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:17:08.453946 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:17:08.453946 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:17:08.453946 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 10 23:17:08.453946 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 10 23:17:08.453946 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Aug 10 23:17:08.453946 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:17:08.453946 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-0c921415-86ab-4a70-a1df-a39b89f98d8f tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:17:08.453946 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-0c921415-86ab-4a70-a1df-a39b89f98d8f tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "PUT /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b" status: 400 len: 108 microversion: 2.1 time: 0.020450 Aug 10 23:17:08.456853 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2206/4247] 10.222.0.58 () {60 vars in 1256 bytes} [Wed Aug 10 23:17:08 2022] PUT /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b => generated 108 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 10 23:17:08.465545 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-72e574a0-05ee-4cd3-82a8-b70eb001d792 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:08.466171 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-72e574a0-05ee-4cd3-82a8-b70eb001d792 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: 0a5d7302-9eab-4c27-9a4b-7c705e06c290] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:08.654360 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-a0f29ac0-57aa-43f1-877e-e08ec96fad30 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "POST /compute/v2.1/servers/250395b5-5be8-420a-8709-dcf8b4241a4e/action" status: 202 len: 0 microversion: 2.1 time: 0.258808 Aug 10 23:17:08.655694 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2042/4248] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:17:08 2022] POST /compute/v2.1/servers/250395b5-5be8-420a-8709-dcf8b4241a4e/action => generated 0 bytes in 261 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:17:08.662799 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-72e574a0-05ee-4cd3-82a8-b70eb001d792 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:08.673324 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-72e574a0-05ee-4cd3-82a8-b70eb001d792 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/0a5d7302-9eab-4c27-9a4b-7c705e06c290" status: 200 len: 1215 microversion: 2.1 time: 0.215330 Aug 10 23:17:08.677253 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2207/4249] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:17:08 2022] GET /compute/v2.1/servers/0a5d7302-9eab-4c27-9a4b-7c705e06c290 => generated 1215 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:17:08.685086 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-3e6ed26c-8949-4fdc-bcb9-8d1fd4335a2b tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:08.690401 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-3e6ed26c-8949-4fdc-bcb9-8d1fd4335a2b tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:08.714464 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3e6ed26c-8949-4fdc-bcb9-8d1fd4335a2b tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:08.716457 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3e6ed26c-8949-4fdc-bcb9-8d1fd4335a2b tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:08.717113 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3e6ed26c-8949-4fdc-bcb9-8d1fd4335a2b tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:08.719516 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3e6ed26c-8949-4fdc-bcb9-8d1fd4335a2b tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:08.721473 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3e6ed26c-8949-4fdc-bcb9-8d1fd4335a2b tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:08.722088 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3e6ed26c-8949-4fdc-bcb9-8d1fd4335a2b tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:08.969835 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-909890fc-a073-4f32-92f3-c6afe70c61de req-397ac324-771e-4e7e-a05b-e01f44e60104 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8410ad7d-396e-45d4-b0a4-92405d95fa8a", "tag": "ccf7cb63-ddd1-4364-82f5-56de3ab3892c"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:17:08.982110 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-909890fc-a073-4f32-92f3-c6afe70c61de req-397ac324-771e-4e7e-a05b-e01f44e60104 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:08.982926 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-909890fc-a073-4f32-92f3-c6afe70c61de req-397ac324-771e-4e7e-a05b-e01f44e60104 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:08.986152 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-909890fc-a073-4f32-92f3-c6afe70c61de req-397ac324-771e-4e7e-a05b-e01f44e60104 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:09.025175 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-909890fc-a073-4f32-92f3-c6afe70c61de req-397ac324-771e-4e7e-a05b-e01f44e60104 service nova] Creating event network-changed:ccf7cb63-ddd1-4364-82f5-56de3ab3892c for instance 8410ad7d-396e-45d4-b0a4-92405d95fa8a on n-h2-850468-14 Aug 10 23:17:09.042374 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-909890fc-a073-4f32-92f3-c6afe70c61de req-397ac324-771e-4e7e-a05b-e01f44e60104 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.361559 Aug 10 23:17:09.043472 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2208/4250] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:17:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:17:09.063255 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-b69b832f-801d-44a0-8724-395631210a10 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:09.064782 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-b69b832f-801d-44a0-8724-395631210a10 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] [instance: 250395b5-5be8-420a-8709-dcf8b4241a4e] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:09.074353 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b69b832f-801d-44a0-8724-395631210a10 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:09.076006 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b69b832f-801d-44a0-8724-395631210a10 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:09.076656 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b69b832f-801d-44a0-8724-395631210a10 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:09.078315 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b69b832f-801d-44a0-8724-395631210a10 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:09.079323 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b69b832f-801d-44a0-8724-395631210a10 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:09.079951 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b69b832f-801d-44a0-8724-395631210a10 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:09.284374 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-3e6ed26c-8949-4fdc-bcb9-8d1fd4335a2b tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:09.298095 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-3e6ed26c-8949-4fdc-bcb9-8d1fd4335a2b tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b" status: 200 len: 1506 microversion: 2.1 time: 0.638712 Aug 10 23:17:09.299608 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2043/4251] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:17:08 2022] GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b => generated 1506 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:17:09.439441 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-3a2897a6-f25b-4c23-b872-41d9a2e6ac02 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:09.440420 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-3a2897a6-f25b-4c23-b872-41d9a2e6ac02 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] [instance: 8410ad7d-396e-45d4-b0a4-92405d95fa8a] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:09.458336 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3a2897a6-f25b-4c23-b872-41d9a2e6ac02 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:09.463274 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3a2897a6-f25b-4c23-b872-41d9a2e6ac02 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:09.465765 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3a2897a6-f25b-4c23-b872-41d9a2e6ac02 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:09.473562 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3a2897a6-f25b-4c23-b872-41d9a2e6ac02 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:09.474319 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3a2897a6-f25b-4c23-b872-41d9a2e6ac02 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:09.475909 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3a2897a6-f25b-4c23-b872-41d9a2e6ac02 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:09.869823 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-b69b832f-801d-44a0-8724-395631210a10 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5899b2ad9f1046caaf7c6073e408eeee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25abd63376614081a9d484f3c9ae950d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:09.884899 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-b69b832f-801d-44a0-8724-395631210a10 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "GET /compute/v2.1/servers/250395b5-5be8-420a-8709-dcf8b4241a4e" status: 200 len: 1689 microversion: 2.1 time: 0.835102 Aug 10 23:17:09.887003 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2209/4252] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:17:09 2022] GET /compute/v2.1/servers/250395b5-5be8-420a-8709-dcf8b4241a4e => generated 1689 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:17:09.901822 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-ff2a058d-3239-43f0-b41a-dab9abddb4dd req-2765c864-5b43-4dc7-986d-2c1df2f5e28b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "250395b5-5be8-420a-8709-dcf8b4241a4e", "name": "network-vif-plugged", "status": "completed", "tag": "fb6df67c-3dbb-4a0f-98f0-c602e1eaa615"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:17:09.944400 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-ff2a058d-3239-43f0-b41a-dab9abddb4dd req-2765c864-5b43-4dc7-986d-2c1df2f5e28b service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:09.944781 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-ff2a058d-3239-43f0-b41a-dab9abddb4dd req-2765c864-5b43-4dc7-986d-2c1df2f5e28b service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:09.947098 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-ff2a058d-3239-43f0-b41a-dab9abddb4dd req-2765c864-5b43-4dc7-986d-2c1df2f5e28b service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:09.991911 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-ff2a058d-3239-43f0-b41a-dab9abddb4dd req-2765c864-5b43-4dc7-986d-2c1df2f5e28b service nova] Creating event network-vif-plugged:fb6df67c-3dbb-4a0f-98f0-c602e1eaa615 for instance 250395b5-5be8-420a-8709-dcf8b4241a4e on n-h2-850468-14 Aug 10 23:17:10.015682 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [req-ff2a058d-3239-43f0-b41a-dab9abddb4dd req-2765c864-5b43-4dc7-986d-2c1df2f5e28b service nova] Instance 250395b5-5be8-420a-8709-dcf8b4241a4e is migrating within the same cell, copying events to all relevant hosts: {'n-h1-850468-14', 'n-h2-850468-14'} {{(pid=122633) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5901}} Aug 10 23:17:10.043778 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-ff2a058d-3239-43f0-b41a-dab9abddb4dd req-2765c864-5b43-4dc7-986d-2c1df2f5e28b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.154574 Aug 10 23:17:10.049737 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2210/4253] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:17:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:17:10.064132 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-5ef6769f-57ed-475e-b372-dc09b47c8a48 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:10.065011 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-5ef6769f-57ed-475e-b372-dc09b47c8a48 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: 0a5d7302-9eab-4c27-9a4b-7c705e06c290] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:10.077306 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5ef6769f-57ed-475e-b372-dc09b47c8a48 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:10.081103 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5ef6769f-57ed-475e-b372-dc09b47c8a48 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:10.081574 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5ef6769f-57ed-475e-b372-dc09b47c8a48 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:10.082610 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5ef6769f-57ed-475e-b372-dc09b47c8a48 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:10.083114 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5ef6769f-57ed-475e-b372-dc09b47c8a48 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:10.083555 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5ef6769f-57ed-475e-b372-dc09b47c8a48 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:10.251130 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-5ef6769f-57ed-475e-b372-dc09b47c8a48 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:10.261256 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-5ef6769f-57ed-475e-b372-dc09b47c8a48 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/0a5d7302-9eab-4c27-9a4b-7c705e06c290" status: 200 len: 1267 microversion: 2.1 time: 0.209627 Aug 10 23:17:10.268015 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2211/4254] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:17:10 2022] GET /compute/v2.1/servers/0a5d7302-9eab-4c27-9a4b-7c705e06c290 => generated 1267 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:17:10.607813 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-3a2897a6-f25b-4c23-b872-41d9a2e6ac02 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82a9184aa6c9405f8534e151e6508335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5049eb227494da1b8b328d8ff28d570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:10.651193 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-3a2897a6-f25b-4c23-b872-41d9a2e6ac02 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '82a9184aa6c9405f8534e151e6508335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5049eb227494da1b8b328d8ff28d570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:10.661347 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-3a2897a6-f25b-4c23-b872-41d9a2e6ac02 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '82a9184aa6c9405f8534e151e6508335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5049eb227494da1b8b328d8ff28d570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:10.690292 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-3a2897a6-f25b-4c23-b872-41d9a2e6ac02 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] 10.222.0.58 "GET /compute/v2.1/servers/8410ad7d-396e-45d4-b0a4-92405d95fa8a" status: 200 len: 1362 microversion: 2.26 time: 1.256071 Aug 10 23:17:10.703699 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2044/4255] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:17:09 2022] GET /compute/v2.1/servers/8410ad7d-396e-45d4-b0a4-92405d95fa8a => generated 1362 bytes in 1270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:17:10.912719 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-7c7f5f27-0085-44b6-9e39-3190f8908303 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:10.913359 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-7c7f5f27-0085-44b6-9e39-3190f8908303 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] [instance: 250395b5-5be8-420a-8709-dcf8b4241a4e] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:10.924660 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7c7f5f27-0085-44b6-9e39-3190f8908303 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:10.925164 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7c7f5f27-0085-44b6-9e39-3190f8908303 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:10.925599 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7c7f5f27-0085-44b6-9e39-3190f8908303 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:10.926309 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7c7f5f27-0085-44b6-9e39-3190f8908303 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:10.926757 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7c7f5f27-0085-44b6-9e39-3190f8908303 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:10.927206 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7c7f5f27-0085-44b6-9e39-3190f8908303 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:11.248340 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-7c7f5f27-0085-44b6-9e39-3190f8908303 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5899b2ad9f1046caaf7c6073e408eeee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25abd63376614081a9d484f3c9ae950d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:11.278132 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-7c7f5f27-0085-44b6-9e39-3190f8908303 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "GET /compute/v2.1/servers/250395b5-5be8-420a-8709-dcf8b4241a4e" status: 200 len: 1689 microversion: 2.1 time: 0.369191 Aug 10 23:17:11.281497 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2212/4256] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:17:10 2022] GET /compute/v2.1/servers/250395b5-5be8-420a-8709-dcf8b4241a4e => generated 1689 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:17:11.307694 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-b2cd29ef-ac98-4667-9535-42aa86f5eb40 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:11.308498 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-b2cd29ef-ac98-4667-9535-42aa86f5eb40 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: 0a5d7302-9eab-4c27-9a4b-7c705e06c290] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:11.337269 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b2cd29ef-ac98-4667-9535-42aa86f5eb40 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:11.338040 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b2cd29ef-ac98-4667-9535-42aa86f5eb40 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:11.339892 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b2cd29ef-ac98-4667-9535-42aa86f5eb40 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:11.341747 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b2cd29ef-ac98-4667-9535-42aa86f5eb40 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:11.345565 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b2cd29ef-ac98-4667-9535-42aa86f5eb40 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:11.347225 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b2cd29ef-ac98-4667-9535-42aa86f5eb40 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:11.620820 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-b2cd29ef-ac98-4667-9535-42aa86f5eb40 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:11.623329 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:17:11.651341 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-b2cd29ef-ac98-4667-9535-42aa86f5eb40 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/0a5d7302-9eab-4c27-9a4b-7c705e06c290" status: 200 len: 1273 microversion: 2.1 time: 0.348482 Aug 10 23:17:11.670041 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2045/4257] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:17:11 2022] GET /compute/v2.1/servers/0a5d7302-9eab-4c27-9a4b-7c705e06c290 => generated 1273 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:17:11.736193 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-79274bc4-10b7-47ee-bf34-4d0633c3d880 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:11.737940 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-79274bc4-10b7-47ee-bf34-4d0633c3d880 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] [instance: 8410ad7d-396e-45d4-b0a4-92405d95fa8a] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:11.754340 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-79274bc4-10b7-47ee-bf34-4d0633c3d880 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:11.755170 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-79274bc4-10b7-47ee-bf34-4d0633c3d880 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:11.757592 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-79274bc4-10b7-47ee-bf34-4d0633c3d880 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:11.762079 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-79274bc4-10b7-47ee-bf34-4d0633c3d880 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:11.762715 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-79274bc4-10b7-47ee-bf34-4d0633c3d880 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:11.763491 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-79274bc4-10b7-47ee-bf34-4d0633c3d880 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:12.307051 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-1c8f7c88-1730-4b22-8c5c-ca7946422a17 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:12.307923 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-1c8f7c88-1730-4b22-8c5c-ca7946422a17 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] [instance: 250395b5-5be8-420a-8709-dcf8b4241a4e] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:12.328349 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1c8f7c88-1730-4b22-8c5c-ca7946422a17 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:12.329102 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1c8f7c88-1730-4b22-8c5c-ca7946422a17 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:12.339816 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1c8f7c88-1730-4b22-8c5c-ca7946422a17 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:12.340963 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1c8f7c88-1730-4b22-8c5c-ca7946422a17 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:12.341610 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1c8f7c88-1730-4b22-8c5c-ca7946422a17 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:12.342208 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1c8f7c88-1730-4b22-8c5c-ca7946422a17 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:12.819838 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-79274bc4-10b7-47ee-bf34-4d0633c3d880 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82a9184aa6c9405f8534e151e6508335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5049eb227494da1b8b328d8ff28d570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:12.832813 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-79274bc4-10b7-47ee-bf34-4d0633c3d880 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '82a9184aa6c9405f8534e151e6508335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5049eb227494da1b8b328d8ff28d570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:12.841338 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-79274bc4-10b7-47ee-bf34-4d0633c3d880 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '82a9184aa6c9405f8534e151e6508335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5049eb227494da1b8b328d8ff28d570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:12.845082 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-79274bc4-10b7-47ee-bf34-4d0633c3d880 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] 10.222.0.58 "GET /compute/v2.1/servers/8410ad7d-396e-45d4-b0a4-92405d95fa8a" status: 200 len: 1362 microversion: 2.26 time: 1.128896 Aug 10 23:17:12.851709 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2213/4258] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:17:11 2022] GET /compute/v2.1/servers/8410ad7d-396e-45d4-b0a4-92405d95fa8a => generated 1362 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:17:12.863089 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-e142cfd1-23a6-43e4-89d0-d8a1c223fe25 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:12.863713 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-e142cfd1-23a6-43e4-89d0-d8a1c223fe25 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: 0a5d7302-9eab-4c27-9a4b-7c705e06c290] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:12.884169 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e142cfd1-23a6-43e4-89d0-d8a1c223fe25 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:12.885720 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e142cfd1-23a6-43e4-89d0-d8a1c223fe25 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:12.887549 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e142cfd1-23a6-43e4-89d0-d8a1c223fe25 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:12.890277 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e142cfd1-23a6-43e4-89d0-d8a1c223fe25 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:12.891253 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e142cfd1-23a6-43e4-89d0-d8a1c223fe25 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:12.892767 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e142cfd1-23a6-43e4-89d0-d8a1c223fe25 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:12.903025 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-1c8f7c88-1730-4b22-8c5c-ca7946422a17 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5899b2ad9f1046caaf7c6073e408eeee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25abd63376614081a9d484f3c9ae950d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:12.932959 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-1c8f7c88-1730-4b22-8c5c-ca7946422a17 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "GET /compute/v2.1/servers/250395b5-5be8-420a-8709-dcf8b4241a4e" status: 200 len: 1689 microversion: 2.1 time: 0.628598 Aug 10 23:17:12.935049 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2046/4259] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:17:12 2022] GET /compute/v2.1/servers/250395b5-5be8-420a-8709-dcf8b4241a4e => generated 1689 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:17:13.667145 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-e142cfd1-23a6-43e4-89d0-d8a1c223fe25 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:13.681306 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-e142cfd1-23a6-43e4-89d0-d8a1c223fe25 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/0a5d7302-9eab-4c27-9a4b-7c705e06c290" status: 200 len: 1315 microversion: 2.1 time: 0.828101 Aug 10 23:17:13.683105 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2214/4260] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:17:12 2022] GET /compute/v2.1/servers/0a5d7302-9eab-4c27-9a4b-7c705e06c290 => generated 1315 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:17:13.875441 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-5c869d53-0bcf-4a0a-a275-309eb087892d tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:13.876317 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-5c869d53-0bcf-4a0a-a275-309eb087892d tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] [instance: 8410ad7d-396e-45d4-b0a4-92405d95fa8a] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:13.887895 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5c869d53-0bcf-4a0a-a275-309eb087892d tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:13.888393 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5c869d53-0bcf-4a0a-a275-309eb087892d tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:13.888830 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5c869d53-0bcf-4a0a-a275-309eb087892d tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:13.889585 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5c869d53-0bcf-4a0a-a275-309eb087892d tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:13.890041 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5c869d53-0bcf-4a0a-a275-309eb087892d tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:13.890464 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5c869d53-0bcf-4a0a-a275-309eb087892d tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:13.963918 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-d61d3bee-02fb-440a-b3e2-3e4a97764979 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:13.965252 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-d61d3bee-02fb-440a-b3e2-3e4a97764979 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] [instance: 250395b5-5be8-420a-8709-dcf8b4241a4e] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:13.988635 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d61d3bee-02fb-440a-b3e2-3e4a97764979 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:13.993364 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d61d3bee-02fb-440a-b3e2-3e4a97764979 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:13.993602 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d61d3bee-02fb-440a-b3e2-3e4a97764979 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:14.007191 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d61d3bee-02fb-440a-b3e2-3e4a97764979 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:14.008015 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d61d3bee-02fb-440a-b3e2-3e4a97764979 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:14.008656 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d61d3bee-02fb-440a-b3e2-3e4a97764979 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:14.056299 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=100 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:17:14.371841 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-d61d3bee-02fb-440a-b3e2-3e4a97764979 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5899b2ad9f1046caaf7c6073e408eeee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25abd63376614081a9d484f3c9ae950d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:14.385985 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-d61d3bee-02fb-440a-b3e2-3e4a97764979 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "GET /compute/v2.1/servers/250395b5-5be8-420a-8709-dcf8b4241a4e" status: 200 len: 1689 microversion: 2.1 time: 0.430210 Aug 10 23:17:14.386708 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2215/4261] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:17:13 2022] GET /compute/v2.1/servers/250395b5-5be8-420a-8709-dcf8b4241a4e => generated 1689 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:17:14.425383 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-5c869d53-0bcf-4a0a-a275-309eb087892d tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82a9184aa6c9405f8534e151e6508335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5049eb227494da1b8b328d8ff28d570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:14.440979 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-5c869d53-0bcf-4a0a-a275-309eb087892d tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '82a9184aa6c9405f8534e151e6508335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5049eb227494da1b8b328d8ff28d570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:14.444876 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-5c869d53-0bcf-4a0a-a275-309eb087892d tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '82a9184aa6c9405f8534e151e6508335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5049eb227494da1b8b328d8ff28d570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:14.458505 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-5c869d53-0bcf-4a0a-a275-309eb087892d tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] 10.222.0.58 "GET /compute/v2.1/servers/8410ad7d-396e-45d4-b0a4-92405d95fa8a" status: 200 len: 1362 microversion: 2.26 time: 0.588740 Aug 10 23:17:14.463460 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2047/4262] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:17:13 2022] GET /compute/v2.1/servers/8410ad7d-396e-45d4-b0a4-92405d95fa8a => generated 1362 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:17:14.706442 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-b4a6124f-e1d0-408f-8df7-4146ef6b7e17 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:14.707104 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-b4a6124f-e1d0-408f-8df7-4146ef6b7e17 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: 0a5d7302-9eab-4c27-9a4b-7c705e06c290] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:14.721891 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b4a6124f-e1d0-408f-8df7-4146ef6b7e17 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:14.723322 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b4a6124f-e1d0-408f-8df7-4146ef6b7e17 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:14.724588 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b4a6124f-e1d0-408f-8df7-4146ef6b7e17 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:14.727085 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b4a6124f-e1d0-408f-8df7-4146ef6b7e17 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:14.728331 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b4a6124f-e1d0-408f-8df7-4146ef6b7e17 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:14.741111 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b4a6124f-e1d0-408f-8df7-4146ef6b7e17 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:15.409034 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-067ad075-c2e9-4716-8e2b-7b362268bd24 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:15.409647 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-067ad075-c2e9-4716-8e2b-7b362268bd24 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] [instance: 250395b5-5be8-420a-8709-dcf8b4241a4e] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:15.419309 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-067ad075-c2e9-4716-8e2b-7b362268bd24 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:15.419916 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-067ad075-c2e9-4716-8e2b-7b362268bd24 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:15.421386 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-067ad075-c2e9-4716-8e2b-7b362268bd24 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:15.422282 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-067ad075-c2e9-4716-8e2b-7b362268bd24 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:15.422741 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-067ad075-c2e9-4716-8e2b-7b362268bd24 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:15.431488 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-067ad075-c2e9-4716-8e2b-7b362268bd24 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:15.772542 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-b4a6124f-e1d0-408f-8df7-4146ef6b7e17 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:15.788650 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-b4a6124f-e1d0-408f-8df7-4146ef6b7e17 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/0a5d7302-9eab-4c27-9a4b-7c705e06c290" status: 200 len: 1315 microversion: 2.1 time: 1.087575 Aug 10 23:17:15.789446 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2216/4263] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:17:14 2022] GET /compute/v2.1/servers/0a5d7302-9eab-4c27-9a4b-7c705e06c290 => generated 1315 bytes in 1089 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:17:15.821191 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-f4c5e28a-b150-4ec8-ae5d-be2387b93800 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d632d4af-1e58-4001-8d46-0d8419f7033e"}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:17:15.832056 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-f4c5e28a-b150-4ec8-ae5d-be2387b93800 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] [instance: 3ecbcf63-5592-4074-a3f7-d2caf3c58969] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:15.858590 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f4c5e28a-b150-4ec8-ae5d-be2387b93800 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:15.859104 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f4c5e28a-b150-4ec8-ae5d-be2387b93800 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:15.859550 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f4c5e28a-b150-4ec8-ae5d-be2387b93800 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:15.860288 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f4c5e28a-b150-4ec8-ae5d-be2387b93800 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:15.860780 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f4c5e28a-b150-4ec8-ae5d-be2387b93800 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:15.861159 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f4c5e28a-b150-4ec8-ae5d-be2387b93800 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:16.068948 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-067ad075-c2e9-4716-8e2b-7b362268bd24 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5899b2ad9f1046caaf7c6073e408eeee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25abd63376614081a9d484f3c9ae950d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:16.087877 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-067ad075-c2e9-4716-8e2b-7b362268bd24 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "GET /compute/v2.1/servers/250395b5-5be8-420a-8709-dcf8b4241a4e" status: 200 len: 1689 microversion: 2.1 time: 0.682386 Aug 10 23:17:16.107302 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2048/4264] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:17:15 2022] GET /compute/v2.1/servers/250395b5-5be8-420a-8709-dcf8b4241a4e => generated 1689 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:17:16.115012 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-9430d022-72d7-495d-b0f2-4a254717da7b tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:16.115635 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-9430d022-72d7-495d-b0f2-4a254717da7b tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] [instance: 8410ad7d-396e-45d4-b0a4-92405d95fa8a] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:16.164258 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9430d022-72d7-495d-b0f2-4a254717da7b tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:16.167459 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9430d022-72d7-495d-b0f2-4a254717da7b tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:16.173572 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9430d022-72d7-495d-b0f2-4a254717da7b tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:16.176000 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9430d022-72d7-495d-b0f2-4a254717da7b tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:16.177147 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9430d022-72d7-495d-b0f2-4a254717da7b tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:16.180541 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9430d022-72d7-495d-b0f2-4a254717da7b tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:16.634643 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-f4c5e28a-b150-4ec8-ae5d-be2387b93800 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] 10.222.0.58 "POST /compute/v2.1/servers/3ecbcf63-5592-4074-a3f7-d2caf3c58969/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.844005 Aug 10 23:17:16.640945 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2217/4265] 10.222.0.58 () {60 vars in 1323 bytes} [Wed Aug 10 23:17:15 2022] POST /compute/v2.1/servers/3ecbcf63-5592-4074-a3f7-d2caf3c58969/os-volume_attachments => generated 194 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:17:16.660486 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-f2d03f41-a2ba-4beb-bf8c-0def579763a5 req-45e43f73-0a2a-45ff-a8e8-c2b12c322dc8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a5d7302-9eab-4c27-9a4b-7c705e06c290", "tag": "b753ef0a-169a-496f-ba6e-46e3a214c4f8"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:17:16.689275 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-f2d03f41-a2ba-4beb-bf8c-0def579763a5 req-45e43f73-0a2a-45ff-a8e8-c2b12c322dc8 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:16.697815 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-f2d03f41-a2ba-4beb-bf8c-0def579763a5 req-45e43f73-0a2a-45ff-a8e8-c2b12c322dc8 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:16.698996 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-f2d03f41-a2ba-4beb-bf8c-0def579763a5 req-45e43f73-0a2a-45ff-a8e8-c2b12c322dc8 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:16.739748 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-f2d03f41-a2ba-4beb-bf8c-0def579763a5 req-45e43f73-0a2a-45ff-a8e8-c2b12c322dc8 service nova] Creating event network-changed:b753ef0a-169a-496f-ba6e-46e3a214c4f8 for instance 0a5d7302-9eab-4c27-9a4b-7c705e06c290 on n-h1-850468-14 Aug 10 23:17:16.757967 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-f2d03f41-a2ba-4beb-bf8c-0def579763a5 req-45e43f73-0a2a-45ff-a8e8-c2b12c322dc8 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110884 Aug 10 23:17:16.759156 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2218/4266] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:17:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:17:16.815942 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-e00c450f-4a89-4d04-ad20-84bb629a8f6d tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:16.816941 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-e00c450f-4a89-4d04-ad20-84bb629a8f6d tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: 0a5d7302-9eab-4c27-9a4b-7c705e06c290] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:16.828314 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e00c450f-4a89-4d04-ad20-84bb629a8f6d tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:16.829122 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e00c450f-4a89-4d04-ad20-84bb629a8f6d tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:16.829738 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e00c450f-4a89-4d04-ad20-84bb629a8f6d tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:16.830623 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e00c450f-4a89-4d04-ad20-84bb629a8f6d tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:16.831279 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e00c450f-4a89-4d04-ad20-84bb629a8f6d tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:16.832200 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e00c450f-4a89-4d04-ad20-84bb629a8f6d tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:17.150647 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-9430d022-72d7-495d-b0f2-4a254717da7b tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82a9184aa6c9405f8534e151e6508335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5049eb227494da1b8b328d8ff28d570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:17.169445 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-9430d022-72d7-495d-b0f2-4a254717da7b tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '82a9184aa6c9405f8534e151e6508335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5049eb227494da1b8b328d8ff28d570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:17.176456 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-9430d022-72d7-495d-b0f2-4a254717da7b tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '82a9184aa6c9405f8534e151e6508335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5049eb227494da1b8b328d8ff28d570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:17.183718 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-9430d022-72d7-495d-b0f2-4a254717da7b tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] 10.222.0.58 "GET /compute/v2.1/servers/8410ad7d-396e-45d4-b0a4-92405d95fa8a" status: 200 len: 1362 microversion: 2.26 time: 1.078511 Aug 10 23:17:17.184236 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2049/4267] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:17:16 2022] GET /compute/v2.1/servers/8410ad7d-396e-45d4-b0a4-92405d95fa8a => generated 1362 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:17:17.206728 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-2ad6aad2-e93a-4ddb-a09d-dab70aa5afd5 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:17.207406 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-2ad6aad2-e93a-4ddb-a09d-dab70aa5afd5 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] [instance: 250395b5-5be8-420a-8709-dcf8b4241a4e] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:17.232967 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2ad6aad2-e93a-4ddb-a09d-dab70aa5afd5 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:17.233348 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2ad6aad2-e93a-4ddb-a09d-dab70aa5afd5 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:17.238263 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2ad6aad2-e93a-4ddb-a09d-dab70aa5afd5 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:17.239351 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2ad6aad2-e93a-4ddb-a09d-dab70aa5afd5 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:17.241659 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2ad6aad2-e93a-4ddb-a09d-dab70aa5afd5 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:17.242535 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2ad6aad2-e93a-4ddb-a09d-dab70aa5afd5 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:17.320122 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-e00c450f-4a89-4d04-ad20-84bb629a8f6d tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:17.332173 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-e00c450f-4a89-4d04-ad20-84bb629a8f6d tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/0a5d7302-9eab-4c27-9a4b-7c705e06c290" status: 200 len: 1315 microversion: 2.1 time: 0.520643 Aug 10 23:17:17.346308 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2219/4268] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:17:16 2022] GET /compute/v2.1/servers/0a5d7302-9eab-4c27-9a4b-7c705e06c290 => generated 1315 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:17:17.675073 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-51c143fe-724d-46b7-a352-2eb977128b7b req-318ffebc-9a7e-48d2-ac8d-50b9c4e8ce92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8410ad7d-396e-45d4-b0a4-92405d95fa8a", "name": "network-vif-plugged", "status": "completed", "tag": "ccf7cb63-ddd1-4364-82f5-56de3ab3892c"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:17:17.702415 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-51c143fe-724d-46b7-a352-2eb977128b7b req-318ffebc-9a7e-48d2-ac8d-50b9c4e8ce92 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:17.721896 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-51c143fe-724d-46b7-a352-2eb977128b7b req-318ffebc-9a7e-48d2-ac8d-50b9c4e8ce92 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:17.722487 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-51c143fe-724d-46b7-a352-2eb977128b7b req-318ffebc-9a7e-48d2-ac8d-50b9c4e8ce92 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:17.772802 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-51c143fe-724d-46b7-a352-2eb977128b7b req-318ffebc-9a7e-48d2-ac8d-50b9c4e8ce92 service nova] Creating event network-vif-plugged:ccf7cb63-ddd1-4364-82f5-56de3ab3892c for instance 8410ad7d-396e-45d4-b0a4-92405d95fa8a on n-h2-850468-14 Aug 10 23:17:17.806760 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-51c143fe-724d-46b7-a352-2eb977128b7b req-318ffebc-9a7e-48d2-ac8d-50b9c4e8ce92 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121379 Aug 10 23:17:17.815140 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2220/4269] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:17:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:17:18.212779 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-6b543f54-a63e-41e7-a350-4fcc3ff4d48d tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:18.213526 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-6b543f54-a63e-41e7-a350-4fcc3ff4d48d tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] [instance: 8410ad7d-396e-45d4-b0a4-92405d95fa8a] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:18.226657 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6b543f54-a63e-41e7-a350-4fcc3ff4d48d tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:18.233684 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6b543f54-a63e-41e7-a350-4fcc3ff4d48d tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:18.238627 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-2ad6aad2-e93a-4ddb-a09d-dab70aa5afd5 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5899b2ad9f1046caaf7c6073e408eeee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25abd63376614081a9d484f3c9ae950d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:18.246271 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6b543f54-a63e-41e7-a350-4fcc3ff4d48d tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:18.247068 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6b543f54-a63e-41e7-a350-4fcc3ff4d48d tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:18.247535 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6b543f54-a63e-41e7-a350-4fcc3ff4d48d tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:18.247967 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6b543f54-a63e-41e7-a350-4fcc3ff4d48d tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:18.250678 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-2ad6aad2-e93a-4ddb-a09d-dab70aa5afd5 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "GET /compute/v2.1/servers/250395b5-5be8-420a-8709-dcf8b4241a4e" status: 200 len: 1689 microversion: 2.1 time: 1.065345 Aug 10 23:17:18.279208 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2050/4270] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:17:17 2022] GET /compute/v2.1/servers/250395b5-5be8-420a-8709-dcf8b4241a4e => generated 1689 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:17:18.353409 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-563b4f34-7216-4947-b80b-086a73b08ec1 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:18.354281 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-563b4f34-7216-4947-b80b-086a73b08ec1 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: 0a5d7302-9eab-4c27-9a4b-7c705e06c290] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:18.356417 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=4 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:17:18.361545 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=12 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:17:18.384142 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-563b4f34-7216-4947-b80b-086a73b08ec1 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:18.387433 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-563b4f34-7216-4947-b80b-086a73b08ec1 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:18.395521 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-563b4f34-7216-4947-b80b-086a73b08ec1 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:18.399404 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-563b4f34-7216-4947-b80b-086a73b08ec1 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:18.400075 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-563b4f34-7216-4947-b80b-086a73b08ec1 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:18.400700 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-563b4f34-7216-4947-b80b-086a73b08ec1 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:18.668349 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=4 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:17:18.745811 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-6b543f54-a63e-41e7-a350-4fcc3ff4d48d tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82a9184aa6c9405f8534e151e6508335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5049eb227494da1b8b328d8ff28d570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:18.762606 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-6b543f54-a63e-41e7-a350-4fcc3ff4d48d tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '82a9184aa6c9405f8534e151e6508335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5049eb227494da1b8b328d8ff28d570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:18.765474 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-6b543f54-a63e-41e7-a350-4fcc3ff4d48d tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '82a9184aa6c9405f8534e151e6508335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5049eb227494da1b8b328d8ff28d570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:18.766951 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-6b543f54-a63e-41e7-a350-4fcc3ff4d48d tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] 10.222.0.58 "GET /compute/v2.1/servers/8410ad7d-396e-45d4-b0a4-92405d95fa8a" status: 200 len: 1362 microversion: 2.26 time: 0.559249 Aug 10 23:17:18.770460 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2221/4271] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:17:18 2022] GET /compute/v2.1/servers/8410ad7d-396e-45d4-b0a4-92405d95fa8a => generated 1362 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 23:17:18.802760 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-d4ba8976-3208-4b48-9f5c-0eb72b9c95cc req-003ffdcd-2599-453c-96ff-3d3cc2e0c02c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "250395b5-5be8-420a-8709-dcf8b4241a4e", "name": "network-vif-unplugged", "status": "completed", "tag": "fb6df67c-3dbb-4a0f-98f0-c602e1eaa615"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:17:18.828144 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-d4ba8976-3208-4b48-9f5c-0eb72b9c95cc req-003ffdcd-2599-453c-96ff-3d3cc2e0c02c service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:18.828733 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-d4ba8976-3208-4b48-9f5c-0eb72b9c95cc req-003ffdcd-2599-453c-96ff-3d3cc2e0c02c service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:18.847299 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-d4ba8976-3208-4b48-9f5c-0eb72b9c95cc req-003ffdcd-2599-453c-96ff-3d3cc2e0c02c service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:18.893880 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-d4ba8976-3208-4b48-9f5c-0eb72b9c95cc req-003ffdcd-2599-453c-96ff-3d3cc2e0c02c service nova] Creating event network-vif-unplugged:fb6df67c-3dbb-4a0f-98f0-c602e1eaa615 for instance 250395b5-5be8-420a-8709-dcf8b4241a4e on n-h1-850468-14 Aug 10 23:17:18.911127 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [req-d4ba8976-3208-4b48-9f5c-0eb72b9c95cc req-003ffdcd-2599-453c-96ff-3d3cc2e0c02c service nova] Instance 250395b5-5be8-420a-8709-dcf8b4241a4e is migrating within the same cell, copying events to all relevant hosts: {'n-h1-850468-14', 'n-h2-850468-14'} {{(pid=122633) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5901}} Aug 10 23:17:18.933618 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-d4ba8976-3208-4b48-9f5c-0eb72b9c95cc req-003ffdcd-2599-453c-96ff-3d3cc2e0c02c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.134767 Aug 10 23:17:18.937897 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2222/4272] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:17:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 23:17:19.281210 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-a22ad415-8207-4035-9fc6-7672e0ead26b tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:19.281912 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-a22ad415-8207-4035-9fc6-7672e0ead26b tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] [instance: 250395b5-5be8-420a-8709-dcf8b4241a4e] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:19.299695 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a22ad415-8207-4035-9fc6-7672e0ead26b tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:19.300489 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a22ad415-8207-4035-9fc6-7672e0ead26b tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:19.301119 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a22ad415-8207-4035-9fc6-7672e0ead26b tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:19.306090 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a22ad415-8207-4035-9fc6-7672e0ead26b tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:19.306820 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a22ad415-8207-4035-9fc6-7672e0ead26b tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:19.308036 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a22ad415-8207-4035-9fc6-7672e0ead26b tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:19.357369 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-563b4f34-7216-4947-b80b-086a73b08ec1 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:19.392029 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-563b4f34-7216-4947-b80b-086a73b08ec1 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/0a5d7302-9eab-4c27-9a4b-7c705e06c290" status: 200 len: 1315 microversion: 2.1 time: 1.036705 Aug 10 23:17:19.395812 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2051/4273] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:17:18 2022] GET /compute/v2.1/servers/0a5d7302-9eab-4c27-9a4b-7c705e06c290 => generated 1315 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:17:19.805320 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-bf535cc1-522b-4e3c-bc0e-67cadba1eb1e tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:19.806124 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-bf535cc1-522b-4e3c-bc0e-67cadba1eb1e tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] [instance: 8410ad7d-396e-45d4-b0a4-92405d95fa8a] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:19.832650 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bf535cc1-522b-4e3c-bc0e-67cadba1eb1e tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:19.834031 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bf535cc1-522b-4e3c-bc0e-67cadba1eb1e tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:19.836901 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bf535cc1-522b-4e3c-bc0e-67cadba1eb1e tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:19.840693 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bf535cc1-522b-4e3c-bc0e-67cadba1eb1e tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:19.842020 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bf535cc1-522b-4e3c-bc0e-67cadba1eb1e tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:19.843414 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bf535cc1-522b-4e3c-bc0e-67cadba1eb1e tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:19.916314 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-a22ad415-8207-4035-9fc6-7672e0ead26b tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5899b2ad9f1046caaf7c6073e408eeee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25abd63376614081a9d484f3c9ae950d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:19.925616 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-a22ad415-8207-4035-9fc6-7672e0ead26b tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "GET /compute/v2.1/servers/250395b5-5be8-420a-8709-dcf8b4241a4e" status: 200 len: 1689 microversion: 2.1 time: 0.649989 Aug 10 23:17:19.940673 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2223/4274] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:17:19 2022] GET /compute/v2.1/servers/250395b5-5be8-420a-8709-dcf8b4241a4e => generated 1689 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:17:20.419046 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-4365ad62-5204-484a-9908-005ac23d2cce tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:20.420757 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-4365ad62-5204-484a-9908-005ac23d2cce tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: 0a5d7302-9eab-4c27-9a4b-7c705e06c290] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:20.440139 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4365ad62-5204-484a-9908-005ac23d2cce tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:20.440813 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4365ad62-5204-484a-9908-005ac23d2cce tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:20.444495 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4365ad62-5204-484a-9908-005ac23d2cce tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:20.445278 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4365ad62-5204-484a-9908-005ac23d2cce tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:20.445751 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4365ad62-5204-484a-9908-005ac23d2cce tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:20.446190 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4365ad62-5204-484a-9908-005ac23d2cce tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:20.725047 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-4365ad62-5204-484a-9908-005ac23d2cce tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:20.749769 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-4365ad62-5204-484a-9908-005ac23d2cce tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/0a5d7302-9eab-4c27-9a4b-7c705e06c290" status: 200 len: 1315 microversion: 2.1 time: 0.333276 Aug 10 23:17:20.755510 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2224/4275] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:17:20 2022] GET /compute/v2.1/servers/0a5d7302-9eab-4c27-9a4b-7c705e06c290 => generated 1315 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:17:20.960457 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c2123992-c594-4979-9f81-ac4f337dd4e9 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:20.961343 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-c2123992-c594-4979-9f81-ac4f337dd4e9 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] [instance: 250395b5-5be8-420a-8709-dcf8b4241a4e] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:20.968376 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-bf535cc1-522b-4e3c-bc0e-67cadba1eb1e tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82a9184aa6c9405f8534e151e6508335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5049eb227494da1b8b328d8ff28d570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:20.972848 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c2123992-c594-4979-9f81-ac4f337dd4e9 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:20.973617 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c2123992-c594-4979-9f81-ac4f337dd4e9 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:20.974292 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c2123992-c594-4979-9f81-ac4f337dd4e9 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:20.985168 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-bf535cc1-522b-4e3c-bc0e-67cadba1eb1e tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '82a9184aa6c9405f8534e151e6508335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5049eb227494da1b8b328d8ff28d570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:20.986358 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c2123992-c594-4979-9f81-ac4f337dd4e9 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:20.987342 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c2123992-c594-4979-9f81-ac4f337dd4e9 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:20.987630 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-bf535cc1-522b-4e3c-bc0e-67cadba1eb1e tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '82a9184aa6c9405f8534e151e6508335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5049eb227494da1b8b328d8ff28d570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:20.988265 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c2123992-c594-4979-9f81-ac4f337dd4e9 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:20.988974 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-bf535cc1-522b-4e3c-bc0e-67cadba1eb1e tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] 10.222.0.58 "GET /compute/v2.1/servers/8410ad7d-396e-45d4-b0a4-92405d95fa8a" status: 200 len: 1547 microversion: 2.26 time: 1.193011 Aug 10 23:17:21.008893 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2052/4276] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:17:19 2022] GET /compute/v2.1/servers/8410ad7d-396e-45d4-b0a4-92405d95fa8a => generated 1547 bytes in 1213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 23:17:21.022197 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-f639420a-d3d3-4a5d-a518-10b1a30f23ac tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Calling method '.version_select at 0x7f847d055040>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:21.033440 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:17:21.062279 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f639420a-d3d3-4a5d-a518-10b1a30f23ac tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:21.068419 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f639420a-d3d3-4a5d-a518-10b1a30f23ac tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:21.069121 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f639420a-d3d3-4a5d-a518-10b1a30f23ac tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:21.070352 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-f639420a-d3d3-4a5d-a518-10b1a30f23ac tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] [instance: 8410ad7d-396e-45d4-b0a4-92405d95fa8a] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:21.093469 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f639420a-d3d3-4a5d-a518-10b1a30f23ac tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:21.094340 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f639420a-d3d3-4a5d-a518-10b1a30f23ac tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:21.094985 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f639420a-d3d3-4a5d-a518-10b1a30f23ac tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:21.095889 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f639420a-d3d3-4a5d-a518-10b1a30f23ac tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:21.097980 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f639420a-d3d3-4a5d-a518-10b1a30f23ac tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:21.098720 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f639420a-d3d3-4a5d-a518-10b1a30f23ac tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:21.190009 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f639420a-d3d3-4a5d-a518-10b1a30f23ac tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:21.191036 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f639420a-d3d3-4a5d-a518-10b1a30f23ac tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:21.192532 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f639420a-d3d3-4a5d-a518-10b1a30f23ac tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:21.213351 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f639420a-d3d3-4a5d-a518-10b1a30f23ac tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:21.228881 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f639420a-d3d3-4a5d-a518-10b1a30f23ac tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:21.230229 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f639420a-d3d3-4a5d-a518-10b1a30f23ac tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:21.283819 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.objects.instance [None req-f639420a-d3d3-4a5d-a518-10b1a30f23ac tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lazy-loading 'flavor' on Instance uuid 8410ad7d-396e-45d4-b0a4-92405d95fa8a {{(pid=122632) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:17:21.315289 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-f639420a-d3d3-4a5d-a518-10b1a30f23ac tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] 10.222.0.58 "PUT /compute/v2.1/servers/8410ad7d-396e-45d4-b0a4-92405d95fa8a/tags/tempest-tag-895354713" status: 201 len: 0 microversion: 2.26 time: 0.298141 Aug 10 23:17:21.329117 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2053/4277] 10.222.0.58 () {62 vars in 1377 bytes} [Wed Aug 10 23:17:21 2022] PUT /compute/v2.1/servers/8410ad7d-396e-45d4-b0a4-92405d95fa8a/tags/tempest-tag-895354713 => generated 0 bytes in 309 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Aug 10 23:17:21.337588 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-393102c8-5291-4d70-ac4c-22bd7a1ce6a2 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Calling method '.version_select at 0x7f847d24b280>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:21.359540 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-393102c8-5291-4d70-ac4c-22bd7a1ce6a2 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:21.362532 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-393102c8-5291-4d70-ac4c-22bd7a1ce6a2 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:21.364114 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-393102c8-5291-4d70-ac4c-22bd7a1ce6a2 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:21.394548 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-393102c8-5291-4d70-ac4c-22bd7a1ce6a2 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] 10.222.0.58 "GET /compute/v2.1/servers/8410ad7d-396e-45d4-b0a4-92405d95fa8a/tags/tempest-tag-895354713" status: 204 len: 0 microversion: 2.26 time: 0.064039 Aug 10 23:17:21.397961 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2054/4278] 10.222.0.58 () {60 vars in 1358 bytes} [Wed Aug 10 23:17:21 2022] GET /compute/v2.1/servers/8410ad7d-396e-45d4-b0a4-92405d95fa8a/tags/tempest-tag-895354713 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 10 23:17:21.413511 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c4403f69-6fa2-4483-b1aa-d9206f6da188 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:21.414361 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-c4403f69-6fa2-4483-b1aa-d9206f6da188 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 6dc592cb-94c7-4918-8103-023db604fd70] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:21.430072 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c4403f69-6fa2-4483-b1aa-d9206f6da188 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:21.434392 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-c2123992-c594-4979-9f81-ac4f337dd4e9 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5899b2ad9f1046caaf7c6073e408eeee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25abd63376614081a9d484f3c9ae950d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:21.435280 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c4403f69-6fa2-4483-b1aa-d9206f6da188 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:21.435808 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c4403f69-6fa2-4483-b1aa-d9206f6da188 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:21.437177 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c4403f69-6fa2-4483-b1aa-d9206f6da188 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:21.437635 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c4403f69-6fa2-4483-b1aa-d9206f6da188 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:21.438062 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c4403f69-6fa2-4483-b1aa-d9206f6da188 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:21.447282 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-c2123992-c594-4979-9f81-ac4f337dd4e9 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "GET /compute/v2.1/servers/250395b5-5be8-420a-8709-dcf8b4241a4e" status: 200 len: 1689 microversion: 2.1 time: 0.491025 Aug 10 23:17:21.451651 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2225/4279] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:17:20 2022] GET /compute/v2.1/servers/250395b5-5be8-420a-8709-dcf8b4241a4e => generated 1689 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:17:21.465174 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-f9c716f0-2b24-4154-8529-99d3945b083a tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Calling method '.version_select at 0x7f847cf8e040>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:21.476556 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-c4403f69-6fa2-4483-b1aa-d9206f6da188 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] HTTP exception thrown: Instance 6dc592cb-94c7-4918-8103-023db604fd70 could not be found. Aug 10 23:17:21.483020 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c4403f69-6fa2-4483-b1aa-d9206f6da188 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Request method failure captured: Aug 10 23:17:21.483020 n-d-850468-14 devstack@n-api.service[122632]: request: DELETE /compute/v2.1/servers/6dc592cb-94c7-4918-8103-023db604fd70 HTTP/1.1 Aug 10 23:17:21.483020 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:17:21.483020 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:17:21.483020 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:17:21.483020 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 23:17:21.483020 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:17:21.483020 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:17:21.483020 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:17:21.483020 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:17:21.483020 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9DuIKrfOsS8tKST0PsIPrvuNPfsVISfOPvUoe9ddkVcTJKj7rDjd3OuH9u-DTT1aypj1AUoUKtajD98eDOUOHSpPisBSdRlSCov30lHf1uZq-XZLyBIVg5kAG8-SuXk2s1TL7EnRcjjMARSkm95dZDnXaBXRT3M4f8UoMDwqu7xK7gQ Aug 10 23:17:21.483020 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:17:21.483020 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:17:21.483020 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:17:21.483020 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:17:21.483020 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:17:21.483020 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:17:21.483020 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: d11bbb3e87f4463787da56ab19108822 Aug 10 23:17:21.483020 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-ServersNegativeTestJSON-1216728002 Aug 10 23:17:21.483020 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:17:21.483020 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:17:21.483020 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d11bbb3e87f4463787da56ab19108822"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d11bbb3e87f4463787da56ab19108822"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d11bbb3e87f4463787da56ab19108822"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d11bbb3e87f4463787da56ab19108822", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:17:21.483020 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-ServersNegativeTestJSON-1216728002 Aug 10 23:17:21.483020 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: d11bbb3e87f4463787da56ab19108822 Aug 10 23:17:21.483020 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1216728002 Aug 10 23:17:21.483020 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-ServersNegativeTestJSON-1216728002-project Aug 10 23:17:21.483020 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:17:21.483020 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:17:21.483020 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: f284ec2a4bf546b58c1c1adaf880e1fb Aug 10 23:17:21.483020 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-ServersNegativeTestJSON-1216728002-project Aug 10 23:17:21.483020 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:17:21.483020 n-d-850468-14 devstack@n-api.service[122632]: exception: Instance 6dc592cb-94c7-4918-8103-023db604fd70 could not be found. Aug 10 23:17:21.483020 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': '6dc592cb-94c7-4918-8103-023db604fd70'} Aug 10 23:17:21.483020 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:17:21.483020 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:17:21.483020 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:17:21.483020 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:17:21.483020 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:17:21.483020 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:17:21.483020 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:17:21.483020 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:17:21.483020 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:17:21.483020 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:17:21.483020 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6dc592cb-94c7-4918-8103-023db604fd70 could not be found. Aug 10 23:17:21.483020 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:17:21.483020 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:17:21.483020 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:17:21.483020 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:17:21.483020 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:17:21.483020 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:17:21.483020 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:17:21.483020 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:17:21.483020 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:17:21.483020 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:17:21.483020 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 23:17:21.483020 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 23:17:21.483020 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 23:17:21.483020 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 23:17:21.483020 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:17:21.483020 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:17:21.483020 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:17:21.483020 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:17:21.488491 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6dc592cb-94c7-4918-8103-023db604fd70 could not be found. Aug 10 23:17:21.488491 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:17:21.488491 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:17:21.488491 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:17:21.488491 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:17:21.488491 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:17:21.488491 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:17:21.488491 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:17:21.488491 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:17:21.488491 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6dc592cb-94c7-4918-8103-023db604fd70 could not be found. Aug 10 23:17:21.488491 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:17:21.489375 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f9c716f0-2b24-4154-8529-99d3945b083a tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:21.489375 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f9c716f0-2b24-4154-8529-99d3945b083a tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:21.489375 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f9c716f0-2b24-4154-8529-99d3945b083a tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:21.489375 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-f9c716f0-2b24-4154-8529-99d3945b083a tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] [instance: 8410ad7d-396e-45d4-b0a4-92405d95fa8a] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:21.494754 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c4403f69-6fa2-4483-b1aa-d9206f6da188 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Returning 404 to user: Instance 6dc592cb-94c7-4918-8103-023db604fd70 could not be found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:17:21.494754 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-c4403f69-6fa2-4483-b1aa-d9206f6da188 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "DELETE /compute/v2.1/servers/6dc592cb-94c7-4918-8103-023db604fd70" status: 404 len: 111 microversion: 2.1 time: 0.090411 Aug 10 23:17:21.494754 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2055/4280] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:17:21 2022] DELETE /compute/v2.1/servers/6dc592cb-94c7-4918-8103-023db604fd70 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:17:21.507836 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-d5443d67-ce6d-4798-be5e-e39b79780a42 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:21.512086 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-d5443d67-ce6d-4798-be5e-e39b79780a42 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 6dc592cb-94c7-4918-8103-023db604fd70] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:21.534824 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f9c716f0-2b24-4154-8529-99d3945b083a tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:21.534824 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f9c716f0-2b24-4154-8529-99d3945b083a tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:21.534824 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f9c716f0-2b24-4154-8529-99d3945b083a tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:21.535161 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f9c716f0-2b24-4154-8529-99d3945b083a tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:21.535616 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f9c716f0-2b24-4154-8529-99d3945b083a tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:21.543738 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d5443d67-ce6d-4798-be5e-e39b79780a42 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:21.544225 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d5443d67-ce6d-4798-be5e-e39b79780a42 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:21.544658 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d5443d67-ce6d-4798-be5e-e39b79780a42 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:21.545546 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f9c716f0-2b24-4154-8529-99d3945b083a tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:21.546600 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d5443d67-ce6d-4798-be5e-e39b79780a42 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:21.551006 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d5443d67-ce6d-4798-be5e-e39b79780a42 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:21.552993 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d5443d67-ce6d-4798-be5e-e39b79780a42 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:21.596647 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-d5443d67-ce6d-4798-be5e-e39b79780a42 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] HTTP exception thrown: Instance 6dc592cb-94c7-4918-8103-023db604fd70 could not be found. Aug 10 23:17:21.599428 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-d5443d67-ce6d-4798-be5e-e39b79780a42 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Request method failure captured: Aug 10 23:17:21.599428 n-d-850468-14 devstack@n-api.service[122632]: request: GET /compute/v2.1/servers/6dc592cb-94c7-4918-8103-023db604fd70 HTTP/1.1 Aug 10 23:17:21.599428 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:17:21.599428 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:17:21.599428 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:17:21.599428 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 23:17:21.599428 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:17:21.599428 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:17:21.599428 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:17:21.599428 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:17:21.599428 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9DuIKrfOsS8tKST0PsIPrvuNPfsVISfOPvUoe9ddkVcTJKj7rDjd3OuH9u-DTT1aypj1AUoUKtajD98eDOUOHSpPisBSdRlSCov30lHf1uZq-XZLyBIVg5kAG8-SuXk2s1TL7EnRcjjMARSkm95dZDnXaBXRT3M4f8UoMDwqu7xK7gQ Aug 10 23:17:21.599428 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:17:21.599428 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:17:21.599428 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:17:21.599428 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:17:21.599428 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:17:21.599428 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:17:21.599428 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: d11bbb3e87f4463787da56ab19108822 Aug 10 23:17:21.599428 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-ServersNegativeTestJSON-1216728002 Aug 10 23:17:21.599428 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:17:21.599428 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:17:21.599428 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d11bbb3e87f4463787da56ab19108822"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d11bbb3e87f4463787da56ab19108822"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d11bbb3e87f4463787da56ab19108822"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d11bbb3e87f4463787da56ab19108822", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:17:21.599428 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-ServersNegativeTestJSON-1216728002 Aug 10 23:17:21.599428 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: d11bbb3e87f4463787da56ab19108822 Aug 10 23:17:21.599428 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1216728002 Aug 10 23:17:21.599428 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-ServersNegativeTestJSON-1216728002-project Aug 10 23:17:21.599428 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:17:21.599428 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:17:21.599428 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: f284ec2a4bf546b58c1c1adaf880e1fb Aug 10 23:17:21.599428 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-ServersNegativeTestJSON-1216728002-project Aug 10 23:17:21.599428 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:17:21.599428 n-d-850468-14 devstack@n-api.service[122632]: exception: Instance 6dc592cb-94c7-4918-8103-023db604fd70 could not be found. Aug 10 23:17:21.599428 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': '6dc592cb-94c7-4918-8103-023db604fd70'} Aug 10 23:17:21.599428 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:17:21.599428 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:17:21.599428 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:17:21.599428 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:17:21.599428 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:17:21.599428 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:17:21.599428 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:17:21.599428 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:17:21.599428 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:17:21.599428 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:17:21.599428 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6dc592cb-94c7-4918-8103-023db604fd70 could not be found. Aug 10 23:17:21.599428 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:17:21.599428 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:17:21.599428 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:17:21.599428 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:17:21.599428 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:17:21.599428 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:17:21.599428 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:17:21.599428 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:17:21.599428 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:17:21.599428 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:17:21.599428 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:17:21.599428 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:17:21.599428 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:17:21.599428 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:17:21.599428 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:17:21.599428 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:17:21.599428 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6dc592cb-94c7-4918-8103-023db604fd70 could not be found. Aug 10 23:17:21.599428 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:17:21.599428 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:17:21.599428 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:17:21.604432 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:17:21.604432 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:17:21.604432 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:17:21.604432 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:17:21.604432 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:17:21.604432 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6dc592cb-94c7-4918-8103-023db604fd70 could not be found. Aug 10 23:17:21.604432 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:17:21.611425 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-d5443d67-ce6d-4798-be5e-e39b79780a42 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Returning 404 to user: Instance 6dc592cb-94c7-4918-8103-023db604fd70 could not be found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:17:21.614709 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-d5443d67-ce6d-4798-be5e-e39b79780a42 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/6dc592cb-94c7-4918-8103-023db604fd70" status: 404 len: 111 microversion: 2.1 time: 0.110244 Aug 10 23:17:21.616890 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2056/4281] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:17:21 2022] GET /compute/v2.1/servers/6dc592cb-94c7-4918-8103-023db604fd70 => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:17:21.619951 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f9c716f0-2b24-4154-8529-99d3945b083a tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:21.620727 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f9c716f0-2b24-4154-8529-99d3945b083a tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:21.621348 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f9c716f0-2b24-4154-8529-99d3945b083a tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:21.632913 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-6e9c44da-dc89-4663-8f3f-c34b43d0e84b req-8b1e1ee1-c5b7-4037-9912-a6120c549f5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "250395b5-5be8-420a-8709-dcf8b4241a4e", "tag": "fb6df67c-3dbb-4a0f-98f0-c602e1eaa615"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:17:21.671937 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.objects.instance [None req-f9c716f0-2b24-4154-8529-99d3945b083a tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lazy-loading 'flavor' on Instance uuid 8410ad7d-396e-45d4-b0a4-92405d95fa8a {{(pid=122633) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:17:21.675485 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-6e9c44da-dc89-4663-8f3f-c34b43d0e84b req-8b1e1ee1-c5b7-4037-9912-a6120c549f5e service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:21.675976 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-6e9c44da-dc89-4663-8f3f-c34b43d0e84b req-8b1e1ee1-c5b7-4037-9912-a6120c549f5e service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:21.681423 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-6e9c44da-dc89-4663-8f3f-c34b43d0e84b req-8b1e1ee1-c5b7-4037-9912-a6120c549f5e service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:21.707426 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-f9c716f0-2b24-4154-8529-99d3945b083a tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] 10.222.0.58 "DELETE /compute/v2.1/servers/8410ad7d-396e-45d4-b0a4-92405d95fa8a/tags" status: 204 len: 0 microversion: 2.26 time: 0.253499 Aug 10 23:17:21.708619 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2226/4282] 10.222.0.58 () {60 vars in 1295 bytes} [Wed Aug 10 23:17:21 2022] DELETE /compute/v2.1/servers/8410ad7d-396e-45d4-b0a4-92405d95fa8a/tags => generated 0 bytes in 256 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 10 23:17:21.724981 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-53045503-aab6-4d1a-bac8-581c12764298 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:21.725810 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-53045503-aab6-4d1a-bac8-581c12764298 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:21.727205 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-6e9c44da-dc89-4663-8f3f-c34b43d0e84b req-8b1e1ee1-c5b7-4037-9912-a6120c549f5e service nova] Creating event network-changed:fb6df67c-3dbb-4a0f-98f0-c602e1eaa615 for instance 250395b5-5be8-420a-8709-dcf8b4241a4e on n-h1-850468-14 Aug 10 23:17:21.739925 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-53045503-aab6-4d1a-bac8-581c12764298 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:21.740698 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-53045503-aab6-4d1a-bac8-581c12764298 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:21.742700 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-53045503-aab6-4d1a-bac8-581c12764298 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:21.743430 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [req-6e9c44da-dc89-4663-8f3f-c34b43d0e84b req-8b1e1ee1-c5b7-4037-9912-a6120c549f5e service nova] Instance 250395b5-5be8-420a-8709-dcf8b4241a4e is migrating within the same cell, copying events to all relevant hosts: {'n-h1-850468-14', 'n-h2-850468-14'} {{(pid=122632) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5901}} Aug 10 23:17:21.743813 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-53045503-aab6-4d1a-bac8-581c12764298 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:21.746227 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-53045503-aab6-4d1a-bac8-581c12764298 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:21.746900 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-53045503-aab6-4d1a-bac8-581c12764298 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:21.791148 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-6e9c44da-dc89-4663-8f3f-c34b43d0e84b req-8b1e1ee1-c5b7-4037-9912-a6120c549f5e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.165624 Aug 10 23:17:21.792694 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-53045503-aab6-4d1a-bac8-581c12764298 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Going to try to terminate instance {{(pid=122633) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:17:21.795812 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2057/4283] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:17:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:17:21.812424 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-15e21777-c4a9-4a91-b43f-525eea1fefa3 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Calling method '.version_select at 0x7f847c71f700>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:21.849484 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-15e21777-c4a9-4a91-b43f-525eea1fefa3 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:21.850258 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-15e21777-c4a9-4a91-b43f-525eea1fefa3 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:21.850712 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-15e21777-c4a9-4a91-b43f-525eea1fefa3 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:21.878360 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-15e21777-c4a9-4a91-b43f-525eea1fefa3 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] 10.222.0.58 "GET /compute/v2.1/servers/8410ad7d-396e-45d4-b0a4-92405d95fa8a/tags" status: 200 len: 12 microversion: 2.26 time: 0.081212 Aug 10 23:17:21.883677 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2058/4284] 10.222.0.58 () {60 vars in 1292 bytes} [Wed Aug 10 23:17:21 2022] GET /compute/v2.1/servers/8410ad7d-396e-45d4-b0a4-92405d95fa8a/tags => generated 12 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:17:21.898340 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-9df77424-76d8-4e0b-a178-e74682f4e780 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:21.902007 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-9df77424-76d8-4e0b-a178-e74682f4e780 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: 0a5d7302-9eab-4c27-9a4b-7c705e06c290] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:21.933642 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9df77424-76d8-4e0b-a178-e74682f4e780 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:21.934527 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9df77424-76d8-4e0b-a178-e74682f4e780 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:21.935218 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9df77424-76d8-4e0b-a178-e74682f4e780 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:21.936741 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9df77424-76d8-4e0b-a178-e74682f4e780 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:21.960180 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9df77424-76d8-4e0b-a178-e74682f4e780 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:21.962643 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9df77424-76d8-4e0b-a178-e74682f4e780 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:21.975989 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-53045503-aab6-4d1a-bac8-581c12764298 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "DELETE /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b" status: 204 len: 0 microversion: 2.1 time: 0.265762 Aug 10 23:17:21.980825 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2227/4285] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:17:21 2022] DELETE /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b => generated 0 bytes in 269 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:17:21.995485 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-862a85bd-078c-4bb0-a20d-d98d4ac48315 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Calling method '.version_select at 0x7f847d292430>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:22.022726 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-862a85bd-078c-4bb0-a20d-d98d4ac48315 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:22.023260 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-862a85bd-078c-4bb0-a20d-d98d4ac48315 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:22.023709 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-862a85bd-078c-4bb0-a20d-d98d4ac48315 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:22.024328 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-862a85bd-078c-4bb0-a20d-d98d4ac48315 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] [instance: 8410ad7d-396e-45d4-b0a4-92405d95fa8a] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:22.040699 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-862a85bd-078c-4bb0-a20d-d98d4ac48315 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:22.041198 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-862a85bd-078c-4bb0-a20d-d98d4ac48315 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:22.041644 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-862a85bd-078c-4bb0-a20d-d98d4ac48315 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:22.042369 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-862a85bd-078c-4bb0-a20d-d98d4ac48315 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:22.042848 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-862a85bd-078c-4bb0-a20d-d98d4ac48315 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:22.043288 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-862a85bd-078c-4bb0-a20d-d98d4ac48315 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:22.122022 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-862a85bd-078c-4bb0-a20d-d98d4ac48315 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:22.124238 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-862a85bd-078c-4bb0-a20d-d98d4ac48315 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:22.125145 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-862a85bd-078c-4bb0-a20d-d98d4ac48315 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:22.151112 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-862a85bd-078c-4bb0-a20d-d98d4ac48315 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:22.154433 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-862a85bd-078c-4bb0-a20d-d98d4ac48315 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:22.155391 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-862a85bd-078c-4bb0-a20d-d98d4ac48315 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:22.202516 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=3,nova_cell1:INSERT=3,nova_cell1:DELETE=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:17:22.216255 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.objects.instance [None req-862a85bd-078c-4bb0-a20d-d98d4ac48315 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lazy-loading 'flavor' on Instance uuid 8410ad7d-396e-45d4-b0a4-92405d95fa8a {{(pid=122633) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:17:22.253520 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-862a85bd-078c-4bb0-a20d-d98d4ac48315 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] 10.222.0.58 "PUT /compute/v2.1/servers/8410ad7d-396e-45d4-b0a4-92405d95fa8a/tags/tempest-tag-87659954" status: 201 len: 0 microversion: 2.26 time: 0.271314 Aug 10 23:17:22.255163 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2228/4286] 10.222.0.58 () {62 vars in 1374 bytes} [Wed Aug 10 23:17:21 2022] PUT /compute/v2.1/servers/8410ad7d-396e-45d4-b0a4-92405d95fa8a/tags/tempest-tag-87659954 => generated 0 bytes in 274 msecs (HTTP/1.1 201) 10 headers in 484 bytes (1 switches on core 0) Aug 10 23:17:22.267879 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-9ef093c8-c033-48fd-8ce2-55b10e07a915 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:22.268388 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-9ef093c8-c033-48fd-8ce2-55b10e07a915 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:22.293235 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9ef093c8-c033-48fd-8ce2-55b10e07a915 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:22.293922 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9ef093c8-c033-48fd-8ce2-55b10e07a915 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:22.294384 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9ef093c8-c033-48fd-8ce2-55b10e07a915 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:22.295653 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9ef093c8-c033-48fd-8ce2-55b10e07a915 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:22.296296 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9ef093c8-c033-48fd-8ce2-55b10e07a915 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:22.296888 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9ef093c8-c033-48fd-8ce2-55b10e07a915 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:22.824557 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-9df77424-76d8-4e0b-a178-e74682f4e780 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:22.839225 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-9df77424-76d8-4e0b-a178-e74682f4e780 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/0a5d7302-9eab-4c27-9a4b-7c705e06c290" status: 200 len: 1315 microversion: 2.1 time: 0.949990 Aug 10 23:17:22.855809 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2059/4287] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:17:21 2022] GET /compute/v2.1/servers/0a5d7302-9eab-4c27-9a4b-7c705e06c290 => generated 1315 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:17:22.872261 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-3ca0cbf5-3fed-4069-b5d7-cd6ea18a7348 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Calling method '.version_select at 0x7f847d24bf70>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:22.893395 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3ca0cbf5-3fed-4069-b5d7-cd6ea18a7348 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:22.895969 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3ca0cbf5-3fed-4069-b5d7-cd6ea18a7348 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:22.898150 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3ca0cbf5-3fed-4069-b5d7-cd6ea18a7348 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:22.924745 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-3ca0cbf5-3fed-4069-b5d7-cd6ea18a7348 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] 10.222.0.58 "GET /compute/v2.1/servers/8410ad7d-396e-45d4-b0a4-92405d95fa8a/tags" status: 200 len: 34 microversion: 2.26 time: 0.067110 Aug 10 23:17:22.933499 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-9ef093c8-c033-48fd-8ce2-55b10e07a915 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:22.937850 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2060/4288] 10.222.0.58 () {60 vars in 1292 bytes} [Wed Aug 10 23:17:22 2022] GET /compute/v2.1/servers/8410ad7d-396e-45d4-b0a4-92405d95fa8a/tags => generated 34 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:17:22.948996 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-9817f3c5-4a6c-42ec-bba0-e232107af30e tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:22.949796 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-9817f3c5-4a6c-42ec-bba0-e232107af30e tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] [instance: 250395b5-5be8-420a-8709-dcf8b4241a4e] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:22.953158 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-9ef093c8-c033-48fd-8ce2-55b10e07a915 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b" status: 200 len: 1512 microversion: 2.1 time: 0.690800 Aug 10 23:17:22.954467 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2229/4289] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:17:22 2022] GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b => generated 1512 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:17:22.965478 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9817f3c5-4a6c-42ec-bba0-e232107af30e tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:22.966240 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9817f3c5-4a6c-42ec-bba0-e232107af30e tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:22.968476 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9817f3c5-4a6c-42ec-bba0-e232107af30e tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:22.970406 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9817f3c5-4a6c-42ec-bba0-e232107af30e tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:22.972446 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9817f3c5-4a6c-42ec-bba0-e232107af30e tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:22.972610 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c429a19c-4c8d-4d19-8136-02f35803adcf tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Calling method '.version_select at 0x7f847d295310>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:22.974381 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9817f3c5-4a6c-42ec-bba0-e232107af30e tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:23.001656 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c429a19c-4c8d-4d19-8136-02f35803adcf tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:23.005709 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c429a19c-4c8d-4d19-8136-02f35803adcf tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:23.014055 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c429a19c-4c8d-4d19-8136-02f35803adcf tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:23.014939 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-c429a19c-4c8d-4d19-8136-02f35803adcf tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] [instance: 8410ad7d-396e-45d4-b0a4-92405d95fa8a] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:23.032721 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c429a19c-4c8d-4d19-8136-02f35803adcf tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:23.042194 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c429a19c-4c8d-4d19-8136-02f35803adcf tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:23.045513 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c429a19c-4c8d-4d19-8136-02f35803adcf tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:23.046567 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c429a19c-4c8d-4d19-8136-02f35803adcf tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:23.048618 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c429a19c-4c8d-4d19-8136-02f35803adcf tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:23.049186 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c429a19c-4c8d-4d19-8136-02f35803adcf tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:23.132406 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c429a19c-4c8d-4d19-8136-02f35803adcf tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:23.134951 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c429a19c-4c8d-4d19-8136-02f35803adcf tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:23.135548 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c429a19c-4c8d-4d19-8136-02f35803adcf tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:23.213486 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.objects.instance [None req-c429a19c-4c8d-4d19-8136-02f35803adcf tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lazy-loading 'flavor' on Instance uuid 8410ad7d-396e-45d4-b0a4-92405d95fa8a {{(pid=122633) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:17:23.244903 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-9817f3c5-4a6c-42ec-bba0-e232107af30e tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5899b2ad9f1046caaf7c6073e408eeee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25abd63376614081a9d484f3c9ae950d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:23.257983 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-9817f3c5-4a6c-42ec-bba0-e232107af30e tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "GET /compute/v2.1/servers/250395b5-5be8-420a-8709-dcf8b4241a4e" status: 200 len: 1689 microversion: 2.1 time: 0.318476 Aug 10 23:17:23.258815 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2061/4290] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:17:22 2022] GET /compute/v2.1/servers/250395b5-5be8-420a-8709-dcf8b4241a4e => generated 1689 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:17:23.264323 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-c429a19c-4c8d-4d19-8136-02f35803adcf tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] 10.222.0.58 "DELETE /compute/v2.1/servers/8410ad7d-396e-45d4-b0a4-92405d95fa8a/tags/tempest-tag-87659954" status: 204 len: 0 microversion: 2.26 time: 0.306264 Aug 10 23:17:23.265423 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2230/4291] 10.222.0.58 () {60 vars in 1358 bytes} [Wed Aug 10 23:17:22 2022] DELETE /compute/v2.1/servers/8410ad7d-396e-45d4-b0a4-92405d95fa8a/tags/tempest-tag-87659954 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 10 23:17:23.282189 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-f56e21b7-7ece-4ec0-aa20-73b00286f6f0 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Calling method '.version_select at 0x7f847d17bb80>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:23.291914 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f56e21b7-7ece-4ec0-aa20-73b00286f6f0 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:23.292694 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f56e21b7-7ece-4ec0-aa20-73b00286f6f0 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:23.293996 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f56e21b7-7ece-4ec0-aa20-73b00286f6f0 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:23.305524 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-f56e21b7-7ece-4ec0-aa20-73b00286f6f0 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] 10.222.0.58 "GET /compute/v2.1/servers/8410ad7d-396e-45d4-b0a4-92405d95fa8a/tags" status: 200 len: 12 microversion: 2.26 time: 0.028195 Aug 10 23:17:23.313407 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2062/4292] 10.222.0.58 () {60 vars in 1292 bytes} [Wed Aug 10 23:17:23 2022] GET /compute/v2.1/servers/8410ad7d-396e-45d4-b0a4-92405d95fa8a/tags => generated 12 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:17:23.319522 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-673f24d6-a840-4ccc-9075-d309f433e8fe tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Calling method '.version_select at 0x7f84823e38b0>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:23.335252 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-673f24d6-a840-4ccc-9075-d309f433e8fe tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:23.335948 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-673f24d6-a840-4ccc-9075-d309f433e8fe tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:23.337724 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-673f24d6-a840-4ccc-9075-d309f433e8fe tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:23.338532 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-673f24d6-a840-4ccc-9075-d309f433e8fe tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] [instance: 8410ad7d-396e-45d4-b0a4-92405d95fa8a] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:23.355048 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-673f24d6-a840-4ccc-9075-d309f433e8fe tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:23.356087 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-673f24d6-a840-4ccc-9075-d309f433e8fe tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:23.356787 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-673f24d6-a840-4ccc-9075-d309f433e8fe tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:23.357960 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-673f24d6-a840-4ccc-9075-d309f433e8fe tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:23.360124 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-673f24d6-a840-4ccc-9075-d309f433e8fe tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:23.361328 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-673f24d6-a840-4ccc-9075-d309f433e8fe tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:23.412742 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-673f24d6-a840-4ccc-9075-d309f433e8fe tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:23.417502 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-673f24d6-a840-4ccc-9075-d309f433e8fe tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:23.418158 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-673f24d6-a840-4ccc-9075-d309f433e8fe tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:23.448136 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.objects.instance [None req-673f24d6-a840-4ccc-9075-d309f433e8fe tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lazy-loading 'flavor' on Instance uuid 8410ad7d-396e-45d4-b0a4-92405d95fa8a {{(pid=122633) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:17:23.485192 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-673f24d6-a840-4ccc-9075-d309f433e8fe tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] 10.222.0.58 "DELETE /compute/v2.1/servers/8410ad7d-396e-45d4-b0a4-92405d95fa8a/tags" status: 204 len: 0 microversion: 2.26 time: 0.170650 Aug 10 23:17:23.486329 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2231/4293] 10.222.0.58 () {60 vars in 1295 bytes} [Wed Aug 10 23:17:23 2022] DELETE /compute/v2.1/servers/8410ad7d-396e-45d4-b0a4-92405d95fa8a/tags => generated 0 bytes in 173 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 10 23:17:23.500053 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-5aaaae5f-6776-4c1d-ac8e-20014d4224c8 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Calling method '.version_select at 0x7f847d24bb80>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:23.539705 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5aaaae5f-6776-4c1d-ac8e-20014d4224c8 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:23.540223 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5aaaae5f-6776-4c1d-ac8e-20014d4224c8 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:23.541507 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5aaaae5f-6776-4c1d-ac8e-20014d4224c8 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:23.542232 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-5aaaae5f-6776-4c1d-ac8e-20014d4224c8 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] [instance: 8410ad7d-396e-45d4-b0a4-92405d95fa8a] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:23.549361 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5aaaae5f-6776-4c1d-ac8e-20014d4224c8 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:23.555878 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5aaaae5f-6776-4c1d-ac8e-20014d4224c8 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:23.556596 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5aaaae5f-6776-4c1d-ac8e-20014d4224c8 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:23.557801 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5aaaae5f-6776-4c1d-ac8e-20014d4224c8 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:23.558419 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5aaaae5f-6776-4c1d-ac8e-20014d4224c8 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:23.559034 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5aaaae5f-6776-4c1d-ac8e-20014d4224c8 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:23.629145 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5aaaae5f-6776-4c1d-ac8e-20014d4224c8 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:23.632005 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5aaaae5f-6776-4c1d-ac8e-20014d4224c8 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:23.632690 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5aaaae5f-6776-4c1d-ac8e-20014d4224c8 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:23.651568 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5aaaae5f-6776-4c1d-ac8e-20014d4224c8 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:23.652306 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5aaaae5f-6776-4c1d-ac8e-20014d4224c8 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:23.652908 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5aaaae5f-6776-4c1d-ac8e-20014d4224c8 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:23.657013 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=1,nova_cell1:RELEASE=1 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:17:23.714227 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.objects.instance [None req-5aaaae5f-6776-4c1d-ac8e-20014d4224c8 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lazy-loading 'flavor' on Instance uuid 8410ad7d-396e-45d4-b0a4-92405d95fa8a {{(pid=122632) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:17:23.748972 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-5aaaae5f-6776-4c1d-ac8e-20014d4224c8 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] 10.222.0.58 "PUT /compute/v2.1/servers/8410ad7d-396e-45d4-b0a4-92405d95fa8a/tags/tempest-tag-69952683" status: 201 len: 0 microversion: 2.26 time: 0.254306 Aug 10 23:17:23.755315 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2063/4294] 10.222.0.58 () {62 vars in 1374 bytes} [Wed Aug 10 23:17:23 2022] PUT /compute/v2.1/servers/8410ad7d-396e-45d4-b0a4-92405d95fa8a/tags/tempest-tag-69952683 => generated 0 bytes in 256 msecs (HTTP/1.1 201) 10 headers in 484 bytes (1 switches on core 0) Aug 10 23:17:23.761191 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-dcc709fa-aa3b-4d13-b0db-04d5c045c9b5 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Calling method '.version_select at 0x7f847d2c3b80>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:23.790617 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dcc709fa-aa3b-4d13-b0db-04d5c045c9b5 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:23.792438 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dcc709fa-aa3b-4d13-b0db-04d5c045c9b5 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:23.803027 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dcc709fa-aa3b-4d13-b0db-04d5c045c9b5 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:23.803763 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-dcc709fa-aa3b-4d13-b0db-04d5c045c9b5 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] [instance: 8410ad7d-396e-45d4-b0a4-92405d95fa8a] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:23.827076 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dcc709fa-aa3b-4d13-b0db-04d5c045c9b5 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:23.828090 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dcc709fa-aa3b-4d13-b0db-04d5c045c9b5 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:23.828808 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dcc709fa-aa3b-4d13-b0db-04d5c045c9b5 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:23.830107 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dcc709fa-aa3b-4d13-b0db-04d5c045c9b5 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:23.832215 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dcc709fa-aa3b-4d13-b0db-04d5c045c9b5 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:23.833112 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dcc709fa-aa3b-4d13-b0db-04d5c045c9b5 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:23.866908 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-0411e4e4-9d51-44ad-8077-9a08fa9fe1d5 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:23.867590 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-0411e4e4-9d51-44ad-8077-9a08fa9fe1d5 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: 0a5d7302-9eab-4c27-9a4b-7c705e06c290] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:23.878177 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0411e4e4-9d51-44ad-8077-9a08fa9fe1d5 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:23.878693 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0411e4e4-9d51-44ad-8077-9a08fa9fe1d5 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:23.891384 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0411e4e4-9d51-44ad-8077-9a08fa9fe1d5 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:23.892194 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0411e4e4-9d51-44ad-8077-9a08fa9fe1d5 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:23.892678 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0411e4e4-9d51-44ad-8077-9a08fa9fe1d5 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:23.893125 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0411e4e4-9d51-44ad-8077-9a08fa9fe1d5 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:23.933228 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dcc709fa-aa3b-4d13-b0db-04d5c045c9b5 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:23.936583 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dcc709fa-aa3b-4d13-b0db-04d5c045c9b5 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:23.937927 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dcc709fa-aa3b-4d13-b0db-04d5c045c9b5 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:23.964261 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dcc709fa-aa3b-4d13-b0db-04d5c045c9b5 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:23.973886 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dcc709fa-aa3b-4d13-b0db-04d5c045c9b5 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:23.975785 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dcc709fa-aa3b-4d13-b0db-04d5c045c9b5 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:24.028896 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.objects.instance [None req-dcc709fa-aa3b-4d13-b0db-04d5c045c9b5 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lazy-loading 'flavor' on Instance uuid 8410ad7d-396e-45d4-b0a4-92405d95fa8a {{(pid=122633) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:17:24.064377 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-dcc709fa-aa3b-4d13-b0db-04d5c045c9b5 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] 10.222.0.58 "PUT /compute/v2.1/servers/8410ad7d-396e-45d4-b0a4-92405d95fa8a/tags/tempest-tag-1721891888" status: 201 len: 0 microversion: 2.26 time: 0.308988 Aug 10 23:17:24.065694 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2232/4295] 10.222.0.58 () {62 vars in 1380 bytes} [Wed Aug 10 23:17:23 2022] PUT /compute/v2.1/servers/8410ad7d-396e-45d4-b0a4-92405d95fa8a/tags/tempest-tag-1721891888 => generated 0 bytes in 311 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Aug 10 23:17:24.079849 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-da2ceaf4-6816-4de8-a486-4c64a0eab532 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:24.086220 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-da2ceaf4-6816-4de8-a486-4c64a0eab532 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:24.106520 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-da2ceaf4-6816-4de8-a486-4c64a0eab532 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:24.115601 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-da2ceaf4-6816-4de8-a486-4c64a0eab532 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:24.120933 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-da2ceaf4-6816-4de8-a486-4c64a0eab532 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:24.122254 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-da2ceaf4-6816-4de8-a486-4c64a0eab532 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:24.123343 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-da2ceaf4-6816-4de8-a486-4c64a0eab532 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:24.124006 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-da2ceaf4-6816-4de8-a486-4c64a0eab532 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:24.983851 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-0411e4e4-9d51-44ad-8077-9a08fa9fe1d5 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:24.994843 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-0411e4e4-9d51-44ad-8077-9a08fa9fe1d5 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/0a5d7302-9eab-4c27-9a4b-7c705e06c290" status: 200 len: 1315 microversion: 2.1 time: 1.132957 Aug 10 23:17:25.003035 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2064/4296] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:17:23 2022] GET /compute/v2.1/servers/0a5d7302-9eab-4c27-9a4b-7c705e06c290 => generated 1315 bytes in 1142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:17:25.019251 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-8e652ccd-d0f9-4106-a208-f473f9879b32 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Calling method '.version_select at 0x7f847d6494c0>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:25.059082 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8e652ccd-d0f9-4106-a208-f473f9879b32 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:25.059880 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8e652ccd-d0f9-4106-a208-f473f9879b32 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:25.064597 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8e652ccd-d0f9-4106-a208-f473f9879b32 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:25.065337 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-8e652ccd-d0f9-4106-a208-f473f9879b32 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] [instance: 8410ad7d-396e-45d4-b0a4-92405d95fa8a] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:25.088950 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8e652ccd-d0f9-4106-a208-f473f9879b32 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:25.089454 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8e652ccd-d0f9-4106-a208-f473f9879b32 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:25.089897 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8e652ccd-d0f9-4106-a208-f473f9879b32 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:25.090615 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8e652ccd-d0f9-4106-a208-f473f9879b32 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:25.099026 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8e652ccd-d0f9-4106-a208-f473f9879b32 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:25.099615 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8e652ccd-d0f9-4106-a208-f473f9879b32 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:25.191653 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8e652ccd-d0f9-4106-a208-f473f9879b32 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:25.199610 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8e652ccd-d0f9-4106-a208-f473f9879b32 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:25.201615 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8e652ccd-d0f9-4106-a208-f473f9879b32 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:25.246059 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.objects.instance [None req-8e652ccd-d0f9-4106-a208-f473f9879b32 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lazy-loading 'flavor' on Instance uuid 8410ad7d-396e-45d4-b0a4-92405d95fa8a {{(pid=122632) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:17:25.295856 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-8e652ccd-d0f9-4106-a208-f473f9879b32 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] 10.222.0.58 "DELETE /compute/v2.1/servers/8410ad7d-396e-45d4-b0a4-92405d95fa8a/tags" status: 204 len: 0 microversion: 2.26 time: 0.290882 Aug 10 23:17:25.296471 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2065/4297] 10.222.0.58 () {60 vars in 1295 bytes} [Wed Aug 10 23:17:25 2022] DELETE /compute/v2.1/servers/8410ad7d-396e-45d4-b0a4-92405d95fa8a/tags => generated 0 bytes in 293 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 10 23:17:25.308304 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-35027960-441f-4f03-ad22-586b9f40a7fd tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:25.328496 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-35027960-441f-4f03-ad22-586b9f40a7fd tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] [instance: 250395b5-5be8-420a-8709-dcf8b4241a4e] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:25.344835 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-35027960-441f-4f03-ad22-586b9f40a7fd tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:25.345366 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-35027960-441f-4f03-ad22-586b9f40a7fd tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:25.345810 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-35027960-441f-4f03-ad22-586b9f40a7fd tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:25.352395 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-35027960-441f-4f03-ad22-586b9f40a7fd tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:25.354306 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-35027960-441f-4f03-ad22-586b9f40a7fd tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:25.359814 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-35027960-441f-4f03-ad22-586b9f40a7fd tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:25.944214 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-da2ceaf4-6816-4de8-a486-4c64a0eab532 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:25.957914 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-da2ceaf4-6816-4de8-a486-4c64a0eab532 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b" status: 200 len: 1512 microversion: 2.1 time: 1.889821 Aug 10 23:17:25.969171 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2233/4298] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:17:24 2022] GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b => generated 1512 bytes in 1902 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:17:26.009788 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-6089ae95-c5a4-4c00-b2ad-83a693102c68 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Calling method '.version_select at 0x7f847d0fce50>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:26.029879 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6089ae95-c5a4-4c00-b2ad-83a693102c68 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:26.030375 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6089ae95-c5a4-4c00-b2ad-83a693102c68 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:26.035472 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6089ae95-c5a4-4c00-b2ad-83a693102c68 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:26.064316 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-6089ae95-c5a4-4c00-b2ad-83a693102c68 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] 10.222.0.58 "GET /compute/v2.1/servers/8410ad7d-396e-45d4-b0a4-92405d95fa8a/tags" status: 200 len: 12 microversion: 2.26 time: 0.093209 Aug 10 23:17:26.077175 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2234/4299] 10.222.0.58 () {60 vars in 1292 bytes} [Wed Aug 10 23:17:25 2022] GET /compute/v2.1/servers/8410ad7d-396e-45d4-b0a4-92405d95fa8a/tags => generated 12 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:17:26.091888 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-35027960-441f-4f03-ad22-586b9f40a7fd tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5899b2ad9f1046caaf7c6073e408eeee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25abd63376614081a9d484f3c9ae950d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:26.095544 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-380f4886-c489-4822-9a4c-0fc6f2dec1b0 req-2a7acf71-2022-4891-9e8d-8867195f104b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a5d7302-9eab-4c27-9a4b-7c705e06c290", "name": "network-vif-plugged", "status": "completed", "tag": "b753ef0a-169a-496f-ba6e-46e3a214c4f8"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:17:26.101289 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-35027960-441f-4f03-ad22-586b9f40a7fd tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "GET /compute/v2.1/servers/250395b5-5be8-420a-8709-dcf8b4241a4e" status: 200 len: 1682 microversion: 2.1 time: 0.797102 Aug 10 23:17:26.101947 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2066/4300] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:17:25 2022] GET /compute/v2.1/servers/250395b5-5be8-420a-8709-dcf8b4241a4e => generated 1682 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:17:26.133740 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-0e2a3dc7-3fcb-409d-be66-2e3c4f7b64f9 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:26.134716 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-0e2a3dc7-3fcb-409d-be66-2e3c4f7b64f9 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: 0a5d7302-9eab-4c27-9a4b-7c705e06c290] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:26.143139 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-380f4886-c489-4822-9a4c-0fc6f2dec1b0 req-2a7acf71-2022-4891-9e8d-8867195f104b service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:26.154766 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-380f4886-c489-4822-9a4c-0fc6f2dec1b0 req-2a7acf71-2022-4891-9e8d-8867195f104b service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:26.157668 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-380f4886-c489-4822-9a4c-0fc6f2dec1b0 req-2a7acf71-2022-4891-9e8d-8867195f104b service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:26.158571 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0e2a3dc7-3fcb-409d-be66-2e3c4f7b64f9 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:26.159104 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0e2a3dc7-3fcb-409d-be66-2e3c4f7b64f9 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:26.162176 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0e2a3dc7-3fcb-409d-be66-2e3c4f7b64f9 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:26.169678 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0e2a3dc7-3fcb-409d-be66-2e3c4f7b64f9 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:26.173012 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0e2a3dc7-3fcb-409d-be66-2e3c4f7b64f9 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:26.173672 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0e2a3dc7-3fcb-409d-be66-2e3c4f7b64f9 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:26.202332 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-380f4886-c489-4822-9a4c-0fc6f2dec1b0 req-2a7acf71-2022-4891-9e8d-8867195f104b service nova] Creating event network-vif-plugged:b753ef0a-169a-496f-ba6e-46e3a214c4f8 for instance 0a5d7302-9eab-4c27-9a4b-7c705e06c290 on n-h1-850468-14 Aug 10 23:17:26.234427 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-380f4886-c489-4822-9a4c-0fc6f2dec1b0 req-2a7acf71-2022-4891-9e8d-8867195f104b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.138336 Aug 10 23:17:26.236960 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2235/4301] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:17:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:17:26.249197 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-49ee8070-7f68-4dbe-85bc-cc2908b020c0 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Calling method '.version_select at 0x7f847d2785e0>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:26.311920 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-49ee8070-7f68-4dbe-85bc-cc2908b020c0 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:26.312418 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-49ee8070-7f68-4dbe-85bc-cc2908b020c0 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:26.315997 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-49ee8070-7f68-4dbe-85bc-cc2908b020c0 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:26.318889 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-49ee8070-7f68-4dbe-85bc-cc2908b020c0 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] [instance: 8410ad7d-396e-45d4-b0a4-92405d95fa8a] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:26.334592 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-49ee8070-7f68-4dbe-85bc-cc2908b020c0 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:26.335159 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-49ee8070-7f68-4dbe-85bc-cc2908b020c0 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:26.335622 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-49ee8070-7f68-4dbe-85bc-cc2908b020c0 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:26.336379 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-49ee8070-7f68-4dbe-85bc-cc2908b020c0 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:26.341017 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-49ee8070-7f68-4dbe-85bc-cc2908b020c0 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:26.342087 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-49ee8070-7f68-4dbe-85bc-cc2908b020c0 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:26.396891 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-49ee8070-7f68-4dbe-85bc-cc2908b020c0 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:26.397384 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-49ee8070-7f68-4dbe-85bc-cc2908b020c0 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:26.398150 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-49ee8070-7f68-4dbe-85bc-cc2908b020c0 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:26.449852 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.objects.instance [None req-49ee8070-7f68-4dbe-85bc-cc2908b020c0 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lazy-loading 'flavor' on Instance uuid 8410ad7d-396e-45d4-b0a4-92405d95fa8a {{(pid=122633) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:17:26.532050 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-49ee8070-7f68-4dbe-85bc-cc2908b020c0 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] 10.222.0.58 "DELETE /compute/v2.1/servers/8410ad7d-396e-45d4-b0a4-92405d95fa8a/tags" status: 204 len: 0 microversion: 2.26 time: 0.290529 Aug 10 23:17:26.533036 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2236/4302] 10.222.0.58 () {60 vars in 1295 bytes} [Wed Aug 10 23:17:26 2022] DELETE /compute/v2.1/servers/8410ad7d-396e-45d4-b0a4-92405d95fa8a/tags => generated 0 bytes in 295 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 10 23:17:26.547769 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-4dc7169b-accc-4f44-a03d-6be3ac36fc1a tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Calling method '.version_select at 0x7f847d2c30d0>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:26.602357 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4dc7169b-accc-4f44-a03d-6be3ac36fc1a tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:26.602896 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4dc7169b-accc-4f44-a03d-6be3ac36fc1a tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:26.603349 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4dc7169b-accc-4f44-a03d-6be3ac36fc1a tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:26.603839 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-4dc7169b-accc-4f44-a03d-6be3ac36fc1a tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] [instance: 8410ad7d-396e-45d4-b0a4-92405d95fa8a] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:26.625324 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4dc7169b-accc-4f44-a03d-6be3ac36fc1a tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:26.625822 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4dc7169b-accc-4f44-a03d-6be3ac36fc1a tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:26.626260 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4dc7169b-accc-4f44-a03d-6be3ac36fc1a tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:26.627018 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4dc7169b-accc-4f44-a03d-6be3ac36fc1a tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:26.627474 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4dc7169b-accc-4f44-a03d-6be3ac36fc1a tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:26.627899 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4dc7169b-accc-4f44-a03d-6be3ac36fc1a tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:26.752858 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4dc7169b-accc-4f44-a03d-6be3ac36fc1a tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:26.753322 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4dc7169b-accc-4f44-a03d-6be3ac36fc1a tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:26.754463 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4dc7169b-accc-4f44-a03d-6be3ac36fc1a tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:26.800100 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4dc7169b-accc-4f44-a03d-6be3ac36fc1a tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:26.800896 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4dc7169b-accc-4f44-a03d-6be3ac36fc1a tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:26.801519 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4dc7169b-accc-4f44-a03d-6be3ac36fc1a tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:26.870636 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.objects.instance [None req-4dc7169b-accc-4f44-a03d-6be3ac36fc1a tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lazy-loading 'flavor' on Instance uuid 8410ad7d-396e-45d4-b0a4-92405d95fa8a {{(pid=122633) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:17:26.944045 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-4dc7169b-accc-4f44-a03d-6be3ac36fc1a tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] 10.222.0.58 "PUT /compute/v2.1/servers/8410ad7d-396e-45d4-b0a4-92405d95fa8a/tags/tempest-tag-1144909855" status: 201 len: 0 microversion: 2.26 time: 0.402455 Aug 10 23:17:26.949930 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2237/4303] 10.222.0.58 () {62 vars in 1380 bytes} [Wed Aug 10 23:17:26 2022] PUT /compute/v2.1/servers/8410ad7d-396e-45d4-b0a4-92405d95fa8a/tags/tempest-tag-1144909855 => generated 0 bytes in 410 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Aug 10 23:17:26.961609 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-a3419607-4d53-4501-a6e0-de658eb0a399 req-8f4cb901-3884-4fcd-be3f-ffe51c7a60ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23bbe055-4a92-4b96-8b89-c941229bfb0b", "name": "network-vif-deleted", "tag": "6f537f41-6630-4a1c-b82e-c0862b0fc22c"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:17:26.986149 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-a3419607-4d53-4501-a6e0-de658eb0a399 req-8f4cb901-3884-4fcd-be3f-ffe51c7a60ac service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:26.987335 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-a3419607-4d53-4501-a6e0-de658eb0a399 req-8f4cb901-3884-4fcd-be3f-ffe51c7a60ac service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:26.990648 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-a3419607-4d53-4501-a6e0-de658eb0a399 req-8f4cb901-3884-4fcd-be3f-ffe51c7a60ac service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:27.004441 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-0e2a3dc7-3fcb-409d-be66-2e3c4f7b64f9 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:27.012827 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-0e2a3dc7-3fcb-409d-be66-2e3c4f7b64f9 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/0a5d7302-9eab-4c27-9a4b-7c705e06c290" status: 200 len: 1315 microversion: 2.1 time: 0.900459 Aug 10 23:17:27.017317 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2067/4304] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:17:26 2022] GET /compute/v2.1/servers/0a5d7302-9eab-4c27-9a4b-7c705e06c290 => generated 1315 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:17:27.031152 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-6dfe92af-8144-4a56-bf92-1bd106eb5e7f tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Calling method '.version_select at 0x7f847c71f1f0>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:27.040947 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-a3419607-4d53-4501-a6e0-de658eb0a399 req-8f4cb901-3884-4fcd-be3f-ffe51c7a60ac service nova] Creating event network-vif-deleted:6f537f41-6630-4a1c-b82e-c0862b0fc22c for instance 23bbe055-4a92-4b96-8b89-c941229bfb0b on n-h2-850468-14 Aug 10 23:17:27.050893 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-a3419607-4d53-4501-a6e0-de658eb0a399 req-8f4cb901-3884-4fcd-be3f-ffe51c7a60ac service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098884 Aug 10 23:17:27.051792 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2238/4305] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:17:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:17:27.079424 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-fdbe44ef-d4f0-4164-86bf-f7878e5f6633 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:27.080393 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-fdbe44ef-d4f0-4164-86bf-f7878e5f6633 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:27.097295 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fdbe44ef-d4f0-4164-86bf-f7878e5f6633 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:27.097295 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fdbe44ef-d4f0-4164-86bf-f7878e5f6633 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:27.097884 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fdbe44ef-d4f0-4164-86bf-f7878e5f6633 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:27.102146 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6dfe92af-8144-4a56-bf92-1bd106eb5e7f tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:27.102668 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fdbe44ef-d4f0-4164-86bf-f7878e5f6633 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:27.102761 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6dfe92af-8144-4a56-bf92-1bd106eb5e7f tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:27.102888 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fdbe44ef-d4f0-4164-86bf-f7878e5f6633 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:27.103412 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fdbe44ef-d4f0-4164-86bf-f7878e5f6633 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:27.104652 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6dfe92af-8144-4a56-bf92-1bd106eb5e7f tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:27.105151 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-6dfe92af-8144-4a56-bf92-1bd106eb5e7f tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] [instance: 8410ad7d-396e-45d4-b0a4-92405d95fa8a] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:27.133998 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6dfe92af-8144-4a56-bf92-1bd106eb5e7f tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:27.134878 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6dfe92af-8144-4a56-bf92-1bd106eb5e7f tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:27.135323 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6dfe92af-8144-4a56-bf92-1bd106eb5e7f tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:27.141043 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6dfe92af-8144-4a56-bf92-1bd106eb5e7f tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:27.151048 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6dfe92af-8144-4a56-bf92-1bd106eb5e7f tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:27.155443 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6dfe92af-8144-4a56-bf92-1bd106eb5e7f tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:27.224754 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fdbe44ef-d4f0-4164-86bf-f7878e5f6633 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:27.231242 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fdbe44ef-d4f0-4164-86bf-f7878e5f6633 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:27.231874 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fdbe44ef-d4f0-4164-86bf-f7878e5f6633 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:27.233114 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.objects.instance [None req-fdbe44ef-d4f0-4164-86bf-f7878e5f6633 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lazy-loading 'fault' on Instance uuid 23bbe055-4a92-4b96-8b89-c941229bfb0b {{(pid=122633) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:17:27.285604 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6dfe92af-8144-4a56-bf92-1bd106eb5e7f tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:27.286382 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6dfe92af-8144-4a56-bf92-1bd106eb5e7f tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:27.291690 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6dfe92af-8144-4a56-bf92-1bd106eb5e7f tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:27.334474 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6dfe92af-8144-4a56-bf92-1bd106eb5e7f tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:27.338272 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6dfe92af-8144-4a56-bf92-1bd106eb5e7f tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:27.338951 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6dfe92af-8144-4a56-bf92-1bd106eb5e7f tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:27.395705 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.objects.instance [None req-6dfe92af-8144-4a56-bf92-1bd106eb5e7f tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lazy-loading 'flavor' on Instance uuid 8410ad7d-396e-45d4-b0a4-92405d95fa8a {{(pid=122632) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:17:27.425312 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-6dfe92af-8144-4a56-bf92-1bd106eb5e7f tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] 10.222.0.58 "PUT /compute/v2.1/servers/8410ad7d-396e-45d4-b0a4-92405d95fa8a/tags/tempest-tag-1789347478" status: 201 len: 0 microversion: 2.26 time: 0.404147 Aug 10 23:17:27.427427 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2068/4306] 10.222.0.58 () {62 vars in 1380 bytes} [Wed Aug 10 23:17:27 2022] PUT /compute/v2.1/servers/8410ad7d-396e-45d4-b0a4-92405d95fa8a/tags/tempest-tag-1789347478 => generated 0 bytes in 409 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Aug 10 23:17:27.442383 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-fdbe44ef-d4f0-4164-86bf-f7878e5f6633 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f284ec2a4bf546b58c1c1adaf880e1fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd11bbb3e87f4463787da56ab19108822', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:27.464295 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-fdbe44ef-d4f0-4164-86bf-f7878e5f6633 tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b" status: 200 len: 1307 microversion: 2.1 time: 0.406527 Aug 10 23:17:27.465321 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-27718638-5f62-4c23-9878-b93afcda9bc2 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Action: 'update_all', calling method: .version_select at 0x7f847d24b5e0>, body: {"tags": ["tempest-tag-1300133062", "tempest-tag-1062813701"]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:17:27.466277 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2239/4307] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:17:27 2022] GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b => generated 1307 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:17:27.501286 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-27718638-5f62-4c23-9878-b93afcda9bc2 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:27.507478 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-27718638-5f62-4c23-9878-b93afcda9bc2 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:27.508188 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-27718638-5f62-4c23-9878-b93afcda9bc2 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:27.530489 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-27718638-5f62-4c23-9878-b93afcda9bc2 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] [instance: 8410ad7d-396e-45d4-b0a4-92405d95fa8a] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:27.545201 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-27718638-5f62-4c23-9878-b93afcda9bc2 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:27.550048 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-27718638-5f62-4c23-9878-b93afcda9bc2 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:27.551012 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-27718638-5f62-4c23-9878-b93afcda9bc2 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:27.552342 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-27718638-5f62-4c23-9878-b93afcda9bc2 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:27.553220 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-27718638-5f62-4c23-9878-b93afcda9bc2 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:27.555387 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-27718638-5f62-4c23-9878-b93afcda9bc2 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:27.614346 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-27718638-5f62-4c23-9878-b93afcda9bc2 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:27.616745 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-27718638-5f62-4c23-9878-b93afcda9bc2 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:27.621158 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-27718638-5f62-4c23-9878-b93afcda9bc2 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:27.662251 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.objects.instance [None req-27718638-5f62-4c23-9878-b93afcda9bc2 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lazy-loading 'flavor' on Instance uuid 8410ad7d-396e-45d4-b0a4-92405d95fa8a {{(pid=122632) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:17:27.707444 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-27718638-5f62-4c23-9878-b93afcda9bc2 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] 10.222.0.58 "PUT /compute/v2.1/servers/8410ad7d-396e-45d4-b0a4-92405d95fa8a/tags" status: 200 len: 62 microversion: 2.26 time: 0.271904 Aug 10 23:17:27.708428 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2069/4308] 10.222.0.58 () {62 vars in 1312 bytes} [Wed Aug 10 23:17:27 2022] PUT /compute/v2.1/servers/8410ad7d-396e-45d4-b0a4-92405d95fa8a/tags => generated 62 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:17:27.720519 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-d51a6003-1082-4a61-8802-c80e30459dfc tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Calling method '.version_select at 0x7f847d292d30>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:27.728493 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:17:27.740581 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d51a6003-1082-4a61-8802-c80e30459dfc tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:27.742032 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d51a6003-1082-4a61-8802-c80e30459dfc tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:27.743168 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d51a6003-1082-4a61-8802-c80e30459dfc tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:27.776613 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-d51a6003-1082-4a61-8802-c80e30459dfc tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] 10.222.0.58 "GET /compute/v2.1/servers/8410ad7d-396e-45d4-b0a4-92405d95fa8a/tags" status: 200 len: 62 microversion: 2.26 time: 0.059999 Aug 10 23:17:27.777872 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2240/4309] 10.222.0.58 () {60 vars in 1292 bytes} [Wed Aug 10 23:17:27 2022] GET /compute/v2.1/servers/8410ad7d-396e-45d4-b0a4-92405d95fa8a/tags => generated 62 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:17:27.789635 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-68566f6d-9099-4650-9110-99300551d4a7 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Calling method '.version_select at 0x7f847d614ca0>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:27.830315 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-68566f6d-9099-4650-9110-99300551d4a7 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:27.833127 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-68566f6d-9099-4650-9110-99300551d4a7 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:27.835449 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-68566f6d-9099-4650-9110-99300551d4a7 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:27.836535 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-68566f6d-9099-4650-9110-99300551d4a7 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] [instance: 8410ad7d-396e-45d4-b0a4-92405d95fa8a] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:27.848159 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-68566f6d-9099-4650-9110-99300551d4a7 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:27.850556 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-68566f6d-9099-4650-9110-99300551d4a7 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:27.852514 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-68566f6d-9099-4650-9110-99300551d4a7 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:27.853832 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-68566f6d-9099-4650-9110-99300551d4a7 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:27.865740 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-68566f6d-9099-4650-9110-99300551d4a7 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:27.869042 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-68566f6d-9099-4650-9110-99300551d4a7 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:27.938527 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-68566f6d-9099-4650-9110-99300551d4a7 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:27.941896 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-68566f6d-9099-4650-9110-99300551d4a7 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:27.943536 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-68566f6d-9099-4650-9110-99300551d4a7 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:27.993135 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.objects.instance [None req-68566f6d-9099-4650-9110-99300551d4a7 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lazy-loading 'flavor' on Instance uuid 8410ad7d-396e-45d4-b0a4-92405d95fa8a {{(pid=122632) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:17:28.064841 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-f43afd0e-dff1-4c71-be7d-0a3c00e695fd tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:28.065506 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-f43afd0e-dff1-4c71-be7d-0a3c00e695fd tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: 0a5d7302-9eab-4c27-9a4b-7c705e06c290] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:28.066486 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-68566f6d-9099-4650-9110-99300551d4a7 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] 10.222.0.58 "DELETE /compute/v2.1/servers/8410ad7d-396e-45d4-b0a4-92405d95fa8a/tags" status: 204 len: 0 microversion: 2.26 time: 0.282012 Aug 10 23:17:28.069558 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2070/4310] 10.222.0.58 () {60 vars in 1295 bytes} [Wed Aug 10 23:17:27 2022] DELETE /compute/v2.1/servers/8410ad7d-396e-45d4-b0a4-92405d95fa8a/tags => generated 0 bytes in 285 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 10 23:17:28.087429 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-786ad38d-a3b3-4d19-a0c0-a59eddccc08f tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:28.092381 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-786ad38d-a3b3-4d19-a0c0-a59eddccc08f tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] [instance: 8410ad7d-396e-45d4-b0a4-92405d95fa8a] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:28.096135 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f43afd0e-dff1-4c71-be7d-0a3c00e695fd tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:28.096968 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f43afd0e-dff1-4c71-be7d-0a3c00e695fd tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:28.101516 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f43afd0e-dff1-4c71-be7d-0a3c00e695fd tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:28.102295 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f43afd0e-dff1-4c71-be7d-0a3c00e695fd tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:28.102766 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f43afd0e-dff1-4c71-be7d-0a3c00e695fd tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:28.103243 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f43afd0e-dff1-4c71-be7d-0a3c00e695fd tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:28.110442 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-786ad38d-a3b3-4d19-a0c0-a59eddccc08f tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:28.116767 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-786ad38d-a3b3-4d19-a0c0-a59eddccc08f tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:28.117921 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-786ad38d-a3b3-4d19-a0c0-a59eddccc08f tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:28.124286 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-786ad38d-a3b3-4d19-a0c0-a59eddccc08f tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:28.127501 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-786ad38d-a3b3-4d19-a0c0-a59eddccc08f tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:28.128132 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-786ad38d-a3b3-4d19-a0c0-a59eddccc08f tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:28.202397 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=91,nova_cell1:DELETE=3,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=2,nova_cell1:RELEASE=2 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:17:28.227531 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-786ad38d-a3b3-4d19-a0c0-a59eddccc08f tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] [instance: 8410ad7d-396e-45d4-b0a4-92405d95fa8a] Going to try to terminate instance {{(pid=122632) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:17:28.453052 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-f43afd0e-dff1-4c71-be7d-0a3c00e695fd tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:28.475874 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-f43afd0e-dff1-4c71-be7d-0a3c00e695fd tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/0a5d7302-9eab-4c27-9a4b-7c705e06c290" status: 200 len: 1501 microversion: 2.1 time: 0.430754 Aug 10 23:17:28.476547 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2241/4311] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:17:28 2022] GET /compute/v2.1/servers/0a5d7302-9eab-4c27-9a4b-7c705e06c290 => generated 1501 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:17:28.508140 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-644cedb5-2570-45e9-beb4-b3b7a70bb95c tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:28.514979 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-786ad38d-a3b3-4d19-a0c0-a59eddccc08f tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] 10.222.0.58 "DELETE /compute/v2.1/servers/8410ad7d-396e-45d4-b0a4-92405d95fa8a" status: 204 len: 0 microversion: 2.26 time: 0.436387 Aug 10 23:17:28.516531 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-644cedb5-2570-45e9-beb4-b3b7a70bb95c tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] [instance: 23bbe055-4a92-4b96-8b89-c941229bfb0b] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:28.517045 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2071/4312] 10.222.0.58 () {60 vars in 1280 bytes} [Wed Aug 10 23:17:28 2022] DELETE /compute/v2.1/servers/8410ad7d-396e-45d4-b0a4-92405d95fa8a => generated 0 bytes in 439 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 10 23:17:28.525738 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-cc902823-3947-43e6-96bc-a663e27de441 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:17:28.530547 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-644cedb5-2570-45e9-beb4-b3b7a70bb95c tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:28.531243 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-cc902823-3947-43e6-96bc-a663e27de441 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: 0a5d7302-9eab-4c27-9a4b-7c705e06c290] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:28.532398 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-644cedb5-2570-45e9-beb4-b3b7a70bb95c tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:28.538095 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-644cedb5-2570-45e9-beb4-b3b7a70bb95c tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:28.539210 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-644cedb5-2570-45e9-beb4-b3b7a70bb95c tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:28.540254 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-644cedb5-2570-45e9-beb4-b3b7a70bb95c tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:28.540840 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-644cedb5-2570-45e9-beb4-b3b7a70bb95c tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:28.546606 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cc902823-3947-43e6-96bc-a663e27de441 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:28.547280 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cc902823-3947-43e6-96bc-a663e27de441 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:28.547817 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cc902823-3947-43e6-96bc-a663e27de441 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:28.548658 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cc902823-3947-43e6-96bc-a663e27de441 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:28.550547 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cc902823-3947-43e6-96bc-a663e27de441 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:28.556112 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cc902823-3947-43e6-96bc-a663e27de441 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:28.617092 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-644cedb5-2570-45e9-beb4-b3b7a70bb95c tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] HTTP exception thrown: Instance 23bbe055-4a92-4b96-8b89-c941229bfb0b could not be found. Aug 10 23:17:28.621442 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-644cedb5-2570-45e9-beb4-b3b7a70bb95c tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Request method failure captured: Aug 10 23:17:28.621442 n-d-850468-14 devstack@n-api.service[122633]: request: GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b HTTP/1.1 Aug 10 23:17:28.621442 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:17:28.621442 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:17:28.621442 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:17:28.621442 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:17:28.621442 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:17:28.621442 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:17:28.621442 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:17:28.621442 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:17:28.621442 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9DuIKrfOsS8tKST0PsIPrvuNPfsVISfOPvUoe9ddkVcTJKj7rDjd3OuH9u-DTT1aypj1AUoUKtajD98eDOUOHSpPisBSdRlSCov30lHf1uZq-XZLyBIVg5kAG8-SuXk2s1TL7EnRcjjMARSkm95dZDnXaBXRT3M4f8UoMDwqu7xK7gQ Aug 10 23:17:28.621442 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:17:28.621442 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:17:28.621442 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:17:28.621442 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:17:28.621442 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:17:28.621442 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:17:28.621442 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: d11bbb3e87f4463787da56ab19108822 Aug 10 23:17:28.621442 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-ServersNegativeTestJSON-1216728002 Aug 10 23:17:28.621442 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:17:28.621442 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:17:28.621442 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d11bbb3e87f4463787da56ab19108822"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/d11bbb3e87f4463787da56ab19108822"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/d11bbb3e87f4463787da56ab19108822"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_d11bbb3e87f4463787da56ab19108822", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:17:28.621442 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-ServersNegativeTestJSON-1216728002 Aug 10 23:17:28.621442 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: d11bbb3e87f4463787da56ab19108822 Aug 10 23:17:28.621442 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1216728002 Aug 10 23:17:28.621442 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-ServersNegativeTestJSON-1216728002-project Aug 10 23:17:28.621442 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:17:28.621442 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:17:28.621442 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: f284ec2a4bf546b58c1c1adaf880e1fb Aug 10 23:17:28.621442 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-ServersNegativeTestJSON-1216728002-project Aug 10 23:17:28.621442 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:17:28.621442 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance 23bbe055-4a92-4b96-8b89-c941229bfb0b could not be found. Aug 10 23:17:28.621442 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': '23bbe055-4a92-4b96-8b89-c941229bfb0b'} Aug 10 23:17:28.621442 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:17:28.621442 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:17:28.621442 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:17:28.621442 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:17:28.621442 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:17:28.621442 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:17:28.621442 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:17:28.621442 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:17:28.621442 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:17:28.621442 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:17:28.621442 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23bbe055-4a92-4b96-8b89-c941229bfb0b could not be found. Aug 10 23:17:28.621442 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:17:28.621442 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:17:28.621442 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:17:28.621442 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:17:28.621442 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:17:28.621442 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:17:28.621442 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:17:28.621442 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:17:28.621442 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:17:28.621442 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:17:28.621442 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:17:28.621442 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:17:28.621442 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:17:28.621442 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:17:28.621442 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:17:28.621442 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:17:28.621442 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23bbe055-4a92-4b96-8b89-c941229bfb0b could not be found. Aug 10 23:17:28.621442 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:17:28.621442 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:17:28.621442 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:17:28.627554 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:17:28.627554 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:17:28.627554 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:17:28.627554 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:17:28.627554 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:17:28.627554 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23bbe055-4a92-4b96-8b89-c941229bfb0b could not be found. Aug 10 23:17:28.627554 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:17:28.633962 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-644cedb5-2570-45e9-beb4-b3b7a70bb95c tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] Returning 404 to user: Instance 23bbe055-4a92-4b96-8b89-c941229bfb0b could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:17:28.635160 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-644cedb5-2570-45e9-beb4-b3b7a70bb95c tempest-ServersNegativeTestJSON-1216728002 tempest-ServersNegativeTestJSON-1216728002-project] 10.222.0.58 "GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b" status: 404 len: 111 microversion: 2.1 time: 0.149696 Aug 10 23:17:28.636210 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2242/4313] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:17:28 2022] GET /compute/v2.1/servers/23bbe055-4a92-4b96-8b89-c941229bfb0b => generated 111 bytes in 151 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:17:28.649280 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-fc182310-8acc-4dc9-a387-dcdc164a8ec0 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:28.650842 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-fc182310-8acc-4dc9-a387-dcdc164a8ec0 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] [instance: 8410ad7d-396e-45d4-b0a4-92405d95fa8a] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:28.661907 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fc182310-8acc-4dc9-a387-dcdc164a8ec0 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:28.662736 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fc182310-8acc-4dc9-a387-dcdc164a8ec0 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:28.663482 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fc182310-8acc-4dc9-a387-dcdc164a8ec0 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:28.664399 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fc182310-8acc-4dc9-a387-dcdc164a8ec0 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:28.665032 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fc182310-8acc-4dc9-a387-dcdc164a8ec0 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:28.665613 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fc182310-8acc-4dc9-a387-dcdc164a8ec0 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:29.057447 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.network.security_group_api [None req-cc902823-3947-43e6-96bc-a663e27de441 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Removing security group 659ed3c8-c04a-472c-aaef-657b4cd83526 from port b753ef0a-169a-496f-ba6e-46e3a214c4f8 Aug 10 23:17:29.269239 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-fc182310-8acc-4dc9-a387-dcdc164a8ec0 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82a9184aa6c9405f8534e151e6508335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5049eb227494da1b8b328d8ff28d570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:29.281607 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-fc182310-8acc-4dc9-a387-dcdc164a8ec0 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '82a9184aa6c9405f8534e151e6508335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5049eb227494da1b8b328d8ff28d570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:29.289035 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-fc182310-8acc-4dc9-a387-dcdc164a8ec0 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '82a9184aa6c9405f8534e151e6508335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5049eb227494da1b8b328d8ff28d570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:29.292739 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-fc182310-8acc-4dc9-a387-dcdc164a8ec0 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] 10.222.0.58 "GET /compute/v2.1/servers/8410ad7d-396e-45d4-b0a4-92405d95fa8a" status: 200 len: 1553 microversion: 2.26 time: 0.655356 Aug 10 23:17:29.296357 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2243/4314] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:17:28 2022] GET /compute/v2.1/servers/8410ad7d-396e-45d4-b0a4-92405d95fa8a => generated 1553 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:17:30.328568 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-6fad1a50-0cbc-4455-a2b8-0a14519f8d8c tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:30.329898 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-6fad1a50-0cbc-4455-a2b8-0a14519f8d8c tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] [instance: 8410ad7d-396e-45d4-b0a4-92405d95fa8a] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:30.341235 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-cc902823-3947-43e6-96bc-a663e27de441 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "POST /compute/v2.1/servers/0a5d7302-9eab-4c27-9a4b-7c705e06c290/action" status: 202 len: 0 microversion: 2.1 time: 1.822700 Aug 10 23:17:30.343104 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2072/4315] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:17:28 2022] POST /compute/v2.1/servers/0a5d7302-9eab-4c27-9a4b-7c705e06c290/action => generated 0 bytes in 1825 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:17:30.350519 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-2f7269f9-1580-419f-9eba-9441e90cb449 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:30.351377 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-2f7269f9-1580-419f-9eba-9441e90cb449 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: 0a5d7302-9eab-4c27-9a4b-7c705e06c290] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:30.355799 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6fad1a50-0cbc-4455-a2b8-0a14519f8d8c tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:30.358280 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6fad1a50-0cbc-4455-a2b8-0a14519f8d8c tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:30.359050 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6fad1a50-0cbc-4455-a2b8-0a14519f8d8c tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:30.360876 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6fad1a50-0cbc-4455-a2b8-0a14519f8d8c tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:30.361644 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6fad1a50-0cbc-4455-a2b8-0a14519f8d8c tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:30.363422 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6fad1a50-0cbc-4455-a2b8-0a14519f8d8c tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:30.367389 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2f7269f9-1580-419f-9eba-9441e90cb449 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:30.367974 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2f7269f9-1580-419f-9eba-9441e90cb449 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:30.368491 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2f7269f9-1580-419f-9eba-9441e90cb449 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:30.369376 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2f7269f9-1580-419f-9eba-9441e90cb449 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:30.370107 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2f7269f9-1580-419f-9eba-9441e90cb449 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:30.370726 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2f7269f9-1580-419f-9eba-9441e90cb449 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:30.728436 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-6fad1a50-0cbc-4455-a2b8-0a14519f8d8c tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82a9184aa6c9405f8534e151e6508335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5049eb227494da1b8b328d8ff28d570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:30.741755 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-6fad1a50-0cbc-4455-a2b8-0a14519f8d8c tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '82a9184aa6c9405f8534e151e6508335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5049eb227494da1b8b328d8ff28d570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:30.744147 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-6fad1a50-0cbc-4455-a2b8-0a14519f8d8c tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '82a9184aa6c9405f8534e151e6508335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5049eb227494da1b8b328d8ff28d570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:30.745779 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-6fad1a50-0cbc-4455-a2b8-0a14519f8d8c tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] 10.222.0.58 "GET /compute/v2.1/servers/8410ad7d-396e-45d4-b0a4-92405d95fa8a" status: 200 len: 1553 microversion: 2.26 time: 0.422194 Aug 10 23:17:30.760004 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2244/4316] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:17:30 2022] GET /compute/v2.1/servers/8410ad7d-396e-45d4-b0a4-92405d95fa8a => generated 1553 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 23:17:30.852241 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-71e8aaae-c3c0-4b80-83f0-4e2988f0f7b4 req-d9d11242-ad95-4a9e-81df-050709082a8b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a5d7302-9eab-4c27-9a4b-7c705e06c290", "tag": "b753ef0a-169a-496f-ba6e-46e3a214c4f8"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:17:30.875854 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-71e8aaae-c3c0-4b80-83f0-4e2988f0f7b4 req-d9d11242-ad95-4a9e-81df-050709082a8b service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:30.878658 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-71e8aaae-c3c0-4b80-83f0-4e2988f0f7b4 req-d9d11242-ad95-4a9e-81df-050709082a8b service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:30.879915 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-71e8aaae-c3c0-4b80-83f0-4e2988f0f7b4 req-d9d11242-ad95-4a9e-81df-050709082a8b service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:30.905404 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-71e8aaae-c3c0-4b80-83f0-4e2988f0f7b4 req-d9d11242-ad95-4a9e-81df-050709082a8b service nova] Creating event network-changed:b753ef0a-169a-496f-ba6e-46e3a214c4f8 for instance 0a5d7302-9eab-4c27-9a4b-7c705e06c290 on n-h1-850468-14 Aug 10 23:17:30.912238 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-71e8aaae-c3c0-4b80-83f0-4e2988f0f7b4 req-d9d11242-ad95-4a9e-81df-050709082a8b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065072 Aug 10 23:17:30.913479 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2245/4317] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:17:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:17:31.028664 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-2f7269f9-1580-419f-9eba-9441e90cb449 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:31.032901 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=88,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=4,nova_cell1:RELEASE=2,nova_cell1:DELETE=3,nova_cell1:UPDATE=1 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:17:31.050929 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-2f7269f9-1580-419f-9eba-9441e90cb449 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/0a5d7302-9eab-4c27-9a4b-7c705e06c290" status: 200 len: 1459 microversion: 2.1 time: 0.703948 Aug 10 23:17:31.051562 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2073/4318] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:17:30 2022] GET /compute/v2.1/servers/0a5d7302-9eab-4c27-9a4b-7c705e06c290 => generated 1459 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:17:31.087210 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c310d4fd-683a-46d5-9451-69178e4c89b0 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:31.088810 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-c310d4fd-683a-46d5-9451-69178e4c89b0 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: fa9dfd3a-a636-48ce-ae15-0ed51baee954] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:31.107179 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c310d4fd-683a-46d5-9451-69178e4c89b0 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:31.107888 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c310d4fd-683a-46d5-9451-69178e4c89b0 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:31.108988 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c310d4fd-683a-46d5-9451-69178e4c89b0 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:31.110628 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c310d4fd-683a-46d5-9451-69178e4c89b0 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:31.111373 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c310d4fd-683a-46d5-9451-69178e4c89b0 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:31.112366 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c310d4fd-683a-46d5-9451-69178e4c89b0 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:31.458526 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-c310d4fd-683a-46d5-9451-69178e4c89b0 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:31.474899 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-c310d4fd-683a-46d5-9451-69178e4c89b0 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954" status: 200 len: 1667 microversion: 2.1 time: 0.390147 Aug 10 23:17:31.475941 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2246/4319] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:17:31 2022] GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954 => generated 1667 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:17:31.509543 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-35801c46-9314-44a0-b169-6d77c05daf5b tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:31.510913 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-35801c46-9314-44a0-b169-6d77c05daf5b tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: fa9dfd3a-a636-48ce-ae15-0ed51baee954] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:31.526540 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-35801c46-9314-44a0-b169-6d77c05daf5b tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:31.528179 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-35801c46-9314-44a0-b169-6d77c05daf5b tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:31.528675 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-35801c46-9314-44a0-b169-6d77c05daf5b tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:31.530135 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-35801c46-9314-44a0-b169-6d77c05daf5b tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:31.530623 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-35801c46-9314-44a0-b169-6d77c05daf5b tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:31.533415 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-35801c46-9314-44a0-b169-6d77c05daf5b tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:31.773673 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-77a92070-5829-4f9a-926e-cf229b1f5b9d tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:31.775101 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-77a92070-5829-4f9a-926e-cf229b1f5b9d tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] [instance: 8410ad7d-396e-45d4-b0a4-92405d95fa8a] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:31.787818 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-77a92070-5829-4f9a-926e-cf229b1f5b9d tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:31.792320 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-77a92070-5829-4f9a-926e-cf229b1f5b9d tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:31.792815 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-77a92070-5829-4f9a-926e-cf229b1f5b9d tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:31.793694 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-77a92070-5829-4f9a-926e-cf229b1f5b9d tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:31.795385 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-77a92070-5829-4f9a-926e-cf229b1f5b9d tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:31.803646 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-77a92070-5829-4f9a-926e-cf229b1f5b9d tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:32.353704 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-77a92070-5829-4f9a-926e-cf229b1f5b9d tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82a9184aa6c9405f8534e151e6508335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5049eb227494da1b8b328d8ff28d570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:32.370816 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-77a92070-5829-4f9a-926e-cf229b1f5b9d tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '82a9184aa6c9405f8534e151e6508335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5049eb227494da1b8b328d8ff28d570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:32.372553 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-77a92070-5829-4f9a-926e-cf229b1f5b9d tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '82a9184aa6c9405f8534e151e6508335', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b5049eb227494da1b8b328d8ff28d570', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:32.373831 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-77a92070-5829-4f9a-926e-cf229b1f5b9d tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] 10.222.0.58 "GET /compute/v2.1/servers/8410ad7d-396e-45d4-b0a4-92405d95fa8a" status: 200 len: 1553 microversion: 2.26 time: 0.604890 Aug 10 23:17:32.374415 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2247/4320] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:17:31 2022] GET /compute/v2.1/servers/8410ad7d-396e-45d4-b0a4-92405d95fa8a => generated 1553 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:17:32.381380 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-75d6b532-e594-450b-b1ff-4f20884ebdd2 req-968c4b50-ead5-4dc4-92f2-68cbd7b03042 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "250395b5-5be8-420a-8709-dcf8b4241a4e", "name": "network-vif-plugged", "status": "completed", "tag": "fb6df67c-3dbb-4a0f-98f0-c602e1eaa615"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:17:32.410591 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-75d6b532-e594-450b-b1ff-4f20884ebdd2 req-968c4b50-ead5-4dc4-92f2-68cbd7b03042 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:32.411448 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-75d6b532-e594-450b-b1ff-4f20884ebdd2 req-968c4b50-ead5-4dc4-92f2-68cbd7b03042 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:32.412170 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-75d6b532-e594-450b-b1ff-4f20884ebdd2 req-968c4b50-ead5-4dc4-92f2-68cbd7b03042 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:32.438692 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-75d6b532-e594-450b-b1ff-4f20884ebdd2 req-968c4b50-ead5-4dc4-92f2-68cbd7b03042 service nova] Creating event network-vif-plugged:fb6df67c-3dbb-4a0f-98f0-c602e1eaa615 for instance 250395b5-5be8-420a-8709-dcf8b4241a4e on n-h1-850468-14 Aug 10 23:17:32.449914 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-75d6b532-e594-450b-b1ff-4f20884ebdd2 req-968c4b50-ead5-4dc4-92f2-68cbd7b03042 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073564 Aug 10 23:17:32.451569 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2248/4321] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:17:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:17:32.557888 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-35801c46-9314-44a0-b169-6d77c05daf5b tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:32.573388 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-35801c46-9314-44a0-b169-6d77c05daf5b tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954" status: 200 len: 1667 microversion: 2.1 time: 1.072105 Aug 10 23:17:32.573975 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2074/4322] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:17:31 2022] GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954 => generated 1667 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:17:32.600487 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-cf018cb2-2ad3-4aed-8b20-a2e6154c9f6d tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:32.601236 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-cf018cb2-2ad3-4aed-8b20-a2e6154c9f6d tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: fa9dfd3a-a636-48ce-ae15-0ed51baee954] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:32.613833 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cf018cb2-2ad3-4aed-8b20-a2e6154c9f6d tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:32.614371 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cf018cb2-2ad3-4aed-8b20-a2e6154c9f6d tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:32.614986 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cf018cb2-2ad3-4aed-8b20-a2e6154c9f6d tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:32.615647 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cf018cb2-2ad3-4aed-8b20-a2e6154c9f6d tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:32.618805 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cf018cb2-2ad3-4aed-8b20-a2e6154c9f6d tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:32.619639 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cf018cb2-2ad3-4aed-8b20-a2e6154c9f6d tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:32.981424 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-48fac91a-1a61-449b-87d5-ad432fedc1fd req-b9fe8d55-ffc1-4e4e-8a4c-35e5ab210328 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8410ad7d-396e-45d4-b0a4-92405d95fa8a", "name": "network-vif-deleted", "tag": "ccf7cb63-ddd1-4364-82f5-56de3ab3892c"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:17:33.009577 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-48fac91a-1a61-449b-87d5-ad432fedc1fd req-b9fe8d55-ffc1-4e4e-8a4c-35e5ab210328 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:33.013938 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-48fac91a-1a61-449b-87d5-ad432fedc1fd req-b9fe8d55-ffc1-4e4e-8a4c-35e5ab210328 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:33.015127 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-48fac91a-1a61-449b-87d5-ad432fedc1fd req-b9fe8d55-ffc1-4e4e-8a4c-35e5ab210328 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:33.039396 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-48fac91a-1a61-449b-87d5-ad432fedc1fd req-b9fe8d55-ffc1-4e4e-8a4c-35e5ab210328 service nova] Creating event network-vif-deleted:ccf7cb63-ddd1-4364-82f5-56de3ab3892c for instance 8410ad7d-396e-45d4-b0a4-92405d95fa8a on n-h2-850468-14 Aug 10 23:17:33.062374 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-48fac91a-1a61-449b-87d5-ad432fedc1fd req-b9fe8d55-ffc1-4e4e-8a4c-35e5ab210328 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076055 Aug 10 23:17:33.065207 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2075/4323] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:17:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 23:17:33.408535 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-edefc2a6-d6c4-4fdb-aa48-1f2e21bcba59 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:33.409297 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-edefc2a6-d6c4-4fdb-aa48-1f2e21bcba59 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] [instance: 8410ad7d-396e-45d4-b0a4-92405d95fa8a] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:33.434093 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-edefc2a6-d6c4-4fdb-aa48-1f2e21bcba59 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:33.434582 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-edefc2a6-d6c4-4fdb-aa48-1f2e21bcba59 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:33.445438 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-edefc2a6-d6c4-4fdb-aa48-1f2e21bcba59 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:33.448122 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-edefc2a6-d6c4-4fdb-aa48-1f2e21bcba59 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:33.450528 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-edefc2a6-d6c4-4fdb-aa48-1f2e21bcba59 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:33.452579 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-edefc2a6-d6c4-4fdb-aa48-1f2e21bcba59 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:33.491481 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-edefc2a6-d6c4-4fdb-aa48-1f2e21bcba59 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] HTTP exception thrown: Instance 8410ad7d-396e-45d4-b0a4-92405d95fa8a could not be found. Aug 10 23:17:33.493758 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-edefc2a6-d6c4-4fdb-aa48-1f2e21bcba59 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Request method failure captured: Aug 10 23:17:33.493758 n-d-850468-14 devstack@n-api.service[122632]: request: GET /compute/v2.1/servers/8410ad7d-396e-45d4-b0a4-92405d95fa8a HTTP/1.1 Aug 10 23:17:33.493758 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:17:33.493758 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:17:33.493758 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:17:33.493758 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 23:17:33.493758 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:17:33.493758 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:17:33.493758 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:17:33.493758 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:17:33.493758 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9DxoJWGhF7Co-O8MTclvcbno3XSBgptnKMcPEVedIJoqYbP9Jyy1t4zrCRwP1HUqDF3DifZr4UNpb4_ARAFDvymXk33zckGkFl4AT-GeOngtKiWejFhTwO40ByclyNfIyLEZXmxYNQigR0syBHS4A_7KslpN7UeBaiNJls1Vr2Flmqk Aug 10 23:17:33.493758 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:17:33.493758 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:17:33.493758 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:17:33.493758 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:17:33.493758 n-d-850468-14 devstack@n-api.service[122632]: X-Openstack-Nova-Api-Version: 2.26 Aug 10 23:17:33.493758 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:17:33.493758 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:17:33.493758 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: b5049eb227494da1b8b328d8ff28d570 Aug 10 23:17:33.493758 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-ServerTagsTestJSON-1978454333 Aug 10 23:17:33.493758 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:17:33.493758 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:17:33.493758 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b5049eb227494da1b8b328d8ff28d570"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b5049eb227494da1b8b328d8ff28d570"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b5049eb227494da1b8b328d8ff28d570"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b5049eb227494da1b8b328d8ff28d570", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:17:33.493758 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-ServerTagsTestJSON-1978454333 Aug 10 23:17:33.493758 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: b5049eb227494da1b8b328d8ff28d570 Aug 10 23:17:33.493758 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-ServerTagsTestJSON-1978454333 Aug 10 23:17:33.493758 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-ServerTagsTestJSON-1978454333-project Aug 10 23:17:33.493758 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:17:33.493758 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:17:33.493758 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: 82a9184aa6c9405f8534e151e6508335 Aug 10 23:17:33.493758 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-ServerTagsTestJSON-1978454333-project Aug 10 23:17:33.493758 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:17:33.493758 n-d-850468-14 devstack@n-api.service[122632]: exception: Instance 8410ad7d-396e-45d4-b0a4-92405d95fa8a could not be found. Aug 10 23:17:33.493758 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': '8410ad7d-396e-45d4-b0a4-92405d95fa8a'} Aug 10 23:17:33.493758 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:17:33.493758 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:17:33.493758 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:17:33.493758 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:17:33.493758 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:17:33.493758 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:17:33.493758 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:17:33.493758 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:17:33.493758 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:17:33.493758 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:17:33.493758 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8410ad7d-396e-45d4-b0a4-92405d95fa8a could not be found. Aug 10 23:17:33.493758 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:17:33.493758 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:17:33.493758 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:17:33.493758 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:17:33.493758 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:17:33.493758 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:17:33.493758 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:17:33.493758 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:17:33.493758 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:17:33.493758 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:17:33.493758 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:17:33.493758 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:17:33.493758 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:17:33.493758 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:17:33.493758 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:17:33.493758 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:17:33.493758 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8410ad7d-396e-45d4-b0a4-92405d95fa8a could not be found. Aug 10 23:17:33.493758 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:17:33.493758 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:17:33.493758 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:17:33.499134 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:17:33.499134 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:17:33.499134 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:17:33.499134 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:17:33.499134 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:17:33.499134 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8410ad7d-396e-45d4-b0a4-92405d95fa8a could not be found. Aug 10 23:17:33.499134 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:17:33.501301 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-edefc2a6-d6c4-4fdb-aa48-1f2e21bcba59 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] Returning 404 to user: Instance 8410ad7d-396e-45d4-b0a4-92405d95fa8a could not be found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:17:33.503001 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-edefc2a6-d6c4-4fdb-aa48-1f2e21bcba59 tempest-ServerTagsTestJSON-1978454333 tempest-ServerTagsTestJSON-1978454333-project] 10.222.0.58 "GET /compute/v2.1/servers/8410ad7d-396e-45d4-b0a4-92405d95fa8a" status: 404 len: 111 microversion: 2.26 time: 0.100691 Aug 10 23:17:33.504077 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2076/4324] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:17:33 2022] GET /compute/v2.1/servers/8410ad7d-396e-45d4-b0a4-92405d95fa8a => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 10 23:17:33.543099 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-cf018cb2-2ad3-4aed-8b20-a2e6154c9f6d tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:33.558413 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-cf018cb2-2ad3-4aed-8b20-a2e6154c9f6d tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954" status: 200 len: 1667 microversion: 2.1 time: 0.957515 Aug 10 23:17:33.559082 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2249/4325] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:17:32 2022] GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954 => generated 1667 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:17:33.588380 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-4ae57a9d-e33f-48ce-8129-9f658f6d530a tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:33.589759 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-4ae57a9d-e33f-48ce-8129-9f658f6d530a tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: fa9dfd3a-a636-48ce-ae15-0ed51baee954] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:33.598519 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4ae57a9d-e33f-48ce-8129-9f658f6d530a tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:33.599287 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4ae57a9d-e33f-48ce-8129-9f658f6d530a tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:33.599975 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4ae57a9d-e33f-48ce-8129-9f658f6d530a tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:33.601110 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4ae57a9d-e33f-48ce-8129-9f658f6d530a tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:33.602253 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4ae57a9d-e33f-48ce-8129-9f658f6d530a tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:33.602877 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4ae57a9d-e33f-48ce-8129-9f658f6d530a tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:34.451293 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-4ae57a9d-e33f-48ce-8129-9f658f6d530a tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:34.469334 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-4ae57a9d-e33f-48ce-8129-9f658f6d530a tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954" status: 200 len: 1667 microversion: 2.1 time: 0.883103 Aug 10 23:17:34.480184 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2077/4326] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:17:33 2022] GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954 => generated 1667 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:17:34.733175 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-94755b90-8963-4036-b54f-8aa734fc9bc2 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-84605017", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452", "networks": [{"uuid": "9e4068f0-b1bd-443a-a951-7f332436087d"}]}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:17:34.809909 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.network.neutron [None req-94755b90-8963-4036-b54f-8aa734fc9bc2 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] validate_networks() for [('9e4068f0-b1bd-443a-a951-7f332436087d', None, None, None, None, None)] {{(pid=122633) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 23:17:36.150350 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-94755b90-8963-4036-b54f-8aa734fc9bc2 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Flavor limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:17:36.151322 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-94755b90-8963-4036-b54f-8aa734fc9bc2 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Image limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:17:36.160543 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-94755b90-8963-4036-b54f-8aa734fc9bc2 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Flavor pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:17:36.161202 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-94755b90-8963-4036-b54f-8aa734fc9bc2 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Image pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:17:36.161791 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-94755b90-8963-4036-b54f-8aa734fc9bc2 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:17:36.189693 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-94755b90-8963-4036-b54f-8aa734fc9bc2 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:36.190085 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-94755b90-8963-4036-b54f-8aa734fc9bc2 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:36.190580 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-94755b90-8963-4036-b54f-8aa734fc9bc2 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:36.197885 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-94755b90-8963-4036-b54f-8aa734fc9bc2 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:36.198942 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-94755b90-8963-4036-b54f-8aa734fc9bc2 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:36.201899 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-94755b90-8963-4036-b54f-8aa734fc9bc2 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:36.291152 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-94755b90-8963-4036-b54f-8aa734fc9bc2 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Getting quotas for project 1eb12683ada249bfa2ca7bf5cf730ca3. Resources: {'instances', 'cores', 'ram'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:17:36.299921 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-94755b90-8963-4036-b54f-8aa734fc9bc2 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Getting quotas for user 2ea96841d5b64d2390d18b3eb5da8b73 and project 1eb12683ada249bfa2ca7bf5cf730ca3. Resources: {'instances', 'cores', 'ram'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:17:36.334359 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-94755b90-8963-4036-b54f-8aa734fc9bc2 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Going to run 1 instances... {{(pid=122633) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 23:17:36.349874 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-94755b90-8963-4036-b54f-8aa734fc9bc2 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: 7f49d27c-0fba-4d08-8f85-3eaed8b805e7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78ad8905-f66f-4733-8be9-2b260f1fabed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122633) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 23:17:36.504942 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-94755b90-8963-4036-b54f-8aa734fc9bc2 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.781272 Aug 10 23:17:36.516297 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2250/4327] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 23:17:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 1793 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 23:17:36.528265 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-3fda51fd-0ca4-4e47-be0a-f08dc48b7b16 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:36.531222 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-3fda51fd-0ca4-4e47-be0a-f08dc48b7b16 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: 7f49d27c-0fba-4d08-8f85-3eaed8b805e7] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:36.834124 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-3fda51fd-0ca4-4e47-be0a-f08dc48b7b16 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:36.850624 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-3fda51fd-0ca4-4e47-be0a-f08dc48b7b16 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/7f49d27c-0fba-4d08-8f85-3eaed8b805e7" status: 200 len: 1213 microversion: 2.1 time: 0.326410 Aug 10 23:17:36.863731 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2078/4328] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:17:36 2022] GET /compute/v2.1/servers/7f49d27c-0fba-4d08-8f85-3eaed8b805e7 => generated 1213 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:17:37.318802 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-19a6e1e7-258b-484e-abb7-96e2dacef6d4 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:17:37.326947 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-19a6e1e7-258b-484e-abb7-96e2dacef6d4 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] [instance: 3ecbcf63-5592-4074-a3f7-d2caf3c58969] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:37.353109 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-19a6e1e7-258b-484e-abb7-96e2dacef6d4 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:37.354532 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-19a6e1e7-258b-484e-abb7-96e2dacef6d4 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:37.362390 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-19a6e1e7-258b-484e-abb7-96e2dacef6d4 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:37.363329 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-19a6e1e7-258b-484e-abb7-96e2dacef6d4 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:37.368564 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-19a6e1e7-258b-484e-abb7-96e2dacef6d4 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:37.373119 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-19a6e1e7-258b-484e-abb7-96e2dacef6d4 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:37.466879 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.objects.instance [None req-19a6e1e7-258b-484e-abb7-96e2dacef6d4 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lazy-loading 'flavor' on Instance uuid 3ecbcf63-5592-4074-a3f7-d2caf3c58969 {{(pid=122633) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:17:37.882300 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-6ad38830-69be-486b-8033-7fefadf6fccc tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:37.885025 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-6ad38830-69be-486b-8033-7fefadf6fccc tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: 7f49d27c-0fba-4d08-8f85-3eaed8b805e7] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:37.928092 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-19a6e1e7-258b-484e-abb7-96e2dacef6d4 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] 10.222.0.58 "POST /compute/v2.1/servers/3ecbcf63-5592-4074-a3f7-d2caf3c58969/action" status: 200 len: 32 microversion: 2.1 time: 0.612199 Aug 10 23:17:37.932817 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2251/4329] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:17:37 2022] POST /compute/v2.1/servers/3ecbcf63-5592-4074-a3f7-d2caf3c58969/action => generated 32 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 23:17:37.941366 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6ad38830-69be-486b-8033-7fefadf6fccc tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:37.945941 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6ad38830-69be-486b-8033-7fefadf6fccc tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:37.953231 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-0a8d1d13-fa3c-4c4d-861c-d7347c5eab46 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:37.953725 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6ad38830-69be-486b-8033-7fefadf6fccc tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:37.955696 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-0a8d1d13-fa3c-4c4d-861c-d7347c5eab46 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] [instance: 3ecbcf63-5592-4074-a3f7-d2caf3c58969] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:37.957749 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6ad38830-69be-486b-8033-7fefadf6fccc tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:37.973552 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6ad38830-69be-486b-8033-7fefadf6fccc tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:37.974428 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0a8d1d13-fa3c-4c4d-861c-d7347c5eab46 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:37.983341 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0a8d1d13-fa3c-4c4d-861c-d7347c5eab46 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:37.984201 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0a8d1d13-fa3c-4c4d-861c-d7347c5eab46 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:37.985710 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6ad38830-69be-486b-8033-7fefadf6fccc tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:37.986386 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0a8d1d13-fa3c-4c4d-861c-d7347c5eab46 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:37.988274 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0a8d1d13-fa3c-4c4d-861c-d7347c5eab46 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:37.989252 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0a8d1d13-fa3c-4c4d-861c-d7347c5eab46 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:38.694300 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-6ad38830-69be-486b-8033-7fefadf6fccc tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:38.757121 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-6ad38830-69be-486b-8033-7fefadf6fccc tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/7f49d27c-0fba-4d08-8f85-3eaed8b805e7" status: 200 len: 1265 microversion: 2.1 time: 0.884050 Aug 10 23:17:38.773866 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2079/4330] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:17:37 2022] GET /compute/v2.1/servers/7f49d27c-0fba-4d08-8f85-3eaed8b805e7 => generated 1265 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:17:39.102701 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-0a8d1d13-fa3c-4c4d-861c-d7347c5eab46 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07c94ebf0954cdea12b9a689538d96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395d7c4077e54c43bb95288db3942b0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:39.118670 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-0a8d1d13-fa3c-4c4d-861c-d7347c5eab46 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] 10.222.0.58 "GET /compute/v2.1/servers/3ecbcf63-5592-4074-a3f7-d2caf3c58969" status: 200 len: 1737 microversion: 2.1 time: 1.178279 Aug 10 23:17:39.119727 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2252/4331] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:17:37 2022] GET /compute/v2.1/servers/3ecbcf63-5592-4074-a3f7-d2caf3c58969 => generated 1737 bytes in 1181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:17:39.781796 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-be8baa06-1bd6-4a04-9304-d22853d93083 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:39.782362 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-be8baa06-1bd6-4a04-9304-d22853d93083 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: 7f49d27c-0fba-4d08-8f85-3eaed8b805e7] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:39.793828 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-be8baa06-1bd6-4a04-9304-d22853d93083 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:39.795246 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-be8baa06-1bd6-4a04-9304-d22853d93083 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:39.795801 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-be8baa06-1bd6-4a04-9304-d22853d93083 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:39.796523 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-be8baa06-1bd6-4a04-9304-d22853d93083 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:39.796973 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-be8baa06-1bd6-4a04-9304-d22853d93083 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:39.797397 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-be8baa06-1bd6-4a04-9304-d22853d93083 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:40.145452 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-6d32b606-494d-482c-b26f-9d4d3b319136 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:40.146225 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-6d32b606-494d-482c-b26f-9d4d3b319136 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] [instance: 3ecbcf63-5592-4074-a3f7-d2caf3c58969] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:40.158733 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6d32b606-494d-482c-b26f-9d4d3b319136 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:40.159811 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6d32b606-494d-482c-b26f-9d4d3b319136 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:40.160752 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6d32b606-494d-482c-b26f-9d4d3b319136 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:40.161905 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6d32b606-494d-482c-b26f-9d4d3b319136 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:40.162516 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6d32b606-494d-482c-b26f-9d4d3b319136 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:40.163332 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6d32b606-494d-482c-b26f-9d4d3b319136 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:40.211047 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-be8baa06-1bd6-4a04-9304-d22853d93083 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:40.224241 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-be8baa06-1bd6-4a04-9304-d22853d93083 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/7f49d27c-0fba-4d08-8f85-3eaed8b805e7" status: 200 len: 1271 microversion: 2.1 time: 0.448043 Aug 10 23:17:40.230342 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2080/4332] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:17:39 2022] GET /compute/v2.1/servers/7f49d27c-0fba-4d08-8f85-3eaed8b805e7 => generated 1271 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:17:40.444735 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-6d32b606-494d-482c-b26f-9d4d3b319136 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07c94ebf0954cdea12b9a689538d96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395d7c4077e54c43bb95288db3942b0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:40.475123 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-6d32b606-494d-482c-b26f-9d4d3b319136 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] 10.222.0.58 "GET /compute/v2.1/servers/3ecbcf63-5592-4074-a3f7-d2caf3c58969" status: 200 len: 1737 microversion: 2.1 time: 0.333878 Aug 10 23:17:40.487252 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2253/4333] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:17:40 2022] GET /compute/v2.1/servers/3ecbcf63-5592-4074-a3f7-d2caf3c58969 => generated 1737 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:17:41.245969 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-d16701f5-6169-4fda-9834-2d33207d0eee tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:41.246685 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-d16701f5-6169-4fda-9834-2d33207d0eee tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: 7f49d27c-0fba-4d08-8f85-3eaed8b805e7] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:41.257785 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d16701f5-6169-4fda-9834-2d33207d0eee tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:41.258289 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d16701f5-6169-4fda-9834-2d33207d0eee tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:41.258732 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d16701f5-6169-4fda-9834-2d33207d0eee tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:41.259494 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d16701f5-6169-4fda-9834-2d33207d0eee tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:41.264126 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d16701f5-6169-4fda-9834-2d33207d0eee tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:41.267232 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d16701f5-6169-4fda-9834-2d33207d0eee tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:41.507435 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-7b311b35-adaa-474b-9da2-ce2c103f239c tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:41.508936 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-7b311b35-adaa-474b-9da2-ce2c103f239c tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] [instance: 3ecbcf63-5592-4074-a3f7-d2caf3c58969] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:41.540783 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7b311b35-adaa-474b-9da2-ce2c103f239c tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:41.541290 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7b311b35-adaa-474b-9da2-ce2c103f239c tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:41.541924 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7b311b35-adaa-474b-9da2-ce2c103f239c tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:41.543313 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7b311b35-adaa-474b-9da2-ce2c103f239c tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:41.546558 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7b311b35-adaa-474b-9da2-ce2c103f239c tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:41.547062 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7b311b35-adaa-474b-9da2-ce2c103f239c tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:41.718174 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-d16701f5-6169-4fda-9834-2d33207d0eee tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:41.732479 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-d16701f5-6169-4fda-9834-2d33207d0eee tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/7f49d27c-0fba-4d08-8f85-3eaed8b805e7" status: 200 len: 1271 microversion: 2.1 time: 0.489984 Aug 10 23:17:41.747545 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2081/4334] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:17:41 2022] GET /compute/v2.1/servers/7f49d27c-0fba-4d08-8f85-3eaed8b805e7 => generated 1271 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:17:41.938827 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-7b311b35-adaa-474b-9da2-ce2c103f239c tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07c94ebf0954cdea12b9a689538d96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395d7c4077e54c43bb95288db3942b0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:41.948141 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-7b311b35-adaa-474b-9da2-ce2c103f239c tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] 10.222.0.58 "GET /compute/v2.1/servers/3ecbcf63-5592-4074-a3f7-d2caf3c58969" status: 200 len: 1737 microversion: 2.1 time: 0.451416 Aug 10 23:17:41.952768 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2254/4335] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:17:41 2022] GET /compute/v2.1/servers/3ecbcf63-5592-4074-a3f7-d2caf3c58969 => generated 1737 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:17:42.758668 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-2b6a017e-a72d-446e-b06b-eb00b1c749e9 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:42.759297 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-2b6a017e-a72d-446e-b06b-eb00b1c749e9 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: 7f49d27c-0fba-4d08-8f85-3eaed8b805e7] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:42.773309 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2b6a017e-a72d-446e-b06b-eb00b1c749e9 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:42.773808 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2b6a017e-a72d-446e-b06b-eb00b1c749e9 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:42.774253 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2b6a017e-a72d-446e-b06b-eb00b1c749e9 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:42.775003 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2b6a017e-a72d-446e-b06b-eb00b1c749e9 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:42.775464 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2b6a017e-a72d-446e-b06b-eb00b1c749e9 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:42.775894 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2b6a017e-a72d-446e-b06b-eb00b1c749e9 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:42.972440 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-4646ff08-b669-4ecb-8fb1-a70c6fad9a3e tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:42.973660 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-4646ff08-b669-4ecb-8fb1-a70c6fad9a3e tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] [instance: 3ecbcf63-5592-4074-a3f7-d2caf3c58969] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:42.993527 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4646ff08-b669-4ecb-8fb1-a70c6fad9a3e tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:42.994195 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4646ff08-b669-4ecb-8fb1-a70c6fad9a3e tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:42.994846 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4646ff08-b669-4ecb-8fb1-a70c6fad9a3e tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:42.995739 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4646ff08-b669-4ecb-8fb1-a70c6fad9a3e tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:42.996345 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4646ff08-b669-4ecb-8fb1-a70c6fad9a3e tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:42.997462 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4646ff08-b669-4ecb-8fb1-a70c6fad9a3e tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:43.347208 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-4646ff08-b669-4ecb-8fb1-a70c6fad9a3e tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07c94ebf0954cdea12b9a689538d96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395d7c4077e54c43bb95288db3942b0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:43.364817 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-4646ff08-b669-4ecb-8fb1-a70c6fad9a3e tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] 10.222.0.58 "GET /compute/v2.1/servers/3ecbcf63-5592-4074-a3f7-d2caf3c58969" status: 200 len: 1737 microversion: 2.1 time: 0.396113 Aug 10 23:17:43.371378 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2255/4336] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:17:42 2022] GET /compute/v2.1/servers/3ecbcf63-5592-4074-a3f7-d2caf3c58969 => generated 1737 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:17:44.178330 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-2b6a017e-a72d-446e-b06b-eb00b1c749e9 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:44.196603 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-2b6a017e-a72d-446e-b06b-eb00b1c749e9 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/7f49d27c-0fba-4d08-8f85-3eaed8b805e7" status: 200 len: 1313 microversion: 2.1 time: 1.441376 Aug 10 23:17:44.198896 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2082/4337] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:17:42 2022] GET /compute/v2.1/servers/7f49d27c-0fba-4d08-8f85-3eaed8b805e7 => generated 1313 bytes in 1447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:17:44.389927 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-0282d597-a0a6-4164-a651-b507d1c32bbd tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:44.390816 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-0282d597-a0a6-4164-a651-b507d1c32bbd tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] [instance: 3ecbcf63-5592-4074-a3f7-d2caf3c58969] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:44.405141 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0282d597-a0a6-4164-a651-b507d1c32bbd tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:44.405848 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0282d597-a0a6-4164-a651-b507d1c32bbd tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:44.410102 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0282d597-a0a6-4164-a651-b507d1c32bbd tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:44.411241 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0282d597-a0a6-4164-a651-b507d1c32bbd tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:44.414012 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0282d597-a0a6-4164-a651-b507d1c32bbd tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:44.414598 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0282d597-a0a6-4164-a651-b507d1c32bbd tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:44.984830 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-0282d597-a0a6-4164-a651-b507d1c32bbd tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07c94ebf0954cdea12b9a689538d96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395d7c4077e54c43bb95288db3942b0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:45.015982 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-0282d597-a0a6-4164-a651-b507d1c32bbd tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] 10.222.0.58 "GET /compute/v2.1/servers/3ecbcf63-5592-4074-a3f7-d2caf3c58969" status: 200 len: 1737 microversion: 2.1 time: 0.630247 Aug 10 23:17:45.017476 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2256/4338] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:17:44 2022] GET /compute/v2.1/servers/3ecbcf63-5592-4074-a3f7-d2caf3c58969 => generated 1737 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:17:45.221783 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-19622872-40c2-45ed-9db7-146283532fe4 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:45.223405 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-19622872-40c2-45ed-9db7-146283532fe4 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: 7f49d27c-0fba-4d08-8f85-3eaed8b805e7] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:45.236238 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-19622872-40c2-45ed-9db7-146283532fe4 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:45.240376 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-19622872-40c2-45ed-9db7-146283532fe4 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:45.241152 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-19622872-40c2-45ed-9db7-146283532fe4 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:45.242080 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-19622872-40c2-45ed-9db7-146283532fe4 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:45.242709 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-19622872-40c2-45ed-9db7-146283532fe4 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:45.248803 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-19622872-40c2-45ed-9db7-146283532fe4 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:46.040980 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-318028f0-240f-46cb-9113-d85eef9b0cd9 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:46.041614 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-318028f0-240f-46cb-9113-d85eef9b0cd9 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] [instance: 3ecbcf63-5592-4074-a3f7-d2caf3c58969] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:46.067757 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-318028f0-240f-46cb-9113-d85eef9b0cd9 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:46.068430 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-318028f0-240f-46cb-9113-d85eef9b0cd9 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:46.068847 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-318028f0-240f-46cb-9113-d85eef9b0cd9 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:46.078165 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-318028f0-240f-46cb-9113-d85eef9b0cd9 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:46.078685 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-318028f0-240f-46cb-9113-d85eef9b0cd9 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:46.079168 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-318028f0-240f-46cb-9113-d85eef9b0cd9 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:46.237802 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=2 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:17:46.320789 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=6 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:17:46.395181 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-19622872-40c2-45ed-9db7-146283532fe4 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:46.463865 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-19622872-40c2-45ed-9db7-146283532fe4 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/7f49d27c-0fba-4d08-8f85-3eaed8b805e7" status: 200 len: 1313 microversion: 2.1 time: 1.248030 Aug 10 23:17:46.470097 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2083/4339] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:17:45 2022] GET /compute/v2.1/servers/7f49d27c-0fba-4d08-8f85-3eaed8b805e7 => generated 1313 bytes in 1255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:17:46.899115 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-318028f0-240f-46cb-9113-d85eef9b0cd9 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07c94ebf0954cdea12b9a689538d96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395d7c4077e54c43bb95288db3942b0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:46.915690 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-318028f0-240f-46cb-9113-d85eef9b0cd9 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] 10.222.0.58 "GET /compute/v2.1/servers/3ecbcf63-5592-4074-a3f7-d2caf3c58969" status: 200 len: 1737 microversion: 2.1 time: 0.878696 Aug 10 23:17:46.916571 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2257/4340] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:17:46 2022] GET /compute/v2.1/servers/3ecbcf63-5592-4074-a3f7-d2caf3c58969 => generated 1737 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:17:47.491832 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-a718d9b1-44eb-43cc-99b9-1f4e247c19e3 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:47.492446 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-a718d9b1-44eb-43cc-99b9-1f4e247c19e3 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: 7f49d27c-0fba-4d08-8f85-3eaed8b805e7] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:47.503376 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=2 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:17:47.506187 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a718d9b1-44eb-43cc-99b9-1f4e247c19e3 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:47.506679 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a718d9b1-44eb-43cc-99b9-1f4e247c19e3 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:47.515458 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a718d9b1-44eb-43cc-99b9-1f4e247c19e3 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:47.516331 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a718d9b1-44eb-43cc-99b9-1f4e247c19e3 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:47.516800 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a718d9b1-44eb-43cc-99b9-1f4e247c19e3 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:47.517409 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a718d9b1-44eb-43cc-99b9-1f4e247c19e3 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:47.938990 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-a2d6e591-60fc-448c-9fcd-cebabebc2de2 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:47.939691 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-a2d6e591-60fc-448c-9fcd-cebabebc2de2 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] [instance: 3ecbcf63-5592-4074-a3f7-d2caf3c58969] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:47.953157 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a2d6e591-60fc-448c-9fcd-cebabebc2de2 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:47.953649 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a2d6e591-60fc-448c-9fcd-cebabebc2de2 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:47.954161 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a2d6e591-60fc-448c-9fcd-cebabebc2de2 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:47.954931 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a2d6e591-60fc-448c-9fcd-cebabebc2de2 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:47.955453 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a2d6e591-60fc-448c-9fcd-cebabebc2de2 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:47.955907 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a2d6e591-60fc-448c-9fcd-cebabebc2de2 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:48.649879 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-a718d9b1-44eb-43cc-99b9-1f4e247c19e3 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:48.662193 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-a718d9b1-44eb-43cc-99b9-1f4e247c19e3 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/7f49d27c-0fba-4d08-8f85-3eaed8b805e7" status: 200 len: 1313 microversion: 2.1 time: 1.178176 Aug 10 23:17:48.676885 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2084/4341] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:17:47 2022] GET /compute/v2.1/servers/7f49d27c-0fba-4d08-8f85-3eaed8b805e7 => generated 1313 bytes in 1193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:17:48.689380 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-6f4aa33c-5425-48f4-8c45-3507a84faa37 req-e31e996d-f7c5-4b65-95af-cccd4dbb11a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f49d27c-0fba-4d08-8f85-3eaed8b805e7", "tag": "69ad680e-3222-4e16-9619-7f0a0d9623e5"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:17:48.731312 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-6f4aa33c-5425-48f4-8c45-3507a84faa37 req-e31e996d-f7c5-4b65-95af-cccd4dbb11a7 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:48.732197 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-6f4aa33c-5425-48f4-8c45-3507a84faa37 req-e31e996d-f7c5-4b65-95af-cccd4dbb11a7 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:48.732653 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-6f4aa33c-5425-48f4-8c45-3507a84faa37 req-e31e996d-f7c5-4b65-95af-cccd4dbb11a7 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:48.771535 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-6f4aa33c-5425-48f4-8c45-3507a84faa37 req-e31e996d-f7c5-4b65-95af-cccd4dbb11a7 service nova] Creating event network-changed:69ad680e-3222-4e16-9619-7f0a0d9623e5 for instance 7f49d27c-0fba-4d08-8f85-3eaed8b805e7 on n-h2-850468-14 Aug 10 23:17:48.787073 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-6f4aa33c-5425-48f4-8c45-3507a84faa37 req-e31e996d-f7c5-4b65-95af-cccd4dbb11a7 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104097 Aug 10 23:17:48.788355 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-a2d6e591-60fc-448c-9fcd-cebabebc2de2 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07c94ebf0954cdea12b9a689538d96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395d7c4077e54c43bb95288db3942b0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:48.788925 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2085/4342] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:17:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:17:48.801037 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:17:48.805790 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-a2d6e591-60fc-448c-9fcd-cebabebc2de2 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] 10.222.0.58 "GET /compute/v2.1/servers/3ecbcf63-5592-4074-a3f7-d2caf3c58969" status: 200 len: 1737 microversion: 2.1 time: 0.871772 Aug 10 23:17:48.810967 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2258/4343] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:17:47 2022] GET /compute/v2.1/servers/3ecbcf63-5592-4074-a3f7-d2caf3c58969 => generated 1737 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:17:49.689181 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-ac37ed72-e1e7-4c41-a71b-d6447e073789 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:49.690558 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-ac37ed72-e1e7-4c41-a71b-d6447e073789 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: 7f49d27c-0fba-4d08-8f85-3eaed8b805e7] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:49.708168 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ac37ed72-e1e7-4c41-a71b-d6447e073789 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:49.708778 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ac37ed72-e1e7-4c41-a71b-d6447e073789 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:49.709451 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ac37ed72-e1e7-4c41-a71b-d6447e073789 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:49.710302 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ac37ed72-e1e7-4c41-a71b-d6447e073789 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:49.710764 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ac37ed72-e1e7-4c41-a71b-d6447e073789 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:49.711224 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ac37ed72-e1e7-4c41-a71b-d6447e073789 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:49.833891 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-6df5f4ac-f0e8-4a6a-aae1-f804eda9c65e tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:49.834518 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-6df5f4ac-f0e8-4a6a-aae1-f804eda9c65e tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] [instance: 3ecbcf63-5592-4074-a3f7-d2caf3c58969] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:49.850340 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6df5f4ac-f0e8-4a6a-aae1-f804eda9c65e tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:49.850855 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6df5f4ac-f0e8-4a6a-aae1-f804eda9c65e tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:49.851364 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6df5f4ac-f0e8-4a6a-aae1-f804eda9c65e tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:49.852086 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6df5f4ac-f0e8-4a6a-aae1-f804eda9c65e tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:49.852540 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6df5f4ac-f0e8-4a6a-aae1-f804eda9c65e tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:49.852973 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6df5f4ac-f0e8-4a6a-aae1-f804eda9c65e tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:50.357243 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-ac37ed72-e1e7-4c41-a71b-d6447e073789 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:50.372068 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-ac37ed72-e1e7-4c41-a71b-d6447e073789 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/7f49d27c-0fba-4d08-8f85-3eaed8b805e7" status: 200 len: 1313 microversion: 2.1 time: 0.688525 Aug 10 23:17:50.372676 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2086/4344] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:17:49 2022] GET /compute/v2.1/servers/7f49d27c-0fba-4d08-8f85-3eaed8b805e7 => generated 1313 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:17:50.398984 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-4b773bb7-3bef-4e3f-9718-e3ca178c9a16 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Action: 'create', calling method: .version_select at 0x7f847c7729d0>, body: {"keypair": {"name": "tempest-keypair-1181065274", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNq4GfaaeF7D2z0Cvbrns/ZPO5xVOpQESq3TjoP95EFMt7ZZL3UDxnknTxEUnNi75jeL50yuBYeVVvPlc5gKVDbeLzHpUum0P8EytDQxCxyukIkAEdcsKXLtloYSQqhHmw=="}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:17:50.426034 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-4b773bb7-3bef-4e3f-9718-e3ca178c9a16 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Getting quotas for project bfebe97ce8df4dab9b53298700295139. Resources: {'key_pairs'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:17:50.432408 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-4b773bb7-3bef-4e3f-9718-e3ca178c9a16 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Getting quotas for user 1622d26ca18940cbbaba5eb72ce382d7 and project bfebe97ce8df4dab9b53298700295139. Resources: {'key_pairs'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:17:50.476179 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-4b773bb7-3bef-4e3f-9718-e3ca178c9a16 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.32 time: 0.081304 Aug 10 23:17:50.480120 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2087/4345] 10.222.0.58 () {62 vars in 1200 bytes} [Wed Aug 10 23:17:50 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 86 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 10 23:17:50.489551 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-fcfe153d-0853-4ac4-937f-70a46fd08e18 tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1900086661", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:17:50.499511 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:17:50.619590 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-6df5f4ac-f0e8-4a6a-aae1-f804eda9c65e tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07c94ebf0954cdea12b9a689538d96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395d7c4077e54c43bb95288db3942b0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:50.650529 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-6df5f4ac-f0e8-4a6a-aae1-f804eda9c65e tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] 10.222.0.58 "GET /compute/v2.1/servers/3ecbcf63-5592-4074-a3f7-d2caf3c58969" status: 200 len: 1737 microversion: 2.1 time: 0.810759 Aug 10 23:17:50.654067 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2259/4346] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:17:49 2022] GET /compute/v2.1/servers/3ecbcf63-5592-4074-a3f7-d2caf3c58969 => generated 1737 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:17:50.706800 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.network.neutron [None req-fcfe153d-0853-4ac4-937f-70a46fd08e18 tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] validate_networks() for None {{(pid=122632) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 23:17:51.318181 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-fcfe153d-0853-4ac4-937f-70a46fd08e18 tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] Flavor limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:17:51.318620 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-fcfe153d-0853-4ac4-937f-70a46fd08e18 tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] Image limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:17:51.319419 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-fcfe153d-0853-4ac4-937f-70a46fd08e18 tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] Flavor pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:17:51.320075 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-fcfe153d-0853-4ac4-937f-70a46fd08e18 tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] Image pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:17:51.320876 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-fcfe153d-0853-4ac4-937f-70a46fd08e18 tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:17:51.359638 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fcfe153d-0853-4ac4-937f-70a46fd08e18 tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:51.363056 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fcfe153d-0853-4ac4-937f-70a46fd08e18 tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:51.364105 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fcfe153d-0853-4ac4-937f-70a46fd08e18 tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:51.366099 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fcfe153d-0853-4ac4-937f-70a46fd08e18 tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:51.366614 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fcfe153d-0853-4ac4-937f-70a46fd08e18 tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:51.369238 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fcfe153d-0853-4ac4-937f-70a46fd08e18 tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:51.410309 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-a2e40aff-11ab-4e2d-baf8-3283f635fbbc tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:51.411621 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-a2e40aff-11ab-4e2d-baf8-3283f635fbbc tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: 7f49d27c-0fba-4d08-8f85-3eaed8b805e7] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:51.427520 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a2e40aff-11ab-4e2d-baf8-3283f635fbbc tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:51.431651 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a2e40aff-11ab-4e2d-baf8-3283f635fbbc tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:51.433104 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a2e40aff-11ab-4e2d-baf8-3283f635fbbc tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:51.436291 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a2e40aff-11ab-4e2d-baf8-3283f635fbbc tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:51.438029 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a2e40aff-11ab-4e2d-baf8-3283f635fbbc tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:51.439539 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a2e40aff-11ab-4e2d-baf8-3283f635fbbc tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:51.441137 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-fcfe153d-0853-4ac4-937f-70a46fd08e18 tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] Getting quotas for project 388c27a7d5644cab98aedcac17f1debf. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:17:51.457012 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-fcfe153d-0853-4ac4-937f-70a46fd08e18 tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] Getting quotas for user d3702c7420014cd5a5ae703e9abbd408 and project 388c27a7d5644cab98aedcac17f1debf. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:17:51.489438 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-fcfe153d-0853-4ac4-937f-70a46fd08e18 tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] Going to run 1 instances... {{(pid=122632) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 23:17:51.495590 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-fcfe153d-0853-4ac4-937f-70a46fd08e18 tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] [instance: 9ec33e8e-61d8-4663-a54f-8a1b57b3b7fc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78ad8905-f66f-4733-8be9-2b260f1fabed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122632) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 23:17:51.624819 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-fcfe153d-0853-4ac4-937f-70a46fd08e18 tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.137695 Aug 10 23:17:51.626799 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2088/4347] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 23:17:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 1146 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 23:17:51.667591 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-202fff49-5f41-45e6-946d-1d8c8541b6f8 tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:51.668213 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-202fff49-5f41-45e6-946d-1d8c8541b6f8 tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] [instance: 9ec33e8e-61d8-4663-a54f-8a1b57b3b7fc] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:52.001026 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-a2e40aff-11ab-4e2d-baf8-3283f635fbbc tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:52.008555 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-a2e40aff-11ab-4e2d-baf8-3283f635fbbc tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/7f49d27c-0fba-4d08-8f85-3eaed8b805e7" status: 200 len: 1313 microversion: 2.1 time: 0.607162 Aug 10 23:17:52.018944 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2260/4348] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:17:51 2022] GET /compute/v2.1/servers/7f49d27c-0fba-4d08-8f85-3eaed8b805e7 => generated 1313 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:17:52.024215 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c8bde77c-e9b0-4bb6-a88d-1d3dbe57d145 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:52.038042 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-c8bde77c-e9b0-4bb6-a88d-1d3dbe57d145 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] [instance: 3ecbcf63-5592-4074-a3f7-d2caf3c58969] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:52.054864 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c8bde77c-e9b0-4bb6-a88d-1d3dbe57d145 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:52.061744 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c8bde77c-e9b0-4bb6-a88d-1d3dbe57d145 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:52.062214 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c8bde77c-e9b0-4bb6-a88d-1d3dbe57d145 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:52.062999 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c8bde77c-e9b0-4bb6-a88d-1d3dbe57d145 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:52.063460 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c8bde77c-e9b0-4bb6-a88d-1d3dbe57d145 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:52.064126 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c8bde77c-e9b0-4bb6-a88d-1d3dbe57d145 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:52.197351 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-202fff49-5f41-45e6-946d-1d8c8541b6f8 tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3702c7420014cd5a5ae703e9abbd408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '388c27a7d5644cab98aedcac17f1debf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:52.205107 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-202fff49-5f41-45e6-946d-1d8c8541b6f8 tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] 10.222.0.58 "GET /compute/v2.1/servers/9ec33e8e-61d8-4663-a54f-8a1b57b3b7fc" status: 200 len: 1215 microversion: 2.1 time: 0.555005 Aug 10 23:17:52.205693 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2089/4349] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:17:51 2022] GET /compute/v2.1/servers/9ec33e8e-61d8-4663-a54f-8a1b57b3b7fc => generated 1215 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:17:52.486261 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-99424f8c-d36b-4edc-99ed-f8dff1cccb9e tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:17:52.488796 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-99424f8c-d36b-4edc-99ed-f8dff1cccb9e tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] [instance: 250395b5-5be8-420a-8709-dcf8b4241a4e] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:52.504268 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-99424f8c-d36b-4edc-99ed-f8dff1cccb9e tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:52.506625 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-99424f8c-d36b-4edc-99ed-f8dff1cccb9e tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:52.507287 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-99424f8c-d36b-4edc-99ed-f8dff1cccb9e tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:52.509017 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-99424f8c-d36b-4edc-99ed-f8dff1cccb9e tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:52.511798 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-99424f8c-d36b-4edc-99ed-f8dff1cccb9e tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:52.513640 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-99424f8c-d36b-4edc-99ed-f8dff1cccb9e tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:52.596734 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-99424f8c-d36b-4edc-99ed-f8dff1cccb9e tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "POST /compute/v2.1/servers/250395b5-5be8-420a-8709-dcf8b4241a4e/action" status: 200 len: 63178 microversion: 2.1 time: 0.114457 Aug 10 23:17:52.598410 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2090/4350] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:17:52 2022] POST /compute/v2.1/servers/250395b5-5be8-420a-8709-dcf8b4241a4e/action => generated 63178 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 23:17:52.682522 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-c8bde77c-e9b0-4bb6-a88d-1d3dbe57d145 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07c94ebf0954cdea12b9a689538d96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395d7c4077e54c43bb95288db3942b0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:52.695908 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-c8bde77c-e9b0-4bb6-a88d-1d3dbe57d145 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] 10.222.0.58 "GET /compute/v2.1/servers/3ecbcf63-5592-4074-a3f7-d2caf3c58969" status: 200 len: 1737 microversion: 2.1 time: 0.675492 Aug 10 23:17:52.701722 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2261/4351] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:17:52 2022] GET /compute/v2.1/servers/3ecbcf63-5592-4074-a3f7-d2caf3c58969 => generated 1737 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:17:53.048780 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-d7d503bf-1ea7-48a0-97fe-929aca6ec6d9 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:53.049544 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-d7d503bf-1ea7-48a0-97fe-929aca6ec6d9 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: 7f49d27c-0fba-4d08-8f85-3eaed8b805e7] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:53.076422 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d7d503bf-1ea7-48a0-97fe-929aca6ec6d9 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:53.076963 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d7d503bf-1ea7-48a0-97fe-929aca6ec6d9 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:53.077422 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d7d503bf-1ea7-48a0-97fe-929aca6ec6d9 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:53.078195 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d7d503bf-1ea7-48a0-97fe-929aca6ec6d9 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:53.078678 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d7d503bf-1ea7-48a0-97fe-929aca6ec6d9 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:53.079155 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d7d503bf-1ea7-48a0-97fe-929aca6ec6d9 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:53.248028 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-df2c2148-7aca-4561-a28f-be2a7438c22d tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:53.248648 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-df2c2148-7aca-4561-a28f-be2a7438c22d tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] [instance: 9ec33e8e-61d8-4663-a54f-8a1b57b3b7fc] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:53.258438 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-df2c2148-7aca-4561-a28f-be2a7438c22d tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:53.260274 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-df2c2148-7aca-4561-a28f-be2a7438c22d tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:53.260752 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-df2c2148-7aca-4561-a28f-be2a7438c22d tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:53.261670 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-df2c2148-7aca-4561-a28f-be2a7438c22d tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:53.262217 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-df2c2148-7aca-4561-a28f-be2a7438c22d tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:53.262649 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-df2c2148-7aca-4561-a28f-be2a7438c22d tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:53.354446 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-df2c2148-7aca-4561-a28f-be2a7438c22d tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3702c7420014cd5a5ae703e9abbd408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '388c27a7d5644cab98aedcac17f1debf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:53.367271 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-df2c2148-7aca-4561-a28f-be2a7438c22d tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] 10.222.0.58 "GET /compute/v2.1/servers/9ec33e8e-61d8-4663-a54f-8a1b57b3b7fc" status: 200 len: 1267 microversion: 2.1 time: 0.123396 Aug 10 23:17:53.367890 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2262/4352] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:17:53 2022] GET /compute/v2.1/servers/9ec33e8e-61d8-4663-a54f-8a1b57b3b7fc => generated 1267 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:17:53.725101 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-63844097-1c5f-4876-9f07-da0b897b4f99 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:53.727225 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-63844097-1c5f-4876-9f07-da0b897b4f99 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] [instance: 3ecbcf63-5592-4074-a3f7-d2caf3c58969] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:53.743562 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-63844097-1c5f-4876-9f07-da0b897b4f99 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:53.744498 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-63844097-1c5f-4876-9f07-da0b897b4f99 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:53.745701 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-63844097-1c5f-4876-9f07-da0b897b4f99 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:53.753938 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-63844097-1c5f-4876-9f07-da0b897b4f99 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:53.755547 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-63844097-1c5f-4876-9f07-da0b897b4f99 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:53.758601 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-63844097-1c5f-4876-9f07-da0b897b4f99 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:53.969521 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-d7d503bf-1ea7-48a0-97fe-929aca6ec6d9 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:53.995175 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-d7d503bf-1ea7-48a0-97fe-929aca6ec6d9 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/7f49d27c-0fba-4d08-8f85-3eaed8b805e7" status: 200 len: 1313 microversion: 2.1 time: 0.948889 Aug 10 23:17:53.999107 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2091/4353] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:17:53 2022] GET /compute/v2.1/servers/7f49d27c-0fba-4d08-8f85-3eaed8b805e7 => generated 1313 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:17:54.171636 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-63844097-1c5f-4876-9f07-da0b897b4f99 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07c94ebf0954cdea12b9a689538d96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395d7c4077e54c43bb95288db3942b0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:54.183033 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-63844097-1c5f-4876-9f07-da0b897b4f99 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] 10.222.0.58 "GET /compute/v2.1/servers/3ecbcf63-5592-4074-a3f7-d2caf3c58969" status: 200 len: 1737 microversion: 2.1 time: 0.462247 Aug 10 23:17:54.186098 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2263/4354] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:17:53 2022] GET /compute/v2.1/servers/3ecbcf63-5592-4074-a3f7-d2caf3c58969 => generated 1737 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:17:54.278206 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-6d1a12fd-c488-459e-b400-06b9a7a0eff0 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Action: 'create', calling method: .version_select at 0x7f847d083040>, body: {"keypair": {"name": "tempest-keypair-521131830", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIyuOmHAbIJFddLsiosp9Gs1nlRSi9QT6jFiK8/FeEAljuwrOYXmyRHXvyuhAAjUjayxwSLLpijygh3HwZyksb0vKOxBtkr16o1+woA9hJB/9XFhhrKAjaLdvfd512eMnQ=="}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:17:54.304230 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-6d1a12fd-c488-459e-b400-06b9a7a0eff0 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Getting quotas for project 2b557edd165144c8943eb9acc339a377. Resources: {'key_pairs'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:17:54.314305 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-6d1a12fd-c488-459e-b400-06b9a7a0eff0 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Getting quotas for user 0d89081084f14e0187f4c67cd9185fef and project 2b557edd165144c8943eb9acc339a377. Resources: {'key_pairs'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:17:54.349609 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-6d1a12fd-c488-459e-b400-06b9a7a0eff0 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.320316 Aug 10 23:17:54.351649 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2092/4355] 10.222.0.58 () {60 vars in 1159 bytes} [Wed Aug 10 23:17:54 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:17:54.389973 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-81061b84-88a9-4e1e-a11f-0b39665d0bf5 tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:54.390888 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-81061b84-88a9-4e1e-a11f-0b39665d0bf5 tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] [instance: 9ec33e8e-61d8-4663-a54f-8a1b57b3b7fc] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:54.398172 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-81061b84-88a9-4e1e-a11f-0b39665d0bf5 tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:54.398924 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-81061b84-88a9-4e1e-a11f-0b39665d0bf5 tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:54.399521 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-81061b84-88a9-4e1e-a11f-0b39665d0bf5 tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:54.400420 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-81061b84-88a9-4e1e-a11f-0b39665d0bf5 tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:54.401726 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-81061b84-88a9-4e1e-a11f-0b39665d0bf5 tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:54.402333 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-81061b84-88a9-4e1e-a11f-0b39665d0bf5 tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:54.551632 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-81061b84-88a9-4e1e-a11f-0b39665d0bf5 tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3702c7420014cd5a5ae703e9abbd408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '388c27a7d5644cab98aedcac17f1debf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:54.562400 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-81061b84-88a9-4e1e-a11f-0b39665d0bf5 tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] 10.222.0.58 "GET /compute/v2.1/servers/9ec33e8e-61d8-4663-a54f-8a1b57b3b7fc" status: 200 len: 1273 microversion: 2.1 time: 0.176512 Aug 10 23:17:54.566538 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2264/4356] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:17:54 2022] GET /compute/v2.1/servers/9ec33e8e-61d8-4663-a54f-8a1b57b3b7fc => generated 1273 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:17:55.042250 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-b7a801fc-bc15-48cd-8934-350b69142927 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:55.044239 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-b7a801fc-bc15-48cd-8934-350b69142927 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: 7f49d27c-0fba-4d08-8f85-3eaed8b805e7] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:55.051368 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b7a801fc-bc15-48cd-8934-350b69142927 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:55.052275 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b7a801fc-bc15-48cd-8934-350b69142927 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:55.053009 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b7a801fc-bc15-48cd-8934-350b69142927 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:55.053985 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b7a801fc-bc15-48cd-8934-350b69142927 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:55.054664 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b7a801fc-bc15-48cd-8934-350b69142927 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:55.055368 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b7a801fc-bc15-48cd-8934-350b69142927 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:55.207504 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-0d97386c-ee26-449b-8232-3bdef4aa257d tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:55.208121 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-0d97386c-ee26-449b-8232-3bdef4aa257d tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] [instance: 3ecbcf63-5592-4074-a3f7-d2caf3c58969] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:55.218919 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0d97386c-ee26-449b-8232-3bdef4aa257d tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:55.219418 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0d97386c-ee26-449b-8232-3bdef4aa257d tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:55.219860 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0d97386c-ee26-449b-8232-3bdef4aa257d tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:55.220576 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0d97386c-ee26-449b-8232-3bdef4aa257d tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:55.221041 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0d97386c-ee26-449b-8232-3bdef4aa257d tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:55.221464 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0d97386c-ee26-449b-8232-3bdef4aa257d tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:55.615434 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-0d97386c-ee26-449b-8232-3bdef4aa257d tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07c94ebf0954cdea12b9a689538d96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395d7c4077e54c43bb95288db3942b0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:55.634049 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-0d97386c-ee26-449b-8232-3bdef4aa257d tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] 10.222.0.58 "GET /compute/v2.1/servers/3ecbcf63-5592-4074-a3f7-d2caf3c58969" status: 200 len: 1737 microversion: 2.1 time: 0.430354 Aug 10 23:17:55.635991 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2265/4357] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:17:55 2022] GET /compute/v2.1/servers/3ecbcf63-5592-4074-a3f7-d2caf3c58969 => generated 1737 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:17:55.656945 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-78e63f82-0adb-4a1c-b0a1-d28aa338e15e tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:55.659751 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-78e63f82-0adb-4a1c-b0a1-d28aa338e15e tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] [instance: 9ec33e8e-61d8-4663-a54f-8a1b57b3b7fc] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:55.674126 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-78e63f82-0adb-4a1c-b0a1-d28aa338e15e tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:55.675165 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-78e63f82-0adb-4a1c-b0a1-d28aa338e15e tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:55.676004 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-78e63f82-0adb-4a1c-b0a1-d28aa338e15e tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:55.677091 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-78e63f82-0adb-4a1c-b0a1-d28aa338e15e tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:55.677846 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-78e63f82-0adb-4a1c-b0a1-d28aa338e15e tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:55.679125 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-78e63f82-0adb-4a1c-b0a1-d28aa338e15e tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:55.850492 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-78e63f82-0adb-4a1c-b0a1-d28aa338e15e tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3702c7420014cd5a5ae703e9abbd408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '388c27a7d5644cab98aedcac17f1debf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:55.865535 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-78e63f82-0adb-4a1c-b0a1-d28aa338e15e tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] 10.222.0.58 "GET /compute/v2.1/servers/9ec33e8e-61d8-4663-a54f-8a1b57b3b7fc" status: 200 len: 1273 microversion: 2.1 time: 0.221557 Aug 10 23:17:55.871116 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2266/4358] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:17:55 2022] GET /compute/v2.1/servers/9ec33e8e-61d8-4663-a54f-8a1b57b3b7fc => generated 1273 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:17:55.985447 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-b7a801fc-bc15-48cd-8934-350b69142927 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:56.006285 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-b7a801fc-bc15-48cd-8934-350b69142927 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/7f49d27c-0fba-4d08-8f85-3eaed8b805e7" status: 200 len: 1313 microversion: 2.1 time: 0.967867 Aug 10 23:17:56.006920 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2093/4359] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:17:55 2022] GET /compute/v2.1/servers/7f49d27c-0fba-4d08-8f85-3eaed8b805e7 => generated 1313 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:17:56.664465 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-9ea77b35-be90-4e53-a3e8-580c8e5a9252 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:56.667173 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-9ea77b35-be90-4e53-a3e8-580c8e5a9252 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] [instance: 3ecbcf63-5592-4074-a3f7-d2caf3c58969] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:56.676074 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9ea77b35-be90-4e53-a3e8-580c8e5a9252 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:56.676907 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9ea77b35-be90-4e53-a3e8-580c8e5a9252 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:56.677542 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9ea77b35-be90-4e53-a3e8-580c8e5a9252 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:56.678459 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9ea77b35-be90-4e53-a3e8-580c8e5a9252 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:56.688711 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9ea77b35-be90-4e53-a3e8-580c8e5a9252 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:56.689225 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9ea77b35-be90-4e53-a3e8-580c8e5a9252 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:56.906231 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-95bd92d4-f905-4126-961f-99808dacbf92 tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:56.907542 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-95bd92d4-f905-4126-961f-99808dacbf92 tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] [instance: 9ec33e8e-61d8-4663-a54f-8a1b57b3b7fc] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:56.921272 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-95bd92d4-f905-4126-961f-99808dacbf92 tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:56.923619 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-95bd92d4-f905-4126-961f-99808dacbf92 tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:56.924393 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-95bd92d4-f905-4126-961f-99808dacbf92 tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:56.925361 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-95bd92d4-f905-4126-961f-99808dacbf92 tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:56.926029 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-95bd92d4-f905-4126-961f-99808dacbf92 tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:56.926675 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-95bd92d4-f905-4126-961f-99808dacbf92 tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:57.155446 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-95bd92d4-f905-4126-961f-99808dacbf92 tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3702c7420014cd5a5ae703e9abbd408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '388c27a7d5644cab98aedcac17f1debf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:57.170624 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-95bd92d4-f905-4126-961f-99808dacbf92 tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] 10.222.0.58 "GET /compute/v2.1/servers/9ec33e8e-61d8-4663-a54f-8a1b57b3b7fc" status: 200 len: 1273 microversion: 2.1 time: 0.279287 Aug 10 23:17:57.173010 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2094/4360] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:17:56 2022] GET /compute/v2.1/servers/9ec33e8e-61d8-4663-a54f-8a1b57b3b7fc => generated 1273 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:17:57.189218 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-ad5ad9be-25b1-4937-b96a-b561891d680b tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:57.191148 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-ad5ad9be-25b1-4937-b96a-b561891d680b tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: 7f49d27c-0fba-4d08-8f85-3eaed8b805e7] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:57.214441 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ad5ad9be-25b1-4937-b96a-b561891d680b tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:57.215036 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ad5ad9be-25b1-4937-b96a-b561891d680b tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:57.215856 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ad5ad9be-25b1-4937-b96a-b561891d680b tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:57.216570 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ad5ad9be-25b1-4937-b96a-b561891d680b tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:57.217027 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ad5ad9be-25b1-4937-b96a-b561891d680b tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:57.217451 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ad5ad9be-25b1-4937-b96a-b561891d680b tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:57.627717 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-9ea77b35-be90-4e53-a3e8-580c8e5a9252 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07c94ebf0954cdea12b9a689538d96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395d7c4077e54c43bb95288db3942b0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:57.639618 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-9ea77b35-be90-4e53-a3e8-580c8e5a9252 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] 10.222.0.58 "GET /compute/v2.1/servers/3ecbcf63-5592-4074-a3f7-d2caf3c58969" status: 200 len: 1737 microversion: 2.1 time: 0.980186 Aug 10 23:17:57.652555 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2267/4361] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:17:56 2022] GET /compute/v2.1/servers/3ecbcf63-5592-4074-a3f7-d2caf3c58969 => generated 1737 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:17:57.671453 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-345c046c-89a5-49c2-b099-f21a7aca4eea req-3dcf6068-14d4-4618-8601-ee015e40b1da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f49d27c-0fba-4d08-8f85-3eaed8b805e7", "name": "network-vif-plugged", "status": "completed", "tag": "69ad680e-3222-4e16-9619-7f0a0d9623e5"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:17:57.691114 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-345c046c-89a5-49c2-b099-f21a7aca4eea req-3dcf6068-14d4-4618-8601-ee015e40b1da service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:57.693314 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-345c046c-89a5-49c2-b099-f21a7aca4eea req-3dcf6068-14d4-4618-8601-ee015e40b1da service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:57.693906 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-345c046c-89a5-49c2-b099-f21a7aca4eea req-3dcf6068-14d4-4618-8601-ee015e40b1da service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:57.726358 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-345c046c-89a5-49c2-b099-f21a7aca4eea req-3dcf6068-14d4-4618-8601-ee015e40b1da service nova] Creating event network-vif-plugged:69ad680e-3222-4e16-9619-7f0a0d9623e5 for instance 7f49d27c-0fba-4d08-8f85-3eaed8b805e7 on n-h2-850468-14 Aug 10 23:17:57.736689 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-345c046c-89a5-49c2-b099-f21a7aca4eea req-3dcf6068-14d4-4618-8601-ee015e40b1da service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082680 Aug 10 23:17:57.737321 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2268/4362] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:17:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:17:58.203583 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-a3b3c1a4-7f57-4b3e-b265-e357804428f6 tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:58.204686 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-a3b3c1a4-7f57-4b3e-b265-e357804428f6 tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] [instance: 9ec33e8e-61d8-4663-a54f-8a1b57b3b7fc] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:58.223881 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=3 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:17:58.229948 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a3b3c1a4-7f57-4b3e-b265-e357804428f6 tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:58.232349 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a3b3c1a4-7f57-4b3e-b265-e357804428f6 tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:58.234016 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a3b3c1a4-7f57-4b3e-b265-e357804428f6 tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:58.235074 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a3b3c1a4-7f57-4b3e-b265-e357804428f6 tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:58.235800 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a3b3c1a4-7f57-4b3e-b265-e357804428f6 tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:58.236477 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a3b3c1a4-7f57-4b3e-b265-e357804428f6 tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:58.463508 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-ad5ad9be-25b1-4937-b96a-b561891d680b tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:58.476109 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-ad5ad9be-25b1-4937-b96a-b561891d680b tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/7f49d27c-0fba-4d08-8f85-3eaed8b805e7" status: 200 len: 1313 microversion: 2.1 time: 1.298959 Aug 10 23:17:58.476753 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2095/4363] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:17:57 2022] GET /compute/v2.1/servers/7f49d27c-0fba-4d08-8f85-3eaed8b805e7 => generated 1313 bytes in 1303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:17:58.553606 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-25f7674e-00a0-47bc-87f8-5466c01f2977 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1243383171", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "87055a36-03cf-4502-9984-7d793ab9f9b4"}, {"port": "d1dfd00f-ee9e-41fd-a00e-0820c42b1cf5", "tag": "port-1"}, {"port": "fef0f10f-3060-43c3-bd96-39b0c071dfab", "tag": "port-2"}, {"uuid": "ffacc409-5cd0-44b6-897f-bcb454bc7904", "tag": "net-1"}, {"uuid": "ffacc409-5cd0-44b6-897f-bcb454bc7904"}, {"uuid": "867ce2dc-391a-4ccf-8511-42a7ef94c9b6", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "867ce2dc-391a-4ccf-8511-42a7ef94c9b6", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "c1a86610-0aad-4fd2-a82d-ddc855274d74", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "36583d19-123e-4438-9bd9-78112448e3a3", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "266a1813-1f78-43a3-834c-18c64fddcc9d", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--566466296"}], "key_name": "tempest-keypair-1181065274", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:17:58.605038 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-a3b3c1a4-7f57-4b3e-b265-e357804428f6 tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3702c7420014cd5a5ae703e9abbd408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '388c27a7d5644cab98aedcac17f1debf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:58.615154 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-a3b3c1a4-7f57-4b3e-b265-e357804428f6 tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] 10.222.0.58 "GET /compute/v2.1/servers/9ec33e8e-61d8-4663-a54f-8a1b57b3b7fc" status: 200 len: 1315 microversion: 2.1 time: 0.423984 Aug 10 23:17:58.619863 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2269/4364] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:17:58 2022] GET /compute/v2.1/servers/9ec33e8e-61d8-4663-a54f-8a1b57b3b7fc => generated 1315 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:17:58.669666 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-9daf7e2f-bfdd-41c9-9ee8-8e6aa127b224 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:58.670947 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-9daf7e2f-bfdd-41c9-9ee8-8e6aa127b224 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] [instance: 3ecbcf63-5592-4074-a3f7-d2caf3c58969] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:58.690150 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9daf7e2f-bfdd-41c9-9ee8-8e6aa127b224 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:58.695950 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9daf7e2f-bfdd-41c9-9ee8-8e6aa127b224 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:58.706724 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9daf7e2f-bfdd-41c9-9ee8-8e6aa127b224 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:58.708438 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9daf7e2f-bfdd-41c9-9ee8-8e6aa127b224 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:58.709170 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9daf7e2f-bfdd-41c9-9ee8-8e6aa127b224 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:58.715371 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9daf7e2f-bfdd-41c9-9ee8-8e6aa127b224 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:59.098269 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.network.neutron [None req-25f7674e-00a0-47bc-87f8-5466c01f2977 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] validate_networks() for [('87055a36-03cf-4502-9984-7d793ab9f9b4', None, None, None, None, None), (None, None, 'd1dfd00f-ee9e-41fd-a00e-0820c42b1cf5', None, None, None), (None, None, 'fef0f10f-3060-43c3-bd96-39b0c071dfab', None, None, None), ('ffacc409-5cd0-44b6-897f-bcb454bc7904', None, None, None, None, None), ('ffacc409-5cd0-44b6-897f-bcb454bc7904', None, None, None, None, None), ('867ce2dc-391a-4ccf-8511-42a7ef94c9b6', '10.2.2.100', None, None, None, None), ('867ce2dc-391a-4ccf-8511-42a7ef94c9b6', '10.2.2.200', None, None, None, None)] {{(pid=122632) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 23:17:59.115972 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-9daf7e2f-bfdd-41c9-9ee8-8e6aa127b224 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07c94ebf0954cdea12b9a689538d96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395d7c4077e54c43bb95288db3942b0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:17:59.130109 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-9daf7e2f-bfdd-41c9-9ee8-8e6aa127b224 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] 10.222.0.58 "GET /compute/v2.1/servers/3ecbcf63-5592-4074-a3f7-d2caf3c58969" status: 200 len: 1737 microversion: 2.1 time: 0.467198 Aug 10 23:17:59.133644 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2270/4365] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:17:58 2022] GET /compute/v2.1/servers/3ecbcf63-5592-4074-a3f7-d2caf3c58969 => generated 1737 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:17:59.459370 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-75e11e70-f41d-4813-a2ef-43d181b2caef tempest-TestNetworkAdvancedServerOps-1638906998 tempest-TestNetworkAdvancedServerOps-1638906998-project-admin] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:59.459987 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-75e11e70-f41d-4813-a2ef-43d181b2caef tempest-TestNetworkAdvancedServerOps-1638906998 tempest-TestNetworkAdvancedServerOps-1638906998-project-admin] [instance: 250395b5-5be8-420a-8709-dcf8b4241a4e] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:59.473525 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-75e11e70-f41d-4813-a2ef-43d181b2caef tempest-TestNetworkAdvancedServerOps-1638906998 tempest-TestNetworkAdvancedServerOps-1638906998-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:59.474023 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-75e11e70-f41d-4813-a2ef-43d181b2caef tempest-TestNetworkAdvancedServerOps-1638906998 tempest-TestNetworkAdvancedServerOps-1638906998-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:59.474463 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-75e11e70-f41d-4813-a2ef-43d181b2caef tempest-TestNetworkAdvancedServerOps-1638906998 tempest-TestNetworkAdvancedServerOps-1638906998-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:59.475202 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-75e11e70-f41d-4813-a2ef-43d181b2caef tempest-TestNetworkAdvancedServerOps-1638906998 tempest-TestNetworkAdvancedServerOps-1638906998-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:59.478420 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-75e11e70-f41d-4813-a2ef-43d181b2caef tempest-TestNetworkAdvancedServerOps-1638906998 tempest-TestNetworkAdvancedServerOps-1638906998-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:59.479140 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-75e11e70-f41d-4813-a2ef-43d181b2caef tempest-TestNetworkAdvancedServerOps-1638906998 tempest-TestNetworkAdvancedServerOps-1638906998-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:59.773614 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-75e11e70-f41d-4813-a2ef-43d181b2caef tempest-TestNetworkAdvancedServerOps-1638906998 tempest-TestNetworkAdvancedServerOps-1638906998-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/250395b5-5be8-420a-8709-dcf8b4241a4e" status: 200 len: 1835 microversion: 2.1 time: 0.633323 Aug 10 23:17:59.775671 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2271/4366] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:17:59 2022] GET /compute/v2.1/servers/250395b5-5be8-420a-8709-dcf8b4241a4e => generated 1835 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:17:59.784274 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-a2b860f2-77d2-4a30-a5e6-29fe79a92119 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:17:59.785217 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-a2b860f2-77d2-4a30-a5e6-29fe79a92119 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: 7f49d27c-0fba-4d08-8f85-3eaed8b805e7] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:17:59.800432 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a2b860f2-77d2-4a30-a5e6-29fe79a92119 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:59.801757 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a2b860f2-77d2-4a30-a5e6-29fe79a92119 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:59.802430 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a2b860f2-77d2-4a30-a5e6-29fe79a92119 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:17:59.803693 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a2b860f2-77d2-4a30-a5e6-29fe79a92119 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:17:59.804972 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a2b860f2-77d2-4a30-a5e6-29fe79a92119 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:17:59.805627 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a2b860f2-77d2-4a30-a5e6-29fe79a92119 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:00.086301 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-a2b860f2-77d2-4a30-a5e6-29fe79a92119 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:00.099282 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-a2b860f2-77d2-4a30-a5e6-29fe79a92119 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/7f49d27c-0fba-4d08-8f85-3eaed8b805e7" status: 200 len: 1500 microversion: 2.1 time: 0.321689 Aug 10 23:18:00.100512 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2272/4367] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:17:59 2022] GET /compute/v2.1/servers/7f49d27c-0fba-4d08-8f85-3eaed8b805e7 => generated 1500 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:18:00.119965 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-9a8b7343-3953-4196-a40e-32272473111a tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:18:00.120586 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-9a8b7343-3953-4196-a40e-32272473111a tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] [instance: 9ec33e8e-61d8-4663-a54f-8a1b57b3b7fc] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:18:00.131337 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9a8b7343-3953-4196-a40e-32272473111a tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:00.132206 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9a8b7343-3953-4196-a40e-32272473111a tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:00.132299 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9a8b7343-3953-4196-a40e-32272473111a tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:00.137531 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9a8b7343-3953-4196-a40e-32272473111a tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:00.138543 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9a8b7343-3953-4196-a40e-32272473111a tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:00.141154 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9a8b7343-3953-4196-a40e-32272473111a tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:00.536481 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-9a8b7343-3953-4196-a40e-32272473111a tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3702c7420014cd5a5ae703e9abbd408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '388c27a7d5644cab98aedcac17f1debf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:00.550504 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-9a8b7343-3953-4196-a40e-32272473111a tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] 10.222.0.58 "GET /compute/v2.1/servers/9ec33e8e-61d8-4663-a54f-8a1b57b3b7fc" status: 200 len: 1315 microversion: 2.1 time: 0.448594 Aug 10 23:18:00.551205 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2273/4368] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:18:00 2022] GET /compute/v2.1/servers/9ec33e8e-61d8-4663-a54f-8a1b57b3b7fc => generated 1315 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:18:00.580461 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-b2aa3076-e7db-4960-a2b9-c0ad1a04a51a tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:18:00.581005 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-b2aa3076-e7db-4960-a2b9-c0ad1a04a51a tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: 7f49d27c-0fba-4d08-8f85-3eaed8b805e7] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:18:00.606041 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b2aa3076-e7db-4960-a2b9-c0ad1a04a51a tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:00.606658 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b2aa3076-e7db-4960-a2b9-c0ad1a04a51a tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:00.607138 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b2aa3076-e7db-4960-a2b9-c0ad1a04a51a tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:00.610187 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b2aa3076-e7db-4960-a2b9-c0ad1a04a51a tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:00.614007 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b2aa3076-e7db-4960-a2b9-c0ad1a04a51a tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:00.614463 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b2aa3076-e7db-4960-a2b9-c0ad1a04a51a tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:00.751805 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-b2aa3076-e7db-4960-a2b9-c0ad1a04a51a tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "POST /compute/v2.1/servers/7f49d27c-0fba-4d08-8f85-3eaed8b805e7/action" status: 202 len: 0 microversion: 2.1 time: 0.174905 Aug 10 23:18:00.752661 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2274/4369] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:18:00 2022] POST /compute/v2.1/servers/7f49d27c-0fba-4d08-8f85-3eaed8b805e7/action => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:18:00.767460 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-353ed6cf-c713-46d3-a5f5-8f1ced8f1fb4 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:18:00.769603 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-353ed6cf-c713-46d3-a5f5-8f1ced8f1fb4 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] [instance: 3ecbcf63-5592-4074-a3f7-d2caf3c58969] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:18:00.791437 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-353ed6cf-c713-46d3-a5f5-8f1ced8f1fb4 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:00.794313 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-353ed6cf-c713-46d3-a5f5-8f1ced8f1fb4 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:00.795403 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-353ed6cf-c713-46d3-a5f5-8f1ced8f1fb4 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:00.796449 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-353ed6cf-c713-46d3-a5f5-8f1ced8f1fb4 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:00.797302 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-353ed6cf-c713-46d3-a5f5-8f1ced8f1fb4 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:00.798444 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-353ed6cf-c713-46d3-a5f5-8f1ced8f1fb4 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:00.806275 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:18:01.342324 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-353ed6cf-c713-46d3-a5f5-8f1ced8f1fb4 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07c94ebf0954cdea12b9a689538d96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395d7c4077e54c43bb95288db3942b0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:01.352842 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-353ed6cf-c713-46d3-a5f5-8f1ced8f1fb4 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] 10.222.0.58 "GET /compute/v2.1/servers/3ecbcf63-5592-4074-a3f7-d2caf3c58969" status: 200 len: 1737 microversion: 2.1 time: 0.598725 Aug 10 23:18:01.353445 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2275/4370] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:18:00 2022] GET /compute/v2.1/servers/3ecbcf63-5592-4074-a3f7-d2caf3c58969 => generated 1737 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:18:01.383591 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-fa9eae5f-1de8-41a2-94ea-e03f740494a5 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:18:01.384368 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-fa9eae5f-1de8-41a2-94ea-e03f740494a5 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: 7f49d27c-0fba-4d08-8f85-3eaed8b805e7] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:18:01.396004 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fa9eae5f-1de8-41a2-94ea-e03f740494a5 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:01.396516 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fa9eae5f-1de8-41a2-94ea-e03f740494a5 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:01.396966 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fa9eae5f-1de8-41a2-94ea-e03f740494a5 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:01.397092 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=2 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:18:01.397773 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fa9eae5f-1de8-41a2-94ea-e03f740494a5 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:01.398279 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fa9eae5f-1de8-41a2-94ea-e03f740494a5 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:01.398842 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fa9eae5f-1de8-41a2-94ea-e03f740494a5 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:02.094579 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-fa9eae5f-1de8-41a2-94ea-e03f740494a5 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:02.105067 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-fa9eae5f-1de8-41a2-94ea-e03f740494a5 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/7f49d27c-0fba-4d08-8f85-3eaed8b805e7" status: 200 len: 1485 microversion: 2.1 time: 0.728284 Aug 10 23:18:02.119824 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2276/4371] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:18:01 2022] GET /compute/v2.1/servers/7f49d27c-0fba-4d08-8f85-3eaed8b805e7 => generated 1485 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:18:02.139051 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-e4143264-e08c-4ce3-915a-917c0edc57ae tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:18:02.139999 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-e4143264-e08c-4ce3-915a-917c0edc57ae tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] [instance: 9ec33e8e-61d8-4663-a54f-8a1b57b3b7fc] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:18:02.150857 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e4143264-e08c-4ce3-915a-917c0edc57ae tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:02.151311 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e4143264-e08c-4ce3-915a-917c0edc57ae tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:02.151758 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e4143264-e08c-4ce3-915a-917c0edc57ae tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:02.152589 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e4143264-e08c-4ce3-915a-917c0edc57ae tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:02.153047 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e4143264-e08c-4ce3-915a-917c0edc57ae tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:02.153473 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e4143264-e08c-4ce3-915a-917c0edc57ae tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:02.635618 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-e4143264-e08c-4ce3-915a-917c0edc57ae tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3702c7420014cd5a5ae703e9abbd408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '388c27a7d5644cab98aedcac17f1debf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:02.647134 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-e4143264-e08c-4ce3-915a-917c0edc57ae tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] 10.222.0.58 "GET /compute/v2.1/servers/9ec33e8e-61d8-4663-a54f-8a1b57b3b7fc" status: 200 len: 1315 microversion: 2.1 time: 0.525864 Aug 10 23:18:02.655184 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2277/4372] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:18:02 2022] GET /compute/v2.1/servers/9ec33e8e-61d8-4663-a54f-8a1b57b3b7fc => generated 1315 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:18:02.673948 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-0f29172e-2a81-471d-a437-37803b506a66 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:18:02.674504 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-0f29172e-2a81-471d-a437-37803b506a66 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: 7f49d27c-0fba-4d08-8f85-3eaed8b805e7] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:18:02.692411 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0f29172e-2a81-471d-a437-37803b506a66 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:02.693112 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0f29172e-2a81-471d-a437-37803b506a66 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:02.695654 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0f29172e-2a81-471d-a437-37803b506a66 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:02.696661 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0f29172e-2a81-471d-a437-37803b506a66 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:02.697286 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0f29172e-2a81-471d-a437-37803b506a66 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:02.700055 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0f29172e-2a81-471d-a437-37803b506a66 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:02.760816 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.objects.instance [None req-0f29172e-2a81-471d-a437-37803b506a66 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lazy-loading 'flavor' on Instance uuid 7f49d27c-0fba-4d08-8f85-3eaed8b805e7 {{(pid=122633) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:18:03.157887 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-0f29172e-2a81-471d-a437-37803b506a66 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "POST /compute/v2.1/servers/7f49d27c-0fba-4d08-8f85-3eaed8b805e7/action" status: 202 len: 0 microversion: 2.1 time: 0.501284 Aug 10 23:18:03.162148 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2278/4373] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:18:02 2022] POST /compute/v2.1/servers/7f49d27c-0fba-4d08-8f85-3eaed8b805e7/action => generated 0 bytes in 506 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:18:03.172318 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-734ff0f1-dddf-40b4-8616-aba2a1b1f038 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:18:03.173042 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-734ff0f1-dddf-40b4-8616-aba2a1b1f038 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] [instance: 3ecbcf63-5592-4074-a3f7-d2caf3c58969] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:18:03.197289 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-734ff0f1-dddf-40b4-8616-aba2a1b1f038 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:03.198176 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-734ff0f1-dddf-40b4-8616-aba2a1b1f038 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:03.198893 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-734ff0f1-dddf-40b4-8616-aba2a1b1f038 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:03.199802 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-734ff0f1-dddf-40b4-8616-aba2a1b1f038 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:03.200431 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-734ff0f1-dddf-40b4-8616-aba2a1b1f038 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:03.201043 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-734ff0f1-dddf-40b4-8616-aba2a1b1f038 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:04.234998 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-734ff0f1-dddf-40b4-8616-aba2a1b1f038 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07c94ebf0954cdea12b9a689538d96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395d7c4077e54c43bb95288db3942b0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:04.243858 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-734ff0f1-dddf-40b4-8616-aba2a1b1f038 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] 10.222.0.58 "GET /compute/v2.1/servers/3ecbcf63-5592-4074-a3f7-d2caf3c58969" status: 200 len: 1737 microversion: 2.1 time: 1.080359 Aug 10 23:18:04.247593 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2279/4374] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:18:03 2022] GET /compute/v2.1/servers/3ecbcf63-5592-4074-a3f7-d2caf3c58969 => generated 1737 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:18:04.263490 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-d33d137b-62fd-4b56-9779-9234a5545e36 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:18:04.264263 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-d33d137b-62fd-4b56-9779-9234a5545e36 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] [instance: 250395b5-5be8-420a-8709-dcf8b4241a4e] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:18:04.279130 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d33d137b-62fd-4b56-9779-9234a5545e36 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:04.280017 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d33d137b-62fd-4b56-9779-9234a5545e36 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:04.280747 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d33d137b-62fd-4b56-9779-9234a5545e36 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:04.282063 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d33d137b-62fd-4b56-9779-9234a5545e36 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:04.283436 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d33d137b-62fd-4b56-9779-9234a5545e36 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:04.284099 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d33d137b-62fd-4b56-9779-9234a5545e36 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:04.326519 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=16 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:18:04.333809 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-d33d137b-62fd-4b56-9779-9234a5545e36 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] [instance: 250395b5-5be8-420a-8709-dcf8b4241a4e] Going to try to terminate instance {{(pid=122633) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:18:04.466853 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-d33d137b-62fd-4b56-9779-9234a5545e36 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "DELETE /compute/v2.1/servers/250395b5-5be8-420a-8709-dcf8b4241a4e" status: 204 len: 0 microversion: 2.1 time: 0.216738 Aug 10 23:18:04.467660 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2280/4375] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:18:04 2022] DELETE /compute/v2.1/servers/250395b5-5be8-420a-8709-dcf8b4241a4e => generated 0 bytes in 219 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:18:04.477093 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-9510432d-d9e7-4cfa-82cb-b51dd365f26e req-fef1400b-a3e3-453e-9b12-6ae2da4f0fe5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "250395b5-5be8-420a-8709-dcf8b4241a4e", "tag": "fb6df67c-3dbb-4a0f-98f0-c602e1eaa615"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:18:04.487612 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-9510432d-d9e7-4cfa-82cb-b51dd365f26e req-fef1400b-a3e3-453e-9b12-6ae2da4f0fe5 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:04.488212 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-9510432d-d9e7-4cfa-82cb-b51dd365f26e req-fef1400b-a3e3-453e-9b12-6ae2da4f0fe5 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:04.488654 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-9510432d-d9e7-4cfa-82cb-b51dd365f26e req-fef1400b-a3e3-453e-9b12-6ae2da4f0fe5 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:04.502411 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-9510432d-d9e7-4cfa-82cb-b51dd365f26e req-fef1400b-a3e3-453e-9b12-6ae2da4f0fe5 service nova] Creating event network-changed:fb6df67c-3dbb-4a0f-98f0-c602e1eaa615 for instance 250395b5-5be8-420a-8709-dcf8b4241a4e on n-h1-850468-14 Aug 10 23:18:04.507965 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-9510432d-d9e7-4cfa-82cb-b51dd365f26e req-fef1400b-a3e3-453e-9b12-6ae2da4f0fe5 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035937 Aug 10 23:18:04.508777 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2281/4376] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:18:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:18:04.515977 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-dda798ad-81ec-4757-a9b5-e3f460d4b29c tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2122819591", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6022f6db-e3f4-46f3-9a7f-22454e88771a"}], "security_groups": [{"name": "tempest-securitygroup--511673724"}], "key_name": "tempest-keypair-521131830", "user_data": "}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:18:04.720655 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.network.neutron [None req-dda798ad-81ec-4757-a9b5-e3f460d4b29c tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] validate_networks() for [('6022f6db-e3f4-46f3-9a7f-22454e88771a', None, None, None, None, None)] {{(pid=122633) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 23:18:06.014955 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-dda798ad-81ec-4757-a9b5-e3f460d4b29c tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Flavor limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:18:06.015576 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-dda798ad-81ec-4757-a9b5-e3f460d4b29c tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Image limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:18:06.015839 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-dda798ad-81ec-4757-a9b5-e3f460d4b29c tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Flavor pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:18:06.016249 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-dda798ad-81ec-4757-a9b5-e3f460d4b29c tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Image pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:18:06.016844 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-dda798ad-81ec-4757-a9b5-e3f460d4b29c tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:18:06.036405 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dda798ad-81ec-4757-a9b5-e3f460d4b29c tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:06.036916 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dda798ad-81ec-4757-a9b5-e3f460d4b29c tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:06.037352 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dda798ad-81ec-4757-a9b5-e3f460d4b29c tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:06.038093 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dda798ad-81ec-4757-a9b5-e3f460d4b29c tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:06.042631 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dda798ad-81ec-4757-a9b5-e3f460d4b29c tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:06.043209 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dda798ad-81ec-4757-a9b5-e3f460d4b29c tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:06.089822 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-dda798ad-81ec-4757-a9b5-e3f460d4b29c tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Getting quotas for project 2b557edd165144c8943eb9acc339a377. Resources: {'instances', 'cores', 'ram'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:18:06.101338 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-dda798ad-81ec-4757-a9b5-e3f460d4b29c tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Getting quotas for user 0d89081084f14e0187f4c67cd9185fef and project 2b557edd165144c8943eb9acc339a377. Resources: {'instances', 'cores', 'ram'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:18:06.128626 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-dda798ad-81ec-4757-a9b5-e3f460d4b29c tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Going to run 1 instances... {{(pid=122633) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 23:18:06.131048 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-dda798ad-81ec-4757-a9b5-e3f460d4b29c tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] [instance: b812cd8c-7e33-4e97-8df6-c7fccdf12019] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78ad8905-f66f-4733-8be9-2b260f1fabed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122633) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 23:18:06.255416 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-dda798ad-81ec-4757-a9b5-e3f460d4b29c tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.745595 Aug 10 23:18:06.259046 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2282/4377] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 23:18:04 2022] POST /compute/v2.1/servers => generated 401 bytes in 1750 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 23:18:06.271739 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-bc55d41a-2a20-4bc7-9515-605c5f9ea79e req-08ef419d-225a-4589-bb09-fe6465ad1c7e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ec33e8e-61d8-4663-a54f-8a1b57b3b7fc", "tag": "ba570bf5-1107-41fc-8071-bd5b5f0321ed"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:18:06.313847 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-bc55d41a-2a20-4bc7-9515-605c5f9ea79e req-08ef419d-225a-4589-bb09-fe6465ad1c7e service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:06.317093 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-bc55d41a-2a20-4bc7-9515-605c5f9ea79e req-08ef419d-225a-4589-bb09-fe6465ad1c7e service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:06.317671 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-bc55d41a-2a20-4bc7-9515-605c5f9ea79e req-08ef419d-225a-4589-bb09-fe6465ad1c7e service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:06.347081 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-bc55d41a-2a20-4bc7-9515-605c5f9ea79e req-08ef419d-225a-4589-bb09-fe6465ad1c7e service nova] Creating event network-changed:ba570bf5-1107-41fc-8071-bd5b5f0321ed for instance 9ec33e8e-61d8-4663-a54f-8a1b57b3b7fc on n-h2-850468-14 Aug 10 23:18:06.361944 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-bc55d41a-2a20-4bc7-9515-605c5f9ea79e req-08ef419d-225a-4589-bb09-fe6465ad1c7e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099285 Aug 10 23:18:06.364713 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2283/4378] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:18:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:18:06.380124 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-971547e6-157b-49b3-84d5-2c0fe19a49f2 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:18:06.382353 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-971547e6-157b-49b3-84d5-2c0fe19a49f2 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: 7f49d27c-0fba-4d08-8f85-3eaed8b805e7] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:18:06.404700 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-971547e6-157b-49b3-84d5-2c0fe19a49f2 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:06.405610 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-971547e6-157b-49b3-84d5-2c0fe19a49f2 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:06.410338 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-971547e6-157b-49b3-84d5-2c0fe19a49f2 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:06.411647 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-971547e6-157b-49b3-84d5-2c0fe19a49f2 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:06.413798 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-971547e6-157b-49b3-84d5-2c0fe19a49f2 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:06.416439 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-971547e6-157b-49b3-84d5-2c0fe19a49f2 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:06.790033 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-971547e6-157b-49b3-84d5-2c0fe19a49f2 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:06.803623 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-971547e6-157b-49b3-84d5-2c0fe19a49f2 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/7f49d27c-0fba-4d08-8f85-3eaed8b805e7" status: 200 len: 1507 microversion: 2.1 time: 0.428895 Aug 10 23:18:06.805330 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2284/4379] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:18:06 2022] GET /compute/v2.1/servers/7f49d27c-0fba-4d08-8f85-3eaed8b805e7 => generated 1507 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:18:06.819836 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-af86d26f-abc3-42c7-a725-38ca39137262 tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:18:06.827485 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-af86d26f-abc3-42c7-a725-38ca39137262 tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] [instance: 9ec33e8e-61d8-4663-a54f-8a1b57b3b7fc] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:18:06.853286 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-af86d26f-abc3-42c7-a725-38ca39137262 tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:06.854118 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-af86d26f-abc3-42c7-a725-38ca39137262 tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:06.857116 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-af86d26f-abc3-42c7-a725-38ca39137262 tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:06.858674 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-af86d26f-abc3-42c7-a725-38ca39137262 tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:06.861966 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-af86d26f-abc3-42c7-a725-38ca39137262 tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:06.862706 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-af86d26f-abc3-42c7-a725-38ca39137262 tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:07.478770 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-af86d26f-abc3-42c7-a725-38ca39137262 tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3702c7420014cd5a5ae703e9abbd408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '388c27a7d5644cab98aedcac17f1debf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:07.488349 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-af86d26f-abc3-42c7-a725-38ca39137262 tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] 10.222.0.58 "GET /compute/v2.1/servers/9ec33e8e-61d8-4663-a54f-8a1b57b3b7fc" status: 200 len: 1315 microversion: 2.1 time: 0.677536 Aug 10 23:18:07.488760 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2285/4380] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:18:06 2022] GET /compute/v2.1/servers/9ec33e8e-61d8-4663-a54f-8a1b57b3b7fc => generated 1315 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:18:07.521046 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-3252a6d0-3266-4ce3-b0aa-2a8d9012425d tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:18:07.521559 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-3252a6d0-3266-4ce3-b0aa-2a8d9012425d tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] [instance: 250395b5-5be8-420a-8709-dcf8b4241a4e] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:18:07.531686 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3252a6d0-3266-4ce3-b0aa-2a8d9012425d tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:07.540377 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3252a6d0-3266-4ce3-b0aa-2a8d9012425d tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:07.541112 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3252a6d0-3266-4ce3-b0aa-2a8d9012425d tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:07.542073 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3252a6d0-3266-4ce3-b0aa-2a8d9012425d tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:07.543687 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3252a6d0-3266-4ce3-b0aa-2a8d9012425d tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:07.544325 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3252a6d0-3266-4ce3-b0aa-2a8d9012425d tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:07.663531 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-3252a6d0-3266-4ce3-b0aa-2a8d9012425d tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5899b2ad9f1046caaf7c6073e408eeee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25abd63376614081a9d484f3c9ae950d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:07.673371 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-3252a6d0-3266-4ce3-b0aa-2a8d9012425d tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "GET /compute/v2.1/servers/250395b5-5be8-420a-8709-dcf8b4241a4e" status: 200 len: 1620 microversion: 2.1 time: 0.183567 Aug 10 23:18:07.675243 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2286/4381] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:18:07 2022] GET /compute/v2.1/servers/250395b5-5be8-420a-8709-dcf8b4241a4e => generated 1620 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:18:07.687237 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-f308345a-ac3e-4bbb-8d00-da2566c5e2b3 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:18:07.691437 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-f308345a-ac3e-4bbb-8d00-da2566c5e2b3 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] [instance: 3ecbcf63-5592-4074-a3f7-d2caf3c58969] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:18:07.707478 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f308345a-ac3e-4bbb-8d00-da2566c5e2b3 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:07.709468 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f308345a-ac3e-4bbb-8d00-da2566c5e2b3 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:07.709984 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f308345a-ac3e-4bbb-8d00-da2566c5e2b3 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:07.710720 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f308345a-ac3e-4bbb-8d00-da2566c5e2b3 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:07.713346 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f308345a-ac3e-4bbb-8d00-da2566c5e2b3 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:07.714140 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f308345a-ac3e-4bbb-8d00-da2566c5e2b3 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:08.052498 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-f308345a-ac3e-4bbb-8d00-da2566c5e2b3 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07c94ebf0954cdea12b9a689538d96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395d7c4077e54c43bb95288db3942b0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:08.066351 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-f308345a-ac3e-4bbb-8d00-da2566c5e2b3 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] 10.222.0.58 "GET /compute/v2.1/servers/3ecbcf63-5592-4074-a3f7-d2caf3c58969" status: 200 len: 1717 microversion: 2.1 time: 0.388122 Aug 10 23:18:08.067100 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2287/4382] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:18:07 2022] GET /compute/v2.1/servers/3ecbcf63-5592-4074-a3f7-d2caf3c58969 => generated 1717 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:18:08.367204 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-23de939e-1aa8-4fb1-9248-f805c8d961c4 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-866821117", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452", "networks": [{"uuid": "af9afbc6-0659-47e6-b542-cfe9f265fcc2"}]}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:18:08.470422 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=90 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:18:08.500499 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.network.neutron [None req-23de939e-1aa8-4fb1-9248-f805c8d961c4 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] validate_networks() for [('af9afbc6-0659-47e6-b542-cfe9f265fcc2', None, None, None, None, None)] {{(pid=122633) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 23:18:09.770914 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-23de939e-1aa8-4fb1-9248-f805c8d961c4 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Flavor limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:18:09.772026 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-23de939e-1aa8-4fb1-9248-f805c8d961c4 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Image limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:18:09.773320 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-23de939e-1aa8-4fb1-9248-f805c8d961c4 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Flavor pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:18:09.773902 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-23de939e-1aa8-4fb1-9248-f805c8d961c4 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Image pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:18:09.774481 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-23de939e-1aa8-4fb1-9248-f805c8d961c4 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:18:09.799290 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-23de939e-1aa8-4fb1-9248-f805c8d961c4 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:09.806609 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-23de939e-1aa8-4fb1-9248-f805c8d961c4 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:09.808448 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-23de939e-1aa8-4fb1-9248-f805c8d961c4 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:09.809571 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-23de939e-1aa8-4fb1-9248-f805c8d961c4 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:09.810197 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-23de939e-1aa8-4fb1-9248-f805c8d961c4 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:09.812136 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-23de939e-1aa8-4fb1-9248-f805c8d961c4 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:09.877373 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-23de939e-1aa8-4fb1-9248-f805c8d961c4 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Getting quotas for project 0b0582ace9e4443b8ad88915503ee630. Resources: {'instances', 'cores', 'ram'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:18:09.890865 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-23de939e-1aa8-4fb1-9248-f805c8d961c4 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Getting quotas for user 6684f0c87e4242be9e0ffb4ef1973f96 and project 0b0582ace9e4443b8ad88915503ee630. Resources: {'instances', 'cores', 'ram'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:18:09.922016 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-23de939e-1aa8-4fb1-9248-f805c8d961c4 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Going to run 1 instances... {{(pid=122633) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 23:18:09.930294 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-23de939e-1aa8-4fb1-9248-f805c8d961c4 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: 1885b741-1fc3-413a-bb33-f8d3aeff8b04] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78ad8905-f66f-4733-8be9-2b260f1fabed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122633) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 23:18:10.044447 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-23de939e-1aa8-4fb1-9248-f805c8d961c4 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.948786 Aug 10 23:18:10.049548 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-25f7674e-00a0-47bc-87f8-5466c01f2977 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Flavor limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:18:10.050190 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-25f7674e-00a0-47bc-87f8-5466c01f2977 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Image limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:18:10.050735 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-25f7674e-00a0-47bc-87f8-5466c01f2977 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Flavor pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:18:10.051333 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-25f7674e-00a0-47bc-87f8-5466c01f2977 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Image pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:18:10.051853 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-25f7674e-00a0-47bc-87f8-5466c01f2977 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:18:10.054276 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2288/4383] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 23:18:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 1986 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 23:18:10.067340 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-3e1c92f6-e3cb-4aad-9596-c3ba5554b865 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:18:10.067928 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-3e1c92f6-e3cb-4aad-9596-c3ba5554b865 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] [instance: b812cd8c-7e33-4e97-8df6-c7fccdf12019] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:18:10.096802 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3e1c92f6-e3cb-4aad-9596-c3ba5554b865 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:10.097523 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3e1c92f6-e3cb-4aad-9596-c3ba5554b865 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:10.099141 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3e1c92f6-e3cb-4aad-9596-c3ba5554b865 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:10.099961 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3e1c92f6-e3cb-4aad-9596-c3ba5554b865 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:10.100420 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3e1c92f6-e3cb-4aad-9596-c3ba5554b865 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:10.100845 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3e1c92f6-e3cb-4aad-9596-c3ba5554b865 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:10.110057 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-25f7674e-00a0-47bc-87f8-5466c01f2977 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:10.110568 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-25f7674e-00a0-47bc-87f8-5466c01f2977 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:10.111037 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-25f7674e-00a0-47bc-87f8-5466c01f2977 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:10.112059 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-25f7674e-00a0-47bc-87f8-5466c01f2977 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:10.112251 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-25f7674e-00a0-47bc-87f8-5466c01f2977 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:10.115121 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-25f7674e-00a0-47bc-87f8-5466c01f2977 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:10.210258 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-25f7674e-00a0-47bc-87f8-5466c01f2977 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Getting quotas for project bfebe97ce8df4dab9b53298700295139. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:18:10.227638 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-25f7674e-00a0-47bc-87f8-5466c01f2977 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Getting quotas for user 1622d26ca18940cbbaba5eb72ce382d7 and project bfebe97ce8df4dab9b53298700295139. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:18:10.605014 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-25f7674e-00a0-47bc-87f8-5466c01f2977 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Going to run 1 instances... {{(pid=122632) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 23:18:10.609931 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-25f7674e-00a0-47bc-87f8-5466c01f2977 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] [instance: 7e091da3-0636-4cba-b8de-94fdeecf0b7f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='c1a86610-0aad-4fd2-a82d-ddc855274d74',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='36583d19-123e-4438-9bd9-78112448e3a3',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='266a1813-1f78-43a3-834c-18c64fddcc9d',volume_size=None,volume_type=None)] {{(pid=122632) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 23:18:10.788056 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-3e1c92f6-e3cb-4aad-9596-c3ba5554b865 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d89081084f14e0187f4c67cd9185fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b557edd165144c8943eb9acc339a377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:10.801043 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-3e1c92f6-e3cb-4aad-9596-c3ba5554b865 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] 10.222.0.58 "GET /compute/v2.1/servers/b812cd8c-7e33-4e97-8df6-c7fccdf12019" status: 200 len: 1366 microversion: 2.1 time: 0.743601 Aug 10 23:18:10.816254 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2289/4384] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:18:10 2022] GET /compute/v2.1/servers/b812cd8c-7e33-4e97-8df6-c7fccdf12019 => generated 1366 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:18:10.825334 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-e86b59ea-cfbe-4175-a85f-a8f57c0f5e8b req-9c97d065-b089-4c9e-a4cb-9cebac82b8ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "250395b5-5be8-420a-8709-dcf8b4241a4e", "name": "network-vif-deleted", "tag": "fb6df67c-3dbb-4a0f-98f0-c602e1eaa615"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:18:10.866398 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-e86b59ea-cfbe-4175-a85f-a8f57c0f5e8b req-9c97d065-b089-4c9e-a4cb-9cebac82b8ca service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:10.875573 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-e86b59ea-cfbe-4175-a85f-a8f57c0f5e8b req-9c97d065-b089-4c9e-a4cb-9cebac82b8ca service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:10.877333 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-e86b59ea-cfbe-4175-a85f-a8f57c0f5e8b req-9c97d065-b089-4c9e-a4cb-9cebac82b8ca service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:10.915508 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-e86b59ea-cfbe-4175-a85f-a8f57c0f5e8b req-9c97d065-b089-4c9e-a4cb-9cebac82b8ca service nova] Creating event network-vif-deleted:fb6df67c-3dbb-4a0f-98f0-c602e1eaa615 for instance 250395b5-5be8-420a-8709-dcf8b4241a4e on n-h1-850468-14 Aug 10 23:18:10.924300 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-e86b59ea-cfbe-4175-a85f-a8f57c0f5e8b req-9c97d065-b089-4c9e-a4cb-9cebac82b8ca service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105212 Aug 10 23:18:10.928135 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2290/4385] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:18:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:18:10.940111 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-2b91294c-0705-4ad5-93c0-0dde7f1cd760 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:18:10.942759 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-2b91294c-0705-4ad5-93c0-0dde7f1cd760 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: 7f49d27c-0fba-4d08-8f85-3eaed8b805e7] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:18:10.956501 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2b91294c-0705-4ad5-93c0-0dde7f1cd760 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:10.957855 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2b91294c-0705-4ad5-93c0-0dde7f1cd760 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:10.958928 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2b91294c-0705-4ad5-93c0-0dde7f1cd760 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:10.960580 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2b91294c-0705-4ad5-93c0-0dde7f1cd760 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:10.961656 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2b91294c-0705-4ad5-93c0-0dde7f1cd760 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:10.963044 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2b91294c-0705-4ad5-93c0-0dde7f1cd760 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:11.069980 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:18:11.500923 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-25f7674e-00a0-47bc-87f8-5466c01f2977 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.32 time: 12.962869 Aug 10 23:18:11.503805 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2096/4386] 10.222.0.58 () {62 vars in 1189 bytes} [Wed Aug 10 23:17:58 2022] POST /compute/v2.1/servers => generated 405 bytes in 12966 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 10 23:18:11.513592 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-e26ebb75-5d20-48d4-8e93-09f08aba7c5f req-08308e08-3b2b-4906-863b-755bcc04d975 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f49d27c-0fba-4d08-8f85-3eaed8b805e7", "name": "network-vif-plugged", "status": "completed", "tag": "69ad680e-3222-4e16-9619-7f0a0d9623e5"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:18:11.551565 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-2b91294c-0705-4ad5-93c0-0dde7f1cd760 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:11.557735 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-e26ebb75-5d20-48d4-8e93-09f08aba7c5f req-08308e08-3b2b-4906-863b-755bcc04d975 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:11.558364 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-e26ebb75-5d20-48d4-8e93-09f08aba7c5f req-08308e08-3b2b-4906-863b-755bcc04d975 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:11.565186 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-2b91294c-0705-4ad5-93c0-0dde7f1cd760 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/7f49d27c-0fba-4d08-8f85-3eaed8b805e7" status: 200 len: 1507 microversion: 2.1 time: 0.635507 Aug 10 23:18:11.571120 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2291/4387] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:18:10 2022] GET /compute/v2.1/servers/7f49d27c-0fba-4d08-8f85-3eaed8b805e7 => generated 1507 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:18:11.572615 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-e26ebb75-5d20-48d4-8e93-09f08aba7c5f req-08308e08-3b2b-4906-863b-755bcc04d975 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:11.587122 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-0ac35e97-2326-4297-b3d0-816394166bc2 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:18:11.587624 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-0ac35e97-2326-4297-b3d0-816394166bc2 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] [instance: 3ecbcf63-5592-4074-a3f7-d2caf3c58969] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:18:11.616844 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0ac35e97-2326-4297-b3d0-816394166bc2 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:11.617343 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0ac35e97-2326-4297-b3d0-816394166bc2 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:11.617795 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0ac35e97-2326-4297-b3d0-816394166bc2 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:11.618512 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0ac35e97-2326-4297-b3d0-816394166bc2 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:11.619000 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0ac35e97-2326-4297-b3d0-816394166bc2 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:11.619438 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0ac35e97-2326-4297-b3d0-816394166bc2 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:11.632766 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-e26ebb75-5d20-48d4-8e93-09f08aba7c5f req-08308e08-3b2b-4906-863b-755bcc04d975 service nova] Creating event network-vif-plugged:69ad680e-3222-4e16-9619-7f0a0d9623e5 for instance 7f49d27c-0fba-4d08-8f85-3eaed8b805e7 on n-h2-850468-14 Aug 10 23:18:11.649513 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-e26ebb75-5d20-48d4-8e93-09f08aba7c5f req-08308e08-3b2b-4906-863b-755bcc04d975 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.144468 Aug 10 23:18:11.655216 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2097/4388] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:18:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:18:11.665218 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-f51b82e1-e5b1-4500-b19a-8f8a52d8e267 tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:18:11.666323 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-f51b82e1-e5b1-4500-b19a-8f8a52d8e267 tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] [instance: 9ec33e8e-61d8-4663-a54f-8a1b57b3b7fc] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:18:11.675695 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f51b82e1-e5b1-4500-b19a-8f8a52d8e267 tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:11.676473 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f51b82e1-e5b1-4500-b19a-8f8a52d8e267 tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:11.677157 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f51b82e1-e5b1-4500-b19a-8f8a52d8e267 tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:11.678098 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f51b82e1-e5b1-4500-b19a-8f8a52d8e267 tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:11.679009 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f51b82e1-e5b1-4500-b19a-8f8a52d8e267 tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:11.679665 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f51b82e1-e5b1-4500-b19a-8f8a52d8e267 tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:11.876481 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-0ac35e97-2326-4297-b3d0-816394166bc2 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] HTTP exception thrown: Cannot 'detach_volume' instance 3ecbcf63-5592-4074-a3f7-d2caf3c58969 while it is in vm_state rescued Aug 10 23:18:11.881723 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-0ac35e97-2326-4297-b3d0-816394166bc2 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Request method failure captured: Aug 10 23:18:11.881723 n-d-850468-14 devstack@n-api.service[122633]: request: DELETE /compute/v2.1/servers/3ecbcf63-5592-4074-a3f7-d2caf3c58969/os-volume_attachments/d632d4af-1e58-4001-8d46-0d8419f7033e HTTP/1.1 Aug 10 23:18:11.881723 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:18:11.881723 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:18:11.881723 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:18:11.881723 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:18:11.881723 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:18:11.881723 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:18:11.881723 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:18:11.881723 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:18:11.881723 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9DvG6mPOp_bU6YQakEzMuJf91N1YrPRgIEe5ouB8tWtrXuOeLQgeJ0ouDTrtP31JIWcz1wQJ17PTz3JUAbF_FaF35I1F09nIb2lkQ0GhE880fsA2K13MCP_yKxqm-kv_hQLiQB8UzdyMBwb04C68j2QYpbobWhHyceARqBEeITDqyg0 Aug 10 23:18:11.881723 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:18:11.881723 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:18:11.881723 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:18:11.881723 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:18:11.881723 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:18:11.881723 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:18:11.881723 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 395d7c4077e54c43bb95288db3942b0a Aug 10 23:18:11.881723 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1029565464 Aug 10 23:18:11.881723 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:18:11.881723 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:18:11.881723 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/395d7c4077e54c43bb95288db3942b0a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/395d7c4077e54c43bb95288db3942b0a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/395d7c4077e54c43bb95288db3942b0a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_395d7c4077e54c43bb95288db3942b0a", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:18:11.881723 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1029565464 Aug 10 23:18:11.881723 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 395d7c4077e54c43bb95288db3942b0a Aug 10 23:18:11.881723 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1029565464 Aug 10 23:18:11.881723 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-ServerRescueNegativeTestJSON-1029565464-project Aug 10 23:18:11.881723 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:18:11.881723 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:18:11.881723 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: f07c94ebf0954cdea12b9a689538d96d Aug 10 23:18:11.881723 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1029565464-project Aug 10 23:18:11.881723 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:18:11.881723 n-d-850468-14 devstack@n-api.service[122633]: exception: Cannot 'detach_volume' instance 3ecbcf63-5592-4074-a3f7-d2caf3c58969 while it is in vm_state rescued Aug 10 23:18:11.881723 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'server_id': '3ecbcf63-5592-4074-a3f7-d2caf3c58969', 'id': 'd632d4af-1e58-4001-8d46-0d8419f7033e'} Aug 10 23:18:11.881723 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:18:11.881723 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:18:11.881723 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 10 23:18:11.881723 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 10 23:18:11.881723 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 10 23:18:11.881723 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 10 23:18:11.881723 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 10 23:18:11.881723 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 10 23:18:11.881723 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 3ecbcf63-5592-4074-a3f7-d2caf3c58969 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 10 23:18:11.881723 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:18:11.881723 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:18:11.881723 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:18:11.881723 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:18:11.881723 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:18:11.881723 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:18:11.881723 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:18:11.881723 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:18:11.881723 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:18:11.881723 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:18:11.881723 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 10 23:18:11.881723 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 10 23:18:11.881723 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 10 23:18:11.881723 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 10 23:18:11.881723 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 3ecbcf63-5592-4074-a3f7-d2caf3c58969 while it is in vm_state rescued Aug 10 23:18:11.881723 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:18:11.881723 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:18:11.881723 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:18:11.881723 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:18:11.887909 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:18:11.887909 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:18:11.887909 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:18:11.887909 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:18:11.887909 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 3ecbcf63-5592-4074-a3f7-d2caf3c58969 while it is in vm_state rescued Aug 10 23:18:11.887909 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:18:11.891062 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-0ac35e97-2326-4297-b3d0-816394166bc2 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Returning 409 to user: Cannot 'detach_volume' instance 3ecbcf63-5592-4074-a3f7-d2caf3c58969 while it is in vm_state rescued {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:18:11.893403 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-0ac35e97-2326-4297-b3d0-816394166bc2 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] 10.222.0.58 "DELETE /compute/v2.1/servers/3ecbcf63-5592-4074-a3f7-d2caf3c58969/os-volume_attachments/d632d4af-1e58-4001-8d46-0d8419f7033e" status: 409 len: 152 microversion: 2.1 time: 0.321266 Aug 10 23:18:11.897568 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2292/4389] 10.222.0.58 () {58 vars in 1416 bytes} [Wed Aug 10 23:18:11 2022] DELETE /compute/v2.1/servers/3ecbcf63-5592-4074-a3f7-d2caf3c58969/os-volume_attachments/d632d4af-1e58-4001-8d46-0d8419f7033e => generated 152 bytes in 326 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 10 23:18:11.913581 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-a3634e0e-76e5-4cee-a4b5-b31992ef1c86 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:18:11.915412 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-a3634e0e-76e5-4cee-a4b5-b31992ef1c86 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] [instance: 250395b5-5be8-420a-8709-dcf8b4241a4e] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:18:11.928087 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a3634e0e-76e5-4cee-a4b5-b31992ef1c86 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:11.929188 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a3634e0e-76e5-4cee-a4b5-b31992ef1c86 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:11.929914 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a3634e0e-76e5-4cee-a4b5-b31992ef1c86 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:11.931499 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a3634e0e-76e5-4cee-a4b5-b31992ef1c86 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:11.933361 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a3634e0e-76e5-4cee-a4b5-b31992ef1c86 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:11.934142 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a3634e0e-76e5-4cee-a4b5-b31992ef1c86 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:11.956570 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-a3634e0e-76e5-4cee-a4b5-b31992ef1c86 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] HTTP exception thrown: Instance 250395b5-5be8-420a-8709-dcf8b4241a4e could not be found. Aug 10 23:18:11.959972 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-a3634e0e-76e5-4cee-a4b5-b31992ef1c86 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Request method failure captured: Aug 10 23:18:11.959972 n-d-850468-14 devstack@n-api.service[122633]: request: GET /compute/v2.1/servers/250395b5-5be8-420a-8709-dcf8b4241a4e HTTP/1.1 Aug 10 23:18:11.959972 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:18:11.959972 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:18:11.959972 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:18:11.959972 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:18:11.959972 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:18:11.959972 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:18:11.959972 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:18:11.959972 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:18:11.959972 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9Ds_i3PDzfY831LhvXxRQTuETlpkVlxLBcxw-fA_3Rgh7BtMKg49t93n4W60rS-OkNCaJLSeSll4L6S-Ea6OzN1bcIzb1fgJBbur3wde6WJsUVM5pLO1qLazxYPdl_aqZKKVBhxsJX3P2s11u3EZ1kQF4iZz3H2MFzZDIBqiyZ7kxOA Aug 10 23:18:11.959972 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:18:11.959972 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:18:11.959972 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:18:11.959972 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:18:11.959972 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:18:11.959972 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:18:11.959972 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 25abd63376614081a9d484f3c9ae950d Aug 10 23:18:11.959972 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1591694610 Aug 10 23:18:11.959972 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:18:11.959972 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:18:11.959972 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/25abd63376614081a9d484f3c9ae950d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/25abd63376614081a9d484f3c9ae950d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/25abd63376614081a9d484f3c9ae950d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_25abd63376614081a9d484f3c9ae950d", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:18:11.959972 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1591694610 Aug 10 23:18:11.959972 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 25abd63376614081a9d484f3c9ae950d Aug 10 23:18:11.959972 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1591694610 Aug 10 23:18:11.959972 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-TestNetworkAdvancedServerOps-1591694610-project Aug 10 23:18:11.959972 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:18:11.959972 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:18:11.959972 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 5899b2ad9f1046caaf7c6073e408eeee Aug 10 23:18:11.959972 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1591694610-project Aug 10 23:18:11.959972 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:18:11.959972 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance 250395b5-5be8-420a-8709-dcf8b4241a4e could not be found. Aug 10 23:18:11.959972 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': '250395b5-5be8-420a-8709-dcf8b4241a4e'} Aug 10 23:18:11.959972 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:18:11.959972 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:18:11.959972 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:18:11.959972 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:18:11.959972 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:18:11.959972 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:18:11.959972 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:18:11.959972 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:18:11.959972 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:18:11.959972 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:18:11.959972 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 250395b5-5be8-420a-8709-dcf8b4241a4e could not be found. Aug 10 23:18:11.959972 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:18:11.959972 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:18:11.959972 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:18:11.959972 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:18:11.959972 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:18:11.959972 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:18:11.959972 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:18:11.959972 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:18:11.959972 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:18:11.959972 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:18:11.959972 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:18:11.959972 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:18:11.959972 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:18:11.959972 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:18:11.959972 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:18:11.959972 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:18:11.959972 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 250395b5-5be8-420a-8709-dcf8b4241a4e could not be found. Aug 10 23:18:11.959972 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:18:11.959972 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:18:11.965723 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:18:11.965723 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:18:11.965723 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:18:11.965723 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:18:11.965723 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:18:11.965723 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:18:11.965723 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 250395b5-5be8-420a-8709-dcf8b4241a4e could not be found. Aug 10 23:18:11.965723 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:18:11.969190 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-a3634e0e-76e5-4cee-a4b5-b31992ef1c86 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Returning 404 to user: Instance 250395b5-5be8-420a-8709-dcf8b4241a4e could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:18:11.971250 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-a3634e0e-76e5-4cee-a4b5-b31992ef1c86 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "GET /compute/v2.1/servers/250395b5-5be8-420a-8709-dcf8b4241a4e" status: 404 len: 111 microversion: 2.1 time: 0.071753 Aug 10 23:18:11.972065 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2293/4390] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:18:11 2022] GET /compute/v2.1/servers/250395b5-5be8-420a-8709-dcf8b4241a4e => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:18:11.981256 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-bcdeb07a-7e9b-4de4-ada7-00c10bbd9461 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:18:11.981824 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-f51b82e1-e5b1-4500-b19a-8f8a52d8e267 tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3702c7420014cd5a5ae703e9abbd408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '388c27a7d5644cab98aedcac17f1debf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:11.982560 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-bcdeb07a-7e9b-4de4-ada7-00c10bbd9461 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: 1885b741-1fc3-413a-bb33-f8d3aeff8b04] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:18:11.990274 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bcdeb07a-7e9b-4de4-ada7-00c10bbd9461 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:11.991134 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bcdeb07a-7e9b-4de4-ada7-00c10bbd9461 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:11.991812 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bcdeb07a-7e9b-4de4-ada7-00c10bbd9461 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:11.992946 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bcdeb07a-7e9b-4de4-ada7-00c10bbd9461 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:11.994263 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bcdeb07a-7e9b-4de4-ada7-00c10bbd9461 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:11.994976 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bcdeb07a-7e9b-4de4-ada7-00c10bbd9461 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:11.996567 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-f51b82e1-e5b1-4500-b19a-8f8a52d8e267 tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] 10.222.0.58 "GET /compute/v2.1/servers/9ec33e8e-61d8-4663-a54f-8a1b57b3b7fc" status: 200 len: 1315 microversion: 2.1 time: 0.337594 Aug 10 23:18:11.997359 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2098/4391] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:18:11 2022] GET /compute/v2.1/servers/9ec33e8e-61d8-4663-a54f-8a1b57b3b7fc => generated 1315 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:18:12.003410 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-f95f0fd1-7565-4908-9355-70909579ffc1 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:18:12.004286 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-f95f0fd1-7565-4908-9355-70909579ffc1 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] [instance: 7e091da3-0636-4cba-b8de-94fdeecf0b7f] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:18:12.082606 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-f95f0fd1-7565-4908-9355-70909579ffc1 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:12.117765 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-f95f0fd1-7565-4908-9355-70909579ffc1 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:12.123358 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-f95f0fd1-7565-4908-9355-70909579ffc1 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:12.127392 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-f95f0fd1-7565-4908-9355-70909579ffc1 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] 10.222.0.58 "GET /compute/v2.1/servers/7e091da3-0636-4cba-b8de-94fdeecf0b7f" status: 200 len: 1286 microversion: 2.32 time: 0.128848 Aug 10 23:18:12.130462 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2099/4392] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:18:11 2022] GET /compute/v2.1/servers/7e091da3-0636-4cba-b8de-94fdeecf0b7f => generated 1286 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:18:12.139344 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-5204a8bb-67c0-4dad-82c7-557c6e1bdadb tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:18:12.140843 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-5204a8bb-67c0-4dad-82c7-557c6e1bdadb tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] [instance: b812cd8c-7e33-4e97-8df6-c7fccdf12019] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:18:12.157594 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5204a8bb-67c0-4dad-82c7-557c6e1bdadb tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:12.159675 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5204a8bb-67c0-4dad-82c7-557c6e1bdadb tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:12.160542 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5204a8bb-67c0-4dad-82c7-557c6e1bdadb tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:12.162612 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5204a8bb-67c0-4dad-82c7-557c6e1bdadb tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:12.163629 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5204a8bb-67c0-4dad-82c7-557c6e1bdadb tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:12.164453 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5204a8bb-67c0-4dad-82c7-557c6e1bdadb tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:12.283778 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-bcdeb07a-7e9b-4de4-ada7-00c10bbd9461 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6684f0c87e4242be9e0ffb4ef1973f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0582ace9e4443b8ad88915503ee630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:12.304662 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-bcdeb07a-7e9b-4de4-ada7-00c10bbd9461 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "GET /compute/v2.1/servers/1885b741-1fc3-413a-bb33-f8d3aeff8b04" status: 200 len: 1244 microversion: 2.1 time: 0.330239 Aug 10 23:18:12.315217 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2294/4393] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:18:11 2022] GET /compute/v2.1/servers/1885b741-1fc3-413a-bb33-f8d3aeff8b04 => generated 1244 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:18:12.325724 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-919fcc2a-23dc-4c7d-a7cc-16481e172b45 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:18:12.326498 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-919fcc2a-23dc-4c7d-a7cc-16481e172b45 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] [instance: 3ecbcf63-5592-4074-a3f7-d2caf3c58969] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:18:12.344360 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-919fcc2a-23dc-4c7d-a7cc-16481e172b45 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:12.345258 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-919fcc2a-23dc-4c7d-a7cc-16481e172b45 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:12.346170 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-919fcc2a-23dc-4c7d-a7cc-16481e172b45 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:12.348087 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-919fcc2a-23dc-4c7d-a7cc-16481e172b45 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:12.349204 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-919fcc2a-23dc-4c7d-a7cc-16481e172b45 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:12.350494 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-919fcc2a-23dc-4c7d-a7cc-16481e172b45 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:12.445342 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-5204a8bb-67c0-4dad-82c7-557c6e1bdadb tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d89081084f14e0187f4c67cd9185fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b557edd165144c8943eb9acc339a377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:12.458415 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-5204a8bb-67c0-4dad-82c7-557c6e1bdadb tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] 10.222.0.58 "GET /compute/v2.1/servers/b812cd8c-7e33-4e97-8df6-c7fccdf12019" status: 200 len: 1366 microversion: 2.1 time: 0.326269 Aug 10 23:18:12.466945 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2100/4394] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:18:12 2022] GET /compute/v2.1/servers/b812cd8c-7e33-4e97-8df6-c7fccdf12019 => generated 1366 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:18:12.595419 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-dddea5ff-c287-47dd-a543-75211b62d371 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:18:12.596862 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-dddea5ff-c287-47dd-a543-75211b62d371 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: 7f49d27c-0fba-4d08-8f85-3eaed8b805e7] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:18:12.612169 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dddea5ff-c287-47dd-a543-75211b62d371 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:12.612627 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-919fcc2a-23dc-4c7d-a7cc-16481e172b45 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] 10.222.0.58 "POST /compute/v2.1/servers/3ecbcf63-5592-4074-a3f7-d2caf3c58969/action" status: 202 len: 0 microversion: 2.1 time: 0.287969 Aug 10 23:18:12.614542 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2295/4395] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:18:12 2022] POST /compute/v2.1/servers/3ecbcf63-5592-4074-a3f7-d2caf3c58969/action => generated 0 bytes in 299 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:18:12.620463 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dddea5ff-c287-47dd-a543-75211b62d371 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:12.625043 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-143abfe5-ee9e-417c-90de-3a6bd79c6f43 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:18:12.627443 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dddea5ff-c287-47dd-a543-75211b62d371 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:12.629844 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dddea5ff-c287-47dd-a543-75211b62d371 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:12.630579 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dddea5ff-c287-47dd-a543-75211b62d371 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:12.631943 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dddea5ff-c287-47dd-a543-75211b62d371 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:12.639755 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-143abfe5-ee9e-417c-90de-3a6bd79c6f43 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] [instance: 3ecbcf63-5592-4074-a3f7-d2caf3c58969] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:18:12.663702 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-143abfe5-ee9e-417c-90de-3a6bd79c6f43 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:12.664577 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-143abfe5-ee9e-417c-90de-3a6bd79c6f43 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:12.665257 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-143abfe5-ee9e-417c-90de-3a6bd79c6f43 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:12.666215 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-143abfe5-ee9e-417c-90de-3a6bd79c6f43 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:12.666994 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-143abfe5-ee9e-417c-90de-3a6bd79c6f43 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:12.668002 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-143abfe5-ee9e-417c-90de-3a6bd79c6f43 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:13.117070 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-143abfe5-ee9e-417c-90de-3a6bd79c6f43 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07c94ebf0954cdea12b9a689538d96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395d7c4077e54c43bb95288db3942b0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:13.135671 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-143abfe5-ee9e-417c-90de-3a6bd79c6f43 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] 10.222.0.58 "GET /compute/v2.1/servers/3ecbcf63-5592-4074-a3f7-d2caf3c58969" status: 200 len: 1725 microversion: 2.1 time: 0.516294 Aug 10 23:18:13.155760 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2296/4396] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:18:12 2022] GET /compute/v2.1/servers/3ecbcf63-5592-4074-a3f7-d2caf3c58969 => generated 1725 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:18:13.171736 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-1991c065-4e8b-46fb-8e1e-2e70dd6e5ae3 tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:18:13.172442 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-1991c065-4e8b-46fb-8e1e-2e70dd6e5ae3 tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] [instance: 9ec33e8e-61d8-4663-a54f-8a1b57b3b7fc] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:18:13.183480 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1991c065-4e8b-46fb-8e1e-2e70dd6e5ae3 tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:13.187108 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1991c065-4e8b-46fb-8e1e-2e70dd6e5ae3 tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:13.188388 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1991c065-4e8b-46fb-8e1e-2e70dd6e5ae3 tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:13.191179 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1991c065-4e8b-46fb-8e1e-2e70dd6e5ae3 tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:13.193685 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1991c065-4e8b-46fb-8e1e-2e70dd6e5ae3 tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:13.195408 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1991c065-4e8b-46fb-8e1e-2e70dd6e5ae3 tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:13.810267 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-dddea5ff-c287-47dd-a543-75211b62d371 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:13.825082 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-dddea5ff-c287-47dd-a543-75211b62d371 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/7f49d27c-0fba-4d08-8f85-3eaed8b805e7" status: 200 len: 1507 microversion: 2.1 time: 1.236069 Aug 10 23:18:13.835247 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2101/4397] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:18:12 2022] GET /compute/v2.1/servers/7f49d27c-0fba-4d08-8f85-3eaed8b805e7 => generated 1507 bytes in 1247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:18:13.859294 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-33998e56-f50e-44e8-8f3e-972de0bc9380 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:18:13.870073 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-33998e56-f50e-44e8-8f3e-972de0bc9380 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] [instance: 7e091da3-0636-4cba-b8de-94fdeecf0b7f] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:18:13.892377 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-33998e56-f50e-44e8-8f3e-972de0bc9380 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:13.893083 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-33998e56-f50e-44e8-8f3e-972de0bc9380 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:13.893607 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-33998e56-f50e-44e8-8f3e-972de0bc9380 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:13.894416 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-33998e56-f50e-44e8-8f3e-972de0bc9380 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:13.895027 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-33998e56-f50e-44e8-8f3e-972de0bc9380 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:13.896367 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-33998e56-f50e-44e8-8f3e-972de0bc9380 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:14.429642 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-1991c065-4e8b-46fb-8e1e-2e70dd6e5ae3 tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3702c7420014cd5a5ae703e9abbd408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '388c27a7d5644cab98aedcac17f1debf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:14.451124 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-33998e56-f50e-44e8-8f3e-972de0bc9380 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:14.468438 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-33998e56-f50e-44e8-8f3e-972de0bc9380 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:14.470350 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-33998e56-f50e-44e8-8f3e-972de0bc9380 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:14.471781 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-33998e56-f50e-44e8-8f3e-972de0bc9380 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] 10.222.0.58 "GET /compute/v2.1/servers/7e091da3-0636-4cba-b8de-94fdeecf0b7f" status: 200 len: 1520 microversion: 2.32 time: 0.635092 Aug 10 23:18:14.477185 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2102/4398] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:18:13 2022] GET /compute/v2.1/servers/7e091da3-0636-4cba-b8de-94fdeecf0b7f => generated 1520 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:18:14.491781 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-03143044-d28c-4e86-868d-a95108c5bf48 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:18:14.493176 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-1991c065-4e8b-46fb-8e1e-2e70dd6e5ae3 tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] 10.222.0.58 "GET /compute/v2.1/servers/9ec33e8e-61d8-4663-a54f-8a1b57b3b7fc" status: 200 len: 1315 microversion: 2.1 time: 1.336200 Aug 10 23:18:14.493931 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2297/4399] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:18:13 2022] GET /compute/v2.1/servers/9ec33e8e-61d8-4663-a54f-8a1b57b3b7fc => generated 1315 bytes in 1338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:18:14.499704 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-cb780be0-5cc4-4bcf-9611-732b305b4806 req-34c3064a-5e5a-418a-b980-ea6f5f641ac8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b812cd8c-7e33-4e97-8df6-c7fccdf12019", "tag": "fc32a303-f86b-4983-9b9a-e8ed05dd3d0f"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:18:14.509678 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-03143044-d28c-4e86-868d-a95108c5bf48 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: 1885b741-1fc3-413a-bb33-f8d3aeff8b04] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:18:14.531396 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-cb780be0-5cc4-4bcf-9611-732b305b4806 req-34c3064a-5e5a-418a-b980-ea6f5f641ac8 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:14.532166 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-cb780be0-5cc4-4bcf-9611-732b305b4806 req-34c3064a-5e5a-418a-b980-ea6f5f641ac8 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:14.532954 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-03143044-d28c-4e86-868d-a95108c5bf48 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:14.533452 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-03143044-d28c-4e86-868d-a95108c5bf48 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:14.534082 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-03143044-d28c-4e86-868d-a95108c5bf48 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:14.534854 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-cb780be0-5cc4-4bcf-9611-732b305b4806 req-34c3064a-5e5a-418a-b980-ea6f5f641ac8 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:14.535191 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-03143044-d28c-4e86-868d-a95108c5bf48 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:14.535889 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-03143044-d28c-4e86-868d-a95108c5bf48 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:14.536558 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-03143044-d28c-4e86-868d-a95108c5bf48 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:14.560720 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-cb780be0-5cc4-4bcf-9611-732b305b4806 req-34c3064a-5e5a-418a-b980-ea6f5f641ac8 service nova] Creating event network-changed:fc32a303-f86b-4983-9b9a-e8ed05dd3d0f for instance b812cd8c-7e33-4e97-8df6-c7fccdf12019 on n-h1-850468-14 Aug 10 23:18:14.580733 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-cb780be0-5cc4-4bcf-9611-732b305b4806 req-34c3064a-5e5a-418a-b980-ea6f5f641ac8 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085385 Aug 10 23:18:14.581349 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2298/4400] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:18:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:18:14.586743 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-28861d26-a8c7-4d00-b4af-e84aae2065da tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:18:14.605192 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-28861d26-a8c7-4d00-b4af-e84aae2065da tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] [instance: b812cd8c-7e33-4e97-8df6-c7fccdf12019] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:18:14.653870 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-28861d26-a8c7-4d00-b4af-e84aae2065da tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:14.654479 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-28861d26-a8c7-4d00-b4af-e84aae2065da tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:14.655019 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-28861d26-a8c7-4d00-b4af-e84aae2065da tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:14.655957 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-28861d26-a8c7-4d00-b4af-e84aae2065da tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:14.656576 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-28861d26-a8c7-4d00-b4af-e84aae2065da tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:14.657174 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-28861d26-a8c7-4d00-b4af-e84aae2065da tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:14.817308 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-03143044-d28c-4e86-868d-a95108c5bf48 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6684f0c87e4242be9e0ffb4ef1973f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0582ace9e4443b8ad88915503ee630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:14.834357 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-03143044-d28c-4e86-868d-a95108c5bf48 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "GET /compute/v2.1/servers/1885b741-1fc3-413a-bb33-f8d3aeff8b04" status: 200 len: 1250 microversion: 2.1 time: 0.346235 Aug 10 23:18:14.840558 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2103/4401] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:18:14 2022] GET /compute/v2.1/servers/1885b741-1fc3-413a-bb33-f8d3aeff8b04 => generated 1250 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:18:14.860604 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-89eb5430-5a28-4d26-bdbc-76b8ebbb5c3f req-3d4405d0-5a00-4311-8c04-92b7e28b17b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ec33e8e-61d8-4663-a54f-8a1b57b3b7fc", "name": "network-vif-plugged", "status": "completed", "tag": "ba570bf5-1107-41fc-8071-bd5b5f0321ed"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:18:14.898570 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-89eb5430-5a28-4d26-bdbc-76b8ebbb5c3f req-3d4405d0-5a00-4311-8c04-92b7e28b17b4 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:14.899407 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-89eb5430-5a28-4d26-bdbc-76b8ebbb5c3f req-3d4405d0-5a00-4311-8c04-92b7e28b17b4 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:14.899976 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-89eb5430-5a28-4d26-bdbc-76b8ebbb5c3f req-3d4405d0-5a00-4311-8c04-92b7e28b17b4 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:14.940668 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-89eb5430-5a28-4d26-bdbc-76b8ebbb5c3f req-3d4405d0-5a00-4311-8c04-92b7e28b17b4 service nova] Creating event network-vif-plugged:ba570bf5-1107-41fc-8071-bd5b5f0321ed for instance 9ec33e8e-61d8-4663-a54f-8a1b57b3b7fc on n-h2-850468-14 Aug 10 23:18:14.949434 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-89eb5430-5a28-4d26-bdbc-76b8ebbb5c3f req-3d4405d0-5a00-4311-8c04-92b7e28b17b4 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107082 Aug 10 23:18:14.954743 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2104/4402] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:18:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:18:14.961778 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-2bf9922e-07bc-4eec-a7d2-decd2f15c858 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:18:14.967822 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-2bf9922e-07bc-4eec-a7d2-decd2f15c858 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] [instance: 3ecbcf63-5592-4074-a3f7-d2caf3c58969] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:18:14.978326 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2bf9922e-07bc-4eec-a7d2-decd2f15c858 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:14.999107 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2bf9922e-07bc-4eec-a7d2-decd2f15c858 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:14.999588 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2bf9922e-07bc-4eec-a7d2-decd2f15c858 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:15.000359 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2bf9922e-07bc-4eec-a7d2-decd2f15c858 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:15.005895 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2bf9922e-07bc-4eec-a7d2-decd2f15c858 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:15.010504 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2bf9922e-07bc-4eec-a7d2-decd2f15c858 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:15.758391 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-28861d26-a8c7-4d00-b4af-e84aae2065da tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d89081084f14e0187f4c67cd9185fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b557edd165144c8943eb9acc339a377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:15.768832 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-28861d26-a8c7-4d00-b4af-e84aae2065da tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] 10.222.0.58 "GET /compute/v2.1/servers/b812cd8c-7e33-4e97-8df6-c7fccdf12019" status: 200 len: 1366 microversion: 2.1 time: 1.186270 Aug 10 23:18:15.784376 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2299/4403] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:18:14 2022] GET /compute/v2.1/servers/b812cd8c-7e33-4e97-8df6-c7fccdf12019 => generated 1366 bytes in 1202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:18:15.792656 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-ff24ac13-b209-43d6-910f-1485d4a501e2 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:18:15.794378 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-ff24ac13-b209-43d6-910f-1485d4a501e2 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: 7f49d27c-0fba-4d08-8f85-3eaed8b805e7] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:18:15.801515 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ff24ac13-b209-43d6-910f-1485d4a501e2 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:15.802213 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ff24ac13-b209-43d6-910f-1485d4a501e2 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:15.803254 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ff24ac13-b209-43d6-910f-1485d4a501e2 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:15.804928 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ff24ac13-b209-43d6-910f-1485d4a501e2 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:15.805856 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ff24ac13-b209-43d6-910f-1485d4a501e2 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:15.806511 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ff24ac13-b209-43d6-910f-1485d4a501e2 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:15.905847 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-2bf9922e-07bc-4eec-a7d2-decd2f15c858 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07c94ebf0954cdea12b9a689538d96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395d7c4077e54c43bb95288db3942b0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:15.918171 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-2bf9922e-07bc-4eec-a7d2-decd2f15c858 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] 10.222.0.58 "GET /compute/v2.1/servers/3ecbcf63-5592-4074-a3f7-d2caf3c58969" status: 200 len: 1725 microversion: 2.1 time: 0.958662 Aug 10 23:18:15.922065 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2105/4404] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:18:14 2022] GET /compute/v2.1/servers/3ecbcf63-5592-4074-a3f7-d2caf3c58969 => generated 1725 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:18:15.945757 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-ec392bce-2943-4e36-ab10-eadb1a8346e2 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:18:15.946806 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-ec392bce-2943-4e36-ab10-eadb1a8346e2 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] [instance: 7e091da3-0636-4cba-b8de-94fdeecf0b7f] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:18:15.955706 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ec392bce-2943-4e36-ab10-eadb1a8346e2 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:15.956785 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ec392bce-2943-4e36-ab10-eadb1a8346e2 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:15.958216 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ec392bce-2943-4e36-ab10-eadb1a8346e2 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:15.959061 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ec392bce-2943-4e36-ab10-eadb1a8346e2 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:15.959751 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ec392bce-2943-4e36-ab10-eadb1a8346e2 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:15.960379 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ec392bce-2943-4e36-ab10-eadb1a8346e2 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:16.140545 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-ec392bce-2943-4e36-ab10-eadb1a8346e2 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:16.168110 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-ec392bce-2943-4e36-ab10-eadb1a8346e2 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:16.176903 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-ec392bce-2943-4e36-ab10-eadb1a8346e2 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:16.185640 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-ec392bce-2943-4e36-ab10-eadb1a8346e2 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] 10.222.0.58 "GET /compute/v2.1/servers/7e091da3-0636-4cba-b8de-94fdeecf0b7f" status: 200 len: 1594 microversion: 2.32 time: 0.249033 Aug 10 23:18:16.186882 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2106/4405] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:18:15 2022] GET /compute/v2.1/servers/7e091da3-0636-4cba-b8de-94fdeecf0b7f => generated 1594 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:18:16.191699 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-e91cb49d-0aa4-4a03-b2d2-882bda4dd25f tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:18:16.194251 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-e91cb49d-0aa4-4a03-b2d2-882bda4dd25f tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] [instance: 9ec33e8e-61d8-4663-a54f-8a1b57b3b7fc] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:18:16.211114 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e91cb49d-0aa4-4a03-b2d2-882bda4dd25f tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:16.211799 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e91cb49d-0aa4-4a03-b2d2-882bda4dd25f tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:16.212484 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e91cb49d-0aa4-4a03-b2d2-882bda4dd25f tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:16.214130 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e91cb49d-0aa4-4a03-b2d2-882bda4dd25f tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:16.215109 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e91cb49d-0aa4-4a03-b2d2-882bda4dd25f tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:16.217743 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e91cb49d-0aa4-4a03-b2d2-882bda4dd25f tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:16.764351 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-e91cb49d-0aa4-4a03-b2d2-882bda4dd25f tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3702c7420014cd5a5ae703e9abbd408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '388c27a7d5644cab98aedcac17f1debf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:16.772682 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-e91cb49d-0aa4-4a03-b2d2-882bda4dd25f tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] 10.222.0.58 "GET /compute/v2.1/servers/9ec33e8e-61d8-4663-a54f-8a1b57b3b7fc" status: 200 len: 1315 microversion: 2.1 time: 0.584587 Aug 10 23:18:16.786266 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2107/4406] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:18:16 2022] GET /compute/v2.1/servers/9ec33e8e-61d8-4663-a54f-8a1b57b3b7fc => generated 1315 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:18:16.786266 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-136c2178-d1f9-4675-ae82-c3297d0521bc tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:18:16.786266 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-136c2178-d1f9-4675-ae82-c3297d0521bc tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: 1885b741-1fc3-413a-bb33-f8d3aeff8b04] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:18:16.809854 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-136c2178-d1f9-4675-ae82-c3297d0521bc tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:16.810384 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-136c2178-d1f9-4675-ae82-c3297d0521bc tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:16.810850 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-136c2178-d1f9-4675-ae82-c3297d0521bc tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:16.811568 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-136c2178-d1f9-4675-ae82-c3297d0521bc tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:16.812017 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-136c2178-d1f9-4675-ae82-c3297d0521bc tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:16.812445 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-136c2178-d1f9-4675-ae82-c3297d0521bc tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:16.891823 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-ff24ac13-b209-43d6-910f-1485d4a501e2 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:16.903835 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-ff24ac13-b209-43d6-910f-1485d4a501e2 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/7f49d27c-0fba-4d08-8f85-3eaed8b805e7" status: 200 len: 1507 microversion: 2.1 time: 1.117781 Aug 10 23:18:16.904443 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2300/4407] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:18:15 2022] GET /compute/v2.1/servers/7f49d27c-0fba-4d08-8f85-3eaed8b805e7 => generated 1507 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:18:16.934190 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-7dbea5c6-4604-4f63-982c-5256297cef3c tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:18:16.939759 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-7dbea5c6-4604-4f63-982c-5256297cef3c tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] [instance: b812cd8c-7e33-4e97-8df6-c7fccdf12019] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:18:16.962653 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:18:16.965518 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7dbea5c6-4604-4f63-982c-5256297cef3c tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:16.966023 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7dbea5c6-4604-4f63-982c-5256297cef3c tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:16.966456 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7dbea5c6-4604-4f63-982c-5256297cef3c tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:16.970234 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7dbea5c6-4604-4f63-982c-5256297cef3c tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:16.970720 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7dbea5c6-4604-4f63-982c-5256297cef3c tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:16.972275 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7dbea5c6-4604-4f63-982c-5256297cef3c tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:17.715649 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-7dbea5c6-4604-4f63-982c-5256297cef3c tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d89081084f14e0187f4c67cd9185fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b557edd165144c8943eb9acc339a377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:17.732110 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-7dbea5c6-4604-4f63-982c-5256297cef3c tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] 10.222.0.58 "GET /compute/v2.1/servers/b812cd8c-7e33-4e97-8df6-c7fccdf12019" status: 200 len: 1366 microversion: 2.1 time: 0.822280 Aug 10 23:18:17.738338 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-136c2178-d1f9-4675-ae82-c3297d0521bc tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6684f0c87e4242be9e0ffb4ef1973f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0582ace9e4443b8ad88915503ee630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:17.749964 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2301/4408] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:18:16 2022] GET /compute/v2.1/servers/b812cd8c-7e33-4e97-8df6-c7fccdf12019 => generated 1366 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:18:17.753074 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-136c2178-d1f9-4675-ae82-c3297d0521bc tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "GET /compute/v2.1/servers/1885b741-1fc3-413a-bb33-f8d3aeff8b04" status: 200 len: 1250 microversion: 2.1 time: 0.975728 Aug 10 23:18:17.771096 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-19bb386d-7767-4636-807d-7b746820751d tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:18:17.771708 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-19bb386d-7767-4636-807d-7b746820751d tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] [instance: 3ecbcf63-5592-4074-a3f7-d2caf3c58969] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:18:17.775201 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2108/4409] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:18:16 2022] GET /compute/v2.1/servers/1885b741-1fc3-413a-bb33-f8d3aeff8b04 => generated 1250 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:18:17.780849 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-0bd143b1-bf6d-4b02-afdc-07470ade0d72 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:18:17.781457 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-0bd143b1-bf6d-4b02-afdc-07470ade0d72 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] [instance: 7e091da3-0636-4cba-b8de-94fdeecf0b7f] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:18:17.797503 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-19bb386d-7767-4636-807d-7b746820751d tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:17.797992 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-19bb386d-7767-4636-807d-7b746820751d tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:17.798424 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-19bb386d-7767-4636-807d-7b746820751d tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:17.799153 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-19bb386d-7767-4636-807d-7b746820751d tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:17.799605 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-19bb386d-7767-4636-807d-7b746820751d tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:17.800025 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-19bb386d-7767-4636-807d-7b746820751d tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:17.815572 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0bd143b1-bf6d-4b02-afdc-07470ade0d72 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:17.816059 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0bd143b1-bf6d-4b02-afdc-07470ade0d72 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:17.816493 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0bd143b1-bf6d-4b02-afdc-07470ade0d72 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:17.817197 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0bd143b1-bf6d-4b02-afdc-07470ade0d72 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:17.817646 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0bd143b1-bf6d-4b02-afdc-07470ade0d72 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:17.818067 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0bd143b1-bf6d-4b02-afdc-07470ade0d72 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:18.595913 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-19bb386d-7767-4636-807d-7b746820751d tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07c94ebf0954cdea12b9a689538d96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395d7c4077e54c43bb95288db3942b0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:18.608157 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-19bb386d-7767-4636-807d-7b746820751d tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] 10.222.0.58 "GET /compute/v2.1/servers/3ecbcf63-5592-4074-a3f7-d2caf3c58969" status: 200 len: 1725 microversion: 2.1 time: 0.857082 Aug 10 23:18:18.609058 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2302/4410] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:18:17 2022] GET /compute/v2.1/servers/3ecbcf63-5592-4074-a3f7-d2caf3c58969 => generated 1725 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:18:18.621860 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-0bd143b1-bf6d-4b02-afdc-07470ade0d72 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:18.634467 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-0bd143b1-bf6d-4b02-afdc-07470ade0d72 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:18.640208 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-0bd143b1-bf6d-4b02-afdc-07470ade0d72 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:18.643030 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-0bd143b1-bf6d-4b02-afdc-07470ade0d72 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] 10.222.0.58 "GET /compute/v2.1/servers/7e091da3-0636-4cba-b8de-94fdeecf0b7f" status: 200 len: 1661 microversion: 2.32 time: 0.865504 Aug 10 23:18:18.644188 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2109/4411] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:18:17 2022] GET /compute/v2.1/servers/7e091da3-0636-4cba-b8de-94fdeecf0b7f => generated 1661 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:18:18.646048 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-f9110311-4706-4070-8c95-d21cf39749e3 tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:18:18.647986 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-f9110311-4706-4070-8c95-d21cf39749e3 tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] [instance: 9ec33e8e-61d8-4663-a54f-8a1b57b3b7fc] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:18:18.650411 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-b33d98f5-cfbe-4dc8-81e0-c1a790249dd3 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:18:18.651396 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-b33d98f5-cfbe-4dc8-81e0-c1a790249dd3 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: 7f49d27c-0fba-4d08-8f85-3eaed8b805e7] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:18:18.661373 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b33d98f5-cfbe-4dc8-81e0-c1a790249dd3 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:18.662157 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b33d98f5-cfbe-4dc8-81e0-c1a790249dd3 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:18.662887 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b33d98f5-cfbe-4dc8-81e0-c1a790249dd3 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:18.663793 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b33d98f5-cfbe-4dc8-81e0-c1a790249dd3 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:18.664418 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b33d98f5-cfbe-4dc8-81e0-c1a790249dd3 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:18.665027 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b33d98f5-cfbe-4dc8-81e0-c1a790249dd3 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:18.679129 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f9110311-4706-4070-8c95-d21cf39749e3 tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:18.681524 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f9110311-4706-4070-8c95-d21cf39749e3 tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:18.696393 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f9110311-4706-4070-8c95-d21cf39749e3 tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:18.698332 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f9110311-4706-4070-8c95-d21cf39749e3 tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:18.698332 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f9110311-4706-4070-8c95-d21cf39749e3 tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:18.699444 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f9110311-4706-4070-8c95-d21cf39749e3 tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:19.161448 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-b33d98f5-cfbe-4dc8-81e0-c1a790249dd3 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:19.182866 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-b33d98f5-cfbe-4dc8-81e0-c1a790249dd3 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/7f49d27c-0fba-4d08-8f85-3eaed8b805e7" status: 200 len: 1507 microversion: 2.1 time: 0.537171 Aug 10 23:18:19.183500 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2110/4412] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:18:18 2022] GET /compute/v2.1/servers/7f49d27c-0fba-4d08-8f85-3eaed8b805e7 => generated 1507 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:18:19.207365 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-aab97e7c-b6f5-4322-8da7-89f64d1289c7 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:18:19.208648 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-aab97e7c-b6f5-4322-8da7-89f64d1289c7 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] [instance: b812cd8c-7e33-4e97-8df6-c7fccdf12019] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:18:19.225240 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-aab97e7c-b6f5-4322-8da7-89f64d1289c7 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:19.226022 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-aab97e7c-b6f5-4322-8da7-89f64d1289c7 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:19.227189 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-aab97e7c-b6f5-4322-8da7-89f64d1289c7 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:19.228138 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-aab97e7c-b6f5-4322-8da7-89f64d1289c7 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:19.228777 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-aab97e7c-b6f5-4322-8da7-89f64d1289c7 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:19.229931 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-aab97e7c-b6f5-4322-8da7-89f64d1289c7 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:19.843595 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=4 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:18:19.910079 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=12 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:18:19.960605 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-aab97e7c-b6f5-4322-8da7-89f64d1289c7 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d89081084f14e0187f4c67cd9185fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b557edd165144c8943eb9acc339a377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:19.978039 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-aab97e7c-b6f5-4322-8da7-89f64d1289c7 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] 10.222.0.58 "GET /compute/v2.1/servers/b812cd8c-7e33-4e97-8df6-c7fccdf12019" status: 200 len: 1366 microversion: 2.1 time: 0.778785 Aug 10 23:18:19.985384 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2111/4413] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:18:19 2022] GET /compute/v2.1/servers/b812cd8c-7e33-4e97-8df6-c7fccdf12019 => generated 1366 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:18:19.998018 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-e344e3d6-30fa-4daf-a2b1-858b6e48f49e tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:18:19.999661 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-e344e3d6-30fa-4daf-a2b1-858b6e48f49e tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: 1885b741-1fc3-413a-bb33-f8d3aeff8b04] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:18:20.029444 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e344e3d6-30fa-4daf-a2b1-858b6e48f49e tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:20.045872 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e344e3d6-30fa-4daf-a2b1-858b6e48f49e tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:20.046524 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e344e3d6-30fa-4daf-a2b1-858b6e48f49e tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:20.047449 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e344e3d6-30fa-4daf-a2b1-858b6e48f49e tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:20.048317 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e344e3d6-30fa-4daf-a2b1-858b6e48f49e tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:20.049745 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e344e3d6-30fa-4daf-a2b1-858b6e48f49e tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:20.174886 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=2 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:18:20.216515 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-f9110311-4706-4070-8c95-d21cf39749e3 tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3702c7420014cd5a5ae703e9abbd408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '388c27a7d5644cab98aedcac17f1debf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:20.225067 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-f9110311-4706-4070-8c95-d21cf39749e3 tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] 10.222.0.58 "GET /compute/v2.1/servers/9ec33e8e-61d8-4663-a54f-8a1b57b3b7fc" status: 200 len: 1465 microversion: 2.1 time: 1.610276 Aug 10 23:18:20.231109 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2303/4414] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:18:18 2022] GET /compute/v2.1/servers/9ec33e8e-61d8-4663-a54f-8a1b57b3b7fc => generated 1465 bytes in 1617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:18:20.242345 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-3f8d4d3b-4cfb-4b46-932a-74efdf7f5309 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:18:20.243466 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-3f8d4d3b-4cfb-4b46-932a-74efdf7f5309 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] [instance: 3ecbcf63-5592-4074-a3f7-d2caf3c58969] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:18:20.278096 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3f8d4d3b-4cfb-4b46-932a-74efdf7f5309 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:20.279078 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3f8d4d3b-4cfb-4b46-932a-74efdf7f5309 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:20.289504 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3f8d4d3b-4cfb-4b46-932a-74efdf7f5309 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:20.291645 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3f8d4d3b-4cfb-4b46-932a-74efdf7f5309 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:20.292445 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3f8d4d3b-4cfb-4b46-932a-74efdf7f5309 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:20.293168 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3f8d4d3b-4cfb-4b46-932a-74efdf7f5309 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:20.532007 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-3f8d4d3b-4cfb-4b46-932a-74efdf7f5309 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07c94ebf0954cdea12b9a689538d96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395d7c4077e54c43bb95288db3942b0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:20.540656 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-3f8d4d3b-4cfb-4b46-932a-74efdf7f5309 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] 10.222.0.58 "GET /compute/v2.1/servers/3ecbcf63-5592-4074-a3f7-d2caf3c58969" status: 200 len: 1731 microversion: 2.1 time: 0.308207 Aug 10 23:18:20.543524 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2304/4415] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:18:20 2022] GET /compute/v2.1/servers/3ecbcf63-5592-4074-a3f7-d2caf3c58969 => generated 1731 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:18:20.565360 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-3d2bef5d-ba4c-4dbe-9635-669cf034bd80 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:18:20.571888 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-3d2bef5d-ba4c-4dbe-9635-669cf034bd80 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] [instance: 7e091da3-0636-4cba-b8de-94fdeecf0b7f] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:18:20.588050 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3d2bef5d-ba4c-4dbe-9635-669cf034bd80 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:20.599165 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3d2bef5d-ba4c-4dbe-9635-669cf034bd80 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:20.599641 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3d2bef5d-ba4c-4dbe-9635-669cf034bd80 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:20.600457 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3d2bef5d-ba4c-4dbe-9635-669cf034bd80 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:20.600939 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3d2bef5d-ba4c-4dbe-9635-669cf034bd80 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:20.608375 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3d2bef5d-ba4c-4dbe-9635-669cf034bd80 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:20.860020 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-3d2bef5d-ba4c-4dbe-9635-669cf034bd80 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:20.873550 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-3d2bef5d-ba4c-4dbe-9635-669cf034bd80 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:20.881666 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-3d2bef5d-ba4c-4dbe-9635-669cf034bd80 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:20.882954 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-3d2bef5d-ba4c-4dbe-9635-669cf034bd80 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] 10.222.0.58 "GET /compute/v2.1/servers/7e091da3-0636-4cba-b8de-94fdeecf0b7f" status: 200 len: 1707 microversion: 2.32 time: 0.337473 Aug 10 23:18:20.883547 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2305/4416] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:18:20 2022] GET /compute/v2.1/servers/7e091da3-0636-4cba-b8de-94fdeecf0b7f => generated 1707 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:18:20.896546 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-e64344d1-5f32-4886-9cae-3dfd7d66ced9 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:18:20.897170 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-e64344d1-5f32-4886-9cae-3dfd7d66ced9 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: 7f49d27c-0fba-4d08-8f85-3eaed8b805e7] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:18:20.910028 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e64344d1-5f32-4886-9cae-3dfd7d66ced9 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:20.910527 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e64344d1-5f32-4886-9cae-3dfd7d66ced9 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:20.911004 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e64344d1-5f32-4886-9cae-3dfd7d66ced9 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:20.919070 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e64344d1-5f32-4886-9cae-3dfd7d66ced9 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:20.919848 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e64344d1-5f32-4886-9cae-3dfd7d66ced9 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:20.920319 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e64344d1-5f32-4886-9cae-3dfd7d66ced9 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:21.337099 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-e64344d1-5f32-4886-9cae-3dfd7d66ced9 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:21.349611 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-e64344d1-5f32-4886-9cae-3dfd7d66ced9 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/7f49d27c-0fba-4d08-8f85-3eaed8b805e7" status: 200 len: 1507 microversion: 2.1 time: 0.457399 Aug 10 23:18:21.351471 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2306/4417] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:18:20 2022] GET /compute/v2.1/servers/7f49d27c-0fba-4d08-8f85-3eaed8b805e7 => generated 1507 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:18:21.366875 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-b3af0553-4f38-4cad-a61d-b06b8b8bbed9 tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:18:21.368133 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-b3af0553-4f38-4cad-a61d-b06b8b8bbed9 tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] [instance: 9ec33e8e-61d8-4663-a54f-8a1b57b3b7fc] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:18:21.371747 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-e344e3d6-30fa-4daf-a2b1-858b6e48f49e tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6684f0c87e4242be9e0ffb4ef1973f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0582ace9e4443b8ad88915503ee630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:21.395257 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b3af0553-4f38-4cad-a61d-b06b8b8bbed9 tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:21.396094 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b3af0553-4f38-4cad-a61d-b06b8b8bbed9 tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:21.396289 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-e344e3d6-30fa-4daf-a2b1-858b6e48f49e tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "GET /compute/v2.1/servers/1885b741-1fc3-413a-bb33-f8d3aeff8b04" status: 200 len: 1292 microversion: 2.1 time: 1.397408 Aug 10 23:18:21.397079 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2112/4418] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:18:19 2022] GET /compute/v2.1/servers/1885b741-1fc3-413a-bb33-f8d3aeff8b04 => generated 1292 bytes in 1411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:18:21.398402 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b3af0553-4f38-4cad-a61d-b06b8b8bbed9 tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:21.400819 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b3af0553-4f38-4cad-a61d-b06b8b8bbed9 tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:21.405417 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b3af0553-4f38-4cad-a61d-b06b8b8bbed9 tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:21.406150 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b3af0553-4f38-4cad-a61d-b06b8b8bbed9 tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:21.409047 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-89920247-ac10-4469-9a3c-0ce780c5af6a tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:18:21.414865 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-89920247-ac10-4469-9a3c-0ce780c5af6a tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] [instance: 3ecbcf63-5592-4074-a3f7-d2caf3c58969] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:18:21.431658 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=7 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:18:21.434435 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-89920247-ac10-4469-9a3c-0ce780c5af6a tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:21.435117 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-89920247-ac10-4469-9a3c-0ce780c5af6a tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:21.436433 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-89920247-ac10-4469-9a3c-0ce780c5af6a tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:21.447784 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-89920247-ac10-4469-9a3c-0ce780c5af6a tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:21.449846 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-89920247-ac10-4469-9a3c-0ce780c5af6a tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:21.450440 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-89920247-ac10-4469-9a3c-0ce780c5af6a tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:21.482122 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-b3af0553-4f38-4cad-a61d-b06b8b8bbed9 tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] [instance: 9ec33e8e-61d8-4663-a54f-8a1b57b3b7fc] Going to try to terminate instance {{(pid=122633) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:18:21.590153 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:18:21.752616 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-b3af0553-4f38-4cad-a61d-b06b8b8bbed9 tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] 10.222.0.58 "DELETE /compute/v2.1/servers/9ec33e8e-61d8-4663-a54f-8a1b57b3b7fc" status: 204 len: 0 microversion: 2.1 time: 0.399710 Aug 10 23:18:21.756703 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2307/4419] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:18:21 2022] DELETE /compute/v2.1/servers/9ec33e8e-61d8-4663-a54f-8a1b57b3b7fc => generated 0 bytes in 401 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:18:21.763351 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-7b33f27c-8a5f-45fd-aa93-abea712364ff tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:18:21.769426 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-7b33f27c-8a5f-45fd-aa93-abea712364ff tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] [instance: b812cd8c-7e33-4e97-8df6-c7fccdf12019] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:18:21.785102 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7b33f27c-8a5f-45fd-aa93-abea712364ff tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:21.785751 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7b33f27c-8a5f-45fd-aa93-abea712364ff tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:21.786296 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7b33f27c-8a5f-45fd-aa93-abea712364ff tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:21.787167 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7b33f27c-8a5f-45fd-aa93-abea712364ff tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:21.789579 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7b33f27c-8a5f-45fd-aa93-abea712364ff tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:21.789579 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7b33f27c-8a5f-45fd-aa93-abea712364ff tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:21.903262 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-89920247-ac10-4469-9a3c-0ce780c5af6a tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] 10.222.0.58 "GET /compute/v2.1/servers/3ecbcf63-5592-4074-a3f7-d2caf3c58969/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.503485 Aug 10 23:18:21.904294 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2113/4420] 10.222.0.58 () {58 vars in 1275 bytes} [Wed Aug 10 23:18:21 2022] GET /compute/v2.1/servers/3ecbcf63-5592-4074-a3f7-d2caf3c58969/os-interface => generated 285 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:18:21.910525 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-64fbb564-3bba-4e12-aaf1-f405203a5855 tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:18:21.911467 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-64fbb564-3bba-4e12-aaf1-f405203a5855 tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] [instance: 9ec33e8e-61d8-4663-a54f-8a1b57b3b7fc] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:18:21.929661 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-64fbb564-3bba-4e12-aaf1-f405203a5855 tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:21.930269 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-64fbb564-3bba-4e12-aaf1-f405203a5855 tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:21.931116 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-64fbb564-3bba-4e12-aaf1-f405203a5855 tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:21.931931 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-64fbb564-3bba-4e12-aaf1-f405203a5855 tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:21.934312 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-64fbb564-3bba-4e12-aaf1-f405203a5855 tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:21.936616 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-64fbb564-3bba-4e12-aaf1-f405203a5855 tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:22.095312 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=8 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:18:22.532358 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-64fbb564-3bba-4e12-aaf1-f405203a5855 tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3702c7420014cd5a5ae703e9abbd408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '388c27a7d5644cab98aedcac17f1debf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:22.541570 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-64fbb564-3bba-4e12-aaf1-f405203a5855 tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] 10.222.0.58 "GET /compute/v2.1/servers/9ec33e8e-61d8-4663-a54f-8a1b57b3b7fc" status: 200 len: 1471 microversion: 2.1 time: 0.635966 Aug 10 23:18:22.548422 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2114/4421] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:18:21 2022] GET /compute/v2.1/servers/9ec33e8e-61d8-4663-a54f-8a1b57b3b7fc => generated 1471 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:18:22.567479 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-8480b6fe-4ba0-4043-8f04-f120f23b6261 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:18:22.568296 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-8480b6fe-4ba0-4043-8f04-f120f23b6261 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] [instance: 7e091da3-0636-4cba-b8de-94fdeecf0b7f] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:18:22.574774 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-7b33f27c-8a5f-45fd-aa93-abea712364ff tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d89081084f14e0187f4c67cd9185fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b557edd165144c8943eb9acc339a377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:22.591892 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-7b33f27c-8a5f-45fd-aa93-abea712364ff tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] 10.222.0.58 "GET /compute/v2.1/servers/b812cd8c-7e33-4e97-8df6-c7fccdf12019" status: 200 len: 1366 microversion: 2.1 time: 0.836819 Aug 10 23:18:22.596153 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2308/4422] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:18:21 2022] GET /compute/v2.1/servers/b812cd8c-7e33-4e97-8df6-c7fccdf12019 => generated 1366 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:18:22.601085 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8480b6fe-4ba0-4043-8f04-f120f23b6261 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:22.606536 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8480b6fe-4ba0-4043-8f04-f120f23b6261 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:22.607339 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8480b6fe-4ba0-4043-8f04-f120f23b6261 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:22.609285 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-1d9e6da8-e9a2-4c62-82ee-5da379f662cc req-b5f49eed-1678-4583-a8de-aa6cfaa408ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1885b741-1fc3-413a-bb33-f8d3aeff8b04", "tag": "060b6999-ca43-47ee-9c41-f1df86541c80"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:18:22.610854 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8480b6fe-4ba0-4043-8f04-f120f23b6261 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:22.612426 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8480b6fe-4ba0-4043-8f04-f120f23b6261 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:22.614571 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8480b6fe-4ba0-4043-8f04-f120f23b6261 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:22.642389 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-1d9e6da8-e9a2-4c62-82ee-5da379f662cc req-b5f49eed-1678-4583-a8de-aa6cfaa408ba service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:22.650641 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-1d9e6da8-e9a2-4c62-82ee-5da379f662cc req-b5f49eed-1678-4583-a8de-aa6cfaa408ba service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:22.653322 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-1d9e6da8-e9a2-4c62-82ee-5da379f662cc req-b5f49eed-1678-4583-a8de-aa6cfaa408ba service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:22.694290 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-1d9e6da8-e9a2-4c62-82ee-5da379f662cc req-b5f49eed-1678-4583-a8de-aa6cfaa408ba service nova] Creating event network-changed:060b6999-ca43-47ee-9c41-f1df86541c80 for instance 1885b741-1fc3-413a-bb33-f8d3aeff8b04 on n-h2-850468-14 Aug 10 23:18:22.707719 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-1d9e6da8-e9a2-4c62-82ee-5da379f662cc req-b5f49eed-1678-4583-a8de-aa6cfaa408ba service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108721 Aug 10 23:18:22.709957 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2309/4423] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:18:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:18:22.727924 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-4962f14f-b774-467a-a987-0221f283676f tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:18:22.731246 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-4962f14f-b774-467a-a987-0221f283676f tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: 7f49d27c-0fba-4d08-8f85-3eaed8b805e7] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:18:22.746812 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4962f14f-b774-467a-a987-0221f283676f tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:22.747706 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4962f14f-b774-467a-a987-0221f283676f tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:22.751593 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4962f14f-b774-467a-a987-0221f283676f tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:22.753415 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4962f14f-b774-467a-a987-0221f283676f tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:22.756490 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4962f14f-b774-467a-a987-0221f283676f tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:22.758214 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4962f14f-b774-467a-a987-0221f283676f tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:24.105972 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-4962f14f-b774-467a-a987-0221f283676f tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:24.122534 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-4962f14f-b774-467a-a987-0221f283676f tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/7f49d27c-0fba-4d08-8f85-3eaed8b805e7" status: 200 len: 1507 microversion: 2.1 time: 1.407008 Aug 10 23:18:24.124506 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2310/4424] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:18:22 2022] GET /compute/v2.1/servers/7f49d27c-0fba-4d08-8f85-3eaed8b805e7 => generated 1507 bytes in 1413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:18:24.131616 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-7529e2e9-f5dc-435b-b86a-edf3624e0c13 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:18:24.132607 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-7529e2e9-f5dc-435b-b86a-edf3624e0c13 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: 1885b741-1fc3-413a-bb33-f8d3aeff8b04] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:18:24.140333 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7529e2e9-f5dc-435b-b86a-edf3624e0c13 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:24.141114 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7529e2e9-f5dc-435b-b86a-edf3624e0c13 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:24.142018 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7529e2e9-f5dc-435b-b86a-edf3624e0c13 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:24.143181 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7529e2e9-f5dc-435b-b86a-edf3624e0c13 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:24.143844 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7529e2e9-f5dc-435b-b86a-edf3624e0c13 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:24.144426 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7529e2e9-f5dc-435b-b86a-edf3624e0c13 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:24.405929 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-8480b6fe-4ba0-4043-8f04-f120f23b6261 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:24.415029 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=100 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:18:24.457612 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-8480b6fe-4ba0-4043-8f04-f120f23b6261 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:24.468640 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-8480b6fe-4ba0-4043-8f04-f120f23b6261 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:24.475883 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-8480b6fe-4ba0-4043-8f04-f120f23b6261 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] 10.222.0.58 "GET /compute/v2.1/servers/7e091da3-0636-4cba-b8de-94fdeecf0b7f" status: 200 len: 1707 microversion: 2.32 time: 1.925787 Aug 10 23:18:24.489692 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2115/4425] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:18:22 2022] GET /compute/v2.1/servers/7e091da3-0636-4cba-b8de-94fdeecf0b7f => generated 1707 bytes in 1934 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:18:24.529769 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-d3b9b360-a1ad-4823-886b-3a50607dcc68 tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:18:24.533255 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-d3b9b360-a1ad-4823-886b-3a50607dcc68 tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] [instance: 9ec33e8e-61d8-4663-a54f-8a1b57b3b7fc] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:18:24.565006 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d3b9b360-a1ad-4823-886b-3a50607dcc68 tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:24.565006 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d3b9b360-a1ad-4823-886b-3a50607dcc68 tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:24.565275 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d3b9b360-a1ad-4823-886b-3a50607dcc68 tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:24.581413 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d3b9b360-a1ad-4823-886b-3a50607dcc68 tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:24.585818 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d3b9b360-a1ad-4823-886b-3a50607dcc68 tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:24.594222 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d3b9b360-a1ad-4823-886b-3a50607dcc68 tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:24.754442 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-7529e2e9-f5dc-435b-b86a-edf3624e0c13 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6684f0c87e4242be9e0ffb4ef1973f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0582ace9e4443b8ad88915503ee630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:24.772510 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-7529e2e9-f5dc-435b-b86a-edf3624e0c13 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "GET /compute/v2.1/servers/1885b741-1fc3-413a-bb33-f8d3aeff8b04" status: 200 len: 1292 microversion: 2.1 time: 0.646359 Aug 10 23:18:24.782584 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2311/4426] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:18:24 2022] GET /compute/v2.1/servers/1885b741-1fc3-413a-bb33-f8d3aeff8b04 => generated 1292 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:18:24.789573 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-650bc4ed-6e02-40f3-9575-e8566bf2f33d tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:18:24.794223 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-650bc4ed-6e02-40f3-9575-e8566bf2f33d tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] [instance: b812cd8c-7e33-4e97-8df6-c7fccdf12019] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:18:24.819888 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-650bc4ed-6e02-40f3-9575-e8566bf2f33d tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:24.820817 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-650bc4ed-6e02-40f3-9575-e8566bf2f33d tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:24.825902 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-650bc4ed-6e02-40f3-9575-e8566bf2f33d tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:24.827327 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-650bc4ed-6e02-40f3-9575-e8566bf2f33d tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:24.830577 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-650bc4ed-6e02-40f3-9575-e8566bf2f33d tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:24.833226 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-650bc4ed-6e02-40f3-9575-e8566bf2f33d tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:25.286069 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-650bc4ed-6e02-40f3-9575-e8566bf2f33d tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d89081084f14e0187f4c67cd9185fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b557edd165144c8943eb9acc339a377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:25.301742 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-650bc4ed-6e02-40f3-9575-e8566bf2f33d tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] 10.222.0.58 "GET /compute/v2.1/servers/b812cd8c-7e33-4e97-8df6-c7fccdf12019" status: 200 len: 1366 microversion: 2.1 time: 0.517351 Aug 10 23:18:25.316274 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2312/4427] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:18:24 2022] GET /compute/v2.1/servers/b812cd8c-7e33-4e97-8df6-c7fccdf12019 => generated 1366 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:18:25.329321 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-774de43d-9f01-499a-ac3e-c47141f1ef5b tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:18:25.330254 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-774de43d-9f01-499a-ac3e-c47141f1ef5b tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: 7f49d27c-0fba-4d08-8f85-3eaed8b805e7] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:18:25.347285 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-774de43d-9f01-499a-ac3e-c47141f1ef5b tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:25.348086 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-774de43d-9f01-499a-ac3e-c47141f1ef5b tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:25.349553 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-774de43d-9f01-499a-ac3e-c47141f1ef5b tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:25.352054 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-774de43d-9f01-499a-ac3e-c47141f1ef5b tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:25.352689 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-774de43d-9f01-499a-ac3e-c47141f1ef5b tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:25.353319 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-774de43d-9f01-499a-ac3e-c47141f1ef5b tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:26.144720 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-774de43d-9f01-499a-ac3e-c47141f1ef5b tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:26.195383 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-774de43d-9f01-499a-ac3e-c47141f1ef5b tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/7f49d27c-0fba-4d08-8f85-3eaed8b805e7" status: 200 len: 1507 microversion: 2.1 time: 0.877359 Aug 10 23:18:26.195999 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2313/4428] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:18:25 2022] GET /compute/v2.1/servers/7f49d27c-0fba-4d08-8f85-3eaed8b805e7 => generated 1507 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:18:26.229971 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-0ce6796a-6923-44aa-a78a-417cbb33e44b tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:18:26.238066 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-0ce6796a-6923-44aa-a78a-417cbb33e44b tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] [instance: 7e091da3-0636-4cba-b8de-94fdeecf0b7f] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:18:26.265392 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0ce6796a-6923-44aa-a78a-417cbb33e44b tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:26.268020 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0ce6796a-6923-44aa-a78a-417cbb33e44b tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:26.270814 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0ce6796a-6923-44aa-a78a-417cbb33e44b tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:26.271871 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0ce6796a-6923-44aa-a78a-417cbb33e44b tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:26.274491 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0ce6796a-6923-44aa-a78a-417cbb33e44b tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:26.277932 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0ce6796a-6923-44aa-a78a-417cbb33e44b tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:26.607303 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-d3b9b360-a1ad-4823-886b-3a50607dcc68 tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3702c7420014cd5a5ae703e9abbd408', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '388c27a7d5644cab98aedcac17f1debf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:26.629042 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-d3b9b360-a1ad-4823-886b-3a50607dcc68 tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] 10.222.0.58 "GET /compute/v2.1/servers/9ec33e8e-61d8-4663-a54f-8a1b57b3b7fc" status: 200 len: 1471 microversion: 2.1 time: 2.137428 Aug 10 23:18:26.629896 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2116/4429] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:18:24 2022] GET /compute/v2.1/servers/9ec33e8e-61d8-4663-a54f-8a1b57b3b7fc => generated 1471 bytes in 2139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:18:26.634577 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-1fee9027-0989-4514-a0be-8d3ee5fc336b tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:18:26.651607 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-1fee9027-0989-4514-a0be-8d3ee5fc336b tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: 1885b741-1fc3-413a-bb33-f8d3aeff8b04] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:18:26.687216 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1fee9027-0989-4514-a0be-8d3ee5fc336b tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:26.687719 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1fee9027-0989-4514-a0be-8d3ee5fc336b tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:26.688172 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1fee9027-0989-4514-a0be-8d3ee5fc336b tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:26.688895 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1fee9027-0989-4514-a0be-8d3ee5fc336b tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:26.689346 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1fee9027-0989-4514-a0be-8d3ee5fc336b tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:26.700807 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1fee9027-0989-4514-a0be-8d3ee5fc336b tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:27.225446 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-0ce6796a-6923-44aa-a78a-417cbb33e44b tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:27.237998 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-0ce6796a-6923-44aa-a78a-417cbb33e44b tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:27.245501 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-0ce6796a-6923-44aa-a78a-417cbb33e44b tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:27.250086 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-0ce6796a-6923-44aa-a78a-417cbb33e44b tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] 10.222.0.58 "GET /compute/v2.1/servers/7e091da3-0636-4cba-b8de-94fdeecf0b7f" status: 200 len: 1753 microversion: 2.32 time: 1.045401 Aug 10 23:18:27.250953 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2314/4430] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:18:26 2022] GET /compute/v2.1/servers/7e091da3-0636-4cba-b8de-94fdeecf0b7f => generated 1753 bytes in 1049 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:18:27.262203 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-1eaa76f1-4a7b-4705-a8c4-de61ae12bf8b req-96047507-c266-4385-a3a0-97aba74373bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ec33e8e-61d8-4663-a54f-8a1b57b3b7fc", "name": "network-vif-deleted", "tag": "ba570bf5-1107-41fc-8071-bd5b5f0321ed"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:18:27.288472 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-1eaa76f1-4a7b-4705-a8c4-de61ae12bf8b req-96047507-c266-4385-a3a0-97aba74373bb service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:27.290219 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-1eaa76f1-4a7b-4705-a8c4-de61ae12bf8b req-96047507-c266-4385-a3a0-97aba74373bb service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:27.299298 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-1eaa76f1-4a7b-4705-a8c4-de61ae12bf8b req-96047507-c266-4385-a3a0-97aba74373bb service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:27.337340 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-1eaa76f1-4a7b-4705-a8c4-de61ae12bf8b req-96047507-c266-4385-a3a0-97aba74373bb service nova] Creating event network-vif-deleted:ba570bf5-1107-41fc-8071-bd5b5f0321ed for instance 9ec33e8e-61d8-4663-a54f-8a1b57b3b7fc on n-h2-850468-14 Aug 10 23:18:27.348949 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-1eaa76f1-4a7b-4705-a8c4-de61ae12bf8b req-96047507-c266-4385-a3a0-97aba74373bb service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094996 Aug 10 23:18:27.350839 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2315/4431] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:18:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:18:27.362569 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-c44d56d5-a924-4e47-b682-1f43cff41cd5 req-049d603f-0275-4a85-982b-f080ce8cac11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b812cd8c-7e33-4e97-8df6-c7fccdf12019", "name": "network-vif-plugged", "status": "completed", "tag": "fc32a303-f86b-4983-9b9a-e8ed05dd3d0f"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:18:27.393002 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-c44d56d5-a924-4e47-b682-1f43cff41cd5 req-049d603f-0275-4a85-982b-f080ce8cac11 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:27.399040 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-c44d56d5-a924-4e47-b682-1f43cff41cd5 req-049d603f-0275-4a85-982b-f080ce8cac11 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:27.403067 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-c44d56d5-a924-4e47-b682-1f43cff41cd5 req-049d603f-0275-4a85-982b-f080ce8cac11 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:27.419238 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-c44d56d5-a924-4e47-b682-1f43cff41cd5 req-049d603f-0275-4a85-982b-f080ce8cac11 service nova] Creating event network-vif-plugged:fc32a303-f86b-4983-9b9a-e8ed05dd3d0f for instance b812cd8c-7e33-4e97-8df6-c7fccdf12019 on n-h1-850468-14 Aug 10 23:18:27.430238 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-c44d56d5-a924-4e47-b682-1f43cff41cd5 req-049d603f-0275-4a85-982b-f080ce8cac11 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077408 Aug 10 23:18:27.441231 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2316/4432] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:18:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:18:27.451721 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-26ef16e3-8277-4c4a-a79d-6e9ebead6e78 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:18:27.452724 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-26ef16e3-8277-4c4a-a79d-6e9ebead6e78 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] [instance: b812cd8c-7e33-4e97-8df6-c7fccdf12019] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:18:27.466744 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-26ef16e3-8277-4c4a-a79d-6e9ebead6e78 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:27.467801 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-26ef16e3-8277-4c4a-a79d-6e9ebead6e78 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:27.468561 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-26ef16e3-8277-4c4a-a79d-6e9ebead6e78 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:27.469569 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-26ef16e3-8277-4c4a-a79d-6e9ebead6e78 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:27.470272 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-26ef16e3-8277-4c4a-a79d-6e9ebead6e78 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:27.471037 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-26ef16e3-8277-4c4a-a79d-6e9ebead6e78 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:27.602833 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-1fee9027-0989-4514-a0be-8d3ee5fc336b tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6684f0c87e4242be9e0ffb4ef1973f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0582ace9e4443b8ad88915503ee630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:27.614771 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-1fee9027-0989-4514-a0be-8d3ee5fc336b tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "GET /compute/v2.1/servers/1885b741-1fc3-413a-bb33-f8d3aeff8b04" status: 200 len: 1292 microversion: 2.1 time: 0.982511 Aug 10 23:18:27.616156 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2117/4433] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:18:26 2022] GET /compute/v2.1/servers/1885b741-1fc3-413a-bb33-f8d3aeff8b04 => generated 1292 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:18:27.621043 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-1def601a-9e58-4a31-a92b-8db5dc8a8dcc tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:18:27.636773 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-1def601a-9e58-4a31-a92b-8db5dc8a8dcc tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: 7f49d27c-0fba-4d08-8f85-3eaed8b805e7] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:18:27.650525 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1def601a-9e58-4a31-a92b-8db5dc8a8dcc tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:27.659052 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1def601a-9e58-4a31-a92b-8db5dc8a8dcc tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:27.659720 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1def601a-9e58-4a31-a92b-8db5dc8a8dcc tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:27.661565 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1def601a-9e58-4a31-a92b-8db5dc8a8dcc tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:27.662212 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1def601a-9e58-4a31-a92b-8db5dc8a8dcc tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:27.662888 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1def601a-9e58-4a31-a92b-8db5dc8a8dcc tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:28.207277 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-26ef16e3-8277-4c4a-a79d-6e9ebead6e78 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d89081084f14e0187f4c67cd9185fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b557edd165144c8943eb9acc339a377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:28.246450 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-26ef16e3-8277-4c4a-a79d-6e9ebead6e78 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] 10.222.0.58 "GET /compute/v2.1/servers/b812cd8c-7e33-4e97-8df6-c7fccdf12019" status: 200 len: 1366 microversion: 2.1 time: 0.803007 Aug 10 23:18:28.265399 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2317/4434] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:18:27 2022] GET /compute/v2.1/servers/b812cd8c-7e33-4e97-8df6-c7fccdf12019 => generated 1366 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:18:28.279798 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-7dc916eb-88c8-49ee-81f5-d2448adf4ef3 tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:18:28.283160 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-7dc916eb-88c8-49ee-81f5-d2448adf4ef3 tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] [instance: 9ec33e8e-61d8-4663-a54f-8a1b57b3b7fc] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:18:28.298326 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7dc916eb-88c8-49ee-81f5-d2448adf4ef3 tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:28.300126 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7dc916eb-88c8-49ee-81f5-d2448adf4ef3 tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:28.302308 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7dc916eb-88c8-49ee-81f5-d2448adf4ef3 tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:28.303314 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7dc916eb-88c8-49ee-81f5-d2448adf4ef3 tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:28.305028 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7dc916eb-88c8-49ee-81f5-d2448adf4ef3 tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:28.311320 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7dc916eb-88c8-49ee-81f5-d2448adf4ef3 tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:28.372137 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-7dc916eb-88c8-49ee-81f5-d2448adf4ef3 tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] HTTP exception thrown: Instance 9ec33e8e-61d8-4663-a54f-8a1b57b3b7fc could not be found. Aug 10 23:18:28.378238 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-7dc916eb-88c8-49ee-81f5-d2448adf4ef3 tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] Request method failure captured: Aug 10 23:18:28.378238 n-d-850468-14 devstack@n-api.service[122633]: request: GET /compute/v2.1/servers/9ec33e8e-61d8-4663-a54f-8a1b57b3b7fc HTTP/1.1 Aug 10 23:18:28.378238 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:18:28.378238 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:18:28.378238 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:18:28.378238 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:18:28.378238 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:18:28.378238 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:18:28.378238 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:18:28.378238 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:18:28.378238 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9Dyb7m5DdcTzI2A97-n1IYrkNUiVFypWQz5U1h_l__n-Dt51RiIKpUDBb7fxqGDHe8FBZyK5IDR_-3vnIv7Kb0bek6BxUn0KXxWsSYRKHUMFBgHelV96BL4BcT_VyeiJm4ItSLFv5QvmWxmdIH63G9FKLkpDsq_T7fQGDDLxf1oCrBE Aug 10 23:18:28.378238 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:18:28.378238 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:18:28.378238 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:18:28.378238 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:18:28.378238 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:18:28.378238 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:18:28.378238 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 388c27a7d5644cab98aedcac17f1debf Aug 10 23:18:28.378238 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-VolumesNegativeTest-1224833813 Aug 10 23:18:28.378238 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:18:28.378238 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:18:28.378238 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/388c27a7d5644cab98aedcac17f1debf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/388c27a7d5644cab98aedcac17f1debf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/388c27a7d5644cab98aedcac17f1debf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_388c27a7d5644cab98aedcac17f1debf", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:18:28.378238 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-VolumesNegativeTest-1224833813 Aug 10 23:18:28.378238 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 388c27a7d5644cab98aedcac17f1debf Aug 10 23:18:28.378238 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-VolumesNegativeTest-1224833813 Aug 10 23:18:28.378238 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-VolumesNegativeTest-1224833813-project Aug 10 23:18:28.378238 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:18:28.378238 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:18:28.378238 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: d3702c7420014cd5a5ae703e9abbd408 Aug 10 23:18:28.378238 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-VolumesNegativeTest-1224833813-project Aug 10 23:18:28.378238 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:18:28.378238 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance 9ec33e8e-61d8-4663-a54f-8a1b57b3b7fc could not be found. Aug 10 23:18:28.378238 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': '9ec33e8e-61d8-4663-a54f-8a1b57b3b7fc'} Aug 10 23:18:28.378238 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:18:28.378238 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:18:28.378238 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:18:28.378238 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:18:28.378238 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:18:28.378238 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:18:28.378238 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:18:28.378238 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:18:28.378238 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:18:28.378238 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:18:28.378238 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ec33e8e-61d8-4663-a54f-8a1b57b3b7fc could not be found. Aug 10 23:18:28.378238 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:18:28.378238 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:18:28.378238 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:18:28.378238 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:18:28.378238 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:18:28.378238 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:18:28.378238 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:18:28.378238 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:18:28.378238 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:18:28.378238 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:18:28.378238 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:18:28.378238 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:18:28.378238 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:18:28.378238 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:18:28.378238 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:18:28.378238 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:18:28.378238 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ec33e8e-61d8-4663-a54f-8a1b57b3b7fc could not be found. Aug 10 23:18:28.378238 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:18:28.378238 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:18:28.378238 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:18:28.385535 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:18:28.385535 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:18:28.385535 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:18:28.385535 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:18:28.385535 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:18:28.385535 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ec33e8e-61d8-4663-a54f-8a1b57b3b7fc could not be found. Aug 10 23:18:28.385535 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:18:28.393075 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-7dc916eb-88c8-49ee-81f5-d2448adf4ef3 tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] Returning 404 to user: Instance 9ec33e8e-61d8-4663-a54f-8a1b57b3b7fc could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:18:28.395655 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-7dc916eb-88c8-49ee-81f5-d2448adf4ef3 tempest-VolumesNegativeTest-1224833813 tempest-VolumesNegativeTest-1224833813-project] 10.222.0.58 "GET /compute/v2.1/servers/9ec33e8e-61d8-4663-a54f-8a1b57b3b7fc" status: 404 len: 111 microversion: 2.1 time: 0.128134 Aug 10 23:18:28.396826 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2318/4435] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:18:28 2022] GET /compute/v2.1/servers/9ec33e8e-61d8-4663-a54f-8a1b57b3b7fc => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:18:28.404098 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-b838b750-89a6-4e3b-995b-f7fd8f1954d0 req-bb692c8b-eab3-4ce6-bc1f-cfbd224e2172 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ecbcf63-5592-4074-a3f7-d2caf3c58969", "tag": "4640966a-83e6-4989-a8a2-bbd72226c336"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:18:28.415813 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-b838b750-89a6-4e3b-995b-f7fd8f1954d0 req-bb692c8b-eab3-4ce6-bc1f-cfbd224e2172 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:28.416711 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-b838b750-89a6-4e3b-995b-f7fd8f1954d0 req-bb692c8b-eab3-4ce6-bc1f-cfbd224e2172 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:28.417372 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-b838b750-89a6-4e3b-995b-f7fd8f1954d0 req-bb692c8b-eab3-4ce6-bc1f-cfbd224e2172 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:28.450260 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-b838b750-89a6-4e3b-995b-f7fd8f1954d0 req-bb692c8b-eab3-4ce6-bc1f-cfbd224e2172 service nova] Creating event network-changed:4640966a-83e6-4989-a8a2-bbd72226c336 for instance 3ecbcf63-5592-4074-a3f7-d2caf3c58969 on n-h1-850468-14 Aug 10 23:18:28.458245 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-b838b750-89a6-4e3b-995b-f7fd8f1954d0 req-bb692c8b-eab3-4ce6-bc1f-cfbd224e2172 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059598 Aug 10 23:18:28.462342 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2319/4436] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:18:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:18:28.500818 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-671a1a5b-afcc-4b3a-a08b-2ca73b4a90af tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:18:28.501551 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-671a1a5b-afcc-4b3a-a08b-2ca73b4a90af tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] [instance: 7e091da3-0636-4cba-b8de-94fdeecf0b7f] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:18:28.542650 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-671a1a5b-afcc-4b3a-a08b-2ca73b4a90af tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:28.543258 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-671a1a5b-afcc-4b3a-a08b-2ca73b4a90af tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:28.543740 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-671a1a5b-afcc-4b3a-a08b-2ca73b4a90af tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:28.549382 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-671a1a5b-afcc-4b3a-a08b-2ca73b4a90af tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:28.551769 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-671a1a5b-afcc-4b3a-a08b-2ca73b4a90af tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:28.554175 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-671a1a5b-afcc-4b3a-a08b-2ca73b4a90af tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:29.276291 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-671a1a5b-afcc-4b3a-a08b-2ca73b4a90af tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:29.289051 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-671a1a5b-afcc-4b3a-a08b-2ca73b4a90af tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:29.302900 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-671a1a5b-afcc-4b3a-a08b-2ca73b4a90af tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:29.312697 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-671a1a5b-afcc-4b3a-a08b-2ca73b4a90af tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] 10.222.0.58 "GET /compute/v2.1/servers/7e091da3-0636-4cba-b8de-94fdeecf0b7f" status: 200 len: 1753 microversion: 2.32 time: 0.844731 Aug 10 23:18:29.313594 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2320/4437] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:18:28 2022] GET /compute/v2.1/servers/7e091da3-0636-4cba-b8de-94fdeecf0b7f => generated 1753 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:18:29.344807 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-6879163f-bbbc-495e-9152-0033c48e6abe tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Calling method '.version_select at 0x7f847d3b23a0>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:18:29.421765 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-6879163f-bbbc-495e-9152-0033c48e6abe tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1298304459" status: 202 len: 0 microversion: 2.1 time: 0.103947 Aug 10 23:18:29.422359 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2321/4438] 10.222.0.58 () {58 vars in 1284 bytes} [Wed Aug 10 23:18:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1298304459 => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:18:29.444048 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-4904b67b-3473-488c-8e0f-a902158d7ca9 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:18:29.450676 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-4904b67b-3473-488c-8e0f-a902158d7ca9 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: 1885b741-1fc3-413a-bb33-f8d3aeff8b04] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:18:29.478516 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4904b67b-3473-488c-8e0f-a902158d7ca9 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:29.479468 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4904b67b-3473-488c-8e0f-a902158d7ca9 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:29.480289 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4904b67b-3473-488c-8e0f-a902158d7ca9 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:29.481198 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4904b67b-3473-488c-8e0f-a902158d7ca9 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:29.481907 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4904b67b-3473-488c-8e0f-a902158d7ca9 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:29.482530 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4904b67b-3473-488c-8e0f-a902158d7ca9 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:29.721563 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-1def601a-9e58-4a31-a92b-8db5dc8a8dcc tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:29.739290 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-1def601a-9e58-4a31-a92b-8db5dc8a8dcc tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/7f49d27c-0fba-4d08-8f85-3eaed8b805e7" status: 200 len: 1507 microversion: 2.1 time: 2.121833 Aug 10 23:18:29.747052 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2118/4439] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:18:27 2022] GET /compute/v2.1/servers/7f49d27c-0fba-4d08-8f85-3eaed8b805e7 => generated 1507 bytes in 2130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:18:29.803388 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-99c5cb10-4eb0-4c82-971e-8c1dbc4c7169 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:18:29.810066 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-99c5cb10-4eb0-4c82-971e-8c1dbc4c7169 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] [instance: b812cd8c-7e33-4e97-8df6-c7fccdf12019] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:18:29.848076 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-99c5cb10-4eb0-4c82-971e-8c1dbc4c7169 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:29.853135 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-99c5cb10-4eb0-4c82-971e-8c1dbc4c7169 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:29.855100 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-99c5cb10-4eb0-4c82-971e-8c1dbc4c7169 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:29.856074 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-99c5cb10-4eb0-4c82-971e-8c1dbc4c7169 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:29.860879 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-99c5cb10-4eb0-4c82-971e-8c1dbc4c7169 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:29.863122 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-99c5cb10-4eb0-4c82-971e-8c1dbc4c7169 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:29.999776 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-4904b67b-3473-488c-8e0f-a902158d7ca9 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6684f0c87e4242be9e0ffb4ef1973f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0582ace9e4443b8ad88915503ee630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:30.011042 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-4904b67b-3473-488c-8e0f-a902158d7ca9 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "GET /compute/v2.1/servers/1885b741-1fc3-413a-bb33-f8d3aeff8b04" status: 200 len: 1292 microversion: 2.1 time: 0.583710 Aug 10 23:18:30.028677 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2322/4440] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:18:29 2022] GET /compute/v2.1/servers/1885b741-1fc3-413a-bb33-f8d3aeff8b04 => generated 1292 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:18:30.034219 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-6da48698-8cf9-4d53-acc3-3136b104d9f1 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Action: 'create', calling method: .version_select at 0x7f847c55f040>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1953386696", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDcdC89X0Qhj06LmLVSDMV5CYIPH1sKYEL3JKBcIj0itsdkj4OqM7BkyeNKzqgRR8YkA19mDQ6fvjMtuMDQ/5hEA/RthZKd0KZbmzJISx16vFtgBBHgUWwzTXa/EE4XI+w=="}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:18:30.059196 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-6da48698-8cf9-4d53-acc3-3136b104d9f1 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Getting quotas for project 25abd63376614081a9d484f3c9ae950d. Resources: {'key_pairs'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:18:30.068889 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-6da48698-8cf9-4d53-acc3-3136b104d9f1 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Getting quotas for user 5899b2ad9f1046caaf7c6073e408eeee and project 25abd63376614081a9d484f3c9ae950d. Resources: {'key_pairs'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:18:30.148494 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-6da48698-8cf9-4d53-acc3-3136b104d9f1 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.118026 Aug 10 23:18:30.150232 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2323/4441] 10.222.0.58 () {60 vars in 1159 bytes} [Wed Aug 10 23:18:30 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:18:30.342173 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-893c040d-920f-4976-aae0-35a39393298a tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:18:30.342970 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-893c040d-920f-4976-aae0-35a39393298a tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] [instance: 7e091da3-0636-4cba-b8de-94fdeecf0b7f] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:18:30.362312 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-893c040d-920f-4976-aae0-35a39393298a tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:30.362958 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-893c040d-920f-4976-aae0-35a39393298a tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:30.363413 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-893c040d-920f-4976-aae0-35a39393298a tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:30.368454 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-893c040d-920f-4976-aae0-35a39393298a tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:30.368945 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-893c040d-920f-4976-aae0-35a39393298a tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:30.369486 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-893c040d-920f-4976-aae0-35a39393298a tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:30.373163 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-99c5cb10-4eb0-4c82-971e-8c1dbc4c7169 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d89081084f14e0187f4c67cd9185fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b557edd165144c8943eb9acc339a377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:30.396825 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-99c5cb10-4eb0-4c82-971e-8c1dbc4c7169 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] 10.222.0.58 "GET /compute/v2.1/servers/b812cd8c-7e33-4e97-8df6-c7fccdf12019" status: 200 len: 1557 microversion: 2.1 time: 0.625214 Aug 10 23:18:30.398299 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2119/4442] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:18:29 2022] GET /compute/v2.1/servers/b812cd8c-7e33-4e97-8df6-c7fccdf12019 => generated 1557 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:18:30.420982 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-ace9b5b7-a34b-4a4d-8340-9ea2e2edf28c tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:18:30.421809 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-ace9b5b7-a34b-4a4d-8340-9ea2e2edf28c tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] [instance: b812cd8c-7e33-4e97-8df6-c7fccdf12019] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:18:30.429960 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ace9b5b7-a34b-4a4d-8340-9ea2e2edf28c tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:30.434129 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ace9b5b7-a34b-4a4d-8340-9ea2e2edf28c tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:30.435036 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ace9b5b7-a34b-4a4d-8340-9ea2e2edf28c tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:30.436098 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ace9b5b7-a34b-4a4d-8340-9ea2e2edf28c tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:30.438286 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ace9b5b7-a34b-4a4d-8340-9ea2e2edf28c tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:30.439035 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ace9b5b7-a34b-4a4d-8340-9ea2e2edf28c tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:30.732223 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-ace9b5b7-a34b-4a4d-8340-9ea2e2edf28c tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] 10.222.0.58 "GET /compute/v2.1/servers/b812cd8c-7e33-4e97-8df6-c7fccdf12019/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.316210 Aug 10 23:18:30.734275 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2120/4443] 10.222.0.58 () {58 vars in 1275 bytes} [Wed Aug 10 23:18:30 2022] GET /compute/v2.1/servers/b812cd8c-7e33-4e97-8df6-c7fccdf12019/os-interface => generated 285 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 23:18:30.739777 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-4d61bec6-4486-4155-8a74-85b03bfb1cab req-a676b8bb-a139-40bd-ae10-d411947169ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ecbcf63-5592-4074-a3f7-d2caf3c58969", "tag": "4640966a-83e6-4989-a8a2-bbd72226c336"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:18:30.769205 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-4d61bec6-4486-4155-8a74-85b03bfb1cab req-a676b8bb-a139-40bd-ae10-d411947169ca service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:30.769328 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-4d61bec6-4486-4155-8a74-85b03bfb1cab req-a676b8bb-a139-40bd-ae10-d411947169ca service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:30.772380 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-4d61bec6-4486-4155-8a74-85b03bfb1cab req-a676b8bb-a139-40bd-ae10-d411947169ca service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:30.805753 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-4d61bec6-4486-4155-8a74-85b03bfb1cab req-a676b8bb-a139-40bd-ae10-d411947169ca service nova] Creating event network-changed:4640966a-83e6-4989-a8a2-bbd72226c336 for instance 3ecbcf63-5592-4074-a3f7-d2caf3c58969 on n-h1-850468-14 Aug 10 23:18:30.819143 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-4d61bec6-4486-4155-8a74-85b03bfb1cab req-a676b8bb-a139-40bd-ae10-d411947169ca service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081877 Aug 10 23:18:30.824996 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2121/4444] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:18:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:18:30.832603 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-3c62e3f4-47d2-4e63-89e6-3855c7d27e20 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:18:30.840311 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-3c62e3f4-47d2-4e63-89e6-3855c7d27e20 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: 7f49d27c-0fba-4d08-8f85-3eaed8b805e7] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:18:30.867736 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3c62e3f4-47d2-4e63-89e6-3855c7d27e20 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:30.875293 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3c62e3f4-47d2-4e63-89e6-3855c7d27e20 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:30.875945 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3c62e3f4-47d2-4e63-89e6-3855c7d27e20 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:30.876713 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3c62e3f4-47d2-4e63-89e6-3855c7d27e20 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:30.877191 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3c62e3f4-47d2-4e63-89e6-3855c7d27e20 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:30.880523 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3c62e3f4-47d2-4e63-89e6-3855c7d27e20 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:31.727004 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-3c62e3f4-47d2-4e63-89e6-3855c7d27e20 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:31.740080 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-3c62e3f4-47d2-4e63-89e6-3855c7d27e20 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/7f49d27c-0fba-4d08-8f85-3eaed8b805e7" status: 200 len: 1507 microversion: 2.1 time: 0.913441 Aug 10 23:18:31.741982 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2122/4445] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:18:30 2022] GET /compute/v2.1/servers/7f49d27c-0fba-4d08-8f85-3eaed8b805e7 => generated 1507 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:18:31.762860 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-a43c9398-1435-4799-bccc-94c62ce5dfa1 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:18:31.764626 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-a43c9398-1435-4799-bccc-94c62ce5dfa1 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: 1885b741-1fc3-413a-bb33-f8d3aeff8b04] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:18:31.781472 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a43c9398-1435-4799-bccc-94c62ce5dfa1 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:31.783093 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a43c9398-1435-4799-bccc-94c62ce5dfa1 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:31.783708 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a43c9398-1435-4799-bccc-94c62ce5dfa1 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:31.784582 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a43c9398-1435-4799-bccc-94c62ce5dfa1 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:31.785190 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a43c9398-1435-4799-bccc-94c62ce5dfa1 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:31.785825 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a43c9398-1435-4799-bccc-94c62ce5dfa1 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:32.261835 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-893c040d-920f-4976-aae0-35a39393298a tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:32.277120 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-893c040d-920f-4976-aae0-35a39393298a tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:32.278423 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-893c040d-920f-4976-aae0-35a39393298a tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:32.292617 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-893c040d-920f-4976-aae0-35a39393298a tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] 10.222.0.58 "GET /compute/v2.1/servers/7e091da3-0636-4cba-b8de-94fdeecf0b7f" status: 200 len: 1799 microversion: 2.32 time: 1.956296 Aug 10 23:18:32.293837 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2324/4446] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:18:30 2022] GET /compute/v2.1/servers/7e091da3-0636-4cba-b8de-94fdeecf0b7f => generated 1799 bytes in 1958 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 23:18:32.645090 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-a43c9398-1435-4799-bccc-94c62ce5dfa1 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6684f0c87e4242be9e0ffb4ef1973f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0582ace9e4443b8ad88915503ee630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:32.665926 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-a43c9398-1435-4799-bccc-94c62ce5dfa1 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "GET /compute/v2.1/servers/1885b741-1fc3-413a-bb33-f8d3aeff8b04" status: 200 len: 1292 microversion: 2.1 time: 0.922645 Aug 10 23:18:32.670768 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2123/4447] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:18:31 2022] GET /compute/v2.1/servers/1885b741-1fc3-413a-bb33-f8d3aeff8b04 => generated 1292 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:18:32.762560 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-db5ad94d-66b0-47fa-a57a-08ba6c5b4a30 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:18:32.763466 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-db5ad94d-66b0-47fa-a57a-08ba6c5b4a30 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: 7f49d27c-0fba-4d08-8f85-3eaed8b805e7] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:18:32.778199 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-db5ad94d-66b0-47fa-a57a-08ba6c5b4a30 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:32.789230 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-db5ad94d-66b0-47fa-a57a-08ba6c5b4a30 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:32.790056 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-db5ad94d-66b0-47fa-a57a-08ba6c5b4a30 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:32.791756 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-db5ad94d-66b0-47fa-a57a-08ba6c5b4a30 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:32.808286 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-db5ad94d-66b0-47fa-a57a-08ba6c5b4a30 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:32.808994 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-db5ad94d-66b0-47fa-a57a-08ba6c5b4a30 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:33.326240 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-f77b88aa-e0dc-49b0-ac35-40936cb49ae2 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:18:33.327039 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-f77b88aa-e0dc-49b0-ac35-40936cb49ae2 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] [instance: 7e091da3-0636-4cba-b8de-94fdeecf0b7f] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:18:33.347662 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f77b88aa-e0dc-49b0-ac35-40936cb49ae2 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:33.348158 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f77b88aa-e0dc-49b0-ac35-40936cb49ae2 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:33.352392 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f77b88aa-e0dc-49b0-ac35-40936cb49ae2 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:33.356454 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f77b88aa-e0dc-49b0-ac35-40936cb49ae2 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:33.359860 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f77b88aa-e0dc-49b0-ac35-40936cb49ae2 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:33.360510 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f77b88aa-e0dc-49b0-ac35-40936cb49ae2 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:33.902018 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-f77b88aa-e0dc-49b0-ac35-40936cb49ae2 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:33.924200 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-f77b88aa-e0dc-49b0-ac35-40936cb49ae2 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:33.929291 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-f77b88aa-e0dc-49b0-ac35-40936cb49ae2 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:33.938318 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-f77b88aa-e0dc-49b0-ac35-40936cb49ae2 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] 10.222.0.58 "GET /compute/v2.1/servers/7e091da3-0636-4cba-b8de-94fdeecf0b7f" status: 200 len: 1845 microversion: 2.32 time: 0.619475 Aug 10 23:18:33.971485 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2124/4448] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:18:33 2022] GET /compute/v2.1/servers/7e091da3-0636-4cba-b8de-94fdeecf0b7f => generated 1845 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:18:33.977516 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-d72b20aa-1977-492a-a0c4-64f0fba45666 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:18:33.978586 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-d72b20aa-1977-492a-a0c4-64f0fba45666 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: 1885b741-1fc3-413a-bb33-f8d3aeff8b04] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:18:33.987752 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d72b20aa-1977-492a-a0c4-64f0fba45666 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:33.988788 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d72b20aa-1977-492a-a0c4-64f0fba45666 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:33.989493 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d72b20aa-1977-492a-a0c4-64f0fba45666 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:33.990477 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d72b20aa-1977-492a-a0c4-64f0fba45666 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:33.991725 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d72b20aa-1977-492a-a0c4-64f0fba45666 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:33.992417 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d72b20aa-1977-492a-a0c4-64f0fba45666 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:34.224459 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-db5ad94d-66b0-47fa-a57a-08ba6c5b4a30 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:34.255995 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-db5ad94d-66b0-47fa-a57a-08ba6c5b4a30 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/7f49d27c-0fba-4d08-8f85-3eaed8b805e7" status: 200 len: 1507 microversion: 2.1 time: 1.497490 Aug 10 23:18:34.256833 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2325/4449] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:18:32 2022] GET /compute/v2.1/servers/7f49d27c-0fba-4d08-8f85-3eaed8b805e7 => generated 1507 bytes in 1499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:18:34.519668 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-d72b20aa-1977-492a-a0c4-64f0fba45666 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6684f0c87e4242be9e0ffb4ef1973f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0582ace9e4443b8ad88915503ee630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:34.533846 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-d72b20aa-1977-492a-a0c4-64f0fba45666 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "GET /compute/v2.1/servers/1885b741-1fc3-413a-bb33-f8d3aeff8b04" status: 200 len: 1292 microversion: 2.1 time: 0.558408 Aug 10 23:18:34.536803 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2125/4450] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:18:33 2022] GET /compute/v2.1/servers/1885b741-1fc3-413a-bb33-f8d3aeff8b04 => generated 1292 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:18:34.976591 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-6d7cdb68-46d3-4303-9976-d6c37e7b2384 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:18:34.979660 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-6d7cdb68-46d3-4303-9976-d6c37e7b2384 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] [instance: 7e091da3-0636-4cba-b8de-94fdeecf0b7f] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:18:34.990107 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6d7cdb68-46d3-4303-9976-d6c37e7b2384 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:34.991023 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6d7cdb68-46d3-4303-9976-d6c37e7b2384 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:34.992222 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6d7cdb68-46d3-4303-9976-d6c37e7b2384 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:34.993205 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6d7cdb68-46d3-4303-9976-d6c37e7b2384 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:34.993884 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6d7cdb68-46d3-4303-9976-d6c37e7b2384 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:34.994757 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6d7cdb68-46d3-4303-9976-d6c37e7b2384 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:35.279582 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-d10888a1-788f-4e1a-9712-07c74a6de3a9 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:18:35.280705 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-d10888a1-788f-4e1a-9712-07c74a6de3a9 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: 7f49d27c-0fba-4d08-8f85-3eaed8b805e7] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:18:35.298501 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d10888a1-788f-4e1a-9712-07c74a6de3a9 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:35.299397 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d10888a1-788f-4e1a-9712-07c74a6de3a9 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:35.300112 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d10888a1-788f-4e1a-9712-07c74a6de3a9 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:35.301523 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d10888a1-788f-4e1a-9712-07c74a6de3a9 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:35.303040 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d10888a1-788f-4e1a-9712-07c74a6de3a9 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:35.306054 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d10888a1-788f-4e1a-9712-07c74a6de3a9 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:36.095551 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-d10888a1-788f-4e1a-9712-07c74a6de3a9 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:36.107942 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-d10888a1-788f-4e1a-9712-07c74a6de3a9 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/7f49d27c-0fba-4d08-8f85-3eaed8b805e7" status: 200 len: 1504 microversion: 2.1 time: 0.834442 Aug 10 23:18:36.109917 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2126/4451] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:18:35 2022] GET /compute/v2.1/servers/7f49d27c-0fba-4d08-8f85-3eaed8b805e7 => generated 1504 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:18:36.126321 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-e30c5508-6986-4c21-b795-5e8b97dc1031 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:18:36.127151 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-e30c5508-6986-4c21-b795-5e8b97dc1031 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: 1885b741-1fc3-413a-bb33-f8d3aeff8b04] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:18:36.145418 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e30c5508-6986-4c21-b795-5e8b97dc1031 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:36.146137 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e30c5508-6986-4c21-b795-5e8b97dc1031 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:36.146734 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e30c5508-6986-4c21-b795-5e8b97dc1031 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:36.148382 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e30c5508-6986-4c21-b795-5e8b97dc1031 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:36.149002 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e30c5508-6986-4c21-b795-5e8b97dc1031 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:36.149607 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e30c5508-6986-4c21-b795-5e8b97dc1031 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:36.437981 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-e30c5508-6986-4c21-b795-5e8b97dc1031 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6684f0c87e4242be9e0ffb4ef1973f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0582ace9e4443b8ad88915503ee630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:36.453586 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-e30c5508-6986-4c21-b795-5e8b97dc1031 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "GET /compute/v2.1/servers/1885b741-1fc3-413a-bb33-f8d3aeff8b04" status: 200 len: 1292 microversion: 2.1 time: 0.342283 Aug 10 23:18:36.454553 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2127/4452] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:18:36 2022] GET /compute/v2.1/servers/1885b741-1fc3-413a-bb33-f8d3aeff8b04 => generated 1292 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:18:36.460666 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-7f6f3b7d-cc58-48b3-9677-7571611a177f req-45af3217-0977-4fcd-8d00-8be886f5de7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1885b741-1fc3-413a-bb33-f8d3aeff8b04", "name": "network-vif-plugged", "status": "completed", "tag": "060b6999-ca43-47ee-9c41-f1df86541c80"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:18:36.476885 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-6d7cdb68-46d3-4303-9976-d6c37e7b2384 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:36.489083 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-7f6f3b7d-cc58-48b3-9677-7571611a177f req-45af3217-0977-4fcd-8d00-8be886f5de7b service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:36.489744 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-7f6f3b7d-cc58-48b3-9677-7571611a177f req-45af3217-0977-4fcd-8d00-8be886f5de7b service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:36.490295 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-7f6f3b7d-cc58-48b3-9677-7571611a177f req-45af3217-0977-4fcd-8d00-8be886f5de7b service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:36.493951 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-6d7cdb68-46d3-4303-9976-d6c37e7b2384 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:36.496016 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-6d7cdb68-46d3-4303-9976-d6c37e7b2384 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:36.499001 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-6d7cdb68-46d3-4303-9976-d6c37e7b2384 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] 10.222.0.58 "GET /compute/v2.1/servers/7e091da3-0636-4cba-b8de-94fdeecf0b7f" status: 200 len: 1845 microversion: 2.32 time: 1.526325 Aug 10 23:18:36.514030 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-7f6f3b7d-cc58-48b3-9677-7571611a177f req-45af3217-0977-4fcd-8d00-8be886f5de7b service nova] Creating event network-vif-plugged:060b6999-ca43-47ee-9c41-f1df86541c80 for instance 1885b741-1fc3-413a-bb33-f8d3aeff8b04 on n-h2-850468-14 Aug 10 23:18:36.523809 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-7f6f3b7d-cc58-48b3-9677-7571611a177f req-45af3217-0977-4fcd-8d00-8be886f5de7b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067410 Aug 10 23:18:36.530002 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2128/4453] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:18:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:18:36.532960 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2326/4454] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:18:34 2022] GET /compute/v2.1/servers/7e091da3-0636-4cba-b8de-94fdeecf0b7f => generated 1845 bytes in 1561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:18:36.549367 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-176659d3-4b77-4c94-8357-32bd55b37fa6 req-e7bfd7fd-5eec-4e7e-bc16-0a44b027f6b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e091da3-0636-4cba-b8de-94fdeecf0b7f", "tag": "7dab50f5-321c-4571-bb72-8c2a4a681492"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:18:36.568549 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-176659d3-4b77-4c94-8357-32bd55b37fa6 req-e7bfd7fd-5eec-4e7e-bc16-0a44b027f6b5 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:36.573369 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-176659d3-4b77-4c94-8357-32bd55b37fa6 req-e7bfd7fd-5eec-4e7e-bc16-0a44b027f6b5 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:36.579009 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-176659d3-4b77-4c94-8357-32bd55b37fa6 req-e7bfd7fd-5eec-4e7e-bc16-0a44b027f6b5 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:36.596527 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-176659d3-4b77-4c94-8357-32bd55b37fa6 req-e7bfd7fd-5eec-4e7e-bc16-0a44b027f6b5 service nova] Creating event network-changed:7dab50f5-321c-4571-bb72-8c2a4a681492 for instance 7e091da3-0636-4cba-b8de-94fdeecf0b7f on n-h1-850468-14 Aug 10 23:18:36.621045 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-176659d3-4b77-4c94-8357-32bd55b37fa6 req-e7bfd7fd-5eec-4e7e-bc16-0a44b027f6b5 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089150 Aug 10 23:18:36.627111 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2129/4455] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:18:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:18:37.139877 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-b6e85e89-33bf-40c8-af6e-daf8f0ccacf6 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:18:37.141713 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-b6e85e89-33bf-40c8-af6e-daf8f0ccacf6 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: 7f49d27c-0fba-4d08-8f85-3eaed8b805e7] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:18:37.162702 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b6e85e89-33bf-40c8-af6e-daf8f0ccacf6 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:37.163532 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b6e85e89-33bf-40c8-af6e-daf8f0ccacf6 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:37.164149 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b6e85e89-33bf-40c8-af6e-daf8f0ccacf6 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:37.170540 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b6e85e89-33bf-40c8-af6e-daf8f0ccacf6 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:37.171359 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b6e85e89-33bf-40c8-af6e-daf8f0ccacf6 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:37.171998 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b6e85e89-33bf-40c8-af6e-daf8f0ccacf6 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:37.480536 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-fe3b92ff-c54f-4a47-8a8d-368b2e7f88e9 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:18:37.481486 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-fe3b92ff-c54f-4a47-8a8d-368b2e7f88e9 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: 1885b741-1fc3-413a-bb33-f8d3aeff8b04] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:18:37.504226 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fe3b92ff-c54f-4a47-8a8d-368b2e7f88e9 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:37.504724 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fe3b92ff-c54f-4a47-8a8d-368b2e7f88e9 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:37.505168 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fe3b92ff-c54f-4a47-8a8d-368b2e7f88e9 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:37.506284 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fe3b92ff-c54f-4a47-8a8d-368b2e7f88e9 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:37.506737 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fe3b92ff-c54f-4a47-8a8d-368b2e7f88e9 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:37.507194 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fe3b92ff-c54f-4a47-8a8d-368b2e7f88e9 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:37.893189 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-b6e85e89-33bf-40c8-af6e-daf8f0ccacf6 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:37.905242 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-b6e85e89-33bf-40c8-af6e-daf8f0ccacf6 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/7f49d27c-0fba-4d08-8f85-3eaed8b805e7" status: 200 len: 1504 microversion: 2.1 time: 0.776023 Aug 10 23:18:37.907346 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2327/4456] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:18:37 2022] GET /compute/v2.1/servers/7f49d27c-0fba-4d08-8f85-3eaed8b805e7 => generated 1504 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:18:37.916320 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-4c4a024e-c7d4-4304-8707-ec7713492022 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:18:37.917018 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-4c4a024e-c7d4-4304-8707-ec7713492022 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] [instance: 7e091da3-0636-4cba-b8de-94fdeecf0b7f] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:18:37.930395 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-fe3b92ff-c54f-4a47-8a8d-368b2e7f88e9 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6684f0c87e4242be9e0ffb4ef1973f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0582ace9e4443b8ad88915503ee630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:37.944542 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-fe3b92ff-c54f-4a47-8a8d-368b2e7f88e9 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "GET /compute/v2.1/servers/1885b741-1fc3-413a-bb33-f8d3aeff8b04" status: 200 len: 1292 microversion: 2.1 time: 0.470494 Aug 10 23:18:37.945608 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2130/4457] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:18:37 2022] GET /compute/v2.1/servers/1885b741-1fc3-413a-bb33-f8d3aeff8b04 => generated 1292 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:18:37.946591 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4c4a024e-c7d4-4304-8707-ec7713492022 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:37.947738 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4c4a024e-c7d4-4304-8707-ec7713492022 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:37.951328 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4c4a024e-c7d4-4304-8707-ec7713492022 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:37.952115 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4c4a024e-c7d4-4304-8707-ec7713492022 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:37.952597 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4c4a024e-c7d4-4304-8707-ec7713492022 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:37.953040 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4c4a024e-c7d4-4304-8707-ec7713492022 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:38.321039 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-0cef1817-81b9-45f0-8cd9-062821d9f24c req-c7b74698-bf74-4792-88ae-98432da8375b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b812cd8c-7e33-4e97-8df6-c7fccdf12019", "tag": "fc32a303-f86b-4983-9b9a-e8ed05dd3d0f"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:18:38.340681 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-0cef1817-81b9-45f0-8cd9-062821d9f24c req-c7b74698-bf74-4792-88ae-98432da8375b service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:38.341539 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-0cef1817-81b9-45f0-8cd9-062821d9f24c req-c7b74698-bf74-4792-88ae-98432da8375b service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:38.342217 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-0cef1817-81b9-45f0-8cd9-062821d9f24c req-c7b74698-bf74-4792-88ae-98432da8375b service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:38.368764 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-0cef1817-81b9-45f0-8cd9-062821d9f24c req-c7b74698-bf74-4792-88ae-98432da8375b service nova] Creating event network-changed:fc32a303-f86b-4983-9b9a-e8ed05dd3d0f for instance b812cd8c-7e33-4e97-8df6-c7fccdf12019 on n-h1-850468-14 Aug 10 23:18:38.378030 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-0cef1817-81b9-45f0-8cd9-062821d9f24c req-c7b74698-bf74-4792-88ae-98432da8375b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061502 Aug 10 23:18:38.387530 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2131/4458] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:18:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:18:38.578107 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-4c4a024e-c7d4-4304-8707-ec7713492022 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:38.581895 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:18:38.608253 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-4c4a024e-c7d4-4304-8707-ec7713492022 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:38.613533 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-4c4a024e-c7d4-4304-8707-ec7713492022 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:38.614762 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-4c4a024e-c7d4-4304-8707-ec7713492022 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] 10.222.0.58 "GET /compute/v2.1/servers/7e091da3-0636-4cba-b8de-94fdeecf0b7f" status: 200 len: 1866 microversion: 2.32 time: 0.706455 Aug 10 23:18:38.623541 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2328/4459] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:18:37 2022] GET /compute/v2.1/servers/7e091da3-0636-4cba-b8de-94fdeecf0b7f => generated 1866 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:18:38.936140 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-069f434d-95fb-4bdf-9911-c5e67d976bf8 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:18:38.936757 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-069f434d-95fb-4bdf-9911-c5e67d976bf8 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: 7f49d27c-0fba-4d08-8f85-3eaed8b805e7] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:18:38.955966 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-069f434d-95fb-4bdf-9911-c5e67d976bf8 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:38.956785 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-069f434d-95fb-4bdf-9911-c5e67d976bf8 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:38.957616 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-069f434d-95fb-4bdf-9911-c5e67d976bf8 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:38.958533 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-069f434d-95fb-4bdf-9911-c5e67d976bf8 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:38.959075 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-069f434d-95fb-4bdf-9911-c5e67d976bf8 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:38.959489 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-069f434d-95fb-4bdf-9911-c5e67d976bf8 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:38.972391 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-09a49d0d-e23a-441b-bd55-96bbdd306077 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:18:38.973116 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-09a49d0d-e23a-441b-bd55-96bbdd306077 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: 1885b741-1fc3-413a-bb33-f8d3aeff8b04] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:18:38.995844 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-09a49d0d-e23a-441b-bd55-96bbdd306077 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:38.999296 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-09a49d0d-e23a-441b-bd55-96bbdd306077 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:39.000915 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-09a49d0d-e23a-441b-bd55-96bbdd306077 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:39.005453 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-09a49d0d-e23a-441b-bd55-96bbdd306077 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:39.007424 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-09a49d0d-e23a-441b-bd55-96bbdd306077 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:39.007924 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-09a49d0d-e23a-441b-bd55-96bbdd306077 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:39.441201 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-09a49d0d-e23a-441b-bd55-96bbdd306077 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6684f0c87e4242be9e0ffb4ef1973f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0582ace9e4443b8ad88915503ee630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:39.459725 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-09a49d0d-e23a-441b-bd55-96bbdd306077 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "GET /compute/v2.1/servers/1885b741-1fc3-413a-bb33-f8d3aeff8b04" status: 200 len: 1292 microversion: 2.1 time: 0.492513 Aug 10 23:18:39.462237 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2329/4460] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:18:38 2022] GET /compute/v2.1/servers/1885b741-1fc3-413a-bb33-f8d3aeff8b04 => generated 1292 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:18:39.473229 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-aae9854e-7757-4ef9-ae58-f549eb438804 req-4719daf5-ff1a-444b-a284-95a6900a65e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e091da3-0636-4cba-b8de-94fdeecf0b7f", "tag": "d1dfd00f-ee9e-41fd-a00e-0820c42b1cf5"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:18:39.488291 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-aae9854e-7757-4ef9-ae58-f549eb438804 req-4719daf5-ff1a-444b-a284-95a6900a65e0 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:39.489221 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-aae9854e-7757-4ef9-ae58-f549eb438804 req-4719daf5-ff1a-444b-a284-95a6900a65e0 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:39.489873 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-aae9854e-7757-4ef9-ae58-f549eb438804 req-4719daf5-ff1a-444b-a284-95a6900a65e0 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:39.554968 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-aae9854e-7757-4ef9-ae58-f549eb438804 req-4719daf5-ff1a-444b-a284-95a6900a65e0 service nova] Creating event network-changed:d1dfd00f-ee9e-41fd-a00e-0820c42b1cf5 for instance 7e091da3-0636-4cba-b8de-94fdeecf0b7f on n-h1-850468-14 Aug 10 23:18:39.565742 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-aae9854e-7757-4ef9-ae58-f549eb438804 req-4719daf5-ff1a-444b-a284-95a6900a65e0 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100825 Aug 10 23:18:39.586285 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2330/4461] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:18:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:18:39.647009 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-8d9297b3-ee5d-4046-8c23-313ab6a50bad tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:18:39.647812 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-8d9297b3-ee5d-4046-8c23-313ab6a50bad tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] [instance: 7e091da3-0636-4cba-b8de-94fdeecf0b7f] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:18:39.663710 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8d9297b3-ee5d-4046-8c23-313ab6a50bad tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:39.664465 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8d9297b3-ee5d-4046-8c23-313ab6a50bad tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:39.665105 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8d9297b3-ee5d-4046-8c23-313ab6a50bad tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:39.667138 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8d9297b3-ee5d-4046-8c23-313ab6a50bad tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:39.668950 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8d9297b3-ee5d-4046-8c23-313ab6a50bad tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:39.669575 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8d9297b3-ee5d-4046-8c23-313ab6a50bad tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:39.948799 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-069f434d-95fb-4bdf-9911-c5e67d976bf8 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:39.982017 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-069f434d-95fb-4bdf-9911-c5e67d976bf8 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/7f49d27c-0fba-4d08-8f85-3eaed8b805e7" status: 200 len: 1504 microversion: 2.1 time: 1.052298 Aug 10 23:18:39.996188 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2132/4462] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:18:38 2022] GET /compute/v2.1/servers/7f49d27c-0fba-4d08-8f85-3eaed8b805e7 => generated 1504 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:18:40.019293 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-72b9e401-1025-4d45-b2f1-e5d9a640b9e6 req-82884301-d0b3-47be-aa0b-0a3f3420111d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f49d27c-0fba-4d08-8f85-3eaed8b805e7", "name": "network-vif-unplugged", "status": "completed", "tag": "69ad680e-3222-4e16-9619-7f0a0d9623e5"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:18:40.068156 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-72b9e401-1025-4d45-b2f1-e5d9a640b9e6 req-82884301-d0b3-47be-aa0b-0a3f3420111d service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:40.068709 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-72b9e401-1025-4d45-b2f1-e5d9a640b9e6 req-82884301-d0b3-47be-aa0b-0a3f3420111d service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:40.069152 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-72b9e401-1025-4d45-b2f1-e5d9a640b9e6 req-82884301-d0b3-47be-aa0b-0a3f3420111d service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:40.080482 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=4 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:18:40.113637 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-72b9e401-1025-4d45-b2f1-e5d9a640b9e6 req-82884301-d0b3-47be-aa0b-0a3f3420111d service nova] Creating event network-vif-unplugged:69ad680e-3222-4e16-9619-7f0a0d9623e5 for instance 7f49d27c-0fba-4d08-8f85-3eaed8b805e7 on n-h2-850468-14 Aug 10 23:18:40.128587 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-72b9e401-1025-4d45-b2f1-e5d9a640b9e6 req-82884301-d0b3-47be-aa0b-0a3f3420111d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.130474 Aug 10 23:18:40.129524 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2133/4463] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:18:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:18:40.466413 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-8d9297b3-ee5d-4046-8c23-313ab6a50bad tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:40.483224 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-8d9297b3-ee5d-4046-8c23-313ab6a50bad tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:40.485212 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-8d9297b3-ee5d-4046-8c23-313ab6a50bad tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:40.490229 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-8d9297b3-ee5d-4046-8c23-313ab6a50bad tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] 10.222.0.58 "GET /compute/v2.1/servers/7e091da3-0636-4cba-b8de-94fdeecf0b7f" status: 200 len: 1866 microversion: 2.32 time: 0.848328 Aug 10 23:18:40.493035 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-1221ffa2-066b-4c44-88f1-152d9ec27e02 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:18:40.495464 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-1221ffa2-066b-4c44-88f1-152d9ec27e02 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: 1885b741-1fc3-413a-bb33-f8d3aeff8b04] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:18:40.509613 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2331/4464] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:18:39 2022] GET /compute/v2.1/servers/7e091da3-0636-4cba-b8de-94fdeecf0b7f => generated 1866 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 23:18:40.510469 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1221ffa2-066b-4c44-88f1-152d9ec27e02 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:40.511004 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1221ffa2-066b-4c44-88f1-152d9ec27e02 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:40.511460 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1221ffa2-066b-4c44-88f1-152d9ec27e02 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:40.521242 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1221ffa2-066b-4c44-88f1-152d9ec27e02 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:40.521754 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1221ffa2-066b-4c44-88f1-152d9ec27e02 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:40.542240 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1221ffa2-066b-4c44-88f1-152d9ec27e02 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:41.013846 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-7022b763-9e6d-4594-904a-110e91c81daa tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:18:41.014866 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-7022b763-9e6d-4594-904a-110e91c81daa tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: 7f49d27c-0fba-4d08-8f85-3eaed8b805e7] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:18:41.032730 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7022b763-9e6d-4594-904a-110e91c81daa tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:41.033710 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7022b763-9e6d-4594-904a-110e91c81daa tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:41.034385 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7022b763-9e6d-4594-904a-110e91c81daa tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:41.035375 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7022b763-9e6d-4594-904a-110e91c81daa tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:41.036066 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7022b763-9e6d-4594-904a-110e91c81daa tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:41.036731 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7022b763-9e6d-4594-904a-110e91c81daa tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:41.272539 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-7022b763-9e6d-4594-904a-110e91c81daa tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:41.283255 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-7022b763-9e6d-4594-904a-110e91c81daa tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/7f49d27c-0fba-4d08-8f85-3eaed8b805e7" status: 200 len: 1447 microversion: 2.1 time: 0.273503 Aug 10 23:18:41.289443 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2332/4465] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:18:41 2022] GET /compute/v2.1/servers/7f49d27c-0fba-4d08-8f85-3eaed8b805e7 => generated 1447 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:18:41.314246 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-9e68e27b-0a36-4941-91f0-34748f6cdcd3 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:18:41.315357 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-9e68e27b-0a36-4941-91f0-34748f6cdcd3 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: fa9dfd3a-a636-48ce-ae15-0ed51baee954] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:18:41.332672 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9e68e27b-0a36-4941-91f0-34748f6cdcd3 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:41.333579 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9e68e27b-0a36-4941-91f0-34748f6cdcd3 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:41.334282 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9e68e27b-0a36-4941-91f0-34748f6cdcd3 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:41.335291 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9e68e27b-0a36-4941-91f0-34748f6cdcd3 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:41.336006 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9e68e27b-0a36-4941-91f0-34748f6cdcd3 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:41.336665 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9e68e27b-0a36-4941-91f0-34748f6cdcd3 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:41.633743 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-9e68e27b-0a36-4941-91f0-34748f6cdcd3 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:41.643521 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-9e68e27b-0a36-4941-91f0-34748f6cdcd3 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954" status: 200 len: 1667 microversion: 2.1 time: 0.333187 Aug 10 23:18:41.652016 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2333/4466] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:18:41 2022] GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954 => generated 1667 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:18:41.659081 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-9097d474-cdd7-4318-ba0a-e42c308ed245 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:18:41.659998 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-9097d474-cdd7-4318-ba0a-e42c308ed245 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] [instance: 7e091da3-0636-4cba-b8de-94fdeecf0b7f] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:18:41.666738 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9097d474-cdd7-4318-ba0a-e42c308ed245 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:41.667721 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9097d474-cdd7-4318-ba0a-e42c308ed245 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:41.668378 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9097d474-cdd7-4318-ba0a-e42c308ed245 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:41.669325 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9097d474-cdd7-4318-ba0a-e42c308ed245 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:41.670027 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9097d474-cdd7-4318-ba0a-e42c308ed245 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:41.670593 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9097d474-cdd7-4318-ba0a-e42c308ed245 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:41.908085 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-1221ffa2-066b-4c44-88f1-152d9ec27e02 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6684f0c87e4242be9e0ffb4ef1973f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0582ace9e4443b8ad88915503ee630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:41.919839 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-1221ffa2-066b-4c44-88f1-152d9ec27e02 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "GET /compute/v2.1/servers/1885b741-1fc3-413a-bb33-f8d3aeff8b04" status: 200 len: 1292 microversion: 2.1 time: 1.431195 Aug 10 23:18:41.920442 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2134/4467] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:18:40 2022] GET /compute/v2.1/servers/1885b741-1fc3-413a-bb33-f8d3aeff8b04 => generated 1292 bytes in 1433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:18:41.938176 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-58ba4f64-2a11-4309-b254-947ca9f8717d tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:18:41.942158 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-58ba4f64-2a11-4309-b254-947ca9f8717d tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: fa9dfd3a-a636-48ce-ae15-0ed51baee954] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:18:41.959147 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-58ba4f64-2a11-4309-b254-947ca9f8717d tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:41.963408 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-58ba4f64-2a11-4309-b254-947ca9f8717d tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:41.963857 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-58ba4f64-2a11-4309-b254-947ca9f8717d tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:41.964611 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-58ba4f64-2a11-4309-b254-947ca9f8717d tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:41.965068 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-58ba4f64-2a11-4309-b254-947ca9f8717d tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:41.965494 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-58ba4f64-2a11-4309-b254-947ca9f8717d tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:42.253399 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-58ba4f64-2a11-4309-b254-947ca9f8717d tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:42.268630 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-58ba4f64-2a11-4309-b254-947ca9f8717d tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954" status: 200 len: 1667 microversion: 2.1 time: 0.338150 Aug 10 23:18:42.269895 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2135/4468] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:18:41 2022] GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954 => generated 1667 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:18:42.286224 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-70e841d2-3dcb-4754-8309-70914890855d req-de844a7a-d363-45fe-b091-35a87eb5b6ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e091da3-0636-4cba-b8de-94fdeecf0b7f", "tag": "fef0f10f-3060-43c3-bd96-39b0c071dfab"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:18:42.302145 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-70e841d2-3dcb-4754-8309-70914890855d req-de844a7a-d363-45fe-b091-35a87eb5b6ee service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:42.305898 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-70e841d2-3dcb-4754-8309-70914890855d req-de844a7a-d363-45fe-b091-35a87eb5b6ee service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:42.309278 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-70e841d2-3dcb-4754-8309-70914890855d req-de844a7a-d363-45fe-b091-35a87eb5b6ee service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:42.319893 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=100 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:18:42.333600 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-9097d474-cdd7-4318-ba0a-e42c308ed245 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:42.338631 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-70e841d2-3dcb-4754-8309-70914890855d req-de844a7a-d363-45fe-b091-35a87eb5b6ee service nova] Creating event network-changed:fef0f10f-3060-43c3-bd96-39b0c071dfab for instance 7e091da3-0636-4cba-b8de-94fdeecf0b7f on n-h1-850468-14 Aug 10 23:18:42.352867 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-9097d474-cdd7-4318-ba0a-e42c308ed245 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:42.353706 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-70e841d2-3dcb-4754-8309-70914890855d req-de844a7a-d363-45fe-b091-35a87eb5b6ee service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070297 Aug 10 23:18:42.354259 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2136/4469] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:18:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 23:18:42.358433 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-9097d474-cdd7-4318-ba0a-e42c308ed245 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:42.365324 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-9097d474-cdd7-4318-ba0a-e42c308ed245 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] 10.222.0.58 "GET /compute/v2.1/servers/7e091da3-0636-4cba-b8de-94fdeecf0b7f" status: 200 len: 1887 microversion: 2.32 time: 0.710029 Aug 10 23:18:42.365661 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-7d15c921-147b-494b-a7f9-fdce2a8b77ef tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:18:42.366646 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-7d15c921-147b-494b-a7f9-fdce2a8b77ef tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: fa9dfd3a-a636-48ce-ae15-0ed51baee954] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:18:42.366890 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2334/4470] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:18:41 2022] GET /compute/v2.1/servers/7e091da3-0636-4cba-b8de-94fdeecf0b7f => generated 1887 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:18:42.381356 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7d15c921-147b-494b-a7f9-fdce2a8b77ef tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:42.382556 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7d15c921-147b-494b-a7f9-fdce2a8b77ef tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:42.384742 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7d15c921-147b-494b-a7f9-fdce2a8b77ef tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:42.394746 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7d15c921-147b-494b-a7f9-fdce2a8b77ef tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:42.395561 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7d15c921-147b-494b-a7f9-fdce2a8b77ef tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:42.396172 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7d15c921-147b-494b-a7f9-fdce2a8b77ef tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:42.944435 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-9dd05b0c-8573-4738-8e7e-dcb372aea4a4 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:18:42.945542 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-9dd05b0c-8573-4738-8e7e-dcb372aea4a4 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: 1885b741-1fc3-413a-bb33-f8d3aeff8b04] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:18:42.960776 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9dd05b0c-8573-4738-8e7e-dcb372aea4a4 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:42.961709 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9dd05b0c-8573-4738-8e7e-dcb372aea4a4 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:42.964433 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9dd05b0c-8573-4738-8e7e-dcb372aea4a4 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:42.965411 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9dd05b0c-8573-4738-8e7e-dcb372aea4a4 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:42.966068 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9dd05b0c-8573-4738-8e7e-dcb372aea4a4 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:42.969138 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9dd05b0c-8573-4738-8e7e-dcb372aea4a4 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:43.237540 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-7d15c921-147b-494b-a7f9-fdce2a8b77ef tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:43.256591 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-7d15c921-147b-494b-a7f9-fdce2a8b77ef tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954" status: 200 len: 1667 microversion: 2.1 time: 0.897926 Aug 10 23:18:43.266817 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2137/4471] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:18:42 2022] GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954 => generated 1667 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:18:43.279444 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-a9d3c3ec-2c23-4ee4-8086-e25f54b8eb89 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:18:43.280055 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-a9d3c3ec-2c23-4ee4-8086-e25f54b8eb89 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: fa9dfd3a-a636-48ce-ae15-0ed51baee954] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:18:43.293649 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a9d3c3ec-2c23-4ee4-8086-e25f54b8eb89 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:43.296914 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a9d3c3ec-2c23-4ee4-8086-e25f54b8eb89 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:43.299832 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a9d3c3ec-2c23-4ee4-8086-e25f54b8eb89 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:43.301585 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a9d3c3ec-2c23-4ee4-8086-e25f54b8eb89 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:43.302811 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a9d3c3ec-2c23-4ee4-8086-e25f54b8eb89 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:43.303688 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a9d3c3ec-2c23-4ee4-8086-e25f54b8eb89 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:43.371043 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-9dd05b0c-8573-4738-8e7e-dcb372aea4a4 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6684f0c87e4242be9e0ffb4ef1973f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0582ace9e4443b8ad88915503ee630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:43.396244 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-9dd05b0c-8573-4738-8e7e-dcb372aea4a4 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "GET /compute/v2.1/servers/1885b741-1fc3-413a-bb33-f8d3aeff8b04" status: 200 len: 1473 microversion: 2.1 time: 0.455486 Aug 10 23:18:43.407524 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2335/4472] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:18:42 2022] GET /compute/v2.1/servers/1885b741-1fc3-413a-bb33-f8d3aeff8b04 => generated 1473 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:18:43.437130 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-f2a93ab0-5a43-4136-b563-828a77f49d14 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:18:43.437747 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-f2a93ab0-5a43-4136-b563-828a77f49d14 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] [instance: 7e091da3-0636-4cba-b8de-94fdeecf0b7f] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:18:43.460515 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f2a93ab0-5a43-4136-b563-828a77f49d14 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:43.461485 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f2a93ab0-5a43-4136-b563-828a77f49d14 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:43.461485 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f2a93ab0-5a43-4136-b563-828a77f49d14 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:43.462140 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f2a93ab0-5a43-4136-b563-828a77f49d14 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:43.462744 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f2a93ab0-5a43-4136-b563-828a77f49d14 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:43.467484 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f2a93ab0-5a43-4136-b563-828a77f49d14 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:44.019152 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-f2a93ab0-5a43-4136-b563-828a77f49d14 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:44.031904 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-f2a93ab0-5a43-4136-b563-828a77f49d14 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:44.040021 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-f2a93ab0-5a43-4136-b563-828a77f49d14 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:44.045831 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-f2a93ab0-5a43-4136-b563-828a77f49d14 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] 10.222.0.58 "GET /compute/v2.1/servers/7e091da3-0636-4cba-b8de-94fdeecf0b7f" status: 200 len: 1887 microversion: 2.32 time: 0.636716 Aug 10 23:18:44.059118 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2336/4473] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:18:43 2022] GET /compute/v2.1/servers/7e091da3-0636-4cba-b8de-94fdeecf0b7f => generated 1887 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:18:44.064672 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-3c5adaf1-6ed8-4095-9453-85c6ae24f900 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-407228220", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:18:44.080019 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-a9d3c3ec-2c23-4ee4-8086-e25f54b8eb89 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:44.089307 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-a9d3c3ec-2c23-4ee4-8086-e25f54b8eb89 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954" status: 200 len: 1667 microversion: 2.1 time: 0.814212 Aug 10 23:18:44.095756 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2138/4474] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:18:43 2022] GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954 => generated 1667 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:18:44.117749 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-628212f4-de8e-4e85-9667-d7135f0e61cf tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:18:44.129720 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-628212f4-de8e-4e85-9667-d7135f0e61cf tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:44.130496 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-628212f4-de8e-4e85-9667-d7135f0e61cf tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:44.131786 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-628212f4-de8e-4e85-9667-d7135f0e61cf tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:44.187031 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-628212f4-de8e-4e85-9667-d7135f0e61cf tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: fa9dfd3a-a636-48ce-ae15-0ed51baee954] Going to try to stop instance {{(pid=122632) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 10 23:18:44.196964 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.network.neutron [None req-3c5adaf1-6ed8-4095-9453-85c6ae24f900 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] validate_networks() for [('af9afbc6-0659-47e6-b542-cfe9f265fcc2', None, None, None, None, None)] {{(pid=122633) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 23:18:44.268014 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-628212f4-de8e-4e85-9667-d7135f0e61cf tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "POST /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954/action" status: 202 len: 0 microversion: 2.1 time: 0.145061 Aug 10 23:18:44.274933 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2139/4475] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:18:44 2022] POST /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954/action => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:18:44.295904 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-8fdb1f4b-3f93-4df6-a6a3-91226879ee3b tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:18:44.296635 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-8fdb1f4b-3f93-4df6-a6a3-91226879ee3b tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: fa9dfd3a-a636-48ce-ae15-0ed51baee954] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:18:44.324267 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8fdb1f4b-3f93-4df6-a6a3-91226879ee3b tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:44.325937 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8fdb1f4b-3f93-4df6-a6a3-91226879ee3b tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:44.328377 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8fdb1f4b-3f93-4df6-a6a3-91226879ee3b tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:44.331019 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8fdb1f4b-3f93-4df6-a6a3-91226879ee3b tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:44.333233 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8fdb1f4b-3f93-4df6-a6a3-91226879ee3b tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:44.335777 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8fdb1f4b-3f93-4df6-a6a3-91226879ee3b tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:44.744875 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-8fdb1f4b-3f93-4df6-a6a3-91226879ee3b tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:44.758503 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-8fdb1f4b-3f93-4df6-a6a3-91226879ee3b tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954" status: 200 len: 1677 microversion: 2.1 time: 0.480505 Aug 10 23:18:44.779312 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2140/4476] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:18:44 2022] GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954 => generated 1677 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:18:44.795205 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-2db9957b-906f-4ab8-ac1e-ba6e5d850c03 req-67e09869-ef30-4663-aeb6-6805148d0e5a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e091da3-0636-4cba-b8de-94fdeecf0b7f", "tag": "06a5a1f3-cec1-4f39-b897-ff685f8485fa"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:18:44.817167 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-2db9957b-906f-4ab8-ac1e-ba6e5d850c03 req-67e09869-ef30-4663-aeb6-6805148d0e5a service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:44.817864 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-2db9957b-906f-4ab8-ac1e-ba6e5d850c03 req-67e09869-ef30-4663-aeb6-6805148d0e5a service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:44.818468 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-2db9957b-906f-4ab8-ac1e-ba6e5d850c03 req-67e09869-ef30-4663-aeb6-6805148d0e5a service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:44.833711 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-2db9957b-906f-4ab8-ac1e-ba6e5d850c03 req-67e09869-ef30-4663-aeb6-6805148d0e5a service nova] Creating event network-changed:06a5a1f3-cec1-4f39-b897-ff685f8485fa for instance 7e091da3-0636-4cba-b8de-94fdeecf0b7f on n-h1-850468-14 Aug 10 23:18:44.840187 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-2db9957b-906f-4ab8-ac1e-ba6e5d850c03 req-67e09869-ef30-4663-aeb6-6805148d0e5a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059238 Aug 10 23:18:44.841423 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2141/4477] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:18:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:18:45.084131 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-18ea5b7e-a34e-47c1-a914-0368dedd5a4a tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:18:45.085721 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-18ea5b7e-a34e-47c1-a914-0368dedd5a4a tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] [instance: 7e091da3-0636-4cba-b8de-94fdeecf0b7f] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:18:45.104397 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-18ea5b7e-a34e-47c1-a914-0368dedd5a4a tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:45.107133 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-18ea5b7e-a34e-47c1-a914-0368dedd5a4a tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:45.107631 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-18ea5b7e-a34e-47c1-a914-0368dedd5a4a tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:45.109809 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-18ea5b7e-a34e-47c1-a914-0368dedd5a4a tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:45.111369 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-18ea5b7e-a34e-47c1-a914-0368dedd5a4a tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:45.111992 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-18ea5b7e-a34e-47c1-a914-0368dedd5a4a tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:45.755757 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-18ea5b7e-a34e-47c1-a914-0368dedd5a4a tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:45.772815 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-18ea5b7e-a34e-47c1-a914-0368dedd5a4a tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:45.779733 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-18ea5b7e-a34e-47c1-a914-0368dedd5a4a tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:45.780846 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-18ea5b7e-a34e-47c1-a914-0368dedd5a4a tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] 10.222.0.58 "GET /compute/v2.1/servers/7e091da3-0636-4cba-b8de-94fdeecf0b7f" status: 200 len: 1887 microversion: 2.32 time: 0.702384 Aug 10 23:18:45.781416 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2142/4478] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:18:45 2022] GET /compute/v2.1/servers/7e091da3-0636-4cba-b8de-94fdeecf0b7f => generated 1887 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 23:18:45.799566 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-e16a8160-953a-4656-a1f8-1587dadbfbb6 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:18:45.801313 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-e16a8160-953a-4656-a1f8-1587dadbfbb6 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: fa9dfd3a-a636-48ce-ae15-0ed51baee954] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:18:45.816030 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e16a8160-953a-4656-a1f8-1587dadbfbb6 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:45.817459 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e16a8160-953a-4656-a1f8-1587dadbfbb6 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:45.818191 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e16a8160-953a-4656-a1f8-1587dadbfbb6 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:45.819406 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e16a8160-953a-4656-a1f8-1587dadbfbb6 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:45.820106 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e16a8160-953a-4656-a1f8-1587dadbfbb6 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:45.820761 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e16a8160-953a-4656-a1f8-1587dadbfbb6 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:46.159320 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-3c5adaf1-6ed8-4095-9453-85c6ae24f900 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Flavor limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:18:46.159872 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-3c5adaf1-6ed8-4095-9453-85c6ae24f900 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Image limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:18:46.160463 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-3c5adaf1-6ed8-4095-9453-85c6ae24f900 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Flavor pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:18:46.161057 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-3c5adaf1-6ed8-4095-9453-85c6ae24f900 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Image pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:18:46.161669 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-3c5adaf1-6ed8-4095-9453-85c6ae24f900 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:18:46.170557 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-e16a8160-953a-4656-a1f8-1587dadbfbb6 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:46.177787 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3c5adaf1-6ed8-4095-9453-85c6ae24f900 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:46.178625 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3c5adaf1-6ed8-4095-9453-85c6ae24f900 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:46.179210 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-e16a8160-953a-4656-a1f8-1587dadbfbb6 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954" status: 200 len: 1677 microversion: 2.1 time: 0.391486 Aug 10 23:18:46.179578 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3c5adaf1-6ed8-4095-9453-85c6ae24f900 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:46.179805 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2143/4479] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:18:45 2022] GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954 => generated 1677 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:18:46.182433 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3c5adaf1-6ed8-4095-9453-85c6ae24f900 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:46.183439 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3c5adaf1-6ed8-4095-9453-85c6ae24f900 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:46.184119 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3c5adaf1-6ed8-4095-9453-85c6ae24f900 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:46.212676 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-3c5adaf1-6ed8-4095-9453-85c6ae24f900 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Getting quotas for project 0b0582ace9e4443b8ad88915503ee630. Resources: {'instances', 'cores', 'ram'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:18:46.220629 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-3c5adaf1-6ed8-4095-9453-85c6ae24f900 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Getting quotas for user 6684f0c87e4242be9e0ffb4ef1973f96 and project 0b0582ace9e4443b8ad88915503ee630. Resources: {'instances', 'cores', 'ram'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:18:46.245612 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:18:46.251783 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-3c5adaf1-6ed8-4095-9453-85c6ae24f900 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Going to run 1 instances... {{(pid=122633) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 23:18:46.254171 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-3c5adaf1-6ed8-4095-9453-85c6ae24f900 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: 820f7087-4d63-448c-a8fc-6d815c0c6ba2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78ad8905-f66f-4733-8be9-2b260f1fabed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122633) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 23:18:46.308530 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-3c5adaf1-6ed8-4095-9453-85c6ae24f900 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.247880 Aug 10 23:18:46.309911 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2337/4480] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 23:18:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 2250 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 23:18:46.322492 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-2e8816d8-474a-4da2-bb3b-4041d40f3102 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:18:46.326247 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-2e8816d8-474a-4da2-bb3b-4041d40f3102 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: 820f7087-4d63-448c-a8fc-6d815c0c6ba2] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:18:46.381088 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-2e8816d8-474a-4da2-bb3b-4041d40f3102 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: 820f7087-4d63-448c-a8fc-6d815c0c6ba2] Going to try to terminate instance {{(pid=122632) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:18:46.623536 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-2e8816d8-474a-4da2-bb3b-4041d40f3102 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "DELETE /compute/v2.1/servers/820f7087-4d63-448c-a8fc-6d815c0c6ba2" status: 204 len: 0 microversion: 2.1 time: 0.306434 Aug 10 23:18:46.626567 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2144/4481] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:18:46 2022] DELETE /compute/v2.1/servers/820f7087-4d63-448c-a8fc-6d815c0c6ba2 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:18:46.636033 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-5eebf645-b69a-4cf6-92d0-4fc9df383197 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:18:46.636656 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-5eebf645-b69a-4cf6-92d0-4fc9df383197 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: 820f7087-4d63-448c-a8fc-6d815c0c6ba2] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:18:46.674087 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-5eebf645-b69a-4cf6-92d0-4fc9df383197 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] HTTP exception thrown: Instance 820f7087-4d63-448c-a8fc-6d815c0c6ba2 could not be found. Aug 10 23:18:46.684106 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-5eebf645-b69a-4cf6-92d0-4fc9df383197 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Request method failure captured: Aug 10 23:18:46.684106 n-d-850468-14 devstack@n-api.service[122633]: request: GET /compute/v2.1/servers/820f7087-4d63-448c-a8fc-6d815c0c6ba2 HTTP/1.1 Aug 10 23:18:46.684106 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:18:46.684106 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:18:46.684106 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:18:46.684106 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:18:46.684106 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:18:46.684106 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:18:46.684106 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:18:46.684106 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:18:46.684106 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9DytBT8uIivFlHEw3ugwW3-_1ks70Fcm-KUdUfNf3hiFdhb5xvDC9LI4u79J0X-frOTrhG-DWWR1w8a7yZU35-jGfQgN97QRTSA7hDEW06netEOKzarBlr77OO9sCeT3s5ektFA7vCYLl4122WPKHg-MSXQY0g9YmL291Ic7yNjWLnQ Aug 10 23:18:46.684106 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:18:46.684106 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:18:46.684106 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:18:46.684106 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:18:46.684106 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:18:46.684106 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:18:46.684106 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 0b0582ace9e4443b8ad88915503ee630 Aug 10 23:18:46.684106 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-ServersTestJSON-516662906 Aug 10 23:18:46.684106 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:18:46.684106 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:18:46.684106 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0b0582ace9e4443b8ad88915503ee630"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0b0582ace9e4443b8ad88915503ee630"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/0b0582ace9e4443b8ad88915503ee630"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_0b0582ace9e4443b8ad88915503ee630", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:18:46.684106 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-ServersTestJSON-516662906 Aug 10 23:18:46.684106 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 0b0582ace9e4443b8ad88915503ee630 Aug 10 23:18:46.684106 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-ServersTestJSON-516662906 Aug 10 23:18:46.684106 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-ServersTestJSON-516662906-project Aug 10 23:18:46.684106 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:18:46.684106 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:18:46.684106 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 6684f0c87e4242be9e0ffb4ef1973f96 Aug 10 23:18:46.684106 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-ServersTestJSON-516662906-project Aug 10 23:18:46.684106 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:18:46.684106 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance 820f7087-4d63-448c-a8fc-6d815c0c6ba2 could not be found. Aug 10 23:18:46.684106 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': '820f7087-4d63-448c-a8fc-6d815c0c6ba2'} Aug 10 23:18:46.684106 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:18:46.684106 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:18:46.684106 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2879, in _get_instance Aug 10 23:18:46.684106 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi build_req = objects.BuildRequest.get_by_instance_uuid( Aug 10 23:18:46.684106 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 10 23:18:46.684106 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 10 23:18:46.684106 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/build_request.py", line 177, in get_by_instance_uuid Aug 10 23:18:46.684106 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi db_req = cls._get_by_instance_uuid_from_db(context, instance_uuid) Aug 10 23:18:46.684106 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 10 23:18:46.684106 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 10 23:18:46.684106 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/build_request.py", line 172, in _get_by_instance_uuid_from_db Aug 10 23:18:46.684106 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.BuildRequestNotFound(uuid=instance_uuid) Aug 10 23:18:46.684106 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.BuildRequestNotFound: BuildRequest not found for instance 820f7087-4d63-448c-a8fc-6d815c0c6ba2 Aug 10 23:18:46.684106 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:18:46.684106 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:18:46.684106 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:18:46.684106 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:18:46.684106 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:18:46.684106 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:18:46.684106 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:18:46.684106 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:18:46.684106 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2891, in _get_instance Aug 10 23:18:46.684106 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 10 23:18:46.684106 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 820f7087-4d63-448c-a8fc-6d815c0c6ba2 could not be found. Aug 10 23:18:46.684106 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:18:46.684106 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:18:46.684106 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:18:46.684106 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:18:46.684106 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:18:46.684106 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:18:46.689102 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:18:46.689102 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:18:46.689102 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:18:46.689102 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:18:46.689102 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:18:46.689102 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:18:46.689102 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:18:46.689102 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:18:46.689102 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:18:46.689102 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:18:46.689102 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 820f7087-4d63-448c-a8fc-6d815c0c6ba2 could not be found. Aug 10 23:18:46.689102 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:18:46.689102 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:18:46.689102 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:18:46.689102 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:18:46.689102 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:18:46.689102 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:18:46.689102 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:18:46.689102 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:18:46.689102 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 820f7087-4d63-448c-a8fc-6d815c0c6ba2 could not be found. Aug 10 23:18:46.689102 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:18:46.692081 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-5eebf645-b69a-4cf6-92d0-4fc9df383197 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Returning 404 to user: Instance 820f7087-4d63-448c-a8fc-6d815c0c6ba2 could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:18:46.693342 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-5eebf645-b69a-4cf6-92d0-4fc9df383197 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "GET /compute/v2.1/servers/820f7087-4d63-448c-a8fc-6d815c0c6ba2" status: 404 len: 111 microversion: 2.1 time: 0.062486 Aug 10 23:18:46.701362 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2338/4482] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:18:46 2022] GET /compute/v2.1/servers/820f7087-4d63-448c-a8fc-6d815c0c6ba2 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:18:46.783628 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-14f21761-5b27-4bd1-a1c7-7973c302cd95 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-388687826", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "af9afbc6-0659-47e6-b542-cfe9f265fcc2"}]}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:18:46.807976 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-4bd6a33c-47e6-49bc-8754-474e22e6ed38 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:18:46.808597 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-4bd6a33c-47e6-49bc-8754-474e22e6ed38 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] [instance: 7e091da3-0636-4cba-b8de-94fdeecf0b7f] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:18:46.838632 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4bd6a33c-47e6-49bc-8754-474e22e6ed38 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:46.855501 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4bd6a33c-47e6-49bc-8754-474e22e6ed38 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:46.858307 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4bd6a33c-47e6-49bc-8754-474e22e6ed38 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:46.861631 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4bd6a33c-47e6-49bc-8754-474e22e6ed38 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:46.863299 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4bd6a33c-47e6-49bc-8754-474e22e6ed38 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:46.865064 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4bd6a33c-47e6-49bc-8754-474e22e6ed38 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:46.943367 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.network.neutron [None req-14f21761-5b27-4bd1-a1c7-7973c302cd95 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] validate_networks() for [('af9afbc6-0659-47e6-b542-cfe9f265fcc2', None, None, None, None, None)] {{(pid=122632) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 23:18:47.632474 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-4bd6a33c-47e6-49bc-8754-474e22e6ed38 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:47.643371 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-4bd6a33c-47e6-49bc-8754-474e22e6ed38 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:47.645168 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-4bd6a33c-47e6-49bc-8754-474e22e6ed38 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:47.646589 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-4bd6a33c-47e6-49bc-8754-474e22e6ed38 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] 10.222.0.58 "GET /compute/v2.1/servers/7e091da3-0636-4cba-b8de-94fdeecf0b7f" status: 200 len: 1875 microversion: 2.32 time: 0.844994 Aug 10 23:18:47.664062 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2339/4483] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:18:46 2022] GET /compute/v2.1/servers/7e091da3-0636-4cba-b8de-94fdeecf0b7f => generated 1875 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 23:18:47.670067 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-1517e4e3-4a01-4a9c-8b16-18d1b715c78c req-c0ac8aae-36b2-48ae-9998-4bbe46b73c76 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e091da3-0636-4cba-b8de-94fdeecf0b7f", "tag": "15a1ebf2-6257-4511-9a21-1f5f62d2bad4"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:18:47.681575 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-1517e4e3-4a01-4a9c-8b16-18d1b715c78c req-c0ac8aae-36b2-48ae-9998-4bbe46b73c76 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:47.682321 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-1517e4e3-4a01-4a9c-8b16-18d1b715c78c req-c0ac8aae-36b2-48ae-9998-4bbe46b73c76 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:47.683041 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-1517e4e3-4a01-4a9c-8b16-18d1b715c78c req-c0ac8aae-36b2-48ae-9998-4bbe46b73c76 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:47.696324 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-1517e4e3-4a01-4a9c-8b16-18d1b715c78c req-c0ac8aae-36b2-48ae-9998-4bbe46b73c76 service nova] Creating event network-changed:15a1ebf2-6257-4511-9a21-1f5f62d2bad4 for instance 7e091da3-0636-4cba-b8de-94fdeecf0b7f on n-h1-850468-14 Aug 10 23:18:47.702356 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-1517e4e3-4a01-4a9c-8b16-18d1b715c78c req-c0ac8aae-36b2-48ae-9998-4bbe46b73c76 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036715 Aug 10 23:18:47.704015 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2340/4484] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:18:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:18:47.709255 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-f49dc51e-ec69-4adc-ad92-fcbaaa36ccc6 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:18:47.711206 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-f49dc51e-ec69-4adc-ad92-fcbaaa36ccc6 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: fa9dfd3a-a636-48ce-ae15-0ed51baee954] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:18:47.719291 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f49dc51e-ec69-4adc-ad92-fcbaaa36ccc6 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:47.720044 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f49dc51e-ec69-4adc-ad92-fcbaaa36ccc6 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:47.720657 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f49dc51e-ec69-4adc-ad92-fcbaaa36ccc6 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:47.721899 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f49dc51e-ec69-4adc-ad92-fcbaaa36ccc6 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:47.722516 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f49dc51e-ec69-4adc-ad92-fcbaaa36ccc6 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:47.723144 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f49dc51e-ec69-4adc-ad92-fcbaaa36ccc6 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:48.180501 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-14f21761-5b27-4bd1-a1c7-7973c302cd95 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Flavor limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:18:48.181643 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-14f21761-5b27-4bd1-a1c7-7973c302cd95 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Image limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:18:48.181919 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-14f21761-5b27-4bd1-a1c7-7973c302cd95 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Flavor pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:18:48.182331 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-14f21761-5b27-4bd1-a1c7-7973c302cd95 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Image pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:18:48.182757 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-14f21761-5b27-4bd1-a1c7-7973c302cd95 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:18:48.204708 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-14f21761-5b27-4bd1-a1c7-7973c302cd95 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:48.205137 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-14f21761-5b27-4bd1-a1c7-7973c302cd95 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:48.205579 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-14f21761-5b27-4bd1-a1c7-7973c302cd95 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:48.206313 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-14f21761-5b27-4bd1-a1c7-7973c302cd95 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:48.206756 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-14f21761-5b27-4bd1-a1c7-7973c302cd95 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:48.207214 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-14f21761-5b27-4bd1-a1c7-7973c302cd95 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:48.227057 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-14f21761-5b27-4bd1-a1c7-7973c302cd95 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Getting quotas for project 0b0582ace9e4443b8ad88915503ee630. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:18:48.233582 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-14f21761-5b27-4bd1-a1c7-7973c302cd95 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Getting quotas for user 6684f0c87e4242be9e0ffb4ef1973f96 and project 0b0582ace9e4443b8ad88915503ee630. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:18:48.249660 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-14f21761-5b27-4bd1-a1c7-7973c302cd95 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Going to run 1 instances... {{(pid=122632) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 23:18:48.252763 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-14f21761-5b27-4bd1-a1c7-7973c302cd95 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: 641b3607-8ef3-4e41-ab75-28a6ab178750] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78ad8905-f66f-4733-8be9-2b260f1fabed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122632) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 23:18:48.314087 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-14f21761-5b27-4bd1-a1c7-7973c302cd95 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.535290 Aug 10 23:18:48.315531 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2145/4485] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 23:18:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 1537 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 23:18:48.327762 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-ee33c677-8c35-4560-9f1c-f1f2a6bd0299 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:18:48.328705 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-ee33c677-8c35-4560-9f1c-f1f2a6bd0299 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: 641b3607-8ef3-4e41-ab75-28a6ab178750] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:18:48.481865 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-ee33c677-8c35-4560-9f1c-f1f2a6bd0299 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6684f0c87e4242be9e0ffb4ef1973f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0582ace9e4443b8ad88915503ee630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:48.495356 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-ee33c677-8c35-4560-9f1c-f1f2a6bd0299 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "GET /compute/v2.1/servers/641b3607-8ef3-4e41-ab75-28a6ab178750" status: 200 len: 1220 microversion: 2.1 time: 0.172327 Aug 10 23:18:48.495948 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2146/4486] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:18:48 2022] GET /compute/v2.1/servers/641b3607-8ef3-4e41-ab75-28a6ab178750 => generated 1220 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:18:48.536695 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-f49dc51e-ec69-4adc-ad92-fcbaaa36ccc6 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:48.547784 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-f49dc51e-ec69-4adc-ad92-fcbaaa36ccc6 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954" status: 200 len: 1677 microversion: 2.1 time: 0.839908 Aug 10 23:18:48.548558 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2341/4487] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:18:47 2022] GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954 => generated 1677 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:18:48.675455 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-38f0bb56-37c9-43b5-a787-a6dd2295faa5 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:18:48.676062 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-38f0bb56-37c9-43b5-a787-a6dd2295faa5 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] [instance: 7e091da3-0636-4cba-b8de-94fdeecf0b7f] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:18:48.689764 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-38f0bb56-37c9-43b5-a787-a6dd2295faa5 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:48.691083 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-38f0bb56-37c9-43b5-a787-a6dd2295faa5 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:48.692167 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-38f0bb56-37c9-43b5-a787-a6dd2295faa5 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:48.694023 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-38f0bb56-37c9-43b5-a787-a6dd2295faa5 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:48.694484 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-38f0bb56-37c9-43b5-a787-a6dd2295faa5 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:48.700168 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-38f0bb56-37c9-43b5-a787-a6dd2295faa5 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:49.266041 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-38f0bb56-37c9-43b5-a787-a6dd2295faa5 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:49.281154 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-38f0bb56-37c9-43b5-a787-a6dd2295faa5 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:49.286303 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-38f0bb56-37c9-43b5-a787-a6dd2295faa5 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:49.300864 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-38f0bb56-37c9-43b5-a787-a6dd2295faa5 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] 10.222.0.58 "GET /compute/v2.1/servers/7e091da3-0636-4cba-b8de-94fdeecf0b7f" status: 200 len: 1875 microversion: 2.32 time: 0.629898 Aug 10 23:18:49.302003 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2147/4488] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:18:48 2022] GET /compute/v2.1/servers/7e091da3-0636-4cba-b8de-94fdeecf0b7f => generated 1875 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:18:49.526672 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-90a4f66a-dd75-429a-9519-65478839c907 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:18:49.530317 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-90a4f66a-dd75-429a-9519-65478839c907 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: 641b3607-8ef3-4e41-ab75-28a6ab178750] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:18:49.552337 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-90a4f66a-dd75-429a-9519-65478839c907 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:49.553164 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-90a4f66a-dd75-429a-9519-65478839c907 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:49.553615 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-90a4f66a-dd75-429a-9519-65478839c907 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:49.554309 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-90a4f66a-dd75-429a-9519-65478839c907 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:49.555231 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-90a4f66a-dd75-429a-9519-65478839c907 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:49.556379 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-90a4f66a-dd75-429a-9519-65478839c907 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:49.573021 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c5c659f1-73db-41c2-bb7f-9e9df391a52c tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:18:49.573636 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-c5c659f1-73db-41c2-bb7f-9e9df391a52c tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: fa9dfd3a-a636-48ce-ae15-0ed51baee954] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:18:49.581433 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:18:49.585533 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c5c659f1-73db-41c2-bb7f-9e9df391a52c tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:49.586030 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c5c659f1-73db-41c2-bb7f-9e9df391a52c tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:49.586465 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c5c659f1-73db-41c2-bb7f-9e9df391a52c tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:49.587771 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c5c659f1-73db-41c2-bb7f-9e9df391a52c tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:49.588441 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c5c659f1-73db-41c2-bb7f-9e9df391a52c tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:49.588886 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c5c659f1-73db-41c2-bb7f-9e9df391a52c tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:49.693368 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-90a4f66a-dd75-429a-9519-65478839c907 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6684f0c87e4242be9e0ffb4ef1973f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0582ace9e4443b8ad88915503ee630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:49.708532 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-90a4f66a-dd75-429a-9519-65478839c907 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "GET /compute/v2.1/servers/641b3607-8ef3-4e41-ab75-28a6ab178750" status: 200 len: 1216 microversion: 2.1 time: 0.186380 Aug 10 23:18:49.710105 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2342/4489] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:18:49 2022] GET /compute/v2.1/servers/641b3607-8ef3-4e41-ab75-28a6ab178750 => generated 1216 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:18:49.734403 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-d9c4d6c4-f399-42f3-ae88-937f61fbfcd8 req-113e31d1-d9a5-4d5c-8ccd-223968f19f45 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e091da3-0636-4cba-b8de-94fdeecf0b7f", "tag": "e33f8996-1d01-4809-ae73-234bdbbc3c3f"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:18:49.753196 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-d9c4d6c4-f399-42f3-ae88-937f61fbfcd8 req-113e31d1-d9a5-4d5c-8ccd-223968f19f45 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:49.754018 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-d9c4d6c4-f399-42f3-ae88-937f61fbfcd8 req-113e31d1-d9a5-4d5c-8ccd-223968f19f45 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:49.754813 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-d9c4d6c4-f399-42f3-ae88-937f61fbfcd8 req-113e31d1-d9a5-4d5c-8ccd-223968f19f45 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:49.771017 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-d9c4d6c4-f399-42f3-ae88-937f61fbfcd8 req-113e31d1-d9a5-4d5c-8ccd-223968f19f45 service nova] Creating event network-changed:e33f8996-1d01-4809-ae73-234bdbbc3c3f for instance 7e091da3-0636-4cba-b8de-94fdeecf0b7f on n-h1-850468-14 Aug 10 23:18:49.778560 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-d9c4d6c4-f399-42f3-ae88-937f61fbfcd8 req-113e31d1-d9a5-4d5c-8ccd-223968f19f45 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047300 Aug 10 23:18:49.779950 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2343/4490] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:18:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:18:50.278494 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-c5c659f1-73db-41c2-bb7f-9e9df391a52c tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:50.290713 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-c5c659f1-73db-41c2-bb7f-9e9df391a52c tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954" status: 200 len: 1677 microversion: 2.1 time: 0.722047 Aug 10 23:18:50.292118 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2148/4491] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:18:49 2022] GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954 => generated 1677 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:18:50.332415 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c63c3c8f-6109-4b73-9b4e-1400d73beccb tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:18:50.333424 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-c63c3c8f-6109-4b73-9b4e-1400d73beccb tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] [instance: 7e091da3-0636-4cba-b8de-94fdeecf0b7f] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:18:50.342321 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c63c3c8f-6109-4b73-9b4e-1400d73beccb tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:50.347518 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c63c3c8f-6109-4b73-9b4e-1400d73beccb tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:50.348277 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c63c3c8f-6109-4b73-9b4e-1400d73beccb tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:50.349217 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c63c3c8f-6109-4b73-9b4e-1400d73beccb tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:50.349872 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c63c3c8f-6109-4b73-9b4e-1400d73beccb tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:50.350482 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c63c3c8f-6109-4b73-9b4e-1400d73beccb tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:50.734865 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-dd160e7e-08bd-4c58-a94b-ab245fc37679 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:18:50.736525 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-dd160e7e-08bd-4c58-a94b-ab245fc37679 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: 641b3607-8ef3-4e41-ab75-28a6ab178750] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:18:50.753920 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dd160e7e-08bd-4c58-a94b-ab245fc37679 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:50.754493 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dd160e7e-08bd-4c58-a94b-ab245fc37679 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:50.756425 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dd160e7e-08bd-4c58-a94b-ab245fc37679 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:50.757483 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dd160e7e-08bd-4c58-a94b-ab245fc37679 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:50.758624 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dd160e7e-08bd-4c58-a94b-ab245fc37679 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:50.759900 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dd160e7e-08bd-4c58-a94b-ab245fc37679 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:50.964799 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-dd160e7e-08bd-4c58-a94b-ab245fc37679 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6684f0c87e4242be9e0ffb4ef1973f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0582ace9e4443b8ad88915503ee630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:50.974863 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-dd160e7e-08bd-4c58-a94b-ab245fc37679 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "GET /compute/v2.1/servers/641b3607-8ef3-4e41-ab75-28a6ab178750" status: 200 len: 1278 microversion: 2.1 time: 0.245081 Aug 10 23:18:50.981180 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2149/4492] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:18:50 2022] GET /compute/v2.1/servers/641b3607-8ef3-4e41-ab75-28a6ab178750 => generated 1278 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:18:51.075602 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-c63c3c8f-6109-4b73-9b4e-1400d73beccb tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:51.096213 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-c63c3c8f-6109-4b73-9b4e-1400d73beccb tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:51.102068 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-c63c3c8f-6109-4b73-9b4e-1400d73beccb tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:51.105510 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-c63c3c8f-6109-4b73-9b4e-1400d73beccb tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] 10.222.0.58 "GET /compute/v2.1/servers/7e091da3-0636-4cba-b8de-94fdeecf0b7f" status: 200 len: 1875 microversion: 2.32 time: 0.777977 Aug 10 23:18:51.106969 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2344/4493] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:18:50 2022] GET /compute/v2.1/servers/7e091da3-0636-4cba-b8de-94fdeecf0b7f => generated 1875 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:18:51.316570 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-f0ebf1bd-9cac-4332-acc4-987fdbfe97cb tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:18:51.317839 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-f0ebf1bd-9cac-4332-acc4-987fdbfe97cb tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: fa9dfd3a-a636-48ce-ae15-0ed51baee954] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:18:51.325583 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f0ebf1bd-9cac-4332-acc4-987fdbfe97cb tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:51.330579 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f0ebf1bd-9cac-4332-acc4-987fdbfe97cb tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:51.331299 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f0ebf1bd-9cac-4332-acc4-987fdbfe97cb tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:51.337729 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f0ebf1bd-9cac-4332-acc4-987fdbfe97cb tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:51.338499 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f0ebf1bd-9cac-4332-acc4-987fdbfe97cb tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:51.339192 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f0ebf1bd-9cac-4332-acc4-987fdbfe97cb tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:51.603959 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-f0ebf1bd-9cac-4332-acc4-987fdbfe97cb tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:51.612502 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-f0ebf1bd-9cac-4332-acc4-987fdbfe97cb tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954" status: 200 len: 1677 microversion: 2.1 time: 0.299956 Aug 10 23:18:51.613143 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2150/4494] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:18:51 2022] GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954 => generated 1677 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:18:51.803882 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-0f44c20a-5a4a-463e-8481-74b377f2748e req-1425a454-7c81-4aec-8031-8c3c85f4c62b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e091da3-0636-4cba-b8de-94fdeecf0b7f", "tag": "a65ed440-a31b-429f-8aa3-2fb86a09c770"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:18:51.827914 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-0f44c20a-5a4a-463e-8481-74b377f2748e req-1425a454-7c81-4aec-8031-8c3c85f4c62b service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:51.829812 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-0f44c20a-5a4a-463e-8481-74b377f2748e req-1425a454-7c81-4aec-8031-8c3c85f4c62b service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:51.830290 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-0f44c20a-5a4a-463e-8481-74b377f2748e req-1425a454-7c81-4aec-8031-8c3c85f4c62b service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:51.855547 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-0f44c20a-5a4a-463e-8481-74b377f2748e req-1425a454-7c81-4aec-8031-8c3c85f4c62b service nova] Creating event network-changed:a65ed440-a31b-429f-8aa3-2fb86a09c770 for instance 7e091da3-0636-4cba-b8de-94fdeecf0b7f on n-h1-850468-14 Aug 10 23:18:51.871519 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-0f44c20a-5a4a-463e-8481-74b377f2748e req-1425a454-7c81-4aec-8031-8c3c85f4c62b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071008 Aug 10 23:18:51.873470 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2345/4495] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:18:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:18:52.015135 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-da867125-44c9-40af-a22e-a7e7cd21c31e tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:18:52.015907 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-da867125-44c9-40af-a22e-a7e7cd21c31e tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: 641b3607-8ef3-4e41-ab75-28a6ab178750] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:18:52.041962 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-da867125-44c9-40af-a22e-a7e7cd21c31e tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:52.042514 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-da867125-44c9-40af-a22e-a7e7cd21c31e tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:52.043074 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-da867125-44c9-40af-a22e-a7e7cd21c31e tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:52.043805 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-da867125-44c9-40af-a22e-a7e7cd21c31e tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:52.044259 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-da867125-44c9-40af-a22e-a7e7cd21c31e tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:52.044678 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-da867125-44c9-40af-a22e-a7e7cd21c31e tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:52.137439 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-6b6a6a57-6ebb-4ea5-aa10-4d8d5ee3496c tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:18:52.138759 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-6b6a6a57-6ebb-4ea5-aa10-4d8d5ee3496c tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] [instance: 7e091da3-0636-4cba-b8de-94fdeecf0b7f] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:18:52.152884 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6b6a6a57-6ebb-4ea5-aa10-4d8d5ee3496c tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:52.153635 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6b6a6a57-6ebb-4ea5-aa10-4d8d5ee3496c tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:52.154271 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6b6a6a57-6ebb-4ea5-aa10-4d8d5ee3496c tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:52.155418 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6b6a6a57-6ebb-4ea5-aa10-4d8d5ee3496c tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:52.156039 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6b6a6a57-6ebb-4ea5-aa10-4d8d5ee3496c tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:52.156628 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6b6a6a57-6ebb-4ea5-aa10-4d8d5ee3496c tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:52.244094 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-da867125-44c9-40af-a22e-a7e7cd21c31e tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6684f0c87e4242be9e0ffb4ef1973f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0582ace9e4443b8ad88915503ee630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:52.256369 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-da867125-44c9-40af-a22e-a7e7cd21c31e tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "GET /compute/v2.1/servers/641b3607-8ef3-4e41-ab75-28a6ab178750" status: 200 len: 1278 microversion: 2.1 time: 0.258277 Aug 10 23:18:52.278363 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2151/4496] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:18:51 2022] GET /compute/v2.1/servers/641b3607-8ef3-4e41-ab75-28a6ab178750 => generated 1278 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:18:52.561622 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-6b6a6a57-6ebb-4ea5-aa10-4d8d5ee3496c tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:52.578850 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-6b6a6a57-6ebb-4ea5-aa10-4d8d5ee3496c tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:52.582270 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-6b6a6a57-6ebb-4ea5-aa10-4d8d5ee3496c tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:52.586820 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-6b6a6a57-6ebb-4ea5-aa10-4d8d5ee3496c tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] 10.222.0.58 "GET /compute/v2.1/servers/7e091da3-0636-4cba-b8de-94fdeecf0b7f" status: 200 len: 1875 microversion: 2.32 time: 0.455739 Aug 10 23:18:52.588254 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2346/4497] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:18:52 2022] GET /compute/v2.1/servers/7e091da3-0636-4cba-b8de-94fdeecf0b7f => generated 1875 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 23:18:52.637536 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-776aa7a0-8892-4172-bc69-852a98341932 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:18:52.638114 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-776aa7a0-8892-4172-bc69-852a98341932 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: fa9dfd3a-a636-48ce-ae15-0ed51baee954] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:18:52.664653 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-776aa7a0-8892-4172-bc69-852a98341932 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:52.665223 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-776aa7a0-8892-4172-bc69-852a98341932 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:52.665668 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-776aa7a0-8892-4172-bc69-852a98341932 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:52.666508 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-776aa7a0-8892-4172-bc69-852a98341932 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:52.667008 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-776aa7a0-8892-4172-bc69-852a98341932 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:52.667439 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-776aa7a0-8892-4172-bc69-852a98341932 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:53.099849 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-776aa7a0-8892-4172-bc69-852a98341932 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:53.115774 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-776aa7a0-8892-4172-bc69-852a98341932 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954" status: 200 len: 1677 microversion: 2.1 time: 0.482627 Aug 10 23:18:53.121502 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2152/4498] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:18:52 2022] GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954 => generated 1677 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:18:53.288523 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-2342fde5-e99a-4e1a-b462-76e119c3b64c tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:18:53.290893 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-2342fde5-e99a-4e1a-b462-76e119c3b64c tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: 641b3607-8ef3-4e41-ab75-28a6ab178750] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:18:53.309045 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2342fde5-e99a-4e1a-b462-76e119c3b64c tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:53.309715 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2342fde5-e99a-4e1a-b462-76e119c3b64c tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:53.312669 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2342fde5-e99a-4e1a-b462-76e119c3b64c tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:53.315097 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2342fde5-e99a-4e1a-b462-76e119c3b64c tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:53.316066 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2342fde5-e99a-4e1a-b462-76e119c3b64c tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:53.317948 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2342fde5-e99a-4e1a-b462-76e119c3b64c tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:53.621204 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-182797ef-585e-4fc1-9d46-0805f5201159 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:18:53.621832 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-182797ef-585e-4fc1-9d46-0805f5201159 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] [instance: 7e091da3-0636-4cba-b8de-94fdeecf0b7f] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:18:53.630896 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-182797ef-585e-4fc1-9d46-0805f5201159 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:53.631455 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-182797ef-585e-4fc1-9d46-0805f5201159 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:53.631902 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-182797ef-585e-4fc1-9d46-0805f5201159 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:53.632813 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-182797ef-585e-4fc1-9d46-0805f5201159 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:53.638145 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-182797ef-585e-4fc1-9d46-0805f5201159 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:53.639982 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-182797ef-585e-4fc1-9d46-0805f5201159 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:54.475257 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-2342fde5-e99a-4e1a-b462-76e119c3b64c tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6684f0c87e4242be9e0ffb4ef1973f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0582ace9e4443b8ad88915503ee630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:54.494029 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-2342fde5-e99a-4e1a-b462-76e119c3b64c tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "GET /compute/v2.1/servers/641b3607-8ef3-4e41-ab75-28a6ab178750" status: 200 len: 1320 microversion: 2.1 time: 1.210418 Aug 10 23:18:54.495897 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2347/4499] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:18:53 2022] GET /compute/v2.1/servers/641b3607-8ef3-4e41-ab75-28a6ab178750 => generated 1320 bytes in 1214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:18:54.502329 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-45dd79a9-20d0-420c-b5db-abe65d15289a tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:18:54.503418 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-45dd79a9-20d0-420c-b5db-abe65d15289a tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: fa9dfd3a-a636-48ce-ae15-0ed51baee954] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:18:54.530748 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-45dd79a9-20d0-420c-b5db-abe65d15289a tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:54.531293 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-45dd79a9-20d0-420c-b5db-abe65d15289a tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:54.532647 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-45dd79a9-20d0-420c-b5db-abe65d15289a tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:54.533532 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-45dd79a9-20d0-420c-b5db-abe65d15289a tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:54.533983 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-45dd79a9-20d0-420c-b5db-abe65d15289a tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:54.535383 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-45dd79a9-20d0-420c-b5db-abe65d15289a tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:54.570619 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-182797ef-585e-4fc1-9d46-0805f5201159 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:54.588791 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-182797ef-585e-4fc1-9d46-0805f5201159 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:54.590806 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-182797ef-585e-4fc1-9d46-0805f5201159 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:54.595194 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-182797ef-585e-4fc1-9d46-0805f5201159 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] 10.222.0.58 "GET /compute/v2.1/servers/7e091da3-0636-4cba-b8de-94fdeecf0b7f" status: 200 len: 1875 microversion: 2.32 time: 0.981267 Aug 10 23:18:54.596427 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2153/4500] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:18:53 2022] GET /compute/v2.1/servers/7e091da3-0636-4cba-b8de-94fdeecf0b7f => generated 1875 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:18:54.845559 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-45dd79a9-20d0-420c-b5db-abe65d15289a tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:54.854200 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-45dd79a9-20d0-420c-b5db-abe65d15289a tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954" status: 200 len: 1677 microversion: 2.1 time: 0.356845 Aug 10 23:18:54.861956 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2348/4501] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:18:54 2022] GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954 => generated 1677 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:18:55.040941 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-ad3845cb-69a0-41ca-bd6e-a24702bf3b03 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:18:55.041587 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-ad3845cb-69a0-41ca-bd6e-a24702bf3b03 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] [instance: 3ecbcf63-5592-4074-a3f7-d2caf3c58969] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:18:55.052614 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ad3845cb-69a0-41ca-bd6e-a24702bf3b03 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:55.053422 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ad3845cb-69a0-41ca-bd6e-a24702bf3b03 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:55.054233 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ad3845cb-69a0-41ca-bd6e-a24702bf3b03 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:55.055506 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ad3845cb-69a0-41ca-bd6e-a24702bf3b03 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:55.056195 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ad3845cb-69a0-41ca-bd6e-a24702bf3b03 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:55.056826 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ad3845cb-69a0-41ca-bd6e-a24702bf3b03 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:55.200407 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.objects.instance [None req-ad3845cb-69a0-41ca-bd6e-a24702bf3b03 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lazy-loading 'services' on Instance uuid 3ecbcf63-5592-4074-a3f7-d2caf3c58969 {{(pid=122632) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:18:55.366284 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-ad3845cb-69a0-41ca-bd6e-a24702bf3b03 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] 10.222.0.58 "DELETE /compute/v2.1/servers/3ecbcf63-5592-4074-a3f7-d2caf3c58969/os-volume_attachments/d632d4af-1e58-4001-8d46-0d8419f7033e" status: 202 len: 0 microversion: 2.1 time: 0.329434 Aug 10 23:18:55.373830 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2154/4502] 10.222.0.58 () {58 vars in 1416 bytes} [Wed Aug 10 23:18:55 2022] DELETE /compute/v2.1/servers/3ecbcf63-5592-4074-a3f7-d2caf3c58969/os-volume_attachments/d632d4af-1e58-4001-8d46-0d8419f7033e => generated 0 bytes in 338 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:18:55.378668 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-126635d3-f313-4577-a654-e0591865372b tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:18:55.384051 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-126635d3-f313-4577-a654-e0591865372b tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] [instance: 3ecbcf63-5592-4074-a3f7-d2caf3c58969] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:18:55.409201 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-126635d3-f313-4577-a654-e0591865372b tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:55.409823 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-126635d3-f313-4577-a654-e0591865372b tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:55.411192 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-126635d3-f313-4577-a654-e0591865372b tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:55.431812 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-126635d3-f313-4577-a654-e0591865372b tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:55.436618 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-126635d3-f313-4577-a654-e0591865372b tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:55.440686 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-126635d3-f313-4577-a654-e0591865372b tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:55.513096 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=100 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:18:55.517035 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-126635d3-f313-4577-a654-e0591865372b tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] 10.222.0.58 "GET /compute/v2.1/servers/3ecbcf63-5592-4074-a3f7-d2caf3c58969/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.142725 Aug 10 23:18:55.517624 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-9a496d79-1ff7-4a47-a78d-fb26f9f52b84 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:18:55.518535 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-9a496d79-1ff7-4a47-a78d-fb26f9f52b84 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: 641b3607-8ef3-4e41-ab75-28a6ab178750] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:18:55.521213 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2349/4503] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 10 23:18:55 2022] GET /compute/v2.1/servers/3ecbcf63-5592-4074-a3f7-d2caf3c58969/os-volume_attachments => generated 197 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 23:18:55.532536 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9a496d79-1ff7-4a47-a78d-fb26f9f52b84 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:55.533660 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9a496d79-1ff7-4a47-a78d-fb26f9f52b84 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:55.534263 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9a496d79-1ff7-4a47-a78d-fb26f9f52b84 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:55.535169 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9a496d79-1ff7-4a47-a78d-fb26f9f52b84 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:55.535987 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9a496d79-1ff7-4a47-a78d-fb26f9f52b84 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:55.536576 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9a496d79-1ff7-4a47-a78d-fb26f9f52b84 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:55.542650 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:18:55.624478 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-b1992726-1bcc-456f-8b84-e2154b214f5b tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:18:55.625391 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-b1992726-1bcc-456f-8b84-e2154b214f5b tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] [instance: 7e091da3-0636-4cba-b8de-94fdeecf0b7f] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:18:55.636160 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b1992726-1bcc-456f-8b84-e2154b214f5b tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:55.644551 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b1992726-1bcc-456f-8b84-e2154b214f5b tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:55.645266 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b1992726-1bcc-456f-8b84-e2154b214f5b tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:55.646199 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b1992726-1bcc-456f-8b84-e2154b214f5b tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:55.646928 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b1992726-1bcc-456f-8b84-e2154b214f5b tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:55.647531 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b1992726-1bcc-456f-8b84-e2154b214f5b tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:56.199194 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=2 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:18:56.242465 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=6 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:18:56.249052 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-9a496d79-1ff7-4a47-a78d-fb26f9f52b84 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6684f0c87e4242be9e0ffb4ef1973f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0582ace9e4443b8ad88915503ee630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:56.261713 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-9a496d79-1ff7-4a47-a78d-fb26f9f52b84 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "GET /compute/v2.1/servers/641b3607-8ef3-4e41-ab75-28a6ab178750" status: 200 len: 1320 microversion: 2.1 time: 0.749291 Aug 10 23:18:56.263484 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2155/4504] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:18:55 2022] GET /compute/v2.1/servers/641b3607-8ef3-4e41-ab75-28a6ab178750 => generated 1320 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:18:56.277062 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-be0b55b6-d291-47f5-afff-255085908921 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:18:56.278109 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-be0b55b6-d291-47f5-afff-255085908921 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: fa9dfd3a-a636-48ce-ae15-0ed51baee954] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:18:56.303536 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-be0b55b6-d291-47f5-afff-255085908921 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:56.308423 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-be0b55b6-d291-47f5-afff-255085908921 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:56.308995 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-be0b55b6-d291-47f5-afff-255085908921 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:56.309774 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-be0b55b6-d291-47f5-afff-255085908921 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:56.310255 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-be0b55b6-d291-47f5-afff-255085908921 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:56.310690 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-be0b55b6-d291-47f5-afff-255085908921 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:56.815858 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-be0b55b6-d291-47f5-afff-255085908921 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:56.834206 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-be0b55b6-d291-47f5-afff-255085908921 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954" status: 200 len: 1654 microversion: 2.1 time: 0.567180 Aug 10 23:18:56.840249 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2156/4505] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:18:56 2022] GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954 => generated 1654 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:18:56.848017 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-ccb86e85-63fb-425f-a586-55b1aa95824f tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:18:56.861243 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-ccb86e85-63fb-425f-a586-55b1aa95824f tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] [instance: 3ecbcf63-5592-4074-a3f7-d2caf3c58969] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:18:56.866459 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-b1992726-1bcc-456f-8b84-e2154b214f5b tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:56.882294 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ccb86e85-63fb-425f-a586-55b1aa95824f tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:56.884498 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ccb86e85-63fb-425f-a586-55b1aa95824f tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:56.884774 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-b1992726-1bcc-456f-8b84-e2154b214f5b tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:56.885571 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ccb86e85-63fb-425f-a586-55b1aa95824f tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:56.886541 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ccb86e85-63fb-425f-a586-55b1aa95824f tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:56.887267 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ccb86e85-63fb-425f-a586-55b1aa95824f tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:56.887971 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ccb86e85-63fb-425f-a586-55b1aa95824f tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:56.896042 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-b1992726-1bcc-456f-8b84-e2154b214f5b tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:56.901783 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-b1992726-1bcc-456f-8b84-e2154b214f5b tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] 10.222.0.58 "GET /compute/v2.1/servers/7e091da3-0636-4cba-b8de-94fdeecf0b7f" status: 200 len: 1875 microversion: 2.32 time: 1.282210 Aug 10 23:18:56.913318 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2350/4506] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:18:55 2022] GET /compute/v2.1/servers/7e091da3-0636-4cba-b8de-94fdeecf0b7f => generated 1875 bytes in 1295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:18:56.919518 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-3df5a284-d90b-4553-b9b3-2e5df2c8af1b tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:18:56.949353 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3df5a284-d90b-4553-b9b3-2e5df2c8af1b tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:56.949857 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3df5a284-d90b-4553-b9b3-2e5df2c8af1b tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:56.950300 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3df5a284-d90b-4553-b9b3-2e5df2c8af1b tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:56.989101 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-ccb86e85-63fb-425f-a586-55b1aa95824f tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] 10.222.0.58 "GET /compute/v2.1/servers/3ecbcf63-5592-4074-a3f7-d2caf3c58969/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.144709 Aug 10 23:18:57.002030 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2157/4507] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 10 23:18:56 2022] GET /compute/v2.1/servers/3ecbcf63-5592-4074-a3f7-d2caf3c58969/os-volume_attachments => generated 197 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:18:57.032266 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-3df5a284-d90b-4553-b9b3-2e5df2c8af1b tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: fa9dfd3a-a636-48ce-ae15-0ed51baee954] Going to try to start instance {{(pid=122633) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 10 23:18:57.169056 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-3df5a284-d90b-4553-b9b3-2e5df2c8af1b tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "POST /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954/action" status: 202 len: 0 microversion: 2.1 time: 0.254320 Aug 10 23:18:57.170311 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2351/4508] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:18:56 2022] POST /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954/action => generated 0 bytes in 256 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:18:57.180819 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-dfb4a4c3-d6f8-494c-9e3a-a989f5994d18 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:18:57.182019 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-dfb4a4c3-d6f8-494c-9e3a-a989f5994d18 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: fa9dfd3a-a636-48ce-ae15-0ed51baee954] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:18:57.243117 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dfb4a4c3-d6f8-494c-9e3a-a989f5994d18 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:57.250923 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dfb4a4c3-d6f8-494c-9e3a-a989f5994d18 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:57.254466 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dfb4a4c3-d6f8-494c-9e3a-a989f5994d18 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:57.256293 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dfb4a4c3-d6f8-494c-9e3a-a989f5994d18 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:57.257246 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dfb4a4c3-d6f8-494c-9e3a-a989f5994d18 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:57.266261 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dfb4a4c3-d6f8-494c-9e3a-a989f5994d18 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:57.288439 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-ad267e6c-e81d-4649-b490-e9025df60af9 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:18:57.289447 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-ad267e6c-e81d-4649-b490-e9025df60af9 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: 641b3607-8ef3-4e41-ab75-28a6ab178750] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:18:57.297733 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ad267e6c-e81d-4649-b490-e9025df60af9 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:57.299025 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ad267e6c-e81d-4649-b490-e9025df60af9 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:57.299686 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ad267e6c-e81d-4649-b490-e9025df60af9 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:57.300971 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ad267e6c-e81d-4649-b490-e9025df60af9 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:57.301773 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ad267e6c-e81d-4649-b490-e9025df60af9 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:57.302507 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ad267e6c-e81d-4649-b490-e9025df60af9 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:57.817392 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-ad267e6c-e81d-4649-b490-e9025df60af9 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6684f0c87e4242be9e0ffb4ef1973f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0582ace9e4443b8ad88915503ee630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:57.829736 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-ad267e6c-e81d-4649-b490-e9025df60af9 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "GET /compute/v2.1/servers/641b3607-8ef3-4e41-ab75-28a6ab178750" status: 200 len: 1320 microversion: 2.1 time: 0.546556 Aug 10 23:18:57.834575 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2352/4509] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:18:57 2022] GET /compute/v2.1/servers/641b3607-8ef3-4e41-ab75-28a6ab178750 => generated 1320 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:18:57.856265 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-9540a555-dd67-4500-a367-b4f908c312fe req-384ed9a6-b5c2-4d48-a60c-6081d3714690 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "641b3607-8ef3-4e41-ab75-28a6ab178750", "tag": "22688e12-f8a6-47d7-8f54-3618c6749884"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:18:57.893219 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-9540a555-dd67-4500-a367-b4f908c312fe req-384ed9a6-b5c2-4d48-a60c-6081d3714690 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:57.902906 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-9540a555-dd67-4500-a367-b4f908c312fe req-384ed9a6-b5c2-4d48-a60c-6081d3714690 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:57.903565 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-9540a555-dd67-4500-a367-b4f908c312fe req-384ed9a6-b5c2-4d48-a60c-6081d3714690 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:57.941037 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-9540a555-dd67-4500-a367-b4f908c312fe req-384ed9a6-b5c2-4d48-a60c-6081d3714690 service nova] Creating event network-changed:22688e12-f8a6-47d7-8f54-3618c6749884 for instance 641b3607-8ef3-4e41-ab75-28a6ab178750 on n-h2-850468-14 Aug 10 23:18:57.967016 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-9540a555-dd67-4500-a367-b4f908c312fe req-384ed9a6-b5c2-4d48-a60c-6081d3714690 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128226 Aug 10 23:18:57.974100 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2353/4510] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:18:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:18:57.992459 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-57da318d-1baa-4a05-9c6a-a452f66a6dad tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:18:57.994245 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-57da318d-1baa-4a05-9c6a-a452f66a6dad tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] [instance: 7e091da3-0636-4cba-b8de-94fdeecf0b7f] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:18:58.014625 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-57da318d-1baa-4a05-9c6a-a452f66a6dad tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:58.018036 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-57da318d-1baa-4a05-9c6a-a452f66a6dad tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:58.018860 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-57da318d-1baa-4a05-9c6a-a452f66a6dad tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:58.019689 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-57da318d-1baa-4a05-9c6a-a452f66a6dad tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:58.020765 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-57da318d-1baa-4a05-9c6a-a452f66a6dad tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:58.023284 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-57da318d-1baa-4a05-9c6a-a452f66a6dad tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:58.216718 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=2 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:18:58.487459 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=10 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:18:58.898120 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-57da318d-1baa-4a05-9c6a-a452f66a6dad tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:58.940381 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-57da318d-1baa-4a05-9c6a-a452f66a6dad tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:58.945174 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-57da318d-1baa-4a05-9c6a-a452f66a6dad tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:58.948724 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-57da318d-1baa-4a05-9c6a-a452f66a6dad tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] 10.222.0.58 "GET /compute/v2.1/servers/7e091da3-0636-4cba-b8de-94fdeecf0b7f" status: 200 len: 1875 microversion: 2.32 time: 0.971500 Aug 10 23:18:58.951061 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2354/4511] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:18:57 2022] GET /compute/v2.1/servers/7e091da3-0636-4cba-b8de-94fdeecf0b7f => generated 1875 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:18:58.960726 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-083cb0e8-39e0-4953-b6e0-6dc7ba562918 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:18:58.966210 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-083cb0e8-39e0-4953-b6e0-6dc7ba562918 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] [instance: 3ecbcf63-5592-4074-a3f7-d2caf3c58969] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:18:58.986026 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-083cb0e8-39e0-4953-b6e0-6dc7ba562918 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:58.989024 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-083cb0e8-39e0-4953-b6e0-6dc7ba562918 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:58.989694 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-083cb0e8-39e0-4953-b6e0-6dc7ba562918 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:58.990712 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-083cb0e8-39e0-4953-b6e0-6dc7ba562918 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:58.991911 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-083cb0e8-39e0-4953-b6e0-6dc7ba562918 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:58.993772 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-083cb0e8-39e0-4953-b6e0-6dc7ba562918 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:59.079500 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-083cb0e8-39e0-4953-b6e0-6dc7ba562918 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] 10.222.0.58 "GET /compute/v2.1/servers/3ecbcf63-5592-4074-a3f7-d2caf3c58969/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.126931 Aug 10 23:18:59.082310 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2355/4512] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 10 23:18:58 2022] GET /compute/v2.1/servers/3ecbcf63-5592-4074-a3f7-d2caf3c58969/os-volume_attachments => generated 197 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:18:59.089033 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-10f06007-8dde-41db-ab64-a6f4c324a4a1 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1206617653", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452", "networks": [{"uuid": "4781fdfb-125b-42c9-95f7-e3136b96dd22"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1953386696", "security_groups": [{"name": "tempest-secgroup-smoke-1764359027"}]}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:18:59.169170 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-dfb4a4c3-d6f8-494c-9e3a-a989f5994d18 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:59.187800 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-dfb4a4c3-d6f8-494c-9e3a-a989f5994d18 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954" status: 200 len: 1663 microversion: 2.1 time: 2.009327 Aug 10 23:18:59.188761 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2158/4513] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:18:57 2022] GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954 => generated 1663 bytes in 2015 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:18:59.208675 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-98afc203-2b6c-4675-bbff-bd437b016034 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:18:59.209554 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-98afc203-2b6c-4675-bbff-bd437b016034 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: 641b3607-8ef3-4e41-ab75-28a6ab178750] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:18:59.217156 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-98afc203-2b6c-4675-bbff-bd437b016034 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:59.218059 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-98afc203-2b6c-4675-bbff-bd437b016034 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:59.218722 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-98afc203-2b6c-4675-bbff-bd437b016034 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:59.219765 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-98afc203-2b6c-4675-bbff-bd437b016034 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:18:59.220483 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-98afc203-2b6c-4675-bbff-bd437b016034 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:18:59.221149 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-98afc203-2b6c-4675-bbff-bd437b016034 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:18:59.433324 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.network.neutron [None req-10f06007-8dde-41db-ab64-a6f4c324a4a1 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] validate_networks() for [('4781fdfb-125b-42c9-95f7-e3136b96dd22', None, None, None, None, None)] {{(pid=122633) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 23:18:59.838228 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-98afc203-2b6c-4675-bbff-bd437b016034 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6684f0c87e4242be9e0ffb4ef1973f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0582ace9e4443b8ad88915503ee630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:18:59.856362 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-98afc203-2b6c-4675-bbff-bd437b016034 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "GET /compute/v2.1/servers/641b3607-8ef3-4e41-ab75-28a6ab178750" status: 200 len: 1320 microversion: 2.1 time: 0.655959 Aug 10 23:18:59.880731 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2159/4514] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:18:59 2022] GET /compute/v2.1/servers/641b3607-8ef3-4e41-ab75-28a6ab178750 => generated 1320 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:18:59.981187 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-abeb4be1-7caf-4e26-83d7-0f28377f8e0a tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:18:59.981802 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-abeb4be1-7caf-4e26-83d7-0f28377f8e0a tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] [instance: 7e091da3-0636-4cba-b8de-94fdeecf0b7f] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:00.003085 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-abeb4be1-7caf-4e26-83d7-0f28377f8e0a tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:00.004840 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-abeb4be1-7caf-4e26-83d7-0f28377f8e0a tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:00.006347 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-abeb4be1-7caf-4e26-83d7-0f28377f8e0a tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:00.008788 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-abeb4be1-7caf-4e26-83d7-0f28377f8e0a tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:00.011775 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-abeb4be1-7caf-4e26-83d7-0f28377f8e0a tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:00.012398 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-abeb4be1-7caf-4e26-83d7-0f28377f8e0a tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:00.347724 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-10f06007-8dde-41db-ab64-a6f4c324a4a1 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Flavor limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:19:00.349141 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-10f06007-8dde-41db-ab64-a6f4c324a4a1 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Image limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:19:00.349937 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-10f06007-8dde-41db-ab64-a6f4c324a4a1 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Flavor pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:19:00.350537 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-10f06007-8dde-41db-ab64-a6f4c324a4a1 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Image pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:19:00.355838 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-10f06007-8dde-41db-ab64-a6f4c324a4a1 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:19:00.391732 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-10f06007-8dde-41db-ab64-a6f4c324a4a1 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:00.393803 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-10f06007-8dde-41db-ab64-a6f4c324a4a1 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:00.396961 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-10f06007-8dde-41db-ab64-a6f4c324a4a1 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:00.398190 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-10f06007-8dde-41db-ab64-a6f4c324a4a1 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:00.400182 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-10f06007-8dde-41db-ab64-a6f4c324a4a1 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:00.401740 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-10f06007-8dde-41db-ab64-a6f4c324a4a1 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:00.455230 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-10f06007-8dde-41db-ab64-a6f4c324a4a1 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Getting quotas for project 25abd63376614081a9d484f3c9ae950d. Resources: {'instances', 'cores', 'ram'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:19:00.475924 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-10f06007-8dde-41db-ab64-a6f4c324a4a1 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Getting quotas for user 5899b2ad9f1046caaf7c6073e408eeee and project 25abd63376614081a9d484f3c9ae950d. Resources: {'instances', 'cores', 'ram'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:19:00.521821 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-10f06007-8dde-41db-ab64-a6f4c324a4a1 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Going to run 1 instances... {{(pid=122633) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 23:19:00.530086 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-10f06007-8dde-41db-ab64-a6f4c324a4a1 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] [instance: 69c4b403-a8ad-449c-a577-63837a6d2445] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78ad8905-f66f-4733-8be9-2b260f1fabed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122633) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 23:19:00.662167 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-10f06007-8dde-41db-ab64-a6f4c324a4a1 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.578417 Aug 10 23:19:00.665801 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2356/4515] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 23:18:59 2022] POST /compute/v2.1/servers => generated 406 bytes in 1583 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 23:19:00.674851 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-faf748fe-23cb-497d-8bca-0b3d7e62713a tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:00.680722 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-faf748fe-23cb-497d-8bca-0b3d7e62713a tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] [instance: 3ecbcf63-5592-4074-a3f7-d2caf3c58969] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:00.717282 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-faf748fe-23cb-497d-8bca-0b3d7e62713a tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:00.717793 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-faf748fe-23cb-497d-8bca-0b3d7e62713a tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:00.724657 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-faf748fe-23cb-497d-8bca-0b3d7e62713a tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:00.725537 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-faf748fe-23cb-497d-8bca-0b3d7e62713a tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:00.726036 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-faf748fe-23cb-497d-8bca-0b3d7e62713a tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:00.726483 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-faf748fe-23cb-497d-8bca-0b3d7e62713a tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:00.817784 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-faf748fe-23cb-497d-8bca-0b3d7e62713a tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] 10.222.0.58 "GET /compute/v2.1/servers/3ecbcf63-5592-4074-a3f7-d2caf3c58969/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.150777 Aug 10 23:19:00.818377 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2357/4516] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 10 23:19:00 2022] GET /compute/v2.1/servers/3ecbcf63-5592-4074-a3f7-d2caf3c58969/os-volume_attachments => generated 197 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:19:00.830954 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-be59630f-5ef8-4da7-998a-b9af29258fb2 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:00.831985 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-be59630f-5ef8-4da7-998a-b9af29258fb2 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: fa9dfd3a-a636-48ce-ae15-0ed51baee954] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:00.846777 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-be59630f-5ef8-4da7-998a-b9af29258fb2 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:00.847304 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-be59630f-5ef8-4da7-998a-b9af29258fb2 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:00.847750 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-be59630f-5ef8-4da7-998a-b9af29258fb2 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:00.848459 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-be59630f-5ef8-4da7-998a-b9af29258fb2 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:00.848914 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-be59630f-5ef8-4da7-998a-b9af29258fb2 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:00.849343 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-be59630f-5ef8-4da7-998a-b9af29258fb2 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:00.990258 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-abeb4be1-7caf-4e26-83d7-0f28377f8e0a tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:01.020288 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-abeb4be1-7caf-4e26-83d7-0f28377f8e0a tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:01.038974 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-abeb4be1-7caf-4e26-83d7-0f28377f8e0a tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:01.041449 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-abeb4be1-7caf-4e26-83d7-0f28377f8e0a tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] 10.222.0.58 "GET /compute/v2.1/servers/7e091da3-0636-4cba-b8de-94fdeecf0b7f" status: 200 len: 1875 microversion: 2.32 time: 1.066859 Aug 10 23:19:01.042382 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2160/4517] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:18:59 2022] GET /compute/v2.1/servers/7e091da3-0636-4cba-b8de-94fdeecf0b7f => generated 1875 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 23:19:01.060593 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-174cc1eb-a783-4034-ae6f-e5790d0531f3 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:01.072878 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-174cc1eb-a783-4034-ae6f-e5790d0531f3 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] [instance: 69c4b403-a8ad-449c-a577-63837a6d2445] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:01.343220 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-be59630f-5ef8-4da7-998a-b9af29258fb2 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:01.371065 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-be59630f-5ef8-4da7-998a-b9af29258fb2 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954" status: 200 len: 1663 microversion: 2.1 time: 0.527879 Aug 10 23:19:01.373893 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2358/4518] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:00 2022] GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954 => generated 1663 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:19:01.381614 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-eef75cbd-6159-4302-94b0-d7934ef53c3b tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:01.382486 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-eef75cbd-6159-4302-94b0-d7934ef53c3b tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: 641b3607-8ef3-4e41-ab75-28a6ab178750] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:01.392126 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-eef75cbd-6159-4302-94b0-d7934ef53c3b tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:01.393027 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-eef75cbd-6159-4302-94b0-d7934ef53c3b tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:01.393806 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-eef75cbd-6159-4302-94b0-d7934ef53c3b tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:01.395693 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-eef75cbd-6159-4302-94b0-d7934ef53c3b tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:01.396905 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-eef75cbd-6159-4302-94b0-d7934ef53c3b tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:01.398511 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-eef75cbd-6159-4302-94b0-d7934ef53c3b tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:01.464447 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-174cc1eb-a783-4034-ae6f-e5790d0531f3 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5899b2ad9f1046caaf7c6073e408eeee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25abd63376614081a9d484f3c9ae950d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:01.482331 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-174cc1eb-a783-4034-ae6f-e5790d0531f3 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "GET /compute/v2.1/servers/69c4b403-a8ad-449c-a577-63837a6d2445" status: 200 len: 1267 microversion: 2.1 time: 0.436685 Aug 10 23:19:01.491556 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2161/4519] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:01 2022] GET /compute/v2.1/servers/69c4b403-a8ad-449c-a577-63837a6d2445 => generated 1267 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:19:01.830198 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-738a2172-1175-437b-9f33-9e5349d120ed tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:01.833836 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-738a2172-1175-437b-9f33-9e5349d120ed tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] [instance: 3ecbcf63-5592-4074-a3f7-d2caf3c58969] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:01.864609 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-738a2172-1175-437b-9f33-9e5349d120ed tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:01.870465 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-738a2172-1175-437b-9f33-9e5349d120ed tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:01.875595 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-738a2172-1175-437b-9f33-9e5349d120ed tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:01.891837 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-738a2172-1175-437b-9f33-9e5349d120ed tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:01.892147 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-738a2172-1175-437b-9f33-9e5349d120ed tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:01.896083 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-738a2172-1175-437b-9f33-9e5349d120ed tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:02.036163 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-738a2172-1175-437b-9f33-9e5349d120ed tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] 10.222.0.58 "GET /compute/v2.1/servers/3ecbcf63-5592-4074-a3f7-d2caf3c58969/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.210191 Aug 10 23:19:02.044906 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2162/4520] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 10 23:19:01 2022] GET /compute/v2.1/servers/3ecbcf63-5592-4074-a3f7-d2caf3c58969/os-volume_attachments => generated 197 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:19:02.068702 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-cff2fb22-c927-44bb-b509-7ba5011d2a4b tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:02.069897 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-cff2fb22-c927-44bb-b509-7ba5011d2a4b tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] [instance: 7e091da3-0636-4cba-b8de-94fdeecf0b7f] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:02.086639 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cff2fb22-c927-44bb-b509-7ba5011d2a4b tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:02.087873 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cff2fb22-c927-44bb-b509-7ba5011d2a4b tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:02.090763 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cff2fb22-c927-44bb-b509-7ba5011d2a4b tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:02.091932 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cff2fb22-c927-44bb-b509-7ba5011d2a4b tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:02.095175 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cff2fb22-c927-44bb-b509-7ba5011d2a4b tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:02.095968 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cff2fb22-c927-44bb-b509-7ba5011d2a4b tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:02.248835 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-eef75cbd-6159-4302-94b0-d7934ef53c3b tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6684f0c87e4242be9e0ffb4ef1973f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0582ace9e4443b8ad88915503ee630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:02.262952 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-eef75cbd-6159-4302-94b0-d7934ef53c3b tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "GET /compute/v2.1/servers/641b3607-8ef3-4e41-ab75-28a6ab178750" status: 200 len: 1320 microversion: 2.1 time: 0.887573 Aug 10 23:19:02.264556 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2359/4521] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:01 2022] GET /compute/v2.1/servers/641b3607-8ef3-4e41-ab75-28a6ab178750 => generated 1320 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:19:02.395219 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-46181e32-a6d5-495d-b151-941ce2dcd646 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:02.396536 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-46181e32-a6d5-495d-b151-941ce2dcd646 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: fa9dfd3a-a636-48ce-ae15-0ed51baee954] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:02.405223 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-46181e32-a6d5-495d-b151-941ce2dcd646 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:02.413317 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-46181e32-a6d5-495d-b151-941ce2dcd646 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:02.420443 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-46181e32-a6d5-495d-b151-941ce2dcd646 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:02.424225 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-46181e32-a6d5-495d-b151-941ce2dcd646 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:02.430283 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-46181e32-a6d5-495d-b151-941ce2dcd646 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:02.431575 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-46181e32-a6d5-495d-b151-941ce2dcd646 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:02.813054 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-cff2fb22-c927-44bb-b509-7ba5011d2a4b tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:02.841154 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-cff2fb22-c927-44bb-b509-7ba5011d2a4b tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:02.844502 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-cff2fb22-c927-44bb-b509-7ba5011d2a4b tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:02.853503 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-cff2fb22-c927-44bb-b509-7ba5011d2a4b tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] 10.222.0.58 "GET /compute/v2.1/servers/7e091da3-0636-4cba-b8de-94fdeecf0b7f" status: 200 len: 1875 microversion: 2.32 time: 0.788774 Aug 10 23:19:02.856158 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2163/4522] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:19:02 2022] GET /compute/v2.1/servers/7e091da3-0636-4cba-b8de-94fdeecf0b7f => generated 1875 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 23:19:02.866320 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-b9f10d04-e4af-4b56-9037-d1c5185ff6f6 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:02.866775 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-b9f10d04-e4af-4b56-9037-d1c5185ff6f6 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] [instance: 69c4b403-a8ad-449c-a577-63837a6d2445] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:02.892588 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b9f10d04-e4af-4b56-9037-d1c5185ff6f6 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:02.904271 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b9f10d04-e4af-4b56-9037-d1c5185ff6f6 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:02.904908 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b9f10d04-e4af-4b56-9037-d1c5185ff6f6 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:02.905849 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b9f10d04-e4af-4b56-9037-d1c5185ff6f6 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:02.906440 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b9f10d04-e4af-4b56-9037-d1c5185ff6f6 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:02.915353 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b9f10d04-e4af-4b56-9037-d1c5185ff6f6 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:03.121904 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-b9f10d04-e4af-4b56-9037-d1c5185ff6f6 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5899b2ad9f1046caaf7c6073e408eeee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25abd63376614081a9d484f3c9ae950d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:03.132063 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-b9f10d04-e4af-4b56-9037-d1c5185ff6f6 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "GET /compute/v2.1/servers/69c4b403-a8ad-449c-a577-63837a6d2445" status: 200 len: 1319 microversion: 2.1 time: 0.272379 Aug 10 23:19:03.139131 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2164/4523] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:02 2022] GET /compute/v2.1/servers/69c4b403-a8ad-449c-a577-63837a6d2445 => generated 1319 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:19:03.144439 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-a1358949-f37b-4ab7-8885-3bd737cb2e41 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:03.153664 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-a1358949-f37b-4ab7-8885-3bd737cb2e41 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] [instance: 3ecbcf63-5592-4074-a3f7-d2caf3c58969] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:03.168517 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a1358949-f37b-4ab7-8885-3bd737cb2e41 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:03.171381 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a1358949-f37b-4ab7-8885-3bd737cb2e41 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:03.172086 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a1358949-f37b-4ab7-8885-3bd737cb2e41 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:03.177172 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a1358949-f37b-4ab7-8885-3bd737cb2e41 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:03.178434 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a1358949-f37b-4ab7-8885-3bd737cb2e41 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:03.179211 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a1358949-f37b-4ab7-8885-3bd737cb2e41 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:03.303556 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-a1358949-f37b-4ab7-8885-3bd737cb2e41 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] 10.222.0.58 "GET /compute/v2.1/servers/3ecbcf63-5592-4074-a3f7-d2caf3c58969/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.162863 Aug 10 23:19:03.307763 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2165/4524] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 10 23:19:03 2022] GET /compute/v2.1/servers/3ecbcf63-5592-4074-a3f7-d2caf3c58969/os-volume_attachments => generated 197 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:19:03.321838 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-f89f5b08-491d-4686-9f31-7f051d5beed0 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:03.328889 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-f89f5b08-491d-4686-9f31-7f051d5beed0 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: 641b3607-8ef3-4e41-ab75-28a6ab178750] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:03.350172 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f89f5b08-491d-4686-9f31-7f051d5beed0 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:03.351226 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f89f5b08-491d-4686-9f31-7f051d5beed0 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:03.353380 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-46181e32-a6d5-495d-b151-941ce2dcd646 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:03.353570 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f89f5b08-491d-4686-9f31-7f051d5beed0 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:03.354211 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f89f5b08-491d-4686-9f31-7f051d5beed0 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:03.354682 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f89f5b08-491d-4686-9f31-7f051d5beed0 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:03.355153 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f89f5b08-491d-4686-9f31-7f051d5beed0 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:03.372848 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-46181e32-a6d5-495d-b151-941ce2dcd646 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954" status: 200 len: 1663 microversion: 2.1 time: 0.981733 Aug 10 23:19:03.394944 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2360/4525] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:02 2022] GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954 => generated 1663 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:19:03.887902 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-aade61c4-4138-461c-aa95-3b17f9bf4790 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:03.889299 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-aade61c4-4138-461c-aa95-3b17f9bf4790 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] [instance: 7e091da3-0636-4cba-b8de-94fdeecf0b7f] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:03.889475 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-f89f5b08-491d-4686-9f31-7f051d5beed0 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6684f0c87e4242be9e0ffb4ef1973f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0582ace9e4443b8ad88915503ee630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:03.898190 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-aade61c4-4138-461c-aa95-3b17f9bf4790 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:03.899505 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-aade61c4-4138-461c-aa95-3b17f9bf4790 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:03.899751 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-f89f5b08-491d-4686-9f31-7f051d5beed0 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "GET /compute/v2.1/servers/641b3607-8ef3-4e41-ab75-28a6ab178750" status: 200 len: 1320 microversion: 2.1 time: 0.589999 Aug 10 23:19:03.900347 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2166/4526] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:03 2022] GET /compute/v2.1/servers/641b3607-8ef3-4e41-ab75-28a6ab178750 => generated 1320 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:19:03.914763 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-aade61c4-4138-461c-aa95-3b17f9bf4790 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:03.916825 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-aade61c4-4138-461c-aa95-3b17f9bf4790 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:03.917341 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-aade61c4-4138-461c-aa95-3b17f9bf4790 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:03.917795 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-aade61c4-4138-461c-aa95-3b17f9bf4790 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:04.155240 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-08e3f6e7-17ce-46c8-ac39-81c40e561c5e tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:04.155857 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-08e3f6e7-17ce-46c8-ac39-81c40e561c5e tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] [instance: 69c4b403-a8ad-449c-a577-63837a6d2445] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:04.175236 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-08e3f6e7-17ce-46c8-ac39-81c40e561c5e tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:04.175966 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-08e3f6e7-17ce-46c8-ac39-81c40e561c5e tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:04.176618 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-08e3f6e7-17ce-46c8-ac39-81c40e561c5e tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:04.177747 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-08e3f6e7-17ce-46c8-ac39-81c40e561c5e tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:04.178536 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-08e3f6e7-17ce-46c8-ac39-81c40e561c5e tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:04.179203 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-08e3f6e7-17ce-46c8-ac39-81c40e561c5e tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:04.291365 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-aade61c4-4138-461c-aa95-3b17f9bf4790 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:04.301845 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-08e3f6e7-17ce-46c8-ac39-81c40e561c5e tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5899b2ad9f1046caaf7c6073e408eeee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25abd63376614081a9d484f3c9ae950d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:04.303681 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-aade61c4-4138-461c-aa95-3b17f9bf4790 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:04.306274 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-aade61c4-4138-461c-aa95-3b17f9bf4790 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:04.307783 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-aade61c4-4138-461c-aa95-3b17f9bf4790 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] 10.222.0.58 "GET /compute/v2.1/servers/7e091da3-0636-4cba-b8de-94fdeecf0b7f" status: 200 len: 1875 microversion: 2.32 time: 0.426567 Aug 10 23:19:04.323020 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2361/4527] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:19:03 2022] GET /compute/v2.1/servers/7e091da3-0636-4cba-b8de-94fdeecf0b7f => generated 1875 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 23:19:04.323125 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-08e3f6e7-17ce-46c8-ac39-81c40e561c5e tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "GET /compute/v2.1/servers/69c4b403-a8ad-449c-a577-63837a6d2445" status: 200 len: 1325 microversion: 2.1 time: 0.168696 Aug 10 23:19:04.323125 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2167/4528] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:04 2022] GET /compute/v2.1/servers/69c4b403-a8ad-449c-a577-63837a6d2445 => generated 1325 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:19:04.332769 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-d25f7166-f694-4860-8552-c4a742a8c704 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:04.337347 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-d25f7166-f694-4860-8552-c4a742a8c704 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] [instance: 3ecbcf63-5592-4074-a3f7-d2caf3c58969] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:04.355386 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d25f7166-f694-4860-8552-c4a742a8c704 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:04.356545 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d25f7166-f694-4860-8552-c4a742a8c704 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:04.357188 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d25f7166-f694-4860-8552-c4a742a8c704 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:04.358141 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d25f7166-f694-4860-8552-c4a742a8c704 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:04.358818 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d25f7166-f694-4860-8552-c4a742a8c704 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:04.359464 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d25f7166-f694-4860-8552-c4a742a8c704 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:04.394435 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-d25f7166-f694-4860-8552-c4a742a8c704 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] 10.222.0.58 "GET /compute/v2.1/servers/3ecbcf63-5592-4074-a3f7-d2caf3c58969/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077305 Aug 10 23:19:04.395455 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2362/4529] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 10 23:19:04 2022] GET /compute/v2.1/servers/3ecbcf63-5592-4074-a3f7-d2caf3c58969/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:19:04.399560 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-7d213abf-ddff-4866-983a-31496ae0d829 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:04.400177 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-7d213abf-ddff-4866-983a-31496ae0d829 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: fa9dfd3a-a636-48ce-ae15-0ed51baee954] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:04.419363 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7d213abf-ddff-4866-983a-31496ae0d829 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:04.419986 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7d213abf-ddff-4866-983a-31496ae0d829 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:04.420642 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7d213abf-ddff-4866-983a-31496ae0d829 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:04.421567 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7d213abf-ddff-4866-983a-31496ae0d829 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:04.422311 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7d213abf-ddff-4866-983a-31496ae0d829 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:04.422752 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7d213abf-ddff-4866-983a-31496ae0d829 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:05.027070 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-5f6b0c92-32a7-4f04-ad5b-28c1d509cb75 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Action: 'create', calling method: .version_select at 0x7f847c476550>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-295433155", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLoVQOkwlSFcEzednwTHhKpRgEgQCv271w03iBOWNss60sWZpUwKfCXkJyBYsMF87AaoLWfS/OSohrHpgssmYpt6nYnTTxRJ1wh7Swpy9Vazg7m2AgI0/BP51Et4xmugoA=="}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:19:05.049761 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-5f6b0c92-32a7-4f04-ad5b-28c1d509cb75 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Getting quotas for project 2cb5f5856c46490ab1ded572d693c4cc. Resources: {'key_pairs'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:19:05.057011 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-7d213abf-ddff-4866-983a-31496ae0d829 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:05.057568 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-5f6b0c92-32a7-4f04-ad5b-28c1d509cb75 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Getting quotas for user 627b163f1a0e4fdeb0e9692e7d37460d and project 2cb5f5856c46490ab1ded572d693c4cc. Resources: {'key_pairs'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:19:05.065195 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-7d213abf-ddff-4866-983a-31496ae0d829 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954" status: 200 len: 1667 microversion: 2.1 time: 0.669701 Aug 10 23:19:05.074941 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2168/4530] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:04 2022] GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954 => generated 1667 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:19:05.090623 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-1b91dbdb-2a86-44a6-98fe-0cdaadfe1228 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:05.093920 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-1b91dbdb-2a86-44a6-98fe-0cdaadfe1228 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: 641b3607-8ef3-4e41-ab75-28a6ab178750] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:05.110880 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1b91dbdb-2a86-44a6-98fe-0cdaadfe1228 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:05.111401 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1b91dbdb-2a86-44a6-98fe-0cdaadfe1228 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:05.111826 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1b91dbdb-2a86-44a6-98fe-0cdaadfe1228 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:05.112545 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1b91dbdb-2a86-44a6-98fe-0cdaadfe1228 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:05.113004 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1b91dbdb-2a86-44a6-98fe-0cdaadfe1228 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:05.113436 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1b91dbdb-2a86-44a6-98fe-0cdaadfe1228 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:05.116809 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-5f6b0c92-32a7-4f04-ad5b-28c1d509cb75 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.410715 Aug 10 23:19:05.118665 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2363/4531] 10.222.0.58 () {60 vars in 1159 bytes} [Wed Aug 10 23:19:04 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:19:05.124580 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-406fd048-1bcf-42c4-84ce-06098321ef52 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:05.125401 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-406fd048-1bcf-42c4-84ce-06098321ef52 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: fa9dfd3a-a636-48ce-ae15-0ed51baee954] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:05.133248 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-406fd048-1bcf-42c4-84ce-06098321ef52 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:05.134031 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-406fd048-1bcf-42c4-84ce-06098321ef52 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:05.134650 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-406fd048-1bcf-42c4-84ce-06098321ef52 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:05.135601 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-406fd048-1bcf-42c4-84ce-06098321ef52 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:05.136444 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-406fd048-1bcf-42c4-84ce-06098321ef52 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:05.137205 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-406fd048-1bcf-42c4-84ce-06098321ef52 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:05.526347 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-1b91dbdb-2a86-44a6-98fe-0cdaadfe1228 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6684f0c87e4242be9e0ffb4ef1973f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0582ace9e4443b8ad88915503ee630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:05.546499 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-406fd048-1bcf-42c4-84ce-06098321ef52 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:05.574851 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-1b91dbdb-2a86-44a6-98fe-0cdaadfe1228 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "GET /compute/v2.1/servers/641b3607-8ef3-4e41-ab75-28a6ab178750" status: 200 len: 1320 microversion: 2.1 time: 0.498674 Aug 10 23:19:05.578696 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-406fd048-1bcf-42c4-84ce-06098321ef52 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954" status: 200 len: 1667 microversion: 2.1 time: 0.458117 Aug 10 23:19:05.581312 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2364/4532] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:05 2022] GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954 => generated 1667 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:19:05.596315 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2169/4533] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:05 2022] GET /compute/v2.1/servers/641b3607-8ef3-4e41-ab75-28a6ab178750 => generated 1320 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:19:05.607739 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-33c9b5de-0f25-4785-aae8-5c04d21a7726 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:05.607950 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-e8400f33-64b2-41a7-8029-df34576dd88e tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:05.608480 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-e8400f33-64b2-41a7-8029-df34576dd88e tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] [instance: 7e091da3-0636-4cba-b8de-94fdeecf0b7f] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:05.609557 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-33c9b5de-0f25-4785-aae8-5c04d21a7726 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] [instance: 69c4b403-a8ad-449c-a577-63837a6d2445] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:05.618599 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-33c9b5de-0f25-4785-aae8-5c04d21a7726 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:05.619659 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-33c9b5de-0f25-4785-aae8-5c04d21a7726 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:05.621239 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-33c9b5de-0f25-4785-aae8-5c04d21a7726 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:05.623211 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-33c9b5de-0f25-4785-aae8-5c04d21a7726 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:05.624497 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-33c9b5de-0f25-4785-aae8-5c04d21a7726 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:05.627959 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-33c9b5de-0f25-4785-aae8-5c04d21a7726 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:05.628470 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e8400f33-64b2-41a7-8029-df34576dd88e tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:05.628981 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e8400f33-64b2-41a7-8029-df34576dd88e tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:05.629419 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e8400f33-64b2-41a7-8029-df34576dd88e tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:05.630134 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e8400f33-64b2-41a7-8029-df34576dd88e tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:05.630585 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e8400f33-64b2-41a7-8029-df34576dd88e tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:05.631043 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e8400f33-64b2-41a7-8029-df34576dd88e tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:06.006186 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-33c9b5de-0f25-4785-aae8-5c04d21a7726 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5899b2ad9f1046caaf7c6073e408eeee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25abd63376614081a9d484f3c9ae950d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:06.020172 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-33c9b5de-0f25-4785-aae8-5c04d21a7726 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "GET /compute/v2.1/servers/69c4b403-a8ad-449c-a577-63837a6d2445" status: 200 len: 1393 microversion: 2.1 time: 0.421979 Aug 10 23:19:06.021800 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2170/4534] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:05 2022] GET /compute/v2.1/servers/69c4b403-a8ad-449c-a577-63837a6d2445 => generated 1393 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:19:06.049259 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-046ca753-1baf-4808-a6df-2b8233d6a2c3 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:06.059539 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-046ca753-1baf-4808-a6df-2b8233d6a2c3 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] [instance: 3ecbcf63-5592-4074-a3f7-d2caf3c58969] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:06.071851 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-046ca753-1baf-4808-a6df-2b8233d6a2c3 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:06.073445 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-046ca753-1baf-4808-a6df-2b8233d6a2c3 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:06.074900 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-046ca753-1baf-4808-a6df-2b8233d6a2c3 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:06.075914 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-046ca753-1baf-4808-a6df-2b8233d6a2c3 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:06.076537 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-046ca753-1baf-4808-a6df-2b8233d6a2c3 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:06.077123 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-046ca753-1baf-4808-a6df-2b8233d6a2c3 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:06.114177 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-046ca753-1baf-4808-a6df-2b8233d6a2c3 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] 10.222.0.58 "GET /compute/v2.1/servers/3ecbcf63-5592-4074-a3f7-d2caf3c58969/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.090630 Aug 10 23:19:06.115403 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2171/4535] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 10 23:19:06 2022] GET /compute/v2.1/servers/3ecbcf63-5592-4074-a3f7-d2caf3c58969/os-volume_attachments => generated 25 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 23:19:06.121369 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-02abc041-ec8e-4d3c-b4b1-29eafcc8b8c7 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:06.122194 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-02abc041-ec8e-4d3c-b4b1-29eafcc8b8c7 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: fa9dfd3a-a636-48ce-ae15-0ed51baee954] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:06.130751 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-02abc041-ec8e-4d3c-b4b1-29eafcc8b8c7 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:06.131436 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-02abc041-ec8e-4d3c-b4b1-29eafcc8b8c7 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:06.132057 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-02abc041-ec8e-4d3c-b4b1-29eafcc8b8c7 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:06.133005 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-02abc041-ec8e-4d3c-b4b1-29eafcc8b8c7 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:06.133740 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-02abc041-ec8e-4d3c-b4b1-29eafcc8b8c7 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:06.134834 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-02abc041-ec8e-4d3c-b4b1-29eafcc8b8c7 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:06.398291 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-02abc041-ec8e-4d3c-b4b1-29eafcc8b8c7 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:06.402633 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=100 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:19:06.407524 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-02abc041-ec8e-4d3c-b4b1-29eafcc8b8c7 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954" status: 200 len: 1667 microversion: 2.1 time: 0.290692 Aug 10 23:19:06.412094 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2172/4536] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:06 2022] GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954 => generated 1667 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:19:06.420355 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-3fbf572e-54c4-4ba5-a8f3-cd10d4762030 req-2f23068c-8bea-42a9-8a1d-31177a4aa847 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "641b3607-8ef3-4e41-ab75-28a6ab178750", "name": "network-vif-plugged", "status": "completed", "tag": "22688e12-f8a6-47d7-8f54-3618c6749884"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:19:06.453469 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-3fbf572e-54c4-4ba5-a8f3-cd10d4762030 req-2f23068c-8bea-42a9-8a1d-31177a4aa847 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:06.454384 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-3fbf572e-54c4-4ba5-a8f3-cd10d4762030 req-2f23068c-8bea-42a9-8a1d-31177a4aa847 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:06.455173 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-3fbf572e-54c4-4ba5-a8f3-cd10d4762030 req-2f23068c-8bea-42a9-8a1d-31177a4aa847 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:06.471707 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-3fbf572e-54c4-4ba5-a8f3-cd10d4762030 req-2f23068c-8bea-42a9-8a1d-31177a4aa847 service nova] Creating event network-vif-plugged:22688e12-f8a6-47d7-8f54-3618c6749884 for instance 641b3607-8ef3-4e41-ab75-28a6ab178750 on n-h2-850468-14 Aug 10 23:19:06.483382 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-3fbf572e-54c4-4ba5-a8f3-cd10d4762030 req-2f23068c-8bea-42a9-8a1d-31177a4aa847 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066524 Aug 10 23:19:06.484571 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2173/4537] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:19:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:19:06.491390 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-707bc840-669f-45b2-b5e1-74de4344a43d tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:19:06.494377 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-707bc840-669f-45b2-b5e1-74de4344a43d tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] [instance: 7df225be-2dbc-4ef6-aeec-9a3de33a0006] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:06.501333 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-707bc840-669f-45b2-b5e1-74de4344a43d tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:06.502096 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-707bc840-669f-45b2-b5e1-74de4344a43d tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:06.502769 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-707bc840-669f-45b2-b5e1-74de4344a43d tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:06.503807 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-707bc840-669f-45b2-b5e1-74de4344a43d tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:06.504627 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-707bc840-669f-45b2-b5e1-74de4344a43d tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:06.505292 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-707bc840-669f-45b2-b5e1-74de4344a43d tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:06.506606 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-e8400f33-64b2-41a7-8029-df34576dd88e tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:06.542656 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-e8400f33-64b2-41a7-8029-df34576dd88e tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:06.546512 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-e8400f33-64b2-41a7-8029-df34576dd88e tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:06.548047 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-e8400f33-64b2-41a7-8029-df34576dd88e tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] 10.222.0.58 "GET /compute/v2.1/servers/7e091da3-0636-4cba-b8de-94fdeecf0b7f" status: 200 len: 1875 microversion: 2.32 time: 0.966102 Aug 10 23:19:06.548793 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2365/4538] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:19:05 2022] GET /compute/v2.1/servers/7e091da3-0636-4cba-b8de-94fdeecf0b7f => generated 1875 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:19:06.555988 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-ac3f6cef-fd39-476c-b09d-bd7bdba3af88 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:06.556869 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-ac3f6cef-fd39-476c-b09d-bd7bdba3af88 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: fa9dfd3a-a636-48ce-ae15-0ed51baee954] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:06.563427 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-707bc840-669f-45b2-b5e1-74de4344a43d tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] HTTP exception thrown: Cannot 'reboot' instance 7df225be-2dbc-4ef6-aeec-9a3de33a0006 while it is in vm_state rescued Aug 10 23:19:06.565812 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-707bc840-669f-45b2-b5e1-74de4344a43d tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Request method failure captured: Aug 10 23:19:06.565812 n-d-850468-14 devstack@n-api.service[122632]: request: POST /compute/v2.1/servers/7df225be-2dbc-4ef6-aeec-9a3de33a0006/action HTTP/1.1 Aug 10 23:19:06.565812 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:19:06.565812 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:19:06.565812 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:19:06.565812 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 28 Aug 10 23:19:06.565812 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:19:06.565812 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:19:06.565812 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:19:06.565812 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:19:06.565812 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9DvG6mPOp_bU6YQakEzMuJf91N1YrPRgIEe5ouB8tWtrXuOeLQgeJ0ouDTrtP31JIWcz1wQJ17PTz3JUAbF_FaF35I1F09nIb2lkQ0GhE880fsA2K13MCP_yKxqm-kv_hQLiQB8UzdyMBwb04C68j2QYpbobWhHyceARqBEeITDqyg0 Aug 10 23:19:06.565812 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:19:06.565812 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:19:06.565812 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:19:06.565812 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:19:06.565812 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:19:06.565812 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:19:06.565812 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 395d7c4077e54c43bb95288db3942b0a Aug 10 23:19:06.565812 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1029565464 Aug 10 23:19:06.565812 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:19:06.565812 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:19:06.565812 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/395d7c4077e54c43bb95288db3942b0a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/395d7c4077e54c43bb95288db3942b0a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/395d7c4077e54c43bb95288db3942b0a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_395d7c4077e54c43bb95288db3942b0a", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:19:06.565812 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1029565464 Aug 10 23:19:06.565812 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 395d7c4077e54c43bb95288db3942b0a Aug 10 23:19:06.565812 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1029565464 Aug 10 23:19:06.565812 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-ServerRescueNegativeTestJSON-1029565464-project Aug 10 23:19:06.565812 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:19:06.565812 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:19:06.565812 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: f07c94ebf0954cdea12b9a689538d96d Aug 10 23:19:06.565812 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1029565464-project Aug 10 23:19:06.565812 n-d-850468-14 devstack@n-api.service[122632]: Aug 10 23:19:06.565812 n-d-850468-14 devstack@n-api.service[122632]: {"reboot": {"type": "HARD"}} Aug 10 23:19:06.565812 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:19:06.565812 n-d-850468-14 devstack@n-api.service[122632]: exception: Cannot 'reboot' instance 7df225be-2dbc-4ef6-aeec-9a3de33a0006 while it is in vm_state rescued Aug 10 23:19:06.565812 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': '7df225be-2dbc-4ef6-aeec-9a3de33a0006', 'body': {'reboot': {'type': 'HARD'}}} Aug 10 23:19:06.565812 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:19:06.565812 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:19:06.565812 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot Aug 10 23:19:06.565812 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) Aug 10 23:19:06.565812 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 10 23:19:06.565812 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 10 23:19:06.565812 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3499, in reboot Aug 10 23:19:06.565812 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) Aug 10 23:19:06.565812 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 10 23:19:06.565812 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 10 23:19:06.565812 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 7df225be-2dbc-4ef6-aeec-9a3de33a0006 in vm_state rescued. Cannot _hard_reboot while the instance is in this state. Aug 10 23:19:06.565812 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:19:06.565812 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:19:06.565812 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:19:06.565812 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:19:06.565812 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:19:06.565812 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:19:06.565812 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:19:06.565812 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:19:06.565812 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:19:06.565812 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:19:06.565812 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 23:19:06.565812 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 23:19:06.565812 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot Aug 10 23:19:06.565812 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 10 23:19:06.565812 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 10 23:19:06.565812 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 10 23:19:06.571287 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance 7df225be-2dbc-4ef6-aeec-9a3de33a0006 while it is in vm_state rescued Aug 10 23:19:06.571287 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:19:06.571287 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:19:06.571287 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:19:06.571287 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:19:06.571287 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:19:06.571287 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:19:06.571287 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:19:06.571287 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:19:06.571287 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance 7df225be-2dbc-4ef6-aeec-9a3de33a0006 while it is in vm_state rescued Aug 10 23:19:06.571287 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:19:06.575270 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-707bc840-669f-45b2-b5e1-74de4344a43d tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Returning 409 to user: Cannot 'reboot' instance 7df225be-2dbc-4ef6-aeec-9a3de33a0006 while it is in vm_state rescued {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:19:06.578456 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-707bc840-669f-45b2-b5e1-74de4344a43d tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] 10.222.0.58 "POST /compute/v2.1/servers/7df225be-2dbc-4ef6-aeec-9a3de33a0006/action" status: 409 len: 145 microversion: 2.1 time: 0.092452 Aug 10 23:19:06.579104 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2174/4539] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:19:06 2022] POST /compute/v2.1/servers/7df225be-2dbc-4ef6-aeec-9a3de33a0006/action => generated 145 bytes in 94 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 10 23:19:06.580267 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ac3f6cef-fd39-476c-b09d-bd7bdba3af88 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:06.583693 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ac3f6cef-fd39-476c-b09d-bd7bdba3af88 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:06.584230 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ac3f6cef-fd39-476c-b09d-bd7bdba3af88 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:06.587948 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ac3f6cef-fd39-476c-b09d-bd7bdba3af88 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:06.589382 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ac3f6cef-fd39-476c-b09d-bd7bdba3af88 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:06.589916 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ac3f6cef-fd39-476c-b09d-bd7bdba3af88 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:06.591793 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-823a3970-3beb-461d-bcf6-e18f776e36f0 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:19:06.598042 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-823a3970-3beb-461d-bcf6-e18f776e36f0 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] [instance: 7df225be-2dbc-4ef6-aeec-9a3de33a0006] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:06.614279 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-823a3970-3beb-461d-bcf6-e18f776e36f0 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:06.615001 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-823a3970-3beb-461d-bcf6-e18f776e36f0 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:06.616833 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-823a3970-3beb-461d-bcf6-e18f776e36f0 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:06.619437 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-823a3970-3beb-461d-bcf6-e18f776e36f0 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:06.620134 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-823a3970-3beb-461d-bcf6-e18f776e36f0 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:06.623384 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-823a3970-3beb-461d-bcf6-e18f776e36f0 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:06.667379 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-823a3970-3beb-461d-bcf6-e18f776e36f0 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] HTTP exception thrown: Cannot 'rebuild' instance 7df225be-2dbc-4ef6-aeec-9a3de33a0006 while it is in vm_state rescued Aug 10 23:19:06.669613 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-823a3970-3beb-461d-bcf6-e18f776e36f0 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Request method failure captured: Aug 10 23:19:06.669613 n-d-850468-14 devstack@n-api.service[122632]: request: POST /compute/v2.1/servers/7df225be-2dbc-4ef6-aeec-9a3de33a0006/action HTTP/1.1 Aug 10 23:19:06.669613 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:19:06.669613 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:19:06.669613 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:19:06.669613 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 65 Aug 10 23:19:06.669613 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:19:06.669613 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:19:06.669613 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:19:06.669613 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:19:06.669613 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9DvG6mPOp_bU6YQakEzMuJf91N1YrPRgIEe5ouB8tWtrXuOeLQgeJ0ouDTrtP31JIWcz1wQJ17PTz3JUAbF_FaF35I1F09nIb2lkQ0GhE880fsA2K13MCP_yKxqm-kv_hQLiQB8UzdyMBwb04C68j2QYpbobWhHyceARqBEeITDqyg0 Aug 10 23:19:06.669613 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:19:06.669613 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:19:06.669613 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:19:06.669613 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:19:06.669613 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:19:06.669613 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:19:06.669613 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 395d7c4077e54c43bb95288db3942b0a Aug 10 23:19:06.669613 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1029565464 Aug 10 23:19:06.669613 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:19:06.669613 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:19:06.669613 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/395d7c4077e54c43bb95288db3942b0a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/395d7c4077e54c43bb95288db3942b0a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/395d7c4077e54c43bb95288db3942b0a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_395d7c4077e54c43bb95288db3942b0a", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:19:06.669613 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1029565464 Aug 10 23:19:06.669613 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 395d7c4077e54c43bb95288db3942b0a Aug 10 23:19:06.669613 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1029565464 Aug 10 23:19:06.669613 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-ServerRescueNegativeTestJSON-1029565464-project Aug 10 23:19:06.669613 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:19:06.669613 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:19:06.669613 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: f07c94ebf0954cdea12b9a689538d96d Aug 10 23:19:06.669613 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1029565464-project Aug 10 23:19:06.669613 n-d-850468-14 devstack@n-api.service[122632]: Aug 10 23:19:06.669613 n-d-850468-14 devstack@n-api.service[122632]: {"rebuild": {"imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed"}} Aug 10 23:19:06.669613 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:19:06.669613 n-d-850468-14 devstack@n-api.service[122632]: exception: Cannot 'rebuild' instance 7df225be-2dbc-4ef6-aeec-9a3de33a0006 while it is in vm_state rescued Aug 10 23:19:06.669613 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': '7df225be-2dbc-4ef6-aeec-9a3de33a0006', 'body': {'rebuild': {'imageRef': '78ad8905-f66f-4733-8be9-2b260f1fabed'}}} Aug 10 23:19:06.669613 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:19:06.669613 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:19:06.669613 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1220, in _action_rebuild Aug 10 23:19:06.669613 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, Aug 10 23:19:06.669613 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Aug 10 23:19:06.669613 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 10 23:19:06.669613 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Aug 10 23:19:06.669613 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 10 23:19:06.669613 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 10 23:19:06.669613 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 10 23:19:06.669613 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 10 23:19:06.669613 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 10 23:19:06.669613 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 7df225be-2dbc-4ef6-aeec-9a3de33a0006 in vm_state rescued. Cannot rebuild while the instance is in this state. Aug 10 23:19:06.669613 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:19:06.669613 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:19:06.669613 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:19:06.669613 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:19:06.669613 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:19:06.669613 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:19:06.669613 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:19:06.669613 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:19:06.669613 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:19:06.669613 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:19:06.669613 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 23:19:06.669613 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 23:19:06.669613 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 23:19:06.669613 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 23:19:06.669613 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 23:19:06.674393 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 23:19:06.674393 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Aug 10 23:19:06.674393 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1228, in _action_rebuild Aug 10 23:19:06.674393 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 10 23:19:06.674393 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 10 23:19:06.674393 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 10 23:19:06.674393 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance 7df225be-2dbc-4ef6-aeec-9a3de33a0006 while it is in vm_state rescued Aug 10 23:19:06.674393 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:19:06.674393 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:19:06.674393 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:19:06.674393 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:19:06.674393 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:19:06.674393 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:19:06.674393 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:19:06.674393 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:19:06.674393 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance 7df225be-2dbc-4ef6-aeec-9a3de33a0006 while it is in vm_state rescued Aug 10 23:19:06.674393 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:19:06.676471 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-823a3970-3beb-461d-bcf6-e18f776e36f0 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Returning 409 to user: Cannot 'rebuild' instance 7df225be-2dbc-4ef6-aeec-9a3de33a0006 while it is in vm_state rescued {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:19:06.677569 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-823a3970-3beb-461d-bcf6-e18f776e36f0 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] 10.222.0.58 "POST /compute/v2.1/servers/7df225be-2dbc-4ef6-aeec-9a3de33a0006/action" status: 409 len: 146 microversion: 2.1 time: 0.091392 Aug 10 23:19:06.678813 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2175/4540] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:19:06 2022] POST /compute/v2.1/servers/7df225be-2dbc-4ef6-aeec-9a3de33a0006/action => generated 146 bytes in 93 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 10 23:19:06.686600 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-a0f74cb2-8075-4b23-9932-1038b0551f45 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:06.687494 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-a0f74cb2-8075-4b23-9932-1038b0551f45 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: 641b3607-8ef3-4e41-ab75-28a6ab178750] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:06.694421 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a0f74cb2-8075-4b23-9932-1038b0551f45 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:06.695390 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a0f74cb2-8075-4b23-9932-1038b0551f45 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:06.696049 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a0f74cb2-8075-4b23-9932-1038b0551f45 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:06.697019 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a0f74cb2-8075-4b23-9932-1038b0551f45 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:06.697703 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a0f74cb2-8075-4b23-9932-1038b0551f45 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:06.698451 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a0f74cb2-8075-4b23-9932-1038b0551f45 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:06.928010 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-a0f74cb2-8075-4b23-9932-1038b0551f45 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6684f0c87e4242be9e0ffb4ef1973f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0582ace9e4443b8ad88915503ee630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:06.941203 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-a0f74cb2-8075-4b23-9932-1038b0551f45 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "GET /compute/v2.1/servers/641b3607-8ef3-4e41-ab75-28a6ab178750" status: 200 len: 1320 microversion: 2.1 time: 0.260158 Aug 10 23:19:06.957181 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2176/4541] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:06 2022] GET /compute/v2.1/servers/641b3607-8ef3-4e41-ab75-28a6ab178750 => generated 1320 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:19:06.994212 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-373c5f65-7b9d-48b5-8173-44ac70f9cca9 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:06.995248 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-373c5f65-7b9d-48b5-8173-44ac70f9cca9 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] [instance: 3ecbcf63-5592-4074-a3f7-d2caf3c58969] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:06.997858 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-ac3f6cef-fd39-476c-b09d-bd7bdba3af88 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:07.018757 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-ac3f6cef-fd39-476c-b09d-bd7bdba3af88 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954" status: 200 len: 1667 microversion: 2.1 time: 0.468509 Aug 10 23:19:07.031141 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-373c5f65-7b9d-48b5-8173-44ac70f9cca9 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:07.031703 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-373c5f65-7b9d-48b5-8173-44ac70f9cca9 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:07.032036 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2366/4542] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:06 2022] GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954 => generated 1667 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:19:07.032672 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-373c5f65-7b9d-48b5-8173-44ac70f9cca9 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:07.033576 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-373c5f65-7b9d-48b5-8173-44ac70f9cca9 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:07.034335 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-373c5f65-7b9d-48b5-8173-44ac70f9cca9 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:07.034980 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-373c5f65-7b9d-48b5-8173-44ac70f9cca9 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:07.046332 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-adc62d06-86a8-4ce5-9a61-4303b786a160 req-49250b06-9b27-4801-aa68-0e705676050f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69c4b403-a8ad-449c-a577-63837a6d2445", "tag": "8597a359-c6f1-46f8-9a07-e80725a3a36d"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:19:07.067512 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-adc62d06-86a8-4ce5-9a61-4303b786a160 req-49250b06-9b27-4801-aa68-0e705676050f service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:07.068608 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-adc62d06-86a8-4ce5-9a61-4303b786a160 req-49250b06-9b27-4801-aa68-0e705676050f service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:07.069502 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-adc62d06-86a8-4ce5-9a61-4303b786a160 req-49250b06-9b27-4801-aa68-0e705676050f service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:07.079034 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-373c5f65-7b9d-48b5-8173-44ac70f9cca9 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] [instance: 3ecbcf63-5592-4074-a3f7-d2caf3c58969] Going to try to terminate instance {{(pid=122632) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:19:07.091982 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-adc62d06-86a8-4ce5-9a61-4303b786a160 req-49250b06-9b27-4801-aa68-0e705676050f service nova] Creating event network-changed:8597a359-c6f1-46f8-9a07-e80725a3a36d for instance 69c4b403-a8ad-449c-a577-63837a6d2445 on n-h2-850468-14 Aug 10 23:19:07.098505 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-adc62d06-86a8-4ce5-9a61-4303b786a160 req-49250b06-9b27-4801-aa68-0e705676050f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064463 Aug 10 23:19:07.099464 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2367/4543] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:19:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:19:07.105459 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-a9ed9bc1-6cc0-4e14-9559-5c77f2b1396b tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:07.106553 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-a9ed9bc1-6cc0-4e14-9559-5c77f2b1396b tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] [instance: 69c4b403-a8ad-449c-a577-63837a6d2445] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:07.114079 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a9ed9bc1-6cc0-4e14-9559-5c77f2b1396b tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:07.114993 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a9ed9bc1-6cc0-4e14-9559-5c77f2b1396b tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:07.115845 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a9ed9bc1-6cc0-4e14-9559-5c77f2b1396b tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:07.116737 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a9ed9bc1-6cc0-4e14-9559-5c77f2b1396b tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:07.117220 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a9ed9bc1-6cc0-4e14-9559-5c77f2b1396b tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:07.117902 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a9ed9bc1-6cc0-4e14-9559-5c77f2b1396b tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:07.146528 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:19:07.195889 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-373c5f65-7b9d-48b5-8173-44ac70f9cca9 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] 10.222.0.58 "DELETE /compute/v2.1/servers/3ecbcf63-5592-4074-a3f7-d2caf3c58969" status: 204 len: 0 microversion: 2.1 time: 0.235904 Aug 10 23:19:07.200045 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2177/4544] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:19:06 2022] DELETE /compute/v2.1/servers/3ecbcf63-5592-4074-a3f7-d2caf3c58969 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:19:07.203001 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-06b4a38a-1aa2-49f6-933e-f8b88f4fc371 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:07.203700 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-06b4a38a-1aa2-49f6-933e-f8b88f4fc371 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: fa9dfd3a-a636-48ce-ae15-0ed51baee954] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:07.209963 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-06b4a38a-1aa2-49f6-933e-f8b88f4fc371 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:07.210444 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-06b4a38a-1aa2-49f6-933e-f8b88f4fc371 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:07.211330 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-06b4a38a-1aa2-49f6-933e-f8b88f4fc371 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:07.212729 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-06b4a38a-1aa2-49f6-933e-f8b88f4fc371 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:07.213172 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-06b4a38a-1aa2-49f6-933e-f8b88f4fc371 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:07.213597 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-06b4a38a-1aa2-49f6-933e-f8b88f4fc371 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:07.366362 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-06b4a38a-1aa2-49f6-933e-f8b88f4fc371 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:07.374420 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-06b4a38a-1aa2-49f6-933e-f8b88f4fc371 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954" status: 200 len: 1667 microversion: 2.1 time: 0.175928 Aug 10 23:19:07.375041 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2178/4545] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:07 2022] GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954 => generated 1667 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:19:07.379468 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-6914f37c-dfa5-4156-9412-c87850e2e5d0 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:07.380070 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-6914f37c-dfa5-4156-9412-c87850e2e5d0 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] [instance: 3ecbcf63-5592-4074-a3f7-d2caf3c58969] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:07.386931 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6914f37c-dfa5-4156-9412-c87850e2e5d0 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:07.387417 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6914f37c-dfa5-4156-9412-c87850e2e5d0 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:07.387851 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6914f37c-dfa5-4156-9412-c87850e2e5d0 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:07.388547 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6914f37c-dfa5-4156-9412-c87850e2e5d0 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:07.389002 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6914f37c-dfa5-4156-9412-c87850e2e5d0 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:07.389426 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6914f37c-dfa5-4156-9412-c87850e2e5d0 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:07.571836 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-a9ed9bc1-6cc0-4e14-9559-5c77f2b1396b tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5899b2ad9f1046caaf7c6073e408eeee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25abd63376614081a9d484f3c9ae950d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:07.581187 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-a9ed9bc1-6cc0-4e14-9559-5c77f2b1396b tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "GET /compute/v2.1/servers/69c4b403-a8ad-449c-a577-63837a6d2445" status: 200 len: 1393 microversion: 2.1 time: 0.480333 Aug 10 23:19:07.587865 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2368/4546] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:07 2022] GET /compute/v2.1/servers/69c4b403-a8ad-449c-a577-63837a6d2445 => generated 1393 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:19:07.588220 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-2c44066d-62bc-4ddd-8cf6-898e57d4b467 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:19:07.588773 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-2c44066d-62bc-4ddd-8cf6-898e57d4b467 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: fa9dfd3a-a636-48ce-ae15-0ed51baee954] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:07.597848 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2c44066d-62bc-4ddd-8cf6-898e57d4b467 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:07.598499 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2c44066d-62bc-4ddd-8cf6-898e57d4b467 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:07.598976 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2c44066d-62bc-4ddd-8cf6-898e57d4b467 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:07.599697 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2c44066d-62bc-4ddd-8cf6-898e57d4b467 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:07.600497 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2c44066d-62bc-4ddd-8cf6-898e57d4b467 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:07.600941 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2c44066d-62bc-4ddd-8cf6-898e57d4b467 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:07.633857 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.objects.instance [None req-2c44066d-62bc-4ddd-8cf6-898e57d4b467 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lazy-loading 'flavor' on Instance uuid fa9dfd3a-a636-48ce-ae15-0ed51baee954 {{(pid=122633) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:19:07.654394 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-6914f37c-dfa5-4156-9412-c87850e2e5d0 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07c94ebf0954cdea12b9a689538d96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395d7c4077e54c43bb95288db3942b0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:07.664810 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-6914f37c-dfa5-4156-9412-c87850e2e5d0 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] 10.222.0.58 "GET /compute/v2.1/servers/3ecbcf63-5592-4074-a3f7-d2caf3c58969" status: 200 len: 1691 microversion: 2.1 time: 0.288120 Aug 10 23:19:07.665598 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2179/4547] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:07 2022] GET /compute/v2.1/servers/3ecbcf63-5592-4074-a3f7-d2caf3c58969 => generated 1691 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:19:07.690636 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-eea4c30d-af3f-44af-b57b-41b7fdb188b3 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:07.691771 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-eea4c30d-af3f-44af-b57b-41b7fdb188b3 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] [instance: 7e091da3-0636-4cba-b8de-94fdeecf0b7f] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:07.701392 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-eea4c30d-af3f-44af-b57b-41b7fdb188b3 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:07.701902 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-eea4c30d-af3f-44af-b57b-41b7fdb188b3 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:07.702348 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-eea4c30d-af3f-44af-b57b-41b7fdb188b3 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:07.703117 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-eea4c30d-af3f-44af-b57b-41b7fdb188b3 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:07.704041 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-eea4c30d-af3f-44af-b57b-41b7fdb188b3 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:07.704041 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-eea4c30d-af3f-44af-b57b-41b7fdb188b3 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:07.749565 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-2c44066d-62bc-4ddd-8cf6-898e57d4b467 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "POST /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954/action" status: 202 len: 0 microversion: 2.1 time: 0.165406 Aug 10 23:19:07.751507 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2369/4548] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:19:07 2022] POST /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954/action => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:19:07.776437 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c9e1e123-26b4-4ee8-9788-3a5737c97197 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:07.778736 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-c9e1e123-26b4-4ee8-9788-3a5737c97197 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: fa9dfd3a-a636-48ce-ae15-0ed51baee954] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:07.789407 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:19:07.791239 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c9e1e123-26b4-4ee8-9788-3a5737c97197 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:07.792223 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c9e1e123-26b4-4ee8-9788-3a5737c97197 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:07.793035 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c9e1e123-26b4-4ee8-9788-3a5737c97197 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:07.793932 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c9e1e123-26b4-4ee8-9788-3a5737c97197 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:07.798730 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c9e1e123-26b4-4ee8-9788-3a5737c97197 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:07.799564 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c9e1e123-26b4-4ee8-9788-3a5737c97197 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:08.087377 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-eea4c30d-af3f-44af-b57b-41b7fdb188b3 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:08.105868 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-eea4c30d-af3f-44af-b57b-41b7fdb188b3 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:08.111748 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-eea4c30d-af3f-44af-b57b-41b7fdb188b3 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:08.114486 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-eea4c30d-af3f-44af-b57b-41b7fdb188b3 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] 10.222.0.58 "GET /compute/v2.1/servers/7e091da3-0636-4cba-b8de-94fdeecf0b7f" status: 200 len: 1875 microversion: 2.32 time: 0.433171 Aug 10 23:19:08.116447 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2180/4549] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:19:07 2022] GET /compute/v2.1/servers/7e091da3-0636-4cba-b8de-94fdeecf0b7f => generated 1875 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:19:08.122738 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-adbd4156-7f1c-4d2a-9518-3d72ee43a61e tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:08.123472 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-adbd4156-7f1c-4d2a-9518-3d72ee43a61e tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: 641b3607-8ef3-4e41-ab75-28a6ab178750] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:08.130970 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-adbd4156-7f1c-4d2a-9518-3d72ee43a61e tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:08.131923 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-adbd4156-7f1c-4d2a-9518-3d72ee43a61e tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:08.132555 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-adbd4156-7f1c-4d2a-9518-3d72ee43a61e tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:08.134331 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-adbd4156-7f1c-4d2a-9518-3d72ee43a61e tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:08.135702 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-adbd4156-7f1c-4d2a-9518-3d72ee43a61e tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:08.136405 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-adbd4156-7f1c-4d2a-9518-3d72ee43a61e tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:08.168211 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-c9e1e123-26b4-4ee8-9788-3a5737c97197 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:08.185759 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-c9e1e123-26b4-4ee8-9788-3a5737c97197 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954" status: 200 len: 1675 microversion: 2.1 time: 0.421952 Aug 10 23:19:08.187115 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2370/4550] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:07 2022] GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954 => generated 1675 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:19:08.358444 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-adbd4156-7f1c-4d2a-9518-3d72ee43a61e tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6684f0c87e4242be9e0ffb4ef1973f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0582ace9e4443b8ad88915503ee630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:08.368570 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-adbd4156-7f1c-4d2a-9518-3d72ee43a61e tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "GET /compute/v2.1/servers/641b3607-8ef3-4e41-ab75-28a6ab178750" status: 200 len: 1320 microversion: 2.1 time: 0.250523 Aug 10 23:19:08.369552 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2181/4551] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:08 2022] GET /compute/v2.1/servers/641b3607-8ef3-4e41-ab75-28a6ab178750 => generated 1320 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:19:08.621770 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-06babe10-9642-49ae-88a9-b687b7f739df tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:08.622980 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-06babe10-9642-49ae-88a9-b687b7f739df tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] [instance: 69c4b403-a8ad-449c-a577-63837a6d2445] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:08.636953 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-06babe10-9642-49ae-88a9-b687b7f739df tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:08.637450 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-06babe10-9642-49ae-88a9-b687b7f739df tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:08.637897 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-06babe10-9642-49ae-88a9-b687b7f739df tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:08.638640 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-06babe10-9642-49ae-88a9-b687b7f739df tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:08.639125 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-06babe10-9642-49ae-88a9-b687b7f739df tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:08.639754 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-06babe10-9642-49ae-88a9-b687b7f739df tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:08.692462 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-d601f4d7-7a35-490c-8e61-5eb4c4d5ab4f tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:08.693137 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-d601f4d7-7a35-490c-8e61-5eb4c4d5ab4f tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] [instance: 3ecbcf63-5592-4074-a3f7-d2caf3c58969] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:08.699884 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d601f4d7-7a35-490c-8e61-5eb4c4d5ab4f tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:08.700395 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d601f4d7-7a35-490c-8e61-5eb4c4d5ab4f tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:08.700820 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d601f4d7-7a35-490c-8e61-5eb4c4d5ab4f tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:08.701582 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d601f4d7-7a35-490c-8e61-5eb4c4d5ab4f tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:08.702043 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d601f4d7-7a35-490c-8e61-5eb4c4d5ab4f tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:08.702469 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d601f4d7-7a35-490c-8e61-5eb4c4d5ab4f tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:08.861774 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-d601f4d7-7a35-490c-8e61-5eb4c4d5ab4f tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07c94ebf0954cdea12b9a689538d96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395d7c4077e54c43bb95288db3942b0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:08.870970 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-d601f4d7-7a35-490c-8e61-5eb4c4d5ab4f tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] 10.222.0.58 "GET /compute/v2.1/servers/3ecbcf63-5592-4074-a3f7-d2caf3c58969" status: 200 len: 1691 microversion: 2.1 time: 0.182300 Aug 10 23:19:08.871657 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2182/4552] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:08 2022] GET /compute/v2.1/servers/3ecbcf63-5592-4074-a3f7-d2caf3c58969 => generated 1691 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:19:09.143524 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-9952a189-a4b0-4283-8991-98953a797410 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:09.144917 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-9952a189-a4b0-4283-8991-98953a797410 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] [instance: 7e091da3-0636-4cba-b8de-94fdeecf0b7f] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:09.152595 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9952a189-a4b0-4283-8991-98953a797410 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:09.153090 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9952a189-a4b0-4283-8991-98953a797410 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:09.153530 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9952a189-a4b0-4283-8991-98953a797410 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:09.154250 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9952a189-a4b0-4283-8991-98953a797410 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:09.154722 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9952a189-a4b0-4283-8991-98953a797410 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:09.155168 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9952a189-a4b0-4283-8991-98953a797410 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:09.348005 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-06babe10-9642-49ae-88a9-b687b7f739df tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5899b2ad9f1046caaf7c6073e408eeee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25abd63376614081a9d484f3c9ae950d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:09.360815 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-06babe10-9642-49ae-88a9-b687b7f739df tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "GET /compute/v2.1/servers/69c4b403-a8ad-449c-a577-63837a6d2445" status: 200 len: 1393 microversion: 2.1 time: 0.758463 Aug 10 23:19:09.362687 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2371/4553] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:08 2022] GET /compute/v2.1/servers/69c4b403-a8ad-449c-a577-63837a6d2445 => generated 1393 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:19:09.368764 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-2bef6f2e-d2c1-4574-8c06-74bec661eaf5 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:09.369667 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-2bef6f2e-d2c1-4574-8c06-74bec661eaf5 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: fa9dfd3a-a636-48ce-ae15-0ed51baee954] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:09.378436 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2bef6f2e-d2c1-4574-8c06-74bec661eaf5 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:09.379339 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2bef6f2e-d2c1-4574-8c06-74bec661eaf5 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:09.380156 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2bef6f2e-d2c1-4574-8c06-74bec661eaf5 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:09.381305 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2bef6f2e-d2c1-4574-8c06-74bec661eaf5 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:09.382024 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2bef6f2e-d2c1-4574-8c06-74bec661eaf5 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:09.382625 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2bef6f2e-d2c1-4574-8c06-74bec661eaf5 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:09.425335 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-9952a189-a4b0-4283-8991-98953a797410 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:09.443086 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-9952a189-a4b0-4283-8991-98953a797410 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:09.451042 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-9952a189-a4b0-4283-8991-98953a797410 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:09.452853 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-9952a189-a4b0-4283-8991-98953a797410 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] 10.222.0.58 "GET /compute/v2.1/servers/7e091da3-0636-4cba-b8de-94fdeecf0b7f" status: 200 len: 1875 microversion: 2.32 time: 0.313299 Aug 10 23:19:09.464720 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2183/4554] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:19:09 2022] GET /compute/v2.1/servers/7e091da3-0636-4cba-b8de-94fdeecf0b7f => generated 1875 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:19:09.477290 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-7c2e87a2-045f-4202-b6a0-9d8ca46540b6 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:09.480342 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-7c2e87a2-045f-4202-b6a0-9d8ca46540b6 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: 641b3607-8ef3-4e41-ab75-28a6ab178750] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:09.488016 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7c2e87a2-045f-4202-b6a0-9d8ca46540b6 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:09.488816 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7c2e87a2-045f-4202-b6a0-9d8ca46540b6 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:09.489436 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7c2e87a2-045f-4202-b6a0-9d8ca46540b6 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:09.490328 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7c2e87a2-045f-4202-b6a0-9d8ca46540b6 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:09.490995 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7c2e87a2-045f-4202-b6a0-9d8ca46540b6 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:09.491601 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7c2e87a2-045f-4202-b6a0-9d8ca46540b6 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:09.871204 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-2bef6f2e-d2c1-4574-8c06-74bec661eaf5 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:09.885521 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-2bef6f2e-d2c1-4574-8c06-74bec661eaf5 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954" status: 200 len: 1658 microversion: 2.1 time: 0.521354 Aug 10 23:19:09.887189 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2372/4555] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:09 2022] GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954 => generated 1658 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:19:09.905268 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-23b5dda3-8aef-49d3-9f06-d03553ebdef9 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:09.906100 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-23b5dda3-8aef-49d3-9f06-d03553ebdef9 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] [instance: 3ecbcf63-5592-4074-a3f7-d2caf3c58969] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:09.918643 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-23b5dda3-8aef-49d3-9f06-d03553ebdef9 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:09.920577 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-23b5dda3-8aef-49d3-9f06-d03553ebdef9 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:09.921446 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-23b5dda3-8aef-49d3-9f06-d03553ebdef9 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:09.922553 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-23b5dda3-8aef-49d3-9f06-d03553ebdef9 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:09.923466 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-23b5dda3-8aef-49d3-9f06-d03553ebdef9 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:09.924112 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-23b5dda3-8aef-49d3-9f06-d03553ebdef9 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:09.938398 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-7c2e87a2-045f-4202-b6a0-9d8ca46540b6 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6684f0c87e4242be9e0ffb4ef1973f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0582ace9e4443b8ad88915503ee630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:09.949855 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-7c2e87a2-045f-4202-b6a0-9d8ca46540b6 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "GET /compute/v2.1/servers/641b3607-8ef3-4e41-ab75-28a6ab178750" status: 200 len: 1501 microversion: 2.1 time: 0.475794 Aug 10 23:19:09.968447 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2184/4556] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:09 2022] GET /compute/v2.1/servers/641b3607-8ef3-4e41-ab75-28a6ab178750 => generated 1501 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:19:09.974962 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-26a6e5e6-1d2b-43f1-b3a1-531214fb15de tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:19:09.976019 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-26a6e5e6-1d2b-43f1-b3a1-531214fb15de tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: fa9dfd3a-a636-48ce-ae15-0ed51baee954] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:09.994932 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-26a6e5e6-1d2b-43f1-b3a1-531214fb15de tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:09.995766 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-26a6e5e6-1d2b-43f1-b3a1-531214fb15de tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:09.997230 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-26a6e5e6-1d2b-43f1-b3a1-531214fb15de tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:09.998147 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-26a6e5e6-1d2b-43f1-b3a1-531214fb15de tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:09.998861 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-26a6e5e6-1d2b-43f1-b3a1-531214fb15de tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:09.999489 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-26a6e5e6-1d2b-43f1-b3a1-531214fb15de tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:10.108157 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-26a6e5e6-1d2b-43f1-b3a1-531214fb15de tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "POST /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954/action" status: 202 len: 0 microversion: 2.1 time: 0.137889 Aug 10 23:19:10.110869 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2185/4557] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:19:09 2022] POST /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954/action => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:19:10.119107 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-f0e7685f-36f4-45af-b5ab-a0a96fa922da tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:10.120084 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-f0e7685f-36f4-45af-b5ab-a0a96fa922da tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: 641b3607-8ef3-4e41-ab75-28a6ab178750] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:10.127785 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f0e7685f-36f4-45af-b5ab-a0a96fa922da tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:10.128536 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f0e7685f-36f4-45af-b5ab-a0a96fa922da tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:10.129182 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f0e7685f-36f4-45af-b5ab-a0a96fa922da tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:10.130627 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f0e7685f-36f4-45af-b5ab-a0a96fa922da tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:10.131413 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f0e7685f-36f4-45af-b5ab-a0a96fa922da tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:10.131995 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f0e7685f-36f4-45af-b5ab-a0a96fa922da tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:10.422991 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-23b5dda3-8aef-49d3-9f06-d03553ebdef9 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07c94ebf0954cdea12b9a689538d96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395d7c4077e54c43bb95288db3942b0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:10.428128 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=2 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:19:10.445276 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-23b5dda3-8aef-49d3-9f06-d03553ebdef9 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] 10.222.0.58 "GET /compute/v2.1/servers/3ecbcf63-5592-4074-a3f7-d2caf3c58969" status: 200 len: 1691 microversion: 2.1 time: 0.549212 Aug 10 23:19:10.447380 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2373/4558] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:09 2022] GET /compute/v2.1/servers/3ecbcf63-5592-4074-a3f7-d2caf3c58969 => generated 1691 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:19:10.464853 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-fd0dafb1-8b9e-45ce-8ba0-f0d62a42e615 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:10.465144 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-f0e7685f-36f4-45af-b5ab-a0a96fa922da tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6684f0c87e4242be9e0ffb4ef1973f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0582ace9e4443b8ad88915503ee630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:10.466044 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-fd0dafb1-8b9e-45ce-8ba0-f0d62a42e615 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: fa9dfd3a-a636-48ce-ae15-0ed51baee954] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:10.477162 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-f0e7685f-36f4-45af-b5ab-a0a96fa922da tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "GET /compute/v2.1/servers/641b3607-8ef3-4e41-ab75-28a6ab178750" status: 200 len: 1501 microversion: 2.1 time: 0.364205 Aug 10 23:19:10.491485 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fd0dafb1-8b9e-45ce-8ba0-f0d62a42e615 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:10.491485 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fd0dafb1-8b9e-45ce-8ba0-f0d62a42e615 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:10.491485 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fd0dafb1-8b9e-45ce-8ba0-f0d62a42e615 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:10.491485 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fd0dafb1-8b9e-45ce-8ba0-f0d62a42e615 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:10.491485 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fd0dafb1-8b9e-45ce-8ba0-f0d62a42e615 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:10.491485 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fd0dafb1-8b9e-45ce-8ba0-f0d62a42e615 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:10.493526 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2186/4559] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:10 2022] GET /compute/v2.1/servers/641b3607-8ef3-4e41-ab75-28a6ab178750 => generated 1501 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:19:10.504590 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-7167343d-09f8-4f57-9edc-c79ade1c293b tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:10.505508 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-7167343d-09f8-4f57-9edc-c79ade1c293b tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] [instance: 69c4b403-a8ad-449c-a577-63837a6d2445] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:10.515845 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7167343d-09f8-4f57-9edc-c79ade1c293b tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:10.516613 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7167343d-09f8-4f57-9edc-c79ade1c293b tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:10.517200 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7167343d-09f8-4f57-9edc-c79ade1c293b tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:10.518074 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7167343d-09f8-4f57-9edc-c79ade1c293b tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:10.518680 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7167343d-09f8-4f57-9edc-c79ade1c293b tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:10.519443 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7167343d-09f8-4f57-9edc-c79ade1c293b tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:10.807138 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-7167343d-09f8-4f57-9edc-c79ade1c293b tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5899b2ad9f1046caaf7c6073e408eeee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25abd63376614081a9d484f3c9ae950d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:10.823000 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-7167343d-09f8-4f57-9edc-c79ade1c293b tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "GET /compute/v2.1/servers/69c4b403-a8ad-449c-a577-63837a6d2445" status: 200 len: 1393 microversion: 2.1 time: 0.325227 Aug 10 23:19:10.824803 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2187/4560] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:10 2022] GET /compute/v2.1/servers/69c4b403-a8ad-449c-a577-63837a6d2445 => generated 1393 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:19:10.838167 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-b74e5d49-a4b4-4780-8170-768703323e8b tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:10.839175 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-b74e5d49-a4b4-4780-8170-768703323e8b tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] [instance: 7e091da3-0636-4cba-b8de-94fdeecf0b7f] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:10.849752 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b74e5d49-a4b4-4780-8170-768703323e8b tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:10.850490 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b74e5d49-a4b4-4780-8170-768703323e8b tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:10.853123 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b74e5d49-a4b4-4780-8170-768703323e8b tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:10.855014 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b74e5d49-a4b4-4780-8170-768703323e8b tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:10.856049 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b74e5d49-a4b4-4780-8170-768703323e8b tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:10.856673 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b74e5d49-a4b4-4780-8170-768703323e8b tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:10.901953 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:19:10.948568 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-fd0dafb1-8b9e-45ce-8ba0-f0d62a42e615 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:10.956985 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-fd0dafb1-8b9e-45ce-8ba0-f0d62a42e615 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954" status: 200 len: 1664 microversion: 2.1 time: 0.508343 Aug 10 23:19:10.957809 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2374/4561] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:10 2022] GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954 => generated 1664 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:19:10.963465 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-9e209fff-a964-4433-ad2a-6e336003affa tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:10.964177 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-9e209fff-a964-4433-ad2a-6e336003affa tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: 641b3607-8ef3-4e41-ab75-28a6ab178750] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:10.979719 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9e209fff-a964-4433-ad2a-6e336003affa tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:10.980515 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9e209fff-a964-4433-ad2a-6e336003affa tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:10.981116 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9e209fff-a964-4433-ad2a-6e336003affa tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:10.982034 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9e209fff-a964-4433-ad2a-6e336003affa tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:10.982640 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9e209fff-a964-4433-ad2a-6e336003affa tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:10.983612 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9e209fff-a964-4433-ad2a-6e336003affa tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:11.018875 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-9e209fff-a964-4433-ad2a-6e336003affa tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: 641b3607-8ef3-4e41-ab75-28a6ab178750] Going to try to terminate instance {{(pid=122633) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:19:11.145620 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-9e209fff-a964-4433-ad2a-6e336003affa tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "DELETE /compute/v2.1/servers/641b3607-8ef3-4e41-ab75-28a6ab178750" status: 204 len: 0 microversion: 2.1 time: 0.186016 Aug 10 23:19:11.153804 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2375/4562] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:19:10 2022] DELETE /compute/v2.1/servers/641b3607-8ef3-4e41-ab75-28a6ab178750 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:19:11.160553 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-1df85b16-9d87-4b3e-b125-e8d3d00a9e5e tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:11.161410 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-1df85b16-9d87-4b3e-b125-e8d3d00a9e5e tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] [instance: b812cd8c-7e33-4e97-8df6-c7fccdf12019] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:11.170889 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1df85b16-9d87-4b3e-b125-e8d3d00a9e5e tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:11.173310 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-b74e5d49-a4b4-4780-8170-768703323e8b tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:11.174307 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1df85b16-9d87-4b3e-b125-e8d3d00a9e5e tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:11.175138 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1df85b16-9d87-4b3e-b125-e8d3d00a9e5e tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:11.176156 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1df85b16-9d87-4b3e-b125-e8d3d00a9e5e tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:11.177386 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1df85b16-9d87-4b3e-b125-e8d3d00a9e5e tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:11.178070 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1df85b16-9d87-4b3e-b125-e8d3d00a9e5e tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:11.188488 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-b74e5d49-a4b4-4780-8170-768703323e8b tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:11.189995 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-b74e5d49-a4b4-4780-8170-768703323e8b tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:11.194348 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-b74e5d49-a4b4-4780-8170-768703323e8b tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] 10.222.0.58 "GET /compute/v2.1/servers/7e091da3-0636-4cba-b8de-94fdeecf0b7f" status: 200 len: 1875 microversion: 2.32 time: 0.368328 Aug 10 23:19:11.200043 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2188/4563] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:19:10 2022] GET /compute/v2.1/servers/7e091da3-0636-4cba-b8de-94fdeecf0b7f => generated 1875 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:19:11.215687 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-8bf7df93-a36a-42bd-923d-431c5e7b3bdc tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:11.216488 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-8bf7df93-a36a-42bd-923d-431c5e7b3bdc tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: 641b3607-8ef3-4e41-ab75-28a6ab178750] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:11.235372 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-1df85b16-9d87-4b3e-b125-e8d3d00a9e5e tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] 10.222.0.58 "GET /compute/v2.1/servers/b812cd8c-7e33-4e97-8df6-c7fccdf12019/ips" status: 200 len: 151 microversion: 2.1 time: 0.079232 Aug 10 23:19:11.235829 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8bf7df93-a36a-42bd-923d-431c5e7b3bdc tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:11.236376 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8bf7df93-a36a-42bd-923d-431c5e7b3bdc tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:11.237632 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2376/4564] 10.222.0.58 () {58 vars in 1248 bytes} [Wed Aug 10 23:19:11 2022] GET /compute/v2.1/servers/b812cd8c-7e33-4e97-8df6-c7fccdf12019/ips => generated 151 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:19:11.244421 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8bf7df93-a36a-42bd-923d-431c5e7b3bdc tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:11.245539 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8bf7df93-a36a-42bd-923d-431c5e7b3bdc tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:11.248173 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8bf7df93-a36a-42bd-923d-431c5e7b3bdc tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:11.248786 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8bf7df93-a36a-42bd-923d-431c5e7b3bdc tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:11.468832 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=2 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:19:11.487762 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-d15e8a35-b302-4401-8801-813c73499e19 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:11.488461 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-d15e8a35-b302-4401-8801-813c73499e19 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] [instance: 3ecbcf63-5592-4074-a3f7-d2caf3c58969] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:11.546059 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d15e8a35-b302-4401-8801-813c73499e19 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:11.547638 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d15e8a35-b302-4401-8801-813c73499e19 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:11.550408 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d15e8a35-b302-4401-8801-813c73499e19 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:11.551853 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d15e8a35-b302-4401-8801-813c73499e19 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:11.553259 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d15e8a35-b302-4401-8801-813c73499e19 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:11.555749 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d15e8a35-b302-4401-8801-813c73499e19 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:11.622440 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-8bf7df93-a36a-42bd-923d-431c5e7b3bdc tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6684f0c87e4242be9e0ffb4ef1973f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0582ace9e4443b8ad88915503ee630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:11.631003 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-8bf7df93-a36a-42bd-923d-431c5e7b3bdc tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "GET /compute/v2.1/servers/641b3607-8ef3-4e41-ab75-28a6ab178750" status: 200 len: 1507 microversion: 2.1 time: 0.429657 Aug 10 23:19:11.637269 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2189/4565] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:11 2022] GET /compute/v2.1/servers/641b3607-8ef3-4e41-ab75-28a6ab178750 => generated 1507 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:19:11.851016 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-d2b9f86c-4210-45cb-b00e-0ed1fbfbbab7 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:11.852424 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-d2b9f86c-4210-45cb-b00e-0ed1fbfbbab7 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] [instance: 69c4b403-a8ad-449c-a577-63837a6d2445] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:11.874303 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d2b9f86c-4210-45cb-b00e-0ed1fbfbbab7 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:11.875540 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d2b9f86c-4210-45cb-b00e-0ed1fbfbbab7 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:11.878537 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d2b9f86c-4210-45cb-b00e-0ed1fbfbbab7 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:11.881185 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d2b9f86c-4210-45cb-b00e-0ed1fbfbbab7 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:11.885452 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d2b9f86c-4210-45cb-b00e-0ed1fbfbbab7 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:11.889248 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d2b9f86c-4210-45cb-b00e-0ed1fbfbbab7 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:12.113385 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-d15e8a35-b302-4401-8801-813c73499e19 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07c94ebf0954cdea12b9a689538d96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395d7c4077e54c43bb95288db3942b0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:12.122383 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-d15e8a35-b302-4401-8801-813c73499e19 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] 10.222.0.58 "GET /compute/v2.1/servers/3ecbcf63-5592-4074-a3f7-d2caf3c58969" status: 200 len: 1691 microversion: 2.1 time: 0.645629 Aug 10 23:19:12.126012 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2377/4566] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:11 2022] GET /compute/v2.1/servers/3ecbcf63-5592-4074-a3f7-d2caf3c58969 => generated 1691 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:19:12.136980 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-2344480a-6486-4da4-ad63-e4e272eb1f3d tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:12.139777 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-2344480a-6486-4da4-ad63-e4e272eb1f3d tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: fa9dfd3a-a636-48ce-ae15-0ed51baee954] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:12.155691 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2344480a-6486-4da4-ad63-e4e272eb1f3d tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:12.156524 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2344480a-6486-4da4-ad63-e4e272eb1f3d tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:12.157079 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2344480a-6486-4da4-ad63-e4e272eb1f3d tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:12.157928 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2344480a-6486-4da4-ad63-e4e272eb1f3d tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:12.158493 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2344480a-6486-4da4-ad63-e4e272eb1f3d tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:12.159217 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2344480a-6486-4da4-ad63-e4e272eb1f3d tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:12.642154 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-2344480a-6486-4da4-ad63-e4e272eb1f3d tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:12.653241 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-2344480a-6486-4da4-ad63-e4e272eb1f3d tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954" status: 200 len: 1664 microversion: 2.1 time: 0.525848 Aug 10 23:19:12.657076 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2378/4567] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:12 2022] GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954 => generated 1664 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:19:12.667574 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-90eee612-a5b1-4da5-b2fd-0841b16b99cf tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:12.672951 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-90eee612-a5b1-4da5-b2fd-0841b16b99cf tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] [instance: 7e091da3-0636-4cba-b8de-94fdeecf0b7f] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:12.688089 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-90eee612-a5b1-4da5-b2fd-0841b16b99cf tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:12.688314 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-d2b9f86c-4210-45cb-b00e-0ed1fbfbbab7 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5899b2ad9f1046caaf7c6073e408eeee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25abd63376614081a9d484f3c9ae950d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:12.693437 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-90eee612-a5b1-4da5-b2fd-0841b16b99cf tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:12.694124 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-90eee612-a5b1-4da5-b2fd-0841b16b99cf tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:12.695942 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-90eee612-a5b1-4da5-b2fd-0841b16b99cf tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:12.699669 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-90eee612-a5b1-4da5-b2fd-0841b16b99cf tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:12.701899 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-90eee612-a5b1-4da5-b2fd-0841b16b99cf tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:12.702277 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-d2b9f86c-4210-45cb-b00e-0ed1fbfbbab7 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "GET /compute/v2.1/servers/69c4b403-a8ad-449c-a577-63837a6d2445" status: 200 len: 1393 microversion: 2.1 time: 0.855044 Aug 10 23:19:12.705811 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2190/4568] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:11 2022] GET /compute/v2.1/servers/69c4b403-a8ad-449c-a577-63837a6d2445 => generated 1393 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:19:12.712825 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-d6f811fa-bbfe-4438-b170-6146ae44b5d8 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:12.721416 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-d6f811fa-bbfe-4438-b170-6146ae44b5d8 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: 641b3607-8ef3-4e41-ab75-28a6ab178750] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:12.731140 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d6f811fa-bbfe-4438-b170-6146ae44b5d8 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:12.731900 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d6f811fa-bbfe-4438-b170-6146ae44b5d8 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:12.732497 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d6f811fa-bbfe-4438-b170-6146ae44b5d8 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:12.733457 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d6f811fa-bbfe-4438-b170-6146ae44b5d8 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:12.734065 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d6f811fa-bbfe-4438-b170-6146ae44b5d8 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:12.734645 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d6f811fa-bbfe-4438-b170-6146ae44b5d8 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:13.246548 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-90eee612-a5b1-4da5-b2fd-0841b16b99cf tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:13.269588 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-90eee612-a5b1-4da5-b2fd-0841b16b99cf tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:13.271856 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-90eee612-a5b1-4da5-b2fd-0841b16b99cf tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:13.273429 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-90eee612-a5b1-4da5-b2fd-0841b16b99cf tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] 10.222.0.58 "GET /compute/v2.1/servers/7e091da3-0636-4cba-b8de-94fdeecf0b7f" status: 200 len: 1875 microversion: 2.32 time: 0.614958 Aug 10 23:19:13.274508 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2379/4569] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:19:12 2022] GET /compute/v2.1/servers/7e091da3-0636-4cba-b8de-94fdeecf0b7f => generated 1875 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:19:13.285287 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-ae744acd-a293-4ebe-bb7a-c7e93f1adc9c tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:13.286409 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-ae744acd-a293-4ebe-bb7a-c7e93f1adc9c tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] [instance: 3ecbcf63-5592-4074-a3f7-d2caf3c58969] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:13.299427 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ae744acd-a293-4ebe-bb7a-c7e93f1adc9c tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:13.300168 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ae744acd-a293-4ebe-bb7a-c7e93f1adc9c tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:13.308735 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ae744acd-a293-4ebe-bb7a-c7e93f1adc9c tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:13.309692 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ae744acd-a293-4ebe-bb7a-c7e93f1adc9c tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:13.310565 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ae744acd-a293-4ebe-bb7a-c7e93f1adc9c tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:13.311224 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ae744acd-a293-4ebe-bb7a-c7e93f1adc9c tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:13.340991 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-d6f811fa-bbfe-4438-b170-6146ae44b5d8 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6684f0c87e4242be9e0ffb4ef1973f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0582ace9e4443b8ad88915503ee630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:13.350687 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-d6f811fa-bbfe-4438-b170-6146ae44b5d8 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "GET /compute/v2.1/servers/641b3607-8ef3-4e41-ab75-28a6ab178750" status: 200 len: 1507 microversion: 2.1 time: 0.643619 Aug 10 23:19:13.355788 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2191/4570] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:12 2022] GET /compute/v2.1/servers/641b3607-8ef3-4e41-ab75-28a6ab178750 => generated 1507 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:19:13.363967 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-d7d7d841-b196-43e3-8edd-299570c9be9e req-54d1ed9f-2647-4cf1-99cd-590f4619bd6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69c4b403-a8ad-449c-a577-63837a6d2445", "name": "network-vif-plugged", "status": "completed", "tag": "8597a359-c6f1-46f8-9a07-e80725a3a36d"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:19:13.385835 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-d7d7d841-b196-43e3-8edd-299570c9be9e req-54d1ed9f-2647-4cf1-99cd-590f4619bd6c service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:13.386320 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-d7d7d841-b196-43e3-8edd-299570c9be9e req-54d1ed9f-2647-4cf1-99cd-590f4619bd6c service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:13.387840 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-d7d7d841-b196-43e3-8edd-299570c9be9e req-54d1ed9f-2647-4cf1-99cd-590f4619bd6c service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:13.424473 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-d7d7d841-b196-43e3-8edd-299570c9be9e req-54d1ed9f-2647-4cf1-99cd-590f4619bd6c service nova] Creating event network-vif-plugged:8597a359-c6f1-46f8-9a07-e80725a3a36d for instance 69c4b403-a8ad-449c-a577-63837a6d2445 on n-h2-850468-14 Aug 10 23:19:13.438274 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-d7d7d841-b196-43e3-8edd-299570c9be9e req-54d1ed9f-2647-4cf1-99cd-590f4619bd6c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081059 Aug 10 23:19:13.440497 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2192/4571] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:19:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:19:13.678825 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-274f6c06-05e9-41eb-ad07-54ea74bbe45a tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:13.680260 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-274f6c06-05e9-41eb-ad07-54ea74bbe45a tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: fa9dfd3a-a636-48ce-ae15-0ed51baee954] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:13.696035 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-274f6c06-05e9-41eb-ad07-54ea74bbe45a tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:13.696639 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-274f6c06-05e9-41eb-ad07-54ea74bbe45a tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:13.698791 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-274f6c06-05e9-41eb-ad07-54ea74bbe45a tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:13.699670 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-274f6c06-05e9-41eb-ad07-54ea74bbe45a tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:13.707919 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-274f6c06-05e9-41eb-ad07-54ea74bbe45a tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:13.708482 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-274f6c06-05e9-41eb-ad07-54ea74bbe45a tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:13.767732 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-ae744acd-a293-4ebe-bb7a-c7e93f1adc9c tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07c94ebf0954cdea12b9a689538d96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395d7c4077e54c43bb95288db3942b0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:13.780448 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-ae744acd-a293-4ebe-bb7a-c7e93f1adc9c tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] 10.222.0.58 "GET /compute/v2.1/servers/3ecbcf63-5592-4074-a3f7-d2caf3c58969" status: 200 len: 1691 microversion: 2.1 time: 0.504022 Aug 10 23:19:13.781053 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2380/4572] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:13 2022] GET /compute/v2.1/servers/3ecbcf63-5592-4074-a3f7-d2caf3c58969 => generated 1691 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:19:13.789968 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-bb000fb8-c630-48d2-a55f-2e3f349b63b3 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:13.790596 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-bb000fb8-c630-48d2-a55f-2e3f349b63b3 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] [instance: 69c4b403-a8ad-449c-a577-63837a6d2445] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:13.804848 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bb000fb8-c630-48d2-a55f-2e3f349b63b3 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:13.805673 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bb000fb8-c630-48d2-a55f-2e3f349b63b3 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:13.806286 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bb000fb8-c630-48d2-a55f-2e3f349b63b3 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:13.808367 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bb000fb8-c630-48d2-a55f-2e3f349b63b3 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:13.809072 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bb000fb8-c630-48d2-a55f-2e3f349b63b3 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:13.809744 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bb000fb8-c630-48d2-a55f-2e3f349b63b3 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:14.165137 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-bb000fb8-c630-48d2-a55f-2e3f349b63b3 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5899b2ad9f1046caaf7c6073e408eeee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25abd63376614081a9d484f3c9ae950d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:14.177502 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-bb000fb8-c630-48d2-a55f-2e3f349b63b3 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "GET /compute/v2.1/servers/69c4b403-a8ad-449c-a577-63837a6d2445" status: 200 len: 1393 microversion: 2.1 time: 0.395041 Aug 10 23:19:14.178450 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2381/4573] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:13 2022] GET /compute/v2.1/servers/69c4b403-a8ad-449c-a577-63837a6d2445 => generated 1393 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:19:14.185125 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-4e5dacc8-3821-4ffb-a0c3-0ae834ae826a tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ba75fad6-85fb-4ae5-bee1-44e5e84a45e5"}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:19:14.188796 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-4e5dacc8-3821-4ffb-a0c3-0ae834ae826a tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] [instance: b812cd8c-7e33-4e97-8df6-c7fccdf12019] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:14.197844 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4e5dacc8-3821-4ffb-a0c3-0ae834ae826a tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:14.198745 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4e5dacc8-3821-4ffb-a0c3-0ae834ae826a tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:14.199483 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4e5dacc8-3821-4ffb-a0c3-0ae834ae826a tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:14.200537 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4e5dacc8-3821-4ffb-a0c3-0ae834ae826a tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:14.201213 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4e5dacc8-3821-4ffb-a0c3-0ae834ae826a tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:14.201904 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4e5dacc8-3821-4ffb-a0c3-0ae834ae826a tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:14.226347 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:19:14.716686 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-4e5dacc8-3821-4ffb-a0c3-0ae834ae826a tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] 10.222.0.58 "POST /compute/v2.1/servers/b812cd8c-7e33-4e97-8df6-c7fccdf12019/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.508439 Aug 10 23:19:14.717414 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2382/4574] 10.222.0.58 () {60 vars in 1323 bytes} [Wed Aug 10 23:19:14 2022] POST /compute/v2.1/servers/b812cd8c-7e33-4e97-8df6-c7fccdf12019/os-volume_attachments => generated 194 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:19:14.728734 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-931c89bd-bc8d-4f0f-a13b-39887f215781 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:14.729446 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-931c89bd-bc8d-4f0f-a13b-39887f215781 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] [instance: 7e091da3-0636-4cba-b8de-94fdeecf0b7f] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:14.768732 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-931c89bd-bc8d-4f0f-a13b-39887f215781 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:14.770389 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-931c89bd-bc8d-4f0f-a13b-39887f215781 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:14.772938 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-931c89bd-bc8d-4f0f-a13b-39887f215781 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:14.781111 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-931c89bd-bc8d-4f0f-a13b-39887f215781 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:14.783262 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-931c89bd-bc8d-4f0f-a13b-39887f215781 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:14.784066 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-931c89bd-bc8d-4f0f-a13b-39887f215781 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:15.080940 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-274f6c06-05e9-41eb-ad07-54ea74bbe45a tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:15.089728 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=10 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:19:15.094206 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-274f6c06-05e9-41eb-ad07-54ea74bbe45a tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954" status: 200 len: 1664 microversion: 2.1 time: 1.420114 Aug 10 23:19:15.094888 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2193/4575] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:13 2022] GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954 => generated 1664 bytes in 1422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:19:15.132302 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-f01f0110-ba87-4200-85a7-d5cf5bc3d198 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:15.134590 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-f01f0110-ba87-4200-85a7-d5cf5bc3d198 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: 641b3607-8ef3-4e41-ab75-28a6ab178750] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:15.142584 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:19:15.152329 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f01f0110-ba87-4200-85a7-d5cf5bc3d198 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:15.153160 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f01f0110-ba87-4200-85a7-d5cf5bc3d198 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:15.154420 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f01f0110-ba87-4200-85a7-d5cf5bc3d198 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:15.156380 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f01f0110-ba87-4200-85a7-d5cf5bc3d198 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:15.157641 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f01f0110-ba87-4200-85a7-d5cf5bc3d198 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:15.160391 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f01f0110-ba87-4200-85a7-d5cf5bc3d198 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:15.441942 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-f01f0110-ba87-4200-85a7-d5cf5bc3d198 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6684f0c87e4242be9e0ffb4ef1973f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0582ace9e4443b8ad88915503ee630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:15.454564 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-f01f0110-ba87-4200-85a7-d5cf5bc3d198 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "GET /compute/v2.1/servers/641b3607-8ef3-4e41-ab75-28a6ab178750" status: 200 len: 1465 microversion: 2.1 time: 0.334485 Aug 10 23:19:15.459647 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2194/4576] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:15 2022] GET /compute/v2.1/servers/641b3607-8ef3-4e41-ab75-28a6ab178750 => generated 1465 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:19:15.707982 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-931c89bd-bc8d-4f0f-a13b-39887f215781 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:15.766054 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-931c89bd-bc8d-4f0f-a13b-39887f215781 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:15.770700 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-931c89bd-bc8d-4f0f-a13b-39887f215781 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:15.774551 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-931c89bd-bc8d-4f0f-a13b-39887f215781 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] 10.222.0.58 "GET /compute/v2.1/servers/7e091da3-0636-4cba-b8de-94fdeecf0b7f" status: 200 len: 1875 microversion: 2.32 time: 1.055722 Aug 10 23:19:15.780630 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2383/4577] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:19:14 2022] GET /compute/v2.1/servers/7e091da3-0636-4cba-b8de-94fdeecf0b7f => generated 1875 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:19:15.786911 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-4bcba1a6-e827-44dd-8aaa-36f86e023f46 req-b6c97a1e-b093-4666-89af-456db846ec2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "641b3607-8ef3-4e41-ab75-28a6ab178750", "name": "network-vif-deleted", "tag": "22688e12-f8a6-47d7-8f54-3618c6749884"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:19:15.813038 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-caa4814a-2d77-450a-ace3-85021adf8844 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:15.815411 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-caa4814a-2d77-450a-ace3-85021adf8844 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] [instance: 3ecbcf63-5592-4074-a3f7-d2caf3c58969] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:15.823614 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-4bcba1a6-e827-44dd-8aaa-36f86e023f46 req-b6c97a1e-b093-4666-89af-456db846ec2a service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:15.824719 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-4bcba1a6-e827-44dd-8aaa-36f86e023f46 req-b6c97a1e-b093-4666-89af-456db846ec2a service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:15.825698 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-4bcba1a6-e827-44dd-8aaa-36f86e023f46 req-b6c97a1e-b093-4666-89af-456db846ec2a service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:15.838463 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-caa4814a-2d77-450a-ace3-85021adf8844 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:15.840691 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-caa4814a-2d77-450a-ace3-85021adf8844 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:15.841225 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-caa4814a-2d77-450a-ace3-85021adf8844 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:15.842264 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-4bcba1a6-e827-44dd-8aaa-36f86e023f46 req-b6c97a1e-b093-4666-89af-456db846ec2a service nova] Creating event network-vif-deleted:22688e12-f8a6-47d7-8f54-3618c6749884 for instance 641b3607-8ef3-4e41-ab75-28a6ab178750 on n-h2-850468-14 Aug 10 23:19:15.843180 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-caa4814a-2d77-450a-ace3-85021adf8844 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:15.843878 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-caa4814a-2d77-450a-ace3-85021adf8844 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:15.845081 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-caa4814a-2d77-450a-ace3-85021adf8844 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:15.864592 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-4bcba1a6-e827-44dd-8aaa-36f86e023f46 req-b6c97a1e-b093-4666-89af-456db846ec2a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081634 Aug 10 23:19:15.867505 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2384/4578] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:19:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:19:15.882837 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-65cbdcf5-2668-4b8a-82ab-379a7efcc484 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:15.891972 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-65cbdcf5-2668-4b8a-82ab-379a7efcc484 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] [instance: 69c4b403-a8ad-449c-a577-63837a6d2445] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:15.909964 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-65cbdcf5-2668-4b8a-82ab-379a7efcc484 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:15.913082 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-65cbdcf5-2668-4b8a-82ab-379a7efcc484 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:15.913994 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-65cbdcf5-2668-4b8a-82ab-379a7efcc484 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:15.916366 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-65cbdcf5-2668-4b8a-82ab-379a7efcc484 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:15.917495 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-65cbdcf5-2668-4b8a-82ab-379a7efcc484 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:15.919279 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-65cbdcf5-2668-4b8a-82ab-379a7efcc484 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:16.066735 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-caa4814a-2d77-450a-ace3-85021adf8844 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07c94ebf0954cdea12b9a689538d96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395d7c4077e54c43bb95288db3942b0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:16.083157 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-caa4814a-2d77-450a-ace3-85021adf8844 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] 10.222.0.58 "GET /compute/v2.1/servers/3ecbcf63-5592-4074-a3f7-d2caf3c58969" status: 200 len: 1623 microversion: 2.1 time: 0.608441 Aug 10 23:19:16.089649 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2195/4579] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:15 2022] GET /compute/v2.1/servers/3ecbcf63-5592-4074-a3f7-d2caf3c58969 => generated 1623 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:19:16.123081 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-4d93dcd7-95ca-4183-97cd-c64978ca0f73 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:16.124139 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-4d93dcd7-95ca-4183-97cd-c64978ca0f73 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: fa9dfd3a-a636-48ce-ae15-0ed51baee954] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:16.154606 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4d93dcd7-95ca-4183-97cd-c64978ca0f73 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:16.156205 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4d93dcd7-95ca-4183-97cd-c64978ca0f73 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:16.156845 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4d93dcd7-95ca-4183-97cd-c64978ca0f73 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:16.157780 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4d93dcd7-95ca-4183-97cd-c64978ca0f73 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:16.158461 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4d93dcd7-95ca-4183-97cd-c64978ca0f73 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:16.160337 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4d93dcd7-95ca-4183-97cd-c64978ca0f73 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:16.508882 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-65cbdcf5-2668-4b8a-82ab-379a7efcc484 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5899b2ad9f1046caaf7c6073e408eeee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25abd63376614081a9d484f3c9ae950d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:16.519632 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-65cbdcf5-2668-4b8a-82ab-379a7efcc484 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "GET /compute/v2.1/servers/69c4b403-a8ad-449c-a577-63837a6d2445" status: 200 len: 1566 microversion: 2.1 time: 0.645135 Aug 10 23:19:16.537175 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2385/4580] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:15 2022] GET /compute/v2.1/servers/69c4b403-a8ad-449c-a577-63837a6d2445 => generated 1566 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:19:16.548063 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-4267857b-8027-4ab8-b893-9b0589c6552b tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:16.552134 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-4267857b-8027-4ab8-b893-9b0589c6552b tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: 641b3607-8ef3-4e41-ab75-28a6ab178750] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:16.579637 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-4d93dcd7-95ca-4183-97cd-c64978ca0f73 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:16.587205 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4267857b-8027-4ab8-b893-9b0589c6552b tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:16.587710 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4267857b-8027-4ab8-b893-9b0589c6552b tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:16.597670 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-4d93dcd7-95ca-4183-97cd-c64978ca0f73 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954" status: 200 len: 1667 microversion: 2.1 time: 0.483118 Aug 10 23:19:16.603921 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2196/4581] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:16 2022] GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954 => generated 1667 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:19:16.608773 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4267857b-8027-4ab8-b893-9b0589c6552b tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:16.609498 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-555b8527-d6fb-4387-9d6e-e9dc69936ec1 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:16.609636 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4267857b-8027-4ab8-b893-9b0589c6552b tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:16.610026 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4267857b-8027-4ab8-b893-9b0589c6552b tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:16.610461 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4267857b-8027-4ab8-b893-9b0589c6552b tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:16.611017 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-555b8527-d6fb-4387-9d6e-e9dc69936ec1 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] [instance: 69c4b403-a8ad-449c-a577-63837a6d2445] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:16.627661 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-555b8527-d6fb-4387-9d6e-e9dc69936ec1 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:16.631548 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-555b8527-d6fb-4387-9d6e-e9dc69936ec1 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:16.633743 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-555b8527-d6fb-4387-9d6e-e9dc69936ec1 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:16.635533 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-555b8527-d6fb-4387-9d6e-e9dc69936ec1 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:16.636216 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-555b8527-d6fb-4387-9d6e-e9dc69936ec1 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:16.636899 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-555b8527-d6fb-4387-9d6e-e9dc69936ec1 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:16.667049 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-4267857b-8027-4ab8-b893-9b0589c6552b tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] HTTP exception thrown: Instance 641b3607-8ef3-4e41-ab75-28a6ab178750 could not be found. Aug 10 23:19:16.668943 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-4267857b-8027-4ab8-b893-9b0589c6552b tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Request method failure captured: Aug 10 23:19:16.668943 n-d-850468-14 devstack@n-api.service[122633]: request: GET /compute/v2.1/servers/641b3607-8ef3-4e41-ab75-28a6ab178750 HTTP/1.1 Aug 10 23:19:16.668943 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:19:16.668943 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:19:16.668943 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:19:16.668943 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:19:16.668943 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:19:16.668943 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:19:16.668943 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:19:16.668943 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:19:16.668943 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9DytBT8uIivFlHEw3ugwW3-_1ks70Fcm-KUdUfNf3hiFdhb5xvDC9LI4u79J0X-frOTrhG-DWWR1w8a7yZU35-jGfQgN97QRTSA7hDEW06netEOKzarBlr77OO9sCeT3s5ektFA7vCYLl4122WPKHg-MSXQY0g9YmL291Ic7yNjWLnQ Aug 10 23:19:16.668943 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:19:16.668943 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:19:16.668943 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:19:16.668943 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:19:16.668943 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:19:16.668943 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:19:16.668943 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 0b0582ace9e4443b8ad88915503ee630 Aug 10 23:19:16.668943 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-ServersTestJSON-516662906 Aug 10 23:19:16.668943 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:19:16.668943 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:19:16.668943 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0b0582ace9e4443b8ad88915503ee630"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0b0582ace9e4443b8ad88915503ee630"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/0b0582ace9e4443b8ad88915503ee630"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_0b0582ace9e4443b8ad88915503ee630", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:19:16.668943 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-ServersTestJSON-516662906 Aug 10 23:19:16.668943 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 0b0582ace9e4443b8ad88915503ee630 Aug 10 23:19:16.668943 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-ServersTestJSON-516662906 Aug 10 23:19:16.668943 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-ServersTestJSON-516662906-project Aug 10 23:19:16.668943 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:19:16.668943 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:19:16.668943 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 6684f0c87e4242be9e0ffb4ef1973f96 Aug 10 23:19:16.668943 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-ServersTestJSON-516662906-project Aug 10 23:19:16.668943 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:19:16.668943 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance 641b3607-8ef3-4e41-ab75-28a6ab178750 could not be found. Aug 10 23:19:16.668943 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': '641b3607-8ef3-4e41-ab75-28a6ab178750'} Aug 10 23:19:16.668943 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:19:16.668943 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:19:16.668943 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:19:16.668943 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:19:16.668943 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:19:16.668943 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:19:16.668943 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:19:16.668943 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:19:16.668943 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:19:16.668943 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:19:16.668943 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 641b3607-8ef3-4e41-ab75-28a6ab178750 could not be found. Aug 10 23:19:16.668943 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:19:16.668943 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:19:16.668943 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:19:16.668943 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:19:16.668943 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:19:16.668943 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:19:16.668943 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:19:16.668943 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:19:16.668943 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:19:16.668943 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:19:16.668943 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:19:16.668943 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:19:16.668943 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:19:16.668943 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:19:16.668943 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:19:16.668943 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:19:16.668943 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 641b3607-8ef3-4e41-ab75-28a6ab178750 could not be found. Aug 10 23:19:16.668943 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:19:16.668943 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:19:16.668943 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:19:16.668943 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:19:16.673282 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:19:16.673282 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:19:16.673282 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:19:16.673282 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:19:16.673282 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 641b3607-8ef3-4e41-ab75-28a6ab178750 could not be found. Aug 10 23:19:16.673282 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:19:16.673282 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-4267857b-8027-4ab8-b893-9b0589c6552b tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Returning 404 to user: Instance 641b3607-8ef3-4e41-ab75-28a6ab178750 could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:19:16.673282 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-4267857b-8027-4ab8-b893-9b0589c6552b tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "GET /compute/v2.1/servers/641b3607-8ef3-4e41-ab75-28a6ab178750" status: 404 len: 111 microversion: 2.1 time: 0.132143 Aug 10 23:19:16.679042 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2386/4582] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:16 2022] GET /compute/v2.1/servers/641b3607-8ef3-4e41-ab75-28a6ab178750 => generated 111 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:19:16.685571 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-a747ec28-ac5c-4117-8599-12dde66f7569 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:16.692865 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-a747ec28-ac5c-4117-8599-12dde66f7569 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: fa9dfd3a-a636-48ce-ae15-0ed51baee954] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:16.707942 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a747ec28-ac5c-4117-8599-12dde66f7569 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:16.708928 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a747ec28-ac5c-4117-8599-12dde66f7569 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:16.709530 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a747ec28-ac5c-4117-8599-12dde66f7569 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:16.710399 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a747ec28-ac5c-4117-8599-12dde66f7569 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:16.715096 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a747ec28-ac5c-4117-8599-12dde66f7569 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:16.715824 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a747ec28-ac5c-4117-8599-12dde66f7569 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:16.982215 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-555b8527-d6fb-4387-9d6e-e9dc69936ec1 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5899b2ad9f1046caaf7c6073e408eeee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25abd63376614081a9d484f3c9ae950d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:17.008773 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-555b8527-d6fb-4387-9d6e-e9dc69936ec1 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "GET /compute/v2.1/servers/69c4b403-a8ad-449c-a577-63837a6d2445" status: 200 len: 1566 microversion: 2.1 time: 0.402423 Aug 10 23:19:17.022820 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2197/4583] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:16 2022] GET /compute/v2.1/servers/69c4b403-a8ad-449c-a577-63837a6d2445 => generated 1566 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:19:17.047369 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-18de2203-8f22-49e4-876c-2d74c8fa2421 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Action: 'create', calling method: .version_select at 0x7f846fd639d0>, body: {"keypair": {"name": "tempest-key-1724435875", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH5nYTrKciFDp33dzku+REPG4Qagry4k3828XKu5unBzhc6Rl70AcOlA1PNic2FI5OHryvOmdIyv2QkdK2/AVc01IEMZa8IkZjq9haGmjDX/Vw8XGXhoKgml1Rcwewhb6g=="}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:19:17.146810 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-18de2203-8f22-49e4-876c-2d74c8fa2421 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Getting quotas for project 0b0582ace9e4443b8ad88915503ee630. Resources: {'key_pairs'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:19:17.162546 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-18de2203-8f22-49e4-876c-2d74c8fa2421 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Getting quotas for user 6684f0c87e4242be9e0ffb4ef1973f96 and project 0b0582ace9e4443b8ad88915503ee630. Resources: {'key_pairs'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:19:17.244728 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-18de2203-8f22-49e4-876c-2d74c8fa2421 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 382 microversion: 2.1 time: 0.227856 Aug 10 23:19:17.246554 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2198/4584] 10.222.0.58 () {60 vars in 1159 bytes} [Wed Aug 10 23:19:17 2022] POST /compute/v2.1/os-keypairs => generated 382 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:19:17.272285 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-0442332e-4e15-4028-a6a4-57e0f3d6fccf tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:17.274323 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-0442332e-4e15-4028-a6a4-57e0f3d6fccf tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] [instance: 7e091da3-0636-4cba-b8de-94fdeecf0b7f] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:17.292123 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0442332e-4e15-4028-a6a4-57e0f3d6fccf tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:17.292899 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0442332e-4e15-4028-a6a4-57e0f3d6fccf tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:17.293509 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0442332e-4e15-4028-a6a4-57e0f3d6fccf tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:17.295375 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0442332e-4e15-4028-a6a4-57e0f3d6fccf tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:17.298570 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0442332e-4e15-4028-a6a4-57e0f3d6fccf tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:17.299216 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0442332e-4e15-4028-a6a4-57e0f3d6fccf tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:17.795120 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-a747ec28-ac5c-4117-8599-12dde66f7569 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:17.811707 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-a747ec28-ac5c-4117-8599-12dde66f7569 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954" status: 200 len: 1667 microversion: 2.1 time: 1.129855 Aug 10 23:19:17.839084 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2387/4585] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:16 2022] GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954 => generated 1667 bytes in 1158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:19:17.869842 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-6f974e15-4f2f-4144-87a2-cf5f77221c22 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:17.870457 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-6f974e15-4f2f-4144-87a2-cf5f77221c22 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] [instance: 3ecbcf63-5592-4074-a3f7-d2caf3c58969] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:17.899679 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6f974e15-4f2f-4144-87a2-cf5f77221c22 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:17.900599 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6f974e15-4f2f-4144-87a2-cf5f77221c22 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:17.901251 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6f974e15-4f2f-4144-87a2-cf5f77221c22 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:17.902232 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6f974e15-4f2f-4144-87a2-cf5f77221c22 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:17.902979 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6f974e15-4f2f-4144-87a2-cf5f77221c22 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:17.903616 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6f974e15-4f2f-4144-87a2-cf5f77221c22 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:17.948233 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-6f974e15-4f2f-4144-87a2-cf5f77221c22 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] HTTP exception thrown: Instance 3ecbcf63-5592-4074-a3f7-d2caf3c58969 could not be found. Aug 10 23:19:17.950698 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-6f974e15-4f2f-4144-87a2-cf5f77221c22 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Request method failure captured: Aug 10 23:19:17.950698 n-d-850468-14 devstack@n-api.service[122633]: request: GET /compute/v2.1/servers/3ecbcf63-5592-4074-a3f7-d2caf3c58969 HTTP/1.1 Aug 10 23:19:17.950698 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:19:17.950698 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:19:17.950698 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:19:17.950698 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:19:17.950698 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:19:17.950698 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:19:17.950698 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:19:17.950698 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:19:17.950698 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9DvG6mPOp_bU6YQakEzMuJf91N1YrPRgIEe5ouB8tWtrXuOeLQgeJ0ouDTrtP31JIWcz1wQJ17PTz3JUAbF_FaF35I1F09nIb2lkQ0GhE880fsA2K13MCP_yKxqm-kv_hQLiQB8UzdyMBwb04C68j2QYpbobWhHyceARqBEeITDqyg0 Aug 10 23:19:17.950698 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:19:17.950698 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:19:17.950698 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:19:17.950698 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:19:17.950698 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:19:17.950698 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:19:17.950698 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 395d7c4077e54c43bb95288db3942b0a Aug 10 23:19:17.950698 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1029565464 Aug 10 23:19:17.950698 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:19:17.950698 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:19:17.950698 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/395d7c4077e54c43bb95288db3942b0a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/395d7c4077e54c43bb95288db3942b0a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/395d7c4077e54c43bb95288db3942b0a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_395d7c4077e54c43bb95288db3942b0a", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:19:17.950698 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1029565464 Aug 10 23:19:17.950698 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 395d7c4077e54c43bb95288db3942b0a Aug 10 23:19:17.950698 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1029565464 Aug 10 23:19:17.950698 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-ServerRescueNegativeTestJSON-1029565464-project Aug 10 23:19:17.950698 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:19:17.950698 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:19:17.950698 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: f07c94ebf0954cdea12b9a689538d96d Aug 10 23:19:17.950698 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1029565464-project Aug 10 23:19:17.950698 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:19:17.950698 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance 3ecbcf63-5592-4074-a3f7-d2caf3c58969 could not be found. Aug 10 23:19:17.950698 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': '3ecbcf63-5592-4074-a3f7-d2caf3c58969'} Aug 10 23:19:17.950698 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:19:17.950698 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:19:17.950698 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:19:17.950698 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:19:17.950698 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:19:17.950698 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:19:17.950698 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:19:17.950698 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:19:17.950698 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:19:17.950698 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:19:17.950698 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ecbcf63-5592-4074-a3f7-d2caf3c58969 could not be found. Aug 10 23:19:17.950698 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:19:17.950698 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:19:17.950698 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:19:17.950698 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:19:17.950698 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:19:17.950698 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:19:17.950698 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:19:17.950698 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:19:17.950698 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:19:17.950698 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:19:17.950698 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:19:17.950698 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:19:17.950698 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:19:17.950698 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:19:17.950698 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:19:17.950698 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:19:17.950698 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ecbcf63-5592-4074-a3f7-d2caf3c58969 could not be found. Aug 10 23:19:17.950698 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:19:17.950698 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:19:17.957839 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:19:17.957839 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:19:17.957839 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:19:17.957839 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:19:17.957839 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:19:17.957839 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:19:17.957839 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ecbcf63-5592-4074-a3f7-d2caf3c58969 could not be found. Aug 10 23:19:17.957839 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:19:17.962129 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-6f974e15-4f2f-4144-87a2-cf5f77221c22 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Returning 404 to user: Instance 3ecbcf63-5592-4074-a3f7-d2caf3c58969 could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:19:17.964951 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-6f974e15-4f2f-4144-87a2-cf5f77221c22 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] 10.222.0.58 "GET /compute/v2.1/servers/3ecbcf63-5592-4074-a3f7-d2caf3c58969" status: 404 len: 111 microversion: 2.1 time: 0.123245 Aug 10 23:19:17.966268 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2388/4586] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:17 2022] GET /compute/v2.1/servers/3ecbcf63-5592-4074-a3f7-d2caf3c58969 => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:19:17.978062 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-dce0abee-835d-4d3c-81fd-a9f406e42bbf tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '.version_select at 0x7f847c1a3940>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:17.983635 n-d-850468-14 devstack@n-api.service[122633]: WARNING oslo_db.sqlalchemy.utils [None req-dce0abee-835d-4d3c-81fd-a9f406e42bbf tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 10 23:19:17.991486 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-dce0abee-835d-4d3c-81fd-a9f406e42bbf tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "GET /compute/v2.1/os-keypairs" status: 200 len: 351 microversion: 2.1 time: 0.021623 Aug 10 23:19:17.994439 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2389/4587] 10.222.0.58 () {58 vars in 1137 bytes} [Wed Aug 10 23:19:17 2022] GET /compute/v2.1/os-keypairs => generated 351 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:19:17.999732 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-80b08df8-0a6e-4e8a-a2c6-d3e348ea3c18 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:18.000862 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-80b08df8-0a6e-4e8a-a2c6-d3e348ea3c18 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: 7f49d27c-0fba-4d08-8f85-3eaed8b805e7] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:18.049051 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-80b08df8-0a6e-4e8a-a2c6-d3e348ea3c18 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:18.049951 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-80b08df8-0a6e-4e8a-a2c6-d3e348ea3c18 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:18.050408 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-80b08df8-0a6e-4e8a-a2c6-d3e348ea3c18 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:18.051163 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-80b08df8-0a6e-4e8a-a2c6-d3e348ea3c18 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:18.051624 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-80b08df8-0a6e-4e8a-a2c6-d3e348ea3c18 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:18.052050 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-80b08df8-0a6e-4e8a-a2c6-d3e348ea3c18 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:18.139793 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-80b08df8-0a6e-4e8a-a2c6-d3e348ea3c18 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: 7f49d27c-0fba-4d08-8f85-3eaed8b805e7] Going to try to terminate instance {{(pid=122633) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:19:18.165660 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.compute.api [None req-80b08df8-0a6e-4e8a-a2c6-d3e348ea3c18 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: 7f49d27c-0fba-4d08-8f85-3eaed8b805e7] Working on deleting snapshot fc32bd6f-2238-41e6-b936-9b11cc4f7530 from shelved instance... Aug 10 23:19:18.359356 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-0442332e-4e15-4028-a6a4-57e0f3d6fccf tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:18.373955 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-0442332e-4e15-4028-a6a4-57e0f3d6fccf tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:18.376187 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-0442332e-4e15-4028-a6a4-57e0f3d6fccf tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:18.377882 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-0442332e-4e15-4028-a6a4-57e0f3d6fccf tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] 10.222.0.58 "GET /compute/v2.1/servers/7e091da3-0636-4cba-b8de-94fdeecf0b7f" status: 200 len: 1875 microversion: 2.32 time: 1.115540 Aug 10 23:19:18.379688 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2199/4588] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:19:17 2022] GET /compute/v2.1/servers/7e091da3-0636-4cba-b8de-94fdeecf0b7f => generated 1875 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:19:18.396593 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-271d6fe9-e86e-4fa7-9037-1b3568f26aaa tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Calling method '.version_select at 0x7f846fd598b0>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:18.449250 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-271d6fe9-e86e-4fa7-9037-1b3568f26aaa tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1159157016" status: 202 len: 0 microversion: 2.1 time: 0.067146 Aug 10 23:19:18.451919 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2200/4589] 10.222.0.58 () {58 vars in 1221 bytes} [Wed Aug 10 23:19:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1159157016 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:19:18.466359 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-294f2d94-0537-48dc-8b52-53283a43e826 req-a32f51cc-cf14-43b1-b15d-7001d8b1476f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ecbcf63-5592-4074-a3f7-d2caf3c58969", "name": "network-vif-deleted", "tag": "4640966a-83e6-4989-a8a2-bbd72226c336"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:19:18.502026 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-294f2d94-0537-48dc-8b52-53283a43e826 req-a32f51cc-cf14-43b1-b15d-7001d8b1476f service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:18.503993 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-294f2d94-0537-48dc-8b52-53283a43e826 req-a32f51cc-cf14-43b1-b15d-7001d8b1476f service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:18.504891 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-294f2d94-0537-48dc-8b52-53283a43e826 req-a32f51cc-cf14-43b1-b15d-7001d8b1476f service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:18.542164 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-294f2d94-0537-48dc-8b52-53283a43e826 req-a32f51cc-cf14-43b1-b15d-7001d8b1476f service nova] Creating event network-vif-deleted:4640966a-83e6-4989-a8a2-bbd72226c336 for instance 3ecbcf63-5592-4074-a3f7-d2caf3c58969 on n-h1-850468-14 Aug 10 23:19:18.548991 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-294f2d94-0537-48dc-8b52-53283a43e826 req-a32f51cc-cf14-43b1-b15d-7001d8b1476f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093146 Aug 10 23:19:18.550533 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2201/4590] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:19:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:19:18.561171 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-bc4a9b9a-6360-4450-8720-c9a21dad8213 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-99902664", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452", "key_name": "tempest-key-1724435875", "networks": [{"uuid": "af9afbc6-0659-47e6-b542-cfe9f265fcc2"}]}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:19:18.671101 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.network.neutron [None req-bc4a9b9a-6360-4450-8720-c9a21dad8213 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] validate_networks() for [('af9afbc6-0659-47e6-b542-cfe9f265fcc2', None, None, None, None, None)] {{(pid=122632) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 23:19:19.575123 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-80b08df8-0a6e-4e8a-a2c6-d3e348ea3c18 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: 7f49d27c-0fba-4d08-8f85-3eaed8b805e7] Doing local delete in cell c9127db4-59f9-48ac-9ab2-b5d6690bb85f(cell1) {{(pid=122633) _delete /opt/stack/nova/nova/compute/api.py:2491}} Aug 10 23:19:19.576714 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-80b08df8-0a6e-4e8a-a2c6-d3e348ea3c18 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:19.577439 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-80b08df8-0a6e-4e8a-a2c6-d3e348ea3c18 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:19.578109 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-80b08df8-0a6e-4e8a-a2c6-d3e348ea3c18 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:19.578916 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.compute.api [None req-80b08df8-0a6e-4e8a-a2c6-d3e348ea3c18 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: 7f49d27c-0fba-4d08-8f85-3eaed8b805e7] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Aug 10 23:19:19.583414 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.network.neutron [None req-80b08df8-0a6e-4e8a-a2c6-d3e348ea3c18 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: 7f49d27c-0fba-4d08-8f85-3eaed8b805e7] deallocate_for_instance() {{(pid=122633) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Aug 10 23:19:20.240099 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-bc4a9b9a-6360-4450-8720-c9a21dad8213 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Flavor limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:19:20.243337 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-bc4a9b9a-6360-4450-8720-c9a21dad8213 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Image limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:19:20.244113 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-bc4a9b9a-6360-4450-8720-c9a21dad8213 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Flavor pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:19:20.244785 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-bc4a9b9a-6360-4450-8720-c9a21dad8213 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Image pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:19:20.245407 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-bc4a9b9a-6360-4450-8720-c9a21dad8213 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:19:20.261379 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bc4a9b9a-6360-4450-8720-c9a21dad8213 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:20.262181 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bc4a9b9a-6360-4450-8720-c9a21dad8213 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:20.263431 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bc4a9b9a-6360-4450-8720-c9a21dad8213 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:20.266348 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bc4a9b9a-6360-4450-8720-c9a21dad8213 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:20.267296 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bc4a9b9a-6360-4450-8720-c9a21dad8213 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:20.267953 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bc4a9b9a-6360-4450-8720-c9a21dad8213 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:20.318190 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-bc4a9b9a-6360-4450-8720-c9a21dad8213 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Getting quotas for project 0b0582ace9e4443b8ad88915503ee630. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:19:20.331743 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-bc4a9b9a-6360-4450-8720-c9a21dad8213 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Getting quotas for user 6684f0c87e4242be9e0ffb4ef1973f96 and project 0b0582ace9e4443b8ad88915503ee630. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:19:20.362371 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-bc4a9b9a-6360-4450-8720-c9a21dad8213 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Going to run 1 instances... {{(pid=122632) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 23:19:20.365344 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-bc4a9b9a-6360-4450-8720-c9a21dad8213 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: d3455c49-214c-4635-b28b-f87ff636e960] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78ad8905-f66f-4733-8be9-2b260f1fabed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122632) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 23:19:20.436117 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-bc4a9b9a-6360-4450-8720-c9a21dad8213 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.883139 Aug 10 23:19:20.437673 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2202/4591] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 23:19:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 1886 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 23:19:20.444593 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-4fc0dd2b-d9bd-4955-8139-e241ce285c2f tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:20.449513 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-4fc0dd2b-d9bd-4955-8139-e241ce285c2f tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] [instance: 7e091da3-0636-4cba-b8de-94fdeecf0b7f] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:20.461539 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4fc0dd2b-d9bd-4955-8139-e241ce285c2f tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:20.462473 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4fc0dd2b-d9bd-4955-8139-e241ce285c2f tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:20.463204 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4fc0dd2b-d9bd-4955-8139-e241ce285c2f tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:20.464209 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4fc0dd2b-d9bd-4955-8139-e241ce285c2f tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:20.464942 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4fc0dd2b-d9bd-4955-8139-e241ce285c2f tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:20.465591 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4fc0dd2b-d9bd-4955-8139-e241ce285c2f tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:21.118057 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-4fc0dd2b-d9bd-4955-8139-e241ce285c2f tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:21.131205 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-4fc0dd2b-d9bd-4955-8139-e241ce285c2f tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:21.137909 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-4fc0dd2b-d9bd-4955-8139-e241ce285c2f tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:21.140724 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-4fc0dd2b-d9bd-4955-8139-e241ce285c2f tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] 10.222.0.58 "GET /compute/v2.1/servers/7e091da3-0636-4cba-b8de-94fdeecf0b7f" status: 200 len: 1875 microversion: 2.32 time: 0.701786 Aug 10 23:19:21.153070 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2203/4592] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:19:20 2022] GET /compute/v2.1/servers/7e091da3-0636-4cba-b8de-94fdeecf0b7f => generated 1875 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:19:21.170266 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-3829f932-4725-40d1-9535-a128125182fa tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:21.171327 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-3829f932-4725-40d1-9535-a128125182fa tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: d3455c49-214c-4635-b28b-f87ff636e960] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:21.308862 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-3829f932-4725-40d1-9535-a128125182fa tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6684f0c87e4242be9e0ffb4ef1973f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0582ace9e4443b8ad88915503ee630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:21.324962 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-3829f932-4725-40d1-9535-a128125182fa tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "GET /compute/v2.1/servers/d3455c49-214c-4635-b28b-f87ff636e960" status: 200 len: 1227 microversion: 2.1 time: 0.159800 Aug 10 23:19:21.327734 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2204/4593] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:21 2022] GET /compute/v2.1/servers/d3455c49-214c-4635-b28b-f87ff636e960 => generated 1227 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:19:22.171023 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-7fa7bdb8-c9d0-4b00-8317-8621147ff832 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:22.173194 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-7fa7bdb8-c9d0-4b00-8317-8621147ff832 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] [instance: 7e091da3-0636-4cba-b8de-94fdeecf0b7f] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:22.203220 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7fa7bdb8-c9d0-4b00-8317-8621147ff832 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:22.204143 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7fa7bdb8-c9d0-4b00-8317-8621147ff832 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:22.205743 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7fa7bdb8-c9d0-4b00-8317-8621147ff832 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:22.207444 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7fa7bdb8-c9d0-4b00-8317-8621147ff832 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:22.211460 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7fa7bdb8-c9d0-4b00-8317-8621147ff832 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:22.212241 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7fa7bdb8-c9d0-4b00-8317-8621147ff832 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:22.771178 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-7fa7bdb8-c9d0-4b00-8317-8621147ff832 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:22.791428 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-7fa7bdb8-c9d0-4b00-8317-8621147ff832 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:22.796636 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-7fa7bdb8-c9d0-4b00-8317-8621147ff832 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:22.801760 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-7fa7bdb8-c9d0-4b00-8317-8621147ff832 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] 10.222.0.58 "GET /compute/v2.1/servers/7e091da3-0636-4cba-b8de-94fdeecf0b7f" status: 200 len: 1875 microversion: 2.32 time: 0.633110 Aug 10 23:19:22.807142 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2205/4594] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:19:22 2022] GET /compute/v2.1/servers/7e091da3-0636-4cba-b8de-94fdeecf0b7f => generated 1875 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:19:22.813707 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-688d71e3-c1ea-44f2-9db1-82e44a4ddab7 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:22.814701 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-688d71e3-c1ea-44f2-9db1-82e44a4ddab7 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: d3455c49-214c-4635-b28b-f87ff636e960] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:22.834650 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-688d71e3-c1ea-44f2-9db1-82e44a4ddab7 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:22.836396 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-688d71e3-c1ea-44f2-9db1-82e44a4ddab7 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:22.837173 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-688d71e3-c1ea-44f2-9db1-82e44a4ddab7 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:22.838633 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-688d71e3-c1ea-44f2-9db1-82e44a4ddab7 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:22.839369 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-688d71e3-c1ea-44f2-9db1-82e44a4ddab7 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:22.839961 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-688d71e3-c1ea-44f2-9db1-82e44a4ddab7 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:23.052958 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-688d71e3-c1ea-44f2-9db1-82e44a4ddab7 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6684f0c87e4242be9e0ffb4ef1973f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0582ace9e4443b8ad88915503ee630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:23.062480 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-688d71e3-c1ea-44f2-9db1-82e44a4ddab7 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "GET /compute/v2.1/servers/d3455c49-214c-4635-b28b-f87ff636e960" status: 200 len: 1287 microversion: 2.1 time: 0.253417 Aug 10 23:19:23.079770 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2206/4595] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:22 2022] GET /compute/v2.1/servers/d3455c49-214c-4635-b28b-f87ff636e960 => generated 1287 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:19:23.094616 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-3ad98972-e391-4fb6-96d9-49898defef39 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:23.095256 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-3ad98972-e391-4fb6-96d9-49898defef39 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] [instance: 69c4b403-a8ad-449c-a577-63837a6d2445] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:23.112761 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3ad98972-e391-4fb6-96d9-49898defef39 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:23.116545 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3ad98972-e391-4fb6-96d9-49898defef39 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:23.120029 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3ad98972-e391-4fb6-96d9-49898defef39 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:23.121114 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3ad98972-e391-4fb6-96d9-49898defef39 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:23.121768 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3ad98972-e391-4fb6-96d9-49898defef39 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:23.122776 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3ad98972-e391-4fb6-96d9-49898defef39 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:23.443375 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-3ad98972-e391-4fb6-96d9-49898defef39 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5899b2ad9f1046caaf7c6073e408eeee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25abd63376614081a9d484f3c9ae950d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:23.457515 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-3ad98972-e391-4fb6-96d9-49898defef39 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "GET /compute/v2.1/servers/69c4b403-a8ad-449c-a577-63837a6d2445" status: 200 len: 1566 microversion: 2.1 time: 0.374348 Aug 10 23:19:23.458492 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2207/4596] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:23 2022] GET /compute/v2.1/servers/69c4b403-a8ad-449c-a577-63837a6d2445 => generated 1566 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:19:23.466954 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-578ffeed-9f24-4ef7-b9c9-c946458b84dd req-c92df453-0e77-4006-bffb-2de16138a43a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69c4b403-a8ad-449c-a577-63837a6d2445", "tag": "8597a359-c6f1-46f8-9a07-e80725a3a36d"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:19:23.506884 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.network.neutron [None req-80b08df8-0a6e-4e8a-a2c6-d3e348ea3c18 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: 7f49d27c-0fba-4d08-8f85-3eaed8b805e7] Updating instance_info_cache with network_info: [] {{(pid=122633) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 10 23:19:23.520243 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-578ffeed-9f24-4ef7-b9c9-c946458b84dd req-c92df453-0e77-4006-bffb-2de16138a43a service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:23.520725 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-578ffeed-9f24-4ef7-b9c9-c946458b84dd req-c92df453-0e77-4006-bffb-2de16138a43a service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:23.523818 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-578ffeed-9f24-4ef7-b9c9-c946458b84dd req-c92df453-0e77-4006-bffb-2de16138a43a service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:23.576101 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-578ffeed-9f24-4ef7-b9c9-c946458b84dd req-c92df453-0e77-4006-bffb-2de16138a43a service nova] Creating event network-changed:8597a359-c6f1-46f8-9a07-e80725a3a36d for instance 69c4b403-a8ad-449c-a577-63837a6d2445 on n-h2-850468-14 Aug 10 23:19:23.590508 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-578ffeed-9f24-4ef7-b9c9-c946458b84dd req-c92df453-0e77-4006-bffb-2de16138a43a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128358 Aug 10 23:19:23.593323 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2208/4597] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:19:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:19:23.604100 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-7bda01ac-11af-4668-9e1f-78b18250b307 req-68d8c1d5-9323-4077-b51a-95a72235d36e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f49d27c-0fba-4d08-8f85-3eaed8b805e7", "name": "network-vif-deleted", "tag": "69ad680e-3222-4e16-9619-7f0a0d9623e5"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:19:23.661787 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-7bda01ac-11af-4668-9e1f-78b18250b307 req-68d8c1d5-9323-4077-b51a-95a72235d36e service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:23.662285 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-7bda01ac-11af-4668-9e1f-78b18250b307 req-68d8c1d5-9323-4077-b51a-95a72235d36e service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:23.662725 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-7bda01ac-11af-4668-9e1f-78b18250b307 req-68d8c1d5-9323-4077-b51a-95a72235d36e service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:23.704532 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.compute.server_external_events [req-7bda01ac-11af-4668-9e1f-78b18250b307 req-68d8c1d5-9323-4077-b51a-95a72235d36e service nova] Unable to find a host for instance 7f49d27c-0fba-4d08-8f85-3eaed8b805e7. Dropping event network-vif-deleted {{(pid=122632) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 10 23:19:23.708361 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-7bda01ac-11af-4668-9e1f-78b18250b307 req-68d8c1d5-9323-4077-b51a-95a72235d36e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.112614 Aug 10 23:19:23.709663 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2209/4598] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:19:23 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 115 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 10 23:19:23.832780 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-56d48be5-508d-4b56-a808-e6cdccd65054 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:23.833512 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-56d48be5-508d-4b56-a808-e6cdccd65054 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] [instance: 7e091da3-0636-4cba-b8de-94fdeecf0b7f] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:23.849951 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-56d48be5-508d-4b56-a808-e6cdccd65054 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:23.850466 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-56d48be5-508d-4b56-a808-e6cdccd65054 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:23.853660 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-56d48be5-508d-4b56-a808-e6cdccd65054 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:23.854493 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-56d48be5-508d-4b56-a808-e6cdccd65054 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:23.854998 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-56d48be5-508d-4b56-a808-e6cdccd65054 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:23.857862 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-56d48be5-508d-4b56-a808-e6cdccd65054 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:24.361142 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-80b08df8-0a6e-4e8a-a2c6-d3e348ea3c18 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "DELETE /compute/v2.1/servers/7f49d27c-0fba-4d08-8f85-3eaed8b805e7" status: 204 len: 0 microversion: 2.1 time: 6.356970 Aug 10 23:19:24.361142 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2390/4599] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:19:17 2022] DELETE /compute/v2.1/servers/7f49d27c-0fba-4d08-8f85-3eaed8b805e7 => generated 0 bytes in 6359 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:19:24.370754 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-8d7a701f-2371-4ed8-bf6d-749356df03e6 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:24.376499 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-8d7a701f-2371-4ed8-bf6d-749356df03e6 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: d3455c49-214c-4635-b28b-f87ff636e960] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:24.391833 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8d7a701f-2371-4ed8-bf6d-749356df03e6 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:24.392327 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8d7a701f-2371-4ed8-bf6d-749356df03e6 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:24.392764 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8d7a701f-2371-4ed8-bf6d-749356df03e6 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:24.396286 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8d7a701f-2371-4ed8-bf6d-749356df03e6 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:24.396779 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8d7a701f-2371-4ed8-bf6d-749356df03e6 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:24.397220 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8d7a701f-2371-4ed8-bf6d-749356df03e6 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:24.631096 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-8d7a701f-2371-4ed8-bf6d-749356df03e6 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6684f0c87e4242be9e0ffb4ef1973f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0582ace9e4443b8ad88915503ee630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:24.648790 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-8d7a701f-2371-4ed8-bf6d-749356df03e6 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "GET /compute/v2.1/servers/d3455c49-214c-4635-b28b-f87ff636e960" status: 200 len: 1285 microversion: 2.1 time: 0.285645 Aug 10 23:19:24.649429 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2391/4600] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:24 2022] GET /compute/v2.1/servers/d3455c49-214c-4635-b28b-f87ff636e960 => generated 1285 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:19:24.676219 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-fa41b020-0b1b-4572-ae56-77c1d2b38aeb tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:24.677038 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-fa41b020-0b1b-4572-ae56-77c1d2b38aeb tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: 7f49d27c-0fba-4d08-8f85-3eaed8b805e7] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:24.692211 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fa41b020-0b1b-4572-ae56-77c1d2b38aeb tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:24.696460 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fa41b020-0b1b-4572-ae56-77c1d2b38aeb tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:24.698342 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fa41b020-0b1b-4572-ae56-77c1d2b38aeb tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:24.699310 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fa41b020-0b1b-4572-ae56-77c1d2b38aeb tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:24.706211 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fa41b020-0b1b-4572-ae56-77c1d2b38aeb tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:24.706992 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fa41b020-0b1b-4572-ae56-77c1d2b38aeb tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:24.746524 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-fa41b020-0b1b-4572-ae56-77c1d2b38aeb tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] HTTP exception thrown: Instance 7f49d27c-0fba-4d08-8f85-3eaed8b805e7 could not be found. Aug 10 23:19:24.752485 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-fa41b020-0b1b-4572-ae56-77c1d2b38aeb tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Request method failure captured: Aug 10 23:19:24.752485 n-d-850468-14 devstack@n-api.service[122633]: request: GET /compute/v2.1/servers/7f49d27c-0fba-4d08-8f85-3eaed8b805e7 HTTP/1.1 Aug 10 23:19:24.752485 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:19:24.752485 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:19:24.752485 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:19:24.752485 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:19:24.752485 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:19:24.752485 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:19:24.752485 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:19:24.752485 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:19:24.752485 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9Drw0c2MsNlQk2xhClSBMImCg12_8SYgkoaKQkzmFSrheNUqLDbfnKYZ8D3mVjR4fUdjKeuub5tXKPuyho3Qbzr6min3JWaqN44jGsCPGM23nBipHIYVBpHQxUCRbFIS5jN95f9E_tT0WyV4NvgkZnorl71EuxY70xL3GkCDAg5oTLs Aug 10 23:19:24.752485 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:19:24.752485 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:19:24.752485 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:19:24.752485 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:19:24.752485 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:19:24.752485 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:19:24.752485 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 1eb12683ada249bfa2ca7bf5cf730ca3 Aug 10 23:19:24.752485 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-ServerActionsTestJSON-819186707 Aug 10 23:19:24.752485 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:19:24.752485 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:19:24.752485 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1eb12683ada249bfa2ca7bf5cf730ca3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1eb12683ada249bfa2ca7bf5cf730ca3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/1eb12683ada249bfa2ca7bf5cf730ca3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_1eb12683ada249bfa2ca7bf5cf730ca3", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:19:24.752485 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-ServerActionsTestJSON-819186707 Aug 10 23:19:24.752485 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 1eb12683ada249bfa2ca7bf5cf730ca3 Aug 10 23:19:24.752485 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-ServerActionsTestJSON-819186707 Aug 10 23:19:24.752485 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-ServerActionsTestJSON-819186707-project Aug 10 23:19:24.752485 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:19:24.752485 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:19:24.752485 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 2ea96841d5b64d2390d18b3eb5da8b73 Aug 10 23:19:24.752485 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-ServerActionsTestJSON-819186707-project Aug 10 23:19:24.752485 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:19:24.752485 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance 7f49d27c-0fba-4d08-8f85-3eaed8b805e7 could not be found. Aug 10 23:19:24.752485 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': '7f49d27c-0fba-4d08-8f85-3eaed8b805e7'} Aug 10 23:19:24.752485 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:19:24.752485 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:19:24.752485 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:19:24.752485 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:19:24.752485 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:19:24.752485 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:19:24.752485 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:19:24.752485 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:19:24.752485 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:19:24.752485 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:19:24.752485 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f49d27c-0fba-4d08-8f85-3eaed8b805e7 could not be found. Aug 10 23:19:24.752485 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:19:24.752485 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:19:24.752485 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:19:24.752485 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:19:24.752485 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:19:24.752485 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:19:24.752485 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:19:24.752485 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:19:24.752485 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:19:24.752485 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:19:24.752485 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:19:24.752485 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:19:24.752485 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:19:24.752485 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:19:24.752485 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:19:24.752485 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:19:24.752485 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f49d27c-0fba-4d08-8f85-3eaed8b805e7 could not be found. Aug 10 23:19:24.752485 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:19:24.752485 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:19:24.752485 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:19:24.758304 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:19:24.758304 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:19:24.758304 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:19:24.758304 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:19:24.758304 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:19:24.758304 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f49d27c-0fba-4d08-8f85-3eaed8b805e7 could not be found. Aug 10 23:19:24.758304 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:19:24.763059 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-fa41b020-0b1b-4572-ae56-77c1d2b38aeb tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Returning 404 to user: Instance 7f49d27c-0fba-4d08-8f85-3eaed8b805e7 could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:19:24.763952 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-fa41b020-0b1b-4572-ae56-77c1d2b38aeb tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/7f49d27c-0fba-4d08-8f85-3eaed8b805e7" status: 404 len: 111 microversion: 2.1 time: 0.104002 Aug 10 23:19:24.767999 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2392/4601] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:24 2022] GET /compute/v2.1/servers/7f49d27c-0fba-4d08-8f85-3eaed8b805e7 => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:19:24.773762 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-b0f3795b-a62c-4811-8259-c304498867a7 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:24.774564 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-b0f3795b-a62c-4811-8259-c304498867a7 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: 0a5d7302-9eab-4c27-9a4b-7c705e06c290] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:24.779181 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-56d48be5-508d-4b56-a808-e6cdccd65054 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:24.781601 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b0f3795b-a62c-4811-8259-c304498867a7 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:24.783084 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b0f3795b-a62c-4811-8259-c304498867a7 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:24.783780 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b0f3795b-a62c-4811-8259-c304498867a7 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:24.784750 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b0f3795b-a62c-4811-8259-c304498867a7 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:24.785419 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b0f3795b-a62c-4811-8259-c304498867a7 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:24.786182 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b0f3795b-a62c-4811-8259-c304498867a7 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:24.806283 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-56d48be5-508d-4b56-a808-e6cdccd65054 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:24.809499 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-56d48be5-508d-4b56-a808-e6cdccd65054 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:24.817522 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-56d48be5-508d-4b56-a808-e6cdccd65054 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] 10.222.0.58 "GET /compute/v2.1/servers/7e091da3-0636-4cba-b8de-94fdeecf0b7f" status: 200 len: 1875 microversion: 2.32 time: 0.988615 Aug 10 23:19:24.839939 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2210/4602] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:19:23 2022] GET /compute/v2.1/servers/7e091da3-0636-4cba-b8de-94fdeecf0b7f => generated 1875 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 23:19:24.879956 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-b0f3795b-a62c-4811-8259-c304498867a7 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: 0a5d7302-9eab-4c27-9a4b-7c705e06c290] Going to try to terminate instance {{(pid=122633) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:19:24.992947 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=19,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:19:25.130585 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-b0f3795b-a62c-4811-8259-c304498867a7 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "DELETE /compute/v2.1/servers/0a5d7302-9eab-4c27-9a4b-7c705e06c290" status: 204 len: 0 microversion: 2.1 time: 0.360128 Aug 10 23:19:25.133582 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2393/4603] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:19:24 2022] DELETE /compute/v2.1/servers/0a5d7302-9eab-4c27-9a4b-7c705e06c290 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:19:25.141857 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-b8a224ef-f698-4b85-b074-6b5d1d543dfa tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:25.142641 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-b8a224ef-f698-4b85-b074-6b5d1d543dfa tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: 0a5d7302-9eab-4c27-9a4b-7c705e06c290] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:25.159633 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b8a224ef-f698-4b85-b074-6b5d1d543dfa tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:25.162430 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b8a224ef-f698-4b85-b074-6b5d1d543dfa tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:25.162940 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b8a224ef-f698-4b85-b074-6b5d1d543dfa tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:25.164553 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b8a224ef-f698-4b85-b074-6b5d1d543dfa tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:25.165054 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b8a224ef-f698-4b85-b074-6b5d1d543dfa tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:25.165488 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b8a224ef-f698-4b85-b074-6b5d1d543dfa tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:25.242458 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=100 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:19:25.595077 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-b8a224ef-f698-4b85-b074-6b5d1d543dfa tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:25.606363 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-b8a224ef-f698-4b85-b074-6b5d1d543dfa tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/0a5d7302-9eab-4c27-9a4b-7c705e06c290" status: 200 len: 1465 microversion: 2.1 time: 0.469167 Aug 10 23:19:25.607241 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2211/4604] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:25 2022] GET /compute/v2.1/servers/0a5d7302-9eab-4c27-9a4b-7c705e06c290 => generated 1465 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:19:25.675705 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-1bba566b-2682-4847-ad19-a754b730edbe tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:25.676412 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-1bba566b-2682-4847-ad19-a754b730edbe tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: d3455c49-214c-4635-b28b-f87ff636e960] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:25.694751 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1bba566b-2682-4847-ad19-a754b730edbe tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:25.703853 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1bba566b-2682-4847-ad19-a754b730edbe tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:25.704427 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1bba566b-2682-4847-ad19-a754b730edbe tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:25.705196 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1bba566b-2682-4847-ad19-a754b730edbe tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:25.705662 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1bba566b-2682-4847-ad19-a754b730edbe tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:25.706088 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1bba566b-2682-4847-ad19-a754b730edbe tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:25.853160 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-e0152924-ed98-4451-bd1f-581c5d2f81f9 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:25.854405 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-e0152924-ed98-4451-bd1f-581c5d2f81f9 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] [instance: 7e091da3-0636-4cba-b8de-94fdeecf0b7f] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:25.864440 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e0152924-ed98-4451-bd1f-581c5d2f81f9 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:25.868500 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e0152924-ed98-4451-bd1f-581c5d2f81f9 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:25.871354 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e0152924-ed98-4451-bd1f-581c5d2f81f9 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:25.872090 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e0152924-ed98-4451-bd1f-581c5d2f81f9 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:25.872550 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e0152924-ed98-4451-bd1f-581c5d2f81f9 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:25.872979 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e0152924-ed98-4451-bd1f-581c5d2f81f9 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:25.901372 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-1bba566b-2682-4847-ad19-a754b730edbe tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6684f0c87e4242be9e0ffb4ef1973f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0582ace9e4443b8ad88915503ee630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:25.910232 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-1bba566b-2682-4847-ad19-a754b730edbe tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "GET /compute/v2.1/servers/d3455c49-214c-4635-b28b-f87ff636e960" status: 200 len: 1285 microversion: 2.1 time: 0.239604 Aug 10 23:19:25.918089 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2394/4605] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:25 2022] GET /compute/v2.1/servers/d3455c49-214c-4635-b28b-f87ff636e960 => generated 1285 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:19:26.630998 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-19bab477-af67-44eb-8073-b35929bd8c6d tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:26.632013 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-19bab477-af67-44eb-8073-b35929bd8c6d tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: 0a5d7302-9eab-4c27-9a4b-7c705e06c290] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:26.642175 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-19bab477-af67-44eb-8073-b35929bd8c6d tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:26.643365 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-19bab477-af67-44eb-8073-b35929bd8c6d tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:26.643926 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-19bab477-af67-44eb-8073-b35929bd8c6d tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:26.644769 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-19bab477-af67-44eb-8073-b35929bd8c6d tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:26.645679 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-19bab477-af67-44eb-8073-b35929bd8c6d tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:26.647245 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-19bab477-af67-44eb-8073-b35929bd8c6d tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:26.837494 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-19bab477-af67-44eb-8073-b35929bd8c6d tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:26.851499 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-19bab477-af67-44eb-8073-b35929bd8c6d tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/0a5d7302-9eab-4c27-9a4b-7c705e06c290" status: 200 len: 1465 microversion: 2.1 time: 0.222823 Aug 10 23:19:26.866063 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2395/4606] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:26 2022] GET /compute/v2.1/servers/0a5d7302-9eab-4c27-9a4b-7c705e06c290 => generated 1465 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:19:26.936675 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-2c2cb9e6-dd9c-437f-9e3a-e9058eed7888 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:26.937633 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-2c2cb9e6-dd9c-437f-9e3a-e9058eed7888 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: d3455c49-214c-4635-b28b-f87ff636e960] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:26.948922 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2c2cb9e6-dd9c-437f-9e3a-e9058eed7888 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:26.949594 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2c2cb9e6-dd9c-437f-9e3a-e9058eed7888 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:26.951545 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2c2cb9e6-dd9c-437f-9e3a-e9058eed7888 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:26.952400 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2c2cb9e6-dd9c-437f-9e3a-e9058eed7888 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:26.954726 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2c2cb9e6-dd9c-437f-9e3a-e9058eed7888 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:26.955459 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2c2cb9e6-dd9c-437f-9e3a-e9058eed7888 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:27.271154 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-e0152924-ed98-4451-bd1f-581c5d2f81f9 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:27.290549 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-e0152924-ed98-4451-bd1f-581c5d2f81f9 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:27.292233 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-e0152924-ed98-4451-bd1f-581c5d2f81f9 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:27.293429 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-e0152924-ed98-4451-bd1f-581c5d2f81f9 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] 10.222.0.58 "GET /compute/v2.1/servers/7e091da3-0636-4cba-b8de-94fdeecf0b7f" status: 200 len: 1875 microversion: 2.32 time: 1.445807 Aug 10 23:19:27.308249 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2212/4607] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:19:25 2022] GET /compute/v2.1/servers/7e091da3-0636-4cba-b8de-94fdeecf0b7f => generated 1875 bytes in 1461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:19:27.515107 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-03c2d812-a2f4-4113-bee5-7d74227b57ec tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-858173259-access_point-605346919", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452", "networks": [{"uuid": "5abce3cd-10a8-430d-a898-64354d612590"}], "key_name": "tempest-TestSecurityGroupsBasicOps-295433155", "security_groups": [{"name": "tempest-secgroup_access--994341053"}, {"name": "tempest-secgroup_general--1337351767"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:19:27.560487 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-2c2cb9e6-dd9c-437f-9e3a-e9058eed7888 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6684f0c87e4242be9e0ffb4ef1973f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0582ace9e4443b8ad88915503ee630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:27.574172 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-2c2cb9e6-dd9c-437f-9e3a-e9058eed7888 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "GET /compute/v2.1/servers/d3455c49-214c-4635-b28b-f87ff636e960" status: 200 len: 1327 microversion: 2.1 time: 0.639578 Aug 10 23:19:27.577782 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2396/4608] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:26 2022] GET /compute/v2.1/servers/d3455c49-214c-4635-b28b-f87ff636e960 => generated 1327 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:19:27.591082 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-6b2283f0-6b98-460b-9396-5e8237777761 req-d4336584-0f7e-4666-b486-372931fa0363 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a5d7302-9eab-4c27-9a4b-7c705e06c290", "name": "network-vif-deleted", "tag": "b753ef0a-169a-496f-ba6e-46e3a214c4f8"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:19:27.637180 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-6b2283f0-6b98-460b-9396-5e8237777761 req-d4336584-0f7e-4666-b486-372931fa0363 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:27.639838 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-6b2283f0-6b98-460b-9396-5e8237777761 req-d4336584-0f7e-4666-b486-372931fa0363 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:27.640875 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-6b2283f0-6b98-460b-9396-5e8237777761 req-d4336584-0f7e-4666-b486-372931fa0363 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:27.677930 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-6b2283f0-6b98-460b-9396-5e8237777761 req-d4336584-0f7e-4666-b486-372931fa0363 service nova] Creating event network-vif-deleted:b753ef0a-169a-496f-ba6e-46e3a214c4f8 for instance 0a5d7302-9eab-4c27-9a4b-7c705e06c290 on n-h1-850468-14 Aug 10 23:19:27.692007 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-6b2283f0-6b98-460b-9396-5e8237777761 req-d4336584-0f7e-4666-b486-372931fa0363 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112372 Aug 10 23:19:27.697150 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2397/4609] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:19:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:19:27.880098 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-e31d867e-9439-4313-87ce-8bba0eb14a26 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:27.881565 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-e31d867e-9439-4313-87ce-8bba0eb14a26 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: 0a5d7302-9eab-4c27-9a4b-7c705e06c290] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:27.906414 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e31d867e-9439-4313-87ce-8bba0eb14a26 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:27.907402 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e31d867e-9439-4313-87ce-8bba0eb14a26 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:27.911052 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e31d867e-9439-4313-87ce-8bba0eb14a26 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:27.913388 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e31d867e-9439-4313-87ce-8bba0eb14a26 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:27.914215 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e31d867e-9439-4313-87ce-8bba0eb14a26 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:27.916490 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e31d867e-9439-4313-87ce-8bba0eb14a26 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:28.016216 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e31d867e-9439-4313-87ce-8bba0eb14a26 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:28.016959 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e31d867e-9439-4313-87ce-8bba0eb14a26 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:28.017598 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e31d867e-9439-4313-87ce-8bba0eb14a26 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:28.018297 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.objects.instance [None req-e31d867e-9439-4313-87ce-8bba0eb14a26 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lazy-loading 'fault' on Instance uuid 0a5d7302-9eab-4c27-9a4b-7c705e06c290 {{(pid=122633) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:19:28.183923 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-e31d867e-9439-4313-87ce-8bba0eb14a26 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:28.196659 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-e31d867e-9439-4313-87ce-8bba0eb14a26 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/0a5d7302-9eab-4c27-9a4b-7c705e06c290" status: 200 len: 1305 microversion: 2.1 time: 0.325417 Aug 10 23:19:28.197494 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2398/4610] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:27 2022] GET /compute/v2.1/servers/0a5d7302-9eab-4c27-9a4b-7c705e06c290 => generated 1305 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:19:28.269130 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.network.neutron [None req-03c2d812-a2f4-4113-bee5-7d74227b57ec tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] validate_networks() for [('5abce3cd-10a8-430d-a898-64354d612590', None, None, None, None, None)] {{(pid=122632) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 23:19:28.333155 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-3c73b45b-7c8a-4a4d-a133-862bc0ea4afe tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:28.334968 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-3c73b45b-7c8a-4a4d-a133-862bc0ea4afe tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] [instance: 7e091da3-0636-4cba-b8de-94fdeecf0b7f] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:28.346454 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3c73b45b-7c8a-4a4d-a133-862bc0ea4afe tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:28.356560 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3c73b45b-7c8a-4a4d-a133-862bc0ea4afe tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:28.359506 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3c73b45b-7c8a-4a4d-a133-862bc0ea4afe tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:28.360900 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3c73b45b-7c8a-4a4d-a133-862bc0ea4afe tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:28.368740 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3c73b45b-7c8a-4a4d-a133-862bc0ea4afe tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:28.375571 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3c73b45b-7c8a-4a4d-a133-862bc0ea4afe tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:28.958287 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-3c73b45b-7c8a-4a4d-a133-862bc0ea4afe tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:28.974750 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-3c73b45b-7c8a-4a4d-a133-862bc0ea4afe tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:28.976863 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-3c73b45b-7c8a-4a4d-a133-862bc0ea4afe tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:28.978078 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-3c73b45b-7c8a-4a4d-a133-862bc0ea4afe tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] 10.222.0.58 "GET /compute/v2.1/servers/7e091da3-0636-4cba-b8de-94fdeecf0b7f" status: 200 len: 1875 microversion: 2.32 time: 0.659572 Aug 10 23:19:28.979252 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2399/4611] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:19:28 2022] GET /compute/v2.1/servers/7e091da3-0636-4cba-b8de-94fdeecf0b7f => generated 1875 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:19:28.984287 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-ee41a9d5-f74c-402d-b51b-1794df42012c tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:28.986815 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-ee41a9d5-f74c-402d-b51b-1794df42012c tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: d3455c49-214c-4635-b28b-f87ff636e960] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:28.995739 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ee41a9d5-f74c-402d-b51b-1794df42012c tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:28.996512 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ee41a9d5-f74c-402d-b51b-1794df42012c tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:28.997746 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ee41a9d5-f74c-402d-b51b-1794df42012c tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:28.998665 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ee41a9d5-f74c-402d-b51b-1794df42012c tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:28.999517 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ee41a9d5-f74c-402d-b51b-1794df42012c tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:29.000194 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ee41a9d5-f74c-402d-b51b-1794df42012c tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:29.425596 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-ee41a9d5-f74c-402d-b51b-1794df42012c tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6684f0c87e4242be9e0ffb4ef1973f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0582ace9e4443b8ad88915503ee630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:29.437807 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-03c2d812-a2f4-4113-bee5-7d74227b57ec tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Flavor limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:19:29.438580 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-03c2d812-a2f4-4113-bee5-7d74227b57ec tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Image limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:19:29.439086 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-03c2d812-a2f4-4113-bee5-7d74227b57ec tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Flavor pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:19:29.439228 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-03c2d812-a2f4-4113-bee5-7d74227b57ec tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Image pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:19:29.439621 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-03c2d812-a2f4-4113-bee5-7d74227b57ec tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:19:29.443157 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-ee41a9d5-f74c-402d-b51b-1794df42012c tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "GET /compute/v2.1/servers/d3455c49-214c-4635-b28b-f87ff636e960" status: 200 len: 1327 microversion: 2.1 time: 0.461183 Aug 10 23:19:29.445070 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2400/4612] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:28 2022] GET /compute/v2.1/servers/d3455c49-214c-4635-b28b-f87ff636e960 => generated 1327 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:19:29.453970 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-03c2d812-a2f4-4113-bee5-7d74227b57ec tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:29.454815 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-03c2d812-a2f4-4113-bee5-7d74227b57ec tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:29.460735 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-03c2d812-a2f4-4113-bee5-7d74227b57ec tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:29.461890 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-03c2d812-a2f4-4113-bee5-7d74227b57ec tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:29.462679 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-2d775575-6e2d-4031-9c50-1b1d2bb897d7 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:29.463931 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-03c2d812-a2f4-4113-bee5-7d74227b57ec tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:29.464809 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-2d775575-6e2d-4031-9c50-1b1d2bb897d7 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: 0a5d7302-9eab-4c27-9a4b-7c705e06c290] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:29.465447 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-03c2d812-a2f4-4113-bee5-7d74227b57ec tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:29.480332 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2d775575-6e2d-4031-9c50-1b1d2bb897d7 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:29.480929 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2d775575-6e2d-4031-9c50-1b1d2bb897d7 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:29.481771 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2d775575-6e2d-4031-9c50-1b1d2bb897d7 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:29.486149 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2d775575-6e2d-4031-9c50-1b1d2bb897d7 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:29.486859 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2d775575-6e2d-4031-9c50-1b1d2bb897d7 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:29.490006 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2d775575-6e2d-4031-9c50-1b1d2bb897d7 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:29.524754 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-2d775575-6e2d-4031-9c50-1b1d2bb897d7 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] HTTP exception thrown: Instance 0a5d7302-9eab-4c27-9a4b-7c705e06c290 could not be found. Aug 10 23:19:29.529479 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-2d775575-6e2d-4031-9c50-1b1d2bb897d7 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Request method failure captured: Aug 10 23:19:29.529479 n-d-850468-14 devstack@n-api.service[122633]: request: GET /compute/v2.1/servers/0a5d7302-9eab-4c27-9a4b-7c705e06c290 HTTP/1.1 Aug 10 23:19:29.529479 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:19:29.529479 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:19:29.529479 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:19:29.529479 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:19:29.529479 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:19:29.529479 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:19:29.529479 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:19:29.529479 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:19:29.529479 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9Drw0c2MsNlQk2xhClSBMImCg12_8SYgkoaKQkzmFSrheNUqLDbfnKYZ8D3mVjR4fUdjKeuub5tXKPuyho3Qbzr6min3JWaqN44jGsCPGM23nBipHIYVBpHQxUCRbFIS5jN95f9E_tT0WyV4NvgkZnorl71EuxY70xL3GkCDAg5oTLs Aug 10 23:19:29.529479 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:19:29.529479 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:19:29.529479 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:19:29.529479 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:19:29.529479 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:19:29.529479 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:19:29.529479 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 1eb12683ada249bfa2ca7bf5cf730ca3 Aug 10 23:19:29.529479 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-ServerActionsTestJSON-819186707 Aug 10 23:19:29.529479 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:19:29.529479 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:19:29.529479 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1eb12683ada249bfa2ca7bf5cf730ca3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1eb12683ada249bfa2ca7bf5cf730ca3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/1eb12683ada249bfa2ca7bf5cf730ca3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_1eb12683ada249bfa2ca7bf5cf730ca3", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:19:29.529479 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-ServerActionsTestJSON-819186707 Aug 10 23:19:29.529479 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 1eb12683ada249bfa2ca7bf5cf730ca3 Aug 10 23:19:29.529479 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-ServerActionsTestJSON-819186707 Aug 10 23:19:29.529479 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-ServerActionsTestJSON-819186707-project Aug 10 23:19:29.529479 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:19:29.529479 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:19:29.529479 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 2ea96841d5b64d2390d18b3eb5da8b73 Aug 10 23:19:29.529479 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-ServerActionsTestJSON-819186707-project Aug 10 23:19:29.529479 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:19:29.529479 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance 0a5d7302-9eab-4c27-9a4b-7c705e06c290 could not be found. Aug 10 23:19:29.529479 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': '0a5d7302-9eab-4c27-9a4b-7c705e06c290'} Aug 10 23:19:29.529479 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:19:29.529479 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:19:29.529479 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:19:29.529479 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:19:29.529479 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:19:29.529479 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:19:29.529479 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:19:29.529479 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:19:29.529479 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:19:29.529479 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:19:29.529479 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a5d7302-9eab-4c27-9a4b-7c705e06c290 could not be found. Aug 10 23:19:29.529479 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:19:29.529479 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:19:29.529479 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:19:29.529479 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:19:29.529479 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:19:29.529479 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:19:29.529479 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:19:29.529479 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:19:29.529479 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:19:29.529479 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:19:29.529479 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:19:29.529479 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:19:29.529479 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:19:29.529479 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:19:29.529479 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:19:29.529479 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:19:29.529479 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a5d7302-9eab-4c27-9a4b-7c705e06c290 could not be found. Aug 10 23:19:29.529479 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:19:29.529479 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:19:29.529479 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:19:29.534297 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:19:29.534297 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:19:29.534297 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:19:29.534297 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:19:29.534297 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:19:29.534297 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a5d7302-9eab-4c27-9a4b-7c705e06c290 could not be found. Aug 10 23:19:29.534297 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:19:29.537403 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-2d775575-6e2d-4031-9c50-1b1d2bb897d7 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Returning 404 to user: Instance 0a5d7302-9eab-4c27-9a4b-7c705e06c290 could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:19:29.539728 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-2d775575-6e2d-4031-9c50-1b1d2bb897d7 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/0a5d7302-9eab-4c27-9a4b-7c705e06c290" status: 404 len: 111 microversion: 2.1 time: 0.091576 Aug 10 23:19:29.547545 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2401/4613] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:29 2022] GET /compute/v2.1/servers/0a5d7302-9eab-4c27-9a4b-7c705e06c290 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:19:29.559996 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-ad0b22fa-30e9-42a4-a1f4-f81b72b64fbf tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:29.560805 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-ad0b22fa-30e9-42a4-a1f4-f81b72b64fbf tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: 1da4d99f-4cb0-4533-bda8-3bda03205e07] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:29.577612 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ad0b22fa-30e9-42a4-a1f4-f81b72b64fbf tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:29.579397 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ad0b22fa-30e9-42a4-a1f4-f81b72b64fbf tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:29.581890 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ad0b22fa-30e9-42a4-a1f4-f81b72b64fbf tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:29.582870 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ad0b22fa-30e9-42a4-a1f4-f81b72b64fbf tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:29.585749 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ad0b22fa-30e9-42a4-a1f4-f81b72b64fbf tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:29.586859 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ad0b22fa-30e9-42a4-a1f4-f81b72b64fbf tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:29.705047 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-ad0b22fa-30e9-42a4-a1f4-f81b72b64fbf tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: 1da4d99f-4cb0-4533-bda8-3bda03205e07] Going to try to terminate instance {{(pid=122633) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:19:29.914562 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-ad0b22fa-30e9-42a4-a1f4-f81b72b64fbf tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "DELETE /compute/v2.1/servers/1da4d99f-4cb0-4533-bda8-3bda03205e07" status: 204 len: 0 microversion: 2.1 time: 0.361964 Aug 10 23:19:29.915615 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2402/4614] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:19:29 2022] DELETE /compute/v2.1/servers/1da4d99f-4cb0-4533-bda8-3bda03205e07 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:19:29.931726 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c12f565e-77a8-4f62-8cd7-96b4fc8e4b7a tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:29.936173 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-c12f565e-77a8-4f62-8cd7-96b4fc8e4b7a tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: 1da4d99f-4cb0-4533-bda8-3bda03205e07] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:29.952523 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c12f565e-77a8-4f62-8cd7-96b4fc8e4b7a tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:29.953104 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c12f565e-77a8-4f62-8cd7-96b4fc8e4b7a tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:29.959502 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c12f565e-77a8-4f62-8cd7-96b4fc8e4b7a tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:29.971414 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c12f565e-77a8-4f62-8cd7-96b4fc8e4b7a tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:29.971929 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c12f565e-77a8-4f62-8cd7-96b4fc8e4b7a tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:29.972383 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c12f565e-77a8-4f62-8cd7-96b4fc8e4b7a tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:30.016829 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-03c2d812-a2f4-4113-bee5-7d74227b57ec tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Getting quotas for project 2cb5f5856c46490ab1ded572d693c4cc. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:19:30.028394 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-03c2d812-a2f4-4113-bee5-7d74227b57ec tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Getting quotas for user 627b163f1a0e4fdeb0e9692e7d37460d and project 2cb5f5856c46490ab1ded572d693c4cc. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:19:30.047685 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-03c2d812-a2f4-4113-bee5-7d74227b57ec tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Going to run 1 instances... {{(pid=122632) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 23:19:30.051641 n-d-850468-14 devstack@n-api.service[122632]: WARNING nova.utils [None req-03c2d812-a2f4-4113-bee5-7d74227b57ec tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-858173259-access_point-605346919 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-858173259-acc Aug 10 23:19:30.052687 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-03c2d812-a2f4-4113-bee5-7d74227b57ec tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] [instance: ee6a796b-efa5-4c73-8776-d86b54ca2190] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78ad8905-f66f-4733-8be9-2b260f1fabed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122632) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 23:19:30.147107 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-03c2d812-a2f4-4113-bee5-7d74227b57ec tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 457 microversion: 2.1 time: 2.636496 Aug 10 23:19:30.150754 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2213/4615] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 23:19:27 2022] POST /compute/v2.1/servers => generated 457 bytes in 2641 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 23:19:30.164760 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-20bfbab8-e6b7-4a57-80b6-2842c182b91d tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:30.166255 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-20bfbab8-e6b7-4a57-80b6-2842c182b91d tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] [instance: 7e091da3-0636-4cba-b8de-94fdeecf0b7f] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:30.189911 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-20bfbab8-e6b7-4a57-80b6-2842c182b91d tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:30.190507 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-20bfbab8-e6b7-4a57-80b6-2842c182b91d tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:30.191072 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-20bfbab8-e6b7-4a57-80b6-2842c182b91d tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:30.193381 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-20bfbab8-e6b7-4a57-80b6-2842c182b91d tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:30.193861 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-20bfbab8-e6b7-4a57-80b6-2842c182b91d tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:30.194832 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-20bfbab8-e6b7-4a57-80b6-2842c182b91d tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:30.331624 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-c12f565e-77a8-4f62-8cd7-96b4fc8e4b7a tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:30.341906 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-c12f565e-77a8-4f62-8cd7-96b4fc8e4b7a tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/1da4d99f-4cb0-4533-bda8-3bda03205e07" status: 200 len: 1508 microversion: 2.1 time: 0.421609 Aug 10 23:19:30.343042 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2403/4616] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:29 2022] GET /compute/v2.1/servers/1da4d99f-4cb0-4533-bda8-3bda03205e07 => generated 1508 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:19:30.348011 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-cd6377d3-ab2e-4bf6-8494-d211639bc162 req-784bc240-8169-4604-8a12-5438b623eb13 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3455c49-214c-4635-b28b-f87ff636e960", "tag": "6dfabd56-dd78-4f9a-89be-a1bea2f40277"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:19:30.381771 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-cd6377d3-ab2e-4bf6-8494-d211639bc162 req-784bc240-8169-4604-8a12-5438b623eb13 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:30.392594 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-cd6377d3-ab2e-4bf6-8494-d211639bc162 req-784bc240-8169-4604-8a12-5438b623eb13 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:30.393047 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-cd6377d3-ab2e-4bf6-8494-d211639bc162 req-784bc240-8169-4604-8a12-5438b623eb13 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:30.429627 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-cd6377d3-ab2e-4bf6-8494-d211639bc162 req-784bc240-8169-4604-8a12-5438b623eb13 service nova] Creating event network-changed:6dfabd56-dd78-4f9a-89be-a1bea2f40277 for instance d3455c49-214c-4635-b28b-f87ff636e960 on n-h1-850468-14 Aug 10 23:19:30.447661 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-cd6377d3-ab2e-4bf6-8494-d211639bc162 req-784bc240-8169-4604-8a12-5438b623eb13 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103123 Aug 10 23:19:30.448576 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2404/4617] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:19:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:19:30.457136 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-506c7940-d73b-4504-be6d-704e55823e6c tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:30.474390 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-506c7940-d73b-4504-be6d-704e55823e6c tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] [instance: ee6a796b-efa5-4c73-8776-d86b54ca2190] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:30.483896 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=4 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:19:30.574178 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-506c7940-d73b-4504-be6d-704e55823e6c tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '627b163f1a0e4fdeb0e9692e7d37460d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb5f5856c46490ab1ded572d693c4cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:30.587009 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-506c7940-d73b-4504-be6d-704e55823e6c tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] 10.222.0.58 "GET /compute/v2.1/servers/ee6a796b-efa5-4c73-8776-d86b54ca2190" status: 200 len: 1292 microversion: 2.1 time: 0.132813 Aug 10 23:19:30.587221 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2405/4618] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:30 2022] GET /compute/v2.1/servers/ee6a796b-efa5-4c73-8776-d86b54ca2190 => generated 1292 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:19:30.603526 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-cefd4de7-75e5-4984-8558-499141711111 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:30.607750 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-cefd4de7-75e5-4984-8558-499141711111 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: d3455c49-214c-4635-b28b-f87ff636e960] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:30.624565 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cefd4de7-75e5-4984-8558-499141711111 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:30.625373 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cefd4de7-75e5-4984-8558-499141711111 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:30.626157 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cefd4de7-75e5-4984-8558-499141711111 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:30.627170 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cefd4de7-75e5-4984-8558-499141711111 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:30.629333 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cefd4de7-75e5-4984-8558-499141711111 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:30.629962 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cefd4de7-75e5-4984-8558-499141711111 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:30.854255 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-cefd4de7-75e5-4984-8558-499141711111 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6684f0c87e4242be9e0ffb4ef1973f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0582ace9e4443b8ad88915503ee630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:30.865113 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-cefd4de7-75e5-4984-8558-499141711111 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "GET /compute/v2.1/servers/d3455c49-214c-4635-b28b-f87ff636e960" status: 200 len: 1327 microversion: 2.1 time: 0.276714 Aug 10 23:19:30.866342 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2406/4619] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:30 2022] GET /compute/v2.1/servers/d3455c49-214c-4635-b28b-f87ff636e960 => generated 1327 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:19:30.969276 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-20bfbab8-e6b7-4a57-80b6-2842c182b91d tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:30.994817 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-20bfbab8-e6b7-4a57-80b6-2842c182b91d tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:31.002919 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-20bfbab8-e6b7-4a57-80b6-2842c182b91d tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:31.014243 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-20bfbab8-e6b7-4a57-80b6-2842c182b91d tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] 10.222.0.58 "GET /compute/v2.1/servers/7e091da3-0636-4cba-b8de-94fdeecf0b7f" status: 200 len: 1875 microversion: 2.32 time: 0.860687 Aug 10 23:19:31.052584 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2214/4620] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:19:30 2022] GET /compute/v2.1/servers/7e091da3-0636-4cba-b8de-94fdeecf0b7f => generated 1875 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:19:31.364160 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-4c17e55d-c199-4cbf-94c4-1bb9bac23052 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:31.365593 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-4c17e55d-c199-4cbf-94c4-1bb9bac23052 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: 1da4d99f-4cb0-4533-bda8-3bda03205e07] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:31.375580 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4c17e55d-c199-4cbf-94c4-1bb9bac23052 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:31.379068 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4c17e55d-c199-4cbf-94c4-1bb9bac23052 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:31.382341 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4c17e55d-c199-4cbf-94c4-1bb9bac23052 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:31.384199 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4c17e55d-c199-4cbf-94c4-1bb9bac23052 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:31.385793 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4c17e55d-c199-4cbf-94c4-1bb9bac23052 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:31.387074 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4c17e55d-c199-4cbf-94c4-1bb9bac23052 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:31.611403 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-b782151c-f047-4444-ab3e-73cd3563ac0e tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:31.613529 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-b782151c-f047-4444-ab3e-73cd3563ac0e tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] [instance: ee6a796b-efa5-4c73-8776-d86b54ca2190] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:31.644149 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b782151c-f047-4444-ab3e-73cd3563ac0e tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:31.644962 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b782151c-f047-4444-ab3e-73cd3563ac0e tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:31.646546 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b782151c-f047-4444-ab3e-73cd3563ac0e tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:31.649577 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b782151c-f047-4444-ab3e-73cd3563ac0e tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:31.652231 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b782151c-f047-4444-ab3e-73cd3563ac0e tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:31.652857 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b782151c-f047-4444-ab3e-73cd3563ac0e tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:31.910237 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-b782151c-f047-4444-ab3e-73cd3563ac0e tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '627b163f1a0e4fdeb0e9692e7d37460d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb5f5856c46490ab1ded572d693c4cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:31.927071 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-b782151c-f047-4444-ab3e-73cd3563ac0e tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] 10.222.0.58 "GET /compute/v2.1/servers/ee6a796b-efa5-4c73-8776-d86b54ca2190" status: 200 len: 1296 microversion: 2.1 time: 0.322926 Aug 10 23:19:31.927913 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2215/4621] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:31 2022] GET /compute/v2.1/servers/ee6a796b-efa5-4c73-8776-d86b54ca2190 => generated 1296 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:19:31.937063 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-738402f0-80e6-4abc-987a-b408113630f0 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:31.939975 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-738402f0-80e6-4abc-987a-b408113630f0 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: d3455c49-214c-4635-b28b-f87ff636e960] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:31.950941 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-738402f0-80e6-4abc-987a-b408113630f0 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:31.956550 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-738402f0-80e6-4abc-987a-b408113630f0 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:31.957364 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-738402f0-80e6-4abc-987a-b408113630f0 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:31.958341 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-738402f0-80e6-4abc-987a-b408113630f0 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:31.959059 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-738402f0-80e6-4abc-987a-b408113630f0 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:31.960088 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-738402f0-80e6-4abc-987a-b408113630f0 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:32.114165 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-4c17e55d-c199-4cbf-94c4-1bb9bac23052 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:32.125316 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-4c17e55d-c199-4cbf-94c4-1bb9bac23052 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/1da4d99f-4cb0-4533-bda8-3bda03205e07" status: 200 len: 1508 microversion: 2.1 time: 0.765447 Aug 10 23:19:32.128784 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2407/4622] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:31 2022] GET /compute/v2.1/servers/1da4d99f-4cb0-4533-bda8-3bda03205e07 => generated 1508 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:19:32.141196 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-3784cfbb-6a73-4683-9987-ca672779fdb5 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:32.143453 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-3784cfbb-6a73-4683-9987-ca672779fdb5 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] [instance: 7e091da3-0636-4cba-b8de-94fdeecf0b7f] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:32.160072 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3784cfbb-6a73-4683-9987-ca672779fdb5 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:32.162396 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3784cfbb-6a73-4683-9987-ca672779fdb5 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:32.163681 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3784cfbb-6a73-4683-9987-ca672779fdb5 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:32.167498 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3784cfbb-6a73-4683-9987-ca672779fdb5 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:32.168505 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3784cfbb-6a73-4683-9987-ca672779fdb5 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:32.170232 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3784cfbb-6a73-4683-9987-ca672779fdb5 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:32.611607 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-3784cfbb-6a73-4683-9987-ca672779fdb5 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:32.630503 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-3784cfbb-6a73-4683-9987-ca672779fdb5 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:32.633961 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-3784cfbb-6a73-4683-9987-ca672779fdb5 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:32.635869 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-3784cfbb-6a73-4683-9987-ca672779fdb5 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] 10.222.0.58 "GET /compute/v2.1/servers/7e091da3-0636-4cba-b8de-94fdeecf0b7f" status: 200 len: 1875 microversion: 2.32 time: 0.504023 Aug 10 23:19:32.652341 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2408/4623] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:19:32 2022] GET /compute/v2.1/servers/7e091da3-0636-4cba-b8de-94fdeecf0b7f => generated 1875 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:19:32.666227 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-d32e115c-60c9-4a12-a913-c9773175e91b tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Action: 'create', calling method: .version_select at 0x7f847c12e280>, body: {"keypair": {"name": "tempest-keypair-1551742593", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLLLIciNj/kERcU+jvgqBuW+Sx0tQNkc61hIzFh/cKR8s1MdgbHbtH3rr8gUqpYjb4WBVdaCjDtFuNtXEwGZnZMKU6YXioLkPSSI8nNvw1d+arOw5DQe6hnECAFOY1D/5A=="}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:19:32.699438 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-d32e115c-60c9-4a12-a913-c9773175e91b tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Getting quotas for project 2b557edd165144c8943eb9acc339a377. Resources: {'key_pairs'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:19:32.705856 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-d32e115c-60c9-4a12-a913-c9773175e91b tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Getting quotas for user 0d89081084f14e0187f4c67cd9185fef and project 2b557edd165144c8943eb9acc339a377. Resources: {'key_pairs'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:19:32.760003 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-d32e115c-60c9-4a12-a913-c9773175e91b tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.106124 Aug 10 23:19:32.761290 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2409/4624] 10.222.0.58 () {60 vars in 1159 bytes} [Wed Aug 10 23:19:32 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:19:32.949565 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-4d901f18-4198-4b3d-94f0-88b94a9d9322 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:32.950343 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-4d901f18-4198-4b3d-94f0-88b94a9d9322 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] [instance: ee6a796b-efa5-4c73-8776-d86b54ca2190] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:32.965733 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-738402f0-80e6-4abc-987a-b408113630f0 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6684f0c87e4242be9e0ffb4ef1973f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0582ace9e4443b8ad88915503ee630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:32.971698 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4d901f18-4198-4b3d-94f0-88b94a9d9322 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:32.972499 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4d901f18-4198-4b3d-94f0-88b94a9d9322 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:32.973459 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4d901f18-4198-4b3d-94f0-88b94a9d9322 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:32.974451 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-738402f0-80e6-4abc-987a-b408113630f0 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "GET /compute/v2.1/servers/d3455c49-214c-4635-b28b-f87ff636e960" status: 200 len: 1327 microversion: 2.1 time: 1.044684 Aug 10 23:19:32.976716 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2216/4625] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:31 2022] GET /compute/v2.1/servers/d3455c49-214c-4635-b28b-f87ff636e960 => generated 1327 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:19:32.977680 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4d901f18-4198-4b3d-94f0-88b94a9d9322 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:32.982048 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4d901f18-4198-4b3d-94f0-88b94a9d9322 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:32.982701 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4d901f18-4198-4b3d-94f0-88b94a9d9322 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:33.150841 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-821b92b7-753c-4d1a-91b6-625313178f5d tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:33.151625 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-821b92b7-753c-4d1a-91b6-625313178f5d tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: 1da4d99f-4cb0-4533-bda8-3bda03205e07] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:33.162768 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-821b92b7-753c-4d1a-91b6-625313178f5d tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:33.167650 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-821b92b7-753c-4d1a-91b6-625313178f5d tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:33.168273 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-821b92b7-753c-4d1a-91b6-625313178f5d tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:33.169193 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-821b92b7-753c-4d1a-91b6-625313178f5d tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:33.170068 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-821b92b7-753c-4d1a-91b6-625313178f5d tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:33.170456 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-821b92b7-753c-4d1a-91b6-625313178f5d tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:33.188880 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-4d901f18-4198-4b3d-94f0-88b94a9d9322 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '627b163f1a0e4fdeb0e9692e7d37460d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb5f5856c46490ab1ded572d693c4cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:33.199307 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-4d901f18-4198-4b3d-94f0-88b94a9d9322 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] 10.222.0.58 "GET /compute/v2.1/servers/ee6a796b-efa5-4c73-8776-d86b54ca2190" status: 200 len: 1350 microversion: 2.1 time: 0.254023 Aug 10 23:19:33.203628 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2410/4626] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:32 2022] GET /compute/v2.1/servers/ee6a796b-efa5-4c73-8776-d86b54ca2190 => generated 1350 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:19:33.667588 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-692905ef-ca61-4c9d-86c8-3584b9080738 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:33.668227 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-692905ef-ca61-4c9d-86c8-3584b9080738 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] [instance: 7e091da3-0636-4cba-b8de-94fdeecf0b7f] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:33.697118 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-692905ef-ca61-4c9d-86c8-3584b9080738 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:33.710359 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-692905ef-ca61-4c9d-86c8-3584b9080738 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:33.711069 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-692905ef-ca61-4c9d-86c8-3584b9080738 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:33.712103 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-692905ef-ca61-4c9d-86c8-3584b9080738 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:33.712598 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-692905ef-ca61-4c9d-86c8-3584b9080738 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:33.713038 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-692905ef-ca61-4c9d-86c8-3584b9080738 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:33.957546 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-821b92b7-753c-4d1a-91b6-625313178f5d tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:33.967807 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-821b92b7-753c-4d1a-91b6-625313178f5d tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/1da4d99f-4cb0-4533-bda8-3bda03205e07" status: 200 len: 1508 microversion: 2.1 time: 0.821779 Aug 10 23:19:33.971829 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2217/4627] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:33 2022] GET /compute/v2.1/servers/1da4d99f-4cb0-4533-bda8-3bda03205e07 => generated 1508 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:19:34.005769 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-8ec3e5cb-166b-49b1-a6ab-3200485d3228 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:34.007935 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-8ec3e5cb-166b-49b1-a6ab-3200485d3228 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: d3455c49-214c-4635-b28b-f87ff636e960] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:34.018744 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8ec3e5cb-166b-49b1-a6ab-3200485d3228 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:34.019547 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8ec3e5cb-166b-49b1-a6ab-3200485d3228 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:34.023309 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8ec3e5cb-166b-49b1-a6ab-3200485d3228 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:34.024326 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8ec3e5cb-166b-49b1-a6ab-3200485d3228 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:34.025018 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8ec3e5cb-166b-49b1-a6ab-3200485d3228 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:34.025669 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8ec3e5cb-166b-49b1-a6ab-3200485d3228 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:34.261553 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-692905ef-ca61-4c9d-86c8-3584b9080738 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:34.265094 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:19:34.280961 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-692905ef-ca61-4c9d-86c8-3584b9080738 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:34.282525 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-692905ef-ca61-4c9d-86c8-3584b9080738 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:34.283742 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-692905ef-ca61-4c9d-86c8-3584b9080738 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] 10.222.0.58 "GET /compute/v2.1/servers/7e091da3-0636-4cba-b8de-94fdeecf0b7f" status: 200 len: 1875 microversion: 2.32 time: 0.623615 Aug 10 23:19:34.298316 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2411/4628] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:19:33 2022] GET /compute/v2.1/servers/7e091da3-0636-4cba-b8de-94fdeecf0b7f => generated 1875 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:19:34.306859 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-dfaec848-1605-49cd-a3e7-9ac9e473e12f tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:34.309411 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-dfaec848-1605-49cd-a3e7-9ac9e473e12f tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] [instance: ee6a796b-efa5-4c73-8776-d86b54ca2190] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:34.327343 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dfaec848-1605-49cd-a3e7-9ac9e473e12f tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:34.331720 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dfaec848-1605-49cd-a3e7-9ac9e473e12f tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:34.334119 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dfaec848-1605-49cd-a3e7-9ac9e473e12f tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:34.335267 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dfaec848-1605-49cd-a3e7-9ac9e473e12f tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:34.341504 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dfaec848-1605-49cd-a3e7-9ac9e473e12f tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:34.342199 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dfaec848-1605-49cd-a3e7-9ac9e473e12f tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:34.472661 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-dfaec848-1605-49cd-a3e7-9ac9e473e12f tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '627b163f1a0e4fdeb0e9692e7d37460d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb5f5856c46490ab1ded572d693c4cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:34.487859 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-dfaec848-1605-49cd-a3e7-9ac9e473e12f tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] 10.222.0.58 "GET /compute/v2.1/servers/ee6a796b-efa5-4c73-8776-d86b54ca2190" status: 200 len: 1350 microversion: 2.1 time: 0.188002 Aug 10 23:19:34.488739 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2412/4629] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:34 2022] GET /compute/v2.1/servers/ee6a796b-efa5-4c73-8776-d86b54ca2190 => generated 1350 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:19:34.661419 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-d3de42f9-05ab-4123-a054-9f754e95b6ff req-5b200892-70a1-4fc9-afa3-ade0b2c16c90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e091da3-0636-4cba-b8de-94fdeecf0b7f", "name": "network-vif-plugged", "status": "completed", "tag": "15a1ebf2-6257-4511-9a21-1f5f62d2bad4"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:19:34.687332 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-d3de42f9-05ab-4123-a054-9f754e95b6ff req-5b200892-70a1-4fc9-afa3-ade0b2c16c90 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:34.688942 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-d3de42f9-05ab-4123-a054-9f754e95b6ff req-5b200892-70a1-4fc9-afa3-ade0b2c16c90 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:34.691571 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-d3de42f9-05ab-4123-a054-9f754e95b6ff req-5b200892-70a1-4fc9-afa3-ade0b2c16c90 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:34.705345 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-d3de42f9-05ab-4123-a054-9f754e95b6ff req-5b200892-70a1-4fc9-afa3-ade0b2c16c90 service nova] Creating event network-vif-plugged:15a1ebf2-6257-4511-9a21-1f5f62d2bad4 for instance 7e091da3-0636-4cba-b8de-94fdeecf0b7f on n-h1-850468-14 Aug 10 23:19:34.714344 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-d3de42f9-05ab-4123-a054-9f754e95b6ff req-5b200892-70a1-4fc9-afa3-ade0b2c16c90 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063667 Aug 10 23:19:34.715734 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2413/4630] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:19:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:19:34.723694 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-8ec3e5cb-166b-49b1-a6ab-3200485d3228 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6684f0c87e4242be9e0ffb4ef1973f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0582ace9e4443b8ad88915503ee630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:34.736908 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-8ec3e5cb-166b-49b1-a6ab-3200485d3228 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "GET /compute/v2.1/servers/d3455c49-214c-4635-b28b-f87ff636e960" status: 200 len: 1327 microversion: 2.1 time: 0.735727 Aug 10 23:19:34.738647 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2218/4631] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:33 2022] GET /compute/v2.1/servers/d3455c49-214c-4635-b28b-f87ff636e960 => generated 1327 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:19:34.998086 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-6baaaa82-6d6e-4fd9-8ba7-0ea2998b966d tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:34.999112 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-6baaaa82-6d6e-4fd9-8ba7-0ea2998b966d tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: 1da4d99f-4cb0-4533-bda8-3bda03205e07] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:35.007920 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6baaaa82-6d6e-4fd9-8ba7-0ea2998b966d tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:35.008798 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6baaaa82-6d6e-4fd9-8ba7-0ea2998b966d tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:35.009470 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6baaaa82-6d6e-4fd9-8ba7-0ea2998b966d tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:35.010449 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6baaaa82-6d6e-4fd9-8ba7-0ea2998b966d tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:35.011220 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6baaaa82-6d6e-4fd9-8ba7-0ea2998b966d tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:35.011881 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6baaaa82-6d6e-4fd9-8ba7-0ea2998b966d tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:35.230234 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-6baaaa82-6d6e-4fd9-8ba7-0ea2998b966d tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:35.242495 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-6baaaa82-6d6e-4fd9-8ba7-0ea2998b966d tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/1da4d99f-4cb0-4533-bda8-3bda03205e07" status: 200 len: 1508 microversion: 2.1 time: 0.248311 Aug 10 23:19:35.243787 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2414/4632] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:34 2022] GET /compute/v2.1/servers/1da4d99f-4cb0-4533-bda8-3bda03205e07 => generated 1508 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:19:35.313974 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-e444d85e-a382-4992-9cf0-ddfd09beb2f4 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:35.315400 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-e444d85e-a382-4992-9cf0-ddfd09beb2f4 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] [instance: 7e091da3-0636-4cba-b8de-94fdeecf0b7f] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:35.323973 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e444d85e-a382-4992-9cf0-ddfd09beb2f4 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:35.324840 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e444d85e-a382-4992-9cf0-ddfd09beb2f4 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:35.326321 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e444d85e-a382-4992-9cf0-ddfd09beb2f4 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:35.328630 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e444d85e-a382-4992-9cf0-ddfd09beb2f4 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:35.329355 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e444d85e-a382-4992-9cf0-ddfd09beb2f4 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:35.330206 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e444d85e-a382-4992-9cf0-ddfd09beb2f4 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:35.511234 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-e1dbfd86-64b6-4c69-acc7-b5a671fc26d0 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:35.512113 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-e1dbfd86-64b6-4c69-acc7-b5a671fc26d0 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] [instance: ee6a796b-efa5-4c73-8776-d86b54ca2190] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:35.519167 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e1dbfd86-64b6-4c69-acc7-b5a671fc26d0 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:35.520146 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e1dbfd86-64b6-4c69-acc7-b5a671fc26d0 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:35.520881 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e1dbfd86-64b6-4c69-acc7-b5a671fc26d0 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:35.522375 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e1dbfd86-64b6-4c69-acc7-b5a671fc26d0 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:35.523081 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e1dbfd86-64b6-4c69-acc7-b5a671fc26d0 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:35.523948 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e1dbfd86-64b6-4c69-acc7-b5a671fc26d0 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:35.599781 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-e1dbfd86-64b6-4c69-acc7-b5a671fc26d0 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '627b163f1a0e4fdeb0e9692e7d37460d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb5f5856c46490ab1ded572d693c4cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:35.609556 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-e1dbfd86-64b6-4c69-acc7-b5a671fc26d0 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] 10.222.0.58 "GET /compute/v2.1/servers/ee6a796b-efa5-4c73-8776-d86b54ca2190" status: 200 len: 1350 microversion: 2.1 time: 0.103903 Aug 10 23:19:35.617446 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2415/4633] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:35 2022] GET /compute/v2.1/servers/ee6a796b-efa5-4c73-8776-d86b54ca2190 => generated 1350 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:19:35.764520 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-f5ea5424-5022-452c-b6e6-bdc502c41454 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:35.766172 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-f5ea5424-5022-452c-b6e6-bdc502c41454 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: d3455c49-214c-4635-b28b-f87ff636e960] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:35.791972 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f5ea5424-5022-452c-b6e6-bdc502c41454 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:35.795002 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f5ea5424-5022-452c-b6e6-bdc502c41454 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:35.797676 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f5ea5424-5022-452c-b6e6-bdc502c41454 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:35.799174 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f5ea5424-5022-452c-b6e6-bdc502c41454 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:35.800572 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f5ea5424-5022-452c-b6e6-bdc502c41454 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:35.801687 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f5ea5424-5022-452c-b6e6-bdc502c41454 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:36.262446 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-f5ea5424-5022-452c-b6e6-bdc502c41454 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6684f0c87e4242be9e0ffb4ef1973f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0582ace9e4443b8ad88915503ee630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:36.271546 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-f5ea5424-5022-452c-b6e6-bdc502c41454 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "GET /compute/v2.1/servers/d3455c49-214c-4635-b28b-f87ff636e960" status: 200 len: 1327 microversion: 2.1 time: 0.512095 Aug 10 23:19:36.273193 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2416/4634] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:35 2022] GET /compute/v2.1/servers/d3455c49-214c-4635-b28b-f87ff636e960 => generated 1327 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:19:36.278353 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-46593e1d-443c-4011-8729-9295446bb3a9 req-e6cabf1a-7c11-4481-9b37-4a8421811a36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1da4d99f-4cb0-4533-bda8-3bda03205e07", "name": "network-vif-deleted", "tag": "00538a30-d023-4ceb-a5db-4e41b89bea2b"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:19:36.289412 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-46593e1d-443c-4011-8729-9295446bb3a9 req-e6cabf1a-7c11-4481-9b37-4a8421811a36 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:36.290180 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-46593e1d-443c-4011-8729-9295446bb3a9 req-e6cabf1a-7c11-4481-9b37-4a8421811a36 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:36.290881 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-46593e1d-443c-4011-8729-9295446bb3a9 req-e6cabf1a-7c11-4481-9b37-4a8421811a36 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:36.302703 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-46593e1d-443c-4011-8729-9295446bb3a9 req-e6cabf1a-7c11-4481-9b37-4a8421811a36 service nova] Creating event network-vif-deleted:00538a30-d023-4ceb-a5db-4e41b89bea2b for instance 1da4d99f-4cb0-4533-bda8-3bda03205e07 on n-h1-850468-14 Aug 10 23:19:36.307990 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-46593e1d-443c-4011-8729-9295446bb3a9 req-e6cabf1a-7c11-4481-9b37-4a8421811a36 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033275 Aug 10 23:19:36.309084 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2417/4635] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:19:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:19:36.313963 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c76d55d0-c467-469b-bd56-c33a1f55f4e7 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:36.314698 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-c76d55d0-c467-469b-bd56-c33a1f55f4e7 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] [instance: 7df225be-2dbc-4ef6-aeec-9a3de33a0006] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:36.322210 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c76d55d0-c467-469b-bd56-c33a1f55f4e7 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:36.322807 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c76d55d0-c467-469b-bd56-c33a1f55f4e7 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:36.323290 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c76d55d0-c467-469b-bd56-c33a1f55f4e7 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:36.324069 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c76d55d0-c467-469b-bd56-c33a1f55f4e7 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:36.324531 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c76d55d0-c467-469b-bd56-c33a1f55f4e7 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:36.324966 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c76d55d0-c467-469b-bd56-c33a1f55f4e7 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:36.355713 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-c76d55d0-c467-469b-bd56-c33a1f55f4e7 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] [instance: 7df225be-2dbc-4ef6-aeec-9a3de33a0006] Going to try to terminate instance {{(pid=122633) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:19:36.366625 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-e444d85e-a382-4992-9cf0-ddfd09beb2f4 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:36.392990 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-e444d85e-a382-4992-9cf0-ddfd09beb2f4 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:36.396024 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-e444d85e-a382-4992-9cf0-ddfd09beb2f4 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:36.400397 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-e444d85e-a382-4992-9cf0-ddfd09beb2f4 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] 10.222.0.58 "GET /compute/v2.1/servers/7e091da3-0636-4cba-b8de-94fdeecf0b7f" status: 200 len: 1875 microversion: 2.32 time: 1.090697 Aug 10 23:19:36.422383 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2219/4636] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:19:35 2022] GET /compute/v2.1/servers/7e091da3-0636-4cba-b8de-94fdeecf0b7f => generated 1875 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:19:36.422383 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-6efa6e25-eb9e-4b79-9db9-e886b3f8a49c tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:36.422383 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-6efa6e25-eb9e-4b79-9db9-e886b3f8a49c tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: 1da4d99f-4cb0-4533-bda8-3bda03205e07] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:36.422383 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6efa6e25-eb9e-4b79-9db9-e886b3f8a49c tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:36.422383 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6efa6e25-eb9e-4b79-9db9-e886b3f8a49c tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:36.422383 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6efa6e25-eb9e-4b79-9db9-e886b3f8a49c tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:36.423390 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6efa6e25-eb9e-4b79-9db9-e886b3f8a49c tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:36.423390 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6efa6e25-eb9e-4b79-9db9-e886b3f8a49c tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:36.423734 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6efa6e25-eb9e-4b79-9db9-e886b3f8a49c tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:36.477987 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:DELETE=1 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:19:36.493182 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6efa6e25-eb9e-4b79-9db9-e886b3f8a49c tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:36.493738 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6efa6e25-eb9e-4b79-9db9-e886b3f8a49c tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:36.494233 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6efa6e25-eb9e-4b79-9db9-e886b3f8a49c tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:36.494752 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.objects.instance [None req-6efa6e25-eb9e-4b79-9db9-e886b3f8a49c tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lazy-loading 'fault' on Instance uuid 1da4d99f-4cb0-4533-bda8-3bda03205e07 {{(pid=122632) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:19:36.534639 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-c76d55d0-c467-469b-bd56-c33a1f55f4e7 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] 10.222.0.58 "DELETE /compute/v2.1/servers/7df225be-2dbc-4ef6-aeec-9a3de33a0006" status: 204 len: 0 microversion: 2.1 time: 0.224534 Aug 10 23:19:36.539701 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2418/4637] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:19:36 2022] DELETE /compute/v2.1/servers/7df225be-2dbc-4ef6-aeec-9a3de33a0006 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:19:36.548679 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-d31ac9a9-33b4-4dad-a480-3682f2779578 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:36.549384 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-d31ac9a9-33b4-4dad-a480-3682f2779578 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] [instance: 7df225be-2dbc-4ef6-aeec-9a3de33a0006] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:36.559103 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d31ac9a9-33b4-4dad-a480-3682f2779578 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:36.559600 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d31ac9a9-33b4-4dad-a480-3682f2779578 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:36.560403 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d31ac9a9-33b4-4dad-a480-3682f2779578 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:36.561380 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d31ac9a9-33b4-4dad-a480-3682f2779578 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:36.561997 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d31ac9a9-33b4-4dad-a480-3682f2779578 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:36.562522 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d31ac9a9-33b4-4dad-a480-3682f2779578 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:36.625460 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-6efa6e25-eb9e-4b79-9db9-e886b3f8a49c tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:36.642580 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-6efa6e25-eb9e-4b79-9db9-e886b3f8a49c tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/1da4d99f-4cb0-4533-bda8-3bda03205e07" status: 200 len: 1305 microversion: 2.1 time: 0.231891 Aug 10 23:19:36.644796 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2220/4638] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:36 2022] GET /compute/v2.1/servers/1da4d99f-4cb0-4533-bda8-3bda03205e07 => generated 1305 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:19:36.655037 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-91ae4a90-32f7-4c89-b8d7-eb60e4edb5c2 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:36.657665 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-91ae4a90-32f7-4c89-b8d7-eb60e4edb5c2 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] [instance: ee6a796b-efa5-4c73-8776-d86b54ca2190] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:36.668067 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-91ae4a90-32f7-4c89-b8d7-eb60e4edb5c2 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:36.668826 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-91ae4a90-32f7-4c89-b8d7-eb60e4edb5c2 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:36.669427 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-91ae4a90-32f7-4c89-b8d7-eb60e4edb5c2 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:36.670346 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-91ae4a90-32f7-4c89-b8d7-eb60e4edb5c2 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:36.671111 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-91ae4a90-32f7-4c89-b8d7-eb60e4edb5c2 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:36.671868 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-91ae4a90-32f7-4c89-b8d7-eb60e4edb5c2 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:36.744719 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-d31ac9a9-33b4-4dad-a480-3682f2779578 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07c94ebf0954cdea12b9a689538d96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395d7c4077e54c43bb95288db3942b0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:36.752678 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-d31ac9a9-33b4-4dad-a480-3682f2779578 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] 10.222.0.58 "GET /compute/v2.1/servers/7df225be-2dbc-4ef6-aeec-9a3de33a0006" status: 200 len: 1508 microversion: 2.1 time: 0.208453 Aug 10 23:19:36.763524 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2419/4639] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:36 2022] GET /compute/v2.1/servers/7df225be-2dbc-4ef6-aeec-9a3de33a0006 => generated 1508 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:19:36.772499 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-f8c485e4-fc8c-4729-a9a6-724bad59d213 req-a26621c3-e837-4109-b6f2-c3321869922f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e091da3-0636-4cba-b8de-94fdeecf0b7f", "name": "network-vif-plugged", "status": "completed", "tag": "06a5a1f3-cec1-4f39-b897-ff685f8485fa"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:19:36.782364 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-f8c485e4-fc8c-4729-a9a6-724bad59d213 req-a26621c3-e837-4109-b6f2-c3321869922f service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:36.783687 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-f8c485e4-fc8c-4729-a9a6-724bad59d213 req-a26621c3-e837-4109-b6f2-c3321869922f service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:36.784138 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-f8c485e4-fc8c-4729-a9a6-724bad59d213 req-a26621c3-e837-4109-b6f2-c3321869922f service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:36.796970 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-f8c485e4-fc8c-4729-a9a6-724bad59d213 req-a26621c3-e837-4109-b6f2-c3321869922f service nova] Creating event network-vif-plugged:06a5a1f3-cec1-4f39-b897-ff685f8485fa for instance 7e091da3-0636-4cba-b8de-94fdeecf0b7f on n-h1-850468-14 Aug 10 23:19:36.799495 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-91ae4a90-32f7-4c89-b8d7-eb60e4edb5c2 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '627b163f1a0e4fdeb0e9692e7d37460d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb5f5856c46490ab1ded572d693c4cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:36.802670 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-f8c485e4-fc8c-4729-a9a6-724bad59d213 req-a26621c3-e837-4109-b6f2-c3321869922f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037597 Aug 10 23:19:36.808611 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2420/4640] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:19:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:19:36.812077 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-91ae4a90-32f7-4c89-b8d7-eb60e4edb5c2 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] 10.222.0.58 "GET /compute/v2.1/servers/ee6a796b-efa5-4c73-8776-d86b54ca2190" status: 200 len: 1350 microversion: 2.1 time: 0.166139 Aug 10 23:19:36.813234 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2221/4641] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:36 2022] GET /compute/v2.1/servers/ee6a796b-efa5-4c73-8776-d86b54ca2190 => generated 1350 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:19:37.295476 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-9013da93-52fc-439b-80b8-605c7dd7c90e tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:37.296486 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-9013da93-52fc-439b-80b8-605c7dd7c90e tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: d3455c49-214c-4635-b28b-f87ff636e960] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:37.304895 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9013da93-52fc-439b-80b8-605c7dd7c90e tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:37.305321 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9013da93-52fc-439b-80b8-605c7dd7c90e tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:37.305986 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9013da93-52fc-439b-80b8-605c7dd7c90e tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:37.307113 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9013da93-52fc-439b-80b8-605c7dd7c90e tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:37.307830 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9013da93-52fc-439b-80b8-605c7dd7c90e tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:37.308265 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9013da93-52fc-439b-80b8-605c7dd7c90e tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:37.430687 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-95113d9a-15b5-4987-b724-1620a814f24f tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:37.431895 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-95113d9a-15b5-4987-b724-1620a814f24f tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] [instance: 7e091da3-0636-4cba-b8de-94fdeecf0b7f] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:37.442181 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-95113d9a-15b5-4987-b724-1620a814f24f tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:37.445280 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-95113d9a-15b5-4987-b724-1620a814f24f tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:37.445778 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-95113d9a-15b5-4987-b724-1620a814f24f tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:37.446529 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-95113d9a-15b5-4987-b724-1620a814f24f tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:37.447031 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-95113d9a-15b5-4987-b724-1620a814f24f tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:37.447466 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-95113d9a-15b5-4987-b724-1620a814f24f tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:37.520698 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-9013da93-52fc-439b-80b8-605c7dd7c90e tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6684f0c87e4242be9e0ffb4ef1973f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0582ace9e4443b8ad88915503ee630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:37.531605 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-9013da93-52fc-439b-80b8-605c7dd7c90e tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "GET /compute/v2.1/servers/d3455c49-214c-4635-b28b-f87ff636e960" status: 200 len: 1327 microversion: 2.1 time: 0.241044 Aug 10 23:19:37.540353 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2421/4642] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:37 2022] GET /compute/v2.1/servers/d3455c49-214c-4635-b28b-f87ff636e960 => generated 1327 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:19:37.667386 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-02e2e347-58c5-4ce1-911e-aacffe5f8dd2 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:37.668116 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-02e2e347-58c5-4ce1-911e-aacffe5f8dd2 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: 1da4d99f-4cb0-4533-bda8-3bda03205e07] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:37.676122 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-02e2e347-58c5-4ce1-911e-aacffe5f8dd2 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:37.676122 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-02e2e347-58c5-4ce1-911e-aacffe5f8dd2 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:37.676122 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-02e2e347-58c5-4ce1-911e-aacffe5f8dd2 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:37.676625 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-02e2e347-58c5-4ce1-911e-aacffe5f8dd2 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:37.676995 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-02e2e347-58c5-4ce1-911e-aacffe5f8dd2 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:37.677426 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-02e2e347-58c5-4ce1-911e-aacffe5f8dd2 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:37.694239 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-02e2e347-58c5-4ce1-911e-aacffe5f8dd2 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] HTTP exception thrown: Instance 1da4d99f-4cb0-4533-bda8-3bda03205e07 could not be found. Aug 10 23:19:37.695949 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-02e2e347-58c5-4ce1-911e-aacffe5f8dd2 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Request method failure captured: Aug 10 23:19:37.695949 n-d-850468-14 devstack@n-api.service[122633]: request: GET /compute/v2.1/servers/1da4d99f-4cb0-4533-bda8-3bda03205e07 HTTP/1.1 Aug 10 23:19:37.695949 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:19:37.695949 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:19:37.695949 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:19:37.695949 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:19:37.695949 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:19:37.695949 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:19:37.695949 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:19:37.695949 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:19:37.695949 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9Drw0c2MsNlQk2xhClSBMImCg12_8SYgkoaKQkzmFSrheNUqLDbfnKYZ8D3mVjR4fUdjKeuub5tXKPuyho3Qbzr6min3JWaqN44jGsCPGM23nBipHIYVBpHQxUCRbFIS5jN95f9E_tT0WyV4NvgkZnorl71EuxY70xL3GkCDAg5oTLs Aug 10 23:19:37.695949 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:19:37.695949 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:19:37.695949 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:19:37.695949 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:19:37.695949 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:19:37.695949 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:19:37.695949 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 1eb12683ada249bfa2ca7bf5cf730ca3 Aug 10 23:19:37.695949 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-ServerActionsTestJSON-819186707 Aug 10 23:19:37.695949 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:19:37.695949 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:19:37.695949 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1eb12683ada249bfa2ca7bf5cf730ca3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1eb12683ada249bfa2ca7bf5cf730ca3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/1eb12683ada249bfa2ca7bf5cf730ca3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_1eb12683ada249bfa2ca7bf5cf730ca3", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:19:37.695949 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-ServerActionsTestJSON-819186707 Aug 10 23:19:37.695949 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 1eb12683ada249bfa2ca7bf5cf730ca3 Aug 10 23:19:37.695949 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-ServerActionsTestJSON-819186707 Aug 10 23:19:37.695949 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-ServerActionsTestJSON-819186707-project Aug 10 23:19:37.695949 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:19:37.695949 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:19:37.695949 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 2ea96841d5b64d2390d18b3eb5da8b73 Aug 10 23:19:37.695949 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-ServerActionsTestJSON-819186707-project Aug 10 23:19:37.695949 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:19:37.695949 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance 1da4d99f-4cb0-4533-bda8-3bda03205e07 could not be found. Aug 10 23:19:37.695949 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': '1da4d99f-4cb0-4533-bda8-3bda03205e07'} Aug 10 23:19:37.695949 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:19:37.695949 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:19:37.695949 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:19:37.695949 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:19:37.695949 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:19:37.695949 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:19:37.695949 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:19:37.695949 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:19:37.695949 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:19:37.695949 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:19:37.695949 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1da4d99f-4cb0-4533-bda8-3bda03205e07 could not be found. Aug 10 23:19:37.695949 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:19:37.695949 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:19:37.695949 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:19:37.695949 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:19:37.695949 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:19:37.695949 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:19:37.695949 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:19:37.695949 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:19:37.695949 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:19:37.695949 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:19:37.695949 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:19:37.695949 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:19:37.695949 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:19:37.695949 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:19:37.695949 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:19:37.695949 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:19:37.695949 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1da4d99f-4cb0-4533-bda8-3bda03205e07 could not be found. Aug 10 23:19:37.695949 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:19:37.695949 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:19:37.695949 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:19:37.700965 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:19:37.700965 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:19:37.700965 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:19:37.700965 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:19:37.700965 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:19:37.700965 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1da4d99f-4cb0-4533-bda8-3bda03205e07 could not be found. Aug 10 23:19:37.700965 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:19:37.700965 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-02e2e347-58c5-4ce1-911e-aacffe5f8dd2 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Returning 404 to user: Instance 1da4d99f-4cb0-4533-bda8-3bda03205e07 could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:19:37.700965 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-02e2e347-58c5-4ce1-911e-aacffe5f8dd2 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/1da4d99f-4cb0-4533-bda8-3bda03205e07" status: 404 len: 111 microversion: 2.1 time: 0.036262 Aug 10 23:19:37.700965 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2422/4643] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:37 2022] GET /compute/v2.1/servers/1da4d99f-4cb0-4533-bda8-3bda03205e07 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 10 23:19:37.719640 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-d52ae98c-9fae-4c73-8266-796d2046b722 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:37.720473 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-d52ae98c-9fae-4c73-8266-796d2046b722 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: 3efc12c9-baf5-40e4-9d98-e72d28377db6] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:37.729151 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d52ae98c-9fae-4c73-8266-796d2046b722 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:37.730028 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d52ae98c-9fae-4c73-8266-796d2046b722 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:37.730695 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d52ae98c-9fae-4c73-8266-796d2046b722 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:37.731686 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d52ae98c-9fae-4c73-8266-796d2046b722 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:37.732856 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d52ae98c-9fae-4c73-8266-796d2046b722 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:37.735248 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d52ae98c-9fae-4c73-8266-796d2046b722 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:37.768625 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-d52ae98c-9fae-4c73-8266-796d2046b722 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: 3efc12c9-baf5-40e4-9d98-e72d28377db6] Going to try to terminate instance {{(pid=122633) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:19:37.830434 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-95113d9a-15b5-4987-b724-1620a814f24f tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:37.847553 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-95113d9a-15b5-4987-b724-1620a814f24f tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:37.852042 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-95113d9a-15b5-4987-b724-1620a814f24f tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:37.854484 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-95113d9a-15b5-4987-b724-1620a814f24f tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] 10.222.0.58 "GET /compute/v2.1/servers/7e091da3-0636-4cba-b8de-94fdeecf0b7f" status: 200 len: 1875 microversion: 2.32 time: 0.428355 Aug 10 23:19:37.857589 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2222/4644] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:19:37 2022] GET /compute/v2.1/servers/7e091da3-0636-4cba-b8de-94fdeecf0b7f => generated 1875 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 23:19:37.868899 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-9cb86c30-40f0-49c5-9e70-6724b09dbe09 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:37.872700 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-9cb86c30-40f0-49c5-9e70-6724b09dbe09 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] [instance: 7df225be-2dbc-4ef6-aeec-9a3de33a0006] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:37.888418 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9cb86c30-40f0-49c5-9e70-6724b09dbe09 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:37.894683 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9cb86c30-40f0-49c5-9e70-6724b09dbe09 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:37.895690 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9cb86c30-40f0-49c5-9e70-6724b09dbe09 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:37.896463 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9cb86c30-40f0-49c5-9e70-6724b09dbe09 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:37.897768 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9cb86c30-40f0-49c5-9e70-6724b09dbe09 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:37.898555 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9cb86c30-40f0-49c5-9e70-6724b09dbe09 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:37.914740 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-d52ae98c-9fae-4c73-8266-796d2046b722 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "DELETE /compute/v2.1/servers/3efc12c9-baf5-40e4-9d98-e72d28377db6" status: 204 len: 0 microversion: 2.1 time: 0.198338 Aug 10 23:19:37.916148 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2423/4645] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:19:37 2022] DELETE /compute/v2.1/servers/3efc12c9-baf5-40e4-9d98-e72d28377db6 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 10 23:19:37.928846 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-1a048889-ebff-48b5-beb4-71083fbae663 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:37.930593 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-1a048889-ebff-48b5-beb4-71083fbae663 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] [instance: ee6a796b-efa5-4c73-8776-d86b54ca2190] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:37.943443 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1a048889-ebff-48b5-beb4-71083fbae663 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:37.944487 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1a048889-ebff-48b5-beb4-71083fbae663 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:37.944933 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1a048889-ebff-48b5-beb4-71083fbae663 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:37.945655 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1a048889-ebff-48b5-beb4-71083fbae663 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:37.946301 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1a048889-ebff-48b5-beb4-71083fbae663 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:37.946974 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1a048889-ebff-48b5-beb4-71083fbae663 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:38.140311 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-9cb86c30-40f0-49c5-9e70-6724b09dbe09 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07c94ebf0954cdea12b9a689538d96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395d7c4077e54c43bb95288db3942b0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:38.149209 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-9cb86c30-40f0-49c5-9e70-6724b09dbe09 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] 10.222.0.58 "GET /compute/v2.1/servers/7df225be-2dbc-4ef6-aeec-9a3de33a0006" status: 200 len: 1508 microversion: 2.1 time: 0.288805 Aug 10 23:19:38.153858 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2223/4646] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:37 2022] GET /compute/v2.1/servers/7df225be-2dbc-4ef6-aeec-9a3de33a0006 => generated 1508 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:19:38.167619 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-957e1f9f-5290-4197-9174-b2cd438827ea tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-859957266", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6022f6db-e3f4-46f3-9a7f-22454e88771a"}], "security_groups": [{"name": "tempest-securitygroup--288147144"}], "key_name": "tempest-keypair-1551742593", "user_data": "}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:19:38.292150 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-1a048889-ebff-48b5-beb4-71083fbae663 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '627b163f1a0e4fdeb0e9692e7d37460d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb5f5856c46490ab1ded572d693c4cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:38.308474 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-1a048889-ebff-48b5-beb4-71083fbae663 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] 10.222.0.58 "GET /compute/v2.1/servers/ee6a796b-efa5-4c73-8776-d86b54ca2190" status: 200 len: 1469 microversion: 2.1 time: 0.389584 Aug 10 23:19:38.327024 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2424/4647] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:37 2022] GET /compute/v2.1/servers/ee6a796b-efa5-4c73-8776-d86b54ca2190 => generated 1469 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:19:38.332943 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-d69ebaa3-d03e-4527-b16a-0269eb0a7374 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:38.333858 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-d69ebaa3-d03e-4527-b16a-0269eb0a7374 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: 3efc12c9-baf5-40e4-9d98-e72d28377db6] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:38.344307 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d69ebaa3-d03e-4527-b16a-0269eb0a7374 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:38.344864 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d69ebaa3-d03e-4527-b16a-0269eb0a7374 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:38.345314 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d69ebaa3-d03e-4527-b16a-0269eb0a7374 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:38.346356 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d69ebaa3-d03e-4527-b16a-0269eb0a7374 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:38.347420 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d69ebaa3-d03e-4527-b16a-0269eb0a7374 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:38.348802 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d69ebaa3-d03e-4527-b16a-0269eb0a7374 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:38.540485 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.network.neutron [None req-957e1f9f-5290-4197-9174-b2cd438827ea tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] validate_networks() for [('6022f6db-e3f4-46f3-9a7f-22454e88771a', None, None, None, None, None)] {{(pid=122632) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 23:19:39.168548 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-d69ebaa3-d03e-4527-b16a-0269eb0a7374 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:39.182129 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-d69ebaa3-d03e-4527-b16a-0269eb0a7374 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/3efc12c9-baf5-40e4-9d98-e72d28377db6" status: 200 len: 1494 microversion: 2.1 time: 0.853151 Aug 10 23:19:39.195740 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2425/4648] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:38 2022] GET /compute/v2.1/servers/3efc12c9-baf5-40e4-9d98-e72d28377db6 => generated 1494 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:19:39.202576 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-8c984990-fd93-4ddc-86a3-b46591c84e01 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:39.203484 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-8c984990-fd93-4ddc-86a3-b46591c84e01 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: d3455c49-214c-4635-b28b-f87ff636e960] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:39.210891 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8c984990-fd93-4ddc-86a3-b46591c84e01 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:39.211643 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8c984990-fd93-4ddc-86a3-b46591c84e01 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:39.212239 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8c984990-fd93-4ddc-86a3-b46591c84e01 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:39.213148 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8c984990-fd93-4ddc-86a3-b46591c84e01 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:39.213753 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8c984990-fd93-4ddc-86a3-b46591c84e01 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:39.214327 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8c984990-fd93-4ddc-86a3-b46591c84e01 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:39.560640 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-8c984990-fd93-4ddc-86a3-b46591c84e01 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6684f0c87e4242be9e0ffb4ef1973f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0582ace9e4443b8ad88915503ee630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:39.569107 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-8c984990-fd93-4ddc-86a3-b46591c84e01 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "GET /compute/v2.1/servers/d3455c49-214c-4635-b28b-f87ff636e960" status: 200 len: 1327 microversion: 2.1 time: 0.371359 Aug 10 23:19:39.583388 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2426/4649] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:39 2022] GET /compute/v2.1/servers/d3455c49-214c-4635-b28b-f87ff636e960 => generated 1327 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:19:39.593313 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-74d44772-d79e-44c0-9886-632ae3c6717f req-0b471628-3250-4fdd-a4a1-cadba914349d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e091da3-0636-4cba-b8de-94fdeecf0b7f", "name": "network-vif-plugged", "status": "completed", "tag": "e33f8996-1d01-4809-ae73-234bdbbc3c3f"}, {"server_uuid": "7e091da3-0636-4cba-b8de-94fdeecf0b7f", "name": "network-vif-plugged", "status": "completed", "tag": "fef0f10f-3060-43c3-bd96-39b0c071dfab"}, {"server_uuid": "7e091da3-0636-4cba-b8de-94fdeecf0b7f", "name": "network-vif-plugged", "status": "completed", "tag": "7dab50f5-321c-4571-bb72-8c2a4a681492"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:19:39.608223 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-74d44772-d79e-44c0-9886-632ae3c6717f req-0b471628-3250-4fdd-a4a1-cadba914349d service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:39.608998 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-74d44772-d79e-44c0-9886-632ae3c6717f req-0b471628-3250-4fdd-a4a1-cadba914349d service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:39.609617 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-74d44772-d79e-44c0-9886-632ae3c6717f req-0b471628-3250-4fdd-a4a1-cadba914349d service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:39.628640 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-74d44772-d79e-44c0-9886-632ae3c6717f req-0b471628-3250-4fdd-a4a1-cadba914349d service nova] Creating event network-vif-plugged:e33f8996-1d01-4809-ae73-234bdbbc3c3f for instance 7e091da3-0636-4cba-b8de-94fdeecf0b7f on n-h1-850468-14 Aug 10 23:19:39.630337 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-74d44772-d79e-44c0-9886-632ae3c6717f req-0b471628-3250-4fdd-a4a1-cadba914349d service nova] Creating event network-vif-plugged:fef0f10f-3060-43c3-bd96-39b0c071dfab for instance 7e091da3-0636-4cba-b8de-94fdeecf0b7f on n-h1-850468-14 Aug 10 23:19:39.632154 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-74d44772-d79e-44c0-9886-632ae3c6717f req-0b471628-3250-4fdd-a4a1-cadba914349d service nova] Creating event network-vif-plugged:7dab50f5-321c-4571-bb72-8c2a4a681492 for instance 7e091da3-0636-4cba-b8de-94fdeecf0b7f on n-h1-850468-14 Aug 10 23:19:39.638887 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-74d44772-d79e-44c0-9886-632ae3c6717f req-0b471628-3250-4fdd-a4a1-cadba914349d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.053064 Aug 10 23:19:39.640069 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2427/4650] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:19:39 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:19:39.652102 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-1e59019c-4e12-43ea-9916-f6876da34a81 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:39.654976 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-1e59019c-4e12-43ea-9916-f6876da34a81 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] [instance: 7e091da3-0636-4cba-b8de-94fdeecf0b7f] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:39.663694 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1e59019c-4e12-43ea-9916-f6876da34a81 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:39.664510 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1e59019c-4e12-43ea-9916-f6876da34a81 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:39.665129 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1e59019c-4e12-43ea-9916-f6876da34a81 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:39.666036 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1e59019c-4e12-43ea-9916-f6876da34a81 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:39.666668 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1e59019c-4e12-43ea-9916-f6876da34a81 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:39.667493 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1e59019c-4e12-43ea-9916-f6876da34a81 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:39.702922 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:19:40.001923 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=4 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:19:40.036270 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-1e59019c-4e12-43ea-9916-f6876da34a81 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:40.044668 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-957e1f9f-5290-4197-9174-b2cd438827ea tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Flavor limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:19:40.045366 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-957e1f9f-5290-4197-9174-b2cd438827ea tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Image limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:19:40.046551 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-957e1f9f-5290-4197-9174-b2cd438827ea tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Flavor pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:19:40.048710 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-957e1f9f-5290-4197-9174-b2cd438827ea tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Image pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:19:40.049304 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-957e1f9f-5290-4197-9174-b2cd438827ea tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:19:40.056383 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=18 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:19:40.068022 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-1e59019c-4e12-43ea-9916-f6876da34a81 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:40.070621 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-1e59019c-4e12-43ea-9916-f6876da34a81 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:40.072251 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-1e59019c-4e12-43ea-9916-f6876da34a81 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] 10.222.0.58 "GET /compute/v2.1/servers/7e091da3-0636-4cba-b8de-94fdeecf0b7f" status: 200 len: 1875 microversion: 2.32 time: 0.430896 Aug 10 23:19:40.073829 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2428/4651] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:19:39 2022] GET /compute/v2.1/servers/7e091da3-0636-4cba-b8de-94fdeecf0b7f => generated 1875 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:19:40.079412 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-957e1f9f-5290-4197-9174-b2cd438827ea tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:40.079918 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-957e1f9f-5290-4197-9174-b2cd438827ea tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:40.080347 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-a4e990a2-81ee-4bab-9f80-fec0557e69b3 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:40.080485 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-957e1f9f-5290-4197-9174-b2cd438827ea tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:40.081108 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-957e1f9f-5290-4197-9174-b2cd438827ea tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:40.081598 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-957e1f9f-5290-4197-9174-b2cd438827ea tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:40.081978 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-957e1f9f-5290-4197-9174-b2cd438827ea tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:40.082411 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-a4e990a2-81ee-4bab-9f80-fec0557e69b3 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] [instance: 7df225be-2dbc-4ef6-aeec-9a3de33a0006] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:40.090224 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a4e990a2-81ee-4bab-9f80-fec0557e69b3 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:40.090987 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a4e990a2-81ee-4bab-9f80-fec0557e69b3 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:40.091809 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a4e990a2-81ee-4bab-9f80-fec0557e69b3 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:40.092706 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a4e990a2-81ee-4bab-9f80-fec0557e69b3 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:40.093496 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a4e990a2-81ee-4bab-9f80-fec0557e69b3 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:40.094151 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a4e990a2-81ee-4bab-9f80-fec0557e69b3 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:40.163836 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-957e1f9f-5290-4197-9174-b2cd438827ea tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Getting quotas for project 2b557edd165144c8943eb9acc339a377. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:19:40.174194 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-957e1f9f-5290-4197-9174-b2cd438827ea tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Getting quotas for user 0d89081084f14e0187f4c67cd9185fef and project 2b557edd165144c8943eb9acc339a377. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:19:40.232905 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-957e1f9f-5290-4197-9174-b2cd438827ea tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Going to run 1 instances... {{(pid=122632) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 23:19:40.240000 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-957e1f9f-5290-4197-9174-b2cd438827ea tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] [instance: a98455ed-1e70-4d9a-98a4-77262e588e87] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78ad8905-f66f-4733-8be9-2b260f1fabed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122632) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 23:19:40.345768 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-957e1f9f-5290-4197-9174-b2cd438827ea tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.190638 Aug 10 23:19:40.346871 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2224/4652] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 23:19:38 2022] POST /compute/v2.1/servers => generated 401 bytes in 2192 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 23:19:40.358333 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c02ed9e2-35c9-4326-a966-6af5611d2a7d tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:40.359100 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-c02ed9e2-35c9-4326-a966-6af5611d2a7d tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] [instance: ee6a796b-efa5-4c73-8776-d86b54ca2190] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:40.376329 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c02ed9e2-35c9-4326-a966-6af5611d2a7d tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:40.376734 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c02ed9e2-35c9-4326-a966-6af5611d2a7d tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:40.377187 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c02ed9e2-35c9-4326-a966-6af5611d2a7d tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:40.380151 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c02ed9e2-35c9-4326-a966-6af5611d2a7d tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:40.380641 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c02ed9e2-35c9-4326-a966-6af5611d2a7d tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:40.381215 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c02ed9e2-35c9-4326-a966-6af5611d2a7d tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:40.728243 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-a4e990a2-81ee-4bab-9f80-fec0557e69b3 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07c94ebf0954cdea12b9a689538d96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395d7c4077e54c43bb95288db3942b0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:40.753578 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-a4e990a2-81ee-4bab-9f80-fec0557e69b3 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] 10.222.0.58 "GET /compute/v2.1/servers/7df225be-2dbc-4ef6-aeec-9a3de33a0006" status: 200 len: 1508 microversion: 2.1 time: 0.673042 Aug 10 23:19:40.755270 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2429/4653] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:40 2022] GET /compute/v2.1/servers/7df225be-2dbc-4ef6-aeec-9a3de33a0006 => generated 1508 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:19:40.771103 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-ce52e865-f742-4320-ade9-e965007c7204 req-38d7e21d-9edc-42b1-96e8-981748a5ea9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3efc12c9-baf5-40e4-9d98-e72d28377db6", "name": "network-vif-deleted", "tag": "2917009e-0d0a-40bd-81cf-b2967c8c2f2e"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:19:40.795759 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-ce52e865-f742-4320-ade9-e965007c7204 req-38d7e21d-9edc-42b1-96e8-981748a5ea9d service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:40.814034 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-ce52e865-f742-4320-ade9-e965007c7204 req-38d7e21d-9edc-42b1-96e8-981748a5ea9d service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:40.820907 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-ce52e865-f742-4320-ade9-e965007c7204 req-38d7e21d-9edc-42b1-96e8-981748a5ea9d service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:40.839175 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-ce52e865-f742-4320-ade9-e965007c7204 req-38d7e21d-9edc-42b1-96e8-981748a5ea9d service nova] Creating event network-vif-deleted:2917009e-0d0a-40bd-81cf-b2967c8c2f2e for instance 3efc12c9-baf5-40e4-9d98-e72d28377db6 on n-h1-850468-14 Aug 10 23:19:40.866296 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-ce52e865-f742-4320-ade9-e965007c7204 req-38d7e21d-9edc-42b1-96e8-981748a5ea9d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109006 Aug 10 23:19:40.867490 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2430/4654] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:19:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:19:40.882460 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-eeaa6b1a-9d01-4ab7-9937-0348c6563800 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:40.883662 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-eeaa6b1a-9d01-4ab7-9937-0348c6563800 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: 3efc12c9-baf5-40e4-9d98-e72d28377db6] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:40.949193 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-eeaa6b1a-9d01-4ab7-9937-0348c6563800 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:40.949975 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-eeaa6b1a-9d01-4ab7-9937-0348c6563800 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:40.950681 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-eeaa6b1a-9d01-4ab7-9937-0348c6563800 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:40.953298 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-eeaa6b1a-9d01-4ab7-9937-0348c6563800 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:40.954071 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-eeaa6b1a-9d01-4ab7-9937-0348c6563800 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:40.956276 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-eeaa6b1a-9d01-4ab7-9937-0348c6563800 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:41.002151 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-eeaa6b1a-9d01-4ab7-9937-0348c6563800 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] HTTP exception thrown: Instance 3efc12c9-baf5-40e4-9d98-e72d28377db6 could not be found. Aug 10 23:19:41.004631 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-eeaa6b1a-9d01-4ab7-9937-0348c6563800 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Request method failure captured: Aug 10 23:19:41.004631 n-d-850468-14 devstack@n-api.service[122633]: request: GET /compute/v2.1/servers/3efc12c9-baf5-40e4-9d98-e72d28377db6 HTTP/1.1 Aug 10 23:19:41.004631 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:19:41.004631 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:19:41.004631 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:19:41.004631 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:19:41.004631 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:19:41.004631 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:19:41.004631 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:19:41.004631 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:19:41.004631 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9Drw0c2MsNlQk2xhClSBMImCg12_8SYgkoaKQkzmFSrheNUqLDbfnKYZ8D3mVjR4fUdjKeuub5tXKPuyho3Qbzr6min3JWaqN44jGsCPGM23nBipHIYVBpHQxUCRbFIS5jN95f9E_tT0WyV4NvgkZnorl71EuxY70xL3GkCDAg5oTLs Aug 10 23:19:41.004631 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:19:41.004631 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:19:41.004631 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:19:41.004631 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:19:41.004631 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:19:41.004631 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:19:41.004631 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 1eb12683ada249bfa2ca7bf5cf730ca3 Aug 10 23:19:41.004631 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-ServerActionsTestJSON-819186707 Aug 10 23:19:41.004631 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:19:41.004631 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:19:41.004631 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1eb12683ada249bfa2ca7bf5cf730ca3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1eb12683ada249bfa2ca7bf5cf730ca3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/1eb12683ada249bfa2ca7bf5cf730ca3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_1eb12683ada249bfa2ca7bf5cf730ca3", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:19:41.004631 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-ServerActionsTestJSON-819186707 Aug 10 23:19:41.004631 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 1eb12683ada249bfa2ca7bf5cf730ca3 Aug 10 23:19:41.004631 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-ServerActionsTestJSON-819186707 Aug 10 23:19:41.004631 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-ServerActionsTestJSON-819186707-project Aug 10 23:19:41.004631 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:19:41.004631 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:19:41.004631 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 2ea96841d5b64d2390d18b3eb5da8b73 Aug 10 23:19:41.004631 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-ServerActionsTestJSON-819186707-project Aug 10 23:19:41.004631 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:19:41.004631 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance 3efc12c9-baf5-40e4-9d98-e72d28377db6 could not be found. Aug 10 23:19:41.004631 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': '3efc12c9-baf5-40e4-9d98-e72d28377db6'} Aug 10 23:19:41.004631 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:19:41.004631 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:19:41.004631 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:19:41.004631 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:19:41.004631 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:19:41.004631 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:19:41.004631 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:19:41.004631 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:19:41.004631 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:19:41.004631 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:19:41.004631 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3efc12c9-baf5-40e4-9d98-e72d28377db6 could not be found. Aug 10 23:19:41.004631 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:19:41.004631 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:19:41.004631 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:19:41.004631 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:19:41.004631 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:19:41.004631 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:19:41.004631 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:19:41.004631 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:19:41.004631 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:19:41.004631 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:19:41.004631 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:19:41.004631 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:19:41.004631 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:19:41.004631 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:19:41.004631 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:19:41.004631 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:19:41.004631 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3efc12c9-baf5-40e4-9d98-e72d28377db6 could not be found. Aug 10 23:19:41.004631 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:19:41.004631 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:19:41.004631 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:19:41.010109 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:19:41.010109 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:19:41.010109 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:19:41.010109 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:19:41.010109 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:19:41.010109 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3efc12c9-baf5-40e4-9d98-e72d28377db6 could not be found. Aug 10 23:19:41.010109 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:19:41.014173 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-eeaa6b1a-9d01-4ab7-9937-0348c6563800 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Returning 404 to user: Instance 3efc12c9-baf5-40e4-9d98-e72d28377db6 could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:19:41.020513 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-eeaa6b1a-9d01-4ab7-9937-0348c6563800 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/3efc12c9-baf5-40e4-9d98-e72d28377db6" status: 404 len: 111 microversion: 2.1 time: 0.151052 Aug 10 23:19:41.021464 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2431/4655] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:40 2022] GET /compute/v2.1/servers/3efc12c9-baf5-40e4-9d98-e72d28377db6 => generated 111 bytes in 153 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:19:41.028839 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-3d06e82f-4969-43b5-bae4-1010f67b5b9e tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:41.034650 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-3d06e82f-4969-43b5-bae4-1010f67b5b9e tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] [instance: a98455ed-1e70-4d9a-98a4-77262e588e87] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:41.197765 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-3d06e82f-4969-43b5-bae4-1010f67b5b9e tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d89081084f14e0187f4c67cd9185fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b557edd165144c8943eb9acc339a377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:41.215179 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-3d06e82f-4969-43b5-bae4-1010f67b5b9e tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] 10.222.0.58 "GET /compute/v2.1/servers/a98455ed-1e70-4d9a-98a4-77262e588e87" status: 200 len: 1241 microversion: 2.1 time: 0.190334 Aug 10 23:19:41.230110 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2432/4656] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:41 2022] GET /compute/v2.1/servers/a98455ed-1e70-4d9a-98a4-77262e588e87 => generated 1241 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:19:41.239603 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c728c553-4bf6-4709-aad0-cfcd18ae20bc tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:41.244255 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-c728c553-4bf6-4709-aad0-cfcd18ae20bc tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: d3455c49-214c-4635-b28b-f87ff636e960] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:41.254625 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c728c553-4bf6-4709-aad0-cfcd18ae20bc tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:41.255199 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c728c553-4bf6-4709-aad0-cfcd18ae20bc tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:41.255648 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c728c553-4bf6-4709-aad0-cfcd18ae20bc tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:41.256742 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c728c553-4bf6-4709-aad0-cfcd18ae20bc tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:41.257210 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c728c553-4bf6-4709-aad0-cfcd18ae20bc tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:41.257712 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c728c553-4bf6-4709-aad0-cfcd18ae20bc tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:41.301098 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-c02ed9e2-35c9-4326-a966-6af5611d2a7d tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '627b163f1a0e4fdeb0e9692e7d37460d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb5f5856c46490ab1ded572d693c4cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:41.318136 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-c02ed9e2-35c9-4326-a966-6af5611d2a7d tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] 10.222.0.58 "GET /compute/v2.1/servers/ee6a796b-efa5-4c73-8776-d86b54ca2190" status: 200 len: 1469 microversion: 2.1 time: 0.965072 Aug 10 23:19:41.318990 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2225/4657] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:40 2022] GET /compute/v2.1/servers/ee6a796b-efa5-4c73-8776-d86b54ca2190 => generated 1469 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:19:41.326056 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-caa30cba-f50a-4381-adcc-71b36edd9524 req-9bc6c8a2-2b3d-4f11-90e5-59755eaeb0b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7df225be-2dbc-4ef6-aeec-9a3de33a0006", "name": "network-vif-deleted", "tag": "54202e59-d171-4a05-91d4-e187250d698c"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:19:41.354086 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-caa30cba-f50a-4381-adcc-71b36edd9524 req-9bc6c8a2-2b3d-4f11-90e5-59755eaeb0b1 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:41.355116 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-caa30cba-f50a-4381-adcc-71b36edd9524 req-9bc6c8a2-2b3d-4f11-90e5-59755eaeb0b1 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:41.355446 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-caa30cba-f50a-4381-adcc-71b36edd9524 req-9bc6c8a2-2b3d-4f11-90e5-59755eaeb0b1 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:41.374632 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-caa30cba-f50a-4381-adcc-71b36edd9524 req-9bc6c8a2-2b3d-4f11-90e5-59755eaeb0b1 service nova] Creating event network-vif-deleted:54202e59-d171-4a05-91d4-e187250d698c for instance 7df225be-2dbc-4ef6-aeec-9a3de33a0006 on n-h2-850468-14 Aug 10 23:19:41.384170 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-caa30cba-f50a-4381-adcc-71b36edd9524 req-9bc6c8a2-2b3d-4f11-90e5-59755eaeb0b1 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063444 Aug 10 23:19:41.385417 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2226/4658] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:19:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:19:41.392895 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-00c48b55-8e52-466e-b2f1-884ff10d8f45 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:41.397131 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-00c48b55-8e52-466e-b2f1-884ff10d8f45 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: fa9dfd3a-a636-48ce-ae15-0ed51baee954] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:41.406036 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-00c48b55-8e52-466e-b2f1-884ff10d8f45 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:41.406760 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-00c48b55-8e52-466e-b2f1-884ff10d8f45 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:41.407802 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-00c48b55-8e52-466e-b2f1-884ff10d8f45 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:41.408685 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-00c48b55-8e52-466e-b2f1-884ff10d8f45 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:41.411806 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-00c48b55-8e52-466e-b2f1-884ff10d8f45 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:41.413589 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-00c48b55-8e52-466e-b2f1-884ff10d8f45 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:41.455859 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-00c48b55-8e52-466e-b2f1-884ff10d8f45 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: fa9dfd3a-a636-48ce-ae15-0ed51baee954] Going to try to terminate instance {{(pid=122632) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:19:41.566188 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:19:41.590169 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-c728c553-4bf6-4709-aad0-cfcd18ae20bc tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6684f0c87e4242be9e0ffb4ef1973f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0582ace9e4443b8ad88915503ee630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:41.603667 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-c728c553-4bf6-4709-aad0-cfcd18ae20bc tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "GET /compute/v2.1/servers/d3455c49-214c-4635-b28b-f87ff636e960" status: 200 len: 1327 microversion: 2.1 time: 0.373949 Aug 10 23:19:41.604986 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2433/4659] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:41 2022] GET /compute/v2.1/servers/d3455c49-214c-4635-b28b-f87ff636e960 => generated 1327 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:19:41.614475 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-08d32096-a6da-41c2-91c6-27a0a5a9402e tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:41.617174 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-00c48b55-8e52-466e-b2f1-884ff10d8f45 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "DELETE /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954" status: 204 len: 0 microversion: 2.1 time: 0.228462 Aug 10 23:19:41.618093 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-08d32096-a6da-41c2-91c6-27a0a5a9402e tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] [instance: 7e091da3-0636-4cba-b8de-94fdeecf0b7f] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:41.622884 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2227/4660] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:19:41 2022] DELETE /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:19:41.630567 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-08d32096-a6da-41c2-91c6-27a0a5a9402e tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:41.633456 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-eb28782d-00b1-4812-8761-418cedd619f6 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:41.634116 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-08d32096-a6da-41c2-91c6-27a0a5a9402e tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:41.634696 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-08d32096-a6da-41c2-91c6-27a0a5a9402e tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:41.635201 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-eb28782d-00b1-4812-8761-418cedd619f6 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: fa9dfd3a-a636-48ce-ae15-0ed51baee954] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:41.635726 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-08d32096-a6da-41c2-91c6-27a0a5a9402e tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:41.637634 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-08d32096-a6da-41c2-91c6-27a0a5a9402e tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:41.638615 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-08d32096-a6da-41c2-91c6-27a0a5a9402e tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:41.646047 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-eb28782d-00b1-4812-8761-418cedd619f6 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:41.647629 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-eb28782d-00b1-4812-8761-418cedd619f6 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:41.648442 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-eb28782d-00b1-4812-8761-418cedd619f6 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:41.649561 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-eb28782d-00b1-4812-8761-418cedd619f6 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:41.650244 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-eb28782d-00b1-4812-8761-418cedd619f6 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:41.650959 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-eb28782d-00b1-4812-8761-418cedd619f6 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:41.845242 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-eb28782d-00b1-4812-8761-418cedd619f6 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:41.854564 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-eb28782d-00b1-4812-8761-418cedd619f6 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954" status: 200 len: 1673 microversion: 2.1 time: 0.229560 Aug 10 23:19:41.856334 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2228/4661] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:41 2022] GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954 => generated 1673 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:19:41.860485 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c60b0560-d8bf-4eb9-a61a-b2afbe674ce6 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:41.861606 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-c60b0560-d8bf-4eb9-a61a-b2afbe674ce6 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] [instance: 7df225be-2dbc-4ef6-aeec-9a3de33a0006] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:41.877120 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c60b0560-d8bf-4eb9-a61a-b2afbe674ce6 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:41.877733 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c60b0560-d8bf-4eb9-a61a-b2afbe674ce6 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:41.878399 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c60b0560-d8bf-4eb9-a61a-b2afbe674ce6 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:41.882812 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c60b0560-d8bf-4eb9-a61a-b2afbe674ce6 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:41.882812 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c60b0560-d8bf-4eb9-a61a-b2afbe674ce6 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:41.882812 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c60b0560-d8bf-4eb9-a61a-b2afbe674ce6 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:41.900306 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-c60b0560-d8bf-4eb9-a61a-b2afbe674ce6 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] HTTP exception thrown: Instance 7df225be-2dbc-4ef6-aeec-9a3de33a0006 could not be found. Aug 10 23:19:41.902168 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c60b0560-d8bf-4eb9-a61a-b2afbe674ce6 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Request method failure captured: Aug 10 23:19:41.902168 n-d-850468-14 devstack@n-api.service[122632]: request: GET /compute/v2.1/servers/7df225be-2dbc-4ef6-aeec-9a3de33a0006 HTTP/1.1 Aug 10 23:19:41.902168 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:19:41.902168 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:19:41.902168 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:19:41.902168 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 23:19:41.902168 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:19:41.902168 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:19:41.902168 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:19:41.902168 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:19:41.902168 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9DvG6mPOp_bU6YQakEzMuJf91N1YrPRgIEe5ouB8tWtrXuOeLQgeJ0ouDTrtP31JIWcz1wQJ17PTz3JUAbF_FaF35I1F09nIb2lkQ0GhE880fsA2K13MCP_yKxqm-kv_hQLiQB8UzdyMBwb04C68j2QYpbobWhHyceARqBEeITDqyg0 Aug 10 23:19:41.902168 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:19:41.902168 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:19:41.902168 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:19:41.902168 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:19:41.902168 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:19:41.902168 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:19:41.902168 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 395d7c4077e54c43bb95288db3942b0a Aug 10 23:19:41.902168 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1029565464 Aug 10 23:19:41.902168 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:19:41.902168 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:19:41.902168 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/395d7c4077e54c43bb95288db3942b0a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/395d7c4077e54c43bb95288db3942b0a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/395d7c4077e54c43bb95288db3942b0a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_395d7c4077e54c43bb95288db3942b0a", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:19:41.902168 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1029565464 Aug 10 23:19:41.902168 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 395d7c4077e54c43bb95288db3942b0a Aug 10 23:19:41.902168 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1029565464 Aug 10 23:19:41.902168 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-ServerRescueNegativeTestJSON-1029565464-project Aug 10 23:19:41.902168 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:19:41.902168 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:19:41.902168 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: f07c94ebf0954cdea12b9a689538d96d Aug 10 23:19:41.902168 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1029565464-project Aug 10 23:19:41.902168 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:19:41.902168 n-d-850468-14 devstack@n-api.service[122632]: exception: Instance 7df225be-2dbc-4ef6-aeec-9a3de33a0006 could not be found. Aug 10 23:19:41.902168 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': '7df225be-2dbc-4ef6-aeec-9a3de33a0006'} Aug 10 23:19:41.902168 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:19:41.902168 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:19:41.902168 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:19:41.902168 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:19:41.902168 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:19:41.902168 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:19:41.902168 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:19:41.902168 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:19:41.902168 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:19:41.902168 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:19:41.902168 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7df225be-2dbc-4ef6-aeec-9a3de33a0006 could not be found. Aug 10 23:19:41.902168 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:19:41.902168 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:19:41.902168 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:19:41.902168 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:19:41.902168 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:19:41.902168 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:19:41.902168 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:19:41.902168 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:19:41.902168 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:19:41.902168 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:19:41.902168 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:19:41.902168 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:19:41.902168 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:19:41.902168 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:19:41.902168 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:19:41.902168 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:19:41.902168 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7df225be-2dbc-4ef6-aeec-9a3de33a0006 could not be found. Aug 10 23:19:41.902168 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:19:41.902168 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:19:41.906979 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:19:41.906979 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:19:41.906979 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:19:41.906979 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:19:41.906979 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:19:41.906979 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:19:41.906979 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7df225be-2dbc-4ef6-aeec-9a3de33a0006 could not be found. Aug 10 23:19:41.906979 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:19:41.906979 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c60b0560-d8bf-4eb9-a61a-b2afbe674ce6 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Returning 404 to user: Instance 7df225be-2dbc-4ef6-aeec-9a3de33a0006 could not be found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:19:41.906979 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-c60b0560-d8bf-4eb9-a61a-b2afbe674ce6 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] 10.222.0.58 "GET /compute/v2.1/servers/7df225be-2dbc-4ef6-aeec-9a3de33a0006" status: 404 len: 111 microversion: 2.1 time: 0.047761 Aug 10 23:19:41.908158 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2229/4662] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:41 2022] GET /compute/v2.1/servers/7df225be-2dbc-4ef6-aeec-9a3de33a0006 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:19:41.913263 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-fe1a3e57-3a4e-44d0-8faa-edf8783236c0 req-66bbb2c7-7b12-46b3-a2a0-fc797349e7f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e091da3-0636-4cba-b8de-94fdeecf0b7f", "name": "network-vif-plugged", "status": "completed", "tag": "d1dfd00f-ee9e-41fd-a00e-0820c42b1cf5"}, {"server_uuid": "7e091da3-0636-4cba-b8de-94fdeecf0b7f", "name": "network-vif-plugged", "status": "completed", "tag": "a65ed440-a31b-429f-8aa3-2fb86a09c770"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:19:41.924175 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-fe1a3e57-3a4e-44d0-8faa-edf8783236c0 req-66bbb2c7-7b12-46b3-a2a0-fc797349e7f9 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:41.924666 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-fe1a3e57-3a4e-44d0-8faa-edf8783236c0 req-66bbb2c7-7b12-46b3-a2a0-fc797349e7f9 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:41.925140 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-fe1a3e57-3a4e-44d0-8faa-edf8783236c0 req-66bbb2c7-7b12-46b3-a2a0-fc797349e7f9 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:41.972103 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-fe1a3e57-3a4e-44d0-8faa-edf8783236c0 req-66bbb2c7-7b12-46b3-a2a0-fc797349e7f9 service nova] Creating event network-vif-plugged:d1dfd00f-ee9e-41fd-a00e-0820c42b1cf5 for instance 7e091da3-0636-4cba-b8de-94fdeecf0b7f on n-h1-850468-14 Aug 10 23:19:41.975959 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-fe1a3e57-3a4e-44d0-8faa-edf8783236c0 req-66bbb2c7-7b12-46b3-a2a0-fc797349e7f9 service nova] Creating event network-vif-plugged:a65ed440-a31b-429f-8aa3-2fb86a09c770 for instance 7e091da3-0636-4cba-b8de-94fdeecf0b7f on n-h1-850468-14 Aug 10 23:19:41.994089 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-fe1a3e57-3a4e-44d0-8faa-edf8783236c0 req-66bbb2c7-7b12-46b3-a2a0-fc797349e7f9 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.084767 Aug 10 23:19:41.994709 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2230/4663] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:19:41 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:19:42.004675 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-16136653-aead-4c2a-8f69-97e38b56838a tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:42.007716 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-16136653-aead-4c2a-8f69-97e38b56838a tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] [instance: 27dd09d6-47ed-4b55-bd02-baad36a28429] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:42.007873 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-08d32096-a6da-41c2-91c6-27a0a5a9402e tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:42.017051 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-08d32096-a6da-41c2-91c6-27a0a5a9402e tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:42.018575 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-08d32096-a6da-41c2-91c6-27a0a5a9402e tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:42.020144 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-08d32096-a6da-41c2-91c6-27a0a5a9402e tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] 10.222.0.58 "GET /compute/v2.1/servers/7e091da3-0636-4cba-b8de-94fdeecf0b7f" status: 200 len: 1875 microversion: 2.32 time: 0.411086 Aug 10 23:19:42.024087 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2434/4664] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:19:41 2022] GET /compute/v2.1/servers/7e091da3-0636-4cba-b8de-94fdeecf0b7f => generated 1875 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:19:42.025909 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-16136653-aead-4c2a-8f69-97e38b56838a tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:42.026423 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-16136653-aead-4c2a-8f69-97e38b56838a tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:42.031002 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-16136653-aead-4c2a-8f69-97e38b56838a tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:42.032017 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-16136653-aead-4c2a-8f69-97e38b56838a tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:42.032716 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-16136653-aead-4c2a-8f69-97e38b56838a tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:42.033473 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-16136653-aead-4c2a-8f69-97e38b56838a tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:42.112333 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-16136653-aead-4c2a-8f69-97e38b56838a tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] [instance: 27dd09d6-47ed-4b55-bd02-baad36a28429] Going to try to terminate instance {{(pid=122632) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:19:42.237621 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-0f04a986-0a61-4e07-bfff-c7a3f51825b9 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:42.238251 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-0f04a986-0a61-4e07-bfff-c7a3f51825b9 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] [instance: a98455ed-1e70-4d9a-98a4-77262e588e87] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:42.246021 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0f04a986-0a61-4e07-bfff-c7a3f51825b9 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:42.246529 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0f04a986-0a61-4e07-bfff-c7a3f51825b9 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:42.247025 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0f04a986-0a61-4e07-bfff-c7a3f51825b9 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:42.247747 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0f04a986-0a61-4e07-bfff-c7a3f51825b9 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:42.248402 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0f04a986-0a61-4e07-bfff-c7a3f51825b9 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:42.249368 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0f04a986-0a61-4e07-bfff-c7a3f51825b9 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:42.298091 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-16136653-aead-4c2a-8f69-97e38b56838a tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] 10.222.0.58 "DELETE /compute/v2.1/servers/27dd09d6-47ed-4b55-bd02-baad36a28429" status: 204 len: 0 microversion: 2.1 time: 0.301809 Aug 10 23:19:42.298904 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2231/4665] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:19:41 2022] DELETE /compute/v2.1/servers/27dd09d6-47ed-4b55-bd02-baad36a28429 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:19:42.308228 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c5463a96-5282-48a6-9898-3615c15e7b80 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:42.308958 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-c5463a96-5282-48a6-9898-3615c15e7b80 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] [instance: 27dd09d6-47ed-4b55-bd02-baad36a28429] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:42.316219 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c5463a96-5282-48a6-9898-3615c15e7b80 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:42.317085 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c5463a96-5282-48a6-9898-3615c15e7b80 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:42.317902 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c5463a96-5282-48a6-9898-3615c15e7b80 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:42.319649 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c5463a96-5282-48a6-9898-3615c15e7b80 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:42.320455 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c5463a96-5282-48a6-9898-3615c15e7b80 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:42.321661 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c5463a96-5282-48a6-9898-3615c15e7b80 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:42.386238 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-0f04a986-0a61-4e07-bfff-c7a3f51825b9 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d89081084f14e0187f4c67cd9185fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b557edd165144c8943eb9acc339a377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:42.403006 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-0f04a986-0a61-4e07-bfff-c7a3f51825b9 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] 10.222.0.58 "GET /compute/v2.1/servers/a98455ed-1e70-4d9a-98a4-77262e588e87" status: 200 len: 1301 microversion: 2.1 time: 0.166244 Aug 10 23:19:42.403618 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2435/4666] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:42 2022] GET /compute/v2.1/servers/a98455ed-1e70-4d9a-98a4-77262e588e87 => generated 1301 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:19:42.417233 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-613d77c3-d615-4bde-8bf9-41d87f058437 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:42.418661 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-613d77c3-d615-4bde-8bf9-41d87f058437 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] [instance: ee6a796b-efa5-4c73-8776-d86b54ca2190] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:42.435074 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-613d77c3-d615-4bde-8bf9-41d87f058437 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:42.435850 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-613d77c3-d615-4bde-8bf9-41d87f058437 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:42.437753 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-613d77c3-d615-4bde-8bf9-41d87f058437 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:42.438542 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-613d77c3-d615-4bde-8bf9-41d87f058437 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:42.439130 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-613d77c3-d615-4bde-8bf9-41d87f058437 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:42.439741 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-613d77c3-d615-4bde-8bf9-41d87f058437 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:42.654981 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-c5463a96-5282-48a6-9898-3615c15e7b80 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07c94ebf0954cdea12b9a689538d96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395d7c4077e54c43bb95288db3942b0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:42.663661 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-c5463a96-5282-48a6-9898-3615c15e7b80 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] 10.222.0.58 "GET /compute/v2.1/servers/27dd09d6-47ed-4b55-bd02-baad36a28429" status: 200 len: 1521 microversion: 2.1 time: 0.360371 Aug 10 23:19:42.664512 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2232/4667] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:42 2022] GET /compute/v2.1/servers/27dd09d6-47ed-4b55-bd02-baad36a28429 => generated 1521 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:19:42.670383 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-ffeed1a0-57c8-4aa5-8088-6e9aa5d121c9 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:42.671234 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-ffeed1a0-57c8-4aa5-8088-6e9aa5d121c9 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: d3455c49-214c-4635-b28b-f87ff636e960] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:42.678760 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ffeed1a0-57c8-4aa5-8088-6e9aa5d121c9 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:42.679314 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ffeed1a0-57c8-4aa5-8088-6e9aa5d121c9 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:42.679754 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ffeed1a0-57c8-4aa5-8088-6e9aa5d121c9 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:42.680466 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ffeed1a0-57c8-4aa5-8088-6e9aa5d121c9 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:42.680921 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ffeed1a0-57c8-4aa5-8088-6e9aa5d121c9 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:42.681349 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ffeed1a0-57c8-4aa5-8088-6e9aa5d121c9 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:42.813035 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-613d77c3-d615-4bde-8bf9-41d87f058437 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '627b163f1a0e4fdeb0e9692e7d37460d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb5f5856c46490ab1ded572d693c4cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:42.822266 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-613d77c3-d615-4bde-8bf9-41d87f058437 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] 10.222.0.58 "GET /compute/v2.1/servers/ee6a796b-efa5-4c73-8776-d86b54ca2190" status: 200 len: 1469 microversion: 2.1 time: 0.415908 Aug 10 23:19:42.835441 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-ffeed1a0-57c8-4aa5-8088-6e9aa5d121c9 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6684f0c87e4242be9e0ffb4ef1973f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0582ace9e4443b8ad88915503ee630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:42.835441 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-ffeed1a0-57c8-4aa5-8088-6e9aa5d121c9 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "GET /compute/v2.1/servers/d3455c49-214c-4635-b28b-f87ff636e960" status: 200 len: 1327 microversion: 2.1 time: 0.165051 Aug 10 23:19:42.835441 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2233/4668] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:42 2022] GET /compute/v2.1/servers/d3455c49-214c-4635-b28b-f87ff636e960 => generated 1327 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:19:42.836359 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2436/4669] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:42 2022] GET /compute/v2.1/servers/ee6a796b-efa5-4c73-8776-d86b54ca2190 => generated 1469 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:19:42.889071 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c6ed8955-5aea-4c92-b1cc-3c2ac2ff699b tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:42.889856 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-c6ed8955-5aea-4c92-b1cc-3c2ac2ff699b tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: fa9dfd3a-a636-48ce-ae15-0ed51baee954] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:42.898817 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c6ed8955-5aea-4c92-b1cc-3c2ac2ff699b tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:42.899331 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c6ed8955-5aea-4c92-b1cc-3c2ac2ff699b tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:42.899769 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c6ed8955-5aea-4c92-b1cc-3c2ac2ff699b tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:42.900551 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c6ed8955-5aea-4c92-b1cc-3c2ac2ff699b tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:42.900964 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c6ed8955-5aea-4c92-b1cc-3c2ac2ff699b tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:42.901388 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c6ed8955-5aea-4c92-b1cc-3c2ac2ff699b tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:42.941510 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-ce1b7352-e72a-4cab-b228-707e109a1f33 req-261e8fad-721f-43ca-a151-348736278990 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee6a796b-efa5-4c73-8776-d86b54ca2190", "tag": "4879d463-bf92-43e3-a52e-45e2730c0d75"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:19:42.953414 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-ce1b7352-e72a-4cab-b228-707e109a1f33 req-261e8fad-721f-43ca-a151-348736278990 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:42.954488 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-ce1b7352-e72a-4cab-b228-707e109a1f33 req-261e8fad-721f-43ca-a151-348736278990 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:42.954488 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-ce1b7352-e72a-4cab-b228-707e109a1f33 req-261e8fad-721f-43ca-a151-348736278990 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:42.968386 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-ce1b7352-e72a-4cab-b228-707e109a1f33 req-261e8fad-721f-43ca-a151-348736278990 service nova] Creating event network-changed:4879d463-bf92-43e3-a52e-45e2730c0d75 for instance ee6a796b-efa5-4c73-8776-d86b54ca2190 on n-h2-850468-14 Aug 10 23:19:42.976067 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-ce1b7352-e72a-4cab-b228-707e109a1f33 req-261e8fad-721f-43ca-a151-348736278990 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039212 Aug 10 23:19:42.977025 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2437/4670] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:19:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 23:19:43.031940 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-e97eb9b2-c7aa-4da3-98ab-ff56cd25df54 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:19:43.040249 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-e97eb9b2-c7aa-4da3-98ab-ff56cd25df54 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] [instance: 69c4b403-a8ad-449c-a577-63837a6d2445] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:43.048189 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e97eb9b2-c7aa-4da3-98ab-ff56cd25df54 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:43.048848 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e97eb9b2-c7aa-4da3-98ab-ff56cd25df54 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:43.049137 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e97eb9b2-c7aa-4da3-98ab-ff56cd25df54 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:43.049993 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e97eb9b2-c7aa-4da3-98ab-ff56cd25df54 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:43.050469 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e97eb9b2-c7aa-4da3-98ab-ff56cd25df54 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:43.050953 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e97eb9b2-c7aa-4da3-98ab-ff56cd25df54 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:43.093954 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-c6ed8955-5aea-4c92-b1cc-3c2ac2ff699b tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:43.104634 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-c6ed8955-5aea-4c92-b1cc-3c2ac2ff699b tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954" status: 200 len: 1673 microversion: 2.1 time: 0.217883 Aug 10 23:19:43.104634 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2234/4671] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:42 2022] GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954 => generated 1673 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:19:43.108903 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-ac506b30-6d0f-4966-8c71-2103809b013b tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:43.109519 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-ac506b30-6d0f-4966-8c71-2103809b013b tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] [instance: 7e091da3-0636-4cba-b8de-94fdeecf0b7f] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:43.117252 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ac506b30-6d0f-4966-8c71-2103809b013b tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:43.117505 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ac506b30-6d0f-4966-8c71-2103809b013b tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:43.117969 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ac506b30-6d0f-4966-8c71-2103809b013b tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:43.119165 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ac506b30-6d0f-4966-8c71-2103809b013b tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:43.119293 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ac506b30-6d0f-4966-8c71-2103809b013b tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:43.119651 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ac506b30-6d0f-4966-8c71-2103809b013b tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:43.344669 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-ac506b30-6d0f-4966-8c71-2103809b013b tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:43.355437 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-ac506b30-6d0f-4966-8c71-2103809b013b tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:43.357393 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-ac506b30-6d0f-4966-8c71-2103809b013b tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:43.358607 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-ac506b30-6d0f-4966-8c71-2103809b013b tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] 10.222.0.58 "GET /compute/v2.1/servers/7e091da3-0636-4cba-b8de-94fdeecf0b7f" status: 200 len: 1875 microversion: 2.32 time: 0.253774 Aug 10 23:19:43.359286 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2235/4672] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:19:43 2022] GET /compute/v2.1/servers/7e091da3-0636-4cba-b8de-94fdeecf0b7f => generated 1875 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:19:43.424147 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-771c8bf9-eaa4-45c1-819f-c4f7a0cddbea tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:43.424772 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-771c8bf9-eaa4-45c1-819f-c4f7a0cddbea tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] [instance: a98455ed-1e70-4d9a-98a4-77262e588e87] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:43.432194 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-771c8bf9-eaa4-45c1-819f-c4f7a0cddbea tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:43.432897 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-771c8bf9-eaa4-45c1-819f-c4f7a0cddbea tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:43.433357 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-771c8bf9-eaa4-45c1-819f-c4f7a0cddbea tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:43.434095 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-771c8bf9-eaa4-45c1-819f-c4f7a0cddbea tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:43.434588 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-771c8bf9-eaa4-45c1-819f-c4f7a0cddbea tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:43.435075 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-771c8bf9-eaa4-45c1-819f-c4f7a0cddbea tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:43.510496 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-771c8bf9-eaa4-45c1-819f-c4f7a0cddbea tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d89081084f14e0187f4c67cd9185fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b557edd165144c8943eb9acc339a377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:43.529006 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-771c8bf9-eaa4-45c1-819f-c4f7a0cddbea tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] 10.222.0.58 "GET /compute/v2.1/servers/a98455ed-1e70-4d9a-98a4-77262e588e87" status: 200 len: 1299 microversion: 2.1 time: 0.108956 Aug 10 23:19:43.530845 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2236/4673] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:43 2022] GET /compute/v2.1/servers/a98455ed-1e70-4d9a-98a4-77262e588e87 => generated 1299 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:19:43.685296 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-52372a87-bf55-477e-8a0d-4e1352a44cc2 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:43.685973 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-52372a87-bf55-477e-8a0d-4e1352a44cc2 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] [instance: 27dd09d6-47ed-4b55-bd02-baad36a28429] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:43.696166 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-52372a87-bf55-477e-8a0d-4e1352a44cc2 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:43.698924 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-52372a87-bf55-477e-8a0d-4e1352a44cc2 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:43.699680 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-52372a87-bf55-477e-8a0d-4e1352a44cc2 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:43.701543 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-52372a87-bf55-477e-8a0d-4e1352a44cc2 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:43.703514 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-52372a87-bf55-477e-8a0d-4e1352a44cc2 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:43.705242 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-52372a87-bf55-477e-8a0d-4e1352a44cc2 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:43.927504 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-52372a87-bf55-477e-8a0d-4e1352a44cc2 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07c94ebf0954cdea12b9a689538d96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395d7c4077e54c43bb95288db3942b0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:43.947160 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-52372a87-bf55-477e-8a0d-4e1352a44cc2 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] 10.222.0.58 "GET /compute/v2.1/servers/27dd09d6-47ed-4b55-bd02-baad36a28429" status: 200 len: 1521 microversion: 2.1 time: 0.261461 Aug 10 23:19:43.961203 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2237/4674] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:43 2022] GET /compute/v2.1/servers/27dd09d6-47ed-4b55-bd02-baad36a28429 => generated 1521 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:19:43.970421 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-9d9bb09b-80c7-4e99-b48c-dc7136e3d8c7 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:43.971177 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-9d9bb09b-80c7-4e99-b48c-dc7136e3d8c7 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] [instance: ee6a796b-efa5-4c73-8776-d86b54ca2190] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:43.987375 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9d9bb09b-80c7-4e99-b48c-dc7136e3d8c7 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:43.987884 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9d9bb09b-80c7-4e99-b48c-dc7136e3d8c7 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:43.988329 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9d9bb09b-80c7-4e99-b48c-dc7136e3d8c7 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:43.989056 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9d9bb09b-80c7-4e99-b48c-dc7136e3d8c7 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:43.989516 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9d9bb09b-80c7-4e99-b48c-dc7136e3d8c7 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:43.992602 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9d9bb09b-80c7-4e99-b48c-dc7136e3d8c7 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:44.322987 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-9d9bb09b-80c7-4e99-b48c-dc7136e3d8c7 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '627b163f1a0e4fdeb0e9692e7d37460d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb5f5856c46490ab1ded572d693c4cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:44.332571 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-9d9bb09b-80c7-4e99-b48c-dc7136e3d8c7 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] 10.222.0.58 "GET /compute/v2.1/servers/ee6a796b-efa5-4c73-8776-d86b54ca2190" status: 200 len: 1469 microversion: 2.1 time: 0.369404 Aug 10 23:19:44.333224 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2238/4675] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:43 2022] GET /compute/v2.1/servers/ee6a796b-efa5-4c73-8776-d86b54ca2190 => generated 1469 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:19:44.340603 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-745f298c-82fd-4494-8829-a735c43bb0f5 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:44.341489 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-745f298c-82fd-4494-8829-a735c43bb0f5 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: d3455c49-214c-4635-b28b-f87ff636e960] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:44.351688 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-745f298c-82fd-4494-8829-a735c43bb0f5 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:44.352312 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-745f298c-82fd-4494-8829-a735c43bb0f5 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:44.352897 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-745f298c-82fd-4494-8829-a735c43bb0f5 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:44.353698 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-745f298c-82fd-4494-8829-a735c43bb0f5 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:44.354235 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-745f298c-82fd-4494-8829-a735c43bb0f5 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:44.354736 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-745f298c-82fd-4494-8829-a735c43bb0f5 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:44.572487 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-745f298c-82fd-4494-8829-a735c43bb0f5 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6684f0c87e4242be9e0ffb4ef1973f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0582ace9e4443b8ad88915503ee630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:44.591353 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-745f298c-82fd-4494-8829-a735c43bb0f5 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "GET /compute/v2.1/servers/d3455c49-214c-4635-b28b-f87ff636e960" status: 200 len: 1327 microversion: 2.1 time: 0.253707 Aug 10 23:19:44.608441 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2239/4676] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:44 2022] GET /compute/v2.1/servers/d3455c49-214c-4635-b28b-f87ff636e960 => generated 1327 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:19:44.624151 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-e21870c2-b215-470c-84b4-09b2d78da101 req-52e63d36-e544-4ec9-9518-e6a15ee01071 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3455c49-214c-4635-b28b-f87ff636e960", "name": "network-vif-plugged", "status": "completed", "tag": "6dfabd56-dd78-4f9a-89be-a1bea2f40277"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:19:44.638201 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-e21870c2-b215-470c-84b4-09b2d78da101 req-52e63d36-e544-4ec9-9518-e6a15ee01071 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:44.639907 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-e21870c2-b215-470c-84b4-09b2d78da101 req-52e63d36-e544-4ec9-9518-e6a15ee01071 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:44.640536 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-e21870c2-b215-470c-84b4-09b2d78da101 req-52e63d36-e544-4ec9-9518-e6a15ee01071 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:44.656922 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-e21870c2-b215-470c-84b4-09b2d78da101 req-52e63d36-e544-4ec9-9518-e6a15ee01071 service nova] Creating event network-vif-plugged:6dfabd56-dd78-4f9a-89be-a1bea2f40277 for instance d3455c49-214c-4635-b28b-f87ff636e960 on n-h1-850468-14 Aug 10 23:19:44.662568 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-e21870c2-b215-470c-84b4-09b2d78da101 req-52e63d36-e544-4ec9-9518-e6a15ee01071 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051991 Aug 10 23:19:44.663603 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2240/4677] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:19:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:19:44.669545 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-65d78073-fe65-4467-97e1-fe2b3a2327a7 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:44.670254 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-65d78073-fe65-4467-97e1-fe2b3a2327a7 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: fa9dfd3a-a636-48ce-ae15-0ed51baee954] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:44.679986 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-65d78073-fe65-4467-97e1-fe2b3a2327a7 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:44.680483 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-65d78073-fe65-4467-97e1-fe2b3a2327a7 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:44.681153 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-65d78073-fe65-4467-97e1-fe2b3a2327a7 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:44.682108 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-65d78073-fe65-4467-97e1-fe2b3a2327a7 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:44.682721 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-65d78073-fe65-4467-97e1-fe2b3a2327a7 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:44.683353 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-65d78073-fe65-4467-97e1-fe2b3a2327a7 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:44.935108 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-65d78073-fe65-4467-97e1-fe2b3a2327a7 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:44.944707 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-65d78073-fe65-4467-97e1-fe2b3a2327a7 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954" status: 200 len: 1673 microversion: 2.1 time: 0.279033 Aug 10 23:19:44.945301 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2241/4678] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:44 2022] GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954 => generated 1673 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:19:44.950024 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-ed8cdacd-4b66-4efd-b334-f25c499b1495 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:44.950629 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-ed8cdacd-4b66-4efd-b334-f25c499b1495 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] [instance: 7e091da3-0636-4cba-b8de-94fdeecf0b7f] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:44.956669 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ed8cdacd-4b66-4efd-b334-f25c499b1495 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:44.957191 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ed8cdacd-4b66-4efd-b334-f25c499b1495 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:44.957628 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ed8cdacd-4b66-4efd-b334-f25c499b1495 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:44.958340 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ed8cdacd-4b66-4efd-b334-f25c499b1495 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:44.958771 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ed8cdacd-4b66-4efd-b334-f25c499b1495 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:44.963559 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ed8cdacd-4b66-4efd-b334-f25c499b1495 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:45.208054 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-ed8cdacd-4b66-4efd-b334-f25c499b1495 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:45.218328 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-ed8cdacd-4b66-4efd-b334-f25c499b1495 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:45.219867 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-ed8cdacd-4b66-4efd-b334-f25c499b1495 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:45.221632 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-ed8cdacd-4b66-4efd-b334-f25c499b1495 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] 10.222.0.58 "GET /compute/v2.1/servers/7e091da3-0636-4cba-b8de-94fdeecf0b7f" status: 200 len: 2828 microversion: 2.32 time: 0.274771 Aug 10 23:19:45.227175 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2242/4679] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:19:44 2022] GET /compute/v2.1/servers/7e091da3-0636-4cba-b8de-94fdeecf0b7f => generated 2828 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:19:45.227408 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-3efdf7b7-1e7b-458f-9d69-0ab22ad35477 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:45.228033 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-3efdf7b7-1e7b-458f-9d69-0ab22ad35477 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] [instance: a98455ed-1e70-4d9a-98a4-77262e588e87] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:45.235643 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3efdf7b7-1e7b-458f-9d69-0ab22ad35477 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:45.236005 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3efdf7b7-1e7b-458f-9d69-0ab22ad35477 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:45.236573 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3efdf7b7-1e7b-458f-9d69-0ab22ad35477 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:45.237281 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3efdf7b7-1e7b-458f-9d69-0ab22ad35477 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:45.237775 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3efdf7b7-1e7b-458f-9d69-0ab22ad35477 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:45.238217 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3efdf7b7-1e7b-458f-9d69-0ab22ad35477 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:45.297975 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-e97eb9b2-c7aa-4da3-98ab-ff56cd25df54 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "POST /compute/v2.1/servers/69c4b403-a8ad-449c-a577-63837a6d2445/action" status: 200 len: 24555 microversion: 2.1 time: 2.273670 Aug 10 23:19:45.300462 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2438/4680] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:19:43 2022] POST /compute/v2.1/servers/69c4b403-a8ad-449c-a577-63837a6d2445/action => generated 24555 bytes in 2278 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 23:19:45.306944 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-b1c82505-98da-40c6-8047-045f292f7879 req-1c87eb8d-f9c9-43e4-8aed-84d476b93a2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a98455ed-1e70-4d9a-98a4-77262e588e87", "tag": "182692c8-73e7-42ae-ada4-e4937c1ac10d"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:19:45.317401 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-b1c82505-98da-40c6-8047-045f292f7879 req-1c87eb8d-f9c9-43e4-8aed-84d476b93a2a service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:45.318138 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-b1c82505-98da-40c6-8047-045f292f7879 req-1c87eb8d-f9c9-43e4-8aed-84d476b93a2a service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:45.319282 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-b1c82505-98da-40c6-8047-045f292f7879 req-1c87eb8d-f9c9-43e4-8aed-84d476b93a2a service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:45.334141 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-b1c82505-98da-40c6-8047-045f292f7879 req-1c87eb8d-f9c9-43e4-8aed-84d476b93a2a service nova] Creating event network-changed:182692c8-73e7-42ae-ada4-e4937c1ac10d for instance a98455ed-1e70-4d9a-98a4-77262e588e87 on n-h1-850468-14 Aug 10 23:19:45.339846 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-b1c82505-98da-40c6-8047-045f292f7879 req-1c87eb8d-f9c9-43e4-8aed-84d476b93a2a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037732 Aug 10 23:19:45.340563 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2439/4681] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:19:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:19:45.346478 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-bae14049-c695-4233-b8cb-2665163c3b5a tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:45.348611 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-bae14049-c695-4233-b8cb-2665163c3b5a tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] [instance: 27dd09d6-47ed-4b55-bd02-baad36a28429] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:45.356014 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bae14049-c695-4233-b8cb-2665163c3b5a tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:45.356510 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bae14049-c695-4233-b8cb-2665163c3b5a tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:45.356945 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bae14049-c695-4233-b8cb-2665163c3b5a tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:45.357957 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bae14049-c695-4233-b8cb-2665163c3b5a tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:45.358693 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bae14049-c695-4233-b8cb-2665163c3b5a tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:45.359506 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bae14049-c695-4233-b8cb-2665163c3b5a tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:45.549595 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-3efdf7b7-1e7b-458f-9d69-0ab22ad35477 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d89081084f14e0187f4c67cd9185fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b557edd165144c8943eb9acc339a377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:45.560454 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-3efdf7b7-1e7b-458f-9d69-0ab22ad35477 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] 10.222.0.58 "GET /compute/v2.1/servers/a98455ed-1e70-4d9a-98a4-77262e588e87" status: 200 len: 1366 microversion: 2.1 time: 0.337142 Aug 10 23:19:45.561150 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2243/4682] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:45 2022] GET /compute/v2.1/servers/a98455ed-1e70-4d9a-98a4-77262e588e87 => generated 1366 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:19:45.566621 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-b85215f4-7752-4c36-8077-04885c6edab2 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:45.567434 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-b85215f4-7752-4c36-8077-04885c6edab2 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] [instance: 7e091da3-0636-4cba-b8de-94fdeecf0b7f] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:45.577151 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b85215f4-7752-4c36-8077-04885c6edab2 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:45.577649 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b85215f4-7752-4c36-8077-04885c6edab2 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:45.578097 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b85215f4-7752-4c36-8077-04885c6edab2 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:45.578831 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b85215f4-7752-4c36-8077-04885c6edab2 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:45.579300 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b85215f4-7752-4c36-8077-04885c6edab2 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:45.584795 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b85215f4-7752-4c36-8077-04885c6edab2 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:45.657148 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-bae14049-c695-4233-b8cb-2665163c3b5a tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07c94ebf0954cdea12b9a689538d96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395d7c4077e54c43bb95288db3942b0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:45.666443 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-bae14049-c695-4233-b8cb-2665163c3b5a tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] 10.222.0.58 "GET /compute/v2.1/servers/27dd09d6-47ed-4b55-bd02-baad36a28429" status: 200 len: 1521 microversion: 2.1 time: 0.324500 Aug 10 23:19:45.668479 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2440/4683] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:45 2022] GET /compute/v2.1/servers/27dd09d6-47ed-4b55-bd02-baad36a28429 => generated 1521 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:19:45.675353 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-42e375ed-5a78-4e25-b880-5348f59fc6aa tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:45.676264 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-42e375ed-5a78-4e25-b880-5348f59fc6aa tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] [instance: ee6a796b-efa5-4c73-8776-d86b54ca2190] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:45.688804 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-42e375ed-5a78-4e25-b880-5348f59fc6aa tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:45.689296 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-42e375ed-5a78-4e25-b880-5348f59fc6aa tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:45.689735 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-42e375ed-5a78-4e25-b880-5348f59fc6aa tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:45.690609 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-42e375ed-5a78-4e25-b880-5348f59fc6aa tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:45.691277 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-42e375ed-5a78-4e25-b880-5348f59fc6aa tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:45.692221 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-42e375ed-5a78-4e25-b880-5348f59fc6aa tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:45.763980 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-b85215f4-7752-4c36-8077-04885c6edab2 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] 10.222.0.58 "GET /compute/v2.1/servers/7e091da3-0636-4cba-b8de-94fdeecf0b7f/os-interface" status: 200 len: 1832 microversion: 2.32 time: 0.201469 Aug 10 23:19:45.765137 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2244/4684] 10.222.0.58 () {60 vars in 1316 bytes} [Wed Aug 10 23:19:45 2022] GET /compute/v2.1/servers/7e091da3-0636-4cba-b8de-94fdeecf0b7f/os-interface => generated 1832 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:19:45.774429 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-4099d58c-93e1-4bd1-b79e-f33c5d7780e3 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:45.775483 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-4099d58c-93e1-4bd1-b79e-f33c5d7780e3 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: d3455c49-214c-4635-b28b-f87ff636e960] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:45.782550 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4099d58c-93e1-4bd1-b79e-f33c5d7780e3 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:45.783102 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4099d58c-93e1-4bd1-b79e-f33c5d7780e3 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:45.783545 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4099d58c-93e1-4bd1-b79e-f33c5d7780e3 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:45.784258 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4099d58c-93e1-4bd1-b79e-f33c5d7780e3 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:45.785308 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4099d58c-93e1-4bd1-b79e-f33c5d7780e3 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:45.785308 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4099d58c-93e1-4bd1-b79e-f33c5d7780e3 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:45.801895 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:19:46.128467 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-4099d58c-93e1-4bd1-b79e-f33c5d7780e3 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6684f0c87e4242be9e0ffb4ef1973f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0582ace9e4443b8ad88915503ee630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:46.139965 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-4099d58c-93e1-4bd1-b79e-f33c5d7780e3 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "GET /compute/v2.1/servers/d3455c49-214c-4635-b28b-f87ff636e960" status: 200 len: 1327 microversion: 2.1 time: 0.373201 Aug 10 23:19:46.141115 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2245/4685] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:45 2022] GET /compute/v2.1/servers/d3455c49-214c-4635-b28b-f87ff636e960 => generated 1327 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:19:46.147930 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-1f80ce29-7a32-43ea-883d-8deaac34f2b2 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:46.148982 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-1f80ce29-7a32-43ea-883d-8deaac34f2b2 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: fa9dfd3a-a636-48ce-ae15-0ed51baee954] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:46.156322 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1f80ce29-7a32-43ea-883d-8deaac34f2b2 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:46.157027 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1f80ce29-7a32-43ea-883d-8deaac34f2b2 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:46.157401 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1f80ce29-7a32-43ea-883d-8deaac34f2b2 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:46.158315 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1f80ce29-7a32-43ea-883d-8deaac34f2b2 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:46.158777 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1f80ce29-7a32-43ea-883d-8deaac34f2b2 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:46.159304 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1f80ce29-7a32-43ea-883d-8deaac34f2b2 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:46.312506 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-1f80ce29-7a32-43ea-883d-8deaac34f2b2 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:46.320789 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-1f80ce29-7a32-43ea-883d-8deaac34f2b2 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954" status: 200 len: 1673 microversion: 2.1 time: 0.178116 Aug 10 23:19:46.321377 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2246/4686] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:46 2022] GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954 => generated 1673 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:19:46.585431 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-de38da87-8247-46ad-9f0b-8e69f386467f tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:46.586157 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-de38da87-8247-46ad-9f0b-8e69f386467f tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] [instance: a98455ed-1e70-4d9a-98a4-77262e588e87] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:46.593461 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-de38da87-8247-46ad-9f0b-8e69f386467f tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:46.593956 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-de38da87-8247-46ad-9f0b-8e69f386467f tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:46.594828 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-de38da87-8247-46ad-9f0b-8e69f386467f tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:46.596256 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-de38da87-8247-46ad-9f0b-8e69f386467f tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:46.596729 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-de38da87-8247-46ad-9f0b-8e69f386467f tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:46.597167 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-de38da87-8247-46ad-9f0b-8e69f386467f tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:46.680903 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-42e375ed-5a78-4e25-b880-5348f59fc6aa tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '627b163f1a0e4fdeb0e9692e7d37460d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb5f5856c46490ab1ded572d693c4cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:46.690296 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-42e375ed-5a78-4e25-b880-5348f59fc6aa tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] 10.222.0.58 "GET /compute/v2.1/servers/ee6a796b-efa5-4c73-8776-d86b54ca2190" status: 200 len: 1469 microversion: 2.1 time: 1.020555 Aug 10 23:19:46.690907 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2441/4687] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:45 2022] GET /compute/v2.1/servers/ee6a796b-efa5-4c73-8776-d86b54ca2190 => generated 1469 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:19:46.696649 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-27b536b1-69bc-43fe-afd5-fcac2638c9e6 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:46.697269 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-27b536b1-69bc-43fe-afd5-fcac2638c9e6 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] [instance: 27dd09d6-47ed-4b55-bd02-baad36a28429] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:46.708650 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-27b536b1-69bc-43fe-afd5-fcac2638c9e6 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:46.709759 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-27b536b1-69bc-43fe-afd5-fcac2638c9e6 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:46.710472 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-27b536b1-69bc-43fe-afd5-fcac2638c9e6 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:46.710963 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-27b536b1-69bc-43fe-afd5-fcac2638c9e6 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:46.711423 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-27b536b1-69bc-43fe-afd5-fcac2638c9e6 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:46.712031 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-27b536b1-69bc-43fe-afd5-fcac2638c9e6 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:46.924962 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-de38da87-8247-46ad-9f0b-8e69f386467f tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d89081084f14e0187f4c67cd9185fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b557edd165144c8943eb9acc339a377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:46.937990 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-de38da87-8247-46ad-9f0b-8e69f386467f tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] 10.222.0.58 "GET /compute/v2.1/servers/a98455ed-1e70-4d9a-98a4-77262e588e87" status: 200 len: 1366 microversion: 2.1 time: 0.358679 Aug 10 23:19:46.939380 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2247/4688] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:46 2022] GET /compute/v2.1/servers/a98455ed-1e70-4d9a-98a4-77262e588e87 => generated 1366 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:19:47.160753 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-52a588a8-330b-46b9-96ff-226e2992a68f tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:47.161739 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-52a588a8-330b-46b9-96ff-226e2992a68f tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: d3455c49-214c-4635-b28b-f87ff636e960] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:47.169106 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-52a588a8-330b-46b9-96ff-226e2992a68f tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:47.169609 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-52a588a8-330b-46b9-96ff-226e2992a68f tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:47.170051 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-52a588a8-330b-46b9-96ff-226e2992a68f tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:47.171083 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-52a588a8-330b-46b9-96ff-226e2992a68f tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:47.171820 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-52a588a8-330b-46b9-96ff-226e2992a68f tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:47.172343 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-52a588a8-330b-46b9-96ff-226e2992a68f tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:47.294576 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-27b536b1-69bc-43fe-afd5-fcac2638c9e6 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f07c94ebf0954cdea12b9a689538d96d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '395d7c4077e54c43bb95288db3942b0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:47.303687 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-27b536b1-69bc-43fe-afd5-fcac2638c9e6 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] 10.222.0.58 "GET /compute/v2.1/servers/27dd09d6-47ed-4b55-bd02-baad36a28429" status: 200 len: 1521 microversion: 2.1 time: 0.611101 Aug 10 23:19:47.304785 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2442/4689] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:46 2022] GET /compute/v2.1/servers/27dd09d6-47ed-4b55-bd02-baad36a28429 => generated 1521 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:19:47.360600 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-f8cc8fed-7cc5-4682-b5cc-e804eda8ce93 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:47.361240 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-f8cc8fed-7cc5-4682-b5cc-e804eda8ce93 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: fa9dfd3a-a636-48ce-ae15-0ed51baee954] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:47.368224 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=1,nova_api:UPDATE=2 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:19:47.370200 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f8cc8fed-7cc5-4682-b5cc-e804eda8ce93 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:47.370711 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f8cc8fed-7cc5-4682-b5cc-e804eda8ce93 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:47.371324 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f8cc8fed-7cc5-4682-b5cc-e804eda8ce93 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:47.372068 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f8cc8fed-7cc5-4682-b5cc-e804eda8ce93 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:47.372537 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f8cc8fed-7cc5-4682-b5cc-e804eda8ce93 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:47.372973 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f8cc8fed-7cc5-4682-b5cc-e804eda8ce93 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:47.540757 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-52a588a8-330b-46b9-96ff-226e2992a68f tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6684f0c87e4242be9e0ffb4ef1973f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0582ace9e4443b8ad88915503ee630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:47.548841 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-52a588a8-330b-46b9-96ff-226e2992a68f tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "GET /compute/v2.1/servers/d3455c49-214c-4635-b28b-f87ff636e960" status: 200 len: 1508 microversion: 2.1 time: 0.392127 Aug 10 23:19:47.549938 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2248/4690] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:47 2022] GET /compute/v2.1/servers/d3455c49-214c-4635-b28b-f87ff636e960 => generated 1508 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:19:47.584413 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-6721a3e7-53c9-4dd2-bc54-37c9f2e034ab tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:47.585930 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-6721a3e7-53c9-4dd2-bc54-37c9f2e034ab tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: d3455c49-214c-4635-b28b-f87ff636e960] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:47.592782 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6721a3e7-53c9-4dd2-bc54-37c9f2e034ab tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:47.593401 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6721a3e7-53c9-4dd2-bc54-37c9f2e034ab tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:47.593702 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6721a3e7-53c9-4dd2-bc54-37c9f2e034ab tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:47.594773 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6721a3e7-53c9-4dd2-bc54-37c9f2e034ab tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:47.595420 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6721a3e7-53c9-4dd2-bc54-37c9f2e034ab tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:47.596009 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6721a3e7-53c9-4dd2-bc54-37c9f2e034ab tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:47.823579 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-f8cc8fed-7cc5-4682-b5cc-e804eda8ce93 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:47.833815 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-f8cc8fed-7cc5-4682-b5cc-e804eda8ce93 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954" status: 200 len: 1673 microversion: 2.1 time: 0.493435 Aug 10 23:19:47.835308 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2443/4691] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:47 2022] GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954 => generated 1673 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:19:47.840480 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-ebfd8c32-3069-4c1e-90d1-85664a7e0b43 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:47.841369 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-ebfd8c32-3069-4c1e-90d1-85664a7e0b43 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] [instance: ee6a796b-efa5-4c73-8776-d86b54ca2190] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:47.888805 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ebfd8c32-3069-4c1e-90d1-85664a7e0b43 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:47.889355 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ebfd8c32-3069-4c1e-90d1-85664a7e0b43 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:47.889803 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ebfd8c32-3069-4c1e-90d1-85664a7e0b43 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:47.892175 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ebfd8c32-3069-4c1e-90d1-85664a7e0b43 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:47.892936 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ebfd8c32-3069-4c1e-90d1-85664a7e0b43 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:47.893657 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ebfd8c32-3069-4c1e-90d1-85664a7e0b43 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:48.311999 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-6721a3e7-53c9-4dd2-bc54-37c9f2e034ab tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6684f0c87e4242be9e0ffb4ef1973f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0582ace9e4443b8ad88915503ee630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:48.325820 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-6721a3e7-53c9-4dd2-bc54-37c9f2e034ab tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "GET /compute/v2.1/servers/d3455c49-214c-4635-b28b-f87ff636e960" status: 200 len: 1508 microversion: 2.1 time: 0.748396 Aug 10 23:19:48.329650 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2249/4692] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:47 2022] GET /compute/v2.1/servers/d3455c49-214c-4635-b28b-f87ff636e960 => generated 1508 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:19:48.334283 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-355d3bac-17ed-4cd8-b9a7-ee2b5d6c9451 req-f047e4dc-8eb8-4a53-8238-bd7cab1ca924 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27dd09d6-47ed-4b55-bd02-baad36a28429", "name": "network-vif-deleted", "tag": "be28e077-8bcf-4598-b8d5-d46262e4d7fb"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:19:48.360453 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-355d3bac-17ed-4cd8-b9a7-ee2b5d6c9451 req-f047e4dc-8eb8-4a53-8238-bd7cab1ca924 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:48.361115 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-355d3bac-17ed-4cd8-b9a7-ee2b5d6c9451 req-f047e4dc-8eb8-4a53-8238-bd7cab1ca924 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:48.361613 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-355d3bac-17ed-4cd8-b9a7-ee2b5d6c9451 req-f047e4dc-8eb8-4a53-8238-bd7cab1ca924 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:48.389948 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-355d3bac-17ed-4cd8-b9a7-ee2b5d6c9451 req-f047e4dc-8eb8-4a53-8238-bd7cab1ca924 service nova] Creating event network-vif-deleted:be28e077-8bcf-4598-b8d5-d46262e4d7fb for instance 27dd09d6-47ed-4b55-bd02-baad36a28429 on n-h2-850468-14 Aug 10 23:19:48.398370 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-355d3bac-17ed-4cd8-b9a7-ee2b5d6c9451 req-f047e4dc-8eb8-4a53-8238-bd7cab1ca924 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069413 Aug 10 23:19:48.399680 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2250/4693] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:19:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:19:48.415037 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-74cc3449-deec-48d1-a00a-d6f95c3df6d7 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:48.415748 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-74cc3449-deec-48d1-a00a-d6f95c3df6d7 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] [instance: a98455ed-1e70-4d9a-98a4-77262e588e87] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:48.422692 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-74cc3449-deec-48d1-a00a-d6f95c3df6d7 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:48.423616 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-74cc3449-deec-48d1-a00a-d6f95c3df6d7 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:48.424343 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-74cc3449-deec-48d1-a00a-d6f95c3df6d7 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:48.425367 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-74cc3449-deec-48d1-a00a-d6f95c3df6d7 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:48.425982 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-74cc3449-deec-48d1-a00a-d6f95c3df6d7 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:48.426735 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-74cc3449-deec-48d1-a00a-d6f95c3df6d7 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:48.855098 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-74cc3449-deec-48d1-a00a-d6f95c3df6d7 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d89081084f14e0187f4c67cd9185fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b557edd165144c8943eb9acc339a377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:48.864236 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-74cc3449-deec-48d1-a00a-d6f95c3df6d7 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] 10.222.0.58 "GET /compute/v2.1/servers/a98455ed-1e70-4d9a-98a4-77262e588e87" status: 200 len: 1366 microversion: 2.1 time: 0.461157 Aug 10 23:19:48.869778 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2251/4694] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:48 2022] GET /compute/v2.1/servers/a98455ed-1e70-4d9a-98a4-77262e588e87 => generated 1366 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:19:48.877175 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-82994d46-235f-4ac3-9fad-192a4988bf65 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:48.879393 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-82994d46-235f-4ac3-9fad-192a4988bf65 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] [instance: 27dd09d6-47ed-4b55-bd02-baad36a28429] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:48.888540 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-82994d46-235f-4ac3-9fad-192a4988bf65 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:48.889831 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-82994d46-235f-4ac3-9fad-192a4988bf65 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:48.890516 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-82994d46-235f-4ac3-9fad-192a4988bf65 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:48.891692 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-82994d46-235f-4ac3-9fad-192a4988bf65 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:48.892322 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-82994d46-235f-4ac3-9fad-192a4988bf65 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:48.892919 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-82994d46-235f-4ac3-9fad-192a4988bf65 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:48.909412 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-82994d46-235f-4ac3-9fad-192a4988bf65 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] HTTP exception thrown: Instance 27dd09d6-47ed-4b55-bd02-baad36a28429 could not be found. Aug 10 23:19:48.911694 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-82994d46-235f-4ac3-9fad-192a4988bf65 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Request method failure captured: Aug 10 23:19:48.911694 n-d-850468-14 devstack@n-api.service[122632]: request: GET /compute/v2.1/servers/27dd09d6-47ed-4b55-bd02-baad36a28429 HTTP/1.1 Aug 10 23:19:48.911694 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:19:48.911694 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:19:48.911694 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:19:48.911694 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 23:19:48.911694 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:19:48.911694 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:19:48.911694 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:19:48.911694 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:19:48.911694 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9DvG6mPOp_bU6YQakEzMuJf91N1YrPRgIEe5ouB8tWtrXuOeLQgeJ0ouDTrtP31JIWcz1wQJ17PTz3JUAbF_FaF35I1F09nIb2lkQ0GhE880fsA2K13MCP_yKxqm-kv_hQLiQB8UzdyMBwb04C68j2QYpbobWhHyceARqBEeITDqyg0 Aug 10 23:19:48.911694 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:19:48.911694 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:19:48.911694 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:19:48.911694 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:19:48.911694 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:19:48.911694 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:19:48.911694 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 395d7c4077e54c43bb95288db3942b0a Aug 10 23:19:48.911694 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1029565464 Aug 10 23:19:48.911694 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:19:48.911694 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:19:48.911694 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/395d7c4077e54c43bb95288db3942b0a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/395d7c4077e54c43bb95288db3942b0a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/395d7c4077e54c43bb95288db3942b0a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_395d7c4077e54c43bb95288db3942b0a", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:19:48.911694 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1029565464 Aug 10 23:19:48.911694 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 395d7c4077e54c43bb95288db3942b0a Aug 10 23:19:48.911694 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1029565464 Aug 10 23:19:48.911694 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-ServerRescueNegativeTestJSON-1029565464-project Aug 10 23:19:48.911694 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:19:48.911694 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:19:48.911694 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: f07c94ebf0954cdea12b9a689538d96d Aug 10 23:19:48.911694 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1029565464-project Aug 10 23:19:48.911694 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:19:48.911694 n-d-850468-14 devstack@n-api.service[122632]: exception: Instance 27dd09d6-47ed-4b55-bd02-baad36a28429 could not be found. Aug 10 23:19:48.911694 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': '27dd09d6-47ed-4b55-bd02-baad36a28429'} Aug 10 23:19:48.911694 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:19:48.911694 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:19:48.911694 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:19:48.911694 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:19:48.911694 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:19:48.911694 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:19:48.911694 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:19:48.911694 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:19:48.911694 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:19:48.911694 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:19:48.911694 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27dd09d6-47ed-4b55-bd02-baad36a28429 could not be found. Aug 10 23:19:48.911694 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:19:48.911694 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:19:48.911694 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:19:48.911694 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:19:48.911694 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:19:48.911694 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:19:48.911694 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:19:48.911694 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:19:48.911694 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:19:48.911694 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:19:48.911694 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:19:48.911694 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:19:48.911694 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:19:48.911694 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:19:48.911694 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:19:48.911694 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:19:48.911694 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27dd09d6-47ed-4b55-bd02-baad36a28429 could not be found. Aug 10 23:19:48.911694 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:19:48.911694 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:19:48.917376 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:19:48.917376 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:19:48.917376 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:19:48.917376 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:19:48.917376 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:19:48.917376 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:19:48.917376 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27dd09d6-47ed-4b55-bd02-baad36a28429 could not be found. Aug 10 23:19:48.917376 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:19:48.918836 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-82994d46-235f-4ac3-9fad-192a4988bf65 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] Returning 404 to user: Instance 27dd09d6-47ed-4b55-bd02-baad36a28429 could not be found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:19:48.919898 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-82994d46-235f-4ac3-9fad-192a4988bf65 tempest-ServerRescueNegativeTestJSON-1029565464 tempest-ServerRescueNegativeTestJSON-1029565464-project] 10.222.0.58 "GET /compute/v2.1/servers/27dd09d6-47ed-4b55-bd02-baad36a28429" status: 404 len: 111 microversion: 2.1 time: 0.049141 Aug 10 23:19:48.920964 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2252/4695] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:48 2022] GET /compute/v2.1/servers/27dd09d6-47ed-4b55-bd02-baad36a28429 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:19:48.926404 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-34c3a51e-6ce8-47ac-b2d6-90a689551a2e tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:48.927128 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-34c3a51e-6ce8-47ac-b2d6-90a689551a2e tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: d3455c49-214c-4635-b28b-f87ff636e960] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:48.936340 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-34c3a51e-6ce8-47ac-b2d6-90a689551a2e tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:48.937049 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-34c3a51e-6ce8-47ac-b2d6-90a689551a2e tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:48.937711 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-34c3a51e-6ce8-47ac-b2d6-90a689551a2e tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:48.938553 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-34c3a51e-6ce8-47ac-b2d6-90a689551a2e tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:48.939105 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-34c3a51e-6ce8-47ac-b2d6-90a689551a2e tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:48.939544 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-34c3a51e-6ce8-47ac-b2d6-90a689551a2e tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:48.970124 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-34c3a51e-6ce8-47ac-b2d6-90a689551a2e tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: d3455c49-214c-4635-b28b-f87ff636e960] Going to try to terminate instance {{(pid=122632) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:19:49.020641 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-ebfd8c32-3069-4c1e-90d1-85664a7e0b43 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '627b163f1a0e4fdeb0e9692e7d37460d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb5f5856c46490ab1ded572d693c4cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:49.029435 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-ebfd8c32-3069-4c1e-90d1-85664a7e0b43 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] 10.222.0.58 "GET /compute/v2.1/servers/ee6a796b-efa5-4c73-8776-d86b54ca2190" status: 200 len: 1469 microversion: 2.1 time: 1.192708 Aug 10 23:19:49.030340 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2444/4696] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:47 2022] GET /compute/v2.1/servers/ee6a796b-efa5-4c73-8776-d86b54ca2190 => generated 1469 bytes in 1194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:19:49.049579 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c0542beb-4c0b-41ba-9224-51cc500d06b4 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:49.050424 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-c0542beb-4c0b-41ba-9224-51cc500d06b4 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: fa9dfd3a-a636-48ce-ae15-0ed51baee954] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:49.059008 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c0542beb-4c0b-41ba-9224-51cc500d06b4 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:49.059915 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c0542beb-4c0b-41ba-9224-51cc500d06b4 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:49.060525 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c0542beb-4c0b-41ba-9224-51cc500d06b4 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:49.061491 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c0542beb-4c0b-41ba-9224-51cc500d06b4 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:49.062190 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c0542beb-4c0b-41ba-9224-51cc500d06b4 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:49.062962 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c0542beb-4c0b-41ba-9224-51cc500d06b4 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:49.078870 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:UPDATE=3 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:19:49.089821 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-34c3a51e-6ce8-47ac-b2d6-90a689551a2e tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "DELETE /compute/v2.1/servers/d3455c49-214c-4635-b28b-f87ff636e960" status: 204 len: 0 microversion: 2.1 time: 0.166849 Aug 10 23:19:49.094646 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2253/4697] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:19:48 2022] DELETE /compute/v2.1/servers/d3455c49-214c-4635-b28b-f87ff636e960 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:19:49.101837 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-fd2b540c-e0b4-434a-9888-f3cd299df649 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:49.102912 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-fd2b540c-e0b4-434a-9888-f3cd299df649 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: d3455c49-214c-4635-b28b-f87ff636e960] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:49.111635 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fd2b540c-e0b4-434a-9888-f3cd299df649 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:49.112143 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fd2b540c-e0b4-434a-9888-f3cd299df649 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:49.112590 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fd2b540c-e0b4-434a-9888-f3cd299df649 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:49.113361 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fd2b540c-e0b4-434a-9888-f3cd299df649 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:49.113819 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fd2b540c-e0b4-434a-9888-f3cd299df649 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:49.114186 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fd2b540c-e0b4-434a-9888-f3cd299df649 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:49.185455 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-c0542beb-4c0b-41ba-9224-51cc500d06b4 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2ea96841d5b64d2390d18b3eb5da8b73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb12683ada249bfa2ca7bf5cf730ca3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:49.194686 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-c0542beb-4c0b-41ba-9224-51cc500d06b4 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954" status: 200 len: 1606 microversion: 2.1 time: 0.162696 Aug 10 23:19:49.195660 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2445/4698] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:49 2022] GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954 => generated 1606 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:19:49.461851 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-fd2b540c-e0b4-434a-9888-f3cd299df649 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6684f0c87e4242be9e0ffb4ef1973f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0582ace9e4443b8ad88915503ee630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:49.472770 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-fd2b540c-e0b4-434a-9888-f3cd299df649 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "GET /compute/v2.1/servers/d3455c49-214c-4635-b28b-f87ff636e960" status: 200 len: 1514 microversion: 2.1 time: 0.376730 Aug 10 23:19:49.489226 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2254/4699] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:49 2022] GET /compute/v2.1/servers/d3455c49-214c-4635-b28b-f87ff636e960 => generated 1514 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:19:49.891771 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-fafd2477-cbe6-4099-b93a-c4ba13d8b2f1 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:49.892714 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-fafd2477-cbe6-4099-b93a-c4ba13d8b2f1 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] [instance: a98455ed-1e70-4d9a-98a4-77262e588e87] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:49.903292 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fafd2477-cbe6-4099-b93a-c4ba13d8b2f1 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:49.904145 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fafd2477-cbe6-4099-b93a-c4ba13d8b2f1 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:49.904927 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fafd2477-cbe6-4099-b93a-c4ba13d8b2f1 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:49.906387 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fafd2477-cbe6-4099-b93a-c4ba13d8b2f1 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:49.907274 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fafd2477-cbe6-4099-b93a-c4ba13d8b2f1 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:49.908127 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fafd2477-cbe6-4099-b93a-c4ba13d8b2f1 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:50.053466 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-59e0acfd-72e0-4505-a923-4519e63a81f9 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:50.054235 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-59e0acfd-72e0-4505-a923-4519e63a81f9 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] [instance: ee6a796b-efa5-4c73-8776-d86b54ca2190] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:50.073175 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-59e0acfd-72e0-4505-a923-4519e63a81f9 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:50.073678 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-59e0acfd-72e0-4505-a923-4519e63a81f9 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:50.074121 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-59e0acfd-72e0-4505-a923-4519e63a81f9 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:50.074879 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-59e0acfd-72e0-4505-a923-4519e63a81f9 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:50.075332 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-59e0acfd-72e0-4505-a923-4519e63a81f9 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:50.075736 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-59e0acfd-72e0-4505-a923-4519e63a81f9 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:50.134371 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=2 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:19:50.164848 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-fafd2477-cbe6-4099-b93a-c4ba13d8b2f1 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d89081084f14e0187f4c67cd9185fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b557edd165144c8943eb9acc339a377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:50.176792 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-fafd2477-cbe6-4099-b93a-c4ba13d8b2f1 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] 10.222.0.58 "GET /compute/v2.1/servers/a98455ed-1e70-4d9a-98a4-77262e588e87" status: 200 len: 1366 microversion: 2.1 time: 0.290604 Aug 10 23:19:50.194814 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2446/4700] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:49 2022] GET /compute/v2.1/servers/a98455ed-1e70-4d9a-98a4-77262e588e87 => generated 1366 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:19:50.219430 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-72566566-9d14-4419-b198-4f8f2893dc91 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:50.220217 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-72566566-9d14-4419-b198-4f8f2893dc91 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] [instance: fa9dfd3a-a636-48ce-ae15-0ed51baee954] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:50.221988 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=6 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:19:50.231190 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-72566566-9d14-4419-b198-4f8f2893dc91 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:50.231690 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-72566566-9d14-4419-b198-4f8f2893dc91 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:50.232133 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-72566566-9d14-4419-b198-4f8f2893dc91 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:50.232846 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-72566566-9d14-4419-b198-4f8f2893dc91 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:50.233605 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-72566566-9d14-4419-b198-4f8f2893dc91 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:50.234032 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-72566566-9d14-4419-b198-4f8f2893dc91 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:50.251749 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-72566566-9d14-4419-b198-4f8f2893dc91 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] HTTP exception thrown: Instance fa9dfd3a-a636-48ce-ae15-0ed51baee954 could not be found. Aug 10 23:19:50.253842 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-72566566-9d14-4419-b198-4f8f2893dc91 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Request method failure captured: Aug 10 23:19:50.253842 n-d-850468-14 devstack@n-api.service[122633]: request: GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954 HTTP/1.1 Aug 10 23:19:50.253842 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:19:50.253842 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:19:50.253842 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:19:50.253842 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:19:50.253842 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:19:50.253842 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:19:50.253842 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:19:50.253842 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:19:50.253842 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9Drw0c2MsNlQk2xhClSBMImCg12_8SYgkoaKQkzmFSrheNUqLDbfnKYZ8D3mVjR4fUdjKeuub5tXKPuyho3Qbzr6min3JWaqN44jGsCPGM23nBipHIYVBpHQxUCRbFIS5jN95f9E_tT0WyV4NvgkZnorl71EuxY70xL3GkCDAg5oTLs Aug 10 23:19:50.253842 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:19:50.253842 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:19:50.253842 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:19:50.253842 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:19:50.253842 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:19:50.253842 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:19:50.253842 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 1eb12683ada249bfa2ca7bf5cf730ca3 Aug 10 23:19:50.253842 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-ServerActionsTestJSON-819186707 Aug 10 23:19:50.253842 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:19:50.253842 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:19:50.253842 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1eb12683ada249bfa2ca7bf5cf730ca3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1eb12683ada249bfa2ca7bf5cf730ca3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/1eb12683ada249bfa2ca7bf5cf730ca3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_1eb12683ada249bfa2ca7bf5cf730ca3", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:19:50.253842 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-ServerActionsTestJSON-819186707 Aug 10 23:19:50.253842 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 1eb12683ada249bfa2ca7bf5cf730ca3 Aug 10 23:19:50.253842 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-ServerActionsTestJSON-819186707 Aug 10 23:19:50.253842 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-ServerActionsTestJSON-819186707-project Aug 10 23:19:50.253842 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:19:50.253842 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:19:50.253842 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 2ea96841d5b64d2390d18b3eb5da8b73 Aug 10 23:19:50.253842 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-ServerActionsTestJSON-819186707-project Aug 10 23:19:50.253842 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:19:50.253842 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance fa9dfd3a-a636-48ce-ae15-0ed51baee954 could not be found. Aug 10 23:19:50.253842 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': 'fa9dfd3a-a636-48ce-ae15-0ed51baee954'} Aug 10 23:19:50.253842 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:19:50.253842 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:19:50.253842 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:19:50.253842 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:19:50.253842 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:19:50.253842 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:19:50.253842 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:19:50.253842 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:19:50.253842 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:19:50.253842 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:19:50.253842 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa9dfd3a-a636-48ce-ae15-0ed51baee954 could not be found. Aug 10 23:19:50.253842 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:19:50.253842 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:19:50.253842 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:19:50.253842 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:19:50.253842 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:19:50.253842 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:19:50.253842 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:19:50.253842 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:19:50.253842 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:19:50.253842 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:19:50.253842 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:19:50.253842 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:19:50.253842 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:19:50.253842 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:19:50.253842 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:19:50.253842 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:19:50.253842 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa9dfd3a-a636-48ce-ae15-0ed51baee954 could not be found. Aug 10 23:19:50.253842 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:19:50.253842 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:19:50.253842 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:19:50.261730 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:19:50.261730 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:19:50.261730 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:19:50.261730 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:19:50.261730 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:19:50.261730 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa9dfd3a-a636-48ce-ae15-0ed51baee954 could not be found. Aug 10 23:19:50.261730 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:19:50.261730 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-72566566-9d14-4419-b198-4f8f2893dc91 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Returning 404 to user: Instance fa9dfd3a-a636-48ce-ae15-0ed51baee954 could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:19:50.261730 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-72566566-9d14-4419-b198-4f8f2893dc91 tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954" status: 404 len: 111 microversion: 2.1 time: 0.041751 Aug 10 23:19:50.261730 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2447/4701] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:50 2022] GET /compute/v2.1/servers/fa9dfd3a-a636-48ce-ae15-0ed51baee954 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:19:50.267238 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-9ebeee81-9a57-4af1-b5ed-b282365763bd tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] Calling method '.version_select at 0x7f847c559040>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:50.296728 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-9ebeee81-9a57-4af1-b5ed-b282365763bd tempest-ServerActionsTestJSON-819186707 tempest-ServerActionsTestJSON-819186707-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-323861283" status: 202 len: 0 microversion: 2.1 time: 0.034001 Aug 10 23:19:50.300928 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2448/4702] 10.222.0.58 () {58 vars in 1218 bytes} [Wed Aug 10 23:19:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-323861283 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:19:50.499038 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-9879ceec-af9e-42a3-9dd3-6fe41832a6c4 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:50.500193 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-9879ceec-af9e-42a3-9dd3-6fe41832a6c4 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: d3455c49-214c-4635-b28b-f87ff636e960] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:50.510060 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9879ceec-af9e-42a3-9dd3-6fe41832a6c4 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:50.530208 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9879ceec-af9e-42a3-9dd3-6fe41832a6c4 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:50.530924 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9879ceec-af9e-42a3-9dd3-6fe41832a6c4 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:50.532153 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9879ceec-af9e-42a3-9dd3-6fe41832a6c4 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:50.533598 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9879ceec-af9e-42a3-9dd3-6fe41832a6c4 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:50.534737 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9879ceec-af9e-42a3-9dd3-6fe41832a6c4 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:50.831171 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-59e0acfd-72e0-4505-a923-4519e63a81f9 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '627b163f1a0e4fdeb0e9692e7d37460d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb5f5856c46490ab1ded572d693c4cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:50.841586 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-59e0acfd-72e0-4505-a923-4519e63a81f9 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] 10.222.0.58 "GET /compute/v2.1/servers/ee6a796b-efa5-4c73-8776-d86b54ca2190" status: 200 len: 1469 microversion: 2.1 time: 0.793396 Aug 10 23:19:50.843044 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2255/4703] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:50 2022] GET /compute/v2.1/servers/ee6a796b-efa5-4c73-8776-d86b54ca2190 => generated 1469 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:19:50.861283 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-0deb1eee-8b01-46a2-8fc5-816293f95044 req-2851129f-880b-4504-8878-981dacb4af10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa9dfd3a-a636-48ce-ae15-0ed51baee954", "name": "network-vif-deleted", "tag": "456f7ca7-21c6-4b5d-8993-9a7c329acf12"}, {"name": "network-changed", "server_uuid": "7e091da3-0636-4cba-b8de-94fdeecf0b7f", "tag": "7dab50f5-321c-4571-bb72-8c2a4a681492"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:19:50.884229 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-9879ceec-af9e-42a3-9dd3-6fe41832a6c4 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6684f0c87e4242be9e0ffb4ef1973f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0582ace9e4443b8ad88915503ee630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:50.894698 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-9879ceec-af9e-42a3-9dd3-6fe41832a6c4 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "GET /compute/v2.1/servers/d3455c49-214c-4635-b28b-f87ff636e960" status: 200 len: 1514 microversion: 2.1 time: 0.404511 Aug 10 23:19:50.895765 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-0deb1eee-8b01-46a2-8fc5-816293f95044 req-2851129f-880b-4504-8878-981dacb4af10 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:50.897800 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-0deb1eee-8b01-46a2-8fc5-816293f95044 req-2851129f-880b-4504-8878-981dacb4af10 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:50.899056 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-0deb1eee-8b01-46a2-8fc5-816293f95044 req-2851129f-880b-4504-8878-981dacb4af10 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:50.900767 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2449/4704] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:50 2022] GET /compute/v2.1/servers/d3455c49-214c-4635-b28b-f87ff636e960 => generated 1514 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:19:50.931553 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-0deb1eee-8b01-46a2-8fc5-816293f95044 req-2851129f-880b-4504-8878-981dacb4af10 service nova] Creating event network-vif-deleted:456f7ca7-21c6-4b5d-8993-9a7c329acf12 for instance fa9dfd3a-a636-48ce-ae15-0ed51baee954 on n-h2-850468-14 Aug 10 23:19:50.932483 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-0deb1eee-8b01-46a2-8fc5-816293f95044 req-2851129f-880b-4504-8878-981dacb4af10 service nova] Creating event network-changed:7dab50f5-321c-4571-bb72-8c2a4a681492 for instance 7e091da3-0636-4cba-b8de-94fdeecf0b7f on n-h1-850468-14 Aug 10 23:19:50.956766 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-0deb1eee-8b01-46a2-8fc5-816293f95044 req-2851129f-880b-4504-8878-981dacb4af10 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.110688 Aug 10 23:19:50.958408 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2256/4705] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:19:50 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:19:51.003965 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-9c7e14d8-d217-495c-b75f-b8d7c1b70fa3 req-ea47a63c-e7f3-426a-8fe9-c592b0f81a73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee6a796b-efa5-4c73-8776-d86b54ca2190", "name": "network-vif-plugged", "status": "completed", "tag": "4879d463-bf92-43e3-a52e-45e2730c0d75"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:19:51.030108 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-9c7e14d8-d217-495c-b75f-b8d7c1b70fa3 req-ea47a63c-e7f3-426a-8fe9-c592b0f81a73 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:51.030749 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-9c7e14d8-d217-495c-b75f-b8d7c1b70fa3 req-ea47a63c-e7f3-426a-8fe9-c592b0f81a73 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:51.031289 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-9c7e14d8-d217-495c-b75f-b8d7c1b70fa3 req-ea47a63c-e7f3-426a-8fe9-c592b0f81a73 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:51.054008 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-9c7e14d8-d217-495c-b75f-b8d7c1b70fa3 req-ea47a63c-e7f3-426a-8fe9-c592b0f81a73 service nova] Creating event network-vif-plugged:4879d463-bf92-43e3-a52e-45e2730c0d75 for instance ee6a796b-efa5-4c73-8776-d86b54ca2190 on n-h2-850468-14 Aug 10 23:19:51.081893 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-9c7e14d8-d217-495c-b75f-b8d7c1b70fa3 req-ea47a63c-e7f3-426a-8fe9-c592b0f81a73 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069072 Aug 10 23:19:51.083203 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2450/4706] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:19:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:19:51.205549 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-91c73034-824a-42f0-88b0-ca50eb683631 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:51.206936 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-91c73034-824a-42f0-88b0-ca50eb683631 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] [instance: a98455ed-1e70-4d9a-98a4-77262e588e87] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:51.214544 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-91c73034-824a-42f0-88b0-ca50eb683631 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:51.215316 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-91c73034-824a-42f0-88b0-ca50eb683631 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:51.215979 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-91c73034-824a-42f0-88b0-ca50eb683631 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:51.216863 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-91c73034-824a-42f0-88b0-ca50eb683631 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:51.217486 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-91c73034-824a-42f0-88b0-ca50eb683631 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:51.218065 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-91c73034-824a-42f0-88b0-ca50eb683631 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:51.749537 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-657e4ff5-ce30-42ad-bf51-d2bdcb7d5d4d tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:51.750399 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-657e4ff5-ce30-42ad-bf51-d2bdcb7d5d4d tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] [instance: 69c4b403-a8ad-449c-a577-63837a6d2445] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:51.752689 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=8 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:19:51.765727 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-657e4ff5-ce30-42ad-bf51-d2bdcb7d5d4d tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:51.768104 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-657e4ff5-ce30-42ad-bf51-d2bdcb7d5d4d tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:51.772856 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-657e4ff5-ce30-42ad-bf51-d2bdcb7d5d4d tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:51.774036 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-657e4ff5-ce30-42ad-bf51-d2bdcb7d5d4d tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:51.774678 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-657e4ff5-ce30-42ad-bf51-d2bdcb7d5d4d tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:51.775402 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-657e4ff5-ce30-42ad-bf51-d2bdcb7d5d4d tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:51.820784 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=100 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:19:51.830088 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-91c73034-824a-42f0-88b0-ca50eb683631 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d89081084f14e0187f4c67cd9185fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b557edd165144c8943eb9acc339a377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:51.845900 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-91c73034-824a-42f0-88b0-ca50eb683631 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] 10.222.0.58 "GET /compute/v2.1/servers/a98455ed-1e70-4d9a-98a4-77262e588e87" status: 200 len: 1366 microversion: 2.1 time: 0.645316 Aug 10 23:19:51.846504 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2257/4707] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:51 2022] GET /compute/v2.1/servers/a98455ed-1e70-4d9a-98a4-77262e588e87 => generated 1366 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:19:51.865862 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-24e077cd-7b54-4553-ad08-382e01deb249 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:51.867662 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-24e077cd-7b54-4553-ad08-382e01deb249 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] [instance: ee6a796b-efa5-4c73-8776-d86b54ca2190] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:51.879045 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-24e077cd-7b54-4553-ad08-382e01deb249 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:51.879649 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-24e077cd-7b54-4553-ad08-382e01deb249 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:51.880144 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-24e077cd-7b54-4553-ad08-382e01deb249 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:51.881021 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-24e077cd-7b54-4553-ad08-382e01deb249 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:51.881884 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-24e077cd-7b54-4553-ad08-382e01deb249 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:51.882321 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-24e077cd-7b54-4553-ad08-382e01deb249 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:52.093861 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-657e4ff5-ce30-42ad-bf51-d2bdcb7d5d4d tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5899b2ad9f1046caaf7c6073e408eeee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25abd63376614081a9d484f3c9ae950d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:52.104730 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-657e4ff5-ce30-42ad-bf51-d2bdcb7d5d4d tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "GET /compute/v2.1/servers/69c4b403-a8ad-449c-a577-63837a6d2445" status: 200 len: 1684 microversion: 2.1 time: 0.359241 Aug 10 23:19:52.120197 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2451/4708] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:51 2022] GET /compute/v2.1/servers/69c4b403-a8ad-449c-a577-63837a6d2445 => generated 1684 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:19:52.128063 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-a0168e34-4183-4fef-bc3a-b0354b65d47d tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:52.129327 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-a0168e34-4183-4fef-bc3a-b0354b65d47d tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: d3455c49-214c-4635-b28b-f87ff636e960] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:52.140268 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a0168e34-4183-4fef-bc3a-b0354b65d47d tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:52.141006 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a0168e34-4183-4fef-bc3a-b0354b65d47d tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:52.141703 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a0168e34-4183-4fef-bc3a-b0354b65d47d tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:52.142949 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a0168e34-4183-4fef-bc3a-b0354b65d47d tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:52.152163 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a0168e34-4183-4fef-bc3a-b0354b65d47d tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:52.153101 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a0168e34-4183-4fef-bc3a-b0354b65d47d tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:52.345578 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-a0168e34-4183-4fef-bc3a-b0354b65d47d tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6684f0c87e4242be9e0ffb4ef1973f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0582ace9e4443b8ad88915503ee630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:52.354360 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-a0168e34-4183-4fef-bc3a-b0354b65d47d tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "GET /compute/v2.1/servers/d3455c49-214c-4635-b28b-f87ff636e960" status: 200 len: 1472 microversion: 2.1 time: 0.233167 Aug 10 23:19:52.358396 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2452/4709] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:52 2022] GET /compute/v2.1/servers/d3455c49-214c-4635-b28b-f87ff636e960 => generated 1472 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:19:52.363619 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-6fd2c4e5-918a-4339-81b2-88f7e305e694 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:19:52.366038 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-6fd2c4e5-918a-4339-81b2-88f7e305e694 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] [instance: 69c4b403-a8ad-449c-a577-63837a6d2445] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:52.375578 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6fd2c4e5-918a-4339-81b2-88f7e305e694 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:52.377271 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6fd2c4e5-918a-4339-81b2-88f7e305e694 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:52.378085 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6fd2c4e5-918a-4339-81b2-88f7e305e694 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:52.380192 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6fd2c4e5-918a-4339-81b2-88f7e305e694 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:52.382060 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6fd2c4e5-918a-4339-81b2-88f7e305e694 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:52.383255 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6fd2c4e5-918a-4339-81b2-88f7e305e694 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:52.410074 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-24e077cd-7b54-4553-ad08-382e01deb249 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '627b163f1a0e4fdeb0e9692e7d37460d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb5f5856c46490ab1ded572d693c4cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:52.427908 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-24e077cd-7b54-4553-ad08-382e01deb249 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] 10.222.0.58 "GET /compute/v2.1/servers/ee6a796b-efa5-4c73-8776-d86b54ca2190" status: 200 len: 1469 microversion: 2.1 time: 0.566839 Aug 10 23:19:52.429477 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2258/4710] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:51 2022] GET /compute/v2.1/servers/ee6a796b-efa5-4c73-8776-d86b54ca2190 => generated 1469 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:19:52.449083 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-6fd2c4e5-918a-4339-81b2-88f7e305e694 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "POST /compute/v2.1/servers/69c4b403-a8ad-449c-a577-63837a6d2445/action" status: 200 len: 32629 microversion: 2.1 time: 0.089003 Aug 10 23:19:52.450191 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2453/4711] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:19:52 2022] POST /compute/v2.1/servers/69c4b403-a8ad-449c-a577-63837a6d2445/action => generated 32629 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 23:19:52.528288 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-2e39a116-e299-4939-b15b-3b8941c2ff48 req-5f61ed7d-ac6d-49eb-9eee-a2558035722f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3455c49-214c-4635-b28b-f87ff636e960", "name": "network-vif-deleted", "tag": "6dfabd56-dd78-4f9a-89be-a1bea2f40277"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:19:52.556706 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-2e39a116-e299-4939-b15b-3b8941c2ff48 req-5f61ed7d-ac6d-49eb-9eee-a2558035722f service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:52.557222 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-2e39a116-e299-4939-b15b-3b8941c2ff48 req-5f61ed7d-ac6d-49eb-9eee-a2558035722f service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:52.559819 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-2e39a116-e299-4939-b15b-3b8941c2ff48 req-5f61ed7d-ac6d-49eb-9eee-a2558035722f service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:52.596925 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-2e39a116-e299-4939-b15b-3b8941c2ff48 req-5f61ed7d-ac6d-49eb-9eee-a2558035722f service nova] Creating event network-vif-deleted:6dfabd56-dd78-4f9a-89be-a1bea2f40277 for instance d3455c49-214c-4635-b28b-f87ff636e960 on n-h1-850468-14 Aug 10 23:19:52.609560 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-2e39a116-e299-4939-b15b-3b8941c2ff48 req-5f61ed7d-ac6d-49eb-9eee-a2558035722f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084241 Aug 10 23:19:52.612245 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2259/4712] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:19:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 23:19:52.741532 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-31ce58ca-a8cd-410d-9173-e02075213b15 tempest-TestNetworkAdvancedServerOps-1638906998 tempest-TestNetworkAdvancedServerOps-1638906998-project-admin] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:52.742929 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-31ce58ca-a8cd-410d-9173-e02075213b15 tempest-TestNetworkAdvancedServerOps-1638906998 tempest-TestNetworkAdvancedServerOps-1638906998-project-admin] [instance: 69c4b403-a8ad-449c-a577-63837a6d2445] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:52.756745 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-31ce58ca-a8cd-410d-9173-e02075213b15 tempest-TestNetworkAdvancedServerOps-1638906998 tempest-TestNetworkAdvancedServerOps-1638906998-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:52.758303 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-31ce58ca-a8cd-410d-9173-e02075213b15 tempest-TestNetworkAdvancedServerOps-1638906998 tempest-TestNetworkAdvancedServerOps-1638906998-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:52.758303 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-31ce58ca-a8cd-410d-9173-e02075213b15 tempest-TestNetworkAdvancedServerOps-1638906998 tempest-TestNetworkAdvancedServerOps-1638906998-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:52.758576 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-31ce58ca-a8cd-410d-9173-e02075213b15 tempest-TestNetworkAdvancedServerOps-1638906998 tempest-TestNetworkAdvancedServerOps-1638906998-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:52.758850 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-31ce58ca-a8cd-410d-9173-e02075213b15 tempest-TestNetworkAdvancedServerOps-1638906998 tempest-TestNetworkAdvancedServerOps-1638906998-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:52.766481 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-31ce58ca-a8cd-410d-9173-e02075213b15 tempest-TestNetworkAdvancedServerOps-1638906998 tempest-TestNetworkAdvancedServerOps-1638906998-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:52.870144 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-742e5c63-0a0d-4a2f-9c50-6d59ddebcd0a tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:52.871331 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-742e5c63-0a0d-4a2f-9c50-6d59ddebcd0a tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] [instance: a98455ed-1e70-4d9a-98a4-77262e588e87] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:52.883180 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-742e5c63-0a0d-4a2f-9c50-6d59ddebcd0a tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:52.883991 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-742e5c63-0a0d-4a2f-9c50-6d59ddebcd0a tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:52.885712 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-742e5c63-0a0d-4a2f-9c50-6d59ddebcd0a tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:52.887924 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-742e5c63-0a0d-4a2f-9c50-6d59ddebcd0a tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:52.888577 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-742e5c63-0a0d-4a2f-9c50-6d59ddebcd0a tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:52.889685 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-742e5c63-0a0d-4a2f-9c50-6d59ddebcd0a tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:53.097977 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-742e5c63-0a0d-4a2f-9c50-6d59ddebcd0a tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d89081084f14e0187f4c67cd9185fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b557edd165144c8943eb9acc339a377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:53.109507 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-742e5c63-0a0d-4a2f-9c50-6d59ddebcd0a tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] 10.222.0.58 "GET /compute/v2.1/servers/a98455ed-1e70-4d9a-98a4-77262e588e87" status: 200 len: 1366 microversion: 2.1 time: 0.244625 Aug 10 23:19:53.124598 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2260/4713] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:52 2022] GET /compute/v2.1/servers/a98455ed-1e70-4d9a-98a4-77262e588e87 => generated 1366 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:19:53.131014 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-34ad8eee-8461-46a2-b216-c915c8861c3f req-22e33aca-c31e-4616-8632-619d3c8330ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a98455ed-1e70-4d9a-98a4-77262e588e87", "name": "network-vif-plugged", "status": "completed", "tag": "182692c8-73e7-42ae-ada4-e4937c1ac10d"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:19:53.141216 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-34ad8eee-8461-46a2-b216-c915c8861c3f req-22e33aca-c31e-4616-8632-619d3c8330ff service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:53.141700 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-34ad8eee-8461-46a2-b216-c915c8861c3f req-22e33aca-c31e-4616-8632-619d3c8330ff service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:53.142131 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-34ad8eee-8461-46a2-b216-c915c8861c3f req-22e33aca-c31e-4616-8632-619d3c8330ff service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:53.158340 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-34ad8eee-8461-46a2-b216-c915c8861c3f req-22e33aca-c31e-4616-8632-619d3c8330ff service nova] Creating event network-vif-plugged:182692c8-73e7-42ae-ada4-e4937c1ac10d for instance a98455ed-1e70-4d9a-98a4-77262e588e87 on n-h1-850468-14 Aug 10 23:19:53.180529 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-34ad8eee-8461-46a2-b216-c915c8861c3f req-22e33aca-c31e-4616-8632-619d3c8330ff service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054276 Aug 10 23:19:53.181863 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2261/4714] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:19:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:19:53.373814 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-31ce58ca-a8cd-410d-9173-e02075213b15 tempest-TestNetworkAdvancedServerOps-1638906998 tempest-TestNetworkAdvancedServerOps-1638906998-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/69c4b403-a8ad-449c-a577-63837a6d2445" status: 200 len: 1837 microversion: 2.1 time: 0.636619 Aug 10 23:19:53.375188 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2454/4715] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:52 2022] GET /compute/v2.1/servers/69c4b403-a8ad-449c-a577-63837a6d2445 => generated 1837 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:19:53.381385 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c5851aad-4ba0-4c30-b960-632e95becdd1 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:53.382241 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-c5851aad-4ba0-4c30-b960-632e95becdd1 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: d3455c49-214c-4635-b28b-f87ff636e960] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:53.401270 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c5851aad-4ba0-4c30-b960-632e95becdd1 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:53.402317 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c5851aad-4ba0-4c30-b960-632e95becdd1 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:53.403518 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c5851aad-4ba0-4c30-b960-632e95becdd1 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:53.404917 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c5851aad-4ba0-4c30-b960-632e95becdd1 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:53.405644 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c5851aad-4ba0-4c30-b960-632e95becdd1 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:53.406394 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c5851aad-4ba0-4c30-b960-632e95becdd1 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:53.410698 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-4abc064c-9416-4e10-9cf7-a69a25619038 tempest-TestNetworkAdvancedServerOps-1638906998 tempest-TestNetworkAdvancedServerOps-1638906998-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:19:53.416315 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-4abc064c-9416-4e10-9cf7-a69a25619038 tempest-TestNetworkAdvancedServerOps-1638906998 tempest-TestNetworkAdvancedServerOps-1638906998-project-admin] [instance: 69c4b403-a8ad-449c-a577-63837a6d2445] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:53.425564 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4abc064c-9416-4e10-9cf7-a69a25619038 tempest-TestNetworkAdvancedServerOps-1638906998 tempest-TestNetworkAdvancedServerOps-1638906998-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:53.426626 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4abc064c-9416-4e10-9cf7-a69a25619038 tempest-TestNetworkAdvancedServerOps-1638906998 tempest-TestNetworkAdvancedServerOps-1638906998-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:53.430017 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4abc064c-9416-4e10-9cf7-a69a25619038 tempest-TestNetworkAdvancedServerOps-1638906998 tempest-TestNetworkAdvancedServerOps-1638906998-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:53.431218 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4abc064c-9416-4e10-9cf7-a69a25619038 tempest-TestNetworkAdvancedServerOps-1638906998 tempest-TestNetworkAdvancedServerOps-1638906998-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:53.432064 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4abc064c-9416-4e10-9cf7-a69a25619038 tempest-TestNetworkAdvancedServerOps-1638906998 tempest-TestNetworkAdvancedServerOps-1638906998-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:53.433402 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4abc064c-9416-4e10-9cf7-a69a25619038 tempest-TestNetworkAdvancedServerOps-1638906998 tempest-TestNetworkAdvancedServerOps-1638906998-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:53.434769 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-c5851aad-4ba0-4c30-b960-632e95becdd1 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] HTTP exception thrown: Instance d3455c49-214c-4635-b28b-f87ff636e960 could not be found. Aug 10 23:19:53.436561 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c5851aad-4ba0-4c30-b960-632e95becdd1 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Request method failure captured: Aug 10 23:19:53.436561 n-d-850468-14 devstack@n-api.service[122632]: request: GET /compute/v2.1/servers/d3455c49-214c-4635-b28b-f87ff636e960 HTTP/1.1 Aug 10 23:19:53.436561 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:19:53.436561 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:19:53.436561 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:19:53.436561 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 23:19:53.436561 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:19:53.436561 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:19:53.436561 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:19:53.436561 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:19:53.436561 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9DytBT8uIivFlHEw3ugwW3-_1ks70Fcm-KUdUfNf3hiFdhb5xvDC9LI4u79J0X-frOTrhG-DWWR1w8a7yZU35-jGfQgN97QRTSA7hDEW06netEOKzarBlr77OO9sCeT3s5ektFA7vCYLl4122WPKHg-MSXQY0g9YmL291Ic7yNjWLnQ Aug 10 23:19:53.436561 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:19:53.436561 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:19:53.436561 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:19:53.436561 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:19:53.436561 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:19:53.436561 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:19:53.436561 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 0b0582ace9e4443b8ad88915503ee630 Aug 10 23:19:53.436561 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-ServersTestJSON-516662906 Aug 10 23:19:53.436561 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:19:53.436561 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:19:53.436561 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0b0582ace9e4443b8ad88915503ee630"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0b0582ace9e4443b8ad88915503ee630"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/0b0582ace9e4443b8ad88915503ee630"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_0b0582ace9e4443b8ad88915503ee630", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:19:53.436561 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-ServersTestJSON-516662906 Aug 10 23:19:53.436561 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 0b0582ace9e4443b8ad88915503ee630 Aug 10 23:19:53.436561 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-ServersTestJSON-516662906 Aug 10 23:19:53.436561 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-ServersTestJSON-516662906-project Aug 10 23:19:53.436561 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:19:53.436561 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:19:53.436561 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: 6684f0c87e4242be9e0ffb4ef1973f96 Aug 10 23:19:53.436561 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-ServersTestJSON-516662906-project Aug 10 23:19:53.436561 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:19:53.436561 n-d-850468-14 devstack@n-api.service[122632]: exception: Instance d3455c49-214c-4635-b28b-f87ff636e960 could not be found. Aug 10 23:19:53.436561 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': 'd3455c49-214c-4635-b28b-f87ff636e960'} Aug 10 23:19:53.436561 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:19:53.436561 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:19:53.436561 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:19:53.436561 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:19:53.436561 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:19:53.436561 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:19:53.436561 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:19:53.436561 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:19:53.436561 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:19:53.436561 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:19:53.436561 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3455c49-214c-4635-b28b-f87ff636e960 could not be found. Aug 10 23:19:53.436561 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:19:53.436561 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:19:53.436561 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:19:53.436561 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:19:53.436561 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:19:53.436561 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:19:53.436561 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:19:53.436561 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:19:53.436561 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:19:53.436561 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:19:53.436561 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:19:53.436561 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:19:53.436561 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:19:53.436561 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:19:53.436561 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:19:53.436561 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:19:53.436561 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3455c49-214c-4635-b28b-f87ff636e960 could not be found. Aug 10 23:19:53.436561 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:19:53.436561 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:19:53.436561 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:19:53.436561 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:19:53.443848 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:19:53.443848 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:19:53.443848 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:19:53.443848 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:19:53.443848 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3455c49-214c-4635-b28b-f87ff636e960 could not be found. Aug 10 23:19:53.443848 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:19:53.443848 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c5851aad-4ba0-4c30-b960-632e95becdd1 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Returning 404 to user: Instance d3455c49-214c-4635-b28b-f87ff636e960 could not be found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:19:53.443848 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-c5851aad-4ba0-4c30-b960-632e95becdd1 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "GET /compute/v2.1/servers/d3455c49-214c-4635-b28b-f87ff636e960" status: 404 len: 111 microversion: 2.1 time: 0.063446 Aug 10 23:19:53.445491 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2262/4716] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:53 2022] GET /compute/v2.1/servers/d3455c49-214c-4635-b28b-f87ff636e960 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:19:53.452190 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-46a59105-91f9-4307-8eeb-6415543058ec tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '.version_select at 0x7f847d1c61f0>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:53.479712 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-46a59105-91f9-4307-8eeb-6415543058ec tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-key-1724435875" status: 202 len: 0 microversion: 2.1 time: 0.032436 Aug 10 23:19:53.484107 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2263/4717] 10.222.0.58 () {58 vars in 1209 bytes} [Wed Aug 10 23:19:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-1724435875 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:19:53.499542 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-8b0bdf2a-ee8a-4584-a250-545d833b0407 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:53.501699 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-8b0bdf2a-ee8a-4584-a250-545d833b0407 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] [instance: ee6a796b-efa5-4c73-8776-d86b54ca2190] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:53.510733 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8b0bdf2a-ee8a-4584-a250-545d833b0407 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:53.511945 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8b0bdf2a-ee8a-4584-a250-545d833b0407 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:53.512612 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8b0bdf2a-ee8a-4584-a250-545d833b0407 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:53.513597 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8b0bdf2a-ee8a-4584-a250-545d833b0407 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:53.514271 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8b0bdf2a-ee8a-4584-a250-545d833b0407 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:53.515062 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8b0bdf2a-ee8a-4584-a250-545d833b0407 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:53.552831 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.objects.instance [None req-4abc064c-9416-4e10-9cf7-a69a25619038 tempest-TestNetworkAdvancedServerOps-1638906998 tempest-TestNetworkAdvancedServerOps-1638906998-project-admin] Lazy-loading 'flavor' on Instance uuid 69c4b403-a8ad-449c-a577-63837a6d2445 {{(pid=122633) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:19:53.575777 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-4abc064c-9416-4e10-9cf7-a69a25619038 tempest-TestNetworkAdvancedServerOps-1638906998 tempest-TestNetworkAdvancedServerOps-1638906998-project-admin] [instance: 69c4b403-a8ad-449c-a577-63837a6d2445] Going to try to live migrate instance to another host {{(pid=122633) live_migrate /opt/stack/nova/nova/compute/api.py:5443}} Aug 10 23:19:53.929461 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-8b0bdf2a-ee8a-4584-a250-545d833b0407 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '627b163f1a0e4fdeb0e9692e7d37460d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb5f5856c46490ab1ded572d693c4cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:53.938388 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-8b0bdf2a-ee8a-4584-a250-545d833b0407 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] 10.222.0.58 "GET /compute/v2.1/servers/ee6a796b-efa5-4c73-8776-d86b54ca2190" status: 200 len: 1641 microversion: 2.1 time: 0.446079 Aug 10 23:19:53.944717 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2264/4718] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:53 2022] GET /compute/v2.1/servers/ee6a796b-efa5-4c73-8776-d86b54ca2190 => generated 1641 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:19:53.950605 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-b6e051bf-36db-418b-885f-1c41d92a5397 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1525450872", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452", "networks": [{"uuid": "af9afbc6-0659-47e6-b542-cfe9f265fcc2"}]}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:19:54.033490 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.network.neutron [None req-b6e051bf-36db-418b-885f-1c41d92a5397 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] validate_networks() for [('af9afbc6-0659-47e6-b542-cfe9f265fcc2', None, None, None, None, None)] {{(pid=122632) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 23:19:54.940896 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-b6e051bf-36db-418b-885f-1c41d92a5397 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Flavor limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:19:54.941656 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-b6e051bf-36db-418b-885f-1c41d92a5397 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Image limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:19:54.948545 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-b6e051bf-36db-418b-885f-1c41d92a5397 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Flavor pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:19:54.950173 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-b6e051bf-36db-418b-885f-1c41d92a5397 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Image pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:19:54.951281 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-b6e051bf-36db-418b-885f-1c41d92a5397 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:19:54.993539 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b6e051bf-36db-418b-885f-1c41d92a5397 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:54.994343 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b6e051bf-36db-418b-885f-1c41d92a5397 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:54.995066 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b6e051bf-36db-418b-885f-1c41d92a5397 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:54.996185 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b6e051bf-36db-418b-885f-1c41d92a5397 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:54.997193 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b6e051bf-36db-418b-885f-1c41d92a5397 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:54.998133 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b6e051bf-36db-418b-885f-1c41d92a5397 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:55.016692 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:19:55.042133 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-b6e051bf-36db-418b-885f-1c41d92a5397 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Getting quotas for project 0b0582ace9e4443b8ad88915503ee630. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:19:55.059581 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-b6e051bf-36db-418b-885f-1c41d92a5397 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Getting quotas for user 6684f0c87e4242be9e0ffb4ef1973f96 and project 0b0582ace9e4443b8ad88915503ee630. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:19:55.093600 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-b6e051bf-36db-418b-885f-1c41d92a5397 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Going to run 1 instances... {{(pid=122632) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 23:19:55.097364 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-b6e051bf-36db-418b-885f-1c41d92a5397 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: 53003fff-46d7-4621-93fb-c2751572bb90] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78ad8905-f66f-4733-8be9-2b260f1fabed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122632) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 23:19:55.197874 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-b6e051bf-36db-418b-885f-1c41d92a5397 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.250118 Aug 10 23:19:55.200363 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2265/4719] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 23:19:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 1255 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 23:19:55.253403 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-6bf7c109-215e-4945-bc1c-22f0a4016bea tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:55.254120 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-6bf7c109-215e-4945-bc1c-22f0a4016bea tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] [instance: ee6a796b-efa5-4c73-8776-d86b54ca2190] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:55.269217 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6bf7c109-215e-4945-bc1c-22f0a4016bea tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:55.276224 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6bf7c109-215e-4945-bc1c-22f0a4016bea tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:55.276939 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6bf7c109-215e-4945-bc1c-22f0a4016bea tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:55.277887 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6bf7c109-215e-4945-bc1c-22f0a4016bea tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:55.278507 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6bf7c109-215e-4945-bc1c-22f0a4016bea tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:55.279157 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6bf7c109-215e-4945-bc1c-22f0a4016bea tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:55.666532 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-6bf7c109-215e-4945-bc1c-22f0a4016bea tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '627b163f1a0e4fdeb0e9692e7d37460d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb5f5856c46490ab1ded572d693c4cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:55.690059 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-6bf7c109-215e-4945-bc1c-22f0a4016bea tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] 10.222.0.58 "GET /compute/v2.1/servers/ee6a796b-efa5-4c73-8776-d86b54ca2190" status: 200 len: 1641 microversion: 2.1 time: 0.486905 Aug 10 23:19:55.703473 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2266/4720] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:55 2022] GET /compute/v2.1/servers/ee6a796b-efa5-4c73-8776-d86b54ca2190 => generated 1641 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:19:55.713914 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-52611224-e675-4ee1-a229-44b6255eaf21 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:55.714853 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-52611224-e675-4ee1-a229-44b6255eaf21 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] [instance: a98455ed-1e70-4d9a-98a4-77262e588e87] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:55.721503 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-52611224-e675-4ee1-a229-44b6255eaf21 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:55.722126 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-52611224-e675-4ee1-a229-44b6255eaf21 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:55.722740 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-52611224-e675-4ee1-a229-44b6255eaf21 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:55.723787 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-52611224-e675-4ee1-a229-44b6255eaf21 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:55.725597 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-52611224-e675-4ee1-a229-44b6255eaf21 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:55.726211 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-52611224-e675-4ee1-a229-44b6255eaf21 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:56.089187 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-52611224-e675-4ee1-a229-44b6255eaf21 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d89081084f14e0187f4c67cd9185fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b557edd165144c8943eb9acc339a377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:56.111611 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-52611224-e675-4ee1-a229-44b6255eaf21 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] 10.222.0.58 "GET /compute/v2.1/servers/a98455ed-1e70-4d9a-98a4-77262e588e87" status: 200 len: 1557 microversion: 2.1 time: 0.407015 Aug 10 23:19:56.129572 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2267/4721] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:55 2022] GET /compute/v2.1/servers/a98455ed-1e70-4d9a-98a4-77262e588e87 => generated 1557 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:19:56.142683 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-a524bddd-cf25-4aa8-b615-4c54fae0945f tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:56.148320 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-a524bddd-cf25-4aa8-b615-4c54fae0945f tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: 53003fff-46d7-4621-93fb-c2751572bb90] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:56.161161 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a524bddd-cf25-4aa8-b615-4c54fae0945f tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:56.164614 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a524bddd-cf25-4aa8-b615-4c54fae0945f tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:56.165253 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a524bddd-cf25-4aa8-b615-4c54fae0945f tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:56.166170 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a524bddd-cf25-4aa8-b615-4c54fae0945f tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:56.174390 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a524bddd-cf25-4aa8-b615-4c54fae0945f tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:56.174983 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a524bddd-cf25-4aa8-b615-4c54fae0945f tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:56.329440 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-a524bddd-cf25-4aa8-b615-4c54fae0945f tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6684f0c87e4242be9e0ffb4ef1973f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0582ace9e4443b8ad88915503ee630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:56.339009 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-a524bddd-cf25-4aa8-b615-4c54fae0945f tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "GET /compute/v2.1/servers/53003fff-46d7-4621-93fb-c2751572bb90" status: 200 len: 1213 microversion: 2.1 time: 0.207001 Aug 10 23:19:56.360378 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2268/4722] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:56 2022] GET /compute/v2.1/servers/53003fff-46d7-4621-93fb-c2751572bb90 => generated 1213 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:19:56.368022 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-58dda0ed-3b2e-4683-8555-3672066e3427 tempest-TestSecurityGroupsBasicOps-584807937 tempest-TestSecurityGroupsBasicOps-584807937-project-admin] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:56.368879 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-58dda0ed-3b2e-4683-8555-3672066e3427 tempest-TestSecurityGroupsBasicOps-584807937 tempest-TestSecurityGroupsBasicOps-584807937-project-admin] [instance: ee6a796b-efa5-4c73-8776-d86b54ca2190] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:56.387721 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-58dda0ed-3b2e-4683-8555-3672066e3427 tempest-TestSecurityGroupsBasicOps-584807937 tempest-TestSecurityGroupsBasicOps-584807937-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:56.388551 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-58dda0ed-3b2e-4683-8555-3672066e3427 tempest-TestSecurityGroupsBasicOps-584807937 tempest-TestSecurityGroupsBasicOps-584807937-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:56.389173 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-58dda0ed-3b2e-4683-8555-3672066e3427 tempest-TestSecurityGroupsBasicOps-584807937 tempest-TestSecurityGroupsBasicOps-584807937-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:56.390118 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-58dda0ed-3b2e-4683-8555-3672066e3427 tempest-TestSecurityGroupsBasicOps-584807937 tempest-TestSecurityGroupsBasicOps-584807937-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:56.397646 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-58dda0ed-3b2e-4683-8555-3672066e3427 tempest-TestSecurityGroupsBasicOps-584807937 tempest-TestSecurityGroupsBasicOps-584807937-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:56.398417 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-58dda0ed-3b2e-4683-8555-3672066e3427 tempest-TestSecurityGroupsBasicOps-584807937 tempest-TestSecurityGroupsBasicOps-584807937-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:57.340618 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-4abc064c-9416-4e10-9cf7-a69a25619038 tempest-TestNetworkAdvancedServerOps-1638906998 tempest-TestNetworkAdvancedServerOps-1638906998-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/69c4b403-a8ad-449c-a577-63837a6d2445/action" status: 202 len: 0 microversion: 2.1 time: 3.935638 Aug 10 23:19:57.342167 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2455/4723] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:19:53 2022] POST /compute/v2.1/servers/69c4b403-a8ad-449c-a577-63837a6d2445/action => generated 0 bytes in 3938 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 10 23:19:57.348041 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-31cf69b4-fead-496f-9217-99ccf30bafed tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:57.349669 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-31cf69b4-fead-496f-9217-99ccf30bafed tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] [instance: a98455ed-1e70-4d9a-98a4-77262e588e87] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:57.366148 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-31cf69b4-fead-496f-9217-99ccf30bafed tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:57.367202 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-31cf69b4-fead-496f-9217-99ccf30bafed tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:57.368663 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-31cf69b4-fead-496f-9217-99ccf30bafed tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:57.369720 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-31cf69b4-fead-496f-9217-99ccf30bafed tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:57.372816 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-31cf69b4-fead-496f-9217-99ccf30bafed tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:57.373416 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-31cf69b4-fead-496f-9217-99ccf30bafed tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:57.436627 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-58dda0ed-3b2e-4683-8555-3672066e3427 tempest-TestSecurityGroupsBasicOps-584807937 tempest-TestSecurityGroupsBasicOps-584807937-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/ee6a796b-efa5-4c73-8776-d86b54ca2190" status: 200 len: 1794 microversion: 2.1 time: 1.054976 Aug 10 23:19:57.438137 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2269/4724] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:56 2022] GET /compute/v2.1/servers/ee6a796b-efa5-4c73-8776-d86b54ca2190 => generated 1794 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:19:57.447414 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-f9534fe0-c98a-4267-906d-c6e118428976 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:57.455425 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-f9534fe0-c98a-4267-906d-c6e118428976 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] [instance: 69c4b403-a8ad-449c-a577-63837a6d2445] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:57.467869 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f9534fe0-c98a-4267-906d-c6e118428976 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:57.468726 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f9534fe0-c98a-4267-906d-c6e118428976 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:57.470003 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f9534fe0-c98a-4267-906d-c6e118428976 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:57.471217 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f9534fe0-c98a-4267-906d-c6e118428976 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:57.472233 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f9534fe0-c98a-4267-906d-c6e118428976 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:57.473439 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f9534fe0-c98a-4267-906d-c6e118428976 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:57.792289 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-31cf69b4-fead-496f-9217-99ccf30bafed tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] 10.222.0.58 "GET /compute/v2.1/servers/a98455ed-1e70-4d9a-98a4-77262e588e87/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.440163 Aug 10 23:19:57.796851 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2456/4725] 10.222.0.58 () {58 vars in 1275 bytes} [Wed Aug 10 23:19:57 2022] GET /compute/v2.1/servers/a98455ed-1e70-4d9a-98a4-77262e588e87/os-interface => generated 285 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:19:57.813717 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-fe967fce-2358-45fb-ac66-e450cb7b3830 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:57.815188 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-fe967fce-2358-45fb-ac66-e450cb7b3830 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: 53003fff-46d7-4621-93fb-c2751572bb90] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:57.836351 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fe967fce-2358-45fb-ac66-e450cb7b3830 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:57.837201 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fe967fce-2358-45fb-ac66-e450cb7b3830 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:57.838572 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fe967fce-2358-45fb-ac66-e450cb7b3830 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:57.840062 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fe967fce-2358-45fb-ac66-e450cb7b3830 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:57.840974 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fe967fce-2358-45fb-ac66-e450cb7b3830 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:57.841787 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fe967fce-2358-45fb-ac66-e450cb7b3830 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:58.079222 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-f9534fe0-c98a-4267-906d-c6e118428976 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5899b2ad9f1046caaf7c6073e408eeee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25abd63376614081a9d484f3c9ae950d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:58.093682 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-f9534fe0-c98a-4267-906d-c6e118428976 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "GET /compute/v2.1/servers/69c4b403-a8ad-449c-a577-63837a6d2445" status: 200 len: 1694 microversion: 2.1 time: 0.651964 Aug 10 23:19:58.113215 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2270/4726] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:57 2022] GET /compute/v2.1/servers/69c4b403-a8ad-449c-a577-63837a6d2445 => generated 1694 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:19:58.999463 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-fe967fce-2358-45fb-ac66-e450cb7b3830 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6684f0c87e4242be9e0ffb4ef1973f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0582ace9e4443b8ad88915503ee630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:59.016456 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-fe967fce-2358-45fb-ac66-e450cb7b3830 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "GET /compute/v2.1/servers/53003fff-46d7-4621-93fb-c2751572bb90" status: 200 len: 1267 microversion: 2.1 time: 1.214281 Aug 10 23:19:59.018049 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2457/4727] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:57 2022] GET /compute/v2.1/servers/53003fff-46d7-4621-93fb-c2751572bb90 => generated 1267 bytes in 1220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:19:59.121380 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-bc6ade4f-685b-4ab6-bdcc-99527f8fd81e tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:19:59.123091 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-bc6ade4f-685b-4ab6-bdcc-99527f8fd81e tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] [instance: 69c4b403-a8ad-449c-a577-63837a6d2445] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:19:59.138921 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bc6ade4f-685b-4ab6-bdcc-99527f8fd81e tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:59.139437 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bc6ade4f-685b-4ab6-bdcc-99527f8fd81e tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:59.139897 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bc6ade4f-685b-4ab6-bdcc-99527f8fd81e tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:59.140626 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bc6ade4f-685b-4ab6-bdcc-99527f8fd81e tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:19:59.141257 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bc6ade4f-685b-4ab6-bdcc-99527f8fd81e tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:19:59.150361 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bc6ade4f-685b-4ab6-bdcc-99527f8fd81e tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:19:59.777888 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-bc6ade4f-685b-4ab6-bdcc-99527f8fd81e tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5899b2ad9f1046caaf7c6073e408eeee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25abd63376614081a9d484f3c9ae950d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:19:59.792006 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-bc6ade4f-685b-4ab6-bdcc-99527f8fd81e tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "GET /compute/v2.1/servers/69c4b403-a8ad-449c-a577-63837a6d2445" status: 200 len: 1694 microversion: 2.1 time: 0.678192 Aug 10 23:19:59.800139 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2271/4728] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:19:59 2022] GET /compute/v2.1/servers/69c4b403-a8ad-449c-a577-63837a6d2445 => generated 1694 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:20:00.041485 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-8f7ee86a-8dab-4312-9258-6d7f5af69ded tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:00.042099 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-8f7ee86a-8dab-4312-9258-6d7f5af69ded tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: 53003fff-46d7-4621-93fb-c2751572bb90] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:00.052380 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8f7ee86a-8dab-4312-9258-6d7f5af69ded tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:00.053365 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8f7ee86a-8dab-4312-9258-6d7f5af69ded tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:00.054324 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8f7ee86a-8dab-4312-9258-6d7f5af69ded tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:00.057020 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8f7ee86a-8dab-4312-9258-6d7f5af69ded tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:00.058258 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8f7ee86a-8dab-4312-9258-6d7f5af69ded tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:00.058935 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8f7ee86a-8dab-4312-9258-6d7f5af69ded tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:00.242584 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-8f7ee86a-8dab-4312-9258-6d7f5af69ded tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6684f0c87e4242be9e0ffb4ef1973f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0582ace9e4443b8ad88915503ee630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:00.255201 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-8f7ee86a-8dab-4312-9258-6d7f5af69ded tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "GET /compute/v2.1/servers/53003fff-46d7-4621-93fb-c2751572bb90" status: 200 len: 1267 microversion: 2.1 time: 0.217419 Aug 10 23:20:00.260454 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2458/4729] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:20:00 2022] GET /compute/v2.1/servers/53003fff-46d7-4621-93fb-c2751572bb90 => generated 1267 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:20:00.564171 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-b801bb6a-6279-4e6d-a4ab-94b3d52bdaa1 req-1032a474-def6-4dcb-8ee8-1ce8d29f8cbe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69c4b403-a8ad-449c-a577-63837a6d2445", "name": "network-vif-unplugged", "status": "completed", "tag": "8597a359-c6f1-46f8-9a07-e80725a3a36d"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:20:00.644997 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-b801bb6a-6279-4e6d-a4ab-94b3d52bdaa1 req-1032a474-def6-4dcb-8ee8-1ce8d29f8cbe service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:00.645488 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-b801bb6a-6279-4e6d-a4ab-94b3d52bdaa1 req-1032a474-def6-4dcb-8ee8-1ce8d29f8cbe service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:00.646727 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-b801bb6a-6279-4e6d-a4ab-94b3d52bdaa1 req-1032a474-def6-4dcb-8ee8-1ce8d29f8cbe service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:00.668339 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-b801bb6a-6279-4e6d-a4ab-94b3d52bdaa1 req-1032a474-def6-4dcb-8ee8-1ce8d29f8cbe service nova] Creating event network-vif-unplugged:8597a359-c6f1-46f8-9a07-e80725a3a36d for instance 69c4b403-a8ad-449c-a577-63837a6d2445 on n-h2-850468-14 Aug 10 23:20:00.682318 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-b801bb6a-6279-4e6d-a4ab-94b3d52bdaa1 req-1032a474-def6-4dcb-8ee8-1ce8d29f8cbe service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.121848 Aug 10 23:20:00.683628 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2272/4730] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:20:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:20:00.827003 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-4f046fc4-51de-41dd-996e-962c2e8fb015 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:00.832934 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-4f046fc4-51de-41dd-996e-962c2e8fb015 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] [instance: 69c4b403-a8ad-449c-a577-63837a6d2445] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:00.847953 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4f046fc4-51de-41dd-996e-962c2e8fb015 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:00.852554 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4f046fc4-51de-41dd-996e-962c2e8fb015 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:00.853328 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4f046fc4-51de-41dd-996e-962c2e8fb015 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:00.855953 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4f046fc4-51de-41dd-996e-962c2e8fb015 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:00.856616 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4f046fc4-51de-41dd-996e-962c2e8fb015 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:00.862652 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4f046fc4-51de-41dd-996e-962c2e8fb015 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:01.138391 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-cd903237-07aa-4dcc-af4e-25ac97d74552 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1957966784", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452", "networks": "none"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:20:01.224427 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-cd903237-07aa-4dcc-af4e-25ac97d74552 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Flavor limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:20:01.224960 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-cd903237-07aa-4dcc-af4e-25ac97d74552 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Image limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:20:01.225880 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-cd903237-07aa-4dcc-af4e-25ac97d74552 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Flavor pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:20:01.226537 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-cd903237-07aa-4dcc-af4e-25ac97d74552 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Image pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:20:01.227364 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-cd903237-07aa-4dcc-af4e-25ac97d74552 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:20:01.238048 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cd903237-07aa-4dcc-af4e-25ac97d74552 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:01.238943 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cd903237-07aa-4dcc-af4e-25ac97d74552 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:01.240174 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cd903237-07aa-4dcc-af4e-25ac97d74552 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:01.241632 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cd903237-07aa-4dcc-af4e-25ac97d74552 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:01.242374 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cd903237-07aa-4dcc-af4e-25ac97d74552 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:01.243116 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cd903237-07aa-4dcc-af4e-25ac97d74552 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:01.264862 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-cd903237-07aa-4dcc-af4e-25ac97d74552 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Getting quotas for project 3661cd206d19455eb1c4ac3dd988a67d. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:20:01.273432 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-cd903237-07aa-4dcc-af4e-25ac97d74552 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Getting quotas for user 65fc7792249b4daca6a39f7259d2236c and project 3661cd206d19455eb1c4ac3dd988a67d. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:20:01.295572 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-cd903237-07aa-4dcc-af4e-25ac97d74552 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Going to run 1 instances... {{(pid=122632) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 23:20:01.297975 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-cd903237-07aa-4dcc-af4e-25ac97d74552 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] [instance: ce24e04e-229f-432f-90b2-9fd65134dbeb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78ad8905-f66f-4733-8be9-2b260f1fabed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122632) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 23:20:01.358067 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-cd903237-07aa-4dcc-af4e-25ac97d74552 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.409981 Aug 10 23:20:01.360433 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2273/4731] 10.222.0.58 () {62 vars in 1188 bytes} [Wed Aug 10 23:20:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 413 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 10 23:20:01.373432 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-cc768a2e-1bd3-4173-b2ce-2609a1067ad8 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:01.374099 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-cc768a2e-1bd3-4173-b2ce-2609a1067ad8 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: 53003fff-46d7-4621-93fb-c2751572bb90] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:01.392080 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cc768a2e-1bd3-4173-b2ce-2609a1067ad8 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:01.392818 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cc768a2e-1bd3-4173-b2ce-2609a1067ad8 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:01.393564 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cc768a2e-1bd3-4173-b2ce-2609a1067ad8 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:01.394553 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cc768a2e-1bd3-4173-b2ce-2609a1067ad8 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:01.395210 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cc768a2e-1bd3-4173-b2ce-2609a1067ad8 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:01.397920 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cc768a2e-1bd3-4173-b2ce-2609a1067ad8 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:01.831265 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-cc768a2e-1bd3-4173-b2ce-2609a1067ad8 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6684f0c87e4242be9e0ffb4ef1973f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0582ace9e4443b8ad88915503ee630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:01.840118 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-cc768a2e-1bd3-4173-b2ce-2609a1067ad8 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "GET /compute/v2.1/servers/53003fff-46d7-4621-93fb-c2751572bb90" status: 200 len: 1309 microversion: 2.1 time: 0.476281 Aug 10 23:20:01.857139 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2274/4732] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:20:01 2022] GET /compute/v2.1/servers/53003fff-46d7-4621-93fb-c2751572bb90 => generated 1309 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:20:01.865078 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-d523d8d9-fa70-4884-bffe-1104c18b4673 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:01.865702 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-d523d8d9-fa70-4884-bffe-1104c18b4673 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] [instance: ce24e04e-229f-432f-90b2-9fd65134dbeb] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:01.977131 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-4f046fc4-51de-41dd-996e-962c2e8fb015 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5899b2ad9f1046caaf7c6073e408eeee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25abd63376614081a9d484f3c9ae950d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:01.992969 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-4f046fc4-51de-41dd-996e-962c2e8fb015 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "GET /compute/v2.1/servers/69c4b403-a8ad-449c-a577-63837a6d2445" status: 200 len: 1694 microversion: 2.1 time: 1.171513 Aug 10 23:20:01.995088 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2459/4733] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:20:00 2022] GET /compute/v2.1/servers/69c4b403-a8ad-449c-a577-63837a6d2445 => generated 1694 bytes in 1176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:20:02.040475 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-d523d8d9-fa70-4884-bffe-1104c18b4673 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65fc7792249b4daca6a39f7259d2236c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3661cd206d19455eb1c4ac3dd988a67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:02.054361 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-d523d8d9-fa70-4884-bffe-1104c18b4673 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65fc7792249b4daca6a39f7259d2236c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3661cd206d19455eb1c4ac3dd988a67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:02.058033 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-d523d8d9-fa70-4884-bffe-1104c18b4673 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65fc7792249b4daca6a39f7259d2236c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3661cd206d19455eb1c4ac3dd988a67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:02.063276 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-d523d8d9-fa70-4884-bffe-1104c18b4673 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] 10.222.0.58 "GET /compute/v2.1/servers/ce24e04e-229f-432f-90b2-9fd65134dbeb" status: 200 len: 1278 microversion: 2.47 time: 0.204806 Aug 10 23:20:02.063875 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2275/4734] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:20:01 2022] GET /compute/v2.1/servers/ce24e04e-229f-432f-90b2-9fd65134dbeb => generated 1278 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:20:02.167274 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-458d35f1-51ec-46d0-9e7f-d0cc627f9e52 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1402195982", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452", "networks": "none"}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:20:02.329532 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-458d35f1-51ec-46d0-9e7f-d0cc627f9e52 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Flavor limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:20:02.331165 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-458d35f1-51ec-46d0-9e7f-d0cc627f9e52 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Image limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:20:02.331689 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-458d35f1-51ec-46d0-9e7f-d0cc627f9e52 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Flavor pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:20:02.346311 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-458d35f1-51ec-46d0-9e7f-d0cc627f9e52 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Image pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:20:02.346914 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-458d35f1-51ec-46d0-9e7f-d0cc627f9e52 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:20:02.376149 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-458d35f1-51ec-46d0-9e7f-d0cc627f9e52 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:02.376640 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-458d35f1-51ec-46d0-9e7f-d0cc627f9e52 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:02.377079 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-458d35f1-51ec-46d0-9e7f-d0cc627f9e52 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:02.377805 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-458d35f1-51ec-46d0-9e7f-d0cc627f9e52 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:02.380504 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-458d35f1-51ec-46d0-9e7f-d0cc627f9e52 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:02.382062 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-458d35f1-51ec-46d0-9e7f-d0cc627f9e52 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:02.437267 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-458d35f1-51ec-46d0-9e7f-d0cc627f9e52 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Getting quotas for project 3661cd206d19455eb1c4ac3dd988a67d. Resources: {'instances', 'cores', 'ram'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:20:02.462862 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-458d35f1-51ec-46d0-9e7f-d0cc627f9e52 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Getting quotas for user 65fc7792249b4daca6a39f7259d2236c and project 3661cd206d19455eb1c4ac3dd988a67d. Resources: {'instances', 'cores', 'ram'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:20:02.501615 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-458d35f1-51ec-46d0-9e7f-d0cc627f9e52 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Going to run 1 instances... {{(pid=122633) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 23:20:02.504207 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-458d35f1-51ec-46d0-9e7f-d0cc627f9e52 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] [instance: 364415e0-931a-4be4-8149-86eb03e99544] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78ad8905-f66f-4733-8be9-2b260f1fabed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122633) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 23:20:02.616872 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-458d35f1-51ec-46d0-9e7f-d0cc627f9e52 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.457157 Aug 10 23:20:02.624380 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2460/4735] 10.222.0.58 () {62 vars in 1188 bytes} [Wed Aug 10 23:20:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 463 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 10 23:20:02.633255 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-66eb3ee0-5f01-4775-8af3-1881b0493b26 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:20:02.643760 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-66eb3ee0-5f01-4775-8af3-1881b0493b26 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] [instance: 364415e0-931a-4be4-8149-86eb03e99544] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:02.663791 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-db34a6ca-2941-4acf-b94c-4c83e977467f req-07ead2a3-5614-4232-b9a0-6899a326198c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a98455ed-1e70-4d9a-98a4-77262e588e87", "tag": "182692c8-73e7-42ae-ada4-e4937c1ac10d"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:20:02.728035 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-db34a6ca-2941-4acf-b94c-4c83e977467f req-07ead2a3-5614-4232-b9a0-6899a326198c service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:02.728524 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-db34a6ca-2941-4acf-b94c-4c83e977467f req-07ead2a3-5614-4232-b9a0-6899a326198c service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:02.728959 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-db34a6ca-2941-4acf-b94c-4c83e977467f req-07ead2a3-5614-4232-b9a0-6899a326198c service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:02.779303 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-db34a6ca-2941-4acf-b94c-4c83e977467f req-07ead2a3-5614-4232-b9a0-6899a326198c service nova] Creating event network-changed:182692c8-73e7-42ae-ada4-e4937c1ac10d for instance a98455ed-1e70-4d9a-98a4-77262e588e87 on n-h1-850468-14 Aug 10 23:20:02.796447 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-db34a6ca-2941-4acf-b94c-4c83e977467f req-07ead2a3-5614-4232-b9a0-6899a326198c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.139407 Aug 10 23:20:02.797399 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2461/4736] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:20:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:20:02.803601 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-2b43ed42-5939-4b66-a5af-6bb3488796f9 req-abf3756a-c67d-4b74-834a-e7ff35e614ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69c4b403-a8ad-449c-a577-63837a6d2445", "tag": "8597a359-c6f1-46f8-9a07-e80725a3a36d"}, {"name": "network-changed", "server_uuid": "ee6a796b-efa5-4c73-8776-d86b54ca2190", "tag": "4879d463-bf92-43e3-a52e-45e2730c0d75"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:20:02.827424 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-66eb3ee0-5f01-4775-8af3-1881b0493b26 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] 10.222.0.58 "PUT /compute/v2.1/servers/364415e0-931a-4be4-8149-86eb03e99544" status: 200 len: 992 microversion: 2.47 time: 0.200827 Aug 10 23:20:02.829556 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-2b43ed42-5939-4b66-a5af-6bb3488796f9 req-abf3756a-c67d-4b74-834a-e7ff35e614ab service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:02.837467 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-2b43ed42-5939-4b66-a5af-6bb3488796f9 req-abf3756a-c67d-4b74-834a-e7ff35e614ab service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:02.838207 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-2b43ed42-5939-4b66-a5af-6bb3488796f9 req-abf3756a-c67d-4b74-834a-e7ff35e614ab service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:02.846119 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2276/4737] 10.222.0.58 () {62 vars in 1297 bytes} [Wed Aug 10 23:20:02 2022] PUT /compute/v2.1/servers/364415e0-931a-4be4-8149-86eb03e99544 => generated 992 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 23:20:02.857689 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-2b43ed42-5939-4b66-a5af-6bb3488796f9 req-abf3756a-c67d-4b74-834a-e7ff35e614ab service nova] Creating event network-changed:8597a359-c6f1-46f8-9a07-e80725a3a36d for instance 69c4b403-a8ad-449c-a577-63837a6d2445 on n-h2-850468-14 Aug 10 23:20:02.861617 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-a3d0babd-13e8-450b-8eff-23b7cafbecb7 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:02.863771 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-a3d0babd-13e8-450b-8eff-23b7cafbecb7 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] [instance: 364415e0-931a-4be4-8149-86eb03e99544] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:02.866584 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-2b43ed42-5939-4b66-a5af-6bb3488796f9 req-abf3756a-c67d-4b74-834a-e7ff35e614ab service nova] Creating event network-changed:4879d463-bf92-43e3-a52e-45e2730c0d75 for instance ee6a796b-efa5-4c73-8776-d86b54ca2190 on n-h2-850468-14 Aug 10 23:20:02.882195 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-2b43ed42-5939-4b66-a5af-6bb3488796f9 req-abf3756a-c67d-4b74-834a-e7ff35e614ab service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.083091 Aug 10 23:20:02.895956 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2462/4738] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:20:02 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:20:02.901845 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-e6695a11-0ed6-4350-b721-ec5d46ee75fb tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:02.902872 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-e6695a11-0ed6-4350-b721-ec5d46ee75fb tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: 53003fff-46d7-4621-93fb-c2751572bb90] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:02.915223 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e6695a11-0ed6-4350-b721-ec5d46ee75fb tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:02.916295 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e6695a11-0ed6-4350-b721-ec5d46ee75fb tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:02.917217 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e6695a11-0ed6-4350-b721-ec5d46ee75fb tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:02.918226 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e6695a11-0ed6-4350-b721-ec5d46ee75fb tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:02.919601 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e6695a11-0ed6-4350-b721-ec5d46ee75fb tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:02.931522 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e6695a11-0ed6-4350-b721-ec5d46ee75fb tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:03.311718 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-a3d0babd-13e8-450b-8eff-23b7cafbecb7 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65fc7792249b4daca6a39f7259d2236c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3661cd206d19455eb1c4ac3dd988a67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:03.329601 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-a3d0babd-13e8-450b-8eff-23b7cafbecb7 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65fc7792249b4daca6a39f7259d2236c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3661cd206d19455eb1c4ac3dd988a67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:03.331938 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-a3d0babd-13e8-450b-8eff-23b7cafbecb7 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65fc7792249b4daca6a39f7259d2236c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3661cd206d19455eb1c4ac3dd988a67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:03.335226 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-a3d0babd-13e8-450b-8eff-23b7cafbecb7 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] 10.222.0.58 "GET /compute/v2.1/servers/364415e0-931a-4be4-8149-86eb03e99544" status: 200 len: 1278 microversion: 2.47 time: 0.480739 Aug 10 23:20:03.336400 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2277/4739] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:20:02 2022] GET /compute/v2.1/servers/364415e0-931a-4be4-8149-86eb03e99544 => generated 1278 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:20:03.366055 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-040107fd-57ac-498c-a578-79481dc1f267 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:03.366678 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-040107fd-57ac-498c-a578-79481dc1f267 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] [instance: 69c4b403-a8ad-449c-a577-63837a6d2445] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:03.385929 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-040107fd-57ac-498c-a578-79481dc1f267 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:03.386295 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-040107fd-57ac-498c-a578-79481dc1f267 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:03.386740 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-040107fd-57ac-498c-a578-79481dc1f267 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:03.387484 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-040107fd-57ac-498c-a578-79481dc1f267 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:03.387977 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-040107fd-57ac-498c-a578-79481dc1f267 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:03.388643 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-040107fd-57ac-498c-a578-79481dc1f267 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:03.702073 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-e6695a11-0ed6-4350-b721-ec5d46ee75fb tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6684f0c87e4242be9e0ffb4ef1973f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0582ace9e4443b8ad88915503ee630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:03.725058 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-e6695a11-0ed6-4350-b721-ec5d46ee75fb tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "GET /compute/v2.1/servers/53003fff-46d7-4621-93fb-c2751572bb90" status: 200 len: 1309 microversion: 2.1 time: 0.827368 Aug 10 23:20:03.738317 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2463/4740] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:20:02 2022] GET /compute/v2.1/servers/53003fff-46d7-4621-93fb-c2751572bb90 => generated 1309 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:20:04.288849 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-040107fd-57ac-498c-a578-79481dc1f267 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5899b2ad9f1046caaf7c6073e408eeee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25abd63376614081a9d484f3c9ae950d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:04.296630 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-040107fd-57ac-498c-a578-79481dc1f267 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "GET /compute/v2.1/servers/69c4b403-a8ad-449c-a577-63837a6d2445" status: 200 len: 1694 microversion: 2.1 time: 0.939830 Aug 10 23:20:04.297430 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2278/4741] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:20:03 2022] GET /compute/v2.1/servers/69c4b403-a8ad-449c-a577-63837a6d2445 => generated 1694 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:20:04.362556 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-6765fd15-eec4-4e48-8393-0d3c49f72493 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:04.368033 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-6765fd15-eec4-4e48-8393-0d3c49f72493 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] [instance: 364415e0-931a-4be4-8149-86eb03e99544] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:04.412133 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6765fd15-eec4-4e48-8393-0d3c49f72493 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:04.415249 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6765fd15-eec4-4e48-8393-0d3c49f72493 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:04.420208 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6765fd15-eec4-4e48-8393-0d3c49f72493 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:04.428729 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6765fd15-eec4-4e48-8393-0d3c49f72493 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:04.432919 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6765fd15-eec4-4e48-8393-0d3c49f72493 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:04.434514 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6765fd15-eec4-4e48-8393-0d3c49f72493 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:04.748156 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-46b88db8-3683-4574-ab37-b511f866b8ca tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:04.749073 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-46b88db8-3683-4574-ab37-b511f866b8ca tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: 53003fff-46d7-4621-93fb-c2751572bb90] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:04.763677 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-46b88db8-3683-4574-ab37-b511f866b8ca tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:04.764177 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-46b88db8-3683-4574-ab37-b511f866b8ca tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:04.771263 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-46b88db8-3683-4574-ab37-b511f866b8ca tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:04.772154 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-46b88db8-3683-4574-ab37-b511f866b8ca tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:04.772807 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-46b88db8-3683-4574-ab37-b511f866b8ca tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:04.773260 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-46b88db8-3683-4574-ab37-b511f866b8ca tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:05.096390 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-6765fd15-eec4-4e48-8393-0d3c49f72493 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65fc7792249b4daca6a39f7259d2236c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3661cd206d19455eb1c4ac3dd988a67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:05.108254 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-6765fd15-eec4-4e48-8393-0d3c49f72493 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65fc7792249b4daca6a39f7259d2236c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3661cd206d19455eb1c4ac3dd988a67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:05.114649 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-6765fd15-eec4-4e48-8393-0d3c49f72493 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65fc7792249b4daca6a39f7259d2236c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3661cd206d19455eb1c4ac3dd988a67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:05.116096 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-6765fd15-eec4-4e48-8393-0d3c49f72493 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] 10.222.0.58 "GET /compute/v2.1/servers/364415e0-931a-4be4-8149-86eb03e99544" status: 200 len: 1330 microversion: 2.47 time: 0.757496 Aug 10 23:20:05.116684 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2464/4742] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:20:04 2022] GET /compute/v2.1/servers/364415e0-931a-4be4-8149-86eb03e99544 => generated 1330 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:20:05.154767 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-826e54aa-3047-4f2f-abd0-f6b3d76fa705 req-5f674844-0ed7-4132-bb0c-ed2778ead6c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53003fff-46d7-4621-93fb-c2751572bb90", "tag": "f5b14e4f-573b-48b3-a4b6-d1786c62a70e"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:20:05.173840 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-826e54aa-3047-4f2f-abd0-f6b3d76fa705 req-5f674844-0ed7-4132-bb0c-ed2778ead6c5 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:05.174183 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-826e54aa-3047-4f2f-abd0-f6b3d76fa705 req-5f674844-0ed7-4132-bb0c-ed2778ead6c5 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:05.174923 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-826e54aa-3047-4f2f-abd0-f6b3d76fa705 req-5f674844-0ed7-4132-bb0c-ed2778ead6c5 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:05.194428 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-826e54aa-3047-4f2f-abd0-f6b3d76fa705 req-5f674844-0ed7-4132-bb0c-ed2778ead6c5 service nova] Creating event network-changed:f5b14e4f-573b-48b3-a4b6-d1786c62a70e for instance 53003fff-46d7-4621-93fb-c2751572bb90 on n-h2-850468-14 Aug 10 23:20:05.202773 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-826e54aa-3047-4f2f-abd0-f6b3d76fa705 req-5f674844-0ed7-4132-bb0c-ed2778ead6c5 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074032 Aug 10 23:20:05.203985 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2465/4743] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:20:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:20:05.325756 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-22542898-ba7d-4601-9e95-b35750e73437 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:05.326988 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-22542898-ba7d-4601-9e95-b35750e73437 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] [instance: 69c4b403-a8ad-449c-a577-63837a6d2445] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:05.337048 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-22542898-ba7d-4601-9e95-b35750e73437 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:05.337947 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-22542898-ba7d-4601-9e95-b35750e73437 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:05.338610 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-22542898-ba7d-4601-9e95-b35750e73437 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:05.339774 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-22542898-ba7d-4601-9e95-b35750e73437 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:05.345325 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-22542898-ba7d-4601-9e95-b35750e73437 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:05.348680 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-22542898-ba7d-4601-9e95-b35750e73437 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:05.374061 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-46b88db8-3683-4574-ab37-b511f866b8ca tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6684f0c87e4242be9e0ffb4ef1973f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0582ace9e4443b8ad88915503ee630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:05.389531 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-46b88db8-3683-4574-ab37-b511f866b8ca tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "GET /compute/v2.1/servers/53003fff-46d7-4621-93fb-c2751572bb90" status: 200 len: 1309 microversion: 2.1 time: 0.646922 Aug 10 23:20:05.405903 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2279/4744] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:20:04 2022] GET /compute/v2.1/servers/53003fff-46d7-4621-93fb-c2751572bb90 => generated 1309 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:20:05.663207 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-22542898-ba7d-4601-9e95-b35750e73437 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5899b2ad9f1046caaf7c6073e408eeee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25abd63376614081a9d484f3c9ae950d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:05.678087 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-22542898-ba7d-4601-9e95-b35750e73437 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "GET /compute/v2.1/servers/69c4b403-a8ad-449c-a577-63837a6d2445" status: 200 len: 1694 microversion: 2.1 time: 0.359029 Aug 10 23:20:05.678721 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2466/4745] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:20:05 2022] GET /compute/v2.1/servers/69c4b403-a8ad-449c-a577-63837a6d2445 => generated 1694 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:20:06.145258 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-24dadf3d-4876-4896-9eee-c1a190a131fe tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:06.146032 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-24dadf3d-4876-4896-9eee-c1a190a131fe tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] [instance: 364415e0-931a-4be4-8149-86eb03e99544] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:06.164921 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-24dadf3d-4876-4896-9eee-c1a190a131fe tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:06.165343 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-24dadf3d-4876-4896-9eee-c1a190a131fe tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:06.165787 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-24dadf3d-4876-4896-9eee-c1a190a131fe tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:06.166507 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-24dadf3d-4876-4896-9eee-c1a190a131fe tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:06.166997 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-24dadf3d-4876-4896-9eee-c1a190a131fe tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:06.167427 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-24dadf3d-4876-4896-9eee-c1a190a131fe tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:06.308820 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-24dadf3d-4876-4896-9eee-c1a190a131fe tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65fc7792249b4daca6a39f7259d2236c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3661cd206d19455eb1c4ac3dd988a67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:06.319381 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-24dadf3d-4876-4896-9eee-c1a190a131fe tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65fc7792249b4daca6a39f7259d2236c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3661cd206d19455eb1c4ac3dd988a67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:06.320463 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-24dadf3d-4876-4896-9eee-c1a190a131fe tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65fc7792249b4daca6a39f7259d2236c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3661cd206d19455eb1c4ac3dd988a67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:06.321883 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-24dadf3d-4876-4896-9eee-c1a190a131fe tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] 10.222.0.58 "GET /compute/v2.1/servers/364415e0-931a-4be4-8149-86eb03e99544" status: 200 len: 1336 microversion: 2.47 time: 0.182469 Aug 10 23:20:06.322453 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2280/4746] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:20:06 2022] GET /compute/v2.1/servers/364415e0-931a-4be4-8149-86eb03e99544 => generated 1336 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:20:06.412527 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c10862f5-829b-46df-80fc-a86f43d79030 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:06.413148 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-c10862f5-829b-46df-80fc-a86f43d79030 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: 53003fff-46d7-4621-93fb-c2751572bb90] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:06.432024 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c10862f5-829b-46df-80fc-a86f43d79030 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:06.433506 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c10862f5-829b-46df-80fc-a86f43d79030 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:06.434429 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c10862f5-829b-46df-80fc-a86f43d79030 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:06.435835 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c10862f5-829b-46df-80fc-a86f43d79030 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:06.436665 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c10862f5-829b-46df-80fc-a86f43d79030 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:06.437438 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c10862f5-829b-46df-80fc-a86f43d79030 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:06.673312 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-c10862f5-829b-46df-80fc-a86f43d79030 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6684f0c87e4242be9e0ffb4ef1973f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0582ace9e4443b8ad88915503ee630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:06.686880 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-c10862f5-829b-46df-80fc-a86f43d79030 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "GET /compute/v2.1/servers/53003fff-46d7-4621-93fb-c2751572bb90" status: 200 len: 1309 microversion: 2.1 time: 0.278657 Aug 10 23:20:06.688751 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2467/4747] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:20:06 2022] GET /compute/v2.1/servers/53003fff-46d7-4621-93fb-c2751572bb90 => generated 1309 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:20:06.705395 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-ab250354-96be-4f52-a872-081f8d48eba4 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:06.706014 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-ab250354-96be-4f52-a872-081f8d48eba4 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] [instance: 69c4b403-a8ad-449c-a577-63837a6d2445] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:06.713772 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ab250354-96be-4f52-a872-081f8d48eba4 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:06.714270 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ab250354-96be-4f52-a872-081f8d48eba4 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:06.714813 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ab250354-96be-4f52-a872-081f8d48eba4 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:06.715563 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ab250354-96be-4f52-a872-081f8d48eba4 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:06.716225 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ab250354-96be-4f52-a872-081f8d48eba4 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:06.716711 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ab250354-96be-4f52-a872-081f8d48eba4 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:07.082141 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-ab250354-96be-4f52-a872-081f8d48eba4 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5899b2ad9f1046caaf7c6073e408eeee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25abd63376614081a9d484f3c9ae950d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:07.105024 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-ab250354-96be-4f52-a872-081f8d48eba4 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "GET /compute/v2.1/servers/69c4b403-a8ad-449c-a577-63837a6d2445" status: 200 len: 1694 microversion: 2.1 time: 0.402886 Aug 10 23:20:07.106025 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2281/4748] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:20:06 2022] GET /compute/v2.1/servers/69c4b403-a8ad-449c-a577-63837a6d2445 => generated 1694 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:20:07.347422 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-dbcf1788-7cf6-41b4-b52c-6f98c9584863 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:07.348207 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-dbcf1788-7cf6-41b4-b52c-6f98c9584863 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] [instance: 364415e0-931a-4be4-8149-86eb03e99544] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:07.355891 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dbcf1788-7cf6-41b4-b52c-6f98c9584863 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:07.356415 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dbcf1788-7cf6-41b4-b52c-6f98c9584863 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:07.357059 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dbcf1788-7cf6-41b4-b52c-6f98c9584863 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:07.357785 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dbcf1788-7cf6-41b4-b52c-6f98c9584863 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:07.358630 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dbcf1788-7cf6-41b4-b52c-6f98c9584863 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:07.359346 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dbcf1788-7cf6-41b4-b52c-6f98c9584863 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:07.455722 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-dbcf1788-7cf6-41b4-b52c-6f98c9584863 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65fc7792249b4daca6a39f7259d2236c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3661cd206d19455eb1c4ac3dd988a67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:07.468437 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-dbcf1788-7cf6-41b4-b52c-6f98c9584863 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65fc7792249b4daca6a39f7259d2236c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3661cd206d19455eb1c4ac3dd988a67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:07.470119 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-dbcf1788-7cf6-41b4-b52c-6f98c9584863 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65fc7792249b4daca6a39f7259d2236c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3661cd206d19455eb1c4ac3dd988a67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:07.471498 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-dbcf1788-7cf6-41b4-b52c-6f98c9584863 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] 10.222.0.58 "GET /compute/v2.1/servers/364415e0-931a-4be4-8149-86eb03e99544" status: 200 len: 1357 microversion: 2.47 time: 0.128144 Aug 10 23:20:07.478234 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2468/4749] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:20:07 2022] GET /compute/v2.1/servers/364415e0-931a-4be4-8149-86eb03e99544 => generated 1357 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:20:07.497938 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-836413c8-5f32-4b5a-a099-70f888888834 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:20:07.500789 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-836413c8-5f32-4b5a-a099-70f888888834 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] [instance: 364415e0-931a-4be4-8149-86eb03e99544] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:07.510458 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-836413c8-5f32-4b5a-a099-70f888888834 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:07.511577 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-836413c8-5f32-4b5a-a099-70f888888834 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:07.512331 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-836413c8-5f32-4b5a-a099-70f888888834 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:07.513310 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-836413c8-5f32-4b5a-a099-70f888888834 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:07.513775 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-836413c8-5f32-4b5a-a099-70f888888834 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:07.514223 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-836413c8-5f32-4b5a-a099-70f888888834 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:07.612160 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=1,nova_api:INSERT=6 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:20:07.616991 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-836413c8-5f32-4b5a-a099-70f888888834 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Flavor limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:20:07.617424 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-836413c8-5f32-4b5a-a099-70f888888834 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Image limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:20:07.617899 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-836413c8-5f32-4b5a-a099-70f888888834 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Flavor pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:20:07.618307 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-836413c8-5f32-4b5a-a099-70f888888834 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Image pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:20:07.618819 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-836413c8-5f32-4b5a-a099-70f888888834 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:20:07.686023 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-836413c8-5f32-4b5a-a099-70f888888834 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] [instance: 364415e0-931a-4be4-8149-86eb03e99544] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:07.694397 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-836413c8-5f32-4b5a-a099-70f888888834 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:07.694930 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-836413c8-5f32-4b5a-a099-70f888888834 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:07.695383 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-836413c8-5f32-4b5a-a099-70f888888834 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:07.696109 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-836413c8-5f32-4b5a-a099-70f888888834 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:07.696571 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-836413c8-5f32-4b5a-a099-70f888888834 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:07.697003 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-836413c8-5f32-4b5a-a099-70f888888834 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:07.709833 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-61bcb037-0a08-4041-bdd8-f4f24a30c2f7 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:07.710919 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-61bcb037-0a08-4041-bdd8-f4f24a30c2f7 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: 53003fff-46d7-4621-93fb-c2751572bb90] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:07.717964 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-61bcb037-0a08-4041-bdd8-f4f24a30c2f7 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:07.719612 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-61bcb037-0a08-4041-bdd8-f4f24a30c2f7 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:07.720314 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-61bcb037-0a08-4041-bdd8-f4f24a30c2f7 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:07.721272 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-61bcb037-0a08-4041-bdd8-f4f24a30c2f7 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:07.722020 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-61bcb037-0a08-4041-bdd8-f4f24a30c2f7 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:07.722701 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-61bcb037-0a08-4041-bdd8-f4f24a30c2f7 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:07.759918 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-836413c8-5f32-4b5a-a099-70f888888834 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] 10.222.0.58 "POST /compute/v2.1/servers/364415e0-931a-4be4-8149-86eb03e99544/action" status: 202 len: 1079 microversion: 2.47 time: 0.265912 Aug 10 23:20:07.761770 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2282/4750] 10.222.0.58 () {62 vars in 1319 bytes} [Wed Aug 10 23:20:07 2022] POST /compute/v2.1/servers/364415e0-931a-4be4-8149-86eb03e99544/action => generated 1079 bytes in 269 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 10 23:20:07.781271 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-43a96473-0dda-40ae-a5a6-561fd8d2c9dc tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:07.781909 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-43a96473-0dda-40ae-a5a6-561fd8d2c9dc tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] [instance: 364415e0-931a-4be4-8149-86eb03e99544] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:07.790770 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-43a96473-0dda-40ae-a5a6-561fd8d2c9dc tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:07.791674 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-43a96473-0dda-40ae-a5a6-561fd8d2c9dc tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:07.792288 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-43a96473-0dda-40ae-a5a6-561fd8d2c9dc tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:07.793223 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-43a96473-0dda-40ae-a5a6-561fd8d2c9dc tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:07.793849 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-43a96473-0dda-40ae-a5a6-561fd8d2c9dc tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:07.794444 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-43a96473-0dda-40ae-a5a6-561fd8d2c9dc tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:07.888913 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-43a96473-0dda-40ae-a5a6-561fd8d2c9dc tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65fc7792249b4daca6a39f7259d2236c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3661cd206d19455eb1c4ac3dd988a67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:07.898712 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-43a96473-0dda-40ae-a5a6-561fd8d2c9dc tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65fc7792249b4daca6a39f7259d2236c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3661cd206d19455eb1c4ac3dd988a67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:07.900359 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-43a96473-0dda-40ae-a5a6-561fd8d2c9dc tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65fc7792249b4daca6a39f7259d2236c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3661cd206d19455eb1c4ac3dd988a67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:07.901660 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-43a96473-0dda-40ae-a5a6-561fd8d2c9dc tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] 10.222.0.58 "GET /compute/v2.1/servers/364415e0-931a-4be4-8149-86eb03e99544" status: 200 len: 1366 microversion: 2.47 time: 0.124812 Aug 10 23:20:07.902319 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2283/4751] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:20:07 2022] GET /compute/v2.1/servers/364415e0-931a-4be4-8149-86eb03e99544 => generated 1366 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 23:20:07.928872 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-61bcb037-0a08-4041-bdd8-f4f24a30c2f7 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6684f0c87e4242be9e0ffb4ef1973f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0582ace9e4443b8ad88915503ee630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:07.932915 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:20:07.938447 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-61bcb037-0a08-4041-bdd8-f4f24a30c2f7 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "GET /compute/v2.1/servers/53003fff-46d7-4621-93fb-c2751572bb90" status: 200 len: 1309 microversion: 2.1 time: 0.234333 Aug 10 23:20:07.939443 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2469/4752] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:20:07 2022] GET /compute/v2.1/servers/53003fff-46d7-4621-93fb-c2751572bb90 => generated 1309 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:20:08.146976 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-e5223271-30f5-485e-9b9b-344eafe1b75c tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:08.147485 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-e5223271-30f5-485e-9b9b-344eafe1b75c tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] [instance: 69c4b403-a8ad-449c-a577-63837a6d2445] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:08.156490 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e5223271-30f5-485e-9b9b-344eafe1b75c tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:08.156985 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e5223271-30f5-485e-9b9b-344eafe1b75c tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:08.157423 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e5223271-30f5-485e-9b9b-344eafe1b75c tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:08.158155 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e5223271-30f5-485e-9b9b-344eafe1b75c tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:08.159200 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e5223271-30f5-485e-9b9b-344eafe1b75c tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:08.159742 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e5223271-30f5-485e-9b9b-344eafe1b75c tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:08.471412 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-e5223271-30f5-485e-9b9b-344eafe1b75c tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5899b2ad9f1046caaf7c6073e408eeee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25abd63376614081a9d484f3c9ae950d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:08.477173 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:20:08.495941 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-e5223271-30f5-485e-9b9b-344eafe1b75c tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "GET /compute/v2.1/servers/69c4b403-a8ad-449c-a577-63837a6d2445" status: 200 len: 1694 microversion: 2.1 time: 0.353868 Aug 10 23:20:08.496764 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2284/4753] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:20:08 2022] GET /compute/v2.1/servers/69c4b403-a8ad-449c-a577-63837a6d2445 => generated 1694 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:20:08.927515 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-bf427358-f6e8-4a70-9a9f-713a1db7895d tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:08.928553 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-bf427358-f6e8-4a70-9a9f-713a1db7895d tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] [instance: 364415e0-931a-4be4-8149-86eb03e99544] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:08.943257 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bf427358-f6e8-4a70-9a9f-713a1db7895d tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:08.944122 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bf427358-f6e8-4a70-9a9f-713a1db7895d tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:08.953419 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bf427358-f6e8-4a70-9a9f-713a1db7895d tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:08.956375 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bf427358-f6e8-4a70-9a9f-713a1db7895d tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:08.957484 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bf427358-f6e8-4a70-9a9f-713a1db7895d tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:08.959420 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bf427358-f6e8-4a70-9a9f-713a1db7895d tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:08.961909 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-95fc8769-25a9-4623-8f58-1a1c9dedaf55 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:08.963254 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-95fc8769-25a9-4623-8f58-1a1c9dedaf55 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: 53003fff-46d7-4621-93fb-c2751572bb90] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:08.982993 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-95fc8769-25a9-4623-8f58-1a1c9dedaf55 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:08.983845 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-95fc8769-25a9-4623-8f58-1a1c9dedaf55 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:08.984458 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-95fc8769-25a9-4623-8f58-1a1c9dedaf55 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:08.985369 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-95fc8769-25a9-4623-8f58-1a1c9dedaf55 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:08.985988 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-95fc8769-25a9-4623-8f58-1a1c9dedaf55 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:08.986576 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-95fc8769-25a9-4623-8f58-1a1c9dedaf55 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:09.197431 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-bf427358-f6e8-4a70-9a9f-713a1db7895d tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65fc7792249b4daca6a39f7259d2236c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3661cd206d19455eb1c4ac3dd988a67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:09.223129 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-bf427358-f6e8-4a70-9a9f-713a1db7895d tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65fc7792249b4daca6a39f7259d2236c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3661cd206d19455eb1c4ac3dd988a67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:09.225303 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-bf427358-f6e8-4a70-9a9f-713a1db7895d tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65fc7792249b4daca6a39f7259d2236c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3661cd206d19455eb1c4ac3dd988a67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:09.227705 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-bf427358-f6e8-4a70-9a9f-713a1db7895d tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] 10.222.0.58 "GET /compute/v2.1/servers/364415e0-931a-4be4-8149-86eb03e99544" status: 200 len: 1366 microversion: 2.47 time: 0.305850 Aug 10 23:20:09.230389 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2470/4754] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:20:08 2022] GET /compute/v2.1/servers/364415e0-931a-4be4-8149-86eb03e99544 => generated 1366 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:20:09.389139 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-95fc8769-25a9-4623-8f58-1a1c9dedaf55 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6684f0c87e4242be9e0ffb4ef1973f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0582ace9e4443b8ad88915503ee630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:09.401382 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-95fc8769-25a9-4623-8f58-1a1c9dedaf55 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "GET /compute/v2.1/servers/53003fff-46d7-4621-93fb-c2751572bb90" status: 200 len: 1309 microversion: 2.1 time: 0.444350 Aug 10 23:20:09.420564 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2285/4755] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:20:08 2022] GET /compute/v2.1/servers/53003fff-46d7-4621-93fb-c2751572bb90 => generated 1309 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:20:09.526476 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-72da828a-6c12-4702-a015-11c6bfde05a1 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:09.527827 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-72da828a-6c12-4702-a015-11c6bfde05a1 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] [instance: 69c4b403-a8ad-449c-a577-63837a6d2445] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:09.549613 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-72da828a-6c12-4702-a015-11c6bfde05a1 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:09.554515 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-72da828a-6c12-4702-a015-11c6bfde05a1 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:09.557297 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-72da828a-6c12-4702-a015-11c6bfde05a1 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:09.558529 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-72da828a-6c12-4702-a015-11c6bfde05a1 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:09.559216 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-72da828a-6c12-4702-a015-11c6bfde05a1 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:09.562872 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-72da828a-6c12-4702-a015-11c6bfde05a1 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:10.031614 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-72da828a-6c12-4702-a015-11c6bfde05a1 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5899b2ad9f1046caaf7c6073e408eeee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25abd63376614081a9d484f3c9ae950d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:10.043417 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-72da828a-6c12-4702-a015-11c6bfde05a1 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "GET /compute/v2.1/servers/69c4b403-a8ad-449c-a577-63837a6d2445" status: 200 len: 1694 microversion: 2.1 time: 0.525777 Aug 10 23:20:10.044517 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2471/4756] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:20:09 2022] GET /compute/v2.1/servers/69c4b403-a8ad-449c-a577-63837a6d2445 => generated 1694 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:20:10.253995 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c2bd415a-26d6-493a-9693-61655fd07225 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:10.255110 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-c2bd415a-26d6-493a-9693-61655fd07225 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] [instance: 364415e0-931a-4be4-8149-86eb03e99544] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:10.268410 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c2bd415a-26d6-493a-9693-61655fd07225 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:10.268917 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c2bd415a-26d6-493a-9693-61655fd07225 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:10.269364 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c2bd415a-26d6-493a-9693-61655fd07225 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:10.270157 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c2bd415a-26d6-493a-9693-61655fd07225 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:10.270643 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c2bd415a-26d6-493a-9693-61655fd07225 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:10.271087 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c2bd415a-26d6-493a-9693-61655fd07225 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:10.408388 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-c2bd415a-26d6-493a-9693-61655fd07225 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65fc7792249b4daca6a39f7259d2236c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3661cd206d19455eb1c4ac3dd988a67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:10.422982 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-c2bd415a-26d6-493a-9693-61655fd07225 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65fc7792249b4daca6a39f7259d2236c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3661cd206d19455eb1c4ac3dd988a67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:10.425673 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-c2bd415a-26d6-493a-9693-61655fd07225 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65fc7792249b4daca6a39f7259d2236c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3661cd206d19455eb1c4ac3dd988a67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:10.428623 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-c2bd415a-26d6-493a-9693-61655fd07225 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] 10.222.0.58 "GET /compute/v2.1/servers/364415e0-931a-4be4-8149-86eb03e99544" status: 200 len: 1366 microversion: 2.47 time: 0.179346 Aug 10 23:20:10.428937 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-1363d75b-2f0a-49c4-a4c5-2da55ee7dac9 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:10.429711 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-1363d75b-2f0a-49c4-a4c5-2da55ee7dac9 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: 53003fff-46d7-4621-93fb-c2751572bb90] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:10.430373 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2286/4757] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:20:10 2022] GET /compute/v2.1/servers/364415e0-931a-4be4-8149-86eb03e99544 => generated 1366 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:20:10.452334 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1363d75b-2f0a-49c4-a4c5-2da55ee7dac9 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:10.453150 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1363d75b-2f0a-49c4-a4c5-2da55ee7dac9 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:10.453790 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1363d75b-2f0a-49c4-a4c5-2da55ee7dac9 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:10.454703 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1363d75b-2f0a-49c4-a4c5-2da55ee7dac9 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:10.455410 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1363d75b-2f0a-49c4-a4c5-2da55ee7dac9 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:10.455899 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1363d75b-2f0a-49c4-a4c5-2da55ee7dac9 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:10.883858 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-1363d75b-2f0a-49c4-a4c5-2da55ee7dac9 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6684f0c87e4242be9e0ffb4ef1973f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0582ace9e4443b8ad88915503ee630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:10.897694 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-1363d75b-2f0a-49c4-a4c5-2da55ee7dac9 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "GET /compute/v2.1/servers/53003fff-46d7-4621-93fb-c2751572bb90" status: 200 len: 1309 microversion: 2.1 time: 0.473921 Aug 10 23:20:10.899208 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2472/4758] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:20:10 2022] GET /compute/v2.1/servers/53003fff-46d7-4621-93fb-c2751572bb90 => generated 1309 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:20:11.070689 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-92a5ffbf-f8e8-45a7-8552-f33e90808bf7 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:11.071356 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-92a5ffbf-f8e8-45a7-8552-f33e90808bf7 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] [instance: 69c4b403-a8ad-449c-a577-63837a6d2445] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:11.100705 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-92a5ffbf-f8e8-45a7-8552-f33e90808bf7 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:11.101668 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-92a5ffbf-f8e8-45a7-8552-f33e90808bf7 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:11.102482 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-92a5ffbf-f8e8-45a7-8552-f33e90808bf7 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:11.103659 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-92a5ffbf-f8e8-45a7-8552-f33e90808bf7 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:11.104441 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-92a5ffbf-f8e8-45a7-8552-f33e90808bf7 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:11.105211 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-92a5ffbf-f8e8-45a7-8552-f33e90808bf7 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:11.251759 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=4 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:20:11.457638 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-1aa7df48-1be8-4ef8-a394-9bfc53506cf7 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:11.458916 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-1aa7df48-1be8-4ef8-a394-9bfc53506cf7 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] [instance: 364415e0-931a-4be4-8149-86eb03e99544] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:11.467704 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1aa7df48-1be8-4ef8-a394-9bfc53506cf7 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:11.468291 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1aa7df48-1be8-4ef8-a394-9bfc53506cf7 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:11.468848 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1aa7df48-1be8-4ef8-a394-9bfc53506cf7 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:11.469695 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1aa7df48-1be8-4ef8-a394-9bfc53506cf7 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:11.470488 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1aa7df48-1be8-4ef8-a394-9bfc53506cf7 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:11.471171 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1aa7df48-1be8-4ef8-a394-9bfc53506cf7 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:11.561228 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-1aa7df48-1be8-4ef8-a394-9bfc53506cf7 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65fc7792249b4daca6a39f7259d2236c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3661cd206d19455eb1c4ac3dd988a67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:11.572768 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-1aa7df48-1be8-4ef8-a394-9bfc53506cf7 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65fc7792249b4daca6a39f7259d2236c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3661cd206d19455eb1c4ac3dd988a67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:11.574390 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-1aa7df48-1be8-4ef8-a394-9bfc53506cf7 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65fc7792249b4daca6a39f7259d2236c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3661cd206d19455eb1c4ac3dd988a67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:11.575805 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-1aa7df48-1be8-4ef8-a394-9bfc53506cf7 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] 10.222.0.58 "GET /compute/v2.1/servers/364415e0-931a-4be4-8149-86eb03e99544" status: 200 len: 1366 microversion: 2.47 time: 0.124765 Aug 10 23:20:11.576453 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2473/4759] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:20:11 2022] GET /compute/v2.1/servers/364415e0-931a-4be4-8149-86eb03e99544 => generated 1366 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 23:20:11.605771 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-92a5ffbf-f8e8-45a7-8552-f33e90808bf7 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5899b2ad9f1046caaf7c6073e408eeee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25abd63376614081a9d484f3c9ae950d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:11.615546 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-92a5ffbf-f8e8-45a7-8552-f33e90808bf7 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "GET /compute/v2.1/servers/69c4b403-a8ad-449c-a577-63837a6d2445" status: 200 len: 1694 microversion: 2.1 time: 0.549456 Aug 10 23:20:11.617332 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2287/4760] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:20:11 2022] GET /compute/v2.1/servers/69c4b403-a8ad-449c-a577-63837a6d2445 => generated 1694 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:20:11.920488 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-e9ae2913-08dd-4b2e-adb1-25c5d1cfc011 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:11.921440 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-e9ae2913-08dd-4b2e-adb1-25c5d1cfc011 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: 53003fff-46d7-4621-93fb-c2751572bb90] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:11.929177 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e9ae2913-08dd-4b2e-adb1-25c5d1cfc011 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:11.930085 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e9ae2913-08dd-4b2e-adb1-25c5d1cfc011 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:11.930772 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e9ae2913-08dd-4b2e-adb1-25c5d1cfc011 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:11.931901 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e9ae2913-08dd-4b2e-adb1-25c5d1cfc011 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:11.932577 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e9ae2913-08dd-4b2e-adb1-25c5d1cfc011 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:11.933095 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e9ae2913-08dd-4b2e-adb1-25c5d1cfc011 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:12.220470 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-e9ae2913-08dd-4b2e-adb1-25c5d1cfc011 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6684f0c87e4242be9e0ffb4ef1973f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0582ace9e4443b8ad88915503ee630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:12.246749 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-e9ae2913-08dd-4b2e-adb1-25c5d1cfc011 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "GET /compute/v2.1/servers/53003fff-46d7-4621-93fb-c2751572bb90" status: 200 len: 1309 microversion: 2.1 time: 0.331181 Aug 10 23:20:12.267152 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2474/4761] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:20:11 2022] GET /compute/v2.1/servers/53003fff-46d7-4621-93fb-c2751572bb90 => generated 1309 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:20:12.588405 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-fb9e303c-dcfa-4d5b-ab80-4566f2fc5e13 req-83da2a8f-8b51-475f-954e-92ad0b5f3b6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53003fff-46d7-4621-93fb-c2751572bb90", "name": "network-vif-plugged", "status": "completed", "tag": "f5b14e4f-573b-48b3-a4b6-d1786c62a70e"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:20:12.603892 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-d1683dc2-6afa-4f3f-b7b4-e9627784c91c tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:12.604473 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-d1683dc2-6afa-4f3f-b7b4-e9627784c91c tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] [instance: 364415e0-931a-4be4-8149-86eb03e99544] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:12.610329 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-fb9e303c-dcfa-4d5b-ab80-4566f2fc5e13 req-83da2a8f-8b51-475f-954e-92ad0b5f3b6d service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:12.610952 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-fb9e303c-dcfa-4d5b-ab80-4566f2fc5e13 req-83da2a8f-8b51-475f-954e-92ad0b5f3b6d service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:12.612904 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-fb9e303c-dcfa-4d5b-ab80-4566f2fc5e13 req-83da2a8f-8b51-475f-954e-92ad0b5f3b6d service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:12.616035 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=2 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:20:12.623638 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=6 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:20:12.627686 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d1683dc2-6afa-4f3f-b7b4-e9627784c91c tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:12.628198 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d1683dc2-6afa-4f3f-b7b4-e9627784c91c tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:12.630887 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d1683dc2-6afa-4f3f-b7b4-e9627784c91c tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:12.631596 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d1683dc2-6afa-4f3f-b7b4-e9627784c91c tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:12.632071 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d1683dc2-6afa-4f3f-b7b4-e9627784c91c tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:12.634006 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d1683dc2-6afa-4f3f-b7b4-e9627784c91c tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:12.640427 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-fb9e303c-dcfa-4d5b-ab80-4566f2fc5e13 req-83da2a8f-8b51-475f-954e-92ad0b5f3b6d service nova] Creating event network-vif-plugged:f5b14e4f-573b-48b3-a4b6-d1786c62a70e for instance 53003fff-46d7-4621-93fb-c2751572bb90 on n-h2-850468-14 Aug 10 23:20:12.659881 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-fb9e303c-dcfa-4d5b-ab80-4566f2fc5e13 req-83da2a8f-8b51-475f-954e-92ad0b5f3b6d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077383 Aug 10 23:20:12.669539 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2288/4762] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:20:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 23:20:12.675716 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-a292df2f-9c02-4ec6-94ef-1a74529810b0 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:12.677225 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-a292df2f-9c02-4ec6-94ef-1a74529810b0 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] [instance: 69c4b403-a8ad-449c-a577-63837a6d2445] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:12.694989 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a292df2f-9c02-4ec6-94ef-1a74529810b0 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:12.696690 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a292df2f-9c02-4ec6-94ef-1a74529810b0 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:12.697329 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a292df2f-9c02-4ec6-94ef-1a74529810b0 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:12.702701 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a292df2f-9c02-4ec6-94ef-1a74529810b0 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:12.703676 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a292df2f-9c02-4ec6-94ef-1a74529810b0 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:12.704972 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a292df2f-9c02-4ec6-94ef-1a74529810b0 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:12.927148 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-d1683dc2-6afa-4f3f-b7b4-e9627784c91c tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65fc7792249b4daca6a39f7259d2236c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3661cd206d19455eb1c4ac3dd988a67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:12.942595 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-d1683dc2-6afa-4f3f-b7b4-e9627784c91c tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65fc7792249b4daca6a39f7259d2236c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3661cd206d19455eb1c4ac3dd988a67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:12.944998 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-d1683dc2-6afa-4f3f-b7b4-e9627784c91c tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65fc7792249b4daca6a39f7259d2236c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3661cd206d19455eb1c4ac3dd988a67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:12.946932 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-d1683dc2-6afa-4f3f-b7b4-e9627784c91c tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] 10.222.0.58 "GET /compute/v2.1/servers/364415e0-931a-4be4-8149-86eb03e99544" status: 200 len: 1366 microversion: 2.47 time: 0.349877 Aug 10 23:20:12.948754 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2475/4763] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:20:12 2022] GET /compute/v2.1/servers/364415e0-931a-4be4-8149-86eb03e99544 => generated 1366 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:20:13.077177 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-a292df2f-9c02-4ec6-94ef-1a74529810b0 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5899b2ad9f1046caaf7c6073e408eeee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25abd63376614081a9d484f3c9ae950d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:13.096376 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-a292df2f-9c02-4ec6-94ef-1a74529810b0 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "GET /compute/v2.1/servers/69c4b403-a8ad-449c-a577-63837a6d2445" status: 200 len: 1694 microversion: 2.1 time: 0.424474 Aug 10 23:20:13.118906 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2289/4764] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:20:12 2022] GET /compute/v2.1/servers/69c4b403-a8ad-449c-a577-63837a6d2445 => generated 1694 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:20:13.274590 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-a47a5ea1-0618-483f-b06d-ded1200cf1e0 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:13.275280 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-a47a5ea1-0618-483f-b06d-ded1200cf1e0 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: 53003fff-46d7-4621-93fb-c2751572bb90] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:13.287032 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a47a5ea1-0618-483f-b06d-ded1200cf1e0 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:13.288021 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a47a5ea1-0618-483f-b06d-ded1200cf1e0 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:13.288986 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a47a5ea1-0618-483f-b06d-ded1200cf1e0 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:13.295009 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a47a5ea1-0618-483f-b06d-ded1200cf1e0 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:13.296170 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a47a5ea1-0618-483f-b06d-ded1200cf1e0 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:13.296782 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a47a5ea1-0618-483f-b06d-ded1200cf1e0 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:13.524155 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-a47a5ea1-0618-483f-b06d-ded1200cf1e0 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6684f0c87e4242be9e0ffb4ef1973f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0582ace9e4443b8ad88915503ee630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:13.536682 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-a47a5ea1-0618-483f-b06d-ded1200cf1e0 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "GET /compute/v2.1/servers/53003fff-46d7-4621-93fb-c2751572bb90" status: 200 len: 1309 microversion: 2.1 time: 0.265363 Aug 10 23:20:13.541287 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2476/4765] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:20:13 2022] GET /compute/v2.1/servers/53003fff-46d7-4621-93fb-c2751572bb90 => generated 1309 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:20:13.986590 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-bf6be807-1645-4290-b62a-b1034b322aa5 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:13.988459 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-bf6be807-1645-4290-b62a-b1034b322aa5 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] [instance: 364415e0-931a-4be4-8149-86eb03e99544] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:13.993247 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=16 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:20:14.005377 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bf6be807-1645-4290-b62a-b1034b322aa5 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:14.006419 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bf6be807-1645-4290-b62a-b1034b322aa5 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:14.007562 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bf6be807-1645-4290-b62a-b1034b322aa5 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:14.008753 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bf6be807-1645-4290-b62a-b1034b322aa5 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:14.009770 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bf6be807-1645-4290-b62a-b1034b322aa5 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:14.011116 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bf6be807-1645-4290-b62a-b1034b322aa5 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:14.131234 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-314bbc25-be40-40c4-b8cd-3bd7875a2066 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:14.134039 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-314bbc25-be40-40c4-b8cd-3bd7875a2066 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] [instance: 69c4b403-a8ad-449c-a577-63837a6d2445] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:14.171666 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-bf6be807-1645-4290-b62a-b1034b322aa5 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65fc7792249b4daca6a39f7259d2236c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3661cd206d19455eb1c4ac3dd988a67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:14.175365 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-314bbc25-be40-40c4-b8cd-3bd7875a2066 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:14.179121 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-314bbc25-be40-40c4-b8cd-3bd7875a2066 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:14.181425 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-314bbc25-be40-40c4-b8cd-3bd7875a2066 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:14.182957 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-314bbc25-be40-40c4-b8cd-3bd7875a2066 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:14.185013 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-314bbc25-be40-40c4-b8cd-3bd7875a2066 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:14.185944 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-314bbc25-be40-40c4-b8cd-3bd7875a2066 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:14.194629 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-bf6be807-1645-4290-b62a-b1034b322aa5 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65fc7792249b4daca6a39f7259d2236c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3661cd206d19455eb1c4ac3dd988a67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:14.208542 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-bf6be807-1645-4290-b62a-b1034b322aa5 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65fc7792249b4daca6a39f7259d2236c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3661cd206d19455eb1c4ac3dd988a67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:14.212391 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-bf6be807-1645-4290-b62a-b1034b322aa5 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] 10.222.0.58 "GET /compute/v2.1/servers/364415e0-931a-4be4-8149-86eb03e99544" status: 200 len: 1366 microversion: 2.47 time: 0.240067 Aug 10 23:20:14.215602 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2290/4766] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:20:13 2022] GET /compute/v2.1/servers/364415e0-931a-4be4-8149-86eb03e99544 => generated 1366 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:20:14.567761 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-5df052ab-df9c-4331-9f01-9b7c872a2311 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:14.569626 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-5df052ab-df9c-4331-9f01-9b7c872a2311 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: 53003fff-46d7-4621-93fb-c2751572bb90] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:14.604083 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5df052ab-df9c-4331-9f01-9b7c872a2311 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:14.604680 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5df052ab-df9c-4331-9f01-9b7c872a2311 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:14.606825 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5df052ab-df9c-4331-9f01-9b7c872a2311 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:14.607625 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5df052ab-df9c-4331-9f01-9b7c872a2311 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:14.608567 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5df052ab-df9c-4331-9f01-9b7c872a2311 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:14.615808 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5df052ab-df9c-4331-9f01-9b7c872a2311 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:14.736968 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-314bbc25-be40-40c4-b8cd-3bd7875a2066 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5899b2ad9f1046caaf7c6073e408eeee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25abd63376614081a9d484f3c9ae950d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:14.749987 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-314bbc25-be40-40c4-b8cd-3bd7875a2066 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "GET /compute/v2.1/servers/69c4b403-a8ad-449c-a577-63837a6d2445" status: 200 len: 1684 microversion: 2.1 time: 0.631898 Aug 10 23:20:14.751488 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2477/4767] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:20:14 2022] GET /compute/v2.1/servers/69c4b403-a8ad-449c-a577-63837a6d2445 => generated 1684 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:20:14.777982 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-58f86016-135c-487e-8291-b5d27cd90e85 tempest-TestNetworkAdvancedServerOps-1638906998 tempest-TestNetworkAdvancedServerOps-1638906998-project-admin] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:14.778774 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-58f86016-135c-487e-8291-b5d27cd90e85 tempest-TestNetworkAdvancedServerOps-1638906998 tempest-TestNetworkAdvancedServerOps-1638906998-project-admin] [instance: 69c4b403-a8ad-449c-a577-63837a6d2445] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:14.790528 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-58f86016-135c-487e-8291-b5d27cd90e85 tempest-TestNetworkAdvancedServerOps-1638906998 tempest-TestNetworkAdvancedServerOps-1638906998-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:14.791544 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-58f86016-135c-487e-8291-b5d27cd90e85 tempest-TestNetworkAdvancedServerOps-1638906998 tempest-TestNetworkAdvancedServerOps-1638906998-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:14.792245 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-58f86016-135c-487e-8291-b5d27cd90e85 tempest-TestNetworkAdvancedServerOps-1638906998 tempest-TestNetworkAdvancedServerOps-1638906998-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:14.793466 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-58f86016-135c-487e-8291-b5d27cd90e85 tempest-TestNetworkAdvancedServerOps-1638906998 tempest-TestNetworkAdvancedServerOps-1638906998-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:14.794143 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-58f86016-135c-487e-8291-b5d27cd90e85 tempest-TestNetworkAdvancedServerOps-1638906998 tempest-TestNetworkAdvancedServerOps-1638906998-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:14.794806 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-58f86016-135c-487e-8291-b5d27cd90e85 tempest-TestNetworkAdvancedServerOps-1638906998 tempest-TestNetworkAdvancedServerOps-1638906998-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:15.087992 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-5df052ab-df9c-4331-9f01-9b7c872a2311 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6684f0c87e4242be9e0ffb4ef1973f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0582ace9e4443b8ad88915503ee630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:15.100115 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-5df052ab-df9c-4331-9f01-9b7c872a2311 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "GET /compute/v2.1/servers/53003fff-46d7-4621-93fb-c2751572bb90" status: 200 len: 1489 microversion: 2.1 time: 0.544460 Aug 10 23:20:15.101038 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2291/4768] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:20:14 2022] GET /compute/v2.1/servers/53003fff-46d7-4621-93fb-c2751572bb90 => generated 1489 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:20:15.244199 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-b0733c85-f6ad-4364-a441-0854414d9dd3 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:15.245029 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-b0733c85-f6ad-4364-a441-0854414d9dd3 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] [instance: 364415e0-931a-4be4-8149-86eb03e99544] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:15.256742 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b0733c85-f6ad-4364-a441-0854414d9dd3 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:15.259287 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b0733c85-f6ad-4364-a441-0854414d9dd3 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:15.259782 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b0733c85-f6ad-4364-a441-0854414d9dd3 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:15.263573 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b0733c85-f6ad-4364-a441-0854414d9dd3 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:15.264680 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b0733c85-f6ad-4364-a441-0854414d9dd3 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:15.265856 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b0733c85-f6ad-4364-a441-0854414d9dd3 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:15.437723 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-b0733c85-f6ad-4364-a441-0854414d9dd3 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65fc7792249b4daca6a39f7259d2236c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3661cd206d19455eb1c4ac3dd988a67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:15.459362 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-b0733c85-f6ad-4364-a441-0854414d9dd3 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65fc7792249b4daca6a39f7259d2236c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3661cd206d19455eb1c4ac3dd988a67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:15.461972 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-b0733c85-f6ad-4364-a441-0854414d9dd3 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65fc7792249b4daca6a39f7259d2236c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3661cd206d19455eb1c4ac3dd988a67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:15.464070 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-b0733c85-f6ad-4364-a441-0854414d9dd3 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] 10.222.0.58 "GET /compute/v2.1/servers/364415e0-931a-4be4-8149-86eb03e99544" status: 200 len: 1366 microversion: 2.47 time: 0.226020 Aug 10 23:20:15.465301 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2292/4769] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:20:15 2022] GET /compute/v2.1/servers/364415e0-931a-4be4-8149-86eb03e99544 => generated 1366 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:20:15.479644 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c8c34dfa-7ed5-4d0b-8a25-6e8d1af8d7cf tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1525450872", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452", "networks": [{"uuid": "af9afbc6-0659-47e6-b542-cfe9f265fcc2"}]}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:20:15.509271 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-58f86016-135c-487e-8291-b5d27cd90e85 tempest-TestNetworkAdvancedServerOps-1638906998 tempest-TestNetworkAdvancedServerOps-1638906998-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/69c4b403-a8ad-449c-a577-63837a6d2445" status: 200 len: 1837 microversion: 2.1 time: 0.735811 Aug 10 23:20:15.510011 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2478/4770] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:20:14 2022] GET /compute/v2.1/servers/69c4b403-a8ad-449c-a577-63837a6d2445 => generated 1837 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:20:15.542402 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-36c148f4-8968-4065-90b1-1f5a58ec8876 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:15.543442 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-36c148f4-8968-4065-90b1-1f5a58ec8876 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] [instance: 69c4b403-a8ad-449c-a577-63837a6d2445] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:15.555871 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-36c148f4-8968-4065-90b1-1f5a58ec8876 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:15.559829 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-36c148f4-8968-4065-90b1-1f5a58ec8876 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:15.560657 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-36c148f4-8968-4065-90b1-1f5a58ec8876 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:15.561605 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-36c148f4-8968-4065-90b1-1f5a58ec8876 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:15.563812 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-36c148f4-8968-4065-90b1-1f5a58ec8876 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:15.564436 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-36c148f4-8968-4065-90b1-1f5a58ec8876 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:15.590035 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.network.neutron [None req-c8c34dfa-7ed5-4d0b-8a25-6e8d1af8d7cf tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] validate_networks() for [('af9afbc6-0659-47e6-b542-cfe9f265fcc2', None, None, None, None, None)] {{(pid=122632) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 23:20:15.799551 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-36c148f4-8968-4065-90b1-1f5a58ec8876 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5899b2ad9f1046caaf7c6073e408eeee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25abd63376614081a9d484f3c9ae950d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:15.812863 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-36c148f4-8968-4065-90b1-1f5a58ec8876 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "GET /compute/v2.1/servers/69c4b403-a8ad-449c-a577-63837a6d2445" status: 200 len: 1684 microversion: 2.1 time: 0.275389 Aug 10 23:20:15.813502 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2479/4771] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:20:15 2022] GET /compute/v2.1/servers/69c4b403-a8ad-449c-a577-63837a6d2445 => generated 1684 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:20:16.011730 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-552fa346-0950-4119-af8d-f054c53bc35d tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-1010643179", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452", "networks": [{"uuid": "5dab367c-5978-42d6-969f-07432ef1be8c"}]}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:20:16.076453 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.network.neutron [None req-552fa346-0950-4119-af8d-f054c53bc35d tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] validate_networks() for [('5dab367c-5978-42d6-969f-07432ef1be8c', None, None, None, None, None)] {{(pid=122633) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 23:20:16.315672 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-c8c34dfa-7ed5-4d0b-8a25-6e8d1af8d7cf tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Flavor limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:20:16.317615 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-c8c34dfa-7ed5-4d0b-8a25-6e8d1af8d7cf tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Image limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:20:16.319985 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-c8c34dfa-7ed5-4d0b-8a25-6e8d1af8d7cf tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Flavor pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:20:16.320745 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-c8c34dfa-7ed5-4d0b-8a25-6e8d1af8d7cf tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Image pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:20:16.322441 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-c8c34dfa-7ed5-4d0b-8a25-6e8d1af8d7cf tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:20:16.341436 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c8c34dfa-7ed5-4d0b-8a25-6e8d1af8d7cf tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:16.342369 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c8c34dfa-7ed5-4d0b-8a25-6e8d1af8d7cf tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:16.343632 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c8c34dfa-7ed5-4d0b-8a25-6e8d1af8d7cf tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:16.344619 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c8c34dfa-7ed5-4d0b-8a25-6e8d1af8d7cf tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:16.345303 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c8c34dfa-7ed5-4d0b-8a25-6e8d1af8d7cf tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:16.346232 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c8c34dfa-7ed5-4d0b-8a25-6e8d1af8d7cf tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:16.374191 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-c8c34dfa-7ed5-4d0b-8a25-6e8d1af8d7cf tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Getting quotas for project 0b0582ace9e4443b8ad88915503ee630. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:20:16.391613 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-c8c34dfa-7ed5-4d0b-8a25-6e8d1af8d7cf tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Getting quotas for user 6684f0c87e4242be9e0ffb4ef1973f96 and project 0b0582ace9e4443b8ad88915503ee630. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:20:16.414463 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-c8c34dfa-7ed5-4d0b-8a25-6e8d1af8d7cf tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Going to run 1 instances... {{(pid=122632) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 23:20:16.418626 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-c8c34dfa-7ed5-4d0b-8a25-6e8d1af8d7cf tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: 5ae8b5a0-e56c-4154-a487-080d996d54d3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78ad8905-f66f-4733-8be9-2b260f1fabed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122632) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 23:20:16.505986 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-c8c34dfa-7ed5-4d0b-8a25-6e8d1af8d7cf tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.036324 Aug 10 23:20:16.521453 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2293/4772] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 23:20:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 1051 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 23:20:16.524067 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-9ea87ff2-13d0-492f-84e9-8bf411a31a3d tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:20:16.526552 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-9ea87ff2-13d0-492f-84e9-8bf411a31a3d tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] [instance: 69c4b403-a8ad-449c-a577-63837a6d2445] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:16.545723 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9ea87ff2-13d0-492f-84e9-8bf411a31a3d tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:16.546451 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9ea87ff2-13d0-492f-84e9-8bf411a31a3d tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:16.546988 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9ea87ff2-13d0-492f-84e9-8bf411a31a3d tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:16.548369 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9ea87ff2-13d0-492f-84e9-8bf411a31a3d tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:16.549281 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9ea87ff2-13d0-492f-84e9-8bf411a31a3d tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:16.550181 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9ea87ff2-13d0-492f-84e9-8bf411a31a3d tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:16.623380 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-9ea87ff2-13d0-492f-84e9-8bf411a31a3d tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "POST /compute/v2.1/servers/69c4b403-a8ad-449c-a577-63837a6d2445/action" status: 200 len: 38622 microversion: 2.1 time: 0.104476 Aug 10 23:20:16.632237 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2294/4773] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:20:16 2022] POST /compute/v2.1/servers/69c4b403-a8ad-449c-a577-63837a6d2445/action => generated 38622 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 23:20:16.632237 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-0eb5a2f6-c9e3-4b96-80c9-da2c4d4ce1e5 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:16.634436 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-0eb5a2f6-c9e3-4b96-80c9-da2c4d4ce1e5 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] [instance: 364415e0-931a-4be4-8149-86eb03e99544] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:16.649929 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0eb5a2f6-c9e3-4b96-80c9-da2c4d4ce1e5 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:16.653447 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0eb5a2f6-c9e3-4b96-80c9-da2c4d4ce1e5 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:16.655055 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0eb5a2f6-c9e3-4b96-80c9-da2c4d4ce1e5 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:16.661669 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0eb5a2f6-c9e3-4b96-80c9-da2c4d4ce1e5 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:16.662944 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0eb5a2f6-c9e3-4b96-80c9-da2c4d4ce1e5 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:16.663591 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0eb5a2f6-c9e3-4b96-80c9-da2c4d4ce1e5 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:16.684884 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-552fa346-0950-4119-af8d-f054c53bc35d tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Flavor limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:20:16.685446 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-552fa346-0950-4119-af8d-f054c53bc35d tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Image limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:20:16.685768 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-552fa346-0950-4119-af8d-f054c53bc35d tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Flavor pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:20:16.686178 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-552fa346-0950-4119-af8d-f054c53bc35d tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Image pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:20:16.686595 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-552fa346-0950-4119-af8d-f054c53bc35d tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:20:16.712895 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-552fa346-0950-4119-af8d-f054c53bc35d tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:16.713393 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-552fa346-0950-4119-af8d-f054c53bc35d tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:16.713830 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-552fa346-0950-4119-af8d-f054c53bc35d tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:16.714576 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-552fa346-0950-4119-af8d-f054c53bc35d tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:16.715271 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-552fa346-0950-4119-af8d-f054c53bc35d tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:16.715831 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-552fa346-0950-4119-af8d-f054c53bc35d tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:16.786173 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-552fa346-0950-4119-af8d-f054c53bc35d tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Getting quotas for project e09d9809383a48d3915a3b6fd045fcdc. Resources: {'instances', 'cores', 'ram'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:20:16.802194 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-552fa346-0950-4119-af8d-f054c53bc35d tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Getting quotas for user ac0d39db7158452d8b9ab2a4eeec786e and project e09d9809383a48d3915a3b6fd045fcdc. Resources: {'instances', 'cores', 'ram'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:20:16.815506 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:20:16.842078 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-552fa346-0950-4119-af8d-f054c53bc35d tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Going to run 1 instances... {{(pid=122633) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 23:20:16.845714 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-552fa346-0950-4119-af8d-f054c53bc35d tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] [instance: ff959855-a396-4cce-9233-120a7d3f4cc9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78ad8905-f66f-4733-8be9-2b260f1fabed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122633) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 23:20:16.930647 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-552fa346-0950-4119-af8d-f054c53bc35d tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.105652 Aug 10 23:20:16.931647 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2480/4774] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 23:20:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 1112 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 23:20:16.945131 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-9a5fe309-f834-4e7e-885c-94bad3521876 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:16.945916 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-9a5fe309-f834-4e7e-885c-94bad3521876 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: 5ae8b5a0-e56c-4154-a487-080d996d54d3] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:17.047522 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-9a5fe309-f834-4e7e-885c-94bad3521876 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6684f0c87e4242be9e0ffb4ef1973f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0582ace9e4443b8ad88915503ee630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:17.056354 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-9a5fe309-f834-4e7e-885c-94bad3521876 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "GET /compute/v2.1/servers/5ae8b5a0-e56c-4154-a487-080d996d54d3" status: 200 len: 1209 microversion: 2.1 time: 0.123465 Aug 10 23:20:17.072321 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-0eb5a2f6-c9e3-4b96-80c9-da2c4d4ce1e5 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65fc7792249b4daca6a39f7259d2236c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3661cd206d19455eb1c4ac3dd988a67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:17.074447 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2481/4775] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:20:16 2022] GET /compute/v2.1/servers/5ae8b5a0-e56c-4154-a487-080d996d54d3 => generated 1209 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:20:17.085243 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-65ef8f41-b7e9-44c5-b5eb-f6c17b6a1802 tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:17.088342 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-65ef8f41-b7e9-44c5-b5eb-f6c17b6a1802 tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] [instance: ff959855-a396-4cce-9233-120a7d3f4cc9] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:17.088918 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-0eb5a2f6-c9e3-4b96-80c9-da2c4d4ce1e5 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65fc7792249b4daca6a39f7259d2236c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3661cd206d19455eb1c4ac3dd988a67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:17.090997 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-0eb5a2f6-c9e3-4b96-80c9-da2c4d4ce1e5 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65fc7792249b4daca6a39f7259d2236c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3661cd206d19455eb1c4ac3dd988a67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:17.093348 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-0eb5a2f6-c9e3-4b96-80c9-da2c4d4ce1e5 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] 10.222.0.58 "GET /compute/v2.1/servers/364415e0-931a-4be4-8149-86eb03e99544" status: 200 len: 1366 microversion: 2.47 time: 0.467857 Aug 10 23:20:17.094151 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2295/4776] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:20:16 2022] GET /compute/v2.1/servers/364415e0-931a-4be4-8149-86eb03e99544 => generated 1366 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:20:17.217228 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-65ef8f41-b7e9-44c5-b5eb-f6c17b6a1802 tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0d39db7158452d8b9ab2a4eeec786e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09d9809383a48d3915a3b6fd045fcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:17.227320 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-65ef8f41-b7e9-44c5-b5eb-f6c17b6a1802 tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] 10.222.0.58 "GET /compute/v2.1/servers/ff959855-a396-4cce-9233-120a7d3f4cc9" status: 200 len: 1225 microversion: 2.1 time: 0.149996 Aug 10 23:20:17.231013 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2482/4777] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:20:17 2022] GET /compute/v2.1/servers/ff959855-a396-4cce-9233-120a7d3f4cc9 => generated 1225 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:20:18.080538 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-a6dcee31-f73d-4cd1-b44b-6639ee5281c9 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:18.081156 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-a6dcee31-f73d-4cd1-b44b-6639ee5281c9 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: 5ae8b5a0-e56c-4154-a487-080d996d54d3] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:18.098137 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a6dcee31-f73d-4cd1-b44b-6639ee5281c9 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:18.101798 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a6dcee31-f73d-4cd1-b44b-6639ee5281c9 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:18.102496 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a6dcee31-f73d-4cd1-b44b-6639ee5281c9 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:18.103867 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a6dcee31-f73d-4cd1-b44b-6639ee5281c9 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:18.106950 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a6dcee31-f73d-4cd1-b44b-6639ee5281c9 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:18.107678 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a6dcee31-f73d-4cd1-b44b-6639ee5281c9 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:18.117003 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c77bda2e-98db-4b49-aff2-3334ad59503b tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:18.118446 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-c77bda2e-98db-4b49-aff2-3334ad59503b tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] [instance: 364415e0-931a-4be4-8149-86eb03e99544] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:18.135383 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c77bda2e-98db-4b49-aff2-3334ad59503b tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:18.136180 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c77bda2e-98db-4b49-aff2-3334ad59503b tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:18.136799 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c77bda2e-98db-4b49-aff2-3334ad59503b tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:18.137743 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c77bda2e-98db-4b49-aff2-3334ad59503b tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:18.138624 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c77bda2e-98db-4b49-aff2-3334ad59503b tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:18.139278 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c77bda2e-98db-4b49-aff2-3334ad59503b tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:18.323206 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-c77bda2e-98db-4b49-aff2-3334ad59503b tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65fc7792249b4daca6a39f7259d2236c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3661cd206d19455eb1c4ac3dd988a67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:18.337624 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-c77bda2e-98db-4b49-aff2-3334ad59503b tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65fc7792249b4daca6a39f7259d2236c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3661cd206d19455eb1c4ac3dd988a67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:18.339263 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-c77bda2e-98db-4b49-aff2-3334ad59503b tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65fc7792249b4daca6a39f7259d2236c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3661cd206d19455eb1c4ac3dd988a67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:18.340504 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-c77bda2e-98db-4b49-aff2-3334ad59503b tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] 10.222.0.58 "GET /compute/v2.1/servers/364415e0-931a-4be4-8149-86eb03e99544" status: 200 len: 1366 microversion: 2.47 time: 0.228260 Aug 10 23:20:18.352832 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2483/4778] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:20:18 2022] GET /compute/v2.1/servers/364415e0-931a-4be4-8149-86eb03e99544 => generated 1366 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 23:20:18.358932 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-a6dcee31-f73d-4cd1-b44b-6639ee5281c9 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6684f0c87e4242be9e0ffb4ef1973f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0582ace9e4443b8ad88915503ee630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:18.365998 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-d411f674-67c8-40a8-9c99-1119e52f5a99 tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:18.368550 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-d411f674-67c8-40a8-9c99-1119e52f5a99 tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] [instance: ff959855-a396-4cce-9233-120a7d3f4cc9] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:18.376093 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-a6dcee31-f73d-4cd1-b44b-6639ee5281c9 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "GET /compute/v2.1/servers/5ae8b5a0-e56c-4154-a487-080d996d54d3" status: 200 len: 1261 microversion: 2.1 time: 0.301069 Aug 10 23:20:18.382404 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d411f674-67c8-40a8-9c99-1119e52f5a99 tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:18.387315 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d411f674-67c8-40a8-9c99-1119e52f5a99 tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:18.388087 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d411f674-67c8-40a8-9c99-1119e52f5a99 tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:18.389240 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d411f674-67c8-40a8-9c99-1119e52f5a99 tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:18.389917 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d411f674-67c8-40a8-9c99-1119e52f5a99 tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:18.390466 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2296/4779] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:20:18 2022] GET /compute/v2.1/servers/5ae8b5a0-e56c-4154-a487-080d996d54d3 => generated 1261 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:20:18.390841 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d411f674-67c8-40a8-9c99-1119e52f5a99 tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:18.539113 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-d411f674-67c8-40a8-9c99-1119e52f5a99 tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0d39db7158452d8b9ab2a4eeec786e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09d9809383a48d3915a3b6fd045fcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:18.553204 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-d411f674-67c8-40a8-9c99-1119e52f5a99 tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] 10.222.0.58 "GET /compute/v2.1/servers/ff959855-a396-4cce-9233-120a7d3f4cc9" status: 200 len: 1221 microversion: 2.1 time: 0.195458 Aug 10 23:20:18.557765 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2484/4780] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:20:18 2022] GET /compute/v2.1/servers/ff959855-a396-4cce-9233-120a7d3f4cc9 => generated 1221 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:20:18.585101 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-0c32a779-04af-456f-8c49-4c6332c3ae68 req-e6a68c73-f256-4c0f-8b7d-3643fb35e4d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69c4b403-a8ad-449c-a577-63837a6d2445", "tag": "8597a359-c6f1-46f8-9a07-e80725a3a36d"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:20:18.587621 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-e78c6445-c4d9-4500-8d7f-6c635c54974c tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:18.592254 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-e78c6445-c4d9-4500-8d7f-6c635c54974c tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] [instance: 69c4b403-a8ad-449c-a577-63837a6d2445] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:18.606974 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-0c32a779-04af-456f-8c49-4c6332c3ae68 req-e6a68c73-f256-4c0f-8b7d-3643fb35e4d7 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:18.607240 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e78c6445-c4d9-4500-8d7f-6c635c54974c tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:18.607974 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e78c6445-c4d9-4500-8d7f-6c635c54974c tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:18.608597 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e78c6445-c4d9-4500-8d7f-6c635c54974c tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:18.609498 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e78c6445-c4d9-4500-8d7f-6c635c54974c tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:18.610155 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-0c32a779-04af-456f-8c49-4c6332c3ae68 req-e6a68c73-f256-4c0f-8b7d-3643fb35e4d7 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:18.610815 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e78c6445-c4d9-4500-8d7f-6c635c54974c tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:18.611444 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-0c32a779-04af-456f-8c49-4c6332c3ae68 req-e6a68c73-f256-4c0f-8b7d-3643fb35e4d7 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:18.612051 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e78c6445-c4d9-4500-8d7f-6c635c54974c tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:18.645447 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-0c32a779-04af-456f-8c49-4c6332c3ae68 req-e6a68c73-f256-4c0f-8b7d-3643fb35e4d7 service nova] Creating event network-changed:8597a359-c6f1-46f8-9a07-e80725a3a36d for instance 69c4b403-a8ad-449c-a577-63837a6d2445 on n-h1-850468-14 Aug 10 23:20:18.651358 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-0c32a779-04af-456f-8c49-4c6332c3ae68 req-e6a68c73-f256-4c0f-8b7d-3643fb35e4d7 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072087 Aug 10 23:20:18.652546 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2485/4781] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:20:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:20:18.672315 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-e78c6445-c4d9-4500-8d7f-6c635c54974c tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] [instance: 69c4b403-a8ad-449c-a577-63837a6d2445] Going to try to terminate instance {{(pid=122632) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:20:18.947326 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-e78c6445-c4d9-4500-8d7f-6c635c54974c tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "DELETE /compute/v2.1/servers/69c4b403-a8ad-449c-a577-63837a6d2445" status: 204 len: 0 microversion: 2.1 time: 0.371452 Aug 10 23:20:18.953819 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2297/4782] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:20:18 2022] DELETE /compute/v2.1/servers/69c4b403-a8ad-449c-a577-63837a6d2445 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:20:18.964559 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-2db790af-7bda-404a-abcc-8890d4411c71 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:18.966649 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-2db790af-7bda-404a-abcc-8890d4411c71 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] [instance: 69c4b403-a8ad-449c-a577-63837a6d2445] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:18.999633 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2db790af-7bda-404a-abcc-8890d4411c71 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:19.007785 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2db790af-7bda-404a-abcc-8890d4411c71 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:19.008954 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2db790af-7bda-404a-abcc-8890d4411c71 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:19.017751 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2db790af-7bda-404a-abcc-8890d4411c71 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:19.018473 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2db790af-7bda-404a-abcc-8890d4411c71 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:19.019159 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2db790af-7bda-404a-abcc-8890d4411c71 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:19.382624 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-6cbd6787-429b-4654-8e88-bd913ad8e689 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:19.382624 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-6cbd6787-429b-4654-8e88-bd913ad8e689 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] [instance: 364415e0-931a-4be4-8149-86eb03e99544] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:19.406507 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6cbd6787-429b-4654-8e88-bd913ad8e689 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:19.407079 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6cbd6787-429b-4654-8e88-bd913ad8e689 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:19.407743 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6cbd6787-429b-4654-8e88-bd913ad8e689 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:19.408647 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6cbd6787-429b-4654-8e88-bd913ad8e689 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:19.409429 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6cbd6787-429b-4654-8e88-bd913ad8e689 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:19.410027 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6cbd6787-429b-4654-8e88-bd913ad8e689 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:19.537676 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-2db790af-7bda-404a-abcc-8890d4411c71 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5899b2ad9f1046caaf7c6073e408eeee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25abd63376614081a9d484f3c9ae950d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:19.549261 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-2db790af-7bda-404a-abcc-8890d4411c71 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "GET /compute/v2.1/servers/69c4b403-a8ad-449c-a577-63837a6d2445" status: 200 len: 1690 microversion: 2.1 time: 0.592556 Aug 10 23:20:19.552128 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2486/4783] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:20:18 2022] GET /compute/v2.1/servers/69c4b403-a8ad-449c-a577-63837a6d2445 => generated 1690 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:20:19.566664 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-9bf045d3-950a-46ea-9c4d-5dd0f0d35b93 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:19.569758 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-9bf045d3-950a-46ea-9c4d-5dd0f0d35b93 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: 5ae8b5a0-e56c-4154-a487-080d996d54d3] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:19.582740 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9bf045d3-950a-46ea-9c4d-5dd0f0d35b93 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:19.583728 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9bf045d3-950a-46ea-9c4d-5dd0f0d35b93 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:19.584402 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9bf045d3-950a-46ea-9c4d-5dd0f0d35b93 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:19.585455 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9bf045d3-950a-46ea-9c4d-5dd0f0d35b93 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:19.586119 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9bf045d3-950a-46ea-9c4d-5dd0f0d35b93 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:19.586813 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9bf045d3-950a-46ea-9c4d-5dd0f0d35b93 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:19.595003 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-6cbd6787-429b-4654-8e88-bd913ad8e689 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65fc7792249b4daca6a39f7259d2236c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3661cd206d19455eb1c4ac3dd988a67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:19.610189 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-6cbd6787-429b-4654-8e88-bd913ad8e689 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65fc7792249b4daca6a39f7259d2236c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3661cd206d19455eb1c4ac3dd988a67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:19.618336 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-6cbd6787-429b-4654-8e88-bd913ad8e689 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65fc7792249b4daca6a39f7259d2236c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3661cd206d19455eb1c4ac3dd988a67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:19.619777 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-6cbd6787-429b-4654-8e88-bd913ad8e689 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] 10.222.0.58 "GET /compute/v2.1/servers/364415e0-931a-4be4-8149-86eb03e99544" status: 200 len: 1366 microversion: 2.47 time: 0.244515 Aug 10 23:20:19.620392 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2298/4784] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:20:19 2022] GET /compute/v2.1/servers/364415e0-931a-4be4-8149-86eb03e99544 => generated 1366 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 23:20:19.633348 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c45bcf8f-6406-4cc3-9b16-affa87b4ea21 tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:19.634368 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-c45bcf8f-6406-4cc3-9b16-affa87b4ea21 tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] [instance: ff959855-a396-4cce-9233-120a7d3f4cc9] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:19.667351 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c45bcf8f-6406-4cc3-9b16-affa87b4ea21 tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:19.667351 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c45bcf8f-6406-4cc3-9b16-affa87b4ea21 tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:19.667351 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c45bcf8f-6406-4cc3-9b16-affa87b4ea21 tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:19.668094 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c45bcf8f-6406-4cc3-9b16-affa87b4ea21 tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:19.669044 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c45bcf8f-6406-4cc3-9b16-affa87b4ea21 tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:19.669710 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c45bcf8f-6406-4cc3-9b16-affa87b4ea21 tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:19.718896 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-9bf045d3-950a-46ea-9c4d-5dd0f0d35b93 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6684f0c87e4242be9e0ffb4ef1973f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0582ace9e4443b8ad88915503ee630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:19.729376 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-9bf045d3-950a-46ea-9c4d-5dd0f0d35b93 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "GET /compute/v2.1/servers/5ae8b5a0-e56c-4154-a487-080d996d54d3" status: 200 len: 1267 microversion: 2.1 time: 0.173627 Aug 10 23:20:19.744048 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2487/4785] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:20:19 2022] GET /compute/v2.1/servers/5ae8b5a0-e56c-4154-a487-080d996d54d3 => generated 1267 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:20:19.843651 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-c45bcf8f-6406-4cc3-9b16-affa87b4ea21 tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0d39db7158452d8b9ab2a4eeec786e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09d9809383a48d3915a3b6fd045fcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:19.856939 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-c45bcf8f-6406-4cc3-9b16-affa87b4ea21 tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] 10.222.0.58 "GET /compute/v2.1/servers/ff959855-a396-4cce-9233-120a7d3f4cc9" status: 200 len: 1283 microversion: 2.1 time: 0.232866 Aug 10 23:20:19.858093 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2299/4786] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:20:19 2022] GET /compute/v2.1/servers/ff959855-a396-4cce-9233-120a7d3f4cc9 => generated 1283 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:20:20.576500 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-fe075d8e-3afc-4e68-92c0-1d3a12f58f8c tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:20.577976 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-fe075d8e-3afc-4e68-92c0-1d3a12f58f8c tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] [instance: 69c4b403-a8ad-449c-a577-63837a6d2445] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:20.591253 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fe075d8e-3afc-4e68-92c0-1d3a12f58f8c tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:20.591764 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fe075d8e-3afc-4e68-92c0-1d3a12f58f8c tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:20.592423 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fe075d8e-3afc-4e68-92c0-1d3a12f58f8c tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:20.593938 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fe075d8e-3afc-4e68-92c0-1d3a12f58f8c tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:20.596100 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fe075d8e-3afc-4e68-92c0-1d3a12f58f8c tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:20.596964 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fe075d8e-3afc-4e68-92c0-1d3a12f58f8c tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:20.648462 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-96dbdb2d-d5c2-4647-9837-f059e0681419 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:20.649090 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-96dbdb2d-d5c2-4647-9837-f059e0681419 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] [instance: 364415e0-931a-4be4-8149-86eb03e99544] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:20.666767 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-96dbdb2d-d5c2-4647-9837-f059e0681419 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:20.667444 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-96dbdb2d-d5c2-4647-9837-f059e0681419 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:20.667853 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-96dbdb2d-d5c2-4647-9837-f059e0681419 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:20.668933 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-96dbdb2d-d5c2-4647-9837-f059e0681419 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:20.669213 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-96dbdb2d-d5c2-4647-9837-f059e0681419 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:20.669647 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-96dbdb2d-d5c2-4647-9837-f059e0681419 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:20.813367 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-96dbdb2d-d5c2-4647-9837-f059e0681419 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65fc7792249b4daca6a39f7259d2236c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3661cd206d19455eb1c4ac3dd988a67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:20.838968 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-96dbdb2d-d5c2-4647-9837-f059e0681419 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65fc7792249b4daca6a39f7259d2236c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3661cd206d19455eb1c4ac3dd988a67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:20.841248 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-96dbdb2d-d5c2-4647-9837-f059e0681419 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65fc7792249b4daca6a39f7259d2236c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3661cd206d19455eb1c4ac3dd988a67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:20.843036 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-96dbdb2d-d5c2-4647-9837-f059e0681419 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] 10.222.0.58 "GET /compute/v2.1/servers/364415e0-931a-4be4-8149-86eb03e99544" status: 200 len: 1366 microversion: 2.47 time: 0.199056 Aug 10 23:20:20.844315 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2300/4787] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:20:20 2022] GET /compute/v2.1/servers/364415e0-931a-4be4-8149-86eb03e99544 => generated 1366 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:20:20.862464 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-4074ea6c-8558-46ed-adde-7dcc210d2b79 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:20.864398 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-4074ea6c-8558-46ed-adde-7dcc210d2b79 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: 5ae8b5a0-e56c-4154-a487-080d996d54d3] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:20.875183 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4074ea6c-8558-46ed-adde-7dcc210d2b79 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:20.876027 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4074ea6c-8558-46ed-adde-7dcc210d2b79 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:20.876623 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4074ea6c-8558-46ed-adde-7dcc210d2b79 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:20.877560 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4074ea6c-8558-46ed-adde-7dcc210d2b79 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:20.878274 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4074ea6c-8558-46ed-adde-7dcc210d2b79 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:20.879381 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4074ea6c-8558-46ed-adde-7dcc210d2b79 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:20.924439 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:20:21.108464 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-fe075d8e-3afc-4e68-92c0-1d3a12f58f8c tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5899b2ad9f1046caaf7c6073e408eeee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25abd63376614081a9d484f3c9ae950d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:21.119786 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-fe075d8e-3afc-4e68-92c0-1d3a12f58f8c tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "GET /compute/v2.1/servers/69c4b403-a8ad-449c-a577-63837a6d2445" status: 200 len: 1572 microversion: 2.1 time: 0.547657 Aug 10 23:20:21.122962 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2488/4788] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:20:20 2022] GET /compute/v2.1/servers/69c4b403-a8ad-449c-a577-63837a6d2445 => generated 1572 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:20:21.135324 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-72d98521-f430-4259-9290-527add01117a tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:21.136433 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-72d98521-f430-4259-9290-527add01117a tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] [instance: ff959855-a396-4cce-9233-120a7d3f4cc9] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:21.152224 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-72d98521-f430-4259-9290-527add01117a tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:21.153018 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-72d98521-f430-4259-9290-527add01117a tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:21.153748 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-72d98521-f430-4259-9290-527add01117a tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:21.154959 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-72d98521-f430-4259-9290-527add01117a tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:21.157648 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-72d98521-f430-4259-9290-527add01117a tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:21.158412 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-72d98521-f430-4259-9290-527add01117a tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:21.548846 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-4074ea6c-8558-46ed-adde-7dcc210d2b79 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6684f0c87e4242be9e0ffb4ef1973f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0582ace9e4443b8ad88915503ee630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:21.564446 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-4074ea6c-8558-46ed-adde-7dcc210d2b79 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "GET /compute/v2.1/servers/5ae8b5a0-e56c-4154-a487-080d996d54d3" status: 200 len: 1309 microversion: 2.1 time: 0.716593 Aug 10 23:20:21.565060 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2301/4789] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:20:20 2022] GET /compute/v2.1/servers/5ae8b5a0-e56c-4154-a487-080d996d54d3 => generated 1309 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:20:21.870674 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-839b466f-6290-40fd-80f6-dd463fc4c2d1 req-b253f501-b9d7-43fc-a7ae-23ea4b466bbb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69c4b403-a8ad-449c-a577-63837a6d2445", "name": "network-vif-deleted", "tag": "8597a359-c6f1-46f8-9a07-e80725a3a36d"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:20:21.889544 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-839b466f-6290-40fd-80f6-dd463fc4c2d1 req-b253f501-b9d7-43fc-a7ae-23ea4b466bbb service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:21.890033 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-839b466f-6290-40fd-80f6-dd463fc4c2d1 req-b253f501-b9d7-43fc-a7ae-23ea4b466bbb service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:21.890930 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-839b466f-6290-40fd-80f6-dd463fc4c2d1 req-b253f501-b9d7-43fc-a7ae-23ea4b466bbb service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:21.906776 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-839b466f-6290-40fd-80f6-dd463fc4c2d1 req-b253f501-b9d7-43fc-a7ae-23ea4b466bbb service nova] Creating event network-vif-deleted:8597a359-c6f1-46f8-9a07-e80725a3a36d for instance 69c4b403-a8ad-449c-a577-63837a6d2445 on n-h1-850468-14 Aug 10 23:20:21.915078 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-839b466f-6290-40fd-80f6-dd463fc4c2d1 req-b253f501-b9d7-43fc-a7ae-23ea4b466bbb service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051441 Aug 10 23:20:21.917553 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2302/4790] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:20:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 23:20:21.923764 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-e3c318ae-b056-4a6a-a811-756681100289 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:21.925215 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-e3c318ae-b056-4a6a-a811-756681100289 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] [instance: 364415e0-931a-4be4-8149-86eb03e99544] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:21.935819 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e3c318ae-b056-4a6a-a811-756681100289 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:21.936738 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e3c318ae-b056-4a6a-a811-756681100289 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:21.939999 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e3c318ae-b056-4a6a-a811-756681100289 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:21.941172 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e3c318ae-b056-4a6a-a811-756681100289 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:21.942644 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e3c318ae-b056-4a6a-a811-756681100289 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:21.943357 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e3c318ae-b056-4a6a-a811-756681100289 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:21.967593 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-72d98521-f430-4259-9290-527add01117a tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0d39db7158452d8b9ab2a4eeec786e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09d9809383a48d3915a3b6fd045fcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:21.974971 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=100 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:20:21.988975 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-72d98521-f430-4259-9290-527add01117a tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] 10.222.0.58 "GET /compute/v2.1/servers/ff959855-a396-4cce-9233-120a7d3f4cc9" status: 200 len: 1325 microversion: 2.1 time: 0.862465 Aug 10 23:20:21.990050 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2489/4791] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:20:21 2022] GET /compute/v2.1/servers/ff959855-a396-4cce-9233-120a7d3f4cc9 => generated 1325 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:20:22.065704 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-e3c318ae-b056-4a6a-a811-756681100289 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65fc7792249b4daca6a39f7259d2236c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3661cd206d19455eb1c4ac3dd988a67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:22.086818 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-e3c318ae-b056-4a6a-a811-756681100289 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65fc7792249b4daca6a39f7259d2236c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3661cd206d19455eb1c4ac3dd988a67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:22.088814 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-e3c318ae-b056-4a6a-a811-756681100289 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65fc7792249b4daca6a39f7259d2236c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3661cd206d19455eb1c4ac3dd988a67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:22.090537 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-e3c318ae-b056-4a6a-a811-756681100289 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] 10.222.0.58 "GET /compute/v2.1/servers/364415e0-931a-4be4-8149-86eb03e99544" status: 200 len: 1366 microversion: 2.47 time: 0.171523 Aug 10 23:20:22.091393 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2303/4792] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:20:21 2022] GET /compute/v2.1/servers/364415e0-931a-4be4-8149-86eb03e99544 => generated 1366 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:20:22.150152 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-7085cd29-211f-4a31-b3bf-ff2b80cb041f tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:22.151056 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-7085cd29-211f-4a31-b3bf-ff2b80cb041f tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] [instance: 69c4b403-a8ad-449c-a577-63837a6d2445] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:22.159640 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7085cd29-211f-4a31-b3bf-ff2b80cb041f tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:22.164378 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7085cd29-211f-4a31-b3bf-ff2b80cb041f tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:22.166887 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7085cd29-211f-4a31-b3bf-ff2b80cb041f tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:22.168508 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7085cd29-211f-4a31-b3bf-ff2b80cb041f tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:22.170777 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7085cd29-211f-4a31-b3bf-ff2b80cb041f tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:22.171599 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7085cd29-211f-4a31-b3bf-ff2b80cb041f tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:22.249542 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7085cd29-211f-4a31-b3bf-ff2b80cb041f tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:22.250038 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7085cd29-211f-4a31-b3bf-ff2b80cb041f tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:22.250480 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7085cd29-211f-4a31-b3bf-ff2b80cb041f tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:22.250973 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.objects.instance [None req-7085cd29-211f-4a31-b3bf-ff2b80cb041f tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lazy-loading 'fault' on Instance uuid 69c4b403-a8ad-449c-a577-63837a6d2445 {{(pid=122633) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:20:22.400183 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-7085cd29-211f-4a31-b3bf-ff2b80cb041f tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5899b2ad9f1046caaf7c6073e408eeee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25abd63376614081a9d484f3c9ae950d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:22.413657 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-7085cd29-211f-4a31-b3bf-ff2b80cb041f tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "GET /compute/v2.1/servers/69c4b403-a8ad-449c-a577-63837a6d2445" status: 200 len: 1357 microversion: 2.1 time: 0.267333 Aug 10 23:20:22.414277 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2490/4793] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:20:22 2022] GET /compute/v2.1/servers/69c4b403-a8ad-449c-a577-63837a6d2445 => generated 1357 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:20:22.588141 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-9e85ed7d-194a-4e23-909f-d21c5066cf48 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:22.588947 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-9e85ed7d-194a-4e23-909f-d21c5066cf48 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: 5ae8b5a0-e56c-4154-a487-080d996d54d3] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:22.595742 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9e85ed7d-194a-4e23-909f-d21c5066cf48 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:22.596376 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9e85ed7d-194a-4e23-909f-d21c5066cf48 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:22.597069 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9e85ed7d-194a-4e23-909f-d21c5066cf48 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:22.598222 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9e85ed7d-194a-4e23-909f-d21c5066cf48 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:22.598740 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9e85ed7d-194a-4e23-909f-d21c5066cf48 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:22.599448 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9e85ed7d-194a-4e23-909f-d21c5066cf48 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:22.750351 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-9e85ed7d-194a-4e23-909f-d21c5066cf48 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6684f0c87e4242be9e0ffb4ef1973f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0582ace9e4443b8ad88915503ee630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:22.760251 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-9e85ed7d-194a-4e23-909f-d21c5066cf48 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "GET /compute/v2.1/servers/5ae8b5a0-e56c-4154-a487-080d996d54d3" status: 200 len: 1309 microversion: 2.1 time: 0.176215 Aug 10 23:20:22.760856 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2304/4794] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:20:22 2022] GET /compute/v2.1/servers/5ae8b5a0-e56c-4154-a487-080d996d54d3 => generated 1309 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:20:23.010859 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-af50a3d9-3605-4f3c-a855-f298fe48e506 tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:23.012154 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-af50a3d9-3605-4f3c-a855-f298fe48e506 tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] [instance: ff959855-a396-4cce-9233-120a7d3f4cc9] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:23.019649 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-af50a3d9-3605-4f3c-a855-f298fe48e506 tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:23.020143 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-af50a3d9-3605-4f3c-a855-f298fe48e506 tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:23.020592 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-af50a3d9-3605-4f3c-a855-f298fe48e506 tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:23.021318 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-af50a3d9-3605-4f3c-a855-f298fe48e506 tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:23.021781 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-af50a3d9-3605-4f3c-a855-f298fe48e506 tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:23.022213 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-af50a3d9-3605-4f3c-a855-f298fe48e506 tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:23.114899 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-8e53bb68-beb8-4453-b461-1cee7ce36ca6 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:23.115791 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-8e53bb68-beb8-4453-b461-1cee7ce36ca6 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] [instance: 364415e0-931a-4be4-8149-86eb03e99544] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:23.123042 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8e53bb68-beb8-4453-b461-1cee7ce36ca6 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:23.123704 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8e53bb68-beb8-4453-b461-1cee7ce36ca6 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:23.124310 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8e53bb68-beb8-4453-b461-1cee7ce36ca6 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:23.125162 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8e53bb68-beb8-4453-b461-1cee7ce36ca6 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:23.125846 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8e53bb68-beb8-4453-b461-1cee7ce36ca6 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:23.126271 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8e53bb68-beb8-4453-b461-1cee7ce36ca6 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:23.200788 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-8e53bb68-beb8-4453-b461-1cee7ce36ca6 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65fc7792249b4daca6a39f7259d2236c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3661cd206d19455eb1c4ac3dd988a67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:23.213061 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-8e53bb68-beb8-4453-b461-1cee7ce36ca6 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65fc7792249b4daca6a39f7259d2236c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3661cd206d19455eb1c4ac3dd988a67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:23.214681 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-8e53bb68-beb8-4453-b461-1cee7ce36ca6 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65fc7792249b4daca6a39f7259d2236c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3661cd206d19455eb1c4ac3dd988a67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:23.215902 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-8e53bb68-beb8-4453-b461-1cee7ce36ca6 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] 10.222.0.58 "GET /compute/v2.1/servers/364415e0-931a-4be4-8149-86eb03e99544" status: 200 len: 1366 microversion: 2.47 time: 0.106189 Aug 10 23:20:23.224938 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2305/4795] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:20:23 2022] GET /compute/v2.1/servers/364415e0-931a-4be4-8149-86eb03e99544 => generated 1366 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 23:20:23.371549 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-af50a3d9-3605-4f3c-a855-f298fe48e506 tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0d39db7158452d8b9ab2a4eeec786e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09d9809383a48d3915a3b6fd045fcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:23.386113 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-af50a3d9-3605-4f3c-a855-f298fe48e506 tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] 10.222.0.58 "GET /compute/v2.1/servers/ff959855-a396-4cce-9233-120a7d3f4cc9" status: 200 len: 1325 microversion: 2.1 time: 0.379776 Aug 10 23:20:23.391902 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2491/4796] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:20:23 2022] GET /compute/v2.1/servers/ff959855-a396-4cce-9233-120a7d3f4cc9 => generated 1325 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:20:23.438081 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-dbb7cf62-8e19-4b76-a267-00d60d1a8ae7 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:23.439021 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-dbb7cf62-8e19-4b76-a267-00d60d1a8ae7 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] [instance: 69c4b403-a8ad-449c-a577-63837a6d2445] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:23.447590 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dbb7cf62-8e19-4b76-a267-00d60d1a8ae7 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:23.448217 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dbb7cf62-8e19-4b76-a267-00d60d1a8ae7 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:23.448764 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dbb7cf62-8e19-4b76-a267-00d60d1a8ae7 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:23.449602 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dbb7cf62-8e19-4b76-a267-00d60d1a8ae7 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:23.450159 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dbb7cf62-8e19-4b76-a267-00d60d1a8ae7 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:23.451366 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dbb7cf62-8e19-4b76-a267-00d60d1a8ae7 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:23.470512 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-dbb7cf62-8e19-4b76-a267-00d60d1a8ae7 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] HTTP exception thrown: Instance 69c4b403-a8ad-449c-a577-63837a6d2445 could not be found. Aug 10 23:20:23.472848 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-dbb7cf62-8e19-4b76-a267-00d60d1a8ae7 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Request method failure captured: Aug 10 23:20:23.472848 n-d-850468-14 devstack@n-api.service[122632]: request: GET /compute/v2.1/servers/69c4b403-a8ad-449c-a577-63837a6d2445 HTTP/1.1 Aug 10 23:20:23.472848 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:20:23.472848 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:20:23.472848 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:20:23.472848 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 23:20:23.472848 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:20:23.472848 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:20:23.472848 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:20:23.472848 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:20:23.472848 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9Ds_i3PDzfY831LhvXxRQTuETlpkVlxLBcxw-fA_3Rgh7BtMKg49t93n4W60rS-OkNCaJLSeSll4L6S-Ea6OzN1bcIzb1fgJBbur3wde6WJsUVM5pLO1qLazxYPdl_aqZKKVBhxsJX3P2s11u3EZ1kQF4iZz3H2MFzZDIBqiyZ7kxOA Aug 10 23:20:23.472848 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:20:23.472848 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:20:23.472848 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:20:23.472848 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:20:23.472848 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:20:23.472848 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:20:23.472848 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 25abd63376614081a9d484f3c9ae950d Aug 10 23:20:23.472848 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1591694610 Aug 10 23:20:23.472848 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:20:23.472848 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:20:23.472848 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/25abd63376614081a9d484f3c9ae950d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/25abd63376614081a9d484f3c9ae950d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/25abd63376614081a9d484f3c9ae950d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_25abd63376614081a9d484f3c9ae950d", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:20:23.472848 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1591694610 Aug 10 23:20:23.472848 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 25abd63376614081a9d484f3c9ae950d Aug 10 23:20:23.472848 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1591694610 Aug 10 23:20:23.472848 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-TestNetworkAdvancedServerOps-1591694610-project Aug 10 23:20:23.472848 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:20:23.472848 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:20:23.472848 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: 5899b2ad9f1046caaf7c6073e408eeee Aug 10 23:20:23.472848 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1591694610-project Aug 10 23:20:23.472848 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:20:23.472848 n-d-850468-14 devstack@n-api.service[122632]: exception: Instance 69c4b403-a8ad-449c-a577-63837a6d2445 could not be found. Aug 10 23:20:23.472848 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': '69c4b403-a8ad-449c-a577-63837a6d2445'} Aug 10 23:20:23.472848 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:20:23.472848 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:20:23.472848 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:20:23.472848 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:20:23.472848 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:20:23.472848 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:20:23.472848 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:20:23.472848 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:20:23.472848 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:20:23.472848 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:20:23.472848 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69c4b403-a8ad-449c-a577-63837a6d2445 could not be found. Aug 10 23:20:23.472848 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:20:23.472848 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:20:23.472848 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:20:23.472848 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:20:23.472848 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:20:23.472848 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:20:23.472848 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:20:23.472848 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:20:23.472848 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:20:23.472848 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:20:23.472848 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:20:23.472848 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:20:23.472848 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:20:23.472848 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:20:23.472848 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:20:23.472848 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:20:23.472848 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69c4b403-a8ad-449c-a577-63837a6d2445 could not be found. Aug 10 23:20:23.472848 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:20:23.472848 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:20:23.481286 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:20:23.481286 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:20:23.481286 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:20:23.481286 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:20:23.481286 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:20:23.481286 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:20:23.481286 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69c4b403-a8ad-449c-a577-63837a6d2445 could not be found. Aug 10 23:20:23.481286 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:20:23.481286 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-dbb7cf62-8e19-4b76-a267-00d60d1a8ae7 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Returning 404 to user: Instance 69c4b403-a8ad-449c-a577-63837a6d2445 could not be found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:20:23.481286 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-dbb7cf62-8e19-4b76-a267-00d60d1a8ae7 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "GET /compute/v2.1/servers/69c4b403-a8ad-449c-a577-63837a6d2445" status: 404 len: 111 microversion: 2.1 time: 0.043534 Aug 10 23:20:23.481286 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2306/4797] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:20:23 2022] GET /compute/v2.1/servers/69c4b403-a8ad-449c-a577-63837a6d2445 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:20:23.783269 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-598dd43a-cd5d-4e89-a7e9-1641d1bffec0 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:23.784498 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-598dd43a-cd5d-4e89-a7e9-1641d1bffec0 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: 5ae8b5a0-e56c-4154-a487-080d996d54d3] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:23.792995 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-598dd43a-cd5d-4e89-a7e9-1641d1bffec0 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:23.793520 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-598dd43a-cd5d-4e89-a7e9-1641d1bffec0 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:23.793962 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-598dd43a-cd5d-4e89-a7e9-1641d1bffec0 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:23.795350 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-598dd43a-cd5d-4e89-a7e9-1641d1bffec0 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:23.796075 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-598dd43a-cd5d-4e89-a7e9-1641d1bffec0 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:23.796668 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-598dd43a-cd5d-4e89-a7e9-1641d1bffec0 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:23.959741 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-893e6637-3744-49d3-a9ed-14bbeef6770e req-39e83dc0-018f-4065-a0f7-0b388a2b1b90 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ae8b5a0-e56c-4154-a487-080d996d54d3", "tag": "dce83ee8-37ec-4913-9b31-22429243af3d"}, {"name": "network-changed", "server_uuid": "ff959855-a396-4cce-9233-120a7d3f4cc9", "tag": "cb873f8c-37f1-423b-9bdc-77f8a729e19c"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:20:23.975513 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-893e6637-3744-49d3-a9ed-14bbeef6770e req-39e83dc0-018f-4065-a0f7-0b388a2b1b90 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:23.976208 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-893e6637-3744-49d3-a9ed-14bbeef6770e req-39e83dc0-018f-4065-a0f7-0b388a2b1b90 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:23.977009 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-893e6637-3744-49d3-a9ed-14bbeef6770e req-39e83dc0-018f-4065-a0f7-0b388a2b1b90 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:23.994088 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-893e6637-3744-49d3-a9ed-14bbeef6770e req-39e83dc0-018f-4065-a0f7-0b388a2b1b90 service nova] Creating event network-changed:dce83ee8-37ec-4913-9b31-22429243af3d for instance 5ae8b5a0-e56c-4154-a487-080d996d54d3 on n-h2-850468-14 Aug 10 23:20:23.995041 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-893e6637-3744-49d3-a9ed-14bbeef6770e req-39e83dc0-018f-4065-a0f7-0b388a2b1b90 service nova] Creating event network-changed:cb873f8c-37f1-423b-9bdc-77f8a729e19c for instance ff959855-a396-4cce-9233-120a7d3f4cc9 on n-h2-850468-14 Aug 10 23:20:24.003333 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-893e6637-3744-49d3-a9ed-14bbeef6770e req-39e83dc0-018f-4065-a0f7-0b388a2b1b90 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.048328 Aug 10 23:20:24.005114 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2307/4798] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:20:23 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:20:24.225985 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-598dd43a-cd5d-4e89-a7e9-1641d1bffec0 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6684f0c87e4242be9e0ffb4ef1973f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0582ace9e4443b8ad88915503ee630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:24.241346 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-598dd43a-cd5d-4e89-a7e9-1641d1bffec0 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "GET /compute/v2.1/servers/5ae8b5a0-e56c-4154-a487-080d996d54d3" status: 200 len: 1309 microversion: 2.1 time: 0.463468 Aug 10 23:20:24.243110 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2492/4799] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:20:23 2022] GET /compute/v2.1/servers/5ae8b5a0-e56c-4154-a487-080d996d54d3 => generated 1309 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:20:24.254656 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-90bdbbb7-4e0c-4e45-be5a-5e35fff849a3 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:24.255472 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-90bdbbb7-4e0c-4e45-be5a-5e35fff849a3 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] [instance: 364415e0-931a-4be4-8149-86eb03e99544] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:24.267641 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-90bdbbb7-4e0c-4e45-be5a-5e35fff849a3 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:24.268226 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-90bdbbb7-4e0c-4e45-be5a-5e35fff849a3 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:24.269093 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-90bdbbb7-4e0c-4e45-be5a-5e35fff849a3 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:24.270979 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-90bdbbb7-4e0c-4e45-be5a-5e35fff849a3 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:24.271634 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-90bdbbb7-4e0c-4e45-be5a-5e35fff849a3 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:24.272129 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-90bdbbb7-4e0c-4e45-be5a-5e35fff849a3 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:24.377606 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-90bdbbb7-4e0c-4e45-be5a-5e35fff849a3 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65fc7792249b4daca6a39f7259d2236c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3661cd206d19455eb1c4ac3dd988a67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:24.391800 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-90bdbbb7-4e0c-4e45-be5a-5e35fff849a3 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65fc7792249b4daca6a39f7259d2236c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3661cd206d19455eb1c4ac3dd988a67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:24.394941 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-90bdbbb7-4e0c-4e45-be5a-5e35fff849a3 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65fc7792249b4daca6a39f7259d2236c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3661cd206d19455eb1c4ac3dd988a67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:24.397747 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-90bdbbb7-4e0c-4e45-be5a-5e35fff849a3 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] 10.222.0.58 "GET /compute/v2.1/servers/364415e0-931a-4be4-8149-86eb03e99544" status: 200 len: 1366 microversion: 2.47 time: 0.161036 Aug 10 23:20:24.399096 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2308/4800] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:20:24 2022] GET /compute/v2.1/servers/364415e0-931a-4be4-8149-86eb03e99544 => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:20:24.439126 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-543c77ce-fd70-412b-b3af-272cdc08dddf tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:24.441723 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-543c77ce-fd70-412b-b3af-272cdc08dddf tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] [instance: ff959855-a396-4cce-9233-120a7d3f4cc9] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:24.456140 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-543c77ce-fd70-412b-b3af-272cdc08dddf tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:24.457578 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-543c77ce-fd70-412b-b3af-272cdc08dddf tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:24.458230 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-543c77ce-fd70-412b-b3af-272cdc08dddf tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:24.459165 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-543c77ce-fd70-412b-b3af-272cdc08dddf tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:24.459794 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-543c77ce-fd70-412b-b3af-272cdc08dddf tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:24.460653 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-543c77ce-fd70-412b-b3af-272cdc08dddf tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:24.810512 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-543c77ce-fd70-412b-b3af-272cdc08dddf tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0d39db7158452d8b9ab2a4eeec786e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09d9809383a48d3915a3b6fd045fcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:24.819412 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-543c77ce-fd70-412b-b3af-272cdc08dddf tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] 10.222.0.58 "GET /compute/v2.1/servers/ff959855-a396-4cce-9233-120a7d3f4cc9" status: 200 len: 1325 microversion: 2.1 time: 0.404468 Aug 10 23:20:24.820503 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2493/4801] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:20:24 2022] GET /compute/v2.1/servers/ff959855-a396-4cce-9233-120a7d3f4cc9 => generated 1325 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:20:25.267746 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-949971b8-2ba5-4066-a7c0-ebcee2a804a0 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:25.268537 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-949971b8-2ba5-4066-a7c0-ebcee2a804a0 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: 5ae8b5a0-e56c-4154-a487-080d996d54d3] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:25.277077 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-949971b8-2ba5-4066-a7c0-ebcee2a804a0 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:25.277873 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-949971b8-2ba5-4066-a7c0-ebcee2a804a0 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:25.278324 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-949971b8-2ba5-4066-a7c0-ebcee2a804a0 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:25.279073 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-949971b8-2ba5-4066-a7c0-ebcee2a804a0 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:25.279715 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-949971b8-2ba5-4066-a7c0-ebcee2a804a0 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:25.280336 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-949971b8-2ba5-4066-a7c0-ebcee2a804a0 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:25.429302 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-1cbfb0c3-3860-420a-aaa6-0067ca1fcf24 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:25.430776 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-1cbfb0c3-3860-420a-aaa6-0067ca1fcf24 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] [instance: 364415e0-931a-4be4-8149-86eb03e99544] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:25.449061 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1cbfb0c3-3860-420a-aaa6-0067ca1fcf24 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:25.449562 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1cbfb0c3-3860-420a-aaa6-0067ca1fcf24 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:25.450209 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1cbfb0c3-3860-420a-aaa6-0067ca1fcf24 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:25.451148 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1cbfb0c3-3860-420a-aaa6-0067ca1fcf24 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:25.451606 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1cbfb0c3-3860-420a-aaa6-0067ca1fcf24 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:25.452200 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1cbfb0c3-3860-420a-aaa6-0067ca1fcf24 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:25.532612 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-949971b8-2ba5-4066-a7c0-ebcee2a804a0 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6684f0c87e4242be9e0ffb4ef1973f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0582ace9e4443b8ad88915503ee630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:25.544095 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-949971b8-2ba5-4066-a7c0-ebcee2a804a0 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "GET /compute/v2.1/servers/5ae8b5a0-e56c-4154-a487-080d996d54d3" status: 200 len: 1309 microversion: 2.1 time: 0.281066 Aug 10 23:20:25.545407 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2309/4802] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:20:25 2022] GET /compute/v2.1/servers/5ae8b5a0-e56c-4154-a487-080d996d54d3 => generated 1309 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:20:25.596487 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-1cbfb0c3-3860-420a-aaa6-0067ca1fcf24 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65fc7792249b4daca6a39f7259d2236c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3661cd206d19455eb1c4ac3dd988a67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:25.621100 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-1cbfb0c3-3860-420a-aaa6-0067ca1fcf24 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65fc7792249b4daca6a39f7259d2236c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3661cd206d19455eb1c4ac3dd988a67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:25.626395 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-1cbfb0c3-3860-420a-aaa6-0067ca1fcf24 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65fc7792249b4daca6a39f7259d2236c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3661cd206d19455eb1c4ac3dd988a67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:25.629831 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-1cbfb0c3-3860-420a-aaa6-0067ca1fcf24 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] 10.222.0.58 "GET /compute/v2.1/servers/364415e0-931a-4be4-8149-86eb03e99544" status: 200 len: 1366 microversion: 2.47 time: 0.206797 Aug 10 23:20:25.632080 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2494/4803] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:20:25 2022] GET /compute/v2.1/servers/364415e0-931a-4be4-8149-86eb03e99544 => generated 1366 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:20:25.841900 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-418a1b22-8f3e-4070-9035-fe7c2f7ff422 tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:25.842870 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-418a1b22-8f3e-4070-9035-fe7c2f7ff422 tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] [instance: ff959855-a396-4cce-9233-120a7d3f4cc9] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:25.850409 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-418a1b22-8f3e-4070-9035-fe7c2f7ff422 tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:25.851231 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-418a1b22-8f3e-4070-9035-fe7c2f7ff422 tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:25.851866 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-418a1b22-8f3e-4070-9035-fe7c2f7ff422 tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:25.852815 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-418a1b22-8f3e-4070-9035-fe7c2f7ff422 tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:25.853444 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-418a1b22-8f3e-4070-9035-fe7c2f7ff422 tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:25.854035 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-418a1b22-8f3e-4070-9035-fe7c2f7ff422 tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:26.199185 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-418a1b22-8f3e-4070-9035-fe7c2f7ff422 tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0d39db7158452d8b9ab2a4eeec786e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09d9809383a48d3915a3b6fd045fcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:26.210125 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-418a1b22-8f3e-4070-9035-fe7c2f7ff422 tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] 10.222.0.58 "GET /compute/v2.1/servers/ff959855-a396-4cce-9233-120a7d3f4cc9" status: 200 len: 1325 microversion: 2.1 time: 0.372713 Aug 10 23:20:26.213255 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2310/4804] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:20:25 2022] GET /compute/v2.1/servers/ff959855-a396-4cce-9233-120a7d3f4cc9 => generated 1325 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:20:26.567277 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-d685fab3-f86f-4347-b419-472cab07dc20 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:26.568064 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-d685fab3-f86f-4347-b419-472cab07dc20 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: 5ae8b5a0-e56c-4154-a487-080d996d54d3] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:26.576150 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d685fab3-f86f-4347-b419-472cab07dc20 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:26.577509 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d685fab3-f86f-4347-b419-472cab07dc20 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:26.578506 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d685fab3-f86f-4347-b419-472cab07dc20 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:26.579821 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d685fab3-f86f-4347-b419-472cab07dc20 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:26.580628 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d685fab3-f86f-4347-b419-472cab07dc20 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:26.581317 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d685fab3-f86f-4347-b419-472cab07dc20 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:26.655931 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-2f12c8eb-eb89-412c-9e1c-f1a3a2182549 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:26.658756 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-2f12c8eb-eb89-412c-9e1c-f1a3a2182549 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] [instance: 364415e0-931a-4be4-8149-86eb03e99544] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:26.664536 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=2 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:20:26.665999 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=6 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:20:26.673939 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2f12c8eb-eb89-412c-9e1c-f1a3a2182549 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:26.675059 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2f12c8eb-eb89-412c-9e1c-f1a3a2182549 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:26.681089 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2f12c8eb-eb89-412c-9e1c-f1a3a2182549 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:26.682675 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2f12c8eb-eb89-412c-9e1c-f1a3a2182549 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:26.683593 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2f12c8eb-eb89-412c-9e1c-f1a3a2182549 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:26.684496 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2f12c8eb-eb89-412c-9e1c-f1a3a2182549 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:26.748001 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=2 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:20:26.807326 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-2f12c8eb-eb89-412c-9e1c-f1a3a2182549 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65fc7792249b4daca6a39f7259d2236c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3661cd206d19455eb1c4ac3dd988a67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:26.824652 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-2f12c8eb-eb89-412c-9e1c-f1a3a2182549 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65fc7792249b4daca6a39f7259d2236c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3661cd206d19455eb1c4ac3dd988a67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:26.829994 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-2f12c8eb-eb89-412c-9e1c-f1a3a2182549 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65fc7792249b4daca6a39f7259d2236c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3661cd206d19455eb1c4ac3dd988a67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:26.834394 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-2f12c8eb-eb89-412c-9e1c-f1a3a2182549 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] 10.222.0.58 "GET /compute/v2.1/servers/364415e0-931a-4be4-8149-86eb03e99544" status: 200 len: 1366 microversion: 2.47 time: 0.181352 Aug 10 23:20:26.835574 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2311/4805] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:20:26 2022] GET /compute/v2.1/servers/364415e0-931a-4be4-8149-86eb03e99544 => generated 1366 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 23:20:27.161331 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-d685fab3-f86f-4347-b419-472cab07dc20 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6684f0c87e4242be9e0ffb4ef1973f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0582ace9e4443b8ad88915503ee630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:27.183746 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-d685fab3-f86f-4347-b419-472cab07dc20 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "GET /compute/v2.1/servers/5ae8b5a0-e56c-4154-a487-080d996d54d3" status: 200 len: 1309 microversion: 2.1 time: 0.618376 Aug 10 23:20:27.186983 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2495/4806] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:20:26 2022] GET /compute/v2.1/servers/5ae8b5a0-e56c-4154-a487-080d996d54d3 => generated 1309 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:20:27.235544 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-f22865ec-c2e8-480f-b4d1-e2001227a52b tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:27.236254 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-f22865ec-c2e8-480f-b4d1-e2001227a52b tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] [instance: ff959855-a396-4cce-9233-120a7d3f4cc9] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:27.247304 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f22865ec-c2e8-480f-b4d1-e2001227a52b tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:27.247807 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f22865ec-c2e8-480f-b4d1-e2001227a52b tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:27.248303 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f22865ec-c2e8-480f-b4d1-e2001227a52b tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:27.249350 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f22865ec-c2e8-480f-b4d1-e2001227a52b tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:27.249580 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f22865ec-c2e8-480f-b4d1-e2001227a52b tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:27.250019 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f22865ec-c2e8-480f-b4d1-e2001227a52b tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:27.546416 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-f22865ec-c2e8-480f-b4d1-e2001227a52b tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0d39db7158452d8b9ab2a4eeec786e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09d9809383a48d3915a3b6fd045fcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:27.555712 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-f22865ec-c2e8-480f-b4d1-e2001227a52b tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] 10.222.0.58 "GET /compute/v2.1/servers/ff959855-a396-4cce-9233-120a7d3f4cc9" status: 200 len: 1325 microversion: 2.1 time: 0.325883 Aug 10 23:20:27.556593 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2312/4807] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:20:27 2022] GET /compute/v2.1/servers/ff959855-a396-4cce-9233-120a7d3f4cc9 => generated 1325 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:20:27.862344 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-8b36b243-9bff-4df7-a584-0818da9a17d1 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:27.863686 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-8b36b243-9bff-4df7-a584-0818da9a17d1 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] [instance: 364415e0-931a-4be4-8149-86eb03e99544] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:27.865967 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=10 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:20:27.875671 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8b36b243-9bff-4df7-a584-0818da9a17d1 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:27.876168 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8b36b243-9bff-4df7-a584-0818da9a17d1 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:27.882170 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8b36b243-9bff-4df7-a584-0818da9a17d1 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:27.883211 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8b36b243-9bff-4df7-a584-0818da9a17d1 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:27.883893 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8b36b243-9bff-4df7-a584-0818da9a17d1 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:27.884543 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8b36b243-9bff-4df7-a584-0818da9a17d1 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:27.996135 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-8b36b243-9bff-4df7-a584-0818da9a17d1 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65fc7792249b4daca6a39f7259d2236c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3661cd206d19455eb1c4ac3dd988a67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:28.005534 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-8b36b243-9bff-4df7-a584-0818da9a17d1 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65fc7792249b4daca6a39f7259d2236c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3661cd206d19455eb1c4ac3dd988a67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:28.007103 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-8b36b243-9bff-4df7-a584-0818da9a17d1 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65fc7792249b4daca6a39f7259d2236c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3661cd206d19455eb1c4ac3dd988a67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:28.008595 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-8b36b243-9bff-4df7-a584-0818da9a17d1 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] 10.222.0.58 "GET /compute/v2.1/servers/364415e0-931a-4be4-8149-86eb03e99544" status: 200 len: 1366 microversion: 2.47 time: 0.151683 Aug 10 23:20:28.009129 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2496/4808] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:20:27 2022] GET /compute/v2.1/servers/364415e0-931a-4be4-8149-86eb03e99544 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:20:28.206570 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-88380121-c13e-4d45-9751-e5da56726e8b tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:28.207829 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-88380121-c13e-4d45-9751-e5da56726e8b tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: 5ae8b5a0-e56c-4154-a487-080d996d54d3] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:28.220401 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-88380121-c13e-4d45-9751-e5da56726e8b tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:28.220905 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-88380121-c13e-4d45-9751-e5da56726e8b tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:28.221404 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-88380121-c13e-4d45-9751-e5da56726e8b tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:28.222143 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-88380121-c13e-4d45-9751-e5da56726e8b tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:28.223169 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-88380121-c13e-4d45-9751-e5da56726e8b tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:28.223812 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-88380121-c13e-4d45-9751-e5da56726e8b tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:28.580681 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-85ab7e13-ec31-4110-9015-8a741cb90ffd tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:28.581301 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-85ab7e13-ec31-4110-9015-8a741cb90ffd tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] [instance: ff959855-a396-4cce-9233-120a7d3f4cc9] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:28.592652 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-85ab7e13-ec31-4110-9015-8a741cb90ffd tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:28.593156 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-85ab7e13-ec31-4110-9015-8a741cb90ffd tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:28.593707 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-85ab7e13-ec31-4110-9015-8a741cb90ffd tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:28.594685 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-85ab7e13-ec31-4110-9015-8a741cb90ffd tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:28.595233 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-85ab7e13-ec31-4110-9015-8a741cb90ffd tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:28.595660 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-85ab7e13-ec31-4110-9015-8a741cb90ffd tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:28.658060 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-88380121-c13e-4d45-9751-e5da56726e8b tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6684f0c87e4242be9e0ffb4ef1973f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0582ace9e4443b8ad88915503ee630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:28.674216 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-88380121-c13e-4d45-9751-e5da56726e8b tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "GET /compute/v2.1/servers/5ae8b5a0-e56c-4154-a487-080d996d54d3" status: 200 len: 1309 microversion: 2.1 time: 0.472474 Aug 10 23:20:28.697574 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2313/4809] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:20:28 2022] GET /compute/v2.1/servers/5ae8b5a0-e56c-4154-a487-080d996d54d3 => generated 1309 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:20:28.950372 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-ddda1353-99be-4df7-8212-bb94457222e2 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Calling method '.version_select at 0x7f847d15b940>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:28.984159 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-ddda1353-99be-4df7-8212-bb94457222e2 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1953386696" status: 202 len: 0 microversion: 2.1 time: 0.038014 Aug 10 23:20:28.984662 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2314/4810] 10.222.0.58 () {58 vars in 1284 bytes} [Wed Aug 10 23:20:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1953386696 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 10 23:20:29.023504 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-ec031e68-b30c-43f2-b105-9087ef3b124b tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Action: 'create', calling method: .version_select at 0x7f847d7c28b0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1298960212", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJQu7sERB6M4EnB2OenkBaQrR6HL3knrL8jAmwa2UJb2b4aC+NazyY166e8gI6K7+EKxdZDyhGq7aDkmWV7y2U5UqX+BLEcrs/P21W02N/6BFSXBBW25+i73SrV1py39Cw=="}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:20:29.049820 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-ec031e68-b30c-43f2-b105-9087ef3b124b tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Getting quotas for project 25abd63376614081a9d484f3c9ae950d. Resources: {'key_pairs'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:20:29.062488 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-ec031e68-b30c-43f2-b105-9087ef3b124b tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Getting quotas for user 5899b2ad9f1046caaf7c6073e408eeee and project 25abd63376614081a9d484f3c9ae950d. Resources: {'key_pairs'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:20:29.085951 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:20:29.097536 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-ec031e68-b30c-43f2-b105-9087ef3b124b tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.079454 Aug 10 23:20:29.104823 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2315/4811] 10.222.0.58 () {60 vars in 1159 bytes} [Wed Aug 10 23:20:29 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 23:20:29.104823 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-76441f04-1a11-4c00-9806-0e6a3b352bf8 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:29.104823 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-76441f04-1a11-4c00-9806-0e6a3b352bf8 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] [instance: 364415e0-931a-4be4-8149-86eb03e99544] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:29.114501 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-76441f04-1a11-4c00-9806-0e6a3b352bf8 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:29.115125 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-76441f04-1a11-4c00-9806-0e6a3b352bf8 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:29.115691 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-76441f04-1a11-4c00-9806-0e6a3b352bf8 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:29.116488 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-76441f04-1a11-4c00-9806-0e6a3b352bf8 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:29.117153 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-76441f04-1a11-4c00-9806-0e6a3b352bf8 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:29.117704 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-76441f04-1a11-4c00-9806-0e6a3b352bf8 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:29.122643 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-85ab7e13-ec31-4110-9015-8a741cb90ffd tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0d39db7158452d8b9ab2a4eeec786e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09d9809383a48d3915a3b6fd045fcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:29.138354 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-85ab7e13-ec31-4110-9015-8a741cb90ffd tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] 10.222.0.58 "GET /compute/v2.1/servers/ff959855-a396-4cce-9233-120a7d3f4cc9" status: 200 len: 1325 microversion: 2.1 time: 0.557719 Aug 10 23:20:29.139869 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2497/4812] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:20:28 2022] GET /compute/v2.1/servers/ff959855-a396-4cce-9233-120a7d3f4cc9 => generated 1325 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:20:29.215045 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-37771f37-374b-4e0b-8c51-f8a5dfa56ee5 req-15494f27-9eb9-4f38-8c31-c8b3249cf6e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ae8b5a0-e56c-4154-a487-080d996d54d3", "name": "network-vif-plugged", "status": "completed", "tag": "dce83ee8-37ec-4913-9b31-22429243af3d"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:20:29.241259 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-37771f37-374b-4e0b-8c51-f8a5dfa56ee5 req-15494f27-9eb9-4f38-8c31-c8b3249cf6e4 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:29.241661 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-37771f37-374b-4e0b-8c51-f8a5dfa56ee5 req-15494f27-9eb9-4f38-8c31-c8b3249cf6e4 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:29.242088 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-37771f37-374b-4e0b-8c51-f8a5dfa56ee5 req-15494f27-9eb9-4f38-8c31-c8b3249cf6e4 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:29.283654 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-37771f37-374b-4e0b-8c51-f8a5dfa56ee5 req-15494f27-9eb9-4f38-8c31-c8b3249cf6e4 service nova] Creating event network-vif-plugged:dce83ee8-37ec-4913-9b31-22429243af3d for instance 5ae8b5a0-e56c-4154-a487-080d996d54d3 on n-h2-850468-14 Aug 10 23:20:29.291953 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-37771f37-374b-4e0b-8c51-f8a5dfa56ee5 req-15494f27-9eb9-4f38-8c31-c8b3249cf6e4 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080526 Aug 10 23:20:29.292905 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2498/4813] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:20:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 23:20:29.307121 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-76441f04-1a11-4c00-9806-0e6a3b352bf8 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65fc7792249b4daca6a39f7259d2236c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3661cd206d19455eb1c4ac3dd988a67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:29.321449 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-76441f04-1a11-4c00-9806-0e6a3b352bf8 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65fc7792249b4daca6a39f7259d2236c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3661cd206d19455eb1c4ac3dd988a67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:29.324069 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-76441f04-1a11-4c00-9806-0e6a3b352bf8 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65fc7792249b4daca6a39f7259d2236c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3661cd206d19455eb1c4ac3dd988a67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:29.326271 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-76441f04-1a11-4c00-9806-0e6a3b352bf8 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] 10.222.0.58 "GET /compute/v2.1/servers/364415e0-931a-4be4-8149-86eb03e99544" status: 200 len: 1366 microversion: 2.47 time: 0.226896 Aug 10 23:20:29.327384 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2316/4814] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:20:29 2022] GET /compute/v2.1/servers/364415e0-931a-4be4-8149-86eb03e99544 => generated 1366 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:20:29.714695 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-74e306d3-238b-4ecd-9807-a8824f23ef1d tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:29.715425 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-74e306d3-238b-4ecd-9807-a8824f23ef1d tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: 5ae8b5a0-e56c-4154-a487-080d996d54d3] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:29.723586 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-74e306d3-238b-4ecd-9807-a8824f23ef1d tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:29.724273 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-74e306d3-238b-4ecd-9807-a8824f23ef1d tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:29.724711 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-74e306d3-238b-4ecd-9807-a8824f23ef1d tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:29.725591 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-74e306d3-238b-4ecd-9807-a8824f23ef1d tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:29.726212 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-74e306d3-238b-4ecd-9807-a8824f23ef1d tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:29.726635 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-74e306d3-238b-4ecd-9807-a8824f23ef1d tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:29.960329 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-74e306d3-238b-4ecd-9807-a8824f23ef1d tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6684f0c87e4242be9e0ffb4ef1973f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0582ace9e4443b8ad88915503ee630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:29.978505 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-74e306d3-238b-4ecd-9807-a8824f23ef1d tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "GET /compute/v2.1/servers/5ae8b5a0-e56c-4154-a487-080d996d54d3" status: 200 len: 1309 microversion: 2.1 time: 0.268147 Aug 10 23:20:29.979504 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2499/4815] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:20:29 2022] GET /compute/v2.1/servers/5ae8b5a0-e56c-4154-a487-080d996d54d3 => generated 1309 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:20:30.176090 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-8dbfacaa-1d96-4a52-8d62-4cafa76fe045 tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:30.180402 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-8dbfacaa-1d96-4a52-8d62-4cafa76fe045 tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] [instance: ff959855-a396-4cce-9233-120a7d3f4cc9] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:30.205395 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8dbfacaa-1d96-4a52-8d62-4cafa76fe045 tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:30.208590 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8dbfacaa-1d96-4a52-8d62-4cafa76fe045 tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:30.211593 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8dbfacaa-1d96-4a52-8d62-4cafa76fe045 tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:30.213464 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8dbfacaa-1d96-4a52-8d62-4cafa76fe045 tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:30.214270 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8dbfacaa-1d96-4a52-8d62-4cafa76fe045 tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:30.214847 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8dbfacaa-1d96-4a52-8d62-4cafa76fe045 tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:30.352655 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-f8caf98d-f403-4e6c-aac0-e975ec196d5b tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:30.353268 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-f8caf98d-f403-4e6c-aac0-e975ec196d5b tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] [instance: 364415e0-931a-4be4-8149-86eb03e99544] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:30.360360 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f8caf98d-f403-4e6c-aac0-e975ec196d5b tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:30.361047 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f8caf98d-f403-4e6c-aac0-e975ec196d5b tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:30.361702 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f8caf98d-f403-4e6c-aac0-e975ec196d5b tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:30.362671 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f8caf98d-f403-4e6c-aac0-e975ec196d5b tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:30.363393 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f8caf98d-f403-4e6c-aac0-e975ec196d5b tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:30.364016 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f8caf98d-f403-4e6c-aac0-e975ec196d5b tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:30.451498 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-f8caf98d-f403-4e6c-aac0-e975ec196d5b tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65fc7792249b4daca6a39f7259d2236c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3661cd206d19455eb1c4ac3dd988a67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:30.468209 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-f8caf98d-f403-4e6c-aac0-e975ec196d5b tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65fc7792249b4daca6a39f7259d2236c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3661cd206d19455eb1c4ac3dd988a67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:30.470264 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-f8caf98d-f403-4e6c-aac0-e975ec196d5b tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65fc7792249b4daca6a39f7259d2236c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3661cd206d19455eb1c4ac3dd988a67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:30.472755 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-f8caf98d-f403-4e6c-aac0-e975ec196d5b tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] 10.222.0.58 "GET /compute/v2.1/servers/364415e0-931a-4be4-8149-86eb03e99544" status: 200 len: 1366 microversion: 2.47 time: 0.123122 Aug 10 23:20:30.474465 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2500/4816] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:20:30 2022] GET /compute/v2.1/servers/364415e0-931a-4be4-8149-86eb03e99544 => generated 1366 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 23:20:30.484497 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-8dbfacaa-1d96-4a52-8d62-4cafa76fe045 tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0d39db7158452d8b9ab2a4eeec786e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09d9809383a48d3915a3b6fd045fcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:30.493207 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-8dbfacaa-1d96-4a52-8d62-4cafa76fe045 tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] 10.222.0.58 "GET /compute/v2.1/servers/ff959855-a396-4cce-9233-120a7d3f4cc9" status: 200 len: 1325 microversion: 2.1 time: 0.332102 Aug 10 23:20:30.494171 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2317/4817] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:20:30 2022] GET /compute/v2.1/servers/ff959855-a396-4cce-9233-120a7d3f4cc9 => generated 1325 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:20:31.013425 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-845b3be7-dcfc-4f38-adbf-37a2d0b758f2 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:31.014094 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-845b3be7-dcfc-4f38-adbf-37a2d0b758f2 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: 5ae8b5a0-e56c-4154-a487-080d996d54d3] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:31.022634 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-845b3be7-dcfc-4f38-adbf-37a2d0b758f2 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:31.023191 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-845b3be7-dcfc-4f38-adbf-37a2d0b758f2 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:31.023642 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-845b3be7-dcfc-4f38-adbf-37a2d0b758f2 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:31.024355 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-845b3be7-dcfc-4f38-adbf-37a2d0b758f2 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:31.025300 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-845b3be7-dcfc-4f38-adbf-37a2d0b758f2 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:31.025966 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-845b3be7-dcfc-4f38-adbf-37a2d0b758f2 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:31.320501 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-845b3be7-dcfc-4f38-adbf-37a2d0b758f2 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6684f0c87e4242be9e0ffb4ef1973f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0582ace9e4443b8ad88915503ee630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:31.332570 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-845b3be7-dcfc-4f38-adbf-37a2d0b758f2 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "GET /compute/v2.1/servers/5ae8b5a0-e56c-4154-a487-080d996d54d3" status: 200 len: 1490 microversion: 2.1 time: 0.323079 Aug 10 23:20:31.342837 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2501/4818] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:20:31 2022] GET /compute/v2.1/servers/5ae8b5a0-e56c-4154-a487-080d996d54d3 => generated 1490 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:20:31.359399 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-60ebcd2c-e050-4e66-87f7-40d4888762af req-b9dcc66d-aaf9-45e4-86d7-46c605939275 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff959855-a396-4cce-9233-120a7d3f4cc9", "name": "network-vif-plugged", "status": "completed", "tag": "cb873f8c-37f1-423b-9bdc-77f8a729e19c"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:20:31.359615 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-53bc0c48-f7a6-4126-9f15-c4df57ee18e0 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:31.364757 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-53bc0c48-f7a6-4126-9f15-c4df57ee18e0 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: 53003fff-46d7-4621-93fb-c2751572bb90] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:31.375430 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-60ebcd2c-e050-4e66-87f7-40d4888762af req-b9dcc66d-aaf9-45e4-86d7-46c605939275 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:31.376746 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-60ebcd2c-e050-4e66-87f7-40d4888762af req-b9dcc66d-aaf9-45e4-86d7-46c605939275 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:31.377355 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-60ebcd2c-e050-4e66-87f7-40d4888762af req-b9dcc66d-aaf9-45e4-86d7-46c605939275 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:31.384022 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-53bc0c48-f7a6-4126-9f15-c4df57ee18e0 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:31.384569 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-53bc0c48-f7a6-4126-9f15-c4df57ee18e0 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:31.388285 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-53bc0c48-f7a6-4126-9f15-c4df57ee18e0 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:31.389225 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-53bc0c48-f7a6-4126-9f15-c4df57ee18e0 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:31.389874 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-53bc0c48-f7a6-4126-9f15-c4df57ee18e0 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:31.390506 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-53bc0c48-f7a6-4126-9f15-c4df57ee18e0 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:31.396391 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-60ebcd2c-e050-4e66-87f7-40d4888762af req-b9dcc66d-aaf9-45e4-86d7-46c605939275 service nova] Creating event network-vif-plugged:cb873f8c-37f1-423b-9bdc-77f8a729e19c for instance ff959855-a396-4cce-9233-120a7d3f4cc9 on n-h2-850468-14 Aug 10 23:20:31.404968 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-60ebcd2c-e050-4e66-87f7-40d4888762af req-b9dcc66d-aaf9-45e4-86d7-46c605939275 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058491 Aug 10 23:20:31.405596 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2318/4819] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:20:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:20:31.518065 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-b29fbe1b-793f-4bd2-a019-26986a8ce9b2 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:31.520115 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-b29fbe1b-793f-4bd2-a019-26986a8ce9b2 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] [instance: 364415e0-931a-4be4-8149-86eb03e99544] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:31.533332 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b29fbe1b-793f-4bd2-a019-26986a8ce9b2 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:31.533828 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b29fbe1b-793f-4bd2-a019-26986a8ce9b2 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:31.535534 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b29fbe1b-793f-4bd2-a019-26986a8ce9b2 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:31.543238 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b29fbe1b-793f-4bd2-a019-26986a8ce9b2 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:31.543967 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b29fbe1b-793f-4bd2-a019-26986a8ce9b2 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:31.548097 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b29fbe1b-793f-4bd2-a019-26986a8ce9b2 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:31.658021 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-53bc0c48-f7a6-4126-9f15-c4df57ee18e0 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6684f0c87e4242be9e0ffb4ef1973f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0582ace9e4443b8ad88915503ee630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:31.666813 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-53bc0c48-f7a6-4126-9f15-c4df57ee18e0 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "GET /compute/v2.1/servers/53003fff-46d7-4621-93fb-c2751572bb90" status: 200 len: 1489 microversion: 2.1 time: 0.311903 Aug 10 23:20:31.668009 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2502/4820] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:20:31 2022] GET /compute/v2.1/servers/53003fff-46d7-4621-93fb-c2751572bb90 => generated 1489 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:20:31.673038 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-15b2e70c-a6c5-43b5-953b-17b51fb337ed tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:31.673659 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-15b2e70c-a6c5-43b5-953b-17b51fb337ed tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] [instance: ff959855-a396-4cce-9233-120a7d3f4cc9] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:31.689496 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-15b2e70c-a6c5-43b5-953b-17b51fb337ed tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:31.690248 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-15b2e70c-a6c5-43b5-953b-17b51fb337ed tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:31.692164 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-15b2e70c-a6c5-43b5-953b-17b51fb337ed tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:31.694261 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-15b2e70c-a6c5-43b5-953b-17b51fb337ed tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:31.694987 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-15b2e70c-a6c5-43b5-953b-17b51fb337ed tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:31.695638 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-15b2e70c-a6c5-43b5-953b-17b51fb337ed tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:31.698351 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-b29fbe1b-793f-4bd2-a019-26986a8ce9b2 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65fc7792249b4daca6a39f7259d2236c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3661cd206d19455eb1c4ac3dd988a67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:31.710935 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-b29fbe1b-793f-4bd2-a019-26986a8ce9b2 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65fc7792249b4daca6a39f7259d2236c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3661cd206d19455eb1c4ac3dd988a67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:31.713148 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-b29fbe1b-793f-4bd2-a019-26986a8ce9b2 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65fc7792249b4daca6a39f7259d2236c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3661cd206d19455eb1c4ac3dd988a67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:31.714363 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-b29fbe1b-793f-4bd2-a019-26986a8ce9b2 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] 10.222.0.58 "GET /compute/v2.1/servers/364415e0-931a-4be4-8149-86eb03e99544" status: 200 len: 1366 microversion: 2.47 time: 0.215296 Aug 10 23:20:31.715715 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2319/4821] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:20:31 2022] GET /compute/v2.1/servers/364415e0-931a-4be4-8149-86eb03e99544 => generated 1366 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 23:20:31.722575 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-d0183ce7-87ec-45a3-8207-cfa9d9521fd1 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:31.723547 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-d0183ce7-87ec-45a3-8207-cfa9d9521fd1 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: 5ae8b5a0-e56c-4154-a487-080d996d54d3] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:31.730858 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d0183ce7-87ec-45a3-8207-cfa9d9521fd1 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:31.731616 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d0183ce7-87ec-45a3-8207-cfa9d9521fd1 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:31.732226 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d0183ce7-87ec-45a3-8207-cfa9d9521fd1 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:31.733103 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d0183ce7-87ec-45a3-8207-cfa9d9521fd1 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:31.733777 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d0183ce7-87ec-45a3-8207-cfa9d9521fd1 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:31.734857 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d0183ce7-87ec-45a3-8207-cfa9d9521fd1 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:31.878186 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-15b2e70c-a6c5-43b5-953b-17b51fb337ed tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0d39db7158452d8b9ab2a4eeec786e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09d9809383a48d3915a3b6fd045fcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:31.887782 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-15b2e70c-a6c5-43b5-953b-17b51fb337ed tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] 10.222.0.58 "GET /compute/v2.1/servers/ff959855-a396-4cce-9233-120a7d3f4cc9" status: 200 len: 1325 microversion: 2.1 time: 0.218416 Aug 10 23:20:31.888690 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2503/4822] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:20:31 2022] GET /compute/v2.1/servers/ff959855-a396-4cce-9233-120a7d3f4cc9 => generated 1325 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:20:32.092814 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-d0183ce7-87ec-45a3-8207-cfa9d9521fd1 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6684f0c87e4242be9e0ffb4ef1973f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0582ace9e4443b8ad88915503ee630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:32.102186 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-d0183ce7-87ec-45a3-8207-cfa9d9521fd1 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "GET /compute/v2.1/servers/5ae8b5a0-e56c-4154-a487-080d996d54d3" status: 200 len: 1490 microversion: 2.1 time: 0.385105 Aug 10 23:20:32.103334 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2320/4823] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:20:31 2022] GET /compute/v2.1/servers/5ae8b5a0-e56c-4154-a487-080d996d54d3 => generated 1490 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:20:32.126254 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-7edf15b0-c225-4571-902f-3fbcb748d0fe tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:32.127063 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-7edf15b0-c225-4571-902f-3fbcb748d0fe tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: 5ae8b5a0-e56c-4154-a487-080d996d54d3] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:32.135974 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7edf15b0-c225-4571-902f-3fbcb748d0fe tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:32.136762 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7edf15b0-c225-4571-902f-3fbcb748d0fe tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:32.137366 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7edf15b0-c225-4571-902f-3fbcb748d0fe tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:32.138237 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7edf15b0-c225-4571-902f-3fbcb748d0fe tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:32.138882 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7edf15b0-c225-4571-902f-3fbcb748d0fe tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:32.139492 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7edf15b0-c225-4571-902f-3fbcb748d0fe tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:32.170081 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-7edf15b0-c225-4571-902f-3fbcb748d0fe tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: 5ae8b5a0-e56c-4154-a487-080d996d54d3] Going to try to terminate instance {{(pid=122633) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:20:32.327219 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-7edf15b0-c225-4571-902f-3fbcb748d0fe tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "DELETE /compute/v2.1/servers/5ae8b5a0-e56c-4154-a487-080d996d54d3" status: 204 len: 0 microversion: 2.1 time: 0.207070 Aug 10 23:20:32.328080 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2504/4824] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:20:32 2022] DELETE /compute/v2.1/servers/5ae8b5a0-e56c-4154-a487-080d996d54d3 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:20:32.337186 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-b9db9561-f5ed-4162-af0f-a71803e2dcd2 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:32.337864 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-b9db9561-f5ed-4162-af0f-a71803e2dcd2 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: 5ae8b5a0-e56c-4154-a487-080d996d54d3] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:32.344871 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b9db9561-f5ed-4162-af0f-a71803e2dcd2 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:32.345720 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b9db9561-f5ed-4162-af0f-a71803e2dcd2 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:32.346339 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b9db9561-f5ed-4162-af0f-a71803e2dcd2 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:32.347431 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b9db9561-f5ed-4162-af0f-a71803e2dcd2 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:32.348155 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b9db9561-f5ed-4162-af0f-a71803e2dcd2 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:32.348775 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b9db9561-f5ed-4162-af0f-a71803e2dcd2 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:32.686300 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-b9db9561-f5ed-4162-af0f-a71803e2dcd2 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6684f0c87e4242be9e0ffb4ef1973f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0582ace9e4443b8ad88915503ee630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:32.695027 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-b9db9561-f5ed-4162-af0f-a71803e2dcd2 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "GET /compute/v2.1/servers/5ae8b5a0-e56c-4154-a487-080d996d54d3" status: 200 len: 1496 microversion: 2.1 time: 0.361890 Aug 10 23:20:32.696484 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2321/4825] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:20:32 2022] GET /compute/v2.1/servers/5ae8b5a0-e56c-4154-a487-080d996d54d3 => generated 1496 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:20:32.745246 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-15739b4d-1334-4cfa-8961-9fc6b536f6ca tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:32.746708 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-15739b4d-1334-4cfa-8961-9fc6b536f6ca tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] [instance: 364415e0-931a-4be4-8149-86eb03e99544] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:32.752809 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-15739b4d-1334-4cfa-8961-9fc6b536f6ca tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:32.754236 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-15739b4d-1334-4cfa-8961-9fc6b536f6ca tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:32.754554 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-15739b4d-1334-4cfa-8961-9fc6b536f6ca tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:32.755565 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-15739b4d-1334-4cfa-8961-9fc6b536f6ca tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:32.756107 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-15739b4d-1334-4cfa-8961-9fc6b536f6ca tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:32.756632 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-15739b4d-1334-4cfa-8961-9fc6b536f6ca tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:32.761323 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:20:32.838293 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-15739b4d-1334-4cfa-8961-9fc6b536f6ca tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65fc7792249b4daca6a39f7259d2236c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3661cd206d19455eb1c4ac3dd988a67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:32.852368 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-15739b4d-1334-4cfa-8961-9fc6b536f6ca tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65fc7792249b4daca6a39f7259d2236c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3661cd206d19455eb1c4ac3dd988a67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:32.854707 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-15739b4d-1334-4cfa-8961-9fc6b536f6ca tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65fc7792249b4daca6a39f7259d2236c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3661cd206d19455eb1c4ac3dd988a67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:32.856433 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-15739b4d-1334-4cfa-8961-9fc6b536f6ca tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] 10.222.0.58 "GET /compute/v2.1/servers/364415e0-931a-4be4-8149-86eb03e99544" status: 200 len: 1366 microversion: 2.47 time: 0.116002 Aug 10 23:20:32.858884 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2505/4826] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:20:32 2022] GET /compute/v2.1/servers/364415e0-931a-4be4-8149-86eb03e99544 => generated 1366 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:20:32.909304 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-545dfaee-9707-4937-b46d-24d0fee76af6 tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:32.910312 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-545dfaee-9707-4937-b46d-24d0fee76af6 tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] [instance: ff959855-a396-4cce-9233-120a7d3f4cc9] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:32.919176 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-545dfaee-9707-4937-b46d-24d0fee76af6 tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:32.919821 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-545dfaee-9707-4937-b46d-24d0fee76af6 tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:32.920593 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-545dfaee-9707-4937-b46d-24d0fee76af6 tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:32.922069 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-545dfaee-9707-4937-b46d-24d0fee76af6 tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:32.922858 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-545dfaee-9707-4937-b46d-24d0fee76af6 tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:32.923857 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-545dfaee-9707-4937-b46d-24d0fee76af6 tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:33.689968 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-545dfaee-9707-4937-b46d-24d0fee76af6 tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0d39db7158452d8b9ab2a4eeec786e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09d9809383a48d3915a3b6fd045fcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:33.695742 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=100 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:20:33.702129 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-545dfaee-9707-4937-b46d-24d0fee76af6 tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] 10.222.0.58 "GET /compute/v2.1/servers/ff959855-a396-4cce-9233-120a7d3f4cc9" status: 200 len: 1325 microversion: 2.1 time: 0.797501 Aug 10 23:20:33.703397 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2322/4827] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:20:32 2022] GET /compute/v2.1/servers/ff959855-a396-4cce-9233-120a7d3f4cc9 => generated 1325 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:20:33.721490 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c84d616c-21cc-456d-8a14-f3728cb6986f tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:33.723019 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-c84d616c-21cc-456d-8a14-f3728cb6986f tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: 5ae8b5a0-e56c-4154-a487-080d996d54d3] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:33.733485 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c84d616c-21cc-456d-8a14-f3728cb6986f tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:33.734474 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c84d616c-21cc-456d-8a14-f3728cb6986f tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:33.735135 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c84d616c-21cc-456d-8a14-f3728cb6986f tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:33.736106 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c84d616c-21cc-456d-8a14-f3728cb6986f tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:33.736920 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c84d616c-21cc-456d-8a14-f3728cb6986f tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:33.738247 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c84d616c-21cc-456d-8a14-f3728cb6986f tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:33.894664 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-821e0192-abf2-42c2-ba93-7ea62f4c995e tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:33.897076 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-821e0192-abf2-42c2-ba93-7ea62f4c995e tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] [instance: 364415e0-931a-4be4-8149-86eb03e99544] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:33.904596 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-821e0192-abf2-42c2-ba93-7ea62f4c995e tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:33.907868 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-821e0192-abf2-42c2-ba93-7ea62f4c995e tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:33.908594 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-821e0192-abf2-42c2-ba93-7ea62f4c995e tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:33.909844 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-821e0192-abf2-42c2-ba93-7ea62f4c995e tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:33.911083 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-821e0192-abf2-42c2-ba93-7ea62f4c995e tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:33.911746 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-821e0192-abf2-42c2-ba93-7ea62f4c995e tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:34.050974 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-c84d616c-21cc-456d-8a14-f3728cb6986f tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6684f0c87e4242be9e0ffb4ef1973f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0582ace9e4443b8ad88915503ee630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:34.056275 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-821e0192-abf2-42c2-ba93-7ea62f4c995e tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65fc7792249b4daca6a39f7259d2236c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3661cd206d19455eb1c4ac3dd988a67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:34.075121 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-c84d616c-21cc-456d-8a14-f3728cb6986f tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "GET /compute/v2.1/servers/5ae8b5a0-e56c-4154-a487-080d996d54d3" status: 200 len: 1496 microversion: 2.1 time: 0.357538 Aug 10 23:20:34.076111 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2506/4828] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:20:33 2022] GET /compute/v2.1/servers/5ae8b5a0-e56c-4154-a487-080d996d54d3 => generated 1496 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:20:34.076257 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-821e0192-abf2-42c2-ba93-7ea62f4c995e tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65fc7792249b4daca6a39f7259d2236c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3661cd206d19455eb1c4ac3dd988a67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:34.081764 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-821e0192-abf2-42c2-ba93-7ea62f4c995e tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65fc7792249b4daca6a39f7259d2236c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3661cd206d19455eb1c4ac3dd988a67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:34.083518 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-821e0192-abf2-42c2-ba93-7ea62f4c995e tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] 10.222.0.58 "GET /compute/v2.1/servers/364415e0-931a-4be4-8149-86eb03e99544" status: 200 len: 1366 microversion: 2.47 time: 0.205314 Aug 10 23:20:34.100190 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2323/4829] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:20:33 2022] GET /compute/v2.1/servers/364415e0-931a-4be4-8149-86eb03e99544 => generated 1366 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 23:20:34.724575 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-3e3d5dd0-5e89-4caf-852b-c1a023832af0 tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:34.725279 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-3e3d5dd0-5e89-4caf-852b-c1a023832af0 tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] [instance: ff959855-a396-4cce-9233-120a7d3f4cc9] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:34.732886 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3e3d5dd0-5e89-4caf-852b-c1a023832af0 tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:34.733912 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3e3d5dd0-5e89-4caf-852b-c1a023832af0 tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:34.734587 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3e3d5dd0-5e89-4caf-852b-c1a023832af0 tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:34.735578 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3e3d5dd0-5e89-4caf-852b-c1a023832af0 tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:34.736288 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3e3d5dd0-5e89-4caf-852b-c1a023832af0 tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:34.736951 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3e3d5dd0-5e89-4caf-852b-c1a023832af0 tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:35.098049 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-acf1376b-a859-40fe-8551-be140c0a867b tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:35.098648 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-acf1376b-a859-40fe-8551-be140c0a867b tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: 5ae8b5a0-e56c-4154-a487-080d996d54d3] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:35.117597 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-acf1376b-a859-40fe-8551-be140c0a867b tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:35.118105 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-acf1376b-a859-40fe-8551-be140c0a867b tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:35.118555 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-acf1376b-a859-40fe-8551-be140c0a867b tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:35.119320 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-acf1376b-a859-40fe-8551-be140c0a867b tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:35.119786 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-acf1376b-a859-40fe-8551-be140c0a867b tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:35.120217 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-acf1376b-a859-40fe-8551-be140c0a867b tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:35.605703 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-3e3d5dd0-5e89-4caf-852b-c1a023832af0 tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0d39db7158452d8b9ab2a4eeec786e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09d9809383a48d3915a3b6fd045fcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:35.618727 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-3e3d5dd0-5e89-4caf-852b-c1a023832af0 tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] 10.222.0.58 "GET /compute/v2.1/servers/ff959855-a396-4cce-9233-120a7d3f4cc9" status: 200 len: 1521 microversion: 2.1 time: 0.898529 Aug 10 23:20:35.619605 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2507/4830] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:20:34 2022] GET /compute/v2.1/servers/ff959855-a396-4cce-9233-120a7d3f4cc9 => generated 1521 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:20:35.628898 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-acf1376b-a859-40fe-8551-be140c0a867b tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6684f0c87e4242be9e0ffb4ef1973f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0582ace9e4443b8ad88915503ee630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:35.637363 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-7c674917-038a-4ab3-86c4-39bf93cec248 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:35.639010 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-7c674917-038a-4ab3-86c4-39bf93cec248 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] [instance: 364415e0-931a-4be4-8149-86eb03e99544] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:35.648305 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-acf1376b-a859-40fe-8551-be140c0a867b tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "GET /compute/v2.1/servers/5ae8b5a0-e56c-4154-a487-080d996d54d3" status: 200 len: 1496 microversion: 2.1 time: 0.550425 Aug 10 23:20:35.658807 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2324/4831] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:20:35 2022] GET /compute/v2.1/servers/5ae8b5a0-e56c-4154-a487-080d996d54d3 => generated 1496 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:20:35.659210 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7c674917-038a-4ab3-86c4-39bf93cec248 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:35.659210 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7c674917-038a-4ab3-86c4-39bf93cec248 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:35.659210 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7c674917-038a-4ab3-86c4-39bf93cec248 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:35.659210 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7c674917-038a-4ab3-86c4-39bf93cec248 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:35.659642 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7c674917-038a-4ab3-86c4-39bf93cec248 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:35.661680 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7c674917-038a-4ab3-86c4-39bf93cec248 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:35.664289 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-f1706252-e0f6-4bd2-8624-acc39598f1ee tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:35.667253 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-f1706252-e0f6-4bd2-8624-acc39598f1ee tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] [instance: a98455ed-1e70-4d9a-98a4-77262e588e87] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:35.688250 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f1706252-e0f6-4bd2-8624-acc39598f1ee tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:35.690155 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f1706252-e0f6-4bd2-8624-acc39598f1ee tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:35.691858 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f1706252-e0f6-4bd2-8624-acc39598f1ee tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:35.693470 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f1706252-e0f6-4bd2-8624-acc39598f1ee tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:35.696078 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f1706252-e0f6-4bd2-8624-acc39598f1ee tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:35.697526 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f1706252-e0f6-4bd2-8624-acc39598f1ee tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:35.758706 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-f1706252-e0f6-4bd2-8624-acc39598f1ee tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] 10.222.0.58 "GET /compute/v2.1/servers/a98455ed-1e70-4d9a-98a4-77262e588e87/ips" status: 200 len: 150 microversion: 2.1 time: 0.108251 Aug 10 23:20:35.763348 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2325/4832] 10.222.0.58 () {58 vars in 1248 bytes} [Wed Aug 10 23:20:35 2022] GET /compute/v2.1/servers/a98455ed-1e70-4d9a-98a4-77262e588e87/ips => generated 150 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:20:35.775374 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-0f3c9da1-ca92-4308-ae63-4b51e635996b tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:35.775875 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-0f3c9da1-ca92-4308-ae63-4b51e635996b tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] [instance: ff959855-a396-4cce-9233-120a7d3f4cc9] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:35.788915 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0f3c9da1-ca92-4308-ae63-4b51e635996b tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:35.790754 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0f3c9da1-ca92-4308-ae63-4b51e635996b tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:35.791234 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0f3c9da1-ca92-4308-ae63-4b51e635996b tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:35.794526 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0f3c9da1-ca92-4308-ae63-4b51e635996b tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:35.795367 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0f3c9da1-ca92-4308-ae63-4b51e635996b tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:35.795810 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0f3c9da1-ca92-4308-ae63-4b51e635996b tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:35.850339 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-0f3c9da1-ca92-4308-ae63-4b51e635996b tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] HTTP exception thrown: Instance is not a member of specified network Aug 10 23:20:35.858476 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-0f3c9da1-ca92-4308-ae63-4b51e635996b tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Request method failure captured: Aug 10 23:20:35.858476 n-d-850468-14 devstack@n-api.service[122632]: request: GET /compute/v2.1/servers/ff959855-a396-4cce-9233-120a7d3f4cc9/ips/invalid HTTP/1.1 Aug 10 23:20:35.858476 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:20:35.858476 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:20:35.858476 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:20:35.858476 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 23:20:35.858476 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:20:35.858476 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:20:35.858476 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:20:35.858476 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:20:35.858476 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9D0vRJ1RVk_JAM_nzht8rm-snnrniKG8W7poULWB-tDxItZnb17Rp9xLJO1gSaJC9brYLo4N0Gvdv5k2Xdzn0uuqeEdZbczL5B0CYX2waBiwPIZe5MW9LNm8Ii4X-APgE94qGp6BcC76dGck7yMpfvQm_gC7GODXuyVzt7YiXw-9Txo Aug 10 23:20:35.858476 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:20:35.858476 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:20:35.858476 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:20:35.858476 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:20:35.858476 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:20:35.858476 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:20:35.858476 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: e09d9809383a48d3915a3b6fd045fcdc Aug 10 23:20:35.858476 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-736615761 Aug 10 23:20:35.858476 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:20:35.858476 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:20:35.858476 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e09d9809383a48d3915a3b6fd045fcdc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e09d9809383a48d3915a3b6fd045fcdc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/e09d9809383a48d3915a3b6fd045fcdc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_e09d9809383a48d3915a3b6fd045fcdc", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:20:35.858476 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-736615761 Aug 10 23:20:35.858476 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: e09d9809383a48d3915a3b6fd045fcdc Aug 10 23:20:35.858476 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-736615761 Aug 10 23:20:35.858476 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-ServerAddressesNegativeTestJSON-736615761-project Aug 10 23:20:35.858476 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:20:35.858476 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:20:35.858476 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: ac0d39db7158452d8b9ab2a4eeec786e Aug 10 23:20:35.858476 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-736615761-project Aug 10 23:20:35.858476 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:20:35.858476 n-d-850468-14 devstack@n-api.service[122632]: exception: Instance is not a member of specified network Aug 10 23:20:35.858476 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'server_id': 'ff959855-a396-4cce-9233-120a7d3f4cc9', 'id': 'invalid'} Aug 10 23:20:35.858476 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:20:35.858476 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:20:35.858476 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:20:35.858476 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:20:35.858476 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:20:35.858476 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:20:35.858476 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:20:35.858476 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:20:35.858476 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show Aug 10 23:20:35.858476 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 10 23:20:35.858476 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network Aug 10 23:20:35.858476 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:20:35.858476 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:20:35.858476 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:20:35.858476 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:20:35.858476 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:20:35.858476 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:20:35.858476 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:20:35.858476 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:20:35.858476 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network Aug 10 23:20:35.858476 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:20:35.869820 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-7c674917-038a-4ab3-86c4-39bf93cec248 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65fc7792249b4daca6a39f7259d2236c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3661cd206d19455eb1c4ac3dd988a67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:35.883033 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-7c674917-038a-4ab3-86c4-39bf93cec248 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65fc7792249b4daca6a39f7259d2236c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3661cd206d19455eb1c4ac3dd988a67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:35.884092 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-0f3c9da1-ca92-4308-ae63-4b51e635996b tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Returning 404 to user: Instance is not a member of specified network {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:20:35.889261 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-0f3c9da1-ca92-4308-ae63-4b51e635996b tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] 10.222.0.58 "GET /compute/v2.1/servers/ff959855-a396-4cce-9233-120a7d3f4cc9/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.119828 Aug 10 23:20:35.890198 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2326/4833] 10.222.0.58 () {58 vars in 1272 bytes} [Wed Aug 10 23:20:35 2022] GET /compute/v2.1/servers/ff959855-a396-4cce-9233-120a7d3f4cc9/ips/invalid => generated 91 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 10 23:20:35.899910 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-7c674917-038a-4ab3-86c4-39bf93cec248 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65fc7792249b4daca6a39f7259d2236c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3661cd206d19455eb1c4ac3dd988a67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:35.905826 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-7c674917-038a-4ab3-86c4-39bf93cec248 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] 10.222.0.58 "GET /compute/v2.1/servers/364415e0-931a-4be4-8149-86eb03e99544" status: 200 len: 1366 microversion: 2.47 time: 0.282938 Aug 10 23:20:35.907667 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-6474003d-0134-4498-bac7-bcc583d89f64 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ba75fad6-85fb-4ae5-bee1-44e5e84a45e5"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:20:35.911205 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2508/4834] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:20:35 2022] GET /compute/v2.1/servers/364415e0-931a-4be4-8149-86eb03e99544 => generated 1366 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:20:35.920371 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-6474003d-0134-4498-bac7-bcc583d89f64 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] [instance: a98455ed-1e70-4d9a-98a4-77262e588e87] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:35.926714 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-0c06fe35-b709-468d-894b-b6f3f5e77b67 tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:35.932328 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-0c06fe35-b709-468d-894b-b6f3f5e77b67 tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Failed to fetch instance by id 999 {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2928}} Aug 10 23:20:35.933092 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-0c06fe35-b709-468d-894b-b6f3f5e77b67 tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] HTTP exception thrown: Instance 999 could not be found. Aug 10 23:20:35.944335 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-0c06fe35-b709-468d-894b-b6f3f5e77b67 tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Request method failure captured: Aug 10 23:20:35.944335 n-d-850468-14 devstack@n-api.service[122633]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 Aug 10 23:20:35.944335 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:20:35.944335 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:20:35.944335 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:20:35.944335 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:20:35.944335 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:20:35.944335 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:20:35.944335 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:20:35.944335 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:20:35.944335 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9D0vRJ1RVk_JAM_nzht8rm-snnrniKG8W7poULWB-tDxItZnb17Rp9xLJO1gSaJC9brYLo4N0Gvdv5k2Xdzn0uuqeEdZbczL5B0CYX2waBiwPIZe5MW9LNm8Ii4X-APgE94qGp6BcC76dGck7yMpfvQm_gC7GODXuyVzt7YiXw-9Txo Aug 10 23:20:35.944335 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:20:35.944335 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:20:35.944335 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:20:35.944335 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:20:35.944335 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:20:35.944335 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:20:35.944335 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: e09d9809383a48d3915a3b6fd045fcdc Aug 10 23:20:35.944335 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-736615761 Aug 10 23:20:35.944335 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:20:35.944335 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:20:35.944335 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e09d9809383a48d3915a3b6fd045fcdc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e09d9809383a48d3915a3b6fd045fcdc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/e09d9809383a48d3915a3b6fd045fcdc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_e09d9809383a48d3915a3b6fd045fcdc", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:20:35.944335 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-736615761 Aug 10 23:20:35.944335 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: e09d9809383a48d3915a3b6fd045fcdc Aug 10 23:20:35.944335 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-736615761 Aug 10 23:20:35.944335 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-ServerAddressesNegativeTestJSON-736615761-project Aug 10 23:20:35.944335 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:20:35.944335 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:20:35.944335 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: ac0d39db7158452d8b9ab2a4eeec786e Aug 10 23:20:35.944335 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-736615761-project Aug 10 23:20:35.944335 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:20:35.944335 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance 999 could not be found. Aug 10 23:20:35.944335 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'server_id': '999'} Aug 10 23:20:35.944335 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:20:35.944335 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:20:35.944335 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:20:35.944335 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:20:35.944335 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2929, in get Aug 10 23:20:35.944335 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 10 23:20:35.944335 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Aug 10 23:20:35.944335 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:20:35.944335 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:20:35.944335 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:20:35.944335 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:20:35.944335 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:20:35.944335 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:20:35.944335 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:20:35.944335 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:20:35.944335 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:20:35.944335 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:20:35.944335 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index Aug 10 23:20:35.944335 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) Aug 10 23:20:35.944335 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:20:35.944335 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:20:35.944335 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Aug 10 23:20:35.944335 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:20:35.944335 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:20:35.944335 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:20:35.944335 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:20:35.944335 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:20:35.944335 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:20:35.944335 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:20:35.944335 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:20:35.944335 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Aug 10 23:20:35.944335 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:20:35.959934 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-0c06fe35-b709-468d-894b-b6f3f5e77b67 tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Returning 404 to user: Instance 999 could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:20:35.960554 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6474003d-0134-4498-bac7-bcc583d89f64 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:35.961558 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6474003d-0134-4498-bac7-bcc583d89f64 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:35.962110 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6474003d-0134-4498-bac7-bcc583d89f64 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:35.962959 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6474003d-0134-4498-bac7-bcc583d89f64 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:35.963540 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6474003d-0134-4498-bac7-bcc583d89f64 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:35.964068 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6474003d-0134-4498-bac7-bcc583d89f64 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:35.965756 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-0c06fe35-b709-468d-894b-b6f3f5e77b67 tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] 10.222.0.58 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.050252 Aug 10 23:20:35.970498 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2509/4835] 10.222.0.58 () {58 vars in 1149 bytes} [Wed Aug 10 23:20:35 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 10 23:20:35.988078 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-574ed750-4193-4ab1-8f86-2dc5f847f649 tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:36.000331 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-574ed750-4193-4ab1-8f86-2dc5f847f649 tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] [instance: ff959855-a396-4cce-9233-120a7d3f4cc9] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:36.029498 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-574ed750-4193-4ab1-8f86-2dc5f847f649 tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:36.030371 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-574ed750-4193-4ab1-8f86-2dc5f847f649 tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:36.031039 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-574ed750-4193-4ab1-8f86-2dc5f847f649 tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:36.032181 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-574ed750-4193-4ab1-8f86-2dc5f847f649 tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:36.033650 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-574ed750-4193-4ab1-8f86-2dc5f847f649 tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:36.039598 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-574ed750-4193-4ab1-8f86-2dc5f847f649 tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:36.134715 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-574ed750-4193-4ab1-8f86-2dc5f847f649 tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] [instance: ff959855-a396-4cce-9233-120a7d3f4cc9] Going to try to terminate instance {{(pid=122633) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:20:36.238646 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-6474003d-0134-4498-bac7-bcc583d89f64 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] HTTP exception thrown: Invalid volume: volume ba75fad6-85fb-4ae5-bee1-44e5e84a45e5 is already attached to instances: b812cd8c-7e33-4e97-8df6-c7fccdf12019 Aug 10 23:20:36.242244 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-6474003d-0134-4498-bac7-bcc583d89f64 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Request method failure captured: Aug 10 23:20:36.242244 n-d-850468-14 devstack@n-api.service[122632]: request: POST /compute/v2.1/servers/a98455ed-1e70-4d9a-98a4-77262e588e87/os-volume_attachments HTTP/1.1 Aug 10 23:20:36.242244 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:20:36.242244 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:20:36.242244 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:20:36.242244 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 74 Aug 10 23:20:36.242244 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:20:36.242244 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:20:36.242244 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:20:36.242244 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:20:36.242244 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9Dyh6-R-3HT3qmAYw73oJfCuu2NJv_Uk6ESXtcq6VvNMtaQn1cTuz-I3qzoDfMZYBb14V5s9aXOf7KFvhR2arcnhZ5gC9SddHqo24MvVPxr7p8PNkuseL9l1-7bXrad-0RpRPdQnhZkSYtsPZXEtrxg11yCwwP1jlsEo-QBQNYEMWc4 Aug 10 23:20:36.242244 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:20:36.242244 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:20:36.242244 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:20:36.242244 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:20:36.242244 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:20:36.242244 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:20:36.242244 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 2b557edd165144c8943eb9acc339a377 Aug 10 23:20:36.242244 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-AttachVolumeNegativeTest-393353666 Aug 10 23:20:36.242244 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:20:36.242244 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:20:36.242244 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2b557edd165144c8943eb9acc339a377"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2b557edd165144c8943eb9acc339a377"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2b557edd165144c8943eb9acc339a377"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2b557edd165144c8943eb9acc339a377", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:20:36.242244 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-AttachVolumeNegativeTest-393353666 Aug 10 23:20:36.242244 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 2b557edd165144c8943eb9acc339a377 Aug 10 23:20:36.242244 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-393353666 Aug 10 23:20:36.242244 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-AttachVolumeNegativeTest-393353666-project Aug 10 23:20:36.242244 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:20:36.242244 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:20:36.242244 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: 0d89081084f14e0187f4c67cd9185fef Aug 10 23:20:36.242244 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-AttachVolumeNegativeTest-393353666-project Aug 10 23:20:36.242244 n-d-850468-14 devstack@n-api.service[122632]: Aug 10 23:20:36.242244 n-d-850468-14 devstack@n-api.service[122632]: {"volumeAttachment": {"volumeId": "ba75fad6-85fb-4ae5-bee1-44e5e84a45e5"}} Aug 10 23:20:36.242244 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:20:36.242244 n-d-850468-14 devstack@n-api.service[122632]: exception: Invalid volume: volume ba75fad6-85fb-4ae5-bee1-44e5e84a45e5 is already attached to instances: b812cd8c-7e33-4e97-8df6-c7fccdf12019 Aug 10 23:20:36.242244 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'server_id': 'a98455ed-1e70-4d9a-98a4-77262e588e87', 'body': {'volumeAttachment': {'volumeId': 'ba75fad6-85fb-4ae5-bee1-44e5e84a45e5'}}} Aug 10 23:20:36.242244 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:20:36.242244 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:20:36.242244 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 10 23:20:36.242244 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 10 23:20:36.242244 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 10 23:20:36.242244 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 10 23:20:36.242244 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 10 23:20:36.242244 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 10 23:20:36.242244 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5079, in attach_volume Aug 10 23:20:36.242244 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 10 23:20:36.242244 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4919, in _check_volume_already_attached Aug 10 23:20:36.242244 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 10 23:20:36.242244 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume ba75fad6-85fb-4ae5-bee1-44e5e84a45e5 is already attached to instances: b812cd8c-7e33-4e97-8df6-c7fccdf12019 Aug 10 23:20:36.242244 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:20:36.242244 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:20:36.242244 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:20:36.242244 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:20:36.242244 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:20:36.242244 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:20:36.242244 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:20:36.242244 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:20:36.242244 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:20:36.242244 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:20:36.242244 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 23:20:36.242244 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 23:20:36.242244 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 23:20:36.242244 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 23:20:36.248211 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 23:20:36.248211 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 23:20:36.248211 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 10 23:20:36.248211 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 10 23:20:36.248211 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume ba75fad6-85fb-4ae5-bee1-44e5e84a45e5 is already attached to instances: b812cd8c-7e33-4e97-8df6-c7fccdf12019 Aug 10 23:20:36.248211 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:20:36.248211 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:20:36.248211 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:20:36.248211 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:20:36.248211 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:20:36.248211 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:20:36.248211 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:20:36.248211 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:20:36.248211 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume ba75fad6-85fb-4ae5-bee1-44e5e84a45e5 is already attached to instances: b812cd8c-7e33-4e97-8df6-c7fccdf12019 Aug 10 23:20:36.248211 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:20:36.262061 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-6474003d-0134-4498-bac7-bcc583d89f64 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Returning 400 to user: Invalid volume: volume ba75fad6-85fb-4ae5-bee1-44e5e84a45e5 is already attached to instances: b812cd8c-7e33-4e97-8df6-c7fccdf12019 {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:20:36.264267 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-6474003d-0134-4498-bac7-bcc583d89f64 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] 10.222.0.58 "POST /compute/v2.1/servers/a98455ed-1e70-4d9a-98a4-77262e588e87/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.372771 Aug 10 23:20:36.273323 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2327/4836] 10.222.0.58 () {60 vars in 1323 bytes} [Wed Aug 10 23:20:35 2022] POST /compute/v2.1/servers/a98455ed-1e70-4d9a-98a4-77262e588e87/os-volume_attachments => generated 174 bytes in 382 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 10 23:20:36.284077 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-22aca8b7-925c-4de9-b0f8-9fbc3519522c tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:36.288183 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-22aca8b7-925c-4de9-b0f8-9fbc3519522c tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] [instance: a98455ed-1e70-4d9a-98a4-77262e588e87] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:36.308264 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-22aca8b7-925c-4de9-b0f8-9fbc3519522c tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:36.310727 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-22aca8b7-925c-4de9-b0f8-9fbc3519522c tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:36.311467 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-22aca8b7-925c-4de9-b0f8-9fbc3519522c tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:36.314957 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-22aca8b7-925c-4de9-b0f8-9fbc3519522c tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:36.315188 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-574ed750-4193-4ab1-8f86-2dc5f847f649 tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] 10.222.0.58 "DELETE /compute/v2.1/servers/ff959855-a396-4cce-9233-120a7d3f4cc9" status: 204 len: 0 microversion: 2.1 time: 0.341925 Aug 10 23:20:36.316513 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2510/4837] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:20:35 2022] DELETE /compute/v2.1/servers/ff959855-a396-4cce-9233-120a7d3f4cc9 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:20:36.319946 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-22aca8b7-925c-4de9-b0f8-9fbc3519522c tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:36.320852 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-22aca8b7-925c-4de9-b0f8-9fbc3519522c tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:36.328943 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-4c593c77-dd8c-4d60-b827-35b8fd8bdb58 tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:36.330128 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-4c593c77-dd8c-4d60-b827-35b8fd8bdb58 tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] [instance: ff959855-a396-4cce-9233-120a7d3f4cc9] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:36.339530 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4c593c77-dd8c-4d60-b827-35b8fd8bdb58 tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:36.340470 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4c593c77-dd8c-4d60-b827-35b8fd8bdb58 tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:36.341443 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4c593c77-dd8c-4d60-b827-35b8fd8bdb58 tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:36.342368 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4c593c77-dd8c-4d60-b827-35b8fd8bdb58 tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:36.343106 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4c593c77-dd8c-4d60-b827-35b8fd8bdb58 tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:36.343804 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4c593c77-dd8c-4d60-b827-35b8fd8bdb58 tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:36.376094 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-22aca8b7-925c-4de9-b0f8-9fbc3519522c tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] [instance: a98455ed-1e70-4d9a-98a4-77262e588e87] Going to try to terminate instance {{(pid=122632) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:20:36.563880 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-22aca8b7-925c-4de9-b0f8-9fbc3519522c tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] 10.222.0.58 "DELETE /compute/v2.1/servers/a98455ed-1e70-4d9a-98a4-77262e588e87" status: 204 len: 0 microversion: 2.1 time: 0.288390 Aug 10 23:20:36.565038 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2328/4838] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:20:36 2022] DELETE /compute/v2.1/servers/a98455ed-1e70-4d9a-98a4-77262e588e87 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:20:36.585117 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-4a976f42-0aee-48d1-9c23-329a47a2d7ba tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:36.585117 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-4a976f42-0aee-48d1-9c23-329a47a2d7ba tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] [instance: a98455ed-1e70-4d9a-98a4-77262e588e87] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:36.602486 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4a976f42-0aee-48d1-9c23-329a47a2d7ba tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:36.607424 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4a976f42-0aee-48d1-9c23-329a47a2d7ba tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:36.608001 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4a976f42-0aee-48d1-9c23-329a47a2d7ba tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:36.608762 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4a976f42-0aee-48d1-9c23-329a47a2d7ba tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:36.609225 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4a976f42-0aee-48d1-9c23-329a47a2d7ba tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:36.609710 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4a976f42-0aee-48d1-9c23-329a47a2d7ba tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:36.887988 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-4c593c77-dd8c-4d60-b827-35b8fd8bdb58 tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0d39db7158452d8b9ab2a4eeec786e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09d9809383a48d3915a3b6fd045fcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:36.908924 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-4c593c77-dd8c-4d60-b827-35b8fd8bdb58 tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] 10.222.0.58 "GET /compute/v2.1/servers/ff959855-a396-4cce-9233-120a7d3f4cc9" status: 200 len: 1527 microversion: 2.1 time: 0.585557 Aug 10 23:20:36.910346 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2511/4839] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:20:36 2022] GET /compute/v2.1/servers/ff959855-a396-4cce-9233-120a7d3f4cc9 => generated 1527 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:20:36.947916 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-635470c6-638d-4835-a884-c0f555568e88 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:36.948535 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-635470c6-638d-4835-a884-c0f555568e88 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: 5ae8b5a0-e56c-4154-a487-080d996d54d3] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:36.961368 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-635470c6-638d-4835-a884-c0f555568e88 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:36.962062 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-635470c6-638d-4835-a884-c0f555568e88 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:36.962730 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-635470c6-638d-4835-a884-c0f555568e88 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:36.964312 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-635470c6-638d-4835-a884-c0f555568e88 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:36.965065 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-635470c6-638d-4835-a884-c0f555568e88 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:36.965664 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-635470c6-638d-4835-a884-c0f555568e88 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:37.111696 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-635470c6-638d-4835-a884-c0f555568e88 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6684f0c87e4242be9e0ffb4ef1973f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0582ace9e4443b8ad88915503ee630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:37.121233 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-635470c6-638d-4835-a884-c0f555568e88 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "GET /compute/v2.1/servers/5ae8b5a0-e56c-4154-a487-080d996d54d3" status: 200 len: 1454 microversion: 2.1 time: 0.188616 Aug 10 23:20:37.131165 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2512/4840] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:20:36 2022] GET /compute/v2.1/servers/5ae8b5a0-e56c-4154-a487-080d996d54d3 => generated 1454 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:20:37.136683 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-3f24f7cc-11e1-467d-9f80-2383f3721a7a req-f05dbce0-5a58-40b7-843b-75f5b797b5e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ae8b5a0-e56c-4154-a487-080d996d54d3", "name": "network-vif-deleted", "tag": "dce83ee8-37ec-4913-9b31-22429243af3d"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:20:37.164015 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-3f24f7cc-11e1-467d-9f80-2383f3721a7a req-f05dbce0-5a58-40b7-843b-75f5b797b5e3 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:37.164780 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-3f24f7cc-11e1-467d-9f80-2383f3721a7a req-f05dbce0-5a58-40b7-843b-75f5b797b5e3 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:37.165389 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-3f24f7cc-11e1-467d-9f80-2383f3721a7a req-f05dbce0-5a58-40b7-843b-75f5b797b5e3 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:37.186647 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-3f24f7cc-11e1-467d-9f80-2383f3721a7a req-f05dbce0-5a58-40b7-843b-75f5b797b5e3 service nova] Creating event network-vif-deleted:dce83ee8-37ec-4913-9b31-22429243af3d for instance 5ae8b5a0-e56c-4154-a487-080d996d54d3 on n-h2-850468-14 Aug 10 23:20:37.201570 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-3f24f7cc-11e1-467d-9f80-2383f3721a7a req-f05dbce0-5a58-40b7-843b-75f5b797b5e3 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066046 Aug 10 23:20:37.203094 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2513/4841] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:20:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:20:37.215606 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c3ccad50-ffc7-43d0-ae6c-fd68dccb615f tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:37.217080 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-c3ccad50-ffc7-43d0-ae6c-fd68dccb615f tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] [instance: 364415e0-931a-4be4-8149-86eb03e99544] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:37.226933 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c3ccad50-ffc7-43d0-ae6c-fd68dccb615f tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:37.227886 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c3ccad50-ffc7-43d0-ae6c-fd68dccb615f tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:37.228830 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c3ccad50-ffc7-43d0-ae6c-fd68dccb615f tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:37.229919 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c3ccad50-ffc7-43d0-ae6c-fd68dccb615f tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:37.231642 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c3ccad50-ffc7-43d0-ae6c-fd68dccb615f tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:37.232364 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c3ccad50-ffc7-43d0-ae6c-fd68dccb615f tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:37.687223 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-c3ccad50-ffc7-43d0-ae6c-fd68dccb615f tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65fc7792249b4daca6a39f7259d2236c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3661cd206d19455eb1c4ac3dd988a67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:37.688146 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-4a976f42-0aee-48d1-9c23-329a47a2d7ba tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d89081084f14e0187f4c67cd9185fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b557edd165144c8943eb9acc339a377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:37.698168 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-c3ccad50-ffc7-43d0-ae6c-fd68dccb615f tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65fc7792249b4daca6a39f7259d2236c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3661cd206d19455eb1c4ac3dd988a67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:37.700230 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-c3ccad50-ffc7-43d0-ae6c-fd68dccb615f tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65fc7792249b4daca6a39f7259d2236c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3661cd206d19455eb1c4ac3dd988a67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:37.702659 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-c3ccad50-ffc7-43d0-ae6c-fd68dccb615f tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] 10.222.0.58 "GET /compute/v2.1/servers/364415e0-931a-4be4-8149-86eb03e99544" status: 200 len: 1366 microversion: 2.47 time: 0.493184 Aug 10 23:20:37.703272 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-4a976f42-0aee-48d1-9c23-329a47a2d7ba tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] 10.222.0.58 "GET /compute/v2.1/servers/a98455ed-1e70-4d9a-98a4-77262e588e87" status: 200 len: 1681 microversion: 2.1 time: 1.132251 Aug 10 23:20:37.704183 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2329/4842] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:20:36 2022] GET /compute/v2.1/servers/a98455ed-1e70-4d9a-98a4-77262e588e87 => generated 1681 bytes in 1134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:20:37.705239 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2514/4843] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:20:37 2022] GET /compute/v2.1/servers/364415e0-931a-4be4-8149-86eb03e99544 => generated 1366 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:20:37.933466 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-b8bffde0-8d99-4ca8-becd-ad1a63c66640 tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:37.934514 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-b8bffde0-8d99-4ca8-becd-ad1a63c66640 tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] [instance: ff959855-a396-4cce-9233-120a7d3f4cc9] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:37.946645 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b8bffde0-8d99-4ca8-becd-ad1a63c66640 tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:37.947496 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b8bffde0-8d99-4ca8-becd-ad1a63c66640 tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:37.948291 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b8bffde0-8d99-4ca8-becd-ad1a63c66640 tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:37.949281 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b8bffde0-8d99-4ca8-becd-ad1a63c66640 tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:37.949996 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b8bffde0-8d99-4ca8-becd-ad1a63c66640 tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:37.950915 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b8bffde0-8d99-4ca8-becd-ad1a63c66640 tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:38.147469 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-b16ab960-c22e-42ed-b721-70284dee3aaa tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:38.148995 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-b16ab960-c22e-42ed-b721-70284dee3aaa tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: 5ae8b5a0-e56c-4154-a487-080d996d54d3] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:38.161899 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b16ab960-c22e-42ed-b721-70284dee3aaa tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:38.163477 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b16ab960-c22e-42ed-b721-70284dee3aaa tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:38.163934 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b16ab960-c22e-42ed-b721-70284dee3aaa tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:38.164849 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b16ab960-c22e-42ed-b721-70284dee3aaa tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:38.165247 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b16ab960-c22e-42ed-b721-70284dee3aaa tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:38.167681 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b16ab960-c22e-42ed-b721-70284dee3aaa tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:38.246985 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b16ab960-c22e-42ed-b721-70284dee3aaa tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:38.247536 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b16ab960-c22e-42ed-b721-70284dee3aaa tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:38.248137 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b16ab960-c22e-42ed-b721-70284dee3aaa tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:38.254692 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.objects.instance [None req-b16ab960-c22e-42ed-b721-70284dee3aaa tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lazy-loading 'fault' on Instance uuid 5ae8b5a0-e56c-4154-a487-080d996d54d3 {{(pid=122633) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:20:38.709081 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-b16ab960-c22e-42ed-b721-70284dee3aaa tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6684f0c87e4242be9e0ffb4ef1973f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0582ace9e4443b8ad88915503ee630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:38.716456 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-b16ab960-c22e-42ed-b721-70284dee3aaa tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "GET /compute/v2.1/servers/5ae8b5a0-e56c-4154-a487-080d996d54d3" status: 200 len: 1299 microversion: 2.1 time: 0.575976 Aug 10 23:20:38.724657 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2515/4844] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:20:38 2022] GET /compute/v2.1/servers/5ae8b5a0-e56c-4154-a487-080d996d54d3 => generated 1299 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:20:38.742615 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-4b2dca19-1f7d-4338-83ce-5badac61fb69 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:38.743765 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-4b2dca19-1f7d-4338-83ce-5badac61fb69 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] [instance: 364415e0-931a-4be4-8149-86eb03e99544] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:38.763967 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4b2dca19-1f7d-4338-83ce-5badac61fb69 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:38.764536 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4b2dca19-1f7d-4338-83ce-5badac61fb69 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:38.764980 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4b2dca19-1f7d-4338-83ce-5badac61fb69 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:38.765751 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4b2dca19-1f7d-4338-83ce-5badac61fb69 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:38.766206 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4b2dca19-1f7d-4338-83ce-5badac61fb69 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:38.766707 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4b2dca19-1f7d-4338-83ce-5badac61fb69 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:39.075878 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=4 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:20:39.091995 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-4b2dca19-1f7d-4338-83ce-5badac61fb69 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65fc7792249b4daca6a39f7259d2236c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3661cd206d19455eb1c4ac3dd988a67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:39.109821 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-4b2dca19-1f7d-4338-83ce-5badac61fb69 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65fc7792249b4daca6a39f7259d2236c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3661cd206d19455eb1c4ac3dd988a67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:39.113262 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-4b2dca19-1f7d-4338-83ce-5badac61fb69 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65fc7792249b4daca6a39f7259d2236c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3661cd206d19455eb1c4ac3dd988a67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:39.114527 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-4b2dca19-1f7d-4338-83ce-5badac61fb69 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] 10.222.0.58 "GET /compute/v2.1/servers/364415e0-931a-4be4-8149-86eb03e99544" status: 200 len: 1366 microversion: 2.47 time: 0.385971 Aug 10 23:20:39.123740 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2516/4845] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:20:38 2022] GET /compute/v2.1/servers/364415e0-931a-4be4-8149-86eb03e99544 => generated 1366 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:20:39.128992 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-959025eb-b6a4-4382-965b-3c9f138f4ce9 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:39.129581 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-959025eb-b6a4-4382-965b-3c9f138f4ce9 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] [instance: a98455ed-1e70-4d9a-98a4-77262e588e87] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:39.146951 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-959025eb-b6a4-4382-965b-3c9f138f4ce9 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:39.148258 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-959025eb-b6a4-4382-965b-3c9f138f4ce9 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:39.150155 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-959025eb-b6a4-4382-965b-3c9f138f4ce9 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:39.151506 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-959025eb-b6a4-4382-965b-3c9f138f4ce9 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:39.152300 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-959025eb-b6a4-4382-965b-3c9f138f4ce9 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:39.153901 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-959025eb-b6a4-4382-965b-3c9f138f4ce9 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:39.395094 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-b8bffde0-8d99-4ca8-becd-ad1a63c66640 tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0d39db7158452d8b9ab2a4eeec786e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09d9809383a48d3915a3b6fd045fcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:39.404978 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-b8bffde0-8d99-4ca8-becd-ad1a63c66640 tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] 10.222.0.58 "GET /compute/v2.1/servers/ff959855-a396-4cce-9233-120a7d3f4cc9" status: 200 len: 1527 microversion: 2.1 time: 1.476391 Aug 10 23:20:39.405954 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2330/4846] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:20:37 2022] GET /compute/v2.1/servers/ff959855-a396-4cce-9233-120a7d3f4cc9 => generated 1527 bytes in 1479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:20:39.695992 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-959025eb-b6a4-4382-965b-3c9f138f4ce9 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d89081084f14e0187f4c67cd9185fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b557edd165144c8943eb9acc339a377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:39.709620 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-959025eb-b6a4-4382-965b-3c9f138f4ce9 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] 10.222.0.58 "GET /compute/v2.1/servers/a98455ed-1e70-4d9a-98a4-77262e588e87" status: 200 len: 1681 microversion: 2.1 time: 0.584618 Aug 10 23:20:39.710765 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2517/4847] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:20:39 2022] GET /compute/v2.1/servers/a98455ed-1e70-4d9a-98a4-77262e588e87 => generated 1681 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:20:39.754505 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-3eb6cfe9-ffe7-4c18-9f79-c5b5248a3fab tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:39.755197 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-3eb6cfe9-ffe7-4c18-9f79-c5b5248a3fab tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: 5ae8b5a0-e56c-4154-a487-080d996d54d3] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:39.763901 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3eb6cfe9-ffe7-4c18-9f79-c5b5248a3fab tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:39.764635 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3eb6cfe9-ffe7-4c18-9f79-c5b5248a3fab tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:39.765152 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3eb6cfe9-ffe7-4c18-9f79-c5b5248a3fab tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:39.765937 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3eb6cfe9-ffe7-4c18-9f79-c5b5248a3fab tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:39.766490 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3eb6cfe9-ffe7-4c18-9f79-c5b5248a3fab tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:39.767018 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3eb6cfe9-ffe7-4c18-9f79-c5b5248a3fab tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:39.792485 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-3eb6cfe9-ffe7-4c18-9f79-c5b5248a3fab tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] HTTP exception thrown: Instance 5ae8b5a0-e56c-4154-a487-080d996d54d3 could not be found. Aug 10 23:20:39.796001 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-3eb6cfe9-ffe7-4c18-9f79-c5b5248a3fab tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Request method failure captured: Aug 10 23:20:39.796001 n-d-850468-14 devstack@n-api.service[122632]: request: GET /compute/v2.1/servers/5ae8b5a0-e56c-4154-a487-080d996d54d3 HTTP/1.1 Aug 10 23:20:39.796001 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:20:39.796001 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:20:39.796001 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:20:39.796001 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 23:20:39.796001 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:20:39.796001 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:20:39.796001 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:20:39.796001 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:20:39.796001 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9DytBT8uIivFlHEw3ugwW3-_1ks70Fcm-KUdUfNf3hiFdhb5xvDC9LI4u79J0X-frOTrhG-DWWR1w8a7yZU35-jGfQgN97QRTSA7hDEW06netEOKzarBlr77OO9sCeT3s5ektFA7vCYLl4122WPKHg-MSXQY0g9YmL291Ic7yNjWLnQ Aug 10 23:20:39.796001 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:20:39.796001 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:20:39.796001 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:20:39.796001 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:20:39.796001 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:20:39.796001 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:20:39.796001 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 0b0582ace9e4443b8ad88915503ee630 Aug 10 23:20:39.796001 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-ServersTestJSON-516662906 Aug 10 23:20:39.796001 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:20:39.796001 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:20:39.796001 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0b0582ace9e4443b8ad88915503ee630"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0b0582ace9e4443b8ad88915503ee630"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/0b0582ace9e4443b8ad88915503ee630"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_0b0582ace9e4443b8ad88915503ee630", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:20:39.796001 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-ServersTestJSON-516662906 Aug 10 23:20:39.796001 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 0b0582ace9e4443b8ad88915503ee630 Aug 10 23:20:39.796001 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-ServersTestJSON-516662906 Aug 10 23:20:39.796001 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-ServersTestJSON-516662906-project Aug 10 23:20:39.796001 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:20:39.796001 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:20:39.796001 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: 6684f0c87e4242be9e0ffb4ef1973f96 Aug 10 23:20:39.796001 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-ServersTestJSON-516662906-project Aug 10 23:20:39.796001 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:20:39.796001 n-d-850468-14 devstack@n-api.service[122632]: exception: Instance 5ae8b5a0-e56c-4154-a487-080d996d54d3 could not be found. Aug 10 23:20:39.796001 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': '5ae8b5a0-e56c-4154-a487-080d996d54d3'} Aug 10 23:20:39.796001 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:20:39.796001 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:20:39.796001 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:20:39.796001 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:20:39.796001 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:20:39.796001 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:20:39.796001 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:20:39.796001 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:20:39.796001 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:20:39.796001 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:20:39.796001 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ae8b5a0-e56c-4154-a487-080d996d54d3 could not be found. Aug 10 23:20:39.796001 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:20:39.796001 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:20:39.796001 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:20:39.796001 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:20:39.796001 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:20:39.796001 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:20:39.796001 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:20:39.796001 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:20:39.796001 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:20:39.796001 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:20:39.796001 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:20:39.796001 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:20:39.796001 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:20:39.796001 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:20:39.796001 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:20:39.796001 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:20:39.796001 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ae8b5a0-e56c-4154-a487-080d996d54d3 could not be found. Aug 10 23:20:39.796001 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:20:39.796001 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:20:39.796001 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:20:39.796001 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:20:39.808687 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:20:39.808687 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:20:39.808687 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:20:39.808687 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:20:39.808687 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ae8b5a0-e56c-4154-a487-080d996d54d3 could not be found. Aug 10 23:20:39.808687 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:20:39.808687 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-3eb6cfe9-ffe7-4c18-9f79-c5b5248a3fab tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Returning 404 to user: Instance 5ae8b5a0-e56c-4154-a487-080d996d54d3 could not be found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:20:39.808687 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-3eb6cfe9-ffe7-4c18-9f79-c5b5248a3fab tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "GET /compute/v2.1/servers/5ae8b5a0-e56c-4154-a487-080d996d54d3" status: 404 len: 111 microversion: 2.1 time: 0.052522 Aug 10 23:20:39.808687 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2331/4848] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:20:39 2022] GET /compute/v2.1/servers/5ae8b5a0-e56c-4154-a487-080d996d54d3 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:20:39.812828 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-28a37a2f-8d76-4c60-a4a8-4568bfb965d1 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:39.813334 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-28a37a2f-8d76-4c60-a4a8-4568bfb965d1 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: 53003fff-46d7-4621-93fb-c2751572bb90] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:39.823269 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:20:39.825442 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-28a37a2f-8d76-4c60-a4a8-4568bfb965d1 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:39.826295 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-28a37a2f-8d76-4c60-a4a8-4568bfb965d1 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:39.826938 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-28a37a2f-8d76-4c60-a4a8-4568bfb965d1 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:39.827844 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-28a37a2f-8d76-4c60-a4a8-4568bfb965d1 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:39.828468 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-28a37a2f-8d76-4c60-a4a8-4568bfb965d1 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:39.829082 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-28a37a2f-8d76-4c60-a4a8-4568bfb965d1 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:39.867225 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-28a37a2f-8d76-4c60-a4a8-4568bfb965d1 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: 53003fff-46d7-4621-93fb-c2751572bb90] Going to try to terminate instance {{(pid=122633) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:20:40.017137 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-2506ccac-a609-4db2-8855-95b4d34f6b16 req-f70be1cc-26d5-4018-b656-c6d3d01cd8fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff959855-a396-4cce-9233-120a7d3f4cc9", "name": "network-vif-deleted", "tag": "cb873f8c-37f1-423b-9bdc-77f8a729e19c"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:20:40.032429 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-28a37a2f-8d76-4c60-a4a8-4568bfb965d1 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "DELETE /compute/v2.1/servers/53003fff-46d7-4621-93fb-c2751572bb90" status: 204 len: 0 microversion: 2.1 time: 0.223058 Aug 10 23:20:40.033517 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2518/4849] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:20:39 2022] DELETE /compute/v2.1/servers/53003fff-46d7-4621-93fb-c2751572bb90 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 10 23:20:40.040352 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-2506ccac-a609-4db2-8855-95b4d34f6b16 req-f70be1cc-26d5-4018-b656-c6d3d01cd8fd service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:40.042006 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-2506ccac-a609-4db2-8855-95b4d34f6b16 req-f70be1cc-26d5-4018-b656-c6d3d01cd8fd service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:40.044731 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-2506ccac-a609-4db2-8855-95b4d34f6b16 req-f70be1cc-26d5-4018-b656-c6d3d01cd8fd service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:40.048703 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-336a82c5-e5c8-4daa-b9af-25f721f71f2b tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:40.049442 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-336a82c5-e5c8-4daa-b9af-25f721f71f2b tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: 53003fff-46d7-4621-93fb-c2751572bb90] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:40.065262 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-336a82c5-e5c8-4daa-b9af-25f721f71f2b tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:40.067945 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-336a82c5-e5c8-4daa-b9af-25f721f71f2b tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:40.068902 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-336a82c5-e5c8-4daa-b9af-25f721f71f2b tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:40.071077 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-336a82c5-e5c8-4daa-b9af-25f721f71f2b tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:40.072387 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-336a82c5-e5c8-4daa-b9af-25f721f71f2b tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:40.075385 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-336a82c5-e5c8-4daa-b9af-25f721f71f2b tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:40.083188 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-2506ccac-a609-4db2-8855-95b4d34f6b16 req-f70be1cc-26d5-4018-b656-c6d3d01cd8fd service nova] Creating event network-vif-deleted:cb873f8c-37f1-423b-9bdc-77f8a729e19c for instance ff959855-a396-4cce-9233-120a7d3f4cc9 on n-h2-850468-14 Aug 10 23:20:40.094572 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-2506ccac-a609-4db2-8855-95b4d34f6b16 req-f70be1cc-26d5-4018-b656-c6d3d01cd8fd service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083448 Aug 10 23:20:40.099122 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2332/4850] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:20:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:20:40.153142 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-9d7b186a-ce4b-4b82-8e2e-50c691b8967a tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:40.154772 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-9d7b186a-ce4b-4b82-8e2e-50c691b8967a tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] [instance: 364415e0-931a-4be4-8149-86eb03e99544] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:40.194887 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9d7b186a-ce4b-4b82-8e2e-50c691b8967a tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:40.195758 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9d7b186a-ce4b-4b82-8e2e-50c691b8967a tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:40.196543 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9d7b186a-ce4b-4b82-8e2e-50c691b8967a tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:40.197762 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9d7b186a-ce4b-4b82-8e2e-50c691b8967a tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:40.198546 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9d7b186a-ce4b-4b82-8e2e-50c691b8967a tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:40.199252 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9d7b186a-ce4b-4b82-8e2e-50c691b8967a tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:40.558313 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-336a82c5-e5c8-4daa-b9af-25f721f71f2b tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6684f0c87e4242be9e0ffb4ef1973f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0582ace9e4443b8ad88915503ee630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:40.567405 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:20:40.580181 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-336a82c5-e5c8-4daa-b9af-25f721f71f2b tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "GET /compute/v2.1/servers/53003fff-46d7-4621-93fb-c2751572bb90" status: 200 len: 1495 microversion: 2.1 time: 0.541071 Aug 10 23:20:40.581313 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2519/4851] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:20:40 2022] GET /compute/v2.1/servers/53003fff-46d7-4621-93fb-c2751572bb90 => generated 1495 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:20:40.589359 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-07514684-1f17-4e37-a6ee-fc4bf493023b tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:40.590226 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-07514684-1f17-4e37-a6ee-fc4bf493023b tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] [instance: ff959855-a396-4cce-9233-120a7d3f4cc9] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:40.607092 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-07514684-1f17-4e37-a6ee-fc4bf493023b tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:40.607851 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-07514684-1f17-4e37-a6ee-fc4bf493023b tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:40.608569 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-07514684-1f17-4e37-a6ee-fc4bf493023b tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:40.609319 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-07514684-1f17-4e37-a6ee-fc4bf493023b tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:40.609930 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-07514684-1f17-4e37-a6ee-fc4bf493023b tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:40.610374 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-07514684-1f17-4e37-a6ee-fc4bf493023b tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:40.652486 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-9d7b186a-ce4b-4b82-8e2e-50c691b8967a tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65fc7792249b4daca6a39f7259d2236c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3661cd206d19455eb1c4ac3dd988a67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:40.663427 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-9d7b186a-ce4b-4b82-8e2e-50c691b8967a tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65fc7792249b4daca6a39f7259d2236c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3661cd206d19455eb1c4ac3dd988a67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:40.665418 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-9d7b186a-ce4b-4b82-8e2e-50c691b8967a tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65fc7792249b4daca6a39f7259d2236c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3661cd206d19455eb1c4ac3dd988a67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:40.666875 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-9d7b186a-ce4b-4b82-8e2e-50c691b8967a tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] 10.222.0.58 "GET /compute/v2.1/servers/364415e0-931a-4be4-8149-86eb03e99544" status: 200 len: 1366 microversion: 2.47 time: 0.521777 Aug 10 23:20:40.668670 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2333/4852] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:20:40 2022] GET /compute/v2.1/servers/364415e0-931a-4be4-8149-86eb03e99544 => generated 1366 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:20:40.735688 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-2812291c-b5a4-42da-b305-69606e0aea35 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:40.736293 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-07514684-1f17-4e37-a6ee-fc4bf493023b tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0d39db7158452d8b9ab2a4eeec786e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09d9809383a48d3915a3b6fd045fcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:40.742441 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-2812291c-b5a4-42da-b305-69606e0aea35 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] [instance: a98455ed-1e70-4d9a-98a4-77262e588e87] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:40.754846 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-07514684-1f17-4e37-a6ee-fc4bf493023b tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] 10.222.0.58 "GET /compute/v2.1/servers/ff959855-a396-4cce-9233-120a7d3f4cc9" status: 200 len: 1310 microversion: 2.1 time: 0.171258 Aug 10 23:20:40.760161 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2812291c-b5a4-42da-b305-69606e0aea35 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:40.761230 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2520/4853] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:20:40 2022] GET /compute/v2.1/servers/ff959855-a396-4cce-9233-120a7d3f4cc9 => generated 1310 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:20:40.762046 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2812291c-b5a4-42da-b305-69606e0aea35 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:40.763243 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2812291c-b5a4-42da-b305-69606e0aea35 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:40.764663 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2812291c-b5a4-42da-b305-69606e0aea35 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:40.765645 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2812291c-b5a4-42da-b305-69606e0aea35 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:40.766308 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2812291c-b5a4-42da-b305-69606e0aea35 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:40.987899 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-2812291c-b5a4-42da-b305-69606e0aea35 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d89081084f14e0187f4c67cd9185fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b557edd165144c8943eb9acc339a377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:41.006797 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-2812291c-b5a4-42da-b305-69606e0aea35 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] 10.222.0.58 "GET /compute/v2.1/servers/a98455ed-1e70-4d9a-98a4-77262e588e87" status: 200 len: 1614 microversion: 2.1 time: 0.278201 Aug 10 23:20:41.022619 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2334/4854] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:20:40 2022] GET /compute/v2.1/servers/a98455ed-1e70-4d9a-98a4-77262e588e87 => generated 1614 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:20:41.604214 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-94177064-35be-4173-98c1-5f2ccb1eaa51 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:41.605108 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-94177064-35be-4173-98c1-5f2ccb1eaa51 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: 53003fff-46d7-4621-93fb-c2751572bb90] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:41.614284 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-94177064-35be-4173-98c1-5f2ccb1eaa51 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:41.615063 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-94177064-35be-4173-98c1-5f2ccb1eaa51 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:41.615669 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-94177064-35be-4173-98c1-5f2ccb1eaa51 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:41.616693 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-94177064-35be-4173-98c1-5f2ccb1eaa51 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:41.617465 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-94177064-35be-4173-98c1-5f2ccb1eaa51 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:41.618060 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-94177064-35be-4173-98c1-5f2ccb1eaa51 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:41.692130 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-81f24146-bbb3-44fc-b9e2-3b60a858cbd9 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:41.693909 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-81f24146-bbb3-44fc-b9e2-3b60a858cbd9 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] [instance: 364415e0-931a-4be4-8149-86eb03e99544] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:41.704377 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-81f24146-bbb3-44fc-b9e2-3b60a858cbd9 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:41.721198 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-81f24146-bbb3-44fc-b9e2-3b60a858cbd9 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:41.722503 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-81f24146-bbb3-44fc-b9e2-3b60a858cbd9 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:41.724393 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-81f24146-bbb3-44fc-b9e2-3b60a858cbd9 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:41.726884 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-81f24146-bbb3-44fc-b9e2-3b60a858cbd9 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:41.728149 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-81f24146-bbb3-44fc-b9e2-3b60a858cbd9 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:41.885261 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-94177064-35be-4173-98c1-5f2ccb1eaa51 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6684f0c87e4242be9e0ffb4ef1973f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0582ace9e4443b8ad88915503ee630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:41.896025 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-94177064-35be-4173-98c1-5f2ccb1eaa51 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "GET /compute/v2.1/servers/53003fff-46d7-4621-93fb-c2751572bb90" status: 200 len: 1495 microversion: 2.1 time: 0.297048 Aug 10 23:20:41.896801 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2521/4855] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:20:41 2022] GET /compute/v2.1/servers/53003fff-46d7-4621-93fb-c2751572bb90 => generated 1495 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:20:41.903478 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-21cd0c69-387d-449f-8667-6ecb7bc3ec67 tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:41.904343 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-21cd0c69-387d-449f-8667-6ecb7bc3ec67 tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] [instance: ff959855-a396-4cce-9233-120a7d3f4cc9] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:41.911619 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-21cd0c69-387d-449f-8667-6ecb7bc3ec67 tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:41.912336 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-21cd0c69-387d-449f-8667-6ecb7bc3ec67 tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:41.912956 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-21cd0c69-387d-449f-8667-6ecb7bc3ec67 tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:41.913875 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-21cd0c69-387d-449f-8667-6ecb7bc3ec67 tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:41.914496 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-21cd0c69-387d-449f-8667-6ecb7bc3ec67 tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:41.915144 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-21cd0c69-387d-449f-8667-6ecb7bc3ec67 tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:41.956875 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-21cd0c69-387d-449f-8667-6ecb7bc3ec67 tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:41.957786 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-21cd0c69-387d-449f-8667-6ecb7bc3ec67 tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:41.958437 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-21cd0c69-387d-449f-8667-6ecb7bc3ec67 tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:41.960112 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.objects.instance [None req-21cd0c69-387d-449f-8667-6ecb7bc3ec67 tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Lazy-loading 'fault' on Instance uuid ff959855-a396-4cce-9233-120a7d3f4cc9 {{(pid=122633) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:20:42.019145 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-21cd0c69-387d-449f-8667-6ecb7bc3ec67 tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac0d39db7158452d8b9ab2a4eeec786e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e09d9809383a48d3915a3b6fd045fcdc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:42.026089 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-81f24146-bbb3-44fc-b9e2-3b60a858cbd9 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65fc7792249b4daca6a39f7259d2236c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3661cd206d19455eb1c4ac3dd988a67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:42.040504 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-21cd0c69-387d-449f-8667-6ecb7bc3ec67 tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] 10.222.0.58 "GET /compute/v2.1/servers/ff959855-a396-4cce-9233-120a7d3f4cc9" status: 200 len: 1315 microversion: 2.1 time: 0.142401 Aug 10 23:20:42.041906 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-81f24146-bbb3-44fc-b9e2-3b60a858cbd9 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65fc7792249b4daca6a39f7259d2236c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3661cd206d19455eb1c4ac3dd988a67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:42.043603 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-81f24146-bbb3-44fc-b9e2-3b60a858cbd9 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65fc7792249b4daca6a39f7259d2236c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3661cd206d19455eb1c4ac3dd988a67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:42.044825 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-81f24146-bbb3-44fc-b9e2-3b60a858cbd9 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] 10.222.0.58 "GET /compute/v2.1/servers/364415e0-931a-4be4-8149-86eb03e99544" status: 200 len: 1366 microversion: 2.47 time: 0.357889 Aug 10 23:20:42.045403 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2335/4856] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:20:41 2022] GET /compute/v2.1/servers/364415e0-931a-4be4-8149-86eb03e99544 => generated 1366 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 23:20:42.047278 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2522/4857] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:20:41 2022] GET /compute/v2.1/servers/ff959855-a396-4cce-9233-120a7d3f4cc9 => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:20:42.056295 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-159202f0-c0f7-4cf9-90f1-fabae01b0603 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:42.057311 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-159202f0-c0f7-4cf9-90f1-fabae01b0603 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] [instance: a98455ed-1e70-4d9a-98a4-77262e588e87] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:42.065014 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-159202f0-c0f7-4cf9-90f1-fabae01b0603 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:42.065975 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-159202f0-c0f7-4cf9-90f1-fabae01b0603 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:42.066657 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-159202f0-c0f7-4cf9-90f1-fabae01b0603 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:42.067536 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-159202f0-c0f7-4cf9-90f1-fabae01b0603 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:42.067996 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-159202f0-c0f7-4cf9-90f1-fabae01b0603 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:42.068427 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-159202f0-c0f7-4cf9-90f1-fabae01b0603 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:42.084629 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-159202f0-c0f7-4cf9-90f1-fabae01b0603 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] HTTP exception thrown: Instance a98455ed-1e70-4d9a-98a4-77262e588e87 could not be found. Aug 10 23:20:42.086317 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-159202f0-c0f7-4cf9-90f1-fabae01b0603 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Request method failure captured: Aug 10 23:20:42.086317 n-d-850468-14 devstack@n-api.service[122633]: request: GET /compute/v2.1/servers/a98455ed-1e70-4d9a-98a4-77262e588e87 HTTP/1.1 Aug 10 23:20:42.086317 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:20:42.086317 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:20:42.086317 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:20:42.086317 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:20:42.086317 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:20:42.086317 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:20:42.086317 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:20:42.086317 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:20:42.086317 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9Dyh6-R-3HT3qmAYw73oJfCuu2NJv_Uk6ESXtcq6VvNMtaQn1cTuz-I3qzoDfMZYBb14V5s9aXOf7KFvhR2arcnhZ5gC9SddHqo24MvVPxr7p8PNkuseL9l1-7bXrad-0RpRPdQnhZkSYtsPZXEtrxg11yCwwP1jlsEo-QBQNYEMWc4 Aug 10 23:20:42.086317 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:20:42.086317 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:20:42.086317 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:20:42.086317 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:20:42.086317 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:20:42.086317 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:20:42.086317 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 2b557edd165144c8943eb9acc339a377 Aug 10 23:20:42.086317 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-AttachVolumeNegativeTest-393353666 Aug 10 23:20:42.086317 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:20:42.086317 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:20:42.086317 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2b557edd165144c8943eb9acc339a377"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2b557edd165144c8943eb9acc339a377"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2b557edd165144c8943eb9acc339a377"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2b557edd165144c8943eb9acc339a377", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:20:42.086317 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-AttachVolumeNegativeTest-393353666 Aug 10 23:20:42.086317 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 2b557edd165144c8943eb9acc339a377 Aug 10 23:20:42.086317 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-393353666 Aug 10 23:20:42.086317 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-AttachVolumeNegativeTest-393353666-project Aug 10 23:20:42.086317 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:20:42.086317 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:20:42.086317 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 0d89081084f14e0187f4c67cd9185fef Aug 10 23:20:42.086317 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-AttachVolumeNegativeTest-393353666-project Aug 10 23:20:42.086317 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:20:42.086317 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance a98455ed-1e70-4d9a-98a4-77262e588e87 could not be found. Aug 10 23:20:42.086317 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': 'a98455ed-1e70-4d9a-98a4-77262e588e87'} Aug 10 23:20:42.086317 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:20:42.086317 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:20:42.086317 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:20:42.086317 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:20:42.086317 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:20:42.086317 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:20:42.086317 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:20:42.086317 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:20:42.086317 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:20:42.086317 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:20:42.086317 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a98455ed-1e70-4d9a-98a4-77262e588e87 could not be found. Aug 10 23:20:42.086317 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:20:42.086317 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:20:42.086317 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:20:42.086317 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:20:42.086317 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:20:42.086317 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:20:42.086317 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:20:42.086317 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:20:42.086317 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:20:42.086317 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:20:42.086317 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:20:42.086317 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:20:42.086317 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:20:42.086317 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:20:42.086317 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:20:42.086317 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:20:42.086317 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a98455ed-1e70-4d9a-98a4-77262e588e87 could not be found. Aug 10 23:20:42.086317 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:20:42.086317 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:20:42.086317 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:20:42.091541 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:20:42.091541 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:20:42.091541 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:20:42.091541 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:20:42.091541 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:20:42.091541 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a98455ed-1e70-4d9a-98a4-77262e588e87 could not be found. Aug 10 23:20:42.091541 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:20:42.091541 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-159202f0-c0f7-4cf9-90f1-fabae01b0603 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Returning 404 to user: Instance a98455ed-1e70-4d9a-98a4-77262e588e87 could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:20:42.091541 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-159202f0-c0f7-4cf9-90f1-fabae01b0603 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] 10.222.0.58 "GET /compute/v2.1/servers/a98455ed-1e70-4d9a-98a4-77262e588e87" status: 404 len: 111 microversion: 2.1 time: 0.039495 Aug 10 23:20:42.091541 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2523/4858] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:20:42 2022] GET /compute/v2.1/servers/a98455ed-1e70-4d9a-98a4-77262e588e87 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:20:42.098400 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-958d2a4a-b093-4ac0-bb06-72d848cd732b tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Calling method '.version_select at 0x7f847c809550>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:42.123706 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-20fc708b-a971-43da-bc92-51d48f651629 req-e5ef8f08-0bb3-440f-bce5-7c07951a57bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a98455ed-1e70-4d9a-98a4-77262e588e87", "name": "network-vif-deleted", "tag": "182692c8-73e7-42ae-ada4-e4937c1ac10d"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:20:42.126011 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-958d2a4a-b093-4ac0-bb06-72d848cd732b tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1551742593" status: 202 len: 0 microversion: 2.1 time: 0.032190 Aug 10 23:20:42.127827 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2336/4859] 10.222.0.58 () {58 vars in 1221 bytes} [Wed Aug 10 23:20:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1551742593 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:20:42.150558 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-20fc708b-a971-43da-bc92-51d48f651629 req-e5ef8f08-0bb3-440f-bce5-7c07951a57bb service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:42.151677 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-20fc708b-a971-43da-bc92-51d48f651629 req-e5ef8f08-0bb3-440f-bce5-7c07951a57bb service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:42.152669 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-20fc708b-a971-43da-bc92-51d48f651629 req-e5ef8f08-0bb3-440f-bce5-7c07951a57bb service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:42.183344 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-20fc708b-a971-43da-bc92-51d48f651629 req-e5ef8f08-0bb3-440f-bce5-7c07951a57bb service nova] Creating event network-vif-deleted:182692c8-73e7-42ae-ada4-e4937c1ac10d for instance a98455ed-1e70-4d9a-98a4-77262e588e87 on n-h1-850468-14 Aug 10 23:20:42.195089 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-20fc708b-a971-43da-bc92-51d48f651629 req-e5ef8f08-0bb3-440f-bce5-7c07951a57bb service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075647 Aug 10 23:20:42.196689 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2524/4860] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:20:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 23:20:42.506445 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-40221abe-b284-452c-9d1c-e7646ea741a2 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:42.507111 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-40221abe-b284-452c-9d1c-e7646ea741a2 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] [instance: 7e091da3-0636-4cba-b8de-94fdeecf0b7f] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:42.527031 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-40221abe-b284-452c-9d1c-e7646ea741a2 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:42.533076 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-40221abe-b284-452c-9d1c-e7646ea741a2 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:42.535987 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-40221abe-b284-452c-9d1c-e7646ea741a2 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:42.538196 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-40221abe-b284-452c-9d1c-e7646ea741a2 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:42.540070 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-40221abe-b284-452c-9d1c-e7646ea741a2 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:42.541336 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-40221abe-b284-452c-9d1c-e7646ea741a2 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:42.918157 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-586eb0e1-16ab-4703-ae72-86892ea050d4 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:42.919541 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-586eb0e1-16ab-4703-ae72-86892ea050d4 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: 53003fff-46d7-4621-93fb-c2751572bb90] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:42.932318 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-586eb0e1-16ab-4703-ae72-86892ea050d4 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:42.938476 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-586eb0e1-16ab-4703-ae72-86892ea050d4 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:42.939431 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-586eb0e1-16ab-4703-ae72-86892ea050d4 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:42.940609 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-586eb0e1-16ab-4703-ae72-86892ea050d4 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:42.943577 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-586eb0e1-16ab-4703-ae72-86892ea050d4 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:42.944290 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-586eb0e1-16ab-4703-ae72-86892ea050d4 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:43.087849 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-40221abe-b284-452c-9d1c-e7646ea741a2 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:43.107696 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-40221abe-b284-452c-9d1c-e7646ea741a2 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:43.112127 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-40221abe-b284-452c-9d1c-e7646ea741a2 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:43.115279 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-40221abe-b284-452c-9d1c-e7646ea741a2 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] 10.222.0.58 "GET /compute/v2.1/servers/7e091da3-0636-4cba-b8de-94fdeecf0b7f" status: 200 len: 2947 microversion: 2.32 time: 0.616643 Aug 10 23:20:43.130743 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2337/4861] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:20:42 2022] GET /compute/v2.1/servers/7e091da3-0636-4cba-b8de-94fdeecf0b7f => generated 2947 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:20:43.143735 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-6e080e44-0506-469e-9df3-e52bc82810c5 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-81356938", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452", "networks": [{"uuid": "94a80b19-6b00-4e55-9c2a-d120d01fd582"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1298960212", "security_groups": [{"name": "tempest-secgroup-smoke-1281178724"}]}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:20:43.336700 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.network.neutron [None req-6e080e44-0506-469e-9df3-e52bc82810c5 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] validate_networks() for [('94a80b19-6b00-4e55-9c2a-d120d01fd582', None, None, None, None, None)] {{(pid=122632) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 23:20:43.648102 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-586eb0e1-16ab-4703-ae72-86892ea050d4 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6684f0c87e4242be9e0ffb4ef1973f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0582ace9e4443b8ad88915503ee630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:43.665794 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-586eb0e1-16ab-4703-ae72-86892ea050d4 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "GET /compute/v2.1/servers/53003fff-46d7-4621-93fb-c2751572bb90" status: 200 len: 1495 microversion: 2.1 time: 0.751547 Aug 10 23:20:43.678239 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2525/4862] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:20:42 2022] GET /compute/v2.1/servers/53003fff-46d7-4621-93fb-c2751572bb90 => generated 1495 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:20:43.686342 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-73599adb-f259-46d2-9f24-142c572eb1ff tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:43.687250 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-73599adb-f259-46d2-9f24-142c572eb1ff tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] [instance: ff959855-a396-4cce-9233-120a7d3f4cc9] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:43.695839 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-73599adb-f259-46d2-9f24-142c572eb1ff tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:43.696634 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-73599adb-f259-46d2-9f24-142c572eb1ff tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:43.697641 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-73599adb-f259-46d2-9f24-142c572eb1ff tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:43.698968 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-73599adb-f259-46d2-9f24-142c572eb1ff tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:43.699916 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-73599adb-f259-46d2-9f24-142c572eb1ff tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:43.700508 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-73599adb-f259-46d2-9f24-142c572eb1ff tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:43.719623 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-73599adb-f259-46d2-9f24-142c572eb1ff tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] HTTP exception thrown: Instance ff959855-a396-4cce-9233-120a7d3f4cc9 could not be found. Aug 10 23:20:43.722327 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-73599adb-f259-46d2-9f24-142c572eb1ff tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Request method failure captured: Aug 10 23:20:43.722327 n-d-850468-14 devstack@n-api.service[122633]: request: GET /compute/v2.1/servers/ff959855-a396-4cce-9233-120a7d3f4cc9 HTTP/1.1 Aug 10 23:20:43.722327 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:20:43.722327 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:20:43.722327 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:20:43.722327 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:20:43.722327 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:20:43.722327 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:20:43.722327 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:20:43.722327 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:20:43.722327 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9D0vRJ1RVk_JAM_nzht8rm-snnrniKG8W7poULWB-tDxItZnb17Rp9xLJO1gSaJC9brYLo4N0Gvdv5k2Xdzn0uuqeEdZbczL5B0CYX2waBiwPIZe5MW9LNm8Ii4X-APgE94qGp6BcC76dGck7yMpfvQm_gC7GODXuyVzt7YiXw-9Txo Aug 10 23:20:43.722327 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:20:43.722327 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:20:43.722327 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:20:43.722327 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:20:43.722327 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:20:43.722327 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:20:43.722327 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: e09d9809383a48d3915a3b6fd045fcdc Aug 10 23:20:43.722327 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-736615761 Aug 10 23:20:43.722327 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:20:43.722327 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:20:43.722327 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e09d9809383a48d3915a3b6fd045fcdc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e09d9809383a48d3915a3b6fd045fcdc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/e09d9809383a48d3915a3b6fd045fcdc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_e09d9809383a48d3915a3b6fd045fcdc", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:20:43.722327 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-736615761 Aug 10 23:20:43.722327 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: e09d9809383a48d3915a3b6fd045fcdc Aug 10 23:20:43.722327 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-736615761 Aug 10 23:20:43.722327 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-ServerAddressesNegativeTestJSON-736615761-project Aug 10 23:20:43.722327 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:20:43.722327 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:20:43.722327 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: ac0d39db7158452d8b9ab2a4eeec786e Aug 10 23:20:43.722327 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-736615761-project Aug 10 23:20:43.722327 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:20:43.722327 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance ff959855-a396-4cce-9233-120a7d3f4cc9 could not be found. Aug 10 23:20:43.722327 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': 'ff959855-a396-4cce-9233-120a7d3f4cc9'} Aug 10 23:20:43.722327 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:20:43.722327 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:20:43.722327 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:20:43.722327 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:20:43.722327 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:20:43.722327 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:20:43.722327 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:20:43.722327 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:20:43.722327 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:20:43.722327 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:20:43.722327 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff959855-a396-4cce-9233-120a7d3f4cc9 could not be found. Aug 10 23:20:43.722327 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:20:43.722327 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:20:43.722327 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:20:43.722327 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:20:43.722327 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:20:43.722327 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:20:43.722327 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:20:43.722327 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:20:43.722327 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:20:43.722327 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:20:43.722327 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:20:43.722327 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:20:43.722327 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:20:43.722327 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:20:43.722327 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:20:43.722327 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:20:43.722327 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff959855-a396-4cce-9233-120a7d3f4cc9 could not be found. Aug 10 23:20:43.722327 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:20:43.722327 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:20:43.727603 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:20:43.727603 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:20:43.727603 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:20:43.727603 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:20:43.727603 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:20:43.727603 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:20:43.727603 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff959855-a396-4cce-9233-120a7d3f4cc9 could not be found. Aug 10 23:20:43.727603 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:20:43.729763 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-73599adb-f259-46d2-9f24-142c572eb1ff tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] Returning 404 to user: Instance ff959855-a396-4cce-9233-120a7d3f4cc9 could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:20:43.730865 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-73599adb-f259-46d2-9f24-142c572eb1ff tempest-ServerAddressesNegativeTestJSON-736615761 tempest-ServerAddressesNegativeTestJSON-736615761-project] 10.222.0.58 "GET /compute/v2.1/servers/ff959855-a396-4cce-9233-120a7d3f4cc9" status: 404 len: 111 microversion: 2.1 time: 0.051553 Aug 10 23:20:43.731953 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2526/4863] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:20:43 2022] GET /compute/v2.1/servers/ff959855-a396-4cce-9233-120a7d3f4cc9 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:20:43.736759 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c73d0397-4716-4aed-9264-b7fe532df405 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:43.739638 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-c73d0397-4716-4aed-9264-b7fe532df405 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] [instance: 364415e0-931a-4be4-8149-86eb03e99544] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:43.747684 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c73d0397-4716-4aed-9264-b7fe532df405 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:43.748362 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c73d0397-4716-4aed-9264-b7fe532df405 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:43.749112 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c73d0397-4716-4aed-9264-b7fe532df405 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:43.750289 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c73d0397-4716-4aed-9264-b7fe532df405 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:43.750944 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c73d0397-4716-4aed-9264-b7fe532df405 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:43.751539 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c73d0397-4716-4aed-9264-b7fe532df405 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:43.996926 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-c73d0397-4716-4aed-9264-b7fe532df405 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65fc7792249b4daca6a39f7259d2236c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3661cd206d19455eb1c4ac3dd988a67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:44.004565 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-6e080e44-0506-469e-9df3-e52bc82810c5 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Flavor limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:20:44.005001 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-6e080e44-0506-469e-9df3-e52bc82810c5 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Image limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:20:44.005718 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-6e080e44-0506-469e-9df3-e52bc82810c5 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Flavor pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:20:44.006138 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-6e080e44-0506-469e-9df3-e52bc82810c5 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Image pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:20:44.006560 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-6e080e44-0506-469e-9df3-e52bc82810c5 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:20:44.011441 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-c73d0397-4716-4aed-9264-b7fe532df405 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65fc7792249b4daca6a39f7259d2236c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3661cd206d19455eb1c4ac3dd988a67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:44.013366 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-c73d0397-4716-4aed-9264-b7fe532df405 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65fc7792249b4daca6a39f7259d2236c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3661cd206d19455eb1c4ac3dd988a67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:44.015465 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-c73d0397-4716-4aed-9264-b7fe532df405 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] 10.222.0.58 "GET /compute/v2.1/servers/364415e0-931a-4be4-8149-86eb03e99544" status: 200 len: 1372 microversion: 2.47 time: 0.282399 Aug 10 23:20:44.016638 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2527/4864] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:20:43 2022] GET /compute/v2.1/servers/364415e0-931a-4be4-8149-86eb03e99544 => generated 1372 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:20:44.031147 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6e080e44-0506-469e-9df3-e52bc82810c5 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:44.032254 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-f147248f-dac4-467e-819b-3aa56c7b67d1 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:44.033104 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6e080e44-0506-469e-9df3-e52bc82810c5 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:44.034592 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-f147248f-dac4-467e-819b-3aa56c7b67d1 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] [instance: 7e091da3-0636-4cba-b8de-94fdeecf0b7f] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:44.035499 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6e080e44-0506-469e-9df3-e52bc82810c5 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:44.037348 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6e080e44-0506-469e-9df3-e52bc82810c5 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:44.039360 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6e080e44-0506-469e-9df3-e52bc82810c5 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:44.040009 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6e080e44-0506-469e-9df3-e52bc82810c5 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:44.044111 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f147248f-dac4-467e-819b-3aa56c7b67d1 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:44.044891 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f147248f-dac4-467e-819b-3aa56c7b67d1 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:44.045735 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f147248f-dac4-467e-819b-3aa56c7b67d1 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:44.046916 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f147248f-dac4-467e-819b-3aa56c7b67d1 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:44.047610 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f147248f-dac4-467e-819b-3aa56c7b67d1 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:44.048274 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f147248f-dac4-467e-819b-3aa56c7b67d1 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:44.068037 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-6e080e44-0506-469e-9df3-e52bc82810c5 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Getting quotas for project 25abd63376614081a9d484f3c9ae950d. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:20:44.077386 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-6e080e44-0506-469e-9df3-e52bc82810c5 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Getting quotas for user 5899b2ad9f1046caaf7c6073e408eeee and project 25abd63376614081a9d484f3c9ae950d. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:20:44.098084 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-6e080e44-0506-469e-9df3-e52bc82810c5 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Going to run 1 instances... {{(pid=122632) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 23:20:44.100763 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-6e080e44-0506-469e-9df3-e52bc82810c5 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] [instance: 32ddd6eb-6c3f-4bd1-b9be-f819e8ef3a68] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78ad8905-f66f-4733-8be9-2b260f1fabed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122632) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 23:20:44.158808 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-6e080e44-0506-469e-9df3-e52bc82810c5 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.026314 Aug 10 23:20:44.159929 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2338/4865] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 23:20:43 2022] POST /compute/v2.1/servers => generated 406 bytes in 1028 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 23:20:44.183955 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-e8bcb667-d112-48ee-8a15-03688c7a67c1 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:44.188405 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-e8bcb667-d112-48ee-8a15-03688c7a67c1 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] [instance: 32ddd6eb-6c3f-4bd1-b9be-f819e8ef3a68] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:44.259921 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-e8bcb667-d112-48ee-8a15-03688c7a67c1 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5899b2ad9f1046caaf7c6073e408eeee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25abd63376614081a9d484f3c9ae950d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:44.269246 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-e8bcb667-d112-48ee-8a15-03688c7a67c1 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "GET /compute/v2.1/servers/32ddd6eb-6c3f-4bd1-b9be-f819e8ef3a68" status: 200 len: 1265 microversion: 2.1 time: 0.092289 Aug 10 23:20:44.270167 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2339/4866] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:20:44 2022] GET /compute/v2.1/servers/32ddd6eb-6c3f-4bd1-b9be-f819e8ef3a68 => generated 1265 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:20:44.380907 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-f147248f-dac4-467e-819b-3aa56c7b67d1 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] 10.222.0.58 "GET /compute/v2.1/servers/7e091da3-0636-4cba-b8de-94fdeecf0b7f/os-interface" status: 200 len: 1832 microversion: 2.32 time: 0.362624 Aug 10 23:20:44.391175 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2528/4867] 10.222.0.58 () {60 vars in 1316 bytes} [Wed Aug 10 23:20:44 2022] GET /compute/v2.1/servers/7e091da3-0636-4cba-b8de-94fdeecf0b7f/os-interface => generated 1832 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:20:44.696462 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-83def0f8-d5cb-4eba-a9d7-dbd222149a56 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:44.697355 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-83def0f8-d5cb-4eba-a9d7-dbd222149a56 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: 53003fff-46d7-4621-93fb-c2751572bb90] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:44.716284 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-83def0f8-d5cb-4eba-a9d7-dbd222149a56 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:44.717682 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-83def0f8-d5cb-4eba-a9d7-dbd222149a56 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:44.722954 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-83def0f8-d5cb-4eba-a9d7-dbd222149a56 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:44.724273 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-83def0f8-d5cb-4eba-a9d7-dbd222149a56 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:44.726290 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-83def0f8-d5cb-4eba-a9d7-dbd222149a56 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:44.727814 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-83def0f8-d5cb-4eba-a9d7-dbd222149a56 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:45.043853 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-00440325-6ad0-4416-9bc9-ade008f0cde4 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:45.045993 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-00440325-6ad0-4416-9bc9-ade008f0cde4 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] [instance: 364415e0-931a-4be4-8149-86eb03e99544] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:45.070434 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-00440325-6ad0-4416-9bc9-ade008f0cde4 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:45.073313 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-00440325-6ad0-4416-9bc9-ade008f0cde4 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:45.076792 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-00440325-6ad0-4416-9bc9-ade008f0cde4 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:45.079008 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-00440325-6ad0-4416-9bc9-ade008f0cde4 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:45.084069 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-00440325-6ad0-4416-9bc9-ade008f0cde4 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:45.085002 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-00440325-6ad0-4416-9bc9-ade008f0cde4 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:45.289374 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-00440325-6ad0-4416-9bc9-ade008f0cde4 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65fc7792249b4daca6a39f7259d2236c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3661cd206d19455eb1c4ac3dd988a67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:45.313717 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-00440325-6ad0-4416-9bc9-ade008f0cde4 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65fc7792249b4daca6a39f7259d2236c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3661cd206d19455eb1c4ac3dd988a67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:45.323243 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-00440325-6ad0-4416-9bc9-ade008f0cde4 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65fc7792249b4daca6a39f7259d2236c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3661cd206d19455eb1c4ac3dd988a67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:45.330259 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-00440325-6ad0-4416-9bc9-ade008f0cde4 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] 10.222.0.58 "GET /compute/v2.1/servers/364415e0-931a-4be4-8149-86eb03e99544" status: 200 len: 1357 microversion: 2.47 time: 0.290398 Aug 10 23:20:45.333227 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2529/4868] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:20:45 2022] GET /compute/v2.1/servers/364415e0-931a-4be4-8149-86eb03e99544 => generated 1357 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:20:45.350288 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-e14957af-b256-4f89-a62a-5fe14b1c26ab tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:45.351438 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-e14957af-b256-4f89-a62a-5fe14b1c26ab tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] [instance: 32ddd6eb-6c3f-4bd1-b9be-f819e8ef3a68] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:45.374448 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e14957af-b256-4f89-a62a-5fe14b1c26ab tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:45.375971 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e14957af-b256-4f89-a62a-5fe14b1c26ab tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:45.381553 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e14957af-b256-4f89-a62a-5fe14b1c26ab tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:45.382711 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e14957af-b256-4f89-a62a-5fe14b1c26ab tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:45.384216 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e14957af-b256-4f89-a62a-5fe14b1c26ab tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:45.384973 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e14957af-b256-4f89-a62a-5fe14b1c26ab tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:45.480888 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-83def0f8-d5cb-4eba-a9d7-dbd222149a56 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6684f0c87e4242be9e0ffb4ef1973f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0582ace9e4443b8ad88915503ee630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:45.504211 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-83def0f8-d5cb-4eba-a9d7-dbd222149a56 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "GET /compute/v2.1/servers/53003fff-46d7-4621-93fb-c2751572bb90" status: 200 len: 1495 microversion: 2.1 time: 0.811617 Aug 10 23:20:45.505799 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2340/4869] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:20:44 2022] GET /compute/v2.1/servers/53003fff-46d7-4621-93fb-c2751572bb90 => generated 1495 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:20:45.520366 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-1654af1b-3d9d-46c3-91eb-263034a7c929 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:45.544830 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-1654af1b-3d9d-46c3-91eb-263034a7c929 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '65fc7792249b4daca6a39f7259d2236c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3661cd206d19455eb1c4ac3dd988a67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:45.548536 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-1654af1b-3d9d-46c3-91eb-263034a7c929 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Searching by: {'deleted': False, 'project_id': '3661cd206d19455eb1c4ac3dd988a67d'} {{(pid=122632) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 10 23:20:45.567611 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1654af1b-3d9d-46c3-91eb-263034a7c929 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:45.571132 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1654af1b-3d9d-46c3-91eb-263034a7c929 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:45.571657 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1654af1b-3d9d-46c3-91eb-263034a7c929 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:45.572484 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1654af1b-3d9d-46c3-91eb-263034a7c929 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:45.572964 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1654af1b-3d9d-46c3-91eb-263034a7c929 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:45.573395 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1654af1b-3d9d-46c3-91eb-263034a7c929 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:45.612338 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-e14957af-b256-4f89-a62a-5fe14b1c26ab tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5899b2ad9f1046caaf7c6073e408eeee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25abd63376614081a9d484f3c9ae950d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:45.629968 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-e14957af-b256-4f89-a62a-5fe14b1c26ab tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "GET /compute/v2.1/servers/32ddd6eb-6c3f-4bd1-b9be-f819e8ef3a68" status: 200 len: 1317 microversion: 2.1 time: 0.291366 Aug 10 23:20:45.633742 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2530/4870] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:20:45 2022] GET /compute/v2.1/servers/32ddd6eb-6c3f-4bd1-b9be-f819e8ef3a68 => generated 1317 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:20:45.644304 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-28894545-8238-42fc-8eb4-73d96fa745de tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:45.645963 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-28894545-8238-42fc-8eb4-73d96fa745de tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] [instance: b812cd8c-7e33-4e97-8df6-c7fccdf12019] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:45.666423 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-28894545-8238-42fc-8eb4-73d96fa745de tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:45.667519 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-28894545-8238-42fc-8eb4-73d96fa745de tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:45.668816 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-28894545-8238-42fc-8eb4-73d96fa745de tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:45.671019 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-28894545-8238-42fc-8eb4-73d96fa745de tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:45.675995 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-28894545-8238-42fc-8eb4-73d96fa745de tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:45.677341 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-28894545-8238-42fc-8eb4-73d96fa745de tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:45.882841 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.multi_cell_list [None req-1654af1b-3d9d-46c3-91eb-263034a7c929 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=122632) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 10 23:20:45.883495 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.objects.instance [None req-28894545-8238-42fc-8eb4-73d96fa745de tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lazy-loading 'services' on Instance uuid b812cd8c-7e33-4e97-8df6-c7fccdf12019 {{(pid=122633) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:20:46.109363 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-28894545-8238-42fc-8eb4-73d96fa745de tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] 10.222.0.58 "DELETE /compute/v2.1/servers/b812cd8c-7e33-4e97-8df6-c7fccdf12019/os-volume_attachments/ba75fad6-85fb-4ae5-bee1-44e5e84a45e5" status: 202 len: 0 microversion: 2.1 time: 0.474158 Aug 10 23:20:46.111324 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2531/4871] 10.222.0.58 () {58 vars in 1416 bytes} [Wed Aug 10 23:20:45 2022] DELETE /compute/v2.1/servers/b812cd8c-7e33-4e97-8df6-c7fccdf12019/os-volume_attachments/ba75fad6-85fb-4ae5-bee1-44e5e84a45e5 => generated 0 bytes in 477 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:20:46.142328 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-b800e628-74ba-467f-8586-d31a857a6179 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:46.145692 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-b800e628-74ba-467f-8586-d31a857a6179 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] [instance: b812cd8c-7e33-4e97-8df6-c7fccdf12019] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:46.154702 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b800e628-74ba-467f-8586-d31a857a6179 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:46.155517 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b800e628-74ba-467f-8586-d31a857a6179 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:46.156208 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b800e628-74ba-467f-8586-d31a857a6179 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:46.157415 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b800e628-74ba-467f-8586-d31a857a6179 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:46.158122 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b800e628-74ba-467f-8586-d31a857a6179 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:46.159855 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b800e628-74ba-467f-8586-d31a857a6179 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:46.167353 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-1654af1b-3d9d-46c3-91eb-263034a7c929 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65fc7792249b4daca6a39f7259d2236c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3661cd206d19455eb1c4ac3dd988a67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:46.196270 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1654af1b-3d9d-46c3-91eb-263034a7c929 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:46.196849 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1654af1b-3d9d-46c3-91eb-263034a7c929 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:46.197339 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1654af1b-3d9d-46c3-91eb-263034a7c929 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:46.211701 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:20:46.240778 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-b800e628-74ba-467f-8586-d31a857a6179 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] 10.222.0.58 "GET /compute/v2.1/servers/b812cd8c-7e33-4e97-8df6-c7fccdf12019/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.125967 Aug 10 23:20:46.242094 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2532/4872] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 10 23:20:46 2022] GET /compute/v2.1/servers/b812cd8c-7e33-4e97-8df6-c7fccdf12019/os-volume_attachments => generated 197 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:20:46.248314 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-1654af1b-3d9d-46c3-91eb-263034a7c929 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65fc7792249b4daca6a39f7259d2236c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3661cd206d19455eb1c4ac3dd988a67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:46.250698 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-1654af1b-3d9d-46c3-91eb-263034a7c929 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65fc7792249b4daca6a39f7259d2236c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3661cd206d19455eb1c4ac3dd988a67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:46.427338 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-1654af1b-3d9d-46c3-91eb-263034a7c929 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] 10.222.0.58 "GET /compute/v2.1/servers/detail" status: 200 len: 2707 microversion: 2.47 time: 0.918687 Aug 10 23:20:46.428570 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2341/4873] 10.222.0.58 () {60 vars in 1187 bytes} [Wed Aug 10 23:20:45 2022] GET /compute/v2.1/servers/detail => generated 2707 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:20:46.472280 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-ffa14c46-669c-4b64-9512-566d07baa879 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:46.477035 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-ffa14c46-669c-4b64-9512-566d07baa879 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] [instance: 364415e0-931a-4be4-8149-86eb03e99544] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:46.490417 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ffa14c46-669c-4b64-9512-566d07baa879 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:46.495862 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ffa14c46-669c-4b64-9512-566d07baa879 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:46.496428 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ffa14c46-669c-4b64-9512-566d07baa879 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:46.497521 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ffa14c46-669c-4b64-9512-566d07baa879 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:46.498268 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ffa14c46-669c-4b64-9512-566d07baa879 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:46.498761 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ffa14c46-669c-4b64-9512-566d07baa879 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:46.529731 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-9009b215-0929-44fb-ab50-aa6490a21bd3 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:46.530440 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-9009b215-0929-44fb-ab50-aa6490a21bd3 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: 53003fff-46d7-4621-93fb-c2751572bb90] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:46.552213 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9009b215-0929-44fb-ab50-aa6490a21bd3 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:46.552955 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9009b215-0929-44fb-ab50-aa6490a21bd3 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:46.554197 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9009b215-0929-44fb-ab50-aa6490a21bd3 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:46.555244 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9009b215-0929-44fb-ab50-aa6490a21bd3 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:46.557546 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9009b215-0929-44fb-ab50-aa6490a21bd3 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:46.559453 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9009b215-0929-44fb-ab50-aa6490a21bd3 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:46.573452 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-ffa14c46-669c-4b64-9512-566d07baa879 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] [instance: 364415e0-931a-4be4-8149-86eb03e99544] Going to try to terminate instance {{(pid=122633) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:20:46.701104 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-9009b215-0929-44fb-ab50-aa6490a21bd3 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6684f0c87e4242be9e0ffb4ef1973f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0582ace9e4443b8ad88915503ee630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:46.716601 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-9009b215-0929-44fb-ab50-aa6490a21bd3 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "GET /compute/v2.1/servers/53003fff-46d7-4621-93fb-c2751572bb90" status: 200 len: 1453 microversion: 2.1 time: 0.190898 Aug 10 23:20:46.719498 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2342/4874] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:20:46 2022] GET /compute/v2.1/servers/53003fff-46d7-4621-93fb-c2751572bb90 => generated 1453 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:20:46.725755 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-de272b22-b6fb-4efc-88f5-4a4ad1ec66d1 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:46.739373 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-de272b22-b6fb-4efc-88f5-4a4ad1ec66d1 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] [instance: 32ddd6eb-6c3f-4bd1-b9be-f819e8ef3a68] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:46.751709 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-de272b22-b6fb-4efc-88f5-4a4ad1ec66d1 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:46.753119 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-de272b22-b6fb-4efc-88f5-4a4ad1ec66d1 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:46.754573 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-de272b22-b6fb-4efc-88f5-4a4ad1ec66d1 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:46.755598 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-de272b22-b6fb-4efc-88f5-4a4ad1ec66d1 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:46.756273 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-de272b22-b6fb-4efc-88f5-4a4ad1ec66d1 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:46.763551 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-de272b22-b6fb-4efc-88f5-4a4ad1ec66d1 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:46.803914 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-ffa14c46-669c-4b64-9512-566d07baa879 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] 10.222.0.58 "DELETE /compute/v2.1/servers/364415e0-931a-4be4-8149-86eb03e99544" status: 204 len: 0 microversion: 2.47 time: 0.335588 Aug 10 23:20:46.804942 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2533/4875] 10.222.0.58 () {60 vars in 1280 bytes} [Wed Aug 10 23:20:46 2022] DELETE /compute/v2.1/servers/364415e0-931a-4be4-8149-86eb03e99544 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 10 23:20:46.819598 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-8c08515b-e2a2-4876-b7fb-d70914e159a1 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:46.821495 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-8c08515b-e2a2-4876-b7fb-d70914e159a1 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] [instance: 364415e0-931a-4be4-8149-86eb03e99544] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:46.848189 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8c08515b-e2a2-4876-b7fb-d70914e159a1 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:46.848692 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8c08515b-e2a2-4876-b7fb-d70914e159a1 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:46.849139 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8c08515b-e2a2-4876-b7fb-d70914e159a1 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:46.853337 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8c08515b-e2a2-4876-b7fb-d70914e159a1 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:46.853816 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8c08515b-e2a2-4876-b7fb-d70914e159a1 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:46.854691 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8c08515b-e2a2-4876-b7fb-d70914e159a1 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:47.092928 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-de272b22-b6fb-4efc-88f5-4a4ad1ec66d1 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5899b2ad9f1046caaf7c6073e408eeee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25abd63376614081a9d484f3c9ae950d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:47.114885 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-de272b22-b6fb-4efc-88f5-4a4ad1ec66d1 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "GET /compute/v2.1/servers/32ddd6eb-6c3f-4bd1-b9be-f819e8ef3a68" status: 200 len: 1323 microversion: 2.1 time: 0.393453 Aug 10 23:20:47.120575 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2343/4876] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:20:46 2022] GET /compute/v2.1/servers/32ddd6eb-6c3f-4bd1-b9be-f819e8ef3a68 => generated 1323 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:20:47.254595 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-e5b2a51a-953f-4e3a-8e50-f895904d6f60 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:47.257268 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-e5b2a51a-953f-4e3a-8e50-f895904d6f60 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] [instance: b812cd8c-7e33-4e97-8df6-c7fccdf12019] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:47.273053 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e5b2a51a-953f-4e3a-8e50-f895904d6f60 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:47.274183 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e5b2a51a-953f-4e3a-8e50-f895904d6f60 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:47.276219 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e5b2a51a-953f-4e3a-8e50-f895904d6f60 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:47.277360 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e5b2a51a-953f-4e3a-8e50-f895904d6f60 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:47.278054 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e5b2a51a-953f-4e3a-8e50-f895904d6f60 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:47.278823 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e5b2a51a-953f-4e3a-8e50-f895904d6f60 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:47.350275 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-e5b2a51a-953f-4e3a-8e50-f895904d6f60 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] 10.222.0.58 "GET /compute/v2.1/servers/b812cd8c-7e33-4e97-8df6-c7fccdf12019/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.099617 Aug 10 23:20:47.351313 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2344/4877] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 10 23:20:47 2022] GET /compute/v2.1/servers/b812cd8c-7e33-4e97-8df6-c7fccdf12019/os-volume_attachments => generated 197 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 23:20:47.416942 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-8c08515b-e2a2-4876-b7fb-d70914e159a1 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65fc7792249b4daca6a39f7259d2236c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3661cd206d19455eb1c4ac3dd988a67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:47.435087 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-8c08515b-e2a2-4876-b7fb-d70914e159a1 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65fc7792249b4daca6a39f7259d2236c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3661cd206d19455eb1c4ac3dd988a67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:47.436960 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-8c08515b-e2a2-4876-b7fb-d70914e159a1 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65fc7792249b4daca6a39f7259d2236c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3661cd206d19455eb1c4ac3dd988a67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:47.441487 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-8c08515b-e2a2-4876-b7fb-d70914e159a1 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] 10.222.0.58 "GET /compute/v2.1/servers/364415e0-931a-4be4-8149-86eb03e99544" status: 200 len: 1363 microversion: 2.47 time: 0.631936 Aug 10 23:20:47.450569 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2534/4878] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:20:46 2022] GET /compute/v2.1/servers/364415e0-931a-4be4-8149-86eb03e99544 => generated 1363 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:20:47.543785 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-6bd93675-2ecc-40fb-b421-25671f83746e req-2b58741f-5182-4471-9a53-99158eef0ff0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53003fff-46d7-4621-93fb-c2751572bb90", "name": "network-vif-deleted", "tag": "f5b14e4f-573b-48b3-a4b6-d1786c62a70e"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:20:47.595740 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-6bd93675-2ecc-40fb-b421-25671f83746e req-2b58741f-5182-4471-9a53-99158eef0ff0 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:47.598050 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-6bd93675-2ecc-40fb-b421-25671f83746e req-2b58741f-5182-4471-9a53-99158eef0ff0 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:47.598910 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-6bd93675-2ecc-40fb-b421-25671f83746e req-2b58741f-5182-4471-9a53-99158eef0ff0 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:47.629844 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-6bd93675-2ecc-40fb-b421-25671f83746e req-2b58741f-5182-4471-9a53-99158eef0ff0 service nova] Creating event network-vif-deleted:f5b14e4f-573b-48b3-a4b6-d1786c62a70e for instance 53003fff-46d7-4621-93fb-c2751572bb90 on n-h2-850468-14 Aug 10 23:20:47.656425 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-6bd93675-2ecc-40fb-b421-25671f83746e req-2b58741f-5182-4471-9a53-99158eef0ff0 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117295 Aug 10 23:20:47.657915 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2345/4879] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:20:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:20:47.742656 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-e4af3df3-2a16-4737-9f9b-1f42071c2098 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:47.745884 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-e4af3df3-2a16-4737-9f9b-1f42071c2098 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: 53003fff-46d7-4621-93fb-c2751572bb90] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:47.765417 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e4af3df3-2a16-4737-9f9b-1f42071c2098 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:47.766238 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e4af3df3-2a16-4737-9f9b-1f42071c2098 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:47.767055 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e4af3df3-2a16-4737-9f9b-1f42071c2098 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:47.787405 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e4af3df3-2a16-4737-9f9b-1f42071c2098 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:47.791045 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e4af3df3-2a16-4737-9f9b-1f42071c2098 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:47.791045 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e4af3df3-2a16-4737-9f9b-1f42071c2098 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:47.905357 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e4af3df3-2a16-4737-9f9b-1f42071c2098 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:47.905918 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e4af3df3-2a16-4737-9f9b-1f42071c2098 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:47.907217 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e4af3df3-2a16-4737-9f9b-1f42071c2098 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:47.907682 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.objects.instance [None req-e4af3df3-2a16-4737-9f9b-1f42071c2098 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lazy-loading 'fault' on Instance uuid 53003fff-46d7-4621-93fb-c2751572bb90 {{(pid=122633) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:20:48.142277 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-dfb487cb-2ea2-4652-bd7b-57d085f9dc64 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:48.143555 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-dfb487cb-2ea2-4652-bd7b-57d085f9dc64 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] [instance: 32ddd6eb-6c3f-4bd1-b9be-f819e8ef3a68] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:48.161533 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-e4af3df3-2a16-4737-9f9b-1f42071c2098 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6684f0c87e4242be9e0ffb4ef1973f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0582ace9e4443b8ad88915503ee630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:48.163318 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dfb487cb-2ea2-4652-bd7b-57d085f9dc64 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:48.164080 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dfb487cb-2ea2-4652-bd7b-57d085f9dc64 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:48.169464 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dfb487cb-2ea2-4652-bd7b-57d085f9dc64 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:48.171010 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dfb487cb-2ea2-4652-bd7b-57d085f9dc64 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:48.171693 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dfb487cb-2ea2-4652-bd7b-57d085f9dc64 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:48.172321 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dfb487cb-2ea2-4652-bd7b-57d085f9dc64 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:48.177021 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:20:48.200519 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-e4af3df3-2a16-4737-9f9b-1f42071c2098 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "GET /compute/v2.1/servers/53003fff-46d7-4621-93fb-c2751572bb90" status: 200 len: 1299 microversion: 2.1 time: 0.457915 Aug 10 23:20:48.201912 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2535/4880] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:20:47 2022] GET /compute/v2.1/servers/53003fff-46d7-4621-93fb-c2751572bb90 => generated 1299 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:20:48.367637 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-bcffdece-9b2a-4687-942c-b4fda492c85e tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:48.373694 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-bcffdece-9b2a-4687-942c-b4fda492c85e tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] [instance: b812cd8c-7e33-4e97-8df6-c7fccdf12019] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:48.403706 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bcffdece-9b2a-4687-942c-b4fda492c85e tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:48.404809 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bcffdece-9b2a-4687-942c-b4fda492c85e tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:48.405710 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bcffdece-9b2a-4687-942c-b4fda492c85e tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:48.406728 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bcffdece-9b2a-4687-942c-b4fda492c85e tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:48.407458 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bcffdece-9b2a-4687-942c-b4fda492c85e tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:48.408116 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bcffdece-9b2a-4687-942c-b4fda492c85e tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:48.476202 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-bcffdece-9b2a-4687-942c-b4fda492c85e tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] 10.222.0.58 "GET /compute/v2.1/servers/b812cd8c-7e33-4e97-8df6-c7fccdf12019/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.116665 Aug 10 23:20:48.482325 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2536/4881] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 10 23:20:48 2022] GET /compute/v2.1/servers/b812cd8c-7e33-4e97-8df6-c7fccdf12019/os-volume_attachments => generated 197 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 23:20:48.488992 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-f625e342-4c81-44f1-ad23-c7842fab8968 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:48.489931 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-f625e342-4c81-44f1-ad23-c7842fab8968 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] [instance: 364415e0-931a-4be4-8149-86eb03e99544] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:48.500359 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f625e342-4c81-44f1-ad23-c7842fab8968 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:48.501121 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f625e342-4c81-44f1-ad23-c7842fab8968 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:48.501767 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f625e342-4c81-44f1-ad23-c7842fab8968 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:48.507612 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f625e342-4c81-44f1-ad23-c7842fab8968 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:48.508670 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f625e342-4c81-44f1-ad23-c7842fab8968 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:48.513939 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f625e342-4c81-44f1-ad23-c7842fab8968 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:48.770821 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-f625e342-4c81-44f1-ad23-c7842fab8968 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65fc7792249b4daca6a39f7259d2236c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3661cd206d19455eb1c4ac3dd988a67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:48.787078 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-f625e342-4c81-44f1-ad23-c7842fab8968 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65fc7792249b4daca6a39f7259d2236c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3661cd206d19455eb1c4ac3dd988a67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:48.791006 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-f625e342-4c81-44f1-ad23-c7842fab8968 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65fc7792249b4daca6a39f7259d2236c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3661cd206d19455eb1c4ac3dd988a67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:48.794671 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-f625e342-4c81-44f1-ad23-c7842fab8968 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] 10.222.0.58 "GET /compute/v2.1/servers/364415e0-931a-4be4-8149-86eb03e99544" status: 200 len: 1363 microversion: 2.47 time: 0.310902 Aug 10 23:20:48.795310 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2537/4882] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:20:48 2022] GET /compute/v2.1/servers/364415e0-931a-4be4-8149-86eb03e99544 => generated 1363 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:20:48.865745 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-dfb487cb-2ea2-4652-bd7b-57d085f9dc64 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5899b2ad9f1046caaf7c6073e408eeee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25abd63376614081a9d484f3c9ae950d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:48.881102 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-dfb487cb-2ea2-4652-bd7b-57d085f9dc64 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "GET /compute/v2.1/servers/32ddd6eb-6c3f-4bd1-b9be-f819e8ef3a68" status: 200 len: 1323 microversion: 2.1 time: 0.740291 Aug 10 23:20:48.883062 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2346/4883] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:20:48 2022] GET /compute/v2.1/servers/32ddd6eb-6c3f-4bd1-b9be-f819e8ef3a68 => generated 1323 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:20:49.231896 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-e6d8ee5c-42c3-46fe-b028-bfec5d2472fd tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:49.232526 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-e6d8ee5c-42c3-46fe-b028-bfec5d2472fd tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: 53003fff-46d7-4621-93fb-c2751572bb90] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:49.241538 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e6d8ee5c-42c3-46fe-b028-bfec5d2472fd tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:49.242032 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e6d8ee5c-42c3-46fe-b028-bfec5d2472fd tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:49.242552 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e6d8ee5c-42c3-46fe-b028-bfec5d2472fd tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:49.243220 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e6d8ee5c-42c3-46fe-b028-bfec5d2472fd tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:49.243676 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e6d8ee5c-42c3-46fe-b028-bfec5d2472fd tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:49.244102 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e6d8ee5c-42c3-46fe-b028-bfec5d2472fd tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:49.333622 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e6d8ee5c-42c3-46fe-b028-bfec5d2472fd tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:49.334397 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e6d8ee5c-42c3-46fe-b028-bfec5d2472fd tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:49.334886 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e6d8ee5c-42c3-46fe-b028-bfec5d2472fd tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:49.336313 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.objects.instance [None req-e6d8ee5c-42c3-46fe-b028-bfec5d2472fd tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lazy-loading 'fault' on Instance uuid 53003fff-46d7-4621-93fb-c2751572bb90 {{(pid=122633) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:20:49.492309 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-34a54da4-0072-4b2f-a985-23c666b3dd15 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:49.498822 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-34a54da4-0072-4b2f-a985-23c666b3dd15 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] [instance: b812cd8c-7e33-4e97-8df6-c7fccdf12019] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:49.525405 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-34a54da4-0072-4b2f-a985-23c666b3dd15 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:49.526401 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-34a54da4-0072-4b2f-a985-23c666b3dd15 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:49.527141 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-34a54da4-0072-4b2f-a985-23c666b3dd15 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:49.529011 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-34a54da4-0072-4b2f-a985-23c666b3dd15 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:49.531377 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-34a54da4-0072-4b2f-a985-23c666b3dd15 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:49.532033 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-34a54da4-0072-4b2f-a985-23c666b3dd15 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:49.632637 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-34a54da4-0072-4b2f-a985-23c666b3dd15 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] 10.222.0.58 "GET /compute/v2.1/servers/b812cd8c-7e33-4e97-8df6-c7fccdf12019/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.145672 Aug 10 23:20:49.635794 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2347/4884] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 10 23:20:49 2022] GET /compute/v2.1/servers/b812cd8c-7e33-4e97-8df6-c7fccdf12019/os-volume_attachments => generated 197 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 23:20:49.823454 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-e08aa03e-b210-4553-a2c8-bf491b212122 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:49.824388 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-e08aa03e-b210-4553-a2c8-bf491b212122 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] [instance: 364415e0-931a-4be4-8149-86eb03e99544] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:49.837156 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e08aa03e-b210-4553-a2c8-bf491b212122 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:49.838106 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e08aa03e-b210-4553-a2c8-bf491b212122 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:49.838731 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e08aa03e-b210-4553-a2c8-bf491b212122 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:49.839661 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e08aa03e-b210-4553-a2c8-bf491b212122 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:49.841266 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e08aa03e-b210-4553-a2c8-bf491b212122 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:49.841859 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e08aa03e-b210-4553-a2c8-bf491b212122 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:49.988783 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-e6d8ee5c-42c3-46fe-b028-bfec5d2472fd tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6684f0c87e4242be9e0ffb4ef1973f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0582ace9e4443b8ad88915503ee630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:50.020222 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-e6d8ee5c-42c3-46fe-b028-bfec5d2472fd tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "GET /compute/v2.1/servers/53003fff-46d7-4621-93fb-c2751572bb90" status: 200 len: 1299 microversion: 2.1 time: 0.793764 Aug 10 23:20:50.020768 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2538/4885] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:20:49 2022] GET /compute/v2.1/servers/53003fff-46d7-4621-93fb-c2751572bb90 => generated 1299 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:20:50.026729 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-9929da5e-81d7-46e6-9839-e6c8325a043f tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:50.028551 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-9929da5e-81d7-46e6-9839-e6c8325a043f tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] [instance: 32ddd6eb-6c3f-4bd1-b9be-f819e8ef3a68] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:50.040638 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9929da5e-81d7-46e6-9839-e6c8325a043f tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:50.042599 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9929da5e-81d7-46e6-9839-e6c8325a043f tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:50.051550 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9929da5e-81d7-46e6-9839-e6c8325a043f tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:50.052588 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9929da5e-81d7-46e6-9839-e6c8325a043f tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:50.053126 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9929da5e-81d7-46e6-9839-e6c8325a043f tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:50.053565 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9929da5e-81d7-46e6-9839-e6c8325a043f tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:50.059944 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-e08aa03e-b210-4553-a2c8-bf491b212122 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65fc7792249b4daca6a39f7259d2236c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3661cd206d19455eb1c4ac3dd988a67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:50.075084 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-e08aa03e-b210-4553-a2c8-bf491b212122 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65fc7792249b4daca6a39f7259d2236c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3661cd206d19455eb1c4ac3dd988a67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:50.079820 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-e08aa03e-b210-4553-a2c8-bf491b212122 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65fc7792249b4daca6a39f7259d2236c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3661cd206d19455eb1c4ac3dd988a67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:50.091261 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-e08aa03e-b210-4553-a2c8-bf491b212122 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] 10.222.0.58 "GET /compute/v2.1/servers/364415e0-931a-4be4-8149-86eb03e99544" status: 200 len: 1363 microversion: 2.47 time: 0.264394 Aug 10 23:20:50.100301 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2348/4886] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:20:49 2022] GET /compute/v2.1/servers/364415e0-931a-4be4-8149-86eb03e99544 => generated 1363 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:20:50.302728 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-9929da5e-81d7-46e6-9839-e6c8325a043f tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5899b2ad9f1046caaf7c6073e408eeee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25abd63376614081a9d484f3c9ae950d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:50.317326 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-9929da5e-81d7-46e6-9839-e6c8325a043f tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "GET /compute/v2.1/servers/32ddd6eb-6c3f-4bd1-b9be-f819e8ef3a68" status: 200 len: 1323 microversion: 2.1 time: 0.294629 Aug 10 23:20:50.317924 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2539/4887] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:20:50 2022] GET /compute/v2.1/servers/32ddd6eb-6c3f-4bd1-b9be-f819e8ef3a68 => generated 1323 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:20:50.650516 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-fc063204-aad7-47a6-96a5-af98012fcfb0 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:50.653644 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-fc063204-aad7-47a6-96a5-af98012fcfb0 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] [instance: b812cd8c-7e33-4e97-8df6-c7fccdf12019] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:50.692663 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fc063204-aad7-47a6-96a5-af98012fcfb0 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:50.693182 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fc063204-aad7-47a6-96a5-af98012fcfb0 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:50.695222 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fc063204-aad7-47a6-96a5-af98012fcfb0 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:50.698928 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fc063204-aad7-47a6-96a5-af98012fcfb0 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:50.699413 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fc063204-aad7-47a6-96a5-af98012fcfb0 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:50.701329 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fc063204-aad7-47a6-96a5-af98012fcfb0 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:50.807363 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-fc063204-aad7-47a6-96a5-af98012fcfb0 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] 10.222.0.58 "GET /compute/v2.1/servers/b812cd8c-7e33-4e97-8df6-c7fccdf12019/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.161519 Aug 10 23:20:50.816876 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2349/4888] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 10 23:20:50 2022] GET /compute/v2.1/servers/b812cd8c-7e33-4e97-8df6-c7fccdf12019/os-volume_attachments => generated 197 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:20:51.044533 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-8240e9a2-068d-4679-82b5-a2a7cafff7b2 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:51.045952 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-8240e9a2-068d-4679-82b5-a2a7cafff7b2 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: 53003fff-46d7-4621-93fb-c2751572bb90] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:51.057711 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8240e9a2-068d-4679-82b5-a2a7cafff7b2 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:51.058489 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8240e9a2-068d-4679-82b5-a2a7cafff7b2 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:51.060547 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8240e9a2-068d-4679-82b5-a2a7cafff7b2 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:51.061282 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8240e9a2-068d-4679-82b5-a2a7cafff7b2 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:51.061735 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8240e9a2-068d-4679-82b5-a2a7cafff7b2 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:51.075598 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8240e9a2-068d-4679-82b5-a2a7cafff7b2 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:51.104207 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-8240e9a2-068d-4679-82b5-a2a7cafff7b2 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] HTTP exception thrown: Instance 53003fff-46d7-4621-93fb-c2751572bb90 could not be found. Aug 10 23:20:51.105910 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-8240e9a2-068d-4679-82b5-a2a7cafff7b2 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Request method failure captured: Aug 10 23:20:51.105910 n-d-850468-14 devstack@n-api.service[122633]: request: GET /compute/v2.1/servers/53003fff-46d7-4621-93fb-c2751572bb90 HTTP/1.1 Aug 10 23:20:51.105910 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:20:51.105910 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:20:51.105910 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:20:51.105910 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:20:51.105910 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:20:51.105910 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:20:51.105910 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:20:51.105910 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:20:51.105910 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9DytBT8uIivFlHEw3ugwW3-_1ks70Fcm-KUdUfNf3hiFdhb5xvDC9LI4u79J0X-frOTrhG-DWWR1w8a7yZU35-jGfQgN97QRTSA7hDEW06netEOKzarBlr77OO9sCeT3s5ektFA7vCYLl4122WPKHg-MSXQY0g9YmL291Ic7yNjWLnQ Aug 10 23:20:51.105910 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:20:51.105910 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:20:51.105910 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:20:51.105910 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:20:51.105910 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:20:51.105910 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:20:51.105910 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 0b0582ace9e4443b8ad88915503ee630 Aug 10 23:20:51.105910 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-ServersTestJSON-516662906 Aug 10 23:20:51.105910 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:20:51.105910 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:20:51.105910 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0b0582ace9e4443b8ad88915503ee630"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0b0582ace9e4443b8ad88915503ee630"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/0b0582ace9e4443b8ad88915503ee630"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_0b0582ace9e4443b8ad88915503ee630", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:20:51.105910 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-ServersTestJSON-516662906 Aug 10 23:20:51.105910 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 0b0582ace9e4443b8ad88915503ee630 Aug 10 23:20:51.105910 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-ServersTestJSON-516662906 Aug 10 23:20:51.105910 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-ServersTestJSON-516662906-project Aug 10 23:20:51.105910 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:20:51.105910 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:20:51.105910 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 6684f0c87e4242be9e0ffb4ef1973f96 Aug 10 23:20:51.105910 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-ServersTestJSON-516662906-project Aug 10 23:20:51.105910 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:20:51.105910 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance 53003fff-46d7-4621-93fb-c2751572bb90 could not be found. Aug 10 23:20:51.105910 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': '53003fff-46d7-4621-93fb-c2751572bb90'} Aug 10 23:20:51.105910 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:20:51.105910 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:20:51.105910 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:20:51.105910 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:20:51.105910 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:20:51.105910 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:20:51.105910 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:20:51.105910 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:20:51.105910 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:20:51.105910 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:20:51.105910 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53003fff-46d7-4621-93fb-c2751572bb90 could not be found. Aug 10 23:20:51.105910 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:20:51.105910 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:20:51.105910 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:20:51.105910 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:20:51.105910 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:20:51.105910 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:20:51.105910 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:20:51.105910 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:20:51.105910 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:20:51.105910 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:20:51.105910 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:20:51.105910 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:20:51.105910 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:20:51.105910 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:20:51.105910 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:20:51.105910 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:20:51.105910 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53003fff-46d7-4621-93fb-c2751572bb90 could not be found. Aug 10 23:20:51.105910 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:20:51.105910 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:20:51.105910 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:20:51.105910 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:20:51.112314 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:20:51.112314 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:20:51.112314 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:20:51.112314 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:20:51.112314 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53003fff-46d7-4621-93fb-c2751572bb90 could not be found. Aug 10 23:20:51.112314 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:20:51.112314 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-8240e9a2-068d-4679-82b5-a2a7cafff7b2 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Returning 404 to user: Instance 53003fff-46d7-4621-93fb-c2751572bb90 could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:20:51.112314 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-8240e9a2-068d-4679-82b5-a2a7cafff7b2 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "GET /compute/v2.1/servers/53003fff-46d7-4621-93fb-c2751572bb90" status: 404 len: 111 microversion: 2.1 time: 0.066825 Aug 10 23:20:51.112314 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2540/4889] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:20:51 2022] GET /compute/v2.1/servers/53003fff-46d7-4621-93fb-c2751572bb90 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:20:51.124941 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-eca1600a-51f8-4ac2-941d-f7cca3cb32d3 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:51.125557 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-eca1600a-51f8-4ac2-941d-f7cca3cb32d3 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] [instance: 364415e0-931a-4be4-8149-86eb03e99544] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:51.139059 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-eca1600a-51f8-4ac2-941d-f7cca3cb32d3 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:51.139555 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-eca1600a-51f8-4ac2-941d-f7cca3cb32d3 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:51.139990 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-eca1600a-51f8-4ac2-941d-f7cca3cb32d3 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:51.140691 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-eca1600a-51f8-4ac2-941d-f7cca3cb32d3 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:51.141144 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-eca1600a-51f8-4ac2-941d-f7cca3cb32d3 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:51.141563 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-eca1600a-51f8-4ac2-941d-f7cca3cb32d3 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:51.169994 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-eca1600a-51f8-4ac2-941d-f7cca3cb32d3 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] HTTP exception thrown: Instance 364415e0-931a-4be4-8149-86eb03e99544 could not be found. Aug 10 23:20:51.171819 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-eca1600a-51f8-4ac2-941d-f7cca3cb32d3 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Request method failure captured: Aug 10 23:20:51.171819 n-d-850468-14 devstack@n-api.service[122632]: request: GET /compute/v2.1/servers/364415e0-931a-4be4-8149-86eb03e99544 HTTP/1.1 Aug 10 23:20:51.171819 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:20:51.171819 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:20:51.171819 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:20:51.171819 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 23:20:51.171819 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:20:51.171819 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:20:51.171819 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:20:51.171819 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:20:51.171819 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9D0g5XPjBa558A6eiE5nL1i7Cz0F_3hsMa2HJQBglozyE56vLe7OPERW6a4gNbzGCDvpcZ5E23k65OV11UT6TdLhtZ0PuzkYXFQyk58divNFH4G8C5nEDBEVpJKfpXaLNkcXywNDVFxBfguMyFajFNR7mWGb5Ar1Z38y--PcqDpv_uI Aug 10 23:20:51.171819 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:20:51.171819 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:20:51.171819 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:20:51.171819 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:20:51.171819 n-d-850468-14 devstack@n-api.service[122632]: X-Openstack-Nova-Api-Version: 2.47 Aug 10 23:20:51.171819 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:20:51.171819 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:20:51.171819 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 3661cd206d19455eb1c4ac3dd988a67d Aug 10 23:20:51.171819 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-ServerShowV247Test-803332544 Aug 10 23:20:51.171819 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:20:51.171819 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:20:51.171819 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3661cd206d19455eb1c4ac3dd988a67d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3661cd206d19455eb1c4ac3dd988a67d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/3661cd206d19455eb1c4ac3dd988a67d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_3661cd206d19455eb1c4ac3dd988a67d", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:20:51.171819 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-ServerShowV247Test-803332544 Aug 10 23:20:51.171819 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 3661cd206d19455eb1c4ac3dd988a67d Aug 10 23:20:51.171819 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-ServerShowV247Test-803332544 Aug 10 23:20:51.171819 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-ServerShowV247Test-803332544-project Aug 10 23:20:51.171819 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:20:51.171819 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:20:51.171819 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: 65fc7792249b4daca6a39f7259d2236c Aug 10 23:20:51.171819 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-ServerShowV247Test-803332544-project Aug 10 23:20:51.171819 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:20:51.171819 n-d-850468-14 devstack@n-api.service[122632]: exception: Instance 364415e0-931a-4be4-8149-86eb03e99544 could not be found. Aug 10 23:20:51.171819 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': '364415e0-931a-4be4-8149-86eb03e99544'} Aug 10 23:20:51.171819 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:20:51.171819 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:20:51.171819 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:20:51.171819 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:20:51.171819 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:20:51.171819 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:20:51.171819 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:20:51.171819 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:20:51.171819 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:20:51.171819 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:20:51.171819 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 364415e0-931a-4be4-8149-86eb03e99544 could not be found. Aug 10 23:20:51.171819 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:20:51.171819 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:20:51.171819 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:20:51.171819 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:20:51.171819 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:20:51.171819 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:20:51.171819 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:20:51.171819 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:20:51.171819 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:20:51.171819 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:20:51.171819 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:20:51.171819 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:20:51.171819 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:20:51.171819 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:20:51.171819 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:20:51.171819 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:20:51.171819 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 364415e0-931a-4be4-8149-86eb03e99544 could not be found. Aug 10 23:20:51.171819 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:20:51.171819 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:20:51.171819 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:20:51.177807 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:20:51.177807 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:20:51.177807 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:20:51.177807 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:20:51.177807 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:20:51.177807 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 364415e0-931a-4be4-8149-86eb03e99544 could not be found. Aug 10 23:20:51.177807 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:20:51.177807 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-eca1600a-51f8-4ac2-941d-f7cca3cb32d3 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Returning 404 to user: Instance 364415e0-931a-4be4-8149-86eb03e99544 could not be found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:20:51.177807 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-eca1600a-51f8-4ac2-941d-f7cca3cb32d3 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] 10.222.0.58 "GET /compute/v2.1/servers/364415e0-931a-4be4-8149-86eb03e99544" status: 404 len: 111 microversion: 2.47 time: 0.052311 Aug 10 23:20:51.177807 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2350/4890] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:20:51 2022] GET /compute/v2.1/servers/364415e0-931a-4be4-8149-86eb03e99544 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 10 23:20:51.185164 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-802820d5-d38c-40a4-b4d1-be607261e553 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:51.185792 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-802820d5-d38c-40a4-b4d1-be607261e553 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] [instance: ce24e04e-229f-432f-90b2-9fd65134dbeb] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:51.195644 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-802820d5-d38c-40a4-b4d1-be607261e553 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:51.196140 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-802820d5-d38c-40a4-b4d1-be607261e553 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:51.196582 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-802820d5-d38c-40a4-b4d1-be607261e553 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:51.197301 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-802820d5-d38c-40a4-b4d1-be607261e553 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:51.197949 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-802820d5-d38c-40a4-b4d1-be607261e553 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:51.198382 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-802820d5-d38c-40a4-b4d1-be607261e553 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:51.260974 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-802820d5-d38c-40a4-b4d1-be607261e553 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] [instance: ce24e04e-229f-432f-90b2-9fd65134dbeb] Going to try to terminate instance {{(pid=122633) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:20:51.335187 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-de7e63b6-434a-4db3-b3c1-22acf3a640d9 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1974963899", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452", "networks": [{"uuid": "af9afbc6-0659-47e6-b542-cfe9f265fcc2"}]}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:20:51.385555 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:20:51.464475 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-802820d5-d38c-40a4-b4d1-be607261e553 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] 10.222.0.58 "DELETE /compute/v2.1/servers/ce24e04e-229f-432f-90b2-9fd65134dbeb" status: 204 len: 0 microversion: 2.47 time: 0.282531 Aug 10 23:20:51.465753 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2541/4891] 10.222.0.58 () {60 vars in 1280 bytes} [Wed Aug 10 23:20:51 2022] DELETE /compute/v2.1/servers/ce24e04e-229f-432f-90b2-9fd65134dbeb => generated 0 bytes in 285 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 10 23:20:51.509207 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.network.neutron [None req-de7e63b6-434a-4db3-b3c1-22acf3a640d9 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] validate_networks() for [('af9afbc6-0659-47e6-b542-cfe9f265fcc2', None, None, None, None, None)] {{(pid=122632) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 23:20:51.520924 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-78b734f7-d3be-4e3e-8d6d-e902585d294e tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:51.522574 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-78b734f7-d3be-4e3e-8d6d-e902585d294e tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] [instance: 32ddd6eb-6c3f-4bd1-b9be-f819e8ef3a68] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:51.540946 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-78b734f7-d3be-4e3e-8d6d-e902585d294e tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:51.542558 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-78b734f7-d3be-4e3e-8d6d-e902585d294e tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:51.543973 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-78b734f7-d3be-4e3e-8d6d-e902585d294e tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:51.544932 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-78b734f7-d3be-4e3e-8d6d-e902585d294e tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:51.545555 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-78b734f7-d3be-4e3e-8d6d-e902585d294e tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:51.546192 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-78b734f7-d3be-4e3e-8d6d-e902585d294e tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:52.026162 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-78b734f7-d3be-4e3e-8d6d-e902585d294e tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5899b2ad9f1046caaf7c6073e408eeee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25abd63376614081a9d484f3c9ae950d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:52.038876 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-78b734f7-d3be-4e3e-8d6d-e902585d294e tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "GET /compute/v2.1/servers/32ddd6eb-6c3f-4bd1-b9be-f819e8ef3a68" status: 200 len: 1391 microversion: 2.1 time: 0.571607 Aug 10 23:20:52.045734 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2542/4892] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:20:51 2022] GET /compute/v2.1/servers/32ddd6eb-6c3f-4bd1-b9be-f819e8ef3a68 => generated 1391 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:20:52.065361 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-7d56a377-1537-434e-b6f2-f8d2835adcef tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:52.070138 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-7d56a377-1537-434e-b6f2-f8d2835adcef tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] [instance: ce24e04e-229f-432f-90b2-9fd65134dbeb] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:52.087417 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7d56a377-1537-434e-b6f2-f8d2835adcef tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:52.088040 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7d56a377-1537-434e-b6f2-f8d2835adcef tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:52.088701 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7d56a377-1537-434e-b6f2-f8d2835adcef tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:52.091263 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7d56a377-1537-434e-b6f2-f8d2835adcef tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:52.092442 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7d56a377-1537-434e-b6f2-f8d2835adcef tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:52.093317 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7d56a377-1537-434e-b6f2-f8d2835adcef tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:52.206619 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-7d56a377-1537-434e-b6f2-f8d2835adcef tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65fc7792249b4daca6a39f7259d2236c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3661cd206d19455eb1c4ac3dd988a67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:52.234684 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-7d56a377-1537-434e-b6f2-f8d2835adcef tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65fc7792249b4daca6a39f7259d2236c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3661cd206d19455eb1c4ac3dd988a67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:52.251059 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-7d56a377-1537-434e-b6f2-f8d2835adcef tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65fc7792249b4daca6a39f7259d2236c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3661cd206d19455eb1c4ac3dd988a67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:52.254625 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-7d56a377-1537-434e-b6f2-f8d2835adcef tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] 10.222.0.58 "GET /compute/v2.1/servers/ce24e04e-229f-432f-90b2-9fd65134dbeb" status: 200 len: 1363 microversion: 2.47 time: 0.193246 Aug 10 23:20:52.267179 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2543/4893] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:20:52 2022] GET /compute/v2.1/servers/ce24e04e-229f-432f-90b2-9fd65134dbeb => generated 1363 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:20:52.282357 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-75bf965c-1b71-4d72-aff3-49fba23d832b tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:52.285471 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-75bf965c-1b71-4d72-aff3-49fba23d832b tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] [instance: b812cd8c-7e33-4e97-8df6-c7fccdf12019] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:52.300107 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-75bf965c-1b71-4d72-aff3-49fba23d832b tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:52.301004 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-75bf965c-1b71-4d72-aff3-49fba23d832b tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:52.312941 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-75bf965c-1b71-4d72-aff3-49fba23d832b tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:52.314230 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-75bf965c-1b71-4d72-aff3-49fba23d832b tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:52.315497 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-75bf965c-1b71-4d72-aff3-49fba23d832b tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:52.327640 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-75bf965c-1b71-4d72-aff3-49fba23d832b tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:52.385642 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-75bf965c-1b71-4d72-aff3-49fba23d832b tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] 10.222.0.58 "GET /compute/v2.1/servers/b812cd8c-7e33-4e97-8df6-c7fccdf12019/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.116690 Aug 10 23:20:52.391021 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2544/4894] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 10 23:20:52 2022] GET /compute/v2.1/servers/b812cd8c-7e33-4e97-8df6-c7fccdf12019/os-volume_attachments => generated 197 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:20:52.889072 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-de7e63b6-434a-4db3-b3c1-22acf3a640d9 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Flavor limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:20:52.889575 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-de7e63b6-434a-4db3-b3c1-22acf3a640d9 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Image limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:20:52.889674 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-de7e63b6-434a-4db3-b3c1-22acf3a640d9 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Flavor pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:20:52.890078 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-de7e63b6-434a-4db3-b3c1-22acf3a640d9 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Image pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:20:52.891164 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-de7e63b6-434a-4db3-b3c1-22acf3a640d9 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:20:52.909702 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-de7e63b6-434a-4db3-b3c1-22acf3a640d9 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:52.910205 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-de7e63b6-434a-4db3-b3c1-22acf3a640d9 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:52.911663 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-de7e63b6-434a-4db3-b3c1-22acf3a640d9 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:52.913355 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-de7e63b6-434a-4db3-b3c1-22acf3a640d9 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:52.913827 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-de7e63b6-434a-4db3-b3c1-22acf3a640d9 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:52.914253 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-de7e63b6-434a-4db3-b3c1-22acf3a640d9 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:52.976814 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-de7e63b6-434a-4db3-b3c1-22acf3a640d9 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Getting quotas for project 0b0582ace9e4443b8ad88915503ee630. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:20:52.989846 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-de7e63b6-434a-4db3-b3c1-22acf3a640d9 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Getting quotas for user 6684f0c87e4242be9e0ffb4ef1973f96 and project 0b0582ace9e4443b8ad88915503ee630. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:20:53.027720 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-de7e63b6-434a-4db3-b3c1-22acf3a640d9 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Going to run 1 instances... {{(pid=122632) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 23:20:53.037691 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-de7e63b6-434a-4db3-b3c1-22acf3a640d9 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: a8ed4840-07d6-4506-a0ef-b686a6231fb7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78ad8905-f66f-4733-8be9-2b260f1fabed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122632) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 23:20:53.068420 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-3471680b-119a-46fd-b4d8-18d73c23924b tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:53.069652 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-3471680b-119a-46fd-b4d8-18d73c23924b tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] [instance: 32ddd6eb-6c3f-4bd1-b9be-f819e8ef3a68] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:53.082321 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3471680b-119a-46fd-b4d8-18d73c23924b tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:53.083121 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3471680b-119a-46fd-b4d8-18d73c23924b tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:53.085332 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3471680b-119a-46fd-b4d8-18d73c23924b tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:53.086400 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3471680b-119a-46fd-b4d8-18d73c23924b tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:53.092698 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3471680b-119a-46fd-b4d8-18d73c23924b tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:53.094726 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3471680b-119a-46fd-b4d8-18d73c23924b tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:53.162544 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-de7e63b6-434a-4db3-b3c1-22acf3a640d9 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.832384 Aug 10 23:20:53.163245 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2351/4895] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 23:20:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 1834 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 23:20:53.186730 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-6c50d0c3-502f-4f80-a840-c34646f01712 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:53.196369 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-6c50d0c3-502f-4f80-a840-c34646f01712 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: a8ed4840-07d6-4506-a0ef-b686a6231fb7] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:53.358996 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-6c50d0c3-502f-4f80-a840-c34646f01712 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6684f0c87e4242be9e0ffb4ef1973f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0582ace9e4443b8ad88915503ee630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:53.371061 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-6c50d0c3-502f-4f80-a840-c34646f01712 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "GET /compute/v2.1/servers/a8ed4840-07d6-4506-a0ef-b686a6231fb7" status: 200 len: 1209 microversion: 2.1 time: 0.192392 Aug 10 23:20:53.373763 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2352/4896] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:20:53 2022] GET /compute/v2.1/servers/a8ed4840-07d6-4506-a0ef-b686a6231fb7 => generated 1209 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:20:53.379858 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-35f841f8-d229-44da-93ab-72b385231542 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:53.380792 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-35f841f8-d229-44da-93ab-72b385231542 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] [instance: ce24e04e-229f-432f-90b2-9fd65134dbeb] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:53.388442 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-35f841f8-d229-44da-93ab-72b385231542 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:53.390258 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-35f841f8-d229-44da-93ab-72b385231542 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:53.390974 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-35f841f8-d229-44da-93ab-72b385231542 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:53.391935 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-35f841f8-d229-44da-93ab-72b385231542 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:53.394267 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-35f841f8-d229-44da-93ab-72b385231542 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:53.395479 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-35f841f8-d229-44da-93ab-72b385231542 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:53.549614 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-35f841f8-d229-44da-93ab-72b385231542 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '65fc7792249b4daca6a39f7259d2236c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3661cd206d19455eb1c4ac3dd988a67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:53.568711 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-35f841f8-d229-44da-93ab-72b385231542 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '65fc7792249b4daca6a39f7259d2236c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3661cd206d19455eb1c4ac3dd988a67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:53.574293 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-35f841f8-d229-44da-93ab-72b385231542 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '65fc7792249b4daca6a39f7259d2236c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3661cd206d19455eb1c4ac3dd988a67d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:53.578568 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-35f841f8-d229-44da-93ab-72b385231542 tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] 10.222.0.58 "GET /compute/v2.1/servers/ce24e04e-229f-432f-90b2-9fd65134dbeb" status: 200 len: 1363 microversion: 2.47 time: 0.203301 Aug 10 23:20:53.596518 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2353/4897] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:20:53 2022] GET /compute/v2.1/servers/ce24e04e-229f-432f-90b2-9fd65134dbeb => generated 1363 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:20:53.613832 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-cc196921-aa75-4d24-bebf-bcad85b1819a tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:53.622377 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-cc196921-aa75-4d24-bebf-bcad85b1819a tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] [instance: b812cd8c-7e33-4e97-8df6-c7fccdf12019] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:53.642442 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cc196921-aa75-4d24-bebf-bcad85b1819a tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:53.643969 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cc196921-aa75-4d24-bebf-bcad85b1819a tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:53.644409 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cc196921-aa75-4d24-bebf-bcad85b1819a tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:53.645158 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cc196921-aa75-4d24-bebf-bcad85b1819a tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:53.645616 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cc196921-aa75-4d24-bebf-bcad85b1819a tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:53.646050 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cc196921-aa75-4d24-bebf-bcad85b1819a tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:53.698681 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-cc196921-aa75-4d24-bebf-bcad85b1819a tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] 10.222.0.58 "GET /compute/v2.1/servers/b812cd8c-7e33-4e97-8df6-c7fccdf12019/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.099342 Aug 10 23:20:53.702715 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2354/4898] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 10 23:20:53 2022] GET /compute/v2.1/servers/b812cd8c-7e33-4e97-8df6-c7fccdf12019/os-volume_attachments => generated 197 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:20:54.059487 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-3471680b-119a-46fd-b4d8-18d73c23924b tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5899b2ad9f1046caaf7c6073e408eeee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25abd63376614081a9d484f3c9ae950d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:54.069005 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-3471680b-119a-46fd-b4d8-18d73c23924b tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "GET /compute/v2.1/servers/32ddd6eb-6c3f-4bd1-b9be-f819e8ef3a68" status: 200 len: 1391 microversion: 2.1 time: 1.006742 Aug 10 23:20:54.078917 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2545/4899] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:20:53 2022] GET /compute/v2.1/servers/32ddd6eb-6c3f-4bd1-b9be-f819e8ef3a68 => generated 1391 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:20:54.395402 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c34b643d-7d27-414d-9733-262ca6fa68fb tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:54.396084 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-c34b643d-7d27-414d-9733-262ca6fa68fb tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: a8ed4840-07d6-4506-a0ef-b686a6231fb7] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:54.405635 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c34b643d-7d27-414d-9733-262ca6fa68fb tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:54.406142 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c34b643d-7d27-414d-9733-262ca6fa68fb tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:54.406588 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c34b643d-7d27-414d-9733-262ca6fa68fb tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:54.407345 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c34b643d-7d27-414d-9733-262ca6fa68fb tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:54.419627 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c34b643d-7d27-414d-9733-262ca6fa68fb tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:54.420403 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c34b643d-7d27-414d-9733-262ca6fa68fb tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:54.609773 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-66de301d-c366-4817-9c17-3cb36c9fca2f tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:54.610703 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-66de301d-c366-4817-9c17-3cb36c9fca2f tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] [instance: ce24e04e-229f-432f-90b2-9fd65134dbeb] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:54.638434 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-66de301d-c366-4817-9c17-3cb36c9fca2f tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:54.639954 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-66de301d-c366-4817-9c17-3cb36c9fca2f tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:54.645395 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-66de301d-c366-4817-9c17-3cb36c9fca2f tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:54.646330 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-66de301d-c366-4817-9c17-3cb36c9fca2f tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:54.646965 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-66de301d-c366-4817-9c17-3cb36c9fca2f tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:54.647523 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-66de301d-c366-4817-9c17-3cb36c9fca2f tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:54.674947 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-66de301d-c366-4817-9c17-3cb36c9fca2f tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] HTTP exception thrown: Instance ce24e04e-229f-432f-90b2-9fd65134dbeb could not be found. Aug 10 23:20:54.677546 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-66de301d-c366-4817-9c17-3cb36c9fca2f tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Request method failure captured: Aug 10 23:20:54.677546 n-d-850468-14 devstack@n-api.service[122633]: request: GET /compute/v2.1/servers/ce24e04e-229f-432f-90b2-9fd65134dbeb HTTP/1.1 Aug 10 23:20:54.677546 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:20:54.677546 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:20:54.677546 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:20:54.677546 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:20:54.677546 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:20:54.677546 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:20:54.677546 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:20:54.677546 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:20:54.677546 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9D0g5XPjBa558A6eiE5nL1i7Cz0F_3hsMa2HJQBglozyE56vLe7OPERW6a4gNbzGCDvpcZ5E23k65OV11UT6TdLhtZ0PuzkYXFQyk58divNFH4G8C5nEDBEVpJKfpXaLNkcXywNDVFxBfguMyFajFNR7mWGb5Ar1Z38y--PcqDpv_uI Aug 10 23:20:54.677546 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:20:54.677546 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:20:54.677546 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:20:54.677546 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:20:54.677546 n-d-850468-14 devstack@n-api.service[122633]: X-Openstack-Nova-Api-Version: 2.47 Aug 10 23:20:54.677546 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:20:54.677546 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:20:54.677546 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 3661cd206d19455eb1c4ac3dd988a67d Aug 10 23:20:54.677546 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-ServerShowV247Test-803332544 Aug 10 23:20:54.677546 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:20:54.677546 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:20:54.677546 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3661cd206d19455eb1c4ac3dd988a67d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/3661cd206d19455eb1c4ac3dd988a67d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/3661cd206d19455eb1c4ac3dd988a67d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_3661cd206d19455eb1c4ac3dd988a67d", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:20:54.677546 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-ServerShowV247Test-803332544 Aug 10 23:20:54.677546 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 3661cd206d19455eb1c4ac3dd988a67d Aug 10 23:20:54.677546 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-ServerShowV247Test-803332544 Aug 10 23:20:54.677546 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-ServerShowV247Test-803332544-project Aug 10 23:20:54.677546 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:20:54.677546 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:20:54.677546 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 65fc7792249b4daca6a39f7259d2236c Aug 10 23:20:54.677546 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-ServerShowV247Test-803332544-project Aug 10 23:20:54.677546 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:20:54.677546 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance ce24e04e-229f-432f-90b2-9fd65134dbeb could not be found. Aug 10 23:20:54.677546 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': 'ce24e04e-229f-432f-90b2-9fd65134dbeb'} Aug 10 23:20:54.677546 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:20:54.677546 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:20:54.677546 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:20:54.677546 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:20:54.677546 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:20:54.677546 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:20:54.677546 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:20:54.677546 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:20:54.677546 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:20:54.677546 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:20:54.677546 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce24e04e-229f-432f-90b2-9fd65134dbeb could not be found. Aug 10 23:20:54.677546 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:20:54.677546 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:20:54.677546 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:20:54.677546 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:20:54.677546 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:20:54.677546 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:20:54.677546 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:20:54.677546 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:20:54.677546 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:20:54.677546 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:20:54.677546 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:20:54.677546 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:20:54.677546 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:20:54.677546 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:20:54.677546 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:20:54.677546 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:20:54.677546 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce24e04e-229f-432f-90b2-9fd65134dbeb could not be found. Aug 10 23:20:54.677546 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:20:54.677546 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:20:54.677546 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:20:54.682150 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:20:54.682150 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:20:54.682150 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:20:54.682150 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:20:54.682150 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:20:54.682150 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce24e04e-229f-432f-90b2-9fd65134dbeb could not be found. Aug 10 23:20:54.682150 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:20:54.685997 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-66de301d-c366-4817-9c17-3cb36c9fca2f tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] Returning 404 to user: Instance ce24e04e-229f-432f-90b2-9fd65134dbeb could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:20:54.687229 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-66de301d-c366-4817-9c17-3cb36c9fca2f tempest-ServerShowV247Test-803332544 tempest-ServerShowV247Test-803332544-project] 10.222.0.58 "GET /compute/v2.1/servers/ce24e04e-229f-432f-90b2-9fd65134dbeb" status: 404 len: 111 microversion: 2.47 time: 0.083470 Aug 10 23:20:54.688434 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2546/4900] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:20:54 2022] GET /compute/v2.1/servers/ce24e04e-229f-432f-90b2-9fd65134dbeb => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 10 23:20:54.697105 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-c34b643d-7d27-414d-9733-262ca6fa68fb tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6684f0c87e4242be9e0ffb4ef1973f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0582ace9e4443b8ad88915503ee630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:54.718123 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-c34b643d-7d27-414d-9733-262ca6fa68fb tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "GET /compute/v2.1/servers/a8ed4840-07d6-4506-a0ef-b686a6231fb7" status: 200 len: 1261 microversion: 2.1 time: 0.328070 Aug 10 23:20:54.725386 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2355/4901] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:20:54 2022] GET /compute/v2.1/servers/a8ed4840-07d6-4506-a0ef-b686a6231fb7 => generated 1261 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:20:54.731760 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c3c0e840-6134-4f1b-b091-1a857c0b6d08 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:54.733936 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-9c96634e-5c28-42ad-b583-e72bcf4738df req-b155c582-0022-426e-8c68-2388deb55e37 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32ddd6eb-6c3f-4bd1-b9be-f819e8ef3a68", "tag": "4f9f24c0-e01f-4d27-8d15-06a370ec5bb8"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:20:54.734093 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-c3c0e840-6134-4f1b-b091-1a857c0b6d08 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] [instance: b812cd8c-7e33-4e97-8df6-c7fccdf12019] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:54.753259 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c3c0e840-6134-4f1b-b091-1a857c0b6d08 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:54.755116 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c3c0e840-6134-4f1b-b091-1a857c0b6d08 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:54.755760 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c3c0e840-6134-4f1b-b091-1a857c0b6d08 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:54.757919 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c3c0e840-6134-4f1b-b091-1a857c0b6d08 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:54.758573 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c3c0e840-6134-4f1b-b091-1a857c0b6d08 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:54.760656 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c3c0e840-6134-4f1b-b091-1a857c0b6d08 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:54.775893 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-9c96634e-5c28-42ad-b583-e72bcf4738df req-b155c582-0022-426e-8c68-2388deb55e37 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:54.781593 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-9c96634e-5c28-42ad-b583-e72bcf4738df req-b155c582-0022-426e-8c68-2388deb55e37 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:54.782500 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-9c96634e-5c28-42ad-b583-e72bcf4738df req-b155c582-0022-426e-8c68-2388deb55e37 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:54.804462 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-9c96634e-5c28-42ad-b583-e72bcf4738df req-b155c582-0022-426e-8c68-2388deb55e37 service nova] Creating event network-changed:4f9f24c0-e01f-4d27-8d15-06a370ec5bb8 for instance 32ddd6eb-6c3f-4bd1-b9be-f819e8ef3a68 on n-h2-850468-14 Aug 10 23:20:54.811335 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-9c96634e-5c28-42ad-b583-e72bcf4738df req-b155c582-0022-426e-8c68-2388deb55e37 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121245 Aug 10 23:20:54.812688 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2547/4902] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:20:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:20:54.835692 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-c3c0e840-6134-4f1b-b091-1a857c0b6d08 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] 10.222.0.58 "GET /compute/v2.1/servers/b812cd8c-7e33-4e97-8df6-c7fccdf12019/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.108568 Aug 10 23:20:54.836307 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2356/4903] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 10 23:20:54 2022] GET /compute/v2.1/servers/b812cd8c-7e33-4e97-8df6-c7fccdf12019/os-volume_attachments => generated 25 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 23:20:54.926163 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-43df4acc-3b90-402c-b8d1-098bcd80c2d8 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:54.931512 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-43df4acc-3b90-402c-b8d1-098bcd80c2d8 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] [instance: b812cd8c-7e33-4e97-8df6-c7fccdf12019] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:54.938524 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-43df4acc-3b90-402c-b8d1-098bcd80c2d8 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:54.939045 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-43df4acc-3b90-402c-b8d1-098bcd80c2d8 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:54.939585 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-43df4acc-3b90-402c-b8d1-098bcd80c2d8 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:54.940353 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-43df4acc-3b90-402c-b8d1-098bcd80c2d8 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:54.940790 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-43df4acc-3b90-402c-b8d1-098bcd80c2d8 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:54.941227 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-43df4acc-3b90-402c-b8d1-098bcd80c2d8 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:55.007354 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-43df4acc-3b90-402c-b8d1-098bcd80c2d8 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] [instance: b812cd8c-7e33-4e97-8df6-c7fccdf12019] Going to try to terminate instance {{(pid=122633) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:20:55.101902 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-e3a990e1-1fdf-439b-b1a9-2c9df9c4a661 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:55.102538 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-e3a990e1-1fdf-439b-b1a9-2c9df9c4a661 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] [instance: 32ddd6eb-6c3f-4bd1-b9be-f819e8ef3a68] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:55.114209 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e3a990e1-1fdf-439b-b1a9-2c9df9c4a661 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:55.114719 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e3a990e1-1fdf-439b-b1a9-2c9df9c4a661 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:55.120455 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e3a990e1-1fdf-439b-b1a9-2c9df9c4a661 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:55.121359 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e3a990e1-1fdf-439b-b1a9-2c9df9c4a661 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:55.129588 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e3a990e1-1fdf-439b-b1a9-2c9df9c4a661 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:55.130141 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e3a990e1-1fdf-439b-b1a9-2c9df9c4a661 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:55.229426 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-43df4acc-3b90-402c-b8d1-098bcd80c2d8 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] 10.222.0.58 "DELETE /compute/v2.1/servers/b812cd8c-7e33-4e97-8df6-c7fccdf12019" status: 204 len: 0 microversion: 2.1 time: 0.308604 Aug 10 23:20:55.230019 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2548/4904] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:20:54 2022] DELETE /compute/v2.1/servers/b812cd8c-7e33-4e97-8df6-c7fccdf12019 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:20:55.242820 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-f193bab3-d4a0-4002-98dd-9f8abbedb97e tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:55.249228 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-f193bab3-d4a0-4002-98dd-9f8abbedb97e tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] [instance: b812cd8c-7e33-4e97-8df6-c7fccdf12019] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:55.264633 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f193bab3-d4a0-4002-98dd-9f8abbedb97e tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:55.268866 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f193bab3-d4a0-4002-98dd-9f8abbedb97e tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:55.269570 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f193bab3-d4a0-4002-98dd-9f8abbedb97e tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:55.278344 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f193bab3-d4a0-4002-98dd-9f8abbedb97e tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:55.279261 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f193bab3-d4a0-4002-98dd-9f8abbedb97e tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:55.279898 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f193bab3-d4a0-4002-98dd-9f8abbedb97e tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:55.815094 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-f193bab3-d4a0-4002-98dd-9f8abbedb97e tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d89081084f14e0187f4c67cd9185fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b557edd165144c8943eb9acc339a377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:55.826551 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-f193bab3-d4a0-4002-98dd-9f8abbedb97e tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] 10.222.0.58 "GET /compute/v2.1/servers/b812cd8c-7e33-4e97-8df6-c7fccdf12019" status: 200 len: 1682 microversion: 2.1 time: 0.591778 Aug 10 23:20:55.827188 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2549/4905] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:20:55 2022] GET /compute/v2.1/servers/b812cd8c-7e33-4e97-8df6-c7fccdf12019 => generated 1682 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:20:55.855672 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-1478476f-6848-4bf3-8a29-d0c65bf63602 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:55.856312 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-1478476f-6848-4bf3-8a29-d0c65bf63602 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: a8ed4840-07d6-4506-a0ef-b686a6231fb7] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:55.884247 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1478476f-6848-4bf3-8a29-d0c65bf63602 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:55.884782 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1478476f-6848-4bf3-8a29-d0c65bf63602 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:55.885587 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1478476f-6848-4bf3-8a29-d0c65bf63602 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:55.886564 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1478476f-6848-4bf3-8a29-d0c65bf63602 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:55.888312 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1478476f-6848-4bf3-8a29-d0c65bf63602 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:55.888941 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1478476f-6848-4bf3-8a29-d0c65bf63602 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:56.063536 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-1478476f-6848-4bf3-8a29-d0c65bf63602 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6684f0c87e4242be9e0ffb4ef1973f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0582ace9e4443b8ad88915503ee630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:56.069063 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:20:56.078503 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-1478476f-6848-4bf3-8a29-d0c65bf63602 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "GET /compute/v2.1/servers/a8ed4840-07d6-4506-a0ef-b686a6231fb7" status: 200 len: 1267 microversion: 2.1 time: 0.234155 Aug 10 23:20:56.079392 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2550/4906] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:20:55 2022] GET /compute/v2.1/servers/a8ed4840-07d6-4506-a0ef-b686a6231fb7 => generated 1267 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:20:56.158291 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-e3a990e1-1fdf-439b-b1a9-2c9df9c4a661 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5899b2ad9f1046caaf7c6073e408eeee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25abd63376614081a9d484f3c9ae950d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:56.168357 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-e3a990e1-1fdf-439b-b1a9-2c9df9c4a661 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "GET /compute/v2.1/servers/32ddd6eb-6c3f-4bd1-b9be-f819e8ef3a68" status: 200 len: 1391 microversion: 2.1 time: 1.070673 Aug 10 23:20:56.169395 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2357/4907] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:20:55 2022] GET /compute/v2.1/servers/32ddd6eb-6c3f-4bd1-b9be-f819e8ef3a68 => generated 1391 bytes in 1072 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:20:56.853402 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-bbbd9dcd-1815-4e57-aed0-7ab42a174434 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:56.854147 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-bbbd9dcd-1815-4e57-aed0-7ab42a174434 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] [instance: b812cd8c-7e33-4e97-8df6-c7fccdf12019] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:56.889140 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bbbd9dcd-1815-4e57-aed0-7ab42a174434 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:56.893628 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bbbd9dcd-1815-4e57-aed0-7ab42a174434 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:56.896285 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bbbd9dcd-1815-4e57-aed0-7ab42a174434 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:56.899405 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bbbd9dcd-1815-4e57-aed0-7ab42a174434 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:56.901804 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bbbd9dcd-1815-4e57-aed0-7ab42a174434 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:56.904298 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bbbd9dcd-1815-4e57-aed0-7ab42a174434 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:56.980327 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-cac01ac6-6d5a-41da-a151-78579981a215 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-951019882", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452", "networks": [{"uuid": "2fbd93c2-3503-4907-8ddb-f8684d61eb32"}], "key_name": "tempest-TestSecurityGroupsBasicOps-295433155", "security_groups": []}, "os:scheduler_hints": {"different_host": ["ee6a796b-efa5-4c73-8776-d86b54ca2190"]}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:20:57.112923 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.network.neutron [None req-cac01ac6-6d5a-41da-a151-78579981a215 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] validate_networks() for [('2fbd93c2-3503-4907-8ddb-f8684d61eb32', None, None, None, None, None)] {{(pid=122632) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 23:20:57.307584 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-bbbd9dcd-1815-4e57-aed0-7ab42a174434 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d89081084f14e0187f4c67cd9185fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b557edd165144c8943eb9acc339a377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:57.324843 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-bbbd9dcd-1815-4e57-aed0-7ab42a174434 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] 10.222.0.58 "GET /compute/v2.1/servers/b812cd8c-7e33-4e97-8df6-c7fccdf12019" status: 200 len: 1682 microversion: 2.1 time: 0.476465 Aug 10 23:20:57.325777 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2551/4908] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:20:56 2022] GET /compute/v2.1/servers/b812cd8c-7e33-4e97-8df6-c7fccdf12019 => generated 1682 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:20:57.343286 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-d5d16c02-62f3-4dba-a462-983cf51e66cd tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:57.344303 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-d5d16c02-62f3-4dba-a462-983cf51e66cd tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: a8ed4840-07d6-4506-a0ef-b686a6231fb7] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:57.355176 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d5d16c02-62f3-4dba-a462-983cf51e66cd tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:57.356002 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d5d16c02-62f3-4dba-a462-983cf51e66cd tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:57.356661 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d5d16c02-62f3-4dba-a462-983cf51e66cd tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:57.358698 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d5d16c02-62f3-4dba-a462-983cf51e66cd tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:57.359400 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d5d16c02-62f3-4dba-a462-983cf51e66cd tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:57.363428 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d5d16c02-62f3-4dba-a462-983cf51e66cd tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:57.685649 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-d5d16c02-62f3-4dba-a462-983cf51e66cd tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6684f0c87e4242be9e0ffb4ef1973f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0582ace9e4443b8ad88915503ee630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:57.697950 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-d5d16c02-62f3-4dba-a462-983cf51e66cd tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "GET /compute/v2.1/servers/a8ed4840-07d6-4506-a0ef-b686a6231fb7" status: 200 len: 1267 microversion: 2.1 time: 0.370449 Aug 10 23:20:57.701321 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2552/4909] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:20:57 2022] GET /compute/v2.1/servers/a8ed4840-07d6-4506-a0ef-b686a6231fb7 => generated 1267 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:20:57.706850 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-a463c87e-2625-481c-a08b-66d3a61929f8 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:57.707470 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-a463c87e-2625-481c-a08b-66d3a61929f8 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] [instance: 32ddd6eb-6c3f-4bd1-b9be-f819e8ef3a68] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:57.709396 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=4 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:20:57.746273 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a463c87e-2625-481c-a08b-66d3a61929f8 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:57.746769 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a463c87e-2625-481c-a08b-66d3a61929f8 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:57.747242 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a463c87e-2625-481c-a08b-66d3a61929f8 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:57.747974 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a463c87e-2625-481c-a08b-66d3a61929f8 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:57.748417 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a463c87e-2625-481c-a08b-66d3a61929f8 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:57.748844 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a463c87e-2625-481c-a08b-66d3a61929f8 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:58.790156 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-a463c87e-2625-481c-a08b-66d3a61929f8 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5899b2ad9f1046caaf7c6073e408eeee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25abd63376614081a9d484f3c9ae950d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:58.798215 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-a463c87e-2625-481c-a08b-66d3a61929f8 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "GET /compute/v2.1/servers/32ddd6eb-6c3f-4bd1-b9be-f819e8ef3a68" status: 200 len: 1391 microversion: 2.1 time: 1.095792 Aug 10 23:20:58.799514 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2553/4910] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:20:57 2022] GET /compute/v2.1/servers/32ddd6eb-6c3f-4bd1-b9be-f819e8ef3a68 => generated 1391 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:20:58.833089 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-d06e9e20-35bd-480c-b08d-0f55ab2d8917 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:58.834056 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-d06e9e20-35bd-480c-b08d-0f55ab2d8917 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] [instance: b812cd8c-7e33-4e97-8df6-c7fccdf12019] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:58.842127 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d06e9e20-35bd-480c-b08d-0f55ab2d8917 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:58.847728 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d06e9e20-35bd-480c-b08d-0f55ab2d8917 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:58.848475 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d06e9e20-35bd-480c-b08d-0f55ab2d8917 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:58.849679 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d06e9e20-35bd-480c-b08d-0f55ab2d8917 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:58.850442 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d06e9e20-35bd-480c-b08d-0f55ab2d8917 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:58.851306 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d06e9e20-35bd-480c-b08d-0f55ab2d8917 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:59.405350 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-d06e9e20-35bd-480c-b08d-0f55ab2d8917 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d89081084f14e0187f4c67cd9185fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b557edd165144c8943eb9acc339a377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:59.430798 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-d06e9e20-35bd-480c-b08d-0f55ab2d8917 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] 10.222.0.58 "GET /compute/v2.1/servers/b812cd8c-7e33-4e97-8df6-c7fccdf12019" status: 200 len: 1682 microversion: 2.1 time: 0.602479 Aug 10 23:20:59.446964 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2554/4911] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:20:58 2022] GET /compute/v2.1/servers/b812cd8c-7e33-4e97-8df6-c7fccdf12019 => generated 1682 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:20:59.452886 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-fb55f2fd-9c9f-4141-ad53-48d6fb777d72 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:20:59.453728 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-fb55f2fd-9c9f-4141-ad53-48d6fb777d72 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: a8ed4840-07d6-4506-a0ef-b686a6231fb7] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:20:59.462916 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fb55f2fd-9c9f-4141-ad53-48d6fb777d72 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:59.464266 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fb55f2fd-9c9f-4141-ad53-48d6fb777d72 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:59.464867 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fb55f2fd-9c9f-4141-ad53-48d6fb777d72 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:59.465918 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fb55f2fd-9c9f-4141-ad53-48d6fb777d72 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:20:59.467123 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fb55f2fd-9c9f-4141-ad53-48d6fb777d72 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:20:59.468027 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fb55f2fd-9c9f-4141-ad53-48d6fb777d72 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:20:59.978204 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-fb55f2fd-9c9f-4141-ad53-48d6fb777d72 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6684f0c87e4242be9e0ffb4ef1973f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0582ace9e4443b8ad88915503ee630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:20:59.993016 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-fb55f2fd-9c9f-4141-ad53-48d6fb777d72 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "GET /compute/v2.1/servers/a8ed4840-07d6-4506-a0ef-b686a6231fb7" status: 200 len: 1309 microversion: 2.1 time: 0.544482 Aug 10 23:21:00.000325 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2555/4912] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:20:59 2022] GET /compute/v2.1/servers/a8ed4840-07d6-4506-a0ef-b686a6231fb7 => generated 1309 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:21:00.026762 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-f752a6ce-0836-4b66-8f44-06b240ec3050 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:00.027836 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-f752a6ce-0836-4b66-8f44-06b240ec3050 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] [instance: 32ddd6eb-6c3f-4bd1-b9be-f819e8ef3a68] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:00.040496 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f752a6ce-0836-4b66-8f44-06b240ec3050 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:00.041504 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f752a6ce-0836-4b66-8f44-06b240ec3050 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:00.042281 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f752a6ce-0836-4b66-8f44-06b240ec3050 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:00.043285 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f752a6ce-0836-4b66-8f44-06b240ec3050 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:00.045870 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f752a6ce-0836-4b66-8f44-06b240ec3050 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:00.047482 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f752a6ce-0836-4b66-8f44-06b240ec3050 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:00.431331 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-cac01ac6-6d5a-41da-a151-78579981a215 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Flavor limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:21:00.432954 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-cac01ac6-6d5a-41da-a151-78579981a215 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Image limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:21:00.433659 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-cac01ac6-6d5a-41da-a151-78579981a215 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Flavor pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:21:00.434290 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-cac01ac6-6d5a-41da-a151-78579981a215 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Image pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:21:00.435192 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-cac01ac6-6d5a-41da-a151-78579981a215 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:21:00.462685 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-f752a6ce-0836-4b66-8f44-06b240ec3050 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5899b2ad9f1046caaf7c6073e408eeee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25abd63376614081a9d484f3c9ae950d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:00.469056 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cac01ac6-6d5a-41da-a151-78579981a215 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:00.474584 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cac01ac6-6d5a-41da-a151-78579981a215 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:00.475500 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cac01ac6-6d5a-41da-a151-78579981a215 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:00.476840 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cac01ac6-6d5a-41da-a151-78579981a215 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:00.477836 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cac01ac6-6d5a-41da-a151-78579981a215 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:00.480619 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-f752a6ce-0836-4b66-8f44-06b240ec3050 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "GET /compute/v2.1/servers/32ddd6eb-6c3f-4bd1-b9be-f819e8ef3a68" status: 200 len: 1391 microversion: 2.1 time: 0.474713 Aug 10 23:21:00.481905 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cac01ac6-6d5a-41da-a151-78579981a215 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:00.488358 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2556/4913] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:21:00 2022] GET /compute/v2.1/servers/32ddd6eb-6c3f-4bd1-b9be-f819e8ef3a68 => generated 1391 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:21:00.521745 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-b24ba650-4304-4530-995f-f9b992d19b75 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:00.539666 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-b24ba650-4304-4530-995f-f9b992d19b75 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] [instance: b812cd8c-7e33-4e97-8df6-c7fccdf12019] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:00.573780 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b24ba650-4304-4530-995f-f9b992d19b75 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:00.575406 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b24ba650-4304-4530-995f-f9b992d19b75 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:00.577394 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b24ba650-4304-4530-995f-f9b992d19b75 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:00.581410 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b24ba650-4304-4530-995f-f9b992d19b75 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:00.584773 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b24ba650-4304-4530-995f-f9b992d19b75 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:00.585331 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b24ba650-4304-4530-995f-f9b992d19b75 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:00.587091 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-cac01ac6-6d5a-41da-a151-78579981a215 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Getting quotas for project 2cb5f5856c46490ab1ded572d693c4cc. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:21:00.604550 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-cac01ac6-6d5a-41da-a151-78579981a215 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Getting quotas for user 627b163f1a0e4fdeb0e9692e7d37460d and project 2cb5f5856c46490ab1ded572d693c4cc. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:21:00.639708 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-cac01ac6-6d5a-41da-a151-78579981a215 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Going to run 1 instances... {{(pid=122632) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 23:21:00.647146 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-cac01ac6-6d5a-41da-a151-78579981a215 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] [instance: 076fa162-4b4f-4246-aa95-02525f01e4a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78ad8905-f66f-4733-8be9-2b260f1fabed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122632) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 23:21:00.710432 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-b24ba650-4304-4530-995f-f9b992d19b75 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d89081084f14e0187f4c67cd9185fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b557edd165144c8943eb9acc339a377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:00.721228 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-b24ba650-4304-4530-995f-f9b992d19b75 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] 10.222.0.58 "GET /compute/v2.1/servers/b812cd8c-7e33-4e97-8df6-c7fccdf12019" status: 200 len: 1615 microversion: 2.1 time: 0.229887 Aug 10 23:21:00.722575 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2557/4914] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:21:00 2022] GET /compute/v2.1/servers/b812cd8c-7e33-4e97-8df6-c7fccdf12019 => generated 1615 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:21:00.727925 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-869e5aa6-3c82-443c-bcfb-2e8997ba4f49 req-f982d3b2-3b31-4731-a68d-4962532eba57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b812cd8c-7e33-4e97-8df6-c7fccdf12019", "name": "network-vif-deleted", "tag": "fc32a303-f86b-4983-9b9a-e8ed05dd3d0f"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:21:00.740081 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-cac01ac6-6d5a-41da-a151-78579981a215 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 3.764086 Aug 10 23:21:00.741848 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-869e5aa6-3c82-443c-bcfb-2e8997ba4f49 req-f982d3b2-3b31-4731-a68d-4962532eba57 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:00.742820 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2358/4915] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 23:20:56 2022] POST /compute/v2.1/servers => generated 361 bytes in 3767 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 10 23:21:00.749672 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-869e5aa6-3c82-443c-bcfb-2e8997ba4f49 req-f982d3b2-3b31-4731-a68d-4962532eba57 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:00.750717 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-869e5aa6-3c82-443c-bcfb-2e8997ba4f49 req-f982d3b2-3b31-4731-a68d-4962532eba57 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:00.754606 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-062ce313-b89c-4ed0-bb01-b09826486895 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:00.755756 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-062ce313-b89c-4ed0-bb01-b09826486895 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] [instance: 076fa162-4b4f-4246-aa95-02525f01e4a7] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:00.766243 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-869e5aa6-3c82-443c-bcfb-2e8997ba4f49 req-f982d3b2-3b31-4731-a68d-4962532eba57 service nova] Creating event network-vif-deleted:fc32a303-f86b-4983-9b9a-e8ed05dd3d0f for instance b812cd8c-7e33-4e97-8df6-c7fccdf12019 on n-h1-850468-14 Aug 10 23:21:00.779706 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-869e5aa6-3c82-443c-bcfb-2e8997ba4f49 req-f982d3b2-3b31-4731-a68d-4962532eba57 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055404 Aug 10 23:21:00.781537 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2558/4916] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:21:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:21:00.914260 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-062ce313-b89c-4ed0-bb01-b09826486895 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '627b163f1a0e4fdeb0e9692e7d37460d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb5f5856c46490ab1ded572d693c4cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:00.927190 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-062ce313-b89c-4ed0-bb01-b09826486895 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] 10.222.0.58 "GET /compute/v2.1/servers/076fa162-4b4f-4246-aa95-02525f01e4a7" status: 200 len: 1240 microversion: 2.1 time: 0.175936 Aug 10 23:21:00.928398 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2359/4917] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:21:00 2022] GET /compute/v2.1/servers/076fa162-4b4f-4246-aa95-02525f01e4a7 => generated 1240 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:21:01.026025 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c4df5baa-2a4d-4310-b3ef-9959b58221e8 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:01.042972 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-c4df5baa-2a4d-4310-b3ef-9959b58221e8 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: a8ed4840-07d6-4506-a0ef-b686a6231fb7] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:01.070257 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c4df5baa-2a4d-4310-b3ef-9959b58221e8 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:01.072320 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c4df5baa-2a4d-4310-b3ef-9959b58221e8 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:01.072886 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c4df5baa-2a4d-4310-b3ef-9959b58221e8 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:01.073806 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c4df5baa-2a4d-4310-b3ef-9959b58221e8 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:01.077545 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c4df5baa-2a4d-4310-b3ef-9959b58221e8 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:01.078266 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c4df5baa-2a4d-4310-b3ef-9959b58221e8 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:01.486442 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-c4df5baa-2a4d-4310-b3ef-9959b58221e8 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6684f0c87e4242be9e0ffb4ef1973f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0582ace9e4443b8ad88915503ee630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:01.504703 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-c4df5baa-2a4d-4310-b3ef-9959b58221e8 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "GET /compute/v2.1/servers/a8ed4840-07d6-4506-a0ef-b686a6231fb7" status: 200 len: 1309 microversion: 2.1 time: 0.485946 Aug 10 23:21:01.505311 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2559/4918] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:21:01 2022] GET /compute/v2.1/servers/a8ed4840-07d6-4506-a0ef-b686a6231fb7 => generated 1309 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:21:01.523192 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-b6bbc757-ed66-4733-902d-ce3178ed22e6 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:01.524889 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-b6bbc757-ed66-4733-902d-ce3178ed22e6 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] [instance: 32ddd6eb-6c3f-4bd1-b9be-f819e8ef3a68] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:01.554334 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b6bbc757-ed66-4733-902d-ce3178ed22e6 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:01.554796 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b6bbc757-ed66-4733-902d-ce3178ed22e6 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:01.559580 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b6bbc757-ed66-4733-902d-ce3178ed22e6 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:01.564319 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b6bbc757-ed66-4733-902d-ce3178ed22e6 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:01.566129 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b6bbc757-ed66-4733-902d-ce3178ed22e6 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:01.566954 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b6bbc757-ed66-4733-902d-ce3178ed22e6 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:01.750733 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-4fcc3c9e-8114-4801-a977-8dab48c5038a tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:01.752580 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-4fcc3c9e-8114-4801-a977-8dab48c5038a tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] [instance: b812cd8c-7e33-4e97-8df6-c7fccdf12019] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:01.762408 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4fcc3c9e-8114-4801-a977-8dab48c5038a tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:01.764950 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4fcc3c9e-8114-4801-a977-8dab48c5038a tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:01.769988 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4fcc3c9e-8114-4801-a977-8dab48c5038a tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:01.773106 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4fcc3c9e-8114-4801-a977-8dab48c5038a tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:01.774745 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4fcc3c9e-8114-4801-a977-8dab48c5038a tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:01.776806 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4fcc3c9e-8114-4801-a977-8dab48c5038a tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:01.844376 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-4fcc3c9e-8114-4801-a977-8dab48c5038a tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] HTTP exception thrown: Instance b812cd8c-7e33-4e97-8df6-c7fccdf12019 could not be found. Aug 10 23:21:01.850238 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-4fcc3c9e-8114-4801-a977-8dab48c5038a tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Request method failure captured: Aug 10 23:21:01.850238 n-d-850468-14 devstack@n-api.service[122633]: request: GET /compute/v2.1/servers/b812cd8c-7e33-4e97-8df6-c7fccdf12019 HTTP/1.1 Aug 10 23:21:01.850238 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:21:01.850238 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:21:01.850238 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:21:01.850238 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:21:01.850238 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:21:01.850238 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:21:01.850238 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:21:01.850238 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:21:01.850238 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9Dyh6-R-3HT3qmAYw73oJfCuu2NJv_Uk6ESXtcq6VvNMtaQn1cTuz-I3qzoDfMZYBb14V5s9aXOf7KFvhR2arcnhZ5gC9SddHqo24MvVPxr7p8PNkuseL9l1-7bXrad-0RpRPdQnhZkSYtsPZXEtrxg11yCwwP1jlsEo-QBQNYEMWc4 Aug 10 23:21:01.850238 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:21:01.850238 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:21:01.850238 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:21:01.850238 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:21:01.850238 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:21:01.850238 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:21:01.850238 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 2b557edd165144c8943eb9acc339a377 Aug 10 23:21:01.850238 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-AttachVolumeNegativeTest-393353666 Aug 10 23:21:01.850238 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:21:01.850238 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:21:01.850238 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2b557edd165144c8943eb9acc339a377"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2b557edd165144c8943eb9acc339a377"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2b557edd165144c8943eb9acc339a377"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2b557edd165144c8943eb9acc339a377", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:21:01.850238 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-AttachVolumeNegativeTest-393353666 Aug 10 23:21:01.850238 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 2b557edd165144c8943eb9acc339a377 Aug 10 23:21:01.850238 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-393353666 Aug 10 23:21:01.850238 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-AttachVolumeNegativeTest-393353666-project Aug 10 23:21:01.850238 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:21:01.850238 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:21:01.850238 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 0d89081084f14e0187f4c67cd9185fef Aug 10 23:21:01.850238 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-AttachVolumeNegativeTest-393353666-project Aug 10 23:21:01.850238 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:21:01.850238 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance b812cd8c-7e33-4e97-8df6-c7fccdf12019 could not be found. Aug 10 23:21:01.850238 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': 'b812cd8c-7e33-4e97-8df6-c7fccdf12019'} Aug 10 23:21:01.850238 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:21:01.850238 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:21:01.850238 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:21:01.850238 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:21:01.850238 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:21:01.850238 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:21:01.850238 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:21:01.850238 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:21:01.850238 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:21:01.850238 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:21:01.850238 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b812cd8c-7e33-4e97-8df6-c7fccdf12019 could not be found. Aug 10 23:21:01.850238 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:21:01.850238 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:21:01.850238 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:21:01.850238 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:21:01.850238 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:21:01.850238 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:21:01.850238 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:21:01.850238 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:21:01.850238 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:21:01.850238 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:21:01.850238 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:21:01.850238 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:21:01.850238 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:21:01.850238 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:21:01.850238 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:21:01.850238 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:21:01.850238 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b812cd8c-7e33-4e97-8df6-c7fccdf12019 could not be found. Aug 10 23:21:01.850238 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:21:01.850238 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:21:01.850238 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:21:01.854758 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:21:01.854758 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:21:01.854758 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:21:01.854758 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:21:01.854758 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:21:01.854758 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b812cd8c-7e33-4e97-8df6-c7fccdf12019 could not be found. Aug 10 23:21:01.854758 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:21:01.854758 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-4fcc3c9e-8114-4801-a977-8dab48c5038a tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Returning 404 to user: Instance b812cd8c-7e33-4e97-8df6-c7fccdf12019 could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:21:01.854758 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-4fcc3c9e-8114-4801-a977-8dab48c5038a tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] 10.222.0.58 "GET /compute/v2.1/servers/b812cd8c-7e33-4e97-8df6-c7fccdf12019" status: 404 len: 111 microversion: 2.1 time: 0.109556 Aug 10 23:21:01.854758 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2560/4919] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:21:01 2022] GET /compute/v2.1/servers/b812cd8c-7e33-4e97-8df6-c7fccdf12019 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:21:01.867924 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-a884be70-5c41-4568-862b-9f018e3aec58 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Calling method '.version_select at 0x7f847d2983a0>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:01.928950 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-a884be70-5c41-4568-862b-9f018e3aec58 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-521131830" status: 202 len: 0 microversion: 2.1 time: 0.071757 Aug 10 23:21:01.929707 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2561/4920] 10.222.0.58 () {58 vars in 1218 bytes} [Wed Aug 10 23:21:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-521131830 => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:21:01.949460 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c0455852-26ab-4e64-8808-9e3250e586fb tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:01.950414 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-c0455852-26ab-4e64-8808-9e3250e586fb tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] [instance: 076fa162-4b4f-4246-aa95-02525f01e4a7] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:01.967212 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c0455852-26ab-4e64-8808-9e3250e586fb tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:01.967732 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c0455852-26ab-4e64-8808-9e3250e586fb tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:01.968248 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c0455852-26ab-4e64-8808-9e3250e586fb tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:01.975239 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c0455852-26ab-4e64-8808-9e3250e586fb tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:01.975869 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c0455852-26ab-4e64-8808-9e3250e586fb tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:01.976434 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c0455852-26ab-4e64-8808-9e3250e586fb tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:02.108735 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-c0455852-26ab-4e64-8808-9e3250e586fb tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '627b163f1a0e4fdeb0e9692e7d37460d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb5f5856c46490ab1ded572d693c4cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:02.121878 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-c0455852-26ab-4e64-8808-9e3250e586fb tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] 10.222.0.58 "GET /compute/v2.1/servers/076fa162-4b4f-4246-aa95-02525f01e4a7" status: 200 len: 1292 microversion: 2.1 time: 0.176713 Aug 10 23:21:02.124114 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2562/4921] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:21:01 2022] GET /compute/v2.1/servers/076fa162-4b4f-4246-aa95-02525f01e4a7 => generated 1292 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:21:02.541871 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-f6d4efea-3b3d-4a6e-a62c-f5e91265858e tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:02.544391 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-f6d4efea-3b3d-4a6e-a62c-f5e91265858e tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: a8ed4840-07d6-4506-a0ef-b686a6231fb7] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:02.596301 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f6d4efea-3b3d-4a6e-a62c-f5e91265858e tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:02.596301 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f6d4efea-3b3d-4a6e-a62c-f5e91265858e tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:02.596301 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f6d4efea-3b3d-4a6e-a62c-f5e91265858e tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:02.596301 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f6d4efea-3b3d-4a6e-a62c-f5e91265858e tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:02.596301 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f6d4efea-3b3d-4a6e-a62c-f5e91265858e tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:02.596301 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f6d4efea-3b3d-4a6e-a62c-f5e91265858e tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:02.893950 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-f6d4efea-3b3d-4a6e-a62c-f5e91265858e tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6684f0c87e4242be9e0ffb4ef1973f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0582ace9e4443b8ad88915503ee630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:02.907297 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-f6d4efea-3b3d-4a6e-a62c-f5e91265858e tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "GET /compute/v2.1/servers/a8ed4840-07d6-4506-a0ef-b686a6231fb7" status: 200 len: 1309 microversion: 2.1 time: 0.373609 Aug 10 23:21:02.923169 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2563/4922] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:21:02 2022] GET /compute/v2.1/servers/a8ed4840-07d6-4506-a0ef-b686a6231fb7 => generated 1309 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:21:02.944960 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-b6bbc757-ed66-4733-902d-ce3178ed22e6 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5899b2ad9f1046caaf7c6073e408eeee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25abd63376614081a9d484f3c9ae950d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:02.965810 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-b6bbc757-ed66-4733-902d-ce3178ed22e6 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "GET /compute/v2.1/servers/32ddd6eb-6c3f-4bd1-b9be-f819e8ef3a68" status: 200 len: 1391 microversion: 2.1 time: 1.455177 Aug 10 23:21:02.969032 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2360/4923] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:21:01 2022] GET /compute/v2.1/servers/32ddd6eb-6c3f-4bd1-b9be-f819e8ef3a68 => generated 1391 bytes in 1460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:21:03.148720 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-fac26910-c303-4209-a082-4fc3badbe110 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:03.149258 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-fac26910-c303-4209-a082-4fc3badbe110 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] [instance: 076fa162-4b4f-4246-aa95-02525f01e4a7] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:03.159225 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fac26910-c303-4209-a082-4fc3badbe110 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:03.160037 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fac26910-c303-4209-a082-4fc3badbe110 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:03.165086 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fac26910-c303-4209-a082-4fc3badbe110 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:03.167596 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fac26910-c303-4209-a082-4fc3badbe110 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:03.168414 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fac26910-c303-4209-a082-4fc3badbe110 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:03.171127 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fac26910-c303-4209-a082-4fc3badbe110 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:03.231107 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-3a15fb77-eca4-4fd2-885b-5c5fe7c19903 req-481187a1-d2d8-4841-bb3d-571a241b6677 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32ddd6eb-6c3f-4bd1-b9be-f819e8ef3a68", "name": "network-vif-plugged", "status": "completed", "tag": "4f9f24c0-e01f-4d27-8d15-06a370ec5bb8"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:21:03.258447 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-3a15fb77-eca4-4fd2-885b-5c5fe7c19903 req-481187a1-d2d8-4841-bb3d-571a241b6677 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:03.259063 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-3a15fb77-eca4-4fd2-885b-5c5fe7c19903 req-481187a1-d2d8-4841-bb3d-571a241b6677 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:03.261669 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-3a15fb77-eca4-4fd2-885b-5c5fe7c19903 req-481187a1-d2d8-4841-bb3d-571a241b6677 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:03.304543 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-3a15fb77-eca4-4fd2-885b-5c5fe7c19903 req-481187a1-d2d8-4841-bb3d-571a241b6677 service nova] Creating event network-vif-plugged:4f9f24c0-e01f-4d27-8d15-06a370ec5bb8 for instance 32ddd6eb-6c3f-4bd1-b9be-f819e8ef3a68 on n-h2-850468-14 Aug 10 23:21:03.319278 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-3a15fb77-eca4-4fd2-885b-5c5fe7c19903 req-481187a1-d2d8-4841-bb3d-571a241b6677 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092004 Aug 10 23:21:03.322513 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2361/4924] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:21:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 23:21:03.397787 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-fac26910-c303-4209-a082-4fc3badbe110 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '627b163f1a0e4fdeb0e9692e7d37460d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb5f5856c46490ab1ded572d693c4cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:03.420208 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-fac26910-c303-4209-a082-4fc3badbe110 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] 10.222.0.58 "GET /compute/v2.1/servers/076fa162-4b4f-4246-aa95-02525f01e4a7" status: 200 len: 1298 microversion: 2.1 time: 0.278103 Aug 10 23:21:03.428835 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2564/4925] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:21:03 2022] GET /compute/v2.1/servers/076fa162-4b4f-4246-aa95-02525f01e4a7 => generated 1298 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:21:03.569059 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-0ce0ff2e-1fb9-4c88-bde3-b3fa5d02eb43 tempest-QuotasTestJSON-365844199 tempest-QuotasTestJSON-365844199-project] Calling method '.version_select at 0x7f847dd8ad30>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:03.669159 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-0ce0ff2e-1fb9-4c88-bde3-b3fa5d02eb43 tempest-QuotasTestJSON-365844199 tempest-QuotasTestJSON-365844199-project] 10.222.0.58 "GET /compute/v2.1/os-quota-sets/72e02a47dfa547ce8452c5e1d2333f5a/defaults" status: 200 len: 371 microversion: 2.1 time: 0.275806 Aug 10 23:21:03.678260 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2362/4926] 10.222.0.58 () {58 vars in 1269 bytes} [Wed Aug 10 23:21:03 2022] GET /compute/v2.1/os-quota-sets/72e02a47dfa547ce8452c5e1d2333f5a/defaults => generated 371 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:21:03.685928 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-af27d15a-d807-4539-ad70-05fbdf61dca2 tempest-QuotasTestJSON-365844199 tempest-QuotasTestJSON-365844199-project] Calling method '.version_select at 0x7f847cf675e0>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:03.806643 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-af27d15a-d807-4539-ad70-05fbdf61dca2 tempest-QuotasTestJSON-365844199 tempest-QuotasTestJSON-365844199-project] 10.222.0.58 "GET /compute/v2.1/os-quota-sets/72e02a47dfa547ce8452c5e1d2333f5a" status: 200 len: 371 microversion: 2.1 time: 0.124507 Aug 10 23:21:03.819021 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2565/4927] 10.222.0.58 () {58 vars in 1242 bytes} [Wed Aug 10 23:21:03 2022] GET /compute/v2.1/os-quota-sets/72e02a47dfa547ce8452c5e1d2333f5a => generated 371 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:21:03.823241 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-d0843fb1-2a2f-4946-a67e-f3978203c5b7 tempest-QuotasTestJSON-365844199 tempest-QuotasTestJSON-365844199-project] Calling method '.version_select at 0x7f847d978d30>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:03.920018 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-d0843fb1-2a2f-4946-a67e-f3978203c5b7 tempest-QuotasTestJSON-365844199 tempest-QuotasTestJSON-365844199-project] 10.222.0.58 "GET /compute/v2.1/os-quota-sets/72e02a47dfa547ce8452c5e1d2333f5a/defaults" status: 200 len: 371 microversion: 2.1 time: 0.100689 Aug 10 23:21:03.931347 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2363/4928] 10.222.0.58 () {58 vars in 1269 bytes} [Wed Aug 10 23:21:03 2022] GET /compute/v2.1/os-quota-sets/72e02a47dfa547ce8452c5e1d2333f5a/defaults => generated 371 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 23:21:03.935460 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-afca542c-9dad-4544-af22-2176366cd7ae tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:03.936095 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-afca542c-9dad-4544-af22-2176366cd7ae tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: a8ed4840-07d6-4506-a0ef-b686a6231fb7] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:03.937481 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-444a9852-6cb2-424f-be67-db6a7bcda9d2 tempest-QuotasTestJSON-365844199 tempest-QuotasTestJSON-365844199-project] Calling method '.version_select at 0x7f847d9789d0>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:03.947502 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-afca542c-9dad-4544-af22-2176366cd7ae tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:03.948004 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-afca542c-9dad-4544-af22-2176366cd7ae tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:03.948448 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-afca542c-9dad-4544-af22-2176366cd7ae tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:03.949173 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-afca542c-9dad-4544-af22-2176366cd7ae tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:03.949787 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-afca542c-9dad-4544-af22-2176366cd7ae tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:03.950460 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-afca542c-9dad-4544-af22-2176366cd7ae tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:04.117831 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-444a9852-6cb2-424f-be67-db6a7bcda9d2 tempest-QuotasTestJSON-365844199 tempest-QuotasTestJSON-365844199-project] 10.222.0.58 "GET /compute/v2.1/os-quota-sets/72e02a47dfa547ce8452c5e1d2333f5a" status: 200 len: 371 microversion: 2.1 time: 0.181329 Aug 10 23:21:04.117831 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2364/4929] 10.222.0.58 () {58 vars in 1242 bytes} [Wed Aug 10 23:21:03 2022] GET /compute/v2.1/os-quota-sets/72e02a47dfa547ce8452c5e1d2333f5a => generated 371 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:21:04.126104 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-68c1d62c-e84d-4c32-bee4-88f68a6e5bd3 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:04.127746 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-68c1d62c-e84d-4c32-bee4-88f68a6e5bd3 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] [instance: 32ddd6eb-6c3f-4bd1-b9be-f819e8ef3a68] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:04.134380 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-68c1d62c-e84d-4c32-bee4-88f68a6e5bd3 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:04.135233 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-68c1d62c-e84d-4c32-bee4-88f68a6e5bd3 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:04.136176 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-68c1d62c-e84d-4c32-bee4-88f68a6e5bd3 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:04.136994 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-68c1d62c-e84d-4c32-bee4-88f68a6e5bd3 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:04.137559 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-68c1d62c-e84d-4c32-bee4-88f68a6e5bd3 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:04.138206 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-68c1d62c-e84d-4c32-bee4-88f68a6e5bd3 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:04.292179 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-afca542c-9dad-4544-af22-2176366cd7ae tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6684f0c87e4242be9e0ffb4ef1973f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0582ace9e4443b8ad88915503ee630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:04.300157 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-afca542c-9dad-4544-af22-2176366cd7ae tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "GET /compute/v2.1/servers/a8ed4840-07d6-4506-a0ef-b686a6231fb7" status: 200 len: 1309 microversion: 2.1 time: 0.369924 Aug 10 23:21:04.311524 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2566/4930] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:21:03 2022] GET /compute/v2.1/servers/a8ed4840-07d6-4506-a0ef-b686a6231fb7 => generated 1309 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:21:04.322542 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-e8f98a53-fa09-42fa-86dd-88cd682ade4d tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Action: 'create', calling method: .version_select at 0x7f847cf67ee0>, body: {"keypair": {"name": "tempest-keypair-1843562770", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGtx3DBzveBHXLK9XITjQq48pTzFFXq5Dlqb69QvWcwCNyX3mH/ky3rfw+GPchGbVq1NK5ZEUtQ8Hc8keq53GDQdhFHkfGcT0LUM8aDsRCvpubczLRmSMuM62SUTxxX8IQ=="}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:21:04.340642 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-e8f98a53-fa09-42fa-86dd-88cd682ade4d tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Getting quotas for project 2b557edd165144c8943eb9acc339a377. Resources: {'key_pairs'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:21:04.349484 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-e8f98a53-fa09-42fa-86dd-88cd682ade4d tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Getting quotas for user 0d89081084f14e0187f4c67cd9185fef and project 2b557edd165144c8943eb9acc339a377. Resources: {'key_pairs'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:21:04.416956 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-e8f98a53-fa09-42fa-86dd-88cd682ade4d tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.098188 Aug 10 23:21:04.417989 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2567/4931] 10.222.0.58 () {60 vars in 1159 bytes} [Wed Aug 10 23:21:04 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:21:04.425379 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-bd304308-07b3-4fb4-99b1-fb5da24acea4 tempest-QuotasTestJSON-365844199 tempest-QuotasTestJSON-365844199-project] Calling method '.version_select at 0x7f847cf8ec10>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:04.567593 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-bd304308-07b3-4fb4-99b1-fb5da24acea4 tempest-QuotasTestJSON-365844199 tempest-QuotasTestJSON-365844199-project] 10.222.0.58 "GET /compute/v2.1/os-quota-sets/72e02a47dfa547ce8452c5e1d2333f5a?user_id=ab0ad5faed84436ebbd04a31740cbf72" status: 200 len: 371 microversion: 2.1 time: 0.148117 Aug 10 23:21:04.568441 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2568/4932] 10.222.0.58 () {58 vars in 1323 bytes} [Wed Aug 10 23:21:04 2022] GET /compute/v2.1/os-quota-sets/72e02a47dfa547ce8452c5e1d2333f5a?user_id=ab0ad5faed84436ebbd04a31740cbf72 => generated 371 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:21:04.574548 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-11733be1-a9f6-4ced-ba82-dfba72c2b4c7 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:04.603569 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-11733be1-a9f6-4ced-ba82-dfba72c2b4c7 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] [instance: 076fa162-4b4f-4246-aa95-02525f01e4a7] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:04.620869 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-11733be1-a9f6-4ced-ba82-dfba72c2b4c7 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:04.629124 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-11733be1-a9f6-4ced-ba82-dfba72c2b4c7 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:04.629693 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-11733be1-a9f6-4ced-ba82-dfba72c2b4c7 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:04.630578 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-11733be1-a9f6-4ced-ba82-dfba72c2b4c7 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:04.632964 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-11733be1-a9f6-4ced-ba82-dfba72c2b4c7 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:04.634182 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-11733be1-a9f6-4ced-ba82-dfba72c2b4c7 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:04.898904 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-68c1d62c-e84d-4c32-bee4-88f68a6e5bd3 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5899b2ad9f1046caaf7c6073e408eeee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25abd63376614081a9d484f3c9ae950d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:04.916871 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-68c1d62c-e84d-4c32-bee4-88f68a6e5bd3 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "GET /compute/v2.1/servers/32ddd6eb-6c3f-4bd1-b9be-f819e8ef3a68" status: 200 len: 1391 microversion: 2.1 time: 0.799577 Aug 10 23:21:04.918203 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2365/4933] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:21:04 2022] GET /compute/v2.1/servers/32ddd6eb-6c3f-4bd1-b9be-f819e8ef3a68 => generated 1391 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:21:04.931355 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-ced20a36-a07d-4cc4-bde9-224b7e09d1b2 req-04df531b-6e63-4d3d-b15a-773c375d4a02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8ed4840-07d6-4506-a0ef-b686a6231fb7", "tag": "d7d0f217-6cf8-4a40-82d9-fe0df4b342bc"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:21:04.984705 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-ced20a36-a07d-4cc4-bde9-224b7e09d1b2 req-04df531b-6e63-4d3d-b15a-773c375d4a02 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:04.986684 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-ced20a36-a07d-4cc4-bde9-224b7e09d1b2 req-04df531b-6e63-4d3d-b15a-773c375d4a02 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:04.987265 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-ced20a36-a07d-4cc4-bde9-224b7e09d1b2 req-04df531b-6e63-4d3d-b15a-773c375d4a02 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:05.014619 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-ced20a36-a07d-4cc4-bde9-224b7e09d1b2 req-04df531b-6e63-4d3d-b15a-773c375d4a02 service nova] Creating event network-changed:d7d0f217-6cf8-4a40-82d9-fe0df4b342bc for instance a8ed4840-07d6-4506-a0ef-b686a6231fb7 on n-h1-850468-14 Aug 10 23:21:05.022619 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-ced20a36-a07d-4cc4-bde9-224b7e09d1b2 req-04df531b-6e63-4d3d-b15a-773c375d4a02 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102107 Aug 10 23:21:05.024253 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2366/4934] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:21:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:21:05.327362 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-a8d659b2-f41e-4e59-a123-bfd94151eb93 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:05.330132 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-a8d659b2-f41e-4e59-a123-bfd94151eb93 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: a8ed4840-07d6-4506-a0ef-b686a6231fb7] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:05.343351 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a8d659b2-f41e-4e59-a123-bfd94151eb93 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:05.344200 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a8d659b2-f41e-4e59-a123-bfd94151eb93 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:05.344921 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a8d659b2-f41e-4e59-a123-bfd94151eb93 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:05.345938 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a8d659b2-f41e-4e59-a123-bfd94151eb93 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:05.346598 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a8d659b2-f41e-4e59-a123-bfd94151eb93 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:05.347113 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a8d659b2-f41e-4e59-a123-bfd94151eb93 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:05.371698 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=100 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:21:05.438587 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-11733be1-a9f6-4ced-ba82-dfba72c2b4c7 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '627b163f1a0e4fdeb0e9692e7d37460d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb5f5856c46490ab1ded572d693c4cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:05.449412 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-11733be1-a9f6-4ced-ba82-dfba72c2b4c7 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] 10.222.0.58 "GET /compute/v2.1/servers/076fa162-4b4f-4246-aa95-02525f01e4a7" status: 200 len: 1298 microversion: 2.1 time: 0.879624 Aug 10 23:21:05.450571 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2569/4935] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:21:04 2022] GET /compute/v2.1/servers/076fa162-4b4f-4246-aa95-02525f01e4a7 => generated 1298 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:21:05.911991 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-a8d659b2-f41e-4e59-a123-bfd94151eb93 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6684f0c87e4242be9e0ffb4ef1973f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0582ace9e4443b8ad88915503ee630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:05.925593 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-a8d659b2-f41e-4e59-a123-bfd94151eb93 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "GET /compute/v2.1/servers/a8ed4840-07d6-4506-a0ef-b686a6231fb7" status: 200 len: 1309 microversion: 2.1 time: 0.604455 Aug 10 23:21:05.927364 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2367/4936] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:21:05 2022] GET /compute/v2.1/servers/a8ed4840-07d6-4506-a0ef-b686a6231fb7 => generated 1309 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:21:05.937727 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-2d1d882b-a15f-4868-96c9-bf9582eba42b tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:05.938345 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-2d1d882b-a15f-4868-96c9-bf9582eba42b tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] [instance: 32ddd6eb-6c3f-4bd1-b9be-f819e8ef3a68] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:05.952334 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2d1d882b-a15f-4868-96c9-bf9582eba42b tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:05.952955 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2d1d882b-a15f-4868-96c9-bf9582eba42b tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:05.953777 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2d1d882b-a15f-4868-96c9-bf9582eba42b tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:05.954732 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2d1d882b-a15f-4868-96c9-bf9582eba42b tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:05.955735 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2d1d882b-a15f-4868-96c9-bf9582eba42b tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:05.963191 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2d1d882b-a15f-4868-96c9-bf9582eba42b tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:06.406531 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-2d1d882b-a15f-4868-96c9-bf9582eba42b tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5899b2ad9f1046caaf7c6073e408eeee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25abd63376614081a9d484f3c9ae950d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:06.420543 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-2d1d882b-a15f-4868-96c9-bf9582eba42b tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "GET /compute/v2.1/servers/32ddd6eb-6c3f-4bd1-b9be-f819e8ef3a68" status: 200 len: 1564 microversion: 2.1 time: 0.486329 Aug 10 23:21:06.436772 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2570/4937] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:21:05 2022] GET /compute/v2.1/servers/32ddd6eb-6c3f-4bd1-b9be-f819e8ef3a68 => generated 1564 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:21:06.443150 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-ed9f87c7-4e0f-4877-aded-25f567abfc9c tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:06.443768 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-ed9f87c7-4e0f-4877-aded-25f567abfc9c tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] [instance: 32ddd6eb-6c3f-4bd1-b9be-f819e8ef3a68] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:06.456120 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ed9f87c7-4e0f-4877-aded-25f567abfc9c tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:06.456627 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ed9f87c7-4e0f-4877-aded-25f567abfc9c tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:06.457135 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ed9f87c7-4e0f-4877-aded-25f567abfc9c tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:06.457928 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ed9f87c7-4e0f-4877-aded-25f567abfc9c tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:06.458377 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ed9f87c7-4e0f-4877-aded-25f567abfc9c tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:06.458846 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ed9f87c7-4e0f-4877-aded-25f567abfc9c tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:06.473328 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-9037d535-c846-4c45-b557-d61c1b795568 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:06.474681 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-9037d535-c846-4c45-b557-d61c1b795568 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] [instance: 076fa162-4b4f-4246-aa95-02525f01e4a7] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:06.482198 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9037d535-c846-4c45-b557-d61c1b795568 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:06.487779 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9037d535-c846-4c45-b557-d61c1b795568 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:06.488245 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9037d535-c846-4c45-b557-d61c1b795568 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:06.489494 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9037d535-c846-4c45-b557-d61c1b795568 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:06.492638 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9037d535-c846-4c45-b557-d61c1b795568 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:06.494677 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9037d535-c846-4c45-b557-d61c1b795568 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:06.687794 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-9037d535-c846-4c45-b557-d61c1b795568 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '627b163f1a0e4fdeb0e9692e7d37460d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb5f5856c46490ab1ded572d693c4cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:06.698308 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-9037d535-c846-4c45-b557-d61c1b795568 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] 10.222.0.58 "GET /compute/v2.1/servers/076fa162-4b4f-4246-aa95-02525f01e4a7" status: 200 len: 1298 microversion: 2.1 time: 0.229516 Aug 10 23:21:06.712464 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2571/4938] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:21:06 2022] GET /compute/v2.1/servers/076fa162-4b4f-4246-aa95-02525f01e4a7 => generated 1298 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:21:06.791426 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-c63ed39a-bf78-4bb6-ad1e-d539d96f1801 req-f41422b9-8b02-4533-ba19-c1143003132a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "076fa162-4b4f-4246-aa95-02525f01e4a7", "tag": "6849b263-5fec-4087-a5ee-f4b58a934628"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:21:06.823032 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-c63ed39a-bf78-4bb6-ad1e-d539d96f1801 req-f41422b9-8b02-4533-ba19-c1143003132a service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:06.827731 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-c63ed39a-bf78-4bb6-ad1e-d539d96f1801 req-f41422b9-8b02-4533-ba19-c1143003132a service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:06.828486 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-c63ed39a-bf78-4bb6-ad1e-d539d96f1801 req-f41422b9-8b02-4533-ba19-c1143003132a service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:06.870767 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-c63ed39a-bf78-4bb6-ad1e-d539d96f1801 req-f41422b9-8b02-4533-ba19-c1143003132a service nova] Creating event network-changed:6849b263-5fec-4087-a5ee-f4b58a934628 for instance 076fa162-4b4f-4246-aa95-02525f01e4a7 on n-h1-850468-14 Aug 10 23:21:06.885131 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-c63ed39a-bf78-4bb6-ad1e-d539d96f1801 req-f41422b9-8b02-4533-ba19-c1143003132a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099006 Aug 10 23:21:06.888522 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2572/4939] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:21:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:21:06.968394 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-eb56c4a1-5be9-4f22-aa9b-03a9ab093285 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:06.973588 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-eb56c4a1-5be9-4f22-aa9b-03a9ab093285 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: a8ed4840-07d6-4506-a0ef-b686a6231fb7] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:07.015577 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-eb56c4a1-5be9-4f22-aa9b-03a9ab093285 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:07.016489 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-eb56c4a1-5be9-4f22-aa9b-03a9ab093285 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:07.019068 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-eb56c4a1-5be9-4f22-aa9b-03a9ab093285 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:07.019848 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-eb56c4a1-5be9-4f22-aa9b-03a9ab093285 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:07.020329 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-eb56c4a1-5be9-4f22-aa9b-03a9ab093285 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:07.023348 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-eb56c4a1-5be9-4f22-aa9b-03a9ab093285 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:07.082679 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=100 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:21:07.592382 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-eb56c4a1-5be9-4f22-aa9b-03a9ab093285 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6684f0c87e4242be9e0ffb4ef1973f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0582ace9e4443b8ad88915503ee630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:07.603659 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-eb56c4a1-5be9-4f22-aa9b-03a9ab093285 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "GET /compute/v2.1/servers/a8ed4840-07d6-4506-a0ef-b686a6231fb7" status: 200 len: 1309 microversion: 2.1 time: 0.656763 Aug 10 23:21:07.608477 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-ed9f87c7-4e0f-4877-aded-25f567abfc9c tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5899b2ad9f1046caaf7c6073e408eeee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25abd63376614081a9d484f3c9ae950d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:07.619776 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2573/4940] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:21:06 2022] GET /compute/v2.1/servers/a8ed4840-07d6-4506-a0ef-b686a6231fb7 => generated 1309 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:21:07.628015 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-ed9f87c7-4e0f-4877-aded-25f567abfc9c tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "GET /compute/v2.1/servers/32ddd6eb-6c3f-4bd1-b9be-f819e8ef3a68" status: 200 len: 1564 microversion: 2.1 time: 1.189435 Aug 10 23:21:07.629537 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2368/4941] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:21:06 2022] GET /compute/v2.1/servers/32ddd6eb-6c3f-4bd1-b9be-f819e8ef3a68 => generated 1564 bytes in 1192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:21:07.719760 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-968e5d1f-61d5-459f-8306-9bb481bfd899 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:07.720903 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-968e5d1f-61d5-459f-8306-9bb481bfd899 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] [instance: 076fa162-4b4f-4246-aa95-02525f01e4a7] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:07.732554 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-968e5d1f-61d5-459f-8306-9bb481bfd899 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:07.733339 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-968e5d1f-61d5-459f-8306-9bb481bfd899 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:07.734116 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-968e5d1f-61d5-459f-8306-9bb481bfd899 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:07.735067 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-968e5d1f-61d5-459f-8306-9bb481bfd899 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:07.738350 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-968e5d1f-61d5-459f-8306-9bb481bfd899 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:07.739013 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-968e5d1f-61d5-459f-8306-9bb481bfd899 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:07.975159 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-d156dcfa-7b40-468b-905c-282fbea87218 tempest-VolumesSnapshotsTestJSON-567793322 tempest-VolumesSnapshotsTestJSON-567793322-project] Action: 'create', calling method: .version_select at 0x7f84823c9310>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-264375718"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:21:08.015312 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-968e5d1f-61d5-459f-8306-9bb481bfd899 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '627b163f1a0e4fdeb0e9692e7d37460d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb5f5856c46490ab1ded572d693c4cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:08.032881 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-968e5d1f-61d5-459f-8306-9bb481bfd899 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] 10.222.0.58 "GET /compute/v2.1/servers/076fa162-4b4f-4246-aa95-02525f01e4a7" status: 200 len: 1298 microversion: 2.1 time: 0.312355 Aug 10 23:21:08.035650 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2574/4942] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:21:07 2022] GET /compute/v2.1/servers/076fa162-4b4f-4246-aa95-02525f01e4a7 => generated 1298 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:21:08.572293 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-d156dcfa-7b40-468b-905c-282fbea87218 tempest-VolumesSnapshotsTestJSON-567793322 tempest-VolumesSnapshotsTestJSON-567793322-project] 10.222.0.58 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.823229 Aug 10 23:21:08.573189 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2369/4943] 10.222.0.58 () {60 vars in 1155 bytes} [Wed Aug 10 23:21:07 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 825 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 10 23:21:08.588781 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-cbb7e1c3-b10d-4fe4-9115-6cb17af250df tempest-VolumesSnapshotsTestJSON-567793322 tempest-VolumesSnapshotsTestJSON-567793322-project] Calling method '.version_select at 0x7f847d261f70>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:08.628381 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-5604f670-1801-4e1c-873e-d9cf07b90112 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:08.629630 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-5604f670-1801-4e1c-873e-d9cf07b90112 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: a8ed4840-07d6-4506-a0ef-b686a6231fb7] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:08.637542 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5604f670-1801-4e1c-873e-d9cf07b90112 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:08.642293 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5604f670-1801-4e1c-873e-d9cf07b90112 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:08.646205 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5604f670-1801-4e1c-873e-d9cf07b90112 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:08.649381 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5604f670-1801-4e1c-873e-d9cf07b90112 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:08.650096 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5604f670-1801-4e1c-873e-d9cf07b90112 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:08.650769 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5604f670-1801-4e1c-873e-d9cf07b90112 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:08.657164 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-cbb7e1c3-b10d-4fe4-9115-6cb17af250df tempest-VolumesSnapshotsTestJSON-567793322 tempest-VolumesSnapshotsTestJSON-567793322-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/2aeeb410-cbc4-4a41-a0cb-44630bc5a835" status: 200 len: 344 microversion: 2.1 time: 0.072099 Aug 10 23:21:08.659298 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2575/4944] 10.222.0.58 () {58 vars in 1245 bytes} [Wed Aug 10 23:21:08 2022] GET /compute/v2.1/os-volumes/2aeeb410-cbc4-4a41-a0cb-44630bc5a835 => generated 344 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:21:09.061758 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-a476e740-b982-4a12-ad67-a7ee249717cb tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:09.062664 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-a476e740-b982-4a12-ad67-a7ee249717cb tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] [instance: 076fa162-4b4f-4246-aa95-02525f01e4a7] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:09.116191 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a476e740-b982-4a12-ad67-a7ee249717cb tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:09.119990 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a476e740-b982-4a12-ad67-a7ee249717cb tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:09.123667 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a476e740-b982-4a12-ad67-a7ee249717cb tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:09.127958 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a476e740-b982-4a12-ad67-a7ee249717cb tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:09.166028 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a476e740-b982-4a12-ad67-a7ee249717cb tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:09.167080 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a476e740-b982-4a12-ad67-a7ee249717cb tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.036s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:09.404758 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-5604f670-1801-4e1c-873e-d9cf07b90112 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6684f0c87e4242be9e0ffb4ef1973f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0582ace9e4443b8ad88915503ee630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:09.427246 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-5604f670-1801-4e1c-873e-d9cf07b90112 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "GET /compute/v2.1/servers/a8ed4840-07d6-4506-a0ef-b686a6231fb7" status: 200 len: 1309 microversion: 2.1 time: 0.793191 Aug 10 23:21:09.428642 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2370/4945] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:21:08 2022] GET /compute/v2.1/servers/a8ed4840-07d6-4506-a0ef-b686a6231fb7 => generated 1309 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:21:09.458882 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-428a22e4-47b2-45ba-819e-47d42f4fc3ed tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1767341761", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6022f6db-e3f4-46f3-9a7f-22454e88771a"}], "security_groups": [{"name": "tempest-securitygroup--1687273924"}], "key_name": "tempest-keypair-1843562770", "user_data": "}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:21:09.791097 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.network.neutron [None req-428a22e4-47b2-45ba-819e-47d42f4fc3ed tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] validate_networks() for [('6022f6db-e3f4-46f3-9a7f-22454e88771a', None, None, None, None, None)] {{(pid=122632) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 23:21:09.910020 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-a476e740-b982-4a12-ad67-a7ee249717cb tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '627b163f1a0e4fdeb0e9692e7d37460d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb5f5856c46490ab1ded572d693c4cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:09.921184 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-a476e740-b982-4a12-ad67-a7ee249717cb tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] 10.222.0.58 "GET /compute/v2.1/servers/076fa162-4b4f-4246-aa95-02525f01e4a7" status: 200 len: 1298 microversion: 2.1 time: 0.868491 Aug 10 23:21:09.939977 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2576/4946] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:21:09 2022] GET /compute/v2.1/servers/076fa162-4b4f-4246-aa95-02525f01e4a7 => generated 1298 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:21:09.950012 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c05ab311-8a85-467a-996d-57710728bc17 tempest-VolumesSnapshotsTestJSON-567793322 tempest-VolumesSnapshotsTestJSON-567793322-project] Calling method '.version_select at 0x7f847d2958b0>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:10.055809 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-c05ab311-8a85-467a-996d-57710728bc17 tempest-VolumesSnapshotsTestJSON-567793322 tempest-VolumesSnapshotsTestJSON-567793322-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/2aeeb410-cbc4-4a41-a0cb-44630bc5a835" status: 200 len: 344 microversion: 2.1 time: 0.114552 Aug 10 23:21:10.062823 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2577/4947] 10.222.0.58 () {58 vars in 1245 bytes} [Wed Aug 10 23:21:09 2022] GET /compute/v2.1/os-volumes/2aeeb410-cbc4-4a41-a0cb-44630bc5a835 => generated 344 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:21:10.451140 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-95600b00-ddf4-4900-8a18-d46dd650f604 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:10.452417 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-95600b00-ddf4-4900-8a18-d46dd650f604 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: a8ed4840-07d6-4506-a0ef-b686a6231fb7] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:10.463478 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-95600b00-ddf4-4900-8a18-d46dd650f604 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:10.464587 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-95600b00-ddf4-4900-8a18-d46dd650f604 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:10.465228 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-95600b00-ddf4-4900-8a18-d46dd650f604 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:10.466923 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-95600b00-ddf4-4900-8a18-d46dd650f604 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:10.467973 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-95600b00-ddf4-4900-8a18-d46dd650f604 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:10.468610 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-95600b00-ddf4-4900-8a18-d46dd650f604 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:10.563666 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=8 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:21:10.845455 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-95600b00-ddf4-4900-8a18-d46dd650f604 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6684f0c87e4242be9e0ffb4ef1973f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0582ace9e4443b8ad88915503ee630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:10.855982 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-95600b00-ddf4-4900-8a18-d46dd650f604 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "GET /compute/v2.1/servers/a8ed4840-07d6-4506-a0ef-b686a6231fb7" status: 200 len: 1309 microversion: 2.1 time: 0.408595 Aug 10 23:21:10.876922 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2578/4948] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:21:10 2022] GET /compute/v2.1/servers/a8ed4840-07d6-4506-a0ef-b686a6231fb7 => generated 1309 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:21:10.943747 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-5a759553-41a8-4cc2-bff2-4a4359dcca6b tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:10.945381 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-5a759553-41a8-4cc2-bff2-4a4359dcca6b tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] [instance: 076fa162-4b4f-4246-aa95-02525f01e4a7] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:10.952844 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5a759553-41a8-4cc2-bff2-4a4359dcca6b tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:10.953738 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5a759553-41a8-4cc2-bff2-4a4359dcca6b tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:10.954655 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5a759553-41a8-4cc2-bff2-4a4359dcca6b tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:10.955960 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5a759553-41a8-4cc2-bff2-4a4359dcca6b tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:10.957145 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5a759553-41a8-4cc2-bff2-4a4359dcca6b tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:10.957881 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5a759553-41a8-4cc2-bff2-4a4359dcca6b tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:10.959047 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-428a22e4-47b2-45ba-819e-47d42f4fc3ed tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Flavor limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:21:10.962875 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-428a22e4-47b2-45ba-819e-47d42f4fc3ed tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Image limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:21:10.963461 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-428a22e4-47b2-45ba-819e-47d42f4fc3ed tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Flavor pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:21:10.964293 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-428a22e4-47b2-45ba-819e-47d42f4fc3ed tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Image pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:21:10.964653 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-428a22e4-47b2-45ba-819e-47d42f4fc3ed tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:21:10.976491 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=29 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:21:10.984375 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-428a22e4-47b2-45ba-819e-47d42f4fc3ed tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:10.984921 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-428a22e4-47b2-45ba-819e-47d42f4fc3ed tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:10.986379 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-428a22e4-47b2-45ba-819e-47d42f4fc3ed tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:10.987712 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-428a22e4-47b2-45ba-819e-47d42f4fc3ed tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:10.988415 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-428a22e4-47b2-45ba-819e-47d42f4fc3ed tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:10.989758 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-428a22e4-47b2-45ba-819e-47d42f4fc3ed tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:11.026848 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-428a22e4-47b2-45ba-819e-47d42f4fc3ed tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Getting quotas for project 2b557edd165144c8943eb9acc339a377. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:21:11.035210 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-428a22e4-47b2-45ba-819e-47d42f4fc3ed tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Getting quotas for user 0d89081084f14e0187f4c67cd9185fef and project 2b557edd165144c8943eb9acc339a377. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:21:11.067169 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-428a22e4-47b2-45ba-819e-47d42f4fc3ed tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Going to run 1 instances... {{(pid=122632) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 23:21:11.069993 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-428a22e4-47b2-45ba-819e-47d42f4fc3ed tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] [instance: 440c3d30-e5c9-4093-9b7e-39e06d32d682] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78ad8905-f66f-4733-8be9-2b260f1fabed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122632) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 23:21:11.140358 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-428a22e4-47b2-45ba-819e-47d42f4fc3ed tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.686213 Aug 10 23:21:11.141893 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2371/4949] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 23:21:09 2022] POST /compute/v2.1/servers => generated 402 bytes in 1688 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 10 23:21:11.148901 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-6b2906f9-1a9c-4c7d-a02b-6c9c0132d68d tempest-VolumesSnapshotsTestJSON-567793322 tempest-VolumesSnapshotsTestJSON-567793322-project] Calling method '.version_select at 0x7f847d024160>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:11.208917 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-5a759553-41a8-4cc2-bff2-4a4359dcca6b tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '627b163f1a0e4fdeb0e9692e7d37460d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb5f5856c46490ab1ded572d693c4cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:11.220248 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-5a759553-41a8-4cc2-bff2-4a4359dcca6b tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] 10.222.0.58 "GET /compute/v2.1/servers/076fa162-4b4f-4246-aa95-02525f01e4a7" status: 200 len: 1298 microversion: 2.1 time: 0.280836 Aug 10 23:21:11.221203 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2579/4950] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:21:10 2022] GET /compute/v2.1/servers/076fa162-4b4f-4246-aa95-02525f01e4a7 => generated 1298 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:21:11.245626 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-8e3c686d-4083-4211-8351-e274542b8cc7 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:11.246250 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-8e3c686d-4083-4211-8351-e274542b8cc7 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] [instance: 440c3d30-e5c9-4093-9b7e-39e06d32d682] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:11.269970 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-6b2906f9-1a9c-4c7d-a02b-6c9c0132d68d tempest-VolumesSnapshotsTestJSON-567793322 tempest-VolumesSnapshotsTestJSON-567793322-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/2aeeb410-cbc4-4a41-a0cb-44630bc5a835" status: 200 len: 345 microversion: 2.1 time: 0.126591 Aug 10 23:21:11.270846 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2372/4951] 10.222.0.58 () {58 vars in 1245 bytes} [Wed Aug 10 23:21:11 2022] GET /compute/v2.1/os-volumes/2aeeb410-cbc4-4a41-a0cb-44630bc5a835 => generated 345 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:21:11.285503 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-ff3e179d-74f6-4e90-8e48-ef9560a70cb6 tempest-VolumesSnapshotsTestJSON-567793322 tempest-VolumesSnapshotsTestJSON-567793322-project] Action: 'create', calling method: .version_select at 0x7f847d1b7430>, body: {"snapshot": {"volume_id": "2aeeb410-cbc4-4a41-a0cb-44630bc5a835", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-2056548259"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:21:11.592891 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-ff3e179d-74f6-4e90-8e48-ef9560a70cb6 tempest-VolumesSnapshotsTestJSON-567793322 tempest-VolumesSnapshotsTestJSON-567793322-project] 10.222.0.58 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.313043 Aug 10 23:21:11.593704 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2373/4952] 10.222.0.58 () {60 vars in 1162 bytes} [Wed Aug 10 23:21:11 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:21:11.597531 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-8e3c686d-4083-4211-8351-e274542b8cc7 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d89081084f14e0187f4c67cd9185fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b557edd165144c8943eb9acc339a377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:11.606099 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-8e3c686d-4083-4211-8351-e274542b8cc7 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] 10.222.0.58 "GET /compute/v2.1/servers/440c3d30-e5c9-4093-9b7e-39e06d32d682" status: 200 len: 1242 microversion: 2.1 time: 0.383582 Aug 10 23:21:11.607300 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-e2e48976-fa15-4012-8e60-6a4cbabfa403 tempest-VolumesSnapshotsTestJSON-567793322 tempest-VolumesSnapshotsTestJSON-567793322-project] Calling method '.version_select at 0x7f847db49a60>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:11.611172 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2580/4953] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:21:11 2022] GET /compute/v2.1/servers/440c3d30-e5c9-4093-9b7e-39e06d32d682 => generated 1242 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:21:11.671191 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-e2e48976-fa15-4012-8e60-6a4cbabfa403 tempest-VolumesSnapshotsTestJSON-567793322 tempest-VolumesSnapshotsTestJSON-567793322-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/4f4f582d-9fe5-487e-bc18-9dec8b978917" status: 200 len: 287 microversion: 2.1 time: 0.069766 Aug 10 23:21:11.672161 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2374/4954] 10.222.0.58 () {58 vars in 1251 bytes} [Wed Aug 10 23:21:11 2022] GET /compute/v2.1/os-snapshots/4f4f582d-9fe5-487e-bc18-9dec8b978917 => generated 287 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:21:11.685188 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-b6964d06-c7b0-40e1-b062-a07a95b2fe6f tempest-VolumesSnapshotsTestJSON-567793322 tempest-VolumesSnapshotsTestJSON-567793322-project] Calling method '.version_select at 0x7f847d295790>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:11.770687 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-b6964d06-c7b0-40e1-b062-a07a95b2fe6f tempest-VolumesSnapshotsTestJSON-567793322 tempest-VolumesSnapshotsTestJSON-567793322-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.090829 Aug 10 23:21:11.772060 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2581/4955] 10.222.0.58 () {58 vars in 1140 bytes} [Wed Aug 10 23:21:11 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:21:11.786256 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-468a9836-966a-47cc-8a8e-7647afdf195b tempest-VolumesSnapshotsTestJSON-567793322 tempest-VolumesSnapshotsTestJSON-567793322-project] Calling method '.version_select at 0x7f848253f5e0>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:11.842300 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-468a9836-966a-47cc-8a8e-7647afdf195b tempest-VolumesSnapshotsTestJSON-567793322 tempest-VolumesSnapshotsTestJSON-567793322-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/4f4f582d-9fe5-487e-bc18-9dec8b978917" status: 200 len: 287 microversion: 2.1 time: 0.062330 Aug 10 23:21:11.843207 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2375/4956] 10.222.0.58 () {58 vars in 1251 bytes} [Wed Aug 10 23:21:11 2022] GET /compute/v2.1/os-snapshots/4f4f582d-9fe5-487e-bc18-9dec8b978917 => generated 287 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:21:11.884337 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-39e3cbf2-6580-4c8d-9176-d86d1dd75998 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:11.885221 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-39e3cbf2-6580-4c8d-9176-d86d1dd75998 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: a8ed4840-07d6-4506-a0ef-b686a6231fb7] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:11.899812 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-39e3cbf2-6580-4c8d-9176-d86d1dd75998 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:11.909096 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-39e3cbf2-6580-4c8d-9176-d86d1dd75998 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:11.909785 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-39e3cbf2-6580-4c8d-9176-d86d1dd75998 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:11.910535 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-39e3cbf2-6580-4c8d-9176-d86d1dd75998 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:11.912490 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-39e3cbf2-6580-4c8d-9176-d86d1dd75998 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:11.912981 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-39e3cbf2-6580-4c8d-9176-d86d1dd75998 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:12.003021 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-d377c005-7c6f-413a-aa06-1acb13f8308a req-d2934134-07f8-4c56-97be-7a5c57aa9790 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8ed4840-07d6-4506-a0ef-b686a6231fb7", "name": "network-vif-plugged", "status": "completed", "tag": "d7d0f217-6cf8-4a40-82d9-fe0df4b342bc"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:21:12.034627 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-d377c005-7c6f-413a-aa06-1acb13f8308a req-d2934134-07f8-4c56-97be-7a5c57aa9790 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:12.035163 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-d377c005-7c6f-413a-aa06-1acb13f8308a req-d2934134-07f8-4c56-97be-7a5c57aa9790 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:12.035612 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-d377c005-7c6f-413a-aa06-1acb13f8308a req-d2934134-07f8-4c56-97be-7a5c57aa9790 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:12.082522 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-d377c005-7c6f-413a-aa06-1acb13f8308a req-d2934134-07f8-4c56-97be-7a5c57aa9790 service nova] Creating event network-vif-plugged:d7d0f217-6cf8-4a40-82d9-fe0df4b342bc for instance a8ed4840-07d6-4506-a0ef-b686a6231fb7 on n-h1-850468-14 Aug 10 23:21:12.087672 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-d377c005-7c6f-413a-aa06-1acb13f8308a req-d2934134-07f8-4c56-97be-7a5c57aa9790 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089003 Aug 10 23:21:12.088597 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2376/4957] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:21:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:21:12.245178 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-33cc03ad-c162-40ba-86c8-1513a2d20796 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:12.245891 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-33cc03ad-c162-40ba-86c8-1513a2d20796 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] [instance: 076fa162-4b4f-4246-aa95-02525f01e4a7] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:12.262695 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-33cc03ad-c162-40ba-86c8-1513a2d20796 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:12.263217 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-33cc03ad-c162-40ba-86c8-1513a2d20796 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:12.263655 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-33cc03ad-c162-40ba-86c8-1513a2d20796 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:12.264376 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-33cc03ad-c162-40ba-86c8-1513a2d20796 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:12.264830 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-33cc03ad-c162-40ba-86c8-1513a2d20796 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:12.265254 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-33cc03ad-c162-40ba-86c8-1513a2d20796 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:12.488225 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-39e3cbf2-6580-4c8d-9176-d86d1dd75998 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6684f0c87e4242be9e0ffb4ef1973f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0582ace9e4443b8ad88915503ee630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:12.502180 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-39e3cbf2-6580-4c8d-9176-d86d1dd75998 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "GET /compute/v2.1/servers/a8ed4840-07d6-4506-a0ef-b686a6231fb7" status: 200 len: 1309 microversion: 2.1 time: 0.624692 Aug 10 23:21:12.504521 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2582/4958] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:21:11 2022] GET /compute/v2.1/servers/a8ed4840-07d6-4506-a0ef-b686a6231fb7 => generated 1309 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:21:12.594545 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-33cc03ad-c162-40ba-86c8-1513a2d20796 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '627b163f1a0e4fdeb0e9692e7d37460d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb5f5856c46490ab1ded572d693c4cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:12.610284 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-33cc03ad-c162-40ba-86c8-1513a2d20796 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] 10.222.0.58 "GET /compute/v2.1/servers/076fa162-4b4f-4246-aa95-02525f01e4a7" status: 200 len: 1298 microversion: 2.1 time: 0.369324 Aug 10 23:21:12.611721 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2377/4959] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:21:12 2022] GET /compute/v2.1/servers/076fa162-4b4f-4246-aa95-02525f01e4a7 => generated 1298 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:21:12.633553 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-961b3e6b-e52a-4b27-a7a0-c3c0695c4e1a tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:12.635245 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-961b3e6b-e52a-4b27-a7a0-c3c0695c4e1a tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] [instance: 440c3d30-e5c9-4093-9b7e-39e06d32d682] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:12.654061 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-961b3e6b-e52a-4b27-a7a0-c3c0695c4e1a tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:12.655461 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-961b3e6b-e52a-4b27-a7a0-c3c0695c4e1a tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:12.656016 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-961b3e6b-e52a-4b27-a7a0-c3c0695c4e1a tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:12.657157 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-961b3e6b-e52a-4b27-a7a0-c3c0695c4e1a tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:12.657724 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-961b3e6b-e52a-4b27-a7a0-c3c0695c4e1a tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:12.658417 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-961b3e6b-e52a-4b27-a7a0-c3c0695c4e1a tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:12.856171 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-199eabba-6747-4ad6-9a3a-ed0c2b59648b tempest-VolumesSnapshotsTestJSON-567793322 tempest-VolumesSnapshotsTestJSON-567793322-project] Calling method '.version_select at 0x7f847c7c3ca0>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:12.948149 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-199eabba-6747-4ad6-9a3a-ed0c2b59648b tempest-VolumesSnapshotsTestJSON-567793322 tempest-VolumesSnapshotsTestJSON-567793322-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/4f4f582d-9fe5-487e-bc18-9dec8b978917" status: 200 len: 287 microversion: 2.1 time: 0.096226 Aug 10 23:21:12.949190 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2378/4960] 10.222.0.58 () {58 vars in 1251 bytes} [Wed Aug 10 23:21:12 2022] GET /compute/v2.1/os-snapshots/4f4f582d-9fe5-487e-bc18-9dec8b978917 => generated 287 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 23:21:13.453415 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-961b3e6b-e52a-4b27-a7a0-c3c0695c4e1a tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d89081084f14e0187f4c67cd9185fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b557edd165144c8943eb9acc339a377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:13.466306 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-961b3e6b-e52a-4b27-a7a0-c3c0695c4e1a tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] 10.222.0.58 "GET /compute/v2.1/servers/440c3d30-e5c9-4093-9b7e-39e06d32d682" status: 200 len: 1294 microversion: 2.1 time: 0.836754 Aug 10 23:21:13.471449 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2583/4961] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:21:12 2022] GET /compute/v2.1/servers/440c3d30-e5c9-4093-9b7e-39e06d32d682 => generated 1294 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:21:13.543339 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-957f50bb-74ce-4f5b-b595-7e15f2510375 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:13.544522 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-957f50bb-74ce-4f5b-b595-7e15f2510375 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: a8ed4840-07d6-4506-a0ef-b686a6231fb7] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:13.555815 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-957f50bb-74ce-4f5b-b595-7e15f2510375 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:13.556587 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-957f50bb-74ce-4f5b-b595-7e15f2510375 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:13.558011 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-957f50bb-74ce-4f5b-b595-7e15f2510375 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:13.561393 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-957f50bb-74ce-4f5b-b595-7e15f2510375 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:13.565140 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-957f50bb-74ce-4f5b-b595-7e15f2510375 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:13.566008 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-957f50bb-74ce-4f5b-b595-7e15f2510375 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:13.644339 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-52ec47d4-d4a0-4777-b93c-adea245392fd tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:13.648376 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-52ec47d4-d4a0-4777-b93c-adea245392fd tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] [instance: 076fa162-4b4f-4246-aa95-02525f01e4a7] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:13.670333 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-52ec47d4-d4a0-4777-b93c-adea245392fd tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:13.674162 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-52ec47d4-d4a0-4777-b93c-adea245392fd tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:13.674667 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-52ec47d4-d4a0-4777-b93c-adea245392fd tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:13.675853 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-52ec47d4-d4a0-4777-b93c-adea245392fd tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:13.677665 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-52ec47d4-d4a0-4777-b93c-adea245392fd tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:13.679144 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-52ec47d4-d4a0-4777-b93c-adea245392fd tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:14.049706 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-52ec47d4-d4a0-4777-b93c-adea245392fd tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '627b163f1a0e4fdeb0e9692e7d37460d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb5f5856c46490ab1ded572d693c4cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:14.104198 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-52ec47d4-d4a0-4777-b93c-adea245392fd tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] 10.222.0.58 "GET /compute/v2.1/servers/076fa162-4b4f-4246-aa95-02525f01e4a7" status: 200 len: 1298 microversion: 2.1 time: 0.469388 Aug 10 23:21:14.104810 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2584/4962] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:21:13 2022] GET /compute/v2.1/servers/076fa162-4b4f-4246-aa95-02525f01e4a7 => generated 1298 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:21:14.123128 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-18eaa6f7-9376-4d06-a087-e7d64317fae3 tempest-VolumesSnapshotsTestJSON-567793322 tempest-VolumesSnapshotsTestJSON-567793322-project] Calling method '.version_select at 0x7f847d292160>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:14.209051 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-18eaa6f7-9376-4d06-a087-e7d64317fae3 tempest-VolumesSnapshotsTestJSON-567793322 tempest-VolumesSnapshotsTestJSON-567793322-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/4f4f582d-9fe5-487e-bc18-9dec8b978917" status: 200 len: 287 microversion: 2.1 time: 0.103152 Aug 10 23:21:14.215404 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2585/4963] 10.222.0.58 () {58 vars in 1251 bytes} [Wed Aug 10 23:21:14 2022] GET /compute/v2.1/os-snapshots/4f4f582d-9fe5-487e-bc18-9dec8b978917 => generated 287 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:21:14.496960 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-48e7df04-2604-4e8d-a1ee-719b180259d9 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:14.503967 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-48e7df04-2604-4e8d-a1ee-719b180259d9 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] [instance: 440c3d30-e5c9-4093-9b7e-39e06d32d682] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:14.519199 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-48e7df04-2604-4e8d-a1ee-719b180259d9 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:14.520120 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-48e7df04-2604-4e8d-a1ee-719b180259d9 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:14.521550 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-48e7df04-2604-4e8d-a1ee-719b180259d9 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:14.523818 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-48e7df04-2604-4e8d-a1ee-719b180259d9 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:14.525303 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-48e7df04-2604-4e8d-a1ee-719b180259d9 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:14.527266 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-48e7df04-2604-4e8d-a1ee-719b180259d9 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:14.538509 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-957f50bb-74ce-4f5b-b595-7e15f2510375 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6684f0c87e4242be9e0ffb4ef1973f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0582ace9e4443b8ad88915503ee630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:14.548725 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-957f50bb-74ce-4f5b-b595-7e15f2510375 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "GET /compute/v2.1/servers/a8ed4840-07d6-4506-a0ef-b686a6231fb7" status: 200 len: 1309 microversion: 2.1 time: 1.018206 Aug 10 23:21:14.563137 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2379/4964] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:21:13 2022] GET /compute/v2.1/servers/a8ed4840-07d6-4506-a0ef-b686a6231fb7 => generated 1309 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:21:14.659850 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-48e7df04-2604-4e8d-a1ee-719b180259d9 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d89081084f14e0187f4c67cd9185fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b557edd165144c8943eb9acc339a377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:14.681722 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-48e7df04-2604-4e8d-a1ee-719b180259d9 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] 10.222.0.58 "GET /compute/v2.1/servers/440c3d30-e5c9-4093-9b7e-39e06d32d682" status: 200 len: 1300 microversion: 2.1 time: 0.197881 Aug 10 23:21:14.700572 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2586/4965] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:21:14 2022] GET /compute/v2.1/servers/440c3d30-e5c9-4093-9b7e-39e06d32d682 => generated 1300 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:21:15.125620 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-50426592-0bb3-4ef7-9a06-a6b67658bf85 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:15.127151 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-50426592-0bb3-4ef7-9a06-a6b67658bf85 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] [instance: 076fa162-4b4f-4246-aa95-02525f01e4a7] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:15.146486 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-50426592-0bb3-4ef7-9a06-a6b67658bf85 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:15.147025 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-50426592-0bb3-4ef7-9a06-a6b67658bf85 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:15.147464 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-50426592-0bb3-4ef7-9a06-a6b67658bf85 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:15.148179 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-50426592-0bb3-4ef7-9a06-a6b67658bf85 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:15.148630 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-50426592-0bb3-4ef7-9a06-a6b67658bf85 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:15.149056 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-50426592-0bb3-4ef7-9a06-a6b67658bf85 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:15.222746 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-1a94d952-0f03-4067-9605-697fc0e8f44b tempest-VolumesSnapshotsTestJSON-567793322 tempest-VolumesSnapshotsTestJSON-567793322-project] Calling method '.version_select at 0x7f847d2924c0>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:15.301960 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-1a94d952-0f03-4067-9605-697fc0e8f44b tempest-VolumesSnapshotsTestJSON-567793322 tempest-VolumesSnapshotsTestJSON-567793322-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/4f4f582d-9fe5-487e-bc18-9dec8b978917" status: 200 len: 288 microversion: 2.1 time: 0.083195 Aug 10 23:21:15.309201 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2587/4966] 10.222.0.58 () {58 vars in 1251 bytes} [Wed Aug 10 23:21:15 2022] GET /compute/v2.1/os-snapshots/4f4f582d-9fe5-487e-bc18-9dec8b978917 => generated 288 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 23:21:15.314714 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-2c709834-120b-43ae-92bf-aac70049b23b tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:15.318433 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-2c709834-120b-43ae-92bf-aac70049b23b tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] [instance: 32ddd6eb-6c3f-4bd1-b9be-f819e8ef3a68] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:15.336160 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2c709834-120b-43ae-92bf-aac70049b23b tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:15.336904 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2c709834-120b-43ae-92bf-aac70049b23b tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:15.337554 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2c709834-120b-43ae-92bf-aac70049b23b tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:15.339517 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2c709834-120b-43ae-92bf-aac70049b23b tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:15.342660 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2c709834-120b-43ae-92bf-aac70049b23b tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:15.343468 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2c709834-120b-43ae-92bf-aac70049b23b tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:15.382544 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-50426592-0bb3-4ef7-9a06-a6b67658bf85 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '627b163f1a0e4fdeb0e9692e7d37460d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb5f5856c46490ab1ded572d693c4cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:15.395127 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-50426592-0bb3-4ef7-9a06-a6b67658bf85 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] 10.222.0.58 "GET /compute/v2.1/servers/076fa162-4b4f-4246-aa95-02525f01e4a7" status: 200 len: 1298 microversion: 2.1 time: 0.271620 Aug 10 23:21:15.399139 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2380/4967] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:21:15 2022] GET /compute/v2.1/servers/076fa162-4b4f-4246-aa95-02525f01e4a7 => generated 1298 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:21:15.414727 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-7cc2cf05-0125-465b-a8d8-ea6993ebcb15 req-db6bc8aa-b3f9-48b1-a6cc-064e8ff51370 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32ddd6eb-6c3f-4bd1-b9be-f819e8ef3a68", "tag": "4f9f24c0-e01f-4d27-8d15-06a370ec5bb8"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:21:15.436101 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:21:15.457326 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-7cc2cf05-0125-465b-a8d8-ea6993ebcb15 req-db6bc8aa-b3f9-48b1-a6cc-064e8ff51370 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:15.462209 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-7cc2cf05-0125-465b-a8d8-ea6993ebcb15 req-db6bc8aa-b3f9-48b1-a6cc-064e8ff51370 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:15.463135 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-7cc2cf05-0125-465b-a8d8-ea6993ebcb15 req-db6bc8aa-b3f9-48b1-a6cc-064e8ff51370 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:15.481631 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-7cc2cf05-0125-465b-a8d8-ea6993ebcb15 req-db6bc8aa-b3f9-48b1-a6cc-064e8ff51370 service nova] Creating event network-changed:4f9f24c0-e01f-4d27-8d15-06a370ec5bb8 for instance 32ddd6eb-6c3f-4bd1-b9be-f819e8ef3a68 on n-h2-850468-14 Aug 10 23:21:15.493282 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-7cc2cf05-0125-465b-a8d8-ea6993ebcb15 req-db6bc8aa-b3f9-48b1-a6cc-064e8ff51370 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092383 Aug 10 23:21:15.494419 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2381/4968] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:21:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:21:15.518019 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-6b05dd39-373e-4d7b-9745-b25e9618b7da tempest-VolumesSnapshotsTestJSON-567793322 tempest-VolumesSnapshotsTestJSON-567793322-project] Calling method '.version_select at 0x7f847c7c3ca0>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:15.640580 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-6b05dd39-373e-4d7b-9745-b25e9618b7da tempest-VolumesSnapshotsTestJSON-567793322 tempest-VolumesSnapshotsTestJSON-567793322-project] 10.222.0.58 "DELETE /compute/v2.1/os-snapshots/4f4f582d-9fe5-487e-bc18-9dec8b978917" status: 202 len: 0 microversion: 2.1 time: 0.138371 Aug 10 23:21:15.645278 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2382/4969] 10.222.0.58 () {58 vars in 1254 bytes} [Wed Aug 10 23:21:15 2022] DELETE /compute/v2.1/os-snapshots/4f4f582d-9fe5-487e-bc18-9dec8b978917 => generated 0 bytes in 150 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:21:15.651067 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-46d6a069-4852-4ad1-904e-c9a3eef7e536 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:15.652017 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-46d6a069-4852-4ad1-904e-c9a3eef7e536 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: a8ed4840-07d6-4506-a0ef-b686a6231fb7] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:15.659297 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-46d6a069-4852-4ad1-904e-c9a3eef7e536 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:15.660293 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-46d6a069-4852-4ad1-904e-c9a3eef7e536 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:15.660981 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-46d6a069-4852-4ad1-904e-c9a3eef7e536 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:15.661897 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-46d6a069-4852-4ad1-904e-c9a3eef7e536 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:15.662521 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-46d6a069-4852-4ad1-904e-c9a3eef7e536 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:15.663173 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-46d6a069-4852-4ad1-904e-c9a3eef7e536 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:15.767894 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-2c709834-120b-43ae-92bf-aac70049b23b tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5899b2ad9f1046caaf7c6073e408eeee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25abd63376614081a9d484f3c9ae950d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:15.781236 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-2c709834-120b-43ae-92bf-aac70049b23b tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "GET /compute/v2.1/servers/32ddd6eb-6c3f-4bd1-b9be-f819e8ef3a68" status: 200 len: 1564 microversion: 2.1 time: 0.470734 Aug 10 23:21:15.783020 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2588/4970] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:21:15 2022] GET /compute/v2.1/servers/32ddd6eb-6c3f-4bd1-b9be-f819e8ef3a68 => generated 1564 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:21:15.793493 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-d831bb55-2dbe-401c-9980-5cc2bd0753b8 req-b34d66f9-5b73-44df-a5b4-c6702c02f9c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "076fa162-4b4f-4246-aa95-02525f01e4a7", "name": "network-vif-plugged", "status": "completed", "tag": "6849b263-5fec-4087-a5ee-f4b58a934628"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:21:15.831735 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-d831bb55-2dbe-401c-9980-5cc2bd0753b8 req-b34d66f9-5b73-44df-a5b4-c6702c02f9c1 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:15.832373 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-d831bb55-2dbe-401c-9980-5cc2bd0753b8 req-b34d66f9-5b73-44df-a5b4-c6702c02f9c1 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:15.833012 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-d831bb55-2dbe-401c-9980-5cc2bd0753b8 req-b34d66f9-5b73-44df-a5b4-c6702c02f9c1 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:15.863218 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-d831bb55-2dbe-401c-9980-5cc2bd0753b8 req-b34d66f9-5b73-44df-a5b4-c6702c02f9c1 service nova] Creating event network-vif-plugged:6849b263-5fec-4087-a5ee-f4b58a934628 for instance 076fa162-4b4f-4246-aa95-02525f01e4a7 on n-h1-850468-14 Aug 10 23:21:15.874176 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-d831bb55-2dbe-401c-9980-5cc2bd0753b8 req-b34d66f9-5b73-44df-a5b4-c6702c02f9c1 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088101 Aug 10 23:21:15.880349 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2589/4971] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:21:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:21:15.894420 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-74b4656a-1e30-45ba-9e64-6a464e915df5 tempest-VolumesSnapshotsTestJSON-567793322 tempest-VolumesSnapshotsTestJSON-567793322-project] Calling method '.version_select at 0x7f847d298f70>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:15.933191 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-74b4656a-1e30-45ba-9e64-6a464e915df5 tempest-VolumesSnapshotsTestJSON-567793322 tempest-VolumesSnapshotsTestJSON-567793322-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/4f4f582d-9fe5-487e-bc18-9dec8b978917" status: 200 len: 287 microversion: 2.1 time: 0.044093 Aug 10 23:21:15.934541 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2590/4972] 10.222.0.58 () {58 vars in 1251 bytes} [Wed Aug 10 23:21:15 2022] GET /compute/v2.1/os-snapshots/4f4f582d-9fe5-487e-bc18-9dec8b978917 => generated 287 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:21:15.940083 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-638f23b6-22e5-4d18-9858-fc7700f6031c tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:15.941154 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-638f23b6-22e5-4d18-9858-fc7700f6031c tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] [instance: 440c3d30-e5c9-4093-9b7e-39e06d32d682] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:15.952312 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-638f23b6-22e5-4d18-9858-fc7700f6031c tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:15.953135 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-638f23b6-22e5-4d18-9858-fc7700f6031c tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:15.954487 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-638f23b6-22e5-4d18-9858-fc7700f6031c tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:15.955592 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-638f23b6-22e5-4d18-9858-fc7700f6031c tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:15.956287 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-638f23b6-22e5-4d18-9858-fc7700f6031c tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:15.957151 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-638f23b6-22e5-4d18-9858-fc7700f6031c tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:16.184969 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-46d6a069-4852-4ad1-904e-c9a3eef7e536 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6684f0c87e4242be9e0ffb4ef1973f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0582ace9e4443b8ad88915503ee630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:16.193976 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-638f23b6-22e5-4d18-9858-fc7700f6031c tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d89081084f14e0187f4c67cd9185fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b557edd165144c8943eb9acc339a377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:16.196271 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-46d6a069-4852-4ad1-904e-c9a3eef7e536 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "GET /compute/v2.1/servers/a8ed4840-07d6-4506-a0ef-b686a6231fb7" status: 200 len: 1489 microversion: 2.1 time: 0.549692 Aug 10 23:21:16.202109 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-638f23b6-22e5-4d18-9858-fc7700f6031c tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] 10.222.0.58 "GET /compute/v2.1/servers/440c3d30-e5c9-4093-9b7e-39e06d32d682" status: 200 len: 1300 microversion: 2.1 time: 0.266052 Aug 10 23:21:16.204076 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2383/4973] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:21:15 2022] GET /compute/v2.1/servers/a8ed4840-07d6-4506-a0ef-b686a6231fb7 => generated 1489 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:21:16.208982 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2591/4974] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:21:15 2022] GET /compute/v2.1/servers/440c3d30-e5c9-4093-9b7e-39e06d32d682 => generated 1300 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:21:16.224135 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-68eab1ca-89de-4121-b16e-3e1c7c792754 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:21:16.226923 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-68eab1ca-89de-4121-b16e-3e1c7c792754 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: a8ed4840-07d6-4506-a0ef-b686a6231fb7] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:16.243243 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-68eab1ca-89de-4121-b16e-3e1c7c792754 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:16.249719 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-68eab1ca-89de-4121-b16e-3e1c7c792754 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:16.251894 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-68eab1ca-89de-4121-b16e-3e1c7c792754 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:16.253174 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-68eab1ca-89de-4121-b16e-3e1c7c792754 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:16.253881 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-68eab1ca-89de-4121-b16e-3e1c7c792754 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:16.254886 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-68eab1ca-89de-4121-b16e-3e1c7c792754 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:16.380587 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-68eab1ca-89de-4121-b16e-3e1c7c792754 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "PUT /compute/v2.1/servers/a8ed4840-07d6-4506-a0ef-b686a6231fb7" status: 200 len: 1084 microversion: 2.1 time: 0.163135 Aug 10 23:21:16.382342 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2384/4975] 10.222.0.58 () {60 vars in 1256 bytes} [Wed Aug 10 23:21:16 2022] PUT /compute/v2.1/servers/a8ed4840-07d6-4506-a0ef-b686a6231fb7 => generated 1084 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:21:16.403240 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-054c174a-7dc0-493e-a4da-95b0f44760db tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:16.404346 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-054c174a-7dc0-493e-a4da-95b0f44760db tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: a8ed4840-07d6-4506-a0ef-b686a6231fb7] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:16.441853 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-f19146d3-14c5-4d4f-9ec7-ecb75bce0394 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:16.443554 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-054c174a-7dc0-493e-a4da-95b0f44760db tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:16.444609 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-054c174a-7dc0-493e-a4da-95b0f44760db tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:16.445234 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-054c174a-7dc0-493e-a4da-95b0f44760db tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:16.446128 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-f19146d3-14c5-4d4f-9ec7-ecb75bce0394 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] [instance: 076fa162-4b4f-4246-aa95-02525f01e4a7] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:16.447173 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-054c174a-7dc0-493e-a4da-95b0f44760db tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:16.450420 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-054c174a-7dc0-493e-a4da-95b0f44760db tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:16.451650 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-054c174a-7dc0-493e-a4da-95b0f44760db tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:16.504046 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f19146d3-14c5-4d4f-9ec7-ecb75bce0394 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:16.506830 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f19146d3-14c5-4d4f-9ec7-ecb75bce0394 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.038s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:16.507596 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f19146d3-14c5-4d4f-9ec7-ecb75bce0394 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:16.512318 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f19146d3-14c5-4d4f-9ec7-ecb75bce0394 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:16.513252 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f19146d3-14c5-4d4f-9ec7-ecb75bce0394 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:16.522717 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f19146d3-14c5-4d4f-9ec7-ecb75bce0394 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:16.771489 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-f19146d3-14c5-4d4f-9ec7-ecb75bce0394 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '627b163f1a0e4fdeb0e9692e7d37460d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb5f5856c46490ab1ded572d693c4cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:16.787541 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-f19146d3-14c5-4d4f-9ec7-ecb75bce0394 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] 10.222.0.58 "GET /compute/v2.1/servers/076fa162-4b4f-4246-aa95-02525f01e4a7" status: 200 len: 1298 microversion: 2.1 time: 0.373891 Aug 10 23:21:16.788786 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2385/4976] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:21:16 2022] GET /compute/v2.1/servers/076fa162-4b4f-4246-aa95-02525f01e4a7 => generated 1298 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:21:16.946866 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-8af33566-1be6-49dd-8302-cbe7c58d8420 tempest-VolumesSnapshotsTestJSON-567793322 tempest-VolumesSnapshotsTestJSON-567793322-project] Calling method '.version_select at 0x7f8482516160>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:17.013768 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-8af33566-1be6-49dd-8302-cbe7c58d8420 tempest-VolumesSnapshotsTestJSON-567793322 tempest-VolumesSnapshotsTestJSON-567793322-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/4f4f582d-9fe5-487e-bc18-9dec8b978917" status: 200 len: 287 microversion: 2.1 time: 0.070736 Aug 10 23:21:17.014643 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2386/4977] 10.222.0.58 () {58 vars in 1251 bytes} [Wed Aug 10 23:21:16 2022] GET /compute/v2.1/os-snapshots/4f4f582d-9fe5-487e-bc18-9dec8b978917 => generated 287 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:21:17.229514 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-208c2adc-998b-46f6-8f34-693af1ae7eec tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:17.230513 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-208c2adc-998b-46f6-8f34-693af1ae7eec tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] [instance: 440c3d30-e5c9-4093-9b7e-39e06d32d682] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:17.240132 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-208c2adc-998b-46f6-8f34-693af1ae7eec tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:17.246125 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-208c2adc-998b-46f6-8f34-693af1ae7eec tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:17.246796 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-208c2adc-998b-46f6-8f34-693af1ae7eec tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:17.248132 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-208c2adc-998b-46f6-8f34-693af1ae7eec tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:17.248766 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-208c2adc-998b-46f6-8f34-693af1ae7eec tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:17.249383 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-208c2adc-998b-46f6-8f34-693af1ae7eec tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:17.528485 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-208c2adc-998b-46f6-8f34-693af1ae7eec tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d89081084f14e0187f4c67cd9185fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b557edd165144c8943eb9acc339a377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:17.542019 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-208c2adc-998b-46f6-8f34-693af1ae7eec tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] 10.222.0.58 "GET /compute/v2.1/servers/440c3d30-e5c9-4093-9b7e-39e06d32d682" status: 200 len: 1368 microversion: 2.1 time: 0.316206 Aug 10 23:21:17.550585 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2387/4978] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:21:17 2022] GET /compute/v2.1/servers/440c3d30-e5c9-4093-9b7e-39e06d32d682 => generated 1368 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:21:17.650718 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-054c174a-7dc0-493e-a4da-95b0f44760db tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6684f0c87e4242be9e0ffb4ef1973f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0582ace9e4443b8ad88915503ee630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:17.666962 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-054c174a-7dc0-493e-a4da-95b0f44760db tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "GET /compute/v2.1/servers/a8ed4840-07d6-4506-a0ef-b686a6231fb7" status: 200 len: 1510 microversion: 2.1 time: 1.270833 Aug 10 23:21:17.673179 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2592/4979] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:21:16 2022] GET /compute/v2.1/servers/a8ed4840-07d6-4506-a0ef-b686a6231fb7 => generated 1510 bytes in 1278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:21:17.694844 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-f0340a82-559c-438b-a366-b5348b1d4b86 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:17.696408 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-f0340a82-559c-438b-a366-b5348b1d4b86 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: a8ed4840-07d6-4506-a0ef-b686a6231fb7] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:17.705278 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f0340a82-559c-438b-a366-b5348b1d4b86 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:17.706365 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f0340a82-559c-438b-a366-b5348b1d4b86 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:17.707151 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f0340a82-559c-438b-a366-b5348b1d4b86 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:17.708342 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f0340a82-559c-438b-a366-b5348b1d4b86 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:17.709317 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f0340a82-559c-438b-a366-b5348b1d4b86 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:17.710088 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f0340a82-559c-438b-a366-b5348b1d4b86 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:17.819194 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-3435e11f-742b-4346-a55c-73f48cb02f33 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:17.820089 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-3435e11f-742b-4346-a55c-73f48cb02f33 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] [instance: 076fa162-4b4f-4246-aa95-02525f01e4a7] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:17.835283 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3435e11f-742b-4346-a55c-73f48cb02f33 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:17.836466 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3435e11f-742b-4346-a55c-73f48cb02f33 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:17.837588 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3435e11f-742b-4346-a55c-73f48cb02f33 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:17.838578 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3435e11f-742b-4346-a55c-73f48cb02f33 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:17.839294 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3435e11f-742b-4346-a55c-73f48cb02f33 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:17.839953 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3435e11f-742b-4346-a55c-73f48cb02f33 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:18.009786 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-3435e11f-742b-4346-a55c-73f48cb02f33 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '627b163f1a0e4fdeb0e9692e7d37460d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb5f5856c46490ab1ded572d693c4cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:18.039987 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-3435e11f-742b-4346-a55c-73f48cb02f33 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] 10.222.0.58 "GET /compute/v2.1/servers/076fa162-4b4f-4246-aa95-02525f01e4a7" status: 200 len: 1471 microversion: 2.1 time: 0.232388 Aug 10 23:21:18.041353 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2593/4980] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:21:17 2022] GET /compute/v2.1/servers/076fa162-4b4f-4246-aa95-02525f01e4a7 => generated 1471 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:21:18.052634 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-652e5bab-3dad-445e-8162-67e58ed99e08 tempest-VolumesSnapshotsTestJSON-567793322 tempest-VolumesSnapshotsTestJSON-567793322-project] Calling method '.version_select at 0x7f847cf8e0d0>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:18.126204 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-652e5bab-3dad-445e-8162-67e58ed99e08 tempest-VolumesSnapshotsTestJSON-567793322 tempest-VolumesSnapshotsTestJSON-567793322-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/4f4f582d-9fe5-487e-bc18-9dec8b978917" status: 200 len: 287 microversion: 2.1 time: 0.083382 Aug 10 23:21:18.127011 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2594/4981] 10.222.0.58 () {58 vars in 1251 bytes} [Wed Aug 10 23:21:18 2022] GET /compute/v2.1/os-snapshots/4f4f582d-9fe5-487e-bc18-9dec8b978917 => generated 287 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:21:18.146529 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-44d4c5fe-b484-43bc-a8d2-9da66c7c7068 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:18.149166 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-44d4c5fe-b484-43bc-a8d2-9da66c7c7068 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] [instance: 076fa162-4b4f-4246-aa95-02525f01e4a7] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:18.172328 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-44d4c5fe-b484-43bc-a8d2-9da66c7c7068 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:18.173340 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-44d4c5fe-b484-43bc-a8d2-9da66c7c7068 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:18.174039 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-44d4c5fe-b484-43bc-a8d2-9da66c7c7068 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:18.175495 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-44d4c5fe-b484-43bc-a8d2-9da66c7c7068 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:18.176525 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-44d4c5fe-b484-43bc-a8d2-9da66c7c7068 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:18.177508 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-44d4c5fe-b484-43bc-a8d2-9da66c7c7068 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:18.207904 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-f0340a82-559c-438b-a366-b5348b1d4b86 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6684f0c87e4242be9e0ffb4ef1973f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0582ace9e4443b8ad88915503ee630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:18.226843 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-f0340a82-559c-438b-a366-b5348b1d4b86 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "GET /compute/v2.1/servers/a8ed4840-07d6-4506-a0ef-b686a6231fb7" status: 200 len: 1510 microversion: 2.1 time: 0.536962 Aug 10 23:21:18.227456 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2388/4982] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:21:17 2022] GET /compute/v2.1/servers/a8ed4840-07d6-4506-a0ef-b686a6231fb7 => generated 1510 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:21:18.248424 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-5e478813-53a1-4b9f-855b-6202ce5878ab tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:18.249130 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-5e478813-53a1-4b9f-855b-6202ce5878ab tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: a8ed4840-07d6-4506-a0ef-b686a6231fb7] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:18.272332 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5e478813-53a1-4b9f-855b-6202ce5878ab tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:18.273150 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5e478813-53a1-4b9f-855b-6202ce5878ab tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:18.273816 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5e478813-53a1-4b9f-855b-6202ce5878ab tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:18.274543 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5e478813-53a1-4b9f-855b-6202ce5878ab tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:18.275025 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5e478813-53a1-4b9f-855b-6202ce5878ab tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:18.275626 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5e478813-53a1-4b9f-855b-6202ce5878ab tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:18.318249 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-5e478813-53a1-4b9f-855b-6202ce5878ab tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: a8ed4840-07d6-4506-a0ef-b686a6231fb7] Going to try to terminate instance {{(pid=122632) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:21:18.333394 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-44d4c5fe-b484-43bc-a8d2-9da66c7c7068 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '627b163f1a0e4fdeb0e9692e7d37460d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb5f5856c46490ab1ded572d693c4cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:18.355424 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-44d4c5fe-b484-43bc-a8d2-9da66c7c7068 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] 10.222.0.58 "GET /compute/v2.1/servers/076fa162-4b4f-4246-aa95-02525f01e4a7" status: 200 len: 1471 microversion: 2.1 time: 0.214694 Aug 10 23:21:18.356103 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2595/4983] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:21:18 2022] GET /compute/v2.1/servers/076fa162-4b4f-4246-aa95-02525f01e4a7 => generated 1471 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:21:18.377194 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-09ed4f07-baaf-494c-bdf6-70e60171ed58 tempest-TestSecurityGroupsBasicOps-584807937 tempest-TestSecurityGroupsBasicOps-584807937-project-admin] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:18.378299 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-09ed4f07-baaf-494c-bdf6-70e60171ed58 tempest-TestSecurityGroupsBasicOps-584807937 tempest-TestSecurityGroupsBasicOps-584807937-project-admin] [instance: 076fa162-4b4f-4246-aa95-02525f01e4a7] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:18.389614 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-09ed4f07-baaf-494c-bdf6-70e60171ed58 tempest-TestSecurityGroupsBasicOps-584807937 tempest-TestSecurityGroupsBasicOps-584807937-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:18.390357 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-09ed4f07-baaf-494c-bdf6-70e60171ed58 tempest-TestSecurityGroupsBasicOps-584807937 tempest-TestSecurityGroupsBasicOps-584807937-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:18.391003 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-09ed4f07-baaf-494c-bdf6-70e60171ed58 tempest-TestSecurityGroupsBasicOps-584807937 tempest-TestSecurityGroupsBasicOps-584807937-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:18.395044 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-09ed4f07-baaf-494c-bdf6-70e60171ed58 tempest-TestSecurityGroupsBasicOps-584807937 tempest-TestSecurityGroupsBasicOps-584807937-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:18.396241 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-09ed4f07-baaf-494c-bdf6-70e60171ed58 tempest-TestSecurityGroupsBasicOps-584807937 tempest-TestSecurityGroupsBasicOps-584807937-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:18.396859 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-09ed4f07-baaf-494c-bdf6-70e60171ed58 tempest-TestSecurityGroupsBasicOps-584807937 tempest-TestSecurityGroupsBasicOps-584807937-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:18.512045 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-5e478813-53a1-4b9f-855b-6202ce5878ab tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "DELETE /compute/v2.1/servers/a8ed4840-07d6-4506-a0ef-b686a6231fb7" status: 204 len: 0 microversion: 2.1 time: 0.265815 Aug 10 23:21:18.514306 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2389/4984] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:21:18 2022] DELETE /compute/v2.1/servers/a8ed4840-07d6-4506-a0ef-b686a6231fb7 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 10 23:21:18.531105 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-5c229592-74ca-421e-9232-0b916c68680b tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:18.532616 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-5c229592-74ca-421e-9232-0b916c68680b tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: a8ed4840-07d6-4506-a0ef-b686a6231fb7] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:18.544471 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5c229592-74ca-421e-9232-0b916c68680b tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:18.545284 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5c229592-74ca-421e-9232-0b916c68680b tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:18.545898 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5c229592-74ca-421e-9232-0b916c68680b tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:18.547180 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5c229592-74ca-421e-9232-0b916c68680b tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:18.547877 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5c229592-74ca-421e-9232-0b916c68680b tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:18.549121 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5c229592-74ca-421e-9232-0b916c68680b tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:18.579351 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-09ed4f07-baaf-494c-bdf6-70e60171ed58 tempest-TestSecurityGroupsBasicOps-584807937 tempest-TestSecurityGroupsBasicOps-584807937-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/076fa162-4b4f-4246-aa95-02525f01e4a7" status: 200 len: 1624 microversion: 2.1 time: 0.206783 Aug 10 23:21:18.581701 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2596/4985] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:21:18 2022] GET /compute/v2.1/servers/076fa162-4b4f-4246-aa95-02525f01e4a7 => generated 1624 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:21:18.591703 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-7a795a66-f881-4e3c-9dca-c424fb17a8a6 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:18.593636 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-7a795a66-f881-4e3c-9dca-c424fb17a8a6 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] [instance: 440c3d30-e5c9-4093-9b7e-39e06d32d682] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:18.607744 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7a795a66-f881-4e3c-9dca-c424fb17a8a6 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:18.611667 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7a795a66-f881-4e3c-9dca-c424fb17a8a6 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:18.613404 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7a795a66-f881-4e3c-9dca-c424fb17a8a6 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:18.614165 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7a795a66-f881-4e3c-9dca-c424fb17a8a6 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:18.615388 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7a795a66-f881-4e3c-9dca-c424fb17a8a6 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:18.621366 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7a795a66-f881-4e3c-9dca-c424fb17a8a6 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:18.892442 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-5c229592-74ca-421e-9232-0b916c68680b tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6684f0c87e4242be9e0ffb4ef1973f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0582ace9e4443b8ad88915503ee630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:18.908479 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-5c229592-74ca-421e-9232-0b916c68680b tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "GET /compute/v2.1/servers/a8ed4840-07d6-4506-a0ef-b686a6231fb7" status: 200 len: 1516 microversion: 2.1 time: 0.387562 Aug 10 23:21:18.909612 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2390/4986] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:21:18 2022] GET /compute/v2.1/servers/a8ed4840-07d6-4506-a0ef-b686a6231fb7 => generated 1516 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:21:18.920243 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c7ca527e-f846-4d14-818b-4a9fe81253b8 tempest-TestSecurityGroupsBasicOps-584807937 tempest-TestSecurityGroupsBasicOps-584807937-project-admin] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:18.921659 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-c7ca527e-f846-4d14-818b-4a9fe81253b8 tempest-TestSecurityGroupsBasicOps-584807937 tempest-TestSecurityGroupsBasicOps-584807937-project-admin] [instance: ee6a796b-efa5-4c73-8776-d86b54ca2190] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:18.931188 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-7a795a66-f881-4e3c-9dca-c424fb17a8a6 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d89081084f14e0187f4c67cd9185fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b557edd165144c8943eb9acc339a377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:18.939886 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c7ca527e-f846-4d14-818b-4a9fe81253b8 tempest-TestSecurityGroupsBasicOps-584807937 tempest-TestSecurityGroupsBasicOps-584807937-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:18.940115 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c7ca527e-f846-4d14-818b-4a9fe81253b8 tempest-TestSecurityGroupsBasicOps-584807937 tempest-TestSecurityGroupsBasicOps-584807937-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:18.940531 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c7ca527e-f846-4d14-818b-4a9fe81253b8 tempest-TestSecurityGroupsBasicOps-584807937 tempest-TestSecurityGroupsBasicOps-584807937-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:18.941246 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c7ca527e-f846-4d14-818b-4a9fe81253b8 tempest-TestSecurityGroupsBasicOps-584807937 tempest-TestSecurityGroupsBasicOps-584807937-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:18.941699 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c7ca527e-f846-4d14-818b-4a9fe81253b8 tempest-TestSecurityGroupsBasicOps-584807937 tempest-TestSecurityGroupsBasicOps-584807937-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:18.942122 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c7ca527e-f846-4d14-818b-4a9fe81253b8 tempest-TestSecurityGroupsBasicOps-584807937 tempest-TestSecurityGroupsBasicOps-584807937-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:18.948167 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-7a795a66-f881-4e3c-9dca-c424fb17a8a6 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] 10.222.0.58 "GET /compute/v2.1/servers/440c3d30-e5c9-4093-9b7e-39e06d32d682" status: 200 len: 1368 microversion: 2.1 time: 0.364989 Aug 10 23:21:18.949478 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2597/4987] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:21:18 2022] GET /compute/v2.1/servers/440c3d30-e5c9-4093-9b7e-39e06d32d682 => generated 1368 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:21:19.147060 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-17828d34-9cae-4968-b660-09822cfd9644 tempest-VolumesSnapshotsTestJSON-567793322 tempest-VolumesSnapshotsTestJSON-567793322-project] Calling method '.version_select at 0x7f847d298f70>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:19.201534 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-17828d34-9cae-4968-b660-09822cfd9644 tempest-VolumesSnapshotsTestJSON-567793322 tempest-VolumesSnapshotsTestJSON-567793322-project] HTTP exception thrown: Snapshot 4f4f582d-9fe5-487e-bc18-9dec8b978917 could not be found. Aug 10 23:21:19.213331 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-17828d34-9cae-4968-b660-09822cfd9644 tempest-VolumesSnapshotsTestJSON-567793322 tempest-VolumesSnapshotsTestJSON-567793322-project] Request method failure captured: Aug 10 23:21:19.213331 n-d-850468-14 devstack@n-api.service[122633]: request: GET /compute/v2.1/os-snapshots/4f4f582d-9fe5-487e-bc18-9dec8b978917 HTTP/1.1 Aug 10 23:21:19.213331 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:21:19.213331 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:21:19.213331 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:21:19.213331 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:21:19.213331 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:21:19.213331 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:21:19.213331 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:21:19.213331 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:21:19.213331 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9D1j8URCG0SzpeXfwyxcBDYqDrcf8Cv15sWbqwKVxG0CMO_kfh6dN7y2oKYLZKi4RpzlkookOgi3x4TZN5HhR21SADjHa47QpR5CH1KE64MAA-7s8ucn-bk1pUEhpesoZdm52k6DIH7wT2BfhOF6tn1nD4cTenmEPFZKX_QjriYsr2I Aug 10 23:21:19.213331 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:21:19.213331 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:21:19.213331 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:21:19.213331 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:21:19.213331 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:21:19.213331 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:21:19.213331 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: bd84e9fa3f814289b4cb7460a0441675 Aug 10 23:21:19.213331 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-567793322 Aug 10 23:21:19.213331 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:21:19.213331 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:21:19.213331 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/bd84e9fa3f814289b4cb7460a0441675"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/bd84e9fa3f814289b4cb7460a0441675"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/bd84e9fa3f814289b4cb7460a0441675"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_bd84e9fa3f814289b4cb7460a0441675", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:21:19.213331 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-VolumesSnapshotsTestJSON-567793322 Aug 10 23:21:19.213331 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: bd84e9fa3f814289b4cb7460a0441675 Aug 10 23:21:19.213331 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-567793322 Aug 10 23:21:19.213331 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-VolumesSnapshotsTestJSON-567793322-project Aug 10 23:21:19.213331 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:21:19.213331 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:21:19.213331 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 7683ade2b8a74114941c58bc2229228e Aug 10 23:21:19.213331 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-VolumesSnapshotsTestJSON-567793322-project Aug 10 23:21:19.213331 n-d-850468-14 devstack@n-api.service[122633]: method: Aug 10 23:21:19.213331 n-d-850468-14 devstack@n-api.service[122633]: exception: Snapshot 4f4f582d-9fe5-487e-bc18-9dec8b978917 could not be found. Aug 10 23:21:19.213331 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': '4f4f582d-9fe5-487e-bc18-9dec8b978917'} Aug 10 23:21:19.213331 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:21:19.213331 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:21:19.213331 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 10 23:21:19.213331 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 10 23:21:19.213331 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 10 23:21:19.213331 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 10 23:21:19.213331 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 10 23:21:19.213331 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 10 23:21:19.213331 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 10 23:21:19.213331 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 10 23:21:19.213331 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 10 23:21:19.213331 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 10 23:21:19.213331 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 23:21:19.213331 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 23:21:19.213331 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 23:21:19.213331 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 23:21:19.213331 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 4f4f582d-9fe5-487e-bc18-9dec8b978917 could not be found. (HTTP 404) (Request-ID: req-2c1c564c-8321-4c64-80ce-8c3ba45966a5) Aug 10 23:21:19.213331 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:21:19.213331 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:21:19.213331 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:21:19.213331 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:21:19.213331 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 10 23:21:19.213331 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 10 23:21:19.213331 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 10 23:21:19.213331 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 10 23:21:19.213331 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 10 23:21:19.213331 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 10 23:21:19.213331 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 10 23:21:19.213331 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 10 23:21:19.218337 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 10 23:21:19.218337 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 10 23:21:19.218337 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 10 23:21:19.218337 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 10 23:21:19.218337 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 10 23:21:19.218337 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 10 23:21:19.218337 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 10 23:21:19.218337 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 10 23:21:19.218337 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 10 23:21:19.218337 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 10 23:21:19.218337 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 23:21:19.218337 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 23:21:19.218337 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 23:21:19.218337 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 23:21:19.218337 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 4f4f582d-9fe5-487e-bc18-9dec8b978917 could not be found. Aug 10 23:21:19.218337 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:21:19.218337 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:21:19.218337 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:21:19.218337 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:21:19.218337 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:21:19.218337 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:21:19.218337 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:21:19.218337 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:21:19.218337 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 23:21:19.218337 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 23:21:19.218337 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:21:19.218337 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:21:19.218337 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 10 23:21:19.218337 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:21:19.218337 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 4f4f582d-9fe5-487e-bc18-9dec8b978917 could not be found. Aug 10 23:21:19.218337 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:21:19.218337 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:21:19.218337 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:21:19.218337 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:21:19.218337 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:21:19.218337 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:21:19.218337 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:21:19.218337 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:21:19.218337 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 4f4f582d-9fe5-487e-bc18-9dec8b978917 could not be found. Aug 10 23:21:19.218337 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:21:19.226365 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:21:19.226916 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-17828d34-9cae-4968-b660-09822cfd9644 tempest-VolumesSnapshotsTestJSON-567793322 tempest-VolumesSnapshotsTestJSON-567793322-project] Returning 404 to user: Snapshot 4f4f582d-9fe5-487e-bc18-9dec8b978917 could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:21:19.226916 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-17828d34-9cae-4968-b660-09822cfd9644 tempest-VolumesSnapshotsTestJSON-567793322 tempest-VolumesSnapshotsTestJSON-567793322-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/4f4f582d-9fe5-487e-bc18-9dec8b978917" status: 404 len: 111 microversion: 2.1 time: 0.088732 Aug 10 23:21:19.229028 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2598/4988] 10.222.0.58 () {58 vars in 1251 bytes} [Wed Aug 10 23:21:19 2022] GET /compute/v2.1/os-snapshots/4f4f582d-9fe5-487e-bc18-9dec8b978917 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:21:19.231163 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-c7ca527e-f846-4d14-818b-4a9fe81253b8 tempest-TestSecurityGroupsBasicOps-584807937 tempest-TestSecurityGroupsBasicOps-584807937-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/ee6a796b-efa5-4c73-8776-d86b54ca2190" status: 200 len: 1913 microversion: 2.1 time: 0.319226 Aug 10 23:21:19.238818 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-1f378826-15b7-4eb5-a745-e8123385935c tempest-VolumesSnapshotsTestJSON-567793322 tempest-VolumesSnapshotsTestJSON-567793322-project] Calling method '.version_select at 0x7f847d3860d0>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:19.247302 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2391/4989] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:21:18 2022] GET /compute/v2.1/servers/ee6a796b-efa5-4c73-8776-d86b54ca2190 => generated 1913 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:21:19.352123 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-6ee1ad5d-72be-4f6f-8b8f-38cfc1faffa3 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:19.352614 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-6ee1ad5d-72be-4f6f-8b8f-38cfc1faffa3 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] [instance: 076fa162-4b4f-4246-aa95-02525f01e4a7] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:19.374356 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6ee1ad5d-72be-4f6f-8b8f-38cfc1faffa3 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:19.374925 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6ee1ad5d-72be-4f6f-8b8f-38cfc1faffa3 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:19.376088 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6ee1ad5d-72be-4f6f-8b8f-38cfc1faffa3 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:19.377726 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6ee1ad5d-72be-4f6f-8b8f-38cfc1faffa3 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:19.378491 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6ee1ad5d-72be-4f6f-8b8f-38cfc1faffa3 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:19.379362 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6ee1ad5d-72be-4f6f-8b8f-38cfc1faffa3 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:19.413622 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-1f378826-15b7-4eb5-a745-e8123385935c tempest-VolumesSnapshotsTestJSON-567793322 tempest-VolumesSnapshotsTestJSON-567793322-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/2aeeb410-cbc4-4a41-a0cb-44630bc5a835" status: 202 len: 0 microversion: 2.1 time: 0.182065 Aug 10 23:21:19.415081 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2599/4990] 10.222.0.58 () {58 vars in 1248 bytes} [Wed Aug 10 23:21:19 2022] DELETE /compute/v2.1/os-volumes/2aeeb410-cbc4-4a41-a0cb-44630bc5a835 => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:21:19.428472 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-d7316a88-8fff-45dc-879d-c5debba4a3ba tempest-VolumesSnapshotsTestJSON-567793322 tempest-VolumesSnapshotsTestJSON-567793322-project] Calling method '.version_select at 0x7f847d2c3d30>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:19.438243 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-6ee1ad5d-72be-4f6f-8b8f-38cfc1faffa3 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] [instance: 076fa162-4b4f-4246-aa95-02525f01e4a7] Going to try to terminate instance {{(pid=122632) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:21:19.568596 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-d7316a88-8fff-45dc-879d-c5debba4a3ba tempest-VolumesSnapshotsTestJSON-567793322 tempest-VolumesSnapshotsTestJSON-567793322-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/2aeeb410-cbc4-4a41-a0cb-44630bc5a835" status: 200 len: 344 microversion: 2.1 time: 0.148221 Aug 10 23:21:19.570142 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2600/4991] 10.222.0.58 () {58 vars in 1245 bytes} [Wed Aug 10 23:21:19 2022] GET /compute/v2.1/os-volumes/2aeeb410-cbc4-4a41-a0cb-44630bc5a835 => generated 344 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:21:19.575227 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-e79c58a7-aca2-467a-b5e2-d241c02e42b2 req-861e6d08-0d07-4fba-91f3-da657ec3cfa4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "440c3d30-e5c9-4093-9b7e-39e06d32d682", "tag": "56eb709a-f823-4e09-86fa-42e4d98f2bb3"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:21:19.587655 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-e79c58a7-aca2-467a-b5e2-d241c02e42b2 req-861e6d08-0d07-4fba-91f3-da657ec3cfa4 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:19.588441 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-e79c58a7-aca2-467a-b5e2-d241c02e42b2 req-861e6d08-0d07-4fba-91f3-da657ec3cfa4 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:19.589131 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-e79c58a7-aca2-467a-b5e2-d241c02e42b2 req-861e6d08-0d07-4fba-91f3-da657ec3cfa4 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:19.623724 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-e79c58a7-aca2-467a-b5e2-d241c02e42b2 req-861e6d08-0d07-4fba-91f3-da657ec3cfa4 service nova] Creating event network-changed:56eb709a-f823-4e09-86fa-42e4d98f2bb3 for instance 440c3d30-e5c9-4093-9b7e-39e06d32d682 on n-h2-850468-14 Aug 10 23:21:19.633687 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-6ee1ad5d-72be-4f6f-8b8f-38cfc1faffa3 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] 10.222.0.58 "DELETE /compute/v2.1/servers/076fa162-4b4f-4246-aa95-02525f01e4a7" status: 204 len: 0 microversion: 2.1 time: 0.285502 Aug 10 23:21:19.640539 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-e79c58a7-aca2-467a-b5e2-d241c02e42b2 req-861e6d08-0d07-4fba-91f3-da657ec3cfa4 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063989 Aug 10 23:21:19.642090 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2392/4992] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:21:19 2022] DELETE /compute/v2.1/servers/076fa162-4b4f-4246-aa95-02525f01e4a7 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 10 23:21:19.648378 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2601/4993] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:21:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:21:19.649554 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-503af531-bb1e-4669-aa44-b5ea0a200069 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:19.650713 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-503af531-bb1e-4669-aa44-b5ea0a200069 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] [instance: 076fa162-4b4f-4246-aa95-02525f01e4a7] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:19.661501 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-503af531-bb1e-4669-aa44-b5ea0a200069 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:19.662862 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-503af531-bb1e-4669-aa44-b5ea0a200069 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:19.663480 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-503af531-bb1e-4669-aa44-b5ea0a200069 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:19.664368 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-503af531-bb1e-4669-aa44-b5ea0a200069 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:19.665423 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-503af531-bb1e-4669-aa44-b5ea0a200069 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:19.666377 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-503af531-bb1e-4669-aa44-b5ea0a200069 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:19.929507 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-503af531-bb1e-4669-aa44-b5ea0a200069 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '627b163f1a0e4fdeb0e9692e7d37460d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb5f5856c46490ab1ded572d693c4cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:19.933304 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-be1be85c-7ebc-4fe2-ba95-6468ee60df07 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:19.934093 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-be1be85c-7ebc-4fe2-ba95-6468ee60df07 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: a8ed4840-07d6-4506-a0ef-b686a6231fb7] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:19.943271 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-503af531-bb1e-4669-aa44-b5ea0a200069 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] 10.222.0.58 "GET /compute/v2.1/servers/076fa162-4b4f-4246-aa95-02525f01e4a7" status: 200 len: 1477 microversion: 2.1 time: 0.298965 Aug 10 23:21:19.958230 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-be1be85c-7ebc-4fe2-ba95-6468ee60df07 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:19.958230 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-be1be85c-7ebc-4fe2-ba95-6468ee60df07 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:19.958230 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-be1be85c-7ebc-4fe2-ba95-6468ee60df07 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:19.958230 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-be1be85c-7ebc-4fe2-ba95-6468ee60df07 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:19.958762 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-be1be85c-7ebc-4fe2-ba95-6468ee60df07 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:19.958914 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-be1be85c-7ebc-4fe2-ba95-6468ee60df07 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:19.959662 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2393/4994] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:21:19 2022] GET /compute/v2.1/servers/076fa162-4b4f-4246-aa95-02525f01e4a7 => generated 1477 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:21:19.978531 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-56bf155e-aeb9-478c-a4ad-349e1fe4c9c1 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:19.995353 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-56bf155e-aeb9-478c-a4ad-349e1fe4c9c1 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] [instance: 440c3d30-e5c9-4093-9b7e-39e06d32d682] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:20.028446 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-56bf155e-aeb9-478c-a4ad-349e1fe4c9c1 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:20.028945 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-56bf155e-aeb9-478c-a4ad-349e1fe4c9c1 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:20.029411 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-56bf155e-aeb9-478c-a4ad-349e1fe4c9c1 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:20.035607 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-56bf155e-aeb9-478c-a4ad-349e1fe4c9c1 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:20.039295 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-56bf155e-aeb9-478c-a4ad-349e1fe4c9c1 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:20.043728 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-56bf155e-aeb9-478c-a4ad-349e1fe4c9c1 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:20.056706 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=100 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:21:20.386042 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-56bf155e-aeb9-478c-a4ad-349e1fe4c9c1 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d89081084f14e0187f4c67cd9185fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b557edd165144c8943eb9acc339a377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:20.395072 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-56bf155e-aeb9-478c-a4ad-349e1fe4c9c1 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] 10.222.0.58 "GET /compute/v2.1/servers/440c3d30-e5c9-4093-9b7e-39e06d32d682" status: 200 len: 1368 microversion: 2.1 time: 0.421524 Aug 10 23:21:20.411289 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2394/4995] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:21:19 2022] GET /compute/v2.1/servers/440c3d30-e5c9-4093-9b7e-39e06d32d682 => generated 1368 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:21:20.584276 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c2ce07cf-18da-4a27-9c5f-5afe99cb8606 tempest-VolumesSnapshotsTestJSON-567793322 tempest-VolumesSnapshotsTestJSON-567793322-project] Calling method '.version_select at 0x7f84823ae8b0>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:20.606349 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-be1be85c-7ebc-4fe2-ba95-6468ee60df07 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6684f0c87e4242be9e0ffb4ef1973f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0582ace9e4443b8ad88915503ee630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:20.617836 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-be1be85c-7ebc-4fe2-ba95-6468ee60df07 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "GET /compute/v2.1/servers/a8ed4840-07d6-4506-a0ef-b686a6231fb7" status: 200 len: 1516 microversion: 2.1 time: 0.690688 Aug 10 23:21:20.621850 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2602/4996] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:21:19 2022] GET /compute/v2.1/servers/a8ed4840-07d6-4506-a0ef-b686a6231fb7 => generated 1516 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:21:20.739146 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-c2ce07cf-18da-4a27-9c5f-5afe99cb8606 tempest-VolumesSnapshotsTestJSON-567793322 tempest-VolumesSnapshotsTestJSON-567793322-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/2aeeb410-cbc4-4a41-a0cb-44630bc5a835" status: 200 len: 344 microversion: 2.1 time: 0.158960 Aug 10 23:21:20.755055 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2395/4997] 10.222.0.58 () {58 vars in 1245 bytes} [Wed Aug 10 23:21:20 2022] GET /compute/v2.1/os-volumes/2aeeb410-cbc4-4a41-a0cb-44630bc5a835 => generated 344 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 23:21:20.969222 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-d53e925a-75b2-4dda-9ad1-3ff1fae745cd tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:20.971195 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-d53e925a-75b2-4dda-9ad1-3ff1fae745cd tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] [instance: 076fa162-4b4f-4246-aa95-02525f01e4a7] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:20.978924 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:21:20.994610 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d53e925a-75b2-4dda-9ad1-3ff1fae745cd tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:20.995144 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d53e925a-75b2-4dda-9ad1-3ff1fae745cd tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:20.995681 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d53e925a-75b2-4dda-9ad1-3ff1fae745cd tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:21.005280 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d53e925a-75b2-4dda-9ad1-3ff1fae745cd tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:21.006100 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d53e925a-75b2-4dda-9ad1-3ff1fae745cd tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:21.007646 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d53e925a-75b2-4dda-9ad1-3ff1fae745cd tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:21.413300 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=2 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:21:21.414814 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=5 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:21:21.421039 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c3731597-2b95-45bf-9166-6aeaddf72a64 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:21.421829 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-c3731597-2b95-45bf-9166-6aeaddf72a64 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] [instance: 440c3d30-e5c9-4093-9b7e-39e06d32d682] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:21.452175 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c3731597-2b95-45bf-9166-6aeaddf72a64 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:21.456588 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c3731597-2b95-45bf-9166-6aeaddf72a64 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:21.460421 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c3731597-2b95-45bf-9166-6aeaddf72a64 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:21.466660 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c3731597-2b95-45bf-9166-6aeaddf72a64 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:21.467260 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c3731597-2b95-45bf-9166-6aeaddf72a64 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:21.467720 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c3731597-2b95-45bf-9166-6aeaddf72a64 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:21.604892 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=12 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:21:21.824196 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-c3731597-2b95-45bf-9166-6aeaddf72a64 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d89081084f14e0187f4c67cd9185fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b557edd165144c8943eb9acc339a377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:21.834964 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-c3731597-2b95-45bf-9166-6aeaddf72a64 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] 10.222.0.58 "GET /compute/v2.1/servers/440c3d30-e5c9-4093-9b7e-39e06d32d682" status: 200 len: 1368 microversion: 2.1 time: 0.422415 Aug 10 23:21:21.836206 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2396/4998] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:21:21 2022] GET /compute/v2.1/servers/440c3d30-e5c9-4093-9b7e-39e06d32d682 => generated 1368 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:21:21.841778 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-5ddc6d06-c9ea-48c4-b281-88b86ac7f0c5 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:21.842693 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-5ddc6d06-c9ea-48c4-b281-88b86ac7f0c5 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: a8ed4840-07d6-4506-a0ef-b686a6231fb7] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:21.852857 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5ddc6d06-c9ea-48c4-b281-88b86ac7f0c5 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:21.853557 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5ddc6d06-c9ea-48c4-b281-88b86ac7f0c5 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:21.854088 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5ddc6d06-c9ea-48c4-b281-88b86ac7f0c5 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:21.856083 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5ddc6d06-c9ea-48c4-b281-88b86ac7f0c5 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:21.857909 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5ddc6d06-c9ea-48c4-b281-88b86ac7f0c5 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:21.858444 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5ddc6d06-c9ea-48c4-b281-88b86ac7f0c5 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:21.912995 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5ddc6d06-c9ea-48c4-b281-88b86ac7f0c5 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:21.913194 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5ddc6d06-c9ea-48c4-b281-88b86ac7f0c5 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:21.913820 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5ddc6d06-c9ea-48c4-b281-88b86ac7f0c5 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:21.914504 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.objects.instance [None req-5ddc6d06-c9ea-48c4-b281-88b86ac7f0c5 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lazy-loading 'fault' on Instance uuid a8ed4840-07d6-4506-a0ef-b686a6231fb7 {{(pid=122632) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:21:21.919449 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-d53e925a-75b2-4dda-9ad1-3ff1fae745cd tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '627b163f1a0e4fdeb0e9692e7d37460d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb5f5856c46490ab1ded572d693c4cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:21.940776 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-d53e925a-75b2-4dda-9ad1-3ff1fae745cd tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] 10.222.0.58 "GET /compute/v2.1/servers/076fa162-4b4f-4246-aa95-02525f01e4a7" status: 200 len: 1477 microversion: 2.1 time: 0.979281 Aug 10 23:21:21.951221 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2603/4999] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:21:20 2022] GET /compute/v2.1/servers/076fa162-4b4f-4246-aa95-02525f01e4a7 => generated 1477 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:21:21.961474 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-c061839d-fab2-4ba2-ab5c-affd3eff656f req-cfee33dc-79f0-48a1-84d1-865122ce2e74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8ed4840-07d6-4506-a0ef-b686a6231fb7", "name": "network-vif-deleted", "tag": "d7d0f217-6cf8-4a40-82d9-fe0df4b342bc"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:21:21.986352 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-c061839d-fab2-4ba2-ab5c-affd3eff656f req-cfee33dc-79f0-48a1-84d1-865122ce2e74 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:21.988113 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-5ddc6d06-c9ea-48c4-b281-88b86ac7f0c5 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6684f0c87e4242be9e0ffb4ef1973f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0582ace9e4443b8ad88915503ee630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:21.988514 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-c061839d-fab2-4ba2-ab5c-affd3eff656f req-cfee33dc-79f0-48a1-84d1-865122ce2e74 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:21.989171 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-c061839d-fab2-4ba2-ab5c-affd3eff656f req-cfee33dc-79f0-48a1-84d1-865122ce2e74 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:22.003183 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-5ddc6d06-c9ea-48c4-b281-88b86ac7f0c5 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "GET /compute/v2.1/servers/a8ed4840-07d6-4506-a0ef-b686a6231fb7" status: 200 len: 1320 microversion: 2.1 time: 0.165400 Aug 10 23:21:22.004445 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2397/5000] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:21:21 2022] GET /compute/v2.1/servers/a8ed4840-07d6-4506-a0ef-b686a6231fb7 => generated 1320 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:21:22.011688 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-1687e3dc-85d3-41ad-8edc-bf415584036c tempest-VolumesSnapshotsTestJSON-567793322 tempest-VolumesSnapshotsTestJSON-567793322-project] Calling method '.version_select at 0x7f847c97e700>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:22.030961 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-c061839d-fab2-4ba2-ab5c-affd3eff656f req-cfee33dc-79f0-48a1-84d1-865122ce2e74 service nova] Creating event network-vif-deleted:d7d0f217-6cf8-4a40-82d9-fe0df4b342bc for instance a8ed4840-07d6-4506-a0ef-b686a6231fb7 on n-h1-850468-14 Aug 10 23:21:22.037692 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-c061839d-fab2-4ba2-ab5c-affd3eff656f req-cfee33dc-79f0-48a1-84d1-865122ce2e74 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085128 Aug 10 23:21:22.043320 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2604/5001] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:21:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:21:22.086666 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-1687e3dc-85d3-41ad-8edc-bf415584036c tempest-VolumesSnapshotsTestJSON-567793322 tempest-VolumesSnapshotsTestJSON-567793322-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/2aeeb410-cbc4-4a41-a0cb-44630bc5a835" status: 200 len: 344 microversion: 2.1 time: 0.081005 Aug 10 23:21:22.090837 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2398/5002] 10.222.0.58 () {58 vars in 1245 bytes} [Wed Aug 10 23:21:22 2022] GET /compute/v2.1/os-volumes/2aeeb410-cbc4-4a41-a0cb-44630bc5a835 => generated 344 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:21:22.864905 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-fa20020b-da47-4320-befa-50f40c2d3b91 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:22.866157 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-fa20020b-da47-4320-befa-50f40c2d3b91 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] [instance: 440c3d30-e5c9-4093-9b7e-39e06d32d682] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:22.875805 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fa20020b-da47-4320-befa-50f40c2d3b91 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:22.877205 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fa20020b-da47-4320-befa-50f40c2d3b91 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:22.877957 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fa20020b-da47-4320-befa-50f40c2d3b91 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:22.879129 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fa20020b-da47-4320-befa-50f40c2d3b91 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:22.879825 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fa20020b-da47-4320-befa-50f40c2d3b91 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:22.880576 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fa20020b-da47-4320-befa-50f40c2d3b91 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:22.972149 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-6e61b69c-a970-4a4a-8ddb-4d8a55b61624 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:22.973803 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-6e61b69c-a970-4a4a-8ddb-4d8a55b61624 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] [instance: 076fa162-4b4f-4246-aa95-02525f01e4a7] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:22.990365 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6e61b69c-a970-4a4a-8ddb-4d8a55b61624 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:22.991186 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6e61b69c-a970-4a4a-8ddb-4d8a55b61624 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:22.991750 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6e61b69c-a970-4a4a-8ddb-4d8a55b61624 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:22.992842 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6e61b69c-a970-4a4a-8ddb-4d8a55b61624 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:22.993404 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6e61b69c-a970-4a4a-8ddb-4d8a55b61624 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:22.993918 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6e61b69c-a970-4a4a-8ddb-4d8a55b61624 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:23.121117 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-6e61b69c-a970-4a4a-8ddb-4d8a55b61624 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '627b163f1a0e4fdeb0e9692e7d37460d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb5f5856c46490ab1ded572d693c4cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:23.131112 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-6e61b69c-a970-4a4a-8ddb-4d8a55b61624 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] 10.222.0.58 "GET /compute/v2.1/servers/076fa162-4b4f-4246-aa95-02525f01e4a7" status: 200 len: 1477 microversion: 2.1 time: 0.168916 Aug 10 23:21:23.147086 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2399/5003] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:21:22 2022] GET /compute/v2.1/servers/076fa162-4b4f-4246-aa95-02525f01e4a7 => generated 1477 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:21:23.156305 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-fa20020b-da47-4320-befa-50f40c2d3b91 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d89081084f14e0187f4c67cd9185fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b557edd165144c8943eb9acc339a377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:23.162618 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-eaab6de2-6bde-4440-8867-c70e1b02c67e tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:23.167813 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-fa20020b-da47-4320-befa-50f40c2d3b91 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] 10.222.0.58 "GET /compute/v2.1/servers/440c3d30-e5c9-4093-9b7e-39e06d32d682" status: 200 len: 1368 microversion: 2.1 time: 0.312843 Aug 10 23:21:23.168862 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-eaab6de2-6bde-4440-8867-c70e1b02c67e tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: a8ed4840-07d6-4506-a0ef-b686a6231fb7] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:23.171751 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2605/5004] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:21:22 2022] GET /compute/v2.1/servers/440c3d30-e5c9-4093-9b7e-39e06d32d682 => generated 1368 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:21:23.184614 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-17409ae0-5590-4dc1-9093-f0098e311f72 tempest-VolumesSnapshotsTestJSON-567793322 tempest-VolumesSnapshotsTestJSON-567793322-project] Calling method '.version_select at 0x7f847cf50790>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:23.194008 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-eaab6de2-6bde-4440-8867-c70e1b02c67e tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:23.194507 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-eaab6de2-6bde-4440-8867-c70e1b02c67e tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:23.194974 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-eaab6de2-6bde-4440-8867-c70e1b02c67e tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:23.196063 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-eaab6de2-6bde-4440-8867-c70e1b02c67e tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:23.196896 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-eaab6de2-6bde-4440-8867-c70e1b02c67e tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:23.198488 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-eaab6de2-6bde-4440-8867-c70e1b02c67e tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:23.215533 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-eaab6de2-6bde-4440-8867-c70e1b02c67e tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] HTTP exception thrown: Instance a8ed4840-07d6-4506-a0ef-b686a6231fb7 could not be found. Aug 10 23:21:23.217706 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-eaab6de2-6bde-4440-8867-c70e1b02c67e tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Request method failure captured: Aug 10 23:21:23.217706 n-d-850468-14 devstack@n-api.service[122632]: request: GET /compute/v2.1/servers/a8ed4840-07d6-4506-a0ef-b686a6231fb7 HTTP/1.1 Aug 10 23:21:23.217706 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:21:23.217706 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:21:23.217706 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:21:23.217706 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 23:21:23.217706 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:21:23.217706 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:21:23.217706 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:21:23.217706 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:21:23.217706 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9DytBT8uIivFlHEw3ugwW3-_1ks70Fcm-KUdUfNf3hiFdhb5xvDC9LI4u79J0X-frOTrhG-DWWR1w8a7yZU35-jGfQgN97QRTSA7hDEW06netEOKzarBlr77OO9sCeT3s5ektFA7vCYLl4122WPKHg-MSXQY0g9YmL291Ic7yNjWLnQ Aug 10 23:21:23.217706 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:21:23.217706 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:21:23.217706 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:21:23.217706 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:21:23.217706 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:21:23.217706 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:21:23.217706 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 0b0582ace9e4443b8ad88915503ee630 Aug 10 23:21:23.217706 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-ServersTestJSON-516662906 Aug 10 23:21:23.217706 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:21:23.217706 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:21:23.217706 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0b0582ace9e4443b8ad88915503ee630"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0b0582ace9e4443b8ad88915503ee630"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/0b0582ace9e4443b8ad88915503ee630"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_0b0582ace9e4443b8ad88915503ee630", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:21:23.217706 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-ServersTestJSON-516662906 Aug 10 23:21:23.217706 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 0b0582ace9e4443b8ad88915503ee630 Aug 10 23:21:23.217706 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-ServersTestJSON-516662906 Aug 10 23:21:23.217706 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-ServersTestJSON-516662906-project Aug 10 23:21:23.217706 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:21:23.217706 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:21:23.217706 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: 6684f0c87e4242be9e0ffb4ef1973f96 Aug 10 23:21:23.217706 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-ServersTestJSON-516662906-project Aug 10 23:21:23.217706 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:21:23.217706 n-d-850468-14 devstack@n-api.service[122632]: exception: Instance a8ed4840-07d6-4506-a0ef-b686a6231fb7 could not be found. Aug 10 23:21:23.217706 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': 'a8ed4840-07d6-4506-a0ef-b686a6231fb7'} Aug 10 23:21:23.217706 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:21:23.217706 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:21:23.217706 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:21:23.217706 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:21:23.217706 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:21:23.217706 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:21:23.217706 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:21:23.217706 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:21:23.217706 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:21:23.217706 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:21:23.217706 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8ed4840-07d6-4506-a0ef-b686a6231fb7 could not be found. Aug 10 23:21:23.217706 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:21:23.217706 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:21:23.217706 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:21:23.217706 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:21:23.217706 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:21:23.217706 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:21:23.217706 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:21:23.217706 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:21:23.217706 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:21:23.217706 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:21:23.217706 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:21:23.217706 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:21:23.217706 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:21:23.217706 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:21:23.217706 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:21:23.217706 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:21:23.217706 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8ed4840-07d6-4506-a0ef-b686a6231fb7 could not be found. Aug 10 23:21:23.217706 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:21:23.217706 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:21:23.217706 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:21:23.217706 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:21:23.223128 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:21:23.223128 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:21:23.223128 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:21:23.223128 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:21:23.223128 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8ed4840-07d6-4506-a0ef-b686a6231fb7 could not be found. Aug 10 23:21:23.223128 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:21:23.225487 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-eaab6de2-6bde-4440-8867-c70e1b02c67e tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Returning 404 to user: Instance a8ed4840-07d6-4506-a0ef-b686a6231fb7 could not be found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:21:23.226597 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-eaab6de2-6bde-4440-8867-c70e1b02c67e tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "GET /compute/v2.1/servers/a8ed4840-07d6-4506-a0ef-b686a6231fb7" status: 404 len: 111 microversion: 2.1 time: 0.077930 Aug 10 23:21:23.227365 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-17409ae0-5590-4dc1-9093-f0098e311f72 tempest-VolumesSnapshotsTestJSON-567793322 tempest-VolumesSnapshotsTestJSON-567793322-project] HTTP exception thrown: Volume 2aeeb410-cbc4-4a41-a0cb-44630bc5a835 could not be found. Aug 10 23:21:23.227815 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2400/5005] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:21:23 2022] GET /compute/v2.1/servers/a8ed4840-07d6-4506-a0ef-b686a6231fb7 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:21:23.234625 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-17409ae0-5590-4dc1-9093-f0098e311f72 tempest-VolumesSnapshotsTestJSON-567793322 tempest-VolumesSnapshotsTestJSON-567793322-project] Request method failure captured: Aug 10 23:21:23.234625 n-d-850468-14 devstack@n-api.service[122633]: request: GET /compute/v2.1/os-volumes/2aeeb410-cbc4-4a41-a0cb-44630bc5a835 HTTP/1.1 Aug 10 23:21:23.234625 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:21:23.234625 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:21:23.234625 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:21:23.234625 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:21:23.234625 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:21:23.234625 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:21:23.234625 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:21:23.234625 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:21:23.234625 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9D1j8URCG0SzpeXfwyxcBDYqDrcf8Cv15sWbqwKVxG0CMO_kfh6dN7y2oKYLZKi4RpzlkookOgi3x4TZN5HhR21SADjHa47QpR5CH1KE64MAA-7s8ucn-bk1pUEhpesoZdm52k6DIH7wT2BfhOF6tn1nD4cTenmEPFZKX_QjriYsr2I Aug 10 23:21:23.234625 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:21:23.234625 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:21:23.234625 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:21:23.234625 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:21:23.234625 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:21:23.234625 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:21:23.234625 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: bd84e9fa3f814289b4cb7460a0441675 Aug 10 23:21:23.234625 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-567793322 Aug 10 23:21:23.234625 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:21:23.234625 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:21:23.234625 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/bd84e9fa3f814289b4cb7460a0441675"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/bd84e9fa3f814289b4cb7460a0441675"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/bd84e9fa3f814289b4cb7460a0441675"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_bd84e9fa3f814289b4cb7460a0441675", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:21:23.234625 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-VolumesSnapshotsTestJSON-567793322 Aug 10 23:21:23.234625 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: bd84e9fa3f814289b4cb7460a0441675 Aug 10 23:21:23.234625 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-567793322 Aug 10 23:21:23.234625 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-VolumesSnapshotsTestJSON-567793322-project Aug 10 23:21:23.234625 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:21:23.234625 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:21:23.234625 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 7683ade2b8a74114941c58bc2229228e Aug 10 23:21:23.234625 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-VolumesSnapshotsTestJSON-567793322-project Aug 10 23:21:23.234625 n-d-850468-14 devstack@n-api.service[122633]: method: Aug 10 23:21:23.234625 n-d-850468-14 devstack@n-api.service[122633]: exception: Volume 2aeeb410-cbc4-4a41-a0cb-44630bc5a835 could not be found. Aug 10 23:21:23.234625 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': '2aeeb410-cbc4-4a41-a0cb-44630bc5a835'} Aug 10 23:21:23.234625 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:21:23.234625 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:21:23.234625 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 23:21:23.234625 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 23:21:23.234625 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 10 23:21:23.234625 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 10 23:21:23.234625 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 10 23:21:23.234625 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 10 23:21:23.234625 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 10 23:21:23.234625 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 10 23:21:23.234625 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 10 23:21:23.234625 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 10 23:21:23.234625 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 23:21:23.234625 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 23:21:23.234625 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 23:21:23.234625 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 23:21:23.234625 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2aeeb410-cbc4-4a41-a0cb-44630bc5a835 could not be found. (HTTP 404) (Request-ID: req-d1a838a7-b9a4-421a-9596-d66525b03c6f) Aug 10 23:21:23.234625 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:21:23.234625 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:21:23.234625 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:21:23.234625 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:21:23.234625 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 10 23:21:23.234625 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 10 23:21:23.234625 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 10 23:21:23.234625 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 10 23:21:23.234625 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 10 23:21:23.234625 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 10 23:21:23.234625 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 10 23:21:23.234625 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 10 23:21:23.234625 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 23:21:23.241964 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 23:21:23.241964 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 10 23:21:23.241964 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 10 23:21:23.241964 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 10 23:21:23.241964 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 10 23:21:23.241964 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 10 23:21:23.241964 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 10 23:21:23.241964 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 10 23:21:23.241964 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 10 23:21:23.241964 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 23:21:23.241964 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 23:21:23.241964 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 23:21:23.241964 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 23:21:23.241964 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2aeeb410-cbc4-4a41-a0cb-44630bc5a835 could not be found. Aug 10 23:21:23.241964 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:21:23.241964 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:21:23.241964 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:21:23.241964 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:21:23.241964 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:21:23.241964 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:21:23.241964 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:21:23.241964 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:21:23.241964 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 23:21:23.241964 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 23:21:23.241964 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:21:23.241964 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:21:23.241964 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 10 23:21:23.241964 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:21:23.241964 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2aeeb410-cbc4-4a41-a0cb-44630bc5a835 could not be found. Aug 10 23:21:23.241964 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:21:23.241964 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:21:23.241964 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:21:23.241964 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:21:23.241964 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:21:23.241964 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:21:23.241964 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:21:23.241964 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:21:23.241964 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2aeeb410-cbc4-4a41-a0cb-44630bc5a835 could not be found. Aug 10 23:21:23.241964 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:21:23.241964 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-17409ae0-5590-4dc1-9093-f0098e311f72 tempest-VolumesSnapshotsTestJSON-567793322 tempest-VolumesSnapshotsTestJSON-567793322-project] Returning 404 to user: Volume 2aeeb410-cbc4-4a41-a0cb-44630bc5a835 could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:21:23.241964 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-17409ae0-5590-4dc1-9093-f0098e311f72 tempest-VolumesSnapshotsTestJSON-567793322 tempest-VolumesSnapshotsTestJSON-567793322-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/2aeeb410-cbc4-4a41-a0cb-44630bc5a835" status: 404 len: 109 microversion: 2.1 time: 0.057287 Aug 10 23:21:23.241964 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2606/5006] 10.222.0.58 () {58 vars in 1245 bytes} [Wed Aug 10 23:21:23 2022] GET /compute/v2.1/os-volumes/2aeeb410-cbc4-4a41-a0cb-44630bc5a835 => generated 109 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:21:23.256444 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c25396ca-0d89-452a-9d32-c80265c25b87 tempest-VolumesSnapshotsTestJSON-567793322 tempest-VolumesSnapshotsTestJSON-567793322-project] Calling method '.version_select at 0x7f847d978d30>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:23.292859 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-c25396ca-0d89-452a-9d32-c80265c25b87 tempest-VolumesSnapshotsTestJSON-567793322 tempest-VolumesSnapshotsTestJSON-567793322-project] HTTP exception thrown: Volume 2aeeb410-cbc4-4a41-a0cb-44630bc5a835 could not be found. Aug 10 23:21:23.294909 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c25396ca-0d89-452a-9d32-c80265c25b87 tempest-VolumesSnapshotsTestJSON-567793322 tempest-VolumesSnapshotsTestJSON-567793322-project] Request method failure captured: Aug 10 23:21:23.294909 n-d-850468-14 devstack@n-api.service[122632]: request: DELETE /compute/v2.1/os-volumes/2aeeb410-cbc4-4a41-a0cb-44630bc5a835 HTTP/1.1 Aug 10 23:21:23.294909 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:21:23.294909 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:21:23.294909 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:21:23.294909 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 23:21:23.294909 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:21:23.294909 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:21:23.294909 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:21:23.294909 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:21:23.294909 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9D1j8URCG0SzpeXfwyxcBDYqDrcf8Cv15sWbqwKVxG0CMO_kfh6dN7y2oKYLZKi4RpzlkookOgi3x4TZN5HhR21SADjHa47QpR5CH1KE64MAA-7s8ucn-bk1pUEhpesoZdm52k6DIH7wT2BfhOF6tn1nD4cTenmEPFZKX_QjriYsr2I Aug 10 23:21:23.294909 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:21:23.294909 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:21:23.294909 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:21:23.294909 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:21:23.294909 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:21:23.294909 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:21:23.294909 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: bd84e9fa3f814289b4cb7460a0441675 Aug 10 23:21:23.294909 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-567793322 Aug 10 23:21:23.294909 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:21:23.294909 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:21:23.294909 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/bd84e9fa3f814289b4cb7460a0441675"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/bd84e9fa3f814289b4cb7460a0441675"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/bd84e9fa3f814289b4cb7460a0441675"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_bd84e9fa3f814289b4cb7460a0441675", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:21:23.294909 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-VolumesSnapshotsTestJSON-567793322 Aug 10 23:21:23.294909 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: bd84e9fa3f814289b4cb7460a0441675 Aug 10 23:21:23.294909 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-567793322 Aug 10 23:21:23.294909 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-VolumesSnapshotsTestJSON-567793322-project Aug 10 23:21:23.294909 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:21:23.294909 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:21:23.294909 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: 7683ade2b8a74114941c58bc2229228e Aug 10 23:21:23.294909 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-VolumesSnapshotsTestJSON-567793322-project Aug 10 23:21:23.294909 n-d-850468-14 devstack@n-api.service[122632]: method: Aug 10 23:21:23.294909 n-d-850468-14 devstack@n-api.service[122632]: exception: Volume 2aeeb410-cbc4-4a41-a0cb-44630bc5a835 could not be found. Aug 10 23:21:23.294909 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': '2aeeb410-cbc4-4a41-a0cb-44630bc5a835'} Aug 10 23:21:23.294909 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:21:23.294909 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:21:23.294909 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 23:21:23.294909 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 23:21:23.294909 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 10 23:21:23.294909 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 10 23:21:23.294909 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 10 23:21:23.294909 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 10 23:21:23.294909 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 10 23:21:23.294909 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 10 23:21:23.294909 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 10 23:21:23.294909 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 10 23:21:23.294909 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 23:21:23.294909 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 23:21:23.294909 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 23:21:23.294909 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 23:21:23.294909 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2aeeb410-cbc4-4a41-a0cb-44630bc5a835 could not be found. (HTTP 404) (Request-ID: req-bfee8a36-be69-457f-a2f7-177742d1020d) Aug 10 23:21:23.294909 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:21:23.294909 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:21:23.294909 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:21:23.294909 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:21:23.294909 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 10 23:21:23.294909 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 10 23:21:23.294909 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 10 23:21:23.294909 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 10 23:21:23.294909 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 10 23:21:23.294909 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 10 23:21:23.294909 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 10 23:21:23.294909 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 10 23:21:23.294909 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 23:21:23.304597 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 23:21:23.304597 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 10 23:21:23.304597 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 10 23:21:23.304597 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 10 23:21:23.304597 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 10 23:21:23.304597 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 10 23:21:23.304597 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 10 23:21:23.304597 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 10 23:21:23.304597 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 10 23:21:23.304597 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 23:21:23.304597 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 23:21:23.304597 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 23:21:23.304597 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 23:21:23.304597 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2aeeb410-cbc4-4a41-a0cb-44630bc5a835 could not be found. Aug 10 23:21:23.304597 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:21:23.304597 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:21:23.304597 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:21:23.304597 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:21:23.304597 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:21:23.304597 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:21:23.304597 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:21:23.304597 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:21:23.304597 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 23:21:23.304597 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 23:21:23.304597 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:21:23.304597 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:21:23.304597 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 10 23:21:23.304597 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:21:23.304597 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2aeeb410-cbc4-4a41-a0cb-44630bc5a835 could not be found. Aug 10 23:21:23.304597 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:21:23.304597 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:21:23.304597 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:21:23.304597 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:21:23.304597 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:21:23.304597 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:21:23.304597 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:21:23.304597 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:21:23.304597 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2aeeb410-cbc4-4a41-a0cb-44630bc5a835 could not be found. Aug 10 23:21:23.304597 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:21:23.304597 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c25396ca-0d89-452a-9d32-c80265c25b87 tempest-VolumesSnapshotsTestJSON-567793322 tempest-VolumesSnapshotsTestJSON-567793322-project] Returning 404 to user: Volume 2aeeb410-cbc4-4a41-a0cb-44630bc5a835 could not be found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:21:23.304597 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-c25396ca-0d89-452a-9d32-c80265c25b87 tempest-VolumesSnapshotsTestJSON-567793322 tempest-VolumesSnapshotsTestJSON-567793322-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/2aeeb410-cbc4-4a41-a0cb-44630bc5a835" status: 404 len: 109 microversion: 2.1 time: 0.048347 Aug 10 23:21:23.304597 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2401/5007] 10.222.0.58 () {58 vars in 1248 bytes} [Wed Aug 10 23:21:23 2022] DELETE /compute/v2.1/os-volumes/2aeeb410-cbc4-4a41-a0cb-44630bc5a835 => generated 109 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:21:23.310490 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-fdd80cf3-ced5-4251-b08d-9fb7d1cb188b tempest-VolumesSnapshotsTestJSON-567793322 tempest-VolumesSnapshotsTestJSON-567793322-project] Calling method '.version_select at 0x7f847d44e160>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:23.350048 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-fdd80cf3-ced5-4251-b08d-9fb7d1cb188b tempest-VolumesSnapshotsTestJSON-567793322 tempest-VolumesSnapshotsTestJSON-567793322-project] HTTP exception thrown: Volume 2aeeb410-cbc4-4a41-a0cb-44630bc5a835 could not be found. Aug 10 23:21:23.355663 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-fdd80cf3-ced5-4251-b08d-9fb7d1cb188b tempest-VolumesSnapshotsTestJSON-567793322 tempest-VolumesSnapshotsTestJSON-567793322-project] Request method failure captured: Aug 10 23:21:23.355663 n-d-850468-14 devstack@n-api.service[122633]: request: GET /compute/v2.1/os-volumes/2aeeb410-cbc4-4a41-a0cb-44630bc5a835 HTTP/1.1 Aug 10 23:21:23.355663 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:21:23.355663 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:21:23.355663 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:21:23.355663 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:21:23.355663 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:21:23.355663 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:21:23.355663 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:21:23.355663 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:21:23.355663 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9D1j8URCG0SzpeXfwyxcBDYqDrcf8Cv15sWbqwKVxG0CMO_kfh6dN7y2oKYLZKi4RpzlkookOgi3x4TZN5HhR21SADjHa47QpR5CH1KE64MAA-7s8ucn-bk1pUEhpesoZdm52k6DIH7wT2BfhOF6tn1nD4cTenmEPFZKX_QjriYsr2I Aug 10 23:21:23.355663 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:21:23.355663 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:21:23.355663 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:21:23.355663 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:21:23.355663 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:21:23.355663 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:21:23.355663 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: bd84e9fa3f814289b4cb7460a0441675 Aug 10 23:21:23.355663 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-567793322 Aug 10 23:21:23.355663 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:21:23.355663 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:21:23.355663 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/bd84e9fa3f814289b4cb7460a0441675"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/bd84e9fa3f814289b4cb7460a0441675"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/bd84e9fa3f814289b4cb7460a0441675"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_bd84e9fa3f814289b4cb7460a0441675", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:21:23.355663 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-VolumesSnapshotsTestJSON-567793322 Aug 10 23:21:23.355663 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: bd84e9fa3f814289b4cb7460a0441675 Aug 10 23:21:23.355663 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-567793322 Aug 10 23:21:23.355663 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-VolumesSnapshotsTestJSON-567793322-project Aug 10 23:21:23.355663 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:21:23.355663 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:21:23.355663 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 7683ade2b8a74114941c58bc2229228e Aug 10 23:21:23.355663 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-VolumesSnapshotsTestJSON-567793322-project Aug 10 23:21:23.355663 n-d-850468-14 devstack@n-api.service[122633]: method: Aug 10 23:21:23.355663 n-d-850468-14 devstack@n-api.service[122633]: exception: Volume 2aeeb410-cbc4-4a41-a0cb-44630bc5a835 could not be found. Aug 10 23:21:23.355663 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': '2aeeb410-cbc4-4a41-a0cb-44630bc5a835'} Aug 10 23:21:23.355663 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:21:23.355663 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:21:23.355663 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 23:21:23.355663 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 23:21:23.355663 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 10 23:21:23.355663 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 10 23:21:23.355663 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 10 23:21:23.355663 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 10 23:21:23.355663 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 10 23:21:23.355663 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 10 23:21:23.355663 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 10 23:21:23.355663 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 10 23:21:23.355663 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 23:21:23.355663 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 23:21:23.355663 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 23:21:23.355663 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 23:21:23.355663 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2aeeb410-cbc4-4a41-a0cb-44630bc5a835 could not be found. (HTTP 404) (Request-ID: req-bc7027d9-776a-4bbe-a3de-c57b03a48e26) Aug 10 23:21:23.355663 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:21:23.355663 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:21:23.355663 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:21:23.355663 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:21:23.355663 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 10 23:21:23.355663 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 10 23:21:23.355663 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 10 23:21:23.355663 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 10 23:21:23.355663 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 10 23:21:23.355663 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 10 23:21:23.355663 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 10 23:21:23.355663 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 10 23:21:23.355663 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 10 23:21:23.361773 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 10 23:21:23.361773 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 10 23:21:23.361773 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 10 23:21:23.361773 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 10 23:21:23.361773 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 10 23:21:23.361773 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 10 23:21:23.361773 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 10 23:21:23.361773 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 10 23:21:23.361773 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 10 23:21:23.361773 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 10 23:21:23.361773 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 10 23:21:23.361773 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 10 23:21:23.361773 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 10 23:21:23.361773 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2aeeb410-cbc4-4a41-a0cb-44630bc5a835 could not be found. Aug 10 23:21:23.361773 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:21:23.361773 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:21:23.361773 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:21:23.361773 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:21:23.361773 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:21:23.361773 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:21:23.361773 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:21:23.361773 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:21:23.361773 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 10 23:21:23.361773 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 10 23:21:23.361773 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:21:23.361773 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:21:23.361773 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 10 23:21:23.361773 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:21:23.361773 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2aeeb410-cbc4-4a41-a0cb-44630bc5a835 could not be found. Aug 10 23:21:23.361773 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:21:23.361773 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:21:23.361773 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:21:23.361773 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:21:23.361773 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:21:23.361773 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:21:23.361773 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:21:23.361773 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:21:23.361773 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2aeeb410-cbc4-4a41-a0cb-44630bc5a835 could not be found. Aug 10 23:21:23.361773 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:21:23.361773 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-fdd80cf3-ced5-4251-b08d-9fb7d1cb188b tempest-VolumesSnapshotsTestJSON-567793322 tempest-VolumesSnapshotsTestJSON-567793322-project] Returning 404 to user: Volume 2aeeb410-cbc4-4a41-a0cb-44630bc5a835 could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:21:23.361773 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-fdd80cf3-ced5-4251-b08d-9fb7d1cb188b tempest-VolumesSnapshotsTestJSON-567793322 tempest-VolumesSnapshotsTestJSON-567793322-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/2aeeb410-cbc4-4a41-a0cb-44630bc5a835" status: 404 len: 109 microversion: 2.1 time: 0.054473 Aug 10 23:21:23.361773 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2607/5008] 10.222.0.58 () {58 vars in 1245 bytes} [Wed Aug 10 23:21:23 2022] GET /compute/v2.1/os-volumes/2aeeb410-cbc4-4a41-a0cb-44630bc5a835 => generated 109 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:21:23.513997 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-439b74ed-7723-4abb-9395-a00ade3bc8b1 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-721785566", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452", "networks": [{"uuid": "af9afbc6-0659-47e6-b542-cfe9f265fcc2"}]}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:21:23.602636 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.network.neutron [None req-439b74ed-7723-4abb-9395-a00ade3bc8b1 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] validate_networks() for [('af9afbc6-0659-47e6-b542-cfe9f265fcc2', None, None, None, None, None)] {{(pid=122632) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 23:21:24.160046 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-249720de-becf-40d3-8377-64e61b2b18f7 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:24.160673 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-249720de-becf-40d3-8377-64e61b2b18f7 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] [instance: 076fa162-4b4f-4246-aa95-02525f01e4a7] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:24.176586 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-249720de-becf-40d3-8377-64e61b2b18f7 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:24.177383 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-249720de-becf-40d3-8377-64e61b2b18f7 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:24.178008 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-249720de-becf-40d3-8377-64e61b2b18f7 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:24.191919 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-249720de-becf-40d3-8377-64e61b2b18f7 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:24.192672 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-249720de-becf-40d3-8377-64e61b2b18f7 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:24.193293 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-249720de-becf-40d3-8377-64e61b2b18f7 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:24.402068 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-439b74ed-7723-4abb-9395-a00ade3bc8b1 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Flavor limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:21:24.402908 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-439b74ed-7723-4abb-9395-a00ade3bc8b1 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Image limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:21:24.403400 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-439b74ed-7723-4abb-9395-a00ade3bc8b1 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Flavor pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:21:24.403998 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-439b74ed-7723-4abb-9395-a00ade3bc8b1 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Image pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:21:24.404412 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-439b74ed-7723-4abb-9395-a00ade3bc8b1 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:21:24.424310 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-439b74ed-7723-4abb-9395-a00ade3bc8b1 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:24.424799 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-439b74ed-7723-4abb-9395-a00ade3bc8b1 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:24.426234 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-439b74ed-7723-4abb-9395-a00ade3bc8b1 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:24.426912 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-439b74ed-7723-4abb-9395-a00ade3bc8b1 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:24.429676 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-439b74ed-7723-4abb-9395-a00ade3bc8b1 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:24.430297 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-439b74ed-7723-4abb-9395-a00ade3bc8b1 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:24.483813 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-439b74ed-7723-4abb-9395-a00ade3bc8b1 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Getting quotas for project 0b0582ace9e4443b8ad88915503ee630. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:21:24.504528 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-439b74ed-7723-4abb-9395-a00ade3bc8b1 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Getting quotas for user 6684f0c87e4242be9e0ffb4ef1973f96 and project 0b0582ace9e4443b8ad88915503ee630. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:21:24.537012 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-249720de-becf-40d3-8377-64e61b2b18f7 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '627b163f1a0e4fdeb0e9692e7d37460d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb5f5856c46490ab1ded572d693c4cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:24.547033 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-439b74ed-7723-4abb-9395-a00ade3bc8b1 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Going to run 1 instances... {{(pid=122632) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 23:21:24.548382 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-249720de-becf-40d3-8377-64e61b2b18f7 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] 10.222.0.58 "GET /compute/v2.1/servers/076fa162-4b4f-4246-aa95-02525f01e4a7" status: 200 len: 1477 microversion: 2.1 time: 0.400576 Aug 10 23:21:24.556182 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-439b74ed-7723-4abb-9395-a00ade3bc8b1 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: 0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78ad8905-f66f-4733-8be9-2b260f1fabed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122632) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 23:21:24.564699 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2608/5009] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:21:24 2022] GET /compute/v2.1/servers/076fa162-4b4f-4246-aa95-02525f01e4a7 => generated 1477 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:21:24.573445 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-1282ccf7-8100-49dc-a697-01ce7a4826b7 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:24.574713 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-1282ccf7-8100-49dc-a697-01ce7a4826b7 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] [instance: 440c3d30-e5c9-4093-9b7e-39e06d32d682] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:24.602508 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1282ccf7-8100-49dc-a697-01ce7a4826b7 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:24.603315 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1282ccf7-8100-49dc-a697-01ce7a4826b7 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:24.604021 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1282ccf7-8100-49dc-a697-01ce7a4826b7 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:24.606402 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1282ccf7-8100-49dc-a697-01ce7a4826b7 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:24.607157 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1282ccf7-8100-49dc-a697-01ce7a4826b7 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:24.608181 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1282ccf7-8100-49dc-a697-01ce7a4826b7 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:24.710062 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-439b74ed-7723-4abb-9395-a00ade3bc8b1 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.206178 Aug 10 23:21:24.710731 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2402/5010] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 23:21:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1209 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 23:21:24.728383 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-f486ac8c-2eea-4d04-b0e3-adf0c2f4826c req-fe3da52a-78d4-4e46-b2ed-f048ee3fd061 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "076fa162-4b4f-4246-aa95-02525f01e4a7", "name": "network-vif-deleted", "tag": "6849b263-5fec-4087-a5ee-f4b58a934628"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:21:24.751057 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-f486ac8c-2eea-4d04-b0e3-adf0c2f4826c req-fe3da52a-78d4-4e46-b2ed-f048ee3fd061 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:24.751404 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-f486ac8c-2eea-4d04-b0e3-adf0c2f4826c req-fe3da52a-78d4-4e46-b2ed-f048ee3fd061 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:24.751842 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-f486ac8c-2eea-4d04-b0e3-adf0c2f4826c req-fe3da52a-78d4-4e46-b2ed-f048ee3fd061 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:24.782595 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-f486ac8c-2eea-4d04-b0e3-adf0c2f4826c req-fe3da52a-78d4-4e46-b2ed-f048ee3fd061 service nova] Creating event network-vif-deleted:6849b263-5fec-4087-a5ee-f4b58a934628 for instance 076fa162-4b4f-4246-aa95-02525f01e4a7 on n-h1-850468-14 Aug 10 23:21:24.789387 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-f486ac8c-2eea-4d04-b0e3-adf0c2f4826c req-fe3da52a-78d4-4e46-b2ed-f048ee3fd061 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071945 Aug 10 23:21:24.794147 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2403/5011] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:21:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:21:24.807082 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-f74d9f8b-03b6-4abe-a7ab-5b212577a2d6 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:24.808105 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-f74d9f8b-03b6-4abe-a7ab-5b212577a2d6 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: 0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:24.915699 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-f74d9f8b-03b6-4abe-a7ab-5b212577a2d6 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6684f0c87e4242be9e0ffb4ef1973f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0582ace9e4443b8ad88915503ee630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:24.925005 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-f74d9f8b-03b6-4abe-a7ab-5b212577a2d6 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "GET /compute/v2.1/servers/0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d" status: 200 len: 1208 microversion: 2.1 time: 0.128587 Aug 10 23:21:24.926386 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2404/5012] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:21:24 2022] GET /compute/v2.1/servers/0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d => generated 1208 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:21:25.279233 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-1282ccf7-8100-49dc-a697-01ce7a4826b7 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d89081084f14e0187f4c67cd9185fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b557edd165144c8943eb9acc339a377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:25.299778 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-1282ccf7-8100-49dc-a697-01ce7a4826b7 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] 10.222.0.58 "GET /compute/v2.1/servers/440c3d30-e5c9-4093-9b7e-39e06d32d682" status: 200 len: 1368 microversion: 2.1 time: 0.732735 Aug 10 23:21:25.300717 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2609/5013] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:21:24 2022] GET /compute/v2.1/servers/440c3d30-e5c9-4093-9b7e-39e06d32d682 => generated 1368 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:21:25.600479 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-822a4f98-52ee-4475-9303-41ae8eeeebe1 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:25.601283 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-822a4f98-52ee-4475-9303-41ae8eeeebe1 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] [instance: 076fa162-4b4f-4246-aa95-02525f01e4a7] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:25.616105 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-822a4f98-52ee-4475-9303-41ae8eeeebe1 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:25.616597 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-822a4f98-52ee-4475-9303-41ae8eeeebe1 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:25.617043 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-822a4f98-52ee-4475-9303-41ae8eeeebe1 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:25.617783 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-822a4f98-52ee-4475-9303-41ae8eeeebe1 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:25.618238 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-822a4f98-52ee-4475-9303-41ae8eeeebe1 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:25.618659 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-822a4f98-52ee-4475-9303-41ae8eeeebe1 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:25.689211 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-822a4f98-52ee-4475-9303-41ae8eeeebe1 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] HTTP exception thrown: Instance 076fa162-4b4f-4246-aa95-02525f01e4a7 could not be found. Aug 10 23:21:25.695829 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-822a4f98-52ee-4475-9303-41ae8eeeebe1 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Request method failure captured: Aug 10 23:21:25.695829 n-d-850468-14 devstack@n-api.service[122632]: request: GET /compute/v2.1/servers/076fa162-4b4f-4246-aa95-02525f01e4a7 HTTP/1.1 Aug 10 23:21:25.695829 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:21:25.695829 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:21:25.695829 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:21:25.695829 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 23:21:25.695829 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:21:25.695829 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:21:25.695829 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:21:25.695829 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:21:25.695829 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9DzmK7JMZGD8UwmtgBGa_YaYtOrQrz9Q-6luaXuC2stQ7fTooGVEyG6LJOlZhhsfu77EQ59wHZWdmcedCKO-tNaK5MHo2ZCZ2SnQaNBPRHNBnNI_2XhwITyaBw0c4AXCDreQXuvvZj9M9fQPwNjgUwqTb5FrWzw-TOyMj5WsnGDeRIU Aug 10 23:21:25.695829 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:21:25.695829 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:21:25.695829 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:21:25.695829 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:21:25.695829 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:21:25.695829 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:21:25.695829 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 2cb5f5856c46490ab1ded572d693c4cc Aug 10 23:21:25.695829 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-858173259 Aug 10 23:21:25.695829 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:21:25.695829 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:21:25.695829 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2cb5f5856c46490ab1ded572d693c4cc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2cb5f5856c46490ab1ded572d693c4cc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2cb5f5856c46490ab1ded572d693c4cc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2cb5f5856c46490ab1ded572d693c4cc", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:21:25.695829 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-TestSecurityGroupsBasicOps-858173259 Aug 10 23:21:25.695829 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 2cb5f5856c46490ab1ded572d693c4cc Aug 10 23:21:25.695829 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-858173259 Aug 10 23:21:25.695829 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-TestSecurityGroupsBasicOps-858173259-project Aug 10 23:21:25.695829 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:21:25.695829 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:21:25.695829 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: 627b163f1a0e4fdeb0e9692e7d37460d Aug 10 23:21:25.695829 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-TestSecurityGroupsBasicOps-858173259-project Aug 10 23:21:25.695829 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:21:25.695829 n-d-850468-14 devstack@n-api.service[122632]: exception: Instance 076fa162-4b4f-4246-aa95-02525f01e4a7 could not be found. Aug 10 23:21:25.695829 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': '076fa162-4b4f-4246-aa95-02525f01e4a7'} Aug 10 23:21:25.695829 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:21:25.695829 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:21:25.695829 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:21:25.695829 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:21:25.695829 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:21:25.695829 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:21:25.695829 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:21:25.695829 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:21:25.695829 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:21:25.695829 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:21:25.695829 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 076fa162-4b4f-4246-aa95-02525f01e4a7 could not be found. Aug 10 23:21:25.695829 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:21:25.695829 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:21:25.695829 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:21:25.695829 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:21:25.695829 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:21:25.695829 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:21:25.695829 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:21:25.695829 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:21:25.695829 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:21:25.695829 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:21:25.695829 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:21:25.695829 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:21:25.695829 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:21:25.695829 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:21:25.695829 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:21:25.695829 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:21:25.695829 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 076fa162-4b4f-4246-aa95-02525f01e4a7 could not be found. Aug 10 23:21:25.695829 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:21:25.695829 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:21:25.695829 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:21:25.700529 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:21:25.700529 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:21:25.700529 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:21:25.700529 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:21:25.700529 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:21:25.700529 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 076fa162-4b4f-4246-aa95-02525f01e4a7 could not be found. Aug 10 23:21:25.700529 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:21:25.705257 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-822a4f98-52ee-4475-9303-41ae8eeeebe1 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Returning 404 to user: Instance 076fa162-4b4f-4246-aa95-02525f01e4a7 could not be found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:21:25.710705 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-822a4f98-52ee-4475-9303-41ae8eeeebe1 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] 10.222.0.58 "GET /compute/v2.1/servers/076fa162-4b4f-4246-aa95-02525f01e4a7" status: 404 len: 111 microversion: 2.1 time: 0.110540 Aug 10 23:21:25.711565 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2405/5014] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:21:25 2022] GET /compute/v2.1/servers/076fa162-4b4f-4246-aa95-02525f01e4a7 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:21:25.849087 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-06ddc215-4d00-4da9-953d-aab6a47b9aac req-37889d65-6d06-40cf-b8fd-62e5e4bf75e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "440c3d30-e5c9-4093-9b7e-39e06d32d682", "name": "network-vif-plugged", "status": "completed", "tag": "56eb709a-f823-4e09-86fa-42e4d98f2bb3"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:21:25.868717 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-06ddc215-4d00-4da9-953d-aab6a47b9aac req-37889d65-6d06-40cf-b8fd-62e5e4bf75e3 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:25.871368 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-06ddc215-4d00-4da9-953d-aab6a47b9aac req-37889d65-6d06-40cf-b8fd-62e5e4bf75e3 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:25.872220 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-06ddc215-4d00-4da9-953d-aab6a47b9aac req-37889d65-6d06-40cf-b8fd-62e5e4bf75e3 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:25.901807 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-06ddc215-4d00-4da9-953d-aab6a47b9aac req-37889d65-6d06-40cf-b8fd-62e5e4bf75e3 service nova] Creating event network-vif-plugged:56eb709a-f823-4e09-86fa-42e4d98f2bb3 for instance 440c3d30-e5c9-4093-9b7e-39e06d32d682 on n-h2-850468-14 Aug 10 23:21:25.909267 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-06ddc215-4d00-4da9-953d-aab6a47b9aac req-37889d65-6d06-40cf-b8fd-62e5e4bf75e3 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064394 Aug 10 23:21:25.919201 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2610/5015] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:21:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:21:25.950593 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-e17d5cff-2b3c-4faa-ac3f-c7eebdd35e65 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:25.951831 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-e17d5cff-2b3c-4faa-ac3f-c7eebdd35e65 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: 0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:25.965668 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e17d5cff-2b3c-4faa-ac3f-c7eebdd35e65 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:25.967148 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e17d5cff-2b3c-4faa-ac3f-c7eebdd35e65 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:25.970649 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e17d5cff-2b3c-4faa-ac3f-c7eebdd35e65 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:25.971909 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e17d5cff-2b3c-4faa-ac3f-c7eebdd35e65 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:25.973034 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e17d5cff-2b3c-4faa-ac3f-c7eebdd35e65 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:25.973661 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e17d5cff-2b3c-4faa-ac3f-c7eebdd35e65 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:26.206674 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-e17d5cff-2b3c-4faa-ac3f-c7eebdd35e65 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6684f0c87e4242be9e0ffb4ef1973f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0582ace9e4443b8ad88915503ee630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:26.222895 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-e17d5cff-2b3c-4faa-ac3f-c7eebdd35e65 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "GET /compute/v2.1/servers/0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d" status: 200 len: 1204 microversion: 2.1 time: 0.277579 Aug 10 23:21:26.224342 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2406/5016] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:21:25 2022] GET /compute/v2.1/servers/0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d => generated 1204 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:21:26.323566 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-68fd5792-f990-4412-ae3b-cc9a874d21f7 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:26.325458 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-68fd5792-f990-4412-ae3b-cc9a874d21f7 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] [instance: 440c3d30-e5c9-4093-9b7e-39e06d32d682] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:26.348296 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-68fd5792-f990-4412-ae3b-cc9a874d21f7 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:26.349069 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-68fd5792-f990-4412-ae3b-cc9a874d21f7 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:26.351485 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-68fd5792-f990-4412-ae3b-cc9a874d21f7 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:26.352398 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-68fd5792-f990-4412-ae3b-cc9a874d21f7 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:26.361841 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-68fd5792-f990-4412-ae3b-cc9a874d21f7 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:26.364137 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-68fd5792-f990-4412-ae3b-cc9a874d21f7 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:27.096526 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-68fd5792-f990-4412-ae3b-cc9a874d21f7 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d89081084f14e0187f4c67cd9185fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b557edd165144c8943eb9acc339a377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:27.112500 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-68fd5792-f990-4412-ae3b-cc9a874d21f7 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] 10.222.0.58 "GET /compute/v2.1/servers/440c3d30-e5c9-4093-9b7e-39e06d32d682" status: 200 len: 1368 microversion: 2.1 time: 0.793754 Aug 10 23:21:27.113778 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2611/5017] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:21:26 2022] GET /compute/v2.1/servers/440c3d30-e5c9-4093-9b7e-39e06d32d682 => generated 1368 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:21:27.247067 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-41158c91-220b-49c0-9e33-22c4ffecdcba tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:27.248459 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-41158c91-220b-49c0-9e33-22c4ffecdcba tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: 0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:27.259459 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-41158c91-220b-49c0-9e33-22c4ffecdcba tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:27.261625 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-41158c91-220b-49c0-9e33-22c4ffecdcba tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:27.263219 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-41158c91-220b-49c0-9e33-22c4ffecdcba tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:27.263969 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-41158c91-220b-49c0-9e33-22c4ffecdcba tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:27.264439 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-41158c91-220b-49c0-9e33-22c4ffecdcba tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:27.264878 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-41158c91-220b-49c0-9e33-22c4ffecdcba tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:27.545902 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-41158c91-220b-49c0-9e33-22c4ffecdcba tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6684f0c87e4242be9e0ffb4ef1973f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0582ace9e4443b8ad88915503ee630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:27.556612 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-41158c91-220b-49c0-9e33-22c4ffecdcba tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "GET /compute/v2.1/servers/0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d" status: 200 len: 1266 microversion: 2.1 time: 0.313306 Aug 10 23:21:27.557794 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2407/5018] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:21:27 2022] GET /compute/v2.1/servers/0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d => generated 1266 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:21:28.140041 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-ab043628-57da-472f-b5fe-117586c4f0b3 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:28.143141 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-ab043628-57da-472f-b5fe-117586c4f0b3 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] [instance: 440c3d30-e5c9-4093-9b7e-39e06d32d682] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:28.162169 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ab043628-57da-472f-b5fe-117586c4f0b3 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:28.163172 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ab043628-57da-472f-b5fe-117586c4f0b3 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:28.164256 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ab043628-57da-472f-b5fe-117586c4f0b3 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:28.166938 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ab043628-57da-472f-b5fe-117586c4f0b3 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:28.167877 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ab043628-57da-472f-b5fe-117586c4f0b3 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:28.170760 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ab043628-57da-472f-b5fe-117586c4f0b3 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:28.580567 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-87cda87a-e076-4358-9fa3-d16ce255e0c9 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:28.584238 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-87cda87a-e076-4358-9fa3-d16ce255e0c9 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: 0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:28.605310 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-87cda87a-e076-4358-9fa3-d16ce255e0c9 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:28.606772 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-87cda87a-e076-4358-9fa3-d16ce255e0c9 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:28.607851 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-87cda87a-e076-4358-9fa3-d16ce255e0c9 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:28.612401 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-87cda87a-e076-4358-9fa3-d16ce255e0c9 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:28.613725 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-87cda87a-e076-4358-9fa3-d16ce255e0c9 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:28.615006 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-87cda87a-e076-4358-9fa3-d16ce255e0c9 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:28.718420 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-87cda87a-e076-4358-9fa3-d16ce255e0c9 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6684f0c87e4242be9e0ffb4ef1973f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0582ace9e4443b8ad88915503ee630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:28.730129 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-87cda87a-e076-4358-9fa3-d16ce255e0c9 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "GET /compute/v2.1/servers/0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d" status: 200 len: 1266 microversion: 2.1 time: 0.154262 Aug 10 23:21:28.731487 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2408/5019] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:21:28 2022] GET /compute/v2.1/servers/0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:21:29.197695 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-ab043628-57da-472f-b5fe-117586c4f0b3 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d89081084f14e0187f4c67cd9185fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b557edd165144c8943eb9acc339a377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:29.213937 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-ab043628-57da-472f-b5fe-117586c4f0b3 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] 10.222.0.58 "GET /compute/v2.1/servers/440c3d30-e5c9-4093-9b7e-39e06d32d682" status: 200 len: 1558 microversion: 2.1 time: 1.082540 Aug 10 23:21:29.215282 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2612/5020] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:21:28 2022] GET /compute/v2.1/servers/440c3d30-e5c9-4093-9b7e-39e06d32d682 => generated 1558 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:21:29.239361 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-f491fe1d-048b-478a-91ee-3d18368a596d tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:29.239958 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-f491fe1d-048b-478a-91ee-3d18368a596d tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] [instance: 440c3d30-e5c9-4093-9b7e-39e06d32d682] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:29.247618 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f491fe1d-048b-478a-91ee-3d18368a596d tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:29.248410 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f491fe1d-048b-478a-91ee-3d18368a596d tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:29.249101 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f491fe1d-048b-478a-91ee-3d18368a596d tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:29.250628 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f491fe1d-048b-478a-91ee-3d18368a596d tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:29.251529 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f491fe1d-048b-478a-91ee-3d18368a596d tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:29.252176 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f491fe1d-048b-478a-91ee-3d18368a596d tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:29.400655 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-f491fe1d-048b-478a-91ee-3d18368a596d tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] 10.222.0.58 "GET /compute/v2.1/servers/440c3d30-e5c9-4093-9b7e-39e06d32d682/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.167310 Aug 10 23:21:29.401263 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2409/5021] 10.222.0.58 () {58 vars in 1275 bytes} [Wed Aug 10 23:21:29 2022] GET /compute/v2.1/servers/440c3d30-e5c9-4093-9b7e-39e06d32d682/os-interface => generated 284 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:21:29.764580 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-f8bd8e9c-f860-4601-bba9-f43f26eeb198 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:29.765814 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-f8bd8e9c-f860-4601-bba9-f43f26eeb198 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: 0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:29.799580 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f8bd8e9c-f860-4601-bba9-f43f26eeb198 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:29.802978 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f8bd8e9c-f860-4601-bba9-f43f26eeb198 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:29.803417 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f8bd8e9c-f860-4601-bba9-f43f26eeb198 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:29.804513 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f8bd8e9c-f860-4601-bba9-f43f26eeb198 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:29.806108 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f8bd8e9c-f860-4601-bba9-f43f26eeb198 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:29.808927 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f8bd8e9c-f860-4601-bba9-f43f26eeb198 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:31.188125 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-f8bd8e9c-f860-4601-bba9-f43f26eeb198 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6684f0c87e4242be9e0ffb4ef1973f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0582ace9e4443b8ad88915503ee630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:31.201971 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-f8bd8e9c-f860-4601-bba9-f43f26eeb198 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "GET /compute/v2.1/servers/0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d" status: 200 len: 1308 microversion: 2.1 time: 1.450474 Aug 10 23:21:31.204280 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2613/5022] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:21:29 2022] GET /compute/v2.1/servers/0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d => generated 1308 bytes in 1456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:21:31.525360 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-db15b720-6df3-4591-870c-4ffa8d8f2d72 req-ac44f6fe-360e-4740-8697-c4ae1e851928 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "440c3d30-e5c9-4093-9b7e-39e06d32d682", "tag": "56eb709a-f823-4e09-86fa-42e4d98f2bb3"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:21:31.544269 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-db15b720-6df3-4591-870c-4ffa8d8f2d72 req-ac44f6fe-360e-4740-8697-c4ae1e851928 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:31.550123 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-db15b720-6df3-4591-870c-4ffa8d8f2d72 req-ac44f6fe-360e-4740-8697-c4ae1e851928 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:31.551133 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-db15b720-6df3-4591-870c-4ffa8d8f2d72 req-ac44f6fe-360e-4740-8697-c4ae1e851928 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:31.579386 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-db15b720-6df3-4591-870c-4ffa8d8f2d72 req-ac44f6fe-360e-4740-8697-c4ae1e851928 service nova] Creating event network-changed:56eb709a-f823-4e09-86fa-42e4d98f2bb3 for instance 440c3d30-e5c9-4093-9b7e-39e06d32d682 on n-h2-850468-14 Aug 10 23:21:31.598159 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-db15b720-6df3-4591-870c-4ffa8d8f2d72 req-ac44f6fe-360e-4740-8697-c4ae1e851928 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077641 Aug 10 23:21:31.599522 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2410/5023] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:21:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:21:32.225719 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-fe763144-b8b7-4b3f-8d38-98418fafb2f5 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:32.226733 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-fe763144-b8b7-4b3f-8d38-98418fafb2f5 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: 0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:32.244324 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fe763144-b8b7-4b3f-8d38-98418fafb2f5 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:32.251681 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fe763144-b8b7-4b3f-8d38-98418fafb2f5 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:32.252448 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fe763144-b8b7-4b3f-8d38-98418fafb2f5 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:32.253774 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fe763144-b8b7-4b3f-8d38-98418fafb2f5 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:32.254670 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fe763144-b8b7-4b3f-8d38-98418fafb2f5 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:32.264077 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fe763144-b8b7-4b3f-8d38-98418fafb2f5 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:32.589454 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-765b6548-deb5-4f49-8277-cb9448058fdd tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:21:32.597173 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-765b6548-deb5-4f49-8277-cb9448058fdd tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] [instance: 32ddd6eb-6c3f-4bd1-b9be-f819e8ef3a68] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:32.634201 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-765b6548-deb5-4f49-8277-cb9448058fdd tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:32.648906 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-765b6548-deb5-4f49-8277-cb9448058fdd tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:32.649695 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-765b6548-deb5-4f49-8277-cb9448058fdd tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:32.650488 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-765b6548-deb5-4f49-8277-cb9448058fdd tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:32.651011 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-765b6548-deb5-4f49-8277-cb9448058fdd tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:32.651457 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-765b6548-deb5-4f49-8277-cb9448058fdd tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:32.785441 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-765b6548-deb5-4f49-8277-cb9448058fdd tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "POST /compute/v2.1/servers/32ddd6eb-6c3f-4bd1-b9be-f819e8ef3a68/action" status: 200 len: 24572 microversion: 2.1 time: 0.214845 Aug 10 23:21:32.794305 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2411/5024] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:21:32 2022] POST /compute/v2.1/servers/32ddd6eb-6c3f-4bd1-b9be-f819e8ef3a68/action => generated 24572 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 23:21:34.153259 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-fe763144-b8b7-4b3f-8d38-98418fafb2f5 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6684f0c87e4242be9e0ffb4ef1973f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0582ace9e4443b8ad88915503ee630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:34.163565 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-fe763144-b8b7-4b3f-8d38-98418fafb2f5 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "GET /compute/v2.1/servers/0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d" status: 200 len: 1308 microversion: 2.1 time: 1.941811 Aug 10 23:21:34.163963 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2614/5025] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:21:32 2022] GET /compute/v2.1/servers/0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d => generated 1308 bytes in 1943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:21:35.191573 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-e6772a2a-5ab5-4bbb-919b-843400f021cc req-28ab8f6e-87dd-4d69-a5c8-9713984d649e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d", "tag": "2089cd8b-4d54-4b16-8849-6a4e27d5cb27"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:21:35.192142 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c8de32c5-3b38-492f-85ee-f9d2f4c51573 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:35.192642 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-c8de32c5-3b38-492f-85ee-f9d2f4c51573 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: 0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:35.211064 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-e6772a2a-5ab5-4bbb-919b-843400f021cc req-28ab8f6e-87dd-4d69-a5c8-9713984d649e service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:35.211652 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-e6772a2a-5ab5-4bbb-919b-843400f021cc req-28ab8f6e-87dd-4d69-a5c8-9713984d649e service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:35.212001 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-e6772a2a-5ab5-4bbb-919b-843400f021cc req-28ab8f6e-87dd-4d69-a5c8-9713984d649e service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:35.219439 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=2 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:21:35.221933 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=8 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:21:35.225048 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c8de32c5-3b38-492f-85ee-f9d2f4c51573 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:35.227873 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c8de32c5-3b38-492f-85ee-f9d2f4c51573 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:35.229675 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c8de32c5-3b38-492f-85ee-f9d2f4c51573 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:35.232136 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c8de32c5-3b38-492f-85ee-f9d2f4c51573 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:35.232819 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c8de32c5-3b38-492f-85ee-f9d2f4c51573 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:35.233626 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c8de32c5-3b38-492f-85ee-f9d2f4c51573 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:35.266113 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-e6772a2a-5ab5-4bbb-919b-843400f021cc req-28ab8f6e-87dd-4d69-a5c8-9713984d649e service nova] Creating event network-changed:2089cd8b-4d54-4b16-8849-6a4e27d5cb27 for instance 0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d on n-h1-850468-14 Aug 10 23:21:35.288775 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-e6772a2a-5ab5-4bbb-919b-843400f021cc req-28ab8f6e-87dd-4d69-a5c8-9713984d649e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101542 Aug 10 23:21:35.289431 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2615/5026] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:21:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 23:21:35.767551 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-c8de32c5-3b38-492f-85ee-f9d2f4c51573 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6684f0c87e4242be9e0ffb4ef1973f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0582ace9e4443b8ad88915503ee630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:35.777216 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-c8de32c5-3b38-492f-85ee-f9d2f4c51573 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "GET /compute/v2.1/servers/0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d" status: 200 len: 1308 microversion: 2.1 time: 0.594476 Aug 10 23:21:35.783313 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2412/5027] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:21:35 2022] GET /compute/v2.1/servers/0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d => generated 1308 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:21:36.816625 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-bfe749bb-21af-4a09-ab5b-9d3623ac9766 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:36.818215 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-bfe749bb-21af-4a09-ab5b-9d3623ac9766 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: 0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:36.842384 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bfe749bb-21af-4a09-ab5b-9d3623ac9766 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:36.843807 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bfe749bb-21af-4a09-ab5b-9d3623ac9766 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:36.846938 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bfe749bb-21af-4a09-ab5b-9d3623ac9766 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:36.851048 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bfe749bb-21af-4a09-ab5b-9d3623ac9766 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:36.852594 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bfe749bb-21af-4a09-ab5b-9d3623ac9766 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:36.856695 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bfe749bb-21af-4a09-ab5b-9d3623ac9766 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:37.380932 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-bfe749bb-21af-4a09-ab5b-9d3623ac9766 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6684f0c87e4242be9e0ffb4ef1973f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0582ace9e4443b8ad88915503ee630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:37.391622 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-bfe749bb-21af-4a09-ab5b-9d3623ac9766 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "GET /compute/v2.1/servers/0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d" status: 200 len: 1308 microversion: 2.1 time: 0.590151 Aug 10 23:21:37.394811 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2616/5028] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:21:36 2022] GET /compute/v2.1/servers/0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d => generated 1308 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:21:37.834937 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-80a6474a-16b1-4805-ad7c-31de27b1dd25 tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-388341129", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452", "networks": [{"uuid": "650a4589-89ad-4728-a279-699b8b5b50a1"}]}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:21:37.971051 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.network.neutron [None req-80a6474a-16b1-4805-ad7c-31de27b1dd25 tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] validate_networks() for [('650a4589-89ad-4728-a279-699b8b5b50a1', None, None, None, None, None)] {{(pid=122632) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 23:21:38.413253 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-09d745a0-ec68-4023-8c97-ff1e7ede958a tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:38.413933 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-09d745a0-ec68-4023-8c97-ff1e7ede958a tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: 0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:38.426074 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-09d745a0-ec68-4023-8c97-ff1e7ede958a tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:38.426567 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-09d745a0-ec68-4023-8c97-ff1e7ede958a tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:38.427036 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-09d745a0-ec68-4023-8c97-ff1e7ede958a tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:38.432634 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-09d745a0-ec68-4023-8c97-ff1e7ede958a tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:38.433141 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-09d745a0-ec68-4023-8c97-ff1e7ede958a tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:38.433583 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-09d745a0-ec68-4023-8c97-ff1e7ede958a tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:38.834527 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-09d745a0-ec68-4023-8c97-ff1e7ede958a tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6684f0c87e4242be9e0ffb4ef1973f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0582ace9e4443b8ad88915503ee630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:38.848322 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-09d745a0-ec68-4023-8c97-ff1e7ede958a tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "GET /compute/v2.1/servers/0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d" status: 200 len: 1308 microversion: 2.1 time: 0.438984 Aug 10 23:21:38.864958 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2617/5029] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:21:38 2022] GET /compute/v2.1/servers/0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d => generated 1308 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:21:39.563649 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-80a6474a-16b1-4805-ad7c-31de27b1dd25 tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] Flavor limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:21:39.564267 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-80a6474a-16b1-4805-ad7c-31de27b1dd25 tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] Image limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:21:39.566299 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-80a6474a-16b1-4805-ad7c-31de27b1dd25 tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] Flavor pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:21:39.566733 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-80a6474a-16b1-4805-ad7c-31de27b1dd25 tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] Image pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:21:39.567291 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-80a6474a-16b1-4805-ad7c-31de27b1dd25 tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:21:39.594307 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-80a6474a-16b1-4805-ad7c-31de27b1dd25 tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:39.594818 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-80a6474a-16b1-4805-ad7c-31de27b1dd25 tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:39.600658 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-80a6474a-16b1-4805-ad7c-31de27b1dd25 tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:39.602731 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-80a6474a-16b1-4805-ad7c-31de27b1dd25 tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:39.603631 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-80a6474a-16b1-4805-ad7c-31de27b1dd25 tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:39.604560 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-80a6474a-16b1-4805-ad7c-31de27b1dd25 tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:39.667520 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-80a6474a-16b1-4805-ad7c-31de27b1dd25 tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] Getting quotas for project e1545dd3a53941429a96aaea671fdd3b. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:21:39.681339 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-80a6474a-16b1-4805-ad7c-31de27b1dd25 tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] Getting quotas for user 814b873378304b909564638973604400 and project e1545dd3a53941429a96aaea671fdd3b. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:21:39.719796 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-80a6474a-16b1-4805-ad7c-31de27b1dd25 tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] Going to run 1 instances... {{(pid=122632) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 23:21:39.732725 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-80a6474a-16b1-4805-ad7c-31de27b1dd25 tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] [instance: 173c58d3-70ae-4415-b257-1ee3a468eb20] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78ad8905-f66f-4733-8be9-2b260f1fabed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122632) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 23:21:39.836277 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-80a6474a-16b1-4805-ad7c-31de27b1dd25 tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.414933 Aug 10 23:21:39.837102 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2413/5030] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 23:21:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 2417 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 23:21:39.848619 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-36385e6b-e75a-4548-a7f9-14bb2dd91e58 tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:39.849764 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-36385e6b-e75a-4548-a7f9-14bb2dd91e58 tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] [instance: 173c58d3-70ae-4415-b257-1ee3a468eb20] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:39.890262 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-b64d5c02-e9ae-485f-9ac2-7ded5ebb3b0f tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:39.891252 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-b64d5c02-e9ae-485f-9ac2-7ded5ebb3b0f tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: 0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:39.897758 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:INSERT=6 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:21:39.901495 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b64d5c02-e9ae-485f-9ac2-7ded5ebb3b0f tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:39.902554 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b64d5c02-e9ae-485f-9ac2-7ded5ebb3b0f tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:39.903394 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b64d5c02-e9ae-485f-9ac2-7ded5ebb3b0f tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:39.904827 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b64d5c02-e9ae-485f-9ac2-7ded5ebb3b0f tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:39.905622 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b64d5c02-e9ae-485f-9ac2-7ded5ebb3b0f tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:39.905975 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b64d5c02-e9ae-485f-9ac2-7ded5ebb3b0f tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:39.993168 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-36385e6b-e75a-4548-a7f9-14bb2dd91e58 tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '814b873378304b909564638973604400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1545dd3a53941429a96aaea671fdd3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:40.000937 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-36385e6b-e75a-4548-a7f9-14bb2dd91e58 tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] 10.222.0.58 "GET /compute/v2.1/servers/173c58d3-70ae-4415-b257-1ee3a468eb20" status: 200 len: 1227 microversion: 2.1 time: 0.157229 Aug 10 23:21:40.002735 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2618/5031] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:21:39 2022] GET /compute/v2.1/servers/173c58d3-70ae-4415-b257-1ee3a468eb20 => generated 1227 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:21:40.331773 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-b64d5c02-e9ae-485f-9ac2-7ded5ebb3b0f tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6684f0c87e4242be9e0ffb4ef1973f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0582ace9e4443b8ad88915503ee630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:40.343579 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-b64d5c02-e9ae-485f-9ac2-7ded5ebb3b0f tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "GET /compute/v2.1/servers/0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d" status: 200 len: 1308 microversion: 2.1 time: 0.459772 Aug 10 23:21:40.354868 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2414/5032] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:21:39 2022] GET /compute/v2.1/servers/0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d => generated 1308 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:21:41.025982 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-35e501c4-a469-4920-8b08-08f472a38d43 tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:41.027129 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-35e501c4-a469-4920-8b08-08f472a38d43 tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] [instance: 173c58d3-70ae-4415-b257-1ee3a468eb20] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:41.369111 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-6bc07baa-d5d0-457e-8557-b457d953cab5 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:41.378862 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-35e501c4-a469-4920-8b08-08f472a38d43 tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '814b873378304b909564638973604400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1545dd3a53941429a96aaea671fdd3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:41.383596 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-6bc07baa-d5d0-457e-8557-b457d953cab5 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: 0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:41.405175 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-35e501c4-a469-4920-8b08-08f472a38d43 tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] 10.222.0.58 "GET /compute/v2.1/servers/173c58d3-70ae-4415-b257-1ee3a468eb20" status: 200 len: 1227 microversion: 2.1 time: 0.381341 Aug 10 23:21:41.411855 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6bc07baa-d5d0-457e-8557-b457d953cab5 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:41.414017 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6bc07baa-d5d0-457e-8557-b457d953cab5 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:41.415589 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6bc07baa-d5d0-457e-8557-b457d953cab5 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:41.418748 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6bc07baa-d5d0-457e-8557-b457d953cab5 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:41.419821 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6bc07baa-d5d0-457e-8557-b457d953cab5 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:41.422209 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6bc07baa-d5d0-457e-8557-b457d953cab5 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:41.430169 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2619/5033] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:21:41 2022] GET /compute/v2.1/servers/173c58d3-70ae-4415-b257-1ee3a468eb20 => generated 1227 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:21:41.442672 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:21:41.760375 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-6bc07baa-d5d0-457e-8557-b457d953cab5 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6684f0c87e4242be9e0ffb4ef1973f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0582ace9e4443b8ad88915503ee630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:41.773012 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-6bc07baa-d5d0-457e-8557-b457d953cab5 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "GET /compute/v2.1/servers/0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d" status: 200 len: 1308 microversion: 2.1 time: 0.407905 Aug 10 23:21:41.775051 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2415/5034] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:21:41 2022] GET /compute/v2.1/servers/0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d => generated 1308 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:21:42.436255 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-3d2e219d-28d9-418c-8466-400b5701a75a tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:42.438138 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-3d2e219d-28d9-418c-8466-400b5701a75a tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] [instance: 173c58d3-70ae-4415-b257-1ee3a468eb20] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:42.456449 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3d2e219d-28d9-418c-8466-400b5701a75a tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:42.459463 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3d2e219d-28d9-418c-8466-400b5701a75a tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:42.460401 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3d2e219d-28d9-418c-8466-400b5701a75a tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:42.462112 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3d2e219d-28d9-418c-8466-400b5701a75a tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:42.464695 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3d2e219d-28d9-418c-8466-400b5701a75a tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:42.465543 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3d2e219d-28d9-418c-8466-400b5701a75a tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:42.802904 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-2d47ebbc-fb86-457f-9e53-d13f295c8945 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:42.803556 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-2d47ebbc-fb86-457f-9e53-d13f295c8945 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: 0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:42.824644 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2d47ebbc-fb86-457f-9e53-d13f295c8945 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:42.829036 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2d47ebbc-fb86-457f-9e53-d13f295c8945 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:42.832354 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2d47ebbc-fb86-457f-9e53-d13f295c8945 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:42.833638 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2d47ebbc-fb86-457f-9e53-d13f295c8945 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:42.835429 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2d47ebbc-fb86-457f-9e53-d13f295c8945 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:42.839309 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2d47ebbc-fb86-457f-9e53-d13f295c8945 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:42.855544 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-3d2e219d-28d9-418c-8466-400b5701a75a tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '814b873378304b909564638973604400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1545dd3a53941429a96aaea671fdd3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:42.870141 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-3d2e219d-28d9-418c-8466-400b5701a75a tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] 10.222.0.58 "GET /compute/v2.1/servers/173c58d3-70ae-4415-b257-1ee3a468eb20" status: 200 len: 1285 microversion: 2.1 time: 0.439706 Aug 10 23:21:42.871705 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2620/5035] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:21:42 2022] GET /compute/v2.1/servers/173c58d3-70ae-4415-b257-1ee3a468eb20 => generated 1285 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:21:43.187860 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-2d47ebbc-fb86-457f-9e53-d13f295c8945 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6684f0c87e4242be9e0ffb4ef1973f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0582ace9e4443b8ad88915503ee630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:43.207183 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-2d47ebbc-fb86-457f-9e53-d13f295c8945 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "GET /compute/v2.1/servers/0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d" status: 200 len: 1308 microversion: 2.1 time: 0.410827 Aug 10 23:21:43.210864 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2416/5036] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:21:42 2022] GET /compute/v2.1/servers/0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d => generated 1308 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:21:43.837359 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-a69ab3b2-81a4-4306-975d-979c1a7e71e3 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed"}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:21:43.840835 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-a69ab3b2-81a4-4306-975d-979c1a7e71e3 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] [instance: 32ddd6eb-6c3f-4bd1-b9be-f819e8ef3a68] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:43.856301 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a69ab3b2-81a4-4306-975d-979c1a7e71e3 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:43.860597 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a69ab3b2-81a4-4306-975d-979c1a7e71e3 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:43.861325 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a69ab3b2-81a4-4306-975d-979c1a7e71e3 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:43.862430 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a69ab3b2-81a4-4306-975d-979c1a7e71e3 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:43.864412 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a69ab3b2-81a4-4306-975d-979c1a7e71e3 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:43.867511 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a69ab3b2-81a4-4306-975d-979c1a7e71e3 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:43.898250 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-0bec545f-6d34-42d8-9a05-6965e65c02a8 tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:43.899550 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-0bec545f-6d34-42d8-9a05-6965e65c02a8 tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] [instance: 173c58d3-70ae-4415-b257-1ee3a468eb20] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:43.913532 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0bec545f-6d34-42d8-9a05-6965e65c02a8 tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:43.914015 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0bec545f-6d34-42d8-9a05-6965e65c02a8 tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:43.919580 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0bec545f-6d34-42d8-9a05-6965e65c02a8 tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:43.923635 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0bec545f-6d34-42d8-9a05-6965e65c02a8 tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:43.929948 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0bec545f-6d34-42d8-9a05-6965e65c02a8 tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:43.932077 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0bec545f-6d34-42d8-9a05-6965e65c02a8 tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:44.114085 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-a69ab3b2-81a4-4306-975d-979c1a7e71e3 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Flavor limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:21:44.115733 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-a69ab3b2-81a4-4306-975d-979c1a7e71e3 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Image limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:21:44.117756 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-a69ab3b2-81a4-4306-975d-979c1a7e71e3 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Flavor pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:21:44.119922 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-a69ab3b2-81a4-4306-975d-979c1a7e71e3 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Image pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:21:44.120594 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-a69ab3b2-81a4-4306-975d-979c1a7e71e3 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:21:44.243827 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-a69ab3b2-81a4-4306-975d-979c1a7e71e3 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] [instance: 32ddd6eb-6c3f-4bd1-b9be-f819e8ef3a68] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:44.251948 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a69ab3b2-81a4-4306-975d-979c1a7e71e3 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:44.252703 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a69ab3b2-81a4-4306-975d-979c1a7e71e3 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:44.253467 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a69ab3b2-81a4-4306-975d-979c1a7e71e3 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:44.254522 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a69ab3b2-81a4-4306-975d-979c1a7e71e3 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:44.255973 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a69ab3b2-81a4-4306-975d-979c1a7e71e3 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:44.256590 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a69ab3b2-81a4-4306-975d-979c1a7e71e3 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:44.295409 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-a69ab3b2-81a4-4306-975d-979c1a7e71e3 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "POST /compute/v2.1/servers/32ddd6eb-6c3f-4bd1-b9be-f819e8ef3a68/action" status: 202 len: 1137 microversion: 2.1 time: 0.462646 Aug 10 23:21:44.311495 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2621/5037] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:21:43 2022] POST /compute/v2.1/servers/32ddd6eb-6c3f-4bd1-b9be-f819e8ef3a68/action => generated 1137 bytes in 480 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 10 23:21:44.767474 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-0bec545f-6d34-42d8-9a05-6965e65c02a8 tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '814b873378304b909564638973604400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1545dd3a53941429a96aaea671fdd3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:44.778130 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-201d4ca3-0f28-4db7-b887-bd6635528347 req-cd701b5e-f45a-46df-be5d-59db8d1c5058 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d", "name": "network-vif-plugged", "status": "completed", "tag": "2089cd8b-4d54-4b16-8849-6a4e27d5cb27"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:21:44.781227 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-0bec545f-6d34-42d8-9a05-6965e65c02a8 tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] 10.222.0.58 "GET /compute/v2.1/servers/173c58d3-70ae-4415-b257-1ee3a468eb20" status: 200 len: 1327 microversion: 2.1 time: 0.886501 Aug 10 23:21:44.783128 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2417/5038] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:21:43 2022] GET /compute/v2.1/servers/173c58d3-70ae-4415-b257-1ee3a468eb20 => generated 1327 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:21:44.795815 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-75328ca8-25f2-4242-b9c1-02c87ace7e4e tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:44.809255 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-75328ca8-25f2-4242-b9c1-02c87ace7e4e tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: 0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:44.824761 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-75328ca8-25f2-4242-b9c1-02c87ace7e4e tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:44.827989 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-75328ca8-25f2-4242-b9c1-02c87ace7e4e tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:44.830077 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-75328ca8-25f2-4242-b9c1-02c87ace7e4e tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:44.834377 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-75328ca8-25f2-4242-b9c1-02c87ace7e4e tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:44.834926 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-75328ca8-25f2-4242-b9c1-02c87ace7e4e tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:44.836046 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-75328ca8-25f2-4242-b9c1-02c87ace7e4e tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:44.842386 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-201d4ca3-0f28-4db7-b887-bd6635528347 req-cd701b5e-f45a-46df-be5d-59db8d1c5058 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:44.846177 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-201d4ca3-0f28-4db7-b887-bd6635528347 req-cd701b5e-f45a-46df-be5d-59db8d1c5058 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:44.849586 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-201d4ca3-0f28-4db7-b887-bd6635528347 req-cd701b5e-f45a-46df-be5d-59db8d1c5058 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:44.899724 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-201d4ca3-0f28-4db7-b887-bd6635528347 req-cd701b5e-f45a-46df-be5d-59db8d1c5058 service nova] Creating event network-vif-plugged:2089cd8b-4d54-4b16-8849-6a4e27d5cb27 for instance 0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d on n-h1-850468-14 Aug 10 23:21:44.920828 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-201d4ca3-0f28-4db7-b887-bd6635528347 req-cd701b5e-f45a-46df-be5d-59db8d1c5058 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.606027 Aug 10 23:21:44.923687 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2622/5039] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:21:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:21:44.939028 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-7f1a3bb7-11f9-4b91-9b8b-675001cedc0b tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:44.942257 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-7f1a3bb7-11f9-4b91-9b8b-675001cedc0b tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] [instance: 32ddd6eb-6c3f-4bd1-b9be-f819e8ef3a68] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:44.968317 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7f1a3bb7-11f9-4b91-9b8b-675001cedc0b tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:44.969290 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7f1a3bb7-11f9-4b91-9b8b-675001cedc0b tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:44.969762 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7f1a3bb7-11f9-4b91-9b8b-675001cedc0b tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:44.970524 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7f1a3bb7-11f9-4b91-9b8b-675001cedc0b tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:44.975233 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7f1a3bb7-11f9-4b91-9b8b-675001cedc0b tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:44.975860 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7f1a3bb7-11f9-4b91-9b8b-675001cedc0b tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:45.258945 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-75328ca8-25f2-4242-b9c1-02c87ace7e4e tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6684f0c87e4242be9e0ffb4ef1973f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0582ace9e4443b8ad88915503ee630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:45.276508 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-75328ca8-25f2-4242-b9c1-02c87ace7e4e tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "GET /compute/v2.1/servers/0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d" status: 200 len: 1308 microversion: 2.1 time: 0.488731 Aug 10 23:21:45.278229 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2418/5040] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:21:44 2022] GET /compute/v2.1/servers/0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d => generated 1308 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:21:45.296351 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-8e246df8-f0e1-4d44-b29d-4a9eba50c2f1 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:45.301341 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-8e246df8-f0e1-4d44-b29d-4a9eba50c2f1 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] [instance: ee6a796b-efa5-4c73-8776-d86b54ca2190] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:45.314577 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8e246df8-f0e1-4d44-b29d-4a9eba50c2f1 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:45.315034 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8e246df8-f0e1-4d44-b29d-4a9eba50c2f1 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:45.315480 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8e246df8-f0e1-4d44-b29d-4a9eba50c2f1 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:45.316211 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8e246df8-f0e1-4d44-b29d-4a9eba50c2f1 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:45.316667 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8e246df8-f0e1-4d44-b29d-4a9eba50c2f1 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:45.317096 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8e246df8-f0e1-4d44-b29d-4a9eba50c2f1 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:45.387477 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-8e246df8-f0e1-4d44-b29d-4a9eba50c2f1 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] [instance: ee6a796b-efa5-4c73-8776-d86b54ca2190] Going to try to terminate instance {{(pid=122632) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:21:45.403951 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-7f1a3bb7-11f9-4b91-9b8b-675001cedc0b tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5899b2ad9f1046caaf7c6073e408eeee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25abd63376614081a9d484f3c9ae950d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:45.408731 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:21:45.414296 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-7f1a3bb7-11f9-4b91-9b8b-675001cedc0b tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "GET /compute/v2.1/servers/32ddd6eb-6c3f-4bd1-b9be-f819e8ef3a68" status: 200 len: 1692 microversion: 2.1 time: 0.486382 Aug 10 23:21:45.425963 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2623/5041] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:21:44 2022] GET /compute/v2.1/servers/32ddd6eb-6c3f-4bd1-b9be-f819e8ef3a68 => generated 1692 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:21:45.442827 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-9baaf8b7-1659-4dc8-a3e3-b1ad3bbfeef5 req-1a87cb13-56ca-4a24-807c-fe20afdaee4d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee6a796b-efa5-4c73-8776-d86b54ca2190", "tag": "4879d463-bf92-43e3-a52e-45e2730c0d75"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:21:45.460646 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-9baaf8b7-1659-4dc8-a3e3-b1ad3bbfeef5 req-1a87cb13-56ca-4a24-807c-fe20afdaee4d service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:45.461468 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-9baaf8b7-1659-4dc8-a3e3-b1ad3bbfeef5 req-1a87cb13-56ca-4a24-807c-fe20afdaee4d service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:45.462353 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-9baaf8b7-1659-4dc8-a3e3-b1ad3bbfeef5 req-1a87cb13-56ca-4a24-807c-fe20afdaee4d service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:45.494151 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-9baaf8b7-1659-4dc8-a3e3-b1ad3bbfeef5 req-1a87cb13-56ca-4a24-807c-fe20afdaee4d service nova] Creating event network-changed:4879d463-bf92-43e3-a52e-45e2730c0d75 for instance ee6a796b-efa5-4c73-8776-d86b54ca2190 on n-h2-850468-14 Aug 10 23:21:45.503284 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-9baaf8b7-1659-4dc8-a3e3-b1ad3bbfeef5 req-1a87cb13-56ca-4a24-807c-fe20afdaee4d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075567 Aug 10 23:21:45.516192 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2624/5042] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:21:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:21:45.537990 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-afe6768a-9528-45c9-846b-67316a25b76d req-59b5b13f-d87d-4685-be16-54dee73563e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "173c58d3-70ae-4415-b257-1ee3a468eb20", "tag": "680b2f8c-3000-419b-8dc4-70be2fe00d8a"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:21:45.560860 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-afe6768a-9528-45c9-846b-67316a25b76d req-59b5b13f-d87d-4685-be16-54dee73563e8 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:45.562397 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-afe6768a-9528-45c9-846b-67316a25b76d req-59b5b13f-d87d-4685-be16-54dee73563e8 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:45.563155 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-afe6768a-9528-45c9-846b-67316a25b76d req-59b5b13f-d87d-4685-be16-54dee73563e8 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:45.597302 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-afe6768a-9528-45c9-846b-67316a25b76d req-59b5b13f-d87d-4685-be16-54dee73563e8 service nova] Creating event network-changed:680b2f8c-3000-419b-8dc4-70be2fe00d8a for instance 173c58d3-70ae-4415-b257-1ee3a468eb20 on n-h1-850468-14 Aug 10 23:21:45.611097 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-8e246df8-f0e1-4d44-b29d-4a9eba50c2f1 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] 10.222.0.58 "DELETE /compute/v2.1/servers/ee6a796b-efa5-4c73-8776-d86b54ca2190" status: 204 len: 0 microversion: 2.1 time: 0.331450 Aug 10 23:21:45.612263 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-afe6768a-9528-45c9-846b-67316a25b76d req-59b5b13f-d87d-4685-be16-54dee73563e8 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089252 Aug 10 23:21:45.613203 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2625/5043] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:21:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:21:45.614604 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2419/5044] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:21:45 2022] DELETE /compute/v2.1/servers/ee6a796b-efa5-4c73-8776-d86b54ca2190 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:21:45.628096 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-bb9c0404-266b-453f-bc72-685230d81320 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:45.630462 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-bb9c0404-266b-453f-bc72-685230d81320 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] [instance: ee6a796b-efa5-4c73-8776-d86b54ca2190] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:45.648981 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bb9c0404-266b-453f-bc72-685230d81320 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:45.651986 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bb9c0404-266b-453f-bc72-685230d81320 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:45.652539 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bb9c0404-266b-453f-bc72-685230d81320 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:45.656410 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bb9c0404-266b-453f-bc72-685230d81320 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:45.657288 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bb9c0404-266b-453f-bc72-685230d81320 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:45.657823 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bb9c0404-266b-453f-bc72-685230d81320 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:45.804852 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-41650287-bbad-4d4d-be03-4901ea049d10 tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:45.805925 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-41650287-bbad-4d4d-be03-4901ea049d10 tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] [instance: 173c58d3-70ae-4415-b257-1ee3a468eb20] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:45.818436 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-41650287-bbad-4d4d-be03-4901ea049d10 tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:45.819501 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-41650287-bbad-4d4d-be03-4901ea049d10 tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:45.821847 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-41650287-bbad-4d4d-be03-4901ea049d10 tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:45.822993 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-41650287-bbad-4d4d-be03-4901ea049d10 tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:45.824289 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-41650287-bbad-4d4d-be03-4901ea049d10 tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:45.824964 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-41650287-bbad-4d4d-be03-4901ea049d10 tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:46.183084 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-41650287-bbad-4d4d-be03-4901ea049d10 tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '814b873378304b909564638973604400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1545dd3a53941429a96aaea671fdd3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:46.192235 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-41650287-bbad-4d4d-be03-4901ea049d10 tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] 10.222.0.58 "GET /compute/v2.1/servers/173c58d3-70ae-4415-b257-1ee3a468eb20" status: 200 len: 1327 microversion: 2.1 time: 0.391961 Aug 10 23:21:46.192753 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2420/5045] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:21:45 2022] GET /compute/v2.1/servers/173c58d3-70ae-4415-b257-1ee3a468eb20 => generated 1327 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:21:46.304337 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-1ed3dba8-17e3-48e9-bb0d-896f62826600 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:46.305784 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-1ed3dba8-17e3-48e9-bb0d-896f62826600 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: 0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:46.314544 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1ed3dba8-17e3-48e9-bb0d-896f62826600 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:46.321215 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1ed3dba8-17e3-48e9-bb0d-896f62826600 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:46.321708 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1ed3dba8-17e3-48e9-bb0d-896f62826600 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:46.322564 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1ed3dba8-17e3-48e9-bb0d-896f62826600 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:46.323253 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1ed3dba8-17e3-48e9-bb0d-896f62826600 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:46.323874 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1ed3dba8-17e3-48e9-bb0d-896f62826600 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:46.418506 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-bb9c0404-266b-453f-bc72-685230d81320 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '627b163f1a0e4fdeb0e9692e7d37460d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb5f5856c46490ab1ded572d693c4cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:46.434082 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-bb9c0404-266b-453f-bc72-685230d81320 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] 10.222.0.58 "GET /compute/v2.1/servers/ee6a796b-efa5-4c73-8776-d86b54ca2190" status: 200 len: 1766 microversion: 2.1 time: 0.813833 Aug 10 23:21:46.437228 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2626/5046] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:21:45 2022] GET /compute/v2.1/servers/ee6a796b-efa5-4c73-8776-d86b54ca2190 => generated 1766 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:21:46.457406 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-1755a26d-b55c-4bff-82eb-5257cf097803 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:46.458147 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-1755a26d-b55c-4bff-82eb-5257cf097803 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] [instance: 32ddd6eb-6c3f-4bd1-b9be-f819e8ef3a68] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:46.475087 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1755a26d-b55c-4bff-82eb-5257cf097803 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:46.475770 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1755a26d-b55c-4bff-82eb-5257cf097803 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:46.476228 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1755a26d-b55c-4bff-82eb-5257cf097803 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:46.476952 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1755a26d-b55c-4bff-82eb-5257cf097803 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:46.478466 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1755a26d-b55c-4bff-82eb-5257cf097803 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:46.479280 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1755a26d-b55c-4bff-82eb-5257cf097803 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:46.844887 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-1ed3dba8-17e3-48e9-bb0d-896f62826600 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6684f0c87e4242be9e0ffb4ef1973f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0582ace9e4443b8ad88915503ee630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:46.865123 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-1ed3dba8-17e3-48e9-bb0d-896f62826600 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "GET /compute/v2.1/servers/0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d" status: 200 len: 1308 microversion: 2.1 time: 0.563260 Aug 10 23:21:46.866215 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2421/5047] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:21:46 2022] GET /compute/v2.1/servers/0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d => generated 1308 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:21:47.006422 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-1755a26d-b55c-4bff-82eb-5257cf097803 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5899b2ad9f1046caaf7c6073e408eeee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25abd63376614081a9d484f3c9ae950d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:47.016673 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-1755a26d-b55c-4bff-82eb-5257cf097803 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "GET /compute/v2.1/servers/32ddd6eb-6c3f-4bd1-b9be-f819e8ef3a68" status: 200 len: 1692 microversion: 2.1 time: 0.568913 Aug 10 23:21:47.019298 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2627/5048] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:21:46 2022] GET /compute/v2.1/servers/32ddd6eb-6c3f-4bd1-b9be-f819e8ef3a68 => generated 1692 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:21:47.223799 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-a145a4c3-b537-4721-b436-5220eedadb2f tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:47.224667 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-a145a4c3-b537-4721-b436-5220eedadb2f tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] [instance: 173c58d3-70ae-4415-b257-1ee3a468eb20] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:47.241437 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a145a4c3-b537-4721-b436-5220eedadb2f tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:47.242825 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a145a4c3-b537-4721-b436-5220eedadb2f tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:47.243272 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a145a4c3-b537-4721-b436-5220eedadb2f tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:47.244083 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a145a4c3-b537-4721-b436-5220eedadb2f tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:47.244863 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a145a4c3-b537-4721-b436-5220eedadb2f tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:47.245463 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a145a4c3-b537-4721-b436-5220eedadb2f tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:47.457259 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-bf7c3f0f-7f8a-4f27-bff7-53a209bddd65 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:47.457886 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-bf7c3f0f-7f8a-4f27-bff7-53a209bddd65 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] [instance: ee6a796b-efa5-4c73-8776-d86b54ca2190] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:47.468655 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bf7c3f0f-7f8a-4f27-bff7-53a209bddd65 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:47.471642 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bf7c3f0f-7f8a-4f27-bff7-53a209bddd65 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:47.472208 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bf7c3f0f-7f8a-4f27-bff7-53a209bddd65 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:47.473070 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bf7c3f0f-7f8a-4f27-bff7-53a209bddd65 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:47.473642 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bf7c3f0f-7f8a-4f27-bff7-53a209bddd65 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:47.474179 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bf7c3f0f-7f8a-4f27-bff7-53a209bddd65 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:47.629517 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-a145a4c3-b537-4721-b436-5220eedadb2f tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '814b873378304b909564638973604400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1545dd3a53941429a96aaea671fdd3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:47.647117 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-a145a4c3-b537-4721-b436-5220eedadb2f tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] 10.222.0.58 "GET /compute/v2.1/servers/173c58d3-70ae-4415-b257-1ee3a468eb20" status: 200 len: 1327 microversion: 2.1 time: 0.436174 Aug 10 23:21:47.661137 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2422/5049] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:21:47 2022] GET /compute/v2.1/servers/173c58d3-70ae-4415-b257-1ee3a468eb20 => generated 1327 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:21:47.857321 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-bf7c3f0f-7f8a-4f27-bff7-53a209bddd65 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '627b163f1a0e4fdeb0e9692e7d37460d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cb5f5856c46490ab1ded572d693c4cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:47.885258 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-0208d703-597d-4996-977e-9a2583f7b301 req-59a0ff44-a0a9-4aed-9bf0-8ac95d85db7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee6a796b-efa5-4c73-8776-d86b54ca2190", "name": "network-vif-deleted", "tag": "4879d463-bf92-43e3-a52e-45e2730c0d75"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:21:47.892545 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-bf7c3f0f-7f8a-4f27-bff7-53a209bddd65 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] 10.222.0.58 "GET /compute/v2.1/servers/ee6a796b-efa5-4c73-8776-d86b54ca2190" status: 200 len: 1766 microversion: 2.1 time: 0.440465 Aug 10 23:21:47.900627 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-0208d703-597d-4996-977e-9a2583f7b301 req-59a0ff44-a0a9-4aed-9bf0-8ac95d85db7a service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:47.901668 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-0208d703-597d-4996-977e-9a2583f7b301 req-59a0ff44-a0a9-4aed-9bf0-8ac95d85db7a service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:47.902260 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-0208d703-597d-4996-977e-9a2583f7b301 req-59a0ff44-a0a9-4aed-9bf0-8ac95d85db7a service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:47.904070 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2628/5050] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:21:47 2022] GET /compute/v2.1/servers/ee6a796b-efa5-4c73-8776-d86b54ca2190 => generated 1766 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:21:47.922343 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-aa993ab3-8518-4d31-8db1-cf080d252d99 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:47.923302 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-aa993ab3-8518-4d31-8db1-cf080d252d99 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: 0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:47.940534 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-0208d703-597d-4996-977e-9a2583f7b301 req-59a0ff44-a0a9-4aed-9bf0-8ac95d85db7a service nova] Creating event network-vif-deleted:4879d463-bf92-43e3-a52e-45e2730c0d75 for instance ee6a796b-efa5-4c73-8776-d86b54ca2190 on n-h2-850468-14 Aug 10 23:21:47.945211 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-aa993ab3-8518-4d31-8db1-cf080d252d99 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:47.957983 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-aa993ab3-8518-4d31-8db1-cf080d252d99 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:47.962506 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-aa993ab3-8518-4d31-8db1-cf080d252d99 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:47.963508 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-aa993ab3-8518-4d31-8db1-cf080d252d99 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:47.966268 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-0208d703-597d-4996-977e-9a2583f7b301 req-59a0ff44-a0a9-4aed-9bf0-8ac95d85db7a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073868 Aug 10 23:21:47.967983 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2423/5051] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:21:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:21:47.968537 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-aa993ab3-8518-4d31-8db1-cf080d252d99 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:47.969331 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-aa993ab3-8518-4d31-8db1-cf080d252d99 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:48.048596 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-d3a23a51-d7a8-47df-a376-a8d6ef64b0c5 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:48.049680 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-d3a23a51-d7a8-47df-a376-a8d6ef64b0c5 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] [instance: 32ddd6eb-6c3f-4bd1-b9be-f819e8ef3a68] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:48.059107 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d3a23a51-d7a8-47df-a376-a8d6ef64b0c5 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:48.060564 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d3a23a51-d7a8-47df-a376-a8d6ef64b0c5 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:48.061195 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d3a23a51-d7a8-47df-a376-a8d6ef64b0c5 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:48.064601 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d3a23a51-d7a8-47df-a376-a8d6ef64b0c5 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:48.065702 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d3a23a51-d7a8-47df-a376-a8d6ef64b0c5 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:48.067101 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d3a23a51-d7a8-47df-a376-a8d6ef64b0c5 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:48.345194 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-d3a23a51-d7a8-47df-a376-a8d6ef64b0c5 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5899b2ad9f1046caaf7c6073e408eeee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25abd63376614081a9d484f3c9ae950d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:48.347206 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-d3a23a51-d7a8-47df-a376-a8d6ef64b0c5 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "GET /compute/v2.1/servers/32ddd6eb-6c3f-4bd1-b9be-f819e8ef3a68" status: 200 len: 1692 microversion: 2.1 time: 0.305824 Aug 10 23:21:48.375095 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2424/5052] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:21:48 2022] GET /compute/v2.1/servers/32ddd6eb-6c3f-4bd1-b9be-f819e8ef3a68 => generated 1692 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:21:48.637270 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-aa993ab3-8518-4d31-8db1-cf080d252d99 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6684f0c87e4242be9e0ffb4ef1973f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0582ace9e4443b8ad88915503ee630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:48.650514 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-aa993ab3-8518-4d31-8db1-cf080d252d99 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "GET /compute/v2.1/servers/0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d" status: 200 len: 1488 microversion: 2.1 time: 0.742756 Aug 10 23:21:48.652343 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2629/5053] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:21:47 2022] GET /compute/v2.1/servers/0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d => generated 1488 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:21:48.672348 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c2241b98-00e5-4aa5-ae84-a7497153b94a tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:48.676605 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-c2241b98-00e5-4aa5-ae84-a7497153b94a tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] [instance: 173c58d3-70ae-4415-b257-1ee3a468eb20] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:48.685845 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c2241b98-00e5-4aa5-ae84-a7497153b94a tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:48.687900 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c2241b98-00e5-4aa5-ae84-a7497153b94a tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:48.688542 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c2241b98-00e5-4aa5-ae84-a7497153b94a tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:48.689278 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c2241b98-00e5-4aa5-ae84-a7497153b94a tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:48.689886 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c2241b98-00e5-4aa5-ae84-a7497153b94a tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:48.690320 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c2241b98-00e5-4aa5-ae84-a7497153b94a tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:48.692009 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-9fb7ea98-aea7-406a-b46c-58dbc2d77872 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-677737013"}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:21:48.699213 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-9fb7ea98-aea7-406a-b46c-58dbc2d77872 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: 0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:48.712402 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9fb7ea98-aea7-406a-b46c-58dbc2d77872 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:48.713573 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9fb7ea98-aea7-406a-b46c-58dbc2d77872 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:48.714579 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9fb7ea98-aea7-406a-b46c-58dbc2d77872 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:48.718657 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9fb7ea98-aea7-406a-b46c-58dbc2d77872 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:48.719675 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9fb7ea98-aea7-406a-b46c-58dbc2d77872 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:48.721579 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9fb7ea98-aea7-406a-b46c-58dbc2d77872 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:48.817329 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-9fb7ea98-aea7-406a-b46c-58dbc2d77872 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "PUT /compute/v2.1/servers/0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d" status: 200 len: 1073 microversion: 2.1 time: 0.135282 Aug 10 23:21:48.818546 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2630/5054] 10.222.0.58 () {60 vars in 1256 bytes} [Wed Aug 10 23:21:48 2022] PUT /compute/v2.1/servers/0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d => generated 1073 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:21:48.839386 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-5e95ce4c-4cb8-46b6-9d7b-1911acc6f2b4 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:48.841411 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-5e95ce4c-4cb8-46b6-9d7b-1911acc6f2b4 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: 0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:48.850623 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5e95ce4c-4cb8-46b6-9d7b-1911acc6f2b4 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:48.851137 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5e95ce4c-4cb8-46b6-9d7b-1911acc6f2b4 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:48.851816 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5e95ce4c-4cb8-46b6-9d7b-1911acc6f2b4 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:48.852686 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5e95ce4c-4cb8-46b6-9d7b-1911acc6f2b4 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:48.853147 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5e95ce4c-4cb8-46b6-9d7b-1911acc6f2b4 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:48.853614 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5e95ce4c-4cb8-46b6-9d7b-1911acc6f2b4 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:48.973329 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-c2241b98-00e5-4aa5-ae84-a7497153b94a tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '814b873378304b909564638973604400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1545dd3a53941429a96aaea671fdd3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:48.983646 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-c2241b98-00e5-4aa5-ae84-a7497153b94a tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] 10.222.0.58 "GET /compute/v2.1/servers/173c58d3-70ae-4415-b257-1ee3a468eb20" status: 200 len: 1327 microversion: 2.1 time: 0.316319 Aug 10 23:21:48.985283 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2425/5055] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:21:48 2022] GET /compute/v2.1/servers/173c58d3-70ae-4415-b257-1ee3a468eb20 => generated 1327 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:21:48.991430 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-53c9d6cb-e304-41b0-ba32-ddba11801da6 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:48.992524 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-53c9d6cb-e304-41b0-ba32-ddba11801da6 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] [instance: ee6a796b-efa5-4c73-8776-d86b54ca2190] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:49.001367 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-53c9d6cb-e304-41b0-ba32-ddba11801da6 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:49.002862 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-53c9d6cb-e304-41b0-ba32-ddba11801da6 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:49.002862 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-53c9d6cb-e304-41b0-ba32-ddba11801da6 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:49.003141 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-53c9d6cb-e304-41b0-ba32-ddba11801da6 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:49.003831 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-53c9d6cb-e304-41b0-ba32-ddba11801da6 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:49.004573 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-53c9d6cb-e304-41b0-ba32-ddba11801da6 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:49.022560 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-53c9d6cb-e304-41b0-ba32-ddba11801da6 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] HTTP exception thrown: Instance ee6a796b-efa5-4c73-8776-d86b54ca2190 could not be found. Aug 10 23:21:49.024935 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-53c9d6cb-e304-41b0-ba32-ddba11801da6 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Request method failure captured: Aug 10 23:21:49.024935 n-d-850468-14 devstack@n-api.service[122632]: request: GET /compute/v2.1/servers/ee6a796b-efa5-4c73-8776-d86b54ca2190 HTTP/1.1 Aug 10 23:21:49.024935 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:21:49.024935 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:21:49.024935 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:21:49.024935 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 23:21:49.024935 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:21:49.024935 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:21:49.024935 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:21:49.024935 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:21:49.024935 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9DzmK7JMZGD8UwmtgBGa_YaYtOrQrz9Q-6luaXuC2stQ7fTooGVEyG6LJOlZhhsfu77EQ59wHZWdmcedCKO-tNaK5MHo2ZCZ2SnQaNBPRHNBnNI_2XhwITyaBw0c4AXCDreQXuvvZj9M9fQPwNjgUwqTb5FrWzw-TOyMj5WsnGDeRIU Aug 10 23:21:49.024935 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:21:49.024935 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:21:49.024935 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:21:49.024935 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:21:49.024935 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:21:49.024935 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:21:49.024935 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 2cb5f5856c46490ab1ded572d693c4cc Aug 10 23:21:49.024935 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-858173259 Aug 10 23:21:49.024935 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:21:49.024935 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:21:49.024935 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2cb5f5856c46490ab1ded572d693c4cc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2cb5f5856c46490ab1ded572d693c4cc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2cb5f5856c46490ab1ded572d693c4cc"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2cb5f5856c46490ab1ded572d693c4cc", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:21:49.024935 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-TestSecurityGroupsBasicOps-858173259 Aug 10 23:21:49.024935 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 2cb5f5856c46490ab1ded572d693c4cc Aug 10 23:21:49.024935 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-858173259 Aug 10 23:21:49.024935 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-TestSecurityGroupsBasicOps-858173259-project Aug 10 23:21:49.024935 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:21:49.024935 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:21:49.024935 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: 627b163f1a0e4fdeb0e9692e7d37460d Aug 10 23:21:49.024935 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-TestSecurityGroupsBasicOps-858173259-project Aug 10 23:21:49.024935 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:21:49.024935 n-d-850468-14 devstack@n-api.service[122632]: exception: Instance ee6a796b-efa5-4c73-8776-d86b54ca2190 could not be found. Aug 10 23:21:49.024935 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': 'ee6a796b-efa5-4c73-8776-d86b54ca2190'} Aug 10 23:21:49.024935 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:21:49.024935 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:21:49.024935 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:21:49.024935 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:21:49.024935 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:21:49.024935 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:21:49.024935 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:21:49.024935 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:21:49.024935 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:21:49.024935 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:21:49.024935 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee6a796b-efa5-4c73-8776-d86b54ca2190 could not be found. Aug 10 23:21:49.024935 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:21:49.024935 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:21:49.024935 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:21:49.024935 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:21:49.024935 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:21:49.024935 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:21:49.024935 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:21:49.024935 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:21:49.024935 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:21:49.024935 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:21:49.024935 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:21:49.024935 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:21:49.024935 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:21:49.024935 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:21:49.024935 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:21:49.024935 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:21:49.024935 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee6a796b-efa5-4c73-8776-d86b54ca2190 could not be found. Aug 10 23:21:49.024935 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:21:49.024935 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:21:49.024935 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:21:49.030773 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:21:49.030773 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:21:49.030773 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:21:49.030773 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:21:49.030773 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:21:49.030773 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee6a796b-efa5-4c73-8776-d86b54ca2190 could not be found. Aug 10 23:21:49.030773 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:21:49.030773 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-53c9d6cb-e304-41b0-ba32-ddba11801da6 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Returning 404 to user: Instance ee6a796b-efa5-4c73-8776-d86b54ca2190 could not be found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:21:49.030773 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-53c9d6cb-e304-41b0-ba32-ddba11801da6 tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] 10.222.0.58 "GET /compute/v2.1/servers/ee6a796b-efa5-4c73-8776-d86b54ca2190" status: 404 len: 111 microversion: 2.1 time: 0.040035 Aug 10 23:21:49.030773 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2426/5056] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:21:48 2022] GET /compute/v2.1/servers/ee6a796b-efa5-4c73-8776-d86b54ca2190 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:21:49.234122 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-5e95ce4c-4cb8-46b6-9d7b-1911acc6f2b4 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6684f0c87e4242be9e0ffb4ef1973f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0582ace9e4443b8ad88915503ee630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:49.248493 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-5e95ce4c-4cb8-46b6-9d7b-1911acc6f2b4 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "GET /compute/v2.1/servers/0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d" status: 200 len: 1499 microversion: 2.1 time: 0.415732 Aug 10 23:21:49.250685 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2631/5057] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:21:48 2022] GET /compute/v2.1/servers/0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d => generated 1499 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:21:49.274633 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-4c3c219e-84fe-43b9-97ac-0f1689d57e81 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:49.279139 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-4c3c219e-84fe-43b9-97ac-0f1689d57e81 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: 0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:49.297775 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4c3c219e-84fe-43b9-97ac-0f1689d57e81 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:49.298738 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4c3c219e-84fe-43b9-97ac-0f1689d57e81 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:49.300704 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4c3c219e-84fe-43b9-97ac-0f1689d57e81 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:49.301656 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4c3c219e-84fe-43b9-97ac-0f1689d57e81 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:49.302218 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4c3c219e-84fe-43b9-97ac-0f1689d57e81 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:49.302660 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4c3c219e-84fe-43b9-97ac-0f1689d57e81 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:49.396592 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-cb5b0cb4-e804-4572-b031-e473ee2eec18 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:49.397203 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-cb5b0cb4-e804-4572-b031-e473ee2eec18 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] [instance: 32ddd6eb-6c3f-4bd1-b9be-f819e8ef3a68] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:49.410555 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cb5b0cb4-e804-4572-b031-e473ee2eec18 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:49.411357 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cb5b0cb4-e804-4572-b031-e473ee2eec18 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:49.412002 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cb5b0cb4-e804-4572-b031-e473ee2eec18 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:49.412901 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cb5b0cb4-e804-4572-b031-e473ee2eec18 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:49.413528 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cb5b0cb4-e804-4572-b031-e473ee2eec18 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:49.414127 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cb5b0cb4-e804-4572-b031-e473ee2eec18 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:49.633111 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=2 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:21:49.684125 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-4c3c219e-84fe-43b9-97ac-0f1689d57e81 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6684f0c87e4242be9e0ffb4ef1973f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0582ace9e4443b8ad88915503ee630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:49.697588 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-4c3c219e-84fe-43b9-97ac-0f1689d57e81 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "GET /compute/v2.1/servers/0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d" status: 200 len: 1499 microversion: 2.1 time: 0.430077 Aug 10 23:21:49.700558 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2427/5058] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:21:49 2022] GET /compute/v2.1/servers/0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d => generated 1499 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:21:49.717792 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-cb5b0cb4-e804-4572-b031-e473ee2eec18 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5899b2ad9f1046caaf7c6073e408eeee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25abd63376614081a9d484f3c9ae950d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:49.729908 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-797524d7-1173-4b50-b8a1-65fa3f509eb9 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:21:49.735767 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-cb5b0cb4-e804-4572-b031-e473ee2eec18 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "GET /compute/v2.1/servers/32ddd6eb-6c3f-4bd1-b9be-f819e8ef3a68" status: 200 len: 1692 microversion: 2.1 time: 0.341516 Aug 10 23:21:49.739945 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2632/5059] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:21:49 2022] GET /compute/v2.1/servers/32ddd6eb-6c3f-4bd1-b9be-f819e8ef3a68 => generated 1692 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:21:49.743777 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=6 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:21:49.761973 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-797524d7-1173-4b50-b8a1-65fa3f509eb9 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:49.762581 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-797524d7-1173-4b50-b8a1-65fa3f509eb9 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:49.763528 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-797524d7-1173-4b50-b8a1-65fa3f509eb9 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:49.798588 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-797524d7-1173-4b50-b8a1-65fa3f509eb9 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: 0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d] Going to try to stop instance {{(pid=122632) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 10 23:21:49.863887 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-797524d7-1173-4b50-b8a1-65fa3f509eb9 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "POST /compute/v2.1/servers/0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d/action" status: 202 len: 0 microversion: 2.1 time: 0.142855 Aug 10 23:21:49.865001 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2428/5060] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:21:49 2022] POST /compute/v2.1/servers/0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d/action => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 10 23:21:49.874046 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-4d538ddc-917a-4813-9457-0c93171b6c94 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:49.875040 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-4d538ddc-917a-4813-9457-0c93171b6c94 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: 0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:49.881916 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4d538ddc-917a-4813-9457-0c93171b6c94 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:49.882954 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4d538ddc-917a-4813-9457-0c93171b6c94 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:49.883659 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4d538ddc-917a-4813-9457-0c93171b6c94 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:49.884602 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4d538ddc-917a-4813-9457-0c93171b6c94 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:49.885253 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4d538ddc-917a-4813-9457-0c93171b6c94 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:49.885857 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4d538ddc-917a-4813-9457-0c93171b6c94 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:50.009749 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-7e00d989-1eff-442d-9d97-4ad4a053ef63 tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:50.011040 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-7e00d989-1eff-442d-9d97-4ad4a053ef63 tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] [instance: 173c58d3-70ae-4415-b257-1ee3a468eb20] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:50.030998 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7e00d989-1eff-442d-9d97-4ad4a053ef63 tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:50.033926 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7e00d989-1eff-442d-9d97-4ad4a053ef63 tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:50.035713 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7e00d989-1eff-442d-9d97-4ad4a053ef63 tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:50.037281 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7e00d989-1eff-442d-9d97-4ad4a053ef63 tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:50.037945 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7e00d989-1eff-442d-9d97-4ad4a053ef63 tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:50.038563 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7e00d989-1eff-442d-9d97-4ad4a053ef63 tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:50.125045 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-4d538ddc-917a-4813-9457-0c93171b6c94 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6684f0c87e4242be9e0ffb4ef1973f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0582ace9e4443b8ad88915503ee630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:50.145139 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-4d538ddc-917a-4813-9457-0c93171b6c94 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "GET /compute/v2.1/servers/0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d" status: 200 len: 1509 microversion: 2.1 time: 0.275074 Aug 10 23:21:50.146881 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2633/5061] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:21:49 2022] GET /compute/v2.1/servers/0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d => generated 1509 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:21:50.473579 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-7e00d989-1eff-442d-9d97-4ad4a053ef63 tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '814b873378304b909564638973604400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1545dd3a53941429a96aaea671fdd3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:50.482768 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-7e00d989-1eff-442d-9d97-4ad4a053ef63 tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] 10.222.0.58 "GET /compute/v2.1/servers/173c58d3-70ae-4415-b257-1ee3a468eb20" status: 200 len: 1327 microversion: 2.1 time: 0.480602 Aug 10 23:21:50.484066 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2429/5062] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:21:50 2022] GET /compute/v2.1/servers/173c58d3-70ae-4415-b257-1ee3a468eb20 => generated 1327 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:21:50.765851 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-7ccbbf98-1dd3-4ed5-a304-73cc55cd98d4 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:50.766578 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-7ccbbf98-1dd3-4ed5-a304-73cc55cd98d4 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] [instance: 32ddd6eb-6c3f-4bd1-b9be-f819e8ef3a68] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:50.772916 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7ccbbf98-1dd3-4ed5-a304-73cc55cd98d4 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:50.773411 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7ccbbf98-1dd3-4ed5-a304-73cc55cd98d4 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:50.773852 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7ccbbf98-1dd3-4ed5-a304-73cc55cd98d4 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:50.774564 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7ccbbf98-1dd3-4ed5-a304-73cc55cd98d4 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:50.775251 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7ccbbf98-1dd3-4ed5-a304-73cc55cd98d4 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:50.775667 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7ccbbf98-1dd3-4ed5-a304-73cc55cd98d4 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:50.972417 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-7ccbbf98-1dd3-4ed5-a304-73cc55cd98d4 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5899b2ad9f1046caaf7c6073e408eeee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25abd63376614081a9d484f3c9ae950d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:50.988608 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-7ccbbf98-1dd3-4ed5-a304-73cc55cd98d4 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "GET /compute/v2.1/servers/32ddd6eb-6c3f-4bd1-b9be-f819e8ef3a68" status: 200 len: 1692 microversion: 2.1 time: 0.227200 Aug 10 23:21:50.990821 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2634/5063] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:21:50 2022] GET /compute/v2.1/servers/32ddd6eb-6c3f-4bd1-b9be-f819e8ef3a68 => generated 1692 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:21:51.168730 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-aa0a3b36-2f32-45ad-ba02-78c73b061782 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:51.169346 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-aa0a3b36-2f32-45ad-ba02-78c73b061782 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: 0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:51.177115 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-aa0a3b36-2f32-45ad-ba02-78c73b061782 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:51.177866 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-aa0a3b36-2f32-45ad-ba02-78c73b061782 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:51.178471 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-aa0a3b36-2f32-45ad-ba02-78c73b061782 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:51.179369 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-aa0a3b36-2f32-45ad-ba02-78c73b061782 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:51.179987 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-aa0a3b36-2f32-45ad-ba02-78c73b061782 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:51.180568 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-aa0a3b36-2f32-45ad-ba02-78c73b061782 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:51.218461 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:21:51.505219 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-b484f649-3945-4057-ad04-a6076a586af7 tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:51.506576 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-b484f649-3945-4057-ad04-a6076a586af7 tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] [instance: 173c58d3-70ae-4415-b257-1ee3a468eb20] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:51.510213 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=4 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:21:51.516395 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_api:SELECT=68 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:21:51.533154 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b484f649-3945-4057-ad04-a6076a586af7 tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:51.534280 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b484f649-3945-4057-ad04-a6076a586af7 tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:51.535056 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b484f649-3945-4057-ad04-a6076a586af7 tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:51.536626 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b484f649-3945-4057-ad04-a6076a586af7 tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:51.537368 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b484f649-3945-4057-ad04-a6076a586af7 tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:51.538350 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b484f649-3945-4057-ad04-a6076a586af7 tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:51.741713 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-b484f649-3945-4057-ad04-a6076a586af7 tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '814b873378304b909564638973604400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1545dd3a53941429a96aaea671fdd3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:51.752472 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-b484f649-3945-4057-ad04-a6076a586af7 tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] 10.222.0.58 "GET /compute/v2.1/servers/173c58d3-70ae-4415-b257-1ee3a468eb20" status: 200 len: 1327 microversion: 2.1 time: 0.252144 Aug 10 23:21:51.756365 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2635/5064] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:21:51 2022] GET /compute/v2.1/servers/173c58d3-70ae-4415-b257-1ee3a468eb20 => generated 1327 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:21:51.832953 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-aa0a3b36-2f32-45ad-ba02-78c73b061782 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6684f0c87e4242be9e0ffb4ef1973f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0582ace9e4443b8ad88915503ee630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:51.852306 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-aa0a3b36-2f32-45ad-ba02-78c73b061782 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "GET /compute/v2.1/servers/0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d" status: 200 len: 1509 microversion: 2.1 time: 0.687697 Aug 10 23:21:51.853352 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2430/5065] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:21:51 2022] GET /compute/v2.1/servers/0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d => generated 1509 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:21:52.014149 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-ac745e04-3fa2-414c-a735-acc541bcba86 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:52.015574 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-ac745e04-3fa2-414c-a735-acc541bcba86 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] [instance: 32ddd6eb-6c3f-4bd1-b9be-f819e8ef3a68] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:52.026120 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ac745e04-3fa2-414c-a735-acc541bcba86 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:52.026698 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ac745e04-3fa2-414c-a735-acc541bcba86 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:52.027445 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ac745e04-3fa2-414c-a735-acc541bcba86 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:52.029162 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ac745e04-3fa2-414c-a735-acc541bcba86 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:52.030362 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ac745e04-3fa2-414c-a735-acc541bcba86 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:52.033221 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ac745e04-3fa2-414c-a735-acc541bcba86 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:52.255762 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-ac745e04-3fa2-414c-a735-acc541bcba86 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5899b2ad9f1046caaf7c6073e408eeee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25abd63376614081a9d484f3c9ae950d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:52.268784 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-ac745e04-3fa2-414c-a735-acc541bcba86 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "GET /compute/v2.1/servers/32ddd6eb-6c3f-4bd1-b9be-f819e8ef3a68" status: 200 len: 1692 microversion: 2.1 time: 0.258782 Aug 10 23:21:52.282894 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2636/5066] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:21:52 2022] GET /compute/v2.1/servers/32ddd6eb-6c3f-4bd1-b9be-f819e8ef3a68 => generated 1692 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:21:52.783416 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c2a7ef36-de19-4293-95b7-78af5c6142bf tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:52.784713 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-c2a7ef36-de19-4293-95b7-78af5c6142bf tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] [instance: 173c58d3-70ae-4415-b257-1ee3a468eb20] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:52.794820 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c2a7ef36-de19-4293-95b7-78af5c6142bf tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:52.797255 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c2a7ef36-de19-4293-95b7-78af5c6142bf tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:52.797939 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c2a7ef36-de19-4293-95b7-78af5c6142bf tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:52.800003 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c2a7ef36-de19-4293-95b7-78af5c6142bf tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:52.801545 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c2a7ef36-de19-4293-95b7-78af5c6142bf tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:52.802162 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c2a7ef36-de19-4293-95b7-78af5c6142bf tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:52.878114 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-408b4d40-a83f-4d68-99df-d41042ece8dc tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:52.879033 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-408b4d40-a83f-4d68-99df-d41042ece8dc tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: 0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:52.892890 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-408b4d40-a83f-4d68-99df-d41042ece8dc tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:52.893515 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-408b4d40-a83f-4d68-99df-d41042ece8dc tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:52.894632 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-408b4d40-a83f-4d68-99df-d41042ece8dc tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:52.896180 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-408b4d40-a83f-4d68-99df-d41042ece8dc tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:52.897979 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-408b4d40-a83f-4d68-99df-d41042ece8dc tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:52.898520 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-408b4d40-a83f-4d68-99df-d41042ece8dc tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:53.157917 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-c2a7ef36-de19-4293-95b7-78af5c6142bf tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '814b873378304b909564638973604400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1545dd3a53941429a96aaea671fdd3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:53.165983 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-c2a7ef36-de19-4293-95b7-78af5c6142bf tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] 10.222.0.58 "GET /compute/v2.1/servers/173c58d3-70ae-4415-b257-1ee3a468eb20" status: 200 len: 1327 microversion: 2.1 time: 0.391003 Aug 10 23:21:53.179721 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2431/5067] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:21:52 2022] GET /compute/v2.1/servers/173c58d3-70ae-4415-b257-1ee3a468eb20 => generated 1327 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:21:53.210211 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-408b4d40-a83f-4d68-99df-d41042ece8dc tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6684f0c87e4242be9e0ffb4ef1973f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0582ace9e4443b8ad88915503ee630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:53.225546 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-408b4d40-a83f-4d68-99df-d41042ece8dc tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "GET /compute/v2.1/servers/0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d" status: 200 len: 1509 microversion: 2.1 time: 0.351685 Aug 10 23:21:53.227944 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2637/5068] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:21:52 2022] GET /compute/v2.1/servers/0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d => generated 1509 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:21:53.291774 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-132d9cbc-43e1-4c48-b04e-32d497afa795 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:53.293325 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-132d9cbc-43e1-4c48-b04e-32d497afa795 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] [instance: 32ddd6eb-6c3f-4bd1-b9be-f819e8ef3a68] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:53.300772 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-132d9cbc-43e1-4c48-b04e-32d497afa795 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:53.301640 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-132d9cbc-43e1-4c48-b04e-32d497afa795 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:53.302564 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-132d9cbc-43e1-4c48-b04e-32d497afa795 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:53.303679 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-132d9cbc-43e1-4c48-b04e-32d497afa795 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:53.304832 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-132d9cbc-43e1-4c48-b04e-32d497afa795 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:53.305488 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-132d9cbc-43e1-4c48-b04e-32d497afa795 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:53.632540 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-b9b3d9ef-f433-4b4b-baf0-582f18d13639 req-b81bdcb0-8cf0-4800-87d8-fcaec3c95694 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "173c58d3-70ae-4415-b257-1ee3a468eb20", "name": "network-vif-plugged", "status": "completed", "tag": "680b2f8c-3000-419b-8dc4-70be2fe00d8a"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:21:53.655787 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-b9b3d9ef-f433-4b4b-baf0-582f18d13639 req-b81bdcb0-8cf0-4800-87d8-fcaec3c95694 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:53.659371 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-b9b3d9ef-f433-4b4b-baf0-582f18d13639 req-b81bdcb0-8cf0-4800-87d8-fcaec3c95694 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:53.660048 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-b9b3d9ef-f433-4b4b-baf0-582f18d13639 req-b81bdcb0-8cf0-4800-87d8-fcaec3c95694 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:53.688089 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-b9b3d9ef-f433-4b4b-baf0-582f18d13639 req-b81bdcb0-8cf0-4800-87d8-fcaec3c95694 service nova] Creating event network-vif-plugged:680b2f8c-3000-419b-8dc4-70be2fe00d8a for instance 173c58d3-70ae-4415-b257-1ee3a468eb20 on n-h1-850468-14 Aug 10 23:21:53.696912 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-b9b3d9ef-f433-4b4b-baf0-582f18d13639 req-b81bdcb0-8cf0-4800-87d8-fcaec3c95694 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068261 Aug 10 23:21:53.697462 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2638/5069] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:21:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:21:53.747252 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-132d9cbc-43e1-4c48-b04e-32d497afa795 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5899b2ad9f1046caaf7c6073e408eeee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25abd63376614081a9d484f3c9ae950d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:53.764486 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-132d9cbc-43e1-4c48-b04e-32d497afa795 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "GET /compute/v2.1/servers/32ddd6eb-6c3f-4bd1-b9be-f819e8ef3a68" status: 200 len: 1692 microversion: 2.1 time: 0.476704 Aug 10 23:21:53.765396 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2432/5070] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:21:53 2022] GET /compute/v2.1/servers/32ddd6eb-6c3f-4bd1-b9be-f819e8ef3a68 => generated 1692 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:21:54.192129 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-827e2108-7544-4d10-b0d5-a2956576aa9c tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:54.192884 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-827e2108-7544-4d10-b0d5-a2956576aa9c tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] [instance: 173c58d3-70ae-4415-b257-1ee3a468eb20] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:54.203057 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-827e2108-7544-4d10-b0d5-a2956576aa9c tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:54.204166 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-827e2108-7544-4d10-b0d5-a2956576aa9c tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:54.205157 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-827e2108-7544-4d10-b0d5-a2956576aa9c tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:54.206596 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-827e2108-7544-4d10-b0d5-a2956576aa9c tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:54.208390 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-827e2108-7544-4d10-b0d5-a2956576aa9c tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:54.209185 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-827e2108-7544-4d10-b0d5-a2956576aa9c tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:54.249861 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-4144a15e-bb6a-43cd-b67d-67aa6897a242 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:54.251185 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-4144a15e-bb6a-43cd-b67d-67aa6897a242 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: 0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:54.265961 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4144a15e-bb6a-43cd-b67d-67aa6897a242 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:54.266668 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4144a15e-bb6a-43cd-b67d-67aa6897a242 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:54.271257 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4144a15e-bb6a-43cd-b67d-67aa6897a242 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:54.272864 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4144a15e-bb6a-43cd-b67d-67aa6897a242 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:54.278896 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4144a15e-bb6a-43cd-b67d-67aa6897a242 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:54.279546 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4144a15e-bb6a-43cd-b67d-67aa6897a242 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:54.535889 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-4144a15e-bb6a-43cd-b67d-67aa6897a242 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6684f0c87e4242be9e0ffb4ef1973f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0582ace9e4443b8ad88915503ee630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:54.544666 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-4144a15e-bb6a-43cd-b67d-67aa6897a242 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "GET /compute/v2.1/servers/0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d" status: 200 len: 1509 microversion: 2.1 time: 0.298894 Aug 10 23:21:54.545981 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2433/5071] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:21:54 2022] GET /compute/v2.1/servers/0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d => generated 1509 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:21:54.719676 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-827e2108-7544-4d10-b0d5-a2956576aa9c tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '814b873378304b909564638973604400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1545dd3a53941429a96aaea671fdd3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:54.729066 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-827e2108-7544-4d10-b0d5-a2956576aa9c tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] 10.222.0.58 "GET /compute/v2.1/servers/173c58d3-70ae-4415-b257-1ee3a468eb20" status: 200 len: 1327 microversion: 2.1 time: 0.542895 Aug 10 23:21:54.730159 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2639/5072] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:21:54 2022] GET /compute/v2.1/servers/173c58d3-70ae-4415-b257-1ee3a468eb20 => generated 1327 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:21:54.787574 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-db464786-c247-45f8-af14-77f553c160ce tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:54.788519 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-db464786-c247-45f8-af14-77f553c160ce tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] [instance: 32ddd6eb-6c3f-4bd1-b9be-f819e8ef3a68] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:54.797224 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-db464786-c247-45f8-af14-77f553c160ce tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:54.798024 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-db464786-c247-45f8-af14-77f553c160ce tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:54.798697 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-db464786-c247-45f8-af14-77f553c160ce tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:54.799672 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-db464786-c247-45f8-af14-77f553c160ce tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:54.800604 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-db464786-c247-45f8-af14-77f553c160ce tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:54.801049 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-db464786-c247-45f8-af14-77f553c160ce tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:55.179335 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-db464786-c247-45f8-af14-77f553c160ce tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5899b2ad9f1046caaf7c6073e408eeee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25abd63376614081a9d484f3c9ae950d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:55.194757 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-db464786-c247-45f8-af14-77f553c160ce tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "GET /compute/v2.1/servers/32ddd6eb-6c3f-4bd1-b9be-f819e8ef3a68" status: 200 len: 1692 microversion: 2.1 time: 0.411458 Aug 10 23:21:55.195404 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2434/5073] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:21:54 2022] GET /compute/v2.1/servers/32ddd6eb-6c3f-4bd1-b9be-f819e8ef3a68 => generated 1692 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:21:55.577307 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-3791b0a0-47be-4eca-801a-35b80a3a104f tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:55.578658 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-3791b0a0-47be-4eca-801a-35b80a3a104f tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: 0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:55.597811 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3791b0a0-47be-4eca-801a-35b80a3a104f tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:55.598618 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3791b0a0-47be-4eca-801a-35b80a3a104f tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:55.599271 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3791b0a0-47be-4eca-801a-35b80a3a104f tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:55.601465 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3791b0a0-47be-4eca-801a-35b80a3a104f tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:55.602321 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3791b0a0-47be-4eca-801a-35b80a3a104f tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:55.603448 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3791b0a0-47be-4eca-801a-35b80a3a104f tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:55.752449 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-28cbdaeb-3180-459f-bdf8-3e58c24efa3d tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:55.753264 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-28cbdaeb-3180-459f-bdf8-3e58c24efa3d tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] [instance: 173c58d3-70ae-4415-b257-1ee3a468eb20] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:55.762972 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-28cbdaeb-3180-459f-bdf8-3e58c24efa3d tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:55.763615 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-28cbdaeb-3180-459f-bdf8-3e58c24efa3d tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:55.764785 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-28cbdaeb-3180-459f-bdf8-3e58c24efa3d tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:55.765929 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-28cbdaeb-3180-459f-bdf8-3e58c24efa3d tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:55.766723 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-28cbdaeb-3180-459f-bdf8-3e58c24efa3d tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:55.767591 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-28cbdaeb-3180-459f-bdf8-3e58c24efa3d tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:55.784899 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-3791b0a0-47be-4eca-801a-35b80a3a104f tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6684f0c87e4242be9e0ffb4ef1973f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0582ace9e4443b8ad88915503ee630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:55.797433 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-3791b0a0-47be-4eca-801a-35b80a3a104f tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "GET /compute/v2.1/servers/0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d" status: 200 len: 1509 microversion: 2.1 time: 0.228887 Aug 10 23:21:55.798330 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2640/5074] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:21:55 2022] GET /compute/v2.1/servers/0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d => generated 1509 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:21:56.216617 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-7c873c52-632d-4317-bade-b760dafbcbd5 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:56.217567 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-7c873c52-632d-4317-bade-b760dafbcbd5 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] [instance: 32ddd6eb-6c3f-4bd1-b9be-f819e8ef3a68] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:56.224427 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7c873c52-632d-4317-bade-b760dafbcbd5 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:56.224927 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7c873c52-632d-4317-bade-b760dafbcbd5 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:56.225368 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7c873c52-632d-4317-bade-b760dafbcbd5 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:56.231639 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7c873c52-632d-4317-bade-b760dafbcbd5 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:56.232142 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7c873c52-632d-4317-bade-b760dafbcbd5 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:56.233362 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7c873c52-632d-4317-bade-b760dafbcbd5 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:56.405325 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-7c873c52-632d-4317-bade-b760dafbcbd5 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5899b2ad9f1046caaf7c6073e408eeee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25abd63376614081a9d484f3c9ae950d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:56.409839 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:21:56.415319 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-7c873c52-632d-4317-bade-b760dafbcbd5 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "GET /compute/v2.1/servers/32ddd6eb-6c3f-4bd1-b9be-f819e8ef3a68" status: 200 len: 1692 microversion: 2.1 time: 0.202491 Aug 10 23:21:56.416422 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2641/5075] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:21:56 2022] GET /compute/v2.1/servers/32ddd6eb-6c3f-4bd1-b9be-f819e8ef3a68 => generated 1692 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:21:56.455733 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-28cbdaeb-3180-459f-bdf8-3e58c24efa3d tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '814b873378304b909564638973604400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1545dd3a53941429a96aaea671fdd3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:56.465473 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-28cbdaeb-3180-459f-bdf8-3e58c24efa3d tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] 10.222.0.58 "GET /compute/v2.1/servers/173c58d3-70ae-4415-b257-1ee3a468eb20" status: 200 len: 1528 microversion: 2.1 time: 0.717459 Aug 10 23:21:56.466865 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2435/5076] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:21:55 2022] GET /compute/v2.1/servers/173c58d3-70ae-4415-b257-1ee3a468eb20 => generated 1528 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:21:56.493473 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-a954410c-ff96-40ba-98c7-11000d54d06e tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:56.494764 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-a954410c-ff96-40ba-98c7-11000d54d06e tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] [instance: 173c58d3-70ae-4415-b257-1ee3a468eb20] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:56.511920 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a954410c-ff96-40ba-98c7-11000d54d06e tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:56.512426 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a954410c-ff96-40ba-98c7-11000d54d06e tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:56.512874 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a954410c-ff96-40ba-98c7-11000d54d06e tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:56.513594 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a954410c-ff96-40ba-98c7-11000d54d06e tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:56.514581 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a954410c-ff96-40ba-98c7-11000d54d06e tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:56.515042 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a954410c-ff96-40ba-98c7-11000d54d06e tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:56.698703 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-a954410c-ff96-40ba-98c7-11000d54d06e tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '814b873378304b909564638973604400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1545dd3a53941429a96aaea671fdd3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:56.707033 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-a954410c-ff96-40ba-98c7-11000d54d06e tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] 10.222.0.58 "GET /compute/v2.1/servers/173c58d3-70ae-4415-b257-1ee3a468eb20" status: 200 len: 1528 microversion: 2.1 time: 0.220349 Aug 10 23:21:56.707661 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2642/5077] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:21:56 2022] GET /compute/v2.1/servers/173c58d3-70ae-4415-b257-1ee3a468eb20 => generated 1528 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:21:56.832543 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-270d5769-2f8f-4816-9182-474f1ce6aa51 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:56.833322 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-270d5769-2f8f-4816-9182-474f1ce6aa51 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: 0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:56.841653 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-270d5769-2f8f-4816-9182-474f1ce6aa51 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:56.843290 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-270d5769-2f8f-4816-9182-474f1ce6aa51 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:56.844181 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-270d5769-2f8f-4816-9182-474f1ce6aa51 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:56.845263 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-270d5769-2f8f-4816-9182-474f1ce6aa51 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:56.845966 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-270d5769-2f8f-4816-9182-474f1ce6aa51 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:56.857531 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-270d5769-2f8f-4816-9182-474f1ce6aa51 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:56.997306 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-efcd3717-83cc-47eb-9da5-c2457452630a tempest-ServersNegativeTestMultiTenantJSON-1647893654 tempest-ServersNegativeTestMultiTenantJSON-1647893654-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:57.003461 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-efcd3717-83cc-47eb-9da5-c2457452630a tempest-ServersNegativeTestMultiTenantJSON-1647893654 tempest-ServersNegativeTestMultiTenantJSON-1647893654-project] [instance: 173c58d3-70ae-4415-b257-1ee3a468eb20] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:57.017964 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-efcd3717-83cc-47eb-9da5-c2457452630a tempest-ServersNegativeTestMultiTenantJSON-1647893654 tempest-ServersNegativeTestMultiTenantJSON-1647893654-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:57.018468 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-efcd3717-83cc-47eb-9da5-c2457452630a tempest-ServersNegativeTestMultiTenantJSON-1647893654 tempest-ServersNegativeTestMultiTenantJSON-1647893654-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:57.021849 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-efcd3717-83cc-47eb-9da5-c2457452630a tempest-ServersNegativeTestMultiTenantJSON-1647893654 tempest-ServersNegativeTestMultiTenantJSON-1647893654-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:57.022605 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-efcd3717-83cc-47eb-9da5-c2457452630a tempest-ServersNegativeTestMultiTenantJSON-1647893654 tempest-ServersNegativeTestMultiTenantJSON-1647893654-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:57.023130 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-efcd3717-83cc-47eb-9da5-c2457452630a tempest-ServersNegativeTestMultiTenantJSON-1647893654 tempest-ServersNegativeTestMultiTenantJSON-1647893654-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:57.025910 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-efcd3717-83cc-47eb-9da5-c2457452630a tempest-ServersNegativeTestMultiTenantJSON-1647893654 tempest-ServersNegativeTestMultiTenantJSON-1647893654-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:57.049263 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-efcd3717-83cc-47eb-9da5-c2457452630a tempest-ServersNegativeTestMultiTenantJSON-1647893654 tempest-ServersNegativeTestMultiTenantJSON-1647893654-project] HTTP exception thrown: Instance 173c58d3-70ae-4415-b257-1ee3a468eb20 could not be found. Aug 10 23:21:57.051555 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-efcd3717-83cc-47eb-9da5-c2457452630a tempest-ServersNegativeTestMultiTenantJSON-1647893654 tempest-ServersNegativeTestMultiTenantJSON-1647893654-project] Request method failure captured: Aug 10 23:21:57.051555 n-d-850468-14 devstack@n-api.service[122632]: request: DELETE /compute/v2.1/servers/173c58d3-70ae-4415-b257-1ee3a468eb20 HTTP/1.1 Aug 10 23:21:57.051555 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:21:57.051555 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:21:57.051555 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:21:57.051555 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 23:21:57.051555 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:21:57.051555 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:21:57.051555 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:21:57.051555 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:21:57.051555 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9D2ADukGC_TILBBOCnCtZJJGmU7vi6Yx7vKeUrf4A5aFNVSh5SilRh57qYc4E7JxStJd0N1sAwy34K6zVzHb2RUTJnDRHCqZhtp5XA1YwyPxHkgfCxCtM_FxpJIAue1o5VzRyw9eB4aBt6qqp-JLYYSKq8Q5Xr0V0TwDYbfjQ-r5H6I Aug 10 23:21:57.051555 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:21:57.051555 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:21:57.051555 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:21:57.051555 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:21:57.051555 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:21:57.051555 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:21:57.051555 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: e3631cd0ae304311920f8fb64c397b2a Aug 10 23:21:57.051555 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1647893654 Aug 10 23:21:57.051555 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:21:57.051555 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:21:57.051555 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e3631cd0ae304311920f8fb64c397b2a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e3631cd0ae304311920f8fb64c397b2a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/e3631cd0ae304311920f8fb64c397b2a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_e3631cd0ae304311920f8fb64c397b2a", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:21:57.051555 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1647893654 Aug 10 23:21:57.051555 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: e3631cd0ae304311920f8fb64c397b2a Aug 10 23:21:57.051555 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1647893654 Aug 10 23:21:57.051555 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1647893654-project Aug 10 23:21:57.051555 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:21:57.051555 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:21:57.051555 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: 7627e5f6066c4861bd0ec6e9347a099e Aug 10 23:21:57.051555 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1647893654-project Aug 10 23:21:57.051555 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:21:57.051555 n-d-850468-14 devstack@n-api.service[122632]: exception: Instance 173c58d3-70ae-4415-b257-1ee3a468eb20 could not be found. Aug 10 23:21:57.051555 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': '173c58d3-70ae-4415-b257-1ee3a468eb20'} Aug 10 23:21:57.051555 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:21:57.051555 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:21:57.051555 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:21:57.051555 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:21:57.051555 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:21:57.051555 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:21:57.051555 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:21:57.051555 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:21:57.051555 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:21:57.051555 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:21:57.051555 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 173c58d3-70ae-4415-b257-1ee3a468eb20 could not be found. Aug 10 23:21:57.051555 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:21:57.051555 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:21:57.051555 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:21:57.051555 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:21:57.051555 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:21:57.051555 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:21:57.051555 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:21:57.051555 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:21:57.051555 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:21:57.051555 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:21:57.051555 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 23:21:57.051555 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 23:21:57.051555 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 23:21:57.051555 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 23:21:57.051555 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:21:57.051555 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:21:57.051555 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:21:57.051555 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:21:57.058160 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 173c58d3-70ae-4415-b257-1ee3a468eb20 could not be found. Aug 10 23:21:57.058160 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:21:57.058160 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:21:57.058160 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:21:57.058160 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:21:57.058160 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:21:57.058160 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:21:57.058160 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:21:57.058160 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:21:57.058160 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 173c58d3-70ae-4415-b257-1ee3a468eb20 could not be found. Aug 10 23:21:57.058160 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:21:57.062008 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-efcd3717-83cc-47eb-9da5-c2457452630a tempest-ServersNegativeTestMultiTenantJSON-1647893654 tempest-ServersNegativeTestMultiTenantJSON-1647893654-project] Returning 404 to user: Instance 173c58d3-70ae-4415-b257-1ee3a468eb20 could not be found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:21:57.063843 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-efcd3717-83cc-47eb-9da5-c2457452630a tempest-ServersNegativeTestMultiTenantJSON-1647893654 tempest-ServersNegativeTestMultiTenantJSON-1647893654-project] 10.222.0.58 "DELETE /compute/v2.1/servers/173c58d3-70ae-4415-b257-1ee3a468eb20" status: 404 len: 111 microversion: 2.1 time: 0.339998 Aug 10 23:21:57.065618 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2436/5078] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:21:56 2022] DELETE /compute/v2.1/servers/173c58d3-70ae-4415-b257-1ee3a468eb20 => generated 111 bytes in 342 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:21:57.081978 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-e531c1ae-303f-4b86-8274-b6cabed2c03b tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:57.083249 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-e531c1ae-303f-4b86-8274-b6cabed2c03b tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] [instance: 173c58d3-70ae-4415-b257-1ee3a468eb20] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:57.091093 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e531c1ae-303f-4b86-8274-b6cabed2c03b tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:57.091874 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e531c1ae-303f-4b86-8274-b6cabed2c03b tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:57.093017 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e531c1ae-303f-4b86-8274-b6cabed2c03b tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:57.094059 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e531c1ae-303f-4b86-8274-b6cabed2c03b tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:57.094716 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e531c1ae-303f-4b86-8274-b6cabed2c03b tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:57.096176 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e531c1ae-303f-4b86-8274-b6cabed2c03b tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:57.215120 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-270d5769-2f8f-4816-9182-474f1ce6aa51 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6684f0c87e4242be9e0ffb4ef1973f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0582ace9e4443b8ad88915503ee630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:57.223768 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-270d5769-2f8f-4816-9182-474f1ce6aa51 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "GET /compute/v2.1/servers/0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d" status: 200 len: 1509 microversion: 2.1 time: 0.404510 Aug 10 23:21:57.224727 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2643/5079] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:21:56 2022] GET /compute/v2.1/servers/0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d => generated 1509 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:21:57.302469 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-e531c1ae-303f-4b86-8274-b6cabed2c03b tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '814b873378304b909564638973604400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1545dd3a53941429a96aaea671fdd3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:57.313925 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-e531c1ae-303f-4b86-8274-b6cabed2c03b tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] 10.222.0.58 "GET /compute/v2.1/servers/173c58d3-70ae-4415-b257-1ee3a468eb20" status: 200 len: 1528 microversion: 2.1 time: 0.242249 Aug 10 23:21:57.315470 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2437/5080] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:21:57 2022] GET /compute/v2.1/servers/173c58d3-70ae-4415-b257-1ee3a468eb20 => generated 1528 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:21:57.335123 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-fc272de3-9930-43fb-bf89-1b8080e24006 tempest-ServersNegativeTestMultiTenantJSON-1647893654 tempest-ServersNegativeTestMultiTenantJSON-1647893654-project] Action: 'update', calling method: >, body: {"server": {"name": "173c58d3-70ae-4415-b257-1ee3a468eb20_new"}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:21:57.338032 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-fc272de3-9930-43fb-bf89-1b8080e24006 tempest-ServersNegativeTestMultiTenantJSON-1647893654 tempest-ServersNegativeTestMultiTenantJSON-1647893654-project] [instance: 173c58d3-70ae-4415-b257-1ee3a468eb20] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:57.351600 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fc272de3-9930-43fb-bf89-1b8080e24006 tempest-ServersNegativeTestMultiTenantJSON-1647893654 tempest-ServersNegativeTestMultiTenantJSON-1647893654-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:57.352291 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fc272de3-9930-43fb-bf89-1b8080e24006 tempest-ServersNegativeTestMultiTenantJSON-1647893654 tempest-ServersNegativeTestMultiTenantJSON-1647893654-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:57.353130 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fc272de3-9930-43fb-bf89-1b8080e24006 tempest-ServersNegativeTestMultiTenantJSON-1647893654 tempest-ServersNegativeTestMultiTenantJSON-1647893654-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:57.353885 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fc272de3-9930-43fb-bf89-1b8080e24006 tempest-ServersNegativeTestMultiTenantJSON-1647893654 tempest-ServersNegativeTestMultiTenantJSON-1647893654-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:57.354355 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fc272de3-9930-43fb-bf89-1b8080e24006 tempest-ServersNegativeTestMultiTenantJSON-1647893654 tempest-ServersNegativeTestMultiTenantJSON-1647893654-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:57.354812 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fc272de3-9930-43fb-bf89-1b8080e24006 tempest-ServersNegativeTestMultiTenantJSON-1647893654 tempest-ServersNegativeTestMultiTenantJSON-1647893654-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:57.371983 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-fc272de3-9930-43fb-bf89-1b8080e24006 tempest-ServersNegativeTestMultiTenantJSON-1647893654 tempest-ServersNegativeTestMultiTenantJSON-1647893654-project] HTTP exception thrown: Instance 173c58d3-70ae-4415-b257-1ee3a468eb20 could not be found. Aug 10 23:21:57.374863 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-fc272de3-9930-43fb-bf89-1b8080e24006 tempest-ServersNegativeTestMultiTenantJSON-1647893654 tempest-ServersNegativeTestMultiTenantJSON-1647893654-project] Request method failure captured: Aug 10 23:21:57.374863 n-d-850468-14 devstack@n-api.service[122633]: request: PUT /compute/v2.1/servers/173c58d3-70ae-4415-b257-1ee3a468eb20 HTTP/1.1 Aug 10 23:21:57.374863 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:21:57.374863 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:21:57.374863 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:21:57.374863 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 64 Aug 10 23:21:57.374863 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:21:57.374863 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:21:57.374863 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:21:57.374863 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:21:57.374863 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9D2ADukGC_TILBBOCnCtZJJGmU7vi6Yx7vKeUrf4A5aFNVSh5SilRh57qYc4E7JxStJd0N1sAwy34K6zVzHb2RUTJnDRHCqZhtp5XA1YwyPxHkgfCxCtM_FxpJIAue1o5VzRyw9eB4aBt6qqp-JLYYSKq8Q5Xr0V0TwDYbfjQ-r5H6I Aug 10 23:21:57.374863 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:21:57.374863 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:21:57.374863 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:21:57.374863 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:21:57.374863 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:21:57.374863 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:21:57.374863 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: e3631cd0ae304311920f8fb64c397b2a Aug 10 23:21:57.374863 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-1647893654 Aug 10 23:21:57.374863 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:21:57.374863 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:21:57.374863 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e3631cd0ae304311920f8fb64c397b2a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e3631cd0ae304311920f8fb64c397b2a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/e3631cd0ae304311920f8fb64c397b2a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_e3631cd0ae304311920f8fb64c397b2a", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:21:57.374863 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-1647893654 Aug 10 23:21:57.374863 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: e3631cd0ae304311920f8fb64c397b2a Aug 10 23:21:57.374863 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-1647893654 Aug 10 23:21:57.374863 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-ServersNegativeTestMultiTenantJSON-1647893654-project Aug 10 23:21:57.374863 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:21:57.374863 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:21:57.374863 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 7627e5f6066c4861bd0ec6e9347a099e Aug 10 23:21:57.374863 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-1647893654-project Aug 10 23:21:57.374863 n-d-850468-14 devstack@n-api.service[122633]: Aug 10 23:21:57.374863 n-d-850468-14 devstack@n-api.service[122633]: {"server": {"name": "173c58d3-70ae-4415-b257-1ee3a468eb20_new"}} Aug 10 23:21:57.374863 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:21:57.374863 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance 173c58d3-70ae-4415-b257-1ee3a468eb20 could not be found. Aug 10 23:21:57.374863 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': '173c58d3-70ae-4415-b257-1ee3a468eb20', 'body': {'server': {'name': '173c58d3-70ae-4415-b257-1ee3a468eb20_new'}}} Aug 10 23:21:57.374863 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:21:57.374863 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:21:57.374863 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:21:57.374863 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:21:57.374863 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:21:57.374863 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:21:57.374863 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:21:57.374863 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:21:57.374863 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:21:57.374863 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:21:57.374863 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 173c58d3-70ae-4415-b257-1ee3a468eb20 could not be found. Aug 10 23:21:57.374863 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:21:57.374863 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:21:57.374863 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:21:57.374863 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:21:57.374863 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:21:57.374863 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:21:57.374863 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:21:57.374863 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:21:57.374863 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:21:57.374863 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:21:57.374863 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 23:21:57.374863 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 23:21:57.374863 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 23:21:57.374863 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 23:21:57.374863 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 23:21:57.374863 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 23:21:57.374863 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 10 23:21:57.381030 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Aug 10 23:21:57.381030 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Aug 10 23:21:57.381030 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:21:57.381030 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:21:57.381030 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:21:57.381030 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:21:57.381030 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 173c58d3-70ae-4415-b257-1ee3a468eb20 could not be found. Aug 10 23:21:57.381030 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:21:57.381030 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:21:57.381030 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:21:57.381030 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:21:57.381030 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:21:57.381030 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:21:57.381030 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:21:57.381030 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:21:57.381030 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 173c58d3-70ae-4415-b257-1ee3a468eb20 could not be found. Aug 10 23:21:57.381030 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:21:57.384105 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-fc272de3-9930-43fb-bf89-1b8080e24006 tempest-ServersNegativeTestMultiTenantJSON-1647893654 tempest-ServersNegativeTestMultiTenantJSON-1647893654-project] Returning 404 to user: Instance 173c58d3-70ae-4415-b257-1ee3a468eb20 could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:21:57.385200 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-fc272de3-9930-43fb-bf89-1b8080e24006 tempest-ServersNegativeTestMultiTenantJSON-1647893654 tempest-ServersNegativeTestMultiTenantJSON-1647893654-project] 10.222.0.58 "PUT /compute/v2.1/servers/173c58d3-70ae-4415-b257-1ee3a468eb20" status: 404 len: 111 microversion: 2.1 time: 0.054306 Aug 10 23:21:57.394893 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2644/5081] 10.222.0.58 () {60 vars in 1256 bytes} [Wed Aug 10 23:21:57 2022] PUT /compute/v2.1/servers/173c58d3-70ae-4415-b257-1ee3a468eb20 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:21:57.397634 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-39e83068-4c96-4881-bd95-609ba0153697 tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:57.398129 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-39e83068-4c96-4881-bd95-609ba0153697 tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] [instance: 173c58d3-70ae-4415-b257-1ee3a468eb20] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:57.404318 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-39e83068-4c96-4881-bd95-609ba0153697 tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:57.405538 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-39e83068-4c96-4881-bd95-609ba0153697 tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:57.406254 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-39e83068-4c96-4881-bd95-609ba0153697 tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:57.407331 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-39e83068-4c96-4881-bd95-609ba0153697 tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:57.407994 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-39e83068-4c96-4881-bd95-609ba0153697 tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:57.408868 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-39e83068-4c96-4881-bd95-609ba0153697 tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:57.437514 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-39e83068-4c96-4881-bd95-609ba0153697 tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] [instance: 173c58d3-70ae-4415-b257-1ee3a468eb20] Going to try to terminate instance {{(pid=122632) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:21:57.438820 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-76b3958d-d698-4d0b-a7c4-4c502a33e276 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:57.439732 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-76b3958d-d698-4d0b-a7c4-4c502a33e276 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] [instance: 32ddd6eb-6c3f-4bd1-b9be-f819e8ef3a68] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:57.446279 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-76b3958d-d698-4d0b-a7c4-4c502a33e276 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:57.450093 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-76b3958d-d698-4d0b-a7c4-4c502a33e276 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:57.450690 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-76b3958d-d698-4d0b-a7c4-4c502a33e276 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:57.452142 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-76b3958d-d698-4d0b-a7c4-4c502a33e276 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:57.452965 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-76b3958d-d698-4d0b-a7c4-4c502a33e276 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:57.453500 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-76b3958d-d698-4d0b-a7c4-4c502a33e276 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:57.561749 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-39e83068-4c96-4881-bd95-609ba0153697 tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] 10.222.0.58 "DELETE /compute/v2.1/servers/173c58d3-70ae-4415-b257-1ee3a468eb20" status: 204 len: 0 microversion: 2.1 time: 0.168068 Aug 10 23:21:57.562771 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2438/5082] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:21:57 2022] DELETE /compute/v2.1/servers/173c58d3-70ae-4415-b257-1ee3a468eb20 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:21:57.571637 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-aad4bb1d-71c3-468c-90db-afa5576e3a03 tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:57.572837 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-aad4bb1d-71c3-468c-90db-afa5576e3a03 tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] [instance: 173c58d3-70ae-4415-b257-1ee3a468eb20] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:57.581623 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-aad4bb1d-71c3-468c-90db-afa5576e3a03 tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:57.582526 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-aad4bb1d-71c3-468c-90db-afa5576e3a03 tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:57.583249 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-aad4bb1d-71c3-468c-90db-afa5576e3a03 tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:57.584205 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-aad4bb1d-71c3-468c-90db-afa5576e3a03 tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:57.586747 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-aad4bb1d-71c3-468c-90db-afa5576e3a03 tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:57.587777 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-aad4bb1d-71c3-468c-90db-afa5576e3a03 tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:57.805421 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-aad4bb1d-71c3-468c-90db-afa5576e3a03 tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '814b873378304b909564638973604400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1545dd3a53941429a96aaea671fdd3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:57.814880 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-aad4bb1d-71c3-468c-90db-afa5576e3a03 tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] 10.222.0.58 "GET /compute/v2.1/servers/173c58d3-70ae-4415-b257-1ee3a468eb20" status: 200 len: 1534 microversion: 2.1 time: 0.247461 Aug 10 23:21:57.823203 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2439/5083] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:21:57 2022] GET /compute/v2.1/servers/173c58d3-70ae-4415-b257-1ee3a468eb20 => generated 1534 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:21:57.870358 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-76b3958d-d698-4d0b-a7c4-4c502a33e276 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5899b2ad9f1046caaf7c6073e408eeee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25abd63376614081a9d484f3c9ae950d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:57.879169 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-76b3958d-d698-4d0b-a7c4-4c502a33e276 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "GET /compute/v2.1/servers/32ddd6eb-6c3f-4bd1-b9be-f819e8ef3a68" status: 200 len: 1698 microversion: 2.1 time: 0.445086 Aug 10 23:21:57.880247 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2645/5084] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:21:57 2022] GET /compute/v2.1/servers/32ddd6eb-6c3f-4bd1-b9be-f819e8ef3a68 => generated 1698 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:21:58.053076 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-fc4dda97-36c7-429b-9aa4-fdb7bed3f38e tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] Calling method '.version_select at 0x7f847db341f0>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:58.078165 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-fc4dda97-36c7-429b-9aa4-fdb7bed3f38e tempest-TestSecurityGroupsBasicOps-858173259 tempest-TestSecurityGroupsBasicOps-858173259-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-295433155" status: 202 len: 0 microversion: 2.1 time: 0.029105 Aug 10 23:21:58.084186 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2440/5085] 10.222.0.58 () {58 vars in 1275 bytes} [Wed Aug 10 23:21:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-295433155 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:21:58.246955 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-11b3bf49-32ea-48c6-a59a-4b11528b3123 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:58.247879 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-11b3bf49-32ea-48c6-a59a-4b11528b3123 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: 0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:58.256261 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-11b3bf49-32ea-48c6-a59a-4b11528b3123 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:58.257130 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-11b3bf49-32ea-48c6-a59a-4b11528b3123 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:58.257818 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-11b3bf49-32ea-48c6-a59a-4b11528b3123 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:58.258949 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-11b3bf49-32ea-48c6-a59a-4b11528b3123 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:58.259816 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-11b3bf49-32ea-48c6-a59a-4b11528b3123 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:58.260483 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-11b3bf49-32ea-48c6-a59a-4b11528b3123 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:58.459149 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-11b3bf49-32ea-48c6-a59a-4b11528b3123 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6684f0c87e4242be9e0ffb4ef1973f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0582ace9e4443b8ad88915503ee630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:58.471485 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-11b3bf49-32ea-48c6-a59a-4b11528b3123 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "GET /compute/v2.1/servers/0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d" status: 200 len: 1509 microversion: 2.1 time: 0.228888 Aug 10 23:21:58.476640 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2646/5086] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:21:58 2022] GET /compute/v2.1/servers/0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d => generated 1509 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:21:58.837211 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-89d10141-31be-4f9d-ad46-ecf1c9faf0c1 tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:58.838169 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-89d10141-31be-4f9d-ad46-ecf1c9faf0c1 tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] [instance: 173c58d3-70ae-4415-b257-1ee3a468eb20] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:58.847486 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-89d10141-31be-4f9d-ad46-ecf1c9faf0c1 tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:58.848373 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-89d10141-31be-4f9d-ad46-ecf1c9faf0c1 tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:58.849064 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-89d10141-31be-4f9d-ad46-ecf1c9faf0c1 tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:58.849990 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-89d10141-31be-4f9d-ad46-ecf1c9faf0c1 tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:58.850648 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-89d10141-31be-4f9d-ad46-ecf1c9faf0c1 tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:58.851338 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-89d10141-31be-4f9d-ad46-ecf1c9faf0c1 tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:58.904760 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-08ff0a32-e563-4e89-bb36-845392487e45 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:58.905554 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-08ff0a32-e563-4e89-bb36-845392487e45 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] [instance: 32ddd6eb-6c3f-4bd1-b9be-f819e8ef3a68] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:58.913005 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-08ff0a32-e563-4e89-bb36-845392487e45 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:58.913836 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-08ff0a32-e563-4e89-bb36-845392487e45 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:58.914573 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-08ff0a32-e563-4e89-bb36-845392487e45 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:58.915562 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-08ff0a32-e563-4e89-bb36-845392487e45 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:58.916285 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-08ff0a32-e563-4e89-bb36-845392487e45 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:58.917082 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-08ff0a32-e563-4e89-bb36-845392487e45 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:59.115859 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-89d10141-31be-4f9d-ad46-ecf1c9faf0c1 tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '814b873378304b909564638973604400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1545dd3a53941429a96aaea671fdd3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:59.144669 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-89d10141-31be-4f9d-ad46-ecf1c9faf0c1 tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] 10.222.0.58 "GET /compute/v2.1/servers/173c58d3-70ae-4415-b257-1ee3a468eb20" status: 200 len: 1534 microversion: 2.1 time: 0.311991 Aug 10 23:21:59.145563 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2441/5087] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:21:58 2022] GET /compute/v2.1/servers/173c58d3-70ae-4415-b257-1ee3a468eb20 => generated 1534 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:21:59.366247 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-08ff0a32-e563-4e89-bb36-845392487e45 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5899b2ad9f1046caaf7c6073e408eeee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25abd63376614081a9d484f3c9ae950d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:59.381136 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-08ff0a32-e563-4e89-bb36-845392487e45 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "GET /compute/v2.1/servers/32ddd6eb-6c3f-4bd1-b9be-f819e8ef3a68" status: 200 len: 1698 microversion: 2.1 time: 0.480371 Aug 10 23:21:59.387551 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2647/5088] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:21:58 2022] GET /compute/v2.1/servers/32ddd6eb-6c3f-4bd1-b9be-f819e8ef3a68 => generated 1698 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:21:59.495128 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-85f2cc58-6a44-4a54-a47e-134d27ea2572 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:21:59.496213 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-85f2cc58-6a44-4a54-a47e-134d27ea2572 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: 0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:21:59.511526 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-85f2cc58-6a44-4a54-a47e-134d27ea2572 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:59.513426 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-85f2cc58-6a44-4a54-a47e-134d27ea2572 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:59.516396 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-85f2cc58-6a44-4a54-a47e-134d27ea2572 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:59.519062 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-85f2cc58-6a44-4a54-a47e-134d27ea2572 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:21:59.522535 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-85f2cc58-6a44-4a54-a47e-134d27ea2572 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:21:59.523728 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-85f2cc58-6a44-4a54-a47e-134d27ea2572 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:21:59.956460 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-85f2cc58-6a44-4a54-a47e-134d27ea2572 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6684f0c87e4242be9e0ffb4ef1973f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0582ace9e4443b8ad88915503ee630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:21:59.965035 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-85f2cc58-6a44-4a54-a47e-134d27ea2572 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "GET /compute/v2.1/servers/0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d" status: 200 len: 1509 microversion: 2.1 time: 0.474895 Aug 10 23:21:59.966093 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2442/5089] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:21:59 2022] GET /compute/v2.1/servers/0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d => generated 1509 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:22:00.166660 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-74e6b6b9-e068-4d0b-89c5-9684e95c3093 tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:00.167258 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-74e6b6b9-e068-4d0b-89c5-9684e95c3093 tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] [instance: 173c58d3-70ae-4415-b257-1ee3a468eb20] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:00.176613 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-74e6b6b9-e068-4d0b-89c5-9684e95c3093 tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:00.177229 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-74e6b6b9-e068-4d0b-89c5-9684e95c3093 tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:00.177743 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-74e6b6b9-e068-4d0b-89c5-9684e95c3093 tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:00.178539 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-74e6b6b9-e068-4d0b-89c5-9684e95c3093 tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:00.179287 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-74e6b6b9-e068-4d0b-89c5-9684e95c3093 tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:00.179776 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-74e6b6b9-e068-4d0b-89c5-9684e95c3093 tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:00.392915 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-74e6b6b9-e068-4d0b-89c5-9684e95c3093 tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '814b873378304b909564638973604400', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1545dd3a53941429a96aaea671fdd3b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:00.409464 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-a8d79a9f-2eca-431e-be7a-271c8c6a9ed6 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:00.410059 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-a8d79a9f-2eca-431e-be7a-271c8c6a9ed6 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] [instance: 32ddd6eb-6c3f-4bd1-b9be-f819e8ef3a68] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:00.421601 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-74e6b6b9-e068-4d0b-89c5-9684e95c3093 tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] 10.222.0.58 "GET /compute/v2.1/servers/173c58d3-70ae-4415-b257-1ee3a468eb20" status: 200 len: 1492 microversion: 2.1 time: 0.246966 Aug 10 23:22:00.422695 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2648/5090] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:22:00 2022] GET /compute/v2.1/servers/173c58d3-70ae-4415-b257-1ee3a468eb20 => generated 1492 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:22:00.426621 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a8d79a9f-2eca-431e-be7a-271c8c6a9ed6 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:00.427200 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a8d79a9f-2eca-431e-be7a-271c8c6a9ed6 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:00.429503 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a8d79a9f-2eca-431e-be7a-271c8c6a9ed6 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:00.431485 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a8d79a9f-2eca-431e-be7a-271c8c6a9ed6 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:00.434246 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a8d79a9f-2eca-431e-be7a-271c8c6a9ed6 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:00.434720 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a8d79a9f-2eca-431e-be7a-271c8c6a9ed6 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:00.524622 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-ad3aa483-8052-4e20-9f57-4b00b1e90469 req-3950fc4d-4b76-4285-a103-7156998f7f45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "173c58d3-70ae-4415-b257-1ee3a468eb20", "name": "network-vif-deleted", "tag": "680b2f8c-3000-419b-8dc4-70be2fe00d8a"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:22:00.560253 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-ad3aa483-8052-4e20-9f57-4b00b1e90469 req-3950fc4d-4b76-4285-a103-7156998f7f45 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:00.573612 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-ad3aa483-8052-4e20-9f57-4b00b1e90469 req-3950fc4d-4b76-4285-a103-7156998f7f45 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:00.574541 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-ad3aa483-8052-4e20-9f57-4b00b1e90469 req-3950fc4d-4b76-4285-a103-7156998f7f45 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:00.621793 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-ad3aa483-8052-4e20-9f57-4b00b1e90469 req-3950fc4d-4b76-4285-a103-7156998f7f45 service nova] Creating event network-vif-deleted:680b2f8c-3000-419b-8dc4-70be2fe00d8a for instance 173c58d3-70ae-4415-b257-1ee3a468eb20 on n-h1-850468-14 Aug 10 23:22:00.632986 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-ad3aa483-8052-4e20-9f57-4b00b1e90469 req-3950fc4d-4b76-4285-a103-7156998f7f45 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115157 Aug 10 23:22:00.633846 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2649/5091] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:22:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 23:22:00.865182 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-a8d79a9f-2eca-431e-be7a-271c8c6a9ed6 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5899b2ad9f1046caaf7c6073e408eeee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25abd63376614081a9d484f3c9ae950d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:00.880315 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-a8d79a9f-2eca-431e-be7a-271c8c6a9ed6 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "GET /compute/v2.1/servers/32ddd6eb-6c3f-4bd1-b9be-f819e8ef3a68" status: 200 len: 1683 microversion: 2.1 time: 0.474795 Aug 10 23:22:00.882714 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2443/5092] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:22:00 2022] GET /compute/v2.1/servers/32ddd6eb-6c3f-4bd1-b9be-f819e8ef3a68 => generated 1683 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:22:00.988675 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-5decd230-21a0-43b3-b841-c01c9123ecdb tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:00.991516 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-5decd230-21a0-43b3-b841-c01c9123ecdb tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: 0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:01.000063 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5decd230-21a0-43b3-b841-c01c9123ecdb tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:01.000825 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5decd230-21a0-43b3-b841-c01c9123ecdb tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:01.001485 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5decd230-21a0-43b3-b841-c01c9123ecdb tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:01.002420 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5decd230-21a0-43b3-b841-c01c9123ecdb tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:01.003115 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5decd230-21a0-43b3-b841-c01c9123ecdb tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:01.003628 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5decd230-21a0-43b3-b841-c01c9123ecdb tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:01.375151 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-9d8e3416-7eda-4ac1-bdd5-132db0961fcf req-dc51fc6c-84fd-4001-95c8-0ae86828d5bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32ddd6eb-6c3f-4bd1-b9be-f819e8ef3a68", "name": "network-vif-plugged", "status": "completed", "tag": "4f9f24c0-e01f-4d27-8d15-06a370ec5bb8"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:22:01.388051 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-9d8e3416-7eda-4ac1-bdd5-132db0961fcf req-dc51fc6c-84fd-4001-95c8-0ae86828d5bb service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:01.388551 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-9d8e3416-7eda-4ac1-bdd5-132db0961fcf req-dc51fc6c-84fd-4001-95c8-0ae86828d5bb service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:01.395151 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-9d8e3416-7eda-4ac1-bdd5-132db0961fcf req-dc51fc6c-84fd-4001-95c8-0ae86828d5bb service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:01.421131 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-9d8e3416-7eda-4ac1-bdd5-132db0961fcf req-dc51fc6c-84fd-4001-95c8-0ae86828d5bb service nova] Creating event network-vif-plugged:4f9f24c0-e01f-4d27-8d15-06a370ec5bb8 for instance 32ddd6eb-6c3f-4bd1-b9be-f819e8ef3a68 on n-h2-850468-14 Aug 10 23:22:01.429907 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-9d8e3416-7eda-4ac1-bdd5-132db0961fcf req-dc51fc6c-84fd-4001-95c8-0ae86828d5bb service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058146 Aug 10 23:22:01.433853 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2444/5093] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:22:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:22:01.455279 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-76ed0f56-19bc-4e69-a56f-ac19137f8a0c tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:01.457023 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-76ed0f56-19bc-4e69-a56f-ac19137f8a0c tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] [instance: 173c58d3-70ae-4415-b257-1ee3a468eb20] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:01.468205 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-76ed0f56-19bc-4e69-a56f-ac19137f8a0c tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:01.468715 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-76ed0f56-19bc-4e69-a56f-ac19137f8a0c tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:01.469316 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-76ed0f56-19bc-4e69-a56f-ac19137f8a0c tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:01.471057 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-76ed0f56-19bc-4e69-a56f-ac19137f8a0c tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:01.471605 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-76ed0f56-19bc-4e69-a56f-ac19137f8a0c tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:01.472097 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-76ed0f56-19bc-4e69-a56f-ac19137f8a0c tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:01.494897 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-76ed0f56-19bc-4e69-a56f-ac19137f8a0c tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] HTTP exception thrown: Instance 173c58d3-70ae-4415-b257-1ee3a468eb20 could not be found. Aug 10 23:22:01.497674 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-76ed0f56-19bc-4e69-a56f-ac19137f8a0c tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] Request method failure captured: Aug 10 23:22:01.497674 n-d-850468-14 devstack@n-api.service[122632]: request: GET /compute/v2.1/servers/173c58d3-70ae-4415-b257-1ee3a468eb20 HTTP/1.1 Aug 10 23:22:01.497674 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:22:01.497674 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:22:01.497674 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:22:01.497674 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 23:22:01.497674 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:22:01.497674 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:22:01.497674 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:22:01.497674 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:22:01.497674 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9D1syCnvGfZLAflPxg6IG4N8q10VJS6JXVTMNTGKPJo5gZ3GrtpA282E_Y1BDaUFH72tyEU_A3T97C1Zxvct11XEi-bgszMvAI9HBuevTL9IygTGJCFw21sbiLhCPOiv3eZgbiwBid4t_FomprlO4yI-lPxO6FqH2U5nrnAT7xsWNBM Aug 10 23:22:01.497674 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:22:01.497674 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:22:01.497674 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:22:01.497674 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:22:01.497674 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:22:01.497674 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:22:01.497674 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: e1545dd3a53941429a96aaea671fdd3b Aug 10 23:22:01.497674 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-127894808 Aug 10 23:22:01.497674 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:22:01.497674 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:22:01.497674 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e1545dd3a53941429a96aaea671fdd3b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e1545dd3a53941429a96aaea671fdd3b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/e1545dd3a53941429a96aaea671fdd3b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_e1545dd3a53941429a96aaea671fdd3b", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:22:01.497674 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-127894808 Aug 10 23:22:01.497674 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: e1545dd3a53941429a96aaea671fdd3b Aug 10 23:22:01.497674 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-127894808 Aug 10 23:22:01.497674 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-ServersNegativeTestMultiTenantJSON-127894808-project Aug 10 23:22:01.497674 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:22:01.497674 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:22:01.497674 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: 814b873378304b909564638973604400 Aug 10 23:22:01.497674 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-127894808-project Aug 10 23:22:01.497674 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:22:01.497674 n-d-850468-14 devstack@n-api.service[122632]: exception: Instance 173c58d3-70ae-4415-b257-1ee3a468eb20 could not be found. Aug 10 23:22:01.497674 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': '173c58d3-70ae-4415-b257-1ee3a468eb20'} Aug 10 23:22:01.497674 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:22:01.497674 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:22:01.497674 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:22:01.497674 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:22:01.497674 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:22:01.497674 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:22:01.497674 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:22:01.497674 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:22:01.497674 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:22:01.497674 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:22:01.497674 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 173c58d3-70ae-4415-b257-1ee3a468eb20 could not be found. Aug 10 23:22:01.497674 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:22:01.497674 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:22:01.497674 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:22:01.497674 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:22:01.497674 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:22:01.497674 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:22:01.497674 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:22:01.497674 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:22:01.497674 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:22:01.497674 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:22:01.497674 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:22:01.497674 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:22:01.497674 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:22:01.497674 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:22:01.497674 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:22:01.497674 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:22:01.497674 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 173c58d3-70ae-4415-b257-1ee3a468eb20 could not be found. Aug 10 23:22:01.497674 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:22:01.504383 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:22:01.504383 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:22:01.504383 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:22:01.504383 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:22:01.504383 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:22:01.504383 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:22:01.504383 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:22:01.504383 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 173c58d3-70ae-4415-b257-1ee3a468eb20 could not be found. Aug 10 23:22:01.504383 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:22:01.507283 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-76ed0f56-19bc-4e69-a56f-ac19137f8a0c tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] Returning 404 to user: Instance 173c58d3-70ae-4415-b257-1ee3a468eb20 could not be found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:22:01.508666 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-76ed0f56-19bc-4e69-a56f-ac19137f8a0c tempest-ServersNegativeTestMultiTenantJSON-127894808 tempest-ServersNegativeTestMultiTenantJSON-127894808-project] 10.222.0.58 "GET /compute/v2.1/servers/173c58d3-70ae-4415-b257-1ee3a468eb20" status: 404 len: 111 microversion: 2.1 time: 0.059618 Aug 10 23:22:01.509798 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2445/5094] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:22:01 2022] GET /compute/v2.1/servers/173c58d3-70ae-4415-b257-1ee3a468eb20 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:22:01.902067 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-5decd230-21a0-43b3-b841-c01c9123ecdb tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6684f0c87e4242be9e0ffb4ef1973f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0582ace9e4443b8ad88915503ee630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:01.919329 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-5decd230-21a0-43b3-b841-c01c9123ecdb tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "GET /compute/v2.1/servers/0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d" status: 200 len: 1509 microversion: 2.1 time: 0.934756 Aug 10 23:22:01.937811 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2650/5095] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:22:00 2022] GET /compute/v2.1/servers/0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d => generated 1509 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:22:02.944109 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-7d670608-c7ae-4c6c-85fd-711a2a6c0b98 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:02.945710 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-7d670608-c7ae-4c6c-85fd-711a2a6c0b98 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: 0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:02.958321 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7d670608-c7ae-4c6c-85fd-711a2a6c0b98 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:02.963726 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7d670608-c7ae-4c6c-85fd-711a2a6c0b98 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:02.964548 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7d670608-c7ae-4c6c-85fd-711a2a6c0b98 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:02.965494 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7d670608-c7ae-4c6c-85fd-711a2a6c0b98 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:02.967447 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7d670608-c7ae-4c6c-85fd-711a2a6c0b98 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:02.968347 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7d670608-c7ae-4c6c-85fd-711a2a6c0b98 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:03.272844 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-7d670608-c7ae-4c6c-85fd-711a2a6c0b98 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6684f0c87e4242be9e0ffb4ef1973f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0582ace9e4443b8ad88915503ee630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:03.287210 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-7d670608-c7ae-4c6c-85fd-711a2a6c0b98 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "GET /compute/v2.1/servers/0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d" status: 200 len: 1509 microversion: 2.1 time: 0.346021 Aug 10 23:22:03.288470 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2446/5096] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:22:02 2022] GET /compute/v2.1/servers/0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d => generated 1509 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:22:04.309472 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-f5739b03-2e5e-4f09-a97d-cca162da7557 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:04.311253 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-f5739b03-2e5e-4f09-a97d-cca162da7557 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: 0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:04.319126 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f5739b03-2e5e-4f09-a97d-cca162da7557 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:04.319928 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f5739b03-2e5e-4f09-a97d-cca162da7557 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:04.320559 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f5739b03-2e5e-4f09-a97d-cca162da7557 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:04.321453 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f5739b03-2e5e-4f09-a97d-cca162da7557 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:04.322285 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f5739b03-2e5e-4f09-a97d-cca162da7557 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:04.323043 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f5739b03-2e5e-4f09-a97d-cca162da7557 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:04.597002 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-f5739b03-2e5e-4f09-a97d-cca162da7557 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6684f0c87e4242be9e0ffb4ef1973f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0582ace9e4443b8ad88915503ee630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:04.608356 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-f5739b03-2e5e-4f09-a97d-cca162da7557 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "GET /compute/v2.1/servers/0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d" status: 200 len: 1509 microversion: 2.1 time: 0.301287 Aug 10 23:22:04.608971 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2651/5097] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:22:04 2022] GET /compute/v2.1/servers/0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d => generated 1509 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:22:05.640522 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-44337802-a99b-47df-aa84-11b2ba4ed193 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:05.641534 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-44337802-a99b-47df-aa84-11b2ba4ed193 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: 0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:05.661691 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-44337802-a99b-47df-aa84-11b2ba4ed193 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:05.662905 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-44337802-a99b-47df-aa84-11b2ba4ed193 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:05.663985 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-44337802-a99b-47df-aa84-11b2ba4ed193 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:05.665732 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-44337802-a99b-47df-aa84-11b2ba4ed193 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:05.666766 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-44337802-a99b-47df-aa84-11b2ba4ed193 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:05.667748 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-44337802-a99b-47df-aa84-11b2ba4ed193 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:05.959085 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-44337802-a99b-47df-aa84-11b2ba4ed193 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6684f0c87e4242be9e0ffb4ef1973f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0582ace9e4443b8ad88915503ee630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:05.981250 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-44337802-a99b-47df-aa84-11b2ba4ed193 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "GET /compute/v2.1/servers/0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d" status: 200 len: 1509 microversion: 2.1 time: 0.350113 Aug 10 23:22:05.984413 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2447/5098] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:22:05 2022] GET /compute/v2.1/servers/0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d => generated 1509 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:22:06.174486 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c9042b67-81ab-4f91-b40c-abd79d988f1b tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:06.175282 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-c9042b67-81ab-4f91-b40c-abd79d988f1b tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] [instance: 440c3d30-e5c9-4093-9b7e-39e06d32d682] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:06.195521 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c9042b67-81ab-4f91-b40c-abd79d988f1b tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:06.197002 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c9042b67-81ab-4f91-b40c-abd79d988f1b tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:06.197475 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c9042b67-81ab-4f91-b40c-abd79d988f1b tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:06.199972 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c9042b67-81ab-4f91-b40c-abd79d988f1b tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:06.200501 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c9042b67-81ab-4f91-b40c-abd79d988f1b tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:06.200988 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c9042b67-81ab-4f91-b40c-abd79d988f1b tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:06.243126 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-c9042b67-81ab-4f91-b40c-abd79d988f1b tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] 10.222.0.58 "GET /compute/v2.1/servers/440c3d30-e5c9-4093-9b7e-39e06d32d682/ips" status: 200 len: 150 microversion: 2.1 time: 0.074089 Aug 10 23:22:06.245001 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2652/5099] 10.222.0.58 () {58 vars in 1248 bytes} [Wed Aug 10 23:22:06 2022] GET /compute/v2.1/servers/440c3d30-e5c9-4093-9b7e-39e06d32d682/ips => generated 150 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:22:07.006843 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-313125b7-8401-4115-8137-134e5f666803 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:07.007620 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-313125b7-8401-4115-8137-134e5f666803 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: 0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:07.020123 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-313125b7-8401-4115-8137-134e5f666803 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:07.020618 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-313125b7-8401-4115-8137-134e5f666803 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:07.021159 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-313125b7-8401-4115-8137-134e5f666803 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:07.021759 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-313125b7-8401-4115-8137-134e5f666803 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:07.022211 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-313125b7-8401-4115-8137-134e5f666803 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:07.022632 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-313125b7-8401-4115-8137-134e5f666803 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:07.089370 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:22:07.496466 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-313125b7-8401-4115-8137-134e5f666803 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6684f0c87e4242be9e0ffb4ef1973f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0582ace9e4443b8ad88915503ee630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:07.507611 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-313125b7-8401-4115-8137-134e5f666803 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "GET /compute/v2.1/servers/0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d" status: 200 len: 1509 microversion: 2.1 time: 0.505464 Aug 10 23:22:07.508883 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2448/5100] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:22:07 2022] GET /compute/v2.1/servers/0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d => generated 1509 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:22:08.530326 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c3445009-6442-4cc4-a267-bd217a0f94b8 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:08.530985 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-c3445009-6442-4cc4-a267-bd217a0f94b8 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: 0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:08.539070 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c3445009-6442-4cc4-a267-bd217a0f94b8 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:08.539819 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c3445009-6442-4cc4-a267-bd217a0f94b8 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:08.540462 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c3445009-6442-4cc4-a267-bd217a0f94b8 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:08.541418 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c3445009-6442-4cc4-a267-bd217a0f94b8 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:08.542104 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c3445009-6442-4cc4-a267-bd217a0f94b8 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:08.554250 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c3445009-6442-4cc4-a267-bd217a0f94b8 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:09.046703 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-a8ca3958-6b6a-4440-8dec-b40802836631 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9cea5599-6c37-48ec-8d9c-8af49aa354c3"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:22:09.049353 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-a8ca3958-6b6a-4440-8dec-b40802836631 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] [instance: 440c3d30-e5c9-4093-9b7e-39e06d32d682] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:09.065010 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a8ca3958-6b6a-4440-8dec-b40802836631 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:09.065512 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a8ca3958-6b6a-4440-8dec-b40802836631 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:09.065962 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a8ca3958-6b6a-4440-8dec-b40802836631 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:09.066683 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a8ca3958-6b6a-4440-8dec-b40802836631 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:09.075494 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a8ca3958-6b6a-4440-8dec-b40802836631 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:09.076627 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a8ca3958-6b6a-4440-8dec-b40802836631 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:09.368934 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-c3445009-6442-4cc4-a267-bd217a0f94b8 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6684f0c87e4242be9e0ffb4ef1973f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0582ace9e4443b8ad88915503ee630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:09.384317 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-c3445009-6442-4cc4-a267-bd217a0f94b8 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "GET /compute/v2.1/servers/0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d" status: 200 len: 1509 microversion: 2.1 time: 0.853430 Aug 10 23:22:09.385164 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2653/5101] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:22:08 2022] GET /compute/v2.1/servers/0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d => generated 1509 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:22:09.499967 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-a8ca3958-6b6a-4440-8dec-b40802836631 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] 10.222.0.58 "POST /compute/v2.1/servers/440c3d30-e5c9-4093-9b7e-39e06d32d682/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.457418 Aug 10 23:22:09.501103 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2449/5102] 10.222.0.58 () {60 vars in 1323 bytes} [Wed Aug 10 23:22:09 2022] POST /compute/v2.1/servers/440c3d30-e5c9-4093-9b7e-39e06d32d682/os-volume_attachments => generated 194 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:22:10.406834 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-39a04c2c-9f83-44c2-9f13-7bf6a59cf68a tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:10.407525 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-39a04c2c-9f83-44c2-9f13-7bf6a59cf68a tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: 0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:10.421426 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-39a04c2c-9f83-44c2-9f13-7bf6a59cf68a tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:10.424302 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-39a04c2c-9f83-44c2-9f13-7bf6a59cf68a tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:10.425024 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-39a04c2c-9f83-44c2-9f13-7bf6a59cf68a tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:10.426628 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-39a04c2c-9f83-44c2-9f13-7bf6a59cf68a tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:10.428427 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-39a04c2c-9f83-44c2-9f13-7bf6a59cf68a tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:10.429088 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-39a04c2c-9f83-44c2-9f13-7bf6a59cf68a tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:10.816909 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-39a04c2c-9f83-44c2-9f13-7bf6a59cf68a tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6684f0c87e4242be9e0ffb4ef1973f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0582ace9e4443b8ad88915503ee630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:10.825323 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-39a04c2c-9f83-44c2-9f13-7bf6a59cf68a tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "GET /compute/v2.1/servers/0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d" status: 200 len: 1509 microversion: 2.1 time: 0.423366 Aug 10 23:22:10.845580 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2654/5103] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:22:10 2022] GET /compute/v2.1/servers/0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d => generated 1509 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:22:11.850625 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-eae5b5cd-2b94-40b4-8899-5ca94d19ba11 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:11.851909 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-eae5b5cd-2b94-40b4-8899-5ca94d19ba11 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: 0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:11.857650 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:22:11.859633 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-eae5b5cd-2b94-40b4-8899-5ca94d19ba11 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:11.860341 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-eae5b5cd-2b94-40b4-8899-5ca94d19ba11 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:11.860960 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-eae5b5cd-2b94-40b4-8899-5ca94d19ba11 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:11.861845 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-eae5b5cd-2b94-40b4-8899-5ca94d19ba11 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:11.862464 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-eae5b5cd-2b94-40b4-8899-5ca94d19ba11 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:11.863089 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-eae5b5cd-2b94-40b4-8899-5ca94d19ba11 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:12.108308 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-eae5b5cd-2b94-40b4-8899-5ca94d19ba11 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6684f0c87e4242be9e0ffb4ef1973f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0582ace9e4443b8ad88915503ee630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:12.121527 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-eae5b5cd-2b94-40b4-8899-5ca94d19ba11 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "GET /compute/v2.1/servers/0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d" status: 200 len: 1509 microversion: 2.1 time: 0.277082 Aug 10 23:22:12.123570 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2450/5104] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:22:11 2022] GET /compute/v2.1/servers/0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d => generated 1509 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:22:13.144029 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-4dc4e364-eafe-4267-b4e8-cd372fa1c3ad tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:13.144635 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-4dc4e364-eafe-4267-b4e8-cd372fa1c3ad tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: 0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:13.162187 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4dc4e364-eafe-4267-b4e8-cd372fa1c3ad tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:13.162888 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4dc4e364-eafe-4267-b4e8-cd372fa1c3ad tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:13.163573 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4dc4e364-eafe-4267-b4e8-cd372fa1c3ad tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:13.164540 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4dc4e364-eafe-4267-b4e8-cd372fa1c3ad tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:13.165196 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4dc4e364-eafe-4267-b4e8-cd372fa1c3ad tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:13.166450 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4dc4e364-eafe-4267-b4e8-cd372fa1c3ad tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:13.888911 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-4dc4e364-eafe-4267-b4e8-cd372fa1c3ad tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6684f0c87e4242be9e0ffb4ef1973f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0582ace9e4443b8ad88915503ee630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:13.902585 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-4dc4e364-eafe-4267-b4e8-cd372fa1c3ad tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "GET /compute/v2.1/servers/0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d" status: 200 len: 1509 microversion: 2.1 time: 0.761951 Aug 10 23:22:13.903785 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2655/5105] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:22:13 2022] GET /compute/v2.1/servers/0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d => generated 1509 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:22:14.926228 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-11dcca19-7033-40d0-9188-362df7f494f8 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:14.927628 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-11dcca19-7033-40d0-9188-362df7f494f8 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: 0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:14.939135 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-11dcca19-7033-40d0-9188-362df7f494f8 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:14.940043 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-11dcca19-7033-40d0-9188-362df7f494f8 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:14.940750 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-11dcca19-7033-40d0-9188-362df7f494f8 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:14.942894 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-11dcca19-7033-40d0-9188-362df7f494f8 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:14.943825 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-11dcca19-7033-40d0-9188-362df7f494f8 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:14.944580 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-11dcca19-7033-40d0-9188-362df7f494f8 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:15.406473 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-11dcca19-7033-40d0-9188-362df7f494f8 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6684f0c87e4242be9e0ffb4ef1973f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0582ace9e4443b8ad88915503ee630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:15.421147 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-11dcca19-7033-40d0-9188-362df7f494f8 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "GET /compute/v2.1/servers/0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d" status: 200 len: 1509 microversion: 2.1 time: 0.497127 Aug 10 23:22:15.423528 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2451/5106] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:22:14 2022] GET /compute/v2.1/servers/0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d => generated 1509 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:22:16.454105 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-d3d3d46a-b2b2-442d-a150-373e1e8eaac8 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:16.456873 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-d3d3d46a-b2b2-442d-a150-373e1e8eaac8 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: 0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:16.470566 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d3d3d46a-b2b2-442d-a150-373e1e8eaac8 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:16.471821 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d3d3d46a-b2b2-442d-a150-373e1e8eaac8 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:16.473036 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d3d3d46a-b2b2-442d-a150-373e1e8eaac8 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:16.474220 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d3d3d46a-b2b2-442d-a150-373e1e8eaac8 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:16.474914 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d3d3d46a-b2b2-442d-a150-373e1e8eaac8 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:16.475582 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d3d3d46a-b2b2-442d-a150-373e1e8eaac8 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:16.786625 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-d3d3d46a-b2b2-442d-a150-373e1e8eaac8 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6684f0c87e4242be9e0ffb4ef1973f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0582ace9e4443b8ad88915503ee630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:16.800758 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-d3d3d46a-b2b2-442d-a150-373e1e8eaac8 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "GET /compute/v2.1/servers/0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d" status: 200 len: 1486 microversion: 2.1 time: 0.352409 Aug 10 23:22:16.805879 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2656/5107] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:22:16 2022] GET /compute/v2.1/servers/0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d => generated 1486 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:22:16.840197 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-089c7e4a-82a1-460d-a9cc-68f545ad34d0 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-154147298"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:22:16.849898 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-089c7e4a-82a1-460d-a9cc-68f545ad34d0 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: 0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:16.886939 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-089c7e4a-82a1-460d-a9cc-68f545ad34d0 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:16.887596 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-089c7e4a-82a1-460d-a9cc-68f545ad34d0 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:16.888095 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-089c7e4a-82a1-460d-a9cc-68f545ad34d0 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:16.891806 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-089c7e4a-82a1-460d-a9cc-68f545ad34d0 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:16.894949 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-089c7e4a-82a1-460d-a9cc-68f545ad34d0 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:16.895465 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-089c7e4a-82a1-460d-a9cc-68f545ad34d0 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:16.982471 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-089c7e4a-82a1-460d-a9cc-68f545ad34d0 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "PUT /compute/v2.1/servers/0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d" status: 200 len: 1059 microversion: 2.1 time: 0.151591 Aug 10 23:22:16.999444 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2452/5108] 10.222.0.58 () {60 vars in 1256 bytes} [Wed Aug 10 23:22:16 2022] PUT /compute/v2.1/servers/0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d => generated 1059 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:22:17.005357 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-62f5d832-4971-4ebc-9429-54d9db98fba6 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:17.006235 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-62f5d832-4971-4ebc-9429-54d9db98fba6 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: 0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:17.016327 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-62f5d832-4971-4ebc-9429-54d9db98fba6 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:17.018609 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-62f5d832-4971-4ebc-9429-54d9db98fba6 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:17.019285 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-62f5d832-4971-4ebc-9429-54d9db98fba6 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:17.020691 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-62f5d832-4971-4ebc-9429-54d9db98fba6 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:17.023739 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-62f5d832-4971-4ebc-9429-54d9db98fba6 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:17.025141 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-62f5d832-4971-4ebc-9429-54d9db98fba6 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:17.311594 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-62f5d832-4971-4ebc-9429-54d9db98fba6 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6684f0c87e4242be9e0ffb4ef1973f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0582ace9e4443b8ad88915503ee630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:17.319319 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-62f5d832-4971-4ebc-9429-54d9db98fba6 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "GET /compute/v2.1/servers/0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d" status: 200 len: 1486 microversion: 2.1 time: 0.318588 Aug 10 23:22:17.331925 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2657/5109] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:22:16 2022] GET /compute/v2.1/servers/0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d => generated 1486 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:22:17.356338 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-97e160fa-176e-47ff-859e-8f15ab9b81fb tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:17.357560 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-97e160fa-176e-47ff-859e-8f15ab9b81fb tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: 0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:17.364825 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-97e160fa-176e-47ff-859e-8f15ab9b81fb tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:17.365324 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-97e160fa-176e-47ff-859e-8f15ab9b81fb tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:17.365759 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-97e160fa-176e-47ff-859e-8f15ab9b81fb tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:17.366935 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-97e160fa-176e-47ff-859e-8f15ab9b81fb tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:17.367565 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-97e160fa-176e-47ff-859e-8f15ab9b81fb tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:17.368393 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-97e160fa-176e-47ff-859e-8f15ab9b81fb tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:17.733483 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-97e160fa-176e-47ff-859e-8f15ab9b81fb tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6684f0c87e4242be9e0ffb4ef1973f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0582ace9e4443b8ad88915503ee630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:17.741736 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-97e160fa-176e-47ff-859e-8f15ab9b81fb tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "GET /compute/v2.1/servers/0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d" status: 200 len: 1486 microversion: 2.1 time: 0.389273 Aug 10 23:22:17.742328 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2453/5110] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:22:17 2022] GET /compute/v2.1/servers/0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d => generated 1486 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:22:17.763883 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-12fdd636-7a87-403a-879e-e9ce63f00b6d tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:17.764515 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-12fdd636-7a87-403a-879e-e9ce63f00b6d tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: 0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:17.777486 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-12fdd636-7a87-403a-879e-e9ce63f00b6d tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:17.780484 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-12fdd636-7a87-403a-879e-e9ce63f00b6d tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:17.781127 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-12fdd636-7a87-403a-879e-e9ce63f00b6d tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:17.782020 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-12fdd636-7a87-403a-879e-e9ce63f00b6d tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:17.782647 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-12fdd636-7a87-403a-879e-e9ce63f00b6d tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:17.783293 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-12fdd636-7a87-403a-879e-e9ce63f00b6d tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:17.845388 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-12fdd636-7a87-403a-879e-e9ce63f00b6d tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: 0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d] Going to try to terminate instance {{(pid=122633) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:22:17.957193 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:22:18.029149 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-12fdd636-7a87-403a-879e-e9ce63f00b6d tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "DELETE /compute/v2.1/servers/0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d" status: 204 len: 0 microversion: 2.1 time: 0.268943 Aug 10 23:22:18.030774 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2658/5111] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:22:17 2022] DELETE /compute/v2.1/servers/0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d => generated 0 bytes in 272 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:22:18.039938 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-028c048b-a9cf-4be5-8427-92b8cee1fcb0 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:18.041268 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-028c048b-a9cf-4be5-8427-92b8cee1fcb0 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: 0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:18.053208 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-028c048b-a9cf-4be5-8427-92b8cee1fcb0 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:18.053954 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-028c048b-a9cf-4be5-8427-92b8cee1fcb0 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:18.054623 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-028c048b-a9cf-4be5-8427-92b8cee1fcb0 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:18.055919 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-028c048b-a9cf-4be5-8427-92b8cee1fcb0 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:18.056568 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-028c048b-a9cf-4be5-8427-92b8cee1fcb0 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:18.057247 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-028c048b-a9cf-4be5-8427-92b8cee1fcb0 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:18.271603 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-028c048b-a9cf-4be5-8427-92b8cee1fcb0 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6684f0c87e4242be9e0ffb4ef1973f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0582ace9e4443b8ad88915503ee630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:18.285819 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-028c048b-a9cf-4be5-8427-92b8cee1fcb0 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "GET /compute/v2.1/servers/0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d" status: 200 len: 1492 microversion: 2.1 time: 0.250651 Aug 10 23:22:18.286512 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2454/5112] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:22:18 2022] GET /compute/v2.1/servers/0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d => generated 1492 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:22:19.312968 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-27d1c5fb-be54-42b5-93d3-97a44fedad49 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:19.314432 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-27d1c5fb-be54-42b5-93d3-97a44fedad49 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: 0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:19.324631 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-27d1c5fb-be54-42b5-93d3-97a44fedad49 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:19.325931 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-27d1c5fb-be54-42b5-93d3-97a44fedad49 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:19.326968 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-27d1c5fb-be54-42b5-93d3-97a44fedad49 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:19.328339 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-27d1c5fb-be54-42b5-93d3-97a44fedad49 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:19.329226 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-27d1c5fb-be54-42b5-93d3-97a44fedad49 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:19.329851 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-27d1c5fb-be54-42b5-93d3-97a44fedad49 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:19.745747 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-27d1c5fb-be54-42b5-93d3-97a44fedad49 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6684f0c87e4242be9e0ffb4ef1973f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0582ace9e4443b8ad88915503ee630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:19.756826 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-27d1c5fb-be54-42b5-93d3-97a44fedad49 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "GET /compute/v2.1/servers/0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d" status: 200 len: 1492 microversion: 2.1 time: 0.451690 Aug 10 23:22:19.757390 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2659/5113] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:22:19 2022] GET /compute/v2.1/servers/0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d => generated 1492 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:22:20.784135 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-dbd73118-046e-41a1-9f8f-277d4e1fdea1 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:20.785825 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-dbd73118-046e-41a1-9f8f-277d4e1fdea1 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: 0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:20.795145 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dbd73118-046e-41a1-9f8f-277d4e1fdea1 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:20.796533 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dbd73118-046e-41a1-9f8f-277d4e1fdea1 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:20.797181 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dbd73118-046e-41a1-9f8f-277d4e1fdea1 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:20.798236 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dbd73118-046e-41a1-9f8f-277d4e1fdea1 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:20.798934 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dbd73118-046e-41a1-9f8f-277d4e1fdea1 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:20.801128 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dbd73118-046e-41a1-9f8f-277d4e1fdea1 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:20.849168 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-df73fafd-e878-401e-b6e4-907e5a867281 req-b30c396c-71d3-4664-aa5f-97f473fe402c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d", "name": "network-vif-deleted", "tag": "2089cd8b-4d54-4b16-8849-6a4e27d5cb27"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:22:20.885726 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-df73fafd-e878-401e-b6e4-907e5a867281 req-b30c396c-71d3-4664-aa5f-97f473fe402c service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:20.888435 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-df73fafd-e878-401e-b6e4-907e5a867281 req-b30c396c-71d3-4664-aa5f-97f473fe402c service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:20.890396 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-df73fafd-e878-401e-b6e4-907e5a867281 req-b30c396c-71d3-4664-aa5f-97f473fe402c service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:20.916272 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dbd73118-046e-41a1-9f8f-277d4e1fdea1 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:20.916631 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-df73fafd-e878-401e-b6e4-907e5a867281 req-b30c396c-71d3-4664-aa5f-97f473fe402c service nova] Creating event network-vif-deleted:2089cd8b-4d54-4b16-8849-6a4e27d5cb27 for instance 0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d on n-h1-850468-14 Aug 10 23:22:20.920281 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dbd73118-046e-41a1-9f8f-277d4e1fdea1 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:20.920736 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dbd73118-046e-41a1-9f8f-277d4e1fdea1 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:20.922937 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.objects.instance [None req-dbd73118-046e-41a1-9f8f-277d4e1fdea1 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lazy-loading 'fault' on Instance uuid 0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d {{(pid=122633) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:22:20.952930 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-df73fafd-e878-401e-b6e4-907e5a867281 req-b30c396c-71d3-4664-aa5f-97f473fe402c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.511349 Aug 10 23:22:20.953559 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2455/5114] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:22:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:22:21.020442 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-dbd73118-046e-41a1-9f8f-277d4e1fdea1 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6684f0c87e4242be9e0ffb4ef1973f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0582ace9e4443b8ad88915503ee630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:21.033468 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-dbd73118-046e-41a1-9f8f-277d4e1fdea1 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "GET /compute/v2.1/servers/0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d" status: 200 len: 1309 microversion: 2.1 time: 0.255535 Aug 10 23:22:21.035416 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2660/5115] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:22:20 2022] GET /compute/v2.1/servers/0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d => generated 1309 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:22:22.058057 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-6fc989ab-c1b4-4bc3-b7f8-eef9d6d046a5 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:22.059431 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-6fc989ab-c1b4-4bc3-b7f8-eef9d6d046a5 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: 0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:22.067580 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6fc989ab-c1b4-4bc3-b7f8-eef9d6d046a5 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:22.068787 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6fc989ab-c1b4-4bc3-b7f8-eef9d6d046a5 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:22.069454 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6fc989ab-c1b4-4bc3-b7f8-eef9d6d046a5 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:22.070586 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6fc989ab-c1b4-4bc3-b7f8-eef9d6d046a5 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:22.072546 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6fc989ab-c1b4-4bc3-b7f8-eef9d6d046a5 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:22.073158 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6fc989ab-c1b4-4bc3-b7f8-eef9d6d046a5 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:22.090016 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-6fc989ab-c1b4-4bc3-b7f8-eef9d6d046a5 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] HTTP exception thrown: Instance 0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d could not be found. Aug 10 23:22:22.093094 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-6fc989ab-c1b4-4bc3-b7f8-eef9d6d046a5 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Request method failure captured: Aug 10 23:22:22.093094 n-d-850468-14 devstack@n-api.service[122632]: request: GET /compute/v2.1/servers/0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d HTTP/1.1 Aug 10 23:22:22.093094 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:22:22.093094 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:22:22.093094 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:22:22.093094 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 23:22:22.093094 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:22:22.093094 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:22:22.093094 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:22:22.093094 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:22:22.093094 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9DytBT8uIivFlHEw3ugwW3-_1ks70Fcm-KUdUfNf3hiFdhb5xvDC9LI4u79J0X-frOTrhG-DWWR1w8a7yZU35-jGfQgN97QRTSA7hDEW06netEOKzarBlr77OO9sCeT3s5ektFA7vCYLl4122WPKHg-MSXQY0g9YmL291Ic7yNjWLnQ Aug 10 23:22:22.093094 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:22:22.093094 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:22:22.093094 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:22:22.093094 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:22:22.093094 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:22:22.093094 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:22:22.093094 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 0b0582ace9e4443b8ad88915503ee630 Aug 10 23:22:22.093094 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-ServersTestJSON-516662906 Aug 10 23:22:22.093094 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:22:22.093094 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:22:22.093094 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0b0582ace9e4443b8ad88915503ee630"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0b0582ace9e4443b8ad88915503ee630"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/0b0582ace9e4443b8ad88915503ee630"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_0b0582ace9e4443b8ad88915503ee630", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:22:22.093094 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-ServersTestJSON-516662906 Aug 10 23:22:22.093094 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 0b0582ace9e4443b8ad88915503ee630 Aug 10 23:22:22.093094 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-ServersTestJSON-516662906 Aug 10 23:22:22.093094 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-ServersTestJSON-516662906-project Aug 10 23:22:22.093094 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:22:22.093094 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:22:22.093094 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: 6684f0c87e4242be9e0ffb4ef1973f96 Aug 10 23:22:22.093094 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-ServersTestJSON-516662906-project Aug 10 23:22:22.093094 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:22:22.093094 n-d-850468-14 devstack@n-api.service[122632]: exception: Instance 0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d could not be found. Aug 10 23:22:22.093094 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': '0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d'} Aug 10 23:22:22.093094 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:22:22.093094 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:22:22.093094 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:22:22.093094 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:22:22.093094 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:22:22.093094 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:22:22.093094 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:22:22.093094 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:22:22.093094 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:22:22.093094 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:22:22.093094 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d could not be found. Aug 10 23:22:22.093094 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:22:22.093094 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:22:22.093094 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:22:22.093094 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:22:22.093094 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:22:22.093094 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:22:22.093094 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:22:22.093094 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:22:22.093094 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:22:22.093094 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:22:22.093094 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:22:22.093094 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:22:22.093094 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:22:22.093094 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:22:22.093094 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:22:22.093094 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:22:22.093094 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d could not be found. Aug 10 23:22:22.093094 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:22:22.093094 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:22:22.093094 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:22:22.093094 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:22:22.099398 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:22:22.099398 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:22:22.099398 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:22:22.099398 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:22:22.099398 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d could not be found. Aug 10 23:22:22.099398 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:22:22.100756 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-6fc989ab-c1b4-4bc3-b7f8-eef9d6d046a5 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Returning 404 to user: Instance 0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d could not be found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:22:22.102868 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-6fc989ab-c1b4-4bc3-b7f8-eef9d6d046a5 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "GET /compute/v2.1/servers/0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d" status: 404 len: 111 microversion: 2.1 time: 0.050892 Aug 10 23:22:22.103624 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2456/5116] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:22:22 2022] GET /compute/v2.1/servers/0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:22:22.116832 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-1658d0e0-9f72-4ee5-9fbd-ac15b0fbe903 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:22.118374 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-1658d0e0-9f72-4ee5-9fbd-ac15b0fbe903 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: 0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:22.124190 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:22:22.134192 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1658d0e0-9f72-4ee5-9fbd-ac15b0fbe903 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:22.135246 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1658d0e0-9f72-4ee5-9fbd-ac15b0fbe903 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:22.135891 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1658d0e0-9f72-4ee5-9fbd-ac15b0fbe903 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:22.136834 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1658d0e0-9f72-4ee5-9fbd-ac15b0fbe903 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:22.138653 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1658d0e0-9f72-4ee5-9fbd-ac15b0fbe903 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:22.139482 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1658d0e0-9f72-4ee5-9fbd-ac15b0fbe903 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:22.245483 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-1658d0e0-9f72-4ee5-9fbd-ac15b0fbe903 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] HTTP exception thrown: Instance 0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d could not be found. Aug 10 23:22:22.245483 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-1658d0e0-9f72-4ee5-9fbd-ac15b0fbe903 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Request method failure captured: Aug 10 23:22:22.245483 n-d-850468-14 devstack@n-api.service[122633]: request: DELETE /compute/v2.1/servers/0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d HTTP/1.1 Aug 10 23:22:22.245483 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:22:22.245483 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:22:22.245483 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:22:22.245483 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:22:22.245483 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:22:22.245483 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:22:22.245483 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:22:22.245483 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:22:22.245483 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9DytBT8uIivFlHEw3ugwW3-_1ks70Fcm-KUdUfNf3hiFdhb5xvDC9LI4u79J0X-frOTrhG-DWWR1w8a7yZU35-jGfQgN97QRTSA7hDEW06netEOKzarBlr77OO9sCeT3s5ektFA7vCYLl4122WPKHg-MSXQY0g9YmL291Ic7yNjWLnQ Aug 10 23:22:22.245483 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:22:22.245483 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:22:22.245483 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:22:22.245483 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:22:22.245483 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:22:22.245483 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:22:22.245483 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 0b0582ace9e4443b8ad88915503ee630 Aug 10 23:22:22.245483 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-ServersTestJSON-516662906 Aug 10 23:22:22.245483 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:22:22.245483 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:22:22.245483 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0b0582ace9e4443b8ad88915503ee630"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0b0582ace9e4443b8ad88915503ee630"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/0b0582ace9e4443b8ad88915503ee630"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_0b0582ace9e4443b8ad88915503ee630", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:22:22.245483 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-ServersTestJSON-516662906 Aug 10 23:22:22.245483 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 0b0582ace9e4443b8ad88915503ee630 Aug 10 23:22:22.245483 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-ServersTestJSON-516662906 Aug 10 23:22:22.245483 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-ServersTestJSON-516662906-project Aug 10 23:22:22.245483 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:22:22.245483 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:22:22.245483 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 6684f0c87e4242be9e0ffb4ef1973f96 Aug 10 23:22:22.245483 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-ServersTestJSON-516662906-project Aug 10 23:22:22.245483 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:22:22.245483 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance 0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d could not be found. Aug 10 23:22:22.245483 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': '0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d'} Aug 10 23:22:22.245483 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:22:22.245483 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:22:22.245483 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:22:22.245483 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:22:22.245483 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:22:22.245483 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:22:22.245483 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:22:22.245483 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:22:22.245483 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:22:22.245483 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:22:22.245483 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d could not be found. Aug 10 23:22:22.245483 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:22:22.245483 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:22:22.245483 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:22:22.245483 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:22:22.245483 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:22:22.245483 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:22:22.245483 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:22:22.245483 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:22:22.245483 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:22:22.245483 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:22:22.245483 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 23:22:22.245483 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 23:22:22.245483 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 23:22:22.245483 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 23:22:22.245483 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:22:22.245483 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:22:22.252575 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:22:22.252575 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:22:22.252575 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d could not be found. Aug 10 23:22:22.252575 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:22:22.252575 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:22:22.252575 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:22:22.252575 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:22:22.252575 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:22:22.252575 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:22:22.252575 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:22:22.252575 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:22:22.252575 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d could not be found. Aug 10 23:22:22.252575 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:22:22.252575 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-1658d0e0-9f72-4ee5-9fbd-ac15b0fbe903 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Returning 404 to user: Instance 0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:22:22.252575 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-1658d0e0-9f72-4ee5-9fbd-ac15b0fbe903 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "DELETE /compute/v2.1/servers/0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d" status: 404 len: 111 microversion: 2.1 time: 0.068716 Aug 10 23:22:22.252575 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2661/5117] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:22:22 2022] DELETE /compute/v2.1/servers/0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:22:22.255774 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-832fb1b2-680d-48b6-a815-22c059490248 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:22.255774 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-832fb1b2-680d-48b6-a815-22c059490248 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: 0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:22.255774 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-832fb1b2-680d-48b6-a815-22c059490248 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:22.255774 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-832fb1b2-680d-48b6-a815-22c059490248 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:22.255774 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-832fb1b2-680d-48b6-a815-22c059490248 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:22.255774 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-832fb1b2-680d-48b6-a815-22c059490248 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:22.255774 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-832fb1b2-680d-48b6-a815-22c059490248 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:22.255774 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-832fb1b2-680d-48b6-a815-22c059490248 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:22.255774 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-832fb1b2-680d-48b6-a815-22c059490248 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] HTTP exception thrown: Instance 0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d could not be found. Aug 10 23:22:22.255774 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-832fb1b2-680d-48b6-a815-22c059490248 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Request method failure captured: Aug 10 23:22:22.255774 n-d-850468-14 devstack@n-api.service[122632]: request: GET /compute/v2.1/servers/0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d HTTP/1.1 Aug 10 23:22:22.255774 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:22:22.255774 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:22:22.255774 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:22:22.255774 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 23:22:22.255774 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:22:22.255774 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:22:22.255774 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:22:22.255774 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:22:22.255774 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9DytBT8uIivFlHEw3ugwW3-_1ks70Fcm-KUdUfNf3hiFdhb5xvDC9LI4u79J0X-frOTrhG-DWWR1w8a7yZU35-jGfQgN97QRTSA7hDEW06netEOKzarBlr77OO9sCeT3s5ektFA7vCYLl4122WPKHg-MSXQY0g9YmL291Ic7yNjWLnQ Aug 10 23:22:22.255774 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:22:22.255774 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:22:22.255774 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:22:22.255774 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:22:22.255774 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:22:22.255774 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:22:22.255774 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 0b0582ace9e4443b8ad88915503ee630 Aug 10 23:22:22.255774 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-ServersTestJSON-516662906 Aug 10 23:22:22.255774 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:22:22.255774 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:22:22.257263 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0b0582ace9e4443b8ad88915503ee630"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0b0582ace9e4443b8ad88915503ee630"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/0b0582ace9e4443b8ad88915503ee630"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_0b0582ace9e4443b8ad88915503ee630", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:22:22.257263 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-ServersTestJSON-516662906 Aug 10 23:22:22.257263 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 0b0582ace9e4443b8ad88915503ee630 Aug 10 23:22:22.257263 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-ServersTestJSON-516662906 Aug 10 23:22:22.257263 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-ServersTestJSON-516662906-project Aug 10 23:22:22.257263 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:22:22.257263 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:22:22.257263 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: 6684f0c87e4242be9e0ffb4ef1973f96 Aug 10 23:22:22.257263 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-ServersTestJSON-516662906-project Aug 10 23:22:22.257263 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:22:22.257263 n-d-850468-14 devstack@n-api.service[122632]: exception: Instance 0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d could not be found. Aug 10 23:22:22.257263 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': '0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d'} Aug 10 23:22:22.257263 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:22:22.257263 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:22:22.257263 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:22:22.257263 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:22:22.257263 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:22:22.257263 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:22:22.257263 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:22:22.257263 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:22:22.257263 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:22:22.257263 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:22:22.257263 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d could not be found. Aug 10 23:22:22.257263 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:22:22.257263 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:22:22.257263 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:22:22.257263 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:22:22.257263 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:22:22.257263 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:22:22.257263 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:22:22.257263 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:22:22.257263 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:22:22.257263 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:22:22.257263 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:22:22.257263 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:22:22.257263 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:22:22.257263 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:22:22.257263 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:22:22.257263 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:22:22.257263 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d could not be found. Aug 10 23:22:22.257263 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:22:22.257263 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:22:22.257263 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:22:22.257263 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:22:22.257263 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:22:22.257263 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:22:22.257263 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:22:22.257263 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:22:22.257263 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d could not be found. Aug 10 23:22:22.257263 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:22:22.257263 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-832fb1b2-680d-48b6-a815-22c059490248 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Returning 404 to user: Instance 0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d could not be found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:22:22.259852 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-832fb1b2-680d-48b6-a815-22c059490248 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "GET /compute/v2.1/servers/0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d" status: 404 len: 111 microversion: 2.1 time: 0.050564 Aug 10 23:22:22.259852 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2457/5118] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:22:22 2022] GET /compute/v2.1/servers/0f2ee3e4-96cf-4b2c-9b5b-f06690c9b33d => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:22:22.259994 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-40d7191d-bab7-4eb4-abef-20473fb597cd tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:22.259994 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-40d7191d-bab7-4eb4-abef-20473fb597cd tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: a8ed4840-07d6-4506-a0ef-b686a6231fb7] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:22.262341 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-40d7191d-bab7-4eb4-abef-20473fb597cd tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:22.263663 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-40d7191d-bab7-4eb4-abef-20473fb597cd tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:22.264260 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-40d7191d-bab7-4eb4-abef-20473fb597cd tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:22.264976 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-40d7191d-bab7-4eb4-abef-20473fb597cd tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:22.265432 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-40d7191d-bab7-4eb4-abef-20473fb597cd tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:22.265860 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-40d7191d-bab7-4eb4-abef-20473fb597cd tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:22.283022 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-40d7191d-bab7-4eb4-abef-20473fb597cd tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] HTTP exception thrown: Instance a8ed4840-07d6-4506-a0ef-b686a6231fb7 could not be found. Aug 10 23:22:22.285029 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-40d7191d-bab7-4eb4-abef-20473fb597cd tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Request method failure captured: Aug 10 23:22:22.285029 n-d-850468-14 devstack@n-api.service[122633]: request: DELETE /compute/v2.1/servers/a8ed4840-07d6-4506-a0ef-b686a6231fb7 HTTP/1.1 Aug 10 23:22:22.285029 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:22:22.285029 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:22:22.285029 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:22:22.285029 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:22:22.285029 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:22:22.285029 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:22:22.285029 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:22:22.285029 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:22:22.285029 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9DytBT8uIivFlHEw3ugwW3-_1ks70Fcm-KUdUfNf3hiFdhb5xvDC9LI4u79J0X-frOTrhG-DWWR1w8a7yZU35-jGfQgN97QRTSA7hDEW06netEOKzarBlr77OO9sCeT3s5ektFA7vCYLl4122WPKHg-MSXQY0g9YmL291Ic7yNjWLnQ Aug 10 23:22:22.285029 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:22:22.285029 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:22:22.285029 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:22:22.285029 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:22:22.285029 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:22:22.285029 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:22:22.285029 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 0b0582ace9e4443b8ad88915503ee630 Aug 10 23:22:22.285029 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-ServersTestJSON-516662906 Aug 10 23:22:22.285029 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:22:22.285029 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:22:22.285029 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0b0582ace9e4443b8ad88915503ee630"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0b0582ace9e4443b8ad88915503ee630"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/0b0582ace9e4443b8ad88915503ee630"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_0b0582ace9e4443b8ad88915503ee630", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:22:22.285029 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-ServersTestJSON-516662906 Aug 10 23:22:22.285029 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 0b0582ace9e4443b8ad88915503ee630 Aug 10 23:22:22.285029 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-ServersTestJSON-516662906 Aug 10 23:22:22.285029 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-ServersTestJSON-516662906-project Aug 10 23:22:22.285029 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:22:22.285029 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:22:22.285029 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 6684f0c87e4242be9e0ffb4ef1973f96 Aug 10 23:22:22.285029 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-ServersTestJSON-516662906-project Aug 10 23:22:22.285029 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:22:22.285029 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance a8ed4840-07d6-4506-a0ef-b686a6231fb7 could not be found. Aug 10 23:22:22.285029 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': 'a8ed4840-07d6-4506-a0ef-b686a6231fb7'} Aug 10 23:22:22.285029 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:22:22.285029 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:22:22.285029 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:22:22.285029 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:22:22.285029 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:22:22.285029 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:22:22.285029 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:22:22.285029 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:22:22.285029 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:22:22.285029 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:22:22.285029 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8ed4840-07d6-4506-a0ef-b686a6231fb7 could not be found. Aug 10 23:22:22.285029 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:22:22.285029 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:22:22.285029 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:22:22.285029 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:22:22.285029 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:22:22.285029 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:22:22.285029 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:22:22.285029 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:22:22.285029 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:22:22.285029 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:22:22.285029 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 23:22:22.285029 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 23:22:22.285029 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 23:22:22.285029 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 23:22:22.285029 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:22:22.285029 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:22:22.285029 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:22:22.285029 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:22:22.285029 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8ed4840-07d6-4506-a0ef-b686a6231fb7 could not be found. Aug 10 23:22:22.288285 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:22:22.288285 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:22:22.288285 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:22:22.288285 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:22:22.288285 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:22:22.288285 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:22:22.288285 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:22:22.288285 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:22:22.288285 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8ed4840-07d6-4506-a0ef-b686a6231fb7 could not be found. Aug 10 23:22:22.288285 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:22:22.288285 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-40d7191d-bab7-4eb4-abef-20473fb597cd tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Returning 404 to user: Instance a8ed4840-07d6-4506-a0ef-b686a6231fb7 could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:22:22.288285 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-40d7191d-bab7-4eb4-abef-20473fb597cd tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "DELETE /compute/v2.1/servers/a8ed4840-07d6-4506-a0ef-b686a6231fb7" status: 404 len: 111 microversion: 2.1 time: 0.041417 Aug 10 23:22:22.297178 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-329be816-f6e2-4474-8263-d4224f66f726 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:22.297796 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-329be816-f6e2-4474-8263-d4224f66f726 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: a8ed4840-07d6-4506-a0ef-b686a6231fb7] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:22.303461 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2662/5119] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:22:22 2022] DELETE /compute/v2.1/servers/a8ed4840-07d6-4506-a0ef-b686a6231fb7 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:22:22.306749 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-329be816-f6e2-4474-8263-d4224f66f726 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:22.307281 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-329be816-f6e2-4474-8263-d4224f66f726 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:22.307716 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-329be816-f6e2-4474-8263-d4224f66f726 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:22.308421 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-329be816-f6e2-4474-8263-d4224f66f726 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:22.308869 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-329be816-f6e2-4474-8263-d4224f66f726 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:22.309290 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-329be816-f6e2-4474-8263-d4224f66f726 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:22.338702 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-329be816-f6e2-4474-8263-d4224f66f726 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] HTTP exception thrown: Instance a8ed4840-07d6-4506-a0ef-b686a6231fb7 could not be found. Aug 10 23:22:22.344377 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-329be816-f6e2-4474-8263-d4224f66f726 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Request method failure captured: Aug 10 23:22:22.344377 n-d-850468-14 devstack@n-api.service[122632]: request: GET /compute/v2.1/servers/a8ed4840-07d6-4506-a0ef-b686a6231fb7 HTTP/1.1 Aug 10 23:22:22.344377 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:22:22.344377 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:22:22.344377 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:22:22.344377 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 23:22:22.344377 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:22:22.344377 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:22:22.344377 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:22:22.344377 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:22:22.344377 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9DytBT8uIivFlHEw3ugwW3-_1ks70Fcm-KUdUfNf3hiFdhb5xvDC9LI4u79J0X-frOTrhG-DWWR1w8a7yZU35-jGfQgN97QRTSA7hDEW06netEOKzarBlr77OO9sCeT3s5ektFA7vCYLl4122WPKHg-MSXQY0g9YmL291Ic7yNjWLnQ Aug 10 23:22:22.344377 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:22:22.344377 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:22:22.344377 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:22:22.344377 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:22:22.344377 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:22:22.344377 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:22:22.344377 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 0b0582ace9e4443b8ad88915503ee630 Aug 10 23:22:22.344377 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-ServersTestJSON-516662906 Aug 10 23:22:22.344377 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:22:22.344377 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:22:22.344377 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0b0582ace9e4443b8ad88915503ee630"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0b0582ace9e4443b8ad88915503ee630"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/0b0582ace9e4443b8ad88915503ee630"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_0b0582ace9e4443b8ad88915503ee630", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:22:22.344377 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-ServersTestJSON-516662906 Aug 10 23:22:22.344377 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 0b0582ace9e4443b8ad88915503ee630 Aug 10 23:22:22.344377 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-ServersTestJSON-516662906 Aug 10 23:22:22.344377 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-ServersTestJSON-516662906-project Aug 10 23:22:22.344377 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:22:22.344377 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:22:22.344377 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: 6684f0c87e4242be9e0ffb4ef1973f96 Aug 10 23:22:22.344377 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-ServersTestJSON-516662906-project Aug 10 23:22:22.344377 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:22:22.344377 n-d-850468-14 devstack@n-api.service[122632]: exception: Instance a8ed4840-07d6-4506-a0ef-b686a6231fb7 could not be found. Aug 10 23:22:22.344377 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': 'a8ed4840-07d6-4506-a0ef-b686a6231fb7'} Aug 10 23:22:22.344377 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:22:22.344377 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:22:22.344377 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:22:22.344377 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:22:22.344377 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:22:22.344377 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:22:22.344377 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:22:22.344377 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:22:22.344377 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:22:22.344377 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:22:22.344377 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8ed4840-07d6-4506-a0ef-b686a6231fb7 could not be found. Aug 10 23:22:22.344377 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:22:22.344377 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:22:22.344377 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:22:22.344377 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:22:22.344377 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:22:22.344377 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:22:22.344377 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:22:22.344377 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:22:22.344377 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:22:22.344377 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:22:22.344377 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:22:22.344377 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:22:22.344377 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:22:22.344377 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:22:22.344377 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:22:22.344377 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:22:22.344377 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8ed4840-07d6-4506-a0ef-b686a6231fb7 could not be found. Aug 10 23:22:22.344377 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:22:22.344377 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:22:22.344377 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:22:22.344377 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:22:22.347580 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:22:22.347580 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:22:22.347580 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:22:22.347580 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:22:22.347580 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8ed4840-07d6-4506-a0ef-b686a6231fb7 could not be found. Aug 10 23:22:22.347580 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:22:22.351108 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-329be816-f6e2-4474-8263-d4224f66f726 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Returning 404 to user: Instance a8ed4840-07d6-4506-a0ef-b686a6231fb7 could not be found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:22:22.356180 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-329be816-f6e2-4474-8263-d4224f66f726 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "GET /compute/v2.1/servers/a8ed4840-07d6-4506-a0ef-b686a6231fb7" status: 404 len: 111 microversion: 2.1 time: 0.061961 Aug 10 23:22:22.357886 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2458/5120] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:22:22 2022] GET /compute/v2.1/servers/a8ed4840-07d6-4506-a0ef-b686a6231fb7 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:22:22.373783 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-b1785a02-c609-490a-846a-63f188606f57 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:22.374354 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-b1785a02-c609-490a-846a-63f188606f57 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: 5ae8b5a0-e56c-4154-a487-080d996d54d3] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:22.383473 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b1785a02-c609-490a-846a-63f188606f57 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:22.384184 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b1785a02-c609-490a-846a-63f188606f57 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:22.384623 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b1785a02-c609-490a-846a-63f188606f57 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:22.385626 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b1785a02-c609-490a-846a-63f188606f57 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:22.386153 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b1785a02-c609-490a-846a-63f188606f57 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:22.386501 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b1785a02-c609-490a-846a-63f188606f57 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:22.422533 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-b1785a02-c609-490a-846a-63f188606f57 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] HTTP exception thrown: Instance 5ae8b5a0-e56c-4154-a487-080d996d54d3 could not be found. Aug 10 23:22:22.424067 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-b1785a02-c609-490a-846a-63f188606f57 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Request method failure captured: Aug 10 23:22:22.424067 n-d-850468-14 devstack@n-api.service[122633]: request: DELETE /compute/v2.1/servers/5ae8b5a0-e56c-4154-a487-080d996d54d3 HTTP/1.1 Aug 10 23:22:22.424067 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:22:22.424067 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:22:22.424067 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:22:22.424067 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:22:22.424067 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:22:22.424067 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:22:22.424067 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:22:22.424067 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:22:22.424067 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9DytBT8uIivFlHEw3ugwW3-_1ks70Fcm-KUdUfNf3hiFdhb5xvDC9LI4u79J0X-frOTrhG-DWWR1w8a7yZU35-jGfQgN97QRTSA7hDEW06netEOKzarBlr77OO9sCeT3s5ektFA7vCYLl4122WPKHg-MSXQY0g9YmL291Ic7yNjWLnQ Aug 10 23:22:22.424067 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:22:22.424067 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:22:22.424067 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:22:22.424067 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:22:22.424067 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:22:22.424067 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:22:22.424067 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 0b0582ace9e4443b8ad88915503ee630 Aug 10 23:22:22.424067 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-ServersTestJSON-516662906 Aug 10 23:22:22.424067 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:22:22.424067 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:22:22.424067 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0b0582ace9e4443b8ad88915503ee630"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0b0582ace9e4443b8ad88915503ee630"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/0b0582ace9e4443b8ad88915503ee630"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_0b0582ace9e4443b8ad88915503ee630", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:22:22.424067 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-ServersTestJSON-516662906 Aug 10 23:22:22.424067 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 0b0582ace9e4443b8ad88915503ee630 Aug 10 23:22:22.424067 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-ServersTestJSON-516662906 Aug 10 23:22:22.424067 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-ServersTestJSON-516662906-project Aug 10 23:22:22.424067 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:22:22.424067 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:22:22.424067 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 6684f0c87e4242be9e0ffb4ef1973f96 Aug 10 23:22:22.424067 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-ServersTestJSON-516662906-project Aug 10 23:22:22.424067 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:22:22.424067 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance 5ae8b5a0-e56c-4154-a487-080d996d54d3 could not be found. Aug 10 23:22:22.424067 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': '5ae8b5a0-e56c-4154-a487-080d996d54d3'} Aug 10 23:22:22.424067 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:22:22.424067 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:22:22.424067 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:22:22.424067 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:22:22.424067 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:22:22.424067 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:22:22.424067 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:22:22.424067 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:22:22.424067 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:22:22.424067 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:22:22.424067 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ae8b5a0-e56c-4154-a487-080d996d54d3 could not be found. Aug 10 23:22:22.424067 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:22:22.424067 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:22:22.424067 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:22:22.424067 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:22:22.424067 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:22:22.424067 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:22:22.424067 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:22:22.424067 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:22:22.424067 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:22:22.424067 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:22:22.424067 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 23:22:22.424067 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 23:22:22.424067 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 23:22:22.424067 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 23:22:22.424067 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:22:22.424067 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:22:22.424067 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:22:22.424067 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:22:22.424067 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ae8b5a0-e56c-4154-a487-080d996d54d3 could not be found. Aug 10 23:22:22.428877 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:22:22.428877 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:22:22.428877 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:22:22.428877 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:22:22.428877 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:22:22.428877 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:22:22.428877 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:22:22.428877 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:22:22.428877 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ae8b5a0-e56c-4154-a487-080d996d54d3 could not be found. Aug 10 23:22:22.428877 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:22:22.428877 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-b1785a02-c609-490a-846a-63f188606f57 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Returning 404 to user: Instance 5ae8b5a0-e56c-4154-a487-080d996d54d3 could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:22:22.428877 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-b1785a02-c609-490a-846a-63f188606f57 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "DELETE /compute/v2.1/servers/5ae8b5a0-e56c-4154-a487-080d996d54d3" status: 404 len: 111 microversion: 2.1 time: 0.063436 Aug 10 23:22:22.428877 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2663/5121] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:22:22 2022] DELETE /compute/v2.1/servers/5ae8b5a0-e56c-4154-a487-080d996d54d3 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 10 23:22:22.436715 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-721f5d2c-0b45-4375-87db-3af22611daae tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:22.437436 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-721f5d2c-0b45-4375-87db-3af22611daae tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: 5ae8b5a0-e56c-4154-a487-080d996d54d3] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:22.446311 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-721f5d2c-0b45-4375-87db-3af22611daae tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:22.447081 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-721f5d2c-0b45-4375-87db-3af22611daae tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:22.447665 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-721f5d2c-0b45-4375-87db-3af22611daae tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:22.448389 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-721f5d2c-0b45-4375-87db-3af22611daae tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:22.448909 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-721f5d2c-0b45-4375-87db-3af22611daae tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:22.453172 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-721f5d2c-0b45-4375-87db-3af22611daae tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:22.480834 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-721f5d2c-0b45-4375-87db-3af22611daae tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] HTTP exception thrown: Instance 5ae8b5a0-e56c-4154-a487-080d996d54d3 could not be found. Aug 10 23:22:22.482461 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-721f5d2c-0b45-4375-87db-3af22611daae tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Request method failure captured: Aug 10 23:22:22.482461 n-d-850468-14 devstack@n-api.service[122632]: request: GET /compute/v2.1/servers/5ae8b5a0-e56c-4154-a487-080d996d54d3 HTTP/1.1 Aug 10 23:22:22.482461 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:22:22.482461 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:22:22.482461 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:22:22.482461 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 23:22:22.482461 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:22:22.482461 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:22:22.482461 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:22:22.482461 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:22:22.482461 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9DytBT8uIivFlHEw3ugwW3-_1ks70Fcm-KUdUfNf3hiFdhb5xvDC9LI4u79J0X-frOTrhG-DWWR1w8a7yZU35-jGfQgN97QRTSA7hDEW06netEOKzarBlr77OO9sCeT3s5ektFA7vCYLl4122WPKHg-MSXQY0g9YmL291Ic7yNjWLnQ Aug 10 23:22:22.482461 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:22:22.482461 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:22:22.482461 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:22:22.482461 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:22:22.482461 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:22:22.482461 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:22:22.482461 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 0b0582ace9e4443b8ad88915503ee630 Aug 10 23:22:22.482461 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-ServersTestJSON-516662906 Aug 10 23:22:22.482461 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:22:22.482461 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:22:22.482461 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0b0582ace9e4443b8ad88915503ee630"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0b0582ace9e4443b8ad88915503ee630"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/0b0582ace9e4443b8ad88915503ee630"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_0b0582ace9e4443b8ad88915503ee630", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:22:22.482461 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-ServersTestJSON-516662906 Aug 10 23:22:22.482461 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 0b0582ace9e4443b8ad88915503ee630 Aug 10 23:22:22.482461 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-ServersTestJSON-516662906 Aug 10 23:22:22.482461 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-ServersTestJSON-516662906-project Aug 10 23:22:22.482461 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:22:22.482461 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:22:22.482461 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: 6684f0c87e4242be9e0ffb4ef1973f96 Aug 10 23:22:22.482461 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-ServersTestJSON-516662906-project Aug 10 23:22:22.482461 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:22:22.482461 n-d-850468-14 devstack@n-api.service[122632]: exception: Instance 5ae8b5a0-e56c-4154-a487-080d996d54d3 could not be found. Aug 10 23:22:22.482461 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': '5ae8b5a0-e56c-4154-a487-080d996d54d3'} Aug 10 23:22:22.482461 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:22:22.482461 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:22:22.482461 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:22:22.482461 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:22:22.482461 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:22:22.482461 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:22:22.482461 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:22:22.482461 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:22:22.482461 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:22:22.482461 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:22:22.482461 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ae8b5a0-e56c-4154-a487-080d996d54d3 could not be found. Aug 10 23:22:22.482461 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:22:22.482461 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:22:22.482461 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:22:22.482461 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:22:22.482461 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:22:22.482461 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:22:22.482461 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:22:22.482461 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:22:22.482461 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:22:22.482461 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:22:22.482461 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:22:22.482461 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:22:22.482461 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:22:22.482461 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:22:22.482461 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:22:22.482461 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:22:22.482461 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ae8b5a0-e56c-4154-a487-080d996d54d3 could not be found. Aug 10 23:22:22.482461 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:22:22.482461 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:22:22.482461 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:22:22.482461 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:22:22.486276 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:22:22.486276 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:22:22.486276 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:22:22.486276 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:22:22.486276 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ae8b5a0-e56c-4154-a487-080d996d54d3 could not be found. Aug 10 23:22:22.486276 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:22:22.486276 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-721f5d2c-0b45-4375-87db-3af22611daae tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Returning 404 to user: Instance 5ae8b5a0-e56c-4154-a487-080d996d54d3 could not be found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:22:22.486276 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-721f5d2c-0b45-4375-87db-3af22611daae tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "GET /compute/v2.1/servers/5ae8b5a0-e56c-4154-a487-080d996d54d3" status: 404 len: 111 microversion: 2.1 time: 0.052637 Aug 10 23:22:22.493037 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-4feb98e4-bdc4-4ced-932b-7eace290c2cc tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:22.493840 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-4feb98e4-bdc4-4ced-932b-7eace290c2cc tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: 53003fff-46d7-4621-93fb-c2751572bb90] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:22.499543 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2459/5122] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:22:22 2022] GET /compute/v2.1/servers/5ae8b5a0-e56c-4154-a487-080d996d54d3 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:22:22.501260 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4feb98e4-bdc4-4ced-932b-7eace290c2cc tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:22.501773 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4feb98e4-bdc4-4ced-932b-7eace290c2cc tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:22.502200 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4feb98e4-bdc4-4ced-932b-7eace290c2cc tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:22.504324 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4feb98e4-bdc4-4ced-932b-7eace290c2cc tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:22.505023 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4feb98e4-bdc4-4ced-932b-7eace290c2cc tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:22.505484 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4feb98e4-bdc4-4ced-932b-7eace290c2cc tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:22.525567 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-4feb98e4-bdc4-4ced-932b-7eace290c2cc tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] HTTP exception thrown: Instance 53003fff-46d7-4621-93fb-c2751572bb90 could not be found. Aug 10 23:22:22.527359 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-4feb98e4-bdc4-4ced-932b-7eace290c2cc tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Request method failure captured: Aug 10 23:22:22.527359 n-d-850468-14 devstack@n-api.service[122633]: request: DELETE /compute/v2.1/servers/53003fff-46d7-4621-93fb-c2751572bb90 HTTP/1.1 Aug 10 23:22:22.527359 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:22:22.527359 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:22:22.527359 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:22:22.527359 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:22:22.527359 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:22:22.527359 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:22:22.527359 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:22:22.527359 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:22:22.527359 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9DytBT8uIivFlHEw3ugwW3-_1ks70Fcm-KUdUfNf3hiFdhb5xvDC9LI4u79J0X-frOTrhG-DWWR1w8a7yZU35-jGfQgN97QRTSA7hDEW06netEOKzarBlr77OO9sCeT3s5ektFA7vCYLl4122WPKHg-MSXQY0g9YmL291Ic7yNjWLnQ Aug 10 23:22:22.527359 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:22:22.527359 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:22:22.527359 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:22:22.527359 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:22:22.527359 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:22:22.527359 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:22:22.527359 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 0b0582ace9e4443b8ad88915503ee630 Aug 10 23:22:22.527359 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-ServersTestJSON-516662906 Aug 10 23:22:22.527359 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:22:22.527359 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:22:22.527359 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0b0582ace9e4443b8ad88915503ee630"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0b0582ace9e4443b8ad88915503ee630"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/0b0582ace9e4443b8ad88915503ee630"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_0b0582ace9e4443b8ad88915503ee630", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:22:22.527359 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-ServersTestJSON-516662906 Aug 10 23:22:22.527359 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 0b0582ace9e4443b8ad88915503ee630 Aug 10 23:22:22.527359 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-ServersTestJSON-516662906 Aug 10 23:22:22.527359 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-ServersTestJSON-516662906-project Aug 10 23:22:22.527359 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:22:22.527359 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:22:22.527359 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 6684f0c87e4242be9e0ffb4ef1973f96 Aug 10 23:22:22.527359 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-ServersTestJSON-516662906-project Aug 10 23:22:22.527359 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:22:22.527359 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance 53003fff-46d7-4621-93fb-c2751572bb90 could not be found. Aug 10 23:22:22.527359 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': '53003fff-46d7-4621-93fb-c2751572bb90'} Aug 10 23:22:22.527359 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:22:22.527359 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:22:22.527359 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:22:22.527359 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:22:22.527359 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:22:22.527359 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:22:22.527359 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:22:22.527359 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:22:22.527359 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:22:22.527359 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:22:22.527359 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53003fff-46d7-4621-93fb-c2751572bb90 could not be found. Aug 10 23:22:22.527359 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:22:22.527359 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:22:22.527359 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:22:22.527359 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:22:22.527359 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:22:22.527359 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:22:22.527359 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:22:22.527359 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:22:22.527359 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:22:22.527359 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:22:22.527359 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 23:22:22.527359 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 23:22:22.527359 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 23:22:22.527359 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 23:22:22.527359 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:22:22.527359 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:22:22.527359 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:22:22.527359 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:22:22.527359 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53003fff-46d7-4621-93fb-c2751572bb90 could not be found. Aug 10 23:22:22.530248 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:22:22.530248 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:22:22.530248 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:22:22.530248 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:22:22.530248 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:22:22.530248 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:22:22.530248 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:22:22.530248 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:22:22.530248 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53003fff-46d7-4621-93fb-c2751572bb90 could not be found. Aug 10 23:22:22.530248 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:22:22.531583 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-4feb98e4-bdc4-4ced-932b-7eace290c2cc tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Returning 404 to user: Instance 53003fff-46d7-4621-93fb-c2751572bb90 could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:22:22.532583 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-4feb98e4-bdc4-4ced-932b-7eace290c2cc tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "DELETE /compute/v2.1/servers/53003fff-46d7-4621-93fb-c2751572bb90" status: 404 len: 111 microversion: 2.1 time: 0.043725 Aug 10 23:22:22.542278 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-cfa06edb-2a87-4328-a7a4-2d81911d01fa tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:22.543087 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-cfa06edb-2a87-4328-a7a4-2d81911d01fa tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: 53003fff-46d7-4621-93fb-c2751572bb90] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:22.550014 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2664/5123] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:22:22 2022] DELETE /compute/v2.1/servers/53003fff-46d7-4621-93fb-c2751572bb90 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:22:22.551919 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cfa06edb-2a87-4328-a7a4-2d81911d01fa tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:22.552568 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cfa06edb-2a87-4328-a7a4-2d81911d01fa tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:22.553155 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cfa06edb-2a87-4328-a7a4-2d81911d01fa tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:22.554009 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cfa06edb-2a87-4328-a7a4-2d81911d01fa tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:22.554601 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cfa06edb-2a87-4328-a7a4-2d81911d01fa tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:22.555243 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cfa06edb-2a87-4328-a7a4-2d81911d01fa tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:22.573453 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-cfa06edb-2a87-4328-a7a4-2d81911d01fa tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] HTTP exception thrown: Instance 53003fff-46d7-4621-93fb-c2751572bb90 could not be found. Aug 10 23:22:22.580338 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-cfa06edb-2a87-4328-a7a4-2d81911d01fa tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Request method failure captured: Aug 10 23:22:22.580338 n-d-850468-14 devstack@n-api.service[122632]: request: GET /compute/v2.1/servers/53003fff-46d7-4621-93fb-c2751572bb90 HTTP/1.1 Aug 10 23:22:22.580338 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:22:22.580338 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:22:22.580338 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:22:22.580338 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 23:22:22.580338 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:22:22.580338 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:22:22.580338 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:22:22.580338 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:22:22.580338 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9DytBT8uIivFlHEw3ugwW3-_1ks70Fcm-KUdUfNf3hiFdhb5xvDC9LI4u79J0X-frOTrhG-DWWR1w8a7yZU35-jGfQgN97QRTSA7hDEW06netEOKzarBlr77OO9sCeT3s5ektFA7vCYLl4122WPKHg-MSXQY0g9YmL291Ic7yNjWLnQ Aug 10 23:22:22.580338 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:22:22.580338 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:22:22.580338 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:22:22.580338 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:22:22.580338 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:22:22.580338 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:22:22.580338 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 0b0582ace9e4443b8ad88915503ee630 Aug 10 23:22:22.580338 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-ServersTestJSON-516662906 Aug 10 23:22:22.580338 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:22:22.580338 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:22:22.580338 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0b0582ace9e4443b8ad88915503ee630"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0b0582ace9e4443b8ad88915503ee630"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/0b0582ace9e4443b8ad88915503ee630"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_0b0582ace9e4443b8ad88915503ee630", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:22:22.580338 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-ServersTestJSON-516662906 Aug 10 23:22:22.580338 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 0b0582ace9e4443b8ad88915503ee630 Aug 10 23:22:22.580338 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-ServersTestJSON-516662906 Aug 10 23:22:22.580338 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-ServersTestJSON-516662906-project Aug 10 23:22:22.580338 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:22:22.580338 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:22:22.580338 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: 6684f0c87e4242be9e0ffb4ef1973f96 Aug 10 23:22:22.580338 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-ServersTestJSON-516662906-project Aug 10 23:22:22.580338 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:22:22.580338 n-d-850468-14 devstack@n-api.service[122632]: exception: Instance 53003fff-46d7-4621-93fb-c2751572bb90 could not be found. Aug 10 23:22:22.580338 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': '53003fff-46d7-4621-93fb-c2751572bb90'} Aug 10 23:22:22.580338 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:22:22.580338 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:22:22.580338 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:22:22.580338 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:22:22.580338 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:22:22.580338 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:22:22.580338 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:22:22.580338 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:22:22.580338 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:22:22.580338 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:22:22.580338 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53003fff-46d7-4621-93fb-c2751572bb90 could not be found. Aug 10 23:22:22.580338 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:22:22.580338 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:22:22.580338 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:22:22.580338 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:22:22.580338 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:22:22.580338 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:22:22.580338 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:22:22.580338 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:22:22.580338 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:22:22.580338 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:22:22.580338 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:22:22.580338 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:22:22.580338 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:22:22.580338 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:22:22.580338 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:22:22.580338 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:22:22.580338 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53003fff-46d7-4621-93fb-c2751572bb90 could not be found. Aug 10 23:22:22.580338 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:22:22.580338 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:22:22.580338 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:22:22.580338 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:22:22.585315 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:22:22.585315 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:22:22.585315 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:22:22.585315 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:22:22.585315 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53003fff-46d7-4621-93fb-c2751572bb90 could not be found. Aug 10 23:22:22.585315 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:22:22.586543 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-cfa06edb-2a87-4328-a7a4-2d81911d01fa tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Returning 404 to user: Instance 53003fff-46d7-4621-93fb-c2751572bb90 could not be found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:22:22.587062 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-cfa06edb-2a87-4328-a7a4-2d81911d01fa tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "GET /compute/v2.1/servers/53003fff-46d7-4621-93fb-c2751572bb90" status: 404 len: 111 microversion: 2.1 time: 0.049586 Aug 10 23:22:22.594482 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2460/5124] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:22:22 2022] GET /compute/v2.1/servers/53003fff-46d7-4621-93fb-c2751572bb90 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:22:22.603333 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-95d5ad06-3786-4c27-b76a-ce4b96ce939f tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:22.603930 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-95d5ad06-3786-4c27-b76a-ce4b96ce939f tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: d3455c49-214c-4635-b28b-f87ff636e960] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:22.613306 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-95d5ad06-3786-4c27-b76a-ce4b96ce939f tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:22.613800 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-95d5ad06-3786-4c27-b76a-ce4b96ce939f tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:22.614649 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-95d5ad06-3786-4c27-b76a-ce4b96ce939f tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:22.615518 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-95d5ad06-3786-4c27-b76a-ce4b96ce939f tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:22.616537 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-95d5ad06-3786-4c27-b76a-ce4b96ce939f tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:22.616971 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-95d5ad06-3786-4c27-b76a-ce4b96ce939f tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:22.641342 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-95d5ad06-3786-4c27-b76a-ce4b96ce939f tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] HTTP exception thrown: Instance d3455c49-214c-4635-b28b-f87ff636e960 could not be found. Aug 10 23:22:22.643160 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-95d5ad06-3786-4c27-b76a-ce4b96ce939f tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Request method failure captured: Aug 10 23:22:22.643160 n-d-850468-14 devstack@n-api.service[122633]: request: DELETE /compute/v2.1/servers/d3455c49-214c-4635-b28b-f87ff636e960 HTTP/1.1 Aug 10 23:22:22.643160 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:22:22.643160 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:22:22.643160 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:22:22.643160 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:22:22.643160 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:22:22.643160 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:22:22.643160 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:22:22.643160 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:22:22.643160 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9DytBT8uIivFlHEw3ugwW3-_1ks70Fcm-KUdUfNf3hiFdhb5xvDC9LI4u79J0X-frOTrhG-DWWR1w8a7yZU35-jGfQgN97QRTSA7hDEW06netEOKzarBlr77OO9sCeT3s5ektFA7vCYLl4122WPKHg-MSXQY0g9YmL291Ic7yNjWLnQ Aug 10 23:22:22.643160 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:22:22.643160 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:22:22.643160 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:22:22.643160 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:22:22.643160 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:22:22.643160 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:22:22.643160 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 0b0582ace9e4443b8ad88915503ee630 Aug 10 23:22:22.643160 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-ServersTestJSON-516662906 Aug 10 23:22:22.643160 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:22:22.643160 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:22:22.643160 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0b0582ace9e4443b8ad88915503ee630"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0b0582ace9e4443b8ad88915503ee630"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/0b0582ace9e4443b8ad88915503ee630"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_0b0582ace9e4443b8ad88915503ee630", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:22:22.643160 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-ServersTestJSON-516662906 Aug 10 23:22:22.643160 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 0b0582ace9e4443b8ad88915503ee630 Aug 10 23:22:22.643160 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-ServersTestJSON-516662906 Aug 10 23:22:22.643160 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-ServersTestJSON-516662906-project Aug 10 23:22:22.643160 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:22:22.643160 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:22:22.643160 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 6684f0c87e4242be9e0ffb4ef1973f96 Aug 10 23:22:22.643160 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-ServersTestJSON-516662906-project Aug 10 23:22:22.643160 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:22:22.643160 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance d3455c49-214c-4635-b28b-f87ff636e960 could not be found. Aug 10 23:22:22.643160 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': 'd3455c49-214c-4635-b28b-f87ff636e960'} Aug 10 23:22:22.643160 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:22:22.643160 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:22:22.643160 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:22:22.643160 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:22:22.643160 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:22:22.643160 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:22:22.643160 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:22:22.643160 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:22:22.643160 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:22:22.643160 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:22:22.643160 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3455c49-214c-4635-b28b-f87ff636e960 could not be found. Aug 10 23:22:22.643160 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:22:22.643160 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:22:22.643160 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:22:22.643160 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:22:22.643160 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:22:22.643160 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:22:22.643160 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:22:22.643160 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:22:22.643160 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:22:22.643160 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:22:22.643160 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 23:22:22.643160 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 23:22:22.643160 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 23:22:22.643160 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 23:22:22.643160 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:22:22.643160 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:22:22.643160 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:22:22.643160 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:22:22.643160 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3455c49-214c-4635-b28b-f87ff636e960 could not be found. Aug 10 23:22:22.646021 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:22:22.646021 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:22:22.646021 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:22:22.646021 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:22:22.646021 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:22:22.646021 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:22:22.646021 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:22:22.646021 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:22:22.646021 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3455c49-214c-4635-b28b-f87ff636e960 could not be found. Aug 10 23:22:22.646021 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:22:22.648007 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-95d5ad06-3786-4c27-b76a-ce4b96ce939f tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Returning 404 to user: Instance d3455c49-214c-4635-b28b-f87ff636e960 could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:22:22.649027 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-95d5ad06-3786-4c27-b76a-ce4b96ce939f tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "DELETE /compute/v2.1/servers/d3455c49-214c-4635-b28b-f87ff636e960" status: 404 len: 111 microversion: 2.1 time: 0.050314 Aug 10 23:22:22.649635 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2665/5125] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:22:22 2022] DELETE /compute/v2.1/servers/d3455c49-214c-4635-b28b-f87ff636e960 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:22:22.661014 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-fb28c6b0-1a85-4d4a-95ba-fc34012428ae tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:22.661997 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-fb28c6b0-1a85-4d4a-95ba-fc34012428ae tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: d3455c49-214c-4635-b28b-f87ff636e960] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:22.676297 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fb28c6b0-1a85-4d4a-95ba-fc34012428ae tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:22.677031 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fb28c6b0-1a85-4d4a-95ba-fc34012428ae tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:22.677581 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fb28c6b0-1a85-4d4a-95ba-fc34012428ae tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:22.679137 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fb28c6b0-1a85-4d4a-95ba-fc34012428ae tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:22.682254 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fb28c6b0-1a85-4d4a-95ba-fc34012428ae tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:22.683198 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fb28c6b0-1a85-4d4a-95ba-fc34012428ae tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:22.703801 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-fb28c6b0-1a85-4d4a-95ba-fc34012428ae tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] HTTP exception thrown: Instance d3455c49-214c-4635-b28b-f87ff636e960 could not be found. Aug 10 23:22:22.705802 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-fb28c6b0-1a85-4d4a-95ba-fc34012428ae tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Request method failure captured: Aug 10 23:22:22.705802 n-d-850468-14 devstack@n-api.service[122632]: request: GET /compute/v2.1/servers/d3455c49-214c-4635-b28b-f87ff636e960 HTTP/1.1 Aug 10 23:22:22.705802 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:22:22.705802 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:22:22.705802 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:22:22.705802 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 23:22:22.705802 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:22:22.705802 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:22:22.705802 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:22:22.705802 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:22:22.705802 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9DytBT8uIivFlHEw3ugwW3-_1ks70Fcm-KUdUfNf3hiFdhb5xvDC9LI4u79J0X-frOTrhG-DWWR1w8a7yZU35-jGfQgN97QRTSA7hDEW06netEOKzarBlr77OO9sCeT3s5ektFA7vCYLl4122WPKHg-MSXQY0g9YmL291Ic7yNjWLnQ Aug 10 23:22:22.705802 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:22:22.705802 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:22:22.705802 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:22:22.705802 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:22:22.705802 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:22:22.705802 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:22:22.705802 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 0b0582ace9e4443b8ad88915503ee630 Aug 10 23:22:22.705802 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-ServersTestJSON-516662906 Aug 10 23:22:22.705802 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:22:22.705802 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:22:22.705802 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0b0582ace9e4443b8ad88915503ee630"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0b0582ace9e4443b8ad88915503ee630"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/0b0582ace9e4443b8ad88915503ee630"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_0b0582ace9e4443b8ad88915503ee630", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:22:22.705802 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-ServersTestJSON-516662906 Aug 10 23:22:22.705802 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 0b0582ace9e4443b8ad88915503ee630 Aug 10 23:22:22.705802 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-ServersTestJSON-516662906 Aug 10 23:22:22.705802 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-ServersTestJSON-516662906-project Aug 10 23:22:22.705802 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:22:22.705802 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:22:22.705802 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: 6684f0c87e4242be9e0ffb4ef1973f96 Aug 10 23:22:22.705802 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-ServersTestJSON-516662906-project Aug 10 23:22:22.705802 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:22:22.705802 n-d-850468-14 devstack@n-api.service[122632]: exception: Instance d3455c49-214c-4635-b28b-f87ff636e960 could not be found. Aug 10 23:22:22.705802 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': 'd3455c49-214c-4635-b28b-f87ff636e960'} Aug 10 23:22:22.705802 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:22:22.705802 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:22:22.705802 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:22:22.705802 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:22:22.705802 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:22:22.705802 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:22:22.705802 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:22:22.705802 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:22:22.705802 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:22:22.705802 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:22:22.705802 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3455c49-214c-4635-b28b-f87ff636e960 could not be found. Aug 10 23:22:22.705802 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:22:22.705802 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:22:22.705802 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:22:22.705802 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:22:22.705802 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:22:22.705802 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:22:22.705802 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:22:22.705802 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:22:22.705802 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:22:22.705802 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:22:22.705802 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:22:22.705802 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:22:22.705802 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:22:22.705802 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:22:22.705802 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:22:22.705802 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:22:22.705802 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3455c49-214c-4635-b28b-f87ff636e960 could not be found. Aug 10 23:22:22.705802 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:22:22.705802 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:22:22.705802 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:22:22.705802 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:22:22.709438 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:22:22.709438 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:22:22.709438 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:22:22.709438 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:22:22.709438 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3455c49-214c-4635-b28b-f87ff636e960 could not be found. Aug 10 23:22:22.709438 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:22:22.709982 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-fb28c6b0-1a85-4d4a-95ba-fc34012428ae tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Returning 404 to user: Instance d3455c49-214c-4635-b28b-f87ff636e960 could not be found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:22:22.715973 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-fb28c6b0-1a85-4d4a-95ba-fc34012428ae tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "GET /compute/v2.1/servers/d3455c49-214c-4635-b28b-f87ff636e960" status: 404 len: 111 microversion: 2.1 time: 0.055008 Aug 10 23:22:22.715973 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2461/5126] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:22:22 2022] GET /compute/v2.1/servers/d3455c49-214c-4635-b28b-f87ff636e960 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:22:22.719773 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-f225e10d-5c1f-4d83-aaaf-65c920ee6a30 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:22.720263 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-f225e10d-5c1f-4d83-aaaf-65c920ee6a30 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: 641b3607-8ef3-4e41-ab75-28a6ab178750] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:22.739924 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f225e10d-5c1f-4d83-aaaf-65c920ee6a30 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:22.740609 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f225e10d-5c1f-4d83-aaaf-65c920ee6a30 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:22.741053 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f225e10d-5c1f-4d83-aaaf-65c920ee6a30 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:22.743185 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f225e10d-5c1f-4d83-aaaf-65c920ee6a30 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:22.744053 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f225e10d-5c1f-4d83-aaaf-65c920ee6a30 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:22.744663 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f225e10d-5c1f-4d83-aaaf-65c920ee6a30 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:22.781302 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-f225e10d-5c1f-4d83-aaaf-65c920ee6a30 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] HTTP exception thrown: Instance 641b3607-8ef3-4e41-ab75-28a6ab178750 could not be found. Aug 10 23:22:22.783009 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-f225e10d-5c1f-4d83-aaaf-65c920ee6a30 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Request method failure captured: Aug 10 23:22:22.783009 n-d-850468-14 devstack@n-api.service[122633]: request: DELETE /compute/v2.1/servers/641b3607-8ef3-4e41-ab75-28a6ab178750 HTTP/1.1 Aug 10 23:22:22.783009 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:22:22.783009 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:22:22.783009 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:22:22.783009 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:22:22.783009 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:22:22.783009 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:22:22.783009 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:22:22.783009 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:22:22.783009 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9DytBT8uIivFlHEw3ugwW3-_1ks70Fcm-KUdUfNf3hiFdhb5xvDC9LI4u79J0X-frOTrhG-DWWR1w8a7yZU35-jGfQgN97QRTSA7hDEW06netEOKzarBlr77OO9sCeT3s5ektFA7vCYLl4122WPKHg-MSXQY0g9YmL291Ic7yNjWLnQ Aug 10 23:22:22.783009 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:22:22.783009 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:22:22.783009 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:22:22.783009 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:22:22.783009 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:22:22.783009 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:22:22.783009 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 0b0582ace9e4443b8ad88915503ee630 Aug 10 23:22:22.783009 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-ServersTestJSON-516662906 Aug 10 23:22:22.783009 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:22:22.783009 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:22:22.783009 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0b0582ace9e4443b8ad88915503ee630"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0b0582ace9e4443b8ad88915503ee630"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/0b0582ace9e4443b8ad88915503ee630"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_0b0582ace9e4443b8ad88915503ee630", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:22:22.783009 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-ServersTestJSON-516662906 Aug 10 23:22:22.783009 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 0b0582ace9e4443b8ad88915503ee630 Aug 10 23:22:22.783009 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-ServersTestJSON-516662906 Aug 10 23:22:22.783009 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-ServersTestJSON-516662906-project Aug 10 23:22:22.783009 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:22:22.783009 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:22:22.783009 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 6684f0c87e4242be9e0ffb4ef1973f96 Aug 10 23:22:22.783009 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-ServersTestJSON-516662906-project Aug 10 23:22:22.783009 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:22:22.783009 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance 641b3607-8ef3-4e41-ab75-28a6ab178750 could not be found. Aug 10 23:22:22.783009 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': '641b3607-8ef3-4e41-ab75-28a6ab178750'} Aug 10 23:22:22.783009 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:22:22.783009 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:22:22.783009 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:22:22.783009 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:22:22.783009 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:22:22.783009 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:22:22.783009 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:22:22.783009 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:22:22.783009 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:22:22.783009 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:22:22.783009 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 641b3607-8ef3-4e41-ab75-28a6ab178750 could not be found. Aug 10 23:22:22.783009 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:22:22.783009 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:22:22.783009 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:22:22.783009 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:22:22.783009 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:22:22.783009 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:22:22.783009 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:22:22.783009 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:22:22.783009 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:22:22.783009 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:22:22.783009 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 23:22:22.783009 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 23:22:22.783009 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 23:22:22.783009 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 23:22:22.783009 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:22:22.783009 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:22:22.783009 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:22:22.783009 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:22:22.783009 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 641b3607-8ef3-4e41-ab75-28a6ab178750 could not be found. Aug 10 23:22:22.786794 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:22:22.786794 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:22:22.786794 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:22:22.786794 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:22:22.786794 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:22:22.786794 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:22:22.786794 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:22:22.786794 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:22:22.786794 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 641b3607-8ef3-4e41-ab75-28a6ab178750 could not be found. Aug 10 23:22:22.786794 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:22:22.786794 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-f225e10d-5c1f-4d83-aaaf-65c920ee6a30 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Returning 404 to user: Instance 641b3607-8ef3-4e41-ab75-28a6ab178750 could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:22:22.786794 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-f225e10d-5c1f-4d83-aaaf-65c920ee6a30 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "DELETE /compute/v2.1/servers/641b3607-8ef3-4e41-ab75-28a6ab178750" status: 404 len: 111 microversion: 2.1 time: 0.068747 Aug 10 23:22:22.786794 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2666/5127] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:22:22 2022] DELETE /compute/v2.1/servers/641b3607-8ef3-4e41-ab75-28a6ab178750 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:22:22.795035 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-4f9602a9-87a1-4ba3-815c-d15a6a95a277 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:22.796389 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-4f9602a9-87a1-4ba3-815c-d15a6a95a277 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: 641b3607-8ef3-4e41-ab75-28a6ab178750] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:22.812343 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4f9602a9-87a1-4ba3-815c-d15a6a95a277 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:22.812755 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4f9602a9-87a1-4ba3-815c-d15a6a95a277 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:22.813202 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4f9602a9-87a1-4ba3-815c-d15a6a95a277 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:22.813925 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4f9602a9-87a1-4ba3-815c-d15a6a95a277 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:22.814451 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4f9602a9-87a1-4ba3-815c-d15a6a95a277 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:22.814927 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4f9602a9-87a1-4ba3-815c-d15a6a95a277 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:22.843377 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-4f9602a9-87a1-4ba3-815c-d15a6a95a277 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] HTTP exception thrown: Instance 641b3607-8ef3-4e41-ab75-28a6ab178750 could not be found. Aug 10 23:22:22.845047 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-4f9602a9-87a1-4ba3-815c-d15a6a95a277 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Request method failure captured: Aug 10 23:22:22.845047 n-d-850468-14 devstack@n-api.service[122632]: request: GET /compute/v2.1/servers/641b3607-8ef3-4e41-ab75-28a6ab178750 HTTP/1.1 Aug 10 23:22:22.845047 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:22:22.845047 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:22:22.845047 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:22:22.845047 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 23:22:22.845047 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:22:22.845047 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:22:22.845047 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:22:22.845047 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:22:22.845047 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9DytBT8uIivFlHEw3ugwW3-_1ks70Fcm-KUdUfNf3hiFdhb5xvDC9LI4u79J0X-frOTrhG-DWWR1w8a7yZU35-jGfQgN97QRTSA7hDEW06netEOKzarBlr77OO9sCeT3s5ektFA7vCYLl4122WPKHg-MSXQY0g9YmL291Ic7yNjWLnQ Aug 10 23:22:22.845047 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:22:22.845047 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:22:22.845047 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:22:22.845047 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:22:22.845047 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:22:22.845047 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:22:22.845047 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 0b0582ace9e4443b8ad88915503ee630 Aug 10 23:22:22.845047 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-ServersTestJSON-516662906 Aug 10 23:22:22.845047 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:22:22.845047 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:22:22.845047 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0b0582ace9e4443b8ad88915503ee630"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0b0582ace9e4443b8ad88915503ee630"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/0b0582ace9e4443b8ad88915503ee630"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_0b0582ace9e4443b8ad88915503ee630", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:22:22.845047 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-ServersTestJSON-516662906 Aug 10 23:22:22.845047 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 0b0582ace9e4443b8ad88915503ee630 Aug 10 23:22:22.845047 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-ServersTestJSON-516662906 Aug 10 23:22:22.845047 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-ServersTestJSON-516662906-project Aug 10 23:22:22.845047 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:22:22.845047 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:22:22.845047 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: 6684f0c87e4242be9e0ffb4ef1973f96 Aug 10 23:22:22.845047 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-ServersTestJSON-516662906-project Aug 10 23:22:22.845047 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:22:22.845047 n-d-850468-14 devstack@n-api.service[122632]: exception: Instance 641b3607-8ef3-4e41-ab75-28a6ab178750 could not be found. Aug 10 23:22:22.845047 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': '641b3607-8ef3-4e41-ab75-28a6ab178750'} Aug 10 23:22:22.845047 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:22:22.845047 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:22:22.845047 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:22:22.845047 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:22:22.845047 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:22:22.845047 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:22:22.845047 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:22:22.845047 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:22:22.845047 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:22:22.845047 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:22:22.845047 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 641b3607-8ef3-4e41-ab75-28a6ab178750 could not be found. Aug 10 23:22:22.845047 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:22:22.845047 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:22:22.845047 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:22:22.845047 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:22:22.845047 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:22:22.845047 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:22:22.845047 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:22:22.845047 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:22:22.845047 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:22:22.845047 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:22:22.845047 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:22:22.845047 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:22:22.845047 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:22:22.845047 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:22:22.845047 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:22:22.845047 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:22:22.845047 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 641b3607-8ef3-4e41-ab75-28a6ab178750 could not be found. Aug 10 23:22:22.845047 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:22:22.845047 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:22:22.845047 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:22:22.845047 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:22:22.849324 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:22:22.849324 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:22:22.849324 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:22:22.849324 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:22:22.849324 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 641b3607-8ef3-4e41-ab75-28a6ab178750 could not be found. Aug 10 23:22:22.849324 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:22:22.849324 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-4f9602a9-87a1-4ba3-815c-d15a6a95a277 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Returning 404 to user: Instance 641b3607-8ef3-4e41-ab75-28a6ab178750 could not be found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:22:22.849324 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-4f9602a9-87a1-4ba3-815c-d15a6a95a277 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "GET /compute/v2.1/servers/641b3607-8ef3-4e41-ab75-28a6ab178750" status: 404 len: 111 microversion: 2.1 time: 0.057220 Aug 10 23:22:22.849324 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2462/5128] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:22:22 2022] GET /compute/v2.1/servers/641b3607-8ef3-4e41-ab75-28a6ab178750 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:22:22.859269 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-6158077b-8434-4936-805b-10a42b12237a tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:22.860307 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-6158077b-8434-4936-805b-10a42b12237a tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: 820f7087-4d63-448c-a8fc-6d815c0c6ba2] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:22.867734 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-6158077b-8434-4936-805b-10a42b12237a tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] HTTP exception thrown: Instance 820f7087-4d63-448c-a8fc-6d815c0c6ba2 could not be found. Aug 10 23:22:22.869725 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-6158077b-8434-4936-805b-10a42b12237a tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Request method failure captured: Aug 10 23:22:22.869725 n-d-850468-14 devstack@n-api.service[122633]: request: DELETE /compute/v2.1/servers/820f7087-4d63-448c-a8fc-6d815c0c6ba2 HTTP/1.1 Aug 10 23:22:22.869725 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:22:22.869725 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:22:22.869725 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:22:22.869725 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:22:22.869725 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:22:22.869725 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:22:22.869725 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:22:22.869725 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:22:22.869725 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9DytBT8uIivFlHEw3ugwW3-_1ks70Fcm-KUdUfNf3hiFdhb5xvDC9LI4u79J0X-frOTrhG-DWWR1w8a7yZU35-jGfQgN97QRTSA7hDEW06netEOKzarBlr77OO9sCeT3s5ektFA7vCYLl4122WPKHg-MSXQY0g9YmL291Ic7yNjWLnQ Aug 10 23:22:22.869725 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:22:22.869725 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:22:22.869725 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:22:22.869725 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:22:22.869725 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:22:22.869725 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:22:22.869725 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 0b0582ace9e4443b8ad88915503ee630 Aug 10 23:22:22.869725 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-ServersTestJSON-516662906 Aug 10 23:22:22.869725 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:22:22.869725 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:22:22.869725 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0b0582ace9e4443b8ad88915503ee630"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0b0582ace9e4443b8ad88915503ee630"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/0b0582ace9e4443b8ad88915503ee630"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_0b0582ace9e4443b8ad88915503ee630", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:22:22.869725 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-ServersTestJSON-516662906 Aug 10 23:22:22.869725 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 0b0582ace9e4443b8ad88915503ee630 Aug 10 23:22:22.869725 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-ServersTestJSON-516662906 Aug 10 23:22:22.869725 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-ServersTestJSON-516662906-project Aug 10 23:22:22.869725 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:22:22.869725 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:22:22.869725 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 6684f0c87e4242be9e0ffb4ef1973f96 Aug 10 23:22:22.869725 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-ServersTestJSON-516662906-project Aug 10 23:22:22.869725 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:22:22.869725 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance 820f7087-4d63-448c-a8fc-6d815c0c6ba2 could not be found. Aug 10 23:22:22.869725 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': '820f7087-4d63-448c-a8fc-6d815c0c6ba2'} Aug 10 23:22:22.869725 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:22:22.869725 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:22:22.869725 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:22:22.869725 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:22:22.869725 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:22:22.869725 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:22:22.869725 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 10 23:22:22.869725 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 10 23:22:22.869725 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 820f7087-4d63-448c-a8fc-6d815c0c6ba2 could not be found. Aug 10 23:22:22.869725 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:22:22.869725 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:22:22.869725 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:22:22.869725 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:22:22.869725 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:22:22.869725 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:22:22.869725 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:22:22.869725 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:22:22.869725 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:22:22.869725 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:22:22.869725 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 23:22:22.869725 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 23:22:22.869725 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 23:22:22.869725 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 23:22:22.869725 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:22:22.869725 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:22:22.869725 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:22:22.869725 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:22:22.869725 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 820f7087-4d63-448c-a8fc-6d815c0c6ba2 could not be found. Aug 10 23:22:22.869725 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:22:22.869725 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:22:22.869725 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:22:22.874326 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:22:22.874326 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:22:22.874326 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:22:22.874326 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:22:22.874326 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:22:22.874326 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 820f7087-4d63-448c-a8fc-6d815c0c6ba2 could not be found. Aug 10 23:22:22.874326 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:22:22.874326 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-6158077b-8434-4936-805b-10a42b12237a tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Returning 404 to user: Instance 820f7087-4d63-448c-a8fc-6d815c0c6ba2 could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:22:22.874326 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-6158077b-8434-4936-805b-10a42b12237a tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "DELETE /compute/v2.1/servers/820f7087-4d63-448c-a8fc-6d815c0c6ba2" status: 404 len: 111 microversion: 2.1 time: 0.021991 Aug 10 23:22:22.884663 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-a4dc8022-53e7-418d-b339-933802ae4e7b tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:22.886648 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-a4dc8022-53e7-418d-b339-933802ae4e7b tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: 820f7087-4d63-448c-a8fc-6d815c0c6ba2] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:22.887146 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2667/5129] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:22:22 2022] DELETE /compute/v2.1/servers/820f7087-4d63-448c-a8fc-6d815c0c6ba2 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:22:22.895323 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-a4dc8022-53e7-418d-b339-933802ae4e7b tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] HTTP exception thrown: Instance 820f7087-4d63-448c-a8fc-6d815c0c6ba2 could not be found. Aug 10 23:22:22.898413 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-a4dc8022-53e7-418d-b339-933802ae4e7b tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Request method failure captured: Aug 10 23:22:22.898413 n-d-850468-14 devstack@n-api.service[122632]: request: GET /compute/v2.1/servers/820f7087-4d63-448c-a8fc-6d815c0c6ba2 HTTP/1.1 Aug 10 23:22:22.898413 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:22:22.898413 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:22:22.898413 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:22:22.898413 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 23:22:22.898413 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:22:22.898413 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:22:22.898413 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:22:22.898413 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:22:22.898413 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9DytBT8uIivFlHEw3ugwW3-_1ks70Fcm-KUdUfNf3hiFdhb5xvDC9LI4u79J0X-frOTrhG-DWWR1w8a7yZU35-jGfQgN97QRTSA7hDEW06netEOKzarBlr77OO9sCeT3s5ektFA7vCYLl4122WPKHg-MSXQY0g9YmL291Ic7yNjWLnQ Aug 10 23:22:22.898413 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:22:22.898413 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:22:22.898413 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:22:22.898413 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:22:22.898413 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:22:22.898413 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:22:22.898413 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 0b0582ace9e4443b8ad88915503ee630 Aug 10 23:22:22.898413 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-ServersTestJSON-516662906 Aug 10 23:22:22.898413 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:22:22.898413 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:22:22.898413 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0b0582ace9e4443b8ad88915503ee630"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0b0582ace9e4443b8ad88915503ee630"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/0b0582ace9e4443b8ad88915503ee630"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_0b0582ace9e4443b8ad88915503ee630", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:22:22.898413 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-ServersTestJSON-516662906 Aug 10 23:22:22.898413 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 0b0582ace9e4443b8ad88915503ee630 Aug 10 23:22:22.898413 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-ServersTestJSON-516662906 Aug 10 23:22:22.898413 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-ServersTestJSON-516662906-project Aug 10 23:22:22.898413 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:22:22.898413 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:22:22.898413 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: 6684f0c87e4242be9e0ffb4ef1973f96 Aug 10 23:22:22.898413 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-ServersTestJSON-516662906-project Aug 10 23:22:22.898413 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:22:22.898413 n-d-850468-14 devstack@n-api.service[122632]: exception: Instance 820f7087-4d63-448c-a8fc-6d815c0c6ba2 could not be found. Aug 10 23:22:22.898413 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': '820f7087-4d63-448c-a8fc-6d815c0c6ba2'} Aug 10 23:22:22.898413 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:22:22.898413 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:22:22.898413 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:22:22.898413 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:22:22.898413 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:22:22.898413 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:22:22.898413 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 10 23:22:22.898413 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 10 23:22:22.898413 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 820f7087-4d63-448c-a8fc-6d815c0c6ba2 could not be found. Aug 10 23:22:22.898413 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:22:22.898413 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:22:22.898413 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:22:22.898413 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:22:22.898413 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:22:22.898413 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:22:22.898413 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:22:22.898413 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:22:22.898413 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:22:22.898413 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:22:22.898413 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:22:22.898413 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:22:22.898413 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:22:22.898413 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:22:22.898413 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:22:22.898413 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:22:22.898413 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 820f7087-4d63-448c-a8fc-6d815c0c6ba2 could not be found. Aug 10 23:22:22.898413 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:22:22.898413 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:22:22.898413 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:22:22.898413 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:22:22.898413 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:22:22.898413 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:22:22.901934 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:22:22.901934 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:22:22.901934 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 820f7087-4d63-448c-a8fc-6d815c0c6ba2 could not be found. Aug 10 23:22:22.901934 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:22:22.903806 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-a4dc8022-53e7-418d-b339-933802ae4e7b tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Returning 404 to user: Instance 820f7087-4d63-448c-a8fc-6d815c0c6ba2 could not be found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:22:22.904987 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-a4dc8022-53e7-418d-b339-933802ae4e7b tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "GET /compute/v2.1/servers/820f7087-4d63-448c-a8fc-6d815c0c6ba2" status: 404 len: 111 microversion: 2.1 time: 0.026138 Aug 10 23:22:22.906177 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2463/5130] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:22:22 2022] GET /compute/v2.1/servers/820f7087-4d63-448c-a8fc-6d815c0c6ba2 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:22:22.915437 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-73554352-c713-4f26-ae57-15438557c5d4 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:22.916084 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-73554352-c713-4f26-ae57-15438557c5d4 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: 1885b741-1fc3-413a-bb33-f8d3aeff8b04] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:22.931200 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-73554352-c713-4f26-ae57-15438557c5d4 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:22.942201 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-73554352-c713-4f26-ae57-15438557c5d4 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:22.942872 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-73554352-c713-4f26-ae57-15438557c5d4 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:22.944194 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-73554352-c713-4f26-ae57-15438557c5d4 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:22.945904 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-73554352-c713-4f26-ae57-15438557c5d4 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:22.946679 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-73554352-c713-4f26-ae57-15438557c5d4 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:22.990986 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-73554352-c713-4f26-ae57-15438557c5d4 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: 1885b741-1fc3-413a-bb33-f8d3aeff8b04] Going to try to terminate instance {{(pid=122633) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:22:23.071327 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-473e5291-1e98-46d2-81a6-930015395026 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9cea5599-6c37-48ec-8d9c-8af49aa354c3"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:22:23.075782 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-473e5291-1e98-46d2-81a6-930015395026 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] [instance: 440c3d30-e5c9-4093-9b7e-39e06d32d682] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:23.102017 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-473e5291-1e98-46d2-81a6-930015395026 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:23.103148 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-473e5291-1e98-46d2-81a6-930015395026 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:23.105266 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-473e5291-1e98-46d2-81a6-930015395026 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:23.106314 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-473e5291-1e98-46d2-81a6-930015395026 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:23.108615 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-473e5291-1e98-46d2-81a6-930015395026 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:23.112082 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-473e5291-1e98-46d2-81a6-930015395026 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:23.165549 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-73554352-c713-4f26-ae57-15438557c5d4 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "DELETE /compute/v2.1/servers/1885b741-1fc3-413a-bb33-f8d3aeff8b04" status: 204 len: 0 microversion: 2.1 time: 0.254882 Aug 10 23:22:23.170985 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2668/5131] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:22:22 2022] DELETE /compute/v2.1/servers/1885b741-1fc3-413a-bb33-f8d3aeff8b04 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:22:23.185887 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-2cde9762-38b2-46aa-bf04-d6f4b46ef375 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:23.187349 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-2cde9762-38b2-46aa-bf04-d6f4b46ef375 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: 1885b741-1fc3-413a-bb33-f8d3aeff8b04] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:23.223933 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2cde9762-38b2-46aa-bf04-d6f4b46ef375 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:23.224624 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2cde9762-38b2-46aa-bf04-d6f4b46ef375 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:23.225252 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2cde9762-38b2-46aa-bf04-d6f4b46ef375 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:23.226433 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2cde9762-38b2-46aa-bf04-d6f4b46ef375 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:23.226925 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2cde9762-38b2-46aa-bf04-d6f4b46ef375 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:23.227351 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2cde9762-38b2-46aa-bf04-d6f4b46ef375 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:23.305539 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-473e5291-1e98-46d2-81a6-930015395026 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] HTTP exception thrown: Invalid volume: volume 9cea5599-6c37-48ec-8d9c-8af49aa354c3 is already attached to instances: 440c3d30-e5c9-4093-9b7e-39e06d32d682 Aug 10 23:22:23.307610 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-473e5291-1e98-46d2-81a6-930015395026 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Request method failure captured: Aug 10 23:22:23.307610 n-d-850468-14 devstack@n-api.service[122632]: request: POST /compute/v2.1/servers/440c3d30-e5c9-4093-9b7e-39e06d32d682/os-volume_attachments HTTP/1.1 Aug 10 23:22:23.307610 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:22:23.307610 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:22:23.307610 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:22:23.307610 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 74 Aug 10 23:22:23.307610 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:22:23.307610 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:22:23.307610 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:22:23.307610 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:22:23.307610 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9Dyh6-R-3HT3qmAYw73oJfCuu2NJv_Uk6ESXtcq6VvNMtaQn1cTuz-I3qzoDfMZYBb14V5s9aXOf7KFvhR2arcnhZ5gC9SddHqo24MvVPxr7p8PNkuseL9l1-7bXrad-0RpRPdQnhZkSYtsPZXEtrxg11yCwwP1jlsEo-QBQNYEMWc4 Aug 10 23:22:23.307610 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:22:23.307610 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:22:23.307610 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:22:23.307610 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:22:23.307610 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:22:23.307610 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:22:23.307610 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 2b557edd165144c8943eb9acc339a377 Aug 10 23:22:23.307610 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-AttachVolumeNegativeTest-393353666 Aug 10 23:22:23.307610 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:22:23.307610 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:22:23.307610 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2b557edd165144c8943eb9acc339a377"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2b557edd165144c8943eb9acc339a377"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2b557edd165144c8943eb9acc339a377"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2b557edd165144c8943eb9acc339a377", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:22:23.307610 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-AttachVolumeNegativeTest-393353666 Aug 10 23:22:23.307610 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 2b557edd165144c8943eb9acc339a377 Aug 10 23:22:23.307610 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-393353666 Aug 10 23:22:23.307610 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-AttachVolumeNegativeTest-393353666-project Aug 10 23:22:23.307610 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:22:23.307610 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:22:23.307610 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: 0d89081084f14e0187f4c67cd9185fef Aug 10 23:22:23.307610 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-AttachVolumeNegativeTest-393353666-project Aug 10 23:22:23.307610 n-d-850468-14 devstack@n-api.service[122632]: Aug 10 23:22:23.307610 n-d-850468-14 devstack@n-api.service[122632]: {"volumeAttachment": {"volumeId": "9cea5599-6c37-48ec-8d9c-8af49aa354c3"}} Aug 10 23:22:23.307610 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:22:23.307610 n-d-850468-14 devstack@n-api.service[122632]: exception: Invalid volume: volume 9cea5599-6c37-48ec-8d9c-8af49aa354c3 is already attached to instances: 440c3d30-e5c9-4093-9b7e-39e06d32d682 Aug 10 23:22:23.307610 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'server_id': '440c3d30-e5c9-4093-9b7e-39e06d32d682', 'body': {'volumeAttachment': {'volumeId': '9cea5599-6c37-48ec-8d9c-8af49aa354c3'}}} Aug 10 23:22:23.307610 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:22:23.307610 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:22:23.307610 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 10 23:22:23.307610 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 10 23:22:23.307610 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 10 23:22:23.307610 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 10 23:22:23.307610 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 10 23:22:23.307610 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 10 23:22:23.307610 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5079, in attach_volume Aug 10 23:22:23.307610 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 10 23:22:23.307610 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4919, in _check_volume_already_attached Aug 10 23:22:23.307610 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 10 23:22:23.307610 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 9cea5599-6c37-48ec-8d9c-8af49aa354c3 is already attached to instances: 440c3d30-e5c9-4093-9b7e-39e06d32d682 Aug 10 23:22:23.307610 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:22:23.307610 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:22:23.307610 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:22:23.307610 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:22:23.307610 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:22:23.307610 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:22:23.307610 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:22:23.307610 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:22:23.307610 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:22:23.307610 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:22:23.307610 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 23:22:23.307610 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 23:22:23.307610 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 23:22:23.307610 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 23:22:23.311360 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 23:22:23.311360 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 23:22:23.311360 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 10 23:22:23.311360 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 10 23:22:23.311360 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 9cea5599-6c37-48ec-8d9c-8af49aa354c3 is already attached to instances: 440c3d30-e5c9-4093-9b7e-39e06d32d682 Aug 10 23:22:23.311360 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:22:23.311360 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:22:23.311360 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:22:23.311360 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:22:23.311360 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:22:23.311360 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:22:23.311360 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:22:23.311360 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:22:23.311360 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 9cea5599-6c37-48ec-8d9c-8af49aa354c3 is already attached to instances: 440c3d30-e5c9-4093-9b7e-39e06d32d682 Aug 10 23:22:23.311360 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:22:23.315488 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-473e5291-1e98-46d2-81a6-930015395026 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Returning 400 to user: Invalid volume: volume 9cea5599-6c37-48ec-8d9c-8af49aa354c3 is already attached to instances: 440c3d30-e5c9-4093-9b7e-39e06d32d682 {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:22:23.316944 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-473e5291-1e98-46d2-81a6-930015395026 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] 10.222.0.58 "POST /compute/v2.1/servers/440c3d30-e5c9-4093-9b7e-39e06d32d682/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.254200 Aug 10 23:22:23.317744 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2464/5132] 10.222.0.58 () {60 vars in 1323 bytes} [Wed Aug 10 23:22:23 2022] POST /compute/v2.1/servers/440c3d30-e5c9-4093-9b7e-39e06d32d682/os-volume_attachments => generated 174 bytes in 256 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 10 23:22:23.395906 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-fdf8af81-35a8-4117-a5ee-c53e1c2927f4 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:23.396665 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-fdf8af81-35a8-4117-a5ee-c53e1c2927f4 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] [instance: 440c3d30-e5c9-4093-9b7e-39e06d32d682] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:23.406426 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fdf8af81-35a8-4117-a5ee-c53e1c2927f4 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:23.408428 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fdf8af81-35a8-4117-a5ee-c53e1c2927f4 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:23.410645 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fdf8af81-35a8-4117-a5ee-c53e1c2927f4 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:23.411858 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fdf8af81-35a8-4117-a5ee-c53e1c2927f4 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:23.415668 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fdf8af81-35a8-4117-a5ee-c53e1c2927f4 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:23.416312 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fdf8af81-35a8-4117-a5ee-c53e1c2927f4 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:23.504169 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-2cde9762-38b2-46aa-bf04-d6f4b46ef375 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6684f0c87e4242be9e0ffb4ef1973f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0582ace9e4443b8ad88915503ee630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:23.533609 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-2cde9762-38b2-46aa-bf04-d6f4b46ef375 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "GET /compute/v2.1/servers/1885b741-1fc3-413a-bb33-f8d3aeff8b04" status: 200 len: 1479 microversion: 2.1 time: 0.359255 Aug 10 23:22:23.537795 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2669/5133] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:22:23 2022] GET /compute/v2.1/servers/1885b741-1fc3-413a-bb33-f8d3aeff8b04 => generated 1479 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:22:23.580960 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.objects.instance [None req-fdf8af81-35a8-4117-a5ee-c53e1c2927f4 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lazy-loading 'services' on Instance uuid 440c3d30-e5c9-4093-9b7e-39e06d32d682 {{(pid=122632) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:22:23.724754 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-fdf8af81-35a8-4117-a5ee-c53e1c2927f4 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] 10.222.0.58 "DELETE /compute/v2.1/servers/440c3d30-e5c9-4093-9b7e-39e06d32d682/os-volume_attachments/9cea5599-6c37-48ec-8d9c-8af49aa354c3" status: 202 len: 0 microversion: 2.1 time: 0.332819 Aug 10 23:22:23.734662 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-a4c43d68-e14a-4cbe-ad65-bd83ef972083 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:23.736973 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-a4c43d68-e14a-4cbe-ad65-bd83ef972083 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] [instance: 440c3d30-e5c9-4093-9b7e-39e06d32d682] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:23.739151 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2465/5134] 10.222.0.58 () {58 vars in 1416 bytes} [Wed Aug 10 23:22:23 2022] DELETE /compute/v2.1/servers/440c3d30-e5c9-4093-9b7e-39e06d32d682/os-volume_attachments/9cea5599-6c37-48ec-8d9c-8af49aa354c3 => generated 0 bytes in 348 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 10 23:22:23.745679 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a4c43d68-e14a-4cbe-ad65-bd83ef972083 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:23.746568 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a4c43d68-e14a-4cbe-ad65-bd83ef972083 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:23.748118 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a4c43d68-e14a-4cbe-ad65-bd83ef972083 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:23.749244 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a4c43d68-e14a-4cbe-ad65-bd83ef972083 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:23.750017 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a4c43d68-e14a-4cbe-ad65-bd83ef972083 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:23.750926 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a4c43d68-e14a-4cbe-ad65-bd83ef972083 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:23.786823 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-a4c43d68-e14a-4cbe-ad65-bd83ef972083 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] 10.222.0.58 "GET /compute/v2.1/servers/440c3d30-e5c9-4093-9b7e-39e06d32d682/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056848 Aug 10 23:22:23.792108 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2670/5135] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 10 23:22:23 2022] GET /compute/v2.1/servers/440c3d30-e5c9-4093-9b7e-39e06d32d682/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:22:24.560608 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-b3ddd4e3-c2f5-4e4c-b1b2-b0a4e5c22f21 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:24.561943 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-b3ddd4e3-c2f5-4e4c-b1b2-b0a4e5c22f21 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: 1885b741-1fc3-413a-bb33-f8d3aeff8b04] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:24.577812 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b3ddd4e3-c2f5-4e4c-b1b2-b0a4e5c22f21 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:24.578311 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b3ddd4e3-c2f5-4e4c-b1b2-b0a4e5c22f21 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:24.585423 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b3ddd4e3-c2f5-4e4c-b1b2-b0a4e5c22f21 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:24.590404 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b3ddd4e3-c2f5-4e4c-b1b2-b0a4e5c22f21 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:24.591696 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b3ddd4e3-c2f5-4e4c-b1b2-b0a4e5c22f21 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:24.592667 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b3ddd4e3-c2f5-4e4c-b1b2-b0a4e5c22f21 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:24.800090 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-ea20e361-3616-44a0-a17d-1f39997ff0ad tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:24.802313 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-ea20e361-3616-44a0-a17d-1f39997ff0ad tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] [instance: 440c3d30-e5c9-4093-9b7e-39e06d32d682] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:24.818206 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ea20e361-3616-44a0-a17d-1f39997ff0ad tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:24.818703 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ea20e361-3616-44a0-a17d-1f39997ff0ad tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:24.819193 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ea20e361-3616-44a0-a17d-1f39997ff0ad tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:24.819913 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ea20e361-3616-44a0-a17d-1f39997ff0ad tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:24.820373 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ea20e361-3616-44a0-a17d-1f39997ff0ad tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:24.820801 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ea20e361-3616-44a0-a17d-1f39997ff0ad tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:24.908958 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-ea20e361-3616-44a0-a17d-1f39997ff0ad tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] 10.222.0.58 "GET /compute/v2.1/servers/440c3d30-e5c9-4093-9b7e-39e06d32d682/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.113102 Aug 10 23:22:24.914300 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2671/5136] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 10 23:22:24 2022] GET /compute/v2.1/servers/440c3d30-e5c9-4093-9b7e-39e06d32d682/os-volume_attachments => generated 197 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:22:25.031684 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-b3ddd4e3-c2f5-4e4c-b1b2-b0a4e5c22f21 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6684f0c87e4242be9e0ffb4ef1973f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0582ace9e4443b8ad88915503ee630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:25.045350 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-b3ddd4e3-c2f5-4e4c-b1b2-b0a4e5c22f21 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "GET /compute/v2.1/servers/1885b741-1fc3-413a-bb33-f8d3aeff8b04" status: 200 len: 1479 microversion: 2.1 time: 0.490280 Aug 10 23:22:25.046708 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2466/5137] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:22:24 2022] GET /compute/v2.1/servers/1885b741-1fc3-413a-bb33-f8d3aeff8b04 => generated 1479 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:22:25.929189 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-cc866e17-8960-4c7b-8934-f5fff4fafb6e req-11fc9e4e-a93d-4b09-9028-f14c8d93d453 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1885b741-1fc3-413a-bb33-f8d3aeff8b04", "name": "network-vif-deleted", "tag": "060b6999-ca43-47ee-9c41-f1df86541c80"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:22:25.929860 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-24ed72f0-fa63-4709-9039-4b0cbd21563b tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:25.933099 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-24ed72f0-fa63-4709-9039-4b0cbd21563b tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] [instance: 440c3d30-e5c9-4093-9b7e-39e06d32d682] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:25.950709 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-cc866e17-8960-4c7b-8934-f5fff4fafb6e req-11fc9e4e-a93d-4b09-9028-f14c8d93d453 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:25.955522 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-cc866e17-8960-4c7b-8934-f5fff4fafb6e req-11fc9e4e-a93d-4b09-9028-f14c8d93d453 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:25.956216 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-cc866e17-8960-4c7b-8934-f5fff4fafb6e req-11fc9e4e-a93d-4b09-9028-f14c8d93d453 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:25.961040 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-24ed72f0-fa63-4709-9039-4b0cbd21563b tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:25.963459 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-24ed72f0-fa63-4709-9039-4b0cbd21563b tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:25.963938 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-24ed72f0-fa63-4709-9039-4b0cbd21563b tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:25.970364 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-24ed72f0-fa63-4709-9039-4b0cbd21563b tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:25.971143 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-24ed72f0-fa63-4709-9039-4b0cbd21563b tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:25.971766 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-24ed72f0-fa63-4709-9039-4b0cbd21563b tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:25.980657 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-cc866e17-8960-4c7b-8934-f5fff4fafb6e req-11fc9e4e-a93d-4b09-9028-f14c8d93d453 service nova] Creating event network-vif-deleted:060b6999-ca43-47ee-9c41-f1df86541c80 for instance 1885b741-1fc3-413a-bb33-f8d3aeff8b04 on n-h2-850468-14 Aug 10 23:22:25.992008 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-cc866e17-8960-4c7b-8934-f5fff4fafb6e req-11fc9e4e-a93d-4b09-9028-f14c8d93d453 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067525 Aug 10 23:22:25.993214 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2467/5138] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:22:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:22:26.061205 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-24ed72f0-fa63-4709-9039-4b0cbd21563b tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] 10.222.0.58 "GET /compute/v2.1/servers/440c3d30-e5c9-4093-9b7e-39e06d32d682/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.143261 Aug 10 23:22:26.072618 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-4f647ce4-ba6c-4f3d-bdbd-08da88031c59 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:26.073606 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-4f647ce4-ba6c-4f3d-bdbd-08da88031c59 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: 1885b741-1fc3-413a-bb33-f8d3aeff8b04] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:26.079969 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2672/5139] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 10 23:22:25 2022] GET /compute/v2.1/servers/440c3d30-e5c9-4093-9b7e-39e06d32d682/os-volume_attachments => generated 197 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:22:26.087610 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4f647ce4-ba6c-4f3d-bdbd-08da88031c59 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:26.088821 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4f647ce4-ba6c-4f3d-bdbd-08da88031c59 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:26.089454 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4f647ce4-ba6c-4f3d-bdbd-08da88031c59 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:26.091230 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4f647ce4-ba6c-4f3d-bdbd-08da88031c59 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:26.091946 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4f647ce4-ba6c-4f3d-bdbd-08da88031c59 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:26.092562 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4f647ce4-ba6c-4f3d-bdbd-08da88031c59 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:26.206379 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4f647ce4-ba6c-4f3d-bdbd-08da88031c59 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:26.210993 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4f647ce4-ba6c-4f3d-bdbd-08da88031c59 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:26.211621 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4f647ce4-ba6c-4f3d-bdbd-08da88031c59 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:26.212219 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.objects.instance [None req-4f647ce4-ba6c-4f3d-bdbd-08da88031c59 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lazy-loading 'fault' on Instance uuid 1885b741-1fc3-413a-bb33-f8d3aeff8b04 {{(pid=122632) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:22:26.509451 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-4f647ce4-ba6c-4f3d-bdbd-08da88031c59 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6684f0c87e4242be9e0ffb4ef1973f96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b0582ace9e4443b8ad88915503ee630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:26.523309 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-4f647ce4-ba6c-4f3d-bdbd-08da88031c59 tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "GET /compute/v2.1/servers/1885b741-1fc3-413a-bb33-f8d3aeff8b04" status: 200 len: 1282 microversion: 2.1 time: 0.458795 Aug 10 23:22:26.524097 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2468/5140] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:22:26 2022] GET /compute/v2.1/servers/1885b741-1fc3-413a-bb33-f8d3aeff8b04 => generated 1282 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:22:27.090113 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-6bf4af79-5c10-4a99-a1cc-4cb8cd39d2b2 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:27.092683 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-6bf4af79-5c10-4a99-a1cc-4cb8cd39d2b2 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] [instance: 440c3d30-e5c9-4093-9b7e-39e06d32d682] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:27.111804 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6bf4af79-5c10-4a99-a1cc-4cb8cd39d2b2 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:27.112872 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6bf4af79-5c10-4a99-a1cc-4cb8cd39d2b2 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:27.113562 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6bf4af79-5c10-4a99-a1cc-4cb8cd39d2b2 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:27.114529 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6bf4af79-5c10-4a99-a1cc-4cb8cd39d2b2 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:27.115226 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6bf4af79-5c10-4a99-a1cc-4cb8cd39d2b2 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:27.115863 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6bf4af79-5c10-4a99-a1cc-4cb8cd39d2b2 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:27.183763 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-6bf4af79-5c10-4a99-a1cc-4cb8cd39d2b2 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] 10.222.0.58 "GET /compute/v2.1/servers/440c3d30-e5c9-4093-9b7e-39e06d32d682/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.097853 Aug 10 23:22:27.185598 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2673/5141] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 10 23:22:27 2022] GET /compute/v2.1/servers/440c3d30-e5c9-4093-9b7e-39e06d32d682/os-volume_attachments => generated 197 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:22:27.550566 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-0482e090-bfd0-45b3-8cb0-3acedc69712a tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:27.551791 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-0482e090-bfd0-45b3-8cb0-3acedc69712a tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] [instance: 1885b741-1fc3-413a-bb33-f8d3aeff8b04] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:27.565447 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0482e090-bfd0-45b3-8cb0-3acedc69712a tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:27.566660 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0482e090-bfd0-45b3-8cb0-3acedc69712a tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:27.567557 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0482e090-bfd0-45b3-8cb0-3acedc69712a tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:27.569838 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0482e090-bfd0-45b3-8cb0-3acedc69712a tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:27.571123 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0482e090-bfd0-45b3-8cb0-3acedc69712a tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:27.573427 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0482e090-bfd0-45b3-8cb0-3acedc69712a tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:27.609471 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-0482e090-bfd0-45b3-8cb0-3acedc69712a tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] HTTP exception thrown: Instance 1885b741-1fc3-413a-bb33-f8d3aeff8b04 could not be found. Aug 10 23:22:27.614253 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-0482e090-bfd0-45b3-8cb0-3acedc69712a tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Request method failure captured: Aug 10 23:22:27.614253 n-d-850468-14 devstack@n-api.service[122633]: request: GET /compute/v2.1/servers/1885b741-1fc3-413a-bb33-f8d3aeff8b04 HTTP/1.1 Aug 10 23:22:27.614253 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:22:27.614253 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:22:27.614253 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:22:27.614253 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:22:27.614253 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:22:27.614253 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:22:27.614253 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:22:27.614253 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:22:27.614253 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9DytBT8uIivFlHEw3ugwW3-_1ks70Fcm-KUdUfNf3hiFdhb5xvDC9LI4u79J0X-frOTrhG-DWWR1w8a7yZU35-jGfQgN97QRTSA7hDEW06netEOKzarBlr77OO9sCeT3s5ektFA7vCYLl4122WPKHg-MSXQY0g9YmL291Ic7yNjWLnQ Aug 10 23:22:27.614253 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:22:27.614253 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:22:27.614253 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:22:27.614253 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:22:27.614253 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:22:27.614253 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:22:27.614253 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 0b0582ace9e4443b8ad88915503ee630 Aug 10 23:22:27.614253 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-ServersTestJSON-516662906 Aug 10 23:22:27.614253 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:22:27.614253 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:22:27.614253 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0b0582ace9e4443b8ad88915503ee630"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0b0582ace9e4443b8ad88915503ee630"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/0b0582ace9e4443b8ad88915503ee630"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_0b0582ace9e4443b8ad88915503ee630", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:22:27.614253 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-ServersTestJSON-516662906 Aug 10 23:22:27.614253 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 0b0582ace9e4443b8ad88915503ee630 Aug 10 23:22:27.614253 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-ServersTestJSON-516662906 Aug 10 23:22:27.614253 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-ServersTestJSON-516662906-project Aug 10 23:22:27.614253 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:22:27.614253 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:22:27.614253 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 6684f0c87e4242be9e0ffb4ef1973f96 Aug 10 23:22:27.614253 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-ServersTestJSON-516662906-project Aug 10 23:22:27.614253 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:22:27.614253 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance 1885b741-1fc3-413a-bb33-f8d3aeff8b04 could not be found. Aug 10 23:22:27.614253 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': '1885b741-1fc3-413a-bb33-f8d3aeff8b04'} Aug 10 23:22:27.614253 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:22:27.614253 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:22:27.614253 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:22:27.614253 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:22:27.614253 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:22:27.614253 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:22:27.614253 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:22:27.614253 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:22:27.614253 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:22:27.614253 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:22:27.614253 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1885b741-1fc3-413a-bb33-f8d3aeff8b04 could not be found. Aug 10 23:22:27.614253 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:22:27.614253 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:22:27.614253 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:22:27.614253 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:22:27.614253 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:22:27.614253 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:22:27.614253 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:22:27.614253 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:22:27.614253 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:22:27.614253 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:22:27.614253 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:22:27.614253 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:22:27.614253 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:22:27.614253 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:22:27.614253 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:22:27.614253 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:22:27.614253 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1885b741-1fc3-413a-bb33-f8d3aeff8b04 could not be found. Aug 10 23:22:27.614253 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:22:27.614253 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:22:27.614253 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:22:27.614253 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:22:27.623508 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:22:27.623508 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:22:27.623508 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:22:27.623508 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:22:27.623508 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1885b741-1fc3-413a-bb33-f8d3aeff8b04 could not be found. Aug 10 23:22:27.623508 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:22:27.626047 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-0482e090-bfd0-45b3-8cb0-3acedc69712a tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] Returning 404 to user: Instance 1885b741-1fc3-413a-bb33-f8d3aeff8b04 could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:22:27.629457 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-0482e090-bfd0-45b3-8cb0-3acedc69712a tempest-ServersTestJSON-516662906 tempest-ServersTestJSON-516662906-project] 10.222.0.58 "GET /compute/v2.1/servers/1885b741-1fc3-413a-bb33-f8d3aeff8b04" status: 404 len: 111 microversion: 2.1 time: 0.085068 Aug 10 23:22:27.635816 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2674/5142] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:22:27 2022] GET /compute/v2.1/servers/1885b741-1fc3-413a-bb33-f8d3aeff8b04 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:22:27.920047 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-76818aae-f959-4354-baaf-e0ddb984d8db tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:22:27.922710 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-76818aae-f959-4354-baaf-e0ddb984d8db tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] [instance: 32ddd6eb-6c3f-4bd1-b9be-f819e8ef3a68] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:27.932035 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-76818aae-f959-4354-baaf-e0ddb984d8db tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:27.933344 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-76818aae-f959-4354-baaf-e0ddb984d8db tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:27.938938 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-76818aae-f959-4354-baaf-e0ddb984d8db tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:27.939896 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-76818aae-f959-4354-baaf-e0ddb984d8db tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:27.943568 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-76818aae-f959-4354-baaf-e0ddb984d8db tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:27.944222 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-76818aae-f959-4354-baaf-e0ddb984d8db tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:27.951908 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:22:28.032683 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-76818aae-f959-4354-baaf-e0ddb984d8db tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "POST /compute/v2.1/servers/32ddd6eb-6c3f-4bd1-b9be-f819e8ef3a68/action" status: 200 len: 24568 microversion: 2.1 time: 0.645715 Aug 10 23:22:28.038558 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2469/5143] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:22:27 2022] POST /compute/v2.1/servers/32ddd6eb-6c3f-4bd1-b9be-f819e8ef3a68/action => generated 24568 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 23:22:28.197046 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-636f8f9d-d260-434a-b273-88292a7a237d tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:28.199883 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-636f8f9d-d260-434a-b273-88292a7a237d tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] [instance: 440c3d30-e5c9-4093-9b7e-39e06d32d682] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:28.227643 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-636f8f9d-d260-434a-b273-88292a7a237d tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:28.228652 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-636f8f9d-d260-434a-b273-88292a7a237d tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:28.229371 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-636f8f9d-d260-434a-b273-88292a7a237d tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:28.230310 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-636f8f9d-d260-434a-b273-88292a7a237d tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:28.231060 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-636f8f9d-d260-434a-b273-88292a7a237d tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:28.232238 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-636f8f9d-d260-434a-b273-88292a7a237d tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:28.297005 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-636f8f9d-d260-434a-b273-88292a7a237d tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] 10.222.0.58 "GET /compute/v2.1/servers/440c3d30-e5c9-4093-9b7e-39e06d32d682/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.103122 Aug 10 23:22:28.303165 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2675/5144] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 10 23:22:28 2022] GET /compute/v2.1/servers/440c3d30-e5c9-4093-9b7e-39e06d32d682/os-volume_attachments => generated 197 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:22:29.310655 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-dd7dba9a-c074-4b3f-9ad9-fd21d92a8b78 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:29.314772 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-dd7dba9a-c074-4b3f-9ad9-fd21d92a8b78 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] [instance: 440c3d30-e5c9-4093-9b7e-39e06d32d682] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:29.332127 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dd7dba9a-c074-4b3f-9ad9-fd21d92a8b78 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:29.337950 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dd7dba9a-c074-4b3f-9ad9-fd21d92a8b78 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:29.342126 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dd7dba9a-c074-4b3f-9ad9-fd21d92a8b78 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:29.343608 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dd7dba9a-c074-4b3f-9ad9-fd21d92a8b78 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:29.344385 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dd7dba9a-c074-4b3f-9ad9-fd21d92a8b78 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:29.345562 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dd7dba9a-c074-4b3f-9ad9-fd21d92a8b78 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:29.425216 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-dd7dba9a-c074-4b3f-9ad9-fd21d92a8b78 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] 10.222.0.58 "GET /compute/v2.1/servers/440c3d30-e5c9-4093-9b7e-39e06d32d682/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.119076 Aug 10 23:22:29.439245 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2470/5145] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 10 23:22:29 2022] GET /compute/v2.1/servers/440c3d30-e5c9-4093-9b7e-39e06d32d682/os-volume_attachments => generated 197 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:22:30.449581 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-cb9688da-3897-4e9b-8d9a-fa9cb205eebd tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:30.453317 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-cb9688da-3897-4e9b-8d9a-fa9cb205eebd tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] [instance: 440c3d30-e5c9-4093-9b7e-39e06d32d682] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:30.472785 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cb9688da-3897-4e9b-8d9a-fa9cb205eebd tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:30.484820 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cb9688da-3897-4e9b-8d9a-fa9cb205eebd tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:30.487197 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cb9688da-3897-4e9b-8d9a-fa9cb205eebd tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:30.489984 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cb9688da-3897-4e9b-8d9a-fa9cb205eebd tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:30.490481 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cb9688da-3897-4e9b-8d9a-fa9cb205eebd tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:30.491128 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cb9688da-3897-4e9b-8d9a-fa9cb205eebd tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:30.621127 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-cb9688da-3897-4e9b-8d9a-fa9cb205eebd tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] 10.222.0.58 "GET /compute/v2.1/servers/440c3d30-e5c9-4093-9b7e-39e06d32d682/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.184359 Aug 10 23:22:30.632545 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2676/5146] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 10 23:22:30 2022] GET /compute/v2.1/servers/440c3d30-e5c9-4093-9b7e-39e06d32d682/os-volume_attachments => generated 197 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:22:31.633842 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-b38b01d0-2bc4-4a40-8763-c273e6b10542 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:31.636696 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-b38b01d0-2bc4-4a40-8763-c273e6b10542 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] [instance: 440c3d30-e5c9-4093-9b7e-39e06d32d682] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:31.652320 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b38b01d0-2bc4-4a40-8763-c273e6b10542 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:31.653261 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b38b01d0-2bc4-4a40-8763-c273e6b10542 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:31.653955 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b38b01d0-2bc4-4a40-8763-c273e6b10542 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:31.655553 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b38b01d0-2bc4-4a40-8763-c273e6b10542 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:31.657753 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b38b01d0-2bc4-4a40-8763-c273e6b10542 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:31.660854 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b38b01d0-2bc4-4a40-8763-c273e6b10542 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:31.736075 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-b38b01d0-2bc4-4a40-8763-c273e6b10542 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] 10.222.0.58 "GET /compute/v2.1/servers/440c3d30-e5c9-4093-9b7e-39e06d32d682/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.106271 Aug 10 23:22:31.740678 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2471/5147] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 10 23:22:31 2022] GET /compute/v2.1/servers/440c3d30-e5c9-4093-9b7e-39e06d32d682/os-volume_attachments => generated 197 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:22:32.750322 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-b4117a75-62d8-418c-b851-e25a061cde39 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:32.754820 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-b4117a75-62d8-418c-b851-e25a061cde39 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] [instance: 440c3d30-e5c9-4093-9b7e-39e06d32d682] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:32.791724 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b4117a75-62d8-418c-b851-e25a061cde39 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:32.792660 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b4117a75-62d8-418c-b851-e25a061cde39 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:32.793574 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b4117a75-62d8-418c-b851-e25a061cde39 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:32.795023 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b4117a75-62d8-418c-b851-e25a061cde39 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:32.805652 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b4117a75-62d8-418c-b851-e25a061cde39 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:32.806476 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b4117a75-62d8-418c-b851-e25a061cde39 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:32.960488 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-b4117a75-62d8-418c-b851-e25a061cde39 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] 10.222.0.58 "GET /compute/v2.1/servers/440c3d30-e5c9-4093-9b7e-39e06d32d682/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.215219 Aug 10 23:22:32.966976 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2677/5148] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 10 23:22:32 2022] GET /compute/v2.1/servers/440c3d30-e5c9-4093-9b7e-39e06d32d682/os-volume_attachments => generated 197 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:22:33.987573 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-3fdf36df-c83b-4b01-815a-de3a0bfe7dd3 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:33.989870 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-3fdf36df-c83b-4b01-815a-de3a0bfe7dd3 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] [instance: 440c3d30-e5c9-4093-9b7e-39e06d32d682] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:34.030684 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3fdf36df-c83b-4b01-815a-de3a0bfe7dd3 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:34.038698 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3fdf36df-c83b-4b01-815a-de3a0bfe7dd3 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:34.039711 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3fdf36df-c83b-4b01-815a-de3a0bfe7dd3 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:34.040481 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3fdf36df-c83b-4b01-815a-de3a0bfe7dd3 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:34.040952 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3fdf36df-c83b-4b01-815a-de3a0bfe7dd3 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:34.041382 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3fdf36df-c83b-4b01-815a-de3a0bfe7dd3 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:34.137688 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-3fdf36df-c83b-4b01-815a-de3a0bfe7dd3 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] 10.222.0.58 "GET /compute/v2.1/servers/440c3d30-e5c9-4093-9b7e-39e06d32d682/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.163956 Aug 10 23:22:34.146500 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2472/5149] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 10 23:22:33 2022] GET /compute/v2.1/servers/440c3d30-e5c9-4093-9b7e-39e06d32d682/os-volume_attachments => generated 25 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 23:22:34.250017 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-d326711f-28fb-44f9-8fac-9ff1219bfaad tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:34.250513 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-d326711f-28fb-44f9-8fac-9ff1219bfaad tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] [instance: 440c3d30-e5c9-4093-9b7e-39e06d32d682] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:34.277246 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d326711f-28fb-44f9-8fac-9ff1219bfaad tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:34.278681 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d326711f-28fb-44f9-8fac-9ff1219bfaad tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:34.279175 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d326711f-28fb-44f9-8fac-9ff1219bfaad tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:34.279943 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d326711f-28fb-44f9-8fac-9ff1219bfaad tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:34.280409 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d326711f-28fb-44f9-8fac-9ff1219bfaad tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:34.280847 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d326711f-28fb-44f9-8fac-9ff1219bfaad tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:34.376704 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-d326711f-28fb-44f9-8fac-9ff1219bfaad tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] [instance: 440c3d30-e5c9-4093-9b7e-39e06d32d682] Going to try to terminate instance {{(pid=122633) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:22:34.384684 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:22:34.617274 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-d326711f-28fb-44f9-8fac-9ff1219bfaad tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] 10.222.0.58 "DELETE /compute/v2.1/servers/440c3d30-e5c9-4093-9b7e-39e06d32d682" status: 204 len: 0 microversion: 2.1 time: 0.375240 Aug 10 23:22:34.619811 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2678/5150] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:22:34 2022] DELETE /compute/v2.1/servers/440c3d30-e5c9-4093-9b7e-39e06d32d682 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:22:34.629066 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-75ffede5-d9f6-4827-952d-d23eea7d7869 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:34.630514 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-75ffede5-d9f6-4827-952d-d23eea7d7869 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] [instance: 440c3d30-e5c9-4093-9b7e-39e06d32d682] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:34.640849 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-75ffede5-d9f6-4827-952d-d23eea7d7869 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:34.643478 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-75ffede5-d9f6-4827-952d-d23eea7d7869 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:34.644546 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-75ffede5-d9f6-4827-952d-d23eea7d7869 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:34.648258 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-75ffede5-d9f6-4827-952d-d23eea7d7869 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:34.649193 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-75ffede5-d9f6-4827-952d-d23eea7d7869 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:34.649813 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-75ffede5-d9f6-4827-952d-d23eea7d7869 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:34.975000 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-75ffede5-d9f6-4827-952d-d23eea7d7869 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d89081084f14e0187f4c67cd9185fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b557edd165144c8943eb9acc339a377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:34.988896 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-75ffede5-d9f6-4827-952d-d23eea7d7869 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] 10.222.0.58 "GET /compute/v2.1/servers/440c3d30-e5c9-4093-9b7e-39e06d32d682" status: 200 len: 1683 microversion: 2.1 time: 0.363946 Aug 10 23:22:35.005145 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2473/5151] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:22:34 2022] GET /compute/v2.1/servers/440c3d30-e5c9-4093-9b7e-39e06d32d682 => generated 1683 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:22:36.013985 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-894036d1-6459-4200-8880-ad62779703e3 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:36.014618 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-894036d1-6459-4200-8880-ad62779703e3 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] [instance: 440c3d30-e5c9-4093-9b7e-39e06d32d682] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:36.021285 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-894036d1-6459-4200-8880-ad62779703e3 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:36.021763 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-894036d1-6459-4200-8880-ad62779703e3 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:36.022199 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-894036d1-6459-4200-8880-ad62779703e3 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:36.022944 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-894036d1-6459-4200-8880-ad62779703e3 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:36.023390 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-894036d1-6459-4200-8880-ad62779703e3 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:36.023814 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-894036d1-6459-4200-8880-ad62779703e3 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:36.179417 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-894036d1-6459-4200-8880-ad62779703e3 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d89081084f14e0187f4c67cd9185fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b557edd165144c8943eb9acc339a377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:36.197104 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-894036d1-6459-4200-8880-ad62779703e3 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] 10.222.0.58 "GET /compute/v2.1/servers/440c3d30-e5c9-4093-9b7e-39e06d32d682" status: 200 len: 1683 microversion: 2.1 time: 0.188340 Aug 10 23:22:36.206896 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2679/5152] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:22:36 2022] GET /compute/v2.1/servers/440c3d30-e5c9-4093-9b7e-39e06d32d682 => generated 1683 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:22:37.225411 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-24adae97-c1c1-47f4-82f2-b4134650cc97 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:37.226173 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-24adae97-c1c1-47f4-82f2-b4134650cc97 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] [instance: 440c3d30-e5c9-4093-9b7e-39e06d32d682] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:37.236869 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-24adae97-c1c1-47f4-82f2-b4134650cc97 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:37.238491 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-24adae97-c1c1-47f4-82f2-b4134650cc97 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:37.240531 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-24adae97-c1c1-47f4-82f2-b4134650cc97 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:37.242081 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-24adae97-c1c1-47f4-82f2-b4134650cc97 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:37.243684 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-24adae97-c1c1-47f4-82f2-b4134650cc97 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:37.244272 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-24adae97-c1c1-47f4-82f2-b4134650cc97 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:37.329136 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-24adae97-c1c1-47f4-82f2-b4134650cc97 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d89081084f14e0187f4c67cd9185fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b557edd165144c8943eb9acc339a377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:37.339337 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-24adae97-c1c1-47f4-82f2-b4134650cc97 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] 10.222.0.58 "GET /compute/v2.1/servers/440c3d30-e5c9-4093-9b7e-39e06d32d682" status: 200 len: 1615 microversion: 2.1 time: 0.117537 Aug 10 23:22:37.341002 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2474/5153] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:22:37 2022] GET /compute/v2.1/servers/440c3d30-e5c9-4093-9b7e-39e06d32d682 => generated 1615 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:22:37.548419 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-1955fd59-f523-4581-b37f-ee46acebdf71 req-1426c1f7-5ac9-42bc-8adc-1a4e39ad056e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "440c3d30-e5c9-4093-9b7e-39e06d32d682", "name": "network-vif-deleted", "tag": "56eb709a-f823-4e09-86fa-42e4d98f2bb3"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:22:37.569989 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-1955fd59-f523-4581-b37f-ee46acebdf71 req-1426c1f7-5ac9-42bc-8adc-1a4e39ad056e service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:37.570930 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-1955fd59-f523-4581-b37f-ee46acebdf71 req-1426c1f7-5ac9-42bc-8adc-1a4e39ad056e service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:37.571638 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-1955fd59-f523-4581-b37f-ee46acebdf71 req-1426c1f7-5ac9-42bc-8adc-1a4e39ad056e service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:37.591467 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-1955fd59-f523-4581-b37f-ee46acebdf71 req-1426c1f7-5ac9-42bc-8adc-1a4e39ad056e service nova] Creating event network-vif-deleted:56eb709a-f823-4e09-86fa-42e4d98f2bb3 for instance 440c3d30-e5c9-4093-9b7e-39e06d32d682 on n-h2-850468-14 Aug 10 23:22:37.612866 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-1955fd59-f523-4581-b37f-ee46acebdf71 req-1426c1f7-5ac9-42bc-8adc-1a4e39ad056e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068431 Aug 10 23:22:37.615988 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2680/5154] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:22:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:22:38.304707 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-ccbdb9ad-e44a-4d56-820b-0bd580b5f58b tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-1792176135", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452", "networks": "none"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:22:38.362053 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-dd219202-ae03-4314-bf73-2c9a82eb8dd3 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:38.362999 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-dd219202-ae03-4314-bf73-2c9a82eb8dd3 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] [instance: 440c3d30-e5c9-4093-9b7e-39e06d32d682] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:38.377353 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dd219202-ae03-4314-bf73-2c9a82eb8dd3 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:38.378286 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dd219202-ae03-4314-bf73-2c9a82eb8dd3 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:38.379590 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dd219202-ae03-4314-bf73-2c9a82eb8dd3 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:38.382125 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dd219202-ae03-4314-bf73-2c9a82eb8dd3 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:38.382867 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dd219202-ae03-4314-bf73-2c9a82eb8dd3 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:38.383525 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dd219202-ae03-4314-bf73-2c9a82eb8dd3 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:38.387654 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-ccbdb9ad-e44a-4d56-820b-0bd580b5f58b tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Flavor limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:22:38.389131 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-ccbdb9ad-e44a-4d56-820b-0bd580b5f58b tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Image limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:22:38.389775 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-ccbdb9ad-e44a-4d56-820b-0bd580b5f58b tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Flavor pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:22:38.390352 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-ccbdb9ad-e44a-4d56-820b-0bd580b5f58b tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Image pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:22:38.391048 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-ccbdb9ad-e44a-4d56-820b-0bd580b5f58b tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:22:38.400994 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ccbdb9ad-e44a-4d56-820b-0bd580b5f58b tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:38.401477 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ccbdb9ad-e44a-4d56-820b-0bd580b5f58b tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:38.402083 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ccbdb9ad-e44a-4d56-820b-0bd580b5f58b tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:38.404538 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ccbdb9ad-e44a-4d56-820b-0bd580b5f58b tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:38.405219 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ccbdb9ad-e44a-4d56-820b-0bd580b5f58b tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:38.405914 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ccbdb9ad-e44a-4d56-820b-0bd580b5f58b tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:38.407273 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-dd219202-ae03-4314-bf73-2c9a82eb8dd3 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] HTTP exception thrown: Instance 440c3d30-e5c9-4093-9b7e-39e06d32d682 could not be found. Aug 10 23:22:38.410136 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-dd219202-ae03-4314-bf73-2c9a82eb8dd3 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Request method failure captured: Aug 10 23:22:38.410136 n-d-850468-14 devstack@n-api.service[122633]: request: GET /compute/v2.1/servers/440c3d30-e5c9-4093-9b7e-39e06d32d682 HTTP/1.1 Aug 10 23:22:38.410136 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:22:38.410136 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:22:38.410136 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:22:38.410136 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:22:38.410136 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:22:38.410136 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:22:38.410136 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:22:38.410136 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:22:38.410136 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9Dyh6-R-3HT3qmAYw73oJfCuu2NJv_Uk6ESXtcq6VvNMtaQn1cTuz-I3qzoDfMZYBb14V5s9aXOf7KFvhR2arcnhZ5gC9SddHqo24MvVPxr7p8PNkuseL9l1-7bXrad-0RpRPdQnhZkSYtsPZXEtrxg11yCwwP1jlsEo-QBQNYEMWc4 Aug 10 23:22:38.410136 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:22:38.410136 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:22:38.410136 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:22:38.410136 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:22:38.410136 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:22:38.410136 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:22:38.410136 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 2b557edd165144c8943eb9acc339a377 Aug 10 23:22:38.410136 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-AttachVolumeNegativeTest-393353666 Aug 10 23:22:38.410136 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:22:38.410136 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:22:38.410136 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2b557edd165144c8943eb9acc339a377"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2b557edd165144c8943eb9acc339a377"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2b557edd165144c8943eb9acc339a377"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2b557edd165144c8943eb9acc339a377", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:22:38.410136 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-AttachVolumeNegativeTest-393353666 Aug 10 23:22:38.410136 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 2b557edd165144c8943eb9acc339a377 Aug 10 23:22:38.410136 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-393353666 Aug 10 23:22:38.410136 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-AttachVolumeNegativeTest-393353666-project Aug 10 23:22:38.410136 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:22:38.410136 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:22:38.410136 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 0d89081084f14e0187f4c67cd9185fef Aug 10 23:22:38.410136 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-AttachVolumeNegativeTest-393353666-project Aug 10 23:22:38.410136 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:22:38.410136 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance 440c3d30-e5c9-4093-9b7e-39e06d32d682 could not be found. Aug 10 23:22:38.410136 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': '440c3d30-e5c9-4093-9b7e-39e06d32d682'} Aug 10 23:22:38.410136 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:22:38.410136 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:22:38.410136 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:22:38.410136 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:22:38.410136 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:22:38.410136 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:22:38.410136 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:22:38.410136 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:22:38.410136 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:22:38.410136 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:22:38.410136 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 440c3d30-e5c9-4093-9b7e-39e06d32d682 could not be found. Aug 10 23:22:38.410136 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:22:38.410136 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:22:38.410136 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:22:38.410136 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:22:38.410136 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:22:38.410136 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:22:38.410136 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:22:38.410136 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:22:38.410136 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:22:38.410136 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:22:38.410136 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:22:38.410136 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:22:38.410136 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:22:38.410136 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:22:38.410136 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:22:38.410136 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:22:38.410136 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 440c3d30-e5c9-4093-9b7e-39e06d32d682 could not be found. Aug 10 23:22:38.410136 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:22:38.410136 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:22:38.410136 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:22:38.414268 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:22:38.414268 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:22:38.414268 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:22:38.414268 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:22:38.414268 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:22:38.414268 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 440c3d30-e5c9-4093-9b7e-39e06d32d682 could not be found. Aug 10 23:22:38.414268 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:22:38.422510 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-dd219202-ae03-4314-bf73-2c9a82eb8dd3 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Returning 404 to user: Instance 440c3d30-e5c9-4093-9b7e-39e06d32d682 could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:22:38.423445 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-dd219202-ae03-4314-bf73-2c9a82eb8dd3 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] 10.222.0.58 "GET /compute/v2.1/servers/440c3d30-e5c9-4093-9b7e-39e06d32d682" status: 404 len: 111 microversion: 2.1 time: 0.065872 Aug 10 23:22:38.424805 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2681/5155] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:22:38 2022] GET /compute/v2.1/servers/440c3d30-e5c9-4093-9b7e-39e06d32d682 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:22:38.434825 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-ccbdb9ad-e44a-4d56-820b-0bd580b5f58b tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Getting quotas for project 23c2436609c447e1b55d203ac00bf880. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:22:38.435856 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-ea504127-f488-47be-8515-de6099691d2c tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Calling method '.version_select at 0x7f847d298040>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:38.446074 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-ccbdb9ad-e44a-4d56-820b-0bd580b5f58b tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Getting quotas for user 036a90c902be43e0bdc2547278d94c62 and project 23c2436609c447e1b55d203ac00bf880. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:22:38.463728 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-ccbdb9ad-e44a-4d56-820b-0bd580b5f58b tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Going to run 1 instances... {{(pid=122632) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 23:22:38.467580 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-ea504127-f488-47be-8515-de6099691d2c tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1843562770" status: 202 len: 0 microversion: 2.1 time: 0.038451 Aug 10 23:22:38.468285 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-ccbdb9ad-e44a-4d56-820b-0bd580b5f58b tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] [instance: f3c2dd22-f9d5-4649-9fc4-b3befdf6b8fc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78ad8905-f66f-4733-8be9-2b260f1fabed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122632) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 23:22:38.471003 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2682/5156] 10.222.0.58 () {58 vars in 1221 bytes} [Wed Aug 10 23:22:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1843562770 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:22:38.535609 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-ccbdb9ad-e44a-4d56-820b-0bd580b5f58b tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 0.573867 Aug 10 23:22:38.544485 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2475/5157] 10.222.0.58 () {62 vars in 1188 bytes} [Wed Aug 10 23:22:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 585 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 10 23:22:38.549056 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-3797f349-f270-4fe2-a6d2-05c7ab9aac35 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:38.551076 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-3797f349-f270-4fe2-a6d2-05c7ab9aac35 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] [instance: f3c2dd22-f9d5-4649-9fc4-b3befdf6b8fc] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:38.706591 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-3797f349-f270-4fe2-a6d2-05c7ab9aac35 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036a90c902be43e0bdc2547278d94c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c2436609c447e1b55d203ac00bf880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:38.720262 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-3797f349-f270-4fe2-a6d2-05c7ab9aac35 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '036a90c902be43e0bdc2547278d94c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c2436609c447e1b55d203ac00bf880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:38.721818 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-3797f349-f270-4fe2-a6d2-05c7ab9aac35 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '036a90c902be43e0bdc2547278d94c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c2436609c447e1b55d203ac00bf880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:38.725411 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-3797f349-f270-4fe2-a6d2-05c7ab9aac35 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] 10.222.0.58 "GET /compute/v2.1/servers/f3c2dd22-f9d5-4649-9fc4-b3befdf6b8fc" status: 200 len: 1278 microversion: 2.54 time: 0.180623 Aug 10 23:22:38.741424 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2683/5158] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:22:38 2022] GET /compute/v2.1/servers/f3c2dd22-f9d5-4649-9fc4-b3befdf6b8fc => generated 1278 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:22:39.494761 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-881cbeef-a307-45e7-a400-44acab4e1761 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Action: 'create', calling method: .version_select at 0x7f846fc951f0>, body: {"keypair": {"name": "tempest-keypair-1719151935", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP1B0YcFuYpDx/yGoeztopuWZQ2DguvJ+wer6VD+1sr4QfgrNTcf+ENWpg2kEoH5YU+Q1zWkcq5hakw+sBCG0Whhg8Vjndu+FYoVdDMcK9EMCtNqvbWlLlvSJ8trFgOnfw=="}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:22:39.560641 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-881cbeef-a307-45e7-a400-44acab4e1761 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Getting quotas for project 2b557edd165144c8943eb9acc339a377. Resources: {'key_pairs'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:22:39.578159 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-881cbeef-a307-45e7-a400-44acab4e1761 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Getting quotas for user 0d89081084f14e0187f4c67cd9185fef and project 2b557edd165144c8943eb9acc339a377. Resources: {'key_pairs'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:22:39.621047 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-881cbeef-a307-45e7-a400-44acab4e1761 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.130855 Aug 10 23:22:39.622656 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2476/5159] 10.222.0.58 () {60 vars in 1159 bytes} [Wed Aug 10 23:22:39 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:22:39.753141 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-8fc62c05-fc7e-46d0-ada7-99ebc54e603a tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:39.753729 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-8fc62c05-fc7e-46d0-ada7-99ebc54e603a tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] [instance: f3c2dd22-f9d5-4649-9fc4-b3befdf6b8fc] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:39.768622 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8fc62c05-fc7e-46d0-ada7-99ebc54e603a tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:39.769114 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8fc62c05-fc7e-46d0-ada7-99ebc54e603a tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:39.769717 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8fc62c05-fc7e-46d0-ada7-99ebc54e603a tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:39.770434 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8fc62c05-fc7e-46d0-ada7-99ebc54e603a tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:39.770913 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8fc62c05-fc7e-46d0-ada7-99ebc54e603a tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:39.771345 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8fc62c05-fc7e-46d0-ada7-99ebc54e603a tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:39.902050 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-8fc62c05-fc7e-46d0-ada7-99ebc54e603a tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036a90c902be43e0bdc2547278d94c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c2436609c447e1b55d203ac00bf880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:39.914854 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-8fc62c05-fc7e-46d0-ada7-99ebc54e603a tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '036a90c902be43e0bdc2547278d94c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c2436609c447e1b55d203ac00bf880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:39.916917 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-8fc62c05-fc7e-46d0-ada7-99ebc54e603a tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '036a90c902be43e0bdc2547278d94c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c2436609c447e1b55d203ac00bf880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:39.919571 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-8fc62c05-fc7e-46d0-ada7-99ebc54e603a tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] 10.222.0.58 "GET /compute/v2.1/servers/f3c2dd22-f9d5-4649-9fc4-b3befdf6b8fc" status: 200 len: 1330 microversion: 2.54 time: 0.170742 Aug 10 23:22:39.920808 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2684/5160] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:22:39 2022] GET /compute/v2.1/servers/f3c2dd22-f9d5-4649-9fc4-b3befdf6b8fc => generated 1330 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:22:40.946157 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-8fa0f198-eec1-405d-95e1-5705917bafab tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:40.947372 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-8fa0f198-eec1-405d-95e1-5705917bafab tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] [instance: f3c2dd22-f9d5-4649-9fc4-b3befdf6b8fc] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:40.955502 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8fa0f198-eec1-405d-95e1-5705917bafab tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:40.955998 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8fa0f198-eec1-405d-95e1-5705917bafab tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:40.956661 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8fa0f198-eec1-405d-95e1-5705917bafab tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:40.957395 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8fa0f198-eec1-405d-95e1-5705917bafab tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:40.957832 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8fa0f198-eec1-405d-95e1-5705917bafab tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:40.958256 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8fa0f198-eec1-405d-95e1-5705917bafab tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:41.113945 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-8fa0f198-eec1-405d-95e1-5705917bafab tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036a90c902be43e0bdc2547278d94c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c2436609c447e1b55d203ac00bf880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:41.125232 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-8fa0f198-eec1-405d-95e1-5705917bafab tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '036a90c902be43e0bdc2547278d94c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c2436609c447e1b55d203ac00bf880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:41.126749 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-8fa0f198-eec1-405d-95e1-5705917bafab tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '036a90c902be43e0bdc2547278d94c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c2436609c447e1b55d203ac00bf880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:41.127960 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-8fa0f198-eec1-405d-95e1-5705917bafab tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] 10.222.0.58 "GET /compute/v2.1/servers/f3c2dd22-f9d5-4649-9fc4-b3befdf6b8fc" status: 200 len: 1336 microversion: 2.54 time: 0.186373 Aug 10 23:22:41.128544 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2477/5161] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:22:40 2022] GET /compute/v2.1/servers/f3c2dd22-f9d5-4649-9fc4-b3befdf6b8fc => generated 1336 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 23:22:41.628769 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-7f5b1833-6d5d-4db8-9505-7a770b03b089 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:41.629781 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-7f5b1833-6d5d-4db8-9505-7a770b03b089 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] [instance: 32ddd6eb-6c3f-4bd1-b9be-f819e8ef3a68] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:41.639436 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7f5b1833-6d5d-4db8-9505-7a770b03b089 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:41.640093 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7f5b1833-6d5d-4db8-9505-7a770b03b089 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:41.640674 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7f5b1833-6d5d-4db8-9505-7a770b03b089 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:41.641721 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7f5b1833-6d5d-4db8-9505-7a770b03b089 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:41.642418 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7f5b1833-6d5d-4db8-9505-7a770b03b089 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:41.643036 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7f5b1833-6d5d-4db8-9505-7a770b03b089 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:41.693775 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-7f5b1833-6d5d-4db8-9505-7a770b03b089 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] [instance: 32ddd6eb-6c3f-4bd1-b9be-f819e8ef3a68] Going to try to terminate instance {{(pid=122633) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:22:41.843133 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-7f5b1833-6d5d-4db8-9505-7a770b03b089 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "DELETE /compute/v2.1/servers/32ddd6eb-6c3f-4bd1-b9be-f819e8ef3a68" status: 204 len: 0 microversion: 2.1 time: 0.217976 Aug 10 23:22:41.843953 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2685/5162] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:22:41 2022] DELETE /compute/v2.1/servers/32ddd6eb-6c3f-4bd1-b9be-f819e8ef3a68 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:22:41.866247 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-24ae08dd-60d1-4d92-91cc-cb1c65b40102 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:41.867376 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-24ae08dd-60d1-4d92-91cc-cb1c65b40102 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] [instance: 32ddd6eb-6c3f-4bd1-b9be-f819e8ef3a68] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:41.876654 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-24ae08dd-60d1-4d92-91cc-cb1c65b40102 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:41.877551 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-24ae08dd-60d1-4d92-91cc-cb1c65b40102 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:41.878259 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-24ae08dd-60d1-4d92-91cc-cb1c65b40102 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:41.879210 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-24ae08dd-60d1-4d92-91cc-cb1c65b40102 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:41.880559 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-24ae08dd-60d1-4d92-91cc-cb1c65b40102 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:41.881277 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-24ae08dd-60d1-4d92-91cc-cb1c65b40102 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:42.060689 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-c4aa5407-f676-4d8d-af2d-b970e1c734e8 req-5cc2b897-0ab9-4ef3-aeea-a38d65f23f58 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32ddd6eb-6c3f-4bd1-b9be-f819e8ef3a68", "tag": "4f9f24c0-e01f-4d27-8d15-06a370ec5bb8"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:22:42.076176 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=4 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:22:42.094258 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-c4aa5407-f676-4d8d-af2d-b970e1c734e8 req-5cc2b897-0ab9-4ef3-aeea-a38d65f23f58 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:42.096772 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-c4aa5407-f676-4d8d-af2d-b970e1c734e8 req-5cc2b897-0ab9-4ef3-aeea-a38d65f23f58 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:42.098193 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-c4aa5407-f676-4d8d-af2d-b970e1c734e8 req-5cc2b897-0ab9-4ef3-aeea-a38d65f23f58 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:42.138107 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-c4aa5407-f676-4d8d-af2d-b970e1c734e8 req-5cc2b897-0ab9-4ef3-aeea-a38d65f23f58 service nova] Creating event network-changed:4f9f24c0-e01f-4d27-8d15-06a370ec5bb8 for instance 32ddd6eb-6c3f-4bd1-b9be-f819e8ef3a68 on n-h2-850468-14 Aug 10 23:22:42.151261 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-c4aa5407-f676-4d8d-af2d-b970e1c734e8 req-5cc2b897-0ab9-4ef3-aeea-a38d65f23f58 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.505033 Aug 10 23:22:42.152311 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2478/5163] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:22:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 23:22:42.159133 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-b3f736f1-e2d9-4904-aa34-e1af631fa0b0 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:42.160339 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-b3f736f1-e2d9-4904-aa34-e1af631fa0b0 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] [instance: f3c2dd22-f9d5-4649-9fc4-b3befdf6b8fc] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:42.168133 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b3f736f1-e2d9-4904-aa34-e1af631fa0b0 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:42.169592 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b3f736f1-e2d9-4904-aa34-e1af631fa0b0 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:42.170244 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b3f736f1-e2d9-4904-aa34-e1af631fa0b0 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:42.171202 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b3f736f1-e2d9-4904-aa34-e1af631fa0b0 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:42.171922 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b3f736f1-e2d9-4904-aa34-e1af631fa0b0 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:42.172581 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b3f736f1-e2d9-4904-aa34-e1af631fa0b0 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:42.237564 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-24ae08dd-60d1-4d92-91cc-cb1c65b40102 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5899b2ad9f1046caaf7c6073e408eeee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25abd63376614081a9d484f3c9ae950d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:42.251238 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-24ae08dd-60d1-4d92-91cc-cb1c65b40102 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "GET /compute/v2.1/servers/32ddd6eb-6c3f-4bd1-b9be-f819e8ef3a68" status: 200 len: 1689 microversion: 2.1 time: 0.401443 Aug 10 23:22:42.252524 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2686/5164] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:22:41 2022] GET /compute/v2.1/servers/32ddd6eb-6c3f-4bd1-b9be-f819e8ef3a68 => generated 1689 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:22:42.316547 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-b3f736f1-e2d9-4904-aa34-e1af631fa0b0 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036a90c902be43e0bdc2547278d94c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c2436609c447e1b55d203ac00bf880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:42.343895 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-b3f736f1-e2d9-4904-aa34-e1af631fa0b0 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '036a90c902be43e0bdc2547278d94c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c2436609c447e1b55d203ac00bf880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:42.347140 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-b3f736f1-e2d9-4904-aa34-e1af631fa0b0 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '036a90c902be43e0bdc2547278d94c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c2436609c447e1b55d203ac00bf880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:42.348886 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-b3f736f1-e2d9-4904-aa34-e1af631fa0b0 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] 10.222.0.58 "GET /compute/v2.1/servers/f3c2dd22-f9d5-4649-9fc4-b3befdf6b8fc" status: 200 len: 1336 microversion: 2.54 time: 0.195205 Aug 10 23:22:42.363985 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2479/5165] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:22:42 2022] GET /compute/v2.1/servers/f3c2dd22-f9d5-4649-9fc4-b3befdf6b8fc => generated 1336 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:22:43.273469 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-39cc6376-f763-4f24-93ef-391e46398bd1 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:43.274091 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-39cc6376-f763-4f24-93ef-391e46398bd1 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] [instance: 32ddd6eb-6c3f-4bd1-b9be-f819e8ef3a68] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:43.283446 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-39cc6376-f763-4f24-93ef-391e46398bd1 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:43.284156 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-39cc6376-f763-4f24-93ef-391e46398bd1 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:43.284755 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-39cc6376-f763-4f24-93ef-391e46398bd1 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:43.285879 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-39cc6376-f763-4f24-93ef-391e46398bd1 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:43.286972 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-39cc6376-f763-4f24-93ef-391e46398bd1 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:43.287927 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-39cc6376-f763-4f24-93ef-391e46398bd1 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:43.377361 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-63aa7f1e-5d29-4050-9524-25620507d435 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:43.377972 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-63aa7f1e-5d29-4050-9524-25620507d435 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] [instance: f3c2dd22-f9d5-4649-9fc4-b3befdf6b8fc] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:43.394680 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-63aa7f1e-5d29-4050-9524-25620507d435 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:43.395206 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-63aa7f1e-5d29-4050-9524-25620507d435 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:43.395643 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-63aa7f1e-5d29-4050-9524-25620507d435 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:43.396354 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-63aa7f1e-5d29-4050-9524-25620507d435 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:43.396805 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-63aa7f1e-5d29-4050-9524-25620507d435 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:43.397227 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-63aa7f1e-5d29-4050-9524-25620507d435 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:43.721838 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-63aa7f1e-5d29-4050-9524-25620507d435 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036a90c902be43e0bdc2547278d94c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c2436609c447e1b55d203ac00bf880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:43.737058 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-63aa7f1e-5d29-4050-9524-25620507d435 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '036a90c902be43e0bdc2547278d94c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c2436609c447e1b55d203ac00bf880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:43.741806 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-63aa7f1e-5d29-4050-9524-25620507d435 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '036a90c902be43e0bdc2547278d94c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c2436609c447e1b55d203ac00bf880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:43.749062 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-63aa7f1e-5d29-4050-9524-25620507d435 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] 10.222.0.58 "GET /compute/v2.1/servers/f3c2dd22-f9d5-4649-9fc4-b3befdf6b8fc" status: 200 len: 1357 microversion: 2.54 time: 0.372368 Aug 10 23:22:43.749931 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2480/5166] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:22:43 2022] GET /compute/v2.1/servers/f3c2dd22-f9d5-4649-9fc4-b3befdf6b8fc => generated 1357 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:22:43.784305 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-4a28181a-4ca8-4543-942d-8cf6dad6a5eb tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Action: 'create', calling method: .version_select at 0x7f847c9b3790>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-1496904749", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIp5N9dVgzRMHlpBOi1uSFF3Xl1VeF6dmUucaMp4Web+ewNRiCvSaQRR1lnGKwq/UcA4docHcFAmiGKtZZIcGIni4+EOfdLrG+DBxeQZ7h86hNn/JcDZNjcIQDeBtAmNow=="}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:22:43.822608 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-4a28181a-4ca8-4543-942d-8cf6dad6a5eb tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Getting quotas for project 23c2436609c447e1b55d203ac00bf880. Resources: {'key_pairs'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:22:43.837382 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-39cc6376-f763-4f24-93ef-391e46398bd1 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5899b2ad9f1046caaf7c6073e408eeee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25abd63376614081a9d484f3c9ae950d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:43.839082 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-4a28181a-4ca8-4543-942d-8cf6dad6a5eb tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Getting quotas for user 036a90c902be43e0bdc2547278d94c62 and project 23c2436609c447e1b55d203ac00bf880. Resources: {'key_pairs'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:22:43.850487 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-39cc6376-f763-4f24-93ef-391e46398bd1 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "GET /compute/v2.1/servers/32ddd6eb-6c3f-4bd1-b9be-f819e8ef3a68" status: 200 len: 1689 microversion: 2.1 time: 0.581595 Aug 10 23:22:43.852878 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2687/5167] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:22:43 2022] GET /compute/v2.1/servers/32ddd6eb-6c3f-4bd1-b9be-f819e8ef3a68 => generated 1689 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:22:43.895421 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-4a28181a-4ca8-4543-942d-8cf6dad6a5eb tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.54 time: 0.115431 Aug 10 23:22:43.896304 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2481/5168] 10.222.0.58 () {62 vars in 1200 bytes} [Wed Aug 10 23:22:43 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 117 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Aug 10 23:22:43.913708 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-03b834d1-d500-463a-99aa-3d53632affe5 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-1496904749", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed"}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:22:43.922318 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-03b834d1-d500-463a-99aa-3d53632affe5 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] [instance: f3c2dd22-f9d5-4649-9fc4-b3befdf6b8fc] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:43.932342 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-03b834d1-d500-463a-99aa-3d53632affe5 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:43.933462 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-03b834d1-d500-463a-99aa-3d53632affe5 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:43.934391 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-03b834d1-d500-463a-99aa-3d53632affe5 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:43.936137 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-03b834d1-d500-463a-99aa-3d53632affe5 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:43.936836 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-03b834d1-d500-463a-99aa-3d53632affe5 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:43.937411 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-03b834d1-d500-463a-99aa-3d53632affe5 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:44.089278 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-16e80973-9bc2-4484-87bd-c885cd906259 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2021171946", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6022f6db-e3f4-46f3-9a7f-22454e88771a"}], "security_groups": [{"name": "tempest-securitygroup--1953171360"}], "key_name": "tempest-keypair-1719151935", "user_data": "}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:22:44.094054 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-03b834d1-d500-463a-99aa-3d53632affe5 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Flavor limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:22:44.094560 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-03b834d1-d500-463a-99aa-3d53632affe5 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Image limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:22:44.095153 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-03b834d1-d500-463a-99aa-3d53632affe5 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Flavor pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:22:44.100448 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-03b834d1-d500-463a-99aa-3d53632affe5 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Image pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:22:44.100946 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-03b834d1-d500-463a-99aa-3d53632affe5 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:22:44.278554 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-03b834d1-d500-463a-99aa-3d53632affe5 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] [instance: f3c2dd22-f9d5-4649-9fc4-b3befdf6b8fc] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:44.289147 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-03b834d1-d500-463a-99aa-3d53632affe5 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:44.290294 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-03b834d1-d500-463a-99aa-3d53632affe5 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:44.291025 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-03b834d1-d500-463a-99aa-3d53632affe5 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:44.292299 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-03b834d1-d500-463a-99aa-3d53632affe5 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:44.293069 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-03b834d1-d500-463a-99aa-3d53632affe5 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:44.296183 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-03b834d1-d500-463a-99aa-3d53632affe5 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:44.381475 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-03b834d1-d500-463a-99aa-3d53632affe5 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] 10.222.0.58 "POST /compute/v2.1/servers/f3c2dd22-f9d5-4649-9fc4-b3befdf6b8fc/action" status: 202 len: 1140 microversion: 2.54 time: 0.470260 Aug 10 23:22:44.383474 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2688/5169] 10.222.0.58 () {62 vars in 1320 bytes} [Wed Aug 10 23:22:43 2022] POST /compute/v2.1/servers/f3c2dd22-f9d5-4649-9fc4-b3befdf6b8fc/action => generated 1140 bytes in 481 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 10 23:22:44.422457 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-655eed2b-13a8-485c-81d3-6bc75564367d tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:44.424636 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-655eed2b-13a8-485c-81d3-6bc75564367d tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] [instance: f3c2dd22-f9d5-4649-9fc4-b3befdf6b8fc] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:44.444621 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-655eed2b-13a8-485c-81d3-6bc75564367d tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:44.445243 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-655eed2b-13a8-485c-81d3-6bc75564367d tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:44.448154 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-655eed2b-13a8-485c-81d3-6bc75564367d tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:44.450588 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-655eed2b-13a8-485c-81d3-6bc75564367d tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:44.452895 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-655eed2b-13a8-485c-81d3-6bc75564367d tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:44.453623 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-655eed2b-13a8-485c-81d3-6bc75564367d tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:44.552628 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.network.neutron [None req-16e80973-9bc2-4484-87bd-c885cd906259 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] validate_networks() for [('6022f6db-e3f4-46f3-9a7f-22454e88771a', None, None, None, None, None)] {{(pid=122632) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 23:22:44.596991 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-655eed2b-13a8-485c-81d3-6bc75564367d tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036a90c902be43e0bdc2547278d94c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c2436609c447e1b55d203ac00bf880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:44.612515 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-655eed2b-13a8-485c-81d3-6bc75564367d tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '036a90c902be43e0bdc2547278d94c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c2436609c447e1b55d203ac00bf880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:44.615494 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-655eed2b-13a8-485c-81d3-6bc75564367d tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '036a90c902be43e0bdc2547278d94c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c2436609c447e1b55d203ac00bf880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:44.617828 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-655eed2b-13a8-485c-81d3-6bc75564367d tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] 10.222.0.58 "GET /compute/v2.1/servers/f3c2dd22-f9d5-4649-9fc4-b3befdf6b8fc" status: 200 len: 1409 microversion: 2.54 time: 0.213744 Aug 10 23:22:44.619695 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2689/5170] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:22:44 2022] GET /compute/v2.1/servers/f3c2dd22-f9d5-4649-9fc4-b3befdf6b8fc => generated 1409 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:22:44.877266 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-d2ba4076-b8b6-4a5a-ab05-28ac7d6476dd tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:44.878369 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-d2ba4076-b8b6-4a5a-ab05-28ac7d6476dd tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] [instance: 32ddd6eb-6c3f-4bd1-b9be-f819e8ef3a68] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:44.887642 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d2ba4076-b8b6-4a5a-ab05-28ac7d6476dd tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:44.888433 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d2ba4076-b8b6-4a5a-ab05-28ac7d6476dd tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:44.889087 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d2ba4076-b8b6-4a5a-ab05-28ac7d6476dd tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:44.890001 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d2ba4076-b8b6-4a5a-ab05-28ac7d6476dd tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:44.890683 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d2ba4076-b8b6-4a5a-ab05-28ac7d6476dd tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:44.891524 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d2ba4076-b8b6-4a5a-ab05-28ac7d6476dd tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:45.175049 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-d2ba4076-b8b6-4a5a-ab05-28ac7d6476dd tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5899b2ad9f1046caaf7c6073e408eeee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25abd63376614081a9d484f3c9ae950d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:45.184957 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-d2ba4076-b8b6-4a5a-ab05-28ac7d6476dd tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "GET /compute/v2.1/servers/32ddd6eb-6c3f-4bd1-b9be-f819e8ef3a68" status: 200 len: 1570 microversion: 2.1 time: 0.312661 Aug 10 23:22:45.186040 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2690/5171] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:22:44 2022] GET /compute/v2.1/servers/32ddd6eb-6c3f-4bd1-b9be-f819e8ef3a68 => generated 1570 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:22:45.648032 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c04a2537-10e2-47bc-82c8-4fb923f6cb75 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:45.649386 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-c04a2537-10e2-47bc-82c8-4fb923f6cb75 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] [instance: f3c2dd22-f9d5-4649-9fc4-b3befdf6b8fc] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:45.659521 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c04a2537-10e2-47bc-82c8-4fb923f6cb75 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:45.660212 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c04a2537-10e2-47bc-82c8-4fb923f6cb75 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:45.660809 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c04a2537-10e2-47bc-82c8-4fb923f6cb75 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:45.661834 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c04a2537-10e2-47bc-82c8-4fb923f6cb75 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:45.662449 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c04a2537-10e2-47bc-82c8-4fb923f6cb75 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:45.663065 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c04a2537-10e2-47bc-82c8-4fb923f6cb75 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:45.756991 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-c04a2537-10e2-47bc-82c8-4fb923f6cb75 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036a90c902be43e0bdc2547278d94c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c2436609c447e1b55d203ac00bf880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:45.767121 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-c04a2537-10e2-47bc-82c8-4fb923f6cb75 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '036a90c902be43e0bdc2547278d94c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c2436609c447e1b55d203ac00bf880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:45.769076 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-c04a2537-10e2-47bc-82c8-4fb923f6cb75 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '036a90c902be43e0bdc2547278d94c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c2436609c447e1b55d203ac00bf880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:45.770608 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-c04a2537-10e2-47bc-82c8-4fb923f6cb75 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] 10.222.0.58 "GET /compute/v2.1/servers/f3c2dd22-f9d5-4649-9fc4-b3befdf6b8fc" status: 200 len: 1409 microversion: 2.54 time: 0.128753 Aug 10 23:22:45.778619 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2691/5172] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:22:45 2022] GET /compute/v2.1/servers/f3c2dd22-f9d5-4649-9fc4-b3befdf6b8fc => generated 1409 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 23:22:45.804972 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-a29d15b2-b86d-40c2-8404-82de2b065726 req-9fb98d10-155a-4663-9a40-a6688858cbf8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32ddd6eb-6c3f-4bd1-b9be-f819e8ef3a68", "name": "network-vif-deleted", "tag": "4f9f24c0-e01f-4d27-8d15-06a370ec5bb8"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:22:45.826522 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-a29d15b2-b86d-40c2-8404-82de2b065726 req-9fb98d10-155a-4663-9a40-a6688858cbf8 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:45.827248 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-a29d15b2-b86d-40c2-8404-82de2b065726 req-9fb98d10-155a-4663-9a40-a6688858cbf8 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:45.827832 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-a29d15b2-b86d-40c2-8404-82de2b065726 req-9fb98d10-155a-4663-9a40-a6688858cbf8 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:45.859462 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-a29d15b2-b86d-40c2-8404-82de2b065726 req-9fb98d10-155a-4663-9a40-a6688858cbf8 service nova] Creating event network-vif-deleted:4f9f24c0-e01f-4d27-8d15-06a370ec5bb8 for instance 32ddd6eb-6c3f-4bd1-b9be-f819e8ef3a68 on n-h2-850468-14 Aug 10 23:22:45.872995 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-a29d15b2-b86d-40c2-8404-82de2b065726 req-9fb98d10-155a-4663-9a40-a6688858cbf8 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072032 Aug 10 23:22:45.875036 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2692/5173] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:22:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:22:46.208627 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-3b800ec0-a97d-443c-a405-d26d7ea6aac5 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:46.209696 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-3b800ec0-a97d-443c-a405-d26d7ea6aac5 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] [instance: 32ddd6eb-6c3f-4bd1-b9be-f819e8ef3a68] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:46.220514 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3b800ec0-a97d-443c-a405-d26d7ea6aac5 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:46.223423 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3b800ec0-a97d-443c-a405-d26d7ea6aac5 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:46.225221 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3b800ec0-a97d-443c-a405-d26d7ea6aac5 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:46.227037 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3b800ec0-a97d-443c-a405-d26d7ea6aac5 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:46.227994 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3b800ec0-a97d-443c-a405-d26d7ea6aac5 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:46.230757 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3b800ec0-a97d-443c-a405-d26d7ea6aac5 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:46.282002 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-16e80973-9bc2-4484-87bd-c885cd906259 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Flavor limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:22:46.282485 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-16e80973-9bc2-4484-87bd-c885cd906259 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Image limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:22:46.283106 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-16e80973-9bc2-4484-87bd-c885cd906259 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Flavor pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:22:46.283671 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-16e80973-9bc2-4484-87bd-c885cd906259 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Image pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:22:46.284209 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-16e80973-9bc2-4484-87bd-c885cd906259 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:22:46.314541 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-16e80973-9bc2-4484-87bd-c885cd906259 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:46.318204 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-16e80973-9bc2-4484-87bd-c885cd906259 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:46.318672 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-16e80973-9bc2-4484-87bd-c885cd906259 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:46.324523 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-16e80973-9bc2-4484-87bd-c885cd906259 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:46.327302 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-16e80973-9bc2-4484-87bd-c885cd906259 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:46.328900 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-16e80973-9bc2-4484-87bd-c885cd906259 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:46.338939 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3b800ec0-a97d-443c-a405-d26d7ea6aac5 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:46.341149 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3b800ec0-a97d-443c-a405-d26d7ea6aac5 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:46.344948 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3b800ec0-a97d-443c-a405-d26d7ea6aac5 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:46.346111 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.objects.instance [None req-3b800ec0-a97d-443c-a405-d26d7ea6aac5 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lazy-loading 'fault' on Instance uuid 32ddd6eb-6c3f-4bd1-b9be-f819e8ef3a68 {{(pid=122633) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:22:46.358981 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:22:46.393265 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-16e80973-9bc2-4484-87bd-c885cd906259 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Getting quotas for project 2b557edd165144c8943eb9acc339a377. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:22:46.400777 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-16e80973-9bc2-4484-87bd-c885cd906259 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Getting quotas for user 0d89081084f14e0187f4c67cd9185fef and project 2b557edd165144c8943eb9acc339a377. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:22:46.423134 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-16e80973-9bc2-4484-87bd-c885cd906259 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Going to run 1 instances... {{(pid=122632) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 23:22:46.427716 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-16e80973-9bc2-4484-87bd-c885cd906259 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] [instance: 2646d3d8-2541-4dbf-9b0f-5eb122ca1452] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78ad8905-f66f-4733-8be9-2b260f1fabed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122632) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 23:22:46.456221 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-3b800ec0-a97d-443c-a405-d26d7ea6aac5 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5899b2ad9f1046caaf7c6073e408eeee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25abd63376614081a9d484f3c9ae950d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:46.467422 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-3b800ec0-a97d-443c-a405-d26d7ea6aac5 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "GET /compute/v2.1/servers/32ddd6eb-6c3f-4bd1-b9be-f819e8ef3a68" status: 200 len: 1355 microversion: 2.1 time: 0.261312 Aug 10 23:22:46.468047 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2693/5174] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:22:46 2022] GET /compute/v2.1/servers/32ddd6eb-6c3f-4bd1-b9be-f819e8ef3a68 => generated 1355 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:22:46.563623 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-16e80973-9bc2-4484-87bd-c885cd906259 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.479471 Aug 10 23:22:46.565277 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2482/5175] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 23:22:44 2022] POST /compute/v2.1/servers => generated 402 bytes in 2482 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 23:22:46.579122 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-64ba190c-1376-4dc8-ace5-44b0a675a7e7 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:46.580080 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-64ba190c-1376-4dc8-ace5-44b0a675a7e7 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] [instance: 2646d3d8-2541-4dbf-9b0f-5eb122ca1452] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:46.661697 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-64ba190c-1376-4dc8-ace5-44b0a675a7e7 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d89081084f14e0187f4c67cd9185fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b557edd165144c8943eb9acc339a377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:46.676481 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-64ba190c-1376-4dc8-ace5-44b0a675a7e7 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] 10.222.0.58 "GET /compute/v2.1/servers/2646d3d8-2541-4dbf-9b0f-5eb122ca1452" status: 200 len: 1242 microversion: 2.1 time: 0.101468 Aug 10 23:22:46.686844 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2694/5176] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:22:46 2022] GET /compute/v2.1/servers/2646d3d8-2541-4dbf-9b0f-5eb122ca1452 => generated 1242 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:22:46.808582 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-1523ffef-c233-406d-8a5e-048fc2a0ddaa tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:46.809883 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-1523ffef-c233-406d-8a5e-048fc2a0ddaa tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] [instance: f3c2dd22-f9d5-4649-9fc4-b3befdf6b8fc] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:46.830497 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1523ffef-c233-406d-8a5e-048fc2a0ddaa tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:46.831480 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1523ffef-c233-406d-8a5e-048fc2a0ddaa tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:46.834090 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1523ffef-c233-406d-8a5e-048fc2a0ddaa tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:46.836287 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1523ffef-c233-406d-8a5e-048fc2a0ddaa tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:46.837234 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1523ffef-c233-406d-8a5e-048fc2a0ddaa tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:46.839631 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1523ffef-c233-406d-8a5e-048fc2a0ddaa tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:46.992122 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-1523ffef-c233-406d-8a5e-048fc2a0ddaa tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036a90c902be43e0bdc2547278d94c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c2436609c447e1b55d203ac00bf880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:47.010924 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-1523ffef-c233-406d-8a5e-048fc2a0ddaa tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '036a90c902be43e0bdc2547278d94c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c2436609c447e1b55d203ac00bf880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:47.013305 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-1523ffef-c233-406d-8a5e-048fc2a0ddaa tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '036a90c902be43e0bdc2547278d94c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c2436609c447e1b55d203ac00bf880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:47.014879 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-1523ffef-c233-406d-8a5e-048fc2a0ddaa tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] 10.222.0.58 "GET /compute/v2.1/servers/f3c2dd22-f9d5-4649-9fc4-b3befdf6b8fc" status: 200 len: 1409 microversion: 2.54 time: 0.212368 Aug 10 23:22:47.028432 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2483/5177] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:22:46 2022] GET /compute/v2.1/servers/f3c2dd22-f9d5-4649-9fc4-b3befdf6b8fc => generated 1409 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:22:47.490645 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c55bb8e9-d30e-46f7-999c-4958910565b4 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:47.491724 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-c55bb8e9-d30e-46f7-999c-4958910565b4 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] [instance: 32ddd6eb-6c3f-4bd1-b9be-f819e8ef3a68] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:47.497034 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:22:47.508456 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c55bb8e9-d30e-46f7-999c-4958910565b4 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:47.509007 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c55bb8e9-d30e-46f7-999c-4958910565b4 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:47.510007 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c55bb8e9-d30e-46f7-999c-4958910565b4 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:47.511043 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c55bb8e9-d30e-46f7-999c-4958910565b4 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:47.523932 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c55bb8e9-d30e-46f7-999c-4958910565b4 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:47.529092 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c55bb8e9-d30e-46f7-999c-4958910565b4 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:47.581312 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-c55bb8e9-d30e-46f7-999c-4958910565b4 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] HTTP exception thrown: Instance 32ddd6eb-6c3f-4bd1-b9be-f819e8ef3a68 could not be found. Aug 10 23:22:47.583620 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c55bb8e9-d30e-46f7-999c-4958910565b4 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Request method failure captured: Aug 10 23:22:47.583620 n-d-850468-14 devstack@n-api.service[122633]: request: GET /compute/v2.1/servers/32ddd6eb-6c3f-4bd1-b9be-f819e8ef3a68 HTTP/1.1 Aug 10 23:22:47.583620 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:22:47.583620 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:22:47.583620 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:22:47.583620 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:22:47.583620 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:22:47.583620 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:22:47.583620 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:22:47.583620 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:22:47.583620 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9Ds_i3PDzfY831LhvXxRQTuETlpkVlxLBcxw-fA_3Rgh7BtMKg49t93n4W60rS-OkNCaJLSeSll4L6S-Ea6OzN1bcIzb1fgJBbur3wde6WJsUVM5pLO1qLazxYPdl_aqZKKVBhxsJX3P2s11u3EZ1kQF4iZz3H2MFzZDIBqiyZ7kxOA Aug 10 23:22:47.583620 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:22:47.583620 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:22:47.583620 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:22:47.583620 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:22:47.583620 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:22:47.583620 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:22:47.583620 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 25abd63376614081a9d484f3c9ae950d Aug 10 23:22:47.583620 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1591694610 Aug 10 23:22:47.583620 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:22:47.583620 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:22:47.583620 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/25abd63376614081a9d484f3c9ae950d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/25abd63376614081a9d484f3c9ae950d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/25abd63376614081a9d484f3c9ae950d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_25abd63376614081a9d484f3c9ae950d", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:22:47.583620 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1591694610 Aug 10 23:22:47.583620 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 25abd63376614081a9d484f3c9ae950d Aug 10 23:22:47.583620 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1591694610 Aug 10 23:22:47.583620 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-TestNetworkAdvancedServerOps-1591694610-project Aug 10 23:22:47.583620 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:22:47.583620 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:22:47.583620 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 5899b2ad9f1046caaf7c6073e408eeee Aug 10 23:22:47.583620 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1591694610-project Aug 10 23:22:47.583620 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:22:47.583620 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance 32ddd6eb-6c3f-4bd1-b9be-f819e8ef3a68 could not be found. Aug 10 23:22:47.583620 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': '32ddd6eb-6c3f-4bd1-b9be-f819e8ef3a68'} Aug 10 23:22:47.583620 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:22:47.583620 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:22:47.583620 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:22:47.583620 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:22:47.583620 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:22:47.583620 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:22:47.583620 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:22:47.583620 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:22:47.583620 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:22:47.583620 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:22:47.583620 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32ddd6eb-6c3f-4bd1-b9be-f819e8ef3a68 could not be found. Aug 10 23:22:47.583620 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:22:47.583620 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:22:47.583620 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:22:47.583620 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:22:47.583620 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:22:47.583620 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:22:47.583620 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:22:47.583620 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:22:47.583620 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:22:47.583620 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:22:47.583620 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:22:47.583620 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:22:47.583620 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:22:47.583620 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:22:47.583620 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:22:47.583620 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:22:47.583620 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32ddd6eb-6c3f-4bd1-b9be-f819e8ef3a68 could not be found. Aug 10 23:22:47.583620 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:22:47.583620 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:22:47.588520 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:22:47.588520 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:22:47.588520 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:22:47.588520 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:22:47.588520 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:22:47.588520 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:22:47.588520 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32ddd6eb-6c3f-4bd1-b9be-f819e8ef3a68 could not be found. Aug 10 23:22:47.588520 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:22:47.590942 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c55bb8e9-d30e-46f7-999c-4958910565b4 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Returning 404 to user: Instance 32ddd6eb-6c3f-4bd1-b9be-f819e8ef3a68 could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:22:47.592216 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-c55bb8e9-d30e-46f7-999c-4958910565b4 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "GET /compute/v2.1/servers/32ddd6eb-6c3f-4bd1-b9be-f819e8ef3a68" status: 404 len: 111 microversion: 2.1 time: 0.106658 Aug 10 23:22:47.592975 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2695/5178] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:22:47 2022] GET /compute/v2.1/servers/32ddd6eb-6c3f-4bd1-b9be-f819e8ef3a68 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:22:47.700738 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-7c3721a4-acf7-4b59-80bb-f3884d5f5bff tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:47.701466 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-7c3721a4-acf7-4b59-80bb-f3884d5f5bff tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] [instance: 2646d3d8-2541-4dbf-9b0f-5eb122ca1452] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:47.711155 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7c3721a4-acf7-4b59-80bb-f3884d5f5bff tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:47.712474 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7c3721a4-acf7-4b59-80bb-f3884d5f5bff tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:47.716019 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7c3721a4-acf7-4b59-80bb-f3884d5f5bff tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:47.717804 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7c3721a4-acf7-4b59-80bb-f3884d5f5bff tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:47.719174 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7c3721a4-acf7-4b59-80bb-f3884d5f5bff tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:47.720996 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7c3721a4-acf7-4b59-80bb-f3884d5f5bff tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:47.910374 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-7c3721a4-acf7-4b59-80bb-f3884d5f5bff tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d89081084f14e0187f4c67cd9185fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b557edd165144c8943eb9acc339a377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:47.918425 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-7c3721a4-acf7-4b59-80bb-f3884d5f5bff tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] 10.222.0.58 "GET /compute/v2.1/servers/2646d3d8-2541-4dbf-9b0f-5eb122ca1452" status: 200 len: 1294 microversion: 2.1 time: 0.224324 Aug 10 23:22:47.920632 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2484/5179] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:22:47 2022] GET /compute/v2.1/servers/2646d3d8-2541-4dbf-9b0f-5eb122ca1452 => generated 1294 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:22:48.043943 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-e3e5857e-cc1c-4396-8c71-8577817c1ed8 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:48.044568 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-e3e5857e-cc1c-4396-8c71-8577817c1ed8 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] [instance: f3c2dd22-f9d5-4649-9fc4-b3befdf6b8fc] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:48.057948 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e3e5857e-cc1c-4396-8c71-8577817c1ed8 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:48.062075 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e3e5857e-cc1c-4396-8c71-8577817c1ed8 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:48.062723 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e3e5857e-cc1c-4396-8c71-8577817c1ed8 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:48.063585 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e3e5857e-cc1c-4396-8c71-8577817c1ed8 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:48.067239 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e3e5857e-cc1c-4396-8c71-8577817c1ed8 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:48.067704 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e3e5857e-cc1c-4396-8c71-8577817c1ed8 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:48.161553 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-e3e5857e-cc1c-4396-8c71-8577817c1ed8 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036a90c902be43e0bdc2547278d94c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c2436609c447e1b55d203ac00bf880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:48.178294 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-e3e5857e-cc1c-4396-8c71-8577817c1ed8 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '036a90c902be43e0bdc2547278d94c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c2436609c447e1b55d203ac00bf880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:48.180206 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-e3e5857e-cc1c-4396-8c71-8577817c1ed8 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '036a90c902be43e0bdc2547278d94c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c2436609c447e1b55d203ac00bf880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:48.182081 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-e3e5857e-cc1c-4396-8c71-8577817c1ed8 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] 10.222.0.58 "GET /compute/v2.1/servers/f3c2dd22-f9d5-4649-9fc4-b3befdf6b8fc" status: 200 len: 1409 microversion: 2.54 time: 0.143769 Aug 10 23:22:48.195471 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2696/5180] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:22:48 2022] GET /compute/v2.1/servers/f3c2dd22-f9d5-4649-9fc4-b3befdf6b8fc => generated 1409 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:22:48.941240 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-32228f4b-0d3b-4d50-bc81-694f5aa5adc3 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:48.943203 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-32228f4b-0d3b-4d50-bc81-694f5aa5adc3 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] [instance: 2646d3d8-2541-4dbf-9b0f-5eb122ca1452] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:48.960190 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-32228f4b-0d3b-4d50-bc81-694f5aa5adc3 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:48.960853 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-32228f4b-0d3b-4d50-bc81-694f5aa5adc3 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:48.962105 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-32228f4b-0d3b-4d50-bc81-694f5aa5adc3 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:48.963803 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-32228f4b-0d3b-4d50-bc81-694f5aa5adc3 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:48.965366 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-32228f4b-0d3b-4d50-bc81-694f5aa5adc3 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:48.965829 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-32228f4b-0d3b-4d50-bc81-694f5aa5adc3 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:49.105657 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-32228f4b-0d3b-4d50-bc81-694f5aa5adc3 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d89081084f14e0187f4c67cd9185fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b557edd165144c8943eb9acc339a377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:49.118279 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-32228f4b-0d3b-4d50-bc81-694f5aa5adc3 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] 10.222.0.58 "GET /compute/v2.1/servers/2646d3d8-2541-4dbf-9b0f-5eb122ca1452" status: 200 len: 1300 microversion: 2.1 time: 0.181562 Aug 10 23:22:49.132090 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2485/5181] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:22:48 2022] GET /compute/v2.1/servers/2646d3d8-2541-4dbf-9b0f-5eb122ca1452 => generated 1300 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:22:49.207686 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-51451684-fd53-480d-802a-31261621f95a tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:49.209796 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-51451684-fd53-480d-802a-31261621f95a tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] [instance: f3c2dd22-f9d5-4649-9fc4-b3befdf6b8fc] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:49.219482 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-51451684-fd53-480d-802a-31261621f95a tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:49.220840 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-51451684-fd53-480d-802a-31261621f95a tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:49.221436 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-51451684-fd53-480d-802a-31261621f95a tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:49.222306 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-51451684-fd53-480d-802a-31261621f95a tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:49.223455 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-51451684-fd53-480d-802a-31261621f95a tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:49.224135 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-51451684-fd53-480d-802a-31261621f95a tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:49.351436 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-51451684-fd53-480d-802a-31261621f95a tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036a90c902be43e0bdc2547278d94c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c2436609c447e1b55d203ac00bf880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:49.369699 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-51451684-fd53-480d-802a-31261621f95a tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '036a90c902be43e0bdc2547278d94c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c2436609c447e1b55d203ac00bf880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:49.373937 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-51451684-fd53-480d-802a-31261621f95a tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '036a90c902be43e0bdc2547278d94c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c2436609c447e1b55d203ac00bf880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:49.376064 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-51451684-fd53-480d-802a-31261621f95a tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] 10.222.0.58 "GET /compute/v2.1/servers/f3c2dd22-f9d5-4649-9fc4-b3befdf6b8fc" status: 200 len: 1409 microversion: 2.54 time: 0.173299 Aug 10 23:22:49.378053 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2697/5182] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:22:49 2022] GET /compute/v2.1/servers/f3c2dd22-f9d5-4649-9fc4-b3befdf6b8fc => generated 1409 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:22:50.142965 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-799b8ef1-c60e-4933-b9f4-792609f095d8 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:50.144015 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-799b8ef1-c60e-4933-b9f4-792609f095d8 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] [instance: 2646d3d8-2541-4dbf-9b0f-5eb122ca1452] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:50.156781 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-799b8ef1-c60e-4933-b9f4-792609f095d8 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:50.157780 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-799b8ef1-c60e-4933-b9f4-792609f095d8 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:50.165612 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-799b8ef1-c60e-4933-b9f4-792609f095d8 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:50.178245 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-799b8ef1-c60e-4933-b9f4-792609f095d8 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:50.179628 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-799b8ef1-c60e-4933-b9f4-792609f095d8 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:50.181255 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-799b8ef1-c60e-4933-b9f4-792609f095d8 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:50.579339 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-799b8ef1-c60e-4933-b9f4-792609f095d8 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d89081084f14e0187f4c67cd9185fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b557edd165144c8943eb9acc339a377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:50.588873 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-799b8ef1-c60e-4933-b9f4-792609f095d8 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] 10.222.0.58 "GET /compute/v2.1/servers/2646d3d8-2541-4dbf-9b0f-5eb122ca1452" status: 200 len: 1368 microversion: 2.1 time: 0.451030 Aug 10 23:22:50.598082 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2698/5183] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:22:50 2022] GET /compute/v2.1/servers/2646d3d8-2541-4dbf-9b0f-5eb122ca1452 => generated 1368 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:22:50.608900 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-d872da25-fddf-4916-b70e-e42ede771a3e tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:50.609539 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-d872da25-fddf-4916-b70e-e42ede771a3e tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] [instance: f3c2dd22-f9d5-4649-9fc4-b3befdf6b8fc] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:50.614080 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-181145ae-7950-48c1-b68c-0169a02b57f3 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:50.615350 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-181145ae-7950-48c1-b68c-0169a02b57f3 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] [instance: 7e091da3-0636-4cba-b8de-94fdeecf0b7f] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:50.617020 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d872da25-fddf-4916-b70e-e42ede771a3e tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:50.617511 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d872da25-fddf-4916-b70e-e42ede771a3e tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:50.617948 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d872da25-fddf-4916-b70e-e42ede771a3e tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:50.618715 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d872da25-fddf-4916-b70e-e42ede771a3e tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:50.619243 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d872da25-fddf-4916-b70e-e42ede771a3e tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:50.619666 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d872da25-fddf-4916-b70e-e42ede771a3e tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:50.627753 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-181145ae-7950-48c1-b68c-0169a02b57f3 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:50.629809 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-181145ae-7950-48c1-b68c-0169a02b57f3 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:50.630413 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-181145ae-7950-48c1-b68c-0169a02b57f3 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:50.632361 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-181145ae-7950-48c1-b68c-0169a02b57f3 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:50.645369 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-181145ae-7950-48c1-b68c-0169a02b57f3 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:50.650616 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-181145ae-7950-48c1-b68c-0169a02b57f3 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:50.701715 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-181145ae-7950-48c1-b68c-0169a02b57f3 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] [instance: 7e091da3-0636-4cba-b8de-94fdeecf0b7f] Going to try to terminate instance {{(pid=122632) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:22:50.793452 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-d872da25-fddf-4916-b70e-e42ede771a3e tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036a90c902be43e0bdc2547278d94c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c2436609c447e1b55d203ac00bf880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:50.807653 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-d872da25-fddf-4916-b70e-e42ede771a3e tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '036a90c902be43e0bdc2547278d94c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c2436609c447e1b55d203ac00bf880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:50.817010 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-d872da25-fddf-4916-b70e-e42ede771a3e tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '036a90c902be43e0bdc2547278d94c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c2436609c447e1b55d203ac00bf880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:50.818375 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-d872da25-fddf-4916-b70e-e42ede771a3e tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] 10.222.0.58 "GET /compute/v2.1/servers/f3c2dd22-f9d5-4649-9fc4-b3befdf6b8fc" status: 200 len: 1409 microversion: 2.54 time: 0.219243 Aug 10 23:22:50.821086 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2699/5184] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:22:50 2022] GET /compute/v2.1/servers/f3c2dd22-f9d5-4649-9fc4-b3befdf6b8fc => generated 1409 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:22:50.825160 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-181145ae-7950-48c1-b68c-0169a02b57f3 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] 10.222.0.58 "DELETE /compute/v2.1/servers/7e091da3-0636-4cba-b8de-94fdeecf0b7f" status: 204 len: 0 microversion: 2.32 time: 0.881183 Aug 10 23:22:50.834491 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-72f66317-d4d8-4e04-b3f0-4e855e9fb35b tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:50.835273 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-72f66317-d4d8-4e04-b3f0-4e855e9fb35b tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] [instance: 7e091da3-0636-4cba-b8de-94fdeecf0b7f] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:50.837940 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2486/5185] 10.222.0.58 () {60 vars in 1280 bytes} [Wed Aug 10 23:22:49 2022] DELETE /compute/v2.1/servers/7e091da3-0636-4cba-b8de-94fdeecf0b7f => generated 0 bytes in 884 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 10 23:22:50.854314 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-72f66317-d4d8-4e04-b3f0-4e855e9fb35b tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:50.855380 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-72f66317-d4d8-4e04-b3f0-4e855e9fb35b tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:50.856183 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-72f66317-d4d8-4e04-b3f0-4e855e9fb35b tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:50.856922 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-72f66317-d4d8-4e04-b3f0-4e855e9fb35b tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:50.857547 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-72f66317-d4d8-4e04-b3f0-4e855e9fb35b tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:50.857984 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-72f66317-d4d8-4e04-b3f0-4e855e9fb35b tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:51.208538 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-72f66317-d4d8-4e04-b3f0-4e855e9fb35b tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:51.228296 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-72f66317-d4d8-4e04-b3f0-4e855e9fb35b tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:51.236584 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-72f66317-d4d8-4e04-b3f0-4e855e9fb35b tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:51.239632 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-72f66317-d4d8-4e04-b3f0-4e855e9fb35b tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] 10.222.0.58 "GET /compute/v2.1/servers/7e091da3-0636-4cba-b8de-94fdeecf0b7f" status: 200 len: 2953 microversion: 2.32 time: 0.408869 Aug 10 23:22:51.247596 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2700/5186] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:22:50 2022] GET /compute/v2.1/servers/7e091da3-0636-4cba-b8de-94fdeecf0b7f => generated 2953 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:22:51.423716 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-311a7da1-6a90-452c-954e-c8d950308610 tempest-PortsAdminExtendedAttrsTestJSON-1861657930 tempest-PortsAdminExtendedAttrsTestJSON-1861657930-project-admin] Calling method '.version_select at 0x7f846fd0b040>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:51.424867 n-d-850468-14 devstack@n-api.service[122632]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 23:22:51.424867 n-d-850468-14 devstack@n-api.service[122632]: warnings.warn(msg) Aug 10 23:22:51.426172 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-311a7da1-6a90-452c-954e-c8d950308610 tempest-PortsAdminExtendedAttrsTestJSON-1861657930 tempest-PortsAdminExtendedAttrsTestJSON-1861657930-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:51.426658 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-311a7da1-6a90-452c-954e-c8d950308610 tempest-PortsAdminExtendedAttrsTestJSON-1861657930 tempest-PortsAdminExtendedAttrsTestJSON-1861657930-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:51.427274 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-311a7da1-6a90-452c-954e-c8d950308610 tempest-PortsAdminExtendedAttrsTestJSON-1861657930 tempest-PortsAdminExtendedAttrsTestJSON-1861657930-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:51.452716 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-311a7da1-6a90-452c-954e-c8d950308610 tempest-PortsAdminExtendedAttrsTestJSON-1861657930 tempest-PortsAdminExtendedAttrsTestJSON-1861657930-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:51.453419 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-311a7da1-6a90-452c-954e-c8d950308610 tempest-PortsAdminExtendedAttrsTestJSON-1861657930 tempest-PortsAdminExtendedAttrsTestJSON-1861657930-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:51.454010 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-311a7da1-6a90-452c-954e-c8d950308610 tempest-PortsAdminExtendedAttrsTestJSON-1861657930 tempest-PortsAdminExtendedAttrsTestJSON-1861657930-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:51.469396 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-311a7da1-6a90-452c-954e-c8d950308610 tempest-PortsAdminExtendedAttrsTestJSON-1861657930 tempest-PortsAdminExtendedAttrsTestJSON-1861657930-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:51.470249 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-311a7da1-6a90-452c-954e-c8d950308610 tempest-PortsAdminExtendedAttrsTestJSON-1861657930 tempest-PortsAdminExtendedAttrsTestJSON-1861657930-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:51.471101 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-311a7da1-6a90-452c-954e-c8d950308610 tempest-PortsAdminExtendedAttrsTestJSON-1861657930 tempest-PortsAdminExtendedAttrsTestJSON-1861657930-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:51.478096 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-311a7da1-6a90-452c-954e-c8d950308610 tempest-PortsAdminExtendedAttrsTestJSON-1861657930 tempest-PortsAdminExtendedAttrsTestJSON-1861657930-project-admin] 10.222.0.58 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.398451 Aug 10 23:22:51.488655 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2487/5187] 10.222.0.58 () {58 vars in 1146 bytes} [Wed Aug 10 23:22:51 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 23:22:51.621688 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-6a01d199-4a0c-4204-b28a-4e34c12ed679 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:51.624548 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-6a01d199-4a0c-4204-b28a-4e34c12ed679 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] [instance: 2646d3d8-2541-4dbf-9b0f-5eb122ca1452] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:51.656176 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6a01d199-4a0c-4204-b28a-4e34c12ed679 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:51.659467 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6a01d199-4a0c-4204-b28a-4e34c12ed679 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:51.660608 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6a01d199-4a0c-4204-b28a-4e34c12ed679 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:51.661470 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6a01d199-4a0c-4204-b28a-4e34c12ed679 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:51.663138 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6a01d199-4a0c-4204-b28a-4e34c12ed679 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:51.663943 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6a01d199-4a0c-4204-b28a-4e34c12ed679 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:51.847027 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-9c0c8126-d875-4faa-bcdb-fd4b7aa19114 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:51.847781 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-9c0c8126-d875-4faa-bcdb-fd4b7aa19114 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] [instance: f3c2dd22-f9d5-4649-9fc4-b3befdf6b8fc] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:51.860408 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9c0c8126-d875-4faa-bcdb-fd4b7aa19114 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:51.860947 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9c0c8126-d875-4faa-bcdb-fd4b7aa19114 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:51.861324 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9c0c8126-d875-4faa-bcdb-fd4b7aa19114 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:51.862030 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9c0c8126-d875-4faa-bcdb-fd4b7aa19114 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:51.862479 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9c0c8126-d875-4faa-bcdb-fd4b7aa19114 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:51.871123 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9c0c8126-d875-4faa-bcdb-fd4b7aa19114 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:51.903125 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:22:52.038496 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-9c0c8126-d875-4faa-bcdb-fd4b7aa19114 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036a90c902be43e0bdc2547278d94c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c2436609c447e1b55d203ac00bf880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:52.052199 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-9c0c8126-d875-4faa-bcdb-fd4b7aa19114 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '036a90c902be43e0bdc2547278d94c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c2436609c447e1b55d203ac00bf880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:52.054170 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-9c0c8126-d875-4faa-bcdb-fd4b7aa19114 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '036a90c902be43e0bdc2547278d94c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c2436609c447e1b55d203ac00bf880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:52.056317 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-9c0c8126-d875-4faa-bcdb-fd4b7aa19114 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] 10.222.0.58 "GET /compute/v2.1/servers/f3c2dd22-f9d5-4649-9fc4-b3befdf6b8fc" status: 200 len: 1409 microversion: 2.54 time: 0.215348 Aug 10 23:22:52.057621 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2488/5188] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:22:51 2022] GET /compute/v2.1/servers/f3c2dd22-f9d5-4649-9fc4-b3befdf6b8fc => generated 1409 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:22:52.175861 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-b1c7424b-194e-49c3-98b7-d4a453fd182b req-661243b7-cbd7-4ac2-ac1c-60834781ffc4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2646d3d8-2541-4dbf-9b0f-5eb122ca1452", "tag": "98a6e2a1-4551-40ba-ae20-1d39116fefc4"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:22:52.205161 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-6a01d199-4a0c-4204-b28a-4e34c12ed679 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d89081084f14e0187f4c67cd9185fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b557edd165144c8943eb9acc339a377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:52.206067 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-b1c7424b-194e-49c3-98b7-d4a453fd182b req-661243b7-cbd7-4ac2-ac1c-60834781ffc4 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:52.207173 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-b1c7424b-194e-49c3-98b7-d4a453fd182b req-661243b7-cbd7-4ac2-ac1c-60834781ffc4 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:52.208781 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-b1c7424b-194e-49c3-98b7-d4a453fd182b req-661243b7-cbd7-4ac2-ac1c-60834781ffc4 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:52.216039 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-6a01d199-4a0c-4204-b28a-4e34c12ed679 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] 10.222.0.58 "GET /compute/v2.1/servers/2646d3d8-2541-4dbf-9b0f-5eb122ca1452" status: 200 len: 1368 microversion: 2.1 time: 0.603538 Aug 10 23:22:52.216905 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2701/5189] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:22:51 2022] GET /compute/v2.1/servers/2646d3d8-2541-4dbf-9b0f-5eb122ca1452 => generated 1368 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:22:52.240040 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-b1c7424b-194e-49c3-98b7-d4a453fd182b req-661243b7-cbd7-4ac2-ac1c-60834781ffc4 service nova] Creating event network-changed:98a6e2a1-4551-40ba-ae20-1d39116fefc4 for instance 2646d3d8-2541-4dbf-9b0f-5eb122ca1452 on n-h2-850468-14 Aug 10 23:22:52.246447 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-b1c7424b-194e-49c3-98b7-d4a453fd182b req-661243b7-cbd7-4ac2-ac1c-60834781ffc4 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074425 Aug 10 23:22:52.247556 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2489/5190] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:22:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 23:22:52.268385 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-aa92042c-ef4a-4f3a-9679-03cda5e7a30d tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:52.269053 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-aa92042c-ef4a-4f3a-9679-03cda5e7a30d tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] [instance: 7e091da3-0636-4cba-b8de-94fdeecf0b7f] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:52.281450 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-aa92042c-ef4a-4f3a-9679-03cda5e7a30d tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:52.281956 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-aa92042c-ef4a-4f3a-9679-03cda5e7a30d tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:52.282402 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-aa92042c-ef4a-4f3a-9679-03cda5e7a30d tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:52.283156 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-aa92042c-ef4a-4f3a-9679-03cda5e7a30d tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:52.283672 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-aa92042c-ef4a-4f3a-9679-03cda5e7a30d tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:52.286520 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-aa92042c-ef4a-4f3a-9679-03cda5e7a30d tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:52.915902 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-aa92042c-ef4a-4f3a-9679-03cda5e7a30d tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:52.930991 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-aa92042c-ef4a-4f3a-9679-03cda5e7a30d tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:52.932603 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-aa92042c-ef4a-4f3a-9679-03cda5e7a30d tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:52.934088 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-aa92042c-ef4a-4f3a-9679-03cda5e7a30d tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] 10.222.0.58 "GET /compute/v2.1/servers/7e091da3-0636-4cba-b8de-94fdeecf0b7f" status: 200 len: 2953 microversion: 2.32 time: 0.669873 Aug 10 23:22:52.934708 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2702/5191] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:22:52 2022] GET /compute/v2.1/servers/7e091da3-0636-4cba-b8de-94fdeecf0b7f => generated 2953 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:22:53.091428 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-d5289bb9-deac-4664-bd25-8d106b78efe5 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:53.093726 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-d5289bb9-deac-4664-bd25-8d106b78efe5 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] [instance: f3c2dd22-f9d5-4649-9fc4-b3befdf6b8fc] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:53.104097 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d5289bb9-deac-4664-bd25-8d106b78efe5 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:53.106084 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d5289bb9-deac-4664-bd25-8d106b78efe5 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:53.107670 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d5289bb9-deac-4664-bd25-8d106b78efe5 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:53.110239 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d5289bb9-deac-4664-bd25-8d106b78efe5 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:53.111436 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d5289bb9-deac-4664-bd25-8d106b78efe5 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:53.112806 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d5289bb9-deac-4664-bd25-8d106b78efe5 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:53.241832 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-fb2015b5-fe02-44ae-963c-82e34384666b tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:53.242937 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-fb2015b5-fe02-44ae-963c-82e34384666b tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] [instance: 2646d3d8-2541-4dbf-9b0f-5eb122ca1452] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:53.252183 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fb2015b5-fe02-44ae-963c-82e34384666b tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:53.255692 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fb2015b5-fe02-44ae-963c-82e34384666b tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:53.256345 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fb2015b5-fe02-44ae-963c-82e34384666b tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:53.257242 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fb2015b5-fe02-44ae-963c-82e34384666b tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:53.259215 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fb2015b5-fe02-44ae-963c-82e34384666b tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:53.260568 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fb2015b5-fe02-44ae-963c-82e34384666b tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:53.319154 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-d5289bb9-deac-4664-bd25-8d106b78efe5 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036a90c902be43e0bdc2547278d94c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c2436609c447e1b55d203ac00bf880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:53.342490 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-d5289bb9-deac-4664-bd25-8d106b78efe5 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '036a90c902be43e0bdc2547278d94c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c2436609c447e1b55d203ac00bf880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:53.352592 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-d5289bb9-deac-4664-bd25-8d106b78efe5 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '036a90c902be43e0bdc2547278d94c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c2436609c447e1b55d203ac00bf880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:53.359036 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-d5289bb9-deac-4664-bd25-8d106b78efe5 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] 10.222.0.58 "GET /compute/v2.1/servers/f3c2dd22-f9d5-4649-9fc4-b3befdf6b8fc" status: 200 len: 1409 microversion: 2.54 time: 0.276775 Aug 10 23:22:53.360883 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2490/5192] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:22:53 2022] GET /compute/v2.1/servers/f3c2dd22-f9d5-4649-9fc4-b3befdf6b8fc => generated 1409 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:22:53.761401 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-fb2015b5-fe02-44ae-963c-82e34384666b tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d89081084f14e0187f4c67cd9185fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b557edd165144c8943eb9acc339a377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:53.781865 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-fb2015b5-fe02-44ae-963c-82e34384666b tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] 10.222.0.58 "GET /compute/v2.1/servers/2646d3d8-2541-4dbf-9b0f-5eb122ca1452" status: 200 len: 1368 microversion: 2.1 time: 0.543582 Aug 10 23:22:53.801255 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2703/5193] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:22:53 2022] GET /compute/v2.1/servers/2646d3d8-2541-4dbf-9b0f-5eb122ca1452 => generated 1368 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:22:53.963078 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-262b6a1a-5aa9-4de4-b3cc-5142417c5052 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:53.964769 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-262b6a1a-5aa9-4de4-b3cc-5142417c5052 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] [instance: 7e091da3-0636-4cba-b8de-94fdeecf0b7f] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:53.973114 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-262b6a1a-5aa9-4de4-b3cc-5142417c5052 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:53.973838 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-262b6a1a-5aa9-4de4-b3cc-5142417c5052 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:53.974484 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-262b6a1a-5aa9-4de4-b3cc-5142417c5052 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:53.975441 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-262b6a1a-5aa9-4de4-b3cc-5142417c5052 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:53.976112 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-262b6a1a-5aa9-4de4-b3cc-5142417c5052 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:53.976729 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-262b6a1a-5aa9-4de4-b3cc-5142417c5052 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:54.387194 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-fbfd9c51-ffa6-476b-9ba8-1d17ed2763cb tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:54.388113 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-fbfd9c51-ffa6-476b-9ba8-1d17ed2763cb tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] [instance: f3c2dd22-f9d5-4649-9fc4-b3befdf6b8fc] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:54.395785 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fbfd9c51-ffa6-476b-9ba8-1d17ed2763cb tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:54.405964 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fbfd9c51-ffa6-476b-9ba8-1d17ed2763cb tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:54.414091 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fbfd9c51-ffa6-476b-9ba8-1d17ed2763cb tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:54.426457 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fbfd9c51-ffa6-476b-9ba8-1d17ed2763cb tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:54.429226 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fbfd9c51-ffa6-476b-9ba8-1d17ed2763cb tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:54.429677 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fbfd9c51-ffa6-476b-9ba8-1d17ed2763cb tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:54.446712 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-262b6a1a-5aa9-4de4-b3cc-5142417c5052 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:54.472879 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-262b6a1a-5aa9-4de4-b3cc-5142417c5052 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:54.475470 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-262b6a1a-5aa9-4de4-b3cc-5142417c5052 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:54.477854 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-262b6a1a-5aa9-4de4-b3cc-5142417c5052 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] 10.222.0.58 "GET /compute/v2.1/servers/7e091da3-0636-4cba-b8de-94fdeecf0b7f" status: 200 len: 2953 microversion: 2.32 time: 0.518837 Aug 10 23:22:54.478800 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2491/5194] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:22:53 2022] GET /compute/v2.1/servers/7e091da3-0636-4cba-b8de-94fdeecf0b7f => generated 2953 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:22:54.908508 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-fbfd9c51-ffa6-476b-9ba8-1d17ed2763cb tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036a90c902be43e0bdc2547278d94c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c2436609c447e1b55d203ac00bf880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:54.930245 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-fbfd9c51-ffa6-476b-9ba8-1d17ed2763cb tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '036a90c902be43e0bdc2547278d94c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c2436609c447e1b55d203ac00bf880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:54.938252 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-fbfd9c51-ffa6-476b-9ba8-1d17ed2763cb tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '036a90c902be43e0bdc2547278d94c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c2436609c447e1b55d203ac00bf880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:54.941755 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-fbfd9c51-ffa6-476b-9ba8-1d17ed2763cb tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] 10.222.0.58 "GET /compute/v2.1/servers/f3c2dd22-f9d5-4649-9fc4-b3befdf6b8fc" status: 200 len: 1409 microversion: 2.54 time: 0.559847 Aug 10 23:22:54.949461 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2704/5195] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:22:54 2022] GET /compute/v2.1/servers/f3c2dd22-f9d5-4649-9fc4-b3befdf6b8fc => generated 1409 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:22:55.260092 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-ee35787a-627b-4728-98f7-f27f8e3eb5d1 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:55.261039 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-ee35787a-627b-4728-98f7-f27f8e3eb5d1 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] [instance: 2646d3d8-2541-4dbf-9b0f-5eb122ca1452] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:55.280839 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ee35787a-627b-4728-98f7-f27f8e3eb5d1 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:55.283678 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ee35787a-627b-4728-98f7-f27f8e3eb5d1 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:55.284167 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ee35787a-627b-4728-98f7-f27f8e3eb5d1 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:55.287319 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ee35787a-627b-4728-98f7-f27f8e3eb5d1 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:55.287809 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ee35787a-627b-4728-98f7-f27f8e3eb5d1 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:55.288254 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ee35787a-627b-4728-98f7-f27f8e3eb5d1 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:55.513054 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-6b12c0e1-f7e8-4d80-bcda-0b77de21bcf7 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:55.514605 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-6b12c0e1-f7e8-4d80-bcda-0b77de21bcf7 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] [instance: 7e091da3-0636-4cba-b8de-94fdeecf0b7f] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:55.529397 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6b12c0e1-f7e8-4d80-bcda-0b77de21bcf7 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:55.530550 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6b12c0e1-f7e8-4d80-bcda-0b77de21bcf7 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:55.532974 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6b12c0e1-f7e8-4d80-bcda-0b77de21bcf7 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:55.533899 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6b12c0e1-f7e8-4d80-bcda-0b77de21bcf7 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:55.537703 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6b12c0e1-f7e8-4d80-bcda-0b77de21bcf7 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:55.538300 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6b12c0e1-f7e8-4d80-bcda-0b77de21bcf7 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:55.888441 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-ee35787a-627b-4728-98f7-f27f8e3eb5d1 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d89081084f14e0187f4c67cd9185fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b557edd165144c8943eb9acc339a377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:55.900796 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-ee35787a-627b-4728-98f7-f27f8e3eb5d1 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] 10.222.0.58 "GET /compute/v2.1/servers/2646d3d8-2541-4dbf-9b0f-5eb122ca1452" status: 200 len: 1368 microversion: 2.1 time: 1.096705 Aug 10 23:22:55.902193 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2492/5196] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:22:54 2022] GET /compute/v2.1/servers/2646d3d8-2541-4dbf-9b0f-5eb122ca1452 => generated 1368 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:22:55.977429 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-757c1e4f-8587-4ceb-857e-1fe045b67ba5 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:55.978271 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-757c1e4f-8587-4ceb-857e-1fe045b67ba5 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] [instance: f3c2dd22-f9d5-4649-9fc4-b3befdf6b8fc] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:55.991947 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-757c1e4f-8587-4ceb-857e-1fe045b67ba5 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:55.997629 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-757c1e4f-8587-4ceb-857e-1fe045b67ba5 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:55.998259 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-757c1e4f-8587-4ceb-857e-1fe045b67ba5 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:55.999216 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-757c1e4f-8587-4ceb-857e-1fe045b67ba5 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:56.000518 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-757c1e4f-8587-4ceb-857e-1fe045b67ba5 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:56.001104 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-757c1e4f-8587-4ceb-857e-1fe045b67ba5 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:56.231595 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-6b12c0e1-f7e8-4d80-bcda-0b77de21bcf7 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:56.249751 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-6b12c0e1-f7e8-4d80-bcda-0b77de21bcf7 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:56.251709 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-6b12c0e1-f7e8-4d80-bcda-0b77de21bcf7 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:56.252978 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-6b12c0e1-f7e8-4d80-bcda-0b77de21bcf7 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] 10.222.0.58 "GET /compute/v2.1/servers/7e091da3-0636-4cba-b8de-94fdeecf0b7f" status: 200 len: 2932 microversion: 2.32 time: 0.746838 Aug 10 23:22:56.253556 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2705/5197] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:22:55 2022] GET /compute/v2.1/servers/7e091da3-0636-4cba-b8de-94fdeecf0b7f => generated 2932 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:22:56.279262 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-757c1e4f-8587-4ceb-857e-1fe045b67ba5 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036a90c902be43e0bdc2547278d94c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c2436609c447e1b55d203ac00bf880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:56.289975 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-757c1e4f-8587-4ceb-857e-1fe045b67ba5 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '036a90c902be43e0bdc2547278d94c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c2436609c447e1b55d203ac00bf880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:56.292721 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-757c1e4f-8587-4ceb-857e-1fe045b67ba5 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '036a90c902be43e0bdc2547278d94c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c2436609c447e1b55d203ac00bf880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:56.294415 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-757c1e4f-8587-4ceb-857e-1fe045b67ba5 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] 10.222.0.58 "GET /compute/v2.1/servers/f3c2dd22-f9d5-4649-9fc4-b3befdf6b8fc" status: 200 len: 1409 microversion: 2.54 time: 0.322834 Aug 10 23:22:56.296101 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2493/5198] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:22:55 2022] GET /compute/v2.1/servers/f3c2dd22-f9d5-4649-9fc4-b3befdf6b8fc => generated 1409 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 23:22:56.740219 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-e965cb4e-842b-4561-a272-0a706e10e334 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] Calling method '.version_select at 0x7f847d412a60>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:56.752787 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=4 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:22:56.785105 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-e965cb4e-842b-4561-a272-0a706e10e334 tempest-TestNetworkAdvancedServerOps-1591694610 tempest-TestNetworkAdvancedServerOps-1591694610-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1298960212" status: 202 len: 0 microversion: 2.1 time: 0.049270 Aug 10 23:22:56.785712 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2706/5199] 10.222.0.58 () {58 vars in 1284 bytes} [Wed Aug 10 23:22:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1298960212 => generated 0 bytes in 51 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:22:56.924134 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-a36f4cb3-2912-43ef-b9ca-4c6e1bfa05de tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:56.926022 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-a36f4cb3-2912-43ef-b9ca-4c6e1bfa05de tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] [instance: 2646d3d8-2541-4dbf-9b0f-5eb122ca1452] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:56.931825 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=4 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:22:56.933078 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=20 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:22:56.935950 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a36f4cb3-2912-43ef-b9ca-4c6e1bfa05de tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:56.936725 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a36f4cb3-2912-43ef-b9ca-4c6e1bfa05de tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:56.937494 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a36f4cb3-2912-43ef-b9ca-4c6e1bfa05de tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:56.938560 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a36f4cb3-2912-43ef-b9ca-4c6e1bfa05de tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:56.939264 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a36f4cb3-2912-43ef-b9ca-4c6e1bfa05de tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:56.940243 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a36f4cb3-2912-43ef-b9ca-4c6e1bfa05de tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:57.149942 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-a36f4cb3-2912-43ef-b9ca-4c6e1bfa05de tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d89081084f14e0187f4c67cd9185fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b557edd165144c8943eb9acc339a377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:57.162429 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-a36f4cb3-2912-43ef-b9ca-4c6e1bfa05de tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] 10.222.0.58 "GET /compute/v2.1/servers/2646d3d8-2541-4dbf-9b0f-5eb122ca1452" status: 200 len: 1368 microversion: 2.1 time: 0.240767 Aug 10 23:22:57.163071 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2494/5200] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:22:56 2022] GET /compute/v2.1/servers/2646d3d8-2541-4dbf-9b0f-5eb122ca1452 => generated 1368 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:22:57.261669 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-754a6e75-f23b-4b26-b309-3442ecbb9c81 req-c7601b66-5bc2-4d16-9b1d-669f49b4ac25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2646d3d8-2541-4dbf-9b0f-5eb122ca1452", "name": "network-vif-plugged", "status": "completed", "tag": "98a6e2a1-4551-40ba-ae20-1d39116fefc4"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:22:57.279359 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-1ef5c40b-d285-4f0e-a786-06808a568c91 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:57.280059 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-1ef5c40b-d285-4f0e-a786-06808a568c91 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] [instance: 7e091da3-0636-4cba-b8de-94fdeecf0b7f] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:57.315064 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1ef5c40b-d285-4f0e-a786-06808a568c91 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:57.316037 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1ef5c40b-d285-4f0e-a786-06808a568c91 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:57.316684 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1ef5c40b-d285-4f0e-a786-06808a568c91 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:57.317729 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1ef5c40b-d285-4f0e-a786-06808a568c91 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:57.318368 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1ef5c40b-d285-4f0e-a786-06808a568c91 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:57.319014 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1ef5c40b-d285-4f0e-a786-06808a568c91 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:57.326943 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-754a6e75-f23b-4b26-b309-3442ecbb9c81 req-c7601b66-5bc2-4d16-9b1d-669f49b4ac25 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:57.327472 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-754a6e75-f23b-4b26-b309-3442ecbb9c81 req-c7601b66-5bc2-4d16-9b1d-669f49b4ac25 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:57.327914 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-754a6e75-f23b-4b26-b309-3442ecbb9c81 req-c7601b66-5bc2-4d16-9b1d-669f49b4ac25 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:57.361446 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-754a6e75-f23b-4b26-b309-3442ecbb9c81 req-c7601b66-5bc2-4d16-9b1d-669f49b4ac25 service nova] Creating event network-vif-plugged:98a6e2a1-4551-40ba-ae20-1d39116fefc4 for instance 2646d3d8-2541-4dbf-9b0f-5eb122ca1452 on n-h2-850468-14 Aug 10 23:22:57.372311 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-754a6e75-f23b-4b26-b309-3442ecbb9c81 req-c7601b66-5bc2-4d16-9b1d-669f49b4ac25 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114509 Aug 10 23:22:57.372921 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2707/5201] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:22:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:22:57.389378 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-7130ec3c-024d-41fa-91e6-010689447fd5 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:57.390523 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-7130ec3c-024d-41fa-91e6-010689447fd5 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] [instance: f3c2dd22-f9d5-4649-9fc4-b3befdf6b8fc] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:57.397420 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7130ec3c-024d-41fa-91e6-010689447fd5 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:57.398130 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7130ec3c-024d-41fa-91e6-010689447fd5 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:57.398768 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7130ec3c-024d-41fa-91e6-010689447fd5 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:57.400038 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7130ec3c-024d-41fa-91e6-010689447fd5 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:57.400676 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7130ec3c-024d-41fa-91e6-010689447fd5 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:57.401402 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7130ec3c-024d-41fa-91e6-010689447fd5 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:57.553698 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-7130ec3c-024d-41fa-91e6-010689447fd5 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036a90c902be43e0bdc2547278d94c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c2436609c447e1b55d203ac00bf880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:57.569219 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-7130ec3c-024d-41fa-91e6-010689447fd5 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '036a90c902be43e0bdc2547278d94c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c2436609c447e1b55d203ac00bf880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:57.571779 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-7130ec3c-024d-41fa-91e6-010689447fd5 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '036a90c902be43e0bdc2547278d94c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c2436609c447e1b55d203ac00bf880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:57.577079 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-7130ec3c-024d-41fa-91e6-010689447fd5 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] 10.222.0.58 "GET /compute/v2.1/servers/f3c2dd22-f9d5-4649-9fc4-b3befdf6b8fc" status: 200 len: 1409 microversion: 2.54 time: 0.198977 Aug 10 23:22:57.578621 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2708/5202] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:22:57 2022] GET /compute/v2.1/servers/f3c2dd22-f9d5-4649-9fc4-b3befdf6b8fc => generated 1409 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:22:57.865302 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-3683cfc2-6e89-4021-9a9d-d1a8adcfd26c req-71944246-3a9b-4cc0-b907-075f9fd7dfbc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e091da3-0636-4cba-b8de-94fdeecf0b7f", "name": "network-vif-deleted", "tag": "15a1ebf2-6257-4511-9a21-1f5f62d2bad4"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:22:57.872528 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-1ef5c40b-d285-4f0e-a786-06808a568c91 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:57.891334 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-3683cfc2-6e89-4021-9a9d-d1a8adcfd26c req-71944246-3a9b-4cc0-b907-075f9fd7dfbc service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:57.894775 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-1ef5c40b-d285-4f0e-a786-06808a568c91 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:57.895302 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-3683cfc2-6e89-4021-9a9d-d1a8adcfd26c req-71944246-3a9b-4cc0-b907-075f9fd7dfbc service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:57.895764 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-3683cfc2-6e89-4021-9a9d-d1a8adcfd26c req-71944246-3a9b-4cc0-b907-075f9fd7dfbc service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:57.895885 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-1ef5c40b-d285-4f0e-a786-06808a568c91 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:57.897088 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-1ef5c40b-d285-4f0e-a786-06808a568c91 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] 10.222.0.58 "GET /compute/v2.1/servers/7e091da3-0636-4cba-b8de-94fdeecf0b7f" status: 200 len: 2911 microversion: 2.32 time: 0.623323 Aug 10 23:22:57.897788 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2495/5203] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:22:57 2022] GET /compute/v2.1/servers/7e091da3-0636-4cba-b8de-94fdeecf0b7f => generated 2911 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 23:22:57.921439 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-3683cfc2-6e89-4021-9a9d-d1a8adcfd26c req-71944246-3a9b-4cc0-b907-075f9fd7dfbc service nova] Creating event network-vif-deleted:15a1ebf2-6257-4511-9a21-1f5f62d2bad4 for instance 7e091da3-0636-4cba-b8de-94fdeecf0b7f on n-h1-850468-14 Aug 10 23:22:57.929687 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-3683cfc2-6e89-4021-9a9d-d1a8adcfd26c req-71944246-3a9b-4cc0-b907-075f9fd7dfbc service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070280 Aug 10 23:22:57.933020 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2709/5204] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:22:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 23:22:58.187906 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-8a7de5a9-5044-4b1e-8d2a-77b88a2720a5 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:58.189201 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-8a7de5a9-5044-4b1e-8d2a-77b88a2720a5 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] [instance: 2646d3d8-2541-4dbf-9b0f-5eb122ca1452] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:58.204593 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8a7de5a9-5044-4b1e-8d2a-77b88a2720a5 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:58.205464 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8a7de5a9-5044-4b1e-8d2a-77b88a2720a5 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:58.206098 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8a7de5a9-5044-4b1e-8d2a-77b88a2720a5 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:58.207112 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8a7de5a9-5044-4b1e-8d2a-77b88a2720a5 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:58.207744 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8a7de5a9-5044-4b1e-8d2a-77b88a2720a5 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:58.209499 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8a7de5a9-5044-4b1e-8d2a-77b88a2720a5 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:58.603572 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-ff58192f-c530-41bb-b121-84a815261bbe tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:58.609758 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-ff58192f-c530-41bb-b121-84a815261bbe tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] [instance: f3c2dd22-f9d5-4649-9fc4-b3befdf6b8fc] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:58.630066 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ff58192f-c530-41bb-b121-84a815261bbe tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:58.631251 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ff58192f-c530-41bb-b121-84a815261bbe tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:58.632110 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ff58192f-c530-41bb-b121-84a815261bbe tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:58.633080 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ff58192f-c530-41bb-b121-84a815261bbe tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:58.633760 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ff58192f-c530-41bb-b121-84a815261bbe tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:58.634413 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ff58192f-c530-41bb-b121-84a815261bbe tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:58.785121 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-8a7de5a9-5044-4b1e-8d2a-77b88a2720a5 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d89081084f14e0187f4c67cd9185fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b557edd165144c8943eb9acc339a377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:58.807620 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-8a7de5a9-5044-4b1e-8d2a-77b88a2720a5 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] 10.222.0.58 "GET /compute/v2.1/servers/2646d3d8-2541-4dbf-9b0f-5eb122ca1452" status: 200 len: 1368 microversion: 2.1 time: 0.611882 Aug 10 23:22:58.807620 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2496/5205] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:22:58 2022] GET /compute/v2.1/servers/2646d3d8-2541-4dbf-9b0f-5eb122ca1452 => generated 1368 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:22:58.868017 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-ff58192f-c530-41bb-b121-84a815261bbe tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036a90c902be43e0bdc2547278d94c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c2436609c447e1b55d203ac00bf880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:58.881298 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-ff58192f-c530-41bb-b121-84a815261bbe tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '036a90c902be43e0bdc2547278d94c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c2436609c447e1b55d203ac00bf880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:58.887088 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-ff58192f-c530-41bb-b121-84a815261bbe tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '036a90c902be43e0bdc2547278d94c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c2436609c447e1b55d203ac00bf880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:58.893076 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-ff58192f-c530-41bb-b121-84a815261bbe tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] 10.222.0.58 "GET /compute/v2.1/servers/f3c2dd22-f9d5-4649-9fc4-b3befdf6b8fc" status: 200 len: 1409 microversion: 2.54 time: 0.290102 Aug 10 23:22:58.907844 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2710/5206] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:22:58 2022] GET /compute/v2.1/servers/f3c2dd22-f9d5-4649-9fc4-b3befdf6b8fc => generated 1409 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:22:58.925360 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-ebe86a8e-9f07-4f0c-863d-45875b1b4ab2 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:58.926112 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-ebe86a8e-9f07-4f0c-863d-45875b1b4ab2 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] [instance: 7e091da3-0636-4cba-b8de-94fdeecf0b7f] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:58.956200 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ebe86a8e-9f07-4f0c-863d-45875b1b4ab2 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:58.956888 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ebe86a8e-9f07-4f0c-863d-45875b1b4ab2 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:58.957538 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ebe86a8e-9f07-4f0c-863d-45875b1b4ab2 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:58.961093 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ebe86a8e-9f07-4f0c-863d-45875b1b4ab2 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:58.961802 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ebe86a8e-9f07-4f0c-863d-45875b1b4ab2 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:58.967791 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ebe86a8e-9f07-4f0c-863d-45875b1b4ab2 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:59.387654 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-e132f2af-9c08-4f28-8a99-7b0a3be7383a req-2080c56d-b4b5-4071-8f45-b629e429727b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e091da3-0636-4cba-b8de-94fdeecf0b7f", "name": "network-vif-unplugged", "status": "completed", "tag": "e33f8996-1d01-4809-ae73-234bdbbc3c3f"}, {"server_uuid": "7e091da3-0636-4cba-b8de-94fdeecf0b7f", "name": "network-vif-unplugged", "status": "completed", "tag": "06a5a1f3-cec1-4f39-b897-ff685f8485fa"}, {"server_uuid": "7e091da3-0636-4cba-b8de-94fdeecf0b7f", "name": "network-vif-unplugged", "status": "completed", "tag": "7dab50f5-321c-4571-bb72-8c2a4a681492"}, {"server_uuid": "7e091da3-0636-4cba-b8de-94fdeecf0b7f", "name": "network-vif-unplugged", "status": "completed", "tag": "a65ed440-a31b-429f-8aa3-2fb86a09c770"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:22:59.405895 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-e132f2af-9c08-4f28-8a99-7b0a3be7383a req-2080c56d-b4b5-4071-8f45-b629e429727b service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:59.407186 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-e132f2af-9c08-4f28-8a99-7b0a3be7383a req-2080c56d-b4b5-4071-8f45-b629e429727b service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:59.407746 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-e132f2af-9c08-4f28-8a99-7b0a3be7383a req-2080c56d-b4b5-4071-8f45-b629e429727b service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:59.426132 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-e132f2af-9c08-4f28-8a99-7b0a3be7383a req-2080c56d-b4b5-4071-8f45-b629e429727b service nova] Creating event network-vif-unplugged:e33f8996-1d01-4809-ae73-234bdbbc3c3f for instance 7e091da3-0636-4cba-b8de-94fdeecf0b7f on n-h1-850468-14 Aug 10 23:22:59.427384 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-e132f2af-9c08-4f28-8a99-7b0a3be7383a req-2080c56d-b4b5-4071-8f45-b629e429727b service nova] Creating event network-vif-unplugged:06a5a1f3-cec1-4f39-b897-ff685f8485fa for instance 7e091da3-0636-4cba-b8de-94fdeecf0b7f on n-h1-850468-14 Aug 10 23:22:59.428159 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-e132f2af-9c08-4f28-8a99-7b0a3be7383a req-2080c56d-b4b5-4071-8f45-b629e429727b service nova] Creating event network-vif-unplugged:7dab50f5-321c-4571-bb72-8c2a4a681492 for instance 7e091da3-0636-4cba-b8de-94fdeecf0b7f on n-h1-850468-14 Aug 10 23:22:59.429119 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-e132f2af-9c08-4f28-8a99-7b0a3be7383a req-2080c56d-b4b5-4071-8f45-b629e429727b service nova] Creating event network-vif-unplugged:a65ed440-a31b-429f-8aa3-2fb86a09c770 for instance 7e091da3-0636-4cba-b8de-94fdeecf0b7f on n-h1-850468-14 Aug 10 23:22:59.438239 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-e132f2af-9c08-4f28-8a99-7b0a3be7383a req-2080c56d-b4b5-4071-8f45-b629e429727b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 704 microversion: 2.1 time: 0.054536 Aug 10 23:22:59.439873 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2711/5207] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:22:59 2022] POST /compute/v2.1/os-server-external-events => generated 704 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 23:22:59.733419 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-ebe86a8e-9f07-4f0c-863d-45875b1b4ab2 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:59.757066 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-ebe86a8e-9f07-4f0c-863d-45875b1b4ab2 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:59.759673 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-ebe86a8e-9f07-4f0c-863d-45875b1b4ab2 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:22:59.767273 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-ebe86a8e-9f07-4f0c-863d-45875b1b4ab2 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] 10.222.0.58 "GET /compute/v2.1/servers/7e091da3-0636-4cba-b8de-94fdeecf0b7f" status: 200 len: 2705 microversion: 2.32 time: 0.845939 Aug 10 23:22:59.772966 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2497/5208] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:22:58 2022] GET /compute/v2.1/servers/7e091da3-0636-4cba-b8de-94fdeecf0b7f => generated 2705 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:22:59.831844 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-9a4a0c09-83b2-4363-9143-4bf84434cc5f tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:59.833598 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-9a4a0c09-83b2-4363-9143-4bf84434cc5f tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] [instance: 2646d3d8-2541-4dbf-9b0f-5eb122ca1452] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:59.853143 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9a4a0c09-83b2-4363-9143-4bf84434cc5f tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:59.853733 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9a4a0c09-83b2-4363-9143-4bf84434cc5f tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:59.854864 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9a4a0c09-83b2-4363-9143-4bf84434cc5f tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:59.862990 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9a4a0c09-83b2-4363-9143-4bf84434cc5f tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:59.863782 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9a4a0c09-83b2-4363-9143-4bf84434cc5f tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:59.868947 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9a4a0c09-83b2-4363-9143-4bf84434cc5f tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:59.922024 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-5cce97f7-7792-4316-9dd7-50ae52ee51b6 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:22:59.922952 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-5cce97f7-7792-4316-9dd7-50ae52ee51b6 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] [instance: f3c2dd22-f9d5-4649-9fc4-b3befdf6b8fc] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:22:59.932375 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5cce97f7-7792-4316-9dd7-50ae52ee51b6 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:59.944102 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5cce97f7-7792-4316-9dd7-50ae52ee51b6 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:59.944565 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5cce97f7-7792-4316-9dd7-50ae52ee51b6 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:22:59.948268 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5cce97f7-7792-4316-9dd7-50ae52ee51b6 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:22:59.948750 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5cce97f7-7792-4316-9dd7-50ae52ee51b6 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:22:59.949190 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5cce97f7-7792-4316-9dd7-50ae52ee51b6 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:00.153395 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-5cce97f7-7792-4316-9dd7-50ae52ee51b6 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036a90c902be43e0bdc2547278d94c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c2436609c447e1b55d203ac00bf880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:00.176291 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-5cce97f7-7792-4316-9dd7-50ae52ee51b6 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '036a90c902be43e0bdc2547278d94c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c2436609c447e1b55d203ac00bf880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:00.186527 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-5cce97f7-7792-4316-9dd7-50ae52ee51b6 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '036a90c902be43e0bdc2547278d94c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c2436609c447e1b55d203ac00bf880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:00.193624 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-5cce97f7-7792-4316-9dd7-50ae52ee51b6 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] 10.222.0.58 "GET /compute/v2.1/servers/f3c2dd22-f9d5-4649-9fc4-b3befdf6b8fc" status: 200 len: 1409 microversion: 2.54 time: 0.273561 Aug 10 23:23:00.199304 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2498/5209] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:22:59 2022] GET /compute/v2.1/servers/f3c2dd22-f9d5-4649-9fc4-b3befdf6b8fc => generated 1409 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 23:23:00.221680 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-677bc101-7122-461d-83bc-a90838faac23 req-5747629e-f407-4f66-8a6d-898bab2656f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e091da3-0636-4cba-b8de-94fdeecf0b7f", "name": "network-vif-deleted", "tag": "7dab50f5-321c-4571-bb72-8c2a4a681492"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:23:00.232963 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-677bc101-7122-461d-83bc-a90838faac23 req-5747629e-f407-4f66-8a6d-898bab2656f2 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:00.234459 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-677bc101-7122-461d-83bc-a90838faac23 req-5747629e-f407-4f66-8a6d-898bab2656f2 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:00.234957 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-677bc101-7122-461d-83bc-a90838faac23 req-5747629e-f407-4f66-8a6d-898bab2656f2 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:00.247777 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-677bc101-7122-461d-83bc-a90838faac23 req-5747629e-f407-4f66-8a6d-898bab2656f2 service nova] Creating event network-vif-deleted:7dab50f5-321c-4571-bb72-8c2a4a681492 for instance 7e091da3-0636-4cba-b8de-94fdeecf0b7f on n-h1-850468-14 Aug 10 23:23:00.256857 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-677bc101-7122-461d-83bc-a90838faac23 req-5747629e-f407-4f66-8a6d-898bab2656f2 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055767 Aug 10 23:23:00.257839 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2499/5210] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:23:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:23:00.383795 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-9a4a0c09-83b2-4363-9143-4bf84434cc5f tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d89081084f14e0187f4c67cd9185fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b557edd165144c8943eb9acc339a377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:00.402023 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-9a4a0c09-83b2-4363-9143-4bf84434cc5f tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] 10.222.0.58 "GET /compute/v2.1/servers/2646d3d8-2541-4dbf-9b0f-5eb122ca1452" status: 200 len: 1558 microversion: 2.1 time: 0.579422 Aug 10 23:23:00.402950 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2712/5211] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:22:59 2022] GET /compute/v2.1/servers/2646d3d8-2541-4dbf-9b0f-5eb122ca1452 => generated 1558 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:23:00.430038 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-3699465a-bee2-4d83-a2a6-bf17aa48ccea tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:23:00.430933 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-3699465a-bee2-4d83-a2a6-bf17aa48ccea tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] [instance: 2646d3d8-2541-4dbf-9b0f-5eb122ca1452] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:23:00.446663 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3699465a-bee2-4d83-a2a6-bf17aa48ccea tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:00.449316 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3699465a-bee2-4d83-a2a6-bf17aa48ccea tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:00.449759 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3699465a-bee2-4d83-a2a6-bf17aa48ccea tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:00.454895 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3699465a-bee2-4d83-a2a6-bf17aa48ccea tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:00.458175 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3699465a-bee2-4d83-a2a6-bf17aa48ccea tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:00.459872 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3699465a-bee2-4d83-a2a6-bf17aa48ccea tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:00.803538 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-3a50fc57-4cfb-4116-86ca-bbfe23ed01e4 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:23:00.804773 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-3a50fc57-4cfb-4116-86ca-bbfe23ed01e4 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] [instance: 7e091da3-0636-4cba-b8de-94fdeecf0b7f] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:23:00.813941 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3a50fc57-4cfb-4116-86ca-bbfe23ed01e4 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:00.815048 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3a50fc57-4cfb-4116-86ca-bbfe23ed01e4 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:00.815737 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3a50fc57-4cfb-4116-86ca-bbfe23ed01e4 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:00.819409 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3a50fc57-4cfb-4116-86ca-bbfe23ed01e4 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:00.820234 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3a50fc57-4cfb-4116-86ca-bbfe23ed01e4 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:00.821163 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3a50fc57-4cfb-4116-86ca-bbfe23ed01e4 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:00.823223 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-3699465a-bee2-4d83-a2a6-bf17aa48ccea tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] 10.222.0.58 "GET /compute/v2.1/servers/2646d3d8-2541-4dbf-9b0f-5eb122ca1452/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.398081 Aug 10 23:23:00.824095 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2500/5212] 10.222.0.58 () {58 vars in 1275 bytes} [Wed Aug 10 23:23:00 2022] GET /compute/v2.1/servers/2646d3d8-2541-4dbf-9b0f-5eb122ca1452/os-interface => generated 284 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:23:01.219930 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-4965fbbc-17d6-407a-8a72-456a688e752c tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:23:01.220541 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-4965fbbc-17d6-407a-8a72-456a688e752c tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] [instance: f3c2dd22-f9d5-4649-9fc4-b3befdf6b8fc] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:23:01.229303 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4965fbbc-17d6-407a-8a72-456a688e752c tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:01.230168 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4965fbbc-17d6-407a-8a72-456a688e752c tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:01.230372 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4965fbbc-17d6-407a-8a72-456a688e752c tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:01.250509 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4965fbbc-17d6-407a-8a72-456a688e752c tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:01.251174 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4965fbbc-17d6-407a-8a72-456a688e752c tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:01.252930 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4965fbbc-17d6-407a-8a72-456a688e752c tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:01.266624 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-3a50fc57-4cfb-4116-86ca-bbfe23ed01e4 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:01.294670 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-3a50fc57-4cfb-4116-86ca-bbfe23ed01e4 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:01.303817 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-3a50fc57-4cfb-4116-86ca-bbfe23ed01e4 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:01.305411 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-3a50fc57-4cfb-4116-86ca-bbfe23ed01e4 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] 10.222.0.58 "GET /compute/v2.1/servers/7e091da3-0636-4cba-b8de-94fdeecf0b7f" status: 200 len: 2372 microversion: 2.32 time: 0.510018 Aug 10 23:23:01.320291 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2713/5213] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:23:00 2022] GET /compute/v2.1/servers/7e091da3-0636-4cba-b8de-94fdeecf0b7f => generated 2372 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:23:01.380951 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-4965fbbc-17d6-407a-8a72-456a688e752c tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036a90c902be43e0bdc2547278d94c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c2436609c447e1b55d203ac00bf880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:01.398565 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-4965fbbc-17d6-407a-8a72-456a688e752c tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '036a90c902be43e0bdc2547278d94c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c2436609c447e1b55d203ac00bf880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:01.400364 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-4965fbbc-17d6-407a-8a72-456a688e752c tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '036a90c902be43e0bdc2547278d94c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c2436609c447e1b55d203ac00bf880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:01.403065 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-4965fbbc-17d6-407a-8a72-456a688e752c tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] 10.222.0.58 "GET /compute/v2.1/servers/f3c2dd22-f9d5-4649-9fc4-b3befdf6b8fc" status: 200 len: 1409 microversion: 2.54 time: 0.186638 Aug 10 23:23:01.405733 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2501/5214] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:23:01 2022] GET /compute/v2.1/servers/f3c2dd22-f9d5-4649-9fc4-b3befdf6b8fc => generated 1409 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:23:02.286473 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-7385b459-1f50-4f3a-a7c6-84013171ef91 req-ded96f2d-4393-4162-84b0-5fdef948253f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e091da3-0636-4cba-b8de-94fdeecf0b7f", "name": "network-vif-deleted", "tag": "e33f8996-1d01-4809-ae73-234bdbbc3c3f"}, {"server_uuid": "7e091da3-0636-4cba-b8de-94fdeecf0b7f", "name": "network-vif-deleted", "tag": "a65ed440-a31b-429f-8aa3-2fb86a09c770"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:23:02.304440 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-7385b459-1f50-4f3a-a7c6-84013171ef91 req-ded96f2d-4393-4162-84b0-5fdef948253f service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:02.304940 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-7385b459-1f50-4f3a-a7c6-84013171ef91 req-ded96f2d-4393-4162-84b0-5fdef948253f service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:02.305382 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-7385b459-1f50-4f3a-a7c6-84013171ef91 req-ded96f2d-4393-4162-84b0-5fdef948253f service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:02.335325 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-7385b459-1f50-4f3a-a7c6-84013171ef91 req-ded96f2d-4393-4162-84b0-5fdef948253f service nova] Creating event network-vif-deleted:e33f8996-1d01-4809-ae73-234bdbbc3c3f for instance 7e091da3-0636-4cba-b8de-94fdeecf0b7f on n-h1-850468-14 Aug 10 23:23:02.335839 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-7385b459-1f50-4f3a-a7c6-84013171ef91 req-ded96f2d-4393-4162-84b0-5fdef948253f service nova] Creating event network-vif-deleted:a65ed440-a31b-429f-8aa3-2fb86a09c770 for instance 7e091da3-0636-4cba-b8de-94fdeecf0b7f on n-h1-850468-14 Aug 10 23:23:02.338096 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-090dbc68-4be8-4ea8-a27f-8bbd9b6c1b7b tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:23:02.339673 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-090dbc68-4be8-4ea8-a27f-8bbd9b6c1b7b tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] [instance: 7e091da3-0636-4cba-b8de-94fdeecf0b7f] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:23:02.352957 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-090dbc68-4be8-4ea8-a27f-8bbd9b6c1b7b tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:02.353454 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-090dbc68-4be8-4ea8-a27f-8bbd9b6c1b7b tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:02.353684 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-7385b459-1f50-4f3a-a7c6-84013171ef91 req-ded96f2d-4393-4162-84b0-5fdef948253f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.069335 Aug 10 23:23:02.353903 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-090dbc68-4be8-4ea8-a27f-8bbd9b6c1b7b tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:02.359914 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2714/5215] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:23:02 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:23:02.363881 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-090dbc68-4be8-4ea8-a27f-8bbd9b6c1b7b tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:02.364389 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-090dbc68-4be8-4ea8-a27f-8bbd9b6c1b7b tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:02.364839 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-090dbc68-4be8-4ea8-a27f-8bbd9b6c1b7b tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:02.431273 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-71ff68d3-2f60-4fa9-af0c-e69ef9470f28 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:23:02.432042 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-71ff68d3-2f60-4fa9-af0c-e69ef9470f28 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] [instance: f3c2dd22-f9d5-4649-9fc4-b3befdf6b8fc] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:23:02.450670 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-71ff68d3-2f60-4fa9-af0c-e69ef9470f28 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:02.455153 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-71ff68d3-2f60-4fa9-af0c-e69ef9470f28 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:02.458738 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-71ff68d3-2f60-4fa9-af0c-e69ef9470f28 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:02.459958 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-71ff68d3-2f60-4fa9-af0c-e69ef9470f28 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:02.461788 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-71ff68d3-2f60-4fa9-af0c-e69ef9470f28 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:02.462890 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-71ff68d3-2f60-4fa9-af0c-e69ef9470f28 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:02.528183 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=100 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:23:02.773079 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-090dbc68-4be8-4ea8-a27f-8bbd9b6c1b7b tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:02.773985 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-71ff68d3-2f60-4fa9-af0c-e69ef9470f28 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036a90c902be43e0bdc2547278d94c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c2436609c447e1b55d203ac00bf880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:02.784206 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-71ff68d3-2f60-4fa9-af0c-e69ef9470f28 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '036a90c902be43e0bdc2547278d94c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c2436609c447e1b55d203ac00bf880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:02.784920 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-090dbc68-4be8-4ea8-a27f-8bbd9b6c1b7b tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:02.786942 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-090dbc68-4be8-4ea8-a27f-8bbd9b6c1b7b tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:02.788613 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-090dbc68-4be8-4ea8-a27f-8bbd9b6c1b7b tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] 10.222.0.58 "GET /compute/v2.1/servers/7e091da3-0636-4cba-b8de-94fdeecf0b7f" status: 200 len: 2212 microversion: 2.32 time: 0.455077 Aug 10 23:23:02.790263 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2502/5216] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:23:02 2022] GET /compute/v2.1/servers/7e091da3-0636-4cba-b8de-94fdeecf0b7f => generated 2212 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 23:23:02.802980 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-71ff68d3-2f60-4fa9-af0c-e69ef9470f28 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '036a90c902be43e0bdc2547278d94c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c2436609c447e1b55d203ac00bf880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:02.804685 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-71ff68d3-2f60-4fa9-af0c-e69ef9470f28 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] 10.222.0.58 "GET /compute/v2.1/servers/f3c2dd22-f9d5-4649-9fc4-b3befdf6b8fc" status: 200 len: 1409 microversion: 2.54 time: 0.378788 Aug 10 23:23:02.811049 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2715/5217] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:23:02 2022] GET /compute/v2.1/servers/f3c2dd22-f9d5-4649-9fc4-b3befdf6b8fc => generated 1409 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:23:02.897962 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-10a423dc-a173-4717-b7f2-a4b7658dfc44 req-5717f7e2-3e59-4e75-955b-3b5d8dba3cda service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2646d3d8-2541-4dbf-9b0f-5eb122ca1452", "tag": "98a6e2a1-4551-40ba-ae20-1d39116fefc4"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:23:02.919577 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-10a423dc-a173-4717-b7f2-a4b7658dfc44 req-5717f7e2-3e59-4e75-955b-3b5d8dba3cda service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:02.922466 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-10a423dc-a173-4717-b7f2-a4b7658dfc44 req-5717f7e2-3e59-4e75-955b-3b5d8dba3cda service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:02.924274 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-10a423dc-a173-4717-b7f2-a4b7658dfc44 req-5717f7e2-3e59-4e75-955b-3b5d8dba3cda service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:02.967914 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-10a423dc-a173-4717-b7f2-a4b7658dfc44 req-5717f7e2-3e59-4e75-955b-3b5d8dba3cda service nova] Creating event network-changed:98a6e2a1-4551-40ba-ae20-1d39116fefc4 for instance 2646d3d8-2541-4dbf-9b0f-5eb122ca1452 on n-h2-850468-14 Aug 10 23:23:02.980521 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-10a423dc-a173-4717-b7f2-a4b7658dfc44 req-5717f7e2-3e59-4e75-955b-3b5d8dba3cda service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086431 Aug 10 23:23:02.984784 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2503/5218] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:23:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:23:03.818261 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-4e2c4c41-edd8-494d-b93e-db92e48e0284 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:23:03.818860 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-4e2c4c41-edd8-494d-b93e-db92e48e0284 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] [instance: 7e091da3-0636-4cba-b8de-94fdeecf0b7f] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:23:03.833121 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4e2c4c41-edd8-494d-b93e-db92e48e0284 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:03.835850 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-7d344ebc-8dc0-4064-badb-34e70a0b8e92 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:23:03.837112 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-7d344ebc-8dc0-4064-badb-34e70a0b8e92 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] [instance: f3c2dd22-f9d5-4649-9fc4-b3befdf6b8fc] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:23:03.839774 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4e2c4c41-edd8-494d-b93e-db92e48e0284 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:03.840229 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4e2c4c41-edd8-494d-b93e-db92e48e0284 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:03.844378 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4e2c4c41-edd8-494d-b93e-db92e48e0284 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:03.845549 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4e2c4c41-edd8-494d-b93e-db92e48e0284 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:03.849107 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4e2c4c41-edd8-494d-b93e-db92e48e0284 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:03.856537 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7d344ebc-8dc0-4064-badb-34e70a0b8e92 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:03.857035 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7d344ebc-8dc0-4064-badb-34e70a0b8e92 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:03.857472 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7d344ebc-8dc0-4064-badb-34e70a0b8e92 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:03.871202 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7d344ebc-8dc0-4064-badb-34e70a0b8e92 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:03.871798 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7d344ebc-8dc0-4064-badb-34e70a0b8e92 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:03.872247 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7d344ebc-8dc0-4064-badb-34e70a0b8e92 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:04.212705 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-4e2c4c41-edd8-494d-b93e-db92e48e0284 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:04.222718 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-4e2c4c41-edd8-494d-b93e-db92e48e0284 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:04.233812 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-4e2c4c41-edd8-494d-b93e-db92e48e0284 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:04.235138 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-4e2c4c41-edd8-494d-b93e-db92e48e0284 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] 10.222.0.58 "GET /compute/v2.1/servers/7e091da3-0636-4cba-b8de-94fdeecf0b7f" status: 200 len: 1605 microversion: 2.32 time: 0.421354 Aug 10 23:23:04.250646 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-7d344ebc-8dc0-4064-badb-34e70a0b8e92 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036a90c902be43e0bdc2547278d94c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c2436609c447e1b55d203ac00bf880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:04.258470 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2716/5219] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:23:03 2022] GET /compute/v2.1/servers/7e091da3-0636-4cba-b8de-94fdeecf0b7f => generated 1605 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:23:04.262455 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-7d344ebc-8dc0-4064-badb-34e70a0b8e92 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '036a90c902be43e0bdc2547278d94c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c2436609c447e1b55d203ac00bf880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:04.272575 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-7d344ebc-8dc0-4064-badb-34e70a0b8e92 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '036a90c902be43e0bdc2547278d94c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c2436609c447e1b55d203ac00bf880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:04.274125 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-7d344ebc-8dc0-4064-badb-34e70a0b8e92 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] 10.222.0.58 "GET /compute/v2.1/servers/f3c2dd22-f9d5-4649-9fc4-b3befdf6b8fc" status: 200 len: 1409 microversion: 2.54 time: 0.442951 Aug 10 23:23:04.277814 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2504/5220] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:23:03 2022] GET /compute/v2.1/servers/f3c2dd22-f9d5-4649-9fc4-b3befdf6b8fc => generated 1409 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:23:04.449749 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-1f05a535-a568-4a17-9484-d6f9b190ff4b req-a5c67894-21bc-48d4-b50e-0bbbbd444457 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e091da3-0636-4cba-b8de-94fdeecf0b7f", "name": "network-vif-deleted", "tag": "06a5a1f3-cec1-4f39-b897-ff685f8485fa"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:23:04.470833 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-1f05a535-a568-4a17-9484-d6f9b190ff4b req-a5c67894-21bc-48d4-b50e-0bbbbd444457 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:04.471459 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-1f05a535-a568-4a17-9484-d6f9b190ff4b req-a5c67894-21bc-48d4-b50e-0bbbbd444457 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:04.472097 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-1f05a535-a568-4a17-9484-d6f9b190ff4b req-a5c67894-21bc-48d4-b50e-0bbbbd444457 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:04.492673 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-1f05a535-a568-4a17-9484-d6f9b190ff4b req-a5c67894-21bc-48d4-b50e-0bbbbd444457 service nova] Creating event network-vif-deleted:06a5a1f3-cec1-4f39-b897-ff685f8485fa for instance 7e091da3-0636-4cba-b8de-94fdeecf0b7f on n-h1-850468-14 Aug 10 23:23:04.510083 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-1f05a535-a568-4a17-9484-d6f9b190ff4b req-a5c67894-21bc-48d4-b50e-0bbbbd444457 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062064 Aug 10 23:23:04.513861 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2717/5221] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:23:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:23:05.258812 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-40706feb-50fb-44c9-88ac-3ac1f1fd0bca tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:23:05.259495 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-40706feb-50fb-44c9-88ac-3ac1f1fd0bca tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] [instance: 7e091da3-0636-4cba-b8de-94fdeecf0b7f] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:23:05.273350 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-40706feb-50fb-44c9-88ac-3ac1f1fd0bca tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:05.275603 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-40706feb-50fb-44c9-88ac-3ac1f1fd0bca tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:05.278282 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-40706feb-50fb-44c9-88ac-3ac1f1fd0bca tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:05.279274 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-40706feb-50fb-44c9-88ac-3ac1f1fd0bca tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:05.281247 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-40706feb-50fb-44c9-88ac-3ac1f1fd0bca tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:05.281893 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-40706feb-50fb-44c9-88ac-3ac1f1fd0bca tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:05.309188 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-541a71de-b5b1-4ee4-a7d1-485c344c4e47 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:23:05.310598 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-541a71de-b5b1-4ee4-a7d1-485c344c4e47 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] [instance: f3c2dd22-f9d5-4649-9fc4-b3befdf6b8fc] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:23:05.333325 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-541a71de-b5b1-4ee4-a7d1-485c344c4e47 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:05.335933 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-541a71de-b5b1-4ee4-a7d1-485c344c4e47 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:05.340839 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-541a71de-b5b1-4ee4-a7d1-485c344c4e47 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:05.342422 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-541a71de-b5b1-4ee4-a7d1-485c344c4e47 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:05.344151 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-541a71de-b5b1-4ee4-a7d1-485c344c4e47 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:05.345801 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-541a71de-b5b1-4ee4-a7d1-485c344c4e47 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:05.457446 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-541a71de-b5b1-4ee4-a7d1-485c344c4e47 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036a90c902be43e0bdc2547278d94c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c2436609c447e1b55d203ac00bf880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:05.459690 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-40706feb-50fb-44c9-88ac-3ac1f1fd0bca tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:05.472009 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-40706feb-50fb-44c9-88ac-3ac1f1fd0bca tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:05.474208 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-40706feb-50fb-44c9-88ac-3ac1f1fd0bca tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:05.475456 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-40706feb-50fb-44c9-88ac-3ac1f1fd0bca tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] 10.222.0.58 "GET /compute/v2.1/servers/7e091da3-0636-4cba-b8de-94fdeecf0b7f" status: 200 len: 1605 microversion: 2.32 time: 0.220838 Aug 10 23:23:05.476030 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2505/5222] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:23:05 2022] GET /compute/v2.1/servers/7e091da3-0636-4cba-b8de-94fdeecf0b7f => generated 1605 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:23:05.493673 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-541a71de-b5b1-4ee4-a7d1-485c344c4e47 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '036a90c902be43e0bdc2547278d94c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c2436609c447e1b55d203ac00bf880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:05.496189 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-541a71de-b5b1-4ee4-a7d1-485c344c4e47 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '036a90c902be43e0bdc2547278d94c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c2436609c447e1b55d203ac00bf880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:05.497780 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-541a71de-b5b1-4ee4-a7d1-485c344c4e47 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] 10.222.0.58 "GET /compute/v2.1/servers/f3c2dd22-f9d5-4649-9fc4-b3befdf6b8fc" status: 200 len: 1409 microversion: 2.54 time: 0.193872 Aug 10 23:23:05.498675 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2718/5223] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:23:05 2022] GET /compute/v2.1/servers/f3c2dd22-f9d5-4649-9fc4-b3befdf6b8fc => generated 1409 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 23:23:06.500042 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-151f0280-9215-4528-93b1-5d530c9754a7 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:23:06.500742 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-151f0280-9215-4528-93b1-5d530c9754a7 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] [instance: 7e091da3-0636-4cba-b8de-94fdeecf0b7f] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:23:06.519505 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-151f0280-9215-4528-93b1-5d530c9754a7 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:06.530899 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-151f0280-9215-4528-93b1-5d530c9754a7 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:06.531490 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-aa8b6708-6ea5-4413-b3bc-fc9928bf6162 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:23:06.531942 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-151f0280-9215-4528-93b1-5d530c9754a7 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:06.532140 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-aa8b6708-6ea5-4413-b3bc-fc9928bf6162 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] [instance: f3c2dd22-f9d5-4649-9fc4-b3befdf6b8fc] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:23:06.536963 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-151f0280-9215-4528-93b1-5d530c9754a7 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:06.539236 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-151f0280-9215-4528-93b1-5d530c9754a7 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:06.540757 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-151f0280-9215-4528-93b1-5d530c9754a7 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:06.563849 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-aa8b6708-6ea5-4413-b3bc-fc9928bf6162 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:06.566203 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-aa8b6708-6ea5-4413-b3bc-fc9928bf6162 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:06.567888 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-aa8b6708-6ea5-4413-b3bc-fc9928bf6162 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:06.574729 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-aa8b6708-6ea5-4413-b3bc-fc9928bf6162 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:06.575829 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-aa8b6708-6ea5-4413-b3bc-fc9928bf6162 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:06.576446 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-aa8b6708-6ea5-4413-b3bc-fc9928bf6162 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:06.711956 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-151f0280-9215-4528-93b1-5d530c9754a7 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:06.727802 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-151f0280-9215-4528-93b1-5d530c9754a7 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:06.744144 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-151f0280-9215-4528-93b1-5d530c9754a7 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:06.746853 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-151f0280-9215-4528-93b1-5d530c9754a7 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] 10.222.0.58 "GET /compute/v2.1/servers/7e091da3-0636-4cba-b8de-94fdeecf0b7f" status: 200 len: 1605 microversion: 2.32 time: 0.251044 Aug 10 23:23:06.766818 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2506/5224] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:23:06 2022] GET /compute/v2.1/servers/7e091da3-0636-4cba-b8de-94fdeecf0b7f => generated 1605 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:23:06.818808 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-aa8b6708-6ea5-4413-b3bc-fc9928bf6162 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036a90c902be43e0bdc2547278d94c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c2436609c447e1b55d203ac00bf880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:06.835596 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-aa8b6708-6ea5-4413-b3bc-fc9928bf6162 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '036a90c902be43e0bdc2547278d94c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c2436609c447e1b55d203ac00bf880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:06.842072 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-aa8b6708-6ea5-4413-b3bc-fc9928bf6162 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '036a90c902be43e0bdc2547278d94c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c2436609c447e1b55d203ac00bf880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:06.846142 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-aa8b6708-6ea5-4413-b3bc-fc9928bf6162 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] 10.222.0.58 "GET /compute/v2.1/servers/f3c2dd22-f9d5-4649-9fc4-b3befdf6b8fc" status: 200 len: 1409 microversion: 2.54 time: 0.318508 Aug 10 23:23:06.846766 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2719/5225] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:23:06 2022] GET /compute/v2.1/servers/f3c2dd22-f9d5-4649-9fc4-b3befdf6b8fc => generated 1409 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:23:07.781195 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-f3beb8de-c357-4d47-b17e-173fcce82ffa tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:23:07.783714 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-f3beb8de-c357-4d47-b17e-173fcce82ffa tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] [instance: 7e091da3-0636-4cba-b8de-94fdeecf0b7f] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:23:07.793415 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f3beb8de-c357-4d47-b17e-173fcce82ffa tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:07.794405 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f3beb8de-c357-4d47-b17e-173fcce82ffa tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:07.795119 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f3beb8de-c357-4d47-b17e-173fcce82ffa tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:07.796005 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f3beb8de-c357-4d47-b17e-173fcce82ffa tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:07.796625 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f3beb8de-c357-4d47-b17e-173fcce82ffa tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:07.797319 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f3beb8de-c357-4d47-b17e-173fcce82ffa tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:07.891881 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-f3beb8de-c357-4d47-b17e-173fcce82ffa tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:07.902242 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-f3beb8de-c357-4d47-b17e-173fcce82ffa tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:07.904322 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-f3beb8de-c357-4d47-b17e-173fcce82ffa tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:07.905697 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-f3beb8de-c357-4d47-b17e-173fcce82ffa tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] 10.222.0.58 "GET /compute/v2.1/servers/7e091da3-0636-4cba-b8de-94fdeecf0b7f" status: 200 len: 1605 microversion: 2.32 time: 0.131309 Aug 10 23:23:07.906378 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2720/5226] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:23:07 2022] GET /compute/v2.1/servers/7e091da3-0636-4cba-b8de-94fdeecf0b7f => generated 1605 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 23:23:07.928522 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-35425f17-6385-440f-953b-d82b3020a1c3 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:23:07.929362 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-35425f17-6385-440f-953b-d82b3020a1c3 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] [instance: f3c2dd22-f9d5-4649-9fc4-b3befdf6b8fc] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:23:07.936472 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-35425f17-6385-440f-953b-d82b3020a1c3 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:07.937117 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-35425f17-6385-440f-953b-d82b3020a1c3 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:07.937831 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-35425f17-6385-440f-953b-d82b3020a1c3 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:07.939163 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-35425f17-6385-440f-953b-d82b3020a1c3 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:07.939936 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-35425f17-6385-440f-953b-d82b3020a1c3 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:07.940843 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-35425f17-6385-440f-953b-d82b3020a1c3 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:08.027823 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c7502e99-48b7-4edb-90c8-4c478cd62ba2 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-1763580938", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452", "networks": [{"uuid": "e82cadd8-589a-4efd-bf88-06c2dfbf68ef"}]}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:23:08.032603 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-35425f17-6385-440f-953b-d82b3020a1c3 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036a90c902be43e0bdc2547278d94c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c2436609c447e1b55d203ac00bf880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:08.042271 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-35425f17-6385-440f-953b-d82b3020a1c3 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '036a90c902be43e0bdc2547278d94c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c2436609c447e1b55d203ac00bf880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:08.045096 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-35425f17-6385-440f-953b-d82b3020a1c3 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '036a90c902be43e0bdc2547278d94c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c2436609c447e1b55d203ac00bf880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:08.046495 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-35425f17-6385-440f-953b-d82b3020a1c3 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] 10.222.0.58 "GET /compute/v2.1/servers/f3c2dd22-f9d5-4649-9fc4-b3befdf6b8fc" status: 200 len: 1409 microversion: 2.54 time: 0.121876 Aug 10 23:23:08.047414 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2721/5227] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:23:07 2022] GET /compute/v2.1/servers/f3c2dd22-f9d5-4649-9fc4-b3befdf6b8fc => generated 1409 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:23:08.102156 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.network.neutron [None req-c7502e99-48b7-4edb-90c8-4c478cd62ba2 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] validate_networks() for [('e82cadd8-589a-4efd-bf88-06c2dfbf68ef', None, None, None, None, None)] {{(pid=122632) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 23:23:08.931697 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-7ea139ba-e695-461f-80a1-1c0cb258f86d tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:23:08.932891 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-7ea139ba-e695-461f-80a1-1c0cb258f86d tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] [instance: 7e091da3-0636-4cba-b8de-94fdeecf0b7f] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:23:08.945290 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7ea139ba-e695-461f-80a1-1c0cb258f86d tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:08.946068 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7ea139ba-e695-461f-80a1-1c0cb258f86d tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:08.947633 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7ea139ba-e695-461f-80a1-1c0cb258f86d tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:08.949094 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7ea139ba-e695-461f-80a1-1c0cb258f86d tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:08.951701 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7ea139ba-e695-461f-80a1-1c0cb258f86d tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:08.953347 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7ea139ba-e695-461f-80a1-1c0cb258f86d tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:09.086978 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-7ea139ba-e695-461f-80a1-1c0cb258f86d tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:09.107099 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-7ea139ba-e695-461f-80a1-1c0cb258f86d tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:09.110387 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-7ea139ba-e695-461f-80a1-1c0cb258f86d tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:09.112022 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-7ea139ba-e695-461f-80a1-1c0cb258f86d tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] 10.222.0.58 "GET /compute/v2.1/servers/7e091da3-0636-4cba-b8de-94fdeecf0b7f" status: 200 len: 1605 microversion: 2.32 time: 0.184600 Aug 10 23:23:09.112770 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2722/5228] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:23:08 2022] GET /compute/v2.1/servers/7e091da3-0636-4cba-b8de-94fdeecf0b7f => generated 1605 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 23:23:09.128526 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-c7502e99-48b7-4edb-90c8-4c478cd62ba2 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Flavor limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:23:09.128948 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-c7502e99-48b7-4edb-90c8-4c478cd62ba2 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Image limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:23:09.129422 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-c7502e99-48b7-4edb-90c8-4c478cd62ba2 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Flavor pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:23:09.129829 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-c7502e99-48b7-4edb-90c8-4c478cd62ba2 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Image pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:23:09.131802 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-c7502e99-48b7-4edb-90c8-4c478cd62ba2 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:23:09.137156 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-565e0721-555d-4c66-af81-df7eb8ef5eb5 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:23:09.137785 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-565e0721-555d-4c66-af81-df7eb8ef5eb5 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] [instance: f3c2dd22-f9d5-4649-9fc4-b3befdf6b8fc] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:23:09.144115 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-565e0721-555d-4c66-af81-df7eb8ef5eb5 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:09.144608 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-565e0721-555d-4c66-af81-df7eb8ef5eb5 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:09.145186 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-565e0721-555d-4c66-af81-df7eb8ef5eb5 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:09.146031 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-565e0721-555d-4c66-af81-df7eb8ef5eb5 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:09.146491 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-565e0721-555d-4c66-af81-df7eb8ef5eb5 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:09.146936 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-565e0721-555d-4c66-af81-df7eb8ef5eb5 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:09.156283 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c7502e99-48b7-4edb-90c8-4c478cd62ba2 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:09.156775 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c7502e99-48b7-4edb-90c8-4c478cd62ba2 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:09.160953 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c7502e99-48b7-4edb-90c8-4c478cd62ba2 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:09.162101 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c7502e99-48b7-4edb-90c8-4c478cd62ba2 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:09.164829 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c7502e99-48b7-4edb-90c8-4c478cd62ba2 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:09.165473 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c7502e99-48b7-4edb-90c8-4c478cd62ba2 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:09.192879 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-c7502e99-48b7-4edb-90c8-4c478cd62ba2 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Getting quotas for project 492ef66ca40744bbb9b6a7e847929a8b. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:23:09.198673 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-c7502e99-48b7-4edb-90c8-4c478cd62ba2 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Getting quotas for user 2be6f687ffa44c00ab6deb4d7a78eb5f and project 492ef66ca40744bbb9b6a7e847929a8b. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:23:09.204779 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:23:09.222185 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-c7502e99-48b7-4edb-90c8-4c478cd62ba2 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Going to run 1 instances... {{(pid=122632) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 23:23:09.225023 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-c7502e99-48b7-4edb-90c8-4c478cd62ba2 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] [instance: ebb9a0bf-74e7-4e0f-bad3-32d21bd3fb77] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78ad8905-f66f-4733-8be9-2b260f1fabed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122632) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 23:23:09.253530 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-565e0721-555d-4c66-af81-df7eb8ef5eb5 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036a90c902be43e0bdc2547278d94c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c2436609c447e1b55d203ac00bf880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:09.266559 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-565e0721-555d-4c66-af81-df7eb8ef5eb5 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '036a90c902be43e0bdc2547278d94c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c2436609c447e1b55d203ac00bf880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:09.268251 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-565e0721-555d-4c66-af81-df7eb8ef5eb5 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '036a90c902be43e0bdc2547278d94c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c2436609c447e1b55d203ac00bf880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:09.276913 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-565e0721-555d-4c66-af81-df7eb8ef5eb5 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] 10.222.0.58 "GET /compute/v2.1/servers/f3c2dd22-f9d5-4649-9fc4-b3befdf6b8fc" status: 200 len: 1409 microversion: 2.54 time: 0.147013 Aug 10 23:23:09.277828 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2723/5229] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:23:09 2022] GET /compute/v2.1/servers/f3c2dd22-f9d5-4649-9fc4-b3befdf6b8fc => generated 1409 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:23:09.304090 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-c7502e99-48b7-4edb-90c8-4c478cd62ba2 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.658081 Aug 10 23:23:09.304090 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2507/5230] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 23:23:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 1660 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 23:23:09.321565 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-232fb3ab-9114-4f2e-98cd-ac093d8b48ba tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:23:09.323522 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-232fb3ab-9114-4f2e-98cd-ac093d8b48ba tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] [instance: ebb9a0bf-74e7-4e0f-bad3-32d21bd3fb77] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:23:09.406687 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-232fb3ab-9114-4f2e-98cd-ac093d8b48ba tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2be6f687ffa44c00ab6deb4d7a78eb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492ef66ca40744bbb9b6a7e847929a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:09.418603 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-232fb3ab-9114-4f2e-98cd-ac093d8b48ba tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] 10.222.0.58 "GET /compute/v2.1/servers/ebb9a0bf-74e7-4e0f-bad3-32d21bd3fb77" status: 200 len: 1215 microversion: 2.1 time: 0.109067 Aug 10 23:23:09.422092 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2724/5231] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:23:09 2022] GET /compute/v2.1/servers/ebb9a0bf-74e7-4e0f-bad3-32d21bd3fb77 => generated 1215 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:23:10.142725 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-39475c04-d1cb-4151-9bbc-c5873c0e4c59 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:23:10.143369 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-39475c04-d1cb-4151-9bbc-c5873c0e4c59 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] [instance: 7e091da3-0636-4cba-b8de-94fdeecf0b7f] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:23:10.159602 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-39475c04-d1cb-4151-9bbc-c5873c0e4c59 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:10.160098 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-39475c04-d1cb-4151-9bbc-c5873c0e4c59 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:10.161305 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-39475c04-d1cb-4151-9bbc-c5873c0e4c59 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:10.162701 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-39475c04-d1cb-4151-9bbc-c5873c0e4c59 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:10.163855 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-39475c04-d1cb-4151-9bbc-c5873c0e4c59 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:10.167411 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-39475c04-d1cb-4151-9bbc-c5873c0e4c59 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:10.225817 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=100 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:23:10.308143 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-39475c04-d1cb-4151-9bbc-c5873c0e4c59 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:10.314686 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-5ed67f2f-cf75-46e0-8402-940d7b85fe0d tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:23:10.315358 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-5ed67f2f-cf75-46e0-8402-940d7b85fe0d tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] [instance: f3c2dd22-f9d5-4649-9fc4-b3befdf6b8fc] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:23:10.342487 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-39475c04-d1cb-4151-9bbc-c5873c0e4c59 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:10.348342 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5ed67f2f-cf75-46e0-8402-940d7b85fe0d tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:10.349412 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-39475c04-d1cb-4151-9bbc-c5873c0e4c59 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:10.350135 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5ed67f2f-cf75-46e0-8402-940d7b85fe0d tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:10.350607 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5ed67f2f-cf75-46e0-8402-940d7b85fe0d tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:10.354490 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5ed67f2f-cf75-46e0-8402-940d7b85fe0d tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:10.355693 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-39475c04-d1cb-4151-9bbc-c5873c0e4c59 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] 10.222.0.58 "GET /compute/v2.1/servers/7e091da3-0636-4cba-b8de-94fdeecf0b7f" status: 200 len: 1605 microversion: 2.32 time: 0.215806 Aug 10 23:23:10.357067 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5ed67f2f-cf75-46e0-8402-940d7b85fe0d tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:10.358433 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5ed67f2f-cf75-46e0-8402-940d7b85fe0d tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:10.359980 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2508/5232] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:23:10 2022] GET /compute/v2.1/servers/7e091da3-0636-4cba-b8de-94fdeecf0b7f => generated 1605 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:23:10.449939 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-5ed67f2f-cf75-46e0-8402-940d7b85fe0d tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036a90c902be43e0bdc2547278d94c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c2436609c447e1b55d203ac00bf880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:10.456539 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-4d45558a-887f-43a0-a221-4fe180d509d3 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:23:10.457408 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-4d45558a-887f-43a0-a221-4fe180d509d3 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] [instance: ebb9a0bf-74e7-4e0f-bad3-32d21bd3fb77] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:23:10.467197 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-5ed67f2f-cf75-46e0-8402-940d7b85fe0d tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '036a90c902be43e0bdc2547278d94c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c2436609c447e1b55d203ac00bf880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:10.475570 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4d45558a-887f-43a0-a221-4fe180d509d3 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:10.476288 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4d45558a-887f-43a0-a221-4fe180d509d3 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:10.478087 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-5ed67f2f-cf75-46e0-8402-940d7b85fe0d tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '036a90c902be43e0bdc2547278d94c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c2436609c447e1b55d203ac00bf880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:10.479580 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4d45558a-887f-43a0-a221-4fe180d509d3 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:10.481162 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-5ed67f2f-cf75-46e0-8402-940d7b85fe0d tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] 10.222.0.58 "GET /compute/v2.1/servers/f3c2dd22-f9d5-4649-9fc4-b3befdf6b8fc" status: 200 len: 1409 microversion: 2.54 time: 0.179164 Aug 10 23:23:10.481855 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4d45558a-887f-43a0-a221-4fe180d509d3 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:10.482527 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4d45558a-887f-43a0-a221-4fe180d509d3 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:10.484506 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2725/5233] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:23:10 2022] GET /compute/v2.1/servers/f3c2dd22-f9d5-4649-9fc4-b3befdf6b8fc => generated 1409 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:23:10.484767 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4d45558a-887f-43a0-a221-4fe180d509d3 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:10.613573 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-4d45558a-887f-43a0-a221-4fe180d509d3 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2be6f687ffa44c00ab6deb4d7a78eb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492ef66ca40744bbb9b6a7e847929a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:10.628214 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-4d45558a-887f-43a0-a221-4fe180d509d3 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] 10.222.0.58 "GET /compute/v2.1/servers/ebb9a0bf-74e7-4e0f-bad3-32d21bd3fb77" status: 200 len: 1267 microversion: 2.1 time: 0.187688 Aug 10 23:23:10.636457 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2509/5234] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:23:10 2022] GET /compute/v2.1/servers/ebb9a0bf-74e7-4e0f-bad3-32d21bd3fb77 => generated 1267 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:23:11.387744 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-655431ea-d77f-4527-93e7-64b7b2ccda64 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:23:11.388360 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-655431ea-d77f-4527-93e7-64b7b2ccda64 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] [instance: 7e091da3-0636-4cba-b8de-94fdeecf0b7f] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:23:11.398755 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-655431ea-d77f-4527-93e7-64b7b2ccda64 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:11.399811 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-655431ea-d77f-4527-93e7-64b7b2ccda64 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:11.402881 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-655431ea-d77f-4527-93e7-64b7b2ccda64 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:11.405046 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-655431ea-d77f-4527-93e7-64b7b2ccda64 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:11.408330 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-655431ea-d77f-4527-93e7-64b7b2ccda64 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:11.408995 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-655431ea-d77f-4527-93e7-64b7b2ccda64 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:11.512406 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-400693d0-e15d-435c-a9f3-d71cfd256f14 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:23:11.513955 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-400693d0-e15d-435c-a9f3-d71cfd256f14 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] [instance: f3c2dd22-f9d5-4649-9fc4-b3befdf6b8fc] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:23:11.523473 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-400693d0-e15d-435c-a9f3-d71cfd256f14 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:11.524370 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-400693d0-e15d-435c-a9f3-d71cfd256f14 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:11.524998 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-400693d0-e15d-435c-a9f3-d71cfd256f14 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:11.526494 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-400693d0-e15d-435c-a9f3-d71cfd256f14 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:11.527334 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-400693d0-e15d-435c-a9f3-d71cfd256f14 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:11.527939 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-400693d0-e15d-435c-a9f3-d71cfd256f14 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:11.528444 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-655431ea-d77f-4527-93e7-64b7b2ccda64 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:11.540404 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-655431ea-d77f-4527-93e7-64b7b2ccda64 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:11.546627 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-655431ea-d77f-4527-93e7-64b7b2ccda64 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:11.548375 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-655431ea-d77f-4527-93e7-64b7b2ccda64 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] 10.222.0.58 "GET /compute/v2.1/servers/7e091da3-0636-4cba-b8de-94fdeecf0b7f" status: 200 len: 1605 microversion: 2.32 time: 0.165731 Aug 10 23:23:11.548888 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2726/5235] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:23:11 2022] GET /compute/v2.1/servers/7e091da3-0636-4cba-b8de-94fdeecf0b7f => generated 1605 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:23:11.636581 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-400693d0-e15d-435c-a9f3-d71cfd256f14 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036a90c902be43e0bdc2547278d94c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c2436609c447e1b55d203ac00bf880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:11.654683 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-63afafb2-2e48-405a-81fb-be8bd3fc9e04 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:23:11.655473 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-63afafb2-2e48-405a-81fb-be8bd3fc9e04 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] [instance: ebb9a0bf-74e7-4e0f-bad3-32d21bd3fb77] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:23:11.670163 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-400693d0-e15d-435c-a9f3-d71cfd256f14 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '036a90c902be43e0bdc2547278d94c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c2436609c447e1b55d203ac00bf880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:11.672516 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-63afafb2-2e48-405a-81fb-be8bd3fc9e04 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:11.673672 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-400693d0-e15d-435c-a9f3-d71cfd256f14 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '036a90c902be43e0bdc2547278d94c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c2436609c447e1b55d203ac00bf880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:11.674330 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-63afafb2-2e48-405a-81fb-be8bd3fc9e04 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:11.674969 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-63afafb2-2e48-405a-81fb-be8bd3fc9e04 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:11.676763 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-63afafb2-2e48-405a-81fb-be8bd3fc9e04 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:11.677443 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-400693d0-e15d-435c-a9f3-d71cfd256f14 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] 10.222.0.58 "GET /compute/v2.1/servers/f3c2dd22-f9d5-4649-9fc4-b3befdf6b8fc" status: 200 len: 1415 microversion: 2.54 time: 0.171129 Aug 10 23:23:11.678049 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-63afafb2-2e48-405a-81fb-be8bd3fc9e04 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:11.678620 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-63afafb2-2e48-405a-81fb-be8bd3fc9e04 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:11.679383 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2510/5236] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:23:11 2022] GET /compute/v2.1/servers/f3c2dd22-f9d5-4649-9fc4-b3befdf6b8fc => generated 1415 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:23:11.808850 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-63afafb2-2e48-405a-81fb-be8bd3fc9e04 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2be6f687ffa44c00ab6deb4d7a78eb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492ef66ca40744bbb9b6a7e847929a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:11.836886 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-63afafb2-2e48-405a-81fb-be8bd3fc9e04 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] 10.222.0.58 "GET /compute/v2.1/servers/ebb9a0bf-74e7-4e0f-bad3-32d21bd3fb77" status: 200 len: 1273 microversion: 2.1 time: 0.187387 Aug 10 23:23:11.840258 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2727/5237] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:23:11 2022] GET /compute/v2.1/servers/ebb9a0bf-74e7-4e0f-bad3-32d21bd3fb77 => generated 1273 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:23:12.577456 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-efceb879-46a5-4dc9-abf3-fd1299916de6 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:23:12.578064 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-efceb879-46a5-4dc9-abf3-fd1299916de6 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] [instance: 7e091da3-0636-4cba-b8de-94fdeecf0b7f] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:23:12.595634 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-efceb879-46a5-4dc9-abf3-fd1299916de6 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:12.596158 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-efceb879-46a5-4dc9-abf3-fd1299916de6 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:12.596605 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-efceb879-46a5-4dc9-abf3-fd1299916de6 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:12.601746 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-efceb879-46a5-4dc9-abf3-fd1299916de6 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:12.602238 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-efceb879-46a5-4dc9-abf3-fd1299916de6 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:12.602984 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-efceb879-46a5-4dc9-abf3-fd1299916de6 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:12.704813 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-7b098791-c5c0-4db1-b067-089b3f543713 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:23:12.705474 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-7b098791-c5c0-4db1-b067-089b3f543713 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] [instance: f3c2dd22-f9d5-4649-9fc4-b3befdf6b8fc] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:23:12.719276 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7b098791-c5c0-4db1-b067-089b3f543713 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:12.719779 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7b098791-c5c0-4db1-b067-089b3f543713 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:12.720221 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7b098791-c5c0-4db1-b067-089b3f543713 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:12.720935 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7b098791-c5c0-4db1-b067-089b3f543713 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:12.721402 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7b098791-c5c0-4db1-b067-089b3f543713 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:12.721827 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7b098791-c5c0-4db1-b067-089b3f543713 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:12.783751 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-efceb879-46a5-4dc9-abf3-fd1299916de6 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:12.796650 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-efceb879-46a5-4dc9-abf3-fd1299916de6 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:12.798655 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-efceb879-46a5-4dc9-abf3-fd1299916de6 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:12.803202 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-efceb879-46a5-4dc9-abf3-fd1299916de6 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] 10.222.0.58 "GET /compute/v2.1/servers/7e091da3-0636-4cba-b8de-94fdeecf0b7f" status: 200 len: 1605 microversion: 2.32 time: 0.230932 Aug 10 23:23:12.808569 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-7b098791-c5c0-4db1-b067-089b3f543713 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036a90c902be43e0bdc2547278d94c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c2436609c447e1b55d203ac00bf880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:12.831154 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2511/5238] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:23:12 2022] GET /compute/v2.1/servers/7e091da3-0636-4cba-b8de-94fdeecf0b7f => generated 1605 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:23:12.833801 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-7b098791-c5c0-4db1-b067-089b3f543713 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '036a90c902be43e0bdc2547278d94c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c2436609c447e1b55d203ac00bf880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:12.835754 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-7b098791-c5c0-4db1-b067-089b3f543713 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '036a90c902be43e0bdc2547278d94c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c2436609c447e1b55d203ac00bf880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:12.837392 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-7b098791-c5c0-4db1-b067-089b3f543713 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] 10.222.0.58 "GET /compute/v2.1/servers/f3c2dd22-f9d5-4649-9fc4-b3befdf6b8fc" status: 200 len: 1415 microversion: 2.54 time: 0.138142 Aug 10 23:23:12.851303 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2728/5239] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:23:12 2022] GET /compute/v2.1/servers/f3c2dd22-f9d5-4649-9fc4-b3befdf6b8fc => generated 1415 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 23:23:12.860719 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-f2e69a5d-3f44-4491-a2de-8deb247dfae7 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:23:12.861353 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-f2e69a5d-3f44-4491-a2de-8deb247dfae7 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] [instance: ebb9a0bf-74e7-4e0f-bad3-32d21bd3fb77] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:23:12.874457 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f2e69a5d-3f44-4491-a2de-8deb247dfae7 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:12.875131 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f2e69a5d-3f44-4491-a2de-8deb247dfae7 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:12.875635 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f2e69a5d-3f44-4491-a2de-8deb247dfae7 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:12.878177 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f2e69a5d-3f44-4491-a2de-8deb247dfae7 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:12.879588 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f2e69a5d-3f44-4491-a2de-8deb247dfae7 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:12.880428 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f2e69a5d-3f44-4491-a2de-8deb247dfae7 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:13.143889 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-f2e69a5d-3f44-4491-a2de-8deb247dfae7 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2be6f687ffa44c00ab6deb4d7a78eb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492ef66ca40744bbb9b6a7e847929a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:13.171042 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-f2e69a5d-3f44-4491-a2de-8deb247dfae7 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] 10.222.0.58 "GET /compute/v2.1/servers/ebb9a0bf-74e7-4e0f-bad3-32d21bd3fb77" status: 200 len: 1315 microversion: 2.1 time: 0.315872 Aug 10 23:23:13.198178 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2512/5240] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:23:12 2022] GET /compute/v2.1/servers/ebb9a0bf-74e7-4e0f-bad3-32d21bd3fb77 => generated 1315 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:23:13.292194 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-6c1c48f6-5a6c-4bd3-b8e8-7dd224e1b296 req-ea636ae8-7400-4ff4-888c-c6d27329f6f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ebb9a0bf-74e7-4e0f-bad3-32d21bd3fb77", "tag": "c9780f33-c5f4-421c-937a-6a501f26f058"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:23:13.318112 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-6c1c48f6-5a6c-4bd3-b8e8-7dd224e1b296 req-ea636ae8-7400-4ff4-888c-c6d27329f6f7 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:13.321082 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-6c1c48f6-5a6c-4bd3-b8e8-7dd224e1b296 req-ea636ae8-7400-4ff4-888c-c6d27329f6f7 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:13.333076 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-6c1c48f6-5a6c-4bd3-b8e8-7dd224e1b296 req-ea636ae8-7400-4ff4-888c-c6d27329f6f7 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:13.359132 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-6c1c48f6-5a6c-4bd3-b8e8-7dd224e1b296 req-ea636ae8-7400-4ff4-888c-c6d27329f6f7 service nova] Creating event network-changed:c9780f33-c5f4-421c-937a-6a501f26f058 for instance ebb9a0bf-74e7-4e0f-bad3-32d21bd3fb77 on n-h2-850468-14 Aug 10 23:23:13.374849 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-6c1c48f6-5a6c-4bd3-b8e8-7dd224e1b296 req-ea636ae8-7400-4ff4-888c-c6d27329f6f7 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088862 Aug 10 23:23:13.375994 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2729/5241] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:23:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:23:13.840655 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-8ec0d539-38de-48cf-be8a-f22b24dd061c tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:23:13.841820 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-8ec0d539-38de-48cf-be8a-f22b24dd061c tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] [instance: 7e091da3-0636-4cba-b8de-94fdeecf0b7f] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:23:13.853066 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8ec0d539-38de-48cf-be8a-f22b24dd061c tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:13.854664 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8ec0d539-38de-48cf-be8a-f22b24dd061c tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:13.860728 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8ec0d539-38de-48cf-be8a-f22b24dd061c tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:13.861709 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8ec0d539-38de-48cf-be8a-f22b24dd061c tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:13.862326 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8ec0d539-38de-48cf-be8a-f22b24dd061c tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:13.862927 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8ec0d539-38de-48cf-be8a-f22b24dd061c tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:13.869374 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-42d8f151-f48c-4367-979f-b910b3b7ded8 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:23:13.871314 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-42d8f151-f48c-4367-979f-b910b3b7ded8 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] [instance: f3c2dd22-f9d5-4649-9fc4-b3befdf6b8fc] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:23:13.881004 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-42d8f151-f48c-4367-979f-b910b3b7ded8 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:13.881861 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-42d8f151-f48c-4367-979f-b910b3b7ded8 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:13.882577 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-42d8f151-f48c-4367-979f-b910b3b7ded8 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:13.883750 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-42d8f151-f48c-4367-979f-b910b3b7ded8 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:13.884421 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-42d8f151-f48c-4367-979f-b910b3b7ded8 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:13.885898 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-42d8f151-f48c-4367-979f-b910b3b7ded8 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:13.961877 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-8ec0d539-38de-48cf-be8a-f22b24dd061c tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:13.977010 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-8ec0d539-38de-48cf-be8a-f22b24dd061c tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:13.979789 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-8ec0d539-38de-48cf-be8a-f22b24dd061c tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:13.982128 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-8ec0d539-38de-48cf-be8a-f22b24dd061c tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] 10.222.0.58 "GET /compute/v2.1/servers/7e091da3-0636-4cba-b8de-94fdeecf0b7f" status: 200 len: 1605 microversion: 2.32 time: 0.146995 Aug 10 23:23:14.000506 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2513/5242] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:23:13 2022] GET /compute/v2.1/servers/7e091da3-0636-4cba-b8de-94fdeecf0b7f => generated 1605 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:23:14.045454 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-42d8f151-f48c-4367-979f-b910b3b7ded8 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036a90c902be43e0bdc2547278d94c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c2436609c447e1b55d203ac00bf880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:14.058296 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-42d8f151-f48c-4367-979f-b910b3b7ded8 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '036a90c902be43e0bdc2547278d94c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c2436609c447e1b55d203ac00bf880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:14.061625 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-42d8f151-f48c-4367-979f-b910b3b7ded8 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '036a90c902be43e0bdc2547278d94c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c2436609c447e1b55d203ac00bf880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:14.063913 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-42d8f151-f48c-4367-979f-b910b3b7ded8 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] 10.222.0.58 "GET /compute/v2.1/servers/f3c2dd22-f9d5-4649-9fc4-b3befdf6b8fc" status: 200 len: 1400 microversion: 2.54 time: 0.202021 Aug 10 23:23:14.066340 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2730/5243] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:23:13 2022] GET /compute/v2.1/servers/f3c2dd22-f9d5-4649-9fc4-b3befdf6b8fc => generated 1400 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:23:14.090741 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-a17f9d51-82d5-4575-8391-737f6ae98b0d tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Calling method '.version_select at 0x7f846fc951f0>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:23:14.119849 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-a17f9d51-82d5-4575-8391-737f6ae98b0d tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1496904749" status: 204 len: 0 microversion: 2.54 time: 0.033737 Aug 10 23:23:14.124218 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2514/5244] 10.222.0.58 () {60 vars in 1319 bytes} [Wed Aug 10 23:23:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1496904749 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 10 23:23:14.135468 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-3fc1190b-dd56-4186-b61c-ace72ceab062 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:23:14.135986 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-3fc1190b-dd56-4186-b61c-ace72ceab062 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] [instance: f3c2dd22-f9d5-4649-9fc4-b3befdf6b8fc] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:23:14.142314 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3fc1190b-dd56-4186-b61c-ace72ceab062 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:14.142838 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3fc1190b-dd56-4186-b61c-ace72ceab062 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:14.143279 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3fc1190b-dd56-4186-b61c-ace72ceab062 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:14.143985 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3fc1190b-dd56-4186-b61c-ace72ceab062 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:14.144486 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3fc1190b-dd56-4186-b61c-ace72ceab062 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:14.145169 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3fc1190b-dd56-4186-b61c-ace72ceab062 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:14.178767 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-3fc1190b-dd56-4186-b61c-ace72ceab062 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] [instance: f3c2dd22-f9d5-4649-9fc4-b3befdf6b8fc] Going to try to terminate instance {{(pid=122633) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:23:14.194398 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-8228f6ea-c0f2-4a38-bc27-3af58dee9f7c tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:23:14.195332 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-8228f6ea-c0f2-4a38-bc27-3af58dee9f7c tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] [instance: ebb9a0bf-74e7-4e0f-bad3-32d21bd3fb77] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:23:14.210406 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8228f6ea-c0f2-4a38-bc27-3af58dee9f7c tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:14.210961 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8228f6ea-c0f2-4a38-bc27-3af58dee9f7c tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:14.211375 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8228f6ea-c0f2-4a38-bc27-3af58dee9f7c tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:14.212138 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8228f6ea-c0f2-4a38-bc27-3af58dee9f7c tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:14.214710 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8228f6ea-c0f2-4a38-bc27-3af58dee9f7c tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:14.214710 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8228f6ea-c0f2-4a38-bc27-3af58dee9f7c tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:14.347593 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-3fc1190b-dd56-4186-b61c-ace72ceab062 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] 10.222.0.58 "DELETE /compute/v2.1/servers/f3c2dd22-f9d5-4649-9fc4-b3befdf6b8fc" status: 204 len: 0 microversion: 2.54 time: 0.216494 Aug 10 23:23:14.354683 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2731/5245] 10.222.0.58 () {60 vars in 1280 bytes} [Wed Aug 10 23:23:14 2022] DELETE /compute/v2.1/servers/f3c2dd22-f9d5-4649-9fc4-b3befdf6b8fc => generated 0 bytes in 224 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 10 23:23:14.365486 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-dbad78ff-85a2-4e4d-be94-4338448d2285 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:23:14.366370 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-dbad78ff-85a2-4e4d-be94-4338448d2285 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] [instance: f3c2dd22-f9d5-4649-9fc4-b3befdf6b8fc] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:23:14.386901 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dbad78ff-85a2-4e4d-be94-4338448d2285 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:14.387590 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dbad78ff-85a2-4e4d-be94-4338448d2285 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:14.388144 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dbad78ff-85a2-4e4d-be94-4338448d2285 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:14.388975 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dbad78ff-85a2-4e4d-be94-4338448d2285 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:14.389801 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dbad78ff-85a2-4e4d-be94-4338448d2285 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:14.390336 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dbad78ff-85a2-4e4d-be94-4338448d2285 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:14.437218 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-8228f6ea-c0f2-4a38-bc27-3af58dee9f7c tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2be6f687ffa44c00ab6deb4d7a78eb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492ef66ca40744bbb9b6a7e847929a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:14.445572 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-8228f6ea-c0f2-4a38-bc27-3af58dee9f7c tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] 10.222.0.58 "GET /compute/v2.1/servers/ebb9a0bf-74e7-4e0f-bad3-32d21bd3fb77" status: 200 len: 1315 microversion: 2.1 time: 0.255885 Aug 10 23:23:14.446170 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2515/5246] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:23:14 2022] GET /compute/v2.1/servers/ebb9a0bf-74e7-4e0f-bad3-32d21bd3fb77 => generated 1315 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:23:14.594750 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-dbad78ff-85a2-4e4d-be94-4338448d2285 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036a90c902be43e0bdc2547278d94c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c2436609c447e1b55d203ac00bf880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:14.598956 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:23:14.608910 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-dbad78ff-85a2-4e4d-be94-4338448d2285 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '036a90c902be43e0bdc2547278d94c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c2436609c447e1b55d203ac00bf880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:14.610870 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-dbad78ff-85a2-4e4d-be94-4338448d2285 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '036a90c902be43e0bdc2547278d94c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c2436609c447e1b55d203ac00bf880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:14.613010 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-dbad78ff-85a2-4e4d-be94-4338448d2285 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] 10.222.0.58 "GET /compute/v2.1/servers/f3c2dd22-f9d5-4649-9fc4-b3befdf6b8fc" status: 200 len: 1406 microversion: 2.54 time: 0.253648 Aug 10 23:23:14.614411 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2732/5247] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:23:14 2022] GET /compute/v2.1/servers/f3c2dd22-f9d5-4649-9fc4-b3befdf6b8fc => generated 1406 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:23:15.009192 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-3e3f03e5-a226-431c-961b-6596c0797213 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:23:15.010742 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-3e3f03e5-a226-431c-961b-6596c0797213 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] [instance: 7e091da3-0636-4cba-b8de-94fdeecf0b7f] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:23:15.020247 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3e3f03e5-a226-431c-961b-6596c0797213 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:15.021112 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3e3f03e5-a226-431c-961b-6596c0797213 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:15.021848 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3e3f03e5-a226-431c-961b-6596c0797213 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:15.023756 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3e3f03e5-a226-431c-961b-6596c0797213 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:15.024762 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3e3f03e5-a226-431c-961b-6596c0797213 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:15.026592 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3e3f03e5-a226-431c-961b-6596c0797213 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:15.163641 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-3e3f03e5-a226-431c-961b-6596c0797213 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:15.178830 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-3e3f03e5-a226-431c-961b-6596c0797213 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:15.181195 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-3e3f03e5-a226-431c-961b-6596c0797213 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:15.183269 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-3e3f03e5-a226-431c-961b-6596c0797213 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] 10.222.0.58 "GET /compute/v2.1/servers/7e091da3-0636-4cba-b8de-94fdeecf0b7f" status: 200 len: 1605 microversion: 2.32 time: 0.180396 Aug 10 23:23:15.200511 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2516/5248] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:23:15 2022] GET /compute/v2.1/servers/7e091da3-0636-4cba-b8de-94fdeecf0b7f => generated 1605 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:23:15.466668 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-2664190f-ef66-4415-89dd-06d3ddcba99a tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:23:15.468290 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-2664190f-ef66-4415-89dd-06d3ddcba99a tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] [instance: ebb9a0bf-74e7-4e0f-bad3-32d21bd3fb77] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:23:15.491407 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2664190f-ef66-4415-89dd-06d3ddcba99a tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:15.492247 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2664190f-ef66-4415-89dd-06d3ddcba99a tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:15.492957 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2664190f-ef66-4415-89dd-06d3ddcba99a tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:15.493959 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2664190f-ef66-4415-89dd-06d3ddcba99a tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:15.496468 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2664190f-ef66-4415-89dd-06d3ddcba99a tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:15.497190 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2664190f-ef66-4415-89dd-06d3ddcba99a tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:15.636805 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-0cfc8c35-f481-4e41-b649-8085068c7e4a tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:23:15.637557 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-0cfc8c35-f481-4e41-b649-8085068c7e4a tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] [instance: f3c2dd22-f9d5-4649-9fc4-b3befdf6b8fc] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:23:15.645085 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0cfc8c35-f481-4e41-b649-8085068c7e4a tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:15.645343 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0cfc8c35-f481-4e41-b649-8085068c7e4a tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:15.645930 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0cfc8c35-f481-4e41-b649-8085068c7e4a tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:15.646706 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0cfc8c35-f481-4e41-b649-8085068c7e4a tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:15.647298 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0cfc8c35-f481-4e41-b649-8085068c7e4a tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:15.647827 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0cfc8c35-f481-4e41-b649-8085068c7e4a tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:15.744174 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-0cfc8c35-f481-4e41-b649-8085068c7e4a tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '036a90c902be43e0bdc2547278d94c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c2436609c447e1b55d203ac00bf880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:15.753249 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-0cfc8c35-f481-4e41-b649-8085068c7e4a tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '036a90c902be43e0bdc2547278d94c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c2436609c447e1b55d203ac00bf880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:15.755137 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-0cfc8c35-f481-4e41-b649-8085068c7e4a tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '036a90c902be43e0bdc2547278d94c62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23c2436609c447e1b55d203ac00bf880', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:15.757086 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-0cfc8c35-f481-4e41-b649-8085068c7e4a tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] 10.222.0.58 "GET /compute/v2.1/servers/f3c2dd22-f9d5-4649-9fc4-b3befdf6b8fc" status: 200 len: 1406 microversion: 2.54 time: 0.124368 Aug 10 23:23:15.757679 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2517/5249] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:23:15 2022] GET /compute/v2.1/servers/f3c2dd22-f9d5-4649-9fc4-b3befdf6b8fc => generated 1406 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 23:23:15.872337 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-2664190f-ef66-4415-89dd-06d3ddcba99a tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2be6f687ffa44c00ab6deb4d7a78eb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492ef66ca40744bbb9b6a7e847929a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:15.891302 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-2664190f-ef66-4415-89dd-06d3ddcba99a tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] 10.222.0.58 "GET /compute/v2.1/servers/ebb9a0bf-74e7-4e0f-bad3-32d21bd3fb77" status: 200 len: 1315 microversion: 2.1 time: 0.429353 Aug 10 23:23:15.905433 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2733/5250] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:23:15 2022] GET /compute/v2.1/servers/ebb9a0bf-74e7-4e0f-bad3-32d21bd3fb77 => generated 1315 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:23:16.208662 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-4d4ae9ee-fff7-4100-a547-f2e8e7ff3b14 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:23:16.209277 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-4d4ae9ee-fff7-4100-a547-f2e8e7ff3b14 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] [instance: 7e091da3-0636-4cba-b8de-94fdeecf0b7f] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:23:16.225760 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4d4ae9ee-fff7-4100-a547-f2e8e7ff3b14 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:16.226492 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4d4ae9ee-fff7-4100-a547-f2e8e7ff3b14 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:16.227546 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4d4ae9ee-fff7-4100-a547-f2e8e7ff3b14 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:16.228538 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4d4ae9ee-fff7-4100-a547-f2e8e7ff3b14 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:16.229233 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4d4ae9ee-fff7-4100-a547-f2e8e7ff3b14 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:16.230351 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4d4ae9ee-fff7-4100-a547-f2e8e7ff3b14 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:16.371680 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-4d4ae9ee-fff7-4100-a547-f2e8e7ff3b14 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:16.394067 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-4d4ae9ee-fff7-4100-a547-f2e8e7ff3b14 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:16.399871 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-4d4ae9ee-fff7-4100-a547-f2e8e7ff3b14 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:16.408346 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-4d4ae9ee-fff7-4100-a547-f2e8e7ff3b14 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] 10.222.0.58 "GET /compute/v2.1/servers/7e091da3-0636-4cba-b8de-94fdeecf0b7f" status: 200 len: 1605 microversion: 2.32 time: 0.203629 Aug 10 23:23:16.413349 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2518/5251] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:23:16 2022] GET /compute/v2.1/servers/7e091da3-0636-4cba-b8de-94fdeecf0b7f => generated 1605 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:23:16.784783 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-863ee9b3-65a1-41f7-8526-0e8acfd496c6 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:23:16.785705 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-863ee9b3-65a1-41f7-8526-0e8acfd496c6 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] [instance: f3c2dd22-f9d5-4649-9fc4-b3befdf6b8fc] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:23:16.795823 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-863ee9b3-65a1-41f7-8526-0e8acfd496c6 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:16.798509 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-863ee9b3-65a1-41f7-8526-0e8acfd496c6 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:16.803000 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-863ee9b3-65a1-41f7-8526-0e8acfd496c6 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:16.803764 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-863ee9b3-65a1-41f7-8526-0e8acfd496c6 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:16.804225 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-863ee9b3-65a1-41f7-8526-0e8acfd496c6 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:16.804811 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-863ee9b3-65a1-41f7-8526-0e8acfd496c6 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:16.831121 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-863ee9b3-65a1-41f7-8526-0e8acfd496c6 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] HTTP exception thrown: Instance f3c2dd22-f9d5-4649-9fc4-b3befdf6b8fc could not be found. Aug 10 23:23:16.835992 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-863ee9b3-65a1-41f7-8526-0e8acfd496c6 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Request method failure captured: Aug 10 23:23:16.835992 n-d-850468-14 devstack@n-api.service[122633]: request: GET /compute/v2.1/servers/f3c2dd22-f9d5-4649-9fc4-b3befdf6b8fc HTTP/1.1 Aug 10 23:23:16.835992 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:23:16.835992 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:23:16.835992 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:23:16.835992 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:23:16.835992 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:23:16.835992 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:23:16.835992 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:23:16.835992 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:23:16.835992 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9D29MY9jkFHfeS_N6GotwTIC-MeHnfPeU5b81AZvBE3sxoA3I_o0lTx-UT7OsaVjh01dCcwVgTwmdNBn-45iFja1RBsWnYHaTkiCdNhCKZQDpR7_HIr6QSchl4ZE45o41yvntdKn7tnqEYwkNQJ6sh9XhsyGdmIAwJ7hRM5nkYUrzDA Aug 10 23:23:16.835992 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:23:16.835992 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:23:16.835992 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:23:16.835992 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:23:16.835992 n-d-850468-14 devstack@n-api.service[122633]: X-Openstack-Nova-Api-Version: 2.54 Aug 10 23:23:16.835992 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:23:16.835992 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:23:16.835992 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 23c2436609c447e1b55d203ac00bf880 Aug 10 23:23:16.835992 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-ServerShowV254Test-907592585 Aug 10 23:23:16.835992 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:23:16.835992 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:23:16.835992 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/23c2436609c447e1b55d203ac00bf880"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/23c2436609c447e1b55d203ac00bf880"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/23c2436609c447e1b55d203ac00bf880"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_23c2436609c447e1b55d203ac00bf880", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:23:16.835992 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-ServerShowV254Test-907592585 Aug 10 23:23:16.835992 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 23c2436609c447e1b55d203ac00bf880 Aug 10 23:23:16.835992 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-ServerShowV254Test-907592585 Aug 10 23:23:16.835992 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-ServerShowV254Test-907592585-project Aug 10 23:23:16.835992 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:23:16.835992 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:23:16.835992 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 036a90c902be43e0bdc2547278d94c62 Aug 10 23:23:16.835992 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-ServerShowV254Test-907592585-project Aug 10 23:23:16.835992 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:23:16.835992 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance f3c2dd22-f9d5-4649-9fc4-b3befdf6b8fc could not be found. Aug 10 23:23:16.835992 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': 'f3c2dd22-f9d5-4649-9fc4-b3befdf6b8fc'} Aug 10 23:23:16.835992 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:23:16.835992 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:23:16.835992 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:23:16.835992 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:23:16.835992 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:23:16.835992 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:23:16.835992 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:23:16.835992 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:23:16.835992 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:23:16.835992 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:23:16.835992 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3c2dd22-f9d5-4649-9fc4-b3befdf6b8fc could not be found. Aug 10 23:23:16.835992 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:23:16.835992 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:23:16.835992 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:23:16.835992 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:23:16.835992 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:23:16.835992 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:23:16.835992 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:23:16.835992 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:23:16.835992 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:23:16.835992 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:23:16.835992 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:23:16.835992 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:23:16.835992 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:23:16.835992 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:23:16.835992 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:23:16.835992 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:23:16.835992 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3c2dd22-f9d5-4649-9fc4-b3befdf6b8fc could not be found. Aug 10 23:23:16.835992 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:23:16.835992 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:23:16.835992 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:23:16.840952 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:23:16.840952 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:23:16.840952 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:23:16.840952 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:23:16.840952 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:23:16.840952 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3c2dd22-f9d5-4649-9fc4-b3befdf6b8fc could not be found. Aug 10 23:23:16.840952 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:23:16.845755 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-863ee9b3-65a1-41f7-8526-0e8acfd496c6 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] Returning 404 to user: Instance f3c2dd22-f9d5-4649-9fc4-b3befdf6b8fc could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:23:16.849171 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-863ee9b3-65a1-41f7-8526-0e8acfd496c6 tempest-ServerShowV254Test-907592585 tempest-ServerShowV254Test-907592585-project] 10.222.0.58 "GET /compute/v2.1/servers/f3c2dd22-f9d5-4649-9fc4-b3befdf6b8fc" status: 404 len: 111 microversion: 2.54 time: 0.068778 Aug 10 23:23:16.849981 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2734/5252] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:23:16 2022] GET /compute/v2.1/servers/f3c2dd22-f9d5-4649-9fc4-b3befdf6b8fc => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 10 23:23:16.912324 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c3ee8ac2-b8bb-4b9f-9d91-d397de39ba87 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:23:16.912946 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-c3ee8ac2-b8bb-4b9f-9d91-d397de39ba87 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] [instance: ebb9a0bf-74e7-4e0f-bad3-32d21bd3fb77] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:23:16.930301 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c3ee8ac2-b8bb-4b9f-9d91-d397de39ba87 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:16.930944 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c3ee8ac2-b8bb-4b9f-9d91-d397de39ba87 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:16.931650 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c3ee8ac2-b8bb-4b9f-9d91-d397de39ba87 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:16.932371 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c3ee8ac2-b8bb-4b9f-9d91-d397de39ba87 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:16.932827 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c3ee8ac2-b8bb-4b9f-9d91-d397de39ba87 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:16.933261 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c3ee8ac2-b8bb-4b9f-9d91-d397de39ba87 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:17.224390 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-c3ee8ac2-b8bb-4b9f-9d91-d397de39ba87 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2be6f687ffa44c00ab6deb4d7a78eb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492ef66ca40744bbb9b6a7e847929a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:17.238981 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-c3ee8ac2-b8bb-4b9f-9d91-d397de39ba87 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] 10.222.0.58 "GET /compute/v2.1/servers/ebb9a0bf-74e7-4e0f-bad3-32d21bd3fb77" status: 200 len: 1315 microversion: 2.1 time: 0.328851 Aug 10 23:23:17.240073 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2519/5253] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:23:16 2022] GET /compute/v2.1/servers/ebb9a0bf-74e7-4e0f-bad3-32d21bd3fb77 => generated 1315 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:23:17.433539 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-8690c45c-ee52-43a4-b759-21bdf789b02e tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:23:17.434309 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-8690c45c-ee52-43a4-b759-21bdf789b02e tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] [instance: 7e091da3-0636-4cba-b8de-94fdeecf0b7f] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:23:17.443690 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8690c45c-ee52-43a4-b759-21bdf789b02e tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:17.454069 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-b89933d7-f11c-4255-8acd-d918f57e1e34 req-6702f070-05bb-48ae-abf5-6a6e67984672 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebb9a0bf-74e7-4e0f-bad3-32d21bd3fb77", "name": "network-vif-plugged", "status": "completed", "tag": "c9780f33-c5f4-421c-937a-6a501f26f058"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:23:17.465470 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8690c45c-ee52-43a4-b759-21bdf789b02e tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:17.465983 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8690c45c-ee52-43a4-b759-21bdf789b02e tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:17.469167 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8690c45c-ee52-43a4-b759-21bdf789b02e tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:17.472008 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8690c45c-ee52-43a4-b759-21bdf789b02e tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:17.473014 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8690c45c-ee52-43a4-b759-21bdf789b02e tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:17.482054 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-b89933d7-f11c-4255-8acd-d918f57e1e34 req-6702f070-05bb-48ae-abf5-6a6e67984672 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:17.482544 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-b89933d7-f11c-4255-8acd-d918f57e1e34 req-6702f070-05bb-48ae-abf5-6a6e67984672 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:17.483012 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-b89933d7-f11c-4255-8acd-d918f57e1e34 req-6702f070-05bb-48ae-abf5-6a6e67984672 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:17.534437 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-b89933d7-f11c-4255-8acd-d918f57e1e34 req-6702f070-05bb-48ae-abf5-6a6e67984672 service nova] Creating event network-vif-plugged:c9780f33-c5f4-421c-937a-6a501f26f058 for instance ebb9a0bf-74e7-4e0f-bad3-32d21bd3fb77 on n-h2-850468-14 Aug 10 23:23:17.550201 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-b89933d7-f11c-4255-8acd-d918f57e1e34 req-6702f070-05bb-48ae-abf5-6a6e67984672 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099584 Aug 10 23:23:17.553781 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2520/5254] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:23:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 23:23:17.698306 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-8690c45c-ee52-43a4-b759-21bdf789b02e tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:17.720175 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-8690c45c-ee52-43a4-b759-21bdf789b02e tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:17.721677 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-8690c45c-ee52-43a4-b759-21bdf789b02e tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:17.722921 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-8690c45c-ee52-43a4-b759-21bdf789b02e tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] 10.222.0.58 "GET /compute/v2.1/servers/7e091da3-0636-4cba-b8de-94fdeecf0b7f" status: 200 len: 1605 microversion: 2.32 time: 0.294506 Aug 10 23:23:17.723820 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2735/5255] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:23:17 2022] GET /compute/v2.1/servers/7e091da3-0636-4cba-b8de-94fdeecf0b7f => generated 1605 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:23:18.266461 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-5c7bed16-0ddf-47b5-abd7-244d72c40714 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:23:18.267238 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-5c7bed16-0ddf-47b5-abd7-244d72c40714 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] [instance: ebb9a0bf-74e7-4e0f-bad3-32d21bd3fb77] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:23:18.283212 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5c7bed16-0ddf-47b5-abd7-244d72c40714 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:18.284798 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5c7bed16-0ddf-47b5-abd7-244d72c40714 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:18.286637 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5c7bed16-0ddf-47b5-abd7-244d72c40714 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:18.288006 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5c7bed16-0ddf-47b5-abd7-244d72c40714 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:18.288374 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5c7bed16-0ddf-47b5-abd7-244d72c40714 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:18.288820 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5c7bed16-0ddf-47b5-abd7-244d72c40714 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:18.559369 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-5c7bed16-0ddf-47b5-abd7-244d72c40714 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2be6f687ffa44c00ab6deb4d7a78eb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492ef66ca40744bbb9b6a7e847929a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:18.588283 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-5c7bed16-0ddf-47b5-abd7-244d72c40714 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] 10.222.0.58 "GET /compute/v2.1/servers/ebb9a0bf-74e7-4e0f-bad3-32d21bd3fb77" status: 200 len: 1315 microversion: 2.1 time: 0.326001 Aug 10 23:23:18.590550 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2521/5256] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:23:18 2022] GET /compute/v2.1/servers/ebb9a0bf-74e7-4e0f-bad3-32d21bd3fb77 => generated 1315 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:23:18.754080 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-f4d785ef-97c5-48ff-a686-a07b3255c716 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:23:18.756353 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-f4d785ef-97c5-48ff-a686-a07b3255c716 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] [instance: 7e091da3-0636-4cba-b8de-94fdeecf0b7f] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:23:18.772910 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_api:SELECT=90,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:23:18.792227 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f4d785ef-97c5-48ff-a686-a07b3255c716 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:18.793066 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f4d785ef-97c5-48ff-a686-a07b3255c716 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:18.793801 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f4d785ef-97c5-48ff-a686-a07b3255c716 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:18.795020 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f4d785ef-97c5-48ff-a686-a07b3255c716 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:18.795782 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f4d785ef-97c5-48ff-a686-a07b3255c716 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:18.801489 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f4d785ef-97c5-48ff-a686-a07b3255c716 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:18.942670 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-f4d785ef-97c5-48ff-a686-a07b3255c716 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:18.967469 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-f4d785ef-97c5-48ff-a686-a07b3255c716 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:18.969001 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-f4d785ef-97c5-48ff-a686-a07b3255c716 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:18.970280 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-f4d785ef-97c5-48ff-a686-a07b3255c716 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] 10.222.0.58 "GET /compute/v2.1/servers/7e091da3-0636-4cba-b8de-94fdeecf0b7f" status: 200 len: 1605 microversion: 2.32 time: 0.223279 Aug 10 23:23:18.986064 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2736/5257] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:23:18 2022] GET /compute/v2.1/servers/7e091da3-0636-4cba-b8de-94fdeecf0b7f => generated 1605 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 23:23:19.609657 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-ce30fdbe-e1b5-4e43-b679-d735db351512 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:23:19.610934 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-ce30fdbe-e1b5-4e43-b679-d735db351512 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] [instance: ebb9a0bf-74e7-4e0f-bad3-32d21bd3fb77] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:23:19.613548 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=2 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:23:19.614557 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=6 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:23:19.630892 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ce30fdbe-e1b5-4e43-b679-d735db351512 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:19.631392 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ce30fdbe-e1b5-4e43-b679-d735db351512 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:19.631836 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ce30fdbe-e1b5-4e43-b679-d735db351512 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:19.639466 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ce30fdbe-e1b5-4e43-b679-d735db351512 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:19.640399 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ce30fdbe-e1b5-4e43-b679-d735db351512 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:19.640953 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ce30fdbe-e1b5-4e43-b679-d735db351512 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:19.945327 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-ce30fdbe-e1b5-4e43-b679-d735db351512 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2be6f687ffa44c00ab6deb4d7a78eb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492ef66ca40744bbb9b6a7e847929a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:19.958433 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-ce30fdbe-e1b5-4e43-b679-d735db351512 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] 10.222.0.58 "GET /compute/v2.1/servers/ebb9a0bf-74e7-4e0f-bad3-32d21bd3fb77" status: 200 len: 1502 microversion: 2.1 time: 0.352813 Aug 10 23:23:19.967293 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2522/5258] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:23:19 2022] GET /compute/v2.1/servers/ebb9a0bf-74e7-4e0f-bad3-32d21bd3fb77 => generated 1502 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:23:19.981581 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-5a0523b4-30a0-4847-81fb-d0ac732f9531 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:23:19.982322 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-5a0523b4-30a0-4847-81fb-d0ac732f9531 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] [instance: ebb9a0bf-74e7-4e0f-bad3-32d21bd3fb77] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:23:19.984826 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=2 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:23:19.996319 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5a0523b4-30a0-4847-81fb-d0ac732f9531 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:19.998069 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5a0523b4-30a0-4847-81fb-d0ac732f9531 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:19.998721 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5a0523b4-30a0-4847-81fb-d0ac732f9531 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:20.000883 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5a0523b4-30a0-4847-81fb-d0ac732f9531 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:20.002908 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5a0523b4-30a0-4847-81fb-d0ac732f9531 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:20.004240 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5a0523b4-30a0-4847-81fb-d0ac732f9531 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:20.016459 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-b4f51266-ec0d-420a-be48-e43b8f1efda6 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:23:20.018872 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-b4f51266-ec0d-420a-be48-e43b8f1efda6 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] [instance: 7e091da3-0636-4cba-b8de-94fdeecf0b7f] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:23:20.032668 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b4f51266-ec0d-420a-be48-e43b8f1efda6 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:20.036262 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b4f51266-ec0d-420a-be48-e43b8f1efda6 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:20.036912 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b4f51266-ec0d-420a-be48-e43b8f1efda6 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:20.037866 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b4f51266-ec0d-420a-be48-e43b8f1efda6 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:20.039005 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b4f51266-ec0d-420a-be48-e43b8f1efda6 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:20.039706 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b4f51266-ec0d-420a-be48-e43b8f1efda6 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:20.149384 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-b4f51266-ec0d-420a-be48-e43b8f1efda6 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:20.161216 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-b4f51266-ec0d-420a-be48-e43b8f1efda6 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:20.163104 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-b4f51266-ec0d-420a-be48-e43b8f1efda6 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:20.164577 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-b4f51266-ec0d-420a-be48-e43b8f1efda6 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] 10.222.0.58 "GET /compute/v2.1/servers/7e091da3-0636-4cba-b8de-94fdeecf0b7f" status: 200 len: 1605 microversion: 2.32 time: 0.154257 Aug 10 23:23:20.166259 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2523/5259] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:23:20 2022] GET /compute/v2.1/servers/7e091da3-0636-4cba-b8de-94fdeecf0b7f => generated 1605 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 23:23:20.206988 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-5a0523b4-30a0-4847-81fb-d0ac732f9531 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2be6f687ffa44c00ab6deb4d7a78eb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492ef66ca40744bbb9b6a7e847929a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:20.220853 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-5a0523b4-30a0-4847-81fb-d0ac732f9531 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] 10.222.0.58 "GET /compute/v2.1/servers/ebb9a0bf-74e7-4e0f-bad3-32d21bd3fb77" status: 200 len: 1502 microversion: 2.1 time: 0.244278 Aug 10 23:23:20.222804 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2737/5260] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:23:19 2022] GET /compute/v2.1/servers/ebb9a0bf-74e7-4e0f-bad3-32d21bd3fb77 => generated 1502 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:23:20.243207 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-45687020-bf5c-46c0-8e6e-c6f3144202ca tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:23:20.244533 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-45687020-bf5c-46c0-8e6e-c6f3144202ca tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] [instance: ebb9a0bf-74e7-4e0f-bad3-32d21bd3fb77] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:23:20.252508 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-45687020-bf5c-46c0-8e6e-c6f3144202ca tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:20.253143 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-45687020-bf5c-46c0-8e6e-c6f3144202ca tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:20.253714 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-45687020-bf5c-46c0-8e6e-c6f3144202ca tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:20.254550 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-45687020-bf5c-46c0-8e6e-c6f3144202ca tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:20.255163 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-45687020-bf5c-46c0-8e6e-c6f3144202ca tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:20.255949 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-45687020-bf5c-46c0-8e6e-c6f3144202ca tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:20.283386 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.objects.instance [None req-45687020-bf5c-46c0-8e6e-c6f3144202ca tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Lazy-loading 'flavor' on Instance uuid ebb9a0bf-74e7-4e0f-bad3-32d21bd3fb77 {{(pid=122632) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:23:20.357463 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:23:20.366470 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-45687020-bf5c-46c0-8e6e-c6f3144202ca tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] 10.222.0.58 "POST /compute/v2.1/servers/ebb9a0bf-74e7-4e0f-bad3-32d21bd3fb77/action" status: 202 len: 0 microversion: 2.1 time: 0.127482 Aug 10 23:23:20.371115 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2524/5261] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:23:20 2022] POST /compute/v2.1/servers/ebb9a0bf-74e7-4e0f-bad3-32d21bd3fb77/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:23:20.379629 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-62b162ce-713c-4887-abba-120c335bffc2 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:23:20.380424 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-62b162ce-713c-4887-abba-120c335bffc2 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] [instance: ebb9a0bf-74e7-4e0f-bad3-32d21bd3fb77] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:23:20.387328 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-62b162ce-713c-4887-abba-120c335bffc2 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:20.388062 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-62b162ce-713c-4887-abba-120c335bffc2 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:20.388703 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-62b162ce-713c-4887-abba-120c335bffc2 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:20.389561 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-62b162ce-713c-4887-abba-120c335bffc2 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:20.390166 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-62b162ce-713c-4887-abba-120c335bffc2 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:20.390740 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-62b162ce-713c-4887-abba-120c335bffc2 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:20.618536 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-62b162ce-713c-4887-abba-120c335bffc2 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2be6f687ffa44c00ab6deb4d7a78eb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492ef66ca40744bbb9b6a7e847929a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:20.630427 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-62b162ce-713c-4887-abba-120c335bffc2 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] 10.222.0.58 "GET /compute/v2.1/servers/ebb9a0bf-74e7-4e0f-bad3-32d21bd3fb77" status: 200 len: 1510 microversion: 2.1 time: 0.257818 Aug 10 23:23:20.631995 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2738/5262] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:23:20 2022] GET /compute/v2.1/servers/ebb9a0bf-74e7-4e0f-bad3-32d21bd3fb77 => generated 1510 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:23:20.846211 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-a4abea8c-1368-45d1-8150-4676e3fc2218 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-1523847015", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452", "networks": "none"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:23:20.917428 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-a4abea8c-1368-45d1-8150-4676e3fc2218 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Flavor limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:23:20.918163 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-a4abea8c-1368-45d1-8150-4676e3fc2218 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Image limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:23:20.918902 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-a4abea8c-1368-45d1-8150-4676e3fc2218 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Flavor pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:23:20.919499 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-a4abea8c-1368-45d1-8150-4676e3fc2218 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Image pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:23:20.920050 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-a4abea8c-1368-45d1-8150-4676e3fc2218 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:23:20.969485 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a4abea8c-1368-45d1-8150-4676e3fc2218 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:20.970277 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a4abea8c-1368-45d1-8150-4676e3fc2218 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:20.971008 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a4abea8c-1368-45d1-8150-4676e3fc2218 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:20.972204 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a4abea8c-1368-45d1-8150-4676e3fc2218 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:20.972919 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a4abea8c-1368-45d1-8150-4676e3fc2218 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:20.973540 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a4abea8c-1368-45d1-8150-4676e3fc2218 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:21.004491 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-a4abea8c-1368-45d1-8150-4676e3fc2218 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Getting quotas for project 59d608b3eb7b4d1b965981b5ea727a62. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:23:21.010907 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-a4abea8c-1368-45d1-8150-4676e3fc2218 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Getting quotas for user a3f44535879e47f3b3a39d551418eb37 and project 59d608b3eb7b4d1b965981b5ea727a62. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:23:21.027491 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-a4abea8c-1368-45d1-8150-4676e3fc2218 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Going to run 1 instances... {{(pid=122632) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 23:23:21.030916 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-a4abea8c-1368-45d1-8150-4676e3fc2218 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] [instance: 9aebc95f-f7c3-479b-ba60-8de2f4539f82] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78ad8905-f66f-4733-8be9-2b260f1fabed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122632) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 23:23:21.112096 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-a4abea8c-1368-45d1-8150-4676e3fc2218 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 0.646831 Aug 10 23:23:21.114847 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2525/5263] 10.222.0.58 () {62 vars in 1188 bytes} [Wed Aug 10 23:23:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 652 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 10 23:23:21.127252 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-485e4f7b-e3dd-4582-a9e5-12a5285459c4 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:23:21.127955 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-485e4f7b-e3dd-4582-a9e5-12a5285459c4 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] [instance: 9aebc95f-f7c3-479b-ba60-8de2f4539f82] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:23:21.198879 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-9b824196-77a3-428c-8bbc-9c0c55b75131 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:23:21.199556 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-9b824196-77a3-428c-8bbc-9c0c55b75131 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] [instance: 7e091da3-0636-4cba-b8de-94fdeecf0b7f] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:23:21.224471 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9b824196-77a3-428c-8bbc-9c0c55b75131 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:21.225300 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9b824196-77a3-428c-8bbc-9c0c55b75131 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:21.229491 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9b824196-77a3-428c-8bbc-9c0c55b75131 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:21.231586 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9b824196-77a3-428c-8bbc-9c0c55b75131 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:21.233990 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9b824196-77a3-428c-8bbc-9c0c55b75131 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:21.234445 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9b824196-77a3-428c-8bbc-9c0c55b75131 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:21.282064 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-485e4f7b-e3dd-4582-a9e5-12a5285459c4 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3f44535879e47f3b3a39d551418eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d608b3eb7b4d1b965981b5ea727a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:21.293629 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-485e4f7b-e3dd-4582-a9e5-12a5285459c4 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3f44535879e47f3b3a39d551418eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d608b3eb7b4d1b965981b5ea727a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:21.296138 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-485e4f7b-e3dd-4582-a9e5-12a5285459c4 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3f44535879e47f3b3a39d551418eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d608b3eb7b4d1b965981b5ea727a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:21.298520 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-485e4f7b-e3dd-4582-a9e5-12a5285459c4 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] 10.222.0.58 "GET /compute/v2.1/servers/9aebc95f-f7c3-479b-ba60-8de2f4539f82" status: 200 len: 1278 microversion: 2.57 time: 0.176095 Aug 10 23:23:21.301075 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2739/5264] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:23:21 2022] GET /compute/v2.1/servers/9aebc95f-f7c3-479b-ba60-8de2f4539f82 => generated 1278 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:23:21.645999 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-9b824196-77a3-428c-8bbc-9c0c55b75131 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:21.656861 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c8349e96-96ab-4768-8975-d9a871831ecb tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:23:21.657478 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-c8349e96-96ab-4768-8975-d9a871831ecb tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] [instance: ebb9a0bf-74e7-4e0f-bad3-32d21bd3fb77] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:23:21.660458 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-9b824196-77a3-428c-8bbc-9c0c55b75131 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:21.663707 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-9b824196-77a3-428c-8bbc-9c0c55b75131 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:21.665069 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-9b824196-77a3-428c-8bbc-9c0c55b75131 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] 10.222.0.58 "GET /compute/v2.1/servers/7e091da3-0636-4cba-b8de-94fdeecf0b7f" status: 200 len: 1605 microversion: 2.32 time: 0.475103 Aug 10 23:23:21.671525 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2526/5265] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:23:21 2022] GET /compute/v2.1/servers/7e091da3-0636-4cba-b8de-94fdeecf0b7f => generated 1605 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:23:21.674864 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c8349e96-96ab-4768-8975-d9a871831ecb tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:21.675587 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c8349e96-96ab-4768-8975-d9a871831ecb tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:21.676244 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c8349e96-96ab-4768-8975-d9a871831ecb tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:21.677136 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c8349e96-96ab-4768-8975-d9a871831ecb tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:21.677898 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c8349e96-96ab-4768-8975-d9a871831ecb tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:21.678513 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c8349e96-96ab-4768-8975-d9a871831ecb tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:21.974482 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-c8349e96-96ab-4768-8975-d9a871831ecb tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2be6f687ffa44c00ab6deb4d7a78eb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492ef66ca40744bbb9b6a7e847929a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:21.984189 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-c8349e96-96ab-4768-8975-d9a871831ecb tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] 10.222.0.58 "GET /compute/v2.1/servers/ebb9a0bf-74e7-4e0f-bad3-32d21bd3fb77" status: 200 len: 1493 microversion: 2.1 time: 0.331009 Aug 10 23:23:22.000045 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2740/5266] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:23:21 2022] GET /compute/v2.1/servers/ebb9a0bf-74e7-4e0f-bad3-32d21bd3fb77 => generated 1493 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:23:22.007745 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-05326cdc-d1d4-4cc3-9526-d7ca2a019188 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:23:22.008912 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-05326cdc-d1d4-4cc3-9526-d7ca2a019188 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] [instance: ebb9a0bf-74e7-4e0f-bad3-32d21bd3fb77] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:23:22.018973 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-05326cdc-d1d4-4cc3-9526-d7ca2a019188 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:22.019651 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-05326cdc-d1d4-4cc3-9526-d7ca2a019188 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:22.022443 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-05326cdc-d1d4-4cc3-9526-d7ca2a019188 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:22.023345 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-05326cdc-d1d4-4cc3-9526-d7ca2a019188 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:22.023911 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-05326cdc-d1d4-4cc3-9526-d7ca2a019188 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:22.026633 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-05326cdc-d1d4-4cc3-9526-d7ca2a019188 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:22.133724 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-05326cdc-d1d4-4cc3-9526-d7ca2a019188 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] 10.222.0.58 "POST /compute/v2.1/servers/ebb9a0bf-74e7-4e0f-bad3-32d21bd3fb77/action" status: 202 len: 0 microversion: 2.1 time: 0.130147 Aug 10 23:23:22.137550 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2527/5267] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:23:22 2022] POST /compute/v2.1/servers/ebb9a0bf-74e7-4e0f-bad3-32d21bd3fb77/action => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:23:22.147667 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-5fbf69d8-f03d-4c4c-b736-6002b3a287b6 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:23:22.148423 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-5fbf69d8-f03d-4c4c-b736-6002b3a287b6 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] [instance: ebb9a0bf-74e7-4e0f-bad3-32d21bd3fb77] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:23:22.174523 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5fbf69d8-f03d-4c4c-b736-6002b3a287b6 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:22.178221 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5fbf69d8-f03d-4c4c-b736-6002b3a287b6 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:22.178886 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5fbf69d8-f03d-4c4c-b736-6002b3a287b6 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:22.179635 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5fbf69d8-f03d-4c4c-b736-6002b3a287b6 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:22.184790 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5fbf69d8-f03d-4c4c-b736-6002b3a287b6 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:22.185389 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5fbf69d8-f03d-4c4c-b736-6002b3a287b6 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:22.329057 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-1598835f-baa2-47d4-b61a-df52143519c5 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:23:22.330750 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-1598835f-baa2-47d4-b61a-df52143519c5 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] [instance: 9aebc95f-f7c3-479b-ba60-8de2f4539f82] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:23:22.339921 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1598835f-baa2-47d4-b61a-df52143519c5 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:22.340658 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1598835f-baa2-47d4-b61a-df52143519c5 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:22.341497 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1598835f-baa2-47d4-b61a-df52143519c5 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:22.344721 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1598835f-baa2-47d4-b61a-df52143519c5 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:22.345687 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1598835f-baa2-47d4-b61a-df52143519c5 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:22.346358 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1598835f-baa2-47d4-b61a-df52143519c5 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:22.422284 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-5fbf69d8-f03d-4c4c-b736-6002b3a287b6 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2be6f687ffa44c00ab6deb4d7a78eb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492ef66ca40744bbb9b6a7e847929a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:22.433324 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-5fbf69d8-f03d-4c4c-b736-6002b3a287b6 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] 10.222.0.58 "GET /compute/v2.1/servers/ebb9a0bf-74e7-4e0f-bad3-32d21bd3fb77" status: 200 len: 1499 microversion: 2.1 time: 0.290910 Aug 10 23:23:22.444922 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2741/5268] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:23:22 2022] GET /compute/v2.1/servers/ebb9a0bf-74e7-4e0f-bad3-32d21bd3fb77 => generated 1499 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:23:22.511987 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-1598835f-baa2-47d4-b61a-df52143519c5 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3f44535879e47f3b3a39d551418eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d608b3eb7b4d1b965981b5ea727a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:22.527525 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-1598835f-baa2-47d4-b61a-df52143519c5 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3f44535879e47f3b3a39d551418eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d608b3eb7b4d1b965981b5ea727a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:22.532639 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-1598835f-baa2-47d4-b61a-df52143519c5 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3f44535879e47f3b3a39d551418eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d608b3eb7b4d1b965981b5ea727a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:22.534620 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-1598835f-baa2-47d4-b61a-df52143519c5 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] 10.222.0.58 "GET /compute/v2.1/servers/9aebc95f-f7c3-479b-ba60-8de2f4539f82" status: 200 len: 1330 microversion: 2.57 time: 0.212962 Aug 10 23:23:22.536922 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2528/5269] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:23:22 2022] GET /compute/v2.1/servers/9aebc95f-f7c3-479b-ba60-8de2f4539f82 => generated 1330 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 23:23:22.693467 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-fbf7849c-33bd-46fe-b255-39803eed9f4d tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:23:22.694312 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-fbf7849c-33bd-46fe-b255-39803eed9f4d tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] [instance: 7e091da3-0636-4cba-b8de-94fdeecf0b7f] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:23:22.710205 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fbf7849c-33bd-46fe-b255-39803eed9f4d tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:22.712079 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fbf7849c-33bd-46fe-b255-39803eed9f4d tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:22.713581 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fbf7849c-33bd-46fe-b255-39803eed9f4d tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:22.715845 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fbf7849c-33bd-46fe-b255-39803eed9f4d tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:22.716594 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fbf7849c-33bd-46fe-b255-39803eed9f4d tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:22.721920 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fbf7849c-33bd-46fe-b255-39803eed9f4d tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:22.831955 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-fbf7849c-33bd-46fe-b255-39803eed9f4d tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:22.849379 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-fbf7849c-33bd-46fe-b255-39803eed9f4d tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:22.851068 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-fbf7849c-33bd-46fe-b255-39803eed9f4d tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:22.857707 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-fbf7849c-33bd-46fe-b255-39803eed9f4d tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] 10.222.0.58 "GET /compute/v2.1/servers/7e091da3-0636-4cba-b8de-94fdeecf0b7f" status: 200 len: 1605 microversion: 2.32 time: 0.168098 Aug 10 23:23:22.859093 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2742/5270] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:23:22 2022] GET /compute/v2.1/servers/7e091da3-0636-4cba-b8de-94fdeecf0b7f => generated 1605 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:23:23.456337 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-41ddbd95-378a-430d-b148-b7e0d5916e2a tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:23:23.457149 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-41ddbd95-378a-430d-b148-b7e0d5916e2a tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] [instance: ebb9a0bf-74e7-4e0f-bad3-32d21bd3fb77] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:23:23.471620 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-41ddbd95-378a-430d-b148-b7e0d5916e2a tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:23.473627 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-41ddbd95-378a-430d-b148-b7e0d5916e2a tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:23.475236 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-41ddbd95-378a-430d-b148-b7e0d5916e2a tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:23.476100 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-41ddbd95-378a-430d-b148-b7e0d5916e2a tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:23.478254 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-41ddbd95-378a-430d-b148-b7e0d5916e2a tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:23.478812 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-41ddbd95-378a-430d-b148-b7e0d5916e2a tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:23.568297 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-87c4bfde-cf07-4919-b6ee-2b8731c0819b tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:23:23.569501 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-87c4bfde-cf07-4919-b6ee-2b8731c0819b tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] [instance: 9aebc95f-f7c3-479b-ba60-8de2f4539f82] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:23:23.582777 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-87c4bfde-cf07-4919-b6ee-2b8731c0819b tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:23.583458 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-87c4bfde-cf07-4919-b6ee-2b8731c0819b tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:23.584129 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-87c4bfde-cf07-4919-b6ee-2b8731c0819b tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:23.585151 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-87c4bfde-cf07-4919-b6ee-2b8731c0819b tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:23.588152 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-87c4bfde-cf07-4919-b6ee-2b8731c0819b tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:23.589035 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-87c4bfde-cf07-4919-b6ee-2b8731c0819b tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:23.855951 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-41ddbd95-378a-430d-b148-b7e0d5916e2a tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2be6f687ffa44c00ab6deb4d7a78eb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492ef66ca40744bbb9b6a7e847929a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:23.865664 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-41ddbd95-378a-430d-b148-b7e0d5916e2a tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] 10.222.0.58 "GET /compute/v2.1/servers/ebb9a0bf-74e7-4e0f-bad3-32d21bd3fb77" status: 200 len: 1499 microversion: 2.1 time: 0.413356 Aug 10 23:23:23.867134 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2529/5271] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:23:23 2022] GET /compute/v2.1/servers/ebb9a0bf-74e7-4e0f-bad3-32d21bd3fb77 => generated 1499 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:23:23.890099 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-87c4bfde-cf07-4919-b6ee-2b8731c0819b tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3f44535879e47f3b3a39d551418eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d608b3eb7b4d1b965981b5ea727a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:23.892530 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-3ff1fd9e-fd1e-4e48-9a54-dac4adf095c2 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:23:23.893942 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-3ff1fd9e-fd1e-4e48-9a54-dac4adf095c2 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] [instance: 7e091da3-0636-4cba-b8de-94fdeecf0b7f] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:23:23.903455 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3ff1fd9e-fd1e-4e48-9a54-dac4adf095c2 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:23.904475 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3ff1fd9e-fd1e-4e48-9a54-dac4adf095c2 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:23.905079 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3ff1fd9e-fd1e-4e48-9a54-dac4adf095c2 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:23.906019 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3ff1fd9e-fd1e-4e48-9a54-dac4adf095c2 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:23.906626 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3ff1fd9e-fd1e-4e48-9a54-dac4adf095c2 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:23.907155 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-87c4bfde-cf07-4919-b6ee-2b8731c0819b tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3f44535879e47f3b3a39d551418eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d608b3eb7b4d1b965981b5ea727a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:23.907330 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3ff1fd9e-fd1e-4e48-9a54-dac4adf095c2 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:23.909903 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-87c4bfde-cf07-4919-b6ee-2b8731c0819b tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3f44535879e47f3b3a39d551418eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d608b3eb7b4d1b965981b5ea727a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:23.911520 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-87c4bfde-cf07-4919-b6ee-2b8731c0819b tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] 10.222.0.58 "GET /compute/v2.1/servers/9aebc95f-f7c3-479b-ba60-8de2f4539f82" status: 200 len: 1336 microversion: 2.57 time: 0.347274 Aug 10 23:23:23.912331 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2743/5272] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:23:23 2022] GET /compute/v2.1/servers/9aebc95f-f7c3-479b-ba60-8de2f4539f82 => generated 1336 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:23:24.028153 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-3ff1fd9e-fd1e-4e48-9a54-dac4adf095c2 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:24.050747 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-3ff1fd9e-fd1e-4e48-9a54-dac4adf095c2 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:24.052284 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-3ff1fd9e-fd1e-4e48-9a54-dac4adf095c2 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:24.053483 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-3ff1fd9e-fd1e-4e48-9a54-dac4adf095c2 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] 10.222.0.58 "GET /compute/v2.1/servers/7e091da3-0636-4cba-b8de-94fdeecf0b7f" status: 200 len: 1605 microversion: 2.32 time: 0.165995 Aug 10 23:23:24.054049 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2530/5273] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:23:23 2022] GET /compute/v2.1/servers/7e091da3-0636-4cba-b8de-94fdeecf0b7f => generated 1605 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 23:23:24.892935 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-035c9849-7a4f-4d04-a70c-7fccd22b8d2e tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:23:24.894529 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-035c9849-7a4f-4d04-a70c-7fccd22b8d2e tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] [instance: ebb9a0bf-74e7-4e0f-bad3-32d21bd3fb77] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:23:24.905508 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-035c9849-7a4f-4d04-a70c-7fccd22b8d2e tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:24.907310 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-035c9849-7a4f-4d04-a70c-7fccd22b8d2e tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:24.908150 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-035c9849-7a4f-4d04-a70c-7fccd22b8d2e tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:24.909533 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-035c9849-7a4f-4d04-a70c-7fccd22b8d2e tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:24.914756 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-035c9849-7a4f-4d04-a70c-7fccd22b8d2e tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:24.917136 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-035c9849-7a4f-4d04-a70c-7fccd22b8d2e tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:24.944708 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-4970175c-b17d-4ddc-a668-2b20ca7a58c6 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:23:24.945464 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-4970175c-b17d-4ddc-a668-2b20ca7a58c6 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] [instance: 9aebc95f-f7c3-479b-ba60-8de2f4539f82] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:23:24.960734 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4970175c-b17d-4ddc-a668-2b20ca7a58c6 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:24.961386 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4970175c-b17d-4ddc-a668-2b20ca7a58c6 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:24.962023 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4970175c-b17d-4ddc-a668-2b20ca7a58c6 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:24.963459 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4970175c-b17d-4ddc-a668-2b20ca7a58c6 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:24.974880 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4970175c-b17d-4ddc-a668-2b20ca7a58c6 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:24.975678 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4970175c-b17d-4ddc-a668-2b20ca7a58c6 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:25.070370 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-4970175c-b17d-4ddc-a668-2b20ca7a58c6 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3f44535879e47f3b3a39d551418eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d608b3eb7b4d1b965981b5ea727a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:25.082443 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-4970175c-b17d-4ddc-a668-2b20ca7a58c6 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3f44535879e47f3b3a39d551418eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d608b3eb7b4d1b965981b5ea727a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:25.084275 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-4970175c-b17d-4ddc-a668-2b20ca7a58c6 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3f44535879e47f3b3a39d551418eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d608b3eb7b4d1b965981b5ea727a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:25.088802 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-4970175c-b17d-4ddc-a668-2b20ca7a58c6 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] 10.222.0.58 "GET /compute/v2.1/servers/9aebc95f-f7c3-479b-ba60-8de2f4539f82" status: 200 len: 1357 microversion: 2.57 time: 0.146658 Aug 10 23:23:25.090139 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2531/5274] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:23:24 2022] GET /compute/v2.1/servers/9aebc95f-f7c3-479b-ba60-8de2f4539f82 => generated 1357 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:23:25.095812 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-2141a213-1519-472a-9943-26f656878dab tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:23:25.096836 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-2141a213-1519-472a-9943-26f656878dab tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] [instance: 7e091da3-0636-4cba-b8de-94fdeecf0b7f] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:23:25.105247 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2141a213-1519-472a-9943-26f656878dab tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:25.106119 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2141a213-1519-472a-9943-26f656878dab tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:25.106942 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2141a213-1519-472a-9943-26f656878dab tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:25.107977 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2141a213-1519-472a-9943-26f656878dab tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:25.108752 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2141a213-1519-472a-9943-26f656878dab tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:25.109326 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2141a213-1519-472a-9943-26f656878dab tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:25.192359 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-2141a213-1519-472a-9943-26f656878dab tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:25.229391 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-2141a213-1519-472a-9943-26f656878dab tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:25.236232 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-2141a213-1519-472a-9943-26f656878dab tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:25.237591 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-2141a213-1519-472a-9943-26f656878dab tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] 10.222.0.58 "GET /compute/v2.1/servers/7e091da3-0636-4cba-b8de-94fdeecf0b7f" status: 200 len: 1605 microversion: 2.32 time: 0.146230 Aug 10 23:23:25.238336 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2532/5275] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:23:25 2022] GET /compute/v2.1/servers/7e091da3-0636-4cba-b8de-94fdeecf0b7f => generated 1605 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:23:25.249479 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-3ce05481-ad79-4030-9b3f-c43ba707dabe tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:23:25.258206 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-3ce05481-ad79-4030-9b3f-c43ba707dabe tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] [instance: 9aebc95f-f7c3-479b-ba60-8de2f4539f82] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:23:25.268886 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3ce05481-ad79-4030-9b3f-c43ba707dabe tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:25.269382 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3ce05481-ad79-4030-9b3f-c43ba707dabe tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:25.269817 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3ce05481-ad79-4030-9b3f-c43ba707dabe tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:25.271008 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3ce05481-ad79-4030-9b3f-c43ba707dabe tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:25.271465 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3ce05481-ad79-4030-9b3f-c43ba707dabe tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:25.271897 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3ce05481-ad79-4030-9b3f-c43ba707dabe tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:25.285937 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-035c9849-7a4f-4d04-a70c-7fccd22b8d2e tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2be6f687ffa44c00ab6deb4d7a78eb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492ef66ca40744bbb9b6a7e847929a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:25.297416 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-035c9849-7a4f-4d04-a70c-7fccd22b8d2e tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] 10.222.0.58 "GET /compute/v2.1/servers/ebb9a0bf-74e7-4e0f-bad3-32d21bd3fb77" status: 200 len: 1502 microversion: 2.1 time: 0.411210 Aug 10 23:23:25.310882 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2744/5276] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:23:24 2022] GET /compute/v2.1/servers/ebb9a0bf-74e7-4e0f-bad3-32d21bd3fb77 => generated 1502 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:23:25.320845 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-f86e4a9b-62da-4d31-b7e2-caa9544cddd4 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:23:25.324200 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-f86e4a9b-62da-4d31-b7e2-caa9544cddd4 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] [instance: ebb9a0bf-74e7-4e0f-bad3-32d21bd3fb77] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:23:25.335267 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f86e4a9b-62da-4d31-b7e2-caa9544cddd4 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:25.336010 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f86e4a9b-62da-4d31-b7e2-caa9544cddd4 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:25.336562 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f86e4a9b-62da-4d31-b7e2-caa9544cddd4 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:25.338432 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f86e4a9b-62da-4d31-b7e2-caa9544cddd4 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:25.339847 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f86e4a9b-62da-4d31-b7e2-caa9544cddd4 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:25.340746 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f86e4a9b-62da-4d31-b7e2-caa9544cddd4 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:25.371314 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.objects.instance [None req-f86e4a9b-62da-4d31-b7e2-caa9544cddd4 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Lazy-loading 'flavor' on Instance uuid ebb9a0bf-74e7-4e0f-bad3-32d21bd3fb77 {{(pid=122633) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:23:25.437374 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-3ce05481-ad79-4030-9b3f-c43ba707dabe tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Flavor limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:23:25.438083 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-3ce05481-ad79-4030-9b3f-c43ba707dabe tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Image limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:23:25.438886 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-3ce05481-ad79-4030-9b3f-c43ba707dabe tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Flavor pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:23:25.441007 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-3ce05481-ad79-4030-9b3f-c43ba707dabe tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Image pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:23:25.441958 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-3ce05481-ad79-4030-9b3f-c43ba707dabe tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:23:25.462864 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-f86e4a9b-62da-4d31-b7e2-caa9544cddd4 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] 10.222.0.58 "POST /compute/v2.1/servers/ebb9a0bf-74e7-4e0f-bad3-32d21bd3fb77/action" status: 202 len: 0 microversion: 2.1 time: 0.144342 Aug 10 23:23:25.467261 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2745/5277] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:23:25 2022] POST /compute/v2.1/servers/ebb9a0bf-74e7-4e0f-bad3-32d21bd3fb77/action => generated 0 bytes in 151 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 10 23:23:25.474810 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-6cdedf93-d4f8-412f-9764-cb5e23e556eb tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:23:25.475366 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-6cdedf93-d4f8-412f-9764-cb5e23e556eb tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] [instance: ebb9a0bf-74e7-4e0f-bad3-32d21bd3fb77] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:23:25.486233 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6cdedf93-d4f8-412f-9764-cb5e23e556eb tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:25.487099 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6cdedf93-d4f8-412f-9764-cb5e23e556eb tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:25.487734 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6cdedf93-d4f8-412f-9764-cb5e23e556eb tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:25.488819 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6cdedf93-d4f8-412f-9764-cb5e23e556eb tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:25.489250 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6cdedf93-d4f8-412f-9764-cb5e23e556eb tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:25.490663 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6cdedf93-d4f8-412f-9764-cb5e23e556eb tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:25.562805 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-3ce05481-ad79-4030-9b3f-c43ba707dabe tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] [instance: 9aebc95f-f7c3-479b-ba60-8de2f4539f82] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:23:25.573173 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3ce05481-ad79-4030-9b3f-c43ba707dabe tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:25.574022 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3ce05481-ad79-4030-9b3f-c43ba707dabe tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:25.575034 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3ce05481-ad79-4030-9b3f-c43ba707dabe tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:25.577179 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3ce05481-ad79-4030-9b3f-c43ba707dabe tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:25.577860 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3ce05481-ad79-4030-9b3f-c43ba707dabe tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:25.578439 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3ce05481-ad79-4030-9b3f-c43ba707dabe tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:25.640653 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-3ce05481-ad79-4030-9b3f-c43ba707dabe tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] 10.222.0.58 "POST /compute/v2.1/servers/9aebc95f-f7c3-479b-ba60-8de2f4539f82/action" status: 202 len: 1138 microversion: 2.57 time: 0.398706 Aug 10 23:23:25.657690 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2533/5278] 10.222.0.58 () {62 vars in 1320 bytes} [Wed Aug 10 23:23:25 2022] POST /compute/v2.1/servers/9aebc95f-f7c3-479b-ba60-8de2f4539f82/action => generated 1138 bytes in 418 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 10 23:23:25.663777 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-d4bb7817-405c-4996-a006-6805167891a9 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:23:25.664769 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-d4bb7817-405c-4996-a006-6805167891a9 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] [instance: 9aebc95f-f7c3-479b-ba60-8de2f4539f82] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:23:25.671805 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d4bb7817-405c-4996-a006-6805167891a9 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:25.672870 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d4bb7817-405c-4996-a006-6805167891a9 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:25.673606 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d4bb7817-405c-4996-a006-6805167891a9 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:25.674726 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d4bb7817-405c-4996-a006-6805167891a9 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:25.675661 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d4bb7817-405c-4996-a006-6805167891a9 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:25.676606 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d4bb7817-405c-4996-a006-6805167891a9 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:25.705052 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-6cdedf93-d4f8-412f-9764-cb5e23e556eb tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2be6f687ffa44c00ab6deb4d7a78eb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492ef66ca40744bbb9b6a7e847929a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:25.714290 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-6cdedf93-d4f8-412f-9764-cb5e23e556eb tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] 10.222.0.58 "GET /compute/v2.1/servers/ebb9a0bf-74e7-4e0f-bad3-32d21bd3fb77" status: 200 len: 1510 microversion: 2.1 time: 0.245539 Aug 10 23:23:25.715164 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2746/5279] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:23:25 2022] GET /compute/v2.1/servers/ebb9a0bf-74e7-4e0f-bad3-32d21bd3fb77 => generated 1510 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:23:25.794689 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-d4bb7817-405c-4996-a006-6805167891a9 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3f44535879e47f3b3a39d551418eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d608b3eb7b4d1b965981b5ea727a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:25.807679 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-d4bb7817-405c-4996-a006-6805167891a9 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3f44535879e47f3b3a39d551418eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d608b3eb7b4d1b965981b5ea727a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:25.809539 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-d4bb7817-405c-4996-a006-6805167891a9 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3f44535879e47f3b3a39d551418eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d608b3eb7b4d1b965981b5ea727a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:25.810938 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-d4bb7817-405c-4996-a006-6805167891a9 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] 10.222.0.58 "GET /compute/v2.1/servers/9aebc95f-f7c3-479b-ba60-8de2f4539f82" status: 200 len: 1366 microversion: 2.57 time: 0.151420 Aug 10 23:23:25.823699 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2534/5280] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:23:25 2022] GET /compute/v2.1/servers/9aebc95f-f7c3-479b-ba60-8de2f4539f82 => generated 1366 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:23:26.271294 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-e2ffc1e4-1a6a-4b00-828c-529eaa22bd86 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:23:26.272404 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-e2ffc1e4-1a6a-4b00-828c-529eaa22bd86 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] [instance: 7e091da3-0636-4cba-b8de-94fdeecf0b7f] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:23:26.285257 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e2ffc1e4-1a6a-4b00-828c-529eaa22bd86 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:26.286005 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e2ffc1e4-1a6a-4b00-828c-529eaa22bd86 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:26.286459 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e2ffc1e4-1a6a-4b00-828c-529eaa22bd86 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:26.287207 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e2ffc1e4-1a6a-4b00-828c-529eaa22bd86 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:26.287669 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e2ffc1e4-1a6a-4b00-828c-529eaa22bd86 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:26.288100 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e2ffc1e4-1a6a-4b00-828c-529eaa22bd86 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:26.378648 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-e2ffc1e4-1a6a-4b00-828c-529eaa22bd86 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:26.390201 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-e2ffc1e4-1a6a-4b00-828c-529eaa22bd86 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:26.391788 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-e2ffc1e4-1a6a-4b00-828c-529eaa22bd86 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1622d26ca18940cbbaba5eb72ce382d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bfebe97ce8df4dab9b53298700295139', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:26.393369 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-e2ffc1e4-1a6a-4b00-828c-529eaa22bd86 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] 10.222.0.58 "GET /compute/v2.1/servers/7e091da3-0636-4cba-b8de-94fdeecf0b7f" status: 200 len: 1605 microversion: 2.32 time: 0.126390 Aug 10 23:23:26.394512 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2747/5281] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:23:26 2022] GET /compute/v2.1/servers/7e091da3-0636-4cba-b8de-94fdeecf0b7f => generated 1605 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:23:26.737041 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-7d433a90-cd55-4689-96fa-286ce43d236d tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:23:26.737667 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-7d433a90-cd55-4689-96fa-286ce43d236d tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] [instance: ebb9a0bf-74e7-4e0f-bad3-32d21bd3fb77] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:23:26.746030 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7d433a90-cd55-4689-96fa-286ce43d236d tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:26.746533 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7d433a90-cd55-4689-96fa-286ce43d236d tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:26.751136 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7d433a90-cd55-4689-96fa-286ce43d236d tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:26.752418 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7d433a90-cd55-4689-96fa-286ce43d236d tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:26.755841 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7d433a90-cd55-4689-96fa-286ce43d236d tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:26.756378 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7d433a90-cd55-4689-96fa-286ce43d236d tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:26.835980 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-9393c87b-826a-4e9e-8eb3-2525ae0bbf6c tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:23:26.836778 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-9393c87b-826a-4e9e-8eb3-2525ae0bbf6c tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] [instance: 9aebc95f-f7c3-479b-ba60-8de2f4539f82] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:23:26.860823 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9393c87b-826a-4e9e-8eb3-2525ae0bbf6c tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:26.861573 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9393c87b-826a-4e9e-8eb3-2525ae0bbf6c tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:26.862186 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9393c87b-826a-4e9e-8eb3-2525ae0bbf6c tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:26.863106 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9393c87b-826a-4e9e-8eb3-2525ae0bbf6c tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:26.863736 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9393c87b-826a-4e9e-8eb3-2525ae0bbf6c tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:26.864172 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9393c87b-826a-4e9e-8eb3-2525ae0bbf6c tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:26.969305 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-9393c87b-826a-4e9e-8eb3-2525ae0bbf6c tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3f44535879e47f3b3a39d551418eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d608b3eb7b4d1b965981b5ea727a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:26.980414 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-9393c87b-826a-4e9e-8eb3-2525ae0bbf6c tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3f44535879e47f3b3a39d551418eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d608b3eb7b4d1b965981b5ea727a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:26.982565 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-9393c87b-826a-4e9e-8eb3-2525ae0bbf6c tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3f44535879e47f3b3a39d551418eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d608b3eb7b4d1b965981b5ea727a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:26.983174 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-9393c87b-826a-4e9e-8eb3-2525ae0bbf6c tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] 10.222.0.58 "GET /compute/v2.1/servers/9aebc95f-f7c3-479b-ba60-8de2f4539f82" status: 200 len: 1366 microversion: 2.57 time: 0.151797 Aug 10 23:23:26.999364 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2748/5282] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:23:26 2022] GET /compute/v2.1/servers/9aebc95f-f7c3-479b-ba60-8de2f4539f82 => generated 1366 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:23:27.038445 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-7d433a90-cd55-4689-96fa-286ce43d236d tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2be6f687ffa44c00ab6deb4d7a78eb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492ef66ca40744bbb9b6a7e847929a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:27.049504 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-7d433a90-cd55-4689-96fa-286ce43d236d tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] 10.222.0.58 "GET /compute/v2.1/servers/ebb9a0bf-74e7-4e0f-bad3-32d21bd3fb77" status: 200 len: 1493 microversion: 2.1 time: 0.316473 Aug 10 23:23:27.050820 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2535/5283] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:23:26 2022] GET /compute/v2.1/servers/ebb9a0bf-74e7-4e0f-bad3-32d21bd3fb77 => generated 1493 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:23:27.073565 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-7d94fc58-738c-459b-8af5-9315b6050ccc tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:23:27.074096 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-7d94fc58-738c-459b-8af5-9315b6050ccc tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] [instance: ebb9a0bf-74e7-4e0f-bad3-32d21bd3fb77] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:23:27.093940 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7d94fc58-738c-459b-8af5-9315b6050ccc tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:27.095836 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7d94fc58-738c-459b-8af5-9315b6050ccc tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:27.096602 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7d94fc58-738c-459b-8af5-9315b6050ccc tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:27.098298 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7d94fc58-738c-459b-8af5-9315b6050ccc tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:27.100495 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7d94fc58-738c-459b-8af5-9315b6050ccc tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:27.101452 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7d94fc58-738c-459b-8af5-9315b6050ccc tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:27.141347 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:23:27.223951 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-7d94fc58-738c-459b-8af5-9315b6050ccc tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] 10.222.0.58 "POST /compute/v2.1/servers/ebb9a0bf-74e7-4e0f-bad3-32d21bd3fb77/action" status: 202 len: 0 microversion: 2.1 time: 0.154577 Aug 10 23:23:27.225442 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2749/5284] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:23:27 2022] POST /compute/v2.1/servers/ebb9a0bf-74e7-4e0f-bad3-32d21bd3fb77/action => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:23:27.254682 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-234bb9f2-1d58-4019-ae09-ba600b092f3f tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:23:27.255460 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-234bb9f2-1d58-4019-ae09-ba600b092f3f tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] [instance: ebb9a0bf-74e7-4e0f-bad3-32d21bd3fb77] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:23:27.280991 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-234bb9f2-1d58-4019-ae09-ba600b092f3f tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:27.281431 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-234bb9f2-1d58-4019-ae09-ba600b092f3f tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:27.282195 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-234bb9f2-1d58-4019-ae09-ba600b092f3f tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:27.283190 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-234bb9f2-1d58-4019-ae09-ba600b092f3f tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:27.283816 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-234bb9f2-1d58-4019-ae09-ba600b092f3f tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:27.284415 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-234bb9f2-1d58-4019-ae09-ba600b092f3f tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:27.421194 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-9d1c557c-aca0-468f-993e-308dc09b57e3 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:23:27.422405 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-9d1c557c-aca0-468f-993e-308dc09b57e3 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] [instance: 7e091da3-0636-4cba-b8de-94fdeecf0b7f] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:23:27.430710 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9d1c557c-aca0-468f-993e-308dc09b57e3 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:27.432459 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9d1c557c-aca0-468f-993e-308dc09b57e3 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:27.433060 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9d1c557c-aca0-468f-993e-308dc09b57e3 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:27.433964 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9d1c557c-aca0-468f-993e-308dc09b57e3 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:27.434569 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9d1c557c-aca0-468f-993e-308dc09b57e3 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:27.435304 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9d1c557c-aca0-468f-993e-308dc09b57e3 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:27.453592 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-9d1c557c-aca0-468f-993e-308dc09b57e3 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] HTTP exception thrown: Instance 7e091da3-0636-4cba-b8de-94fdeecf0b7f could not be found. Aug 10 23:23:27.455792 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-9d1c557c-aca0-468f-993e-308dc09b57e3 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Request method failure captured: Aug 10 23:23:27.455792 n-d-850468-14 devstack@n-api.service[122633]: request: GET /compute/v2.1/servers/7e091da3-0636-4cba-b8de-94fdeecf0b7f HTTP/1.1 Aug 10 23:23:27.455792 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:23:27.455792 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:23:27.455792 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:23:27.455792 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:23:27.455792 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:23:27.455792 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:23:27.455792 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:23:27.455792 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:23:27.455792 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9DxPoik3qqc8GE5jnVPvsy-1cVbtLBl574wA6n-r6ez-tXNdD_4DaVlXGwG84PbYqiTlvFXUHOab6PUt1mkrW0PRXq2OjkPyD6TAI76mFTEnlIwIKqYwj4UXZM4sRRg7cfuidTTc2DGtIN0do-UwiF-KtaEyY2Nt_Jx5HNbGOVoYQz4 Aug 10 23:23:27.455792 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:23:27.455792 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:23:27.455792 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:23:27.455792 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:23:27.455792 n-d-850468-14 devstack@n-api.service[122633]: X-Openstack-Nova-Api-Version: 2.32 Aug 10 23:23:27.455792 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:23:27.455792 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:23:27.455792 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: bfebe97ce8df4dab9b53298700295139 Aug 10 23:23:27.455792 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-TaggedBootDevicesTest-1955966987 Aug 10 23:23:27.455792 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:23:27.455792 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:23:27.455792 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/bfebe97ce8df4dab9b53298700295139"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/bfebe97ce8df4dab9b53298700295139"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/bfebe97ce8df4dab9b53298700295139"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_bfebe97ce8df4dab9b53298700295139", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:23:27.455792 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-TaggedBootDevicesTest-1955966987 Aug 10 23:23:27.455792 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: bfebe97ce8df4dab9b53298700295139 Aug 10 23:23:27.455792 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1955966987 Aug 10 23:23:27.455792 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-TaggedBootDevicesTest-1955966987-project Aug 10 23:23:27.455792 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:23:27.455792 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:23:27.455792 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 1622d26ca18940cbbaba5eb72ce382d7 Aug 10 23:23:27.455792 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-TaggedBootDevicesTest-1955966987-project Aug 10 23:23:27.455792 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:23:27.455792 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance 7e091da3-0636-4cba-b8de-94fdeecf0b7f could not be found. Aug 10 23:23:27.455792 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': '7e091da3-0636-4cba-b8de-94fdeecf0b7f'} Aug 10 23:23:27.455792 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:23:27.455792 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:23:27.455792 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:23:27.455792 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:23:27.455792 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:23:27.455792 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:23:27.455792 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:23:27.455792 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:23:27.455792 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:23:27.455792 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:23:27.455792 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e091da3-0636-4cba-b8de-94fdeecf0b7f could not be found. Aug 10 23:23:27.455792 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:23:27.455792 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:23:27.455792 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:23:27.455792 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:23:27.455792 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:23:27.455792 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:23:27.455792 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:23:27.455792 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:23:27.455792 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:23:27.455792 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:23:27.455792 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:23:27.455792 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:23:27.455792 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:23:27.455792 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:23:27.455792 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:23:27.455792 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:23:27.455792 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e091da3-0636-4cba-b8de-94fdeecf0b7f could not be found. Aug 10 23:23:27.455792 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:23:27.455792 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:23:27.460147 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:23:27.460147 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:23:27.460147 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:23:27.460147 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:23:27.460147 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:23:27.460147 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:23:27.460147 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e091da3-0636-4cba-b8de-94fdeecf0b7f could not be found. Aug 10 23:23:27.460147 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:23:27.460147 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-9d1c557c-aca0-468f-993e-308dc09b57e3 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Returning 404 to user: Instance 7e091da3-0636-4cba-b8de-94fdeecf0b7f could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:23:27.460147 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-9d1c557c-aca0-468f-993e-308dc09b57e3 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] 10.222.0.58 "GET /compute/v2.1/servers/7e091da3-0636-4cba-b8de-94fdeecf0b7f" status: 404 len: 111 microversion: 2.32 time: 0.043175 Aug 10 23:23:27.461828 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2750/5285] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:23:27 2022] GET /compute/v2.1/servers/7e091da3-0636-4cba-b8de-94fdeecf0b7f => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 10 23:23:27.468762 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c3524aed-7a79-42da-91a1-ae759e699465 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Calling method '.version_select at 0x7f847d445430>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:23:27.532282 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-c3524aed-7a79-42da-91a1-ae759e699465 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1181065274" status: 204 len: 0 microversion: 2.32 time: 0.067895 Aug 10 23:23:27.532989 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2751/5286] 10.222.0.58 () {60 vars in 1262 bytes} [Wed Aug 10 23:23:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1181065274 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 10 23:23:27.782640 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-234bb9f2-1d58-4019-ae09-ba600b092f3f tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2be6f687ffa44c00ab6deb4d7a78eb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492ef66ca40744bbb9b6a7e847929a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:27.799575 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-234bb9f2-1d58-4019-ae09-ba600b092f3f tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] 10.222.0.58 "GET /compute/v2.1/servers/ebb9a0bf-74e7-4e0f-bad3-32d21bd3fb77" status: 200 len: 1499 microversion: 2.1 time: 0.568894 Aug 10 23:23:27.800353 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2536/5287] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:23:27 2022] GET /compute/v2.1/servers/ebb9a0bf-74e7-4e0f-bad3-32d21bd3fb77 => generated 1499 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:23:28.010250 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-e950f8c9-b08a-4a3a-a783-c6cbfe0ff784 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:23:28.011835 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-e950f8c9-b08a-4a3a-a783-c6cbfe0ff784 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] [instance: 9aebc95f-f7c3-479b-ba60-8de2f4539f82] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:23:28.023564 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e950f8c9-b08a-4a3a-a783-c6cbfe0ff784 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:28.025354 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e950f8c9-b08a-4a3a-a783-c6cbfe0ff784 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:28.026449 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e950f8c9-b08a-4a3a-a783-c6cbfe0ff784 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:28.027408 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e950f8c9-b08a-4a3a-a783-c6cbfe0ff784 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:28.028699 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e950f8c9-b08a-4a3a-a783-c6cbfe0ff784 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:28.029407 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e950f8c9-b08a-4a3a-a783-c6cbfe0ff784 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:28.145676 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-e950f8c9-b08a-4a3a-a783-c6cbfe0ff784 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3f44535879e47f3b3a39d551418eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d608b3eb7b4d1b965981b5ea727a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:28.157730 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-e950f8c9-b08a-4a3a-a783-c6cbfe0ff784 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3f44535879e47f3b3a39d551418eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d608b3eb7b4d1b965981b5ea727a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:28.161251 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-e950f8c9-b08a-4a3a-a783-c6cbfe0ff784 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3f44535879e47f3b3a39d551418eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d608b3eb7b4d1b965981b5ea727a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:28.163484 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-e950f8c9-b08a-4a3a-a783-c6cbfe0ff784 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] 10.222.0.58 "GET /compute/v2.1/servers/9aebc95f-f7c3-479b-ba60-8de2f4539f82" status: 200 len: 1366 microversion: 2.57 time: 0.160550 Aug 10 23:23:28.164805 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2752/5288] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:23:28 2022] GET /compute/v2.1/servers/9aebc95f-f7c3-479b-ba60-8de2f4539f82 => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:23:28.821254 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-a112c932-d97b-4e14-96aa-bf4c6119d585 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:23:28.822627 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-a112c932-d97b-4e14-96aa-bf4c6119d585 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] [instance: ebb9a0bf-74e7-4e0f-bad3-32d21bd3fb77] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:23:28.833049 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a112c932-d97b-4e14-96aa-bf4c6119d585 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:28.833999 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a112c932-d97b-4e14-96aa-bf4c6119d585 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:28.834600 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a112c932-d97b-4e14-96aa-bf4c6119d585 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:28.835514 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a112c932-d97b-4e14-96aa-bf4c6119d585 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:28.836421 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a112c932-d97b-4e14-96aa-bf4c6119d585 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:28.837146 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a112c932-d97b-4e14-96aa-bf4c6119d585 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:29.188938 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-f2aa5a46-abc7-423e-8b74-fb18ae30921a tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:23:29.189403 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-f2aa5a46-abc7-423e-8b74-fb18ae30921a tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] [instance: 9aebc95f-f7c3-479b-ba60-8de2f4539f82] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:23:29.201415 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f2aa5a46-abc7-423e-8b74-fb18ae30921a tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:29.206150 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f2aa5a46-abc7-423e-8b74-fb18ae30921a tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:29.206771 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f2aa5a46-abc7-423e-8b74-fb18ae30921a tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:29.207571 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f2aa5a46-abc7-423e-8b74-fb18ae30921a tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:29.208047 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f2aa5a46-abc7-423e-8b74-fb18ae30921a tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:29.213183 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f2aa5a46-abc7-423e-8b74-fb18ae30921a tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:29.271644 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-a112c932-d97b-4e14-96aa-bf4c6119d585 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2be6f687ffa44c00ab6deb4d7a78eb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492ef66ca40744bbb9b6a7e847929a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:29.281215 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-a112c932-d97b-4e14-96aa-bf4c6119d585 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] 10.222.0.58 "GET /compute/v2.1/servers/ebb9a0bf-74e7-4e0f-bad3-32d21bd3fb77" status: 200 len: 1499 microversion: 2.1 time: 0.463691 Aug 10 23:23:29.289768 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2537/5289] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:23:28 2022] GET /compute/v2.1/servers/ebb9a0bf-74e7-4e0f-bad3-32d21bd3fb77 => generated 1499 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:23:29.413226 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-f2aa5a46-abc7-423e-8b74-fb18ae30921a tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3f44535879e47f3b3a39d551418eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d608b3eb7b4d1b965981b5ea727a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:29.430306 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-f2aa5a46-abc7-423e-8b74-fb18ae30921a tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3f44535879e47f3b3a39d551418eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d608b3eb7b4d1b965981b5ea727a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:29.433530 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-f2aa5a46-abc7-423e-8b74-fb18ae30921a tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3f44535879e47f3b3a39d551418eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d608b3eb7b4d1b965981b5ea727a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:29.434840 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-f2aa5a46-abc7-423e-8b74-fb18ae30921a tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] 10.222.0.58 "GET /compute/v2.1/servers/9aebc95f-f7c3-479b-ba60-8de2f4539f82" status: 200 len: 1366 microversion: 2.57 time: 0.250218 Aug 10 23:23:29.436110 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2753/5290] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:23:29 2022] GET /compute/v2.1/servers/9aebc95f-f7c3-479b-ba60-8de2f4539f82 => generated 1366 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 23:23:30.314161 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-4a8b387f-20b8-48dc-aae6-e86eae5692ce tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:23:30.316192 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-4a8b387f-20b8-48dc-aae6-e86eae5692ce tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] [instance: ebb9a0bf-74e7-4e0f-bad3-32d21bd3fb77] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:23:30.340950 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4a8b387f-20b8-48dc-aae6-e86eae5692ce tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:30.351482 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4a8b387f-20b8-48dc-aae6-e86eae5692ce tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:30.352097 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4a8b387f-20b8-48dc-aae6-e86eae5692ce tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:30.353405 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4a8b387f-20b8-48dc-aae6-e86eae5692ce tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:30.354021 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4a8b387f-20b8-48dc-aae6-e86eae5692ce tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:30.354315 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4a8b387f-20b8-48dc-aae6-e86eae5692ce tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:30.468703 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-320d1ada-d34b-488c-a065-e4a793f4e1be tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:23:30.469965 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-320d1ada-d34b-488c-a065-e4a793f4e1be tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] [instance: 9aebc95f-f7c3-479b-ba60-8de2f4539f82] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:23:30.532313 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-320d1ada-d34b-488c-a065-e4a793f4e1be tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:30.532997 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-320d1ada-d34b-488c-a065-e4a793f4e1be tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:30.533437 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-320d1ada-d34b-488c-a065-e4a793f4e1be tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:30.534147 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-320d1ada-d34b-488c-a065-e4a793f4e1be tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:30.540436 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-320d1ada-d34b-488c-a065-e4a793f4e1be tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:30.541206 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-320d1ada-d34b-488c-a065-e4a793f4e1be tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:30.828882 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-4a8b387f-20b8-48dc-aae6-e86eae5692ce tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2be6f687ffa44c00ab6deb4d7a78eb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492ef66ca40744bbb9b6a7e847929a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:30.837731 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-4a8b387f-20b8-48dc-aae6-e86eae5692ce tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] 10.222.0.58 "GET /compute/v2.1/servers/ebb9a0bf-74e7-4e0f-bad3-32d21bd3fb77" status: 200 len: 1502 microversion: 2.1 time: 0.531621 Aug 10 23:23:30.842617 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2538/5291] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:23:30 2022] GET /compute/v2.1/servers/ebb9a0bf-74e7-4e0f-bad3-32d21bd3fb77 => generated 1502 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:23:30.862232 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-e74e15e4-3078-4775-b04d-3275f4490001 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:23:30.862929 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-e74e15e4-3078-4775-b04d-3275f4490001 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] [instance: ebb9a0bf-74e7-4e0f-bad3-32d21bd3fb77] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:23:30.865570 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-320d1ada-d34b-488c-a065-e4a793f4e1be tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3f44535879e47f3b3a39d551418eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d608b3eb7b4d1b965981b5ea727a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:30.876438 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e74e15e4-3078-4775-b04d-3275f4490001 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:30.881656 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e74e15e4-3078-4775-b04d-3275f4490001 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:30.882266 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e74e15e4-3078-4775-b04d-3275f4490001 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:30.888146 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-320d1ada-d34b-488c-a065-e4a793f4e1be tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3f44535879e47f3b3a39d551418eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d608b3eb7b4d1b965981b5ea727a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:30.889562 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e74e15e4-3078-4775-b04d-3275f4490001 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:30.892705 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e74e15e4-3078-4775-b04d-3275f4490001 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:30.894691 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e74e15e4-3078-4775-b04d-3275f4490001 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:30.894853 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-320d1ada-d34b-488c-a065-e4a793f4e1be tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3f44535879e47f3b3a39d551418eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d608b3eb7b4d1b965981b5ea727a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:30.896942 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-320d1ada-d34b-488c-a065-e4a793f4e1be tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] 10.222.0.58 "GET /compute/v2.1/servers/9aebc95f-f7c3-479b-ba60-8de2f4539f82" status: 200 len: 1366 microversion: 2.57 time: 0.434956 Aug 10 23:23:30.902657 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:23:30.913795 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2754/5292] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:23:30 2022] GET /compute/v2.1/servers/9aebc95f-f7c3-479b-ba60-8de2f4539f82 => generated 1366 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 23:23:30.961250 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-e74e15e4-3078-4775-b04d-3275f4490001 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] [instance: ebb9a0bf-74e7-4e0f-bad3-32d21bd3fb77] Going to try to terminate instance {{(pid=122632) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:23:30.996258 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=2 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:23:31.092200 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=6 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:23:31.242479 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-e74e15e4-3078-4775-b04d-3275f4490001 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] 10.222.0.58 "DELETE /compute/v2.1/servers/ebb9a0bf-74e7-4e0f-bad3-32d21bd3fb77" status: 204 len: 0 microversion: 2.1 time: 0.384037 Aug 10 23:23:31.247245 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2539/5293] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:23:30 2022] DELETE /compute/v2.1/servers/ebb9a0bf-74e7-4e0f-bad3-32d21bd3fb77 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:23:31.256718 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-cbce6b1e-2e3f-4245-b2f7-fb0a7063e324 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:23:31.257996 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-cbce6b1e-2e3f-4245-b2f7-fb0a7063e324 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] [instance: ebb9a0bf-74e7-4e0f-bad3-32d21bd3fb77] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:23:31.266807 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cbce6b1e-2e3f-4245-b2f7-fb0a7063e324 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:31.272650 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cbce6b1e-2e3f-4245-b2f7-fb0a7063e324 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:31.273490 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cbce6b1e-2e3f-4245-b2f7-fb0a7063e324 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:31.275062 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cbce6b1e-2e3f-4245-b2f7-fb0a7063e324 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:31.275760 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cbce6b1e-2e3f-4245-b2f7-fb0a7063e324 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:31.276387 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cbce6b1e-2e3f-4245-b2f7-fb0a7063e324 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:31.295389 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=2 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:23:31.826289 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-cbce6b1e-2e3f-4245-b2f7-fb0a7063e324 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2be6f687ffa44c00ab6deb4d7a78eb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492ef66ca40744bbb9b6a7e847929a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:31.834628 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-cbce6b1e-2e3f-4245-b2f7-fb0a7063e324 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] 10.222.0.58 "GET /compute/v2.1/servers/ebb9a0bf-74e7-4e0f-bad3-32d21bd3fb77" status: 200 len: 1508 microversion: 2.1 time: 0.583136 Aug 10 23:23:31.840071 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2755/5294] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:23:31 2022] GET /compute/v2.1/servers/ebb9a0bf-74e7-4e0f-bad3-32d21bd3fb77 => generated 1508 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:23:31.924809 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-351f6442-f65f-45df-9efb-b4d1b43564a7 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:23:31.925530 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-351f6442-f65f-45df-9efb-b4d1b43564a7 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] [instance: 9aebc95f-f7c3-479b-ba60-8de2f4539f82] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:23:31.938178 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-351f6442-f65f-45df-9efb-b4d1b43564a7 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:31.938939 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-351f6442-f65f-45df-9efb-b4d1b43564a7 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:31.939590 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-351f6442-f65f-45df-9efb-b4d1b43564a7 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:31.940549 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-351f6442-f65f-45df-9efb-b4d1b43564a7 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:31.941238 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-351f6442-f65f-45df-9efb-b4d1b43564a7 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:31.942097 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-351f6442-f65f-45df-9efb-b4d1b43564a7 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:32.144767 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-351f6442-f65f-45df-9efb-b4d1b43564a7 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3f44535879e47f3b3a39d551418eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d608b3eb7b4d1b965981b5ea727a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:32.158409 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-351f6442-f65f-45df-9efb-b4d1b43564a7 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3f44535879e47f3b3a39d551418eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d608b3eb7b4d1b965981b5ea727a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:32.167976 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-351f6442-f65f-45df-9efb-b4d1b43564a7 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3f44535879e47f3b3a39d551418eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d608b3eb7b4d1b965981b5ea727a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:32.174104 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-351f6442-f65f-45df-9efb-b4d1b43564a7 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] 10.222.0.58 "GET /compute/v2.1/servers/9aebc95f-f7c3-479b-ba60-8de2f4539f82" status: 200 len: 1366 microversion: 2.57 time: 0.253140 Aug 10 23:23:32.177206 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2540/5295] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:23:31 2022] GET /compute/v2.1/servers/9aebc95f-f7c3-479b-ba60-8de2f4539f82 => generated 1366 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:23:32.868688 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-80a65c5d-651e-4798-845a-a4f6bb52b8c0 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:23:32.869866 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-80a65c5d-651e-4798-845a-a4f6bb52b8c0 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] [instance: ebb9a0bf-74e7-4e0f-bad3-32d21bd3fb77] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:23:32.928314 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-80a65c5d-651e-4798-845a-a4f6bb52b8c0 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:32.930129 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-80a65c5d-651e-4798-845a-a4f6bb52b8c0 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:32.934322 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-80a65c5d-651e-4798-845a-a4f6bb52b8c0 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:32.935178 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-80a65c5d-651e-4798-845a-a4f6bb52b8c0 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:32.935800 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-80a65c5d-651e-4798-845a-a4f6bb52b8c0 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:32.936381 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-80a65c5d-651e-4798-845a-a4f6bb52b8c0 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:33.206524 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-534e1e63-773b-4b0a-84df-47720939b8ea tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:23:33.207688 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-534e1e63-773b-4b0a-84df-47720939b8ea tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] [instance: 9aebc95f-f7c3-479b-ba60-8de2f4539f82] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:23:33.227623 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:23:33.245052 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-534e1e63-773b-4b0a-84df-47720939b8ea tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:33.247425 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-534e1e63-773b-4b0a-84df-47720939b8ea tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:33.247921 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-534e1e63-773b-4b0a-84df-47720939b8ea tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:33.251193 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-534e1e63-773b-4b0a-84df-47720939b8ea tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:33.257092 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-534e1e63-773b-4b0a-84df-47720939b8ea tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:33.257621 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-534e1e63-773b-4b0a-84df-47720939b8ea tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:33.405899 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-534e1e63-773b-4b0a-84df-47720939b8ea tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3f44535879e47f3b3a39d551418eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d608b3eb7b4d1b965981b5ea727a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:33.415265 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-534e1e63-773b-4b0a-84df-47720939b8ea tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3f44535879e47f3b3a39d551418eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d608b3eb7b4d1b965981b5ea727a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:33.417661 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-534e1e63-773b-4b0a-84df-47720939b8ea tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3f44535879e47f3b3a39d551418eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d608b3eb7b4d1b965981b5ea727a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:33.424863 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-80a65c5d-651e-4798-845a-a4f6bb52b8c0 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2be6f687ffa44c00ab6deb4d7a78eb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492ef66ca40744bbb9b6a7e847929a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:33.425973 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-534e1e63-773b-4b0a-84df-47720939b8ea tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] 10.222.0.58 "GET /compute/v2.1/servers/9aebc95f-f7c3-479b-ba60-8de2f4539f82" status: 200 len: 1366 microversion: 2.57 time: 0.229011 Aug 10 23:23:33.435941 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-80a65c5d-651e-4798-845a-a4f6bb52b8c0 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] 10.222.0.58 "GET /compute/v2.1/servers/ebb9a0bf-74e7-4e0f-bad3-32d21bd3fb77" status: 200 len: 1508 microversion: 2.1 time: 0.574789 Aug 10 23:23:33.436526 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2756/5296] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:23:32 2022] GET /compute/v2.1/servers/ebb9a0bf-74e7-4e0f-bad3-32d21bd3fb77 => generated 1508 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:23:33.440967 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2541/5297] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:23:33 2022] GET /compute/v2.1/servers/9aebc95f-f7c3-479b-ba60-8de2f4539f82 => generated 1366 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 23:23:34.229382 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-644fe7a5-69da-428c-8849-fc07609c7b5c req-508646ae-5e03-4291-924a-785c37d50c58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebb9a0bf-74e7-4e0f-bad3-32d21bd3fb77", "name": "network-vif-deleted", "tag": "c9780f33-c5f4-421c-937a-6a501f26f058"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:23:34.262015 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-644fe7a5-69da-428c-8849-fc07609c7b5c req-508646ae-5e03-4291-924a-785c37d50c58 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:34.267594 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-644fe7a5-69da-428c-8849-fc07609c7b5c req-508646ae-5e03-4291-924a-785c37d50c58 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:34.268047 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-644fe7a5-69da-428c-8849-fc07609c7b5c req-508646ae-5e03-4291-924a-785c37d50c58 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:34.320214 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-644fe7a5-69da-428c-8849-fc07609c7b5c req-508646ae-5e03-4291-924a-785c37d50c58 service nova] Creating event network-vif-deleted:c9780f33-c5f4-421c-937a-6a501f26f058 for instance ebb9a0bf-74e7-4e0f-bad3-32d21bd3fb77 on n-h2-850468-14 Aug 10 23:23:34.348790 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-644fe7a5-69da-428c-8849-fc07609c7b5c req-508646ae-5e03-4291-924a-785c37d50c58 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123857 Aug 10 23:23:34.349795 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2757/5298] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:23:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:23:34.452108 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-d80d1b54-d7a7-43d9-b120-348744e4d80d tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:23:34.458752 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-63917a55-a4d6-46d2-b5c3-79d081f6c660 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:23:34.464427 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-d80d1b54-d7a7-43d9-b120-348744e4d80d tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] [instance: 9aebc95f-f7c3-479b-ba60-8de2f4539f82] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:23:34.465441 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-63917a55-a4d6-46d2-b5c3-79d081f6c660 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] [instance: ebb9a0bf-74e7-4e0f-bad3-32d21bd3fb77] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:23:34.487446 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-63917a55-a4d6-46d2-b5c3-79d081f6c660 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:34.489054 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d80d1b54-d7a7-43d9-b120-348744e4d80d tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:34.492031 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d80d1b54-d7a7-43d9-b120-348744e4d80d tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:34.493808 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d80d1b54-d7a7-43d9-b120-348744e4d80d tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:34.512298 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-63917a55-a4d6-46d2-b5c3-79d081f6c660 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:34.514069 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-63917a55-a4d6-46d2-b5c3-79d081f6c660 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:34.514554 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d80d1b54-d7a7-43d9-b120-348744e4d80d tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:34.515515 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-63917a55-a4d6-46d2-b5c3-79d081f6c660 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:34.516828 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d80d1b54-d7a7-43d9-b120-348744e4d80d tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:34.517436 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d80d1b54-d7a7-43d9-b120-348744e4d80d tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:34.518135 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-63917a55-a4d6-46d2-b5c3-79d081f6c660 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:34.523159 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-63917a55-a4d6-46d2-b5c3-79d081f6c660 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:34.630635 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-63917a55-a4d6-46d2-b5c3-79d081f6c660 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:34.639314 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-63917a55-a4d6-46d2-b5c3-79d081f6c660 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:34.639771 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-63917a55-a4d6-46d2-b5c3-79d081f6c660 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:34.640254 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.objects.instance [None req-63917a55-a4d6-46d2-b5c3-79d081f6c660 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Lazy-loading 'fault' on Instance uuid ebb9a0bf-74e7-4e0f-bad3-32d21bd3fb77 {{(pid=122633) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:23:34.803912 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-63917a55-a4d6-46d2-b5c3-79d081f6c660 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2be6f687ffa44c00ab6deb4d7a78eb5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492ef66ca40744bbb9b6a7e847929a8b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:34.812879 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-63917a55-a4d6-46d2-b5c3-79d081f6c660 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] 10.222.0.58 "GET /compute/v2.1/servers/ebb9a0bf-74e7-4e0f-bad3-32d21bd3fb77" status: 200 len: 1305 microversion: 2.1 time: 0.358444 Aug 10 23:23:34.819098 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2758/5299] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:23:34 2022] GET /compute/v2.1/servers/ebb9a0bf-74e7-4e0f-bad3-32d21bd3fb77 => generated 1305 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:23:35.405580 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-d80d1b54-d7a7-43d9-b120-348744e4d80d tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3f44535879e47f3b3a39d551418eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d608b3eb7b4d1b965981b5ea727a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:35.417194 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-d80d1b54-d7a7-43d9-b120-348744e4d80d tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3f44535879e47f3b3a39d551418eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d608b3eb7b4d1b965981b5ea727a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:35.421356 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-d80d1b54-d7a7-43d9-b120-348744e4d80d tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3f44535879e47f3b3a39d551418eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d608b3eb7b4d1b965981b5ea727a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:35.424878 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-d80d1b54-d7a7-43d9-b120-348744e4d80d tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] 10.222.0.58 "GET /compute/v2.1/servers/9aebc95f-f7c3-479b-ba60-8de2f4539f82" status: 200 len: 1366 microversion: 2.57 time: 0.976885 Aug 10 23:23:35.426053 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2542/5300] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:23:34 2022] GET /compute/v2.1/servers/9aebc95f-f7c3-479b-ba60-8de2f4539f82 => generated 1366 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:23:35.451569 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-f514d905-881e-4fad-914a-cd43c9963199 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:23:35.452590 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-f514d905-881e-4fad-914a-cd43c9963199 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] [instance: 7e091da3-0636-4cba-b8de-94fdeecf0b7f] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:23:35.464267 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f514d905-881e-4fad-914a-cd43c9963199 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:35.464998 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f514d905-881e-4fad-914a-cd43c9963199 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:35.465779 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f514d905-881e-4fad-914a-cd43c9963199 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:35.466744 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f514d905-881e-4fad-914a-cd43c9963199 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:35.467669 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f514d905-881e-4fad-914a-cd43c9963199 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:35.468322 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f514d905-881e-4fad-914a-cd43c9963199 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:35.489324 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-f514d905-881e-4fad-914a-cd43c9963199 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] HTTP exception thrown: Instance 7e091da3-0636-4cba-b8de-94fdeecf0b7f could not be found. Aug 10 23:23:35.491684 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-f514d905-881e-4fad-914a-cd43c9963199 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Request method failure captured: Aug 10 23:23:35.491684 n-d-850468-14 devstack@n-api.service[122633]: request: DELETE /compute/v2.1/servers/7e091da3-0636-4cba-b8de-94fdeecf0b7f HTTP/1.1 Aug 10 23:23:35.491684 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:23:35.491684 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:23:35.491684 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:23:35.491684 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:23:35.491684 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:23:35.491684 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:23:35.491684 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:23:35.491684 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:23:35.491684 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9DxPoik3qqc8GE5jnVPvsy-1cVbtLBl574wA6n-r6ez-tXNdD_4DaVlXGwG84PbYqiTlvFXUHOab6PUt1mkrW0PRXq2OjkPyD6TAI76mFTEnlIwIKqYwj4UXZM4sRRg7cfuidTTc2DGtIN0do-UwiF-KtaEyY2Nt_Jx5HNbGOVoYQz4 Aug 10 23:23:35.491684 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:23:35.491684 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:23:35.491684 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:23:35.491684 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:23:35.491684 n-d-850468-14 devstack@n-api.service[122633]: X-Openstack-Nova-Api-Version: 2.32 Aug 10 23:23:35.491684 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:23:35.491684 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:23:35.491684 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: bfebe97ce8df4dab9b53298700295139 Aug 10 23:23:35.491684 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-TaggedBootDevicesTest-1955966987 Aug 10 23:23:35.491684 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:23:35.491684 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:23:35.491684 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/bfebe97ce8df4dab9b53298700295139"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/bfebe97ce8df4dab9b53298700295139"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/bfebe97ce8df4dab9b53298700295139"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_bfebe97ce8df4dab9b53298700295139", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:23:35.491684 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-TaggedBootDevicesTest-1955966987 Aug 10 23:23:35.491684 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: bfebe97ce8df4dab9b53298700295139 Aug 10 23:23:35.491684 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1955966987 Aug 10 23:23:35.491684 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-TaggedBootDevicesTest-1955966987-project Aug 10 23:23:35.491684 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:23:35.491684 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:23:35.491684 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 1622d26ca18940cbbaba5eb72ce382d7 Aug 10 23:23:35.491684 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-TaggedBootDevicesTest-1955966987-project Aug 10 23:23:35.491684 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:23:35.491684 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance 7e091da3-0636-4cba-b8de-94fdeecf0b7f could not be found. Aug 10 23:23:35.491684 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': '7e091da3-0636-4cba-b8de-94fdeecf0b7f'} Aug 10 23:23:35.491684 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:23:35.491684 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:23:35.491684 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:23:35.491684 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:23:35.491684 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:23:35.491684 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:23:35.491684 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:23:35.491684 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:23:35.491684 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:23:35.491684 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:23:35.491684 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e091da3-0636-4cba-b8de-94fdeecf0b7f could not be found. Aug 10 23:23:35.491684 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:23:35.491684 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:23:35.491684 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:23:35.491684 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:23:35.491684 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:23:35.491684 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:23:35.491684 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:23:35.491684 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:23:35.491684 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:23:35.491684 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:23:35.491684 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 23:23:35.491684 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 23:23:35.491684 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 23:23:35.491684 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 23:23:35.491684 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:23:35.491684 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:23:35.491684 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:23:35.491684 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:23:35.497575 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e091da3-0636-4cba-b8de-94fdeecf0b7f could not be found. Aug 10 23:23:35.497575 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:23:35.497575 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:23:35.497575 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:23:35.497575 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:23:35.497575 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:23:35.497575 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:23:35.497575 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:23:35.497575 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:23:35.497575 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e091da3-0636-4cba-b8de-94fdeecf0b7f could not be found. Aug 10 23:23:35.497575 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:23:35.500856 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-f514d905-881e-4fad-914a-cd43c9963199 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Returning 404 to user: Instance 7e091da3-0636-4cba-b8de-94fdeecf0b7f could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:23:35.501996 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-f514d905-881e-4fad-914a-cd43c9963199 tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] 10.222.0.58 "DELETE /compute/v2.1/servers/7e091da3-0636-4cba-b8de-94fdeecf0b7f" status: 404 len: 111 microversion: 2.32 time: 0.055702 Aug 10 23:23:35.503124 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2759/5301] 10.222.0.58 () {60 vars in 1280 bytes} [Wed Aug 10 23:23:35 2022] DELETE /compute/v2.1/servers/7e091da3-0636-4cba-b8de-94fdeecf0b7f => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 10 23:23:35.522108 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-26ec8a47-2e71-47db-bdc9-a3b7abbe93fa tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:23:35.522762 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-26ec8a47-2e71-47db-bdc9-a3b7abbe93fa tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] [instance: 7e091da3-0636-4cba-b8de-94fdeecf0b7f] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:23:35.547848 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-26ec8a47-2e71-47db-bdc9-a3b7abbe93fa tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:35.548344 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-26ec8a47-2e71-47db-bdc9-a3b7abbe93fa tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:35.552861 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-26ec8a47-2e71-47db-bdc9-a3b7abbe93fa tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:35.554998 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-26ec8a47-2e71-47db-bdc9-a3b7abbe93fa tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:35.556121 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-26ec8a47-2e71-47db-bdc9-a3b7abbe93fa tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:35.556590 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-26ec8a47-2e71-47db-bdc9-a3b7abbe93fa tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:35.575492 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-26ec8a47-2e71-47db-bdc9-a3b7abbe93fa tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] HTTP exception thrown: Instance 7e091da3-0636-4cba-b8de-94fdeecf0b7f could not be found. Aug 10 23:23:35.578335 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-26ec8a47-2e71-47db-bdc9-a3b7abbe93fa tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Request method failure captured: Aug 10 23:23:35.578335 n-d-850468-14 devstack@n-api.service[122632]: request: GET /compute/v2.1/servers/7e091da3-0636-4cba-b8de-94fdeecf0b7f HTTP/1.1 Aug 10 23:23:35.578335 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:23:35.578335 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:23:35.578335 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:23:35.578335 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 23:23:35.578335 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:23:35.578335 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:23:35.578335 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:23:35.578335 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:23:35.578335 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9DxPoik3qqc8GE5jnVPvsy-1cVbtLBl574wA6n-r6ez-tXNdD_4DaVlXGwG84PbYqiTlvFXUHOab6PUt1mkrW0PRXq2OjkPyD6TAI76mFTEnlIwIKqYwj4UXZM4sRRg7cfuidTTc2DGtIN0do-UwiF-KtaEyY2Nt_Jx5HNbGOVoYQz4 Aug 10 23:23:35.578335 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:23:35.578335 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:23:35.578335 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:23:35.578335 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:23:35.578335 n-d-850468-14 devstack@n-api.service[122632]: X-Openstack-Nova-Api-Version: 2.32 Aug 10 23:23:35.578335 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:23:35.578335 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:23:35.578335 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: bfebe97ce8df4dab9b53298700295139 Aug 10 23:23:35.578335 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-TaggedBootDevicesTest-1955966987 Aug 10 23:23:35.578335 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:23:35.578335 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:23:35.578335 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/bfebe97ce8df4dab9b53298700295139"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/bfebe97ce8df4dab9b53298700295139"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/bfebe97ce8df4dab9b53298700295139"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_bfebe97ce8df4dab9b53298700295139", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:23:35.578335 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-TaggedBootDevicesTest-1955966987 Aug 10 23:23:35.578335 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: bfebe97ce8df4dab9b53298700295139 Aug 10 23:23:35.578335 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-TaggedBootDevicesTest-1955966987 Aug 10 23:23:35.578335 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-TaggedBootDevicesTest-1955966987-project Aug 10 23:23:35.578335 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:23:35.578335 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:23:35.578335 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: 1622d26ca18940cbbaba5eb72ce382d7 Aug 10 23:23:35.578335 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-TaggedBootDevicesTest-1955966987-project Aug 10 23:23:35.578335 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:23:35.578335 n-d-850468-14 devstack@n-api.service[122632]: exception: Instance 7e091da3-0636-4cba-b8de-94fdeecf0b7f could not be found. Aug 10 23:23:35.578335 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': '7e091da3-0636-4cba-b8de-94fdeecf0b7f'} Aug 10 23:23:35.578335 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:23:35.578335 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:23:35.578335 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:23:35.578335 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:23:35.578335 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:23:35.578335 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:23:35.578335 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:23:35.578335 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:23:35.578335 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:23:35.578335 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:23:35.578335 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e091da3-0636-4cba-b8de-94fdeecf0b7f could not be found. Aug 10 23:23:35.578335 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:23:35.578335 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:23:35.578335 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:23:35.578335 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:23:35.578335 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:23:35.578335 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:23:35.578335 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:23:35.578335 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:23:35.578335 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:23:35.578335 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:23:35.578335 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:23:35.578335 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:23:35.578335 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:23:35.578335 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:23:35.578335 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:23:35.578335 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:23:35.578335 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e091da3-0636-4cba-b8de-94fdeecf0b7f could not be found. Aug 10 23:23:35.578335 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:23:35.578335 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:23:35.583708 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:23:35.583708 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:23:35.583708 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:23:35.583708 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:23:35.583708 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:23:35.583708 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:23:35.583708 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e091da3-0636-4cba-b8de-94fdeecf0b7f could not be found. Aug 10 23:23:35.583708 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:23:35.587795 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-26ec8a47-2e71-47db-bdc9-a3b7abbe93fa tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] Returning 404 to user: Instance 7e091da3-0636-4cba-b8de-94fdeecf0b7f could not be found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:23:35.588936 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-26ec8a47-2e71-47db-bdc9-a3b7abbe93fa tempest-TaggedBootDevicesTest-1955966987 tempest-TaggedBootDevicesTest-1955966987-project] 10.222.0.58 "GET /compute/v2.1/servers/7e091da3-0636-4cba-b8de-94fdeecf0b7f" status: 404 len: 111 microversion: 2.32 time: 0.081500 Aug 10 23:23:35.590013 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2543/5302] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:23:35 2022] GET /compute/v2.1/servers/7e091da3-0636-4cba-b8de-94fdeecf0b7f => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 10 23:23:35.838003 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-8c87f54e-3ca3-4dcf-8889-0260637d2e05 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:23:35.839194 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-8c87f54e-3ca3-4dcf-8889-0260637d2e05 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] [instance: ebb9a0bf-74e7-4e0f-bad3-32d21bd3fb77] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:23:35.848140 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8c87f54e-3ca3-4dcf-8889-0260637d2e05 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:35.848913 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8c87f54e-3ca3-4dcf-8889-0260637d2e05 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:35.849659 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8c87f54e-3ca3-4dcf-8889-0260637d2e05 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:35.850883 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8c87f54e-3ca3-4dcf-8889-0260637d2e05 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:35.851554 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8c87f54e-3ca3-4dcf-8889-0260637d2e05 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:35.852234 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8c87f54e-3ca3-4dcf-8889-0260637d2e05 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:35.880855 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-8c87f54e-3ca3-4dcf-8889-0260637d2e05 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] HTTP exception thrown: Instance ebb9a0bf-74e7-4e0f-bad3-32d21bd3fb77 could not be found. Aug 10 23:23:35.883001 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-8c87f54e-3ca3-4dcf-8889-0260637d2e05 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Request method failure captured: Aug 10 23:23:35.883001 n-d-850468-14 devstack@n-api.service[122633]: request: GET /compute/v2.1/servers/ebb9a0bf-74e7-4e0f-bad3-32d21bd3fb77 HTTP/1.1 Aug 10 23:23:35.883001 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:23:35.883001 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:23:35.883001 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:23:35.883001 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:23:35.883001 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:23:35.883001 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:23:35.883001 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:23:35.883001 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:23:35.883001 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9D3YBx8x4DzKRQQXXplfEhXCKdTV5uKIEFH35N6YUAPyQlWmpNNol59DhEPZ6aFL1hbYgcp6SPoE--yh3F9wX718LR_cX7t4D3BErpbAsRlXvzZWedNA326Ff3fMa2ZvigJ17VIAJlK5E9VRBYm6gsHjNWLo8_txphNcPkBchFlm_Y4 Aug 10 23:23:35.883001 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:23:35.883001 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:23:35.883001 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:23:35.883001 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:23:35.883001 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:23:35.883001 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:23:35.883001 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 492ef66ca40744bbb9b6a7e847929a8b Aug 10 23:23:35.883001 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-TestServerAdvancedOps-1758322073 Aug 10 23:23:35.883001 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:23:35.883001 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:23:35.883001 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/492ef66ca40744bbb9b6a7e847929a8b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/492ef66ca40744bbb9b6a7e847929a8b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/492ef66ca40744bbb9b6a7e847929a8b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_492ef66ca40744bbb9b6a7e847929a8b", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:23:35.883001 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-TestServerAdvancedOps-1758322073 Aug 10 23:23:35.883001 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 492ef66ca40744bbb9b6a7e847929a8b Aug 10 23:23:35.883001 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-TestServerAdvancedOps-1758322073 Aug 10 23:23:35.883001 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-TestServerAdvancedOps-1758322073-project Aug 10 23:23:35.883001 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:23:35.883001 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:23:35.883001 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 2be6f687ffa44c00ab6deb4d7a78eb5f Aug 10 23:23:35.883001 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-TestServerAdvancedOps-1758322073-project Aug 10 23:23:35.883001 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:23:35.883001 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance ebb9a0bf-74e7-4e0f-bad3-32d21bd3fb77 could not be found. Aug 10 23:23:35.883001 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': 'ebb9a0bf-74e7-4e0f-bad3-32d21bd3fb77'} Aug 10 23:23:35.883001 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:23:35.883001 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:23:35.883001 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:23:35.883001 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:23:35.883001 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:23:35.883001 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:23:35.883001 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:23:35.883001 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:23:35.883001 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:23:35.883001 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:23:35.883001 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ebb9a0bf-74e7-4e0f-bad3-32d21bd3fb77 could not be found. Aug 10 23:23:35.883001 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:23:35.883001 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:23:35.883001 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:23:35.883001 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:23:35.883001 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:23:35.883001 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:23:35.883001 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:23:35.883001 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:23:35.883001 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:23:35.883001 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:23:35.883001 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:23:35.883001 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:23:35.883001 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:23:35.883001 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:23:35.883001 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:23:35.883001 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:23:35.883001 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ebb9a0bf-74e7-4e0f-bad3-32d21bd3fb77 could not be found. Aug 10 23:23:35.883001 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:23:35.883001 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:23:35.883001 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:23:35.887415 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:23:35.887415 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:23:35.887415 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:23:35.887415 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:23:35.887415 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:23:35.887415 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ebb9a0bf-74e7-4e0f-bad3-32d21bd3fb77 could not be found. Aug 10 23:23:35.887415 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:23:35.889721 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-8c87f54e-3ca3-4dcf-8889-0260637d2e05 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] Returning 404 to user: Instance ebb9a0bf-74e7-4e0f-bad3-32d21bd3fb77 could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:23:35.893187 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-8c87f54e-3ca3-4dcf-8889-0260637d2e05 tempest-TestServerAdvancedOps-1758322073 tempest-TestServerAdvancedOps-1758322073-project] 10.222.0.58 "GET /compute/v2.1/servers/ebb9a0bf-74e7-4e0f-bad3-32d21bd3fb77" status: 404 len: 111 microversion: 2.1 time: 0.060117 Aug 10 23:23:35.894027 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2760/5303] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:23:35 2022] GET /compute/v2.1/servers/ebb9a0bf-74e7-4e0f-bad3-32d21bd3fb77 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:23:36.454748 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-1a4c2a7a-5874-4ad3-a7ca-c0fefa30046c tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:23:36.455758 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-1a4c2a7a-5874-4ad3-a7ca-c0fefa30046c tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] [instance: 9aebc95f-f7c3-479b-ba60-8de2f4539f82] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:23:36.468151 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1a4c2a7a-5874-4ad3-a7ca-c0fefa30046c tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:36.469045 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1a4c2a7a-5874-4ad3-a7ca-c0fefa30046c tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:36.469806 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1a4c2a7a-5874-4ad3-a7ca-c0fefa30046c tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:36.470768 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1a4c2a7a-5874-4ad3-a7ca-c0fefa30046c tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:36.473595 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1a4c2a7a-5874-4ad3-a7ca-c0fefa30046c tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:36.474845 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1a4c2a7a-5874-4ad3-a7ca-c0fefa30046c tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:36.659448 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-1a4c2a7a-5874-4ad3-a7ca-c0fefa30046c tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3f44535879e47f3b3a39d551418eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d608b3eb7b4d1b965981b5ea727a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:36.672988 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-1a4c2a7a-5874-4ad3-a7ca-c0fefa30046c tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3f44535879e47f3b3a39d551418eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d608b3eb7b4d1b965981b5ea727a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:36.675728 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-1a4c2a7a-5874-4ad3-a7ca-c0fefa30046c tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3f44535879e47f3b3a39d551418eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d608b3eb7b4d1b965981b5ea727a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:36.680051 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-1a4c2a7a-5874-4ad3-a7ca-c0fefa30046c tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] 10.222.0.58 "GET /compute/v2.1/servers/9aebc95f-f7c3-479b-ba60-8de2f4539f82" status: 200 len: 1366 microversion: 2.57 time: 0.230179 Aug 10 23:23:36.681085 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2544/5304] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:23:36 2022] GET /compute/v2.1/servers/9aebc95f-f7c3-479b-ba60-8de2f4539f82 => generated 1366 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:23:37.656944 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-322f376b-e0e5-4e62-a9ef-9008d51e1e57 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:23:37.657453 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-322f376b-e0e5-4e62-a9ef-9008d51e1e57 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] [instance: 2646d3d8-2541-4dbf-9b0f-5eb122ca1452] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:23:37.679770 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-322f376b-e0e5-4e62-a9ef-9008d51e1e57 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:37.680804 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-322f376b-e0e5-4e62-a9ef-9008d51e1e57 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:37.681285 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-322f376b-e0e5-4e62-a9ef-9008d51e1e57 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:37.681978 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-322f376b-e0e5-4e62-a9ef-9008d51e1e57 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:37.687763 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-322f376b-e0e5-4e62-a9ef-9008d51e1e57 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:37.688304 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-322f376b-e0e5-4e62-a9ef-9008d51e1e57 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:37.703868 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-10068bd0-ca66-49e9-83d2-71cca5cb4fbd tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:23:37.704520 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-10068bd0-ca66-49e9-83d2-71cca5cb4fbd tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] [instance: 9aebc95f-f7c3-479b-ba60-8de2f4539f82] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:23:37.729264 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-10068bd0-ca66-49e9-83d2-71cca5cb4fbd tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:37.748161 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-10068bd0-ca66-49e9-83d2-71cca5cb4fbd tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:37.755496 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-10068bd0-ca66-49e9-83d2-71cca5cb4fbd tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:37.755907 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-10068bd0-ca66-49e9-83d2-71cca5cb4fbd tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:37.760676 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-10068bd0-ca66-49e9-83d2-71cca5cb4fbd tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:37.761133 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-10068bd0-ca66-49e9-83d2-71cca5cb4fbd tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:37.838614 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-322f376b-e0e5-4e62-a9ef-9008d51e1e57 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] 10.222.0.58 "GET /compute/v2.1/servers/2646d3d8-2541-4dbf-9b0f-5eb122ca1452/ips" status: 200 len: 150 microversion: 2.1 time: 0.190381 Aug 10 23:23:37.847772 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2761/5305] 10.222.0.58 () {58 vars in 1248 bytes} [Wed Aug 10 23:23:37 2022] GET /compute/v2.1/servers/2646d3d8-2541-4dbf-9b0f-5eb122ca1452/ips => generated 150 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:23:37.969956 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-10068bd0-ca66-49e9-83d2-71cca5cb4fbd tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3f44535879e47f3b3a39d551418eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d608b3eb7b4d1b965981b5ea727a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:37.985949 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-10068bd0-ca66-49e9-83d2-71cca5cb4fbd tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3f44535879e47f3b3a39d551418eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d608b3eb7b4d1b965981b5ea727a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:37.987894 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-10068bd0-ca66-49e9-83d2-71cca5cb4fbd tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3f44535879e47f3b3a39d551418eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d608b3eb7b4d1b965981b5ea727a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:37.991736 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-10068bd0-ca66-49e9-83d2-71cca5cb4fbd tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] 10.222.0.58 "GET /compute/v2.1/servers/9aebc95f-f7c3-479b-ba60-8de2f4539f82" status: 200 len: 1366 microversion: 2.57 time: 0.292254 Aug 10 23:23:37.994827 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2545/5306] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:23:37 2022] GET /compute/v2.1/servers/9aebc95f-f7c3-479b-ba60-8de2f4539f82 => generated 1366 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 23:23:39.023624 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-4ec5cd89-2b08-41de-85a7-19ec627d51bc tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:23:39.024880 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-4ec5cd89-2b08-41de-85a7-19ec627d51bc tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] [instance: 9aebc95f-f7c3-479b-ba60-8de2f4539f82] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:23:39.043332 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4ec5cd89-2b08-41de-85a7-19ec627d51bc tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:39.044176 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4ec5cd89-2b08-41de-85a7-19ec627d51bc tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:39.046122 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4ec5cd89-2b08-41de-85a7-19ec627d51bc tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:39.051231 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4ec5cd89-2b08-41de-85a7-19ec627d51bc tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:39.052334 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4ec5cd89-2b08-41de-85a7-19ec627d51bc tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:39.053066 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4ec5cd89-2b08-41de-85a7-19ec627d51bc tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:39.279380 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-4ec5cd89-2b08-41de-85a7-19ec627d51bc tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3f44535879e47f3b3a39d551418eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d608b3eb7b4d1b965981b5ea727a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:39.301739 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-4ec5cd89-2b08-41de-85a7-19ec627d51bc tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3f44535879e47f3b3a39d551418eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d608b3eb7b4d1b965981b5ea727a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:39.303736 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-4ec5cd89-2b08-41de-85a7-19ec627d51bc tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3f44535879e47f3b3a39d551418eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d608b3eb7b4d1b965981b5ea727a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:39.305408 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-4ec5cd89-2b08-41de-85a7-19ec627d51bc tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] 10.222.0.58 "GET /compute/v2.1/servers/9aebc95f-f7c3-479b-ba60-8de2f4539f82" status: 200 len: 1366 microversion: 2.57 time: 0.288182 Aug 10 23:23:39.306859 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2762/5307] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:23:39 2022] GET /compute/v2.1/servers/9aebc95f-f7c3-479b-ba60-8de2f4539f82 => generated 1366 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:23:40.330948 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-313cca04-2381-44e1-9fe0-141b6508c338 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:23:40.332398 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-313cca04-2381-44e1-9fe0-141b6508c338 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] [instance: 9aebc95f-f7c3-479b-ba60-8de2f4539f82] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:23:40.349478 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-313cca04-2381-44e1-9fe0-141b6508c338 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:40.350358 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-313cca04-2381-44e1-9fe0-141b6508c338 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:40.351043 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-313cca04-2381-44e1-9fe0-141b6508c338 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:40.352577 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-313cca04-2381-44e1-9fe0-141b6508c338 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:40.355059 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-313cca04-2381-44e1-9fe0-141b6508c338 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:40.356716 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-313cca04-2381-44e1-9fe0-141b6508c338 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:40.450474 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-313cca04-2381-44e1-9fe0-141b6508c338 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3f44535879e47f3b3a39d551418eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d608b3eb7b4d1b965981b5ea727a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:40.476191 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-313cca04-2381-44e1-9fe0-141b6508c338 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3f44535879e47f3b3a39d551418eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d608b3eb7b4d1b965981b5ea727a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:40.480998 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-313cca04-2381-44e1-9fe0-141b6508c338 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3f44535879e47f3b3a39d551418eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d608b3eb7b4d1b965981b5ea727a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:40.496682 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-313cca04-2381-44e1-9fe0-141b6508c338 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] 10.222.0.58 "GET /compute/v2.1/servers/9aebc95f-f7c3-479b-ba60-8de2f4539f82" status: 200 len: 1366 microversion: 2.57 time: 0.169593 Aug 10 23:23:40.498329 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2546/5308] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:23:40 2022] GET /compute/v2.1/servers/9aebc95f-f7c3-479b-ba60-8de2f4539f82 => generated 1366 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:23:40.755936 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-ebf6d5f4-c1a2-4c0d-816f-271e32740209 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "128a12b1-d255-447e-8a64-61f404db3bad"}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:23:40.764091 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-ebf6d5f4-c1a2-4c0d-816f-271e32740209 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] [instance: 2646d3d8-2541-4dbf-9b0f-5eb122ca1452] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:23:40.776577 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ebf6d5f4-c1a2-4c0d-816f-271e32740209 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:40.777317 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ebf6d5f4-c1a2-4c0d-816f-271e32740209 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:40.779127 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ebf6d5f4-c1a2-4c0d-816f-271e32740209 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:40.780131 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ebf6d5f4-c1a2-4c0d-816f-271e32740209 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:40.781268 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ebf6d5f4-c1a2-4c0d-816f-271e32740209 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:40.781859 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ebf6d5f4-c1a2-4c0d-816f-271e32740209 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:41.256007 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-ebf6d5f4-c1a2-4c0d-816f-271e32740209 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] 10.222.0.58 "POST /compute/v2.1/servers/2646d3d8-2541-4dbf-9b0f-5eb122ca1452/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.505210 Aug 10 23:23:41.258763 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2763/5309] 10.222.0.58 () {60 vars in 1323 bytes} [Wed Aug 10 23:23:40 2022] POST /compute/v2.1/servers/2646d3d8-2541-4dbf-9b0f-5eb122ca1452/os-volume_attachments => generated 194 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 23:23:41.551236 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-d5956f49-e561-4127-bb5a-54974dc71238 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:23:41.553870 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-d5956f49-e561-4127-bb5a-54974dc71238 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] [instance: 9aebc95f-f7c3-479b-ba60-8de2f4539f82] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:23:41.599883 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d5956f49-e561-4127-bb5a-54974dc71238 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:41.600420 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d5956f49-e561-4127-bb5a-54974dc71238 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:41.600806 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d5956f49-e561-4127-bb5a-54974dc71238 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:41.601521 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d5956f49-e561-4127-bb5a-54974dc71238 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:41.602013 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d5956f49-e561-4127-bb5a-54974dc71238 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:41.602437 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d5956f49-e561-4127-bb5a-54974dc71238 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:41.931508 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-d5956f49-e561-4127-bb5a-54974dc71238 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3f44535879e47f3b3a39d551418eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d608b3eb7b4d1b965981b5ea727a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:41.941341 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-d5956f49-e561-4127-bb5a-54974dc71238 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3f44535879e47f3b3a39d551418eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d608b3eb7b4d1b965981b5ea727a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:41.943082 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-d5956f49-e561-4127-bb5a-54974dc71238 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3f44535879e47f3b3a39d551418eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d608b3eb7b4d1b965981b5ea727a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:41.948380 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-d5956f49-e561-4127-bb5a-54974dc71238 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] 10.222.0.58 "GET /compute/v2.1/servers/9aebc95f-f7c3-479b-ba60-8de2f4539f82" status: 200 len: 1366 microversion: 2.57 time: 0.423562 Aug 10 23:23:41.949166 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2547/5310] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:23:41 2022] GET /compute/v2.1/servers/9aebc95f-f7c3-479b-ba60-8de2f4539f82 => generated 1366 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:23:42.975715 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c07fc7c4-632b-4dfe-97e9-8b025846a06a tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:23:42.976425 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-c07fc7c4-632b-4dfe-97e9-8b025846a06a tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] [instance: 9aebc95f-f7c3-479b-ba60-8de2f4539f82] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:23:42.989390 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c07fc7c4-632b-4dfe-97e9-8b025846a06a tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:42.989823 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c07fc7c4-632b-4dfe-97e9-8b025846a06a tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:42.990264 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c07fc7c4-632b-4dfe-97e9-8b025846a06a tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:42.991017 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c07fc7c4-632b-4dfe-97e9-8b025846a06a tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:42.997125 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c07fc7c4-632b-4dfe-97e9-8b025846a06a tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:42.998159 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c07fc7c4-632b-4dfe-97e9-8b025846a06a tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:43.146658 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-c07fc7c4-632b-4dfe-97e9-8b025846a06a tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3f44535879e47f3b3a39d551418eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d608b3eb7b4d1b965981b5ea727a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:43.159389 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-c07fc7c4-632b-4dfe-97e9-8b025846a06a tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3f44535879e47f3b3a39d551418eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d608b3eb7b4d1b965981b5ea727a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:43.161219 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-c07fc7c4-632b-4dfe-97e9-8b025846a06a tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3f44535879e47f3b3a39d551418eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d608b3eb7b4d1b965981b5ea727a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:43.162434 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-c07fc7c4-632b-4dfe-97e9-8b025846a06a tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] 10.222.0.58 "GET /compute/v2.1/servers/9aebc95f-f7c3-479b-ba60-8de2f4539f82" status: 200 len: 1366 microversion: 2.57 time: 0.192541 Aug 10 23:23:43.163233 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2764/5311] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:23:42 2022] GET /compute/v2.1/servers/9aebc95f-f7c3-479b-ba60-8de2f4539f82 => generated 1366 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:23:44.191328 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-889b7d25-5b2d-4bff-b576-533eb294b0d0 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:23:44.192095 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-889b7d25-5b2d-4bff-b576-533eb294b0d0 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] [instance: 9aebc95f-f7c3-479b-ba60-8de2f4539f82] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:23:44.204188 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-889b7d25-5b2d-4bff-b576-533eb294b0d0 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:44.204685 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-889b7d25-5b2d-4bff-b576-533eb294b0d0 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:44.206434 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-889b7d25-5b2d-4bff-b576-533eb294b0d0 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:44.209306 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-889b7d25-5b2d-4bff-b576-533eb294b0d0 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:44.209849 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-889b7d25-5b2d-4bff-b576-533eb294b0d0 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:44.210330 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-889b7d25-5b2d-4bff-b576-533eb294b0d0 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:44.372471 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-889b7d25-5b2d-4bff-b576-533eb294b0d0 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3f44535879e47f3b3a39d551418eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d608b3eb7b4d1b965981b5ea727a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:44.397561 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-889b7d25-5b2d-4bff-b576-533eb294b0d0 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3f44535879e47f3b3a39d551418eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d608b3eb7b4d1b965981b5ea727a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:44.399673 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-889b7d25-5b2d-4bff-b576-533eb294b0d0 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3f44535879e47f3b3a39d551418eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d608b3eb7b4d1b965981b5ea727a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:44.401272 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-889b7d25-5b2d-4bff-b576-533eb294b0d0 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] 10.222.0.58 "GET /compute/v2.1/servers/9aebc95f-f7c3-479b-ba60-8de2f4539f82" status: 200 len: 1366 microversion: 2.57 time: 0.214170 Aug 10 23:23:44.402316 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2548/5312] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:23:44 2022] GET /compute/v2.1/servers/9aebc95f-f7c3-479b-ba60-8de2f4539f82 => generated 1366 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:23:45.429561 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-8407d521-bda3-4499-989d-0dcdc5399adb tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:23:45.431459 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-8407d521-bda3-4499-989d-0dcdc5399adb tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] [instance: 9aebc95f-f7c3-479b-ba60-8de2f4539f82] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:23:45.446939 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8407d521-bda3-4499-989d-0dcdc5399adb tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:45.447635 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8407d521-bda3-4499-989d-0dcdc5399adb tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:45.448264 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8407d521-bda3-4499-989d-0dcdc5399adb tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:45.449265 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8407d521-bda3-4499-989d-0dcdc5399adb tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:45.451472 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8407d521-bda3-4499-989d-0dcdc5399adb tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:45.452184 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8407d521-bda3-4499-989d-0dcdc5399adb tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:45.623264 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-8407d521-bda3-4499-989d-0dcdc5399adb tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3f44535879e47f3b3a39d551418eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d608b3eb7b4d1b965981b5ea727a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:45.636667 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-8407d521-bda3-4499-989d-0dcdc5399adb tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3f44535879e47f3b3a39d551418eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d608b3eb7b4d1b965981b5ea727a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:45.638579 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-8407d521-bda3-4499-989d-0dcdc5399adb tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3f44535879e47f3b3a39d551418eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d608b3eb7b4d1b965981b5ea727a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:45.640032 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-8407d521-bda3-4499-989d-0dcdc5399adb tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] 10.222.0.58 "GET /compute/v2.1/servers/9aebc95f-f7c3-479b-ba60-8de2f4539f82" status: 200 len: 1366 microversion: 2.57 time: 0.214404 Aug 10 23:23:45.644544 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2765/5313] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:23:45 2022] GET /compute/v2.1/servers/9aebc95f-f7c3-479b-ba60-8de2f4539f82 => generated 1366 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:23:46.672735 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-54764c51-aa82-47b1-98fc-826100cad179 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:23:46.673451 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-54764c51-aa82-47b1-98fc-826100cad179 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] [instance: 9aebc95f-f7c3-479b-ba60-8de2f4539f82] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:23:46.692267 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-54764c51-aa82-47b1-98fc-826100cad179 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:46.692911 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-54764c51-aa82-47b1-98fc-826100cad179 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:46.693470 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-54764c51-aa82-47b1-98fc-826100cad179 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:46.694296 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-54764c51-aa82-47b1-98fc-826100cad179 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:46.694886 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-54764c51-aa82-47b1-98fc-826100cad179 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:46.695510 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-54764c51-aa82-47b1-98fc-826100cad179 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:46.837317 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-54764c51-aa82-47b1-98fc-826100cad179 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3f44535879e47f3b3a39d551418eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d608b3eb7b4d1b965981b5ea727a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:46.846629 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-54764c51-aa82-47b1-98fc-826100cad179 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3f44535879e47f3b3a39d551418eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d608b3eb7b4d1b965981b5ea727a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:46.848358 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-54764c51-aa82-47b1-98fc-826100cad179 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3f44535879e47f3b3a39d551418eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d608b3eb7b4d1b965981b5ea727a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:46.849561 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-54764c51-aa82-47b1-98fc-826100cad179 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] 10.222.0.58 "GET /compute/v2.1/servers/9aebc95f-f7c3-479b-ba60-8de2f4539f82" status: 200 len: 1366 microversion: 2.57 time: 0.181541 Aug 10 23:23:46.850378 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2549/5314] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:23:46 2022] GET /compute/v2.1/servers/9aebc95f-f7c3-479b-ba60-8de2f4539f82 => generated 1366 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 23:23:47.876088 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-bad075da-7985-4a3a-8f55-882b73f2c71d tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:23:47.877395 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-bad075da-7985-4a3a-8f55-882b73f2c71d tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] [instance: 9aebc95f-f7c3-479b-ba60-8de2f4539f82] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:23:47.895201 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bad075da-7985-4a3a-8f55-882b73f2c71d tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:47.896456 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bad075da-7985-4a3a-8f55-882b73f2c71d tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:47.899138 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bad075da-7985-4a3a-8f55-882b73f2c71d tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:47.901289 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bad075da-7985-4a3a-8f55-882b73f2c71d tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:47.901985 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bad075da-7985-4a3a-8f55-882b73f2c71d tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:47.903078 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bad075da-7985-4a3a-8f55-882b73f2c71d tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:48.084962 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-bad075da-7985-4a3a-8f55-882b73f2c71d tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3f44535879e47f3b3a39d551418eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d608b3eb7b4d1b965981b5ea727a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:48.107169 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-bad075da-7985-4a3a-8f55-882b73f2c71d tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3f44535879e47f3b3a39d551418eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d608b3eb7b4d1b965981b5ea727a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:48.111429 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-bad075da-7985-4a3a-8f55-882b73f2c71d tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3f44535879e47f3b3a39d551418eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d608b3eb7b4d1b965981b5ea727a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:48.116369 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-bad075da-7985-4a3a-8f55-882b73f2c71d tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] 10.222.0.58 "GET /compute/v2.1/servers/9aebc95f-f7c3-479b-ba60-8de2f4539f82" status: 200 len: 1366 microversion: 2.57 time: 0.242467 Aug 10 23:23:48.116989 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2766/5315] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:23:47 2022] GET /compute/v2.1/servers/9aebc95f-f7c3-479b-ba60-8de2f4539f82 => generated 1366 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:23:49.141641 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-6eea2aa6-4d78-4786-acc0-dfe8eacb1471 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:23:49.142254 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-6eea2aa6-4d78-4786-acc0-dfe8eacb1471 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] [instance: 9aebc95f-f7c3-479b-ba60-8de2f4539f82] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:23:49.163207 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6eea2aa6-4d78-4786-acc0-dfe8eacb1471 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:49.165273 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6eea2aa6-4d78-4786-acc0-dfe8eacb1471 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:49.169447 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6eea2aa6-4d78-4786-acc0-dfe8eacb1471 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:49.172896 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6eea2aa6-4d78-4786-acc0-dfe8eacb1471 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:49.176353 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6eea2aa6-4d78-4786-acc0-dfe8eacb1471 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:49.177159 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6eea2aa6-4d78-4786-acc0-dfe8eacb1471 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:49.319293 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-6eea2aa6-4d78-4786-acc0-dfe8eacb1471 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3f44535879e47f3b3a39d551418eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d608b3eb7b4d1b965981b5ea727a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:49.347811 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-6eea2aa6-4d78-4786-acc0-dfe8eacb1471 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3f44535879e47f3b3a39d551418eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d608b3eb7b4d1b965981b5ea727a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:49.363553 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-6eea2aa6-4d78-4786-acc0-dfe8eacb1471 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3f44535879e47f3b3a39d551418eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d608b3eb7b4d1b965981b5ea727a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:49.366883 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-6eea2aa6-4d78-4786-acc0-dfe8eacb1471 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] 10.222.0.58 "GET /compute/v2.1/servers/9aebc95f-f7c3-479b-ba60-8de2f4539f82" status: 200 len: 1366 microversion: 2.57 time: 0.229172 Aug 10 23:23:49.369799 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2550/5316] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:23:49 2022] GET /compute/v2.1/servers/9aebc95f-f7c3-479b-ba60-8de2f4539f82 => generated 1366 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:23:50.396845 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-5cf8518e-d153-4be0-ae2e-20374f1fcdaf tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:23:50.397458 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-5cf8518e-d153-4be0-ae2e-20374f1fcdaf tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] [instance: 9aebc95f-f7c3-479b-ba60-8de2f4539f82] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:23:50.420215 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_api:SELECT=67,nova_api:DELETE=1 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:23:50.432830 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5cf8518e-d153-4be0-ae2e-20374f1fcdaf tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:50.433452 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5cf8518e-d153-4be0-ae2e-20374f1fcdaf tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:50.434245 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5cf8518e-d153-4be0-ae2e-20374f1fcdaf tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:50.435224 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5cf8518e-d153-4be0-ae2e-20374f1fcdaf tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:50.437953 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5cf8518e-d153-4be0-ae2e-20374f1fcdaf tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:50.438582 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5cf8518e-d153-4be0-ae2e-20374f1fcdaf tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:50.506599 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:23:50.877273 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-5cf8518e-d153-4be0-ae2e-20374f1fcdaf tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3f44535879e47f3b3a39d551418eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d608b3eb7b4d1b965981b5ea727a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:50.891390 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-5cf8518e-d153-4be0-ae2e-20374f1fcdaf tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3f44535879e47f3b3a39d551418eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d608b3eb7b4d1b965981b5ea727a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:50.908843 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-5cf8518e-d153-4be0-ae2e-20374f1fcdaf tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3f44535879e47f3b3a39d551418eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d608b3eb7b4d1b965981b5ea727a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:50.910082 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-5cf8518e-d153-4be0-ae2e-20374f1fcdaf tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] 10.222.0.58 "GET /compute/v2.1/servers/9aebc95f-f7c3-479b-ba60-8de2f4539f82" status: 200 len: 1366 microversion: 2.57 time: 0.517457 Aug 10 23:23:50.910653 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2767/5317] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:23:50 2022] GET /compute/v2.1/servers/9aebc95f-f7c3-479b-ba60-8de2f4539f82 => generated 1366 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:23:51.938628 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-2d3dc92c-9351-496b-ac3c-e4aaf7a96df7 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:23:51.939592 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-2d3dc92c-9351-496b-ac3c-e4aaf7a96df7 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] [instance: 9aebc95f-f7c3-479b-ba60-8de2f4539f82] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:23:51.971782 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2d3dc92c-9351-496b-ac3c-e4aaf7a96df7 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:51.974558 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2d3dc92c-9351-496b-ac3c-e4aaf7a96df7 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:51.976494 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2d3dc92c-9351-496b-ac3c-e4aaf7a96df7 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:51.978663 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2d3dc92c-9351-496b-ac3c-e4aaf7a96df7 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:51.979432 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2d3dc92c-9351-496b-ac3c-e4aaf7a96df7 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:51.980128 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2d3dc92c-9351-496b-ac3c-e4aaf7a96df7 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:52.205146 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-2d3dc92c-9351-496b-ac3c-e4aaf7a96df7 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3f44535879e47f3b3a39d551418eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d608b3eb7b4d1b965981b5ea727a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:52.215818 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-2d3dc92c-9351-496b-ac3c-e4aaf7a96df7 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3f44535879e47f3b3a39d551418eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d608b3eb7b4d1b965981b5ea727a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:52.228832 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-2d3dc92c-9351-496b-ac3c-e4aaf7a96df7 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3f44535879e47f3b3a39d551418eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d608b3eb7b4d1b965981b5ea727a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:52.230422 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-2d3dc92c-9351-496b-ac3c-e4aaf7a96df7 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] 10.222.0.58 "GET /compute/v2.1/servers/9aebc95f-f7c3-479b-ba60-8de2f4539f82" status: 200 len: 1366 microversion: 2.57 time: 0.296769 Aug 10 23:23:52.231253 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2551/5318] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:23:51 2022] GET /compute/v2.1/servers/9aebc95f-f7c3-479b-ba60-8de2f4539f82 => generated 1366 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:23:53.269653 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-cdf37f2b-336b-4c79-8edc-7a12ed3842c0 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:23:53.270712 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-cdf37f2b-336b-4c79-8edc-7a12ed3842c0 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] [instance: 9aebc95f-f7c3-479b-ba60-8de2f4539f82] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:23:53.287057 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cdf37f2b-336b-4c79-8edc-7a12ed3842c0 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:53.287725 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cdf37f2b-336b-4c79-8edc-7a12ed3842c0 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:53.288313 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cdf37f2b-336b-4c79-8edc-7a12ed3842c0 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:53.289610 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cdf37f2b-336b-4c79-8edc-7a12ed3842c0 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:53.292702 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cdf37f2b-336b-4c79-8edc-7a12ed3842c0 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:53.293375 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cdf37f2b-336b-4c79-8edc-7a12ed3842c0 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:53.561167 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-cdf37f2b-336b-4c79-8edc-7a12ed3842c0 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3f44535879e47f3b3a39d551418eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d608b3eb7b4d1b965981b5ea727a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:53.597757 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-cdf37f2b-336b-4c79-8edc-7a12ed3842c0 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3f44535879e47f3b3a39d551418eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d608b3eb7b4d1b965981b5ea727a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:53.599667 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-cdf37f2b-336b-4c79-8edc-7a12ed3842c0 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3f44535879e47f3b3a39d551418eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d608b3eb7b4d1b965981b5ea727a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:53.601723 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-cdf37f2b-336b-4c79-8edc-7a12ed3842c0 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] 10.222.0.58 "GET /compute/v2.1/servers/9aebc95f-f7c3-479b-ba60-8de2f4539f82" status: 200 len: 1372 microversion: 2.57 time: 0.335848 Aug 10 23:23:53.603411 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2768/5319] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:23:53 2022] GET /compute/v2.1/servers/9aebc95f-f7c3-479b-ba60-8de2f4539f82 => generated 1372 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:23:54.641427 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-992f7bae-4d54-4526-ada2-80622bf56457 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:23:54.642170 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-992f7bae-4d54-4526-ada2-80622bf56457 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] [instance: 9aebc95f-f7c3-479b-ba60-8de2f4539f82] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:23:54.657277 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-992f7bae-4d54-4526-ada2-80622bf56457 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:54.671317 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-992f7bae-4d54-4526-ada2-80622bf56457 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:54.671317 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-992f7bae-4d54-4526-ada2-80622bf56457 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:54.671317 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-992f7bae-4d54-4526-ada2-80622bf56457 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:54.671317 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-992f7bae-4d54-4526-ada2-80622bf56457 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:54.671317 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-992f7bae-4d54-4526-ada2-80622bf56457 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:54.766308 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-992f7bae-4d54-4526-ada2-80622bf56457 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3f44535879e47f3b3a39d551418eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d608b3eb7b4d1b965981b5ea727a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:54.779486 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-992f7bae-4d54-4526-ada2-80622bf56457 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3f44535879e47f3b3a39d551418eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d608b3eb7b4d1b965981b5ea727a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:54.781175 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-992f7bae-4d54-4526-ada2-80622bf56457 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3f44535879e47f3b3a39d551418eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d608b3eb7b4d1b965981b5ea727a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:54.783275 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-992f7bae-4d54-4526-ada2-80622bf56457 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] 10.222.0.58 "GET /compute/v2.1/servers/9aebc95f-f7c3-479b-ba60-8de2f4539f82" status: 200 len: 1372 microversion: 2.57 time: 0.147100 Aug 10 23:23:54.784158 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2552/5320] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:23:54 2022] GET /compute/v2.1/servers/9aebc95f-f7c3-479b-ba60-8de2f4539f82 => generated 1372 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:23:55.811255 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-7941f455-5a2a-4ce7-ac2c-8e7cd5453c3f tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:23:55.812723 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-7941f455-5a2a-4ce7-ac2c-8e7cd5453c3f tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] [instance: 9aebc95f-f7c3-479b-ba60-8de2f4539f82] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:23:55.836816 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7941f455-5a2a-4ce7-ac2c-8e7cd5453c3f tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:55.837609 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7941f455-5a2a-4ce7-ac2c-8e7cd5453c3f tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:55.841195 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7941f455-5a2a-4ce7-ac2c-8e7cd5453c3f tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:55.843042 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7941f455-5a2a-4ce7-ac2c-8e7cd5453c3f tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:55.844313 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7941f455-5a2a-4ce7-ac2c-8e7cd5453c3f tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:55.849474 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7941f455-5a2a-4ce7-ac2c-8e7cd5453c3f tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:56.093106 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-7941f455-5a2a-4ce7-ac2c-8e7cd5453c3f tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3f44535879e47f3b3a39d551418eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d608b3eb7b4d1b965981b5ea727a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:56.103667 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-7941f455-5a2a-4ce7-ac2c-8e7cd5453c3f tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3f44535879e47f3b3a39d551418eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d608b3eb7b4d1b965981b5ea727a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:56.105189 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-7941f455-5a2a-4ce7-ac2c-8e7cd5453c3f tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3f44535879e47f3b3a39d551418eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d608b3eb7b4d1b965981b5ea727a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:56.113944 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-7941f455-5a2a-4ce7-ac2c-8e7cd5453c3f tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] 10.222.0.58 "GET /compute/v2.1/servers/9aebc95f-f7c3-479b-ba60-8de2f4539f82" status: 200 len: 1357 microversion: 2.57 time: 0.302536 Aug 10 23:23:56.131994 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2769/5321] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:23:55 2022] GET /compute/v2.1/servers/9aebc95f-f7c3-479b-ba60-8de2f4539f82 => generated 1357 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:23:56.144540 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-9611ee97-938e-42d0-96a4-1f36b8416b31 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:23:56.145037 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-9611ee97-938e-42d0-96a4-1f36b8416b31 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] [instance: 9aebc95f-f7c3-479b-ba60-8de2f4539f82] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:23:56.157046 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9611ee97-938e-42d0-96a4-1f36b8416b31 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:56.158486 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9611ee97-938e-42d0-96a4-1f36b8416b31 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:56.160319 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9611ee97-938e-42d0-96a4-1f36b8416b31 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:56.161084 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9611ee97-938e-42d0-96a4-1f36b8416b31 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:56.161547 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9611ee97-938e-42d0-96a4-1f36b8416b31 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:56.161978 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9611ee97-938e-42d0-96a4-1f36b8416b31 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:56.265198 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-9611ee97-938e-42d0-96a4-1f36b8416b31 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] [instance: 9aebc95f-f7c3-479b-ba60-8de2f4539f82] Going to try to terminate instance {{(pid=122632) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:23:56.352459 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:23:56.508243 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-9611ee97-938e-42d0-96a4-1f36b8416b31 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] 10.222.0.58 "DELETE /compute/v2.1/servers/9aebc95f-f7c3-479b-ba60-8de2f4539f82" status: 204 len: 0 microversion: 2.57 time: 0.363190 Aug 10 23:23:56.513398 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2553/5322] 10.222.0.58 () {60 vars in 1280 bytes} [Wed Aug 10 23:23:56 2022] DELETE /compute/v2.1/servers/9aebc95f-f7c3-479b-ba60-8de2f4539f82 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 10 23:23:56.523460 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c3eb8904-f7d3-40a5-874a-ee1cd4b162f8 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:23:56.524489 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-c3eb8904-f7d3-40a5-874a-ee1cd4b162f8 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] [instance: 9aebc95f-f7c3-479b-ba60-8de2f4539f82] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:23:56.543181 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c3eb8904-f7d3-40a5-874a-ee1cd4b162f8 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:56.543686 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c3eb8904-f7d3-40a5-874a-ee1cd4b162f8 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:56.544181 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c3eb8904-f7d3-40a5-874a-ee1cd4b162f8 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:56.545106 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c3eb8904-f7d3-40a5-874a-ee1cd4b162f8 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:56.545765 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c3eb8904-f7d3-40a5-874a-ee1cd4b162f8 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:56.546341 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c3eb8904-f7d3-40a5-874a-ee1cd4b162f8 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:57.029649 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-c3eb8904-f7d3-40a5-874a-ee1cd4b162f8 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3f44535879e47f3b3a39d551418eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d608b3eb7b4d1b965981b5ea727a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:57.042654 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-c3eb8904-f7d3-40a5-874a-ee1cd4b162f8 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3f44535879e47f3b3a39d551418eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d608b3eb7b4d1b965981b5ea727a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:57.048755 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-c3eb8904-f7d3-40a5-874a-ee1cd4b162f8 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3f44535879e47f3b3a39d551418eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d608b3eb7b4d1b965981b5ea727a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:57.050360 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-c3eb8904-f7d3-40a5-874a-ee1cd4b162f8 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] 10.222.0.58 "GET /compute/v2.1/servers/9aebc95f-f7c3-479b-ba60-8de2f4539f82" status: 200 len: 1363 microversion: 2.57 time: 0.534240 Aug 10 23:23:57.071086 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2770/5323] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:23:56 2022] GET /compute/v2.1/servers/9aebc95f-f7c3-479b-ba60-8de2f4539f82 => generated 1363 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:23:58.079391 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-04e80088-79eb-402f-bf99-f57b7285b6b2 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:23:58.080094 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-04e80088-79eb-402f-bf99-f57b7285b6b2 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] [instance: 9aebc95f-f7c3-479b-ba60-8de2f4539f82] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:23:58.096894 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-04e80088-79eb-402f-bf99-f57b7285b6b2 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:58.101637 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-04e80088-79eb-402f-bf99-f57b7285b6b2 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:58.104014 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-04e80088-79eb-402f-bf99-f57b7285b6b2 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:58.105014 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-04e80088-79eb-402f-bf99-f57b7285b6b2 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:58.108526 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-04e80088-79eb-402f-bf99-f57b7285b6b2 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:58.108981 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-04e80088-79eb-402f-bf99-f57b7285b6b2 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:58.387408 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-04e80088-79eb-402f-bf99-f57b7285b6b2 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3f44535879e47f3b3a39d551418eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d608b3eb7b4d1b965981b5ea727a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:58.409202 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-04e80088-79eb-402f-bf99-f57b7285b6b2 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a3f44535879e47f3b3a39d551418eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d608b3eb7b4d1b965981b5ea727a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:58.410736 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-04e80088-79eb-402f-bf99-f57b7285b6b2 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a3f44535879e47f3b3a39d551418eb37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59d608b3eb7b4d1b965981b5ea727a62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:23:58.423233 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-04e80088-79eb-402f-bf99-f57b7285b6b2 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] 10.222.0.58 "GET /compute/v2.1/servers/9aebc95f-f7c3-479b-ba60-8de2f4539f82" status: 200 len: 1363 microversion: 2.57 time: 0.347604 Aug 10 23:23:58.425463 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2554/5324] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:23:58 2022] GET /compute/v2.1/servers/9aebc95f-f7c3-479b-ba60-8de2f4539f82 => generated 1363 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:23:58.591842 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c6b5b8fd-018b-4875-b4d7-f33fbad0fa33 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:23:58.594186 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-c6b5b8fd-018b-4875-b4d7-f33fbad0fa33 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] [instance: 2646d3d8-2541-4dbf-9b0f-5eb122ca1452] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:23:58.612522 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c6b5b8fd-018b-4875-b4d7-f33fbad0fa33 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:58.613265 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c6b5b8fd-018b-4875-b4d7-f33fbad0fa33 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:58.613928 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c6b5b8fd-018b-4875-b4d7-f33fbad0fa33 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:58.615097 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c6b5b8fd-018b-4875-b4d7-f33fbad0fa33 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:58.615713 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c6b5b8fd-018b-4875-b4d7-f33fbad0fa33 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:58.616347 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c6b5b8fd-018b-4875-b4d7-f33fbad0fa33 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:58.827669 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.objects.instance [None req-c6b5b8fd-018b-4875-b4d7-f33fbad0fa33 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lazy-loading 'services' on Instance uuid 2646d3d8-2541-4dbf-9b0f-5eb122ca1452 {{(pid=122633) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:23:59.014255 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-c6b5b8fd-018b-4875-b4d7-f33fbad0fa33 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] 10.222.0.58 "DELETE /compute/v2.1/servers/2646d3d8-2541-4dbf-9b0f-5eb122ca1452/os-volume_attachments/128a12b1-d255-447e-8a64-61f404db3bad" status: 202 len: 0 microversion: 2.1 time: 0.426818 Aug 10 23:23:59.014946 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2771/5325] 10.222.0.58 () {58 vars in 1416 bytes} [Wed Aug 10 23:23:58 2022] DELETE /compute/v2.1/servers/2646d3d8-2541-4dbf-9b0f-5eb122ca1452/os-volume_attachments/128a12b1-d255-447e-8a64-61f404db3bad => generated 0 bytes in 428 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:23:59.023571 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-0a5682f4-9c15-434e-a949-b09b36abd847 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:23:59.025998 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-0a5682f4-9c15-434e-a949-b09b36abd847 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] [instance: 2646d3d8-2541-4dbf-9b0f-5eb122ca1452] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:23:59.039736 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0a5682f4-9c15-434e-a949-b09b36abd847 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:59.040347 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0a5682f4-9c15-434e-a949-b09b36abd847 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:59.043453 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0a5682f4-9c15-434e-a949-b09b36abd847 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:59.044447 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0a5682f4-9c15-434e-a949-b09b36abd847 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:59.045069 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0a5682f4-9c15-434e-a949-b09b36abd847 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:59.045652 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0a5682f4-9c15-434e-a949-b09b36abd847 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:59.097492 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-0a5682f4-9c15-434e-a949-b09b36abd847 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] 10.222.0.58 "GET /compute/v2.1/servers/2646d3d8-2541-4dbf-9b0f-5eb122ca1452/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078186 Aug 10 23:23:59.103229 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2555/5326] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 10 23:23:59 2022] GET /compute/v2.1/servers/2646d3d8-2541-4dbf-9b0f-5eb122ca1452/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:23:59.456680 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-08ade0bb-fb29-42ff-ba63-11ef86d001f9 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:23:59.457534 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-08ade0bb-fb29-42ff-ba63-11ef86d001f9 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] [instance: 9aebc95f-f7c3-479b-ba60-8de2f4539f82] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:23:59.467123 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-08ade0bb-fb29-42ff-ba63-11ef86d001f9 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:59.468371 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-08ade0bb-fb29-42ff-ba63-11ef86d001f9 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:59.469195 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-08ade0bb-fb29-42ff-ba63-11ef86d001f9 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:59.469996 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-08ade0bb-fb29-42ff-ba63-11ef86d001f9 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:23:59.470626 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-08ade0bb-fb29-42ff-ba63-11ef86d001f9 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:23:59.471560 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-08ade0bb-fb29-42ff-ba63-11ef86d001f9 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:23:59.504731 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-08ade0bb-fb29-42ff-ba63-11ef86d001f9 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] HTTP exception thrown: Instance 9aebc95f-f7c3-479b-ba60-8de2f4539f82 could not be found. Aug 10 23:23:59.506416 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-08ade0bb-fb29-42ff-ba63-11ef86d001f9 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Request method failure captured: Aug 10 23:23:59.506416 n-d-850468-14 devstack@n-api.service[122633]: request: GET /compute/v2.1/servers/9aebc95f-f7c3-479b-ba60-8de2f4539f82 HTTP/1.1 Aug 10 23:23:59.506416 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:23:59.506416 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:23:59.506416 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:23:59.506416 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:23:59.506416 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:23:59.506416 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:23:59.506416 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:23:59.506416 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:23:59.506416 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9D3nVPaxX0HeJTjkiBdk16j3XQbX-YIpdPMveohVVRs2WibPzfLJjMuEBWtXZRBQb4YgfE87vP5PgSueGNXcz7ALUyKacm9R_TdkAQ1Y_AkeopreSi-ze6FgqGmk2nS2LsPk3yX3a00iv5ixvFgrFOyQrQKZYff1ksIDYFt1Ipg0Dy4 Aug 10 23:23:59.506416 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:23:59.506416 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:23:59.506416 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:23:59.506416 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:23:59.506416 n-d-850468-14 devstack@n-api.service[122633]: X-Openstack-Nova-Api-Version: 2.57 Aug 10 23:23:59.506416 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:23:59.506416 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:23:59.506416 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 59d608b3eb7b4d1b965981b5ea727a62 Aug 10 23:23:59.506416 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-ServerShowV257Test-559337149 Aug 10 23:23:59.506416 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:23:59.506416 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:23:59.506416 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/59d608b3eb7b4d1b965981b5ea727a62"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/59d608b3eb7b4d1b965981b5ea727a62"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/59d608b3eb7b4d1b965981b5ea727a62"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_59d608b3eb7b4d1b965981b5ea727a62", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:23:59.506416 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-ServerShowV257Test-559337149 Aug 10 23:23:59.506416 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 59d608b3eb7b4d1b965981b5ea727a62 Aug 10 23:23:59.506416 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-ServerShowV257Test-559337149 Aug 10 23:23:59.506416 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-ServerShowV257Test-559337149-project Aug 10 23:23:59.506416 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:23:59.506416 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:23:59.506416 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: a3f44535879e47f3b3a39d551418eb37 Aug 10 23:23:59.506416 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-ServerShowV257Test-559337149-project Aug 10 23:23:59.506416 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:23:59.506416 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance 9aebc95f-f7c3-479b-ba60-8de2f4539f82 could not be found. Aug 10 23:23:59.506416 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': '9aebc95f-f7c3-479b-ba60-8de2f4539f82'} Aug 10 23:23:59.506416 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:23:59.506416 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:23:59.506416 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:23:59.506416 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:23:59.506416 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:23:59.506416 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:23:59.506416 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:23:59.506416 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:23:59.506416 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:23:59.506416 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:23:59.506416 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9aebc95f-f7c3-479b-ba60-8de2f4539f82 could not be found. Aug 10 23:23:59.506416 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:23:59.506416 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:23:59.506416 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:23:59.506416 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:23:59.506416 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:23:59.506416 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:23:59.506416 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:23:59.506416 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:23:59.506416 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:23:59.506416 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:23:59.506416 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:23:59.506416 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:23:59.506416 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:23:59.506416 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:23:59.506416 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:23:59.506416 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:23:59.506416 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9aebc95f-f7c3-479b-ba60-8de2f4539f82 could not be found. Aug 10 23:23:59.506416 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:23:59.506416 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:23:59.506416 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:23:59.511127 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:23:59.511127 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:23:59.511127 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:23:59.511127 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:23:59.511127 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:23:59.511127 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9aebc95f-f7c3-479b-ba60-8de2f4539f82 could not be found. Aug 10 23:23:59.511127 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:23:59.514201 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-08ade0bb-fb29-42ff-ba63-11ef86d001f9 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] Returning 404 to user: Instance 9aebc95f-f7c3-479b-ba60-8de2f4539f82 could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:23:59.515282 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-08ade0bb-fb29-42ff-ba63-11ef86d001f9 tempest-ServerShowV257Test-559337149 tempest-ServerShowV257Test-559337149-project] 10.222.0.58 "GET /compute/v2.1/servers/9aebc95f-f7c3-479b-ba60-8de2f4539f82" status: 404 len: 111 microversion: 2.57 time: 0.067823 Aug 10 23:23:59.515876 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2772/5327] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:23:59 2022] GET /compute/v2.1/servers/9aebc95f-f7c3-479b-ba60-8de2f4539f82 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 10 23:24:00.111554 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-b007d508-96ab-4e6c-99a5-e6de8e406f0b tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:24:00.113368 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-b007d508-96ab-4e6c-99a5-e6de8e406f0b tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] [instance: 2646d3d8-2541-4dbf-9b0f-5eb122ca1452] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:24:00.140755 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b007d508-96ab-4e6c-99a5-e6de8e406f0b tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:24:00.141910 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b007d508-96ab-4e6c-99a5-e6de8e406f0b tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:24:00.143524 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b007d508-96ab-4e6c-99a5-e6de8e406f0b tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:24:00.146190 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b007d508-96ab-4e6c-99a5-e6de8e406f0b tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:24:00.149894 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b007d508-96ab-4e6c-99a5-e6de8e406f0b tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:24:00.150659 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b007d508-96ab-4e6c-99a5-e6de8e406f0b tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:24:00.299644 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-b007d508-96ab-4e6c-99a5-e6de8e406f0b tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] 10.222.0.58 "GET /compute/v2.1/servers/2646d3d8-2541-4dbf-9b0f-5eb122ca1452/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.192748 Aug 10 23:24:00.301707 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2556/5328] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 10 23:24:00 2022] GET /compute/v2.1/servers/2646d3d8-2541-4dbf-9b0f-5eb122ca1452/os-volume_attachments => generated 197 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:24:01.314084 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-bbc416fd-f7ef-4a10-8a1d-62adc9b76884 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:24:01.319119 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-bbc416fd-f7ef-4a10-8a1d-62adc9b76884 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] [instance: 2646d3d8-2541-4dbf-9b0f-5eb122ca1452] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:24:01.339466 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bbc416fd-f7ef-4a10-8a1d-62adc9b76884 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:24:01.339971 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bbc416fd-f7ef-4a10-8a1d-62adc9b76884 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:24:01.341014 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bbc416fd-f7ef-4a10-8a1d-62adc9b76884 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:24:01.341889 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bbc416fd-f7ef-4a10-8a1d-62adc9b76884 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:24:01.346614 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bbc416fd-f7ef-4a10-8a1d-62adc9b76884 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:24:01.347276 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bbc416fd-f7ef-4a10-8a1d-62adc9b76884 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:24:01.481747 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-bbc416fd-f7ef-4a10-8a1d-62adc9b76884 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] 10.222.0.58 "GET /compute/v2.1/servers/2646d3d8-2541-4dbf-9b0f-5eb122ca1452/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.172107 Aug 10 23:24:01.483659 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2773/5329] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 10 23:24:01 2022] GET /compute/v2.1/servers/2646d3d8-2541-4dbf-9b0f-5eb122ca1452/os-volume_attachments => generated 197 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 23:24:02.502758 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-e88e05ad-d542-442a-b536-912578664522 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:24:02.508188 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-e88e05ad-d542-442a-b536-912578664522 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] [instance: 2646d3d8-2541-4dbf-9b0f-5eb122ca1452] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:24:02.534991 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e88e05ad-d542-442a-b536-912578664522 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:24:02.537609 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e88e05ad-d542-442a-b536-912578664522 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:24:02.541798 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e88e05ad-d542-442a-b536-912578664522 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:24:02.544445 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e88e05ad-d542-442a-b536-912578664522 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:24:02.547413 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e88e05ad-d542-442a-b536-912578664522 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:24:02.548171 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e88e05ad-d542-442a-b536-912578664522 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:24:02.670136 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-e88e05ad-d542-442a-b536-912578664522 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] 10.222.0.58 "GET /compute/v2.1/servers/2646d3d8-2541-4dbf-9b0f-5eb122ca1452/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.179430 Aug 10 23:24:02.671048 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2557/5330] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 10 23:24:02 2022] GET /compute/v2.1/servers/2646d3d8-2541-4dbf-9b0f-5eb122ca1452/os-volume_attachments => generated 197 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 23:24:03.684285 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-15b636e9-2350-4402-b729-321399aaf8de tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:24:03.686980 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-15b636e9-2350-4402-b729-321399aaf8de tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] [instance: 2646d3d8-2541-4dbf-9b0f-5eb122ca1452] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:24:03.703786 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-15b636e9-2350-4402-b729-321399aaf8de tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:24:03.704334 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-15b636e9-2350-4402-b729-321399aaf8de tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:24:03.704693 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-15b636e9-2350-4402-b729-321399aaf8de tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:24:03.718216 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-15b636e9-2350-4402-b729-321399aaf8de tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:24:03.720009 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-15b636e9-2350-4402-b729-321399aaf8de tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:24:03.720635 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-15b636e9-2350-4402-b729-321399aaf8de tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:24:03.836406 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-15b636e9-2350-4402-b729-321399aaf8de tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] 10.222.0.58 "GET /compute/v2.1/servers/2646d3d8-2541-4dbf-9b0f-5eb122ca1452/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.156709 Aug 10 23:24:03.843139 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2774/5331] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 10 23:24:03 2022] GET /compute/v2.1/servers/2646d3d8-2541-4dbf-9b0f-5eb122ca1452/os-volume_attachments => generated 197 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 23:24:04.851625 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-d4bb000a-6c12-4023-95fd-958b127e8839 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:24:04.853512 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-d4bb000a-6c12-4023-95fd-958b127e8839 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] [instance: 2646d3d8-2541-4dbf-9b0f-5eb122ca1452] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:24:04.861783 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:24:04.871571 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d4bb000a-6c12-4023-95fd-958b127e8839 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:24:04.874571 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d4bb000a-6c12-4023-95fd-958b127e8839 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:24:04.875260 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d4bb000a-6c12-4023-95fd-958b127e8839 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:24:04.876180 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d4bb000a-6c12-4023-95fd-958b127e8839 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:24:04.879669 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d4bb000a-6c12-4023-95fd-958b127e8839 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:24:04.884768 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d4bb000a-6c12-4023-95fd-958b127e8839 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:24:04.955410 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-d4bb000a-6c12-4023-95fd-958b127e8839 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] 10.222.0.58 "GET /compute/v2.1/servers/2646d3d8-2541-4dbf-9b0f-5eb122ca1452/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.108089 Aug 10 23:24:04.960761 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2558/5332] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 10 23:24:04 2022] GET /compute/v2.1/servers/2646d3d8-2541-4dbf-9b0f-5eb122ca1452/os-volume_attachments => generated 197 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:24:05.378151 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-38954bc0-ff50-4bae-8b6c-85e7110133f6 tempest-ComputeTenantNetworksTest-322114658 tempest-ComputeTenantNetworksTest-322114658-project] Calling method '.version_select at 0x7f847c4b8430>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:24:05.972941 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-d26e5207-b1df-4f59-9d75-ff98a8e2cc0b tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:24:05.976474 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-d26e5207-b1df-4f59-9d75-ff98a8e2cc0b tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] [instance: 2646d3d8-2541-4dbf-9b0f-5eb122ca1452] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:24:05.987706 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d26e5207-b1df-4f59-9d75-ff98a8e2cc0b tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:24:05.988413 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d26e5207-b1df-4f59-9d75-ff98a8e2cc0b tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:24:05.989040 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d26e5207-b1df-4f59-9d75-ff98a8e2cc0b tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:24:05.989814 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d26e5207-b1df-4f59-9d75-ff98a8e2cc0b tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:24:05.990302 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d26e5207-b1df-4f59-9d75-ff98a8e2cc0b tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:24:05.990752 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d26e5207-b1df-4f59-9d75-ff98a8e2cc0b tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:24:06.067282 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-d26e5207-b1df-4f59-9d75-ff98a8e2cc0b tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] 10.222.0.58 "GET /compute/v2.1/servers/2646d3d8-2541-4dbf-9b0f-5eb122ca1452/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.098880 Aug 10 23:24:06.075087 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2559/5333] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 10 23:24:05 2022] GET /compute/v2.1/servers/2646d3d8-2541-4dbf-9b0f-5eb122ca1452/os-volume_attachments => generated 197 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 23:24:06.152922 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-38954bc0-ff50-4bae-8b6c-85e7110133f6 tempest-ComputeTenantNetworksTest-322114658 tempest-ComputeTenantNetworksTest-322114658-project] 10.222.0.58 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 309 microversion: 2.1 time: 1.083947 Aug 10 23:24:06.154029 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2775/5334] 10.222.0.58 () {58 vars in 1158 bytes} [Wed Aug 10 23:24:05 2022] GET /compute/v2.1/os-tenant-networks => generated 309 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:24:06.185611 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-adf0e35c-618b-406c-a383-8bbeb29f2f6e tempest-ComputeTenantNetworksTest-322114658 tempest-ComputeTenantNetworksTest-322114658-project] Calling method '.version_select at 0x7f846fc11d30>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:24:06.824864 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-adf0e35c-618b-406c-a383-8bbeb29f2f6e tempest-ComputeTenantNetworksTest-322114658 tempest-ComputeTenantNetworksTest-322114658-project] 10.222.0.58 "GET /compute/v2.1/os-tenant-networks/24b951bd-dd42-4280-a7a3-008da6d83dc8" status: 200 len: 140 microversion: 2.1 time: 0.650903 Aug 10 23:24:06.825783 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2560/5335] 10.222.0.58 () {58 vars in 1269 bytes} [Wed Aug 10 23:24:06 2022] GET /compute/v2.1/os-tenant-networks/24b951bd-dd42-4280-a7a3-008da6d83dc8 => generated 140 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:24:07.082251 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-fbc49d0e-e73b-4d33-800f-550876ab21c3 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:24:07.085978 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-fbc49d0e-e73b-4d33-800f-550876ab21c3 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] [instance: 2646d3d8-2541-4dbf-9b0f-5eb122ca1452] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:24:07.117978 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fbc49d0e-e73b-4d33-800f-550876ab21c3 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:24:07.118442 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fbc49d0e-e73b-4d33-800f-550876ab21c3 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:24:07.118924 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fbc49d0e-e73b-4d33-800f-550876ab21c3 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:24:07.119647 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fbc49d0e-e73b-4d33-800f-550876ab21c3 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:24:07.120103 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fbc49d0e-e73b-4d33-800f-550876ab21c3 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:24:07.120533 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fbc49d0e-e73b-4d33-800f-550876ab21c3 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:24:07.234601 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-fbc49d0e-e73b-4d33-800f-550876ab21c3 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] 10.222.0.58 "GET /compute/v2.1/servers/2646d3d8-2541-4dbf-9b0f-5eb122ca1452/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.156805 Aug 10 23:24:07.239233 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2776/5336] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 10 23:24:07 2022] GET /compute/v2.1/servers/2646d3d8-2541-4dbf-9b0f-5eb122ca1452/os-volume_attachments => generated 197 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:24:08.247823 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-0a80dbd6-69cf-4721-b354-3c1016722694 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:24:08.250434 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-0a80dbd6-69cf-4721-b354-3c1016722694 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] [instance: 2646d3d8-2541-4dbf-9b0f-5eb122ca1452] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:24:08.280503 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0a80dbd6-69cf-4721-b354-3c1016722694 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:24:08.282321 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0a80dbd6-69cf-4721-b354-3c1016722694 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:24:08.285297 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0a80dbd6-69cf-4721-b354-3c1016722694 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:24:08.286463 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0a80dbd6-69cf-4721-b354-3c1016722694 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:24:08.288926 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0a80dbd6-69cf-4721-b354-3c1016722694 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:24:08.289531 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0a80dbd6-69cf-4721-b354-3c1016722694 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:24:08.430381 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-0a80dbd6-69cf-4721-b354-3c1016722694 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] 10.222.0.58 "GET /compute/v2.1/servers/2646d3d8-2541-4dbf-9b0f-5eb122ca1452/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.187034 Aug 10 23:24:08.434381 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2561/5337] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 10 23:24:08 2022] GET /compute/v2.1/servers/2646d3d8-2541-4dbf-9b0f-5eb122ca1452/os-volume_attachments => generated 25 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 23:24:08.565370 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-1206fbed-112b-4b66-b0fa-7460bcb7b415 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:24:08.565957 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-1206fbed-112b-4b66-b0fa-7460bcb7b415 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] [instance: 2646d3d8-2541-4dbf-9b0f-5eb122ca1452] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:24:08.574891 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1206fbed-112b-4b66-b0fa-7460bcb7b415 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:24:08.575398 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1206fbed-112b-4b66-b0fa-7460bcb7b415 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:24:08.575843 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1206fbed-112b-4b66-b0fa-7460bcb7b415 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:24:08.576559 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1206fbed-112b-4b66-b0fa-7460bcb7b415 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:24:08.577017 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1206fbed-112b-4b66-b0fa-7460bcb7b415 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:24:08.577448 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1206fbed-112b-4b66-b0fa-7460bcb7b415 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:24:08.608574 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-1206fbed-112b-4b66-b0fa-7460bcb7b415 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] [instance: 2646d3d8-2541-4dbf-9b0f-5eb122ca1452] Going to try to terminate instance {{(pid=122633) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:24:08.780886 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-1206fbed-112b-4b66-b0fa-7460bcb7b415 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] 10.222.0.58 "DELETE /compute/v2.1/servers/2646d3d8-2541-4dbf-9b0f-5eb122ca1452" status: 204 len: 0 microversion: 2.1 time: 0.219368 Aug 10 23:24:08.782189 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2777/5338] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:24:08 2022] DELETE /compute/v2.1/servers/2646d3d8-2541-4dbf-9b0f-5eb122ca1452 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:24:08.791100 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-3ce948b5-2637-48aa-83f7-f65de0dae429 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:24:08.792063 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-3ce948b5-2637-48aa-83f7-f65de0dae429 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] [instance: 2646d3d8-2541-4dbf-9b0f-5eb122ca1452] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:24:08.804514 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3ce948b5-2637-48aa-83f7-f65de0dae429 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:24:08.812762 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3ce948b5-2637-48aa-83f7-f65de0dae429 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:24:08.813613 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3ce948b5-2637-48aa-83f7-f65de0dae429 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:24:08.814558 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3ce948b5-2637-48aa-83f7-f65de0dae429 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:24:08.815386 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3ce948b5-2637-48aa-83f7-f65de0dae429 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:24:08.815972 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3ce948b5-2637-48aa-83f7-f65de0dae429 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:24:09.185197 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-3ce948b5-2637-48aa-83f7-f65de0dae429 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d89081084f14e0187f4c67cd9185fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b557edd165144c8943eb9acc339a377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:24:09.196672 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-3ce948b5-2637-48aa-83f7-f65de0dae429 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] 10.222.0.58 "GET /compute/v2.1/servers/2646d3d8-2541-4dbf-9b0f-5eb122ca1452" status: 200 len: 1683 microversion: 2.1 time: 0.410231 Aug 10 23:24:09.197612 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2562/5339] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:24:08 2022] GET /compute/v2.1/servers/2646d3d8-2541-4dbf-9b0f-5eb122ca1452 => generated 1683 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:24:10.220913 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-7d4e77e1-591e-4771-a3ed-219b2b9e6d72 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:24:10.221669 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-7d4e77e1-591e-4771-a3ed-219b2b9e6d72 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] [instance: 2646d3d8-2541-4dbf-9b0f-5eb122ca1452] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:24:10.247459 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7d4e77e1-591e-4771-a3ed-219b2b9e6d72 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:24:10.248027 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7d4e77e1-591e-4771-a3ed-219b2b9e6d72 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:24:10.252938 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7d4e77e1-591e-4771-a3ed-219b2b9e6d72 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:24:10.253858 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7d4e77e1-591e-4771-a3ed-219b2b9e6d72 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:24:10.254350 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7d4e77e1-591e-4771-a3ed-219b2b9e6d72 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:24:10.258636 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7d4e77e1-591e-4771-a3ed-219b2b9e6d72 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:24:10.562566 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-7d4e77e1-591e-4771-a3ed-219b2b9e6d72 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d89081084f14e0187f4c67cd9185fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b557edd165144c8943eb9acc339a377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:24:10.582877 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-7d4e77e1-591e-4771-a3ed-219b2b9e6d72 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] 10.222.0.58 "GET /compute/v2.1/servers/2646d3d8-2541-4dbf-9b0f-5eb122ca1452" status: 200 len: 1683 microversion: 2.1 time: 0.367198 Aug 10 23:24:10.592693 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2778/5340] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:24:10 2022] GET /compute/v2.1/servers/2646d3d8-2541-4dbf-9b0f-5eb122ca1452 => generated 1683 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:24:11.615092 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-cce67276-720f-4778-8862-affa0d3ce38d tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:24:11.616059 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-cce67276-720f-4778-8862-affa0d3ce38d tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] [instance: 2646d3d8-2541-4dbf-9b0f-5eb122ca1452] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:24:11.628279 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cce67276-720f-4778-8862-affa0d3ce38d tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:24:11.628936 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cce67276-720f-4778-8862-affa0d3ce38d tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:24:11.629541 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cce67276-720f-4778-8862-affa0d3ce38d tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:24:11.636983 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cce67276-720f-4778-8862-affa0d3ce38d tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:24:11.637617 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cce67276-720f-4778-8862-affa0d3ce38d tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:24:11.638225 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cce67276-720f-4778-8862-affa0d3ce38d tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:24:12.399050 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-cce67276-720f-4778-8862-affa0d3ce38d tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d89081084f14e0187f4c67cd9185fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b557edd165144c8943eb9acc339a377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:24:12.416568 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-cce67276-720f-4778-8862-affa0d3ce38d tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] 10.222.0.58 "GET /compute/v2.1/servers/2646d3d8-2541-4dbf-9b0f-5eb122ca1452" status: 200 len: 1683 microversion: 2.1 time: 0.805727 Aug 10 23:24:12.426877 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2563/5341] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:24:11 2022] GET /compute/v2.1/servers/2646d3d8-2541-4dbf-9b0f-5eb122ca1452 => generated 1683 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:24:13.440180 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-772dd646-b80f-41dc-9584-f69239ee1f9b tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:24:13.440792 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-772dd646-b80f-41dc-9584-f69239ee1f9b tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] [instance: 2646d3d8-2541-4dbf-9b0f-5eb122ca1452] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:24:13.457965 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-772dd646-b80f-41dc-9584-f69239ee1f9b tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:24:13.458446 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-772dd646-b80f-41dc-9584-f69239ee1f9b tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:24:13.459175 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-772dd646-b80f-41dc-9584-f69239ee1f9b tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:24:13.460977 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-772dd646-b80f-41dc-9584-f69239ee1f9b tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:24:13.466187 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-772dd646-b80f-41dc-9584-f69239ee1f9b tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:24:13.467351 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-772dd646-b80f-41dc-9584-f69239ee1f9b tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:24:13.808384 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-772dd646-b80f-41dc-9584-f69239ee1f9b tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d89081084f14e0187f4c67cd9185fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b557edd165144c8943eb9acc339a377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:24:13.816574 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-772dd646-b80f-41dc-9584-f69239ee1f9b tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] 10.222.0.58 "GET /compute/v2.1/servers/2646d3d8-2541-4dbf-9b0f-5eb122ca1452" status: 200 len: 1615 microversion: 2.1 time: 0.380165 Aug 10 23:24:13.839481 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2779/5342] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:24:13 2022] GET /compute/v2.1/servers/2646d3d8-2541-4dbf-9b0f-5eb122ca1452 => generated 1615 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:24:14.320043 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-194a3eab-e6f1-497a-b749-3e11402f997c req-53f907e2-0ad9-4d95-8573-18a25f2bd06e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2646d3d8-2541-4dbf-9b0f-5eb122ca1452", "name": "network-vif-deleted", "tag": "98a6e2a1-4551-40ba-ae20-1d39116fefc4"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:24:14.342585 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-194a3eab-e6f1-497a-b749-3e11402f997c req-53f907e2-0ad9-4d95-8573-18a25f2bd06e service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:24:14.343397 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-194a3eab-e6f1-497a-b749-3e11402f997c req-53f907e2-0ad9-4d95-8573-18a25f2bd06e service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:24:14.344021 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-194a3eab-e6f1-497a-b749-3e11402f997c req-53f907e2-0ad9-4d95-8573-18a25f2bd06e service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:24:14.364403 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-194a3eab-e6f1-497a-b749-3e11402f997c req-53f907e2-0ad9-4d95-8573-18a25f2bd06e service nova] Creating event network-vif-deleted:98a6e2a1-4551-40ba-ae20-1d39116fefc4 for instance 2646d3d8-2541-4dbf-9b0f-5eb122ca1452 on n-h2-850468-14 Aug 10 23:24:14.379148 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-194a3eab-e6f1-497a-b749-3e11402f997c req-53f907e2-0ad9-4d95-8573-18a25f2bd06e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058978 Aug 10 23:24:14.380632 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2564/5343] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:24:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:24:14.845681 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-f8ae3faf-ddf4-480d-b819-c700daa731dc tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:24:14.846948 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-f8ae3faf-ddf4-480d-b819-c700daa731dc tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] [instance: 2646d3d8-2541-4dbf-9b0f-5eb122ca1452] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:24:14.860793 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f8ae3faf-ddf4-480d-b819-c700daa731dc tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:24:14.862857 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f8ae3faf-ddf4-480d-b819-c700daa731dc tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:24:14.870423 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f8ae3faf-ddf4-480d-b819-c700daa731dc tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:24:14.871329 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f8ae3faf-ddf4-480d-b819-c700daa731dc tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:24:14.872096 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f8ae3faf-ddf4-480d-b819-c700daa731dc tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:24:14.872278 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f8ae3faf-ddf4-480d-b819-c700daa731dc tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:24:14.960811 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f8ae3faf-ddf4-480d-b819-c700daa731dc tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:24:14.961317 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f8ae3faf-ddf4-480d-b819-c700daa731dc tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:24:14.961764 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f8ae3faf-ddf4-480d-b819-c700daa731dc tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:24:14.962274 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.objects.instance [None req-f8ae3faf-ddf4-480d-b819-c700daa731dc tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lazy-loading 'fault' on Instance uuid 2646d3d8-2541-4dbf-9b0f-5eb122ca1452 {{(pid=122633) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:24:15.059715 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-f8ae3faf-ddf4-480d-b819-c700daa731dc tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d89081084f14e0187f4c67cd9185fef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b557edd165144c8943eb9acc339a377', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:24:15.073417 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-f8ae3faf-ddf4-480d-b819-c700daa731dc tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] 10.222.0.58 "GET /compute/v2.1/servers/2646d3d8-2541-4dbf-9b0f-5eb122ca1452" status: 200 len: 1332 microversion: 2.1 time: 0.231678 Aug 10 23:24:15.074601 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2780/5344] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:24:14 2022] GET /compute/v2.1/servers/2646d3d8-2541-4dbf-9b0f-5eb122ca1452 => generated 1332 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:24:16.094941 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-9e89ce86-da75-4e49-951d-adbb3e4a2fe8 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:24:16.096288 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-9e89ce86-da75-4e49-951d-adbb3e4a2fe8 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] [instance: 2646d3d8-2541-4dbf-9b0f-5eb122ca1452] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:24:16.117344 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9e89ce86-da75-4e49-951d-adbb3e4a2fe8 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:24:16.117841 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9e89ce86-da75-4e49-951d-adbb3e4a2fe8 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:24:16.118282 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9e89ce86-da75-4e49-951d-adbb3e4a2fe8 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:24:16.119030 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9e89ce86-da75-4e49-951d-adbb3e4a2fe8 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:24:16.119481 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9e89ce86-da75-4e49-951d-adbb3e4a2fe8 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:24:16.119903 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9e89ce86-da75-4e49-951d-adbb3e4a2fe8 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:24:16.144171 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-9e89ce86-da75-4e49-951d-adbb3e4a2fe8 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] HTTP exception thrown: Instance 2646d3d8-2541-4dbf-9b0f-5eb122ca1452 could not be found. Aug 10 23:24:16.145968 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-9e89ce86-da75-4e49-951d-adbb3e4a2fe8 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Request method failure captured: Aug 10 23:24:16.145968 n-d-850468-14 devstack@n-api.service[122632]: request: GET /compute/v2.1/servers/2646d3d8-2541-4dbf-9b0f-5eb122ca1452 HTTP/1.1 Aug 10 23:24:16.145968 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:24:16.145968 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:24:16.145968 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:24:16.145968 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 23:24:16.145968 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:24:16.145968 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:24:16.145968 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:24:16.145968 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:24:16.145968 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9Dyh6-R-3HT3qmAYw73oJfCuu2NJv_Uk6ESXtcq6VvNMtaQn1cTuz-I3qzoDfMZYBb14V5s9aXOf7KFvhR2arcnhZ5gC9SddHqo24MvVPxr7p8PNkuseL9l1-7bXrad-0RpRPdQnhZkSYtsPZXEtrxg11yCwwP1jlsEo-QBQNYEMWc4 Aug 10 23:24:16.145968 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:24:16.145968 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:24:16.145968 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:24:16.145968 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:24:16.145968 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:24:16.145968 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:24:16.145968 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 2b557edd165144c8943eb9acc339a377 Aug 10 23:24:16.145968 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-AttachVolumeNegativeTest-393353666 Aug 10 23:24:16.145968 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:24:16.145968 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:24:16.145968 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2b557edd165144c8943eb9acc339a377"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2b557edd165144c8943eb9acc339a377"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2b557edd165144c8943eb9acc339a377"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2b557edd165144c8943eb9acc339a377", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:24:16.145968 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-AttachVolumeNegativeTest-393353666 Aug 10 23:24:16.145968 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 2b557edd165144c8943eb9acc339a377 Aug 10 23:24:16.145968 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-393353666 Aug 10 23:24:16.145968 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-AttachVolumeNegativeTest-393353666-project Aug 10 23:24:16.145968 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:24:16.145968 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:24:16.145968 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: 0d89081084f14e0187f4c67cd9185fef Aug 10 23:24:16.145968 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-AttachVolumeNegativeTest-393353666-project Aug 10 23:24:16.145968 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:24:16.145968 n-d-850468-14 devstack@n-api.service[122632]: exception: Instance 2646d3d8-2541-4dbf-9b0f-5eb122ca1452 could not be found. Aug 10 23:24:16.145968 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': '2646d3d8-2541-4dbf-9b0f-5eb122ca1452'} Aug 10 23:24:16.145968 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:24:16.145968 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:24:16.145968 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:24:16.145968 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:24:16.145968 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:24:16.145968 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:24:16.145968 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:24:16.145968 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:24:16.145968 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:24:16.145968 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:24:16.145968 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2646d3d8-2541-4dbf-9b0f-5eb122ca1452 could not be found. Aug 10 23:24:16.145968 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:24:16.145968 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:24:16.145968 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:24:16.145968 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:24:16.145968 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:24:16.145968 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:24:16.145968 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:24:16.145968 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:24:16.145968 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:24:16.145968 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:24:16.145968 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:24:16.145968 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:24:16.145968 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:24:16.145968 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:24:16.145968 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:24:16.145968 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:24:16.145968 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2646d3d8-2541-4dbf-9b0f-5eb122ca1452 could not be found. Aug 10 23:24:16.145968 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:24:16.145968 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:24:16.145968 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:24:16.151330 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:24:16.151330 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:24:16.151330 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:24:16.151330 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:24:16.151330 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:24:16.151330 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2646d3d8-2541-4dbf-9b0f-5eb122ca1452 could not be found. Aug 10 23:24:16.151330 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:24:16.151330 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-9e89ce86-da75-4e49-951d-adbb3e4a2fe8 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Returning 404 to user: Instance 2646d3d8-2541-4dbf-9b0f-5eb122ca1452 could not be found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:24:16.151330 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-9e89ce86-da75-4e49-951d-adbb3e4a2fe8 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] 10.222.0.58 "GET /compute/v2.1/servers/2646d3d8-2541-4dbf-9b0f-5eb122ca1452" status: 404 len: 111 microversion: 2.1 time: 0.057480 Aug 10 23:24:16.157148 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-63d076af-dfa1-430a-8a12-18bc64f2c596 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Calling method '.version_select at 0x7f847c46e820>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:24:16.166978 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2565/5345] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:24:16 2022] GET /compute/v2.1/servers/2646d3d8-2541-4dbf-9b0f-5eb122ca1452 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:24:16.196117 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-63d076af-dfa1-430a-8a12-18bc64f2c596 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1719151935" status: 202 len: 0 microversion: 2.1 time: 0.042407 Aug 10 23:24:16.200132 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2781/5346] 10.222.0.58 () {58 vars in 1221 bytes} [Wed Aug 10 23:24:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1719151935 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:24:24.439195 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-72f794f5-5a80-4f64-91a3-3f5c8482dec7 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Action: 'create', calling method: .version_select at 0x7f846fc11310>, body: {"keypair": {"name": "tempest-keypair-1598256161", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA3HgK7ep9My3ly1PellHinQ50CmNqdR3cFtegWiiuWreQqOMmlCI803QzNn5C/VgSk2ERbUGnq7TsHgQf/Al6fW6At4P/Rp0FWbtwf8ES/+jJQfSWpxlTf6oFQuCk7BDg=="}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:24:24.481331 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-72f794f5-5a80-4f64-91a3-3f5c8482dec7 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Getting quotas for project 1597a7e6731c4f5f9d8dfdc793ec2d47. Resources: {'key_pairs'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:24:24.498022 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-72f794f5-5a80-4f64-91a3-3f5c8482dec7 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Getting quotas for user 8ad42d35070247d18e67b2fa10690252 and project 1597a7e6731c4f5f9d8dfdc793ec2d47. Resources: {'key_pairs'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:24:24.578971 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-72f794f5-5a80-4f64-91a3-3f5c8482dec7 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.506708 Aug 10 23:24:24.591178 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2566/5347] 10.222.0.58 () {62 vars in 1200 bytes} [Wed Aug 10 23:24:24 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 520 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 10 23:24:25.755655 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-d0d199a3-4cc5-4569-8f0b-f5a5f131b0d6 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:24:25.756447 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-d0d199a3-4cc5-4569-8f0b-f5a5f131b0d6 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] [instance: 2646d3d8-2541-4dbf-9b0f-5eb122ca1452] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:24:25.774589 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=83,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:24:25.775921 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:24:25.777416 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d0d199a3-4cc5-4569-8f0b-f5a5f131b0d6 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:24:25.777984 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d0d199a3-4cc5-4569-8f0b-f5a5f131b0d6 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:24:25.778427 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d0d199a3-4cc5-4569-8f0b-f5a5f131b0d6 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:24:25.791361 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d0d199a3-4cc5-4569-8f0b-f5a5f131b0d6 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:24:25.791923 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d0d199a3-4cc5-4569-8f0b-f5a5f131b0d6 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:24:25.792376 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d0d199a3-4cc5-4569-8f0b-f5a5f131b0d6 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:24:25.845374 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-d0d199a3-4cc5-4569-8f0b-f5a5f131b0d6 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] HTTP exception thrown: Instance 2646d3d8-2541-4dbf-9b0f-5eb122ca1452 could not be found. Aug 10 23:24:25.852614 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-d0d199a3-4cc5-4569-8f0b-f5a5f131b0d6 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Request method failure captured: Aug 10 23:24:25.852614 n-d-850468-14 devstack@n-api.service[122633]: request: DELETE /compute/v2.1/servers/2646d3d8-2541-4dbf-9b0f-5eb122ca1452 HTTP/1.1 Aug 10 23:24:25.852614 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:24:25.852614 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:24:25.852614 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:24:25.852614 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:24:25.852614 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:24:25.852614 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:24:25.852614 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:24:25.852614 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:24:25.852614 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9Dyh6-R-3HT3qmAYw73oJfCuu2NJv_Uk6ESXtcq6VvNMtaQn1cTuz-I3qzoDfMZYBb14V5s9aXOf7KFvhR2arcnhZ5gC9SddHqo24MvVPxr7p8PNkuseL9l1-7bXrad-0RpRPdQnhZkSYtsPZXEtrxg11yCwwP1jlsEo-QBQNYEMWc4 Aug 10 23:24:25.852614 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:24:25.852614 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:24:25.852614 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:24:25.852614 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:24:25.852614 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:24:25.852614 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:24:25.852614 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 2b557edd165144c8943eb9acc339a377 Aug 10 23:24:25.852614 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-AttachVolumeNegativeTest-393353666 Aug 10 23:24:25.852614 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:24:25.852614 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:24:25.852614 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2b557edd165144c8943eb9acc339a377"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2b557edd165144c8943eb9acc339a377"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2b557edd165144c8943eb9acc339a377"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2b557edd165144c8943eb9acc339a377", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:24:25.852614 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-AttachVolumeNegativeTest-393353666 Aug 10 23:24:25.852614 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 2b557edd165144c8943eb9acc339a377 Aug 10 23:24:25.852614 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-393353666 Aug 10 23:24:25.852614 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-AttachVolumeNegativeTest-393353666-project Aug 10 23:24:25.852614 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:24:25.852614 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:24:25.852614 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 0d89081084f14e0187f4c67cd9185fef Aug 10 23:24:25.852614 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-AttachVolumeNegativeTest-393353666-project Aug 10 23:24:25.852614 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:24:25.852614 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance 2646d3d8-2541-4dbf-9b0f-5eb122ca1452 could not be found. Aug 10 23:24:25.852614 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': '2646d3d8-2541-4dbf-9b0f-5eb122ca1452'} Aug 10 23:24:25.852614 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:24:25.852614 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:24:25.852614 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:24:25.852614 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:24:25.852614 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:24:25.852614 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:24:25.852614 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:24:25.852614 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:24:25.852614 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:24:25.852614 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:24:25.852614 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2646d3d8-2541-4dbf-9b0f-5eb122ca1452 could not be found. Aug 10 23:24:25.852614 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:24:25.852614 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:24:25.852614 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:24:25.852614 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:24:25.852614 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:24:25.852614 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:24:25.852614 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:24:25.852614 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:24:25.852614 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:24:25.852614 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:24:25.852614 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 23:24:25.852614 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 23:24:25.852614 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 23:24:25.852614 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 23:24:25.852614 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:24:25.852614 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:24:25.852614 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:24:25.852614 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:24:25.856670 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2646d3d8-2541-4dbf-9b0f-5eb122ca1452 could not be found. Aug 10 23:24:25.856670 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:24:25.856670 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:24:25.856670 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:24:25.856670 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:24:25.856670 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:24:25.856670 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:24:25.856670 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:24:25.856670 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:24:25.856670 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2646d3d8-2541-4dbf-9b0f-5eb122ca1452 could not be found. Aug 10 23:24:25.856670 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:24:25.859336 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-d0d199a3-4cc5-4569-8f0b-f5a5f131b0d6 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Returning 404 to user: Instance 2646d3d8-2541-4dbf-9b0f-5eb122ca1452 could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:24:25.863566 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-d0d199a3-4cc5-4569-8f0b-f5a5f131b0d6 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] 10.222.0.58 "DELETE /compute/v2.1/servers/2646d3d8-2541-4dbf-9b0f-5eb122ca1452" status: 404 len: 111 microversion: 2.1 time: 0.111752 Aug 10 23:24:25.871569 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2782/5348] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:24:25 2022] DELETE /compute/v2.1/servers/2646d3d8-2541-4dbf-9b0f-5eb122ca1452 => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:24:25.881178 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-992a362a-b0cd-46ed-b705-df0607112fcf tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:24:25.882910 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-992a362a-b0cd-46ed-b705-df0607112fcf tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] [instance: 2646d3d8-2541-4dbf-9b0f-5eb122ca1452] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:24:25.892900 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-992a362a-b0cd-46ed-b705-df0607112fcf tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:24:25.893634 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-992a362a-b0cd-46ed-b705-df0607112fcf tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:24:25.894298 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-992a362a-b0cd-46ed-b705-df0607112fcf tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:24:25.898803 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-992a362a-b0cd-46ed-b705-df0607112fcf tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:24:25.899744 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-992a362a-b0cd-46ed-b705-df0607112fcf tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:24:25.903228 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-992a362a-b0cd-46ed-b705-df0607112fcf tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:24:25.940820 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-992a362a-b0cd-46ed-b705-df0607112fcf tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] HTTP exception thrown: Instance 2646d3d8-2541-4dbf-9b0f-5eb122ca1452 could not be found. Aug 10 23:24:25.944211 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-992a362a-b0cd-46ed-b705-df0607112fcf tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Request method failure captured: Aug 10 23:24:25.944211 n-d-850468-14 devstack@n-api.service[122632]: request: GET /compute/v2.1/servers/2646d3d8-2541-4dbf-9b0f-5eb122ca1452 HTTP/1.1 Aug 10 23:24:25.944211 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:24:25.944211 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:24:25.944211 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:24:25.944211 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 23:24:25.944211 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:24:25.944211 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:24:25.944211 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:24:25.944211 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:24:25.944211 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9Dyh6-R-3HT3qmAYw73oJfCuu2NJv_Uk6ESXtcq6VvNMtaQn1cTuz-I3qzoDfMZYBb14V5s9aXOf7KFvhR2arcnhZ5gC9SddHqo24MvVPxr7p8PNkuseL9l1-7bXrad-0RpRPdQnhZkSYtsPZXEtrxg11yCwwP1jlsEo-QBQNYEMWc4 Aug 10 23:24:25.944211 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:24:25.944211 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:24:25.944211 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:24:25.944211 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:24:25.944211 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:24:25.944211 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:24:25.944211 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 2b557edd165144c8943eb9acc339a377 Aug 10 23:24:25.944211 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-AttachVolumeNegativeTest-393353666 Aug 10 23:24:25.944211 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:24:25.944211 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:24:25.944211 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2b557edd165144c8943eb9acc339a377"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2b557edd165144c8943eb9acc339a377"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2b557edd165144c8943eb9acc339a377"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2b557edd165144c8943eb9acc339a377", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:24:25.944211 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-AttachVolumeNegativeTest-393353666 Aug 10 23:24:25.944211 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 2b557edd165144c8943eb9acc339a377 Aug 10 23:24:25.944211 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-393353666 Aug 10 23:24:25.944211 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-AttachVolumeNegativeTest-393353666-project Aug 10 23:24:25.944211 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:24:25.944211 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:24:25.944211 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: 0d89081084f14e0187f4c67cd9185fef Aug 10 23:24:25.944211 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-AttachVolumeNegativeTest-393353666-project Aug 10 23:24:25.944211 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:24:25.944211 n-d-850468-14 devstack@n-api.service[122632]: exception: Instance 2646d3d8-2541-4dbf-9b0f-5eb122ca1452 could not be found. Aug 10 23:24:25.944211 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': '2646d3d8-2541-4dbf-9b0f-5eb122ca1452'} Aug 10 23:24:25.944211 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:24:25.944211 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:24:25.944211 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:24:25.944211 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:24:25.944211 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:24:25.944211 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:24:25.944211 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:24:25.944211 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:24:25.944211 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:24:25.944211 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:24:25.944211 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2646d3d8-2541-4dbf-9b0f-5eb122ca1452 could not be found. Aug 10 23:24:25.944211 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:24:25.944211 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:24:25.944211 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:24:25.944211 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:24:25.944211 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:24:25.944211 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:24:25.944211 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:24:25.944211 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:24:25.944211 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:24:25.944211 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:24:25.944211 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:24:25.944211 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:24:25.944211 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:24:25.944211 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:24:25.944211 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:24:25.944211 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:24:25.944211 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2646d3d8-2541-4dbf-9b0f-5eb122ca1452 could not be found. Aug 10 23:24:25.944211 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:24:25.944211 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:24:25.944211 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:24:25.948711 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:24:25.948711 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:24:25.948711 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:24:25.948711 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:24:25.948711 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:24:25.948711 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2646d3d8-2541-4dbf-9b0f-5eb122ca1452 could not be found. Aug 10 23:24:25.948711 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:24:25.950323 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-992a362a-b0cd-46ed-b705-df0607112fcf tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Returning 404 to user: Instance 2646d3d8-2541-4dbf-9b0f-5eb122ca1452 could not be found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:24:25.951747 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-992a362a-b0cd-46ed-b705-df0607112fcf tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] 10.222.0.58 "GET /compute/v2.1/servers/2646d3d8-2541-4dbf-9b0f-5eb122ca1452" status: 404 len: 111 microversion: 2.1 time: 0.075938 Aug 10 23:24:25.955694 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2567/5349] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:24:25 2022] GET /compute/v2.1/servers/2646d3d8-2541-4dbf-9b0f-5eb122ca1452 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:24:30.304076 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-641eaca8-3ad3-4194-893a-26c7d655c8ea tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2042702416", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a1e77038-b03a-4411-8a20-a5a8eaec9348"}], "security_groups": [{"name": "tempest-securitygroup--852600172"}], "key_name": "tempest-keypair-1598256161", "user_data": "}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:24:30.608901 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.network.neutron [None req-641eaca8-3ad3-4194-893a-26c7d655c8ea tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] validate_networks() for [('a1e77038-b03a-4411-8a20-a5a8eaec9348', None, None, None, None, None)] {{(pid=122633) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 23:24:32.003816 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-641eaca8-3ad3-4194-893a-26c7d655c8ea tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Flavor limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:24:32.006440 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-641eaca8-3ad3-4194-893a-26c7d655c8ea tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Image limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:24:32.007793 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-641eaca8-3ad3-4194-893a-26c7d655c8ea tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Flavor pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:24:32.008439 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-641eaca8-3ad3-4194-893a-26c7d655c8ea tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Image pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:24:32.009069 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-641eaca8-3ad3-4194-893a-26c7d655c8ea tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:24:32.022392 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-641eaca8-3ad3-4194-893a-26c7d655c8ea tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:24:32.023402 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-641eaca8-3ad3-4194-893a-26c7d655c8ea tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:24:32.024074 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-641eaca8-3ad3-4194-893a-26c7d655c8ea tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:24:32.025716 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-641eaca8-3ad3-4194-893a-26c7d655c8ea tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:24:32.030755 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-641eaca8-3ad3-4194-893a-26c7d655c8ea tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:24:32.031603 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-641eaca8-3ad3-4194-893a-26c7d655c8ea tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:24:32.089311 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-641eaca8-3ad3-4194-893a-26c7d655c8ea tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Getting quotas for project 1597a7e6731c4f5f9d8dfdc793ec2d47. Resources: {'instances', 'cores', 'ram'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:24:32.101657 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-641eaca8-3ad3-4194-893a-26c7d655c8ea tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Getting quotas for user 8ad42d35070247d18e67b2fa10690252 and project 1597a7e6731c4f5f9d8dfdc793ec2d47. Resources: {'instances', 'cores', 'ram'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:24:32.143079 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-641eaca8-3ad3-4194-893a-26c7d655c8ea tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Going to run 1 instances... {{(pid=122633) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 23:24:32.145527 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-641eaca8-3ad3-4194-893a-26c7d655c8ea tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: 03e88a01-d3ed-4ab2-a334-f4bc274fe800] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78ad8905-f66f-4733-8be9-2b260f1fabed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122633) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 23:24:32.266740 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-641eaca8-3ad3-4194-893a-26c7d655c8ea tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.967433 Aug 10 23:24:32.273269 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2783/5350] 10.222.0.58 () {62 vars in 1188 bytes} [Wed Aug 10 23:24:30 2022] POST /compute/v2.1/servers => generated 401 bytes in 1975 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 10 23:24:32.283980 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-97ca095a-45e0-4e84-95ac-cfa5fcc80f30 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:24:32.285291 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-97ca095a-45e0-4e84-95ac-cfa5fcc80f30 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: 03e88a01-d3ed-4ab2-a334-f4bc274fe800] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:24:32.503588 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-97ca095a-45e0-4e84-95ac-cfa5fcc80f30 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:24:32.514916 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-97ca095a-45e0-4e84-95ac-cfa5fcc80f30 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:24:32.517069 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-97ca095a-45e0-4e84-95ac-cfa5fcc80f30 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:24:32.518396 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-97ca095a-45e0-4e84-95ac-cfa5fcc80f30 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800" status: 200 len: 1282 microversion: 2.20 time: 0.238511 Aug 10 23:24:32.532214 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2568/5351] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:24:32 2022] GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800 => generated 1282 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:24:33.550053 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-86756d1f-367e-41ba-b529-4e894f490343 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:24:33.551413 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-86756d1f-367e-41ba-b529-4e894f490343 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: 03e88a01-d3ed-4ab2-a334-f4bc274fe800] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:24:33.573364 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-86756d1f-367e-41ba-b529-4e894f490343 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:24:33.582424 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-86756d1f-367e-41ba-b529-4e894f490343 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:24:33.587472 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-86756d1f-367e-41ba-b529-4e894f490343 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:24:33.588818 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-86756d1f-367e-41ba-b529-4e894f490343 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:24:33.589401 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-86756d1f-367e-41ba-b529-4e894f490343 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:24:33.594530 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-86756d1f-367e-41ba-b529-4e894f490343 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:24:33.871767 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-86756d1f-367e-41ba-b529-4e894f490343 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:24:33.881730 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-86756d1f-367e-41ba-b529-4e894f490343 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:24:33.903152 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-86756d1f-367e-41ba-b529-4e894f490343 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:24:33.908229 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-86756d1f-367e-41ba-b529-4e894f490343 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800" status: 200 len: 1278 microversion: 2.20 time: 0.363300 Aug 10 23:24:33.909137 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2784/5352] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:24:33 2022] GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800 => generated 1278 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:24:34.937463 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-5471a593-9967-42d9-a160-cc3f3f530219 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:24:34.938964 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-5471a593-9967-42d9-a160-cc3f3f530219 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: 03e88a01-d3ed-4ab2-a334-f4bc274fe800] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:24:34.943247 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=1 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:24:34.960770 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5471a593-9967-42d9-a160-cc3f3f530219 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:24:34.974848 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5471a593-9967-42d9-a160-cc3f3f530219 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:24:34.974848 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5471a593-9967-42d9-a160-cc3f3f530219 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:24:34.974848 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5471a593-9967-42d9-a160-cc3f3f530219 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:24:34.974848 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5471a593-9967-42d9-a160-cc3f3f530219 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:24:34.974848 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5471a593-9967-42d9-a160-cc3f3f530219 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:24:35.054311 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=64,nova_cell1:INSERT=1 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:24:35.137648 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-5471a593-9967-42d9-a160-cc3f3f530219 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:24:35.177498 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-5471a593-9967-42d9-a160-cc3f3f530219 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:24:35.183585 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-5471a593-9967-42d9-a160-cc3f3f530219 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:24:35.184822 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-5471a593-9967-42d9-a160-cc3f3f530219 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800" status: 200 len: 1352 microversion: 2.20 time: 0.251555 Aug 10 23:24:35.188132 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2569/5353] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:24:34 2022] GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800 => generated 1352 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:24:36.213781 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-56ad1159-5499-4ee3-af83-4db1034a1209 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:24:36.214391 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-56ad1159-5499-4ee3-af83-4db1034a1209 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: 03e88a01-d3ed-4ab2-a334-f4bc274fe800] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:24:36.238125 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-56ad1159-5499-4ee3-af83-4db1034a1209 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:24:36.238125 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-56ad1159-5499-4ee3-af83-4db1034a1209 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:24:36.238125 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-56ad1159-5499-4ee3-af83-4db1034a1209 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:24:36.247529 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-56ad1159-5499-4ee3-af83-4db1034a1209 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:24:36.248200 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-56ad1159-5499-4ee3-af83-4db1034a1209 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:24:36.248656 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-56ad1159-5499-4ee3-af83-4db1034a1209 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:24:36.425535 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-56ad1159-5499-4ee3-af83-4db1034a1209 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:24:36.436130 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-56ad1159-5499-4ee3-af83-4db1034a1209 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:24:36.450550 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-56ad1159-5499-4ee3-af83-4db1034a1209 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:24:36.454552 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-56ad1159-5499-4ee3-af83-4db1034a1209 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800" status: 200 len: 1340 microversion: 2.20 time: 0.244645 Aug 10 23:24:36.457622 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2785/5354] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:24:36 2022] GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800 => generated 1340 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:24:37.487248 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-345a382c-7724-4283-803a-ac840b2ac723 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:24:37.487952 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-345a382c-7724-4283-803a-ac840b2ac723 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: 03e88a01-d3ed-4ab2-a334-f4bc274fe800] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:24:37.506934 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-345a382c-7724-4283-803a-ac840b2ac723 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:24:37.507530 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-345a382c-7724-4283-803a-ac840b2ac723 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:24:37.508183 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-345a382c-7724-4283-803a-ac840b2ac723 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:24:37.509099 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-345a382c-7724-4283-803a-ac840b2ac723 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:24:37.509750 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-345a382c-7724-4283-803a-ac840b2ac723 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:24:37.512285 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-345a382c-7724-4283-803a-ac840b2ac723 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:24:38.278568 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-345a382c-7724-4283-803a-ac840b2ac723 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:24:38.309531 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-345a382c-7724-4283-803a-ac840b2ac723 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:24:38.312045 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-345a382c-7724-4283-803a-ac840b2ac723 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:24:38.332332 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-345a382c-7724-4283-803a-ac840b2ac723 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800" status: 200 len: 1407 microversion: 2.20 time: 0.851758 Aug 10 23:24:38.334418 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2570/5355] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:24:37 2022] GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800 => generated 1407 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:24:38.485727 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-85cad62c-5e71-48be-af3f-8f0c9157bf67 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:24:38.486250 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-85cad62c-5e71-48be-af3f-8f0c9157bf67 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] [instance: 440c3d30-e5c9-4093-9b7e-39e06d32d682] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:24:38.506221 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-85cad62c-5e71-48be-af3f-8f0c9157bf67 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:24:38.506753 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-85cad62c-5e71-48be-af3f-8f0c9157bf67 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:24:38.507395 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-85cad62c-5e71-48be-af3f-8f0c9157bf67 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:24:38.509776 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-85cad62c-5e71-48be-af3f-8f0c9157bf67 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:24:38.511460 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-85cad62c-5e71-48be-af3f-8f0c9157bf67 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:24:38.511908 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-85cad62c-5e71-48be-af3f-8f0c9157bf67 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:24:38.559965 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-85cad62c-5e71-48be-af3f-8f0c9157bf67 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] HTTP exception thrown: Instance 440c3d30-e5c9-4093-9b7e-39e06d32d682 could not be found. Aug 10 23:24:38.564781 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-85cad62c-5e71-48be-af3f-8f0c9157bf67 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Request method failure captured: Aug 10 23:24:38.564781 n-d-850468-14 devstack@n-api.service[122633]: request: DELETE /compute/v2.1/servers/440c3d30-e5c9-4093-9b7e-39e06d32d682 HTTP/1.1 Aug 10 23:24:38.564781 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:24:38.564781 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:24:38.564781 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:24:38.564781 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:24:38.564781 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:24:38.564781 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:24:38.564781 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:24:38.564781 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:24:38.564781 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9Dyh6-R-3HT3qmAYw73oJfCuu2NJv_Uk6ESXtcq6VvNMtaQn1cTuz-I3qzoDfMZYBb14V5s9aXOf7KFvhR2arcnhZ5gC9SddHqo24MvVPxr7p8PNkuseL9l1-7bXrad-0RpRPdQnhZkSYtsPZXEtrxg11yCwwP1jlsEo-QBQNYEMWc4 Aug 10 23:24:38.564781 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:24:38.564781 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:24:38.564781 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:24:38.564781 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:24:38.564781 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:24:38.564781 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:24:38.564781 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 2b557edd165144c8943eb9acc339a377 Aug 10 23:24:38.564781 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-AttachVolumeNegativeTest-393353666 Aug 10 23:24:38.564781 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:24:38.564781 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:24:38.564781 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2b557edd165144c8943eb9acc339a377"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2b557edd165144c8943eb9acc339a377"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2b557edd165144c8943eb9acc339a377"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2b557edd165144c8943eb9acc339a377", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:24:38.564781 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-AttachVolumeNegativeTest-393353666 Aug 10 23:24:38.564781 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 2b557edd165144c8943eb9acc339a377 Aug 10 23:24:38.564781 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-393353666 Aug 10 23:24:38.564781 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-AttachVolumeNegativeTest-393353666-project Aug 10 23:24:38.564781 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:24:38.564781 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:24:38.564781 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 0d89081084f14e0187f4c67cd9185fef Aug 10 23:24:38.564781 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-AttachVolumeNegativeTest-393353666-project Aug 10 23:24:38.564781 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:24:38.564781 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance 440c3d30-e5c9-4093-9b7e-39e06d32d682 could not be found. Aug 10 23:24:38.564781 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': '440c3d30-e5c9-4093-9b7e-39e06d32d682'} Aug 10 23:24:38.564781 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:24:38.564781 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:24:38.564781 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:24:38.564781 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:24:38.564781 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:24:38.564781 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:24:38.564781 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:24:38.564781 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:24:38.564781 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:24:38.564781 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:24:38.564781 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 440c3d30-e5c9-4093-9b7e-39e06d32d682 could not be found. Aug 10 23:24:38.564781 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:24:38.564781 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:24:38.564781 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:24:38.564781 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:24:38.564781 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:24:38.564781 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:24:38.564781 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:24:38.564781 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:24:38.564781 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:24:38.564781 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:24:38.564781 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 23:24:38.564781 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 23:24:38.564781 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 23:24:38.564781 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 23:24:38.564781 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:24:38.564781 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:24:38.564781 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:24:38.564781 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:24:38.571356 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 440c3d30-e5c9-4093-9b7e-39e06d32d682 could not be found. Aug 10 23:24:38.571356 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:24:38.571356 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:24:38.571356 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:24:38.571356 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:24:38.571356 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:24:38.571356 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:24:38.571356 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:24:38.571356 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:24:38.571356 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 440c3d30-e5c9-4093-9b7e-39e06d32d682 could not be found. Aug 10 23:24:38.571356 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:24:38.577358 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-85cad62c-5e71-48be-af3f-8f0c9157bf67 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Returning 404 to user: Instance 440c3d30-e5c9-4093-9b7e-39e06d32d682 could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:24:38.580367 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-85cad62c-5e71-48be-af3f-8f0c9157bf67 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] 10.222.0.58 "DELETE /compute/v2.1/servers/440c3d30-e5c9-4093-9b7e-39e06d32d682" status: 404 len: 111 microversion: 2.1 time: 0.101997 Aug 10 23:24:38.583741 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2786/5356] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:24:38 2022] DELETE /compute/v2.1/servers/440c3d30-e5c9-4093-9b7e-39e06d32d682 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:24:38.593414 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-b1ea0bdb-6d0c-44b3-8c3c-d365108899ab tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:24:38.594049 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-b1ea0bdb-6d0c-44b3-8c3c-d365108899ab tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] [instance: 440c3d30-e5c9-4093-9b7e-39e06d32d682] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:24:38.628396 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-865b7c0a-5b35-4eff-9153-2c88ee0e73ce req-cdf160a3-b493-4d11-8c90-579ec9d2d54a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03e88a01-d3ed-4ab2-a334-f4bc274fe800", "tag": "7481f052-393a-446e-bc21-7be34657945e"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:24:38.633884 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b1ea0bdb-6d0c-44b3-8c3c-d365108899ab tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:24:38.634476 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b1ea0bdb-6d0c-44b3-8c3c-d365108899ab tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:24:38.634899 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b1ea0bdb-6d0c-44b3-8c3c-d365108899ab tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:24:38.649369 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b1ea0bdb-6d0c-44b3-8c3c-d365108899ab tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:24:38.649703 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b1ea0bdb-6d0c-44b3-8c3c-d365108899ab tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:24:38.650199 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b1ea0bdb-6d0c-44b3-8c3c-d365108899ab tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:24:38.689755 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-865b7c0a-5b35-4eff-9153-2c88ee0e73ce req-cdf160a3-b493-4d11-8c90-579ec9d2d54a service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:24:38.690361 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-865b7c0a-5b35-4eff-9153-2c88ee0e73ce req-cdf160a3-b493-4d11-8c90-579ec9d2d54a service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:24:38.697808 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-865b7c0a-5b35-4eff-9153-2c88ee0e73ce req-cdf160a3-b493-4d11-8c90-579ec9d2d54a service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:24:38.719541 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-b1ea0bdb-6d0c-44b3-8c3c-d365108899ab tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] HTTP exception thrown: Instance 440c3d30-e5c9-4093-9b7e-39e06d32d682 could not be found. Aug 10 23:24:38.723882 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-b1ea0bdb-6d0c-44b3-8c3c-d365108899ab tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Request method failure captured: Aug 10 23:24:38.723882 n-d-850468-14 devstack@n-api.service[122632]: request: GET /compute/v2.1/servers/440c3d30-e5c9-4093-9b7e-39e06d32d682 HTTP/1.1 Aug 10 23:24:38.723882 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:24:38.723882 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:24:38.723882 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:24:38.723882 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 23:24:38.723882 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:24:38.723882 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:24:38.723882 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:24:38.723882 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:24:38.723882 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9Dyh6-R-3HT3qmAYw73oJfCuu2NJv_Uk6ESXtcq6VvNMtaQn1cTuz-I3qzoDfMZYBb14V5s9aXOf7KFvhR2arcnhZ5gC9SddHqo24MvVPxr7p8PNkuseL9l1-7bXrad-0RpRPdQnhZkSYtsPZXEtrxg11yCwwP1jlsEo-QBQNYEMWc4 Aug 10 23:24:38.723882 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:24:38.723882 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:24:38.723882 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:24:38.723882 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:24:38.723882 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:24:38.723882 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:24:38.723882 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 2b557edd165144c8943eb9acc339a377 Aug 10 23:24:38.723882 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-AttachVolumeNegativeTest-393353666 Aug 10 23:24:38.723882 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:24:38.723882 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:24:38.723882 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2b557edd165144c8943eb9acc339a377"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2b557edd165144c8943eb9acc339a377"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2b557edd165144c8943eb9acc339a377"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2b557edd165144c8943eb9acc339a377", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:24:38.723882 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-AttachVolumeNegativeTest-393353666 Aug 10 23:24:38.723882 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 2b557edd165144c8943eb9acc339a377 Aug 10 23:24:38.723882 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-393353666 Aug 10 23:24:38.723882 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-AttachVolumeNegativeTest-393353666-project Aug 10 23:24:38.723882 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:24:38.723882 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:24:38.723882 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: 0d89081084f14e0187f4c67cd9185fef Aug 10 23:24:38.723882 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-AttachVolumeNegativeTest-393353666-project Aug 10 23:24:38.723882 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:24:38.723882 n-d-850468-14 devstack@n-api.service[122632]: exception: Instance 440c3d30-e5c9-4093-9b7e-39e06d32d682 could not be found. Aug 10 23:24:38.723882 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': '440c3d30-e5c9-4093-9b7e-39e06d32d682'} Aug 10 23:24:38.723882 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:24:38.723882 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:24:38.723882 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:24:38.723882 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:24:38.723882 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:24:38.723882 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:24:38.723882 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:24:38.723882 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:24:38.723882 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:24:38.723882 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:24:38.723882 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 440c3d30-e5c9-4093-9b7e-39e06d32d682 could not be found. Aug 10 23:24:38.723882 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:24:38.723882 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:24:38.723882 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:24:38.723882 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:24:38.723882 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:24:38.723882 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:24:38.723882 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:24:38.723882 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:24:38.723882 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:24:38.723882 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:24:38.723882 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:24:38.723882 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:24:38.723882 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:24:38.723882 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:24:38.723882 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:24:38.723882 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:24:38.723882 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 440c3d30-e5c9-4093-9b7e-39e06d32d682 could not be found. Aug 10 23:24:38.723882 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:24:38.723882 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:24:38.723882 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:24:38.728090 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:24:38.728090 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:24:38.728090 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:24:38.728090 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:24:38.728090 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:24:38.728090 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 440c3d30-e5c9-4093-9b7e-39e06d32d682 could not be found. Aug 10 23:24:38.728090 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:24:38.740771 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-b1ea0bdb-6d0c-44b3-8c3c-d365108899ab tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Returning 404 to user: Instance 440c3d30-e5c9-4093-9b7e-39e06d32d682 could not be found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:24:38.745768 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-b1ea0bdb-6d0c-44b3-8c3c-d365108899ab tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] 10.222.0.58 "GET /compute/v2.1/servers/440c3d30-e5c9-4093-9b7e-39e06d32d682" status: 404 len: 111 microversion: 2.1 time: 0.159016 Aug 10 23:24:38.747466 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2571/5357] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:24:38 2022] GET /compute/v2.1/servers/440c3d30-e5c9-4093-9b7e-39e06d32d682 => generated 111 bytes in 161 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:24:38.762557 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-865b7c0a-5b35-4eff-9153-2c88ee0e73ce req-cdf160a3-b493-4d11-8c90-579ec9d2d54a service nova] Creating event network-changed:7481f052-393a-446e-bc21-7be34657945e for instance 03e88a01-d3ed-4ab2-a334-f4bc274fe800 on n-h1-850468-14 Aug 10 23:24:38.768480 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-113a9ce3-f5b2-43db-8b9b-8043b8401cce tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:24:38.773263 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-113a9ce3-f5b2-43db-8b9b-8043b8401cce tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] [instance: a98455ed-1e70-4d9a-98a4-77262e588e87] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:24:38.781124 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-865b7c0a-5b35-4eff-9153-2c88ee0e73ce req-cdf160a3-b493-4d11-8c90-579ec9d2d54a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.171382 Aug 10 23:24:38.783446 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2787/5358] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:24:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:24:38.792590 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-113a9ce3-f5b2-43db-8b9b-8043b8401cce tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:24:38.793385 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-113a9ce3-f5b2-43db-8b9b-8043b8401cce tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:24:38.794008 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-113a9ce3-f5b2-43db-8b9b-8043b8401cce tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:24:38.794937 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-113a9ce3-f5b2-43db-8b9b-8043b8401cce tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:24:38.795547 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-113a9ce3-f5b2-43db-8b9b-8043b8401cce tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:24:38.799293 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-113a9ce3-f5b2-43db-8b9b-8043b8401cce tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:24:38.853314 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-113a9ce3-f5b2-43db-8b9b-8043b8401cce tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] HTTP exception thrown: Instance a98455ed-1e70-4d9a-98a4-77262e588e87 could not be found. Aug 10 23:24:38.854942 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-113a9ce3-f5b2-43db-8b9b-8043b8401cce tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Request method failure captured: Aug 10 23:24:38.854942 n-d-850468-14 devstack@n-api.service[122632]: request: DELETE /compute/v2.1/servers/a98455ed-1e70-4d9a-98a4-77262e588e87 HTTP/1.1 Aug 10 23:24:38.854942 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:24:38.854942 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:24:38.854942 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:24:38.854942 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 23:24:38.854942 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:24:38.854942 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:24:38.854942 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:24:38.854942 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:24:38.854942 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9Dyh6-R-3HT3qmAYw73oJfCuu2NJv_Uk6ESXtcq6VvNMtaQn1cTuz-I3qzoDfMZYBb14V5s9aXOf7KFvhR2arcnhZ5gC9SddHqo24MvVPxr7p8PNkuseL9l1-7bXrad-0RpRPdQnhZkSYtsPZXEtrxg11yCwwP1jlsEo-QBQNYEMWc4 Aug 10 23:24:38.854942 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:24:38.854942 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:24:38.854942 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:24:38.854942 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:24:38.854942 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:24:38.854942 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:24:38.854942 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 2b557edd165144c8943eb9acc339a377 Aug 10 23:24:38.854942 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-AttachVolumeNegativeTest-393353666 Aug 10 23:24:38.854942 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:24:38.854942 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:24:38.854942 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2b557edd165144c8943eb9acc339a377"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2b557edd165144c8943eb9acc339a377"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2b557edd165144c8943eb9acc339a377"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2b557edd165144c8943eb9acc339a377", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:24:38.854942 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-AttachVolumeNegativeTest-393353666 Aug 10 23:24:38.854942 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 2b557edd165144c8943eb9acc339a377 Aug 10 23:24:38.854942 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-393353666 Aug 10 23:24:38.854942 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-AttachVolumeNegativeTest-393353666-project Aug 10 23:24:38.854942 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:24:38.854942 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:24:38.854942 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: 0d89081084f14e0187f4c67cd9185fef Aug 10 23:24:38.854942 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-AttachVolumeNegativeTest-393353666-project Aug 10 23:24:38.854942 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:24:38.854942 n-d-850468-14 devstack@n-api.service[122632]: exception: Instance a98455ed-1e70-4d9a-98a4-77262e588e87 could not be found. Aug 10 23:24:38.854942 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': 'a98455ed-1e70-4d9a-98a4-77262e588e87'} Aug 10 23:24:38.854942 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:24:38.854942 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:24:38.854942 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:24:38.854942 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:24:38.854942 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:24:38.854942 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:24:38.854942 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:24:38.854942 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:24:38.854942 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:24:38.854942 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:24:38.854942 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a98455ed-1e70-4d9a-98a4-77262e588e87 could not be found. Aug 10 23:24:38.854942 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:24:38.854942 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:24:38.854942 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:24:38.854942 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:24:38.854942 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:24:38.854942 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:24:38.854942 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:24:38.854942 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:24:38.854942 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:24:38.854942 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:24:38.854942 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 23:24:38.854942 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 23:24:38.854942 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 23:24:38.854942 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 23:24:38.854942 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:24:38.854942 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:24:38.854942 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:24:38.854942 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:24:38.859198 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a98455ed-1e70-4d9a-98a4-77262e588e87 could not be found. Aug 10 23:24:38.859198 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:24:38.859198 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:24:38.859198 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:24:38.859198 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:24:38.859198 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:24:38.859198 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:24:38.859198 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:24:38.859198 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:24:38.859198 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a98455ed-1e70-4d9a-98a4-77262e588e87 could not be found. Aug 10 23:24:38.859198 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:24:38.859198 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-113a9ce3-f5b2-43db-8b9b-8043b8401cce tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Returning 404 to user: Instance a98455ed-1e70-4d9a-98a4-77262e588e87 could not be found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:24:38.859198 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-113a9ce3-f5b2-43db-8b9b-8043b8401cce tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] 10.222.0.58 "DELETE /compute/v2.1/servers/a98455ed-1e70-4d9a-98a4-77262e588e87" status: 404 len: 111 microversion: 2.1 time: 0.104662 Aug 10 23:24:38.860395 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2572/5359] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:24:38 2022] DELETE /compute/v2.1/servers/a98455ed-1e70-4d9a-98a4-77262e588e87 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:24:38.866887 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-0bae9a40-b812-4cdb-a2d0-71712f53c9f8 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:24:38.868366 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-0bae9a40-b812-4cdb-a2d0-71712f53c9f8 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] [instance: a98455ed-1e70-4d9a-98a4-77262e588e87] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:24:38.881933 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0bae9a40-b812-4cdb-a2d0-71712f53c9f8 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:24:38.882709 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0bae9a40-b812-4cdb-a2d0-71712f53c9f8 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:24:38.887155 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0bae9a40-b812-4cdb-a2d0-71712f53c9f8 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:24:38.888369 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0bae9a40-b812-4cdb-a2d0-71712f53c9f8 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:24:38.889697 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0bae9a40-b812-4cdb-a2d0-71712f53c9f8 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:24:38.890444 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0bae9a40-b812-4cdb-a2d0-71712f53c9f8 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:24:38.934906 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-0bae9a40-b812-4cdb-a2d0-71712f53c9f8 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] HTTP exception thrown: Instance a98455ed-1e70-4d9a-98a4-77262e588e87 could not be found. Aug 10 23:24:38.951613 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-0bae9a40-b812-4cdb-a2d0-71712f53c9f8 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Request method failure captured: Aug 10 23:24:38.951613 n-d-850468-14 devstack@n-api.service[122633]: request: GET /compute/v2.1/servers/a98455ed-1e70-4d9a-98a4-77262e588e87 HTTP/1.1 Aug 10 23:24:38.951613 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:24:38.951613 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:24:38.951613 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:24:38.951613 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:24:38.951613 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:24:38.951613 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:24:38.951613 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:24:38.951613 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:24:38.951613 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9Dyh6-R-3HT3qmAYw73oJfCuu2NJv_Uk6ESXtcq6VvNMtaQn1cTuz-I3qzoDfMZYBb14V5s9aXOf7KFvhR2arcnhZ5gC9SddHqo24MvVPxr7p8PNkuseL9l1-7bXrad-0RpRPdQnhZkSYtsPZXEtrxg11yCwwP1jlsEo-QBQNYEMWc4 Aug 10 23:24:38.951613 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:24:38.951613 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:24:38.951613 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:24:38.951613 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:24:38.951613 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:24:38.951613 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:24:38.951613 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 2b557edd165144c8943eb9acc339a377 Aug 10 23:24:38.951613 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-AttachVolumeNegativeTest-393353666 Aug 10 23:24:38.951613 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:24:38.951613 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:24:38.951613 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2b557edd165144c8943eb9acc339a377"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2b557edd165144c8943eb9acc339a377"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2b557edd165144c8943eb9acc339a377"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2b557edd165144c8943eb9acc339a377", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:24:38.951613 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-AttachVolumeNegativeTest-393353666 Aug 10 23:24:38.951613 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 2b557edd165144c8943eb9acc339a377 Aug 10 23:24:38.951613 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-393353666 Aug 10 23:24:38.951613 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-AttachVolumeNegativeTest-393353666-project Aug 10 23:24:38.951613 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:24:38.951613 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:24:38.951613 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 0d89081084f14e0187f4c67cd9185fef Aug 10 23:24:38.951613 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-AttachVolumeNegativeTest-393353666-project Aug 10 23:24:38.951613 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:24:38.951613 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance a98455ed-1e70-4d9a-98a4-77262e588e87 could not be found. Aug 10 23:24:38.951613 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': 'a98455ed-1e70-4d9a-98a4-77262e588e87'} Aug 10 23:24:38.951613 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:24:38.951613 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:24:38.951613 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:24:38.951613 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:24:38.951613 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:24:38.951613 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:24:38.951613 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:24:38.951613 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:24:38.951613 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:24:38.951613 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:24:38.951613 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a98455ed-1e70-4d9a-98a4-77262e588e87 could not be found. Aug 10 23:24:38.951613 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:24:38.951613 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:24:38.951613 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:24:38.951613 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:24:38.951613 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:24:38.951613 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:24:38.951613 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:24:38.951613 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:24:38.951613 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:24:38.951613 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:24:38.951613 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:24:38.951613 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:24:38.951613 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:24:38.951613 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:24:38.951613 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:24:38.951613 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:24:38.951613 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a98455ed-1e70-4d9a-98a4-77262e588e87 could not be found. Aug 10 23:24:38.951613 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:24:38.951613 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:24:38.951613 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:24:38.956169 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:24:38.956169 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:24:38.956169 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:24:38.956169 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:24:38.956169 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:24:38.956169 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a98455ed-1e70-4d9a-98a4-77262e588e87 could not be found. Aug 10 23:24:38.956169 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:24:38.960821 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-0bae9a40-b812-4cdb-a2d0-71712f53c9f8 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Returning 404 to user: Instance a98455ed-1e70-4d9a-98a4-77262e588e87 could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:24:38.962353 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-0bae9a40-b812-4cdb-a2d0-71712f53c9f8 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] 10.222.0.58 "GET /compute/v2.1/servers/a98455ed-1e70-4d9a-98a4-77262e588e87" status: 404 len: 111 microversion: 2.1 time: 0.100532 Aug 10 23:24:38.967699 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2788/5360] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:24:38 2022] GET /compute/v2.1/servers/a98455ed-1e70-4d9a-98a4-77262e588e87 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:24:39.357963 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-b3223a27-37e7-4b8f-9545-efc5ca90b0c9 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:24:39.358584 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-b3223a27-37e7-4b8f-9545-efc5ca90b0c9 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: 03e88a01-d3ed-4ab2-a334-f4bc274fe800] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:24:39.372787 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b3223a27-37e7-4b8f-9545-efc5ca90b0c9 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:24:39.373284 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b3223a27-37e7-4b8f-9545-efc5ca90b0c9 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:24:39.373899 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b3223a27-37e7-4b8f-9545-efc5ca90b0c9 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:24:39.374963 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b3223a27-37e7-4b8f-9545-efc5ca90b0c9 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:24:39.383594 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b3223a27-37e7-4b8f-9545-efc5ca90b0c9 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:24:39.384326 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b3223a27-37e7-4b8f-9545-efc5ca90b0c9 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:24:40.393189 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-b3223a27-37e7-4b8f-9545-efc5ca90b0c9 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:24:40.407395 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-b3223a27-37e7-4b8f-9545-efc5ca90b0c9 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:24:40.408935 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-b3223a27-37e7-4b8f-9545-efc5ca90b0c9 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:24:40.410075 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-b3223a27-37e7-4b8f-9545-efc5ca90b0c9 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800" status: 200 len: 1407 microversion: 2.20 time: 1.057580 Aug 10 23:24:40.417546 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2573/5361] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:24:39 2022] GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800 => generated 1407 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:24:41.435616 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-daab7069-8760-42ca-a97d-32e3aec95de2 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:24:41.438238 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-daab7069-8760-42ca-a97d-32e3aec95de2 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: 03e88a01-d3ed-4ab2-a334-f4bc274fe800] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:24:41.460360 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-daab7069-8760-42ca-a97d-32e3aec95de2 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:24:41.464592 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-daab7069-8760-42ca-a97d-32e3aec95de2 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:24:41.465352 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-daab7069-8760-42ca-a97d-32e3aec95de2 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:24:41.468099 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-daab7069-8760-42ca-a97d-32e3aec95de2 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:24:41.469946 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-daab7069-8760-42ca-a97d-32e3aec95de2 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:24:41.495222 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-daab7069-8760-42ca-a97d-32e3aec95de2 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:24:41.955214 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-daab7069-8760-42ca-a97d-32e3aec95de2 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:24:41.982923 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-daab7069-8760-42ca-a97d-32e3aec95de2 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:24:41.987770 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-daab7069-8760-42ca-a97d-32e3aec95de2 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:24:41.993260 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-daab7069-8760-42ca-a97d-32e3aec95de2 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800" status: 200 len: 1407 microversion: 2.20 time: 0.563004 Aug 10 23:24:41.997545 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2789/5362] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:24:41 2022] GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800 => generated 1407 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:24:43.027023 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-9280dad6-97cf-4e6b-ba4b-bc2cf12d2729 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:24:43.027880 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-9280dad6-97cf-4e6b-ba4b-bc2cf12d2729 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: 03e88a01-d3ed-4ab2-a334-f4bc274fe800] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:24:43.036103 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=6 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:24:43.038292 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9280dad6-97cf-4e6b-ba4b-bc2cf12d2729 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:24:43.038812 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9280dad6-97cf-4e6b-ba4b-bc2cf12d2729 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:24:43.039759 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9280dad6-97cf-4e6b-ba4b-bc2cf12d2729 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:24:43.040493 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9280dad6-97cf-4e6b-ba4b-bc2cf12d2729 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:24:43.041111 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9280dad6-97cf-4e6b-ba4b-bc2cf12d2729 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:24:43.043147 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9280dad6-97cf-4e6b-ba4b-bc2cf12d2729 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:24:43.460361 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-9280dad6-97cf-4e6b-ba4b-bc2cf12d2729 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:24:43.480007 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-9280dad6-97cf-4e6b-ba4b-bc2cf12d2729 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:24:43.487507 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-9280dad6-97cf-4e6b-ba4b-bc2cf12d2729 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:24:43.492112 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-9280dad6-97cf-4e6b-ba4b-bc2cf12d2729 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800" status: 200 len: 1407 microversion: 2.20 time: 0.472991 Aug 10 23:24:43.497432 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2574/5363] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:24:43 2022] GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800 => generated 1407 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:24:44.520880 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-7204c98a-261a-4424-b932-e891250bfcbb tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:24:44.522953 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-7204c98a-261a-4424-b932-e891250bfcbb tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: 03e88a01-d3ed-4ab2-a334-f4bc274fe800] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:24:44.525356 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=2 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:24:44.528932 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=6 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:24:44.558449 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7204c98a-261a-4424-b932-e891250bfcbb tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:24:44.570174 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7204c98a-261a-4424-b932-e891250bfcbb tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:24:44.572313 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7204c98a-261a-4424-b932-e891250bfcbb tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:24:44.573076 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7204c98a-261a-4424-b932-e891250bfcbb tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:24:44.573543 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7204c98a-261a-4424-b932-e891250bfcbb tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:24:44.573976 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7204c98a-261a-4424-b932-e891250bfcbb tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:24:45.157137 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-7204c98a-261a-4424-b932-e891250bfcbb tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:24:45.168137 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-7204c98a-261a-4424-b932-e891250bfcbb tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:24:45.172133 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-7204c98a-261a-4424-b932-e891250bfcbb tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:24:45.173527 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-7204c98a-261a-4424-b932-e891250bfcbb tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800" status: 200 len: 1407 microversion: 2.20 time: 0.657132 Aug 10 23:24:45.175203 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2790/5364] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:24:44 2022] GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800 => generated 1407 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:24:45.739751 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-64a2a4bd-ca17-4255-bca4-567d85a44d99 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:24:45.740426 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-64a2a4bd-ca17-4255-bca4-567d85a44d99 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] [instance: b812cd8c-7e33-4e97-8df6-c7fccdf12019] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:24:45.754013 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-64a2a4bd-ca17-4255-bca4-567d85a44d99 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:24:45.754657 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-64a2a4bd-ca17-4255-bca4-567d85a44d99 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:24:45.755346 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-64a2a4bd-ca17-4255-bca4-567d85a44d99 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:24:45.756266 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-64a2a4bd-ca17-4255-bca4-567d85a44d99 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:24:45.756636 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-64a2a4bd-ca17-4255-bca4-567d85a44d99 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:24:45.757255 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-64a2a4bd-ca17-4255-bca4-567d85a44d99 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:24:45.793240 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-64a2a4bd-ca17-4255-bca4-567d85a44d99 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] HTTP exception thrown: Instance b812cd8c-7e33-4e97-8df6-c7fccdf12019 could not be found. Aug 10 23:24:45.794889 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-64a2a4bd-ca17-4255-bca4-567d85a44d99 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Request method failure captured: Aug 10 23:24:45.794889 n-d-850468-14 devstack@n-api.service[122632]: request: DELETE /compute/v2.1/servers/b812cd8c-7e33-4e97-8df6-c7fccdf12019 HTTP/1.1 Aug 10 23:24:45.794889 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:24:45.794889 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:24:45.794889 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:24:45.794889 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 23:24:45.794889 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:24:45.794889 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:24:45.794889 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:24:45.794889 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:24:45.794889 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9Dyh6-R-3HT3qmAYw73oJfCuu2NJv_Uk6ESXtcq6VvNMtaQn1cTuz-I3qzoDfMZYBb14V5s9aXOf7KFvhR2arcnhZ5gC9SddHqo24MvVPxr7p8PNkuseL9l1-7bXrad-0RpRPdQnhZkSYtsPZXEtrxg11yCwwP1jlsEo-QBQNYEMWc4 Aug 10 23:24:45.794889 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:24:45.794889 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:24:45.794889 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:24:45.794889 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:24:45.794889 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:24:45.794889 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:24:45.794889 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 2b557edd165144c8943eb9acc339a377 Aug 10 23:24:45.794889 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-AttachVolumeNegativeTest-393353666 Aug 10 23:24:45.794889 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:24:45.794889 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:24:45.794889 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2b557edd165144c8943eb9acc339a377"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2b557edd165144c8943eb9acc339a377"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2b557edd165144c8943eb9acc339a377"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2b557edd165144c8943eb9acc339a377", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:24:45.794889 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-AttachVolumeNegativeTest-393353666 Aug 10 23:24:45.794889 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 2b557edd165144c8943eb9acc339a377 Aug 10 23:24:45.794889 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-393353666 Aug 10 23:24:45.794889 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-AttachVolumeNegativeTest-393353666-project Aug 10 23:24:45.794889 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:24:45.794889 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:24:45.794889 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: 0d89081084f14e0187f4c67cd9185fef Aug 10 23:24:45.794889 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-AttachVolumeNegativeTest-393353666-project Aug 10 23:24:45.794889 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:24:45.794889 n-d-850468-14 devstack@n-api.service[122632]: exception: Instance b812cd8c-7e33-4e97-8df6-c7fccdf12019 could not be found. Aug 10 23:24:45.794889 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': 'b812cd8c-7e33-4e97-8df6-c7fccdf12019'} Aug 10 23:24:45.794889 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:24:45.794889 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:24:45.794889 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:24:45.794889 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:24:45.794889 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:24:45.794889 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:24:45.794889 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:24:45.794889 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:24:45.794889 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:24:45.794889 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:24:45.794889 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b812cd8c-7e33-4e97-8df6-c7fccdf12019 could not be found. Aug 10 23:24:45.794889 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:24:45.794889 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:24:45.794889 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:24:45.794889 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:24:45.794889 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:24:45.794889 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:24:45.794889 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:24:45.794889 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:24:45.794889 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:24:45.794889 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:24:45.794889 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 23:24:45.794889 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 23:24:45.794889 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 23:24:45.794889 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 23:24:45.794889 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:24:45.794889 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:24:45.794889 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:24:45.794889 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:24:45.803749 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b812cd8c-7e33-4e97-8df6-c7fccdf12019 could not be found. Aug 10 23:24:45.803749 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:24:45.803749 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:24:45.803749 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:24:45.803749 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:24:45.803749 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:24:45.803749 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:24:45.803749 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:24:45.803749 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:24:45.803749 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b812cd8c-7e33-4e97-8df6-c7fccdf12019 could not be found. Aug 10 23:24:45.803749 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:24:45.803749 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-64a2a4bd-ca17-4255-bca4-567d85a44d99 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Returning 404 to user: Instance b812cd8c-7e33-4e97-8df6-c7fccdf12019 could not be found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:24:45.803749 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-64a2a4bd-ca17-4255-bca4-567d85a44d99 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] 10.222.0.58 "DELETE /compute/v2.1/servers/b812cd8c-7e33-4e97-8df6-c7fccdf12019" status: 404 len: 111 microversion: 2.1 time: 0.061465 Aug 10 23:24:45.803749 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2575/5365] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:24:45 2022] DELETE /compute/v2.1/servers/b812cd8c-7e33-4e97-8df6-c7fccdf12019 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:24:45.808810 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-3a9ce690-971c-4937-9db4-063748c31575 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:24:45.809440 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-3a9ce690-971c-4937-9db4-063748c31575 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] [instance: b812cd8c-7e33-4e97-8df6-c7fccdf12019] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:24:45.818364 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3a9ce690-971c-4937-9db4-063748c31575 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:24:45.826066 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3a9ce690-971c-4937-9db4-063748c31575 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:24:45.826753 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3a9ce690-971c-4937-9db4-063748c31575 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:24:45.827471 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3a9ce690-971c-4937-9db4-063748c31575 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:24:45.827952 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3a9ce690-971c-4937-9db4-063748c31575 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:24:45.828385 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3a9ce690-971c-4937-9db4-063748c31575 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:24:45.869948 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-3a9ce690-971c-4937-9db4-063748c31575 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] HTTP exception thrown: Instance b812cd8c-7e33-4e97-8df6-c7fccdf12019 could not be found. Aug 10 23:24:45.893221 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-3a9ce690-971c-4937-9db4-063748c31575 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Request method failure captured: Aug 10 23:24:45.893221 n-d-850468-14 devstack@n-api.service[122633]: request: GET /compute/v2.1/servers/b812cd8c-7e33-4e97-8df6-c7fccdf12019 HTTP/1.1 Aug 10 23:24:45.893221 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:24:45.893221 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:24:45.893221 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:24:45.893221 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:24:45.893221 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:24:45.893221 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:24:45.893221 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:24:45.893221 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:24:45.893221 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9Dyh6-R-3HT3qmAYw73oJfCuu2NJv_Uk6ESXtcq6VvNMtaQn1cTuz-I3qzoDfMZYBb14V5s9aXOf7KFvhR2arcnhZ5gC9SddHqo24MvVPxr7p8PNkuseL9l1-7bXrad-0RpRPdQnhZkSYtsPZXEtrxg11yCwwP1jlsEo-QBQNYEMWc4 Aug 10 23:24:45.893221 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:24:45.893221 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:24:45.893221 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:24:45.893221 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:24:45.893221 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:24:45.893221 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:24:45.893221 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 2b557edd165144c8943eb9acc339a377 Aug 10 23:24:45.893221 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-AttachVolumeNegativeTest-393353666 Aug 10 23:24:45.893221 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:24:45.893221 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:24:45.893221 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2b557edd165144c8943eb9acc339a377"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2b557edd165144c8943eb9acc339a377"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2b557edd165144c8943eb9acc339a377"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2b557edd165144c8943eb9acc339a377", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:24:45.893221 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-AttachVolumeNegativeTest-393353666 Aug 10 23:24:45.893221 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 2b557edd165144c8943eb9acc339a377 Aug 10 23:24:45.893221 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-393353666 Aug 10 23:24:45.893221 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-AttachVolumeNegativeTest-393353666-project Aug 10 23:24:45.893221 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:24:45.893221 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:24:45.893221 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 0d89081084f14e0187f4c67cd9185fef Aug 10 23:24:45.893221 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-AttachVolumeNegativeTest-393353666-project Aug 10 23:24:45.893221 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:24:45.893221 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance b812cd8c-7e33-4e97-8df6-c7fccdf12019 could not be found. Aug 10 23:24:45.893221 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': 'b812cd8c-7e33-4e97-8df6-c7fccdf12019'} Aug 10 23:24:45.893221 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:24:45.893221 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:24:45.893221 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:24:45.893221 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:24:45.893221 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:24:45.893221 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:24:45.893221 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:24:45.893221 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:24:45.893221 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:24:45.893221 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:24:45.893221 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b812cd8c-7e33-4e97-8df6-c7fccdf12019 could not be found. Aug 10 23:24:45.893221 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:24:45.893221 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:24:45.893221 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:24:45.893221 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:24:45.893221 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:24:45.893221 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:24:45.893221 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:24:45.893221 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:24:45.893221 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:24:45.893221 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:24:45.893221 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:24:45.893221 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:24:45.893221 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:24:45.893221 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:24:45.893221 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:24:45.893221 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:24:45.893221 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b812cd8c-7e33-4e97-8df6-c7fccdf12019 could not be found. Aug 10 23:24:45.893221 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:24:45.893221 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:24:45.893221 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:24:45.897578 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:24:45.897578 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:24:45.897578 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:24:45.897578 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:24:45.897578 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:24:45.897578 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b812cd8c-7e33-4e97-8df6-c7fccdf12019 could not be found. Aug 10 23:24:45.897578 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:24:45.897578 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-3a9ce690-971c-4937-9db4-063748c31575 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] Returning 404 to user: Instance b812cd8c-7e33-4e97-8df6-c7fccdf12019 could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:24:45.897578 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-3a9ce690-971c-4937-9db4-063748c31575 tempest-AttachVolumeNegativeTest-393353666 tempest-AttachVolumeNegativeTest-393353666-project] 10.222.0.58 "GET /compute/v2.1/servers/b812cd8c-7e33-4e97-8df6-c7fccdf12019" status: 404 len: 111 microversion: 2.1 time: 0.090359 Aug 10 23:24:45.897578 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2791/5366] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:24:45 2022] GET /compute/v2.1/servers/b812cd8c-7e33-4e97-8df6-c7fccdf12019 => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:24:46.197571 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-632fd484-8361-4296-b801-533a62a7357d tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:24:46.198467 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-632fd484-8361-4296-b801-533a62a7357d tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: 03e88a01-d3ed-4ab2-a334-f4bc274fe800] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:24:46.213003 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-632fd484-8361-4296-b801-533a62a7357d tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:24:46.213504 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-632fd484-8361-4296-b801-533a62a7357d tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:24:46.213951 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-632fd484-8361-4296-b801-533a62a7357d tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:24:46.214671 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-632fd484-8361-4296-b801-533a62a7357d tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:24:46.215152 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-632fd484-8361-4296-b801-533a62a7357d tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:24:46.216583 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-632fd484-8361-4296-b801-533a62a7357d tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:24:46.632266 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-632fd484-8361-4296-b801-533a62a7357d tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:24:46.647742 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-632fd484-8361-4296-b801-533a62a7357d tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:24:46.649790 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-632fd484-8361-4296-b801-533a62a7357d tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:24:46.661341 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-632fd484-8361-4296-b801-533a62a7357d tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800" status: 200 len: 1407 microversion: 2.20 time: 0.462490 Aug 10 23:24:46.664662 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2576/5367] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:24:46 2022] GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800 => generated 1407 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:24:47.204167 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-d6c83a58-8e4f-47c7-8e45-78a9a88dee0a req-b38fd750-af93-48ed-81b9-d3ace1bd179a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03e88a01-d3ed-4ab2-a334-f4bc274fe800", "name": "network-vif-plugged", "status": "completed", "tag": "7481f052-393a-446e-bc21-7be34657945e"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:24:47.245132 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-d6c83a58-8e4f-47c7-8e45-78a9a88dee0a req-b38fd750-af93-48ed-81b9-d3ace1bd179a service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:24:47.245715 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-d6c83a58-8e4f-47c7-8e45-78a9a88dee0a req-b38fd750-af93-48ed-81b9-d3ace1bd179a service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:24:47.246224 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-d6c83a58-8e4f-47c7-8e45-78a9a88dee0a req-b38fd750-af93-48ed-81b9-d3ace1bd179a service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:24:47.264586 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-d6c83a58-8e4f-47c7-8e45-78a9a88dee0a req-b38fd750-af93-48ed-81b9-d3ace1bd179a service nova] Creating event network-vif-plugged:7481f052-393a-446e-bc21-7be34657945e for instance 03e88a01-d3ed-4ab2-a334-f4bc274fe800 on n-h1-850468-14 Aug 10 23:24:47.280721 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-d6c83a58-8e4f-47c7-8e45-78a9a88dee0a req-b38fd750-af93-48ed-81b9-d3ace1bd179a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087748 Aug 10 23:24:47.286747 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2792/5368] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:24:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:24:47.694585 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-ae9b4d40-10d0-495f-8a4e-560819642b96 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:24:47.695496 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-ae9b4d40-10d0-495f-8a4e-560819642b96 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: 03e88a01-d3ed-4ab2-a334-f4bc274fe800] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:24:47.716610 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ae9b4d40-10d0-495f-8a4e-560819642b96 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:24:47.717116 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ae9b4d40-10d0-495f-8a4e-560819642b96 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:24:47.717565 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ae9b4d40-10d0-495f-8a4e-560819642b96 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:24:47.718428 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ae9b4d40-10d0-495f-8a4e-560819642b96 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:24:47.720118 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ae9b4d40-10d0-495f-8a4e-560819642b96 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:24:47.720722 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ae9b4d40-10d0-495f-8a4e-560819642b96 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:24:48.385500 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-ae9b4d40-10d0-495f-8a4e-560819642b96 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:24:48.414707 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-ae9b4d40-10d0-495f-8a4e-560819642b96 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:24:48.422463 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-ae9b4d40-10d0-495f-8a4e-560819642b96 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:24:48.427694 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-ae9b4d40-10d0-495f-8a4e-560819642b96 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800" status: 200 len: 1407 microversion: 2.20 time: 0.737610 Aug 10 23:24:48.430461 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2577/5369] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:24:47 2022] GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800 => generated 1407 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 23:24:49.464427 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c56ae9c2-255b-46ca-b860-2ac241a87352 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:24:49.465846 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-c56ae9c2-255b-46ca-b860-2ac241a87352 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: 03e88a01-d3ed-4ab2-a334-f4bc274fe800] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:24:49.492145 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c56ae9c2-255b-46ca-b860-2ac241a87352 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:24:49.495040 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c56ae9c2-255b-46ca-b860-2ac241a87352 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:24:49.496173 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c56ae9c2-255b-46ca-b860-2ac241a87352 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:24:49.498065 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c56ae9c2-255b-46ca-b860-2ac241a87352 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:24:49.500962 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c56ae9c2-255b-46ca-b860-2ac241a87352 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:24:49.505108 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c56ae9c2-255b-46ca-b860-2ac241a87352 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:24:50.041782 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-c56ae9c2-255b-46ca-b860-2ac241a87352 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:24:50.063621 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-c56ae9c2-255b-46ca-b860-2ac241a87352 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:24:50.065205 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-c56ae9c2-255b-46ca-b860-2ac241a87352 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:24:50.070268 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-c56ae9c2-255b-46ca-b860-2ac241a87352 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800" status: 200 len: 1599 microversion: 2.20 time: 0.616952 Aug 10 23:24:50.074752 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2793/5370] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:24:49 2022] GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800 => generated 1599 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:24:50.098605 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-8eb62c5d-8572-456e-90aa-747d8c34639b tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:24:50.099200 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-8eb62c5d-8572-456e-90aa-747d8c34639b tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: 03e88a01-d3ed-4ab2-a334-f4bc274fe800] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:24:50.129729 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8eb62c5d-8572-456e-90aa-747d8c34639b tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:24:50.130400 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8eb62c5d-8572-456e-90aa-747d8c34639b tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:24:50.134698 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8eb62c5d-8572-456e-90aa-747d8c34639b tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:24:50.135836 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8eb62c5d-8572-456e-90aa-747d8c34639b tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:24:50.139260 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8eb62c5d-8572-456e-90aa-747d8c34639b tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:24:50.147113 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8eb62c5d-8572-456e-90aa-747d8c34639b tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:24:50.942632 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-8eb62c5d-8572-456e-90aa-747d8c34639b tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.848607 Aug 10 23:24:50.945163 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2578/5371] 10.222.0.58 () {60 vars in 1316 bytes} [Wed Aug 10 23:24:50 2022] GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800/os-interface => generated 284 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 23:24:54.846605 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-b428bfea-20a1-4d52-a2fc-53d5827f5955 req-984842b5-83cd-4637-8b50-05881198025f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03e88a01-d3ed-4ab2-a334-f4bc274fe800", "tag": "7481f052-393a-446e-bc21-7be34657945e"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:24:54.884496 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-b428bfea-20a1-4d52-a2fc-53d5827f5955 req-984842b5-83cd-4637-8b50-05881198025f service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:24:54.885734 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-b428bfea-20a1-4d52-a2fc-53d5827f5955 req-984842b5-83cd-4637-8b50-05881198025f service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:24:54.888986 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-b428bfea-20a1-4d52-a2fc-53d5827f5955 req-984842b5-83cd-4637-8b50-05881198025f service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:24:54.929191 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-b428bfea-20a1-4d52-a2fc-53d5827f5955 req-984842b5-83cd-4637-8b50-05881198025f service nova] Creating event network-changed:7481f052-393a-446e-bc21-7be34657945e for instance 03e88a01-d3ed-4ab2-a334-f4bc274fe800 on n-h1-850468-14 Aug 10 23:24:54.936635 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-b428bfea-20a1-4d52-a2fc-53d5827f5955 req-984842b5-83cd-4637-8b50-05881198025f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094143 Aug 10 23:24:54.937283 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2794/5372] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:24:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:25:22.374626 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-5fe829bb-f1f0-4c78-83de-31c70ec3238b tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:25:22.375932 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-5fe829bb-f1f0-4c78-83de-31c70ec3238b tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: 03e88a01-d3ed-4ab2-a334-f4bc274fe800] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:25:22.384128 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_api:SELECT=19 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:25:22.385057 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=45 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:25:22.394615 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5fe829bb-f1f0-4c78-83de-31c70ec3238b tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:25:22.395346 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5fe829bb-f1f0-4c78-83de-31c70ec3238b tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:25:22.395944 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5fe829bb-f1f0-4c78-83de-31c70ec3238b tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:25:22.396818 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5fe829bb-f1f0-4c78-83de-31c70ec3238b tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:25:22.397437 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5fe829bb-f1f0-4c78-83de-31c70ec3238b tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:25:22.398011 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5fe829bb-f1f0-4c78-83de-31c70ec3238b tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:25:22.454183 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-5fe829bb-f1f0-4c78-83de-31c70ec3238b tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800/ips" status: 200 len: 152 microversion: 2.20 time: 0.083487 Aug 10 23:25:22.463290 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2579/5373] 10.222.0.58 () {60 vars in 1289 bytes} [Wed Aug 10 23:25:22 2022] GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800/ips => generated 152 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 23:25:25.760752 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=3 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:25:25.761866 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=46 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:25:25.768494 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-53bd766f-3c2b-4ffc-af09-a2b35911220f tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:25:25.769183 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-53bd766f-3c2b-4ffc-af09-a2b35911220f tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: 03e88a01-d3ed-4ab2-a334-f4bc274fe800] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:25:25.788784 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-53bd766f-3c2b-4ffc-af09-a2b35911220f tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:25:25.789316 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-53bd766f-3c2b-4ffc-af09-a2b35911220f tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:25:25.789765 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-53bd766f-3c2b-4ffc-af09-a2b35911220f tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:25:25.790488 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-53bd766f-3c2b-4ffc-af09-a2b35911220f tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:25:25.790989 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-53bd766f-3c2b-4ffc-af09-a2b35911220f tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:25:25.791452 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-53bd766f-3c2b-4ffc-af09-a2b35911220f tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:25:25.865100 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.objects.instance [None req-53bd766f-3c2b-4ffc-af09-a2b35911220f tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lazy-loading 'flavor' on Instance uuid 03e88a01-d3ed-4ab2-a334-f4bc274fe800 {{(pid=122633) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:25:26.164428 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-53bd766f-3c2b-4ffc-af09-a2b35911220f tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "POST /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800/action" status: 202 len: 0 microversion: 2.20 time: 0.405405 Aug 10 23:25:26.166373 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2795/5374] 10.222.0.58 () {62 vars in 1319 bytes} [Wed Aug 10 23:25:25 2022] POST /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800/action => generated 0 bytes in 408 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:25:26.181081 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-ea6b3d43-dba7-4db6-b863-d3fb93f8b064 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:25:26.186051 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-ea6b3d43-dba7-4db6-b863-d3fb93f8b064 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: 03e88a01-d3ed-4ab2-a334-f4bc274fe800] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:25:26.201442 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ea6b3d43-dba7-4db6-b863-d3fb93f8b064 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:25:26.202365 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ea6b3d43-dba7-4db6-b863-d3fb93f8b064 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:25:26.203175 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ea6b3d43-dba7-4db6-b863-d3fb93f8b064 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:25:26.208213 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ea6b3d43-dba7-4db6-b863-d3fb93f8b064 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:25:26.208939 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ea6b3d43-dba7-4db6-b863-d3fb93f8b064 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:25:26.209763 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ea6b3d43-dba7-4db6-b863-d3fb93f8b064 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:25:26.619335 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-ea6b3d43-dba7-4db6-b863-d3fb93f8b064 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:25:26.629504 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-ea6b3d43-dba7-4db6-b863-d3fb93f8b064 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:25:26.632203 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-ea6b3d43-dba7-4db6-b863-d3fb93f8b064 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:25:26.637195 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-ea6b3d43-dba7-4db6-b863-d3fb93f8b064 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800" status: 200 len: 1724 microversion: 2.20 time: 0.466041 Aug 10 23:25:26.638508 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2580/5375] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:25:26 2022] GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800 => generated 1724 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:25:27.665763 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-5ca6a21d-1f39-40dc-b739-bed0644cf523 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:25:27.667245 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-5ca6a21d-1f39-40dc-b739-bed0644cf523 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: 03e88a01-d3ed-4ab2-a334-f4bc274fe800] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:25:27.686061 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5ca6a21d-1f39-40dc-b739-bed0644cf523 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:25:27.686865 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5ca6a21d-1f39-40dc-b739-bed0644cf523 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:25:27.688406 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5ca6a21d-1f39-40dc-b739-bed0644cf523 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:25:27.689647 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5ca6a21d-1f39-40dc-b739-bed0644cf523 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:25:27.691893 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5ca6a21d-1f39-40dc-b739-bed0644cf523 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:25:27.693035 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5ca6a21d-1f39-40dc-b739-bed0644cf523 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:25:29.085914 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-5ca6a21d-1f39-40dc-b739-bed0644cf523 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:25:29.094714 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-5ca6a21d-1f39-40dc-b739-bed0644cf523 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:25:29.096916 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-5ca6a21d-1f39-40dc-b739-bed0644cf523 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:25:29.098189 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-5ca6a21d-1f39-40dc-b739-bed0644cf523 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800" status: 200 len: 1724 microversion: 2.20 time: 1.440460 Aug 10 23:25:29.098757 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2796/5376] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:25:27 2022] GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800 => generated 1724 bytes in 1442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:25:29.313795 n-d-850468-14 devstack@n-api.service[122632]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 23:25:29.314266 n-d-850468-14 devstack@n-api.service[122632]: Wed Aug 10 23:25:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 23:25:30.135641 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-0def2da7-b316-4362-84e5-d50c13882181 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:25:30.135641 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-0def2da7-b316-4362-84e5-d50c13882181 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: 03e88a01-d3ed-4ab2-a334-f4bc274fe800] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:25:30.152181 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0def2da7-b316-4362-84e5-d50c13882181 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:25:30.160809 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0def2da7-b316-4362-84e5-d50c13882181 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:25:30.164147 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0def2da7-b316-4362-84e5-d50c13882181 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:25:30.165434 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0def2da7-b316-4362-84e5-d50c13882181 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:25:30.169749 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0def2da7-b316-4362-84e5-d50c13882181 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:25:30.170522 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0def2da7-b316-4362-84e5-d50c13882181 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:25:30.704123 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-0def2da7-b316-4362-84e5-d50c13882181 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:25:30.716874 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-0def2da7-b316-4362-84e5-d50c13882181 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:25:30.718385 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-0def2da7-b316-4362-84e5-d50c13882181 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:25:30.723412 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-0def2da7-b316-4362-84e5-d50c13882181 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800" status: 200 len: 1724 microversion: 2.20 time: 0.602051 Aug 10 23:25:30.744888 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2581/5377] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:25:30 2022] GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800 => generated 1724 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:25:31.763430 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-73c291c5-1807-4f65-ba6f-648389d52453 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:25:31.764259 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-73c291c5-1807-4f65-ba6f-648389d52453 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: 03e88a01-d3ed-4ab2-a334-f4bc274fe800] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:25:31.790587 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-73c291c5-1807-4f65-ba6f-648389d52453 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:25:31.791490 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-73c291c5-1807-4f65-ba6f-648389d52453 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:25:31.796038 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-73c291c5-1807-4f65-ba6f-648389d52453 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:25:31.797234 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-73c291c5-1807-4f65-ba6f-648389d52453 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:25:31.797903 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-73c291c5-1807-4f65-ba6f-648389d52453 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:25:31.806604 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-73c291c5-1807-4f65-ba6f-648389d52453 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:25:33.307186 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-73c291c5-1807-4f65-ba6f-648389d52453 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:25:33.324696 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-73c291c5-1807-4f65-ba6f-648389d52453 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:25:33.332214 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-73c291c5-1807-4f65-ba6f-648389d52453 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:25:33.339641 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-73c291c5-1807-4f65-ba6f-648389d52453 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800" status: 200 len: 1724 microversion: 2.20 time: 1.585970 Aug 10 23:25:33.344182 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2797/5378] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:25:31 2022] GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800 => generated 1724 bytes in 1591 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:25:34.373826 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-e593ed29-0a8b-43a3-b82c-ebb62b935424 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:25:34.374363 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-e593ed29-0a8b-43a3-b82c-ebb62b935424 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: 03e88a01-d3ed-4ab2-a334-f4bc274fe800] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:25:34.391559 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e593ed29-0a8b-43a3-b82c-ebb62b935424 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:25:34.395334 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e593ed29-0a8b-43a3-b82c-ebb62b935424 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:25:34.396227 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e593ed29-0a8b-43a3-b82c-ebb62b935424 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:25:34.397704 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e593ed29-0a8b-43a3-b82c-ebb62b935424 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:25:34.400039 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e593ed29-0a8b-43a3-b82c-ebb62b935424 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:25:34.400858 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e593ed29-0a8b-43a3-b82c-ebb62b935424 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:25:35.508452 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-e593ed29-0a8b-43a3-b82c-ebb62b935424 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:25:35.545687 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-e593ed29-0a8b-43a3-b82c-ebb62b935424 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:25:35.547215 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-e593ed29-0a8b-43a3-b82c-ebb62b935424 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:25:35.548466 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-e593ed29-0a8b-43a3-b82c-ebb62b935424 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800" status: 200 len: 1724 microversion: 2.20 time: 1.180335 Aug 10 23:25:35.565897 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2582/5379] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:25:34 2022] GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800 => generated 1724 bytes in 1198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:25:36.191338 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-406128f0-6cb2-480f-a2f9-65e04637bd12 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Action: 'create', calling method: .version_select at 0x7f847c4bb4c0>, body: {"keypair": {"name": "tempest-keypair-48000632", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNWvfEsgWAkODhhU35uQ6Gngom3qKQdbRvTLVdr88iLkeSf2LojXoXIKj/81/IuPk47vW7tO0JGcgTz/r+/4dF8UBGHBmmemkVdPCn1iNplevM2lA98YtNbf0gQcVyaimQ=="}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:25:36.299347 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-406128f0-6cb2-480f-a2f9-65e04637bd12 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Getting quotas for project f3a075a69271470c904f8a380b0a2657. Resources: {'key_pairs'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:25:36.322891 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-406128f0-6cb2-480f-a2f9-65e04637bd12 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Getting quotas for user a5fe70a2accc42f3ae729c02c876dce9 and project f3a075a69271470c904f8a380b0a2657. Resources: {'key_pairs'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:25:36.406141 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-406128f0-6cb2-480f-a2f9-65e04637bd12 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 201 len: 399 microversion: 2.42 time: 0.220324 Aug 10 23:25:36.407195 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2798/5380] 10.222.0.58 () {62 vars in 1200 bytes} [Wed Aug 10 23:25:36 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 223 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 10 23:25:36.576668 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-5a46e4f5-dce1-4e64-8e08-31f2653d66ff tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:25:36.578207 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-5a46e4f5-dce1-4e64-8e08-31f2653d66ff tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: 03e88a01-d3ed-4ab2-a334-f4bc274fe800] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:25:36.587107 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5a46e4f5-dce1-4e64-8e08-31f2653d66ff tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:25:36.587945 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5a46e4f5-dce1-4e64-8e08-31f2653d66ff tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:25:36.589219 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5a46e4f5-dce1-4e64-8e08-31f2653d66ff tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:25:36.590181 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5a46e4f5-dce1-4e64-8e08-31f2653d66ff tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:25:36.590885 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5a46e4f5-dce1-4e64-8e08-31f2653d66ff tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:25:36.591525 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5a46e4f5-dce1-4e64-8e08-31f2653d66ff tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:25:36.979608 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-5a46e4f5-dce1-4e64-8e08-31f2653d66ff tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:25:36.992294 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-5a46e4f5-dce1-4e64-8e08-31f2653d66ff tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:25:36.994412 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-5a46e4f5-dce1-4e64-8e08-31f2653d66ff tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:25:36.996044 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-5a46e4f5-dce1-4e64-8e08-31f2653d66ff tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800" status: 200 len: 1724 microversion: 2.20 time: 0.427471 Aug 10 23:25:37.012048 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2583/5381] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:25:36 2022] GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800 => generated 1724 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:25:38.026553 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-46ab2c87-e1d0-42fe-a8ed-d6340b9b6f25 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:25:38.027432 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-46ab2c87-e1d0-42fe-a8ed-d6340b9b6f25 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: 03e88a01-d3ed-4ab2-a334-f4bc274fe800] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:25:38.046700 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-46ab2c87-e1d0-42fe-a8ed-d6340b9b6f25 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:25:38.049232 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-46ab2c87-e1d0-42fe-a8ed-d6340b9b6f25 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:25:38.049438 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-46ab2c87-e1d0-42fe-a8ed-d6340b9b6f25 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:25:38.054376 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-46ab2c87-e1d0-42fe-a8ed-d6340b9b6f25 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:25:38.057902 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-46ab2c87-e1d0-42fe-a8ed-d6340b9b6f25 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:25:38.058446 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-46ab2c87-e1d0-42fe-a8ed-d6340b9b6f25 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:25:39.193305 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-46ab2c87-e1d0-42fe-a8ed-d6340b9b6f25 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:25:39.208186 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-46ab2c87-e1d0-42fe-a8ed-d6340b9b6f25 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:25:39.215532 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-46ab2c87-e1d0-42fe-a8ed-d6340b9b6f25 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:25:39.218985 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-46ab2c87-e1d0-42fe-a8ed-d6340b9b6f25 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800" status: 200 len: 1724 microversion: 2.20 time: 1.196069 Aug 10 23:25:39.221203 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2799/5382] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:25:38 2022] GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800 => generated 1724 bytes in 1201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:25:39.646214 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-07816b8f-2f60-4442-8e3d-2605349b86d6 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-511719267", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "c89f8bbf-aecb-41c4-b44d-c9eae867f8b7"}, {"port": "ed350d10-8d47-46e3-bde8-9f8f5eaad3a6", "tag": "port-1"}, {"port": "331b6d87-c1d3-4591-bc0e-3825a4fc234e", "tag": "port-2"}, {"uuid": "1df62900-0d58-423d-9f9b-529051eaa576", "tag": "net-1"}, {"uuid": "1df62900-0d58-423d-9f9b-529051eaa576"}, {"uuid": "79e76c25-a2d0-492e-a9f2-fada58b9603f", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "79e76c25-a2d0-492e-a9f2-fada58b9603f", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "5a2595ed-b221-489e-b974-d94b4b478b38", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "ccbd0e33-38c4-47e9-b378-f56358ba5448", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "b8427b75-f7c4-4974-b8d0-52b698bc578c", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1814925370"}], "key_name": "tempest-keypair-48000632", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:25:40.249201 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-36da29f0-b305-4afd-88d2-b082781a98c6 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:25:40.249807 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-36da29f0-b305-4afd-88d2-b082781a98c6 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: 03e88a01-d3ed-4ab2-a334-f4bc274fe800] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:25:40.264004 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-36da29f0-b305-4afd-88d2-b082781a98c6 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:25:40.264486 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-36da29f0-b305-4afd-88d2-b082781a98c6 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:25:40.264919 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-36da29f0-b305-4afd-88d2-b082781a98c6 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:25:40.268819 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-36da29f0-b305-4afd-88d2-b082781a98c6 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:25:40.269304 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-36da29f0-b305-4afd-88d2-b082781a98c6 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:25:40.269858 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-36da29f0-b305-4afd-88d2-b082781a98c6 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:25:40.427800 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.network.neutron [None req-07816b8f-2f60-4442-8e3d-2605349b86d6 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] validate_networks() for [('c89f8bbf-aecb-41c4-b44d-c9eae867f8b7', None, None, None, None, None), (None, None, 'ed350d10-8d47-46e3-bde8-9f8f5eaad3a6', None, None, None), (None, None, '331b6d87-c1d3-4591-bc0e-3825a4fc234e', None, None, None), ('1df62900-0d58-423d-9f9b-529051eaa576', None, None, None, None, None), ('1df62900-0d58-423d-9f9b-529051eaa576', None, None, None, None, None), ('79e76c25-a2d0-492e-a9f2-fada58b9603f', '10.2.2.100', None, None, None, None), ('79e76c25-a2d0-492e-a9f2-fada58b9603f', '10.2.2.200', None, None, None, None)] {{(pid=122632) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 23:25:40.796635 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-36da29f0-b305-4afd-88d2-b082781a98c6 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:25:40.805922 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-36da29f0-b305-4afd-88d2-b082781a98c6 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:25:40.808062 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-36da29f0-b305-4afd-88d2-b082781a98c6 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:25:40.809653 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-36da29f0-b305-4afd-88d2-b082781a98c6 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800" status: 200 len: 1724 microversion: 2.20 time: 0.567144 Aug 10 23:25:40.811051 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2800/5383] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:25:40 2022] GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800 => generated 1724 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:25:41.836077 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-995b30fa-58d1-4d02-b955-d473b72c0490 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:25:41.836740 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-995b30fa-58d1-4d02-b955-d473b72c0490 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: 03e88a01-d3ed-4ab2-a334-f4bc274fe800] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:25:41.849224 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-995b30fa-58d1-4d02-b955-d473b72c0490 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:25:41.850944 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-995b30fa-58d1-4d02-b955-d473b72c0490 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:25:41.852130 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-995b30fa-58d1-4d02-b955-d473b72c0490 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:25:41.852791 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-995b30fa-58d1-4d02-b955-d473b72c0490 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:25:41.853256 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-995b30fa-58d1-4d02-b955-d473b72c0490 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:25:41.858519 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-995b30fa-58d1-4d02-b955-d473b72c0490 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:25:42.520887 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-995b30fa-58d1-4d02-b955-d473b72c0490 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:25:42.530895 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-995b30fa-58d1-4d02-b955-d473b72c0490 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:25:42.535973 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-995b30fa-58d1-4d02-b955-d473b72c0490 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:25:42.537911 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-995b30fa-58d1-4d02-b955-d473b72c0490 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800" status: 200 len: 1745 microversion: 2.20 time: 0.706499 Aug 10 23:25:42.549557 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2801/5384] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:25:41 2022] GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800 => generated 1745 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:25:43.564236 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-791dcf3c-284d-4a12-b8f1-f0dce70befab tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:25:43.565550 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-791dcf3c-284d-4a12-b8f1-f0dce70befab tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: 03e88a01-d3ed-4ab2-a334-f4bc274fe800] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:25:43.582502 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-791dcf3c-284d-4a12-b8f1-f0dce70befab tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:25:43.583026 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-791dcf3c-284d-4a12-b8f1-f0dce70befab tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:25:43.583501 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-791dcf3c-284d-4a12-b8f1-f0dce70befab tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:25:43.588130 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-791dcf3c-284d-4a12-b8f1-f0dce70befab tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:25:43.588610 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-791dcf3c-284d-4a12-b8f1-f0dce70befab tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:25:43.589048 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-791dcf3c-284d-4a12-b8f1-f0dce70befab tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:25:43.998681 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-791dcf3c-284d-4a12-b8f1-f0dce70befab tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:25:44.030052 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-791dcf3c-284d-4a12-b8f1-f0dce70befab tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:25:44.035268 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-791dcf3c-284d-4a12-b8f1-f0dce70befab tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:25:44.036749 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-791dcf3c-284d-4a12-b8f1-f0dce70befab tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800" status: 200 len: 1745 microversion: 2.20 time: 0.477256 Aug 10 23:25:44.040402 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2802/5385] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:25:43 2022] GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800 => generated 1745 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 23:25:45.067332 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c40bcb0c-13be-4c22-95e4-f1ea15555fc1 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:25:45.070032 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-c40bcb0c-13be-4c22-95e4-f1ea15555fc1 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: 03e88a01-d3ed-4ab2-a334-f4bc274fe800] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:25:45.098253 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c40bcb0c-13be-4c22-95e4-f1ea15555fc1 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:25:45.100640 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c40bcb0c-13be-4c22-95e4-f1ea15555fc1 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:25:45.103348 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c40bcb0c-13be-4c22-95e4-f1ea15555fc1 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:25:45.104304 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c40bcb0c-13be-4c22-95e4-f1ea15555fc1 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:25:45.104931 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c40bcb0c-13be-4c22-95e4-f1ea15555fc1 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:25:45.107316 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c40bcb0c-13be-4c22-95e4-f1ea15555fc1 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:25:45.680731 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-c40bcb0c-13be-4c22-95e4-f1ea15555fc1 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:25:45.690710 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-c40bcb0c-13be-4c22-95e4-f1ea15555fc1 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:25:45.698411 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-c40bcb0c-13be-4c22-95e4-f1ea15555fc1 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:25:45.699933 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-c40bcb0c-13be-4c22-95e4-f1ea15555fc1 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800" status: 200 len: 1740 microversion: 2.20 time: 0.641098 Aug 10 23:25:45.701667 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2803/5386] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:25:45 2022] GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800 => generated 1740 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 23:25:46.743716 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-8f5bc2df-5b47-492d-bb8f-1c13ed330e44 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:25:46.746088 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-8f5bc2df-5b47-492d-bb8f-1c13ed330e44 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: 03e88a01-d3ed-4ab2-a334-f4bc274fe800] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:25:46.789952 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=4 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:25:46.810490 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8f5bc2df-5b47-492d-bb8f-1c13ed330e44 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:25:46.816535 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8f5bc2df-5b47-492d-bb8f-1c13ed330e44 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:25:46.818109 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8f5bc2df-5b47-492d-bb8f-1c13ed330e44 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:25:46.821445 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8f5bc2df-5b47-492d-bb8f-1c13ed330e44 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:25:46.825837 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8f5bc2df-5b47-492d-bb8f-1c13ed330e44 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:25:46.826936 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8f5bc2df-5b47-492d-bb8f-1c13ed330e44 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:25:46.983834 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=28 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:25:47.956566 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-8f5bc2df-5b47-492d-bb8f-1c13ed330e44 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:25:47.971871 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-8f5bc2df-5b47-492d-bb8f-1c13ed330e44 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:25:47.973599 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-8f5bc2df-5b47-492d-bb8f-1c13ed330e44 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:25:47.978308 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-8f5bc2df-5b47-492d-bb8f-1c13ed330e44 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800" status: 200 len: 1740 microversion: 2.20 time: 1.248413 Aug 10 23:25:47.983142 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2804/5387] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:25:46 2022] GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800 => generated 1740 bytes in 1254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:25:49.008023 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-acac9425-9213-4692-b65f-32cd9184d6e8 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:25:49.009342 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-acac9425-9213-4692-b65f-32cd9184d6e8 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: 03e88a01-d3ed-4ab2-a334-f4bc274fe800] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:25:49.019209 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-acac9425-9213-4692-b65f-32cd9184d6e8 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:25:49.032172 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-acac9425-9213-4692-b65f-32cd9184d6e8 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:25:49.037574 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-acac9425-9213-4692-b65f-32cd9184d6e8 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:25:49.040980 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-acac9425-9213-4692-b65f-32cd9184d6e8 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:25:49.044361 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-acac9425-9213-4692-b65f-32cd9184d6e8 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:25:49.048170 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-acac9425-9213-4692-b65f-32cd9184d6e8 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:25:49.649524 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-acac9425-9213-4692-b65f-32cd9184d6e8 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:25:49.669689 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-acac9425-9213-4692-b65f-32cd9184d6e8 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:25:49.678244 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-acac9425-9213-4692-b65f-32cd9184d6e8 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:25:49.684143 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-acac9425-9213-4692-b65f-32cd9184d6e8 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800" status: 200 len: 1740 microversion: 2.20 time: 0.679966 Aug 10 23:25:49.687620 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2805/5388] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:25:49 2022] GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800 => generated 1740 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:25:49.719455 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-80eaccc0-4e0c-48f6-b515-24d69806cdba req-17eff48f-dee2-451d-85c9-1387de38110d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03e88a01-d3ed-4ab2-a334-f4bc274fe800", "name": "network-vif-plugged", "status": "completed", "tag": "7481f052-393a-446e-bc21-7be34657945e"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:25:49.769255 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-80eaccc0-4e0c-48f6-b515-24d69806cdba req-17eff48f-dee2-451d-85c9-1387de38110d service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:25:49.769786 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-80eaccc0-4e0c-48f6-b515-24d69806cdba req-17eff48f-dee2-451d-85c9-1387de38110d service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:25:49.770240 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-80eaccc0-4e0c-48f6-b515-24d69806cdba req-17eff48f-dee2-451d-85c9-1387de38110d service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:25:49.867760 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-80eaccc0-4e0c-48f6-b515-24d69806cdba req-17eff48f-dee2-451d-85c9-1387de38110d service nova] Creating event network-vif-plugged:7481f052-393a-446e-bc21-7be34657945e for instance 03e88a01-d3ed-4ab2-a334-f4bc274fe800 on n-h1-850468-14 Aug 10 23:25:49.891054 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-80eaccc0-4e0c-48f6-b515-24d69806cdba req-17eff48f-dee2-451d-85c9-1387de38110d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.193159 Aug 10 23:25:49.895988 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2806/5389] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:25:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:25:50.070150 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-07816b8f-2f60-4442-8e3d-2605349b86d6 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Flavor limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:25:50.071259 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-07816b8f-2f60-4442-8e3d-2605349b86d6 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Image limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:25:50.071982 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-07816b8f-2f60-4442-8e3d-2605349b86d6 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Flavor pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:25:50.072619 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-07816b8f-2f60-4442-8e3d-2605349b86d6 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Image pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:25:50.073253 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-07816b8f-2f60-4442-8e3d-2605349b86d6 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:25:50.093524 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-07816b8f-2f60-4442-8e3d-2605349b86d6 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:25:50.097408 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-07816b8f-2f60-4442-8e3d-2605349b86d6 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:25:50.098281 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-07816b8f-2f60-4442-8e3d-2605349b86d6 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:25:50.100170 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-07816b8f-2f60-4442-8e3d-2605349b86d6 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:25:50.102151 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-07816b8f-2f60-4442-8e3d-2605349b86d6 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:25:50.107596 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-07816b8f-2f60-4442-8e3d-2605349b86d6 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:25:50.165375 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-07816b8f-2f60-4442-8e3d-2605349b86d6 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Getting quotas for project f3a075a69271470c904f8a380b0a2657. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:25:50.176361 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-07816b8f-2f60-4442-8e3d-2605349b86d6 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Getting quotas for user a5fe70a2accc42f3ae729c02c876dce9 and project f3a075a69271470c904f8a380b0a2657. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:25:50.611715 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-07816b8f-2f60-4442-8e3d-2605349b86d6 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Going to run 1 instances... {{(pid=122632) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 23:25:50.614662 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-07816b8f-2f60-4442-8e3d-2605349b86d6 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] [instance: 94831c62-29a5-4745-b321-11b28dafaaa6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='5a2595ed-b221-489e-b974-d94b4b478b38',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='ccbd0e33-38c4-47e9-b378-f56358ba5448',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b8427b75-f7c4-4974-b8d0-52b698bc578c',volume_size=None,volume_type=None)] {{(pid=122632) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 23:25:50.715733 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-98a354bb-d2e5-4e4a-bc4f-d54621f3c93e tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:25:50.717235 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-98a354bb-d2e5-4e4a-bc4f-d54621f3c93e tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: 03e88a01-d3ed-4ab2-a334-f4bc274fe800] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:25:50.741218 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-98a354bb-d2e5-4e4a-bc4f-d54621f3c93e tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:25:50.741968 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-98a354bb-d2e5-4e4a-bc4f-d54621f3c93e tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:25:50.745511 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-98a354bb-d2e5-4e4a-bc4f-d54621f3c93e tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:25:50.746496 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-98a354bb-d2e5-4e4a-bc4f-d54621f3c93e tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:25:50.748053 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-98a354bb-d2e5-4e4a-bc4f-d54621f3c93e tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:25:50.748666 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-98a354bb-d2e5-4e4a-bc4f-d54621f3c93e tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:25:51.637324 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-07816b8f-2f60-4442-8e3d-2605349b86d6 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.42 time: 11.997406 Aug 10 23:25:51.639154 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2584/5390] 10.222.0.58 () {62 vars in 1189 bytes} [Wed Aug 10 23:25:39 2022] POST /compute/v2.1/servers => generated 406 bytes in 12000 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 10 23:25:51.656444 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-92a28653-83ce-46fe-8d09-faab46e899b6 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:25:51.657637 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-92a28653-83ce-46fe-8d09-faab46e899b6 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] [instance: 94831c62-29a5-4745-b321-11b28dafaaa6] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:25:51.834083 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-92a28653-83ce-46fe-8d09-faab46e899b6 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:25:51.858087 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-92a28653-83ce-46fe-8d09-faab46e899b6 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:25:51.859575 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-92a28653-83ce-46fe-8d09-faab46e899b6 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:25:51.861546 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-92a28653-83ce-46fe-8d09-faab46e899b6 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] 10.222.0.58 "GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6" status: 200 len: 1283 microversion: 2.42 time: 0.215196 Aug 10 23:25:51.871336 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2585/5391] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:25:51 2022] GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6 => generated 1283 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:25:51.963405 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-98a354bb-d2e5-4e4a-bc4f-d54621f3c93e tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:25:51.998489 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-98a354bb-d2e5-4e4a-bc4f-d54621f3c93e tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:25:52.008665 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-98a354bb-d2e5-4e4a-bc4f-d54621f3c93e tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:25:52.013807 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-98a354bb-d2e5-4e4a-bc4f-d54621f3c93e tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800" status: 200 len: 1740 microversion: 2.20 time: 1.303361 Aug 10 23:25:52.018822 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2807/5392] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:25:50 2022] GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800 => generated 1740 bytes in 1309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:25:52.886683 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-0d554961-f37c-46dc-87dd-7793702c9d70 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:25:52.888221 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-0d554961-f37c-46dc-87dd-7793702c9d70 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] [instance: 94831c62-29a5-4745-b321-11b28dafaaa6] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:25:52.901727 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:25:53.051770 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-7f0d3d8d-76d0-4033-9b46-933a6f40422b tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:25:53.052434 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-7f0d3d8d-76d0-4033-9b46-933a6f40422b tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: 03e88a01-d3ed-4ab2-a334-f4bc274fe800] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:25:53.089194 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7f0d3d8d-76d0-4033-9b46-933a6f40422b tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:25:53.089693 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7f0d3d8d-76d0-4033-9b46-933a6f40422b tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:25:53.090143 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7f0d3d8d-76d0-4033-9b46-933a6f40422b tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:25:53.090886 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7f0d3d8d-76d0-4033-9b46-933a6f40422b tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:25:53.095833 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7f0d3d8d-76d0-4033-9b46-933a6f40422b tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:25:53.096406 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7f0d3d8d-76d0-4033-9b46-933a6f40422b tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:25:53.293991 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-0d554961-f37c-46dc-87dd-7793702c9d70 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:25:53.306271 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-0d554961-f37c-46dc-87dd-7793702c9d70 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:25:53.316087 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-0d554961-f37c-46dc-87dd-7793702c9d70 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:25:53.319817 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-0d554961-f37c-46dc-87dd-7793702c9d70 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] 10.222.0.58 "GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6" status: 200 len: 1283 microversion: 2.42 time: 0.438189 Aug 10 23:25:53.323764 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2586/5393] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:25:52 2022] GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6 => generated 1283 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:25:54.143596 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-7f0d3d8d-76d0-4033-9b46-933a6f40422b tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:25:54.171796 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-7f0d3d8d-76d0-4033-9b46-933a6f40422b tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:25:54.173441 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-7f0d3d8d-76d0-4033-9b46-933a6f40422b tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:25:54.206709 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-7f0d3d8d-76d0-4033-9b46-933a6f40422b tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800" status: 200 len: 1740 microversion: 2.20 time: 1.129228 Aug 10 23:25:54.208067 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2808/5394] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:25:53 2022] GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800 => generated 1740 bytes in 1163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:25:54.350071 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-3df0cbb3-3a59-4456-99ab-07f4a355cf0c tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:25:54.351301 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-3df0cbb3-3a59-4456-99ab-07f4a355cf0c tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] [instance: 94831c62-29a5-4745-b321-11b28dafaaa6] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:25:54.368629 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3df0cbb3-3a59-4456-99ab-07f4a355cf0c tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:25:54.369141 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3df0cbb3-3a59-4456-99ab-07f4a355cf0c tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:25:54.369589 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3df0cbb3-3a59-4456-99ab-07f4a355cf0c tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:25:54.370313 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3df0cbb3-3a59-4456-99ab-07f4a355cf0c tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:25:54.370826 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3df0cbb3-3a59-4456-99ab-07f4a355cf0c tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:25:54.371426 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3df0cbb3-3a59-4456-99ab-07f4a355cf0c tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:25:54.638717 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-3df0cbb3-3a59-4456-99ab-07f4a355cf0c tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:25:54.650253 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-3df0cbb3-3a59-4456-99ab-07f4a355cf0c tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:25:54.651797 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-3df0cbb3-3a59-4456-99ab-07f4a355cf0c tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:25:54.652972 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-3df0cbb3-3a59-4456-99ab-07f4a355cf0c tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] 10.222.0.58 "GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6" status: 200 len: 1517 microversion: 2.42 time: 0.307334 Aug 10 23:25:54.697819 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2587/5395] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:25:54 2022] GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6 => generated 1517 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:25:55.240205 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-a93ca41a-20a8-4497-a635-2537ca26667a tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:25:55.241023 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-a93ca41a-20a8-4497-a635-2537ca26667a tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: 03e88a01-d3ed-4ab2-a334-f4bc274fe800] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:25:55.272750 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a93ca41a-20a8-4497-a635-2537ca26667a tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:25:55.273256 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a93ca41a-20a8-4497-a635-2537ca26667a tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:25:55.274935 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a93ca41a-20a8-4497-a635-2537ca26667a tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:25:55.276230 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a93ca41a-20a8-4497-a635-2537ca26667a tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:25:55.276705 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a93ca41a-20a8-4497-a635-2537ca26667a tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:25:55.277150 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a93ca41a-20a8-4497-a635-2537ca26667a tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:25:55.697715 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-d05c5700-47ad-453d-99e4-0af66e3568e7 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:25:55.699039 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-d05c5700-47ad-453d-99e4-0af66e3568e7 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] [instance: 94831c62-29a5-4745-b321-11b28dafaaa6] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:25:55.713682 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d05c5700-47ad-453d-99e4-0af66e3568e7 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:25:55.714582 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d05c5700-47ad-453d-99e4-0af66e3568e7 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:25:55.715783 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d05c5700-47ad-453d-99e4-0af66e3568e7 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:25:55.716893 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d05c5700-47ad-453d-99e4-0af66e3568e7 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:25:55.717597 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d05c5700-47ad-453d-99e4-0af66e3568e7 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:25:55.719926 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d05c5700-47ad-453d-99e4-0af66e3568e7 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:25:55.843549 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-a93ca41a-20a8-4497-a635-2537ca26667a tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:25:55.851638 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:25:55.866458 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-a93ca41a-20a8-4497-a635-2537ca26667a tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:25:55.868286 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-a93ca41a-20a8-4497-a635-2537ca26667a tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:25:55.886774 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-a93ca41a-20a8-4497-a635-2537ca26667a tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800" status: 200 len: 1740 microversion: 2.20 time: 0.656737 Aug 10 23:25:55.890315 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2809/5396] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:25:55 2022] GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800 => generated 1740 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:25:55.928266 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-d05c5700-47ad-453d-99e4-0af66e3568e7 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:25:55.960691 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-d05c5700-47ad-453d-99e4-0af66e3568e7 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:25:55.968223 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-d05c5700-47ad-453d-99e4-0af66e3568e7 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:25:55.973120 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-d05c5700-47ad-453d-99e4-0af66e3568e7 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] 10.222.0.58 "GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6" status: 200 len: 1581 microversion: 2.42 time: 0.286036 Aug 10 23:25:55.975488 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2588/5397] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:25:55 2022] GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6 => generated 1581 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:25:56.914253 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-264c2d03-3408-4dea-8573-dfccb1e470c1 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:25:56.915295 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-264c2d03-3408-4dea-8573-dfccb1e470c1 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: 03e88a01-d3ed-4ab2-a334-f4bc274fe800] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:25:56.938519 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=1 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:25:56.940707 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-264c2d03-3408-4dea-8573-dfccb1e470c1 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:25:56.941475 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-264c2d03-3408-4dea-8573-dfccb1e470c1 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:25:56.952802 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-264c2d03-3408-4dea-8573-dfccb1e470c1 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:25:56.954565 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-264c2d03-3408-4dea-8573-dfccb1e470c1 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:25:56.960711 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-264c2d03-3408-4dea-8573-dfccb1e470c1 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:25:56.961486 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-264c2d03-3408-4dea-8573-dfccb1e470c1 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:25:57.002020 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-e7b7b6d3-0750-4bc2-81ff-305c6c90655d tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:25:57.003612 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-e7b7b6d3-0750-4bc2-81ff-305c6c90655d tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] [instance: 94831c62-29a5-4745-b321-11b28dafaaa6] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:25:57.039360 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e7b7b6d3-0750-4bc2-81ff-305c6c90655d tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:25:57.041226 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e7b7b6d3-0750-4bc2-81ff-305c6c90655d tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:25:57.042709 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e7b7b6d3-0750-4bc2-81ff-305c6c90655d tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:25:57.044061 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e7b7b6d3-0750-4bc2-81ff-305c6c90655d tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:25:57.045370 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e7b7b6d3-0750-4bc2-81ff-305c6c90655d tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:25:57.050365 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e7b7b6d3-0750-4bc2-81ff-305c6c90655d tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:25:57.333845 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-e7b7b6d3-0750-4bc2-81ff-305c6c90655d tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:25:57.358509 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-e7b7b6d3-0750-4bc2-81ff-305c6c90655d tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:25:57.368203 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-e7b7b6d3-0750-4bc2-81ff-305c6c90655d tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:25:57.372170 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-e7b7b6d3-0750-4bc2-81ff-305c6c90655d tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] 10.222.0.58 "GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6" status: 200 len: 1591 microversion: 2.42 time: 0.372401 Aug 10 23:25:57.373408 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2589/5398] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:25:56 2022] GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6 => generated 1591 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:25:58.407877 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-3d985885-c06a-4b42-a9a7-1f4010a33d10 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:25:58.409229 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-3d985885-c06a-4b42-a9a7-1f4010a33d10 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] [instance: 94831c62-29a5-4745-b321-11b28dafaaa6] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:25:58.424297 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3d985885-c06a-4b42-a9a7-1f4010a33d10 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:25:58.425074 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3d985885-c06a-4b42-a9a7-1f4010a33d10 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:25:58.425708 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3d985885-c06a-4b42-a9a7-1f4010a33d10 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:25:58.426586 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3d985885-c06a-4b42-a9a7-1f4010a33d10 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:25:58.427228 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3d985885-c06a-4b42-a9a7-1f4010a33d10 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:25:58.430391 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3d985885-c06a-4b42-a9a7-1f4010a33d10 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:25:58.470506 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-264c2d03-3408-4dea-8573-dfccb1e470c1 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:25:58.499216 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-264c2d03-3408-4dea-8573-dfccb1e470c1 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:25:58.521312 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-264c2d03-3408-4dea-8573-dfccb1e470c1 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:25:58.522777 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-264c2d03-3408-4dea-8573-dfccb1e470c1 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800" status: 200 len: 1740 microversion: 2.20 time: 1.612407 Aug 10 23:25:58.562854 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2810/5399] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:25:56 2022] GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800 => generated 1740 bytes in 1639 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:25:58.911480 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-3d985885-c06a-4b42-a9a7-1f4010a33d10 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:25:58.940517 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-3d985885-c06a-4b42-a9a7-1f4010a33d10 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:25:58.948115 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-3d985885-c06a-4b42-a9a7-1f4010a33d10 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:25:58.950199 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-3d985885-c06a-4b42-a9a7-1f4010a33d10 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] 10.222.0.58 "GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6" status: 200 len: 1591 microversion: 2.42 time: 0.548070 Aug 10 23:25:58.951985 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2590/5400] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:25:58 2022] GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6 => generated 1591 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:25:59.581816 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-deaba359-cf7d-45f3-bc91-297eeba338a1 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:25:59.582894 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-deaba359-cf7d-45f3-bc91-297eeba338a1 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: 03e88a01-d3ed-4ab2-a334-f4bc274fe800] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:25:59.617815 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-deaba359-cf7d-45f3-bc91-297eeba338a1 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:25:59.651441 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-deaba359-cf7d-45f3-bc91-297eeba338a1 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.033s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:25:59.652042 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-deaba359-cf7d-45f3-bc91-297eeba338a1 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:25:59.666849 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-deaba359-cf7d-45f3-bc91-297eeba338a1 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:25:59.676713 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-deaba359-cf7d-45f3-bc91-297eeba338a1 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:25:59.677623 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-deaba359-cf7d-45f3-bc91-297eeba338a1 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:25:59.975337 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-7e237e2b-fbc2-4fb9-88f2-c0951a1f2d73 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:25:59.976199 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-7e237e2b-fbc2-4fb9-88f2-c0951a1f2d73 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] [instance: 94831c62-29a5-4745-b321-11b28dafaaa6] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:25:59.991118 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7e237e2b-fbc2-4fb9-88f2-c0951a1f2d73 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:25:59.998610 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7e237e2b-fbc2-4fb9-88f2-c0951a1f2d73 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:00.002095 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7e237e2b-fbc2-4fb9-88f2-c0951a1f2d73 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:00.005910 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7e237e2b-fbc2-4fb9-88f2-c0951a1f2d73 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:00.008944 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7e237e2b-fbc2-4fb9-88f2-c0951a1f2d73 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:00.009570 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7e237e2b-fbc2-4fb9-88f2-c0951a1f2d73 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:00.148828 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=2 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:26:01.422713 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-7e237e2b-fbc2-4fb9-88f2-c0951a1f2d73 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:01.455129 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-7e237e2b-fbc2-4fb9-88f2-c0951a1f2d73 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:01.457306 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-7e237e2b-fbc2-4fb9-88f2-c0951a1f2d73 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:01.463920 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-7e237e2b-fbc2-4fb9-88f2-c0951a1f2d73 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] 10.222.0.58 "GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6" status: 200 len: 1659 microversion: 2.42 time: 1.493989 Aug 10 23:26:01.465086 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2591/5401] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:25:59 2022] GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6 => generated 1659 bytes in 1496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 23:26:01.751703 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-deaba359-cf7d-45f3-bc91-297eeba338a1 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:01.764535 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-deaba359-cf7d-45f3-bc91-297eeba338a1 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:01.785084 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-deaba359-cf7d-45f3-bc91-297eeba338a1 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:01.796298 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-deaba359-cf7d-45f3-bc91-297eeba338a1 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800" status: 200 len: 1740 microversion: 2.20 time: 2.223734 Aug 10 23:26:01.796983 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2811/5402] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:25:59 2022] GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800 => generated 1740 bytes in 2225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:26:02.507181 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-38e0020c-361a-4a99-b0df-91f663a52051 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:26:02.513127 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-38e0020c-361a-4a99-b0df-91f663a52051 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] [instance: 94831c62-29a5-4745-b321-11b28dafaaa6] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:26:02.544947 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-38e0020c-361a-4a99-b0df-91f663a52051 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:02.551683 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-38e0020c-361a-4a99-b0df-91f663a52051 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:02.552742 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-38e0020c-361a-4a99-b0df-91f663a52051 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:02.553904 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-38e0020c-361a-4a99-b0df-91f663a52051 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:02.555596 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-38e0020c-361a-4a99-b0df-91f663a52051 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:02.605567 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-38e0020c-361a-4a99-b0df-91f663a52051 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:02.861715 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-f8ff48af-1c65-4e1f-b612-ed1211bb8cf1 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:26:02.862304 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-f8ff48af-1c65-4e1f-b612-ed1211bb8cf1 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: 03e88a01-d3ed-4ab2-a334-f4bc274fe800] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:26:02.887451 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f8ff48af-1c65-4e1f-b612-ed1211bb8cf1 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:02.887970 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f8ff48af-1c65-4e1f-b612-ed1211bb8cf1 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:02.888418 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f8ff48af-1c65-4e1f-b612-ed1211bb8cf1 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:02.889156 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f8ff48af-1c65-4e1f-b612-ed1211bb8cf1 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:02.890832 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f8ff48af-1c65-4e1f-b612-ed1211bb8cf1 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:02.934298 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f8ff48af-1c65-4e1f-b612-ed1211bb8cf1 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:03.301822 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=10 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:26:04.142116 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-38e0020c-361a-4a99-b0df-91f663a52051 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:04.152725 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-f8ff48af-1c65-4e1f-b612-ed1211bb8cf1 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:04.162392 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-f8ff48af-1c65-4e1f-b612-ed1211bb8cf1 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:04.165532 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-38e0020c-361a-4a99-b0df-91f663a52051 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:04.168781 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-38e0020c-361a-4a99-b0df-91f663a52051 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:04.170620 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-38e0020c-361a-4a99-b0df-91f663a52051 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] 10.222.0.58 "GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6" status: 200 len: 1659 microversion: 2.42 time: 1.680602 Aug 10 23:26:04.171517 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-f8ff48af-1c65-4e1f-b612-ed1211bb8cf1 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:04.175726 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-f8ff48af-1c65-4e1f-b612-ed1211bb8cf1 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800" status: 200 len: 1740 microversion: 2.20 time: 1.360079 Aug 10 23:26:04.183475 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2592/5403] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:26:02 2022] GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6 => generated 1659 bytes in 1695 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:26:04.190286 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2812/5404] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:26:02 2022] GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800 => generated 1740 bytes in 1375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 23:26:05.199640 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-f3847fb5-3b89-4bdf-b526-a160a1ccc542 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:26:05.201008 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-f3847fb5-3b89-4bdf-b526-a160a1ccc542 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] [instance: 94831c62-29a5-4745-b321-11b28dafaaa6] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:26:05.208486 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-36969c2f-79a2-4ea4-9ec4-5408525f9d77 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:26:05.210565 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-36969c2f-79a2-4ea4-9ec4-5408525f9d77 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: 03e88a01-d3ed-4ab2-a334-f4bc274fe800] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:26:05.242034 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f3847fb5-3b89-4bdf-b526-a160a1ccc542 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:05.245254 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f3847fb5-3b89-4bdf-b526-a160a1ccc542 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:05.246119 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f3847fb5-3b89-4bdf-b526-a160a1ccc542 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:05.256401 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-36969c2f-79a2-4ea4-9ec4-5408525f9d77 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:05.257225 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f3847fb5-3b89-4bdf-b526-a160a1ccc542 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:05.257430 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-36969c2f-79a2-4ea4-9ec4-5408525f9d77 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:05.258253 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-36969c2f-79a2-4ea4-9ec4-5408525f9d77 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:05.259618 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-36969c2f-79a2-4ea4-9ec4-5408525f9d77 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:05.259737 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f3847fb5-3b89-4bdf-b526-a160a1ccc542 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:05.260467 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-36969c2f-79a2-4ea4-9ec4-5408525f9d77 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:05.260600 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f3847fb5-3b89-4bdf-b526-a160a1ccc542 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:05.261258 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-36969c2f-79a2-4ea4-9ec4-5408525f9d77 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:06.017416 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-f3847fb5-3b89-4bdf-b526-a160a1ccc542 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:06.027395 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-f3847fb5-3b89-4bdf-b526-a160a1ccc542 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:06.040887 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-f3847fb5-3b89-4bdf-b526-a160a1ccc542 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:06.042303 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-f3847fb5-3b89-4bdf-b526-a160a1ccc542 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] 10.222.0.58 "GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6" status: 200 len: 1706 microversion: 2.42 time: 0.848845 Aug 10 23:26:06.058811 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2593/5405] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:26:05 2022] GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6 => generated 1706 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:26:06.995664 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-36969c2f-79a2-4ea4-9ec4-5408525f9d77 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:07.027906 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-36969c2f-79a2-4ea4-9ec4-5408525f9d77 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:07.036997 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-36969c2f-79a2-4ea4-9ec4-5408525f9d77 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:07.048164 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-36969c2f-79a2-4ea4-9ec4-5408525f9d77 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800" status: 200 len: 1740 microversion: 2.20 time: 1.845645 Aug 10 23:26:07.050023 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2813/5406] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:26:05 2022] GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800 => generated 1740 bytes in 1850 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:26:07.072906 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-faabe6e9-2755-4506-a82b-b542bc9f05b1 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:26:07.074954 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-faabe6e9-2755-4506-a82b-b542bc9f05b1 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] [instance: 94831c62-29a5-4745-b321-11b28dafaaa6] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:26:07.104598 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-faabe6e9-2755-4506-a82b-b542bc9f05b1 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:07.105792 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-faabe6e9-2755-4506-a82b-b542bc9f05b1 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:07.112748 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-faabe6e9-2755-4506-a82b-b542bc9f05b1 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:07.114354 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-faabe6e9-2755-4506-a82b-b542bc9f05b1 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:07.115435 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-faabe6e9-2755-4506-a82b-b542bc9f05b1 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:07.116410 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-faabe6e9-2755-4506-a82b-b542bc9f05b1 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:08.080376 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-04ec1b8b-e65c-4ac0-936d-8b5eed27a310 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:26:08.083236 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-04ec1b8b-e65c-4ac0-936d-8b5eed27a310 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: 03e88a01-d3ed-4ab2-a334-f4bc274fe800] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:26:08.104274 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-04ec1b8b-e65c-4ac0-936d-8b5eed27a310 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:08.105070 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-04ec1b8b-e65c-4ac0-936d-8b5eed27a310 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:08.105874 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-04ec1b8b-e65c-4ac0-936d-8b5eed27a310 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:08.106835 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-04ec1b8b-e65c-4ac0-936d-8b5eed27a310 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:08.107652 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-04ec1b8b-e65c-4ac0-936d-8b5eed27a310 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:08.108269 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-04ec1b8b-e65c-4ac0-936d-8b5eed27a310 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:08.540839 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-04ec1b8b-e65c-4ac0-936d-8b5eed27a310 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:08.557903 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-04ec1b8b-e65c-4ac0-936d-8b5eed27a310 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:08.561987 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-04ec1b8b-e65c-4ac0-936d-8b5eed27a310 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:08.564911 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-04ec1b8b-e65c-4ac0-936d-8b5eed27a310 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800" status: 200 len: 1740 microversion: 2.20 time: 0.495204 Aug 10 23:26:08.567177 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2814/5407] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:26:08 2022] GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800 => generated 1740 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 23:26:08.845122 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-faabe6e9-2755-4506-a82b-b542bc9f05b1 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:08.867884 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-faabe6e9-2755-4506-a82b-b542bc9f05b1 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:08.871766 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-faabe6e9-2755-4506-a82b-b542bc9f05b1 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:08.876156 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-faabe6e9-2755-4506-a82b-b542bc9f05b1 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] 10.222.0.58 "GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6" status: 200 len: 1706 microversion: 2.42 time: 1.810697 Aug 10 23:26:08.879732 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2594/5408] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:26:07 2022] GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6 => generated 1706 bytes in 1815 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:26:09.588697 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-15e2de99-24c8-44a6-8253-c56bd490e4cb tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:26:09.590442 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-15e2de99-24c8-44a6-8253-c56bd490e4cb tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: 03e88a01-d3ed-4ab2-a334-f4bc274fe800] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:26:09.599215 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-15e2de99-24c8-44a6-8253-c56bd490e4cb tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:09.605219 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-15e2de99-24c8-44a6-8253-c56bd490e4cb tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:09.606011 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-15e2de99-24c8-44a6-8253-c56bd490e4cb tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:09.606971 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-15e2de99-24c8-44a6-8253-c56bd490e4cb tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:09.609106 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-15e2de99-24c8-44a6-8253-c56bd490e4cb tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:09.610069 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-15e2de99-24c8-44a6-8253-c56bd490e4cb tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:09.904382 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-cf1610a6-14d8-4159-a558-cef9923780ca tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:26:09.904993 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-cf1610a6-14d8-4159-a558-cef9923780ca tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] [instance: 94831c62-29a5-4745-b321-11b28dafaaa6] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:26:09.925560 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cf1610a6-14d8-4159-a558-cef9923780ca tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:09.926257 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cf1610a6-14d8-4159-a558-cef9923780ca tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:09.926923 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cf1610a6-14d8-4159-a558-cef9923780ca tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:09.929239 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cf1610a6-14d8-4159-a558-cef9923780ca tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:09.929860 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cf1610a6-14d8-4159-a558-cef9923780ca tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:09.930437 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cf1610a6-14d8-4159-a558-cef9923780ca tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:10.275222 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-15e2de99-24c8-44a6-8253-c56bd490e4cb tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:10.289906 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-15e2de99-24c8-44a6-8253-c56bd490e4cb tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:10.291518 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-15e2de99-24c8-44a6-8253-c56bd490e4cb tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:10.292745 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-15e2de99-24c8-44a6-8253-c56bd490e4cb tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800" status: 200 len: 1740 microversion: 2.20 time: 0.708307 Aug 10 23:26:10.300551 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2815/5409] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:26:09 2022] GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800 => generated 1740 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:26:10.920090 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-cf1610a6-14d8-4159-a558-cef9923780ca tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:10.929743 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-cf1610a6-14d8-4159-a558-cef9923780ca tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:10.931297 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-cf1610a6-14d8-4159-a558-cef9923780ca tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:10.932452 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-cf1610a6-14d8-4159-a558-cef9923780ca tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] 10.222.0.58 "GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6" status: 200 len: 1753 microversion: 2.42 time: 1.032209 Aug 10 23:26:10.942501 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2595/5410] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:26:09 2022] GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6 => generated 1753 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 23:26:11.322844 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-5eab61ee-cc40-4aa1-b913-24147ba7360a tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:26:11.323438 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-5eab61ee-cc40-4aa1-b913-24147ba7360a tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: 03e88a01-d3ed-4ab2-a334-f4bc274fe800] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:26:11.344728 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5eab61ee-cc40-4aa1-b913-24147ba7360a tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:11.345443 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5eab61ee-cc40-4aa1-b913-24147ba7360a tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:11.346049 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5eab61ee-cc40-4aa1-b913-24147ba7360a tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:11.348027 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5eab61ee-cc40-4aa1-b913-24147ba7360a tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:11.351539 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5eab61ee-cc40-4aa1-b913-24147ba7360a tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:11.352187 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5eab61ee-cc40-4aa1-b913-24147ba7360a tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:11.855427 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-5eab61ee-cc40-4aa1-b913-24147ba7360a tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:11.867471 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-5eab61ee-cc40-4aa1-b913-24147ba7360a tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:11.869665 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-5eab61ee-cc40-4aa1-b913-24147ba7360a tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:11.871354 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-5eab61ee-cc40-4aa1-b913-24147ba7360a tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800" status: 200 len: 1740 microversion: 2.20 time: 0.552691 Aug 10 23:26:11.872607 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2816/5411] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:26:11 2022] GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800 => generated 1740 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:26:11.963003 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-0d667c76-e343-4dc0-a1b7-5f07026fa12f tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:26:11.964320 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-0d667c76-e343-4dc0-a1b7-5f07026fa12f tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] [instance: 94831c62-29a5-4745-b321-11b28dafaaa6] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:26:11.989350 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0d667c76-e343-4dc0-a1b7-5f07026fa12f tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:11.990182 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0d667c76-e343-4dc0-a1b7-5f07026fa12f tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:11.993346 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0d667c76-e343-4dc0-a1b7-5f07026fa12f tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:11.994383 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0d667c76-e343-4dc0-a1b7-5f07026fa12f tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:11.995092 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0d667c76-e343-4dc0-a1b7-5f07026fa12f tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:12.004287 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0d667c76-e343-4dc0-a1b7-5f07026fa12f tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:12.905420 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-16cef71b-5f86-4fa6-8dc8-ccf1d7ebd39e tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:26:12.906350 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-16cef71b-5f86-4fa6-8dc8-ccf1d7ebd39e tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: 03e88a01-d3ed-4ab2-a334-f4bc274fe800] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:26:12.919695 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-16cef71b-5f86-4fa6-8dc8-ccf1d7ebd39e tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:12.922457 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-16cef71b-5f86-4fa6-8dc8-ccf1d7ebd39e tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:12.923070 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-16cef71b-5f86-4fa6-8dc8-ccf1d7ebd39e tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:12.923941 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-16cef71b-5f86-4fa6-8dc8-ccf1d7ebd39e tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:12.927326 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-16cef71b-5f86-4fa6-8dc8-ccf1d7ebd39e tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:12.927940 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-16cef71b-5f86-4fa6-8dc8-ccf1d7ebd39e tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:13.334212 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-16cef71b-5f86-4fa6-8dc8-ccf1d7ebd39e tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:13.348362 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-16cef71b-5f86-4fa6-8dc8-ccf1d7ebd39e tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:13.354574 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-16cef71b-5f86-4fa6-8dc8-ccf1d7ebd39e tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:13.357377 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-16cef71b-5f86-4fa6-8dc8-ccf1d7ebd39e tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800" status: 200 len: 1740 microversion: 2.20 time: 0.457153 Aug 10 23:26:13.363242 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2817/5412] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:26:12 2022] GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800 => generated 1740 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 23:26:13.466206 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-0d667c76-e343-4dc0-a1b7-5f07026fa12f tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:13.489289 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-0d667c76-e343-4dc0-a1b7-5f07026fa12f tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:13.509697 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-0d667c76-e343-4dc0-a1b7-5f07026fa12f tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:13.517872 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-0d667c76-e343-4dc0-a1b7-5f07026fa12f tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] 10.222.0.58 "GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6" status: 200 len: 1753 microversion: 2.42 time: 1.558935 Aug 10 23:26:13.519249 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2596/5413] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:26:11 2022] GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6 => generated 1753 bytes in 1561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 23:26:14.395415 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-49bc4a13-306f-4286-bf0c-6115b5d2ec63 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:26:14.396991 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-49bc4a13-306f-4286-bf0c-6115b5d2ec63 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: 03e88a01-d3ed-4ab2-a334-f4bc274fe800] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:26:14.412956 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-49bc4a13-306f-4286-bf0c-6115b5d2ec63 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:14.413887 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-49bc4a13-306f-4286-bf0c-6115b5d2ec63 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:14.416723 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-49bc4a13-306f-4286-bf0c-6115b5d2ec63 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:14.418553 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-49bc4a13-306f-4286-bf0c-6115b5d2ec63 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:14.424471 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-49bc4a13-306f-4286-bf0c-6115b5d2ec63 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:14.426735 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-49bc4a13-306f-4286-bf0c-6115b5d2ec63 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:14.544436 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-5cdae5a4-fbd0-41c0-8c0e-9b57054ff163 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:26:14.545064 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-5cdae5a4-fbd0-41c0-8c0e-9b57054ff163 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] [instance: 94831c62-29a5-4745-b321-11b28dafaaa6] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:26:14.560289 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5cdae5a4-fbd0-41c0-8c0e-9b57054ff163 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:14.560851 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5cdae5a4-fbd0-41c0-8c0e-9b57054ff163 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:14.561295 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5cdae5a4-fbd0-41c0-8c0e-9b57054ff163 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:14.565801 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5cdae5a4-fbd0-41c0-8c0e-9b57054ff163 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:14.566242 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5cdae5a4-fbd0-41c0-8c0e-9b57054ff163 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:14.566696 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5cdae5a4-fbd0-41c0-8c0e-9b57054ff163 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:14.813974 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-49bc4a13-306f-4286-bf0c-6115b5d2ec63 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:14.836854 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-49bc4a13-306f-4286-bf0c-6115b5d2ec63 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:14.839215 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-49bc4a13-306f-4286-bf0c-6115b5d2ec63 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:14.841437 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-49bc4a13-306f-4286-bf0c-6115b5d2ec63 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800" status: 200 len: 1740 microversion: 2.20 time: 0.452108 Aug 10 23:26:14.842610 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2818/5414] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:26:14 2022] GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800 => generated 1740 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:26:15.137822 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-5cdae5a4-fbd0-41c0-8c0e-9b57054ff163 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:15.151785 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-5cdae5a4-fbd0-41c0-8c0e-9b57054ff163 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:15.153644 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-5cdae5a4-fbd0-41c0-8c0e-9b57054ff163 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:15.155155 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-5cdae5a4-fbd0-41c0-8c0e-9b57054ff163 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] 10.222.0.58 "GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6" status: 200 len: 1753 microversion: 2.42 time: 0.614666 Aug 10 23:26:15.174837 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2597/5415] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:26:14 2022] GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6 => generated 1753 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:26:15.871778 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-f9b7c906-a01d-4aa7-bb22-64627fe5b05b tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:26:15.878754 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-f9b7c906-a01d-4aa7-bb22-64627fe5b05b tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: 03e88a01-d3ed-4ab2-a334-f4bc274fe800] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:26:15.913167 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f9b7c906-a01d-4aa7-bb22-64627fe5b05b tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:15.913976 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f9b7c906-a01d-4aa7-bb22-64627fe5b05b tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:15.930914 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f9b7c906-a01d-4aa7-bb22-64627fe5b05b tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:15.931926 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f9b7c906-a01d-4aa7-bb22-64627fe5b05b tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:15.932471 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f9b7c906-a01d-4aa7-bb22-64627fe5b05b tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:15.932923 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f9b7c906-a01d-4aa7-bb22-64627fe5b05b tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:16.191755 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-d05db9f5-28b4-453e-88af-c6f2f247c307 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:26:16.193390 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-d05db9f5-28b4-453e-88af-c6f2f247c307 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] [instance: 94831c62-29a5-4745-b321-11b28dafaaa6] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:26:16.212319 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d05db9f5-28b4-453e-88af-c6f2f247c307 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:16.213103 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d05db9f5-28b4-453e-88af-c6f2f247c307 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:16.213887 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d05db9f5-28b4-453e-88af-c6f2f247c307 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:16.215162 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d05db9f5-28b4-453e-88af-c6f2f247c307 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:16.215790 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d05db9f5-28b4-453e-88af-c6f2f247c307 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:16.216396 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d05db9f5-28b4-453e-88af-c6f2f247c307 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:16.261283 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-f9b7c906-a01d-4aa7-bb22-64627fe5b05b tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:16.271751 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-f9b7c906-a01d-4aa7-bb22-64627fe5b05b tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:16.273466 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-f9b7c906-a01d-4aa7-bb22-64627fe5b05b tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:16.287584 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-f9b7c906-a01d-4aa7-bb22-64627fe5b05b tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800" status: 200 len: 1722 microversion: 2.20 time: 0.424114 Aug 10 23:26:16.288236 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2819/5416] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:26:15 2022] GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800 => generated 1722 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:26:16.976906 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-d05db9f5-28b4-453e-88af-c6f2f247c307 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:16.988297 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-d05db9f5-28b4-453e-88af-c6f2f247c307 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:16.999645 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-d05db9f5-28b4-453e-88af-c6f2f247c307 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:17.001269 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-d05db9f5-28b4-453e-88af-c6f2f247c307 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] 10.222.0.58 "GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6" status: 200 len: 1800 microversion: 2.42 time: 0.819515 Aug 10 23:26:17.011302 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2598/5417] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:26:16 2022] GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6 => generated 1800 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:26:17.316552 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-7e1d1ec5-57be-4315-b4f7-64fe457b7692 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:26:17.317168 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-7e1d1ec5-57be-4315-b4f7-64fe457b7692 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: 03e88a01-d3ed-4ab2-a334-f4bc274fe800] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:26:17.327169 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7e1d1ec5-57be-4315-b4f7-64fe457b7692 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:17.334040 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7e1d1ec5-57be-4315-b4f7-64fe457b7692 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:17.334669 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7e1d1ec5-57be-4315-b4f7-64fe457b7692 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:17.335820 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7e1d1ec5-57be-4315-b4f7-64fe457b7692 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:17.338744 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7e1d1ec5-57be-4315-b4f7-64fe457b7692 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:17.339392 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7e1d1ec5-57be-4315-b4f7-64fe457b7692 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:17.846675 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-7e1d1ec5-57be-4315-b4f7-64fe457b7692 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:17.859159 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-7e1d1ec5-57be-4315-b4f7-64fe457b7692 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:17.868136 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-7e1d1ec5-57be-4315-b4f7-64fe457b7692 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:17.869817 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-7e1d1ec5-57be-4315-b4f7-64fe457b7692 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800" status: 200 len: 1722 microversion: 2.20 time: 0.557246 Aug 10 23:26:17.891173 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2820/5418] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:26:17 2022] GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800 => generated 1722 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:26:18.039722 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c305c025-f34d-415d-8d34-3977126baa1c tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:26:18.040955 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-c305c025-f34d-415d-8d34-3977126baa1c tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] [instance: 94831c62-29a5-4745-b321-11b28dafaaa6] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:26:18.058836 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c305c025-f34d-415d-8d34-3977126baa1c tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:18.059597 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c305c025-f34d-415d-8d34-3977126baa1c tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:18.060202 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c305c025-f34d-415d-8d34-3977126baa1c tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:18.061088 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c305c025-f34d-415d-8d34-3977126baa1c tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:18.062513 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c305c025-f34d-415d-8d34-3977126baa1c tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:18.065724 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c305c025-f34d-415d-8d34-3977126baa1c tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:18.076686 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=75 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:26:18.782140 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-c305c025-f34d-415d-8d34-3977126baa1c tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:18.802273 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-c305c025-f34d-415d-8d34-3977126baa1c tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:18.803816 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-c305c025-f34d-415d-8d34-3977126baa1c tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:18.804988 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-c305c025-f34d-415d-8d34-3977126baa1c tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] 10.222.0.58 "GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6" status: 200 len: 1800 microversion: 2.42 time: 0.769230 Aug 10 23:26:18.805605 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2599/5419] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:26:18 2022] GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6 => generated 1800 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:26:18.900172 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-e0913c86-9a62-4e42-8f54-94d5a952ca6f tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:26:18.901709 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-e0913c86-9a62-4e42-8f54-94d5a952ca6f tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: 03e88a01-d3ed-4ab2-a334-f4bc274fe800] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:26:18.918474 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e0913c86-9a62-4e42-8f54-94d5a952ca6f tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:18.919087 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e0913c86-9a62-4e42-8f54-94d5a952ca6f tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:18.919766 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e0913c86-9a62-4e42-8f54-94d5a952ca6f tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:18.920527 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e0913c86-9a62-4e42-8f54-94d5a952ca6f tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:18.921520 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e0913c86-9a62-4e42-8f54-94d5a952ca6f tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:18.921953 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e0913c86-9a62-4e42-8f54-94d5a952ca6f tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:19.266548 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-e0913c86-9a62-4e42-8f54-94d5a952ca6f tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:19.279035 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-e0913c86-9a62-4e42-8f54-94d5a952ca6f tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:19.283484 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-e0913c86-9a62-4e42-8f54-94d5a952ca6f tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:19.292297 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-e0913c86-9a62-4e42-8f54-94d5a952ca6f tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800" status: 200 len: 1722 microversion: 2.20 time: 0.396153 Aug 10 23:26:19.316163 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2821/5420] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:26:18 2022] GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800 => generated 1722 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:26:19.835086 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c35039f5-ae64-4714-80c0-2c5a305f7f8a tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:26:19.836393 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-c35039f5-ae64-4714-80c0-2c5a305f7f8a tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] [instance: 94831c62-29a5-4745-b321-11b28dafaaa6] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:26:19.858633 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c35039f5-ae64-4714-80c0-2c5a305f7f8a tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:19.860018 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c35039f5-ae64-4714-80c0-2c5a305f7f8a tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:19.862761 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c35039f5-ae64-4714-80c0-2c5a305f7f8a tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:19.863818 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c35039f5-ae64-4714-80c0-2c5a305f7f8a tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:19.864480 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c35039f5-ae64-4714-80c0-2c5a305f7f8a tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:19.866570 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c35039f5-ae64-4714-80c0-2c5a305f7f8a tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:20.318470 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-62bb9912-f66f-49d9-91ce-28906794417b tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:26:20.333931 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-62bb9912-f66f-49d9-91ce-28906794417b tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: 03e88a01-d3ed-4ab2-a334-f4bc274fe800] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:26:20.341479 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-c35039f5-ae64-4714-80c0-2c5a305f7f8a tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:20.356092 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-62bb9912-f66f-49d9-91ce-28906794417b tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:20.358929 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-62bb9912-f66f-49d9-91ce-28906794417b tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:20.359536 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-62bb9912-f66f-49d9-91ce-28906794417b tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:20.362135 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-62bb9912-f66f-49d9-91ce-28906794417b tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:20.363918 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-62bb9912-f66f-49d9-91ce-28906794417b tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:20.369102 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-62bb9912-f66f-49d9-91ce-28906794417b tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:20.393726 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-c35039f5-ae64-4714-80c0-2c5a305f7f8a tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:20.395725 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-c35039f5-ae64-4714-80c0-2c5a305f7f8a tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:20.401817 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-c35039f5-ae64-4714-80c0-2c5a305f7f8a tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] 10.222.0.58 "GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6" status: 200 len: 1847 microversion: 2.42 time: 0.567114 Aug 10 23:26:20.402852 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2600/5421] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:26:19 2022] GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6 => generated 1847 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:26:20.597159 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-39e9075e-a207-4f6e-9603-f39f7fdd540a req-057301d7-77b3-4f89-ae7a-96e3adde8da6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03e88a01-d3ed-4ab2-a334-f4bc274fe800", "name": "network-vif-unplugged", "status": "completed", "tag": "7481f052-393a-446e-bc21-7be34657945e"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:26:20.620354 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-39e9075e-a207-4f6e-9603-f39f7fdd540a req-057301d7-77b3-4f89-ae7a-96e3adde8da6 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:20.620862 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-39e9075e-a207-4f6e-9603-f39f7fdd540a req-057301d7-77b3-4f89-ae7a-96e3adde8da6 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:20.621310 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-39e9075e-a207-4f6e-9603-f39f7fdd540a req-057301d7-77b3-4f89-ae7a-96e3adde8da6 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:20.651254 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.compute.server_external_events [req-39e9075e-a207-4f6e-9603-f39f7fdd540a req-057301d7-77b3-4f89-ae7a-96e3adde8da6 service nova] Unable to find a host for instance 03e88a01-d3ed-4ab2-a334-f4bc274fe800. Dropping event network-vif-unplugged {{(pid=122632) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 10 23:26:20.652237 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-39e9075e-a207-4f6e-9603-f39f7fdd540a req-057301d7-77b3-4f89-ae7a-96e3adde8da6 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.059794 Aug 10 23:26:20.653182 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2601/5422] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:26:20 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 61 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 10 23:26:21.134176 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-62bb9912-f66f-49d9-91ce-28906794417b tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:21.176850 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-62bb9912-f66f-49d9-91ce-28906794417b tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:21.182493 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-62bb9912-f66f-49d9-91ce-28906794417b tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:21.189109 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-62bb9912-f66f-49d9-91ce-28906794417b tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800" status: 200 len: 1665 microversion: 2.20 time: 0.869498 Aug 10 23:26:21.193114 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2822/5423] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:26:20 2022] GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800 => generated 1665 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:26:21.219492 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-88c61646-b2e4-4704-a63f-0f762653cb44 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6a48a73d-a806-49d0-9dd3-e5c8fb4f0d74"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:26:21.223065 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-88c61646-b2e4-4704-a63f-0f762653cb44 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: 03e88a01-d3ed-4ab2-a334-f4bc274fe800] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:26:21.234877 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-88c61646-b2e4-4704-a63f-0f762653cb44 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:21.235539 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-88c61646-b2e4-4704-a63f-0f762653cb44 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:21.236148 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-88c61646-b2e4-4704-a63f-0f762653cb44 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:21.237096 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-88c61646-b2e4-4704-a63f-0f762653cb44 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:21.237723 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-88c61646-b2e4-4704-a63f-0f762653cb44 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:21.239610 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-88c61646-b2e4-4704-a63f-0f762653cb44 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:21.430357 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-8cb8fccb-96c0-4b67-a497-7f6c624c116e tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:26:21.431761 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-8cb8fccb-96c0-4b67-a497-7f6c624c116e tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] [instance: 94831c62-29a5-4745-b321-11b28dafaaa6] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:26:21.463005 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8cb8fccb-96c0-4b67-a497-7f6c624c116e tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:21.466522 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8cb8fccb-96c0-4b67-a497-7f6c624c116e tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:21.467293 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8cb8fccb-96c0-4b67-a497-7f6c624c116e tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:21.472214 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8cb8fccb-96c0-4b67-a497-7f6c624c116e tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:21.473477 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8cb8fccb-96c0-4b67-a497-7f6c624c116e tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:21.475409 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8cb8fccb-96c0-4b67-a497-7f6c624c116e tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:21.893459 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-8cb8fccb-96c0-4b67-a497-7f6c624c116e tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:21.909839 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-8cb8fccb-96c0-4b67-a497-7f6c624c116e tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:21.915110 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-8cb8fccb-96c0-4b67-a497-7f6c624c116e tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:21.919683 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-8cb8fccb-96c0-4b67-a497-7f6c624c116e tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] 10.222.0.58 "GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6" status: 200 len: 1847 microversion: 2.42 time: 0.497453 Aug 10 23:26:21.922257 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2823/5424] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:26:21 2022] GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6 => generated 1847 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:26:21.923132 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-88c61646-b2e4-4704-a63f-0f762653cb44 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "POST /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.709652 Aug 10 23:26:21.929958 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2602/5425] 10.222.0.58 () {62 vars in 1364 bytes} [Wed Aug 10 23:26:21 2022] POST /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800/os-volume_attachments => generated 188 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 23:26:22.133067 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-10e5eacd-270c-43eb-82cc-7e71c08c3577 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:26:22.135064 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-10e5eacd-270c-43eb-82cc-7e71c08c3577 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: 03e88a01-d3ed-4ab2-a334-f4bc274fe800] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:26:22.146734 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-10e5eacd-270c-43eb-82cc-7e71c08c3577 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:22.148332 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-10e5eacd-270c-43eb-82cc-7e71c08c3577 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:22.148901 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-10e5eacd-270c-43eb-82cc-7e71c08c3577 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:22.150807 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-10e5eacd-270c-43eb-82cc-7e71c08c3577 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:22.151579 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-10e5eacd-270c-43eb-82cc-7e71c08c3577 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:22.152240 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-10e5eacd-270c-43eb-82cc-7e71c08c3577 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:22.195727 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-10e5eacd-270c-43eb-82cc-7e71c08c3577 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: 03e88a01-d3ed-4ab2-a334-f4bc274fe800] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=122633) unshelve /opt/stack/nova/nova/compute/api.py:4544}} Aug 10 23:26:22.298983 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-10e5eacd-270c-43eb-82cc-7e71c08c3577 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "POST /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800/action" status: 202 len: 0 microversion: 2.20 time: 0.171303 Aug 10 23:26:22.300691 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2824/5426] 10.222.0.58 () {62 vars in 1319 bytes} [Wed Aug 10 23:26:22 2022] POST /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800/action => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:26:22.309708 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-71851866-7d9c-4f9c-888a-47f0dfb3843a tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:26:22.310237 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-71851866-7d9c-4f9c-888a-47f0dfb3843a tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: 03e88a01-d3ed-4ab2-a334-f4bc274fe800] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:26:22.329398 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-71851866-7d9c-4f9c-888a-47f0dfb3843a tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:22.333066 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-71851866-7d9c-4f9c-888a-47f0dfb3843a tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:22.333545 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-71851866-7d9c-4f9c-888a-47f0dfb3843a tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:22.334295 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-71851866-7d9c-4f9c-888a-47f0dfb3843a tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:22.334761 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-71851866-7d9c-4f9c-888a-47f0dfb3843a tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:22.335222 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-71851866-7d9c-4f9c-888a-47f0dfb3843a tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:22.713196 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-374a4825-a853-4a35-b176-ada2d69ef418 req-81f457e2-853d-4028-8d28-fb95f092b52f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94831c62-29a5-4745-b321-11b28dafaaa6", "tag": "6ee28c71-7f46-4357-91a2-e3f81d338784"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:26:22.740135 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-374a4825-a853-4a35-b176-ada2d69ef418 req-81f457e2-853d-4028-8d28-fb95f092b52f service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:22.740740 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-374a4825-a853-4a35-b176-ada2d69ef418 req-81f457e2-853d-4028-8d28-fb95f092b52f service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:22.741194 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-374a4825-a853-4a35-b176-ada2d69ef418 req-81f457e2-853d-4028-8d28-fb95f092b52f service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:22.766699 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-374a4825-a853-4a35-b176-ada2d69ef418 req-81f457e2-853d-4028-8d28-fb95f092b52f service nova] Creating event network-changed:6ee28c71-7f46-4357-91a2-e3f81d338784 for instance 94831c62-29a5-4745-b321-11b28dafaaa6 on n-h2-850468-14 Aug 10 23:26:22.773962 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-374a4825-a853-4a35-b176-ada2d69ef418 req-81f457e2-853d-4028-8d28-fb95f092b52f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065900 Aug 10 23:26:22.774585 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2825/5427] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:26:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:26:22.946455 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-01257b87-e067-4a5f-a26f-dc155fafdfe2 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:26:22.947180 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-01257b87-e067-4a5f-a26f-dc155fafdfe2 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] [instance: 94831c62-29a5-4745-b321-11b28dafaaa6] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:26:22.960439 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-01257b87-e067-4a5f-a26f-dc155fafdfe2 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:22.960981 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-01257b87-e067-4a5f-a26f-dc155fafdfe2 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:22.961943 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-01257b87-e067-4a5f-a26f-dc155fafdfe2 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:22.962675 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-01257b87-e067-4a5f-a26f-dc155fafdfe2 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:22.967175 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-01257b87-e067-4a5f-a26f-dc155fafdfe2 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:22.968228 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-01257b87-e067-4a5f-a26f-dc155fafdfe2 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:22.981613 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:26:23.429280 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-71851866-7d9c-4f9c-888a-47f0dfb3843a tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:23.450710 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-71851866-7d9c-4f9c-888a-47f0dfb3843a tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:23.456535 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-71851866-7d9c-4f9c-888a-47f0dfb3843a tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:23.465247 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-71851866-7d9c-4f9c-888a-47f0dfb3843a tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800" status: 200 len: 1751 microversion: 2.20 time: 1.155131 Aug 10 23:26:23.466480 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2603/5428] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:26:22 2022] GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800 => generated 1751 bytes in 1162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 23:26:23.752832 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-01257b87-e067-4a5f-a26f-dc155fafdfe2 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:23.769104 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-01257b87-e067-4a5f-a26f-dc155fafdfe2 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:23.776420 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-01257b87-e067-4a5f-a26f-dc155fafdfe2 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:23.780822 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-01257b87-e067-4a5f-a26f-dc155fafdfe2 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] 10.222.0.58 "GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6" status: 200 len: 1847 microversion: 2.42 time: 0.838319 Aug 10 23:26:23.799880 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2826/5429] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:26:22 2022] GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6 => generated 1847 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:26:24.494709 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-fa4f6ec8-83c4-4862-b7db-d1fd6f65be4e tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:26:24.496579 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-fa4f6ec8-83c4-4862-b7db-d1fd6f65be4e tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: 03e88a01-d3ed-4ab2-a334-f4bc274fe800] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:26:24.514269 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_api:SELECT=38 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:26:24.519782 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fa4f6ec8-83c4-4862-b7db-d1fd6f65be4e tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:24.521873 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fa4f6ec8-83c4-4862-b7db-d1fd6f65be4e tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:24.526505 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fa4f6ec8-83c4-4862-b7db-d1fd6f65be4e tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:24.527662 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fa4f6ec8-83c4-4862-b7db-d1fd6f65be4e tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:24.528575 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fa4f6ec8-83c4-4862-b7db-d1fd6f65be4e tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:24.531374 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fa4f6ec8-83c4-4862-b7db-d1fd6f65be4e tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:24.814428 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-4beb8f5f-ec2f-4197-aee3-93b4dcc76e96 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:26:24.815677 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-4beb8f5f-ec2f-4197-aee3-93b4dcc76e96 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] [instance: 94831c62-29a5-4745-b321-11b28dafaaa6] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:26:24.830443 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4beb8f5f-ec2f-4197-aee3-93b4dcc76e96 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:24.834605 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4beb8f5f-ec2f-4197-aee3-93b4dcc76e96 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:24.835531 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4beb8f5f-ec2f-4197-aee3-93b4dcc76e96 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:24.836623 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4beb8f5f-ec2f-4197-aee3-93b4dcc76e96 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:24.839210 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4beb8f5f-ec2f-4197-aee3-93b4dcc76e96 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:24.839862 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4beb8f5f-ec2f-4197-aee3-93b4dcc76e96 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:25.255730 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-4beb8f5f-ec2f-4197-aee3-93b4dcc76e96 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:25.269098 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-4beb8f5f-ec2f-4197-aee3-93b4dcc76e96 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:25.277013 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-4beb8f5f-ec2f-4197-aee3-93b4dcc76e96 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:25.278723 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-4beb8f5f-ec2f-4197-aee3-93b4dcc76e96 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] 10.222.0.58 "GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6" status: 200 len: 1868 microversion: 2.42 time: 0.469332 Aug 10 23:26:25.291296 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2827/5430] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:26:24 2022] GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6 => generated 1868 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:26:25.462049 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-fa4f6ec8-83c4-4862-b7db-d1fd6f65be4e tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:25.474367 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-fa4f6ec8-83c4-4862-b7db-d1fd6f65be4e tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:25.482330 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-fa4f6ec8-83c4-4862-b7db-d1fd6f65be4e tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:25.484417 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-fa4f6ec8-83c4-4862-b7db-d1fd6f65be4e tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800" status: 200 len: 1751 microversion: 2.20 time: 0.998831 Aug 10 23:26:25.485067 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2604/5431] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:26:24 2022] GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800 => generated 1751 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:26:26.152982 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-5955b2ce-d726-4d5b-9b27-08aa94a05491 req-33783f5f-3054-4e8b-be9b-0e0aa3bbfe04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94831c62-29a5-4745-b321-11b28dafaaa6", "tag": "ed350d10-8d47-46e3-bde8-9f8f5eaad3a6"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:26:26.172792 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-5955b2ce-d726-4d5b-9b27-08aa94a05491 req-33783f5f-3054-4e8b-be9b-0e0aa3bbfe04 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:26.190165 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-5955b2ce-d726-4d5b-9b27-08aa94a05491 req-33783f5f-3054-4e8b-be9b-0e0aa3bbfe04 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:26.191050 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-5955b2ce-d726-4d5b-9b27-08aa94a05491 req-33783f5f-3054-4e8b-be9b-0e0aa3bbfe04 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:26.223400 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-5955b2ce-d726-4d5b-9b27-08aa94a05491 req-33783f5f-3054-4e8b-be9b-0e0aa3bbfe04 service nova] Creating event network-changed:ed350d10-8d47-46e3-bde8-9f8f5eaad3a6 for instance 94831c62-29a5-4745-b321-11b28dafaaa6 on n-h2-850468-14 Aug 10 23:26:26.229045 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-5955b2ce-d726-4d5b-9b27-08aa94a05491 req-33783f5f-3054-4e8b-be9b-0e0aa3bbfe04 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079868 Aug 10 23:26:26.230449 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2828/5432] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:26:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:26:26.304819 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-9e4c449f-718b-45c7-aa3b-12e874a126fe tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:26:26.306029 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-9e4c449f-718b-45c7-aa3b-12e874a126fe tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] [instance: 94831c62-29a5-4745-b321-11b28dafaaa6] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:26:26.317519 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9e4c449f-718b-45c7-aa3b-12e874a126fe tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:26.320439 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9e4c449f-718b-45c7-aa3b-12e874a126fe tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:26.321118 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9e4c449f-718b-45c7-aa3b-12e874a126fe tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:26.321997 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9e4c449f-718b-45c7-aa3b-12e874a126fe tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:26.324440 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9e4c449f-718b-45c7-aa3b-12e874a126fe tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:26.326097 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9e4c449f-718b-45c7-aa3b-12e874a126fe tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:26.510335 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-ce3bceab-6465-44a3-a1c5-87c56a90354f tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:26:26.511056 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-ce3bceab-6465-44a3-a1c5-87c56a90354f tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: 03e88a01-d3ed-4ab2-a334-f4bc274fe800] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:26:26.524796 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ce3bceab-6465-44a3-a1c5-87c56a90354f tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:26.525287 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ce3bceab-6465-44a3-a1c5-87c56a90354f tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:26.525720 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ce3bceab-6465-44a3-a1c5-87c56a90354f tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:26.526422 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ce3bceab-6465-44a3-a1c5-87c56a90354f tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:26.527077 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ce3bceab-6465-44a3-a1c5-87c56a90354f tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:26.527663 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ce3bceab-6465-44a3-a1c5-87c56a90354f tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:26.912970 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-ce3bceab-6465-44a3-a1c5-87c56a90354f tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:26.928480 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-ce3bceab-6465-44a3-a1c5-87c56a90354f tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:26.930085 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-ce3bceab-6465-44a3-a1c5-87c56a90354f tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:26.931390 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-ce3bceab-6465-44a3-a1c5-87c56a90354f tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800" status: 200 len: 1753 microversion: 2.20 time: 0.425462 Aug 10 23:26:26.931951 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2829/5433] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:26:26 2022] GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800 => generated 1753 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 23:26:27.270352 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-9e4c449f-718b-45c7-aa3b-12e874a126fe tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:27.281104 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-9e4c449f-718b-45c7-aa3b-12e874a126fe tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:27.283097 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-9e4c449f-718b-45c7-aa3b-12e874a126fe tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:27.284526 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-9e4c449f-718b-45c7-aa3b-12e874a126fe tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] 10.222.0.58 "GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6" status: 200 len: 1868 microversion: 2.42 time: 0.984197 Aug 10 23:26:27.285724 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2605/5434] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:26:26 2022] GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6 => generated 1868 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:26:27.961059 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-225deefa-7da8-49c3-a4a5-67f2e61e3c5a tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:26:27.962575 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-225deefa-7da8-49c3-a4a5-67f2e61e3c5a tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: 03e88a01-d3ed-4ab2-a334-f4bc274fe800] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:26:27.970951 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:26:27.973557 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-225deefa-7da8-49c3-a4a5-67f2e61e3c5a tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:27.974617 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-225deefa-7da8-49c3-a4a5-67f2e61e3c5a tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:27.975255 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-225deefa-7da8-49c3-a4a5-67f2e61e3c5a tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:27.976251 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-225deefa-7da8-49c3-a4a5-67f2e61e3c5a tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:27.977313 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-225deefa-7da8-49c3-a4a5-67f2e61e3c5a tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:27.977911 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-225deefa-7da8-49c3-a4a5-67f2e61e3c5a tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:28.322119 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-225deefa-7da8-49c3-a4a5-67f2e61e3c5a tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:28.336258 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-728fdd2f-54d2-437f-ad3a-1174301a7287 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:26:28.342976 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-728fdd2f-54d2-437f-ad3a-1174301a7287 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] [instance: 94831c62-29a5-4745-b321-11b28dafaaa6] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:26:28.370194 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-225deefa-7da8-49c3-a4a5-67f2e61e3c5a tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:28.376762 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-728fdd2f-54d2-437f-ad3a-1174301a7287 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:28.380861 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-225deefa-7da8-49c3-a4a5-67f2e61e3c5a tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:28.384266 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-225deefa-7da8-49c3-a4a5-67f2e61e3c5a tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800" status: 200 len: 1753 microversion: 2.20 time: 0.429854 Aug 10 23:26:28.384865 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2830/5435] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:26:27 2022] GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800 => generated 1753 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:26:28.385275 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-728fdd2f-54d2-437f-ad3a-1174301a7287 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:28.385854 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-728fdd2f-54d2-437f-ad3a-1174301a7287 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:28.386721 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-728fdd2f-54d2-437f-ad3a-1174301a7287 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:28.390200 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-728fdd2f-54d2-437f-ad3a-1174301a7287 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:28.390862 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-728fdd2f-54d2-437f-ad3a-1174301a7287 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:28.751652 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-728fdd2f-54d2-437f-ad3a-1174301a7287 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:28.764679 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-728fdd2f-54d2-437f-ad3a-1174301a7287 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:28.771825 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-728fdd2f-54d2-437f-ad3a-1174301a7287 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:28.776586 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-728fdd2f-54d2-437f-ad3a-1174301a7287 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] 10.222.0.58 "GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6" status: 200 len: 1877 microversion: 2.42 time: 0.470114 Aug 10 23:26:28.778041 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2606/5436] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:26:28 2022] GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6 => generated 1877 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 23:26:28.813770 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-d0cac220-4fee-4e65-bab2-a4e6c5bc6be5 req-6c40cbc2-305c-4962-9310-5bde8f6d4278 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94831c62-29a5-4745-b321-11b28dafaaa6", "tag": "331b6d87-c1d3-4591-bc0e-3825a4fc234e"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:26:28.840955 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-d0cac220-4fee-4e65-bab2-a4e6c5bc6be5 req-6c40cbc2-305c-4962-9310-5bde8f6d4278 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:28.841656 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-d0cac220-4fee-4e65-bab2-a4e6c5bc6be5 req-6c40cbc2-305c-4962-9310-5bde8f6d4278 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:28.843324 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-d0cac220-4fee-4e65-bab2-a4e6c5bc6be5 req-6c40cbc2-305c-4962-9310-5bde8f6d4278 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:28.868097 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-d0cac220-4fee-4e65-bab2-a4e6c5bc6be5 req-6c40cbc2-305c-4962-9310-5bde8f6d4278 service nova] Creating event network-changed:331b6d87-c1d3-4591-bc0e-3825a4fc234e for instance 94831c62-29a5-4745-b321-11b28dafaaa6 on n-h2-850468-14 Aug 10 23:26:28.882963 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-d0cac220-4fee-4e65-bab2-a4e6c5bc6be5 req-6c40cbc2-305c-4962-9310-5bde8f6d4278 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072679 Aug 10 23:26:28.885886 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2831/5437] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:26:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:26:29.429306 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-1e5bf4c2-979a-4eec-aaba-38f4c216c560 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:26:29.430111 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-1e5bf4c2-979a-4eec-aaba-38f4c216c560 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: 03e88a01-d3ed-4ab2-a334-f4bc274fe800] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:26:29.446311 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1e5bf4c2-979a-4eec-aaba-38f4c216c560 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:29.448772 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1e5bf4c2-979a-4eec-aaba-38f4c216c560 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:29.449867 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1e5bf4c2-979a-4eec-aaba-38f4c216c560 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:29.453784 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1e5bf4c2-979a-4eec-aaba-38f4c216c560 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:29.454591 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1e5bf4c2-979a-4eec-aaba-38f4c216c560 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:29.455283 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1e5bf4c2-979a-4eec-aaba-38f4c216c560 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:29.807704 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-ca44b907-d949-440e-90cd-d505e782a59d tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:26:29.809127 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-ca44b907-d949-440e-90cd-d505e782a59d tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] [instance: 94831c62-29a5-4745-b321-11b28dafaaa6] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:26:29.825848 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ca44b907-d949-440e-90cd-d505e782a59d tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:29.827335 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ca44b907-d949-440e-90cd-d505e782a59d tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:29.828506 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ca44b907-d949-440e-90cd-d505e782a59d tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:29.829731 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ca44b907-d949-440e-90cd-d505e782a59d tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:29.831933 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ca44b907-d949-440e-90cd-d505e782a59d tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:29.840168 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ca44b907-d949-440e-90cd-d505e782a59d tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:30.148550 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-1e5bf4c2-979a-4eec-aaba-38f4c216c560 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:30.174610 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-1e5bf4c2-979a-4eec-aaba-38f4c216c560 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:30.176778 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-1e5bf4c2-979a-4eec-aaba-38f4c216c560 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:30.179355 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-1e5bf4c2-979a-4eec-aaba-38f4c216c560 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800" status: 200 len: 1753 microversion: 2.20 time: 0.754660 Aug 10 23:26:30.207647 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2607/5438] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:26:29 2022] GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800 => generated 1753 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:26:30.370644 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-ca44b907-d949-440e-90cd-d505e782a59d tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:30.383898 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-ca44b907-d949-440e-90cd-d505e782a59d tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:30.386869 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-ca44b907-d949-440e-90cd-d505e782a59d tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:30.390042 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-ca44b907-d949-440e-90cd-d505e782a59d tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] 10.222.0.58 "GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6" status: 200 len: 1877 microversion: 2.42 time: 0.586647 Aug 10 23:26:30.391995 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2832/5439] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:26:29 2022] GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6 => generated 1877 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:26:30.927978 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-ad5b1268-4343-4f11-8502-40108abef77b req-2c003fa5-d06e-4b54-af04-991a37e314c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94831c62-29a5-4745-b321-11b28dafaaa6", "tag": "cd619ffb-72c7-4f4d-88b0-2923eb1f3d04"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:26:30.959272 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-ad5b1268-4343-4f11-8502-40108abef77b req-2c003fa5-d06e-4b54-af04-991a37e314c9 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:30.960133 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-ad5b1268-4343-4f11-8502-40108abef77b req-2c003fa5-d06e-4b54-af04-991a37e314c9 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:30.963602 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-ad5b1268-4343-4f11-8502-40108abef77b req-2c003fa5-d06e-4b54-af04-991a37e314c9 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:31.001968 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-ad5b1268-4343-4f11-8502-40108abef77b req-2c003fa5-d06e-4b54-af04-991a37e314c9 service nova] Creating event network-changed:cd619ffb-72c7-4f4d-88b0-2923eb1f3d04 for instance 94831c62-29a5-4745-b321-11b28dafaaa6 on n-h2-850468-14 Aug 10 23:26:31.021317 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-ad5b1268-4343-4f11-8502-40108abef77b req-2c003fa5-d06e-4b54-af04-991a37e314c9 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097039 Aug 10 23:26:31.024486 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2608/5440] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:26:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:26:31.214004 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-3159cc70-99e4-446e-8c48-8eaf0b402cd2 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:26:31.215238 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-3159cc70-99e4-446e-8c48-8eaf0b402cd2 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: 03e88a01-d3ed-4ab2-a334-f4bc274fe800] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:26:31.232609 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3159cc70-99e4-446e-8c48-8eaf0b402cd2 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:31.233938 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3159cc70-99e4-446e-8c48-8eaf0b402cd2 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:31.234544 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3159cc70-99e4-446e-8c48-8eaf0b402cd2 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:31.235477 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3159cc70-99e4-446e-8c48-8eaf0b402cd2 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:31.236086 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3159cc70-99e4-446e-8c48-8eaf0b402cd2 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:31.236665 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3159cc70-99e4-446e-8c48-8eaf0b402cd2 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:31.416825 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-3f274d8a-1076-46d6-a559-62633d6dd186 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:26:31.417968 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-3f274d8a-1076-46d6-a559-62633d6dd186 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] [instance: 94831c62-29a5-4745-b321-11b28dafaaa6] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:26:31.431859 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3f274d8a-1076-46d6-a559-62633d6dd186 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:31.432361 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3f274d8a-1076-46d6-a559-62633d6dd186 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:31.432803 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3f274d8a-1076-46d6-a559-62633d6dd186 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:31.433509 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3f274d8a-1076-46d6-a559-62633d6dd186 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:31.435333 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3f274d8a-1076-46d6-a559-62633d6dd186 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:31.438870 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3f274d8a-1076-46d6-a559-62633d6dd186 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:31.754212 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-3159cc70-99e4-446e-8c48-8eaf0b402cd2 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:31.763153 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-3159cc70-99e4-446e-8c48-8eaf0b402cd2 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:31.767655 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-3159cc70-99e4-446e-8c48-8eaf0b402cd2 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:31.769138 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-3159cc70-99e4-446e-8c48-8eaf0b402cd2 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800" status: 200 len: 1753 microversion: 2.20 time: 0.563984 Aug 10 23:26:31.770171 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2833/5441] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:26:31 2022] GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800 => generated 1753 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:26:32.062279 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-3f274d8a-1076-46d6-a559-62633d6dd186 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:32.083149 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-3f274d8a-1076-46d6-a559-62633d6dd186 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:32.089982 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-3f274d8a-1076-46d6-a559-62633d6dd186 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:32.107931 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-3f274d8a-1076-46d6-a559-62633d6dd186 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] 10.222.0.58 "GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6" status: 200 len: 1877 microversion: 2.42 time: 0.693409 Aug 10 23:26:32.108809 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2609/5442] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:26:31 2022] GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6 => generated 1877 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:26:32.794211 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-eb9a9fa8-7ce0-4d8a-9f71-95d8d2d6ca0e tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:26:32.795866 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-eb9a9fa8-7ce0-4d8a-9f71-95d8d2d6ca0e tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: 03e88a01-d3ed-4ab2-a334-f4bc274fe800] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:26:32.812553 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-eb9a9fa8-7ce0-4d8a-9f71-95d8d2d6ca0e tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:32.813486 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-eb9a9fa8-7ce0-4d8a-9f71-95d8d2d6ca0e tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:32.814098 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-eb9a9fa8-7ce0-4d8a-9f71-95d8d2d6ca0e tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:32.815011 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-eb9a9fa8-7ce0-4d8a-9f71-95d8d2d6ca0e tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:32.815987 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-eb9a9fa8-7ce0-4d8a-9f71-95d8d2d6ca0e tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:32.816580 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-eb9a9fa8-7ce0-4d8a-9f71-95d8d2d6ca0e tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:33.147200 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-35acc317-4a4f-4862-a926-553777c52418 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:26:33.149137 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-35acc317-4a4f-4862-a926-553777c52418 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] [instance: 94831c62-29a5-4745-b321-11b28dafaaa6] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:26:33.168314 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-eb9a9fa8-7ce0-4d8a-9f71-95d8d2d6ca0e tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:33.168965 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-35acc317-4a4f-4862-a926-553777c52418 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:33.169606 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-35acc317-4a4f-4862-a926-553777c52418 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:33.170902 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-35acc317-4a4f-4862-a926-553777c52418 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:33.172534 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-35acc317-4a4f-4862-a926-553777c52418 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:33.173398 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-35acc317-4a4f-4862-a926-553777c52418 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:33.173990 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-35acc317-4a4f-4862-a926-553777c52418 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:33.193745 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-eb9a9fa8-7ce0-4d8a-9f71-95d8d2d6ca0e tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:33.197567 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-eb9a9fa8-7ce0-4d8a-9f71-95d8d2d6ca0e tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:33.199693 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-eb9a9fa8-7ce0-4d8a-9f71-95d8d2d6ca0e tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800" status: 200 len: 1753 microversion: 2.20 time: 0.410398 Aug 10 23:26:33.204460 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2834/5443] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:26:32 2022] GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800 => generated 1753 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 23:26:33.224760 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-4fabbafa-8773-406c-b2bb-09d9151d5937 req-186c88ad-05b6-46a1-a235-f22f7f7e043d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94831c62-29a5-4745-b321-11b28dafaaa6", "tag": "c9cab9a2-351a-4700-9d8b-f72f4f00057f"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:26:33.243387 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-4fabbafa-8773-406c-b2bb-09d9151d5937 req-186c88ad-05b6-46a1-a235-f22f7f7e043d service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:33.243966 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-4fabbafa-8773-406c-b2bb-09d9151d5937 req-186c88ad-05b6-46a1-a235-f22f7f7e043d service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:33.244422 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-4fabbafa-8773-406c-b2bb-09d9151d5937 req-186c88ad-05b6-46a1-a235-f22f7f7e043d service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:33.271881 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-4fabbafa-8773-406c-b2bb-09d9151d5937 req-186c88ad-05b6-46a1-a235-f22f7f7e043d service nova] Creating event network-changed:c9cab9a2-351a-4700-9d8b-f72f4f00057f for instance 94831c62-29a5-4745-b321-11b28dafaaa6 on n-h2-850468-14 Aug 10 23:26:33.281848 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-4fabbafa-8773-406c-b2bb-09d9151d5937 req-186c88ad-05b6-46a1-a235-f22f7f7e043d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061476 Aug 10 23:26:33.284869 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2835/5444] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:26:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 23:26:33.952050 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-35acc317-4a4f-4862-a926-553777c52418 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:33.962404 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-35acc317-4a4f-4862-a926-553777c52418 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:33.971053 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-35acc317-4a4f-4862-a926-553777c52418 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:33.972282 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-35acc317-4a4f-4862-a926-553777c52418 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] 10.222.0.58 "GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6" status: 200 len: 1877 microversion: 2.42 time: 0.842363 Aug 10 23:26:33.980421 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2610/5445] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:26:33 2022] GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6 => generated 1877 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:26:34.230011 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-23d60f7a-63e9-4382-8146-0dbd155c7772 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:26:34.230721 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-23d60f7a-63e9-4382-8146-0dbd155c7772 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: 03e88a01-d3ed-4ab2-a334-f4bc274fe800] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:26:34.273125 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-23d60f7a-63e9-4382-8146-0dbd155c7772 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:34.273635 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-23d60f7a-63e9-4382-8146-0dbd155c7772 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:34.274083 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-23d60f7a-63e9-4382-8146-0dbd155c7772 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:34.284886 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-23d60f7a-63e9-4382-8146-0dbd155c7772 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:34.285405 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-23d60f7a-63e9-4382-8146-0dbd155c7772 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:34.285860 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-23d60f7a-63e9-4382-8146-0dbd155c7772 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:34.711435 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-23d60f7a-63e9-4382-8146-0dbd155c7772 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:34.723130 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-23d60f7a-63e9-4382-8146-0dbd155c7772 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:34.728605 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-23d60f7a-63e9-4382-8146-0dbd155c7772 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:34.731488 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-23d60f7a-63e9-4382-8146-0dbd155c7772 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800" status: 200 len: 1753 microversion: 2.20 time: 0.504436 Aug 10 23:26:34.735053 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2836/5446] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:26:34 2022] GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800 => generated 1753 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:26:35.005560 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-f87ccf9a-0052-49d9-b3da-8ffdd4716ba4 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:26:35.007083 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-f87ccf9a-0052-49d9-b3da-8ffdd4716ba4 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] [instance: 94831c62-29a5-4745-b321-11b28dafaaa6] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:26:35.018305 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f87ccf9a-0052-49d9-b3da-8ffdd4716ba4 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:35.018826 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f87ccf9a-0052-49d9-b3da-8ffdd4716ba4 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:35.019271 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f87ccf9a-0052-49d9-b3da-8ffdd4716ba4 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:35.020256 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f87ccf9a-0052-49d9-b3da-8ffdd4716ba4 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:35.021021 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f87ccf9a-0052-49d9-b3da-8ffdd4716ba4 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:35.021604 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f87ccf9a-0052-49d9-b3da-8ffdd4716ba4 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:35.351002 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-4d302681-15e6-4ae4-9753-af71e7d3062f req-60c136ba-1f01-43ff-b6f9-dc982c6aa25e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94831c62-29a5-4745-b321-11b28dafaaa6", "tag": "4ea7c095-71fb-40ed-b707-b71bba302403"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:26:35.365393 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-4d302681-15e6-4ae4-9753-af71e7d3062f req-60c136ba-1f01-43ff-b6f9-dc982c6aa25e service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:35.366161 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-4d302681-15e6-4ae4-9753-af71e7d3062f req-60c136ba-1f01-43ff-b6f9-dc982c6aa25e service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:35.366840 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-4d302681-15e6-4ae4-9753-af71e7d3062f req-60c136ba-1f01-43ff-b6f9-dc982c6aa25e service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:35.386176 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-4d302681-15e6-4ae4-9753-af71e7d3062f req-60c136ba-1f01-43ff-b6f9-dc982c6aa25e service nova] Creating event network-changed:4ea7c095-71fb-40ed-b707-b71bba302403 for instance 94831c62-29a5-4745-b321-11b28dafaaa6 on n-h2-850468-14 Aug 10 23:26:35.408502 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-4d302681-15e6-4ae4-9753-af71e7d3062f req-60c136ba-1f01-43ff-b6f9-dc982c6aa25e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061668 Aug 10 23:26:35.410376 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2837/5447] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:26:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:26:35.701605 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-f87ccf9a-0052-49d9-b3da-8ffdd4716ba4 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:35.728755 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-f87ccf9a-0052-49d9-b3da-8ffdd4716ba4 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:35.730458 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-f87ccf9a-0052-49d9-b3da-8ffdd4716ba4 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:35.739293 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-f87ccf9a-0052-49d9-b3da-8ffdd4716ba4 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] 10.222.0.58 "GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6" status: 200 len: 1877 microversion: 2.42 time: 0.735605 Aug 10 23:26:35.739942 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2611/5448] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:26:35 2022] GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6 => generated 1877 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:26:35.762647 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-e66c8993-50c9-4f8e-8940-b7569beef2f1 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:26:35.764908 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-e66c8993-50c9-4f8e-8940-b7569beef2f1 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: 03e88a01-d3ed-4ab2-a334-f4bc274fe800] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:26:35.780706 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e66c8993-50c9-4f8e-8940-b7569beef2f1 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:35.783780 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e66c8993-50c9-4f8e-8940-b7569beef2f1 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:35.784494 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e66c8993-50c9-4f8e-8940-b7569beef2f1 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:35.788626 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e66c8993-50c9-4f8e-8940-b7569beef2f1 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:35.789673 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e66c8993-50c9-4f8e-8940-b7569beef2f1 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:35.790351 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e66c8993-50c9-4f8e-8940-b7569beef2f1 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:36.208499 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-e66c8993-50c9-4f8e-8940-b7569beef2f1 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:36.222513 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-e66c8993-50c9-4f8e-8940-b7569beef2f1 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:36.224985 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-e66c8993-50c9-4f8e-8940-b7569beef2f1 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:36.230188 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-e66c8993-50c9-4f8e-8940-b7569beef2f1 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800" status: 200 len: 1753 microversion: 2.20 time: 0.472807 Aug 10 23:26:36.235095 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2838/5449] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:26:35 2022] GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800 => generated 1753 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:26:36.768072 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-dae7dd37-9a4d-4ca0-b266-0d01b1294a39 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:26:36.769672 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-dae7dd37-9a4d-4ca0-b266-0d01b1294a39 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] [instance: 94831c62-29a5-4745-b321-11b28dafaaa6] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:26:36.802017 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dae7dd37-9a4d-4ca0-b266-0d01b1294a39 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:36.802617 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dae7dd37-9a4d-4ca0-b266-0d01b1294a39 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:36.803262 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dae7dd37-9a4d-4ca0-b266-0d01b1294a39 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:36.805613 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dae7dd37-9a4d-4ca0-b266-0d01b1294a39 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:36.806533 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dae7dd37-9a4d-4ca0-b266-0d01b1294a39 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:36.807513 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dae7dd37-9a4d-4ca0-b266-0d01b1294a39 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:37.269280 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-874904ba-b002-4f7f-b7af-e6be443d15a9 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:26:37.270040 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-874904ba-b002-4f7f-b7af-e6be443d15a9 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: 03e88a01-d3ed-4ab2-a334-f4bc274fe800] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:26:37.282849 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-874904ba-b002-4f7f-b7af-e6be443d15a9 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:37.283478 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-874904ba-b002-4f7f-b7af-e6be443d15a9 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:37.284195 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-874904ba-b002-4f7f-b7af-e6be443d15a9 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:37.285172 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-874904ba-b002-4f7f-b7af-e6be443d15a9 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:37.286898 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-874904ba-b002-4f7f-b7af-e6be443d15a9 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:37.287582 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-874904ba-b002-4f7f-b7af-e6be443d15a9 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:37.392783 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-dae7dd37-9a4d-4ca0-b266-0d01b1294a39 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:37.411044 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-dae7dd37-9a4d-4ca0-b266-0d01b1294a39 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:37.413205 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-dae7dd37-9a4d-4ca0-b266-0d01b1294a39 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:37.418451 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-dae7dd37-9a4d-4ca0-b266-0d01b1294a39 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] 10.222.0.58 "GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6" status: 200 len: 1877 microversion: 2.42 time: 0.652134 Aug 10 23:26:37.436193 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2612/5450] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:26:36 2022] GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6 => generated 1877 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:26:37.494031 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-a2210612-f4aa-4649-9282-6f36b61e996c req-f9b099c7-cd10-4065-8cc3-7369a08656b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94831c62-29a5-4745-b321-11b28dafaaa6", "tag": "a925a35c-5deb-47db-b01a-bff542b92a26"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:26:37.538981 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-a2210612-f4aa-4649-9282-6f36b61e996c req-f9b099c7-cd10-4065-8cc3-7369a08656b0 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:37.539817 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-a2210612-f4aa-4649-9282-6f36b61e996c req-f9b099c7-cd10-4065-8cc3-7369a08656b0 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:37.540576 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-a2210612-f4aa-4649-9282-6f36b61e996c req-f9b099c7-cd10-4065-8cc3-7369a08656b0 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:37.565607 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-a2210612-f4aa-4649-9282-6f36b61e996c req-f9b099c7-cd10-4065-8cc3-7369a08656b0 service nova] Creating event network-changed:a925a35c-5deb-47db-b01a-bff542b92a26 for instance 94831c62-29a5-4745-b321-11b28dafaaa6 on n-h2-850468-14 Aug 10 23:26:37.577588 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-a2210612-f4aa-4649-9282-6f36b61e996c req-f9b099c7-cd10-4065-8cc3-7369a08656b0 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087723 Aug 10 23:26:37.581578 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2613/5451] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:26:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:26:37.728786 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-874904ba-b002-4f7f-b7af-e6be443d15a9 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:37.744640 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-874904ba-b002-4f7f-b7af-e6be443d15a9 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:37.747164 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-874904ba-b002-4f7f-b7af-e6be443d15a9 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:37.773506 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-874904ba-b002-4f7f-b7af-e6be443d15a9 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800" status: 200 len: 1753 microversion: 2.20 time: 0.507205 Aug 10 23:26:37.773506 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2839/5452] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:26:37 2022] GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800 => generated 1753 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 23:26:38.452762 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-64f13551-313d-40c8-9cfb-10fc9082bc9f tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:26:38.455679 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-64f13551-313d-40c8-9cfb-10fc9082bc9f tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] [instance: 94831c62-29a5-4745-b321-11b28dafaaa6] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:26:38.493063 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-64f13551-313d-40c8-9cfb-10fc9082bc9f tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:38.493563 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-64f13551-313d-40c8-9cfb-10fc9082bc9f tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:38.494008 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-64f13551-313d-40c8-9cfb-10fc9082bc9f tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:38.494719 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-64f13551-313d-40c8-9cfb-10fc9082bc9f tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:38.515516 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-64f13551-313d-40c8-9cfb-10fc9082bc9f tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:38.515983 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-64f13551-313d-40c8-9cfb-10fc9082bc9f tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:38.798982 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-2f24ceb4-482c-49f8-b856-8b4ef52cb965 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:26:38.799609 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-2f24ceb4-482c-49f8-b856-8b4ef52cb965 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: 03e88a01-d3ed-4ab2-a334-f4bc274fe800] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:26:38.814098 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2f24ceb4-482c-49f8-b856-8b4ef52cb965 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:38.814675 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2f24ceb4-482c-49f8-b856-8b4ef52cb965 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:38.816863 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2f24ceb4-482c-49f8-b856-8b4ef52cb965 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:38.819722 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2f24ceb4-482c-49f8-b856-8b4ef52cb965 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:38.820240 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2f24ceb4-482c-49f8-b856-8b4ef52cb965 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:38.822820 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2f24ceb4-482c-49f8-b856-8b4ef52cb965 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:39.276499 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-2f24ceb4-482c-49f8-b856-8b4ef52cb965 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:39.291106 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-2f24ceb4-482c-49f8-b856-8b4ef52cb965 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:39.292964 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-2f24ceb4-482c-49f8-b856-8b4ef52cb965 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:39.294269 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-2f24ceb4-482c-49f8-b856-8b4ef52cb965 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800" status: 200 len: 1753 microversion: 2.20 time: 0.500276 Aug 10 23:26:39.299473 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2840/5453] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:26:38 2022] GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800 => generated 1753 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:26:39.674884 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-64f13551-313d-40c8-9cfb-10fc9082bc9f tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:39.701554 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-64f13551-313d-40c8-9cfb-10fc9082bc9f tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:39.722207 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-64f13551-313d-40c8-9cfb-10fc9082bc9f tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:39.732208 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-64f13551-313d-40c8-9cfb-10fc9082bc9f tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] 10.222.0.58 "GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6" status: 200 len: 1877 microversion: 2.42 time: 1.285224 Aug 10 23:26:39.749441 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2614/5454] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:26:38 2022] GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6 => generated 1877 bytes in 1292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:26:40.320346 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-45ffbad9-4ff0-46f7-850f-1c3e702be291 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:26:40.322455 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-45ffbad9-4ff0-46f7-850f-1c3e702be291 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: 03e88a01-d3ed-4ab2-a334-f4bc274fe800] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:26:40.331411 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-45ffbad9-4ff0-46f7-850f-1c3e702be291 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:40.332575 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-45ffbad9-4ff0-46f7-850f-1c3e702be291 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:40.333264 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-45ffbad9-4ff0-46f7-850f-1c3e702be291 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:40.334143 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-45ffbad9-4ff0-46f7-850f-1c3e702be291 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:40.334902 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-45ffbad9-4ff0-46f7-850f-1c3e702be291 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:40.335596 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-45ffbad9-4ff0-46f7-850f-1c3e702be291 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:40.759286 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-7f298fdc-7176-493e-8801-b734319fa117 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:26:40.760487 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-7f298fdc-7176-493e-8801-b734319fa117 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] [instance: 94831c62-29a5-4745-b321-11b28dafaaa6] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:26:40.772227 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7f298fdc-7176-493e-8801-b734319fa117 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:40.778211 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7f298fdc-7176-493e-8801-b734319fa117 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:40.780413 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7f298fdc-7176-493e-8801-b734319fa117 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:40.781275 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7f298fdc-7176-493e-8801-b734319fa117 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:40.781856 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7f298fdc-7176-493e-8801-b734319fa117 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:40.782399 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7f298fdc-7176-493e-8801-b734319fa117 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:40.838645 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:26:40.931320 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-45ffbad9-4ff0-46f7-850f-1c3e702be291 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:40.963947 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-45ffbad9-4ff0-46f7-850f-1c3e702be291 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:40.992686 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-45ffbad9-4ff0-46f7-850f-1c3e702be291 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:40.995507 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-45ffbad9-4ff0-46f7-850f-1c3e702be291 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800" status: 200 len: 1809 microversion: 2.20 time: 0.681450 Aug 10 23:26:41.000125 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2841/5455] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:26:40 2022] GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800 => generated 1809 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:26:41.330860 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-7f298fdc-7176-493e-8801-b734319fa117 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:41.350946 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-7f298fdc-7176-493e-8801-b734319fa117 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:41.355032 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-7f298fdc-7176-493e-8801-b734319fa117 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:41.358945 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-7f298fdc-7176-493e-8801-b734319fa117 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] 10.222.0.58 "GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6" status: 200 len: 1877 microversion: 2.42 time: 0.605522 Aug 10 23:26:41.361020 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2615/5456] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:26:40 2022] GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6 => generated 1877 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:26:42.027202 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-e3290597-5ad1-47c5-9f41-54d19e551ada tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:26:42.028039 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-e3290597-5ad1-47c5-9f41-54d19e551ada tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: 03e88a01-d3ed-4ab2-a334-f4bc274fe800] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:26:42.044264 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e3290597-5ad1-47c5-9f41-54d19e551ada tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:42.046382 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e3290597-5ad1-47c5-9f41-54d19e551ada tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:42.047634 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e3290597-5ad1-47c5-9f41-54d19e551ada tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:42.049034 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e3290597-5ad1-47c5-9f41-54d19e551ada tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:42.050475 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e3290597-5ad1-47c5-9f41-54d19e551ada tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:42.051849 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e3290597-5ad1-47c5-9f41-54d19e551ada tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:42.388219 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-d7537a17-0599-46bd-b2c9-9855c5bc41f8 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:26:42.389246 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-d7537a17-0599-46bd-b2c9-9855c5bc41f8 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] [instance: 94831c62-29a5-4745-b321-11b28dafaaa6] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:26:42.398890 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d7537a17-0599-46bd-b2c9-9855c5bc41f8 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:42.399462 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d7537a17-0599-46bd-b2c9-9855c5bc41f8 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:42.399811 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d7537a17-0599-46bd-b2c9-9855c5bc41f8 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:42.400534 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d7537a17-0599-46bd-b2c9-9855c5bc41f8 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:42.400994 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d7537a17-0599-46bd-b2c9-9855c5bc41f8 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:42.401425 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d7537a17-0599-46bd-b2c9-9855c5bc41f8 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:42.677928 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-e3290597-5ad1-47c5-9f41-54d19e551ada tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:42.697020 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-e3290597-5ad1-47c5-9f41-54d19e551ada tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:42.698981 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-e3290597-5ad1-47c5-9f41-54d19e551ada tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:42.701554 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-e3290597-5ad1-47c5-9f41-54d19e551ada tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800" status: 200 len: 1809 microversion: 2.20 time: 0.678907 Aug 10 23:26:42.702312 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2842/5457] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:26:42 2022] GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800 => generated 1809 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:26:42.787924 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-d7537a17-0599-46bd-b2c9-9855c5bc41f8 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:42.799388 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-d7537a17-0599-46bd-b2c9-9855c5bc41f8 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:42.801626 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-d7537a17-0599-46bd-b2c9-9855c5bc41f8 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:42.803867 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-d7537a17-0599-46bd-b2c9-9855c5bc41f8 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] 10.222.0.58 "GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6" status: 200 len: 1877 microversion: 2.42 time: 0.422094 Aug 10 23:26:42.804739 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2616/5458] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:26:42 2022] GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6 => generated 1877 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:26:43.727243 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-f4d4a9eb-1de1-4afa-92ea-ac8bdaf706c5 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:26:43.728141 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-f4d4a9eb-1de1-4afa-92ea-ac8bdaf706c5 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: 03e88a01-d3ed-4ab2-a334-f4bc274fe800] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:26:43.745644 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f4d4a9eb-1de1-4afa-92ea-ac8bdaf706c5 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:43.746148 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f4d4a9eb-1de1-4afa-92ea-ac8bdaf706c5 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:43.746595 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f4d4a9eb-1de1-4afa-92ea-ac8bdaf706c5 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:43.755618 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f4d4a9eb-1de1-4afa-92ea-ac8bdaf706c5 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:43.756248 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f4d4a9eb-1de1-4afa-92ea-ac8bdaf706c5 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:43.756796 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f4d4a9eb-1de1-4afa-92ea-ac8bdaf706c5 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:43.836840 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-a949bc66-4dca-493a-9de7-b783af99f96a tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:26:43.838333 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-a949bc66-4dca-493a-9de7-b783af99f96a tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] [instance: 94831c62-29a5-4745-b321-11b28dafaaa6] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:26:43.857567 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a949bc66-4dca-493a-9de7-b783af99f96a tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:43.858630 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a949bc66-4dca-493a-9de7-b783af99f96a tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:43.861725 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a949bc66-4dca-493a-9de7-b783af99f96a tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:43.863090 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a949bc66-4dca-493a-9de7-b783af99f96a tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:43.864555 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a949bc66-4dca-493a-9de7-b783af99f96a tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:43.865397 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a949bc66-4dca-493a-9de7-b783af99f96a tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:44.129709 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-f4d4a9eb-1de1-4afa-92ea-ac8bdaf706c5 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:44.149901 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-f4d4a9eb-1de1-4afa-92ea-ac8bdaf706c5 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:44.151757 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-f4d4a9eb-1de1-4afa-92ea-ac8bdaf706c5 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:44.153182 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-f4d4a9eb-1de1-4afa-92ea-ac8bdaf706c5 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800" status: 200 len: 1809 microversion: 2.20 time: 0.432187 Aug 10 23:26:44.167539 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2843/5459] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:26:43 2022] GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800 => generated 1809 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:26:44.386524 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-a949bc66-4dca-493a-9de7-b783af99f96a tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:44.396369 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-a949bc66-4dca-493a-9de7-b783af99f96a tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:44.405938 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-a949bc66-4dca-493a-9de7-b783af99f96a tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:44.424606 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-a949bc66-4dca-493a-9de7-b783af99f96a tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] 10.222.0.58 "GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6" status: 200 len: 1877 microversion: 2.42 time: 0.578307 Aug 10 23:26:44.425604 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2617/5460] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:26:43 2022] GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6 => generated 1877 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 23:26:45.177624 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-08a837b5-01cc-462e-b72f-998a823d3503 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:26:45.178968 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-08a837b5-01cc-462e-b72f-998a823d3503 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: 03e88a01-d3ed-4ab2-a334-f4bc274fe800] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:26:45.194449 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-08a837b5-01cc-462e-b72f-998a823d3503 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:45.195327 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-08a837b5-01cc-462e-b72f-998a823d3503 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:45.195959 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-08a837b5-01cc-462e-b72f-998a823d3503 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:45.196867 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-08a837b5-01cc-462e-b72f-998a823d3503 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:45.197510 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-08a837b5-01cc-462e-b72f-998a823d3503 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:45.199303 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-08a837b5-01cc-462e-b72f-998a823d3503 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:45.452903 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-8a9e0321-98f4-4c94-a903-a7199ab43580 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:26:45.454989 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-8a9e0321-98f4-4c94-a903-a7199ab43580 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] [instance: 94831c62-29a5-4745-b321-11b28dafaaa6] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:26:45.471026 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8a9e0321-98f4-4c94-a903-a7199ab43580 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:45.471895 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8a9e0321-98f4-4c94-a903-a7199ab43580 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:45.472571 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8a9e0321-98f4-4c94-a903-a7199ab43580 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:45.473806 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8a9e0321-98f4-4c94-a903-a7199ab43580 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:45.474482 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8a9e0321-98f4-4c94-a903-a7199ab43580 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:45.475278 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8a9e0321-98f4-4c94-a903-a7199ab43580 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:46.179289 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-8a9e0321-98f4-4c94-a903-a7199ab43580 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:46.191221 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-8a9e0321-98f4-4c94-a903-a7199ab43580 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:46.206512 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-8a9e0321-98f4-4c94-a903-a7199ab43580 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:46.223224 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-8a9e0321-98f4-4c94-a903-a7199ab43580 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] 10.222.0.58 "GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6" status: 200 len: 1877 microversion: 2.42 time: 0.776977 Aug 10 23:26:46.224234 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2618/5461] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:26:45 2022] GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6 => generated 1877 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:26:46.452353 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-08a837b5-01cc-462e-b72f-998a823d3503 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:46.468472 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-08a837b5-01cc-462e-b72f-998a823d3503 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:46.470490 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-08a837b5-01cc-462e-b72f-998a823d3503 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:46.484430 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-08a837b5-01cc-462e-b72f-998a823d3503 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800" status: 200 len: 1809 microversion: 2.20 time: 1.310647 Aug 10 23:26:46.498909 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2844/5462] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:26:45 2022] GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800 => generated 1809 bytes in 1322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 23:26:47.249608 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-7f401e42-475f-486c-bb17-3f7251b6ffe0 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:26:47.250281 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-7f401e42-475f-486c-bb17-3f7251b6ffe0 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] [instance: 94831c62-29a5-4745-b321-11b28dafaaa6] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:26:47.263996 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7f401e42-475f-486c-bb17-3f7251b6ffe0 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:47.264888 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7f401e42-475f-486c-bb17-3f7251b6ffe0 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:47.266730 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7f401e42-475f-486c-bb17-3f7251b6ffe0 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:47.267742 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7f401e42-475f-486c-bb17-3f7251b6ffe0 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:47.269196 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7f401e42-475f-486c-bb17-3f7251b6ffe0 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:47.271793 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7f401e42-475f-486c-bb17-3f7251b6ffe0 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:47.519134 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-855937b2-4554-43b6-aab6-790bd85355ca tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:26:47.520446 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-855937b2-4554-43b6-aab6-790bd85355ca tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: 03e88a01-d3ed-4ab2-a334-f4bc274fe800] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:26:47.533525 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-855937b2-4554-43b6-aab6-790bd85355ca tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:47.534278 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-855937b2-4554-43b6-aab6-790bd85355ca tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:47.534976 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-855937b2-4554-43b6-aab6-790bd85355ca tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:47.539057 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-855937b2-4554-43b6-aab6-790bd85355ca tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:47.539749 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-855937b2-4554-43b6-aab6-790bd85355ca tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:47.540430 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-855937b2-4554-43b6-aab6-790bd85355ca tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:47.588444 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=100 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:26:47.801102 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-7f401e42-475f-486c-bb17-3f7251b6ffe0 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:47.822356 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-7f401e42-475f-486c-bb17-3f7251b6ffe0 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:47.824241 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-7f401e42-475f-486c-bb17-3f7251b6ffe0 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:47.825762 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-7f401e42-475f-486c-bb17-3f7251b6ffe0 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] 10.222.0.58 "GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6" status: 200 len: 1877 microversion: 2.42 time: 0.580284 Aug 10 23:26:47.826873 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2619/5463] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:26:47 2022] GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6 => generated 1877 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:26:48.407521 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-855937b2-4554-43b6-aab6-790bd85355ca tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:48.421564 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-855937b2-4554-43b6-aab6-790bd85355ca tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:48.432701 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-855937b2-4554-43b6-aab6-790bd85355ca tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:48.434368 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-855937b2-4554-43b6-aab6-790bd85355ca tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800" status: 200 len: 1809 microversion: 2.20 time: 0.919446 Aug 10 23:26:48.437842 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2845/5464] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:26:47 2022] GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800 => generated 1809 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:26:48.854682 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-6ded526f-5b5d-4a75-923f-495c7c9189cb tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:26:48.855945 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-6ded526f-5b5d-4a75-923f-495c7c9189cb tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] [instance: 94831c62-29a5-4745-b321-11b28dafaaa6] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:26:48.867783 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6ded526f-5b5d-4a75-923f-495c7c9189cb tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:48.871565 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6ded526f-5b5d-4a75-923f-495c7c9189cb tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:48.872898 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6ded526f-5b5d-4a75-923f-495c7c9189cb tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:48.874114 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6ded526f-5b5d-4a75-923f-495c7c9189cb tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:48.876418 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6ded526f-5b5d-4a75-923f-495c7c9189cb tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:48.878381 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6ded526f-5b5d-4a75-923f-495c7c9189cb tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:49.460668 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-d425991a-83d8-4780-b4cb-426112b360a6 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:26:49.461439 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-d425991a-83d8-4780-b4cb-426112b360a6 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: 03e88a01-d3ed-4ab2-a334-f4bc274fe800] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:26:49.472900 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d425991a-83d8-4780-b4cb-426112b360a6 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:49.478140 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d425991a-83d8-4780-b4cb-426112b360a6 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:49.479858 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d425991a-83d8-4780-b4cb-426112b360a6 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:49.485956 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d425991a-83d8-4780-b4cb-426112b360a6 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:49.490183 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d425991a-83d8-4780-b4cb-426112b360a6 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:49.490914 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d425991a-83d8-4780-b4cb-426112b360a6 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:49.634223 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-6ded526f-5b5d-4a75-923f-495c7c9189cb tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:49.651289 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-6ded526f-5b5d-4a75-923f-495c7c9189cb tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:49.658419 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-6ded526f-5b5d-4a75-923f-495c7c9189cb tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:49.661515 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-6ded526f-5b5d-4a75-923f-495c7c9189cb tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] 10.222.0.58 "GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6" status: 200 len: 1877 microversion: 2.42 time: 0.811158 Aug 10 23:26:49.677559 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2620/5465] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:26:48 2022] GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6 => generated 1877 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:26:50.693197 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-af912aa0-4822-4ed0-ba4b-a67fd3f6ac8a tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:26:50.695852 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-af912aa0-4822-4ed0-ba4b-a67fd3f6ac8a tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] [instance: 94831c62-29a5-4745-b321-11b28dafaaa6] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:26:50.712093 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-af912aa0-4822-4ed0-ba4b-a67fd3f6ac8a tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:50.712920 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-af912aa0-4822-4ed0-ba4b-a67fd3f6ac8a tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:50.713909 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-af912aa0-4822-4ed0-ba4b-a67fd3f6ac8a tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:50.715611 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-af912aa0-4822-4ed0-ba4b-a67fd3f6ac8a tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:50.717415 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-af912aa0-4822-4ed0-ba4b-a67fd3f6ac8a tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:50.719973 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-af912aa0-4822-4ed0-ba4b-a67fd3f6ac8a tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:50.739941 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-d425991a-83d8-4780-b4cb-426112b360a6 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:50.755096 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-d425991a-83d8-4780-b4cb-426112b360a6 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:50.772946 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-d425991a-83d8-4780-b4cb-426112b360a6 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:50.774587 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-d425991a-83d8-4780-b4cb-426112b360a6 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800" status: 200 len: 1809 microversion: 2.20 time: 1.317822 Aug 10 23:26:50.806947 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2846/5466] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:26:49 2022] GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800 => generated 1809 bytes in 1351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:26:51.484121 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-af912aa0-4822-4ed0-ba4b-a67fd3f6ac8a tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:51.518852 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-af912aa0-4822-4ed0-ba4b-a67fd3f6ac8a tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:51.525076 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-af912aa0-4822-4ed0-ba4b-a67fd3f6ac8a tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:51.531074 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-af912aa0-4822-4ed0-ba4b-a67fd3f6ac8a tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] 10.222.0.58 "GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6" status: 200 len: 1877 microversion: 2.42 time: 0.842354 Aug 10 23:26:51.534329 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2621/5467] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:26:50 2022] GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6 => generated 1877 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:26:51.803890 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-5e9c8827-7e4c-4407-a6b3-48fd45b0a69f tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:26:51.806460 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-5e9c8827-7e4c-4407-a6b3-48fd45b0a69f tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: 03e88a01-d3ed-4ab2-a334-f4bc274fe800] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:26:51.832448 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5e9c8827-7e4c-4407-a6b3-48fd45b0a69f tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:51.833321 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5e9c8827-7e4c-4407-a6b3-48fd45b0a69f tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:51.835267 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5e9c8827-7e4c-4407-a6b3-48fd45b0a69f tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:51.836429 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5e9c8827-7e4c-4407-a6b3-48fd45b0a69f tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:51.846343 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5e9c8827-7e4c-4407-a6b3-48fd45b0a69f tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:51.847189 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5e9c8827-7e4c-4407-a6b3-48fd45b0a69f tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:52.385868 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-5e9c8827-7e4c-4407-a6b3-48fd45b0a69f tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:52.420871 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-5e9c8827-7e4c-4407-a6b3-48fd45b0a69f tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:52.431644 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-5e9c8827-7e4c-4407-a6b3-48fd45b0a69f tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:52.437173 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-5e9c8827-7e4c-4407-a6b3-48fd45b0a69f tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800" status: 200 len: 1809 microversion: 2.20 time: 0.637030 Aug 10 23:26:52.443011 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2847/5468] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:26:51 2022] GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800 => generated 1809 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:26:52.557122 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-b92ff04d-5c10-4c10-918a-619eb15782da tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:26:52.557752 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-b92ff04d-5c10-4c10-918a-619eb15782da tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] [instance: 94831c62-29a5-4745-b321-11b28dafaaa6] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:26:52.569689 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b92ff04d-5c10-4c10-918a-619eb15782da tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:52.570355 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b92ff04d-5c10-4c10-918a-619eb15782da tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:52.570855 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b92ff04d-5c10-4c10-918a-619eb15782da tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:52.571571 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b92ff04d-5c10-4c10-918a-619eb15782da tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:52.572034 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b92ff04d-5c10-4c10-918a-619eb15782da tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:52.572467 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b92ff04d-5c10-4c10-918a-619eb15782da tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:53.053958 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-b92ff04d-5c10-4c10-918a-619eb15782da tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:53.066605 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-b92ff04d-5c10-4c10-918a-619eb15782da tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:53.078205 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-b92ff04d-5c10-4c10-918a-619eb15782da tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:53.079478 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-b92ff04d-5c10-4c10-918a-619eb15782da tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] 10.222.0.58 "GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6" status: 200 len: 1877 microversion: 2.42 time: 0.526513 Aug 10 23:26:53.085912 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2622/5469] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:26:52 2022] GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6 => generated 1877 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:26:53.475960 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-bfe1b114-c903-4135-ae36-b061e72dbffd tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:26:53.476569 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-bfe1b114-c903-4135-ae36-b061e72dbffd tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: 03e88a01-d3ed-4ab2-a334-f4bc274fe800] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:26:53.492293 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bfe1b114-c903-4135-ae36-b061e72dbffd tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:53.495383 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bfe1b114-c903-4135-ae36-b061e72dbffd tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:53.496821 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bfe1b114-c903-4135-ae36-b061e72dbffd tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:53.499781 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bfe1b114-c903-4135-ae36-b061e72dbffd tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:53.502242 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bfe1b114-c903-4135-ae36-b061e72dbffd tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:53.503723 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bfe1b114-c903-4135-ae36-b061e72dbffd tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:53.877035 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-bfe1b114-c903-4135-ae36-b061e72dbffd tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:53.913657 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-bfe1b114-c903-4135-ae36-b061e72dbffd tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:53.930498 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-bfe1b114-c903-4135-ae36-b061e72dbffd tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:53.937870 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-bfe1b114-c903-4135-ae36-b061e72dbffd tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800" status: 200 len: 1809 microversion: 2.20 time: 0.465507 Aug 10 23:26:53.967474 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2848/5470] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:26:53 2022] GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800 => generated 1809 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:26:54.105772 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-097b8986-0e25-4d81-b98b-67ef8a51aa95 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:26:54.107890 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-097b8986-0e25-4d81-b98b-67ef8a51aa95 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] [instance: 94831c62-29a5-4745-b321-11b28dafaaa6] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:26:54.120884 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-097b8986-0e25-4d81-b98b-67ef8a51aa95 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:54.121581 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-097b8986-0e25-4d81-b98b-67ef8a51aa95 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:54.124253 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-097b8986-0e25-4d81-b98b-67ef8a51aa95 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:54.125029 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-097b8986-0e25-4d81-b98b-67ef8a51aa95 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:54.125498 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-097b8986-0e25-4d81-b98b-67ef8a51aa95 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:54.125955 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-097b8986-0e25-4d81-b98b-67ef8a51aa95 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:54.762388 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-097b8986-0e25-4d81-b98b-67ef8a51aa95 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:54.779067 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-097b8986-0e25-4d81-b98b-67ef8a51aa95 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:54.780704 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-097b8986-0e25-4d81-b98b-67ef8a51aa95 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:54.781918 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-097b8986-0e25-4d81-b98b-67ef8a51aa95 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] 10.222.0.58 "GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6" status: 200 len: 1877 microversion: 2.42 time: 0.680253 Aug 10 23:26:54.798772 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2623/5471] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:26:54 2022] GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6 => generated 1877 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:26:54.992153 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-699f6ff4-2b6d-4c1d-9a75-36f3906351fb tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:26:54.992624 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-699f6ff4-2b6d-4c1d-9a75-36f3906351fb tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: 03e88a01-d3ed-4ab2-a334-f4bc274fe800] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:26:55.024434 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-699f6ff4-2b6d-4c1d-9a75-36f3906351fb tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:55.024948 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-699f6ff4-2b6d-4c1d-9a75-36f3906351fb tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:55.025405 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-699f6ff4-2b6d-4c1d-9a75-36f3906351fb tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:55.026146 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-699f6ff4-2b6d-4c1d-9a75-36f3906351fb tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:55.026660 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-699f6ff4-2b6d-4c1d-9a75-36f3906351fb tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:55.027163 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-699f6ff4-2b6d-4c1d-9a75-36f3906351fb tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:55.657762 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-699f6ff4-2b6d-4c1d-9a75-36f3906351fb tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:55.670531 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-699f6ff4-2b6d-4c1d-9a75-36f3906351fb tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:55.682326 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-699f6ff4-2b6d-4c1d-9a75-36f3906351fb tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:55.704431 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-699f6ff4-2b6d-4c1d-9a75-36f3906351fb tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800" status: 200 len: 1809 microversion: 2.20 time: 0.696973 Aug 10 23:26:55.705115 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2849/5472] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:26:54 2022] GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800 => generated 1809 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:26:55.820213 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-48e3d3ef-31a2-4d9f-aa45-a0183340899a tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:26:55.820841 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-48e3d3ef-31a2-4d9f-aa45-a0183340899a tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] [instance: 94831c62-29a5-4745-b321-11b28dafaaa6] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:26:55.825127 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_api:SELECT=40 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:26:55.843477 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-48e3d3ef-31a2-4d9f-aa45-a0183340899a tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:55.846868 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-48e3d3ef-31a2-4d9f-aa45-a0183340899a tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:55.850550 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-48e3d3ef-31a2-4d9f-aa45-a0183340899a tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:55.876452 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-48e3d3ef-31a2-4d9f-aa45-a0183340899a tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:55.878679 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-48e3d3ef-31a2-4d9f-aa45-a0183340899a tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:55.879183 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-48e3d3ef-31a2-4d9f-aa45-a0183340899a tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:56.738644 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-abb791ac-29a7-498a-9e47-f885143bdfb8 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:26:56.740630 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-abb791ac-29a7-498a-9e47-f885143bdfb8 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: 03e88a01-d3ed-4ab2-a334-f4bc274fe800] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:26:56.761356 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-abb791ac-29a7-498a-9e47-f885143bdfb8 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:56.762948 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-abb791ac-29a7-498a-9e47-f885143bdfb8 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:56.766626 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-abb791ac-29a7-498a-9e47-f885143bdfb8 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:56.768876 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-abb791ac-29a7-498a-9e47-f885143bdfb8 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:56.774920 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-abb791ac-29a7-498a-9e47-f885143bdfb8 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:56.779326 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-abb791ac-29a7-498a-9e47-f885143bdfb8 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:56.958517 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-48e3d3ef-31a2-4d9f-aa45-a0183340899a tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:56.980740 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-48e3d3ef-31a2-4d9f-aa45-a0183340899a tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:56.988716 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-48e3d3ef-31a2-4d9f-aa45-a0183340899a tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:56.994322 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-48e3d3ef-31a2-4d9f-aa45-a0183340899a tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] 10.222.0.58 "GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6" status: 200 len: 1877 microversion: 2.42 time: 1.184251 Aug 10 23:26:57.001301 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2624/5473] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:26:55 2022] GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6 => generated 1877 bytes in 1192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:26:57.269312 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-abb791ac-29a7-498a-9e47-f885143bdfb8 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:57.280219 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-abb791ac-29a7-498a-9e47-f885143bdfb8 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:57.294324 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-abb791ac-29a7-498a-9e47-f885143bdfb8 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:57.303395 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-abb791ac-29a7-498a-9e47-f885143bdfb8 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800" status: 200 len: 1809 microversion: 2.20 time: 0.569588 Aug 10 23:26:57.304003 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2850/5474] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:26:56 2022] GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800 => generated 1809 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:26:58.029439 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-9e1382a4-c71d-4eaf-ab29-ee5c4f6ff4fd tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:26:58.030665 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-9e1382a4-c71d-4eaf-ab29-ee5c4f6ff4fd tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] [instance: 94831c62-29a5-4745-b321-11b28dafaaa6] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:26:58.043374 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9e1382a4-c71d-4eaf-ab29-ee5c4f6ff4fd tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:58.045050 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9e1382a4-c71d-4eaf-ab29-ee5c4f6ff4fd tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:58.045315 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9e1382a4-c71d-4eaf-ab29-ee5c4f6ff4fd tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:58.052316 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9e1382a4-c71d-4eaf-ab29-ee5c4f6ff4fd tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:58.053050 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9e1382a4-c71d-4eaf-ab29-ee5c4f6ff4fd tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:58.053657 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9e1382a4-c71d-4eaf-ab29-ee5c4f6ff4fd tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:58.335539 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-8fef7529-af22-43af-9c2a-ce1de29a1e6a tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:26:58.336343 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-8fef7529-af22-43af-9c2a-ce1de29a1e6a tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: 03e88a01-d3ed-4ab2-a334-f4bc274fe800] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:26:58.348156 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_api:SELECT=42 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:26:58.350465 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8fef7529-af22-43af-9c2a-ce1de29a1e6a tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:58.351233 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8fef7529-af22-43af-9c2a-ce1de29a1e6a tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:58.355285 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8fef7529-af22-43af-9c2a-ce1de29a1e6a tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:58.356762 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8fef7529-af22-43af-9c2a-ce1de29a1e6a tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:58.357357 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8fef7529-af22-43af-9c2a-ce1de29a1e6a tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:58.357868 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8fef7529-af22-43af-9c2a-ce1de29a1e6a tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:58.762061 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-8fef7529-af22-43af-9c2a-ce1de29a1e6a tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:58.783250 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-8fef7529-af22-43af-9c2a-ce1de29a1e6a tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:58.785566 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-8fef7529-af22-43af-9c2a-ce1de29a1e6a tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:58.789551 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-8fef7529-af22-43af-9c2a-ce1de29a1e6a tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800" status: 200 len: 1809 microversion: 2.20 time: 0.457964 Aug 10 23:26:58.807115 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2851/5475] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:26:58 2022] GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800 => generated 1809 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:26:58.844200 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-9e1382a4-c71d-4eaf-ab29-ee5c4f6ff4fd tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:58.862429 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-9e1382a4-c71d-4eaf-ab29-ee5c4f6ff4fd tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:58.864032 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-9e1382a4-c71d-4eaf-ab29-ee5c4f6ff4fd tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:26:58.867027 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-9e1382a4-c71d-4eaf-ab29-ee5c4f6ff4fd tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] 10.222.0.58 "GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6" status: 200 len: 1877 microversion: 2.42 time: 0.840588 Aug 10 23:26:58.868177 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2625/5476] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:26:58 2022] GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6 => generated 1877 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:26:59.816716 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-129c9411-e3b5-4afb-a8cc-3c08ed0a65c6 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:26:59.817348 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-129c9411-e3b5-4afb-a8cc-3c08ed0a65c6 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: 03e88a01-d3ed-4ab2-a334-f4bc274fe800] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:26:59.834519 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-129c9411-e3b5-4afb-a8cc-3c08ed0a65c6 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:59.835052 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-129c9411-e3b5-4afb-a8cc-3c08ed0a65c6 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:59.835487 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-129c9411-e3b5-4afb-a8cc-3c08ed0a65c6 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:59.836200 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-129c9411-e3b5-4afb-a8cc-3c08ed0a65c6 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:59.836654 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-129c9411-e3b5-4afb-a8cc-3c08ed0a65c6 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:59.837079 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-129c9411-e3b5-4afb-a8cc-3c08ed0a65c6 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:59.893182 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-30b1f43a-f100-4944-9473-cdce9b1d9765 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:26:59.894027 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-30b1f43a-f100-4944-9473-cdce9b1d9765 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] [instance: 94831c62-29a5-4745-b321-11b28dafaaa6] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:26:59.905358 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-30b1f43a-f100-4944-9473-cdce9b1d9765 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:59.905998 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-30b1f43a-f100-4944-9473-cdce9b1d9765 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:59.906516 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-30b1f43a-f100-4944-9473-cdce9b1d9765 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:26:59.907327 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-30b1f43a-f100-4944-9473-cdce9b1d9765 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:26:59.907885 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-30b1f43a-f100-4944-9473-cdce9b1d9765 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:26:59.908337 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-30b1f43a-f100-4944-9473-cdce9b1d9765 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:00.130822 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-129c9411-e3b5-4afb-a8cc-3c08ed0a65c6 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:27:00.144134 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-129c9411-e3b5-4afb-a8cc-3c08ed0a65c6 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:27:00.146979 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-129c9411-e3b5-4afb-a8cc-3c08ed0a65c6 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:27:00.151619 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-129c9411-e3b5-4afb-a8cc-3c08ed0a65c6 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800" status: 200 len: 1809 microversion: 2.20 time: 0.338804 Aug 10 23:27:00.172153 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2852/5477] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:26:59 2022] GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800 => generated 1809 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:27:00.390580 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-30b1f43a-f100-4944-9473-cdce9b1d9765 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:27:00.412607 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-30b1f43a-f100-4944-9473-cdce9b1d9765 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:27:00.415194 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-30b1f43a-f100-4944-9473-cdce9b1d9765 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:27:00.417504 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-30b1f43a-f100-4944-9473-cdce9b1d9765 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] 10.222.0.58 "GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6" status: 200 len: 1877 microversion: 2.42 time: 0.529771 Aug 10 23:27:00.419262 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2626/5478] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:26:59 2022] GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6 => generated 1877 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:27:01.183258 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-d737f765-b086-4b4d-afbe-8ab3786b694b tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:27:01.183876 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-d737f765-b086-4b4d-afbe-8ab3786b694b tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: 03e88a01-d3ed-4ab2-a334-f4bc274fe800] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:27:01.197547 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d737f765-b086-4b4d-afbe-8ab3786b694b tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:01.198045 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d737f765-b086-4b4d-afbe-8ab3786b694b tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:01.198606 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d737f765-b086-4b4d-afbe-8ab3786b694b tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:01.199541 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d737f765-b086-4b4d-afbe-8ab3786b694b tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:01.200071 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d737f765-b086-4b4d-afbe-8ab3786b694b tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:01.200837 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d737f765-b086-4b4d-afbe-8ab3786b694b tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:01.446285 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-5867244f-176e-43f0-883e-1190ae86834f tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:27:01.447492 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-5867244f-176e-43f0-883e-1190ae86834f tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] [instance: 94831c62-29a5-4745-b321-11b28dafaaa6] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:27:01.465240 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5867244f-176e-43f0-883e-1190ae86834f tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:01.466047 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5867244f-176e-43f0-883e-1190ae86834f tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:01.483118 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5867244f-176e-43f0-883e-1190ae86834f tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:01.484049 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5867244f-176e-43f0-883e-1190ae86834f tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:01.484541 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5867244f-176e-43f0-883e-1190ae86834f tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:01.484980 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5867244f-176e-43f0-883e-1190ae86834f tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:01.504582 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-d737f765-b086-4b4d-afbe-8ab3786b694b tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:27:01.519384 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-d737f765-b086-4b4d-afbe-8ab3786b694b tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:27:01.524880 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-d737f765-b086-4b4d-afbe-8ab3786b694b tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:27:01.529624 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-d737f765-b086-4b4d-afbe-8ab3786b694b tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800" status: 200 len: 1809 microversion: 2.20 time: 0.349381 Aug 10 23:27:01.534877 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2853/5479] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:27:01 2022] GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800 => generated 1809 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:27:02.540674 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-5867244f-176e-43f0-883e-1190ae86834f tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:27:02.558319 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-29321c8c-1df8-4b14-8f85-2f4050429920 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:27:02.558963 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-29321c8c-1df8-4b14-8f85-2f4050429920 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: 03e88a01-d3ed-4ab2-a334-f4bc274fe800] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:27:02.570940 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-5867244f-176e-43f0-883e-1190ae86834f tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:27:02.574636 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-5867244f-176e-43f0-883e-1190ae86834f tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:27:02.579343 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-5867244f-176e-43f0-883e-1190ae86834f tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] 10.222.0.58 "GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6" status: 200 len: 1877 microversion: 2.42 time: 1.137370 Aug 10 23:27:02.580812 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-29321c8c-1df8-4b14-8f85-2f4050429920 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:02.581280 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2627/5480] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:27:01 2022] GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6 => generated 1877 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:27:02.584592 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-29321c8c-1df8-4b14-8f85-2f4050429920 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:02.595365 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-29321c8c-1df8-4b14-8f85-2f4050429920 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:02.596651 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-29321c8c-1df8-4b14-8f85-2f4050429920 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:02.617788 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-29321c8c-1df8-4b14-8f85-2f4050429920 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:02.618666 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-29321c8c-1df8-4b14-8f85-2f4050429920 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:03.341134 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-29321c8c-1df8-4b14-8f85-2f4050429920 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:27:03.354756 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-29321c8c-1df8-4b14-8f85-2f4050429920 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:27:03.356453 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-29321c8c-1df8-4b14-8f85-2f4050429920 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:27:03.358096 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-29321c8c-1df8-4b14-8f85-2f4050429920 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800" status: 200 len: 1809 microversion: 2.20 time: 0.803349 Aug 10 23:27:03.358506 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2854/5481] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:27:02 2022] GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800 => generated 1809 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:27:03.614689 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-198170fa-0af8-4fda-a8e1-6f70876f4612 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:27:03.615476 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-198170fa-0af8-4fda-a8e1-6f70876f4612 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] [instance: 94831c62-29a5-4745-b321-11b28dafaaa6] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:27:03.631424 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-198170fa-0af8-4fda-a8e1-6f70876f4612 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:03.634049 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-198170fa-0af8-4fda-a8e1-6f70876f4612 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:03.634526 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-198170fa-0af8-4fda-a8e1-6f70876f4612 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:03.635547 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-198170fa-0af8-4fda-a8e1-6f70876f4612 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:03.636189 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-198170fa-0af8-4fda-a8e1-6f70876f4612 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:03.636729 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-198170fa-0af8-4fda-a8e1-6f70876f4612 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:04.382336 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-2eb36a1b-4e1f-4877-a08c-9503485e267e tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:27:04.383056 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-2eb36a1b-4e1f-4877-a08c-9503485e267e tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: 03e88a01-d3ed-4ab2-a334-f4bc274fe800] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:27:04.393237 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2eb36a1b-4e1f-4877-a08c-9503485e267e tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:04.393735 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2eb36a1b-4e1f-4877-a08c-9503485e267e tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:04.394171 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2eb36a1b-4e1f-4877-a08c-9503485e267e tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:04.410566 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2eb36a1b-4e1f-4877-a08c-9503485e267e tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:04.414047 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2eb36a1b-4e1f-4877-a08c-9503485e267e tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:04.414508 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2eb36a1b-4e1f-4877-a08c-9503485e267e tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:04.484312 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-198170fa-0af8-4fda-a8e1-6f70876f4612 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:27:04.520568 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-198170fa-0af8-4fda-a8e1-6f70876f4612 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:27:04.532504 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-198170fa-0af8-4fda-a8e1-6f70876f4612 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:27:04.540356 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-198170fa-0af8-4fda-a8e1-6f70876f4612 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] 10.222.0.58 "GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6" status: 200 len: 1877 microversion: 2.42 time: 0.932521 Aug 10 23:27:04.549254 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2628/5482] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:27:03 2022] GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6 => generated 1877 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:27:05.163454 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-2eb36a1b-4e1f-4877-a08c-9503485e267e tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:27:05.183889 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-2eb36a1b-4e1f-4877-a08c-9503485e267e tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:27:05.186171 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-2eb36a1b-4e1f-4877-a08c-9503485e267e tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:27:05.187780 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-2eb36a1b-4e1f-4877-a08c-9503485e267e tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800" status: 200 len: 1809 microversion: 2.20 time: 0.809403 Aug 10 23:27:05.203946 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2855/5483] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:27:04 2022] GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800 => generated 1809 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:27:05.583077 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-0f38e944-415b-4a67-99f3-3de40adae819 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:27:05.584892 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-0f38e944-415b-4a67-99f3-3de40adae819 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] [instance: 94831c62-29a5-4745-b321-11b28dafaaa6] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:27:05.613284 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0f38e944-415b-4a67-99f3-3de40adae819 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:05.615818 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0f38e944-415b-4a67-99f3-3de40adae819 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:05.620520 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0f38e944-415b-4a67-99f3-3de40adae819 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:05.625734 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0f38e944-415b-4a67-99f3-3de40adae819 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:05.627150 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0f38e944-415b-4a67-99f3-3de40adae819 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:05.627808 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0f38e944-415b-4a67-99f3-3de40adae819 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:06.057917 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-0f38e944-415b-4a67-99f3-3de40adae819 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:27:06.072073 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-0f38e944-415b-4a67-99f3-3de40adae819 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:27:06.074144 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-0f38e944-415b-4a67-99f3-3de40adae819 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:27:06.076511 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-0f38e944-415b-4a67-99f3-3de40adae819 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] 10.222.0.58 "GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6" status: 200 len: 1877 microversion: 2.42 time: 0.502721 Aug 10 23:27:06.078568 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2629/5484] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:27:05 2022] GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6 => generated 1877 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:27:06.216919 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-e5b29adb-78fc-4de9-aba5-9f2844095a67 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:27:06.217530 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-e5b29adb-78fc-4de9-aba5-9f2844095a67 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: 03e88a01-d3ed-4ab2-a334-f4bc274fe800] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:27:06.235701 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e5b29adb-78fc-4de9-aba5-9f2844095a67 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:06.236190 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e5b29adb-78fc-4de9-aba5-9f2844095a67 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:06.247426 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e5b29adb-78fc-4de9-aba5-9f2844095a67 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:06.248573 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e5b29adb-78fc-4de9-aba5-9f2844095a67 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:06.249236 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e5b29adb-78fc-4de9-aba5-9f2844095a67 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:06.249841 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e5b29adb-78fc-4de9-aba5-9f2844095a67 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:07.016121 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-e5b29adb-78fc-4de9-aba5-9f2844095a67 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:27:07.028781 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-e5b29adb-78fc-4de9-aba5-9f2844095a67 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:27:07.031881 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-e5b29adb-78fc-4de9-aba5-9f2844095a67 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:27:07.034653 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-e5b29adb-78fc-4de9-aba5-9f2844095a67 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800" status: 200 len: 1809 microversion: 2.20 time: 0.821402 Aug 10 23:27:07.037439 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2856/5485] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:27:06 2022] GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800 => generated 1809 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:27:07.104874 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-451e5547-20c3-459c-90f9-890894086345 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:27:07.105438 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-451e5547-20c3-459c-90f9-890894086345 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] [instance: 94831c62-29a5-4745-b321-11b28dafaaa6] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:27:07.116282 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-451e5547-20c3-459c-90f9-890894086345 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:07.117016 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-451e5547-20c3-459c-90f9-890894086345 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:07.118605 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-451e5547-20c3-459c-90f9-890894086345 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:07.119600 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-451e5547-20c3-459c-90f9-890894086345 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:07.122798 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-451e5547-20c3-459c-90f9-890894086345 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:07.125557 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-451e5547-20c3-459c-90f9-890894086345 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:07.914993 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-451e5547-20c3-459c-90f9-890894086345 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:27:07.933107 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-451e5547-20c3-459c-90f9-890894086345 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:27:07.939619 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-451e5547-20c3-459c-90f9-890894086345 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:27:07.942496 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-451e5547-20c3-459c-90f9-890894086345 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] 10.222.0.58 "GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6" status: 200 len: 1877 microversion: 2.42 time: 0.841255 Aug 10 23:27:07.960262 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2630/5486] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:27:07 2022] GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6 => generated 1877 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:27:08.066029 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-1b74f1f3-3da7-44d1-899f-6d1b5fb43d5d tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:27:08.066704 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-1b74f1f3-3da7-44d1-899f-6d1b5fb43d5d tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: 03e88a01-d3ed-4ab2-a334-f4bc274fe800] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:27:08.074256 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1b74f1f3-3da7-44d1-899f-6d1b5fb43d5d tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:08.075241 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1b74f1f3-3da7-44d1-899f-6d1b5fb43d5d tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:08.075782 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1b74f1f3-3da7-44d1-899f-6d1b5fb43d5d tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:08.076519 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1b74f1f3-3da7-44d1-899f-6d1b5fb43d5d tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:08.076974 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1b74f1f3-3da7-44d1-899f-6d1b5fb43d5d tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:08.077495 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1b74f1f3-3da7-44d1-899f-6d1b5fb43d5d tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:08.576626 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-1b74f1f3-3da7-44d1-899f-6d1b5fb43d5d tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:27:08.601052 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-1b74f1f3-3da7-44d1-899f-6d1b5fb43d5d tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:27:08.602816 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-1b74f1f3-3da7-44d1-899f-6d1b5fb43d5d tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:27:08.604106 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-1b74f1f3-3da7-44d1-899f-6d1b5fb43d5d tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800" status: 200 len: 1809 microversion: 2.20 time: 0.545290 Aug 10 23:27:08.605201 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2857/5487] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:27:08 2022] GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800 => generated 1809 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:27:08.974632 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-ed7adf70-74e8-454a-a4d4-2534115084cd tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:27:08.976229 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-ed7adf70-74e8-454a-a4d4-2534115084cd tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] [instance: 94831c62-29a5-4745-b321-11b28dafaaa6] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:27:08.989310 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ed7adf70-74e8-454a-a4d4-2534115084cd tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:08.990674 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ed7adf70-74e8-454a-a4d4-2534115084cd tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:08.991801 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ed7adf70-74e8-454a-a4d4-2534115084cd tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:08.993134 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ed7adf70-74e8-454a-a4d4-2534115084cd tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:08.993730 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ed7adf70-74e8-454a-a4d4-2534115084cd tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:08.995387 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ed7adf70-74e8-454a-a4d4-2534115084cd tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:09.211884 n-d-850468-14 devstack@n-api.service[122632]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 23:27:09.212184 n-d-850468-14 devstack@n-api.service[122632]: Wed Aug 10 23:27:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6 (ip 10.222.0.58) !!! Aug 10 23:27:09.572096 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-ed7adf70-74e8-454a-a4d4-2534115084cd tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:27:09.574983 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=100 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:27:09.586866 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-ed7adf70-74e8-454a-a4d4-2534115084cd tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:27:09.588443 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-ed7adf70-74e8-454a-a4d4-2534115084cd tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:27:09.608836 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-ed7adf70-74e8-454a-a4d4-2534115084cd tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] 10.222.0.58 "GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6" status: 200 len: 1877 microversion: 2.42 time: 0.621025 Aug 10 23:27:09.609522 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2631/5488] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:27:08 2022] GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6 => generated 1877 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:27:09.630037 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-5bcff6ab-2323-4a1a-bae7-e6c2e8fb3b82 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:27:09.630978 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-5bcff6ab-2323-4a1a-bae7-e6c2e8fb3b82 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: 03e88a01-d3ed-4ab2-a334-f4bc274fe800] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:27:09.654870 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5bcff6ab-2323-4a1a-bae7-e6c2e8fb3b82 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:09.655809 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5bcff6ab-2323-4a1a-bae7-e6c2e8fb3b82 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:09.659474 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5bcff6ab-2323-4a1a-bae7-e6c2e8fb3b82 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:09.660424 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5bcff6ab-2323-4a1a-bae7-e6c2e8fb3b82 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:09.661061 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5bcff6ab-2323-4a1a-bae7-e6c2e8fb3b82 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:09.661680 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5bcff6ab-2323-4a1a-bae7-e6c2e8fb3b82 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:09.879371 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-634a2d2d-9673-4f46-8b6b-e8ccb5580ff9 req-f41d8eb5-e45f-4703-a872-6946a6b086fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03e88a01-d3ed-4ab2-a334-f4bc274fe800", "name": "network-vif-plugged", "status": "completed", "tag": "7481f052-393a-446e-bc21-7be34657945e"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:27:09.920763 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-634a2d2d-9673-4f46-8b6b-e8ccb5580ff9 req-f41d8eb5-e45f-4703-a872-6946a6b086fe service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:09.944863 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-634a2d2d-9673-4f46-8b6b-e8ccb5580ff9 req-f41d8eb5-e45f-4703-a872-6946a6b086fe service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:09.948114 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-634a2d2d-9673-4f46-8b6b-e8ccb5580ff9 req-f41d8eb5-e45f-4703-a872-6946a6b086fe service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:10.006583 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-5bcff6ab-2323-4a1a-bae7-e6c2e8fb3b82 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:27:10.021062 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-5bcff6ab-2323-4a1a-bae7-e6c2e8fb3b82 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:27:10.021397 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-634a2d2d-9673-4f46-8b6b-e8ccb5580ff9 req-f41d8eb5-e45f-4703-a872-6946a6b086fe service nova] Creating event network-vif-plugged:7481f052-393a-446e-bc21-7be34657945e for instance 03e88a01-d3ed-4ab2-a334-f4bc274fe800 on n-h1-850468-14 Aug 10 23:27:10.023268 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-5bcff6ab-2323-4a1a-bae7-e6c2e8fb3b82 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:27:10.029322 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-5bcff6ab-2323-4a1a-bae7-e6c2e8fb3b82 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800" status: 200 len: 1809 microversion: 2.20 time: 0.404363 Aug 10 23:27:10.033160 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2632/5489] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:27:09 2022] GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800 => generated 1809 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:27:10.055818 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-634a2d2d-9673-4f46-8b6b-e8ccb5580ff9 req-f41d8eb5-e45f-4703-a872-6946a6b086fe service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.505825 Aug 10 23:27:10.056447 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2858/5490] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:27:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:27:10.633660 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-f23b7160-fc6d-40e5-83de-239b45f29f4e tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:27:10.634611 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-f23b7160-fc6d-40e5-83de-239b45f29f4e tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] [instance: 94831c62-29a5-4745-b321-11b28dafaaa6] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:27:10.657312 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f23b7160-fc6d-40e5-83de-239b45f29f4e tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:10.660573 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f23b7160-fc6d-40e5-83de-239b45f29f4e tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:10.661196 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f23b7160-fc6d-40e5-83de-239b45f29f4e tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:10.662998 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f23b7160-fc6d-40e5-83de-239b45f29f4e tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:10.665369 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f23b7160-fc6d-40e5-83de-239b45f29f4e tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:10.669380 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f23b7160-fc6d-40e5-83de-239b45f29f4e tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:11.060121 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-b4fd73fa-af21-480a-a8d1-cbb4f278a409 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:27:11.063828 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-b4fd73fa-af21-480a-a8d1-cbb4f278a409 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: 03e88a01-d3ed-4ab2-a334-f4bc274fe800] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:27:11.080718 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b4fd73fa-af21-480a-a8d1-cbb4f278a409 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:11.091020 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b4fd73fa-af21-480a-a8d1-cbb4f278a409 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:11.093258 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b4fd73fa-af21-480a-a8d1-cbb4f278a409 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:11.094407 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b4fd73fa-af21-480a-a8d1-cbb4f278a409 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:11.099692 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b4fd73fa-af21-480a-a8d1-cbb4f278a409 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:11.101588 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b4fd73fa-af21-480a-a8d1-cbb4f278a409 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:11.274622 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-f23b7160-fc6d-40e5-83de-239b45f29f4e tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:27:11.290587 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-f23b7160-fc6d-40e5-83de-239b45f29f4e tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:27:11.294674 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-f23b7160-fc6d-40e5-83de-239b45f29f4e tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:27:11.296802 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-f23b7160-fc6d-40e5-83de-239b45f29f4e tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] 10.222.0.58 "GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6" status: 200 len: 1877 microversion: 2.42 time: 0.667520 Aug 10 23:27:11.319250 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2633/5491] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:27:10 2022] GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6 => generated 1877 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:27:12.035108 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-b4fd73fa-af21-480a-a8d1-cbb4f278a409 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:27:12.097696 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-b4fd73fa-af21-480a-a8d1-cbb4f278a409 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:27:12.111168 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-b4fd73fa-af21-480a-a8d1-cbb4f278a409 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:27:12.117060 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-b4fd73fa-af21-480a-a8d1-cbb4f278a409 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800" status: 200 len: 1809 microversion: 2.20 time: 1.061595 Aug 10 23:27:12.121142 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2859/5492] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:27:11 2022] GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800 => generated 1809 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:27:12.329812 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-d944e284-6d3e-4b35-8f29-58ff0d002e0b tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:27:12.330889 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-d944e284-6d3e-4b35-8f29-58ff0d002e0b tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] [instance: 94831c62-29a5-4745-b321-11b28dafaaa6] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:27:12.348419 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d944e284-6d3e-4b35-8f29-58ff0d002e0b tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:12.356413 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d944e284-6d3e-4b35-8f29-58ff0d002e0b tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:12.358044 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d944e284-6d3e-4b35-8f29-58ff0d002e0b tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:12.361174 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d944e284-6d3e-4b35-8f29-58ff0d002e0b tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:12.361852 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d944e284-6d3e-4b35-8f29-58ff0d002e0b tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:12.362711 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d944e284-6d3e-4b35-8f29-58ff0d002e0b tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:12.794363 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-d944e284-6d3e-4b35-8f29-58ff0d002e0b tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:27:12.804464 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-d944e284-6d3e-4b35-8f29-58ff0d002e0b tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:27:12.812046 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-d944e284-6d3e-4b35-8f29-58ff0d002e0b tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:27:12.813358 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-d944e284-6d3e-4b35-8f29-58ff0d002e0b tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] 10.222.0.58 "GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6" status: 200 len: 1877 microversion: 2.42 time: 0.491651 Aug 10 23:27:12.815588 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2634/5493] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:27:12 2022] GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6 => generated 1877 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:27:13.147011 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-9de43975-79ec-4329-9162-6f90c4ddec66 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:27:13.147897 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-9de43975-79ec-4329-9162-6f90c4ddec66 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: 03e88a01-d3ed-4ab2-a334-f4bc274fe800] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:27:13.165587 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9de43975-79ec-4329-9162-6f90c4ddec66 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:13.170459 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9de43975-79ec-4329-9162-6f90c4ddec66 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:13.173117 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9de43975-79ec-4329-9162-6f90c4ddec66 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:13.174917 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9de43975-79ec-4329-9162-6f90c4ddec66 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:13.176904 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9de43975-79ec-4329-9162-6f90c4ddec66 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:13.179436 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9de43975-79ec-4329-9162-6f90c4ddec66 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:13.485581 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-9de43975-79ec-4329-9162-6f90c4ddec66 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:27:13.525935 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-9de43975-79ec-4329-9162-6f90c4ddec66 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:27:13.533759 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-9de43975-79ec-4329-9162-6f90c4ddec66 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:27:13.539637 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-9de43975-79ec-4329-9162-6f90c4ddec66 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800" status: 200 len: 1809 microversion: 2.20 time: 0.396186 Aug 10 23:27:13.540832 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2860/5494] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:27:13 2022] GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800 => generated 1809 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:27:13.849546 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-1d061a84-70f8-485f-b001-cae674af3079 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:27:13.850296 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-1d061a84-70f8-485f-b001-cae674af3079 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] [instance: 94831c62-29a5-4745-b321-11b28dafaaa6] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:27:13.864540 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1d061a84-70f8-485f-b001-cae674af3079 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:13.865055 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1d061a84-70f8-485f-b001-cae674af3079 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:13.869000 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1d061a84-70f8-485f-b001-cae674af3079 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:13.871271 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1d061a84-70f8-485f-b001-cae674af3079 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:13.871947 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1d061a84-70f8-485f-b001-cae674af3079 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:13.872547 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1d061a84-70f8-485f-b001-cae674af3079 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:14.214180 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-1d061a84-70f8-485f-b001-cae674af3079 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:27:14.232855 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-1d061a84-70f8-485f-b001-cae674af3079 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:27:14.234719 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-1d061a84-70f8-485f-b001-cae674af3079 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:27:14.237038 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-1d061a84-70f8-485f-b001-cae674af3079 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] 10.222.0.58 "GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6" status: 200 len: 1877 microversion: 2.42 time: 0.396402 Aug 10 23:27:14.237624 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2635/5495] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:27:13 2022] GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6 => generated 1877 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:27:14.567496 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-b1a0f898-a663-4fce-9a2c-404685614f36 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:27:14.567963 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-b1a0f898-a663-4fce-9a2c-404685614f36 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: 03e88a01-d3ed-4ab2-a334-f4bc274fe800] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:27:14.590750 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b1a0f898-a663-4fce-9a2c-404685614f36 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:14.590750 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b1a0f898-a663-4fce-9a2c-404685614f36 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:14.591738 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b1a0f898-a663-4fce-9a2c-404685614f36 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:14.592549 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b1a0f898-a663-4fce-9a2c-404685614f36 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:14.599840 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b1a0f898-a663-4fce-9a2c-404685614f36 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:14.606640 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b1a0f898-a663-4fce-9a2c-404685614f36 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:15.265953 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-dc9ee318-cc06-486f-b81c-268593c6dbe3 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:27:15.267735 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-dc9ee318-cc06-486f-b81c-268593c6dbe3 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] [instance: 94831c62-29a5-4745-b321-11b28dafaaa6] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:27:15.283704 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dc9ee318-cc06-486f-b81c-268593c6dbe3 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:15.288720 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dc9ee318-cc06-486f-b81c-268593c6dbe3 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:15.289447 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dc9ee318-cc06-486f-b81c-268593c6dbe3 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:15.290415 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dc9ee318-cc06-486f-b81c-268593c6dbe3 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:15.291254 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dc9ee318-cc06-486f-b81c-268593c6dbe3 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:15.292205 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dc9ee318-cc06-486f-b81c-268593c6dbe3 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:15.598131 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-b1a0f898-a663-4fce-9a2c-404685614f36 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:27:15.608713 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-b1a0f898-a663-4fce-9a2c-404685614f36 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:27:15.621969 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-b1a0f898-a663-4fce-9a2c-404685614f36 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:27:15.631105 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-b1a0f898-a663-4fce-9a2c-404685614f36 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800" status: 200 len: 1796 microversion: 2.20 time: 1.068623 Aug 10 23:27:15.631838 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2861/5496] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:27:14 2022] GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800 => generated 1796 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:27:16.115374 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-dc9ee318-cc06-486f-b81c-268593c6dbe3 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:27:16.129429 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-dc9ee318-cc06-486f-b81c-268593c6dbe3 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:27:16.141639 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-dc9ee318-cc06-486f-b81c-268593c6dbe3 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:27:16.142991 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-dc9ee318-cc06-486f-b81c-268593c6dbe3 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] 10.222.0.58 "GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6" status: 200 len: 1877 microversion: 2.42 time: 0.882052 Aug 10 23:27:16.143466 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2636/5497] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:27:15 2022] GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6 => generated 1877 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 23:27:17.169688 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-9006b8ec-6748-427f-907e-0911c60aea7c tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:27:17.170834 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-9006b8ec-6748-427f-907e-0911c60aea7c tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] [instance: 94831c62-29a5-4745-b321-11b28dafaaa6] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:27:17.192253 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9006b8ec-6748-427f-907e-0911c60aea7c tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:17.197832 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9006b8ec-6748-427f-907e-0911c60aea7c tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:17.198260 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9006b8ec-6748-427f-907e-0911c60aea7c tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:17.200436 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9006b8ec-6748-427f-907e-0911c60aea7c tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:17.208021 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9006b8ec-6748-427f-907e-0911c60aea7c tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:17.208485 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9006b8ec-6748-427f-907e-0911c60aea7c tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:17.822834 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-9006b8ec-6748-427f-907e-0911c60aea7c tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:27:17.832793 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=100 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:27:17.848626 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-9006b8ec-6748-427f-907e-0911c60aea7c tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:27:17.856323 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-9006b8ec-6748-427f-907e-0911c60aea7c tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:27:17.864095 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-9006b8ec-6748-427f-907e-0911c60aea7c tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] 10.222.0.58 "GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6" status: 200 len: 1877 microversion: 2.42 time: 0.695969 Aug 10 23:27:17.867118 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2862/5498] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:27:17 2022] GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6 => generated 1877 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:27:18.891262 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-b832b4b8-caf5-4568-9e72-b335042bd2af tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:27:18.891878 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-b832b4b8-caf5-4568-9e72-b335042bd2af tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] [instance: 94831c62-29a5-4745-b321-11b28dafaaa6] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:27:18.909622 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b832b4b8-caf5-4568-9e72-b335042bd2af tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:18.913833 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b832b4b8-caf5-4568-9e72-b335042bd2af tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:18.914608 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b832b4b8-caf5-4568-9e72-b335042bd2af tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:18.916125 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b832b4b8-caf5-4568-9e72-b335042bd2af tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:18.917008 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b832b4b8-caf5-4568-9e72-b335042bd2af tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:18.919426 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b832b4b8-caf5-4568-9e72-b335042bd2af tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:19.437958 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-b832b4b8-caf5-4568-9e72-b335042bd2af tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:27:19.450554 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-b832b4b8-caf5-4568-9e72-b335042bd2af tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:27:19.452182 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-b832b4b8-caf5-4568-9e72-b335042bd2af tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:27:19.453389 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-b832b4b8-caf5-4568-9e72-b335042bd2af tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] 10.222.0.58 "GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6" status: 200 len: 1877 microversion: 2.42 time: 0.567711 Aug 10 23:27:19.453968 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2637/5499] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:27:18 2022] GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6 => generated 1877 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:27:20.479088 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-fa86fb1a-8a90-4431-bb80-da2e43e9e068 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:27:20.481086 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-fa86fb1a-8a90-4431-bb80-da2e43e9e068 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] [instance: 94831c62-29a5-4745-b321-11b28dafaaa6] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:27:20.495717 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fa86fb1a-8a90-4431-bb80-da2e43e9e068 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:20.510154 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fa86fb1a-8a90-4431-bb80-da2e43e9e068 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:20.513822 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fa86fb1a-8a90-4431-bb80-da2e43e9e068 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:20.517735 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fa86fb1a-8a90-4431-bb80-da2e43e9e068 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:20.518430 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fa86fb1a-8a90-4431-bb80-da2e43e9e068 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:20.522185 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fa86fb1a-8a90-4431-bb80-da2e43e9e068 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:21.235152 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-fa86fb1a-8a90-4431-bb80-da2e43e9e068 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:27:21.257170 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-fa86fb1a-8a90-4431-bb80-da2e43e9e068 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:27:21.267993 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-fa86fb1a-8a90-4431-bb80-da2e43e9e068 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:27:21.274624 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-fa86fb1a-8a90-4431-bb80-da2e43e9e068 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] 10.222.0.58 "GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6" status: 200 len: 1877 microversion: 2.42 time: 0.797493 Aug 10 23:27:21.275278 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2863/5500] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:27:20 2022] GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6 => generated 1877 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:27:22.301614 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c12c545c-d90e-4136-a4ef-8e26fcc0b13e tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:27:22.302908 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-c12c545c-d90e-4136-a4ef-8e26fcc0b13e tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] [instance: 94831c62-29a5-4745-b321-11b28dafaaa6] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:27:22.319770 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c12c545c-d90e-4136-a4ef-8e26fcc0b13e tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:22.320518 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c12c545c-d90e-4136-a4ef-8e26fcc0b13e tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:22.325443 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c12c545c-d90e-4136-a4ef-8e26fcc0b13e tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:22.326682 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c12c545c-d90e-4136-a4ef-8e26fcc0b13e tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:22.327589 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c12c545c-d90e-4136-a4ef-8e26fcc0b13e tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:22.328196 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c12c545c-d90e-4136-a4ef-8e26fcc0b13e tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:22.439586 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-bb5a65f5-5ed9-4dea-89ec-5740611c8182 req-1be5652a-307c-47df-83bf-264fbb44566a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94831c62-29a5-4745-b321-11b28dafaaa6", "name": "network-vif-plugged", "status": "completed", "tag": "cd619ffb-72c7-4f4d-88b0-2923eb1f3d04"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:27:22.458229 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-bb5a65f5-5ed9-4dea-89ec-5740611c8182 req-1be5652a-307c-47df-83bf-264fbb44566a service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:22.460746 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-bb5a65f5-5ed9-4dea-89ec-5740611c8182 req-1be5652a-307c-47df-83bf-264fbb44566a service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:22.464138 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-bb5a65f5-5ed9-4dea-89ec-5740611c8182 req-1be5652a-307c-47df-83bf-264fbb44566a service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:22.491370 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-bb5a65f5-5ed9-4dea-89ec-5740611c8182 req-1be5652a-307c-47df-83bf-264fbb44566a service nova] Creating event network-vif-plugged:cd619ffb-72c7-4f4d-88b0-2923eb1f3d04 for instance 94831c62-29a5-4745-b321-11b28dafaaa6 on n-h2-850468-14 Aug 10 23:27:22.503161 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-bb5a65f5-5ed9-4dea-89ec-5740611c8182 req-1be5652a-307c-47df-83bf-264fbb44566a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067875 Aug 10 23:27:22.508243 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2864/5501] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:27:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:27:22.631916 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-c12c545c-d90e-4136-a4ef-8e26fcc0b13e tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:27:22.651732 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-c12c545c-d90e-4136-a4ef-8e26fcc0b13e tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:27:22.664730 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-c12c545c-d90e-4136-a4ef-8e26fcc0b13e tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:27:22.665798 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-c12c545c-d90e-4136-a4ef-8e26fcc0b13e tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] 10.222.0.58 "GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6" status: 200 len: 1877 microversion: 2.42 time: 0.368201 Aug 10 23:27:22.673190 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2638/5502] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:27:22 2022] GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6 => generated 1877 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:27:23.691373 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-beb4d26e-7160-49e6-aa83-cf2d91394540 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:27:23.693350 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-beb4d26e-7160-49e6-aa83-cf2d91394540 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] [instance: 94831c62-29a5-4745-b321-11b28dafaaa6] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:27:23.722883 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-beb4d26e-7160-49e6-aa83-cf2d91394540 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:23.726583 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-beb4d26e-7160-49e6-aa83-cf2d91394540 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:23.727480 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-beb4d26e-7160-49e6-aa83-cf2d91394540 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:23.728427 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-beb4d26e-7160-49e6-aa83-cf2d91394540 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:23.730531 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-beb4d26e-7160-49e6-aa83-cf2d91394540 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:23.732379 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-beb4d26e-7160-49e6-aa83-cf2d91394540 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:24.580486 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-70217e75-9a85-4dfb-a77d-df8449447b12 req-62ed75bb-28c1-4199-a951-00d9b013c18d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94831c62-29a5-4745-b321-11b28dafaaa6", "name": "network-vif-plugged", "status": "completed", "tag": "4ea7c095-71fb-40ed-b707-b71bba302403"}, {"server_uuid": "94831c62-29a5-4745-b321-11b28dafaaa6", "name": "network-vif-plugged", "status": "completed", "tag": "ed350d10-8d47-46e3-bde8-9f8f5eaad3a6"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:27:24.612198 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-70217e75-9a85-4dfb-a77d-df8449447b12 req-62ed75bb-28c1-4199-a951-00d9b013c18d service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:24.615094 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-70217e75-9a85-4dfb-a77d-df8449447b12 req-62ed75bb-28c1-4199-a951-00d9b013c18d service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:24.617511 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-70217e75-9a85-4dfb-a77d-df8449447b12 req-62ed75bb-28c1-4199-a951-00d9b013c18d service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:24.647723 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-70217e75-9a85-4dfb-a77d-df8449447b12 req-62ed75bb-28c1-4199-a951-00d9b013c18d service nova] Creating event network-vif-plugged:4ea7c095-71fb-40ed-b707-b71bba302403 for instance 94831c62-29a5-4745-b321-11b28dafaaa6 on n-h2-850468-14 Aug 10 23:27:24.650277 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-70217e75-9a85-4dfb-a77d-df8449447b12 req-62ed75bb-28c1-4199-a951-00d9b013c18d service nova] Creating event network-vif-plugged:ed350d10-8d47-46e3-bde8-9f8f5eaad3a6 for instance 94831c62-29a5-4745-b321-11b28dafaaa6 on n-h2-850468-14 Aug 10 23:27:24.682633 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-beb4d26e-7160-49e6-aa83-cf2d91394540 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:27:24.686292 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-70217e75-9a85-4dfb-a77d-df8449447b12 req-62ed75bb-28c1-4199-a951-00d9b013c18d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.110628 Aug 10 23:27:24.697752 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2639/5503] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:27:24 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:27:24.744430 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-beb4d26e-7160-49e6-aa83-cf2d91394540 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:27:24.754769 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-beb4d26e-7160-49e6-aa83-cf2d91394540 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:27:24.756378 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-beb4d26e-7160-49e6-aa83-cf2d91394540 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] 10.222.0.58 "GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6" status: 200 len: 1877 microversion: 2.42 time: 1.069589 Aug 10 23:27:24.760399 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2865/5504] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:27:23 2022] GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6 => generated 1877 bytes in 1074 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:27:25.791728 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-4e687c3a-8d2e-4a94-8221-e8da2da66205 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:27:25.794009 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-4e687c3a-8d2e-4a94-8221-e8da2da66205 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] [instance: 94831c62-29a5-4745-b321-11b28dafaaa6] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:27:25.815056 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4e687c3a-8d2e-4a94-8221-e8da2da66205 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:25.816154 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4e687c3a-8d2e-4a94-8221-e8da2da66205 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:25.816614 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4e687c3a-8d2e-4a94-8221-e8da2da66205 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:25.817358 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4e687c3a-8d2e-4a94-8221-e8da2da66205 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:25.817817 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4e687c3a-8d2e-4a94-8221-e8da2da66205 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:25.818238 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4e687c3a-8d2e-4a94-8221-e8da2da66205 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:26.606421 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-4e687c3a-8d2e-4a94-8221-e8da2da66205 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:27:26.619873 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-4e687c3a-8d2e-4a94-8221-e8da2da66205 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:27:26.623024 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-4e687c3a-8d2e-4a94-8221-e8da2da66205 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:27:26.624885 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-4e687c3a-8d2e-4a94-8221-e8da2da66205 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] 10.222.0.58 "GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6" status: 200 len: 1877 microversion: 2.42 time: 0.838771 Aug 10 23:27:26.625877 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2640/5505] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:27:25 2022] GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6 => generated 1877 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:27:26.784896 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-fe05a412-999b-44d2-992b-37d7c5294a7d req-a21fdad7-7707-4a1d-9cba-10310b12f726 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94831c62-29a5-4745-b321-11b28dafaaa6", "name": "network-vif-plugged", "status": "completed", "tag": "c9cab9a2-351a-4700-9d8b-f72f4f00057f"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:27:26.830508 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-fe05a412-999b-44d2-992b-37d7c5294a7d req-a21fdad7-7707-4a1d-9cba-10310b12f726 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:26.831049 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-fe05a412-999b-44d2-992b-37d7c5294a7d req-a21fdad7-7707-4a1d-9cba-10310b12f726 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:26.833886 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-fe05a412-999b-44d2-992b-37d7c5294a7d req-a21fdad7-7707-4a1d-9cba-10310b12f726 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:26.880776 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-fe05a412-999b-44d2-992b-37d7c5294a7d req-a21fdad7-7707-4a1d-9cba-10310b12f726 service nova] Creating event network-vif-plugged:c9cab9a2-351a-4700-9d8b-f72f4f00057f for instance 94831c62-29a5-4745-b321-11b28dafaaa6 on n-h2-850468-14 Aug 10 23:27:26.904318 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-fe05a412-999b-44d2-992b-37d7c5294a7d req-a21fdad7-7707-4a1d-9cba-10310b12f726 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127365 Aug 10 23:27:26.904993 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2866/5506] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:27:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:27:27.653586 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-fa9a4a5f-be6c-4924-865f-9d4e5a6de192 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:27:27.654589 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-fa9a4a5f-be6c-4924-865f-9d4e5a6de192 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] [instance: 94831c62-29a5-4745-b321-11b28dafaaa6] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:27:27.658181 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_api:SELECT=34 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:27:27.675180 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fa9a4a5f-be6c-4924-865f-9d4e5a6de192 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:27.684357 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fa9a4a5f-be6c-4924-865f-9d4e5a6de192 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:27.689438 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fa9a4a5f-be6c-4924-865f-9d4e5a6de192 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:27.700352 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fa9a4a5f-be6c-4924-865f-9d4e5a6de192 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:27.702700 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fa9a4a5f-be6c-4924-865f-9d4e5a6de192 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:27.705863 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fa9a4a5f-be6c-4924-865f-9d4e5a6de192 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:28.293652 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-fa9a4a5f-be6c-4924-865f-9d4e5a6de192 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:27:28.307247 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-fa9a4a5f-be6c-4924-865f-9d4e5a6de192 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:27:28.309375 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-fa9a4a5f-be6c-4924-865f-9d4e5a6de192 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:27:28.310575 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-fa9a4a5f-be6c-4924-865f-9d4e5a6de192 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] 10.222.0.58 "GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6" status: 200 len: 1877 microversion: 2.42 time: 0.662570 Aug 10 23:27:28.311182 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2641/5507] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:27:27 2022] GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6 => generated 1877 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:27:29.015446 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-90ff3788-303b-43b5-9dd4-a48af47e4703 req-65e277aa-48c6-4cd4-ab88-ab2f9b4c8dc6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94831c62-29a5-4745-b321-11b28dafaaa6", "name": "network-vif-plugged", "status": "completed", "tag": "331b6d87-c1d3-4591-bc0e-3825a4fc234e"}, {"server_uuid": "94831c62-29a5-4745-b321-11b28dafaaa6", "name": "network-vif-plugged", "status": "completed", "tag": "6ee28c71-7f46-4357-91a2-e3f81d338784"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:27:29.052905 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_api:SELECT=32 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:27:29.058672 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-90ff3788-303b-43b5-9dd4-a48af47e4703 req-65e277aa-48c6-4cd4-ab88-ab2f9b4c8dc6 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:29.070123 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-90ff3788-303b-43b5-9dd4-a48af47e4703 req-65e277aa-48c6-4cd4-ab88-ab2f9b4c8dc6 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:29.070753 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-90ff3788-303b-43b5-9dd4-a48af47e4703 req-65e277aa-48c6-4cd4-ab88-ab2f9b4c8dc6 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:29.090839 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-90ff3788-303b-43b5-9dd4-a48af47e4703 req-65e277aa-48c6-4cd4-ab88-ab2f9b4c8dc6 service nova] Creating event network-vif-plugged:331b6d87-c1d3-4591-bc0e-3825a4fc234e for instance 94831c62-29a5-4745-b321-11b28dafaaa6 on n-h2-850468-14 Aug 10 23:27:29.091830 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-90ff3788-303b-43b5-9dd4-a48af47e4703 req-65e277aa-48c6-4cd4-ab88-ab2f9b4c8dc6 service nova] Creating event network-vif-plugged:6ee28c71-7f46-4357-91a2-e3f81d338784 for instance 94831c62-29a5-4745-b321-11b28dafaaa6 on n-h2-850468-14 Aug 10 23:27:29.107269 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-90ff3788-303b-43b5-9dd4-a48af47e4703 req-65e277aa-48c6-4cd4-ab88-ab2f9b4c8dc6 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.099511 Aug 10 23:27:29.108079 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2867/5508] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:27:29 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:27:29.337807 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-84992b41-fbd8-4233-9136-c62534146689 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:27:29.338547 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-84992b41-fbd8-4233-9136-c62534146689 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] [instance: 94831c62-29a5-4745-b321-11b28dafaaa6] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:27:29.353544 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-84992b41-fbd8-4233-9136-c62534146689 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:29.361005 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-84992b41-fbd8-4233-9136-c62534146689 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:29.361850 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-84992b41-fbd8-4233-9136-c62534146689 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:29.362957 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-84992b41-fbd8-4233-9136-c62534146689 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:29.365081 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-84992b41-fbd8-4233-9136-c62534146689 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:29.367827 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-84992b41-fbd8-4233-9136-c62534146689 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:29.711553 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-84992b41-fbd8-4233-9136-c62534146689 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:27:29.726861 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-84992b41-fbd8-4233-9136-c62534146689 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:27:29.730704 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-84992b41-fbd8-4233-9136-c62534146689 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:27:29.735041 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-84992b41-fbd8-4233-9136-c62534146689 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] 10.222.0.58 "GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6" status: 200 len: 1877 microversion: 2.42 time: 0.401282 Aug 10 23:27:29.755016 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2642/5509] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:27:29 2022] GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6 => generated 1877 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:27:30.769046 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-b32eecd7-ec59-4fa7-b6d1-76798888b4b8 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:27:30.770681 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-b32eecd7-ec59-4fa7-b6d1-76798888b4b8 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] [instance: 94831c62-29a5-4745-b321-11b28dafaaa6] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:27:30.779060 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b32eecd7-ec59-4fa7-b6d1-76798888b4b8 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:30.779777 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b32eecd7-ec59-4fa7-b6d1-76798888b4b8 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:30.780376 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b32eecd7-ec59-4fa7-b6d1-76798888b4b8 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:30.781449 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b32eecd7-ec59-4fa7-b6d1-76798888b4b8 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:30.782186 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b32eecd7-ec59-4fa7-b6d1-76798888b4b8 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:30.782773 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b32eecd7-ec59-4fa7-b6d1-76798888b4b8 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:31.190539 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-52767a3e-6bbb-4e41-838e-1ec87b59b806 req-cdeae7f0-0940-412f-8cd0-4c34f2e5cec2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94831c62-29a5-4745-b321-11b28dafaaa6", "name": "network-vif-plugged", "status": "completed", "tag": "a925a35c-5deb-47db-b01a-bff542b92a26"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:27:31.216463 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-52767a3e-6bbb-4e41-838e-1ec87b59b806 req-cdeae7f0-0940-412f-8cd0-4c34f2e5cec2 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:31.218425 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-52767a3e-6bbb-4e41-838e-1ec87b59b806 req-cdeae7f0-0940-412f-8cd0-4c34f2e5cec2 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:31.220065 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-52767a3e-6bbb-4e41-838e-1ec87b59b806 req-cdeae7f0-0940-412f-8cd0-4c34f2e5cec2 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:31.241193 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-52767a3e-6bbb-4e41-838e-1ec87b59b806 req-cdeae7f0-0940-412f-8cd0-4c34f2e5cec2 service nova] Creating event network-vif-plugged:a925a35c-5deb-47db-b01a-bff542b92a26 for instance 94831c62-29a5-4745-b321-11b28dafaaa6 on n-h2-850468-14 Aug 10 23:27:31.261184 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-52767a3e-6bbb-4e41-838e-1ec87b59b806 req-cdeae7f0-0940-412f-8cd0-4c34f2e5cec2 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074981 Aug 10 23:27:31.261748 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2643/5510] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:27:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 23:27:31.286689 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-b32eecd7-ec59-4fa7-b6d1-76798888b4b8 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:27:31.337255 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-b32eecd7-ec59-4fa7-b6d1-76798888b4b8 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:27:31.350561 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-b32eecd7-ec59-4fa7-b6d1-76798888b4b8 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:27:31.357573 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-b32eecd7-ec59-4fa7-b6d1-76798888b4b8 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] 10.222.0.58 "GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6" status: 200 len: 1877 microversion: 2.42 time: 0.599203 Aug 10 23:27:31.358643 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2868/5511] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:27:30 2022] GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6 => generated 1877 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:27:32.403043 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-7ab6c25c-74f6-4730-be51-de0f5b9cf69c tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:27:32.406924 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-7ab6c25c-74f6-4730-be51-de0f5b9cf69c tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] [instance: 94831c62-29a5-4745-b321-11b28dafaaa6] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:27:32.447711 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7ab6c25c-74f6-4730-be51-de0f5b9cf69c tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:32.454536 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7ab6c25c-74f6-4730-be51-de0f5b9cf69c tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:32.456627 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7ab6c25c-74f6-4730-be51-de0f5b9cf69c tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:32.457493 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7ab6c25c-74f6-4730-be51-de0f5b9cf69c tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:32.460470 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7ab6c25c-74f6-4730-be51-de0f5b9cf69c tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:32.461916 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7ab6c25c-74f6-4730-be51-de0f5b9cf69c tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:33.045287 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-7ab6c25c-74f6-4730-be51-de0f5b9cf69c tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:27:33.069085 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-7ab6c25c-74f6-4730-be51-de0f5b9cf69c tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:27:33.072985 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-7ab6c25c-74f6-4730-be51-de0f5b9cf69c tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:27:33.091019 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-7ab6c25c-74f6-4730-be51-de0f5b9cf69c tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] 10.222.0.58 "GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6" status: 200 len: 1877 microversion: 2.42 time: 0.703085 Aug 10 23:27:33.092894 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2644/5512] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:27:32 2022] GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6 => generated 1877 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:27:34.121198 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-181fce60-7503-4c45-9122-16d62dde0409 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:27:34.122877 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-181fce60-7503-4c45-9122-16d62dde0409 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] [instance: 94831c62-29a5-4745-b321-11b28dafaaa6] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:27:34.143596 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-181fce60-7503-4c45-9122-16d62dde0409 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:34.144941 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-181fce60-7503-4c45-9122-16d62dde0409 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:34.146010 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-181fce60-7503-4c45-9122-16d62dde0409 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:34.147344 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-181fce60-7503-4c45-9122-16d62dde0409 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:34.150196 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-181fce60-7503-4c45-9122-16d62dde0409 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:34.151968 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-181fce60-7503-4c45-9122-16d62dde0409 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:34.747834 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-181fce60-7503-4c45-9122-16d62dde0409 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:27:34.774411 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-181fce60-7503-4c45-9122-16d62dde0409 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:27:34.777430 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-181fce60-7503-4c45-9122-16d62dde0409 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:27:34.780471 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-181fce60-7503-4c45-9122-16d62dde0409 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] 10.222.0.58 "GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6" status: 200 len: 2835 microversion: 2.42 time: 0.664080 Aug 10 23:27:34.783208 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2869/5513] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:27:34 2022] GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6 => generated 2835 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:27:34.806542 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c3ea165a-91f8-429c-97f2-276695a5a388 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:27:34.807109 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-c3ea165a-91f8-429c-97f2-276695a5a388 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] [instance: 94831c62-29a5-4745-b321-11b28dafaaa6] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:27:34.820646 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c3ea165a-91f8-429c-97f2-276695a5a388 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:34.821883 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c3ea165a-91f8-429c-97f2-276695a5a388 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:34.822394 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c3ea165a-91f8-429c-97f2-276695a5a388 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:34.823595 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c3ea165a-91f8-429c-97f2-276695a5a388 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:34.824178 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c3ea165a-91f8-429c-97f2-276695a5a388 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:34.824480 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c3ea165a-91f8-429c-97f2-276695a5a388 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:35.095749 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-c3ea165a-91f8-429c-97f2-276695a5a388 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] 10.222.0.58 "GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6/os-interface" status: 200 len: 1831 microversion: 2.42 time: 0.293465 Aug 10 23:27:35.096352 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2645/5514] 10.222.0.58 () {60 vars in 1316 bytes} [Wed Aug 10 23:27:34 2022] GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6/os-interface => generated 1831 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:27:38.111484 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-229f9005-ea5a-4484-8cdc-e19cab7d873a req-d0df0946-810d-4b41-8780-2d4470d49588 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94831c62-29a5-4745-b321-11b28dafaaa6", "tag": "6ee28c71-7f46-4357-91a2-e3f81d338784"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:27:38.138301 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-229f9005-ea5a-4484-8cdc-e19cab7d873a req-d0df0946-810d-4b41-8780-2d4470d49588 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:38.140029 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-229f9005-ea5a-4484-8cdc-e19cab7d873a req-d0df0946-810d-4b41-8780-2d4470d49588 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:38.142627 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-229f9005-ea5a-4484-8cdc-e19cab7d873a req-d0df0946-810d-4b41-8780-2d4470d49588 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:38.168734 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-229f9005-ea5a-4484-8cdc-e19cab7d873a req-d0df0946-810d-4b41-8780-2d4470d49588 service nova] Creating event network-changed:6ee28c71-7f46-4357-91a2-e3f81d338784 for instance 94831c62-29a5-4745-b321-11b28dafaaa6 on n-h2-850468-14 Aug 10 23:27:38.180416 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-229f9005-ea5a-4484-8cdc-e19cab7d873a req-d0df0946-810d-4b41-8780-2d4470d49588 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.475768 Aug 10 23:27:38.182617 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2870/5515] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:27:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:27:45.725243 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_api:SELECT=9 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:27:45.726451 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=75 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:27:45.737959 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-a82cb4bd-5f69-4d30-a32f-fc451c366d08 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:27:45.744712 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-a82cb4bd-5f69-4d30-a32f-fc451c366d08 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: 03e88a01-d3ed-4ab2-a334-f4bc274fe800] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:27:45.770095 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a82cb4bd-5f69-4d30-a32f-fc451c366d08 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:45.771002 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a82cb4bd-5f69-4d30-a32f-fc451c366d08 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:45.771637 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a82cb4bd-5f69-4d30-a32f-fc451c366d08 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:45.773866 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a82cb4bd-5f69-4d30-a32f-fc451c366d08 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:45.774831 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a82cb4bd-5f69-4d30-a32f-fc451c366d08 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:45.779024 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a82cb4bd-5f69-4d30-a32f-fc451c366d08 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:45.822038 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-a82cb4bd-5f69-4d30-a32f-fc451c366d08 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800/os-volume_attachments/6a48a73d-a806-49d0-9dd3-e5c8fb4f0d74" status: 200 len: 194 microversion: 2.20 time: 0.100721 Aug 10 23:27:45.830645 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2646/5516] 10.222.0.58 () {60 vars in 1454 bytes} [Wed Aug 10 23:27:45 2022] GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800/os-volume_attachments/6a48a73d-a806-49d0-9dd3-e5c8fb4f0d74 => generated 194 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 23:27:45.932117 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-9efa4d66-ab88-48b4-8ae3-d1e653367ee6 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:27:45.932984 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-9efa4d66-ab88-48b4-8ae3-d1e653367ee6 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: 03e88a01-d3ed-4ab2-a334-f4bc274fe800] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:27:45.950511 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9efa4d66-ab88-48b4-8ae3-d1e653367ee6 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:45.956394 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9efa4d66-ab88-48b4-8ae3-d1e653367ee6 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:45.957338 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9efa4d66-ab88-48b4-8ae3-d1e653367ee6 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:45.958818 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9efa4d66-ab88-48b4-8ae3-d1e653367ee6 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:45.959438 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9efa4d66-ab88-48b4-8ae3-d1e653367ee6 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:45.960256 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9efa4d66-ab88-48b4-8ae3-d1e653367ee6 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:46.165004 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.objects.instance [None req-9efa4d66-ab88-48b4-8ae3-d1e653367ee6 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lazy-loading 'services' on Instance uuid 03e88a01-d3ed-4ab2-a334-f4bc274fe800 {{(pid=122633) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:27:46.349709 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-9efa4d66-ab88-48b4-8ae3-d1e653367ee6 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "DELETE /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800/os-volume_attachments/6a48a73d-a806-49d0-9dd3-e5c8fb4f0d74" status: 202 len: 0 microversion: 2.20 time: 0.420979 Aug 10 23:27:46.352744 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2871/5517] 10.222.0.58 () {60 vars in 1457 bytes} [Wed Aug 10 23:27:45 2022] DELETE /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800/os-volume_attachments/6a48a73d-a806-49d0-9dd3-e5c8fb4f0d74 => generated 0 bytes in 426 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:27:46.364274 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-5629f4ff-a319-4deb-b66e-23c82833958b tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:27:46.368311 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-5629f4ff-a319-4deb-b66e-23c82833958b tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: 03e88a01-d3ed-4ab2-a334-f4bc274fe800] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:27:46.388490 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5629f4ff-a319-4deb-b66e-23c82833958b tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:46.393064 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5629f4ff-a319-4deb-b66e-23c82833958b tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:46.394217 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5629f4ff-a319-4deb-b66e-23c82833958b tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:46.395178 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5629f4ff-a319-4deb-b66e-23c82833958b tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:46.398911 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5629f4ff-a319-4deb-b66e-23c82833958b tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:46.399877 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5629f4ff-a319-4deb-b66e-23c82833958b tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:46.486445 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-5629f4ff-a319-4deb-b66e-23c82833958b tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.126969 Aug 10 23:27:46.491674 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2647/5518] 10.222.0.58 () {60 vars in 1343 bytes} [Wed Aug 10 23:27:46 2022] GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800/os-volume_attachments => generated 197 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 23:27:47.505252 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-22006d4a-87ea-43fc-ad6a-949dc659bcc4 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:27:47.507646 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-22006d4a-87ea-43fc-ad6a-949dc659bcc4 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: 03e88a01-d3ed-4ab2-a334-f4bc274fe800] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:27:47.538985 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-22006d4a-87ea-43fc-ad6a-949dc659bcc4 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:47.540327 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-22006d4a-87ea-43fc-ad6a-949dc659bcc4 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:47.543052 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-22006d4a-87ea-43fc-ad6a-949dc659bcc4 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:47.544547 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-22006d4a-87ea-43fc-ad6a-949dc659bcc4 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:47.546088 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-22006d4a-87ea-43fc-ad6a-949dc659bcc4 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:47.546543 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-22006d4a-87ea-43fc-ad6a-949dc659bcc4 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:47.634795 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-22006d4a-87ea-43fc-ad6a-949dc659bcc4 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.128056 Aug 10 23:27:47.634795 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2872/5519] 10.222.0.58 () {60 vars in 1343 bytes} [Wed Aug 10 23:27:47 2022] GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800/os-volume_attachments => generated 197 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 23:27:48.645765 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-6a51082c-e2f8-44c1-af05-7ee7c7e6164d tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:27:48.648991 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-6a51082c-e2f8-44c1-af05-7ee7c7e6164d tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: 03e88a01-d3ed-4ab2-a334-f4bc274fe800] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:27:48.672849 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6a51082c-e2f8-44c1-af05-7ee7c7e6164d tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:48.677805 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6a51082c-e2f8-44c1-af05-7ee7c7e6164d tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:48.678821 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6a51082c-e2f8-44c1-af05-7ee7c7e6164d tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:48.680158 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6a51082c-e2f8-44c1-af05-7ee7c7e6164d tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:48.680787 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6a51082c-e2f8-44c1-af05-7ee7c7e6164d tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:48.681824 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6a51082c-e2f8-44c1-af05-7ee7c7e6164d tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:48.799512 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-6a51082c-e2f8-44c1-af05-7ee7c7e6164d tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.158324 Aug 10 23:27:48.804112 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2648/5520] 10.222.0.58 () {60 vars in 1343 bytes} [Wed Aug 10 23:27:48 2022] GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800/os-volume_attachments => generated 197 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 23:27:49.818481 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-053084bd-a920-43d5-884a-7aeedfc197e1 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:27:49.823169 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-053084bd-a920-43d5-884a-7aeedfc197e1 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: 03e88a01-d3ed-4ab2-a334-f4bc274fe800] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:27:49.844474 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-053084bd-a920-43d5-884a-7aeedfc197e1 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:49.856733 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-053084bd-a920-43d5-884a-7aeedfc197e1 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:49.857297 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-053084bd-a920-43d5-884a-7aeedfc197e1 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:49.858156 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-053084bd-a920-43d5-884a-7aeedfc197e1 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:49.863460 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-053084bd-a920-43d5-884a-7aeedfc197e1 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:49.864536 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-053084bd-a920-43d5-884a-7aeedfc197e1 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:49.942660 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-053084bd-a920-43d5-884a-7aeedfc197e1 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.130251 Aug 10 23:27:49.944719 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2873/5521] 10.222.0.58 () {60 vars in 1343 bytes} [Wed Aug 10 23:27:49 2022] GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800/os-volume_attachments => generated 197 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 23:27:50.956056 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-6457b293-6558-45e0-872b-35e919a95be9 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:27:50.958946 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-6457b293-6558-45e0-872b-35e919a95be9 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: 03e88a01-d3ed-4ab2-a334-f4bc274fe800] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:27:50.971145 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6457b293-6558-45e0-872b-35e919a95be9 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:50.971634 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6457b293-6558-45e0-872b-35e919a95be9 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:50.972070 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6457b293-6558-45e0-872b-35e919a95be9 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:50.973768 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6457b293-6558-45e0-872b-35e919a95be9 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:50.974226 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6457b293-6558-45e0-872b-35e919a95be9 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:50.974665 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6457b293-6558-45e0-872b-35e919a95be9 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:51.019032 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-6457b293-6558-45e0-872b-35e919a95be9 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.067057 Aug 10 23:27:51.020006 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2649/5522] 10.222.0.58 () {60 vars in 1343 bytes} [Wed Aug 10 23:27:50 2022] GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 23:27:52.037339 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-dca95258-0db4-420e-b33c-73f02749a9e7 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:27:52.040630 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-dca95258-0db4-420e-b33c-73f02749a9e7 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: 03e88a01-d3ed-4ab2-a334-f4bc274fe800] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:27:52.083002 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dca95258-0db4-420e-b33c-73f02749a9e7 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:52.084548 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dca95258-0db4-420e-b33c-73f02749a9e7 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:52.085587 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dca95258-0db4-420e-b33c-73f02749a9e7 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:52.090179 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dca95258-0db4-420e-b33c-73f02749a9e7 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:52.090958 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dca95258-0db4-420e-b33c-73f02749a9e7 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:52.091781 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dca95258-0db4-420e-b33c-73f02749a9e7 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:52.105262 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=1 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:27:52.143693 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-dca95258-0db4-420e-b33c-73f02749a9e7 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.115263 Aug 10 23:27:52.144518 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2874/5523] 10.222.0.58 () {60 vars in 1343 bytes} [Wed Aug 10 23:27:52 2022] GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800/os-volume_attachments => generated 197 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 23:27:53.157840 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-d74a659c-d7f7-4ab0-bdad-c14c9fcb5c6a tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:27:53.161149 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-d74a659c-d7f7-4ab0-bdad-c14c9fcb5c6a tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: 03e88a01-d3ed-4ab2-a334-f4bc274fe800] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:27:53.184438 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d74a659c-d7f7-4ab0-bdad-c14c9fcb5c6a tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:53.184921 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d74a659c-d7f7-4ab0-bdad-c14c9fcb5c6a tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:53.185358 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d74a659c-d7f7-4ab0-bdad-c14c9fcb5c6a tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:53.187959 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d74a659c-d7f7-4ab0-bdad-c14c9fcb5c6a tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:53.188448 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d74a659c-d7f7-4ab0-bdad-c14c9fcb5c6a tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:53.188872 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d74a659c-d7f7-4ab0-bdad-c14c9fcb5c6a tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:53.316037 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-d74a659c-d7f7-4ab0-bdad-c14c9fcb5c6a tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.160203 Aug 10 23:27:53.321078 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2650/5524] 10.222.0.58 () {60 vars in 1343 bytes} [Wed Aug 10 23:27:53 2022] GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800/os-volume_attachments => generated 197 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 23:27:54.330855 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-a774fb4a-e784-4935-81fb-9d5888d26435 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:27:54.334330 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-a774fb4a-e784-4935-81fb-9d5888d26435 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: 03e88a01-d3ed-4ab2-a334-f4bc274fe800] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:27:54.360804 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a774fb4a-e784-4935-81fb-9d5888d26435 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:54.364150 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a774fb4a-e784-4935-81fb-9d5888d26435 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:54.367110 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a774fb4a-e784-4935-81fb-9d5888d26435 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:54.367897 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a774fb4a-e784-4935-81fb-9d5888d26435 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:54.375031 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a774fb4a-e784-4935-81fb-9d5888d26435 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:54.375616 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a774fb4a-e784-4935-81fb-9d5888d26435 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:54.486700 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-a774fb4a-e784-4935-81fb-9d5888d26435 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.160902 Aug 10 23:27:54.499198 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2875/5525] 10.222.0.58 () {60 vars in 1343 bytes} [Wed Aug 10 23:27:54 2022] GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800/os-volume_attachments => generated 25 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:27:54.648240 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-6ae516d9-4a2b-4a01-a719-13428cc2e186 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:27:54.648729 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-6ae516d9-4a2b-4a01-a719-13428cc2e186 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: 03e88a01-d3ed-4ab2-a334-f4bc274fe800] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:27:54.657156 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6ae516d9-4a2b-4a01-a719-13428cc2e186 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:54.657768 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6ae516d9-4a2b-4a01-a719-13428cc2e186 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:54.658212 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6ae516d9-4a2b-4a01-a719-13428cc2e186 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:54.658973 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6ae516d9-4a2b-4a01-a719-13428cc2e186 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:54.659618 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6ae516d9-4a2b-4a01-a719-13428cc2e186 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:54.660333 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6ae516d9-4a2b-4a01-a719-13428cc2e186 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:54.690021 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-6ae516d9-4a2b-4a01-a719-13428cc2e186 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: 03e88a01-d3ed-4ab2-a334-f4bc274fe800] Going to try to terminate instance {{(pid=122632) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:27:54.835929 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-6ae516d9-4a2b-4a01-a719-13428cc2e186 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "DELETE /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800" status: 204 len: 0 microversion: 2.20 time: 0.190637 Aug 10 23:27:54.836898 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2651/5526] 10.222.0.58 () {60 vars in 1280 bytes} [Wed Aug 10 23:27:54 2022] DELETE /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 10 23:27:54.848366 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-b89e2161-b48d-4684-b01f-fcf74e319af7 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:27:54.849750 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-b89e2161-b48d-4684-b01f-fcf74e319af7 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: 03e88a01-d3ed-4ab2-a334-f4bc274fe800] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:27:54.862466 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b89e2161-b48d-4684-b01f-fcf74e319af7 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:54.864306 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b89e2161-b48d-4684-b01f-fcf74e319af7 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:54.867289 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b89e2161-b48d-4684-b01f-fcf74e319af7 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:54.871567 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b89e2161-b48d-4684-b01f-fcf74e319af7 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:54.872261 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b89e2161-b48d-4684-b01f-fcf74e319af7 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:54.873692 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b89e2161-b48d-4684-b01f-fcf74e319af7 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:55.521303 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-b89e2161-b48d-4684-b01f-fcf74e319af7 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:27:55.546098 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-b89e2161-b48d-4684-b01f-fcf74e319af7 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:27:55.556620 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-b89e2161-b48d-4684-b01f-fcf74e319af7 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:27:55.566229 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-b89e2161-b48d-4684-b01f-fcf74e319af7 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800" status: 200 len: 1724 microversion: 2.20 time: 0.718518 Aug 10 23:27:55.568414 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2876/5527] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:27:54 2022] GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800 => generated 1724 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:27:56.628845 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-223396f9-1262-4318-a355-b6d2c61e55ac tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:27:56.630447 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-223396f9-1262-4318-a355-b6d2c61e55ac tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: 03e88a01-d3ed-4ab2-a334-f4bc274fe800] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:27:56.683610 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-223396f9-1262-4318-a355-b6d2c61e55ac tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:56.685497 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-223396f9-1262-4318-a355-b6d2c61e55ac tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:56.688548 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-223396f9-1262-4318-a355-b6d2c61e55ac tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:56.691813 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-223396f9-1262-4318-a355-b6d2c61e55ac tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:56.693026 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-223396f9-1262-4318-a355-b6d2c61e55ac tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:56.695692 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-223396f9-1262-4318-a355-b6d2c61e55ac tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:57.999376 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-223396f9-1262-4318-a355-b6d2c61e55ac tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:27:58.022823 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-223396f9-1262-4318-a355-b6d2c61e55ac tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:27:58.032998 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-223396f9-1262-4318-a355-b6d2c61e55ac tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:27:58.036219 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-223396f9-1262-4318-a355-b6d2c61e55ac tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800" status: 200 len: 1724 microversion: 2.20 time: 1.446600 Aug 10 23:27:58.039223 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2652/5528] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:27:56 2022] GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800 => generated 1724 bytes in 1452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:27:59.072297 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c458311b-1923-4b79-93f5-920277958368 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:27:59.074168 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-c458311b-1923-4b79-93f5-920277958368 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: 03e88a01-d3ed-4ab2-a334-f4bc274fe800] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:27:59.100349 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_api:SELECT=20 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:27:59.109135 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c458311b-1923-4b79-93f5-920277958368 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:59.115045 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c458311b-1923-4b79-93f5-920277958368 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:59.116095 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c458311b-1923-4b79-93f5-920277958368 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:59.118017 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c458311b-1923-4b79-93f5-920277958368 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:59.121466 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c458311b-1923-4b79-93f5-920277958368 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:59.122855 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c458311b-1923-4b79-93f5-920277958368 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:59.715313 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-c458311b-1923-4b79-93f5-920277958368 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:27:59.724595 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-c458311b-1923-4b79-93f5-920277958368 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:27:59.741569 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-c458311b-1923-4b79-93f5-920277958368 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:27:59.749208 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-c458311b-1923-4b79-93f5-920277958368 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800" status: 200 len: 1657 microversion: 2.20 time: 0.680816 Aug 10 23:27:59.750159 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2877/5529] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:27:59 2022] GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800 => generated 1657 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:27:59.846359 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-31caec22-448d-4d9b-a112-58a0302966e8 req-1454d818-4ce3-4265-810c-5b7e0982899c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03e88a01-d3ed-4ab2-a334-f4bc274fe800", "name": "network-vif-deleted", "tag": "7481f052-393a-446e-bc21-7be34657945e"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:27:59.882386 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-31caec22-448d-4d9b-a112-58a0302966e8 req-1454d818-4ce3-4265-810c-5b7e0982899c service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:27:59.886227 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-31caec22-448d-4d9b-a112-58a0302966e8 req-1454d818-4ce3-4265-810c-5b7e0982899c service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:27:59.886684 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-31caec22-448d-4d9b-a112-58a0302966e8 req-1454d818-4ce3-4265-810c-5b7e0982899c service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:27:59.932407 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-31caec22-448d-4d9b-a112-58a0302966e8 req-1454d818-4ce3-4265-810c-5b7e0982899c service nova] Creating event network-vif-deleted:7481f052-393a-446e-bc21-7be34657945e for instance 03e88a01-d3ed-4ab2-a334-f4bc274fe800 on n-h1-850468-14 Aug 10 23:27:59.969026 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-31caec22-448d-4d9b-a112-58a0302966e8 req-1454d818-4ce3-4265-810c-5b7e0982899c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127379 Aug 10 23:27:59.970195 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2653/5530] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:27:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:28:00.779176 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-ef3f4cc2-4150-49e5-b746-ade48cf63bf4 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:28:00.779801 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-ef3f4cc2-4150-49e5-b746-ade48cf63bf4 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: 03e88a01-d3ed-4ab2-a334-f4bc274fe800] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:28:00.798609 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ef3f4cc2-4150-49e5-b746-ade48cf63bf4 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:28:00.804300 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ef3f4cc2-4150-49e5-b746-ade48cf63bf4 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:28:00.809344 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ef3f4cc2-4150-49e5-b746-ade48cf63bf4 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:28:00.814264 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ef3f4cc2-4150-49e5-b746-ade48cf63bf4 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:28:00.815945 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ef3f4cc2-4150-49e5-b746-ade48cf63bf4 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:28:00.818095 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ef3f4cc2-4150-49e5-b746-ade48cf63bf4 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:28:00.871088 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-ef3f4cc2-4150-49e5-b746-ade48cf63bf4 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] HTTP exception thrown: Instance 03e88a01-d3ed-4ab2-a334-f4bc274fe800 could not be found. Aug 10 23:28:00.873579 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-ef3f4cc2-4150-49e5-b746-ade48cf63bf4 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Request method failure captured: Aug 10 23:28:00.873579 n-d-850468-14 devstack@n-api.service[122633]: request: GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800 HTTP/1.1 Aug 10 23:28:00.873579 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:28:00.873579 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:28:00.873579 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:28:00.873579 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:28:00.873579 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:28:00.873579 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:28:00.873579 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:28:00.873579 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:28:00.873579 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9D4nzVq2558z9rLfYRYA2pZxsjFz7RfLxddFUl51tG0j_Wfc_zB98us-y9yS-8JSHiS7PpysPYlf0xuzWy4DHfwFlHmfNLDHPUVze1EVhUWX7GVQuSEdV6BccfHEnO6-A9UPpzshqrhBLTpXBunL_OKsZjlyLzTn-fs8OIuwXlvyLDk Aug 10 23:28:00.873579 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:28:00.873579 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:28:00.873579 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:28:00.873579 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:28:00.873579 n-d-850468-14 devstack@n-api.service[122633]: X-Openstack-Nova-Api-Version: 2.20 Aug 10 23:28:00.873579 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:28:00.873579 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:28:00.873579 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 1597a7e6731c4f5f9d8dfdc793ec2d47 Aug 10 23:28:00.873579 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1591010651 Aug 10 23:28:00.873579 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:28:00.873579 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:28:00.873579 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1597a7e6731c4f5f9d8dfdc793ec2d47"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1597a7e6731c4f5f9d8dfdc793ec2d47"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/1597a7e6731c4f5f9d8dfdc793ec2d47"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_1597a7e6731c4f5f9d8dfdc793ec2d47", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:28:00.873579 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1591010651 Aug 10 23:28:00.873579 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 1597a7e6731c4f5f9d8dfdc793ec2d47 Aug 10 23:28:00.873579 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1591010651 Aug 10 23:28:00.873579 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-AttachVolumeShelveTestJSON-1591010651-project Aug 10 23:28:00.873579 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:28:00.873579 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:28:00.873579 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 8ad42d35070247d18e67b2fa10690252 Aug 10 23:28:00.873579 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1591010651-project Aug 10 23:28:00.873579 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:28:00.873579 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance 03e88a01-d3ed-4ab2-a334-f4bc274fe800 could not be found. Aug 10 23:28:00.873579 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': '03e88a01-d3ed-4ab2-a334-f4bc274fe800'} Aug 10 23:28:00.873579 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:28:00.873579 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:28:00.873579 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:28:00.873579 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:28:00.873579 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:28:00.873579 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:28:00.873579 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:28:00.873579 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:28:00.873579 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:28:00.873579 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:28:00.873579 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03e88a01-d3ed-4ab2-a334-f4bc274fe800 could not be found. Aug 10 23:28:00.873579 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:28:00.873579 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:28:00.873579 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:28:00.873579 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:28:00.873579 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:28:00.873579 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:28:00.873579 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:28:00.873579 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:28:00.873579 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:28:00.873579 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:28:00.873579 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:28:00.873579 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:28:00.873579 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:28:00.873579 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:28:00.873579 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:28:00.873579 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:28:00.873579 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03e88a01-d3ed-4ab2-a334-f4bc274fe800 could not be found. Aug 10 23:28:00.873579 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:28:00.873579 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:28:00.878071 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:28:00.878071 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:28:00.878071 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:28:00.878071 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:28:00.878071 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:28:00.878071 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:28:00.878071 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03e88a01-d3ed-4ab2-a334-f4bc274fe800 could not be found. Aug 10 23:28:00.878071 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:28:00.882484 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-ef3f4cc2-4150-49e5-b746-ade48cf63bf4 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Returning 404 to user: Instance 03e88a01-d3ed-4ab2-a334-f4bc274fe800 could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:28:00.883742 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-ef3f4cc2-4150-49e5-b746-ade48cf63bf4 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800" status: 404 len: 111 microversion: 2.20 time: 0.110265 Aug 10 23:28:00.885966 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2878/5531] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:28:00 2022] GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 10 23:28:00.900138 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-f5ca556e-a474-42a1-9d1b-f22f4bb1d6a5 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Calling method '.version_select at 0x7f846fb7a430>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:28:00.950245 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-f5ca556e-a474-42a1-9d1b-f22f4bb1d6a5 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1598256161" status: 204 len: 0 microversion: 2.20 time: 0.059004 Aug 10 23:28:00.953927 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2654/5532] 10.222.0.58 () {60 vars in 1262 bytes} [Wed Aug 10 23:28:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1598256161 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 10 23:28:01.424128 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-f8707c95-7244-4569-a3bc-4f13a3d0d9a6 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Action: 'create', calling method: .version_select at 0x7f847c0a0a60>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1154531619", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLcVhcBNTtrau6mt2nyPXz+vKnLEWek2LiKVOeEpTKk5NoZkASsalw2T23fP+Zo+EeSbh4Ll3oTF8kfhy4kgty/HCOH09YXD3BSvnwTu0dIPNzihYe0bU1Moa++yhAbJEw=="}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:28:01.489154 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-f8707c95-7244-4569-a3bc-4f13a3d0d9a6 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Getting quotas for project 679d43599f3e4c29ab368a1e54dae608. Resources: {'key_pairs'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:28:01.507151 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-f8707c95-7244-4569-a3bc-4f13a3d0d9a6 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Getting quotas for user fbea80d59f5840f1899bd3cf601ac8bf and project 679d43599f3e4c29ab368a1e54dae608. Resources: {'key_pairs'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:28:01.614916 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-f8707c95-7244-4569-a3bc-4f13a3d0d9a6 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.202704 Aug 10 23:28:01.617047 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2879/5533] 10.222.0.58 () {60 vars in 1159 bytes} [Wed Aug 10 23:28:01 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:28:03.358245 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-0aac41aa-8961-4f94-8878-a6398e036cfd tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Action: 'create', calling method: .version_select at 0x7f846fc95430>, body: {"keypair": {"name": "tempest-keypair-466797257", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIjduKnPNde8fNnJLT1CpS9cPFAcaxLccuPpCCzG9CoU3oZ9ubbw0aSR8vK7XJUdURPIu5HqCcMu6QtLnJuFOdojj8wpvC8GbNV/TCfFtUcQxBMKsWEASX/t0W8ICKWPpQ=="}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:28:03.398500 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-0aac41aa-8961-4f94-8878-a6398e036cfd tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Getting quotas for project 1597a7e6731c4f5f9d8dfdc793ec2d47. Resources: {'key_pairs'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:28:03.409579 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-0aac41aa-8961-4f94-8878-a6398e036cfd tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Getting quotas for user 8ad42d35070247d18e67b2fa10690252 and project 1597a7e6731c4f5f9d8dfdc793ec2d47. Resources: {'key_pairs'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:28:03.469400 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-0aac41aa-8961-4f94-8878-a6398e036cfd tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.116938 Aug 10 23:28:03.470740 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2655/5534] 10.222.0.58 () {62 vars in 1200 bytes} [Wed Aug 10 23:28:03 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 119 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 10 23:28:06.176530 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-fd96b161-a5c1-48d3-898a-1d89ea9ca03a tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-125262942", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452", "networks": [{"uuid": "4108fac8-0d71-4fb0-9138-a78530be98aa"}], "key_name": "tempest-TestNetworkBasicOps-1154531619", "security_groups": [{"name": "tempest-secgroup-smoke-972253944"}]}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:28:06.543879 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.network.neutron [None req-fd96b161-a5c1-48d3-898a-1d89ea9ca03a tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] validate_networks() for [('4108fac8-0d71-4fb0-9138-a78530be98aa', None, None, None, None, None)] {{(pid=122633) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 23:28:07.548304 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-fd96b161-a5c1-48d3-898a-1d89ea9ca03a tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Flavor limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:28:07.549393 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-fd96b161-a5c1-48d3-898a-1d89ea9ca03a tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Image limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:28:07.550136 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-fd96b161-a5c1-48d3-898a-1d89ea9ca03a tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Flavor pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:28:07.550806 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-fd96b161-a5c1-48d3-898a-1d89ea9ca03a tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Image pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:28:07.551441 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-fd96b161-a5c1-48d3-898a-1d89ea9ca03a tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:28:07.565071 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fd96b161-a5c1-48d3-898a-1d89ea9ca03a tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:28:07.566238 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fd96b161-a5c1-48d3-898a-1d89ea9ca03a tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:28:07.566988 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fd96b161-a5c1-48d3-898a-1d89ea9ca03a tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:28:07.568334 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fd96b161-a5c1-48d3-898a-1d89ea9ca03a tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:28:07.569086 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fd96b161-a5c1-48d3-898a-1d89ea9ca03a tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:28:07.570043 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fd96b161-a5c1-48d3-898a-1d89ea9ca03a tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:28:07.597421 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-fd96b161-a5c1-48d3-898a-1d89ea9ca03a tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Getting quotas for project 679d43599f3e4c29ab368a1e54dae608. Resources: {'instances', 'cores', 'ram'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:28:07.605565 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-fd96b161-a5c1-48d3-898a-1d89ea9ca03a tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Getting quotas for user fbea80d59f5840f1899bd3cf601ac8bf and project 679d43599f3e4c29ab368a1e54dae608. Resources: {'instances', 'cores', 'ram'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:28:07.622163 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-fd96b161-a5c1-48d3-898a-1d89ea9ca03a tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Going to run 1 instances... {{(pid=122633) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 23:28:07.625083 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-fd96b161-a5c1-48d3-898a-1d89ea9ca03a tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] [instance: d0df5425-46c7-4aa2-81b7-8113347766ad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78ad8905-f66f-4733-8be9-2b260f1fabed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122633) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 23:28:07.696800 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-fd96b161-a5c1-48d3-898a-1d89ea9ca03a tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.529452 Aug 10 23:28:07.698629 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2880/5535] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 23:28:06 2022] POST /compute/v2.1/servers => generated 405 bytes in 1533 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 23:28:07.710473 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-244209eb-0250-41d1-a704-81d356e51025 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:28:07.713382 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-244209eb-0250-41d1-a704-81d356e51025 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] [instance: d0df5425-46c7-4aa2-81b7-8113347766ad] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:28:07.807541 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-244209eb-0250-41d1-a704-81d356e51025 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbea80d59f5840f1899bd3cf601ac8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679d43599f3e4c29ab368a1e54dae608', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:28:07.810541 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-70b6217a-6373-4f14-a275-794764940b25 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-715887179", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a1e77038-b03a-4411-8a20-a5a8eaec9348"}], "security_groups": [{"name": "tempest-securitygroup--1173613921"}], "key_name": "tempest-keypair-466797257", "user_data": "}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:28:07.820423 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-244209eb-0250-41d1-a704-81d356e51025 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] 10.222.0.58 "GET /compute/v2.1/servers/d0df5425-46c7-4aa2-81b7-8113347766ad" status: 200 len: 1248 microversion: 2.1 time: 0.114303 Aug 10 23:28:07.821388 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2656/5536] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:28:07 2022] GET /compute/v2.1/servers/d0df5425-46c7-4aa2-81b7-8113347766ad => generated 1248 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:28:08.160041 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.network.neutron [None req-70b6217a-6373-4f14-a275-794764940b25 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] validate_networks() for [('a1e77038-b03a-4411-8a20-a5a8eaec9348', None, None, None, None, None)] {{(pid=122633) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 23:28:08.844861 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-ce8c2762-585c-4a34-932d-3af478302c81 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:28:08.845613 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-ce8c2762-585c-4a34-932d-3af478302c81 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] [instance: d0df5425-46c7-4aa2-81b7-8113347766ad] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:28:08.858747 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ce8c2762-585c-4a34-932d-3af478302c81 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:28:08.859527 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ce8c2762-585c-4a34-932d-3af478302c81 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:28:08.860223 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ce8c2762-585c-4a34-932d-3af478302c81 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:28:08.861107 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ce8c2762-585c-4a34-932d-3af478302c81 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:28:08.861704 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ce8c2762-585c-4a34-932d-3af478302c81 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:28:08.864236 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ce8c2762-585c-4a34-932d-3af478302c81 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:28:08.947024 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-70b6217a-6373-4f14-a275-794764940b25 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Flavor limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:28:08.947767 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-70b6217a-6373-4f14-a275-794764940b25 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Image limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:28:08.948427 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-70b6217a-6373-4f14-a275-794764940b25 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Flavor pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:28:08.948925 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-70b6217a-6373-4f14-a275-794764940b25 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Image pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:28:08.949709 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-70b6217a-6373-4f14-a275-794764940b25 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:28:08.966577 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-70b6217a-6373-4f14-a275-794764940b25 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:28:08.967558 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-70b6217a-6373-4f14-a275-794764940b25 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:28:08.968411 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-70b6217a-6373-4f14-a275-794764940b25 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:28:08.969761 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-70b6217a-6373-4f14-a275-794764940b25 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:28:08.970458 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-70b6217a-6373-4f14-a275-794764940b25 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:28:08.971082 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-70b6217a-6373-4f14-a275-794764940b25 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:28:08.993744 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-ce8c2762-585c-4a34-932d-3af478302c81 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbea80d59f5840f1899bd3cf601ac8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679d43599f3e4c29ab368a1e54dae608', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:28:09.007355 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-ce8c2762-585c-4a34-932d-3af478302c81 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] 10.222.0.58 "GET /compute/v2.1/servers/d0df5425-46c7-4aa2-81b7-8113347766ad" status: 200 len: 1252 microversion: 2.1 time: 0.168882 Aug 10 23:28:09.009258 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-70b6217a-6373-4f14-a275-794764940b25 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Getting quotas for project 1597a7e6731c4f5f9d8dfdc793ec2d47. Resources: {'instances', 'cores', 'ram'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:28:09.009432 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2657/5537] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:28:08 2022] GET /compute/v2.1/servers/d0df5425-46c7-4aa2-81b7-8113347766ad => generated 1252 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:28:09.015887 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-70b6217a-6373-4f14-a275-794764940b25 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Getting quotas for user 8ad42d35070247d18e67b2fa10690252 and project 1597a7e6731c4f5f9d8dfdc793ec2d47. Resources: {'instances', 'cores', 'ram'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:28:09.032045 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-70b6217a-6373-4f14-a275-794764940b25 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Going to run 1 instances... {{(pid=122633) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 23:28:09.034752 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-70b6217a-6373-4f14-a275-794764940b25 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: e806d719-6292-49a9-ab7b-31397991291d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78ad8905-f66f-4733-8be9-2b260f1fabed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122633) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 23:28:09.155856 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-70b6217a-6373-4f14-a275-794764940b25 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.351162 Aug 10 23:28:09.156831 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2881/5538] 10.222.0.58 () {62 vars in 1188 bytes} [Wed Aug 10 23:28:07 2022] POST /compute/v2.1/servers => generated 402 bytes in 1353 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 10 23:28:09.171247 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-6ee1c7e3-64e7-463b-bb18-53b98bd602b2 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:28:09.173181 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-6ee1c7e3-64e7-463b-bb18-53b98bd602b2 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: e806d719-6292-49a9-ab7b-31397991291d] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:28:09.292772 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-6ee1c7e3-64e7-463b-bb18-53b98bd602b2 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:28:09.301519 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-6ee1c7e3-64e7-463b-bb18-53b98bd602b2 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:28:09.307525 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-6ee1c7e3-64e7-463b-bb18-53b98bd602b2 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:28:09.311262 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-6ee1c7e3-64e7-463b-bb18-53b98bd602b2 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "GET /compute/v2.1/servers/e806d719-6292-49a9-ab7b-31397991291d" status: 200 len: 1280 microversion: 2.20 time: 0.146656 Aug 10 23:28:09.311930 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2658/5539] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:28:09 2022] GET /compute/v2.1/servers/e806d719-6292-49a9-ab7b-31397991291d => generated 1280 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:28:10.049097 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-9b0f2270-2f71-48b4-864e-bea2de7425de tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:28:10.052406 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-9b0f2270-2f71-48b4-864e-bea2de7425de tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] [instance: d0df5425-46c7-4aa2-81b7-8113347766ad] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:28:10.092129 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9b0f2270-2f71-48b4-864e-bea2de7425de tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:28:10.093736 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9b0f2270-2f71-48b4-864e-bea2de7425de tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:28:10.094921 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9b0f2270-2f71-48b4-864e-bea2de7425de tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:28:10.097323 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9b0f2270-2f71-48b4-864e-bea2de7425de tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:28:10.100274 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9b0f2270-2f71-48b4-864e-bea2de7425de tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:28:10.101945 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9b0f2270-2f71-48b4-864e-bea2de7425de tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:28:10.302387 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-9b0f2270-2f71-48b4-864e-bea2de7425de tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbea80d59f5840f1899bd3cf601ac8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679d43599f3e4c29ab368a1e54dae608', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:28:10.326532 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-9b0f2270-2f71-48b4-864e-bea2de7425de tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] 10.222.0.58 "GET /compute/v2.1/servers/d0df5425-46c7-4aa2-81b7-8113347766ad" status: 200 len: 1306 microversion: 2.1 time: 0.298961 Aug 10 23:28:10.330247 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2882/5540] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:28:10 2022] GET /compute/v2.1/servers/d0df5425-46c7-4aa2-81b7-8113347766ad => generated 1306 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:28:10.348332 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-10e605b7-55c9-4938-a6ac-caaf1519b881 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:28:10.349890 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-10e605b7-55c9-4938-a6ac-caaf1519b881 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: e806d719-6292-49a9-ab7b-31397991291d] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:28:10.365267 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-10e605b7-55c9-4938-a6ac-caaf1519b881 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:28:10.367431 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-10e605b7-55c9-4938-a6ac-caaf1519b881 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:28:10.370165 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-10e605b7-55c9-4938-a6ac-caaf1519b881 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:28:10.371500 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-10e605b7-55c9-4938-a6ac-caaf1519b881 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:28:10.372139 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-10e605b7-55c9-4938-a6ac-caaf1519b881 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:28:10.372579 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-10e605b7-55c9-4938-a6ac-caaf1519b881 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:28:10.475662 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-10e605b7-55c9-4938-a6ac-caaf1519b881 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:28:10.492444 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-10e605b7-55c9-4938-a6ac-caaf1519b881 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:28:10.495139 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-10e605b7-55c9-4938-a6ac-caaf1519b881 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:28:10.496502 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-10e605b7-55c9-4938-a6ac-caaf1519b881 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "GET /compute/v2.1/servers/e806d719-6292-49a9-ab7b-31397991291d" status: 200 len: 1332 microversion: 2.20 time: 0.152458 Aug 10 23:28:10.497610 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2659/5541] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:28:10 2022] GET /compute/v2.1/servers/e806d719-6292-49a9-ab7b-31397991291d => generated 1332 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:28:11.350759 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-572bf091-9618-45c9-ac40-e13d0c4abc17 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:28:11.351589 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-572bf091-9618-45c9-ac40-e13d0c4abc17 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] [instance: d0df5425-46c7-4aa2-81b7-8113347766ad] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:28:11.365165 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-572bf091-9618-45c9-ac40-e13d0c4abc17 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:28:11.365745 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-572bf091-9618-45c9-ac40-e13d0c4abc17 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:28:11.366223 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-572bf091-9618-45c9-ac40-e13d0c4abc17 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:28:11.372033 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-572bf091-9618-45c9-ac40-e13d0c4abc17 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:28:11.372578 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-572bf091-9618-45c9-ac40-e13d0c4abc17 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:28:11.376994 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-572bf091-9618-45c9-ac40-e13d0c4abc17 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:28:11.522366 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-533224d7-f2da-4b50-9781-de761747c456 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:28:11.523008 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-533224d7-f2da-4b50-9781-de761747c456 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: e806d719-6292-49a9-ab7b-31397991291d] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:28:11.542201 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-533224d7-f2da-4b50-9781-de761747c456 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:28:11.544652 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-533224d7-f2da-4b50-9781-de761747c456 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:28:11.545686 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-533224d7-f2da-4b50-9781-de761747c456 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:28:11.547437 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-533224d7-f2da-4b50-9781-de761747c456 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:28:11.550127 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-533224d7-f2da-4b50-9781-de761747c456 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:28:11.551298 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-533224d7-f2da-4b50-9781-de761747c456 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:28:11.692713 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-533224d7-f2da-4b50-9781-de761747c456 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:28:11.723256 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-533224d7-f2da-4b50-9781-de761747c456 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:28:11.729634 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-533224d7-f2da-4b50-9781-de761747c456 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:28:11.735979 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-533224d7-f2da-4b50-9781-de761747c456 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "GET /compute/v2.1/servers/e806d719-6292-49a9-ab7b-31397991291d" status: 200 len: 1338 microversion: 2.20 time: 0.217813 Aug 10 23:28:11.749702 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2660/5542] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:28:11 2022] GET /compute/v2.1/servers/e806d719-6292-49a9-ab7b-31397991291d => generated 1338 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:28:11.937906 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-572bf091-9618-45c9-ac40-e13d0c4abc17 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbea80d59f5840f1899bd3cf601ac8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679d43599f3e4c29ab368a1e54dae608', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:28:11.948300 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-572bf091-9618-45c9-ac40-e13d0c4abc17 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] 10.222.0.58 "GET /compute/v2.1/servers/d0df5425-46c7-4aa2-81b7-8113347766ad" status: 200 len: 1373 microversion: 2.1 time: 0.602099 Aug 10 23:28:11.952079 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2883/5543] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:28:11 2022] GET /compute/v2.1/servers/d0df5425-46c7-4aa2-81b7-8113347766ad => generated 1373 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:28:12.764796 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-6af571e9-5755-4183-b713-67af545d1c1b tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:28:12.766368 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-6af571e9-5755-4183-b713-67af545d1c1b tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: e806d719-6292-49a9-ab7b-31397991291d] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:28:12.782157 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6af571e9-5755-4183-b713-67af545d1c1b tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:28:12.783029 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6af571e9-5755-4183-b713-67af545d1c1b tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:28:12.783698 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6af571e9-5755-4183-b713-67af545d1c1b tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:28:12.784625 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6af571e9-5755-4183-b713-67af545d1c1b tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:28:12.785276 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6af571e9-5755-4183-b713-67af545d1c1b tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:28:12.786717 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6af571e9-5755-4183-b713-67af545d1c1b tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:28:12.972332 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-300af9a6-31bd-46be-af29-c4dbe628fdcf tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:28:12.972945 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-300af9a6-31bd-46be-af29-c4dbe628fdcf tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] [instance: d0df5425-46c7-4aa2-81b7-8113347766ad] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:28:12.992618 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-300af9a6-31bd-46be-af29-c4dbe628fdcf tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:28:12.995440 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-300af9a6-31bd-46be-af29-c4dbe628fdcf tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:28:12.996112 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-300af9a6-31bd-46be-af29-c4dbe628fdcf tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:28:12.997817 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-300af9a6-31bd-46be-af29-c4dbe628fdcf tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:28:13.004304 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-300af9a6-31bd-46be-af29-c4dbe628fdcf tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:28:13.005332 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-300af9a6-31bd-46be-af29-c4dbe628fdcf tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:28:13.300480 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-6af571e9-5755-4183-b713-67af545d1c1b tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:28:13.355901 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-6af571e9-5755-4183-b713-67af545d1c1b tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:28:13.361443 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-6af571e9-5755-4183-b713-67af545d1c1b tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:28:13.364478 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-6af571e9-5755-4183-b713-67af545d1c1b tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "GET /compute/v2.1/servers/e806d719-6292-49a9-ab7b-31397991291d" status: 200 len: 1406 microversion: 2.20 time: 0.604585 Aug 10 23:28:13.382983 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2661/5544] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:28:12 2022] GET /compute/v2.1/servers/e806d719-6292-49a9-ab7b-31397991291d => generated 1406 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 23:28:13.501635 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-bc223b54-d414-43b8-bfb1-df7a070fe19a req-e88305e0-4817-4680-83c2-d82ea53e596c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0df5425-46c7-4aa2-81b7-8113347766ad", "tag": "aa673f43-a995-4dae-b7b0-1c90f9acf05c"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:28:13.543544 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-bc223b54-d414-43b8-bfb1-df7a070fe19a req-e88305e0-4817-4680-83c2-d82ea53e596c service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:28:13.548727 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-bc223b54-d414-43b8-bfb1-df7a070fe19a req-e88305e0-4817-4680-83c2-d82ea53e596c service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:28:13.550114 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-bc223b54-d414-43b8-bfb1-df7a070fe19a req-e88305e0-4817-4680-83c2-d82ea53e596c service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:28:13.590175 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-300af9a6-31bd-46be-af29-c4dbe628fdcf tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbea80d59f5840f1899bd3cf601ac8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679d43599f3e4c29ab368a1e54dae608', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:28:13.600467 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-bc223b54-d414-43b8-bfb1-df7a070fe19a req-e88305e0-4817-4680-83c2-d82ea53e596c service nova] Creating event network-changed:aa673f43-a995-4dae-b7b0-1c90f9acf05c for instance d0df5425-46c7-4aa2-81b7-8113347766ad on n-h1-850468-14 Aug 10 23:28:13.607428 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-300af9a6-31bd-46be-af29-c4dbe628fdcf tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] 10.222.0.58 "GET /compute/v2.1/servers/d0df5425-46c7-4aa2-81b7-8113347766ad" status: 200 len: 1373 microversion: 2.1 time: 0.633834 Aug 10 23:28:13.609894 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2884/5545] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:28:12 2022] GET /compute/v2.1/servers/d0df5425-46c7-4aa2-81b7-8113347766ad => generated 1373 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:28:13.614618 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-bc223b54-d414-43b8-bfb1-df7a070fe19a req-e88305e0-4817-4680-83c2-d82ea53e596c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117298 Aug 10 23:28:13.615717 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2662/5546] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:28:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:28:14.389132 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-ea9a4e8b-e70f-4465-b663-3f1887edd3c7 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:28:14.389860 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-ea9a4e8b-e70f-4465-b663-3f1887edd3c7 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: e806d719-6292-49a9-ab7b-31397991291d] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:28:14.404029 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ea9a4e8b-e70f-4465-b663-3f1887edd3c7 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:28:14.404807 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ea9a4e8b-e70f-4465-b663-3f1887edd3c7 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:28:14.405433 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ea9a4e8b-e70f-4465-b663-3f1887edd3c7 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:28:14.406327 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ea9a4e8b-e70f-4465-b663-3f1887edd3c7 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:28:14.407072 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ea9a4e8b-e70f-4465-b663-3f1887edd3c7 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:28:14.407904 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ea9a4e8b-e70f-4465-b663-3f1887edd3c7 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:28:14.631530 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-3dbf3c22-5199-45d2-a902-c6dcf3a064e9 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:28:14.632793 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-3dbf3c22-5199-45d2-a902-c6dcf3a064e9 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] [instance: d0df5425-46c7-4aa2-81b7-8113347766ad] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:28:14.644194 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3dbf3c22-5199-45d2-a902-c6dcf3a064e9 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:28:14.645387 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3dbf3c22-5199-45d2-a902-c6dcf3a064e9 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:28:14.646080 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3dbf3c22-5199-45d2-a902-c6dcf3a064e9 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:28:14.647128 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3dbf3c22-5199-45d2-a902-c6dcf3a064e9 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:28:14.648035 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3dbf3c22-5199-45d2-a902-c6dcf3a064e9 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:28:14.648711 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3dbf3c22-5199-45d2-a902-c6dcf3a064e9 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:28:14.852575 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-ea9a4e8b-e70f-4465-b663-3f1887edd3c7 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:28:14.868162 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-ea9a4e8b-e70f-4465-b663-3f1887edd3c7 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:28:14.871252 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-ea9a4e8b-e70f-4465-b663-3f1887edd3c7 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:28:14.873065 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-ea9a4e8b-e70f-4465-b663-3f1887edd3c7 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "GET /compute/v2.1/servers/e806d719-6292-49a9-ab7b-31397991291d" status: 200 len: 1406 microversion: 2.20 time: 0.487936 Aug 10 23:28:14.888251 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2885/5547] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:28:14 2022] GET /compute/v2.1/servers/e806d719-6292-49a9-ab7b-31397991291d => generated 1406 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 23:28:14.976014 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-3dbf3c22-5199-45d2-a902-c6dcf3a064e9 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbea80d59f5840f1899bd3cf601ac8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679d43599f3e4c29ab368a1e54dae608', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:28:14.988602 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-3dbf3c22-5199-45d2-a902-c6dcf3a064e9 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] 10.222.0.58 "GET /compute/v2.1/servers/d0df5425-46c7-4aa2-81b7-8113347766ad" status: 200 len: 1373 microversion: 2.1 time: 0.362651 Aug 10 23:28:14.989599 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2663/5548] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:28:14 2022] GET /compute/v2.1/servers/d0df5425-46c7-4aa2-81b7-8113347766ad => generated 1373 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:28:15.679237 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-1b647e2c-2509-471a-a070-6f573d2ebaf3 req-b3532383-ed8d-48b8-b24a-4cec8b657972 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e806d719-6292-49a9-ab7b-31397991291d", "tag": "bd30930e-8098-4180-afd1-75ee64f8dc5a"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:28:15.690829 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-1b647e2c-2509-471a-a070-6f573d2ebaf3 req-b3532383-ed8d-48b8-b24a-4cec8b657972 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:28:15.691589 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-1b647e2c-2509-471a-a070-6f573d2ebaf3 req-b3532383-ed8d-48b8-b24a-4cec8b657972 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:28:15.692098 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-1b647e2c-2509-471a-a070-6f573d2ebaf3 req-b3532383-ed8d-48b8-b24a-4cec8b657972 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:28:15.705889 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-1b647e2c-2509-471a-a070-6f573d2ebaf3 req-b3532383-ed8d-48b8-b24a-4cec8b657972 service nova] Creating event network-changed:bd30930e-8098-4180-afd1-75ee64f8dc5a for instance e806d719-6292-49a9-ab7b-31397991291d on n-h2-850468-14 Aug 10 23:28:15.712729 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-1b647e2c-2509-471a-a070-6f573d2ebaf3 req-b3532383-ed8d-48b8-b24a-4cec8b657972 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037189 Aug 10 23:28:15.714079 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2886/5549] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:28:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:28:15.897212 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-698b5304-c9e5-43c5-8835-c470373f28e4 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:28:15.899025 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-698b5304-c9e5-43c5-8835-c470373f28e4 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: e806d719-6292-49a9-ab7b-31397991291d] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:28:15.907697 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:28:15.915150 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-698b5304-c9e5-43c5-8835-c470373f28e4 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:28:15.916336 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-698b5304-c9e5-43c5-8835-c470373f28e4 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:28:15.916968 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-698b5304-c9e5-43c5-8835-c470373f28e4 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:28:15.917888 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-698b5304-c9e5-43c5-8835-c470373f28e4 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:28:15.918531 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-698b5304-c9e5-43c5-8835-c470373f28e4 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:28:15.919159 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-698b5304-c9e5-43c5-8835-c470373f28e4 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:28:15.953304 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:28:16.012005 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-274dee91-7c66-4a72-86de-c5b3de2ca26a tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:28:16.015522 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-274dee91-7c66-4a72-86de-c5b3de2ca26a tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] [instance: d0df5425-46c7-4aa2-81b7-8113347766ad] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:28:16.029682 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-274dee91-7c66-4a72-86de-c5b3de2ca26a tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:28:16.030301 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-274dee91-7c66-4a72-86de-c5b3de2ca26a tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:28:16.030747 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-274dee91-7c66-4a72-86de-c5b3de2ca26a tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:28:16.033188 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-274dee91-7c66-4a72-86de-c5b3de2ca26a tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:28:16.033701 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-274dee91-7c66-4a72-86de-c5b3de2ca26a tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:28:16.034137 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-274dee91-7c66-4a72-86de-c5b3de2ca26a tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:28:16.187425 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-698b5304-c9e5-43c5-8835-c470373f28e4 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:28:16.209926 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-698b5304-c9e5-43c5-8835-c470373f28e4 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:28:16.212595 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-698b5304-c9e5-43c5-8835-c470373f28e4 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:28:16.214808 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-698b5304-c9e5-43c5-8835-c470373f28e4 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "GET /compute/v2.1/servers/e806d719-6292-49a9-ab7b-31397991291d" status: 200 len: 1406 microversion: 2.20 time: 0.322665 Aug 10 23:28:16.231779 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2664/5550] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:28:15 2022] GET /compute/v2.1/servers/e806d719-6292-49a9-ab7b-31397991291d => generated 1406 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:28:16.382115 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-274dee91-7c66-4a72-86de-c5b3de2ca26a tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbea80d59f5840f1899bd3cf601ac8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679d43599f3e4c29ab368a1e54dae608', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:28:16.391957 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-274dee91-7c66-4a72-86de-c5b3de2ca26a tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] 10.222.0.58 "GET /compute/v2.1/servers/d0df5425-46c7-4aa2-81b7-8113347766ad" status: 200 len: 1373 microversion: 2.1 time: 0.384138 Aug 10 23:28:16.407393 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2887/5551] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:28:16 2022] GET /compute/v2.1/servers/d0df5425-46c7-4aa2-81b7-8113347766ad => generated 1373 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:28:17.238335 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c10f9da3-6007-468b-a3cf-a05def1aba8c tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:28:17.239496 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-c10f9da3-6007-468b-a3cf-a05def1aba8c tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: e806d719-6292-49a9-ab7b-31397991291d] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:28:17.251764 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c10f9da3-6007-468b-a3cf-a05def1aba8c tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:28:17.252706 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c10f9da3-6007-468b-a3cf-a05def1aba8c tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:28:17.253319 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c10f9da3-6007-468b-a3cf-a05def1aba8c tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:28:17.254047 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c10f9da3-6007-468b-a3cf-a05def1aba8c tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:28:17.254587 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c10f9da3-6007-468b-a3cf-a05def1aba8c tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:28:17.255375 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c10f9da3-6007-468b-a3cf-a05def1aba8c tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:28:17.423799 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-0e8adffb-bafb-4cf7-88d3-d49dcf5df1a6 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:28:17.427554 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-0e8adffb-bafb-4cf7-88d3-d49dcf5df1a6 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] [instance: d0df5425-46c7-4aa2-81b7-8113347766ad] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:28:17.451369 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0e8adffb-bafb-4cf7-88d3-d49dcf5df1a6 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:28:17.452349 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0e8adffb-bafb-4cf7-88d3-d49dcf5df1a6 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:28:17.452889 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0e8adffb-bafb-4cf7-88d3-d49dcf5df1a6 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:28:17.453594 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0e8adffb-bafb-4cf7-88d3-d49dcf5df1a6 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:28:17.461579 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0e8adffb-bafb-4cf7-88d3-d49dcf5df1a6 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:28:17.462135 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0e8adffb-bafb-4cf7-88d3-d49dcf5df1a6 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:28:17.486746 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-c10f9da3-6007-468b-a3cf-a05def1aba8c tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:28:17.497599 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-c10f9da3-6007-468b-a3cf-a05def1aba8c tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:28:17.500490 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-c10f9da3-6007-468b-a3cf-a05def1aba8c tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:28:17.506302 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-c10f9da3-6007-468b-a3cf-a05def1aba8c tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "GET /compute/v2.1/servers/e806d719-6292-49a9-ab7b-31397991291d" status: 200 len: 1406 microversion: 2.20 time: 0.272421 Aug 10 23:28:17.510540 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2665/5552] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:28:17 2022] GET /compute/v2.1/servers/e806d719-6292-49a9-ab7b-31397991291d => generated 1406 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:28:18.172723 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-0e8adffb-bafb-4cf7-88d3-d49dcf5df1a6 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbea80d59f5840f1899bd3cf601ac8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679d43599f3e4c29ab368a1e54dae608', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:28:18.191833 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-0e8adffb-bafb-4cf7-88d3-d49dcf5df1a6 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] 10.222.0.58 "GET /compute/v2.1/servers/d0df5425-46c7-4aa2-81b7-8113347766ad" status: 200 len: 1373 microversion: 2.1 time: 0.777721 Aug 10 23:28:18.193721 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2888/5553] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:28:17 2022] GET /compute/v2.1/servers/d0df5425-46c7-4aa2-81b7-8113347766ad => generated 1373 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:28:18.535533 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-495637ba-5c23-40a0-95c7-7748a7854d4e tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:28:18.536144 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-495637ba-5c23-40a0-95c7-7748a7854d4e tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: e806d719-6292-49a9-ab7b-31397991291d] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:28:18.546402 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-495637ba-5c23-40a0-95c7-7748a7854d4e tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:28:18.546925 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-495637ba-5c23-40a0-95c7-7748a7854d4e tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:28:18.547554 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-495637ba-5c23-40a0-95c7-7748a7854d4e tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:28:18.548477 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-495637ba-5c23-40a0-95c7-7748a7854d4e tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:28:18.549110 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-495637ba-5c23-40a0-95c7-7748a7854d4e tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:28:18.550076 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-495637ba-5c23-40a0-95c7-7748a7854d4e tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:28:18.758447 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-495637ba-5c23-40a0-95c7-7748a7854d4e tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:28:18.768339 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-495637ba-5c23-40a0-95c7-7748a7854d4e tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:28:18.769813 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-495637ba-5c23-40a0-95c7-7748a7854d4e tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:28:18.772463 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-495637ba-5c23-40a0-95c7-7748a7854d4e tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "GET /compute/v2.1/servers/e806d719-6292-49a9-ab7b-31397991291d" status: 200 len: 1406 microversion: 2.20 time: 0.239832 Aug 10 23:28:18.775427 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2666/5554] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:28:18 2022] GET /compute/v2.1/servers/e806d719-6292-49a9-ab7b-31397991291d => generated 1406 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:28:19.217026 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-b956bb46-3632-4b37-bb9b-37d1568728e3 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:28:19.217781 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-b956bb46-3632-4b37-bb9b-37d1568728e3 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] [instance: d0df5425-46c7-4aa2-81b7-8113347766ad] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:28:19.227333 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-5705d33d-4256-4384-a68e-3eec52ab65dd req-d27e80e2-2761-446e-acb6-ca4be813b399 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0df5425-46c7-4aa2-81b7-8113347766ad", "name": "network-vif-plugged", "status": "completed", "tag": "aa673f43-a995-4dae-b7b0-1c90f9acf05c"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:28:19.231244 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=4 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:28:19.236069 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=16 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:28:19.239352 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-5705d33d-4256-4384-a68e-3eec52ab65dd req-d27e80e2-2761-446e-acb6-ca4be813b399 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:28:19.239839 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-5705d33d-4256-4384-a68e-3eec52ab65dd req-d27e80e2-2761-446e-acb6-ca4be813b399 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:28:19.240474 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-5705d33d-4256-4384-a68e-3eec52ab65dd req-d27e80e2-2761-446e-acb6-ca4be813b399 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:28:19.250983 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b956bb46-3632-4b37-bb9b-37d1568728e3 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:28:19.252554 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-5705d33d-4256-4384-a68e-3eec52ab65dd req-d27e80e2-2761-446e-acb6-ca4be813b399 service nova] Creating event network-vif-plugged:aa673f43-a995-4dae-b7b0-1c90f9acf05c for instance d0df5425-46c7-4aa2-81b7-8113347766ad on n-h1-850468-14 Aug 10 23:28:19.253925 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b956bb46-3632-4b37-bb9b-37d1568728e3 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:28:19.254415 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b956bb46-3632-4b37-bb9b-37d1568728e3 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:28:19.255420 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b956bb46-3632-4b37-bb9b-37d1568728e3 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:28:19.255890 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b956bb46-3632-4b37-bb9b-37d1568728e3 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:28:19.257939 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b956bb46-3632-4b37-bb9b-37d1568728e3 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:28:19.259135 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-5705d33d-4256-4384-a68e-3eec52ab65dd req-d27e80e2-2761-446e-acb6-ca4be813b399 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036076 Aug 10 23:28:19.260037 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2667/5555] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:28:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 23:28:19.544049 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-b956bb46-3632-4b37-bb9b-37d1568728e3 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbea80d59f5840f1899bd3cf601ac8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679d43599f3e4c29ab368a1e54dae608', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:28:19.556745 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-b956bb46-3632-4b37-bb9b-37d1568728e3 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] 10.222.0.58 "GET /compute/v2.1/servers/d0df5425-46c7-4aa2-81b7-8113347766ad" status: 200 len: 1373 microversion: 2.1 time: 0.343543 Aug 10 23:28:19.558011 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2889/5556] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:28:19 2022] GET /compute/v2.1/servers/d0df5425-46c7-4aa2-81b7-8113347766ad => generated 1373 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:28:19.802903 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-aa1a4a27-a12c-49eb-8868-ae8408ac3250 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:28:19.804347 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-aa1a4a27-a12c-49eb-8868-ae8408ac3250 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: e806d719-6292-49a9-ab7b-31397991291d] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:28:19.811605 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=8 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:28:19.814697 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-aa1a4a27-a12c-49eb-8868-ae8408ac3250 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:28:19.815428 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-aa1a4a27-a12c-49eb-8868-ae8408ac3250 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:28:19.816058 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-aa1a4a27-a12c-49eb-8868-ae8408ac3250 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:28:19.816941 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-aa1a4a27-a12c-49eb-8868-ae8408ac3250 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:28:19.817384 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-aa1a4a27-a12c-49eb-8868-ae8408ac3250 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:28:19.817965 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-aa1a4a27-a12c-49eb-8868-ae8408ac3250 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:28:20.015690 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-aa1a4a27-a12c-49eb-8868-ae8408ac3250 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:28:20.025688 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-aa1a4a27-a12c-49eb-8868-ae8408ac3250 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:28:20.027808 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-aa1a4a27-a12c-49eb-8868-ae8408ac3250 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:28:20.029396 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-aa1a4a27-a12c-49eb-8868-ae8408ac3250 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "GET /compute/v2.1/servers/e806d719-6292-49a9-ab7b-31397991291d" status: 200 len: 1406 microversion: 2.20 time: 0.232058 Aug 10 23:28:20.030453 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2668/5557] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:28:19 2022] GET /compute/v2.1/servers/e806d719-6292-49a9-ab7b-31397991291d => generated 1406 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:28:20.582721 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-bdfc112d-5b6d-4064-90b6-66fbc28f42a9 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:28:20.585895 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-bdfc112d-5b6d-4064-90b6-66fbc28f42a9 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] [instance: d0df5425-46c7-4aa2-81b7-8113347766ad] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:28:20.612253 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bdfc112d-5b6d-4064-90b6-66fbc28f42a9 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:28:20.615785 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bdfc112d-5b6d-4064-90b6-66fbc28f42a9 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:28:20.616583 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bdfc112d-5b6d-4064-90b6-66fbc28f42a9 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:28:20.623190 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bdfc112d-5b6d-4064-90b6-66fbc28f42a9 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:28:20.624055 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bdfc112d-5b6d-4064-90b6-66fbc28f42a9 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:28:20.626833 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bdfc112d-5b6d-4064-90b6-66fbc28f42a9 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:28:20.802923 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-bdfc112d-5b6d-4064-90b6-66fbc28f42a9 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbea80d59f5840f1899bd3cf601ac8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679d43599f3e4c29ab368a1e54dae608', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:28:20.811688 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-bdfc112d-5b6d-4064-90b6-66fbc28f42a9 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] 10.222.0.58 "GET /compute/v2.1/servers/d0df5425-46c7-4aa2-81b7-8113347766ad" status: 200 len: 1546 microversion: 2.1 time: 0.234411 Aug 10 23:28:20.812523 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2890/5558] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:28:20 2022] GET /compute/v2.1/servers/d0df5425-46c7-4aa2-81b7-8113347766ad => generated 1546 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:28:20.833456 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-4b11f734-f1f0-47e9-ba40-64835b558272 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:28:20.834076 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-4b11f734-f1f0-47e9-ba40-64835b558272 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] [instance: d0df5425-46c7-4aa2-81b7-8113347766ad] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:28:20.841673 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4b11f734-f1f0-47e9-ba40-64835b558272 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:28:20.842268 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4b11f734-f1f0-47e9-ba40-64835b558272 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:28:20.842925 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4b11f734-f1f0-47e9-ba40-64835b558272 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:28:20.843652 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4b11f734-f1f0-47e9-ba40-64835b558272 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:28:20.844119 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4b11f734-f1f0-47e9-ba40-64835b558272 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:28:20.844549 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4b11f734-f1f0-47e9-ba40-64835b558272 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:28:21.042284 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-4b11f734-f1f0-47e9-ba40-64835b558272 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbea80d59f5840f1899bd3cf601ac8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679d43599f3e4c29ab368a1e54dae608', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:28:21.053208 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-307322a8-c34b-43dd-9cd9-3c3373de4c54 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:28:21.053868 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-307322a8-c34b-43dd-9cd9-3c3373de4c54 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: e806d719-6292-49a9-ab7b-31397991291d] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:28:21.054649 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-4b11f734-f1f0-47e9-ba40-64835b558272 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] 10.222.0.58 "GET /compute/v2.1/servers/d0df5425-46c7-4aa2-81b7-8113347766ad" status: 200 len: 1546 microversion: 2.1 time: 0.224965 Aug 10 23:28:21.055651 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2669/5559] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:28:20 2022] GET /compute/v2.1/servers/d0df5425-46c7-4aa2-81b7-8113347766ad => generated 1546 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:28:21.070730 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-307322a8-c34b-43dd-9cd9-3c3373de4c54 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:28:21.070730 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-307322a8-c34b-43dd-9cd9-3c3373de4c54 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:28:21.070730 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-307322a8-c34b-43dd-9cd9-3c3373de4c54 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:28:21.070730 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-307322a8-c34b-43dd-9cd9-3c3373de4c54 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:28:21.070730 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-307322a8-c34b-43dd-9cd9-3c3373de4c54 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:28:21.070730 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-307322a8-c34b-43dd-9cd9-3c3373de4c54 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:28:21.310313 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-307322a8-c34b-43dd-9cd9-3c3373de4c54 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:28:21.327102 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-307322a8-c34b-43dd-9cd9-3c3373de4c54 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:28:21.327985 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-307322a8-c34b-43dd-9cd9-3c3373de4c54 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:28:21.330284 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-307322a8-c34b-43dd-9cd9-3c3373de4c54 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "GET /compute/v2.1/servers/e806d719-6292-49a9-ab7b-31397991291d" status: 200 len: 1406 microversion: 2.20 time: 0.281333 Aug 10 23:28:21.333885 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2891/5560] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:28:21 2022] GET /compute/v2.1/servers/e806d719-6292-49a9-ab7b-31397991291d => generated 1406 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 23:28:21.383087 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-08a8503d-53b9-4b33-b787-c9bd2b8e103f req-befa1387-117d-482c-bd93-815a40e47d65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e806d719-6292-49a9-ab7b-31397991291d", "name": "network-vif-plugged", "status": "completed", "tag": "bd30930e-8098-4180-afd1-75ee64f8dc5a"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:28:21.404695 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-08a8503d-53b9-4b33-b787-c9bd2b8e103f req-befa1387-117d-482c-bd93-815a40e47d65 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:28:21.405194 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-08a8503d-53b9-4b33-b787-c9bd2b8e103f req-befa1387-117d-482c-bd93-815a40e47d65 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:28:21.405697 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-08a8503d-53b9-4b33-b787-c9bd2b8e103f req-befa1387-117d-482c-bd93-815a40e47d65 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:28:21.439666 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-08a8503d-53b9-4b33-b787-c9bd2b8e103f req-befa1387-117d-482c-bd93-815a40e47d65 service nova] Creating event network-vif-plugged:bd30930e-8098-4180-afd1-75ee64f8dc5a for instance e806d719-6292-49a9-ab7b-31397991291d on n-h2-850468-14 Aug 10 23:28:21.454168 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-08a8503d-53b9-4b33-b787-c9bd2b8e103f req-befa1387-117d-482c-bd93-815a40e47d65 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074436 Aug 10 23:28:21.455592 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2670/5561] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:28:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 23:28:22.357989 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-d91735d0-4bc9-4058-9a36-1200314b13a6 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:28:22.358732 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-d91735d0-4bc9-4058-9a36-1200314b13a6 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: e806d719-6292-49a9-ab7b-31397991291d] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:28:22.369096 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d91735d0-4bc9-4058-9a36-1200314b13a6 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:28:22.370437 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d91735d0-4bc9-4058-9a36-1200314b13a6 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:28:22.371684 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d91735d0-4bc9-4058-9a36-1200314b13a6 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:28:22.373172 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d91735d0-4bc9-4058-9a36-1200314b13a6 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:28:22.374362 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d91735d0-4bc9-4058-9a36-1200314b13a6 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:28:22.375556 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d91735d0-4bc9-4058-9a36-1200314b13a6 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:28:22.380983 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=86 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:28:22.585855 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-d91735d0-4bc9-4058-9a36-1200314b13a6 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:28:22.607228 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-d91735d0-4bc9-4058-9a36-1200314b13a6 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:28:22.609007 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-d91735d0-4bc9-4058-9a36-1200314b13a6 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:28:22.611404 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-d91735d0-4bc9-4058-9a36-1200314b13a6 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "GET /compute/v2.1/servers/e806d719-6292-49a9-ab7b-31397991291d" status: 200 len: 1406 microversion: 2.20 time: 0.257370 Aug 10 23:28:22.612571 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2892/5562] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:28:22 2022] GET /compute/v2.1/servers/e806d719-6292-49a9-ab7b-31397991291d => generated 1406 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:28:23.638675 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-d9542d95-8817-4fc2-a185-d3ffe1872431 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:28:23.640229 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-d9542d95-8817-4fc2-a185-d3ffe1872431 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: e806d719-6292-49a9-ab7b-31397991291d] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:28:23.647749 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d9542d95-8817-4fc2-a185-d3ffe1872431 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:28:23.649313 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d9542d95-8817-4fc2-a185-d3ffe1872431 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:28:23.650336 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d9542d95-8817-4fc2-a185-d3ffe1872431 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:28:23.651340 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d9542d95-8817-4fc2-a185-d3ffe1872431 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:28:23.652042 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d9542d95-8817-4fc2-a185-d3ffe1872431 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:28:23.652715 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d9542d95-8817-4fc2-a185-d3ffe1872431 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:28:24.028502 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-d9542d95-8817-4fc2-a185-d3ffe1872431 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:28:24.037771 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-d9542d95-8817-4fc2-a185-d3ffe1872431 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:28:24.056317 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-d9542d95-8817-4fc2-a185-d3ffe1872431 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:28:24.067000 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-d9542d95-8817-4fc2-a185-d3ffe1872431 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "GET /compute/v2.1/servers/e806d719-6292-49a9-ab7b-31397991291d" status: 200 len: 1599 microversion: 2.20 time: 0.425512 Aug 10 23:28:24.067000 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2671/5563] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:28:23 2022] GET /compute/v2.1/servers/e806d719-6292-49a9-ab7b-31397991291d => generated 1599 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:28:24.088744 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-9968ca57-a83c-4ded-865b-7af003739d9d tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:28:24.089351 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-9968ca57-a83c-4ded-865b-7af003739d9d tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: e806d719-6292-49a9-ab7b-31397991291d] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:28:24.097849 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9968ca57-a83c-4ded-865b-7af003739d9d tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:28:24.098689 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9968ca57-a83c-4ded-865b-7af003739d9d tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:28:24.099169 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9968ca57-a83c-4ded-865b-7af003739d9d tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:28:24.100097 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9968ca57-a83c-4ded-865b-7af003739d9d tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:28:24.100713 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9968ca57-a83c-4ded-865b-7af003739d9d tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:28:24.102048 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9968ca57-a83c-4ded-865b-7af003739d9d tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:28:24.302410 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-9968ca57-a83c-4ded-865b-7af003739d9d tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "GET /compute/v2.1/servers/e806d719-6292-49a9-ab7b-31397991291d/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.218357 Aug 10 23:28:24.305483 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2893/5564] 10.222.0.58 () {60 vars in 1316 bytes} [Wed Aug 10 23:28:24 2022] GET /compute/v2.1/servers/e806d719-6292-49a9-ab7b-31397991291d/os-interface => generated 285 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 23:28:24.715735 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-d1e287df-897d-45ef-9fb5-52b6f827c98e req-88fa9ae8-f7e5-4193-a34d-3f5ddbcd6979 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0df5425-46c7-4aa2-81b7-8113347766ad", "tag": "aa673f43-a995-4dae-b7b0-1c90f9acf05c"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:28:24.729111 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-d1e287df-897d-45ef-9fb5-52b6f827c98e req-88fa9ae8-f7e5-4193-a34d-3f5ddbcd6979 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:28:24.729937 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-d1e287df-897d-45ef-9fb5-52b6f827c98e req-88fa9ae8-f7e5-4193-a34d-3f5ddbcd6979 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:28:24.730624 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-d1e287df-897d-45ef-9fb5-52b6f827c98e req-88fa9ae8-f7e5-4193-a34d-3f5ddbcd6979 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:28:24.746569 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-d1e287df-897d-45ef-9fb5-52b6f827c98e req-88fa9ae8-f7e5-4193-a34d-3f5ddbcd6979 service nova] Creating event network-changed:aa673f43-a995-4dae-b7b0-1c90f9acf05c for instance d0df5425-46c7-4aa2-81b7-8113347766ad on n-h1-850468-14 Aug 10 23:28:24.770768 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-d1e287df-897d-45ef-9fb5-52b6f827c98e req-88fa9ae8-f7e5-4193-a34d-3f5ddbcd6979 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.303729 Aug 10 23:28:24.776410 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2672/5565] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:28:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:28:26.637266 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-67d8e2fa-9756-44db-a03a-00b5d533703a req-ddc8b9e2-5e8a-42b5-9938-6e551373ebbf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e806d719-6292-49a9-ab7b-31397991291d", "tag": "bd30930e-8098-4180-afd1-75ee64f8dc5a"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:28:26.656640 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-67d8e2fa-9756-44db-a03a-00b5d533703a req-ddc8b9e2-5e8a-42b5-9938-6e551373ebbf service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:28:26.657133 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-67d8e2fa-9756-44db-a03a-00b5d533703a req-ddc8b9e2-5e8a-42b5-9938-6e551373ebbf service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:28:26.657570 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-67d8e2fa-9756-44db-a03a-00b5d533703a req-ddc8b9e2-5e8a-42b5-9938-6e551373ebbf service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:28:26.699386 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-67d8e2fa-9756-44db-a03a-00b5d533703a req-ddc8b9e2-5e8a-42b5-9938-6e551373ebbf service nova] Creating event network-changed:bd30930e-8098-4180-afd1-75ee64f8dc5a for instance e806d719-6292-49a9-ab7b-31397991291d on n-h2-850468-14 Aug 10 23:28:26.714924 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-67d8e2fa-9756-44db-a03a-00b5d533703a req-ddc8b9e2-5e8a-42b5-9938-6e551373ebbf service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082510 Aug 10 23:28:26.720797 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2894/5566] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:28:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:28:28.689795 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-672bcb5e-f393-4051-90dd-23efadcee2a0 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:28:28.690977 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-672bcb5e-f393-4051-90dd-23efadcee2a0 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] [instance: 94831c62-29a5-4745-b321-11b28dafaaa6] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:28:28.700169 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-672bcb5e-f393-4051-90dd-23efadcee2a0 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:28:28.701001 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-672bcb5e-f393-4051-90dd-23efadcee2a0 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:28:28.701708 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-672bcb5e-f393-4051-90dd-23efadcee2a0 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:28:28.702698 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-672bcb5e-f393-4051-90dd-23efadcee2a0 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:28:28.703755 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-672bcb5e-f393-4051-90dd-23efadcee2a0 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:28:28.704397 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-672bcb5e-f393-4051-90dd-23efadcee2a0 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:28:29.019829 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-672bcb5e-f393-4051-90dd-23efadcee2a0 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:28:29.033280 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-672bcb5e-f393-4051-90dd-23efadcee2a0 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:28:29.035190 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-672bcb5e-f393-4051-90dd-23efadcee2a0 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:28:29.036667 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-672bcb5e-f393-4051-90dd-23efadcee2a0 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] 10.222.0.58 "GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6" status: 200 len: 2953 microversion: 2.42 time: 0.358689 Aug 10 23:28:29.037557 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2673/5567] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:28:28 2022] GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6 => generated 2953 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:28:29.076260 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-82fd89d1-b0fd-495b-ad07-cad2c7b97748 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:28:29.077626 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-82fd89d1-b0fd-495b-ad07-cad2c7b97748 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] [instance: 94831c62-29a5-4745-b321-11b28dafaaa6] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:28:29.092207 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-82fd89d1-b0fd-495b-ad07-cad2c7b97748 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:28:29.094125 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-82fd89d1-b0fd-495b-ad07-cad2c7b97748 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:28:29.095160 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-82fd89d1-b0fd-495b-ad07-cad2c7b97748 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:28:29.096798 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-82fd89d1-b0fd-495b-ad07-cad2c7b97748 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:28:29.097791 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-82fd89d1-b0fd-495b-ad07-cad2c7b97748 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:28:29.098764 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-82fd89d1-b0fd-495b-ad07-cad2c7b97748 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:28:29.329193 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-82fd89d1-b0fd-495b-ad07-cad2c7b97748 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] 10.222.0.58 "GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6/os-interface" status: 200 len: 1831 microversion: 2.42 time: 0.260065 Aug 10 23:28:29.330975 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2895/5568] 10.222.0.58 () {60 vars in 1316 bytes} [Wed Aug 10 23:28:29 2022] GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6/os-interface => generated 1831 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:28:42.389031 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-2d9db073-1e0e-4f22-8f9f-4d493ad0d204 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-792132775", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452", "networks": [{"uuid": "fddc3a1d-a321-4d78-8860-79337fdb4661"}]}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:28:42.399927 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_api:SELECT=19 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:28:42.400595 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=47 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:28:42.468937 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.network.neutron [None req-2d9db073-1e0e-4f22-8f9f-4d493ad0d204 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] validate_networks() for [('fddc3a1d-a321-4d78-8860-79337fdb4661', None, None, None, None, None)] {{(pid=122632) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 23:28:43.031075 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-2d9db073-1e0e-4f22-8f9f-4d493ad0d204 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Flavor limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:28:43.031790 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-2d9db073-1e0e-4f22-8f9f-4d493ad0d204 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Image limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:28:43.032546 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-2d9db073-1e0e-4f22-8f9f-4d493ad0d204 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Flavor pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:28:43.033104 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-2d9db073-1e0e-4f22-8f9f-4d493ad0d204 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Image pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:28:43.033951 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-2d9db073-1e0e-4f22-8f9f-4d493ad0d204 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:28:43.046450 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2d9db073-1e0e-4f22-8f9f-4d493ad0d204 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:28:43.046947 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2d9db073-1e0e-4f22-8f9f-4d493ad0d204 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:28:43.047484 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2d9db073-1e0e-4f22-8f9f-4d493ad0d204 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:28:43.048387 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2d9db073-1e0e-4f22-8f9f-4d493ad0d204 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:28:43.048836 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2d9db073-1e0e-4f22-8f9f-4d493ad0d204 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:28:43.049255 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2d9db073-1e0e-4f22-8f9f-4d493ad0d204 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:28:43.074280 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-2d9db073-1e0e-4f22-8f9f-4d493ad0d204 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Getting quotas for project add6bbc9866043499846c4ae3938ff58. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:28:43.081519 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-2d9db073-1e0e-4f22-8f9f-4d493ad0d204 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Getting quotas for user d50c065499e24caa9b0e0d5b499e395d and project add6bbc9866043499846c4ae3938ff58. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:28:43.096441 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-2d9db073-1e0e-4f22-8f9f-4d493ad0d204 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Going to run 1 instances... {{(pid=122632) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 23:28:43.099255 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-2d9db073-1e0e-4f22-8f9f-4d493ad0d204 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] [instance: dca0c450-f6d9-487d-ba7f-e7b0bcf578e8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78ad8905-f66f-4733-8be9-2b260f1fabed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122632) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 23:28:43.151068 n-d-850468-14 devstack@n-api.service[122632]: ERROR oslo.messaging._drivers.impl_rabbit [None req-2d9db073-1e0e-4f22-8f9f-4d493ad0d204 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] [329ab1ee-3736-4e07-a1dd-a75ba01cbc3b] AMQP server on 10.222.0.58:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 10 23:28:44.166538 n-d-850468-14 devstack@n-api.service[122632]: INFO oslo.messaging._drivers.impl_rabbit [None req-2d9db073-1e0e-4f22-8f9f-4d493ad0d204 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] [329ab1ee-3736-4e07-a1dd-a75ba01cbc3b] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 48096. Aug 10 23:28:44.171783 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-2d9db073-1e0e-4f22-8f9f-4d493ad0d204 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.787696 Aug 10 23:28:44.172612 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2674/5569] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 23:28:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 1789 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 23:28:44.184180 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-ebb78ff8-bfcf-41ba-aa0b-68cebcedc809 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:28:44.185028 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-ebb78ff8-bfcf-41ba-aa0b-68cebcedc809 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] [instance: dca0c450-f6d9-487d-ba7f-e7b0bcf578e8] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:28:44.188401 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=7 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:28:44.189573 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=15 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:28:44.278463 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-ebb78ff8-bfcf-41ba-aa0b-68cebcedc809 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c065499e24caa9b0e0d5b499e395d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add6bbc9866043499846c4ae3938ff58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:28:44.288826 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-ebb78ff8-bfcf-41ba-aa0b-68cebcedc809 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] 10.222.0.58 "GET /compute/v2.1/servers/dca0c450-f6d9-487d-ba7f-e7b0bcf578e8" status: 200 len: 1213 microversion: 2.1 time: 0.108350 Aug 10 23:28:44.289815 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2896/5570] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:28:44 2022] GET /compute/v2.1/servers/dca0c450-f6d9-487d-ba7f-e7b0bcf578e8 => generated 1213 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:28:45.312536 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-5066a611-54ac-43ef-b4d8-a84ec89bbb84 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:28:45.313365 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-5066a611-54ac-43ef-b4d8-a84ec89bbb84 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] [instance: dca0c450-f6d9-487d-ba7f-e7b0bcf578e8] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:28:45.327948 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5066a611-54ac-43ef-b4d8-a84ec89bbb84 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:28:45.328738 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5066a611-54ac-43ef-b4d8-a84ec89bbb84 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:28:45.329431 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5066a611-54ac-43ef-b4d8-a84ec89bbb84 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:28:45.330405 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5066a611-54ac-43ef-b4d8-a84ec89bbb84 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:28:45.331720 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5066a611-54ac-43ef-b4d8-a84ec89bbb84 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:28:45.332218 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5066a611-54ac-43ef-b4d8-a84ec89bbb84 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:28:45.466357 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-5066a611-54ac-43ef-b4d8-a84ec89bbb84 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c065499e24caa9b0e0d5b499e395d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add6bbc9866043499846c4ae3938ff58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:28:45.474511 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-5066a611-54ac-43ef-b4d8-a84ec89bbb84 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] 10.222.0.58 "GET /compute/v2.1/servers/dca0c450-f6d9-487d-ba7f-e7b0bcf578e8" status: 200 len: 1273 microversion: 2.1 time: 0.166061 Aug 10 23:28:45.479515 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2675/5571] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:28:45 2022] GET /compute/v2.1/servers/dca0c450-f6d9-487d-ba7f-e7b0bcf578e8 => generated 1273 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:28:46.520833 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-0af9bbb9-735b-4c08-9689-0ae31c528ea1 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:28:46.521352 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-0af9bbb9-735b-4c08-9689-0ae31c528ea1 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] [instance: dca0c450-f6d9-487d-ba7f-e7b0bcf578e8] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:28:46.554966 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0af9bbb9-735b-4c08-9689-0ae31c528ea1 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:28:46.555724 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0af9bbb9-735b-4c08-9689-0ae31c528ea1 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:28:46.557376 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0af9bbb9-735b-4c08-9689-0ae31c528ea1 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:28:46.559166 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0af9bbb9-735b-4c08-9689-0ae31c528ea1 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:28:46.559802 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0af9bbb9-735b-4c08-9689-0ae31c528ea1 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:28:46.561079 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0af9bbb9-735b-4c08-9689-0ae31c528ea1 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:28:46.777646 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-0af9bbb9-735b-4c08-9689-0ae31c528ea1 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c065499e24caa9b0e0d5b499e395d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add6bbc9866043499846c4ae3938ff58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:28:46.793689 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-0af9bbb9-735b-4c08-9689-0ae31c528ea1 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] 10.222.0.58 "GET /compute/v2.1/servers/dca0c450-f6d9-487d-ba7f-e7b0bcf578e8" status: 200 len: 1271 microversion: 2.1 time: 0.276513 Aug 10 23:28:46.804154 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2897/5572] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:28:46 2022] GET /compute/v2.1/servers/dca0c450-f6d9-487d-ba7f-e7b0bcf578e8 => generated 1271 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:28:47.028967 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-872074b7-a7d2-4479-ad10-f38dcd1e95f7 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:28:47.033664 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-872074b7-a7d2-4479-ad10-f38dcd1e95f7 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] [instance: d0df5425-46c7-4aa2-81b7-8113347766ad] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:28:47.056371 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-872074b7-a7d2-4479-ad10-f38dcd1e95f7 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:28:47.059189 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-872074b7-a7d2-4479-ad10-f38dcd1e95f7 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:28:47.059663 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-872074b7-a7d2-4479-ad10-f38dcd1e95f7 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:28:47.063701 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-872074b7-a7d2-4479-ad10-f38dcd1e95f7 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:28:47.067130 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-872074b7-a7d2-4479-ad10-f38dcd1e95f7 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:28:47.069225 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-872074b7-a7d2-4479-ad10-f38dcd1e95f7 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:28:47.175084 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-872074b7-a7d2-4479-ad10-f38dcd1e95f7 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] 10.222.0.58 "POST /compute/v2.1/servers/d0df5425-46c7-4aa2-81b7-8113347766ad/action" status: 200 len: 24567 microversion: 2.1 time: 0.155383 Aug 10 23:28:47.185755 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2676/5573] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:28:47 2022] POST /compute/v2.1/servers/d0df5425-46c7-4aa2-81b7-8113347766ad/action => generated 24567 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 23:28:47.821345 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-87006ee3-5ff0-431f-80e2-dd973173dad3 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:28:47.822224 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-87006ee3-5ff0-431f-80e2-dd973173dad3 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] [instance: dca0c450-f6d9-487d-ba7f-e7b0bcf578e8] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:28:47.833775 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-87006ee3-5ff0-431f-80e2-dd973173dad3 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:28:47.833965 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-87006ee3-5ff0-431f-80e2-dd973173dad3 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:28:47.839080 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-87006ee3-5ff0-431f-80e2-dd973173dad3 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:28:47.840180 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-87006ee3-5ff0-431f-80e2-dd973173dad3 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:28:47.840936 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-87006ee3-5ff0-431f-80e2-dd973173dad3 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:28:47.841576 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-87006ee3-5ff0-431f-80e2-dd973173dad3 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:28:47.897753 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-54103c79-fef6-4851-a981-dc4231127d16 req-0db4f579-c67e-4e18-a0a9-e244c064e6ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dca0c450-f6d9-487d-ba7f-e7b0bcf578e8", "tag": "10f4459b-60c6-4c68-8f12-69fbc828a7eb"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:28:47.953417 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-54103c79-fef6-4851-a981-dc4231127d16 req-0db4f579-c67e-4e18-a0a9-e244c064e6ac service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:28:47.955208 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-54103c79-fef6-4851-a981-dc4231127d16 req-0db4f579-c67e-4e18-a0a9-e244c064e6ac service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:28:47.958244 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-54103c79-fef6-4851-a981-dc4231127d16 req-0db4f579-c67e-4e18-a0a9-e244c064e6ac service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:28:47.979213 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-54103c79-fef6-4851-a981-dc4231127d16 req-0db4f579-c67e-4e18-a0a9-e244c064e6ac service nova] Creating event network-changed:10f4459b-60c6-4c68-8f12-69fbc828a7eb for instance dca0c450-f6d9-487d-ba7f-e7b0bcf578e8 on n-h1-850468-14 Aug 10 23:28:47.985761 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-54103c79-fef6-4851-a981-dc4231127d16 req-0db4f579-c67e-4e18-a0a9-e244c064e6ac service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098623 Aug 10 23:28:47.988548 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2677/5574] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:28:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 23:28:48.152613 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-87006ee3-5ff0-431f-80e2-dd973173dad3 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c065499e24caa9b0e0d5b499e395d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add6bbc9866043499846c4ae3938ff58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:28:48.163043 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-87006ee3-5ff0-431f-80e2-dd973173dad3 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] 10.222.0.58 "GET /compute/v2.1/servers/dca0c450-f6d9-487d-ba7f-e7b0bcf578e8" status: 200 len: 1313 microversion: 2.1 time: 0.345231 Aug 10 23:28:48.175462 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2898/5575] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:28:47 2022] GET /compute/v2.1/servers/dca0c450-f6d9-487d-ba7f-e7b0bcf578e8 => generated 1313 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:28:49.187452 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-d2c299e4-5f3d-4f58-81cc-e6e0d29126b5 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:28:49.188917 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-d2c299e4-5f3d-4f58-81cc-e6e0d29126b5 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] [instance: dca0c450-f6d9-487d-ba7f-e7b0bcf578e8] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:28:49.199123 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d2c299e4-5f3d-4f58-81cc-e6e0d29126b5 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:28:49.199904 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d2c299e4-5f3d-4f58-81cc-e6e0d29126b5 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:28:49.200669 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d2c299e4-5f3d-4f58-81cc-e6e0d29126b5 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:28:49.201594 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d2c299e4-5f3d-4f58-81cc-e6e0d29126b5 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:28:49.202416 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d2c299e4-5f3d-4f58-81cc-e6e0d29126b5 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:28:49.203103 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d2c299e4-5f3d-4f58-81cc-e6e0d29126b5 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:28:49.389183 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-d2c299e4-5f3d-4f58-81cc-e6e0d29126b5 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c065499e24caa9b0e0d5b499e395d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add6bbc9866043499846c4ae3938ff58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:28:49.397866 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-d2c299e4-5f3d-4f58-81cc-e6e0d29126b5 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] 10.222.0.58 "GET /compute/v2.1/servers/dca0c450-f6d9-487d-ba7f-e7b0bcf578e8" status: 200 len: 1313 microversion: 2.1 time: 0.215590 Aug 10 23:28:49.398713 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2678/5576] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:28:49 2022] GET /compute/v2.1/servers/dca0c450-f6d9-487d-ba7f-e7b0bcf578e8 => generated 1313 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:28:50.419909 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-83c7a0f4-aa0c-434c-b03a-2514009584d9 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:28:50.420707 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-83c7a0f4-aa0c-434c-b03a-2514009584d9 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] [instance: dca0c450-f6d9-487d-ba7f-e7b0bcf578e8] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:28:50.429581 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-83c7a0f4-aa0c-434c-b03a-2514009584d9 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:28:50.430076 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-83c7a0f4-aa0c-434c-b03a-2514009584d9 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:28:50.430545 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-83c7a0f4-aa0c-434c-b03a-2514009584d9 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:28:50.431285 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-83c7a0f4-aa0c-434c-b03a-2514009584d9 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:28:50.431738 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-83c7a0f4-aa0c-434c-b03a-2514009584d9 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:28:50.432160 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-83c7a0f4-aa0c-434c-b03a-2514009584d9 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:28:50.615662 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-83c7a0f4-aa0c-434c-b03a-2514009584d9 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c065499e24caa9b0e0d5b499e395d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add6bbc9866043499846c4ae3938ff58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:28:50.625300 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-83c7a0f4-aa0c-434c-b03a-2514009584d9 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] 10.222.0.58 "GET /compute/v2.1/servers/dca0c450-f6d9-487d-ba7f-e7b0bcf578e8" status: 200 len: 1313 microversion: 2.1 time: 0.209290 Aug 10 23:28:50.625880 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2899/5577] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:28:50 2022] GET /compute/v2.1/servers/dca0c450-f6d9-487d-ba7f-e7b0bcf578e8 => generated 1313 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:28:51.648133 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-23dfcf1a-0314-4848-943f-9bfa52350d02 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:28:51.648877 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-23dfcf1a-0314-4848-943f-9bfa52350d02 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] [instance: dca0c450-f6d9-487d-ba7f-e7b0bcf578e8] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:28:51.656110 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-23dfcf1a-0314-4848-943f-9bfa52350d02 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:28:51.656606 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-23dfcf1a-0314-4848-943f-9bfa52350d02 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:28:51.657048 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-23dfcf1a-0314-4848-943f-9bfa52350d02 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:28:51.657754 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-23dfcf1a-0314-4848-943f-9bfa52350d02 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:28:51.658230 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-23dfcf1a-0314-4848-943f-9bfa52350d02 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:28:51.658809 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-23dfcf1a-0314-4848-943f-9bfa52350d02 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:28:51.802466 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-23dfcf1a-0314-4848-943f-9bfa52350d02 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c065499e24caa9b0e0d5b499e395d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add6bbc9866043499846c4ae3938ff58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:28:51.811868 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-23dfcf1a-0314-4848-943f-9bfa52350d02 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] 10.222.0.58 "GET /compute/v2.1/servers/dca0c450-f6d9-487d-ba7f-e7b0bcf578e8" status: 200 len: 1313 microversion: 2.1 time: 0.168304 Aug 10 23:28:51.812583 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2679/5578] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:28:51 2022] GET /compute/v2.1/servers/dca0c450-f6d9-487d-ba7f-e7b0bcf578e8 => generated 1313 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:28:52.833231 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-eca4387e-317e-4131-936d-fc105222f866 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:28:52.833989 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-eca4387e-317e-4131-936d-fc105222f866 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] [instance: dca0c450-f6d9-487d-ba7f-e7b0bcf578e8] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:28:52.842423 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-eca4387e-317e-4131-936d-fc105222f866 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:28:52.843245 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-eca4387e-317e-4131-936d-fc105222f866 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:28:52.843686 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-eca4387e-317e-4131-936d-fc105222f866 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:28:52.844401 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-eca4387e-317e-4131-936d-fc105222f866 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:28:52.844860 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-eca4387e-317e-4131-936d-fc105222f866 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:28:52.845289 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-eca4387e-317e-4131-936d-fc105222f866 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:28:53.018586 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-eca4387e-317e-4131-936d-fc105222f866 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c065499e24caa9b0e0d5b499e395d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add6bbc9866043499846c4ae3938ff58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:28:53.037143 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-eca4387e-317e-4131-936d-fc105222f866 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] 10.222.0.58 "GET /compute/v2.1/servers/dca0c450-f6d9-487d-ba7f-e7b0bcf578e8" status: 200 len: 1313 microversion: 2.1 time: 0.208654 Aug 10 23:28:53.048288 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2900/5579] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:28:52 2022] GET /compute/v2.1/servers/dca0c450-f6d9-487d-ba7f-e7b0bcf578e8 => generated 1313 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:28:53.202503 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=2 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:28:53.203743 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=6 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:28:53.208815 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-673ee8e0-1d7f-4fae-b741-484a21915333 req-6f20794e-c1e7-4cc4-9ca5-cb783849bee8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dca0c450-f6d9-487d-ba7f-e7b0bcf578e8", "name": "network-vif-plugged", "status": "completed", "tag": "10f4459b-60c6-4c68-8f12-69fbc828a7eb"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:28:53.222083 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-673ee8e0-1d7f-4fae-b741-484a21915333 req-6f20794e-c1e7-4cc4-9ca5-cb783849bee8 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:28:53.222755 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-673ee8e0-1d7f-4fae-b741-484a21915333 req-6f20794e-c1e7-4cc4-9ca5-cb783849bee8 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:28:53.224821 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-673ee8e0-1d7f-4fae-b741-484a21915333 req-6f20794e-c1e7-4cc4-9ca5-cb783849bee8 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:28:53.239487 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-673ee8e0-1d7f-4fae-b741-484a21915333 req-6f20794e-c1e7-4cc4-9ca5-cb783849bee8 service nova] Creating event network-vif-plugged:10f4459b-60c6-4c68-8f12-69fbc828a7eb for instance dca0c450-f6d9-487d-ba7f-e7b0bcf578e8 on n-h1-850468-14 Aug 10 23:28:53.247263 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-673ee8e0-1d7f-4fae-b741-484a21915333 req-6f20794e-c1e7-4cc4-9ca5-cb783849bee8 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046287 Aug 10 23:28:53.248557 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2680/5580] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:28:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:28:54.060310 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-1cc43f07-6740-43e4-a5fd-3159517ef7c0 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:28:54.063037 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-1cc43f07-6740-43e4-a5fd-3159517ef7c0 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] [instance: dca0c450-f6d9-487d-ba7f-e7b0bcf578e8] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:28:54.070626 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1cc43f07-6740-43e4-a5fd-3159517ef7c0 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:28:54.071235 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1cc43f07-6740-43e4-a5fd-3159517ef7c0 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:28:54.071677 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1cc43f07-6740-43e4-a5fd-3159517ef7c0 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:28:54.072390 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1cc43f07-6740-43e4-a5fd-3159517ef7c0 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:28:54.072874 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1cc43f07-6740-43e4-a5fd-3159517ef7c0 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:28:54.073302 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1cc43f07-6740-43e4-a5fd-3159517ef7c0 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:28:54.250836 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-1cc43f07-6740-43e4-a5fd-3159517ef7c0 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c065499e24caa9b0e0d5b499e395d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add6bbc9866043499846c4ae3938ff58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:28:54.260105 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-1cc43f07-6740-43e4-a5fd-3159517ef7c0 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] 10.222.0.58 "GET /compute/v2.1/servers/dca0c450-f6d9-487d-ba7f-e7b0bcf578e8" status: 200 len: 1313 microversion: 2.1 time: 0.204130 Aug 10 23:28:54.271569 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2901/5581] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:28:54 2022] GET /compute/v2.1/servers/dca0c450-f6d9-487d-ba7f-e7b0bcf578e8 => generated 1313 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:28:55.285134 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-e4bbc457-dd70-47b6-8b34-ed4d200f9f57 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:28:55.286268 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-e4bbc457-dd70-47b6-8b34-ed4d200f9f57 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] [instance: dca0c450-f6d9-487d-ba7f-e7b0bcf578e8] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:28:55.294556 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e4bbc457-dd70-47b6-8b34-ed4d200f9f57 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:28:55.295085 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e4bbc457-dd70-47b6-8b34-ed4d200f9f57 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:28:55.295739 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e4bbc457-dd70-47b6-8b34-ed4d200f9f57 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:28:55.296588 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e4bbc457-dd70-47b6-8b34-ed4d200f9f57 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:28:55.297055 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e4bbc457-dd70-47b6-8b34-ed4d200f9f57 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:28:55.297480 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e4bbc457-dd70-47b6-8b34-ed4d200f9f57 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:28:55.457082 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-e4bbc457-dd70-47b6-8b34-ed4d200f9f57 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c065499e24caa9b0e0d5b499e395d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add6bbc9866043499846c4ae3938ff58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:28:55.466672 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-e4bbc457-dd70-47b6-8b34-ed4d200f9f57 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] 10.222.0.58 "GET /compute/v2.1/servers/dca0c450-f6d9-487d-ba7f-e7b0bcf578e8" status: 200 len: 1496 microversion: 2.1 time: 0.187199 Aug 10 23:28:55.468151 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2681/5582] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:28:55 2022] GET /compute/v2.1/servers/dca0c450-f6d9-487d-ba7f-e7b0bcf578e8 => generated 1496 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:28:56.057365 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-ac08a65e-2917-43c2-a97e-5554479949cb tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:28:56.058474 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-ac08a65e-2917-43c2-a97e-5554479949cb tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] [instance: dca0c450-f6d9-487d-ba7f-e7b0bcf578e8] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:28:56.064531 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=2 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:28:56.068952 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ac08a65e-2917-43c2-a97e-5554479949cb tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:28:56.073405 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ac08a65e-2917-43c2-a97e-5554479949cb tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:28:56.073901 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ac08a65e-2917-43c2-a97e-5554479949cb tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:28:56.074641 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ac08a65e-2917-43c2-a97e-5554479949cb tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:28:56.075215 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ac08a65e-2917-43c2-a97e-5554479949cb tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:28:56.076381 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ac08a65e-2917-43c2-a97e-5554479949cb tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:28:56.104601 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-ac08a65e-2917-43c2-a97e-5554479949cb tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] [instance: dca0c450-f6d9-487d-ba7f-e7b0bcf578e8] Going to try to terminate instance {{(pid=122633) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:28:56.217364 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-ac08a65e-2917-43c2-a97e-5554479949cb tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] 10.222.0.58 "DELETE /compute/v2.1/servers/dca0c450-f6d9-487d-ba7f-e7b0bcf578e8" status: 204 len: 0 microversion: 2.1 time: 0.163410 Aug 10 23:28:56.217998 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2902/5583] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:28:56 2022] DELETE /compute/v2.1/servers/dca0c450-f6d9-487d-ba7f-e7b0bcf578e8 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:28:56.229823 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-ef7972df-e752-4e79-95d4-4fe50eafba1c tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:28:56.230944 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-ef7972df-e752-4e79-95d4-4fe50eafba1c tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] [instance: dca0c450-f6d9-487d-ba7f-e7b0bcf578e8] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:28:56.239722 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ef7972df-e752-4e79-95d4-4fe50eafba1c tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:28:56.240619 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ef7972df-e752-4e79-95d4-4fe50eafba1c tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:28:56.241351 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ef7972df-e752-4e79-95d4-4fe50eafba1c tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:28:56.243054 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ef7972df-e752-4e79-95d4-4fe50eafba1c tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:28:56.243912 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ef7972df-e752-4e79-95d4-4fe50eafba1c tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:28:56.244574 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ef7972df-e752-4e79-95d4-4fe50eafba1c tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:28:56.414505 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-ef7972df-e752-4e79-95d4-4fe50eafba1c tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c065499e24caa9b0e0d5b499e395d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add6bbc9866043499846c4ae3938ff58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:28:56.427499 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-ef7972df-e752-4e79-95d4-4fe50eafba1c tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] 10.222.0.58 "GET /compute/v2.1/servers/dca0c450-f6d9-487d-ba7f-e7b0bcf578e8" status: 200 len: 1502 microversion: 2.1 time: 0.203456 Aug 10 23:28:56.428642 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2682/5584] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:28:56 2022] GET /compute/v2.1/servers/dca0c450-f6d9-487d-ba7f-e7b0bcf578e8 => generated 1502 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:28:57.454858 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-f047e937-12a5-4b8c-b9be-77b0b337f448 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:28:57.457311 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-f047e937-12a5-4b8c-b9be-77b0b337f448 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] [instance: dca0c450-f6d9-487d-ba7f-e7b0bcf578e8] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:28:57.465442 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f047e937-12a5-4b8c-b9be-77b0b337f448 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:28:57.466894 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f047e937-12a5-4b8c-b9be-77b0b337f448 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:28:57.467809 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f047e937-12a5-4b8c-b9be-77b0b337f448 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:28:57.469513 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f047e937-12a5-4b8c-b9be-77b0b337f448 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:28:57.470172 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f047e937-12a5-4b8c-b9be-77b0b337f448 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:28:57.470980 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f047e937-12a5-4b8c-b9be-77b0b337f448 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:28:57.771877 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-f047e937-12a5-4b8c-b9be-77b0b337f448 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c065499e24caa9b0e0d5b499e395d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add6bbc9866043499846c4ae3938ff58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:28:57.780903 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-f047e937-12a5-4b8c-b9be-77b0b337f448 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] 10.222.0.58 "GET /compute/v2.1/servers/dca0c450-f6d9-487d-ba7f-e7b0bcf578e8" status: 200 len: 1502 microversion: 2.1 time: 0.332720 Aug 10 23:28:57.781502 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2903/5585] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:28:57 2022] GET /compute/v2.1/servers/dca0c450-f6d9-487d-ba7f-e7b0bcf578e8 => generated 1502 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:28:58.243860 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-eaf4037e-f09d-4ee4-9d63-3d55ccee0d65 req-0198b5c6-03c7-44b4-b76d-78b08d0e9186 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dca0c450-f6d9-487d-ba7f-e7b0bcf578e8", "name": "network-vif-deleted", "tag": "10f4459b-60c6-4c68-8f12-69fbc828a7eb"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:28:58.264080 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-eaf4037e-f09d-4ee4-9d63-3d55ccee0d65 req-0198b5c6-03c7-44b4-b76d-78b08d0e9186 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:28:58.266708 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-eaf4037e-f09d-4ee4-9d63-3d55ccee0d65 req-0198b5c6-03c7-44b4-b76d-78b08d0e9186 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:28:58.267362 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-eaf4037e-f09d-4ee4-9d63-3d55ccee0d65 req-0198b5c6-03c7-44b4-b76d-78b08d0e9186 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:28:58.290003 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-eaf4037e-f09d-4ee4-9d63-3d55ccee0d65 req-0198b5c6-03c7-44b4-b76d-78b08d0e9186 service nova] Creating event network-vif-deleted:10f4459b-60c6-4c68-8f12-69fbc828a7eb for instance dca0c450-f6d9-487d-ba7f-e7b0bcf578e8 on n-h1-850468-14 Aug 10 23:28:58.299081 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-eaf4037e-f09d-4ee4-9d63-3d55ccee0d65 req-0198b5c6-03c7-44b4-b76d-78b08d0e9186 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060004 Aug 10 23:28:58.304304 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2683/5586] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:28:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:28:58.802534 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-57cc3fb7-ba28-4d9a-aebf-e170240da556 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:28:58.803832 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-57cc3fb7-ba28-4d9a-aebf-e170240da556 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] [instance: dca0c450-f6d9-487d-ba7f-e7b0bcf578e8] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:28:58.810845 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-57cc3fb7-ba28-4d9a-aebf-e170240da556 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:28:58.812271 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-57cc3fb7-ba28-4d9a-aebf-e170240da556 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:28:58.812717 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-57cc3fb7-ba28-4d9a-aebf-e170240da556 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:28:58.813422 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-57cc3fb7-ba28-4d9a-aebf-e170240da556 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:28:58.813878 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-57cc3fb7-ba28-4d9a-aebf-e170240da556 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:28:58.814329 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-57cc3fb7-ba28-4d9a-aebf-e170240da556 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:28:58.829035 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-57cc3fb7-ba28-4d9a-aebf-e170240da556 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] HTTP exception thrown: Instance dca0c450-f6d9-487d-ba7f-e7b0bcf578e8 could not be found. Aug 10 23:28:58.830698 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-57cc3fb7-ba28-4d9a-aebf-e170240da556 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Request method failure captured: Aug 10 23:28:58.830698 n-d-850468-14 devstack@n-api.service[122633]: request: GET /compute/v2.1/servers/dca0c450-f6d9-487d-ba7f-e7b0bcf578e8 HTTP/1.1 Aug 10 23:28:58.830698 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:28:58.830698 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:28:58.830698 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:28:58.830698 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:28:58.830698 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:28:58.830698 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:28:58.830698 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:28:58.830698 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:28:58.830698 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9D8oJsFSchDW2HEfzqu6ElI9Tyns1oeZoGf-Pis0zUDzPiTouVLC39sL1YM0hoRnMmSmg1Y33YawlpKuJjZUoKwFxVr-oerY12SeLiDiLgqRRkcVl4qf_c-okUuHeyAw6qpPjKExFrsONjjddjo1vZrZ3yvM2Zw4VsS1U2ykzcZzyVE Aug 10 23:28:58.830698 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:28:58.830698 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:28:58.830698 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:28:58.830698 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:28:58.830698 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:28:58.830698 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:28:58.830698 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: add6bbc9866043499846c4ae3938ff58 Aug 10 23:28:58.830698 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-VolumesActionsTest-1050746670 Aug 10 23:28:58.830698 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:28:58.830698 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:28:58.830698 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/add6bbc9866043499846c4ae3938ff58"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/add6bbc9866043499846c4ae3938ff58"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/add6bbc9866043499846c4ae3938ff58"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_add6bbc9866043499846c4ae3938ff58", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:28:58.830698 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-VolumesActionsTest-1050746670 Aug 10 23:28:58.830698 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: add6bbc9866043499846c4ae3938ff58 Aug 10 23:28:58.830698 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-VolumesActionsTest-1050746670 Aug 10 23:28:58.830698 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-VolumesActionsTest-1050746670-project Aug 10 23:28:58.830698 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:28:58.830698 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:28:58.830698 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: d50c065499e24caa9b0e0d5b499e395d Aug 10 23:28:58.830698 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-VolumesActionsTest-1050746670-project Aug 10 23:28:58.830698 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:28:58.830698 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance dca0c450-f6d9-487d-ba7f-e7b0bcf578e8 could not be found. Aug 10 23:28:58.830698 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': 'dca0c450-f6d9-487d-ba7f-e7b0bcf578e8'} Aug 10 23:28:58.830698 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:28:58.830698 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:28:58.830698 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:28:58.830698 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:28:58.830698 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:28:58.830698 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:28:58.830698 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:28:58.830698 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:28:58.830698 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:28:58.830698 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:28:58.830698 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dca0c450-f6d9-487d-ba7f-e7b0bcf578e8 could not be found. Aug 10 23:28:58.830698 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:28:58.830698 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:28:58.830698 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:28:58.830698 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:28:58.830698 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:28:58.830698 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:28:58.830698 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:28:58.830698 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:28:58.830698 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:28:58.830698 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:28:58.830698 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:28:58.830698 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:28:58.830698 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:28:58.830698 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:28:58.830698 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:28:58.830698 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:28:58.830698 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dca0c450-f6d9-487d-ba7f-e7b0bcf578e8 could not be found. Aug 10 23:28:58.830698 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:28:58.830698 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:28:58.830698 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:28:58.835186 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:28:58.835186 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:28:58.835186 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:28:58.835186 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:28:58.835186 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:28:58.835186 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dca0c450-f6d9-487d-ba7f-e7b0bcf578e8 could not be found. Aug 10 23:28:58.835186 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:28:58.837599 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-57cc3fb7-ba28-4d9a-aebf-e170240da556 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Returning 404 to user: Instance dca0c450-f6d9-487d-ba7f-e7b0bcf578e8 could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:28:58.838642 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-57cc3fb7-ba28-4d9a-aebf-e170240da556 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] 10.222.0.58 "GET /compute/v2.1/servers/dca0c450-f6d9-487d-ba7f-e7b0bcf578e8" status: 404 len: 111 microversion: 2.1 time: 0.040215 Aug 10 23:28:58.839256 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2904/5587] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:28:58 2022] GET /compute/v2.1/servers/dca0c450-f6d9-487d-ba7f-e7b0bcf578e8 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:28:59.004749 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-5167a352-74a3-4f52-9567-be85b2bb1c1d tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-601686124", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452", "networks": [{"uuid": "fddc3a1d-a321-4d78-8860-79337fdb4661"}]}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:28:59.075652 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.network.neutron [None req-5167a352-74a3-4f52-9567-be85b2bb1c1d tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] validate_networks() for [('fddc3a1d-a321-4d78-8860-79337fdb4661', None, None, None, None, None)] {{(pid=122632) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 23:28:59.581539 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-5167a352-74a3-4f52-9567-be85b2bb1c1d tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Flavor limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:28:59.582120 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-5167a352-74a3-4f52-9567-be85b2bb1c1d tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Image limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:28:59.583065 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-5167a352-74a3-4f52-9567-be85b2bb1c1d tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Flavor pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:28:59.584672 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-5167a352-74a3-4f52-9567-be85b2bb1c1d tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Image pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:28:59.585334 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-5167a352-74a3-4f52-9567-be85b2bb1c1d tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:28:59.599970 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5167a352-74a3-4f52-9567-be85b2bb1c1d tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:28:59.600675 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5167a352-74a3-4f52-9567-be85b2bb1c1d tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:28:59.601255 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5167a352-74a3-4f52-9567-be85b2bb1c1d tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:28:59.602160 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5167a352-74a3-4f52-9567-be85b2bb1c1d tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:28:59.602803 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5167a352-74a3-4f52-9567-be85b2bb1c1d tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:28:59.603814 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5167a352-74a3-4f52-9567-be85b2bb1c1d tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:28:59.633658 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-5167a352-74a3-4f52-9567-be85b2bb1c1d tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Getting quotas for project add6bbc9866043499846c4ae3938ff58. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:28:59.641161 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-5167a352-74a3-4f52-9567-be85b2bb1c1d tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Getting quotas for user d50c065499e24caa9b0e0d5b499e395d and project add6bbc9866043499846c4ae3938ff58. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:28:59.661696 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-5167a352-74a3-4f52-9567-be85b2bb1c1d tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Going to run 1 instances... {{(pid=122632) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 23:28:59.664359 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-5167a352-74a3-4f52-9567-be85b2bb1c1d tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] [instance: ac44e6f8-57f8-46fa-b369-fb4da2c88568] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78ad8905-f66f-4733-8be9-2b260f1fabed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122632) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 23:28:59.723489 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-5167a352-74a3-4f52-9567-be85b2bb1c1d tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.721624 Aug 10 23:28:59.726464 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2684/5588] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 23:28:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 728 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 23:28:59.736914 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-f4e4648f-ebc0-4f39-b708-31794de0ef0e tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:28:59.737518 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-f4e4648f-ebc0-4f39-b708-31794de0ef0e tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] [instance: ac44e6f8-57f8-46fa-b369-fb4da2c88568] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:28:59.864649 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-f4e4648f-ebc0-4f39-b708-31794de0ef0e tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c065499e24caa9b0e0d5b499e395d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add6bbc9866043499846c4ae3938ff58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:28:59.873684 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-f4e4648f-ebc0-4f39-b708-31794de0ef0e tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] 10.222.0.58 "GET /compute/v2.1/servers/ac44e6f8-57f8-46fa-b369-fb4da2c88568" status: 200 len: 1213 microversion: 2.1 time: 0.140469 Aug 10 23:28:59.878835 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2905/5589] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:28:59 2022] GET /compute/v2.1/servers/ac44e6f8-57f8-46fa-b369-fb4da2c88568 => generated 1213 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:29:00.901485 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-a4d6253d-fdd4-4553-ab8a-4f8d027e97b0 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:29:00.902513 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-a4d6253d-fdd4-4553-ab8a-4f8d027e97b0 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] [instance: ac44e6f8-57f8-46fa-b369-fb4da2c88568] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:29:00.923524 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a4d6253d-fdd4-4553-ab8a-4f8d027e97b0 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:00.924419 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a4d6253d-fdd4-4553-ab8a-4f8d027e97b0 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:00.924876 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a4d6253d-fdd4-4553-ab8a-4f8d027e97b0 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:00.926809 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a4d6253d-fdd4-4553-ab8a-4f8d027e97b0 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:00.927287 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a4d6253d-fdd4-4553-ab8a-4f8d027e97b0 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:00.931115 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a4d6253d-fdd4-4553-ab8a-4f8d027e97b0 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:01.044616 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-a4d6253d-fdd4-4553-ab8a-4f8d027e97b0 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c065499e24caa9b0e0d5b499e395d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add6bbc9866043499846c4ae3938ff58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:29:01.055302 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-a4d6253d-fdd4-4553-ab8a-4f8d027e97b0 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] 10.222.0.58 "GET /compute/v2.1/servers/ac44e6f8-57f8-46fa-b369-fb4da2c88568" status: 200 len: 1273 microversion: 2.1 time: 0.160601 Aug 10 23:29:01.057540 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2685/5590] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:29:00 2022] GET /compute/v2.1/servers/ac44e6f8-57f8-46fa-b369-fb4da2c88568 => generated 1273 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:29:02.079490 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-6c433653-3673-4c69-b20f-6372d938f8bf tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:29:02.080195 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-6c433653-3673-4c69-b20f-6372d938f8bf tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] [instance: ac44e6f8-57f8-46fa-b369-fb4da2c88568] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:29:02.087748 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6c433653-3673-4c69-b20f-6372d938f8bf tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:02.090440 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6c433653-3673-4c69-b20f-6372d938f8bf tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:02.091213 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6c433653-3673-4c69-b20f-6372d938f8bf tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:02.092228 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6c433653-3673-4c69-b20f-6372d938f8bf tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:02.092956 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6c433653-3673-4c69-b20f-6372d938f8bf tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:02.093681 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6c433653-3673-4c69-b20f-6372d938f8bf tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:02.721614 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-6c433653-3673-4c69-b20f-6372d938f8bf tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c065499e24caa9b0e0d5b499e395d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add6bbc9866043499846c4ae3938ff58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:29:02.735367 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-6c433653-3673-4c69-b20f-6372d938f8bf tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] 10.222.0.58 "GET /compute/v2.1/servers/ac44e6f8-57f8-46fa-b369-fb4da2c88568" status: 200 len: 1271 microversion: 2.1 time: 0.659957 Aug 10 23:29:02.736214 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2906/5591] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:29:02 2022] GET /compute/v2.1/servers/ac44e6f8-57f8-46fa-b369-fb4da2c88568 => generated 1271 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:29:03.142912 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-aa06ec62-3137-4880-ab84-c6e2295d33d8 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:29:03.144014 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-aa06ec62-3137-4880-ab84-c6e2295d33d8 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: e806d719-6292-49a9-ab7b-31397991291d] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:29:03.154376 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-aa06ec62-3137-4880-ab84-c6e2295d33d8 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:03.155272 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-aa06ec62-3137-4880-ab84-c6e2295d33d8 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:03.155996 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-aa06ec62-3137-4880-ab84-c6e2295d33d8 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:03.156987 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-aa06ec62-3137-4880-ab84-c6e2295d33d8 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:03.158008 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-aa06ec62-3137-4880-ab84-c6e2295d33d8 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:03.159193 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-aa06ec62-3137-4880-ab84-c6e2295d33d8 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:03.212829 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-aa06ec62-3137-4880-ab84-c6e2295d33d8 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "GET /compute/v2.1/servers/e806d719-6292-49a9-ab7b-31397991291d/ips" status: 200 len: 153 microversion: 2.20 time: 0.061763 Aug 10 23:29:03.214700 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2686/5592] 10.222.0.58 () {60 vars in 1289 bytes} [Wed Aug 10 23:29:03 2022] GET /compute/v2.1/servers/e806d719-6292-49a9-ab7b-31397991291d/ips => generated 153 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 23:29:03.457389 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-31872a4b-87aa-4f51-9ebd-7ae26b470383 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Action: 'create', calling method: .version_select at 0x7f847c075e50>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1079892518", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNM6ThC9kTS6NuDy8LDBC/fcOEDq80yHjan+KMcUjMI6+HGHUIs6e6SR6V1C017yXUcmFhrUKVk4P5+eDC3X4lp1KUxNztGftUYJQPuPVXEPrW6/sNJsA6ilz3f8HxOZTQ=="}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:29:03.542597 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-31872a4b-87aa-4f51-9ebd-7ae26b470383 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Getting quotas for project 679d43599f3e4c29ab368a1e54dae608. Resources: {'key_pairs'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:29:03.579596 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-31872a4b-87aa-4f51-9ebd-7ae26b470383 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Getting quotas for user fbea80d59f5840f1899bd3cf601ac8bf and project 679d43599f3e4c29ab368a1e54dae608. Resources: {'key_pairs'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:29:03.699038 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-31872a4b-87aa-4f51-9ebd-7ae26b470383 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.246357 Aug 10 23:29:03.701883 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2907/5593] 10.222.0.58 () {60 vars in 1159 bytes} [Wed Aug 10 23:29:03 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:29:03.766993 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-255d8b50-c9d4-4a3c-9323-eb8a1d046431 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:29:03.767840 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-255d8b50-c9d4-4a3c-9323-eb8a1d046431 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] [instance: ac44e6f8-57f8-46fa-b369-fb4da2c88568] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:29:03.780384 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-255d8b50-c9d4-4a3c-9323-eb8a1d046431 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:03.781355 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-255d8b50-c9d4-4a3c-9323-eb8a1d046431 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:03.782104 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-255d8b50-c9d4-4a3c-9323-eb8a1d046431 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:03.783693 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-255d8b50-c9d4-4a3c-9323-eb8a1d046431 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:03.786643 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-255d8b50-c9d4-4a3c-9323-eb8a1d046431 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:03.788249 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-255d8b50-c9d4-4a3c-9323-eb8a1d046431 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:04.175085 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-255d8b50-c9d4-4a3c-9323-eb8a1d046431 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c065499e24caa9b0e0d5b499e395d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add6bbc9866043499846c4ae3938ff58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:29:04.182383 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-255d8b50-c9d4-4a3c-9323-eb8a1d046431 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] 10.222.0.58 "GET /compute/v2.1/servers/ac44e6f8-57f8-46fa-b369-fb4da2c88568" status: 200 len: 1313 microversion: 2.1 time: 0.421392 Aug 10 23:29:04.183990 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2687/5594] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:29:03 2022] GET /compute/v2.1/servers/ac44e6f8-57f8-46fa-b369-fb4da2c88568 => generated 1313 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:29:05.208966 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-5c0c5b62-4d4f-40e8-bc39-746b3322340a tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:29:05.209643 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-5c0c5b62-4d4f-40e8-bc39-746b3322340a tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] [instance: ac44e6f8-57f8-46fa-b369-fb4da2c88568] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:29:05.224333 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5c0c5b62-4d4f-40e8-bc39-746b3322340a tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:05.224871 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5c0c5b62-4d4f-40e8-bc39-746b3322340a tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:05.225318 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5c0c5b62-4d4f-40e8-bc39-746b3322340a tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:05.226100 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5c0c5b62-4d4f-40e8-bc39-746b3322340a tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:05.240133 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5c0c5b62-4d4f-40e8-bc39-746b3322340a tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:05.241974 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5c0c5b62-4d4f-40e8-bc39-746b3322340a tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:05.626673 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-6642d710-6f47-46f7-9922-892373efd9e6 req-c4b90f10-4ce8-423d-b569-27eafc4dc246 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac44e6f8-57f8-46fa-b369-fb4da2c88568", "tag": "3742d9dd-db13-474a-97e9-460cb05661bb"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:29:05.660128 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-6642d710-6f47-46f7-9922-892373efd9e6 req-c4b90f10-4ce8-423d-b569-27eafc4dc246 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:05.660611 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-6642d710-6f47-46f7-9922-892373efd9e6 req-c4b90f10-4ce8-423d-b569-27eafc4dc246 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:05.661441 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-6642d710-6f47-46f7-9922-892373efd9e6 req-c4b90f10-4ce8-423d-b569-27eafc4dc246 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:05.691063 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-6642d710-6f47-46f7-9922-892373efd9e6 req-c4b90f10-4ce8-423d-b569-27eafc4dc246 service nova] Creating event network-changed:3742d9dd-db13-474a-97e9-460cb05661bb for instance ac44e6f8-57f8-46fa-b369-fb4da2c88568 on n-h1-850468-14 Aug 10 23:29:05.719370 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-6642d710-6f47-46f7-9922-892373efd9e6 req-c4b90f10-4ce8-423d-b569-27eafc4dc246 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089836 Aug 10 23:29:05.723268 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2688/5595] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:29:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:29:05.753641 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-5c0c5b62-4d4f-40e8-bc39-746b3322340a tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c065499e24caa9b0e0d5b499e395d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add6bbc9866043499846c4ae3938ff58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:29:05.779293 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-5c0c5b62-4d4f-40e8-bc39-746b3322340a tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] 10.222.0.58 "GET /compute/v2.1/servers/ac44e6f8-57f8-46fa-b369-fb4da2c88568" status: 200 len: 1313 microversion: 2.1 time: 0.573935 Aug 10 23:29:05.780459 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2908/5596] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:29:05 2022] GET /compute/v2.1/servers/ac44e6f8-57f8-46fa-b369-fb4da2c88568 => generated 1313 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:29:06.019672 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-8b3ceb1c-8ea0-4999-a0db-c0c5981330da tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1910834118", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452", "networks": [{"uuid": "a8583ae1-52a4-4700-9065-7f7fac06a96c"}], "key_name": "tempest-TestNetworkBasicOps-1079892518", "security_groups": [{"name": "tempest-secgroup-smoke-1542894118"}]}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:29:06.266262 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.network.neutron [None req-8b3ceb1c-8ea0-4999-a0db-c0c5981330da tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] validate_networks() for [('a8583ae1-52a4-4700-9065-7f7fac06a96c', None, None, None, None, None)] {{(pid=122632) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 23:29:06.600908 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-45ee8aee-3d35-41c9-94ae-40194bfc2bbb tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:29:06.601470 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-45ee8aee-3d35-41c9-94ae-40194bfc2bbb tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: e806d719-6292-49a9-ab7b-31397991291d] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:29:06.619800 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-45ee8aee-3d35-41c9-94ae-40194bfc2bbb tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:06.621178 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-45ee8aee-3d35-41c9-94ae-40194bfc2bbb tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:06.622337 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-45ee8aee-3d35-41c9-94ae-40194bfc2bbb tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:06.624285 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-45ee8aee-3d35-41c9-94ae-40194bfc2bbb tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:06.624779 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-45ee8aee-3d35-41c9-94ae-40194bfc2bbb tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:06.625247 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-45ee8aee-3d35-41c9-94ae-40194bfc2bbb tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:06.680979 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.objects.instance [None req-45ee8aee-3d35-41c9-94ae-40194bfc2bbb tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lazy-loading 'flavor' on Instance uuid e806d719-6292-49a9-ab7b-31397991291d {{(pid=122633) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:29:07.117073 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-45ee8aee-3d35-41c9-94ae-40194bfc2bbb tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "POST /compute/v2.1/servers/e806d719-6292-49a9-ab7b-31397991291d/action" status: 202 len: 0 microversion: 2.20 time: 0.516751 Aug 10 23:29:07.119760 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2909/5597] 10.222.0.58 () {62 vars in 1319 bytes} [Wed Aug 10 23:29:06 2022] POST /compute/v2.1/servers/e806d719-6292-49a9-ab7b-31397991291d/action => generated 0 bytes in 524 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 10 23:29:07.139320 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-bfe02cd3-d9d8-4a1b-ba60-6b1f827a29c2 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:29:07.140244 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-bfe02cd3-d9d8-4a1b-ba60-6b1f827a29c2 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] [instance: ac44e6f8-57f8-46fa-b369-fb4da2c88568] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:29:07.149703 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bfe02cd3-d9d8-4a1b-ba60-6b1f827a29c2 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:07.150384 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bfe02cd3-d9d8-4a1b-ba60-6b1f827a29c2 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:07.151402 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bfe02cd3-d9d8-4a1b-ba60-6b1f827a29c2 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:07.152509 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bfe02cd3-d9d8-4a1b-ba60-6b1f827a29c2 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:07.153435 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bfe02cd3-d9d8-4a1b-ba60-6b1f827a29c2 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:07.154500 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bfe02cd3-d9d8-4a1b-ba60-6b1f827a29c2 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:07.190966 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-8b3ceb1c-8ea0-4999-a0db-c0c5981330da tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Flavor limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:29:07.192136 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-8b3ceb1c-8ea0-4999-a0db-c0c5981330da tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Image limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:29:07.193392 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-8b3ceb1c-8ea0-4999-a0db-c0c5981330da tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Flavor pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:29:07.194158 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-8b3ceb1c-8ea0-4999-a0db-c0c5981330da tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Image pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:29:07.196133 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-8b3ceb1c-8ea0-4999-a0db-c0c5981330da tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:29:07.216813 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8b3ceb1c-8ea0-4999-a0db-c0c5981330da tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:07.218572 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8b3ceb1c-8ea0-4999-a0db-c0c5981330da tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:07.228641 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8b3ceb1c-8ea0-4999-a0db-c0c5981330da tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:07.230488 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8b3ceb1c-8ea0-4999-a0db-c0c5981330da tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:07.231632 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8b3ceb1c-8ea0-4999-a0db-c0c5981330da tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:07.234911 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8b3ceb1c-8ea0-4999-a0db-c0c5981330da tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:07.260839 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-8b3ceb1c-8ea0-4999-a0db-c0c5981330da tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Getting quotas for project 679d43599f3e4c29ab368a1e54dae608. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:29:07.279664 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-8b3ceb1c-8ea0-4999-a0db-c0c5981330da tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Getting quotas for user fbea80d59f5840f1899bd3cf601ac8bf and project 679d43599f3e4c29ab368a1e54dae608. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:29:07.299994 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-8b3ceb1c-8ea0-4999-a0db-c0c5981330da tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Going to run 1 instances... {{(pid=122632) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 23:29:07.302946 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-8b3ceb1c-8ea0-4999-a0db-c0c5981330da tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] [instance: e901c537-7d19-4c3f-b660-aadbaa4a264a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78ad8905-f66f-4733-8be9-2b260f1fabed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122632) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 23:29:07.366174 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-8b3ceb1c-8ea0-4999-a0db-c0c5981330da tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.351048 Aug 10 23:29:07.373584 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2689/5598] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 23:29:06 2022] POST /compute/v2.1/servers => generated 406 bytes in 1360 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 23:29:07.379622 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-b303b929-15a5-4575-9570-ef321a30e94a tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:29:07.380709 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-b303b929-15a5-4575-9570-ef321a30e94a tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: e806d719-6292-49a9-ab7b-31397991291d] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:29:07.389895 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b303b929-15a5-4575-9570-ef321a30e94a tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:07.391220 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b303b929-15a5-4575-9570-ef321a30e94a tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:07.391834 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b303b929-15a5-4575-9570-ef321a30e94a tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:07.393396 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b303b929-15a5-4575-9570-ef321a30e94a tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:07.394313 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b303b929-15a5-4575-9570-ef321a30e94a tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:07.395280 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b303b929-15a5-4575-9570-ef321a30e94a tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:07.602128 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-bfe02cd3-d9d8-4a1b-ba60-6b1f827a29c2 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c065499e24caa9b0e0d5b499e395d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add6bbc9866043499846c4ae3938ff58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:29:07.616300 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-bfe02cd3-d9d8-4a1b-ba60-6b1f827a29c2 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] 10.222.0.58 "GET /compute/v2.1/servers/ac44e6f8-57f8-46fa-b369-fb4da2c88568" status: 200 len: 1313 microversion: 2.1 time: 0.482617 Aug 10 23:29:07.631857 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2910/5599] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:29:07 2022] GET /compute/v2.1/servers/ac44e6f8-57f8-46fa-b369-fb4da2c88568 => generated 1313 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:29:07.638650 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-789a9719-b3da-47a6-9497-fe54963c252f tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:29:07.640105 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-789a9719-b3da-47a6-9497-fe54963c252f tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] [instance: e901c537-7d19-4c3f-b660-aadbaa4a264a] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:29:07.648891 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-b303b929-15a5-4575-9570-ef321a30e94a tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:29:07.659055 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-b303b929-15a5-4575-9570-ef321a30e94a tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:29:07.660842 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-b303b929-15a5-4575-9570-ef321a30e94a tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:29:07.662148 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-b303b929-15a5-4575-9570-ef321a30e94a tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "GET /compute/v2.1/servers/e806d719-6292-49a9-ab7b-31397991291d" status: 200 len: 1724 microversion: 2.20 time: 0.287322 Aug 10 23:29:07.662975 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2690/5600] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:29:07 2022] GET /compute/v2.1/servers/e806d719-6292-49a9-ab7b-31397991291d => generated 1724 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:29:07.735405 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-789a9719-b3da-47a6-9497-fe54963c252f tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbea80d59f5840f1899bd3cf601ac8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679d43599f3e4c29ab368a1e54dae608', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:29:07.747546 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-789a9719-b3da-47a6-9497-fe54963c252f tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] 10.222.0.58 "GET /compute/v2.1/servers/e901c537-7d19-4c3f-b660-aadbaa4a264a" status: 200 len: 1249 microversion: 2.1 time: 0.113810 Aug 10 23:29:07.749021 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2911/5601] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:29:07 2022] GET /compute/v2.1/servers/e901c537-7d19-4c3f-b660-aadbaa4a264a => generated 1249 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:29:08.640288 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-1f318200-1611-45d7-aa09-160825b2b04a tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:29:08.641465 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-1f318200-1611-45d7-aa09-160825b2b04a tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] [instance: ac44e6f8-57f8-46fa-b369-fb4da2c88568] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:29:08.648527 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1f318200-1611-45d7-aa09-160825b2b04a tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:08.649280 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1f318200-1611-45d7-aa09-160825b2b04a tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:08.649924 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1f318200-1611-45d7-aa09-160825b2b04a tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:08.650867 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1f318200-1611-45d7-aa09-160825b2b04a tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:08.651322 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1f318200-1611-45d7-aa09-160825b2b04a tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:08.651916 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1f318200-1611-45d7-aa09-160825b2b04a tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:08.689487 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-d9d4b516-69c6-4fb3-83f6-d02b64e755e2 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:29:08.691282 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-d9d4b516-69c6-4fb3-83f6-d02b64e755e2 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: e806d719-6292-49a9-ab7b-31397991291d] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:29:08.705279 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d9d4b516-69c6-4fb3-83f6-d02b64e755e2 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:08.705773 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d9d4b516-69c6-4fb3-83f6-d02b64e755e2 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:08.707601 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d9d4b516-69c6-4fb3-83f6-d02b64e755e2 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:08.708516 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d9d4b516-69c6-4fb3-83f6-d02b64e755e2 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:08.709432 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d9d4b516-69c6-4fb3-83f6-d02b64e755e2 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:08.710708 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d9d4b516-69c6-4fb3-83f6-d02b64e755e2 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:08.808359 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-1f318200-1611-45d7-aa09-160825b2b04a tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c065499e24caa9b0e0d5b499e395d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add6bbc9866043499846c4ae3938ff58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:29:08.819605 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-1f318200-1611-45d7-aa09-160825b2b04a tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] 10.222.0.58 "GET /compute/v2.1/servers/ac44e6f8-57f8-46fa-b369-fb4da2c88568" status: 200 len: 1313 microversion: 2.1 time: 0.182775 Aug 10 23:29:08.820690 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2691/5602] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:29:08 2022] GET /compute/v2.1/servers/ac44e6f8-57f8-46fa-b369-fb4da2c88568 => generated 1313 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:29:08.827182 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-be3b9845-d7da-43c7-bdb0-11991d483fac tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:29:08.828054 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-be3b9845-d7da-43c7-bdb0-11991d483fac tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] [instance: e901c537-7d19-4c3f-b660-aadbaa4a264a] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:29:08.836004 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-be3b9845-d7da-43c7-bdb0-11991d483fac tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:08.836494 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-be3b9845-d7da-43c7-bdb0-11991d483fac tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:08.836934 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-be3b9845-d7da-43c7-bdb0-11991d483fac tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:08.837646 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-be3b9845-d7da-43c7-bdb0-11991d483fac tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:08.838135 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-be3b9845-d7da-43c7-bdb0-11991d483fac tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:08.838524 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-be3b9845-d7da-43c7-bdb0-11991d483fac tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:08.929948 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-be3b9845-d7da-43c7-bdb0-11991d483fac tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbea80d59f5840f1899bd3cf601ac8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679d43599f3e4c29ab368a1e54dae608', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:29:08.941584 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-be3b9845-d7da-43c7-bdb0-11991d483fac tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] 10.222.0.58 "GET /compute/v2.1/servers/e901c537-7d19-4c3f-b660-aadbaa4a264a" status: 200 len: 1301 microversion: 2.1 time: 0.119642 Aug 10 23:29:08.942565 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2692/5603] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:29:08 2022] GET /compute/v2.1/servers/e901c537-7d19-4c3f-b660-aadbaa4a264a => generated 1301 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:29:09.116543 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-d9d4b516-69c6-4fb3-83f6-d02b64e755e2 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:29:09.128988 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-d9d4b516-69c6-4fb3-83f6-d02b64e755e2 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:29:09.132275 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-d9d4b516-69c6-4fb3-83f6-d02b64e755e2 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:29:09.138344 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-d9d4b516-69c6-4fb3-83f6-d02b64e755e2 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "GET /compute/v2.1/servers/e806d719-6292-49a9-ab7b-31397991291d" status: 200 len: 1724 microversion: 2.20 time: 0.455967 Aug 10 23:29:09.139336 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2912/5604] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:29:08 2022] GET /compute/v2.1/servers/e806d719-6292-49a9-ab7b-31397991291d => generated 1724 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 23:29:09.844514 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-48e98bd3-6fbc-4c54-b964-23be513469b2 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:29:09.845811 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-48e98bd3-6fbc-4c54-b964-23be513469b2 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] [instance: ac44e6f8-57f8-46fa-b369-fb4da2c88568] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:29:09.857429 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-48e98bd3-6fbc-4c54-b964-23be513469b2 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:09.857907 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-48e98bd3-6fbc-4c54-b964-23be513469b2 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:09.858353 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-48e98bd3-6fbc-4c54-b964-23be513469b2 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:09.859528 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-48e98bd3-6fbc-4c54-b964-23be513469b2 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:09.859991 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-48e98bd3-6fbc-4c54-b964-23be513469b2 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:09.864397 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-48e98bd3-6fbc-4c54-b964-23be513469b2 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:09.966111 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-674f6103-b7df-49e1-9db4-198d7d03999b tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:29:09.968856 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-674f6103-b7df-49e1-9db4-198d7d03999b tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] [instance: e901c537-7d19-4c3f-b660-aadbaa4a264a] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:29:09.985607 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-674f6103-b7df-49e1-9db4-198d7d03999b tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:09.989140 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-674f6103-b7df-49e1-9db4-198d7d03999b tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:09.989600 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-674f6103-b7df-49e1-9db4-198d7d03999b tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:09.991016 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-674f6103-b7df-49e1-9db4-198d7d03999b tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:09.991480 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-674f6103-b7df-49e1-9db4-198d7d03999b tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:09.993280 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-674f6103-b7df-49e1-9db4-198d7d03999b tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:10.038740 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:29:10.137728 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-48e98bd3-6fbc-4c54-b964-23be513469b2 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c065499e24caa9b0e0d5b499e395d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add6bbc9866043499846c4ae3938ff58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:29:10.147110 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-48e98bd3-6fbc-4c54-b964-23be513469b2 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] 10.222.0.58 "GET /compute/v2.1/servers/ac44e6f8-57f8-46fa-b369-fb4da2c88568" status: 200 len: 1313 microversion: 2.1 time: 0.308045 Aug 10 23:29:10.162434 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2693/5605] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:29:09 2022] GET /compute/v2.1/servers/ac44e6f8-57f8-46fa-b369-fb4da2c88568 => generated 1313 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:29:10.167545 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-aa75e931-a935-471b-a677-bcc811eac864 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:29:10.172846 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-aa75e931-a935-471b-a677-bcc811eac864 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: e806d719-6292-49a9-ab7b-31397991291d] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:29:10.179928 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-aa75e931-a935-471b-a677-bcc811eac864 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:10.180737 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-aa75e931-a935-471b-a677-bcc811eac864 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:10.181380 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-aa75e931-a935-471b-a677-bcc811eac864 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:10.182254 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-aa75e931-a935-471b-a677-bcc811eac864 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:10.182912 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-aa75e931-a935-471b-a677-bcc811eac864 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:10.183495 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-aa75e931-a935-471b-a677-bcc811eac864 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:10.338912 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-674f6103-b7df-49e1-9db4-198d7d03999b tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbea80d59f5840f1899bd3cf601ac8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679d43599f3e4c29ab368a1e54dae608', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:29:10.349178 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-674f6103-b7df-49e1-9db4-198d7d03999b tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] 10.222.0.58 "GET /compute/v2.1/servers/e901c537-7d19-4c3f-b660-aadbaa4a264a" status: 200 len: 1375 microversion: 2.1 time: 0.387771 Aug 10 23:29:10.349765 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2913/5606] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:29:09 2022] GET /compute/v2.1/servers/e901c537-7d19-4c3f-b660-aadbaa4a264a => generated 1375 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:29:10.364767 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-aa75e931-a935-471b-a677-bcc811eac864 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:29:10.377676 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-aa75e931-a935-471b-a677-bcc811eac864 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:29:10.379439 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-aa75e931-a935-471b-a677-bcc811eac864 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:29:10.380622 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-aa75e931-a935-471b-a677-bcc811eac864 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "GET /compute/v2.1/servers/e806d719-6292-49a9-ab7b-31397991291d" status: 200 len: 1724 microversion: 2.20 time: 0.216908 Aug 10 23:29:10.381554 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2694/5607] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:29:10 2022] GET /compute/v2.1/servers/e806d719-6292-49a9-ab7b-31397991291d => generated 1724 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:29:10.817040 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-cc0d4ca7-e9eb-498c-95ff-cfb64d1da574 req-f8774555-19af-448c-b1ca-4a7a9f1370fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e901c537-7d19-4c3f-b660-aadbaa4a264a", "tag": "39201045-2e7d-48eb-ac1d-a9c9970c2e3e"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:29:10.835258 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-cc0d4ca7-e9eb-498c-95ff-cfb64d1da574 req-f8774555-19af-448c-b1ca-4a7a9f1370fd service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:10.835750 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-cc0d4ca7-e9eb-498c-95ff-cfb64d1da574 req-f8774555-19af-448c-b1ca-4a7a9f1370fd service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:10.836191 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-cc0d4ca7-e9eb-498c-95ff-cfb64d1da574 req-f8774555-19af-448c-b1ca-4a7a9f1370fd service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:10.857366 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-cc0d4ca7-e9eb-498c-95ff-cfb64d1da574 req-f8774555-19af-448c-b1ca-4a7a9f1370fd service nova] Creating event network-changed:39201045-2e7d-48eb-ac1d-a9c9970c2e3e for instance e901c537-7d19-4c3f-b660-aadbaa4a264a on n-h2-850468-14 Aug 10 23:29:10.863683 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-cc0d4ca7-e9eb-498c-95ff-cfb64d1da574 req-f8774555-19af-448c-b1ca-4a7a9f1370fd service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051325 Aug 10 23:29:10.864664 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2914/5608] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:29:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:29:11.168368 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-2ba3462b-4cb0-4a7c-a152-f05fdd12f67e tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:29:11.169690 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-2ba3462b-4cb0-4a7c-a152-f05fdd12f67e tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] [instance: ac44e6f8-57f8-46fa-b369-fb4da2c88568] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:29:11.180513 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2ba3462b-4cb0-4a7c-a152-f05fdd12f67e tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:11.182242 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2ba3462b-4cb0-4a7c-a152-f05fdd12f67e tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:11.182743 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2ba3462b-4cb0-4a7c-a152-f05fdd12f67e tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:11.183488 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2ba3462b-4cb0-4a7c-a152-f05fdd12f67e tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:11.184328 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2ba3462b-4cb0-4a7c-a152-f05fdd12f67e tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:11.188568 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2ba3462b-4cb0-4a7c-a152-f05fdd12f67e tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:11.372163 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-70750db7-8b25-4f61-9c9c-e6324875d9e8 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:29:11.372781 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-70750db7-8b25-4f61-9c9c-e6324875d9e8 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] [instance: e901c537-7d19-4c3f-b660-aadbaa4a264a] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:29:11.382219 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-70750db7-8b25-4f61-9c9c-e6324875d9e8 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:11.382926 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-70750db7-8b25-4f61-9c9c-e6324875d9e8 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:11.383531 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-70750db7-8b25-4f61-9c9c-e6324875d9e8 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:11.384422 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-70750db7-8b25-4f61-9c9c-e6324875d9e8 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:11.385221 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-70750db7-8b25-4f61-9c9c-e6324875d9e8 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:11.386017 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-70750db7-8b25-4f61-9c9c-e6324875d9e8 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:11.486446 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-2ba3462b-4cb0-4a7c-a152-f05fdd12f67e tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c065499e24caa9b0e0d5b499e395d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add6bbc9866043499846c4ae3938ff58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:29:11.486446 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=100 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:29:11.497083 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-2ba3462b-4cb0-4a7c-a152-f05fdd12f67e tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] 10.222.0.58 "GET /compute/v2.1/servers/ac44e6f8-57f8-46fa-b369-fb4da2c88568" status: 200 len: 1313 microversion: 2.1 time: 0.332623 Aug 10 23:29:11.497705 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2695/5609] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:29:11 2022] GET /compute/v2.1/servers/ac44e6f8-57f8-46fa-b369-fb4da2c88568 => generated 1313 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:29:11.529514 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-461a2c77-bb08-4d3b-bf2c-5837b7736004 req-d2d846b7-ecf4-42b2-843d-7f2554d4fd41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac44e6f8-57f8-46fa-b369-fb4da2c88568", "name": "network-vif-plugged", "status": "completed", "tag": "3742d9dd-db13-474a-97e9-460cb05661bb"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:29:11.562492 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-461a2c77-bb08-4d3b-bf2c-5837b7736004 req-d2d846b7-ecf4-42b2-843d-7f2554d4fd41 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:11.563000 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-461a2c77-bb08-4d3b-bf2c-5837b7736004 req-d2d846b7-ecf4-42b2-843d-7f2554d4fd41 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:11.563433 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-461a2c77-bb08-4d3b-bf2c-5837b7736004 req-d2d846b7-ecf4-42b2-843d-7f2554d4fd41 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:11.579294 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-461a2c77-bb08-4d3b-bf2c-5837b7736004 req-d2d846b7-ecf4-42b2-843d-7f2554d4fd41 service nova] Creating event network-vif-plugged:3742d9dd-db13-474a-97e9-460cb05661bb for instance ac44e6f8-57f8-46fa-b369-fb4da2c88568 on n-h1-850468-14 Aug 10 23:29:11.585495 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-461a2c77-bb08-4d3b-bf2c-5837b7736004 req-d2d846b7-ecf4-42b2-843d-7f2554d4fd41 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084049 Aug 10 23:29:11.586178 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2696/5610] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:29:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:29:11.598220 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-433de535-8ed5-4902-946f-0b24b11e9938 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:29:11.600195 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-433de535-8ed5-4902-946f-0b24b11e9938 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: e806d719-6292-49a9-ab7b-31397991291d] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:29:11.621436 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-433de535-8ed5-4902-946f-0b24b11e9938 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:11.621893 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-433de535-8ed5-4902-946f-0b24b11e9938 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:11.622450 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-433de535-8ed5-4902-946f-0b24b11e9938 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:11.623348 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-433de535-8ed5-4902-946f-0b24b11e9938 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:11.624547 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-433de535-8ed5-4902-946f-0b24b11e9938 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:11.625284 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-433de535-8ed5-4902-946f-0b24b11e9938 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:11.868571 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-433de535-8ed5-4902-946f-0b24b11e9938 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:29:11.883974 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-433de535-8ed5-4902-946f-0b24b11e9938 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:29:11.885392 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-433de535-8ed5-4902-946f-0b24b11e9938 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:29:11.886569 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-433de535-8ed5-4902-946f-0b24b11e9938 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "GET /compute/v2.1/servers/e806d719-6292-49a9-ab7b-31397991291d" status: 200 len: 1724 microversion: 2.20 time: 0.293900 Aug 10 23:29:11.901865 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2697/5611] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:29:11 2022] GET /compute/v2.1/servers/e806d719-6292-49a9-ab7b-31397991291d => generated 1724 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:29:12.046494 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-70750db7-8b25-4f61-9c9c-e6324875d9e8 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbea80d59f5840f1899bd3cf601ac8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679d43599f3e4c29ab368a1e54dae608', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:29:12.061025 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-70750db7-8b25-4f61-9c9c-e6324875d9e8 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] 10.222.0.58 "GET /compute/v2.1/servers/e901c537-7d19-4c3f-b660-aadbaa4a264a" status: 200 len: 1375 microversion: 2.1 time: 0.693317 Aug 10 23:29:12.063154 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2915/5612] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:29:11 2022] GET /compute/v2.1/servers/e901c537-7d19-4c3f-b660-aadbaa4a264a => generated 1375 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:29:12.523256 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-15d89d24-e820-4241-8e8b-c263321c4e35 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:29:12.523867 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-15d89d24-e820-4241-8e8b-c263321c4e35 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] [instance: ac44e6f8-57f8-46fa-b369-fb4da2c88568] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:29:12.544972 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=9 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:29:12.547343 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-15d89d24-e820-4241-8e8b-c263321c4e35 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:12.548142 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-15d89d24-e820-4241-8e8b-c263321c4e35 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:12.548960 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-15d89d24-e820-4241-8e8b-c263321c4e35 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:12.549536 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-15d89d24-e820-4241-8e8b-c263321c4e35 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:12.550177 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-15d89d24-e820-4241-8e8b-c263321c4e35 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:12.550984 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-15d89d24-e820-4241-8e8b-c263321c4e35 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:12.844108 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-15d89d24-e820-4241-8e8b-c263321c4e35 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c065499e24caa9b0e0d5b499e395d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add6bbc9866043499846c4ae3938ff58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:29:12.854179 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-15d89d24-e820-4241-8e8b-c263321c4e35 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] 10.222.0.58 "GET /compute/v2.1/servers/ac44e6f8-57f8-46fa-b369-fb4da2c88568" status: 200 len: 1313 microversion: 2.1 time: 0.334686 Aug 10 23:29:12.868241 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2698/5613] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:29:12 2022] GET /compute/v2.1/servers/ac44e6f8-57f8-46fa-b369-fb4da2c88568 => generated 1313 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:29:12.910356 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-fe02fe30-1acf-46b0-998f-93e46fd44e8d tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:29:12.911019 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-fe02fe30-1acf-46b0-998f-93e46fd44e8d tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: e806d719-6292-49a9-ab7b-31397991291d] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:29:12.918362 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fe02fe30-1acf-46b0-998f-93e46fd44e8d tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:12.919855 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fe02fe30-1acf-46b0-998f-93e46fd44e8d tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:12.920474 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fe02fe30-1acf-46b0-998f-93e46fd44e8d tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:12.921587 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fe02fe30-1acf-46b0-998f-93e46fd44e8d tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:12.922064 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fe02fe30-1acf-46b0-998f-93e46fd44e8d tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:12.922582 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fe02fe30-1acf-46b0-998f-93e46fd44e8d tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:13.082563 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c368f1ea-2430-45e3-9d41-9df573ae818f tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:29:13.083480 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-c368f1ea-2430-45e3-9d41-9df573ae818f tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] [instance: e901c537-7d19-4c3f-b660-aadbaa4a264a] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:29:13.090299 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c368f1ea-2430-45e3-9d41-9df573ae818f tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:13.091246 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c368f1ea-2430-45e3-9d41-9df573ae818f tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:13.091698 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c368f1ea-2430-45e3-9d41-9df573ae818f tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:13.092456 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c368f1ea-2430-45e3-9d41-9df573ae818f tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:13.093557 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c368f1ea-2430-45e3-9d41-9df573ae818f tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:13.094290 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c368f1ea-2430-45e3-9d41-9df573ae818f tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:13.238839 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-c368f1ea-2430-45e3-9d41-9df573ae818f tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbea80d59f5840f1899bd3cf601ac8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679d43599f3e4c29ab368a1e54dae608', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:29:13.247377 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-c368f1ea-2430-45e3-9d41-9df573ae818f tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] 10.222.0.58 "GET /compute/v2.1/servers/e901c537-7d19-4c3f-b660-aadbaa4a264a" status: 200 len: 1375 microversion: 2.1 time: 0.168780 Aug 10 23:29:13.248310 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2699/5614] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:29:13 2022] GET /compute/v2.1/servers/e901c537-7d19-4c3f-b660-aadbaa4a264a => generated 1375 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:29:13.289243 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-fe02fe30-1acf-46b0-998f-93e46fd44e8d tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:29:13.299522 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-fe02fe30-1acf-46b0-998f-93e46fd44e8d tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:29:13.301231 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-fe02fe30-1acf-46b0-998f-93e46fd44e8d tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:29:13.303184 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-fe02fe30-1acf-46b0-998f-93e46fd44e8d tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "GET /compute/v2.1/servers/e806d719-6292-49a9-ab7b-31397991291d" status: 200 len: 1724 microversion: 2.20 time: 0.397035 Aug 10 23:29:13.309512 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2916/5615] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:29:12 2022] GET /compute/v2.1/servers/e806d719-6292-49a9-ab7b-31397991291d => generated 1724 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:29:13.876233 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c08c8dec-2c9b-40c0-bd43-c7b44e365c0d tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:29:13.876851 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-c08c8dec-2c9b-40c0-bd43-c7b44e365c0d tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] [instance: ac44e6f8-57f8-46fa-b369-fb4da2c88568] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:29:13.886040 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c08c8dec-2c9b-40c0-bd43-c7b44e365c0d tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:13.886677 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c08c8dec-2c9b-40c0-bd43-c7b44e365c0d tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:13.887836 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c08c8dec-2c9b-40c0-bd43-c7b44e365c0d tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:13.889043 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c08c8dec-2c9b-40c0-bd43-c7b44e365c0d tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:13.889792 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c08c8dec-2c9b-40c0-bd43-c7b44e365c0d tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:13.891322 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c08c8dec-2c9b-40c0-bd43-c7b44e365c0d tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:14.095978 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-c08c8dec-2c9b-40c0-bd43-c7b44e365c0d tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c065499e24caa9b0e0d5b499e395d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add6bbc9866043499846c4ae3938ff58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:29:14.115549 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-c08c8dec-2c9b-40c0-bd43-c7b44e365c0d tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] 10.222.0.58 "GET /compute/v2.1/servers/ac44e6f8-57f8-46fa-b369-fb4da2c88568" status: 200 len: 1497 microversion: 2.1 time: 0.244332 Aug 10 23:29:14.116143 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2700/5616] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:29:13 2022] GET /compute/v2.1/servers/ac44e6f8-57f8-46fa-b369-fb4da2c88568 => generated 1497 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:29:14.271575 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-7916b0fd-12a8-4365-9752-56a7b31e85ba tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:29:14.277079 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-7916b0fd-12a8-4365-9752-56a7b31e85ba tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] [instance: e901c537-7d19-4c3f-b660-aadbaa4a264a] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:29:14.283318 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:29:14.293717 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7916b0fd-12a8-4365-9752-56a7b31e85ba tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:14.294760 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7916b0fd-12a8-4365-9752-56a7b31e85ba tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:14.295440 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7916b0fd-12a8-4365-9752-56a7b31e85ba tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:14.297823 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7916b0fd-12a8-4365-9752-56a7b31e85ba tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:14.298950 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7916b0fd-12a8-4365-9752-56a7b31e85ba tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:14.299947 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7916b0fd-12a8-4365-9752-56a7b31e85ba tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:14.329197 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-45fa9c3b-b236-499b-9266-136490e652ff tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:29:14.329797 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-45fa9c3b-b236-499b-9266-136490e652ff tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: e806d719-6292-49a9-ab7b-31397991291d] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:29:14.338959 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-45fa9c3b-b236-499b-9266-136490e652ff tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:14.339370 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-45fa9c3b-b236-499b-9266-136490e652ff tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:14.339801 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-45fa9c3b-b236-499b-9266-136490e652ff tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:14.340492 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-45fa9c3b-b236-499b-9266-136490e652ff tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:14.346511 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-45fa9c3b-b236-499b-9266-136490e652ff tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:14.347194 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-45fa9c3b-b236-499b-9266-136490e652ff tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:14.540215 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-7916b0fd-12a8-4365-9752-56a7b31e85ba tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbea80d59f5840f1899bd3cf601ac8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679d43599f3e4c29ab368a1e54dae608', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:29:14.550774 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-7916b0fd-12a8-4365-9752-56a7b31e85ba tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] 10.222.0.58 "GET /compute/v2.1/servers/e901c537-7d19-4c3f-b660-aadbaa4a264a" status: 200 len: 1375 microversion: 2.1 time: 0.285083 Aug 10 23:29:14.556585 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2917/5617] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:29:14 2022] GET /compute/v2.1/servers/e901c537-7d19-4c3f-b660-aadbaa4a264a => generated 1375 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:29:14.596585 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-45fa9c3b-b236-499b-9266-136490e652ff tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:29:14.605525 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-45fa9c3b-b236-499b-9266-136490e652ff tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:29:14.607083 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-45fa9c3b-b236-499b-9266-136490e652ff tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:29:14.608310 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-45fa9c3b-b236-499b-9266-136490e652ff tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "GET /compute/v2.1/servers/e806d719-6292-49a9-ab7b-31397991291d" status: 200 len: 1724 microversion: 2.20 time: 0.284531 Aug 10 23:29:14.619197 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2701/5618] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:29:14 2022] GET /compute/v2.1/servers/e806d719-6292-49a9-ab7b-31397991291d => generated 1724 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:29:14.764266 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-24516b85-b904-4024-8eba-f4dcb3366691 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:29:14.764899 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-24516b85-b904-4024-8eba-f4dcb3366691 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] [instance: ac44e6f8-57f8-46fa-b369-fb4da2c88568] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:29:14.775122 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-24516b85-b904-4024-8eba-f4dcb3366691 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:14.779442 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-24516b85-b904-4024-8eba-f4dcb3366691 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:14.779951 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-24516b85-b904-4024-8eba-f4dcb3366691 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:14.781598 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-24516b85-b904-4024-8eba-f4dcb3366691 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:14.782676 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-24516b85-b904-4024-8eba-f4dcb3366691 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:14.783349 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-24516b85-b904-4024-8eba-f4dcb3366691 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:14.818153 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-24516b85-b904-4024-8eba-f4dcb3366691 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] [instance: ac44e6f8-57f8-46fa-b369-fb4da2c88568] Going to try to terminate instance {{(pid=122633) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:29:14.955678 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-24516b85-b904-4024-8eba-f4dcb3366691 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] 10.222.0.58 "DELETE /compute/v2.1/servers/ac44e6f8-57f8-46fa-b369-fb4da2c88568" status: 204 len: 0 microversion: 2.1 time: 0.195176 Aug 10 23:29:14.957136 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2918/5619] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:29:14 2022] DELETE /compute/v2.1/servers/ac44e6f8-57f8-46fa-b369-fb4da2c88568 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:29:14.965337 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-ff96a419-3757-4f7b-a2db-ea8a0cf942fe tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:29:14.965947 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-ff96a419-3757-4f7b-a2db-ea8a0cf942fe tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] [instance: ac44e6f8-57f8-46fa-b369-fb4da2c88568] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:29:14.975949 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ff96a419-3757-4f7b-a2db-ea8a0cf942fe tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:14.977485 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ff96a419-3757-4f7b-a2db-ea8a0cf942fe tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:14.978693 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ff96a419-3757-4f7b-a2db-ea8a0cf942fe tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:14.980646 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ff96a419-3757-4f7b-a2db-ea8a0cf942fe tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:14.981698 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ff96a419-3757-4f7b-a2db-ea8a0cf942fe tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:14.982514 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ff96a419-3757-4f7b-a2db-ea8a0cf942fe tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:15.246984 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-ff96a419-3757-4f7b-a2db-ea8a0cf942fe tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c065499e24caa9b0e0d5b499e395d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add6bbc9866043499846c4ae3938ff58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:29:15.263600 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-ff96a419-3757-4f7b-a2db-ea8a0cf942fe tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] 10.222.0.58 "GET /compute/v2.1/servers/ac44e6f8-57f8-46fa-b369-fb4da2c88568" status: 200 len: 1503 microversion: 2.1 time: 0.301225 Aug 10 23:29:15.283048 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2702/5620] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:29:14 2022] GET /compute/v2.1/servers/ac44e6f8-57f8-46fa-b369-fb4da2c88568 => generated 1503 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:29:15.578926 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-3fbaf5f8-d67f-45e2-bc7f-8f13aee8bab4 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:29:15.580456 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-3fbaf5f8-d67f-45e2-bc7f-8f13aee8bab4 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] [instance: e901c537-7d19-4c3f-b660-aadbaa4a264a] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:29:15.601587 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3fbaf5f8-d67f-45e2-bc7f-8f13aee8bab4 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:15.603158 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3fbaf5f8-d67f-45e2-bc7f-8f13aee8bab4 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:15.603869 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3fbaf5f8-d67f-45e2-bc7f-8f13aee8bab4 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:15.604798 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3fbaf5f8-d67f-45e2-bc7f-8f13aee8bab4 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:15.611919 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3fbaf5f8-d67f-45e2-bc7f-8f13aee8bab4 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:15.613100 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3fbaf5f8-d67f-45e2-bc7f-8f13aee8bab4 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:15.641390 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-e346ae1d-b8a7-451c-82bc-a0655073b2f5 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:29:15.642099 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-e346ae1d-b8a7-451c-82bc-a0655073b2f5 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: e806d719-6292-49a9-ab7b-31397991291d] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:29:15.668001 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e346ae1d-b8a7-451c-82bc-a0655073b2f5 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:15.668842 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e346ae1d-b8a7-451c-82bc-a0655073b2f5 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:15.670415 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e346ae1d-b8a7-451c-82bc-a0655073b2f5 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:15.673869 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e346ae1d-b8a7-451c-82bc-a0655073b2f5 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:15.674882 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e346ae1d-b8a7-451c-82bc-a0655073b2f5 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:15.678183 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e346ae1d-b8a7-451c-82bc-a0655073b2f5 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:15.834948 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-3fbaf5f8-d67f-45e2-bc7f-8f13aee8bab4 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbea80d59f5840f1899bd3cf601ac8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679d43599f3e4c29ab368a1e54dae608', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:29:15.854078 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-3fbaf5f8-d67f-45e2-bc7f-8f13aee8bab4 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] 10.222.0.58 "GET /compute/v2.1/servers/e901c537-7d19-4c3f-b660-aadbaa4a264a" status: 200 len: 1375 microversion: 2.1 time: 0.280025 Aug 10 23:29:15.855792 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2919/5621] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:29:15 2022] GET /compute/v2.1/servers/e901c537-7d19-4c3f-b660-aadbaa4a264a => generated 1375 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:29:16.287959 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-78f409fc-32c3-447a-99e7-dba024ed6119 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:29:16.288595 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-78f409fc-32c3-447a-99e7-dba024ed6119 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] [instance: ac44e6f8-57f8-46fa-b369-fb4da2c88568] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:29:16.296102 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-e346ae1d-b8a7-451c-82bc-a0655073b2f5 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:29:16.303733 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-78f409fc-32c3-447a-99e7-dba024ed6119 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:16.304267 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-78f409fc-32c3-447a-99e7-dba024ed6119 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:16.304761 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-78f409fc-32c3-447a-99e7-dba024ed6119 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:16.305571 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-78f409fc-32c3-447a-99e7-dba024ed6119 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:16.306097 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-78f409fc-32c3-447a-99e7-dba024ed6119 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:16.308145 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-78f409fc-32c3-447a-99e7-dba024ed6119 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:16.317169 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-e346ae1d-b8a7-451c-82bc-a0655073b2f5 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:29:16.319708 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-e346ae1d-b8a7-451c-82bc-a0655073b2f5 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:29:16.322274 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-e346ae1d-b8a7-451c-82bc-a0655073b2f5 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "GET /compute/v2.1/servers/e806d719-6292-49a9-ab7b-31397991291d" status: 200 len: 1724 microversion: 2.20 time: 0.690859 Aug 10 23:29:16.323720 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2703/5622] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:29:15 2022] GET /compute/v2.1/servers/e806d719-6292-49a9-ab7b-31397991291d => generated 1724 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:29:16.638673 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-78f409fc-32c3-447a-99e7-dba024ed6119 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c065499e24caa9b0e0d5b499e395d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add6bbc9866043499846c4ae3938ff58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:29:16.651998 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-78f409fc-32c3-447a-99e7-dba024ed6119 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] 10.222.0.58 "GET /compute/v2.1/servers/ac44e6f8-57f8-46fa-b369-fb4da2c88568" status: 200 len: 1503 microversion: 2.1 time: 0.368271 Aug 10 23:29:16.652594 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2920/5623] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:29:16 2022] GET /compute/v2.1/servers/ac44e6f8-57f8-46fa-b369-fb4da2c88568 => generated 1503 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:29:16.888424 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-273a3b5a-8a72-4252-b621-793b8eba8a27 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:29:16.889159 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-273a3b5a-8a72-4252-b621-793b8eba8a27 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] [instance: e901c537-7d19-4c3f-b660-aadbaa4a264a] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:29:16.904710 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-273a3b5a-8a72-4252-b621-793b8eba8a27 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:16.905328 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-273a3b5a-8a72-4252-b621-793b8eba8a27 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:16.908055 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-273a3b5a-8a72-4252-b621-793b8eba8a27 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:16.909789 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-273a3b5a-8a72-4252-b621-793b8eba8a27 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:16.916781 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-273a3b5a-8a72-4252-b621-793b8eba8a27 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:16.918586 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-273a3b5a-8a72-4252-b621-793b8eba8a27 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:17.113944 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-32bd630e-7a1d-4eb1-9c09-f2aa2b3a2678 req-92d0a1d0-b0c5-4583-a095-6696c04dfc7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac44e6f8-57f8-46fa-b369-fb4da2c88568", "name": "network-vif-deleted", "tag": "3742d9dd-db13-474a-97e9-460cb05661bb"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:29:17.136547 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-32bd630e-7a1d-4eb1-9c09-f2aa2b3a2678 req-92d0a1d0-b0c5-4583-a095-6696c04dfc7b service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:17.138258 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-32bd630e-7a1d-4eb1-9c09-f2aa2b3a2678 req-92d0a1d0-b0c5-4583-a095-6696c04dfc7b service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:17.139015 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-32bd630e-7a1d-4eb1-9c09-f2aa2b3a2678 req-92d0a1d0-b0c5-4583-a095-6696c04dfc7b service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:17.155992 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-32bd630e-7a1d-4eb1-9c09-f2aa2b3a2678 req-92d0a1d0-b0c5-4583-a095-6696c04dfc7b service nova] Creating event network-vif-deleted:3742d9dd-db13-474a-97e9-460cb05661bb for instance ac44e6f8-57f8-46fa-b369-fb4da2c88568 on n-h1-850468-14 Aug 10 23:29:17.166654 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-32bd630e-7a1d-4eb1-9c09-f2aa2b3a2678 req-92d0a1d0-b0c5-4583-a095-6696c04dfc7b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057762 Aug 10 23:29:17.172886 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2921/5624] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:29:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 23:29:17.246609 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=4 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:29:17.292868 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=12 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:29:17.302244 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-273a3b5a-8a72-4252-b621-793b8eba8a27 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbea80d59f5840f1899bd3cf601ac8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679d43599f3e4c29ab368a1e54dae608', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:29:17.331094 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-273a3b5a-8a72-4252-b621-793b8eba8a27 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] 10.222.0.58 "GET /compute/v2.1/servers/e901c537-7d19-4c3f-b660-aadbaa4a264a" status: 200 len: 1375 microversion: 2.1 time: 0.446793 Aug 10 23:29:17.332355 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2704/5625] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:29:16 2022] GET /compute/v2.1/servers/e901c537-7d19-4c3f-b660-aadbaa4a264a => generated 1375 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:29:17.347316 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-9d2482f0-49d5-4c5b-8552-4ae898adbcb8 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:29:17.348028 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-9d2482f0-49d5-4c5b-8552-4ae898adbcb8 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: e806d719-6292-49a9-ab7b-31397991291d] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:29:17.359323 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9d2482f0-49d5-4c5b-8552-4ae898adbcb8 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:17.359681 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9d2482f0-49d5-4c5b-8552-4ae898adbcb8 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:17.360762 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9d2482f0-49d5-4c5b-8552-4ae898adbcb8 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:17.361405 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9d2482f0-49d5-4c5b-8552-4ae898adbcb8 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:17.361958 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9d2482f0-49d5-4c5b-8552-4ae898adbcb8 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:17.362283 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9d2482f0-49d5-4c5b-8552-4ae898adbcb8 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:17.674719 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-17d94b43-dcc9-4e61-9716-8006c31af20d tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:29:17.676266 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-17d94b43-dcc9-4e61-9716-8006c31af20d tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] [instance: ac44e6f8-57f8-46fa-b369-fb4da2c88568] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:29:17.701224 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-17d94b43-dcc9-4e61-9716-8006c31af20d tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:17.702015 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-17d94b43-dcc9-4e61-9716-8006c31af20d tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:17.705147 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-17d94b43-dcc9-4e61-9716-8006c31af20d tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:17.706100 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-17d94b43-dcc9-4e61-9716-8006c31af20d tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:17.706731 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-17d94b43-dcc9-4e61-9716-8006c31af20d tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:17.710172 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-17d94b43-dcc9-4e61-9716-8006c31af20d tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:17.748311 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=8 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:29:17.803677 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-9d2482f0-49d5-4c5b-8552-4ae898adbcb8 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:29:17.819072 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-9d2482f0-49d5-4c5b-8552-4ae898adbcb8 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:29:17.823783 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-9d2482f0-49d5-4c5b-8552-4ae898adbcb8 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:29:17.825097 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-9d2482f0-49d5-4c5b-8552-4ae898adbcb8 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "GET /compute/v2.1/servers/e806d719-6292-49a9-ab7b-31397991291d" status: 200 len: 1724 microversion: 2.20 time: 0.483246 Aug 10 23:29:17.825687 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2922/5626] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:29:17 2022] GET /compute/v2.1/servers/e806d719-6292-49a9-ab7b-31397991291d => generated 1724 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:29:17.836422 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-17d94b43-dcc9-4e61-9716-8006c31af20d tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:17.840300 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-17d94b43-dcc9-4e61-9716-8006c31af20d tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:17.840763 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-17d94b43-dcc9-4e61-9716-8006c31af20d tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:17.841236 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.objects.instance [None req-17d94b43-dcc9-4e61-9716-8006c31af20d tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Lazy-loading 'fault' on Instance uuid ac44e6f8-57f8-46fa-b369-fb4da2c88568 {{(pid=122632) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:29:17.850521 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-990d0f21-bd5f-43c4-86bb-c91710d331cf req-66a368fc-c4f2-4614-890d-4b79151624ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e901c537-7d19-4c3f-b660-aadbaa4a264a", "name": "network-vif-plugged", "status": "completed", "tag": "39201045-2e7d-48eb-ac1d-a9c9970c2e3e"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:29:17.876975 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-990d0f21-bd5f-43c4-86bb-c91710d331cf req-66a368fc-c4f2-4614-890d-4b79151624ae service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:17.882392 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-990d0f21-bd5f-43c4-86bb-c91710d331cf req-66a368fc-c4f2-4614-890d-4b79151624ae service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:17.883090 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-990d0f21-bd5f-43c4-86bb-c91710d331cf req-66a368fc-c4f2-4614-890d-4b79151624ae service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:17.913648 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-990d0f21-bd5f-43c4-86bb-c91710d331cf req-66a368fc-c4f2-4614-890d-4b79151624ae service nova] Creating event network-vif-plugged:39201045-2e7d-48eb-ac1d-a9c9970c2e3e for instance e901c537-7d19-4c3f-b660-aadbaa4a264a on n-h2-850468-14 Aug 10 23:29:17.924220 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-17d94b43-dcc9-4e61-9716-8006c31af20d tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd50c065499e24caa9b0e0d5b499e395d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'add6bbc9866043499846c4ae3938ff58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:29:17.929971 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-990d0f21-bd5f-43c4-86bb-c91710d331cf req-66a368fc-c4f2-4614-890d-4b79151624ae service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091926 Aug 10 23:29:17.930995 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2923/5627] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:29:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:29:17.939331 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-17d94b43-dcc9-4e61-9716-8006c31af20d tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] 10.222.0.58 "GET /compute/v2.1/servers/ac44e6f8-57f8-46fa-b369-fb4da2c88568" status: 200 len: 1303 microversion: 2.1 time: 0.269202 Aug 10 23:29:17.955222 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2705/5628] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:29:17 2022] GET /compute/v2.1/servers/ac44e6f8-57f8-46fa-b369-fb4da2c88568 => generated 1303 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:29:18.354225 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-dd09a28b-4047-41ff-95dd-23d434a4c467 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:29:18.355148 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-dd09a28b-4047-41ff-95dd-23d434a4c467 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] [instance: e901c537-7d19-4c3f-b660-aadbaa4a264a] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:29:18.362529 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dd09a28b-4047-41ff-95dd-23d434a4c467 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:18.363355 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dd09a28b-4047-41ff-95dd-23d434a4c467 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:18.364022 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dd09a28b-4047-41ff-95dd-23d434a4c467 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:18.364955 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dd09a28b-4047-41ff-95dd-23d434a4c467 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:18.365611 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dd09a28b-4047-41ff-95dd-23d434a4c467 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:18.366238 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dd09a28b-4047-41ff-95dd-23d434a4c467 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:18.605490 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-dd09a28b-4047-41ff-95dd-23d434a4c467 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbea80d59f5840f1899bd3cf601ac8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679d43599f3e4c29ab368a1e54dae608', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:29:18.619794 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-dd09a28b-4047-41ff-95dd-23d434a4c467 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] 10.222.0.58 "GET /compute/v2.1/servers/e901c537-7d19-4c3f-b660-aadbaa4a264a" status: 200 len: 1375 microversion: 2.1 time: 0.269560 Aug 10 23:29:18.621355 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2924/5629] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:29:18 2022] GET /compute/v2.1/servers/e901c537-7d19-4c3f-b660-aadbaa4a264a => generated 1375 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:29:18.855535 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-2ec498ee-25a0-45dd-b4d6-9a01b550f8fc tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:29:18.857392 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-2ec498ee-25a0-45dd-b4d6-9a01b550f8fc tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: e806d719-6292-49a9-ab7b-31397991291d] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:29:18.868158 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2ec498ee-25a0-45dd-b4d6-9a01b550f8fc tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:18.868659 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2ec498ee-25a0-45dd-b4d6-9a01b550f8fc tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:18.869097 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2ec498ee-25a0-45dd-b4d6-9a01b550f8fc tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:18.870085 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2ec498ee-25a0-45dd-b4d6-9a01b550f8fc tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:18.870418 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2ec498ee-25a0-45dd-b4d6-9a01b550f8fc tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:18.870882 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2ec498ee-25a0-45dd-b4d6-9a01b550f8fc tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:18.962142 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-d8218079-021b-4fab-8d6e-e16e7abd0325 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:29:18.964153 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-d8218079-021b-4fab-8d6e-e16e7abd0325 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] [instance: ac44e6f8-57f8-46fa-b369-fb4da2c88568] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:29:18.979239 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d8218079-021b-4fab-8d6e-e16e7abd0325 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:18.980140 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d8218079-021b-4fab-8d6e-e16e7abd0325 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:18.981052 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d8218079-021b-4fab-8d6e-e16e7abd0325 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:18.982048 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d8218079-021b-4fab-8d6e-e16e7abd0325 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:18.983531 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d8218079-021b-4fab-8d6e-e16e7abd0325 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:18.984092 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d8218079-021b-4fab-8d6e-e16e7abd0325 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:19.007236 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-d8218079-021b-4fab-8d6e-e16e7abd0325 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] HTTP exception thrown: Instance ac44e6f8-57f8-46fa-b369-fb4da2c88568 could not be found. Aug 10 23:29:19.009312 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-d8218079-021b-4fab-8d6e-e16e7abd0325 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Request method failure captured: Aug 10 23:29:19.009312 n-d-850468-14 devstack@n-api.service[122633]: request: GET /compute/v2.1/servers/ac44e6f8-57f8-46fa-b369-fb4da2c88568 HTTP/1.1 Aug 10 23:29:19.009312 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:29:19.009312 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:29:19.009312 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:29:19.009312 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:29:19.009312 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:29:19.009312 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:29:19.009312 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:29:19.009312 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:29:19.009312 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9D8oJsFSchDW2HEfzqu6ElI9Tyns1oeZoGf-Pis0zUDzPiTouVLC39sL1YM0hoRnMmSmg1Y33YawlpKuJjZUoKwFxVr-oerY12SeLiDiLgqRRkcVl4qf_c-okUuHeyAw6qpPjKExFrsONjjddjo1vZrZ3yvM2Zw4VsS1U2ykzcZzyVE Aug 10 23:29:19.009312 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:29:19.009312 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:29:19.009312 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:29:19.009312 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:29:19.009312 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:29:19.009312 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:29:19.009312 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: add6bbc9866043499846c4ae3938ff58 Aug 10 23:29:19.009312 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-VolumesActionsTest-1050746670 Aug 10 23:29:19.009312 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:29:19.009312 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:29:19.009312 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/add6bbc9866043499846c4ae3938ff58"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/add6bbc9866043499846c4ae3938ff58"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/add6bbc9866043499846c4ae3938ff58"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_add6bbc9866043499846c4ae3938ff58", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:29:19.009312 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-VolumesActionsTest-1050746670 Aug 10 23:29:19.009312 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: add6bbc9866043499846c4ae3938ff58 Aug 10 23:29:19.009312 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-VolumesActionsTest-1050746670 Aug 10 23:29:19.009312 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-VolumesActionsTest-1050746670-project Aug 10 23:29:19.009312 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:29:19.009312 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:29:19.009312 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: d50c065499e24caa9b0e0d5b499e395d Aug 10 23:29:19.009312 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-VolumesActionsTest-1050746670-project Aug 10 23:29:19.009312 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:29:19.009312 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance ac44e6f8-57f8-46fa-b369-fb4da2c88568 could not be found. Aug 10 23:29:19.009312 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': 'ac44e6f8-57f8-46fa-b369-fb4da2c88568'} Aug 10 23:29:19.009312 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:29:19.009312 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:29:19.009312 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:29:19.009312 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:29:19.009312 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:29:19.009312 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:29:19.009312 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:29:19.009312 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:29:19.009312 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:29:19.009312 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:29:19.009312 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac44e6f8-57f8-46fa-b369-fb4da2c88568 could not be found. Aug 10 23:29:19.009312 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:29:19.009312 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:29:19.009312 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:29:19.009312 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:29:19.009312 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:29:19.009312 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:29:19.009312 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:29:19.009312 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:29:19.009312 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:29:19.009312 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:29:19.009312 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:29:19.009312 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:29:19.009312 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:29:19.009312 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:29:19.009312 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:29:19.009312 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:29:19.009312 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac44e6f8-57f8-46fa-b369-fb4da2c88568 could not be found. Aug 10 23:29:19.009312 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:29:19.009312 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:29:19.009312 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:29:19.014203 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:29:19.014203 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:29:19.014203 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:29:19.014203 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:29:19.014203 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:29:19.014203 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac44e6f8-57f8-46fa-b369-fb4da2c88568 could not be found. Aug 10 23:29:19.014203 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:29:19.014203 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-d8218079-021b-4fab-8d6e-e16e7abd0325 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] Returning 404 to user: Instance ac44e6f8-57f8-46fa-b369-fb4da2c88568 could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:29:19.014203 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-d8218079-021b-4fab-8d6e-e16e7abd0325 tempest-VolumesActionsTest-1050746670 tempest-VolumesActionsTest-1050746670-project] 10.222.0.58 "GET /compute/v2.1/servers/ac44e6f8-57f8-46fa-b369-fb4da2c88568" status: 404 len: 111 microversion: 2.1 time: 0.054182 Aug 10 23:29:19.015155 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2925/5630] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:29:18 2022] GET /compute/v2.1/servers/ac44e6f8-57f8-46fa-b369-fb4da2c88568 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:29:19.258267 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-2ec498ee-25a0-45dd-b4d6-9a01b550f8fc tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:29:19.278949 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-2ec498ee-25a0-45dd-b4d6-9a01b550f8fc tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:29:19.280569 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-2ec498ee-25a0-45dd-b4d6-9a01b550f8fc tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:29:19.286901 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-2ec498ee-25a0-45dd-b4d6-9a01b550f8fc tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "GET /compute/v2.1/servers/e806d719-6292-49a9-ab7b-31397991291d" status: 200 len: 1724 microversion: 2.20 time: 0.436900 Aug 10 23:29:19.287498 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2706/5631] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:29:18 2022] GET /compute/v2.1/servers/e806d719-6292-49a9-ab7b-31397991291d => generated 1724 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:29:19.645098 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-7bbbd80f-27e9-4f31-b4b4-87bb53022988 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:29:19.645724 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-7bbbd80f-27e9-4f31-b4b4-87bb53022988 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] [instance: e901c537-7d19-4c3f-b660-aadbaa4a264a] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:29:19.652706 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7bbbd80f-27e9-4f31-b4b4-87bb53022988 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:19.653537 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7bbbd80f-27e9-4f31-b4b4-87bb53022988 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:19.654156 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7bbbd80f-27e9-4f31-b4b4-87bb53022988 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:19.655271 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7bbbd80f-27e9-4f31-b4b4-87bb53022988 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:19.655902 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7bbbd80f-27e9-4f31-b4b4-87bb53022988 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:19.656536 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7bbbd80f-27e9-4f31-b4b4-87bb53022988 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:19.900114 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-7bbbd80f-27e9-4f31-b4b4-87bb53022988 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbea80d59f5840f1899bd3cf601ac8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679d43599f3e4c29ab368a1e54dae608', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:29:19.910778 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-7bbbd80f-27e9-4f31-b4b4-87bb53022988 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] 10.222.0.58 "GET /compute/v2.1/servers/e901c537-7d19-4c3f-b660-aadbaa4a264a" status: 200 len: 1548 microversion: 2.1 time: 0.270342 Aug 10 23:29:19.922989 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2926/5632] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:29:19 2022] GET /compute/v2.1/servers/e901c537-7d19-4c3f-b660-aadbaa4a264a => generated 1548 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:29:19.949829 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-cfa4a2fd-ce83-4b90-adb9-359a8c2b0ae8 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:29:19.950312 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-cfa4a2fd-ce83-4b90-adb9-359a8c2b0ae8 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] [instance: e901c537-7d19-4c3f-b660-aadbaa4a264a] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:29:19.962474 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cfa4a2fd-ce83-4b90-adb9-359a8c2b0ae8 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:19.962860 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cfa4a2fd-ce83-4b90-adb9-359a8c2b0ae8 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:19.963306 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cfa4a2fd-ce83-4b90-adb9-359a8c2b0ae8 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:19.964034 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cfa4a2fd-ce83-4b90-adb9-359a8c2b0ae8 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:19.964485 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cfa4a2fd-ce83-4b90-adb9-359a8c2b0ae8 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:19.964993 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cfa4a2fd-ce83-4b90-adb9-359a8c2b0ae8 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:20.313779 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-3dfbd913-0cfe-409d-9cff-4967498f01dd tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:29:20.317320 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-3dfbd913-0cfe-409d-9cff-4967498f01dd tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: e806d719-6292-49a9-ab7b-31397991291d] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:29:20.336690 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3dfbd913-0cfe-409d-9cff-4967498f01dd tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:20.338997 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3dfbd913-0cfe-409d-9cff-4967498f01dd tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:20.341138 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3dfbd913-0cfe-409d-9cff-4967498f01dd tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:20.343970 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3dfbd913-0cfe-409d-9cff-4967498f01dd tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:20.345032 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3dfbd913-0cfe-409d-9cff-4967498f01dd tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:20.346959 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3dfbd913-0cfe-409d-9cff-4967498f01dd tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:20.491164 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-cfa4a2fd-ce83-4b90-adb9-359a8c2b0ae8 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbea80d59f5840f1899bd3cf601ac8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679d43599f3e4c29ab368a1e54dae608', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:29:20.507570 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-cfa4a2fd-ce83-4b90-adb9-359a8c2b0ae8 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] 10.222.0.58 "GET /compute/v2.1/servers/e901c537-7d19-4c3f-b660-aadbaa4a264a" status: 200 len: 1548 microversion: 2.1 time: 0.561766 Aug 10 23:29:20.526184 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2707/5633] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:29:19 2022] GET /compute/v2.1/servers/e901c537-7d19-4c3f-b660-aadbaa4a264a => generated 1548 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:29:20.750988 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-3dfbd913-0cfe-409d-9cff-4967498f01dd tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:29:20.765672 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-3dfbd913-0cfe-409d-9cff-4967498f01dd tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:29:20.769638 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-3dfbd913-0cfe-409d-9cff-4967498f01dd tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:29:20.778504 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-3dfbd913-0cfe-409d-9cff-4967498f01dd tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "GET /compute/v2.1/servers/e806d719-6292-49a9-ab7b-31397991291d" status: 200 len: 1724 microversion: 2.20 time: 0.462910 Aug 10 23:29:20.779989 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2927/5634] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:29:20 2022] GET /compute/v2.1/servers/e806d719-6292-49a9-ab7b-31397991291d => generated 1724 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:29:21.804397 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-d98fbf1a-61cd-4a04-80aa-dff3efc2d811 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:29:21.804914 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-d98fbf1a-61cd-4a04-80aa-dff3efc2d811 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: e806d719-6292-49a9-ab7b-31397991291d] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:29:21.815982 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d98fbf1a-61cd-4a04-80aa-dff3efc2d811 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:21.816481 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d98fbf1a-61cd-4a04-80aa-dff3efc2d811 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:21.816921 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d98fbf1a-61cd-4a04-80aa-dff3efc2d811 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:21.827137 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d98fbf1a-61cd-4a04-80aa-dff3efc2d811 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:21.827778 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d98fbf1a-61cd-4a04-80aa-dff3efc2d811 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:21.828223 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d98fbf1a-61cd-4a04-80aa-dff3efc2d811 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:22.207131 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-d98fbf1a-61cd-4a04-80aa-dff3efc2d811 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:29:22.222819 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-d98fbf1a-61cd-4a04-80aa-dff3efc2d811 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:29:22.226757 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-d98fbf1a-61cd-4a04-80aa-dff3efc2d811 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:29:22.228379 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-d98fbf1a-61cd-4a04-80aa-dff3efc2d811 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "GET /compute/v2.1/servers/e806d719-6292-49a9-ab7b-31397991291d" status: 200 len: 1724 microversion: 2.20 time: 0.428316 Aug 10 23:29:22.234831 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2708/5635] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:29:21 2022] GET /compute/v2.1/servers/e806d719-6292-49a9-ab7b-31397991291d => generated 1724 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:29:23.263913 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-71a4b45e-a70e-4995-9d01-fb7c66c46e38 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:29:23.266407 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-71a4b45e-a70e-4995-9d01-fb7c66c46e38 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: e806d719-6292-49a9-ab7b-31397991291d] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:29:23.280564 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-71a4b45e-a70e-4995-9d01-fb7c66c46e38 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:23.285914 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-71a4b45e-a70e-4995-9d01-fb7c66c46e38 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:23.286621 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-71a4b45e-a70e-4995-9d01-fb7c66c46e38 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:23.287575 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-71a4b45e-a70e-4995-9d01-fb7c66c46e38 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:23.288476 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-71a4b45e-a70e-4995-9d01-fb7c66c46e38 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:23.290269 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-71a4b45e-a70e-4995-9d01-fb7c66c46e38 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:23.894000 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-71a4b45e-a70e-4995-9d01-fb7c66c46e38 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:29:23.938538 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-71a4b45e-a70e-4995-9d01-fb7c66c46e38 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:29:23.950148 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-71a4b45e-a70e-4995-9d01-fb7c66c46e38 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:29:23.952469 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-71a4b45e-a70e-4995-9d01-fb7c66c46e38 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "GET /compute/v2.1/servers/e806d719-6292-49a9-ab7b-31397991291d" status: 200 len: 1745 microversion: 2.20 time: 0.693585 Aug 10 23:29:23.960782 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2928/5636] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:29:23 2022] GET /compute/v2.1/servers/e806d719-6292-49a9-ab7b-31397991291d => generated 1745 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:29:25.499675 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-ed174762-1725-48c1-9ccc-9ff9fb33cb19 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:29:25.501473 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-ed174762-1725-48c1-9ccc-9ff9fb33cb19 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: e806d719-6292-49a9-ab7b-31397991291d] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:29:25.529293 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ed174762-1725-48c1-9ccc-9ff9fb33cb19 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:25.534245 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ed174762-1725-48c1-9ccc-9ff9fb33cb19 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:25.537405 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ed174762-1725-48c1-9ccc-9ff9fb33cb19 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:25.539565 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ed174762-1725-48c1-9ccc-9ff9fb33cb19 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:25.542983 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ed174762-1725-48c1-9ccc-9ff9fb33cb19 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:25.543744 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ed174762-1725-48c1-9ccc-9ff9fb33cb19 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:26.005751 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-ed174762-1725-48c1-9ccc-9ff9fb33cb19 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:29:26.015793 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-ed174762-1725-48c1-9ccc-9ff9fb33cb19 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:29:26.019949 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-ed174762-1725-48c1-9ccc-9ff9fb33cb19 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:29:26.028324 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-ed174762-1725-48c1-9ccc-9ff9fb33cb19 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "GET /compute/v2.1/servers/e806d719-6292-49a9-ab7b-31397991291d" status: 200 len: 1740 microversion: 2.20 time: 1.045231 Aug 10 23:29:26.044466 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2709/5637] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:29:24 2022] GET /compute/v2.1/servers/e806d719-6292-49a9-ab7b-31397991291d => generated 1740 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:29:27.053145 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-0d71b072-b9dc-4e4b-b704-c2c26183697a tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:29:27.054652 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-0d71b072-b9dc-4e4b-b704-c2c26183697a tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: e806d719-6292-49a9-ab7b-31397991291d] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:29:27.071246 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0d71b072-b9dc-4e4b-b704-c2c26183697a tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:27.072025 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0d71b072-b9dc-4e4b-b704-c2c26183697a tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:27.072655 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0d71b072-b9dc-4e4b-b704-c2c26183697a tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:27.073591 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0d71b072-b9dc-4e4b-b704-c2c26183697a tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:27.074055 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0d71b072-b9dc-4e4b-b704-c2c26183697a tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:27.074486 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0d71b072-b9dc-4e4b-b704-c2c26183697a tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:27.866850 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-0d71b072-b9dc-4e4b-b704-c2c26183697a tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:29:27.885008 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-0d71b072-b9dc-4e4b-b704-c2c26183697a tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:29:27.897073 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-0d71b072-b9dc-4e4b-b704-c2c26183697a tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:29:27.904353 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-0d71b072-b9dc-4e4b-b704-c2c26183697a tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "GET /compute/v2.1/servers/e806d719-6292-49a9-ab7b-31397991291d" status: 200 len: 1740 microversion: 2.20 time: 0.853070 Aug 10 23:29:27.918685 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2929/5638] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:29:27 2022] GET /compute/v2.1/servers/e806d719-6292-49a9-ab7b-31397991291d => generated 1740 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:29:28.935925 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-a7076a64-4fa7-4c02-9ec5-fcdb58fd10f4 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:29:28.937267 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-a7076a64-4fa7-4c02-9ec5-fcdb58fd10f4 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: e806d719-6292-49a9-ab7b-31397991291d] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:29:28.960695 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a7076a64-4fa7-4c02-9ec5-fcdb58fd10f4 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:28.976088 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a7076a64-4fa7-4c02-9ec5-fcdb58fd10f4 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:28.977399 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a7076a64-4fa7-4c02-9ec5-fcdb58fd10f4 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:28.980648 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a7076a64-4fa7-4c02-9ec5-fcdb58fd10f4 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:28.981797 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a7076a64-4fa7-4c02-9ec5-fcdb58fd10f4 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:28.989495 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a7076a64-4fa7-4c02-9ec5-fcdb58fd10f4 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:29.428582 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-a7076a64-4fa7-4c02-9ec5-fcdb58fd10f4 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:29:29.450319 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-a7076a64-4fa7-4c02-9ec5-fcdb58fd10f4 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:29:29.461578 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-a7076a64-4fa7-4c02-9ec5-fcdb58fd10f4 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:29:29.467668 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-a7076a64-4fa7-4c02-9ec5-fcdb58fd10f4 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "GET /compute/v2.1/servers/e806d719-6292-49a9-ab7b-31397991291d" status: 200 len: 1740 microversion: 2.20 time: 0.536525 Aug 10 23:29:29.479318 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2710/5639] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:29:28 2022] GET /compute/v2.1/servers/e806d719-6292-49a9-ab7b-31397991291d => generated 1740 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:29:30.457158 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-39e2debb-eca3-4735-8b14-ea7d59c06be1 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:29:30.459116 n-d-850468-14 devstack@n-api.service[122633]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 23:29:30.459116 n-d-850468-14 devstack@n-api.service[122633]: warnings.warn(msg) Aug 10 23:29:30.459997 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-39e2debb-eca3-4735-8b14-ea7d59c06be1 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:30.460554 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-39e2debb-eca3-4735-8b14-ea7d59c06be1 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:30.461274 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-39e2debb-eca3-4735-8b14-ea7d59c06be1 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:30.462150 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-39e2debb-eca3-4735-8b14-ea7d59c06be1 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:30.467745 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-39e2debb-eca3-4735-8b14-ea7d59c06be1 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:30.467745 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-39e2debb-eca3-4735-8b14-ea7d59c06be1 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:30.505852 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-013dcde6-0b30-43c4-ad9c-1519f5f16c19 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:29:30.507196 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-013dcde6-0b30-43c4-ad9c-1519f5f16c19 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: e806d719-6292-49a9-ab7b-31397991291d] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:29:30.522444 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-013dcde6-0b30-43c4-ad9c-1519f5f16c19 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:30.531964 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-013dcde6-0b30-43c4-ad9c-1519f5f16c19 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:30.532669 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-013dcde6-0b30-43c4-ad9c-1519f5f16c19 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:30.536727 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-013dcde6-0b30-43c4-ad9c-1519f5f16c19 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:30.540876 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-013dcde6-0b30-43c4-ad9c-1519f5f16c19 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:30.546843 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-013dcde6-0b30-43c4-ad9c-1519f5f16c19 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:30.589635 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-39e2debb-eca3-4735-8b14-ea7d59c06be1 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] 10.222.0.58 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 615 microversion: 2.1 time: 1.042650 Aug 10 23:29:30.598819 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2930/5640] 10.222.0.58 () {58 vars in 1185 bytes} [Wed Aug 10 23:29:29 2022] GET /compute/v2.1/os-availability-zone/detail => generated 615 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:29:30.916346 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-0381f9de-316f-4f08-b340-46f7078b2892 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-768813322", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452", "availability_zone": "nova:n-h1-850468-14", "networks": [{"uuid": "8ef1ec68-5a6f-4a58-a28b-2257693d5e35"}]}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:29:30.957808 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-013dcde6-0b30-43c4-ad9c-1519f5f16c19 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:29:30.969940 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-013dcde6-0b30-43c4-ad9c-1519f5f16c19 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:29:30.979262 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-013dcde6-0b30-43c4-ad9c-1519f5f16c19 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:29:30.981707 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-013dcde6-0b30-43c4-ad9c-1519f5f16c19 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "GET /compute/v2.1/servers/e806d719-6292-49a9-ab7b-31397991291d" status: 200 len: 1740 microversion: 2.20 time: 0.479374 Aug 10 23:29:30.984645 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2711/5641] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:29:30 2022] GET /compute/v2.1/servers/e806d719-6292-49a9-ab7b-31397991291d => generated 1740 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 23:29:31.660456 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-54994867-d5e6-4879-8c12-87cf216410b8 req-d427745a-2db7-4d1e-8d4a-3c1eb0dba78c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e806d719-6292-49a9-ab7b-31397991291d", "name": "network-vif-plugged", "status": "completed", "tag": "bd30930e-8098-4180-afd1-75ee64f8dc5a"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:29:31.691176 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-54994867-d5e6-4879-8c12-87cf216410b8 req-d427745a-2db7-4d1e-8d4a-3c1eb0dba78c service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:31.696945 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-54994867-d5e6-4879-8c12-87cf216410b8 req-d427745a-2db7-4d1e-8d4a-3c1eb0dba78c service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:31.697649 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-54994867-d5e6-4879-8c12-87cf216410b8 req-d427745a-2db7-4d1e-8d4a-3c1eb0dba78c service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:31.764718 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-54994867-d5e6-4879-8c12-87cf216410b8 req-d427745a-2db7-4d1e-8d4a-3c1eb0dba78c service nova] Creating event network-vif-plugged:bd30930e-8098-4180-afd1-75ee64f8dc5a for instance e806d719-6292-49a9-ab7b-31397991291d on n-h2-850468-14 Aug 10 23:29:31.781788 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-54994867-d5e6-4879-8c12-87cf216410b8 req-d427745a-2db7-4d1e-8d4a-3c1eb0dba78c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125706 Aug 10 23:29:31.794237 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2712/5642] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:29:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:29:32.011783 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-3a71241f-61f1-4e50-8ba3-13fe26e0601d tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:29:32.012755 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-3a71241f-61f1-4e50-8ba3-13fe26e0601d tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: e806d719-6292-49a9-ab7b-31397991291d] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:29:32.028239 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3a71241f-61f1-4e50-8ba3-13fe26e0601d tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:32.034915 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3a71241f-61f1-4e50-8ba3-13fe26e0601d tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:32.035783 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3a71241f-61f1-4e50-8ba3-13fe26e0601d tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:32.042226 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3a71241f-61f1-4e50-8ba3-13fe26e0601d tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:32.049432 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3a71241f-61f1-4e50-8ba3-13fe26e0601d tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:32.050639 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3a71241f-61f1-4e50-8ba3-13fe26e0601d tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:32.155217 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=100 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:29:32.601889 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-3a71241f-61f1-4e50-8ba3-13fe26e0601d tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:29:32.619583 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-3a71241f-61f1-4e50-8ba3-13fe26e0601d tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:29:32.626034 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-3a71241f-61f1-4e50-8ba3-13fe26e0601d tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:29:32.656596 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-3a71241f-61f1-4e50-8ba3-13fe26e0601d tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "GET /compute/v2.1/servers/e806d719-6292-49a9-ab7b-31397991291d" status: 200 len: 1740 microversion: 2.20 time: 0.648846 Aug 10 23:29:32.657371 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2713/5643] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:29:32 2022] GET /compute/v2.1/servers/e806d719-6292-49a9-ab7b-31397991291d => generated 1740 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:29:33.686630 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-5fdfbbf7-eaad-4ff4-ae32-2bf4e365bb26 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:29:33.691417 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-5fdfbbf7-eaad-4ff4-ae32-2bf4e365bb26 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: e806d719-6292-49a9-ab7b-31397991291d] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:29:33.740160 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5fdfbbf7-eaad-4ff4-ae32-2bf4e365bb26 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:33.748449 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5fdfbbf7-eaad-4ff4-ae32-2bf4e365bb26 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:33.751608 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5fdfbbf7-eaad-4ff4-ae32-2bf4e365bb26 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:33.757827 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5fdfbbf7-eaad-4ff4-ae32-2bf4e365bb26 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:33.759191 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5fdfbbf7-eaad-4ff4-ae32-2bf4e365bb26 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:33.764764 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5fdfbbf7-eaad-4ff4-ae32-2bf4e365bb26 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:34.078698 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-5fdfbbf7-eaad-4ff4-ae32-2bf4e365bb26 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:29:34.098222 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-5fdfbbf7-eaad-4ff4-ae32-2bf4e365bb26 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:29:34.102376 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-5fdfbbf7-eaad-4ff4-ae32-2bf4e365bb26 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:29:34.103920 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-5fdfbbf7-eaad-4ff4-ae32-2bf4e365bb26 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "GET /compute/v2.1/servers/e806d719-6292-49a9-ab7b-31397991291d" status: 200 len: 1740 microversion: 2.20 time: 0.426315 Aug 10 23:29:34.123616 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2714/5644] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:29:33 2022] GET /compute/v2.1/servers/e806d719-6292-49a9-ab7b-31397991291d => generated 1740 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:29:35.130473 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-1883f453-f5a0-4bc8-bd7b-178f6360c3d2 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:29:35.132250 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-1883f453-f5a0-4bc8-bd7b-178f6360c3d2 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: e806d719-6292-49a9-ab7b-31397991291d] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:29:35.141909 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1883f453-f5a0-4bc8-bd7b-178f6360c3d2 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:35.142692 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1883f453-f5a0-4bc8-bd7b-178f6360c3d2 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:35.142692 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1883f453-f5a0-4bc8-bd7b-178f6360c3d2 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:35.143329 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1883f453-f5a0-4bc8-bd7b-178f6360c3d2 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:35.143785 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1883f453-f5a0-4bc8-bd7b-178f6360c3d2 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:35.144210 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1883f453-f5a0-4bc8-bd7b-178f6360c3d2 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:35.564105 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-1883f453-f5a0-4bc8-bd7b-178f6360c3d2 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:29:35.584148 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-1883f453-f5a0-4bc8-bd7b-178f6360c3d2 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:29:35.591637 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-1883f453-f5a0-4bc8-bd7b-178f6360c3d2 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:29:35.595561 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-1883f453-f5a0-4bc8-bd7b-178f6360c3d2 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "GET /compute/v2.1/servers/e806d719-6292-49a9-ab7b-31397991291d" status: 200 len: 1740 microversion: 2.20 time: 0.468588 Aug 10 23:29:35.597825 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2715/5645] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:29:35 2022] GET /compute/v2.1/servers/e806d719-6292-49a9-ab7b-31397991291d => generated 1740 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:29:36.621822 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c5523d11-d75f-4d1f-9627-fb3161e45b9a tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:29:36.623201 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-c5523d11-d75f-4d1f-9627-fb3161e45b9a tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: e806d719-6292-49a9-ab7b-31397991291d] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:29:36.652829 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c5523d11-d75f-4d1f-9627-fb3161e45b9a tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:36.653333 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c5523d11-d75f-4d1f-9627-fb3161e45b9a tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:36.653791 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c5523d11-d75f-4d1f-9627-fb3161e45b9a tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:36.654611 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c5523d11-d75f-4d1f-9627-fb3161e45b9a tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:36.655824 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c5523d11-d75f-4d1f-9627-fb3161e45b9a tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:36.655824 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c5523d11-d75f-4d1f-9627-fb3161e45b9a tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:37.082943 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-c5523d11-d75f-4d1f-9627-fb3161e45b9a tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:29:37.095509 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-c5523d11-d75f-4d1f-9627-fb3161e45b9a tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:29:37.097250 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-c5523d11-d75f-4d1f-9627-fb3161e45b9a tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:29:37.098687 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-c5523d11-d75f-4d1f-9627-fb3161e45b9a tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "GET /compute/v2.1/servers/e806d719-6292-49a9-ab7b-31397991291d" status: 200 len: 1740 microversion: 2.20 time: 0.480971 Aug 10 23:29:37.121231 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2716/5646] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:29:36 2022] GET /compute/v2.1/servers/e806d719-6292-49a9-ab7b-31397991291d => generated 1740 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:29:38.129466 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-7786d9f5-bb3a-40e4-bfe1-893c98e306a7 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:29:38.130637 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-7786d9f5-bb3a-40e4-bfe1-893c98e306a7 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: e806d719-6292-49a9-ab7b-31397991291d] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:29:38.141122 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7786d9f5-bb3a-40e4-bfe1-893c98e306a7 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:38.146211 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7786d9f5-bb3a-40e4-bfe1-893c98e306a7 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:38.149986 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7786d9f5-bb3a-40e4-bfe1-893c98e306a7 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:38.152135 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7786d9f5-bb3a-40e4-bfe1-893c98e306a7 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:38.155264 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7786d9f5-bb3a-40e4-bfe1-893c98e306a7 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:38.157678 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7786d9f5-bb3a-40e4-bfe1-893c98e306a7 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:38.412308 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-7786d9f5-bb3a-40e4-bfe1-893c98e306a7 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:29:38.432010 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-7786d9f5-bb3a-40e4-bfe1-893c98e306a7 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:29:38.436907 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-7786d9f5-bb3a-40e4-bfe1-893c98e306a7 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:29:38.453008 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-7786d9f5-bb3a-40e4-bfe1-893c98e306a7 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "GET /compute/v2.1/servers/e806d719-6292-49a9-ab7b-31397991291d" status: 200 len: 1740 microversion: 2.20 time: 0.326697 Aug 10 23:29:38.469941 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2717/5647] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:29:38 2022] GET /compute/v2.1/servers/e806d719-6292-49a9-ab7b-31397991291d => generated 1740 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:29:39.481902 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-6ccf42e1-7ed8-4ad8-9b4d-5f3ec1ea08c3 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:29:39.485012 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-6ccf42e1-7ed8-4ad8-9b4d-5f3ec1ea08c3 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: e806d719-6292-49a9-ab7b-31397991291d] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:29:39.509944 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6ccf42e1-7ed8-4ad8-9b4d-5f3ec1ea08c3 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:39.510445 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6ccf42e1-7ed8-4ad8-9b4d-5f3ec1ea08c3 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:39.510924 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6ccf42e1-7ed8-4ad8-9b4d-5f3ec1ea08c3 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:39.515360 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6ccf42e1-7ed8-4ad8-9b4d-5f3ec1ea08c3 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:39.516016 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6ccf42e1-7ed8-4ad8-9b4d-5f3ec1ea08c3 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:39.516754 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6ccf42e1-7ed8-4ad8-9b4d-5f3ec1ea08c3 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:39.795924 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-6ccf42e1-7ed8-4ad8-9b4d-5f3ec1ea08c3 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:29:39.824432 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-6ccf42e1-7ed8-4ad8-9b4d-5f3ec1ea08c3 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:29:39.825490 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-6ccf42e1-7ed8-4ad8-9b4d-5f3ec1ea08c3 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:29:39.826863 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-6ccf42e1-7ed8-4ad8-9b4d-5f3ec1ea08c3 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "GET /compute/v2.1/servers/e806d719-6292-49a9-ab7b-31397991291d" status: 200 len: 1740 microversion: 2.20 time: 0.349091 Aug 10 23:29:39.846136 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2718/5648] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:29:39 2022] GET /compute/v2.1/servers/e806d719-6292-49a9-ab7b-31397991291d => generated 1740 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 23:29:40.512257 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=2 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:29:40.514376 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:29:40.854144 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-6a7737fc-55ee-432e-82b2-7a40a29ac85e tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:29:40.855591 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-6a7737fc-55ee-432e-82b2-7a40a29ac85e tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: e806d719-6292-49a9-ab7b-31397991291d] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:29:40.876426 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6a7737fc-55ee-432e-82b2-7a40a29ac85e tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:40.878529 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6a7737fc-55ee-432e-82b2-7a40a29ac85e tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:40.880871 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6a7737fc-55ee-432e-82b2-7a40a29ac85e tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:40.882845 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6a7737fc-55ee-432e-82b2-7a40a29ac85e tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:40.886646 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6a7737fc-55ee-432e-82b2-7a40a29ac85e tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:40.890534 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6a7737fc-55ee-432e-82b2-7a40a29ac85e tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:40.986649 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:29:41.211892 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-6a7737fc-55ee-432e-82b2-7a40a29ac85e tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:29:41.231496 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-6a7737fc-55ee-432e-82b2-7a40a29ac85e tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:29:41.234522 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-6a7737fc-55ee-432e-82b2-7a40a29ac85e tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:29:41.235883 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-6a7737fc-55ee-432e-82b2-7a40a29ac85e tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "GET /compute/v2.1/servers/e806d719-6292-49a9-ab7b-31397991291d" status: 200 len: 1740 microversion: 2.20 time: 0.386292 Aug 10 23:29:41.236447 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2719/5649] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:29:40 2022] GET /compute/v2.1/servers/e806d719-6292-49a9-ab7b-31397991291d => generated 1740 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:29:42.264200 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-6a8a8e55-5c49-41f5-8b42-997b3efef3af tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:29:42.264939 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-6a8a8e55-5c49-41f5-8b42-997b3efef3af tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: e806d719-6292-49a9-ab7b-31397991291d] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:29:42.275101 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6a8a8e55-5c49-41f5-8b42-997b3efef3af tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:42.275623 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6a8a8e55-5c49-41f5-8b42-997b3efef3af tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:42.276079 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6a8a8e55-5c49-41f5-8b42-997b3efef3af tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:42.277038 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6a8a8e55-5c49-41f5-8b42-997b3efef3af tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:42.277862 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6a8a8e55-5c49-41f5-8b42-997b3efef3af tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:42.278892 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6a8a8e55-5c49-41f5-8b42-997b3efef3af tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:42.565353 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-6a8a8e55-5c49-41f5-8b42-997b3efef3af tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:29:42.580677 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-6a8a8e55-5c49-41f5-8b42-997b3efef3af tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:29:42.583119 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-6a8a8e55-5c49-41f5-8b42-997b3efef3af tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:29:42.585223 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-6a8a8e55-5c49-41f5-8b42-997b3efef3af tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "GET /compute/v2.1/servers/e806d719-6292-49a9-ab7b-31397991291d" status: 200 len: 1740 microversion: 2.20 time: 0.324352 Aug 10 23:29:42.600137 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2720/5650] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:29:42 2022] GET /compute/v2.1/servers/e806d719-6292-49a9-ab7b-31397991291d => generated 1740 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:29:43.613716 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-cda857e8-f1b5-4f8a-a386-0e0920f52847 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:29:43.613716 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-cda857e8-f1b5-4f8a-a386-0e0920f52847 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: e806d719-6292-49a9-ab7b-31397991291d] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:29:43.624703 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_api:SELECT=48 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:29:43.637165 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cda857e8-f1b5-4f8a-a386-0e0920f52847 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:43.642244 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cda857e8-f1b5-4f8a-a386-0e0920f52847 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:43.642742 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cda857e8-f1b5-4f8a-a386-0e0920f52847 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:43.647865 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cda857e8-f1b5-4f8a-a386-0e0920f52847 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:43.648434 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cda857e8-f1b5-4f8a-a386-0e0920f52847 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:43.651343 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cda857e8-f1b5-4f8a-a386-0e0920f52847 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:44.022088 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-cda857e8-f1b5-4f8a-a386-0e0920f52847 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:29:44.031421 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-cda857e8-f1b5-4f8a-a386-0e0920f52847 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:29:44.035418 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-cda857e8-f1b5-4f8a-a386-0e0920f52847 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:29:44.037025 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-cda857e8-f1b5-4f8a-a386-0e0920f52847 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "GET /compute/v2.1/servers/e806d719-6292-49a9-ab7b-31397991291d" status: 200 len: 1740 microversion: 2.20 time: 0.429383 Aug 10 23:29:44.038165 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2721/5651] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:29:43 2022] GET /compute/v2.1/servers/e806d719-6292-49a9-ab7b-31397991291d => generated 1740 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:29:45.068543 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c25262c3-5521-4c6f-970b-86fe0e262f55 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:29:45.070127 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-c25262c3-5521-4c6f-970b-86fe0e262f55 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: e806d719-6292-49a9-ab7b-31397991291d] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:29:45.084434 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c25262c3-5521-4c6f-970b-86fe0e262f55 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:45.089881 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c25262c3-5521-4c6f-970b-86fe0e262f55 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:45.092647 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c25262c3-5521-4c6f-970b-86fe0e262f55 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:45.094532 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c25262c3-5521-4c6f-970b-86fe0e262f55 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:45.097329 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c25262c3-5521-4c6f-970b-86fe0e262f55 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:45.102346 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c25262c3-5521-4c6f-970b-86fe0e262f55 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:45.456611 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-c25262c3-5521-4c6f-970b-86fe0e262f55 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:29:45.476639 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-c25262c3-5521-4c6f-970b-86fe0e262f55 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:29:45.478897 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-c25262c3-5521-4c6f-970b-86fe0e262f55 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:29:45.480521 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-c25262c3-5521-4c6f-970b-86fe0e262f55 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "GET /compute/v2.1/servers/e806d719-6292-49a9-ab7b-31397991291d" status: 200 len: 1740 microversion: 2.20 time: 0.418624 Aug 10 23:29:45.481782 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2722/5652] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:29:45 2022] GET /compute/v2.1/servers/e806d719-6292-49a9-ab7b-31397991291d => generated 1740 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 23:29:46.051083 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.network.neutron [None req-0381f9de-316f-4f08-b340-46f7078b2892 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] validate_networks() for [('8ef1ec68-5a6f-4a58-a28b-2257693d5e35', None, None, None, None, None)] {{(pid=122633) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 23:29:46.504333 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-828ddfa5-105d-4401-8935-eaf5da619c07 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:29:46.504961 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-828ddfa5-105d-4401-8935-eaf5da619c07 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: e806d719-6292-49a9-ab7b-31397991291d] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:29:46.516059 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-828ddfa5-105d-4401-8935-eaf5da619c07 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:46.517606 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-828ddfa5-105d-4401-8935-eaf5da619c07 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:46.518257 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-828ddfa5-105d-4401-8935-eaf5da619c07 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:46.522557 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-828ddfa5-105d-4401-8935-eaf5da619c07 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:46.526184 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-828ddfa5-105d-4401-8935-eaf5da619c07 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:46.526958 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-828ddfa5-105d-4401-8935-eaf5da619c07 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:46.813337 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-828ddfa5-105d-4401-8935-eaf5da619c07 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:29:46.823526 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-828ddfa5-105d-4401-8935-eaf5da619c07 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:29:46.825150 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-828ddfa5-105d-4401-8935-eaf5da619c07 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:29:46.826606 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-828ddfa5-105d-4401-8935-eaf5da619c07 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "GET /compute/v2.1/servers/e806d719-6292-49a9-ab7b-31397991291d" status: 200 len: 1722 microversion: 2.20 time: 0.326665 Aug 10 23:29:46.827720 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2723/5653] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:29:46 2022] GET /compute/v2.1/servers/e806d719-6292-49a9-ab7b-31397991291d => generated 1722 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:29:47.076123 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-0381f9de-316f-4f08-b340-46f7078b2892 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Flavor limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:29:47.077074 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-0381f9de-316f-4f08-b340-46f7078b2892 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Image limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:29:47.078012 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-0381f9de-316f-4f08-b340-46f7078b2892 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Flavor pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:29:47.078638 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-0381f9de-316f-4f08-b340-46f7078b2892 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Image pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:29:47.079246 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-0381f9de-316f-4f08-b340-46f7078b2892 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:29:47.097525 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0381f9de-316f-4f08-b340-46f7078b2892 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:47.098701 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0381f9de-316f-4f08-b340-46f7078b2892 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:47.099723 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0381f9de-316f-4f08-b340-46f7078b2892 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:47.101176 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0381f9de-316f-4f08-b340-46f7078b2892 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:47.103478 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0381f9de-316f-4f08-b340-46f7078b2892 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:47.104452 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0381f9de-316f-4f08-b340-46f7078b2892 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:47.148639 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-0381f9de-316f-4f08-b340-46f7078b2892 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Getting quotas for project 05776e7992c34fc6af2152359b7887ba. Resources: {'instances', 'cores', 'ram'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:29:47.158493 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-0381f9de-316f-4f08-b340-46f7078b2892 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Getting quotas for user be5ac707f42345efa61f1b7d43b3aa7d and project 05776e7992c34fc6af2152359b7887ba. Resources: {'instances', 'cores', 'ram'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:29:47.185499 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-0381f9de-316f-4f08-b340-46f7078b2892 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Going to run 1 instances... {{(pid=122633) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 23:29:47.188037 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-0381f9de-316f-4f08-b340-46f7078b2892 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] [instance: 4764c5fc-edb2-41f3-8884-01cd0f2ef3ce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78ad8905-f66f-4733-8be9-2b260f1fabed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122633) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 23:29:47.245910 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-0381f9de-316f-4f08-b340-46f7078b2892 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 16.334932 Aug 10 23:29:47.247272 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2931/5654] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 23:29:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 16337 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 10 23:29:47.257641 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-f174b5c8-3850-4bd9-b08a-3b2c95d9c8c3 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:29:47.258247 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-f174b5c8-3850-4bd9-b08a-3b2c95d9c8c3 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] [instance: 4764c5fc-edb2-41f3-8884-01cd0f2ef3ce] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:29:47.359426 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-f174b5c8-3850-4bd9-b08a-3b2c95d9c8c3 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/4764c5fc-edb2-41f3-8884-01cd0f2ef3ce" status: 200 len: 1328 microversion: 2.1 time: 0.105619 Aug 10 23:29:47.365752 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2724/5655] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:29:47 2022] GET /compute/v2.1/servers/4764c5fc-edb2-41f3-8884-01cd0f2ef3ce => generated 1328 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:29:47.853980 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-76bbf532-9722-4e0a-a3aa-1aebd8a52eb7 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:29:47.856961 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-76bbf532-9722-4e0a-a3aa-1aebd8a52eb7 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: e806d719-6292-49a9-ab7b-31397991291d] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:29:47.886766 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-76bbf532-9722-4e0a-a3aa-1aebd8a52eb7 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:47.888898 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-76bbf532-9722-4e0a-a3aa-1aebd8a52eb7 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:47.891114 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-76bbf532-9722-4e0a-a3aa-1aebd8a52eb7 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:47.895584 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-76bbf532-9722-4e0a-a3aa-1aebd8a52eb7 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:47.897951 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-76bbf532-9722-4e0a-a3aa-1aebd8a52eb7 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:47.898406 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-76bbf532-9722-4e0a-a3aa-1aebd8a52eb7 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:48.382226 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-76bbf532-9722-4e0a-a3aa-1aebd8a52eb7 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:29:48.404232 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-b1631a9d-7983-43e3-a3d9-96dc471f2f34 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:29:48.404836 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-b1631a9d-7983-43e3-a3d9-96dc471f2f34 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] [instance: 4764c5fc-edb2-41f3-8884-01cd0f2ef3ce] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:29:48.407029 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-76bbf532-9722-4e0a-a3aa-1aebd8a52eb7 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:29:48.409676 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-76bbf532-9722-4e0a-a3aa-1aebd8a52eb7 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:29:48.411146 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-76bbf532-9722-4e0a-a3aa-1aebd8a52eb7 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "GET /compute/v2.1/servers/e806d719-6292-49a9-ab7b-31397991291d" status: 200 len: 1722 microversion: 2.20 time: 0.562783 Aug 10 23:29:48.413448 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2932/5656] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:29:47 2022] GET /compute/v2.1/servers/e806d719-6292-49a9-ab7b-31397991291d => generated 1722 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 23:29:48.424000 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b1631a9d-7983-43e3-a3d9-96dc471f2f34 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:48.424493 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b1631a9d-7983-43e3-a3d9-96dc471f2f34 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:48.424924 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b1631a9d-7983-43e3-a3d9-96dc471f2f34 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:48.425630 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b1631a9d-7983-43e3-a3d9-96dc471f2f34 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:48.426076 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b1631a9d-7983-43e3-a3d9-96dc471f2f34 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:48.426493 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b1631a9d-7983-43e3-a3d9-96dc471f2f34 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:48.584417 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-b1631a9d-7983-43e3-a3d9-96dc471f2f34 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/4764c5fc-edb2-41f3-8884-01cd0f2ef3ce" status: 200 len: 1417 microversion: 2.1 time: 0.184824 Aug 10 23:29:48.585215 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2725/5657] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:29:48 2022] GET /compute/v2.1/servers/4764c5fc-edb2-41f3-8884-01cd0f2ef3ce => generated 1417 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:29:49.453972 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-14c2a2d6-f588-436c-a5ee-b79ab6fe2e3a tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:29:49.455409 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-14c2a2d6-f588-436c-a5ee-b79ab6fe2e3a tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: e806d719-6292-49a9-ab7b-31397991291d] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:29:49.513947 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-14c2a2d6-f588-436c-a5ee-b79ab6fe2e3a tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:49.520827 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-14c2a2d6-f588-436c-a5ee-b79ab6fe2e3a tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:49.522280 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-14c2a2d6-f588-436c-a5ee-b79ab6fe2e3a tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:49.523360 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-14c2a2d6-f588-436c-a5ee-b79ab6fe2e3a tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:49.524071 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-14c2a2d6-f588-436c-a5ee-b79ab6fe2e3a tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:49.525444 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-14c2a2d6-f588-436c-a5ee-b79ab6fe2e3a tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:49.608367 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-f1dbc1cd-68a1-4357-86f9-f44b16a82b61 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:29:49.610240 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-f1dbc1cd-68a1-4357-86f9-f44b16a82b61 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] [instance: 4764c5fc-edb2-41f3-8884-01cd0f2ef3ce] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:29:49.656239 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f1dbc1cd-68a1-4357-86f9-f44b16a82b61 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:49.661153 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f1dbc1cd-68a1-4357-86f9-f44b16a82b61 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:49.661616 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f1dbc1cd-68a1-4357-86f9-f44b16a82b61 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:49.668067 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f1dbc1cd-68a1-4357-86f9-f44b16a82b61 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:49.669260 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f1dbc1cd-68a1-4357-86f9-f44b16a82b61 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:49.671270 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f1dbc1cd-68a1-4357-86f9-f44b16a82b61 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:49.804399 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-f1dbc1cd-68a1-4357-86f9-f44b16a82b61 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/4764c5fc-edb2-41f3-8884-01cd0f2ef3ce" status: 200 len: 1423 microversion: 2.1 time: 0.202337 Aug 10 23:29:49.809961 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2726/5658] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:29:49 2022] GET /compute/v2.1/servers/4764c5fc-edb2-41f3-8884-01cd0f2ef3ce => generated 1423 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:29:49.818321 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-09a135db-2b03-4624-b87b-1d06d5248075 req-06a25bb3-71b0-4421-818f-831965afc277 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e806d719-6292-49a9-ab7b-31397991291d", "name": "network-vif-unplugged", "status": "completed", "tag": "bd30930e-8098-4180-afd1-75ee64f8dc5a"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:29:49.877423 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-09a135db-2b03-4624-b87b-1d06d5248075 req-06a25bb3-71b0-4421-818f-831965afc277 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:49.878677 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-09a135db-2b03-4624-b87b-1d06d5248075 req-06a25bb3-71b0-4421-818f-831965afc277 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:49.880579 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-09a135db-2b03-4624-b87b-1d06d5248075 req-06a25bb3-71b0-4421-818f-831965afc277 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:49.915222 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-09a135db-2b03-4624-b87b-1d06d5248075 req-06a25bb3-71b0-4421-818f-831965afc277 service nova] Creating event network-vif-unplugged:bd30930e-8098-4180-afd1-75ee64f8dc5a for instance e806d719-6292-49a9-ab7b-31397991291d on n-h2-850468-14 Aug 10 23:29:49.923379 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-09a135db-2b03-4624-b87b-1d06d5248075 req-06a25bb3-71b0-4421-818f-831965afc277 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.111325 Aug 10 23:29:49.924394 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2727/5659] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:29:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:29:50.225810 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-14c2a2d6-f588-436c-a5ee-b79ab6fe2e3a tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:29:50.239579 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-14c2a2d6-f588-436c-a5ee-b79ab6fe2e3a tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:29:50.241749 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-14c2a2d6-f588-436c-a5ee-b79ab6fe2e3a tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:29:50.243268 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-14c2a2d6-f588-436c-a5ee-b79ab6fe2e3a tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "GET /compute/v2.1/servers/e806d719-6292-49a9-ab7b-31397991291d" status: 200 len: 1722 microversion: 2.20 time: 0.805595 Aug 10 23:29:50.244179 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2933/5660] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:29:49 2022] GET /compute/v2.1/servers/e806d719-6292-49a9-ab7b-31397991291d => generated 1722 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:29:50.826315 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-76ad1eb6-fad1-4b0a-a9b6-7e9fe5c4472d tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:29:50.827049 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-76ad1eb6-fad1-4b0a-a9b6-7e9fe5c4472d tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] [instance: 4764c5fc-edb2-41f3-8884-01cd0f2ef3ce] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:29:50.842667 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-76ad1eb6-fad1-4b0a-a9b6-7e9fe5c4472d tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:50.843170 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-76ad1eb6-fad1-4b0a-a9b6-7e9fe5c4472d tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:50.843606 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-76ad1eb6-fad1-4b0a-a9b6-7e9fe5c4472d tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:50.844328 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-76ad1eb6-fad1-4b0a-a9b6-7e9fe5c4472d tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:50.844763 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-76ad1eb6-fad1-4b0a-a9b6-7e9fe5c4472d tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:50.845186 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-76ad1eb6-fad1-4b0a-a9b6-7e9fe5c4472d tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:50.935655 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-76ad1eb6-fad1-4b0a-a9b6-7e9fe5c4472d tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/4764c5fc-edb2-41f3-8884-01cd0f2ef3ce" status: 200 len: 1423 microversion: 2.1 time: 0.113790 Aug 10 23:29:50.938294 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2728/5661] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:29:50 2022] GET /compute/v2.1/servers/4764c5fc-edb2-41f3-8884-01cd0f2ef3ce => generated 1423 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:29:51.268498 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-e0e75305-ed61-4c23-8b2d-8cd696489bbe tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:29:51.269252 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-e0e75305-ed61-4c23-8b2d-8cd696489bbe tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: e806d719-6292-49a9-ab7b-31397991291d] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:29:51.283810 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e0e75305-ed61-4c23-8b2d-8cd696489bbe tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:51.285387 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e0e75305-ed61-4c23-8b2d-8cd696489bbe tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:51.286352 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e0e75305-ed61-4c23-8b2d-8cd696489bbe tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:51.287676 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e0e75305-ed61-4c23-8b2d-8cd696489bbe tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:51.288671 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e0e75305-ed61-4c23-8b2d-8cd696489bbe tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:51.290534 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e0e75305-ed61-4c23-8b2d-8cd696489bbe tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:51.758921 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-d65b472f-6069-4766-a7e8-e8ea96022e04 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:29:51.759677 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-d65b472f-6069-4766-a7e8-e8ea96022e04 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] [instance: e901c537-7d19-4c3f-b660-aadbaa4a264a] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:29:51.770210 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d65b472f-6069-4766-a7e8-e8ea96022e04 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:51.783926 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d65b472f-6069-4766-a7e8-e8ea96022e04 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:51.785244 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d65b472f-6069-4766-a7e8-e8ea96022e04 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:51.785887 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d65b472f-6069-4766-a7e8-e8ea96022e04 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:51.786366 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d65b472f-6069-4766-a7e8-e8ea96022e04 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:51.786826 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d65b472f-6069-4766-a7e8-e8ea96022e04 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:51.839685 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-e0e75305-ed61-4c23-8b2d-8cd696489bbe tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:29:51.859744 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-d65b472f-6069-4766-a7e8-e8ea96022e04 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] [instance: e901c537-7d19-4c3f-b660-aadbaa4a264a] Going to try to terminate instance {{(pid=122632) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:29:51.863763 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-e0e75305-ed61-4c23-8b2d-8cd696489bbe tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:29:51.868547 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-e0e75305-ed61-4c23-8b2d-8cd696489bbe tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:29:51.870380 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-e0e75305-ed61-4c23-8b2d-8cd696489bbe tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "GET /compute/v2.1/servers/e806d719-6292-49a9-ab7b-31397991291d" status: 200 len: 1665 microversion: 2.20 time: 0.605895 Aug 10 23:29:51.873680 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2934/5662] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:29:51 2022] GET /compute/v2.1/servers/e806d719-6292-49a9-ab7b-31397991291d => generated 1665 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:29:51.896416 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-3382398b-d26f-47d4-a269-5326b5581ac3 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cc89eaeb-744b-41c2-a8b1-54167238edcc"}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:29:51.899362 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-3382398b-d26f-47d4-a269-5326b5581ac3 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: e806d719-6292-49a9-ab7b-31397991291d] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:29:51.914038 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3382398b-d26f-47d4-a269-5326b5581ac3 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:51.925909 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3382398b-d26f-47d4-a269-5326b5581ac3 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:51.928084 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3382398b-d26f-47d4-a269-5326b5581ac3 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:51.939860 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3382398b-d26f-47d4-a269-5326b5581ac3 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:51.942286 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3382398b-d26f-47d4-a269-5326b5581ac3 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:51.944496 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3382398b-d26f-47d4-a269-5326b5581ac3 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:52.130288 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-d65b472f-6069-4766-a7e8-e8ea96022e04 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] 10.222.0.58 "DELETE /compute/v2.1/servers/e901c537-7d19-4c3f-b660-aadbaa4a264a" status: 204 len: 0 microversion: 2.1 time: 0.375180 Aug 10 23:29:52.134852 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2729/5663] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:29:51 2022] DELETE /compute/v2.1/servers/e901c537-7d19-4c3f-b660-aadbaa4a264a => generated 0 bytes in 381 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 10 23:29:52.153672 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-904e497c-c472-4e99-b538-0b7e2026fb0e tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:29:52.165961 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-904e497c-c472-4e99-b538-0b7e2026fb0e tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] [instance: 4764c5fc-edb2-41f3-8884-01cd0f2ef3ce] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:29:52.190728 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-904e497c-c472-4e99-b538-0b7e2026fb0e tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:52.196273 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-904e497c-c472-4e99-b538-0b7e2026fb0e tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:52.199602 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-904e497c-c472-4e99-b538-0b7e2026fb0e tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:52.207102 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-904e497c-c472-4e99-b538-0b7e2026fb0e tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:52.208952 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-904e497c-c472-4e99-b538-0b7e2026fb0e tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:52.209471 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-904e497c-c472-4e99-b538-0b7e2026fb0e tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:52.300053 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:29:52.601665 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-904e497c-c472-4e99-b538-0b7e2026fb0e tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/4764c5fc-edb2-41f3-8884-01cd0f2ef3ce" status: 200 len: 1465 microversion: 2.1 time: 0.465008 Aug 10 23:29:52.604553 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2730/5664] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:29:52 2022] GET /compute/v2.1/servers/4764c5fc-edb2-41f3-8884-01cd0f2ef3ce => generated 1465 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:29:52.617454 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-92e02102-3dd2-4423-955c-821b142ab97c tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:29:52.620753 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-92e02102-3dd2-4423-955c-821b142ab97c tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] [instance: e901c537-7d19-4c3f-b660-aadbaa4a264a] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:29:52.633145 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-92e02102-3dd2-4423-955c-821b142ab97c tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:52.639891 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-3382398b-d26f-47d4-a269-5326b5581ac3 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "POST /compute/v2.1/servers/e806d719-6292-49a9-ab7b-31397991291d/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.746871 Aug 10 23:29:52.640813 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-92e02102-3dd2-4423-955c-821b142ab97c tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:52.641508 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-92e02102-3dd2-4423-955c-821b142ab97c tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:52.641738 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2935/5665] 10.222.0.58 () {62 vars in 1364 bytes} [Wed Aug 10 23:29:51 2022] POST /compute/v2.1/servers/e806d719-6292-49a9-ab7b-31397991291d/os-volume_attachments => generated 188 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 10 23:29:52.642818 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-92e02102-3dd2-4423-955c-821b142ab97c tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:52.669429 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-92e02102-3dd2-4423-955c-821b142ab97c tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:52.671554 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-92e02102-3dd2-4423-955c-821b142ab97c tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:52.961583 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-cc167ed0-2e6a-45df-89bf-778c2dee9dd6 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:29:52.962472 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-cc167ed0-2e6a-45df-89bf-778c2dee9dd6 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: e806d719-6292-49a9-ab7b-31397991291d] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:29:52.975957 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cc167ed0-2e6a-45df-89bf-778c2dee9dd6 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:52.976465 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cc167ed0-2e6a-45df-89bf-778c2dee9dd6 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:52.976919 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cc167ed0-2e6a-45df-89bf-778c2dee9dd6 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:52.977648 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cc167ed0-2e6a-45df-89bf-778c2dee9dd6 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:52.978113 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cc167ed0-2e6a-45df-89bf-778c2dee9dd6 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:52.978553 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cc167ed0-2e6a-45df-89bf-778c2dee9dd6 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:52.988026 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-92e02102-3dd2-4423-955c-821b142ab97c tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbea80d59f5840f1899bd3cf601ac8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679d43599f3e4c29ab368a1e54dae608', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:29:53.000998 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-92e02102-3dd2-4423-955c-821b142ab97c tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] 10.222.0.58 "GET /compute/v2.1/servers/e901c537-7d19-4c3f-b660-aadbaa4a264a" status: 200 len: 1554 microversion: 2.1 time: 0.393885 Aug 10 23:29:53.001779 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2731/5666] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:29:52 2022] GET /compute/v2.1/servers/e901c537-7d19-4c3f-b660-aadbaa4a264a => generated 1554 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:29:53.461494 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-cc167ed0-2e6a-45df-89bf-778c2dee9dd6 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "DELETE /compute/v2.1/servers/e806d719-6292-49a9-ab7b-31397991291d/os-volume_attachments/cc89eaeb-744b-41c2-a8b1-54167238edcc" status: 202 len: 0 microversion: 2.20 time: 0.503653 Aug 10 23:29:53.463141 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2936/5667] 10.222.0.58 () {60 vars in 1457 bytes} [Wed Aug 10 23:29:52 2022] DELETE /compute/v2.1/servers/e806d719-6292-49a9-ab7b-31397991291d/os-volume_attachments/cc89eaeb-744b-41c2-a8b1-54167238edcc => generated 0 bytes in 507 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:29:53.513152 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-c36b5c85-63d5-4085-87c6-b4a60413a24f req-b0ccac5c-23f6-465e-9cf9-7b569fb90d34 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4764c5fc-edb2-41f3-8884-01cd0f2ef3ce", "tag": "17ad154c-1ffd-464b-a705-781a09d97ec0"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:29:53.558390 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-c36b5c85-63d5-4085-87c6-b4a60413a24f req-b0ccac5c-23f6-465e-9cf9-7b569fb90d34 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:53.565535 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-c36b5c85-63d5-4085-87c6-b4a60413a24f req-b0ccac5c-23f6-465e-9cf9-7b569fb90d34 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:53.566083 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-c36b5c85-63d5-4085-87c6-b4a60413a24f req-b0ccac5c-23f6-465e-9cf9-7b569fb90d34 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:53.628796 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-7060f920-dd6b-477d-bf52-6e2f7556254a tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:29:53.629426 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-7060f920-dd6b-477d-bf52-6e2f7556254a tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] [instance: 4764c5fc-edb2-41f3-8884-01cd0f2ef3ce] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:29:53.654562 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-c36b5c85-63d5-4085-87c6-b4a60413a24f req-b0ccac5c-23f6-465e-9cf9-7b569fb90d34 service nova] Creating event network-changed:17ad154c-1ffd-464b-a705-781a09d97ec0 for instance 4764c5fc-edb2-41f3-8884-01cd0f2ef3ce on n-h1-850468-14 Aug 10 23:29:53.662178 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7060f920-dd6b-477d-bf52-6e2f7556254a tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:53.663389 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7060f920-dd6b-477d-bf52-6e2f7556254a tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:53.664303 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7060f920-dd6b-477d-bf52-6e2f7556254a tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:53.667329 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7060f920-dd6b-477d-bf52-6e2f7556254a tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:53.668245 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7060f920-dd6b-477d-bf52-6e2f7556254a tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:53.670502 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7060f920-dd6b-477d-bf52-6e2f7556254a tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:53.679463 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-c36b5c85-63d5-4085-87c6-b4a60413a24f req-b0ccac5c-23f6-465e-9cf9-7b569fb90d34 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.172383 Aug 10 23:29:53.684250 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2732/5668] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:29:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:29:53.709153 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-a2fdce51-2c94-4b1f-a2b4-127a5ca2fa65 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:29:53.712158 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-a2fdce51-2c94-4b1f-a2b4-127a5ca2fa65 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: e806d719-6292-49a9-ab7b-31397991291d] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:29:53.730402 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a2fdce51-2c94-4b1f-a2b4-127a5ca2fa65 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:53.733198 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a2fdce51-2c94-4b1f-a2b4-127a5ca2fa65 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:53.737071 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a2fdce51-2c94-4b1f-a2b4-127a5ca2fa65 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:53.741836 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a2fdce51-2c94-4b1f-a2b4-127a5ca2fa65 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:53.743710 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a2fdce51-2c94-4b1f-a2b4-127a5ca2fa65 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:53.770133 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a2fdce51-2c94-4b1f-a2b4-127a5ca2fa65 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:54.294530 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-a2fdce51-2c94-4b1f-a2b4-127a5ca2fa65 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: e806d719-6292-49a9-ab7b-31397991291d] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=122632) unshelve /opt/stack/nova/nova/compute/api.py:4544}} Aug 10 23:29:54.419906 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-a2fdce51-2c94-4b1f-a2b4-127a5ca2fa65 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "POST /compute/v2.1/servers/e806d719-6292-49a9-ab7b-31397991291d/action" status: 202 len: 0 microversion: 2.20 time: 0.731624 Aug 10 23:29:54.424423 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2733/5669] 10.222.0.58 () {62 vars in 1319 bytes} [Wed Aug 10 23:29:53 2022] POST /compute/v2.1/servers/e806d719-6292-49a9-ab7b-31397991291d/action => generated 0 bytes in 739 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:29:54.430323 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-a358075d-0950-40e7-a59f-663586b106ac tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:29:54.431088 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-a358075d-0950-40e7-a59f-663586b106ac tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] [instance: e901c537-7d19-4c3f-b660-aadbaa4a264a] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:29:54.440090 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a358075d-0950-40e7-a59f-663586b106ac tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:54.440786 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a358075d-0950-40e7-a59f-663586b106ac tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:54.441331 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a358075d-0950-40e7-a59f-663586b106ac tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:54.442158 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a358075d-0950-40e7-a59f-663586b106ac tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:54.442721 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a358075d-0950-40e7-a59f-663586b106ac tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:54.443270 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a358075d-0950-40e7-a59f-663586b106ac tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:54.447208 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-7060f920-dd6b-477d-bf52-6e2f7556254a tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/4764c5fc-edb2-41f3-8884-01cd0f2ef3ce" status: 200 len: 1465 microversion: 2.1 time: 0.814979 Aug 10 23:29:54.453263 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2937/5670] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:29:53 2022] GET /compute/v2.1/servers/4764c5fc-edb2-41f3-8884-01cd0f2ef3ce => generated 1465 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:29:54.460190 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-920e74b3-ea58-4a82-8b4e-097f45789828 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:29:54.461041 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-920e74b3-ea58-4a82-8b4e-097f45789828 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: e806d719-6292-49a9-ab7b-31397991291d] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:29:54.487198 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-920e74b3-ea58-4a82-8b4e-097f45789828 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:54.487702 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-920e74b3-ea58-4a82-8b4e-097f45789828 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:54.488326 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-920e74b3-ea58-4a82-8b4e-097f45789828 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:54.489226 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-920e74b3-ea58-4a82-8b4e-097f45789828 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:54.489854 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-920e74b3-ea58-4a82-8b4e-097f45789828 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:54.490607 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-920e74b3-ea58-4a82-8b4e-097f45789828 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:54.692706 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-a358075d-0950-40e7-a59f-663586b106ac tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbea80d59f5840f1899bd3cf601ac8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679d43599f3e4c29ab368a1e54dae608', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:29:54.704467 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-a358075d-0950-40e7-a59f-663586b106ac tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] 10.222.0.58 "GET /compute/v2.1/servers/e901c537-7d19-4c3f-b660-aadbaa4a264a" status: 200 len: 1554 microversion: 2.1 time: 0.275719 Aug 10 23:29:54.707292 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2734/5671] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:29:54 2022] GET /compute/v2.1/servers/e901c537-7d19-4c3f-b660-aadbaa4a264a => generated 1554 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:29:54.751072 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-920e74b3-ea58-4a82-8b4e-097f45789828 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:29:54.761023 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-920e74b3-ea58-4a82-8b4e-097f45789828 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:29:54.763241 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-920e74b3-ea58-4a82-8b4e-097f45789828 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:29:54.765685 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-920e74b3-ea58-4a82-8b4e-097f45789828 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "GET /compute/v2.1/servers/e806d719-6292-49a9-ab7b-31397991291d" status: 200 len: 1673 microversion: 2.20 time: 0.309871 Aug 10 23:29:54.768109 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2938/5672] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:29:54 2022] GET /compute/v2.1/servers/e806d719-6292-49a9-ab7b-31397991291d => generated 1673 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:29:55.473376 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-e5f98599-6bd9-46fe-ad5d-9a7bff602aee tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:29:55.474069 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-e5f98599-6bd9-46fe-ad5d-9a7bff602aee tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] [instance: 4764c5fc-edb2-41f3-8884-01cd0f2ef3ce] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:29:55.488326 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e5f98599-6bd9-46fe-ad5d-9a7bff602aee tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:55.489372 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e5f98599-6bd9-46fe-ad5d-9a7bff602aee tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:55.489831 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e5f98599-6bd9-46fe-ad5d-9a7bff602aee tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:55.495244 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e5f98599-6bd9-46fe-ad5d-9a7bff602aee tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:55.498093 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e5f98599-6bd9-46fe-ad5d-9a7bff602aee tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:55.498591 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e5f98599-6bd9-46fe-ad5d-9a7bff602aee tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:55.714044 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-ea7d3fbe-20ae-4f41-9e45-a020d63c7900 req-a32a9133-4af5-4d00-a840-efb6de279922 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e901c537-7d19-4c3f-b660-aadbaa4a264a", "name": "network-vif-deleted", "tag": "39201045-2e7d-48eb-ac1d-a9c9970c2e3e"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:29:55.730320 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-ea7d3fbe-20ae-4f41-9e45-a020d63c7900 req-a32a9133-4af5-4d00-a840-efb6de279922 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:55.730830 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-ea7d3fbe-20ae-4f41-9e45-a020d63c7900 req-a32a9133-4af5-4d00-a840-efb6de279922 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:55.733834 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-ea7d3fbe-20ae-4f41-9e45-a020d63c7900 req-a32a9133-4af5-4d00-a840-efb6de279922 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:55.755626 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-ea7d3fbe-20ae-4f41-9e45-a020d63c7900 req-a32a9133-4af5-4d00-a840-efb6de279922 service nova] Creating event network-vif-deleted:39201045-2e7d-48eb-ac1d-a9c9970c2e3e for instance e901c537-7d19-4c3f-b660-aadbaa4a264a on n-h2-850468-14 Aug 10 23:29:55.763363 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-ea7d3fbe-20ae-4f41-9e45-a020d63c7900 req-a32a9133-4af5-4d00-a840-efb6de279922 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053012 Aug 10 23:29:55.764567 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2939/5673] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:29:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:29:55.770954 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-b37f32d9-dbee-4bda-9b90-c11705eab64f tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:29:55.772317 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-b37f32d9-dbee-4bda-9b90-c11705eab64f tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] [instance: e901c537-7d19-4c3f-b660-aadbaa4a264a] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:29:55.779429 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b37f32d9-dbee-4bda-9b90-c11705eab64f tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:55.780230 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b37f32d9-dbee-4bda-9b90-c11705eab64f tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:55.780903 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b37f32d9-dbee-4bda-9b90-c11705eab64f tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:55.782308 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b37f32d9-dbee-4bda-9b90-c11705eab64f tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:55.782977 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b37f32d9-dbee-4bda-9b90-c11705eab64f tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:55.784376 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b37f32d9-dbee-4bda-9b90-c11705eab64f tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:55.794124 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-e5f98599-6bd9-46fe-ad5d-9a7bff602aee tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/4764c5fc-edb2-41f3-8884-01cd0f2ef3ce" status: 200 len: 1465 microversion: 2.1 time: 0.324227 Aug 10 23:29:55.795526 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2735/5674] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:29:55 2022] GET /compute/v2.1/servers/4764c5fc-edb2-41f3-8884-01cd0f2ef3ce => generated 1465 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:29:55.801535 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-0cfffea0-0a4b-4747-be35-a6209128621e tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:29:55.802458 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-0cfffea0-0a4b-4747-be35-a6209128621e tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: e806d719-6292-49a9-ab7b-31397991291d] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:29:55.811456 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0cfffea0-0a4b-4747-be35-a6209128621e tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:55.812259 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0cfffea0-0a4b-4747-be35-a6209128621e tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:55.813381 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0cfffea0-0a4b-4747-be35-a6209128621e tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:55.814236 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-b37f32d9-dbee-4bda-9b90-c11705eab64f tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] HTTP exception thrown: Instance e901c537-7d19-4c3f-b660-aadbaa4a264a could not be found. Aug 10 23:29:55.814540 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0cfffea0-0a4b-4747-be35-a6209128621e tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:55.815145 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0cfffea0-0a4b-4747-be35-a6209128621e tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:55.816283 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0cfffea0-0a4b-4747-be35-a6209128621e tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:55.816412 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-b37f32d9-dbee-4bda-9b90-c11705eab64f tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Request method failure captured: Aug 10 23:29:55.816412 n-d-850468-14 devstack@n-api.service[122633]: request: GET /compute/v2.1/servers/e901c537-7d19-4c3f-b660-aadbaa4a264a HTTP/1.1 Aug 10 23:29:55.816412 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:29:55.816412 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:29:55.816412 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:29:55.816412 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:29:55.816412 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:29:55.816412 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:29:55.816412 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:29:55.816412 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:29:55.816412 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9D7xLbha89w4RFaA9WPNaubQudJCDUCb2VIWrKN08Pzedq3777Uk6apcHRNC0PbYtg_8fiEC_kC7gcTZrYMB40oQ4tWtRHjNsjVhrAhgAjKtaVvY3fCimK_NUEVEN-LM6c7t9R8XmEcJtm2mVIxpdgzackpaZxyyUWdyDfNvRMaAbQo Aug 10 23:29:55.816412 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:29:55.816412 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:29:55.816412 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:29:55.816412 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:29:55.816412 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:29:55.816412 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:29:55.816412 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 679d43599f3e4c29ab368a1e54dae608 Aug 10 23:29:55.816412 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-TestNetworkBasicOps-1961993656 Aug 10 23:29:55.816412 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:29:55.816412 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:29:55.816412 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/679d43599f3e4c29ab368a1e54dae608"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/679d43599f3e4c29ab368a1e54dae608"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/679d43599f3e4c29ab368a1e54dae608"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_679d43599f3e4c29ab368a1e54dae608", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:29:55.816412 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-TestNetworkBasicOps-1961993656 Aug 10 23:29:55.816412 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 679d43599f3e4c29ab368a1e54dae608 Aug 10 23:29:55.816412 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-TestNetworkBasicOps-1961993656 Aug 10 23:29:55.816412 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-TestNetworkBasicOps-1961993656-project Aug 10 23:29:55.816412 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:29:55.816412 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:29:55.816412 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: fbea80d59f5840f1899bd3cf601ac8bf Aug 10 23:29:55.816412 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-TestNetworkBasicOps-1961993656-project Aug 10 23:29:55.816412 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:29:55.816412 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance e901c537-7d19-4c3f-b660-aadbaa4a264a could not be found. Aug 10 23:29:55.816412 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': 'e901c537-7d19-4c3f-b660-aadbaa4a264a'} Aug 10 23:29:55.816412 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:29:55.816412 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:29:55.816412 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:29:55.816412 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:29:55.816412 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:29:55.816412 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:29:55.816412 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:29:55.816412 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:29:55.816412 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:29:55.816412 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:29:55.816412 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e901c537-7d19-4c3f-b660-aadbaa4a264a could not be found. Aug 10 23:29:55.816412 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:29:55.816412 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:29:55.816412 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:29:55.816412 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:29:55.816412 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:29:55.816412 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:29:55.816412 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:29:55.816412 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:29:55.816412 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:29:55.816412 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:29:55.816412 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:29:55.816412 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:29:55.816412 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:29:55.816412 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:29:55.816412 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:29:55.816412 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:29:55.816412 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e901c537-7d19-4c3f-b660-aadbaa4a264a could not be found. Aug 10 23:29:55.816412 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:29:55.816412 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:29:55.816412 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:29:55.821750 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:29:55.821750 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:29:55.821750 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:29:55.821750 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:29:55.821750 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:29:55.821750 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e901c537-7d19-4c3f-b660-aadbaa4a264a could not be found. Aug 10 23:29:55.821750 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:29:55.821750 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-b37f32d9-dbee-4bda-9b90-c11705eab64f tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Returning 404 to user: Instance e901c537-7d19-4c3f-b660-aadbaa4a264a could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:29:55.821750 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-b37f32d9-dbee-4bda-9b90-c11705eab64f tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] 10.222.0.58 "GET /compute/v2.1/servers/e901c537-7d19-4c3f-b660-aadbaa4a264a" status: 404 len: 111 microversion: 2.1 time: 0.051357 Aug 10 23:29:55.821750 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2940/5675] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:29:55 2022] GET /compute/v2.1/servers/e901c537-7d19-4c3f-b660-aadbaa4a264a => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:29:56.044352 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-0cfffea0-0a4b-4747-be35-a6209128621e tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:29:56.054407 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-0cfffea0-0a4b-4747-be35-a6209128621e tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:29:56.056269 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-0cfffea0-0a4b-4747-be35-a6209128621e tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:29:56.057660 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-0cfffea0-0a4b-4747-be35-a6209128621e tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "GET /compute/v2.1/servers/e806d719-6292-49a9-ab7b-31397991291d" status: 200 len: 1673 microversion: 2.20 time: 0.260248 Aug 10 23:29:56.058399 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2736/5676] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:29:55 2022] GET /compute/v2.1/servers/e806d719-6292-49a9-ab7b-31397991291d => generated 1673 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:29:56.118588 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-6cfa32f8-29c9-4827-8052-5f673003f6f7 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Calling method '.version_select at 0x7f847c098b80>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:29:56.140992 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-6cfa32f8-29c9-4827-8052-5f673003f6f7 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1079892518" status: 202 len: 0 microversion: 2.1 time: 0.026777 Aug 10 23:29:56.144772 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2941/5677] 10.222.0.58 () {58 vars in 1257 bytes} [Wed Aug 10 23:29:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1079892518 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:29:56.817554 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-ad09a60e-a8f4-43f0-aeb8-9b4cfd2699fc tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:29:56.818279 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-ad09a60e-a8f4-43f0-aeb8-9b4cfd2699fc tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] [instance: 4764c5fc-edb2-41f3-8884-01cd0f2ef3ce] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:29:56.843014 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ad09a60e-a8f4-43f0-aeb8-9b4cfd2699fc tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:56.843641 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ad09a60e-a8f4-43f0-aeb8-9b4cfd2699fc tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:56.844594 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ad09a60e-a8f4-43f0-aeb8-9b4cfd2699fc tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:56.849613 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ad09a60e-a8f4-43f0-aeb8-9b4cfd2699fc tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:56.850348 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ad09a60e-a8f4-43f0-aeb8-9b4cfd2699fc tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:56.851046 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ad09a60e-a8f4-43f0-aeb8-9b4cfd2699fc tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:57.086079 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c972d4d8-fa72-4140-bf82-6892094cb44b tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:29:57.087378 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-c972d4d8-fa72-4140-bf82-6892094cb44b tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: e806d719-6292-49a9-ab7b-31397991291d] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:29:57.099121 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-ad09a60e-a8f4-43f0-aeb8-9b4cfd2699fc tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/4764c5fc-edb2-41f3-8884-01cd0f2ef3ce" status: 200 len: 1465 microversion: 2.1 time: 0.286750 Aug 10 23:29:57.099407 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c972d4d8-fa72-4140-bf82-6892094cb44b tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:57.100028 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2737/5678] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:29:56 2022] GET /compute/v2.1/servers/4764c5fc-edb2-41f3-8884-01cd0f2ef3ce => generated 1465 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:29:57.100354 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c972d4d8-fa72-4140-bf82-6892094cb44b tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:57.101097 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c972d4d8-fa72-4140-bf82-6892094cb44b tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:57.102345 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c972d4d8-fa72-4140-bf82-6892094cb44b tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:57.103528 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c972d4d8-fa72-4140-bf82-6892094cb44b tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:57.104462 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c972d4d8-fa72-4140-bf82-6892094cb44b tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:57.132987 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=2 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:29:57.179661 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=6 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:29:57.886044 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-c972d4d8-fa72-4140-bf82-6892094cb44b tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:29:57.897008 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-c972d4d8-fa72-4140-bf82-6892094cb44b tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:29:57.899877 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-c972d4d8-fa72-4140-bf82-6892094cb44b tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:29:57.901540 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-c972d4d8-fa72-4140-bf82-6892094cb44b tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "GET /compute/v2.1/servers/e806d719-6292-49a9-ab7b-31397991291d" status: 200 len: 1731 microversion: 2.20 time: 0.820744 Aug 10 23:29:57.914216 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2942/5679] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:29:57 2022] GET /compute/v2.1/servers/e806d719-6292-49a9-ab7b-31397991291d => generated 1731 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:29:58.122061 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-f1a41e29-86ba-4753-a0f1-f90b8284e103 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:29:58.128859 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-f1a41e29-86ba-4753-a0f1-f90b8284e103 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] [instance: 4764c5fc-edb2-41f3-8884-01cd0f2ef3ce] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:29:58.131973 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=2 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:29:58.141364 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f1a41e29-86ba-4753-a0f1-f90b8284e103 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:58.144270 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f1a41e29-86ba-4753-a0f1-f90b8284e103 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:58.144738 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f1a41e29-86ba-4753-a0f1-f90b8284e103 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:58.145476 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f1a41e29-86ba-4753-a0f1-f90b8284e103 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:58.145938 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f1a41e29-86ba-4753-a0f1-f90b8284e103 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:58.146370 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f1a41e29-86ba-4753-a0f1-f90b8284e103 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:58.401101 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-f1a41e29-86ba-4753-a0f1-f90b8284e103 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/4764c5fc-edb2-41f3-8884-01cd0f2ef3ce" status: 200 len: 1465 microversion: 2.1 time: 0.284441 Aug 10 23:29:58.411260 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2738/5680] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:29:58 2022] GET /compute/v2.1/servers/4764c5fc-edb2-41f3-8884-01cd0f2ef3ce => generated 1465 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:29:58.668289 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-7e7479c4-f225-470c-b66d-3b7685f83e9d tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-635624177", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452"}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:29:58.771159 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.network.neutron [None req-7e7479c4-f225-470c-b66d-3b7685f83e9d tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] validate_networks() for None {{(pid=122633) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 23:29:58.926109 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-2ef68085-d4f5-4133-bd06-afed9f83e2de tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:29:58.927095 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-2ef68085-d4f5-4133-bd06-afed9f83e2de tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: e806d719-6292-49a9-ab7b-31397991291d] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:29:58.945460 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2ef68085-d4f5-4133-bd06-afed9f83e2de tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:58.946449 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2ef68085-d4f5-4133-bd06-afed9f83e2de tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:58.947159 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2ef68085-d4f5-4133-bd06-afed9f83e2de tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:58.948124 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2ef68085-d4f5-4133-bd06-afed9f83e2de tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:58.948811 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2ef68085-d4f5-4133-bd06-afed9f83e2de tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:58.949459 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2ef68085-d4f5-4133-bd06-afed9f83e2de tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:59.210916 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-2ef68085-d4f5-4133-bd06-afed9f83e2de tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:29:59.224967 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-2ef68085-d4f5-4133-bd06-afed9f83e2de tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:29:59.226723 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-2ef68085-d4f5-4133-bd06-afed9f83e2de tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:29:59.231448 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-2ef68085-d4f5-4133-bd06-afed9f83e2de tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "GET /compute/v2.1/servers/e806d719-6292-49a9-ab7b-31397991291d" status: 200 len: 1731 microversion: 2.20 time: 0.309282 Aug 10 23:29:59.254111 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2739/5681] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:29:58 2022] GET /compute/v2.1/servers/e806d719-6292-49a9-ab7b-31397991291d => generated 1731 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:29:59.326624 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-7e7479c4-f225-470c-b66d-3b7685f83e9d tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Flavor limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:29:59.327403 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-7e7479c4-f225-470c-b66d-3b7685f83e9d tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Image limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:29:59.327972 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-7e7479c4-f225-470c-b66d-3b7685f83e9d tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Flavor pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:29:59.328410 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-7e7479c4-f225-470c-b66d-3b7685f83e9d tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Image pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:29:59.328833 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-7e7479c4-f225-470c-b66d-3b7685f83e9d tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:29:59.348762 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7e7479c4-f225-470c-b66d-3b7685f83e9d tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:59.349256 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7e7479c4-f225-470c-b66d-3b7685f83e9d tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:59.349693 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7e7479c4-f225-470c-b66d-3b7685f83e9d tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:59.350419 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7e7479c4-f225-470c-b66d-3b7685f83e9d tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:59.350902 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7e7479c4-f225-470c-b66d-3b7685f83e9d tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:59.351333 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7e7479c4-f225-470c-b66d-3b7685f83e9d tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:59.394210 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-7e7479c4-f225-470c-b66d-3b7685f83e9d tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Getting quotas for project 467e718cca3a4fdea39706b1f0241c3a. Resources: {'instances', 'cores', 'ram'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:29:59.412611 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-7e7479c4-f225-470c-b66d-3b7685f83e9d tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Getting quotas for user c9719cc999ad49b493186b399fb600a2 and project 467e718cca3a4fdea39706b1f0241c3a. Resources: {'instances', 'cores', 'ram'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:29:59.421533 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-6b5386f2-9f1b-45ae-a4ba-6182277ed4c1 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:29:59.422795 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-6b5386f2-9f1b-45ae-a4ba-6182277ed4c1 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] [instance: 4764c5fc-edb2-41f3-8884-01cd0f2ef3ce] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:29:59.437485 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6b5386f2-9f1b-45ae-a4ba-6182277ed4c1 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:59.438441 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6b5386f2-9f1b-45ae-a4ba-6182277ed4c1 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:59.439401 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6b5386f2-9f1b-45ae-a4ba-6182277ed4c1 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:59.443541 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6b5386f2-9f1b-45ae-a4ba-6182277ed4c1 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:59.444854 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6b5386f2-9f1b-45ae-a4ba-6182277ed4c1 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:59.446736 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6b5386f2-9f1b-45ae-a4ba-6182277ed4c1 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:59.456015 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-7e7479c4-f225-470c-b66d-3b7685f83e9d tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Going to run 1 instances... {{(pid=122633) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 23:29:59.458459 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-7e7479c4-f225-470c-b66d-3b7685f83e9d tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] [instance: fb59b3c4-bc94-49b7-81e7-7369b70731ad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78ad8905-f66f-4733-8be9-2b260f1fabed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122633) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 23:29:59.595961 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-7e7479c4-f225-470c-b66d-3b7685f83e9d tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.933495 Aug 10 23:29:59.596639 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2943/5682] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 23:29:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 935 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 10 23:29:59.619177 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-b00ee4c0-f4fa-4ce4-8cfc-5c8bb8b5c232 tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:29:59.621506 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-b00ee4c0-f4fa-4ce4-8cfc-5c8bb8b5c232 tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] [instance: fb59b3c4-bc94-49b7-81e7-7369b70731ad] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:29:59.756008 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-b00ee4c0-f4fa-4ce4-8cfc-5c8bb8b5c232 tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9719cc999ad49b493186b399fb600a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467e718cca3a4fdea39706b1f0241c3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:29:59.771680 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-b00ee4c0-f4fa-4ce4-8cfc-5c8bb8b5c232 tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] 10.222.0.58 "GET /compute/v2.1/servers/fb59b3c4-bc94-49b7-81e7-7369b70731ad" status: 200 len: 1213 microversion: 2.1 time: 0.157166 Aug 10 23:29:59.772309 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2944/5683] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:29:59 2022] GET /compute/v2.1/servers/fb59b3c4-bc94-49b7-81e7-7369b70731ad => generated 1213 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:29:59.808288 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-37ee9a7f-c3ef-4f40-a9ec-31abafd239b9 req-4c182b2c-4e5e-4153-88f7-70dd7c8aa71c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4764c5fc-edb2-41f3-8884-01cd0f2ef3ce", "name": "network-vif-plugged", "status": "completed", "tag": "17ad154c-1ffd-464b-a705-781a09d97ec0"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:29:59.838104 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-37ee9a7f-c3ef-4f40-a9ec-31abafd239b9 req-4c182b2c-4e5e-4153-88f7-70dd7c8aa71c service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:29:59.839604 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-37ee9a7f-c3ef-4f40-a9ec-31abafd239b9 req-4c182b2c-4e5e-4153-88f7-70dd7c8aa71c service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:29:59.843300 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-37ee9a7f-c3ef-4f40-a9ec-31abafd239b9 req-4c182b2c-4e5e-4153-88f7-70dd7c8aa71c service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:29:59.891333 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-37ee9a7f-c3ef-4f40-a9ec-31abafd239b9 req-4c182b2c-4e5e-4153-88f7-70dd7c8aa71c service nova] Creating event network-vif-plugged:17ad154c-1ffd-464b-a705-781a09d97ec0 for instance 4764c5fc-edb2-41f3-8884-01cd0f2ef3ce on n-h1-850468-14 Aug 10 23:29:59.919618 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-37ee9a7f-c3ef-4f40-a9ec-31abafd239b9 req-4c182b2c-4e5e-4153-88f7-70dd7c8aa71c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.132338 Aug 10 23:29:59.922914 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2945/5684] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:29:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:30:00.264576 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-e148f255-437b-48d5-9897-9d8507ea86b5 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:30:00.266259 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-e148f255-437b-48d5-9897-9d8507ea86b5 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: e806d719-6292-49a9-ab7b-31397991291d] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:30:00.282566 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e148f255-437b-48d5-9897-9d8507ea86b5 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:00.286605 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e148f255-437b-48d5-9897-9d8507ea86b5 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:00.287361 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e148f255-437b-48d5-9897-9d8507ea86b5 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:00.293036 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e148f255-437b-48d5-9897-9d8507ea86b5 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:00.294233 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e148f255-437b-48d5-9897-9d8507ea86b5 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:00.295625 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e148f255-437b-48d5-9897-9d8507ea86b5 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:00.726371 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-e148f255-437b-48d5-9897-9d8507ea86b5 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:30:00.770266 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-e148f255-437b-48d5-9897-9d8507ea86b5 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:30:00.782057 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-e148f255-437b-48d5-9897-9d8507ea86b5 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:30:00.796382 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-e148f255-437b-48d5-9897-9d8507ea86b5 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "GET /compute/v2.1/servers/e806d719-6292-49a9-ab7b-31397991291d" status: 200 len: 1731 microversion: 2.20 time: 0.533376 Aug 10 23:30:00.800328 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2946/5685] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:30:00 2022] GET /compute/v2.1/servers/e806d719-6292-49a9-ab7b-31397991291d => generated 1731 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 23:30:00.816737 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-f332c2d9-54e3-4630-a302-be8827940c61 tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:30:00.819030 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-f332c2d9-54e3-4630-a302-be8827940c61 tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] [instance: fb59b3c4-bc94-49b7-81e7-7369b70731ad] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:30:00.845370 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f332c2d9-54e3-4630-a302-be8827940c61 tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:00.846320 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f332c2d9-54e3-4630-a302-be8827940c61 tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:00.850230 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f332c2d9-54e3-4630-a302-be8827940c61 tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:00.856880 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f332c2d9-54e3-4630-a302-be8827940c61 tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:00.860809 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f332c2d9-54e3-4630-a302-be8827940c61 tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:00.861710 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f332c2d9-54e3-4630-a302-be8827940c61 tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:00.945647 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-6b5386f2-9f1b-45ae-a4ba-6182277ed4c1 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/4764c5fc-edb2-41f3-8884-01cd0f2ef3ce" status: 200 len: 1465 microversion: 2.1 time: 1.527983 Aug 10 23:30:00.947035 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2740/5686] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:29:59 2022] GET /compute/v2.1/servers/4764c5fc-edb2-41f3-8884-01cd0f2ef3ce => generated 1465 bytes in 1530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:30:00.965926 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-75bddf4e-f4b3-4342-a571-11979c39c89f tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:30:00.969209 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-75bddf4e-f4b3-4342-a571-11979c39c89f tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] [instance: d0df5425-46c7-4aa2-81b7-8113347766ad] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:30:00.993845 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-75bddf4e-f4b3-4342-a571-11979c39c89f tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:00.995134 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-75bddf4e-f4b3-4342-a571-11979c39c89f tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:00.996326 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-75bddf4e-f4b3-4342-a571-11979c39c89f tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:00.998470 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-75bddf4e-f4b3-4342-a571-11979c39c89f tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:00.999362 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-75bddf4e-f4b3-4342-a571-11979c39c89f tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:00.999958 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-75bddf4e-f4b3-4342-a571-11979c39c89f tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:01.056647 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-75bddf4e-f4b3-4342-a571-11979c39c89f tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] [instance: d0df5425-46c7-4aa2-81b7-8113347766ad] Going to try to terminate instance {{(pid=122632) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:30:01.122039 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-f332c2d9-54e3-4630-a302-be8827940c61 tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9719cc999ad49b493186b399fb600a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467e718cca3a4fdea39706b1f0241c3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:30:01.130109 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=87,nova_cell1:INSERT=5,nova_cell1:UPDATE=8 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:30:01.147137 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-f332c2d9-54e3-4630-a302-be8827940c61 tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] 10.222.0.58 "GET /compute/v2.1/servers/fb59b3c4-bc94-49b7-81e7-7369b70731ad" status: 200 len: 1217 microversion: 2.1 time: 0.341938 Aug 10 23:30:01.148195 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2947/5687] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:30:00 2022] GET /compute/v2.1/servers/fb59b3c4-bc94-49b7-81e7-7369b70731ad => generated 1217 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:30:01.158317 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-d11e1f68-750f-4218-b6ce-92790d670605 req-fc5ceec0-1c05-410e-b2df-ebe8fe517bf3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0df5425-46c7-4aa2-81b7-8113347766ad", "tag": "aa673f43-a995-4dae-b7b0-1c90f9acf05c"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:30:01.187620 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-d11e1f68-750f-4218-b6ce-92790d670605 req-fc5ceec0-1c05-410e-b2df-ebe8fe517bf3 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:01.188604 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-d11e1f68-750f-4218-b6ce-92790d670605 req-fc5ceec0-1c05-410e-b2df-ebe8fe517bf3 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:01.191439 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-d11e1f68-750f-4218-b6ce-92790d670605 req-fc5ceec0-1c05-410e-b2df-ebe8fe517bf3 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:01.236737 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-d11e1f68-750f-4218-b6ce-92790d670605 req-fc5ceec0-1c05-410e-b2df-ebe8fe517bf3 service nova] Creating event network-changed:aa673f43-a995-4dae-b7b0-1c90f9acf05c for instance d0df5425-46c7-4aa2-81b7-8113347766ad on n-h1-850468-14 Aug 10 23:30:01.246109 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-d11e1f68-750f-4218-b6ce-92790d670605 req-fc5ceec0-1c05-410e-b2df-ebe8fe517bf3 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096403 Aug 10 23:30:01.251294 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-75bddf4e-f4b3-4342-a571-11979c39c89f tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] 10.222.0.58 "DELETE /compute/v2.1/servers/d0df5425-46c7-4aa2-81b7-8113347766ad" status: 204 len: 0 microversion: 2.1 time: 0.302919 Aug 10 23:30:01.252145 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2741/5688] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:30:00 2022] DELETE /compute/v2.1/servers/d0df5425-46c7-4aa2-81b7-8113347766ad => generated 0 bytes in 305 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:30:01.253300 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2948/5689] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:30:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:30:01.281041 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-e574d3cd-e726-47bc-bf9a-05a681de7abd tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:30:01.283212 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-e574d3cd-e726-47bc-bf9a-05a681de7abd tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] [instance: d0df5425-46c7-4aa2-81b7-8113347766ad] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:30:01.313898 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e574d3cd-e726-47bc-bf9a-05a681de7abd tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:01.315001 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e574d3cd-e726-47bc-bf9a-05a681de7abd tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:01.315647 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e574d3cd-e726-47bc-bf9a-05a681de7abd tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:01.317484 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e574d3cd-e726-47bc-bf9a-05a681de7abd tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:01.318147 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e574d3cd-e726-47bc-bf9a-05a681de7abd tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:01.318753 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e574d3cd-e726-47bc-bf9a-05a681de7abd tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:01.588851 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-e574d3cd-e726-47bc-bf9a-05a681de7abd tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbea80d59f5840f1899bd3cf601ac8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679d43599f3e4c29ab368a1e54dae608', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:30:01.601493 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-e574d3cd-e726-47bc-bf9a-05a681de7abd tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] 10.222.0.58 "GET /compute/v2.1/servers/d0df5425-46c7-4aa2-81b7-8113347766ad" status: 200 len: 1671 microversion: 2.1 time: 0.339866 Aug 10 23:30:01.604730 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2742/5690] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:30:01 2022] GET /compute/v2.1/servers/d0df5425-46c7-4aa2-81b7-8113347766ad => generated 1671 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:30:01.827611 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-ad1270ec-dbe2-4e49-ba54-9c6b49ca9a79 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:30:01.830657 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-ad1270ec-dbe2-4e49-ba54-9c6b49ca9a79 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: e806d719-6292-49a9-ab7b-31397991291d] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:30:01.860504 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ad1270ec-dbe2-4e49-ba54-9c6b49ca9a79 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:01.861393 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ad1270ec-dbe2-4e49-ba54-9c6b49ca9a79 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:01.862040 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ad1270ec-dbe2-4e49-ba54-9c6b49ca9a79 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:01.863001 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ad1270ec-dbe2-4e49-ba54-9c6b49ca9a79 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:01.863626 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ad1270ec-dbe2-4e49-ba54-9c6b49ca9a79 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:01.864246 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ad1270ec-dbe2-4e49-ba54-9c6b49ca9a79 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:01.976573 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-25c46f3f-629d-4cd9-8378-ecb44f569de5 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:30:01.977967 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-25c46f3f-629d-4cd9-8378-ecb44f569de5 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] [instance: 4764c5fc-edb2-41f3-8884-01cd0f2ef3ce] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:30:01.990944 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-25c46f3f-629d-4cd9-8378-ecb44f569de5 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:01.998823 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-25c46f3f-629d-4cd9-8378-ecb44f569de5 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:02.002095 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-25c46f3f-629d-4cd9-8378-ecb44f569de5 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:02.004942 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-25c46f3f-629d-4cd9-8378-ecb44f569de5 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:02.005746 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-25c46f3f-629d-4cd9-8378-ecb44f569de5 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:02.007092 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-25c46f3f-629d-4cd9-8378-ecb44f569de5 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:02.169093 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-ad1270ec-dbe2-4e49-ba54-9c6b49ca9a79 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:30:02.181656 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-ad1270ec-dbe2-4e49-ba54-9c6b49ca9a79 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:30:02.188036 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-ad1270ec-dbe2-4e49-ba54-9c6b49ca9a79 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:30:02.189483 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-ad1270ec-dbe2-4e49-ba54-9c6b49ca9a79 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "GET /compute/v2.1/servers/e806d719-6292-49a9-ab7b-31397991291d" status: 200 len: 1731 microversion: 2.20 time: 0.370638 Aug 10 23:30:02.194429 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2949/5691] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:30:01 2022] GET /compute/v2.1/servers/e806d719-6292-49a9-ab7b-31397991291d => generated 1731 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:30:02.205013 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-ea565cbb-2898-4e0a-972f-051cc599647a tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:30:02.214369 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-ea565cbb-2898-4e0a-972f-051cc599647a tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] [instance: fb59b3c4-bc94-49b7-81e7-7369b70731ad] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:30:02.243596 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ea565cbb-2898-4e0a-972f-051cc599647a tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:02.244728 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ea565cbb-2898-4e0a-972f-051cc599647a tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:02.255534 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ea565cbb-2898-4e0a-972f-051cc599647a tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:02.256924 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ea565cbb-2898-4e0a-972f-051cc599647a tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:02.257867 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ea565cbb-2898-4e0a-972f-051cc599647a tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:02.258615 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ea565cbb-2898-4e0a-972f-051cc599647a tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:02.328728 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-25c46f3f-629d-4cd9-8378-ecb44f569de5 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/4764c5fc-edb2-41f3-8884-01cd0f2ef3ce" status: 200 len: 1651 microversion: 2.1 time: 0.358367 Aug 10 23:30:02.337696 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2743/5692] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:30:01 2022] GET /compute/v2.1/servers/4764c5fc-edb2-41f3-8884-01cd0f2ef3ce => generated 1651 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:30:02.357446 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-da5b6f6e-2542-4004-afb3-bc008a722380 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:30:02.360574 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-da5b6f6e-2542-4004-afb3-bc008a722380 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] [instance: 4764c5fc-edb2-41f3-8884-01cd0f2ef3ce] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:30:02.376328 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-da5b6f6e-2542-4004-afb3-bc008a722380 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:02.376864 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-da5b6f6e-2542-4004-afb3-bc008a722380 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:02.378086 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-da5b6f6e-2542-4004-afb3-bc008a722380 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:02.379480 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-da5b6f6e-2542-4004-afb3-bc008a722380 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:02.383236 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-da5b6f6e-2542-4004-afb3-bc008a722380 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:02.383732 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-da5b6f6e-2542-4004-afb3-bc008a722380 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:02.646524 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-ea565cbb-2898-4e0a-972f-051cc599647a tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9719cc999ad49b493186b399fb600a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467e718cca3a4fdea39706b1f0241c3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:30:02.658944 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-ea565cbb-2898-4e0a-972f-051cc599647a tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] 10.222.0.58 "GET /compute/v2.1/servers/fb59b3c4-bc94-49b7-81e7-7369b70731ad" status: 200 len: 1265 microversion: 2.1 time: 0.462687 Aug 10 23:30:02.670811 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2950/5693] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:30:02 2022] GET /compute/v2.1/servers/fb59b3c4-bc94-49b7-81e7-7369b70731ad => generated 1265 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:30:02.670811 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-5602f65e-2030-4fc6-a756-6bf2b0f8bc56 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:30:02.670811 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-5602f65e-2030-4fc6-a756-6bf2b0f8bc56 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] [instance: d0df5425-46c7-4aa2-81b7-8113347766ad] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:30:02.675792 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5602f65e-2030-4fc6-a756-6bf2b0f8bc56 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:02.677025 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5602f65e-2030-4fc6-a756-6bf2b0f8bc56 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:02.678117 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5602f65e-2030-4fc6-a756-6bf2b0f8bc56 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:02.679088 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5602f65e-2030-4fc6-a756-6bf2b0f8bc56 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:02.679693 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5602f65e-2030-4fc6-a756-6bf2b0f8bc56 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:02.680419 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5602f65e-2030-4fc6-a756-6bf2b0f8bc56 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:03.055051 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-5602f65e-2030-4fc6-a756-6bf2b0f8bc56 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbea80d59f5840f1899bd3cf601ac8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679d43599f3e4c29ab368a1e54dae608', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:30:03.066291 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-5602f65e-2030-4fc6-a756-6bf2b0f8bc56 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] 10.222.0.58 "GET /compute/v2.1/servers/d0df5425-46c7-4aa2-81b7-8113347766ad" status: 200 len: 1671 microversion: 2.1 time: 0.404720 Aug 10 23:30:03.099509 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2951/5694] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:30:02 2022] GET /compute/v2.1/servers/d0df5425-46c7-4aa2-81b7-8113347766ad => generated 1671 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:30:03.217599 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-fb9a673d-2663-42bb-b80b-c11bd5e08584 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:30:03.218509 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-fb9a673d-2663-42bb-b80b-c11bd5e08584 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: e806d719-6292-49a9-ab7b-31397991291d] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:30:03.236084 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fb9a673d-2663-42bb-b80b-c11bd5e08584 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:03.236695 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fb9a673d-2663-42bb-b80b-c11bd5e08584 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:03.237208 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fb9a673d-2663-42bb-b80b-c11bd5e08584 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:03.237951 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fb9a673d-2663-42bb-b80b-c11bd5e08584 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:03.238409 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fb9a673d-2663-42bb-b80b-c11bd5e08584 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:03.238892 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fb9a673d-2663-42bb-b80b-c11bd5e08584 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:03.455823 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:30:03.465483 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-da5b6f6e-2542-4004-afb3-bc008a722380 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/4764c5fc-edb2-41f3-8884-01cd0f2ef3ce" status: 200 len: 1651 microversion: 2.1 time: 1.112391 Aug 10 23:30:03.488480 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2744/5695] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:30:02 2022] GET /compute/v2.1/servers/4764c5fc-edb2-41f3-8884-01cd0f2ef3ce => generated 1651 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:30:03.494064 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-eee671f3-b244-441c-a94b-b51f8a164aa4 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:30:03.495494 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-eee671f3-b244-441c-a94b-b51f8a164aa4 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] [instance: 4764c5fc-edb2-41f3-8884-01cd0f2ef3ce] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:30:03.506050 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-eee671f3-b244-441c-a94b-b51f8a164aa4 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:03.506986 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-eee671f3-b244-441c-a94b-b51f8a164aa4 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:03.507729 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-eee671f3-b244-441c-a94b-b51f8a164aa4 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:03.508707 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-eee671f3-b244-441c-a94b-b51f8a164aa4 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:03.509447 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-eee671f3-b244-441c-a94b-b51f8a164aa4 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:03.510696 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-eee671f3-b244-441c-a94b-b51f8a164aa4 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:03.876648 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-fb9a673d-2663-42bb-b80b-c11bd5e08584 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:30:03.895203 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-fb9a673d-2663-42bb-b80b-c11bd5e08584 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:30:03.896588 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-eee671f3-b244-441c-a94b-b51f8a164aa4 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/4764c5fc-edb2-41f3-8884-01cd0f2ef3ce" status: 200 len: 1651 microversion: 2.1 time: 0.406623 Aug 10 23:30:03.904585 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-fb9a673d-2663-42bb-b80b-c11bd5e08584 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:30:03.910998 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-fb9a673d-2663-42bb-b80b-c11bd5e08584 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "GET /compute/v2.1/servers/e806d719-6292-49a9-ab7b-31397991291d" status: 200 len: 1731 microversion: 2.20 time: 0.696246 Aug 10 23:30:03.912232 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2952/5696] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:30:03 2022] GET /compute/v2.1/servers/e806d719-6292-49a9-ab7b-31397991291d => generated 1731 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:30:03.915231 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2745/5697] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:30:03 2022] GET /compute/v2.1/servers/4764c5fc-edb2-41f3-8884-01cd0f2ef3ce => generated 1651 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:30:03.929765 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-b32121d2-8fa0-41bc-a057-e5a65ad7cceb tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:30:03.931928 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-b32121d2-8fa0-41bc-a057-e5a65ad7cceb tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] [instance: fb59b3c4-bc94-49b7-81e7-7369b70731ad] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:30:03.954393 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b32121d2-8fa0-41bc-a057-e5a65ad7cceb tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:03.954932 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b32121d2-8fa0-41bc-a057-e5a65ad7cceb tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:03.959446 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b32121d2-8fa0-41bc-a057-e5a65ad7cceb tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:03.960997 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b32121d2-8fa0-41bc-a057-e5a65ad7cceb tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:03.967506 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b32121d2-8fa0-41bc-a057-e5a65ad7cceb tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:03.968412 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b32121d2-8fa0-41bc-a057-e5a65ad7cceb tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:04.098701 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-b7953d75-ff0e-42bf-8cd7-719073e11c44 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:30:04.100253 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-b7953d75-ff0e-42bf-8cd7-719073e11c44 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] [instance: d0df5425-46c7-4aa2-81b7-8113347766ad] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:30:04.109546 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b7953d75-ff0e-42bf-8cd7-719073e11c44 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:04.110229 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b7953d75-ff0e-42bf-8cd7-719073e11c44 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:04.121593 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b7953d75-ff0e-42bf-8cd7-719073e11c44 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:04.123907 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b7953d75-ff0e-42bf-8cd7-719073e11c44 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:04.126049 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b7953d75-ff0e-42bf-8cd7-719073e11c44 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:04.127735 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b7953d75-ff0e-42bf-8cd7-719073e11c44 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:04.157626 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-b32121d2-8fa0-41bc-a057-e5a65ad7cceb tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9719cc999ad49b493186b399fb600a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467e718cca3a4fdea39706b1f0241c3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:30:04.168242 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-b32121d2-8fa0-41bc-a057-e5a65ad7cceb tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] 10.222.0.58 "GET /compute/v2.1/servers/fb59b3c4-bc94-49b7-81e7-7369b70731ad" status: 200 len: 1271 microversion: 2.1 time: 0.252908 Aug 10 23:30:04.168845 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2953/5698] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:30:03 2022] GET /compute/v2.1/servers/fb59b3c4-bc94-49b7-81e7-7369b70731ad => generated 1271 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:30:04.214238 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-97846491-f75a-44cb-ab48-375cfa21c225 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1363122906", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452", "availability_zone": "nova:n-h2-850468-14", "networks": [{"uuid": "8ef1ec68-5a6f-4a58-a28b-2257693d5e35"}]}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:30:04.329677 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.network.neutron [None req-97846491-f75a-44cb-ab48-375cfa21c225 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] validate_networks() for [('8ef1ec68-5a6f-4a58-a28b-2257693d5e35', None, None, None, None, None)] {{(pid=122633) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 23:30:04.715790 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-b7953d75-ff0e-42bf-8cd7-719073e11c44 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbea80d59f5840f1899bd3cf601ac8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679d43599f3e4c29ab368a1e54dae608', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:30:04.725322 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-b7953d75-ff0e-42bf-8cd7-719073e11c44 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] 10.222.0.58 "GET /compute/v2.1/servers/d0df5425-46c7-4aa2-81b7-8113347766ad" status: 200 len: 1671 microversion: 2.1 time: 0.630877 Aug 10 23:30:04.727974 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2746/5699] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:30:04 2022] GET /compute/v2.1/servers/d0df5425-46c7-4aa2-81b7-8113347766ad => generated 1671 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:30:04.788288 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-fd73333a-5c2e-46c9-8e9b-e1db5fb125ed req-37a4b3f8-e606-428b-9bb4-1e8c0ede50d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0df5425-46c7-4aa2-81b7-8113347766ad", "name": "network-vif-deleted", "tag": "aa673f43-a995-4dae-b7b0-1c90f9acf05c"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:30:04.804652 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-fd73333a-5c2e-46c9-8e9b-e1db5fb125ed req-37a4b3f8-e606-428b-9bb4-1e8c0ede50d8 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:04.807406 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-fd73333a-5c2e-46c9-8e9b-e1db5fb125ed req-37a4b3f8-e606-428b-9bb4-1e8c0ede50d8 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:04.808171 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-fd73333a-5c2e-46c9-8e9b-e1db5fb125ed req-37a4b3f8-e606-428b-9bb4-1e8c0ede50d8 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:04.837276 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-fd73333a-5c2e-46c9-8e9b-e1db5fb125ed req-37a4b3f8-e606-428b-9bb4-1e8c0ede50d8 service nova] Creating event network-vif-deleted:aa673f43-a995-4dae-b7b0-1c90f9acf05c for instance d0df5425-46c7-4aa2-81b7-8113347766ad on n-h1-850468-14 Aug 10 23:30:04.845681 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-fd73333a-5c2e-46c9-8e9b-e1db5fb125ed req-37a4b3f8-e606-428b-9bb4-1e8c0ede50d8 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060855 Aug 10 23:30:04.847467 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2747/5700] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:30:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:30:04.940538 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-a7352ac0-5a61-4c49-badd-0f19d3aa974a tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:30:04.941834 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-a7352ac0-5a61-4c49-badd-0f19d3aa974a tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: e806d719-6292-49a9-ab7b-31397991291d] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:30:04.956624 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a7352ac0-5a61-4c49-badd-0f19d3aa974a tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:04.957447 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a7352ac0-5a61-4c49-badd-0f19d3aa974a tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:04.958261 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a7352ac0-5a61-4c49-badd-0f19d3aa974a tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:04.961285 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a7352ac0-5a61-4c49-badd-0f19d3aa974a tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:04.963367 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a7352ac0-5a61-4c49-badd-0f19d3aa974a tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:04.964019 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a7352ac0-5a61-4c49-badd-0f19d3aa974a tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:05.333195 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-97846491-f75a-44cb-ab48-375cfa21c225 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Flavor limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:30:05.333796 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-97846491-f75a-44cb-ab48-375cfa21c225 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Image limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:30:05.334080 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-97846491-f75a-44cb-ab48-375cfa21c225 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Flavor pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:30:05.334494 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-97846491-f75a-44cb-ab48-375cfa21c225 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Image pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:30:05.334931 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-97846491-f75a-44cb-ab48-375cfa21c225 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:30:05.346229 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-97846491-f75a-44cb-ab48-375cfa21c225 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:05.346703 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-97846491-f75a-44cb-ab48-375cfa21c225 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:05.347529 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-97846491-f75a-44cb-ab48-375cfa21c225 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:05.348627 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-97846491-f75a-44cb-ab48-375cfa21c225 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:05.349244 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-97846491-f75a-44cb-ab48-375cfa21c225 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:05.350015 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-97846491-f75a-44cb-ab48-375cfa21c225 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:05.372807 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-97846491-f75a-44cb-ab48-375cfa21c225 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Getting quotas for project 05776e7992c34fc6af2152359b7887ba. Resources: {'instances', 'cores', 'ram'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:30:05.393199 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-97846491-f75a-44cb-ab48-375cfa21c225 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Getting quotas for user be5ac707f42345efa61f1b7d43b3aa7d and project 05776e7992c34fc6af2152359b7887ba. Resources: {'instances', 'cores', 'ram'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:30:05.435614 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-97846491-f75a-44cb-ab48-375cfa21c225 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Going to run 1 instances... {{(pid=122633) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 23:30:05.440911 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-97846491-f75a-44cb-ab48-375cfa21c225 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] [instance: 366872ea-7465-47d1-a82c-37e597a5355a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78ad8905-f66f-4733-8be9-2b260f1fabed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122633) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 23:30:05.501422 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-a7352ac0-5a61-4c49-badd-0f19d3aa974a tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:30:05.510443 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-a7352ac0-5a61-4c49-badd-0f19d3aa974a tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:30:05.522745 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-a7352ac0-5a61-4c49-badd-0f19d3aa974a tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:30:05.526239 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-a7352ac0-5a61-4c49-badd-0f19d3aa974a tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "GET /compute/v2.1/servers/e806d719-6292-49a9-ab7b-31397991291d" status: 200 len: 1731 microversion: 2.20 time: 0.595055 Aug 10 23:30:05.529549 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2748/5701] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:30:04 2022] GET /compute/v2.1/servers/e806d719-6292-49a9-ab7b-31397991291d => generated 1731 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:30:05.539520 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-84260711-79b5-4994-87c4-3aba1a9ecb7c tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:30:05.541689 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-97846491-f75a-44cb-ab48-375cfa21c225 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.329175 Aug 10 23:30:05.545627 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-84260711-79b5-4994-87c4-3aba1a9ecb7c tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] [instance: fb59b3c4-bc94-49b7-81e7-7369b70731ad] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:30:05.558810 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-84260711-79b5-4994-87c4-3aba1a9ecb7c tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:05.567960 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2954/5702] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 23:30:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 1352 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 23:30:05.571602 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-84260711-79b5-4994-87c4-3aba1a9ecb7c tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:05.574038 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-84260711-79b5-4994-87c4-3aba1a9ecb7c tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:05.577809 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-84260711-79b5-4994-87c4-3aba1a9ecb7c tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:05.580844 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-84260711-79b5-4994-87c4-3aba1a9ecb7c tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:05.581536 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-84260711-79b5-4994-87c4-3aba1a9ecb7c tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:05.588951 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-a623fe8c-5d37-4bac-a1bc-ff85b322672b tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:30:05.592215 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-a623fe8c-5d37-4bac-a1bc-ff85b322672b tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] [instance: 366872ea-7465-47d1-a82c-37e597a5355a] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:30:05.700105 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-a623fe8c-5d37-4bac-a1bc-ff85b322672b tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/366872ea-7465-47d1-a82c-37e597a5355a" status: 200 len: 1329 microversion: 2.1 time: 0.130085 Aug 10 23:30:05.701179 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2955/5703] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:30:05 2022] GET /compute/v2.1/servers/366872ea-7465-47d1-a82c-37e597a5355a => generated 1329 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:30:05.759122 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-4b995854-ec75-46ca-ba79-06daa7a1eaeb tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:30:05.760017 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-4b995854-ec75-46ca-ba79-06daa7a1eaeb tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] [instance: d0df5425-46c7-4aa2-81b7-8113347766ad] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:30:05.763356 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=9,nova_api:DELETE=1 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:30:05.784877 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4b995854-ec75-46ca-ba79-06daa7a1eaeb tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:05.787682 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4b995854-ec75-46ca-ba79-06daa7a1eaeb tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:05.788458 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4b995854-ec75-46ca-ba79-06daa7a1eaeb tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:05.791340 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4b995854-ec75-46ca-ba79-06daa7a1eaeb tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:05.792312 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4b995854-ec75-46ca-ba79-06daa7a1eaeb tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:05.793862 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4b995854-ec75-46ca-ba79-06daa7a1eaeb tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:05.826378 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-4b995854-ec75-46ca-ba79-06daa7a1eaeb tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] HTTP exception thrown: Instance d0df5425-46c7-4aa2-81b7-8113347766ad could not be found. Aug 10 23:30:05.833457 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-4b995854-ec75-46ca-ba79-06daa7a1eaeb tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Request method failure captured: Aug 10 23:30:05.833457 n-d-850468-14 devstack@n-api.service[122633]: request: GET /compute/v2.1/servers/d0df5425-46c7-4aa2-81b7-8113347766ad HTTP/1.1 Aug 10 23:30:05.833457 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:30:05.833457 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:30:05.833457 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:30:05.833457 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:30:05.833457 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:30:05.833457 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:30:05.833457 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:30:05.833457 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:30:05.833457 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9D7xLbha89w4RFaA9WPNaubQudJCDUCb2VIWrKN08Pzedq3777Uk6apcHRNC0PbYtg_8fiEC_kC7gcTZrYMB40oQ4tWtRHjNsjVhrAhgAjKtaVvY3fCimK_NUEVEN-LM6c7t9R8XmEcJtm2mVIxpdgzackpaZxyyUWdyDfNvRMaAbQo Aug 10 23:30:05.833457 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:30:05.833457 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:30:05.833457 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:30:05.833457 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:30:05.833457 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:30:05.833457 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:30:05.833457 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 679d43599f3e4c29ab368a1e54dae608 Aug 10 23:30:05.833457 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-TestNetworkBasicOps-1961993656 Aug 10 23:30:05.833457 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:30:05.833457 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:30:05.833457 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/679d43599f3e4c29ab368a1e54dae608"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/679d43599f3e4c29ab368a1e54dae608"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/679d43599f3e4c29ab368a1e54dae608"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_679d43599f3e4c29ab368a1e54dae608", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:30:05.833457 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-TestNetworkBasicOps-1961993656 Aug 10 23:30:05.833457 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 679d43599f3e4c29ab368a1e54dae608 Aug 10 23:30:05.833457 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-TestNetworkBasicOps-1961993656 Aug 10 23:30:05.833457 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-TestNetworkBasicOps-1961993656-project Aug 10 23:30:05.833457 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:30:05.833457 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:30:05.833457 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: fbea80d59f5840f1899bd3cf601ac8bf Aug 10 23:30:05.833457 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-TestNetworkBasicOps-1961993656-project Aug 10 23:30:05.833457 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:30:05.833457 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance d0df5425-46c7-4aa2-81b7-8113347766ad could not be found. Aug 10 23:30:05.833457 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': 'd0df5425-46c7-4aa2-81b7-8113347766ad'} Aug 10 23:30:05.833457 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:30:05.833457 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:30:05.833457 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:30:05.833457 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:30:05.833457 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:30:05.833457 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:30:05.833457 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:30:05.833457 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:30:05.833457 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:30:05.833457 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:30:05.833457 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0df5425-46c7-4aa2-81b7-8113347766ad could not be found. Aug 10 23:30:05.833457 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:30:05.833457 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:30:05.833457 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:30:05.833457 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:30:05.833457 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:30:05.833457 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:30:05.833457 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:30:05.833457 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:30:05.833457 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:30:05.833457 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:30:05.833457 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:30:05.833457 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:30:05.833457 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:30:05.833457 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:30:05.833457 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:30:05.833457 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:30:05.833457 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0df5425-46c7-4aa2-81b7-8113347766ad could not be found. Aug 10 23:30:05.833457 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:30:05.833457 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:30:05.833457 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:30:05.841089 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:30:05.841089 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:30:05.841089 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:30:05.841089 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:30:05.841089 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:30:05.841089 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0df5425-46c7-4aa2-81b7-8113347766ad could not be found. Aug 10 23:30:05.841089 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:30:05.841089 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-4b995854-ec75-46ca-ba79-06daa7a1eaeb tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Returning 404 to user: Instance d0df5425-46c7-4aa2-81b7-8113347766ad could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:30:05.841089 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-4b995854-ec75-46ca-ba79-06daa7a1eaeb tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] 10.222.0.58 "GET /compute/v2.1/servers/d0df5425-46c7-4aa2-81b7-8113347766ad" status: 404 len: 111 microversion: 2.1 time: 0.084068 Aug 10 23:30:05.841089 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2956/5704] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:30:05 2022] GET /compute/v2.1/servers/d0df5425-46c7-4aa2-81b7-8113347766ad => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:30:06.189563 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-84260711-79b5-4994-87c4-3aba1a9ecb7c tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9719cc999ad49b493186b399fb600a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467e718cca3a4fdea39706b1f0241c3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:30:06.209796 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-84260711-79b5-4994-87c4-3aba1a9ecb7c tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] 10.222.0.58 "GET /compute/v2.1/servers/fb59b3c4-bc94-49b7-81e7-7369b70731ad" status: 200 len: 1313 microversion: 2.1 time: 0.677491 Aug 10 23:30:06.211676 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2749/5705] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:30:05 2022] GET /compute/v2.1/servers/fb59b3c4-bc94-49b7-81e7-7369b70731ad => generated 1313 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:30:06.245919 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-fdf54e9d-f6f5-4e2f-a02b-d0e22988c827 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Calling method '.version_select at 0x7f847c029280>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:30:06.310551 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-fdf54e9d-f6f5-4e2f-a02b-d0e22988c827 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1154531619" status: 202 len: 0 microversion: 2.1 time: 0.068442 Aug 10 23:30:06.315518 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2957/5706] 10.222.0.58 () {58 vars in 1257 bytes} [Wed Aug 10 23:30:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1154531619 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:30:06.557058 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-9f847061-23ca-4fdb-b358-9caff3180445 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:30:06.557058 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-9f847061-23ca-4fdb-b358-9caff3180445 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: e806d719-6292-49a9-ab7b-31397991291d] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:30:06.569837 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9f847061-23ca-4fdb-b358-9caff3180445 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:06.573679 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9f847061-23ca-4fdb-b358-9caff3180445 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:06.574562 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9f847061-23ca-4fdb-b358-9caff3180445 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:06.575836 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9f847061-23ca-4fdb-b358-9caff3180445 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:06.576571 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9f847061-23ca-4fdb-b358-9caff3180445 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:06.579796 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9f847061-23ca-4fdb-b358-9caff3180445 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:06.723614 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-f27cf728-c1ff-4160-a6f7-739e614c8ebf tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:30:06.725026 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-f27cf728-c1ff-4160-a6f7-739e614c8ebf tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] [instance: 366872ea-7465-47d1-a82c-37e597a5355a] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:30:06.740549 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f27cf728-c1ff-4160-a6f7-739e614c8ebf tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:06.743444 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f27cf728-c1ff-4160-a6f7-739e614c8ebf tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:06.745066 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f27cf728-c1ff-4160-a6f7-739e614c8ebf tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:06.747421 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f27cf728-c1ff-4160-a6f7-739e614c8ebf tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:06.749087 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f27cf728-c1ff-4160-a6f7-739e614c8ebf tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:06.752214 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f27cf728-c1ff-4160-a6f7-739e614c8ebf tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:06.901090 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-f27cf728-c1ff-4160-a6f7-739e614c8ebf tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/366872ea-7465-47d1-a82c-37e597a5355a" status: 200 len: 1346 microversion: 2.1 time: 0.182246 Aug 10 23:30:06.908081 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2958/5707] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:30:06 2022] GET /compute/v2.1/servers/366872ea-7465-47d1-a82c-37e597a5355a => generated 1346 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:30:07.172249 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-9f847061-23ca-4fdb-b358-9caff3180445 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:30:07.196379 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-9f847061-23ca-4fdb-b358-9caff3180445 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:30:07.202042 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-9f847061-23ca-4fdb-b358-9caff3180445 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:30:07.208565 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-9f847061-23ca-4fdb-b358-9caff3180445 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "GET /compute/v2.1/servers/e806d719-6292-49a9-ab7b-31397991291d" status: 200 len: 1731 microversion: 2.20 time: 0.660182 Aug 10 23:30:07.215734 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2750/5708] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:30:06 2022] GET /compute/v2.1/servers/e806d719-6292-49a9-ab7b-31397991291d => generated 1731 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:30:07.241612 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-62bcc44f-c4f8-44b0-b803-2b1c390a84d4 tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:30:07.242248 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-62bcc44f-c4f8-44b0-b803-2b1c390a84d4 tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] [instance: fb59b3c4-bc94-49b7-81e7-7369b70731ad] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:30:07.251473 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-62bcc44f-c4f8-44b0-b803-2b1c390a84d4 tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:07.252307 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-62bcc44f-c4f8-44b0-b803-2b1c390a84d4 tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:07.254200 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-62bcc44f-c4f8-44b0-b803-2b1c390a84d4 tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:07.255589 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-62bcc44f-c4f8-44b0-b803-2b1c390a84d4 tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:07.256241 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-62bcc44f-c4f8-44b0-b803-2b1c390a84d4 tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:07.256861 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-62bcc44f-c4f8-44b0-b803-2b1c390a84d4 tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:07.691476 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-62bcc44f-c4f8-44b0-b803-2b1c390a84d4 tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9719cc999ad49b493186b399fb600a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467e718cca3a4fdea39706b1f0241c3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:30:07.704965 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-62bcc44f-c4f8-44b0-b803-2b1c390a84d4 tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] 10.222.0.58 "GET /compute/v2.1/servers/fb59b3c4-bc94-49b7-81e7-7369b70731ad" status: 200 len: 1313 microversion: 2.1 time: 0.467980 Aug 10 23:30:07.717462 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2959/5709] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:30:07 2022] GET /compute/v2.1/servers/fb59b3c4-bc94-49b7-81e7-7369b70731ad => generated 1313 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:30:07.931451 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-b033abb7-f9e1-4c35-bdd7-b0d1c8392313 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:30:07.931990 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-b033abb7-f9e1-4c35-bdd7-b0d1c8392313 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] [instance: 366872ea-7465-47d1-a82c-37e597a5355a] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:30:07.959377 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b033abb7-f9e1-4c35-bdd7-b0d1c8392313 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:07.959377 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b033abb7-f9e1-4c35-bdd7-b0d1c8392313 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:07.959377 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b033abb7-f9e1-4c35-bdd7-b0d1c8392313 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:07.959377 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b033abb7-f9e1-4c35-bdd7-b0d1c8392313 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:07.959377 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b033abb7-f9e1-4c35-bdd7-b0d1c8392313 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:07.959377 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b033abb7-f9e1-4c35-bdd7-b0d1c8392313 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:08.044098 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-c7f729d9-1c81-4c84-96d3-ef3b94a72753 req-d76c8b09-7353-42b9-9ea6-77952babfa4d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb59b3c4-bc94-49b7-81e7-7369b70731ad", "tag": "95cd155a-7c45-491c-b557-d94fd3702092"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:30:08.075646 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-c7f729d9-1c81-4c84-96d3-ef3b94a72753 req-d76c8b09-7353-42b9-9ea6-77952babfa4d service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:08.076137 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-c7f729d9-1c81-4c84-96d3-ef3b94a72753 req-d76c8b09-7353-42b9-9ea6-77952babfa4d service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:08.076580 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-c7f729d9-1c81-4c84-96d3-ef3b94a72753 req-d76c8b09-7353-42b9-9ea6-77952babfa4d service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:08.114913 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-c7f729d9-1c81-4c84-96d3-ef3b94a72753 req-d76c8b09-7353-42b9-9ea6-77952babfa4d service nova] Creating event network-changed:95cd155a-7c45-491c-b557-d94fd3702092 for instance fb59b3c4-bc94-49b7-81e7-7369b70731ad on n-h2-850468-14 Aug 10 23:30:08.120482 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-c7f729d9-1c81-4c84-96d3-ef3b94a72753 req-d76c8b09-7353-42b9-9ea6-77952babfa4d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080213 Aug 10 23:30:08.121092 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2960/5710] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:30:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:30:08.122580 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-b033abb7-f9e1-4c35-bdd7-b0d1c8392313 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/366872ea-7465-47d1-a82c-37e597a5355a" status: 200 len: 1418 microversion: 2.1 time: 0.193343 Aug 10 23:30:08.124004 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2751/5711] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:30:07 2022] GET /compute/v2.1/servers/366872ea-7465-47d1-a82c-37e597a5355a => generated 1418 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:30:08.243197 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-e9dcf892-298d-4670-9373-be0a85f1a120 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:30:08.244080 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-e9dcf892-298d-4670-9373-be0a85f1a120 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: e806d719-6292-49a9-ab7b-31397991291d] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:30:08.262410 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e9dcf892-298d-4670-9373-be0a85f1a120 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:08.263089 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e9dcf892-298d-4670-9373-be0a85f1a120 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:08.263692 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e9dcf892-298d-4670-9373-be0a85f1a120 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:08.268095 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e9dcf892-298d-4670-9373-be0a85f1a120 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:08.268721 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e9dcf892-298d-4670-9373-be0a85f1a120 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:08.269272 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e9dcf892-298d-4670-9373-be0a85f1a120 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:08.726156 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-a0ced65a-7898-48e7-9209-72a4fe70cfec tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:30:08.726950 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-a0ced65a-7898-48e7-9209-72a4fe70cfec tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] [instance: fb59b3c4-bc94-49b7-81e7-7369b70731ad] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:30:08.733738 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a0ced65a-7898-48e7-9209-72a4fe70cfec tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:08.734637 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a0ced65a-7898-48e7-9209-72a4fe70cfec tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:08.735689 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a0ced65a-7898-48e7-9209-72a4fe70cfec tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:08.736764 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a0ced65a-7898-48e7-9209-72a4fe70cfec tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:08.737390 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a0ced65a-7898-48e7-9209-72a4fe70cfec tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:08.737974 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a0ced65a-7898-48e7-9209-72a4fe70cfec tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:08.815145 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-e9dcf892-298d-4670-9373-be0a85f1a120 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:30:08.835765 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-e9dcf892-298d-4670-9373-be0a85f1a120 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:30:08.839949 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-e9dcf892-298d-4670-9373-be0a85f1a120 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:30:08.841809 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-e9dcf892-298d-4670-9373-be0a85f1a120 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "GET /compute/v2.1/servers/e806d719-6292-49a9-ab7b-31397991291d" status: 200 len: 1731 microversion: 2.20 time: 0.603826 Aug 10 23:30:08.843681 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2961/5712] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:30:08 2022] GET /compute/v2.1/servers/e806d719-6292-49a9-ab7b-31397991291d => generated 1731 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:30:08.961127 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-a0ced65a-7898-48e7-9209-72a4fe70cfec tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9719cc999ad49b493186b399fb600a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467e718cca3a4fdea39706b1f0241c3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:30:08.971109 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-a0ced65a-7898-48e7-9209-72a4fe70cfec tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] 10.222.0.58 "GET /compute/v2.1/servers/fb59b3c4-bc94-49b7-81e7-7369b70731ad" status: 200 len: 1313 microversion: 2.1 time: 0.248724 Aug 10 23:30:08.971883 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2752/5713] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:30:08 2022] GET /compute/v2.1/servers/fb59b3c4-bc94-49b7-81e7-7369b70731ad => generated 1313 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:30:09.150079 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-43859f60-4263-4d24-a842-f2368c7bdd95 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:30:09.151811 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-43859f60-4263-4d24-a842-f2368c7bdd95 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] [instance: 366872ea-7465-47d1-a82c-37e597a5355a] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:30:09.159640 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-43859f60-4263-4d24-a842-f2368c7bdd95 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:09.160143 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-43859f60-4263-4d24-a842-f2368c7bdd95 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:09.160879 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-43859f60-4263-4d24-a842-f2368c7bdd95 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:09.161869 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-43859f60-4263-4d24-a842-f2368c7bdd95 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:09.162406 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-43859f60-4263-4d24-a842-f2368c7bdd95 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:09.163144 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-43859f60-4263-4d24-a842-f2368c7bdd95 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:09.294582 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-43859f60-4263-4d24-a842-f2368c7bdd95 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/366872ea-7465-47d1-a82c-37e597a5355a" status: 200 len: 1418 microversion: 2.1 time: 0.149158 Aug 10 23:30:09.295584 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2962/5714] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:30:09 2022] GET /compute/v2.1/servers/366872ea-7465-47d1-a82c-37e597a5355a => generated 1418 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:30:09.865847 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-0bfde22e-dc98-4876-b2df-3b75da675238 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:30:09.866453 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-0bfde22e-dc98-4876-b2df-3b75da675238 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: e806d719-6292-49a9-ab7b-31397991291d] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:30:09.878586 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0bfde22e-dc98-4876-b2df-3b75da675238 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:09.879127 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0bfde22e-dc98-4876-b2df-3b75da675238 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:09.879549 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0bfde22e-dc98-4876-b2df-3b75da675238 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:09.880258 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0bfde22e-dc98-4876-b2df-3b75da675238 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:09.880810 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0bfde22e-dc98-4876-b2df-3b75da675238 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:09.881256 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0bfde22e-dc98-4876-b2df-3b75da675238 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:09.992020 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-4eb283f1-04b2-4284-ac26-78d7d8e86082 tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:30:09.992936 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-4eb283f1-04b2-4284-ac26-78d7d8e86082 tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] [instance: fb59b3c4-bc94-49b7-81e7-7369b70731ad] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:30:09.999595 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4eb283f1-04b2-4284-ac26-78d7d8e86082 tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:10.000472 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4eb283f1-04b2-4284-ac26-78d7d8e86082 tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:10.001332 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4eb283f1-04b2-4284-ac26-78d7d8e86082 tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:10.002670 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4eb283f1-04b2-4284-ac26-78d7d8e86082 tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:10.003337 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4eb283f1-04b2-4284-ac26-78d7d8e86082 tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:10.004119 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4eb283f1-04b2-4284-ac26-78d7d8e86082 tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:10.240181 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-4eb283f1-04b2-4284-ac26-78d7d8e86082 tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9719cc999ad49b493186b399fb600a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467e718cca3a4fdea39706b1f0241c3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:30:10.249438 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-4eb283f1-04b2-4284-ac26-78d7d8e86082 tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] 10.222.0.58 "GET /compute/v2.1/servers/fb59b3c4-bc94-49b7-81e7-7369b70731ad" status: 200 len: 1313 microversion: 2.1 time: 0.261019 Aug 10 23:30:10.265307 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2963/5715] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:30:09 2022] GET /compute/v2.1/servers/fb59b3c4-bc94-49b7-81e7-7369b70731ad => generated 1313 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:30:10.319076 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-e377f5d7-3f12-47db-a79f-352781698eca tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:30:10.319980 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-e377f5d7-3f12-47db-a79f-352781698eca tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] [instance: 366872ea-7465-47d1-a82c-37e597a5355a] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:30:10.327505 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e377f5d7-3f12-47db-a79f-352781698eca tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:10.328315 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e377f5d7-3f12-47db-a79f-352781698eca tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:10.329173 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e377f5d7-3f12-47db-a79f-352781698eca tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:10.329906 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e377f5d7-3f12-47db-a79f-352781698eca tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:10.330370 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e377f5d7-3f12-47db-a79f-352781698eca tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:10.330822 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e377f5d7-3f12-47db-a79f-352781698eca tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:10.436969 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-e377f5d7-3f12-47db-a79f-352781698eca tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/366872ea-7465-47d1-a82c-37e597a5355a" status: 200 len: 1436 microversion: 2.1 time: 0.121859 Aug 10 23:30:10.440940 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2964/5716] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:30:10 2022] GET /compute/v2.1/servers/366872ea-7465-47d1-a82c-37e597a5355a => generated 1436 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:30:10.638649 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-0bfde22e-dc98-4876-b2df-3b75da675238 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:30:10.650477 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-0bfde22e-dc98-4876-b2df-3b75da675238 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:30:10.652102 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-0bfde22e-dc98-4876-b2df-3b75da675238 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:30:10.653289 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-0bfde22e-dc98-4876-b2df-3b75da675238 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "GET /compute/v2.1/servers/e806d719-6292-49a9-ab7b-31397991291d" status: 200 len: 1731 microversion: 2.20 time: 0.791414 Aug 10 23:30:10.653861 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2753/5717] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:30:09 2022] GET /compute/v2.1/servers/e806d719-6292-49a9-ab7b-31397991291d => generated 1731 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:30:11.275851 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-068878d7-101b-4c43-905e-a9056ba54bb9 tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:30:11.276805 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-068878d7-101b-4c43-905e-a9056ba54bb9 tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] [instance: fb59b3c4-bc94-49b7-81e7-7369b70731ad] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:30:11.288687 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-068878d7-101b-4c43-905e-a9056ba54bb9 tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:11.289477 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-068878d7-101b-4c43-905e-a9056ba54bb9 tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:11.311363 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-068878d7-101b-4c43-905e-a9056ba54bb9 tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:11.313274 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-068878d7-101b-4c43-905e-a9056ba54bb9 tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:11.315022 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-068878d7-101b-4c43-905e-a9056ba54bb9 tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:11.316758 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-068878d7-101b-4c43-905e-a9056ba54bb9 tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:11.467372 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-925772fa-08ac-42db-a350-87750ac6a821 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:30:11.471913 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-925772fa-08ac-42db-a350-87750ac6a821 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] [instance: 366872ea-7465-47d1-a82c-37e597a5355a] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:30:11.509140 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-925772fa-08ac-42db-a350-87750ac6a821 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:11.509984 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-925772fa-08ac-42db-a350-87750ac6a821 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:11.513570 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-925772fa-08ac-42db-a350-87750ac6a821 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:11.514926 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-925772fa-08ac-42db-a350-87750ac6a821 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:11.515613 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-925772fa-08ac-42db-a350-87750ac6a821 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:11.517119 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-925772fa-08ac-42db-a350-87750ac6a821 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:11.932865 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-068878d7-101b-4c43-905e-a9056ba54bb9 tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9719cc999ad49b493186b399fb600a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467e718cca3a4fdea39706b1f0241c3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:30:11.944250 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-068878d7-101b-4c43-905e-a9056ba54bb9 tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] 10.222.0.58 "GET /compute/v2.1/servers/fb59b3c4-bc94-49b7-81e7-7369b70731ad" status: 200 len: 1313 microversion: 2.1 time: 0.675095 Aug 10 23:30:11.944860 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2965/5718] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:30:11 2022] GET /compute/v2.1/servers/fb59b3c4-bc94-49b7-81e7-7369b70731ad => generated 1313 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:30:11.962401 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-dd540425-76f3-4449-841b-0e2afe877aca tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:30:11.963178 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-dd540425-76f3-4449-841b-0e2afe877aca tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: e806d719-6292-49a9-ab7b-31397991291d] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:30:11.974035 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dd540425-76f3-4449-841b-0e2afe877aca tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:11.974595 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dd540425-76f3-4449-841b-0e2afe877aca tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:11.975079 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dd540425-76f3-4449-841b-0e2afe877aca tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:11.975800 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dd540425-76f3-4449-841b-0e2afe877aca tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:11.976263 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dd540425-76f3-4449-841b-0e2afe877aca tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:11.976698 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dd540425-76f3-4449-841b-0e2afe877aca tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:12.213712 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-925772fa-08ac-42db-a350-87750ac6a821 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/366872ea-7465-47d1-a82c-37e597a5355a" status: 200 len: 1466 microversion: 2.1 time: 0.755250 Aug 10 23:30:12.223480 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2754/5719] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:30:11 2022] GET /compute/v2.1/servers/366872ea-7465-47d1-a82c-37e597a5355a => generated 1466 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:30:12.291648 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-dd540425-76f3-4449-841b-0e2afe877aca tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:30:12.305504 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-dd540425-76f3-4449-841b-0e2afe877aca tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:30:12.306925 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-dd540425-76f3-4449-841b-0e2afe877aca tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:30:12.308161 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-dd540425-76f3-4449-841b-0e2afe877aca tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "GET /compute/v2.1/servers/e806d719-6292-49a9-ab7b-31397991291d" status: 200 len: 1731 microversion: 2.20 time: 0.362360 Aug 10 23:30:12.322510 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2966/5720] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:30:11 2022] GET /compute/v2.1/servers/e806d719-6292-49a9-ab7b-31397991291d => generated 1731 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:30:12.976626 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-c9c6aba0-edea-4447-9959-a3b788643f55 req-c36bffe6-0b92-41d4-a4ed-9f8ed6648783 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "366872ea-7465-47d1-a82c-37e597a5355a", "tag": "4af9cb9b-a10d-4867-b226-1318266049e9"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:30:12.980566 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-ceb69c34-f1c4-41dd-b91b-cd7ca293817c tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:30:12.983351 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-ceb69c34-f1c4-41dd-b91b-cd7ca293817c tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] [instance: fb59b3c4-bc94-49b7-81e7-7369b70731ad] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:30:13.007342 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ceb69c34-f1c4-41dd-b91b-cd7ca293817c tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:13.011359 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ceb69c34-f1c4-41dd-b91b-cd7ca293817c tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:13.013541 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ceb69c34-f1c4-41dd-b91b-cd7ca293817c tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:13.017498 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ceb69c34-f1c4-41dd-b91b-cd7ca293817c tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:13.018495 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ceb69c34-f1c4-41dd-b91b-cd7ca293817c tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:13.019530 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-c9c6aba0-edea-4447-9959-a3b788643f55 req-c36bffe6-0b92-41d4-a4ed-9f8ed6648783 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:13.020322 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ceb69c34-f1c4-41dd-b91b-cd7ca293817c tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:13.021044 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-c9c6aba0-edea-4447-9959-a3b788643f55 req-c36bffe6-0b92-41d4-a4ed-9f8ed6648783 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:13.023944 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-c9c6aba0-edea-4447-9959-a3b788643f55 req-c36bffe6-0b92-41d4-a4ed-9f8ed6648783 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:13.046423 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-c9c6aba0-edea-4447-9959-a3b788643f55 req-c36bffe6-0b92-41d4-a4ed-9f8ed6648783 service nova] Creating event network-changed:4af9cb9b-a10d-4867-b226-1318266049e9 for instance 366872ea-7465-47d1-a82c-37e597a5355a on n-h2-850468-14 Aug 10 23:30:13.052393 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-c9c6aba0-edea-4447-9959-a3b788643f55 req-c36bffe6-0b92-41d4-a4ed-9f8ed6648783 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080369 Aug 10 23:30:13.057706 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2967/5721] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:30:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 23:30:13.246302 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-a04801a5-e734-497a-86b6-e2f3be56cc09 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:30:13.247343 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-a04801a5-e734-497a-86b6-e2f3be56cc09 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] [instance: 366872ea-7465-47d1-a82c-37e597a5355a] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:30:13.254878 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a04801a5-e734-497a-86b6-e2f3be56cc09 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:13.255521 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a04801a5-e734-497a-86b6-e2f3be56cc09 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:13.255969 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a04801a5-e734-497a-86b6-e2f3be56cc09 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:13.256869 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a04801a5-e734-497a-86b6-e2f3be56cc09 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:13.257341 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a04801a5-e734-497a-86b6-e2f3be56cc09 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:13.257767 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a04801a5-e734-497a-86b6-e2f3be56cc09 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:13.348250 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-ceb69c34-f1c4-41dd-b91b-cd7ca293817c tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9719cc999ad49b493186b399fb600a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467e718cca3a4fdea39706b1f0241c3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:30:13.366502 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-ceb69c34-f1c4-41dd-b91b-cd7ca293817c tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] 10.222.0.58 "GET /compute/v2.1/servers/fb59b3c4-bc94-49b7-81e7-7369b70731ad" status: 200 len: 1313 microversion: 2.1 time: 0.400175 Aug 10 23:30:13.381387 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2755/5722] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:30:12 2022] GET /compute/v2.1/servers/fb59b3c4-bc94-49b7-81e7-7369b70731ad => generated 1313 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:30:13.393317 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-34332e87-9dab-4ef1-99ac-dc86180afe1e tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:30:13.394839 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-34332e87-9dab-4ef1-99ac-dc86180afe1e tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: e806d719-6292-49a9-ab7b-31397991291d] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:30:13.411738 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-34332e87-9dab-4ef1-99ac-dc86180afe1e tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:13.413094 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-34332e87-9dab-4ef1-99ac-dc86180afe1e tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:13.413641 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-34332e87-9dab-4ef1-99ac-dc86180afe1e tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:13.414466 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-34332e87-9dab-4ef1-99ac-dc86180afe1e tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:13.415190 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-34332e87-9dab-4ef1-99ac-dc86180afe1e tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:13.415911 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-34332e87-9dab-4ef1-99ac-dc86180afe1e tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:13.643591 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-a04801a5-e734-497a-86b6-e2f3be56cc09 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/366872ea-7465-47d1-a82c-37e597a5355a" status: 200 len: 1466 microversion: 2.1 time: 0.402750 Aug 10 23:30:13.644208 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2968/5723] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:30:13 2022] GET /compute/v2.1/servers/366872ea-7465-47d1-a82c-37e597a5355a => generated 1466 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:30:13.759739 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-34332e87-9dab-4ef1-99ac-dc86180afe1e tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:30:13.769581 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-34332e87-9dab-4ef1-99ac-dc86180afe1e tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:30:13.771570 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-34332e87-9dab-4ef1-99ac-dc86180afe1e tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:30:13.773049 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-34332e87-9dab-4ef1-99ac-dc86180afe1e tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "GET /compute/v2.1/servers/e806d719-6292-49a9-ab7b-31397991291d" status: 200 len: 1731 microversion: 2.20 time: 0.392129 Aug 10 23:30:13.773885 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2756/5724] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:30:13 2022] GET /compute/v2.1/servers/e806d719-6292-49a9-ab7b-31397991291d => generated 1731 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:30:14.388788 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-82733c84-42e8-4b49-b016-27aa1b04f40c tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:30:14.389822 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-82733c84-42e8-4b49-b016-27aa1b04f40c tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] [instance: fb59b3c4-bc94-49b7-81e7-7369b70731ad] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:30:14.398065 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-82733c84-42e8-4b49-b016-27aa1b04f40c tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:14.399172 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-82733c84-42e8-4b49-b016-27aa1b04f40c tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:14.399853 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-82733c84-42e8-4b49-b016-27aa1b04f40c tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:14.400824 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-82733c84-42e8-4b49-b016-27aa1b04f40c tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:14.401511 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-82733c84-42e8-4b49-b016-27aa1b04f40c tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:14.402191 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-82733c84-42e8-4b49-b016-27aa1b04f40c tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:14.665778 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-1b0b7c9f-3bfa-4586-9e81-7003626ec98d tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:30:14.667177 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-1b0b7c9f-3bfa-4586-9e81-7003626ec98d tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] [instance: 366872ea-7465-47d1-a82c-37e597a5355a] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:30:14.675694 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=3 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:30:14.677794 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1b0b7c9f-3bfa-4586-9e81-7003626ec98d tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:14.679645 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1b0b7c9f-3bfa-4586-9e81-7003626ec98d tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:14.680760 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1b0b7c9f-3bfa-4586-9e81-7003626ec98d tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:14.682135 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1b0b7c9f-3bfa-4586-9e81-7003626ec98d tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:14.682843 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1b0b7c9f-3bfa-4586-9e81-7003626ec98d tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:14.683438 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1b0b7c9f-3bfa-4586-9e81-7003626ec98d tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:14.920186 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-1b0b7c9f-3bfa-4586-9e81-7003626ec98d tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/366872ea-7465-47d1-a82c-37e597a5355a" status: 200 len: 1466 microversion: 2.1 time: 0.257868 Aug 10 23:30:14.921243 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2757/5725] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:30:14 2022] GET /compute/v2.1/servers/366872ea-7465-47d1-a82c-37e597a5355a => generated 1466 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:30:14.927419 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-60fc7a16-e79e-49e8-97e1-f737591aa83c tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:30:14.929754 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-60fc7a16-e79e-49e8-97e1-f737591aa83c tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: e806d719-6292-49a9-ab7b-31397991291d] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:30:14.940852 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-82733c84-42e8-4b49-b016-27aa1b04f40c tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9719cc999ad49b493186b399fb600a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467e718cca3a4fdea39706b1f0241c3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:30:14.942428 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-60fc7a16-e79e-49e8-97e1-f737591aa83c tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:14.943583 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-60fc7a16-e79e-49e8-97e1-f737591aa83c tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:14.944541 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-60fc7a16-e79e-49e8-97e1-f737591aa83c tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:14.945577 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-60fc7a16-e79e-49e8-97e1-f737591aa83c tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:14.946326 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-60fc7a16-e79e-49e8-97e1-f737591aa83c tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:14.947299 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=100 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:30:14.948031 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-60fc7a16-e79e-49e8-97e1-f737591aa83c tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:14.949529 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-82733c84-42e8-4b49-b016-27aa1b04f40c tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] 10.222.0.58 "GET /compute/v2.1/servers/fb59b3c4-bc94-49b7-81e7-7369b70731ad" status: 200 len: 1313 microversion: 2.1 time: 0.564940 Aug 10 23:30:14.970989 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2969/5726] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:30:14 2022] GET /compute/v2.1/servers/fb59b3c4-bc94-49b7-81e7-7369b70731ad => generated 1313 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:30:15.641791 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-60fc7a16-e79e-49e8-97e1-f737591aa83c tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:30:15.654379 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-60fc7a16-e79e-49e8-97e1-f737591aa83c tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:30:15.661620 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-60fc7a16-e79e-49e8-97e1-f737591aa83c tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:30:15.663146 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-60fc7a16-e79e-49e8-97e1-f737591aa83c tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "GET /compute/v2.1/servers/e806d719-6292-49a9-ab7b-31397991291d" status: 200 len: 1731 microversion: 2.20 time: 0.740639 Aug 10 23:30:15.664275 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2758/5727] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:30:14 2022] GET /compute/v2.1/servers/e806d719-6292-49a9-ab7b-31397991291d => generated 1731 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:30:15.944899 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-24429942-fb82-4029-86be-01bbe17f1701 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:30:15.945438 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-24429942-fb82-4029-86be-01bbe17f1701 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] [instance: 366872ea-7465-47d1-a82c-37e597a5355a] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:30:15.958904 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=4 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:30:15.960684 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=16 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:30:15.962374 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-24429942-fb82-4029-86be-01bbe17f1701 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:15.963086 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-24429942-fb82-4029-86be-01bbe17f1701 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:15.963682 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-24429942-fb82-4029-86be-01bbe17f1701 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:15.965375 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-24429942-fb82-4029-86be-01bbe17f1701 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:15.967663 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-24429942-fb82-4029-86be-01bbe17f1701 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:15.967818 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-24429942-fb82-4029-86be-01bbe17f1701 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:15.977774 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-a8d813f9-600b-4944-b0ad-885b94cbefb3 tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:30:15.978387 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-a8d813f9-600b-4944-b0ad-885b94cbefb3 tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] [instance: fb59b3c4-bc94-49b7-81e7-7369b70731ad] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:30:15.990224 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a8d813f9-600b-4944-b0ad-885b94cbefb3 tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:15.998062 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a8d813f9-600b-4944-b0ad-885b94cbefb3 tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:15.998807 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a8d813f9-600b-4944-b0ad-885b94cbefb3 tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:15.999724 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a8d813f9-600b-4944-b0ad-885b94cbefb3 tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:16.000989 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a8d813f9-600b-4944-b0ad-885b94cbefb3 tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:16.001636 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a8d813f9-600b-4944-b0ad-885b94cbefb3 tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:16.368973 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-a8d813f9-600b-4944-b0ad-885b94cbefb3 tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9719cc999ad49b493186b399fb600a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467e718cca3a4fdea39706b1f0241c3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:30:16.384249 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-a8d813f9-600b-4944-b0ad-885b94cbefb3 tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] 10.222.0.58 "GET /compute/v2.1/servers/fb59b3c4-bc94-49b7-81e7-7369b70731ad" status: 200 len: 1313 microversion: 2.1 time: 0.410134 Aug 10 23:30:16.396753 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2759/5728] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:30:15 2022] GET /compute/v2.1/servers/fb59b3c4-bc94-49b7-81e7-7369b70731ad => generated 1313 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:30:16.402842 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-9e11ffe0-854f-4c56-8184-643710afa28f req-45cd3a0e-9d56-4e5b-9659-2323025a595d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e806d719-6292-49a9-ab7b-31397991291d", "name": "network-vif-plugged", "status": "completed", "tag": "bd30930e-8098-4180-afd1-75ee64f8dc5a"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:30:16.428839 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-24429942-fb82-4029-86be-01bbe17f1701 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/366872ea-7465-47d1-a82c-37e597a5355a" status: 200 len: 1466 microversion: 2.1 time: 0.484957 Aug 10 23:30:16.430169 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2970/5729] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:30:15 2022] GET /compute/v2.1/servers/366872ea-7465-47d1-a82c-37e597a5355a => generated 1466 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:30:16.448511 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-9e11ffe0-854f-4c56-8184-643710afa28f req-45cd3a0e-9d56-4e5b-9659-2323025a595d service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:16.450234 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-9e11ffe0-854f-4c56-8184-643710afa28f req-45cd3a0e-9d56-4e5b-9659-2323025a595d service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:16.452765 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-9e11ffe0-854f-4c56-8184-643710afa28f req-45cd3a0e-9d56-4e5b-9659-2323025a595d service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:16.474589 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-9e11ffe0-854f-4c56-8184-643710afa28f req-45cd3a0e-9d56-4e5b-9659-2323025a595d service nova] Creating event network-vif-plugged:bd30930e-8098-4180-afd1-75ee64f8dc5a for instance e806d719-6292-49a9-ab7b-31397991291d on n-h2-850468-14 Aug 10 23:30:16.480854 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-9e11ffe0-854f-4c56-8184-643710afa28f req-45cd3a0e-9d56-4e5b-9659-2323025a595d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082390 Aug 10 23:30:16.481673 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2760/5730] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:30:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:30:16.688815 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-fafd9e89-234e-4537-9383-d40368d8a35f tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:30:16.691735 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-fafd9e89-234e-4537-9383-d40368d8a35f tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: e806d719-6292-49a9-ab7b-31397991291d] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:30:16.704230 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fafd9e89-234e-4537-9383-d40368d8a35f tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:16.706698 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fafd9e89-234e-4537-9383-d40368d8a35f tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:16.709155 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fafd9e89-234e-4537-9383-d40368d8a35f tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:16.713606 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fafd9e89-234e-4537-9383-d40368d8a35f tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:16.714381 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fafd9e89-234e-4537-9383-d40368d8a35f tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:16.715032 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fafd9e89-234e-4537-9383-d40368d8a35f tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:17.182742 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-fafd9e89-234e-4537-9383-d40368d8a35f tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:30:17.199921 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-fafd9e89-234e-4537-9383-d40368d8a35f tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:30:17.201456 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-fafd9e89-234e-4537-9383-d40368d8a35f tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:30:17.202819 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-fafd9e89-234e-4537-9383-d40368d8a35f tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "GET /compute/v2.1/servers/e806d719-6292-49a9-ab7b-31397991291d" status: 200 len: 1731 microversion: 2.20 time: 0.519299 Aug 10 23:30:17.203771 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2971/5731] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:30:16 2022] GET /compute/v2.1/servers/e806d719-6292-49a9-ab7b-31397991291d => generated 1731 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 23:30:17.407794 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-d6cfcb4b-7b67-43c5-8872-f1102616d0ec tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:30:17.408889 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-d6cfcb4b-7b67-43c5-8872-f1102616d0ec tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] [instance: fb59b3c4-bc94-49b7-81e7-7369b70731ad] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:30:17.431732 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d6cfcb4b-7b67-43c5-8872-f1102616d0ec tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:17.434442 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d6cfcb4b-7b67-43c5-8872-f1102616d0ec tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:17.436755 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d6cfcb4b-7b67-43c5-8872-f1102616d0ec tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:17.437523 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d6cfcb4b-7b67-43c5-8872-f1102616d0ec tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:17.439096 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d6cfcb4b-7b67-43c5-8872-f1102616d0ec tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:17.439617 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d6cfcb4b-7b67-43c5-8872-f1102616d0ec tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:17.454686 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-dfc6ffa9-959b-4b6a-b679-77173741cf7e tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:30:17.455861 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-dfc6ffa9-959b-4b6a-b679-77173741cf7e tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] [instance: 366872ea-7465-47d1-a82c-37e597a5355a] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:30:17.465373 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dfc6ffa9-959b-4b6a-b679-77173741cf7e tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:17.465871 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dfc6ffa9-959b-4b6a-b679-77173741cf7e tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:17.469930 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dfc6ffa9-959b-4b6a-b679-77173741cf7e tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:17.471199 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dfc6ffa9-959b-4b6a-b679-77173741cf7e tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:17.471859 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dfc6ffa9-959b-4b6a-b679-77173741cf7e tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:17.472482 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dfc6ffa9-959b-4b6a-b679-77173741cf7e tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:17.756405 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-dfc6ffa9-959b-4b6a-b679-77173741cf7e tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/366872ea-7465-47d1-a82c-37e597a5355a" status: 200 len: 1466 microversion: 2.1 time: 0.305572 Aug 10 23:30:17.773738 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2972/5732] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:30:17 2022] GET /compute/v2.1/servers/366872ea-7465-47d1-a82c-37e597a5355a => generated 1466 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:30:17.944271 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-d6cfcb4b-7b67-43c5-8872-f1102616d0ec tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9719cc999ad49b493186b399fb600a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467e718cca3a4fdea39706b1f0241c3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:30:17.966504 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-d6cfcb4b-7b67-43c5-8872-f1102616d0ec tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] 10.222.0.58 "GET /compute/v2.1/servers/fb59b3c4-bc94-49b7-81e7-7369b70731ad" status: 200 len: 1313 microversion: 2.1 time: 0.564482 Aug 10 23:30:17.972709 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2761/5733] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:30:17 2022] GET /compute/v2.1/servers/fb59b3c4-bc94-49b7-81e7-7369b70731ad => generated 1313 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:30:18.231145 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c3fe4655-c081-4052-823b-eeea4ba159a6 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:30:18.231733 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-c3fe4655-c081-4052-823b-eeea4ba159a6 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: e806d719-6292-49a9-ab7b-31397991291d] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:30:18.244044 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c3fe4655-c081-4052-823b-eeea4ba159a6 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:18.244585 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c3fe4655-c081-4052-823b-eeea4ba159a6 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:18.255654 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c3fe4655-c081-4052-823b-eeea4ba159a6 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:18.256726 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c3fe4655-c081-4052-823b-eeea4ba159a6 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:18.257409 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c3fe4655-c081-4052-823b-eeea4ba159a6 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:18.258046 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c3fe4655-c081-4052-823b-eeea4ba159a6 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:18.547498 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-c3fe4655-c081-4052-823b-eeea4ba159a6 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:30:18.558598 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-c3fe4655-c081-4052-823b-eeea4ba159a6 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:30:18.560561 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-c3fe4655-c081-4052-823b-eeea4ba159a6 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:30:18.562172 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-c3fe4655-c081-4052-823b-eeea4ba159a6 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "GET /compute/v2.1/servers/e806d719-6292-49a9-ab7b-31397991291d" status: 200 len: 1731 microversion: 2.20 time: 0.334855 Aug 10 23:30:18.562775 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2973/5734] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:30:18 2022] GET /compute/v2.1/servers/e806d719-6292-49a9-ab7b-31397991291d => generated 1731 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:30:18.780659 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-a93e2139-16b1-4f0f-82d2-46db5bdbab91 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:30:18.783222 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-a93e2139-16b1-4f0f-82d2-46db5bdbab91 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] [instance: 366872ea-7465-47d1-a82c-37e597a5355a] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:30:18.793406 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a93e2139-16b1-4f0f-82d2-46db5bdbab91 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:18.794109 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a93e2139-16b1-4f0f-82d2-46db5bdbab91 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:18.794725 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a93e2139-16b1-4f0f-82d2-46db5bdbab91 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:18.795801 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a93e2139-16b1-4f0f-82d2-46db5bdbab91 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:18.798597 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a93e2139-16b1-4f0f-82d2-46db5bdbab91 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:18.800340 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a93e2139-16b1-4f0f-82d2-46db5bdbab91 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:18.992043 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-bb5fdae4-eec8-443a-a76d-e42c556583f1 tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:30:18.992754 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-bb5fdae4-eec8-443a-a76d-e42c556583f1 tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] [instance: fb59b3c4-bc94-49b7-81e7-7369b70731ad] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:30:19.006450 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bb5fdae4-eec8-443a-a76d-e42c556583f1 tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:19.006998 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bb5fdae4-eec8-443a-a76d-e42c556583f1 tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:19.007447 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bb5fdae4-eec8-443a-a76d-e42c556583f1 tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:19.011889 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bb5fdae4-eec8-443a-a76d-e42c556583f1 tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:19.015415 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bb5fdae4-eec8-443a-a76d-e42c556583f1 tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:19.015949 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bb5fdae4-eec8-443a-a76d-e42c556583f1 tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:19.365960 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=100 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:30:19.371137 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-a93e2139-16b1-4f0f-82d2-46db5bdbab91 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/366872ea-7465-47d1-a82c-37e597a5355a" status: 200 len: 1466 microversion: 2.1 time: 0.595844 Aug 10 23:30:19.372927 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2762/5735] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:30:18 2022] GET /compute/v2.1/servers/366872ea-7465-47d1-a82c-37e597a5355a => generated 1466 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:30:19.506744 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-524f3808-d1cf-4c43-bda2-f6293efce0d9 req-8cc6d2ec-1258-45c9-94cb-57ec6f48164f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb59b3c4-bc94-49b7-81e7-7369b70731ad", "name": "network-vif-plugged", "status": "completed", "tag": "95cd155a-7c45-491c-b557-d94fd3702092"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:30:19.520918 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-524f3808-d1cf-4c43-bda2-f6293efce0d9 req-8cc6d2ec-1258-45c9-94cb-57ec6f48164f service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:19.521406 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-524f3808-d1cf-4c43-bda2-f6293efce0d9 req-8cc6d2ec-1258-45c9-94cb-57ec6f48164f service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:19.521838 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-524f3808-d1cf-4c43-bda2-f6293efce0d9 req-8cc6d2ec-1258-45c9-94cb-57ec6f48164f service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:19.567227 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-524f3808-d1cf-4c43-bda2-f6293efce0d9 req-8cc6d2ec-1258-45c9-94cb-57ec6f48164f service nova] Creating event network-vif-plugged:95cd155a-7c45-491c-b557-d94fd3702092 for instance fb59b3c4-bc94-49b7-81e7-7369b70731ad on n-h2-850468-14 Aug 10 23:30:19.579017 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-524f3808-d1cf-4c43-bda2-f6293efce0d9 req-8cc6d2ec-1258-45c9-94cb-57ec6f48164f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079264 Aug 10 23:30:19.590278 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2763/5736] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:30:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Aug 10 23:30:19.608005 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-b66478a9-1a8d-40f0-9804-4245861865a7 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:30:19.609213 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-b66478a9-1a8d-40f0-9804-4245861865a7 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: e806d719-6292-49a9-ab7b-31397991291d] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:30:19.621216 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b66478a9-1a8d-40f0-9804-4245861865a7 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:19.626379 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b66478a9-1a8d-40f0-9804-4245861865a7 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:19.627246 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b66478a9-1a8d-40f0-9804-4245861865a7 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:19.628455 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b66478a9-1a8d-40f0-9804-4245861865a7 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:19.629109 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b66478a9-1a8d-40f0-9804-4245861865a7 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:19.629705 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b66478a9-1a8d-40f0-9804-4245861865a7 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:19.806394 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-bb5fdae4-eec8-443a-a76d-e42c556583f1 tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9719cc999ad49b493186b399fb600a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467e718cca3a4fdea39706b1f0241c3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:30:19.815956 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-bb5fdae4-eec8-443a-a76d-e42c556583f1 tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] 10.222.0.58 "GET /compute/v2.1/servers/fb59b3c4-bc94-49b7-81e7-7369b70731ad" status: 200 len: 1313 microversion: 2.1 time: 0.829400 Aug 10 23:30:19.816822 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2974/5737] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:30:18 2022] GET /compute/v2.1/servers/fb59b3c4-bc94-49b7-81e7-7369b70731ad => generated 1313 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:30:19.965514 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-b66478a9-1a8d-40f0-9804-4245861865a7 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:30:19.976648 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-b66478a9-1a8d-40f0-9804-4245861865a7 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:30:19.978445 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-b66478a9-1a8d-40f0-9804-4245861865a7 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:30:19.980665 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-b66478a9-1a8d-40f0-9804-4245861865a7 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "GET /compute/v2.1/servers/e806d719-6292-49a9-ab7b-31397991291d" status: 200 len: 1731 microversion: 2.20 time: 0.386210 Aug 10 23:30:19.981750 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2764/5738] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:30:19 2022] GET /compute/v2.1/servers/e806d719-6292-49a9-ab7b-31397991291d => generated 1731 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:30:20.396001 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-fcf25ca5-91e4-463e-8155-be5ab70aefd9 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:30:20.398632 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-fcf25ca5-91e4-463e-8155-be5ab70aefd9 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] [instance: 366872ea-7465-47d1-a82c-37e597a5355a] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:30:20.422162 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fcf25ca5-91e4-463e-8155-be5ab70aefd9 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:20.423282 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fcf25ca5-91e4-463e-8155-be5ab70aefd9 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:20.424428 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fcf25ca5-91e4-463e-8155-be5ab70aefd9 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:20.427834 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fcf25ca5-91e4-463e-8155-be5ab70aefd9 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:20.428603 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fcf25ca5-91e4-463e-8155-be5ab70aefd9 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:20.429262 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fcf25ca5-91e4-463e-8155-be5ab70aefd9 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:20.732870 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-fcf25ca5-91e4-463e-8155-be5ab70aefd9 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/366872ea-7465-47d1-a82c-37e597a5355a" status: 200 len: 1466 microversion: 2.1 time: 0.341981 Aug 10 23:30:20.734261 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2975/5739] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:30:20 2022] GET /compute/v2.1/servers/366872ea-7465-47d1-a82c-37e597a5355a => generated 1466 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:30:20.838059 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-b2f03102-e837-4cc9-8b3c-884a454e0280 tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:30:20.838679 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-b2f03102-e837-4cc9-8b3c-884a454e0280 tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] [instance: fb59b3c4-bc94-49b7-81e7-7369b70731ad] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:30:20.852630 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b2f03102-e837-4cc9-8b3c-884a454e0280 tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:20.853426 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b2f03102-e837-4cc9-8b3c-884a454e0280 tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:20.854047 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b2f03102-e837-4cc9-8b3c-884a454e0280 tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:20.855626 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b2f03102-e837-4cc9-8b3c-884a454e0280 tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:20.860202 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b2f03102-e837-4cc9-8b3c-884a454e0280 tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:20.860900 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b2f03102-e837-4cc9-8b3c-884a454e0280 tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:21.010298 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-df22f91b-7f4f-4ebf-a453-17648a24cb29 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:30:21.011838 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-df22f91b-7f4f-4ebf-a453-17648a24cb29 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: e806d719-6292-49a9-ab7b-31397991291d] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:30:21.037171 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-df22f91b-7f4f-4ebf-a453-17648a24cb29 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:21.039428 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-df22f91b-7f4f-4ebf-a453-17648a24cb29 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:21.040069 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-df22f91b-7f4f-4ebf-a453-17648a24cb29 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:21.041000 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-df22f91b-7f4f-4ebf-a453-17648a24cb29 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:21.043803 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-df22f91b-7f4f-4ebf-a453-17648a24cb29 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:21.046552 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-df22f91b-7f4f-4ebf-a453-17648a24cb29 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:21.324262 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-b2f03102-e837-4cc9-8b3c-884a454e0280 tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9719cc999ad49b493186b399fb600a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467e718cca3a4fdea39706b1f0241c3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:30:21.348145 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-b2f03102-e837-4cc9-8b3c-884a454e0280 tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] 10.222.0.58 "GET /compute/v2.1/servers/fb59b3c4-bc94-49b7-81e7-7369b70731ad" status: 200 len: 1313 microversion: 2.1 time: 0.509055 Aug 10 23:30:21.350044 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2765/5740] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:30:20 2022] GET /compute/v2.1/servers/fb59b3c4-bc94-49b7-81e7-7369b70731ad => generated 1313 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:30:21.406136 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-df22f91b-7f4f-4ebf-a453-17648a24cb29 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:30:21.416385 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-df22f91b-7f4f-4ebf-a453-17648a24cb29 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:30:21.418215 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-df22f91b-7f4f-4ebf-a453-17648a24cb29 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:30:21.419765 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-df22f91b-7f4f-4ebf-a453-17648a24cb29 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "GET /compute/v2.1/servers/e806d719-6292-49a9-ab7b-31397991291d" status: 200 len: 1718 microversion: 2.20 time: 0.417123 Aug 10 23:30:21.422419 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2976/5741] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:30:21 2022] GET /compute/v2.1/servers/e806d719-6292-49a9-ab7b-31397991291d => generated 1718 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:30:21.757033 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-425c06ee-0067-47a6-9844-99dc1911e9bb tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:30:21.757892 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-425c06ee-0067-47a6-9844-99dc1911e9bb tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] [instance: 366872ea-7465-47d1-a82c-37e597a5355a] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:30:21.764763 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-425c06ee-0067-47a6-9844-99dc1911e9bb tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:21.765597 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-425c06ee-0067-47a6-9844-99dc1911e9bb tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:21.766451 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-425c06ee-0067-47a6-9844-99dc1911e9bb tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:21.767502 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-425c06ee-0067-47a6-9844-99dc1911e9bb tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:21.768196 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-425c06ee-0067-47a6-9844-99dc1911e9bb tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:21.772620 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-425c06ee-0067-47a6-9844-99dc1911e9bb tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:22.013078 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-425c06ee-0067-47a6-9844-99dc1911e9bb tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/366872ea-7465-47d1-a82c-37e597a5355a" status: 200 len: 1466 microversion: 2.1 time: 0.260812 Aug 10 23:30:22.019192 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2766/5742] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:30:21 2022] GET /compute/v2.1/servers/366872ea-7465-47d1-a82c-37e597a5355a => generated 1466 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:30:22.390883 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-defd6e53-f09b-413d-8f53-39cc52a16037 tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:30:22.391565 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-defd6e53-f09b-413d-8f53-39cc52a16037 tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] [instance: fb59b3c4-bc94-49b7-81e7-7369b70731ad] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:30:22.406317 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-defd6e53-f09b-413d-8f53-39cc52a16037 tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:22.407888 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-defd6e53-f09b-413d-8f53-39cc52a16037 tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:22.410843 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-defd6e53-f09b-413d-8f53-39cc52a16037 tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:22.412792 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-defd6e53-f09b-413d-8f53-39cc52a16037 tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:22.420959 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-defd6e53-f09b-413d-8f53-39cc52a16037 tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:22.421681 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-defd6e53-f09b-413d-8f53-39cc52a16037 tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:22.807126 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-defd6e53-f09b-413d-8f53-39cc52a16037 tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9719cc999ad49b493186b399fb600a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467e718cca3a4fdea39706b1f0241c3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:30:22.820449 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-defd6e53-f09b-413d-8f53-39cc52a16037 tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] 10.222.0.58 "GET /compute/v2.1/servers/fb59b3c4-bc94-49b7-81e7-7369b70731ad" status: 200 len: 1462 microversion: 2.1 time: 0.450843 Aug 10 23:30:22.822068 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2977/5743] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:30:22 2022] GET /compute/v2.1/servers/fb59b3c4-bc94-49b7-81e7-7369b70731ad => generated 1462 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:30:22.843292 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-29bedde4-af71-4312-909a-6e7bd715aca6 tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "89d9d5ef-eb1b-4232-b56e-9d3707847141", "device": "/dev/sdb"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:30:22.845851 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-29bedde4-af71-4312-909a-6e7bd715aca6 tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] [instance: fb59b3c4-bc94-49b7-81e7-7369b70731ad] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:30:22.855939 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-29bedde4-af71-4312-909a-6e7bd715aca6 tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:22.856892 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-29bedde4-af71-4312-909a-6e7bd715aca6 tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:22.857562 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-29bedde4-af71-4312-909a-6e7bd715aca6 tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:22.858600 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-29bedde4-af71-4312-909a-6e7bd715aca6 tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:22.859274 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-29bedde4-af71-4312-909a-6e7bd715aca6 tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:22.859967 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-29bedde4-af71-4312-909a-6e7bd715aca6 tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:23.037303 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-bdae9187-6b1c-4b9c-89d1-887b7f241540 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:30:23.038204 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-bdae9187-6b1c-4b9c-89d1-887b7f241540 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] [instance: 366872ea-7465-47d1-a82c-37e597a5355a] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:30:23.053290 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bdae9187-6b1c-4b9c-89d1-887b7f241540 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:23.054069 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bdae9187-6b1c-4b9c-89d1-887b7f241540 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:23.054799 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bdae9187-6b1c-4b9c-89d1-887b7f241540 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:23.055825 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bdae9187-6b1c-4b9c-89d1-887b7f241540 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:23.056602 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bdae9187-6b1c-4b9c-89d1-887b7f241540 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:23.057271 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bdae9187-6b1c-4b9c-89d1-887b7f241540 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:23.286246 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-29bedde4-af71-4312-909a-6e7bd715aca6 tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] 10.222.0.58 "POST /compute/v2.1/servers/fb59b3c4-bc94-49b7-81e7-7369b70731ad/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.446624 Aug 10 23:30:23.287308 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2767/5744] 10.222.0.58 () {60 vars in 1323 bytes} [Wed Aug 10 23:30:22 2022] POST /compute/v2.1/servers/fb59b3c4-bc94-49b7-81e7-7369b70731ad/os-volume_attachments => generated 194 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:30:23.304157 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-5e99bcac-9f4c-41cd-9099-04a6485043bb req-78dc4d17-45cf-4312-9556-33d20a8d1a89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "366872ea-7465-47d1-a82c-37e597a5355a", "name": "network-vif-plugged", "status": "completed", "tag": "4af9cb9b-a10d-4867-b226-1318266049e9"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:30:23.328870 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-5e99bcac-9f4c-41cd-9099-04a6485043bb req-78dc4d17-45cf-4312-9556-33d20a8d1a89 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:23.329366 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-5e99bcac-9f4c-41cd-9099-04a6485043bb req-78dc4d17-45cf-4312-9556-33d20a8d1a89 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:23.329802 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-5e99bcac-9f4c-41cd-9099-04a6485043bb req-78dc4d17-45cf-4312-9556-33d20a8d1a89 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:23.353514 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-5e99bcac-9f4c-41cd-9099-04a6485043bb req-78dc4d17-45cf-4312-9556-33d20a8d1a89 service nova] Creating event network-vif-plugged:4af9cb9b-a10d-4867-b226-1318266049e9 for instance 366872ea-7465-47d1-a82c-37e597a5355a on n-h2-850468-14 Aug 10 23:30:23.365620 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-5e99bcac-9f4c-41cd-9099-04a6485043bb req-78dc4d17-45cf-4312-9556-33d20a8d1a89 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070776 Aug 10 23:30:23.366620 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2768/5745] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:30:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:30:23.555407 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-e2ad1acd-924a-41d3-bfa0-e470a56c7620 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Action: 'create', calling method: .version_select at 0x7f846faca790>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-361587300", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKqQ7dYnHcAdZQIDE8XH/kaAQAN6leMGfY5yFElJ+UTbJONAilZZzUY69nJJ4sUO71nTH3keNx89K8XPrVUC7smg8aUCGQ5oLUdNWUscW2NzkEow10bkyPr3NJzz6CjoCA=="}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:30:23.566191 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-bdae9187-6b1c-4b9c-89d1-887b7f241540 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/366872ea-7465-47d1-a82c-37e597a5355a" status: 200 len: 1466 microversion: 2.1 time: 0.533253 Aug 10 23:30:23.569574 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2978/5746] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:30:23 2022] GET /compute/v2.1/servers/366872ea-7465-47d1-a82c-37e597a5355a => generated 1466 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:30:23.602429 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-e2ad1acd-924a-41d3-bfa0-e470a56c7620 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Getting quotas for project 679d43599f3e4c29ab368a1e54dae608. Resources: {'key_pairs'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:30:23.611604 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-e2ad1acd-924a-41d3-bfa0-e470a56c7620 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Getting quotas for user fbea80d59f5840f1899bd3cf601ac8bf and project 679d43599f3e4c29ab368a1e54dae608. Resources: {'key_pairs'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:30:23.636654 n-d-850468-14 devstack@n-api.service[122632]: ERROR oslo.messaging._drivers.impl_rabbit [None req-e2ad1acd-924a-41d3-bfa0-e470a56c7620 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] [0e2637b5-9f7f-46ac-8015-c7e758a5f595] AMQP server on 10.222.0.58:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 10 23:30:24.596146 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c3cd34f1-292b-410a-9bee-ea390863fcab tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:30:24.596780 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-c3cd34f1-292b-410a-9bee-ea390863fcab tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] [instance: 366872ea-7465-47d1-a82c-37e597a5355a] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:30:24.610264 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c3cd34f1-292b-410a-9bee-ea390863fcab tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:24.611468 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c3cd34f1-292b-410a-9bee-ea390863fcab tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:24.614242 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c3cd34f1-292b-410a-9bee-ea390863fcab tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:24.615251 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c3cd34f1-292b-410a-9bee-ea390863fcab tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:24.616751 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c3cd34f1-292b-410a-9bee-ea390863fcab tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:24.619815 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c3cd34f1-292b-410a-9bee-ea390863fcab tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:24.646526 n-d-850468-14 devstack@n-api.service[122632]: INFO oslo.messaging._drivers.impl_rabbit [None req-e2ad1acd-924a-41d3-bfa0-e470a56c7620 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] [0e2637b5-9f7f-46ac-8015-c7e758a5f595] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 50036. Aug 10 23:30:24.673197 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-e2ad1acd-924a-41d3-bfa0-e470a56c7620 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 1.124237 Aug 10 23:30:24.674465 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2769/5747] 10.222.0.58 () {60 vars in 1159 bytes} [Wed Aug 10 23:30:23 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:30:24.958778 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-c3cd34f1-292b-410a-9bee-ea390863fcab tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/366872ea-7465-47d1-a82c-37e597a5355a" status: 200 len: 1466 microversion: 2.1 time: 0.373897 Aug 10 23:30:24.961937 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2979/5748] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:30:24 2022] GET /compute/v2.1/servers/366872ea-7465-47d1-a82c-37e597a5355a => generated 1466 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:30:25.984096 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-4d170f66-9494-426d-afeb-4a201c3de84b tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:30:25.986016 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-4d170f66-9494-426d-afeb-4a201c3de84b tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] [instance: 366872ea-7465-47d1-a82c-37e597a5355a] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:30:25.996551 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4d170f66-9494-426d-afeb-4a201c3de84b tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:25.997325 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4d170f66-9494-426d-afeb-4a201c3de84b tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:25.997940 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4d170f66-9494-426d-afeb-4a201c3de84b tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:25.999016 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4d170f66-9494-426d-afeb-4a201c3de84b tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:25.999495 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4d170f66-9494-426d-afeb-4a201c3de84b tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:26.000117 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4d170f66-9494-426d-afeb-4a201c3de84b tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:26.214770 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-4d170f66-9494-426d-afeb-4a201c3de84b tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/366872ea-7465-47d1-a82c-37e597a5355a" status: 200 len: 1651 microversion: 2.1 time: 0.235083 Aug 10 23:30:26.218274 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2770/5749] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:30:25 2022] GET /compute/v2.1/servers/366872ea-7465-47d1-a82c-37e597a5355a => generated 1651 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:30:26.241563 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-07b63f1c-67bf-4ec6-90f3-121a33a80751 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:30:26.242882 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-07b63f1c-67bf-4ec6-90f3-121a33a80751 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] [instance: 366872ea-7465-47d1-a82c-37e597a5355a] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:30:26.250259 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-07b63f1c-67bf-4ec6-90f3-121a33a80751 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:26.251077 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-07b63f1c-67bf-4ec6-90f3-121a33a80751 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:26.251718 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-07b63f1c-67bf-4ec6-90f3-121a33a80751 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:26.252616 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-07b63f1c-67bf-4ec6-90f3-121a33a80751 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:26.253285 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-07b63f1c-67bf-4ec6-90f3-121a33a80751 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:26.254058 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-07b63f1c-67bf-4ec6-90f3-121a33a80751 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:26.513014 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-07b63f1c-67bf-4ec6-90f3-121a33a80751 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/366872ea-7465-47d1-a82c-37e597a5355a" status: 200 len: 1651 microversion: 2.1 time: 0.278807 Aug 10 23:30:26.514239 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2980/5750] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:30:26 2022] GET /compute/v2.1/servers/366872ea-7465-47d1-a82c-37e597a5355a => generated 1651 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:30:26.538443 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-ac0f50b6-2d37-41f3-8308-74c2bc623dc5 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:30:26.539441 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-ac0f50b6-2d37-41f3-8308-74c2bc623dc5 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] [instance: 366872ea-7465-47d1-a82c-37e597a5355a] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:30:26.547472 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ac0f50b6-2d37-41f3-8308-74c2bc623dc5 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:26.548683 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ac0f50b6-2d37-41f3-8308-74c2bc623dc5 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:26.549602 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ac0f50b6-2d37-41f3-8308-74c2bc623dc5 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:26.551266 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ac0f50b6-2d37-41f3-8308-74c2bc623dc5 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:26.552068 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ac0f50b6-2d37-41f3-8308-74c2bc623dc5 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:26.552700 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ac0f50b6-2d37-41f3-8308-74c2bc623dc5 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:26.789513 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-ac0f50b6-2d37-41f3-8308-74c2bc623dc5 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/366872ea-7465-47d1-a82c-37e597a5355a" status: 200 len: 1651 microversion: 2.1 time: 0.256408 Aug 10 23:30:26.807299 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2771/5751] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:30:26 2022] GET /compute/v2.1/servers/366872ea-7465-47d1-a82c-37e597a5355a => generated 1651 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:30:26.811454 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-b83f8fa4-f183-4e58-8441-ffcbdfbbbc87 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:30:26.811982 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-b83f8fa4-f183-4e58-8441-ffcbdfbbbc87 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] [instance: 366872ea-7465-47d1-a82c-37e597a5355a] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:30:26.819945 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b83f8fa4-f183-4e58-8441-ffcbdfbbbc87 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:26.820446 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b83f8fa4-f183-4e58-8441-ffcbdfbbbc87 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:26.821163 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b83f8fa4-f183-4e58-8441-ffcbdfbbbc87 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:26.829447 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b83f8fa4-f183-4e58-8441-ffcbdfbbbc87 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:26.831057 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b83f8fa4-f183-4e58-8441-ffcbdfbbbc87 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:26.831953 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b83f8fa4-f183-4e58-8441-ffcbdfbbbc87 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:26.873166 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-cdd1b0cb-e3ee-425e-bf85-aded7517e651 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1368977231", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452", "networks": [{"uuid": "c913600e-e451-453f-8f25-d0987eb728f1"}], "key_name": "tempest-TestNetworkBasicOps-361587300", "security_groups": [{"name": "tempest-secgroup-smoke-415889886"}]}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:30:26.877576 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-b83f8fa4-f183-4e58-8441-ffcbdfbbbc87 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] [instance: 366872ea-7465-47d1-a82c-37e597a5355a] Going to try to terminate instance {{(pid=122633) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:30:27.014133 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-b83f8fa4-f183-4e58-8441-ffcbdfbbbc87 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] 10.222.0.58 "DELETE /compute/v2.1/servers/366872ea-7465-47d1-a82c-37e597a5355a" status: 204 len: 0 microversion: 2.1 time: 0.205929 Aug 10 23:30:27.018456 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2981/5752] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:30:26 2022] DELETE /compute/v2.1/servers/366872ea-7465-47d1-a82c-37e597a5355a => generated 0 bytes in 212 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:30:27.028417 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-58e90849-d850-4a95-8307-a0fb5d042ded tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:30:27.029192 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-58e90849-d850-4a95-8307-a0fb5d042ded tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] [instance: 366872ea-7465-47d1-a82c-37e597a5355a] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:30:27.037578 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-58e90849-d850-4a95-8307-a0fb5d042ded tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:27.038378 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-58e90849-d850-4a95-8307-a0fb5d042ded tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:27.039667 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-58e90849-d850-4a95-8307-a0fb5d042ded tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:27.040617 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-58e90849-d850-4a95-8307-a0fb5d042ded tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:27.041280 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-58e90849-d850-4a95-8307-a0fb5d042ded tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:27.041896 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-58e90849-d850-4a95-8307-a0fb5d042ded tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:27.070398 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.network.neutron [None req-cdd1b0cb-e3ee-425e-bf85-aded7517e651 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] validate_networks() for [('c913600e-e451-453f-8f25-d0987eb728f1', None, None, None, None, None)] {{(pid=122632) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 23:30:27.292892 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-58e90849-d850-4a95-8307-a0fb5d042ded tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/366872ea-7465-47d1-a82c-37e597a5355a" status: 200 len: 1657 microversion: 2.1 time: 0.268759 Aug 10 23:30:27.316357 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2982/5753] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:30:27 2022] GET /compute/v2.1/servers/366872ea-7465-47d1-a82c-37e597a5355a => generated 1657 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:30:27.639691 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-cdd1b0cb-e3ee-425e-bf85-aded7517e651 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Flavor limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:30:27.640057 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-cdd1b0cb-e3ee-425e-bf85-aded7517e651 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Image limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:30:27.640528 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-cdd1b0cb-e3ee-425e-bf85-aded7517e651 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Flavor pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:30:27.640943 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-cdd1b0cb-e3ee-425e-bf85-aded7517e651 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Image pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:30:27.641350 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-cdd1b0cb-e3ee-425e-bf85-aded7517e651 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:30:27.651206 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cdd1b0cb-e3ee-425e-bf85-aded7517e651 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:27.651677 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cdd1b0cb-e3ee-425e-bf85-aded7517e651 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:27.652118 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cdd1b0cb-e3ee-425e-bf85-aded7517e651 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:27.652837 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cdd1b0cb-e3ee-425e-bf85-aded7517e651 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:27.653291 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cdd1b0cb-e3ee-425e-bf85-aded7517e651 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:27.653712 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cdd1b0cb-e3ee-425e-bf85-aded7517e651 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:27.672028 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-cdd1b0cb-e3ee-425e-bf85-aded7517e651 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Getting quotas for project 679d43599f3e4c29ab368a1e54dae608. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:30:27.678158 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-cdd1b0cb-e3ee-425e-bf85-aded7517e651 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Getting quotas for user fbea80d59f5840f1899bd3cf601ac8bf and project 679d43599f3e4c29ab368a1e54dae608. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:30:27.692798 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-cdd1b0cb-e3ee-425e-bf85-aded7517e651 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Going to run 1 instances... {{(pid=122632) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 23:30:27.695464 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-cdd1b0cb-e3ee-425e-bf85-aded7517e651 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] [instance: aa0bed62-e734-42e6-9211-88beb761554a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78ad8905-f66f-4733-8be9-2b260f1fabed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122632) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 23:30:27.774067 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-cdd1b0cb-e3ee-425e-bf85-aded7517e651 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.906272 Aug 10 23:30:27.775097 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2772/5754] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 23:30:26 2022] POST /compute/v2.1/servers => generated 405 bytes in 908 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 10 23:30:27.795816 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-461355e7-3bd3-47fa-bbff-79a22a8704ba tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:30:27.796497 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-461355e7-3bd3-47fa-bbff-79a22a8704ba tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] [instance: aa0bed62-e734-42e6-9211-88beb761554a] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:30:27.877502 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-461355e7-3bd3-47fa-bbff-79a22a8704ba tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbea80d59f5840f1899bd3cf601ac8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679d43599f3e4c29ab368a1e54dae608', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:30:27.886335 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-461355e7-3bd3-47fa-bbff-79a22a8704ba tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] 10.222.0.58 "GET /compute/v2.1/servers/aa0bed62-e734-42e6-9211-88beb761554a" status: 200 len: 1248 microversion: 2.1 time: 0.099837 Aug 10 23:30:27.887131 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2983/5755] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:30:27 2022] GET /compute/v2.1/servers/aa0bed62-e734-42e6-9211-88beb761554a => generated 1248 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:30:28.329602 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-061a8555-faec-4be8-8083-f303a1cc77f8 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:30:28.331474 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-061a8555-faec-4be8-8083-f303a1cc77f8 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] [instance: 366872ea-7465-47d1-a82c-37e597a5355a] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:30:28.340231 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-061a8555-faec-4be8-8083-f303a1cc77f8 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:28.340901 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-061a8555-faec-4be8-8083-f303a1cc77f8 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:28.341475 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-061a8555-faec-4be8-8083-f303a1cc77f8 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:28.342186 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-061a8555-faec-4be8-8083-f303a1cc77f8 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:28.342683 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-061a8555-faec-4be8-8083-f303a1cc77f8 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:28.343128 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-061a8555-faec-4be8-8083-f303a1cc77f8 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:28.508086 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-061a8555-faec-4be8-8083-f303a1cc77f8 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/366872ea-7465-47d1-a82c-37e597a5355a" status: 200 len: 1657 microversion: 2.1 time: 0.183027 Aug 10 23:30:28.510013 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2773/5756] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:30:28 2022] GET /compute/v2.1/servers/366872ea-7465-47d1-a82c-37e597a5355a => generated 1657 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:30:28.909752 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-b0ac3810-cf3d-4eac-9b48-28c318e798a4 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:30:28.911653 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-b0ac3810-cf3d-4eac-9b48-28c318e798a4 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] [instance: aa0bed62-e734-42e6-9211-88beb761554a] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:30:28.919910 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b0ac3810-cf3d-4eac-9b48-28c318e798a4 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:28.920667 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b0ac3810-cf3d-4eac-9b48-28c318e798a4 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:28.921280 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b0ac3810-cf3d-4eac-9b48-28c318e798a4 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:28.922194 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b0ac3810-cf3d-4eac-9b48-28c318e798a4 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:28.927031 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b0ac3810-cf3d-4eac-9b48-28c318e798a4 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:28.927764 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b0ac3810-cf3d-4eac-9b48-28c318e798a4 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:29.028292 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-d38f2b96-655f-43a0-a384-2c0d32ab1ce4 req-47e219d1-8561-4ed6-b9ef-c1ad03f83f3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "366872ea-7465-47d1-a82c-37e597a5355a", "name": "network-vif-deleted", "tag": "4af9cb9b-a10d-4867-b226-1318266049e9"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:30:29.047483 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-d38f2b96-655f-43a0-a384-2c0d32ab1ce4 req-47e219d1-8561-4ed6-b9ef-c1ad03f83f3a service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:29.047977 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-d38f2b96-655f-43a0-a384-2c0d32ab1ce4 req-47e219d1-8561-4ed6-b9ef-c1ad03f83f3a service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:29.048427 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-d38f2b96-655f-43a0-a384-2c0d32ab1ce4 req-47e219d1-8561-4ed6-b9ef-c1ad03f83f3a service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:29.069175 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-d38f2b96-655f-43a0-a384-2c0d32ab1ce4 req-47e219d1-8561-4ed6-b9ef-c1ad03f83f3a service nova] Creating event network-vif-deleted:4af9cb9b-a10d-4867-b226-1318266049e9 for instance 366872ea-7465-47d1-a82c-37e597a5355a on n-h2-850468-14 Aug 10 23:30:29.090876 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-d38f2b96-655f-43a0-a384-2c0d32ab1ce4 req-47e219d1-8561-4ed6-b9ef-c1ad03f83f3a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066272 Aug 10 23:30:29.092064 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2774/5757] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:30:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:30:29.132907 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-b0ac3810-cf3d-4eac-9b48-28c318e798a4 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbea80d59f5840f1899bd3cf601ac8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679d43599f3e4c29ab368a1e54dae608', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:30:29.151550 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-b0ac3810-cf3d-4eac-9b48-28c318e798a4 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] 10.222.0.58 "GET /compute/v2.1/servers/aa0bed62-e734-42e6-9211-88beb761554a" status: 200 len: 1308 microversion: 2.1 time: 0.245657 Aug 10 23:30:29.152958 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2984/5758] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:30:28 2022] GET /compute/v2.1/servers/aa0bed62-e734-42e6-9211-88beb761554a => generated 1308 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:30:29.535831 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-883b8725-3e2b-4740-8dab-d2f5c88e545e tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:30:29.537267 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-883b8725-3e2b-4740-8dab-d2f5c88e545e tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] [instance: 366872ea-7465-47d1-a82c-37e597a5355a] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:30:29.547624 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-883b8725-3e2b-4740-8dab-d2f5c88e545e tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:29.548569 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-883b8725-3e2b-4740-8dab-d2f5c88e545e tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:29.549214 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-883b8725-3e2b-4740-8dab-d2f5c88e545e tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:29.550119 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-883b8725-3e2b-4740-8dab-d2f5c88e545e tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:29.550810 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-883b8725-3e2b-4740-8dab-d2f5c88e545e tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:29.552247 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-883b8725-3e2b-4740-8dab-d2f5c88e545e tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:29.600364 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-883b8725-3e2b-4740-8dab-d2f5c88e545e tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:29.601746 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-883b8725-3e2b-4740-8dab-d2f5c88e545e tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:29.602417 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-883b8725-3e2b-4740-8dab-d2f5c88e545e tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:29.603879 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.objects.instance [None req-883b8725-3e2b-4740-8dab-d2f5c88e545e tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Lazy-loading 'fault' on Instance uuid 366872ea-7465-47d1-a82c-37e597a5355a {{(pid=122632) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:30:29.697803 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-883b8725-3e2b-4740-8dab-d2f5c88e545e tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/366872ea-7465-47d1-a82c-37e597a5355a" status: 200 len: 1456 microversion: 2.1 time: 0.166336 Aug 10 23:30:29.698681 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2775/5759] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:30:29 2022] GET /compute/v2.1/servers/366872ea-7465-47d1-a82c-37e597a5355a => generated 1456 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:30:30.181784 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-cf2d4425-9fc9-4113-af54-a2bf9fcdbc26 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:30:30.183003 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-cf2d4425-9fc9-4113-af54-a2bf9fcdbc26 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] [instance: aa0bed62-e734-42e6-9211-88beb761554a] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:30:30.194067 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cf2d4425-9fc9-4113-af54-a2bf9fcdbc26 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:30.194644 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cf2d4425-9fc9-4113-af54-a2bf9fcdbc26 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:30.195262 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cf2d4425-9fc9-4113-af54-a2bf9fcdbc26 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:30.195997 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cf2d4425-9fc9-4113-af54-a2bf9fcdbc26 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:30.196621 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cf2d4425-9fc9-4113-af54-a2bf9fcdbc26 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:30.197328 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cf2d4425-9fc9-4113-af54-a2bf9fcdbc26 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:30.366438 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-cf2d4425-9fc9-4113-af54-a2bf9fcdbc26 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbea80d59f5840f1899bd3cf601ac8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679d43599f3e4c29ab368a1e54dae608', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:30:30.371509 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:30:30.377554 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-cf2d4425-9fc9-4113-af54-a2bf9fcdbc26 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] 10.222.0.58 "GET /compute/v2.1/servers/aa0bed62-e734-42e6-9211-88beb761554a" status: 200 len: 1373 microversion: 2.1 time: 0.207525 Aug 10 23:30:30.378138 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2985/5760] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:30:30 2022] GET /compute/v2.1/servers/aa0bed62-e734-42e6-9211-88beb761554a => generated 1373 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:30:30.671791 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-df7a20dc-3db7-4ad2-a91a-10aead0b69ab req-6d2aff01-3a2a-44c9-aea3-306eadcbe758 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa0bed62-e734-42e6-9211-88beb761554a", "tag": "ac21225a-7b86-4858-a07c-e2c383b8308b"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:30:30.686265 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-df7a20dc-3db7-4ad2-a91a-10aead0b69ab req-6d2aff01-3a2a-44c9-aea3-306eadcbe758 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:30.686751 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-df7a20dc-3db7-4ad2-a91a-10aead0b69ab req-6d2aff01-3a2a-44c9-aea3-306eadcbe758 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:30.687217 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-df7a20dc-3db7-4ad2-a91a-10aead0b69ab req-6d2aff01-3a2a-44c9-aea3-306eadcbe758 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:30.700179 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-df7a20dc-3db7-4ad2-a91a-10aead0b69ab req-6d2aff01-3a2a-44c9-aea3-306eadcbe758 service nova] Creating event network-changed:ac21225a-7b86-4858-a07c-e2c383b8308b for instance aa0bed62-e734-42e6-9211-88beb761554a on n-h1-850468-14 Aug 10 23:30:30.704888 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-df7a20dc-3db7-4ad2-a91a-10aead0b69ab req-6d2aff01-3a2a-44c9-aea3-306eadcbe758 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037950 Aug 10 23:30:30.705501 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2776/5761] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:30:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:30:30.720614 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-aa924451-e773-4ed1-94aa-3825c2d56945 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:30:30.721365 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-aa924451-e773-4ed1-94aa-3825c2d56945 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] [instance: 366872ea-7465-47d1-a82c-37e597a5355a] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:30:30.728375 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-aa924451-e773-4ed1-94aa-3825c2d56945 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:30.728880 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-aa924451-e773-4ed1-94aa-3825c2d56945 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:30.729326 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-aa924451-e773-4ed1-94aa-3825c2d56945 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:30.730044 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-aa924451-e773-4ed1-94aa-3825c2d56945 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:30.730514 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-aa924451-e773-4ed1-94aa-3825c2d56945 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:30.730989 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-aa924451-e773-4ed1-94aa-3825c2d56945 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:30.746426 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-aa924451-e773-4ed1-94aa-3825c2d56945 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] HTTP exception thrown: Instance 366872ea-7465-47d1-a82c-37e597a5355a could not be found. Aug 10 23:30:30.748132 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-aa924451-e773-4ed1-94aa-3825c2d56945 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Request method failure captured: Aug 10 23:30:30.748132 n-d-850468-14 devstack@n-api.service[122633]: request: GET /compute/v2.1/servers/366872ea-7465-47d1-a82c-37e597a5355a HTTP/1.1 Aug 10 23:30:30.748132 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:30:30.748132 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:30:30.748132 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:30:30.748132 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:30:30.748132 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:30:30.748132 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:30:30.748132 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:30:30.748132 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:30:30.748132 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9D9Z1F_RGk_ic_nuOzRa30qql_Fn7tkVDQFFBtMyNZiunDNLbo_RnSuL33E4lL_Rbsz2DeHJE6UcdpjBuXvE1nHwkje3uMKVbjwSGUVXcAI2EYaQqBVcp_zxC7wFU__6CoI7nA1vNG4h3HKl6pAqObftr5byQ9b_skAo-9eK-OBFJww Aug 10 23:30:30.748132 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:30:30.748132 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:30:30.748132 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:30:30.748132 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:30:30.748132 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:30:30.748132 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:30:30.748132 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 05776e7992c34fc6af2152359b7887ba Aug 10 23:30:30.748132 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-TestServerMultinode-290189576 Aug 10 23:30:30.748132 n-d-850468-14 devstack@n-api.service[122633]: X-Role: admin,member,reader Aug 10 23:30:30.748132 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: admin,member,reader Aug 10 23:30:30.748132 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/05776e7992c34fc6af2152359b7887ba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/05776e7992c34fc6af2152359b7887ba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/05776e7992c34fc6af2152359b7887ba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_05776e7992c34fc6af2152359b7887ba", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:30:30.748132 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-TestServerMultinode-290189576 Aug 10 23:30:30.748132 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 05776e7992c34fc6af2152359b7887ba Aug 10 23:30:30.748132 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-TestServerMultinode-290189576 Aug 10 23:30:30.748132 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-TestServerMultinode-290189576-project-admin Aug 10 23:30:30.748132 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:30:30.748132 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:30:30.748132 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: be5ac707f42345efa61f1b7d43b3aa7d Aug 10 23:30:30.748132 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-TestServerMultinode-290189576-project-admin Aug 10 23:30:30.748132 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:30:30.748132 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance 366872ea-7465-47d1-a82c-37e597a5355a could not be found. Aug 10 23:30:30.748132 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': '366872ea-7465-47d1-a82c-37e597a5355a'} Aug 10 23:30:30.748132 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:30:30.748132 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:30:30.748132 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:30:30.748132 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:30:30.748132 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:30:30.748132 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:30:30.748132 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:30:30.748132 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:30:30.748132 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:30:30.748132 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:30:30.748132 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 366872ea-7465-47d1-a82c-37e597a5355a could not be found. Aug 10 23:30:30.748132 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:30:30.748132 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:30:30.748132 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:30:30.748132 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:30:30.748132 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:30:30.748132 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:30:30.748132 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:30:30.748132 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:30:30.748132 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:30:30.748132 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:30:30.748132 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:30:30.748132 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:30:30.748132 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:30:30.748132 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:30:30.748132 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:30:30.748132 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:30:30.748132 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 366872ea-7465-47d1-a82c-37e597a5355a could not be found. Aug 10 23:30:30.748132 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:30:30.748132 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:30:30.748132 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:30:30.752921 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:30:30.752921 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:30:30.752921 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:30:30.752921 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:30:30.752921 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:30:30.752921 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 366872ea-7465-47d1-a82c-37e597a5355a could not be found. Aug 10 23:30:30.752921 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:30:30.752921 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-aa924451-e773-4ed1-94aa-3825c2d56945 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Returning 404 to user: Instance 366872ea-7465-47d1-a82c-37e597a5355a could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:30:30.752921 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-aa924451-e773-4ed1-94aa-3825c2d56945 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/366872ea-7465-47d1-a82c-37e597a5355a" status: 404 len: 111 microversion: 2.1 time: 0.033090 Aug 10 23:30:30.752921 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2986/5762] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:30:30 2022] GET /compute/v2.1/servers/366872ea-7465-47d1-a82c-37e597a5355a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:30:30.766347 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-e44972f4-fb38-4003-a379-7219a5e8b3d1 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:30:30.767171 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-e44972f4-fb38-4003-a379-7219a5e8b3d1 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] [instance: 4764c5fc-edb2-41f3-8884-01cd0f2ef3ce] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:30:30.774508 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e44972f4-fb38-4003-a379-7219a5e8b3d1 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:30.775299 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e44972f4-fb38-4003-a379-7219a5e8b3d1 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:30.775738 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e44972f4-fb38-4003-a379-7219a5e8b3d1 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:30.776657 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e44972f4-fb38-4003-a379-7219a5e8b3d1 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:30.777122 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e44972f4-fb38-4003-a379-7219a5e8b3d1 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:30.777567 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e44972f4-fb38-4003-a379-7219a5e8b3d1 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:30.803854 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-e44972f4-fb38-4003-a379-7219a5e8b3d1 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] [instance: 4764c5fc-edb2-41f3-8884-01cd0f2ef3ce] Going to try to terminate instance {{(pid=122632) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:30:30.885082 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-e44972f4-fb38-4003-a379-7219a5e8b3d1 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] 10.222.0.58 "DELETE /compute/v2.1/servers/4764c5fc-edb2-41f3-8884-01cd0f2ef3ce" status: 204 len: 0 microversion: 2.1 time: 0.122708 Aug 10 23:30:30.885818 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2777/5763] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:30:30 2022] DELETE /compute/v2.1/servers/4764c5fc-edb2-41f3-8884-01cd0f2ef3ce => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:30:30.897318 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-37e84898-8b2c-4da1-81d7-a0f4e20d23ea tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:30:30.897945 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-37e84898-8b2c-4da1-81d7-a0f4e20d23ea tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] [instance: 4764c5fc-edb2-41f3-8884-01cd0f2ef3ce] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:30:30.904081 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-37e84898-8b2c-4da1-81d7-a0f4e20d23ea tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:30.904562 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-37e84898-8b2c-4da1-81d7-a0f4e20d23ea tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:30.905003 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-37e84898-8b2c-4da1-81d7-a0f4e20d23ea tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:30.905702 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-37e84898-8b2c-4da1-81d7-a0f4e20d23ea tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:30.906183 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-37e84898-8b2c-4da1-81d7-a0f4e20d23ea tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:30.906603 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-37e84898-8b2c-4da1-81d7-a0f4e20d23ea tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:31.043054 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-37e84898-8b2c-4da1-81d7-a0f4e20d23ea tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/4764c5fc-edb2-41f3-8884-01cd0f2ef3ce" status: 200 len: 1657 microversion: 2.1 time: 0.151519 Aug 10 23:30:31.043646 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2987/5764] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:30:30 2022] GET /compute/v2.1/servers/4764c5fc-edb2-41f3-8884-01cd0f2ef3ce => generated 1657 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:30:31.400404 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-9e139577-0929-4558-a7b2-11f29a3fbbbf tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:30:31.401112 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-9e139577-0929-4558-a7b2-11f29a3fbbbf tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] [instance: aa0bed62-e734-42e6-9211-88beb761554a] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:30:31.407194 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9e139577-0929-4558-a7b2-11f29a3fbbbf tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:31.407681 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9e139577-0929-4558-a7b2-11f29a3fbbbf tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:31.408121 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9e139577-0929-4558-a7b2-11f29a3fbbbf tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:31.408815 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9e139577-0929-4558-a7b2-11f29a3fbbbf tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:31.409271 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9e139577-0929-4558-a7b2-11f29a3fbbbf tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:31.409701 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9e139577-0929-4558-a7b2-11f29a3fbbbf tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:31.550120 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-9e139577-0929-4558-a7b2-11f29a3fbbbf tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbea80d59f5840f1899bd3cf601ac8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679d43599f3e4c29ab368a1e54dae608', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:30:31.558026 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-9e139577-0929-4558-a7b2-11f29a3fbbbf tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] 10.222.0.58 "GET /compute/v2.1/servers/aa0bed62-e734-42e6-9211-88beb761554a" status: 200 len: 1373 microversion: 2.1 time: 0.161903 Aug 10 23:30:31.558595 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2778/5765] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:30:31 2022] GET /compute/v2.1/servers/aa0bed62-e734-42e6-9211-88beb761554a => generated 1373 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:30:32.064596 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c12aa34b-1de1-4f5f-b447-b5b5e93a0eed tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:30:32.065212 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-c12aa34b-1de1-4f5f-b447-b5b5e93a0eed tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] [instance: 4764c5fc-edb2-41f3-8884-01cd0f2ef3ce] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:30:32.072631 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c12aa34b-1de1-4f5f-b447-b5b5e93a0eed tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:32.073130 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c12aa34b-1de1-4f5f-b447-b5b5e93a0eed tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:32.073572 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c12aa34b-1de1-4f5f-b447-b5b5e93a0eed tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:32.074281 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c12aa34b-1de1-4f5f-b447-b5b5e93a0eed tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:32.074747 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c12aa34b-1de1-4f5f-b447-b5b5e93a0eed tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:32.075207 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c12aa34b-1de1-4f5f-b447-b5b5e93a0eed tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:32.235967 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-c12aa34b-1de1-4f5f-b447-b5b5e93a0eed tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/4764c5fc-edb2-41f3-8884-01cd0f2ef3ce" status: 200 len: 1657 microversion: 2.1 time: 0.174365 Aug 10 23:30:32.236737 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2988/5766] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:30:32 2022] GET /compute/v2.1/servers/4764c5fc-edb2-41f3-8884-01cd0f2ef3ce => generated 1657 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:30:32.579281 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-276fb86f-57b0-4aa9-9368-62ebc030a581 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:30:32.579894 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-276fb86f-57b0-4aa9-9368-62ebc030a581 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] [instance: aa0bed62-e734-42e6-9211-88beb761554a] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:30:32.586987 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-276fb86f-57b0-4aa9-9368-62ebc030a581 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:32.587476 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-276fb86f-57b0-4aa9-9368-62ebc030a581 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:32.587923 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-276fb86f-57b0-4aa9-9368-62ebc030a581 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:32.588621 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-276fb86f-57b0-4aa9-9368-62ebc030a581 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:32.589107 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-276fb86f-57b0-4aa9-9368-62ebc030a581 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:32.589532 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-276fb86f-57b0-4aa9-9368-62ebc030a581 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:32.730382 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-276fb86f-57b0-4aa9-9368-62ebc030a581 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbea80d59f5840f1899bd3cf601ac8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679d43599f3e4c29ab368a1e54dae608', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:30:32.737993 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-276fb86f-57b0-4aa9-9368-62ebc030a581 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] 10.222.0.58 "GET /compute/v2.1/servers/aa0bed62-e734-42e6-9211-88beb761554a" status: 200 len: 1373 microversion: 2.1 time: 0.162626 Aug 10 23:30:32.738761 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2779/5767] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:30:32 2022] GET /compute/v2.1/servers/aa0bed62-e734-42e6-9211-88beb761554a => generated 1373 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:30:33.257797 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-a6b80cdc-cb0c-4c2a-8865-282c02214fb0 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:30:33.258745 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-a6b80cdc-cb0c-4c2a-8865-282c02214fb0 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] [instance: 4764c5fc-edb2-41f3-8884-01cd0f2ef3ce] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:30:33.268516 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a6b80cdc-cb0c-4c2a-8865-282c02214fb0 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:33.271685 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a6b80cdc-cb0c-4c2a-8865-282c02214fb0 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:33.272529 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a6b80cdc-cb0c-4c2a-8865-282c02214fb0 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:33.273300 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a6b80cdc-cb0c-4c2a-8865-282c02214fb0 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:33.273762 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a6b80cdc-cb0c-4c2a-8865-282c02214fb0 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:33.276361 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a6b80cdc-cb0c-4c2a-8865-282c02214fb0 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:33.313057 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:30:33.400747 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-9b451f32-a53d-4a34-847c-7878639589ab tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:30:33.401864 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-9b451f32-a53d-4a34-847c-7878639589ab tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] [instance: 94831c62-29a5-4745-b321-11b28dafaaa6] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:30:33.409389 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9b451f32-a53d-4a34-847c-7878639589ab tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:33.410111 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9b451f32-a53d-4a34-847c-7878639589ab tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:33.410728 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9b451f32-a53d-4a34-847c-7878639589ab tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:33.412200 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9b451f32-a53d-4a34-847c-7878639589ab tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:33.412838 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9b451f32-a53d-4a34-847c-7878639589ab tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:33.413578 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9b451f32-a53d-4a34-847c-7878639589ab tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:33.447312 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-9b451f32-a53d-4a34-847c-7878639589ab tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] [instance: 94831c62-29a5-4745-b321-11b28dafaaa6] Going to try to terminate instance {{(pid=122633) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:30:33.496682 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-a6b80cdc-cb0c-4c2a-8865-282c02214fb0 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/4764c5fc-edb2-41f3-8884-01cd0f2ef3ce" status: 200 len: 1657 microversion: 2.1 time: 0.241628 Aug 10 23:30:33.499379 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2780/5768] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:30:33 2022] GET /compute/v2.1/servers/4764c5fc-edb2-41f3-8884-01cd0f2ef3ce => generated 1657 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:30:33.589963 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-c44e40df-5abb-422f-9b84-be4ffb4db59f req-d7bc701b-9839-42b4-8265-6ed10512108d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4764c5fc-edb2-41f3-8884-01cd0f2ef3ce", "name": "network-vif-deleted", "tag": "17ad154c-1ffd-464b-a705-781a09d97ec0"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:30:33.624423 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-9b451f32-a53d-4a34-847c-7878639589ab tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] 10.222.0.58 "DELETE /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6" status: 204 len: 0 microversion: 2.42 time: 0.475173 Aug 10 23:30:33.629062 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2989/5769] 10.222.0.58 () {60 vars in 1280 bytes} [Wed Aug 10 23:30:33 2022] DELETE /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 10 23:30:33.629242 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-c44e40df-5abb-422f-9b84-be4ffb4db59f req-d7bc701b-9839-42b4-8265-6ed10512108d service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:33.629242 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-c44e40df-5abb-422f-9b84-be4ffb4db59f req-d7bc701b-9839-42b4-8265-6ed10512108d service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:33.629242 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-c44e40df-5abb-422f-9b84-be4ffb4db59f req-d7bc701b-9839-42b4-8265-6ed10512108d service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:33.639249 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-cf320721-1aa1-4299-88d4-b21cd0d653ce tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:30:33.642680 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-cf320721-1aa1-4299-88d4-b21cd0d653ce tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] [instance: 94831c62-29a5-4745-b321-11b28dafaaa6] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:30:33.648313 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-c44e40df-5abb-422f-9b84-be4ffb4db59f req-d7bc701b-9839-42b4-8265-6ed10512108d service nova] Creating event network-vif-deleted:17ad154c-1ffd-464b-a705-781a09d97ec0 for instance 4764c5fc-edb2-41f3-8884-01cd0f2ef3ce on n-h1-850468-14 Aug 10 23:30:33.653781 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-c44e40df-5abb-422f-9b84-be4ffb4db59f req-d7bc701b-9839-42b4-8265-6ed10512108d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071451 Aug 10 23:30:33.654393 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2781/5770] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:30:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:30:33.658147 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cf320721-1aa1-4299-88d4-b21cd0d653ce tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:33.659316 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cf320721-1aa1-4299-88d4-b21cd0d653ce tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:33.659316 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cf320721-1aa1-4299-88d4-b21cd0d653ce tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:33.659937 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cf320721-1aa1-4299-88d4-b21cd0d653ce tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:33.660494 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cf320721-1aa1-4299-88d4-b21cd0d653ce tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:33.660927 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cf320721-1aa1-4299-88d4-b21cd0d653ce tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:33.759566 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c74abbf4-0cc7-4003-9dd3-417a78fb38d5 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:30:33.760283 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-c74abbf4-0cc7-4003-9dd3-417a78fb38d5 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] [instance: aa0bed62-e734-42e6-9211-88beb761554a] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:30:33.766793 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c74abbf4-0cc7-4003-9dd3-417a78fb38d5 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:33.767308 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c74abbf4-0cc7-4003-9dd3-417a78fb38d5 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:33.767910 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c74abbf4-0cc7-4003-9dd3-417a78fb38d5 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:33.768836 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c74abbf4-0cc7-4003-9dd3-417a78fb38d5 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:33.769296 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c74abbf4-0cc7-4003-9dd3-417a78fb38d5 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:33.769730 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c74abbf4-0cc7-4003-9dd3-417a78fb38d5 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:33.883550 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-cf320721-1aa1-4299-88d4-b21cd0d653ce tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:30:33.895595 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-cf320721-1aa1-4299-88d4-b21cd0d653ce tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:30:33.897225 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-cf320721-1aa1-4299-88d4-b21cd0d653ce tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:30:33.898667 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-cf320721-1aa1-4299-88d4-b21cd0d653ce tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] 10.222.0.58 "GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6" status: 200 len: 2959 microversion: 2.42 time: 0.268854 Aug 10 23:30:33.899647 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2990/5771] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:30:33 2022] GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6 => generated 2959 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:30:33.926399 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-c74abbf4-0cc7-4003-9dd3-417a78fb38d5 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbea80d59f5840f1899bd3cf601ac8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679d43599f3e4c29ab368a1e54dae608', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:30:33.948748 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-c74abbf4-0cc7-4003-9dd3-417a78fb38d5 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] 10.222.0.58 "GET /compute/v2.1/servers/aa0bed62-e734-42e6-9211-88beb761554a" status: 200 len: 1373 microversion: 2.1 time: 0.193750 Aug 10 23:30:33.959513 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2782/5772] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:30:33 2022] GET /compute/v2.1/servers/aa0bed62-e734-42e6-9211-88beb761554a => generated 1373 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:30:34.517661 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-44e8b2a3-34db-4519-b8ee-f10982902904 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:30:34.518213 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-44e8b2a3-34db-4519-b8ee-f10982902904 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] [instance: 4764c5fc-edb2-41f3-8884-01cd0f2ef3ce] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:30:34.525459 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-44e8b2a3-34db-4519-b8ee-f10982902904 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:34.525951 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-44e8b2a3-34db-4519-b8ee-f10982902904 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:34.526396 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-44e8b2a3-34db-4519-b8ee-f10982902904 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:34.527135 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-44e8b2a3-34db-4519-b8ee-f10982902904 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:34.527599 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-44e8b2a3-34db-4519-b8ee-f10982902904 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:34.528031 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-44e8b2a3-34db-4519-b8ee-f10982902904 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:34.541899 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-44e8b2a3-34db-4519-b8ee-f10982902904 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] HTTP exception thrown: Instance 4764c5fc-edb2-41f3-8884-01cd0f2ef3ce could not be found. Aug 10 23:30:34.543816 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-44e8b2a3-34db-4519-b8ee-f10982902904 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Request method failure captured: Aug 10 23:30:34.543816 n-d-850468-14 devstack@n-api.service[122633]: request: GET /compute/v2.1/servers/4764c5fc-edb2-41f3-8884-01cd0f2ef3ce HTTP/1.1 Aug 10 23:30:34.543816 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:30:34.543816 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:30:34.543816 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:30:34.543816 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:30:34.543816 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:30:34.543816 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:30:34.543816 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:30:34.543816 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:30:34.543816 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9D9Z1F_RGk_ic_nuOzRa30qql_Fn7tkVDQFFBtMyNZiunDNLbo_RnSuL33E4lL_Rbsz2DeHJE6UcdpjBuXvE1nHwkje3uMKVbjwSGUVXcAI2EYaQqBVcp_zxC7wFU__6CoI7nA1vNG4h3HKl6pAqObftr5byQ9b_skAo-9eK-OBFJww Aug 10 23:30:34.543816 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:30:34.543816 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:30:34.543816 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:30:34.543816 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:30:34.543816 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:30:34.543816 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:30:34.543816 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 05776e7992c34fc6af2152359b7887ba Aug 10 23:30:34.543816 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-TestServerMultinode-290189576 Aug 10 23:30:34.543816 n-d-850468-14 devstack@n-api.service[122633]: X-Role: admin,member,reader Aug 10 23:30:34.543816 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: admin,member,reader Aug 10 23:30:34.543816 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/05776e7992c34fc6af2152359b7887ba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/05776e7992c34fc6af2152359b7887ba"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/05776e7992c34fc6af2152359b7887ba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_05776e7992c34fc6af2152359b7887ba", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:30:34.543816 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-TestServerMultinode-290189576 Aug 10 23:30:34.543816 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 05776e7992c34fc6af2152359b7887ba Aug 10 23:30:34.543816 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-TestServerMultinode-290189576 Aug 10 23:30:34.543816 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-TestServerMultinode-290189576-project-admin Aug 10 23:30:34.543816 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:30:34.543816 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:30:34.543816 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: be5ac707f42345efa61f1b7d43b3aa7d Aug 10 23:30:34.543816 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-TestServerMultinode-290189576-project-admin Aug 10 23:30:34.543816 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:30:34.543816 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance 4764c5fc-edb2-41f3-8884-01cd0f2ef3ce could not be found. Aug 10 23:30:34.543816 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': '4764c5fc-edb2-41f3-8884-01cd0f2ef3ce'} Aug 10 23:30:34.543816 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:30:34.543816 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:30:34.543816 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:30:34.543816 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:30:34.543816 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:30:34.543816 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:30:34.543816 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:30:34.543816 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:30:34.543816 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:30:34.543816 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:30:34.543816 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4764c5fc-edb2-41f3-8884-01cd0f2ef3ce could not be found. Aug 10 23:30:34.543816 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:30:34.543816 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:30:34.543816 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:30:34.543816 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:30:34.543816 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:30:34.543816 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:30:34.543816 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:30:34.543816 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:30:34.543816 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:30:34.543816 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:30:34.543816 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:30:34.543816 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:30:34.543816 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:30:34.543816 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:30:34.543816 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:30:34.543816 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:30:34.543816 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4764c5fc-edb2-41f3-8884-01cd0f2ef3ce could not be found. Aug 10 23:30:34.543816 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:30:34.543816 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:30:34.543816 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:30:34.548892 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:30:34.548892 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:30:34.548892 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:30:34.548892 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:30:34.548892 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:30:34.548892 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4764c5fc-edb2-41f3-8884-01cd0f2ef3ce could not be found. Aug 10 23:30:34.548892 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:30:34.548892 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-44e8b2a3-34db-4519-b8ee-f10982902904 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] Returning 404 to user: Instance 4764c5fc-edb2-41f3-8884-01cd0f2ef3ce could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:30:34.548892 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-44e8b2a3-34db-4519-b8ee-f10982902904 tempest-TestServerMultinode-290189576 tempest-TestServerMultinode-290189576-project-admin] 10.222.0.58 "GET /compute/v2.1/servers/4764c5fc-edb2-41f3-8884-01cd0f2ef3ce" status: 404 len: 111 microversion: 2.1 time: 0.031648 Aug 10 23:30:34.548892 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2991/5773] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:30:34 2022] GET /compute/v2.1/servers/4764c5fc-edb2-41f3-8884-01cd0f2ef3ce => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:30:34.925082 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-576780e0-cd83-436c-a213-b2ba4143e666 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:30:34.925696 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-576780e0-cd83-436c-a213-b2ba4143e666 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] [instance: 94831c62-29a5-4745-b321-11b28dafaaa6] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:30:34.933346 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-576780e0-cd83-436c-a213-b2ba4143e666 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:34.933883 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-576780e0-cd83-436c-a213-b2ba4143e666 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:34.934415 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-576780e0-cd83-436c-a213-b2ba4143e666 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:34.935158 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-576780e0-cd83-436c-a213-b2ba4143e666 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:34.935616 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-576780e0-cd83-436c-a213-b2ba4143e666 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:34.936038 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-576780e0-cd83-436c-a213-b2ba4143e666 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:34.970446 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-4647594e-f5b6-4170-ad4f-9e327812c493 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:30:34.971096 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-4647594e-f5b6-4170-ad4f-9e327812c493 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] [instance: aa0bed62-e734-42e6-9211-88beb761554a] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:30:34.977874 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4647594e-f5b6-4170-ad4f-9e327812c493 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:34.978377 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4647594e-f5b6-4170-ad4f-9e327812c493 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:34.979066 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4647594e-f5b6-4170-ad4f-9e327812c493 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:34.979992 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4647594e-f5b6-4170-ad4f-9e327812c493 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:34.980477 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4647594e-f5b6-4170-ad4f-9e327812c493 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:34.980901 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4647594e-f5b6-4170-ad4f-9e327812c493 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:35.138705 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-576780e0-cd83-436c-a213-b2ba4143e666 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:30:35.149474 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-576780e0-cd83-436c-a213-b2ba4143e666 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:30:35.150947 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-576780e0-cd83-436c-a213-b2ba4143e666 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:30:35.152275 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-576780e0-cd83-436c-a213-b2ba4143e666 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] 10.222.0.58 "GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6" status: 200 len: 2959 microversion: 2.42 time: 0.231194 Aug 10 23:30:35.152867 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2783/5774] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:30:34 2022] GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6 => generated 2959 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:30:35.477977 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-4647594e-f5b6-4170-ad4f-9e327812c493 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbea80d59f5840f1899bd3cf601ac8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679d43599f3e4c29ab368a1e54dae608', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:30:35.485774 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-4647594e-f5b6-4170-ad4f-9e327812c493 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] 10.222.0.58 "GET /compute/v2.1/servers/aa0bed62-e734-42e6-9211-88beb761554a" status: 200 len: 1373 microversion: 2.1 time: 0.519337 Aug 10 23:30:35.486386 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2992/5775] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:30:34 2022] GET /compute/v2.1/servers/aa0bed62-e734-42e6-9211-88beb761554a => generated 1373 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:30:35.745613 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-1b8b364a-c0ed-4c34-a143-27182f05666e req-33e4dfb5-dc9c-4e25-8d04-387bb8a90bba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa0bed62-e734-42e6-9211-88beb761554a", "name": "network-vif-plugged", "status": "completed", "tag": "ac21225a-7b86-4858-a07c-e2c383b8308b"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:30:35.755608 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-1b8b364a-c0ed-4c34-a143-27182f05666e req-33e4dfb5-dc9c-4e25-8d04-387bb8a90bba service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:35.756639 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-1b8b364a-c0ed-4c34-a143-27182f05666e req-33e4dfb5-dc9c-4e25-8d04-387bb8a90bba service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:35.757295 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-1b8b364a-c0ed-4c34-a143-27182f05666e req-33e4dfb5-dc9c-4e25-8d04-387bb8a90bba service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:35.769852 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-1b8b364a-c0ed-4c34-a143-27182f05666e req-33e4dfb5-dc9c-4e25-8d04-387bb8a90bba service nova] Creating event network-vif-plugged:ac21225a-7b86-4858-a07c-e2c383b8308b for instance aa0bed62-e734-42e6-9211-88beb761554a on n-h1-850468-14 Aug 10 23:30:35.776056 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-1b8b364a-c0ed-4c34-a143-27182f05666e req-33e4dfb5-dc9c-4e25-8d04-387bb8a90bba service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034769 Aug 10 23:30:35.776914 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2784/5776] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:30:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:30:36.182349 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-7b9ebdc0-bc9b-4a78-91e8-bf0eff2d2acc tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:30:36.183507 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-7b9ebdc0-bc9b-4a78-91e8-bf0eff2d2acc tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] [instance: 94831c62-29a5-4745-b321-11b28dafaaa6] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:30:36.191218 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7b9ebdc0-bc9b-4a78-91e8-bf0eff2d2acc tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:36.191716 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7b9ebdc0-bc9b-4a78-91e8-bf0eff2d2acc tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:36.192165 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7b9ebdc0-bc9b-4a78-91e8-bf0eff2d2acc tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:36.194229 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7b9ebdc0-bc9b-4a78-91e8-bf0eff2d2acc tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:36.194229 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7b9ebdc0-bc9b-4a78-91e8-bf0eff2d2acc tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:36.194465 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7b9ebdc0-bc9b-4a78-91e8-bf0eff2d2acc tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:36.471112 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-7b9ebdc0-bc9b-4a78-91e8-bf0eff2d2acc tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:30:36.480386 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-7b9ebdc0-bc9b-4a78-91e8-bf0eff2d2acc tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:30:36.481905 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-7b9ebdc0-bc9b-4a78-91e8-bf0eff2d2acc tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:30:36.483207 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-7b9ebdc0-bc9b-4a78-91e8-bf0eff2d2acc tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] 10.222.0.58 "GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6" status: 200 len: 2959 microversion: 2.42 time: 0.305515 Aug 10 23:30:36.483789 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2993/5777] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:30:36 2022] GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6 => generated 2959 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:30:36.509860 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-28766341-461d-4b13-abf8-21278c1be311 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:30:36.510482 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-28766341-461d-4b13-abf8-21278c1be311 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] [instance: aa0bed62-e734-42e6-9211-88beb761554a] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:30:36.516805 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-28766341-461d-4b13-abf8-21278c1be311 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:36.517306 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-28766341-461d-4b13-abf8-21278c1be311 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:36.517752 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-28766341-461d-4b13-abf8-21278c1be311 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:36.518464 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-28766341-461d-4b13-abf8-21278c1be311 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:36.519128 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-28766341-461d-4b13-abf8-21278c1be311 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:36.519740 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-28766341-461d-4b13-abf8-21278c1be311 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:36.696738 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-28766341-461d-4b13-abf8-21278c1be311 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbea80d59f5840f1899bd3cf601ac8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679d43599f3e4c29ab368a1e54dae608', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:30:36.708354 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-28766341-461d-4b13-abf8-21278c1be311 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] 10.222.0.58 "GET /compute/v2.1/servers/aa0bed62-e734-42e6-9211-88beb761554a" status: 200 len: 1373 microversion: 2.1 time: 0.203546 Aug 10 23:30:36.710058 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2785/5778] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:30:36 2022] GET /compute/v2.1/servers/aa0bed62-e734-42e6-9211-88beb761554a => generated 1373 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:30:37.508441 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-6b03bc5e-7941-472c-b354-2bd66075da98 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:30:37.531434 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-6b03bc5e-7941-472c-b354-2bd66075da98 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] [instance: 94831c62-29a5-4745-b321-11b28dafaaa6] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:30:37.546982 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_api:SELECT=88,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:30:37.561847 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6b03bc5e-7941-472c-b354-2bd66075da98 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:37.562393 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6b03bc5e-7941-472c-b354-2bd66075da98 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:37.565201 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6b03bc5e-7941-472c-b354-2bd66075da98 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:37.566335 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6b03bc5e-7941-472c-b354-2bd66075da98 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:37.569533 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6b03bc5e-7941-472c-b354-2bd66075da98 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:37.570221 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6b03bc5e-7941-472c-b354-2bd66075da98 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:37.732614 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-1231de13-b638-4945-94c8-c7e633f210e4 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:30:37.734197 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-1231de13-b638-4945-94c8-c7e633f210e4 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] [instance: aa0bed62-e734-42e6-9211-88beb761554a] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:30:37.737463 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=2 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:30:37.738406 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=10 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:30:37.745376 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1231de13-b638-4945-94c8-c7e633f210e4 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:37.745880 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1231de13-b638-4945-94c8-c7e633f210e4 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:37.746323 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1231de13-b638-4945-94c8-c7e633f210e4 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:37.747309 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1231de13-b638-4945-94c8-c7e633f210e4 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:37.747881 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1231de13-b638-4945-94c8-c7e633f210e4 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:37.748266 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1231de13-b638-4945-94c8-c7e633f210e4 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:37.885623 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=2 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:30:37.906397 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-1231de13-b638-4945-94c8-c7e633f210e4 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbea80d59f5840f1899bd3cf601ac8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679d43599f3e4c29ab368a1e54dae608', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:30:37.917003 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-1231de13-b638-4945-94c8-c7e633f210e4 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] 10.222.0.58 "GET /compute/v2.1/servers/aa0bed62-e734-42e6-9211-88beb761554a" status: 200 len: 1546 microversion: 2.1 time: 0.188783 Aug 10 23:30:37.918153 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2786/5779] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:30:37 2022] GET /compute/v2.1/servers/aa0bed62-e734-42e6-9211-88beb761554a => generated 1546 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:30:37.938883 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-b4cad4f1-5f07-447c-86e4-c0627fd7b264 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:30:37.939780 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-b4cad4f1-5f07-447c-86e4-c0627fd7b264 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] [instance: aa0bed62-e734-42e6-9211-88beb761554a] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:30:37.947493 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b4cad4f1-5f07-447c-86e4-c0627fd7b264 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:37.947871 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b4cad4f1-5f07-447c-86e4-c0627fd7b264 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:37.974225 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b4cad4f1-5f07-447c-86e4-c0627fd7b264 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:37.980872 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b4cad4f1-5f07-447c-86e4-c0627fd7b264 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:37.981460 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b4cad4f1-5f07-447c-86e4-c0627fd7b264 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:37.982089 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b4cad4f1-5f07-447c-86e4-c0627fd7b264 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:38.030911 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-6b03bc5e-7941-472c-b354-2bd66075da98 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:30:38.049723 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-6b03bc5e-7941-472c-b354-2bd66075da98 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:30:38.051595 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-6b03bc5e-7941-472c-b354-2bd66075da98 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:30:38.059719 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-6b03bc5e-7941-472c-b354-2bd66075da98 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] 10.222.0.58 "GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6" status: 200 len: 2959 microversion: 2.42 time: 0.555940 Aug 10 23:30:38.060715 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2994/5780] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:30:37 2022] GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6 => generated 2959 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:30:38.354761 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-b4cad4f1-5f07-447c-86e4-c0627fd7b264 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbea80d59f5840f1899bd3cf601ac8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679d43599f3e4c29ab368a1e54dae608', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:30:38.362577 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-b4cad4f1-5f07-447c-86e4-c0627fd7b264 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] 10.222.0.58 "GET /compute/v2.1/servers/aa0bed62-e734-42e6-9211-88beb761554a" status: 200 len: 1546 microversion: 2.1 time: 0.427536 Aug 10 23:30:38.363585 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2787/5781] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:30:37 2022] GET /compute/v2.1/servers/aa0bed62-e734-42e6-9211-88beb761554a => generated 1546 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:30:39.091395 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-721cfe61-0336-494a-a321-ed00f79c1828 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:30:39.092056 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-721cfe61-0336-494a-a321-ed00f79c1828 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] [instance: 94831c62-29a5-4745-b321-11b28dafaaa6] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:30:39.102510 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-721cfe61-0336-494a-a321-ed00f79c1828 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:39.103403 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-721cfe61-0336-494a-a321-ed00f79c1828 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:39.104252 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-721cfe61-0336-494a-a321-ed00f79c1828 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:39.105296 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-721cfe61-0336-494a-a321-ed00f79c1828 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:39.106214 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-721cfe61-0336-494a-a321-ed00f79c1828 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:39.106906 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-721cfe61-0336-494a-a321-ed00f79c1828 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:39.765427 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-721cfe61-0336-494a-a321-ed00f79c1828 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:30:39.788458 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-721cfe61-0336-494a-a321-ed00f79c1828 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:30:39.791167 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-721cfe61-0336-494a-a321-ed00f79c1828 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:30:39.793372 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-721cfe61-0336-494a-a321-ed00f79c1828 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] 10.222.0.58 "GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6" status: 200 len: 2938 microversion: 2.42 time: 0.706657 Aug 10 23:30:39.794518 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2995/5782] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:30:39 2022] GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6 => generated 2938 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:30:40.287700 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-3a8f047c-fa90-40f3-9dfb-9e23fdfbeba0 req-c098f1e8-268b-4309-9da7-0df4ed99cdeb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94831c62-29a5-4745-b321-11b28dafaaa6", "name": "network-vif-unplugged", "status": "completed", "tag": "6ee28c71-7f46-4357-91a2-e3f81d338784"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:30:40.300785 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-3a8f047c-fa90-40f3-9dfb-9e23fdfbeba0 req-c098f1e8-268b-4309-9da7-0df4ed99cdeb service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:40.301899 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-3a8f047c-fa90-40f3-9dfb-9e23fdfbeba0 req-c098f1e8-268b-4309-9da7-0df4ed99cdeb service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:40.302546 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-3a8f047c-fa90-40f3-9dfb-9e23fdfbeba0 req-c098f1e8-268b-4309-9da7-0df4ed99cdeb service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:40.338879 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-3a8f047c-fa90-40f3-9dfb-9e23fdfbeba0 req-c098f1e8-268b-4309-9da7-0df4ed99cdeb service nova] Creating event network-vif-unplugged:6ee28c71-7f46-4357-91a2-e3f81d338784 for instance 94831c62-29a5-4745-b321-11b28dafaaa6 on n-h2-850468-14 Aug 10 23:30:40.358768 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-3a8f047c-fa90-40f3-9dfb-9e23fdfbeba0 req-c098f1e8-268b-4309-9da7-0df4ed99cdeb service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.078290 Aug 10 23:30:40.360075 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2788/5783] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:30:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:30:40.823328 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-3e422e3c-daf5-464f-b145-a67e87a47478 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:30:40.823944 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-3e422e3c-daf5-464f-b145-a67e87a47478 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] [instance: 94831c62-29a5-4745-b321-11b28dafaaa6] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:30:40.836102 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3e422e3c-daf5-464f-b145-a67e87a47478 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:40.838846 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3e422e3c-daf5-464f-b145-a67e87a47478 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:40.839514 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3e422e3c-daf5-464f-b145-a67e87a47478 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:40.842165 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3e422e3c-daf5-464f-b145-a67e87a47478 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:40.842874 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3e422e3c-daf5-464f-b145-a67e87a47478 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:40.845317 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3e422e3c-daf5-464f-b145-a67e87a47478 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:41.217728 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-fa27ed19-ead2-45e2-8b96-8dd0e91132ac req-529cb8cc-7ba1-472e-aefc-7e40c9113a6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94831c62-29a5-4745-b321-11b28dafaaa6", "name": "network-vif-deleted", "tag": "a925a35c-5deb-47db-b01a-bff542b92a26"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:30:41.240211 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-fa27ed19-ead2-45e2-8b96-8dd0e91132ac req-529cb8cc-7ba1-472e-aefc-7e40c9113a6c service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:41.240686 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-fa27ed19-ead2-45e2-8b96-8dd0e91132ac req-529cb8cc-7ba1-472e-aefc-7e40c9113a6c service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:41.243812 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-fa27ed19-ead2-45e2-8b96-8dd0e91132ac req-529cb8cc-7ba1-472e-aefc-7e40c9113a6c service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:41.272574 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-fa27ed19-ead2-45e2-8b96-8dd0e91132ac req-529cb8cc-7ba1-472e-aefc-7e40c9113a6c service nova] Creating event network-vif-deleted:a925a35c-5deb-47db-b01a-bff542b92a26 for instance 94831c62-29a5-4745-b321-11b28dafaaa6 on n-h2-850468-14 Aug 10 23:30:41.290188 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-fa27ed19-ead2-45e2-8b96-8dd0e91132ac req-529cb8cc-7ba1-472e-aefc-7e40c9113a6c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078341 Aug 10 23:30:41.291193 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2789/5784] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:30:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 23:30:41.475862 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-dfda4fe4-a6a2-43e3-8f1e-bea3dace3a0c req-3ae23bd2-6f33-49ab-b398-e554bfc70e14 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa0bed62-e734-42e6-9211-88beb761554a", "tag": "ac21225a-7b86-4858-a07c-e2c383b8308b"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:30:41.485051 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:30:41.496859 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-dfda4fe4-a6a2-43e3-8f1e-bea3dace3a0c req-3ae23bd2-6f33-49ab-b398-e554bfc70e14 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:41.498094 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-dfda4fe4-a6a2-43e3-8f1e-bea3dace3a0c req-3ae23bd2-6f33-49ab-b398-e554bfc70e14 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:41.501414 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-dfda4fe4-a6a2-43e3-8f1e-bea3dace3a0c req-3ae23bd2-6f33-49ab-b398-e554bfc70e14 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:41.540937 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-dfda4fe4-a6a2-43e3-8f1e-bea3dace3a0c req-3ae23bd2-6f33-49ab-b398-e554bfc70e14 service nova] Creating event network-changed:ac21225a-7b86-4858-a07c-e2c383b8308b for instance aa0bed62-e734-42e6-9211-88beb761554a on n-h1-850468-14 Aug 10 23:30:41.559577 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-dfda4fe4-a6a2-43e3-8f1e-bea3dace3a0c req-3ae23bd2-6f33-49ab-b398-e554bfc70e14 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084274 Aug 10 23:30:41.560449 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2790/5785] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:30:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 23:30:41.699792 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-3e422e3c-daf5-464f-b145-a67e87a47478 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:30:41.710670 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-3e422e3c-daf5-464f-b145-a67e87a47478 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:30:41.712472 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-3e422e3c-daf5-464f-b145-a67e87a47478 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:30:41.714576 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-3e422e3c-daf5-464f-b145-a67e87a47478 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] 10.222.0.58 "GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6" status: 200 len: 2870 microversion: 2.42 time: 0.896726 Aug 10 23:30:41.734137 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2996/5786] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:30:40 2022] GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6 => generated 2870 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:30:42.399722 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-4145c115-ccfb-4f4d-b79a-48d9ee982d1a req-e52aad41-749d-4479-9207-27df0892f046 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94831c62-29a5-4745-b321-11b28dafaaa6", "name": "network-vif-unplugged", "status": "completed", "tag": "a925a35c-5deb-47db-b01a-bff542b92a26"}, {"server_uuid": "94831c62-29a5-4745-b321-11b28dafaaa6", "name": "network-vif-unplugged", "status": "completed", "tag": "4ea7c095-71fb-40ed-b707-b71bba302403"}, {"server_uuid": "94831c62-29a5-4745-b321-11b28dafaaa6", "name": "network-vif-unplugged", "status": "completed", "tag": "cd619ffb-72c7-4f4d-88b0-2923eb1f3d04"}, {"server_uuid": "94831c62-29a5-4745-b321-11b28dafaaa6", "name": "network-vif-unplugged", "status": "completed", "tag": "c9cab9a2-351a-4700-9d8b-f72f4f00057f"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:30:42.412614 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-4145c115-ccfb-4f4d-b79a-48d9ee982d1a req-e52aad41-749d-4479-9207-27df0892f046 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:42.414479 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-4145c115-ccfb-4f4d-b79a-48d9ee982d1a req-e52aad41-749d-4479-9207-27df0892f046 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:42.415299 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-4145c115-ccfb-4f4d-b79a-48d9ee982d1a req-e52aad41-749d-4479-9207-27df0892f046 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:42.428214 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-4145c115-ccfb-4f4d-b79a-48d9ee982d1a req-e52aad41-749d-4479-9207-27df0892f046 service nova] Creating event network-vif-unplugged:a925a35c-5deb-47db-b01a-bff542b92a26 for instance 94831c62-29a5-4745-b321-11b28dafaaa6 on n-h2-850468-14 Aug 10 23:30:42.430005 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-4145c115-ccfb-4f4d-b79a-48d9ee982d1a req-e52aad41-749d-4479-9207-27df0892f046 service nova] Creating event network-vif-unplugged:4ea7c095-71fb-40ed-b707-b71bba302403 for instance 94831c62-29a5-4745-b321-11b28dafaaa6 on n-h2-850468-14 Aug 10 23:30:42.430688 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-4145c115-ccfb-4f4d-b79a-48d9ee982d1a req-e52aad41-749d-4479-9207-27df0892f046 service nova] Creating event network-vif-unplugged:cd619ffb-72c7-4f4d-88b0-2923eb1f3d04 for instance 94831c62-29a5-4745-b321-11b28dafaaa6 on n-h2-850468-14 Aug 10 23:30:42.431480 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-4145c115-ccfb-4f4d-b79a-48d9ee982d1a req-e52aad41-749d-4479-9207-27df0892f046 service nova] Creating event network-vif-unplugged:c9cab9a2-351a-4700-9d8b-f72f4f00057f for instance 94831c62-29a5-4745-b321-11b28dafaaa6 on n-h2-850468-14 Aug 10 23:30:42.437961 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-4145c115-ccfb-4f4d-b79a-48d9ee982d1a req-e52aad41-749d-4479-9207-27df0892f046 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 704 microversion: 2.1 time: 0.046957 Aug 10 23:30:42.438856 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2791/5787] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:30:42 2022] POST /compute/v2.1/os-server-external-events => generated 704 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:30:42.745285 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-94b7ee8a-96d0-4b00-8f0d-89cbc884adde tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:30:42.748422 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-94b7ee8a-96d0-4b00-8f0d-89cbc884adde tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] [instance: 94831c62-29a5-4745-b321-11b28dafaaa6] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:30:42.768026 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-94b7ee8a-96d0-4b00-8f0d-89cbc884adde tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:42.769777 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-94b7ee8a-96d0-4b00-8f0d-89cbc884adde tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:42.770747 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-94b7ee8a-96d0-4b00-8f0d-89cbc884adde tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:42.781851 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-94b7ee8a-96d0-4b00-8f0d-89cbc884adde tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:42.781976 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-94b7ee8a-96d0-4b00-8f0d-89cbc884adde tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:42.783734 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-94b7ee8a-96d0-4b00-8f0d-89cbc884adde tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:43.337624 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-94b7ee8a-96d0-4b00-8f0d-89cbc884adde tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:30:43.354857 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-94b7ee8a-96d0-4b00-8f0d-89cbc884adde tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:30:43.356385 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-94b7ee8a-96d0-4b00-8f0d-89cbc884adde tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:30:43.357758 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-94b7ee8a-96d0-4b00-8f0d-89cbc884adde tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] 10.222.0.58 "GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6" status: 200 len: 2709 microversion: 2.42 time: 0.620438 Aug 10 23:30:43.358334 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2997/5788] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:30:42 2022] GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6 => generated 2709 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:30:43.375162 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-11ada2e3-57e8-48f0-a166-6b92a2cd6f68 req-90f9935d-364d-4050-9475-69432da69753 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94831c62-29a5-4745-b321-11b28dafaaa6", "name": "network-vif-deleted", "tag": "4ea7c095-71fb-40ed-b707-b71bba302403"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:30:43.395319 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-11ada2e3-57e8-48f0-a166-6b92a2cd6f68 req-90f9935d-364d-4050-9475-69432da69753 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:43.396085 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-11ada2e3-57e8-48f0-a166-6b92a2cd6f68 req-90f9935d-364d-4050-9475-69432da69753 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:43.396708 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-11ada2e3-57e8-48f0-a166-6b92a2cd6f68 req-90f9935d-364d-4050-9475-69432da69753 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:43.425543 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-11ada2e3-57e8-48f0-a166-6b92a2cd6f68 req-90f9935d-364d-4050-9475-69432da69753 service nova] Creating event network-vif-deleted:4ea7c095-71fb-40ed-b707-b71bba302403 for instance 94831c62-29a5-4745-b321-11b28dafaaa6 on n-h2-850468-14 Aug 10 23:30:43.433575 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-11ada2e3-57e8-48f0-a166-6b92a2cd6f68 req-90f9935d-364d-4050-9475-69432da69753 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061440 Aug 10 23:30:43.437004 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2792/5789] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:30:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 23:30:44.393427 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-a76629ad-002e-4993-8e64-c8b6bab3244a tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:30:44.401375 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-a76629ad-002e-4993-8e64-c8b6bab3244a tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] [instance: 94831c62-29a5-4745-b321-11b28dafaaa6] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:30:44.414008 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a76629ad-002e-4993-8e64-c8b6bab3244a tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:44.414495 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a76629ad-002e-4993-8e64-c8b6bab3244a tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:44.423641 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a76629ad-002e-4993-8e64-c8b6bab3244a tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:44.424427 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a76629ad-002e-4993-8e64-c8b6bab3244a tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:44.424915 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a76629ad-002e-4993-8e64-c8b6bab3244a tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:44.425560 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a76629ad-002e-4993-8e64-c8b6bab3244a tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:44.734228 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-a76629ad-002e-4993-8e64-c8b6bab3244a tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:30:44.750647 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-a76629ad-002e-4993-8e64-c8b6bab3244a tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:30:44.752039 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-a76629ad-002e-4993-8e64-c8b6bab3244a tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:30:44.752994 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-a76629ad-002e-4993-8e64-c8b6bab3244a tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] 10.222.0.58 "GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6" status: 200 len: 2504 microversion: 2.42 time: 0.363716 Aug 10 23:30:44.755932 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2998/5790] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:30:44 2022] GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6 => generated 2504 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:30:45.709285 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-12583e51-295b-4674-ab6d-fdab184073ad req-fa4f4995-59cd-42fe-a612-647124440f4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94831c62-29a5-4745-b321-11b28dafaaa6", "name": "network-vif-deleted", "tag": "cd619ffb-72c7-4f4d-88b0-2923eb1f3d04"}, {"server_uuid": "94831c62-29a5-4745-b321-11b28dafaaa6", "name": "network-vif-deleted", "tag": "c9cab9a2-351a-4700-9d8b-f72f4f00057f"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:30:45.752278 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-12583e51-295b-4674-ab6d-fdab184073ad req-fa4f4995-59cd-42fe-a612-647124440f4a service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:45.752775 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-12583e51-295b-4674-ab6d-fdab184073ad req-fa4f4995-59cd-42fe-a612-647124440f4a service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:45.764484 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-12583e51-295b-4674-ab6d-fdab184073ad req-fa4f4995-59cd-42fe-a612-647124440f4a service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:45.793814 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-1c6373c6-e673-4da5-8a4b-6939fb596f29 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:30:45.796224 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-1c6373c6-e673-4da5-8a4b-6939fb596f29 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] [instance: 94831c62-29a5-4745-b321-11b28dafaaa6] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:30:45.801328 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-12583e51-295b-4674-ab6d-fdab184073ad req-fa4f4995-59cd-42fe-a612-647124440f4a service nova] Creating event network-vif-deleted:cd619ffb-72c7-4f4d-88b0-2923eb1f3d04 for instance 94831c62-29a5-4745-b321-11b28dafaaa6 on n-h2-850468-14 Aug 10 23:30:45.805174 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-12583e51-295b-4674-ab6d-fdab184073ad req-fa4f4995-59cd-42fe-a612-647124440f4a service nova] Creating event network-vif-deleted:c9cab9a2-351a-4700-9d8b-f72f4f00057f for instance 94831c62-29a5-4745-b321-11b28dafaaa6 on n-h2-850468-14 Aug 10 23:30:45.821871 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-12583e51-295b-4674-ab6d-fdab184073ad req-fa4f4995-59cd-42fe-a612-647124440f4a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.115428 Aug 10 23:30:45.823817 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2793/5791] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:30:45 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:30:45.828691 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1c6373c6-e673-4da5-8a4b-6939fb596f29 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:45.829651 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1c6373c6-e673-4da5-8a4b-6939fb596f29 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:45.830268 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1c6373c6-e673-4da5-8a4b-6939fb596f29 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:45.831227 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1c6373c6-e673-4da5-8a4b-6939fb596f29 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:45.831877 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1c6373c6-e673-4da5-8a4b-6939fb596f29 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:45.832744 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1c6373c6-e673-4da5-8a4b-6939fb596f29 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:46.473761 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-1c6373c6-e673-4da5-8a4b-6939fb596f29 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:30:46.484966 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-1c6373c6-e673-4da5-8a4b-6939fb596f29 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:30:46.487186 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-1c6373c6-e673-4da5-8a4b-6939fb596f29 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:30:46.488684 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-1c6373c6-e673-4da5-8a4b-6939fb596f29 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] 10.222.0.58 "GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6" status: 200 len: 2457 microversion: 2.42 time: 0.708071 Aug 10 23:30:46.490432 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 2999/5792] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:30:45 2022] GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6 => generated 2457 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 23:30:47.535710 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-a4109a91-db31-41fc-a4d4-a90b42461c28 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:30:47.537000 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-a4109a91-db31-41fc-a4d4-a90b42461c28 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] [instance: 94831c62-29a5-4745-b321-11b28dafaaa6] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:30:47.545326 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a4109a91-db31-41fc-a4d4-a90b42461c28 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:47.546057 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a4109a91-db31-41fc-a4d4-a90b42461c28 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:47.546723 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a4109a91-db31-41fc-a4d4-a90b42461c28 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:47.547786 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a4109a91-db31-41fc-a4d4-a90b42461c28 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:47.548632 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a4109a91-db31-41fc-a4d4-a90b42461c28 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:47.549278 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a4109a91-db31-41fc-a4d4-a90b42461c28 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:47.864134 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-af2c7203-03f5-48ac-850c-8729fe745f86 req-95ddbbd3-2ba3-42aa-8d9b-e002429ba3cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94831c62-29a5-4745-b321-11b28dafaaa6", "name": "network-vif-deleted", "tag": "6ee28c71-7f46-4357-91a2-e3f81d338784"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:30:47.883637 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-af2c7203-03f5-48ac-850c-8729fe745f86 req-95ddbbd3-2ba3-42aa-8d9b-e002429ba3cd service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:47.890576 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-af2c7203-03f5-48ac-850c-8729fe745f86 req-95ddbbd3-2ba3-42aa-8d9b-e002429ba3cd service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:47.891262 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-af2c7203-03f5-48ac-850c-8729fe745f86 req-95ddbbd3-2ba3-42aa-8d9b-e002429ba3cd service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:47.916197 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-af2c7203-03f5-48ac-850c-8729fe745f86 req-95ddbbd3-2ba3-42aa-8d9b-e002429ba3cd service nova] Creating event network-vif-deleted:6ee28c71-7f46-4357-91a2-e3f81d338784 for instance 94831c62-29a5-4745-b321-11b28dafaaa6 on n-h2-850468-14 Aug 10 23:30:47.931270 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-af2c7203-03f5-48ac-850c-8729fe745f86 req-95ddbbd3-2ba3-42aa-8d9b-e002429ba3cd service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070656 Aug 10 23:30:47.932652 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3000/5793] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:30:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 23:30:48.416051 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-a4109a91-db31-41fc-a4d4-a90b42461c28 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:30:48.432698 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-a4109a91-db31-41fc-a4d4-a90b42461c28 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:30:48.439715 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-a4109a91-db31-41fc-a4d4-a90b42461c28 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:30:48.441246 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-a4109a91-db31-41fc-a4d4-a90b42461c28 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] 10.222.0.58 "GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6" status: 200 len: 1602 microversion: 2.42 time: 0.921288 Aug 10 23:30:48.442532 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2794/5794] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:30:47 2022] GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6 => generated 1602 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:30:49.468628 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-bbd010c5-cf36-4cc5-b297-1a5023a8c680 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:30:49.469604 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-bbd010c5-cf36-4cc5-b297-1a5023a8c680 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] [instance: 94831c62-29a5-4745-b321-11b28dafaaa6] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:30:49.477399 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bbd010c5-cf36-4cc5-b297-1a5023a8c680 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:49.478096 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bbd010c5-cf36-4cc5-b297-1a5023a8c680 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:49.478690 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bbd010c5-cf36-4cc5-b297-1a5023a8c680 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:49.479568 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bbd010c5-cf36-4cc5-b297-1a5023a8c680 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:49.480182 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bbd010c5-cf36-4cc5-b297-1a5023a8c680 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:49.480713 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bbd010c5-cf36-4cc5-b297-1a5023a8c680 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:49.556262 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-bbd010c5-cf36-4cc5-b297-1a5023a8c680 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:30:49.566506 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-bbd010c5-cf36-4cc5-b297-1a5023a8c680 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:30:49.568395 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-bbd010c5-cf36-4cc5-b297-1a5023a8c680 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:30:49.569632 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-bbd010c5-cf36-4cc5-b297-1a5023a8c680 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] 10.222.0.58 "GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6" status: 200 len: 1602 microversion: 2.42 time: 0.105522 Aug 10 23:30:49.570512 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3001/5795] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:30:49 2022] GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6 => generated 1602 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 23:30:50.593837 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-fced0a09-25dd-4e14-8a83-1747eee97c6a tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:30:50.594455 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-fced0a09-25dd-4e14-8a83-1747eee97c6a tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] [instance: 94831c62-29a5-4745-b321-11b28dafaaa6] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:30:50.602170 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fced0a09-25dd-4e14-8a83-1747eee97c6a tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:50.603698 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fced0a09-25dd-4e14-8a83-1747eee97c6a tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:50.604251 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fced0a09-25dd-4e14-8a83-1747eee97c6a tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:50.604981 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fced0a09-25dd-4e14-8a83-1747eee97c6a tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:50.605439 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fced0a09-25dd-4e14-8a83-1747eee97c6a tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:50.605864 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fced0a09-25dd-4e14-8a83-1747eee97c6a tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:50.679202 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-fced0a09-25dd-4e14-8a83-1747eee97c6a tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:30:50.689554 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-fced0a09-25dd-4e14-8a83-1747eee97c6a tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:30:50.691080 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-fced0a09-25dd-4e14-8a83-1747eee97c6a tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:30:50.692269 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-fced0a09-25dd-4e14-8a83-1747eee97c6a tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] 10.222.0.58 "GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6" status: 200 len: 1602 microversion: 2.42 time: 0.102423 Aug 10 23:30:50.692833 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2795/5796] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:30:50 2022] GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6 => generated 1602 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:30:51.716947 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-347cfb52-4abe-4c2b-b2f8-265dfb246cb6 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:30:51.717508 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-347cfb52-4abe-4c2b-b2f8-265dfb246cb6 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] [instance: 94831c62-29a5-4745-b321-11b28dafaaa6] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:30:51.724818 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-347cfb52-4abe-4c2b-b2f8-265dfb246cb6 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:51.725309 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-347cfb52-4abe-4c2b-b2f8-265dfb246cb6 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:51.725748 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-347cfb52-4abe-4c2b-b2f8-265dfb246cb6 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:51.726450 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-347cfb52-4abe-4c2b-b2f8-265dfb246cb6 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:51.726927 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-347cfb52-4abe-4c2b-b2f8-265dfb246cb6 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:51.727396 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-347cfb52-4abe-4c2b-b2f8-265dfb246cb6 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:51.795839 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-347cfb52-4abe-4c2b-b2f8-265dfb246cb6 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:30:51.798248 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:30:51.807855 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-347cfb52-4abe-4c2b-b2f8-265dfb246cb6 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:30:51.809485 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-347cfb52-4abe-4c2b-b2f8-265dfb246cb6 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:30:51.810759 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-347cfb52-4abe-4c2b-b2f8-265dfb246cb6 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] 10.222.0.58 "GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6" status: 200 len: 1602 microversion: 2.42 time: 0.098653 Aug 10 23:30:51.811430 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3002/5797] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:30:51 2022] GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6 => generated 1602 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:30:52.835730 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-2ca32359-879a-450d-8c4b-85f48df6bc91 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:30:52.836354 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-2ca32359-879a-450d-8c4b-85f48df6bc91 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] [instance: 94831c62-29a5-4745-b321-11b28dafaaa6] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:30:52.843904 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2ca32359-879a-450d-8c4b-85f48df6bc91 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:52.844426 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2ca32359-879a-450d-8c4b-85f48df6bc91 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:52.844868 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2ca32359-879a-450d-8c4b-85f48df6bc91 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:52.845584 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2ca32359-879a-450d-8c4b-85f48df6bc91 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:52.846044 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2ca32359-879a-450d-8c4b-85f48df6bc91 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:52.846477 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2ca32359-879a-450d-8c4b-85f48df6bc91 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:52.920823 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-2ca32359-879a-450d-8c4b-85f48df6bc91 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:30:52.930721 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-2ca32359-879a-450d-8c4b-85f48df6bc91 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:30:52.932291 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-2ca32359-879a-450d-8c4b-85f48df6bc91 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:30:52.933548 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-2ca32359-879a-450d-8c4b-85f48df6bc91 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] 10.222.0.58 "GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6" status: 200 len: 1602 microversion: 2.42 time: 0.101742 Aug 10 23:30:52.934155 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2796/5798] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:30:52 2022] GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6 => generated 1602 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:30:53.958229 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-97dc2012-087a-4971-9767-5083cc45dd1a tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:30:53.958886 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-97dc2012-087a-4971-9767-5083cc45dd1a tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] [instance: 94831c62-29a5-4745-b321-11b28dafaaa6] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:30:53.968003 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-97dc2012-087a-4971-9767-5083cc45dd1a tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:53.968497 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-97dc2012-087a-4971-9767-5083cc45dd1a tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:53.968947 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-97dc2012-087a-4971-9767-5083cc45dd1a tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:53.969684 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-97dc2012-087a-4971-9767-5083cc45dd1a tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:53.970140 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-97dc2012-087a-4971-9767-5083cc45dd1a tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:53.970576 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-97dc2012-087a-4971-9767-5083cc45dd1a tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:54.036619 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-97dc2012-087a-4971-9767-5083cc45dd1a tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:30:54.045804 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-97dc2012-087a-4971-9767-5083cc45dd1a tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:30:54.047324 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-97dc2012-087a-4971-9767-5083cc45dd1a tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:30:54.048502 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-97dc2012-087a-4971-9767-5083cc45dd1a tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] 10.222.0.58 "GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6" status: 200 len: 1602 microversion: 2.42 time: 0.094379 Aug 10 23:30:54.049067 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3003/5799] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:30:53 2022] GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6 => generated 1602 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:30:54.442887 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-38a95ded-215a-4d5e-8df0-24d5a31c2ba2 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:30:54.445137 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-38a95ded-215a-4d5e-8df0-24d5a31c2ba2 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: e806d719-6292-49a9-ab7b-31397991291d] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:30:54.453770 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-38a95ded-215a-4d5e-8df0-24d5a31c2ba2 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:54.454292 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-38a95ded-215a-4d5e-8df0-24d5a31c2ba2 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:54.454738 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-38a95ded-215a-4d5e-8df0-24d5a31c2ba2 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:54.455484 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-38a95ded-215a-4d5e-8df0-24d5a31c2ba2 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:54.455940 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-38a95ded-215a-4d5e-8df0-24d5a31c2ba2 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:54.456369 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-38a95ded-215a-4d5e-8df0-24d5a31c2ba2 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:54.487461 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-38a95ded-215a-4d5e-8df0-24d5a31c2ba2 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "GET /compute/v2.1/servers/e806d719-6292-49a9-ab7b-31397991291d/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.048771 Aug 10 23:30:54.493221 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2797/5800] 10.222.0.58 () {60 vars in 1343 bytes} [Wed Aug 10 23:30:54 2022] GET /compute/v2.1/servers/e806d719-6292-49a9-ab7b-31397991291d/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:30:54.553902 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-9ca10a21-fb8a-4c7c-ab80-73f58d365554 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:30:54.554401 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-9ca10a21-fb8a-4c7c-ab80-73f58d365554 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: e806d719-6292-49a9-ab7b-31397991291d] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:30:54.561732 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9ca10a21-fb8a-4c7c-ab80-73f58d365554 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:54.562215 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9ca10a21-fb8a-4c7c-ab80-73f58d365554 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:54.562653 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9ca10a21-fb8a-4c7c-ab80-73f58d365554 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:54.563426 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9ca10a21-fb8a-4c7c-ab80-73f58d365554 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:54.563877 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9ca10a21-fb8a-4c7c-ab80-73f58d365554 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:54.564302 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9ca10a21-fb8a-4c7c-ab80-73f58d365554 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:54.593788 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-9ca10a21-fb8a-4c7c-ab80-73f58d365554 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: e806d719-6292-49a9-ab7b-31397991291d] Going to try to terminate instance {{(pid=122633) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:30:54.683633 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-9ca10a21-fb8a-4c7c-ab80-73f58d365554 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "DELETE /compute/v2.1/servers/e806d719-6292-49a9-ab7b-31397991291d" status: 204 len: 0 microversion: 2.20 time: 0.133389 Aug 10 23:30:54.684560 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3004/5801] 10.222.0.58 () {60 vars in 1280 bytes} [Wed Aug 10 23:30:54 2022] DELETE /compute/v2.1/servers/e806d719-6292-49a9-ab7b-31397991291d => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 10 23:30:54.692992 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-765cd3e8-2afa-4447-a36f-f96eb59d25ca tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:30:54.693645 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-765cd3e8-2afa-4447-a36f-f96eb59d25ca tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: e806d719-6292-49a9-ab7b-31397991291d] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:30:54.700313 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-765cd3e8-2afa-4447-a36f-f96eb59d25ca tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:54.700804 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-765cd3e8-2afa-4447-a36f-f96eb59d25ca tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:54.701243 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-765cd3e8-2afa-4447-a36f-f96eb59d25ca tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:54.702195 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-765cd3e8-2afa-4447-a36f-f96eb59d25ca tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:54.702655 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-765cd3e8-2afa-4447-a36f-f96eb59d25ca tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:54.703121 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-765cd3e8-2afa-4447-a36f-f96eb59d25ca tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:54.841113 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-765cd3e8-2afa-4447-a36f-f96eb59d25ca tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:30:54.849225 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-765cd3e8-2afa-4447-a36f-f96eb59d25ca tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:30:54.850824 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-765cd3e8-2afa-4447-a36f-f96eb59d25ca tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:30:54.851991 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-765cd3e8-2afa-4447-a36f-f96eb59d25ca tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "GET /compute/v2.1/servers/e806d719-6292-49a9-ab7b-31397991291d" status: 200 len: 1724 microversion: 2.20 time: 0.163284 Aug 10 23:30:54.852561 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2798/5802] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:30:54 2022] GET /compute/v2.1/servers/e806d719-6292-49a9-ab7b-31397991291d => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:30:55.074399 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-649e6a47-ed44-46aa-9d01-6f6684bfe080 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:30:55.075136 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-649e6a47-ed44-46aa-9d01-6f6684bfe080 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] [instance: 94831c62-29a5-4745-b321-11b28dafaaa6] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:30:55.082271 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-649e6a47-ed44-46aa-9d01-6f6684bfe080 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:55.082765 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-649e6a47-ed44-46aa-9d01-6f6684bfe080 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:55.083239 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-649e6a47-ed44-46aa-9d01-6f6684bfe080 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:55.083961 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-649e6a47-ed44-46aa-9d01-6f6684bfe080 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:55.084420 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-649e6a47-ed44-46aa-9d01-6f6684bfe080 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:55.084854 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-649e6a47-ed44-46aa-9d01-6f6684bfe080 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:55.152021 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-649e6a47-ed44-46aa-9d01-6f6684bfe080 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:30:55.161367 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-649e6a47-ed44-46aa-9d01-6f6684bfe080 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:30:55.162942 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-649e6a47-ed44-46aa-9d01-6f6684bfe080 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:30:55.164131 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-649e6a47-ed44-46aa-9d01-6f6684bfe080 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] 10.222.0.58 "GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6" status: 200 len: 1602 microversion: 2.42 time: 0.094904 Aug 10 23:30:55.164702 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3005/5803] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:30:55 2022] GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6 => generated 1602 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:30:55.876286 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-5326f8dc-0e7c-405d-aa96-234f76e38019 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:30:55.877007 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-5326f8dc-0e7c-405d-aa96-234f76e38019 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: e806d719-6292-49a9-ab7b-31397991291d] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:30:55.884208 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5326f8dc-0e7c-405d-aa96-234f76e38019 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:55.885376 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5326f8dc-0e7c-405d-aa96-234f76e38019 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:55.885904 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5326f8dc-0e7c-405d-aa96-234f76e38019 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:55.886671 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5326f8dc-0e7c-405d-aa96-234f76e38019 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:55.887212 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5326f8dc-0e7c-405d-aa96-234f76e38019 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:55.887700 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5326f8dc-0e7c-405d-aa96-234f76e38019 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:56.026679 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-5326f8dc-0e7c-405d-aa96-234f76e38019 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:30:56.035323 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-5326f8dc-0e7c-405d-aa96-234f76e38019 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:30:56.036825 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-5326f8dc-0e7c-405d-aa96-234f76e38019 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:30:56.037997 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-5326f8dc-0e7c-405d-aa96-234f76e38019 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "GET /compute/v2.1/servers/e806d719-6292-49a9-ab7b-31397991291d" status: 200 len: 1724 microversion: 2.20 time: 0.165812 Aug 10 23:30:56.038590 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2799/5804] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:30:55 2022] GET /compute/v2.1/servers/e806d719-6292-49a9-ab7b-31397991291d => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 23:30:56.188105 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-843c44b6-b26b-40b4-9544-101bf7776557 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:30:56.188809 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-843c44b6-b26b-40b4-9544-101bf7776557 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] [instance: 94831c62-29a5-4745-b321-11b28dafaaa6] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:30:56.196063 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-843c44b6-b26b-40b4-9544-101bf7776557 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:56.196554 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-843c44b6-b26b-40b4-9544-101bf7776557 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:56.197520 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-843c44b6-b26b-40b4-9544-101bf7776557 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:56.198544 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-843c44b6-b26b-40b4-9544-101bf7776557 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:56.199150 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-843c44b6-b26b-40b4-9544-101bf7776557 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:56.199592 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-843c44b6-b26b-40b4-9544-101bf7776557 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:56.293936 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-843c44b6-b26b-40b4-9544-101bf7776557 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:30:56.303268 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-843c44b6-b26b-40b4-9544-101bf7776557 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:30:56.304799 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-843c44b6-b26b-40b4-9544-101bf7776557 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:30:56.307830 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-843c44b6-b26b-40b4-9544-101bf7776557 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] 10.222.0.58 "GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6" status: 200 len: 1602 microversion: 2.42 time: 0.122198 Aug 10 23:30:56.307830 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3006/5805] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:30:56 2022] GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6 => generated 1602 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:30:57.058090 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-acf3cfcb-be06-4fd0-8b3a-58ccada2d6ac req-3d79caaa-0500-4678-affa-92ba46f6099a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e806d719-6292-49a9-ab7b-31397991291d", "name": "network-vif-deleted", "tag": "bd30930e-8098-4180-afd1-75ee64f8dc5a"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:30:57.069793 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-3c2c9480-5058-4a8d-a195-8ec106e270d7 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:30:57.074011 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-3c2c9480-5058-4a8d-a195-8ec106e270d7 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: e806d719-6292-49a9-ab7b-31397991291d] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:30:57.081413 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3c2c9480-5058-4a8d-a195-8ec106e270d7 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:57.082314 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3c2c9480-5058-4a8d-a195-8ec106e270d7 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:57.083005 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3c2c9480-5058-4a8d-a195-8ec106e270d7 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:57.083723 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3c2c9480-5058-4a8d-a195-8ec106e270d7 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:57.084177 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3c2c9480-5058-4a8d-a195-8ec106e270d7 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:57.084604 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3c2c9480-5058-4a8d-a195-8ec106e270d7 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:57.099492 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-acf3cfcb-be06-4fd0-8b3a-58ccada2d6ac req-3d79caaa-0500-4678-affa-92ba46f6099a service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:57.100666 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-acf3cfcb-be06-4fd0-8b3a-58ccada2d6ac req-3d79caaa-0500-4678-affa-92ba46f6099a service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:57.101369 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-acf3cfcb-be06-4fd0-8b3a-58ccada2d6ac req-3d79caaa-0500-4678-affa-92ba46f6099a service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:57.132483 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-acf3cfcb-be06-4fd0-8b3a-58ccada2d6ac req-3d79caaa-0500-4678-affa-92ba46f6099a service nova] Creating event network-vif-deleted:bd30930e-8098-4180-afd1-75ee64f8dc5a for instance e806d719-6292-49a9-ab7b-31397991291d on n-h2-850468-14 Aug 10 23:30:57.148751 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-acf3cfcb-be06-4fd0-8b3a-58ccada2d6ac req-3d79caaa-0500-4678-affa-92ba46f6099a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101408 Aug 10 23:30:57.150961 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2800/5806] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:30:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:30:57.184309 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-3c2c9480-5058-4a8d-a195-8ec106e270d7 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:30:57.199183 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-3c2c9480-5058-4a8d-a195-8ec106e270d7 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:30:57.201382 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-3c2c9480-5058-4a8d-a195-8ec106e270d7 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '8ad42d35070247d18e67b2fa10690252', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1597a7e6731c4f5f9d8dfdc793ec2d47', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:30:57.203077 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-3c2c9480-5058-4a8d-a195-8ec106e270d7 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "GET /compute/v2.1/servers/e806d719-6292-49a9-ab7b-31397991291d" status: 200 len: 1365 microversion: 2.20 time: 0.143522 Aug 10 23:30:57.204433 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3007/5807] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:30:57 2022] GET /compute/v2.1/servers/e806d719-6292-49a9-ab7b-31397991291d => generated 1365 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:30:57.331153 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-8ed1f2e4-0d84-4bfe-a4ce-76e484fde492 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:30:57.332162 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-8ed1f2e4-0d84-4bfe-a4ce-76e484fde492 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] [instance: 94831c62-29a5-4745-b321-11b28dafaaa6] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:30:57.346240 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8ed1f2e4-0d84-4bfe-a4ce-76e484fde492 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:57.347098 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8ed1f2e4-0d84-4bfe-a4ce-76e484fde492 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:57.347911 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8ed1f2e4-0d84-4bfe-a4ce-76e484fde492 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:57.348833 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8ed1f2e4-0d84-4bfe-a4ce-76e484fde492 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:57.349559 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8ed1f2e4-0d84-4bfe-a4ce-76e484fde492 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:57.350019 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8ed1f2e4-0d84-4bfe-a4ce-76e484fde492 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:57.429461 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-8ed1f2e4-0d84-4bfe-a4ce-76e484fde492 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:30:57.440182 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-8ed1f2e4-0d84-4bfe-a4ce-76e484fde492 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:30:57.442109 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-8ed1f2e4-0d84-4bfe-a4ce-76e484fde492 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:30:57.443809 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-8ed1f2e4-0d84-4bfe-a4ce-76e484fde492 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] 10.222.0.58 "GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6" status: 200 len: 1602 microversion: 2.42 time: 0.117766 Aug 10 23:30:57.445265 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2801/5808] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:30:57 2022] GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6 => generated 1602 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:30:58.229476 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-109bc405-f8c8-4a7d-b168-17506f0267b8 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:30:58.230491 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-109bc405-f8c8-4a7d-b168-17506f0267b8 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: e806d719-6292-49a9-ab7b-31397991291d] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:30:58.239337 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-109bc405-f8c8-4a7d-b168-17506f0267b8 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:58.240131 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-109bc405-f8c8-4a7d-b168-17506f0267b8 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:58.240569 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-109bc405-f8c8-4a7d-b168-17506f0267b8 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:58.241285 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-109bc405-f8c8-4a7d-b168-17506f0267b8 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:58.241943 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-109bc405-f8c8-4a7d-b168-17506f0267b8 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:58.242365 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-109bc405-f8c8-4a7d-b168-17506f0267b8 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:58.257772 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-109bc405-f8c8-4a7d-b168-17506f0267b8 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] HTTP exception thrown: Instance e806d719-6292-49a9-ab7b-31397991291d could not be found. Aug 10 23:30:58.263576 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-109bc405-f8c8-4a7d-b168-17506f0267b8 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Request method failure captured: Aug 10 23:30:58.263576 n-d-850468-14 devstack@n-api.service[122633]: request: GET /compute/v2.1/servers/e806d719-6292-49a9-ab7b-31397991291d HTTP/1.1 Aug 10 23:30:58.263576 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:30:58.263576 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:30:58.263576 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:30:58.263576 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:30:58.263576 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:30:58.263576 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:30:58.263576 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:30:58.263576 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:30:58.263576 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9D4nzVq2558z9rLfYRYA2pZxsjFz7RfLxddFUl51tG0j_Wfc_zB98us-y9yS-8JSHiS7PpysPYlf0xuzWy4DHfwFlHmfNLDHPUVze1EVhUWX7GVQuSEdV6BccfHEnO6-A9UPpzshqrhBLTpXBunL_OKsZjlyLzTn-fs8OIuwXlvyLDk Aug 10 23:30:58.263576 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:30:58.263576 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:30:58.263576 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:30:58.263576 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:30:58.263576 n-d-850468-14 devstack@n-api.service[122633]: X-Openstack-Nova-Api-Version: 2.20 Aug 10 23:30:58.263576 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:30:58.263576 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:30:58.263576 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 1597a7e6731c4f5f9d8dfdc793ec2d47 Aug 10 23:30:58.263576 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1591010651 Aug 10 23:30:58.263576 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:30:58.263576 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:30:58.263576 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1597a7e6731c4f5f9d8dfdc793ec2d47"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1597a7e6731c4f5f9d8dfdc793ec2d47"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/1597a7e6731c4f5f9d8dfdc793ec2d47"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_1597a7e6731c4f5f9d8dfdc793ec2d47", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:30:58.263576 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1591010651 Aug 10 23:30:58.263576 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 1597a7e6731c4f5f9d8dfdc793ec2d47 Aug 10 23:30:58.263576 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1591010651 Aug 10 23:30:58.263576 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-AttachVolumeShelveTestJSON-1591010651-project Aug 10 23:30:58.263576 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:30:58.263576 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:30:58.263576 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 8ad42d35070247d18e67b2fa10690252 Aug 10 23:30:58.263576 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1591010651-project Aug 10 23:30:58.263576 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:30:58.263576 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance e806d719-6292-49a9-ab7b-31397991291d could not be found. Aug 10 23:30:58.263576 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': 'e806d719-6292-49a9-ab7b-31397991291d'} Aug 10 23:30:58.263576 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:30:58.263576 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:30:58.263576 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:30:58.263576 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:30:58.263576 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:30:58.263576 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:30:58.263576 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:30:58.263576 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:30:58.263576 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:30:58.263576 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:30:58.263576 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e806d719-6292-49a9-ab7b-31397991291d could not be found. Aug 10 23:30:58.263576 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:30:58.263576 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:30:58.263576 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:30:58.263576 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:30:58.263576 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:30:58.263576 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:30:58.263576 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:30:58.263576 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:30:58.263576 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:30:58.263576 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:30:58.263576 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:30:58.263576 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:30:58.263576 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:30:58.263576 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:30:58.263576 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:30:58.263576 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:30:58.263576 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e806d719-6292-49a9-ab7b-31397991291d could not be found. Aug 10 23:30:58.263576 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:30:58.263576 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:30:58.268246 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:30:58.268246 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:30:58.268246 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:30:58.268246 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:30:58.268246 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:30:58.268246 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:30:58.268246 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e806d719-6292-49a9-ab7b-31397991291d could not be found. Aug 10 23:30:58.268246 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:30:58.268246 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-109bc405-f8c8-4a7d-b168-17506f0267b8 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Returning 404 to user: Instance e806d719-6292-49a9-ab7b-31397991291d could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:30:58.268246 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-109bc405-f8c8-4a7d-b168-17506f0267b8 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "GET /compute/v2.1/servers/e806d719-6292-49a9-ab7b-31397991291d" status: 404 len: 111 microversion: 2.20 time: 0.041573 Aug 10 23:30:58.268246 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3008/5809] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:30:58 2022] GET /compute/v2.1/servers/e806d719-6292-49a9-ab7b-31397991291d => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 10 23:30:58.275823 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-528379c7-b84c-4cdd-ae30-afd3789135a4 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Calling method '.version_select at 0x7f846fb958b0>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:30:58.299503 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-528379c7-b84c-4cdd-ae30-afd3789135a4 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-466797257" status: 204 len: 0 microversion: 2.20 time: 0.028400 Aug 10 23:30:58.300188 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2802/5810] 10.222.0.58 () {60 vars in 1259 bytes} [Wed Aug 10 23:30:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-466797257 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 10 23:30:58.471791 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-75022343-f284-4527-b18c-84a293af9a44 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:30:58.472423 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-75022343-f284-4527-b18c-84a293af9a44 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] [instance: 94831c62-29a5-4745-b321-11b28dafaaa6] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:30:58.491490 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-75022343-f284-4527-b18c-84a293af9a44 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:58.494986 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-75022343-f284-4527-b18c-84a293af9a44 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:58.496152 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-75022343-f284-4527-b18c-84a293af9a44 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:58.497431 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-75022343-f284-4527-b18c-84a293af9a44 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:58.498083 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-75022343-f284-4527-b18c-84a293af9a44 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:58.498695 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-75022343-f284-4527-b18c-84a293af9a44 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:58.579044 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-75022343-f284-4527-b18c-84a293af9a44 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:30:58.591716 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-75022343-f284-4527-b18c-84a293af9a44 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:30:58.593313 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-75022343-f284-4527-b18c-84a293af9a44 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:30:58.594841 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-75022343-f284-4527-b18c-84a293af9a44 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] 10.222.0.58 "GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6" status: 200 len: 1602 microversion: 2.42 time: 0.132046 Aug 10 23:30:58.596291 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3009/5811] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:30:58 2022] GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6 => generated 1602 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:30:59.619080 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c18272ca-4fc1-4def-98d2-1b23a68b8143 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:30:59.621114 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-c18272ca-4fc1-4def-98d2-1b23a68b8143 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] [instance: 94831c62-29a5-4745-b321-11b28dafaaa6] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:30:59.628847 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c18272ca-4fc1-4def-98d2-1b23a68b8143 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:59.629474 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c18272ca-4fc1-4def-98d2-1b23a68b8143 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:59.629934 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c18272ca-4fc1-4def-98d2-1b23a68b8143 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:59.630913 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c18272ca-4fc1-4def-98d2-1b23a68b8143 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:30:59.631369 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c18272ca-4fc1-4def-98d2-1b23a68b8143 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:30:59.631798 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c18272ca-4fc1-4def-98d2-1b23a68b8143 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:30:59.705924 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-c18272ca-4fc1-4def-98d2-1b23a68b8143 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:30:59.716631 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-c18272ca-4fc1-4def-98d2-1b23a68b8143 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:30:59.718443 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-c18272ca-4fc1-4def-98d2-1b23a68b8143 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:30:59.719717 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-c18272ca-4fc1-4def-98d2-1b23a68b8143 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] 10.222.0.58 "GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6" status: 200 len: 1602 microversion: 2.42 time: 0.105939 Aug 10 23:30:59.720280 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2803/5812] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:30:59 2022] GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6 => generated 1602 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:31:00.746075 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-233786e0-802a-462c-b85e-8c8af2654816 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:31:00.746741 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-233786e0-802a-462c-b85e-8c8af2654816 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] [instance: 94831c62-29a5-4745-b321-11b28dafaaa6] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:31:00.756771 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-233786e0-802a-462c-b85e-8c8af2654816 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:31:00.757532 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-233786e0-802a-462c-b85e-8c8af2654816 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:31:00.758146 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-233786e0-802a-462c-b85e-8c8af2654816 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:31:00.759128 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-233786e0-802a-462c-b85e-8c8af2654816 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:31:00.759759 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-233786e0-802a-462c-b85e-8c8af2654816 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:31:00.760511 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-233786e0-802a-462c-b85e-8c8af2654816 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:31:00.907967 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-233786e0-802a-462c-b85e-8c8af2654816 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:31:00.927450 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-233786e0-802a-462c-b85e-8c8af2654816 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:31:00.929653 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-233786e0-802a-462c-b85e-8c8af2654816 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:31:00.934452 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-233786e0-802a-462c-b85e-8c8af2654816 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] 10.222.0.58 "GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6" status: 200 len: 1602 microversion: 2.42 time: 0.189324 Aug 10 23:31:00.935614 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3010/5813] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:31:00 2022] GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6 => generated 1602 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:31:01.231846 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-00f4be0a-c282-4a04-abe0-a2260b2faf9e tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:31:01.233019 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-00f4be0a-c282-4a04-abe0-a2260b2faf9e tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: e806d719-6292-49a9-ab7b-31397991291d] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:31:01.243120 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-00f4be0a-c282-4a04-abe0-a2260b2faf9e tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:31:01.243940 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-00f4be0a-c282-4a04-abe0-a2260b2faf9e tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:31:01.245313 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-00f4be0a-c282-4a04-abe0-a2260b2faf9e tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:31:01.247393 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-00f4be0a-c282-4a04-abe0-a2260b2faf9e tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:31:01.248234 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-00f4be0a-c282-4a04-abe0-a2260b2faf9e tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:31:01.248931 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-00f4be0a-c282-4a04-abe0-a2260b2faf9e tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:31:01.254089 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=100 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:31:01.271898 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-00f4be0a-c282-4a04-abe0-a2260b2faf9e tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] HTTP exception thrown: Instance e806d719-6292-49a9-ab7b-31397991291d could not be found. Aug 10 23:31:01.274076 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-00f4be0a-c282-4a04-abe0-a2260b2faf9e tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Request method failure captured: Aug 10 23:31:01.274076 n-d-850468-14 devstack@n-api.service[122632]: request: DELETE /compute/v2.1/servers/e806d719-6292-49a9-ab7b-31397991291d HTTP/1.1 Aug 10 23:31:01.274076 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:31:01.274076 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:31:01.274076 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:31:01.274076 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 23:31:01.274076 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:31:01.274076 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:31:01.274076 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:31:01.274076 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:31:01.274076 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9D4nzVq2558z9rLfYRYA2pZxsjFz7RfLxddFUl51tG0j_Wfc_zB98us-y9yS-8JSHiS7PpysPYlf0xuzWy4DHfwFlHmfNLDHPUVze1EVhUWX7GVQuSEdV6BccfHEnO6-A9UPpzshqrhBLTpXBunL_OKsZjlyLzTn-fs8OIuwXlvyLDk Aug 10 23:31:01.274076 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:31:01.274076 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:31:01.274076 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:31:01.274076 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:31:01.274076 n-d-850468-14 devstack@n-api.service[122632]: X-Openstack-Nova-Api-Version: 2.20 Aug 10 23:31:01.274076 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:31:01.274076 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:31:01.274076 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 1597a7e6731c4f5f9d8dfdc793ec2d47 Aug 10 23:31:01.274076 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1591010651 Aug 10 23:31:01.274076 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:31:01.274076 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:31:01.274076 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1597a7e6731c4f5f9d8dfdc793ec2d47"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1597a7e6731c4f5f9d8dfdc793ec2d47"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/1597a7e6731c4f5f9d8dfdc793ec2d47"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_1597a7e6731c4f5f9d8dfdc793ec2d47", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:31:01.274076 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1591010651 Aug 10 23:31:01.274076 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 1597a7e6731c4f5f9d8dfdc793ec2d47 Aug 10 23:31:01.274076 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1591010651 Aug 10 23:31:01.274076 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-AttachVolumeShelveTestJSON-1591010651-project Aug 10 23:31:01.274076 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:31:01.274076 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:31:01.274076 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: 8ad42d35070247d18e67b2fa10690252 Aug 10 23:31:01.274076 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1591010651-project Aug 10 23:31:01.274076 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:31:01.274076 n-d-850468-14 devstack@n-api.service[122632]: exception: Instance e806d719-6292-49a9-ab7b-31397991291d could not be found. Aug 10 23:31:01.274076 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': 'e806d719-6292-49a9-ab7b-31397991291d'} Aug 10 23:31:01.274076 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:31:01.274076 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:31:01.274076 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:31:01.274076 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:31:01.274076 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:31:01.274076 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:31:01.274076 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:31:01.274076 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:31:01.274076 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:31:01.274076 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:31:01.274076 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e806d719-6292-49a9-ab7b-31397991291d could not be found. Aug 10 23:31:01.274076 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:31:01.274076 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:31:01.274076 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:31:01.274076 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:31:01.274076 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:31:01.274076 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:31:01.274076 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:31:01.274076 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:31:01.274076 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:31:01.274076 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:31:01.274076 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 23:31:01.274076 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 23:31:01.274076 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 23:31:01.274076 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 23:31:01.274076 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:31:01.274076 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:31:01.274076 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:31:01.274076 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:31:01.280380 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e806d719-6292-49a9-ab7b-31397991291d could not be found. Aug 10 23:31:01.280380 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:31:01.280380 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:31:01.280380 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:31:01.280380 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:31:01.280380 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:31:01.280380 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:31:01.280380 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:31:01.280380 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:31:01.280380 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e806d719-6292-49a9-ab7b-31397991291d could not be found. Aug 10 23:31:01.280380 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:31:01.283710 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-00f4be0a-c282-4a04-abe0-a2260b2faf9e tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Returning 404 to user: Instance e806d719-6292-49a9-ab7b-31397991291d could not be found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:31:01.285067 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-00f4be0a-c282-4a04-abe0-a2260b2faf9e tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "DELETE /compute/v2.1/servers/e806d719-6292-49a9-ab7b-31397991291d" status: 404 len: 111 microversion: 2.20 time: 0.059004 Aug 10 23:31:01.289149 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2804/5814] 10.222.0.58 () {60 vars in 1280 bytes} [Wed Aug 10 23:31:01 2022] DELETE /compute/v2.1/servers/e806d719-6292-49a9-ab7b-31397991291d => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 10 23:31:01.294959 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-57a769a6-6198-4d81-9d18-456a61494d64 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:31:01.295566 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-57a769a6-6198-4d81-9d18-456a61494d64 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: e806d719-6292-49a9-ab7b-31397991291d] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:31:01.302061 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-57a769a6-6198-4d81-9d18-456a61494d64 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:31:01.302237 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-57a769a6-6198-4d81-9d18-456a61494d64 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:31:01.302685 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-57a769a6-6198-4d81-9d18-456a61494d64 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:31:01.303423 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-57a769a6-6198-4d81-9d18-456a61494d64 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:31:01.303880 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-57a769a6-6198-4d81-9d18-456a61494d64 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:31:01.304308 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-57a769a6-6198-4d81-9d18-456a61494d64 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:31:01.320825 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-57a769a6-6198-4d81-9d18-456a61494d64 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] HTTP exception thrown: Instance e806d719-6292-49a9-ab7b-31397991291d could not be found. Aug 10 23:31:01.323319 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-57a769a6-6198-4d81-9d18-456a61494d64 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Request method failure captured: Aug 10 23:31:01.323319 n-d-850468-14 devstack@n-api.service[122633]: request: GET /compute/v2.1/servers/e806d719-6292-49a9-ab7b-31397991291d HTTP/1.1 Aug 10 23:31:01.323319 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:31:01.323319 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:31:01.323319 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:31:01.323319 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:31:01.323319 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:31:01.323319 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:31:01.323319 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:31:01.323319 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:31:01.323319 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9D4nzVq2558z9rLfYRYA2pZxsjFz7RfLxddFUl51tG0j_Wfc_zB98us-y9yS-8JSHiS7PpysPYlf0xuzWy4DHfwFlHmfNLDHPUVze1EVhUWX7GVQuSEdV6BccfHEnO6-A9UPpzshqrhBLTpXBunL_OKsZjlyLzTn-fs8OIuwXlvyLDk Aug 10 23:31:01.323319 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:31:01.323319 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:31:01.323319 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:31:01.323319 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:31:01.323319 n-d-850468-14 devstack@n-api.service[122633]: X-Openstack-Nova-Api-Version: 2.20 Aug 10 23:31:01.323319 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:31:01.323319 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:31:01.323319 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 1597a7e6731c4f5f9d8dfdc793ec2d47 Aug 10 23:31:01.323319 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1591010651 Aug 10 23:31:01.323319 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:31:01.323319 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:31:01.323319 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1597a7e6731c4f5f9d8dfdc793ec2d47"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1597a7e6731c4f5f9d8dfdc793ec2d47"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/1597a7e6731c4f5f9d8dfdc793ec2d47"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_1597a7e6731c4f5f9d8dfdc793ec2d47", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:31:01.323319 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1591010651 Aug 10 23:31:01.323319 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 1597a7e6731c4f5f9d8dfdc793ec2d47 Aug 10 23:31:01.323319 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1591010651 Aug 10 23:31:01.323319 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-AttachVolumeShelveTestJSON-1591010651-project Aug 10 23:31:01.323319 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:31:01.323319 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:31:01.323319 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 8ad42d35070247d18e67b2fa10690252 Aug 10 23:31:01.323319 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1591010651-project Aug 10 23:31:01.323319 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:31:01.323319 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance e806d719-6292-49a9-ab7b-31397991291d could not be found. Aug 10 23:31:01.323319 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': 'e806d719-6292-49a9-ab7b-31397991291d'} Aug 10 23:31:01.323319 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:31:01.323319 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:31:01.323319 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:31:01.323319 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:31:01.323319 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:31:01.323319 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:31:01.323319 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:31:01.323319 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:31:01.323319 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:31:01.323319 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:31:01.323319 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e806d719-6292-49a9-ab7b-31397991291d could not be found. Aug 10 23:31:01.323319 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:31:01.323319 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:31:01.323319 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:31:01.323319 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:31:01.323319 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:31:01.323319 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:31:01.323319 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:31:01.323319 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:31:01.323319 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:31:01.323319 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:31:01.323319 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:31:01.323319 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:31:01.323319 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:31:01.323319 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:31:01.323319 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:31:01.323319 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:31:01.323319 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e806d719-6292-49a9-ab7b-31397991291d could not be found. Aug 10 23:31:01.323319 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:31:01.323319 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:31:01.329536 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:31:01.329536 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:31:01.329536 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:31:01.329536 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:31:01.329536 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:31:01.329536 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:31:01.329536 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e806d719-6292-49a9-ab7b-31397991291d could not be found. Aug 10 23:31:01.329536 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:31:01.331092 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-57a769a6-6198-4d81-9d18-456a61494d64 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Returning 404 to user: Instance e806d719-6292-49a9-ab7b-31397991291d could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:31:01.333042 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-57a769a6-6198-4d81-9d18-456a61494d64 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "GET /compute/v2.1/servers/e806d719-6292-49a9-ab7b-31397991291d" status: 404 len: 111 microversion: 2.20 time: 0.042855 Aug 10 23:31:01.333634 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3011/5815] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:31:01 2022] GET /compute/v2.1/servers/e806d719-6292-49a9-ab7b-31397991291d => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 10 23:31:01.959642 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-79affbfe-dc66-4a5a-a565-5705c6481e3e tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:31:01.960545 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-79affbfe-dc66-4a5a-a565-5705c6481e3e tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] [instance: 94831c62-29a5-4745-b321-11b28dafaaa6] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:31:01.968032 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-79affbfe-dc66-4a5a-a565-5705c6481e3e tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:31:01.968567 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-79affbfe-dc66-4a5a-a565-5705c6481e3e tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:31:01.969035 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-79affbfe-dc66-4a5a-a565-5705c6481e3e tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:31:01.970135 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-79affbfe-dc66-4a5a-a565-5705c6481e3e tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:31:01.971154 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-79affbfe-dc66-4a5a-a565-5705c6481e3e tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:31:01.971754 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-79affbfe-dc66-4a5a-a565-5705c6481e3e tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:31:02.048175 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-79affbfe-dc66-4a5a-a565-5705c6481e3e tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:31:02.059800 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-79affbfe-dc66-4a5a-a565-5705c6481e3e tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:31:02.061920 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-79affbfe-dc66-4a5a-a565-5705c6481e3e tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:31:02.063501 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-79affbfe-dc66-4a5a-a565-5705c6481e3e tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] 10.222.0.58 "GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6" status: 200 len: 1602 microversion: 2.42 time: 0.108407 Aug 10 23:31:02.064845 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2805/5816] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:31:01 2022] GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6 => generated 1602 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:31:03.060911 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-72d37378-ff62-44f3-9a4b-fdee6391ec73 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:31:03.063897 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-72d37378-ff62-44f3-9a4b-fdee6391ec73 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] [instance: aa0bed62-e734-42e6-9211-88beb761554a] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:31:03.071604 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-72d37378-ff62-44f3-9a4b-fdee6391ec73 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:31:03.072377 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-72d37378-ff62-44f3-9a4b-fdee6391ec73 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:31:03.073092 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-72d37378-ff62-44f3-9a4b-fdee6391ec73 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:31:03.074860 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-72d37378-ff62-44f3-9a4b-fdee6391ec73 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:31:03.075627 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-72d37378-ff62-44f3-9a4b-fdee6391ec73 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:31:03.076272 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-72d37378-ff62-44f3-9a4b-fdee6391ec73 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:31:03.089960 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-9817a64f-8a4e-4f03-abe5-1be458e749ed tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:31:03.090916 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-9817a64f-8a4e-4f03-abe5-1be458e749ed tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] [instance: 94831c62-29a5-4745-b321-11b28dafaaa6] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:31:03.101115 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9817a64f-8a4e-4f03-abe5-1be458e749ed tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:31:03.102074 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9817a64f-8a4e-4f03-abe5-1be458e749ed tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:31:03.102668 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9817a64f-8a4e-4f03-abe5-1be458e749ed tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:31:03.103690 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9817a64f-8a4e-4f03-abe5-1be458e749ed tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:31:03.104406 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9817a64f-8a4e-4f03-abe5-1be458e749ed tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:31:03.105123 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9817a64f-8a4e-4f03-abe5-1be458e749ed tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:31:03.143117 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-72d37378-ff62-44f3-9a4b-fdee6391ec73 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] 10.222.0.58 "POST /compute/v2.1/servers/aa0bed62-e734-42e6-9211-88beb761554a/action" status: 200 len: 24568 microversion: 2.1 time: 0.086848 Aug 10 23:31:03.143802 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3012/5817] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:31:03 2022] POST /compute/v2.1/servers/aa0bed62-e734-42e6-9211-88beb761554a/action => generated 24568 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 23:31:03.181521 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-9817a64f-8a4e-4f03-abe5-1be458e749ed tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:31:03.192358 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-9817a64f-8a4e-4f03-abe5-1be458e749ed tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:31:03.194441 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-9817a64f-8a4e-4f03-abe5-1be458e749ed tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:31:03.195976 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-9817a64f-8a4e-4f03-abe5-1be458e749ed tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] 10.222.0.58 "GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6" status: 200 len: 1602 microversion: 2.42 time: 0.111391 Aug 10 23:31:03.198285 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2806/5818] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:31:03 2022] GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6 => generated 1602 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:31:04.222664 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-1881850f-314b-4543-8ce7-8c7e3d180564 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:31:04.224459 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-1881850f-314b-4543-8ce7-8c7e3d180564 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] [instance: 94831c62-29a5-4745-b321-11b28dafaaa6] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:31:04.232461 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1881850f-314b-4543-8ce7-8c7e3d180564 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:31:04.233209 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1881850f-314b-4543-8ce7-8c7e3d180564 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:31:04.233909 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1881850f-314b-4543-8ce7-8c7e3d180564 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:31:04.235255 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1881850f-314b-4543-8ce7-8c7e3d180564 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:31:04.236107 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1881850f-314b-4543-8ce7-8c7e3d180564 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:31:04.236784 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1881850f-314b-4543-8ce7-8c7e3d180564 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:31:04.331949 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-1881850f-314b-4543-8ce7-8c7e3d180564 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:31:04.345747 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-1881850f-314b-4543-8ce7-8c7e3d180564 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:31:04.347350 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-1881850f-314b-4543-8ce7-8c7e3d180564 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:31:04.348796 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-1881850f-314b-4543-8ce7-8c7e3d180564 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] 10.222.0.58 "GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6" status: 200 len: 1602 microversion: 2.42 time: 0.131960 Aug 10 23:31:04.349384 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3013/5819] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:31:04 2022] GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6 => generated 1602 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:31:05.372809 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-b1cde391-778c-4bc4-b3ca-442885461b6f tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:31:05.373503 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-b1cde391-778c-4bc4-b3ca-442885461b6f tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] [instance: 94831c62-29a5-4745-b321-11b28dafaaa6] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:31:05.383119 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b1cde391-778c-4bc4-b3ca-442885461b6f tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:31:05.383734 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b1cde391-778c-4bc4-b3ca-442885461b6f tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:31:05.384812 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b1cde391-778c-4bc4-b3ca-442885461b6f tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:31:05.385640 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b1cde391-778c-4bc4-b3ca-442885461b6f tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:31:05.386338 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b1cde391-778c-4bc4-b3ca-442885461b6f tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:31:05.386980 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b1cde391-778c-4bc4-b3ca-442885461b6f tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:31:05.439221 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b1cde391-778c-4bc4-b3ca-442885461b6f tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:31:05.439926 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b1cde391-778c-4bc4-b3ca-442885461b6f tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:31:05.440531 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b1cde391-778c-4bc4-b3ca-442885461b6f tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:31:05.441155 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.objects.instance [None req-b1cde391-778c-4bc4-b3ca-442885461b6f tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lazy-loading 'fault' on Instance uuid 94831c62-29a5-4745-b321-11b28dafaaa6 {{(pid=122632) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:31:05.517218 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-b1cde391-778c-4bc4-b3ca-442885461b6f tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:31:05.537756 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-b1cde391-778c-4bc4-b3ca-442885461b6f tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:31:05.540271 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-b1cde391-778c-4bc4-b3ca-442885461b6f tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a5fe70a2accc42f3ae729c02c876dce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3a075a69271470c904f8a380b0a2657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:31:05.544059 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-b1cde391-778c-4bc4-b3ca-442885461b6f tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] 10.222.0.58 "GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6" status: 200 len: 1369 microversion: 2.42 time: 0.173614 Aug 10 23:31:05.546822 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2807/5820] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:31:05 2022] GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6 => generated 1369 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:31:06.568462 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-47a0210d-d7e7-4af2-98fe-7f23af00decd tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:31:06.569520 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-47a0210d-d7e7-4af2-98fe-7f23af00decd tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] [instance: 94831c62-29a5-4745-b321-11b28dafaaa6] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:31:06.579065 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-47a0210d-d7e7-4af2-98fe-7f23af00decd tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:31:06.603572 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-47a0210d-d7e7-4af2-98fe-7f23af00decd tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:31:06.603992 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-47a0210d-d7e7-4af2-98fe-7f23af00decd tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:31:06.605348 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-47a0210d-d7e7-4af2-98fe-7f23af00decd tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:31:06.605855 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-47a0210d-d7e7-4af2-98fe-7f23af00decd tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:31:06.606312 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-47a0210d-d7e7-4af2-98fe-7f23af00decd tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:31:06.624415 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-47a0210d-d7e7-4af2-98fe-7f23af00decd tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] HTTP exception thrown: Instance 94831c62-29a5-4745-b321-11b28dafaaa6 could not be found. Aug 10 23:31:06.628007 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-47a0210d-d7e7-4af2-98fe-7f23af00decd tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Request method failure captured: Aug 10 23:31:06.628007 n-d-850468-14 devstack@n-api.service[122633]: request: GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6 HTTP/1.1 Aug 10 23:31:06.628007 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:31:06.628007 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:31:06.628007 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:31:06.628007 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:31:06.628007 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:31:06.628007 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:31:06.628007 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:31:06.628007 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:31:06.628007 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9D4oS0vT8kOsDlbudCSqgBSQVQ6hBe_ekEltYgC7aGZ-Cpt3HAe-IVZwRHPWA6btejL686Xtndap22PC4jcF2c2vHB_yaL7j-3KgR9e_8Kxu3DtmUF9OkxH6iVoeWSoshQI-vf54KyWATDhZwXIHT5xFUB8XbyPmN6ibjyOmwiN7Z8k Aug 10 23:31:06.628007 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:31:06.628007 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:31:06.628007 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:31:06.628007 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:31:06.628007 n-d-850468-14 devstack@n-api.service[122633]: X-Openstack-Nova-Api-Version: 2.42 Aug 10 23:31:06.628007 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:31:06.628007 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:31:06.628007 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: f3a075a69271470c904f8a380b0a2657 Aug 10 23:31:06.628007 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1443303384 Aug 10 23:31:06.628007 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:31:06.628007 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:31:06.628007 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f3a075a69271470c904f8a380b0a2657"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f3a075a69271470c904f8a380b0a2657"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/f3a075a69271470c904f8a380b0a2657"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_f3a075a69271470c904f8a380b0a2657", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:31:06.628007 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1443303384 Aug 10 23:31:06.628007 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: f3a075a69271470c904f8a380b0a2657 Aug 10 23:31:06.628007 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1443303384 Aug 10 23:31:06.628007 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-TaggedBootDevicesTest_v242-1443303384-project Aug 10 23:31:06.628007 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:31:06.628007 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:31:06.628007 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: a5fe70a2accc42f3ae729c02c876dce9 Aug 10 23:31:06.628007 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1443303384-project Aug 10 23:31:06.628007 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:31:06.628007 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance 94831c62-29a5-4745-b321-11b28dafaaa6 could not be found. Aug 10 23:31:06.628007 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': '94831c62-29a5-4745-b321-11b28dafaaa6'} Aug 10 23:31:06.628007 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:31:06.628007 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:31:06.628007 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:31:06.628007 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:31:06.628007 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:31:06.628007 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:31:06.628007 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:31:06.628007 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:31:06.628007 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:31:06.628007 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:31:06.628007 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94831c62-29a5-4745-b321-11b28dafaaa6 could not be found. Aug 10 23:31:06.628007 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:31:06.628007 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:31:06.628007 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:31:06.628007 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:31:06.628007 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:31:06.628007 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:31:06.628007 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:31:06.628007 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:31:06.628007 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:31:06.628007 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:31:06.628007 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:31:06.628007 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:31:06.628007 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:31:06.628007 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:31:06.628007 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:31:06.628007 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:31:06.628007 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94831c62-29a5-4745-b321-11b28dafaaa6 could not be found. Aug 10 23:31:06.628007 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:31:06.628007 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:31:06.635138 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:31:06.635138 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:31:06.635138 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:31:06.635138 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:31:06.635138 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:31:06.635138 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:31:06.635138 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94831c62-29a5-4745-b321-11b28dafaaa6 could not be found. Aug 10 23:31:06.635138 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:31:06.635138 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-47a0210d-d7e7-4af2-98fe-7f23af00decd tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Returning 404 to user: Instance 94831c62-29a5-4745-b321-11b28dafaaa6 could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:31:06.636941 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-47a0210d-d7e7-4af2-98fe-7f23af00decd tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] 10.222.0.58 "GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6" status: 404 len: 111 microversion: 2.42 time: 0.071317 Aug 10 23:31:06.637698 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3014/5821] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:31:06 2022] GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 10 23:31:06.647645 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-f8d4e532-d5c9-46ca-8f22-22f54cda3f8f tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Calling method '.version_select at 0x7f847d0ce940>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:31:06.670258 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-f8d4e532-d5c9-46ca-8f22-22f54cda3f8f tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-48000632" status: 204 len: 0 microversion: 2.42 time: 0.027667 Aug 10 23:31:06.671426 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2808/5822] 10.222.0.58 () {60 vars in 1256 bytes} [Wed Aug 10 23:31:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-48000632 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 10 23:31:07.854817 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-e16cd4e4-038c-4f43-8ff9-9755b88b1982 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:31:07.855893 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-e16cd4e4-038c-4f43-8ff9-9755b88b1982 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: 03e88a01-d3ed-4ab2-a334-f4bc274fe800] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:31:07.863355 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:31:07.880610 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e16cd4e4-038c-4f43-8ff9-9755b88b1982 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:31:07.881125 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e16cd4e4-038c-4f43-8ff9-9755b88b1982 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:31:07.882615 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e16cd4e4-038c-4f43-8ff9-9755b88b1982 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:31:07.883454 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e16cd4e4-038c-4f43-8ff9-9755b88b1982 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:31:07.883916 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e16cd4e4-038c-4f43-8ff9-9755b88b1982 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:31:07.887330 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e16cd4e4-038c-4f43-8ff9-9755b88b1982 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:31:07.922650 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-e16cd4e4-038c-4f43-8ff9-9755b88b1982 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] HTTP exception thrown: Instance 03e88a01-d3ed-4ab2-a334-f4bc274fe800 could not be found. Aug 10 23:31:07.935314 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-e16cd4e4-038c-4f43-8ff9-9755b88b1982 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Request method failure captured: Aug 10 23:31:07.935314 n-d-850468-14 devstack@n-api.service[122633]: request: DELETE /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800 HTTP/1.1 Aug 10 23:31:07.935314 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:31:07.935314 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:31:07.935314 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:31:07.935314 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:31:07.935314 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:31:07.935314 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:31:07.935314 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:31:07.935314 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:31:07.935314 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9D4nzVq2558z9rLfYRYA2pZxsjFz7RfLxddFUl51tG0j_Wfc_zB98us-y9yS-8JSHiS7PpysPYlf0xuzWy4DHfwFlHmfNLDHPUVze1EVhUWX7GVQuSEdV6BccfHEnO6-A9UPpzshqrhBLTpXBunL_OKsZjlyLzTn-fs8OIuwXlvyLDk Aug 10 23:31:07.935314 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:31:07.935314 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:31:07.935314 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:31:07.935314 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:31:07.935314 n-d-850468-14 devstack@n-api.service[122633]: X-Openstack-Nova-Api-Version: 2.20 Aug 10 23:31:07.935314 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:31:07.935314 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:31:07.935314 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 1597a7e6731c4f5f9d8dfdc793ec2d47 Aug 10 23:31:07.935314 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1591010651 Aug 10 23:31:07.935314 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:31:07.935314 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:31:07.935314 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1597a7e6731c4f5f9d8dfdc793ec2d47"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1597a7e6731c4f5f9d8dfdc793ec2d47"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/1597a7e6731c4f5f9d8dfdc793ec2d47"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_1597a7e6731c4f5f9d8dfdc793ec2d47", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:31:07.935314 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1591010651 Aug 10 23:31:07.935314 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 1597a7e6731c4f5f9d8dfdc793ec2d47 Aug 10 23:31:07.935314 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1591010651 Aug 10 23:31:07.935314 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-AttachVolumeShelveTestJSON-1591010651-project Aug 10 23:31:07.935314 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:31:07.935314 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:31:07.935314 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 8ad42d35070247d18e67b2fa10690252 Aug 10 23:31:07.935314 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1591010651-project Aug 10 23:31:07.935314 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:31:07.935314 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance 03e88a01-d3ed-4ab2-a334-f4bc274fe800 could not be found. Aug 10 23:31:07.935314 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': '03e88a01-d3ed-4ab2-a334-f4bc274fe800'} Aug 10 23:31:07.935314 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:31:07.935314 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:31:07.935314 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:31:07.935314 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:31:07.935314 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:31:07.935314 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:31:07.935314 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:31:07.935314 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:31:07.935314 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:31:07.935314 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:31:07.935314 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03e88a01-d3ed-4ab2-a334-f4bc274fe800 could not be found. Aug 10 23:31:07.935314 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:31:07.935314 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:31:07.935314 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:31:07.935314 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:31:07.935314 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:31:07.935314 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:31:07.935314 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:31:07.935314 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:31:07.935314 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:31:07.935314 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:31:07.935314 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 23:31:07.935314 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 23:31:07.935314 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 23:31:07.935314 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 23:31:07.935314 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:31:07.935314 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:31:07.935314 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:31:07.935314 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:31:07.942393 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03e88a01-d3ed-4ab2-a334-f4bc274fe800 could not be found. Aug 10 23:31:07.942393 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:31:07.942393 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:31:07.942393 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:31:07.942393 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:31:07.942393 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:31:07.942393 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:31:07.942393 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:31:07.942393 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:31:07.942393 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03e88a01-d3ed-4ab2-a334-f4bc274fe800 could not be found. Aug 10 23:31:07.942393 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:31:07.946074 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-e16cd4e4-038c-4f43-8ff9-9755b88b1982 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Returning 404 to user: Instance 03e88a01-d3ed-4ab2-a334-f4bc274fe800 could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:31:07.947247 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-e16cd4e4-038c-4f43-8ff9-9755b88b1982 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "DELETE /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800" status: 404 len: 111 microversion: 2.20 time: 0.096368 Aug 10 23:31:07.948427 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3015/5823] 10.222.0.58 () {60 vars in 1280 bytes} [Wed Aug 10 23:31:07 2022] DELETE /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 10 23:31:07.957883 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-2c3e21be-9092-4750-bd5f-a360e875d7b4 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:31:07.958830 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-2c3e21be-9092-4750-bd5f-a360e875d7b4 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] [instance: 03e88a01-d3ed-4ab2-a334-f4bc274fe800] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:31:07.968900 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2c3e21be-9092-4750-bd5f-a360e875d7b4 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:31:07.969437 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2c3e21be-9092-4750-bd5f-a360e875d7b4 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:31:07.970144 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2c3e21be-9092-4750-bd5f-a360e875d7b4 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:31:07.971152 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2c3e21be-9092-4750-bd5f-a360e875d7b4 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:31:07.971621 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2c3e21be-9092-4750-bd5f-a360e875d7b4 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:31:07.972055 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2c3e21be-9092-4750-bd5f-a360e875d7b4 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:31:07.988957 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-2c3e21be-9092-4750-bd5f-a360e875d7b4 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] HTTP exception thrown: Instance 03e88a01-d3ed-4ab2-a334-f4bc274fe800 could not be found. Aug 10 23:31:07.990597 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-2c3e21be-9092-4750-bd5f-a360e875d7b4 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Request method failure captured: Aug 10 23:31:07.990597 n-d-850468-14 devstack@n-api.service[122632]: request: GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800 HTTP/1.1 Aug 10 23:31:07.990597 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:31:07.990597 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:31:07.990597 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:31:07.990597 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 23:31:07.990597 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:31:07.990597 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:31:07.990597 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:31:07.990597 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:31:07.990597 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9D4nzVq2558z9rLfYRYA2pZxsjFz7RfLxddFUl51tG0j_Wfc_zB98us-y9yS-8JSHiS7PpysPYlf0xuzWy4DHfwFlHmfNLDHPUVze1EVhUWX7GVQuSEdV6BccfHEnO6-A9UPpzshqrhBLTpXBunL_OKsZjlyLzTn-fs8OIuwXlvyLDk Aug 10 23:31:07.990597 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:31:07.990597 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:31:07.990597 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:31:07.990597 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:31:07.990597 n-d-850468-14 devstack@n-api.service[122632]: X-Openstack-Nova-Api-Version: 2.20 Aug 10 23:31:07.990597 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:31:07.990597 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:31:07.990597 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 1597a7e6731c4f5f9d8dfdc793ec2d47 Aug 10 23:31:07.990597 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1591010651 Aug 10 23:31:07.990597 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:31:07.990597 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:31:07.990597 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1597a7e6731c4f5f9d8dfdc793ec2d47"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/1597a7e6731c4f5f9d8dfdc793ec2d47"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/1597a7e6731c4f5f9d8dfdc793ec2d47"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_1597a7e6731c4f5f9d8dfdc793ec2d47", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:31:07.990597 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1591010651 Aug 10 23:31:07.990597 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 1597a7e6731c4f5f9d8dfdc793ec2d47 Aug 10 23:31:07.990597 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1591010651 Aug 10 23:31:07.990597 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-AttachVolumeShelveTestJSON-1591010651-project Aug 10 23:31:07.990597 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:31:07.990597 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:31:07.990597 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: 8ad42d35070247d18e67b2fa10690252 Aug 10 23:31:07.990597 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1591010651-project Aug 10 23:31:07.990597 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:31:07.990597 n-d-850468-14 devstack@n-api.service[122632]: exception: Instance 03e88a01-d3ed-4ab2-a334-f4bc274fe800 could not be found. Aug 10 23:31:07.990597 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': '03e88a01-d3ed-4ab2-a334-f4bc274fe800'} Aug 10 23:31:07.990597 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:31:07.990597 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:31:07.990597 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:31:07.990597 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:31:07.990597 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:31:07.990597 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:31:07.990597 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:31:07.990597 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:31:07.990597 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:31:07.990597 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:31:07.990597 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03e88a01-d3ed-4ab2-a334-f4bc274fe800 could not be found. Aug 10 23:31:07.990597 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:31:07.990597 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:31:07.990597 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:31:07.990597 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:31:07.990597 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:31:07.990597 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:31:07.990597 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:31:07.990597 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:31:07.990597 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:31:07.990597 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:31:07.990597 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:31:07.990597 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:31:07.990597 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:31:07.990597 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:31:07.990597 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:31:07.990597 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:31:07.990597 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03e88a01-d3ed-4ab2-a334-f4bc274fe800 could not be found. Aug 10 23:31:07.990597 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:31:07.990597 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:31:07.995886 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:31:07.995886 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:31:07.995886 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:31:07.995886 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:31:07.995886 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:31:07.995886 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:31:07.995886 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03e88a01-d3ed-4ab2-a334-f4bc274fe800 could not be found. Aug 10 23:31:07.995886 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:31:07.995886 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-2c3e21be-9092-4750-bd5f-a360e875d7b4 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] Returning 404 to user: Instance 03e88a01-d3ed-4ab2-a334-f4bc274fe800 could not be found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:31:07.995886 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-2c3e21be-9092-4750-bd5f-a360e875d7b4 tempest-AttachVolumeShelveTestJSON-1591010651 tempest-AttachVolumeShelveTestJSON-1591010651-project] 10.222.0.58 "GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800" status: 404 len: 111 microversion: 2.20 time: 0.039243 Aug 10 23:31:07.997347 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2809/5824] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:31:07 2022] GET /compute/v2.1/servers/03e88a01-d3ed-4ab2-a334-f4bc274fe800 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 10 23:31:09.691658 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-075d8ce2-bb46-45ae-abf7-f432898533cc tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:31:09.695277 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-075d8ce2-bb46-45ae-abf7-f432898533cc tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] [instance: aa0bed62-e734-42e6-9211-88beb761554a] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:31:09.713107 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-075d8ce2-bb46-45ae-abf7-f432898533cc tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:31:09.713581 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-075d8ce2-bb46-45ae-abf7-f432898533cc tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:31:09.716293 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-075d8ce2-bb46-45ae-abf7-f432898533cc tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:31:09.717042 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-075d8ce2-bb46-45ae-abf7-f432898533cc tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:31:09.717527 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-075d8ce2-bb46-45ae-abf7-f432898533cc tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:31:09.720720 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-075d8ce2-bb46-45ae-abf7-f432898533cc tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:31:09.801307 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-075d8ce2-bb46-45ae-abf7-f432898533cc tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] 10.222.0.58 "POST /compute/v2.1/servers/aa0bed62-e734-42e6-9211-88beb761554a/action" status: 200 len: 32644 microversion: 2.1 time: 0.113828 Aug 10 23:31:09.802546 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3016/5825] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:31:09 2022] POST /compute/v2.1/servers/aa0bed62-e734-42e6-9211-88beb761554a/action => generated 32644 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 23:31:11.257283 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-0c3a5f0f-f89f-4141-b474-737bd4a7b7e3 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:31:11.261223 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-0c3a5f0f-f89f-4141-b474-737bd4a7b7e3 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] [instance: 94831c62-29a5-4745-b321-11b28dafaaa6] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:31:11.276539 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0c3a5f0f-f89f-4141-b474-737bd4a7b7e3 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:31:11.277050 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0c3a5f0f-f89f-4141-b474-737bd4a7b7e3 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:31:11.277930 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0c3a5f0f-f89f-4141-b474-737bd4a7b7e3 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:31:11.278991 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0c3a5f0f-f89f-4141-b474-737bd4a7b7e3 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:31:11.279628 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0c3a5f0f-f89f-4141-b474-737bd4a7b7e3 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:31:11.280237 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0c3a5f0f-f89f-4141-b474-737bd4a7b7e3 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:31:11.296927 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-0c3a5f0f-f89f-4141-b474-737bd4a7b7e3 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] HTTP exception thrown: Instance 94831c62-29a5-4745-b321-11b28dafaaa6 could not be found. Aug 10 23:31:11.299051 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-0c3a5f0f-f89f-4141-b474-737bd4a7b7e3 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Request method failure captured: Aug 10 23:31:11.299051 n-d-850468-14 devstack@n-api.service[122632]: request: DELETE /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6 HTTP/1.1 Aug 10 23:31:11.299051 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:31:11.299051 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:31:11.299051 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:31:11.299051 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 23:31:11.299051 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:31:11.299051 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:31:11.299051 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:31:11.299051 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:31:11.299051 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9D4oS0vT8kOsDlbudCSqgBSQVQ6hBe_ekEltYgC7aGZ-Cpt3HAe-IVZwRHPWA6btejL686Xtndap22PC4jcF2c2vHB_yaL7j-3KgR9e_8Kxu3DtmUF9OkxH6iVoeWSoshQI-vf54KyWATDhZwXIHT5xFUB8XbyPmN6ibjyOmwiN7Z8k Aug 10 23:31:11.299051 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:31:11.299051 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:31:11.299051 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:31:11.299051 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:31:11.299051 n-d-850468-14 devstack@n-api.service[122632]: X-Openstack-Nova-Api-Version: 2.42 Aug 10 23:31:11.299051 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:31:11.299051 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:31:11.299051 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: f3a075a69271470c904f8a380b0a2657 Aug 10 23:31:11.299051 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1443303384 Aug 10 23:31:11.299051 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:31:11.299051 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:31:11.299051 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f3a075a69271470c904f8a380b0a2657"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f3a075a69271470c904f8a380b0a2657"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/f3a075a69271470c904f8a380b0a2657"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_f3a075a69271470c904f8a380b0a2657", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:31:11.299051 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1443303384 Aug 10 23:31:11.299051 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: f3a075a69271470c904f8a380b0a2657 Aug 10 23:31:11.299051 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1443303384 Aug 10 23:31:11.299051 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-TaggedBootDevicesTest_v242-1443303384-project Aug 10 23:31:11.299051 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:31:11.299051 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:31:11.299051 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: a5fe70a2accc42f3ae729c02c876dce9 Aug 10 23:31:11.299051 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1443303384-project Aug 10 23:31:11.299051 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:31:11.299051 n-d-850468-14 devstack@n-api.service[122632]: exception: Instance 94831c62-29a5-4745-b321-11b28dafaaa6 could not be found. Aug 10 23:31:11.299051 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': '94831c62-29a5-4745-b321-11b28dafaaa6'} Aug 10 23:31:11.299051 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:31:11.299051 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:31:11.299051 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:31:11.299051 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:31:11.299051 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:31:11.299051 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:31:11.299051 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:31:11.299051 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:31:11.299051 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:31:11.299051 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:31:11.299051 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94831c62-29a5-4745-b321-11b28dafaaa6 could not be found. Aug 10 23:31:11.299051 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:31:11.299051 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:31:11.299051 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:31:11.299051 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:31:11.299051 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:31:11.299051 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:31:11.299051 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:31:11.299051 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:31:11.299051 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:31:11.299051 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:31:11.299051 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 23:31:11.299051 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 23:31:11.299051 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 23:31:11.299051 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 23:31:11.299051 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:31:11.299051 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:31:11.299051 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:31:11.299051 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:31:11.304378 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94831c62-29a5-4745-b321-11b28dafaaa6 could not be found. Aug 10 23:31:11.304378 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:31:11.304378 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:31:11.304378 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:31:11.304378 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:31:11.304378 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:31:11.304378 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:31:11.304378 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:31:11.304378 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:31:11.304378 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94831c62-29a5-4745-b321-11b28dafaaa6 could not be found. Aug 10 23:31:11.304378 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:31:11.306550 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-0c3a5f0f-f89f-4141-b474-737bd4a7b7e3 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Returning 404 to user: Instance 94831c62-29a5-4745-b321-11b28dafaaa6 could not be found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:31:11.307655 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-0c3a5f0f-f89f-4141-b474-737bd4a7b7e3 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] 10.222.0.58 "DELETE /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6" status: 404 len: 111 microversion: 2.42 time: 0.055810 Aug 10 23:31:11.309777 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2810/5826] 10.222.0.58 () {60 vars in 1280 bytes} [Wed Aug 10 23:31:11 2022] DELETE /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 10 23:31:11.320567 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-b89f150b-b8dc-4fca-a612-1338ed4466d8 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:31:11.321378 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-b89f150b-b8dc-4fca-a612-1338ed4466d8 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] [instance: 94831c62-29a5-4745-b321-11b28dafaaa6] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:31:11.330496 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b89f150b-b8dc-4fca-a612-1338ed4466d8 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:31:11.331125 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b89f150b-b8dc-4fca-a612-1338ed4466d8 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:31:11.331672 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b89f150b-b8dc-4fca-a612-1338ed4466d8 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:31:11.332466 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b89f150b-b8dc-4fca-a612-1338ed4466d8 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:31:11.333003 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b89f150b-b8dc-4fca-a612-1338ed4466d8 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:31:11.334609 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b89f150b-b8dc-4fca-a612-1338ed4466d8 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:31:11.354521 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-b89f150b-b8dc-4fca-a612-1338ed4466d8 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] HTTP exception thrown: Instance 94831c62-29a5-4745-b321-11b28dafaaa6 could not be found. Aug 10 23:31:11.357334 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-b89f150b-b8dc-4fca-a612-1338ed4466d8 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Request method failure captured: Aug 10 23:31:11.357334 n-d-850468-14 devstack@n-api.service[122633]: request: GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6 HTTP/1.1 Aug 10 23:31:11.357334 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:31:11.357334 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:31:11.357334 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:31:11.357334 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:31:11.357334 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:31:11.357334 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:31:11.357334 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:31:11.357334 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:31:11.357334 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9D4oS0vT8kOsDlbudCSqgBSQVQ6hBe_ekEltYgC7aGZ-Cpt3HAe-IVZwRHPWA6btejL686Xtndap22PC4jcF2c2vHB_yaL7j-3KgR9e_8Kxu3DtmUF9OkxH6iVoeWSoshQI-vf54KyWATDhZwXIHT5xFUB8XbyPmN6ibjyOmwiN7Z8k Aug 10 23:31:11.357334 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:31:11.357334 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:31:11.357334 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:31:11.357334 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:31:11.357334 n-d-850468-14 devstack@n-api.service[122633]: X-Openstack-Nova-Api-Version: 2.42 Aug 10 23:31:11.357334 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:31:11.357334 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:31:11.357334 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: f3a075a69271470c904f8a380b0a2657 Aug 10 23:31:11.357334 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1443303384 Aug 10 23:31:11.357334 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:31:11.357334 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:31:11.357334 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f3a075a69271470c904f8a380b0a2657"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f3a075a69271470c904f8a380b0a2657"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/f3a075a69271470c904f8a380b0a2657"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_f3a075a69271470c904f8a380b0a2657", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:31:11.357334 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1443303384 Aug 10 23:31:11.357334 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: f3a075a69271470c904f8a380b0a2657 Aug 10 23:31:11.357334 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1443303384 Aug 10 23:31:11.357334 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-TaggedBootDevicesTest_v242-1443303384-project Aug 10 23:31:11.357334 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:31:11.357334 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:31:11.357334 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: a5fe70a2accc42f3ae729c02c876dce9 Aug 10 23:31:11.357334 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1443303384-project Aug 10 23:31:11.357334 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:31:11.357334 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance 94831c62-29a5-4745-b321-11b28dafaaa6 could not be found. Aug 10 23:31:11.357334 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': '94831c62-29a5-4745-b321-11b28dafaaa6'} Aug 10 23:31:11.357334 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:31:11.357334 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:31:11.357334 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:31:11.357334 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:31:11.357334 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:31:11.357334 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:31:11.357334 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:31:11.357334 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:31:11.357334 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:31:11.357334 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:31:11.357334 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94831c62-29a5-4745-b321-11b28dafaaa6 could not be found. Aug 10 23:31:11.357334 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:31:11.357334 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:31:11.357334 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:31:11.357334 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:31:11.357334 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:31:11.357334 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:31:11.357334 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:31:11.357334 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:31:11.357334 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:31:11.357334 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:31:11.357334 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:31:11.357334 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:31:11.357334 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:31:11.357334 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:31:11.357334 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:31:11.357334 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:31:11.357334 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94831c62-29a5-4745-b321-11b28dafaaa6 could not be found. Aug 10 23:31:11.357334 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:31:11.357334 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:31:11.361965 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:31:11.361965 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:31:11.361965 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:31:11.361965 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:31:11.361965 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:31:11.361965 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:31:11.361965 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94831c62-29a5-4745-b321-11b28dafaaa6 could not be found. Aug 10 23:31:11.361965 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:31:11.361965 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-b89f150b-b8dc-4fca-a612-1338ed4466d8 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] Returning 404 to user: Instance 94831c62-29a5-4745-b321-11b28dafaaa6 could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:31:11.361965 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-b89f150b-b8dc-4fca-a612-1338ed4466d8 tempest-TaggedBootDevicesTest_v242-1443303384 tempest-TaggedBootDevicesTest_v242-1443303384-project] 10.222.0.58 "GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6" status: 404 len: 111 microversion: 2.42 time: 0.044804 Aug 10 23:31:11.363274 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3017/5827] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:31:11 2022] GET /compute/v2.1/servers/94831c62-29a5-4745-b321-11b28dafaaa6 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 10 23:31:11.904340 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-aa48d12d-9aa0-4789-8c1d-5ffb24a4e3b3 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:31:11.905269 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-aa48d12d-9aa0-4789-8c1d-5ffb24a4e3b3 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] [instance: aa0bed62-e734-42e6-9211-88beb761554a] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:31:11.917954 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-aa48d12d-9aa0-4789-8c1d-5ffb24a4e3b3 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:31:11.921148 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-aa48d12d-9aa0-4789-8c1d-5ffb24a4e3b3 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:31:11.921868 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-aa48d12d-9aa0-4789-8c1d-5ffb24a4e3b3 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:31:11.924548 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-aa48d12d-9aa0-4789-8c1d-5ffb24a4e3b3 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:31:11.925906 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-aa48d12d-9aa0-4789-8c1d-5ffb24a4e3b3 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:31:11.926546 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-aa48d12d-9aa0-4789-8c1d-5ffb24a4e3b3 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:31:11.931280 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-89afc1a8-711f-4d5a-a528-7a50200728eb req-6fadf8fa-17be-45e0-a5b3-b8c49cd61f3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa0bed62-e734-42e6-9211-88beb761554a", "tag": "ac21225a-7b86-4858-a07c-e2c383b8308b"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:31:11.961961 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-aa48d12d-9aa0-4789-8c1d-5ffb24a4e3b3 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] [instance: aa0bed62-e734-42e6-9211-88beb761554a] Going to try to terminate instance {{(pid=122632) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:31:11.977446 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-89afc1a8-711f-4d5a-a528-7a50200728eb req-6fadf8fa-17be-45e0-a5b3-b8c49cd61f3e service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:31:11.977947 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-89afc1a8-711f-4d5a-a528-7a50200728eb req-6fadf8fa-17be-45e0-a5b3-b8c49cd61f3e service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:31:11.978421 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-89afc1a8-711f-4d5a-a528-7a50200728eb req-6fadf8fa-17be-45e0-a5b3-b8c49cd61f3e service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:31:12.031083 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-89afc1a8-711f-4d5a-a528-7a50200728eb req-6fadf8fa-17be-45e0-a5b3-b8c49cd61f3e service nova] Creating event network-changed:ac21225a-7b86-4858-a07c-e2c383b8308b for instance aa0bed62-e734-42e6-9211-88beb761554a on n-h1-850468-14 Aug 10 23:31:12.038980 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-89afc1a8-711f-4d5a-a528-7a50200728eb req-6fadf8fa-17be-45e0-a5b3-b8c49cd61f3e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111477 Aug 10 23:31:12.040881 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3018/5828] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:31:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 23:31:12.181747 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-aa48d12d-9aa0-4789-8c1d-5ffb24a4e3b3 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] 10.222.0.58 "DELETE /compute/v2.1/servers/aa0bed62-e734-42e6-9211-88beb761554a" status: 204 len: 0 microversion: 2.1 time: 0.281482 Aug 10 23:31:12.182925 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2811/5829] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:31:11 2022] DELETE /compute/v2.1/servers/aa0bed62-e734-42e6-9211-88beb761554a => generated 0 bytes in 284 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:31:12.195864 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-d2131d95-b08b-44cb-9fcd-47fb1dbf627d tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:31:12.197375 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-d2131d95-b08b-44cb-9fcd-47fb1dbf627d tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] [instance: aa0bed62-e734-42e6-9211-88beb761554a] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:31:12.210946 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d2131d95-b08b-44cb-9fcd-47fb1dbf627d tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:31:12.211788 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d2131d95-b08b-44cb-9fcd-47fb1dbf627d tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:31:12.213840 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d2131d95-b08b-44cb-9fcd-47fb1dbf627d tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:31:12.214815 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d2131d95-b08b-44cb-9fcd-47fb1dbf627d tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:31:12.216052 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d2131d95-b08b-44cb-9fcd-47fb1dbf627d tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:31:12.218135 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d2131d95-b08b-44cb-9fcd-47fb1dbf627d tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:31:12.897197 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-d2131d95-b08b-44cb-9fcd-47fb1dbf627d tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbea80d59f5840f1899bd3cf601ac8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679d43599f3e4c29ab368a1e54dae608', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:31:12.909527 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-d2131d95-b08b-44cb-9fcd-47fb1dbf627d tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] 10.222.0.58 "GET /compute/v2.1/servers/aa0bed62-e734-42e6-9211-88beb761554a" status: 200 len: 1671 microversion: 2.1 time: 0.722014 Aug 10 23:31:12.910735 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3019/5830] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:31:12 2022] GET /compute/v2.1/servers/aa0bed62-e734-42e6-9211-88beb761554a => generated 1671 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:31:13.935874 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-5c3df372-417c-44f2-b7be-1fda74b97b3d tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:31:13.937315 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-5c3df372-417c-44f2-b7be-1fda74b97b3d tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] [instance: aa0bed62-e734-42e6-9211-88beb761554a] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:31:13.941543 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_api:SELECT=53,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:31:13.955019 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5c3df372-417c-44f2-b7be-1fda74b97b3d tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:31:13.955873 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5c3df372-417c-44f2-b7be-1fda74b97b3d tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:31:13.956579 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5c3df372-417c-44f2-b7be-1fda74b97b3d tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:31:13.957546 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5c3df372-417c-44f2-b7be-1fda74b97b3d tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:31:13.959331 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5c3df372-417c-44f2-b7be-1fda74b97b3d tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:31:13.959864 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5c3df372-417c-44f2-b7be-1fda74b97b3d tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:31:14.296713 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-5c3df372-417c-44f2-b7be-1fda74b97b3d tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbea80d59f5840f1899bd3cf601ac8bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '679d43599f3e4c29ab368a1e54dae608', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:31:14.308510 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-5c3df372-417c-44f2-b7be-1fda74b97b3d tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] 10.222.0.58 "GET /compute/v2.1/servers/aa0bed62-e734-42e6-9211-88beb761554a" status: 200 len: 1671 microversion: 2.1 time: 0.376794 Aug 10 23:31:14.310998 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2812/5831] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:31:13 2022] GET /compute/v2.1/servers/aa0bed62-e734-42e6-9211-88beb761554a => generated 1671 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:31:14.561609 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-7fad7d09-2213-4191-b5e7-e0abe22f82dc req-8ddc052a-a0f4-4ac0-b8ff-2d2f1da194fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa0bed62-e734-42e6-9211-88beb761554a", "name": "network-vif-deleted", "tag": "ac21225a-7b86-4858-a07c-e2c383b8308b"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:31:14.587599 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-7fad7d09-2213-4191-b5e7-e0abe22f82dc req-8ddc052a-a0f4-4ac0-b8ff-2d2f1da194fb service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:31:14.588267 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-7fad7d09-2213-4191-b5e7-e0abe22f82dc req-8ddc052a-a0f4-4ac0-b8ff-2d2f1da194fb service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:31:14.588847 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-7fad7d09-2213-4191-b5e7-e0abe22f82dc req-8ddc052a-a0f4-4ac0-b8ff-2d2f1da194fb service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:31:14.620376 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-7fad7d09-2213-4191-b5e7-e0abe22f82dc req-8ddc052a-a0f4-4ac0-b8ff-2d2f1da194fb service nova] Creating event network-vif-deleted:ac21225a-7b86-4858-a07c-e2c383b8308b for instance aa0bed62-e734-42e6-9211-88beb761554a on n-h1-850468-14 Aug 10 23:31:14.630915 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-7fad7d09-2213-4191-b5e7-e0abe22f82dc req-8ddc052a-a0f4-4ac0-b8ff-2d2f1da194fb service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073956 Aug 10 23:31:14.631741 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3020/5832] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:31:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:31:15.334397 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-02a0ad81-07f1-46f8-9469-495d22128d7c tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:31:15.335812 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-02a0ad81-07f1-46f8-9469-495d22128d7c tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] [instance: aa0bed62-e734-42e6-9211-88beb761554a] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:31:15.344237 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-02a0ad81-07f1-46f8-9469-495d22128d7c tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:31:15.345029 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-02a0ad81-07f1-46f8-9469-495d22128d7c tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:31:15.346083 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-02a0ad81-07f1-46f8-9469-495d22128d7c tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:31:15.347037 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-02a0ad81-07f1-46f8-9469-495d22128d7c tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:31:15.347659 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-02a0ad81-07f1-46f8-9469-495d22128d7c tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:31:15.348470 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-02a0ad81-07f1-46f8-9469-495d22128d7c tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:31:15.367311 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-02a0ad81-07f1-46f8-9469-495d22128d7c tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] HTTP exception thrown: Instance aa0bed62-e734-42e6-9211-88beb761554a could not be found. Aug 10 23:31:15.370482 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-02a0ad81-07f1-46f8-9469-495d22128d7c tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Request method failure captured: Aug 10 23:31:15.370482 n-d-850468-14 devstack@n-api.service[122632]: request: GET /compute/v2.1/servers/aa0bed62-e734-42e6-9211-88beb761554a HTTP/1.1 Aug 10 23:31:15.370482 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:31:15.370482 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:31:15.370482 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:31:15.370482 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 23:31:15.370482 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:31:15.370482 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:31:15.370482 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:31:15.370482 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:31:15.370482 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9D7xLbha89w4RFaA9WPNaubQudJCDUCb2VIWrKN08Pzedq3777Uk6apcHRNC0PbYtg_8fiEC_kC7gcTZrYMB40oQ4tWtRHjNsjVhrAhgAjKtaVvY3fCimK_NUEVEN-LM6c7t9R8XmEcJtm2mVIxpdgzackpaZxyyUWdyDfNvRMaAbQo Aug 10 23:31:15.370482 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:31:15.370482 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:31:15.370482 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:31:15.370482 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:31:15.370482 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:31:15.370482 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:31:15.370482 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 679d43599f3e4c29ab368a1e54dae608 Aug 10 23:31:15.370482 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-TestNetworkBasicOps-1961993656 Aug 10 23:31:15.370482 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:31:15.370482 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:31:15.370482 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/679d43599f3e4c29ab368a1e54dae608"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/679d43599f3e4c29ab368a1e54dae608"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/679d43599f3e4c29ab368a1e54dae608"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_679d43599f3e4c29ab368a1e54dae608", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:31:15.370482 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-TestNetworkBasicOps-1961993656 Aug 10 23:31:15.370482 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 679d43599f3e4c29ab368a1e54dae608 Aug 10 23:31:15.370482 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-TestNetworkBasicOps-1961993656 Aug 10 23:31:15.370482 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-TestNetworkBasicOps-1961993656-project Aug 10 23:31:15.370482 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:31:15.370482 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:31:15.370482 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: fbea80d59f5840f1899bd3cf601ac8bf Aug 10 23:31:15.370482 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-TestNetworkBasicOps-1961993656-project Aug 10 23:31:15.370482 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:31:15.370482 n-d-850468-14 devstack@n-api.service[122632]: exception: Instance aa0bed62-e734-42e6-9211-88beb761554a could not be found. Aug 10 23:31:15.370482 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': 'aa0bed62-e734-42e6-9211-88beb761554a'} Aug 10 23:31:15.370482 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:31:15.370482 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:31:15.370482 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:31:15.370482 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:31:15.370482 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:31:15.370482 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:31:15.370482 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:31:15.370482 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:31:15.370482 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:31:15.370482 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:31:15.370482 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa0bed62-e734-42e6-9211-88beb761554a could not be found. Aug 10 23:31:15.370482 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:31:15.370482 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:31:15.370482 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:31:15.370482 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:31:15.370482 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:31:15.370482 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:31:15.370482 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:31:15.370482 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:31:15.370482 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:31:15.370482 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:31:15.370482 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:31:15.370482 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:31:15.370482 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:31:15.370482 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:31:15.370482 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:31:15.370482 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:31:15.370482 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa0bed62-e734-42e6-9211-88beb761554a could not be found. Aug 10 23:31:15.370482 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:31:15.370482 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:31:15.370482 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:31:15.382009 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:31:15.382009 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:31:15.382009 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:31:15.382009 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:31:15.382009 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:31:15.382009 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa0bed62-e734-42e6-9211-88beb761554a could not be found. Aug 10 23:31:15.382009 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:31:15.382009 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-02a0ad81-07f1-46f8-9469-495d22128d7c tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Returning 404 to user: Instance aa0bed62-e734-42e6-9211-88beb761554a could not be found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:31:15.382009 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-02a0ad81-07f1-46f8-9469-495d22128d7c tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] 10.222.0.58 "GET /compute/v2.1/servers/aa0bed62-e734-42e6-9211-88beb761554a" status: 404 len: 111 microversion: 2.1 time: 0.042676 Aug 10 23:31:15.382009 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2813/5833] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:31:15 2022] GET /compute/v2.1/servers/aa0bed62-e734-42e6-9211-88beb761554a => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:31:15.626006 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-ffba7a73-efb3-459b-bb8e-eaad54788d12 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] Calling method '.version_select at 0x7f847c4f3820>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:31:15.674437 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-ffba7a73-efb3-459b-bb8e-eaad54788d12 tempest-TestNetworkBasicOps-1961993656 tempest-TestNetworkBasicOps-1961993656-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-361587300" status: 202 len: 0 microversion: 2.1 time: 0.056425 Aug 10 23:31:15.675201 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3021/5834] 10.222.0.58 () {58 vars in 1254 bytes} [Wed Aug 10 23:31:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-361587300 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:31:43.258812 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_api:SELECT=3 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:31:43.260195 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:31:43.519789 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-b9affba9-1c61-4a04-a0a0-2eff30c83b27 tempest-ServersAaction247Test-2057910578 tempest-ServersAaction247Test-2057910578-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-1823652217", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452", "networks": "none"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:31:43.677303 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-b9affba9-1c61-4a04-a0a0-2eff30c83b27 tempest-ServersAaction247Test-2057910578 tempest-ServersAaction247Test-2057910578-project] Flavor limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:31:43.677735 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-b9affba9-1c61-4a04-a0a0-2eff30c83b27 tempest-ServersAaction247Test-2057910578 tempest-ServersAaction247Test-2057910578-project] Image limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:31:43.678207 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-b9affba9-1c61-4a04-a0a0-2eff30c83b27 tempest-ServersAaction247Test-2057910578 tempest-ServersAaction247Test-2057910578-project] Flavor pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:31:43.678624 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-b9affba9-1c61-4a04-a0a0-2eff30c83b27 tempest-ServersAaction247Test-2057910578 tempest-ServersAaction247Test-2057910578-project] Image pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:31:43.679067 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-b9affba9-1c61-4a04-a0a0-2eff30c83b27 tempest-ServersAaction247Test-2057910578 tempest-ServersAaction247Test-2057910578-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:31:43.691198 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b9affba9-1c61-4a04-a0a0-2eff30c83b27 tempest-ServersAaction247Test-2057910578 tempest-ServersAaction247Test-2057910578-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:31:43.702889 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b9affba9-1c61-4a04-a0a0-2eff30c83b27 tempest-ServersAaction247Test-2057910578 tempest-ServersAaction247Test-2057910578-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:31:43.703578 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b9affba9-1c61-4a04-a0a0-2eff30c83b27 tempest-ServersAaction247Test-2057910578 tempest-ServersAaction247Test-2057910578-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:31:43.704663 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b9affba9-1c61-4a04-a0a0-2eff30c83b27 tempest-ServersAaction247Test-2057910578 tempest-ServersAaction247Test-2057910578-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:31:43.705235 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b9affba9-1c61-4a04-a0a0-2eff30c83b27 tempest-ServersAaction247Test-2057910578 tempest-ServersAaction247Test-2057910578-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:31:43.705793 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b9affba9-1c61-4a04-a0a0-2eff30c83b27 tempest-ServersAaction247Test-2057910578 tempest-ServersAaction247Test-2057910578-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:31:43.729852 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-b9affba9-1c61-4a04-a0a0-2eff30c83b27 tempest-ServersAaction247Test-2057910578 tempest-ServersAaction247Test-2057910578-project] Getting quotas for project 6b6f22dbd68c42aba2b2d509a31626c2. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:31:43.737698 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-b9affba9-1c61-4a04-a0a0-2eff30c83b27 tempest-ServersAaction247Test-2057910578 tempest-ServersAaction247Test-2057910578-project] Getting quotas for user 35d469e10d9b40b29edd1f9447e15106 and project 6b6f22dbd68c42aba2b2d509a31626c2. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:31:43.764711 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-b9affba9-1c61-4a04-a0a0-2eff30c83b27 tempest-ServersAaction247Test-2057910578 tempest-ServersAaction247Test-2057910578-project] Going to run 1 instances... {{(pid=122632) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 23:31:43.769613 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-b9affba9-1c61-4a04-a0a0-2eff30c83b27 tempest-ServersAaction247Test-2057910578 tempest-ServersAaction247Test-2057910578-project] [instance: ace16f92-36b0-4559-9f32-d2970c582310] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78ad8905-f66f-4733-8be9-2b260f1fabed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122632) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 23:31:43.856511 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-b9affba9-1c61-4a04-a0a0-2eff30c83b27 tempest-ServersAaction247Test-2057910578 tempest-ServersAaction247Test-2057910578-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.602833 Aug 10 23:31:43.857788 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2814/5835] 10.222.0.58 () {62 vars in 1188 bytes} [Wed Aug 10 23:31:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 605 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 10 23:31:43.872345 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-51f3bdd9-80d0-4e2c-86fb-fa0c55ffc829 tempest-ServersAaction247Test-2057910578 tempest-ServersAaction247Test-2057910578-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:31:43.883590 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-51f3bdd9-80d0-4e2c-86fb-fa0c55ffc829 tempest-ServersAaction247Test-2057910578 tempest-ServersAaction247Test-2057910578-project] [instance: ace16f92-36b0-4559-9f32-d2970c582310] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:31:43.892101 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:31:43.894888 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_api:SELECT=14,nova_api:DELETE=1 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:31:44.054645 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-51f3bdd9-80d0-4e2c-86fb-fa0c55ffc829 tempest-ServersAaction247Test-2057910578 tempest-ServersAaction247Test-2057910578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d469e10d9b40b29edd1f9447e15106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6f22dbd68c42aba2b2d509a31626c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:31:44.065996 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-51f3bdd9-80d0-4e2c-86fb-fa0c55ffc829 tempest-ServersAaction247Test-2057910578 tempest-ServersAaction247Test-2057910578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d469e10d9b40b29edd1f9447e15106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6f22dbd68c42aba2b2d509a31626c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:31:44.069818 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-51f3bdd9-80d0-4e2c-86fb-fa0c55ffc829 tempest-ServersAaction247Test-2057910578 tempest-ServersAaction247Test-2057910578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d469e10d9b40b29edd1f9447e15106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6f22dbd68c42aba2b2d509a31626c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:31:44.071484 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-51f3bdd9-80d0-4e2c-86fb-fa0c55ffc829 tempest-ServersAaction247Test-2057910578 tempest-ServersAaction247Test-2057910578-project] 10.222.0.58 "GET /compute/v2.1/servers/ace16f92-36b0-4559-9f32-d2970c582310" status: 200 len: 1281 microversion: 2.47 time: 0.203509 Aug 10 23:31:44.072062 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3022/5836] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:31:43 2022] GET /compute/v2.1/servers/ace16f92-36b0-4559-9f32-d2970c582310 => generated 1281 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:31:45.097493 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-d1fcf4b2-1e0a-4419-9646-ecab8bab280b tempest-ServersAaction247Test-2057910578 tempest-ServersAaction247Test-2057910578-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:31:45.098966 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-d1fcf4b2-1e0a-4419-9646-ecab8bab280b tempest-ServersAaction247Test-2057910578 tempest-ServersAaction247Test-2057910578-project] [instance: ace16f92-36b0-4559-9f32-d2970c582310] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:31:45.111958 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d1fcf4b2-1e0a-4419-9646-ecab8bab280b tempest-ServersAaction247Test-2057910578 tempest-ServersAaction247Test-2057910578-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:31:45.113943 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d1fcf4b2-1e0a-4419-9646-ecab8bab280b tempest-ServersAaction247Test-2057910578 tempest-ServersAaction247Test-2057910578-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:31:45.114396 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d1fcf4b2-1e0a-4419-9646-ecab8bab280b tempest-ServersAaction247Test-2057910578 tempest-ServersAaction247Test-2057910578-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:31:45.115877 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d1fcf4b2-1e0a-4419-9646-ecab8bab280b tempest-ServersAaction247Test-2057910578 tempest-ServersAaction247Test-2057910578-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:31:45.119817 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d1fcf4b2-1e0a-4419-9646-ecab8bab280b tempest-ServersAaction247Test-2057910578 tempest-ServersAaction247Test-2057910578-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:31:45.120314 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d1fcf4b2-1e0a-4419-9646-ecab8bab280b tempest-ServersAaction247Test-2057910578 tempest-ServersAaction247Test-2057910578-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:31:45.266639 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-d1fcf4b2-1e0a-4419-9646-ecab8bab280b tempest-ServersAaction247Test-2057910578 tempest-ServersAaction247Test-2057910578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d469e10d9b40b29edd1f9447e15106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6f22dbd68c42aba2b2d509a31626c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:31:45.278451 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-d1fcf4b2-1e0a-4419-9646-ecab8bab280b tempest-ServersAaction247Test-2057910578 tempest-ServersAaction247Test-2057910578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d469e10d9b40b29edd1f9447e15106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6f22dbd68c42aba2b2d509a31626c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:31:45.284248 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-d1fcf4b2-1e0a-4419-9646-ecab8bab280b tempest-ServersAaction247Test-2057910578 tempest-ServersAaction247Test-2057910578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d469e10d9b40b29edd1f9447e15106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6f22dbd68c42aba2b2d509a31626c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:31:45.285694 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-d1fcf4b2-1e0a-4419-9646-ecab8bab280b tempest-ServersAaction247Test-2057910578 tempest-ServersAaction247Test-2057910578-project] 10.222.0.58 "GET /compute/v2.1/servers/ace16f92-36b0-4559-9f32-d2970c582310" status: 200 len: 1333 microversion: 2.47 time: 0.194111 Aug 10 23:31:45.299579 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2815/5837] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:31:45 2022] GET /compute/v2.1/servers/ace16f92-36b0-4559-9f32-d2970c582310 => generated 1333 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 10 23:31:46.327017 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-72239d9a-246a-4e88-b43d-03c8daed1242 tempest-ServersAaction247Test-2057910578 tempest-ServersAaction247Test-2057910578-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:31:46.331047 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-72239d9a-246a-4e88-b43d-03c8daed1242 tempest-ServersAaction247Test-2057910578 tempest-ServersAaction247Test-2057910578-project] [instance: ace16f92-36b0-4559-9f32-d2970c582310] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:31:46.340646 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-72239d9a-246a-4e88-b43d-03c8daed1242 tempest-ServersAaction247Test-2057910578 tempest-ServersAaction247Test-2057910578-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:31:46.341641 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-72239d9a-246a-4e88-b43d-03c8daed1242 tempest-ServersAaction247Test-2057910578 tempest-ServersAaction247Test-2057910578-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:31:46.342227 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-72239d9a-246a-4e88-b43d-03c8daed1242 tempest-ServersAaction247Test-2057910578 tempest-ServersAaction247Test-2057910578-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:31:46.343333 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-72239d9a-246a-4e88-b43d-03c8daed1242 tempest-ServersAaction247Test-2057910578 tempest-ServersAaction247Test-2057910578-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:31:46.345245 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-72239d9a-246a-4e88-b43d-03c8daed1242 tempest-ServersAaction247Test-2057910578 tempest-ServersAaction247Test-2057910578-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:31:46.346142 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-72239d9a-246a-4e88-b43d-03c8daed1242 tempest-ServersAaction247Test-2057910578 tempest-ServersAaction247Test-2057910578-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:31:46.430138 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-72239d9a-246a-4e88-b43d-03c8daed1242 tempest-ServersAaction247Test-2057910578 tempest-ServersAaction247Test-2057910578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d469e10d9b40b29edd1f9447e15106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6f22dbd68c42aba2b2d509a31626c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:31:46.446207 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-72239d9a-246a-4e88-b43d-03c8daed1242 tempest-ServersAaction247Test-2057910578 tempest-ServersAaction247Test-2057910578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d469e10d9b40b29edd1f9447e15106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6f22dbd68c42aba2b2d509a31626c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:31:46.448014 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-72239d9a-246a-4e88-b43d-03c8daed1242 tempest-ServersAaction247Test-2057910578 tempest-ServersAaction247Test-2057910578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d469e10d9b40b29edd1f9447e15106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6f22dbd68c42aba2b2d509a31626c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:31:46.449693 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-72239d9a-246a-4e88-b43d-03c8daed1242 tempest-ServersAaction247Test-2057910578 tempest-ServersAaction247Test-2057910578-project] 10.222.0.58 "GET /compute/v2.1/servers/ace16f92-36b0-4559-9f32-d2970c582310" status: 200 len: 1339 microversion: 2.47 time: 0.130346 Aug 10 23:31:46.462860 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3023/5838] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:31:46 2022] GET /compute/v2.1/servers/ace16f92-36b0-4559-9f32-d2970c582310 => generated 1339 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:31:47.474565 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-6d541547-4845-4180-b94b-d89f15c4d7f4 tempest-ServersAaction247Test-2057910578 tempest-ServersAaction247Test-2057910578-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:31:47.475348 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-6d541547-4845-4180-b94b-d89f15c4d7f4 tempest-ServersAaction247Test-2057910578 tempest-ServersAaction247Test-2057910578-project] [instance: ace16f92-36b0-4559-9f32-d2970c582310] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:31:47.484842 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6d541547-4845-4180-b94b-d89f15c4d7f4 tempest-ServersAaction247Test-2057910578 tempest-ServersAaction247Test-2057910578-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:31:47.485655 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6d541547-4845-4180-b94b-d89f15c4d7f4 tempest-ServersAaction247Test-2057910578 tempest-ServersAaction247Test-2057910578-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:31:47.486581 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6d541547-4845-4180-b94b-d89f15c4d7f4 tempest-ServersAaction247Test-2057910578 tempest-ServersAaction247Test-2057910578-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:31:47.487577 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6d541547-4845-4180-b94b-d89f15c4d7f4 tempest-ServersAaction247Test-2057910578 tempest-ServersAaction247Test-2057910578-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:31:47.488709 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6d541547-4845-4180-b94b-d89f15c4d7f4 tempest-ServersAaction247Test-2057910578 tempest-ServersAaction247Test-2057910578-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:31:47.489608 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6d541547-4845-4180-b94b-d89f15c4d7f4 tempest-ServersAaction247Test-2057910578 tempest-ServersAaction247Test-2057910578-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:31:47.636515 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-6d541547-4845-4180-b94b-d89f15c4d7f4 tempest-ServersAaction247Test-2057910578 tempest-ServersAaction247Test-2057910578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d469e10d9b40b29edd1f9447e15106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6f22dbd68c42aba2b2d509a31626c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:31:47.650390 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-6d541547-4845-4180-b94b-d89f15c4d7f4 tempest-ServersAaction247Test-2057910578 tempest-ServersAaction247Test-2057910578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d469e10d9b40b29edd1f9447e15106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6f22dbd68c42aba2b2d509a31626c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:31:47.652588 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-6d541547-4845-4180-b94b-d89f15c4d7f4 tempest-ServersAaction247Test-2057910578 tempest-ServersAaction247Test-2057910578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d469e10d9b40b29edd1f9447e15106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6f22dbd68c42aba2b2d509a31626c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:31:47.657345 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-6d541547-4845-4180-b94b-d89f15c4d7f4 tempest-ServersAaction247Test-2057910578 tempest-ServersAaction247Test-2057910578-project] 10.222.0.58 "GET /compute/v2.1/servers/ace16f92-36b0-4559-9f32-d2970c582310" status: 200 len: 1339 microversion: 2.47 time: 0.186551 Aug 10 23:31:47.658639 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2816/5839] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:31:47 2022] GET /compute/v2.1/servers/ace16f92-36b0-4559-9f32-d2970c582310 => generated 1339 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:31:48.680995 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-9a895412-b11f-4331-bfeb-bba3e80f394d tempest-ServersAaction247Test-2057910578 tempest-ServersAaction247Test-2057910578-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:31:48.682487 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-9a895412-b11f-4331-bfeb-bba3e80f394d tempest-ServersAaction247Test-2057910578 tempest-ServersAaction247Test-2057910578-project] [instance: ace16f92-36b0-4559-9f32-d2970c582310] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:31:48.697313 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9a895412-b11f-4331-bfeb-bba3e80f394d tempest-ServersAaction247Test-2057910578 tempest-ServersAaction247Test-2057910578-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:31:48.699403 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9a895412-b11f-4331-bfeb-bba3e80f394d tempest-ServersAaction247Test-2057910578 tempest-ServersAaction247Test-2057910578-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:31:48.702261 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9a895412-b11f-4331-bfeb-bba3e80f394d tempest-ServersAaction247Test-2057910578 tempest-ServersAaction247Test-2057910578-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:31:48.703464 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9a895412-b11f-4331-bfeb-bba3e80f394d tempest-ServersAaction247Test-2057910578 tempest-ServersAaction247Test-2057910578-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:31:48.704621 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9a895412-b11f-4331-bfeb-bba3e80f394d tempest-ServersAaction247Test-2057910578 tempest-ServersAaction247Test-2057910578-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:31:48.706729 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9a895412-b11f-4331-bfeb-bba3e80f394d tempest-ServersAaction247Test-2057910578 tempest-ServersAaction247Test-2057910578-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:31:48.846176 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-9a895412-b11f-4331-bfeb-bba3e80f394d tempest-ServersAaction247Test-2057910578 tempest-ServersAaction247Test-2057910578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d469e10d9b40b29edd1f9447e15106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6f22dbd68c42aba2b2d509a31626c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:31:48.862301 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-9a895412-b11f-4331-bfeb-bba3e80f394d tempest-ServersAaction247Test-2057910578 tempest-ServersAaction247Test-2057910578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d469e10d9b40b29edd1f9447e15106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6f22dbd68c42aba2b2d509a31626c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:31:48.864363 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-9a895412-b11f-4331-bfeb-bba3e80f394d tempest-ServersAaction247Test-2057910578 tempest-ServersAaction247Test-2057910578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d469e10d9b40b29edd1f9447e15106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6f22dbd68c42aba2b2d509a31626c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:31:48.866210 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-9a895412-b11f-4331-bfeb-bba3e80f394d tempest-ServersAaction247Test-2057910578 tempest-ServersAaction247Test-2057910578-project] 10.222.0.58 "GET /compute/v2.1/servers/ace16f92-36b0-4559-9f32-d2970c582310" status: 200 len: 1360 microversion: 2.47 time: 0.189500 Aug 10 23:31:48.878861 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3024/5840] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:31:48 2022] GET /compute/v2.1/servers/ace16f92-36b0-4559-9f32-d2970c582310 => generated 1360 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:31:48.891492 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-dea0f6a9-337b-420b-8c2f-3c17e9323ce3 tempest-ServersAaction247Test-2057910578 tempest-ServersAaction247Test-2057910578-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1531383645"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:31:48.894322 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-dea0f6a9-337b-420b-8c2f-3c17e9323ce3 tempest-ServersAaction247Test-2057910578 tempest-ServersAaction247Test-2057910578-project] [instance: ace16f92-36b0-4559-9f32-d2970c582310] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:31:48.912051 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dea0f6a9-337b-420b-8c2f-3c17e9323ce3 tempest-ServersAaction247Test-2057910578 tempest-ServersAaction247Test-2057910578-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:31:48.912051 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dea0f6a9-337b-420b-8c2f-3c17e9323ce3 tempest-ServersAaction247Test-2057910578 tempest-ServersAaction247Test-2057910578-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:31:48.912051 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dea0f6a9-337b-420b-8c2f-3c17e9323ce3 tempest-ServersAaction247Test-2057910578 tempest-ServersAaction247Test-2057910578-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:31:48.912051 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dea0f6a9-337b-420b-8c2f-3c17e9323ce3 tempest-ServersAaction247Test-2057910578 tempest-ServersAaction247Test-2057910578-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:31:48.912051 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dea0f6a9-337b-420b-8c2f-3c17e9323ce3 tempest-ServersAaction247Test-2057910578 tempest-ServersAaction247Test-2057910578-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:31:48.912445 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dea0f6a9-337b-420b-8c2f-3c17e9323ce3 tempest-ServersAaction247Test-2057910578 tempest-ServersAaction247Test-2057910578-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:31:49.295898 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-dea0f6a9-337b-420b-8c2f-3c17e9323ce3 tempest-ServersAaction247Test-2057910578 tempest-ServersAaction247Test-2057910578-project] 10.222.0.58 "POST /compute/v2.1/servers/ace16f92-36b0-4559-9f32-d2970c582310/action" status: 202 len: 52 microversion: 2.47 time: 0.407262 Aug 10 23:31:49.299061 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2817/5841] 10.222.0.58 () {62 vars in 1319 bytes} [Wed Aug 10 23:31:48 2022] POST /compute/v2.1/servers/ace16f92-36b0-4559-9f32-d2970c582310/action => generated 52 bytes in 412 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Aug 10 23:31:49.309536 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-70067c71-23f1-4e9f-b46e-246e81b075e2 tempest-ServersAaction247Test-2057910578 tempest-ServersAaction247Test-2057910578-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:31:49.310368 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-70067c71-23f1-4e9f-b46e-246e81b075e2 tempest-ServersAaction247Test-2057910578 tempest-ServersAaction247Test-2057910578-project] [instance: ace16f92-36b0-4559-9f32-d2970c582310] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:31:49.319487 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-70067c71-23f1-4e9f-b46e-246e81b075e2 tempest-ServersAaction247Test-2057910578 tempest-ServersAaction247Test-2057910578-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:31:49.320230 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-70067c71-23f1-4e9f-b46e-246e81b075e2 tempest-ServersAaction247Test-2057910578 tempest-ServersAaction247Test-2057910578-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:31:49.320825 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-70067c71-23f1-4e9f-b46e-246e81b075e2 tempest-ServersAaction247Test-2057910578 tempest-ServersAaction247Test-2057910578-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:31:49.321819 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-70067c71-23f1-4e9f-b46e-246e81b075e2 tempest-ServersAaction247Test-2057910578 tempest-ServersAaction247Test-2057910578-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:31:49.322447 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-70067c71-23f1-4e9f-b46e-246e81b075e2 tempest-ServersAaction247Test-2057910578 tempest-ServersAaction247Test-2057910578-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:31:49.323127 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-70067c71-23f1-4e9f-b46e-246e81b075e2 tempest-ServersAaction247Test-2057910578 tempest-ServersAaction247Test-2057910578-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:31:49.360222 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-70067c71-23f1-4e9f-b46e-246e81b075e2 tempest-ServersAaction247Test-2057910578 tempest-ServersAaction247Test-2057910578-project] [instance: ace16f92-36b0-4559-9f32-d2970c582310] Going to try to terminate instance {{(pid=122633) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:31:49.487960 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-70067c71-23f1-4e9f-b46e-246e81b075e2 tempest-ServersAaction247Test-2057910578 tempest-ServersAaction247Test-2057910578-project] 10.222.0.58 "DELETE /compute/v2.1/servers/ace16f92-36b0-4559-9f32-d2970c582310" status: 204 len: 0 microversion: 2.47 time: 0.182590 Aug 10 23:31:49.489834 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3025/5842] 10.222.0.58 () {60 vars in 1280 bytes} [Wed Aug 10 23:31:49 2022] DELETE /compute/v2.1/servers/ace16f92-36b0-4559-9f32-d2970c582310 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 10 23:31:49.501438 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-ea328044-0ee9-4cdb-b628-fe92eab11d1d tempest-ServersAaction247Test-2057910578 tempest-ServersAaction247Test-2057910578-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:31:49.502612 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-ea328044-0ee9-4cdb-b628-fe92eab11d1d tempest-ServersAaction247Test-2057910578 tempest-ServersAaction247Test-2057910578-project] [instance: ace16f92-36b0-4559-9f32-d2970c582310] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:31:49.532660 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ea328044-0ee9-4cdb-b628-fe92eab11d1d tempest-ServersAaction247Test-2057910578 tempest-ServersAaction247Test-2057910578-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:31:49.533885 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ea328044-0ee9-4cdb-b628-fe92eab11d1d tempest-ServersAaction247Test-2057910578 tempest-ServersAaction247Test-2057910578-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:31:49.534534 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ea328044-0ee9-4cdb-b628-fe92eab11d1d tempest-ServersAaction247Test-2057910578 tempest-ServersAaction247Test-2057910578-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:31:49.535520 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ea328044-0ee9-4cdb-b628-fe92eab11d1d tempest-ServersAaction247Test-2057910578 tempest-ServersAaction247Test-2057910578-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:31:49.536182 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ea328044-0ee9-4cdb-b628-fe92eab11d1d tempest-ServersAaction247Test-2057910578 tempest-ServersAaction247Test-2057910578-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:31:49.536820 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ea328044-0ee9-4cdb-b628-fe92eab11d1d tempest-ServersAaction247Test-2057910578 tempest-ServersAaction247Test-2057910578-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:31:49.675165 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-ea328044-0ee9-4cdb-b628-fe92eab11d1d tempest-ServersAaction247Test-2057910578 tempest-ServersAaction247Test-2057910578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d469e10d9b40b29edd1f9447e15106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6f22dbd68c42aba2b2d509a31626c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:31:49.698498 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-ea328044-0ee9-4cdb-b628-fe92eab11d1d tempest-ServersAaction247Test-2057910578 tempest-ServersAaction247Test-2057910578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d469e10d9b40b29edd1f9447e15106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6f22dbd68c42aba2b2d509a31626c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:31:49.703356 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-ea328044-0ee9-4cdb-b628-fe92eab11d1d tempest-ServersAaction247Test-2057910578 tempest-ServersAaction247Test-2057910578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d469e10d9b40b29edd1f9447e15106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6f22dbd68c42aba2b2d509a31626c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:31:49.708071 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-ea328044-0ee9-4cdb-b628-fe92eab11d1d tempest-ServersAaction247Test-2057910578 tempest-ServersAaction247Test-2057910578-project] 10.222.0.58 "GET /compute/v2.1/servers/ace16f92-36b0-4559-9f32-d2970c582310" status: 200 len: 1366 microversion: 2.47 time: 0.211490 Aug 10 23:31:49.708851 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2818/5843] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:31:49 2022] GET /compute/v2.1/servers/ace16f92-36b0-4559-9f32-d2970c582310 => generated 1366 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:31:50.740241 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-150dfc0f-a890-45bb-b8eb-53a9344f7603 tempest-ServersAaction247Test-2057910578 tempest-ServersAaction247Test-2057910578-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:31:50.741115 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-150dfc0f-a890-45bb-b8eb-53a9344f7603 tempest-ServersAaction247Test-2057910578 tempest-ServersAaction247Test-2057910578-project] [instance: ace16f92-36b0-4559-9f32-d2970c582310] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:31:50.748687 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-150dfc0f-a890-45bb-b8eb-53a9344f7603 tempest-ServersAaction247Test-2057910578 tempest-ServersAaction247Test-2057910578-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:31:50.754220 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-150dfc0f-a890-45bb-b8eb-53a9344f7603 tempest-ServersAaction247Test-2057910578 tempest-ServersAaction247Test-2057910578-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:31:50.754838 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-150dfc0f-a890-45bb-b8eb-53a9344f7603 tempest-ServersAaction247Test-2057910578 tempest-ServersAaction247Test-2057910578-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:31:50.756586 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-150dfc0f-a890-45bb-b8eb-53a9344f7603 tempest-ServersAaction247Test-2057910578 tempest-ServersAaction247Test-2057910578-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:31:50.759802 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-150dfc0f-a890-45bb-b8eb-53a9344f7603 tempest-ServersAaction247Test-2057910578 tempest-ServersAaction247Test-2057910578-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:31:50.760351 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-150dfc0f-a890-45bb-b8eb-53a9344f7603 tempest-ServersAaction247Test-2057910578 tempest-ServersAaction247Test-2057910578-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:31:50.856733 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-150dfc0f-a890-45bb-b8eb-53a9344f7603 tempest-ServersAaction247Test-2057910578 tempest-ServersAaction247Test-2057910578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d469e10d9b40b29edd1f9447e15106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6f22dbd68c42aba2b2d509a31626c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:31:50.868005 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-150dfc0f-a890-45bb-b8eb-53a9344f7603 tempest-ServersAaction247Test-2057910578 tempest-ServersAaction247Test-2057910578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d469e10d9b40b29edd1f9447e15106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6f22dbd68c42aba2b2d509a31626c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:31:50.869794 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-150dfc0f-a890-45bb-b8eb-53a9344f7603 tempest-ServersAaction247Test-2057910578 tempest-ServersAaction247Test-2057910578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d469e10d9b40b29edd1f9447e15106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6f22dbd68c42aba2b2d509a31626c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:31:50.872068 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-150dfc0f-a890-45bb-b8eb-53a9344f7603 tempest-ServersAaction247Test-2057910578 tempest-ServersAaction247Test-2057910578-project] 10.222.0.58 "GET /compute/v2.1/servers/ace16f92-36b0-4559-9f32-d2970c582310" status: 200 len: 1366 microversion: 2.47 time: 0.137748 Aug 10 23:31:50.873275 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3026/5844] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:31:50 2022] GET /compute/v2.1/servers/ace16f92-36b0-4559-9f32-d2970c582310 => generated 1366 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:31:51.903051 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-e9cc5a8e-9d97-4dab-828d-6827bf9bba2c tempest-ServersAaction247Test-2057910578 tempest-ServersAaction247Test-2057910578-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:31:51.903051 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-e9cc5a8e-9d97-4dab-828d-6827bf9bba2c tempest-ServersAaction247Test-2057910578 tempest-ServersAaction247Test-2057910578-project] [instance: ace16f92-36b0-4559-9f32-d2970c582310] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:31:51.913013 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e9cc5a8e-9d97-4dab-828d-6827bf9bba2c tempest-ServersAaction247Test-2057910578 tempest-ServersAaction247Test-2057910578-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:31:51.914144 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e9cc5a8e-9d97-4dab-828d-6827bf9bba2c tempest-ServersAaction247Test-2057910578 tempest-ServersAaction247Test-2057910578-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:31:51.915614 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e9cc5a8e-9d97-4dab-828d-6827bf9bba2c tempest-ServersAaction247Test-2057910578 tempest-ServersAaction247Test-2057910578-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:31:51.917296 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e9cc5a8e-9d97-4dab-828d-6827bf9bba2c tempest-ServersAaction247Test-2057910578 tempest-ServersAaction247Test-2057910578-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:31:51.918274 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e9cc5a8e-9d97-4dab-828d-6827bf9bba2c tempest-ServersAaction247Test-2057910578 tempest-ServersAaction247Test-2057910578-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:31:51.918909 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e9cc5a8e-9d97-4dab-828d-6827bf9bba2c tempest-ServersAaction247Test-2057910578 tempest-ServersAaction247Test-2057910578-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:31:51.978619 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e9cc5a8e-9d97-4dab-828d-6827bf9bba2c tempest-ServersAaction247Test-2057910578 tempest-ServersAaction247Test-2057910578-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:31:51.979398 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e9cc5a8e-9d97-4dab-828d-6827bf9bba2c tempest-ServersAaction247Test-2057910578 tempest-ServersAaction247Test-2057910578-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:31:51.979846 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e9cc5a8e-9d97-4dab-828d-6827bf9bba2c tempest-ServersAaction247Test-2057910578 tempest-ServersAaction247Test-2057910578-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:31:51.980579 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.objects.instance [None req-e9cc5a8e-9d97-4dab-828d-6827bf9bba2c tempest-ServersAaction247Test-2057910578 tempest-ServersAaction247Test-2057910578-project] Lazy-loading 'fault' on Instance uuid ace16f92-36b0-4559-9f32-d2970c582310 {{(pid=122632) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:31:52.038593 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-e9cc5a8e-9d97-4dab-828d-6827bf9bba2c tempest-ServersAaction247Test-2057910578 tempest-ServersAaction247Test-2057910578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '35d469e10d9b40b29edd1f9447e15106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6f22dbd68c42aba2b2d509a31626c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:31:52.050501 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-e9cc5a8e-9d97-4dab-828d-6827bf9bba2c tempest-ServersAaction247Test-2057910578 tempest-ServersAaction247Test-2057910578-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '35d469e10d9b40b29edd1f9447e15106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6f22dbd68c42aba2b2d509a31626c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:31:52.052615 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-e9cc5a8e-9d97-4dab-828d-6827bf9bba2c tempest-ServersAaction247Test-2057910578 tempest-ServersAaction247Test-2057910578-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '35d469e10d9b40b29edd1f9447e15106', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b6f22dbd68c42aba2b2d509a31626c2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:31:52.054045 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-e9cc5a8e-9d97-4dab-828d-6827bf9bba2c tempest-ServersAaction247Test-2057910578 tempest-ServersAaction247Test-2057910578-project] 10.222.0.58 "GET /compute/v2.1/servers/ace16f92-36b0-4559-9f32-d2970c582310" status: 200 len: 1371 microversion: 2.47 time: 0.157182 Aug 10 23:31:52.054983 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2819/5845] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:31:51 2022] GET /compute/v2.1/servers/ace16f92-36b0-4559-9f32-d2970c582310 => generated 1371 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 10 23:31:53.084670 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-ae184c39-9156-4965-8211-39a10baacc99 tempest-ServersAaction247Test-2057910578 tempest-ServersAaction247Test-2057910578-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:31:53.087299 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-ae184c39-9156-4965-8211-39a10baacc99 tempest-ServersAaction247Test-2057910578 tempest-ServersAaction247Test-2057910578-project] [instance: ace16f92-36b0-4559-9f32-d2970c582310] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:31:53.102038 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ae184c39-9156-4965-8211-39a10baacc99 tempest-ServersAaction247Test-2057910578 tempest-ServersAaction247Test-2057910578-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:31:53.102733 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ae184c39-9156-4965-8211-39a10baacc99 tempest-ServersAaction247Test-2057910578 tempest-ServersAaction247Test-2057910578-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:31:53.103656 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ae184c39-9156-4965-8211-39a10baacc99 tempest-ServersAaction247Test-2057910578 tempest-ServersAaction247Test-2057910578-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:31:53.104590 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ae184c39-9156-4965-8211-39a10baacc99 tempest-ServersAaction247Test-2057910578 tempest-ServersAaction247Test-2057910578-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:31:53.105247 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ae184c39-9156-4965-8211-39a10baacc99 tempest-ServersAaction247Test-2057910578 tempest-ServersAaction247Test-2057910578-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:31:53.105726 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ae184c39-9156-4965-8211-39a10baacc99 tempest-ServersAaction247Test-2057910578 tempest-ServersAaction247Test-2057910578-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:31:53.122878 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-ae184c39-9156-4965-8211-39a10baacc99 tempest-ServersAaction247Test-2057910578 tempest-ServersAaction247Test-2057910578-project] HTTP exception thrown: Instance ace16f92-36b0-4559-9f32-d2970c582310 could not be found. Aug 10 23:31:53.124495 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-ae184c39-9156-4965-8211-39a10baacc99 tempest-ServersAaction247Test-2057910578 tempest-ServersAaction247Test-2057910578-project] Request method failure captured: Aug 10 23:31:53.124495 n-d-850468-14 devstack@n-api.service[122633]: request: GET /compute/v2.1/servers/ace16f92-36b0-4559-9f32-d2970c582310 HTTP/1.1 Aug 10 23:31:53.124495 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:31:53.124495 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:31:53.124495 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:31:53.124495 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:31:53.124495 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:31:53.124495 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:31:53.124495 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:31:53.124495 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:31:53.124495 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9D_fwocIIN6cCZpZYfFKXAbl_gEtExquUEXl9mV0qYBZKkkC_sMa6IRbmpl7Bq8tJ2-WKDzL3tPzQZrBbpMDaPYFpin8tkqrRTQqA0zqOLse6jNQMebttGXqbl5atF98bH2SCgm0fENbahbetq4G79ttA6052gtFi9_2-qR8cgYKFJE Aug 10 23:31:53.124495 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:31:53.124495 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:31:53.124495 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:31:53.124495 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:31:53.124495 n-d-850468-14 devstack@n-api.service[122633]: X-Openstack-Nova-Api-Version: 2.47 Aug 10 23:31:53.124495 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:31:53.124495 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:31:53.124495 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 6b6f22dbd68c42aba2b2d509a31626c2 Aug 10 23:31:53.124495 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-ServersAaction247Test-2057910578 Aug 10 23:31:53.124495 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:31:53.124495 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:31:53.124495 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6b6f22dbd68c42aba2b2d509a31626c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/6b6f22dbd68c42aba2b2d509a31626c2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/6b6f22dbd68c42aba2b2d509a31626c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_6b6f22dbd68c42aba2b2d509a31626c2", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:31:53.124495 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-ServersAaction247Test-2057910578 Aug 10 23:31:53.124495 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 6b6f22dbd68c42aba2b2d509a31626c2 Aug 10 23:31:53.124495 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-ServersAaction247Test-2057910578 Aug 10 23:31:53.124495 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-ServersAaction247Test-2057910578-project Aug 10 23:31:53.124495 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:31:53.124495 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:31:53.124495 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 35d469e10d9b40b29edd1f9447e15106 Aug 10 23:31:53.124495 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-ServersAaction247Test-2057910578-project Aug 10 23:31:53.124495 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:31:53.124495 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance ace16f92-36b0-4559-9f32-d2970c582310 could not be found. Aug 10 23:31:53.124495 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': 'ace16f92-36b0-4559-9f32-d2970c582310'} Aug 10 23:31:53.124495 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:31:53.124495 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:31:53.124495 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:31:53.124495 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:31:53.124495 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:31:53.124495 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:31:53.124495 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:31:53.124495 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:31:53.124495 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:31:53.124495 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:31:53.124495 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ace16f92-36b0-4559-9f32-d2970c582310 could not be found. Aug 10 23:31:53.124495 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:31:53.124495 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:31:53.124495 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:31:53.124495 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:31:53.124495 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:31:53.124495 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:31:53.124495 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:31:53.124495 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:31:53.124495 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:31:53.124495 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:31:53.124495 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:31:53.124495 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:31:53.124495 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:31:53.124495 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:31:53.124495 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:31:53.124495 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:31:53.124495 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ace16f92-36b0-4559-9f32-d2970c582310 could not be found. Aug 10 23:31:53.124495 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:31:53.124495 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:31:53.127800 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:31:53.127800 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:31:53.127800 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:31:53.127800 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:31:53.127800 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:31:53.127800 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:31:53.127800 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ace16f92-36b0-4559-9f32-d2970c582310 could not be found. Aug 10 23:31:53.127800 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:31:53.127800 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-ae184c39-9156-4965-8211-39a10baacc99 tempest-ServersAaction247Test-2057910578 tempest-ServersAaction247Test-2057910578-project] Returning 404 to user: Instance ace16f92-36b0-4559-9f32-d2970c582310 could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:31:53.127800 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-ae184c39-9156-4965-8211-39a10baacc99 tempest-ServersAaction247Test-2057910578 tempest-ServersAaction247Test-2057910578-project] 10.222.0.58 "GET /compute/v2.1/servers/ace16f92-36b0-4559-9f32-d2970c582310" status: 404 len: 111 microversion: 2.47 time: 0.046298 Aug 10 23:31:53.127800 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3027/5846] 10.222.0.58 () {60 vars in 1277 bytes} [Wed Aug 10 23:31:53 2022] GET /compute/v2.1/servers/ace16f92-36b0-4559-9f32-d2970c582310 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 10 23:31:57.387107 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-9aa3dffa-9579-4dc8-b3de-d33bdfdff8e1 tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:31:57.387910 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-9aa3dffa-9579-4dc8-b3de-d33bdfdff8e1 tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] [instance: fb59b3c4-bc94-49b7-81e7-7369b70731ad] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:31:57.398684 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=2 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:31:57.399707 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=6 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:31:57.406942 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9aa3dffa-9579-4dc8-b3de-d33bdfdff8e1 tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:31:57.407791 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9aa3dffa-9579-4dc8-b3de-d33bdfdff8e1 tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:31:57.408580 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9aa3dffa-9579-4dc8-b3de-d33bdfdff8e1 tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:31:57.410086 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9aa3dffa-9579-4dc8-b3de-d33bdfdff8e1 tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:31:57.412514 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9aa3dffa-9579-4dc8-b3de-d33bdfdff8e1 tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:31:57.414322 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9aa3dffa-9579-4dc8-b3de-d33bdfdff8e1 tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:31:57.647749 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.objects.instance [None req-9aa3dffa-9579-4dc8-b3de-d33bdfdff8e1 tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Lazy-loading 'services' on Instance uuid fb59b3c4-bc94-49b7-81e7-7369b70731ad {{(pid=122632) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:31:57.756027 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-9aa3dffa-9579-4dc8-b3de-d33bdfdff8e1 tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] 10.222.0.58 "DELETE /compute/v2.1/servers/fb59b3c4-bc94-49b7-81e7-7369b70731ad/os-volume_attachments/89d9d5ef-eb1b-4232-b56e-9d3707847141" status: 202 len: 0 microversion: 2.1 time: 0.372963 Aug 10 23:31:57.756755 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2820/5847] 10.222.0.58 () {58 vars in 1416 bytes} [Wed Aug 10 23:31:57 2022] DELETE /compute/v2.1/servers/fb59b3c4-bc94-49b7-81e7-7369b70731ad/os-volume_attachments/89d9d5ef-eb1b-4232-b56e-9d3707847141 => generated 0 bytes in 375 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:32:05.182442 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=2 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:32:05.183432 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_api:SELECT=19,nova_api:UPDATE=1 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:32:05.184459 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:32:05.462921 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-a22e1e35-200f-4f94-a7af-13c4330c0674 tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-275766244", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452", "networks": [{"uuid": "1b78fe35-814d-4839-a6a1-9d66e8e73545"}]}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:32:05.564084 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.network.neutron [None req-a22e1e35-200f-4f94-a7af-13c4330c0674 tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] validate_networks() for [('1b78fe35-814d-4839-a6a1-9d66e8e73545', None, None, None, None, None)] {{(pid=122633) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 23:32:06.312157 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-a22e1e35-200f-4f94-a7af-13c4330c0674 tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] Flavor limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:32:06.314127 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-a22e1e35-200f-4f94-a7af-13c4330c0674 tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] Image limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:32:06.314724 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-a22e1e35-200f-4f94-a7af-13c4330c0674 tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] Flavor pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:32:06.315977 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-a22e1e35-200f-4f94-a7af-13c4330c0674 tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] Image pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:32:06.316413 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-a22e1e35-200f-4f94-a7af-13c4330c0674 tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:32:06.332644 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a22e1e35-200f-4f94-a7af-13c4330c0674 tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:32:06.333172 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a22e1e35-200f-4f94-a7af-13c4330c0674 tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:32:06.333628 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a22e1e35-200f-4f94-a7af-13c4330c0674 tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:32:06.334387 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a22e1e35-200f-4f94-a7af-13c4330c0674 tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:32:06.334896 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a22e1e35-200f-4f94-a7af-13c4330c0674 tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:32:06.335497 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a22e1e35-200f-4f94-a7af-13c4330c0674 tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:32:06.360730 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-a22e1e35-200f-4f94-a7af-13c4330c0674 tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] Getting quotas for project 24f65423dfb14015b006daea14474b26. Resources: {'instances', 'cores', 'ram'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:32:06.381456 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-a22e1e35-200f-4f94-a7af-13c4330c0674 tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] Getting quotas for user d2f8631e13cf4b23a1129cb79c670f5a and project 24f65423dfb14015b006daea14474b26. Resources: {'instances', 'cores', 'ram'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:32:06.402430 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-a22e1e35-200f-4f94-a7af-13c4330c0674 tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] Going to run 1 instances... {{(pid=122633) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 23:32:06.405609 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-a22e1e35-200f-4f94-a7af-13c4330c0674 tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] [instance: ce0b780e-cd16-45c1-92e9-bbc78c5a0beb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78ad8905-f66f-4733-8be9-2b260f1fabed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122633) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 23:32:06.471394 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-a22e1e35-200f-4f94-a7af-13c4330c0674 tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.290467 Aug 10 23:32:06.472584 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3028/5848] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 23:32:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 1296 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 23:32:06.485529 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-d78757a5-1852-462e-8690-48661bc447d5 tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:32:06.486239 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-d78757a5-1852-462e-8690-48661bc447d5 tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] [instance: ce0b780e-cd16-45c1-92e9-bbc78c5a0beb] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:32:06.611320 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-d78757a5-1852-462e-8690-48661bc447d5 tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f8631e13cf4b23a1129cb79c670f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24f65423dfb14015b006daea14474b26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:32:06.622679 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-d78757a5-1852-462e-8690-48661bc447d5 tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] 10.222.0.58 "GET /compute/v2.1/servers/ce0b780e-cd16-45c1-92e9-bbc78c5a0beb" status: 200 len: 1216 microversion: 2.1 time: 0.142687 Aug 10 23:32:06.624929 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2821/5849] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:32:06 2022] GET /compute/v2.1/servers/ce0b780e-cd16-45c1-92e9-bbc78c5a0beb => generated 1216 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:32:06.899177 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-5bfc91d9-6753-4161-a45d-40a80895e2b3 tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:32:06.899616 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-5bfc91d9-6753-4161-a45d-40a80895e2b3 tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] [instance: fb59b3c4-bc94-49b7-81e7-7369b70731ad] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:32:06.931947 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5bfc91d9-6753-4161-a45d-40a80895e2b3 tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:32:06.932871 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5bfc91d9-6753-4161-a45d-40a80895e2b3 tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:32:06.933329 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5bfc91d9-6753-4161-a45d-40a80895e2b3 tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:32:06.936722 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5bfc91d9-6753-4161-a45d-40a80895e2b3 tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:32:06.937412 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5bfc91d9-6753-4161-a45d-40a80895e2b3 tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:32:06.941617 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5bfc91d9-6753-4161-a45d-40a80895e2b3 tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:32:07.043179 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-5bfc91d9-6753-4161-a45d-40a80895e2b3 tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] [instance: fb59b3c4-bc94-49b7-81e7-7369b70731ad] Going to try to terminate instance {{(pid=122633) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:32:07.194522 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-5bfc91d9-6753-4161-a45d-40a80895e2b3 tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] 10.222.0.58 "DELETE /compute/v2.1/servers/fb59b3c4-bc94-49b7-81e7-7369b70731ad" status: 204 len: 0 microversion: 2.1 time: 0.302208 Aug 10 23:32:07.198214 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3029/5850] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:32:06 2022] DELETE /compute/v2.1/servers/fb59b3c4-bc94-49b7-81e7-7369b70731ad => generated 0 bytes in 307 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:32:07.207408 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-db81d79f-ee16-4526-8087-2c016b6f93bf tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:32:07.208732 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-db81d79f-ee16-4526-8087-2c016b6f93bf tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] [instance: fb59b3c4-bc94-49b7-81e7-7369b70731ad] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:32:07.219083 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-db81d79f-ee16-4526-8087-2c016b6f93bf tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:32:07.220764 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-db81d79f-ee16-4526-8087-2c016b6f93bf tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:32:07.221552 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-db81d79f-ee16-4526-8087-2c016b6f93bf tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:32:07.222864 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-db81d79f-ee16-4526-8087-2c016b6f93bf tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:32:07.223808 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-db81d79f-ee16-4526-8087-2c016b6f93bf tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:32:07.224649 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-db81d79f-ee16-4526-8087-2c016b6f93bf tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:32:07.516368 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-db81d79f-ee16-4526-8087-2c016b6f93bf tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9719cc999ad49b493186b399fb600a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467e718cca3a4fdea39706b1f0241c3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:32:07.527346 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-db81d79f-ee16-4526-8087-2c016b6f93bf tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] 10.222.0.58 "GET /compute/v2.1/servers/fb59b3c4-bc94-49b7-81e7-7369b70731ad" status: 200 len: 1468 microversion: 2.1 time: 0.324372 Aug 10 23:32:07.527949 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2822/5851] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:32:07 2022] GET /compute/v2.1/servers/fb59b3c4-bc94-49b7-81e7-7369b70731ad => generated 1468 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:32:07.658364 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c05aa685-55bb-4f5b-b668-7dd6d12d5b87 tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:32:07.659896 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-c05aa685-55bb-4f5b-b668-7dd6d12d5b87 tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] [instance: ce0b780e-cd16-45c1-92e9-bbc78c5a0beb] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:32:07.671468 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c05aa685-55bb-4f5b-b668-7dd6d12d5b87 tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:32:07.673191 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c05aa685-55bb-4f5b-b668-7dd6d12d5b87 tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:32:07.675477 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c05aa685-55bb-4f5b-b668-7dd6d12d5b87 tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:32:07.676492 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c05aa685-55bb-4f5b-b668-7dd6d12d5b87 tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:32:07.678294 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c05aa685-55bb-4f5b-b668-7dd6d12d5b87 tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:32:07.679954 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c05aa685-55bb-4f5b-b668-7dd6d12d5b87 tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:32:07.782380 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-c05aa685-55bb-4f5b-b668-7dd6d12d5b87 tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f8631e13cf4b23a1129cb79c670f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24f65423dfb14015b006daea14474b26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:32:07.793321 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-c05aa685-55bb-4f5b-b668-7dd6d12d5b87 tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] 10.222.0.58 "GET /compute/v2.1/servers/ce0b780e-cd16-45c1-92e9-bbc78c5a0beb" status: 200 len: 1268 microversion: 2.1 time: 0.142501 Aug 10 23:32:07.794673 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3030/5852] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:32:07 2022] GET /compute/v2.1/servers/ce0b780e-cd16-45c1-92e9-bbc78c5a0beb => generated 1268 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:32:08.552881 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-5121666c-40d0-4635-bb1f-f3c6af9998da tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:32:08.554074 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-5121666c-40d0-4635-bb1f-f3c6af9998da tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] [instance: fb59b3c4-bc94-49b7-81e7-7369b70731ad] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:32:08.571034 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5121666c-40d0-4635-bb1f-f3c6af9998da tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:32:08.571556 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5121666c-40d0-4635-bb1f-f3c6af9998da tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:32:08.572001 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5121666c-40d0-4635-bb1f-f3c6af9998da tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:32:08.572716 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5121666c-40d0-4635-bb1f-f3c6af9998da tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:32:08.578658 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5121666c-40d0-4635-bb1f-f3c6af9998da tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:32:08.580643 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5121666c-40d0-4635-bb1f-f3c6af9998da tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:32:08.823836 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-6f9dfc78-c93f-45d6-8032-94000c05acba tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:32:08.825239 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-6f9dfc78-c93f-45d6-8032-94000c05acba tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] [instance: ce0b780e-cd16-45c1-92e9-bbc78c5a0beb] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:32:08.837014 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6f9dfc78-c93f-45d6-8032-94000c05acba tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:32:08.837995 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6f9dfc78-c93f-45d6-8032-94000c05acba tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:32:08.838934 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6f9dfc78-c93f-45d6-8032-94000c05acba tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:32:08.840082 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6f9dfc78-c93f-45d6-8032-94000c05acba tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:32:08.840752 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6f9dfc78-c93f-45d6-8032-94000c05acba tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:32:08.841376 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6f9dfc78-c93f-45d6-8032-94000c05acba tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:32:09.018103 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-5121666c-40d0-4635-bb1f-f3c6af9998da tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9719cc999ad49b493186b399fb600a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467e718cca3a4fdea39706b1f0241c3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:32:09.026370 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-6f9dfc78-c93f-45d6-8032-94000c05acba tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f8631e13cf4b23a1129cb79c670f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24f65423dfb14015b006daea14474b26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:32:09.037360 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-5121666c-40d0-4635-bb1f-f3c6af9998da tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] 10.222.0.58 "GET /compute/v2.1/servers/fb59b3c4-bc94-49b7-81e7-7369b70731ad" status: 200 len: 1468 microversion: 2.1 time: 0.489815 Aug 10 23:32:09.039257 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2823/5853] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:32:08 2022] GET /compute/v2.1/servers/fb59b3c4-bc94-49b7-81e7-7369b70731ad => generated 1468 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:32:09.053468 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-6f9dfc78-c93f-45d6-8032-94000c05acba tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] 10.222.0.58 "GET /compute/v2.1/servers/ce0b780e-cd16-45c1-92e9-bbc78c5a0beb" status: 200 len: 1274 microversion: 2.1 time: 0.233685 Aug 10 23:32:09.067820 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3031/5854] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:32:08 2022] GET /compute/v2.1/servers/ce0b780e-cd16-45c1-92e9-bbc78c5a0beb => generated 1274 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:32:10.064369 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-a4dd3d2e-7414-46ae-ad19-d83e6011d5ea tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:32:10.066600 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-a4dd3d2e-7414-46ae-ad19-d83e6011d5ea tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] [instance: fb59b3c4-bc94-49b7-81e7-7369b70731ad] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:32:10.079901 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-a93752fd-acf4-4df5-bef0-f3663014642c tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:32:10.081804 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-a93752fd-acf4-4df5-bef0-f3663014642c tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] [instance: ce0b780e-cd16-45c1-92e9-bbc78c5a0beb] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:32:10.092793 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a93752fd-acf4-4df5-bef0-f3663014642c tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:32:10.094674 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a4dd3d2e-7414-46ae-ad19-d83e6011d5ea tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:32:10.095456 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a4dd3d2e-7414-46ae-ad19-d83e6011d5ea tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:32:10.096134 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a4dd3d2e-7414-46ae-ad19-d83e6011d5ea tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:32:10.098653 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a93752fd-acf4-4df5-bef0-f3663014642c tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:32:10.099361 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a4dd3d2e-7414-46ae-ad19-d83e6011d5ea tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:32:10.099987 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a93752fd-acf4-4df5-bef0-f3663014642c tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:32:10.100662 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a4dd3d2e-7414-46ae-ad19-d83e6011d5ea tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:32:10.101612 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a93752fd-acf4-4df5-bef0-f3663014642c tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:32:10.102260 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a4dd3d2e-7414-46ae-ad19-d83e6011d5ea tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:32:10.103568 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a93752fd-acf4-4df5-bef0-f3663014642c tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:32:10.104539 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a93752fd-acf4-4df5-bef0-f3663014642c tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:32:10.345641 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-a4dd3d2e-7414-46ae-ad19-d83e6011d5ea tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c9719cc999ad49b493186b399fb600a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '467e718cca3a4fdea39706b1f0241c3a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:32:10.361787 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-a4dd3d2e-7414-46ae-ad19-d83e6011d5ea tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] 10.222.0.58 "GET /compute/v2.1/servers/fb59b3c4-bc94-49b7-81e7-7369b70731ad" status: 200 len: 1426 microversion: 2.1 time: 0.302714 Aug 10 23:32:10.382252 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2824/5855] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:32:10 2022] GET /compute/v2.1/servers/fb59b3c4-bc94-49b7-81e7-7369b70731ad => generated 1426 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:32:10.393674 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-b0120f40-9e1a-4b7f-a20e-d4447e53312d req-bf04e120-3184-4456-bb30-5a79f42a18b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb59b3c4-bc94-49b7-81e7-7369b70731ad", "name": "network-vif-deleted", "tag": "95cd155a-7c45-491c-b557-d94fd3702092"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:32:10.439636 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-b0120f40-9e1a-4b7f-a20e-d4447e53312d req-bf04e120-3184-4456-bb30-5a79f42a18b9 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:32:10.441987 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-b0120f40-9e1a-4b7f-a20e-d4447e53312d req-bf04e120-3184-4456-bb30-5a79f42a18b9 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:32:10.442640 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-b0120f40-9e1a-4b7f-a20e-d4447e53312d req-bf04e120-3184-4456-bb30-5a79f42a18b9 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:32:10.483837 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-b0120f40-9e1a-4b7f-a20e-d4447e53312d req-bf04e120-3184-4456-bb30-5a79f42a18b9 service nova] Creating event network-vif-deleted:95cd155a-7c45-491c-b557-d94fd3702092 for instance fb59b3c4-bc94-49b7-81e7-7369b70731ad on n-h2-850468-14 Aug 10 23:32:10.493053 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-b0120f40-9e1a-4b7f-a20e-d4447e53312d req-bf04e120-3184-4456-bb30-5a79f42a18b9 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107873 Aug 10 23:32:10.494570 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2825/5856] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:32:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:32:10.569659 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-a93752fd-acf4-4df5-bef0-f3663014642c tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f8631e13cf4b23a1129cb79c670f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24f65423dfb14015b006daea14474b26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:32:10.587968 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-a93752fd-acf4-4df5-bef0-f3663014642c tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] 10.222.0.58 "GET /compute/v2.1/servers/ce0b780e-cd16-45c1-92e9-bbc78c5a0beb" status: 200 len: 1316 microversion: 2.1 time: 0.512480 Aug 10 23:32:10.604198 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3032/5857] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:32:10 2022] GET /compute/v2.1/servers/ce0b780e-cd16-45c1-92e9-bbc78c5a0beb => generated 1316 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:32:10.844302 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-9abf7aa7-27ee-4520-a1ac-0fc1c338822f req-bbd7c1cb-ce22-4853-9e06-7a6934bcb452 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce0b780e-cd16-45c1-92e9-bbc78c5a0beb", "tag": "8b83f592-2340-4774-bd8d-7865706e1f02"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:32:10.884294 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-9abf7aa7-27ee-4520-a1ac-0fc1c338822f req-bbd7c1cb-ce22-4853-9e06-7a6934bcb452 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:32:10.887395 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-9abf7aa7-27ee-4520-a1ac-0fc1c338822f req-bbd7c1cb-ce22-4853-9e06-7a6934bcb452 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:32:10.887977 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-9abf7aa7-27ee-4520-a1ac-0fc1c338822f req-bbd7c1cb-ce22-4853-9e06-7a6934bcb452 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:32:10.932345 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-9abf7aa7-27ee-4520-a1ac-0fc1c338822f req-bbd7c1cb-ce22-4853-9e06-7a6934bcb452 service nova] Creating event network-changed:8b83f592-2340-4774-bd8d-7865706e1f02 for instance ce0b780e-cd16-45c1-92e9-bbc78c5a0beb on n-h1-850468-14 Aug 10 23:32:10.945123 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-9abf7aa7-27ee-4520-a1ac-0fc1c338822f req-bbd7c1cb-ce22-4853-9e06-7a6934bcb452 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113704 Aug 10 23:32:10.945748 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2826/5858] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:32:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:32:11.390930 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-d69baaf3-26b8-4278-ac7a-2f38165662fd tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:32:11.392277 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-d69baaf3-26b8-4278-ac7a-2f38165662fd tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] [instance: fb59b3c4-bc94-49b7-81e7-7369b70731ad] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:32:11.401838 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d69baaf3-26b8-4278-ac7a-2f38165662fd tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:32:11.402683 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d69baaf3-26b8-4278-ac7a-2f38165662fd tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:32:11.403317 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d69baaf3-26b8-4278-ac7a-2f38165662fd tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:32:11.404453 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d69baaf3-26b8-4278-ac7a-2f38165662fd tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:32:11.405415 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d69baaf3-26b8-4278-ac7a-2f38165662fd tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:32:11.406050 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d69baaf3-26b8-4278-ac7a-2f38165662fd tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:32:11.427222 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-d69baaf3-26b8-4278-ac7a-2f38165662fd tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] HTTP exception thrown: Instance fb59b3c4-bc94-49b7-81e7-7369b70731ad could not be found. Aug 10 23:32:11.429584 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-d69baaf3-26b8-4278-ac7a-2f38165662fd tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Request method failure captured: Aug 10 23:32:11.429584 n-d-850468-14 devstack@n-api.service[122633]: request: GET /compute/v2.1/servers/fb59b3c4-bc94-49b7-81e7-7369b70731ad HTTP/1.1 Aug 10 23:32:11.429584 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:32:11.429584 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:32:11.429584 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:32:11.429584 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:32:11.429584 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:32:11.429584 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:32:11.429584 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:32:11.429584 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:32:11.429584 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9D9zx_r1f8x7AiOLqsKdqqbpA90g6vYWYGQC4UYFiTxmBAv8oZGWlquFYw2yS9p5JkzVIQ-_rEqx8TwVhQYj-JOP5H2BK10IXq00qHgphWT5xxghXtlKZBA_Q4INFVdwPVHlSDaJyRDJToSAbpONhmWs0bGc_6xDOQxpUOAgltV_COk Aug 10 23:32:11.429584 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:32:11.429584 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:32:11.429584 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:32:11.429584 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:32:11.429584 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:32:11.429584 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:32:11.429584 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 467e718cca3a4fdea39706b1f0241c3a Aug 10 23:32:11.429584 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-VolumesBackupsTest-1099942268 Aug 10 23:32:11.429584 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:32:11.429584 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:32:11.429584 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/467e718cca3a4fdea39706b1f0241c3a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/467e718cca3a4fdea39706b1f0241c3a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/467e718cca3a4fdea39706b1f0241c3a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_467e718cca3a4fdea39706b1f0241c3a", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:32:11.429584 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-VolumesBackupsTest-1099942268 Aug 10 23:32:11.429584 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 467e718cca3a4fdea39706b1f0241c3a Aug 10 23:32:11.429584 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-VolumesBackupsTest-1099942268 Aug 10 23:32:11.429584 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-VolumesBackupsTest-1099942268-project Aug 10 23:32:11.429584 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:32:11.429584 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:32:11.429584 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: c9719cc999ad49b493186b399fb600a2 Aug 10 23:32:11.429584 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-VolumesBackupsTest-1099942268-project Aug 10 23:32:11.429584 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:32:11.429584 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance fb59b3c4-bc94-49b7-81e7-7369b70731ad could not be found. Aug 10 23:32:11.429584 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': 'fb59b3c4-bc94-49b7-81e7-7369b70731ad'} Aug 10 23:32:11.429584 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:32:11.429584 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:32:11.429584 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:32:11.429584 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:32:11.429584 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:32:11.429584 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:32:11.429584 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:32:11.429584 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:32:11.429584 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:32:11.429584 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:32:11.429584 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb59b3c4-bc94-49b7-81e7-7369b70731ad could not be found. Aug 10 23:32:11.429584 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:32:11.429584 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:32:11.429584 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:32:11.429584 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:32:11.429584 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:32:11.429584 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:32:11.429584 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:32:11.429584 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:32:11.429584 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:32:11.429584 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:32:11.429584 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:32:11.429584 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:32:11.429584 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:32:11.429584 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:32:11.429584 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:32:11.429584 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:32:11.429584 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb59b3c4-bc94-49b7-81e7-7369b70731ad could not be found. Aug 10 23:32:11.429584 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:32:11.429584 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:32:11.429584 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:32:11.434420 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:32:11.434420 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:32:11.434420 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:32:11.434420 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:32:11.434420 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:32:11.434420 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb59b3c4-bc94-49b7-81e7-7369b70731ad could not be found. Aug 10 23:32:11.434420 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:32:11.438068 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-d69baaf3-26b8-4278-ac7a-2f38165662fd tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] Returning 404 to user: Instance fb59b3c4-bc94-49b7-81e7-7369b70731ad could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:32:11.439252 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-d69baaf3-26b8-4278-ac7a-2f38165662fd tempest-VolumesBackupsTest-1099942268 tempest-VolumesBackupsTest-1099942268-project] 10.222.0.58 "GET /compute/v2.1/servers/fb59b3c4-bc94-49b7-81e7-7369b70731ad" status: 404 len: 111 microversion: 2.1 time: 0.054394 Aug 10 23:32:11.441608 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3033/5859] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:32:11 2022] GET /compute/v2.1/servers/fb59b3c4-bc94-49b7-81e7-7369b70731ad => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:32:11.613754 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-11a94bde-c9d7-4b03-9fa5-82669993bad2 tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:32:11.614750 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-11a94bde-c9d7-4b03-9fa5-82669993bad2 tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] [instance: ce0b780e-cd16-45c1-92e9-bbc78c5a0beb] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:32:11.636588 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-11a94bde-c9d7-4b03-9fa5-82669993bad2 tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:32:11.637775 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-11a94bde-c9d7-4b03-9fa5-82669993bad2 tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:32:11.638294 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-11a94bde-c9d7-4b03-9fa5-82669993bad2 tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:32:11.639165 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-11a94bde-c9d7-4b03-9fa5-82669993bad2 tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:32:11.639866 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-11a94bde-c9d7-4b03-9fa5-82669993bad2 tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:32:11.640476 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-11a94bde-c9d7-4b03-9fa5-82669993bad2 tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:32:11.822320 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-11a94bde-c9d7-4b03-9fa5-82669993bad2 tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f8631e13cf4b23a1129cb79c670f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24f65423dfb14015b006daea14474b26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:32:11.833438 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-11a94bde-c9d7-4b03-9fa5-82669993bad2 tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] 10.222.0.58 "GET /compute/v2.1/servers/ce0b780e-cd16-45c1-92e9-bbc78c5a0beb" status: 200 len: 1316 microversion: 2.1 time: 0.224549 Aug 10 23:32:11.834044 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2827/5860] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:32:11 2022] GET /compute/v2.1/servers/ce0b780e-cd16-45c1-92e9-bbc78c5a0beb => generated 1316 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:32:12.856871 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-29392bd3-23f8-4f1d-85d1-49edad69a4fa tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:32:12.858501 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-29392bd3-23f8-4f1d-85d1-49edad69a4fa tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] [instance: ce0b780e-cd16-45c1-92e9-bbc78c5a0beb] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:32:12.867364 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-29392bd3-23f8-4f1d-85d1-49edad69a4fa tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:32:12.868480 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-29392bd3-23f8-4f1d-85d1-49edad69a4fa tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:32:12.869147 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-29392bd3-23f8-4f1d-85d1-49edad69a4fa tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:32:12.870095 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-29392bd3-23f8-4f1d-85d1-49edad69a4fa tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:32:12.871195 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-29392bd3-23f8-4f1d-85d1-49edad69a4fa tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:32:12.871906 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-29392bd3-23f8-4f1d-85d1-49edad69a4fa tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:32:13.047199 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-29392bd3-23f8-4f1d-85d1-49edad69a4fa tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f8631e13cf4b23a1129cb79c670f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24f65423dfb14015b006daea14474b26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:32:13.059206 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-29392bd3-23f8-4f1d-85d1-49edad69a4fa tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] 10.222.0.58 "GET /compute/v2.1/servers/ce0b780e-cd16-45c1-92e9-bbc78c5a0beb" status: 200 len: 1316 microversion: 2.1 time: 0.208393 Aug 10 23:32:13.060486 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3034/5861] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:32:12 2022] GET /compute/v2.1/servers/ce0b780e-cd16-45c1-92e9-bbc78c5a0beb => generated 1316 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:32:14.080181 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-73000286-b984-4a95-9aaf-2ebd10f84b07 tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:32:14.080830 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-73000286-b984-4a95-9aaf-2ebd10f84b07 tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] [instance: ce0b780e-cd16-45c1-92e9-bbc78c5a0beb] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:32:14.093055 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:32:14.098125 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-73000286-b984-4a95-9aaf-2ebd10f84b07 tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:32:14.102514 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-73000286-b984-4a95-9aaf-2ebd10f84b07 tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:32:14.109718 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-73000286-b984-4a95-9aaf-2ebd10f84b07 tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:32:14.110714 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-73000286-b984-4a95-9aaf-2ebd10f84b07 tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:32:14.111375 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-73000286-b984-4a95-9aaf-2ebd10f84b07 tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:32:14.112002 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-73000286-b984-4a95-9aaf-2ebd10f84b07 tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:32:14.121751 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:32:14.330522 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-73000286-b984-4a95-9aaf-2ebd10f84b07 tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f8631e13cf4b23a1129cb79c670f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24f65423dfb14015b006daea14474b26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:32:14.342694 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-73000286-b984-4a95-9aaf-2ebd10f84b07 tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] 10.222.0.58 "GET /compute/v2.1/servers/ce0b780e-cd16-45c1-92e9-bbc78c5a0beb" status: 200 len: 1316 microversion: 2.1 time: 0.266378 Aug 10 23:32:14.343484 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2828/5862] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:32:14 2022] GET /compute/v2.1/servers/ce0b780e-cd16-45c1-92e9-bbc78c5a0beb => generated 1316 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:32:15.367255 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-30e9b9bc-514b-44fa-9dba-55c3260817ea tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:32:15.367945 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-30e9b9bc-514b-44fa-9dba-55c3260817ea tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] [instance: ce0b780e-cd16-45c1-92e9-bbc78c5a0beb] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:32:15.389049 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-30e9b9bc-514b-44fa-9dba-55c3260817ea tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:32:15.390496 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-30e9b9bc-514b-44fa-9dba-55c3260817ea tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:32:15.391196 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-30e9b9bc-514b-44fa-9dba-55c3260817ea tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:32:15.392515 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-30e9b9bc-514b-44fa-9dba-55c3260817ea tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:32:15.394161 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-30e9b9bc-514b-44fa-9dba-55c3260817ea tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:32:15.395775 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-30e9b9bc-514b-44fa-9dba-55c3260817ea tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:32:15.685150 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-30e9b9bc-514b-44fa-9dba-55c3260817ea tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f8631e13cf4b23a1129cb79c670f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24f65423dfb14015b006daea14474b26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:32:15.697690 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-30e9b9bc-514b-44fa-9dba-55c3260817ea tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] 10.222.0.58 "GET /compute/v2.1/servers/ce0b780e-cd16-45c1-92e9-bbc78c5a0beb" status: 200 len: 1316 microversion: 2.1 time: 0.337819 Aug 10 23:32:15.699124 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3035/5863] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:32:15 2022] GET /compute/v2.1/servers/ce0b780e-cd16-45c1-92e9-bbc78c5a0beb => generated 1316 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:32:16.617766 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=2 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:32:16.634625 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-79f62ee7-7f24-4db1-903a-1ee549cc2185 req-89fd0c9e-dac8-408c-981b-135f7f99c67f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce0b780e-cd16-45c1-92e9-bbc78c5a0beb", "name": "network-vif-plugged", "status": "completed", "tag": "8b83f592-2340-4774-bd8d-7865706e1f02"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:32:16.678399 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-79f62ee7-7f24-4db1-903a-1ee549cc2185 req-89fd0c9e-dac8-408c-981b-135f7f99c67f service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:32:16.679247 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-79f62ee7-7f24-4db1-903a-1ee549cc2185 req-89fd0c9e-dac8-408c-981b-135f7f99c67f service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:32:16.683158 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-79f62ee7-7f24-4db1-903a-1ee549cc2185 req-89fd0c9e-dac8-408c-981b-135f7f99c67f service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:32:16.721107 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-90505caf-fa35-40dc-94cb-80d0e8b4a2d5 tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:32:16.721729 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-90505caf-fa35-40dc-94cb-80d0e8b4a2d5 tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] [instance: ce0b780e-cd16-45c1-92e9-bbc78c5a0beb] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:32:16.727880 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=2 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:32:16.731419 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-79f62ee7-7f24-4db1-903a-1ee549cc2185 req-89fd0c9e-dac8-408c-981b-135f7f99c67f service nova] Creating event network-vif-plugged:8b83f592-2340-4774-bd8d-7865706e1f02 for instance ce0b780e-cd16-45c1-92e9-bbc78c5a0beb on n-h1-850468-14 Aug 10 23:32:16.734576 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=6 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:32:16.744256 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-79f62ee7-7f24-4db1-903a-1ee549cc2185 req-89fd0c9e-dac8-408c-981b-135f7f99c67f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.376927 Aug 10 23:32:16.745613 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2829/5864] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:32:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 23:32:16.746396 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-90505caf-fa35-40dc-94cb-80d0e8b4a2d5 tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:32:16.747478 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-90505caf-fa35-40dc-94cb-80d0e8b4a2d5 tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:32:16.748340 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-90505caf-fa35-40dc-94cb-80d0e8b4a2d5 tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:32:16.749201 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-90505caf-fa35-40dc-94cb-80d0e8b4a2d5 tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:32:16.749844 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-90505caf-fa35-40dc-94cb-80d0e8b4a2d5 tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:32:16.750414 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-90505caf-fa35-40dc-94cb-80d0e8b4a2d5 tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:32:16.968181 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-90505caf-fa35-40dc-94cb-80d0e8b4a2d5 tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f8631e13cf4b23a1129cb79c670f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24f65423dfb14015b006daea14474b26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:32:16.983607 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-90505caf-fa35-40dc-94cb-80d0e8b4a2d5 tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] 10.222.0.58 "GET /compute/v2.1/servers/ce0b780e-cd16-45c1-92e9-bbc78c5a0beb" status: 200 len: 1316 microversion: 2.1 time: 0.266680 Aug 10 23:32:16.985711 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3036/5865] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:32:16 2022] GET /compute/v2.1/servers/ce0b780e-cd16-45c1-92e9-bbc78c5a0beb => generated 1316 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:32:18.008492 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-b6aa048a-7990-4442-95fd-843e6b49eb72 tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:32:18.009817 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-b6aa048a-7990-4442-95fd-843e6b49eb72 tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] [instance: ce0b780e-cd16-45c1-92e9-bbc78c5a0beb] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:32:18.023958 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b6aa048a-7990-4442-95fd-843e6b49eb72 tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:32:18.031313 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b6aa048a-7990-4442-95fd-843e6b49eb72 tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:32:18.031947 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b6aa048a-7990-4442-95fd-843e6b49eb72 tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:32:18.032824 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b6aa048a-7990-4442-95fd-843e6b49eb72 tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:32:18.033415 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b6aa048a-7990-4442-95fd-843e6b49eb72 tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:32:18.033998 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b6aa048a-7990-4442-95fd-843e6b49eb72 tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:32:18.322329 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-b6aa048a-7990-4442-95fd-843e6b49eb72 tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f8631e13cf4b23a1129cb79c670f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24f65423dfb14015b006daea14474b26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:32:18.330187 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-b6aa048a-7990-4442-95fd-843e6b49eb72 tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] 10.222.0.58 "GET /compute/v2.1/servers/ce0b780e-cd16-45c1-92e9-bbc78c5a0beb" status: 200 len: 1316 microversion: 2.1 time: 0.327899 Aug 10 23:32:18.330778 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2830/5866] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:32:18 2022] GET /compute/v2.1/servers/ce0b780e-cd16-45c1-92e9-bbc78c5a0beb => generated 1316 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:32:19.353775 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c8f85fc5-3434-4a87-806a-efc501078623 tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:32:19.354565 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-c8f85fc5-3434-4a87-806a-efc501078623 tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] [instance: ce0b780e-cd16-45c1-92e9-bbc78c5a0beb] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:32:19.361985 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c8f85fc5-3434-4a87-806a-efc501078623 tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:32:19.362620 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c8f85fc5-3434-4a87-806a-efc501078623 tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:32:19.364191 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c8f85fc5-3434-4a87-806a-efc501078623 tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:32:19.365502 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c8f85fc5-3434-4a87-806a-efc501078623 tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:32:19.366337 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c8f85fc5-3434-4a87-806a-efc501078623 tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:32:19.366929 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c8f85fc5-3434-4a87-806a-efc501078623 tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:32:19.518874 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-c8f85fc5-3434-4a87-806a-efc501078623 tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f8631e13cf4b23a1129cb79c670f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24f65423dfb14015b006daea14474b26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:32:19.531913 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-c8f85fc5-3434-4a87-806a-efc501078623 tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] 10.222.0.58 "GET /compute/v2.1/servers/ce0b780e-cd16-45c1-92e9-bbc78c5a0beb" status: 200 len: 1505 microversion: 2.1 time: 0.183096 Aug 10 23:32:19.532869 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3037/5867] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:32:19 2022] GET /compute/v2.1/servers/ce0b780e-cd16-45c1-92e9-bbc78c5a0beb => generated 1505 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:32:19.555160 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-4c249fc2-7631-4cd5-8873-b392630281b2 tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:32:19.555702 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-4c249fc2-7631-4cd5-8873-b392630281b2 tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] [instance: ce0b780e-cd16-45c1-92e9-bbc78c5a0beb] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:32:19.563473 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4c249fc2-7631-4cd5-8873-b392630281b2 tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:32:19.564610 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4c249fc2-7631-4cd5-8873-b392630281b2 tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:32:19.565134 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4c249fc2-7631-4cd5-8873-b392630281b2 tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:32:19.565946 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4c249fc2-7631-4cd5-8873-b392630281b2 tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:32:19.567217 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4c249fc2-7631-4cd5-8873-b392630281b2 tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:32:19.567936 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4c249fc2-7631-4cd5-8873-b392630281b2 tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:32:19.594706 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-4c249fc2-7631-4cd5-8873-b392630281b2 tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] 10.222.0.58 "GET /compute/v2.1/servers/ce0b780e-cd16-45c1-92e9-bbc78c5a0beb/ips" status: 200 len: 109 microversion: 2.1 time: 0.045494 Aug 10 23:32:19.595424 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2831/5868] 10.222.0.58 () {58 vars in 1248 bytes} [Wed Aug 10 23:32:19 2022] GET /compute/v2.1/servers/ce0b780e-cd16-45c1-92e9-bbc78c5a0beb/ips => generated 109 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:32:19.607898 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-96e68f9e-4131-4b3f-9e22-b8f3ddb7fe85 tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:32:19.608430 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-96e68f9e-4131-4b3f-9e22-b8f3ddb7fe85 tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] [instance: ce0b780e-cd16-45c1-92e9-bbc78c5a0beb] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:32:19.615571 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-96e68f9e-4131-4b3f-9e22-b8f3ddb7fe85 tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:32:19.616316 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-96e68f9e-4131-4b3f-9e22-b8f3ddb7fe85 tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:32:19.616903 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-96e68f9e-4131-4b3f-9e22-b8f3ddb7fe85 tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:32:19.617793 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-96e68f9e-4131-4b3f-9e22-b8f3ddb7fe85 tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:32:19.618253 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-96e68f9e-4131-4b3f-9e22-b8f3ddb7fe85 tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:32:19.618684 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-96e68f9e-4131-4b3f-9e22-b8f3ddb7fe85 tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:32:19.645519 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-96e68f9e-4131-4b3f-9e22-b8f3ddb7fe85 tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] 10.222.0.58 "GET /compute/v2.1/servers/ce0b780e-cd16-45c1-92e9-bbc78c5a0beb/ips" status: 200 len: 109 microversion: 2.1 time: 0.041389 Aug 10 23:32:19.646413 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3038/5869] 10.222.0.58 () {58 vars in 1248 bytes} [Wed Aug 10 23:32:19 2022] GET /compute/v2.1/servers/ce0b780e-cd16-45c1-92e9-bbc78c5a0beb/ips => generated 109 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 23:32:19.658698 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-5c30fd7b-0ff9-4450-b8c2-62b9a856692c tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:32:19.659228 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-5c30fd7b-0ff9-4450-b8c2-62b9a856692c tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] [instance: ce0b780e-cd16-45c1-92e9-bbc78c5a0beb] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:32:19.667727 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5c30fd7b-0ff9-4450-b8c2-62b9a856692c tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:32:19.668223 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5c30fd7b-0ff9-4450-b8c2-62b9a856692c tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:32:19.668666 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5c30fd7b-0ff9-4450-b8c2-62b9a856692c tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:32:19.669378 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5c30fd7b-0ff9-4450-b8c2-62b9a856692c tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:32:19.670096 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5c30fd7b-0ff9-4450-b8c2-62b9a856692c tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:32:19.670536 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5c30fd7b-0ff9-4450-b8c2-62b9a856692c tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:32:19.702277 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-5c30fd7b-0ff9-4450-b8c2-62b9a856692c tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] 10.222.0.58 "GET /compute/v2.1/servers/ce0b780e-cd16-45c1-92e9-bbc78c5a0beb/ips/tempest-ServerAddressesTestJSON-1202091797-network" status: 200 len: 94 microversion: 2.1 time: 0.047920 Aug 10 23:32:19.708120 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2832/5870] 10.222.0.58 () {58 vars in 1401 bytes} [Wed Aug 10 23:32:19 2022] GET /compute/v2.1/servers/ce0b780e-cd16-45c1-92e9-bbc78c5a0beb/ips/tempest-ServerAddressesTestJSON-1202091797-network => generated 94 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 10 23:32:19.715335 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-a0b89b79-3c18-4d3b-bb1a-3938bb2628b6 tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:32:19.716282 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-a0b89b79-3c18-4d3b-bb1a-3938bb2628b6 tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] [instance: ce0b780e-cd16-45c1-92e9-bbc78c5a0beb] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:32:19.724644 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a0b89b79-3c18-4d3b-bb1a-3938bb2628b6 tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:32:19.725350 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a0b89b79-3c18-4d3b-bb1a-3938bb2628b6 tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:32:19.725790 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a0b89b79-3c18-4d3b-bb1a-3938bb2628b6 tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:32:19.726658 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a0b89b79-3c18-4d3b-bb1a-3938bb2628b6 tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:32:19.727281 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a0b89b79-3c18-4d3b-bb1a-3938bb2628b6 tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:32:19.728151 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a0b89b79-3c18-4d3b-bb1a-3938bb2628b6 tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:32:19.759542 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-a0b89b79-3c18-4d3b-bb1a-3938bb2628b6 tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] [instance: ce0b780e-cd16-45c1-92e9-bbc78c5a0beb] Going to try to terminate instance {{(pid=122633) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:32:19.864016 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-a0b89b79-3c18-4d3b-bb1a-3938bb2628b6 tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] 10.222.0.58 "DELETE /compute/v2.1/servers/ce0b780e-cd16-45c1-92e9-bbc78c5a0beb" status: 204 len: 0 microversion: 2.1 time: 0.151608 Aug 10 23:32:19.864779 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3039/5871] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:32:19 2022] DELETE /compute/v2.1/servers/ce0b780e-cd16-45c1-92e9-bbc78c5a0beb => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:32:19.875136 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-377a905d-3837-4453-a934-a9d918854e3c tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:32:19.876066 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-377a905d-3837-4453-a934-a9d918854e3c tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] [instance: ce0b780e-cd16-45c1-92e9-bbc78c5a0beb] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:32:19.914420 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-377a905d-3837-4453-a934-a9d918854e3c tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:32:19.920851 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-377a905d-3837-4453-a934-a9d918854e3c tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:32:19.921416 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-377a905d-3837-4453-a934-a9d918854e3c tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:32:19.922196 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-377a905d-3837-4453-a934-a9d918854e3c tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:32:19.922702 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-377a905d-3837-4453-a934-a9d918854e3c tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:32:19.923152 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-377a905d-3837-4453-a934-a9d918854e3c tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:32:20.125522 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-377a905d-3837-4453-a934-a9d918854e3c tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f8631e13cf4b23a1129cb79c670f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24f65423dfb14015b006daea14474b26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:32:20.135578 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-377a905d-3837-4453-a934-a9d918854e3c tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] 10.222.0.58 "GET /compute/v2.1/servers/ce0b780e-cd16-45c1-92e9-bbc78c5a0beb" status: 200 len: 1511 microversion: 2.1 time: 0.264772 Aug 10 23:32:20.149960 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2833/5872] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:32:19 2022] GET /compute/v2.1/servers/ce0b780e-cd16-45c1-92e9-bbc78c5a0beb => generated 1511 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:32:21.162477 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-63e8b2f1-99d6-4180-8cf7-e39b3f67e893 tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:32:21.164058 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-63e8b2f1-99d6-4180-8cf7-e39b3f67e893 tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] [instance: ce0b780e-cd16-45c1-92e9-bbc78c5a0beb] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:32:21.177019 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-63e8b2f1-99d6-4180-8cf7-e39b3f67e893 tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:32:21.177714 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-63e8b2f1-99d6-4180-8cf7-e39b3f67e893 tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:32:21.178768 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-63e8b2f1-99d6-4180-8cf7-e39b3f67e893 tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:32:21.179536 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-63e8b2f1-99d6-4180-8cf7-e39b3f67e893 tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:32:21.180150 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-63e8b2f1-99d6-4180-8cf7-e39b3f67e893 tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:32:21.180759 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-63e8b2f1-99d6-4180-8cf7-e39b3f67e893 tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:32:21.398223 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-63e8b2f1-99d6-4180-8cf7-e39b3f67e893 tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2f8631e13cf4b23a1129cb79c670f5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '24f65423dfb14015b006daea14474b26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:32:21.407236 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-63e8b2f1-99d6-4180-8cf7-e39b3f67e893 tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] 10.222.0.58 "GET /compute/v2.1/servers/ce0b780e-cd16-45c1-92e9-bbc78c5a0beb" status: 200 len: 1511 microversion: 2.1 time: 0.253081 Aug 10 23:32:21.408305 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3040/5873] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:32:21 2022] GET /compute/v2.1/servers/ce0b780e-cd16-45c1-92e9-bbc78c5a0beb => generated 1511 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:32:21.805473 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-c6a53b99-ecb8-4fba-96c4-f73e8a37e388 req-2c63717f-4650-4597-9673-418bcf4ad938 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce0b780e-cd16-45c1-92e9-bbc78c5a0beb", "name": "network-vif-deleted", "tag": "8b83f592-2340-4774-bd8d-7865706e1f02"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:32:21.841282 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-c6a53b99-ecb8-4fba-96c4-f73e8a37e388 req-2c63717f-4650-4597-9673-418bcf4ad938 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:32:21.848828 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-c6a53b99-ecb8-4fba-96c4-f73e8a37e388 req-2c63717f-4650-4597-9673-418bcf4ad938 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:32:21.849579 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-c6a53b99-ecb8-4fba-96c4-f73e8a37e388 req-2c63717f-4650-4597-9673-418bcf4ad938 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:32:21.894206 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-c6a53b99-ecb8-4fba-96c4-f73e8a37e388 req-2c63717f-4650-4597-9673-418bcf4ad938 service nova] Creating event network-vif-deleted:8b83f592-2340-4774-bd8d-7865706e1f02 for instance ce0b780e-cd16-45c1-92e9-bbc78c5a0beb on n-h1-850468-14 Aug 10 23:32:21.908567 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-c6a53b99-ecb8-4fba-96c4-f73e8a37e388 req-2c63717f-4650-4597-9673-418bcf4ad938 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108501 Aug 10 23:32:21.913659 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2834/5874] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:32:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:32:22.432722 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-a832cb3e-0443-4974-a411-595416e61b70 tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:32:22.434599 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-a832cb3e-0443-4974-a411-595416e61b70 tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] [instance: ce0b780e-cd16-45c1-92e9-bbc78c5a0beb] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:32:22.451788 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a832cb3e-0443-4974-a411-595416e61b70 tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:32:22.452461 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a832cb3e-0443-4974-a411-595416e61b70 tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:32:22.453077 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a832cb3e-0443-4974-a411-595416e61b70 tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:32:22.454082 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a832cb3e-0443-4974-a411-595416e61b70 tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:32:22.454722 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a832cb3e-0443-4974-a411-595416e61b70 tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:32:22.455205 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a832cb3e-0443-4974-a411-595416e61b70 tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:32:22.474053 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-a832cb3e-0443-4974-a411-595416e61b70 tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] HTTP exception thrown: Instance ce0b780e-cd16-45c1-92e9-bbc78c5a0beb could not be found. Aug 10 23:32:22.476736 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-a832cb3e-0443-4974-a411-595416e61b70 tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] Request method failure captured: Aug 10 23:32:22.476736 n-d-850468-14 devstack@n-api.service[122633]: request: GET /compute/v2.1/servers/ce0b780e-cd16-45c1-92e9-bbc78c5a0beb HTTP/1.1 Aug 10 23:32:22.476736 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:32:22.476736 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:32:22.476736 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:32:22.476736 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:32:22.476736 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:32:22.476736 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:32:22.476736 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:32:22.476736 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:32:22.476736 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9D_00EY5x4s8YI2Vmbzd9839tTKH4DfLWvve0kXoOl3t2VS46OAP6XpvBI9gaeABqLwV8erQvRjJPb1TUK3sMHqc5ra3dHsP4-TagtIdsui8RnoJOcZ2us39xU5y3803Iixanmt5ydUp8wsHSy-1mNYBMwezLgESa7jhi_-S8BuUExc Aug 10 23:32:22.476736 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:32:22.476736 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:32:22.476736 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:32:22.476736 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:32:22.476736 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:32:22.476736 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:32:22.476736 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 24f65423dfb14015b006daea14474b26 Aug 10 23:32:22.476736 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-ServerAddressesTestJSON-2016903890 Aug 10 23:32:22.476736 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:32:22.476736 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:32:22.476736 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/24f65423dfb14015b006daea14474b26"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/24f65423dfb14015b006daea14474b26"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/24f65423dfb14015b006daea14474b26"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_24f65423dfb14015b006daea14474b26", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:32:22.476736 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-ServerAddressesTestJSON-2016903890 Aug 10 23:32:22.476736 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 24f65423dfb14015b006daea14474b26 Aug 10 23:32:22.476736 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-ServerAddressesTestJSON-2016903890 Aug 10 23:32:22.476736 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-ServerAddressesTestJSON-2016903890-project Aug 10 23:32:22.476736 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:32:22.476736 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:32:22.476736 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: d2f8631e13cf4b23a1129cb79c670f5a Aug 10 23:32:22.476736 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-ServerAddressesTestJSON-2016903890-project Aug 10 23:32:22.476736 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:32:22.476736 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance ce0b780e-cd16-45c1-92e9-bbc78c5a0beb could not be found. Aug 10 23:32:22.476736 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': 'ce0b780e-cd16-45c1-92e9-bbc78c5a0beb'} Aug 10 23:32:22.476736 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:32:22.476736 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:32:22.476736 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:32:22.476736 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:32:22.476736 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:32:22.476736 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:32:22.476736 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:32:22.476736 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:32:22.476736 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:32:22.476736 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:32:22.476736 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce0b780e-cd16-45c1-92e9-bbc78c5a0beb could not be found. Aug 10 23:32:22.476736 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:32:22.476736 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:32:22.476736 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:32:22.476736 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:32:22.476736 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:32:22.476736 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:32:22.476736 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:32:22.476736 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:32:22.476736 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:32:22.476736 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:32:22.476736 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:32:22.476736 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:32:22.476736 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:32:22.476736 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:32:22.476736 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:32:22.476736 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:32:22.476736 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce0b780e-cd16-45c1-92e9-bbc78c5a0beb could not be found. Aug 10 23:32:22.476736 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:32:22.476736 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:32:22.476736 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:32:22.480690 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:32:22.480690 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:32:22.480690 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:32:22.480690 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:32:22.480690 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:32:22.480690 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce0b780e-cd16-45c1-92e9-bbc78c5a0beb could not be found. Aug 10 23:32:22.480690 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:32:22.482115 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-a832cb3e-0443-4974-a411-595416e61b70 tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] Returning 404 to user: Instance ce0b780e-cd16-45c1-92e9-bbc78c5a0beb could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:32:22.483046 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-a832cb3e-0443-4974-a411-595416e61b70 tempest-ServerAddressesTestJSON-2016903890 tempest-ServerAddressesTestJSON-2016903890-project] 10.222.0.58 "GET /compute/v2.1/servers/ce0b780e-cd16-45c1-92e9-bbc78c5a0beb" status: 404 len: 111 microversion: 2.1 time: 0.054991 Aug 10 23:32:22.483925 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3041/5875] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:32:22 2022] GET /compute/v2.1/servers/ce0b780e-cd16-45c1-92e9-bbc78c5a0beb => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:32:37.548022 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_api:SELECT=13 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:32:37.549261 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=29 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:32:37.809643 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-e5a6dca6-f162-44c5-95b7-a0fc2c8d63f2 tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Action: 'create', calling method: .version_select at 0x7f847d643310>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-1395003317", "policies": ["affinity"]}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:32:37.831003 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-e5a6dca6-f162-44c5-95b7-a0fc2c8d63f2 tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Getting quotas for project 2aa5f961963f4833b8fc593b200e7f58. Resources: {'server_groups'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:32:37.839026 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-e5a6dca6-f162-44c5-95b7-a0fc2c8d63f2 tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Getting quotas for user 0f947f2c1c9d45fcacfde1d382fc3b58 and project 2aa5f961963f4833b8fc593b200e7f58. Resources: {'server_groups'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:32:37.935606 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-e5a6dca6-f162-44c5-95b7-a0fc2c8d63f2 tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Getting quotas for project 2aa5f961963f4833b8fc593b200e7f58. Resources: {'server_groups'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:32:37.948356 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-e5a6dca6-f162-44c5-95b7-a0fc2c8d63f2 tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Getting quotas for user 0f947f2c1c9d45fcacfde1d382fc3b58 and project 2aa5f961963f4833b8fc593b200e7f58. Resources: {'server_groups'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:32:37.982262 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-e5a6dca6-f162-44c5-95b7-a0fc2c8d63f2 tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] 10.222.0.58 "POST /compute/v2.1/os-server-groups" status: 200 len: 184 microversion: 2.1 time: 0.448645 Aug 10 23:32:37.983496 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2835/5876] 10.222.0.58 () {60 vars in 1174 bytes} [Wed Aug 10 23:32:37 2022] POST /compute/v2.1/os-server-groups => generated 184 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:32:37.992039 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:32:37.993528 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:32:37.997319 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-b70653b9-1f00-4f71-ad49-5eab79f55c87 tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Action: 'create', calling method: .version_select at 0x7f847c4b8040>, body: {"server_group": {"name": "tempest-server-group-957796759", "policies": ["affinity"]}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:32:38.054429 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-b70653b9-1f00-4f71-ad49-5eab79f55c87 tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Getting quotas for project 2aa5f961963f4833b8fc593b200e7f58. Resources: {'server_groups'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:32:38.060548 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-b70653b9-1f00-4f71-ad49-5eab79f55c87 tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Getting quotas for user 0f947f2c1c9d45fcacfde1d382fc3b58 and project 2aa5f961963f4833b8fc593b200e7f58. Resources: {'server_groups'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:32:38.172736 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-b70653b9-1f00-4f71-ad49-5eab79f55c87 tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Getting quotas for project 2aa5f961963f4833b8fc593b200e7f58. Resources: {'server_groups'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:32:38.210994 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-b70653b9-1f00-4f71-ad49-5eab79f55c87 tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Getting quotas for user 0f947f2c1c9d45fcacfde1d382fc3b58 and project 2aa5f961963f4833b8fc593b200e7f58. Resources: {'server_groups'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:32:38.244397 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-b70653b9-1f00-4f71-ad49-5eab79f55c87 tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] 10.222.0.58 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.254527 Aug 10 23:32:38.250897 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3042/5877] 10.222.0.58 () {60 vars in 1173 bytes} [Wed Aug 10 23:32:37 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:32:38.258731 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-40beb066-c58b-43fe-9339-811098aeceef tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Action: 'create', calling method: .version_select at 0x7f846fb6e9d0>, body: {"server_group": {"name": "tempest-server-group-957796759", "policies": ["affinity"]}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:32:38.286174 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-40beb066-c58b-43fe-9339-811098aeceef tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Getting quotas for project 2aa5f961963f4833b8fc593b200e7f58. Resources: {'server_groups'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:32:38.306952 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-40beb066-c58b-43fe-9339-811098aeceef tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Getting quotas for user 0f947f2c1c9d45fcacfde1d382fc3b58 and project 2aa5f961963f4833b8fc593b200e7f58. Resources: {'server_groups'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:32:38.423663 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-40beb066-c58b-43fe-9339-811098aeceef tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Getting quotas for project 2aa5f961963f4833b8fc593b200e7f58. Resources: {'server_groups'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:32:38.434895 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-40beb066-c58b-43fe-9339-811098aeceef tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Getting quotas for user 0f947f2c1c9d45fcacfde1d382fc3b58 and project 2aa5f961963f4833b8fc593b200e7f58. Resources: {'server_groups'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:32:38.456551 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-40beb066-c58b-43fe-9339-811098aeceef tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] 10.222.0.58 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.204702 Aug 10 23:32:38.457655 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2836/5878] 10.222.0.58 () {60 vars in 1173 bytes} [Wed Aug 10 23:32:38 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:32:38.469792 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-8cc2b387-087b-4bbe-9f09-852f402e3b4e tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:32:38.504246 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-8cc2b387-087b-4bbe-9f09-852f402e3b4e tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] 10.222.0.58 "DELETE /compute/v2.1/os-server-groups/b6664f58-2750-4ff4-93a7-70d366ba255c" status: 204 len: 0 microversion: 2.1 time: 0.038646 Aug 10 23:32:38.509028 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3043/5879] 10.222.0.58 () {58 vars in 1266 bytes} [Wed Aug 10 23:32:38 2022] DELETE /compute/v2.1/os-server-groups/b6664f58-2750-4ff4-93a7-70d366ba255c => generated 0 bytes in 41 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:32:38.515999 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-8760e27b-c7c1-4724-892a-f640c1e92792 tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:32:38.537677 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-8760e27b-c7c1-4724-892a-f640c1e92792 tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] 10.222.0.58 "GET /compute/v2.1/os-server-groups" status: 200 len: 334 microversion: 2.1 time: 0.026951 Aug 10 23:32:38.539015 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2837/5880] 10.222.0.58 () {58 vars in 1152 bytes} [Wed Aug 10 23:32:38 2022] GET /compute/v2.1/os-server-groups => generated 334 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 23:32:38.552946 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-a790b992-157f-4c71-8ea4-4c705603b238 tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:32:38.624931 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-a790b992-157f-4c71-8ea4-4c705603b238 tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] 10.222.0.58 "DELETE /compute/v2.1/os-server-groups/8c349eb0-8a12-4c9f-b281-3720f0df6e95" status: 204 len: 0 microversion: 2.1 time: 0.077955 Aug 10 23:32:38.625879 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3044/5881] 10.222.0.58 () {58 vars in 1266 bytes} [Wed Aug 10 23:32:38 2022] DELETE /compute/v2.1/os-server-groups/8c349eb0-8a12-4c9f-b281-3720f0df6e95 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:32:38.635122 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-559963dd-74d7-4649-a116-1fa781cfc5e9 tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:32:38.665749 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-559963dd-74d7-4649-a116-1fa781cfc5e9 tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] 10.222.0.58 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.035216 Aug 10 23:32:38.667515 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2838/5882] 10.222.0.58 () {58 vars in 1152 bytes} [Wed Aug 10 23:32:38 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:32:38.684265 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-61cae998-682d-4c5e-ab2d-5a9a9751b2d4 tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Action: 'create', calling method: .version_select at 0x7f847c4b8f70>, body: {"server_group": {"name": "tempest-server-group-717656681", "policies": ["affinity"]}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:32:38.733014 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-61cae998-682d-4c5e-ab2d-5a9a9751b2d4 tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Getting quotas for project 2aa5f961963f4833b8fc593b200e7f58. Resources: {'server_groups'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:32:38.746648 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-61cae998-682d-4c5e-ab2d-5a9a9751b2d4 tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Getting quotas for user 0f947f2c1c9d45fcacfde1d382fc3b58 and project 2aa5f961963f4833b8fc593b200e7f58. Resources: {'server_groups'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:32:38.840075 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-61cae998-682d-4c5e-ab2d-5a9a9751b2d4 tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Getting quotas for project 2aa5f961963f4833b8fc593b200e7f58. Resources: {'server_groups'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:32:38.848884 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-61cae998-682d-4c5e-ab2d-5a9a9751b2d4 tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Getting quotas for user 0f947f2c1c9d45fcacfde1d382fc3b58 and project 2aa5f961963f4833b8fc593b200e7f58. Resources: {'server_groups'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:32:38.872947 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-61cae998-682d-4c5e-ab2d-5a9a9751b2d4 tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] 10.222.0.58 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.197572 Aug 10 23:32:38.873870 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3045/5883] 10.222.0.58 () {60 vars in 1173 bytes} [Wed Aug 10 23:32:38 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:32:38.888895 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-17d64136-ac4c-4b0f-99d5-60dc3d09e8a0 tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:32:38.945482 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-17d64136-ac4c-4b0f-99d5-60dc3d09e8a0 tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] 10.222.0.58 "DELETE /compute/v2.1/os-server-groups/d2a2aa89-9bca-4fb5-a32e-b4c56a9a8bc6" status: 204 len: 0 microversion: 2.1 time: 0.060546 Aug 10 23:32:38.946118 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2839/5884] 10.222.0.58 () {58 vars in 1266 bytes} [Wed Aug 10 23:32:38 2022] DELETE /compute/v2.1/os-server-groups/d2a2aa89-9bca-4fb5-a32e-b4c56a9a8bc6 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:32:38.956855 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-87ba387c-1ce7-47bb-a6b7-000710de236a tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:32:39.010114 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-87ba387c-1ce7-47bb-a6b7-000710de236a tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] 10.222.0.58 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.058250 Aug 10 23:32:39.018391 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3046/5885] 10.222.0.58 () {58 vars in 1152 bytes} [Wed Aug 10 23:32:38 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:32:39.023158 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-e76a2aa2-d801-4ce6-8a19-5ea669d2e279 tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Action: 'create', calling method: .version_select at 0x7f847c5fc040>, body: {"server_group": {"name": "tempest-server-group-2006785515", "policies": ["anti-affinity"]}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:32:39.058296 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-e76a2aa2-d801-4ce6-8a19-5ea669d2e279 tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Getting quotas for project 2aa5f961963f4833b8fc593b200e7f58. Resources: {'server_groups'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:32:39.076742 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-e76a2aa2-d801-4ce6-8a19-5ea669d2e279 tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Getting quotas for user 0f947f2c1c9d45fcacfde1d382fc3b58 and project 2aa5f961963f4833b8fc593b200e7f58. Resources: {'server_groups'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:32:39.177324 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-e76a2aa2-d801-4ce6-8a19-5ea669d2e279 tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Getting quotas for project 2aa5f961963f4833b8fc593b200e7f58. Resources: {'server_groups'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:32:39.189657 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-e76a2aa2-d801-4ce6-8a19-5ea669d2e279 tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Getting quotas for user 0f947f2c1c9d45fcacfde1d382fc3b58 and project 2aa5f961963f4833b8fc593b200e7f58. Resources: {'server_groups'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:32:39.219790 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-e76a2aa2-d801-4ce6-8a19-5ea669d2e279 tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] 10.222.0.58 "POST /compute/v2.1/os-server-groups" status: 200 len: 169 microversion: 2.1 time: 0.200851 Aug 10 23:32:39.222829 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2840/5886] 10.222.0.58 () {60 vars in 1173 bytes} [Wed Aug 10 23:32:39 2022] POST /compute/v2.1/os-server-groups => generated 169 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 23:32:39.235949 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-9412ffd5-fc0c-4cbd-b877-9b3fd6bb8525 tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:32:39.316634 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-9412ffd5-fc0c-4cbd-b877-9b3fd6bb8525 tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] 10.222.0.58 "DELETE /compute/v2.1/os-server-groups/0b2fce71-151b-415b-9b21-743cbcf2856e" status: 204 len: 0 microversion: 2.1 time: 0.084829 Aug 10 23:32:39.317739 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3047/5887] 10.222.0.58 () {58 vars in 1266 bytes} [Wed Aug 10 23:32:39 2022] DELETE /compute/v2.1/os-server-groups/0b2fce71-151b-415b-9b21-743cbcf2856e => generated 0 bytes in 88 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:32:39.335051 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-4e9c24d2-103c-4d92-b68c-4a0bc27a9a88 tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:32:39.351412 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-4e9c24d2-103c-4d92-b68c-4a0bc27a9a88 tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] 10.222.0.58 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.027128 Aug 10 23:32:39.352549 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2841/5888] 10.222.0.58 () {58 vars in 1152 bytes} [Wed Aug 10 23:32:39 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 23:32:39.429720 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-34e038dd-d793-44ea-a3e6-97a24286c75c tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-732463923", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452", "networks": [{"uuid": "f43a9247-653f-4911-8991-be57dfef7aed"}]}, "os:scheduler_hints": {"group": "e92a2e8b-ea1a-4e27-8cfb-91df4640a432"}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:32:39.518203 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.network.neutron [None req-34e038dd-d793-44ea-a3e6-97a24286c75c tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] validate_networks() for [('f43a9247-653f-4911-8991-be57dfef7aed', None, None, None, None, None)] {{(pid=122633) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 23:32:40.089294 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-34e038dd-d793-44ea-a3e6-97a24286c75c tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Flavor limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:32:40.090342 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-34e038dd-d793-44ea-a3e6-97a24286c75c tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Image limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:32:40.090858 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-34e038dd-d793-44ea-a3e6-97a24286c75c tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Flavor pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:32:40.091544 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-34e038dd-d793-44ea-a3e6-97a24286c75c tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Image pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:32:40.092994 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-34e038dd-d793-44ea-a3e6-97a24286c75c tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:32:40.123087 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-34e038dd-d793-44ea-a3e6-97a24286c75c tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:32:40.123960 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-34e038dd-d793-44ea-a3e6-97a24286c75c tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:32:40.124583 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-34e038dd-d793-44ea-a3e6-97a24286c75c tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:32:40.125498 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-34e038dd-d793-44ea-a3e6-97a24286c75c tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:32:40.126124 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-34e038dd-d793-44ea-a3e6-97a24286c75c tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:32:40.126716 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-34e038dd-d793-44ea-a3e6-97a24286c75c tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:32:40.170046 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-34e038dd-d793-44ea-a3e6-97a24286c75c tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Getting quotas for project 2aa5f961963f4833b8fc593b200e7f58. Resources: {'instances', 'cores', 'ram'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:32:40.187082 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-34e038dd-d793-44ea-a3e6-97a24286c75c tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Getting quotas for user 0f947f2c1c9d45fcacfde1d382fc3b58 and project 2aa5f961963f4833b8fc593b200e7f58. Resources: {'instances', 'cores', 'ram'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:32:40.217665 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-34e038dd-d793-44ea-a3e6-97a24286c75c tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Going to run 1 instances... {{(pid=122633) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 23:32:40.221963 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-34e038dd-d793-44ea-a3e6-97a24286c75c tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] [instance: 11ffaaca-8e16-49ff-a22c-d272eb802883] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78ad8905-f66f-4733-8be9-2b260f1fabed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122633) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 23:32:40.282063 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-34e038dd-d793-44ea-a3e6-97a24286c75c tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=122633) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Aug 10 23:32:40.286055 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=7,nova_api:DELETE=9 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:32:40.323899 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-34e038dd-d793-44ea-a3e6-97a24286c75c tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Getting quotas for project 2aa5f961963f4833b8fc593b200e7f58. Resources: {'server_group_members'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:32:40.331769 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-34e038dd-d793-44ea-a3e6-97a24286c75c tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Getting quotas for user 0f947f2c1c9d45fcacfde1d382fc3b58 and project 2aa5f961963f4833b8fc593b200e7f58. Resources: {'server_group_members'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:32:40.413536 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-34e038dd-d793-44ea-a3e6-97a24286c75c tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Getting quotas for project 2aa5f961963f4833b8fc593b200e7f58. Resources: {'server_group_members'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:32:40.423358 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-34e038dd-d793-44ea-a3e6-97a24286c75c tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Getting quotas for user 0f947f2c1c9d45fcacfde1d382fc3b58 and project 2aa5f961963f4833b8fc593b200e7f58. Resources: {'server_group_members'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:32:40.464292 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-34e038dd-d793-44ea-a3e6-97a24286c75c tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.041524 Aug 10 23:32:40.470957 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3048/5889] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 23:32:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 1043 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 23:32:40.483578 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-ecd2c7f2-d3d8-4259-95b2-2e039a0c470c tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:32:40.484186 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-ecd2c7f2-d3d8-4259-95b2-2e039a0c470c tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] [instance: 11ffaaca-8e16-49ff-a22c-d272eb802883] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:32:40.592220 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-ecd2c7f2-d3d8-4259-95b2-2e039a0c470c tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f947f2c1c9d45fcacfde1d382fc3b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa5f961963f4833b8fc593b200e7f58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:32:40.625323 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-ecd2c7f2-d3d8-4259-95b2-2e039a0c470c tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] 10.222.0.58 "GET /compute/v2.1/servers/11ffaaca-8e16-49ff-a22c-d272eb802883" status: 200 len: 1212 microversion: 2.1 time: 0.149479 Aug 10 23:32:40.628786 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2842/5890] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:32:40 2022] GET /compute/v2.1/servers/11ffaaca-8e16-49ff-a22c-d272eb802883 => generated 1212 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:32:41.659932 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-37538d8e-f3df-4d44-aaba-84b5a047df7a tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:32:41.664226 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-37538d8e-f3df-4d44-aaba-84b5a047df7a tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] [instance: 11ffaaca-8e16-49ff-a22c-d272eb802883] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:32:41.673649 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-37538d8e-f3df-4d44-aaba-84b5a047df7a tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:32:41.674549 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-37538d8e-f3df-4d44-aaba-84b5a047df7a tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:32:41.675224 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-37538d8e-f3df-4d44-aaba-84b5a047df7a tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:32:41.676596 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-37538d8e-f3df-4d44-aaba-84b5a047df7a tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:32:41.677217 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-37538d8e-f3df-4d44-aaba-84b5a047df7a tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:32:41.678029 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-37538d8e-f3df-4d44-aaba-84b5a047df7a tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:32:41.764155 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-37538d8e-f3df-4d44-aaba-84b5a047df7a tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f947f2c1c9d45fcacfde1d382fc3b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa5f961963f4833b8fc593b200e7f58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:32:41.775209 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-37538d8e-f3df-4d44-aaba-84b5a047df7a tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] 10.222.0.58 "GET /compute/v2.1/servers/11ffaaca-8e16-49ff-a22c-d272eb802883" status: 200 len: 1264 microversion: 2.1 time: 0.125399 Aug 10 23:32:41.786805 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3049/5891] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:32:41 2022] GET /compute/v2.1/servers/11ffaaca-8e16-49ff-a22c-d272eb802883 => generated 1264 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:32:42.798437 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c92248f0-d6a6-4a1b-a55f-8969653a3ecf tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:32:42.799797 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-c92248f0-d6a6-4a1b-a55f-8969653a3ecf tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] [instance: 11ffaaca-8e16-49ff-a22c-d272eb802883] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:32:42.805667 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6,nova_api:DELETE=3 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:32:42.813322 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c92248f0-d6a6-4a1b-a55f-8969653a3ecf tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:32:42.814123 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c92248f0-d6a6-4a1b-a55f-8969653a3ecf tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:32:42.814903 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c92248f0-d6a6-4a1b-a55f-8969653a3ecf tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:32:42.815987 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c92248f0-d6a6-4a1b-a55f-8969653a3ecf tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:32:42.816631 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c92248f0-d6a6-4a1b-a55f-8969653a3ecf tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:32:42.818374 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c92248f0-d6a6-4a1b-a55f-8969653a3ecf tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:32:42.920518 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-c92248f0-d6a6-4a1b-a55f-8969653a3ecf tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f947f2c1c9d45fcacfde1d382fc3b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa5f961963f4833b8fc593b200e7f58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:32:42.933104 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-c92248f0-d6a6-4a1b-a55f-8969653a3ecf tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] 10.222.0.58 "GET /compute/v2.1/servers/11ffaaca-8e16-49ff-a22c-d272eb802883" status: 200 len: 1270 microversion: 2.1 time: 0.135916 Aug 10 23:32:42.933807 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2843/5892] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:32:42 2022] GET /compute/v2.1/servers/11ffaaca-8e16-49ff-a22c-d272eb802883 => generated 1270 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:32:43.967755 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-b03d4035-7a3f-4956-94da-651c7fa89b4d tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:32:43.969240 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-b03d4035-7a3f-4956-94da-651c7fa89b4d tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] [instance: 11ffaaca-8e16-49ff-a22c-d272eb802883] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:32:43.986123 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b03d4035-7a3f-4956-94da-651c7fa89b4d tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:32:43.987066 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b03d4035-7a3f-4956-94da-651c7fa89b4d tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:32:43.987657 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b03d4035-7a3f-4956-94da-651c7fa89b4d tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:32:43.988534 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b03d4035-7a3f-4956-94da-651c7fa89b4d tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:32:43.989142 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b03d4035-7a3f-4956-94da-651c7fa89b4d tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:32:43.989713 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b03d4035-7a3f-4956-94da-651c7fa89b4d tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:32:44.372258 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-83f06f6d-bbc9-4e43-a0eb-b623926bc7fa req-d531a58c-8817-46e4-b4c6-5c635f0acd98 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11ffaaca-8e16-49ff-a22c-d272eb802883", "tag": "71977c7a-a888-420b-a2cb-7cf384f7b53e"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:32:44.390823 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-83f06f6d-bbc9-4e43-a0eb-b623926bc7fa req-d531a58c-8817-46e4-b4c6-5c635f0acd98 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:32:44.391302 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-83f06f6d-bbc9-4e43-a0eb-b623926bc7fa req-d531a58c-8817-46e4-b4c6-5c635f0acd98 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:32:44.393183 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-83f06f6d-bbc9-4e43-a0eb-b623926bc7fa req-d531a58c-8817-46e4-b4c6-5c635f0acd98 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:32:44.420701 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-83f06f6d-bbc9-4e43-a0eb-b623926bc7fa req-d531a58c-8817-46e4-b4c6-5c635f0acd98 service nova] Creating event network-changed:71977c7a-a888-420b-a2cb-7cf384f7b53e for instance 11ffaaca-8e16-49ff-a22c-d272eb802883 on n-h1-850468-14 Aug 10 23:32:44.432426 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-83f06f6d-bbc9-4e43-a0eb-b623926bc7fa req-d531a58c-8817-46e4-b4c6-5c635f0acd98 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063663 Aug 10 23:32:44.435742 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2844/5893] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:32:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:32:44.524612 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-b03d4035-7a3f-4956-94da-651c7fa89b4d tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f947f2c1c9d45fcacfde1d382fc3b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa5f961963f4833b8fc593b200e7f58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:32:44.540598 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-b03d4035-7a3f-4956-94da-651c7fa89b4d tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] 10.222.0.58 "GET /compute/v2.1/servers/11ffaaca-8e16-49ff-a22c-d272eb802883" status: 200 len: 1312 microversion: 2.1 time: 0.582870 Aug 10 23:32:44.551558 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3050/5894] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:32:43 2022] GET /compute/v2.1/servers/11ffaaca-8e16-49ff-a22c-d272eb802883 => generated 1312 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:32:45.566430 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-dbe3ec61-1e96-4bb6-af57-d624824bda27 tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:32:45.567210 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-dbe3ec61-1e96-4bb6-af57-d624824bda27 tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] [instance: 11ffaaca-8e16-49ff-a22c-d272eb802883] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:32:45.575063 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dbe3ec61-1e96-4bb6-af57-d624824bda27 tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:32:45.575798 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dbe3ec61-1e96-4bb6-af57-d624824bda27 tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:32:45.576553 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dbe3ec61-1e96-4bb6-af57-d624824bda27 tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:32:45.577512 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dbe3ec61-1e96-4bb6-af57-d624824bda27 tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:32:45.578147 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dbe3ec61-1e96-4bb6-af57-d624824bda27 tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:32:45.578759 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dbe3ec61-1e96-4bb6-af57-d624824bda27 tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:32:46.305974 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-dbe3ec61-1e96-4bb6-af57-d624824bda27 tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f947f2c1c9d45fcacfde1d382fc3b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa5f961963f4833b8fc593b200e7f58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:32:46.317725 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-dbe3ec61-1e96-4bb6-af57-d624824bda27 tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] 10.222.0.58 "GET /compute/v2.1/servers/11ffaaca-8e16-49ff-a22c-d272eb802883" status: 200 len: 1312 microversion: 2.1 time: 0.758478 Aug 10 23:32:46.336788 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2845/5895] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:32:45 2022] GET /compute/v2.1/servers/11ffaaca-8e16-49ff-a22c-d272eb802883 => generated 1312 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:32:47.343589 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-ef132b82-4439-4a7e-8b03-55c8c1dd4f64 tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:32:47.344930 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-ef132b82-4439-4a7e-8b03-55c8c1dd4f64 tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] [instance: 11ffaaca-8e16-49ff-a22c-d272eb802883] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:32:47.353581 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ef132b82-4439-4a7e-8b03-55c8c1dd4f64 tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:32:47.354366 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ef132b82-4439-4a7e-8b03-55c8c1dd4f64 tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:32:47.355070 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ef132b82-4439-4a7e-8b03-55c8c1dd4f64 tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:32:47.356011 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ef132b82-4439-4a7e-8b03-55c8c1dd4f64 tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:32:47.356668 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ef132b82-4439-4a7e-8b03-55c8c1dd4f64 tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:32:47.357297 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ef132b82-4439-4a7e-8b03-55c8c1dd4f64 tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:32:47.533786 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-ef132b82-4439-4a7e-8b03-55c8c1dd4f64 tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f947f2c1c9d45fcacfde1d382fc3b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa5f961963f4833b8fc593b200e7f58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:32:47.544474 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-ef132b82-4439-4a7e-8b03-55c8c1dd4f64 tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] 10.222.0.58 "GET /compute/v2.1/servers/11ffaaca-8e16-49ff-a22c-d272eb802883" status: 200 len: 1312 microversion: 2.1 time: 0.205086 Aug 10 23:32:47.561062 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3051/5896] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:32:47 2022] GET /compute/v2.1/servers/11ffaaca-8e16-49ff-a22c-d272eb802883 => generated 1312 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:32:48.566091 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-9bb7c6b0-76a7-4d8c-9eb3-dc37ce52f987 tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:32:48.567035 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-9bb7c6b0-76a7-4d8c-9eb3-dc37ce52f987 tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] [instance: 11ffaaca-8e16-49ff-a22c-d272eb802883] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:32:48.580017 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9bb7c6b0-76a7-4d8c-9eb3-dc37ce52f987 tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:32:48.580583 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9bb7c6b0-76a7-4d8c-9eb3-dc37ce52f987 tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:32:48.580957 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9bb7c6b0-76a7-4d8c-9eb3-dc37ce52f987 tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:32:48.582594 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9bb7c6b0-76a7-4d8c-9eb3-dc37ce52f987 tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:32:48.583474 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9bb7c6b0-76a7-4d8c-9eb3-dc37ce52f987 tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:32:48.584795 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9bb7c6b0-76a7-4d8c-9eb3-dc37ce52f987 tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:32:48.862425 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-9bb7c6b0-76a7-4d8c-9eb3-dc37ce52f987 tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f947f2c1c9d45fcacfde1d382fc3b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa5f961963f4833b8fc593b200e7f58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:32:48.872948 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-9bb7c6b0-76a7-4d8c-9eb3-dc37ce52f987 tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] 10.222.0.58 "GET /compute/v2.1/servers/11ffaaca-8e16-49ff-a22c-d272eb802883" status: 200 len: 1312 microversion: 2.1 time: 0.311125 Aug 10 23:32:48.873654 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2846/5897] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:32:48 2022] GET /compute/v2.1/servers/11ffaaca-8e16-49ff-a22c-d272eb802883 => generated 1312 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:32:49.894349 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-de352051-c6dc-4af2-9a4f-7a7c007b18ae tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:32:49.895626 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-de352051-c6dc-4af2-9a4f-7a7c007b18ae tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] [instance: 11ffaaca-8e16-49ff-a22c-d272eb802883] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:32:49.903975 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-de352051-c6dc-4af2-9a4f-7a7c007b18ae tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:32:49.905334 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-de352051-c6dc-4af2-9a4f-7a7c007b18ae tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:32:49.906067 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-de352051-c6dc-4af2-9a4f-7a7c007b18ae tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:32:49.906995 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-de352051-c6dc-4af2-9a4f-7a7c007b18ae tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:32:49.907463 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-de352051-c6dc-4af2-9a4f-7a7c007b18ae tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:32:49.907924 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-de352051-c6dc-4af2-9a4f-7a7c007b18ae tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:32:50.072190 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-de352051-c6dc-4af2-9a4f-7a7c007b18ae tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f947f2c1c9d45fcacfde1d382fc3b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa5f961963f4833b8fc593b200e7f58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:32:50.096560 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-de352051-c6dc-4af2-9a4f-7a7c007b18ae tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] 10.222.0.58 "GET /compute/v2.1/servers/11ffaaca-8e16-49ff-a22c-d272eb802883" status: 200 len: 1312 microversion: 2.1 time: 0.198472 Aug 10 23:32:50.097394 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3052/5898] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:32:49 2022] GET /compute/v2.1/servers/11ffaaca-8e16-49ff-a22c-d272eb802883 => generated 1312 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:32:50.396320 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-73e288ea-d409-40ef-b2e4-456e05466914 req-d4927347-d5c4-4cff-b251-9a0a9ad21a78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11ffaaca-8e16-49ff-a22c-d272eb802883", "name": "network-vif-plugged", "status": "completed", "tag": "71977c7a-a888-420b-a2cb-7cf384f7b53e"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:32:50.416527 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-73e288ea-d409-40ef-b2e4-456e05466914 req-d4927347-d5c4-4cff-b251-9a0a9ad21a78 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:32:50.418561 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-73e288ea-d409-40ef-b2e4-456e05466914 req-d4927347-d5c4-4cff-b251-9a0a9ad21a78 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:32:50.419042 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-73e288ea-d409-40ef-b2e4-456e05466914 req-d4927347-d5c4-4cff-b251-9a0a9ad21a78 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:32:50.444493 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-73e288ea-d409-40ef-b2e4-456e05466914 req-d4927347-d5c4-4cff-b251-9a0a9ad21a78 service nova] Creating event network-vif-plugged:71977c7a-a888-420b-a2cb-7cf384f7b53e for instance 11ffaaca-8e16-49ff-a22c-d272eb802883 on n-h1-850468-14 Aug 10 23:32:50.461363 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-73e288ea-d409-40ef-b2e4-456e05466914 req-d4927347-d5c4-4cff-b251-9a0a9ad21a78 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068593 Aug 10 23:32:50.463409 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2847/5899] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:32:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:32:51.124538 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-fe1c7038-3768-4671-a37c-ecfcf594e1a6 tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:32:51.125155 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-fe1c7038-3768-4671-a37c-ecfcf594e1a6 tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] [instance: 11ffaaca-8e16-49ff-a22c-d272eb802883] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:32:51.129527 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=2 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:32:51.130805 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=30 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:32:51.138924 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fe1c7038-3768-4671-a37c-ecfcf594e1a6 tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:32:51.139420 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fe1c7038-3768-4671-a37c-ecfcf594e1a6 tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:32:51.139865 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fe1c7038-3768-4671-a37c-ecfcf594e1a6 tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:32:51.140602 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fe1c7038-3768-4671-a37c-ecfcf594e1a6 tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:32:51.141215 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fe1c7038-3768-4671-a37c-ecfcf594e1a6 tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:32:51.141640 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fe1c7038-3768-4671-a37c-ecfcf594e1a6 tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:32:51.336006 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-fe1c7038-3768-4671-a37c-ecfcf594e1a6 tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f947f2c1c9d45fcacfde1d382fc3b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa5f961963f4833b8fc593b200e7f58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:32:51.345251 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-fe1c7038-3768-4671-a37c-ecfcf594e1a6 tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] 10.222.0.58 "GET /compute/v2.1/servers/11ffaaca-8e16-49ff-a22c-d272eb802883" status: 200 len: 1312 microversion: 2.1 time: 0.225409 Aug 10 23:32:51.346372 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3053/5900] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:32:51 2022] GET /compute/v2.1/servers/11ffaaca-8e16-49ff-a22c-d272eb802883 => generated 1312 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:32:52.368297 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-008066e4-7ba4-44ec-8a12-f6daa48312c4 tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:32:52.369833 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-008066e4-7ba4-44ec-8a12-f6daa48312c4 tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] [instance: 11ffaaca-8e16-49ff-a22c-d272eb802883] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:32:52.372114 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=26 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:32:52.379943 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-008066e4-7ba4-44ec-8a12-f6daa48312c4 tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:32:52.380964 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-008066e4-7ba4-44ec-8a12-f6daa48312c4 tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:32:52.382313 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-008066e4-7ba4-44ec-8a12-f6daa48312c4 tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:32:52.383552 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-008066e4-7ba4-44ec-8a12-f6daa48312c4 tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:32:52.384367 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-008066e4-7ba4-44ec-8a12-f6daa48312c4 tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:32:52.385160 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-008066e4-7ba4-44ec-8a12-f6daa48312c4 tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:32:52.624438 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-008066e4-7ba4-44ec-8a12-f6daa48312c4 tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f947f2c1c9d45fcacfde1d382fc3b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa5f961963f4833b8fc593b200e7f58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:32:52.634950 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-008066e4-7ba4-44ec-8a12-f6daa48312c4 tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] 10.222.0.58 "GET /compute/v2.1/servers/11ffaaca-8e16-49ff-a22c-d272eb802883" status: 200 len: 1497 microversion: 2.1 time: 0.270867 Aug 10 23:32:52.636018 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2848/5901] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:32:52 2022] GET /compute/v2.1/servers/11ffaaca-8e16-49ff-a22c-d272eb802883 => generated 1497 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:32:52.656547 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-d418ca25-a66f-4548-8eaf-ca9fc1f9308e tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:32:52.673392 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.compute.server_groups [None req-d418ca25-a66f-4548-8eaf-ca9fc1f9308e tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Querying cell c9127db4-59f9-48ac-9ab2-b5d6690bb85f(cell1) for 1 instances {{(pid=122633) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 10 23:32:52.674309 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d418ca25-a66f-4548-8eaf-ca9fc1f9308e tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:32:52.674957 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d418ca25-a66f-4548-8eaf-ca9fc1f9308e tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:32:52.675572 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d418ca25-a66f-4548-8eaf-ca9fc1f9308e tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:32:52.712334 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-d418ca25-a66f-4548-8eaf-ca9fc1f9308e tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] 10.222.0.58 "GET /compute/v2.1/os-server-groups/e92a2e8b-ea1a-4e27-8cfb-91df4640a432" status: 200 len: 222 microversion: 2.1 time: 0.058474 Aug 10 23:32:52.731809 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-7d3ab97d-6c3f-4ebb-a358-cf1969ce594e tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:32:52.732566 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-7d3ab97d-6c3f-4ebb-a358-cf1969ce594e tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] [instance: 11ffaaca-8e16-49ff-a22c-d272eb802883] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:32:52.735515 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3054/5902] 10.222.0.58 () {58 vars in 1263 bytes} [Wed Aug 10 23:32:52 2022] GET /compute/v2.1/os-server-groups/e92a2e8b-ea1a-4e27-8cfb-91df4640a432 => generated 222 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:32:52.741397 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7d3ab97d-6c3f-4ebb-a358-cf1969ce594e tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:32:52.742293 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7d3ab97d-6c3f-4ebb-a358-cf1969ce594e tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:32:52.743945 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7d3ab97d-6c3f-4ebb-a358-cf1969ce594e tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:32:52.745174 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7d3ab97d-6c3f-4ebb-a358-cf1969ce594e tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:32:52.745924 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7d3ab97d-6c3f-4ebb-a358-cf1969ce594e tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:32:52.746617 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7d3ab97d-6c3f-4ebb-a358-cf1969ce594e tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:32:52.796276 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-7d3ab97d-6c3f-4ebb-a358-cf1969ce594e tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] [instance: 11ffaaca-8e16-49ff-a22c-d272eb802883] Going to try to terminate instance {{(pid=122632) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:32:52.917305 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-7d3ab97d-6c3f-4ebb-a358-cf1969ce594e tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] 10.222.0.58 "DELETE /compute/v2.1/servers/11ffaaca-8e16-49ff-a22c-d272eb802883" status: 204 len: 0 microversion: 2.1 time: 0.189354 Aug 10 23:32:52.917941 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2849/5903] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:32:52 2022] DELETE /compute/v2.1/servers/11ffaaca-8e16-49ff-a22c-d272eb802883 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:32:52.931275 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-bb43663e-3e2f-479a-8c06-fe84c26c88b4 tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:32:52.933053 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-bb43663e-3e2f-479a-8c06-fe84c26c88b4 tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] [instance: 11ffaaca-8e16-49ff-a22c-d272eb802883] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:32:52.941361 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bb43663e-3e2f-479a-8c06-fe84c26c88b4 tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:32:52.942186 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bb43663e-3e2f-479a-8c06-fe84c26c88b4 tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:32:52.942990 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bb43663e-3e2f-479a-8c06-fe84c26c88b4 tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:32:52.944668 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bb43663e-3e2f-479a-8c06-fe84c26c88b4 tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:32:52.945570 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bb43663e-3e2f-479a-8c06-fe84c26c88b4 tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:32:52.949415 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bb43663e-3e2f-479a-8c06-fe84c26c88b4 tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:32:53.227690 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-bb43663e-3e2f-479a-8c06-fe84c26c88b4 tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f947f2c1c9d45fcacfde1d382fc3b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa5f961963f4833b8fc593b200e7f58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:32:53.241518 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-bb43663e-3e2f-479a-8c06-fe84c26c88b4 tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] 10.222.0.58 "GET /compute/v2.1/servers/11ffaaca-8e16-49ff-a22c-d272eb802883" status: 200 len: 1503 microversion: 2.1 time: 0.316780 Aug 10 23:32:53.258746 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3055/5904] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:32:52 2022] GET /compute/v2.1/servers/11ffaaca-8e16-49ff-a22c-d272eb802883 => generated 1503 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:32:54.264499 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-b0c9d3c2-26dd-4836-b28c-06fc76c2c4c3 tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:32:54.265222 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-b0c9d3c2-26dd-4836-b28c-06fc76c2c4c3 tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] [instance: 11ffaaca-8e16-49ff-a22c-d272eb802883] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:32:54.292704 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b0c9d3c2-26dd-4836-b28c-06fc76c2c4c3 tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:32:54.293101 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b0c9d3c2-26dd-4836-b28c-06fc76c2c4c3 tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:32:54.293715 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b0c9d3c2-26dd-4836-b28c-06fc76c2c4c3 tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:32:54.294585 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b0c9d3c2-26dd-4836-b28c-06fc76c2c4c3 tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:32:54.295213 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b0c9d3c2-26dd-4836-b28c-06fc76c2c4c3 tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:32:54.295786 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b0c9d3c2-26dd-4836-b28c-06fc76c2c4c3 tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:32:54.584869 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-b0c9d3c2-26dd-4836-b28c-06fc76c2c4c3 tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0f947f2c1c9d45fcacfde1d382fc3b58', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2aa5f961963f4833b8fc593b200e7f58', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:32:54.600385 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-b0c9d3c2-26dd-4836-b28c-06fc76c2c4c3 tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] 10.222.0.58 "GET /compute/v2.1/servers/11ffaaca-8e16-49ff-a22c-d272eb802883" status: 200 len: 1503 microversion: 2.1 time: 0.339974 Aug 10 23:32:54.603025 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2850/5905] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:32:54 2022] GET /compute/v2.1/servers/11ffaaca-8e16-49ff-a22c-d272eb802883 => generated 1503 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:32:55.073637 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-e015153e-b4d1-493b-9a46-c95d84698f76 req-7ff8b430-beac-4535-9c42-7b6aa46e16be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11ffaaca-8e16-49ff-a22c-d272eb802883", "name": "network-vif-deleted", "tag": "71977c7a-a888-420b-a2cb-7cf384f7b53e"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:32:55.090844 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-e015153e-b4d1-493b-9a46-c95d84698f76 req-7ff8b430-beac-4535-9c42-7b6aa46e16be service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:32:55.091775 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-e015153e-b4d1-493b-9a46-c95d84698f76 req-7ff8b430-beac-4535-9c42-7b6aa46e16be service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:32:55.094755 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-e015153e-b4d1-493b-9a46-c95d84698f76 req-7ff8b430-beac-4535-9c42-7b6aa46e16be service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:32:55.124193 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-e015153e-b4d1-493b-9a46-c95d84698f76 req-7ff8b430-beac-4535-9c42-7b6aa46e16be service nova] Creating event network-vif-deleted:71977c7a-a888-420b-a2cb-7cf384f7b53e for instance 11ffaaca-8e16-49ff-a22c-d272eb802883 on n-h1-850468-14 Aug 10 23:32:55.130160 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-e015153e-b4d1-493b-9a46-c95d84698f76 req-7ff8b430-beac-4535-9c42-7b6aa46e16be service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061035 Aug 10 23:32:55.131553 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3056/5906] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:32:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:32:55.629554 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-3dcf3b13-9438-4e4b-98f7-9d2d1e400872 tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:32:55.630922 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-3dcf3b13-9438-4e4b-98f7-9d2d1e400872 tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] [instance: 11ffaaca-8e16-49ff-a22c-d272eb802883] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:32:55.639177 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3dcf3b13-9438-4e4b-98f7-9d2d1e400872 tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:32:55.640171 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3dcf3b13-9438-4e4b-98f7-9d2d1e400872 tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:32:55.641533 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3dcf3b13-9438-4e4b-98f7-9d2d1e400872 tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:32:55.642314 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3dcf3b13-9438-4e4b-98f7-9d2d1e400872 tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:32:55.643223 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3dcf3b13-9438-4e4b-98f7-9d2d1e400872 tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:32:55.643743 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3dcf3b13-9438-4e4b-98f7-9d2d1e400872 tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:32:55.666528 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-3dcf3b13-9438-4e4b-98f7-9d2d1e400872 tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] HTTP exception thrown: Instance 11ffaaca-8e16-49ff-a22c-d272eb802883 could not be found. Aug 10 23:32:55.669263 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-3dcf3b13-9438-4e4b-98f7-9d2d1e400872 tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Request method failure captured: Aug 10 23:32:55.669263 n-d-850468-14 devstack@n-api.service[122632]: request: GET /compute/v2.1/servers/11ffaaca-8e16-49ff-a22c-d272eb802883 HTTP/1.1 Aug 10 23:32:55.669263 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:32:55.669263 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:32:55.669263 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:32:55.669263 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 23:32:55.669263 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:32:55.669263 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:32:55.669263 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:32:55.669263 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:32:55.669263 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9EAVJrqF7wx_1RumcuhyLTbBWSRMK8HVUvJPa9H4Kgc0f0jJ1u9rHtXfMrcR1X2K5SKsjA3FWDaBLoR0C7unEWpJiV8o0jwCM8vb-7mXgDwWmkwyvuSgTWq7XHB-17v99D_fsvOEVb0nzkAIiQVNbQr9hdqsHfvWk_xmJzdhBz_TIvs Aug 10 23:32:55.669263 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:32:55.669263 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:32:55.669263 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:32:55.669263 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:32:55.669263 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:32:55.669263 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:32:55.669263 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 2aa5f961963f4833b8fc593b200e7f58 Aug 10 23:32:55.669263 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-ServerGroupTestJSON-1222891098 Aug 10 23:32:55.669263 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:32:55.669263 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:32:55.669263 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2aa5f961963f4833b8fc593b200e7f58"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2aa5f961963f4833b8fc593b200e7f58"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2aa5f961963f4833b8fc593b200e7f58"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2aa5f961963f4833b8fc593b200e7f58", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:32:55.669263 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-ServerGroupTestJSON-1222891098 Aug 10 23:32:55.669263 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 2aa5f961963f4833b8fc593b200e7f58 Aug 10 23:32:55.669263 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-ServerGroupTestJSON-1222891098 Aug 10 23:32:55.669263 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-ServerGroupTestJSON-1222891098-project Aug 10 23:32:55.669263 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:32:55.669263 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:32:55.669263 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: 0f947f2c1c9d45fcacfde1d382fc3b58 Aug 10 23:32:55.669263 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-ServerGroupTestJSON-1222891098-project Aug 10 23:32:55.669263 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:32:55.669263 n-d-850468-14 devstack@n-api.service[122632]: exception: Instance 11ffaaca-8e16-49ff-a22c-d272eb802883 could not be found. Aug 10 23:32:55.669263 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': '11ffaaca-8e16-49ff-a22c-d272eb802883'} Aug 10 23:32:55.669263 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:32:55.669263 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:32:55.669263 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:32:55.669263 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:32:55.669263 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:32:55.669263 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:32:55.669263 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:32:55.669263 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:32:55.669263 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:32:55.669263 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:32:55.669263 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11ffaaca-8e16-49ff-a22c-d272eb802883 could not be found. Aug 10 23:32:55.669263 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:32:55.669263 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:32:55.669263 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:32:55.669263 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:32:55.669263 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:32:55.669263 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:32:55.669263 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:32:55.669263 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:32:55.669263 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:32:55.669263 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:32:55.669263 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:32:55.669263 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:32:55.669263 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:32:55.669263 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:32:55.669263 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:32:55.669263 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:32:55.669263 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11ffaaca-8e16-49ff-a22c-d272eb802883 could not be found. Aug 10 23:32:55.669263 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:32:55.669263 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:32:55.669263 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:32:55.673149 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:32:55.673149 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:32:55.673149 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:32:55.673149 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:32:55.673149 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:32:55.673149 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11ffaaca-8e16-49ff-a22c-d272eb802883 could not be found. Aug 10 23:32:55.673149 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:32:55.675161 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-3dcf3b13-9438-4e4b-98f7-9d2d1e400872 tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Returning 404 to user: Instance 11ffaaca-8e16-49ff-a22c-d272eb802883 could not be found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:32:55.676354 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-3dcf3b13-9438-4e4b-98f7-9d2d1e400872 tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] 10.222.0.58 "GET /compute/v2.1/servers/11ffaaca-8e16-49ff-a22c-d272eb802883" status: 404 len: 111 microversion: 2.1 time: 0.054062 Aug 10 23:32:55.677020 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2851/5907] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:32:55 2022] GET /compute/v2.1/servers/11ffaaca-8e16-49ff-a22c-d272eb802883 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:32:55.695131 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-dbf7decb-457e-4c75-84d7-3670e35be179 tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:32:55.714216 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.compute.server_groups [None req-dbf7decb-457e-4c75-84d7-3670e35be179 tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Querying cell c9127db4-59f9-48ac-9ab2-b5d6690bb85f(cell1) for 1 instances {{(pid=122633) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 10 23:32:55.715156 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dbf7decb-457e-4c75-84d7-3670e35be179 tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:32:55.715670 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dbf7decb-457e-4c75-84d7-3670e35be179 tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:32:55.716137 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dbf7decb-457e-4c75-84d7-3670e35be179 tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:32:55.728265 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-dbf7decb-457e-4c75-84d7-3670e35be179 tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] 10.222.0.58 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.042363 Aug 10 23:32:55.729223 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3057/5908] 10.222.0.58 () {58 vars in 1152 bytes} [Wed Aug 10 23:32:55 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:32:55.742216 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-bddd05d2-f51e-449c-a845-a6deea44b929 tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:32:55.759044 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.compute.server_groups [None req-bddd05d2-f51e-449c-a845-a6deea44b929 tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Querying cell c9127db4-59f9-48ac-9ab2-b5d6690bb85f(cell1) for 1 instances {{(pid=122632) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 10 23:32:55.759840 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bddd05d2-f51e-449c-a845-a6deea44b929 tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:32:55.760498 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bddd05d2-f51e-449c-a845-a6deea44b929 tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:32:55.761123 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bddd05d2-f51e-449c-a845-a6deea44b929 tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:32:55.773287 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-bddd05d2-f51e-449c-a845-a6deea44b929 tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] 10.222.0.58 "GET /compute/v2.1/os-server-groups/e92a2e8b-ea1a-4e27-8cfb-91df4640a432" status: 200 len: 184 microversion: 2.1 time: 0.035887 Aug 10 23:32:55.774033 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2852/5909] 10.222.0.58 () {58 vars in 1263 bytes} [Wed Aug 10 23:32:55 2022] GET /compute/v2.1/os-server-groups/e92a2e8b-ea1a-4e27-8cfb-91df4640a432 => generated 184 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:32:55.790297 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-1c71ea8d-7ccc-4d71-9f67-e186a0be8c55 tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:32:55.791307 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-1c71ea8d-7ccc-4d71-9f67-e186a0be8c55 tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] [instance: 11ffaaca-8e16-49ff-a22c-d272eb802883] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:32:55.800492 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1c71ea8d-7ccc-4d71-9f67-e186a0be8c55 tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:32:55.801340 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1c71ea8d-7ccc-4d71-9f67-e186a0be8c55 tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:32:55.806481 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1c71ea8d-7ccc-4d71-9f67-e186a0be8c55 tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:32:55.808277 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1c71ea8d-7ccc-4d71-9f67-e186a0be8c55 tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:32:55.810128 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1c71ea8d-7ccc-4d71-9f67-e186a0be8c55 tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:32:55.810814 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1c71ea8d-7ccc-4d71-9f67-e186a0be8c55 tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:32:55.832531 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-1c71ea8d-7ccc-4d71-9f67-e186a0be8c55 tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] HTTP exception thrown: Instance 11ffaaca-8e16-49ff-a22c-d272eb802883 could not be found. Aug 10 23:32:55.834455 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-1c71ea8d-7ccc-4d71-9f67-e186a0be8c55 tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Request method failure captured: Aug 10 23:32:55.834455 n-d-850468-14 devstack@n-api.service[122633]: request: DELETE /compute/v2.1/servers/11ffaaca-8e16-49ff-a22c-d272eb802883 HTTP/1.1 Aug 10 23:32:55.834455 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:32:55.834455 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:32:55.834455 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:32:55.834455 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:32:55.834455 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:32:55.834455 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:32:55.834455 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:32:55.834455 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:32:55.834455 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9EAVJrqF7wx_1RumcuhyLTbBWSRMK8HVUvJPa9H4Kgc0f0jJ1u9rHtXfMrcR1X2K5SKsjA3FWDaBLoR0C7unEWpJiV8o0jwCM8vb-7mXgDwWmkwyvuSgTWq7XHB-17v99D_fsvOEVb0nzkAIiQVNbQr9hdqsHfvWk_xmJzdhBz_TIvs Aug 10 23:32:55.834455 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:32:55.834455 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:32:55.834455 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:32:55.834455 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:32:55.834455 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:32:55.834455 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:32:55.834455 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 2aa5f961963f4833b8fc593b200e7f58 Aug 10 23:32:55.834455 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-ServerGroupTestJSON-1222891098 Aug 10 23:32:55.834455 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:32:55.834455 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:32:55.834455 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2aa5f961963f4833b8fc593b200e7f58"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2aa5f961963f4833b8fc593b200e7f58"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2aa5f961963f4833b8fc593b200e7f58"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2aa5f961963f4833b8fc593b200e7f58", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:32:55.834455 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-ServerGroupTestJSON-1222891098 Aug 10 23:32:55.834455 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 2aa5f961963f4833b8fc593b200e7f58 Aug 10 23:32:55.834455 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-ServerGroupTestJSON-1222891098 Aug 10 23:32:55.834455 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-ServerGroupTestJSON-1222891098-project Aug 10 23:32:55.834455 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:32:55.834455 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:32:55.834455 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 0f947f2c1c9d45fcacfde1d382fc3b58 Aug 10 23:32:55.834455 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-ServerGroupTestJSON-1222891098-project Aug 10 23:32:55.834455 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:32:55.834455 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance 11ffaaca-8e16-49ff-a22c-d272eb802883 could not be found. Aug 10 23:32:55.834455 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': '11ffaaca-8e16-49ff-a22c-d272eb802883'} Aug 10 23:32:55.834455 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:32:55.834455 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:32:55.834455 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:32:55.834455 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:32:55.834455 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:32:55.834455 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:32:55.834455 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:32:55.834455 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:32:55.834455 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:32:55.834455 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:32:55.834455 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11ffaaca-8e16-49ff-a22c-d272eb802883 could not be found. Aug 10 23:32:55.834455 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:32:55.834455 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:32:55.834455 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:32:55.834455 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:32:55.834455 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:32:55.834455 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:32:55.834455 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:32:55.834455 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:32:55.834455 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:32:55.834455 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:32:55.834455 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 23:32:55.834455 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 23:32:55.834455 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 23:32:55.834455 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 23:32:55.834455 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:32:55.834455 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:32:55.834455 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:32:55.834455 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:32:55.837752 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11ffaaca-8e16-49ff-a22c-d272eb802883 could not be found. Aug 10 23:32:55.837752 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:32:55.837752 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:32:55.837752 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:32:55.837752 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:32:55.837752 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:32:55.837752 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:32:55.837752 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:32:55.837752 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:32:55.837752 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11ffaaca-8e16-49ff-a22c-d272eb802883 could not be found. Aug 10 23:32:55.837752 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:32:55.837752 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-1c71ea8d-7ccc-4d71-9f67-e186a0be8c55 tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Returning 404 to user: Instance 11ffaaca-8e16-49ff-a22c-d272eb802883 could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:32:55.837752 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-1c71ea8d-7ccc-4d71-9f67-e186a0be8c55 tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] 10.222.0.58 "DELETE /compute/v2.1/servers/11ffaaca-8e16-49ff-a22c-d272eb802883" status: 404 len: 111 microversion: 2.1 time: 0.053712 Aug 10 23:32:55.837752 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3058/5910] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:32:55 2022] DELETE /compute/v2.1/servers/11ffaaca-8e16-49ff-a22c-d272eb802883 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:32:55.845464 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-ab753d19-df46-434e-a2e8-b2953d1b9e7e tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:32:55.846078 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-ab753d19-df46-434e-a2e8-b2953d1b9e7e tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] [instance: 11ffaaca-8e16-49ff-a22c-d272eb802883] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:32:55.862859 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ab753d19-df46-434e-a2e8-b2953d1b9e7e tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:32:55.868668 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ab753d19-df46-434e-a2e8-b2953d1b9e7e tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:32:55.870337 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ab753d19-df46-434e-a2e8-b2953d1b9e7e tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:32:55.871577 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ab753d19-df46-434e-a2e8-b2953d1b9e7e tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:32:55.874305 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ab753d19-df46-434e-a2e8-b2953d1b9e7e tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:32:55.874940 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ab753d19-df46-434e-a2e8-b2953d1b9e7e tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:32:55.906642 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-ab753d19-df46-434e-a2e8-b2953d1b9e7e tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] HTTP exception thrown: Instance 11ffaaca-8e16-49ff-a22c-d272eb802883 could not be found. Aug 10 23:32:55.909037 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-ab753d19-df46-434e-a2e8-b2953d1b9e7e tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Request method failure captured: Aug 10 23:32:55.909037 n-d-850468-14 devstack@n-api.service[122632]: request: GET /compute/v2.1/servers/11ffaaca-8e16-49ff-a22c-d272eb802883 HTTP/1.1 Aug 10 23:32:55.909037 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:32:55.909037 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:32:55.909037 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:32:55.909037 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 23:32:55.909037 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:32:55.909037 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:32:55.909037 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:32:55.909037 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:32:55.909037 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9EAVJrqF7wx_1RumcuhyLTbBWSRMK8HVUvJPa9H4Kgc0f0jJ1u9rHtXfMrcR1X2K5SKsjA3FWDaBLoR0C7unEWpJiV8o0jwCM8vb-7mXgDwWmkwyvuSgTWq7XHB-17v99D_fsvOEVb0nzkAIiQVNbQr9hdqsHfvWk_xmJzdhBz_TIvs Aug 10 23:32:55.909037 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:32:55.909037 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:32:55.909037 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:32:55.909037 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:32:55.909037 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:32:55.909037 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:32:55.909037 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 2aa5f961963f4833b8fc593b200e7f58 Aug 10 23:32:55.909037 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-ServerGroupTestJSON-1222891098 Aug 10 23:32:55.909037 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:32:55.909037 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:32:55.909037 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2aa5f961963f4833b8fc593b200e7f58"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2aa5f961963f4833b8fc593b200e7f58"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2aa5f961963f4833b8fc593b200e7f58"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2aa5f961963f4833b8fc593b200e7f58", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:32:55.909037 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-ServerGroupTestJSON-1222891098 Aug 10 23:32:55.909037 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 2aa5f961963f4833b8fc593b200e7f58 Aug 10 23:32:55.909037 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-ServerGroupTestJSON-1222891098 Aug 10 23:32:55.909037 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-ServerGroupTestJSON-1222891098-project Aug 10 23:32:55.909037 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:32:55.909037 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:32:55.909037 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: 0f947f2c1c9d45fcacfde1d382fc3b58 Aug 10 23:32:55.909037 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-ServerGroupTestJSON-1222891098-project Aug 10 23:32:55.909037 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:32:55.909037 n-d-850468-14 devstack@n-api.service[122632]: exception: Instance 11ffaaca-8e16-49ff-a22c-d272eb802883 could not be found. Aug 10 23:32:55.909037 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': '11ffaaca-8e16-49ff-a22c-d272eb802883'} Aug 10 23:32:55.909037 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:32:55.909037 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:32:55.909037 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:32:55.909037 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:32:55.909037 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:32:55.909037 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:32:55.909037 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:32:55.909037 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:32:55.909037 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:32:55.909037 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:32:55.909037 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11ffaaca-8e16-49ff-a22c-d272eb802883 could not be found. Aug 10 23:32:55.909037 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:32:55.909037 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:32:55.909037 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:32:55.909037 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:32:55.909037 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:32:55.909037 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:32:55.909037 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:32:55.909037 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:32:55.909037 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:32:55.909037 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:32:55.909037 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:32:55.909037 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:32:55.909037 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:32:55.909037 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:32:55.909037 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:32:55.909037 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:32:55.909037 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11ffaaca-8e16-49ff-a22c-d272eb802883 could not be found. Aug 10 23:32:55.909037 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:32:55.909037 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:32:55.909037 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:32:55.912730 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:32:55.912730 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:32:55.912730 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:32:55.912730 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:32:55.912730 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:32:55.912730 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11ffaaca-8e16-49ff-a22c-d272eb802883 could not be found. Aug 10 23:32:55.912730 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:32:55.914898 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-ab753d19-df46-434e-a2e8-b2953d1b9e7e tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Returning 404 to user: Instance 11ffaaca-8e16-49ff-a22c-d272eb802883 could not be found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:32:55.915839 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-ab753d19-df46-434e-a2e8-b2953d1b9e7e tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] 10.222.0.58 "GET /compute/v2.1/servers/11ffaaca-8e16-49ff-a22c-d272eb802883" status: 404 len: 111 microversion: 2.1 time: 0.074506 Aug 10 23:32:55.920534 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2853/5911] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:32:55 2022] GET /compute/v2.1/servers/11ffaaca-8e16-49ff-a22c-d272eb802883 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:32:55.926021 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-761e87e8-0aee-4179-804c-9986033561f1 tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:32:55.932951 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-761e87e8-0aee-4179-804c-9986033561f1 tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] HTTP exception thrown: Instance group 0b2fce71-151b-415b-9b21-743cbcf2856e could not be found. Aug 10 23:32:55.936211 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-761e87e8-0aee-4179-804c-9986033561f1 tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Request method failure captured: Aug 10 23:32:55.936211 n-d-850468-14 devstack@n-api.service[122633]: request: DELETE /compute/v2.1/os-server-groups/0b2fce71-151b-415b-9b21-743cbcf2856e HTTP/1.1 Aug 10 23:32:55.936211 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:32:55.936211 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:32:55.936211 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:32:55.936211 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:32:55.936211 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:32:55.936211 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:32:55.936211 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:32:55.936211 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:32:55.936211 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9EAVJrqF7wx_1RumcuhyLTbBWSRMK8HVUvJPa9H4Kgc0f0jJ1u9rHtXfMrcR1X2K5SKsjA3FWDaBLoR0C7unEWpJiV8o0jwCM8vb-7mXgDwWmkwyvuSgTWq7XHB-17v99D_fsvOEVb0nzkAIiQVNbQr9hdqsHfvWk_xmJzdhBz_TIvs Aug 10 23:32:55.936211 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:32:55.936211 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:32:55.936211 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:32:55.936211 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:32:55.936211 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:32:55.936211 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:32:55.936211 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 2aa5f961963f4833b8fc593b200e7f58 Aug 10 23:32:55.936211 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-ServerGroupTestJSON-1222891098 Aug 10 23:32:55.936211 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:32:55.936211 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:32:55.936211 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2aa5f961963f4833b8fc593b200e7f58"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2aa5f961963f4833b8fc593b200e7f58"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2aa5f961963f4833b8fc593b200e7f58"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2aa5f961963f4833b8fc593b200e7f58", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:32:55.936211 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-ServerGroupTestJSON-1222891098 Aug 10 23:32:55.936211 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 2aa5f961963f4833b8fc593b200e7f58 Aug 10 23:32:55.936211 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-ServerGroupTestJSON-1222891098 Aug 10 23:32:55.936211 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-ServerGroupTestJSON-1222891098-project Aug 10 23:32:55.936211 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:32:55.936211 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:32:55.936211 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 0f947f2c1c9d45fcacfde1d382fc3b58 Aug 10 23:32:55.936211 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-ServerGroupTestJSON-1222891098-project Aug 10 23:32:55.936211 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:32:55.936211 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance group 0b2fce71-151b-415b-9b21-743cbcf2856e could not be found. Aug 10 23:32:55.936211 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': '0b2fce71-151b-415b-9b21-743cbcf2856e'} Aug 10 23:32:55.936211 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:32:55.936211 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:32:55.936211 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 10 23:32:55.936211 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 10 23:32:55.936211 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 10 23:32:55.936211 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 10 23:32:55.936211 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 10 23:32:55.936211 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 10 23:32:55.936211 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 10 23:32:55.936211 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 10 23:32:55.936211 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 10 23:32:55.936211 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 10 23:32:55.936211 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 0b2fce71-151b-415b-9b21-743cbcf2856e could not be found. Aug 10 23:32:55.936211 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:32:55.936211 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:32:55.936211 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:32:55.936211 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:32:55.936211 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:32:55.936211 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:32:55.936211 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:32:55.936211 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:32:55.936211 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:32:55.936211 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:32:55.936211 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 10 23:32:55.936211 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:32:55.936211 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 0b2fce71-151b-415b-9b21-743cbcf2856e could not be found. Aug 10 23:32:55.936211 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:32:55.936211 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:32:55.936211 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:32:55.936211 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:32:55.939555 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:32:55.939555 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:32:55.939555 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:32:55.939555 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:32:55.939555 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 0b2fce71-151b-415b-9b21-743cbcf2856e could not be found. Aug 10 23:32:55.939555 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:32:55.940914 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-761e87e8-0aee-4179-804c-9986033561f1 tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Returning 404 to user: Instance group 0b2fce71-151b-415b-9b21-743cbcf2856e could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:32:55.942201 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-761e87e8-0aee-4179-804c-9986033561f1 tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] 10.222.0.58 "DELETE /compute/v2.1/os-server-groups/0b2fce71-151b-415b-9b21-743cbcf2856e" status: 404 len: 117 microversion: 2.1 time: 0.020009 Aug 10 23:32:55.943254 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3059/5912] 10.222.0.58 () {58 vars in 1266 bytes} [Wed Aug 10 23:32:55 2022] DELETE /compute/v2.1/os-server-groups/0b2fce71-151b-415b-9b21-743cbcf2856e => generated 117 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:32:55.951915 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-925a2cc6-38b3-4140-b380-23c2440b8d83 tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:32:55.959333 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-925a2cc6-38b3-4140-b380-23c2440b8d83 tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] HTTP exception thrown: Instance group d2a2aa89-9bca-4fb5-a32e-b4c56a9a8bc6 could not be found. Aug 10 23:32:55.963258 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-925a2cc6-38b3-4140-b380-23c2440b8d83 tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Request method failure captured: Aug 10 23:32:55.963258 n-d-850468-14 devstack@n-api.service[122632]: request: DELETE /compute/v2.1/os-server-groups/d2a2aa89-9bca-4fb5-a32e-b4c56a9a8bc6 HTTP/1.1 Aug 10 23:32:55.963258 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:32:55.963258 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:32:55.963258 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:32:55.963258 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 23:32:55.963258 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:32:55.963258 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:32:55.963258 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:32:55.963258 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:32:55.963258 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9EAVJrqF7wx_1RumcuhyLTbBWSRMK8HVUvJPa9H4Kgc0f0jJ1u9rHtXfMrcR1X2K5SKsjA3FWDaBLoR0C7unEWpJiV8o0jwCM8vb-7mXgDwWmkwyvuSgTWq7XHB-17v99D_fsvOEVb0nzkAIiQVNbQr9hdqsHfvWk_xmJzdhBz_TIvs Aug 10 23:32:55.963258 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:32:55.963258 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:32:55.963258 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:32:55.963258 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:32:55.963258 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:32:55.963258 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:32:55.963258 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 2aa5f961963f4833b8fc593b200e7f58 Aug 10 23:32:55.963258 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-ServerGroupTestJSON-1222891098 Aug 10 23:32:55.963258 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:32:55.963258 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:32:55.963258 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2aa5f961963f4833b8fc593b200e7f58"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2aa5f961963f4833b8fc593b200e7f58"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2aa5f961963f4833b8fc593b200e7f58"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2aa5f961963f4833b8fc593b200e7f58", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:32:55.963258 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-ServerGroupTestJSON-1222891098 Aug 10 23:32:55.963258 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 2aa5f961963f4833b8fc593b200e7f58 Aug 10 23:32:55.963258 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-ServerGroupTestJSON-1222891098 Aug 10 23:32:55.963258 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-ServerGroupTestJSON-1222891098-project Aug 10 23:32:55.963258 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:32:55.963258 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:32:55.963258 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: 0f947f2c1c9d45fcacfde1d382fc3b58 Aug 10 23:32:55.963258 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-ServerGroupTestJSON-1222891098-project Aug 10 23:32:55.963258 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:32:55.963258 n-d-850468-14 devstack@n-api.service[122632]: exception: Instance group d2a2aa89-9bca-4fb5-a32e-b4c56a9a8bc6 could not be found. Aug 10 23:32:55.963258 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': 'd2a2aa89-9bca-4fb5-a32e-b4c56a9a8bc6'} Aug 10 23:32:55.963258 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:32:55.963258 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:32:55.963258 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 10 23:32:55.963258 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 10 23:32:55.963258 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 10 23:32:55.963258 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 10 23:32:55.963258 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 10 23:32:55.963258 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 10 23:32:55.963258 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 10 23:32:55.963258 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 10 23:32:55.963258 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 10 23:32:55.963258 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 10 23:32:55.963258 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group d2a2aa89-9bca-4fb5-a32e-b4c56a9a8bc6 could not be found. Aug 10 23:32:55.963258 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:32:55.963258 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:32:55.963258 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:32:55.963258 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:32:55.963258 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:32:55.963258 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:32:55.963258 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:32:55.963258 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:32:55.963258 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:32:55.963258 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:32:55.963258 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 10 23:32:55.963258 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:32:55.963258 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group d2a2aa89-9bca-4fb5-a32e-b4c56a9a8bc6 could not be found. Aug 10 23:32:55.963258 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:32:55.963258 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:32:55.963258 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:32:55.963258 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:32:55.967567 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:32:55.967567 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:32:55.967567 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:32:55.967567 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:32:55.967567 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group d2a2aa89-9bca-4fb5-a32e-b4c56a9a8bc6 could not be found. Aug 10 23:32:55.967567 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:32:55.967567 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-925a2cc6-38b3-4140-b380-23c2440b8d83 tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Returning 404 to user: Instance group d2a2aa89-9bca-4fb5-a32e-b4c56a9a8bc6 could not be found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:32:55.967567 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-925a2cc6-38b3-4140-b380-23c2440b8d83 tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] 10.222.0.58 "DELETE /compute/v2.1/os-server-groups/d2a2aa89-9bca-4fb5-a32e-b4c56a9a8bc6" status: 404 len: 117 microversion: 2.1 time: 0.017045 Aug 10 23:32:55.969684 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2854/5913] 10.222.0.58 () {58 vars in 1266 bytes} [Wed Aug 10 23:32:55 2022] DELETE /compute/v2.1/os-server-groups/d2a2aa89-9bca-4fb5-a32e-b4c56a9a8bc6 => generated 117 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:32:55.973980 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-426191ed-81d8-4883-bf7d-841c82d58038 tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:32:55.981966 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-426191ed-81d8-4883-bf7d-841c82d58038 tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] HTTP exception thrown: Instance group 8c349eb0-8a12-4c9f-b281-3720f0df6e95 could not be found. Aug 10 23:32:55.984835 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-426191ed-81d8-4883-bf7d-841c82d58038 tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Request method failure captured: Aug 10 23:32:55.984835 n-d-850468-14 devstack@n-api.service[122633]: request: DELETE /compute/v2.1/os-server-groups/8c349eb0-8a12-4c9f-b281-3720f0df6e95 HTTP/1.1 Aug 10 23:32:55.984835 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:32:55.984835 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:32:55.984835 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:32:55.984835 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:32:55.984835 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:32:55.984835 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:32:55.984835 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:32:55.984835 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:32:55.984835 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9EAVJrqF7wx_1RumcuhyLTbBWSRMK8HVUvJPa9H4Kgc0f0jJ1u9rHtXfMrcR1X2K5SKsjA3FWDaBLoR0C7unEWpJiV8o0jwCM8vb-7mXgDwWmkwyvuSgTWq7XHB-17v99D_fsvOEVb0nzkAIiQVNbQr9hdqsHfvWk_xmJzdhBz_TIvs Aug 10 23:32:55.984835 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:32:55.984835 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:32:55.984835 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:32:55.984835 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:32:55.984835 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:32:55.984835 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:32:55.984835 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 2aa5f961963f4833b8fc593b200e7f58 Aug 10 23:32:55.984835 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-ServerGroupTestJSON-1222891098 Aug 10 23:32:55.984835 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:32:55.984835 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:32:55.984835 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2aa5f961963f4833b8fc593b200e7f58"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2aa5f961963f4833b8fc593b200e7f58"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2aa5f961963f4833b8fc593b200e7f58"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2aa5f961963f4833b8fc593b200e7f58", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:32:55.984835 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-ServerGroupTestJSON-1222891098 Aug 10 23:32:55.984835 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 2aa5f961963f4833b8fc593b200e7f58 Aug 10 23:32:55.984835 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-ServerGroupTestJSON-1222891098 Aug 10 23:32:55.984835 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-ServerGroupTestJSON-1222891098-project Aug 10 23:32:55.984835 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:32:55.984835 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:32:55.984835 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 0f947f2c1c9d45fcacfde1d382fc3b58 Aug 10 23:32:55.984835 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-ServerGroupTestJSON-1222891098-project Aug 10 23:32:55.984835 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:32:55.984835 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance group 8c349eb0-8a12-4c9f-b281-3720f0df6e95 could not be found. Aug 10 23:32:55.984835 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': '8c349eb0-8a12-4c9f-b281-3720f0df6e95'} Aug 10 23:32:55.984835 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:32:55.984835 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:32:55.984835 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 10 23:32:55.984835 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 10 23:32:55.984835 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 10 23:32:55.984835 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 10 23:32:55.984835 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 10 23:32:55.984835 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 10 23:32:55.984835 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 10 23:32:55.984835 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 10 23:32:55.984835 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 10 23:32:55.984835 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 10 23:32:55.984835 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 8c349eb0-8a12-4c9f-b281-3720f0df6e95 could not be found. Aug 10 23:32:55.984835 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:32:55.984835 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:32:55.984835 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:32:55.984835 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:32:55.984835 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:32:55.984835 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:32:55.984835 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:32:55.984835 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:32:55.984835 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:32:55.984835 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:32:55.984835 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 10 23:32:55.984835 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:32:55.984835 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 8c349eb0-8a12-4c9f-b281-3720f0df6e95 could not be found. Aug 10 23:32:55.984835 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:32:55.984835 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:32:55.984835 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:32:55.984835 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:32:55.988846 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:32:55.988846 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:32:55.988846 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:32:55.988846 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:32:55.988846 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 8c349eb0-8a12-4c9f-b281-3720f0df6e95 could not be found. Aug 10 23:32:55.988846 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:32:55.989896 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-426191ed-81d8-4883-bf7d-841c82d58038 tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Returning 404 to user: Instance group 8c349eb0-8a12-4c9f-b281-3720f0df6e95 could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:32:55.991522 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-426191ed-81d8-4883-bf7d-841c82d58038 tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] 10.222.0.58 "DELETE /compute/v2.1/os-server-groups/8c349eb0-8a12-4c9f-b281-3720f0df6e95" status: 404 len: 117 microversion: 2.1 time: 0.021102 Aug 10 23:32:55.992606 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3060/5914] 10.222.0.58 () {58 vars in 1266 bytes} [Wed Aug 10 23:32:55 2022] DELETE /compute/v2.1/os-server-groups/8c349eb0-8a12-4c9f-b281-3720f0df6e95 => generated 117 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:32:56.000967 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-5b65033f-c3bb-4b7d-8f54-fda6f30dc59e tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:32:56.012768 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-5b65033f-c3bb-4b7d-8f54-fda6f30dc59e tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] HTTP exception thrown: Instance group b6664f58-2750-4ff4-93a7-70d366ba255c could not be found. Aug 10 23:32:56.015286 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-5b65033f-c3bb-4b7d-8f54-fda6f30dc59e tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Request method failure captured: Aug 10 23:32:56.015286 n-d-850468-14 devstack@n-api.service[122632]: request: DELETE /compute/v2.1/os-server-groups/b6664f58-2750-4ff4-93a7-70d366ba255c HTTP/1.1 Aug 10 23:32:56.015286 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:32:56.015286 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:32:56.015286 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:32:56.015286 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 23:32:56.015286 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:32:56.015286 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:32:56.015286 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:32:56.015286 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:32:56.015286 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9EAVJrqF7wx_1RumcuhyLTbBWSRMK8HVUvJPa9H4Kgc0f0jJ1u9rHtXfMrcR1X2K5SKsjA3FWDaBLoR0C7unEWpJiV8o0jwCM8vb-7mXgDwWmkwyvuSgTWq7XHB-17v99D_fsvOEVb0nzkAIiQVNbQr9hdqsHfvWk_xmJzdhBz_TIvs Aug 10 23:32:56.015286 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:32:56.015286 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:32:56.015286 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:32:56.015286 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:32:56.015286 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:32:56.015286 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:32:56.015286 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 2aa5f961963f4833b8fc593b200e7f58 Aug 10 23:32:56.015286 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-ServerGroupTestJSON-1222891098 Aug 10 23:32:56.015286 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:32:56.015286 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:32:56.015286 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2aa5f961963f4833b8fc593b200e7f58"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2aa5f961963f4833b8fc593b200e7f58"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2aa5f961963f4833b8fc593b200e7f58"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2aa5f961963f4833b8fc593b200e7f58", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:32:56.015286 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-ServerGroupTestJSON-1222891098 Aug 10 23:32:56.015286 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 2aa5f961963f4833b8fc593b200e7f58 Aug 10 23:32:56.015286 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-ServerGroupTestJSON-1222891098 Aug 10 23:32:56.015286 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-ServerGroupTestJSON-1222891098-project Aug 10 23:32:56.015286 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:32:56.015286 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:32:56.015286 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: 0f947f2c1c9d45fcacfde1d382fc3b58 Aug 10 23:32:56.015286 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-ServerGroupTestJSON-1222891098-project Aug 10 23:32:56.015286 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:32:56.015286 n-d-850468-14 devstack@n-api.service[122632]: exception: Instance group b6664f58-2750-4ff4-93a7-70d366ba255c could not be found. Aug 10 23:32:56.015286 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': 'b6664f58-2750-4ff4-93a7-70d366ba255c'} Aug 10 23:32:56.015286 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:32:56.015286 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:32:56.015286 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 10 23:32:56.015286 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 10 23:32:56.015286 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 10 23:32:56.015286 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 10 23:32:56.015286 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 10 23:32:56.015286 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 10 23:32:56.015286 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 10 23:32:56.015286 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 10 23:32:56.015286 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 10 23:32:56.015286 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 10 23:32:56.015286 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group b6664f58-2750-4ff4-93a7-70d366ba255c could not be found. Aug 10 23:32:56.015286 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:32:56.015286 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:32:56.015286 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:32:56.015286 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:32:56.015286 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:32:56.015286 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:32:56.015286 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:32:56.015286 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:32:56.015286 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:32:56.015286 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:32:56.015286 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 10 23:32:56.015286 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:32:56.015286 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group b6664f58-2750-4ff4-93a7-70d366ba255c could not be found. Aug 10 23:32:56.015286 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:32:56.015286 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:32:56.015286 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:32:56.015286 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:32:56.018611 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:32:56.018611 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:32:56.018611 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:32:56.018611 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:32:56.018611 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group b6664f58-2750-4ff4-93a7-70d366ba255c could not be found. Aug 10 23:32:56.018611 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:32:56.018611 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-5b65033f-c3bb-4b7d-8f54-fda6f30dc59e tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Returning 404 to user: Instance group b6664f58-2750-4ff4-93a7-70d366ba255c could not be found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:32:56.018611 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-5b65033f-c3bb-4b7d-8f54-fda6f30dc59e tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] 10.222.0.58 "DELETE /compute/v2.1/os-server-groups/b6664f58-2750-4ff4-93a7-70d366ba255c" status: 404 len: 117 microversion: 2.1 time: 0.020122 Aug 10 23:32:56.021095 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2855/5915] 10.222.0.58 () {58 vars in 1266 bytes} [Wed Aug 10 23:32:55 2022] DELETE /compute/v2.1/os-server-groups/b6664f58-2750-4ff4-93a7-70d366ba255c => generated 117 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:32:56.026702 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-a9454ad1-e9ba-424e-ad91-cd39b528c60e tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:32:56.056138 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-a9454ad1-e9ba-424e-ad91-cd39b528c60e tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] 10.222.0.58 "DELETE /compute/v2.1/os-server-groups/e92a2e8b-ea1a-4e27-8cfb-91df4640a432" status: 204 len: 0 microversion: 2.1 time: 0.034115 Aug 10 23:32:56.057438 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3061/5916] 10.222.0.58 () {58 vars in 1266 bytes} [Wed Aug 10 23:32:56 2022] DELETE /compute/v2.1/os-server-groups/e92a2e8b-ea1a-4e27-8cfb-91df4640a432 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 10 23:33:02.250762 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-5b65033f-c3bb-4b7d-8f54-fda6f30dc59e tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:33:02.251783 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-5b65033f-c3bb-4b7d-8f54-fda6f30dc59e tempest-ServerGroupTestJSON-1222891098 tempest-ServerGroupTestJSON-1222891098-project] 10.222.0.58 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001358 Aug 10 23:33:02.259963 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2856/5917] 10.222.0.58 () {56 vars in 886 bytes} [Wed Aug 10 23:33:02 2022] GET /compute/ => generated 377 bytes in 10 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 10 23:33:04.503786 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-b7d22c57-056b-49a1-982d-ae01171b6acb tempest-ExtensionsTest-497431400 tempest-ExtensionsTest-497431400-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:33:04.505412 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-b7d22c57-056b-49a1-982d-ae01171b6acb tempest-ExtensionsTest-497431400 tempest-ExtensionsTest-497431400-project] 10.222.0.58 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.160173 Aug 10 23:33:04.505996 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3062/5918] 10.222.0.58 () {58 vars in 1170 bytes} [Wed Aug 10 23:33:04 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:33:04.517043 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-a6a47649-9510-4063-8e44-286dd6437651 tempest-ExtensionsTest-497431400 tempest-ExtensionsTest-497431400-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:33:04.520026 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-a6a47649-9510-4063-8e44-286dd6437651 tempest-ExtensionsTest-497431400 tempest-ExtensionsTest-497431400-project] 10.222.0.58 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.006682 Aug 10 23:33:04.531998 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2857/5919] 10.222.0.58 () {58 vars in 1134 bytes} [Wed Aug 10 23:33:04 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 10 23:33:49.334384 n-d-850468-14 devstack@n-api.service[122632]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 23:33:49.335112 n-d-850468-14 devstack@n-api.service[122632]: Wed Aug 10 23:33:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 23:34:29.081796 n-d-850468-14 devstack@n-api.service[122633]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5e7530cb-e34a-4714-9391-5480d11af743] AMQP server on 10.222.0.58:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 10 23:34:29.082912 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=48 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:34:29.086458 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=1,nova_api:DELETE=3 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:34:29.093021 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c63bc3b6-c01c-40ed-8140-5bc6b8c12a8c tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Action: 'create', calling method: .version_select at 0x7f847c46e8b0>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-1418156268", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEkftlpRSoQToCzgwOPcPEZ2twuyluMrpr32YkOwHNywyk2KcKEmjEAGSvrzFZcetCkm9+dkXnseR5ZpEjR7nVutSoVcCHX0kmD9n1/MjV9jpWzjaSjDaHkoh/QzNV31qw=="}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:34:29.115257 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-c63bc3b6-c01c-40ed-8140-5bc6b8c12a8c tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Getting quotas for project 7d55b00e4b4145b8848962f553bcca66. Resources: {'key_pairs'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:34:29.124218 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-c63bc3b6-c01c-40ed-8140-5bc6b8c12a8c tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Getting quotas for user 7700b1afaaa64b809280b518324724de and project 7d55b00e4b4145b8848962f553bcca66. Resources: {'key_pairs'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:34:29.154962 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-c63bc3b6-c01c-40ed-8140-5bc6b8c12a8c tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.076023 Aug 10 23:34:29.161588 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3063/5920] 10.222.0.58 () {60 vars in 1159 bytes} [Wed Aug 10 23:34:29 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:34:31.743421 n-d-850468-14 devstack@n-api.service[122632]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cd3f72be-c5dc-40c0-bc95-e9b4d1b700e4] AMQP server on 10.222.0.58:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 10 23:34:31.744039 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:34:31.746673 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:34:31.756279 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-67417b9f-6e2f-444b-87df-27e221509802 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-462650412", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "9ddc63c9-64a0-4e53-8f43-e4f552d42044", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-1418156268", "security_groups": [{"name": "tempest-secgroup-smoke-1205535914"}], "networks": [{"uuid": "b4642311-1a5b-4a3c-8f2f-f335df3bdaf2"}]}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:34:32.331500 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.network.neutron [None req-67417b9f-6e2f-444b-87df-27e221509802 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] validate_networks() for [('b4642311-1a5b-4a3c-8f2f-f335df3bdaf2', None, None, None, None, None)] {{(pid=122632) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 23:34:32.773739 n-d-850468-14 devstack@n-api.service[122632]: INFO oslo.messaging._drivers.impl_rabbit [-] [cd3f72be-c5dc-40c0-bc95-e9b4d1b700e4] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 56064. Aug 10 23:34:33.926810 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-67417b9f-6e2f-444b-87df-27e221509802 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Flavor limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:34:33.928852 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-67417b9f-6e2f-444b-87df-27e221509802 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Image limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:34:33.929747 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-67417b9f-6e2f-444b-87df-27e221509802 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Flavor pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:34:33.930499 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-67417b9f-6e2f-444b-87df-27e221509802 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Image pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:34:33.931365 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-67417b9f-6e2f-444b-87df-27e221509802 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:34:33.947237 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-67417b9f-6e2f-444b-87df-27e221509802 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:34:33.955276 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-67417b9f-6e2f-444b-87df-27e221509802 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:34:33.955971 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-67417b9f-6e2f-444b-87df-27e221509802 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:34:33.960094 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-67417b9f-6e2f-444b-87df-27e221509802 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:34:33.960757 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-67417b9f-6e2f-444b-87df-27e221509802 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:34:33.961340 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-67417b9f-6e2f-444b-87df-27e221509802 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:34:33.995809 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-67417b9f-6e2f-444b-87df-27e221509802 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Getting quotas for project 7d55b00e4b4145b8848962f553bcca66. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:34:34.008001 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-67417b9f-6e2f-444b-87df-27e221509802 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Getting quotas for user 7700b1afaaa64b809280b518324724de and project 7d55b00e4b4145b8848962f553bcca66. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:34:34.159088 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-67417b9f-6e2f-444b-87df-27e221509802 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Going to run 1 instances... {{(pid=122632) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 23:34:34.161329 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-67417b9f-6e2f-444b-87df-27e221509802 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] [instance: f1ef4c7d-37a6-4864-8cc4-953bd9b03ff9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9ddc63c9-64a0-4e53-8f43-e4f552d42044',volume_size=None,volume_type=None)] {{(pid=122632) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 23:34:34.425787 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-67417b9f-6e2f-444b-87df-27e221509802 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.678020 Aug 10 23:34:34.426906 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2858/5921] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 23:34:31 2022] POST /compute/v2.1/servers => generated 406 bytes in 2687 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 23:34:34.444338 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-88bd7930-e6f3-4914-861d-e1b3d74d382e tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:34:34.445937 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-88bd7930-e6f3-4914-861d-e1b3d74d382e tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] [instance: f1ef4c7d-37a6-4864-8cc4-953bd9b03ff9] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:34:34.465231 n-d-850468-14 devstack@n-api.service[122633]: INFO oslo.messaging._drivers.impl_rabbit [-] [5e7530cb-e34a-4714-9391-5480d11af743] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 56126. Aug 10 23:34:34.541284 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-88bd7930-e6f3-4914-861d-e1b3d74d382e tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7700b1afaaa64b809280b518324724de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d55b00e4b4145b8848962f553bcca66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:34:34.551999 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-88bd7930-e6f3-4914-861d-e1b3d74d382e tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] 10.222.0.58 "GET /compute/v2.1/servers/f1ef4c7d-37a6-4864-8cc4-953bd9b03ff9" status: 200 len: 1098 microversion: 2.1 time: 0.115247 Aug 10 23:34:34.552915 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3064/5922] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:34:34 2022] GET /compute/v2.1/servers/f1ef4c7d-37a6-4864-8cc4-953bd9b03ff9 => generated 1098 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:34:35.576522 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-720f74d8-cdc5-44e6-91bb-91e6bac4e9e0 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:34:35.577489 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-720f74d8-cdc5-44e6-91bb-91e6bac4e9e0 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] [instance: f1ef4c7d-37a6-4864-8cc4-953bd9b03ff9] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:34:35.588719 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-720f74d8-cdc5-44e6-91bb-91e6bac4e9e0 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:34:35.589272 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-720f74d8-cdc5-44e6-91bb-91e6bac4e9e0 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:34:35.589937 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-720f74d8-cdc5-44e6-91bb-91e6bac4e9e0 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:34:35.591608 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-720f74d8-cdc5-44e6-91bb-91e6bac4e9e0 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:34:35.592074 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-720f74d8-cdc5-44e6-91bb-91e6bac4e9e0 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:34:35.592561 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-720f74d8-cdc5-44e6-91bb-91e6bac4e9e0 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:34:35.710302 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-720f74d8-cdc5-44e6-91bb-91e6bac4e9e0 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7700b1afaaa64b809280b518324724de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d55b00e4b4145b8848962f553bcca66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:34:35.723174 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-720f74d8-cdc5-44e6-91bb-91e6bac4e9e0 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] 10.222.0.58 "GET /compute/v2.1/servers/f1ef4c7d-37a6-4864-8cc4-953bd9b03ff9" status: 200 len: 1148 microversion: 2.1 time: 0.153641 Aug 10 23:34:35.726531 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2859/5923] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:34:35 2022] GET /compute/v2.1/servers/f1ef4c7d-37a6-4864-8cc4-953bd9b03ff9 => generated 1148 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:34:36.744905 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-f2101ced-d7e6-44ea-8fab-ede178861e3b tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:34:36.746190 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-f2101ced-d7e6-44ea-8fab-ede178861e3b tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] [instance: f1ef4c7d-37a6-4864-8cc4-953bd9b03ff9] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:34:36.760559 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f2101ced-d7e6-44ea-8fab-ede178861e3b tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:34:36.761330 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f2101ced-d7e6-44ea-8fab-ede178861e3b tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:34:36.763752 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f2101ced-d7e6-44ea-8fab-ede178861e3b tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:34:36.764612 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f2101ced-d7e6-44ea-8fab-ede178861e3b tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:34:36.765095 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f2101ced-d7e6-44ea-8fab-ede178861e3b tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:34:36.765553 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f2101ced-d7e6-44ea-8fab-ede178861e3b tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:34:36.918055 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-f2101ced-d7e6-44ea-8fab-ede178861e3b tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7700b1afaaa64b809280b518324724de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d55b00e4b4145b8848962f553bcca66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:34:36.931166 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-f2101ced-d7e6-44ea-8fab-ede178861e3b tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] 10.222.0.58 "GET /compute/v2.1/servers/f1ef4c7d-37a6-4864-8cc4-953bd9b03ff9" status: 200 len: 1214 microversion: 2.1 time: 0.186330 Aug 10 23:34:36.934565 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3065/5924] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:34:36 2022] GET /compute/v2.1/servers/f1ef4c7d-37a6-4864-8cc4-953bd9b03ff9 => generated 1214 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:34:37.955992 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-1d925c9f-56ab-4c46-92cf-306a492269a9 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:34:37.956627 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-1d925c9f-56ab-4c46-92cf-306a492269a9 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] [instance: f1ef4c7d-37a6-4864-8cc4-953bd9b03ff9] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:34:37.970217 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1d925c9f-56ab-4c46-92cf-306a492269a9 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:34:37.970870 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1d925c9f-56ab-4c46-92cf-306a492269a9 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:34:37.971280 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1d925c9f-56ab-4c46-92cf-306a492269a9 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:34:37.985260 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1d925c9f-56ab-4c46-92cf-306a492269a9 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:34:37.986117 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1d925c9f-56ab-4c46-92cf-306a492269a9 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:34:37.988470 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1d925c9f-56ab-4c46-92cf-306a492269a9 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:34:38.179768 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-1d925c9f-56ab-4c46-92cf-306a492269a9 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7700b1afaaa64b809280b518324724de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d55b00e4b4145b8848962f553bcca66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:34:38.193809 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-1d925c9f-56ab-4c46-92cf-306a492269a9 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] 10.222.0.58 "GET /compute/v2.1/servers/f1ef4c7d-37a6-4864-8cc4-953bd9b03ff9" status: 200 len: 1214 microversion: 2.1 time: 0.243493 Aug 10 23:34:38.207634 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2860/5925] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:34:37 2022] GET /compute/v2.1/servers/f1ef4c7d-37a6-4864-8cc4-953bd9b03ff9 => generated 1214 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:34:39.235190 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-ca9386c6-e032-41c1-843f-0c42383234bd tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:34:39.235813 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-ca9386c6-e032-41c1-843f-0c42383234bd tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] [instance: f1ef4c7d-37a6-4864-8cc4-953bd9b03ff9] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:34:39.247028 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ca9386c6-e032-41c1-843f-0c42383234bd tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:34:39.251437 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ca9386c6-e032-41c1-843f-0c42383234bd tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:34:39.252064 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ca9386c6-e032-41c1-843f-0c42383234bd tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:34:39.252961 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ca9386c6-e032-41c1-843f-0c42383234bd tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:34:39.255482 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ca9386c6-e032-41c1-843f-0c42383234bd tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:34:39.256128 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ca9386c6-e032-41c1-843f-0c42383234bd tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:34:39.600694 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-ca9386c6-e032-41c1-843f-0c42383234bd tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7700b1afaaa64b809280b518324724de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d55b00e4b4145b8848962f553bcca66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:34:39.615291 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-ca9386c6-e032-41c1-843f-0c42383234bd tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] 10.222.0.58 "GET /compute/v2.1/servers/f1ef4c7d-37a6-4864-8cc4-953bd9b03ff9" status: 200 len: 1282 microversion: 2.1 time: 0.385525 Aug 10 23:34:39.615896 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3066/5926] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:34:39 2022] GET /compute/v2.1/servers/f1ef4c7d-37a6-4864-8cc4-953bd9b03ff9 => generated 1282 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:34:40.269645 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-2e51e4fc-13c4-4a01-b787-b7b3af48ff70 req-1002adc3-5122-4bb1-93d3-1d9fb56bd9d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1ef4c7d-37a6-4864-8cc4-953bd9b03ff9", "tag": "4fb7fde8-d66e-4195-8dcd-9f374af24de9"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:34:40.287380 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-2e51e4fc-13c4-4a01-b787-b7b3af48ff70 req-1002adc3-5122-4bb1-93d3-1d9fb56bd9d4 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:34:40.288910 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-2e51e4fc-13c4-4a01-b787-b7b3af48ff70 req-1002adc3-5122-4bb1-93d3-1d9fb56bd9d4 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:34:40.290127 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-2e51e4fc-13c4-4a01-b787-b7b3af48ff70 req-1002adc3-5122-4bb1-93d3-1d9fb56bd9d4 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:34:40.322849 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-2e51e4fc-13c4-4a01-b787-b7b3af48ff70 req-1002adc3-5122-4bb1-93d3-1d9fb56bd9d4 service nova] Creating event network-changed:4fb7fde8-d66e-4195-8dcd-9f374af24de9 for instance f1ef4c7d-37a6-4864-8cc4-953bd9b03ff9 on n-h1-850468-14 Aug 10 23:34:40.333524 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-2e51e4fc-13c4-4a01-b787-b7b3af48ff70 req-1002adc3-5122-4bb1-93d3-1d9fb56bd9d4 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.389506 Aug 10 23:34:40.340468 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2861/5927] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:34:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:34:40.638336 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-d51bd090-885e-4a4c-99a5-ee898521aed0 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:34:40.638988 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-d51bd090-885e-4a4c-99a5-ee898521aed0 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] [instance: f1ef4c7d-37a6-4864-8cc4-953bd9b03ff9] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:34:40.652392 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d51bd090-885e-4a4c-99a5-ee898521aed0 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:34:40.653152 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d51bd090-885e-4a4c-99a5-ee898521aed0 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:34:40.655816 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d51bd090-885e-4a4c-99a5-ee898521aed0 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:34:40.656116 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d51bd090-885e-4a4c-99a5-ee898521aed0 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:34:40.656587 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d51bd090-885e-4a4c-99a5-ee898521aed0 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:34:40.657017 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d51bd090-885e-4a4c-99a5-ee898521aed0 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:34:41.233920 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-d51bd090-885e-4a4c-99a5-ee898521aed0 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7700b1afaaa64b809280b518324724de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d55b00e4b4145b8848962f553bcca66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:34:41.244872 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-d51bd090-885e-4a4c-99a5-ee898521aed0 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] 10.222.0.58 "GET /compute/v2.1/servers/f1ef4c7d-37a6-4864-8cc4-953bd9b03ff9" status: 200 len: 1282 microversion: 2.1 time: 0.611248 Aug 10 23:34:41.262630 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3067/5928] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:34:40 2022] GET /compute/v2.1/servers/f1ef4c7d-37a6-4864-8cc4-953bd9b03ff9 => generated 1282 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:34:42.273566 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-65dca53b-ce52-4f04-860c-2460cc1ab2be tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:34:42.274289 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-65dca53b-ce52-4f04-860c-2460cc1ab2be tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] [instance: f1ef4c7d-37a6-4864-8cc4-953bd9b03ff9] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:34:42.283530 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-65dca53b-ce52-4f04-860c-2460cc1ab2be tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:34:42.284255 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-65dca53b-ce52-4f04-860c-2460cc1ab2be tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:34:42.284858 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-65dca53b-ce52-4f04-860c-2460cc1ab2be tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:34:42.286117 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-65dca53b-ce52-4f04-860c-2460cc1ab2be tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:34:42.286731 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-65dca53b-ce52-4f04-860c-2460cc1ab2be tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:34:42.287355 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-65dca53b-ce52-4f04-860c-2460cc1ab2be tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:34:42.565700 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-65dca53b-ce52-4f04-860c-2460cc1ab2be tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7700b1afaaa64b809280b518324724de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d55b00e4b4145b8848962f553bcca66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:34:42.574955 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-65dca53b-ce52-4f04-860c-2460cc1ab2be tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] 10.222.0.58 "GET /compute/v2.1/servers/f1ef4c7d-37a6-4864-8cc4-953bd9b03ff9" status: 200 len: 1282 microversion: 2.1 time: 0.307553 Aug 10 23:34:42.583121 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2862/5929] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:34:42 2022] GET /compute/v2.1/servers/f1ef4c7d-37a6-4864-8cc4-953bd9b03ff9 => generated 1282 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:34:43.598225 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-6cc47477-743e-4f4c-a73a-abd86cf763c3 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:34:43.599615 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-6cc47477-743e-4f4c-a73a-abd86cf763c3 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] [instance: f1ef4c7d-37a6-4864-8cc4-953bd9b03ff9] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:34:43.613726 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6cc47477-743e-4f4c-a73a-abd86cf763c3 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:34:43.614408 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6cc47477-743e-4f4c-a73a-abd86cf763c3 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:34:43.616352 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6cc47477-743e-4f4c-a73a-abd86cf763c3 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:34:43.617235 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6cc47477-743e-4f4c-a73a-abd86cf763c3 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:34:43.617867 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6cc47477-743e-4f4c-a73a-abd86cf763c3 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:34:43.619434 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6cc47477-743e-4f4c-a73a-abd86cf763c3 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:34:44.467149 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-6cc47477-743e-4f4c-a73a-abd86cf763c3 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7700b1afaaa64b809280b518324724de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d55b00e4b4145b8848962f553bcca66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:34:44.481568 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-6cc47477-743e-4f4c-a73a-abd86cf763c3 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] 10.222.0.58 "GET /compute/v2.1/servers/f1ef4c7d-37a6-4864-8cc4-953bd9b03ff9" status: 200 len: 1282 microversion: 2.1 time: 0.886239 Aug 10 23:34:44.482956 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3068/5930] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:34:43 2022] GET /compute/v2.1/servers/f1ef4c7d-37a6-4864-8cc4-953bd9b03ff9 => generated 1282 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:34:45.509422 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-b9f108f4-99ea-4a3c-862a-1c40139fd692 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:34:45.510044 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-b9f108f4-99ea-4a3c-862a-1c40139fd692 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] [instance: f1ef4c7d-37a6-4864-8cc4-953bd9b03ff9] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:34:45.531737 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=2 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:34:45.532949 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=6 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:34:45.537713 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b9f108f4-99ea-4a3c-862a-1c40139fd692 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:34:45.541109 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b9f108f4-99ea-4a3c-862a-1c40139fd692 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:34:45.541794 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b9f108f4-99ea-4a3c-862a-1c40139fd692 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:34:45.548531 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b9f108f4-99ea-4a3c-862a-1c40139fd692 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:34:45.549370 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b9f108f4-99ea-4a3c-862a-1c40139fd692 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:34:45.549835 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b9f108f4-99ea-4a3c-862a-1c40139fd692 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:34:46.067621 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-b9f108f4-99ea-4a3c-862a-1c40139fd692 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7700b1afaaa64b809280b518324724de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d55b00e4b4145b8848962f553bcca66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:34:46.076826 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-b9f108f4-99ea-4a3c-862a-1c40139fd692 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] 10.222.0.58 "GET /compute/v2.1/servers/f1ef4c7d-37a6-4864-8cc4-953bd9b03ff9" status: 200 len: 1270 microversion: 2.1 time: 0.571683 Aug 10 23:34:46.077685 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2863/5931] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:34:45 2022] GET /compute/v2.1/servers/f1ef4c7d-37a6-4864-8cc4-953bd9b03ff9 => generated 1270 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:34:47.098815 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-fa54109c-2078-457d-bbe2-91259135bdc1 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:34:47.100124 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-fa54109c-2078-457d-bbe2-91259135bdc1 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] [instance: f1ef4c7d-37a6-4864-8cc4-953bd9b03ff9] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:34:47.102612 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=6 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:34:47.123096 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fa54109c-2078-457d-bbe2-91259135bdc1 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:34:47.123523 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fa54109c-2078-457d-bbe2-91259135bdc1 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:34:47.123970 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fa54109c-2078-457d-bbe2-91259135bdc1 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:34:47.124702 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fa54109c-2078-457d-bbe2-91259135bdc1 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:34:47.125162 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fa54109c-2078-457d-bbe2-91259135bdc1 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:34:47.125596 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fa54109c-2078-457d-bbe2-91259135bdc1 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:34:47.398588 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-fa54109c-2078-457d-bbe2-91259135bdc1 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7700b1afaaa64b809280b518324724de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d55b00e4b4145b8848962f553bcca66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:34:47.411098 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-fa54109c-2078-457d-bbe2-91259135bdc1 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] 10.222.0.58 "GET /compute/v2.1/servers/f1ef4c7d-37a6-4864-8cc4-953bd9b03ff9" status: 200 len: 1270 microversion: 2.1 time: 0.316123 Aug 10 23:34:47.411896 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3069/5932] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:34:47 2022] GET /compute/v2.1/servers/f1ef4c7d-37a6-4864-8cc4-953bd9b03ff9 => generated 1270 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:34:48.436021 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-3fc0274a-5c41-4cac-a5c3-2c090bf80d80 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:34:48.436667 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-3fc0274a-5c41-4cac-a5c3-2c090bf80d80 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] [instance: f1ef4c7d-37a6-4864-8cc4-953bd9b03ff9] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:34:48.454130 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3fc0274a-5c41-4cac-a5c3-2c090bf80d80 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:34:48.454885 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3fc0274a-5c41-4cac-a5c3-2c090bf80d80 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:34:48.459713 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3fc0274a-5c41-4cac-a5c3-2c090bf80d80 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:34:48.465733 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3fc0274a-5c41-4cac-a5c3-2c090bf80d80 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:34:48.466188 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3fc0274a-5c41-4cac-a5c3-2c090bf80d80 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:34:48.466635 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3fc0274a-5c41-4cac-a5c3-2c090bf80d80 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:34:48.722530 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-3fc0274a-5c41-4cac-a5c3-2c090bf80d80 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7700b1afaaa64b809280b518324724de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d55b00e4b4145b8848962f553bcca66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:34:48.739196 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-3fc0274a-5c41-4cac-a5c3-2c090bf80d80 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] 10.222.0.58 "GET /compute/v2.1/servers/f1ef4c7d-37a6-4864-8cc4-953bd9b03ff9" status: 200 len: 1270 microversion: 2.1 time: 0.308906 Aug 10 23:34:48.759209 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2864/5933] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:34:48 2022] GET /compute/v2.1/servers/f1ef4c7d-37a6-4864-8cc4-953bd9b03ff9 => generated 1270 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:34:49.762820 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-6b502a07-d496-40b7-b89d-8e604790d69e tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:34:49.763581 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-6b502a07-d496-40b7-b89d-8e604790d69e tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] [instance: f1ef4c7d-37a6-4864-8cc4-953bd9b03ff9] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:34:49.770832 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6b502a07-d496-40b7-b89d-8e604790d69e tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:34:49.772323 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6b502a07-d496-40b7-b89d-8e604790d69e tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:34:49.772950 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6b502a07-d496-40b7-b89d-8e604790d69e tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:34:49.773833 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6b502a07-d496-40b7-b89d-8e604790d69e tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:34:49.774443 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6b502a07-d496-40b7-b89d-8e604790d69e tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:34:49.775069 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6b502a07-d496-40b7-b89d-8e604790d69e tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:34:50.078730 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-6b502a07-d496-40b7-b89d-8e604790d69e tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7700b1afaaa64b809280b518324724de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d55b00e4b4145b8848962f553bcca66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:34:50.095813 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-6b502a07-d496-40b7-b89d-8e604790d69e tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] 10.222.0.58 "GET /compute/v2.1/servers/f1ef4c7d-37a6-4864-8cc4-953bd9b03ff9" status: 200 len: 1270 microversion: 2.1 time: 0.337691 Aug 10 23:34:50.101833 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3070/5934] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:34:49 2022] GET /compute/v2.1/servers/f1ef4c7d-37a6-4864-8cc4-953bd9b03ff9 => generated 1270 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:34:51.129697 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c1e538ec-b6aa-4fb2-8c1e-b7f8f69a2e4e tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:34:51.134931 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-c1e538ec-b6aa-4fb2-8c1e-b7f8f69a2e4e tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] [instance: f1ef4c7d-37a6-4864-8cc4-953bd9b03ff9] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:34:51.151457 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c1e538ec-b6aa-4fb2-8c1e-b7f8f69a2e4e tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:34:51.154974 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c1e538ec-b6aa-4fb2-8c1e-b7f8f69a2e4e tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:34:51.164559 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c1e538ec-b6aa-4fb2-8c1e-b7f8f69a2e4e tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:34:51.165911 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c1e538ec-b6aa-4fb2-8c1e-b7f8f69a2e4e tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:34:51.169610 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c1e538ec-b6aa-4fb2-8c1e-b7f8f69a2e4e tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:34:51.170244 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c1e538ec-b6aa-4fb2-8c1e-b7f8f69a2e4e tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:34:51.403560 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-c1e538ec-b6aa-4fb2-8c1e-b7f8f69a2e4e tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7700b1afaaa64b809280b518324724de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d55b00e4b4145b8848962f553bcca66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:34:51.412688 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-c1e538ec-b6aa-4fb2-8c1e-b7f8f69a2e4e tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] 10.222.0.58 "GET /compute/v2.1/servers/f1ef4c7d-37a6-4864-8cc4-953bd9b03ff9" status: 200 len: 1270 microversion: 2.1 time: 0.288547 Aug 10 23:34:51.427086 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2865/5935] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:34:51 2022] GET /compute/v2.1/servers/f1ef4c7d-37a6-4864-8cc4-953bd9b03ff9 => generated 1270 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:34:52.436242 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-5cc6576d-f301-4edb-a3fb-d93329f4f236 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:34:52.438397 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-5cc6576d-f301-4edb-a3fb-d93329f4f236 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] [instance: f1ef4c7d-37a6-4864-8cc4-953bd9b03ff9] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:34:52.455055 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5cc6576d-f301-4edb-a3fb-d93329f4f236 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:34:52.461615 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5cc6576d-f301-4edb-a3fb-d93329f4f236 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:34:52.466028 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5cc6576d-f301-4edb-a3fb-d93329f4f236 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:34:52.467047 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5cc6576d-f301-4edb-a3fb-d93329f4f236 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:34:52.467948 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5cc6576d-f301-4edb-a3fb-d93329f4f236 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:34:52.468715 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5cc6576d-f301-4edb-a3fb-d93329f4f236 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:34:52.779995 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-5cc6576d-f301-4edb-a3fb-d93329f4f236 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7700b1afaaa64b809280b518324724de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d55b00e4b4145b8848962f553bcca66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:34:52.788924 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-5cc6576d-f301-4edb-a3fb-d93329f4f236 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] 10.222.0.58 "GET /compute/v2.1/servers/f1ef4c7d-37a6-4864-8cc4-953bd9b03ff9" status: 200 len: 1270 microversion: 2.1 time: 0.358661 Aug 10 23:34:52.803285 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3071/5936] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:34:52 2022] GET /compute/v2.1/servers/f1ef4c7d-37a6-4864-8cc4-953bd9b03ff9 => generated 1270 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:34:53.811265 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-b0ce00ea-698f-42c2-bd7d-836be8ebff87 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:34:53.811841 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-b0ce00ea-698f-42c2-bd7d-836be8ebff87 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] [instance: f1ef4c7d-37a6-4864-8cc4-953bd9b03ff9] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:34:53.825459 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b0ce00ea-698f-42c2-bd7d-836be8ebff87 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:34:53.826013 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b0ce00ea-698f-42c2-bd7d-836be8ebff87 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:34:53.826469 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b0ce00ea-698f-42c2-bd7d-836be8ebff87 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:34:53.827340 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b0ce00ea-698f-42c2-bd7d-836be8ebff87 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:34:53.827838 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b0ce00ea-698f-42c2-bd7d-836be8ebff87 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:34:53.828274 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b0ce00ea-698f-42c2-bd7d-836be8ebff87 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:34:54.116038 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-b0ce00ea-698f-42c2-bd7d-836be8ebff87 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7700b1afaaa64b809280b518324724de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d55b00e4b4145b8848962f553bcca66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:34:54.129985 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-b0ce00ea-698f-42c2-bd7d-836be8ebff87 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] 10.222.0.58 "GET /compute/v2.1/servers/f1ef4c7d-37a6-4864-8cc4-953bd9b03ff9" status: 200 len: 1270 microversion: 2.1 time: 0.323230 Aug 10 23:34:54.144157 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2866/5937] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:34:53 2022] GET /compute/v2.1/servers/f1ef4c7d-37a6-4864-8cc4-953bd9b03ff9 => generated 1270 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:34:55.158598 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-2f55d470-0a5e-448c-82f8-e7b257bc94f5 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:34:55.162542 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-2f55d470-0a5e-448c-82f8-e7b257bc94f5 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] [instance: f1ef4c7d-37a6-4864-8cc4-953bd9b03ff9] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:34:55.180157 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2f55d470-0a5e-448c-82f8-e7b257bc94f5 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:34:55.182363 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2f55d470-0a5e-448c-82f8-e7b257bc94f5 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:34:55.183719 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2f55d470-0a5e-448c-82f8-e7b257bc94f5 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:34:55.186026 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2f55d470-0a5e-448c-82f8-e7b257bc94f5 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:34:55.186694 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2f55d470-0a5e-448c-82f8-e7b257bc94f5 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:34:55.187479 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2f55d470-0a5e-448c-82f8-e7b257bc94f5 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:34:55.432839 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-2f55d470-0a5e-448c-82f8-e7b257bc94f5 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7700b1afaaa64b809280b518324724de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d55b00e4b4145b8848962f553bcca66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:34:55.442845 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-2f55d470-0a5e-448c-82f8-e7b257bc94f5 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] 10.222.0.58 "GET /compute/v2.1/servers/f1ef4c7d-37a6-4864-8cc4-953bd9b03ff9" status: 200 len: 1270 microversion: 2.1 time: 0.291512 Aug 10 23:34:55.444018 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3072/5938] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:34:55 2022] GET /compute/v2.1/servers/f1ef4c7d-37a6-4864-8cc4-953bd9b03ff9 => generated 1270 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:34:56.469720 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-8cca4f82-3ac2-47b8-9cb8-b2fe5a3b8ef0 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:34:56.471039 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-8cca4f82-3ac2-47b8-9cb8-b2fe5a3b8ef0 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] [instance: f1ef4c7d-37a6-4864-8cc4-953bd9b03ff9] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:34:56.480277 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8cca4f82-3ac2-47b8-9cb8-b2fe5a3b8ef0 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:34:56.481103 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8cca4f82-3ac2-47b8-9cb8-b2fe5a3b8ef0 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:34:56.481808 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8cca4f82-3ac2-47b8-9cb8-b2fe5a3b8ef0 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:34:56.482770 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8cca4f82-3ac2-47b8-9cb8-b2fe5a3b8ef0 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:34:56.483439 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8cca4f82-3ac2-47b8-9cb8-b2fe5a3b8ef0 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:34:56.484059 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8cca4f82-3ac2-47b8-9cb8-b2fe5a3b8ef0 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:34:56.896903 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-8cca4f82-3ac2-47b8-9cb8-b2fe5a3b8ef0 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7700b1afaaa64b809280b518324724de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d55b00e4b4145b8848962f553bcca66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:34:56.906288 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-8cca4f82-3ac2-47b8-9cb8-b2fe5a3b8ef0 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] 10.222.0.58 "GET /compute/v2.1/servers/f1ef4c7d-37a6-4864-8cc4-953bd9b03ff9" status: 200 len: 1270 microversion: 2.1 time: 0.440641 Aug 10 23:34:56.928103 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2867/5939] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:34:56 2022] GET /compute/v2.1/servers/f1ef4c7d-37a6-4864-8cc4-953bd9b03ff9 => generated 1270 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:34:57.078441 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-c5913119-6710-41f8-aa0e-0851f344c6b8 req-6daa64fb-19a7-4b24-b3b0-f7f6dafa44bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1ef4c7d-37a6-4864-8cc4-953bd9b03ff9", "name": "network-vif-plugged", "status": "completed", "tag": "4fb7fde8-d66e-4195-8dcd-9f374af24de9"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:34:57.125016 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-c5913119-6710-41f8-aa0e-0851f344c6b8 req-6daa64fb-19a7-4b24-b3b0-f7f6dafa44bf service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:34:57.125425 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-c5913119-6710-41f8-aa0e-0851f344c6b8 req-6daa64fb-19a7-4b24-b3b0-f7f6dafa44bf service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:34:57.126154 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-c5913119-6710-41f8-aa0e-0851f344c6b8 req-6daa64fb-19a7-4b24-b3b0-f7f6dafa44bf service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:34:57.156847 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-c5913119-6710-41f8-aa0e-0851f344c6b8 req-6daa64fb-19a7-4b24-b3b0-f7f6dafa44bf service nova] Creating event network-vif-plugged:4fb7fde8-d66e-4195-8dcd-9f374af24de9 for instance f1ef4c7d-37a6-4864-8cc4-953bd9b03ff9 on n-h1-850468-14 Aug 10 23:34:57.169304 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-c5913119-6710-41f8-aa0e-0851f344c6b8 req-6daa64fb-19a7-4b24-b3b0-f7f6dafa44bf service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102672 Aug 10 23:34:57.171787 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3073/5940] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:34:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:34:57.942948 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-b2617c6d-a5e9-4505-a48f-886a0dd08314 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:34:57.943580 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-b2617c6d-a5e9-4505-a48f-886a0dd08314 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] [instance: f1ef4c7d-37a6-4864-8cc4-953bd9b03ff9] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:34:57.959112 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b2617c6d-a5e9-4505-a48f-886a0dd08314 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:34:57.959894 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b2617c6d-a5e9-4505-a48f-886a0dd08314 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:34:57.960646 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b2617c6d-a5e9-4505-a48f-886a0dd08314 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:34:57.963622 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b2617c6d-a5e9-4505-a48f-886a0dd08314 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:34:57.964427 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b2617c6d-a5e9-4505-a48f-886a0dd08314 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:34:57.967445 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b2617c6d-a5e9-4505-a48f-886a0dd08314 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:34:58.266757 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-b2617c6d-a5e9-4505-a48f-886a0dd08314 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7700b1afaaa64b809280b518324724de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d55b00e4b4145b8848962f553bcca66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:34:58.274867 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-b2617c6d-a5e9-4505-a48f-886a0dd08314 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] 10.222.0.58 "GET /compute/v2.1/servers/f1ef4c7d-37a6-4864-8cc4-953bd9b03ff9" status: 200 len: 1270 microversion: 2.1 time: 0.337002 Aug 10 23:34:58.287580 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2868/5941] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:34:57 2022] GET /compute/v2.1/servers/f1ef4c7d-37a6-4864-8cc4-953bd9b03ff9 => generated 1270 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:34:59.311292 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-0a87fa95-2e00-428c-80df-45b0e6e3f223 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:34:59.312580 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-0a87fa95-2e00-428c-80df-45b0e6e3f223 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] [instance: f1ef4c7d-37a6-4864-8cc4-953bd9b03ff9] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:34:59.322312 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:34:59.325665 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0a87fa95-2e00-428c-80df-45b0e6e3f223 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:34:59.326874 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0a87fa95-2e00-428c-80df-45b0e6e3f223 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:34:59.327827 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0a87fa95-2e00-428c-80df-45b0e6e3f223 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:34:59.329122 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0a87fa95-2e00-428c-80df-45b0e6e3f223 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:34:59.330050 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0a87fa95-2e00-428c-80df-45b0e6e3f223 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:34:59.330765 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0a87fa95-2e00-428c-80df-45b0e6e3f223 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:34:59.365788 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=51 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:34:59.512268 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-0a87fa95-2e00-428c-80df-45b0e6e3f223 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7700b1afaaa64b809280b518324724de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d55b00e4b4145b8848962f553bcca66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:34:59.522635 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-0a87fa95-2e00-428c-80df-45b0e6e3f223 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] 10.222.0.58 "GET /compute/v2.1/servers/f1ef4c7d-37a6-4864-8cc4-953bd9b03ff9" status: 200 len: 1459 microversion: 2.1 time: 0.216432 Aug 10 23:34:59.540014 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3074/5942] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:34:59 2022] GET /compute/v2.1/servers/f1ef4c7d-37a6-4864-8cc4-953bd9b03ff9 => generated 1459 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:34:59.551320 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-dc636f1a-6f04-4355-be6b-bf777109d411 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:34:59.551970 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-dc636f1a-6f04-4355-be6b-bf777109d411 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] [instance: f1ef4c7d-37a6-4864-8cc4-953bd9b03ff9] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:34:59.567545 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dc636f1a-6f04-4355-be6b-bf777109d411 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:34:59.567978 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dc636f1a-6f04-4355-be6b-bf777109d411 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:34:59.568420 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dc636f1a-6f04-4355-be6b-bf777109d411 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:34:59.569156 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dc636f1a-6f04-4355-be6b-bf777109d411 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:34:59.569682 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dc636f1a-6f04-4355-be6b-bf777109d411 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:34:59.570122 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dc636f1a-6f04-4355-be6b-bf777109d411 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:35:00.233353 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-dc636f1a-6f04-4355-be6b-bf777109d411 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7700b1afaaa64b809280b518324724de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d55b00e4b4145b8848962f553bcca66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:35:00.246805 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-dc636f1a-6f04-4355-be6b-bf777109d411 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] 10.222.0.58 "GET /compute/v2.1/servers/f1ef4c7d-37a6-4864-8cc4-953bd9b03ff9" status: 200 len: 1459 microversion: 2.1 time: 0.698767 Aug 10 23:35:00.247443 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2869/5943] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:34:59 2022] GET /compute/v2.1/servers/f1ef4c7d-37a6-4864-8cc4-953bd9b03ff9 => generated 1459 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:35:04.653603 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-548097a1-eb1a-4dde-88be-0ddc3fe43748 req-483bcd3d-b4c3-4003-989e-ce621f0abd25 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1ef4c7d-37a6-4864-8cc4-953bd9b03ff9", "tag": "4fb7fde8-d66e-4195-8dcd-9f374af24de9"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:35:04.694216 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-548097a1-eb1a-4dde-88be-0ddc3fe43748 req-483bcd3d-b4c3-4003-989e-ce621f0abd25 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:35:04.694712 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-548097a1-eb1a-4dde-88be-0ddc3fe43748 req-483bcd3d-b4c3-4003-989e-ce621f0abd25 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:35:04.695194 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-548097a1-eb1a-4dde-88be-0ddc3fe43748 req-483bcd3d-b4c3-4003-989e-ce621f0abd25 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:35:04.737493 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-548097a1-eb1a-4dde-88be-0ddc3fe43748 req-483bcd3d-b4c3-4003-989e-ce621f0abd25 service nova] Creating event network-changed:4fb7fde8-d66e-4195-8dcd-9f374af24de9 for instance f1ef4c7d-37a6-4864-8cc4-953bd9b03ff9 on n-h1-850468-14 Aug 10 23:35:04.760163 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-548097a1-eb1a-4dde-88be-0ddc3fe43748 req-483bcd3d-b4c3-4003-989e-ce621f0abd25 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.516984 Aug 10 23:35:04.760786 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3075/5944] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:35:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:35:07.639287 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-92804212-46bb-4eab-916c-53a03a789acc req-ab9da95a-3181-422d-97aa-4c475c930304 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1ef4c7d-37a6-4864-8cc4-953bd9b03ff9", "tag": "4fb7fde8-d66e-4195-8dcd-9f374af24de9"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:35:07.647637 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=3 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:35:07.659846 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-92804212-46bb-4eab-916c-53a03a789acc req-ab9da95a-3181-422d-97aa-4c475c930304 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:35:07.660803 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-92804212-46bb-4eab-916c-53a03a789acc req-ab9da95a-3181-422d-97aa-4c475c930304 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:35:07.661992 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-92804212-46bb-4eab-916c-53a03a789acc req-ab9da95a-3181-422d-97aa-4c475c930304 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:35:07.685679 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=65 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:35:07.708186 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-92804212-46bb-4eab-916c-53a03a789acc req-ab9da95a-3181-422d-97aa-4c475c930304 service nova] Creating event network-changed:4fb7fde8-d66e-4195-8dcd-9f374af24de9 for instance f1ef4c7d-37a6-4864-8cc4-953bd9b03ff9 on n-h1-850468-14 Aug 10 23:35:07.715788 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-92804212-46bb-4eab-916c-53a03a789acc req-ab9da95a-3181-422d-97aa-4c475c930304 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082201 Aug 10 23:35:07.716948 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2870/5945] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:35:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:35:09.836416 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-ec51721f-4248-43f3-a308-2852dc8cfc88 req-f7af74f8-5d34-4a98-b33c-3d81dac8c4bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1ef4c7d-37a6-4864-8cc4-953bd9b03ff9", "tag": "4fb7fde8-d66e-4195-8dcd-9f374af24de9"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:35:09.875474 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-ec51721f-4248-43f3-a308-2852dc8cfc88 req-f7af74f8-5d34-4a98-b33c-3d81dac8c4bd service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:35:09.878167 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-ec51721f-4248-43f3-a308-2852dc8cfc88 req-f7af74f8-5d34-4a98-b33c-3d81dac8c4bd service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:35:09.879016 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-ec51721f-4248-43f3-a308-2852dc8cfc88 req-f7af74f8-5d34-4a98-b33c-3d81dac8c4bd service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:35:09.905633 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-ec51721f-4248-43f3-a308-2852dc8cfc88 req-f7af74f8-5d34-4a98-b33c-3d81dac8c4bd service nova] Creating event network-changed:4fb7fde8-d66e-4195-8dcd-9f374af24de9 for instance f1ef4c7d-37a6-4864-8cc4-953bd9b03ff9 on n-h1-850468-14 Aug 10 23:35:09.916927 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-ec51721f-4248-43f3-a308-2852dc8cfc88 req-f7af74f8-5d34-4a98-b33c-3d81dac8c4bd service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084553 Aug 10 23:35:09.919421 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3076/5946] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:35:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:35:28.547103 n-d-850468-14 devstack@n-api.service[122633]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 23:35:28.547783 n-d-850468-14 devstack@n-api.service[122633]: Wed Aug 10 23:35:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 23:35:29.229699 n-d-850468-14 devstack@n-api.service[122632]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 23:35:29.230232 n-d-850468-14 devstack@n-api.service[122632]: Wed Aug 10 23:35:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 23:35:41.231919 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_api:SELECT=1 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:35:41.234282 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=1 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:35:41.240762 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-92ff9930-9ed1-414f-801e-fa2748d4d4b3 req-c32c4bb8-a4a3-42ca-a059-5b64f0d6d47e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1ef4c7d-37a6-4864-8cc4-953bd9b03ff9", "tag": "4fb7fde8-d66e-4195-8dcd-9f374af24de9"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:35:41.247494 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-74c2f104-1cfb-4365-bb4c-5be6c5f3eb22 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:35:41.250460 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-74c2f104-1cfb-4365-bb4c-5be6c5f3eb22 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] [instance: f1ef4c7d-37a6-4864-8cc4-953bd9b03ff9] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:35:41.251883 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_api:SELECT=5 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:35:41.252739 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=9 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:35:41.271065 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-92ff9930-9ed1-414f-801e-fa2748d4d4b3 req-c32c4bb8-a4a3-42ca-a059-5b64f0d6d47e service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:35:41.271865 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-92ff9930-9ed1-414f-801e-fa2748d4d4b3 req-c32c4bb8-a4a3-42ca-a059-5b64f0d6d47e service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:35:41.272648 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-92ff9930-9ed1-414f-801e-fa2748d4d4b3 req-c32c4bb8-a4a3-42ca-a059-5b64f0d6d47e service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:35:41.274939 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-74c2f104-1cfb-4365-bb4c-5be6c5f3eb22 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:35:41.275856 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-74c2f104-1cfb-4365-bb4c-5be6c5f3eb22 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:35:41.276922 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-74c2f104-1cfb-4365-bb4c-5be6c5f3eb22 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:35:41.279628 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-74c2f104-1cfb-4365-bb4c-5be6c5f3eb22 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:35:41.281377 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-74c2f104-1cfb-4365-bb4c-5be6c5f3eb22 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:35:41.282048 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-74c2f104-1cfb-4365-bb4c-5be6c5f3eb22 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:35:41.297380 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-92ff9930-9ed1-414f-801e-fa2748d4d4b3 req-c32c4bb8-a4a3-42ca-a059-5b64f0d6d47e service nova] Creating event network-changed:4fb7fde8-d66e-4195-8dcd-9f374af24de9 for instance f1ef4c7d-37a6-4864-8cc4-953bd9b03ff9 on n-h1-850468-14 Aug 10 23:35:41.310445 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-92ff9930-9ed1-414f-801e-fa2748d4d4b3 req-c32c4bb8-a4a3-42ca-a059-5b64f0d6d47e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074872 Aug 10 23:35:41.314268 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3077/5947] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:35:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:35:41.343556 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-74c2f104-1cfb-4365-bb4c-5be6c5f3eb22 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] [instance: f1ef4c7d-37a6-4864-8cc4-953bd9b03ff9] Going to try to terminate instance {{(pid=122632) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:35:41.494270 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-74c2f104-1cfb-4365-bb4c-5be6c5f3eb22 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] 10.222.0.58 "DELETE /compute/v2.1/servers/f1ef4c7d-37a6-4864-8cc4-953bd9b03ff9" status: 204 len: 0 microversion: 2.1 time: 0.267426 Aug 10 23:35:41.495634 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2871/5948] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:35:41 2022] DELETE /compute/v2.1/servers/f1ef4c7d-37a6-4864-8cc4-953bd9b03ff9 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:35:41.506379 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-e8f6580b-61df-47bb-a484-e1bedd572180 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:35:41.507421 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-e8f6580b-61df-47bb-a484-e1bedd572180 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] [instance: f1ef4c7d-37a6-4864-8cc4-953bd9b03ff9] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:35:41.520074 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e8f6580b-61df-47bb-a484-e1bedd572180 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:35:41.522114 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e8f6580b-61df-47bb-a484-e1bedd572180 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:35:41.522870 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e8f6580b-61df-47bb-a484-e1bedd572180 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:35:41.523954 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e8f6580b-61df-47bb-a484-e1bedd572180 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:35:41.524327 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e8f6580b-61df-47bb-a484-e1bedd572180 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:35:41.524766 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e8f6580b-61df-47bb-a484-e1bedd572180 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:35:41.790586 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-e8f6580b-61df-47bb-a484-e1bedd572180 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7700b1afaaa64b809280b518324724de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d55b00e4b4145b8848962f553bcca66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:35:41.798929 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-e8f6580b-61df-47bb-a484-e1bedd572180 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] 10.222.0.58 "GET /compute/v2.1/servers/f1ef4c7d-37a6-4864-8cc4-953bd9b03ff9" status: 200 len: 1583 microversion: 2.1 time: 0.298034 Aug 10 23:35:41.799521 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3078/5949] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:35:41 2022] GET /compute/v2.1/servers/f1ef4c7d-37a6-4864-8cc4-953bd9b03ff9 => generated 1583 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:35:42.836276 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-13584a21-faa9-4f39-a2fb-2da2123c7212 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:35:42.838079 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-13584a21-faa9-4f39-a2fb-2da2123c7212 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] [instance: f1ef4c7d-37a6-4864-8cc4-953bd9b03ff9] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:35:42.848335 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-13584a21-faa9-4f39-a2fb-2da2123c7212 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:35:42.849278 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-13584a21-faa9-4f39-a2fb-2da2123c7212 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:35:42.849995 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-13584a21-faa9-4f39-a2fb-2da2123c7212 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:35:42.851749 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-13584a21-faa9-4f39-a2fb-2da2123c7212 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:35:42.853566 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-13584a21-faa9-4f39-a2fb-2da2123c7212 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:35:42.854649 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-13584a21-faa9-4f39-a2fb-2da2123c7212 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:35:43.174070 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-13584a21-faa9-4f39-a2fb-2da2123c7212 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7700b1afaaa64b809280b518324724de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d55b00e4b4145b8848962f553bcca66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:35:43.182767 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-13584a21-faa9-4f39-a2fb-2da2123c7212 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] 10.222.0.58 "GET /compute/v2.1/servers/f1ef4c7d-37a6-4864-8cc4-953bd9b03ff9" status: 200 len: 1583 microversion: 2.1 time: 0.362584 Aug 10 23:35:43.185878 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2872/5950] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:35:42 2022] GET /compute/v2.1/servers/f1ef4c7d-37a6-4864-8cc4-953bd9b03ff9 => generated 1583 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:35:43.656826 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-170f5768-ff0a-4d52-bf40-ca42896e0b3d req-e72bbfcb-c0f4-4865-ba46-99dd4c451266 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1ef4c7d-37a6-4864-8cc4-953bd9b03ff9", "name": "network-vif-deleted", "tag": "4fb7fde8-d66e-4195-8dcd-9f374af24de9"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:35:43.666725 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-170f5768-ff0a-4d52-bf40-ca42896e0b3d req-e72bbfcb-c0f4-4865-ba46-99dd4c451266 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:35:43.667287 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-170f5768-ff0a-4d52-bf40-ca42896e0b3d req-e72bbfcb-c0f4-4865-ba46-99dd4c451266 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:35:43.667775 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-170f5768-ff0a-4d52-bf40-ca42896e0b3d req-e72bbfcb-c0f4-4865-ba46-99dd4c451266 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:35:43.681534 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-170f5768-ff0a-4d52-bf40-ca42896e0b3d req-e72bbfcb-c0f4-4865-ba46-99dd4c451266 service nova] Creating event network-vif-deleted:4fb7fde8-d66e-4195-8dcd-9f374af24de9 for instance f1ef4c7d-37a6-4864-8cc4-953bd9b03ff9 on n-h1-850468-14 Aug 10 23:35:43.688150 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-170f5768-ff0a-4d52-bf40-ca42896e0b3d req-e72bbfcb-c0f4-4865-ba46-99dd4c451266 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037282 Aug 10 23:35:43.689460 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3079/5951] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:35:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 23:35:44.212112 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-e9e2500f-52d7-4001-8258-6031fc29c5c9 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:35:44.216046 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-e9e2500f-52d7-4001-8258-6031fc29c5c9 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] [instance: f1ef4c7d-37a6-4864-8cc4-953bd9b03ff9] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:35:44.239548 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e9e2500f-52d7-4001-8258-6031fc29c5c9 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:35:44.240095 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e9e2500f-52d7-4001-8258-6031fc29c5c9 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:35:44.240559 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e9e2500f-52d7-4001-8258-6031fc29c5c9 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:35:44.243143 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e9e2500f-52d7-4001-8258-6031fc29c5c9 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:35:44.243628 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e9e2500f-52d7-4001-8258-6031fc29c5c9 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:35:44.247174 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e9e2500f-52d7-4001-8258-6031fc29c5c9 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:35:44.346903 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-e9e2500f-52d7-4001-8258-6031fc29c5c9 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7700b1afaaa64b809280b518324724de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d55b00e4b4145b8848962f553bcca66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:35:44.355172 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-e9e2500f-52d7-4001-8258-6031fc29c5c9 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] 10.222.0.58 "GET /compute/v2.1/servers/f1ef4c7d-37a6-4864-8cc4-953bd9b03ff9" status: 200 len: 1229 microversion: 2.1 time: 0.149349 Aug 10 23:35:44.370216 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2873/5952] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:35:44 2022] GET /compute/v2.1/servers/f1ef4c7d-37a6-4864-8cc4-953bd9b03ff9 => generated 1229 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:35:45.378570 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-e4427067-f94e-417d-87b7-43d40d44cbd8 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:35:45.379408 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-e4427067-f94e-417d-87b7-43d40d44cbd8 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] [instance: f1ef4c7d-37a6-4864-8cc4-953bd9b03ff9] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:35:45.394641 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e4427067-f94e-417d-87b7-43d40d44cbd8 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:35:45.395177 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e4427067-f94e-417d-87b7-43d40d44cbd8 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:35:45.395630 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e4427067-f94e-417d-87b7-43d40d44cbd8 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:35:45.396348 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e4427067-f94e-417d-87b7-43d40d44cbd8 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:35:45.396807 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e4427067-f94e-417d-87b7-43d40d44cbd8 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:35:45.397239 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e4427067-f94e-417d-87b7-43d40d44cbd8 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:35:45.553993 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-e4427067-f94e-417d-87b7-43d40d44cbd8 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7700b1afaaa64b809280b518324724de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d55b00e4b4145b8848962f553bcca66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:35:45.569394 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-e4427067-f94e-417d-87b7-43d40d44cbd8 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] 10.222.0.58 "GET /compute/v2.1/servers/f1ef4c7d-37a6-4864-8cc4-953bd9b03ff9" status: 200 len: 1229 microversion: 2.1 time: 0.195623 Aug 10 23:35:45.574952 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3080/5953] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:35:45 2022] GET /compute/v2.1/servers/f1ef4c7d-37a6-4864-8cc4-953bd9b03ff9 => generated 1229 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:35:46.591543 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-b259249c-42af-44a2-ab99-80c24febdd9c tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:35:46.592183 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-b259249c-42af-44a2-ab99-80c24febdd9c tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] [instance: f1ef4c7d-37a6-4864-8cc4-953bd9b03ff9] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:35:46.611551 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b259249c-42af-44a2-ab99-80c24febdd9c tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:35:46.612072 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b259249c-42af-44a2-ab99-80c24febdd9c tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:35:46.612522 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b259249c-42af-44a2-ab99-80c24febdd9c tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:35:46.613296 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b259249c-42af-44a2-ab99-80c24febdd9c tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:35:46.618887 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b259249c-42af-44a2-ab99-80c24febdd9c tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:35:46.619913 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b259249c-42af-44a2-ab99-80c24febdd9c tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:35:46.717643 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-b259249c-42af-44a2-ab99-80c24febdd9c tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7700b1afaaa64b809280b518324724de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d55b00e4b4145b8848962f553bcca66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:35:46.728379 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-b259249c-42af-44a2-ab99-80c24febdd9c tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] 10.222.0.58 "GET /compute/v2.1/servers/f1ef4c7d-37a6-4864-8cc4-953bd9b03ff9" status: 200 len: 1229 microversion: 2.1 time: 0.142328 Aug 10 23:35:46.728976 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2874/5954] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:35:46 2022] GET /compute/v2.1/servers/f1ef4c7d-37a6-4864-8cc4-953bd9b03ff9 => generated 1229 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:35:47.750615 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-6cb7a874-eee6-4d94-a879-3b8896e63fa9 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:35:47.751271 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-6cb7a874-eee6-4d94-a879-3b8896e63fa9 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] [instance: f1ef4c7d-37a6-4864-8cc4-953bd9b03ff9] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:35:47.759724 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6cb7a874-eee6-4d94-a879-3b8896e63fa9 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:35:47.763646 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6cb7a874-eee6-4d94-a879-3b8896e63fa9 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:35:47.764376 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6cb7a874-eee6-4d94-a879-3b8896e63fa9 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:35:47.765276 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6cb7a874-eee6-4d94-a879-3b8896e63fa9 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:35:47.765901 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6cb7a874-eee6-4d94-a879-3b8896e63fa9 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:35:47.766711 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6cb7a874-eee6-4d94-a879-3b8896e63fa9 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:35:47.854291 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-6cb7a874-eee6-4d94-a879-3b8896e63fa9 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7700b1afaaa64b809280b518324724de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d55b00e4b4145b8848962f553bcca66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:35:47.864801 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-6cb7a874-eee6-4d94-a879-3b8896e63fa9 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] 10.222.0.58 "GET /compute/v2.1/servers/f1ef4c7d-37a6-4864-8cc4-953bd9b03ff9" status: 200 len: 1229 microversion: 2.1 time: 0.119207 Aug 10 23:35:47.866671 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3081/5955] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:35:47 2022] GET /compute/v2.1/servers/f1ef4c7d-37a6-4864-8cc4-953bd9b03ff9 => generated 1229 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:35:48.889447 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-d1f3c527-f99d-46ba-8b9b-4866a86e1d0a tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:35:48.890915 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-d1f3c527-f99d-46ba-8b9b-4866a86e1d0a tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] [instance: f1ef4c7d-37a6-4864-8cc4-953bd9b03ff9] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:35:48.905175 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d1f3c527-f99d-46ba-8b9b-4866a86e1d0a tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:35:48.906066 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d1f3c527-f99d-46ba-8b9b-4866a86e1d0a tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:35:48.907852 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d1f3c527-f99d-46ba-8b9b-4866a86e1d0a tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:35:48.908903 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d1f3c527-f99d-46ba-8b9b-4866a86e1d0a tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:35:48.909721 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d1f3c527-f99d-46ba-8b9b-4866a86e1d0a tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:35:48.910397 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d1f3c527-f99d-46ba-8b9b-4866a86e1d0a tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:35:49.502816 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-d1f3c527-f99d-46ba-8b9b-4866a86e1d0a tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7700b1afaaa64b809280b518324724de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d55b00e4b4145b8848962f553bcca66', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:35:49.515050 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-d1f3c527-f99d-46ba-8b9b-4866a86e1d0a tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] 10.222.0.58 "GET /compute/v2.1/servers/f1ef4c7d-37a6-4864-8cc4-953bd9b03ff9" status: 200 len: 1229 microversion: 2.1 time: 0.630740 Aug 10 23:35:49.517930 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2875/5956] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:35:48 2022] GET /compute/v2.1/servers/f1ef4c7d-37a6-4864-8cc4-953bd9b03ff9 => generated 1229 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:35:50.541438 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-39eca25c-6e3f-48d7-989b-3bad0ee92ef8 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:35:50.542060 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-39eca25c-6e3f-48d7-989b-3bad0ee92ef8 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] [instance: f1ef4c7d-37a6-4864-8cc4-953bd9b03ff9] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:35:50.550441 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-39eca25c-6e3f-48d7-989b-3bad0ee92ef8 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:35:50.550969 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-39eca25c-6e3f-48d7-989b-3bad0ee92ef8 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:35:50.551402 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-39eca25c-6e3f-48d7-989b-3bad0ee92ef8 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:35:50.552106 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-39eca25c-6e3f-48d7-989b-3bad0ee92ef8 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:35:50.552563 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-39eca25c-6e3f-48d7-989b-3bad0ee92ef8 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:35:50.552995 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-39eca25c-6e3f-48d7-989b-3bad0ee92ef8 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:35:50.567936 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-39eca25c-6e3f-48d7-989b-3bad0ee92ef8 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] HTTP exception thrown: Instance f1ef4c7d-37a6-4864-8cc4-953bd9b03ff9 could not be found. Aug 10 23:35:50.569888 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-39eca25c-6e3f-48d7-989b-3bad0ee92ef8 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Request method failure captured: Aug 10 23:35:50.569888 n-d-850468-14 devstack@n-api.service[122633]: request: GET /compute/v2.1/servers/f1ef4c7d-37a6-4864-8cc4-953bd9b03ff9 HTTP/1.1 Aug 10 23:35:50.569888 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:35:50.569888 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:35:50.569888 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:35:50.569888 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:35:50.569888 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:35:50.569888 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:35:50.569888 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:35:50.569888 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:35:50.569888 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9D_UD-i-MTy4pj4Voc05Uo1GlZcRLTB1OGG-5wLCWLFcogwlGd_Sd1godyoIxqnOP0pnw683b1oEblPttonFULZKpWXOwhr76VUS9QnISmfFp-ZfTaMQ555F-zC2kQndYE6WiL0jWLVNqL9i8pnhcC2Eb0w7t5NZY5KoJ_86D1recZU Aug 10 23:35:50.569888 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:35:50.569888 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:35:50.569888 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:35:50.569888 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:35:50.569888 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:35:50.569888 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:35:50.569888 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 7d55b00e4b4145b8848962f553bcca66 Aug 10 23:35:50.569888 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-TestVolumeBackupRestore-1704540358 Aug 10 23:35:50.569888 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:35:50.569888 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:35:50.569888 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7d55b00e4b4145b8848962f553bcca66"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7d55b00e4b4145b8848962f553bcca66"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7d55b00e4b4145b8848962f553bcca66"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7d55b00e4b4145b8848962f553bcca66", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:35:50.569888 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-TestVolumeBackupRestore-1704540358 Aug 10 23:35:50.569888 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 7d55b00e4b4145b8848962f553bcca66 Aug 10 23:35:50.569888 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-TestVolumeBackupRestore-1704540358 Aug 10 23:35:50.569888 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-TestVolumeBackupRestore-1704540358-project Aug 10 23:35:50.569888 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:35:50.569888 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:35:50.569888 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 7700b1afaaa64b809280b518324724de Aug 10 23:35:50.569888 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-TestVolumeBackupRestore-1704540358-project Aug 10 23:35:50.569888 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:35:50.569888 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance f1ef4c7d-37a6-4864-8cc4-953bd9b03ff9 could not be found. Aug 10 23:35:50.569888 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': 'f1ef4c7d-37a6-4864-8cc4-953bd9b03ff9'} Aug 10 23:35:50.569888 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:35:50.569888 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:35:50.569888 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:35:50.569888 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:35:50.569888 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:35:50.569888 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:35:50.569888 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:35:50.569888 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:35:50.569888 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:35:50.569888 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:35:50.569888 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1ef4c7d-37a6-4864-8cc4-953bd9b03ff9 could not be found. Aug 10 23:35:50.569888 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:35:50.569888 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:35:50.569888 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:35:50.569888 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:35:50.569888 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:35:50.569888 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:35:50.569888 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:35:50.569888 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:35:50.569888 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:35:50.569888 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:35:50.569888 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:35:50.569888 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:35:50.569888 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:35:50.569888 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:35:50.569888 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:35:50.569888 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:35:50.569888 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1ef4c7d-37a6-4864-8cc4-953bd9b03ff9 could not be found. Aug 10 23:35:50.569888 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:35:50.569888 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:35:50.569888 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:35:50.574158 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:35:50.574158 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:35:50.574158 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:35:50.574158 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:35:50.574158 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:35:50.574158 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1ef4c7d-37a6-4864-8cc4-953bd9b03ff9 could not be found. Aug 10 23:35:50.574158 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:35:50.574158 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-39eca25c-6e3f-48d7-989b-3bad0ee92ef8 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Returning 404 to user: Instance f1ef4c7d-37a6-4864-8cc4-953bd9b03ff9 could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:35:50.574158 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-39eca25c-6e3f-48d7-989b-3bad0ee92ef8 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] 10.222.0.58 "GET /compute/v2.1/servers/f1ef4c7d-37a6-4864-8cc4-953bd9b03ff9" status: 404 len: 111 microversion: 2.1 time: 0.033856 Aug 10 23:35:50.574158 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3082/5957] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:35:50 2022] GET /compute/v2.1/servers/f1ef4c7d-37a6-4864-8cc4-953bd9b03ff9 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:35:50.775088 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-473c273a-d0e7-45c9-80bf-c534e6815f28 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] Calling method '.version_select at 0x7f847d98cf70>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:35:50.837481 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-473c273a-d0e7-45c9-80bf-c534e6815f28 tempest-TestVolumeBackupRestore-1704540358 tempest-TestVolumeBackupRestore-1704540358-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1418156268" status: 202 len: 0 microversion: 2.1 time: 0.068647 Aug 10 23:35:50.838219 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2876/5958] 10.222.0.58 () {58 vars in 1269 bytes} [Wed Aug 10 23:35:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1418156268 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:36:17.337973 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_api:SELECT=12 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:36:17.339026 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=24 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:36:17.454909 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-a8ae11b3-4d0c-43eb-9336-d4193386bab0 tempest-VolumesActionsTest-838650631 tempest-VolumesActionsTest-838650631-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-203589861", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452", "networks": [{"uuid": "37f655e2-e882-45dc-b048-d65c75d10709"}]}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:36:17.523755 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.network.neutron [None req-a8ae11b3-4d0c-43eb-9336-d4193386bab0 tempest-VolumesActionsTest-838650631 tempest-VolumesActionsTest-838650631-project] validate_networks() for [('37f655e2-e882-45dc-b048-d65c75d10709', None, None, None, None, None)] {{(pid=122633) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 23:36:18.144234 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-a8ae11b3-4d0c-43eb-9336-d4193386bab0 tempest-VolumesActionsTest-838650631 tempest-VolumesActionsTest-838650631-project] Flavor limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:36:18.144910 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-a8ae11b3-4d0c-43eb-9336-d4193386bab0 tempest-VolumesActionsTest-838650631 tempest-VolumesActionsTest-838650631-project] Image limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:36:18.145418 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-a8ae11b3-4d0c-43eb-9336-d4193386bab0 tempest-VolumesActionsTest-838650631 tempest-VolumesActionsTest-838650631-project] Flavor pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:36:18.145825 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-a8ae11b3-4d0c-43eb-9336-d4193386bab0 tempest-VolumesActionsTest-838650631 tempest-VolumesActionsTest-838650631-project] Image pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:36:18.146572 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-a8ae11b3-4d0c-43eb-9336-d4193386bab0 tempest-VolumesActionsTest-838650631 tempest-VolumesActionsTest-838650631-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:36:18.159536 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a8ae11b3-4d0c-43eb-9336-d4193386bab0 tempest-VolumesActionsTest-838650631 tempest-VolumesActionsTest-838650631-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:36:18.160598 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a8ae11b3-4d0c-43eb-9336-d4193386bab0 tempest-VolumesActionsTest-838650631 tempest-VolumesActionsTest-838650631-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:36:18.161434 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a8ae11b3-4d0c-43eb-9336-d4193386bab0 tempest-VolumesActionsTest-838650631 tempest-VolumesActionsTest-838650631-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:36:18.162926 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a8ae11b3-4d0c-43eb-9336-d4193386bab0 tempest-VolumesActionsTest-838650631 tempest-VolumesActionsTest-838650631-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:36:18.163941 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a8ae11b3-4d0c-43eb-9336-d4193386bab0 tempest-VolumesActionsTest-838650631 tempest-VolumesActionsTest-838650631-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:36:18.164913 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a8ae11b3-4d0c-43eb-9336-d4193386bab0 tempest-VolumesActionsTest-838650631 tempest-VolumesActionsTest-838650631-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:36:18.196703 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-a8ae11b3-4d0c-43eb-9336-d4193386bab0 tempest-VolumesActionsTest-838650631 tempest-VolumesActionsTest-838650631-project] Getting quotas for project b8a78977cb894151a194adfb34fd9751. Resources: {'instances', 'cores', 'ram'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:36:18.207756 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-a8ae11b3-4d0c-43eb-9336-d4193386bab0 tempest-VolumesActionsTest-838650631 tempest-VolumesActionsTest-838650631-project] Getting quotas for user d74dc5250e8c4afe8facc79207f1d7dd and project b8a78977cb894151a194adfb34fd9751. Resources: {'instances', 'cores', 'ram'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:36:18.235238 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-a8ae11b3-4d0c-43eb-9336-d4193386bab0 tempest-VolumesActionsTest-838650631 tempest-VolumesActionsTest-838650631-project] Going to run 1 instances... {{(pid=122633) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 23:36:18.240199 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-a8ae11b3-4d0c-43eb-9336-d4193386bab0 tempest-VolumesActionsTest-838650631 tempest-VolumesActionsTest-838650631-project] [instance: a535b77c-196d-48df-bf18-516c7e89ef56] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78ad8905-f66f-4733-8be9-2b260f1fabed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122633) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 23:36:18.303925 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-a8ae11b3-4d0c-43eb-9336-d4193386bab0 tempest-VolumesActionsTest-838650631 tempest-VolumesActionsTest-838650631-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.970214 Aug 10 23:36:18.305287 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3083/5959] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 23:36:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 973 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 23:36:18.317498 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-2860d3f7-bfee-4097-a64e-46ada2292e62 tempest-VolumesActionsTest-838650631 tempest-VolumesActionsTest-838650631-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:36:18.318712 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-2860d3f7-bfee-4097-a64e-46ada2292e62 tempest-VolumesActionsTest-838650631 tempest-VolumesActionsTest-838650631-project] [instance: a535b77c-196d-48df-bf18-516c7e89ef56] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:36:18.321779 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:36:18.323696 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:36:18.397647 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-2860d3f7-bfee-4097-a64e-46ada2292e62 tempest-VolumesActionsTest-838650631 tempest-VolumesActionsTest-838650631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74dc5250e8c4afe8facc79207f1d7dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a78977cb894151a194adfb34fd9751', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:36:18.408561 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-2860d3f7-bfee-4097-a64e-46ada2292e62 tempest-VolumesActionsTest-838650631 tempest-VolumesActionsTest-838650631-project] 10.222.0.58 "GET /compute/v2.1/servers/a535b77c-196d-48df-bf18-516c7e89ef56" status: 200 len: 1213 microversion: 2.1 time: 0.094905 Aug 10 23:36:18.420341 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2877/5960] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:36:18 2022] GET /compute/v2.1/servers/a535b77c-196d-48df-bf18-516c7e89ef56 => generated 1213 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:36:19.432658 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-84e8d0e2-c8f9-40d3-bcf3-112fe45c89ff tempest-VolumesActionsTest-838650631 tempest-VolumesActionsTest-838650631-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:36:19.433264 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-84e8d0e2-c8f9-40d3-bcf3-112fe45c89ff tempest-VolumesActionsTest-838650631 tempest-VolumesActionsTest-838650631-project] [instance: a535b77c-196d-48df-bf18-516c7e89ef56] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:36:19.449202 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-84e8d0e2-c8f9-40d3-bcf3-112fe45c89ff tempest-VolumesActionsTest-838650631 tempest-VolumesActionsTest-838650631-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:36:19.450473 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-84e8d0e2-c8f9-40d3-bcf3-112fe45c89ff tempest-VolumesActionsTest-838650631 tempest-VolumesActionsTest-838650631-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:36:19.451518 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-84e8d0e2-c8f9-40d3-bcf3-112fe45c89ff tempest-VolumesActionsTest-838650631 tempest-VolumesActionsTest-838650631-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:36:19.452449 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-84e8d0e2-c8f9-40d3-bcf3-112fe45c89ff tempest-VolumesActionsTest-838650631 tempest-VolumesActionsTest-838650631-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:36:19.453073 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-84e8d0e2-c8f9-40d3-bcf3-112fe45c89ff tempest-VolumesActionsTest-838650631 tempest-VolumesActionsTest-838650631-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:36:19.453678 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-84e8d0e2-c8f9-40d3-bcf3-112fe45c89ff tempest-VolumesActionsTest-838650631 tempest-VolumesActionsTest-838650631-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:36:19.563262 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-84e8d0e2-c8f9-40d3-bcf3-112fe45c89ff tempest-VolumesActionsTest-838650631 tempest-VolumesActionsTest-838650631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74dc5250e8c4afe8facc79207f1d7dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a78977cb894151a194adfb34fd9751', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:36:19.583743 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-84e8d0e2-c8f9-40d3-bcf3-112fe45c89ff tempest-VolumesActionsTest-838650631 tempest-VolumesActionsTest-838650631-project] 10.222.0.58 "GET /compute/v2.1/servers/a535b77c-196d-48df-bf18-516c7e89ef56" status: 200 len: 1265 microversion: 2.1 time: 0.156363 Aug 10 23:36:19.584913 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3084/5961] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:36:19 2022] GET /compute/v2.1/servers/a535b77c-196d-48df-bf18-516c7e89ef56 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:36:20.612641 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-d14c324b-0891-4b16-86a7-e728207e81cf tempest-VolumesActionsTest-838650631 tempest-VolumesActionsTest-838650631-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:36:20.613888 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-d14c324b-0891-4b16-86a7-e728207e81cf tempest-VolumesActionsTest-838650631 tempest-VolumesActionsTest-838650631-project] [instance: a535b77c-196d-48df-bf18-516c7e89ef56] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:36:20.624293 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d14c324b-0891-4b16-86a7-e728207e81cf tempest-VolumesActionsTest-838650631 tempest-VolumesActionsTest-838650631-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:36:20.624889 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d14c324b-0891-4b16-86a7-e728207e81cf tempest-VolumesActionsTest-838650631 tempest-VolumesActionsTest-838650631-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:36:20.625231 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d14c324b-0891-4b16-86a7-e728207e81cf tempest-VolumesActionsTest-838650631 tempest-VolumesActionsTest-838650631-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:36:20.626534 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d14c324b-0891-4b16-86a7-e728207e81cf tempest-VolumesActionsTest-838650631 tempest-VolumesActionsTest-838650631-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:36:20.627946 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d14c324b-0891-4b16-86a7-e728207e81cf tempest-VolumesActionsTest-838650631 tempest-VolumesActionsTest-838650631-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:36:20.628549 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d14c324b-0891-4b16-86a7-e728207e81cf tempest-VolumesActionsTest-838650631 tempest-VolumesActionsTest-838650631-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:36:20.801907 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-d14c324b-0891-4b16-86a7-e728207e81cf tempest-VolumesActionsTest-838650631 tempest-VolumesActionsTest-838650631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74dc5250e8c4afe8facc79207f1d7dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a78977cb894151a194adfb34fd9751', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:36:20.832033 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-d14c324b-0891-4b16-86a7-e728207e81cf tempest-VolumesActionsTest-838650631 tempest-VolumesActionsTest-838650631-project] 10.222.0.58 "GET /compute/v2.1/servers/a535b77c-196d-48df-bf18-516c7e89ef56" status: 200 len: 1313 microversion: 2.1 time: 0.226048 Aug 10 23:36:20.846677 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2878/5962] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:36:20 2022] GET /compute/v2.1/servers/a535b77c-196d-48df-bf18-516c7e89ef56 => generated 1313 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:36:21.401256 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-688a92e2-c543-4b1d-95c9-d398dcfb64fd req-a0634c95-818c-4c77-b167-0b879ae1b138 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a535b77c-196d-48df-bf18-516c7e89ef56", "tag": "e8137689-dec4-448a-a5eb-66052e0b2dea"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:36:21.420310 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-688a92e2-c543-4b1d-95c9-d398dcfb64fd req-a0634c95-818c-4c77-b167-0b879ae1b138 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:36:21.420902 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-688a92e2-c543-4b1d-95c9-d398dcfb64fd req-a0634c95-818c-4c77-b167-0b879ae1b138 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:36:21.421510 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-688a92e2-c543-4b1d-95c9-d398dcfb64fd req-a0634c95-818c-4c77-b167-0b879ae1b138 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:36:21.436679 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-688a92e2-c543-4b1d-95c9-d398dcfb64fd req-a0634c95-818c-4c77-b167-0b879ae1b138 service nova] Creating event network-changed:e8137689-dec4-448a-a5eb-66052e0b2dea for instance a535b77c-196d-48df-bf18-516c7e89ef56 on n-h1-850468-14 Aug 10 23:36:21.442191 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-688a92e2-c543-4b1d-95c9-d398dcfb64fd req-a0634c95-818c-4c77-b167-0b879ae1b138 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050798 Aug 10 23:36:21.443357 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3085/5963] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:36:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:36:21.854679 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-4a5340f5-c963-4255-93e4-ac269f61f7c3 tempest-VolumesActionsTest-838650631 tempest-VolumesActionsTest-838650631-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:36:21.855514 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-4a5340f5-c963-4255-93e4-ac269f61f7c3 tempest-VolumesActionsTest-838650631 tempest-VolumesActionsTest-838650631-project] [instance: a535b77c-196d-48df-bf18-516c7e89ef56] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:36:21.864108 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4a5340f5-c963-4255-93e4-ac269f61f7c3 tempest-VolumesActionsTest-838650631 tempest-VolumesActionsTest-838650631-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:36:21.865039 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4a5340f5-c963-4255-93e4-ac269f61f7c3 tempest-VolumesActionsTest-838650631 tempest-VolumesActionsTest-838650631-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:36:21.865864 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4a5340f5-c963-4255-93e4-ac269f61f7c3 tempest-VolumesActionsTest-838650631 tempest-VolumesActionsTest-838650631-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:36:21.866840 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4a5340f5-c963-4255-93e4-ac269f61f7c3 tempest-VolumesActionsTest-838650631 tempest-VolumesActionsTest-838650631-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:36:21.867832 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4a5340f5-c963-4255-93e4-ac269f61f7c3 tempest-VolumesActionsTest-838650631 tempest-VolumesActionsTest-838650631-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:36:21.874724 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4a5340f5-c963-4255-93e4-ac269f61f7c3 tempest-VolumesActionsTest-838650631 tempest-VolumesActionsTest-838650631-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:36:22.115977 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-4a5340f5-c963-4255-93e4-ac269f61f7c3 tempest-VolumesActionsTest-838650631 tempest-VolumesActionsTest-838650631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74dc5250e8c4afe8facc79207f1d7dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a78977cb894151a194adfb34fd9751', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:36:22.132422 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-4a5340f5-c963-4255-93e4-ac269f61f7c3 tempest-VolumesActionsTest-838650631 tempest-VolumesActionsTest-838650631-project] 10.222.0.58 "GET /compute/v2.1/servers/a535b77c-196d-48df-bf18-516c7e89ef56" status: 200 len: 1313 microversion: 2.1 time: 0.282591 Aug 10 23:36:22.133365 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2879/5964] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:36:21 2022] GET /compute/v2.1/servers/a535b77c-196d-48df-bf18-516c7e89ef56 => generated 1313 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:36:23.159869 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-612a90ac-f7fb-4f0e-bed3-37d0860e91b7 tempest-VolumesActionsTest-838650631 tempest-VolumesActionsTest-838650631-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:36:23.162379 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-612a90ac-f7fb-4f0e-bed3-37d0860e91b7 tempest-VolumesActionsTest-838650631 tempest-VolumesActionsTest-838650631-project] [instance: a535b77c-196d-48df-bf18-516c7e89ef56] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:36:23.181175 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-612a90ac-f7fb-4f0e-bed3-37d0860e91b7 tempest-VolumesActionsTest-838650631 tempest-VolumesActionsTest-838650631-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:36:23.183269 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-612a90ac-f7fb-4f0e-bed3-37d0860e91b7 tempest-VolumesActionsTest-838650631 tempest-VolumesActionsTest-838650631-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:36:23.184319 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-612a90ac-f7fb-4f0e-bed3-37d0860e91b7 tempest-VolumesActionsTest-838650631 tempest-VolumesActionsTest-838650631-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:36:23.186565 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-612a90ac-f7fb-4f0e-bed3-37d0860e91b7 tempest-VolumesActionsTest-838650631 tempest-VolumesActionsTest-838650631-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:36:23.187712 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-612a90ac-f7fb-4f0e-bed3-37d0860e91b7 tempest-VolumesActionsTest-838650631 tempest-VolumesActionsTest-838650631-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:36:23.188690 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-612a90ac-f7fb-4f0e-bed3-37d0860e91b7 tempest-VolumesActionsTest-838650631 tempest-VolumesActionsTest-838650631-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:36:23.547577 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-612a90ac-f7fb-4f0e-bed3-37d0860e91b7 tempest-VolumesActionsTest-838650631 tempest-VolumesActionsTest-838650631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74dc5250e8c4afe8facc79207f1d7dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a78977cb894151a194adfb34fd9751', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:36:23.556756 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-612a90ac-f7fb-4f0e-bed3-37d0860e91b7 tempest-VolumesActionsTest-838650631 tempest-VolumesActionsTest-838650631-project] 10.222.0.58 "GET /compute/v2.1/servers/a535b77c-196d-48df-bf18-516c7e89ef56" status: 200 len: 1313 microversion: 2.1 time: 0.405793 Aug 10 23:36:23.558386 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3086/5965] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:36:23 2022] GET /compute/v2.1/servers/a535b77c-196d-48df-bf18-516c7e89ef56 => generated 1313 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:36:24.579804 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-f3e8d2ae-4fd8-4920-8062-1bfedf44a798 tempest-VolumesActionsTest-838650631 tempest-VolumesActionsTest-838650631-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:36:24.581903 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-f3e8d2ae-4fd8-4920-8062-1bfedf44a798 tempest-VolumesActionsTest-838650631 tempest-VolumesActionsTest-838650631-project] [instance: a535b77c-196d-48df-bf18-516c7e89ef56] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:36:24.593232 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f3e8d2ae-4fd8-4920-8062-1bfedf44a798 tempest-VolumesActionsTest-838650631 tempest-VolumesActionsTest-838650631-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:36:24.594115 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f3e8d2ae-4fd8-4920-8062-1bfedf44a798 tempest-VolumesActionsTest-838650631 tempest-VolumesActionsTest-838650631-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:36:24.594568 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f3e8d2ae-4fd8-4920-8062-1bfedf44a798 tempest-VolumesActionsTest-838650631 tempest-VolumesActionsTest-838650631-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:36:24.595314 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f3e8d2ae-4fd8-4920-8062-1bfedf44a798 tempest-VolumesActionsTest-838650631 tempest-VolumesActionsTest-838650631-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:36:24.595780 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f3e8d2ae-4fd8-4920-8062-1bfedf44a798 tempest-VolumesActionsTest-838650631 tempest-VolumesActionsTest-838650631-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:36:24.596217 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f3e8d2ae-4fd8-4920-8062-1bfedf44a798 tempest-VolumesActionsTest-838650631 tempest-VolumesActionsTest-838650631-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:36:24.757256 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-f3e8d2ae-4fd8-4920-8062-1bfedf44a798 tempest-VolumesActionsTest-838650631 tempest-VolumesActionsTest-838650631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74dc5250e8c4afe8facc79207f1d7dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a78977cb894151a194adfb34fd9751', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:36:24.766577 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-f3e8d2ae-4fd8-4920-8062-1bfedf44a798 tempest-VolumesActionsTest-838650631 tempest-VolumesActionsTest-838650631-project] 10.222.0.58 "GET /compute/v2.1/servers/a535b77c-196d-48df-bf18-516c7e89ef56" status: 200 len: 1313 microversion: 2.1 time: 0.191710 Aug 10 23:36:24.767242 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2880/5966] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:36:24 2022] GET /compute/v2.1/servers/a535b77c-196d-48df-bf18-516c7e89ef56 => generated 1313 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:36:25.789261 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-785e1696-31e1-4f76-8600-c729e3486a0d tempest-VolumesActionsTest-838650631 tempest-VolumesActionsTest-838650631-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:36:25.789867 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-785e1696-31e1-4f76-8600-c729e3486a0d tempest-VolumesActionsTest-838650631 tempest-VolumesActionsTest-838650631-project] [instance: a535b77c-196d-48df-bf18-516c7e89ef56] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:36:25.799241 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-785e1696-31e1-4f76-8600-c729e3486a0d tempest-VolumesActionsTest-838650631 tempest-VolumesActionsTest-838650631-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:36:25.799732 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-785e1696-31e1-4f76-8600-c729e3486a0d tempest-VolumesActionsTest-838650631 tempest-VolumesActionsTest-838650631-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:36:25.800171 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-785e1696-31e1-4f76-8600-c729e3486a0d tempest-VolumesActionsTest-838650631 tempest-VolumesActionsTest-838650631-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:36:25.801101 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-785e1696-31e1-4f76-8600-c729e3486a0d tempest-VolumesActionsTest-838650631 tempest-VolumesActionsTest-838650631-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:36:25.801552 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-785e1696-31e1-4f76-8600-c729e3486a0d tempest-VolumesActionsTest-838650631 tempest-VolumesActionsTest-838650631-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:36:25.802955 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-785e1696-31e1-4f76-8600-c729e3486a0d tempest-VolumesActionsTest-838650631 tempest-VolumesActionsTest-838650631-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:36:25.972490 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-785e1696-31e1-4f76-8600-c729e3486a0d tempest-VolumesActionsTest-838650631 tempest-VolumesActionsTest-838650631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74dc5250e8c4afe8facc79207f1d7dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a78977cb894151a194adfb34fd9751', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:36:25.981907 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-785e1696-31e1-4f76-8600-c729e3486a0d tempest-VolumesActionsTest-838650631 tempest-VolumesActionsTest-838650631-project] 10.222.0.58 "GET /compute/v2.1/servers/a535b77c-196d-48df-bf18-516c7e89ef56" status: 200 len: 1313 microversion: 2.1 time: 0.196667 Aug 10 23:36:25.983138 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3087/5967] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:36:25 2022] GET /compute/v2.1/servers/a535b77c-196d-48df-bf18-516c7e89ef56 => generated 1313 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:36:27.007500 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-15d5f3db-f4cc-4adc-8d4f-92871ff4e797 tempest-VolumesActionsTest-838650631 tempest-VolumesActionsTest-838650631-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:36:27.008216 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-15d5f3db-f4cc-4adc-8d4f-92871ff4e797 tempest-VolumesActionsTest-838650631 tempest-VolumesActionsTest-838650631-project] [instance: a535b77c-196d-48df-bf18-516c7e89ef56] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:36:27.032701 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-15d5f3db-f4cc-4adc-8d4f-92871ff4e797 tempest-VolumesActionsTest-838650631 tempest-VolumesActionsTest-838650631-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:36:27.033214 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-15d5f3db-f4cc-4adc-8d4f-92871ff4e797 tempest-VolumesActionsTest-838650631 tempest-VolumesActionsTest-838650631-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:36:27.033659 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-15d5f3db-f4cc-4adc-8d4f-92871ff4e797 tempest-VolumesActionsTest-838650631 tempest-VolumesActionsTest-838650631-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:36:27.034616 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-15d5f3db-f4cc-4adc-8d4f-92871ff4e797 tempest-VolumesActionsTest-838650631 tempest-VolumesActionsTest-838650631-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:36:27.035108 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-15d5f3db-f4cc-4adc-8d4f-92871ff4e797 tempest-VolumesActionsTest-838650631 tempest-VolumesActionsTest-838650631-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:36:27.035541 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-15d5f3db-f4cc-4adc-8d4f-92871ff4e797 tempest-VolumesActionsTest-838650631 tempest-VolumesActionsTest-838650631-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:36:27.238844 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-15d5f3db-f4cc-4adc-8d4f-92871ff4e797 tempest-VolumesActionsTest-838650631 tempest-VolumesActionsTest-838650631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74dc5250e8c4afe8facc79207f1d7dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a78977cb894151a194adfb34fd9751', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:36:27.250979 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-15d5f3db-f4cc-4adc-8d4f-92871ff4e797 tempest-VolumesActionsTest-838650631 tempest-VolumesActionsTest-838650631-project] 10.222.0.58 "GET /compute/v2.1/servers/a535b77c-196d-48df-bf18-516c7e89ef56" status: 200 len: 1313 microversion: 2.1 time: 0.245202 Aug 10 23:36:27.254638 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2881/5968] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:36:27 2022] GET /compute/v2.1/servers/a535b77c-196d-48df-bf18-516c7e89ef56 => generated 1313 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:36:27.283261 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-c40c61c7-6bf0-4f7f-a36c-baa5260eaf2f req-3f70b418-5cd8-4de8-978a-8f6c4f9a5db5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a535b77c-196d-48df-bf18-516c7e89ef56", "name": "network-vif-plugged", "status": "completed", "tag": "e8137689-dec4-448a-a5eb-66052e0b2dea"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:36:27.299985 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-c40c61c7-6bf0-4f7f-a36c-baa5260eaf2f req-3f70b418-5cd8-4de8-978a-8f6c4f9a5db5 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:36:27.300449 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-c40c61c7-6bf0-4f7f-a36c-baa5260eaf2f req-3f70b418-5cd8-4de8-978a-8f6c4f9a5db5 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:36:27.300889 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-c40c61c7-6bf0-4f7f-a36c-baa5260eaf2f req-3f70b418-5cd8-4de8-978a-8f6c4f9a5db5 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:36:27.320482 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-c40c61c7-6bf0-4f7f-a36c-baa5260eaf2f req-3f70b418-5cd8-4de8-978a-8f6c4f9a5db5 service nova] Creating event network-vif-plugged:e8137689-dec4-448a-a5eb-66052e0b2dea for instance a535b77c-196d-48df-bf18-516c7e89ef56 on n-h1-850468-14 Aug 10 23:36:27.328572 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-c40c61c7-6bf0-4f7f-a36c-baa5260eaf2f req-3f70b418-5cd8-4de8-978a-8f6c4f9a5db5 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061033 Aug 10 23:36:27.329959 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3088/5969] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:36:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:36:28.280422 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-e6d4959f-a72b-4158-bbaa-504abfdace06 tempest-VolumesActionsTest-838650631 tempest-VolumesActionsTest-838650631-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:36:28.281049 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-e6d4959f-a72b-4158-bbaa-504abfdace06 tempest-VolumesActionsTest-838650631 tempest-VolumesActionsTest-838650631-project] [instance: a535b77c-196d-48df-bf18-516c7e89ef56] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:36:28.288117 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e6d4959f-a72b-4158-bbaa-504abfdace06 tempest-VolumesActionsTest-838650631 tempest-VolumesActionsTest-838650631-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:36:28.288610 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e6d4959f-a72b-4158-bbaa-504abfdace06 tempest-VolumesActionsTest-838650631 tempest-VolumesActionsTest-838650631-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:36:28.289046 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e6d4959f-a72b-4158-bbaa-504abfdace06 tempest-VolumesActionsTest-838650631 tempest-VolumesActionsTest-838650631-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:36:28.289856 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e6d4959f-a72b-4158-bbaa-504abfdace06 tempest-VolumesActionsTest-838650631 tempest-VolumesActionsTest-838650631-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:36:28.290314 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e6d4959f-a72b-4158-bbaa-504abfdace06 tempest-VolumesActionsTest-838650631 tempest-VolumesActionsTest-838650631-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:36:28.290738 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e6d4959f-a72b-4158-bbaa-504abfdace06 tempest-VolumesActionsTest-838650631 tempest-VolumesActionsTest-838650631-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:36:28.405976 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=2 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:36:28.446672 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-e6d4959f-a72b-4158-bbaa-504abfdace06 tempest-VolumesActionsTest-838650631 tempest-VolumesActionsTest-838650631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74dc5250e8c4afe8facc79207f1d7dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a78977cb894151a194adfb34fd9751', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:36:28.455522 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-e6d4959f-a72b-4158-bbaa-504abfdace06 tempest-VolumesActionsTest-838650631 tempest-VolumesActionsTest-838650631-project] 10.222.0.58 "GET /compute/v2.1/servers/a535b77c-196d-48df-bf18-516c7e89ef56" status: 200 len: 1313 microversion: 2.1 time: 0.180444 Aug 10 23:36:28.456115 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2882/5970] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:36:28 2022] GET /compute/v2.1/servers/a535b77c-196d-48df-bf18-516c7e89ef56 => generated 1313 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:36:29.474850 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=2 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:36:29.476218 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=6 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:36:29.482320 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-9b5e0ed3-3d62-4f0c-98ac-f729417da822 tempest-VolumesActionsTest-838650631 tempest-VolumesActionsTest-838650631-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:36:29.483073 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-9b5e0ed3-3d62-4f0c-98ac-f729417da822 tempest-VolumesActionsTest-838650631 tempest-VolumesActionsTest-838650631-project] [instance: a535b77c-196d-48df-bf18-516c7e89ef56] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:36:29.490929 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9b5e0ed3-3d62-4f0c-98ac-f729417da822 tempest-VolumesActionsTest-838650631 tempest-VolumesActionsTest-838650631-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:36:29.491420 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9b5e0ed3-3d62-4f0c-98ac-f729417da822 tempest-VolumesActionsTest-838650631 tempest-VolumesActionsTest-838650631-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:36:29.492033 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9b5e0ed3-3d62-4f0c-98ac-f729417da822 tempest-VolumesActionsTest-838650631 tempest-VolumesActionsTest-838650631-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:36:29.492745 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9b5e0ed3-3d62-4f0c-98ac-f729417da822 tempest-VolumesActionsTest-838650631 tempest-VolumesActionsTest-838650631-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:36:29.493202 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9b5e0ed3-3d62-4f0c-98ac-f729417da822 tempest-VolumesActionsTest-838650631 tempest-VolumesActionsTest-838650631-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:36:29.493630 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9b5e0ed3-3d62-4f0c-98ac-f729417da822 tempest-VolumesActionsTest-838650631 tempest-VolumesActionsTest-838650631-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:36:29.672264 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-9b5e0ed3-3d62-4f0c-98ac-f729417da822 tempest-VolumesActionsTest-838650631 tempest-VolumesActionsTest-838650631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74dc5250e8c4afe8facc79207f1d7dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a78977cb894151a194adfb34fd9751', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:36:29.680498 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-9b5e0ed3-3d62-4f0c-98ac-f729417da822 tempest-VolumesActionsTest-838650631 tempest-VolumesActionsTest-838650631-project] 10.222.0.58 "GET /compute/v2.1/servers/a535b77c-196d-48df-bf18-516c7e89ef56" status: 200 len: 1497 microversion: 2.1 time: 0.206540 Aug 10 23:36:29.682990 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3089/5971] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:36:29 2022] GET /compute/v2.1/servers/a535b77c-196d-48df-bf18-516c7e89ef56 => generated 1497 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:36:33.503804 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-13d1cbc4-80de-4318-8175-31bfb49208ee tempest-VolumesActionsTest-838650631 tempest-VolumesActionsTest-838650631-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:36:33.504317 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-13d1cbc4-80de-4318-8175-31bfb49208ee tempest-VolumesActionsTest-838650631 tempest-VolumesActionsTest-838650631-project] [instance: a535b77c-196d-48df-bf18-516c7e89ef56] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:36:33.511415 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-13d1cbc4-80de-4318-8175-31bfb49208ee tempest-VolumesActionsTest-838650631 tempest-VolumesActionsTest-838650631-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:36:33.511793 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-13d1cbc4-80de-4318-8175-31bfb49208ee tempest-VolumesActionsTest-838650631 tempest-VolumesActionsTest-838650631-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:36:33.513048 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-13d1cbc4-80de-4318-8175-31bfb49208ee tempest-VolumesActionsTest-838650631 tempest-VolumesActionsTest-838650631-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:36:33.513959 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-13d1cbc4-80de-4318-8175-31bfb49208ee tempest-VolumesActionsTest-838650631 tempest-VolumesActionsTest-838650631-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:36:33.514578 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-13d1cbc4-80de-4318-8175-31bfb49208ee tempest-VolumesActionsTest-838650631 tempest-VolumesActionsTest-838650631-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:36:33.515194 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-13d1cbc4-80de-4318-8175-31bfb49208ee tempest-VolumesActionsTest-838650631 tempest-VolumesActionsTest-838650631-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:36:33.551397 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-13d1cbc4-80de-4318-8175-31bfb49208ee tempest-VolumesActionsTest-838650631 tempest-VolumesActionsTest-838650631-project] [instance: a535b77c-196d-48df-bf18-516c7e89ef56] Going to try to terminate instance {{(pid=122632) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:36:33.645027 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-13d1cbc4-80de-4318-8175-31bfb49208ee tempest-VolumesActionsTest-838650631 tempest-VolumesActionsTest-838650631-project] 10.222.0.58 "DELETE /compute/v2.1/servers/a535b77c-196d-48df-bf18-516c7e89ef56" status: 204 len: 0 microversion: 2.1 time: 0.144804 Aug 10 23:36:33.645618 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2883/5972] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:36:33 2022] DELETE /compute/v2.1/servers/a535b77c-196d-48df-bf18-516c7e89ef56 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:36:33.655953 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-37216224-a3e4-4b1a-a3d1-38fa21bab242 tempest-VolumesActionsTest-838650631 tempest-VolumesActionsTest-838650631-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:36:33.656684 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-37216224-a3e4-4b1a-a3d1-38fa21bab242 tempest-VolumesActionsTest-838650631 tempest-VolumesActionsTest-838650631-project] [instance: a535b77c-196d-48df-bf18-516c7e89ef56] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:36:33.665503 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-37216224-a3e4-4b1a-a3d1-38fa21bab242 tempest-VolumesActionsTest-838650631 tempest-VolumesActionsTest-838650631-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:36:33.666061 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-37216224-a3e4-4b1a-a3d1-38fa21bab242 tempest-VolumesActionsTest-838650631 tempest-VolumesActionsTest-838650631-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:36:33.666568 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-37216224-a3e4-4b1a-a3d1-38fa21bab242 tempest-VolumesActionsTest-838650631 tempest-VolumesActionsTest-838650631-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:36:33.667367 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-37216224-a3e4-4b1a-a3d1-38fa21bab242 tempest-VolumesActionsTest-838650631 tempest-VolumesActionsTest-838650631-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:36:33.667943 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-37216224-a3e4-4b1a-a3d1-38fa21bab242 tempest-VolumesActionsTest-838650631 tempest-VolumesActionsTest-838650631-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:36:33.668405 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-37216224-a3e4-4b1a-a3d1-38fa21bab242 tempest-VolumesActionsTest-838650631 tempest-VolumesActionsTest-838650631-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:36:33.830087 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-37216224-a3e4-4b1a-a3d1-38fa21bab242 tempest-VolumesActionsTest-838650631 tempest-VolumesActionsTest-838650631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74dc5250e8c4afe8facc79207f1d7dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a78977cb894151a194adfb34fd9751', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:36:33.838102 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-37216224-a3e4-4b1a-a3d1-38fa21bab242 tempest-VolumesActionsTest-838650631 tempest-VolumesActionsTest-838650631-project] 10.222.0.58 "GET /compute/v2.1/servers/a535b77c-196d-48df-bf18-516c7e89ef56" status: 200 len: 1503 microversion: 2.1 time: 0.187980 Aug 10 23:36:33.839146 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3090/5973] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:36:33 2022] GET /compute/v2.1/servers/a535b77c-196d-48df-bf18-516c7e89ef56 => generated 1503 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:36:34.861257 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-bdd430fe-4a8f-4acd-b41b-2661bb77355c tempest-VolumesActionsTest-838650631 tempest-VolumesActionsTest-838650631-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:36:34.861963 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-bdd430fe-4a8f-4acd-b41b-2661bb77355c tempest-VolumesActionsTest-838650631 tempest-VolumesActionsTest-838650631-project] [instance: a535b77c-196d-48df-bf18-516c7e89ef56] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:36:34.869689 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bdd430fe-4a8f-4acd-b41b-2661bb77355c tempest-VolumesActionsTest-838650631 tempest-VolumesActionsTest-838650631-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:36:34.870187 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bdd430fe-4a8f-4acd-b41b-2661bb77355c tempest-VolumesActionsTest-838650631 tempest-VolumesActionsTest-838650631-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:36:34.870630 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bdd430fe-4a8f-4acd-b41b-2661bb77355c tempest-VolumesActionsTest-838650631 tempest-VolumesActionsTest-838650631-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:36:34.871371 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bdd430fe-4a8f-4acd-b41b-2661bb77355c tempest-VolumesActionsTest-838650631 tempest-VolumesActionsTest-838650631-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:36:34.871825 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bdd430fe-4a8f-4acd-b41b-2661bb77355c tempest-VolumesActionsTest-838650631 tempest-VolumesActionsTest-838650631-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:36:34.872883 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bdd430fe-4a8f-4acd-b41b-2661bb77355c tempest-VolumesActionsTest-838650631 tempest-VolumesActionsTest-838650631-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:36:35.021360 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-bdd430fe-4a8f-4acd-b41b-2661bb77355c tempest-VolumesActionsTest-838650631 tempest-VolumesActionsTest-838650631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd74dc5250e8c4afe8facc79207f1d7dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b8a78977cb894151a194adfb34fd9751', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:36:35.032054 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-bdd430fe-4a8f-4acd-b41b-2661bb77355c tempest-VolumesActionsTest-838650631 tempest-VolumesActionsTest-838650631-project] 10.222.0.58 "GET /compute/v2.1/servers/a535b77c-196d-48df-bf18-516c7e89ef56" status: 200 len: 1503 microversion: 2.1 time: 0.175966 Aug 10 23:36:35.033957 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2884/5974] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:36:34 2022] GET /compute/v2.1/servers/a535b77c-196d-48df-bf18-516c7e89ef56 => generated 1503 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:36:35.480250 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-0726482e-fc74-4ec6-8949-8d372095da02 req-eeae7885-77ee-49f8-892c-0112b2e4f009 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a535b77c-196d-48df-bf18-516c7e89ef56", "name": "network-vif-deleted", "tag": "e8137689-dec4-448a-a5eb-66052e0b2dea"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:36:35.492925 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-0726482e-fc74-4ec6-8949-8d372095da02 req-eeae7885-77ee-49f8-892c-0112b2e4f009 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:36:35.493845 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-0726482e-fc74-4ec6-8949-8d372095da02 req-eeae7885-77ee-49f8-892c-0112b2e4f009 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:36:35.494442 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-0726482e-fc74-4ec6-8949-8d372095da02 req-eeae7885-77ee-49f8-892c-0112b2e4f009 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:36:35.509678 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-0726482e-fc74-4ec6-8949-8d372095da02 req-eeae7885-77ee-49f8-892c-0112b2e4f009 service nova] Creating event network-vif-deleted:e8137689-dec4-448a-a5eb-66052e0b2dea for instance a535b77c-196d-48df-bf18-516c7e89ef56 on n-h1-850468-14 Aug 10 23:36:35.538646 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-0726482e-fc74-4ec6-8949-8d372095da02 req-eeae7885-77ee-49f8-892c-0112b2e4f009 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062146 Aug 10 23:36:35.539350 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3091/5975] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:36:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:36:36.054694 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-3dfb56f7-bdfb-412a-88f0-a744c3d4e7a6 tempest-VolumesActionsTest-838650631 tempest-VolumesActionsTest-838650631-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:36:36.055468 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-3dfb56f7-bdfb-412a-88f0-a744c3d4e7a6 tempest-VolumesActionsTest-838650631 tempest-VolumesActionsTest-838650631-project] [instance: a535b77c-196d-48df-bf18-516c7e89ef56] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:36:36.066491 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3dfb56f7-bdfb-412a-88f0-a744c3d4e7a6 tempest-VolumesActionsTest-838650631 tempest-VolumesActionsTest-838650631-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:36:36.067317 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3dfb56f7-bdfb-412a-88f0-a744c3d4e7a6 tempest-VolumesActionsTest-838650631 tempest-VolumesActionsTest-838650631-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:36:36.067918 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3dfb56f7-bdfb-412a-88f0-a744c3d4e7a6 tempest-VolumesActionsTest-838650631 tempest-VolumesActionsTest-838650631-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:36:36.068624 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3dfb56f7-bdfb-412a-88f0-a744c3d4e7a6 tempest-VolumesActionsTest-838650631 tempest-VolumesActionsTest-838650631-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:36:36.069301 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3dfb56f7-bdfb-412a-88f0-a744c3d4e7a6 tempest-VolumesActionsTest-838650631 tempest-VolumesActionsTest-838650631-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:36:36.069946 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3dfb56f7-bdfb-412a-88f0-a744c3d4e7a6 tempest-VolumesActionsTest-838650631 tempest-VolumesActionsTest-838650631-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:36:36.086907 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-3dfb56f7-bdfb-412a-88f0-a744c3d4e7a6 tempest-VolumesActionsTest-838650631 tempest-VolumesActionsTest-838650631-project] HTTP exception thrown: Instance a535b77c-196d-48df-bf18-516c7e89ef56 could not be found. Aug 10 23:36:36.088873 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-3dfb56f7-bdfb-412a-88f0-a744c3d4e7a6 tempest-VolumesActionsTest-838650631 tempest-VolumesActionsTest-838650631-project] Request method failure captured: Aug 10 23:36:36.088873 n-d-850468-14 devstack@n-api.service[122632]: request: GET /compute/v2.1/servers/a535b77c-196d-48df-bf18-516c7e89ef56 HTTP/1.1 Aug 10 23:36:36.088873 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:36:36.088873 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:36:36.088873 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:36:36.088873 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 23:36:36.088873 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:36:36.088873 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:36:36.088873 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:36:36.088873 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:36:36.088873 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9EDv1-5DZLUMAz-O29REXVJMWtS8kKeGhfX_vvKq7NTZj9ShJya2t4RME_ZgD0TXz1YkCzFqR77OfNC7hCu6Zv8z31IeBdSno72OE_uJJ4WiF9aK1Ga6PnhkU6cb19ybXHv2fEZSulTBBvvku_CzkKVVyJz2APaZyFcAhfbcohNqCH0 Aug 10 23:36:36.088873 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:36:36.088873 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:36:36.088873 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:36:36.088873 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:36:36.088873 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:36:36.088873 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:36:36.088873 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: b8a78977cb894151a194adfb34fd9751 Aug 10 23:36:36.088873 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-VolumesActionsTest-838650631 Aug 10 23:36:36.088873 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:36:36.088873 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:36:36.088873 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b8a78977cb894151a194adfb34fd9751"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/b8a78977cb894151a194adfb34fd9751"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/b8a78977cb894151a194adfb34fd9751"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_b8a78977cb894151a194adfb34fd9751", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:36:36.088873 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-VolumesActionsTest-838650631 Aug 10 23:36:36.088873 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: b8a78977cb894151a194adfb34fd9751 Aug 10 23:36:36.088873 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-VolumesActionsTest-838650631 Aug 10 23:36:36.088873 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-VolumesActionsTest-838650631-project Aug 10 23:36:36.088873 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:36:36.088873 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:36:36.088873 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: d74dc5250e8c4afe8facc79207f1d7dd Aug 10 23:36:36.088873 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-VolumesActionsTest-838650631-project Aug 10 23:36:36.088873 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:36:36.088873 n-d-850468-14 devstack@n-api.service[122632]: exception: Instance a535b77c-196d-48df-bf18-516c7e89ef56 could not be found. Aug 10 23:36:36.088873 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': 'a535b77c-196d-48df-bf18-516c7e89ef56'} Aug 10 23:36:36.088873 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:36:36.088873 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:36:36.088873 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:36:36.088873 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:36:36.088873 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:36:36.088873 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:36:36.088873 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:36:36.088873 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:36:36.088873 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:36:36.088873 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:36:36.088873 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a535b77c-196d-48df-bf18-516c7e89ef56 could not be found. Aug 10 23:36:36.088873 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:36:36.088873 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:36:36.088873 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:36:36.088873 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:36:36.088873 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:36:36.088873 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:36:36.088873 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:36:36.088873 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:36:36.088873 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:36:36.088873 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:36:36.088873 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:36:36.088873 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:36:36.088873 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:36:36.088873 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:36:36.088873 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:36:36.088873 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:36:36.088873 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a535b77c-196d-48df-bf18-516c7e89ef56 could not be found. Aug 10 23:36:36.088873 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:36:36.088873 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:36:36.088873 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:36:36.093620 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:36:36.093620 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:36:36.093620 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:36:36.093620 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:36:36.093620 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:36:36.093620 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a535b77c-196d-48df-bf18-516c7e89ef56 could not be found. Aug 10 23:36:36.093620 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:36:36.095816 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-3dfb56f7-bdfb-412a-88f0-a744c3d4e7a6 tempest-VolumesActionsTest-838650631 tempest-VolumesActionsTest-838650631-project] Returning 404 to user: Instance a535b77c-196d-48df-bf18-516c7e89ef56 could not be found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:36:36.097480 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-3dfb56f7-bdfb-412a-88f0-a744c3d4e7a6 tempest-VolumesActionsTest-838650631 tempest-VolumesActionsTest-838650631-project] 10.222.0.58 "GET /compute/v2.1/servers/a535b77c-196d-48df-bf18-516c7e89ef56" status: 404 len: 111 microversion: 2.1 time: 0.047534 Aug 10 23:36:36.098107 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2885/5976] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:36:36 2022] GET /compute/v2.1/servers/a535b77c-196d-48df-bf18-516c7e89ef56 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:37:07.048321 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:37:07.049535 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=38 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:37:07.432492 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-0298727e-5a4e-4fb1-bca6-40f7db197006 tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Action: 'create', calling method: .version_select at 0x7f847d254c10>, body: {"keypair": {"name": "tempest-TestServerBasicOps-696183268", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA/K1oMuN5CIIPcxmzFS1IE7EjrcAsIqPuP5DoQkD3ZFx+GxQCSr1XQPL3YTKnRmiLcc1DEf+lUbChPAXUs7hcz/LiI3JQkeIe2iXm/StZxEVRu1SiY0konhPZTnOtRf6w=="}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:37:07.477968 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-0298727e-5a4e-4fb1-bca6-40f7db197006 tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Getting quotas for project ce0de2d097a542e9b80d9bcb87299467. Resources: {'key_pairs'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:37:07.490587 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-0298727e-5a4e-4fb1-bca6-40f7db197006 tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Getting quotas for user 5115cfabf810465289e5a21b926bce6c and project ce0de2d097a542e9b80d9bcb87299467. Resources: {'key_pairs'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:37:07.538316 n-d-850468-14 devstack@n-api.service[122633]: ERROR oslo.messaging._drivers.impl_rabbit [None req-0298727e-5a4e-4fb1-bca6-40f7db197006 tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] [e2f225cb-bf19-4d7b-8a8a-277b90e5ad43] AMQP server on 10.222.0.58:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 10 23:37:08.545960 n-d-850468-14 devstack@n-api.service[122633]: INFO oslo.messaging._drivers.impl_rabbit [None req-0298727e-5a4e-4fb1-bca6-40f7db197006 tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] [e2f225cb-bf19-4d7b-8a8a-277b90e5ad43] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 60866. Aug 10 23:37:08.571141 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-0298727e-5a4e-4fb1-bca6-40f7db197006 tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 1.530284 Aug 10 23:37:08.579328 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3092/5977] 10.222.0.58 () {60 vars in 1159 bytes} [Wed Aug 10 23:37:07 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 1539 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:37:09.346153 n-d-850468-14 devstack@n-api.service[122632]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 23:37:09.346687 n-d-850468-14 devstack@n-api.service[122632]: Wed Aug 10 23:37:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 23:37:10.299641 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-5e29761f-3aa5-4885-bdde-6ab80786c5bd tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-835502075", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-696183268", "security_groups": [{"name": "tempest-secgroup-smoke-342344264"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "73e199ab-fb13-431d-a9b3-f9e71cde0ecb"}]}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:37:10.317868 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_api:SELECT=25,nova_api:UPDATE=1 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:37:10.318902 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:37:10.468089 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.network.neutron [None req-5e29761f-3aa5-4885-bdde-6ab80786c5bd tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] validate_networks() for [('73e199ab-fb13-431d-a9b3-f9e71cde0ecb', None, None, None, None, None)] {{(pid=122632) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 23:37:11.185943 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-5e29761f-3aa5-4885-bdde-6ab80786c5bd tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Getting quotas for project ce0de2d097a542e9b80d9bcb87299467. Resources: dict_keys(['metadata_items']) {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:37:11.192488 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-5e29761f-3aa5-4885-bdde-6ab80786c5bd tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Getting quotas for user 5115cfabf810465289e5a21b926bce6c and project ce0de2d097a542e9b80d9bcb87299467. Resources: dict_keys(['metadata_items']) {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:37:11.235471 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-5e29761f-3aa5-4885-bdde-6ab80786c5bd tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Flavor limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:37:11.236268 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-5e29761f-3aa5-4885-bdde-6ab80786c5bd tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Image limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:37:11.236971 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-5e29761f-3aa5-4885-bdde-6ab80786c5bd tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Flavor pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:37:11.237594 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-5e29761f-3aa5-4885-bdde-6ab80786c5bd tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Image pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:37:11.238197 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-5e29761f-3aa5-4885-bdde-6ab80786c5bd tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:37:11.250284 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5e29761f-3aa5-4885-bdde-6ab80786c5bd tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:37:11.251540 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5e29761f-3aa5-4885-bdde-6ab80786c5bd tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:37:11.252480 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5e29761f-3aa5-4885-bdde-6ab80786c5bd tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:37:11.254150 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5e29761f-3aa5-4885-bdde-6ab80786c5bd tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:37:11.255073 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5e29761f-3aa5-4885-bdde-6ab80786c5bd tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:37:11.255721 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5e29761f-3aa5-4885-bdde-6ab80786c5bd tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:37:11.291339 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-5e29761f-3aa5-4885-bdde-6ab80786c5bd tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Getting quotas for project ce0de2d097a542e9b80d9bcb87299467. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:37:11.301147 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-5e29761f-3aa5-4885-bdde-6ab80786c5bd tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Getting quotas for user 5115cfabf810465289e5a21b926bce6c and project ce0de2d097a542e9b80d9bcb87299467. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:37:11.356315 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-5e29761f-3aa5-4885-bdde-6ab80786c5bd tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Going to run 1 instances... {{(pid=122632) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 23:37:11.364777 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-5e29761f-3aa5-4885-bdde-6ab80786c5bd tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] [instance: 8bd23351-3cb0-423c-ba5e-33a8ba3c3db4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78ad8905-f66f-4733-8be9-2b260f1fabed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122632) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 23:37:11.510053 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-5e29761f-3aa5-4885-bdde-6ab80786c5bd tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.214507 Aug 10 23:37:11.517365 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2886/5978] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 23:37:10 2022] POST /compute/v2.1/servers => generated 405 bytes in 1223 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 23:37:11.529824 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-e9b2c5fc-e430-4c2a-9528-d3f4e4a83b5f tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:37:11.531317 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-e9b2c5fc-e430-4c2a-9528-d3f4e4a83b5f tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] [instance: 8bd23351-3cb0-423c-ba5e-33a8ba3c3db4] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:37:11.656857 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-e9b2c5fc-e430-4c2a-9528-d3f4e4a83b5f tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5115cfabf810465289e5a21b926bce6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0de2d097a542e9b80d9bcb87299467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:37:11.671010 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-e9b2c5fc-e430-4c2a-9528-d3f4e4a83b5f tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] 10.222.0.58 "GET /compute/v2.1/servers/8bd23351-3cb0-423c-ba5e-33a8ba3c3db4" status: 200 len: 1301 microversion: 2.1 time: 0.145656 Aug 10 23:37:11.671960 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3093/5979] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:37:11 2022] GET /compute/v2.1/servers/8bd23351-3cb0-423c-ba5e-33a8ba3c3db4 => generated 1301 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:37:12.698261 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-2addf14a-973f-4cbf-910d-62a97663ba39 tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:37:12.699692 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-2addf14a-973f-4cbf-910d-62a97663ba39 tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] [instance: 8bd23351-3cb0-423c-ba5e-33a8ba3c3db4] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:37:12.710309 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2addf14a-973f-4cbf-910d-62a97663ba39 tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:37:12.711084 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2addf14a-973f-4cbf-910d-62a97663ba39 tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:37:12.711894 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2addf14a-973f-4cbf-910d-62a97663ba39 tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:37:12.712901 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2addf14a-973f-4cbf-910d-62a97663ba39 tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:37:12.713539 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2addf14a-973f-4cbf-910d-62a97663ba39 tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:37:12.714289 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2addf14a-973f-4cbf-910d-62a97663ba39 tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:37:12.807571 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-2addf14a-973f-4cbf-910d-62a97663ba39 tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5115cfabf810465289e5a21b926bce6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0de2d097a542e9b80d9bcb87299467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:37:12.819393 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-2addf14a-973f-4cbf-910d-62a97663ba39 tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] 10.222.0.58 "GET /compute/v2.1/servers/8bd23351-3cb0-423c-ba5e-33a8ba3c3db4" status: 200 len: 1305 microversion: 2.1 time: 0.128214 Aug 10 23:37:12.819978 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2887/5980] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:37:12 2022] GET /compute/v2.1/servers/8bd23351-3cb0-423c-ba5e-33a8ba3c3db4 => generated 1305 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:37:13.844208 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-341a8de0-ca39-4fb3-94f6-34e7c630ba8a tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:37:13.845651 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-341a8de0-ca39-4fb3-94f6-34e7c630ba8a tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] [instance: 8bd23351-3cb0-423c-ba5e-33a8ba3c3db4] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:37:13.861005 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-341a8de0-ca39-4fb3-94f6-34e7c630ba8a tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:37:13.862728 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-341a8de0-ca39-4fb3-94f6-34e7c630ba8a tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:37:13.863691 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-341a8de0-ca39-4fb3-94f6-34e7c630ba8a tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:37:13.865125 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-341a8de0-ca39-4fb3-94f6-34e7c630ba8a tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:37:13.866139 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-341a8de0-ca39-4fb3-94f6-34e7c630ba8a tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:37:13.867827 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-341a8de0-ca39-4fb3-94f6-34e7c630ba8a tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:37:13.986237 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-341a8de0-ca39-4fb3-94f6-34e7c630ba8a tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5115cfabf810465289e5a21b926bce6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0de2d097a542e9b80d9bcb87299467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:37:13.995706 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-341a8de0-ca39-4fb3-94f6-34e7c630ba8a tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] 10.222.0.58 "GET /compute/v2.1/servers/8bd23351-3cb0-423c-ba5e-33a8ba3c3db4" status: 200 len: 1353 microversion: 2.1 time: 0.157528 Aug 10 23:37:13.996724 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3094/5981] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:37:13 2022] GET /compute/v2.1/servers/8bd23351-3cb0-423c-ba5e-33a8ba3c3db4 => generated 1353 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:37:15.036216 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-e8174f68-0b49-4cd3-bb79-cdcbf87e877d tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:37:15.036845 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-e8174f68-0b49-4cd3-bb79-cdcbf87e877d tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] [instance: 8bd23351-3cb0-423c-ba5e-33a8ba3c3db4] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:37:15.052960 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e8174f68-0b49-4cd3-bb79-cdcbf87e877d tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:37:15.053564 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e8174f68-0b49-4cd3-bb79-cdcbf87e877d tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:37:15.054269 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e8174f68-0b49-4cd3-bb79-cdcbf87e877d tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:37:15.055988 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e8174f68-0b49-4cd3-bb79-cdcbf87e877d tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:37:15.057563 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e8174f68-0b49-4cd3-bb79-cdcbf87e877d tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:37:15.058122 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e8174f68-0b49-4cd3-bb79-cdcbf87e877d tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:37:15.385881 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-e8174f68-0b49-4cd3-bb79-cdcbf87e877d tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5115cfabf810465289e5a21b926bce6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0de2d097a542e9b80d9bcb87299467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:37:15.427712 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-e8174f68-0b49-4cd3-bb79-cdcbf87e877d tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] 10.222.0.58 "GET /compute/v2.1/servers/8bd23351-3cb0-423c-ba5e-33a8ba3c3db4" status: 200 len: 1426 microversion: 2.1 time: 0.399503 Aug 10 23:37:15.428322 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2888/5982] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:37:15 2022] GET /compute/v2.1/servers/8bd23351-3cb0-423c-ba5e-33a8ba3c3db4 => generated 1426 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:37:16.379100 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-62348826-cbdc-4af7-a291-2507d7493c63 req-4a004ce5-c07d-4051-93fa-a84f0f7e3516 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8bd23351-3cb0-423c-ba5e-33a8ba3c3db4", "tag": "2980f5cb-3090-4531-8d5e-04c67cae8340"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:37:16.413238 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-62348826-cbdc-4af7-a291-2507d7493c63 req-4a004ce5-c07d-4051-93fa-a84f0f7e3516 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:37:16.415398 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-62348826-cbdc-4af7-a291-2507d7493c63 req-4a004ce5-c07d-4051-93fa-a84f0f7e3516 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:37:16.415918 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-62348826-cbdc-4af7-a291-2507d7493c63 req-4a004ce5-c07d-4051-93fa-a84f0f7e3516 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:37:16.451302 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-bf98c4d3-4025-482b-8ec3-44bedac6c766 tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:37:16.453527 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-bf98c4d3-4025-482b-8ec3-44bedac6c766 tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] [instance: 8bd23351-3cb0-423c-ba5e-33a8ba3c3db4] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:37:16.464762 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-62348826-cbdc-4af7-a291-2507d7493c63 req-4a004ce5-c07d-4051-93fa-a84f0f7e3516 service nova] Creating event network-changed:2980f5cb-3090-4531-8d5e-04c67cae8340 for instance 8bd23351-3cb0-423c-ba5e-33a8ba3c3db4 on n-h1-850468-14 Aug 10 23:37:16.467105 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bf98c4d3-4025-482b-8ec3-44bedac6c766 tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:37:16.467984 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bf98c4d3-4025-482b-8ec3-44bedac6c766 tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:37:16.468362 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bf98c4d3-4025-482b-8ec3-44bedac6c766 tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:37:16.469755 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bf98c4d3-4025-482b-8ec3-44bedac6c766 tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:37:16.469755 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bf98c4d3-4025-482b-8ec3-44bedac6c766 tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:37:16.470864 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bf98c4d3-4025-482b-8ec3-44bedac6c766 tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:37:16.480216 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-62348826-cbdc-4af7-a291-2507d7493c63 req-4a004ce5-c07d-4051-93fa-a84f0f7e3516 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105224 Aug 10 23:37:16.481042 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3095/5983] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:37:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:37:16.707314 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-bf98c4d3-4025-482b-8ec3-44bedac6c766 tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5115cfabf810465289e5a21b926bce6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0de2d097a542e9b80d9bcb87299467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:37:16.718660 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-bf98c4d3-4025-482b-8ec3-44bedac6c766 tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] 10.222.0.58 "GET /compute/v2.1/servers/8bd23351-3cb0-423c-ba5e-33a8ba3c3db4" status: 200 len: 1426 microversion: 2.1 time: 0.270638 Aug 10 23:37:16.719907 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2889/5984] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:37:16 2022] GET /compute/v2.1/servers/8bd23351-3cb0-423c-ba5e-33a8ba3c3db4 => generated 1426 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:37:17.751869 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-7ec6d564-2b10-4560-bf2c-de8ff5a11c82 tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:37:17.753448 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-7ec6d564-2b10-4560-bf2c-de8ff5a11c82 tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] [instance: 8bd23351-3cb0-423c-ba5e-33a8ba3c3db4] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:37:17.763510 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7ec6d564-2b10-4560-bf2c-de8ff5a11c82 tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:37:17.764282 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7ec6d564-2b10-4560-bf2c-de8ff5a11c82 tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:37:17.764979 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7ec6d564-2b10-4560-bf2c-de8ff5a11c82 tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:37:17.766550 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7ec6d564-2b10-4560-bf2c-de8ff5a11c82 tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:37:17.767361 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7ec6d564-2b10-4560-bf2c-de8ff5a11c82 tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:37:17.767919 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7ec6d564-2b10-4560-bf2c-de8ff5a11c82 tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:37:18.027503 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-7ec6d564-2b10-4560-bf2c-de8ff5a11c82 tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5115cfabf810465289e5a21b926bce6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0de2d097a542e9b80d9bcb87299467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:37:18.042318 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-7ec6d564-2b10-4560-bf2c-de8ff5a11c82 tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] 10.222.0.58 "GET /compute/v2.1/servers/8bd23351-3cb0-423c-ba5e-33a8ba3c3db4" status: 200 len: 1426 microversion: 2.1 time: 0.296930 Aug 10 23:37:18.043657 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3096/5985] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:37:17 2022] GET /compute/v2.1/servers/8bd23351-3cb0-423c-ba5e-33a8ba3c3db4 => generated 1426 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:37:19.067799 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-2e1a3cc0-2154-410d-99fc-50fe99a2e41d tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:37:19.069408 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-2e1a3cc0-2154-410d-99fc-50fe99a2e41d tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] [instance: 8bd23351-3cb0-423c-ba5e-33a8ba3c3db4] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:37:19.083501 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2e1a3cc0-2154-410d-99fc-50fe99a2e41d tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:37:19.085731 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2e1a3cc0-2154-410d-99fc-50fe99a2e41d tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:37:19.086417 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2e1a3cc0-2154-410d-99fc-50fe99a2e41d tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:37:19.088906 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2e1a3cc0-2154-410d-99fc-50fe99a2e41d tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:37:19.089846 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2e1a3cc0-2154-410d-99fc-50fe99a2e41d tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:37:19.090499 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2e1a3cc0-2154-410d-99fc-50fe99a2e41d tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:37:19.262720 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-2e1a3cc0-2154-410d-99fc-50fe99a2e41d tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5115cfabf810465289e5a21b926bce6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0de2d097a542e9b80d9bcb87299467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:37:19.272180 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-2e1a3cc0-2154-410d-99fc-50fe99a2e41d tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] 10.222.0.58 "GET /compute/v2.1/servers/8bd23351-3cb0-423c-ba5e-33a8ba3c3db4" status: 200 len: 1426 microversion: 2.1 time: 0.212154 Aug 10 23:37:19.272923 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2890/5986] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:37:19 2022] GET /compute/v2.1/servers/8bd23351-3cb0-423c-ba5e-33a8ba3c3db4 => generated 1426 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:37:20.293779 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-50926a34-d5ee-48e4-bac4-606b917b7977 tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:37:20.295764 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-50926a34-d5ee-48e4-bac4-606b917b7977 tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] [instance: 8bd23351-3cb0-423c-ba5e-33a8ba3c3db4] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:37:20.303491 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-50926a34-d5ee-48e4-bac4-606b917b7977 tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:37:20.304209 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-50926a34-d5ee-48e4-bac4-606b917b7977 tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:37:20.304723 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-50926a34-d5ee-48e4-bac4-606b917b7977 tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:37:20.305604 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-50926a34-d5ee-48e4-bac4-606b917b7977 tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:37:20.306136 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-50926a34-d5ee-48e4-bac4-606b917b7977 tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:37:20.306640 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-50926a34-d5ee-48e4-bac4-606b917b7977 tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:37:20.465803 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-50926a34-d5ee-48e4-bac4-606b917b7977 tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5115cfabf810465289e5a21b926bce6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0de2d097a542e9b80d9bcb87299467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:37:20.474398 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-50926a34-d5ee-48e4-bac4-606b917b7977 tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] 10.222.0.58 "GET /compute/v2.1/servers/8bd23351-3cb0-423c-ba5e-33a8ba3c3db4" status: 200 len: 1426 microversion: 2.1 time: 0.184653 Aug 10 23:37:20.475187 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3097/5987] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:37:20 2022] GET /compute/v2.1/servers/8bd23351-3cb0-423c-ba5e-33a8ba3c3db4 => generated 1426 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:37:21.502857 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-74609a40-6f78-4bf7-bbec-dd06b8d8273c tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:37:21.503508 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-74609a40-6f78-4bf7-bbec-dd06b8d8273c tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] [instance: 8bd23351-3cb0-423c-ba5e-33a8ba3c3db4] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:37:21.508238 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=2 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:37:21.509634 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=10 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:37:21.515140 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-74609a40-6f78-4bf7-bbec-dd06b8d8273c tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:37:21.515838 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-74609a40-6f78-4bf7-bbec-dd06b8d8273c tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:37:21.516436 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-74609a40-6f78-4bf7-bbec-dd06b8d8273c tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:37:21.517344 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-74609a40-6f78-4bf7-bbec-dd06b8d8273c tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:37:21.517945 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-74609a40-6f78-4bf7-bbec-dd06b8d8273c tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:37:21.518527 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-74609a40-6f78-4bf7-bbec-dd06b8d8273c tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:37:21.686710 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-74609a40-6f78-4bf7-bbec-dd06b8d8273c tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5115cfabf810465289e5a21b926bce6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0de2d097a542e9b80d9bcb87299467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:37:21.696114 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-74609a40-6f78-4bf7-bbec-dd06b8d8273c tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] 10.222.0.58 "GET /compute/v2.1/servers/8bd23351-3cb0-423c-ba5e-33a8ba3c3db4" status: 200 len: 1426 microversion: 2.1 time: 0.203903 Aug 10 23:37:21.697390 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2891/5988] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:37:21 2022] GET /compute/v2.1/servers/8bd23351-3cb0-423c-ba5e-33a8ba3c3db4 => generated 1426 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:37:22.719885 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-4ff53efa-43d2-4546-9637-5dffed25f7e2 tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:37:22.720506 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-4ff53efa-43d2-4546-9637-5dffed25f7e2 tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] [instance: 8bd23351-3cb0-423c-ba5e-33a8ba3c3db4] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:37:22.724029 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=6 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:37:22.735269 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4ff53efa-43d2-4546-9637-5dffed25f7e2 tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:37:22.735762 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4ff53efa-43d2-4546-9637-5dffed25f7e2 tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:37:22.739390 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4ff53efa-43d2-4546-9637-5dffed25f7e2 tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:37:22.740184 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4ff53efa-43d2-4546-9637-5dffed25f7e2 tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:37:22.740660 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4ff53efa-43d2-4546-9637-5dffed25f7e2 tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:37:22.741100 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4ff53efa-43d2-4546-9637-5dffed25f7e2 tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:37:22.897910 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-4ff53efa-43d2-4546-9637-5dffed25f7e2 tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5115cfabf810465289e5a21b926bce6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0de2d097a542e9b80d9bcb87299467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:37:22.906842 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-4ff53efa-43d2-4546-9637-5dffed25f7e2 tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] 10.222.0.58 "GET /compute/v2.1/servers/8bd23351-3cb0-423c-ba5e-33a8ba3c3db4" status: 200 len: 1426 microversion: 2.1 time: 0.193395 Aug 10 23:37:22.907517 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3098/5989] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:37:22 2022] GET /compute/v2.1/servers/8bd23351-3cb0-423c-ba5e-33a8ba3c3db4 => generated 1426 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:37:23.558617 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-6a25aaca-bd69-4660-aac9-d63caf07147c req-d3cb35b8-69df-45cd-a7b7-9a2e8ec76af3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8bd23351-3cb0-423c-ba5e-33a8ba3c3db4", "name": "network-vif-plugged", "status": "completed", "tag": "2980f5cb-3090-4531-8d5e-04c67cae8340"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:37:23.569137 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-6a25aaca-bd69-4660-aac9-d63caf07147c req-d3cb35b8-69df-45cd-a7b7-9a2e8ec76af3 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:37:23.569898 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-6a25aaca-bd69-4660-aac9-d63caf07147c req-d3cb35b8-69df-45cd-a7b7-9a2e8ec76af3 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:37:23.570335 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-6a25aaca-bd69-4660-aac9-d63caf07147c req-d3cb35b8-69df-45cd-a7b7-9a2e8ec76af3 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:37:23.583312 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-6a25aaca-bd69-4660-aac9-d63caf07147c req-d3cb35b8-69df-45cd-a7b7-9a2e8ec76af3 service nova] Creating event network-vif-plugged:2980f5cb-3090-4531-8d5e-04c67cae8340 for instance 8bd23351-3cb0-423c-ba5e-33a8ba3c3db4 on n-h1-850468-14 Aug 10 23:37:23.588775 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-6a25aaca-bd69-4660-aac9-d63caf07147c req-d3cb35b8-69df-45cd-a7b7-9a2e8ec76af3 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.191504 Aug 10 23:37:23.589373 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2892/5990] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:37:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:37:23.928637 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-f77866aa-0262-4f50-a948-2319145fd878 tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:37:23.929388 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-f77866aa-0262-4f50-a948-2319145fd878 tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] [instance: 8bd23351-3cb0-423c-ba5e-33a8ba3c3db4] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:37:23.936762 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f77866aa-0262-4f50-a948-2319145fd878 tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:37:23.937341 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f77866aa-0262-4f50-a948-2319145fd878 tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:37:23.937848 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f77866aa-0262-4f50-a948-2319145fd878 tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:37:23.938630 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f77866aa-0262-4f50-a948-2319145fd878 tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:37:23.939174 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f77866aa-0262-4f50-a948-2319145fd878 tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:37:23.939739 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f77866aa-0262-4f50-a948-2319145fd878 tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:37:24.096949 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-f77866aa-0262-4f50-a948-2319145fd878 tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5115cfabf810465289e5a21b926bce6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0de2d097a542e9b80d9bcb87299467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:37:24.110146 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-f77866aa-0262-4f50-a948-2319145fd878 tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] 10.222.0.58 "GET /compute/v2.1/servers/8bd23351-3cb0-423c-ba5e-33a8ba3c3db4" status: 200 len: 1426 microversion: 2.1 time: 0.181115 Aug 10 23:37:24.110146 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3099/5991] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:37:23 2022] GET /compute/v2.1/servers/8bd23351-3cb0-423c-ba5e-33a8ba3c3db4 => generated 1426 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:37:25.131441 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-22bd6068-aa8c-45f7-a67c-4dea84b8c7f1 tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:37:25.132078 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-22bd6068-aa8c-45f7-a67c-4dea84b8c7f1 tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] [instance: 8bd23351-3cb0-423c-ba5e-33a8ba3c3db4] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:37:25.140009 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-22bd6068-aa8c-45f7-a67c-4dea84b8c7f1 tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:37:25.140595 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-22bd6068-aa8c-45f7-a67c-4dea84b8c7f1 tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:37:25.141105 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-22bd6068-aa8c-45f7-a67c-4dea84b8c7f1 tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:37:25.141888 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-22bd6068-aa8c-45f7-a67c-4dea84b8c7f1 tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:37:25.142442 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-22bd6068-aa8c-45f7-a67c-4dea84b8c7f1 tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:37:25.142998 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-22bd6068-aa8c-45f7-a67c-4dea84b8c7f1 tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:37:25.326892 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-22bd6068-aa8c-45f7-a67c-4dea84b8c7f1 tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5115cfabf810465289e5a21b926bce6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0de2d097a542e9b80d9bcb87299467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:37:25.340063 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-22bd6068-aa8c-45f7-a67c-4dea84b8c7f1 tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] 10.222.0.58 "GET /compute/v2.1/servers/8bd23351-3cb0-423c-ba5e-33a8ba3c3db4" status: 200 len: 1606 microversion: 2.1 time: 0.213664 Aug 10 23:37:25.354467 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2893/5992] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:37:25 2022] GET /compute/v2.1/servers/8bd23351-3cb0-423c-ba5e-33a8ba3c3db4 => generated 1606 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:37:25.362602 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-32762c7e-9e29-4aa5-9345-5b7e4b7fc2fc tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:37:25.363246 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-32762c7e-9e29-4aa5-9345-5b7e4b7fc2fc tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] [instance: 8bd23351-3cb0-423c-ba5e-33a8ba3c3db4] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:37:25.371916 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-32762c7e-9e29-4aa5-9345-5b7e4b7fc2fc tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:37:25.373245 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-32762c7e-9e29-4aa5-9345-5b7e4b7fc2fc tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:37:25.373929 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-32762c7e-9e29-4aa5-9345-5b7e4b7fc2fc tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:37:25.375093 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-32762c7e-9e29-4aa5-9345-5b7e4b7fc2fc tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:37:25.375726 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-32762c7e-9e29-4aa5-9345-5b7e4b7fc2fc tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:37:25.377282 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-32762c7e-9e29-4aa5-9345-5b7e4b7fc2fc tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:37:25.540846 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-32762c7e-9e29-4aa5-9345-5b7e4b7fc2fc tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5115cfabf810465289e5a21b926bce6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0de2d097a542e9b80d9bcb87299467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:37:25.552368 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-32762c7e-9e29-4aa5-9345-5b7e4b7fc2fc tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] 10.222.0.58 "GET /compute/v2.1/servers/8bd23351-3cb0-423c-ba5e-33a8ba3c3db4" status: 200 len: 1606 microversion: 2.1 time: 0.193874 Aug 10 23:37:25.553541 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3100/5993] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:37:25 2022] GET /compute/v2.1/servers/8bd23351-3cb0-423c-ba5e-33a8ba3c3db4 => generated 1606 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:37:25.574992 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-43f53cae-aac9-440f-b8e2-e04bafcee96b tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:37:25.575394 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-43f53cae-aac9-440f-b8e2-e04bafcee96b tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] [instance: 8bd23351-3cb0-423c-ba5e-33a8ba3c3db4] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:37:25.582958 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-43f53cae-aac9-440f-b8e2-e04bafcee96b tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:37:25.583478 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-43f53cae-aac9-440f-b8e2-e04bafcee96b tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:37:25.584150 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-43f53cae-aac9-440f-b8e2-e04bafcee96b tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:37:25.585082 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-43f53cae-aac9-440f-b8e2-e04bafcee96b tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:37:25.585742 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-43f53cae-aac9-440f-b8e2-e04bafcee96b tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:37:25.586362 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-43f53cae-aac9-440f-b8e2-e04bafcee96b tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:37:25.785233 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-43f53cae-aac9-440f-b8e2-e04bafcee96b tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5115cfabf810465289e5a21b926bce6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0de2d097a542e9b80d9bcb87299467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:37:25.793583 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-43f53cae-aac9-440f-b8e2-e04bafcee96b tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] 10.222.0.58 "GET /compute/v2.1/servers/8bd23351-3cb0-423c-ba5e-33a8ba3c3db4" status: 200 len: 1606 microversion: 2.1 time: 0.223132 Aug 10 23:37:25.795339 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2894/5994] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:37:25 2022] GET /compute/v2.1/servers/8bd23351-3cb0-423c-ba5e-33a8ba3c3db4 => generated 1606 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:37:28.221119 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-a8e2e552-1215-4535-aaa8-2dc73669b915 req-88fecfa5-ce96-4594-99df-c5959c115da6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8bd23351-3cb0-423c-ba5e-33a8ba3c3db4", "tag": "2980f5cb-3090-4531-8d5e-04c67cae8340"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:37:28.237877 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-a8e2e552-1215-4535-aaa8-2dc73669b915 req-88fecfa5-ce96-4594-99df-c5959c115da6 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:37:28.238421 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-a8e2e552-1215-4535-aaa8-2dc73669b915 req-88fecfa5-ce96-4594-99df-c5959c115da6 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:37:28.245864 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-a8e2e552-1215-4535-aaa8-2dc73669b915 req-88fecfa5-ce96-4594-99df-c5959c115da6 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:37:28.277740 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-a8e2e552-1215-4535-aaa8-2dc73669b915 req-88fecfa5-ce96-4594-99df-c5959c115da6 service nova] Creating event network-changed:2980f5cb-3090-4531-8d5e-04c67cae8340 for instance 8bd23351-3cb0-423c-ba5e-33a8ba3c3db4 on n-h1-850468-14 Aug 10 23:37:28.283571 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-a8e2e552-1215-4535-aaa8-2dc73669b915 req-88fecfa5-ce96-4594-99df-c5959c115da6 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066098 Aug 10 23:37:28.284170 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3101/5995] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:37:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:38:02.318740 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c1eb17ce-01fd-4447-bd79-2fec7723ff1c tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:38:02.319461 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-c1eb17ce-01fd-4447-bd79-2fec7723ff1c tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] [instance: 8bd23351-3cb0-423c-ba5e-33a8ba3c3db4] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:38:02.325645 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:38:02.326494 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=46 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:38:02.328713 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c1eb17ce-01fd-4447-bd79-2fec7723ff1c tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:38:02.329749 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c1eb17ce-01fd-4447-bd79-2fec7723ff1c tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:38:02.329979 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c1eb17ce-01fd-4447-bd79-2fec7723ff1c tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:38:02.330974 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c1eb17ce-01fd-4447-bd79-2fec7723ff1c tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:38:02.331789 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c1eb17ce-01fd-4447-bd79-2fec7723ff1c tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:38:02.332194 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c1eb17ce-01fd-4447-bd79-2fec7723ff1c tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:38:02.366807 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-c1eb17ce-01fd-4447-bd79-2fec7723ff1c tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] 10.222.0.58 "GET /compute/v2.1/servers/8bd23351-3cb0-423c-ba5e-33a8ba3c3db4/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.052942 Aug 10 23:38:02.367400 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2895/5996] 10.222.0.58 () {58 vars in 1293 bytes} [Wed Aug 10 23:38:02 2022] GET /compute/v2.1/servers/8bd23351-3cb0-423c-ba5e-33a8ba3c3db4/os-server-password => generated 116 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:38:02.466536 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=1 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:38:02.467402 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=40 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:38:02.471605 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-757708d1-6600-4ac1-85db-9db5564c64e4 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-307940910", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452", "networks": [{"uuid": "655a95a3-55f1-4f3f-b510-b8644c3809a1"}]}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:38:02.529235 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.network.neutron [None req-757708d1-6600-4ac1-85db-9db5564c64e4 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] validate_networks() for [('655a95a3-55f1-4f3f-b510-b8644c3809a1', None, None, None, None, None)] {{(pid=122633) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 23:38:02.894519 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-757708d1-6600-4ac1-85db-9db5564c64e4 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Flavor limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:38:02.895052 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-757708d1-6600-4ac1-85db-9db5564c64e4 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Image limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:38:02.895588 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-757708d1-6600-4ac1-85db-9db5564c64e4 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Flavor pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:38:02.896066 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-757708d1-6600-4ac1-85db-9db5564c64e4 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Image pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:38:02.896576 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-757708d1-6600-4ac1-85db-9db5564c64e4 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:38:02.906681 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-757708d1-6600-4ac1-85db-9db5564c64e4 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:38:02.907283 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-757708d1-6600-4ac1-85db-9db5564c64e4 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:38:02.907717 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-757708d1-6600-4ac1-85db-9db5564c64e4 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:38:02.908457 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-757708d1-6600-4ac1-85db-9db5564c64e4 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:38:02.909078 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-757708d1-6600-4ac1-85db-9db5564c64e4 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:38:02.909503 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-757708d1-6600-4ac1-85db-9db5564c64e4 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:38:02.927653 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-757708d1-6600-4ac1-85db-9db5564c64e4 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Getting quotas for project 5b3c43fe735f488c9e1ccaf93a926960. Resources: {'instances', 'cores', 'ram'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:38:02.935500 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-757708d1-6600-4ac1-85db-9db5564c64e4 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Getting quotas for user d602346dc4054913b803780eb18b6cd8 and project 5b3c43fe735f488c9e1ccaf93a926960. Resources: {'instances', 'cores', 'ram'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:38:02.948970 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-757708d1-6600-4ac1-85db-9db5564c64e4 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Going to run 1 instances... {{(pid=122633) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 23:38:02.951951 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-757708d1-6600-4ac1-85db-9db5564c64e4 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] [instance: b6a7339d-cc65-49bd-950a-33b6ab6bf56a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78ad8905-f66f-4733-8be9-2b260f1fabed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122633) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 23:38:02.998805 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-757708d1-6600-4ac1-85db-9db5564c64e4 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.534384 Aug 10 23:38:02.999630 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3102/5997] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 23:38:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 536 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 23:38:03.010737 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-a1623192-657c-48a9-934d-8dcb219c796d tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:38:03.012241 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-a1623192-657c-48a9-934d-8dcb219c796d tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] [instance: b6a7339d-cc65-49bd-950a-33b6ab6bf56a] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:38:03.082690 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-a1623192-657c-48a9-934d-8dcb219c796d tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd602346dc4054913b803780eb18b6cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b3c43fe735f488c9e1ccaf93a926960', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:38:03.096501 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-a1623192-657c-48a9-934d-8dcb219c796d tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] 10.222.0.58 "GET /compute/v2.1/servers/b6a7339d-cc65-49bd-950a-33b6ab6bf56a" status: 200 len: 1218 microversion: 2.1 time: 0.089920 Aug 10 23:38:03.105215 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2896/5998] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:38:03 2022] GET /compute/v2.1/servers/b6a7339d-cc65-49bd-950a-33b6ab6bf56a => generated 1218 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:38:04.119728 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-17eada6e-4148-44c0-ab64-56e50dbf9bd4 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:38:04.120306 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-17eada6e-4148-44c0-ab64-56e50dbf9bd4 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] [instance: b6a7339d-cc65-49bd-950a-33b6ab6bf56a] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:38:04.132851 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-17eada6e-4148-44c0-ab64-56e50dbf9bd4 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:38:04.133348 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-17eada6e-4148-44c0-ab64-56e50dbf9bd4 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:38:04.133792 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-17eada6e-4148-44c0-ab64-56e50dbf9bd4 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:38:04.134511 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-17eada6e-4148-44c0-ab64-56e50dbf9bd4 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:38:04.136344 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-17eada6e-4148-44c0-ab64-56e50dbf9bd4 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:38:04.136940 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-17eada6e-4148-44c0-ab64-56e50dbf9bd4 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:38:04.205870 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-17eada6e-4148-44c0-ab64-56e50dbf9bd4 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd602346dc4054913b803780eb18b6cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b3c43fe735f488c9e1ccaf93a926960', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:38:04.213561 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-17eada6e-4148-44c0-ab64-56e50dbf9bd4 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] 10.222.0.58 "GET /compute/v2.1/servers/b6a7339d-cc65-49bd-950a-33b6ab6bf56a" status: 200 len: 1270 microversion: 2.1 time: 0.098681 Aug 10 23:38:04.214407 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3103/5999] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:38:04 2022] GET /compute/v2.1/servers/b6a7339d-cc65-49bd-950a-33b6ab6bf56a => generated 1270 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:38:05.236711 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-60345dcc-53f0-4e49-afe6-938a0a1b2a3c tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:38:05.238339 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-60345dcc-53f0-4e49-afe6-938a0a1b2a3c tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] [instance: b6a7339d-cc65-49bd-950a-33b6ab6bf56a] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:38:05.246379 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-60345dcc-53f0-4e49-afe6-938a0a1b2a3c tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:38:05.247306 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-60345dcc-53f0-4e49-afe6-938a0a1b2a3c tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:38:05.247607 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-60345dcc-53f0-4e49-afe6-938a0a1b2a3c tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:38:05.248517 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-60345dcc-53f0-4e49-afe6-938a0a1b2a3c tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:38:05.249191 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-60345dcc-53f0-4e49-afe6-938a0a1b2a3c tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:38:05.249689 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-60345dcc-53f0-4e49-afe6-938a0a1b2a3c tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:38:05.399483 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-60345dcc-53f0-4e49-afe6-938a0a1b2a3c tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd602346dc4054913b803780eb18b6cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b3c43fe735f488c9e1ccaf93a926960', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:38:05.410570 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-60345dcc-53f0-4e49-afe6-938a0a1b2a3c tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] 10.222.0.58 "GET /compute/v2.1/servers/b6a7339d-cc65-49bd-950a-33b6ab6bf56a" status: 200 len: 1318 microversion: 2.1 time: 0.177681 Aug 10 23:38:05.411472 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2897/6000] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:38:05 2022] GET /compute/v2.1/servers/b6a7339d-cc65-49bd-950a-33b6ab6bf56a => generated 1318 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:38:06.156185 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-6cf9891e-d5bd-4df2-8366-95ca57399b20 req-5703e538-333c-46e1-b3c8-a39782489e1d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b6a7339d-cc65-49bd-950a-33b6ab6bf56a", "tag": "39d682e0-d931-4c9e-9ee0-26906dafff09"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:38:06.170296 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-6cf9891e-d5bd-4df2-8366-95ca57399b20 req-5703e538-333c-46e1-b3c8-a39782489e1d service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:38:06.170889 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-6cf9891e-d5bd-4df2-8366-95ca57399b20 req-5703e538-333c-46e1-b3c8-a39782489e1d service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:38:06.171393 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-6cf9891e-d5bd-4df2-8366-95ca57399b20 req-5703e538-333c-46e1-b3c8-a39782489e1d service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:38:06.204142 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-6cf9891e-d5bd-4df2-8366-95ca57399b20 req-5703e538-333c-46e1-b3c8-a39782489e1d service nova] Creating event network-changed:39d682e0-d931-4c9e-9ee0-26906dafff09 for instance b6a7339d-cc65-49bd-950a-33b6ab6bf56a on n-h2-850468-14 Aug 10 23:38:06.221250 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-6cf9891e-d5bd-4df2-8366-95ca57399b20 req-5703e538-333c-46e1-b3c8-a39782489e1d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069250 Aug 10 23:38:06.222050 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3104/6001] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:38:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:38:06.433198 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-925e84e1-8879-4434-82b7-c341ad2c6532 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:38:06.434592 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-925e84e1-8879-4434-82b7-c341ad2c6532 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] [instance: b6a7339d-cc65-49bd-950a-33b6ab6bf56a] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:38:06.442198 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-925e84e1-8879-4434-82b7-c341ad2c6532 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:38:06.443038 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-925e84e1-8879-4434-82b7-c341ad2c6532 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:38:06.443652 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-925e84e1-8879-4434-82b7-c341ad2c6532 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:38:06.444450 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-925e84e1-8879-4434-82b7-c341ad2c6532 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:38:06.445104 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-925e84e1-8879-4434-82b7-c341ad2c6532 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:38:06.445506 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-925e84e1-8879-4434-82b7-c341ad2c6532 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:38:06.648988 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-925e84e1-8879-4434-82b7-c341ad2c6532 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd602346dc4054913b803780eb18b6cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b3c43fe735f488c9e1ccaf93a926960', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:38:06.659732 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-925e84e1-8879-4434-82b7-c341ad2c6532 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] 10.222.0.58 "GET /compute/v2.1/servers/b6a7339d-cc65-49bd-950a-33b6ab6bf56a" status: 200 len: 1318 microversion: 2.1 time: 0.231221 Aug 10 23:38:06.660782 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2898/6002] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:38:06 2022] GET /compute/v2.1/servers/b6a7339d-cc65-49bd-950a-33b6ab6bf56a => generated 1318 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:38:07.683085 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-140ca0db-4bf9-440a-9491-9c0c2568c010 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:38:07.685030 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-140ca0db-4bf9-440a-9491-9c0c2568c010 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] [instance: b6a7339d-cc65-49bd-950a-33b6ab6bf56a] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:38:07.692413 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-140ca0db-4bf9-440a-9491-9c0c2568c010 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:38:07.693133 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-140ca0db-4bf9-440a-9491-9c0c2568c010 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:38:07.693761 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-140ca0db-4bf9-440a-9491-9c0c2568c010 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:38:07.694805 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-140ca0db-4bf9-440a-9491-9c0c2568c010 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:38:07.695416 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-140ca0db-4bf9-440a-9491-9c0c2568c010 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:38:07.696013 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-140ca0db-4bf9-440a-9491-9c0c2568c010 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:38:07.838503 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-140ca0db-4bf9-440a-9491-9c0c2568c010 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd602346dc4054913b803780eb18b6cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b3c43fe735f488c9e1ccaf93a926960', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:38:07.847156 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-140ca0db-4bf9-440a-9491-9c0c2568c010 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] 10.222.0.58 "GET /compute/v2.1/servers/b6a7339d-cc65-49bd-950a-33b6ab6bf56a" status: 200 len: 1318 microversion: 2.1 time: 0.169269 Aug 10 23:38:07.847746 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3105/6003] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:38:07 2022] GET /compute/v2.1/servers/b6a7339d-cc65-49bd-950a-33b6ab6bf56a => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:38:08.875651 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-6fa93d97-d838-4950-b92d-9922c1c38d01 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:38:08.877081 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-6fa93d97-d838-4950-b92d-9922c1c38d01 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] [instance: b6a7339d-cc65-49bd-950a-33b6ab6bf56a] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:38:08.891232 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6fa93d97-d838-4950-b92d-9922c1c38d01 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:38:08.892036 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6fa93d97-d838-4950-b92d-9922c1c38d01 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:38:08.892649 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6fa93d97-d838-4950-b92d-9922c1c38d01 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:38:08.893383 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6fa93d97-d838-4950-b92d-9922c1c38d01 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:38:08.893842 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6fa93d97-d838-4950-b92d-9922c1c38d01 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:38:08.894272 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6fa93d97-d838-4950-b92d-9922c1c38d01 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:38:09.207402 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-6fa93d97-d838-4950-b92d-9922c1c38d01 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd602346dc4054913b803780eb18b6cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b3c43fe735f488c9e1ccaf93a926960', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:38:09.215539 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-6fa93d97-d838-4950-b92d-9922c1c38d01 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] 10.222.0.58 "GET /compute/v2.1/servers/b6a7339d-cc65-49bd-950a-33b6ab6bf56a" status: 200 len: 1318 microversion: 2.1 time: 0.346328 Aug 10 23:38:09.216445 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2899/6004] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:38:08 2022] GET /compute/v2.1/servers/b6a7339d-cc65-49bd-950a-33b6ab6bf56a => generated 1318 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:38:10.237555 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-046f19b7-bc65-42be-af67-64c6cd82c406 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:38:10.238222 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-046f19b7-bc65-42be-af67-64c6cd82c406 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] [instance: b6a7339d-cc65-49bd-950a-33b6ab6bf56a] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:38:10.265175 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-046f19b7-bc65-42be-af67-64c6cd82c406 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:38:10.266773 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-046f19b7-bc65-42be-af67-64c6cd82c406 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:38:10.267284 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-046f19b7-bc65-42be-af67-64c6cd82c406 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:38:10.268051 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-046f19b7-bc65-42be-af67-64c6cd82c406 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:38:10.268519 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-046f19b7-bc65-42be-af67-64c6cd82c406 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:38:10.268959 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-046f19b7-bc65-42be-af67-64c6cd82c406 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:38:10.492183 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-046f19b7-bc65-42be-af67-64c6cd82c406 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd602346dc4054913b803780eb18b6cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b3c43fe735f488c9e1ccaf93a926960', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:38:10.500746 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-046f19b7-bc65-42be-af67-64c6cd82c406 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] 10.222.0.58 "GET /compute/v2.1/servers/b6a7339d-cc65-49bd-950a-33b6ab6bf56a" status: 200 len: 1318 microversion: 2.1 time: 0.267306 Aug 10 23:38:10.503792 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3106/6005] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:38:10 2022] GET /compute/v2.1/servers/b6a7339d-cc65-49bd-950a-33b6ab6bf56a => generated 1318 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:38:11.524694 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-e0502a78-4a2e-411b-acfc-e5243e3d252d tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:38:11.525327 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-e0502a78-4a2e-411b-acfc-e5243e3d252d tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] [instance: b6a7339d-cc65-49bd-950a-33b6ab6bf56a] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:38:11.533379 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e0502a78-4a2e-411b-acfc-e5243e3d252d tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:38:11.534186 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e0502a78-4a2e-411b-acfc-e5243e3d252d tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:38:11.534595 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e0502a78-4a2e-411b-acfc-e5243e3d252d tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:38:11.535525 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e0502a78-4a2e-411b-acfc-e5243e3d252d tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:38:11.536204 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e0502a78-4a2e-411b-acfc-e5243e3d252d tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:38:11.536791 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e0502a78-4a2e-411b-acfc-e5243e3d252d tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:38:11.708462 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-e0502a78-4a2e-411b-acfc-e5243e3d252d tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd602346dc4054913b803780eb18b6cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b3c43fe735f488c9e1ccaf93a926960', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:38:11.718344 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-e0502a78-4a2e-411b-acfc-e5243e3d252d tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] 10.222.0.58 "GET /compute/v2.1/servers/b6a7339d-cc65-49bd-950a-33b6ab6bf56a" status: 200 len: 1318 microversion: 2.1 time: 0.197817 Aug 10 23:38:11.719616 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2900/6006] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:38:11 2022] GET /compute/v2.1/servers/b6a7339d-cc65-49bd-950a-33b6ab6bf56a => generated 1318 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:38:12.705949 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-89149a6e-137a-4fa3-85aa-17bd0625bc81 req-7d645724-69b9-42d0-9296-37eda71cbc98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6a7339d-cc65-49bd-950a-33b6ab6bf56a", "name": "network-vif-plugged", "status": "completed", "tag": "39d682e0-d931-4c9e-9ee0-26906dafff09"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:38:12.717520 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-89149a6e-137a-4fa3-85aa-17bd0625bc81 req-7d645724-69b9-42d0-9296-37eda71cbc98 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:38:12.718207 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-89149a6e-137a-4fa3-85aa-17bd0625bc81 req-7d645724-69b9-42d0-9296-37eda71cbc98 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:38:12.718635 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-89149a6e-137a-4fa3-85aa-17bd0625bc81 req-7d645724-69b9-42d0-9296-37eda71cbc98 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:38:12.731460 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-89149a6e-137a-4fa3-85aa-17bd0625bc81 req-7d645724-69b9-42d0-9296-37eda71cbc98 service nova] Creating event network-vif-plugged:39d682e0-d931-4c9e-9ee0-26906dafff09 for instance b6a7339d-cc65-49bd-950a-33b6ab6bf56a on n-h2-850468-14 Aug 10 23:38:12.742972 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-5cf06a7e-bd37-45f3-aacc-4c8916328cd8 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:38:12.744247 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-5cf06a7e-bd37-45f3-aacc-4c8916328cd8 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] [instance: b6a7339d-cc65-49bd-950a-33b6ab6bf56a] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:38:12.750042 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-89149a6e-137a-4fa3-85aa-17bd0625bc81 req-7d645724-69b9-42d0-9296-37eda71cbc98 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047837 Aug 10 23:38:12.752317 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3107/6007] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:38:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:38:12.756236 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5cf06a7e-bd37-45f3-aacc-4c8916328cd8 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:38:12.756910 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5cf06a7e-bd37-45f3-aacc-4c8916328cd8 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:38:12.757534 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5cf06a7e-bd37-45f3-aacc-4c8916328cd8 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:38:12.758601 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5cf06a7e-bd37-45f3-aacc-4c8916328cd8 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:38:12.759289 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5cf06a7e-bd37-45f3-aacc-4c8916328cd8 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:38:12.759871 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5cf06a7e-bd37-45f3-aacc-4c8916328cd8 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:38:13.056636 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-5cf06a7e-bd37-45f3-aacc-4c8916328cd8 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd602346dc4054913b803780eb18b6cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b3c43fe735f488c9e1ccaf93a926960', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:38:13.066589 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-5cf06a7e-bd37-45f3-aacc-4c8916328cd8 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] 10.222.0.58 "GET /compute/v2.1/servers/b6a7339d-cc65-49bd-950a-33b6ab6bf56a" status: 200 len: 1318 microversion: 2.1 time: 0.328070 Aug 10 23:38:13.067409 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2901/6008] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:38:12 2022] GET /compute/v2.1/servers/b6a7339d-cc65-49bd-950a-33b6ab6bf56a => generated 1318 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:38:14.085174 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=2 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:38:14.087373 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=6 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:38:14.095309 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-6fad12e9-b850-472f-a073-103fe542e4b7 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:38:14.099382 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-6fad12e9-b850-472f-a073-103fe542e4b7 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] [instance: b6a7339d-cc65-49bd-950a-33b6ab6bf56a] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:38:14.112973 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6fad12e9-b850-472f-a073-103fe542e4b7 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:38:14.115475 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6fad12e9-b850-472f-a073-103fe542e4b7 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:38:14.116249 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6fad12e9-b850-472f-a073-103fe542e4b7 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:38:14.117081 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6fad12e9-b850-472f-a073-103fe542e4b7 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:38:14.117616 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6fad12e9-b850-472f-a073-103fe542e4b7 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:38:14.118125 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6fad12e9-b850-472f-a073-103fe542e4b7 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:38:14.402635 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-6fad12e9-b850-472f-a073-103fe542e4b7 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd602346dc4054913b803780eb18b6cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b3c43fe735f488c9e1ccaf93a926960', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:38:14.412852 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-6fad12e9-b850-472f-a073-103fe542e4b7 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] 10.222.0.58 "GET /compute/v2.1/servers/b6a7339d-cc65-49bd-950a-33b6ab6bf56a" status: 200 len: 1318 microversion: 2.1 time: 0.326677 Aug 10 23:38:14.414152 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3108/6009] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:38:14 2022] GET /compute/v2.1/servers/b6a7339d-cc65-49bd-950a-33b6ab6bf56a => generated 1318 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:38:15.435969 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-5649fe12-2c46-4713-a97e-d1e21c2eed2d tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:38:15.436592 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-5649fe12-2c46-4713-a97e-d1e21c2eed2d tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] [instance: b6a7339d-cc65-49bd-950a-33b6ab6bf56a] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:38:15.438950 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=2 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:38:15.457892 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5649fe12-2c46-4713-a97e-d1e21c2eed2d tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:38:15.458655 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5649fe12-2c46-4713-a97e-d1e21c2eed2d tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:38:15.459302 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5649fe12-2c46-4713-a97e-d1e21c2eed2d tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:38:15.460188 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5649fe12-2c46-4713-a97e-d1e21c2eed2d tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:38:15.460837 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5649fe12-2c46-4713-a97e-d1e21c2eed2d tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:38:15.461444 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5649fe12-2c46-4713-a97e-d1e21c2eed2d tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:38:15.800809 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-5649fe12-2c46-4713-a97e-d1e21c2eed2d tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd602346dc4054913b803780eb18b6cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b3c43fe735f488c9e1ccaf93a926960', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:38:15.814803 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-5649fe12-2c46-4713-a97e-d1e21c2eed2d tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] 10.222.0.58 "GET /compute/v2.1/servers/b6a7339d-cc65-49bd-950a-33b6ab6bf56a" status: 200 len: 1505 microversion: 2.1 time: 0.382803 Aug 10 23:38:15.815415 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2902/6010] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:38:15 2022] GET /compute/v2.1/servers/b6a7339d-cc65-49bd-950a-33b6ab6bf56a => generated 1505 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:38:16.476940 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-16085dbc-ad73-42cf-bef9-9cce37e338a6 tempest-TestAggregatesBasicOps-1250458263 tempest-TestAggregatesBasicOps-1250458263-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-731914165", "availability_zone": "foo_zone"}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:38:16.481128 n-d-850468-14 devstack@n-api.service[122633]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 23:38:16.481128 n-d-850468-14 devstack@n-api.service[122633]: warnings.warn(msg) Aug 10 23:38:16.482531 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.objects.aggregate [None req-16085dbc-ad73-42cf-bef9-9cce37e338a6 tempest-TestAggregatesBasicOps-1250458263 tempest-TestAggregatesBasicOps-1250458263-project-admin] Generated uuid fd549b1e-596c-440c-a246-294855e361f8 for aggregate {{(pid=122633) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 10 23:38:16.510440 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-16085dbc-ad73-42cf-bef9-9cce37e338a6 tempest-TestAggregatesBasicOps-1250458263 tempest-TestAggregatesBasicOps-1250458263-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates" status: 200 len: 208 microversion: 2.1 time: 0.227600 Aug 10 23:38:16.513329 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3109/6011] 10.222.0.58 () {60 vars in 1164 bytes} [Wed Aug 10 23:38:16 2022] POST /compute/v2.1/os-aggregates => generated 208 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:38:16.524904 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-bc75dc28-31cd-4bfe-a8d3-eef06abd6f4d tempest-TestAggregatesBasicOps-1250458263 tempest-TestAggregatesBasicOps-1250458263-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:38:16.528574 n-d-850468-14 devstack@n-api.service[122632]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 23:38:16.528574 n-d-850468-14 devstack@n-api.service[122632]: warnings.warn(msg) Aug 10 23:38:16.553129 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-bc75dc28-31cd-4bfe-a8d3-eef06abd6f4d tempest-TestAggregatesBasicOps-1250458263 tempest-TestAggregatesBasicOps-1250458263-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 318 microversion: 2.1 time: 0.032752 Aug 10 23:38:16.554574 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2903/6012] 10.222.0.58 () {60 vars in 1194 bytes} [Wed Aug 10 23:38:16 2022] POST /compute/v2.1/os-aggregates/19/action => generated 318 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:38:16.566022 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-65ec3f06-9493-4bf7-a5db-c22cf95383fa tempest-TestAggregatesBasicOps-1250458263 tempest-TestAggregatesBasicOps-1250458263-project-admin] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:38:16.568648 n-d-850468-14 devstack@n-api.service[122633]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 23:38:16.568648 n-d-850468-14 devstack@n-api.service[122633]: warnings.warn(msg) Aug 10 23:38:16.569796 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-65ec3f06-9493-4bf7-a5db-c22cf95383fa tempest-TestAggregatesBasicOps-1250458263 tempest-TestAggregatesBasicOps-1250458263-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:38:16.571163 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-65ec3f06-9493-4bf7-a5db-c22cf95383fa tempest-TestAggregatesBasicOps-1250458263 tempest-TestAggregatesBasicOps-1250458263-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:38:16.571620 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-65ec3f06-9493-4bf7-a5db-c22cf95383fa tempest-TestAggregatesBasicOps-1250458263 tempest-TestAggregatesBasicOps-1250458263-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:38:16.572418 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-65ec3f06-9493-4bf7-a5db-c22cf95383fa tempest-TestAggregatesBasicOps-1250458263 tempest-TestAggregatesBasicOps-1250458263-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:38:16.572879 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-65ec3f06-9493-4bf7-a5db-c22cf95383fa tempest-TestAggregatesBasicOps-1250458263 tempest-TestAggregatesBasicOps-1250458263-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:38:16.573504 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-65ec3f06-9493-4bf7-a5db-c22cf95383fa tempest-TestAggregatesBasicOps-1250458263 tempest-TestAggregatesBasicOps-1250458263-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:38:16.604806 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-65ec3f06-9493-4bf7-a5db-c22cf95383fa tempest-TestAggregatesBasicOps-1250458263 tempest-TestAggregatesBasicOps-1250458263-project-admin] 10.222.0.58 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.042616 Aug 10 23:38:16.605626 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3110/6013] 10.222.0.58 () {58 vars in 1176 bytes} [Wed Aug 10 23:38:16 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:38:16.617217 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-fda74e14-804f-4e59-9ce5-c5c15a36d45c tempest-TestAggregatesBasicOps-1250458263 tempest-TestAggregatesBasicOps-1250458263-project-admin] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:38:16.618367 n-d-850468-14 devstack@n-api.service[122632]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 23:38:16.618367 n-d-850468-14 devstack@n-api.service[122632]: warnings.warn(msg) Aug 10 23:38:16.633518 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-fda74e14-804f-4e59-9ce5-c5c15a36d45c tempest-TestAggregatesBasicOps-1250458263 tempest-TestAggregatesBasicOps-1250458263-project-admin] 10.222.0.58 "GET /compute/v2.1/os-aggregates" status: 200 len: 297 microversion: 2.1 time: 0.019922 Aug 10 23:38:16.634104 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2904/6014] 10.222.0.58 () {58 vars in 1143 bytes} [Wed Aug 10 23:38:16 2022] GET /compute/v2.1/os-aggregates => generated 297 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:38:16.649592 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-497f99fc-bed4-4898-880c-09495b11670b tempest-TestAggregatesBasicOps-1250458263 tempest-TestAggregatesBasicOps-1250458263-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-850468-14"}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:38:16.653636 n-d-850468-14 devstack@n-api.service[122633]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 23:38:16.653636 n-d-850468-14 devstack@n-api.service[122633]: warnings.warn(msg) Aug 10 23:38:16.665985 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-497f99fc-bed4-4898-880c-09495b11670b tempest-TestAggregatesBasicOps-1250458263 tempest-TestAggregatesBasicOps-1250458263-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:38:16.666887 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-497f99fc-bed4-4898-880c-09495b11670b tempest-TestAggregatesBasicOps-1250458263 tempest-TestAggregatesBasicOps-1250458263-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:38:16.668217 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-497f99fc-bed4-4898-880c-09495b11670b tempest-TestAggregatesBasicOps-1250458263 tempest-TestAggregatesBasicOps-1250458263-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:38:16.955373 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-497f99fc-bed4-4898-880c-09495b11670b tempest-TestAggregatesBasicOps-1250458263 tempest-TestAggregatesBasicOps-1250458263-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 310 microversion: 2.1 time: 0.312230 Aug 10 23:38:16.955978 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3111/6015] 10.222.0.58 () {60 vars in 1194 bytes} [Wed Aug 10 23:38:16 2022] POST /compute/v2.1/os-aggregates/19/action => generated 310 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:38:16.967610 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-500c69c6-d728-485c-84fc-59cba0fad2db tempest-TestAggregatesBasicOps-1250458263 tempest-TestAggregatesBasicOps-1250458263-project-admin] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:38:16.968392 n-d-850468-14 devstack@n-api.service[122632]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 23:38:16.968392 n-d-850468-14 devstack@n-api.service[122632]: warnings.warn(msg) Aug 10 23:38:16.981725 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-500c69c6-d728-485c-84fc-59cba0fad2db tempest-TestAggregatesBasicOps-1250458263 tempest-TestAggregatesBasicOps-1250458263-project-admin] 10.222.0.58 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 310 microversion: 2.1 time: 0.018556 Aug 10 23:38:16.989027 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2905/6016] 10.222.0.58 () {58 vars in 1152 bytes} [Wed Aug 10 23:38:16 2022] GET /compute/v2.1/os-aggregates/19 => generated 310 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:38:16.998450 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-8e1217b0-64ed-4bb3-beff-6c524866c977 tempest-TestAggregatesBasicOps-1250458263 tempest-TestAggregatesBasicOps-1250458263-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-674939812", "availability_zone": "foo_zone"}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:38:17.001487 n-d-850468-14 devstack@n-api.service[122633]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 23:38:17.001487 n-d-850468-14 devstack@n-api.service[122633]: warnings.warn(msg) Aug 10 23:38:17.065479 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-8e1217b0-64ed-4bb3-beff-6c524866c977 tempest-TestAggregatesBasicOps-1250458263 tempest-TestAggregatesBasicOps-1250458263-project-admin] 10.222.0.58 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 342 microversion: 2.1 time: 0.074173 Aug 10 23:38:17.078866 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3112/6017] 10.222.0.58 () {60 vars in 1173 bytes} [Wed Aug 10 23:38:16 2022] PUT /compute/v2.1/os-aggregates/19 => generated 342 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:38:17.079367 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-449a7827-82be-40d5-a330-2c10ca5f6dfa tempest-TestAggregatesBasicOps-1250458263 tempest-TestAggregatesBasicOps-1250458263-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:38:17.082806 n-d-850468-14 devstack@n-api.service[122632]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 23:38:17.082806 n-d-850468-14 devstack@n-api.service[122632]: warnings.warn(msg) Aug 10 23:38:17.124512 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-449a7827-82be-40d5-a330-2c10ca5f6dfa tempest-TestAggregatesBasicOps-1250458263 tempest-TestAggregatesBasicOps-1250458263-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 356 microversion: 2.1 time: 0.050590 Aug 10 23:38:17.125059 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2906/6018] 10.222.0.58 () {60 vars in 1194 bytes} [Wed Aug 10 23:38:17 2022] POST /compute/v2.1/os-aggregates/19/action => generated 356 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:38:17.136587 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-72c61411-ec08-4d8f-a313-7d5503850e7d tempest-TestAggregatesBasicOps-1250458263 tempest-TestAggregatesBasicOps-1250458263-project-admin] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:38:17.137675 n-d-850468-14 devstack@n-api.service[122633]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 23:38:17.137675 n-d-850468-14 devstack@n-api.service[122633]: warnings.warn(msg) Aug 10 23:38:17.146726 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-72c61411-ec08-4d8f-a313-7d5503850e7d tempest-TestAggregatesBasicOps-1250458263 tempest-TestAggregatesBasicOps-1250458263-project-admin] 10.222.0.58 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 356 microversion: 2.1 time: 0.014199 Aug 10 23:38:17.147509 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3113/6019] 10.222.0.58 () {58 vars in 1152 bytes} [Wed Aug 10 23:38:17 2022] GET /compute/v2.1/os-aggregates/19 => generated 356 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:38:17.162307 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-6acfefe0-95ed-4d5c-a9b0-64396bf13f2a tempest-TestAggregatesBasicOps-1250458263 tempest-TestAggregatesBasicOps-1250458263-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-850468-14"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:38:17.165245 n-d-850468-14 devstack@n-api.service[122632]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 23:38:17.165245 n-d-850468-14 devstack@n-api.service[122632]: warnings.warn(msg) Aug 10 23:38:17.179342 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6acfefe0-95ed-4d5c-a9b0-64396bf13f2a tempest-TestAggregatesBasicOps-1250458263 tempest-TestAggregatesBasicOps-1250458263-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:38:17.180120 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6acfefe0-95ed-4d5c-a9b0-64396bf13f2a tempest-TestAggregatesBasicOps-1250458263 tempest-TestAggregatesBasicOps-1250458263-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:38:17.180887 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6acfefe0-95ed-4d5c-a9b0-64396bf13f2a tempest-TestAggregatesBasicOps-1250458263 tempest-TestAggregatesBasicOps-1250458263-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:38:17.400917 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-6acfefe0-95ed-4d5c-a9b0-64396bf13f2a tempest-TestAggregatesBasicOps-1250458263 tempest-TestAggregatesBasicOps-1250458263-project-admin] 10.222.0.58 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 340 microversion: 2.1 time: 0.245300 Aug 10 23:38:17.402008 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2907/6020] 10.222.0.58 () {60 vars in 1194 bytes} [Wed Aug 10 23:38:17 2022] POST /compute/v2.1/os-aggregates/19/action => generated 340 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:38:17.413681 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c40acb27-d9a3-4920-befc-cad37bba963e tempest-TestAggregatesBasicOps-1250458263 tempest-TestAggregatesBasicOps-1250458263-project-admin] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:38:17.414870 n-d-850468-14 devstack@n-api.service[122633]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 23:38:17.414870 n-d-850468-14 devstack@n-api.service[122633]: warnings.warn(msg) Aug 10 23:38:17.443145 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-c40acb27-d9a3-4920-befc-cad37bba963e tempest-TestAggregatesBasicOps-1250458263 tempest-TestAggregatesBasicOps-1250458263-project-admin] 10.222.0.58 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.033406 Aug 10 23:38:17.462551 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3114/6021] 10.222.0.58 () {58 vars in 1155 bytes} [Wed Aug 10 23:38:17 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 10 23:38:35.911156 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=44 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:38:35.913021 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=2,nova_api:DELETE=1 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:38:35.919788 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-e8581099-a0c8-43db-972e-766d326e8461 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "81568bdf-d123-4fd4-b8c6-41dcda3cf35a", "device": "/dev/sdb"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:38:35.923825 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-e8581099-a0c8-43db-972e-766d326e8461 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] [instance: b6a7339d-cc65-49bd-950a-33b6ab6bf56a] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:38:35.936172 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e8581099-a0c8-43db-972e-766d326e8461 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:38:35.936924 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e8581099-a0c8-43db-972e-766d326e8461 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:38:35.938352 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e8581099-a0c8-43db-972e-766d326e8461 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:38:35.939320 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e8581099-a0c8-43db-972e-766d326e8461 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:38:35.939963 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e8581099-a0c8-43db-972e-766d326e8461 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:38:35.940702 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e8581099-a0c8-43db-972e-766d326e8461 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:38:36.341950 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-e8581099-a0c8-43db-972e-766d326e8461 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] 10.222.0.58 "POST /compute/v2.1/servers/b6a7339d-cc65-49bd-950a-33b6ab6bf56a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.432287 Aug 10 23:38:36.349445 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2908/6022] 10.222.0.58 () {60 vars in 1323 bytes} [Wed Aug 10 23:38:35 2022] POST /compute/v2.1/servers/b6a7339d-cc65-49bd-950a-33b6ab6bf56a/os-volume_attachments => generated 194 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:38:39.936274 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=2 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:38:39.937182 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=36 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:38:39.937747 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=6,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:38:39.941719 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-ded6bf76-a701-49ca-92e2-e6f843d9cbfe tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2049208533", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "cf45a2c7-c2b3-4c10-b7bb-394afa1bea78", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "5ed0a190-471f-4749-aff5-4f68f1343451"}]}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:38:40.010662 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.network.neutron [None req-ded6bf76-a701-49ca-92e2-e6f843d9cbfe tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] validate_networks() for [('5ed0a190-471f-4749-aff5-4f68f1343451', None, None, None, None, None)] {{(pid=122633) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 23:38:40.454062 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-ded6bf76-a701-49ca-92e2-e6f843d9cbfe tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Flavor limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:38:40.454763 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-ded6bf76-a701-49ca-92e2-e6f843d9cbfe tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Image limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:38:40.455474 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-ded6bf76-a701-49ca-92e2-e6f843d9cbfe tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Flavor pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:38:40.456114 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-ded6bf76-a701-49ca-92e2-e6f843d9cbfe tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Image pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:38:40.456751 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-ded6bf76-a701-49ca-92e2-e6f843d9cbfe tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:38:40.468587 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ded6bf76-a701-49ca-92e2-e6f843d9cbfe tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:38:40.469155 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ded6bf76-a701-49ca-92e2-e6f843d9cbfe tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:38:40.469811 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ded6bf76-a701-49ca-92e2-e6f843d9cbfe tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:38:40.470680 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ded6bf76-a701-49ca-92e2-e6f843d9cbfe tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:38:40.471363 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ded6bf76-a701-49ca-92e2-e6f843d9cbfe tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:38:40.471987 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ded6bf76-a701-49ca-92e2-e6f843d9cbfe tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:38:40.492466 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-ded6bf76-a701-49ca-92e2-e6f843d9cbfe tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Getting quotas for project 0b22838d50dd4ea8811953e723d0c052. Resources: {'instances', 'cores', 'ram'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:38:40.498639 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-ded6bf76-a701-49ca-92e2-e6f843d9cbfe tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Getting quotas for user e97e9cddb55649809a9cd16dbc43bb7e and project 0b22838d50dd4ea8811953e723d0c052. Resources: {'instances', 'cores', 'ram'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:38:40.562756 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-ded6bf76-a701-49ca-92e2-e6f843d9cbfe tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Going to run 1 instances... {{(pid=122633) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 23:38:40.566617 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-ded6bf76-a701-49ca-92e2-e6f843d9cbfe tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 3d55d57b-fcbc-4f8a-98c5-99ed111aabc7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='cf45a2c7-c2b3-4c10-b7bb-394afa1bea78',volume_size=None,volume_type=None)] {{(pid=122633) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 23:38:40.727498 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-ded6bf76-a701-49ca-92e2-e6f843d9cbfe tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.792729 Aug 10 23:38:40.728427 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3115/6023] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 23:38:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 795 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 10 23:38:40.741463 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-495dd5f1-81e0-44f1-86de-8420ab23212e tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:38:40.742276 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-495dd5f1-81e0-44f1-86de-8420ab23212e tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 3d55d57b-fcbc-4f8a-98c5-99ed111aabc7] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:38:40.825984 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-495dd5f1-81e0-44f1-86de-8420ab23212e tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:38:40.835227 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-495dd5f1-81e0-44f1-86de-8420ab23212e tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/3d55d57b-fcbc-4f8a-98c5-99ed111aabc7" status: 200 len: 1057 microversion: 2.1 time: 0.098951 Aug 10 23:38:40.836336 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2909/6024] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:38:40 2022] GET /compute/v2.1/servers/3d55d57b-fcbc-4f8a-98c5-99ed111aabc7 => generated 1057 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:38:41.857402 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-8bfdb6ce-a6d2-4a93-b04e-4a53ac2cb360 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:38:41.858470 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-8bfdb6ce-a6d2-4a93-b04e-4a53ac2cb360 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 3d55d57b-fcbc-4f8a-98c5-99ed111aabc7] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:38:41.878717 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8bfdb6ce-a6d2-4a93-b04e-4a53ac2cb360 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:38:41.879355 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8bfdb6ce-a6d2-4a93-b04e-4a53ac2cb360 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:38:41.879817 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8bfdb6ce-a6d2-4a93-b04e-4a53ac2cb360 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:38:41.880578 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8bfdb6ce-a6d2-4a93-b04e-4a53ac2cb360 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:38:41.881037 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8bfdb6ce-a6d2-4a93-b04e-4a53ac2cb360 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:38:41.882030 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8bfdb6ce-a6d2-4a93-b04e-4a53ac2cb360 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:38:42.008373 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-8bfdb6ce-a6d2-4a93-b04e-4a53ac2cb360 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:38:42.037515 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-8bfdb6ce-a6d2-4a93-b04e-4a53ac2cb360 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/3d55d57b-fcbc-4f8a-98c5-99ed111aabc7" status: 200 len: 1163 microversion: 2.1 time: 0.176104 Aug 10 23:38:42.038302 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3116/6025] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:38:41 2022] GET /compute/v2.1/servers/3d55d57b-fcbc-4f8a-98c5-99ed111aabc7 => generated 1163 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:38:43.063904 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-345049f3-ddd7-438d-88fa-5d255057f8ad tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:38:43.064645 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-345049f3-ddd7-438d-88fa-5d255057f8ad tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 3d55d57b-fcbc-4f8a-98c5-99ed111aabc7] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:38:43.077022 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-345049f3-ddd7-438d-88fa-5d255057f8ad tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:38:43.077884 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-345049f3-ddd7-438d-88fa-5d255057f8ad tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:38:43.078557 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-345049f3-ddd7-438d-88fa-5d255057f8ad tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:38:43.079578 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-345049f3-ddd7-438d-88fa-5d255057f8ad tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:38:43.080236 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-345049f3-ddd7-438d-88fa-5d255057f8ad tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:38:43.080945 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-345049f3-ddd7-438d-88fa-5d255057f8ad tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:38:43.258107 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-345049f3-ddd7-438d-88fa-5d255057f8ad tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:38:43.267723 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-345049f3-ddd7-438d-88fa-5d255057f8ad tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/3d55d57b-fcbc-4f8a-98c5-99ed111aabc7" status: 200 len: 1215 microversion: 2.1 time: 0.207592 Aug 10 23:38:43.269551 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2910/6026] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:38:43 2022] GET /compute/v2.1/servers/3d55d57b-fcbc-4f8a-98c5-99ed111aabc7 => generated 1215 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:38:43.836300 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-48d556d4-2bce-42c0-ae28-a2929065451f req-bef149b8-0acc-4b5f-aca0-f99383a02544 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d55d57b-fcbc-4f8a-98c5-99ed111aabc7", "tag": "d9638c13-f397-43de-9478-7ae8cba9b241"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:38:43.853200 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-48d556d4-2bce-42c0-ae28-a2929065451f req-bef149b8-0acc-4b5f-aca0-f99383a02544 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:38:43.856867 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-48d556d4-2bce-42c0-ae28-a2929065451f req-bef149b8-0acc-4b5f-aca0-f99383a02544 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:38:43.857505 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-48d556d4-2bce-42c0-ae28-a2929065451f req-bef149b8-0acc-4b5f-aca0-f99383a02544 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:38:43.873449 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-48d556d4-2bce-42c0-ae28-a2929065451f req-bef149b8-0acc-4b5f-aca0-f99383a02544 service nova] Creating event network-changed:d9638c13-f397-43de-9478-7ae8cba9b241 for instance 3d55d57b-fcbc-4f8a-98c5-99ed111aabc7 on n-h1-850468-14 Aug 10 23:38:43.879014 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-48d556d4-2bce-42c0-ae28-a2929065451f req-bef149b8-0acc-4b5f-aca0-f99383a02544 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046364 Aug 10 23:38:43.879928 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3117/6027] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:38:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:38:44.289462 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-208dbb38-c135-4870-95ac-1f48dbcd80a7 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:38:44.290086 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-208dbb38-c135-4870-95ac-1f48dbcd80a7 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 3d55d57b-fcbc-4f8a-98c5-99ed111aabc7] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:38:44.297672 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-208dbb38-c135-4870-95ac-1f48dbcd80a7 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:38:44.298395 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-208dbb38-c135-4870-95ac-1f48dbcd80a7 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:38:44.298862 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-208dbb38-c135-4870-95ac-1f48dbcd80a7 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:38:44.299570 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-208dbb38-c135-4870-95ac-1f48dbcd80a7 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:38:44.300211 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-208dbb38-c135-4870-95ac-1f48dbcd80a7 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:38:44.300793 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-208dbb38-c135-4870-95ac-1f48dbcd80a7 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:38:44.453659 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-208dbb38-c135-4870-95ac-1f48dbcd80a7 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:38:44.462107 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-208dbb38-c135-4870-95ac-1f48dbcd80a7 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/3d55d57b-fcbc-4f8a-98c5-99ed111aabc7" status: 200 len: 1215 microversion: 2.1 time: 0.176558 Aug 10 23:38:44.467235 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2911/6028] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:38:44 2022] GET /compute/v2.1/servers/3d55d57b-fcbc-4f8a-98c5-99ed111aabc7 => generated 1215 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:38:45.484393 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-72a3ee23-1792-4701-9f0c-e222fa27dded tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:38:45.485103 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-72a3ee23-1792-4701-9f0c-e222fa27dded tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 3d55d57b-fcbc-4f8a-98c5-99ed111aabc7] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:38:45.491489 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-72a3ee23-1792-4701-9f0c-e222fa27dded tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:38:45.491990 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-72a3ee23-1792-4701-9f0c-e222fa27dded tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:38:45.492418 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-72a3ee23-1792-4701-9f0c-e222fa27dded tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:38:45.493119 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-72a3ee23-1792-4701-9f0c-e222fa27dded tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:38:45.493582 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-72a3ee23-1792-4701-9f0c-e222fa27dded tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:38:45.494016 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-72a3ee23-1792-4701-9f0c-e222fa27dded tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:38:45.630402 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-72a3ee23-1792-4701-9f0c-e222fa27dded tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:38:45.639025 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-72a3ee23-1792-4701-9f0c-e222fa27dded tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/3d55d57b-fcbc-4f8a-98c5-99ed111aabc7" status: 200 len: 1215 microversion: 2.1 time: 0.160724 Aug 10 23:38:45.639685 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3118/6029] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:38:45 2022] GET /compute/v2.1/servers/3d55d57b-fcbc-4f8a-98c5-99ed111aabc7 => generated 1215 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:38:46.660537 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-f140caf8-3aff-47a0-bd7a-98723d861888 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:38:46.661150 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-f140caf8-3aff-47a0-bd7a-98723d861888 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 3d55d57b-fcbc-4f8a-98c5-99ed111aabc7] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:38:46.668350 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f140caf8-3aff-47a0-bd7a-98723d861888 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:38:46.668836 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f140caf8-3aff-47a0-bd7a-98723d861888 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:38:46.669280 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f140caf8-3aff-47a0-bd7a-98723d861888 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:38:46.669985 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f140caf8-3aff-47a0-bd7a-98723d861888 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:38:46.670445 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f140caf8-3aff-47a0-bd7a-98723d861888 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:38:46.670898 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f140caf8-3aff-47a0-bd7a-98723d861888 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:38:46.813229 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-f140caf8-3aff-47a0-bd7a-98723d861888 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:38:46.821479 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-f140caf8-3aff-47a0-bd7a-98723d861888 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/3d55d57b-fcbc-4f8a-98c5-99ed111aabc7" status: 200 len: 1215 microversion: 2.1 time: 0.164877 Aug 10 23:38:46.822082 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2912/6030] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:38:46 2022] GET /compute/v2.1/servers/3d55d57b-fcbc-4f8a-98c5-99ed111aabc7 => generated 1215 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:38:47.843700 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-a02760f2-2148-49b4-a5e7-418baafe3259 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:38:47.844338 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-a02760f2-2148-49b4-a5e7-418baafe3259 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 3d55d57b-fcbc-4f8a-98c5-99ed111aabc7] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:38:47.851125 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a02760f2-2148-49b4-a5e7-418baafe3259 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:38:47.851606 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a02760f2-2148-49b4-a5e7-418baafe3259 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:38:47.852069 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a02760f2-2148-49b4-a5e7-418baafe3259 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:38:47.852749 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a02760f2-2148-49b4-a5e7-418baafe3259 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:38:47.853196 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a02760f2-2148-49b4-a5e7-418baafe3259 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:38:47.853616 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a02760f2-2148-49b4-a5e7-418baafe3259 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:38:47.988923 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-a02760f2-2148-49b4-a5e7-418baafe3259 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:38:47.996932 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-a02760f2-2148-49b4-a5e7-418baafe3259 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/3d55d57b-fcbc-4f8a-98c5-99ed111aabc7" status: 200 len: 1203 microversion: 2.1 time: 0.158070 Aug 10 23:38:47.997549 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3119/6031] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:38:47 2022] GET /compute/v2.1/servers/3d55d57b-fcbc-4f8a-98c5-99ed111aabc7 => generated 1203 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:38:49.019357 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-4c662edf-aae8-4f35-b3f4-9ee5ca665345 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:38:49.019976 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-4c662edf-aae8-4f35-b3f4-9ee5ca665345 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 3d55d57b-fcbc-4f8a-98c5-99ed111aabc7] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:38:49.027366 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4c662edf-aae8-4f35-b3f4-9ee5ca665345 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:38:49.027859 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4c662edf-aae8-4f35-b3f4-9ee5ca665345 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:38:49.028316 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4c662edf-aae8-4f35-b3f4-9ee5ca665345 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:38:49.029034 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4c662edf-aae8-4f35-b3f4-9ee5ca665345 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:38:49.029498 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4c662edf-aae8-4f35-b3f4-9ee5ca665345 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:38:49.029930 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4c662edf-aae8-4f35-b3f4-9ee5ca665345 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:38:49.173555 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-4c662edf-aae8-4f35-b3f4-9ee5ca665345 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:38:49.181604 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-4c662edf-aae8-4f35-b3f4-9ee5ca665345 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/3d55d57b-fcbc-4f8a-98c5-99ed111aabc7" status: 200 len: 1203 microversion: 2.1 time: 0.166151 Aug 10 23:38:49.182390 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2913/6032] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:38:49 2022] GET /compute/v2.1/servers/3d55d57b-fcbc-4f8a-98c5-99ed111aabc7 => generated 1203 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:38:50.203667 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-9c95a81e-1e49-439c-92dd-25d2187552b7 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:38:50.204199 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-9c95a81e-1e49-439c-92dd-25d2187552b7 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 3d55d57b-fcbc-4f8a-98c5-99ed111aabc7] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:38:50.213751 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9c95a81e-1e49-439c-92dd-25d2187552b7 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:38:50.214286 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9c95a81e-1e49-439c-92dd-25d2187552b7 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:38:50.214726 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9c95a81e-1e49-439c-92dd-25d2187552b7 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:38:50.215448 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9c95a81e-1e49-439c-92dd-25d2187552b7 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:38:50.215902 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9c95a81e-1e49-439c-92dd-25d2187552b7 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:38:50.216323 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9c95a81e-1e49-439c-92dd-25d2187552b7 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:38:50.351227 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-9c95a81e-1e49-439c-92dd-25d2187552b7 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:38:50.359871 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-9c95a81e-1e49-439c-92dd-25d2187552b7 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/3d55d57b-fcbc-4f8a-98c5-99ed111aabc7" status: 200 len: 1203 microversion: 2.1 time: 0.160244 Aug 10 23:38:50.360453 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3120/6033] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:38:50 2022] GET /compute/v2.1/servers/3d55d57b-fcbc-4f8a-98c5-99ed111aabc7 => generated 1203 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:38:51.382122 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-7a663011-3273-49c7-9418-988bd94f185a tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:38:51.383274 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-7a663011-3273-49c7-9418-988bd94f185a tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 3d55d57b-fcbc-4f8a-98c5-99ed111aabc7] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:38:51.386969 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=2 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:38:51.393923 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7a663011-3273-49c7-9418-988bd94f185a tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:38:51.394459 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7a663011-3273-49c7-9418-988bd94f185a tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:38:51.394939 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7a663011-3273-49c7-9418-988bd94f185a tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:38:51.395699 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7a663011-3273-49c7-9418-988bd94f185a tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:38:51.396165 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7a663011-3273-49c7-9418-988bd94f185a tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:38:51.396599 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7a663011-3273-49c7-9418-988bd94f185a tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:38:51.538601 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-7a663011-3273-49c7-9418-988bd94f185a tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:38:51.547097 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-7a663011-3273-49c7-9418-988bd94f185a tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/3d55d57b-fcbc-4f8a-98c5-99ed111aabc7" status: 200 len: 1203 microversion: 2.1 time: 0.169478 Aug 10 23:38:51.547633 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2914/6034] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:38:51 2022] GET /compute/v2.1/servers/3d55d57b-fcbc-4f8a-98c5-99ed111aabc7 => generated 1203 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:38:52.566891 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-1774e06c-aa10-4b47-9466-e41e31f0383b tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:38:52.567512 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-1774e06c-aa10-4b47-9466-e41e31f0383b tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 3d55d57b-fcbc-4f8a-98c5-99ed111aabc7] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:38:52.569496 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=2 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:38:52.570303 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=6 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:38:52.578316 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1774e06c-aa10-4b47-9466-e41e31f0383b tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:38:52.578839 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1774e06c-aa10-4b47-9466-e41e31f0383b tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:38:52.579283 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1774e06c-aa10-4b47-9466-e41e31f0383b tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:38:52.579984 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1774e06c-aa10-4b47-9466-e41e31f0383b tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:38:52.580470 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1774e06c-aa10-4b47-9466-e41e31f0383b tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:38:52.580896 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1774e06c-aa10-4b47-9466-e41e31f0383b tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:38:52.714524 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-1774e06c-aa10-4b47-9466-e41e31f0383b tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:38:52.723494 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-1774e06c-aa10-4b47-9466-e41e31f0383b tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/3d55d57b-fcbc-4f8a-98c5-99ed111aabc7" status: 200 len: 1203 microversion: 2.1 time: 0.160493 Aug 10 23:38:52.724080 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3121/6035] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:38:52 2022] GET /compute/v2.1/servers/3d55d57b-fcbc-4f8a-98c5-99ed111aabc7 => generated 1203 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:38:53.745777 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-f99c9fb9-16a1-4043-a507-3dbc304744ff tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:38:53.746424 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-f99c9fb9-16a1-4043-a507-3dbc304744ff tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 3d55d57b-fcbc-4f8a-98c5-99ed111aabc7] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:38:53.753532 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f99c9fb9-16a1-4043-a507-3dbc304744ff tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:38:53.754029 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f99c9fb9-16a1-4043-a507-3dbc304744ff tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:38:53.754472 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f99c9fb9-16a1-4043-a507-3dbc304744ff tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:38:53.755345 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f99c9fb9-16a1-4043-a507-3dbc304744ff tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:38:53.755810 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f99c9fb9-16a1-4043-a507-3dbc304744ff tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:38:53.756242 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f99c9fb9-16a1-4043-a507-3dbc304744ff tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:38:53.889006 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-f99c9fb9-16a1-4043-a507-3dbc304744ff tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:38:53.897106 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-f99c9fb9-16a1-4043-a507-3dbc304744ff tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/3d55d57b-fcbc-4f8a-98c5-99ed111aabc7" status: 200 len: 1203 microversion: 2.1 time: 0.156130 Aug 10 23:38:53.897678 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2915/6036] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:38:53 2022] GET /compute/v2.1/servers/3d55d57b-fcbc-4f8a-98c5-99ed111aabc7 => generated 1203 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:38:54.917856 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-4eef0684-9403-4cda-b8e2-9849769dfc47 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:38:54.918472 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-4eef0684-9403-4cda-b8e2-9849769dfc47 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 3d55d57b-fcbc-4f8a-98c5-99ed111aabc7] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:38:54.925322 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4eef0684-9403-4cda-b8e2-9849769dfc47 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:38:54.925805 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4eef0684-9403-4cda-b8e2-9849769dfc47 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:38:54.926248 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4eef0684-9403-4cda-b8e2-9849769dfc47 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:38:54.926987 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4eef0684-9403-4cda-b8e2-9849769dfc47 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:38:54.927445 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4eef0684-9403-4cda-b8e2-9849769dfc47 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:38:54.927872 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4eef0684-9403-4cda-b8e2-9849769dfc47 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:38:55.059670 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-4eef0684-9403-4cda-b8e2-9849769dfc47 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:38:55.069796 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-4eef0684-9403-4cda-b8e2-9849769dfc47 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/3d55d57b-fcbc-4f8a-98c5-99ed111aabc7" status: 200 len: 1203 microversion: 2.1 time: 0.156049 Aug 10 23:38:55.070378 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3122/6037] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:38:54 2022] GET /compute/v2.1/servers/3d55d57b-fcbc-4f8a-98c5-99ed111aabc7 => generated 1203 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:38:56.091286 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-5d86f00e-6c3a-42c5-ab89-684c42de6ee9 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:38:56.092061 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-5d86f00e-6c3a-42c5-ab89-684c42de6ee9 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 3d55d57b-fcbc-4f8a-98c5-99ed111aabc7] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:38:56.099391 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5d86f00e-6c3a-42c5-ab89-684c42de6ee9 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:38:56.099883 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5d86f00e-6c3a-42c5-ab89-684c42de6ee9 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:38:56.100342 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5d86f00e-6c3a-42c5-ab89-684c42de6ee9 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:38:56.101022 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5d86f00e-6c3a-42c5-ab89-684c42de6ee9 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:38:56.101479 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5d86f00e-6c3a-42c5-ab89-684c42de6ee9 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:38:56.101930 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5d86f00e-6c3a-42c5-ab89-684c42de6ee9 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:38:56.254824 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-5d86f00e-6c3a-42c5-ab89-684c42de6ee9 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:38:56.263243 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-5d86f00e-6c3a-42c5-ab89-684c42de6ee9 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/3d55d57b-fcbc-4f8a-98c5-99ed111aabc7" status: 200 len: 1203 microversion: 2.1 time: 0.176106 Aug 10 23:38:56.264459 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2916/6038] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:38:56 2022] GET /compute/v2.1/servers/3d55d57b-fcbc-4f8a-98c5-99ed111aabc7 => generated 1203 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:38:57.287438 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-dee0e521-422d-4726-b0cb-5437b8d5ed64 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:38:57.288413 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-dee0e521-422d-4726-b0cb-5437b8d5ed64 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 3d55d57b-fcbc-4f8a-98c5-99ed111aabc7] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:38:57.297975 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dee0e521-422d-4726-b0cb-5437b8d5ed64 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:38:57.298584 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dee0e521-422d-4726-b0cb-5437b8d5ed64 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:38:57.298939 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dee0e521-422d-4726-b0cb-5437b8d5ed64 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:38:57.299821 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dee0e521-422d-4726-b0cb-5437b8d5ed64 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:38:57.300273 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dee0e521-422d-4726-b0cb-5437b8d5ed64 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:38:57.301075 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dee0e521-422d-4726-b0cb-5437b8d5ed64 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:38:57.455657 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-dee0e521-422d-4726-b0cb-5437b8d5ed64 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:38:57.464083 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-dee0e521-422d-4726-b0cb-5437b8d5ed64 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/3d55d57b-fcbc-4f8a-98c5-99ed111aabc7" status: 200 len: 1203 microversion: 2.1 time: 0.180344 Aug 10 23:38:57.464983 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3123/6039] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:38:57 2022] GET /compute/v2.1/servers/3d55d57b-fcbc-4f8a-98c5-99ed111aabc7 => generated 1203 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:38:57.883918 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-f1f43817-f5c3-4795-baac-7db199df6fe5 req-d83d7196-15a5-4bdb-995c-001901002faa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d55d57b-fcbc-4f8a-98c5-99ed111aabc7", "name": "network-vif-plugged", "status": "completed", "tag": "d9638c13-f397-43de-9478-7ae8cba9b241"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:38:57.897868 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-f1f43817-f5c3-4795-baac-7db199df6fe5 req-d83d7196-15a5-4bdb-995c-001901002faa service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:38:57.898822 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-f1f43817-f5c3-4795-baac-7db199df6fe5 req-d83d7196-15a5-4bdb-995c-001901002faa service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:38:57.899308 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-f1f43817-f5c3-4795-baac-7db199df6fe5 req-d83d7196-15a5-4bdb-995c-001901002faa service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:38:57.913890 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-f1f43817-f5c3-4795-baac-7db199df6fe5 req-d83d7196-15a5-4bdb-995c-001901002faa service nova] Creating event network-vif-plugged:d9638c13-f397-43de-9478-7ae8cba9b241 for instance 3d55d57b-fcbc-4f8a-98c5-99ed111aabc7 on n-h1-850468-14 Aug 10 23:38:57.919647 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-f1f43817-f5c3-4795-baac-7db199df6fe5 req-d83d7196-15a5-4bdb-995c-001901002faa service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039613 Aug 10 23:38:57.920309 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2917/6040] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:38:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:38:58.491033 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-fbfffb7c-6f58-4b4e-be33-f38464a16d70 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:38:58.491662 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-fbfffb7c-6f58-4b4e-be33-f38464a16d70 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 3d55d57b-fcbc-4f8a-98c5-99ed111aabc7] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:38:58.500230 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fbfffb7c-6f58-4b4e-be33-f38464a16d70 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:38:58.500724 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fbfffb7c-6f58-4b4e-be33-f38464a16d70 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:38:58.501162 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fbfffb7c-6f58-4b4e-be33-f38464a16d70 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:38:58.501872 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fbfffb7c-6f58-4b4e-be33-f38464a16d70 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:38:58.502331 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fbfffb7c-6f58-4b4e-be33-f38464a16d70 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:38:58.502758 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fbfffb7c-6f58-4b4e-be33-f38464a16d70 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:38:58.648980 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-fbfffb7c-6f58-4b4e-be33-f38464a16d70 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:38:58.657818 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-fbfffb7c-6f58-4b4e-be33-f38464a16d70 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/3d55d57b-fcbc-4f8a-98c5-99ed111aabc7" status: 200 len: 1203 microversion: 2.1 time: 0.172810 Aug 10 23:38:58.658341 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3124/6041] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:38:58 2022] GET /compute/v2.1/servers/3d55d57b-fcbc-4f8a-98c5-99ed111aabc7 => generated 1203 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:38:59.680623 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-bbbe2955-dd2a-4e92-a8c1-ee9bea417b87 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:38:59.681301 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-bbbe2955-dd2a-4e92-a8c1-ee9bea417b87 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 3d55d57b-fcbc-4f8a-98c5-99ed111aabc7] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:38:59.687901 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bbbe2955-dd2a-4e92-a8c1-ee9bea417b87 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:38:59.688423 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bbbe2955-dd2a-4e92-a8c1-ee9bea417b87 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:38:59.688931 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bbbe2955-dd2a-4e92-a8c1-ee9bea417b87 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:38:59.689632 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bbbe2955-dd2a-4e92-a8c1-ee9bea417b87 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:38:59.690139 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bbbe2955-dd2a-4e92-a8c1-ee9bea417b87 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:38:59.690567 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bbbe2955-dd2a-4e92-a8c1-ee9bea417b87 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:38:59.829485 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-bbbe2955-dd2a-4e92-a8c1-ee9bea417b87 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:38:59.837557 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-bbbe2955-dd2a-4e92-a8c1-ee9bea417b87 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/3d55d57b-fcbc-4f8a-98c5-99ed111aabc7" status: 200 len: 1390 microversion: 2.1 time: 0.162322 Aug 10 23:38:59.838640 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2918/6042] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:38:59 2022] GET /compute/v2.1/servers/3d55d57b-fcbc-4f8a-98c5-99ed111aabc7 => generated 1390 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:38:59.859821 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-a9c3986a-95ed-4c77-ad72-ed35033c0258 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:38:59.861214 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-a9c3986a-95ed-4c77-ad72-ed35033c0258 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 3d55d57b-fcbc-4f8a-98c5-99ed111aabc7] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:38:59.868990 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a9c3986a-95ed-4c77-ad72-ed35033c0258 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:38:59.870062 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a9c3986a-95ed-4c77-ad72-ed35033c0258 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:38:59.870514 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a9c3986a-95ed-4c77-ad72-ed35033c0258 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:38:59.871447 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a9c3986a-95ed-4c77-ad72-ed35033c0258 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:38:59.871907 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a9c3986a-95ed-4c77-ad72-ed35033c0258 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:38:59.872336 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a9c3986a-95ed-4c77-ad72-ed35033c0258 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:39:00.013873 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-a9c3986a-95ed-4c77-ad72-ed35033c0258 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:39:00.022035 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-a9c3986a-95ed-4c77-ad72-ed35033c0258 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/3d55d57b-fcbc-4f8a-98c5-99ed111aabc7" status: 200 len: 1390 microversion: 2.1 time: 0.166266 Aug 10 23:39:00.022637 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3125/6043] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:38:59 2022] GET /compute/v2.1/servers/3d55d57b-fcbc-4f8a-98c5-99ed111aabc7 => generated 1390 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:39:00.043544 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-e667cbdb-87fa-4f6e-834a-937b4c92ac4e tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:39:00.044162 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-e667cbdb-87fa-4f6e-834a-937b4c92ac4e tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 3d55d57b-fcbc-4f8a-98c5-99ed111aabc7] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:39:00.050418 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e667cbdb-87fa-4f6e-834a-937b4c92ac4e tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:39:00.051015 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e667cbdb-87fa-4f6e-834a-937b4c92ac4e tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:39:00.051483 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e667cbdb-87fa-4f6e-834a-937b4c92ac4e tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:39:00.052170 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e667cbdb-87fa-4f6e-834a-937b4c92ac4e tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:39:00.052626 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e667cbdb-87fa-4f6e-834a-937b4c92ac4e tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:39:00.053058 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e667cbdb-87fa-4f6e-834a-937b4c92ac4e tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:39:00.483431 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-e667cbdb-87fa-4f6e-834a-937b4c92ac4e tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:39:00.491033 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-e667cbdb-87fa-4f6e-834a-937b4c92ac4e tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/3d55d57b-fcbc-4f8a-98c5-99ed111aabc7" status: 200 len: 1390 microversion: 2.1 time: 0.452549 Aug 10 23:39:00.491607 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2919/6044] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:39:00 2022] GET /compute/v2.1/servers/3d55d57b-fcbc-4f8a-98c5-99ed111aabc7 => generated 1390 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:39:00.511392 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-57328e74-fb47-4f6b-a1de-3198f11f0683 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:39:00.512211 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-57328e74-fb47-4f6b-a1de-3198f11f0683 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 3d55d57b-fcbc-4f8a-98c5-99ed111aabc7] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:39:00.518804 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-57328e74-fb47-4f6b-a1de-3198f11f0683 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:39:00.520182 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-57328e74-fb47-4f6b-a1de-3198f11f0683 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:39:00.520864 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-57328e74-fb47-4f6b-a1de-3198f11f0683 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:39:00.521642 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-57328e74-fb47-4f6b-a1de-3198f11f0683 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:39:00.522146 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-57328e74-fb47-4f6b-a1de-3198f11f0683 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:39:00.522622 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-57328e74-fb47-4f6b-a1de-3198f11f0683 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:39:00.548785 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-57328e74-fb47-4f6b-a1de-3198f11f0683 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 3d55d57b-fcbc-4f8a-98c5-99ed111aabc7] Going to try to terminate instance {{(pid=122633) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:39:00.661121 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-57328e74-fb47-4f6b-a1de-3198f11f0683 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "DELETE /compute/v2.1/servers/3d55d57b-fcbc-4f8a-98c5-99ed111aabc7" status: 204 len: 0 microversion: 2.1 time: 0.153680 Aug 10 23:39:00.662927 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3126/6045] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:39:00 2022] DELETE /compute/v2.1/servers/3d55d57b-fcbc-4f8a-98c5-99ed111aabc7 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:39:00.672294 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-1fc72966-ebca-4913-8ab7-a86075555683 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:39:00.673629 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-1fc72966-ebca-4913-8ab7-a86075555683 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 3d55d57b-fcbc-4f8a-98c5-99ed111aabc7] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:39:00.680538 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1fc72966-ebca-4913-8ab7-a86075555683 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:39:00.681027 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1fc72966-ebca-4913-8ab7-a86075555683 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:39:00.683121 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1fc72966-ebca-4913-8ab7-a86075555683 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:39:00.684045 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1fc72966-ebca-4913-8ab7-a86075555683 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:39:00.684672 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1fc72966-ebca-4913-8ab7-a86075555683 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:39:00.685267 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1fc72966-ebca-4913-8ab7-a86075555683 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:39:00.836327 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-1fc72966-ebca-4913-8ab7-a86075555683 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:39:00.845312 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-1fc72966-ebca-4913-8ab7-a86075555683 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/3d55d57b-fcbc-4f8a-98c5-99ed111aabc7" status: 200 len: 1396 microversion: 2.1 time: 0.178667 Aug 10 23:39:00.846206 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2920/6046] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:39:00 2022] GET /compute/v2.1/servers/3d55d57b-fcbc-4f8a-98c5-99ed111aabc7 => generated 1396 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:39:01.501975 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-b5c8a982-1eaa-494f-a947-840b955c7e5c tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:39:01.502610 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-b5c8a982-1eaa-494f-a947-840b955c7e5c tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] [instance: b6a7339d-cc65-49bd-950a-33b6ab6bf56a] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:39:01.511146 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b5c8a982-1eaa-494f-a947-840b955c7e5c tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:39:01.511646 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b5c8a982-1eaa-494f-a947-840b955c7e5c tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:39:01.512089 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b5c8a982-1eaa-494f-a947-840b955c7e5c tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:39:01.512800 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b5c8a982-1eaa-494f-a947-840b955c7e5c tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:39:01.513259 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b5c8a982-1eaa-494f-a947-840b955c7e5c tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:39:01.513690 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b5c8a982-1eaa-494f-a947-840b955c7e5c tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:39:01.598017 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.objects.instance [None req-b5c8a982-1eaa-494f-a947-840b955c7e5c tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Lazy-loading 'services' on Instance uuid b6a7339d-cc65-49bd-950a-33b6ab6bf56a {{(pid=122633) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:39:01.672575 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-b5c8a982-1eaa-494f-a947-840b955c7e5c tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] 10.222.0.58 "DELETE /compute/v2.1/servers/b6a7339d-cc65-49bd-950a-33b6ab6bf56a/os-volume_attachments/81568bdf-d123-4fd4-b8c6-41dcda3cf35a" status: 202 len: 0 microversion: 2.1 time: 0.174832 Aug 10 23:39:01.673191 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3127/6047] 10.222.0.58 () {58 vars in 1416 bytes} [Wed Aug 10 23:39:01 2022] DELETE /compute/v2.1/servers/b6a7339d-cc65-49bd-950a-33b6ab6bf56a/os-volume_attachments/81568bdf-d123-4fd4-b8c6-41dcda3cf35a => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:39:01.868255 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-375ff9aa-a736-43ba-a011-7dba1a991970 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:39:01.868851 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-375ff9aa-a736-43ba-a011-7dba1a991970 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 3d55d57b-fcbc-4f8a-98c5-99ed111aabc7] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:39:01.876067 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-375ff9aa-a736-43ba-a011-7dba1a991970 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:39:01.876554 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-375ff9aa-a736-43ba-a011-7dba1a991970 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:39:01.877007 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-375ff9aa-a736-43ba-a011-7dba1a991970 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:39:01.877700 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-375ff9aa-a736-43ba-a011-7dba1a991970 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:39:01.878151 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-375ff9aa-a736-43ba-a011-7dba1a991970 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:39:01.878576 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-375ff9aa-a736-43ba-a011-7dba1a991970 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:39:02.017091 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-375ff9aa-a736-43ba-a011-7dba1a991970 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:39:02.024914 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-375ff9aa-a736-43ba-a011-7dba1a991970 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/3d55d57b-fcbc-4f8a-98c5-99ed111aabc7" status: 200 len: 1396 microversion: 2.1 time: 0.160604 Aug 10 23:39:02.025504 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2921/6048] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:39:01 2022] GET /compute/v2.1/servers/3d55d57b-fcbc-4f8a-98c5-99ed111aabc7 => generated 1396 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:39:02.708392 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-51280136-73da-4258-b054-2e61f8d409da req-a972d8f2-a754-47f0-bfee-d983fd6329ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d55d57b-fcbc-4f8a-98c5-99ed111aabc7", "name": "network-vif-deleted", "tag": "d9638c13-f397-43de-9478-7ae8cba9b241"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:39:02.734907 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-51280136-73da-4258-b054-2e61f8d409da req-a972d8f2-a754-47f0-bfee-d983fd6329ef service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:39:02.735394 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-51280136-73da-4258-b054-2e61f8d409da req-a972d8f2-a754-47f0-bfee-d983fd6329ef service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:39:02.735822 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-51280136-73da-4258-b054-2e61f8d409da req-a972d8f2-a754-47f0-bfee-d983fd6329ef service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:39:02.757384 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-51280136-73da-4258-b054-2e61f8d409da req-a972d8f2-a754-47f0-bfee-d983fd6329ef service nova] Creating event network-vif-deleted:d9638c13-f397-43de-9478-7ae8cba9b241 for instance 3d55d57b-fcbc-4f8a-98c5-99ed111aabc7 on n-h1-850468-14 Aug 10 23:39:02.765132 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-51280136-73da-4258-b054-2e61f8d409da req-a972d8f2-a754-47f0-bfee-d983fd6329ef service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062514 Aug 10 23:39:02.766337 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3128/6049] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:39:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:39:03.048102 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-f99ef1a3-9a37-4cbe-a670-38dae1dbcde8 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:39:03.048720 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-f99ef1a3-9a37-4cbe-a670-38dae1dbcde8 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 3d55d57b-fcbc-4f8a-98c5-99ed111aabc7] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:39:03.055561 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f99ef1a3-9a37-4cbe-a670-38dae1dbcde8 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:39:03.056059 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f99ef1a3-9a37-4cbe-a670-38dae1dbcde8 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:39:03.056510 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f99ef1a3-9a37-4cbe-a670-38dae1dbcde8 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:39:03.057847 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f99ef1a3-9a37-4cbe-a670-38dae1dbcde8 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:39:03.058319 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f99ef1a3-9a37-4cbe-a670-38dae1dbcde8 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:39:03.058750 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f99ef1a3-9a37-4cbe-a670-38dae1dbcde8 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:39:03.121600 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-f99ef1a3-9a37-4cbe-a670-38dae1dbcde8 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:39:03.129448 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-f99ef1a3-9a37-4cbe-a670-38dae1dbcde8 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/3d55d57b-fcbc-4f8a-98c5-99ed111aabc7" status: 200 len: 1188 microversion: 2.1 time: 0.085459 Aug 10 23:39:03.130021 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2922/6050] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:39:03 2022] GET /compute/v2.1/servers/3d55d57b-fcbc-4f8a-98c5-99ed111aabc7 => generated 1188 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:39:04.152173 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-52b35908-e2d7-4029-af2c-9f5ab18cf792 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:39:04.152799 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-52b35908-e2d7-4029-af2c-9f5ab18cf792 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 3d55d57b-fcbc-4f8a-98c5-99ed111aabc7] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:39:04.159925 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-52b35908-e2d7-4029-af2c-9f5ab18cf792 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:39:04.160414 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-52b35908-e2d7-4029-af2c-9f5ab18cf792 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:39:04.160850 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-52b35908-e2d7-4029-af2c-9f5ab18cf792 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:39:04.161556 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-52b35908-e2d7-4029-af2c-9f5ab18cf792 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:39:04.162013 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-52b35908-e2d7-4029-af2c-9f5ab18cf792 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:39:04.162439 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-52b35908-e2d7-4029-af2c-9f5ab18cf792 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:39:04.233767 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-52b35908-e2d7-4029-af2c-9f5ab18cf792 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:39:04.241958 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-52b35908-e2d7-4029-af2c-9f5ab18cf792 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/3d55d57b-fcbc-4f8a-98c5-99ed111aabc7" status: 200 len: 1188 microversion: 2.1 time: 0.094393 Aug 10 23:39:04.242537 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3129/6051] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:39:04 2022] GET /compute/v2.1/servers/3d55d57b-fcbc-4f8a-98c5-99ed111aabc7 => generated 1188 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:39:05.263536 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-02c7da55-6d05-4601-a871-ba58b65c3d47 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:39:05.264172 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-02c7da55-6d05-4601-a871-ba58b65c3d47 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 3d55d57b-fcbc-4f8a-98c5-99ed111aabc7] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:39:05.271469 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-02c7da55-6d05-4601-a871-ba58b65c3d47 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:39:05.271963 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-02c7da55-6d05-4601-a871-ba58b65c3d47 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:39:05.272404 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-02c7da55-6d05-4601-a871-ba58b65c3d47 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:39:05.273104 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-02c7da55-6d05-4601-a871-ba58b65c3d47 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:39:05.273561 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-02c7da55-6d05-4601-a871-ba58b65c3d47 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:39:05.273985 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-02c7da55-6d05-4601-a871-ba58b65c3d47 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:39:05.337682 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-02c7da55-6d05-4601-a871-ba58b65c3d47 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:39:05.346296 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-02c7da55-6d05-4601-a871-ba58b65c3d47 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/3d55d57b-fcbc-4f8a-98c5-99ed111aabc7" status: 200 len: 1188 microversion: 2.1 time: 0.087448 Aug 10 23:39:05.346896 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2923/6052] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:39:05 2022] GET /compute/v2.1/servers/3d55d57b-fcbc-4f8a-98c5-99ed111aabc7 => generated 1188 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:39:06.367199 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-6429c519-82c7-4267-b590-b0b1f5163927 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:39:06.367878 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-6429c519-82c7-4267-b590-b0b1f5163927 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 3d55d57b-fcbc-4f8a-98c5-99ed111aabc7] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:39:06.376368 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6429c519-82c7-4267-b590-b0b1f5163927 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:39:06.377648 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6429c519-82c7-4267-b590-b0b1f5163927 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:39:06.378338 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6429c519-82c7-4267-b590-b0b1f5163927 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:39:06.379275 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6429c519-82c7-4267-b590-b0b1f5163927 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:39:06.380096 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6429c519-82c7-4267-b590-b0b1f5163927 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:39:06.380728 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6429c519-82c7-4267-b590-b0b1f5163927 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:39:06.417292 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-bb40b656-d4b3-4b43-a4df-4ab5b726e6a8 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:39:06.418152 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-bb40b656-d4b3-4b43-a4df-4ab5b726e6a8 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] [instance: b6a7339d-cc65-49bd-950a-33b6ab6bf56a] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:39:06.426284 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_api:SELECT=35 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:39:06.436839 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bb40b656-d4b3-4b43-a4df-4ab5b726e6a8 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:39:06.437426 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bb40b656-d4b3-4b43-a4df-4ab5b726e6a8 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:39:06.437874 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bb40b656-d4b3-4b43-a4df-4ab5b726e6a8 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:39:06.439278 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bb40b656-d4b3-4b43-a4df-4ab5b726e6a8 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:39:06.439972 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bb40b656-d4b3-4b43-a4df-4ab5b726e6a8 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:39:06.440626 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bb40b656-d4b3-4b43-a4df-4ab5b726e6a8 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:39:06.445978 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:39:06.466645 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-6429c519-82c7-4267-b590-b0b1f5163927 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:39:06.472007 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-bb40b656-d4b3-4b43-a4df-4ab5b726e6a8 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] [instance: b6a7339d-cc65-49bd-950a-33b6ab6bf56a] Going to try to terminate instance {{(pid=122632) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:39:06.475510 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-6429c519-82c7-4267-b590-b0b1f5163927 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/3d55d57b-fcbc-4f8a-98c5-99ed111aabc7" status: 200 len: 1188 microversion: 2.1 time: 0.112537 Aug 10 23:39:06.476091 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3130/6053] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:39:06 2022] GET /compute/v2.1/servers/3d55d57b-fcbc-4f8a-98c5-99ed111aabc7 => generated 1188 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:39:06.554687 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-bb40b656-d4b3-4b43-a4df-4ab5b726e6a8 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] 10.222.0.58 "DELETE /compute/v2.1/servers/b6a7339d-cc65-49bd-950a-33b6ab6bf56a" status: 204 len: 0 microversion: 2.1 time: 0.145726 Aug 10 23:39:06.555736 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2924/6054] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:39:06 2022] DELETE /compute/v2.1/servers/b6a7339d-cc65-49bd-950a-33b6ab6bf56a => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:39:06.566509 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-07baaff9-4f62-497e-a006-6c327627e96c tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:39:06.567148 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-07baaff9-4f62-497e-a006-6c327627e96c tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] [instance: b6a7339d-cc65-49bd-950a-33b6ab6bf56a] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:39:06.573459 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-07baaff9-4f62-497e-a006-6c327627e96c tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:39:06.573947 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-07baaff9-4f62-497e-a006-6c327627e96c tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:39:06.574380 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-07baaff9-4f62-497e-a006-6c327627e96c tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:39:06.575099 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-07baaff9-4f62-497e-a006-6c327627e96c tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:39:06.575553 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-07baaff9-4f62-497e-a006-6c327627e96c tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:39:06.576019 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-07baaff9-4f62-497e-a006-6c327627e96c tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:39:06.580269 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:39:06.717921 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-07baaff9-4f62-497e-a006-6c327627e96c tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd602346dc4054913b803780eb18b6cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b3c43fe735f488c9e1ccaf93a926960', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:39:06.725694 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-07baaff9-4f62-497e-a006-6c327627e96c tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] 10.222.0.58 "GET /compute/v2.1/servers/b6a7339d-cc65-49bd-950a-33b6ab6bf56a" status: 200 len: 1511 microversion: 2.1 time: 0.164456 Aug 10 23:39:06.726274 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3131/6055] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:39:06 2022] GET /compute/v2.1/servers/b6a7339d-cc65-49bd-950a-33b6ab6bf56a => generated 1511 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:39:07.497910 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-f70cf149-a5c6-49f1-b551-166173b048b2 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:39:07.498526 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-f70cf149-a5c6-49f1-b551-166173b048b2 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 3d55d57b-fcbc-4f8a-98c5-99ed111aabc7] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:39:07.505314 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f70cf149-a5c6-49f1-b551-166173b048b2 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:39:07.505795 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f70cf149-a5c6-49f1-b551-166173b048b2 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:39:07.506230 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f70cf149-a5c6-49f1-b551-166173b048b2 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:39:07.506944 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f70cf149-a5c6-49f1-b551-166173b048b2 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:39:07.507391 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f70cf149-a5c6-49f1-b551-166173b048b2 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:39:07.507845 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f70cf149-a5c6-49f1-b551-166173b048b2 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:39:07.575628 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-f70cf149-a5c6-49f1-b551-166173b048b2 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:39:07.583446 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-f70cf149-a5c6-49f1-b551-166173b048b2 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/3d55d57b-fcbc-4f8a-98c5-99ed111aabc7" status: 200 len: 1188 microversion: 2.1 time: 0.090457 Aug 10 23:39:07.584024 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2925/6056] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:39:07 2022] GET /compute/v2.1/servers/3d55d57b-fcbc-4f8a-98c5-99ed111aabc7 => generated 1188 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:39:07.748361 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-9956e96b-1e21-4139-b3c2-371fdc4fa3fd tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:39:07.748898 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-9956e96b-1e21-4139-b3c2-371fdc4fa3fd tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] [instance: b6a7339d-cc65-49bd-950a-33b6ab6bf56a] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:39:07.755830 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9956e96b-1e21-4139-b3c2-371fdc4fa3fd tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:39:07.756314 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9956e96b-1e21-4139-b3c2-371fdc4fa3fd tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:39:07.756749 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9956e96b-1e21-4139-b3c2-371fdc4fa3fd tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:39:07.757445 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9956e96b-1e21-4139-b3c2-371fdc4fa3fd tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:39:07.757900 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9956e96b-1e21-4139-b3c2-371fdc4fa3fd tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:39:07.758328 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9956e96b-1e21-4139-b3c2-371fdc4fa3fd tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:39:07.903366 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-9956e96b-1e21-4139-b3c2-371fdc4fa3fd tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd602346dc4054913b803780eb18b6cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b3c43fe735f488c9e1ccaf93a926960', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:39:07.911515 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-9956e96b-1e21-4139-b3c2-371fdc4fa3fd tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] 10.222.0.58 "GET /compute/v2.1/servers/b6a7339d-cc65-49bd-950a-33b6ab6bf56a" status: 200 len: 1511 microversion: 2.1 time: 0.167276 Aug 10 23:39:07.912097 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3132/6057] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:39:07 2022] GET /compute/v2.1/servers/b6a7339d-cc65-49bd-950a-33b6ab6bf56a => generated 1511 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:39:08.605639 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-efac6c1b-ed8a-4b29-a471-d35851a6f806 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:39:08.606477 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-efac6c1b-ed8a-4b29-a471-d35851a6f806 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 3d55d57b-fcbc-4f8a-98c5-99ed111aabc7] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:39:08.614320 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-efac6c1b-ed8a-4b29-a471-d35851a6f806 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:39:08.614733 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-efac6c1b-ed8a-4b29-a471-d35851a6f806 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:39:08.615197 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-efac6c1b-ed8a-4b29-a471-d35851a6f806 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:39:08.616106 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-efac6c1b-ed8a-4b29-a471-d35851a6f806 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:39:08.616783 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-efac6c1b-ed8a-4b29-a471-d35851a6f806 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:39:08.617399 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-efac6c1b-ed8a-4b29-a471-d35851a6f806 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:39:08.693024 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-efac6c1b-ed8a-4b29-a471-d35851a6f806 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:39:08.702246 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-efac6c1b-ed8a-4b29-a471-d35851a6f806 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/3d55d57b-fcbc-4f8a-98c5-99ed111aabc7" status: 200 len: 1188 microversion: 2.1 time: 0.101182 Aug 10 23:39:08.704130 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2926/6058] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:39:08 2022] GET /compute/v2.1/servers/3d55d57b-fcbc-4f8a-98c5-99ed111aabc7 => generated 1188 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:39:08.805712 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-e80512ad-95ac-4b6d-b085-9dc44c4dbbf4 req-8ae0ed1a-3e16-4250-be62-5d2245a34875 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b6a7339d-cc65-49bd-950a-33b6ab6bf56a", "name": "network-vif-deleted", "tag": "39d682e0-d931-4c9e-9ee0-26906dafff09"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:39:08.817154 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-e80512ad-95ac-4b6d-b085-9dc44c4dbbf4 req-8ae0ed1a-3e16-4250-be62-5d2245a34875 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:39:08.817926 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-e80512ad-95ac-4b6d-b085-9dc44c4dbbf4 req-8ae0ed1a-3e16-4250-be62-5d2245a34875 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:39:08.818362 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-e80512ad-95ac-4b6d-b085-9dc44c4dbbf4 req-8ae0ed1a-3e16-4250-be62-5d2245a34875 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:39:08.833306 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-e80512ad-95ac-4b6d-b085-9dc44c4dbbf4 req-8ae0ed1a-3e16-4250-be62-5d2245a34875 service nova] Creating event network-vif-deleted:39d682e0-d931-4c9e-9ee0-26906dafff09 for instance b6a7339d-cc65-49bd-950a-33b6ab6bf56a on n-h2-850468-14 Aug 10 23:39:08.839563 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-e80512ad-95ac-4b6d-b085-9dc44c4dbbf4 req-8ae0ed1a-3e16-4250-be62-5d2245a34875 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037584 Aug 10 23:39:08.840175 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3133/6059] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:39:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:39:08.934300 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-e0498ae0-a0ba-4eb1-8208-e0d3e4be019e tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:39:08.934868 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-e0498ae0-a0ba-4eb1-8208-e0d3e4be019e tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] [instance: b6a7339d-cc65-49bd-950a-33b6ab6bf56a] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:39:08.941361 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e0498ae0-a0ba-4eb1-8208-e0d3e4be019e tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:39:08.941869 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e0498ae0-a0ba-4eb1-8208-e0d3e4be019e tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:39:08.942302 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e0498ae0-a0ba-4eb1-8208-e0d3e4be019e tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:39:08.943045 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e0498ae0-a0ba-4eb1-8208-e0d3e4be019e tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:39:08.943497 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e0498ae0-a0ba-4eb1-8208-e0d3e4be019e tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:39:08.943915 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e0498ae0-a0ba-4eb1-8208-e0d3e4be019e tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:39:08.984253 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e0498ae0-a0ba-4eb1-8208-e0d3e4be019e tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:39:08.984754 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e0498ae0-a0ba-4eb1-8208-e0d3e4be019e tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:39:08.985165 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e0498ae0-a0ba-4eb1-8208-e0d3e4be019e tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:39:08.985608 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.objects.instance [None req-e0498ae0-a0ba-4eb1-8208-e0d3e4be019e tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Lazy-loading 'fault' on Instance uuid b6a7339d-cc65-49bd-950a-33b6ab6bf56a {{(pid=122632) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:39:09.029261 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-e0498ae0-a0ba-4eb1-8208-e0d3e4be019e tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd602346dc4054913b803780eb18b6cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b3c43fe735f488c9e1ccaf93a926960', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:39:09.037450 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-e0498ae0-a0ba-4eb1-8208-e0d3e4be019e tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] 10.222.0.58 "GET /compute/v2.1/servers/b6a7339d-cc65-49bd-950a-33b6ab6bf56a" status: 200 len: 1308 microversion: 2.1 time: 0.108895 Aug 10 23:39:09.038033 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2927/6060] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:39:08 2022] GET /compute/v2.1/servers/b6a7339d-cc65-49bd-950a-33b6ab6bf56a => generated 1308 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:39:09.727263 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-2c547b50-b024-4db1-b81f-2aac4c1ab205 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:39:09.727965 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-2c547b50-b024-4db1-b81f-2aac4c1ab205 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 3d55d57b-fcbc-4f8a-98c5-99ed111aabc7] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:39:09.735269 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2c547b50-b024-4db1-b81f-2aac4c1ab205 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:39:09.735765 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2c547b50-b024-4db1-b81f-2aac4c1ab205 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:39:09.736204 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2c547b50-b024-4db1-b81f-2aac4c1ab205 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:39:09.736907 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2c547b50-b024-4db1-b81f-2aac4c1ab205 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:39:09.737362 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2c547b50-b024-4db1-b81f-2aac4c1ab205 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:39:09.737793 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2c547b50-b024-4db1-b81f-2aac4c1ab205 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:39:09.804527 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-2c547b50-b024-4db1-b81f-2aac4c1ab205 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:39:09.813169 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-2c547b50-b024-4db1-b81f-2aac4c1ab205 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/3d55d57b-fcbc-4f8a-98c5-99ed111aabc7" status: 200 len: 1188 microversion: 2.1 time: 0.090271 Aug 10 23:39:09.813774 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3134/6061] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:39:09 2022] GET /compute/v2.1/servers/3d55d57b-fcbc-4f8a-98c5-99ed111aabc7 => generated 1188 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:39:10.058582 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-538153d6-e87a-4445-ac2b-e33d22e3a229 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:39:10.059174 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-538153d6-e87a-4445-ac2b-e33d22e3a229 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] [instance: b6a7339d-cc65-49bd-950a-33b6ab6bf56a] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:39:10.066097 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-538153d6-e87a-4445-ac2b-e33d22e3a229 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:39:10.066606 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-538153d6-e87a-4445-ac2b-e33d22e3a229 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:39:10.067105 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-538153d6-e87a-4445-ac2b-e33d22e3a229 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:39:10.067796 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-538153d6-e87a-4445-ac2b-e33d22e3a229 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:39:10.068267 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-538153d6-e87a-4445-ac2b-e33d22e3a229 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:39:10.068686 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-538153d6-e87a-4445-ac2b-e33d22e3a229 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:39:10.083362 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-538153d6-e87a-4445-ac2b-e33d22e3a229 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] HTTP exception thrown: Instance b6a7339d-cc65-49bd-950a-33b6ab6bf56a could not be found. Aug 10 23:39:10.085001 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-538153d6-e87a-4445-ac2b-e33d22e3a229 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Request method failure captured: Aug 10 23:39:10.085001 n-d-850468-14 devstack@n-api.service[122632]: request: GET /compute/v2.1/servers/b6a7339d-cc65-49bd-950a-33b6ab6bf56a HTTP/1.1 Aug 10 23:39:10.085001 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:39:10.085001 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:39:10.085001 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:39:10.085001 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 23:39:10.085001 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:39:10.085001 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:39:10.085001 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:39:10.085001 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:39:10.085001 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9EEb8QyHd3dMvChYQlm7NZUijwHZ5eMKSScLZKP3sPIpVhJ6A8NOPWJ4c9qaGqipegH2di7hTN0GFms7TiyBndv5s5QzctCZ0_LPjyK5Eijx5VjksKusb5tCLMcTkhdmz0lKuMEPZBHrFvX3dZeoP19mORQXEZHM9cMzVhIdEFZymEM Aug 10 23:39:10.085001 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:39:10.085001 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:39:10.085001 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:39:10.085001 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:39:10.085001 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:39:10.085001 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:39:10.085001 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 5b3c43fe735f488c9e1ccaf93a926960 Aug 10 23:39:10.085001 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-VolumesSnapshotTestJSON-696611637 Aug 10 23:39:10.085001 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:39:10.085001 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:39:10.085001 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5b3c43fe735f488c9e1ccaf93a926960"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5b3c43fe735f488c9e1ccaf93a926960"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/5b3c43fe735f488c9e1ccaf93a926960"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_5b3c43fe735f488c9e1ccaf93a926960", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:39:10.085001 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-VolumesSnapshotTestJSON-696611637 Aug 10 23:39:10.085001 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 5b3c43fe735f488c9e1ccaf93a926960 Aug 10 23:39:10.085001 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-696611637 Aug 10 23:39:10.085001 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-VolumesSnapshotTestJSON-696611637-project Aug 10 23:39:10.085001 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:39:10.085001 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:39:10.085001 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: d602346dc4054913b803780eb18b6cd8 Aug 10 23:39:10.085001 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-VolumesSnapshotTestJSON-696611637-project Aug 10 23:39:10.085001 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:39:10.085001 n-d-850468-14 devstack@n-api.service[122632]: exception: Instance b6a7339d-cc65-49bd-950a-33b6ab6bf56a could not be found. Aug 10 23:39:10.085001 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': 'b6a7339d-cc65-49bd-950a-33b6ab6bf56a'} Aug 10 23:39:10.085001 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:39:10.085001 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:39:10.085001 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:39:10.085001 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:39:10.085001 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:39:10.085001 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:39:10.085001 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:39:10.085001 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:39:10.085001 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:39:10.085001 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:39:10.085001 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b6a7339d-cc65-49bd-950a-33b6ab6bf56a could not be found. Aug 10 23:39:10.085001 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:39:10.085001 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:39:10.085001 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:39:10.085001 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:39:10.085001 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:39:10.085001 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:39:10.085001 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:39:10.085001 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:39:10.085001 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:39:10.085001 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:39:10.085001 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:39:10.085001 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:39:10.085001 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:39:10.085001 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:39:10.085001 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:39:10.085001 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:39:10.085001 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b6a7339d-cc65-49bd-950a-33b6ab6bf56a could not be found. Aug 10 23:39:10.085001 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:39:10.085001 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:39:10.085001 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:39:10.091275 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:39:10.091275 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:39:10.091275 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:39:10.091275 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:39:10.091275 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:39:10.091275 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b6a7339d-cc65-49bd-950a-33b6ab6bf56a could not be found. Aug 10 23:39:10.091275 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:39:10.091275 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-538153d6-e87a-4445-ac2b-e33d22e3a229 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Returning 404 to user: Instance b6a7339d-cc65-49bd-950a-33b6ab6bf56a could not be found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:39:10.091275 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-538153d6-e87a-4445-ac2b-e33d22e3a229 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] 10.222.0.58 "GET /compute/v2.1/servers/b6a7339d-cc65-49bd-950a-33b6ab6bf56a" status: 404 len: 111 microversion: 2.1 time: 0.032006 Aug 10 23:39:10.091275 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2928/6062] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:39:10 2022] GET /compute/v2.1/servers/b6a7339d-cc65-49bd-950a-33b6ab6bf56a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:39:10.834039 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-aff47bdf-2d5f-4ef9-9f35-826eea910aa7 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:39:10.834686 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-aff47bdf-2d5f-4ef9-9f35-826eea910aa7 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 3d55d57b-fcbc-4f8a-98c5-99ed111aabc7] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:39:10.837776 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:39:10.844053 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-aff47bdf-2d5f-4ef9-9f35-826eea910aa7 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:39:10.844581 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-aff47bdf-2d5f-4ef9-9f35-826eea910aa7 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:39:10.845039 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-aff47bdf-2d5f-4ef9-9f35-826eea910aa7 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:39:10.845762 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-aff47bdf-2d5f-4ef9-9f35-826eea910aa7 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:39:10.846219 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-aff47bdf-2d5f-4ef9-9f35-826eea910aa7 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:39:10.846645 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-aff47bdf-2d5f-4ef9-9f35-826eea910aa7 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:39:10.863402 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-aff47bdf-2d5f-4ef9-9f35-826eea910aa7 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] HTTP exception thrown: Instance 3d55d57b-fcbc-4f8a-98c5-99ed111aabc7 could not be found. Aug 10 23:39:10.865118 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-aff47bdf-2d5f-4ef9-9f35-826eea910aa7 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Request method failure captured: Aug 10 23:39:10.865118 n-d-850468-14 devstack@n-api.service[122633]: request: GET /compute/v2.1/servers/3d55d57b-fcbc-4f8a-98c5-99ed111aabc7 HTTP/1.1 Aug 10 23:39:10.865118 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:39:10.865118 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:39:10.865118 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:39:10.865118 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:39:10.865118 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:39:10.865118 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:39:10.865118 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:39:10.865118 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:39:10.865118 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9EF3JcALvIu97mWIb2swBcyDTxDI5PJ3vU9Ry5AtFPunVTcpAqQQUjRv0EmIlEp13u4BOFv0aTDkpyifGo3ChPE2BfANGKPVxkJ3JhuTa-9TLVCXxNdBMfkJGfbXf6wm_Y7u9vFxLHJ5-XazgQxDfOp_ueAQ4sa5cZKpoVrdkbUR3Jc Aug 10 23:39:10.865118 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:39:10.865118 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:39:10.865118 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:39:10.865118 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:39:10.865118 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:39:10.865118 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:39:10.865118 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 0b22838d50dd4ea8811953e723d0c052 Aug 10 23:39:10.865118 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-TestVolumeBootPattern-991439424 Aug 10 23:39:10.865118 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:39:10.865118 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:39:10.865118 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0b22838d50dd4ea8811953e723d0c052"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0b22838d50dd4ea8811953e723d0c052"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/0b22838d50dd4ea8811953e723d0c052"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_0b22838d50dd4ea8811953e723d0c052", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:39:10.865118 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-TestVolumeBootPattern-991439424 Aug 10 23:39:10.865118 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 0b22838d50dd4ea8811953e723d0c052 Aug 10 23:39:10.865118 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-TestVolumeBootPattern-991439424 Aug 10 23:39:10.865118 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-TestVolumeBootPattern-991439424-project Aug 10 23:39:10.865118 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:39:10.865118 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:39:10.865118 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: e97e9cddb55649809a9cd16dbc43bb7e Aug 10 23:39:10.865118 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-TestVolumeBootPattern-991439424-project Aug 10 23:39:10.865118 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:39:10.865118 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance 3d55d57b-fcbc-4f8a-98c5-99ed111aabc7 could not be found. Aug 10 23:39:10.865118 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': '3d55d57b-fcbc-4f8a-98c5-99ed111aabc7'} Aug 10 23:39:10.865118 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:39:10.865118 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:39:10.865118 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:39:10.865118 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:39:10.865118 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:39:10.865118 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:39:10.865118 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:39:10.865118 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:39:10.865118 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:39:10.865118 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:39:10.865118 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d55d57b-fcbc-4f8a-98c5-99ed111aabc7 could not be found. Aug 10 23:39:10.865118 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:39:10.865118 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:39:10.865118 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:39:10.865118 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:39:10.865118 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:39:10.865118 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:39:10.865118 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:39:10.865118 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:39:10.865118 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:39:10.865118 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:39:10.865118 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:39:10.865118 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:39:10.865118 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:39:10.865118 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:39:10.865118 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:39:10.865118 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:39:10.865118 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d55d57b-fcbc-4f8a-98c5-99ed111aabc7 could not be found. Aug 10 23:39:10.865118 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:39:10.865118 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:39:10.865118 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:39:10.870658 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:39:10.870658 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:39:10.870658 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:39:10.870658 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:39:10.870658 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:39:10.870658 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d55d57b-fcbc-4f8a-98c5-99ed111aabc7 could not be found. Aug 10 23:39:10.870658 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:39:10.870658 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-aff47bdf-2d5f-4ef9-9f35-826eea910aa7 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Returning 404 to user: Instance 3d55d57b-fcbc-4f8a-98c5-99ed111aabc7 could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:39:10.870658 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-aff47bdf-2d5f-4ef9-9f35-826eea910aa7 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/3d55d57b-fcbc-4f8a-98c5-99ed111aabc7" status: 404 len: 111 microversion: 2.1 time: 0.036542 Aug 10 23:39:10.870658 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3135/6063] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:39:10 2022] GET /compute/v2.1/servers/3d55d57b-fcbc-4f8a-98c5-99ed111aabc7 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:39:15.876370 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-e7f21fb9-e9a7-4ccc-bfd0-51b2dbcf436c tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-36050115", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "8647db52-25a2-43cc-bcb7-106740c0330b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "5ed0a190-471f-4749-aff5-4f68f1343451"}]}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:39:15.943177 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.network.neutron [None req-e7f21fb9-e9a7-4ccc-bfd0-51b2dbcf436c tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] validate_networks() for [('5ed0a190-471f-4749-aff5-4f68f1343451', None, None, None, None, None)] {{(pid=122632) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 23:39:16.409333 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-e7f21fb9-e9a7-4ccc-bfd0-51b2dbcf436c tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Flavor limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:39:16.409871 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-e7f21fb9-e9a7-4ccc-bfd0-51b2dbcf436c tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Image limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:39:16.410432 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-e7f21fb9-e9a7-4ccc-bfd0-51b2dbcf436c tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Flavor pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:39:16.411048 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-e7f21fb9-e9a7-4ccc-bfd0-51b2dbcf436c tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Image pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:39:16.411625 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-e7f21fb9-e9a7-4ccc-bfd0-51b2dbcf436c tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:39:16.421833 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e7f21fb9-e9a7-4ccc-bfd0-51b2dbcf436c tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:39:16.422317 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e7f21fb9-e9a7-4ccc-bfd0-51b2dbcf436c tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:39:16.422758 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e7f21fb9-e9a7-4ccc-bfd0-51b2dbcf436c tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:39:16.423558 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e7f21fb9-e9a7-4ccc-bfd0-51b2dbcf436c tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:39:16.424016 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e7f21fb9-e9a7-4ccc-bfd0-51b2dbcf436c tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:39:16.424446 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e7f21fb9-e9a7-4ccc-bfd0-51b2dbcf436c tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:39:16.441414 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-e7f21fb9-e9a7-4ccc-bfd0-51b2dbcf436c tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Getting quotas for project 0b22838d50dd4ea8811953e723d0c052. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:39:16.446942 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-e7f21fb9-e9a7-4ccc-bfd0-51b2dbcf436c tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Getting quotas for user e97e9cddb55649809a9cd16dbc43bb7e and project 0b22838d50dd4ea8811953e723d0c052. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:39:16.507726 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-e7f21fb9-e9a7-4ccc-bfd0-51b2dbcf436c tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Going to run 1 instances... {{(pid=122632) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 23:39:16.510662 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-e7f21fb9-e9a7-4ccc-bfd0-51b2dbcf436c tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 210ad895-2d87-4d37-8d50-23938746c73f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8647db52-25a2-43cc-bcb7-106740c0330b',volume_size=None,volume_type=None)] {{(pid=122632) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 23:39:16.673739 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-e7f21fb9-e9a7-4ccc-bfd0-51b2dbcf436c tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.801097 Aug 10 23:39:16.674345 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2929/6064] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 23:39:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 803 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 23:39:16.685415 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c58e1bb7-2658-4174-b1c7-af551f632c39 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:39:16.686034 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-c58e1bb7-2658-4174-b1c7-af551f632c39 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 210ad895-2d87-4d37-8d50-23938746c73f] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:39:16.742505 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-c58e1bb7-2658-4174-b1c7-af551f632c39 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:39:16.749786 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-c58e1bb7-2658-4174-b1c7-af551f632c39 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/210ad895-2d87-4d37-8d50-23938746c73f" status: 200 len: 1055 microversion: 2.1 time: 0.068440 Aug 10 23:39:16.750378 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3136/6065] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:39:16 2022] GET /compute/v2.1/servers/210ad895-2d87-4d37-8d50-23938746c73f => generated 1055 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:39:16.985590 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-01020f59-d633-4754-92dc-9ff52e4f1d7c tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1695454979", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452", "networks": [{"uuid": "655a95a3-55f1-4f3f-b510-b8644c3809a1"}]}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:39:17.042637 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.network.neutron [None req-01020f59-d633-4754-92dc-9ff52e4f1d7c tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] validate_networks() for [('655a95a3-55f1-4f3f-b510-b8644c3809a1', None, None, None, None, None)] {{(pid=122632) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 23:39:17.411018 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-01020f59-d633-4754-92dc-9ff52e4f1d7c tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Flavor limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:39:17.412197 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-01020f59-d633-4754-92dc-9ff52e4f1d7c tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Image limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:39:17.413185 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-01020f59-d633-4754-92dc-9ff52e4f1d7c tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Flavor pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:39:17.413618 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-01020f59-d633-4754-92dc-9ff52e4f1d7c tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Image pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:39:17.414023 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-01020f59-d633-4754-92dc-9ff52e4f1d7c tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:39:17.423824 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-01020f59-d633-4754-92dc-9ff52e4f1d7c tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:39:17.424301 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-01020f59-d633-4754-92dc-9ff52e4f1d7c tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:39:17.424732 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-01020f59-d633-4754-92dc-9ff52e4f1d7c tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:39:17.425443 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-01020f59-d633-4754-92dc-9ff52e4f1d7c tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:39:17.426088 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-01020f59-d633-4754-92dc-9ff52e4f1d7c tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:39:17.426703 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-01020f59-d633-4754-92dc-9ff52e4f1d7c tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:39:17.445052 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-01020f59-d633-4754-92dc-9ff52e4f1d7c tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Getting quotas for project 5b3c43fe735f488c9e1ccaf93a926960. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:39:17.450569 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-01020f59-d633-4754-92dc-9ff52e4f1d7c tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Getting quotas for user d602346dc4054913b803780eb18b6cd8 and project 5b3c43fe735f488c9e1ccaf93a926960. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:39:17.464080 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-01020f59-d633-4754-92dc-9ff52e4f1d7c tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Going to run 1 instances... {{(pid=122632) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 23:39:17.466228 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-01020f59-d633-4754-92dc-9ff52e4f1d7c tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] [instance: 4def0a7d-bafd-43bc-9cd5-dd8ccdd6b49d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78ad8905-f66f-4733-8be9-2b260f1fabed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122632) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 23:39:17.512213 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-01020f59-d633-4754-92dc-9ff52e4f1d7c tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.531605 Aug 10 23:39:17.512864 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2930/6066] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 23:39:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 533 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 23:39:17.526362 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-7456490a-6775-4737-907b-28c0cff1921a tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:39:17.527018 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-7456490a-6775-4737-907b-28c0cff1921a tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] [instance: 4def0a7d-bafd-43bc-9cd5-dd8ccdd6b49d] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:39:17.585120 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-7456490a-6775-4737-907b-28c0cff1921a tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd602346dc4054913b803780eb18b6cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b3c43fe735f488c9e1ccaf93a926960', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:39:17.593767 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-7456490a-6775-4737-907b-28c0cff1921a tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] 10.222.0.58 "GET /compute/v2.1/servers/4def0a7d-bafd-43bc-9cd5-dd8ccdd6b49d" status: 200 len: 1219 microversion: 2.1 time: 0.072155 Aug 10 23:39:17.608089 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3137/6067] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:39:17 2022] GET /compute/v2.1/servers/4def0a7d-bafd-43bc-9cd5-dd8ccdd6b49d => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:39:17.771943 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-71df126e-df72-402a-b81f-a6ac7795ca78 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:39:17.772472 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-71df126e-df72-402a-b81f-a6ac7795ca78 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 210ad895-2d87-4d37-8d50-23938746c73f] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:39:17.781357 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-71df126e-df72-402a-b81f-a6ac7795ca78 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:39:17.781762 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-71df126e-df72-402a-b81f-a6ac7795ca78 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:39:17.782208 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-71df126e-df72-402a-b81f-a6ac7795ca78 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:39:17.782908 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-71df126e-df72-402a-b81f-a6ac7795ca78 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:39:17.783365 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-71df126e-df72-402a-b81f-a6ac7795ca78 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:39:17.783800 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-71df126e-df72-402a-b81f-a6ac7795ca78 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:39:17.856876 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-71df126e-df72-402a-b81f-a6ac7795ca78 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:39:17.866137 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-71df126e-df72-402a-b81f-a6ac7795ca78 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/210ad895-2d87-4d37-8d50-23938746c73f" status: 200 len: 1171 microversion: 2.1 time: 0.098075 Aug 10 23:39:17.867118 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2931/6068] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:39:17 2022] GET /compute/v2.1/servers/210ad895-2d87-4d37-8d50-23938746c73f => generated 1171 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:39:18.615739 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-96719ccd-c04e-4518-accf-21b160ab7a7b tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:39:18.616538 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-96719ccd-c04e-4518-accf-21b160ab7a7b tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] [instance: 4def0a7d-bafd-43bc-9cd5-dd8ccdd6b49d] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:39:18.645500 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-96719ccd-c04e-4518-accf-21b160ab7a7b tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:39:18.646265 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-96719ccd-c04e-4518-accf-21b160ab7a7b tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:39:18.647087 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-96719ccd-c04e-4518-accf-21b160ab7a7b tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:39:18.648044 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-96719ccd-c04e-4518-accf-21b160ab7a7b tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:39:18.648655 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-96719ccd-c04e-4518-accf-21b160ab7a7b tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:39:18.649241 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-96719ccd-c04e-4518-accf-21b160ab7a7b tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:39:18.856744 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-96719ccd-c04e-4518-accf-21b160ab7a7b tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd602346dc4054913b803780eb18b6cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b3c43fe735f488c9e1ccaf93a926960', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:39:18.865743 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-96719ccd-c04e-4518-accf-21b160ab7a7b tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] 10.222.0.58 "GET /compute/v2.1/servers/4def0a7d-bafd-43bc-9cd5-dd8ccdd6b49d" status: 200 len: 1279 microversion: 2.1 time: 0.254949 Aug 10 23:39:18.866504 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3138/6069] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:39:18 2022] GET /compute/v2.1/servers/4def0a7d-bafd-43bc-9cd5-dd8ccdd6b49d => generated 1279 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:39:18.889282 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-a4ffa59e-b655-4cfd-81a8-613df531c86a tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:39:18.890524 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-a4ffa59e-b655-4cfd-81a8-613df531c86a tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 210ad895-2d87-4d37-8d50-23938746c73f] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:39:18.898236 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a4ffa59e-b655-4cfd-81a8-613df531c86a tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:39:18.899181 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a4ffa59e-b655-4cfd-81a8-613df531c86a tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:39:18.899916 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a4ffa59e-b655-4cfd-81a8-613df531c86a tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:39:18.901312 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a4ffa59e-b655-4cfd-81a8-613df531c86a tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:39:18.901955 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a4ffa59e-b655-4cfd-81a8-613df531c86a tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:39:18.902553 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a4ffa59e-b655-4cfd-81a8-613df531c86a tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:39:19.056262 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-a4ffa59e-b655-4cfd-81a8-613df531c86a tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:39:19.069488 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-a4ffa59e-b655-4cfd-81a8-613df531c86a tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/210ad895-2d87-4d37-8d50-23938746c73f" status: 200 len: 1213 microversion: 2.1 time: 0.184526 Aug 10 23:39:19.070225 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2932/6070] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:39:18 2022] GET /compute/v2.1/servers/210ad895-2d87-4d37-8d50-23938746c73f => generated 1213 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:39:19.815154 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-8448a034-f880-4930-99f7-daaa9ad59326 req-f1a5c750-f4f0-427c-bfcb-54753a82c2dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "210ad895-2d87-4d37-8d50-23938746c73f", "tag": "902000e9-3771-4df6-a425-9ccee90ba4ee"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:39:19.837054 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-8448a034-f880-4930-99f7-daaa9ad59326 req-f1a5c750-f4f0-427c-bfcb-54753a82c2dd service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:39:19.838929 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-8448a034-f880-4930-99f7-daaa9ad59326 req-f1a5c750-f4f0-427c-bfcb-54753a82c2dd service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:39:19.839553 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-8448a034-f880-4930-99f7-daaa9ad59326 req-f1a5c750-f4f0-427c-bfcb-54753a82c2dd service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:39:19.853090 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-8448a034-f880-4930-99f7-daaa9ad59326 req-f1a5c750-f4f0-427c-bfcb-54753a82c2dd service nova] Creating event network-changed:902000e9-3771-4df6-a425-9ccee90ba4ee for instance 210ad895-2d87-4d37-8d50-23938746c73f on n-h2-850468-14 Aug 10 23:39:19.859785 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-8448a034-f880-4930-99f7-daaa9ad59326 req-f1a5c750-f4f0-427c-bfcb-54753a82c2dd service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048539 Aug 10 23:39:19.860701 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3139/6071] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:39:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 23:39:19.889692 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-2b1f87b7-6bf7-4f60-ae7b-b942e035dcc6 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:39:19.890371 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-2b1f87b7-6bf7-4f60-ae7b-b942e035dcc6 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] [instance: 4def0a7d-bafd-43bc-9cd5-dd8ccdd6b49d] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:39:19.897679 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2b1f87b7-6bf7-4f60-ae7b-b942e035dcc6 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:39:19.898591 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2b1f87b7-6bf7-4f60-ae7b-b942e035dcc6 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:39:19.899034 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2b1f87b7-6bf7-4f60-ae7b-b942e035dcc6 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:39:19.899988 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2b1f87b7-6bf7-4f60-ae7b-b942e035dcc6 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:39:19.900729 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2b1f87b7-6bf7-4f60-ae7b-b942e035dcc6 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:39:19.901167 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2b1f87b7-6bf7-4f60-ae7b-b942e035dcc6 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:39:19.973863 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-2b1f87b7-6bf7-4f60-ae7b-b942e035dcc6 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd602346dc4054913b803780eb18b6cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b3c43fe735f488c9e1ccaf93a926960', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:39:19.984535 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-2b1f87b7-6bf7-4f60-ae7b-b942e035dcc6 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] 10.222.0.58 "GET /compute/v2.1/servers/4def0a7d-bafd-43bc-9cd5-dd8ccdd6b49d" status: 200 len: 1277 microversion: 2.1 time: 0.100196 Aug 10 23:39:19.986574 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2933/6072] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:39:19 2022] GET /compute/v2.1/servers/4def0a7d-bafd-43bc-9cd5-dd8ccdd6b49d => generated 1277 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:39:20.091939 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-4ac46e34-f31e-4468-b7d8-4d9e99524574 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:39:20.092818 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-4ac46e34-f31e-4468-b7d8-4d9e99524574 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 210ad895-2d87-4d37-8d50-23938746c73f] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:39:20.099391 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4ac46e34-f31e-4468-b7d8-4d9e99524574 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:39:20.099882 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4ac46e34-f31e-4468-b7d8-4d9e99524574 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:39:20.100532 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4ac46e34-f31e-4468-b7d8-4d9e99524574 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:39:20.101238 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4ac46e34-f31e-4468-b7d8-4d9e99524574 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:39:20.101859 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4ac46e34-f31e-4468-b7d8-4d9e99524574 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:39:20.102323 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4ac46e34-f31e-4468-b7d8-4d9e99524574 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:39:20.467947 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-4ac46e34-f31e-4468-b7d8-4d9e99524574 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:39:20.476121 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-4ac46e34-f31e-4468-b7d8-4d9e99524574 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/210ad895-2d87-4d37-8d50-23938746c73f" status: 200 len: 1213 microversion: 2.1 time: 0.389257 Aug 10 23:39:20.477185 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3140/6073] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:39:20 2022] GET /compute/v2.1/servers/210ad895-2d87-4d37-8d50-23938746c73f => generated 1213 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:39:21.007325 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-832af80d-0ea6-4164-8e90-268a4c9c2a78 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:39:21.007949 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-832af80d-0ea6-4164-8e90-268a4c9c2a78 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] [instance: 4def0a7d-bafd-43bc-9cd5-dd8ccdd6b49d] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:39:21.015141 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-832af80d-0ea6-4164-8e90-268a4c9c2a78 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:39:21.015641 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-832af80d-0ea6-4164-8e90-268a4c9c2a78 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:39:21.016087 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-832af80d-0ea6-4164-8e90-268a4c9c2a78 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:39:21.016802 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-832af80d-0ea6-4164-8e90-268a4c9c2a78 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:39:21.017263 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-832af80d-0ea6-4164-8e90-268a4c9c2a78 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:39:21.017695 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-832af80d-0ea6-4164-8e90-268a4c9c2a78 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:39:21.164335 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-832af80d-0ea6-4164-8e90-268a4c9c2a78 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd602346dc4054913b803780eb18b6cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b3c43fe735f488c9e1ccaf93a926960', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:39:21.175550 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-832af80d-0ea6-4164-8e90-268a4c9c2a78 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] 10.222.0.58 "GET /compute/v2.1/servers/4def0a7d-bafd-43bc-9cd5-dd8ccdd6b49d" status: 200 len: 1319 microversion: 2.1 time: 0.171989 Aug 10 23:39:21.176362 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2934/6074] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:39:21 2022] GET /compute/v2.1/servers/4def0a7d-bafd-43bc-9cd5-dd8ccdd6b49d => generated 1319 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:39:21.498340 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-e5472f18-9717-4b38-9693-063b1acf0542 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:39:21.499168 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-e5472f18-9717-4b38-9693-063b1acf0542 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 210ad895-2d87-4d37-8d50-23938746c73f] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:39:21.506095 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e5472f18-9717-4b38-9693-063b1acf0542 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:39:21.506709 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e5472f18-9717-4b38-9693-063b1acf0542 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:39:21.507594 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e5472f18-9717-4b38-9693-063b1acf0542 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:39:21.508418 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e5472f18-9717-4b38-9693-063b1acf0542 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:39:21.508982 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e5472f18-9717-4b38-9693-063b1acf0542 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:39:21.509626 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e5472f18-9717-4b38-9693-063b1acf0542 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:39:21.789858 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-e5472f18-9717-4b38-9693-063b1acf0542 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:39:21.805638 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-e5472f18-9717-4b38-9693-063b1acf0542 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/210ad895-2d87-4d37-8d50-23938746c73f" status: 200 len: 1213 microversion: 2.1 time: 0.311814 Aug 10 23:39:21.806238 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3141/6075] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:39:21 2022] GET /compute/v2.1/servers/210ad895-2d87-4d37-8d50-23938746c73f => generated 1213 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:39:21.898919 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-8c869f68-310c-4f6a-aba3-c236175c20c2 req-08778a96-54a3-46f0-b0c7-33f8edf39319 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4def0a7d-bafd-43bc-9cd5-dd8ccdd6b49d", "tag": "7facbff6-b988-4a9d-bd60-b4be72e8f09c"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:39:21.910720 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-8c869f68-310c-4f6a-aba3-c236175c20c2 req-08778a96-54a3-46f0-b0c7-33f8edf39319 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:39:21.911245 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-8c869f68-310c-4f6a-aba3-c236175c20c2 req-08778a96-54a3-46f0-b0c7-33f8edf39319 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:39:21.911836 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-8c869f68-310c-4f6a-aba3-c236175c20c2 req-08778a96-54a3-46f0-b0c7-33f8edf39319 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:39:21.928289 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-8c869f68-310c-4f6a-aba3-c236175c20c2 req-08778a96-54a3-46f0-b0c7-33f8edf39319 service nova] Creating event network-changed:7facbff6-b988-4a9d-bd60-b4be72e8f09c for instance 4def0a7d-bafd-43bc-9cd5-dd8ccdd6b49d on n-h1-850468-14 Aug 10 23:39:21.934863 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-8c869f68-310c-4f6a-aba3-c236175c20c2 req-08778a96-54a3-46f0-b0c7-33f8edf39319 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039942 Aug 10 23:39:21.935664 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2935/6076] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:39:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:39:22.199057 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-103e1d64-e29c-4786-8138-5930b1803b09 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:39:22.199670 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-103e1d64-e29c-4786-8138-5930b1803b09 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] [instance: 4def0a7d-bafd-43bc-9cd5-dd8ccdd6b49d] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:39:22.205619 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-103e1d64-e29c-4786-8138-5930b1803b09 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:39:22.206104 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-103e1d64-e29c-4786-8138-5930b1803b09 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:39:22.206539 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-103e1d64-e29c-4786-8138-5930b1803b09 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:39:22.207263 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-103e1d64-e29c-4786-8138-5930b1803b09 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:39:22.207720 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-103e1d64-e29c-4786-8138-5930b1803b09 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:39:22.208150 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-103e1d64-e29c-4786-8138-5930b1803b09 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:39:22.340912 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-103e1d64-e29c-4786-8138-5930b1803b09 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd602346dc4054913b803780eb18b6cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b3c43fe735f488c9e1ccaf93a926960', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:39:22.348823 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-103e1d64-e29c-4786-8138-5930b1803b09 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] 10.222.0.58 "GET /compute/v2.1/servers/4def0a7d-bafd-43bc-9cd5-dd8ccdd6b49d" status: 200 len: 1319 microversion: 2.1 time: 0.153827 Aug 10 23:39:22.349391 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3142/6077] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:39:22 2022] GET /compute/v2.1/servers/4def0a7d-bafd-43bc-9cd5-dd8ccdd6b49d => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:39:22.828438 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-b2ec66f0-c64e-4b37-bf6a-88cf23a63649 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:39:22.829126 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-b2ec66f0-c64e-4b37-bf6a-88cf23a63649 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 210ad895-2d87-4d37-8d50-23938746c73f] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:39:22.835453 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b2ec66f0-c64e-4b37-bf6a-88cf23a63649 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:39:22.835939 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b2ec66f0-c64e-4b37-bf6a-88cf23a63649 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:39:22.836382 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b2ec66f0-c64e-4b37-bf6a-88cf23a63649 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:39:22.837085 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b2ec66f0-c64e-4b37-bf6a-88cf23a63649 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:39:22.837556 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b2ec66f0-c64e-4b37-bf6a-88cf23a63649 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:39:22.838529 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b2ec66f0-c64e-4b37-bf6a-88cf23a63649 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:39:22.977631 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-b2ec66f0-c64e-4b37-bf6a-88cf23a63649 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:39:22.986679 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-b2ec66f0-c64e-4b37-bf6a-88cf23a63649 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/210ad895-2d87-4d37-8d50-23938746c73f" status: 200 len: 1213 microversion: 2.1 time: 0.163429 Aug 10 23:39:22.987389 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2936/6078] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:39:22 2022] GET /compute/v2.1/servers/210ad895-2d87-4d37-8d50-23938746c73f => generated 1213 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:39:23.372215 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-b8d0290e-5d68-4b4e-bab0-18fc21d73f77 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:39:23.372779 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-b8d0290e-5d68-4b4e-bab0-18fc21d73f77 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] [instance: 4def0a7d-bafd-43bc-9cd5-dd8ccdd6b49d] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:39:23.379577 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b8d0290e-5d68-4b4e-bab0-18fc21d73f77 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:39:23.380070 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b8d0290e-5d68-4b4e-bab0-18fc21d73f77 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:39:23.380512 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b8d0290e-5d68-4b4e-bab0-18fc21d73f77 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:39:23.381216 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b8d0290e-5d68-4b4e-bab0-18fc21d73f77 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:39:23.381681 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b8d0290e-5d68-4b4e-bab0-18fc21d73f77 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:39:23.382104 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b8d0290e-5d68-4b4e-bab0-18fc21d73f77 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:39:23.522477 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-b8d0290e-5d68-4b4e-bab0-18fc21d73f77 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd602346dc4054913b803780eb18b6cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b3c43fe735f488c9e1ccaf93a926960', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:39:23.531133 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-b8d0290e-5d68-4b4e-bab0-18fc21d73f77 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] 10.222.0.58 "GET /compute/v2.1/servers/4def0a7d-bafd-43bc-9cd5-dd8ccdd6b49d" status: 200 len: 1319 microversion: 2.1 time: 0.163831 Aug 10 23:39:23.531721 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3143/6079] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:39:23 2022] GET /compute/v2.1/servers/4def0a7d-bafd-43bc-9cd5-dd8ccdd6b49d => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:39:24.008542 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-720fbe54-1475-4819-be0d-65a1c7f3e709 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:39:24.009188 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-720fbe54-1475-4819-be0d-65a1c7f3e709 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 210ad895-2d87-4d37-8d50-23938746c73f] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:39:24.016720 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-720fbe54-1475-4819-be0d-65a1c7f3e709 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:39:24.017207 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-720fbe54-1475-4819-be0d-65a1c7f3e709 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:39:24.017643 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-720fbe54-1475-4819-be0d-65a1c7f3e709 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:39:24.018338 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-720fbe54-1475-4819-be0d-65a1c7f3e709 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:39:24.018804 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-720fbe54-1475-4819-be0d-65a1c7f3e709 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:39:24.019250 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-720fbe54-1475-4819-be0d-65a1c7f3e709 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:39:24.150850 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-720fbe54-1475-4819-be0d-65a1c7f3e709 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:39:24.159030 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-720fbe54-1475-4819-be0d-65a1c7f3e709 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/210ad895-2d87-4d37-8d50-23938746c73f" status: 200 len: 1201 microversion: 2.1 time: 0.154396 Aug 10 23:39:24.159607 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2937/6080] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:39:24 2022] GET /compute/v2.1/servers/210ad895-2d87-4d37-8d50-23938746c73f => generated 1201 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:39:24.551700 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-0e5a82cf-87da-47b2-8ccc-5ec300baf405 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:39:24.552309 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-0e5a82cf-87da-47b2-8ccc-5ec300baf405 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] [instance: 4def0a7d-bafd-43bc-9cd5-dd8ccdd6b49d] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:39:24.560302 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0e5a82cf-87da-47b2-8ccc-5ec300baf405 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:39:24.560787 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0e5a82cf-87da-47b2-8ccc-5ec300baf405 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:39:24.561219 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0e5a82cf-87da-47b2-8ccc-5ec300baf405 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:39:24.561906 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0e5a82cf-87da-47b2-8ccc-5ec300baf405 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:39:24.562383 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0e5a82cf-87da-47b2-8ccc-5ec300baf405 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:39:24.562818 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0e5a82cf-87da-47b2-8ccc-5ec300baf405 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:39:24.693632 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-0e5a82cf-87da-47b2-8ccc-5ec300baf405 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd602346dc4054913b803780eb18b6cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b3c43fe735f488c9e1ccaf93a926960', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:39:24.702021 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-0e5a82cf-87da-47b2-8ccc-5ec300baf405 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] 10.222.0.58 "GET /compute/v2.1/servers/4def0a7d-bafd-43bc-9cd5-dd8ccdd6b49d" status: 200 len: 1319 microversion: 2.1 time: 0.154117 Aug 10 23:39:24.702853 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3144/6081] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:39:24 2022] GET /compute/v2.1/servers/4def0a7d-bafd-43bc-9cd5-dd8ccdd6b49d => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:39:25.180204 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-e4f720be-9cfc-492e-a980-b99d6ed22cbe tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:39:25.180812 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-e4f720be-9cfc-492e-a980-b99d6ed22cbe tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 210ad895-2d87-4d37-8d50-23938746c73f] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:39:25.187687 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e4f720be-9cfc-492e-a980-b99d6ed22cbe tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:39:25.188171 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e4f720be-9cfc-492e-a980-b99d6ed22cbe tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:39:25.188610 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e4f720be-9cfc-492e-a980-b99d6ed22cbe tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:39:25.189303 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e4f720be-9cfc-492e-a980-b99d6ed22cbe tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:39:25.189758 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e4f720be-9cfc-492e-a980-b99d6ed22cbe tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:39:25.190189 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e4f720be-9cfc-492e-a980-b99d6ed22cbe tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:39:25.322539 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-e4f720be-9cfc-492e-a980-b99d6ed22cbe tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:39:25.331434 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-e4f720be-9cfc-492e-a980-b99d6ed22cbe tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/210ad895-2d87-4d37-8d50-23938746c73f" status: 200 len: 1201 microversion: 2.1 time: 0.155164 Aug 10 23:39:25.332026 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2938/6082] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:39:25 2022] GET /compute/v2.1/servers/210ad895-2d87-4d37-8d50-23938746c73f => generated 1201 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:39:25.722710 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-7c258f94-6132-4a88-a34d-b9bece0d9ddd tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:39:25.723398 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-7c258f94-6132-4a88-a34d-b9bece0d9ddd tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] [instance: 4def0a7d-bafd-43bc-9cd5-dd8ccdd6b49d] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:39:25.730272 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7c258f94-6132-4a88-a34d-b9bece0d9ddd tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:39:25.730753 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7c258f94-6132-4a88-a34d-b9bece0d9ddd tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:39:25.731221 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7c258f94-6132-4a88-a34d-b9bece0d9ddd tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:39:25.731915 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7c258f94-6132-4a88-a34d-b9bece0d9ddd tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:39:25.732371 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7c258f94-6132-4a88-a34d-b9bece0d9ddd tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:39:25.732794 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7c258f94-6132-4a88-a34d-b9bece0d9ddd tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:39:25.866959 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-7c258f94-6132-4a88-a34d-b9bece0d9ddd tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd602346dc4054913b803780eb18b6cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b3c43fe735f488c9e1ccaf93a926960', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:39:25.875085 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-7c258f94-6132-4a88-a34d-b9bece0d9ddd tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] 10.222.0.58 "GET /compute/v2.1/servers/4def0a7d-bafd-43bc-9cd5-dd8ccdd6b49d" status: 200 len: 1319 microversion: 2.1 time: 0.156187 Aug 10 23:39:25.875684 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3145/6083] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:39:25 2022] GET /compute/v2.1/servers/4def0a7d-bafd-43bc-9cd5-dd8ccdd6b49d => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:39:26.352840 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-65054c33-31fd-4984-ab93-16dfb7603fbc tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:39:26.354282 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-65054c33-31fd-4984-ab93-16dfb7603fbc tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 210ad895-2d87-4d37-8d50-23938746c73f] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:39:26.361807 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-65054c33-31fd-4984-ab93-16dfb7603fbc tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:39:26.362305 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-65054c33-31fd-4984-ab93-16dfb7603fbc tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:39:26.362748 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-65054c33-31fd-4984-ab93-16dfb7603fbc tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:39:26.363495 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-65054c33-31fd-4984-ab93-16dfb7603fbc tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:39:26.363952 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-65054c33-31fd-4984-ab93-16dfb7603fbc tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:39:26.364380 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-65054c33-31fd-4984-ab93-16dfb7603fbc tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:39:26.496446 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-65054c33-31fd-4984-ab93-16dfb7603fbc tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:39:26.503964 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-65054c33-31fd-4984-ab93-16dfb7603fbc tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/210ad895-2d87-4d37-8d50-23938746c73f" status: 200 len: 1201 microversion: 2.1 time: 0.155154 Aug 10 23:39:26.504542 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2939/6084] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:39:26 2022] GET /compute/v2.1/servers/210ad895-2d87-4d37-8d50-23938746c73f => generated 1201 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:39:26.897037 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-3437c8c9-a968-40a7-ac53-0403d0b89bed tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:39:26.897644 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-3437c8c9-a968-40a7-ac53-0403d0b89bed tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] [instance: 4def0a7d-bafd-43bc-9cd5-dd8ccdd6b49d] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:39:26.905224 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3437c8c9-a968-40a7-ac53-0403d0b89bed tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:39:26.905700 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3437c8c9-a968-40a7-ac53-0403d0b89bed tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:39:26.906125 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3437c8c9-a968-40a7-ac53-0403d0b89bed tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:39:26.906827 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3437c8c9-a968-40a7-ac53-0403d0b89bed tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:39:26.907276 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3437c8c9-a968-40a7-ac53-0403d0b89bed tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:39:26.907696 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3437c8c9-a968-40a7-ac53-0403d0b89bed tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:39:27.045152 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-3437c8c9-a968-40a7-ac53-0403d0b89bed tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd602346dc4054913b803780eb18b6cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b3c43fe735f488c9e1ccaf93a926960', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:39:27.052661 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-3437c8c9-a968-40a7-ac53-0403d0b89bed tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] 10.222.0.58 "GET /compute/v2.1/servers/4def0a7d-bafd-43bc-9cd5-dd8ccdd6b49d" status: 200 len: 1319 microversion: 2.1 time: 0.159554 Aug 10 23:39:27.053239 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3146/6085] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:39:26 2022] GET /compute/v2.1/servers/4def0a7d-bafd-43bc-9cd5-dd8ccdd6b49d => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:39:27.525522 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-4e7504de-8fbf-41f8-b410-84018ed5a8b5 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:39:27.526240 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-4e7504de-8fbf-41f8-b410-84018ed5a8b5 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 210ad895-2d87-4d37-8d50-23938746c73f] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:39:27.529114 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=4 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:39:27.529965 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=12 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:39:27.535493 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4e7504de-8fbf-41f8-b410-84018ed5a8b5 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:39:27.535983 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4e7504de-8fbf-41f8-b410-84018ed5a8b5 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:39:27.536425 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4e7504de-8fbf-41f8-b410-84018ed5a8b5 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:39:27.537127 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4e7504de-8fbf-41f8-b410-84018ed5a8b5 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:39:27.537587 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4e7504de-8fbf-41f8-b410-84018ed5a8b5 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:39:27.538017 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4e7504de-8fbf-41f8-b410-84018ed5a8b5 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:39:27.669552 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-4e7504de-8fbf-41f8-b410-84018ed5a8b5 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:39:27.678113 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-4e7504de-8fbf-41f8-b410-84018ed5a8b5 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/210ad895-2d87-4d37-8d50-23938746c73f" status: 200 len: 1201 microversion: 2.1 time: 0.156640 Aug 10 23:39:27.678699 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2940/6086] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:39:27 2022] GET /compute/v2.1/servers/210ad895-2d87-4d37-8d50-23938746c73f => generated 1201 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:39:28.024304 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-bd07b741-1765-43bb-9a68-5b5fd82f055c req-8513ad1d-3718-499e-b9dc-5d18ed17ec06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4def0a7d-bafd-43bc-9cd5-dd8ccdd6b49d", "name": "network-vif-plugged", "status": "completed", "tag": "7facbff6-b988-4a9d-bd60-b4be72e8f09c"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:39:28.029998 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=4 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:39:28.036430 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-bd07b741-1765-43bb-9a68-5b5fd82f055c req-8513ad1d-3718-499e-b9dc-5d18ed17ec06 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:39:28.036923 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-bd07b741-1765-43bb-9a68-5b5fd82f055c req-8513ad1d-3718-499e-b9dc-5d18ed17ec06 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:39:28.037361 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-bd07b741-1765-43bb-9a68-5b5fd82f055c req-8513ad1d-3718-499e-b9dc-5d18ed17ec06 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:39:28.050074 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-bd07b741-1765-43bb-9a68-5b5fd82f055c req-8513ad1d-3718-499e-b9dc-5d18ed17ec06 service nova] Creating event network-vif-plugged:7facbff6-b988-4a9d-bd60-b4be72e8f09c for instance 4def0a7d-bafd-43bc-9cd5-dd8ccdd6b49d on n-h1-850468-14 Aug 10 23:39:28.055022 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-bd07b741-1765-43bb-9a68-5b5fd82f055c req-8513ad1d-3718-499e-b9dc-5d18ed17ec06 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034628 Aug 10 23:39:28.055623 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3147/6087] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:39:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:39:28.074840 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-e864ba1c-3b93-46c0-9f53-4575b1187a15 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:39:28.075466 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-e864ba1c-3b93-46c0-9f53-4575b1187a15 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] [instance: 4def0a7d-bafd-43bc-9cd5-dd8ccdd6b49d] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:39:28.081926 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e864ba1c-3b93-46c0-9f53-4575b1187a15 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:39:28.082658 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e864ba1c-3b93-46c0-9f53-4575b1187a15 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:39:28.083283 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e864ba1c-3b93-46c0-9f53-4575b1187a15 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:39:28.084199 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e864ba1c-3b93-46c0-9f53-4575b1187a15 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:39:28.084817 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e864ba1c-3b93-46c0-9f53-4575b1187a15 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:39:28.085408 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e864ba1c-3b93-46c0-9f53-4575b1187a15 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:39:28.101906 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:39:28.233138 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-e864ba1c-3b93-46c0-9f53-4575b1187a15 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd602346dc4054913b803780eb18b6cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b3c43fe735f488c9e1ccaf93a926960', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:39:28.241143 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-e864ba1c-3b93-46c0-9f53-4575b1187a15 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] 10.222.0.58 "GET /compute/v2.1/servers/4def0a7d-bafd-43bc-9cd5-dd8ccdd6b49d" status: 200 len: 1319 microversion: 2.1 time: 0.170732 Aug 10 23:39:28.241724 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2941/6088] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:39:28 2022] GET /compute/v2.1/servers/4def0a7d-bafd-43bc-9cd5-dd8ccdd6b49d => generated 1319 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:39:28.699903 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-44ff3534-094e-41f5-b0df-7299cb66f32e tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:39:28.700517 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-44ff3534-094e-41f5-b0df-7299cb66f32e tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 210ad895-2d87-4d37-8d50-23938746c73f] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:39:28.707287 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-44ff3534-094e-41f5-b0df-7299cb66f32e tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:39:28.707783 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-44ff3534-094e-41f5-b0df-7299cb66f32e tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:39:28.708222 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-44ff3534-094e-41f5-b0df-7299cb66f32e tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:39:28.708931 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-44ff3534-094e-41f5-b0df-7299cb66f32e tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:39:28.709387 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-44ff3534-094e-41f5-b0df-7299cb66f32e tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:39:28.709816 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-44ff3534-094e-41f5-b0df-7299cb66f32e tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:39:28.846994 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-44ff3534-094e-41f5-b0df-7299cb66f32e tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:39:28.854596 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-44ff3534-094e-41f5-b0df-7299cb66f32e tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/210ad895-2d87-4d37-8d50-23938746c73f" status: 200 len: 1201 microversion: 2.1 time: 0.159834 Aug 10 23:39:28.855204 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3148/6089] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:39:28 2022] GET /compute/v2.1/servers/210ad895-2d87-4d37-8d50-23938746c73f => generated 1201 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:39:29.262941 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-ba61a7b2-e281-4e71-b4b7-1d8b6ef0a003 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:39:29.263562 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-ba61a7b2-e281-4e71-b4b7-1d8b6ef0a003 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] [instance: 4def0a7d-bafd-43bc-9cd5-dd8ccdd6b49d] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:39:29.270935 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ba61a7b2-e281-4e71-b4b7-1d8b6ef0a003 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:39:29.271485 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ba61a7b2-e281-4e71-b4b7-1d8b6ef0a003 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:39:29.271895 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ba61a7b2-e281-4e71-b4b7-1d8b6ef0a003 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:39:29.272588 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ba61a7b2-e281-4e71-b4b7-1d8b6ef0a003 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:39:29.273036 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ba61a7b2-e281-4e71-b4b7-1d8b6ef0a003 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:39:29.273455 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ba61a7b2-e281-4e71-b4b7-1d8b6ef0a003 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:39:29.416825 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-ba61a7b2-e281-4e71-b4b7-1d8b6ef0a003 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd602346dc4054913b803780eb18b6cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b3c43fe735f488c9e1ccaf93a926960', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:39:29.425128 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-ba61a7b2-e281-4e71-b4b7-1d8b6ef0a003 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] 10.222.0.58 "GET /compute/v2.1/servers/4def0a7d-bafd-43bc-9cd5-dd8ccdd6b49d" status: 200 len: 1506 microversion: 2.1 time: 0.167068 Aug 10 23:39:29.425749 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2942/6090] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:39:29 2022] GET /compute/v2.1/servers/4def0a7d-bafd-43bc-9cd5-dd8ccdd6b49d => generated 1506 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:39:29.445661 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-1c3a9b0d-084e-44b3-8c0f-c1197038b8b9 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a9e1022b-ef92-41cd-a896-17027a6baaf6", "device": "/dev/sdb"}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:39:29.449142 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-1c3a9b0d-084e-44b3-8c0f-c1197038b8b9 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] [instance: 4def0a7d-bafd-43bc-9cd5-dd8ccdd6b49d] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:39:29.456735 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1c3a9b0d-084e-44b3-8c0f-c1197038b8b9 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:39:29.457216 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1c3a9b0d-084e-44b3-8c0f-c1197038b8b9 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:39:29.457653 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1c3a9b0d-084e-44b3-8c0f-c1197038b8b9 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:39:29.458352 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1c3a9b0d-084e-44b3-8c0f-c1197038b8b9 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:39:29.458816 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1c3a9b0d-084e-44b3-8c0f-c1197038b8b9 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:39:29.459239 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1c3a9b0d-084e-44b3-8c0f-c1197038b8b9 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:39:29.702590 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-1c3a9b0d-084e-44b3-8c0f-c1197038b8b9 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] 10.222.0.58 "POST /compute/v2.1/servers/4def0a7d-bafd-43bc-9cd5-dd8ccdd6b49d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.260448 Aug 10 23:39:29.703491 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3149/6091] 10.222.0.58 () {60 vars in 1323 bytes} [Wed Aug 10 23:39:29 2022] POST /compute/v2.1/servers/4def0a7d-bafd-43bc-9cd5-dd8ccdd6b49d/os-volume_attachments => generated 194 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:39:29.875837 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c9777ece-8ca2-4051-b3ef-0fa84da24a04 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:39:29.876497 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-c9777ece-8ca2-4051-b3ef-0fa84da24a04 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 210ad895-2d87-4d37-8d50-23938746c73f] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:39:29.883058 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c9777ece-8ca2-4051-b3ef-0fa84da24a04 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:39:29.883570 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c9777ece-8ca2-4051-b3ef-0fa84da24a04 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:39:29.883998 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c9777ece-8ca2-4051-b3ef-0fa84da24a04 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:39:29.885445 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c9777ece-8ca2-4051-b3ef-0fa84da24a04 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:39:29.886197 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c9777ece-8ca2-4051-b3ef-0fa84da24a04 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:39:29.886860 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c9777ece-8ca2-4051-b3ef-0fa84da24a04 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:39:30.029014 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-c9777ece-8ca2-4051-b3ef-0fa84da24a04 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:39:30.036733 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-c9777ece-8ca2-4051-b3ef-0fa84da24a04 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/210ad895-2d87-4d37-8d50-23938746c73f" status: 200 len: 1201 microversion: 2.1 time: 0.164931 Aug 10 23:39:30.037320 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2943/6092] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:39:29 2022] GET /compute/v2.1/servers/210ad895-2d87-4d37-8d50-23938746c73f => generated 1201 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:39:31.063448 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-10ab72a5-3738-457d-a51c-a5249bbfa245 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:39:31.064814 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-10ab72a5-3738-457d-a51c-a5249bbfa245 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 210ad895-2d87-4d37-8d50-23938746c73f] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:39:31.076798 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-10ab72a5-3738-457d-a51c-a5249bbfa245 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:39:31.077419 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-10ab72a5-3738-457d-a51c-a5249bbfa245 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:39:31.077895 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-10ab72a5-3738-457d-a51c-a5249bbfa245 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:39:31.078605 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-10ab72a5-3738-457d-a51c-a5249bbfa245 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:39:31.079091 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-10ab72a5-3738-457d-a51c-a5249bbfa245 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:39:31.079519 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-10ab72a5-3738-457d-a51c-a5249bbfa245 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:39:31.217190 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-10ab72a5-3738-457d-a51c-a5249bbfa245 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:39:31.225573 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-10ab72a5-3738-457d-a51c-a5249bbfa245 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/210ad895-2d87-4d37-8d50-23938746c73f" status: 200 len: 1201 microversion: 2.1 time: 0.171686 Aug 10 23:39:31.226272 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3150/6093] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:39:31 2022] GET /compute/v2.1/servers/210ad895-2d87-4d37-8d50-23938746c73f => generated 1201 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:39:32.248165 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-abe0f2fb-d7f3-4c8f-b1bd-18d46cb8dd95 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:39:32.248764 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-abe0f2fb-d7f3-4c8f-b1bd-18d46cb8dd95 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 210ad895-2d87-4d37-8d50-23938746c73f] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:39:32.256071 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-abe0f2fb-d7f3-4c8f-b1bd-18d46cb8dd95 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:39:32.256631 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-abe0f2fb-d7f3-4c8f-b1bd-18d46cb8dd95 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:39:32.257137 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-abe0f2fb-d7f3-4c8f-b1bd-18d46cb8dd95 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:39:32.257907 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-abe0f2fb-d7f3-4c8f-b1bd-18d46cb8dd95 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:39:32.258429 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-abe0f2fb-d7f3-4c8f-b1bd-18d46cb8dd95 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:39:32.258977 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-abe0f2fb-d7f3-4c8f-b1bd-18d46cb8dd95 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:39:32.407169 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-abe0f2fb-d7f3-4c8f-b1bd-18d46cb8dd95 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:39:32.418920 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-abe0f2fb-d7f3-4c8f-b1bd-18d46cb8dd95 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/210ad895-2d87-4d37-8d50-23938746c73f" status: 200 len: 1201 microversion: 2.1 time: 0.175524 Aug 10 23:39:32.419850 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2944/6094] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:39:32 2022] GET /compute/v2.1/servers/210ad895-2d87-4d37-8d50-23938746c73f => generated 1201 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:39:32.578809 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-41f9dbad-3c70-40bf-ba90-bc0f26a17714 req-bf695937-e171-4db4-8bb9-649a6ec7fe0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "210ad895-2d87-4d37-8d50-23938746c73f", "name": "network-vif-plugged", "status": "completed", "tag": "902000e9-3771-4df6-a425-9ccee90ba4ee"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:39:32.595873 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-41f9dbad-3c70-40bf-ba90-bc0f26a17714 req-bf695937-e171-4db4-8bb9-649a6ec7fe0e service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:39:32.596487 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-41f9dbad-3c70-40bf-ba90-bc0f26a17714 req-bf695937-e171-4db4-8bb9-649a6ec7fe0e service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:39:32.597037 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-41f9dbad-3c70-40bf-ba90-bc0f26a17714 req-bf695937-e171-4db4-8bb9-649a6ec7fe0e service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:39:32.601466 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:39:32.612382 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-41f9dbad-3c70-40bf-ba90-bc0f26a17714 req-bf695937-e171-4db4-8bb9-649a6ec7fe0e service nova] Creating event network-vif-plugged:902000e9-3771-4df6-a425-9ccee90ba4ee for instance 210ad895-2d87-4d37-8d50-23938746c73f on n-h2-850468-14 Aug 10 23:39:32.618414 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-41f9dbad-3c70-40bf-ba90-bc0f26a17714 req-bf695937-e171-4db4-8bb9-649a6ec7fe0e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043702 Aug 10 23:39:32.621546 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3151/6095] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:39:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:39:33.440421 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-aaa56fe0-4abf-4b59-bf31-de7ba343582b tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:39:33.441014 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-aaa56fe0-4abf-4b59-bf31-de7ba343582b tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 210ad895-2d87-4d37-8d50-23938746c73f] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:39:33.449021 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-aaa56fe0-4abf-4b59-bf31-de7ba343582b tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:39:33.449526 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-aaa56fe0-4abf-4b59-bf31-de7ba343582b tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:39:33.449960 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-aaa56fe0-4abf-4b59-bf31-de7ba343582b tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:39:33.450656 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-aaa56fe0-4abf-4b59-bf31-de7ba343582b tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:39:33.451137 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-aaa56fe0-4abf-4b59-bf31-de7ba343582b tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:39:33.451561 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-aaa56fe0-4abf-4b59-bf31-de7ba343582b tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:39:33.586687 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-aaa56fe0-4abf-4b59-bf31-de7ba343582b tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:39:33.596971 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-aaa56fe0-4abf-4b59-bf31-de7ba343582b tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/210ad895-2d87-4d37-8d50-23938746c73f" status: 200 len: 1201 microversion: 2.1 time: 0.160339 Aug 10 23:39:33.598196 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2945/6096] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:39:33 2022] GET /compute/v2.1/servers/210ad895-2d87-4d37-8d50-23938746c73f => generated 1201 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:39:34.622961 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-172f77ae-0985-419b-8f6c-e9b476f56bfe tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:39:34.623692 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-172f77ae-0985-419b-8f6c-e9b476f56bfe tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 210ad895-2d87-4d37-8d50-23938746c73f] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:39:34.631912 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-172f77ae-0985-419b-8f6c-e9b476f56bfe tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:39:34.632458 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-172f77ae-0985-419b-8f6c-e9b476f56bfe tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:39:34.632971 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-172f77ae-0985-419b-8f6c-e9b476f56bfe tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:39:34.633689 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-172f77ae-0985-419b-8f6c-e9b476f56bfe tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:39:34.634226 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-172f77ae-0985-419b-8f6c-e9b476f56bfe tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:39:34.634960 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-172f77ae-0985-419b-8f6c-e9b476f56bfe tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:39:34.786947 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-172f77ae-0985-419b-8f6c-e9b476f56bfe tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:39:34.795406 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-172f77ae-0985-419b-8f6c-e9b476f56bfe tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/210ad895-2d87-4d37-8d50-23938746c73f" status: 200 len: 1388 microversion: 2.1 time: 0.178987 Aug 10 23:39:34.795990 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3152/6097] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:39:34 2022] GET /compute/v2.1/servers/210ad895-2d87-4d37-8d50-23938746c73f => generated 1388 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:39:34.816137 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-ad137975-569d-4387-a2ad-234165bb8d5c tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:39:34.816754 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-ad137975-569d-4387-a2ad-234165bb8d5c tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 210ad895-2d87-4d37-8d50-23938746c73f] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:39:34.823955 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ad137975-569d-4387-a2ad-234165bb8d5c tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:39:34.824392 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ad137975-569d-4387-a2ad-234165bb8d5c tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:39:34.824836 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ad137975-569d-4387-a2ad-234165bb8d5c tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:39:34.825531 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ad137975-569d-4387-a2ad-234165bb8d5c tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:39:34.825989 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ad137975-569d-4387-a2ad-234165bb8d5c tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:39:34.826418 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ad137975-569d-4387-a2ad-234165bb8d5c tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:39:34.961116 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-ad137975-569d-4387-a2ad-234165bb8d5c tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:39:34.969943 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-ad137975-569d-4387-a2ad-234165bb8d5c tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/210ad895-2d87-4d37-8d50-23938746c73f" status: 200 len: 1388 microversion: 2.1 time: 0.157664 Aug 10 23:39:34.970521 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2946/6098] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:39:34 2022] GET /compute/v2.1/servers/210ad895-2d87-4d37-8d50-23938746c73f => generated 1388 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:39:34.990627 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-119dc15a-537b-4aea-860f-e0689daaf6d2 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:39:34.991322 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-119dc15a-537b-4aea-860f-e0689daaf6d2 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 210ad895-2d87-4d37-8d50-23938746c73f] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:39:34.997382 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-119dc15a-537b-4aea-860f-e0689daaf6d2 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:39:34.997867 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-119dc15a-537b-4aea-860f-e0689daaf6d2 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:39:34.998303 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-119dc15a-537b-4aea-860f-e0689daaf6d2 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:39:34.999026 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-119dc15a-537b-4aea-860f-e0689daaf6d2 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:39:34.999482 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-119dc15a-537b-4aea-860f-e0689daaf6d2 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:39:34.999904 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-119dc15a-537b-4aea-860f-e0689daaf6d2 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:39:35.130869 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-119dc15a-537b-4aea-860f-e0689daaf6d2 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:39:35.138976 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-119dc15a-537b-4aea-860f-e0689daaf6d2 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/210ad895-2d87-4d37-8d50-23938746c73f" status: 200 len: 1388 microversion: 2.1 time: 0.152169 Aug 10 23:39:35.139567 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3153/6099] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:39:34 2022] GET /compute/v2.1/servers/210ad895-2d87-4d37-8d50-23938746c73f => generated 1388 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:39:35.159146 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-ddb1c3fb-7753-4a7a-b627-545ab0f466c3 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:39:35.159647 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-ddb1c3fb-7753-4a7a-b627-545ab0f466c3 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 210ad895-2d87-4d37-8d50-23938746c73f] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:39:35.166088 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ddb1c3fb-7753-4a7a-b627-545ab0f466c3 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:39:35.166699 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ddb1c3fb-7753-4a7a-b627-545ab0f466c3 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:39:35.167675 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ddb1c3fb-7753-4a7a-b627-545ab0f466c3 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:39:35.168379 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ddb1c3fb-7753-4a7a-b627-545ab0f466c3 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:39:35.168841 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ddb1c3fb-7753-4a7a-b627-545ab0f466c3 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:39:35.169271 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ddb1c3fb-7753-4a7a-b627-545ab0f466c3 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:39:35.194081 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-ddb1c3fb-7753-4a7a-b627-545ab0f466c3 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 210ad895-2d87-4d37-8d50-23938746c73f] Going to try to terminate instance {{(pid=122632) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:39:35.268385 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-ddb1c3fb-7753-4a7a-b627-545ab0f466c3 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "DELETE /compute/v2.1/servers/210ad895-2d87-4d37-8d50-23938746c73f" status: 204 len: 0 microversion: 2.1 time: 0.112993 Aug 10 23:39:35.268990 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2947/6100] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:39:35 2022] DELETE /compute/v2.1/servers/210ad895-2d87-4d37-8d50-23938746c73f => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:39:35.279798 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-ab5de8b7-8a95-40c5-b231-6eb039010ff8 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:39:35.280567 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-ab5de8b7-8a95-40c5-b231-6eb039010ff8 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 210ad895-2d87-4d37-8d50-23938746c73f] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:39:35.286712 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ab5de8b7-8a95-40c5-b231-6eb039010ff8 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:39:35.287235 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ab5de8b7-8a95-40c5-b231-6eb039010ff8 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:39:35.287989 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ab5de8b7-8a95-40c5-b231-6eb039010ff8 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:39:35.288691 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ab5de8b7-8a95-40c5-b231-6eb039010ff8 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:39:35.289145 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ab5de8b7-8a95-40c5-b231-6eb039010ff8 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:39:35.289581 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ab5de8b7-8a95-40c5-b231-6eb039010ff8 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:39:35.431870 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-ab5de8b7-8a95-40c5-b231-6eb039010ff8 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:39:35.439521 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-ab5de8b7-8a95-40c5-b231-6eb039010ff8 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/210ad895-2d87-4d37-8d50-23938746c73f" status: 200 len: 1394 microversion: 2.1 time: 0.165681 Aug 10 23:39:35.440105 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3154/6101] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:39:35 2022] GET /compute/v2.1/servers/210ad895-2d87-4d37-8d50-23938746c73f => generated 1394 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:39:36.462116 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-34209d27-30d0-4f33-a484-e2b7c776cbf4 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:39:36.463029 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-34209d27-30d0-4f33-a484-e2b7c776cbf4 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 210ad895-2d87-4d37-8d50-23938746c73f] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:39:36.466063 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=2,nova_api:INSERT=6 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:39:36.471595 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-34209d27-30d0-4f33-a484-e2b7c776cbf4 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:39:36.472092 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-34209d27-30d0-4f33-a484-e2b7c776cbf4 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:39:36.472523 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-34209d27-30d0-4f33-a484-e2b7c776cbf4 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:39:36.473224 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-34209d27-30d0-4f33-a484-e2b7c776cbf4 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:39:36.473679 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-34209d27-30d0-4f33-a484-e2b7c776cbf4 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:39:36.474103 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-34209d27-30d0-4f33-a484-e2b7c776cbf4 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:39:36.613405 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-34209d27-30d0-4f33-a484-e2b7c776cbf4 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:39:36.622806 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-34209d27-30d0-4f33-a484-e2b7c776cbf4 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/210ad895-2d87-4d37-8d50-23938746c73f" status: 200 len: 1394 microversion: 2.1 time: 0.164921 Aug 10 23:39:36.624498 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2948/6102] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:39:36 2022] GET /compute/v2.1/servers/210ad895-2d87-4d37-8d50-23938746c73f => generated 1394 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:39:37.355723 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-b0c8e932-30c3-4337-94da-5e4febb208d2 req-7f67960c-d55f-43a8-a311-41a2b46baff6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "210ad895-2d87-4d37-8d50-23938746c73f", "name": "network-vif-deleted", "tag": "902000e9-3771-4df6-a425-9ccee90ba4ee"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:39:37.371506 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-b0c8e932-30c3-4337-94da-5e4febb208d2 req-7f67960c-d55f-43a8-a311-41a2b46baff6 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:39:37.371987 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-b0c8e932-30c3-4337-94da-5e4febb208d2 req-7f67960c-d55f-43a8-a311-41a2b46baff6 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:39:37.372418 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-b0c8e932-30c3-4337-94da-5e4febb208d2 req-7f67960c-d55f-43a8-a311-41a2b46baff6 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:39:37.384907 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-b0c8e932-30c3-4337-94da-5e4febb208d2 req-7f67960c-d55f-43a8-a311-41a2b46baff6 service nova] Creating event network-vif-deleted:902000e9-3771-4df6-a425-9ccee90ba4ee for instance 210ad895-2d87-4d37-8d50-23938746c73f on n-h2-850468-14 Aug 10 23:39:37.390258 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-b0c8e932-30c3-4337-94da-5e4febb208d2 req-7f67960c-d55f-43a8-a311-41a2b46baff6 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039806 Aug 10 23:39:37.391095 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3155/6103] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:39:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:39:37.645390 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-1e6b0d38-504d-47a8-94bb-d5bd405977b6 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:39:37.645929 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-1e6b0d38-504d-47a8-94bb-d5bd405977b6 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 210ad895-2d87-4d37-8d50-23938746c73f] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:39:37.654059 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1e6b0d38-504d-47a8-94bb-d5bd405977b6 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:39:37.654557 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1e6b0d38-504d-47a8-94bb-d5bd405977b6 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:39:37.655039 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1e6b0d38-504d-47a8-94bb-d5bd405977b6 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:39:37.655756 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1e6b0d38-504d-47a8-94bb-d5bd405977b6 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:39:37.656214 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1e6b0d38-504d-47a8-94bb-d5bd405977b6 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:39:37.656644 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1e6b0d38-504d-47a8-94bb-d5bd405977b6 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:39:37.724554 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-1e6b0d38-504d-47a8-94bb-d5bd405977b6 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:39:37.732385 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-1e6b0d38-504d-47a8-94bb-d5bd405977b6 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/210ad895-2d87-4d37-8d50-23938746c73f" status: 200 len: 1186 microversion: 2.1 time: 0.090953 Aug 10 23:39:37.732950 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2949/6104] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:39:37 2022] GET /compute/v2.1/servers/210ad895-2d87-4d37-8d50-23938746c73f => generated 1186 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:39:38.755045 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-b085410b-81c2-4749-80f1-d94f900e22a9 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:39:38.755749 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-b085410b-81c2-4749-80f1-d94f900e22a9 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 210ad895-2d87-4d37-8d50-23938746c73f] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:39:38.763134 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b085410b-81c2-4749-80f1-d94f900e22a9 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:39:38.763680 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b085410b-81c2-4749-80f1-d94f900e22a9 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:39:38.764122 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b085410b-81c2-4749-80f1-d94f900e22a9 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:39:38.764892 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b085410b-81c2-4749-80f1-d94f900e22a9 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:39:38.765392 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b085410b-81c2-4749-80f1-d94f900e22a9 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:39:38.765824 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b085410b-81c2-4749-80f1-d94f900e22a9 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:39:38.834235 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-b085410b-81c2-4749-80f1-d94f900e22a9 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:39:38.849516 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-b085410b-81c2-4749-80f1-d94f900e22a9 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/210ad895-2d87-4d37-8d50-23938746c73f" status: 200 len: 1186 microversion: 2.1 time: 0.099793 Aug 10 23:39:38.850334 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3156/6105] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:39:38 2022] GET /compute/v2.1/servers/210ad895-2d87-4d37-8d50-23938746c73f => generated 1186 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:39:39.871911 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-e9250e47-4cc9-4381-a078-2c55c8767fbe tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:39:39.873386 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-e9250e47-4cc9-4381-a078-2c55c8767fbe tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 210ad895-2d87-4d37-8d50-23938746c73f] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:39:39.879585 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e9250e47-4cc9-4381-a078-2c55c8767fbe tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:39:39.880071 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e9250e47-4cc9-4381-a078-2c55c8767fbe tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:39:39.880511 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e9250e47-4cc9-4381-a078-2c55c8767fbe tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:39:39.881278 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e9250e47-4cc9-4381-a078-2c55c8767fbe tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:39:39.881733 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e9250e47-4cc9-4381-a078-2c55c8767fbe tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:39:39.882159 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e9250e47-4cc9-4381-a078-2c55c8767fbe tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:39:39.944393 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-e9250e47-4cc9-4381-a078-2c55c8767fbe tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:39:39.952062 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-e9250e47-4cc9-4381-a078-2c55c8767fbe tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/210ad895-2d87-4d37-8d50-23938746c73f" status: 200 len: 1186 microversion: 2.1 time: 0.084810 Aug 10 23:39:39.952875 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2950/6106] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:39:39 2022] GET /compute/v2.1/servers/210ad895-2d87-4d37-8d50-23938746c73f => generated 1186 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:39:40.973035 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-8d43b64b-ce9c-4015-bf9e-c37b574bc0cf tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:39:40.973842 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-8d43b64b-ce9c-4015-bf9e-c37b574bc0cf tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 210ad895-2d87-4d37-8d50-23938746c73f] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:39:40.981325 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8d43b64b-ce9c-4015-bf9e-c37b574bc0cf tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:39:40.981959 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8d43b64b-ce9c-4015-bf9e-c37b574bc0cf tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:39:40.982511 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8d43b64b-ce9c-4015-bf9e-c37b574bc0cf tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:39:40.983645 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8d43b64b-ce9c-4015-bf9e-c37b574bc0cf tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:39:40.984229 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8d43b64b-ce9c-4015-bf9e-c37b574bc0cf tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:39:40.984760 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8d43b64b-ce9c-4015-bf9e-c37b574bc0cf tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:39:41.049901 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-8d43b64b-ce9c-4015-bf9e-c37b574bc0cf tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:39:41.059359 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-8d43b64b-ce9c-4015-bf9e-c37b574bc0cf tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/210ad895-2d87-4d37-8d50-23938746c73f" status: 200 len: 1186 microversion: 2.1 time: 0.090296 Aug 10 23:39:41.060096 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3157/6107] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:39:40 2022] GET /compute/v2.1/servers/210ad895-2d87-4d37-8d50-23938746c73f => generated 1186 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:39:42.081811 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-63102702-1fc1-4892-9aba-5054f22c4b1a tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:39:42.082665 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-63102702-1fc1-4892-9aba-5054f22c4b1a tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 210ad895-2d87-4d37-8d50-23938746c73f] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:39:42.090846 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-63102702-1fc1-4892-9aba-5054f22c4b1a tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:39:42.091341 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-63102702-1fc1-4892-9aba-5054f22c4b1a tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:39:42.091971 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-63102702-1fc1-4892-9aba-5054f22c4b1a tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:39:42.092691 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-63102702-1fc1-4892-9aba-5054f22c4b1a tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:39:42.093149 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-63102702-1fc1-4892-9aba-5054f22c4b1a tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:39:42.093577 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-63102702-1fc1-4892-9aba-5054f22c4b1a tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:39:42.127837 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-63102702-1fc1-4892-9aba-5054f22c4b1a tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:39:42.128318 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-63102702-1fc1-4892-9aba-5054f22c4b1a tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:39:42.128750 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-63102702-1fc1-4892-9aba-5054f22c4b1a tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:39:42.129192 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.objects.instance [None req-63102702-1fc1-4892-9aba-5054f22c4b1a tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lazy-loading 'fault' on Instance uuid 210ad895-2d87-4d37-8d50-23938746c73f {{(pid=122632) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:39:42.173867 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-63102702-1fc1-4892-9aba-5054f22c4b1a tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:39:42.180730 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-63102702-1fc1-4892-9aba-5054f22c4b1a tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/210ad895-2d87-4d37-8d50-23938746c73f" status: 200 len: 1145 microversion: 2.1 time: 0.103301 Aug 10 23:39:42.182127 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2951/6108] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:39:42 2022] GET /compute/v2.1/servers/210ad895-2d87-4d37-8d50-23938746c73f => generated 1145 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:39:43.202108 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-b27ac799-e8f4-4adb-a70e-1aef6bcfc8e6 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:39:43.202672 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-b27ac799-e8f4-4adb-a70e-1aef6bcfc8e6 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 210ad895-2d87-4d37-8d50-23938746c73f] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:39:43.209766 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b27ac799-e8f4-4adb-a70e-1aef6bcfc8e6 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:39:43.210256 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b27ac799-e8f4-4adb-a70e-1aef6bcfc8e6 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:39:43.210705 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b27ac799-e8f4-4adb-a70e-1aef6bcfc8e6 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:39:43.211431 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b27ac799-e8f4-4adb-a70e-1aef6bcfc8e6 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:39:43.211892 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b27ac799-e8f4-4adb-a70e-1aef6bcfc8e6 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:39:43.213147 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b27ac799-e8f4-4adb-a70e-1aef6bcfc8e6 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:39:43.226631 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-b27ac799-e8f4-4adb-a70e-1aef6bcfc8e6 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] HTTP exception thrown: Instance 210ad895-2d87-4d37-8d50-23938746c73f could not be found. Aug 10 23:39:43.229367 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-b27ac799-e8f4-4adb-a70e-1aef6bcfc8e6 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Request method failure captured: Aug 10 23:39:43.229367 n-d-850468-14 devstack@n-api.service[122633]: request: GET /compute/v2.1/servers/210ad895-2d87-4d37-8d50-23938746c73f HTTP/1.1 Aug 10 23:39:43.229367 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:39:43.229367 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:39:43.229367 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:39:43.229367 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:39:43.229367 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:39:43.229367 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:39:43.229367 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:39:43.229367 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:39:43.229367 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9EF3JcALvIu97mWIb2swBcyDTxDI5PJ3vU9Ry5AtFPunVTcpAqQQUjRv0EmIlEp13u4BOFv0aTDkpyifGo3ChPE2BfANGKPVxkJ3JhuTa-9TLVCXxNdBMfkJGfbXf6wm_Y7u9vFxLHJ5-XazgQxDfOp_ueAQ4sa5cZKpoVrdkbUR3Jc Aug 10 23:39:43.229367 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:39:43.229367 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:39:43.229367 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:39:43.229367 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:39:43.229367 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:39:43.229367 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:39:43.229367 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 0b22838d50dd4ea8811953e723d0c052 Aug 10 23:39:43.229367 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-TestVolumeBootPattern-991439424 Aug 10 23:39:43.229367 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:39:43.229367 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:39:43.229367 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0b22838d50dd4ea8811953e723d0c052"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0b22838d50dd4ea8811953e723d0c052"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/0b22838d50dd4ea8811953e723d0c052"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_0b22838d50dd4ea8811953e723d0c052", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:39:43.229367 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-TestVolumeBootPattern-991439424 Aug 10 23:39:43.229367 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 0b22838d50dd4ea8811953e723d0c052 Aug 10 23:39:43.229367 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-TestVolumeBootPattern-991439424 Aug 10 23:39:43.229367 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-TestVolumeBootPattern-991439424-project Aug 10 23:39:43.229367 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:39:43.229367 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:39:43.229367 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: e97e9cddb55649809a9cd16dbc43bb7e Aug 10 23:39:43.229367 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-TestVolumeBootPattern-991439424-project Aug 10 23:39:43.229367 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:39:43.229367 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance 210ad895-2d87-4d37-8d50-23938746c73f could not be found. Aug 10 23:39:43.229367 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': '210ad895-2d87-4d37-8d50-23938746c73f'} Aug 10 23:39:43.229367 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:39:43.229367 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:39:43.229367 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:39:43.229367 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:39:43.229367 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:39:43.229367 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:39:43.229367 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:39:43.229367 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:39:43.229367 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:39:43.229367 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:39:43.229367 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 210ad895-2d87-4d37-8d50-23938746c73f could not be found. Aug 10 23:39:43.229367 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:39:43.229367 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:39:43.229367 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:39:43.229367 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:39:43.229367 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:39:43.229367 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:39:43.229367 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:39:43.229367 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:39:43.229367 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:39:43.229367 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:39:43.229367 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:39:43.229367 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:39:43.229367 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:39:43.229367 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:39:43.229367 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:39:43.229367 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:39:43.229367 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 210ad895-2d87-4d37-8d50-23938746c73f could not be found. Aug 10 23:39:43.229367 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:39:43.229367 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:39:43.229367 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:39:43.234614 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:39:43.234614 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:39:43.234614 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:39:43.234614 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:39:43.234614 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:39:43.234614 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 210ad895-2d87-4d37-8d50-23938746c73f could not be found. Aug 10 23:39:43.234614 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:39:43.234614 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-b27ac799-e8f4-4adb-a70e-1aef6bcfc8e6 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Returning 404 to user: Instance 210ad895-2d87-4d37-8d50-23938746c73f could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:39:43.234614 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-b27ac799-e8f4-4adb-a70e-1aef6bcfc8e6 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/210ad895-2d87-4d37-8d50-23938746c73f" status: 404 len: 111 microversion: 2.1 time: 0.033312 Aug 10 23:39:43.234614 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3158/6109] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:39:43 2022] GET /compute/v2.1/servers/210ad895-2d87-4d37-8d50-23938746c73f => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:39:51.360197 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-d21d1792-e6ca-4284-a524-a53b8c826828 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:39:51.361229 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-d21d1792-e6ca-4284-a524-a53b8c826828 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] [instance: 4def0a7d-bafd-43bc-9cd5-dd8ccdd6b49d] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:39:51.368385 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d21d1792-e6ca-4284-a524-a53b8c826828 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:39:51.369562 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d21d1792-e6ca-4284-a524-a53b8c826828 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:39:51.370006 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d21d1792-e6ca-4284-a524-a53b8c826828 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:39:51.370723 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d21d1792-e6ca-4284-a524-a53b8c826828 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:39:51.371210 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d21d1792-e6ca-4284-a524-a53b8c826828 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:39:51.371635 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d21d1792-e6ca-4284-a524-a53b8c826828 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:39:51.464241 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.objects.instance [None req-d21d1792-e6ca-4284-a524-a53b8c826828 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Lazy-loading 'services' on Instance uuid 4def0a7d-bafd-43bc-9cd5-dd8ccdd6b49d {{(pid=122632) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:39:51.544617 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-d21d1792-e6ca-4284-a524-a53b8c826828 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] 10.222.0.58 "DELETE /compute/v2.1/servers/4def0a7d-bafd-43bc-9cd5-dd8ccdd6b49d/os-volume_attachments/a9e1022b-ef92-41cd-a896-17027a6baaf6" status: 202 len: 0 microversion: 2.1 time: 0.191512 Aug 10 23:39:51.545351 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2952/6110] 10.222.0.58 () {58 vars in 1416 bytes} [Wed Aug 10 23:39:51 2022] DELETE /compute/v2.1/servers/4def0a7d-bafd-43bc-9cd5-dd8ccdd6b49d/os-volume_attachments/a9e1022b-ef92-41cd-a896-17027a6baaf6 => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:39:56.958920 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-a2038b29-001a-4c2a-957a-24e13865112a tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:39:56.959528 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-a2038b29-001a-4c2a-957a-24e13865112a tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] [instance: 4def0a7d-bafd-43bc-9cd5-dd8ccdd6b49d] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:39:56.963112 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_api:SELECT=51 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:39:56.963905 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=34 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:39:56.970372 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a2038b29-001a-4c2a-957a-24e13865112a tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:39:56.970891 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a2038b29-001a-4c2a-957a-24e13865112a tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:39:56.971340 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a2038b29-001a-4c2a-957a-24e13865112a tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:39:56.972143 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a2038b29-001a-4c2a-957a-24e13865112a tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:39:56.972612 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a2038b29-001a-4c2a-957a-24e13865112a tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:39:56.973043 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a2038b29-001a-4c2a-957a-24e13865112a tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:39:56.999102 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-a2038b29-001a-4c2a-957a-24e13865112a tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] [instance: 4def0a7d-bafd-43bc-9cd5-dd8ccdd6b49d] Going to try to terminate instance {{(pid=122633) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:39:57.081015 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-a2038b29-001a-4c2a-957a-24e13865112a tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] 10.222.0.58 "DELETE /compute/v2.1/servers/4def0a7d-bafd-43bc-9cd5-dd8ccdd6b49d" status: 204 len: 0 microversion: 2.1 time: 0.125386 Aug 10 23:39:57.082121 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3159/6111] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:39:56 2022] DELETE /compute/v2.1/servers/4def0a7d-bafd-43bc-9cd5-dd8ccdd6b49d => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:39:57.092377 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-44416115-dcc4-48a3-9bbe-cdb4d7d4f051 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:39:57.093034 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-44416115-dcc4-48a3-9bbe-cdb4d7d4f051 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] [instance: 4def0a7d-bafd-43bc-9cd5-dd8ccdd6b49d] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:39:57.099621 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-44416115-dcc4-48a3-9bbe-cdb4d7d4f051 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:39:57.100111 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-44416115-dcc4-48a3-9bbe-cdb4d7d4f051 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:39:57.100551 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-44416115-dcc4-48a3-9bbe-cdb4d7d4f051 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:39:57.101249 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-44416115-dcc4-48a3-9bbe-cdb4d7d4f051 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:39:57.101707 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-44416115-dcc4-48a3-9bbe-cdb4d7d4f051 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:39:57.102136 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-44416115-dcc4-48a3-9bbe-cdb4d7d4f051 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:39:57.303580 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-44416115-dcc4-48a3-9bbe-cdb4d7d4f051 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd602346dc4054913b803780eb18b6cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b3c43fe735f488c9e1ccaf93a926960', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:39:57.312376 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-44416115-dcc4-48a3-9bbe-cdb4d7d4f051 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] 10.222.0.58 "GET /compute/v2.1/servers/4def0a7d-bafd-43bc-9cd5-dd8ccdd6b49d" status: 200 len: 1512 microversion: 2.1 time: 0.225974 Aug 10 23:39:57.313059 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2953/6112] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:39:57 2022] GET /compute/v2.1/servers/4def0a7d-bafd-43bc-9cd5-dd8ccdd6b49d => generated 1512 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:39:58.334854 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-0fd29021-3265-4aef-9861-92067461ab27 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:39:58.335569 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-0fd29021-3265-4aef-9861-92067461ab27 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] [instance: 4def0a7d-bafd-43bc-9cd5-dd8ccdd6b49d] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:39:58.343094 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0fd29021-3265-4aef-9861-92067461ab27 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:39:58.343586 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0fd29021-3265-4aef-9861-92067461ab27 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:39:58.344031 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0fd29021-3265-4aef-9861-92067461ab27 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:39:58.344734 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0fd29021-3265-4aef-9861-92067461ab27 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:39:58.345197 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0fd29021-3265-4aef-9861-92067461ab27 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:39:58.345625 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0fd29021-3265-4aef-9861-92067461ab27 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:39:58.501677 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-0fd29021-3265-4aef-9861-92067461ab27 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd602346dc4054913b803780eb18b6cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b3c43fe735f488c9e1ccaf93a926960', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:39:58.510616 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-0fd29021-3265-4aef-9861-92067461ab27 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] 10.222.0.58 "GET /compute/v2.1/servers/4def0a7d-bafd-43bc-9cd5-dd8ccdd6b49d" status: 200 len: 1512 microversion: 2.1 time: 0.180017 Aug 10 23:39:58.511800 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3160/6113] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:39:58 2022] GET /compute/v2.1/servers/4def0a7d-bafd-43bc-9cd5-dd8ccdd6b49d => generated 1512 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:39:59.383509 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-106bffaf-4e02-4ac7-9365-0bfec8a38d01 req-5ca4d11e-61c9-47f5-a307-bf912df7fee1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4def0a7d-bafd-43bc-9cd5-dd8ccdd6b49d", "name": "network-vif-deleted", "tag": "7facbff6-b988-4a9d-bd60-b4be72e8f09c"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:39:59.394897 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-106bffaf-4e02-4ac7-9365-0bfec8a38d01 req-5ca4d11e-61c9-47f5-a307-bf912df7fee1 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:39:59.395405 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-106bffaf-4e02-4ac7-9365-0bfec8a38d01 req-5ca4d11e-61c9-47f5-a307-bf912df7fee1 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:39:59.395894 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-106bffaf-4e02-4ac7-9365-0bfec8a38d01 req-5ca4d11e-61c9-47f5-a307-bf912df7fee1 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:39:59.407334 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:39:59.409612 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-106bffaf-4e02-4ac7-9365-0bfec8a38d01 req-5ca4d11e-61c9-47f5-a307-bf912df7fee1 service nova] Creating event network-vif-deleted:7facbff6-b988-4a9d-bd60-b4be72e8f09c for instance 4def0a7d-bafd-43bc-9cd5-dd8ccdd6b49d on n-h1-850468-14 Aug 10 23:39:59.414528 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-106bffaf-4e02-4ac7-9365-0bfec8a38d01 req-5ca4d11e-61c9-47f5-a307-bf912df7fee1 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034882 Aug 10 23:39:59.418671 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2954/6114] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:39:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:39:59.533175 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-0a12ab7c-f857-4135-84a8-8bfece2b46b9 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:39:59.533950 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-0a12ab7c-f857-4135-84a8-8bfece2b46b9 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] [instance: 4def0a7d-bafd-43bc-9cd5-dd8ccdd6b49d] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:39:59.543519 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0a12ab7c-f857-4135-84a8-8bfece2b46b9 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:39:59.544107 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0a12ab7c-f857-4135-84a8-8bfece2b46b9 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:39:59.544623 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0a12ab7c-f857-4135-84a8-8bfece2b46b9 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:39:59.545465 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0a12ab7c-f857-4135-84a8-8bfece2b46b9 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:39:59.545997 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0a12ab7c-f857-4135-84a8-8bfece2b46b9 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:39:59.546500 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0a12ab7c-f857-4135-84a8-8bfece2b46b9 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:39:59.583430 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0a12ab7c-f857-4135-84a8-8bfece2b46b9 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:39:59.584231 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0a12ab7c-f857-4135-84a8-8bfece2b46b9 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:39:59.584665 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0a12ab7c-f857-4135-84a8-8bfece2b46b9 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:39:59.585114 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.objects.instance [None req-0a12ab7c-f857-4135-84a8-8bfece2b46b9 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Lazy-loading 'fault' on Instance uuid 4def0a7d-bafd-43bc-9cd5-dd8ccdd6b49d {{(pid=122633) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:39:59.630208 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-0a12ab7c-f857-4135-84a8-8bfece2b46b9 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd602346dc4054913b803780eb18b6cd8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b3c43fe735f488c9e1ccaf93a926960', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:39:59.638937 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-0a12ab7c-f857-4135-84a8-8bfece2b46b9 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] 10.222.0.58 "GET /compute/v2.1/servers/4def0a7d-bafd-43bc-9cd5-dd8ccdd6b49d" status: 200 len: 1309 microversion: 2.1 time: 0.110040 Aug 10 23:39:59.639586 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3161/6115] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:39:59 2022] GET /compute/v2.1/servers/4def0a7d-bafd-43bc-9cd5-dd8ccdd6b49d => generated 1309 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:40:00.662161 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-854b612d-20d9-42cf-aa13-e04fecbab3e0 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:40:00.662893 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-854b612d-20d9-42cf-aa13-e04fecbab3e0 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] [instance: 4def0a7d-bafd-43bc-9cd5-dd8ccdd6b49d] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:40:00.671322 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-854b612d-20d9-42cf-aa13-e04fecbab3e0 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:40:00.671810 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-854b612d-20d9-42cf-aa13-e04fecbab3e0 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:40:00.672247 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-854b612d-20d9-42cf-aa13-e04fecbab3e0 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:40:00.672948 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-854b612d-20d9-42cf-aa13-e04fecbab3e0 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:40:00.673402 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-854b612d-20d9-42cf-aa13-e04fecbab3e0 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:40:00.673828 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-854b612d-20d9-42cf-aa13-e04fecbab3e0 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:40:00.691099 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-854b612d-20d9-42cf-aa13-e04fecbab3e0 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] HTTP exception thrown: Instance 4def0a7d-bafd-43bc-9cd5-dd8ccdd6b49d could not be found. Aug 10 23:40:00.692623 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-854b612d-20d9-42cf-aa13-e04fecbab3e0 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Request method failure captured: Aug 10 23:40:00.692623 n-d-850468-14 devstack@n-api.service[122632]: request: GET /compute/v2.1/servers/4def0a7d-bafd-43bc-9cd5-dd8ccdd6b49d HTTP/1.1 Aug 10 23:40:00.692623 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:40:00.692623 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:40:00.692623 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:40:00.692623 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 23:40:00.692623 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:40:00.692623 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:40:00.692623 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:40:00.692623 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:40:00.692623 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9EEb8QyHd3dMvChYQlm7NZUijwHZ5eMKSScLZKP3sPIpVhJ6A8NOPWJ4c9qaGqipegH2di7hTN0GFms7TiyBndv5s5QzctCZ0_LPjyK5Eijx5VjksKusb5tCLMcTkhdmz0lKuMEPZBHrFvX3dZeoP19mORQXEZHM9cMzVhIdEFZymEM Aug 10 23:40:00.692623 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:40:00.692623 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:40:00.692623 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:40:00.692623 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:40:00.692623 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:40:00.692623 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:40:00.692623 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 5b3c43fe735f488c9e1ccaf93a926960 Aug 10 23:40:00.692623 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-VolumesSnapshotTestJSON-696611637 Aug 10 23:40:00.692623 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:40:00.692623 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:40:00.692623 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5b3c43fe735f488c9e1ccaf93a926960"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/5b3c43fe735f488c9e1ccaf93a926960"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/5b3c43fe735f488c9e1ccaf93a926960"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_5b3c43fe735f488c9e1ccaf93a926960", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:40:00.692623 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-VolumesSnapshotTestJSON-696611637 Aug 10 23:40:00.692623 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 5b3c43fe735f488c9e1ccaf93a926960 Aug 10 23:40:00.692623 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-696611637 Aug 10 23:40:00.692623 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-VolumesSnapshotTestJSON-696611637-project Aug 10 23:40:00.692623 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:40:00.692623 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:40:00.692623 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: d602346dc4054913b803780eb18b6cd8 Aug 10 23:40:00.692623 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-VolumesSnapshotTestJSON-696611637-project Aug 10 23:40:00.692623 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:40:00.692623 n-d-850468-14 devstack@n-api.service[122632]: exception: Instance 4def0a7d-bafd-43bc-9cd5-dd8ccdd6b49d could not be found. Aug 10 23:40:00.692623 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': '4def0a7d-bafd-43bc-9cd5-dd8ccdd6b49d'} Aug 10 23:40:00.692623 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:40:00.692623 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:40:00.692623 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:40:00.692623 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:40:00.692623 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:40:00.692623 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:40:00.692623 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:40:00.692623 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:40:00.692623 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:40:00.692623 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:40:00.692623 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4def0a7d-bafd-43bc-9cd5-dd8ccdd6b49d could not be found. Aug 10 23:40:00.692623 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:40:00.692623 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:40:00.692623 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:40:00.692623 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:40:00.692623 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:40:00.692623 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:40:00.692623 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:40:00.692623 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:40:00.692623 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:40:00.692623 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:40:00.692623 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:40:00.692623 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:40:00.692623 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:40:00.692623 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:40:00.692623 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:40:00.692623 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:40:00.692623 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4def0a7d-bafd-43bc-9cd5-dd8ccdd6b49d could not be found. Aug 10 23:40:00.692623 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:40:00.692623 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:40:00.692623 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:40:00.702445 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:40:00.702445 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:40:00.702445 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:40:00.702445 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:40:00.702445 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:40:00.702445 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4def0a7d-bafd-43bc-9cd5-dd8ccdd6b49d could not be found. Aug 10 23:40:00.702445 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:40:00.702445 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-854b612d-20d9-42cf-aa13-e04fecbab3e0 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] Returning 404 to user: Instance 4def0a7d-bafd-43bc-9cd5-dd8ccdd6b49d could not be found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:40:00.702445 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-854b612d-20d9-42cf-aa13-e04fecbab3e0 tempest-VolumesSnapshotTestJSON-696611637 tempest-VolumesSnapshotTestJSON-696611637-project] 10.222.0.58 "GET /compute/v2.1/servers/4def0a7d-bafd-43bc-9cd5-dd8ccdd6b49d" status: 404 len: 111 microversion: 2.1 time: 0.037062 Aug 10 23:40:00.702445 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2955/6116] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:40:00 2022] GET /compute/v2.1/servers/4def0a7d-bafd-43bc-9cd5-dd8ccdd6b49d => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:40:05.556088 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-65ea00d0-b638-43c9-a5e8-e3ee52e6cd6b tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-120530168", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "2ed02fc1-ea9d-449a-a85d-bafcf8a6a696", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "5ed0a190-471f-4749-aff5-4f68f1343451"}]}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:40:05.656494 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.network.neutron [None req-65ea00d0-b638-43c9-a5e8-e3ee52e6cd6b tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] validate_networks() for [('5ed0a190-471f-4749-aff5-4f68f1343451', None, None, None, None, None)] {{(pid=122633) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 23:40:06.039650 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-65ea00d0-b638-43c9-a5e8-e3ee52e6cd6b tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Flavor limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:40:06.040142 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-65ea00d0-b638-43c9-a5e8-e3ee52e6cd6b tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Image limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:40:06.040623 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-65ea00d0-b638-43c9-a5e8-e3ee52e6cd6b tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Flavor pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:40:06.041483 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-65ea00d0-b638-43c9-a5e8-e3ee52e6cd6b tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Image pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:40:06.042005 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-65ea00d0-b638-43c9-a5e8-e3ee52e6cd6b tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:40:06.051977 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-65ea00d0-b638-43c9-a5e8-e3ee52e6cd6b tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:40:06.052460 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-65ea00d0-b638-43c9-a5e8-e3ee52e6cd6b tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:40:06.053076 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-65ea00d0-b638-43c9-a5e8-e3ee52e6cd6b tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:40:06.053802 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-65ea00d0-b638-43c9-a5e8-e3ee52e6cd6b tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:40:06.054256 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-65ea00d0-b638-43c9-a5e8-e3ee52e6cd6b tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:40:06.054681 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-65ea00d0-b638-43c9-a5e8-e3ee52e6cd6b tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:40:06.072477 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-65ea00d0-b638-43c9-a5e8-e3ee52e6cd6b tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Getting quotas for project 0b22838d50dd4ea8811953e723d0c052. Resources: {'instances', 'cores', 'ram'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:40:06.077909 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-65ea00d0-b638-43c9-a5e8-e3ee52e6cd6b tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Getting quotas for user e97e9cddb55649809a9cd16dbc43bb7e and project 0b22838d50dd4ea8811953e723d0c052. Resources: {'instances', 'cores', 'ram'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:40:06.091373 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-65ea00d0-b638-43c9-a5e8-e3ee52e6cd6b tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Going to run 1 instances... {{(pid=122633) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 23:40:06.093430 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-65ea00d0-b638-43c9-a5e8-e3ee52e6cd6b tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 0d1c24fa-d284-4c63-8d44-4551a001be39] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='2ed02fc1-ea9d-449a-a85d-bafcf8a6a696',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122633) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 23:40:06.169360 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-65ea00d0-b638-43c9-a5e8-e3ee52e6cd6b tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.617594 Aug 10 23:40:06.170029 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3162/6117] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 23:40:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 619 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 23:40:06.182411 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-976fe88f-e675-463f-997d-268791add7eb tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:40:06.183087 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-976fe88f-e675-463f-997d-268791add7eb tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 0d1c24fa-d284-4c63-8d44-4551a001be39] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:40:06.247512 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-976fe88f-e675-463f-997d-268791add7eb tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:40:06.258147 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-976fe88f-e675-463f-997d-268791add7eb tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/0d1c24fa-d284-4c63-8d44-4551a001be39" status: 200 len: 1056 microversion: 2.1 time: 0.080469 Aug 10 23:40:06.259685 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2956/6118] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:40:06 2022] GET /compute/v2.1/servers/0d1c24fa-d284-4c63-8d44-4551a001be39 => generated 1056 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:40:07.281060 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-d2e2a664-4c15-43e8-99ff-f411aed072e9 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:40:07.281775 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-d2e2a664-4c15-43e8-99ff-f411aed072e9 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 0d1c24fa-d284-4c63-8d44-4551a001be39] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:40:07.288884 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d2e2a664-4c15-43e8-99ff-f411aed072e9 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:40:07.289455 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d2e2a664-4c15-43e8-99ff-f411aed072e9 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:40:07.290625 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d2e2a664-4c15-43e8-99ff-f411aed072e9 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:40:07.291787 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d2e2a664-4c15-43e8-99ff-f411aed072e9 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:40:07.292318 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d2e2a664-4c15-43e8-99ff-f411aed072e9 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:40:07.292817 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d2e2a664-4c15-43e8-99ff-f411aed072e9 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:40:07.358809 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-d2e2a664-4c15-43e8-99ff-f411aed072e9 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:40:07.366597 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-d2e2a664-4c15-43e8-99ff-f411aed072e9 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/0d1c24fa-d284-4c63-8d44-4551a001be39" status: 200 len: 1108 microversion: 2.1 time: 0.090494 Aug 10 23:40:07.367216 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3163/6119] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:40:07 2022] GET /compute/v2.1/servers/0d1c24fa-d284-4c63-8d44-4551a001be39 => generated 1108 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:40:08.389798 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-01658a40-6ea2-41a7-abef-6887e989c448 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:40:08.390874 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-01658a40-6ea2-41a7-abef-6887e989c448 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 0d1c24fa-d284-4c63-8d44-4551a001be39] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:40:08.397666 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_api:SELECT=22 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:40:08.399686 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-01658a40-6ea2-41a7-abef-6887e989c448 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:40:08.400472 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-01658a40-6ea2-41a7-abef-6887e989c448 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:40:08.401166 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-01658a40-6ea2-41a7-abef-6887e989c448 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:40:08.401988 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-01658a40-6ea2-41a7-abef-6887e989c448 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:40:08.402675 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-01658a40-6ea2-41a7-abef-6887e989c448 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:40:08.403355 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-01658a40-6ea2-41a7-abef-6887e989c448 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:40:08.472704 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-01658a40-6ea2-41a7-abef-6887e989c448 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:40:08.503728 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-01658a40-6ea2-41a7-abef-6887e989c448 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/0d1c24fa-d284-4c63-8d44-4551a001be39" status: 200 len: 1126 microversion: 2.1 time: 0.114419 Aug 10 23:40:08.523415 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2957/6120] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:40:08 2022] GET /compute/v2.1/servers/0d1c24fa-d284-4c63-8d44-4551a001be39 => generated 1126 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:40:09.535436 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-6b439033-d3ca-43ee-850d-7d490ffa7972 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:40:09.536968 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-6b439033-d3ca-43ee-850d-7d490ffa7972 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 0d1c24fa-d284-4c63-8d44-4551a001be39] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:40:09.547178 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6b439033-d3ca-43ee-850d-7d490ffa7972 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:40:09.547676 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6b439033-d3ca-43ee-850d-7d490ffa7972 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:40:09.548124 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6b439033-d3ca-43ee-850d-7d490ffa7972 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:40:09.553131 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6b439033-d3ca-43ee-850d-7d490ffa7972 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:40:09.558110 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6b439033-d3ca-43ee-850d-7d490ffa7972 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:40:09.558683 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6b439033-d3ca-43ee-850d-7d490ffa7972 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:40:09.765086 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-6b439033-d3ca-43ee-850d-7d490ffa7972 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:40:09.766354 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-dc8b90fb-bacc-44db-9d06-852354b7131c req-cfbe0df8-91f0-4745-b590-92ca9d23609e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d1c24fa-d284-4c63-8d44-4551a001be39", "tag": "2fece870-33ad-4226-a7b8-dc1ba4bf9828"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:40:09.781138 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-6b439033-d3ca-43ee-850d-7d490ffa7972 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/0d1c24fa-d284-4c63-8d44-4551a001be39" status: 200 len: 1168 microversion: 2.1 time: 0.254594 Aug 10 23:40:09.782420 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2958/6121] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:40:09 2022] GET /compute/v2.1/servers/0d1c24fa-d284-4c63-8d44-4551a001be39 => generated 1168 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:40:09.787250 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-dc8b90fb-bacc-44db-9d06-852354b7131c req-cfbe0df8-91f0-4745-b590-92ca9d23609e service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:40:09.787929 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-dc8b90fb-bacc-44db-9d06-852354b7131c req-cfbe0df8-91f0-4745-b590-92ca9d23609e service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:40:09.788750 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-dc8b90fb-bacc-44db-9d06-852354b7131c req-cfbe0df8-91f0-4745-b590-92ca9d23609e service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:40:09.803612 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-dc8b90fb-bacc-44db-9d06-852354b7131c req-cfbe0df8-91f0-4745-b590-92ca9d23609e service nova] Creating event network-changed:2fece870-33ad-4226-a7b8-dc1ba4bf9828 for instance 0d1c24fa-d284-4c63-8d44-4551a001be39 on n-h2-850468-14 Aug 10 23:40:09.809681 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-dc8b90fb-bacc-44db-9d06-852354b7131c req-cfbe0df8-91f0-4745-b590-92ca9d23609e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.341878 Aug 10 23:40:09.813878 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3164/6122] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:40:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:40:10.804760 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-13f55c4c-f1fa-414e-bcdb-f46525dc82fe tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:40:10.806320 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-13f55c4c-f1fa-414e-bcdb-f46525dc82fe tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 0d1c24fa-d284-4c63-8d44-4551a001be39] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:40:10.814062 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-13f55c4c-f1fa-414e-bcdb-f46525dc82fe tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:40:10.814984 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-13f55c4c-f1fa-414e-bcdb-f46525dc82fe tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:40:10.815684 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-13f55c4c-f1fa-414e-bcdb-f46525dc82fe tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:40:10.816618 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-13f55c4c-f1fa-414e-bcdb-f46525dc82fe tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:40:10.817295 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-13f55c4c-f1fa-414e-bcdb-f46525dc82fe tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:40:10.818074 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-13f55c4c-f1fa-414e-bcdb-f46525dc82fe tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:40:11.016094 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-13f55c4c-f1fa-414e-bcdb-f46525dc82fe tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:40:11.032445 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-13f55c4c-f1fa-414e-bcdb-f46525dc82fe tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/0d1c24fa-d284-4c63-8d44-4551a001be39" status: 200 len: 1168 microversion: 2.1 time: 0.230898 Aug 10 23:40:11.045632 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2959/6123] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:40:10 2022] GET /compute/v2.1/servers/0d1c24fa-d284-4c63-8d44-4551a001be39 => generated 1168 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:40:12.054485 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-f763a52a-3824-42b2-a91e-a7d10fb5fa7f tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:40:12.056163 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-f763a52a-3824-42b2-a91e-a7d10fb5fa7f tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 0d1c24fa-d284-4c63-8d44-4551a001be39] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:40:12.062975 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f763a52a-3824-42b2-a91e-a7d10fb5fa7f tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:40:12.063477 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f763a52a-3824-42b2-a91e-a7d10fb5fa7f tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:40:12.063918 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f763a52a-3824-42b2-a91e-a7d10fb5fa7f tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:40:12.064650 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f763a52a-3824-42b2-a91e-a7d10fb5fa7f tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:40:12.065369 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f763a52a-3824-42b2-a91e-a7d10fb5fa7f tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:40:12.065807 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f763a52a-3824-42b2-a91e-a7d10fb5fa7f tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:40:12.259379 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-f763a52a-3824-42b2-a91e-a7d10fb5fa7f tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:40:12.271450 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-f763a52a-3824-42b2-a91e-a7d10fb5fa7f tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/0d1c24fa-d284-4c63-8d44-4551a001be39" status: 200 len: 1168 microversion: 2.1 time: 0.222596 Aug 10 23:40:12.272591 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3165/6124] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:40:12 2022] GET /compute/v2.1/servers/0d1c24fa-d284-4c63-8d44-4551a001be39 => generated 1168 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:40:13.301046 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-1fafb2aa-97c8-49b8-a884-c405658fc313 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:40:13.303132 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-1fafb2aa-97c8-49b8-a884-c405658fc313 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 0d1c24fa-d284-4c63-8d44-4551a001be39] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:40:13.312187 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1fafb2aa-97c8-49b8-a884-c405658fc313 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:40:13.312688 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1fafb2aa-97c8-49b8-a884-c405658fc313 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:40:13.313120 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1fafb2aa-97c8-49b8-a884-c405658fc313 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:40:13.314274 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1fafb2aa-97c8-49b8-a884-c405658fc313 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:40:13.315153 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1fafb2aa-97c8-49b8-a884-c405658fc313 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:40:13.315804 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1fafb2aa-97c8-49b8-a884-c405658fc313 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:40:13.482294 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-1fafb2aa-97c8-49b8-a884-c405658fc313 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:40:13.492009 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-1fafb2aa-97c8-49b8-a884-c405658fc313 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/0d1c24fa-d284-4c63-8d44-4551a001be39" status: 200 len: 1168 microversion: 2.1 time: 0.196759 Aug 10 23:40:13.493629 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2960/6125] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:40:13 2022] GET /compute/v2.1/servers/0d1c24fa-d284-4c63-8d44-4551a001be39 => generated 1168 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:40:14.525232 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-319083d1-d7c3-4127-9d71-fc08921edfdd tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:40:14.526488 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-319083d1-d7c3-4127-9d71-fc08921edfdd tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 0d1c24fa-d284-4c63-8d44-4551a001be39] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:40:14.541227 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-319083d1-d7c3-4127-9d71-fc08921edfdd tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:40:14.541522 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-319083d1-d7c3-4127-9d71-fc08921edfdd tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:40:14.543409 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-319083d1-d7c3-4127-9d71-fc08921edfdd tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:40:14.544047 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-319083d1-d7c3-4127-9d71-fc08921edfdd tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:40:14.544503 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-319083d1-d7c3-4127-9d71-fc08921edfdd tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:40:14.545103 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-319083d1-d7c3-4127-9d71-fc08921edfdd tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:40:14.701520 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-319083d1-d7c3-4127-9d71-fc08921edfdd tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:40:14.712282 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-319083d1-d7c3-4127-9d71-fc08921edfdd tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/0d1c24fa-d284-4c63-8d44-4551a001be39" status: 200 len: 1168 microversion: 2.1 time: 0.191470 Aug 10 23:40:14.712920 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3166/6126] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:40:14 2022] GET /compute/v2.1/servers/0d1c24fa-d284-4c63-8d44-4551a001be39 => generated 1168 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:40:15.739866 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-4a8e29b7-0540-474b-be52-b982e974f56c tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:40:15.740526 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-4a8e29b7-0540-474b-be52-b982e974f56c tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 0d1c24fa-d284-4c63-8d44-4551a001be39] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:40:15.749151 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4a8e29b7-0540-474b-be52-b982e974f56c tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:40:15.749770 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4a8e29b7-0540-474b-be52-b982e974f56c tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:40:15.750239 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4a8e29b7-0540-474b-be52-b982e974f56c tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:40:15.751196 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4a8e29b7-0540-474b-be52-b982e974f56c tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:40:15.752047 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4a8e29b7-0540-474b-be52-b982e974f56c tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:40:15.752439 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4a8e29b7-0540-474b-be52-b982e974f56c tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:40:15.930332 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-4a8e29b7-0540-474b-be52-b982e974f56c tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:40:15.939377 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-4a8e29b7-0540-474b-be52-b982e974f56c tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/0d1c24fa-d284-4c63-8d44-4551a001be39" status: 200 len: 1168 microversion: 2.1 time: 0.203279 Aug 10 23:40:15.940291 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2961/6127] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:40:15 2022] GET /compute/v2.1/servers/0d1c24fa-d284-4c63-8d44-4551a001be39 => generated 1168 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:40:16.971929 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-cc88cd90-c4c8-4f9c-898f-ac61ec8ac7fc tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:40:16.974975 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-cc88cd90-c4c8-4f9c-898f-ac61ec8ac7fc tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 0d1c24fa-d284-4c63-8d44-4551a001be39] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:40:16.986497 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=2 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:40:16.987848 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=6 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:40:16.989689 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cc88cd90-c4c8-4f9c-898f-ac61ec8ac7fc tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:40:16.990525 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cc88cd90-c4c8-4f9c-898f-ac61ec8ac7fc tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:40:16.991248 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cc88cd90-c4c8-4f9c-898f-ac61ec8ac7fc tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:40:16.992300 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cc88cd90-c4c8-4f9c-898f-ac61ec8ac7fc tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:40:16.994918 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cc88cd90-c4c8-4f9c-898f-ac61ec8ac7fc tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:40:16.995692 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cc88cd90-c4c8-4f9c-898f-ac61ec8ac7fc tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:40:17.217653 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-cc88cd90-c4c8-4f9c-898f-ac61ec8ac7fc tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:40:17.232396 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-cc88cd90-c4c8-4f9c-898f-ac61ec8ac7fc tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/0d1c24fa-d284-4c63-8d44-4551a001be39" status: 200 len: 1168 microversion: 2.1 time: 0.272013 Aug 10 23:40:17.233347 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3167/6128] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:40:16 2022] GET /compute/v2.1/servers/0d1c24fa-d284-4c63-8d44-4551a001be39 => generated 1168 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:40:18.257304 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-9073e7b3-a4c7-4fb5-903f-40e7a51cc0d9 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:40:18.257926 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-9073e7b3-a4c7-4fb5-903f-40e7a51cc0d9 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 0d1c24fa-d284-4c63-8d44-4551a001be39] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:40:18.261109 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=2 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:40:18.268601 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9073e7b3-a4c7-4fb5-903f-40e7a51cc0d9 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:40:18.269092 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9073e7b3-a4c7-4fb5-903f-40e7a51cc0d9 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:40:18.269524 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9073e7b3-a4c7-4fb5-903f-40e7a51cc0d9 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:40:18.270222 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9073e7b3-a4c7-4fb5-903f-40e7a51cc0d9 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:40:18.270668 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9073e7b3-a4c7-4fb5-903f-40e7a51cc0d9 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:40:18.273249 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9073e7b3-a4c7-4fb5-903f-40e7a51cc0d9 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:40:18.447835 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-9073e7b3-a4c7-4fb5-903f-40e7a51cc0d9 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:40:18.458489 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-9073e7b3-a4c7-4fb5-903f-40e7a51cc0d9 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/0d1c24fa-d284-4c63-8d44-4551a001be39" status: 200 len: 1168 microversion: 2.1 time: 0.205816 Aug 10 23:40:18.459112 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2962/6129] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:40:18 2022] GET /compute/v2.1/servers/0d1c24fa-d284-4c63-8d44-4551a001be39 => generated 1168 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:40:19.480473 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c18dd001-5dcd-45d9-b06d-3631f50472cf tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:40:19.481017 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-c18dd001-5dcd-45d9-b06d-3631f50472cf tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 0d1c24fa-d284-4c63-8d44-4551a001be39] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:40:19.488751 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c18dd001-5dcd-45d9-b06d-3631f50472cf tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:40:19.489242 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c18dd001-5dcd-45d9-b06d-3631f50472cf tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:40:19.489690 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c18dd001-5dcd-45d9-b06d-3631f50472cf tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:40:19.490403 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c18dd001-5dcd-45d9-b06d-3631f50472cf tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:40:19.490892 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c18dd001-5dcd-45d9-b06d-3631f50472cf tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:40:19.491325 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c18dd001-5dcd-45d9-b06d-3631f50472cf tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:40:19.647125 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-c18dd001-5dcd-45d9-b06d-3631f50472cf tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:40:19.656061 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-c18dd001-5dcd-45d9-b06d-3631f50472cf tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/0d1c24fa-d284-4c63-8d44-4551a001be39" status: 200 len: 1168 microversion: 2.1 time: 0.180284 Aug 10 23:40:19.656686 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3168/6130] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:40:19 2022] GET /compute/v2.1/servers/0d1c24fa-d284-4c63-8d44-4551a001be39 => generated 1168 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:40:20.677799 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-feeb8d9b-9c7d-4c36-8146-210bd5caa736 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:40:20.678508 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-feeb8d9b-9c7d-4c36-8146-210bd5caa736 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 0d1c24fa-d284-4c63-8d44-4551a001be39] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:40:20.692491 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-feeb8d9b-9c7d-4c36-8146-210bd5caa736 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:40:20.692978 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-feeb8d9b-9c7d-4c36-8146-210bd5caa736 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:40:20.693608 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-feeb8d9b-9c7d-4c36-8146-210bd5caa736 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:40:20.694312 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-feeb8d9b-9c7d-4c36-8146-210bd5caa736 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:40:20.694761 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-feeb8d9b-9c7d-4c36-8146-210bd5caa736 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:40:20.695219 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-feeb8d9b-9c7d-4c36-8146-210bd5caa736 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:40:20.839218 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-feeb8d9b-9c7d-4c36-8146-210bd5caa736 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:40:20.846983 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-feeb8d9b-9c7d-4c36-8146-210bd5caa736 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/0d1c24fa-d284-4c63-8d44-4551a001be39" status: 200 len: 1168 microversion: 2.1 time: 0.173192 Aug 10 23:40:20.847656 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2963/6131] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:40:20 2022] GET /compute/v2.1/servers/0d1c24fa-d284-4c63-8d44-4551a001be39 => generated 1168 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:40:21.868148 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-3511a079-ee9a-4f50-be51-f28b8a5a6476 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:40:21.869093 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-3511a079-ee9a-4f50-be51-f28b8a5a6476 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 0d1c24fa-d284-4c63-8d44-4551a001be39] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:40:21.876482 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3511a079-ee9a-4f50-be51-f28b8a5a6476 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:40:21.877082 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3511a079-ee9a-4f50-be51-f28b8a5a6476 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:40:21.877662 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3511a079-ee9a-4f50-be51-f28b8a5a6476 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:40:21.878630 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3511a079-ee9a-4f50-be51-f28b8a5a6476 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:40:21.879246 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3511a079-ee9a-4f50-be51-f28b8a5a6476 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:40:21.879781 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3511a079-ee9a-4f50-be51-f28b8a5a6476 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:40:22.022811 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-3511a079-ee9a-4f50-be51-f28b8a5a6476 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:40:22.032094 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-3511a079-ee9a-4f50-be51-f28b8a5a6476 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/0d1c24fa-d284-4c63-8d44-4551a001be39" status: 200 len: 1168 microversion: 2.1 time: 0.167873 Aug 10 23:40:22.032955 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3169/6132] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:40:21 2022] GET /compute/v2.1/servers/0d1c24fa-d284-4c63-8d44-4551a001be39 => generated 1168 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:40:23.053581 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-6f18058d-789f-4a79-a984-8588da259276 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:40:23.054189 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-6f18058d-789f-4a79-a984-8588da259276 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 0d1c24fa-d284-4c63-8d44-4551a001be39] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:40:23.061767 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6f18058d-789f-4a79-a984-8588da259276 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:40:23.062460 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6f18058d-789f-4a79-a984-8588da259276 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:40:23.063357 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6f18058d-789f-4a79-a984-8588da259276 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:40:23.064021 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6f18058d-789f-4a79-a984-8588da259276 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:40:23.064708 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6f18058d-789f-4a79-a984-8588da259276 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:40:23.065211 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6f18058d-789f-4a79-a984-8588da259276 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:40:23.209011 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-6f18058d-789f-4a79-a984-8588da259276 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:40:23.217528 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-6f18058d-789f-4a79-a984-8588da259276 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/0d1c24fa-d284-4c63-8d44-4551a001be39" status: 200 len: 1214 microversion: 2.1 time: 0.167702 Aug 10 23:40:23.218468 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2964/6133] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:40:23 2022] GET /compute/v2.1/servers/0d1c24fa-d284-4c63-8d44-4551a001be39 => generated 1214 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:40:24.240299 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-e63798c9-958f-426a-ab75-c2cb9301f449 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:40:24.240864 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-e63798c9-958f-426a-ab75-c2cb9301f449 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 0d1c24fa-d284-4c63-8d44-4551a001be39] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:40:24.248688 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e63798c9-958f-426a-ab75-c2cb9301f449 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:40:24.249182 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e63798c9-958f-426a-ab75-c2cb9301f449 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:40:24.249630 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e63798c9-958f-426a-ab75-c2cb9301f449 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:40:24.250341 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e63798c9-958f-426a-ab75-c2cb9301f449 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:40:24.250826 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e63798c9-958f-426a-ab75-c2cb9301f449 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:40:24.251260 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e63798c9-958f-426a-ab75-c2cb9301f449 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:40:24.394965 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-e63798c9-958f-426a-ab75-c2cb9301f449 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:40:24.403324 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-e63798c9-958f-426a-ab75-c2cb9301f449 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/0d1c24fa-d284-4c63-8d44-4551a001be39" status: 200 len: 1202 microversion: 2.1 time: 0.167029 Aug 10 23:40:24.403932 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3170/6134] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:40:24 2022] GET /compute/v2.1/servers/0d1c24fa-d284-4c63-8d44-4551a001be39 => generated 1202 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:40:25.425311 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-b4ecc406-c02f-4a0f-8b98-3384ef2445bc tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:40:25.426094 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-b4ecc406-c02f-4a0f-8b98-3384ef2445bc tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 0d1c24fa-d284-4c63-8d44-4551a001be39] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:40:25.434481 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b4ecc406-c02f-4a0f-8b98-3384ef2445bc tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:40:25.435158 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b4ecc406-c02f-4a0f-8b98-3384ef2445bc tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:40:25.435710 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b4ecc406-c02f-4a0f-8b98-3384ef2445bc tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:40:25.436529 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b4ecc406-c02f-4a0f-8b98-3384ef2445bc tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:40:25.437177 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b4ecc406-c02f-4a0f-8b98-3384ef2445bc tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:40:25.437610 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b4ecc406-c02f-4a0f-8b98-3384ef2445bc tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:40:25.583085 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-b4ecc406-c02f-4a0f-8b98-3384ef2445bc tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:40:25.591774 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-b4ecc406-c02f-4a0f-8b98-3384ef2445bc tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/0d1c24fa-d284-4c63-8d44-4551a001be39" status: 200 len: 1202 microversion: 2.1 time: 0.170407 Aug 10 23:40:25.597387 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2965/6135] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:40:25 2022] GET /compute/v2.1/servers/0d1c24fa-d284-4c63-8d44-4551a001be39 => generated 1202 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:40:26.619262 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-d500de1d-db2c-40bd-adf8-f7a2fe5d5a15 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:40:26.621735 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-d500de1d-db2c-40bd-adf8-f7a2fe5d5a15 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 0d1c24fa-d284-4c63-8d44-4551a001be39] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:40:26.634632 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d500de1d-db2c-40bd-adf8-f7a2fe5d5a15 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:40:26.635524 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d500de1d-db2c-40bd-adf8-f7a2fe5d5a15 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:40:26.636291 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d500de1d-db2c-40bd-adf8-f7a2fe5d5a15 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:40:26.637547 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d500de1d-db2c-40bd-adf8-f7a2fe5d5a15 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:40:26.638769 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d500de1d-db2c-40bd-adf8-f7a2fe5d5a15 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:40:26.639854 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d500de1d-db2c-40bd-adf8-f7a2fe5d5a15 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:40:26.781074 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-d500de1d-db2c-40bd-adf8-f7a2fe5d5a15 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:40:26.788987 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-d500de1d-db2c-40bd-adf8-f7a2fe5d5a15 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/0d1c24fa-d284-4c63-8d44-4551a001be39" status: 200 len: 1202 microversion: 2.1 time: 0.178380 Aug 10 23:40:26.794848 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3171/6136] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:40:26 2022] GET /compute/v2.1/servers/0d1c24fa-d284-4c63-8d44-4551a001be39 => generated 1202 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:40:27.812305 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-7be2f393-43ba-40b4-a541-3d509ad9ebcc tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:40:27.813219 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-7be2f393-43ba-40b4-a541-3d509ad9ebcc tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 0d1c24fa-d284-4c63-8d44-4551a001be39] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:40:27.820223 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7be2f393-43ba-40b4-a541-3d509ad9ebcc tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:40:27.821113 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7be2f393-43ba-40b4-a541-3d509ad9ebcc tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:40:27.821654 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7be2f393-43ba-40b4-a541-3d509ad9ebcc tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:40:27.822269 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7be2f393-43ba-40b4-a541-3d509ad9ebcc tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:40:27.822866 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7be2f393-43ba-40b4-a541-3d509ad9ebcc tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:40:27.823444 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7be2f393-43ba-40b4-a541-3d509ad9ebcc tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:40:27.963586 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-7be2f393-43ba-40b4-a541-3d509ad9ebcc tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:40:27.971489 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-7be2f393-43ba-40b4-a541-3d509ad9ebcc tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/0d1c24fa-d284-4c63-8d44-4551a001be39" status: 200 len: 1202 microversion: 2.1 time: 0.163366 Aug 10 23:40:27.972065 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2966/6137] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:40:27 2022] GET /compute/v2.1/servers/0d1c24fa-d284-4c63-8d44-4551a001be39 => generated 1202 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:40:28.993838 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-03127e5b-7f61-4b01-a222-9f8261c0de26 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:40:28.994505 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-03127e5b-7f61-4b01-a222-9f8261c0de26 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 0d1c24fa-d284-4c63-8d44-4551a001be39] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:40:28.997497 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:40:29.002729 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-03127e5b-7f61-4b01-a222-9f8261c0de26 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:40:29.003245 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-03127e5b-7f61-4b01-a222-9f8261c0de26 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:40:29.003679 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-03127e5b-7f61-4b01-a222-9f8261c0de26 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:40:29.004371 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-03127e5b-7f61-4b01-a222-9f8261c0de26 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:40:29.004829 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-03127e5b-7f61-4b01-a222-9f8261c0de26 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:40:29.005247 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-03127e5b-7f61-4b01-a222-9f8261c0de26 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:40:29.011915 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:40:29.147867 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-03127e5b-7f61-4b01-a222-9f8261c0de26 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:40:29.156641 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-03127e5b-7f61-4b01-a222-9f8261c0de26 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/0d1c24fa-d284-4c63-8d44-4551a001be39" status: 200 len: 1202 microversion: 2.1 time: 0.167697 Aug 10 23:40:29.157233 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3172/6138] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:40:28 2022] GET /compute/v2.1/servers/0d1c24fa-d284-4c63-8d44-4551a001be39 => generated 1202 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:40:29.240820 n-d-850468-14 devstack@n-api.service[122632]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 23:40:29.241417 n-d-850468-14 devstack@n-api.service[122632]: Wed Aug 10 23:40:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 23:40:30.177482 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-dfd72cd9-c134-4242-bdcc-0e26786a1395 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:40:30.177994 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-dfd72cd9-c134-4242-bdcc-0e26786a1395 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 0d1c24fa-d284-4c63-8d44-4551a001be39] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:40:30.186621 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dfd72cd9-c134-4242-bdcc-0e26786a1395 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:40:30.187134 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dfd72cd9-c134-4242-bdcc-0e26786a1395 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:40:30.187595 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dfd72cd9-c134-4242-bdcc-0e26786a1395 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:40:30.188294 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dfd72cd9-c134-4242-bdcc-0e26786a1395 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:40:30.188748 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dfd72cd9-c134-4242-bdcc-0e26786a1395 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:40:30.189168 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dfd72cd9-c134-4242-bdcc-0e26786a1395 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:40:30.328511 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-dfd72cd9-c134-4242-bdcc-0e26786a1395 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:40:30.337527 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-dfd72cd9-c134-4242-bdcc-0e26786a1395 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/0d1c24fa-d284-4c63-8d44-4551a001be39" status: 200 len: 1202 microversion: 2.1 time: 0.164032 Aug 10 23:40:30.338189 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2967/6139] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:40:30 2022] GET /compute/v2.1/servers/0d1c24fa-d284-4c63-8d44-4551a001be39 => generated 1202 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:40:31.359497 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-9df36166-844b-4dcf-9b0b-dbbe5f4736f5 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:40:31.360382 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-9df36166-844b-4dcf-9b0b-dbbe5f4736f5 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 0d1c24fa-d284-4c63-8d44-4551a001be39] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:40:31.367516 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9df36166-844b-4dcf-9b0b-dbbe5f4736f5 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:40:31.368332 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9df36166-844b-4dcf-9b0b-dbbe5f4736f5 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:40:31.368436 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9df36166-844b-4dcf-9b0b-dbbe5f4736f5 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:40:31.369122 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9df36166-844b-4dcf-9b0b-dbbe5f4736f5 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:40:31.369585 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9df36166-844b-4dcf-9b0b-dbbe5f4736f5 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:40:31.370045 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9df36166-844b-4dcf-9b0b-dbbe5f4736f5 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:40:31.575271 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-9df36166-844b-4dcf-9b0b-dbbe5f4736f5 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:40:31.590105 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-9df36166-844b-4dcf-9b0b-dbbe5f4736f5 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/0d1c24fa-d284-4c63-8d44-4551a001be39" status: 200 len: 1202 microversion: 2.1 time: 0.234756 Aug 10 23:40:31.591199 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3173/6140] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:40:31 2022] GET /compute/v2.1/servers/0d1c24fa-d284-4c63-8d44-4551a001be39 => generated 1202 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:40:32.612626 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-27ef4a03-7471-47ca-9cc9-f1d1b403805a tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:40:32.613111 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-27ef4a03-7471-47ca-9cc9-f1d1b403805a tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 0d1c24fa-d284-4c63-8d44-4551a001be39] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:40:32.620301 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-27ef4a03-7471-47ca-9cc9-f1d1b403805a tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:40:32.620787 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-27ef4a03-7471-47ca-9cc9-f1d1b403805a tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:40:32.621222 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-27ef4a03-7471-47ca-9cc9-f1d1b403805a tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:40:32.621923 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-27ef4a03-7471-47ca-9cc9-f1d1b403805a tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:40:32.622371 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-27ef4a03-7471-47ca-9cc9-f1d1b403805a tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:40:32.622814 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-27ef4a03-7471-47ca-9cc9-f1d1b403805a tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:40:32.625464 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=70 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:40:32.798503 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-27ef4a03-7471-47ca-9cc9-f1d1b403805a tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:40:32.812387 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-27ef4a03-7471-47ca-9cc9-f1d1b403805a tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/0d1c24fa-d284-4c63-8d44-4551a001be39" status: 200 len: 1202 microversion: 2.1 time: 0.199399 Aug 10 23:40:32.814827 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2968/6141] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:40:32 2022] GET /compute/v2.1/servers/0d1c24fa-d284-4c63-8d44-4551a001be39 => generated 1202 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:40:32.955367 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-508b807b-f488-42a8-81f5-231b3ef164a5 req-0612c82a-dda3-4461-8b70-8c8212754447 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d1c24fa-d284-4c63-8d44-4551a001be39", "name": "network-vif-plugged", "status": "completed", "tag": "2fece870-33ad-4226-a7b8-dc1ba4bf9828"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:40:32.985116 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-508b807b-f488-42a8-81f5-231b3ef164a5 req-0612c82a-dda3-4461-8b70-8c8212754447 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:40:32.985635 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-508b807b-f488-42a8-81f5-231b3ef164a5 req-0612c82a-dda3-4461-8b70-8c8212754447 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:40:32.986078 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-508b807b-f488-42a8-81f5-231b3ef164a5 req-0612c82a-dda3-4461-8b70-8c8212754447 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:40:33.013751 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-508b807b-f488-42a8-81f5-231b3ef164a5 req-0612c82a-dda3-4461-8b70-8c8212754447 service nova] Creating event network-vif-plugged:2fece870-33ad-4226-a7b8-dc1ba4bf9828 for instance 0d1c24fa-d284-4c63-8d44-4551a001be39 on n-h2-850468-14 Aug 10 23:40:33.019451 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-508b807b-f488-42a8-81f5-231b3ef164a5 req-0612c82a-dda3-4461-8b70-8c8212754447 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067839 Aug 10 23:40:33.020656 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3174/6142] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:40:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:40:33.834800 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-8fa4b061-a695-440d-a029-bac22f544e23 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:40:33.835569 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-8fa4b061-a695-440d-a029-bac22f544e23 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 0d1c24fa-d284-4c63-8d44-4551a001be39] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:40:33.843357 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8fa4b061-a695-440d-a029-bac22f544e23 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:40:33.844147 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8fa4b061-a695-440d-a029-bac22f544e23 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:40:33.844593 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8fa4b061-a695-440d-a029-bac22f544e23 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:40:33.845407 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8fa4b061-a695-440d-a029-bac22f544e23 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:40:33.845870 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8fa4b061-a695-440d-a029-bac22f544e23 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:40:33.846300 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8fa4b061-a695-440d-a029-bac22f544e23 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:40:33.983523 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-8fa4b061-a695-440d-a029-bac22f544e23 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:40:33.991668 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-8fa4b061-a695-440d-a029-bac22f544e23 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/0d1c24fa-d284-4c63-8d44-4551a001be39" status: 200 len: 1202 microversion: 2.1 time: 0.160877 Aug 10 23:40:33.992912 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2969/6143] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:40:33 2022] GET /compute/v2.1/servers/0d1c24fa-d284-4c63-8d44-4551a001be39 => generated 1202 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:40:35.015627 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-31529a75-a255-4e11-bbfb-3646f51c57ec tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:40:35.016242 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-31529a75-a255-4e11-bbfb-3646f51c57ec tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 0d1c24fa-d284-4c63-8d44-4551a001be39] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:40:35.022434 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-31529a75-a255-4e11-bbfb-3646f51c57ec tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:40:35.022965 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-31529a75-a255-4e11-bbfb-3646f51c57ec tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:40:35.023403 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-31529a75-a255-4e11-bbfb-3646f51c57ec tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:40:35.024417 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-31529a75-a255-4e11-bbfb-3646f51c57ec tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:40:35.024883 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-31529a75-a255-4e11-bbfb-3646f51c57ec tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:40:35.025314 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-31529a75-a255-4e11-bbfb-3646f51c57ec tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:40:35.163238 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-31529a75-a255-4e11-bbfb-3646f51c57ec tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:40:35.171764 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-31529a75-a255-4e11-bbfb-3646f51c57ec tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/0d1c24fa-d284-4c63-8d44-4551a001be39" status: 200 len: 1389 microversion: 2.1 time: 0.161469 Aug 10 23:40:35.172455 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3175/6144] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:40:35 2022] GET /compute/v2.1/servers/0d1c24fa-d284-4c63-8d44-4551a001be39 => generated 1389 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:40:35.192817 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-f6a30194-20d4-4caf-8144-435404b79841 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:40:35.193375 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-f6a30194-20d4-4caf-8144-435404b79841 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 0d1c24fa-d284-4c63-8d44-4551a001be39] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:40:35.201132 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f6a30194-20d4-4caf-8144-435404b79841 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:40:35.201630 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f6a30194-20d4-4caf-8144-435404b79841 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:40:35.202078 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f6a30194-20d4-4caf-8144-435404b79841 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:40:35.202803 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f6a30194-20d4-4caf-8144-435404b79841 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:40:35.203283 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f6a30194-20d4-4caf-8144-435404b79841 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:40:35.203715 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f6a30194-20d4-4caf-8144-435404b79841 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:40:35.337569 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-f6a30194-20d4-4caf-8144-435404b79841 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:40:35.345253 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-f6a30194-20d4-4caf-8144-435404b79841 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/0d1c24fa-d284-4c63-8d44-4551a001be39" status: 200 len: 1389 microversion: 2.1 time: 0.156367 Aug 10 23:40:35.345827 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2970/6145] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:40:35 2022] GET /compute/v2.1/servers/0d1c24fa-d284-4c63-8d44-4551a001be39 => generated 1389 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:40:35.365213 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-71b7f2a7-8f58-49ab-b445-022efae989e5 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:40:35.365829 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-71b7f2a7-8f58-49ab-b445-022efae989e5 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 0d1c24fa-d284-4c63-8d44-4551a001be39] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:40:35.371961 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-71b7f2a7-8f58-49ab-b445-022efae989e5 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:40:35.372442 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-71b7f2a7-8f58-49ab-b445-022efae989e5 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:40:35.372878 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-71b7f2a7-8f58-49ab-b445-022efae989e5 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:40:35.373567 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-71b7f2a7-8f58-49ab-b445-022efae989e5 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:40:35.374020 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-71b7f2a7-8f58-49ab-b445-022efae989e5 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:40:35.374446 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-71b7f2a7-8f58-49ab-b445-022efae989e5 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:40:35.513612 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-71b7f2a7-8f58-49ab-b445-022efae989e5 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:40:35.522004 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-71b7f2a7-8f58-49ab-b445-022efae989e5 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/0d1c24fa-d284-4c63-8d44-4551a001be39" status: 200 len: 1389 microversion: 2.1 time: 0.160523 Aug 10 23:40:35.522863 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3176/6146] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:40:35 2022] GET /compute/v2.1/servers/0d1c24fa-d284-4c63-8d44-4551a001be39 => generated 1389 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:40:35.604709 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-ade3d537-33cb-44b6-9412-df5f8d4aea3c tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:40:35.605206 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-ade3d537-33cb-44b6-9412-df5f8d4aea3c tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 0d1c24fa-d284-4c63-8d44-4551a001be39] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:40:35.611540 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ade3d537-33cb-44b6-9412-df5f8d4aea3c tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:40:35.612016 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ade3d537-33cb-44b6-9412-df5f8d4aea3c tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:40:35.612450 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ade3d537-33cb-44b6-9412-df5f8d4aea3c tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:40:35.613142 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ade3d537-33cb-44b6-9412-df5f8d4aea3c tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:40:35.613612 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ade3d537-33cb-44b6-9412-df5f8d4aea3c tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:40:35.614023 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ade3d537-33cb-44b6-9412-df5f8d4aea3c tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:40:35.641950 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-ade3d537-33cb-44b6-9412-df5f8d4aea3c tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 0d1c24fa-d284-4c63-8d44-4551a001be39] Going to try to terminate instance {{(pid=122632) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:40:35.728565 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-ade3d537-33cb-44b6-9412-df5f8d4aea3c tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "DELETE /compute/v2.1/servers/0d1c24fa-d284-4c63-8d44-4551a001be39" status: 204 len: 0 microversion: 2.1 time: 0.127659 Aug 10 23:40:35.729320 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2971/6147] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:40:35 2022] DELETE /compute/v2.1/servers/0d1c24fa-d284-4c63-8d44-4551a001be39 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:40:35.738050 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-000ab5a9-5c71-4a9c-a606-c09814a2c7fa tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:40:35.738668 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-000ab5a9-5c71-4a9c-a606-c09814a2c7fa tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 0d1c24fa-d284-4c63-8d44-4551a001be39] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:40:35.745547 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-000ab5a9-5c71-4a9c-a606-c09814a2c7fa tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:40:35.746035 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-000ab5a9-5c71-4a9c-a606-c09814a2c7fa tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:40:35.746468 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-000ab5a9-5c71-4a9c-a606-c09814a2c7fa tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:40:35.747193 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-000ab5a9-5c71-4a9c-a606-c09814a2c7fa tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:40:35.747643 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-000ab5a9-5c71-4a9c-a606-c09814a2c7fa tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:40:35.748067 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-000ab5a9-5c71-4a9c-a606-c09814a2c7fa tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:40:35.897935 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-000ab5a9-5c71-4a9c-a606-c09814a2c7fa tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:40:35.906391 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-000ab5a9-5c71-4a9c-a606-c09814a2c7fa tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/0d1c24fa-d284-4c63-8d44-4551a001be39" status: 200 len: 1395 microversion: 2.1 time: 0.172428 Aug 10 23:40:35.907000 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3177/6148] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:40:35 2022] GET /compute/v2.1/servers/0d1c24fa-d284-4c63-8d44-4551a001be39 => generated 1395 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:40:36.931564 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-993257d4-fe7f-45ff-a759-52da68eafc55 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:40:36.932276 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-993257d4-fe7f-45ff-a759-52da68eafc55 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 0d1c24fa-d284-4c63-8d44-4551a001be39] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:40:36.938531 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-993257d4-fe7f-45ff-a759-52da68eafc55 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:40:36.939316 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-993257d4-fe7f-45ff-a759-52da68eafc55 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:40:36.939878 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-993257d4-fe7f-45ff-a759-52da68eafc55 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:40:36.940536 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-993257d4-fe7f-45ff-a759-52da68eafc55 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:40:36.941153 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-993257d4-fe7f-45ff-a759-52da68eafc55 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:40:36.941745 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-993257d4-fe7f-45ff-a759-52da68eafc55 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:40:37.106342 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-993257d4-fe7f-45ff-a759-52da68eafc55 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:40:37.122685 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-993257d4-fe7f-45ff-a759-52da68eafc55 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/0d1c24fa-d284-4c63-8d44-4551a001be39" status: 200 len: 1395 microversion: 2.1 time: 0.196828 Aug 10 23:40:37.123569 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2972/6149] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:40:36 2022] GET /compute/v2.1/servers/0d1c24fa-d284-4c63-8d44-4551a001be39 => generated 1395 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:40:37.870470 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-25b83872-e562-4a23-9d97-44294923f98c req-115065e9-fecc-4d28-99e8-0b90f5312ad3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d1c24fa-d284-4c63-8d44-4551a001be39", "name": "network-vif-deleted", "tag": "2fece870-33ad-4226-a7b8-dc1ba4bf9828"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:40:37.881694 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-25b83872-e562-4a23-9d97-44294923f98c req-115065e9-fecc-4d28-99e8-0b90f5312ad3 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:40:37.881854 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-25b83872-e562-4a23-9d97-44294923f98c req-115065e9-fecc-4d28-99e8-0b90f5312ad3 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:40:37.882239 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-25b83872-e562-4a23-9d97-44294923f98c req-115065e9-fecc-4d28-99e8-0b90f5312ad3 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:40:37.895453 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-25b83872-e562-4a23-9d97-44294923f98c req-115065e9-fecc-4d28-99e8-0b90f5312ad3 service nova] Creating event network-vif-deleted:2fece870-33ad-4226-a7b8-dc1ba4bf9828 for instance 0d1c24fa-d284-4c63-8d44-4551a001be39 on n-h2-850468-14 Aug 10 23:40:37.901248 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-25b83872-e562-4a23-9d97-44294923f98c req-115065e9-fecc-4d28-99e8-0b90f5312ad3 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035068 Aug 10 23:40:37.901868 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3178/6150] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:40:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:40:38.145069 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-f93b2ff9-319b-4f9d-9486-ff1506150f68 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:40:38.145716 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-f93b2ff9-319b-4f9d-9486-ff1506150f68 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 0d1c24fa-d284-4c63-8d44-4551a001be39] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:40:38.154035 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f93b2ff9-319b-4f9d-9486-ff1506150f68 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:40:38.154539 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f93b2ff9-319b-4f9d-9486-ff1506150f68 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:40:38.155171 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f93b2ff9-319b-4f9d-9486-ff1506150f68 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:40:38.155891 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f93b2ff9-319b-4f9d-9486-ff1506150f68 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:40:38.156350 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f93b2ff9-319b-4f9d-9486-ff1506150f68 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:40:38.157433 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f93b2ff9-319b-4f9d-9486-ff1506150f68 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:40:38.225479 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-f93b2ff9-319b-4f9d-9486-ff1506150f68 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:40:38.234939 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-f93b2ff9-319b-4f9d-9486-ff1506150f68 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/0d1c24fa-d284-4c63-8d44-4551a001be39" status: 200 len: 1187 microversion: 2.1 time: 0.094080 Aug 10 23:40:38.235523 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2973/6151] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:40:38 2022] GET /compute/v2.1/servers/0d1c24fa-d284-4c63-8d44-4551a001be39 => generated 1187 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:40:39.262477 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-85e6d9ce-815b-4685-b504-eae5bc83e926 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:40:39.263410 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-85e6d9ce-815b-4685-b504-eae5bc83e926 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 0d1c24fa-d284-4c63-8d44-4551a001be39] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:40:39.276428 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-85e6d9ce-815b-4685-b504-eae5bc83e926 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:40:39.276936 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-85e6d9ce-815b-4685-b504-eae5bc83e926 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:40:39.277382 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-85e6d9ce-815b-4685-b504-eae5bc83e926 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:40:39.278108 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-85e6d9ce-815b-4685-b504-eae5bc83e926 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:40:39.278568 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-85e6d9ce-815b-4685-b504-eae5bc83e926 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:40:39.279228 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-85e6d9ce-815b-4685-b504-eae5bc83e926 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:40:39.358750 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-85e6d9ce-815b-4685-b504-eae5bc83e926 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:40:39.370382 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-85e6d9ce-815b-4685-b504-eae5bc83e926 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/0d1c24fa-d284-4c63-8d44-4551a001be39" status: 200 len: 1187 microversion: 2.1 time: 0.116694 Aug 10 23:40:39.380948 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3179/6152] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:40:39 2022] GET /compute/v2.1/servers/0d1c24fa-d284-4c63-8d44-4551a001be39 => generated 1187 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:40:40.391844 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-be445842-a7a4-4265-a21e-b6907983cb21 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:40:40.392489 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-be445842-a7a4-4265-a21e-b6907983cb21 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 0d1c24fa-d284-4c63-8d44-4551a001be39] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:40:40.400324 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:40:40.402190 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-be445842-a7a4-4265-a21e-b6907983cb21 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:40:40.402991 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-be445842-a7a4-4265-a21e-b6907983cb21 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:40:40.404321 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-be445842-a7a4-4265-a21e-b6907983cb21 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:40:40.405818 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-be445842-a7a4-4265-a21e-b6907983cb21 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:40:40.407092 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-be445842-a7a4-4265-a21e-b6907983cb21 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:40:40.407757 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-be445842-a7a4-4265-a21e-b6907983cb21 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:40:40.490075 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-be445842-a7a4-4265-a21e-b6907983cb21 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:40:40.499997 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-be445842-a7a4-4265-a21e-b6907983cb21 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/0d1c24fa-d284-4c63-8d44-4551a001be39" status: 200 len: 1187 microversion: 2.1 time: 0.111811 Aug 10 23:40:40.500815 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2974/6153] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:40:40 2022] GET /compute/v2.1/servers/0d1c24fa-d284-4c63-8d44-4551a001be39 => generated 1187 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:40:41.522132 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-cd8db9cb-3057-4a06-a1ab-36ce827494bb tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:40:41.522736 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-cd8db9cb-3057-4a06-a1ab-36ce827494bb tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 0d1c24fa-d284-4c63-8d44-4551a001be39] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:40:41.534474 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cd8db9cb-3057-4a06-a1ab-36ce827494bb tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:40:41.534990 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cd8db9cb-3057-4a06-a1ab-36ce827494bb tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:40:41.535427 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cd8db9cb-3057-4a06-a1ab-36ce827494bb tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:40:41.536130 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cd8db9cb-3057-4a06-a1ab-36ce827494bb tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:40:41.536580 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cd8db9cb-3057-4a06-a1ab-36ce827494bb tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:40:41.536999 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cd8db9cb-3057-4a06-a1ab-36ce827494bb tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:40:41.723703 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-cd8db9cb-3057-4a06-a1ab-36ce827494bb tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:40:41.732412 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-cd8db9cb-3057-4a06-a1ab-36ce827494bb tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/0d1c24fa-d284-4c63-8d44-4551a001be39" status: 200 len: 1187 microversion: 2.1 time: 0.214244 Aug 10 23:40:41.733087 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3180/6154] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:40:41 2022] GET /compute/v2.1/servers/0d1c24fa-d284-4c63-8d44-4551a001be39 => generated 1187 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:40:42.753406 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-6066c572-a0a8-4011-a6e9-7aaa03813703 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:40:42.754099 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-6066c572-a0a8-4011-a6e9-7aaa03813703 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 0d1c24fa-d284-4c63-8d44-4551a001be39] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:40:42.762960 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6066c572-a0a8-4011-a6e9-7aaa03813703 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:40:42.763461 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6066c572-a0a8-4011-a6e9-7aaa03813703 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:40:42.763898 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6066c572-a0a8-4011-a6e9-7aaa03813703 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:40:42.764600 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6066c572-a0a8-4011-a6e9-7aaa03813703 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:40:42.765055 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6066c572-a0a8-4011-a6e9-7aaa03813703 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:40:42.765479 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6066c572-a0a8-4011-a6e9-7aaa03813703 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:40:42.780201 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-6066c572-a0a8-4011-a6e9-7aaa03813703 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] HTTP exception thrown: Instance 0d1c24fa-d284-4c63-8d44-4551a001be39 could not be found. Aug 10 23:40:42.781755 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-6066c572-a0a8-4011-a6e9-7aaa03813703 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Request method failure captured: Aug 10 23:40:42.781755 n-d-850468-14 devstack@n-api.service[122632]: request: GET /compute/v2.1/servers/0d1c24fa-d284-4c63-8d44-4551a001be39 HTTP/1.1 Aug 10 23:40:42.781755 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:40:42.781755 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:40:42.781755 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:40:42.781755 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 23:40:42.781755 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:40:42.781755 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:40:42.781755 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:40:42.781755 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:40:42.781755 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9EF3JcALvIu97mWIb2swBcyDTxDI5PJ3vU9Ry5AtFPunVTcpAqQQUjRv0EmIlEp13u4BOFv0aTDkpyifGo3ChPE2BfANGKPVxkJ3JhuTa-9TLVCXxNdBMfkJGfbXf6wm_Y7u9vFxLHJ5-XazgQxDfOp_ueAQ4sa5cZKpoVrdkbUR3Jc Aug 10 23:40:42.781755 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:40:42.781755 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:40:42.781755 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:40:42.781755 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:40:42.781755 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:40:42.781755 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:40:42.781755 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 0b22838d50dd4ea8811953e723d0c052 Aug 10 23:40:42.781755 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-TestVolumeBootPattern-991439424 Aug 10 23:40:42.781755 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:40:42.781755 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:40:42.781755 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0b22838d50dd4ea8811953e723d0c052"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0b22838d50dd4ea8811953e723d0c052"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/0b22838d50dd4ea8811953e723d0c052"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_0b22838d50dd4ea8811953e723d0c052", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:40:42.781755 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-TestVolumeBootPattern-991439424 Aug 10 23:40:42.781755 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 0b22838d50dd4ea8811953e723d0c052 Aug 10 23:40:42.781755 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-TestVolumeBootPattern-991439424 Aug 10 23:40:42.781755 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-TestVolumeBootPattern-991439424-project Aug 10 23:40:42.781755 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:40:42.781755 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:40:42.781755 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: e97e9cddb55649809a9cd16dbc43bb7e Aug 10 23:40:42.781755 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-TestVolumeBootPattern-991439424-project Aug 10 23:40:42.781755 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:40:42.781755 n-d-850468-14 devstack@n-api.service[122632]: exception: Instance 0d1c24fa-d284-4c63-8d44-4551a001be39 could not be found. Aug 10 23:40:42.781755 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': '0d1c24fa-d284-4c63-8d44-4551a001be39'} Aug 10 23:40:42.781755 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:40:42.781755 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:40:42.781755 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:40:42.781755 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:40:42.781755 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:40:42.781755 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:40:42.781755 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:40:42.781755 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:40:42.781755 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:40:42.781755 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:40:42.781755 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d1c24fa-d284-4c63-8d44-4551a001be39 could not be found. Aug 10 23:40:42.781755 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:40:42.781755 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:40:42.781755 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:40:42.781755 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:40:42.781755 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:40:42.781755 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:40:42.781755 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:40:42.781755 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:40:42.781755 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:40:42.781755 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:40:42.781755 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:40:42.781755 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:40:42.781755 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:40:42.781755 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:40:42.781755 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:40:42.781755 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:40:42.781755 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d1c24fa-d284-4c63-8d44-4551a001be39 could not be found. Aug 10 23:40:42.781755 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:40:42.781755 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:40:42.781755 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:40:42.786649 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:40:42.786649 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:40:42.786649 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:40:42.786649 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:40:42.786649 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:40:42.786649 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d1c24fa-d284-4c63-8d44-4551a001be39 could not be found. Aug 10 23:40:42.786649 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:40:42.786649 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-6066c572-a0a8-4011-a6e9-7aaa03813703 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Returning 404 to user: Instance 0d1c24fa-d284-4c63-8d44-4551a001be39 could not be found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:40:42.786649 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-6066c572-a0a8-4011-a6e9-7aaa03813703 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/0d1c24fa-d284-4c63-8d44-4551a001be39" status: 404 len: 111 microversion: 2.1 time: 0.033784 Aug 10 23:40:42.786649 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2975/6155] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:40:42 2022] GET /compute/v2.1/servers/0d1c24fa-d284-4c63-8d44-4551a001be39 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:40:46.000827 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-fc60ade3-593a-47d7-a2d3-c370e24d1f42 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:40:46.001449 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-fc60ade3-593a-47d7-a2d3-c370e24d1f42 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 0d1c24fa-d284-4c63-8d44-4551a001be39] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:40:46.009947 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fc60ade3-593a-47d7-a2d3-c370e24d1f42 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:40:46.010582 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fc60ade3-593a-47d7-a2d3-c370e24d1f42 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:40:46.011151 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fc60ade3-593a-47d7-a2d3-c370e24d1f42 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:40:46.011971 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fc60ade3-593a-47d7-a2d3-c370e24d1f42 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:40:46.012526 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fc60ade3-593a-47d7-a2d3-c370e24d1f42 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:40:46.013182 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fc60ade3-593a-47d7-a2d3-c370e24d1f42 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:40:46.031982 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-fc60ade3-593a-47d7-a2d3-c370e24d1f42 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] HTTP exception thrown: Instance 0d1c24fa-d284-4c63-8d44-4551a001be39 could not be found. Aug 10 23:40:46.033869 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-fc60ade3-593a-47d7-a2d3-c370e24d1f42 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Request method failure captured: Aug 10 23:40:46.033869 n-d-850468-14 devstack@n-api.service[122633]: request: DELETE /compute/v2.1/servers/0d1c24fa-d284-4c63-8d44-4551a001be39 HTTP/1.1 Aug 10 23:40:46.033869 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:40:46.033869 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:40:46.033869 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:40:46.033869 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:40:46.033869 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:40:46.033869 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:40:46.033869 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:40:46.033869 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:40:46.033869 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9EF3JcALvIu97mWIb2swBcyDTxDI5PJ3vU9Ry5AtFPunVTcpAqQQUjRv0EmIlEp13u4BOFv0aTDkpyifGo3ChPE2BfANGKPVxkJ3JhuTa-9TLVCXxNdBMfkJGfbXf6wm_Y7u9vFxLHJ5-XazgQxDfOp_ueAQ4sa5cZKpoVrdkbUR3Jc Aug 10 23:40:46.033869 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:40:46.033869 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:40:46.033869 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:40:46.033869 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:40:46.033869 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:40:46.033869 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:40:46.033869 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 0b22838d50dd4ea8811953e723d0c052 Aug 10 23:40:46.033869 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-TestVolumeBootPattern-991439424 Aug 10 23:40:46.033869 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:40:46.033869 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:40:46.033869 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0b22838d50dd4ea8811953e723d0c052"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0b22838d50dd4ea8811953e723d0c052"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/0b22838d50dd4ea8811953e723d0c052"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_0b22838d50dd4ea8811953e723d0c052", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:40:46.033869 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-TestVolumeBootPattern-991439424 Aug 10 23:40:46.033869 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 0b22838d50dd4ea8811953e723d0c052 Aug 10 23:40:46.033869 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-TestVolumeBootPattern-991439424 Aug 10 23:40:46.033869 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-TestVolumeBootPattern-991439424-project Aug 10 23:40:46.033869 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:40:46.033869 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:40:46.033869 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: e97e9cddb55649809a9cd16dbc43bb7e Aug 10 23:40:46.033869 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-TestVolumeBootPattern-991439424-project Aug 10 23:40:46.033869 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:40:46.033869 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance 0d1c24fa-d284-4c63-8d44-4551a001be39 could not be found. Aug 10 23:40:46.033869 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': '0d1c24fa-d284-4c63-8d44-4551a001be39'} Aug 10 23:40:46.033869 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:40:46.033869 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:40:46.033869 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:40:46.033869 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:40:46.033869 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:40:46.033869 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:40:46.033869 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:40:46.033869 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:40:46.033869 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:40:46.033869 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:40:46.033869 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d1c24fa-d284-4c63-8d44-4551a001be39 could not be found. Aug 10 23:40:46.033869 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:40:46.033869 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:40:46.033869 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:40:46.033869 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:40:46.033869 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:40:46.033869 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:40:46.033869 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:40:46.033869 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:40:46.033869 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:40:46.033869 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:40:46.033869 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 23:40:46.033869 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 23:40:46.033869 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 23:40:46.033869 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 23:40:46.033869 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:40:46.033869 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:40:46.033869 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:40:46.033869 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:40:46.039582 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d1c24fa-d284-4c63-8d44-4551a001be39 could not be found. Aug 10 23:40:46.039582 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:40:46.039582 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:40:46.039582 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:40:46.039582 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:40:46.039582 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:40:46.039582 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:40:46.039582 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:40:46.039582 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:40:46.039582 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d1c24fa-d284-4c63-8d44-4551a001be39 could not be found. Aug 10 23:40:46.039582 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:40:46.041797 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-fc60ade3-593a-47d7-a2d3-c370e24d1f42 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Returning 404 to user: Instance 0d1c24fa-d284-4c63-8d44-4551a001be39 could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:40:46.043151 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-fc60ade3-593a-47d7-a2d3-c370e24d1f42 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "DELETE /compute/v2.1/servers/0d1c24fa-d284-4c63-8d44-4551a001be39" status: 404 len: 111 microversion: 2.1 time: 0.046419 Aug 10 23:40:46.047484 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3181/6156] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:40:45 2022] DELETE /compute/v2.1/servers/0d1c24fa-d284-4c63-8d44-4551a001be39 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:40:46.052783 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-7d9095e9-3d44-4882-8213-e5cca2d6f6f0 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:40:46.054057 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-7d9095e9-3d44-4882-8213-e5cca2d6f6f0 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 0d1c24fa-d284-4c63-8d44-4551a001be39] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:40:46.063104 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7d9095e9-3d44-4882-8213-e5cca2d6f6f0 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:40:46.063877 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7d9095e9-3d44-4882-8213-e5cca2d6f6f0 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:40:46.064526 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7d9095e9-3d44-4882-8213-e5cca2d6f6f0 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:40:46.065427 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7d9095e9-3d44-4882-8213-e5cca2d6f6f0 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:40:46.066060 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7d9095e9-3d44-4882-8213-e5cca2d6f6f0 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:40:46.066661 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7d9095e9-3d44-4882-8213-e5cca2d6f6f0 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:40:46.082448 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-7d9095e9-3d44-4882-8213-e5cca2d6f6f0 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] HTTP exception thrown: Instance 0d1c24fa-d284-4c63-8d44-4551a001be39 could not be found. Aug 10 23:40:46.084369 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-7d9095e9-3d44-4882-8213-e5cca2d6f6f0 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Request method failure captured: Aug 10 23:40:46.084369 n-d-850468-14 devstack@n-api.service[122632]: request: GET /compute/v2.1/servers/0d1c24fa-d284-4c63-8d44-4551a001be39 HTTP/1.1 Aug 10 23:40:46.084369 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:40:46.084369 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:40:46.084369 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:40:46.084369 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 23:40:46.084369 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:40:46.084369 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:40:46.084369 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:40:46.084369 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:40:46.084369 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9EF3JcALvIu97mWIb2swBcyDTxDI5PJ3vU9Ry5AtFPunVTcpAqQQUjRv0EmIlEp13u4BOFv0aTDkpyifGo3ChPE2BfANGKPVxkJ3JhuTa-9TLVCXxNdBMfkJGfbXf6wm_Y7u9vFxLHJ5-XazgQxDfOp_ueAQ4sa5cZKpoVrdkbUR3Jc Aug 10 23:40:46.084369 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:40:46.084369 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:40:46.084369 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:40:46.084369 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:40:46.084369 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:40:46.084369 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:40:46.084369 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 0b22838d50dd4ea8811953e723d0c052 Aug 10 23:40:46.084369 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-TestVolumeBootPattern-991439424 Aug 10 23:40:46.084369 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:40:46.084369 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:40:46.084369 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0b22838d50dd4ea8811953e723d0c052"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0b22838d50dd4ea8811953e723d0c052"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/0b22838d50dd4ea8811953e723d0c052"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_0b22838d50dd4ea8811953e723d0c052", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:40:46.084369 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-TestVolumeBootPattern-991439424 Aug 10 23:40:46.084369 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 0b22838d50dd4ea8811953e723d0c052 Aug 10 23:40:46.084369 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-TestVolumeBootPattern-991439424 Aug 10 23:40:46.084369 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-TestVolumeBootPattern-991439424-project Aug 10 23:40:46.084369 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:40:46.084369 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:40:46.084369 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: e97e9cddb55649809a9cd16dbc43bb7e Aug 10 23:40:46.084369 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-TestVolumeBootPattern-991439424-project Aug 10 23:40:46.084369 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:40:46.084369 n-d-850468-14 devstack@n-api.service[122632]: exception: Instance 0d1c24fa-d284-4c63-8d44-4551a001be39 could not be found. Aug 10 23:40:46.084369 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': '0d1c24fa-d284-4c63-8d44-4551a001be39'} Aug 10 23:40:46.084369 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:40:46.084369 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:40:46.084369 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:40:46.084369 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:40:46.084369 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:40:46.084369 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:40:46.084369 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:40:46.084369 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:40:46.084369 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:40:46.084369 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:40:46.084369 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d1c24fa-d284-4c63-8d44-4551a001be39 could not be found. Aug 10 23:40:46.084369 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:40:46.084369 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:40:46.084369 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:40:46.084369 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:40:46.084369 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:40:46.084369 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:40:46.084369 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:40:46.084369 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:40:46.084369 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:40:46.084369 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:40:46.084369 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:40:46.084369 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:40:46.084369 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:40:46.084369 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:40:46.084369 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:40:46.084369 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:40:46.084369 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d1c24fa-d284-4c63-8d44-4551a001be39 could not be found. Aug 10 23:40:46.084369 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:40:46.084369 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:40:46.084369 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:40:46.089945 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:40:46.089945 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:40:46.089945 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:40:46.089945 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:40:46.089945 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:40:46.089945 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d1c24fa-d284-4c63-8d44-4551a001be39 could not be found. Aug 10 23:40:46.089945 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:40:46.091329 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-7d9095e9-3d44-4882-8213-e5cca2d6f6f0 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Returning 404 to user: Instance 0d1c24fa-d284-4c63-8d44-4551a001be39 could not be found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:40:46.092402 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-7d9095e9-3d44-4882-8213-e5cca2d6f6f0 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/0d1c24fa-d284-4c63-8d44-4551a001be39" status: 404 len: 111 microversion: 2.1 time: 0.043577 Aug 10 23:40:46.093497 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2976/6157] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:40:46 2022] GET /compute/v2.1/servers/0d1c24fa-d284-4c63-8d44-4551a001be39 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:41:06.943287 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-ceeda558-e06b-42fd-93fb-c6b990d77613 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-1441069627", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "873563bc-a056-4e0c-8880-de009a7c81b2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "5ed0a190-471f-4749-aff5-4f68f1343451"}]}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:41:06.953224 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_api:SELECT=19 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:41:06.953879 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=47 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:41:07.006286 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.network.neutron [None req-ceeda558-e06b-42fd-93fb-c6b990d77613 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] validate_networks() for [('5ed0a190-471f-4749-aff5-4f68f1343451', None, None, None, None, None)] {{(pid=122633) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 23:41:07.378119 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-ceeda558-e06b-42fd-93fb-c6b990d77613 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Flavor limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:41:07.378543 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-ceeda558-e06b-42fd-93fb-c6b990d77613 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Image limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:41:07.379050 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-ceeda558-e06b-42fd-93fb-c6b990d77613 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Flavor pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:41:07.379459 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-ceeda558-e06b-42fd-93fb-c6b990d77613 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Image pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:41:07.379870 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-ceeda558-e06b-42fd-93fb-c6b990d77613 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:41:07.389099 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ceeda558-e06b-42fd-93fb-c6b990d77613 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:41:07.389583 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ceeda558-e06b-42fd-93fb-c6b990d77613 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:41:07.390019 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ceeda558-e06b-42fd-93fb-c6b990d77613 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:41:07.390751 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ceeda558-e06b-42fd-93fb-c6b990d77613 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:41:07.391311 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ceeda558-e06b-42fd-93fb-c6b990d77613 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:41:07.391782 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ceeda558-e06b-42fd-93fb-c6b990d77613 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:41:07.412385 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-ceeda558-e06b-42fd-93fb-c6b990d77613 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Getting quotas for project 0b22838d50dd4ea8811953e723d0c052. Resources: {'instances', 'cores', 'ram'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:41:07.418503 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-ceeda558-e06b-42fd-93fb-c6b990d77613 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Getting quotas for user e97e9cddb55649809a9cd16dbc43bb7e and project 0b22838d50dd4ea8811953e723d0c052. Resources: {'instances', 'cores', 'ram'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:41:07.477688 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-ceeda558-e06b-42fd-93fb-c6b990d77613 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Going to run 1 instances... {{(pid=122633) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 23:41:07.480051 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-ceeda558-e06b-42fd-93fb-c6b990d77613 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 4583ce16-fb30-4fc9-9ed3-6ca8156c76eb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='873563bc-a056-4e0c-8880-de009a7c81b2',volume_size=None,volume_type=None)] {{(pid=122633) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 23:41:07.616927 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-ceeda558-e06b-42fd-93fb-c6b990d77613 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.677485 Aug 10 23:41:07.617900 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3182/6158] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 23:41:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 679 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 23:41:07.628653 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-73e19174-8b1f-4239-83b5-ca9a82209a96 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:41:07.629258 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-73e19174-8b1f-4239-83b5-ca9a82209a96 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 4583ce16-fb30-4fc9-9ed3-6ca8156c76eb] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:41:07.634630 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_api:SELECT=5 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:41:07.635387 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=53,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:41:07.870982 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-73e19174-8b1f-4239-83b5-ca9a82209a96 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:41:07.879035 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-73e19174-8b1f-4239-83b5-ca9a82209a96 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/4583ce16-fb30-4fc9-9ed3-6ca8156c76eb" status: 200 len: 1071 microversion: 2.1 time: 0.254354 Aug 10 23:41:07.879536 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2977/6159] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:41:07 2022] GET /compute/v2.1/servers/4583ce16-fb30-4fc9-9ed3-6ca8156c76eb => generated 1071 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:41:08.901088 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-b51d74ea-4ed0-4c7c-b59f-7a9b938ad94a tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:41:08.901707 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-b51d74ea-4ed0-4c7c-b59f-7a9b938ad94a tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 4583ce16-fb30-4fc9-9ed3-6ca8156c76eb] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:41:08.908998 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b51d74ea-4ed0-4c7c-b59f-7a9b938ad94a tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:41:08.909491 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b51d74ea-4ed0-4c7c-b59f-7a9b938ad94a tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:41:08.909934 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b51d74ea-4ed0-4c7c-b59f-7a9b938ad94a tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:41:08.910979 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b51d74ea-4ed0-4c7c-b59f-7a9b938ad94a tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:41:08.911722 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b51d74ea-4ed0-4c7c-b59f-7a9b938ad94a tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:41:08.912193 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b51d74ea-4ed0-4c7c-b59f-7a9b938ad94a tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:41:09.002404 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-b51d74ea-4ed0-4c7c-b59f-7a9b938ad94a tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:41:09.011036 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-b51d74ea-4ed0-4c7c-b59f-7a9b938ad94a tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/4583ce16-fb30-4fc9-9ed3-6ca8156c76eb" status: 200 len: 1187 microversion: 2.1 time: 0.114603 Aug 10 23:41:09.011650 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3183/6160] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:41:08 2022] GET /compute/v2.1/servers/4583ce16-fb30-4fc9-9ed3-6ca8156c76eb => generated 1187 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:41:10.032904 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-15e38c13-d137-47ac-b620-3242a7c89ae8 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:41:10.033456 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-15e38c13-d137-47ac-b620-3242a7c89ae8 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 4583ce16-fb30-4fc9-9ed3-6ca8156c76eb] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:41:10.041626 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-15e38c13-d137-47ac-b620-3242a7c89ae8 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:41:10.042129 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-15e38c13-d137-47ac-b620-3242a7c89ae8 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:41:10.042818 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-15e38c13-d137-47ac-b620-3242a7c89ae8 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:41:10.043538 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-15e38c13-d137-47ac-b620-3242a7c89ae8 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:41:10.044031 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-15e38c13-d137-47ac-b620-3242a7c89ae8 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:41:10.044466 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-15e38c13-d137-47ac-b620-3242a7c89ae8 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:41:10.199834 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-15e38c13-d137-47ac-b620-3242a7c89ae8 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:41:10.208295 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-15e38c13-d137-47ac-b620-3242a7c89ae8 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/4583ce16-fb30-4fc9-9ed3-6ca8156c76eb" status: 200 len: 1229 microversion: 2.1 time: 0.179587 Aug 10 23:41:10.208879 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2978/6161] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:41:10 2022] GET /compute/v2.1/servers/4583ce16-fb30-4fc9-9ed3-6ca8156c76eb => generated 1229 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:41:10.317993 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-0d3a2182-67b7-40d8-a681-3f0a2a24969c req-6444f2f7-c8f5-4802-8939-8676692c492f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4583ce16-fb30-4fc9-9ed3-6ca8156c76eb", "tag": "b7a55608-5352-4512-aa12-c167b829963f"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:41:10.343345 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-0d3a2182-67b7-40d8-a681-3f0a2a24969c req-6444f2f7-c8f5-4802-8939-8676692c492f service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:41:10.343744 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-0d3a2182-67b7-40d8-a681-3f0a2a24969c req-6444f2f7-c8f5-4802-8939-8676692c492f service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:41:10.344179 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-0d3a2182-67b7-40d8-a681-3f0a2a24969c req-6444f2f7-c8f5-4802-8939-8676692c492f service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:41:10.357217 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-0d3a2182-67b7-40d8-a681-3f0a2a24969c req-6444f2f7-c8f5-4802-8939-8676692c492f service nova] Creating event network-changed:b7a55608-5352-4512-aa12-c167b829963f for instance 4583ce16-fb30-4fc9-9ed3-6ca8156c76eb on n-h2-850468-14 Aug 10 23:41:10.363170 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-0d3a2182-67b7-40d8-a681-3f0a2a24969c req-6444f2f7-c8f5-4802-8939-8676692c492f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051890 Aug 10 23:41:10.363784 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3184/6162] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:41:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:41:11.230070 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-b10c5089-691c-4338-9f4d-839fbb60a322 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:41:11.230673 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-b10c5089-691c-4338-9f4d-839fbb60a322 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 4583ce16-fb30-4fc9-9ed3-6ca8156c76eb] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:41:11.238227 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b10c5089-691c-4338-9f4d-839fbb60a322 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:41:11.238821 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b10c5089-691c-4338-9f4d-839fbb60a322 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:41:11.239280 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b10c5089-691c-4338-9f4d-839fbb60a322 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:41:11.239985 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b10c5089-691c-4338-9f4d-839fbb60a322 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:41:11.240444 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b10c5089-691c-4338-9f4d-839fbb60a322 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:41:11.240871 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b10c5089-691c-4338-9f4d-839fbb60a322 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:41:11.375805 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-b10c5089-691c-4338-9f4d-839fbb60a322 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:41:11.384117 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-b10c5089-691c-4338-9f4d-839fbb60a322 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/4583ce16-fb30-4fc9-9ed3-6ca8156c76eb" status: 200 len: 1229 microversion: 2.1 time: 0.158595 Aug 10 23:41:11.384793 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2979/6163] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:41:11 2022] GET /compute/v2.1/servers/4583ce16-fb30-4fc9-9ed3-6ca8156c76eb => generated 1229 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:41:12.407018 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-702c9d2c-6272-44ba-9d83-afff227f8e95 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:41:12.407720 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-702c9d2c-6272-44ba-9d83-afff227f8e95 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 4583ce16-fb30-4fc9-9ed3-6ca8156c76eb] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:41:12.414595 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-702c9d2c-6272-44ba-9d83-afff227f8e95 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:41:12.415115 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-702c9d2c-6272-44ba-9d83-afff227f8e95 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:41:12.415558 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-702c9d2c-6272-44ba-9d83-afff227f8e95 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:41:12.416297 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-702c9d2c-6272-44ba-9d83-afff227f8e95 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:41:12.416759 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-702c9d2c-6272-44ba-9d83-afff227f8e95 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:41:12.417187 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-702c9d2c-6272-44ba-9d83-afff227f8e95 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:41:12.556235 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-702c9d2c-6272-44ba-9d83-afff227f8e95 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:41:12.564089 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-702c9d2c-6272-44ba-9d83-afff227f8e95 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/4583ce16-fb30-4fc9-9ed3-6ca8156c76eb" status: 200 len: 1229 microversion: 2.1 time: 0.162133 Aug 10 23:41:12.564678 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3185/6164] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:41:12 2022] GET /compute/v2.1/servers/4583ce16-fb30-4fc9-9ed3-6ca8156c76eb => generated 1229 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:41:13.586809 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-45852405-74bf-4b64-9320-583e43de2750 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:41:13.587523 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-45852405-74bf-4b64-9320-583e43de2750 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 4583ce16-fb30-4fc9-9ed3-6ca8156c76eb] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:41:13.594622 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-45852405-74bf-4b64-9320-583e43de2750 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:41:13.595153 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-45852405-74bf-4b64-9320-583e43de2750 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:41:13.595604 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-45852405-74bf-4b64-9320-583e43de2750 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:41:13.596381 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-45852405-74bf-4b64-9320-583e43de2750 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:41:13.596817 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-45852405-74bf-4b64-9320-583e43de2750 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:41:13.597517 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-45852405-74bf-4b64-9320-583e43de2750 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:41:13.739694 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-45852405-74bf-4b64-9320-583e43de2750 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:41:13.747554 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-45852405-74bf-4b64-9320-583e43de2750 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/4583ce16-fb30-4fc9-9ed3-6ca8156c76eb" status: 200 len: 1229 microversion: 2.1 time: 0.165802 Aug 10 23:41:13.748135 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2980/6165] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:41:13 2022] GET /compute/v2.1/servers/4583ce16-fb30-4fc9-9ed3-6ca8156c76eb => generated 1229 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:41:14.769432 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-1275eb15-b2ce-41a2-8057-5e45429ec9d9 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:41:14.769987 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-1275eb15-b2ce-41a2-8057-5e45429ec9d9 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 4583ce16-fb30-4fc9-9ed3-6ca8156c76eb] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:41:14.777396 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1275eb15-b2ce-41a2-8057-5e45429ec9d9 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:41:14.777888 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1275eb15-b2ce-41a2-8057-5e45429ec9d9 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:41:14.778329 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1275eb15-b2ce-41a2-8057-5e45429ec9d9 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:41:14.779054 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1275eb15-b2ce-41a2-8057-5e45429ec9d9 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:41:14.779521 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1275eb15-b2ce-41a2-8057-5e45429ec9d9 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:41:14.779949 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1275eb15-b2ce-41a2-8057-5e45429ec9d9 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:41:14.911512 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-1275eb15-b2ce-41a2-8057-5e45429ec9d9 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:41:14.919825 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-1275eb15-b2ce-41a2-8057-5e45429ec9d9 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/4583ce16-fb30-4fc9-9ed3-6ca8156c76eb" status: 200 len: 1217 microversion: 2.1 time: 0.154362 Aug 10 23:41:14.920404 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3186/6166] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:41:14 2022] GET /compute/v2.1/servers/4583ce16-fb30-4fc9-9ed3-6ca8156c76eb => generated 1217 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:41:15.941107 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-8d68f9b8-f8bd-4534-a2e4-927f503263c4 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:41:15.941737 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-8d68f9b8-f8bd-4534-a2e4-927f503263c4 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 4583ce16-fb30-4fc9-9ed3-6ca8156c76eb] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:41:15.948919 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8d68f9b8-f8bd-4534-a2e4-927f503263c4 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:41:15.949404 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8d68f9b8-f8bd-4534-a2e4-927f503263c4 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:41:15.949843 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8d68f9b8-f8bd-4534-a2e4-927f503263c4 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:41:15.950532 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8d68f9b8-f8bd-4534-a2e4-927f503263c4 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:41:15.951012 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8d68f9b8-f8bd-4534-a2e4-927f503263c4 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:41:15.951438 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8d68f9b8-f8bd-4534-a2e4-927f503263c4 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:41:16.086371 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-8d68f9b8-f8bd-4534-a2e4-927f503263c4 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:41:16.094732 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-8d68f9b8-f8bd-4534-a2e4-927f503263c4 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/4583ce16-fb30-4fc9-9ed3-6ca8156c76eb" status: 200 len: 1217 microversion: 2.1 time: 0.157564 Aug 10 23:41:16.095325 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2981/6167] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:41:15 2022] GET /compute/v2.1/servers/4583ce16-fb30-4fc9-9ed3-6ca8156c76eb => generated 1217 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:41:17.117252 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-071eb917-5745-496c-806f-1c3db8fe1d80 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:41:17.117879 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-071eb917-5745-496c-806f-1c3db8fe1d80 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 4583ce16-fb30-4fc9-9ed3-6ca8156c76eb] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:41:17.123868 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-071eb917-5745-496c-806f-1c3db8fe1d80 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:41:17.124350 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-071eb917-5745-496c-806f-1c3db8fe1d80 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:41:17.124785 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-071eb917-5745-496c-806f-1c3db8fe1d80 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:41:17.125506 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-071eb917-5745-496c-806f-1c3db8fe1d80 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:41:17.125961 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-071eb917-5745-496c-806f-1c3db8fe1d80 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:41:17.126395 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-071eb917-5745-496c-806f-1c3db8fe1d80 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:41:17.262208 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-071eb917-5745-496c-806f-1c3db8fe1d80 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:41:17.269763 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-071eb917-5745-496c-806f-1c3db8fe1d80 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/4583ce16-fb30-4fc9-9ed3-6ca8156c76eb" status: 200 len: 1217 microversion: 2.1 time: 0.157850 Aug 10 23:41:17.270337 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3187/6168] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:41:17 2022] GET /compute/v2.1/servers/4583ce16-fb30-4fc9-9ed3-6ca8156c76eb => generated 1217 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:41:18.291714 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-511d8bbc-f3d1-4c77-9bb8-9e65bbdb7bf1 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:41:18.292352 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-511d8bbc-f3d1-4c77-9bb8-9e65bbdb7bf1 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 4583ce16-fb30-4fc9-9ed3-6ca8156c76eb] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:41:18.298396 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=2 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:41:18.304963 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-511d8bbc-f3d1-4c77-9bb8-9e65bbdb7bf1 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:41:18.305660 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-511d8bbc-f3d1-4c77-9bb8-9e65bbdb7bf1 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:41:18.306263 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-511d8bbc-f3d1-4c77-9bb8-9e65bbdb7bf1 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:41:18.307342 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-511d8bbc-f3d1-4c77-9bb8-9e65bbdb7bf1 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:41:18.307979 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-511d8bbc-f3d1-4c77-9bb8-9e65bbdb7bf1 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:41:18.308607 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-511d8bbc-f3d1-4c77-9bb8-9e65bbdb7bf1 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:41:18.448412 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-511d8bbc-f3d1-4c77-9bb8-9e65bbdb7bf1 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:41:18.455993 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-511d8bbc-f3d1-4c77-9bb8-9e65bbdb7bf1 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/4583ce16-fb30-4fc9-9ed3-6ca8156c76eb" status: 200 len: 1217 microversion: 2.1 time: 0.168678 Aug 10 23:41:18.456575 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2982/6169] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:41:18 2022] GET /compute/v2.1/servers/4583ce16-fb30-4fc9-9ed3-6ca8156c76eb => generated 1217 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:41:19.477981 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-e42c7890-bf1c-43ac-873d-4b1400c854eb tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:41:19.478553 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-e42c7890-bf1c-43ac-873d-4b1400c854eb tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 4583ce16-fb30-4fc9-9ed3-6ca8156c76eb] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:41:19.480523 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=2 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:41:19.481196 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=6 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:41:19.489250 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e42c7890-bf1c-43ac-873d-4b1400c854eb tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:41:19.489738 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e42c7890-bf1c-43ac-873d-4b1400c854eb tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:41:19.490183 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e42c7890-bf1c-43ac-873d-4b1400c854eb tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:41:19.490918 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e42c7890-bf1c-43ac-873d-4b1400c854eb tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:41:19.491475 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e42c7890-bf1c-43ac-873d-4b1400c854eb tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:41:19.492113 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e42c7890-bf1c-43ac-873d-4b1400c854eb tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:41:19.630416 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-e42c7890-bf1c-43ac-873d-4b1400c854eb tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:41:19.638896 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-e42c7890-bf1c-43ac-873d-4b1400c854eb tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/4583ce16-fb30-4fc9-9ed3-6ca8156c76eb" status: 200 len: 1217 microversion: 2.1 time: 0.165674 Aug 10 23:41:19.639487 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3188/6170] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:41:19 2022] GET /compute/v2.1/servers/4583ce16-fb30-4fc9-9ed3-6ca8156c76eb => generated 1217 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:41:20.660546 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-13f74e21-ebc8-444d-b41c-2e20506d8464 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:41:20.661162 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-13f74e21-ebc8-444d-b41c-2e20506d8464 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 4583ce16-fb30-4fc9-9ed3-6ca8156c76eb] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:41:20.668793 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-13f74e21-ebc8-444d-b41c-2e20506d8464 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:41:20.669282 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-13f74e21-ebc8-444d-b41c-2e20506d8464 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:41:20.669724 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-13f74e21-ebc8-444d-b41c-2e20506d8464 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:41:20.670425 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-13f74e21-ebc8-444d-b41c-2e20506d8464 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:41:20.670908 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-13f74e21-ebc8-444d-b41c-2e20506d8464 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:41:20.671338 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-13f74e21-ebc8-444d-b41c-2e20506d8464 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:41:20.804825 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-13f74e21-ebc8-444d-b41c-2e20506d8464 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:41:20.812368 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-13f74e21-ebc8-444d-b41c-2e20506d8464 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/4583ce16-fb30-4fc9-9ed3-6ca8156c76eb" status: 200 len: 1217 microversion: 2.1 time: 0.155806 Aug 10 23:41:20.812958 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2983/6171] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:41:20 2022] GET /compute/v2.1/servers/4583ce16-fb30-4fc9-9ed3-6ca8156c76eb => generated 1217 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:41:21.832982 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-8207a3f9-969b-4813-8ed2-04e5bb88d664 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:41:21.833586 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-8207a3f9-969b-4813-8ed2-04e5bb88d664 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 4583ce16-fb30-4fc9-9ed3-6ca8156c76eb] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:41:21.840867 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8207a3f9-969b-4813-8ed2-04e5bb88d664 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:41:21.841346 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8207a3f9-969b-4813-8ed2-04e5bb88d664 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:41:21.841779 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8207a3f9-969b-4813-8ed2-04e5bb88d664 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:41:21.842466 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8207a3f9-969b-4813-8ed2-04e5bb88d664 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:41:21.842939 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8207a3f9-969b-4813-8ed2-04e5bb88d664 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:41:21.843358 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8207a3f9-969b-4813-8ed2-04e5bb88d664 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:41:21.974476 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-8207a3f9-969b-4813-8ed2-04e5bb88d664 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:41:21.983078 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-8207a3f9-969b-4813-8ed2-04e5bb88d664 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/4583ce16-fb30-4fc9-9ed3-6ca8156c76eb" status: 200 len: 1217 microversion: 2.1 time: 0.153821 Aug 10 23:41:21.983666 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3189/6172] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:41:21 2022] GET /compute/v2.1/servers/4583ce16-fb30-4fc9-9ed3-6ca8156c76eb => generated 1217 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:41:23.004398 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-e150e1aa-67b5-4f69-adb6-bf13386a531a tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:41:23.005001 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-e150e1aa-67b5-4f69-adb6-bf13386a531a tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 4583ce16-fb30-4fc9-9ed3-6ca8156c76eb] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:41:23.012866 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e150e1aa-67b5-4f69-adb6-bf13386a531a tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:41:23.013349 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e150e1aa-67b5-4f69-adb6-bf13386a531a tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:41:23.013793 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e150e1aa-67b5-4f69-adb6-bf13386a531a tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:41:23.014628 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e150e1aa-67b5-4f69-adb6-bf13386a531a tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:41:23.015162 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e150e1aa-67b5-4f69-adb6-bf13386a531a tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:41:23.015594 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e150e1aa-67b5-4f69-adb6-bf13386a531a tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:41:23.150057 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-e150e1aa-67b5-4f69-adb6-bf13386a531a tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:41:23.157646 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-e150e1aa-67b5-4f69-adb6-bf13386a531a tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/4583ce16-fb30-4fc9-9ed3-6ca8156c76eb" status: 200 len: 1217 microversion: 2.1 time: 0.157364 Aug 10 23:41:23.158227 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2984/6173] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:41:22 2022] GET /compute/v2.1/servers/4583ce16-fb30-4fc9-9ed3-6ca8156c76eb => generated 1217 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:41:23.184164 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-7809b6f3-cb99-4309-b9d1-b41e46d6a376 req-8d159bbc-3f83-4963-9a68-c8402386cdcb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4583ce16-fb30-4fc9-9ed3-6ca8156c76eb", "name": "network-vif-plugged", "status": "completed", "tag": "b7a55608-5352-4512-aa12-c167b829963f"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:41:23.195771 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-7809b6f3-cb99-4309-b9d1-b41e46d6a376 req-8d159bbc-3f83-4963-9a68-c8402386cdcb service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:41:23.196266 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-7809b6f3-cb99-4309-b9d1-b41e46d6a376 req-8d159bbc-3f83-4963-9a68-c8402386cdcb service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:41:23.196789 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-7809b6f3-cb99-4309-b9d1-b41e46d6a376 req-8d159bbc-3f83-4963-9a68-c8402386cdcb service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:41:23.207943 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-7809b6f3-cb99-4309-b9d1-b41e46d6a376 req-8d159bbc-3f83-4963-9a68-c8402386cdcb service nova] Creating event network-vif-plugged:b7a55608-5352-4512-aa12-c167b829963f for instance 4583ce16-fb30-4fc9-9ed3-6ca8156c76eb on n-h2-850468-14 Aug 10 23:41:23.213615 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-7809b6f3-cb99-4309-b9d1-b41e46d6a376 req-8d159bbc-3f83-4963-9a68-c8402386cdcb service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033432 Aug 10 23:41:23.214445 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3190/6174] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:41:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:41:24.178448 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-f6a6cacb-34ab-4268-b48e-6a8101492de1 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:41:24.179246 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-f6a6cacb-34ab-4268-b48e-6a8101492de1 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 4583ce16-fb30-4fc9-9ed3-6ca8156c76eb] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:41:24.187553 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f6a6cacb-34ab-4268-b48e-6a8101492de1 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:41:24.188040 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f6a6cacb-34ab-4268-b48e-6a8101492de1 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:41:24.188479 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f6a6cacb-34ab-4268-b48e-6a8101492de1 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:41:24.189175 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f6a6cacb-34ab-4268-b48e-6a8101492de1 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:41:24.189630 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f6a6cacb-34ab-4268-b48e-6a8101492de1 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:41:24.190056 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f6a6cacb-34ab-4268-b48e-6a8101492de1 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:41:24.324534 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-f6a6cacb-34ab-4268-b48e-6a8101492de1 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:41:24.332085 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-f6a6cacb-34ab-4268-b48e-6a8101492de1 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/4583ce16-fb30-4fc9-9ed3-6ca8156c76eb" status: 200 len: 1217 microversion: 2.1 time: 0.157543 Aug 10 23:41:24.332667 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2985/6175] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:41:24 2022] GET /compute/v2.1/servers/4583ce16-fb30-4fc9-9ed3-6ca8156c76eb => generated 1217 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:41:25.355671 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-bbbd80af-880a-4e1d-8c44-b387e276c395 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:41:25.356380 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-bbbd80af-880a-4e1d-8c44-b387e276c395 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 4583ce16-fb30-4fc9-9ed3-6ca8156c76eb] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:41:25.362907 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bbbd80af-880a-4e1d-8c44-b387e276c395 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:41:25.363424 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bbbd80af-880a-4e1d-8c44-b387e276c395 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:41:25.363869 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bbbd80af-880a-4e1d-8c44-b387e276c395 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:41:25.364563 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bbbd80af-880a-4e1d-8c44-b387e276c395 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:41:25.365022 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bbbd80af-880a-4e1d-8c44-b387e276c395 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:41:25.365451 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bbbd80af-880a-4e1d-8c44-b387e276c395 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:41:25.506074 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-bbbd80af-880a-4e1d-8c44-b387e276c395 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:41:25.514642 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-bbbd80af-880a-4e1d-8c44-b387e276c395 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/4583ce16-fb30-4fc9-9ed3-6ca8156c76eb" status: 200 len: 1405 microversion: 2.1 time: 0.164663 Aug 10 23:41:25.515751 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3191/6176] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:41:25 2022] GET /compute/v2.1/servers/4583ce16-fb30-4fc9-9ed3-6ca8156c76eb => generated 1405 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:41:25.535777 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-2d4e2158-a7d0-4dfc-a55a-4891129f6871 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:41:25.537300 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-2d4e2158-a7d0-4dfc-a55a-4891129f6871 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 4583ce16-fb30-4fc9-9ed3-6ca8156c76eb] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:41:25.544791 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2d4e2158-a7d0-4dfc-a55a-4891129f6871 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:41:25.545266 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2d4e2158-a7d0-4dfc-a55a-4891129f6871 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:41:25.545697 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2d4e2158-a7d0-4dfc-a55a-4891129f6871 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:41:25.547030 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2d4e2158-a7d0-4dfc-a55a-4891129f6871 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:41:25.547030 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2d4e2158-a7d0-4dfc-a55a-4891129f6871 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:41:25.547286 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2d4e2158-a7d0-4dfc-a55a-4891129f6871 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:41:25.680106 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-2d4e2158-a7d0-4dfc-a55a-4891129f6871 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:41:25.687859 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-2d4e2158-a7d0-4dfc-a55a-4891129f6871 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/4583ce16-fb30-4fc9-9ed3-6ca8156c76eb" status: 200 len: 1405 microversion: 2.1 time: 0.156234 Aug 10 23:41:25.688436 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2986/6177] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:41:25 2022] GET /compute/v2.1/servers/4583ce16-fb30-4fc9-9ed3-6ca8156c76eb => generated 1405 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:41:25.708345 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-2c246c15-22ca-4a88-b71b-d397f7b08601 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-1283900174"}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:41:25.710705 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-2c246c15-22ca-4a88-b71b-d397f7b08601 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 4583ce16-fb30-4fc9-9ed3-6ca8156c76eb] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:41:25.716767 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2c246c15-22ca-4a88-b71b-d397f7b08601 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:41:25.717253 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2c246c15-22ca-4a88-b71b-d397f7b08601 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:41:25.717698 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2c246c15-22ca-4a88-b71b-d397f7b08601 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:41:25.718391 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2c246c15-22ca-4a88-b71b-d397f7b08601 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:41:25.718868 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2c246c15-22ca-4a88-b71b-d397f7b08601 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:41:25.719292 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2c246c15-22ca-4a88-b71b-d397f7b08601 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:41:25.811037 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.compute.api [None req-2c246c15-22ca-4a88-b71b-d397f7b08601 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 4583ce16-fb30-4fc9-9ed3-6ca8156c76eb] Attempting to quiesce instance before volume snapshot. Aug 10 23:41:25.835939 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.compute.api [None req-2c246c15-22ca-4a88-b71b-d397f7b08601 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 4583ce16-fb30-4fc9-9ed3-6ca8156c76eb] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Aug 10 23:41:25.905540 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-2c246c15-22ca-4a88-b71b-d397f7b08601 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 4583ce16-fb30-4fc9-9ed3-6ca8156c76eb] Creating snapshot from volume 873563bc-a056-4e0c-8880-de009a7c81b2. {{(pid=122633) snapshot_instance /opt/stack/nova/nova/compute/api.py:3456}} Aug 10 23:41:26.817727 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-2c246c15-22ca-4a88-b71b-d397f7b08601 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "POST /compute/v2.1/servers/4583ce16-fb30-4fc9-9ed3-6ca8156c76eb/action" status: 202 len: 0 microversion: 2.1 time: 1.113255 Aug 10 23:41:26.818622 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3192/6178] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:41:25 2022] POST /compute/v2.1/servers/4583ce16-fb30-4fc9-9ed3-6ca8156c76eb/action => generated 0 bytes in 1115 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 10 23:41:27.971895 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-878a615d-c88d-4cca-82e3-6d21a16d0c8d tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-1200149376", "imageRef": "7c474541-f7a1-4a2c-a0cf-4a0fe51cfd34", "flavorRef": "452", "networks": [{"uuid": "5ed0a190-471f-4749-aff5-4f68f1343451"}]}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:41:28.029220 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.network.neutron [None req-878a615d-c88d-4cca-82e3-6d21a16d0c8d tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] validate_networks() for [('5ed0a190-471f-4749-aff5-4f68f1343451', None, None, None, None, None)] {{(pid=122632) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 23:41:28.473650 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-878a615d-c88d-4cca-82e3-6d21a16d0c8d tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Flavor limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:41:28.474107 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-878a615d-c88d-4cca-82e3-6d21a16d0c8d tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Image limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:41:28.474612 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-878a615d-c88d-4cca-82e3-6d21a16d0c8d tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Flavor pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:41:28.475065 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-878a615d-c88d-4cca-82e3-6d21a16d0c8d tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Image pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:41:28.475479 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-878a615d-c88d-4cca-82e3-6d21a16d0c8d tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:41:28.485858 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-878a615d-c88d-4cca-82e3-6d21a16d0c8d tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:41:28.486346 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-878a615d-c88d-4cca-82e3-6d21a16d0c8d tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:41:28.486808 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-878a615d-c88d-4cca-82e3-6d21a16d0c8d tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:41:28.487572 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-878a615d-c88d-4cca-82e3-6d21a16d0c8d tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:41:28.488034 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-878a615d-c88d-4cca-82e3-6d21a16d0c8d tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:41:28.488467 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-878a615d-c88d-4cca-82e3-6d21a16d0c8d tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:41:28.505429 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-878a615d-c88d-4cca-82e3-6d21a16d0c8d tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Getting quotas for project 0b22838d50dd4ea8811953e723d0c052. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:41:28.511342 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-878a615d-c88d-4cca-82e3-6d21a16d0c8d tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Getting quotas for user e97e9cddb55649809a9cd16dbc43bb7e and project 0b22838d50dd4ea8811953e723d0c052. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:41:28.525240 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-878a615d-c88d-4cca-82e3-6d21a16d0c8d tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Going to run 1 instances... {{(pid=122632) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 23:41:28.527845 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-878a615d-c88d-4cca-82e3-6d21a16d0c8d tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: f2bf2a14-97d9-4fa8-a554-3b7ab3c3cb1a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='c629d2ce-e1fe-401a-b767-1221bb3395ff',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=122632) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 23:41:28.604313 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-878a615d-c88d-4cca-82e3-6d21a16d0c8d tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.636171 Aug 10 23:41:28.604975 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2987/6179] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 23:41:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 637 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 23:41:28.617428 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-00ec8dc1-b77d-4359-81fa-afd759de6e6e tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:41:28.618179 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-00ec8dc1-b77d-4359-81fa-afd759de6e6e tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: f2bf2a14-97d9-4fa8-a554-3b7ab3c3cb1a] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:41:28.672470 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-00ec8dc1-b77d-4359-81fa-afd759de6e6e tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:41:28.679968 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-00ec8dc1-b77d-4359-81fa-afd759de6e6e tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/f2bf2a14-97d9-4fa8-a554-3b7ab3c3cb1a" status: 200 len: 1230 microversion: 2.1 time: 0.067510 Aug 10 23:41:28.680553 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3193/6180] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:41:28 2022] GET /compute/v2.1/servers/f2bf2a14-97d9-4fa8-a554-3b7ab3c3cb1a => generated 1230 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:41:29.704402 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-7610a1da-0b35-4082-9f03-56553a799dcf tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:41:29.705061 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-7610a1da-0b35-4082-9f03-56553a799dcf tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: f2bf2a14-97d9-4fa8-a554-3b7ab3c3cb1a] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:41:29.712947 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7610a1da-0b35-4082-9f03-56553a799dcf tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:41:29.713562 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7610a1da-0b35-4082-9f03-56553a799dcf tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:41:29.714007 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7610a1da-0b35-4082-9f03-56553a799dcf tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:41:29.714716 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7610a1da-0b35-4082-9f03-56553a799dcf tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:41:29.715202 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7610a1da-0b35-4082-9f03-56553a799dcf tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:41:29.716394 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7610a1da-0b35-4082-9f03-56553a799dcf tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:41:29.795585 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-7610a1da-0b35-4082-9f03-56553a799dcf tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:41:29.805208 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-7610a1da-0b35-4082-9f03-56553a799dcf tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/f2bf2a14-97d9-4fa8-a554-3b7ab3c3cb1a" status: 200 len: 1300 microversion: 2.1 time: 0.106087 Aug 10 23:41:29.806492 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2988/6181] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:41:29 2022] GET /compute/v2.1/servers/f2bf2a14-97d9-4fa8-a554-3b7ab3c3cb1a => generated 1300 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:41:30.827690 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-44eedeeb-38f4-4d18-81a3-d6b89f57cf10 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:41:30.828952 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-44eedeeb-38f4-4d18-81a3-d6b89f57cf10 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: f2bf2a14-97d9-4fa8-a554-3b7ab3c3cb1a] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:41:30.836982 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-44eedeeb-38f4-4d18-81a3-d6b89f57cf10 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:41:30.837782 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-44eedeeb-38f4-4d18-81a3-d6b89f57cf10 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:41:30.838236 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-44eedeeb-38f4-4d18-81a3-d6b89f57cf10 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:41:30.839158 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-44eedeeb-38f4-4d18-81a3-d6b89f57cf10 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:41:30.839631 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-44eedeeb-38f4-4d18-81a3-d6b89f57cf10 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:41:30.840098 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-44eedeeb-38f4-4d18-81a3-d6b89f57cf10 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:41:31.034008 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-44eedeeb-38f4-4d18-81a3-d6b89f57cf10 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:41:31.045701 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-44eedeeb-38f4-4d18-81a3-d6b89f57cf10 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/f2bf2a14-97d9-4fa8-a554-3b7ab3c3cb1a" status: 200 len: 1342 microversion: 2.1 time: 0.222409 Aug 10 23:41:31.052464 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3194/6182] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:41:30 2022] GET /compute/v2.1/servers/f2bf2a14-97d9-4fa8-a554-3b7ab3c3cb1a => generated 1342 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:41:31.118496 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-471c2cb4-42c1-47a6-a4f6-e261f70e6e9b req-f6a4536f-ebc5-44d0-b442-f74507484be3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2bf2a14-97d9-4fa8-a554-3b7ab3c3cb1a", "tag": "e35e3150-2f79-4786-b4ac-7ab4c74b5d73"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:41:31.147954 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-471c2cb4-42c1-47a6-a4f6-e261f70e6e9b req-f6a4536f-ebc5-44d0-b442-f74507484be3 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:41:31.148512 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-471c2cb4-42c1-47a6-a4f6-e261f70e6e9b req-f6a4536f-ebc5-44d0-b442-f74507484be3 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:41:31.149429 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-471c2cb4-42c1-47a6-a4f6-e261f70e6e9b req-f6a4536f-ebc5-44d0-b442-f74507484be3 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:41:31.164975 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-471c2cb4-42c1-47a6-a4f6-e261f70e6e9b req-f6a4536f-ebc5-44d0-b442-f74507484be3 service nova] Creating event network-changed:e35e3150-2f79-4786-b4ac-7ab4c74b5d73 for instance f2bf2a14-97d9-4fa8-a554-3b7ab3c3cb1a on n-h1-850468-14 Aug 10 23:41:31.170925 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-471c2cb4-42c1-47a6-a4f6-e261f70e6e9b req-f6a4536f-ebc5-44d0-b442-f74507484be3 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058835 Aug 10 23:41:31.171624 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2989/6183] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:41:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:41:32.067244 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-b2d23fd4-d449-458f-8570-a2716d7908a7 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:41:32.068797 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-b2d23fd4-d449-458f-8570-a2716d7908a7 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: f2bf2a14-97d9-4fa8-a554-3b7ab3c3cb1a] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:41:32.076309 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b2d23fd4-d449-458f-8570-a2716d7908a7 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:41:32.077102 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b2d23fd4-d449-458f-8570-a2716d7908a7 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:41:32.077773 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b2d23fd4-d449-458f-8570-a2716d7908a7 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:41:32.078940 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b2d23fd4-d449-458f-8570-a2716d7908a7 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:41:32.079731 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b2d23fd4-d449-458f-8570-a2716d7908a7 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:41:32.080375 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b2d23fd4-d449-458f-8570-a2716d7908a7 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:41:32.243465 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-b2d23fd4-d449-458f-8570-a2716d7908a7 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:41:32.252220 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-b2d23fd4-d449-458f-8570-a2716d7908a7 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/f2bf2a14-97d9-4fa8-a554-3b7ab3c3cb1a" status: 200 len: 1342 microversion: 2.1 time: 0.189018 Aug 10 23:41:32.265596 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3195/6184] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:41:32 2022] GET /compute/v2.1/servers/f2bf2a14-97d9-4fa8-a554-3b7ab3c3cb1a => generated 1342 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:41:33.275178 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-d0600504-0432-4b70-9475-c9eaa28731db tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:41:33.275877 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-d0600504-0432-4b70-9475-c9eaa28731db tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: f2bf2a14-97d9-4fa8-a554-3b7ab3c3cb1a] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:41:33.283548 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d0600504-0432-4b70-9475-c9eaa28731db tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:41:33.284380 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d0600504-0432-4b70-9475-c9eaa28731db tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:41:33.284853 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d0600504-0432-4b70-9475-c9eaa28731db tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:41:33.285751 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d0600504-0432-4b70-9475-c9eaa28731db tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:41:33.286395 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d0600504-0432-4b70-9475-c9eaa28731db tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:41:33.287023 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d0600504-0432-4b70-9475-c9eaa28731db tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:41:33.480174 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-d0600504-0432-4b70-9475-c9eaa28731db tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:41:33.488754 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-d0600504-0432-4b70-9475-c9eaa28731db tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/f2bf2a14-97d9-4fa8-a554-3b7ab3c3cb1a" status: 200 len: 1342 microversion: 2.1 time: 0.217830 Aug 10 23:41:33.503070 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2990/6185] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:41:33 2022] GET /compute/v2.1/servers/f2bf2a14-97d9-4fa8-a554-3b7ab3c3cb1a => generated 1342 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:41:34.516185 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-5de69d49-d06b-4023-af64-abbe9ca8120e tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:41:34.518106 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-5de69d49-d06b-4023-af64-abbe9ca8120e tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: f2bf2a14-97d9-4fa8-a554-3b7ab3c3cb1a] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:41:34.529518 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5de69d49-d06b-4023-af64-abbe9ca8120e tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:41:34.531512 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5de69d49-d06b-4023-af64-abbe9ca8120e tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:41:34.532397 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5de69d49-d06b-4023-af64-abbe9ca8120e tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:41:34.533822 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5de69d49-d06b-4023-af64-abbe9ca8120e tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:41:34.534525 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5de69d49-d06b-4023-af64-abbe9ca8120e tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:41:34.535011 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5de69d49-d06b-4023-af64-abbe9ca8120e tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:41:34.722982 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-5de69d49-d06b-4023-af64-abbe9ca8120e tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:41:34.733265 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-5de69d49-d06b-4023-af64-abbe9ca8120e tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/f2bf2a14-97d9-4fa8-a554-3b7ab3c3cb1a" status: 200 len: 1342 microversion: 2.1 time: 0.221510 Aug 10 23:41:34.733859 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3196/6186] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:41:34 2022] GET /compute/v2.1/servers/f2bf2a14-97d9-4fa8-a554-3b7ab3c3cb1a => generated 1342 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:41:35.775736 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-31e65ed6-67ab-4b4f-8660-f046bd1ae792 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:41:35.776416 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-31e65ed6-67ab-4b4f-8660-f046bd1ae792 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: f2bf2a14-97d9-4fa8-a554-3b7ab3c3cb1a] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:41:35.784280 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-31e65ed6-67ab-4b4f-8660-f046bd1ae792 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:41:35.784788 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-31e65ed6-67ab-4b4f-8660-f046bd1ae792 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:41:35.785219 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-31e65ed6-67ab-4b4f-8660-f046bd1ae792 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:41:35.786128 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-31e65ed6-67ab-4b4f-8660-f046bd1ae792 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:41:35.786647 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-31e65ed6-67ab-4b4f-8660-f046bd1ae792 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:41:35.787039 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-31e65ed6-67ab-4b4f-8660-f046bd1ae792 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:41:35.933113 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-31e65ed6-67ab-4b4f-8660-f046bd1ae792 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:41:35.941791 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-31e65ed6-67ab-4b4f-8660-f046bd1ae792 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/f2bf2a14-97d9-4fa8-a554-3b7ab3c3cb1a" status: 200 len: 1342 microversion: 2.1 time: 0.171169 Aug 10 23:41:35.948955 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2991/6187] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:41:35 2022] GET /compute/v2.1/servers/f2bf2a14-97d9-4fa8-a554-3b7ab3c3cb1a => generated 1342 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:41:36.964510 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-3316432d-3b1b-42f6-9a5f-f599e73a86bc tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:41:36.965148 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-3316432d-3b1b-42f6-9a5f-f599e73a86bc tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: f2bf2a14-97d9-4fa8-a554-3b7ab3c3cb1a] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:41:36.968097 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:41:36.973550 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3316432d-3b1b-42f6-9a5f-f599e73a86bc tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:41:36.974054 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3316432d-3b1b-42f6-9a5f-f599e73a86bc tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:41:36.974540 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3316432d-3b1b-42f6-9a5f-f599e73a86bc tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:41:36.975284 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3316432d-3b1b-42f6-9a5f-f599e73a86bc tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:41:36.976749 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3316432d-3b1b-42f6-9a5f-f599e73a86bc tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:41:36.977203 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3316432d-3b1b-42f6-9a5f-f599e73a86bc tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:41:36.980699 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=81,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:41:37.128115 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-3316432d-3b1b-42f6-9a5f-f599e73a86bc tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:41:37.136179 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-3316432d-3b1b-42f6-9a5f-f599e73a86bc tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/f2bf2a14-97d9-4fa8-a554-3b7ab3c3cb1a" status: 200 len: 1342 microversion: 2.1 time: 0.175908 Aug 10 23:41:37.142842 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3197/6188] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:41:36 2022] GET /compute/v2.1/servers/f2bf2a14-97d9-4fa8-a554-3b7ab3c3cb1a => generated 1342 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:41:38.159314 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-8d66cf57-240f-42f1-b91e-75601cc3f4e5 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:41:38.160046 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-8d66cf57-240f-42f1-b91e-75601cc3f4e5 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: f2bf2a14-97d9-4fa8-a554-3b7ab3c3cb1a] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:41:38.163388 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:41:38.170728 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8d66cf57-240f-42f1-b91e-75601cc3f4e5 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:41:38.171446 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8d66cf57-240f-42f1-b91e-75601cc3f4e5 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:41:38.171950 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8d66cf57-240f-42f1-b91e-75601cc3f4e5 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:41:38.172852 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8d66cf57-240f-42f1-b91e-75601cc3f4e5 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:41:38.173312 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8d66cf57-240f-42f1-b91e-75601cc3f4e5 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:41:38.173766 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8d66cf57-240f-42f1-b91e-75601cc3f4e5 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:41:38.177213 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=77 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:41:38.313739 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-8d66cf57-240f-42f1-b91e-75601cc3f4e5 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:41:38.321653 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-8d66cf57-240f-42f1-b91e-75601cc3f4e5 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/f2bf2a14-97d9-4fa8-a554-3b7ab3c3cb1a" status: 200 len: 1342 microversion: 2.1 time: 0.167935 Aug 10 23:41:38.322232 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2992/6189] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:41:38 2022] GET /compute/v2.1/servers/f2bf2a14-97d9-4fa8-a554-3b7ab3c3cb1a => generated 1342 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:41:39.343505 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-232e56e8-3545-4157-bb17-898e25879b4d tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:41:39.344211 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-232e56e8-3545-4157-bb17-898e25879b4d tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: f2bf2a14-97d9-4fa8-a554-3b7ab3c3cb1a] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:41:39.346913 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=2 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:41:39.353841 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-232e56e8-3545-4157-bb17-898e25879b4d tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:41:39.354339 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-232e56e8-3545-4157-bb17-898e25879b4d tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:41:39.354808 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-232e56e8-3545-4157-bb17-898e25879b4d tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:41:39.355520 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-232e56e8-3545-4157-bb17-898e25879b4d tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:41:39.356225 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-232e56e8-3545-4157-bb17-898e25879b4d tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:41:39.356833 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-232e56e8-3545-4157-bb17-898e25879b4d tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:41:39.512146 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-232e56e8-3545-4157-bb17-898e25879b4d tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:41:39.526297 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-232e56e8-3545-4157-bb17-898e25879b4d tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/f2bf2a14-97d9-4fa8-a554-3b7ab3c3cb1a" status: 200 len: 1342 microversion: 2.1 time: 0.186658 Aug 10 23:41:39.530210 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3198/6190] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:41:39 2022] GET /compute/v2.1/servers/f2bf2a14-97d9-4fa8-a554-3b7ab3c3cb1a => generated 1342 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:41:40.548099 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-37fa8572-0288-4f3a-9d9a-b72c99b2ee73 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:41:40.548845 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-37fa8572-0288-4f3a-9d9a-b72c99b2ee73 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: f2bf2a14-97d9-4fa8-a554-3b7ab3c3cb1a] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:41:40.550934 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=2 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:41:40.551704 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=6 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:41:40.558511 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-37fa8572-0288-4f3a-9d9a-b72c99b2ee73 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:41:40.559059 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-37fa8572-0288-4f3a-9d9a-b72c99b2ee73 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:41:40.559504 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-37fa8572-0288-4f3a-9d9a-b72c99b2ee73 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:41:40.560211 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-37fa8572-0288-4f3a-9d9a-b72c99b2ee73 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:41:40.560678 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-37fa8572-0288-4f3a-9d9a-b72c99b2ee73 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:41:40.561115 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-37fa8572-0288-4f3a-9d9a-b72c99b2ee73 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:41:40.709635 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-37fa8572-0288-4f3a-9d9a-b72c99b2ee73 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:41:40.718757 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-37fa8572-0288-4f3a-9d9a-b72c99b2ee73 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/f2bf2a14-97d9-4fa8-a554-3b7ab3c3cb1a" status: 200 len: 1342 microversion: 2.1 time: 0.174534 Aug 10 23:41:40.719800 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2993/6191] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:41:40 2022] GET /compute/v2.1/servers/f2bf2a14-97d9-4fa8-a554-3b7ab3c3cb1a => generated 1342 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:41:41.739846 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-9575712b-370c-4a81-b0e5-01106146382b tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:41:41.740477 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-9575712b-370c-4a81-b0e5-01106146382b tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: f2bf2a14-97d9-4fa8-a554-3b7ab3c3cb1a] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:41:41.748514 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9575712b-370c-4a81-b0e5-01106146382b tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:41:41.749019 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9575712b-370c-4a81-b0e5-01106146382b tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:41:41.749477 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9575712b-370c-4a81-b0e5-01106146382b tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:41:41.750200 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9575712b-370c-4a81-b0e5-01106146382b tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:41:41.750699 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9575712b-370c-4a81-b0e5-01106146382b tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:41:41.751174 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9575712b-370c-4a81-b0e5-01106146382b tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:41:41.896363 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-9575712b-370c-4a81-b0e5-01106146382b tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:41:41.904915 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-9575712b-370c-4a81-b0e5-01106146382b tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/f2bf2a14-97d9-4fa8-a554-3b7ab3c3cb1a" status: 200 len: 1342 microversion: 2.1 time: 0.168940 Aug 10 23:41:41.905644 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3199/6192] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:41:41 2022] GET /compute/v2.1/servers/f2bf2a14-97d9-4fa8-a554-3b7ab3c3cb1a => generated 1342 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:41:42.925156 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-68073e09-2eb9-4263-b1ec-668417d4a898 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:41:42.925789 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-68073e09-2eb9-4263-b1ec-668417d4a898 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: f2bf2a14-97d9-4fa8-a554-3b7ab3c3cb1a] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:41:42.933937 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-68073e09-2eb9-4263-b1ec-668417d4a898 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:41:42.934421 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-68073e09-2eb9-4263-b1ec-668417d4a898 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:41:42.934884 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-68073e09-2eb9-4263-b1ec-668417d4a898 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:41:42.935588 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-68073e09-2eb9-4263-b1ec-668417d4a898 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:41:42.936037 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-68073e09-2eb9-4263-b1ec-668417d4a898 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:41:42.936469 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-68073e09-2eb9-4263-b1ec-668417d4a898 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:41:43.070834 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-68073e09-2eb9-4263-b1ec-668417d4a898 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:41:43.078568 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-68073e09-2eb9-4263-b1ec-668417d4a898 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/f2bf2a14-97d9-4fa8-a554-3b7ab3c3cb1a" status: 200 len: 1342 microversion: 2.1 time: 0.157298 Aug 10 23:41:43.079491 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2994/6193] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:41:42 2022] GET /compute/v2.1/servers/f2bf2a14-97d9-4fa8-a554-3b7ab3c3cb1a => generated 1342 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:41:44.101477 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c10a5c7d-e947-4f61-abc6-97b2a1bb81ee tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:41:44.102320 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-c10a5c7d-e947-4f61-abc6-97b2a1bb81ee tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: f2bf2a14-97d9-4fa8-a554-3b7ab3c3cb1a] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:41:44.109379 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c10a5c7d-e947-4f61-abc6-97b2a1bb81ee tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:41:44.110137 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c10a5c7d-e947-4f61-abc6-97b2a1bb81ee tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:41:44.110593 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c10a5c7d-e947-4f61-abc6-97b2a1bb81ee tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:41:44.111359 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c10a5c7d-e947-4f61-abc6-97b2a1bb81ee tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:41:44.111832 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c10a5c7d-e947-4f61-abc6-97b2a1bb81ee tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:41:44.112275 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c10a5c7d-e947-4f61-abc6-97b2a1bb81ee tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:41:44.255250 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-c10a5c7d-e947-4f61-abc6-97b2a1bb81ee tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:41:44.263137 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-c10a5c7d-e947-4f61-abc6-97b2a1bb81ee tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/f2bf2a14-97d9-4fa8-a554-3b7ab3c3cb1a" status: 200 len: 1342 microversion: 2.1 time: 0.166272 Aug 10 23:41:44.263743 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3200/6194] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:41:44 2022] GET /compute/v2.1/servers/f2bf2a14-97d9-4fa8-a554-3b7ab3c3cb1a => generated 1342 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:41:45.284466 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-f93be6d6-ff21-4f1b-a7bc-a607a5eab803 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:41:45.285070 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-f93be6d6-ff21-4f1b-a7bc-a607a5eab803 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: f2bf2a14-97d9-4fa8-a554-3b7ab3c3cb1a] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:41:45.292457 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f93be6d6-ff21-4f1b-a7bc-a607a5eab803 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:41:45.292935 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f93be6d6-ff21-4f1b-a7bc-a607a5eab803 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:41:45.293371 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f93be6d6-ff21-4f1b-a7bc-a607a5eab803 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:41:45.294054 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f93be6d6-ff21-4f1b-a7bc-a607a5eab803 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:41:45.294500 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f93be6d6-ff21-4f1b-a7bc-a607a5eab803 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:41:45.294953 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f93be6d6-ff21-4f1b-a7bc-a607a5eab803 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:41:45.433008 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-f93be6d6-ff21-4f1b-a7bc-a607a5eab803 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:41:45.440545 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-f93be6d6-ff21-4f1b-a7bc-a607a5eab803 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/f2bf2a14-97d9-4fa8-a554-3b7ab3c3cb1a" status: 200 len: 1376 microversion: 2.1 time: 0.160104 Aug 10 23:41:45.441131 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2995/6195] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:41:45 2022] GET /compute/v2.1/servers/f2bf2a14-97d9-4fa8-a554-3b7ab3c3cb1a => generated 1376 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:41:46.462133 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-d74cb745-b9df-4e14-ac98-444a32519126 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:41:46.462756 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-d74cb745-b9df-4e14-ac98-444a32519126 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: f2bf2a14-97d9-4fa8-a554-3b7ab3c3cb1a] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:41:46.469713 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d74cb745-b9df-4e14-ac98-444a32519126 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:41:46.470212 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d74cb745-b9df-4e14-ac98-444a32519126 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:41:46.470670 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d74cb745-b9df-4e14-ac98-444a32519126 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:41:46.471431 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d74cb745-b9df-4e14-ac98-444a32519126 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:41:46.471907 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d74cb745-b9df-4e14-ac98-444a32519126 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:41:46.472352 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d74cb745-b9df-4e14-ac98-444a32519126 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:41:46.612770 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-d74cb745-b9df-4e14-ac98-444a32519126 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:41:46.620540 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-d74cb745-b9df-4e14-ac98-444a32519126 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/f2bf2a14-97d9-4fa8-a554-3b7ab3c3cb1a" status: 200 len: 1376 microversion: 2.1 time: 0.162962 Aug 10 23:41:46.621118 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3201/6196] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:41:46 2022] GET /compute/v2.1/servers/f2bf2a14-97d9-4fa8-a554-3b7ab3c3cb1a => generated 1376 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:41:47.641977 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-912f1b60-6990-44dc-b9e3-d776a820068e tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:41:47.642579 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-912f1b60-6990-44dc-b9e3-d776a820068e tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: f2bf2a14-97d9-4fa8-a554-3b7ab3c3cb1a] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:41:47.650031 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-912f1b60-6990-44dc-b9e3-d776a820068e tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:41:47.650509 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-912f1b60-6990-44dc-b9e3-d776a820068e tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:41:47.650993 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-912f1b60-6990-44dc-b9e3-d776a820068e tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:41:47.651679 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-912f1b60-6990-44dc-b9e3-d776a820068e tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:41:47.652128 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-912f1b60-6990-44dc-b9e3-d776a820068e tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:41:47.652546 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-912f1b60-6990-44dc-b9e3-d776a820068e tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:41:47.786353 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-912f1b60-6990-44dc-b9e3-d776a820068e tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:41:47.794217 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-912f1b60-6990-44dc-b9e3-d776a820068e tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/f2bf2a14-97d9-4fa8-a554-3b7ab3c3cb1a" status: 200 len: 1376 microversion: 2.1 time: 0.156176 Aug 10 23:41:47.794794 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2996/6197] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:41:47 2022] GET /compute/v2.1/servers/f2bf2a14-97d9-4fa8-a554-3b7ab3c3cb1a => generated 1376 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:41:48.816278 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-52110db3-e7c8-4b20-9cb6-a7e8ef145adb tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:41:48.816970 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-52110db3-e7c8-4b20-9cb6-a7e8ef145adb tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: f2bf2a14-97d9-4fa8-a554-3b7ab3c3cb1a] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:41:48.824886 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-52110db3-e7c8-4b20-9cb6-a7e8ef145adb tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:41:48.825825 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-52110db3-e7c8-4b20-9cb6-a7e8ef145adb tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:41:48.826597 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-52110db3-e7c8-4b20-9cb6-a7e8ef145adb tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:41:48.827476 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-52110db3-e7c8-4b20-9cb6-a7e8ef145adb tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:41:48.828267 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-52110db3-e7c8-4b20-9cb6-a7e8ef145adb tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:41:48.828751 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-52110db3-e7c8-4b20-9cb6-a7e8ef145adb tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:41:48.965918 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-52110db3-e7c8-4b20-9cb6-a7e8ef145adb tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:41:48.974247 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-52110db3-e7c8-4b20-9cb6-a7e8ef145adb tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/f2bf2a14-97d9-4fa8-a554-3b7ab3c3cb1a" status: 200 len: 1376 microversion: 2.1 time: 0.162369 Aug 10 23:41:48.974839 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3202/6198] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:41:48 2022] GET /compute/v2.1/servers/f2bf2a14-97d9-4fa8-a554-3b7ab3c3cb1a => generated 1376 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:41:49.998746 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-921d93ee-3079-4fad-9325-6e30beb6f145 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:41:49.999484 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-921d93ee-3079-4fad-9325-6e30beb6f145 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: f2bf2a14-97d9-4fa8-a554-3b7ab3c3cb1a] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:41:50.008225 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-921d93ee-3079-4fad-9325-6e30beb6f145 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:41:50.008927 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-921d93ee-3079-4fad-9325-6e30beb6f145 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:41:50.009512 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-921d93ee-3079-4fad-9325-6e30beb6f145 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:41:50.010402 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-921d93ee-3079-4fad-9325-6e30beb6f145 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:41:50.010978 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-921d93ee-3079-4fad-9325-6e30beb6f145 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:41:50.011409 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-921d93ee-3079-4fad-9325-6e30beb6f145 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:41:50.153151 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-921d93ee-3079-4fad-9325-6e30beb6f145 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:41:50.160972 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-921d93ee-3079-4fad-9325-6e30beb6f145 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/f2bf2a14-97d9-4fa8-a554-3b7ab3c3cb1a" status: 200 len: 1376 microversion: 2.1 time: 0.167195 Aug 10 23:41:50.161548 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2997/6199] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:41:49 2022] GET /compute/v2.1/servers/f2bf2a14-97d9-4fa8-a554-3b7ab3c3cb1a => generated 1376 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:41:51.183246 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-6d97081f-356d-4d7a-ae5a-67cf5faa1cd7 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:41:51.184012 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-6d97081f-356d-4d7a-ae5a-67cf5faa1cd7 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: f2bf2a14-97d9-4fa8-a554-3b7ab3c3cb1a] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:41:51.192530 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6d97081f-356d-4d7a-ae5a-67cf5faa1cd7 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:41:51.193266 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6d97081f-356d-4d7a-ae5a-67cf5faa1cd7 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:41:51.193829 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6d97081f-356d-4d7a-ae5a-67cf5faa1cd7 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:41:51.195277 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6d97081f-356d-4d7a-ae5a-67cf5faa1cd7 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:41:51.195876 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6d97081f-356d-4d7a-ae5a-67cf5faa1cd7 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:41:51.196352 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6d97081f-356d-4d7a-ae5a-67cf5faa1cd7 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:41:51.343951 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-6d97081f-356d-4d7a-ae5a-67cf5faa1cd7 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:41:51.353524 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-6d97081f-356d-4d7a-ae5a-67cf5faa1cd7 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/f2bf2a14-97d9-4fa8-a554-3b7ab3c3cb1a" status: 200 len: 1376 microversion: 2.1 time: 0.174656 Aug 10 23:41:51.354332 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3203/6200] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:41:51 2022] GET /compute/v2.1/servers/f2bf2a14-97d9-4fa8-a554-3b7ab3c3cb1a => generated 1376 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:41:52.375314 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-00cb1fb7-717f-4566-bc5c-cc4e274e5d67 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:41:52.375951 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-00cb1fb7-717f-4566-bc5c-cc4e274e5d67 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: f2bf2a14-97d9-4fa8-a554-3b7ab3c3cb1a] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:41:52.383484 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-00cb1fb7-717f-4566-bc5c-cc4e274e5d67 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:41:52.383981 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-00cb1fb7-717f-4566-bc5c-cc4e274e5d67 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:41:52.384431 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-00cb1fb7-717f-4566-bc5c-cc4e274e5d67 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:41:52.385225 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-00cb1fb7-717f-4566-bc5c-cc4e274e5d67 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:41:52.385703 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-00cb1fb7-717f-4566-bc5c-cc4e274e5d67 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:41:52.386131 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-00cb1fb7-717f-4566-bc5c-cc4e274e5d67 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:41:52.521064 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-00cb1fb7-717f-4566-bc5c-cc4e274e5d67 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:41:52.529337 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-00cb1fb7-717f-4566-bc5c-cc4e274e5d67 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/f2bf2a14-97d9-4fa8-a554-3b7ab3c3cb1a" status: 200 len: 1376 microversion: 2.1 time: 0.158000 Aug 10 23:41:52.529914 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2998/6201] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:41:52 2022] GET /compute/v2.1/servers/f2bf2a14-97d9-4fa8-a554-3b7ab3c3cb1a => generated 1376 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:41:53.549644 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-b096c843-dcc5-4273-bdf8-443b134ecc77 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:41:53.550276 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-b096c843-dcc5-4273-bdf8-443b134ecc77 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: f2bf2a14-97d9-4fa8-a554-3b7ab3c3cb1a] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:41:53.557577 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b096c843-dcc5-4273-bdf8-443b134ecc77 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:41:53.558082 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b096c843-dcc5-4273-bdf8-443b134ecc77 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:41:53.558539 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b096c843-dcc5-4273-bdf8-443b134ecc77 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:41:53.559296 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b096c843-dcc5-4273-bdf8-443b134ecc77 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:41:53.559772 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b096c843-dcc5-4273-bdf8-443b134ecc77 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:41:53.560218 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b096c843-dcc5-4273-bdf8-443b134ecc77 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:41:53.697268 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-b096c843-dcc5-4273-bdf8-443b134ecc77 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:41:53.706198 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-b096c843-dcc5-4273-bdf8-443b134ecc77 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/f2bf2a14-97d9-4fa8-a554-3b7ab3c3cb1a" status: 200 len: 1376 microversion: 2.1 time: 0.160533 Aug 10 23:41:53.707027 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3204/6202] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:41:53 2022] GET /compute/v2.1/servers/f2bf2a14-97d9-4fa8-a554-3b7ab3c3cb1a => generated 1376 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:41:54.728767 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-8c4848f3-7f21-4e25-a11d-da0ffcf52fd8 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:41:54.729436 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-8c4848f3-7f21-4e25-a11d-da0ffcf52fd8 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: f2bf2a14-97d9-4fa8-a554-3b7ab3c3cb1a] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:41:54.738032 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8c4848f3-7f21-4e25-a11d-da0ffcf52fd8 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:41:54.738726 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8c4848f3-7f21-4e25-a11d-da0ffcf52fd8 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:41:54.739266 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8c4848f3-7f21-4e25-a11d-da0ffcf52fd8 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:41:54.740197 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8c4848f3-7f21-4e25-a11d-da0ffcf52fd8 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:41:54.740662 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8c4848f3-7f21-4e25-a11d-da0ffcf52fd8 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:41:54.741258 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8c4848f3-7f21-4e25-a11d-da0ffcf52fd8 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:41:54.803566 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-fc84a6b7-6440-402e-a5ee-4d7a4f071a0d req-7bafce5a-d92e-4117-8be5-4bec670ab984 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2bf2a14-97d9-4fa8-a554-3b7ab3c3cb1a", "name": "network-vif-plugged", "status": "completed", "tag": "e35e3150-2f79-4786-b4ac-7ab4c74b5d73"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:41:54.816411 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-fc84a6b7-6440-402e-a5ee-4d7a4f071a0d req-7bafce5a-d92e-4117-8be5-4bec670ab984 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:41:54.816935 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-fc84a6b7-6440-402e-a5ee-4d7a4f071a0d req-7bafce5a-d92e-4117-8be5-4bec670ab984 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:41:54.817485 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-fc84a6b7-6440-402e-a5ee-4d7a4f071a0d req-7bafce5a-d92e-4117-8be5-4bec670ab984 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:41:54.831074 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-fc84a6b7-6440-402e-a5ee-4d7a4f071a0d req-7bafce5a-d92e-4117-8be5-4bec670ab984 service nova] Creating event network-vif-plugged:e35e3150-2f79-4786-b4ac-7ab4c74b5d73 for instance f2bf2a14-97d9-4fa8-a554-3b7ab3c3cb1a on n-h1-850468-14 Aug 10 23:41:54.837554 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-fc84a6b7-6440-402e-a5ee-4d7a4f071a0d req-7bafce5a-d92e-4117-8be5-4bec670ab984 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037764 Aug 10 23:41:54.838334 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3205/6203] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:41:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 23:41:54.912903 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-8c4848f3-7f21-4e25-a11d-da0ffcf52fd8 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:41:54.922350 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-8c4848f3-7f21-4e25-a11d-da0ffcf52fd8 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/f2bf2a14-97d9-4fa8-a554-3b7ab3c3cb1a" status: 200 len: 1376 microversion: 2.1 time: 0.198089 Aug 10 23:41:54.923029 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 2999/6204] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:41:54 2022] GET /compute/v2.1/servers/f2bf2a14-97d9-4fa8-a554-3b7ab3c3cb1a => generated 1376 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:41:55.946185 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-cf1a4bce-0b58-41d2-99dc-75686eae1758 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:41:55.946969 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-cf1a4bce-0b58-41d2-99dc-75686eae1758 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: f2bf2a14-97d9-4fa8-a554-3b7ab3c3cb1a] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:41:55.953930 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cf1a4bce-0b58-41d2-99dc-75686eae1758 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:41:55.954408 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cf1a4bce-0b58-41d2-99dc-75686eae1758 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:41:55.954892 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cf1a4bce-0b58-41d2-99dc-75686eae1758 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:41:55.955670 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cf1a4bce-0b58-41d2-99dc-75686eae1758 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:41:55.956213 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cf1a4bce-0b58-41d2-99dc-75686eae1758 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:41:55.956656 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cf1a4bce-0b58-41d2-99dc-75686eae1758 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:41:56.128257 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-cf1a4bce-0b58-41d2-99dc-75686eae1758 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:41:56.136287 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-cf1a4bce-0b58-41d2-99dc-75686eae1758 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/f2bf2a14-97d9-4fa8-a554-3b7ab3c3cb1a" status: 200 len: 1376 microversion: 2.1 time: 0.195802 Aug 10 23:41:56.136861 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3206/6205] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:41:55 2022] GET /compute/v2.1/servers/f2bf2a14-97d9-4fa8-a554-3b7ab3c3cb1a => generated 1376 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:41:57.158284 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-ed290210-0340-40dd-9741-a2f44938c18a tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:41:57.161237 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-ed290210-0340-40dd-9741-a2f44938c18a tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: f2bf2a14-97d9-4fa8-a554-3b7ab3c3cb1a] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:41:57.169352 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ed290210-0340-40dd-9741-a2f44938c18a tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:41:57.169933 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ed290210-0340-40dd-9741-a2f44938c18a tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:41:57.170379 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ed290210-0340-40dd-9741-a2f44938c18a tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:41:57.171231 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ed290210-0340-40dd-9741-a2f44938c18a tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:41:57.171834 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ed290210-0340-40dd-9741-a2f44938c18a tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:41:57.172252 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ed290210-0340-40dd-9741-a2f44938c18a tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:41:57.315958 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-ed290210-0340-40dd-9741-a2f44938c18a tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:41:57.325761 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-ed290210-0340-40dd-9741-a2f44938c18a tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/f2bf2a14-97d9-4fa8-a554-3b7ab3c3cb1a" status: 200 len: 1563 microversion: 2.1 time: 0.171665 Aug 10 23:41:57.326459 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3000/6206] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:41:57 2022] GET /compute/v2.1/servers/f2bf2a14-97d9-4fa8-a554-3b7ab3c3cb1a => generated 1563 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:41:57.347679 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-a907180b-3a53-4ef9-894f-40705fb8946f tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:41:57.348354 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-a907180b-3a53-4ef9-894f-40705fb8946f tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: f2bf2a14-97d9-4fa8-a554-3b7ab3c3cb1a] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:41:57.359185 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a907180b-3a53-4ef9-894f-40705fb8946f tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:41:57.360232 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a907180b-3a53-4ef9-894f-40705fb8946f tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:41:57.360697 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a907180b-3a53-4ef9-894f-40705fb8946f tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:41:57.361602 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a907180b-3a53-4ef9-894f-40705fb8946f tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:41:57.362218 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a907180b-3a53-4ef9-894f-40705fb8946f tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:41:57.362774 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a907180b-3a53-4ef9-894f-40705fb8946f tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:41:57.536636 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-a907180b-3a53-4ef9-894f-40705fb8946f tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:41:57.545265 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-a907180b-3a53-4ef9-894f-40705fb8946f tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/f2bf2a14-97d9-4fa8-a554-3b7ab3c3cb1a" status: 200 len: 1563 microversion: 2.1 time: 0.201817 Aug 10 23:41:57.545857 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3207/6207] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:41:57 2022] GET /compute/v2.1/servers/f2bf2a14-97d9-4fa8-a554-3b7ab3c3cb1a => generated 1563 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:41:57.631574 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-aa77908b-a0d8-4172-9dda-4156ead7f7f5 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:41:57.632271 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-aa77908b-a0d8-4172-9dda-4156ead7f7f5 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: f2bf2a14-97d9-4fa8-a554-3b7ab3c3cb1a] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:41:57.638640 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-aa77908b-a0d8-4172-9dda-4156ead7f7f5 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:41:57.639164 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-aa77908b-a0d8-4172-9dda-4156ead7f7f5 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:41:57.639607 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-aa77908b-a0d8-4172-9dda-4156ead7f7f5 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:41:57.640406 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-aa77908b-a0d8-4172-9dda-4156ead7f7f5 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:41:57.640972 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-aa77908b-a0d8-4172-9dda-4156ead7f7f5 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:41:57.641407 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-aa77908b-a0d8-4172-9dda-4156ead7f7f5 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:41:57.671839 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-aa77908b-a0d8-4172-9dda-4156ead7f7f5 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: f2bf2a14-97d9-4fa8-a554-3b7ab3c3cb1a] Going to try to terminate instance {{(pid=122632) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:41:57.764722 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-aa77908b-a0d8-4172-9dda-4156ead7f7f5 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "DELETE /compute/v2.1/servers/f2bf2a14-97d9-4fa8-a554-3b7ab3c3cb1a" status: 204 len: 0 microversion: 2.1 time: 0.136547 Aug 10 23:41:57.765654 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3001/6208] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:41:57 2022] DELETE /compute/v2.1/servers/f2bf2a14-97d9-4fa8-a554-3b7ab3c3cb1a => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:41:57.776914 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-8c2f316a-1426-44a6-9c59-e5355326018c tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:41:57.777675 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-8c2f316a-1426-44a6-9c59-e5355326018c tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: f2bf2a14-97d9-4fa8-a554-3b7ab3c3cb1a] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:41:57.784279 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8c2f316a-1426-44a6-9c59-e5355326018c tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:41:57.784772 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8c2f316a-1426-44a6-9c59-e5355326018c tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:41:57.785221 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8c2f316a-1426-44a6-9c59-e5355326018c tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:41:57.785948 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8c2f316a-1426-44a6-9c59-e5355326018c tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:41:57.786412 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8c2f316a-1426-44a6-9c59-e5355326018c tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:41:57.786879 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8c2f316a-1426-44a6-9c59-e5355326018c tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:41:57.932683 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-8c2f316a-1426-44a6-9c59-e5355326018c tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:41:57.940449 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-8c2f316a-1426-44a6-9c59-e5355326018c tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/f2bf2a14-97d9-4fa8-a554-3b7ab3c3cb1a" status: 200 len: 1569 microversion: 2.1 time: 0.169860 Aug 10 23:41:57.941020 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3208/6209] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:41:57 2022] GET /compute/v2.1/servers/f2bf2a14-97d9-4fa8-a554-3b7ab3c3cb1a => generated 1569 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:41:58.965447 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-6f79d527-bbd3-4821-900b-088da0480c0b tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:41:58.966851 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-6f79d527-bbd3-4821-900b-088da0480c0b tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: f2bf2a14-97d9-4fa8-a554-3b7ab3c3cb1a] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:41:58.973790 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6f79d527-bbd3-4821-900b-088da0480c0b tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:41:58.974280 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6f79d527-bbd3-4821-900b-088da0480c0b tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:41:58.974866 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6f79d527-bbd3-4821-900b-088da0480c0b tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:41:58.975589 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6f79d527-bbd3-4821-900b-088da0480c0b tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:41:58.976855 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6f79d527-bbd3-4821-900b-088da0480c0b tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:41:58.977484 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6f79d527-bbd3-4821-900b-088da0480c0b tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:41:59.120577 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-6f79d527-bbd3-4821-900b-088da0480c0b tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:41:59.129141 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-6f79d527-bbd3-4821-900b-088da0480c0b tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/f2bf2a14-97d9-4fa8-a554-3b7ab3c3cb1a" status: 200 len: 1569 microversion: 2.1 time: 0.169185 Aug 10 23:41:59.129763 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3002/6210] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:41:58 2022] GET /compute/v2.1/servers/f2bf2a14-97d9-4fa8-a554-3b7ab3c3cb1a => generated 1569 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:41:59.891818 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-1e584a24-0d24-4e27-aec8-3056c2a70755 req-9f89ba16-a4e4-4828-b74d-a87fef65c64c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2bf2a14-97d9-4fa8-a554-3b7ab3c3cb1a", "name": "network-vif-deleted", "tag": "e35e3150-2f79-4786-b4ac-7ab4c74b5d73"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:41:59.907600 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-1e584a24-0d24-4e27-aec8-3056c2a70755 req-9f89ba16-a4e4-4828-b74d-a87fef65c64c service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:41:59.908405 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-1e584a24-0d24-4e27-aec8-3056c2a70755 req-9f89ba16-a4e4-4828-b74d-a87fef65c64c service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:41:59.909152 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-1e584a24-0d24-4e27-aec8-3056c2a70755 req-9f89ba16-a4e4-4828-b74d-a87fef65c64c service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:41:59.923422 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-1e584a24-0d24-4e27-aec8-3056c2a70755 req-9f89ba16-a4e4-4828-b74d-a87fef65c64c service nova] Creating event network-vif-deleted:e35e3150-2f79-4786-b4ac-7ab4c74b5d73 for instance f2bf2a14-97d9-4fa8-a554-3b7ab3c3cb1a on n-h1-850468-14 Aug 10 23:41:59.929632 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-1e584a24-0d24-4e27-aec8-3056c2a70755 req-9f89ba16-a4e4-4828-b74d-a87fef65c64c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.214615 Aug 10 23:41:59.930952 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3209/6211] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:41:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:42:00.153739 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-6a1e4265-2b63-4eb5-aed3-34715a32aea1 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:42:00.154312 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-6a1e4265-2b63-4eb5-aed3-34715a32aea1 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: f2bf2a14-97d9-4fa8-a554-3b7ab3c3cb1a] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:42:00.161364 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6a1e4265-2b63-4eb5-aed3-34715a32aea1 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:42:00.161847 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6a1e4265-2b63-4eb5-aed3-34715a32aea1 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:42:00.162279 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6a1e4265-2b63-4eb5-aed3-34715a32aea1 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:42:00.163779 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6a1e4265-2b63-4eb5-aed3-34715a32aea1 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:42:00.164238 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6a1e4265-2b63-4eb5-aed3-34715a32aea1 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:42:00.164826 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6a1e4265-2b63-4eb5-aed3-34715a32aea1 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:42:00.231423 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-6a1e4265-2b63-4eb5-aed3-34715a32aea1 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:42:00.239577 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-6a1e4265-2b63-4eb5-aed3-34715a32aea1 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/f2bf2a14-97d9-4fa8-a554-3b7ab3c3cb1a" status: 200 len: 1361 microversion: 2.1 time: 0.089864 Aug 10 23:42:00.240150 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3003/6212] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:42:00 2022] GET /compute/v2.1/servers/f2bf2a14-97d9-4fa8-a554-3b7ab3c3cb1a => generated 1361 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:42:01.261999 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-eb351892-eaa7-4a50-9f37-5d950043cf65 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:42:01.262861 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-eb351892-eaa7-4a50-9f37-5d950043cf65 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: f2bf2a14-97d9-4fa8-a554-3b7ab3c3cb1a] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:42:01.270269 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-eb351892-eaa7-4a50-9f37-5d950043cf65 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:42:01.270775 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-eb351892-eaa7-4a50-9f37-5d950043cf65 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:42:01.271256 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-eb351892-eaa7-4a50-9f37-5d950043cf65 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:42:01.271981 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-eb351892-eaa7-4a50-9f37-5d950043cf65 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:42:01.272966 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-eb351892-eaa7-4a50-9f37-5d950043cf65 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:42:01.273617 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-eb351892-eaa7-4a50-9f37-5d950043cf65 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:42:01.338651 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-eb351892-eaa7-4a50-9f37-5d950043cf65 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:42:01.346720 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-eb351892-eaa7-4a50-9f37-5d950043cf65 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/f2bf2a14-97d9-4fa8-a554-3b7ab3c3cb1a" status: 200 len: 1361 microversion: 2.1 time: 0.089397 Aug 10 23:42:01.347266 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3210/6213] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:42:01 2022] GET /compute/v2.1/servers/f2bf2a14-97d9-4fa8-a554-3b7ab3c3cb1a => generated 1361 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:42:02.368824 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-247092c9-0545-4fdb-8046-d8fc49dcb467 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:42:02.369428 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-247092c9-0545-4fdb-8046-d8fc49dcb467 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: f2bf2a14-97d9-4fa8-a554-3b7ab3c3cb1a] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:42:02.376497 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-247092c9-0545-4fdb-8046-d8fc49dcb467 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:42:02.376985 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-247092c9-0545-4fdb-8046-d8fc49dcb467 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:42:02.377424 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-247092c9-0545-4fdb-8046-d8fc49dcb467 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:42:02.378132 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-247092c9-0545-4fdb-8046-d8fc49dcb467 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:42:02.378585 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-247092c9-0545-4fdb-8046-d8fc49dcb467 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:42:02.379038 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-247092c9-0545-4fdb-8046-d8fc49dcb467 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:42:02.443649 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-247092c9-0545-4fdb-8046-d8fc49dcb467 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:42:02.453212 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-247092c9-0545-4fdb-8046-d8fc49dcb467 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/f2bf2a14-97d9-4fa8-a554-3b7ab3c3cb1a" status: 200 len: 1361 microversion: 2.1 time: 0.088891 Aug 10 23:42:02.454116 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3004/6214] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:42:02 2022] GET /compute/v2.1/servers/f2bf2a14-97d9-4fa8-a554-3b7ab3c3cb1a => generated 1361 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:42:03.476463 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-cfbed995-193c-4cca-8658-90e00d925623 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:42:03.477240 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-cfbed995-193c-4cca-8658-90e00d925623 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: f2bf2a14-97d9-4fa8-a554-3b7ab3c3cb1a] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:42:03.483719 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cfbed995-193c-4cca-8658-90e00d925623 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:42:03.484239 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cfbed995-193c-4cca-8658-90e00d925623 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:42:03.484681 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cfbed995-193c-4cca-8658-90e00d925623 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:42:03.485651 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cfbed995-193c-4cca-8658-90e00d925623 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:42:03.486117 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cfbed995-193c-4cca-8658-90e00d925623 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:42:03.486559 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cfbed995-193c-4cca-8658-90e00d925623 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:42:03.551758 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-cfbed995-193c-4cca-8658-90e00d925623 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:42:03.561981 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-cfbed995-193c-4cca-8658-90e00d925623 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/f2bf2a14-97d9-4fa8-a554-3b7ab3c3cb1a" status: 200 len: 1361 microversion: 2.1 time: 0.090290 Aug 10 23:42:03.562609 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3211/6215] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:42:03 2022] GET /compute/v2.1/servers/f2bf2a14-97d9-4fa8-a554-3b7ab3c3cb1a => generated 1361 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:42:04.583777 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-ad1973fe-2a2e-407f-a166-9e1c9fb07c77 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:42:04.584314 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-ad1973fe-2a2e-407f-a166-9e1c9fb07c77 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: f2bf2a14-97d9-4fa8-a554-3b7ab3c3cb1a] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:42:04.593450 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ad1973fe-2a2e-407f-a166-9e1c9fb07c77 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:42:04.593949 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ad1973fe-2a2e-407f-a166-9e1c9fb07c77 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:42:04.594428 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ad1973fe-2a2e-407f-a166-9e1c9fb07c77 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:42:04.595198 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ad1973fe-2a2e-407f-a166-9e1c9fb07c77 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:42:04.595833 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ad1973fe-2a2e-407f-a166-9e1c9fb07c77 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:42:04.596285 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ad1973fe-2a2e-407f-a166-9e1c9fb07c77 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:42:04.611572 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-ad1973fe-2a2e-407f-a166-9e1c9fb07c77 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] HTTP exception thrown: Instance f2bf2a14-97d9-4fa8-a554-3b7ab3c3cb1a could not be found. Aug 10 23:42:04.613261 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-ad1973fe-2a2e-407f-a166-9e1c9fb07c77 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Request method failure captured: Aug 10 23:42:04.613261 n-d-850468-14 devstack@n-api.service[122632]: request: GET /compute/v2.1/servers/f2bf2a14-97d9-4fa8-a554-3b7ab3c3cb1a HTTP/1.1 Aug 10 23:42:04.613261 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:42:04.613261 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:42:04.613261 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:42:04.613261 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 23:42:04.613261 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:42:04.613261 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:42:04.613261 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:42:04.613261 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:42:04.613261 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9EF3JcALvIu97mWIb2swBcyDTxDI5PJ3vU9Ry5AtFPunVTcpAqQQUjRv0EmIlEp13u4BOFv0aTDkpyifGo3ChPE2BfANGKPVxkJ3JhuTa-9TLVCXxNdBMfkJGfbXf6wm_Y7u9vFxLHJ5-XazgQxDfOp_ueAQ4sa5cZKpoVrdkbUR3Jc Aug 10 23:42:04.613261 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:42:04.613261 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:42:04.613261 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:42:04.613261 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:42:04.613261 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:42:04.613261 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:42:04.613261 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 0b22838d50dd4ea8811953e723d0c052 Aug 10 23:42:04.613261 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-TestVolumeBootPattern-991439424 Aug 10 23:42:04.613261 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:42:04.613261 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:42:04.613261 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0b22838d50dd4ea8811953e723d0c052"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0b22838d50dd4ea8811953e723d0c052"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/0b22838d50dd4ea8811953e723d0c052"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_0b22838d50dd4ea8811953e723d0c052", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:42:04.613261 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-TestVolumeBootPattern-991439424 Aug 10 23:42:04.613261 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 0b22838d50dd4ea8811953e723d0c052 Aug 10 23:42:04.613261 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-TestVolumeBootPattern-991439424 Aug 10 23:42:04.613261 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-TestVolumeBootPattern-991439424-project Aug 10 23:42:04.613261 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:42:04.613261 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:42:04.613261 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: e97e9cddb55649809a9cd16dbc43bb7e Aug 10 23:42:04.613261 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-TestVolumeBootPattern-991439424-project Aug 10 23:42:04.613261 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:42:04.613261 n-d-850468-14 devstack@n-api.service[122632]: exception: Instance f2bf2a14-97d9-4fa8-a554-3b7ab3c3cb1a could not be found. Aug 10 23:42:04.613261 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': 'f2bf2a14-97d9-4fa8-a554-3b7ab3c3cb1a'} Aug 10 23:42:04.613261 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:42:04.613261 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:42:04.613261 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:42:04.613261 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:42:04.613261 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:42:04.613261 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:42:04.613261 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:42:04.613261 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:42:04.613261 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:42:04.613261 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:42:04.613261 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2bf2a14-97d9-4fa8-a554-3b7ab3c3cb1a could not be found. Aug 10 23:42:04.613261 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:42:04.613261 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:42:04.613261 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:42:04.613261 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:42:04.613261 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:42:04.613261 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:42:04.613261 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:42:04.613261 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:42:04.613261 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:42:04.613261 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:42:04.613261 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:42:04.613261 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:42:04.613261 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:42:04.613261 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:42:04.613261 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:42:04.613261 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:42:04.613261 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2bf2a14-97d9-4fa8-a554-3b7ab3c3cb1a could not be found. Aug 10 23:42:04.613261 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:42:04.613261 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:42:04.613261 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:42:04.619474 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:42:04.619474 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:42:04.619474 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:42:04.619474 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:42:04.619474 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:42:04.619474 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2bf2a14-97d9-4fa8-a554-3b7ab3c3cb1a could not be found. Aug 10 23:42:04.619474 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:42:04.619474 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-ad1973fe-2a2e-407f-a166-9e1c9fb07c77 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Returning 404 to user: Instance f2bf2a14-97d9-4fa8-a554-3b7ab3c3cb1a could not be found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:42:04.619474 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-ad1973fe-2a2e-407f-a166-9e1c9fb07c77 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/f2bf2a14-97d9-4fa8-a554-3b7ab3c3cb1a" status: 404 len: 111 microversion: 2.1 time: 0.035142 Aug 10 23:42:04.619474 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3005/6216] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:42:04 2022] GET /compute/v2.1/servers/f2bf2a14-97d9-4fa8-a554-3b7ab3c3cb1a => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:42:06.077338 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-cddd4636-d5d0-4c53-84a6-f83a37ac16a7 tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:42:06.077946 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-cddd4636-d5d0-4c53-84a6-f83a37ac16a7 tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] [instance: 8bd23351-3cb0-423c-ba5e-33a8ba3c3db4] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:42:06.085526 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cddd4636-d5d0-4c53-84a6-f83a37ac16a7 tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:42:06.085712 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cddd4636-d5d0-4c53-84a6-f83a37ac16a7 tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:42:06.086130 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cddd4636-d5d0-4c53-84a6-f83a37ac16a7 tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:42:06.086930 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cddd4636-d5d0-4c53-84a6-f83a37ac16a7 tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:42:06.087422 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cddd4636-d5d0-4c53-84a6-f83a37ac16a7 tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:42:06.087865 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cddd4636-d5d0-4c53-84a6-f83a37ac16a7 tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:42:06.118076 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-cddd4636-d5d0-4c53-84a6-f83a37ac16a7 tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] [instance: 8bd23351-3cb0-423c-ba5e-33a8ba3c3db4] Going to try to terminate instance {{(pid=122633) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:42:06.207661 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-cddd4636-d5d0-4c53-84a6-f83a37ac16a7 tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] 10.222.0.58 "DELETE /compute/v2.1/servers/8bd23351-3cb0-423c-ba5e-33a8ba3c3db4" status: 204 len: 0 microversion: 2.1 time: 0.134027 Aug 10 23:42:06.212640 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3212/6217] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:42:06 2022] DELETE /compute/v2.1/servers/8bd23351-3cb0-423c-ba5e-33a8ba3c3db4 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:42:06.217963 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-7d94a206-ae77-4fd7-80d9-84e71471fbe9 tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:42:06.218648 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-7d94a206-ae77-4fd7-80d9-84e71471fbe9 tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] [instance: 8bd23351-3cb0-423c-ba5e-33a8ba3c3db4] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:42:06.226417 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7d94a206-ae77-4fd7-80d9-84e71471fbe9 tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:42:06.227226 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7d94a206-ae77-4fd7-80d9-84e71471fbe9 tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:42:06.227610 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7d94a206-ae77-4fd7-80d9-84e71471fbe9 tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:42:06.228310 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7d94a206-ae77-4fd7-80d9-84e71471fbe9 tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:42:06.228866 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7d94a206-ae77-4fd7-80d9-84e71471fbe9 tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:42:06.229431 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7d94a206-ae77-4fd7-80d9-84e71471fbe9 tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:42:06.376203 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-7d94a206-ae77-4fd7-80d9-84e71471fbe9 tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5115cfabf810465289e5a21b926bce6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0de2d097a542e9b80d9bcb87299467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:42:06.384254 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-7d94a206-ae77-4fd7-80d9-84e71471fbe9 tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] 10.222.0.58 "GET /compute/v2.1/servers/8bd23351-3cb0-423c-ba5e-33a8ba3c3db4" status: 200 len: 1731 microversion: 2.1 time: 0.170194 Aug 10 23:42:06.384889 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3006/6218] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:42:06 2022] GET /compute/v2.1/servers/8bd23351-3cb0-423c-ba5e-33a8ba3c3db4 => generated 1731 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:42:07.521024 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-5c01e584-6a92-4557-898e-3cbab62e4855 tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:42:07.521544 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-5c01e584-6a92-4557-898e-3cbab62e4855 tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] [instance: 8bd23351-3cb0-423c-ba5e-33a8ba3c3db4] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:42:07.527109 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:42:07.529157 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5c01e584-6a92-4557-898e-3cbab62e4855 tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:42:07.529560 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5c01e584-6a92-4557-898e-3cbab62e4855 tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:42:07.530021 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5c01e584-6a92-4557-898e-3cbab62e4855 tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:42:07.530756 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5c01e584-6a92-4557-898e-3cbab62e4855 tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:42:07.531611 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5c01e584-6a92-4557-898e-3cbab62e4855 tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:42:07.532008 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5c01e584-6a92-4557-898e-3cbab62e4855 tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:42:07.539979 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:42:07.805809 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-5c01e584-6a92-4557-898e-3cbab62e4855 tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5115cfabf810465289e5a21b926bce6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0de2d097a542e9b80d9bcb87299467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:42:07.824784 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-5c01e584-6a92-4557-898e-3cbab62e4855 tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] 10.222.0.58 "GET /compute/v2.1/servers/8bd23351-3cb0-423c-ba5e-33a8ba3c3db4" status: 200 len: 1731 microversion: 2.1 time: 0.422317 Aug 10 23:42:07.826277 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3213/6219] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:42:07 2022] GET /compute/v2.1/servers/8bd23351-3cb0-423c-ba5e-33a8ba3c3db4 => generated 1731 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:42:08.675680 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-5e275fa9-fc7d-4891-b5fc-f25eca9fbde4 req-7fc668e3-b721-475f-9e74-f489d2276a71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8bd23351-3cb0-423c-ba5e-33a8ba3c3db4", "name": "network-vif-deleted", "tag": "2980f5cb-3090-4531-8d5e-04c67cae8340"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:42:08.684437 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:42:08.693286 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-5e275fa9-fc7d-4891-b5fc-f25eca9fbde4 req-7fc668e3-b721-475f-9e74-f489d2276a71 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:42:08.694249 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-5e275fa9-fc7d-4891-b5fc-f25eca9fbde4 req-7fc668e3-b721-475f-9e74-f489d2276a71 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:42:08.695606 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-5e275fa9-fc7d-4891-b5fc-f25eca9fbde4 req-7fc668e3-b721-475f-9e74-f489d2276a71 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:42:08.701889 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:42:08.713432 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-5e275fa9-fc7d-4891-b5fc-f25eca9fbde4 req-7fc668e3-b721-475f-9e74-f489d2276a71 service nova] Creating event network-vif-deleted:2980f5cb-3090-4531-8d5e-04c67cae8340 for instance 8bd23351-3cb0-423c-ba5e-33a8ba3c3db4 on n-h1-850468-14 Aug 10 23:42:08.721169 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-5e275fa9-fc7d-4891-b5fc-f25eca9fbde4 req-7fc668e3-b721-475f-9e74-f489d2276a71 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049139 Aug 10 23:42:08.728433 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3007/6220] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:42:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:42:08.849737 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-77c14776-ca80-4044-9737-423e30095847 tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:42:08.851852 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-77c14776-ca80-4044-9737-423e30095847 tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] [instance: 8bd23351-3cb0-423c-ba5e-33a8ba3c3db4] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:42:08.860871 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-77c14776-ca80-4044-9737-423e30095847 tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:42:08.861883 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-77c14776-ca80-4044-9737-423e30095847 tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:42:08.863383 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-77c14776-ca80-4044-9737-423e30095847 tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:42:08.864398 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-77c14776-ca80-4044-9737-423e30095847 tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:42:08.865269 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-77c14776-ca80-4044-9737-423e30095847 tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:42:08.865889 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-77c14776-ca80-4044-9737-423e30095847 tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:42:08.912730 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-77c14776-ca80-4044-9737-423e30095847 tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:42:08.914356 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-77c14776-ca80-4044-9737-423e30095847 tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:42:08.915209 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-77c14776-ca80-4044-9737-423e30095847 tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:42:08.915871 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.objects.instance [None req-77c14776-ca80-4044-9737-423e30095847 tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Lazy-loading 'fault' on Instance uuid 8bd23351-3cb0-423c-ba5e-33a8ba3c3db4 {{(pid=122633) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:42:08.980530 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-77c14776-ca80-4044-9737-423e30095847 tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5115cfabf810465289e5a21b926bce6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce0de2d097a542e9b80d9bcb87299467', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:42:08.990366 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-77c14776-ca80-4044-9737-423e30095847 tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] 10.222.0.58 "GET /compute/v2.1/servers/8bd23351-3cb0-423c-ba5e-33a8ba3c3db4" status: 200 len: 1387 microversion: 2.1 time: 0.145772 Aug 10 23:42:08.992032 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3214/6221] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:42:08 2022] GET /compute/v2.1/servers/8bd23351-3cb0-423c-ba5e-33a8ba3c3db4 => generated 1387 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:42:09.998385 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-a6866374-3754-4e13-a652-445561b5d748 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:42:09.999043 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-a6866374-3754-4e13-a652-445561b5d748 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 4583ce16-fb30-4fc9-9ed3-6ca8156c76eb] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:42:10.006364 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a6866374-3754-4e13-a652-445561b5d748 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:42:10.008854 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a6866374-3754-4e13-a652-445561b5d748 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:42:10.009308 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a6866374-3754-4e13-a652-445561b5d748 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:42:10.010029 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a6866374-3754-4e13-a652-445561b5d748 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:42:10.010489 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a6866374-3754-4e13-a652-445561b5d748 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:42:10.010950 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a6866374-3754-4e13-a652-445561b5d748 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:42:10.014360 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-690eb144-be47-4c50-8236-28904c86d596 tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:42:10.015117 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-690eb144-be47-4c50-8236-28904c86d596 tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] [instance: 8bd23351-3cb0-423c-ba5e-33a8ba3c3db4] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:42:10.022329 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-690eb144-be47-4c50-8236-28904c86d596 tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:42:10.023258 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-690eb144-be47-4c50-8236-28904c86d596 tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:42:10.023981 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-690eb144-be47-4c50-8236-28904c86d596 tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:42:10.024810 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-690eb144-be47-4c50-8236-28904c86d596 tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:42:10.025346 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-690eb144-be47-4c50-8236-28904c86d596 tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:42:10.026061 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-690eb144-be47-4c50-8236-28904c86d596 tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:42:10.040539 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-a6866374-3754-4e13-a652-445561b5d748 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 4583ce16-fb30-4fc9-9ed3-6ca8156c76eb] Going to try to terminate instance {{(pid=122632) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:42:10.048930 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-690eb144-be47-4c50-8236-28904c86d596 tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] HTTP exception thrown: Instance 8bd23351-3cb0-423c-ba5e-33a8ba3c3db4 could not be found. Aug 10 23:42:10.050803 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-690eb144-be47-4c50-8236-28904c86d596 tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Request method failure captured: Aug 10 23:42:10.050803 n-d-850468-14 devstack@n-api.service[122633]: request: GET /compute/v2.1/servers/8bd23351-3cb0-423c-ba5e-33a8ba3c3db4 HTTP/1.1 Aug 10 23:42:10.050803 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:42:10.050803 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:42:10.050803 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:42:10.050803 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:42:10.050803 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:42:10.050803 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:42:10.050803 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:42:10.050803 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:42:10.050803 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9EEbaLLFf0qA6XysW2D_a1fFbaZyAcsbzZg9_BcQLG-FZLBvmQQI9CiBveRc_g-Gl8P1RM1LaGtTdgM2UAzwtHd0L4H6Cg3-aCKL3aondr4nQtjErrxxxxVF8c4B9DAgR3bQ0oQkyGm34htob8VS21YrqVB2zCdDHLFhNW_Sv0k8duc Aug 10 23:42:10.050803 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:42:10.050803 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:42:10.050803 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:42:10.050803 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:42:10.050803 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:42:10.050803 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:42:10.050803 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: ce0de2d097a542e9b80d9bcb87299467 Aug 10 23:42:10.050803 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-TestServerBasicOps-1588570670 Aug 10 23:42:10.050803 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:42:10.050803 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:42:10.050803 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ce0de2d097a542e9b80d9bcb87299467"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ce0de2d097a542e9b80d9bcb87299467"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ce0de2d097a542e9b80d9bcb87299467"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ce0de2d097a542e9b80d9bcb87299467", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:42:10.050803 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-TestServerBasicOps-1588570670 Aug 10 23:42:10.050803 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: ce0de2d097a542e9b80d9bcb87299467 Aug 10 23:42:10.050803 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-TestServerBasicOps-1588570670 Aug 10 23:42:10.050803 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-TestServerBasicOps-1588570670-project Aug 10 23:42:10.050803 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:42:10.050803 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:42:10.050803 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 5115cfabf810465289e5a21b926bce6c Aug 10 23:42:10.050803 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-TestServerBasicOps-1588570670-project Aug 10 23:42:10.050803 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:42:10.050803 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance 8bd23351-3cb0-423c-ba5e-33a8ba3c3db4 could not be found. Aug 10 23:42:10.050803 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': '8bd23351-3cb0-423c-ba5e-33a8ba3c3db4'} Aug 10 23:42:10.050803 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:42:10.050803 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:42:10.050803 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:42:10.050803 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:42:10.050803 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:42:10.050803 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:42:10.050803 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:42:10.050803 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:42:10.050803 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:42:10.050803 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:42:10.050803 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8bd23351-3cb0-423c-ba5e-33a8ba3c3db4 could not be found. Aug 10 23:42:10.050803 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:42:10.050803 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:42:10.050803 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:42:10.050803 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:42:10.050803 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:42:10.050803 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:42:10.050803 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:42:10.050803 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:42:10.050803 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:42:10.050803 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:42:10.050803 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:42:10.050803 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:42:10.050803 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:42:10.050803 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:42:10.050803 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:42:10.050803 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:42:10.050803 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8bd23351-3cb0-423c-ba5e-33a8ba3c3db4 could not be found. Aug 10 23:42:10.050803 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:42:10.050803 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:42:10.050803 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:42:10.057604 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:42:10.057604 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:42:10.057604 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:42:10.057604 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:42:10.057604 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:42:10.057604 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8bd23351-3cb0-423c-ba5e-33a8ba3c3db4 could not be found. Aug 10 23:42:10.057604 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:42:10.057604 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-690eb144-be47-4c50-8236-28904c86d596 tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Returning 404 to user: Instance 8bd23351-3cb0-423c-ba5e-33a8ba3c3db4 could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:42:10.057604 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-690eb144-be47-4c50-8236-28904c86d596 tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] 10.222.0.58 "GET /compute/v2.1/servers/8bd23351-3cb0-423c-ba5e-33a8ba3c3db4" status: 404 len: 111 microversion: 2.1 time: 0.045641 Aug 10 23:42:10.057604 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3215/6222] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:42:10 2022] GET /compute/v2.1/servers/8bd23351-3cb0-423c-ba5e-33a8ba3c3db4 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 10 23:42:10.131892 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-a6866374-3754-4e13-a652-445561b5d748 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "DELETE /compute/v2.1/servers/4583ce16-fb30-4fc9-9ed3-6ca8156c76eb" status: 204 len: 0 microversion: 2.1 time: 0.138653 Aug 10 23:42:10.133483 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3008/6223] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:42:09 2022] DELETE /compute/v2.1/servers/4583ce16-fb30-4fc9-9ed3-6ca8156c76eb => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 10 23:42:10.143060 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-0d5f2599-9d0f-46f7-82bb-68cf88080547 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:42:10.143912 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-0d5f2599-9d0f-46f7-82bb-68cf88080547 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 4583ce16-fb30-4fc9-9ed3-6ca8156c76eb] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:42:10.150983 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0d5f2599-9d0f-46f7-82bb-68cf88080547 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:42:10.151495 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0d5f2599-9d0f-46f7-82bb-68cf88080547 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:42:10.151947 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0d5f2599-9d0f-46f7-82bb-68cf88080547 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:42:10.153026 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0d5f2599-9d0f-46f7-82bb-68cf88080547 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:42:10.153506 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0d5f2599-9d0f-46f7-82bb-68cf88080547 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:42:10.153945 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0d5f2599-9d0f-46f7-82bb-68cf88080547 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:42:10.289155 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-0d5f2599-9d0f-46f7-82bb-68cf88080547 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:42:10.297583 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-0d5f2599-9d0f-46f7-82bb-68cf88080547 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/4583ce16-fb30-4fc9-9ed3-6ca8156c76eb" status: 200 len: 1411 microversion: 2.1 time: 0.159088 Aug 10 23:42:10.298219 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3216/6224] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:42:10 2022] GET /compute/v2.1/servers/4583ce16-fb30-4fc9-9ed3-6ca8156c76eb => generated 1411 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:42:10.522847 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-6f008401-08f0-44d3-9878-187be7a22780 tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:42:10.523455 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-6f008401-08f0-44d3-9878-187be7a22780 tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] [instance: 8bd23351-3cb0-423c-ba5e-33a8ba3c3db4] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:42:10.529683 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6f008401-08f0-44d3-9878-187be7a22780 tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:42:10.530188 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6f008401-08f0-44d3-9878-187be7a22780 tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:42:10.530626 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6f008401-08f0-44d3-9878-187be7a22780 tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:42:10.531351 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6f008401-08f0-44d3-9878-187be7a22780 tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:42:10.531809 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6f008401-08f0-44d3-9878-187be7a22780 tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:42:10.532231 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6f008401-08f0-44d3-9878-187be7a22780 tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:42:10.546511 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-6f008401-08f0-44d3-9878-187be7a22780 tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] HTTP exception thrown: Instance 8bd23351-3cb0-423c-ba5e-33a8ba3c3db4 could not be found. Aug 10 23:42:10.548314 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-6f008401-08f0-44d3-9878-187be7a22780 tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Request method failure captured: Aug 10 23:42:10.548314 n-d-850468-14 devstack@n-api.service[122632]: request: DELETE /compute/v2.1/servers/8bd23351-3cb0-423c-ba5e-33a8ba3c3db4 HTTP/1.1 Aug 10 23:42:10.548314 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:42:10.548314 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:42:10.548314 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:42:10.548314 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 23:42:10.548314 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:42:10.548314 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:42:10.548314 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:42:10.548314 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:42:10.548314 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9EEbaLLFf0qA6XysW2D_a1fFbaZyAcsbzZg9_BcQLG-FZLBvmQQI9CiBveRc_g-Gl8P1RM1LaGtTdgM2UAzwtHd0L4H6Cg3-aCKL3aondr4nQtjErrxxxxVF8c4B9DAgR3bQ0oQkyGm34htob8VS21YrqVB2zCdDHLFhNW_Sv0k8duc Aug 10 23:42:10.548314 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:42:10.548314 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:42:10.548314 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:42:10.548314 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:42:10.548314 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:42:10.548314 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:42:10.548314 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: ce0de2d097a542e9b80d9bcb87299467 Aug 10 23:42:10.548314 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-TestServerBasicOps-1588570670 Aug 10 23:42:10.548314 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:42:10.548314 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:42:10.548314 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ce0de2d097a542e9b80d9bcb87299467"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ce0de2d097a542e9b80d9bcb87299467"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ce0de2d097a542e9b80d9bcb87299467"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ce0de2d097a542e9b80d9bcb87299467", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:42:10.548314 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-TestServerBasicOps-1588570670 Aug 10 23:42:10.548314 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: ce0de2d097a542e9b80d9bcb87299467 Aug 10 23:42:10.548314 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-TestServerBasicOps-1588570670 Aug 10 23:42:10.548314 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-TestServerBasicOps-1588570670-project Aug 10 23:42:10.548314 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:42:10.548314 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:42:10.548314 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: 5115cfabf810465289e5a21b926bce6c Aug 10 23:42:10.548314 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-TestServerBasicOps-1588570670-project Aug 10 23:42:10.548314 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:42:10.548314 n-d-850468-14 devstack@n-api.service[122632]: exception: Instance 8bd23351-3cb0-423c-ba5e-33a8ba3c3db4 could not be found. Aug 10 23:42:10.548314 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': '8bd23351-3cb0-423c-ba5e-33a8ba3c3db4'} Aug 10 23:42:10.548314 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:42:10.548314 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:42:10.548314 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:42:10.548314 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:42:10.548314 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:42:10.548314 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:42:10.548314 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:42:10.548314 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:42:10.548314 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:42:10.548314 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:42:10.548314 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8bd23351-3cb0-423c-ba5e-33a8ba3c3db4 could not be found. Aug 10 23:42:10.548314 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:42:10.548314 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:42:10.548314 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:42:10.548314 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:42:10.548314 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:42:10.548314 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:42:10.548314 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:42:10.548314 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:42:10.548314 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:42:10.548314 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:42:10.548314 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 23:42:10.548314 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 23:42:10.548314 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 23:42:10.548314 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 23:42:10.548314 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:42:10.548314 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:42:10.548314 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:42:10.548314 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:42:10.554262 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8bd23351-3cb0-423c-ba5e-33a8ba3c3db4 could not be found. Aug 10 23:42:10.554262 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:42:10.554262 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:42:10.554262 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:42:10.554262 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:42:10.554262 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:42:10.554262 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:42:10.554262 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:42:10.554262 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:42:10.554262 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8bd23351-3cb0-423c-ba5e-33a8ba3c3db4 could not be found. Aug 10 23:42:10.554262 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:42:10.554262 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-6f008401-08f0-44d3-9878-187be7a22780 tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Returning 404 to user: Instance 8bd23351-3cb0-423c-ba5e-33a8ba3c3db4 could not be found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:42:10.554262 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-6f008401-08f0-44d3-9878-187be7a22780 tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] 10.222.0.58 "DELETE /compute/v2.1/servers/8bd23351-3cb0-423c-ba5e-33a8ba3c3db4" status: 404 len: 111 microversion: 2.1 time: 0.031611 Aug 10 23:42:10.554262 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3009/6225] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:42:10 2022] DELETE /compute/v2.1/servers/8bd23351-3cb0-423c-ba5e-33a8ba3c3db4 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:42:10.559537 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-77c996fc-17cd-4c27-b0fb-593cf1c3905a tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:42:10.560186 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-77c996fc-17cd-4c27-b0fb-593cf1c3905a tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] [instance: 8bd23351-3cb0-423c-ba5e-33a8ba3c3db4] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:42:10.566149 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-77c996fc-17cd-4c27-b0fb-593cf1c3905a tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:42:10.566642 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-77c996fc-17cd-4c27-b0fb-593cf1c3905a tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:42:10.567139 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-77c996fc-17cd-4c27-b0fb-593cf1c3905a tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:42:10.567846 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-77c996fc-17cd-4c27-b0fb-593cf1c3905a tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:42:10.568312 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-77c996fc-17cd-4c27-b0fb-593cf1c3905a tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:42:10.568751 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-77c996fc-17cd-4c27-b0fb-593cf1c3905a tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:42:10.582184 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-77c996fc-17cd-4c27-b0fb-593cf1c3905a tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] HTTP exception thrown: Instance 8bd23351-3cb0-423c-ba5e-33a8ba3c3db4 could not be found. Aug 10 23:42:10.583893 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-77c996fc-17cd-4c27-b0fb-593cf1c3905a tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Request method failure captured: Aug 10 23:42:10.583893 n-d-850468-14 devstack@n-api.service[122633]: request: GET /compute/v2.1/servers/8bd23351-3cb0-423c-ba5e-33a8ba3c3db4 HTTP/1.1 Aug 10 23:42:10.583893 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:42:10.583893 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:42:10.583893 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:42:10.583893 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:42:10.583893 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:42:10.583893 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:42:10.583893 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:42:10.583893 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:42:10.583893 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9EEbaLLFf0qA6XysW2D_a1fFbaZyAcsbzZg9_BcQLG-FZLBvmQQI9CiBveRc_g-Gl8P1RM1LaGtTdgM2UAzwtHd0L4H6Cg3-aCKL3aondr4nQtjErrxxxxVF8c4B9DAgR3bQ0oQkyGm34htob8VS21YrqVB2zCdDHLFhNW_Sv0k8duc Aug 10 23:42:10.583893 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:42:10.583893 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:42:10.583893 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:42:10.583893 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:42:10.583893 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:42:10.583893 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:42:10.583893 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: ce0de2d097a542e9b80d9bcb87299467 Aug 10 23:42:10.583893 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-TestServerBasicOps-1588570670 Aug 10 23:42:10.583893 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:42:10.583893 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:42:10.583893 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ce0de2d097a542e9b80d9bcb87299467"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/ce0de2d097a542e9b80d9bcb87299467"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/ce0de2d097a542e9b80d9bcb87299467"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_ce0de2d097a542e9b80d9bcb87299467", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:42:10.583893 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-TestServerBasicOps-1588570670 Aug 10 23:42:10.583893 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: ce0de2d097a542e9b80d9bcb87299467 Aug 10 23:42:10.583893 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-TestServerBasicOps-1588570670 Aug 10 23:42:10.583893 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-TestServerBasicOps-1588570670-project Aug 10 23:42:10.583893 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:42:10.583893 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:42:10.583893 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 5115cfabf810465289e5a21b926bce6c Aug 10 23:42:10.583893 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-TestServerBasicOps-1588570670-project Aug 10 23:42:10.583893 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:42:10.583893 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance 8bd23351-3cb0-423c-ba5e-33a8ba3c3db4 could not be found. Aug 10 23:42:10.583893 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': '8bd23351-3cb0-423c-ba5e-33a8ba3c3db4'} Aug 10 23:42:10.583893 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:42:10.583893 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:42:10.583893 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:42:10.583893 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:42:10.583893 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:42:10.583893 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:42:10.583893 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:42:10.583893 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:42:10.583893 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:42:10.583893 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:42:10.583893 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8bd23351-3cb0-423c-ba5e-33a8ba3c3db4 could not be found. Aug 10 23:42:10.583893 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:42:10.583893 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:42:10.583893 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:42:10.583893 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:42:10.583893 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:42:10.583893 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:42:10.583893 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:42:10.583893 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:42:10.583893 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:42:10.583893 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:42:10.583893 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:42:10.583893 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:42:10.583893 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:42:10.583893 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:42:10.583893 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:42:10.583893 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:42:10.583893 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8bd23351-3cb0-423c-ba5e-33a8ba3c3db4 could not be found. Aug 10 23:42:10.583893 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:42:10.583893 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:42:10.583893 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:42:10.589505 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:42:10.589505 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:42:10.589505 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:42:10.589505 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:42:10.589505 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:42:10.589505 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8bd23351-3cb0-423c-ba5e-33a8ba3c3db4 could not be found. Aug 10 23:42:10.589505 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:42:10.589505 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-77c996fc-17cd-4c27-b0fb-593cf1c3905a tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Returning 404 to user: Instance 8bd23351-3cb0-423c-ba5e-33a8ba3c3db4 could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:42:10.589505 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-77c996fc-17cd-4c27-b0fb-593cf1c3905a tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] 10.222.0.58 "GET /compute/v2.1/servers/8bd23351-3cb0-423c-ba5e-33a8ba3c3db4" status: 404 len: 111 microversion: 2.1 time: 0.029793 Aug 10 23:42:10.589505 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3217/6226] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:42:10 2022] GET /compute/v2.1/servers/8bd23351-3cb0-423c-ba5e-33a8ba3c3db4 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:42:10.756515 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-7bcafdba-3929-4048-9d07-9563b9f7959e tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] Calling method '.version_select at 0x7f847c60f940>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:42:10.781591 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-7bcafdba-3929-4048-9d07-9563b9f7959e tempest-TestServerBasicOps-1588570670 tempest-TestServerBasicOps-1588570670-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-696183268" status: 202 len: 0 microversion: 2.1 time: 0.028928 Aug 10 23:42:10.782202 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3010/6227] 10.222.0.58 () {58 vars in 1251 bytes} [Wed Aug 10 23:42:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-696183268 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:42:11.319168 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-832783d7-e21f-47e3-8f02-5b098ef8ec42 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:42:11.319964 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-832783d7-e21f-47e3-8f02-5b098ef8ec42 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 4583ce16-fb30-4fc9-9ed3-6ca8156c76eb] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:42:11.327461 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-832783d7-e21f-47e3-8f02-5b098ef8ec42 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:42:11.327985 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-832783d7-e21f-47e3-8f02-5b098ef8ec42 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:42:11.328418 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-832783d7-e21f-47e3-8f02-5b098ef8ec42 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:42:11.329142 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-832783d7-e21f-47e3-8f02-5b098ef8ec42 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:42:11.329611 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-832783d7-e21f-47e3-8f02-5b098ef8ec42 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:42:11.330051 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-832783d7-e21f-47e3-8f02-5b098ef8ec42 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:42:11.609883 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-832783d7-e21f-47e3-8f02-5b098ef8ec42 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:42:11.620308 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-832783d7-e21f-47e3-8f02-5b098ef8ec42 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/4583ce16-fb30-4fc9-9ed3-6ca8156c76eb" status: 200 len: 1411 microversion: 2.1 time: 0.304960 Aug 10 23:42:11.621187 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3218/6228] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:42:11 2022] GET /compute/v2.1/servers/4583ce16-fb30-4fc9-9ed3-6ca8156c76eb => generated 1411 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:42:12.645739 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-8b5a85e6-6e5a-4b8a-9733-6473ee7329fc tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:42:12.646586 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-8b5a85e6-6e5a-4b8a-9733-6473ee7329fc tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 4583ce16-fb30-4fc9-9ed3-6ca8156c76eb] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:42:12.655211 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8b5a85e6-6e5a-4b8a-9733-6473ee7329fc tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:42:12.655705 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8b5a85e6-6e5a-4b8a-9733-6473ee7329fc tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:42:12.656175 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8b5a85e6-6e5a-4b8a-9733-6473ee7329fc tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:42:12.656884 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8b5a85e6-6e5a-4b8a-9733-6473ee7329fc tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:42:12.657345 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8b5a85e6-6e5a-4b8a-9733-6473ee7329fc tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:42:12.657778 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8b5a85e6-6e5a-4b8a-9733-6473ee7329fc tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:42:12.788580 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-8b5a85e6-6e5a-4b8a-9733-6473ee7329fc tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:42:12.796620 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-8b5a85e6-6e5a-4b8a-9733-6473ee7329fc tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/4583ce16-fb30-4fc9-9ed3-6ca8156c76eb" status: 200 len: 1369 microversion: 2.1 time: 0.156658 Aug 10 23:42:12.797672 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3011/6229] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:42:12 2022] GET /compute/v2.1/servers/4583ce16-fb30-4fc9-9ed3-6ca8156c76eb => generated 1369 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:42:12.807092 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-db388487-851d-4565-a904-05d206b3cbd7 req-acb1cb62-4583-48ae-9358-f2af457cdba8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4583ce16-fb30-4fc9-9ed3-6ca8156c76eb", "name": "network-vif-deleted", "tag": "b7a55608-5352-4512-aa12-c167b829963f"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:42:12.818769 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-db388487-851d-4565-a904-05d206b3cbd7 req-acb1cb62-4583-48ae-9358-f2af457cdba8 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:42:12.819501 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-db388487-851d-4565-a904-05d206b3cbd7 req-acb1cb62-4583-48ae-9358-f2af457cdba8 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:42:12.821226 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-db388487-851d-4565-a904-05d206b3cbd7 req-acb1cb62-4583-48ae-9358-f2af457cdba8 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:42:12.845475 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-db388487-851d-4565-a904-05d206b3cbd7 req-acb1cb62-4583-48ae-9358-f2af457cdba8 service nova] Creating event network-vif-deleted:b7a55608-5352-4512-aa12-c167b829963f for instance 4583ce16-fb30-4fc9-9ed3-6ca8156c76eb on n-h2-850468-14 Aug 10 23:42:12.852856 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-db388487-851d-4565-a904-05d206b3cbd7 req-acb1cb62-4583-48ae-9358-f2af457cdba8 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050102 Aug 10 23:42:12.854577 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3219/6230] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:42:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:42:13.819026 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c96f878e-c963-4a97-bc81-3f2f4bbdab63 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:42:13.820820 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-c96f878e-c963-4a97-bc81-3f2f4bbdab63 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 4583ce16-fb30-4fc9-9ed3-6ca8156c76eb] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:42:13.828301 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c96f878e-c963-4a97-bc81-3f2f4bbdab63 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:42:13.828907 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c96f878e-c963-4a97-bc81-3f2f4bbdab63 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:42:13.829455 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c96f878e-c963-4a97-bc81-3f2f4bbdab63 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:42:13.830399 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c96f878e-c963-4a97-bc81-3f2f4bbdab63 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:42:13.830997 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c96f878e-c963-4a97-bc81-3f2f4bbdab63 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:42:13.831522 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c96f878e-c963-4a97-bc81-3f2f4bbdab63 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:42:13.900408 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-c96f878e-c963-4a97-bc81-3f2f4bbdab63 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:42:13.908914 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-c96f878e-c963-4a97-bc81-3f2f4bbdab63 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/4583ce16-fb30-4fc9-9ed3-6ca8156c76eb" status: 200 len: 1202 microversion: 2.1 time: 0.093765 Aug 10 23:42:13.909682 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3012/6231] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:42:13 2022] GET /compute/v2.1/servers/4583ce16-fb30-4fc9-9ed3-6ca8156c76eb => generated 1202 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:42:14.935025 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-1cdf6002-aafb-4888-917f-8c3199a56fd3 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:42:14.936421 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-1cdf6002-aafb-4888-917f-8c3199a56fd3 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 4583ce16-fb30-4fc9-9ed3-6ca8156c76eb] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:42:14.945774 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1cdf6002-aafb-4888-917f-8c3199a56fd3 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:42:14.947054 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1cdf6002-aafb-4888-917f-8c3199a56fd3 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:42:14.947747 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1cdf6002-aafb-4888-917f-8c3199a56fd3 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:42:14.948772 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1cdf6002-aafb-4888-917f-8c3199a56fd3 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:42:14.949419 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1cdf6002-aafb-4888-917f-8c3199a56fd3 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:42:14.950029 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1cdf6002-aafb-4888-917f-8c3199a56fd3 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:42:15.026503 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-1cdf6002-aafb-4888-917f-8c3199a56fd3 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:42:15.034591 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-1cdf6002-aafb-4888-917f-8c3199a56fd3 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/4583ce16-fb30-4fc9-9ed3-6ca8156c76eb" status: 200 len: 1202 microversion: 2.1 time: 0.105956 Aug 10 23:42:15.035716 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3220/6232] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:42:14 2022] GET /compute/v2.1/servers/4583ce16-fb30-4fc9-9ed3-6ca8156c76eb => generated 1202 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:42:16.055695 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-47aabb56-0540-43e3-b3ad-f3a8e1194d96 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:42:16.056477 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-47aabb56-0540-43e3-b3ad-f3a8e1194d96 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 4583ce16-fb30-4fc9-9ed3-6ca8156c76eb] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:42:16.063588 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-47aabb56-0540-43e3-b3ad-f3a8e1194d96 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:42:16.064258 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-47aabb56-0540-43e3-b3ad-f3a8e1194d96 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:42:16.064798 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-47aabb56-0540-43e3-b3ad-f3a8e1194d96 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:42:16.065572 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-47aabb56-0540-43e3-b3ad-f3a8e1194d96 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:42:16.066228 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-47aabb56-0540-43e3-b3ad-f3a8e1194d96 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:42:16.066878 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-47aabb56-0540-43e3-b3ad-f3a8e1194d96 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:42:16.165574 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-47aabb56-0540-43e3-b3ad-f3a8e1194d96 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:42:16.173500 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-47aabb56-0540-43e3-b3ad-f3a8e1194d96 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/4583ce16-fb30-4fc9-9ed3-6ca8156c76eb" status: 200 len: 1202 microversion: 2.1 time: 0.121882 Aug 10 23:42:16.174290 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3013/6233] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:42:16 2022] GET /compute/v2.1/servers/4583ce16-fb30-4fc9-9ed3-6ca8156c76eb => generated 1202 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:42:17.196568 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-f1bcf09d-2aa9-4f66-91fa-21361d6840f9 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:42:17.197202 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-f1bcf09d-2aa9-4f66-91fa-21361d6840f9 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 4583ce16-fb30-4fc9-9ed3-6ca8156c76eb] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:42:17.204528 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f1bcf09d-2aa9-4f66-91fa-21361d6840f9 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:42:17.205039 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f1bcf09d-2aa9-4f66-91fa-21361d6840f9 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:42:17.205495 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f1bcf09d-2aa9-4f66-91fa-21361d6840f9 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:42:17.206232 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f1bcf09d-2aa9-4f66-91fa-21361d6840f9 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:42:17.206702 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f1bcf09d-2aa9-4f66-91fa-21361d6840f9 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:42:17.207181 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f1bcf09d-2aa9-4f66-91fa-21361d6840f9 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:42:17.308445 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-f1bcf09d-2aa9-4f66-91fa-21361d6840f9 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:42:17.316138 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-f1bcf09d-2aa9-4f66-91fa-21361d6840f9 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/4583ce16-fb30-4fc9-9ed3-6ca8156c76eb" status: 200 len: 1202 microversion: 2.1 time: 0.124480 Aug 10 23:42:17.316716 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3221/6234] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:42:17 2022] GET /compute/v2.1/servers/4583ce16-fb30-4fc9-9ed3-6ca8156c76eb => generated 1202 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:42:18.338078 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-4323a72f-6f61-4c21-b783-d46accc37cab tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:42:18.338702 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-4323a72f-6f61-4c21-b783-d46accc37cab tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 4583ce16-fb30-4fc9-9ed3-6ca8156c76eb] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:42:18.345916 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4323a72f-6f61-4c21-b783-d46accc37cab tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:42:18.346409 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4323a72f-6f61-4c21-b783-d46accc37cab tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:42:18.347292 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4323a72f-6f61-4c21-b783-d46accc37cab tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:42:18.348089 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4323a72f-6f61-4c21-b783-d46accc37cab tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:42:18.348651 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4323a72f-6f61-4c21-b783-d46accc37cab tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:42:18.349155 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4323a72f-6f61-4c21-b783-d46accc37cab tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:42:18.365795 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-4323a72f-6f61-4c21-b783-d46accc37cab tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] HTTP exception thrown: Instance 4583ce16-fb30-4fc9-9ed3-6ca8156c76eb could not be found. Aug 10 23:42:18.368422 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-4323a72f-6f61-4c21-b783-d46accc37cab tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Request method failure captured: Aug 10 23:42:18.368422 n-d-850468-14 devstack@n-api.service[122632]: request: GET /compute/v2.1/servers/4583ce16-fb30-4fc9-9ed3-6ca8156c76eb HTTP/1.1 Aug 10 23:42:18.368422 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:42:18.368422 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:42:18.368422 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:42:18.368422 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 23:42:18.368422 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:42:18.368422 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:42:18.368422 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:42:18.368422 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:42:18.368422 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9EF3JcALvIu97mWIb2swBcyDTxDI5PJ3vU9Ry5AtFPunVTcpAqQQUjRv0EmIlEp13u4BOFv0aTDkpyifGo3ChPE2BfANGKPVxkJ3JhuTa-9TLVCXxNdBMfkJGfbXf6wm_Y7u9vFxLHJ5-XazgQxDfOp_ueAQ4sa5cZKpoVrdkbUR3Jc Aug 10 23:42:18.368422 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:42:18.368422 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:42:18.368422 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:42:18.368422 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:42:18.368422 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:42:18.368422 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:42:18.368422 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 0b22838d50dd4ea8811953e723d0c052 Aug 10 23:42:18.368422 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-TestVolumeBootPattern-991439424 Aug 10 23:42:18.368422 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:42:18.368422 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:42:18.368422 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0b22838d50dd4ea8811953e723d0c052"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0b22838d50dd4ea8811953e723d0c052"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/0b22838d50dd4ea8811953e723d0c052"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_0b22838d50dd4ea8811953e723d0c052", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:42:18.368422 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-TestVolumeBootPattern-991439424 Aug 10 23:42:18.368422 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 0b22838d50dd4ea8811953e723d0c052 Aug 10 23:42:18.368422 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-TestVolumeBootPattern-991439424 Aug 10 23:42:18.368422 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-TestVolumeBootPattern-991439424-project Aug 10 23:42:18.368422 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:42:18.368422 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:42:18.368422 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: e97e9cddb55649809a9cd16dbc43bb7e Aug 10 23:42:18.368422 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-TestVolumeBootPattern-991439424-project Aug 10 23:42:18.368422 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:42:18.368422 n-d-850468-14 devstack@n-api.service[122632]: exception: Instance 4583ce16-fb30-4fc9-9ed3-6ca8156c76eb could not be found. Aug 10 23:42:18.368422 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': '4583ce16-fb30-4fc9-9ed3-6ca8156c76eb'} Aug 10 23:42:18.368422 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:42:18.368422 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:42:18.368422 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:42:18.368422 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:42:18.368422 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:42:18.368422 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:42:18.368422 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:42:18.368422 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:42:18.368422 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:42:18.368422 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:42:18.368422 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4583ce16-fb30-4fc9-9ed3-6ca8156c76eb could not be found. Aug 10 23:42:18.368422 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:42:18.368422 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:42:18.368422 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:42:18.368422 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:42:18.368422 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:42:18.368422 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:42:18.368422 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:42:18.368422 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:42:18.368422 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:42:18.368422 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:42:18.368422 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:42:18.368422 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:42:18.368422 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:42:18.368422 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:42:18.368422 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:42:18.368422 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:42:18.368422 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4583ce16-fb30-4fc9-9ed3-6ca8156c76eb could not be found. Aug 10 23:42:18.368422 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:42:18.368422 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:42:18.368422 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:42:18.374042 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:42:18.374042 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:42:18.374042 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:42:18.374042 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:42:18.374042 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:42:18.374042 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4583ce16-fb30-4fc9-9ed3-6ca8156c76eb could not be found. Aug 10 23:42:18.374042 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:42:18.374042 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-4323a72f-6f61-4c21-b783-d46accc37cab tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Returning 404 to user: Instance 4583ce16-fb30-4fc9-9ed3-6ca8156c76eb could not be found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:42:18.374042 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-4323a72f-6f61-4c21-b783-d46accc37cab tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/4583ce16-fb30-4fc9-9ed3-6ca8156c76eb" status: 404 len: 111 microversion: 2.1 time: 0.036570 Aug 10 23:42:18.374042 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3014/6235] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:42:18 2022] GET /compute/v2.1/servers/4583ce16-fb30-4fc9-9ed3-6ca8156c76eb => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:42:20.548360 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c9208ffa-2fa5-48da-976c-061d9affd79b tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:42:20.548907 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-c9208ffa-2fa5-48da-976c-061d9affd79b tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: f2bf2a14-97d9-4fa8-a554-3b7ab3c3cb1a] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:42:20.557285 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c9208ffa-2fa5-48da-976c-061d9affd79b tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:42:20.557796 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c9208ffa-2fa5-48da-976c-061d9affd79b tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:42:20.558251 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c9208ffa-2fa5-48da-976c-061d9affd79b tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:42:20.559033 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c9208ffa-2fa5-48da-976c-061d9affd79b tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:42:20.559537 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c9208ffa-2fa5-48da-976c-061d9affd79b tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:42:20.560018 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c9208ffa-2fa5-48da-976c-061d9affd79b tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:42:20.574172 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-c9208ffa-2fa5-48da-976c-061d9affd79b tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] HTTP exception thrown: Instance f2bf2a14-97d9-4fa8-a554-3b7ab3c3cb1a could not be found. Aug 10 23:42:20.575790 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c9208ffa-2fa5-48da-976c-061d9affd79b tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Request method failure captured: Aug 10 23:42:20.575790 n-d-850468-14 devstack@n-api.service[122633]: request: DELETE /compute/v2.1/servers/f2bf2a14-97d9-4fa8-a554-3b7ab3c3cb1a HTTP/1.1 Aug 10 23:42:20.575790 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:42:20.575790 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:42:20.575790 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:42:20.575790 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:42:20.575790 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:42:20.575790 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:42:20.575790 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:42:20.575790 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:42:20.575790 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9EF3JcALvIu97mWIb2swBcyDTxDI5PJ3vU9Ry5AtFPunVTcpAqQQUjRv0EmIlEp13u4BOFv0aTDkpyifGo3ChPE2BfANGKPVxkJ3JhuTa-9TLVCXxNdBMfkJGfbXf6wm_Y7u9vFxLHJ5-XazgQxDfOp_ueAQ4sa5cZKpoVrdkbUR3Jc Aug 10 23:42:20.575790 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:42:20.575790 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:42:20.575790 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:42:20.575790 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:42:20.575790 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:42:20.575790 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:42:20.575790 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 0b22838d50dd4ea8811953e723d0c052 Aug 10 23:42:20.575790 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-TestVolumeBootPattern-991439424 Aug 10 23:42:20.575790 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:42:20.575790 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:42:20.575790 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0b22838d50dd4ea8811953e723d0c052"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0b22838d50dd4ea8811953e723d0c052"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/0b22838d50dd4ea8811953e723d0c052"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_0b22838d50dd4ea8811953e723d0c052", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:42:20.575790 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-TestVolumeBootPattern-991439424 Aug 10 23:42:20.575790 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 0b22838d50dd4ea8811953e723d0c052 Aug 10 23:42:20.575790 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-TestVolumeBootPattern-991439424 Aug 10 23:42:20.575790 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-TestVolumeBootPattern-991439424-project Aug 10 23:42:20.575790 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:42:20.575790 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:42:20.575790 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: e97e9cddb55649809a9cd16dbc43bb7e Aug 10 23:42:20.575790 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-TestVolumeBootPattern-991439424-project Aug 10 23:42:20.575790 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:42:20.575790 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance f2bf2a14-97d9-4fa8-a554-3b7ab3c3cb1a could not be found. Aug 10 23:42:20.575790 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': 'f2bf2a14-97d9-4fa8-a554-3b7ab3c3cb1a'} Aug 10 23:42:20.575790 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:42:20.575790 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:42:20.575790 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:42:20.575790 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:42:20.575790 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:42:20.575790 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:42:20.575790 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:42:20.575790 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:42:20.575790 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:42:20.575790 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:42:20.575790 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2bf2a14-97d9-4fa8-a554-3b7ab3c3cb1a could not be found. Aug 10 23:42:20.575790 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:42:20.575790 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:42:20.575790 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:42:20.575790 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:42:20.575790 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:42:20.575790 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:42:20.575790 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:42:20.575790 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:42:20.575790 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:42:20.575790 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:42:20.575790 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 23:42:20.575790 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 23:42:20.575790 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 23:42:20.575790 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 23:42:20.575790 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:42:20.575790 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:42:20.575790 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:42:20.575790 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:42:20.584279 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2bf2a14-97d9-4fa8-a554-3b7ab3c3cb1a could not be found. Aug 10 23:42:20.584279 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:42:20.584279 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:42:20.584279 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:42:20.584279 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:42:20.584279 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:42:20.584279 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:42:20.584279 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:42:20.584279 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:42:20.584279 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2bf2a14-97d9-4fa8-a554-3b7ab3c3cb1a could not be found. Aug 10 23:42:20.584279 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:42:20.584279 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c9208ffa-2fa5-48da-976c-061d9affd79b tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Returning 404 to user: Instance f2bf2a14-97d9-4fa8-a554-3b7ab3c3cb1a could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:42:20.584279 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-c9208ffa-2fa5-48da-976c-061d9affd79b tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "DELETE /compute/v2.1/servers/f2bf2a14-97d9-4fa8-a554-3b7ab3c3cb1a" status: 404 len: 111 microversion: 2.1 time: 0.032944 Aug 10 23:42:20.584279 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3222/6236] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:42:20 2022] DELETE /compute/v2.1/servers/f2bf2a14-97d9-4fa8-a554-3b7ab3c3cb1a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:42:20.587242 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c48b07e5-c4a7-4632-b942-c2c552066c19 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:42:20.587858 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-c48b07e5-c4a7-4632-b942-c2c552066c19 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: f2bf2a14-97d9-4fa8-a554-3b7ab3c3cb1a] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:42:20.594801 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c48b07e5-c4a7-4632-b942-c2c552066c19 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:42:20.595293 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c48b07e5-c4a7-4632-b942-c2c552066c19 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:42:20.595734 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c48b07e5-c4a7-4632-b942-c2c552066c19 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:42:20.596437 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c48b07e5-c4a7-4632-b942-c2c552066c19 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:42:20.596891 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c48b07e5-c4a7-4632-b942-c2c552066c19 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:42:20.597316 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c48b07e5-c4a7-4632-b942-c2c552066c19 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:42:20.612335 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-c48b07e5-c4a7-4632-b942-c2c552066c19 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] HTTP exception thrown: Instance f2bf2a14-97d9-4fa8-a554-3b7ab3c3cb1a could not be found. Aug 10 23:42:20.613877 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c48b07e5-c4a7-4632-b942-c2c552066c19 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Request method failure captured: Aug 10 23:42:20.613877 n-d-850468-14 devstack@n-api.service[122632]: request: GET /compute/v2.1/servers/f2bf2a14-97d9-4fa8-a554-3b7ab3c3cb1a HTTP/1.1 Aug 10 23:42:20.613877 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:42:20.613877 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:42:20.613877 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:42:20.613877 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 23:42:20.613877 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:42:20.613877 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:42:20.613877 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:42:20.613877 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:42:20.613877 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9EF3JcALvIu97mWIb2swBcyDTxDI5PJ3vU9Ry5AtFPunVTcpAqQQUjRv0EmIlEp13u4BOFv0aTDkpyifGo3ChPE2BfANGKPVxkJ3JhuTa-9TLVCXxNdBMfkJGfbXf6wm_Y7u9vFxLHJ5-XazgQxDfOp_ueAQ4sa5cZKpoVrdkbUR3Jc Aug 10 23:42:20.613877 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:42:20.613877 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:42:20.613877 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:42:20.613877 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:42:20.613877 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:42:20.613877 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:42:20.613877 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 0b22838d50dd4ea8811953e723d0c052 Aug 10 23:42:20.613877 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-TestVolumeBootPattern-991439424 Aug 10 23:42:20.613877 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:42:20.613877 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:42:20.613877 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0b22838d50dd4ea8811953e723d0c052"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0b22838d50dd4ea8811953e723d0c052"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/0b22838d50dd4ea8811953e723d0c052"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_0b22838d50dd4ea8811953e723d0c052", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:42:20.613877 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-TestVolumeBootPattern-991439424 Aug 10 23:42:20.613877 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 0b22838d50dd4ea8811953e723d0c052 Aug 10 23:42:20.613877 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-TestVolumeBootPattern-991439424 Aug 10 23:42:20.613877 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-TestVolumeBootPattern-991439424-project Aug 10 23:42:20.613877 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:42:20.613877 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:42:20.613877 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: e97e9cddb55649809a9cd16dbc43bb7e Aug 10 23:42:20.613877 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-TestVolumeBootPattern-991439424-project Aug 10 23:42:20.613877 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:42:20.613877 n-d-850468-14 devstack@n-api.service[122632]: exception: Instance f2bf2a14-97d9-4fa8-a554-3b7ab3c3cb1a could not be found. Aug 10 23:42:20.613877 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': 'f2bf2a14-97d9-4fa8-a554-3b7ab3c3cb1a'} Aug 10 23:42:20.613877 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:42:20.613877 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:42:20.613877 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:42:20.613877 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:42:20.613877 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:42:20.613877 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:42:20.613877 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:42:20.613877 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:42:20.613877 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:42:20.613877 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:42:20.613877 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2bf2a14-97d9-4fa8-a554-3b7ab3c3cb1a could not be found. Aug 10 23:42:20.613877 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:42:20.613877 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:42:20.613877 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:42:20.613877 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:42:20.613877 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:42:20.613877 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:42:20.613877 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:42:20.613877 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:42:20.613877 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:42:20.613877 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:42:20.613877 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:42:20.613877 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:42:20.613877 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:42:20.613877 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:42:20.613877 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:42:20.613877 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:42:20.613877 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2bf2a14-97d9-4fa8-a554-3b7ab3c3cb1a could not be found. Aug 10 23:42:20.613877 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:42:20.613877 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:42:20.613877 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:42:20.623430 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:42:20.623430 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:42:20.623430 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:42:20.623430 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:42:20.623430 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:42:20.623430 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2bf2a14-97d9-4fa8-a554-3b7ab3c3cb1a could not be found. Aug 10 23:42:20.623430 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:42:20.623430 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c48b07e5-c4a7-4632-b942-c2c552066c19 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Returning 404 to user: Instance f2bf2a14-97d9-4fa8-a554-3b7ab3c3cb1a could not be found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:42:20.623430 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-c48b07e5-c4a7-4632-b942-c2c552066c19 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/f2bf2a14-97d9-4fa8-a554-3b7ab3c3cb1a" status: 404 len: 111 microversion: 2.1 time: 0.033152 Aug 10 23:42:20.623430 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3015/6237] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:42:20 2022] GET /compute/v2.1/servers/f2bf2a14-97d9-4fa8-a554-3b7ab3c3cb1a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 10 23:42:21.125347 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-52db97da-a36a-4045-aade-d15033b86b7d tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:42:21.125853 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-52db97da-a36a-4045-aade-d15033b86b7d tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 4583ce16-fb30-4fc9-9ed3-6ca8156c76eb] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:42:21.132417 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-52db97da-a36a-4045-aade-d15033b86b7d tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:42:21.132865 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-52db97da-a36a-4045-aade-d15033b86b7d tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:42:21.133310 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-52db97da-a36a-4045-aade-d15033b86b7d tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:42:21.134011 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-52db97da-a36a-4045-aade-d15033b86b7d tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:42:21.134475 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-52db97da-a36a-4045-aade-d15033b86b7d tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:42:21.134963 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-52db97da-a36a-4045-aade-d15033b86b7d tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:42:21.149695 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-52db97da-a36a-4045-aade-d15033b86b7d tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] HTTP exception thrown: Instance 4583ce16-fb30-4fc9-9ed3-6ca8156c76eb could not be found. Aug 10 23:42:21.151298 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-52db97da-a36a-4045-aade-d15033b86b7d tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Request method failure captured: Aug 10 23:42:21.151298 n-d-850468-14 devstack@n-api.service[122633]: request: DELETE /compute/v2.1/servers/4583ce16-fb30-4fc9-9ed3-6ca8156c76eb HTTP/1.1 Aug 10 23:42:21.151298 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:42:21.151298 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:42:21.151298 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:42:21.151298 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:42:21.151298 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:42:21.151298 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:42:21.151298 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:42:21.151298 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:42:21.151298 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9EF3JcALvIu97mWIb2swBcyDTxDI5PJ3vU9Ry5AtFPunVTcpAqQQUjRv0EmIlEp13u4BOFv0aTDkpyifGo3ChPE2BfANGKPVxkJ3JhuTa-9TLVCXxNdBMfkJGfbXf6wm_Y7u9vFxLHJ5-XazgQxDfOp_ueAQ4sa5cZKpoVrdkbUR3Jc Aug 10 23:42:21.151298 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:42:21.151298 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:42:21.151298 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:42:21.151298 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:42:21.151298 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:42:21.151298 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:42:21.151298 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 0b22838d50dd4ea8811953e723d0c052 Aug 10 23:42:21.151298 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-TestVolumeBootPattern-991439424 Aug 10 23:42:21.151298 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:42:21.151298 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:42:21.151298 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0b22838d50dd4ea8811953e723d0c052"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0b22838d50dd4ea8811953e723d0c052"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/0b22838d50dd4ea8811953e723d0c052"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_0b22838d50dd4ea8811953e723d0c052", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:42:21.151298 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-TestVolumeBootPattern-991439424 Aug 10 23:42:21.151298 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 0b22838d50dd4ea8811953e723d0c052 Aug 10 23:42:21.151298 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-TestVolumeBootPattern-991439424 Aug 10 23:42:21.151298 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-TestVolumeBootPattern-991439424-project Aug 10 23:42:21.151298 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:42:21.151298 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:42:21.151298 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: e97e9cddb55649809a9cd16dbc43bb7e Aug 10 23:42:21.151298 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-TestVolumeBootPattern-991439424-project Aug 10 23:42:21.151298 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:42:21.151298 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance 4583ce16-fb30-4fc9-9ed3-6ca8156c76eb could not be found. Aug 10 23:42:21.151298 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': '4583ce16-fb30-4fc9-9ed3-6ca8156c76eb'} Aug 10 23:42:21.151298 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:42:21.151298 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:42:21.151298 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:42:21.151298 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:42:21.151298 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:42:21.151298 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:42:21.151298 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:42:21.151298 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:42:21.151298 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:42:21.151298 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:42:21.151298 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4583ce16-fb30-4fc9-9ed3-6ca8156c76eb could not be found. Aug 10 23:42:21.151298 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:42:21.151298 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:42:21.151298 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:42:21.151298 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:42:21.151298 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:42:21.151298 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:42:21.151298 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:42:21.151298 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:42:21.151298 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:42:21.151298 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:42:21.151298 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 23:42:21.151298 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 23:42:21.151298 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 23:42:21.151298 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 23:42:21.151298 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:42:21.151298 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:42:21.151298 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:42:21.151298 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:42:21.157627 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4583ce16-fb30-4fc9-9ed3-6ca8156c76eb could not be found. Aug 10 23:42:21.157627 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:42:21.157627 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:42:21.157627 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:42:21.157627 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:42:21.157627 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:42:21.157627 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:42:21.157627 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:42:21.157627 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:42:21.157627 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4583ce16-fb30-4fc9-9ed3-6ca8156c76eb could not be found. Aug 10 23:42:21.157627 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:42:21.157627 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-52db97da-a36a-4045-aade-d15033b86b7d tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Returning 404 to user: Instance 4583ce16-fb30-4fc9-9ed3-6ca8156c76eb could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:42:21.157627 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-52db97da-a36a-4045-aade-d15033b86b7d tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "DELETE /compute/v2.1/servers/4583ce16-fb30-4fc9-9ed3-6ca8156c76eb" status: 404 len: 111 microversion: 2.1 time: 0.031244 Aug 10 23:42:21.157627 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3223/6238] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:42:21 2022] DELETE /compute/v2.1/servers/4583ce16-fb30-4fc9-9ed3-6ca8156c76eb => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:42:21.161772 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-d3a09af5-827b-470e-9506-c7da85fb6782 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:42:21.162378 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-d3a09af5-827b-470e-9506-c7da85fb6782 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 4583ce16-fb30-4fc9-9ed3-6ca8156c76eb] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:42:21.169554 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d3a09af5-827b-470e-9506-c7da85fb6782 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:42:21.170034 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d3a09af5-827b-470e-9506-c7da85fb6782 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:42:21.170470 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d3a09af5-827b-470e-9506-c7da85fb6782 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:42:21.171211 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d3a09af5-827b-470e-9506-c7da85fb6782 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:42:21.171662 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d3a09af5-827b-470e-9506-c7da85fb6782 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:42:21.172082 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d3a09af5-827b-470e-9506-c7da85fb6782 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:42:21.189603 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-d3a09af5-827b-470e-9506-c7da85fb6782 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] HTTP exception thrown: Instance 4583ce16-fb30-4fc9-9ed3-6ca8156c76eb could not be found. Aug 10 23:42:21.191147 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-d3a09af5-827b-470e-9506-c7da85fb6782 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Request method failure captured: Aug 10 23:42:21.191147 n-d-850468-14 devstack@n-api.service[122632]: request: GET /compute/v2.1/servers/4583ce16-fb30-4fc9-9ed3-6ca8156c76eb HTTP/1.1 Aug 10 23:42:21.191147 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:42:21.191147 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:42:21.191147 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:42:21.191147 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 23:42:21.191147 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:42:21.191147 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:42:21.191147 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:42:21.191147 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:42:21.191147 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9EF3JcALvIu97mWIb2swBcyDTxDI5PJ3vU9Ry5AtFPunVTcpAqQQUjRv0EmIlEp13u4BOFv0aTDkpyifGo3ChPE2BfANGKPVxkJ3JhuTa-9TLVCXxNdBMfkJGfbXf6wm_Y7u9vFxLHJ5-XazgQxDfOp_ueAQ4sa5cZKpoVrdkbUR3Jc Aug 10 23:42:21.191147 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:42:21.191147 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:42:21.191147 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:42:21.191147 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:42:21.191147 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:42:21.191147 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:42:21.191147 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 0b22838d50dd4ea8811953e723d0c052 Aug 10 23:42:21.191147 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-TestVolumeBootPattern-991439424 Aug 10 23:42:21.191147 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:42:21.191147 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:42:21.191147 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0b22838d50dd4ea8811953e723d0c052"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0b22838d50dd4ea8811953e723d0c052"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/0b22838d50dd4ea8811953e723d0c052"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_0b22838d50dd4ea8811953e723d0c052", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:42:21.191147 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-TestVolumeBootPattern-991439424 Aug 10 23:42:21.191147 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 0b22838d50dd4ea8811953e723d0c052 Aug 10 23:42:21.191147 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-TestVolumeBootPattern-991439424 Aug 10 23:42:21.191147 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-TestVolumeBootPattern-991439424-project Aug 10 23:42:21.191147 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:42:21.191147 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:42:21.191147 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: e97e9cddb55649809a9cd16dbc43bb7e Aug 10 23:42:21.191147 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-TestVolumeBootPattern-991439424-project Aug 10 23:42:21.191147 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:42:21.191147 n-d-850468-14 devstack@n-api.service[122632]: exception: Instance 4583ce16-fb30-4fc9-9ed3-6ca8156c76eb could not be found. Aug 10 23:42:21.191147 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': '4583ce16-fb30-4fc9-9ed3-6ca8156c76eb'} Aug 10 23:42:21.191147 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:42:21.191147 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:42:21.191147 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:42:21.191147 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:42:21.191147 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:42:21.191147 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:42:21.191147 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:42:21.191147 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:42:21.191147 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:42:21.191147 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:42:21.191147 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4583ce16-fb30-4fc9-9ed3-6ca8156c76eb could not be found. Aug 10 23:42:21.191147 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:42:21.191147 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:42:21.191147 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:42:21.191147 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:42:21.191147 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:42:21.191147 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:42:21.191147 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:42:21.191147 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:42:21.191147 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:42:21.191147 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:42:21.191147 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:42:21.191147 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:42:21.191147 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:42:21.191147 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:42:21.191147 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:42:21.191147 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:42:21.191147 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4583ce16-fb30-4fc9-9ed3-6ca8156c76eb could not be found. Aug 10 23:42:21.191147 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:42:21.191147 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:42:21.191147 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:42:21.195880 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:42:21.195880 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:42:21.195880 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:42:21.195880 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:42:21.195880 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:42:21.195880 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4583ce16-fb30-4fc9-9ed3-6ca8156c76eb could not be found. Aug 10 23:42:21.195880 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:42:21.195880 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-d3a09af5-827b-470e-9506-c7da85fb6782 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Returning 404 to user: Instance 4583ce16-fb30-4fc9-9ed3-6ca8156c76eb could not be found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:42:21.195880 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-d3a09af5-827b-470e-9506-c7da85fb6782 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/4583ce16-fb30-4fc9-9ed3-6ca8156c76eb" status: 404 len: 111 microversion: 2.1 time: 0.034718 Aug 10 23:42:21.195880 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3016/6239] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:42:21 2022] GET /compute/v2.1/servers/4583ce16-fb30-4fc9-9ed3-6ca8156c76eb => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:42:21.270950 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-96141c44-df4b-43ca-957c-4f64be8dcc00 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Action: 'create', calling method: .version_select at 0x7f847c0a05e0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-299907508", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDNny42gSQcKvkyZo0zrJz1FUyqbF2gqK0TCSNCbD77IvrQS5hNs5Ao/WlSCiUhUAaSpHt0MiXR4Hrp631qxW/tiqj286LWMwS/mfpLQa7QVHT9UpQ+A4nNMZDPJ8pdjGA=="}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:42:21.287484 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-96141c44-df4b-43ca-957c-4f64be8dcc00 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Getting quotas for project 0b22838d50dd4ea8811953e723d0c052. Resources: {'key_pairs'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:42:21.292753 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-96141c44-df4b-43ca-957c-4f64be8dcc00 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Getting quotas for user e97e9cddb55649809a9cd16dbc43bb7e and project 0b22838d50dd4ea8811953e723d0c052. Resources: {'key_pairs'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:42:21.316710 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-96141c44-df4b-43ca-957c-4f64be8dcc00 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.049617 Aug 10 23:42:21.317526 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3224/6240] 10.222.0.58 () {60 vars in 1159 bytes} [Wed Aug 10 23:42:21 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:42:37.653577 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-71ed9097-5469-4376-8fbf-b1fbcf7c2c3c tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1716809422", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-299907508", "security_groups": [{"name": "tempest-secgroup-smoke-201473954"}], "block_device_mapping_v2": [{"uuid": "ac6cb603-33b7-45a5-aa9b-cd13c24271a3", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "5ed0a190-471f-4749-aff5-4f68f1343451"}]}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:42:37.664437 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_api:SELECT=25,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:42:37.665139 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:42:37.771563 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.network.neutron [None req-71ed9097-5469-4376-8fbf-b1fbcf7c2c3c tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] validate_networks() for [('5ed0a190-471f-4749-aff5-4f68f1343451', None, None, None, None, None)] {{(pid=122632) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 23:42:38.432261 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-71ed9097-5469-4376-8fbf-b1fbcf7c2c3c tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Flavor limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:42:38.432690 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-71ed9097-5469-4376-8fbf-b1fbcf7c2c3c tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Image limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:42:38.433193 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-71ed9097-5469-4376-8fbf-b1fbcf7c2c3c tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Flavor pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:42:38.433608 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-71ed9097-5469-4376-8fbf-b1fbcf7c2c3c tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Image pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:42:38.434024 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-71ed9097-5469-4376-8fbf-b1fbcf7c2c3c tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:42:38.443081 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-71ed9097-5469-4376-8fbf-b1fbcf7c2c3c tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:42:38.443567 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-71ed9097-5469-4376-8fbf-b1fbcf7c2c3c tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:42:38.444559 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-71ed9097-5469-4376-8fbf-b1fbcf7c2c3c tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:42:38.445288 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-71ed9097-5469-4376-8fbf-b1fbcf7c2c3c tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:42:38.445745 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-71ed9097-5469-4376-8fbf-b1fbcf7c2c3c tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:42:38.446209 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-71ed9097-5469-4376-8fbf-b1fbcf7c2c3c tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:42:38.464214 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-71ed9097-5469-4376-8fbf-b1fbcf7c2c3c tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Getting quotas for project 0b22838d50dd4ea8811953e723d0c052. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:42:38.469717 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-71ed9097-5469-4376-8fbf-b1fbcf7c2c3c tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Getting quotas for user e97e9cddb55649809a9cd16dbc43bb7e and project 0b22838d50dd4ea8811953e723d0c052. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:42:38.530004 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-71ed9097-5469-4376-8fbf-b1fbcf7c2c3c tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Going to run 1 instances... {{(pid=122632) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 23:42:38.532155 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-71ed9097-5469-4376-8fbf-b1fbcf7c2c3c tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 1de4d8bc-8768-4b1e-b90f-5e8d2dc5bb07] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ac6cb603-33b7-45a5-aa9b-cd13c24271a3',volume_size=None,volume_type=None)] {{(pid=122632) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 23:42:38.662981 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-71ed9097-5469-4376-8fbf-b1fbcf7c2c3c tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.013058 Aug 10 23:42:38.666967 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3017/6241] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 23:42:37 2022] POST /compute/v2.1/servers => generated 405 bytes in 1018 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 23:42:38.672744 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=47 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:42:38.673529 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=4 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:42:38.674179 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:42:38.679423 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-43419e9c-ace7-45df-8e81-32a5561f3129 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:42:38.680059 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-43419e9c-ace7-45df-8e81-32a5561f3129 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 1de4d8bc-8768-4b1e-b90f-5e8d2dc5bb07] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:42:38.737233 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-43419e9c-ace7-45df-8e81-32a5561f3129 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:42:38.745957 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-43419e9c-ace7-45df-8e81-32a5561f3129 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/1de4d8bc-8768-4b1e-b90f-5e8d2dc5bb07" status: 200 len: 1094 microversion: 2.1 time: 0.075148 Aug 10 23:42:38.746847 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3225/6242] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:42:38 2022] GET /compute/v2.1/servers/1de4d8bc-8768-4b1e-b90f-5e8d2dc5bb07 => generated 1094 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:42:39.767416 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-cbee1db4-a0f4-4b07-8762-bd25ea0135aa tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:42:39.768029 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-cbee1db4-a0f4-4b07-8762-bd25ea0135aa tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 1de4d8bc-8768-4b1e-b90f-5e8d2dc5bb07] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:42:39.780568 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cbee1db4-a0f4-4b07-8762-bd25ea0135aa tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:42:39.781867 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cbee1db4-a0f4-4b07-8762-bd25ea0135aa tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:42:39.783101 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cbee1db4-a0f4-4b07-8762-bd25ea0135aa tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:42:39.783279 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cbee1db4-a0f4-4b07-8762-bd25ea0135aa tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:42:39.783744 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cbee1db4-a0f4-4b07-8762-bd25ea0135aa tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:42:39.784169 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cbee1db4-a0f4-4b07-8762-bd25ea0135aa tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:42:39.852468 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-cbee1db4-a0f4-4b07-8762-bd25ea0135aa tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:42:39.860306 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-cbee1db4-a0f4-4b07-8762-bd25ea0135aa tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/1de4d8bc-8768-4b1e-b90f-5e8d2dc5bb07" status: 200 len: 1210 microversion: 2.1 time: 0.096481 Aug 10 23:42:39.861720 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3018/6243] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:42:39 2022] GET /compute/v2.1/servers/1de4d8bc-8768-4b1e-b90f-5e8d2dc5bb07 => generated 1210 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:42:40.883792 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-998ea0e7-27b9-4347-832c-16e08a047f8b tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:42:40.884515 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-998ea0e7-27b9-4347-832c-16e08a047f8b tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 1de4d8bc-8768-4b1e-b90f-5e8d2dc5bb07] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:42:40.893552 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-998ea0e7-27b9-4347-832c-16e08a047f8b tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:42:40.894193 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-998ea0e7-27b9-4347-832c-16e08a047f8b tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:42:40.894659 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-998ea0e7-27b9-4347-832c-16e08a047f8b tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:42:40.895574 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-998ea0e7-27b9-4347-832c-16e08a047f8b tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:42:40.896052 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-998ea0e7-27b9-4347-832c-16e08a047f8b tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:42:40.896495 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-998ea0e7-27b9-4347-832c-16e08a047f8b tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:42:41.118536 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-998ea0e7-27b9-4347-832c-16e08a047f8b tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:42:41.127311 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-998ea0e7-27b9-4347-832c-16e08a047f8b tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/1de4d8bc-8768-4b1e-b90f-5e8d2dc5bb07" status: 200 len: 1277 microversion: 2.1 time: 0.249426 Aug 10 23:42:41.128221 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3226/6244] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:42:40 2022] GET /compute/v2.1/servers/1de4d8bc-8768-4b1e-b90f-5e8d2dc5bb07 => generated 1277 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:42:41.192248 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-cb200f19-44fd-433e-9224-bf12e94bdbdd req-4b5a8ba6-5448-4e25-83e5-c9de9aa1492a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1de4d8bc-8768-4b1e-b90f-5e8d2dc5bb07", "tag": "17b1d53e-f375-4258-b06f-dc78424c38ca"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:42:41.205235 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-cb200f19-44fd-433e-9224-bf12e94bdbdd req-4b5a8ba6-5448-4e25-83e5-c9de9aa1492a service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:42:41.205730 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-cb200f19-44fd-433e-9224-bf12e94bdbdd req-4b5a8ba6-5448-4e25-83e5-c9de9aa1492a service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:42:41.206164 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-cb200f19-44fd-433e-9224-bf12e94bdbdd req-4b5a8ba6-5448-4e25-83e5-c9de9aa1492a service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:42:41.219799 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-cb200f19-44fd-433e-9224-bf12e94bdbdd req-4b5a8ba6-5448-4e25-83e5-c9de9aa1492a service nova] Creating event network-changed:17b1d53e-f375-4258-b06f-dc78424c38ca for instance 1de4d8bc-8768-4b1e-b90f-5e8d2dc5bb07 on n-h1-850468-14 Aug 10 23:42:41.225971 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-cb200f19-44fd-433e-9224-bf12e94bdbdd req-4b5a8ba6-5448-4e25-83e5-c9de9aa1492a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038428 Aug 10 23:42:41.226591 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3019/6245] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:42:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:42:42.151360 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-eae57203-f96c-4439-a751-e58421350b86 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:42:42.152156 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-eae57203-f96c-4439-a751-e58421350b86 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 1de4d8bc-8768-4b1e-b90f-5e8d2dc5bb07] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:42:42.158753 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-eae57203-f96c-4439-a751-e58421350b86 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:42:42.159185 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-eae57203-f96c-4439-a751-e58421350b86 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:42:42.159843 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-eae57203-f96c-4439-a751-e58421350b86 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:42:42.160608 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-eae57203-f96c-4439-a751-e58421350b86 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:42:42.161071 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-eae57203-f96c-4439-a751-e58421350b86 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:42:42.161503 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-eae57203-f96c-4439-a751-e58421350b86 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:42:42.300537 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-eae57203-f96c-4439-a751-e58421350b86 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:42:42.316527 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-eae57203-f96c-4439-a751-e58421350b86 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/1de4d8bc-8768-4b1e-b90f-5e8d2dc5bb07" status: 200 len: 1277 microversion: 2.1 time: 0.170316 Aug 10 23:42:42.317126 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3227/6246] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:42:42 2022] GET /compute/v2.1/servers/1de4d8bc-8768-4b1e-b90f-5e8d2dc5bb07 => generated 1277 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:42:43.339051 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-260b8380-ad39-4801-b971-a21db7728a30 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:42:43.339900 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-260b8380-ad39-4801-b971-a21db7728a30 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 1de4d8bc-8768-4b1e-b90f-5e8d2dc5bb07] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:42:43.346211 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-260b8380-ad39-4801-b971-a21db7728a30 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:42:43.346699 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-260b8380-ad39-4801-b971-a21db7728a30 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:42:43.347176 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-260b8380-ad39-4801-b971-a21db7728a30 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:42:43.347875 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-260b8380-ad39-4801-b971-a21db7728a30 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:42:43.348336 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-260b8380-ad39-4801-b971-a21db7728a30 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:42:43.348766 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-260b8380-ad39-4801-b971-a21db7728a30 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:42:43.495758 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-260b8380-ad39-4801-b971-a21db7728a30 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:42:43.503493 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-260b8380-ad39-4801-b971-a21db7728a30 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/1de4d8bc-8768-4b1e-b90f-5e8d2dc5bb07" status: 200 len: 1277 microversion: 2.1 time: 0.169653 Aug 10 23:42:43.504075 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3020/6247] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:42:43 2022] GET /compute/v2.1/servers/1de4d8bc-8768-4b1e-b90f-5e8d2dc5bb07 => generated 1277 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:42:44.524656 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-4b603ddf-db60-4233-87c5-69cfac5e4783 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:42:44.525284 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-4b603ddf-db60-4233-87c5-69cfac5e4783 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 1de4d8bc-8768-4b1e-b90f-5e8d2dc5bb07] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:42:44.533140 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4b603ddf-db60-4233-87c5-69cfac5e4783 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:42:44.533645 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4b603ddf-db60-4233-87c5-69cfac5e4783 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:42:44.534101 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4b603ddf-db60-4233-87c5-69cfac5e4783 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:42:44.534847 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4b603ddf-db60-4233-87c5-69cfac5e4783 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:42:44.535322 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4b603ddf-db60-4233-87c5-69cfac5e4783 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:42:44.535797 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4b603ddf-db60-4233-87c5-69cfac5e4783 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:42:44.674716 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-4b603ddf-db60-4233-87c5-69cfac5e4783 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:42:44.682742 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-4b603ddf-db60-4233-87c5-69cfac5e4783 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/1de4d8bc-8768-4b1e-b90f-5e8d2dc5bb07" status: 200 len: 1277 microversion: 2.1 time: 0.162807 Aug 10 23:42:44.683350 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3228/6248] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:42:44 2022] GET /compute/v2.1/servers/1de4d8bc-8768-4b1e-b90f-5e8d2dc5bb07 => generated 1277 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:42:45.704303 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-f2137d8b-6169-4fc0-bafb-aab788bb5741 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:42:45.704906 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-f2137d8b-6169-4fc0-bafb-aab788bb5741 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 1de4d8bc-8768-4b1e-b90f-5e8d2dc5bb07] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:42:45.712241 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f2137d8b-6169-4fc0-bafb-aab788bb5741 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:42:45.712724 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f2137d8b-6169-4fc0-bafb-aab788bb5741 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:42:45.713159 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f2137d8b-6169-4fc0-bafb-aab788bb5741 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:42:45.713878 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f2137d8b-6169-4fc0-bafb-aab788bb5741 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:42:45.714331 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f2137d8b-6169-4fc0-bafb-aab788bb5741 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:42:45.714758 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f2137d8b-6169-4fc0-bafb-aab788bb5741 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:42:45.848078 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-f2137d8b-6169-4fc0-bafb-aab788bb5741 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:42:45.856336 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-f2137d8b-6169-4fc0-bafb-aab788bb5741 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/1de4d8bc-8768-4b1e-b90f-5e8d2dc5bb07" status: 200 len: 1265 microversion: 2.1 time: 0.155939 Aug 10 23:42:45.856912 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3021/6249] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:42:45 2022] GET /compute/v2.1/servers/1de4d8bc-8768-4b1e-b90f-5e8d2dc5bb07 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:42:46.877877 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-320eb209-f3a1-44f9-9fd9-e86fd6a9f748 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:42:46.878503 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-320eb209-f3a1-44f9-9fd9-e86fd6a9f748 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 1de4d8bc-8768-4b1e-b90f-5e8d2dc5bb07] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:42:46.886173 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-320eb209-f3a1-44f9-9fd9-e86fd6a9f748 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:42:46.886669 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-320eb209-f3a1-44f9-9fd9-e86fd6a9f748 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:42:46.887153 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-320eb209-f3a1-44f9-9fd9-e86fd6a9f748 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:42:46.887860 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-320eb209-f3a1-44f9-9fd9-e86fd6a9f748 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:42:46.888326 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-320eb209-f3a1-44f9-9fd9-e86fd6a9f748 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:42:46.888766 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-320eb209-f3a1-44f9-9fd9-e86fd6a9f748 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:42:47.032282 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-320eb209-f3a1-44f9-9fd9-e86fd6a9f748 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:42:47.040115 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-320eb209-f3a1-44f9-9fd9-e86fd6a9f748 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/1de4d8bc-8768-4b1e-b90f-5e8d2dc5bb07" status: 200 len: 1265 microversion: 2.1 time: 0.166168 Aug 10 23:42:47.040700 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3229/6250] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:42:46 2022] GET /compute/v2.1/servers/1de4d8bc-8768-4b1e-b90f-5e8d2dc5bb07 => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:42:48.060776 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-d35f8054-e883-4ab2-abaa-914109a76fb1 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:42:48.061398 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-d35f8054-e883-4ab2-abaa-914109a76fb1 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 1de4d8bc-8768-4b1e-b90f-5e8d2dc5bb07] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:42:48.068234 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d35f8054-e883-4ab2-abaa-914109a76fb1 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:42:48.069649 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d35f8054-e883-4ab2-abaa-914109a76fb1 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:42:48.069844 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d35f8054-e883-4ab2-abaa-914109a76fb1 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:42:48.070546 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d35f8054-e883-4ab2-abaa-914109a76fb1 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:42:48.071037 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d35f8054-e883-4ab2-abaa-914109a76fb1 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:42:48.071472 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d35f8054-e883-4ab2-abaa-914109a76fb1 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:42:48.202599 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-d35f8054-e883-4ab2-abaa-914109a76fb1 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:42:48.210920 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-d35f8054-e883-4ab2-abaa-914109a76fb1 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/1de4d8bc-8768-4b1e-b90f-5e8d2dc5bb07" status: 200 len: 1265 microversion: 2.1 time: 0.154051 Aug 10 23:42:48.211493 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3022/6251] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:42:48 2022] GET /compute/v2.1/servers/1de4d8bc-8768-4b1e-b90f-5e8d2dc5bb07 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:42:49.232297 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-dbfd336c-a834-4929-89e9-4ea1c98a5aeb tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:42:49.232921 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-dbfd336c-a834-4929-89e9-4ea1c98a5aeb tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 1de4d8bc-8768-4b1e-b90f-5e8d2dc5bb07] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:42:49.235941 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=2 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:42:49.241992 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dbfd336c-a834-4929-89e9-4ea1c98a5aeb tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:42:49.242532 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dbfd336c-a834-4929-89e9-4ea1c98a5aeb tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:42:49.243023 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dbfd336c-a834-4929-89e9-4ea1c98a5aeb tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:42:49.243746 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dbfd336c-a834-4929-89e9-4ea1c98a5aeb tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:42:49.244223 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dbfd336c-a834-4929-89e9-4ea1c98a5aeb tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:42:49.244664 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dbfd336c-a834-4929-89e9-4ea1c98a5aeb tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:42:49.375759 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-dbfd336c-a834-4929-89e9-4ea1c98a5aeb tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:42:49.383540 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-dbfd336c-a834-4929-89e9-4ea1c98a5aeb tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/1de4d8bc-8768-4b1e-b90f-5e8d2dc5bb07" status: 200 len: 1265 microversion: 2.1 time: 0.155136 Aug 10 23:42:49.384122 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3230/6252] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:42:49 2022] GET /compute/v2.1/servers/1de4d8bc-8768-4b1e-b90f-5e8d2dc5bb07 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:42:50.404104 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-4ff47527-68be-4e2c-8148-a74f9d0950b8 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:42:50.404703 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-4ff47527-68be-4e2c-8148-a74f9d0950b8 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 1de4d8bc-8768-4b1e-b90f-5e8d2dc5bb07] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:42:50.406663 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=2 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:42:50.407355 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=6 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:42:50.414589 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4ff47527-68be-4e2c-8148-a74f9d0950b8 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:42:50.415104 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4ff47527-68be-4e2c-8148-a74f9d0950b8 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:42:50.415570 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4ff47527-68be-4e2c-8148-a74f9d0950b8 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:42:50.416281 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4ff47527-68be-4e2c-8148-a74f9d0950b8 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:42:50.416732 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4ff47527-68be-4e2c-8148-a74f9d0950b8 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:42:50.417160 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4ff47527-68be-4e2c-8148-a74f9d0950b8 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:42:50.558449 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-4ff47527-68be-4e2c-8148-a74f9d0950b8 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:42:50.566013 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-4ff47527-68be-4e2c-8148-a74f9d0950b8 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/1de4d8bc-8768-4b1e-b90f-5e8d2dc5bb07" status: 200 len: 1265 microversion: 2.1 time: 0.165810 Aug 10 23:42:50.566600 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3023/6253] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:42:50 2022] GET /compute/v2.1/servers/1de4d8bc-8768-4b1e-b90f-5e8d2dc5bb07 => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:42:51.587929 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-e3f6832d-4531-4a70-9ddc-e061c46c991f tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:42:51.589179 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-e3f6832d-4531-4a70-9ddc-e061c46c991f tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 1de4d8bc-8768-4b1e-b90f-5e8d2dc5bb07] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:42:51.596211 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e3f6832d-4531-4a70-9ddc-e061c46c991f tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:42:51.596705 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e3f6832d-4531-4a70-9ddc-e061c46c991f tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:42:51.597155 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e3f6832d-4531-4a70-9ddc-e061c46c991f tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:42:51.597862 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e3f6832d-4531-4a70-9ddc-e061c46c991f tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:42:51.598352 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e3f6832d-4531-4a70-9ddc-e061c46c991f tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:42:51.598814 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e3f6832d-4531-4a70-9ddc-e061c46c991f tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:42:51.744066 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-e3f6832d-4531-4a70-9ddc-e061c46c991f tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:42:51.752030 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-e3f6832d-4531-4a70-9ddc-e061c46c991f tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/1de4d8bc-8768-4b1e-b90f-5e8d2dc5bb07" status: 200 len: 1265 microversion: 2.1 time: 0.168444 Aug 10 23:42:51.752635 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3231/6254] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:42:51 2022] GET /compute/v2.1/servers/1de4d8bc-8768-4b1e-b90f-5e8d2dc5bb07 => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:42:52.772784 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-a4ebfe46-1a9e-4c2f-bc60-2c3de3ad204b tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:42:52.773325 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-a4ebfe46-1a9e-4c2f-bc60-2c3de3ad204b tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 1de4d8bc-8768-4b1e-b90f-5e8d2dc5bb07] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:42:52.780364 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a4ebfe46-1a9e-4c2f-bc60-2c3de3ad204b tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:42:52.780849 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a4ebfe46-1a9e-4c2f-bc60-2c3de3ad204b tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:42:52.781284 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a4ebfe46-1a9e-4c2f-bc60-2c3de3ad204b tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:42:52.781970 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a4ebfe46-1a9e-4c2f-bc60-2c3de3ad204b tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:42:52.782421 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a4ebfe46-1a9e-4c2f-bc60-2c3de3ad204b tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:42:52.782885 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a4ebfe46-1a9e-4c2f-bc60-2c3de3ad204b tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:42:52.915573 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-a4ebfe46-1a9e-4c2f-bc60-2c3de3ad204b tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:42:52.923136 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-a4ebfe46-1a9e-4c2f-bc60-2c3de3ad204b tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/1de4d8bc-8768-4b1e-b90f-5e8d2dc5bb07" status: 200 len: 1265 microversion: 2.1 time: 0.154346 Aug 10 23:42:52.923714 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3024/6255] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:42:52 2022] GET /compute/v2.1/servers/1de4d8bc-8768-4b1e-b90f-5e8d2dc5bb07 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:42:53.944938 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-a25eab57-2393-43d0-9f5b-e76b6d7f28e7 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:42:53.945487 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-a25eab57-2393-43d0-9f5b-e76b6d7f28e7 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 1de4d8bc-8768-4b1e-b90f-5e8d2dc5bb07] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:42:53.952446 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a25eab57-2393-43d0-9f5b-e76b6d7f28e7 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:42:53.952943 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a25eab57-2393-43d0-9f5b-e76b6d7f28e7 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:42:53.953392 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a25eab57-2393-43d0-9f5b-e76b6d7f28e7 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:42:53.954101 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a25eab57-2393-43d0-9f5b-e76b6d7f28e7 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:42:53.954572 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a25eab57-2393-43d0-9f5b-e76b6d7f28e7 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:42:53.955056 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a25eab57-2393-43d0-9f5b-e76b6d7f28e7 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:42:54.086620 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-a25eab57-2393-43d0-9f5b-e76b6d7f28e7 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:42:54.094204 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-a25eab57-2393-43d0-9f5b-e76b6d7f28e7 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/1de4d8bc-8768-4b1e-b90f-5e8d2dc5bb07" status: 200 len: 1265 microversion: 2.1 time: 0.153768 Aug 10 23:42:54.094813 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3232/6256] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:42:53 2022] GET /compute/v2.1/servers/1de4d8bc-8768-4b1e-b90f-5e8d2dc5bb07 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:42:55.115236 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-d26d6a2d-0932-4373-b4fd-845dba8c3d22 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:42:55.116452 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-d26d6a2d-0932-4373-b4fd-845dba8c3d22 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 1de4d8bc-8768-4b1e-b90f-5e8d2dc5bb07] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:42:55.123272 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d26d6a2d-0932-4373-b4fd-845dba8c3d22 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:42:55.123759 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d26d6a2d-0932-4373-b4fd-845dba8c3d22 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:42:55.124252 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d26d6a2d-0932-4373-b4fd-845dba8c3d22 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:42:55.124891 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d26d6a2d-0932-4373-b4fd-845dba8c3d22 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:42:55.125346 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d26d6a2d-0932-4373-b4fd-845dba8c3d22 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:42:55.125770 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d26d6a2d-0932-4373-b4fd-845dba8c3d22 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:42:55.286940 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-d26d6a2d-0932-4373-b4fd-845dba8c3d22 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:42:55.296159 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-d26d6a2d-0932-4373-b4fd-845dba8c3d22 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/1de4d8bc-8768-4b1e-b90f-5e8d2dc5bb07" status: 200 len: 1265 microversion: 2.1 time: 0.185021 Aug 10 23:42:55.296675 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3025/6257] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:42:55 2022] GET /compute/v2.1/servers/1de4d8bc-8768-4b1e-b90f-5e8d2dc5bb07 => generated 1265 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:42:55.348389 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-dda7e3c4-d708-4adb-9c81-3e8d1e55978b req-c3f42c74-cb70-4629-9e42-d0ac7bc24375 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1de4d8bc-8768-4b1e-b90f-5e8d2dc5bb07", "name": "network-vif-plugged", "status": "completed", "tag": "17b1d53e-f375-4258-b06f-dc78424c38ca"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:42:55.358542 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-dda7e3c4-d708-4adb-9c81-3e8d1e55978b req-c3f42c74-cb70-4629-9e42-d0ac7bc24375 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:42:55.359134 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-dda7e3c4-d708-4adb-9c81-3e8d1e55978b req-c3f42c74-cb70-4629-9e42-d0ac7bc24375 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:42:55.359587 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-dda7e3c4-d708-4adb-9c81-3e8d1e55978b req-c3f42c74-cb70-4629-9e42-d0ac7bc24375 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:42:55.371277 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-dda7e3c4-d708-4adb-9c81-3e8d1e55978b req-c3f42c74-cb70-4629-9e42-d0ac7bc24375 service nova] Creating event network-vif-plugged:17b1d53e-f375-4258-b06f-dc78424c38ca for instance 1de4d8bc-8768-4b1e-b90f-5e8d2dc5bb07 on n-h1-850468-14 Aug 10 23:42:55.376331 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-dda7e3c4-d708-4adb-9c81-3e8d1e55978b req-c3f42c74-cb70-4629-9e42-d0ac7bc24375 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.175932 Aug 10 23:42:55.376923 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3233/6258] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:42:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 23:42:56.316921 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-8b8788fb-08ed-4cac-848a-e5be770222a6 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:42:56.317511 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-8b8788fb-08ed-4cac-848a-e5be770222a6 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 1de4d8bc-8768-4b1e-b90f-5e8d2dc5bb07] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:42:56.324587 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8b8788fb-08ed-4cac-848a-e5be770222a6 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:42:56.325082 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8b8788fb-08ed-4cac-848a-e5be770222a6 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:42:56.325522 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8b8788fb-08ed-4cac-848a-e5be770222a6 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:42:56.326214 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8b8788fb-08ed-4cac-848a-e5be770222a6 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:42:56.326668 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8b8788fb-08ed-4cac-848a-e5be770222a6 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:42:56.327119 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8b8788fb-08ed-4cac-848a-e5be770222a6 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:42:56.459080 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-8b8788fb-08ed-4cac-848a-e5be770222a6 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:42:56.467448 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-8b8788fb-08ed-4cac-848a-e5be770222a6 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/1de4d8bc-8768-4b1e-b90f-5e8d2dc5bb07" status: 200 len: 1265 microversion: 2.1 time: 0.154454 Aug 10 23:42:56.468010 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3026/6259] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:42:56 2022] GET /compute/v2.1/servers/1de4d8bc-8768-4b1e-b90f-5e8d2dc5bb07 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:42:57.488503 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-1e03e458-a095-4815-86f2-7d1d18ae1b1d tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:42:57.489172 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-1e03e458-a095-4815-86f2-7d1d18ae1b1d tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 1de4d8bc-8768-4b1e-b90f-5e8d2dc5bb07] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:42:57.496297 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1e03e458-a095-4815-86f2-7d1d18ae1b1d tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:42:57.496796 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1e03e458-a095-4815-86f2-7d1d18ae1b1d tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:42:57.497249 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1e03e458-a095-4815-86f2-7d1d18ae1b1d tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:42:57.497960 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1e03e458-a095-4815-86f2-7d1d18ae1b1d tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:42:57.498430 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1e03e458-a095-4815-86f2-7d1d18ae1b1d tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:42:57.498903 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1e03e458-a095-4815-86f2-7d1d18ae1b1d tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:42:57.635690 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-1e03e458-a095-4815-86f2-7d1d18ae1b1d tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:42:57.645502 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-1e03e458-a095-4815-86f2-7d1d18ae1b1d tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/1de4d8bc-8768-4b1e-b90f-5e8d2dc5bb07" status: 200 len: 1452 microversion: 2.1 time: 0.161582 Aug 10 23:42:57.646091 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3234/6260] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:42:57 2022] GET /compute/v2.1/servers/1de4d8bc-8768-4b1e-b90f-5e8d2dc5bb07 => generated 1452 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:42:57.667600 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-89e5d70a-abeb-457d-8ada-788c822cc7c4 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:42:57.668201 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-89e5d70a-abeb-457d-8ada-788c822cc7c4 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 1de4d8bc-8768-4b1e-b90f-5e8d2dc5bb07] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:42:57.675017 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-89e5d70a-abeb-457d-8ada-788c822cc7c4 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:42:57.675500 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-89e5d70a-abeb-457d-8ada-788c822cc7c4 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:42:57.675933 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-89e5d70a-abeb-457d-8ada-788c822cc7c4 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:42:57.676621 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-89e5d70a-abeb-457d-8ada-788c822cc7c4 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:42:57.677101 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-89e5d70a-abeb-457d-8ada-788c822cc7c4 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:42:57.677531 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-89e5d70a-abeb-457d-8ada-788c822cc7c4 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:42:57.811481 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-89e5d70a-abeb-457d-8ada-788c822cc7c4 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:42:57.820280 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-89e5d70a-abeb-457d-8ada-788c822cc7c4 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/1de4d8bc-8768-4b1e-b90f-5e8d2dc5bb07" status: 200 len: 1452 microversion: 2.1 time: 0.157670 Aug 10 23:42:57.820875 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3027/6261] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:42:57 2022] GET /compute/v2.1/servers/1de4d8bc-8768-4b1e-b90f-5e8d2dc5bb07 => generated 1452 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:42:59.477852 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-56366806-7514-44ab-a1c7-f1d096e2a55e req-332948db-2da9-46a1-be5a-c9dd87572ac8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1de4d8bc-8768-4b1e-b90f-5e8d2dc5bb07", "tag": "17b1d53e-f375-4258-b06f-dc78424c38ca"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:42:59.488623 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-56366806-7514-44ab-a1c7-f1d096e2a55e req-332948db-2da9-46a1-be5a-c9dd87572ac8 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:42:59.489115 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-56366806-7514-44ab-a1c7-f1d096e2a55e req-332948db-2da9-46a1-be5a-c9dd87572ac8 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:42:59.489565 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-56366806-7514-44ab-a1c7-f1d096e2a55e req-332948db-2da9-46a1-be5a-c9dd87572ac8 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:42:59.502143 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-56366806-7514-44ab-a1c7-f1d096e2a55e req-332948db-2da9-46a1-be5a-c9dd87572ac8 service nova] Creating event network-changed:17b1d53e-f375-4258-b06f-dc78424c38ca for instance 1de4d8bc-8768-4b1e-b90f-5e8d2dc5bb07 on n-h1-850468-14 Aug 10 23:42:59.508061 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-56366806-7514-44ab-a1c7-f1d096e2a55e req-332948db-2da9-46a1-be5a-c9dd87572ac8 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034287 Aug 10 23:42:59.508661 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3235/6262] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:42:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:43:48.565118 n-d-850468-14 devstack@n-api.service[122633]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 23:43:48.565791 n-d-850468-14 devstack@n-api.service[122633]: Wed Aug 10 23:43:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 23:44:56.936483 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:44:56.937281 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=58 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:44:57.068231 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-568f94da-9615-4564-bc7c-cb4116163822 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:44:57.068740 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-568f94da-9615-4564-bc7c-cb4116163822 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 1de4d8bc-8768-4b1e-b90f-5e8d2dc5bb07] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:44:57.075427 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-568f94da-9615-4564-bc7c-cb4116163822 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:44:57.075914 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-568f94da-9615-4564-bc7c-cb4116163822 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:44:57.076357 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-568f94da-9615-4564-bc7c-cb4116163822 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:44:57.077055 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-568f94da-9615-4564-bc7c-cb4116163822 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:44:57.077514 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-568f94da-9615-4564-bc7c-cb4116163822 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:44:57.077942 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-568f94da-9615-4564-bc7c-cb4116163822 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:44:57.103042 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-568f94da-9615-4564-bc7c-cb4116163822 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 1de4d8bc-8768-4b1e-b90f-5e8d2dc5bb07] Going to try to terminate instance {{(pid=122632) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:44:57.160231 n-d-850468-14 devstack@n-api.service[122632]: ERROR oslo.messaging._drivers.impl_rabbit [None req-568f94da-9615-4564-bc7c-cb4116163822 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [e2b7d07d-e526-48b8-8aac-827aa61c7738] AMQP server on 10.222.0.58:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 10 23:44:58.168120 n-d-850468-14 devstack@n-api.service[122632]: INFO oslo.messaging._drivers.impl_rabbit [None req-568f94da-9615-4564-bc7c-cb4116163822 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [e2b7d07d-e526-48b8-8aac-827aa61c7738] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 36184. Aug 10 23:44:58.190035 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-568f94da-9615-4564-bc7c-cb4116163822 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "DELETE /compute/v2.1/servers/1de4d8bc-8768-4b1e-b90f-5e8d2dc5bb07" status: 204 len: 0 microversion: 2.1 time: 1.255320 Aug 10 23:44:58.191210 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3028/6263] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:44:56 2022] DELETE /compute/v2.1/servers/1de4d8bc-8768-4b1e-b90f-5e8d2dc5bb07 => generated 0 bytes in 1257 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:44:58.200266 n-d-850468-14 devstack@n-api.service[122633]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5e7530cb-e34a-4714-9391-5480d11af743] AMQP server on 10.222.0.58:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 10 23:44:58.202660 n-d-850468-14 devstack@n-api.service[122633]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e2bb3e2a-85f2-4c49-98ff-2d6066099266] AMQP server on 10.222.0.58:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 10 23:44:58.203335 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_api:SELECT=24 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:44:58.204451 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=52 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:44:58.209775 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-7f3736c4-dc38-4f33-b3b9-21d6f66dee9b tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:44:58.210488 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-7f3736c4-dc38-4f33-b3b9-21d6f66dee9b tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 1de4d8bc-8768-4b1e-b90f-5e8d2dc5bb07] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:44:58.218342 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7f3736c4-dc38-4f33-b3b9-21d6f66dee9b tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:44:58.218868 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7f3736c4-dc38-4f33-b3b9-21d6f66dee9b tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:44:58.219321 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7f3736c4-dc38-4f33-b3b9-21d6f66dee9b tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:44:58.220027 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7f3736c4-dc38-4f33-b3b9-21d6f66dee9b tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:44:58.220516 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7f3736c4-dc38-4f33-b3b9-21d6f66dee9b tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:44:58.220954 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7f3736c4-dc38-4f33-b3b9-21d6f66dee9b tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:44:58.360001 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-7f3736c4-dc38-4f33-b3b9-21d6f66dee9b tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:44:58.367907 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-7f3736c4-dc38-4f33-b3b9-21d6f66dee9b tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/1de4d8bc-8768-4b1e-b90f-5e8d2dc5bb07" status: 200 len: 1577 microversion: 2.1 time: 0.171211 Aug 10 23:44:58.368488 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3236/6264] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:44:58 2022] GET /compute/v2.1/servers/1de4d8bc-8768-4b1e-b90f-5e8d2dc5bb07 => generated 1577 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:44:59.389807 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-6f0c0667-0a0c-4122-848c-02f9df7377db tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:44:59.390500 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-6f0c0667-0a0c-4122-848c-02f9df7377db tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 1de4d8bc-8768-4b1e-b90f-5e8d2dc5bb07] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:44:59.397288 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6f0c0667-0a0c-4122-848c-02f9df7377db tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:44:59.397771 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6f0c0667-0a0c-4122-848c-02f9df7377db tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:44:59.398210 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6f0c0667-0a0c-4122-848c-02f9df7377db tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:44:59.398921 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6f0c0667-0a0c-4122-848c-02f9df7377db tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:44:59.399377 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6f0c0667-0a0c-4122-848c-02f9df7377db tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:44:59.399805 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6f0c0667-0a0c-4122-848c-02f9df7377db tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:44:59.541042 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-6f0c0667-0a0c-4122-848c-02f9df7377db tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:44:59.549542 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-6f0c0667-0a0c-4122-848c-02f9df7377db tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/1de4d8bc-8768-4b1e-b90f-5e8d2dc5bb07" status: 200 len: 1577 microversion: 2.1 time: 0.163991 Aug 10 23:44:59.550123 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3029/6265] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:44:59 2022] GET /compute/v2.1/servers/1de4d8bc-8768-4b1e-b90f-5e8d2dc5bb07 => generated 1577 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:45:00.526459 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-970d07f0-baf1-410d-8909-0055411f37df req-a560f1e9-37a8-4e58-ac3c-60cee4a04db0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1de4d8bc-8768-4b1e-b90f-5e8d2dc5bb07", "name": "network-vif-deleted", "tag": "17b1d53e-f375-4258-b06f-dc78424c38ca"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:45:00.539881 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-970d07f0-baf1-410d-8909-0055411f37df req-a560f1e9-37a8-4e58-ac3c-60cee4a04db0 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:45:00.540438 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-970d07f0-baf1-410d-8909-0055411f37df req-a560f1e9-37a8-4e58-ac3c-60cee4a04db0 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:45:00.541247 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-970d07f0-baf1-410d-8909-0055411f37df req-a560f1e9-37a8-4e58-ac3c-60cee4a04db0 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:45:00.554467 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-970d07f0-baf1-410d-8909-0055411f37df req-a560f1e9-37a8-4e58-ac3c-60cee4a04db0 service nova] Creating event network-vif-deleted:17b1d53e-f375-4258-b06f-dc78424c38ca for instance 1de4d8bc-8768-4b1e-b90f-5e8d2dc5bb07 on n-h1-850468-14 Aug 10 23:45:00.560767 n-d-850468-14 devstack@n-api.service[122633]: INFO oslo.messaging._drivers.impl_rabbit [-] [5e7530cb-e34a-4714-9391-5480d11af743] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 36196. Aug 10 23:45:00.563139 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-970d07f0-baf1-410d-8909-0055411f37df req-a560f1e9-37a8-4e58-ac3c-60cee4a04db0 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040545 Aug 10 23:45:00.563989 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3237/6266] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:45:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:45:00.572365 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-9771654a-1eb1-46f1-86f8-8ecf34b35900 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:45:00.573841 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-9771654a-1eb1-46f1-86f8-8ecf34b35900 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 1de4d8bc-8768-4b1e-b90f-5e8d2dc5bb07] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:45:00.582904 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9771654a-1eb1-46f1-86f8-8ecf34b35900 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:45:00.583383 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9771654a-1eb1-46f1-86f8-8ecf34b35900 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:45:00.583839 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9771654a-1eb1-46f1-86f8-8ecf34b35900 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:45:00.584554 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9771654a-1eb1-46f1-86f8-8ecf34b35900 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:45:00.585888 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9771654a-1eb1-46f1-86f8-8ecf34b35900 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:45:00.586330 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9771654a-1eb1-46f1-86f8-8ecf34b35900 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:45:00.702157 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-9771654a-1eb1-46f1-86f8-8ecf34b35900 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:45:00.711902 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-9771654a-1eb1-46f1-86f8-8ecf34b35900 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/1de4d8bc-8768-4b1e-b90f-5e8d2dc5bb07" status: 200 len: 1225 microversion: 2.1 time: 0.144635 Aug 10 23:45:00.712814 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3030/6267] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:45:00 2022] GET /compute/v2.1/servers/1de4d8bc-8768-4b1e-b90f-5e8d2dc5bb07 => generated 1225 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:45:01.731864 n-d-850468-14 devstack@n-api.service[122633]: INFO oslo.messaging._drivers.impl_rabbit [-] [e2bb3e2a-85f2-4c49-98ff-2d6066099266] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 36198. Aug 10 23:45:01.736130 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c94e70f1-ad26-4192-af6f-199ff2e7a865 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:45:01.736853 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-c94e70f1-ad26-4192-af6f-199ff2e7a865 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 1de4d8bc-8768-4b1e-b90f-5e8d2dc5bb07] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:45:01.743635 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c94e70f1-ad26-4192-af6f-199ff2e7a865 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:45:01.744132 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c94e70f1-ad26-4192-af6f-199ff2e7a865 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:45:01.745175 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c94e70f1-ad26-4192-af6f-199ff2e7a865 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:45:01.745889 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c94e70f1-ad26-4192-af6f-199ff2e7a865 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:45:01.746359 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c94e70f1-ad26-4192-af6f-199ff2e7a865 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:45:01.746815 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c94e70f1-ad26-4192-af6f-199ff2e7a865 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:45:01.814420 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-c94e70f1-ad26-4192-af6f-199ff2e7a865 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:45:01.822165 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-c94e70f1-ad26-4192-af6f-199ff2e7a865 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/1de4d8bc-8768-4b1e-b90f-5e8d2dc5bb07" status: 200 len: 1225 microversion: 2.1 time: 0.091789 Aug 10 23:45:01.823375 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3238/6268] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:45:01 2022] GET /compute/v2.1/servers/1de4d8bc-8768-4b1e-b90f-5e8d2dc5bb07 => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:45:02.842896 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-f6da5655-9d63-466e-b4bf-204611288542 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:45:02.843516 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-f6da5655-9d63-466e-b4bf-204611288542 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 1de4d8bc-8768-4b1e-b90f-5e8d2dc5bb07] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:45:02.850187 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f6da5655-9d63-466e-b4bf-204611288542 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:45:02.850675 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f6da5655-9d63-466e-b4bf-204611288542 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:45:02.851144 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f6da5655-9d63-466e-b4bf-204611288542 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:45:02.851861 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f6da5655-9d63-466e-b4bf-204611288542 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:45:02.852301 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f6da5655-9d63-466e-b4bf-204611288542 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:45:02.852727 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f6da5655-9d63-466e-b4bf-204611288542 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:45:02.915350 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-f6da5655-9d63-466e-b4bf-204611288542 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:45:02.924032 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-f6da5655-9d63-466e-b4bf-204611288542 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/1de4d8bc-8768-4b1e-b90f-5e8d2dc5bb07" status: 200 len: 1225 microversion: 2.1 time: 0.084964 Aug 10 23:45:02.924622 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3031/6269] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:45:02 2022] GET /compute/v2.1/servers/1de4d8bc-8768-4b1e-b90f-5e8d2dc5bb07 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:45:03.945861 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-6a7bb501-ad6c-4f57-8b5e-e472d6967145 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:45:03.946540 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-6a7bb501-ad6c-4f57-8b5e-e472d6967145 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 1de4d8bc-8768-4b1e-b90f-5e8d2dc5bb07] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:45:03.954272 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6a7bb501-ad6c-4f57-8b5e-e472d6967145 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:45:03.954795 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6a7bb501-ad6c-4f57-8b5e-e472d6967145 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:45:03.955272 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6a7bb501-ad6c-4f57-8b5e-e472d6967145 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:45:03.956168 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6a7bb501-ad6c-4f57-8b5e-e472d6967145 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:45:03.956649 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6a7bb501-ad6c-4f57-8b5e-e472d6967145 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:45:03.957097 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6a7bb501-ad6c-4f57-8b5e-e472d6967145 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:45:04.024388 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-6a7bb501-ad6c-4f57-8b5e-e472d6967145 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:45:04.033847 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-6a7bb501-ad6c-4f57-8b5e-e472d6967145 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/1de4d8bc-8768-4b1e-b90f-5e8d2dc5bb07" status: 200 len: 1225 microversion: 2.1 time: 0.092087 Aug 10 23:45:04.034444 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3239/6270] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:45:03 2022] GET /compute/v2.1/servers/1de4d8bc-8768-4b1e-b90f-5e8d2dc5bb07 => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:45:05.054645 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-5ab2e50f-5264-4a27-b979-99458b68f030 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:45:05.055298 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-5ab2e50f-5264-4a27-b979-99458b68f030 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 1de4d8bc-8768-4b1e-b90f-5e8d2dc5bb07] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:45:05.062513 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5ab2e50f-5264-4a27-b979-99458b68f030 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:45:05.063039 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5ab2e50f-5264-4a27-b979-99458b68f030 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:45:05.063483 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5ab2e50f-5264-4a27-b979-99458b68f030 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:45:05.064183 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5ab2e50f-5264-4a27-b979-99458b68f030 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:45:05.064641 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5ab2e50f-5264-4a27-b979-99458b68f030 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:45:05.065070 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5ab2e50f-5264-4a27-b979-99458b68f030 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:45:05.097113 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5ab2e50f-5264-4a27-b979-99458b68f030 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:45:05.097514 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5ab2e50f-5264-4a27-b979-99458b68f030 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:45:05.097952 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5ab2e50f-5264-4a27-b979-99458b68f030 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:45:05.098396 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.objects.instance [None req-5ab2e50f-5264-4a27-b979-99458b68f030 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lazy-loading 'fault' on Instance uuid 1de4d8bc-8768-4b1e-b90f-5e8d2dc5bb07 {{(pid=122632) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:45:05.141769 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-5ab2e50f-5264-4a27-b979-99458b68f030 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:45:05.149623 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-5ab2e50f-5264-4a27-b979-99458b68f030 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/1de4d8bc-8768-4b1e-b90f-5e8d2dc5bb07" status: 200 len: 1230 microversion: 2.1 time: 0.098790 Aug 10 23:45:05.150211 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3032/6271] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:45:05 2022] GET /compute/v2.1/servers/1de4d8bc-8768-4b1e-b90f-5e8d2dc5bb07 => generated 1230 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:45:06.172042 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-cb8a6ece-9652-487c-aba0-88268daa7282 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:45:06.172689 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-cb8a6ece-9652-487c-aba0-88268daa7282 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 1de4d8bc-8768-4b1e-b90f-5e8d2dc5bb07] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:45:06.179561 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cb8a6ece-9652-487c-aba0-88268daa7282 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:45:06.180052 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cb8a6ece-9652-487c-aba0-88268daa7282 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:45:06.180499 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cb8a6ece-9652-487c-aba0-88268daa7282 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:45:06.181202 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cb8a6ece-9652-487c-aba0-88268daa7282 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:45:06.182282 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cb8a6ece-9652-487c-aba0-88268daa7282 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:45:06.182805 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cb8a6ece-9652-487c-aba0-88268daa7282 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:45:06.195852 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-cb8a6ece-9652-487c-aba0-88268daa7282 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] HTTP exception thrown: Instance 1de4d8bc-8768-4b1e-b90f-5e8d2dc5bb07 could not be found. Aug 10 23:45:06.197569 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-cb8a6ece-9652-487c-aba0-88268daa7282 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Request method failure captured: Aug 10 23:45:06.197569 n-d-850468-14 devstack@n-api.service[122633]: request: GET /compute/v2.1/servers/1de4d8bc-8768-4b1e-b90f-5e8d2dc5bb07 HTTP/1.1 Aug 10 23:45:06.197569 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:45:06.197569 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:45:06.197569 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:45:06.197569 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:45:06.197569 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:45:06.197569 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:45:06.197569 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:45:06.197569 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:45:06.197569 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9EF3JcALvIu97mWIb2swBcyDTxDI5PJ3vU9Ry5AtFPunVTcpAqQQUjRv0EmIlEp13u4BOFv0aTDkpyifGo3ChPE2BfANGKPVxkJ3JhuTa-9TLVCXxNdBMfkJGfbXf6wm_Y7u9vFxLHJ5-XazgQxDfOp_ueAQ4sa5cZKpoVrdkbUR3Jc Aug 10 23:45:06.197569 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:45:06.197569 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:45:06.197569 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:45:06.197569 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:45:06.197569 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:45:06.197569 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:45:06.197569 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 0b22838d50dd4ea8811953e723d0c052 Aug 10 23:45:06.197569 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-TestVolumeBootPattern-991439424 Aug 10 23:45:06.197569 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:45:06.197569 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:45:06.197569 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0b22838d50dd4ea8811953e723d0c052"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0b22838d50dd4ea8811953e723d0c052"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/0b22838d50dd4ea8811953e723d0c052"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_0b22838d50dd4ea8811953e723d0c052", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:45:06.197569 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-TestVolumeBootPattern-991439424 Aug 10 23:45:06.197569 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 0b22838d50dd4ea8811953e723d0c052 Aug 10 23:45:06.197569 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-TestVolumeBootPattern-991439424 Aug 10 23:45:06.197569 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-TestVolumeBootPattern-991439424-project Aug 10 23:45:06.197569 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:45:06.197569 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:45:06.197569 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: e97e9cddb55649809a9cd16dbc43bb7e Aug 10 23:45:06.197569 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-TestVolumeBootPattern-991439424-project Aug 10 23:45:06.197569 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:45:06.197569 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance 1de4d8bc-8768-4b1e-b90f-5e8d2dc5bb07 could not be found. Aug 10 23:45:06.197569 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': '1de4d8bc-8768-4b1e-b90f-5e8d2dc5bb07'} Aug 10 23:45:06.197569 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:45:06.197569 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:45:06.197569 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:45:06.197569 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:45:06.197569 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:45:06.197569 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:45:06.197569 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:45:06.197569 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:45:06.197569 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:45:06.197569 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:45:06.197569 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1de4d8bc-8768-4b1e-b90f-5e8d2dc5bb07 could not be found. Aug 10 23:45:06.197569 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:45:06.197569 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:45:06.197569 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:45:06.197569 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:45:06.197569 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:45:06.197569 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:45:06.197569 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:45:06.197569 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:45:06.197569 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:45:06.197569 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:45:06.197569 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:45:06.197569 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:45:06.197569 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:45:06.197569 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:45:06.197569 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:45:06.197569 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:45:06.197569 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1de4d8bc-8768-4b1e-b90f-5e8d2dc5bb07 could not be found. Aug 10 23:45:06.197569 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:45:06.197569 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:45:06.197569 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:45:06.203260 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:45:06.203260 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:45:06.203260 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:45:06.203260 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:45:06.203260 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:45:06.203260 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1de4d8bc-8768-4b1e-b90f-5e8d2dc5bb07 could not be found. Aug 10 23:45:06.203260 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:45:06.203260 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-cb8a6ece-9652-487c-aba0-88268daa7282 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Returning 404 to user: Instance 1de4d8bc-8768-4b1e-b90f-5e8d2dc5bb07 could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:45:06.203260 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-cb8a6ece-9652-487c-aba0-88268daa7282 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/1de4d8bc-8768-4b1e-b90f-5e8d2dc5bb07" status: 404 len: 111 microversion: 2.1 time: 0.031077 Aug 10 23:45:06.203260 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3240/6272] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:45:06 2022] GET /compute/v2.1/servers/1de4d8bc-8768-4b1e-b90f-5e8d2dc5bb07 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:45:06.249758 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-1e8a4c1e-cc88-44a3-8c7d-f5a4613c31c7 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-539507517", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-299907508", "security_groups": [{"name": "tempest-secgroup-smoke-201473954"}], "block_device_mapping_v2": [{"uuid": "ac6cb603-33b7-45a5-aa9b-cd13c24271a3", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "5ed0a190-471f-4749-aff5-4f68f1343451"}]}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:45:06.368217 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.network.neutron [None req-1e8a4c1e-cc88-44a3-8c7d-f5a4613c31c7 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] validate_networks() for [('5ed0a190-471f-4749-aff5-4f68f1343451', None, None, None, None, None)] {{(pid=122632) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 23:45:06.760834 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-1e8a4c1e-cc88-44a3-8c7d-f5a4613c31c7 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Flavor limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:45:06.761263 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-1e8a4c1e-cc88-44a3-8c7d-f5a4613c31c7 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Image limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:45:06.761738 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-1e8a4c1e-cc88-44a3-8c7d-f5a4613c31c7 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Flavor pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:45:06.762212 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-1e8a4c1e-cc88-44a3-8c7d-f5a4613c31c7 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Image pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:45:06.762620 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-1e8a4c1e-cc88-44a3-8c7d-f5a4613c31c7 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:45:06.771400 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1e8a4c1e-cc88-44a3-8c7d-f5a4613c31c7 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:45:06.771879 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1e8a4c1e-cc88-44a3-8c7d-f5a4613c31c7 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:45:06.772317 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1e8a4c1e-cc88-44a3-8c7d-f5a4613c31c7 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:45:06.773039 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1e8a4c1e-cc88-44a3-8c7d-f5a4613c31c7 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:45:06.773495 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1e8a4c1e-cc88-44a3-8c7d-f5a4613c31c7 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:45:06.773916 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1e8a4c1e-cc88-44a3-8c7d-f5a4613c31c7 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:45:06.791803 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-1e8a4c1e-cc88-44a3-8c7d-f5a4613c31c7 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Getting quotas for project 0b22838d50dd4ea8811953e723d0c052. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:45:06.797174 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-1e8a4c1e-cc88-44a3-8c7d-f5a4613c31c7 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Getting quotas for user e97e9cddb55649809a9cd16dbc43bb7e and project 0b22838d50dd4ea8811953e723d0c052. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:45:06.856732 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-1e8a4c1e-cc88-44a3-8c7d-f5a4613c31c7 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Going to run 1 instances... {{(pid=122632) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 23:45:06.858820 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-1e8a4c1e-cc88-44a3-8c7d-f5a4613c31c7 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 1afd4615-85fa-4647-ac55-6cc0ba2d1e65] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ac6cb603-33b7-45a5-aa9b-cd13c24271a3',volume_size=None,volume_type=None)] {{(pid=122632) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 23:45:06.986180 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-1e8a4c1e-cc88-44a3-8c7d-f5a4613c31c7 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.741255 Aug 10 23:45:06.986873 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3033/6273] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 23:45:06 2022] POST /compute/v2.1/servers => generated 405 bytes in 743 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 23:45:06.998474 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-eb07cc8b-49d8-4a9d-8974-854d5c2ebfa7 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:45:06.999130 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-eb07cc8b-49d8-4a9d-8974-854d5c2ebfa7 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 1afd4615-85fa-4647-ac55-6cc0ba2d1e65] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:45:07.056389 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-eb07cc8b-49d8-4a9d-8974-854d5c2ebfa7 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:45:07.065198 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-eb07cc8b-49d8-4a9d-8974-854d5c2ebfa7 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/1afd4615-85fa-4647-ac55-6cc0ba2d1e65" status: 200 len: 1093 microversion: 2.1 time: 0.071032 Aug 10 23:45:07.065785 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3241/6274] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:45:06 2022] GET /compute/v2.1/servers/1afd4615-85fa-4647-ac55-6cc0ba2d1e65 => generated 1093 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:45:08.087794 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-5245e0dd-c9cd-44ac-a021-3815a43e1c64 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:45:08.088983 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-5245e0dd-c9cd-44ac-a021-3815a43e1c64 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 1afd4615-85fa-4647-ac55-6cc0ba2d1e65] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:45:08.095290 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5245e0dd-c9cd-44ac-a021-3815a43e1c64 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:45:08.095799 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5245e0dd-c9cd-44ac-a021-3815a43e1c64 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:45:08.096218 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5245e0dd-c9cd-44ac-a021-3815a43e1c64 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:45:08.096938 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5245e0dd-c9cd-44ac-a021-3815a43e1c64 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:45:08.097378 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5245e0dd-c9cd-44ac-a021-3815a43e1c64 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:45:08.097944 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5245e0dd-c9cd-44ac-a021-3815a43e1c64 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:45:08.163632 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-5245e0dd-c9cd-44ac-a021-3815a43e1c64 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:45:08.174049 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-5245e0dd-c9cd-44ac-a021-3815a43e1c64 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/1afd4615-85fa-4647-ac55-6cc0ba2d1e65" status: 200 len: 1209 microversion: 2.1 time: 0.091180 Aug 10 23:45:08.174844 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3034/6275] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:45:08 2022] GET /compute/v2.1/servers/1afd4615-85fa-4647-ac55-6cc0ba2d1e65 => generated 1209 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:45:09.195834 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-85799a05-6f36-4844-9447-1f971f942eb7 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:45:09.196702 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-85799a05-6f36-4844-9447-1f971f942eb7 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 1afd4615-85fa-4647-ac55-6cc0ba2d1e65] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:45:09.206990 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-85799a05-6f36-4844-9447-1f971f942eb7 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:45:09.207742 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-85799a05-6f36-4844-9447-1f971f942eb7 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:45:09.208377 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-85799a05-6f36-4844-9447-1f971f942eb7 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:45:09.209361 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-85799a05-6f36-4844-9447-1f971f942eb7 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:45:09.210372 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-85799a05-6f36-4844-9447-1f971f942eb7 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:45:09.211117 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-85799a05-6f36-4844-9447-1f971f942eb7 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:45:09.408728 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-85799a05-6f36-4844-9447-1f971f942eb7 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:45:09.418031 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-85799a05-6f36-4844-9447-1f971f942eb7 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/1afd4615-85fa-4647-ac55-6cc0ba2d1e65" status: 200 len: 1276 microversion: 2.1 time: 0.225794 Aug 10 23:45:09.419387 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3242/6276] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:45:09 2022] GET /compute/v2.1/servers/1afd4615-85fa-4647-ac55-6cc0ba2d1e65 => generated 1276 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:45:09.500904 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-7748e07d-f8cb-4e13-bfb7-52e24c31bc7a req-34917ce9-c880-43eb-8381-62267d3fed37 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1afd4615-85fa-4647-ac55-6cc0ba2d1e65", "tag": "63d0677d-f478-45a5-adb9-f172b112f293"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:45:09.524003 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-7748e07d-f8cb-4e13-bfb7-52e24c31bc7a req-34917ce9-c880-43eb-8381-62267d3fed37 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:45:09.526685 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-7748e07d-f8cb-4e13-bfb7-52e24c31bc7a req-34917ce9-c880-43eb-8381-62267d3fed37 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:45:09.527159 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-7748e07d-f8cb-4e13-bfb7-52e24c31bc7a req-34917ce9-c880-43eb-8381-62267d3fed37 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:45:09.545761 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-7748e07d-f8cb-4e13-bfb7-52e24c31bc7a req-34917ce9-c880-43eb-8381-62267d3fed37 service nova] Creating event network-changed:63d0677d-f478-45a5-adb9-f172b112f293 for instance 1afd4615-85fa-4647-ac55-6cc0ba2d1e65 on n-h1-850468-14 Aug 10 23:45:09.551574 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-7748e07d-f8cb-4e13-bfb7-52e24c31bc7a req-34917ce9-c880-43eb-8381-62267d3fed37 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055507 Aug 10 23:45:09.552820 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3035/6277] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:45:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:45:10.439737 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-e9ce1529-b6bb-49a5-a627-1b581dbd102b tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:45:10.441067 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-e9ce1529-b6bb-49a5-a627-1b581dbd102b tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 1afd4615-85fa-4647-ac55-6cc0ba2d1e65] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:45:10.449387 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e9ce1529-b6bb-49a5-a627-1b581dbd102b tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:45:10.450200 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e9ce1529-b6bb-49a5-a627-1b581dbd102b tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:45:10.450875 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e9ce1529-b6bb-49a5-a627-1b581dbd102b tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:45:10.451637 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e9ce1529-b6bb-49a5-a627-1b581dbd102b tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:45:10.452297 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e9ce1529-b6bb-49a5-a627-1b581dbd102b tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:45:10.452921 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e9ce1529-b6bb-49a5-a627-1b581dbd102b tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:45:10.601502 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-e9ce1529-b6bb-49a5-a627-1b581dbd102b tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:45:10.609295 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-e9ce1529-b6bb-49a5-a627-1b581dbd102b tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/1afd4615-85fa-4647-ac55-6cc0ba2d1e65" status: 200 len: 1276 microversion: 2.1 time: 0.174547 Aug 10 23:45:10.609880 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3243/6278] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:45:10 2022] GET /compute/v2.1/servers/1afd4615-85fa-4647-ac55-6cc0ba2d1e65 => generated 1276 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:45:11.632440 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-9f1877d6-2b56-4b7c-a247-b42436fbedef tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:45:11.633097 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-9f1877d6-2b56-4b7c-a247-b42436fbedef tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 1afd4615-85fa-4647-ac55-6cc0ba2d1e65] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:45:11.640845 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9f1877d6-2b56-4b7c-a247-b42436fbedef tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:45:11.641337 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9f1877d6-2b56-4b7c-a247-b42436fbedef tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:45:11.641780 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9f1877d6-2b56-4b7c-a247-b42436fbedef tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:45:11.642482 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9f1877d6-2b56-4b7c-a247-b42436fbedef tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:45:11.642969 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9f1877d6-2b56-4b7c-a247-b42436fbedef tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:45:11.643398 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9f1877d6-2b56-4b7c-a247-b42436fbedef tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:45:11.780156 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-9f1877d6-2b56-4b7c-a247-b42436fbedef tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:45:11.788250 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-9f1877d6-2b56-4b7c-a247-b42436fbedef tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/1afd4615-85fa-4647-ac55-6cc0ba2d1e65" status: 200 len: 1276 microversion: 2.1 time: 0.160979 Aug 10 23:45:11.788857 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3036/6279] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:45:11 2022] GET /compute/v2.1/servers/1afd4615-85fa-4647-ac55-6cc0ba2d1e65 => generated 1276 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:45:12.810557 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-8130a3f7-3e8c-4990-af0b-dce16601089a tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:45:12.811232 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-8130a3f7-3e8c-4990-af0b-dce16601089a tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 1afd4615-85fa-4647-ac55-6cc0ba2d1e65] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:45:12.818492 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8130a3f7-3e8c-4990-af0b-dce16601089a tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:45:12.819075 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8130a3f7-3e8c-4990-af0b-dce16601089a tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:45:12.819534 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8130a3f7-3e8c-4990-af0b-dce16601089a tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:45:12.820262 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8130a3f7-3e8c-4990-af0b-dce16601089a tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:45:12.820737 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8130a3f7-3e8c-4990-af0b-dce16601089a tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:45:12.821183 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8130a3f7-3e8c-4990-af0b-dce16601089a tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:45:12.964359 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-8130a3f7-3e8c-4990-af0b-dce16601089a tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:45:12.972283 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-8130a3f7-3e8c-4990-af0b-dce16601089a tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/1afd4615-85fa-4647-ac55-6cc0ba2d1e65" status: 200 len: 1276 microversion: 2.1 time: 0.166719 Aug 10 23:45:12.972862 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3244/6280] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:45:12 2022] GET /compute/v2.1/servers/1afd4615-85fa-4647-ac55-6cc0ba2d1e65 => generated 1276 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:45:13.993501 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-0bd1f001-f83e-4e0c-90e5-82537cb46bb2 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:45:13.994766 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-0bd1f001-f83e-4e0c-90e5-82537cb46bb2 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 1afd4615-85fa-4647-ac55-6cc0ba2d1e65] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:45:14.001640 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0bd1f001-f83e-4e0c-90e5-82537cb46bb2 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:45:14.002122 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0bd1f001-f83e-4e0c-90e5-82537cb46bb2 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:45:14.002558 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0bd1f001-f83e-4e0c-90e5-82537cb46bb2 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:45:14.003290 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0bd1f001-f83e-4e0c-90e5-82537cb46bb2 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:45:14.003744 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0bd1f001-f83e-4e0c-90e5-82537cb46bb2 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:45:14.004169 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0bd1f001-f83e-4e0c-90e5-82537cb46bb2 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:45:14.139694 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-0bd1f001-f83e-4e0c-90e5-82537cb46bb2 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:45:14.147304 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-0bd1f001-f83e-4e0c-90e5-82537cb46bb2 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/1afd4615-85fa-4647-ac55-6cc0ba2d1e65" status: 200 len: 1264 microversion: 2.1 time: 0.157680 Aug 10 23:45:14.147880 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3037/6281] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:45:13 2022] GET /compute/v2.1/servers/1afd4615-85fa-4647-ac55-6cc0ba2d1e65 => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:45:15.168826 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-41f56fb0-892b-4427-8fd6-ed40be8a8636 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:45:15.169455 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-41f56fb0-892b-4427-8fd6-ed40be8a8636 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 1afd4615-85fa-4647-ac55-6cc0ba2d1e65] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:45:15.176388 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-41f56fb0-892b-4427-8fd6-ed40be8a8636 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:45:15.176889 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-41f56fb0-892b-4427-8fd6-ed40be8a8636 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:45:15.177343 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-41f56fb0-892b-4427-8fd6-ed40be8a8636 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:45:15.178053 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-41f56fb0-892b-4427-8fd6-ed40be8a8636 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:45:15.178529 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-41f56fb0-892b-4427-8fd6-ed40be8a8636 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:45:15.179016 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-41f56fb0-892b-4427-8fd6-ed40be8a8636 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:45:15.315646 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-41f56fb0-892b-4427-8fd6-ed40be8a8636 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:45:15.323725 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-41f56fb0-892b-4427-8fd6-ed40be8a8636 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/1afd4615-85fa-4647-ac55-6cc0ba2d1e65" status: 200 len: 1264 microversion: 2.1 time: 0.159344 Aug 10 23:45:15.324293 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3245/6282] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:45:15 2022] GET /compute/v2.1/servers/1afd4615-85fa-4647-ac55-6cc0ba2d1e65 => generated 1264 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:45:16.344001 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-59b14a03-e7a2-4bf0-8c09-0f889a64e87c tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:45:16.344691 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-59b14a03-e7a2-4bf0-8c09-0f889a64e87c tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 1afd4615-85fa-4647-ac55-6cc0ba2d1e65] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:45:16.351422 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-59b14a03-e7a2-4bf0-8c09-0f889a64e87c tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:45:16.351900 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-59b14a03-e7a2-4bf0-8c09-0f889a64e87c tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:45:16.352332 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-59b14a03-e7a2-4bf0-8c09-0f889a64e87c tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:45:16.353018 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-59b14a03-e7a2-4bf0-8c09-0f889a64e87c tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:45:16.353494 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-59b14a03-e7a2-4bf0-8c09-0f889a64e87c tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:45:16.354228 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-59b14a03-e7a2-4bf0-8c09-0f889a64e87c tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:45:16.488055 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-59b14a03-e7a2-4bf0-8c09-0f889a64e87c tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:45:16.496149 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-59b14a03-e7a2-4bf0-8c09-0f889a64e87c tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/1afd4615-85fa-4647-ac55-6cc0ba2d1e65" status: 200 len: 1264 microversion: 2.1 time: 0.156024 Aug 10 23:45:16.496725 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3038/6283] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:45:16 2022] GET /compute/v2.1/servers/1afd4615-85fa-4647-ac55-6cc0ba2d1e65 => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:45:17.517714 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-3c45f04a-c79d-468f-b0e7-190ef0456dcd tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:45:17.518393 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-3c45f04a-c79d-468f-b0e7-190ef0456dcd tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 1afd4615-85fa-4647-ac55-6cc0ba2d1e65] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:45:17.521294 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=2 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:45:17.528418 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3c45f04a-c79d-468f-b0e7-190ef0456dcd tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:45:17.528918 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3c45f04a-c79d-468f-b0e7-190ef0456dcd tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:45:17.529365 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3c45f04a-c79d-468f-b0e7-190ef0456dcd tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:45:17.530106 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3c45f04a-c79d-468f-b0e7-190ef0456dcd tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:45:17.530566 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3c45f04a-c79d-468f-b0e7-190ef0456dcd tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:45:17.531026 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3c45f04a-c79d-468f-b0e7-190ef0456dcd tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:45:17.664149 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-3c45f04a-c79d-468f-b0e7-190ef0456dcd tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:45:17.673350 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-3c45f04a-c79d-468f-b0e7-190ef0456dcd tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/1afd4615-85fa-4647-ac55-6cc0ba2d1e65" status: 200 len: 1264 microversion: 2.1 time: 0.160092 Aug 10 23:45:17.673924 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3246/6284] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:45:17 2022] GET /compute/v2.1/servers/1afd4615-85fa-4647-ac55-6cc0ba2d1e65 => generated 1264 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:45:18.694518 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-57aacaec-c903-4572-9b95-47b6251a6b51 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:45:18.695151 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-57aacaec-c903-4572-9b95-47b6251a6b51 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 1afd4615-85fa-4647-ac55-6cc0ba2d1e65] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:45:18.697086 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=2 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:45:18.698434 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=6 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:45:18.704983 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-57aacaec-c903-4572-9b95-47b6251a6b51 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:45:18.705462 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-57aacaec-c903-4572-9b95-47b6251a6b51 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:45:18.705895 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-57aacaec-c903-4572-9b95-47b6251a6b51 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:45:18.706583 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-57aacaec-c903-4572-9b95-47b6251a6b51 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:45:18.707067 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-57aacaec-c903-4572-9b95-47b6251a6b51 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:45:18.707488 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-57aacaec-c903-4572-9b95-47b6251a6b51 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:45:18.852676 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-57aacaec-c903-4572-9b95-47b6251a6b51 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:45:18.861308 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-57aacaec-c903-4572-9b95-47b6251a6b51 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/1afd4615-85fa-4647-ac55-6cc0ba2d1e65" status: 200 len: 1264 microversion: 2.1 time: 0.170666 Aug 10 23:45:18.861880 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3039/6285] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:45:18 2022] GET /compute/v2.1/servers/1afd4615-85fa-4647-ac55-6cc0ba2d1e65 => generated 1264 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:45:19.886348 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-112b1b4d-bc01-423a-985e-7819a318d63d tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:45:19.887005 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-112b1b4d-bc01-423a-985e-7819a318d63d tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 1afd4615-85fa-4647-ac55-6cc0ba2d1e65] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:45:19.893867 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-112b1b4d-bc01-423a-985e-7819a318d63d tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:45:19.894367 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-112b1b4d-bc01-423a-985e-7819a318d63d tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:45:19.894841 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-112b1b4d-bc01-423a-985e-7819a318d63d tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:45:19.895557 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-112b1b4d-bc01-423a-985e-7819a318d63d tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:45:19.896024 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-112b1b4d-bc01-423a-985e-7819a318d63d tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:45:19.896459 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-112b1b4d-bc01-423a-985e-7819a318d63d tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:45:20.033663 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-112b1b4d-bc01-423a-985e-7819a318d63d tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:45:20.041590 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-112b1b4d-bc01-423a-985e-7819a318d63d tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/1afd4615-85fa-4647-ac55-6cc0ba2d1e65" status: 200 len: 1264 microversion: 2.1 time: 0.159685 Aug 10 23:45:20.042384 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3247/6286] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:45:19 2022] GET /compute/v2.1/servers/1afd4615-85fa-4647-ac55-6cc0ba2d1e65 => generated 1264 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:45:21.062252 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-9648875a-d444-448e-97b2-529467b05f50 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:45:21.062893 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-9648875a-d444-448e-97b2-529467b05f50 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 1afd4615-85fa-4647-ac55-6cc0ba2d1e65] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:45:21.069761 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9648875a-d444-448e-97b2-529467b05f50 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:45:21.070248 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9648875a-d444-448e-97b2-529467b05f50 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:45:21.070692 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9648875a-d444-448e-97b2-529467b05f50 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:45:21.071417 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9648875a-d444-448e-97b2-529467b05f50 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:45:21.071873 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9648875a-d444-448e-97b2-529467b05f50 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:45:21.072306 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9648875a-d444-448e-97b2-529467b05f50 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:45:21.205972 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-9648875a-d444-448e-97b2-529467b05f50 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:45:21.214098 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-9648875a-d444-448e-97b2-529467b05f50 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/1afd4615-85fa-4647-ac55-6cc0ba2d1e65" status: 200 len: 1264 microversion: 2.1 time: 0.155693 Aug 10 23:45:21.214671 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3040/6287] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:45:21 2022] GET /compute/v2.1/servers/1afd4615-85fa-4647-ac55-6cc0ba2d1e65 => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:45:21.926903 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-def1248e-f0de-4fdb-a689-6b003c87b494 req-0ac40163-33e2-4d78-a0e0-4fd3e55357fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1afd4615-85fa-4647-ac55-6cc0ba2d1e65", "name": "network-vif-plugged", "status": "completed", "tag": "63d0677d-f478-45a5-adb9-f172b112f293"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:45:21.940379 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-def1248e-f0de-4fdb-a689-6b003c87b494 req-0ac40163-33e2-4d78-a0e0-4fd3e55357fd service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:45:21.941148 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-def1248e-f0de-4fdb-a689-6b003c87b494 req-0ac40163-33e2-4d78-a0e0-4fd3e55357fd service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:45:21.941888 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-def1248e-f0de-4fdb-a689-6b003c87b494 req-0ac40163-33e2-4d78-a0e0-4fd3e55357fd service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:45:21.953970 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-def1248e-f0de-4fdb-a689-6b003c87b494 req-0ac40163-33e2-4d78-a0e0-4fd3e55357fd service nova] Creating event network-vif-plugged:63d0677d-f478-45a5-adb9-f172b112f293 for instance 1afd4615-85fa-4647-ac55-6cc0ba2d1e65 on n-h1-850468-14 Aug 10 23:45:21.959053 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-def1248e-f0de-4fdb-a689-6b003c87b494 req-0ac40163-33e2-4d78-a0e0-4fd3e55357fd service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035914 Aug 10 23:45:21.960043 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3248/6288] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:45:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:45:22.237374 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c2d925c2-38d4-446f-808c-108420e1db9a tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:45:22.238234 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-c2d925c2-38d4-446f-808c-108420e1db9a tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 1afd4615-85fa-4647-ac55-6cc0ba2d1e65] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:45:22.247000 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c2d925c2-38d4-446f-808c-108420e1db9a tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:45:22.247492 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c2d925c2-38d4-446f-808c-108420e1db9a tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:45:22.247935 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c2d925c2-38d4-446f-808c-108420e1db9a tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:45:22.248642 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c2d925c2-38d4-446f-808c-108420e1db9a tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:45:22.249098 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c2d925c2-38d4-446f-808c-108420e1db9a tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:45:22.249537 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c2d925c2-38d4-446f-808c-108420e1db9a tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:45:22.382847 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-c2d925c2-38d4-446f-808c-108420e1db9a tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:45:22.391674 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-c2d925c2-38d4-446f-808c-108420e1db9a tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/1afd4615-85fa-4647-ac55-6cc0ba2d1e65" status: 200 len: 1264 microversion: 2.1 time: 0.160208 Aug 10 23:45:22.392269 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3041/6289] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:45:22 2022] GET /compute/v2.1/servers/1afd4615-85fa-4647-ac55-6cc0ba2d1e65 => generated 1264 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:45:23.414765 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-9b6295a5-f28d-429b-939c-9b3aae772150 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:45:23.415500 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-9b6295a5-f28d-429b-939c-9b3aae772150 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 1afd4615-85fa-4647-ac55-6cc0ba2d1e65] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:45:23.421853 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9b6295a5-f28d-429b-939c-9b3aae772150 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:45:23.422381 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9b6295a5-f28d-429b-939c-9b3aae772150 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:45:23.422863 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9b6295a5-f28d-429b-939c-9b3aae772150 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:45:23.423608 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9b6295a5-f28d-429b-939c-9b3aae772150 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:45:23.425104 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9b6295a5-f28d-429b-939c-9b3aae772150 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:45:23.425551 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9b6295a5-f28d-429b-939c-9b3aae772150 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:45:23.563891 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-9b6295a5-f28d-429b-939c-9b3aae772150 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:45:23.571473 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-9b6295a5-f28d-429b-939c-9b3aae772150 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/1afd4615-85fa-4647-ac55-6cc0ba2d1e65" status: 200 len: 1451 microversion: 2.1 time: 0.161789 Aug 10 23:45:23.572141 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3249/6290] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:45:23 2022] GET /compute/v2.1/servers/1afd4615-85fa-4647-ac55-6cc0ba2d1e65 => generated 1451 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:45:23.592207 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-a56aa9ec-9db4-4ff2-8447-86e6b9d470cb tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:45:23.592877 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-a56aa9ec-9db4-4ff2-8447-86e6b9d470cb tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 1afd4615-85fa-4647-ac55-6cc0ba2d1e65] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:45:23.599779 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a56aa9ec-9db4-4ff2-8447-86e6b9d470cb tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:45:23.600266 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a56aa9ec-9db4-4ff2-8447-86e6b9d470cb tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:45:23.600707 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a56aa9ec-9db4-4ff2-8447-86e6b9d470cb tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:45:23.601405 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a56aa9ec-9db4-4ff2-8447-86e6b9d470cb tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:45:23.601863 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a56aa9ec-9db4-4ff2-8447-86e6b9d470cb tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:45:23.602291 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a56aa9ec-9db4-4ff2-8447-86e6b9d470cb tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:45:23.745406 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-a56aa9ec-9db4-4ff2-8447-86e6b9d470cb tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:45:23.753028 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-a56aa9ec-9db4-4ff2-8447-86e6b9d470cb tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/1afd4615-85fa-4647-ac55-6cc0ba2d1e65" status: 200 len: 1451 microversion: 2.1 time: 0.164956 Aug 10 23:45:23.753597 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3042/6291] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:45:23 2022] GET /compute/v2.1/servers/1afd4615-85fa-4647-ac55-6cc0ba2d1e65 => generated 1451 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:45:25.857365 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-d1a889db-2153-4216-9df2-f6b79f42b280 req-74abbad0-07da-4ed0-a9d3-6b3a53ffb658 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1afd4615-85fa-4647-ac55-6cc0ba2d1e65", "tag": "63d0677d-f478-45a5-adb9-f172b112f293"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:45:25.867725 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-d1a889db-2153-4216-9df2-f6b79f42b280 req-74abbad0-07da-4ed0-a9d3-6b3a53ffb658 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:45:25.868214 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-d1a889db-2153-4216-9df2-f6b79f42b280 req-74abbad0-07da-4ed0-a9d3-6b3a53ffb658 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:45:25.868657 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-d1a889db-2153-4216-9df2-f6b79f42b280 req-74abbad0-07da-4ed0-a9d3-6b3a53ffb658 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:45:25.880625 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-d1a889db-2153-4216-9df2-f6b79f42b280 req-74abbad0-07da-4ed0-a9d3-6b3a53ffb658 service nova] Creating event network-changed:63d0677d-f478-45a5-adb9-f172b112f293 for instance 1afd4615-85fa-4647-ac55-6cc0ba2d1e65 on n-h1-850468-14 Aug 10 23:45:25.886957 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-d1a889db-2153-4216-9df2-f6b79f42b280 req-74abbad0-07da-4ed0-a9d3-6b3a53ffb658 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033227 Aug 10 23:45:25.887549 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3250/6292] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:45:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 23:45:28.566411 n-d-850468-14 devstack@n-api.service[122633]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 23:45:28.567064 n-d-850468-14 devstack@n-api.service[122633]: Wed Aug 10 23:45:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 23:45:29.253043 n-d-850468-14 devstack@n-api.service[122632]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 23:45:29.253480 n-d-850468-14 devstack@n-api.service[122632]: Wed Aug 10 23:45:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 23:47:08.573432 n-d-850468-14 devstack@n-api.service[122633]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 23:47:08.573903 n-d-850468-14 devstack@n-api.service[122633]: Wed Aug 10 23:47:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 23:47:09.366653 n-d-850468-14 devstack@n-api.service[122632]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 23:47:09.367541 n-d-850468-14 devstack@n-api.service[122632]: Wed Aug 10 23:47:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 23:47:16.821433 n-d-850468-14 devstack@n-api.service[122632]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6aef4e7e-e576-4aec-8e05-1d4d3b8b22c0] AMQP server on 10.222.0.58:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 10 23:47:16.822294 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:47:16.823106 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:47:16.827127 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-aa5da587-9f08-4fb9-a180-f7efe7f4aaeb tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1851650408", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-299907508", "security_groups": [{"name": "tempest-secgroup-smoke-201473954"}], "block_device_mapping_v2": [{"uuid": "81c18a85-e2ea-4f62-be6e-9be2aa83478b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "5ed0a190-471f-4749-aff5-4f68f1343451"}]}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:47:17.073886 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.network.neutron [None req-aa5da587-9f08-4fb9-a180-f7efe7f4aaeb tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] validate_networks() for [('5ed0a190-471f-4749-aff5-4f68f1343451', None, None, None, None, None)] {{(pid=122632) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 23:47:17.495417 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-aa5da587-9f08-4fb9-a180-f7efe7f4aaeb tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Flavor limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:47:17.495835 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-aa5da587-9f08-4fb9-a180-f7efe7f4aaeb tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Image limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:47:17.496297 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-aa5da587-9f08-4fb9-a180-f7efe7f4aaeb tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Flavor pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:47:17.496699 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-aa5da587-9f08-4fb9-a180-f7efe7f4aaeb tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Image pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:47:17.497104 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-aa5da587-9f08-4fb9-a180-f7efe7f4aaeb tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:47:17.507098 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-aa5da587-9f08-4fb9-a180-f7efe7f4aaeb tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:47:17.507577 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-aa5da587-9f08-4fb9-a180-f7efe7f4aaeb tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:47:17.508011 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-aa5da587-9f08-4fb9-a180-f7efe7f4aaeb tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:47:17.508742 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-aa5da587-9f08-4fb9-a180-f7efe7f4aaeb tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:47:17.509181 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-aa5da587-9f08-4fb9-a180-f7efe7f4aaeb tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:47:17.509605 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-aa5da587-9f08-4fb9-a180-f7efe7f4aaeb tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:47:17.528455 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-aa5da587-9f08-4fb9-a180-f7efe7f4aaeb tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Getting quotas for project 0b22838d50dd4ea8811953e723d0c052. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:47:17.533838 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-aa5da587-9f08-4fb9-a180-f7efe7f4aaeb tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Getting quotas for user e97e9cddb55649809a9cd16dbc43bb7e and project 0b22838d50dd4ea8811953e723d0c052. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:47:17.592790 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-aa5da587-9f08-4fb9-a180-f7efe7f4aaeb tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Going to run 1 instances... {{(pid=122632) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 23:47:17.595017 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-aa5da587-9f08-4fb9-a180-f7efe7f4aaeb tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 4c42bc3c-207b-4559-8d91-db50042c4286] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='81c18a85-e2ea-4f62-be6e-9be2aa83478b',volume_size=None,volume_type=None)] {{(pid=122632) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 23:47:17.722604 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-aa5da587-9f08-4fb9-a180-f7efe7f4aaeb tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.903094 Aug 10 23:47:17.723508 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3043/6293] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 23:47:16 2022] POST /compute/v2.1/servers => generated 405 bytes in 904 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 23:47:17.732802 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_api:SELECT=32 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:47:17.733599 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=68 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:47:17.739030 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-ee30eae2-11e9-4611-8145-c8c15098ef10 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:47:17.740411 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-ee30eae2-11e9-4611-8145-c8c15098ef10 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 4c42bc3c-207b-4559-8d91-db50042c4286] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:47:17.899438 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-ee30eae2-11e9-4611-8145-c8c15098ef10 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:47:17.906583 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-ee30eae2-11e9-4611-8145-c8c15098ef10 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/4c42bc3c-207b-4559-8d91-db50042c4286" status: 200 len: 1094 microversion: 2.1 time: 0.176129 Aug 10 23:47:17.907248 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3251/6294] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:47:17 2022] GET /compute/v2.1/servers/4c42bc3c-207b-4559-8d91-db50042c4286 => generated 1094 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:47:18.930880 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-ea5ea8e7-cfd9-45c4-8b3c-5e14b8348b0e tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:47:18.931988 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-ea5ea8e7-cfd9-45c4-8b3c-5e14b8348b0e tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 4c42bc3c-207b-4559-8d91-db50042c4286] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:47:18.939377 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ea5ea8e7-cfd9-45c4-8b3c-5e14b8348b0e tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:47:18.939867 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ea5ea8e7-cfd9-45c4-8b3c-5e14b8348b0e tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:47:18.940306 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ea5ea8e7-cfd9-45c4-8b3c-5e14b8348b0e tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:47:18.941037 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ea5ea8e7-cfd9-45c4-8b3c-5e14b8348b0e tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:47:18.941838 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ea5ea8e7-cfd9-45c4-8b3c-5e14b8348b0e tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:47:18.941993 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ea5ea8e7-cfd9-45c4-8b3c-5e14b8348b0e tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:47:18.948662 n-d-850468-14 devstack@n-api.service[122632]: INFO oslo.messaging._drivers.impl_rabbit [-] [6aef4e7e-e576-4aec-8e05-1d4d3b8b22c0] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 36440. Aug 10 23:47:19.016310 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-ea5ea8e7-cfd9-45c4-8b3c-5e14b8348b0e tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:47:19.026638 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-ea5ea8e7-cfd9-45c4-8b3c-5e14b8348b0e tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/4c42bc3c-207b-4559-8d91-db50042c4286" status: 200 len: 1210 microversion: 2.1 time: 0.101782 Aug 10 23:47:19.032280 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3044/6295] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:47:18 2022] GET /compute/v2.1/servers/4c42bc3c-207b-4559-8d91-db50042c4286 => generated 1210 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:47:20.048198 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-62172f01-a34b-4d30-8fd0-8097ccd75291 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:47:20.048836 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-62172f01-a34b-4d30-8fd0-8097ccd75291 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 4c42bc3c-207b-4559-8d91-db50042c4286] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:47:20.058288 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-62172f01-a34b-4d30-8fd0-8097ccd75291 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:47:20.058681 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-62172f01-a34b-4d30-8fd0-8097ccd75291 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:47:20.059851 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-62172f01-a34b-4d30-8fd0-8097ccd75291 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:47:20.060681 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-62172f01-a34b-4d30-8fd0-8097ccd75291 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:47:20.061151 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-62172f01-a34b-4d30-8fd0-8097ccd75291 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:47:20.061589 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-62172f01-a34b-4d30-8fd0-8097ccd75291 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:47:20.207630 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-62172f01-a34b-4d30-8fd0-8097ccd75291 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:47:20.216690 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-62172f01-a34b-4d30-8fd0-8097ccd75291 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/4c42bc3c-207b-4559-8d91-db50042c4286" status: 200 len: 1277 microversion: 2.1 time: 0.172535 Aug 10 23:47:20.217441 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3252/6296] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:47:20 2022] GET /compute/v2.1/servers/4c42bc3c-207b-4559-8d91-db50042c4286 => generated 1277 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:47:20.391411 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-134e1493-a68d-432b-912b-552ec7237e15 req-f4249748-42a2-4b7a-b87c-f3b950db8bbb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c42bc3c-207b-4559-8d91-db50042c4286", "tag": "00feeea1-083d-4322-b280-a0c90504fb83"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:47:20.404246 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-134e1493-a68d-432b-912b-552ec7237e15 req-f4249748-42a2-4b7a-b87c-f3b950db8bbb service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:47:20.404891 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-134e1493-a68d-432b-912b-552ec7237e15 req-f4249748-42a2-4b7a-b87c-f3b950db8bbb service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:47:20.405802 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-134e1493-a68d-432b-912b-552ec7237e15 req-f4249748-42a2-4b7a-b87c-f3b950db8bbb service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:47:20.421025 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-134e1493-a68d-432b-912b-552ec7237e15 req-f4249748-42a2-4b7a-b87c-f3b950db8bbb service nova] Creating event network-changed:00feeea1-083d-4322-b280-a0c90504fb83 for instance 4c42bc3c-207b-4559-8d91-db50042c4286 on n-h2-850468-14 Aug 10 23:47:20.426805 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-134e1493-a68d-432b-912b-552ec7237e15 req-f4249748-42a2-4b7a-b87c-f3b950db8bbb service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115828 Aug 10 23:47:20.427462 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3045/6297] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:47:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:47:21.239801 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-f6eed123-ee16-431e-9cfc-866abbb4a39b tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:47:21.241403 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-f6eed123-ee16-431e-9cfc-866abbb4a39b tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 4c42bc3c-207b-4559-8d91-db50042c4286] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:47:21.249821 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f6eed123-ee16-431e-9cfc-866abbb4a39b tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:47:21.250364 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f6eed123-ee16-431e-9cfc-866abbb4a39b tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:47:21.250928 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f6eed123-ee16-431e-9cfc-866abbb4a39b tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:47:21.251660 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f6eed123-ee16-431e-9cfc-866abbb4a39b tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:47:21.252136 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f6eed123-ee16-431e-9cfc-866abbb4a39b tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:47:21.252581 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f6eed123-ee16-431e-9cfc-866abbb4a39b tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:47:21.696071 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-f6eed123-ee16-431e-9cfc-866abbb4a39b tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:47:21.703861 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-f6eed123-ee16-431e-9cfc-866abbb4a39b tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/4c42bc3c-207b-4559-8d91-db50042c4286" status: 200 len: 1277 microversion: 2.1 time: 0.469630 Aug 10 23:47:21.704445 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3253/6298] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:47:21 2022] GET /compute/v2.1/servers/4c42bc3c-207b-4559-8d91-db50042c4286 => generated 1277 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:47:22.727365 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c87f30b2-863e-4e94-92f5-6e7deeb3fb6e tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:47:22.728071 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-c87f30b2-863e-4e94-92f5-6e7deeb3fb6e tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 4c42bc3c-207b-4559-8d91-db50042c4286] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:47:22.734611 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c87f30b2-863e-4e94-92f5-6e7deeb3fb6e tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:47:22.735132 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c87f30b2-863e-4e94-92f5-6e7deeb3fb6e tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:47:22.735579 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c87f30b2-863e-4e94-92f5-6e7deeb3fb6e tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:47:22.736280 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c87f30b2-863e-4e94-92f5-6e7deeb3fb6e tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:47:22.736739 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c87f30b2-863e-4e94-92f5-6e7deeb3fb6e tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:47:22.737203 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c87f30b2-863e-4e94-92f5-6e7deeb3fb6e tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:47:22.873209 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-c87f30b2-863e-4e94-92f5-6e7deeb3fb6e tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:47:22.881062 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-c87f30b2-863e-4e94-92f5-6e7deeb3fb6e tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/4c42bc3c-207b-4559-8d91-db50042c4286" status: 200 len: 1277 microversion: 2.1 time: 0.159417 Aug 10 23:47:22.881635 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3046/6299] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:47:22 2022] GET /compute/v2.1/servers/4c42bc3c-207b-4559-8d91-db50042c4286 => generated 1277 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:47:23.906579 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-029d2e84-53c5-4d9e-9dae-826310281776 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:47:23.907470 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-029d2e84-53c5-4d9e-9dae-826310281776 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 4c42bc3c-207b-4559-8d91-db50042c4286] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:47:23.918275 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-029d2e84-53c5-4d9e-9dae-826310281776 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:47:23.918806 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-029d2e84-53c5-4d9e-9dae-826310281776 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:47:23.919341 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-029d2e84-53c5-4d9e-9dae-826310281776 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:47:23.920070 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-029d2e84-53c5-4d9e-9dae-826310281776 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:47:23.920548 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-029d2e84-53c5-4d9e-9dae-826310281776 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:47:23.920988 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-029d2e84-53c5-4d9e-9dae-826310281776 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:47:24.062420 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-029d2e84-53c5-4d9e-9dae-826310281776 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:47:24.070267 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-029d2e84-53c5-4d9e-9dae-826310281776 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/4c42bc3c-207b-4559-8d91-db50042c4286" status: 200 len: 1277 microversion: 2.1 time: 0.169925 Aug 10 23:47:24.070758 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3254/6300] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:47:23 2022] GET /compute/v2.1/servers/4c42bc3c-207b-4559-8d91-db50042c4286 => generated 1277 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:47:25.090389 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-8d1e784a-1f9b-4d1a-95cb-9c4d4a1697cc tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:47:25.091014 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-8d1e784a-1f9b-4d1a-95cb-9c4d4a1697cc tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 4c42bc3c-207b-4559-8d91-db50042c4286] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:47:25.098184 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8d1e784a-1f9b-4d1a-95cb-9c4d4a1697cc tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:47:25.098662 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8d1e784a-1f9b-4d1a-95cb-9c4d4a1697cc tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:47:25.099125 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8d1e784a-1f9b-4d1a-95cb-9c4d4a1697cc tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:47:25.099814 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8d1e784a-1f9b-4d1a-95cb-9c4d4a1697cc tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:47:25.100267 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8d1e784a-1f9b-4d1a-95cb-9c4d4a1697cc tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:47:25.100693 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8d1e784a-1f9b-4d1a-95cb-9c4d4a1697cc tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:47:25.238681 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-8d1e784a-1f9b-4d1a-95cb-9c4d4a1697cc tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:47:25.246539 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-8d1e784a-1f9b-4d1a-95cb-9c4d4a1697cc tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/4c42bc3c-207b-4559-8d91-db50042c4286" status: 200 len: 1265 microversion: 2.1 time: 0.160052 Aug 10 23:47:25.247747 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3047/6301] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:47:25 2022] GET /compute/v2.1/servers/4c42bc3c-207b-4559-8d91-db50042c4286 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:47:26.268167 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-056e8384-9e1c-4044-beca-2c18a0d799b0 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:47:26.269400 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-056e8384-9e1c-4044-beca-2c18a0d799b0 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 4c42bc3c-207b-4559-8d91-db50042c4286] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:47:26.277244 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-056e8384-9e1c-4044-beca-2c18a0d799b0 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:47:26.277766 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-056e8384-9e1c-4044-beca-2c18a0d799b0 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:47:26.278209 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-056e8384-9e1c-4044-beca-2c18a0d799b0 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:47:26.279066 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-056e8384-9e1c-4044-beca-2c18a0d799b0 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:47:26.279658 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-056e8384-9e1c-4044-beca-2c18a0d799b0 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:47:26.280206 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-056e8384-9e1c-4044-beca-2c18a0d799b0 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:47:26.414955 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-056e8384-9e1c-4044-beca-2c18a0d799b0 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:47:26.422555 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-056e8384-9e1c-4044-beca-2c18a0d799b0 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/4c42bc3c-207b-4559-8d91-db50042c4286" status: 200 len: 1265 microversion: 2.1 time: 0.158279 Aug 10 23:47:26.423168 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3255/6302] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:47:26 2022] GET /compute/v2.1/servers/4c42bc3c-207b-4559-8d91-db50042c4286 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:47:27.444565 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c1ce87b7-d5f0-4054-bf6e-254c20b7f6d8 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:47:27.445161 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-c1ce87b7-d5f0-4054-bf6e-254c20b7f6d8 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 4c42bc3c-207b-4559-8d91-db50042c4286] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:47:27.452055 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c1ce87b7-d5f0-4054-bf6e-254c20b7f6d8 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:47:27.452543 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c1ce87b7-d5f0-4054-bf6e-254c20b7f6d8 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:47:27.452980 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c1ce87b7-d5f0-4054-bf6e-254c20b7f6d8 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:47:27.453674 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c1ce87b7-d5f0-4054-bf6e-254c20b7f6d8 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:47:27.454131 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c1ce87b7-d5f0-4054-bf6e-254c20b7f6d8 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:47:27.454558 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c1ce87b7-d5f0-4054-bf6e-254c20b7f6d8 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:47:27.516321 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=2 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:47:27.541304 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=6 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:47:27.603323 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-c1ce87b7-d5f0-4054-bf6e-254c20b7f6d8 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:47:27.610861 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-c1ce87b7-d5f0-4054-bf6e-254c20b7f6d8 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/4c42bc3c-207b-4559-8d91-db50042c4286" status: 200 len: 1265 microversion: 2.1 time: 0.170343 Aug 10 23:47:27.611430 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3048/6303] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:47:27 2022] GET /compute/v2.1/servers/4c42bc3c-207b-4559-8d91-db50042c4286 => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:47:28.634044 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-6fb75430-7155-4399-a127-5eaadc02499c tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:47:28.635052 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-6fb75430-7155-4399-a127-5eaadc02499c tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 4c42bc3c-207b-4559-8d91-db50042c4286] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:47:28.638493 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=2 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:47:28.646187 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6fb75430-7155-4399-a127-5eaadc02499c tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:47:28.646969 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6fb75430-7155-4399-a127-5eaadc02499c tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:47:28.647554 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6fb75430-7155-4399-a127-5eaadc02499c tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:47:28.648553 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6fb75430-7155-4399-a127-5eaadc02499c tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:47:28.649252 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6fb75430-7155-4399-a127-5eaadc02499c tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:47:28.649947 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6fb75430-7155-4399-a127-5eaadc02499c tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:47:28.801866 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-6fb75430-7155-4399-a127-5eaadc02499c tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:47:28.810724 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-6fb75430-7155-4399-a127-5eaadc02499c tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/4c42bc3c-207b-4559-8d91-db50042c4286" status: 200 len: 1265 microversion: 2.1 time: 0.181827 Aug 10 23:47:28.811469 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3256/6304] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:47:28 2022] GET /compute/v2.1/servers/4c42bc3c-207b-4559-8d91-db50042c4286 => generated 1265 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:47:29.832486 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-fa772265-615e-40e3-a72c-6f3ec1be82d7 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:47:29.833117 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-fa772265-615e-40e3-a72c-6f3ec1be82d7 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 4c42bc3c-207b-4559-8d91-db50042c4286] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:47:29.840915 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fa772265-615e-40e3-a72c-6f3ec1be82d7 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:47:29.841422 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fa772265-615e-40e3-a72c-6f3ec1be82d7 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:47:29.841871 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fa772265-615e-40e3-a72c-6f3ec1be82d7 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:47:29.842594 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fa772265-615e-40e3-a72c-6f3ec1be82d7 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:47:29.843095 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fa772265-615e-40e3-a72c-6f3ec1be82d7 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:47:29.843527 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fa772265-615e-40e3-a72c-6f3ec1be82d7 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:47:30.002422 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-fa772265-615e-40e3-a72c-6f3ec1be82d7 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:47:30.010518 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-fa772265-615e-40e3-a72c-6f3ec1be82d7 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/4c42bc3c-207b-4559-8d91-db50042c4286" status: 200 len: 1265 microversion: 2.1 time: 0.181964 Aug 10 23:47:30.011136 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3049/6305] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:47:29 2022] GET /compute/v2.1/servers/4c42bc3c-207b-4559-8d91-db50042c4286 => generated 1265 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:47:31.030441 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-ebd103d4-e38a-42f0-9a37-c8dc367ae218 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:47:31.031076 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-ebd103d4-e38a-42f0-9a37-c8dc367ae218 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 4c42bc3c-207b-4559-8d91-db50042c4286] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:47:31.037646 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ebd103d4-e38a-42f0-9a37-c8dc367ae218 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:47:31.038142 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ebd103d4-e38a-42f0-9a37-c8dc367ae218 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:47:31.038591 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ebd103d4-e38a-42f0-9a37-c8dc367ae218 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:47:31.039342 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ebd103d4-e38a-42f0-9a37-c8dc367ae218 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:47:31.039809 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ebd103d4-e38a-42f0-9a37-c8dc367ae218 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:47:31.040248 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ebd103d4-e38a-42f0-9a37-c8dc367ae218 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:47:31.174613 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-ebd103d4-e38a-42f0-9a37-c8dc367ae218 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:47:31.182722 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-ebd103d4-e38a-42f0-9a37-c8dc367ae218 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/4c42bc3c-207b-4559-8d91-db50042c4286" status: 200 len: 1265 microversion: 2.1 time: 0.156349 Aug 10 23:47:31.183326 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3257/6306] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:47:31 2022] GET /compute/v2.1/servers/4c42bc3c-207b-4559-8d91-db50042c4286 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:47:32.204606 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-3259ee6f-bec5-4161-a6f6-25fafb550c95 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:47:32.205219 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-3259ee6f-bec5-4161-a6f6-25fafb550c95 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 4c42bc3c-207b-4559-8d91-db50042c4286] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:47:32.213723 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3259ee6f-bec5-4161-a6f6-25fafb550c95 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:47:32.214276 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3259ee6f-bec5-4161-a6f6-25fafb550c95 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:47:32.214816 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3259ee6f-bec5-4161-a6f6-25fafb550c95 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:47:32.215522 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3259ee6f-bec5-4161-a6f6-25fafb550c95 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:47:32.216039 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3259ee6f-bec5-4161-a6f6-25fafb550c95 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:47:32.216539 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3259ee6f-bec5-4161-a6f6-25fafb550c95 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:47:32.360015 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-3259ee6f-bec5-4161-a6f6-25fafb550c95 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:47:32.369253 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-3259ee6f-bec5-4161-a6f6-25fafb550c95 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/4c42bc3c-207b-4559-8d91-db50042c4286" status: 200 len: 1265 microversion: 2.1 time: 0.168549 Aug 10 23:47:32.378954 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3050/6307] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:47:32 2022] GET /compute/v2.1/servers/4c42bc3c-207b-4559-8d91-db50042c4286 => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:47:33.390297 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-8bc97651-e77b-449c-97e6-6ea397e0876b tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:47:33.390956 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-8bc97651-e77b-449c-97e6-6ea397e0876b tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 4c42bc3c-207b-4559-8d91-db50042c4286] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:47:33.398294 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8bc97651-e77b-449c-97e6-6ea397e0876b tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:47:33.398824 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8bc97651-e77b-449c-97e6-6ea397e0876b tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:47:33.399379 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8bc97651-e77b-449c-97e6-6ea397e0876b tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:47:33.400110 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8bc97651-e77b-449c-97e6-6ea397e0876b tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:47:33.400582 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8bc97651-e77b-449c-97e6-6ea397e0876b tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:47:33.401029 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8bc97651-e77b-449c-97e6-6ea397e0876b tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:47:33.540653 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-8bc97651-e77b-449c-97e6-6ea397e0876b tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:47:33.545684 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-8bc97651-e77b-449c-97e6-6ea397e0876b tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/4c42bc3c-207b-4559-8d91-db50042c4286" status: 200 len: 1265 microversion: 2.1 time: 0.159410 Aug 10 23:47:33.546270 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3258/6308] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:47:33 2022] GET /compute/v2.1/servers/4c42bc3c-207b-4559-8d91-db50042c4286 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:47:34.566967 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-9cd77d72-17c9-431a-adca-c7d359710002 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:47:34.567588 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-9cd77d72-17c9-431a-adca-c7d359710002 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 4c42bc3c-207b-4559-8d91-db50042c4286] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:47:34.574032 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9cd77d72-17c9-431a-adca-c7d359710002 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:47:34.574515 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9cd77d72-17c9-431a-adca-c7d359710002 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:47:34.574993 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9cd77d72-17c9-431a-adca-c7d359710002 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:47:34.575687 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9cd77d72-17c9-431a-adca-c7d359710002 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:47:34.576150 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9cd77d72-17c9-431a-adca-c7d359710002 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:47:34.576579 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9cd77d72-17c9-431a-adca-c7d359710002 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:47:34.709592 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-9cd77d72-17c9-431a-adca-c7d359710002 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:47:34.717185 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-9cd77d72-17c9-431a-adca-c7d359710002 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/4c42bc3c-207b-4559-8d91-db50042c4286" status: 200 len: 1265 microversion: 2.1 time: 0.154896 Aug 10 23:47:34.717769 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3051/6309] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:47:34 2022] GET /compute/v2.1/servers/4c42bc3c-207b-4559-8d91-db50042c4286 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:47:34.931709 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-28967407-e24f-4646-b464-01abd79af208 req-c4437e31-0e22-4bf6-8e09-4fc666ba1196 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c42bc3c-207b-4559-8d91-db50042c4286", "name": "network-vif-plugged", "status": "completed", "tag": "00feeea1-083d-4322-b280-a0c90504fb83"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:47:34.942848 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-28967407-e24f-4646-b464-01abd79af208 req-c4437e31-0e22-4bf6-8e09-4fc666ba1196 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:47:34.943237 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-28967407-e24f-4646-b464-01abd79af208 req-c4437e31-0e22-4bf6-8e09-4fc666ba1196 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:47:34.943677 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-28967407-e24f-4646-b464-01abd79af208 req-c4437e31-0e22-4bf6-8e09-4fc666ba1196 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:47:34.955070 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-28967407-e24f-4646-b464-01abd79af208 req-c4437e31-0e22-4bf6-8e09-4fc666ba1196 service nova] Creating event network-vif-plugged:00feeea1-083d-4322-b280-a0c90504fb83 for instance 4c42bc3c-207b-4559-8d91-db50042c4286 on n-h2-850468-14 Aug 10 23:47:34.961342 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-28967407-e24f-4646-b464-01abd79af208 req-c4437e31-0e22-4bf6-8e09-4fc666ba1196 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033326 Aug 10 23:47:34.961945 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3259/6310] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:47:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:47:35.739374 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-33bdd2b6-b0fb-4d86-baaa-67d76bc238b5 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:47:35.740109 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-33bdd2b6-b0fb-4d86-baaa-67d76bc238b5 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 4c42bc3c-207b-4559-8d91-db50042c4286] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:47:35.747483 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-33bdd2b6-b0fb-4d86-baaa-67d76bc238b5 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:47:35.747974 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-33bdd2b6-b0fb-4d86-baaa-67d76bc238b5 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:47:35.748411 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-33bdd2b6-b0fb-4d86-baaa-67d76bc238b5 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:47:35.749105 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-33bdd2b6-b0fb-4d86-baaa-67d76bc238b5 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:47:35.749560 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-33bdd2b6-b0fb-4d86-baaa-67d76bc238b5 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:47:35.749979 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-33bdd2b6-b0fb-4d86-baaa-67d76bc238b5 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:47:35.882943 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-33bdd2b6-b0fb-4d86-baaa-67d76bc238b5 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:47:35.890480 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-33bdd2b6-b0fb-4d86-baaa-67d76bc238b5 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/4c42bc3c-207b-4559-8d91-db50042c4286" status: 200 len: 1265 microversion: 2.1 time: 0.155651 Aug 10 23:47:35.891108 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3052/6311] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:47:35 2022] GET /compute/v2.1/servers/4c42bc3c-207b-4559-8d91-db50042c4286 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:47:36.912796 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-10ace2ac-f9cb-4135-8c9d-4acd06315b73 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:47:36.913581 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-10ace2ac-f9cb-4135-8c9d-4acd06315b73 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 4c42bc3c-207b-4559-8d91-db50042c4286] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:47:36.920111 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-10ace2ac-f9cb-4135-8c9d-4acd06315b73 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:47:36.920646 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-10ace2ac-f9cb-4135-8c9d-4acd06315b73 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:47:36.921102 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-10ace2ac-f9cb-4135-8c9d-4acd06315b73 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:47:36.921817 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-10ace2ac-f9cb-4135-8c9d-4acd06315b73 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:47:36.922296 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-10ace2ac-f9cb-4135-8c9d-4acd06315b73 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:47:36.922738 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-10ace2ac-f9cb-4135-8c9d-4acd06315b73 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:47:37.056779 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-10ace2ac-f9cb-4135-8c9d-4acd06315b73 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:47:37.064634 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-10ace2ac-f9cb-4135-8c9d-4acd06315b73 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/4c42bc3c-207b-4559-8d91-db50042c4286" status: 200 len: 1453 microversion: 2.1 time: 0.156925 Aug 10 23:47:37.065244 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3260/6312] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:47:36 2022] GET /compute/v2.1/servers/4c42bc3c-207b-4559-8d91-db50042c4286 => generated 1453 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:47:37.085913 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-7610cd76-d66a-4468-8215-2049398f8a33 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:47:37.086524 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-7610cd76-d66a-4468-8215-2049398f8a33 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 4c42bc3c-207b-4559-8d91-db50042c4286] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:47:37.093302 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7610cd76-d66a-4468-8215-2049398f8a33 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:47:37.093787 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7610cd76-d66a-4468-8215-2049398f8a33 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:47:37.094224 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7610cd76-d66a-4468-8215-2049398f8a33 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:47:37.094955 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7610cd76-d66a-4468-8215-2049398f8a33 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:47:37.095427 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7610cd76-d66a-4468-8215-2049398f8a33 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:47:37.095846 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7610cd76-d66a-4468-8215-2049398f8a33 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:47:37.230323 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-7610cd76-d66a-4468-8215-2049398f8a33 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:47:37.238480 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-7610cd76-d66a-4468-8215-2049398f8a33 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/4c42bc3c-207b-4559-8d91-db50042c4286" status: 200 len: 1453 microversion: 2.1 time: 0.156531 Aug 10 23:47:37.239268 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3053/6313] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:47:37 2022] GET /compute/v2.1/servers/4c42bc3c-207b-4559-8d91-db50042c4286 => generated 1453 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:47:38.875523 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-f7e59d9b-45d5-4e99-b9dd-cb12232bc6ed req-d270f9ed-de61-48d5-b921-1212c1d68318 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c42bc3c-207b-4559-8d91-db50042c4286", "tag": "00feeea1-083d-4322-b280-a0c90504fb83"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:47:38.887271 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-f7e59d9b-45d5-4e99-b9dd-cb12232bc6ed req-d270f9ed-de61-48d5-b921-1212c1d68318 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:47:38.887853 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-f7e59d9b-45d5-4e99-b9dd-cb12232bc6ed req-d270f9ed-de61-48d5-b921-1212c1d68318 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:47:38.888368 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-f7e59d9b-45d5-4e99-b9dd-cb12232bc6ed req-d270f9ed-de61-48d5-b921-1212c1d68318 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:47:38.900106 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-f7e59d9b-45d5-4e99-b9dd-cb12232bc6ed req-d270f9ed-de61-48d5-b921-1212c1d68318 service nova] Creating event network-changed:00feeea1-083d-4322-b280-a0c90504fb83 for instance 4c42bc3c-207b-4559-8d91-db50042c4286 on n-h2-850468-14 Aug 10 23:47:38.905491 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-f7e59d9b-45d5-4e99-b9dd-cb12232bc6ed req-d270f9ed-de61-48d5-b921-1212c1d68318 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033702 Aug 10 23:47:38.906324 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3261/6314] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:47:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:48:48.574588 n-d-850468-14 devstack@n-api.service[122633]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 23:48:48.575196 n-d-850468-14 devstack@n-api.service[122633]: Wed Aug 10 23:48:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 23:48:49.261578 n-d-850468-14 devstack@n-api.service[122632]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 23:48:49.262185 n-d-850468-14 devstack@n-api.service[122632]: Wed Aug 10 23:48:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 23:49:16.898477 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:49:16.900148 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=58 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:49:16.904386 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_api:SELECT=24 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:49:16.905169 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-ac27e5f6-6a78-4e9e-a74c-b163de550cb3 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:49:16.905587 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=52 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:49:16.906140 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-ac27e5f6-6a78-4e9e-a74c-b163de550cb3 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 4c42bc3c-207b-4559-8d91-db50042c4286] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:49:16.915005 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ac27e5f6-6a78-4e9e-a74c-b163de550cb3 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:49:16.915503 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ac27e5f6-6a78-4e9e-a74c-b163de550cb3 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:49:16.916019 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ac27e5f6-6a78-4e9e-a74c-b163de550cb3 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:49:16.916745 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ac27e5f6-6a78-4e9e-a74c-b163de550cb3 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:49:16.917377 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ac27e5f6-6a78-4e9e-a74c-b163de550cb3 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:49:16.917803 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ac27e5f6-6a78-4e9e-a74c-b163de550cb3 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:49:16.948197 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-ac27e5f6-6a78-4e9e-a74c-b163de550cb3 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 4c42bc3c-207b-4559-8d91-db50042c4286] Going to try to terminate instance {{(pid=122632) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:49:16.988445 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-0371f2e5-588e-4b09-8d2d-48b314e88fd7 req-1a4bc6cc-bbce-4e1e-b500-ba84eb86c7fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c42bc3c-207b-4559-8d91-db50042c4286", "tag": "00feeea1-083d-4322-b280-a0c90504fb83"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:49:17.000213 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-0371f2e5-588e-4b09-8d2d-48b314e88fd7 req-1a4bc6cc-bbce-4e1e-b500-ba84eb86c7fd service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:49:17.001214 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-0371f2e5-588e-4b09-8d2d-48b314e88fd7 req-1a4bc6cc-bbce-4e1e-b500-ba84eb86c7fd service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:49:17.001665 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-0371f2e5-588e-4b09-8d2d-48b314e88fd7 req-1a4bc6cc-bbce-4e1e-b500-ba84eb86c7fd service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:49:17.015989 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-0371f2e5-588e-4b09-8d2d-48b314e88fd7 req-1a4bc6cc-bbce-4e1e-b500-ba84eb86c7fd service nova] Creating event network-changed:00feeea1-083d-4322-b280-a0c90504fb83 for instance 4c42bc3c-207b-4559-8d91-db50042c4286 on n-h2-850468-14 Aug 10 23:49:17.020853 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-0371f2e5-588e-4b09-8d2d-48b314e88fd7 req-1a4bc6cc-bbce-4e1e-b500-ba84eb86c7fd service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123393 Aug 10 23:49:17.025575 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3262/6315] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:49:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:49:17.036827 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-ac27e5f6-6a78-4e9e-a74c-b163de550cb3 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "DELETE /compute/v2.1/servers/4c42bc3c-207b-4559-8d91-db50042c4286" status: 204 len: 0 microversion: 2.1 time: 0.141541 Aug 10 23:49:17.038843 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3054/6316] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:49:16 2022] DELETE /compute/v2.1/servers/4c42bc3c-207b-4559-8d91-db50042c4286 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:49:17.047238 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-45311bbe-21dd-41c4-b5a0-674a8197df5d tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:49:17.048028 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-45311bbe-21dd-41c4-b5a0-674a8197df5d tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 4c42bc3c-207b-4559-8d91-db50042c4286] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:49:17.055313 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-45311bbe-21dd-41c4-b5a0-674a8197df5d tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:49:17.055860 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-45311bbe-21dd-41c4-b5a0-674a8197df5d tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:49:17.056350 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-45311bbe-21dd-41c4-b5a0-674a8197df5d tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:49:17.057309 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-45311bbe-21dd-41c4-b5a0-674a8197df5d tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:49:17.057769 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-45311bbe-21dd-41c4-b5a0-674a8197df5d tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:49:17.058311 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-45311bbe-21dd-41c4-b5a0-674a8197df5d tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:49:17.198733 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-45311bbe-21dd-41c4-b5a0-674a8197df5d tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:49:17.206323 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-45311bbe-21dd-41c4-b5a0-674a8197df5d tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/4c42bc3c-207b-4559-8d91-db50042c4286" status: 200 len: 1576 microversion: 2.1 time: 0.163363 Aug 10 23:49:17.206926 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3263/6317] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:49:17 2022] GET /compute/v2.1/servers/4c42bc3c-207b-4559-8d91-db50042c4286 => generated 1576 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:49:18.228975 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-5ebab5b7-6c47-4ea3-8a2c-f610436805eb tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:49:18.229680 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-5ebab5b7-6c47-4ea3-8a2c-f610436805eb tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 4c42bc3c-207b-4559-8d91-db50042c4286] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:49:18.236716 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5ebab5b7-6c47-4ea3-8a2c-f610436805eb tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:49:18.237204 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5ebab5b7-6c47-4ea3-8a2c-f610436805eb tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:49:18.237646 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5ebab5b7-6c47-4ea3-8a2c-f610436805eb tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:49:18.238348 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5ebab5b7-6c47-4ea3-8a2c-f610436805eb tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:49:18.238883 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5ebab5b7-6c47-4ea3-8a2c-f610436805eb tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:49:18.239320 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5ebab5b7-6c47-4ea3-8a2c-f610436805eb tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:49:18.451398 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-5ebab5b7-6c47-4ea3-8a2c-f610436805eb tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:49:18.459000 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-5ebab5b7-6c47-4ea3-8a2c-f610436805eb tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/4c42bc3c-207b-4559-8d91-db50042c4286" status: 200 len: 1576 microversion: 2.1 time: 0.235020 Aug 10 23:49:18.460063 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3055/6318] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:49:18 2022] GET /compute/v2.1/servers/4c42bc3c-207b-4559-8d91-db50042c4286 => generated 1576 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:49:19.349420 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-ba8b2b54-45c2-43f3-be33-0287a3a1efe3 req-aff07b68-c1cf-4254-be4d-1e5a6e9f54a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c42bc3c-207b-4559-8d91-db50042c4286", "name": "network-vif-deleted", "tag": "00feeea1-083d-4322-b280-a0c90504fb83"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:49:19.361415 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-ba8b2b54-45c2-43f3-be33-0287a3a1efe3 req-aff07b68-c1cf-4254-be4d-1e5a6e9f54a2 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:49:19.361915 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-ba8b2b54-45c2-43f3-be33-0287a3a1efe3 req-aff07b68-c1cf-4254-be4d-1e5a6e9f54a2 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:49:19.369847 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-ba8b2b54-45c2-43f3-be33-0287a3a1efe3 req-aff07b68-c1cf-4254-be4d-1e5a6e9f54a2 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:49:19.382366 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-ba8b2b54-45c2-43f3-be33-0287a3a1efe3 req-aff07b68-c1cf-4254-be4d-1e5a6e9f54a2 service nova] Creating event network-vif-deleted:00feeea1-083d-4322-b280-a0c90504fb83 for instance 4c42bc3c-207b-4559-8d91-db50042c4286 on n-h2-850468-14 Aug 10 23:49:19.388095 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-ba8b2b54-45c2-43f3-be33-0287a3a1efe3 req-aff07b68-c1cf-4254-be4d-1e5a6e9f54a2 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042214 Aug 10 23:49:19.388694 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3264/6319] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:49:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:49:19.481423 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-6774f287-c231-45b3-9f2a-76ea06bae1e2 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:49:19.482041 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-6774f287-c231-45b3-9f2a-76ea06bae1e2 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 4c42bc3c-207b-4559-8d91-db50042c4286] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:49:19.488755 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6774f287-c231-45b3-9f2a-76ea06bae1e2 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:49:19.489246 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6774f287-c231-45b3-9f2a-76ea06bae1e2 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:49:19.489686 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6774f287-c231-45b3-9f2a-76ea06bae1e2 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:49:19.490387 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6774f287-c231-45b3-9f2a-76ea06bae1e2 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:49:19.490866 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6774f287-c231-45b3-9f2a-76ea06bae1e2 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:49:19.491517 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6774f287-c231-45b3-9f2a-76ea06bae1e2 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:49:19.555021 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-6774f287-c231-45b3-9f2a-76ea06bae1e2 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:49:19.563064 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-6774f287-c231-45b3-9f2a-76ea06bae1e2 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/4c42bc3c-207b-4559-8d91-db50042c4286" status: 200 len: 1225 microversion: 2.1 time: 0.085707 Aug 10 23:49:19.563583 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3056/6320] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:49:19 2022] GET /compute/v2.1/servers/4c42bc3c-207b-4559-8d91-db50042c4286 => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:49:20.586864 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c718ed49-7094-47ec-96f1-dcdc597f4253 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:49:20.587580 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-c718ed49-7094-47ec-96f1-dcdc597f4253 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 4c42bc3c-207b-4559-8d91-db50042c4286] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:49:20.593823 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c718ed49-7094-47ec-96f1-dcdc597f4253 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:49:20.594316 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c718ed49-7094-47ec-96f1-dcdc597f4253 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:49:20.594762 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c718ed49-7094-47ec-96f1-dcdc597f4253 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:49:20.595489 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c718ed49-7094-47ec-96f1-dcdc597f4253 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:49:20.595953 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c718ed49-7094-47ec-96f1-dcdc597f4253 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:49:20.596385 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c718ed49-7094-47ec-96f1-dcdc597f4253 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:49:20.662148 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-c718ed49-7094-47ec-96f1-dcdc597f4253 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:49:20.670797 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-c718ed49-7094-47ec-96f1-dcdc597f4253 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/4c42bc3c-207b-4559-8d91-db50042c4286" status: 200 len: 1225 microversion: 2.1 time: 0.089511 Aug 10 23:49:20.671638 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3265/6321] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:49:20 2022] GET /compute/v2.1/servers/4c42bc3c-207b-4559-8d91-db50042c4286 => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:49:21.692608 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-ab4f55e7-d320-41f1-aa4d-a0cbc232aead tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:49:21.693181 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-ab4f55e7-d320-41f1-aa4d-a0cbc232aead tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 4c42bc3c-207b-4559-8d91-db50042c4286] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:49:21.700959 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ab4f55e7-d320-41f1-aa4d-a0cbc232aead tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:49:21.701451 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ab4f55e7-d320-41f1-aa4d-a0cbc232aead tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:49:21.701893 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ab4f55e7-d320-41f1-aa4d-a0cbc232aead tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:49:21.702610 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ab4f55e7-d320-41f1-aa4d-a0cbc232aead tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:49:21.703098 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ab4f55e7-d320-41f1-aa4d-a0cbc232aead tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:49:21.703529 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ab4f55e7-d320-41f1-aa4d-a0cbc232aead tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:49:21.774697 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-ab4f55e7-d320-41f1-aa4d-a0cbc232aead tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:49:21.782871 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-ab4f55e7-d320-41f1-aa4d-a0cbc232aead tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/4c42bc3c-207b-4559-8d91-db50042c4286" status: 200 len: 1225 microversion: 2.1 time: 0.094225 Aug 10 23:49:21.783472 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3057/6322] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:49:21 2022] GET /compute/v2.1/servers/4c42bc3c-207b-4559-8d91-db50042c4286 => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:49:22.806533 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-2baac6bb-c8a3-41bd-b2ee-08715118c2c9 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:49:22.807189 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-2baac6bb-c8a3-41bd-b2ee-08715118c2c9 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 4c42bc3c-207b-4559-8d91-db50042c4286] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:49:22.814127 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2baac6bb-c8a3-41bd-b2ee-08715118c2c9 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:49:22.814630 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2baac6bb-c8a3-41bd-b2ee-08715118c2c9 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:49:22.815118 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2baac6bb-c8a3-41bd-b2ee-08715118c2c9 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:49:22.815840 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2baac6bb-c8a3-41bd-b2ee-08715118c2c9 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:49:22.816309 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2baac6bb-c8a3-41bd-b2ee-08715118c2c9 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:49:22.816752 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2baac6bb-c8a3-41bd-b2ee-08715118c2c9 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:49:22.880470 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-2baac6bb-c8a3-41bd-b2ee-08715118c2c9 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:49:22.888399 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-2baac6bb-c8a3-41bd-b2ee-08715118c2c9 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/4c42bc3c-207b-4559-8d91-db50042c4286" status: 200 len: 1225 microversion: 2.1 time: 0.087817 Aug 10 23:49:22.888984 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3266/6323] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:49:22 2022] GET /compute/v2.1/servers/4c42bc3c-207b-4559-8d91-db50042c4286 => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:49:23.909622 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-fcce7085-4d78-4b17-88fe-e62f4bfccf51 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:49:23.910217 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-fcce7085-4d78-4b17-88fe-e62f4bfccf51 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 4c42bc3c-207b-4559-8d91-db50042c4286] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:49:23.918376 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fcce7085-4d78-4b17-88fe-e62f4bfccf51 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:49:23.918891 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fcce7085-4d78-4b17-88fe-e62f4bfccf51 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:49:23.919757 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fcce7085-4d78-4b17-88fe-e62f4bfccf51 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:49:23.920073 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fcce7085-4d78-4b17-88fe-e62f4bfccf51 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:49:23.920559 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fcce7085-4d78-4b17-88fe-e62f4bfccf51 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:49:23.921049 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fcce7085-4d78-4b17-88fe-e62f4bfccf51 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:49:23.954903 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fcce7085-4d78-4b17-88fe-e62f4bfccf51 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:49:23.955318 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fcce7085-4d78-4b17-88fe-e62f4bfccf51 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:49:23.955761 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fcce7085-4d78-4b17-88fe-e62f4bfccf51 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:49:23.956214 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.objects.instance [None req-fcce7085-4d78-4b17-88fe-e62f4bfccf51 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lazy-loading 'fault' on Instance uuid 4c42bc3c-207b-4559-8d91-db50042c4286 {{(pid=122632) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:49:23.998841 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-fcce7085-4d78-4b17-88fe-e62f4bfccf51 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:49:24.005788 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-fcce7085-4d78-4b17-88fe-e62f4bfccf51 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/4c42bc3c-207b-4559-8d91-db50042c4286" status: 200 len: 1184 microversion: 2.1 time: 0.100075 Aug 10 23:49:24.006441 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3058/6324] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:49:23 2022] GET /compute/v2.1/servers/4c42bc3c-207b-4559-8d91-db50042c4286 => generated 1184 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:49:25.027544 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-1d51ad69-350c-4d00-969b-9f38ae71e0df tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:49:25.028222 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-1d51ad69-350c-4d00-969b-9f38ae71e0df tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 4c42bc3c-207b-4559-8d91-db50042c4286] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:49:25.037221 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1d51ad69-350c-4d00-969b-9f38ae71e0df tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:49:25.037905 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1d51ad69-350c-4d00-969b-9f38ae71e0df tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:49:25.038536 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1d51ad69-350c-4d00-969b-9f38ae71e0df tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:49:25.039969 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1d51ad69-350c-4d00-969b-9f38ae71e0df tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:49:25.040441 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1d51ad69-350c-4d00-969b-9f38ae71e0df tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:49:25.041079 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1d51ad69-350c-4d00-969b-9f38ae71e0df tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:49:25.054250 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-1d51ad69-350c-4d00-969b-9f38ae71e0df tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] HTTP exception thrown: Instance 4c42bc3c-207b-4559-8d91-db50042c4286 could not be found. Aug 10 23:49:25.056120 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-1d51ad69-350c-4d00-969b-9f38ae71e0df tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Request method failure captured: Aug 10 23:49:25.056120 n-d-850468-14 devstack@n-api.service[122633]: request: GET /compute/v2.1/servers/4c42bc3c-207b-4559-8d91-db50042c4286 HTTP/1.1 Aug 10 23:49:25.056120 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:49:25.056120 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:49:25.056120 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:49:25.056120 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:49:25.056120 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:49:25.056120 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:49:25.056120 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:49:25.056120 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:49:25.056120 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9EF3JcALvIu97mWIb2swBcyDTxDI5PJ3vU9Ry5AtFPunVTcpAqQQUjRv0EmIlEp13u4BOFv0aTDkpyifGo3ChPE2BfANGKPVxkJ3JhuTa-9TLVCXxNdBMfkJGfbXf6wm_Y7u9vFxLHJ5-XazgQxDfOp_ueAQ4sa5cZKpoVrdkbUR3Jc Aug 10 23:49:25.056120 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:49:25.056120 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:49:25.056120 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:49:25.056120 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:49:25.056120 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:49:25.056120 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:49:25.056120 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 0b22838d50dd4ea8811953e723d0c052 Aug 10 23:49:25.056120 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-TestVolumeBootPattern-991439424 Aug 10 23:49:25.056120 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:49:25.056120 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:49:25.056120 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0b22838d50dd4ea8811953e723d0c052"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0b22838d50dd4ea8811953e723d0c052"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/0b22838d50dd4ea8811953e723d0c052"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_0b22838d50dd4ea8811953e723d0c052", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:49:25.056120 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-TestVolumeBootPattern-991439424 Aug 10 23:49:25.056120 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 0b22838d50dd4ea8811953e723d0c052 Aug 10 23:49:25.056120 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-TestVolumeBootPattern-991439424 Aug 10 23:49:25.056120 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-TestVolumeBootPattern-991439424-project Aug 10 23:49:25.056120 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:49:25.056120 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:49:25.056120 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: e97e9cddb55649809a9cd16dbc43bb7e Aug 10 23:49:25.056120 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-TestVolumeBootPattern-991439424-project Aug 10 23:49:25.056120 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:49:25.056120 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance 4c42bc3c-207b-4559-8d91-db50042c4286 could not be found. Aug 10 23:49:25.056120 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': '4c42bc3c-207b-4559-8d91-db50042c4286'} Aug 10 23:49:25.056120 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:49:25.056120 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:49:25.056120 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:49:25.056120 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:49:25.056120 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:49:25.056120 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:49:25.056120 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:49:25.056120 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:49:25.056120 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:49:25.056120 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:49:25.056120 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c42bc3c-207b-4559-8d91-db50042c4286 could not be found. Aug 10 23:49:25.056120 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:49:25.056120 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:49:25.056120 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:49:25.056120 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:49:25.056120 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:49:25.056120 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:49:25.056120 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:49:25.056120 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:49:25.056120 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:49:25.056120 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:49:25.056120 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:49:25.056120 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:49:25.056120 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:49:25.056120 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:49:25.056120 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:49:25.056120 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:49:25.056120 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c42bc3c-207b-4559-8d91-db50042c4286 could not be found. Aug 10 23:49:25.056120 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:49:25.056120 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:49:25.056120 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:49:25.061961 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:49:25.061961 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:49:25.061961 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:49:25.061961 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:49:25.061961 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:49:25.061961 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c42bc3c-207b-4559-8d91-db50042c4286 could not be found. Aug 10 23:49:25.061961 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:49:25.061961 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-1d51ad69-350c-4d00-969b-9f38ae71e0df tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Returning 404 to user: Instance 4c42bc3c-207b-4559-8d91-db50042c4286 could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:49:25.061961 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-1d51ad69-350c-4d00-969b-9f38ae71e0df tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/4c42bc3c-207b-4559-8d91-db50042c4286" status: 404 len: 111 microversion: 2.1 time: 0.034552 Aug 10 23:49:25.061961 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3267/6325] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:49:25 2022] GET /compute/v2.1/servers/4c42bc3c-207b-4559-8d91-db50042c4286 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:49:31.315897 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-2d68f356-1696-41a2-8e22-db388610e2a9 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:49:31.316525 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-2d68f356-1696-41a2-8e22-db388610e2a9 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 1afd4615-85fa-4647-ac55-6cc0ba2d1e65] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:49:31.317598 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-1cd973b2-9db3-4c7e-a077-332535e5634b req-5e0c8791-d77d-419e-a437-a175f9186d63 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1afd4615-85fa-4647-ac55-6cc0ba2d1e65", "tag": "63d0677d-f478-45a5-adb9-f172b112f293"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:49:31.327572 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2d68f356-1696-41a2-8e22-db388610e2a9 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:49:31.328063 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2d68f356-1696-41a2-8e22-db388610e2a9 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:49:31.328519 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2d68f356-1696-41a2-8e22-db388610e2a9 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:49:31.329490 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2d68f356-1696-41a2-8e22-db388610e2a9 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:49:31.329942 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2d68f356-1696-41a2-8e22-db388610e2a9 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:49:31.330360 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2d68f356-1696-41a2-8e22-db388610e2a9 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:49:31.331447 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-1cd973b2-9db3-4c7e-a077-332535e5634b req-5e0c8791-d77d-419e-a437-a175f9186d63 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:49:31.332679 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-1cd973b2-9db3-4c7e-a077-332535e5634b req-5e0c8791-d77d-419e-a437-a175f9186d63 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:49:31.333583 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-1cd973b2-9db3-4c7e-a077-332535e5634b req-5e0c8791-d77d-419e-a437-a175f9186d63 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:49:31.357009 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-1cd973b2-9db3-4c7e-a077-332535e5634b req-5e0c8791-d77d-419e-a437-a175f9186d63 service nova] Creating event network-changed:63d0677d-f478-45a5-adb9-f172b112f293 for instance 1afd4615-85fa-4647-ac55-6cc0ba2d1e65 on n-h1-850468-14 Aug 10 23:49:31.359297 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-2d68f356-1696-41a2-8e22-db388610e2a9 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 1afd4615-85fa-4647-ac55-6cc0ba2d1e65] Going to try to terminate instance {{(pid=122632) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:49:31.362724 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-1cd973b2-9db3-4c7e-a077-332535e5634b req-5e0c8791-d77d-419e-a437-a175f9186d63 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049169 Aug 10 23:49:31.363549 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3268/6326] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:49:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 23:49:31.466325 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-2d68f356-1696-41a2-8e22-db388610e2a9 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "DELETE /compute/v2.1/servers/1afd4615-85fa-4647-ac55-6cc0ba2d1e65" status: 204 len: 0 microversion: 2.1 time: 0.154165 Aug 10 23:49:31.467455 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3059/6327] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:49:31 2022] DELETE /compute/v2.1/servers/1afd4615-85fa-4647-ac55-6cc0ba2d1e65 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:49:31.477892 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-4d8d8e4d-0afa-4f7e-a83e-214bf46b7f9f tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:49:31.478624 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-4d8d8e4d-0afa-4f7e-a83e-214bf46b7f9f tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 1afd4615-85fa-4647-ac55-6cc0ba2d1e65] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:49:31.484804 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4d8d8e4d-0afa-4f7e-a83e-214bf46b7f9f tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:49:31.485320 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4d8d8e4d-0afa-4f7e-a83e-214bf46b7f9f tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:49:31.485775 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4d8d8e4d-0afa-4f7e-a83e-214bf46b7f9f tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:49:31.486498 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4d8d8e4d-0afa-4f7e-a83e-214bf46b7f9f tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:49:31.487002 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4d8d8e4d-0afa-4f7e-a83e-214bf46b7f9f tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:49:31.487738 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4d8d8e4d-0afa-4f7e-a83e-214bf46b7f9f tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:49:31.658315 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-4d8d8e4d-0afa-4f7e-a83e-214bf46b7f9f tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:49:31.666692 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-4d8d8e4d-0afa-4f7e-a83e-214bf46b7f9f tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/1afd4615-85fa-4647-ac55-6cc0ba2d1e65" status: 200 len: 1576 microversion: 2.1 time: 0.194574 Aug 10 23:49:31.667340 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3269/6328] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:49:31 2022] GET /compute/v2.1/servers/1afd4615-85fa-4647-ac55-6cc0ba2d1e65 => generated 1576 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:49:32.688339 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-f78ad394-382f-4aa4-941d-3d5749e22347 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:49:32.689050 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-f78ad394-382f-4aa4-941d-3d5749e22347 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 1afd4615-85fa-4647-ac55-6cc0ba2d1e65] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:49:32.696000 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f78ad394-382f-4aa4-941d-3d5749e22347 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:49:32.696470 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f78ad394-382f-4aa4-941d-3d5749e22347 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:49:32.696945 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f78ad394-382f-4aa4-941d-3d5749e22347 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:49:32.697838 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f78ad394-382f-4aa4-941d-3d5749e22347 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:49:32.698400 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f78ad394-382f-4aa4-941d-3d5749e22347 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:49:32.698856 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f78ad394-382f-4aa4-941d-3d5749e22347 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:49:32.834734 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-f78ad394-382f-4aa4-941d-3d5749e22347 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:49:32.844116 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-f78ad394-382f-4aa4-941d-3d5749e22347 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/1afd4615-85fa-4647-ac55-6cc0ba2d1e65" status: 200 len: 1576 microversion: 2.1 time: 0.159931 Aug 10 23:49:32.844700 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3060/6329] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:49:32 2022] GET /compute/v2.1/servers/1afd4615-85fa-4647-ac55-6cc0ba2d1e65 => generated 1576 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:49:33.466090 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-d3e2de6e-6bdd-47a2-bc84-fc732e88ea0c req-62a06947-ce06-4ec6-ab0e-41812aadde66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1afd4615-85fa-4647-ac55-6cc0ba2d1e65", "name": "network-vif-deleted", "tag": "63d0677d-f478-45a5-adb9-f172b112f293"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:49:33.477203 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-d3e2de6e-6bdd-47a2-bc84-fc732e88ea0c req-62a06947-ce06-4ec6-ab0e-41812aadde66 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:49:33.477705 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-d3e2de6e-6bdd-47a2-bc84-fc732e88ea0c req-62a06947-ce06-4ec6-ab0e-41812aadde66 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:49:33.478150 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-d3e2de6e-6bdd-47a2-bc84-fc732e88ea0c req-62a06947-ce06-4ec6-ab0e-41812aadde66 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:49:33.490251 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-d3e2de6e-6bdd-47a2-bc84-fc732e88ea0c req-62a06947-ce06-4ec6-ab0e-41812aadde66 service nova] Creating event network-vif-deleted:63d0677d-f478-45a5-adb9-f172b112f293 for instance 1afd4615-85fa-4647-ac55-6cc0ba2d1e65 on n-h1-850468-14 Aug 10 23:49:33.495913 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-d3e2de6e-6bdd-47a2-bc84-fc732e88ea0c req-62a06947-ce06-4ec6-ab0e-41812aadde66 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033615 Aug 10 23:49:33.496824 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3270/6330] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:49:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:49:33.866844 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-2e997765-427b-4dca-9763-be3aa8939e4c tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:49:33.868485 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-2e997765-427b-4dca-9763-be3aa8939e4c tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 1afd4615-85fa-4647-ac55-6cc0ba2d1e65] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:49:33.877570 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2e997765-427b-4dca-9763-be3aa8939e4c tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:49:33.878496 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2e997765-427b-4dca-9763-be3aa8939e4c tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:49:33.879248 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2e997765-427b-4dca-9763-be3aa8939e4c tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:49:33.880014 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2e997765-427b-4dca-9763-be3aa8939e4c tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:49:33.880479 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2e997765-427b-4dca-9763-be3aa8939e4c tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:49:33.880951 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2e997765-427b-4dca-9763-be3aa8939e4c tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:49:33.957310 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-2e997765-427b-4dca-9763-be3aa8939e4c tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:49:33.966936 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-2e997765-427b-4dca-9763-be3aa8939e4c tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/1afd4615-85fa-4647-ac55-6cc0ba2d1e65" status: 200 len: 1224 microversion: 2.1 time: 0.104008 Aug 10 23:49:33.967526 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3061/6331] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:49:33 2022] GET /compute/v2.1/servers/1afd4615-85fa-4647-ac55-6cc0ba2d1e65 => generated 1224 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:49:34.988783 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-75c449b5-ee31-4690-a076-590e0b36b02f tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:49:34.989488 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-75c449b5-ee31-4690-a076-590e0b36b02f tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 1afd4615-85fa-4647-ac55-6cc0ba2d1e65] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:49:34.997229 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-75c449b5-ee31-4690-a076-590e0b36b02f tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:49:34.997822 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-75c449b5-ee31-4690-a076-590e0b36b02f tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:49:34.998282 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-75c449b5-ee31-4690-a076-590e0b36b02f tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:49:34.999029 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-75c449b5-ee31-4690-a076-590e0b36b02f tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:49:34.999499 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-75c449b5-ee31-4690-a076-590e0b36b02f tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:49:34.999936 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-75c449b5-ee31-4690-a076-590e0b36b02f tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:49:35.065542 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-75c449b5-ee31-4690-a076-590e0b36b02f tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:49:35.074645 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-75c449b5-ee31-4690-a076-590e0b36b02f tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/1afd4615-85fa-4647-ac55-6cc0ba2d1e65" status: 200 len: 1224 microversion: 2.1 time: 0.090797 Aug 10 23:49:35.075276 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3271/6332] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:49:34 2022] GET /compute/v2.1/servers/1afd4615-85fa-4647-ac55-6cc0ba2d1e65 => generated 1224 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:49:36.096072 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-5071979c-40c8-4419-932a-d4c453e77a27 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:49:36.096696 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-5071979c-40c8-4419-932a-d4c453e77a27 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 1afd4615-85fa-4647-ac55-6cc0ba2d1e65] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:49:36.103827 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5071979c-40c8-4419-932a-d4c453e77a27 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:49:36.104322 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5071979c-40c8-4419-932a-d4c453e77a27 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:49:36.104765 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5071979c-40c8-4419-932a-d4c453e77a27 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:49:36.105473 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5071979c-40c8-4419-932a-d4c453e77a27 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:49:36.105929 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5071979c-40c8-4419-932a-d4c453e77a27 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:49:36.106354 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5071979c-40c8-4419-932a-d4c453e77a27 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:49:36.171922 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-5071979c-40c8-4419-932a-d4c453e77a27 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:49:36.180075 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-5071979c-40c8-4419-932a-d4c453e77a27 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/1afd4615-85fa-4647-ac55-6cc0ba2d1e65" status: 200 len: 1224 microversion: 2.1 time: 0.087776 Aug 10 23:49:36.180756 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3062/6333] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:49:36 2022] GET /compute/v2.1/servers/1afd4615-85fa-4647-ac55-6cc0ba2d1e65 => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:49:37.201907 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-6cf9e06a-ed75-445d-9e99-22dc65d2cbb1 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:49:37.202515 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-6cf9e06a-ed75-445d-9e99-22dc65d2cbb1 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 1afd4615-85fa-4647-ac55-6cc0ba2d1e65] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:49:37.209713 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6cf9e06a-ed75-445d-9e99-22dc65d2cbb1 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:49:37.210215 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6cf9e06a-ed75-445d-9e99-22dc65d2cbb1 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:49:37.210661 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6cf9e06a-ed75-445d-9e99-22dc65d2cbb1 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:49:37.211619 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6cf9e06a-ed75-445d-9e99-22dc65d2cbb1 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:49:37.212073 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6cf9e06a-ed75-445d-9e99-22dc65d2cbb1 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:49:37.212511 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6cf9e06a-ed75-445d-9e99-22dc65d2cbb1 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:49:37.275269 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-6cf9e06a-ed75-445d-9e99-22dc65d2cbb1 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e97e9cddb55649809a9cd16dbc43bb7e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b22838d50dd4ea8811953e723d0c052', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:49:37.283093 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-6cf9e06a-ed75-445d-9e99-22dc65d2cbb1 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/1afd4615-85fa-4647-ac55-6cc0ba2d1e65" status: 200 len: 1224 microversion: 2.1 time: 0.085065 Aug 10 23:49:37.283674 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3272/6334] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:49:37 2022] GET /compute/v2.1/servers/1afd4615-85fa-4647-ac55-6cc0ba2d1e65 => generated 1224 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:49:38.303938 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-cab4e354-2846-4e5c-b9d2-4971aa947a02 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:49:38.304559 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-cab4e354-2846-4e5c-b9d2-4971aa947a02 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 1afd4615-85fa-4647-ac55-6cc0ba2d1e65] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:49:38.312066 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cab4e354-2846-4e5c-b9d2-4971aa947a02 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:49:38.312561 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cab4e354-2846-4e5c-b9d2-4971aa947a02 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:49:38.313005 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cab4e354-2846-4e5c-b9d2-4971aa947a02 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:49:38.313701 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cab4e354-2846-4e5c-b9d2-4971aa947a02 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:49:38.314160 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cab4e354-2846-4e5c-b9d2-4971aa947a02 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:49:38.314588 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cab4e354-2846-4e5c-b9d2-4971aa947a02 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:49:38.327920 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-cab4e354-2846-4e5c-b9d2-4971aa947a02 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] HTTP exception thrown: Instance 1afd4615-85fa-4647-ac55-6cc0ba2d1e65 could not be found. Aug 10 23:49:38.329581 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-cab4e354-2846-4e5c-b9d2-4971aa947a02 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Request method failure captured: Aug 10 23:49:38.329581 n-d-850468-14 devstack@n-api.service[122632]: request: GET /compute/v2.1/servers/1afd4615-85fa-4647-ac55-6cc0ba2d1e65 HTTP/1.1 Aug 10 23:49:38.329581 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:49:38.329581 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:49:38.329581 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:49:38.329581 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 23:49:38.329581 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:49:38.329581 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:49:38.329581 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:49:38.329581 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:49:38.329581 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9EF3JcALvIu97mWIb2swBcyDTxDI5PJ3vU9Ry5AtFPunVTcpAqQQUjRv0EmIlEp13u4BOFv0aTDkpyifGo3ChPE2BfANGKPVxkJ3JhuTa-9TLVCXxNdBMfkJGfbXf6wm_Y7u9vFxLHJ5-XazgQxDfOp_ueAQ4sa5cZKpoVrdkbUR3Jc Aug 10 23:49:38.329581 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:49:38.329581 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:49:38.329581 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:49:38.329581 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:49:38.329581 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:49:38.329581 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:49:38.329581 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 0b22838d50dd4ea8811953e723d0c052 Aug 10 23:49:38.329581 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-TestVolumeBootPattern-991439424 Aug 10 23:49:38.329581 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:49:38.329581 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:49:38.329581 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0b22838d50dd4ea8811953e723d0c052"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0b22838d50dd4ea8811953e723d0c052"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/0b22838d50dd4ea8811953e723d0c052"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_0b22838d50dd4ea8811953e723d0c052", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:49:38.329581 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-TestVolumeBootPattern-991439424 Aug 10 23:49:38.329581 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 0b22838d50dd4ea8811953e723d0c052 Aug 10 23:49:38.329581 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-TestVolumeBootPattern-991439424 Aug 10 23:49:38.329581 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-TestVolumeBootPattern-991439424-project Aug 10 23:49:38.329581 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:49:38.329581 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:49:38.329581 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: e97e9cddb55649809a9cd16dbc43bb7e Aug 10 23:49:38.329581 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-TestVolumeBootPattern-991439424-project Aug 10 23:49:38.329581 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:49:38.329581 n-d-850468-14 devstack@n-api.service[122632]: exception: Instance 1afd4615-85fa-4647-ac55-6cc0ba2d1e65 could not be found. Aug 10 23:49:38.329581 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': '1afd4615-85fa-4647-ac55-6cc0ba2d1e65'} Aug 10 23:49:38.329581 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:49:38.329581 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:49:38.329581 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:49:38.329581 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:49:38.329581 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:49:38.329581 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:49:38.329581 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:49:38.329581 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:49:38.329581 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:49:38.329581 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:49:38.329581 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1afd4615-85fa-4647-ac55-6cc0ba2d1e65 could not be found. Aug 10 23:49:38.329581 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:49:38.329581 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:49:38.329581 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:49:38.329581 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:49:38.329581 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:49:38.329581 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:49:38.329581 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:49:38.329581 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:49:38.329581 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:49:38.329581 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:49:38.329581 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:49:38.329581 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:49:38.329581 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:49:38.329581 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:49:38.329581 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:49:38.329581 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:49:38.329581 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1afd4615-85fa-4647-ac55-6cc0ba2d1e65 could not be found. Aug 10 23:49:38.329581 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:49:38.329581 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:49:38.329581 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:49:38.334926 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:49:38.334926 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:49:38.334926 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:49:38.334926 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:49:38.334926 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:49:38.334926 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1afd4615-85fa-4647-ac55-6cc0ba2d1e65 could not be found. Aug 10 23:49:38.334926 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:49:38.334926 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-cab4e354-2846-4e5c-b9d2-4971aa947a02 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Returning 404 to user: Instance 1afd4615-85fa-4647-ac55-6cc0ba2d1e65 could not be found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:49:38.334926 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-cab4e354-2846-4e5c-b9d2-4971aa947a02 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/1afd4615-85fa-4647-ac55-6cc0ba2d1e65" status: 404 len: 111 microversion: 2.1 time: 0.030968 Aug 10 23:49:38.334926 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3063/6335] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:49:38 2022] GET /compute/v2.1/servers/1afd4615-85fa-4647-ac55-6cc0ba2d1e65 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:49:38.780421 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-72dc608a-899c-49a8-8d43-f8706b0abfef tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:49:38.780974 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-72dc608a-899c-49a8-8d43-f8706b0abfef tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 1de4d8bc-8768-4b1e-b90f-5e8d2dc5bb07] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:49:38.788030 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-72dc608a-899c-49a8-8d43-f8706b0abfef tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:49:38.788798 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-72dc608a-899c-49a8-8d43-f8706b0abfef tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:49:38.790415 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-72dc608a-899c-49a8-8d43-f8706b0abfef tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:49:38.791177 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-72dc608a-899c-49a8-8d43-f8706b0abfef tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:49:38.791655 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-72dc608a-899c-49a8-8d43-f8706b0abfef tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:49:38.792122 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-72dc608a-899c-49a8-8d43-f8706b0abfef tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:49:38.808850 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-72dc608a-899c-49a8-8d43-f8706b0abfef tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] HTTP exception thrown: Instance 1de4d8bc-8768-4b1e-b90f-5e8d2dc5bb07 could not be found. Aug 10 23:49:38.810520 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-72dc608a-899c-49a8-8d43-f8706b0abfef tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Request method failure captured: Aug 10 23:49:38.810520 n-d-850468-14 devstack@n-api.service[122633]: request: DELETE /compute/v2.1/servers/1de4d8bc-8768-4b1e-b90f-5e8d2dc5bb07 HTTP/1.1 Aug 10 23:49:38.810520 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:49:38.810520 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:49:38.810520 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:49:38.810520 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:49:38.810520 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:49:38.810520 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:49:38.810520 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:49:38.810520 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:49:38.810520 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9EF3JcALvIu97mWIb2swBcyDTxDI5PJ3vU9Ry5AtFPunVTcpAqQQUjRv0EmIlEp13u4BOFv0aTDkpyifGo3ChPE2BfANGKPVxkJ3JhuTa-9TLVCXxNdBMfkJGfbXf6wm_Y7u9vFxLHJ5-XazgQxDfOp_ueAQ4sa5cZKpoVrdkbUR3Jc Aug 10 23:49:38.810520 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:49:38.810520 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:49:38.810520 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:49:38.810520 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:49:38.810520 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:49:38.810520 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:49:38.810520 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 0b22838d50dd4ea8811953e723d0c052 Aug 10 23:49:38.810520 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-TestVolumeBootPattern-991439424 Aug 10 23:49:38.810520 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:49:38.810520 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:49:38.810520 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0b22838d50dd4ea8811953e723d0c052"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0b22838d50dd4ea8811953e723d0c052"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/0b22838d50dd4ea8811953e723d0c052"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_0b22838d50dd4ea8811953e723d0c052", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:49:38.810520 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-TestVolumeBootPattern-991439424 Aug 10 23:49:38.810520 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 0b22838d50dd4ea8811953e723d0c052 Aug 10 23:49:38.810520 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-TestVolumeBootPattern-991439424 Aug 10 23:49:38.810520 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-TestVolumeBootPattern-991439424-project Aug 10 23:49:38.810520 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:49:38.810520 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:49:38.810520 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: e97e9cddb55649809a9cd16dbc43bb7e Aug 10 23:49:38.810520 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-TestVolumeBootPattern-991439424-project Aug 10 23:49:38.810520 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:49:38.810520 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance 1de4d8bc-8768-4b1e-b90f-5e8d2dc5bb07 could not be found. Aug 10 23:49:38.810520 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': '1de4d8bc-8768-4b1e-b90f-5e8d2dc5bb07'} Aug 10 23:49:38.810520 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:49:38.810520 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:49:38.810520 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:49:38.810520 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:49:38.810520 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:49:38.810520 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:49:38.810520 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:49:38.810520 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:49:38.810520 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:49:38.810520 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:49:38.810520 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1de4d8bc-8768-4b1e-b90f-5e8d2dc5bb07 could not be found. Aug 10 23:49:38.810520 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:49:38.810520 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:49:38.810520 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:49:38.810520 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:49:38.810520 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:49:38.810520 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:49:38.810520 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:49:38.810520 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:49:38.810520 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:49:38.810520 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:49:38.810520 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 23:49:38.810520 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 23:49:38.810520 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 23:49:38.810520 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 23:49:38.810520 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:49:38.810520 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:49:38.810520 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:49:38.810520 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:49:38.815318 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1de4d8bc-8768-4b1e-b90f-5e8d2dc5bb07 could not be found. Aug 10 23:49:38.815318 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:49:38.815318 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:49:38.815318 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:49:38.815318 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:49:38.815318 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:49:38.815318 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:49:38.815318 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:49:38.815318 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:49:38.815318 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1de4d8bc-8768-4b1e-b90f-5e8d2dc5bb07 could not be found. Aug 10 23:49:38.815318 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:49:38.815318 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-72dc608a-899c-49a8-8d43-f8706b0abfef tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Returning 404 to user: Instance 1de4d8bc-8768-4b1e-b90f-5e8d2dc5bb07 could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:49:38.815318 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-72dc608a-899c-49a8-8d43-f8706b0abfef tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "DELETE /compute/v2.1/servers/1de4d8bc-8768-4b1e-b90f-5e8d2dc5bb07" status: 404 len: 111 microversion: 2.1 time: 0.036690 Aug 10 23:49:38.815318 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3273/6336] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:49:38 2022] DELETE /compute/v2.1/servers/1de4d8bc-8768-4b1e-b90f-5e8d2dc5bb07 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:49:38.820758 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-17bcbaee-c68d-427f-876d-76e3c3b6c0ac tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:49:38.821485 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-17bcbaee-c68d-427f-876d-76e3c3b6c0ac tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] [instance: 1de4d8bc-8768-4b1e-b90f-5e8d2dc5bb07] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:49:38.827572 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-17bcbaee-c68d-427f-876d-76e3c3b6c0ac tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:49:38.828059 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-17bcbaee-c68d-427f-876d-76e3c3b6c0ac tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:49:38.828502 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-17bcbaee-c68d-427f-876d-76e3c3b6c0ac tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:49:38.829196 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-17bcbaee-c68d-427f-876d-76e3c3b6c0ac tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:49:38.829652 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-17bcbaee-c68d-427f-876d-76e3c3b6c0ac tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:49:38.830085 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-17bcbaee-c68d-427f-876d-76e3c3b6c0ac tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:49:38.844109 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-17bcbaee-c68d-427f-876d-76e3c3b6c0ac tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] HTTP exception thrown: Instance 1de4d8bc-8768-4b1e-b90f-5e8d2dc5bb07 could not be found. Aug 10 23:49:38.845683 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-17bcbaee-c68d-427f-876d-76e3c3b6c0ac tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Request method failure captured: Aug 10 23:49:38.845683 n-d-850468-14 devstack@n-api.service[122632]: request: GET /compute/v2.1/servers/1de4d8bc-8768-4b1e-b90f-5e8d2dc5bb07 HTTP/1.1 Aug 10 23:49:38.845683 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:49:38.845683 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:49:38.845683 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:49:38.845683 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 23:49:38.845683 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:49:38.845683 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:49:38.845683 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:49:38.845683 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:49:38.845683 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9EF3JcALvIu97mWIb2swBcyDTxDI5PJ3vU9Ry5AtFPunVTcpAqQQUjRv0EmIlEp13u4BOFv0aTDkpyifGo3ChPE2BfANGKPVxkJ3JhuTa-9TLVCXxNdBMfkJGfbXf6wm_Y7u9vFxLHJ5-XazgQxDfOp_ueAQ4sa5cZKpoVrdkbUR3Jc Aug 10 23:49:38.845683 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:49:38.845683 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:49:38.845683 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:49:38.845683 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:49:38.845683 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:49:38.845683 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:49:38.845683 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 0b22838d50dd4ea8811953e723d0c052 Aug 10 23:49:38.845683 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-TestVolumeBootPattern-991439424 Aug 10 23:49:38.845683 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:49:38.845683 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:49:38.845683 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0b22838d50dd4ea8811953e723d0c052"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/0b22838d50dd4ea8811953e723d0c052"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/0b22838d50dd4ea8811953e723d0c052"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_0b22838d50dd4ea8811953e723d0c052", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:49:38.845683 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-TestVolumeBootPattern-991439424 Aug 10 23:49:38.845683 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 0b22838d50dd4ea8811953e723d0c052 Aug 10 23:49:38.845683 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-TestVolumeBootPattern-991439424 Aug 10 23:49:38.845683 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-TestVolumeBootPattern-991439424-project Aug 10 23:49:38.845683 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:49:38.845683 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:49:38.845683 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: e97e9cddb55649809a9cd16dbc43bb7e Aug 10 23:49:38.845683 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-TestVolumeBootPattern-991439424-project Aug 10 23:49:38.845683 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:49:38.845683 n-d-850468-14 devstack@n-api.service[122632]: exception: Instance 1de4d8bc-8768-4b1e-b90f-5e8d2dc5bb07 could not be found. Aug 10 23:49:38.845683 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': '1de4d8bc-8768-4b1e-b90f-5e8d2dc5bb07'} Aug 10 23:49:38.845683 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:49:38.845683 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:49:38.845683 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:49:38.845683 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:49:38.845683 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:49:38.845683 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:49:38.845683 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:49:38.845683 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:49:38.845683 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:49:38.845683 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:49:38.845683 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1de4d8bc-8768-4b1e-b90f-5e8d2dc5bb07 could not be found. Aug 10 23:49:38.845683 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:49:38.845683 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:49:38.845683 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:49:38.845683 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:49:38.845683 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:49:38.845683 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:49:38.845683 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:49:38.845683 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:49:38.845683 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:49:38.845683 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:49:38.845683 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:49:38.845683 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:49:38.845683 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:49:38.845683 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:49:38.845683 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:49:38.845683 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:49:38.845683 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1de4d8bc-8768-4b1e-b90f-5e8d2dc5bb07 could not be found. Aug 10 23:49:38.845683 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:49:38.845683 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:49:38.845683 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:49:38.850952 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:49:38.850952 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:49:38.850952 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:49:38.850952 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:49:38.850952 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:49:38.850952 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1de4d8bc-8768-4b1e-b90f-5e8d2dc5bb07 could not be found. Aug 10 23:49:38.850952 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:49:38.850952 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-17bcbaee-c68d-427f-876d-76e3c3b6c0ac tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Returning 404 to user: Instance 1de4d8bc-8768-4b1e-b90f-5e8d2dc5bb07 could not be found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:49:38.850952 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-17bcbaee-c68d-427f-876d-76e3c3b6c0ac tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "GET /compute/v2.1/servers/1de4d8bc-8768-4b1e-b90f-5e8d2dc5bb07" status: 404 len: 111 microversion: 2.1 time: 0.030264 Aug 10 23:49:38.850952 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3064/6337] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:49:38 2022] GET /compute/v2.1/servers/1de4d8bc-8768-4b1e-b90f-5e8d2dc5bb07 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 10 23:49:42.270294 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-df015c54-6246-4a3c-8e38-4fcdd7ba04a2 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] Calling method '.version_select at 0x7f847c514ee0>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:49:42.298937 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-df015c54-6246-4a3c-8e38-4fcdd7ba04a2 tempest-TestVolumeBootPattern-991439424 tempest-TestVolumeBootPattern-991439424-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-299907508" status: 202 len: 0 microversion: 2.1 time: 0.032400 Aug 10 23:49:42.299529 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3274/6338] 10.222.0.58 () {58 vars in 1260 bytes} [Wed Aug 10 23:49:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-299907508 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:50:00.910148 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=2 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:50:00.910919 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:50:01.027258 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-34ca4d45-6380-4f7f-86dd-cd99c83a1225 tempest-ServersAdminNegativeTestJSON-917254120 tempest-ServersAdminNegativeTestJSON-917254120-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-1266726938", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:50:01.082141 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.network.neutron [None req-34ca4d45-6380-4f7f-86dd-cd99c83a1225 tempest-ServersAdminNegativeTestJSON-917254120 tempest-ServersAdminNegativeTestJSON-917254120-project] validate_networks() for None {{(pid=122632) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 23:50:01.364476 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-34ca4d45-6380-4f7f-86dd-cd99c83a1225 tempest-ServersAdminNegativeTestJSON-917254120 tempest-ServersAdminNegativeTestJSON-917254120-project] Flavor limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:50:01.364893 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-34ca4d45-6380-4f7f-86dd-cd99c83a1225 tempest-ServersAdminNegativeTestJSON-917254120 tempest-ServersAdminNegativeTestJSON-917254120-project] Image limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:50:01.365356 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-34ca4d45-6380-4f7f-86dd-cd99c83a1225 tempest-ServersAdminNegativeTestJSON-917254120 tempest-ServersAdminNegativeTestJSON-917254120-project] Flavor pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:50:01.365760 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-34ca4d45-6380-4f7f-86dd-cd99c83a1225 tempest-ServersAdminNegativeTestJSON-917254120 tempest-ServersAdminNegativeTestJSON-917254120-project] Image pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:50:01.366163 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-34ca4d45-6380-4f7f-86dd-cd99c83a1225 tempest-ServersAdminNegativeTestJSON-917254120 tempest-ServersAdminNegativeTestJSON-917254120-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:50:01.376302 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-34ca4d45-6380-4f7f-86dd-cd99c83a1225 tempest-ServersAdminNegativeTestJSON-917254120 tempest-ServersAdminNegativeTestJSON-917254120-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:50:01.376781 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-34ca4d45-6380-4f7f-86dd-cd99c83a1225 tempest-ServersAdminNegativeTestJSON-917254120 tempest-ServersAdminNegativeTestJSON-917254120-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:50:01.377210 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-34ca4d45-6380-4f7f-86dd-cd99c83a1225 tempest-ServersAdminNegativeTestJSON-917254120 tempest-ServersAdminNegativeTestJSON-917254120-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:50:01.377925 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-34ca4d45-6380-4f7f-86dd-cd99c83a1225 tempest-ServersAdminNegativeTestJSON-917254120 tempest-ServersAdminNegativeTestJSON-917254120-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:50:01.378373 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-34ca4d45-6380-4f7f-86dd-cd99c83a1225 tempest-ServersAdminNegativeTestJSON-917254120 tempest-ServersAdminNegativeTestJSON-917254120-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:50:01.378819 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-34ca4d45-6380-4f7f-86dd-cd99c83a1225 tempest-ServersAdminNegativeTestJSON-917254120 tempest-ServersAdminNegativeTestJSON-917254120-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:50:01.396182 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-34ca4d45-6380-4f7f-86dd-cd99c83a1225 tempest-ServersAdminNegativeTestJSON-917254120 tempest-ServersAdminNegativeTestJSON-917254120-project] Getting quotas for project 93a040d7a21f4e8287e463fa89aec0ad. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:50:01.401751 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-34ca4d45-6380-4f7f-86dd-cd99c83a1225 tempest-ServersAdminNegativeTestJSON-917254120 tempest-ServersAdminNegativeTestJSON-917254120-project] Getting quotas for user ced18df2a7904c60b43b59f16ad3339b and project 93a040d7a21f4e8287e463fa89aec0ad. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:50:01.414653 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-34ca4d45-6380-4f7f-86dd-cd99c83a1225 tempest-ServersAdminNegativeTestJSON-917254120 tempest-ServersAdminNegativeTestJSON-917254120-project] Going to run 1 instances... {{(pid=122632) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 23:50:01.417165 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-34ca4d45-6380-4f7f-86dd-cd99c83a1225 tempest-ServersAdminNegativeTestJSON-917254120 tempest-ServersAdminNegativeTestJSON-917254120-project] [instance: 9277e404-727f-4ab6-a825-fa0ffce6b5dd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78ad8905-f66f-4733-8be9-2b260f1fabed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122632) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 23:50:01.460029 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-34ca4d45-6380-4f7f-86dd-cd99c83a1225 tempest-ServersAdminNegativeTestJSON-917254120 tempest-ServersAdminNegativeTestJSON-917254120-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.555192 Aug 10 23:50:01.460666 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3065/6339] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 23:50:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 556 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 23:50:01.471109 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=48 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:50:01.472097 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_api:SELECT=27,nova_api:DELETE=1 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:50:01.478403 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-05f7d391-ab03-4688-b2bf-f7a2b5b0bd08 tempest-ServersAdminNegativeTestJSON-917254120 tempest-ServersAdminNegativeTestJSON-917254120-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:50:01.480495 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-05f7d391-ab03-4688-b2bf-f7a2b5b0bd08 tempest-ServersAdminNegativeTestJSON-917254120 tempest-ServersAdminNegativeTestJSON-917254120-project] [instance: 9277e404-727f-4ab6-a825-fa0ffce6b5dd] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:50:01.540498 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-05f7d391-ab03-4688-b2bf-f7a2b5b0bd08 tempest-ServersAdminNegativeTestJSON-917254120 tempest-ServersAdminNegativeTestJSON-917254120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced18df2a7904c60b43b59f16ad3339b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a040d7a21f4e8287e463fa89aec0ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:50:01.547770 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-05f7d391-ab03-4688-b2bf-f7a2b5b0bd08 tempest-ServersAdminNegativeTestJSON-917254120 tempest-ServersAdminNegativeTestJSON-917254120-project] 10.222.0.58 "GET /compute/v2.1/servers/9277e404-727f-4ab6-a825-fa0ffce6b5dd" status: 200 len: 1222 microversion: 2.1 time: 0.078497 Aug 10 23:50:01.551470 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3275/6340] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:50:01 2022] GET /compute/v2.1/servers/9277e404-727f-4ab6-a825-fa0ffce6b5dd => generated 1222 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:50:02.570560 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-dd3625b6-9c03-4d1d-a0ba-d59959c5d3e6 tempest-ServersAdminNegativeTestJSON-917254120 tempest-ServersAdminNegativeTestJSON-917254120-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:50:02.571301 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-dd3625b6-9c03-4d1d-a0ba-d59959c5d3e6 tempest-ServersAdminNegativeTestJSON-917254120 tempest-ServersAdminNegativeTestJSON-917254120-project] [instance: 9277e404-727f-4ab6-a825-fa0ffce6b5dd] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:50:02.578177 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dd3625b6-9c03-4d1d-a0ba-d59959c5d3e6 tempest-ServersAdminNegativeTestJSON-917254120 tempest-ServersAdminNegativeTestJSON-917254120-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:50:02.578656 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dd3625b6-9c03-4d1d-a0ba-d59959c5d3e6 tempest-ServersAdminNegativeTestJSON-917254120 tempest-ServersAdminNegativeTestJSON-917254120-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:50:02.579126 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dd3625b6-9c03-4d1d-a0ba-d59959c5d3e6 tempest-ServersAdminNegativeTestJSON-917254120 tempest-ServersAdminNegativeTestJSON-917254120-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:50:02.579814 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dd3625b6-9c03-4d1d-a0ba-d59959c5d3e6 tempest-ServersAdminNegativeTestJSON-917254120 tempest-ServersAdminNegativeTestJSON-917254120-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:50:02.580262 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dd3625b6-9c03-4d1d-a0ba-d59959c5d3e6 tempest-ServersAdminNegativeTestJSON-917254120 tempest-ServersAdminNegativeTestJSON-917254120-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:50:02.580680 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dd3625b6-9c03-4d1d-a0ba-d59959c5d3e6 tempest-ServersAdminNegativeTestJSON-917254120 tempest-ServersAdminNegativeTestJSON-917254120-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:50:02.651344 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-dd3625b6-9c03-4d1d-a0ba-d59959c5d3e6 tempest-ServersAdminNegativeTestJSON-917254120 tempest-ServersAdminNegativeTestJSON-917254120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced18df2a7904c60b43b59f16ad3339b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a040d7a21f4e8287e463fa89aec0ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:50:02.658908 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-dd3625b6-9c03-4d1d-a0ba-d59959c5d3e6 tempest-ServersAdminNegativeTestJSON-917254120 tempest-ServersAdminNegativeTestJSON-917254120-project] 10.222.0.58 "GET /compute/v2.1/servers/9277e404-727f-4ab6-a825-fa0ffce6b5dd" status: 200 len: 1280 microversion: 2.1 time: 0.093293 Aug 10 23:50:02.659486 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3066/6341] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:50:02 2022] GET /compute/v2.1/servers/9277e404-727f-4ab6-a825-fa0ffce6b5dd => generated 1280 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:50:03.682290 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-d40b3725-07d2-4546-a540-a8b5fc0ffdbc tempest-ServersAdminNegativeTestJSON-917254120 tempest-ServersAdminNegativeTestJSON-917254120-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:50:03.683101 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-d40b3725-07d2-4546-a540-a8b5fc0ffdbc tempest-ServersAdminNegativeTestJSON-917254120 tempest-ServersAdminNegativeTestJSON-917254120-project] [instance: 9277e404-727f-4ab6-a825-fa0ffce6b5dd] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:50:03.689881 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d40b3725-07d2-4546-a540-a8b5fc0ffdbc tempest-ServersAdminNegativeTestJSON-917254120 tempest-ServersAdminNegativeTestJSON-917254120-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:50:03.690379 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d40b3725-07d2-4546-a540-a8b5fc0ffdbc tempest-ServersAdminNegativeTestJSON-917254120 tempest-ServersAdminNegativeTestJSON-917254120-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:50:03.690858 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d40b3725-07d2-4546-a540-a8b5fc0ffdbc tempest-ServersAdminNegativeTestJSON-917254120 tempest-ServersAdminNegativeTestJSON-917254120-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:50:03.691798 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d40b3725-07d2-4546-a540-a8b5fc0ffdbc tempest-ServersAdminNegativeTestJSON-917254120 tempest-ServersAdminNegativeTestJSON-917254120-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:50:03.692271 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d40b3725-07d2-4546-a540-a8b5fc0ffdbc tempest-ServersAdminNegativeTestJSON-917254120 tempest-ServersAdminNegativeTestJSON-917254120-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:50:03.692714 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d40b3725-07d2-4546-a540-a8b5fc0ffdbc tempest-ServersAdminNegativeTestJSON-917254120 tempest-ServersAdminNegativeTestJSON-917254120-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:50:03.844369 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-d40b3725-07d2-4546-a540-a8b5fc0ffdbc tempest-ServersAdminNegativeTestJSON-917254120 tempest-ServersAdminNegativeTestJSON-917254120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced18df2a7904c60b43b59f16ad3339b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a040d7a21f4e8287e463fa89aec0ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:50:03.852161 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-d40b3725-07d2-4546-a540-a8b5fc0ffdbc tempest-ServersAdminNegativeTestJSON-917254120 tempest-ServersAdminNegativeTestJSON-917254120-project] 10.222.0.58 "GET /compute/v2.1/servers/9277e404-727f-4ab6-a825-fa0ffce6b5dd" status: 200 len: 1322 microversion: 2.1 time: 0.174219 Aug 10 23:50:03.852745 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3276/6342] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:50:03 2022] GET /compute/v2.1/servers/9277e404-727f-4ab6-a825-fa0ffce6b5dd => generated 1322 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:50:03.900574 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-91e63ff6-79cd-408c-8805-877b1bdc9ebd req-42eac39a-3be6-453a-a92a-ac80aa483c8f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9277e404-727f-4ab6-a825-fa0ffce6b5dd", "tag": "ccebd066-fcea-4af5-b644-48948e3395cd"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:50:03.925644 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-91e63ff6-79cd-408c-8805-877b1bdc9ebd req-42eac39a-3be6-453a-a92a-ac80aa483c8f service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:50:03.927018 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-91e63ff6-79cd-408c-8805-877b1bdc9ebd req-42eac39a-3be6-453a-a92a-ac80aa483c8f service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:50:03.927536 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-91e63ff6-79cd-408c-8805-877b1bdc9ebd req-42eac39a-3be6-453a-a92a-ac80aa483c8f service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:50:03.944861 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-91e63ff6-79cd-408c-8805-877b1bdc9ebd req-42eac39a-3be6-453a-a92a-ac80aa483c8f service nova] Creating event network-changed:ccebd066-fcea-4af5-b644-48948e3395cd for instance 9277e404-727f-4ab6-a825-fa0ffce6b5dd on n-h1-850468-14 Aug 10 23:50:03.951203 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-91e63ff6-79cd-408c-8805-877b1bdc9ebd req-42eac39a-3be6-453a-a92a-ac80aa483c8f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056123 Aug 10 23:50:03.952213 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3067/6343] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:50:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:50:04.873409 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-97b9a232-967d-4708-8c59-4789463c3c02 tempest-ServersAdminNegativeTestJSON-917254120 tempest-ServersAdminNegativeTestJSON-917254120-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:50:04.874009 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-97b9a232-967d-4708-8c59-4789463c3c02 tempest-ServersAdminNegativeTestJSON-917254120 tempest-ServersAdminNegativeTestJSON-917254120-project] [instance: 9277e404-727f-4ab6-a825-fa0ffce6b5dd] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:50:04.880815 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-97b9a232-967d-4708-8c59-4789463c3c02 tempest-ServersAdminNegativeTestJSON-917254120 tempest-ServersAdminNegativeTestJSON-917254120-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:50:04.881302 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-97b9a232-967d-4708-8c59-4789463c3c02 tempest-ServersAdminNegativeTestJSON-917254120 tempest-ServersAdminNegativeTestJSON-917254120-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:50:04.881748 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-97b9a232-967d-4708-8c59-4789463c3c02 tempest-ServersAdminNegativeTestJSON-917254120 tempest-ServersAdminNegativeTestJSON-917254120-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:50:04.882470 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-97b9a232-967d-4708-8c59-4789463c3c02 tempest-ServersAdminNegativeTestJSON-917254120 tempest-ServersAdminNegativeTestJSON-917254120-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:50:04.883480 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-97b9a232-967d-4708-8c59-4789463c3c02 tempest-ServersAdminNegativeTestJSON-917254120 tempest-ServersAdminNegativeTestJSON-917254120-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:50:04.883924 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-97b9a232-967d-4708-8c59-4789463c3c02 tempest-ServersAdminNegativeTestJSON-917254120 tempest-ServersAdminNegativeTestJSON-917254120-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:50:05.014835 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-97b9a232-967d-4708-8c59-4789463c3c02 tempest-ServersAdminNegativeTestJSON-917254120 tempest-ServersAdminNegativeTestJSON-917254120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced18df2a7904c60b43b59f16ad3339b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a040d7a21f4e8287e463fa89aec0ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:50:05.022567 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-97b9a232-967d-4708-8c59-4789463c3c02 tempest-ServersAdminNegativeTestJSON-917254120 tempest-ServersAdminNegativeTestJSON-917254120-project] 10.222.0.58 "GET /compute/v2.1/servers/9277e404-727f-4ab6-a825-fa0ffce6b5dd" status: 200 len: 1322 microversion: 2.1 time: 0.153255 Aug 10 23:50:05.023727 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3277/6344] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:50:04 2022] GET /compute/v2.1/servers/9277e404-727f-4ab6-a825-fa0ffce6b5dd => generated 1322 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:50:06.045340 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-8b9ec0a0-3348-4ea9-90b0-265905f64264 tempest-ServersAdminNegativeTestJSON-917254120 tempest-ServersAdminNegativeTestJSON-917254120-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:50:06.046044 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-8b9ec0a0-3348-4ea9-90b0-265905f64264 tempest-ServersAdminNegativeTestJSON-917254120 tempest-ServersAdminNegativeTestJSON-917254120-project] [instance: 9277e404-727f-4ab6-a825-fa0ffce6b5dd] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:50:06.053213 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8b9ec0a0-3348-4ea9-90b0-265905f64264 tempest-ServersAdminNegativeTestJSON-917254120 tempest-ServersAdminNegativeTestJSON-917254120-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:50:06.053693 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8b9ec0a0-3348-4ea9-90b0-265905f64264 tempest-ServersAdminNegativeTestJSON-917254120 tempest-ServersAdminNegativeTestJSON-917254120-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:50:06.054134 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8b9ec0a0-3348-4ea9-90b0-265905f64264 tempest-ServersAdminNegativeTestJSON-917254120 tempest-ServersAdminNegativeTestJSON-917254120-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:50:06.055504 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8b9ec0a0-3348-4ea9-90b0-265905f64264 tempest-ServersAdminNegativeTestJSON-917254120 tempest-ServersAdminNegativeTestJSON-917254120-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:50:06.055969 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8b9ec0a0-3348-4ea9-90b0-265905f64264 tempest-ServersAdminNegativeTestJSON-917254120 tempest-ServersAdminNegativeTestJSON-917254120-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:50:06.056388 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8b9ec0a0-3348-4ea9-90b0-265905f64264 tempest-ServersAdminNegativeTestJSON-917254120 tempest-ServersAdminNegativeTestJSON-917254120-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:50:06.185748 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-8b9ec0a0-3348-4ea9-90b0-265905f64264 tempest-ServersAdminNegativeTestJSON-917254120 tempest-ServersAdminNegativeTestJSON-917254120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced18df2a7904c60b43b59f16ad3339b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a040d7a21f4e8287e463fa89aec0ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:50:06.193322 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-8b9ec0a0-3348-4ea9-90b0-265905f64264 tempest-ServersAdminNegativeTestJSON-917254120 tempest-ServersAdminNegativeTestJSON-917254120-project] 10.222.0.58 "GET /compute/v2.1/servers/9277e404-727f-4ab6-a825-fa0ffce6b5dd" status: 200 len: 1322 microversion: 2.1 time: 0.152235 Aug 10 23:50:06.193892 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3068/6345] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:50:06 2022] GET /compute/v2.1/servers/9277e404-727f-4ab6-a825-fa0ffce6b5dd => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:50:07.213852 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-6bb0af5c-83d2-4051-92a4-258d1ee72164 tempest-ServersAdminNegativeTestJSON-917254120 tempest-ServersAdminNegativeTestJSON-917254120-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:50:07.214514 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-6bb0af5c-83d2-4051-92a4-258d1ee72164 tempest-ServersAdminNegativeTestJSON-917254120 tempest-ServersAdminNegativeTestJSON-917254120-project] [instance: 9277e404-727f-4ab6-a825-fa0ffce6b5dd] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:50:07.221554 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6bb0af5c-83d2-4051-92a4-258d1ee72164 tempest-ServersAdminNegativeTestJSON-917254120 tempest-ServersAdminNegativeTestJSON-917254120-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:50:07.222060 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6bb0af5c-83d2-4051-92a4-258d1ee72164 tempest-ServersAdminNegativeTestJSON-917254120 tempest-ServersAdminNegativeTestJSON-917254120-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:50:07.222522 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6bb0af5c-83d2-4051-92a4-258d1ee72164 tempest-ServersAdminNegativeTestJSON-917254120 tempest-ServersAdminNegativeTestJSON-917254120-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:50:07.223310 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6bb0af5c-83d2-4051-92a4-258d1ee72164 tempest-ServersAdminNegativeTestJSON-917254120 tempest-ServersAdminNegativeTestJSON-917254120-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:50:07.223782 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6bb0af5c-83d2-4051-92a4-258d1ee72164 tempest-ServersAdminNegativeTestJSON-917254120 tempest-ServersAdminNegativeTestJSON-917254120-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:50:07.224363 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6bb0af5c-83d2-4051-92a4-258d1ee72164 tempest-ServersAdminNegativeTestJSON-917254120 tempest-ServersAdminNegativeTestJSON-917254120-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:50:07.358895 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-6bb0af5c-83d2-4051-92a4-258d1ee72164 tempest-ServersAdminNegativeTestJSON-917254120 tempest-ServersAdminNegativeTestJSON-917254120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced18df2a7904c60b43b59f16ad3339b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a040d7a21f4e8287e463fa89aec0ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:50:07.366603 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-6bb0af5c-83d2-4051-92a4-258d1ee72164 tempest-ServersAdminNegativeTestJSON-917254120 tempest-ServersAdminNegativeTestJSON-917254120-project] 10.222.0.58 "GET /compute/v2.1/servers/9277e404-727f-4ab6-a825-fa0ffce6b5dd" status: 200 len: 1322 microversion: 2.1 time: 0.156819 Aug 10 23:50:07.367833 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3278/6346] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:50:07 2022] GET /compute/v2.1/servers/9277e404-727f-4ab6-a825-fa0ffce6b5dd => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:50:08.388521 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-511fd1dd-ebec-4c9a-819b-3669e65a3df1 tempest-ServersAdminNegativeTestJSON-917254120 tempest-ServersAdminNegativeTestJSON-917254120-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:50:08.389148 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-511fd1dd-ebec-4c9a-819b-3669e65a3df1 tempest-ServersAdminNegativeTestJSON-917254120 tempest-ServersAdminNegativeTestJSON-917254120-project] [instance: 9277e404-727f-4ab6-a825-fa0ffce6b5dd] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:50:08.395993 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-511fd1dd-ebec-4c9a-819b-3669e65a3df1 tempest-ServersAdminNegativeTestJSON-917254120 tempest-ServersAdminNegativeTestJSON-917254120-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:50:08.396506 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-511fd1dd-ebec-4c9a-819b-3669e65a3df1 tempest-ServersAdminNegativeTestJSON-917254120 tempest-ServersAdminNegativeTestJSON-917254120-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:50:08.396947 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-511fd1dd-ebec-4c9a-819b-3669e65a3df1 tempest-ServersAdminNegativeTestJSON-917254120 tempest-ServersAdminNegativeTestJSON-917254120-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:50:08.397670 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-511fd1dd-ebec-4c9a-819b-3669e65a3df1 tempest-ServersAdminNegativeTestJSON-917254120 tempest-ServersAdminNegativeTestJSON-917254120-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:50:08.398123 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-511fd1dd-ebec-4c9a-819b-3669e65a3df1 tempest-ServersAdminNegativeTestJSON-917254120 tempest-ServersAdminNegativeTestJSON-917254120-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:50:08.398553 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-511fd1dd-ebec-4c9a-819b-3669e65a3df1 tempest-ServersAdminNegativeTestJSON-917254120 tempest-ServersAdminNegativeTestJSON-917254120-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:50:08.528466 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-511fd1dd-ebec-4c9a-819b-3669e65a3df1 tempest-ServersAdminNegativeTestJSON-917254120 tempest-ServersAdminNegativeTestJSON-917254120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced18df2a7904c60b43b59f16ad3339b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a040d7a21f4e8287e463fa89aec0ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:50:08.535975 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-511fd1dd-ebec-4c9a-819b-3669e65a3df1 tempest-ServersAdminNegativeTestJSON-917254120 tempest-ServersAdminNegativeTestJSON-917254120-project] 10.222.0.58 "GET /compute/v2.1/servers/9277e404-727f-4ab6-a825-fa0ffce6b5dd" status: 200 len: 1322 microversion: 2.1 time: 0.151372 Aug 10 23:50:08.536546 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3069/6347] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:50:08 2022] GET /compute/v2.1/servers/9277e404-727f-4ab6-a825-fa0ffce6b5dd => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:50:09.289398 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-301ac208-7cba-4d8f-8356-ea4037b593e2 req-ca90d07a-c815-4230-8c5c-fe458b47f6fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9277e404-727f-4ab6-a825-fa0ffce6b5dd", "name": "network-vif-plugged", "status": "completed", "tag": "ccebd066-fcea-4af5-b644-48948e3395cd"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:50:09.299292 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-301ac208-7cba-4d8f-8356-ea4037b593e2 req-ca90d07a-c815-4230-8c5c-fe458b47f6fb service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:50:09.299786 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-301ac208-7cba-4d8f-8356-ea4037b593e2 req-ca90d07a-c815-4230-8c5c-fe458b47f6fb service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:50:09.300238 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-301ac208-7cba-4d8f-8356-ea4037b593e2 req-ca90d07a-c815-4230-8c5c-fe458b47f6fb service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:50:09.312211 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-301ac208-7cba-4d8f-8356-ea4037b593e2 req-ca90d07a-c815-4230-8c5c-fe458b47f6fb service nova] Creating event network-vif-plugged:ccebd066-fcea-4af5-b644-48948e3395cd for instance 9277e404-727f-4ab6-a825-fa0ffce6b5dd on n-h1-850468-14 Aug 10 23:50:09.317165 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-301ac208-7cba-4d8f-8356-ea4037b593e2 req-ca90d07a-c815-4230-8c5c-fe458b47f6fb service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103683 Aug 10 23:50:09.317788 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3279/6348] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:50:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:50:09.558495 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c6bf402a-b99d-4ca4-a260-89c8bdbed2ce tempest-ServersAdminNegativeTestJSON-917254120 tempest-ServersAdminNegativeTestJSON-917254120-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:50:09.559226 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-c6bf402a-b99d-4ca4-a260-89c8bdbed2ce tempest-ServersAdminNegativeTestJSON-917254120 tempest-ServersAdminNegativeTestJSON-917254120-project] [instance: 9277e404-727f-4ab6-a825-fa0ffce6b5dd] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:50:09.566820 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c6bf402a-b99d-4ca4-a260-89c8bdbed2ce tempest-ServersAdminNegativeTestJSON-917254120 tempest-ServersAdminNegativeTestJSON-917254120-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:50:09.567341 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c6bf402a-b99d-4ca4-a260-89c8bdbed2ce tempest-ServersAdminNegativeTestJSON-917254120 tempest-ServersAdminNegativeTestJSON-917254120-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:50:09.567783 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c6bf402a-b99d-4ca4-a260-89c8bdbed2ce tempest-ServersAdminNegativeTestJSON-917254120 tempest-ServersAdminNegativeTestJSON-917254120-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:50:09.568507 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c6bf402a-b99d-4ca4-a260-89c8bdbed2ce tempest-ServersAdminNegativeTestJSON-917254120 tempest-ServersAdminNegativeTestJSON-917254120-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:50:09.568963 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c6bf402a-b99d-4ca4-a260-89c8bdbed2ce tempest-ServersAdminNegativeTestJSON-917254120 tempest-ServersAdminNegativeTestJSON-917254120-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:50:09.569395 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c6bf402a-b99d-4ca4-a260-89c8bdbed2ce tempest-ServersAdminNegativeTestJSON-917254120 tempest-ServersAdminNegativeTestJSON-917254120-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:50:09.856442 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-c6bf402a-b99d-4ca4-a260-89c8bdbed2ce tempest-ServersAdminNegativeTestJSON-917254120 tempest-ServersAdminNegativeTestJSON-917254120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced18df2a7904c60b43b59f16ad3339b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a040d7a21f4e8287e463fa89aec0ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:50:09.864160 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-c6bf402a-b99d-4ca4-a260-89c8bdbed2ce tempest-ServersAdminNegativeTestJSON-917254120 tempest-ServersAdminNegativeTestJSON-917254120-project] 10.222.0.58 "GET /compute/v2.1/servers/9277e404-727f-4ab6-a825-fa0ffce6b5dd" status: 200 len: 1322 microversion: 2.1 time: 0.310473 Aug 10 23:50:09.864769 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3070/6349] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:50:09 2022] GET /compute/v2.1/servers/9277e404-727f-4ab6-a825-fa0ffce6b5dd => generated 1322 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:50:10.887652 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-1820bed9-041c-4476-b3b3-eaefa2f2ddeb tempest-ServersAdminNegativeTestJSON-917254120 tempest-ServersAdminNegativeTestJSON-917254120-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:50:10.888402 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-1820bed9-041c-4476-b3b3-eaefa2f2ddeb tempest-ServersAdminNegativeTestJSON-917254120 tempest-ServersAdminNegativeTestJSON-917254120-project] [instance: 9277e404-727f-4ab6-a825-fa0ffce6b5dd] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:50:10.894594 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1820bed9-041c-4476-b3b3-eaefa2f2ddeb tempest-ServersAdminNegativeTestJSON-917254120 tempest-ServersAdminNegativeTestJSON-917254120-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:50:10.895131 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1820bed9-041c-4476-b3b3-eaefa2f2ddeb tempest-ServersAdminNegativeTestJSON-917254120 tempest-ServersAdminNegativeTestJSON-917254120-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:50:10.895589 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1820bed9-041c-4476-b3b3-eaefa2f2ddeb tempest-ServersAdminNegativeTestJSON-917254120 tempest-ServersAdminNegativeTestJSON-917254120-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:50:10.896297 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1820bed9-041c-4476-b3b3-eaefa2f2ddeb tempest-ServersAdminNegativeTestJSON-917254120 tempest-ServersAdminNegativeTestJSON-917254120-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:50:10.896789 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1820bed9-041c-4476-b3b3-eaefa2f2ddeb tempest-ServersAdminNegativeTestJSON-917254120 tempest-ServersAdminNegativeTestJSON-917254120-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:50:10.897213 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1820bed9-041c-4476-b3b3-eaefa2f2ddeb tempest-ServersAdminNegativeTestJSON-917254120 tempest-ServersAdminNegativeTestJSON-917254120-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:50:11.032875 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-1820bed9-041c-4476-b3b3-eaefa2f2ddeb tempest-ServersAdminNegativeTestJSON-917254120 tempest-ServersAdminNegativeTestJSON-917254120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced18df2a7904c60b43b59f16ad3339b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a040d7a21f4e8287e463fa89aec0ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:50:11.042459 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-1820bed9-041c-4476-b3b3-eaefa2f2ddeb tempest-ServersAdminNegativeTestJSON-917254120 tempest-ServersAdminNegativeTestJSON-917254120-project] 10.222.0.58 "GET /compute/v2.1/servers/9277e404-727f-4ab6-a825-fa0ffce6b5dd" status: 200 len: 1322 microversion: 2.1 time: 0.160100 Aug 10 23:50:11.043168 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3280/6350] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:50:10 2022] GET /compute/v2.1/servers/9277e404-727f-4ab6-a825-fa0ffce6b5dd => generated 1322 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:50:12.064676 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-af92ee2c-3db1-4252-91c6-7071b21e28e7 tempest-ServersAdminNegativeTestJSON-917254120 tempest-ServersAdminNegativeTestJSON-917254120-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:50:12.065317 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-af92ee2c-3db1-4252-91c6-7071b21e28e7 tempest-ServersAdminNegativeTestJSON-917254120 tempest-ServersAdminNegativeTestJSON-917254120-project] [instance: 9277e404-727f-4ab6-a825-fa0ffce6b5dd] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:50:12.068100 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=2 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:50:12.068858 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=6 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:50:12.076037 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-af92ee2c-3db1-4252-91c6-7071b21e28e7 tempest-ServersAdminNegativeTestJSON-917254120 tempest-ServersAdminNegativeTestJSON-917254120-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:50:12.076663 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-af92ee2c-3db1-4252-91c6-7071b21e28e7 tempest-ServersAdminNegativeTestJSON-917254120 tempest-ServersAdminNegativeTestJSON-917254120-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:50:12.077332 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-af92ee2c-3db1-4252-91c6-7071b21e28e7 tempest-ServersAdminNegativeTestJSON-917254120 tempest-ServersAdminNegativeTestJSON-917254120-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:50:12.078429 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-af92ee2c-3db1-4252-91c6-7071b21e28e7 tempest-ServersAdminNegativeTestJSON-917254120 tempest-ServersAdminNegativeTestJSON-917254120-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:50:12.079235 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-af92ee2c-3db1-4252-91c6-7071b21e28e7 tempest-ServersAdminNegativeTestJSON-917254120 tempest-ServersAdminNegativeTestJSON-917254120-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:50:12.079887 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-af92ee2c-3db1-4252-91c6-7071b21e28e7 tempest-ServersAdminNegativeTestJSON-917254120 tempest-ServersAdminNegativeTestJSON-917254120-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:50:12.216616 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-af92ee2c-3db1-4252-91c6-7071b21e28e7 tempest-ServersAdminNegativeTestJSON-917254120 tempest-ServersAdminNegativeTestJSON-917254120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced18df2a7904c60b43b59f16ad3339b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a040d7a21f4e8287e463fa89aec0ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:50:12.224267 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-af92ee2c-3db1-4252-91c6-7071b21e28e7 tempest-ServersAdminNegativeTestJSON-917254120 tempest-ServersAdminNegativeTestJSON-917254120-project] 10.222.0.58 "GET /compute/v2.1/servers/9277e404-727f-4ab6-a825-fa0ffce6b5dd" status: 200 len: 1471 microversion: 2.1 time: 0.163553 Aug 10 23:50:12.224844 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3071/6351] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:50:12 2022] GET /compute/v2.1/servers/9277e404-727f-4ab6-a825-fa0ffce6b5dd => generated 1471 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:50:12.248843 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=2 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:50:12.297543 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-ae715e82-85ad-4628-acc6-1f5a5295d981 tempest-ServersAdminNegativeTestJSON-1399365749 tempest-ServersAdminNegativeTestJSON-1399365749-project-admin] Calling method '.version_select at 0x7f847c0d7670>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:50:12.367073 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-ae715e82-85ad-4628-acc6-1f5a5295d981 tempest-ServersAdminNegativeTestJSON-1399365749 tempest-ServersAdminNegativeTestJSON-1399365749-project-admin] 10.222.0.58 "GET /compute/v2.1/os-quota-sets/076520b7ecab4a92a817d2e1a53400f6" status: 200 len: 371 microversion: 2.1 time: 0.123468 Aug 10 23:50:12.367679 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3281/6352] 10.222.0.58 () {58 vars in 1242 bytes} [Wed Aug 10 23:50:12 2022] GET /compute/v2.1/os-quota-sets/076520b7ecab4a92a817d2e1a53400f6 => generated 371 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:50:12.380201 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-2617ea45-188a-4b79-bd43-a972ace8b643 tempest-ServersAdminNegativeTestJSON-1399365749 tempest-ServersAdminNegativeTestJSON-1399365749-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1902379506", "id": 1317794937, "os-flavor-access:is_public": "True"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:50:12.383231 n-d-850468-14 devstack@n-api.service[122632]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 23:50:12.383231 n-d-850468-14 devstack@n-api.service[122632]: warnings.warn(msg) Aug 10 23:50:12.398679 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-2617ea45-188a-4b79-bd43-a972ace8b643 tempest-ServersAdminNegativeTestJSON-1399365749 tempest-ServersAdminNegativeTestJSON-1399365749-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.022170 Aug 10 23:50:12.399372 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3072/6353] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 23:50:12 2022] POST /compute/v2.1/flavors => generated 438 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:50:12.411176 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-216632af-b248-40a9-8de5-740405bf8892 tempest-ServersAdminNegativeTestJSON-1399365749 tempest-ServersAdminNegativeTestJSON-1399365749-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1317794937"}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:50:12.413390 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-216632af-b248-40a9-8de5-740405bf8892 tempest-ServersAdminNegativeTestJSON-1399365749 tempest-ServersAdminNegativeTestJSON-1399365749-project-admin] [instance: 9277e404-727f-4ab6-a825-fa0ffce6b5dd] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:50:12.419990 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-216632af-b248-40a9-8de5-740405bf8892 tempest-ServersAdminNegativeTestJSON-1399365749 tempest-ServersAdminNegativeTestJSON-1399365749-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:50:12.420479 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-216632af-b248-40a9-8de5-740405bf8892 tempest-ServersAdminNegativeTestJSON-1399365749 tempest-ServersAdminNegativeTestJSON-1399365749-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:50:12.420931 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-216632af-b248-40a9-8de5-740405bf8892 tempest-ServersAdminNegativeTestJSON-1399365749 tempest-ServersAdminNegativeTestJSON-1399365749-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:50:12.421944 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-216632af-b248-40a9-8de5-740405bf8892 tempest-ServersAdminNegativeTestJSON-1399365749 tempest-ServersAdminNegativeTestJSON-1399365749-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:50:12.422435 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-216632af-b248-40a9-8de5-740405bf8892 tempest-ServersAdminNegativeTestJSON-1399365749 tempest-ServersAdminNegativeTestJSON-1399365749-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:50:12.422894 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-216632af-b248-40a9-8de5-740405bf8892 tempest-ServersAdminNegativeTestJSON-1399365749 tempest-ServersAdminNegativeTestJSON-1399365749-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:50:12.612122 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-216632af-b248-40a9-8de5-740405bf8892 tempest-ServersAdminNegativeTestJSON-1399365749 tempest-ServersAdminNegativeTestJSON-1399365749-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '8c021f8db66d4729ad72d86e2b7f679d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076520b7ecab4a92a817d2e1a53400f6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:50:12.619355 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-216632af-b248-40a9-8de5-740405bf8892 tempest-ServersAdminNegativeTestJSON-1399365749 tempest-ServersAdminNegativeTestJSON-1399365749-project-admin] [instance: 9277e404-727f-4ab6-a825-fa0ffce6b5dd] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1902379506 {{(pid=122633) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 10 23:50:12.625946 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-216632af-b248-40a9-8de5-740405bf8892 tempest-ServersAdminNegativeTestJSON-1399365749 tempest-ServersAdminNegativeTestJSON-1399365749-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:50:12.626436 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-216632af-b248-40a9-8de5-740405bf8892 tempest-ServersAdminNegativeTestJSON-1399365749 tempest-ServersAdminNegativeTestJSON-1399365749-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:50:12.626915 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-216632af-b248-40a9-8de5-740405bf8892 tempest-ServersAdminNegativeTestJSON-1399365749 tempest-ServersAdminNegativeTestJSON-1399365749-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:50:12.627650 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-216632af-b248-40a9-8de5-740405bf8892 tempest-ServersAdminNegativeTestJSON-1399365749 tempest-ServersAdminNegativeTestJSON-1399365749-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:50:12.628114 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-216632af-b248-40a9-8de5-740405bf8892 tempest-ServersAdminNegativeTestJSON-1399365749 tempest-ServersAdminNegativeTestJSON-1399365749-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:50:12.628549 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-216632af-b248-40a9-8de5-740405bf8892 tempest-ServersAdminNegativeTestJSON-1399365749 tempest-ServersAdminNegativeTestJSON-1399365749-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:50:12.648469 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-216632af-b248-40a9-8de5-740405bf8892 tempest-ServersAdminNegativeTestJSON-1399365749 tempest-ServersAdminNegativeTestJSON-1399365749-project-admin] Getting quotas for project 93a040d7a21f4e8287e463fa89aec0ad. Resources: {'cores', 'ram'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:50:12.654092 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-216632af-b248-40a9-8de5-740405bf8892 tempest-ServersAdminNegativeTestJSON-1399365749 tempest-ServersAdminNegativeTestJSON-1399365749-project-admin] Getting quotas for user ced18df2a7904c60b43b59f16ad3339b and project 93a040d7a21f4e8287e463fa89aec0ad. Resources: {'cores', 'ram'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:50:12.666646 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.compute.api [None req-216632af-b248-40a9-8de5-740405bf8892 tempest-ServersAdminNegativeTestJSON-1399365749 tempest-ServersAdminNegativeTestJSON-1399365749-project-admin] ram quota exceeded for 076520b7ecab4a92a817d2e1a53400f6, tried to resize instance. Aug 10 23:50:12.667502 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-216632af-b248-40a9-8de5-740405bf8892 tempest-ServersAdminNegativeTestJSON-1399365749 tempest-ServersAdminNegativeTestJSON-1399365749-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 10 23:50:12.689104 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-216632af-b248-40a9-8de5-740405bf8892 tempest-ServersAdminNegativeTestJSON-1399365749 tempest-ServersAdminNegativeTestJSON-1399365749-project-admin] Request method failure captured: Aug 10 23:50:12.689104 n-d-850468-14 devstack@n-api.service[122633]: request: POST /compute/v2.1/servers/9277e404-727f-4ab6-a825-fa0ffce6b5dd/action HTTP/1.1 Aug 10 23:50:12.689104 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:50:12.689104 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:50:12.689104 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:50:12.689104 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 39 Aug 10 23:50:12.689104 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:50:12.689104 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:50:12.689104 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:50:12.689104 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:50:12.689104 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9EQoyu4ZQJfrvjE52Of0OG0-lmVHWG4nSF6QJvlVAiyBbvobbgyaL8yUZ2l--7JAlmvv7VoiAAzdy70cNaAk0wkB3XwfapSZulniQMBcG86_PPMY1rVoHsU_JUJBSwG0WF976JuIHgQtQqRkcOp1VUsVgvZ0VC4Ry_jYxjZ6UfwS_qI Aug 10 23:50:12.689104 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:50:12.689104 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:50:12.689104 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:50:12.689104 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:50:12.689104 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:50:12.689104 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:50:12.689104 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 076520b7ecab4a92a817d2e1a53400f6 Aug 10 23:50:12.689104 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1399365749 Aug 10 23:50:12.689104 n-d-850468-14 devstack@n-api.service[122633]: X-Role: admin,member,reader Aug 10 23:50:12.689104 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: admin,member,reader Aug 10 23:50:12.689104 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/076520b7ecab4a92a817d2e1a53400f6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/076520b7ecab4a92a817d2e1a53400f6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/076520b7ecab4a92a817d2e1a53400f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_076520b7ecab4a92a817d2e1a53400f6", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:50:12.689104 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1399365749 Aug 10 23:50:12.689104 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 076520b7ecab4a92a817d2e1a53400f6 Aug 10 23:50:12.689104 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1399365749 Aug 10 23:50:12.689104 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-ServersAdminNegativeTestJSON-1399365749-project-admin Aug 10 23:50:12.689104 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:50:12.689104 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:50:12.689104 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 8c021f8db66d4729ad72d86e2b7f679d Aug 10 23:50:12.689104 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1399365749-project-admin Aug 10 23:50:12.689104 n-d-850468-14 devstack@n-api.service[122633]: Aug 10 23:50:12.689104 n-d-850468-14 devstack@n-api.service[122633]: {"resize": {"flavorRef": "1317794937"}} Aug 10 23:50:12.689104 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:50:12.689104 n-d-850468-14 devstack@n-api.service[122633]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 10 23:50:12.689104 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': '9277e404-727f-4ab6-a825-fa0ffce6b5dd', 'body': {'resize': {'flavorRef': '1317794937'}}} Aug 10 23:50:12.689104 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:50:12.689104 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:50:12.689104 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3823, in _check_quota_for_upsize Aug 10 23:50:12.689104 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Aug 10 23:50:12.689104 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 10 23:50:12.689104 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 10 23:50:12.689104 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 10 23:50:12.689104 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc Aug 10 23:50:12.689104 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 10 23:50:12.689104 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 10 23:50:12.689104 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 10 23:50:12.689104 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 10 23:50:12.689104 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 10 23:50:12.689104 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 10 23:50:12.689104 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 10 23:50:12.689104 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 10 23:50:12.689104 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Aug 10 23:50:12.689104 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 10 23:50:12.689104 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Aug 10 23:50:12.689104 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:50:12.689104 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:50:12.689104 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:50:12.689104 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:50:12.689104 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Aug 10 23:50:12.689104 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Aug 10 23:50:12.689104 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Aug 10 23:50:12.689104 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 10 23:50:12.689104 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Aug 10 23:50:12.695150 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 10 23:50:12.695150 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Aug 10 23:50:12.695150 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 10 23:50:12.695150 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Aug 10 23:50:12.695150 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 10 23:50:12.695150 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 10 23:50:12.695150 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 10 23:50:12.695150 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 10 23:50:12.695150 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 10 23:50:12.695150 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 10 23:50:12.695150 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 10 23:50:12.695150 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4192, in resize Aug 10 23:50:12.695150 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Aug 10 23:50:12.695150 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3841, in _check_quota_for_upsize Aug 10 23:50:12.695150 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 10 23:50:12.695150 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 10 23:50:12.695150 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:50:12.695150 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:50:12.695150 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:50:12.695150 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:50:12.695150 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:50:12.695150 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:50:12.695150 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:50:12.695150 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:50:12.695150 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:50:12.695150 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:50:12.695150 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 23:50:12.695150 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 23:50:12.695150 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Aug 10 23:50:12.695150 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 10 23:50:12.695150 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Aug 10 23:50:12.695150 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 10 23:50:12.695150 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 10 23:50:12.695150 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:50:12.695150 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:50:12.695150 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:50:12.695150 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:50:12.695150 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:50:12.695150 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:50:12.695150 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:50:12.695150 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:50:12.695150 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 10 23:50:12.695150 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:50:12.695150 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-216632af-b248-40a9-8de5-740405bf8892 tempest-ServersAdminNegativeTestJSON-1399365749 tempest-ServersAdminNegativeTestJSON-1399365749-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:50:12.695150 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-216632af-b248-40a9-8de5-740405bf8892 tempest-ServersAdminNegativeTestJSON-1399365749 tempest-ServersAdminNegativeTestJSON-1399365749-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/9277e404-727f-4ab6-a825-fa0ffce6b5dd/action" status: 403 len: 118 microversion: 2.1 time: 0.283299 Aug 10 23:50:12.695150 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3282/6354] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:50:12 2022] POST /compute/v2.1/servers/9277e404-727f-4ab6-a825-fa0ffce6b5dd/action => generated 118 bytes in 284 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:50:12.699620 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c4d5d99f-44a0-4691-9554-fade0e9c4426 tempest-ServersAdminNegativeTestJSON-1399365749 tempest-ServersAdminNegativeTestJSON-1399365749-project-admin] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:50:12.700377 n-d-850468-14 devstack@n-api.service[122632]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 23:50:12.700377 n-d-850468-14 devstack@n-api.service[122632]: warnings.warn(msg) Aug 10 23:50:12.716431 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-c4d5d99f-44a0-4691-9554-fade0e9c4426 tempest-ServersAdminNegativeTestJSON-1399365749 tempest-ServersAdminNegativeTestJSON-1399365749-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/1317794937" status: 202 len: 0 microversion: 2.1 time: 0.020608 Aug 10 23:50:12.717017 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3073/6355] 10.222.0.58 () {58 vars in 1161 bytes} [Wed Aug 10 23:50:12 2022] DELETE /compute/v2.1/flavors/1317794937 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:50:12.724846 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-98707630-310b-47df-8b05-02e35a8f9c7c tempest-ServersAdminNegativeTestJSON-1399365749 tempest-ServersAdminNegativeTestJSON-1399365749-project-admin] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:50:12.747174 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-98707630-310b-47df-8b05-02e35a8f9c7c tempest-ServersAdminNegativeTestJSON-1399365749 tempest-ServersAdminNegativeTestJSON-1399365749-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.025879 Aug 10 23:50:12.747763 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3283/6356] 10.222.0.58 () {58 vars in 1146 bytes} [Wed Aug 10 23:50:12 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:50:12.767313 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-95ce257f-d9d5-46dc-9f8a-09d0e956ab38 tempest-ServersAdminNegativeTestJSON-1399365749 tempest-ServersAdminNegativeTestJSON-1399365749-project-admin] Calling method '.version_select at 0x7f847cfea1f0>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:50:12.838440 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-95ce257f-d9d5-46dc-9f8a-09d0e956ab38 tempest-ServersAdminNegativeTestJSON-1399365749 tempest-ServersAdminNegativeTestJSON-1399365749-project-admin] 10.222.0.58 "GET /compute/v2.1/os-quota-sets/076520b7ecab4a92a817d2e1a53400f6" status: 200 len: 371 microversion: 2.1 time: 0.074825 Aug 10 23:50:12.839040 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3074/6357] 10.222.0.58 () {58 vars in 1242 bytes} [Wed Aug 10 23:50:12 2022] GET /compute/v2.1/os-quota-sets/076520b7ecab4a92a817d2e1a53400f6 => generated 371 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:50:12.850365 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-d6b76912-8ce9-417e-a893-b3842508d1ee tempest-ServersAdminNegativeTestJSON-1399365749 tempest-ServersAdminNegativeTestJSON-1399365749-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1595110629", "id": 653395621, "os-flavor-access:is_public": "True"}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:50:12.854045 n-d-850468-14 devstack@n-api.service[122633]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 23:50:12.854045 n-d-850468-14 devstack@n-api.service[122633]: warnings.warn(msg) Aug 10 23:50:12.869431 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-d6b76912-8ce9-417e-a893-b3842508d1ee tempest-ServersAdminNegativeTestJSON-1399365749 tempest-ServersAdminNegativeTestJSON-1399365749-project-admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 434 microversion: 2.1 time: 0.021909 Aug 10 23:50:12.870266 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3284/6358] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 23:50:12 2022] POST /compute/v2.1/flavors => generated 434 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:50:12.881702 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-91a4f60f-265a-488d-9209-5265b0ce9fca tempest-ServersAdminNegativeTestJSON-1399365749 tempest-ServersAdminNegativeTestJSON-1399365749-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "653395621"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:50:12.884292 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-91a4f60f-265a-488d-9209-5265b0ce9fca tempest-ServersAdminNegativeTestJSON-1399365749 tempest-ServersAdminNegativeTestJSON-1399365749-project-admin] [instance: 9277e404-727f-4ab6-a825-fa0ffce6b5dd] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:50:12.890465 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-91a4f60f-265a-488d-9209-5265b0ce9fca tempest-ServersAdminNegativeTestJSON-1399365749 tempest-ServersAdminNegativeTestJSON-1399365749-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:50:12.890989 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-91a4f60f-265a-488d-9209-5265b0ce9fca tempest-ServersAdminNegativeTestJSON-1399365749 tempest-ServersAdminNegativeTestJSON-1399365749-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:50:12.891422 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-91a4f60f-265a-488d-9209-5265b0ce9fca tempest-ServersAdminNegativeTestJSON-1399365749 tempest-ServersAdminNegativeTestJSON-1399365749-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:50:12.892107 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-91a4f60f-265a-488d-9209-5265b0ce9fca tempest-ServersAdminNegativeTestJSON-1399365749 tempest-ServersAdminNegativeTestJSON-1399365749-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:50:12.892556 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-91a4f60f-265a-488d-9209-5265b0ce9fca tempest-ServersAdminNegativeTestJSON-1399365749 tempest-ServersAdminNegativeTestJSON-1399365749-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:50:12.892977 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-91a4f60f-265a-488d-9209-5265b0ce9fca tempest-ServersAdminNegativeTestJSON-1399365749 tempest-ServersAdminNegativeTestJSON-1399365749-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:50:12.980868 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-91a4f60f-265a-488d-9209-5265b0ce9fca tempest-ServersAdminNegativeTestJSON-1399365749 tempest-ServersAdminNegativeTestJSON-1399365749-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '8c021f8db66d4729ad72d86e2b7f679d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '076520b7ecab4a92a817d2e1a53400f6', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:50:12.987186 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-91a4f60f-265a-488d-9209-5265b0ce9fca tempest-ServersAdminNegativeTestJSON-1399365749 tempest-ServersAdminNegativeTestJSON-1399365749-project-admin] [instance: 9277e404-727f-4ab6-a825-fa0ffce6b5dd] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1595110629 {{(pid=122632) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 10 23:50:12.994199 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-91a4f60f-265a-488d-9209-5265b0ce9fca tempest-ServersAdminNegativeTestJSON-1399365749 tempest-ServersAdminNegativeTestJSON-1399365749-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:50:12.994973 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-91a4f60f-265a-488d-9209-5265b0ce9fca tempest-ServersAdminNegativeTestJSON-1399365749 tempest-ServersAdminNegativeTestJSON-1399365749-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:50:12.995407 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-91a4f60f-265a-488d-9209-5265b0ce9fca tempest-ServersAdminNegativeTestJSON-1399365749 tempest-ServersAdminNegativeTestJSON-1399365749-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:50:12.996148 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-91a4f60f-265a-488d-9209-5265b0ce9fca tempest-ServersAdminNegativeTestJSON-1399365749 tempest-ServersAdminNegativeTestJSON-1399365749-project-admin] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:50:12.996598 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-91a4f60f-265a-488d-9209-5265b0ce9fca tempest-ServersAdminNegativeTestJSON-1399365749 tempest-ServersAdminNegativeTestJSON-1399365749-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:50:12.997014 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-91a4f60f-265a-488d-9209-5265b0ce9fca tempest-ServersAdminNegativeTestJSON-1399365749 tempest-ServersAdminNegativeTestJSON-1399365749-project-admin] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:50:13.017226 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-91a4f60f-265a-488d-9209-5265b0ce9fca tempest-ServersAdminNegativeTestJSON-1399365749 tempest-ServersAdminNegativeTestJSON-1399365749-project-admin] Getting quotas for project 93a040d7a21f4e8287e463fa89aec0ad. Resources: {'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:50:13.022195 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-91a4f60f-265a-488d-9209-5265b0ce9fca tempest-ServersAdminNegativeTestJSON-1399365749 tempest-ServersAdminNegativeTestJSON-1399365749-project-admin] Getting quotas for user ced18df2a7904c60b43b59f16ad3339b and project 93a040d7a21f4e8287e463fa89aec0ad. Resources: {'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:50:13.034827 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.compute.api [None req-91a4f60f-265a-488d-9209-5265b0ce9fca tempest-ServersAdminNegativeTestJSON-1399365749 tempest-ServersAdminNegativeTestJSON-1399365749-project-admin] cores quota exceeded for 076520b7ecab4a92a817d2e1a53400f6, tried to resize instance. Aug 10 23:50:13.035357 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-91a4f60f-265a-488d-9209-5265b0ce9fca tempest-ServersAdminNegativeTestJSON-1399365749 tempest-ServersAdminNegativeTestJSON-1399365749-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 10 23:50:13.037417 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-91a4f60f-265a-488d-9209-5265b0ce9fca tempest-ServersAdminNegativeTestJSON-1399365749 tempest-ServersAdminNegativeTestJSON-1399365749-project-admin] Request method failure captured: Aug 10 23:50:13.037417 n-d-850468-14 devstack@n-api.service[122632]: request: POST /compute/v2.1/servers/9277e404-727f-4ab6-a825-fa0ffce6b5dd/action HTTP/1.1 Aug 10 23:50:13.037417 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:50:13.037417 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:50:13.037417 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:50:13.037417 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 38 Aug 10 23:50:13.037417 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:50:13.037417 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:50:13.037417 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:50:13.037417 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:50:13.037417 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9EQoyu4ZQJfrvjE52Of0OG0-lmVHWG4nSF6QJvlVAiyBbvobbgyaL8yUZ2l--7JAlmvv7VoiAAzdy70cNaAk0wkB3XwfapSZulniQMBcG86_PPMY1rVoHsU_JUJBSwG0WF976JuIHgQtQqRkcOp1VUsVgvZ0VC4Ry_jYxjZ6UfwS_qI Aug 10 23:50:13.037417 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:50:13.037417 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:50:13.037417 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:50:13.037417 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:50:13.037417 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:50:13.037417 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:50:13.037417 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 076520b7ecab4a92a817d2e1a53400f6 Aug 10 23:50:13.037417 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1399365749 Aug 10 23:50:13.037417 n-d-850468-14 devstack@n-api.service[122632]: X-Role: admin,member,reader Aug 10 23:50:13.037417 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: admin,member,reader Aug 10 23:50:13.037417 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/076520b7ecab4a92a817d2e1a53400f6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/076520b7ecab4a92a817d2e1a53400f6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/076520b7ecab4a92a817d2e1a53400f6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_076520b7ecab4a92a817d2e1a53400f6", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:50:13.037417 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1399365749 Aug 10 23:50:13.037417 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 076520b7ecab4a92a817d2e1a53400f6 Aug 10 23:50:13.037417 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1399365749 Aug 10 23:50:13.037417 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-ServersAdminNegativeTestJSON-1399365749-project-admin Aug 10 23:50:13.037417 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:50:13.037417 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:50:13.037417 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: 8c021f8db66d4729ad72d86e2b7f679d Aug 10 23:50:13.037417 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1399365749-project-admin Aug 10 23:50:13.037417 n-d-850468-14 devstack@n-api.service[122632]: Aug 10 23:50:13.037417 n-d-850468-14 devstack@n-api.service[122632]: {"resize": {"flavorRef": "653395621"}} Aug 10 23:50:13.037417 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:50:13.037417 n-d-850468-14 devstack@n-api.service[122632]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 10 23:50:13.037417 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': '9277e404-727f-4ab6-a825-fa0ffce6b5dd', 'body': {'resize': {'flavorRef': '653395621'}}} Aug 10 23:50:13.037417 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:50:13.037417 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:50:13.037417 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3823, in _check_quota_for_upsize Aug 10 23:50:13.037417 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Aug 10 23:50:13.037417 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 10 23:50:13.037417 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 10 23:50:13.037417 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 10 23:50:13.037417 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc Aug 10 23:50:13.037417 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 10 23:50:13.037417 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 10 23:50:13.037417 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 10 23:50:13.037417 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 10 23:50:13.037417 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 10 23:50:13.037417 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 10 23:50:13.037417 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 10 23:50:13.037417 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 10 23:50:13.037417 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Aug 10 23:50:13.037417 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 10 23:50:13.037417 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Aug 10 23:50:13.037417 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:50:13.037417 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:50:13.037417 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:50:13.037417 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:50:13.037417 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Aug 10 23:50:13.037417 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Aug 10 23:50:13.037417 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Aug 10 23:50:13.037417 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 10 23:50:13.037417 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Aug 10 23:50:13.043381 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 10 23:50:13.043381 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Aug 10 23:50:13.043381 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 10 23:50:13.043381 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Aug 10 23:50:13.043381 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 10 23:50:13.043381 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 10 23:50:13.043381 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 10 23:50:13.043381 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 10 23:50:13.043381 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 10 23:50:13.043381 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 10 23:50:13.043381 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 10 23:50:13.043381 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4192, in resize Aug 10 23:50:13.043381 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Aug 10 23:50:13.043381 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3841, in _check_quota_for_upsize Aug 10 23:50:13.043381 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 10 23:50:13.043381 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 10 23:50:13.043381 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:50:13.043381 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:50:13.043381 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:50:13.043381 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:50:13.043381 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:50:13.043381 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:50:13.043381 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:50:13.043381 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:50:13.043381 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:50:13.043381 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:50:13.043381 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 23:50:13.043381 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 23:50:13.043381 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Aug 10 23:50:13.043381 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 10 23:50:13.043381 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Aug 10 23:50:13.043381 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 10 23:50:13.043381 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 10 23:50:13.043381 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:50:13.043381 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:50:13.043381 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:50:13.043381 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:50:13.043381 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:50:13.043381 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:50:13.043381 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:50:13.043381 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:50:13.043381 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 10 23:50:13.043381 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:50:13.043381 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-91a4f60f-265a-488d-9209-5265b0ce9fca tempest-ServersAdminNegativeTestJSON-1399365749 tempest-ServersAdminNegativeTestJSON-1399365749-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:50:13.043381 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-91a4f60f-265a-488d-9209-5265b0ce9fca tempest-ServersAdminNegativeTestJSON-1399365749 tempest-ServersAdminNegativeTestJSON-1399365749-project-admin] 10.222.0.58 "POST /compute/v2.1/servers/9277e404-727f-4ab6-a825-fa0ffce6b5dd/action" status: 403 len: 113 microversion: 2.1 time: 0.161021 Aug 10 23:50:13.043381 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3075/6359] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:50:12 2022] POST /compute/v2.1/servers/9277e404-727f-4ab6-a825-fa0ffce6b5dd/action => generated 113 bytes in 162 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:50:13.048325 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-d2983bc7-d0b5-4b01-a019-b96f03ee8a74 tempest-ServersAdminNegativeTestJSON-1399365749 tempest-ServersAdminNegativeTestJSON-1399365749-project-admin] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:50:13.049076 n-d-850468-14 devstack@n-api.service[122633]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 10 23:50:13.049076 n-d-850468-14 devstack@n-api.service[122633]: warnings.warn(msg) Aug 10 23:50:13.065290 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-d2983bc7-d0b5-4b01-a019-b96f03ee8a74 tempest-ServersAdminNegativeTestJSON-1399365749 tempest-ServersAdminNegativeTestJSON-1399365749-project-admin] 10.222.0.58 "DELETE /compute/v2.1/flavors/653395621" status: 202 len: 0 microversion: 2.1 time: 0.020582 Aug 10 23:50:13.065843 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3285/6360] 10.222.0.58 () {58 vars in 1158 bytes} [Wed Aug 10 23:50:13 2022] DELETE /compute/v2.1/flavors/653395621 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:50:13.073854 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-6a96e469-ca2c-4096-857c-df76472274ff tempest-ServersAdminNegativeTestJSON-1399365749 tempest-ServersAdminNegativeTestJSON-1399365749-project-admin] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:50:13.094996 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-6a96e469-ca2c-4096-857c-df76472274ff tempest-ServersAdminNegativeTestJSON-1399365749 tempest-ServersAdminNegativeTestJSON-1399365749-project-admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024997 Aug 10 23:50:13.095564 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3076/6361] 10.222.0.58 () {58 vars in 1146 bytes} [Wed Aug 10 23:50:13 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:50:13.115764 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-2675ba8c-5122-445c-902c-34ba411abe02 tempest-ServersAdminNegativeTestJSON-917254120 tempest-ServersAdminNegativeTestJSON-917254120-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:50:13.116465 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-2675ba8c-5122-445c-902c-34ba411abe02 tempest-ServersAdminNegativeTestJSON-917254120 tempest-ServersAdminNegativeTestJSON-917254120-project] [instance: 9277e404-727f-4ab6-a825-fa0ffce6b5dd] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:50:13.123296 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2675ba8c-5122-445c-902c-34ba411abe02 tempest-ServersAdminNegativeTestJSON-917254120 tempest-ServersAdminNegativeTestJSON-917254120-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:50:13.123794 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2675ba8c-5122-445c-902c-34ba411abe02 tempest-ServersAdminNegativeTestJSON-917254120 tempest-ServersAdminNegativeTestJSON-917254120-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:50:13.124247 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2675ba8c-5122-445c-902c-34ba411abe02 tempest-ServersAdminNegativeTestJSON-917254120 tempest-ServersAdminNegativeTestJSON-917254120-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:50:13.124957 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2675ba8c-5122-445c-902c-34ba411abe02 tempest-ServersAdminNegativeTestJSON-917254120 tempest-ServersAdminNegativeTestJSON-917254120-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:50:13.125430 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2675ba8c-5122-445c-902c-34ba411abe02 tempest-ServersAdminNegativeTestJSON-917254120 tempest-ServersAdminNegativeTestJSON-917254120-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:50:13.125870 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2675ba8c-5122-445c-902c-34ba411abe02 tempest-ServersAdminNegativeTestJSON-917254120 tempest-ServersAdminNegativeTestJSON-917254120-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:50:13.151782 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-2675ba8c-5122-445c-902c-34ba411abe02 tempest-ServersAdminNegativeTestJSON-917254120 tempest-ServersAdminNegativeTestJSON-917254120-project] [instance: 9277e404-727f-4ab6-a825-fa0ffce6b5dd] Going to try to terminate instance {{(pid=122633) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:50:13.229083 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-2675ba8c-5122-445c-902c-34ba411abe02 tempest-ServersAdminNegativeTestJSON-917254120 tempest-ServersAdminNegativeTestJSON-917254120-project] 10.222.0.58 "DELETE /compute/v2.1/servers/9277e404-727f-4ab6-a825-fa0ffce6b5dd" status: 204 len: 0 microversion: 2.1 time: 0.116834 Aug 10 23:50:13.229686 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3286/6362] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:50:13 2022] DELETE /compute/v2.1/servers/9277e404-727f-4ab6-a825-fa0ffce6b5dd => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:50:13.237914 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-6d2f1096-c3a2-42aa-b43e-a9e24dd7046d tempest-ServersAdminNegativeTestJSON-917254120 tempest-ServersAdminNegativeTestJSON-917254120-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:50:13.238530 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-6d2f1096-c3a2-42aa-b43e-a9e24dd7046d tempest-ServersAdminNegativeTestJSON-917254120 tempest-ServersAdminNegativeTestJSON-917254120-project] [instance: 9277e404-727f-4ab6-a825-fa0ffce6b5dd] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:50:13.245019 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6d2f1096-c3a2-42aa-b43e-a9e24dd7046d tempest-ServersAdminNegativeTestJSON-917254120 tempest-ServersAdminNegativeTestJSON-917254120-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:50:13.245504 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6d2f1096-c3a2-42aa-b43e-a9e24dd7046d tempest-ServersAdminNegativeTestJSON-917254120 tempest-ServersAdminNegativeTestJSON-917254120-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:50:13.245947 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6d2f1096-c3a2-42aa-b43e-a9e24dd7046d tempest-ServersAdminNegativeTestJSON-917254120 tempest-ServersAdminNegativeTestJSON-917254120-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:50:13.246643 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6d2f1096-c3a2-42aa-b43e-a9e24dd7046d tempest-ServersAdminNegativeTestJSON-917254120 tempest-ServersAdminNegativeTestJSON-917254120-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:50:13.247133 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6d2f1096-c3a2-42aa-b43e-a9e24dd7046d tempest-ServersAdminNegativeTestJSON-917254120 tempest-ServersAdminNegativeTestJSON-917254120-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:50:13.247562 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6d2f1096-c3a2-42aa-b43e-a9e24dd7046d tempest-ServersAdminNegativeTestJSON-917254120 tempest-ServersAdminNegativeTestJSON-917254120-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:50:13.377912 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-6d2f1096-c3a2-42aa-b43e-a9e24dd7046d tempest-ServersAdminNegativeTestJSON-917254120 tempest-ServersAdminNegativeTestJSON-917254120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced18df2a7904c60b43b59f16ad3339b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a040d7a21f4e8287e463fa89aec0ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:50:13.386163 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-6d2f1096-c3a2-42aa-b43e-a9e24dd7046d tempest-ServersAdminNegativeTestJSON-917254120 tempest-ServersAdminNegativeTestJSON-917254120-project] 10.222.0.58 "GET /compute/v2.1/servers/9277e404-727f-4ab6-a825-fa0ffce6b5dd" status: 200 len: 1477 microversion: 2.1 time: 0.152183 Aug 10 23:50:13.386733 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3077/6363] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:50:13 2022] GET /compute/v2.1/servers/9277e404-727f-4ab6-a825-fa0ffce6b5dd => generated 1477 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:50:14.409283 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-41c6d413-e2bb-4a03-ab29-aee4fe06d8bc tempest-ServersAdminNegativeTestJSON-917254120 tempest-ServersAdminNegativeTestJSON-917254120-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:50:14.409988 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-41c6d413-e2bb-4a03-ab29-aee4fe06d8bc tempest-ServersAdminNegativeTestJSON-917254120 tempest-ServersAdminNegativeTestJSON-917254120-project] [instance: 9277e404-727f-4ab6-a825-fa0ffce6b5dd] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:50:14.417512 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-41c6d413-e2bb-4a03-ab29-aee4fe06d8bc tempest-ServersAdminNegativeTestJSON-917254120 tempest-ServersAdminNegativeTestJSON-917254120-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:50:14.418009 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-41c6d413-e2bb-4a03-ab29-aee4fe06d8bc tempest-ServersAdminNegativeTestJSON-917254120 tempest-ServersAdminNegativeTestJSON-917254120-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:50:14.418462 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-41c6d413-e2bb-4a03-ab29-aee4fe06d8bc tempest-ServersAdminNegativeTestJSON-917254120 tempest-ServersAdminNegativeTestJSON-917254120-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:50:14.419199 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-41c6d413-e2bb-4a03-ab29-aee4fe06d8bc tempest-ServersAdminNegativeTestJSON-917254120 tempest-ServersAdminNegativeTestJSON-917254120-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:50:14.419669 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-41c6d413-e2bb-4a03-ab29-aee4fe06d8bc tempest-ServersAdminNegativeTestJSON-917254120 tempest-ServersAdminNegativeTestJSON-917254120-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:50:14.420104 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-41c6d413-e2bb-4a03-ab29-aee4fe06d8bc tempest-ServersAdminNegativeTestJSON-917254120 tempest-ServersAdminNegativeTestJSON-917254120-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:50:14.559020 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-41c6d413-e2bb-4a03-ab29-aee4fe06d8bc tempest-ServersAdminNegativeTestJSON-917254120 tempest-ServersAdminNegativeTestJSON-917254120-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ced18df2a7904c60b43b59f16ad3339b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a040d7a21f4e8287e463fa89aec0ad', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:50:14.566803 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-41c6d413-e2bb-4a03-ab29-aee4fe06d8bc tempest-ServersAdminNegativeTestJSON-917254120 tempest-ServersAdminNegativeTestJSON-917254120-project] 10.222.0.58 "GET /compute/v2.1/servers/9277e404-727f-4ab6-a825-fa0ffce6b5dd" status: 200 len: 1477 microversion: 2.1 time: 0.161818 Aug 10 23:50:14.567387 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3287/6364] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:50:14 2022] GET /compute/v2.1/servers/9277e404-727f-4ab6-a825-fa0ffce6b5dd => generated 1477 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:50:14.990872 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-ac946f84-ab48-48d4-b98d-2048594e5cad req-994cde7f-f956-40ec-8315-959a4a6ca3d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9277e404-727f-4ab6-a825-fa0ffce6b5dd", "name": "network-vif-deleted", "tag": "ccebd066-fcea-4af5-b644-48948e3395cd"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:50:15.003128 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-ac946f84-ab48-48d4-b98d-2048594e5cad req-994cde7f-f956-40ec-8315-959a4a6ca3d8 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:50:15.003607 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-ac946f84-ab48-48d4-b98d-2048594e5cad req-994cde7f-f956-40ec-8315-959a4a6ca3d8 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:50:15.004035 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-ac946f84-ab48-48d4-b98d-2048594e5cad req-994cde7f-f956-40ec-8315-959a4a6ca3d8 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:50:15.017450 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-ac946f84-ab48-48d4-b98d-2048594e5cad req-994cde7f-f956-40ec-8315-959a4a6ca3d8 service nova] Creating event network-vif-deleted:ccebd066-fcea-4af5-b644-48948e3395cd for instance 9277e404-727f-4ab6-a825-fa0ffce6b5dd on n-h1-850468-14 Aug 10 23:50:15.022853 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-ac946f84-ab48-48d4-b98d-2048594e5cad req-994cde7f-f956-40ec-8315-959a4a6ca3d8 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035722 Aug 10 23:50:15.027195 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3078/6365] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:50:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:50:15.588415 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-afd1cdf0-b3cc-42a2-85dc-6ee84d26d677 tempest-ServersAdminNegativeTestJSON-917254120 tempest-ServersAdminNegativeTestJSON-917254120-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:50:15.588940 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-afd1cdf0-b3cc-42a2-85dc-6ee84d26d677 tempest-ServersAdminNegativeTestJSON-917254120 tempest-ServersAdminNegativeTestJSON-917254120-project] [instance: 9277e404-727f-4ab6-a825-fa0ffce6b5dd] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:50:15.595754 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-afd1cdf0-b3cc-42a2-85dc-6ee84d26d677 tempest-ServersAdminNegativeTestJSON-917254120 tempest-ServersAdminNegativeTestJSON-917254120-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:50:15.596253 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-afd1cdf0-b3cc-42a2-85dc-6ee84d26d677 tempest-ServersAdminNegativeTestJSON-917254120 tempest-ServersAdminNegativeTestJSON-917254120-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:50:15.596699 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-afd1cdf0-b3cc-42a2-85dc-6ee84d26d677 tempest-ServersAdminNegativeTestJSON-917254120 tempest-ServersAdminNegativeTestJSON-917254120-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:50:15.597400 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-afd1cdf0-b3cc-42a2-85dc-6ee84d26d677 tempest-ServersAdminNegativeTestJSON-917254120 tempest-ServersAdminNegativeTestJSON-917254120-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:50:15.597867 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-afd1cdf0-b3cc-42a2-85dc-6ee84d26d677 tempest-ServersAdminNegativeTestJSON-917254120 tempest-ServersAdminNegativeTestJSON-917254120-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:50:15.598303 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-afd1cdf0-b3cc-42a2-85dc-6ee84d26d677 tempest-ServersAdminNegativeTestJSON-917254120 tempest-ServersAdminNegativeTestJSON-917254120-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:50:15.612780 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-afd1cdf0-b3cc-42a2-85dc-6ee84d26d677 tempest-ServersAdminNegativeTestJSON-917254120 tempest-ServersAdminNegativeTestJSON-917254120-project] HTTP exception thrown: Instance 9277e404-727f-4ab6-a825-fa0ffce6b5dd could not be found. Aug 10 23:50:15.614434 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-afd1cdf0-b3cc-42a2-85dc-6ee84d26d677 tempest-ServersAdminNegativeTestJSON-917254120 tempest-ServersAdminNegativeTestJSON-917254120-project] Request method failure captured: Aug 10 23:50:15.614434 n-d-850468-14 devstack@n-api.service[122633]: request: GET /compute/v2.1/servers/9277e404-727f-4ab6-a825-fa0ffce6b5dd HTTP/1.1 Aug 10 23:50:15.614434 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:50:15.614434 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:50:15.614434 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:50:15.614434 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:50:15.614434 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:50:15.614434 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:50:15.614434 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:50:15.614434 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:50:15.614434 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9EQoQQcCw2Lmy6Aa40LFbt3uN0lQIdrt11iEF44xEwyXbSkoUKVZoidWnNLCq2f6MIYQ02tznZgeSdxkkG17IYhO4JpL-jrBvGPmxgI0HgSHSnG-sEslqIhxSyfyLA0oHL1dERWjNRvpI96bZU8vEyaYD2HIZZ-bu2gILQ8ccEyk-xE Aug 10 23:50:15.614434 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:50:15.614434 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:50:15.614434 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:50:15.614434 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:50:15.614434 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:50:15.614434 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:50:15.614434 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 93a040d7a21f4e8287e463fa89aec0ad Aug 10 23:50:15.614434 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-917254120 Aug 10 23:50:15.614434 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:50:15.614434 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:50:15.614434 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/93a040d7a21f4e8287e463fa89aec0ad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/93a040d7a21f4e8287e463fa89aec0ad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/93a040d7a21f4e8287e463fa89aec0ad"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_93a040d7a21f4e8287e463fa89aec0ad", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:50:15.614434 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-ServersAdminNegativeTestJSON-917254120 Aug 10 23:50:15.614434 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 93a040d7a21f4e8287e463fa89aec0ad Aug 10 23:50:15.614434 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-917254120 Aug 10 23:50:15.614434 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-ServersAdminNegativeTestJSON-917254120-project Aug 10 23:50:15.614434 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:50:15.614434 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:50:15.614434 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: ced18df2a7904c60b43b59f16ad3339b Aug 10 23:50:15.614434 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-ServersAdminNegativeTestJSON-917254120-project Aug 10 23:50:15.614434 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:50:15.614434 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance 9277e404-727f-4ab6-a825-fa0ffce6b5dd could not be found. Aug 10 23:50:15.614434 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': '9277e404-727f-4ab6-a825-fa0ffce6b5dd'} Aug 10 23:50:15.614434 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:50:15.614434 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:50:15.614434 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:50:15.614434 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:50:15.614434 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:50:15.614434 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:50:15.614434 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:50:15.614434 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:50:15.614434 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:50:15.614434 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:50:15.614434 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9277e404-727f-4ab6-a825-fa0ffce6b5dd could not be found. Aug 10 23:50:15.614434 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:50:15.614434 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:50:15.614434 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:50:15.614434 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:50:15.614434 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:50:15.614434 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:50:15.614434 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:50:15.614434 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:50:15.614434 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:50:15.614434 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:50:15.614434 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:50:15.614434 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:50:15.614434 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:50:15.614434 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:50:15.614434 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:50:15.614434 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:50:15.614434 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9277e404-727f-4ab6-a825-fa0ffce6b5dd could not be found. Aug 10 23:50:15.614434 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:50:15.614434 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:50:15.620827 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:50:15.620827 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:50:15.620827 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:50:15.620827 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:50:15.620827 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:50:15.620827 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:50:15.620827 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9277e404-727f-4ab6-a825-fa0ffce6b5dd could not be found. Aug 10 23:50:15.620827 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:50:15.620827 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-afd1cdf0-b3cc-42a2-85dc-6ee84d26d677 tempest-ServersAdminNegativeTestJSON-917254120 tempest-ServersAdminNegativeTestJSON-917254120-project] Returning 404 to user: Instance 9277e404-727f-4ab6-a825-fa0ffce6b5dd could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:50:15.620827 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-afd1cdf0-b3cc-42a2-85dc-6ee84d26d677 tempest-ServersAdminNegativeTestJSON-917254120 tempest-ServersAdminNegativeTestJSON-917254120-project] 10.222.0.58 "GET /compute/v2.1/servers/9277e404-727f-4ab6-a825-fa0ffce6b5dd" status: 404 len: 111 microversion: 2.1 time: 0.032041 Aug 10 23:50:15.620827 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3288/6366] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:50:15 2022] GET /compute/v2.1/servers/9277e404-727f-4ab6-a825-fa0ffce6b5dd => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:50:21.887781 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-0da5e058-6b1a-4c69-af3b-7edf46663a60 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1036681073", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452", "networks": [{"uuid": "6d004ea7-95f7-4ab6-b90b-8b17c0acb821"}]}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:50:21.947289 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.network.neutron [None req-0da5e058-6b1a-4c69-af3b-7edf46663a60 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] validate_networks() for [('6d004ea7-95f7-4ab6-b90b-8b17c0acb821', None, None, None, None, None)] {{(pid=122632) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 23:50:22.355393 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-0da5e058-6b1a-4c69-af3b-7edf46663a60 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Flavor limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:50:22.355816 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-0da5e058-6b1a-4c69-af3b-7edf46663a60 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Image limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:50:22.356322 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-0da5e058-6b1a-4c69-af3b-7edf46663a60 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Flavor pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:50:22.356755 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-0da5e058-6b1a-4c69-af3b-7edf46663a60 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Image pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:50:22.357169 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-0da5e058-6b1a-4c69-af3b-7edf46663a60 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:50:22.366113 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0da5e058-6b1a-4c69-af3b-7edf46663a60 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:50:22.366600 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0da5e058-6b1a-4c69-af3b-7edf46663a60 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:50:22.367064 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0da5e058-6b1a-4c69-af3b-7edf46663a60 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:50:22.367788 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0da5e058-6b1a-4c69-af3b-7edf46663a60 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:50:22.368240 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0da5e058-6b1a-4c69-af3b-7edf46663a60 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:50:22.369319 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0da5e058-6b1a-4c69-af3b-7edf46663a60 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:50:22.386346 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-0da5e058-6b1a-4c69-af3b-7edf46663a60 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Getting quotas for project e4e1db7818b742e79b76ca738e930bb0. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:50:22.391627 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-0da5e058-6b1a-4c69-af3b-7edf46663a60 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Getting quotas for user a57afd5409064dc2ac870d1734855932 and project e4e1db7818b742e79b76ca738e930bb0. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:50:22.403949 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-0da5e058-6b1a-4c69-af3b-7edf46663a60 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Going to run 1 instances... {{(pid=122632) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 23:50:22.406281 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-0da5e058-6b1a-4c69-af3b-7edf46663a60 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] [instance: 45cdf247-6095-4fe9-ae11-1c193cd91584] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78ad8905-f66f-4733-8be9-2b260f1fabed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122632) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 23:50:22.453051 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-0da5e058-6b1a-4c69-af3b-7edf46663a60 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.705846 Aug 10 23:50:22.453702 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3079/6367] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 23:50:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 708 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 23:50:22.464663 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-13d472f7-edcc-4cb4-8dd4-977f1f220bea tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:50:22.465298 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-13d472f7-edcc-4cb4-8dd4-977f1f220bea tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] [instance: 45cdf247-6095-4fe9-ae11-1c193cd91584] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:50:22.468464 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=2 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:50:22.525116 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-13d472f7-edcc-4cb4-8dd4-977f1f220bea tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57afd5409064dc2ac870d1734855932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e1db7818b742e79b76ca738e930bb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:50:22.532450 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-13d472f7-edcc-4cb4-8dd4-977f1f220bea tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] 10.222.0.58 "GET /compute/v2.1/servers/45cdf247-6095-4fe9-ae11-1c193cd91584" status: 200 len: 1215 microversion: 2.1 time: 0.071657 Aug 10 23:50:22.533071 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3289/6368] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:50:22 2022] GET /compute/v2.1/servers/45cdf247-6095-4fe9-ae11-1c193cd91584 => generated 1215 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:50:23.557507 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-333831af-d1cc-4c0d-8d93-42d0b12c0333 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:50:23.558143 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-333831af-d1cc-4c0d-8d93-42d0b12c0333 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] [instance: 45cdf247-6095-4fe9-ae11-1c193cd91584] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:50:23.615666 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-333831af-d1cc-4c0d-8d93-42d0b12c0333 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57afd5409064dc2ac870d1734855932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e1db7818b742e79b76ca738e930bb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:50:23.624103 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-333831af-d1cc-4c0d-8d93-42d0b12c0333 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] 10.222.0.58 "GET /compute/v2.1/servers/45cdf247-6095-4fe9-ae11-1c193cd91584" status: 200 len: 1215 microversion: 2.1 time: 0.074177 Aug 10 23:50:23.624933 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3080/6369] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:50:23 2022] GET /compute/v2.1/servers/45cdf247-6095-4fe9-ae11-1c193cd91584 => generated 1215 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:50:24.645439 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-cf980e97-b13e-49b8-8fcb-d5f07255ddaf tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:50:24.646394 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-cf980e97-b13e-49b8-8fcb-d5f07255ddaf tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] [instance: 45cdf247-6095-4fe9-ae11-1c193cd91584] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:50:24.647958 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=3 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:50:24.709065 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-cf980e97-b13e-49b8-8fcb-d5f07255ddaf tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57afd5409064dc2ac870d1734855932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e1db7818b742e79b76ca738e930bb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:50:24.717307 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-cf980e97-b13e-49b8-8fcb-d5f07255ddaf tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] 10.222.0.58 "GET /compute/v2.1/servers/45cdf247-6095-4fe9-ae11-1c193cd91584" status: 200 len: 1215 microversion: 2.1 time: 0.075575 Aug 10 23:50:24.718256 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3290/6370] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:50:24 2022] GET /compute/v2.1/servers/45cdf247-6095-4fe9-ae11-1c193cd91584 => generated 1215 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:50:25.739147 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-09d064b1-3327-4faf-9a71-ac521e068d68 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:50:25.739714 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-09d064b1-3327-4faf-9a71-ac521e068d68 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] [instance: 45cdf247-6095-4fe9-ae11-1c193cd91584] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:50:25.796740 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-09d064b1-3327-4faf-9a71-ac521e068d68 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57afd5409064dc2ac870d1734855932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e1db7818b742e79b76ca738e930bb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:50:25.803480 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-09d064b1-3327-4faf-9a71-ac521e068d68 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] 10.222.0.58 "GET /compute/v2.1/servers/45cdf247-6095-4fe9-ae11-1c193cd91584" status: 200 len: 1215 microversion: 2.1 time: 0.068707 Aug 10 23:50:25.804064 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3081/6371] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:50:25 2022] GET /compute/v2.1/servers/45cdf247-6095-4fe9-ae11-1c193cd91584 => generated 1215 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:50:26.825200 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-d67ca8cd-141f-404d-bfea-86a7d45a47fa tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:50:26.825828 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-d67ca8cd-141f-404d-bfea-86a7d45a47fa tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] [instance: 45cdf247-6095-4fe9-ae11-1c193cd91584] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:50:26.827773 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:50:26.834966 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d67ca8cd-141f-404d-bfea-86a7d45a47fa tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:50:26.835469 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d67ca8cd-141f-404d-bfea-86a7d45a47fa tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:50:26.835926 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d67ca8cd-141f-404d-bfea-86a7d45a47fa tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:50:26.836637 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d67ca8cd-141f-404d-bfea-86a7d45a47fa tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:50:26.837137 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d67ca8cd-141f-404d-bfea-86a7d45a47fa tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:50:26.837581 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d67ca8cd-141f-404d-bfea-86a7d45a47fa tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:50:26.902759 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-d67ca8cd-141f-404d-bfea-86a7d45a47fa tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57afd5409064dc2ac870d1734855932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e1db7818b742e79b76ca738e930bb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:50:26.910290 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-d67ca8cd-141f-404d-bfea-86a7d45a47fa tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] 10.222.0.58 "GET /compute/v2.1/servers/45cdf247-6095-4fe9-ae11-1c193cd91584" status: 200 len: 1219 microversion: 2.1 time: 0.089650 Aug 10 23:50:26.910883 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3291/6372] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:50:26 2022] GET /compute/v2.1/servers/45cdf247-6095-4fe9-ae11-1c193cd91584 => generated 1219 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:50:27.931748 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-8a6b3256-7901-41ec-913f-ab8b0634c924 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:50:27.932348 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-8a6b3256-7901-41ec-913f-ab8b0634c924 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] [instance: 45cdf247-6095-4fe9-ae11-1c193cd91584] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:50:27.939988 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8a6b3256-7901-41ec-913f-ab8b0634c924 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:50:27.940473 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8a6b3256-7901-41ec-913f-ab8b0634c924 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:50:27.940908 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8a6b3256-7901-41ec-913f-ab8b0634c924 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:50:27.941612 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8a6b3256-7901-41ec-913f-ab8b0634c924 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:50:27.942071 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8a6b3256-7901-41ec-913f-ab8b0634c924 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:50:27.942496 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8a6b3256-7901-41ec-913f-ab8b0634c924 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:50:28.010626 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-8a6b3256-7901-41ec-913f-ab8b0634c924 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57afd5409064dc2ac870d1734855932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e1db7818b742e79b76ca738e930bb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:50:28.018260 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-8a6b3256-7901-41ec-913f-ab8b0634c924 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] 10.222.0.58 "GET /compute/v2.1/servers/45cdf247-6095-4fe9-ae11-1c193cd91584" status: 200 len: 1273 microversion: 2.1 time: 0.090542 Aug 10 23:50:28.018858 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3082/6373] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:50:27 2022] GET /compute/v2.1/servers/45cdf247-6095-4fe9-ae11-1c193cd91584 => generated 1273 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:50:28.583867 n-d-850468-14 devstack@n-api.service[122633]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 23:50:28.584377 n-d-850468-14 devstack@n-api.service[122633]: Wed Aug 10 23:50:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 23:50:28.859490 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-662e46c0-b6c2-4536-8381-b3d1247a93c6 req-4536c2d9-e5fa-4344-886c-b36f5d1676b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45cdf247-6095-4fe9-ae11-1c193cd91584", "tag": "c9ac36ca-3536-4d33-ab38-839c861b8167"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:50:28.874268 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-662e46c0-b6c2-4536-8381-b3d1247a93c6 req-4536c2d9-e5fa-4344-886c-b36f5d1676b7 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:50:28.874760 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-662e46c0-b6c2-4536-8381-b3d1247a93c6 req-4536c2d9-e5fa-4344-886c-b36f5d1676b7 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:50:28.875815 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-662e46c0-b6c2-4536-8381-b3d1247a93c6 req-4536c2d9-e5fa-4344-886c-b36f5d1676b7 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:50:28.890275 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-662e46c0-b6c2-4536-8381-b3d1247a93c6 req-4536c2d9-e5fa-4344-886c-b36f5d1676b7 service nova] Creating event network-changed:c9ac36ca-3536-4d33-ab38-839c861b8167 for instance 45cdf247-6095-4fe9-ae11-1c193cd91584 on n-h1-850468-14 Aug 10 23:50:28.896265 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-662e46c0-b6c2-4536-8381-b3d1247a93c6 req-4536c2d9-e5fa-4344-886c-b36f5d1676b7 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044445 Aug 10 23:50:28.896894 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3292/6374] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:50:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:50:29.040178 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-ec3e069f-9bb3-4e86-996c-2af99cf8f324 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:50:29.041963 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-ec3e069f-9bb3-4e86-996c-2af99cf8f324 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] [instance: 45cdf247-6095-4fe9-ae11-1c193cd91584] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:50:29.049118 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ec3e069f-9bb3-4e86-996c-2af99cf8f324 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:50:29.049728 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ec3e069f-9bb3-4e86-996c-2af99cf8f324 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:50:29.050251 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ec3e069f-9bb3-4e86-996c-2af99cf8f324 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:50:29.051002 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ec3e069f-9bb3-4e86-996c-2af99cf8f324 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:50:29.051463 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ec3e069f-9bb3-4e86-996c-2af99cf8f324 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:50:29.051916 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ec3e069f-9bb3-4e86-996c-2af99cf8f324 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:50:29.275819 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-ec3e069f-9bb3-4e86-996c-2af99cf8f324 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57afd5409064dc2ac870d1734855932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e1db7818b742e79b76ca738e930bb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:50:29.284335 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-ec3e069f-9bb3-4e86-996c-2af99cf8f324 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] 10.222.0.58 "GET /compute/v2.1/servers/45cdf247-6095-4fe9-ae11-1c193cd91584" status: 200 len: 1315 microversion: 2.1 time: 0.247982 Aug 10 23:50:29.284935 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3083/6375] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:50:29 2022] GET /compute/v2.1/servers/45cdf247-6095-4fe9-ae11-1c193cd91584 => generated 1315 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:50:30.307826 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-9212ef10-745c-49ab-a16b-ac88bc145ebb tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:50:30.308548 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-9212ef10-745c-49ab-a16b-ac88bc145ebb tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] [instance: 45cdf247-6095-4fe9-ae11-1c193cd91584] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:50:30.314814 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9212ef10-745c-49ab-a16b-ac88bc145ebb tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:50:30.315333 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9212ef10-745c-49ab-a16b-ac88bc145ebb tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:50:30.315832 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9212ef10-745c-49ab-a16b-ac88bc145ebb tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:50:30.316636 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9212ef10-745c-49ab-a16b-ac88bc145ebb tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:50:30.317111 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9212ef10-745c-49ab-a16b-ac88bc145ebb tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:50:30.317665 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9212ef10-745c-49ab-a16b-ac88bc145ebb tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:50:30.456234 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-9212ef10-745c-49ab-a16b-ac88bc145ebb tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57afd5409064dc2ac870d1734855932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e1db7818b742e79b76ca738e930bb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:50:30.464063 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-9212ef10-745c-49ab-a16b-ac88bc145ebb tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] 10.222.0.58 "GET /compute/v2.1/servers/45cdf247-6095-4fe9-ae11-1c193cd91584" status: 200 len: 1315 microversion: 2.1 time: 0.162095 Aug 10 23:50:30.464642 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3293/6376] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:50:30 2022] GET /compute/v2.1/servers/45cdf247-6095-4fe9-ae11-1c193cd91584 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:50:31.484831 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-d96882cb-f5b2-4c59-bc85-ef8d1c555b40 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:50:31.485433 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-d96882cb-f5b2-4c59-bc85-ef8d1c555b40 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] [instance: 45cdf247-6095-4fe9-ae11-1c193cd91584] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:50:31.488300 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=7,nova_api:DELETE=3 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:50:31.494800 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d96882cb-f5b2-4c59-bc85-ef8d1c555b40 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:50:31.495571 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d96882cb-f5b2-4c59-bc85-ef8d1c555b40 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:50:31.496004 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d96882cb-f5b2-4c59-bc85-ef8d1c555b40 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:50:31.496710 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d96882cb-f5b2-4c59-bc85-ef8d1c555b40 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:50:31.497158 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d96882cb-f5b2-4c59-bc85-ef8d1c555b40 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:50:31.497572 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d96882cb-f5b2-4c59-bc85-ef8d1c555b40 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:50:31.505875 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=70 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:50:31.635838 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-d96882cb-f5b2-4c59-bc85-ef8d1c555b40 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57afd5409064dc2ac870d1734855932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e1db7818b742e79b76ca738e930bb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:50:31.643750 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-d96882cb-f5b2-4c59-bc85-ef8d1c555b40 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] 10.222.0.58 "GET /compute/v2.1/servers/45cdf247-6095-4fe9-ae11-1c193cd91584" status: 200 len: 1315 microversion: 2.1 time: 0.162805 Aug 10 23:50:31.644342 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3084/6377] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:50:31 2022] GET /compute/v2.1/servers/45cdf247-6095-4fe9-ae11-1c193cd91584 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:50:32.666127 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-deff4e31-faee-48ac-9abb-2b08549d8057 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:50:32.666944 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-deff4e31-faee-48ac-9abb-2b08549d8057 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] [instance: 45cdf247-6095-4fe9-ae11-1c193cd91584] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:50:32.669185 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=1,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:50:32.675461 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-deff4e31-faee-48ac-9abb-2b08549d8057 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:50:32.675957 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-deff4e31-faee-48ac-9abb-2b08549d8057 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:50:32.676409 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-deff4e31-faee-48ac-9abb-2b08549d8057 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:50:32.677132 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-deff4e31-faee-48ac-9abb-2b08549d8057 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:50:32.677603 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-deff4e31-faee-48ac-9abb-2b08549d8057 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:50:32.678038 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-deff4e31-faee-48ac-9abb-2b08549d8057 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:50:32.816471 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-deff4e31-faee-48ac-9abb-2b08549d8057 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57afd5409064dc2ac870d1734855932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e1db7818b742e79b76ca738e930bb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:50:32.824860 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-deff4e31-faee-48ac-9abb-2b08549d8057 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] 10.222.0.58 "GET /compute/v2.1/servers/45cdf247-6095-4fe9-ae11-1c193cd91584" status: 200 len: 1315 microversion: 2.1 time: 0.163097 Aug 10 23:50:32.825432 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3294/6378] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:50:32 2022] GET /compute/v2.1/servers/45cdf247-6095-4fe9-ae11-1c193cd91584 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:50:33.288106 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-f63acb67-ae8c-4b43-90c8-b2147568a8a2 req-9913982a-8b1a-45ae-8976-5146c4647289 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45cdf247-6095-4fe9-ae11-1c193cd91584", "name": "network-vif-plugged", "status": "completed", "tag": "c9ac36ca-3536-4d33-ab38-839c861b8167"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:50:33.295893 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=5 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:50:33.305524 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-f63acb67-ae8c-4b43-90c8-b2147568a8a2 req-9913982a-8b1a-45ae-8976-5146c4647289 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:50:33.307230 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-f63acb67-ae8c-4b43-90c8-b2147568a8a2 req-9913982a-8b1a-45ae-8976-5146c4647289 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:50:33.307752 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-f63acb67-ae8c-4b43-90c8-b2147568a8a2 req-9913982a-8b1a-45ae-8976-5146c4647289 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:50:33.320130 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-f63acb67-ae8c-4b43-90c8-b2147568a8a2 req-9913982a-8b1a-45ae-8976-5146c4647289 service nova] Creating event network-vif-plugged:c9ac36ca-3536-4d33-ab38-839c861b8167 for instance 45cdf247-6095-4fe9-ae11-1c193cd91584 on n-h1-850468-14 Aug 10 23:50:33.327130 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-f63acb67-ae8c-4b43-90c8-b2147568a8a2 req-9913982a-8b1a-45ae-8976-5146c4647289 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043022 Aug 10 23:50:33.328010 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3085/6379] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:50:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:50:33.845772 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c9b6903c-928e-4ea0-b663-66fd63db1d01 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:50:33.846402 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-c9b6903c-928e-4ea0-b663-66fd63db1d01 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] [instance: 45cdf247-6095-4fe9-ae11-1c193cd91584] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:50:33.853370 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c9b6903c-928e-4ea0-b663-66fd63db1d01 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:50:33.853874 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c9b6903c-928e-4ea0-b663-66fd63db1d01 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:50:33.854329 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c9b6903c-928e-4ea0-b663-66fd63db1d01 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:50:33.855148 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c9b6903c-928e-4ea0-b663-66fd63db1d01 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:50:33.855620 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c9b6903c-928e-4ea0-b663-66fd63db1d01 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:50:33.856061 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c9b6903c-928e-4ea0-b663-66fd63db1d01 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:50:33.989547 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-c9b6903c-928e-4ea0-b663-66fd63db1d01 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57afd5409064dc2ac870d1734855932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e1db7818b742e79b76ca738e930bb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:50:33.998050 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-c9b6903c-928e-4ea0-b663-66fd63db1d01 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] 10.222.0.58 "GET /compute/v2.1/servers/45cdf247-6095-4fe9-ae11-1c193cd91584" status: 200 len: 1315 microversion: 2.1 time: 0.156191 Aug 10 23:50:33.998622 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3295/6380] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:50:33 2022] GET /compute/v2.1/servers/45cdf247-6095-4fe9-ae11-1c193cd91584 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:50:35.019599 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-5b27f854-5bc0-4a2e-80f2-54eb916b1191 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:50:35.020336 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-5b27f854-5bc0-4a2e-80f2-54eb916b1191 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] [instance: 45cdf247-6095-4fe9-ae11-1c193cd91584] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:50:35.028040 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5b27f854-5bc0-4a2e-80f2-54eb916b1191 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:50:35.028525 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5b27f854-5bc0-4a2e-80f2-54eb916b1191 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:50:35.028999 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5b27f854-5bc0-4a2e-80f2-54eb916b1191 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:50:35.029695 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5b27f854-5bc0-4a2e-80f2-54eb916b1191 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:50:35.030150 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5b27f854-5bc0-4a2e-80f2-54eb916b1191 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:50:35.030577 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5b27f854-5bc0-4a2e-80f2-54eb916b1191 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:50:35.163978 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-5b27f854-5bc0-4a2e-80f2-54eb916b1191 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57afd5409064dc2ac870d1734855932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e1db7818b742e79b76ca738e930bb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:50:35.171834 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-5b27f854-5bc0-4a2e-80f2-54eb916b1191 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] 10.222.0.58 "GET /compute/v2.1/servers/45cdf247-6095-4fe9-ae11-1c193cd91584" status: 200 len: 1503 microversion: 2.1 time: 0.156485 Aug 10 23:50:35.172419 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3086/6381] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:50:35 2022] GET /compute/v2.1/servers/45cdf247-6095-4fe9-ae11-1c193cd91584 => generated 1503 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:50:35.191854 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-b824c9de-337a-44d8-9c3d-146d6f757dac tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:50:35.194170 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-b824c9de-337a-44d8-9c3d-146d6f757dac tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] [instance: 45cdf247-6095-4fe9-ae11-1c193cd91584] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:50:35.196152 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=4 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:50:35.203251 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b824c9de-337a-44d8-9c3d-146d6f757dac tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:50:35.203755 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b824c9de-337a-44d8-9c3d-146d6f757dac tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:50:35.204209 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b824c9de-337a-44d8-9c3d-146d6f757dac tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:50:35.204917 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b824c9de-337a-44d8-9c3d-146d6f757dac tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:50:35.205387 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b824c9de-337a-44d8-9c3d-146d6f757dac tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:50:35.205829 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b824c9de-337a-44d8-9c3d-146d6f757dac tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:50:35.284366 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-b824c9de-337a-44d8-9c3d-146d6f757dac tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'a57afd5409064dc2ac870d1734855932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e1db7818b742e79b76ca738e930bb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:50:35.290347 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-b824c9de-337a-44d8-9c3d-146d6f757dac tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] [instance: 45cdf247-6095-4fe9-ae11-1c193cd91584] Old instance type m1.heat2, new instance type m1.heat {{(pid=122633) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 10 23:50:35.296800 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-b824c9de-337a-44d8-9c3d-146d6f757dac tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Flavor limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:50:35.297236 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-b824c9de-337a-44d8-9c3d-146d6f757dac tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Image limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:50:35.297723 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-b824c9de-337a-44d8-9c3d-146d6f757dac tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Flavor pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:50:35.298144 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-b824c9de-337a-44d8-9c3d-146d6f757dac tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Image pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:50:35.298567 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-b824c9de-337a-44d8-9c3d-146d6f757dac tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:50:35.411285 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-b824c9de-337a-44d8-9c3d-146d6f757dac tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] 10.222.0.58 "POST /compute/v2.1/servers/45cdf247-6095-4fe9-ae11-1c193cd91584/action" status: 202 len: 0 microversion: 2.1 time: 0.223211 Aug 10 23:50:35.411959 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3296/6382] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:50:35 2022] POST /compute/v2.1/servers/45cdf247-6095-4fe9-ae11-1c193cd91584/action => generated 0 bytes in 225 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:50:35.420153 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-9611ebcf-664a-4ce7-be1b-3506b8755a64 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:50:35.420893 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-9611ebcf-664a-4ce7-be1b-3506b8755a64 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] [instance: 45cdf247-6095-4fe9-ae11-1c193cd91584] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:50:35.427243 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9611ebcf-664a-4ce7-be1b-3506b8755a64 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:50:35.427738 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9611ebcf-664a-4ce7-be1b-3506b8755a64 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:50:35.428182 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9611ebcf-664a-4ce7-be1b-3506b8755a64 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:50:35.428888 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9611ebcf-664a-4ce7-be1b-3506b8755a64 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:50:35.429348 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9611ebcf-664a-4ce7-be1b-3506b8755a64 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:50:35.429780 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9611ebcf-664a-4ce7-be1b-3506b8755a64 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:50:35.567699 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-9611ebcf-664a-4ce7-be1b-3506b8755a64 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57afd5409064dc2ac870d1734855932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e1db7818b742e79b76ca738e930bb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:50:35.576380 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-9611ebcf-664a-4ce7-be1b-3506b8755a64 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] 10.222.0.58 "GET /compute/v2.1/servers/45cdf247-6095-4fe9-ae11-1c193cd91584" status: 200 len: 1512 microversion: 2.1 time: 0.160210 Aug 10 23:50:35.576968 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3087/6383] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:50:35 2022] GET /compute/v2.1/servers/45cdf247-6095-4fe9-ae11-1c193cd91584 => generated 1512 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:50:36.598179 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-3ab0e474-fc62-441e-83ce-ddc39ff8c00f tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:50:36.599458 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-3ab0e474-fc62-441e-83ce-ddc39ff8c00f tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] [instance: 45cdf247-6095-4fe9-ae11-1c193cd91584] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:50:36.606914 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3ab0e474-fc62-441e-83ce-ddc39ff8c00f tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:50:36.607556 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3ab0e474-fc62-441e-83ce-ddc39ff8c00f tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:50:36.608016 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3ab0e474-fc62-441e-83ce-ddc39ff8c00f tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:50:36.608740 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3ab0e474-fc62-441e-83ce-ddc39ff8c00f tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:50:36.609212 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3ab0e474-fc62-441e-83ce-ddc39ff8c00f tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:50:36.609657 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3ab0e474-fc62-441e-83ce-ddc39ff8c00f tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:50:36.742692 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-3ab0e474-fc62-441e-83ce-ddc39ff8c00f tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57afd5409064dc2ac870d1734855932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e1db7818b742e79b76ca738e930bb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:50:36.751374 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-3ab0e474-fc62-441e-83ce-ddc39ff8c00f tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] 10.222.0.58 "GET /compute/v2.1/servers/45cdf247-6095-4fe9-ae11-1c193cd91584" status: 200 len: 1512 microversion: 2.1 time: 0.158061 Aug 10 23:50:36.751956 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3297/6384] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:50:36 2022] GET /compute/v2.1/servers/45cdf247-6095-4fe9-ae11-1c193cd91584 => generated 1512 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:50:37.772711 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-82e78ad5-447d-4fc4-bf12-02dbe5ef45b2 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:50:37.773268 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-82e78ad5-447d-4fc4-bf12-02dbe5ef45b2 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] [instance: 45cdf247-6095-4fe9-ae11-1c193cd91584] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:50:37.775288 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=12 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:50:37.781426 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-82e78ad5-447d-4fc4-bf12-02dbe5ef45b2 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:50:37.781908 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-82e78ad5-447d-4fc4-bf12-02dbe5ef45b2 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:50:37.782336 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-82e78ad5-447d-4fc4-bf12-02dbe5ef45b2 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:50:37.783052 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-82e78ad5-447d-4fc4-bf12-02dbe5ef45b2 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:50:37.783502 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-82e78ad5-447d-4fc4-bf12-02dbe5ef45b2 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:50:37.783923 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-82e78ad5-447d-4fc4-bf12-02dbe5ef45b2 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:50:37.919134 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-82e78ad5-447d-4fc4-bf12-02dbe5ef45b2 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57afd5409064dc2ac870d1734855932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e1db7818b742e79b76ca738e930bb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:50:37.926696 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-82e78ad5-447d-4fc4-bf12-02dbe5ef45b2 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] 10.222.0.58 "GET /compute/v2.1/servers/45cdf247-6095-4fe9-ae11-1c193cd91584" status: 200 len: 1517 microversion: 2.1 time: 0.157975 Aug 10 23:50:37.927298 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3088/6385] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:50:37 2022] GET /compute/v2.1/servers/45cdf247-6095-4fe9-ae11-1c193cd91584 => generated 1517 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:50:38.949403 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-0ef76cb9-f1a9-4dd5-b854-9bf18483339c tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:50:38.950026 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-0ef76cb9-f1a9-4dd5-b854-9bf18483339c tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] [instance: 45cdf247-6095-4fe9-ae11-1c193cd91584] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:50:38.957082 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0ef76cb9-f1a9-4dd5-b854-9bf18483339c tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:50:38.957578 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0ef76cb9-f1a9-4dd5-b854-9bf18483339c tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:50:38.958032 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0ef76cb9-f1a9-4dd5-b854-9bf18483339c tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:50:38.958746 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0ef76cb9-f1a9-4dd5-b854-9bf18483339c tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:50:38.959240 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0ef76cb9-f1a9-4dd5-b854-9bf18483339c tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:50:38.959681 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0ef76cb9-f1a9-4dd5-b854-9bf18483339c tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:50:39.094515 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-0ef76cb9-f1a9-4dd5-b854-9bf18483339c tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57afd5409064dc2ac870d1734855932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e1db7818b742e79b76ca738e930bb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:50:39.102159 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-0ef76cb9-f1a9-4dd5-b854-9bf18483339c tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] 10.222.0.58 "GET /compute/v2.1/servers/45cdf247-6095-4fe9-ae11-1c193cd91584" status: 200 len: 1517 microversion: 2.1 time: 0.157470 Aug 10 23:50:39.102804 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3298/6386] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:50:38 2022] GET /compute/v2.1/servers/45cdf247-6095-4fe9-ae11-1c193cd91584 => generated 1517 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:50:40.124795 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-38c40150-222f-4727-8a75-30c92e8d2c79 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:50:40.125412 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-38c40150-222f-4727-8a75-30c92e8d2c79 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] [instance: 45cdf247-6095-4fe9-ae11-1c193cd91584] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:50:40.132186 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-38c40150-222f-4727-8a75-30c92e8d2c79 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:50:40.132660 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-38c40150-222f-4727-8a75-30c92e8d2c79 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:50:40.133090 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-38c40150-222f-4727-8a75-30c92e8d2c79 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:50:40.133768 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-38c40150-222f-4727-8a75-30c92e8d2c79 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:50:40.134213 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-38c40150-222f-4727-8a75-30c92e8d2c79 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:50:40.134627 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-38c40150-222f-4727-8a75-30c92e8d2c79 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:50:40.264563 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-38c40150-222f-4727-8a75-30c92e8d2c79 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57afd5409064dc2ac870d1734855932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e1db7818b742e79b76ca738e930bb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:50:40.272212 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-38c40150-222f-4727-8a75-30c92e8d2c79 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] 10.222.0.58 "GET /compute/v2.1/servers/45cdf247-6095-4fe9-ae11-1c193cd91584" status: 200 len: 1517 microversion: 2.1 time: 0.151279 Aug 10 23:50:40.272799 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3089/6387] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:50:40 2022] GET /compute/v2.1/servers/45cdf247-6095-4fe9-ae11-1c193cd91584 => generated 1517 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:50:41.293310 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-b46f9e5f-5b65-4f99-b69e-0d4c571a24ba tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:50:41.293939 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-b46f9e5f-5b65-4f99-b69e-0d4c571a24ba tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] [instance: 45cdf247-6095-4fe9-ae11-1c193cd91584] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:50:41.300880 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b46f9e5f-5b65-4f99-b69e-0d4c571a24ba tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:50:41.301380 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b46f9e5f-5b65-4f99-b69e-0d4c571a24ba tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:50:41.301863 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b46f9e5f-5b65-4f99-b69e-0d4c571a24ba tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:50:41.302648 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b46f9e5f-5b65-4f99-b69e-0d4c571a24ba tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:50:41.303155 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b46f9e5f-5b65-4f99-b69e-0d4c571a24ba tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:50:41.303595 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b46f9e5f-5b65-4f99-b69e-0d4c571a24ba tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:50:41.435760 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-b46f9e5f-5b65-4f99-b69e-0d4c571a24ba tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57afd5409064dc2ac870d1734855932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e1db7818b742e79b76ca738e930bb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:50:41.443226 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-b46f9e5f-5b65-4f99-b69e-0d4c571a24ba tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] 10.222.0.58 "GET /compute/v2.1/servers/45cdf247-6095-4fe9-ae11-1c193cd91584" status: 200 len: 1517 microversion: 2.1 time: 0.154007 Aug 10 23:50:41.443795 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3299/6388] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:50:41 2022] GET /compute/v2.1/servers/45cdf247-6095-4fe9-ae11-1c193cd91584 => generated 1517 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:50:42.465364 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-4699f131-8bd7-4268-bc14-a1a3717b1810 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:50:42.465961 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-4699f131-8bd7-4268-bc14-a1a3717b1810 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] [instance: 45cdf247-6095-4fe9-ae11-1c193cd91584] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:50:42.472774 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4699f131-8bd7-4268-bc14-a1a3717b1810 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:50:42.473250 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4699f131-8bd7-4268-bc14-a1a3717b1810 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:50:42.473680 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4699f131-8bd7-4268-bc14-a1a3717b1810 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:50:42.474359 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4699f131-8bd7-4268-bc14-a1a3717b1810 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:50:42.474829 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4699f131-8bd7-4268-bc14-a1a3717b1810 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:50:42.475275 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4699f131-8bd7-4268-bc14-a1a3717b1810 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:50:42.619641 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-4699f131-8bd7-4268-bc14-a1a3717b1810 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57afd5409064dc2ac870d1734855932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e1db7818b742e79b76ca738e930bb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:50:42.627582 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-4699f131-8bd7-4268-bc14-a1a3717b1810 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] 10.222.0.58 "GET /compute/v2.1/servers/45cdf247-6095-4fe9-ae11-1c193cd91584" status: 200 len: 1517 microversion: 2.1 time: 0.167037 Aug 10 23:50:42.628163 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3090/6389] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:50:42 2022] GET /compute/v2.1/servers/45cdf247-6095-4fe9-ae11-1c193cd91584 => generated 1517 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:50:43.650206 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-5424543b-34b9-450d-a773-9686edda7593 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:50:43.651219 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-5424543b-34b9-450d-a773-9686edda7593 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] [instance: 45cdf247-6095-4fe9-ae11-1c193cd91584] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:50:43.658102 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5424543b-34b9-450d-a773-9686edda7593 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:50:43.658590 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5424543b-34b9-450d-a773-9686edda7593 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:50:43.659070 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5424543b-34b9-450d-a773-9686edda7593 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:50:43.659767 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5424543b-34b9-450d-a773-9686edda7593 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:50:43.660256 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5424543b-34b9-450d-a773-9686edda7593 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:50:43.660687 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5424543b-34b9-450d-a773-9686edda7593 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:50:43.803194 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-5424543b-34b9-450d-a773-9686edda7593 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57afd5409064dc2ac870d1734855932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e1db7818b742e79b76ca738e930bb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:50:43.811273 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-5424543b-34b9-450d-a773-9686edda7593 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] 10.222.0.58 "GET /compute/v2.1/servers/45cdf247-6095-4fe9-ae11-1c193cd91584" status: 200 len: 1517 microversion: 2.1 time: 0.164993 Aug 10 23:50:43.811854 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3300/6390] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:50:43 2022] GET /compute/v2.1/servers/45cdf247-6095-4fe9-ae11-1c193cd91584 => generated 1517 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:50:44.833584 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c53303b7-a80f-4b58-aabf-fa55ab9e8e5f tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:50:44.834235 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-c53303b7-a80f-4b58-aabf-fa55ab9e8e5f tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] [instance: 45cdf247-6095-4fe9-ae11-1c193cd91584] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:50:44.841745 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c53303b7-a80f-4b58-aabf-fa55ab9e8e5f tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:50:44.842230 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c53303b7-a80f-4b58-aabf-fa55ab9e8e5f tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:50:44.842667 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c53303b7-a80f-4b58-aabf-fa55ab9e8e5f tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:50:44.843385 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c53303b7-a80f-4b58-aabf-fa55ab9e8e5f tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:50:44.843841 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c53303b7-a80f-4b58-aabf-fa55ab9e8e5f tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:50:44.844269 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c53303b7-a80f-4b58-aabf-fa55ab9e8e5f tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:50:44.977467 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-c53303b7-a80f-4b58-aabf-fa55ab9e8e5f tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57afd5409064dc2ac870d1734855932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e1db7818b742e79b76ca738e930bb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:50:44.985283 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-c53303b7-a80f-4b58-aabf-fa55ab9e8e5f tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] 10.222.0.58 "GET /compute/v2.1/servers/45cdf247-6095-4fe9-ae11-1c193cd91584" status: 200 len: 1517 microversion: 2.1 time: 0.155717 Aug 10 23:50:44.985864 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3091/6391] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:50:44 2022] GET /compute/v2.1/servers/45cdf247-6095-4fe9-ae11-1c193cd91584 => generated 1517 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:50:46.006990 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-edefbb32-8bd7-4b15-abc0-1b2891e6f52d tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:50:46.007609 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-edefbb32-8bd7-4b15-abc0-1b2891e6f52d tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] [instance: 45cdf247-6095-4fe9-ae11-1c193cd91584] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:50:46.015239 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-edefbb32-8bd7-4b15-abc0-1b2891e6f52d tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:50:46.015728 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-edefbb32-8bd7-4b15-abc0-1b2891e6f52d tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:50:46.016167 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-edefbb32-8bd7-4b15-abc0-1b2891e6f52d tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:50:46.016866 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-edefbb32-8bd7-4b15-abc0-1b2891e6f52d tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:50:46.017320 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-edefbb32-8bd7-4b15-abc0-1b2891e6f52d tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:50:46.017751 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-edefbb32-8bd7-4b15-abc0-1b2891e6f52d tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:50:46.149396 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-edefbb32-8bd7-4b15-abc0-1b2891e6f52d tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57afd5409064dc2ac870d1734855932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e1db7818b742e79b76ca738e930bb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:50:46.158800 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-edefbb32-8bd7-4b15-abc0-1b2891e6f52d tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] 10.222.0.58 "GET /compute/v2.1/servers/45cdf247-6095-4fe9-ae11-1c193cd91584" status: 200 len: 1517 microversion: 2.1 time: 0.155698 Aug 10 23:50:46.159410 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3301/6392] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:50:46 2022] GET /compute/v2.1/servers/45cdf247-6095-4fe9-ae11-1c193cd91584 => generated 1517 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:50:47.180968 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-e4763bd4-4087-4a6d-a02f-1a5f726716c8 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:50:47.181587 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-e4763bd4-4087-4a6d-a02f-1a5f726716c8 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] [instance: 45cdf247-6095-4fe9-ae11-1c193cd91584] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:50:47.189070 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e4763bd4-4087-4a6d-a02f-1a5f726716c8 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:50:47.189557 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e4763bd4-4087-4a6d-a02f-1a5f726716c8 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:50:47.189999 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e4763bd4-4087-4a6d-a02f-1a5f726716c8 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:50:47.190696 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e4763bd4-4087-4a6d-a02f-1a5f726716c8 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:50:47.191202 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e4763bd4-4087-4a6d-a02f-1a5f726716c8 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:50:47.191630 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e4763bd4-4087-4a6d-a02f-1a5f726716c8 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:50:47.321442 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-e4763bd4-4087-4a6d-a02f-1a5f726716c8 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57afd5409064dc2ac870d1734855932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e1db7818b742e79b76ca738e930bb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:50:47.329598 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-e4763bd4-4087-4a6d-a02f-1a5f726716c8 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] 10.222.0.58 "GET /compute/v2.1/servers/45cdf247-6095-4fe9-ae11-1c193cd91584" status: 200 len: 1517 microversion: 2.1 time: 0.152589 Aug 10 23:50:47.330176 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3092/6393] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:50:47 2022] GET /compute/v2.1/servers/45cdf247-6095-4fe9-ae11-1c193cd91584 => generated 1517 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:50:48.351155 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-55afada2-2980-4b85-9a37-4c69485bc621 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:50:48.351754 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-55afada2-2980-4b85-9a37-4c69485bc621 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] [instance: 45cdf247-6095-4fe9-ae11-1c193cd91584] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:50:48.359101 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-55afada2-2980-4b85-9a37-4c69485bc621 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:50:48.359585 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-55afada2-2980-4b85-9a37-4c69485bc621 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:50:48.360034 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-55afada2-2980-4b85-9a37-4c69485bc621 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:50:48.360726 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-55afada2-2980-4b85-9a37-4c69485bc621 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:50:48.361188 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-55afada2-2980-4b85-9a37-4c69485bc621 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:50:48.361616 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-55afada2-2980-4b85-9a37-4c69485bc621 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:50:48.492365 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-55afada2-2980-4b85-9a37-4c69485bc621 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57afd5409064dc2ac870d1734855932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e1db7818b742e79b76ca738e930bb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:50:48.501063 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-55afada2-2980-4b85-9a37-4c69485bc621 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] 10.222.0.58 "GET /compute/v2.1/servers/45cdf247-6095-4fe9-ae11-1c193cd91584" status: 200 len: 1517 microversion: 2.1 time: 0.153744 Aug 10 23:50:48.501646 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3302/6394] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:50:48 2022] GET /compute/v2.1/servers/45cdf247-6095-4fe9-ae11-1c193cd91584 => generated 1517 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:50:49.522598 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-5c289763-5089-4071-a391-cdbf858af325 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:50:49.523273 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-5c289763-5089-4071-a391-cdbf858af325 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] [instance: 45cdf247-6095-4fe9-ae11-1c193cd91584] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:50:49.530761 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5c289763-5089-4071-a391-cdbf858af325 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:50:49.531270 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5c289763-5089-4071-a391-cdbf858af325 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:50:49.531707 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5c289763-5089-4071-a391-cdbf858af325 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:50:49.532431 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5c289763-5089-4071-a391-cdbf858af325 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:50:49.532884 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5c289763-5089-4071-a391-cdbf858af325 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:50:49.533312 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5c289763-5089-4071-a391-cdbf858af325 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:50:49.668146 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-5c289763-5089-4071-a391-cdbf858af325 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57afd5409064dc2ac870d1734855932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e1db7818b742e79b76ca738e930bb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:50:49.675601 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-5c289763-5089-4071-a391-cdbf858af325 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] 10.222.0.58 "GET /compute/v2.1/servers/45cdf247-6095-4fe9-ae11-1c193cd91584" status: 200 len: 1517 microversion: 2.1 time: 0.157046 Aug 10 23:50:49.676173 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3093/6395] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:50:49 2022] GET /compute/v2.1/servers/45cdf247-6095-4fe9-ae11-1c193cd91584 => generated 1517 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:50:50.696297 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-5527fc18-9ef1-44aa-b812-a8243c3e7ed7 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:50:50.696920 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-5527fc18-9ef1-44aa-b812-a8243c3e7ed7 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] [instance: 45cdf247-6095-4fe9-ae11-1c193cd91584] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:50:50.704020 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5527fc18-9ef1-44aa-b812-a8243c3e7ed7 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:50:50.704520 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5527fc18-9ef1-44aa-b812-a8243c3e7ed7 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:50:50.704973 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5527fc18-9ef1-44aa-b812-a8243c3e7ed7 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:50:50.705685 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5527fc18-9ef1-44aa-b812-a8243c3e7ed7 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:50:50.706157 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5527fc18-9ef1-44aa-b812-a8243c3e7ed7 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:50:50.706592 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5527fc18-9ef1-44aa-b812-a8243c3e7ed7 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:50:50.843812 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-5527fc18-9ef1-44aa-b812-a8243c3e7ed7 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57afd5409064dc2ac870d1734855932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e1db7818b742e79b76ca738e930bb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:50:50.851373 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-5527fc18-9ef1-44aa-b812-a8243c3e7ed7 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] 10.222.0.58 "GET /compute/v2.1/servers/45cdf247-6095-4fe9-ae11-1c193cd91584" status: 200 len: 1517 microversion: 2.1 time: 0.158982 Aug 10 23:50:50.851953 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3303/6396] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:50:50 2022] GET /compute/v2.1/servers/45cdf247-6095-4fe9-ae11-1c193cd91584 => generated 1517 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:50:51.873652 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-52141ecf-a7e3-47f4-9c29-b3d44956d03a tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:50:51.874272 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-52141ecf-a7e3-47f4-9c29-b3d44956d03a tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] [instance: 45cdf247-6095-4fe9-ae11-1c193cd91584] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:50:51.881016 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-52141ecf-a7e3-47f4-9c29-b3d44956d03a tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:50:51.881495 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-52141ecf-a7e3-47f4-9c29-b3d44956d03a tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:50:51.881929 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-52141ecf-a7e3-47f4-9c29-b3d44956d03a tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:50:51.882605 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-52141ecf-a7e3-47f4-9c29-b3d44956d03a tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:50:51.883087 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-52141ecf-a7e3-47f4-9c29-b3d44956d03a tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:50:51.883506 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-52141ecf-a7e3-47f4-9c29-b3d44956d03a tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:50:52.015672 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-52141ecf-a7e3-47f4-9c29-b3d44956d03a tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57afd5409064dc2ac870d1734855932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e1db7818b742e79b76ca738e930bb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:50:52.023582 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-52141ecf-a7e3-47f4-9c29-b3d44956d03a tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] 10.222.0.58 "GET /compute/v2.1/servers/45cdf247-6095-4fe9-ae11-1c193cd91584" status: 200 len: 1517 microversion: 2.1 time: 0.154513 Aug 10 23:50:52.024157 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3094/6397] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:50:51 2022] GET /compute/v2.1/servers/45cdf247-6095-4fe9-ae11-1c193cd91584 => generated 1517 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:50:53.046151 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-aeab6d37-8960-489d-b033-5b98f1af7e62 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:50:53.046753 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-aeab6d37-8960-489d-b033-5b98f1af7e62 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] [instance: 45cdf247-6095-4fe9-ae11-1c193cd91584] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:50:53.053585 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-aeab6d37-8960-489d-b033-5b98f1af7e62 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:50:53.054088 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-aeab6d37-8960-489d-b033-5b98f1af7e62 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:50:53.054537 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-aeab6d37-8960-489d-b033-5b98f1af7e62 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:50:53.055265 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-aeab6d37-8960-489d-b033-5b98f1af7e62 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:50:53.055739 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-aeab6d37-8960-489d-b033-5b98f1af7e62 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:50:53.056256 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-aeab6d37-8960-489d-b033-5b98f1af7e62 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:50:53.185238 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-aeab6d37-8960-489d-b033-5b98f1af7e62 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57afd5409064dc2ac870d1734855932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e1db7818b742e79b76ca738e930bb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:50:53.192721 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-aeab6d37-8960-489d-b033-5b98f1af7e62 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] 10.222.0.58 "GET /compute/v2.1/servers/45cdf247-6095-4fe9-ae11-1c193cd91584" status: 200 len: 1517 microversion: 2.1 time: 0.150441 Aug 10 23:50:53.193292 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3304/6398] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:50:53 2022] GET /compute/v2.1/servers/45cdf247-6095-4fe9-ae11-1c193cd91584 => generated 1517 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:50:54.215450 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-edce7c81-59ff-41c1-b169-7ee9f860023b tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:50:54.216065 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-edce7c81-59ff-41c1-b169-7ee9f860023b tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] [instance: 45cdf247-6095-4fe9-ae11-1c193cd91584] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:50:54.222985 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-edce7c81-59ff-41c1-b169-7ee9f860023b tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:50:54.223465 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-edce7c81-59ff-41c1-b169-7ee9f860023b tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:50:54.223898 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-edce7c81-59ff-41c1-b169-7ee9f860023b tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:50:54.224585 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-edce7c81-59ff-41c1-b169-7ee9f860023b tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:50:54.225036 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-edce7c81-59ff-41c1-b169-7ee9f860023b tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:50:54.225465 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-edce7c81-59ff-41c1-b169-7ee9f860023b tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:50:54.360919 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-edce7c81-59ff-41c1-b169-7ee9f860023b tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57afd5409064dc2ac870d1734855932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e1db7818b742e79b76ca738e930bb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:50:54.368410 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-edce7c81-59ff-41c1-b169-7ee9f860023b tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] 10.222.0.58 "GET /compute/v2.1/servers/45cdf247-6095-4fe9-ae11-1c193cd91584" status: 200 len: 1517 microversion: 2.1 time: 0.157511 Aug 10 23:50:54.368981 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3095/6399] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:50:54 2022] GET /compute/v2.1/servers/45cdf247-6095-4fe9-ae11-1c193cd91584 => generated 1517 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:50:55.390266 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-eada6efd-9007-4979-997c-370a27bc6ea1 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:50:55.390924 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-eada6efd-9007-4979-997c-370a27bc6ea1 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] [instance: 45cdf247-6095-4fe9-ae11-1c193cd91584] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:50:55.397747 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-eada6efd-9007-4979-997c-370a27bc6ea1 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:50:55.398244 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-eada6efd-9007-4979-997c-370a27bc6ea1 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:50:55.398696 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-eada6efd-9007-4979-997c-370a27bc6ea1 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:50:55.399446 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-eada6efd-9007-4979-997c-370a27bc6ea1 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:50:55.399918 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-eada6efd-9007-4979-997c-370a27bc6ea1 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:50:55.400358 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-eada6efd-9007-4979-997c-370a27bc6ea1 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:50:55.818648 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-eada6efd-9007-4979-997c-370a27bc6ea1 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57afd5409064dc2ac870d1734855932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e1db7818b742e79b76ca738e930bb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:50:55.826322 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-eada6efd-9007-4979-997c-370a27bc6ea1 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] 10.222.0.58 "GET /compute/v2.1/servers/45cdf247-6095-4fe9-ae11-1c193cd91584" status: 200 len: 1517 microversion: 2.1 time: 0.439961 Aug 10 23:50:55.826930 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3305/6400] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:50:55 2022] GET /compute/v2.1/servers/45cdf247-6095-4fe9-ae11-1c193cd91584 => generated 1517 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:50:56.848160 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-475c2b5f-a1ad-4b6b-b7df-e25c48591af0 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:50:56.848804 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-475c2b5f-a1ad-4b6b-b7df-e25c48591af0 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] [instance: 45cdf247-6095-4fe9-ae11-1c193cd91584] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:50:56.856482 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-475c2b5f-a1ad-4b6b-b7df-e25c48591af0 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:50:56.856965 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-475c2b5f-a1ad-4b6b-b7df-e25c48591af0 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:50:56.857401 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-475c2b5f-a1ad-4b6b-b7df-e25c48591af0 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:50:56.858095 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-475c2b5f-a1ad-4b6b-b7df-e25c48591af0 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:50:56.858551 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-475c2b5f-a1ad-4b6b-b7df-e25c48591af0 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:50:56.859007 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-475c2b5f-a1ad-4b6b-b7df-e25c48591af0 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:50:56.989585 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-475c2b5f-a1ad-4b6b-b7df-e25c48591af0 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57afd5409064dc2ac870d1734855932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e1db7818b742e79b76ca738e930bb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:50:56.997721 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-475c2b5f-a1ad-4b6b-b7df-e25c48591af0 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] 10.222.0.58 "GET /compute/v2.1/servers/45cdf247-6095-4fe9-ae11-1c193cd91584" status: 200 len: 1517 microversion: 2.1 time: 0.153477 Aug 10 23:50:56.998301 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3096/6401] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:50:56 2022] GET /compute/v2.1/servers/45cdf247-6095-4fe9-ae11-1c193cd91584 => generated 1517 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:50:58.019427 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-7f1efc0c-e9af-417a-a928-416e106e3a02 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:50:58.020058 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-7f1efc0c-e9af-417a-a928-416e106e3a02 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] [instance: 45cdf247-6095-4fe9-ae11-1c193cd91584] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:50:58.027969 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7f1efc0c-e9af-417a-a928-416e106e3a02 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:50:58.028470 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7f1efc0c-e9af-417a-a928-416e106e3a02 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:50:58.028925 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7f1efc0c-e9af-417a-a928-416e106e3a02 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:50:58.029636 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7f1efc0c-e9af-417a-a928-416e106e3a02 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:50:58.030107 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7f1efc0c-e9af-417a-a928-416e106e3a02 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:50:58.030549 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7f1efc0c-e9af-417a-a928-416e106e3a02 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:50:58.034994 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:50:58.168648 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-7f1efc0c-e9af-417a-a928-416e106e3a02 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57afd5409064dc2ac870d1734855932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e1db7818b742e79b76ca738e930bb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:50:58.176296 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-7f1efc0c-e9af-417a-a928-416e106e3a02 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] 10.222.0.58 "GET /compute/v2.1/servers/45cdf247-6095-4fe9-ae11-1c193cd91584" status: 200 len: 1517 microversion: 2.1 time: 0.160740 Aug 10 23:50:58.176884 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3306/6402] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:50:58 2022] GET /compute/v2.1/servers/45cdf247-6095-4fe9-ae11-1c193cd91584 => generated 1517 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:50:59.197739 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-8824e9ba-876e-4cc6-ae51-a282a39d675c tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:50:59.198621 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-8824e9ba-876e-4cc6-ae51-a282a39d675c tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] [instance: 45cdf247-6095-4fe9-ae11-1c193cd91584] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:50:59.205517 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8824e9ba-876e-4cc6-ae51-a282a39d675c tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:50:59.206001 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8824e9ba-876e-4cc6-ae51-a282a39d675c tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:50:59.206457 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8824e9ba-876e-4cc6-ae51-a282a39d675c tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:50:59.207181 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8824e9ba-876e-4cc6-ae51-a282a39d675c tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:50:59.207637 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8824e9ba-876e-4cc6-ae51-a282a39d675c tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:50:59.208070 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8824e9ba-876e-4cc6-ae51-a282a39d675c tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:50:59.348652 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-8824e9ba-876e-4cc6-ae51-a282a39d675c tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57afd5409064dc2ac870d1734855932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e1db7818b742e79b76ca738e930bb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:50:59.357331 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-8824e9ba-876e-4cc6-ae51-a282a39d675c tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] 10.222.0.58 "GET /compute/v2.1/servers/45cdf247-6095-4fe9-ae11-1c193cd91584" status: 200 len: 1517 microversion: 2.1 time: 0.163542 Aug 10 23:50:59.357921 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3097/6403] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:50:59 2022] GET /compute/v2.1/servers/45cdf247-6095-4fe9-ae11-1c193cd91584 => generated 1517 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:51:00.378905 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-f38e8a56-cf2b-4d2c-bd5f-43c492bb726c tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:51:00.379456 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-f38e8a56-cf2b-4d2c-bd5f-43c492bb726c tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] [instance: 45cdf247-6095-4fe9-ae11-1c193cd91584] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:51:00.387271 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f38e8a56-cf2b-4d2c-bd5f-43c492bb726c tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:51:00.387770 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f38e8a56-cf2b-4d2c-bd5f-43c492bb726c tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:51:00.388219 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f38e8a56-cf2b-4d2c-bd5f-43c492bb726c tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:51:00.388923 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f38e8a56-cf2b-4d2c-bd5f-43c492bb726c tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:51:00.389396 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f38e8a56-cf2b-4d2c-bd5f-43c492bb726c tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:51:00.389832 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f38e8a56-cf2b-4d2c-bd5f-43c492bb726c tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:51:00.525733 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-f38e8a56-cf2b-4d2c-bd5f-43c492bb726c tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57afd5409064dc2ac870d1734855932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e1db7818b742e79b76ca738e930bb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:51:00.534146 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-f38e8a56-cf2b-4d2c-bd5f-43c492bb726c tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] 10.222.0.58 "GET /compute/v2.1/servers/45cdf247-6095-4fe9-ae11-1c193cd91584" status: 200 len: 1517 microversion: 2.1 time: 0.159309 Aug 10 23:51:00.534716 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3307/6404] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:51:00 2022] GET /compute/v2.1/servers/45cdf247-6095-4fe9-ae11-1c193cd91584 => generated 1517 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:51:01.555599 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-9f3001b8-4e3a-434a-913f-fa464ab69053 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:51:01.556300 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-9f3001b8-4e3a-434a-913f-fa464ab69053 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] [instance: 45cdf247-6095-4fe9-ae11-1c193cd91584] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:51:01.559169 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_api:SELECT=28 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:51:01.564646 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9f3001b8-4e3a-434a-913f-fa464ab69053 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:51:01.565137 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9f3001b8-4e3a-434a-913f-fa464ab69053 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:51:01.565579 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9f3001b8-4e3a-434a-913f-fa464ab69053 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:51:01.566309 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9f3001b8-4e3a-434a-913f-fa464ab69053 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:51:01.566768 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9f3001b8-4e3a-434a-913f-fa464ab69053 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:51:01.567224 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9f3001b8-4e3a-434a-913f-fa464ab69053 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:51:01.571316 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=80 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:51:01.700752 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-9f3001b8-4e3a-434a-913f-fa464ab69053 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57afd5409064dc2ac870d1734855932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e1db7818b742e79b76ca738e930bb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:51:01.708364 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-9f3001b8-4e3a-434a-913f-fa464ab69053 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] 10.222.0.58 "GET /compute/v2.1/servers/45cdf247-6095-4fe9-ae11-1c193cd91584" status: 200 len: 1517 microversion: 2.1 time: 0.156710 Aug 10 23:51:01.708941 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3098/6405] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:51:01 2022] GET /compute/v2.1/servers/45cdf247-6095-4fe9-ae11-1c193cd91584 => generated 1517 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:51:02.729612 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-dd216cd2-bb5a-4755-bab3-87bedb10048b tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:51:02.730183 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-dd216cd2-bb5a-4755-bab3-87bedb10048b tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] [instance: 45cdf247-6095-4fe9-ae11-1c193cd91584] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:51:02.733093 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_api:SELECT=32 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:51:02.738685 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dd216cd2-bb5a-4755-bab3-87bedb10048b tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:51:02.739213 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dd216cd2-bb5a-4755-bab3-87bedb10048b tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:51:02.739669 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dd216cd2-bb5a-4755-bab3-87bedb10048b tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:51:02.740382 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dd216cd2-bb5a-4755-bab3-87bedb10048b tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:51:02.740880 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dd216cd2-bb5a-4755-bab3-87bedb10048b tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:51:02.741322 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dd216cd2-bb5a-4755-bab3-87bedb10048b tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:51:02.868700 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-dd216cd2-bb5a-4755-bab3-87bedb10048b tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57afd5409064dc2ac870d1734855932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e1db7818b742e79b76ca738e930bb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:51:02.876757 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-dd216cd2-bb5a-4755-bab3-87bedb10048b tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] 10.222.0.58 "GET /compute/v2.1/servers/45cdf247-6095-4fe9-ae11-1c193cd91584" status: 200 len: 1517 microversion: 2.1 time: 0.151114 Aug 10 23:51:02.877329 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3308/6406] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:51:02 2022] GET /compute/v2.1/servers/45cdf247-6095-4fe9-ae11-1c193cd91584 => generated 1517 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:51:03.897966 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-e26ac612-34aa-481f-89a5-cbf80cc1fb85 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:51:03.898605 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-e26ac612-34aa-481f-89a5-cbf80cc1fb85 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] [instance: 45cdf247-6095-4fe9-ae11-1c193cd91584] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:51:03.906014 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e26ac612-34aa-481f-89a5-cbf80cc1fb85 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:51:03.906500 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e26ac612-34aa-481f-89a5-cbf80cc1fb85 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:51:03.907075 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e26ac612-34aa-481f-89a5-cbf80cc1fb85 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:51:03.907771 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e26ac612-34aa-481f-89a5-cbf80cc1fb85 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:51:03.908220 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e26ac612-34aa-481f-89a5-cbf80cc1fb85 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:51:03.908653 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e26ac612-34aa-481f-89a5-cbf80cc1fb85 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:51:04.039251 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-e26ac612-34aa-481f-89a5-cbf80cc1fb85 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57afd5409064dc2ac870d1734855932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e1db7818b742e79b76ca738e930bb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:51:04.047537 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-e26ac612-34aa-481f-89a5-cbf80cc1fb85 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] 10.222.0.58 "GET /compute/v2.1/servers/45cdf247-6095-4fe9-ae11-1c193cd91584" status: 200 len: 1517 microversion: 2.1 time: 0.153705 Aug 10 23:51:04.048147 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3099/6407] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:51:03 2022] GET /compute/v2.1/servers/45cdf247-6095-4fe9-ae11-1c193cd91584 => generated 1517 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:51:04.920151 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-5cf6de36-a551-4684-97f6-935813f0a5cb req-7b9d2f7f-54dd-4e72-8b6b-6fb506cc83cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45cdf247-6095-4fe9-ae11-1c193cd91584", "name": "network-vif-unplugged", "status": "completed", "tag": "c9ac36ca-3536-4d33-ab38-839c861b8167"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:51:04.931969 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-5cf6de36-a551-4684-97f6-935813f0a5cb req-7b9d2f7f-54dd-4e72-8b6b-6fb506cc83cc service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:51:04.932855 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-5cf6de36-a551-4684-97f6-935813f0a5cb req-7b9d2f7f-54dd-4e72-8b6b-6fb506cc83cc service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:51:04.933324 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-5cf6de36-a551-4684-97f6-935813f0a5cb req-7b9d2f7f-54dd-4e72-8b6b-6fb506cc83cc service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:51:04.947057 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-5cf6de36-a551-4684-97f6-935813f0a5cb req-7b9d2f7f-54dd-4e72-8b6b-6fb506cc83cc service nova] Creating event network-vif-unplugged:c9ac36ca-3536-4d33-ab38-839c861b8167 for instance 45cdf247-6095-4fe9-ae11-1c193cd91584 on n-h2-850468-14 Aug 10 23:51:04.952746 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [req-5cf6de36-a551-4684-97f6-935813f0a5cb req-7b9d2f7f-54dd-4e72-8b6b-6fb506cc83cc service nova] Instance 45cdf247-6095-4fe9-ae11-1c193cd91584 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-850468-14', 'n-h2-850468-14'} {{(pid=122633) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5901}} Aug 10 23:51:04.963940 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-5cf6de36-a551-4684-97f6-935813f0a5cb req-7b9d2f7f-54dd-4e72-8b6b-6fb506cc83cc service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048775 Aug 10 23:51:04.965076 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3309/6408] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:51:04 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:51:05.068893 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-9d4026bb-d20c-4c22-8d4b-3ae4862d5e64 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:51:05.069499 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-9d4026bb-d20c-4c22-8d4b-3ae4862d5e64 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] [instance: 45cdf247-6095-4fe9-ae11-1c193cd91584] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:51:05.077482 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9d4026bb-d20c-4c22-8d4b-3ae4862d5e64 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:51:05.077899 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9d4026bb-d20c-4c22-8d4b-3ae4862d5e64 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:51:05.078338 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9d4026bb-d20c-4c22-8d4b-3ae4862d5e64 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:51:05.079103 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9d4026bb-d20c-4c22-8d4b-3ae4862d5e64 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:51:05.079558 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9d4026bb-d20c-4c22-8d4b-3ae4862d5e64 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:51:05.079985 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9d4026bb-d20c-4c22-8d4b-3ae4862d5e64 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:51:05.216646 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-9d4026bb-d20c-4c22-8d4b-3ae4862d5e64 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57afd5409064dc2ac870d1734855932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e1db7818b742e79b76ca738e930bb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:51:05.224697 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-9d4026bb-d20c-4c22-8d4b-3ae4862d5e64 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] 10.222.0.58 "GET /compute/v2.1/servers/45cdf247-6095-4fe9-ae11-1c193cd91584" status: 200 len: 1516 microversion: 2.1 time: 0.159836 Aug 10 23:51:05.225368 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3100/6409] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:51:05 2022] GET /compute/v2.1/servers/45cdf247-6095-4fe9-ae11-1c193cd91584 => generated 1516 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:51:06.247234 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-9e6c81c1-bce8-4a32-ace6-eebd05a024c6 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:51:06.248136 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-9e6c81c1-bce8-4a32-ace6-eebd05a024c6 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] [instance: 45cdf247-6095-4fe9-ae11-1c193cd91584] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:51:06.254441 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9e6c81c1-bce8-4a32-ace6-eebd05a024c6 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:51:06.254998 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9e6c81c1-bce8-4a32-ace6-eebd05a024c6 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:51:06.255449 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9e6c81c1-bce8-4a32-ace6-eebd05a024c6 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:51:06.256157 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9e6c81c1-bce8-4a32-ace6-eebd05a024c6 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:51:06.256619 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9e6c81c1-bce8-4a32-ace6-eebd05a024c6 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:51:06.257055 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9e6c81c1-bce8-4a32-ace6-eebd05a024c6 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:51:06.392317 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-9e6c81c1-bce8-4a32-ace6-eebd05a024c6 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57afd5409064dc2ac870d1734855932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e1db7818b742e79b76ca738e930bb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:51:06.399819 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-9e6c81c1-bce8-4a32-ace6-eebd05a024c6 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] 10.222.0.58 "GET /compute/v2.1/servers/45cdf247-6095-4fe9-ae11-1c193cd91584" status: 200 len: 1514 microversion: 2.1 time: 0.158012 Aug 10 23:51:06.400385 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3310/6410] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:51:06 2022] GET /compute/v2.1/servers/45cdf247-6095-4fe9-ae11-1c193cd91584 => generated 1514 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:51:06.986429 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-608ef25a-c66c-457c-9b35-232481452a29 req-a523f4b8-abbc-45dd-91a9-1675f35dfcba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "45cdf247-6095-4fe9-ae11-1c193cd91584", "tag": "c9ac36ca-3536-4d33-ab38-839c861b8167"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:51:06.997404 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-608ef25a-c66c-457c-9b35-232481452a29 req-a523f4b8-abbc-45dd-91a9-1675f35dfcba service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:51:06.997872 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-608ef25a-c66c-457c-9b35-232481452a29 req-a523f4b8-abbc-45dd-91a9-1675f35dfcba service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:51:06.998328 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-608ef25a-c66c-457c-9b35-232481452a29 req-a523f4b8-abbc-45dd-91a9-1675f35dfcba service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:51:07.009698 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-608ef25a-c66c-457c-9b35-232481452a29 req-a523f4b8-abbc-45dd-91a9-1675f35dfcba service nova] Creating event network-changed:c9ac36ca-3536-4d33-ab38-839c861b8167 for instance 45cdf247-6095-4fe9-ae11-1c193cd91584 on n-h2-850468-14 Aug 10 23:51:07.015659 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [req-608ef25a-c66c-457c-9b35-232481452a29 req-a523f4b8-abbc-45dd-91a9-1675f35dfcba service nova] Instance 45cdf247-6095-4fe9-ae11-1c193cd91584 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-850468-14', 'n-h2-850468-14'} {{(pid=122632) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5901}} Aug 10 23:51:07.026169 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-608ef25a-c66c-457c-9b35-232481452a29 req-a523f4b8-abbc-45dd-91a9-1675f35dfcba service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043385 Aug 10 23:51:07.026766 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3101/6411] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:51:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:51:07.423005 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-ed91a5dd-155c-4a7a-83db-d08b3d85255a tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:51:07.423640 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-ed91a5dd-155c-4a7a-83db-d08b3d85255a tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] [instance: 45cdf247-6095-4fe9-ae11-1c193cd91584] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:51:07.430677 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ed91a5dd-155c-4a7a-83db-d08b3d85255a tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:51:07.431223 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ed91a5dd-155c-4a7a-83db-d08b3d85255a tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:51:07.431678 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ed91a5dd-155c-4a7a-83db-d08b3d85255a tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:51:07.432411 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ed91a5dd-155c-4a7a-83db-d08b3d85255a tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:51:07.432884 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ed91a5dd-155c-4a7a-83db-d08b3d85255a tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:51:07.433359 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ed91a5dd-155c-4a7a-83db-d08b3d85255a tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:51:07.665385 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-ed91a5dd-155c-4a7a-83db-d08b3d85255a tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57afd5409064dc2ac870d1734855932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e1db7818b742e79b76ca738e930bb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:51:07.674719 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-ed91a5dd-155c-4a7a-83db-d08b3d85255a tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] 10.222.0.58 "GET /compute/v2.1/servers/45cdf247-6095-4fe9-ae11-1c193cd91584" status: 200 len: 1514 microversion: 2.1 time: 0.255914 Aug 10 23:51:07.675426 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3311/6412] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:51:07 2022] GET /compute/v2.1/servers/45cdf247-6095-4fe9-ae11-1c193cd91584 => generated 1514 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:51:08.697945 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-2b3f6385-6660-4ce4-a241-d90dbd6ed3eb tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:51:08.698563 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-2b3f6385-6660-4ce4-a241-d90dbd6ed3eb tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] [instance: 45cdf247-6095-4fe9-ae11-1c193cd91584] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:51:08.705019 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2b3f6385-6660-4ce4-a241-d90dbd6ed3eb tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:51:08.705508 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2b3f6385-6660-4ce4-a241-d90dbd6ed3eb tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:51:08.705951 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2b3f6385-6660-4ce4-a241-d90dbd6ed3eb tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:51:08.706649 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2b3f6385-6660-4ce4-a241-d90dbd6ed3eb tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:51:08.707126 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2b3f6385-6660-4ce4-a241-d90dbd6ed3eb tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:51:08.707560 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2b3f6385-6660-4ce4-a241-d90dbd6ed3eb tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:51:08.838946 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-2b3f6385-6660-4ce4-a241-d90dbd6ed3eb tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57afd5409064dc2ac870d1734855932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e1db7818b742e79b76ca738e930bb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:51:08.847379 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-2b3f6385-6660-4ce4-a241-d90dbd6ed3eb tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] 10.222.0.58 "GET /compute/v2.1/servers/45cdf247-6095-4fe9-ae11-1c193cd91584" status: 200 len: 1511 microversion: 2.1 time: 0.154582 Aug 10 23:51:08.847960 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3102/6413] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:51:08 2022] GET /compute/v2.1/servers/45cdf247-6095-4fe9-ae11-1c193cd91584 => generated 1511 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:51:08.868350 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-844c2f73-07fc-4fd6-b74d-332ee9d2e821 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:51:08.868982 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-844c2f73-07fc-4fd6-b74d-332ee9d2e821 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] [instance: 45cdf247-6095-4fe9-ae11-1c193cd91584] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:51:08.877084 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-844c2f73-07fc-4fd6-b74d-332ee9d2e821 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:51:08.877582 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-844c2f73-07fc-4fd6-b74d-332ee9d2e821 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:51:08.878035 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-844c2f73-07fc-4fd6-b74d-332ee9d2e821 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:51:08.878750 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-844c2f73-07fc-4fd6-b74d-332ee9d2e821 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:51:08.879248 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-844c2f73-07fc-4fd6-b74d-332ee9d2e821 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:51:08.879688 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-844c2f73-07fc-4fd6-b74d-332ee9d2e821 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:51:08.906150 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-844c2f73-07fc-4fd6-b74d-332ee9d2e821 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] [instance: 45cdf247-6095-4fe9-ae11-1c193cd91584] Going to try to terminate instance {{(pid=122633) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:51:08.957351 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.compute.api [None req-844c2f73-07fc-4fd6-b74d-332ee9d2e821 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] [instance: 45cdf247-6095-4fe9-ae11-1c193cd91584] Found an unconfirmed migration during delete, id: 16, status: finished Aug 10 23:51:10.109824 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-5a549a70-efd2-4708-afef-8c0241b6d689 req-9ebe40c6-70c3-4bf4-a9fe-dce776a9d81c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45cdf247-6095-4fe9-ae11-1c193cd91584", "name": "network-vif-plugged", "status": "completed", "tag": "c9ac36ca-3536-4d33-ab38-839c861b8167"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:51:10.123088 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-5a549a70-efd2-4708-afef-8c0241b6d689 req-9ebe40c6-70c3-4bf4-a9fe-dce776a9d81c service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:51:10.123584 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-5a549a70-efd2-4708-afef-8c0241b6d689 req-9ebe40c6-70c3-4bf4-a9fe-dce776a9d81c service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:51:10.124642 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-5a549a70-efd2-4708-afef-8c0241b6d689 req-9ebe40c6-70c3-4bf4-a9fe-dce776a9d81c service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:51:10.137787 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-5a549a70-efd2-4708-afef-8c0241b6d689 req-9ebe40c6-70c3-4bf4-a9fe-dce776a9d81c service nova] Creating event network-vif-plugged:c9ac36ca-3536-4d33-ab38-839c861b8167 for instance 45cdf247-6095-4fe9-ae11-1c193cd91584 on n-h2-850468-14 Aug 10 23:51:10.142621 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-5a549a70-efd2-4708-afef-8c0241b6d689 req-9ebe40c6-70c3-4bf4-a9fe-dce776a9d81c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038172 Aug 10 23:51:10.143513 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3103/6414] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:51:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 23:51:10.347599 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-844c2f73-07fc-4fd6-b74d-332ee9d2e821 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] 10.222.0.58 "DELETE /compute/v2.1/servers/45cdf247-6095-4fe9-ae11-1c193cd91584" status: 204 len: 0 microversion: 2.1 time: 1.482691 Aug 10 23:51:10.348236 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3312/6415] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:51:08 2022] DELETE /compute/v2.1/servers/45cdf247-6095-4fe9-ae11-1c193cd91584 => generated 0 bytes in 1484 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:51:10.358379 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-4cf01940-9a7c-49d9-81c2-a8076d478c29 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:51:10.359146 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-4cf01940-9a7c-49d9-81c2-a8076d478c29 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] [instance: 45cdf247-6095-4fe9-ae11-1c193cd91584] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:51:10.365285 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4cf01940-9a7c-49d9-81c2-a8076d478c29 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:51:10.365775 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4cf01940-9a7c-49d9-81c2-a8076d478c29 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:51:10.366213 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4cf01940-9a7c-49d9-81c2-a8076d478c29 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:51:10.367481 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4cf01940-9a7c-49d9-81c2-a8076d478c29 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:51:10.368155 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4cf01940-9a7c-49d9-81c2-a8076d478c29 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:51:10.368619 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4cf01940-9a7c-49d9-81c2-a8076d478c29 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:51:10.516786 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-4cf01940-9a7c-49d9-81c2-a8076d478c29 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57afd5409064dc2ac870d1734855932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e1db7818b742e79b76ca738e930bb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:51:10.523500 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-4cf01940-9a7c-49d9-81c2-a8076d478c29 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] 10.222.0.58 "GET /compute/v2.1/servers/45cdf247-6095-4fe9-ae11-1c193cd91584" status: 200 len: 1503 microversion: 2.1 time: 0.170478 Aug 10 23:51:10.524088 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3104/6416] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:51:10 2022] GET /compute/v2.1/servers/45cdf247-6095-4fe9-ae11-1c193cd91584 => generated 1503 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:51:11.546868 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-0d28cbba-43b1-4c83-9a89-db58feac7cd2 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:51:11.547597 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-0d28cbba-43b1-4c83-9a89-db58feac7cd2 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] [instance: 45cdf247-6095-4fe9-ae11-1c193cd91584] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:51:11.554491 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0d28cbba-43b1-4c83-9a89-db58feac7cd2 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:51:11.555024 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0d28cbba-43b1-4c83-9a89-db58feac7cd2 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:51:11.555479 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0d28cbba-43b1-4c83-9a89-db58feac7cd2 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:51:11.556196 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0d28cbba-43b1-4c83-9a89-db58feac7cd2 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:51:11.556667 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0d28cbba-43b1-4c83-9a89-db58feac7cd2 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:51:11.557110 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0d28cbba-43b1-4c83-9a89-db58feac7cd2 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:51:11.693101 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-0d28cbba-43b1-4c83-9a89-db58feac7cd2 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a57afd5409064dc2ac870d1734855932', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4e1db7818b742e79b76ca738e930bb0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:51:11.700889 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-0d28cbba-43b1-4c83-9a89-db58feac7cd2 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] 10.222.0.58 "GET /compute/v2.1/servers/45cdf247-6095-4fe9-ae11-1c193cd91584" status: 200 len: 1503 microversion: 2.1 time: 0.158936 Aug 10 23:51:11.701895 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3313/6417] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:51:11 2022] GET /compute/v2.1/servers/45cdf247-6095-4fe9-ae11-1c193cd91584 => generated 1503 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:51:12.320187 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-7751a04b-4b66-4e96-aa91-3d05cd0215e9 req-7766a8a1-bf8d-4e3b-a8d8-38d9e30a200b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "45cdf247-6095-4fe9-ae11-1c193cd91584", "name": "network-vif-deleted", "tag": "c9ac36ca-3536-4d33-ab38-839c861b8167"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:51:12.335645 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-7751a04b-4b66-4e96-aa91-3d05cd0215e9 req-7766a8a1-bf8d-4e3b-a8d8-38d9e30a200b service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:51:12.336590 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-7751a04b-4b66-4e96-aa91-3d05cd0215e9 req-7766a8a1-bf8d-4e3b-a8d8-38d9e30a200b service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:51:12.337257 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-7751a04b-4b66-4e96-aa91-3d05cd0215e9 req-7766a8a1-bf8d-4e3b-a8d8-38d9e30a200b service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:51:12.352106 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-7751a04b-4b66-4e96-aa91-3d05cd0215e9 req-7766a8a1-bf8d-4e3b-a8d8-38d9e30a200b service nova] Creating event network-vif-deleted:c9ac36ca-3536-4d33-ab38-839c861b8167 for instance 45cdf247-6095-4fe9-ae11-1c193cd91584 on n-h2-850468-14 Aug 10 23:51:12.357796 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-7751a04b-4b66-4e96-aa91-3d05cd0215e9 req-7766a8a1-bf8d-4e3b-a8d8-38d9e30a200b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041345 Aug 10 23:51:12.358411 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3105/6418] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:51:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:51:12.723102 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-8da0688c-d5d6-4aea-9791-ad81fbf12d5f tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:51:12.723720 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-8da0688c-d5d6-4aea-9791-ad81fbf12d5f tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] [instance: 45cdf247-6095-4fe9-ae11-1c193cd91584] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:51:12.730665 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8da0688c-d5d6-4aea-9791-ad81fbf12d5f tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:51:12.731200 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8da0688c-d5d6-4aea-9791-ad81fbf12d5f tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:51:12.732202 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8da0688c-d5d6-4aea-9791-ad81fbf12d5f tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:51:12.732878 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8da0688c-d5d6-4aea-9791-ad81fbf12d5f tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:51:12.733343 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8da0688c-d5d6-4aea-9791-ad81fbf12d5f tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:51:12.733778 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8da0688c-d5d6-4aea-9791-ad81fbf12d5f tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:51:12.748508 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-8da0688c-d5d6-4aea-9791-ad81fbf12d5f tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] HTTP exception thrown: Instance 45cdf247-6095-4fe9-ae11-1c193cd91584 could not be found. Aug 10 23:51:12.750157 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-8da0688c-d5d6-4aea-9791-ad81fbf12d5f tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Request method failure captured: Aug 10 23:51:12.750157 n-d-850468-14 devstack@n-api.service[122633]: request: GET /compute/v2.1/servers/45cdf247-6095-4fe9-ae11-1c193cd91584 HTTP/1.1 Aug 10 23:51:12.750157 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:51:12.750157 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:51:12.750157 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:51:12.750157 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:51:12.750157 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:51:12.750157 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:51:12.750157 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:51:12.750157 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:51:12.750157 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9EQ9YrGcsPn3rDJXLlCDwRGxmvkbGVVHo9_OFXVCMmefWZjZrmaKJYNGCxrzk5DGWKBO-7h3DePJ7DT5p7WFv207snuxjvxJxIpSsVOABRssUIWLJGNp3O1q5FnUB5gwDphRvuQ4j0PScQk_egQ8wQ0pykdjFrGACN50nHSHLaMo700 Aug 10 23:51:12.750157 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:51:12.750157 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:51:12.750157 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:51:12.750157 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:51:12.750157 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:51:12.750157 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:51:12.750157 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: e4e1db7818b742e79b76ca738e930bb0 Aug 10 23:51:12.750157 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-DeleteServersTestJSON-1743495162 Aug 10 23:51:12.750157 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:51:12.750157 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:51:12.750157 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e4e1db7818b742e79b76ca738e930bb0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e4e1db7818b742e79b76ca738e930bb0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/e4e1db7818b742e79b76ca738e930bb0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_e4e1db7818b742e79b76ca738e930bb0", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:51:12.750157 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-DeleteServersTestJSON-1743495162 Aug 10 23:51:12.750157 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: e4e1db7818b742e79b76ca738e930bb0 Aug 10 23:51:12.750157 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-DeleteServersTestJSON-1743495162 Aug 10 23:51:12.750157 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-DeleteServersTestJSON-1743495162-project Aug 10 23:51:12.750157 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:51:12.750157 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:51:12.750157 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: a57afd5409064dc2ac870d1734855932 Aug 10 23:51:12.750157 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-DeleteServersTestJSON-1743495162-project Aug 10 23:51:12.750157 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:51:12.750157 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance 45cdf247-6095-4fe9-ae11-1c193cd91584 could not be found. Aug 10 23:51:12.750157 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': '45cdf247-6095-4fe9-ae11-1c193cd91584'} Aug 10 23:51:12.750157 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:51:12.750157 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:51:12.750157 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:51:12.750157 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:51:12.750157 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:51:12.750157 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:51:12.750157 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:51:12.750157 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:51:12.750157 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:51:12.750157 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:51:12.750157 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45cdf247-6095-4fe9-ae11-1c193cd91584 could not be found. Aug 10 23:51:12.750157 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:51:12.750157 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:51:12.750157 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:51:12.750157 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:51:12.750157 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:51:12.750157 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:51:12.750157 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:51:12.750157 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:51:12.750157 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:51:12.750157 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:51:12.750157 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:51:12.750157 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:51:12.750157 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:51:12.750157 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:51:12.750157 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:51:12.750157 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:51:12.750157 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45cdf247-6095-4fe9-ae11-1c193cd91584 could not be found. Aug 10 23:51:12.750157 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:51:12.750157 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:51:12.750157 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:51:12.755795 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:51:12.755795 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:51:12.755795 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:51:12.755795 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:51:12.755795 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:51:12.755795 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45cdf247-6095-4fe9-ae11-1c193cd91584 could not be found. Aug 10 23:51:12.755795 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:51:12.755795 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-8da0688c-d5d6-4aea-9791-ad81fbf12d5f tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Returning 404 to user: Instance 45cdf247-6095-4fe9-ae11-1c193cd91584 could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:51:12.755795 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-8da0688c-d5d6-4aea-9791-ad81fbf12d5f tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] 10.222.0.58 "GET /compute/v2.1/servers/45cdf247-6095-4fe9-ae11-1c193cd91584" status: 404 len: 111 microversion: 2.1 time: 0.032464 Aug 10 23:51:12.755795 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3314/6419] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:51:12 2022] GET /compute/v2.1/servers/45cdf247-6095-4fe9-ae11-1c193cd91584 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:51:12.767989 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-a8a5fca6-9459-48c2-9969-377bb79b61e3 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:51:12.768627 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-a8a5fca6-9459-48c2-9969-377bb79b61e3 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] [instance: 45cdf247-6095-4fe9-ae11-1c193cd91584] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:51:12.774823 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a8a5fca6-9459-48c2-9969-377bb79b61e3 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:51:12.775312 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a8a5fca6-9459-48c2-9969-377bb79b61e3 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:51:12.775782 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a8a5fca6-9459-48c2-9969-377bb79b61e3 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:51:12.776475 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a8a5fca6-9459-48c2-9969-377bb79b61e3 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:51:12.776929 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a8a5fca6-9459-48c2-9969-377bb79b61e3 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:51:12.777385 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a8a5fca6-9459-48c2-9969-377bb79b61e3 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:51:12.790600 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-a8a5fca6-9459-48c2-9969-377bb79b61e3 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] HTTP exception thrown: Instance 45cdf247-6095-4fe9-ae11-1c193cd91584 could not be found. Aug 10 23:51:12.792255 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-a8a5fca6-9459-48c2-9969-377bb79b61e3 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Request method failure captured: Aug 10 23:51:12.792255 n-d-850468-14 devstack@n-api.service[122632]: request: DELETE /compute/v2.1/servers/45cdf247-6095-4fe9-ae11-1c193cd91584 HTTP/1.1 Aug 10 23:51:12.792255 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:51:12.792255 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:51:12.792255 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:51:12.792255 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 23:51:12.792255 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:51:12.792255 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:51:12.792255 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:51:12.792255 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:51:12.792255 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9EQ9YrGcsPn3rDJXLlCDwRGxmvkbGVVHo9_OFXVCMmefWZjZrmaKJYNGCxrzk5DGWKBO-7h3DePJ7DT5p7WFv207snuxjvxJxIpSsVOABRssUIWLJGNp3O1q5FnUB5gwDphRvuQ4j0PScQk_egQ8wQ0pykdjFrGACN50nHSHLaMo700 Aug 10 23:51:12.792255 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:51:12.792255 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:51:12.792255 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:51:12.792255 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:51:12.792255 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:51:12.792255 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:51:12.792255 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: e4e1db7818b742e79b76ca738e930bb0 Aug 10 23:51:12.792255 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-DeleteServersTestJSON-1743495162 Aug 10 23:51:12.792255 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:51:12.792255 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:51:12.792255 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e4e1db7818b742e79b76ca738e930bb0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e4e1db7818b742e79b76ca738e930bb0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/e4e1db7818b742e79b76ca738e930bb0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_e4e1db7818b742e79b76ca738e930bb0", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:51:12.792255 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-DeleteServersTestJSON-1743495162 Aug 10 23:51:12.792255 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: e4e1db7818b742e79b76ca738e930bb0 Aug 10 23:51:12.792255 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-DeleteServersTestJSON-1743495162 Aug 10 23:51:12.792255 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-DeleteServersTestJSON-1743495162-project Aug 10 23:51:12.792255 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:51:12.792255 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:51:12.792255 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: a57afd5409064dc2ac870d1734855932 Aug 10 23:51:12.792255 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-DeleteServersTestJSON-1743495162-project Aug 10 23:51:12.792255 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:51:12.792255 n-d-850468-14 devstack@n-api.service[122632]: exception: Instance 45cdf247-6095-4fe9-ae11-1c193cd91584 could not be found. Aug 10 23:51:12.792255 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': '45cdf247-6095-4fe9-ae11-1c193cd91584'} Aug 10 23:51:12.792255 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:51:12.792255 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:51:12.792255 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:51:12.792255 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:51:12.792255 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:51:12.792255 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:51:12.792255 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:51:12.792255 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:51:12.792255 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:51:12.792255 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:51:12.792255 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45cdf247-6095-4fe9-ae11-1c193cd91584 could not be found. Aug 10 23:51:12.792255 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:51:12.792255 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:51:12.792255 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:51:12.792255 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:51:12.792255 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:51:12.792255 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:51:12.792255 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:51:12.792255 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:51:12.792255 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:51:12.792255 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:51:12.792255 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 23:51:12.792255 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 23:51:12.792255 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 23:51:12.792255 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 23:51:12.792255 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:51:12.792255 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:51:12.792255 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:51:12.792255 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:51:12.798486 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45cdf247-6095-4fe9-ae11-1c193cd91584 could not be found. Aug 10 23:51:12.798486 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:51:12.798486 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:51:12.798486 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:51:12.798486 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:51:12.798486 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:51:12.798486 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:51:12.798486 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:51:12.798486 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:51:12.798486 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45cdf247-6095-4fe9-ae11-1c193cd91584 could not be found. Aug 10 23:51:12.798486 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:51:12.798486 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-a8a5fca6-9459-48c2-9969-377bb79b61e3 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Returning 404 to user: Instance 45cdf247-6095-4fe9-ae11-1c193cd91584 could not be found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:51:12.798486 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-a8a5fca6-9459-48c2-9969-377bb79b61e3 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] 10.222.0.58 "DELETE /compute/v2.1/servers/45cdf247-6095-4fe9-ae11-1c193cd91584" status: 404 len: 111 microversion: 2.1 time: 0.030584 Aug 10 23:51:12.798486 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3106/6420] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:51:12 2022] DELETE /compute/v2.1/servers/45cdf247-6095-4fe9-ae11-1c193cd91584 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 10 23:51:12.803122 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-5918049f-42b9-41bf-be6c-613093f5bff6 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:51:12.803747 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-5918049f-42b9-41bf-be6c-613093f5bff6 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] [instance: 45cdf247-6095-4fe9-ae11-1c193cd91584] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:51:12.810381 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5918049f-42b9-41bf-be6c-613093f5bff6 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:51:12.810900 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5918049f-42b9-41bf-be6c-613093f5bff6 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:51:12.811354 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5918049f-42b9-41bf-be6c-613093f5bff6 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:51:12.812066 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5918049f-42b9-41bf-be6c-613093f5bff6 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:51:12.812531 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5918049f-42b9-41bf-be6c-613093f5bff6 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:51:12.812969 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5918049f-42b9-41bf-be6c-613093f5bff6 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:51:12.826326 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-5918049f-42b9-41bf-be6c-613093f5bff6 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] HTTP exception thrown: Instance 45cdf247-6095-4fe9-ae11-1c193cd91584 could not be found. Aug 10 23:51:12.827908 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-5918049f-42b9-41bf-be6c-613093f5bff6 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Request method failure captured: Aug 10 23:51:12.827908 n-d-850468-14 devstack@n-api.service[122633]: request: GET /compute/v2.1/servers/45cdf247-6095-4fe9-ae11-1c193cd91584 HTTP/1.1 Aug 10 23:51:12.827908 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:51:12.827908 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:51:12.827908 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:51:12.827908 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:51:12.827908 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:51:12.827908 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:51:12.827908 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:51:12.827908 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:51:12.827908 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9EQ9YrGcsPn3rDJXLlCDwRGxmvkbGVVHo9_OFXVCMmefWZjZrmaKJYNGCxrzk5DGWKBO-7h3DePJ7DT5p7WFv207snuxjvxJxIpSsVOABRssUIWLJGNp3O1q5FnUB5gwDphRvuQ4j0PScQk_egQ8wQ0pykdjFrGACN50nHSHLaMo700 Aug 10 23:51:12.827908 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:51:12.827908 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:51:12.827908 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:51:12.827908 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:51:12.827908 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:51:12.827908 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:51:12.827908 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: e4e1db7818b742e79b76ca738e930bb0 Aug 10 23:51:12.827908 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-DeleteServersTestJSON-1743495162 Aug 10 23:51:12.827908 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:51:12.827908 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:51:12.827908 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e4e1db7818b742e79b76ca738e930bb0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/e4e1db7818b742e79b76ca738e930bb0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/e4e1db7818b742e79b76ca738e930bb0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_e4e1db7818b742e79b76ca738e930bb0", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:51:12.827908 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-DeleteServersTestJSON-1743495162 Aug 10 23:51:12.827908 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: e4e1db7818b742e79b76ca738e930bb0 Aug 10 23:51:12.827908 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-DeleteServersTestJSON-1743495162 Aug 10 23:51:12.827908 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-DeleteServersTestJSON-1743495162-project Aug 10 23:51:12.827908 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:51:12.827908 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:51:12.827908 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: a57afd5409064dc2ac870d1734855932 Aug 10 23:51:12.827908 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-DeleteServersTestJSON-1743495162-project Aug 10 23:51:12.827908 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:51:12.827908 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance 45cdf247-6095-4fe9-ae11-1c193cd91584 could not be found. Aug 10 23:51:12.827908 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': '45cdf247-6095-4fe9-ae11-1c193cd91584'} Aug 10 23:51:12.827908 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:51:12.827908 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:51:12.827908 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:51:12.827908 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:51:12.827908 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:51:12.827908 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:51:12.827908 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:51:12.827908 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:51:12.827908 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:51:12.827908 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:51:12.827908 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 45cdf247-6095-4fe9-ae11-1c193cd91584 could not be found. Aug 10 23:51:12.827908 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:51:12.827908 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:51:12.827908 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:51:12.827908 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:51:12.827908 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:51:12.827908 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:51:12.827908 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:51:12.827908 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:51:12.827908 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:51:12.827908 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:51:12.827908 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:51:12.827908 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:51:12.827908 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:51:12.827908 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:51:12.827908 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:51:12.827908 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:51:12.827908 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 45cdf247-6095-4fe9-ae11-1c193cd91584 could not be found. Aug 10 23:51:12.827908 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:51:12.827908 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:51:12.827908 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:51:12.836583 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:51:12.836583 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:51:12.836583 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:51:12.836583 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:51:12.836583 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:51:12.836583 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 45cdf247-6095-4fe9-ae11-1c193cd91584 could not be found. Aug 10 23:51:12.836583 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:51:12.836583 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-5918049f-42b9-41bf-be6c-613093f5bff6 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] Returning 404 to user: Instance 45cdf247-6095-4fe9-ae11-1c193cd91584 could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:51:12.836583 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-5918049f-42b9-41bf-be6c-613093f5bff6 tempest-DeleteServersTestJSON-1743495162 tempest-DeleteServersTestJSON-1743495162-project] 10.222.0.58 "GET /compute/v2.1/servers/45cdf247-6095-4fe9-ae11-1c193cd91584" status: 404 len: 111 microversion: 2.1 time: 0.030400 Aug 10 23:51:12.836583 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3315/6421] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:51:12 2022] GET /compute/v2.1/servers/45cdf247-6095-4fe9-ae11-1c193cd91584 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:51:21.313747 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-22083b61-053d-48e5-8495-34d45f498dd2 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1769883065", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452", "networks": [{"uuid": "12af9db6-9d9f-40b6-b86e-76dfd2f6f325"}]}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:51:21.376066 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.network.neutron [None req-22083b61-053d-48e5-8495-34d45f498dd2 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] validate_networks() for [('12af9db6-9d9f-40b6-b86e-76dfd2f6f325', None, None, None, None, None)] {{(pid=122632) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 23:51:21.809359 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-22083b61-053d-48e5-8495-34d45f498dd2 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Flavor limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:51:21.809892 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-22083b61-053d-48e5-8495-34d45f498dd2 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Image limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:51:21.810372 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-22083b61-053d-48e5-8495-34d45f498dd2 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Flavor pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:51:21.810849 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-22083b61-053d-48e5-8495-34d45f498dd2 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Image pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:51:21.811263 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-22083b61-053d-48e5-8495-34d45f498dd2 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:51:21.820398 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-22083b61-053d-48e5-8495-34d45f498dd2 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:51:21.820882 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-22083b61-053d-48e5-8495-34d45f498dd2 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:51:21.821518 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-22083b61-053d-48e5-8495-34d45f498dd2 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:51:21.822247 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-22083b61-053d-48e5-8495-34d45f498dd2 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:51:21.822701 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-22083b61-053d-48e5-8495-34d45f498dd2 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:51:21.823154 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-22083b61-053d-48e5-8495-34d45f498dd2 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:51:21.842612 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-22083b61-053d-48e5-8495-34d45f498dd2 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Getting quotas for project 2966ce3ee7fe4d49ae177c6a3a415421. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:51:21.848460 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-22083b61-053d-48e5-8495-34d45f498dd2 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Getting quotas for user b774b20640b8413eac15565a7f624108 and project 2966ce3ee7fe4d49ae177c6a3a415421. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:51:21.862075 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-22083b61-053d-48e5-8495-34d45f498dd2 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Going to run 1 instances... {{(pid=122632) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 23:51:21.864394 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-22083b61-053d-48e5-8495-34d45f498dd2 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] [instance: aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78ad8905-f66f-4733-8be9-2b260f1fabed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122632) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 23:51:21.912483 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-22083b61-053d-48e5-8495-34d45f498dd2 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.721978 Aug 10 23:51:21.913381 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3107/6422] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 23:51:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 723 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 23:51:21.924856 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-0b1ed329-22bd-4be8-a395-c7959bf53deb tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:51:21.925481 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-0b1ed329-22bd-4be8-a395-c7959bf53deb tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] [instance: aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:51:21.987727 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-0b1ed329-22bd-4be8-a395-c7959bf53deb tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b774b20640b8413eac15565a7f624108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2966ce3ee7fe4d49ae177c6a3a415421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:51:21.998374 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-0b1ed329-22bd-4be8-a395-c7959bf53deb tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] 10.222.0.58 "GET /compute/v2.1/servers/aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1" status: 200 len: 1218 microversion: 2.1 time: 0.077081 Aug 10 23:51:21.998989 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3316/6423] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:51:21 2022] GET /compute/v2.1/servers/aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1 => generated 1218 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:51:23.022467 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-84199dd1-7040-4801-b7bf-8f8177761618 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:51:23.023120 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-84199dd1-7040-4801-b7bf-8f8177761618 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] [instance: aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:51:23.035623 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-84199dd1-7040-4801-b7bf-8f8177761618 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:51:23.036134 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-84199dd1-7040-4801-b7bf-8f8177761618 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:51:23.036728 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-84199dd1-7040-4801-b7bf-8f8177761618 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:51:23.037424 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-84199dd1-7040-4801-b7bf-8f8177761618 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:51:23.037888 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-84199dd1-7040-4801-b7bf-8f8177761618 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:51:23.038462 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-84199dd1-7040-4801-b7bf-8f8177761618 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:51:23.114543 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-84199dd1-7040-4801-b7bf-8f8177761618 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b774b20640b8413eac15565a7f624108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2966ce3ee7fe4d49ae177c6a3a415421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:51:23.123580 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-84199dd1-7040-4801-b7bf-8f8177761618 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] 10.222.0.58 "GET /compute/v2.1/servers/aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1" status: 200 len: 1270 microversion: 2.1 time: 0.105673 Aug 10 23:51:23.124798 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3108/6424] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:51:23 2022] GET /compute/v2.1/servers/aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1 => generated 1270 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:51:24.148576 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-d333d589-82dc-42ba-a431-e309c31710b8 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:51:24.149257 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-d333d589-82dc-42ba-a431-e309c31710b8 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] [instance: aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:51:24.154462 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:51:24.160663 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d333d589-82dc-42ba-a431-e309c31710b8 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:51:24.160769 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d333d589-82dc-42ba-a431-e309c31710b8 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:51:24.161195 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d333d589-82dc-42ba-a431-e309c31710b8 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:51:24.162100 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d333d589-82dc-42ba-a431-e309c31710b8 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:51:24.162574 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d333d589-82dc-42ba-a431-e309c31710b8 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:51:24.163102 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d333d589-82dc-42ba-a431-e309c31710b8 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:51:24.327445 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-d333d589-82dc-42ba-a431-e309c31710b8 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b774b20640b8413eac15565a7f624108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2966ce3ee7fe4d49ae177c6a3a415421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:51:24.339373 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-d333d589-82dc-42ba-a431-e309c31710b8 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] 10.222.0.58 "GET /compute/v2.1/servers/aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1" status: 200 len: 1318 microversion: 2.1 time: 0.194497 Aug 10 23:51:24.340148 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3317/6425] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:51:24 2022] GET /compute/v2.1/servers/aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1 => generated 1318 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:51:24.844038 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-99165997-e53d-40c4-a04c-0449b5065a54 req-70dda259-c93a-4f9b-aa8c-cb4dc7701cad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1", "tag": "c3181422-1f74-4128-82b8-2e27adadef4c"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:51:24.855419 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-99165997-e53d-40c4-a04c-0449b5065a54 req-70dda259-c93a-4f9b-aa8c-cb4dc7701cad service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:51:24.855906 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-99165997-e53d-40c4-a04c-0449b5065a54 req-70dda259-c93a-4f9b-aa8c-cb4dc7701cad service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:51:24.857262 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-99165997-e53d-40c4-a04c-0449b5065a54 req-70dda259-c93a-4f9b-aa8c-cb4dc7701cad service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:51:24.878800 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-99165997-e53d-40c4-a04c-0449b5065a54 req-70dda259-c93a-4f9b-aa8c-cb4dc7701cad service nova] Creating event network-changed:c3181422-1f74-4128-82b8-2e27adadef4c for instance aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1 on n-h1-850468-14 Aug 10 23:51:24.883971 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-99165997-e53d-40c4-a04c-0449b5065a54 req-70dda259-c93a-4f9b-aa8c-cb4dc7701cad service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044117 Aug 10 23:51:24.884589 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3109/6426] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:51:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:51:25.361915 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-ffa30e22-3667-4046-bca2-3a793c67f704 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:51:25.362537 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-ffa30e22-3667-4046-bca2-3a793c67f704 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] [instance: aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:51:25.369476 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ffa30e22-3667-4046-bca2-3a793c67f704 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:51:25.369971 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ffa30e22-3667-4046-bca2-3a793c67f704 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:51:25.370420 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ffa30e22-3667-4046-bca2-3a793c67f704 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:51:25.371399 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ffa30e22-3667-4046-bca2-3a793c67f704 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:51:25.371869 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ffa30e22-3667-4046-bca2-3a793c67f704 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:51:25.372474 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ffa30e22-3667-4046-bca2-3a793c67f704 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:51:25.516671 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-ffa30e22-3667-4046-bca2-3a793c67f704 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b774b20640b8413eac15565a7f624108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2966ce3ee7fe4d49ae177c6a3a415421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:51:25.525073 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-ffa30e22-3667-4046-bca2-3a793c67f704 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] 10.222.0.58 "GET /compute/v2.1/servers/aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1" status: 200 len: 1318 microversion: 2.1 time: 0.167113 Aug 10 23:51:25.525658 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3318/6427] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:51:25 2022] GET /compute/v2.1/servers/aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1 => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:51:26.549507 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-b2b08aa9-c8df-4d76-b513-948d7715cb8b tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:51:26.550231 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-b2b08aa9-c8df-4d76-b513-948d7715cb8b tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] [instance: aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:51:26.556394 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b2b08aa9-c8df-4d76-b513-948d7715cb8b tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:51:26.556871 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b2b08aa9-c8df-4d76-b513-948d7715cb8b tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:51:26.557305 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b2b08aa9-c8df-4d76-b513-948d7715cb8b tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:51:26.557990 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b2b08aa9-c8df-4d76-b513-948d7715cb8b tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:51:26.558441 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b2b08aa9-c8df-4d76-b513-948d7715cb8b tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:51:26.558886 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b2b08aa9-c8df-4d76-b513-948d7715cb8b tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:51:26.694018 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-b2b08aa9-c8df-4d76-b513-948d7715cb8b tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b774b20640b8413eac15565a7f624108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2966ce3ee7fe4d49ae177c6a3a415421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:51:26.701820 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-b2b08aa9-c8df-4d76-b513-948d7715cb8b tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] 10.222.0.58 "GET /compute/v2.1/servers/aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1" status: 200 len: 1318 microversion: 2.1 time: 0.158495 Aug 10 23:51:26.702416 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3110/6428] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:51:26 2022] GET /compute/v2.1/servers/aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:51:27.723719 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-53a46876-d153-4d0d-8696-f8d359ee7397 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:51:27.724350 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-53a46876-d153-4d0d-8696-f8d359ee7397 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] [instance: aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:51:27.732159 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-53a46876-d153-4d0d-8696-f8d359ee7397 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:51:27.732662 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-53a46876-d153-4d0d-8696-f8d359ee7397 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:51:27.733112 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-53a46876-d153-4d0d-8696-f8d359ee7397 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:51:27.733826 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-53a46876-d153-4d0d-8696-f8d359ee7397 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:51:27.734293 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-53a46876-d153-4d0d-8696-f8d359ee7397 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:51:27.734749 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-53a46876-d153-4d0d-8696-f8d359ee7397 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:51:27.870015 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-53a46876-d153-4d0d-8696-f8d359ee7397 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b774b20640b8413eac15565a7f624108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2966ce3ee7fe4d49ae177c6a3a415421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:51:27.879216 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-53a46876-d153-4d0d-8696-f8d359ee7397 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] 10.222.0.58 "GET /compute/v2.1/servers/aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1" status: 200 len: 1318 microversion: 2.1 time: 0.159609 Aug 10 23:51:27.880100 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3319/6429] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:51:27 2022] GET /compute/v2.1/servers/aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:51:28.901383 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-3a56dbdd-2ae3-4648-a2f0-494bb96634e0 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:51:28.901993 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-3a56dbdd-2ae3-4648-a2f0-494bb96634e0 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] [instance: aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:51:28.909012 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3a56dbdd-2ae3-4648-a2f0-494bb96634e0 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:51:28.909504 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3a56dbdd-2ae3-4648-a2f0-494bb96634e0 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:51:28.909944 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3a56dbdd-2ae3-4648-a2f0-494bb96634e0 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:51:28.910640 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3a56dbdd-2ae3-4648-a2f0-494bb96634e0 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:51:28.911116 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3a56dbdd-2ae3-4648-a2f0-494bb96634e0 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:51:28.911540 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3a56dbdd-2ae3-4648-a2f0-494bb96634e0 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:51:29.041954 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-3a56dbdd-2ae3-4648-a2f0-494bb96634e0 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b774b20640b8413eac15565a7f624108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2966ce3ee7fe4d49ae177c6a3a415421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:51:29.050139 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-3a56dbdd-2ae3-4648-a2f0-494bb96634e0 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] 10.222.0.58 "GET /compute/v2.1/servers/aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1" status: 200 len: 1318 microversion: 2.1 time: 0.152724 Aug 10 23:51:29.050718 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3111/6430] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:51:28 2022] GET /compute/v2.1/servers/aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:51:29.539094 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-3a9500f6-743b-405c-be6f-f2fef798989e req-9f1eaaa0-814a-4f09-9fa3-430ce95e7ed8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1", "name": "network-vif-plugged", "status": "completed", "tag": "c3181422-1f74-4128-82b8-2e27adadef4c"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:51:29.550870 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-3a9500f6-743b-405c-be6f-f2fef798989e req-9f1eaaa0-814a-4f09-9fa3-430ce95e7ed8 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:51:29.551368 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-3a9500f6-743b-405c-be6f-f2fef798989e req-9f1eaaa0-814a-4f09-9fa3-430ce95e7ed8 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:51:29.551841 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-3a9500f6-743b-405c-be6f-f2fef798989e req-9f1eaaa0-814a-4f09-9fa3-430ce95e7ed8 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:51:29.566173 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-3a9500f6-743b-405c-be6f-f2fef798989e req-9f1eaaa0-814a-4f09-9fa3-430ce95e7ed8 service nova] Creating event network-vif-plugged:c3181422-1f74-4128-82b8-2e27adadef4c for instance aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1 on n-h1-850468-14 Aug 10 23:51:29.571142 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-3a9500f6-743b-405c-be6f-f2fef798989e req-9f1eaaa0-814a-4f09-9fa3-430ce95e7ed8 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035885 Aug 10 23:51:29.571756 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3320/6431] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:51:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:51:30.071962 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-2c019d5e-5e81-4f1b-932b-c42b17b3fd8f tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:51:30.072580 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-2c019d5e-5e81-4f1b-932b-c42b17b3fd8f tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] [instance: aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:51:30.080302 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2c019d5e-5e81-4f1b-932b-c42b17b3fd8f tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:51:30.080791 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2c019d5e-5e81-4f1b-932b-c42b17b3fd8f tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:51:30.081229 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2c019d5e-5e81-4f1b-932b-c42b17b3fd8f tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:51:30.081931 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2c019d5e-5e81-4f1b-932b-c42b17b3fd8f tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:51:30.082386 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2c019d5e-5e81-4f1b-932b-c42b17b3fd8f tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:51:30.082832 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2c019d5e-5e81-4f1b-932b-c42b17b3fd8f tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:51:30.224042 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-2c019d5e-5e81-4f1b-932b-c42b17b3fd8f tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b774b20640b8413eac15565a7f624108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2966ce3ee7fe4d49ae177c6a3a415421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:51:30.232994 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-2c019d5e-5e81-4f1b-932b-c42b17b3fd8f tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] 10.222.0.58 "GET /compute/v2.1/servers/aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1" status: 200 len: 1318 microversion: 2.1 time: 0.165144 Aug 10 23:51:30.233668 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3112/6432] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:51:30 2022] GET /compute/v2.1/servers/aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1 => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:51:31.255863 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-8108a35d-95ff-48f8-b6a9-ddcb79fb894e tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:51:31.256575 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-8108a35d-95ff-48f8-b6a9-ddcb79fb894e tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] [instance: aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:51:31.264777 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8108a35d-95ff-48f8-b6a9-ddcb79fb894e tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:51:31.265283 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8108a35d-95ff-48f8-b6a9-ddcb79fb894e tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:51:31.265734 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8108a35d-95ff-48f8-b6a9-ddcb79fb894e tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:51:31.266450 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8108a35d-95ff-48f8-b6a9-ddcb79fb894e tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:51:31.267113 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8108a35d-95ff-48f8-b6a9-ddcb79fb894e tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:51:31.267551 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8108a35d-95ff-48f8-b6a9-ddcb79fb894e tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:51:31.431494 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-8108a35d-95ff-48f8-b6a9-ddcb79fb894e tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b774b20640b8413eac15565a7f624108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2966ce3ee7fe4d49ae177c6a3a415421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:51:31.439705 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-8108a35d-95ff-48f8-b6a9-ddcb79fb894e tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] 10.222.0.58 "GET /compute/v2.1/servers/aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1" status: 200 len: 1506 microversion: 2.1 time: 0.189021 Aug 10 23:51:31.440286 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3321/6433] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:51:31 2022] GET /compute/v2.1/servers/aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1 => generated 1506 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:51:31.460567 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-bee9e028-1030-4fd5-bfd7-f9f3a12810b8 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:51:31.461170 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-bee9e028-1030-4fd5-bfd7-f9f3a12810b8 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] [instance: aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:51:31.469334 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bee9e028-1030-4fd5-bfd7-f9f3a12810b8 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:51:31.469815 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bee9e028-1030-4fd5-bfd7-f9f3a12810b8 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:51:31.470253 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bee9e028-1030-4fd5-bfd7-f9f3a12810b8 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:51:31.470972 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bee9e028-1030-4fd5-bfd7-f9f3a12810b8 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:51:31.471417 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bee9e028-1030-4fd5-bfd7-f9f3a12810b8 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:51:31.471834 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bee9e028-1030-4fd5-bfd7-f9f3a12810b8 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:51:31.612603 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-bee9e028-1030-4fd5-bfd7-f9f3a12810b8 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b774b20640b8413eac15565a7f624108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2966ce3ee7fe4d49ae177c6a3a415421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:51:31.614983 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=72 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:51:31.622535 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-bee9e028-1030-4fd5-bfd7-f9f3a12810b8 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] 10.222.0.58 "GET /compute/v2.1/servers/aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1" status: 200 len: 1506 microversion: 2.1 time: 0.164999 Aug 10 23:51:31.623162 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3113/6434] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:51:31 2022] GET /compute/v2.1/servers/aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1 => generated 1506 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:51:31.644560 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-64584b5e-90ed-4849-9903-d9bfa3270c55 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:51:31.646976 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-64584b5e-90ed-4849-9903-d9bfa3270c55 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] [instance: aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:51:31.653067 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-64584b5e-90ed-4849-9903-d9bfa3270c55 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:51:31.653656 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-64584b5e-90ed-4849-9903-d9bfa3270c55 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:51:31.654111 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-64584b5e-90ed-4849-9903-d9bfa3270c55 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:51:31.654841 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-64584b5e-90ed-4849-9903-d9bfa3270c55 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:51:31.655312 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-64584b5e-90ed-4849-9903-d9bfa3270c55 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:51:31.655755 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-64584b5e-90ed-4849-9903-d9bfa3270c55 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:51:31.719607 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-64584b5e-90ed-4849-9903-d9bfa3270c55 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] 10.222.0.58 "PUT /compute/v2.1/servers/aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1" status: 200 len: 1078 microversion: 2.1 time: 0.078849 Aug 10 23:51:31.720234 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3322/6435] 10.222.0.58 () {60 vars in 1256 bytes} [Wed Aug 10 23:51:31 2022] PUT /compute/v2.1/servers/aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1 => generated 1078 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:51:31.741781 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-7a4ef59b-feef-46f2-bb19-4546dec5d69c tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:51:31.742424 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-7a4ef59b-feef-46f2-bb19-4546dec5d69c tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] [instance: aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:51:31.744383 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:51:31.752803 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7a4ef59b-feef-46f2-bb19-4546dec5d69c tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:51:31.753530 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7a4ef59b-feef-46f2-bb19-4546dec5d69c tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:51:31.754213 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7a4ef59b-feef-46f2-bb19-4546dec5d69c tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:51:31.755350 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7a4ef59b-feef-46f2-bb19-4546dec5d69c tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:51:31.756022 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7a4ef59b-feef-46f2-bb19-4546dec5d69c tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:51:31.756563 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7a4ef59b-feef-46f2-bb19-4546dec5d69c tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:51:31.832492 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=2 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:51:31.855618 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=6 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:51:31.896200 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-7a4ef59b-feef-46f2-bb19-4546dec5d69c tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b774b20640b8413eac15565a7f624108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2966ce3ee7fe4d49ae177c6a3a415421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:51:31.903872 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-7a4ef59b-feef-46f2-bb19-4546dec5d69c tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] 10.222.0.58 "GET /compute/v2.1/servers/aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1" status: 200 len: 1504 microversion: 2.1 time: 0.166095 Aug 10 23:51:31.904450 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3114/6436] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:51:31 2022] GET /compute/v2.1/servers/aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1 => generated 1504 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:51:31.923998 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c24fd827-386a-4a03-96b3-703d1c91ca64 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:51:31.924615 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-c24fd827-386a-4a03-96b3-703d1c91ca64 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] [instance: aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:51:31.930672 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c24fd827-386a-4a03-96b3-703d1c91ca64 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:51:31.931193 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c24fd827-386a-4a03-96b3-703d1c91ca64 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:51:31.931637 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c24fd827-386a-4a03-96b3-703d1c91ca64 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:51:31.932329 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c24fd827-386a-4a03-96b3-703d1c91ca64 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:51:31.932792 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c24fd827-386a-4a03-96b3-703d1c91ca64 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:51:31.933223 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c24fd827-386a-4a03-96b3-703d1c91ca64 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:51:31.996784 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=2 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:51:32.076194 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-c24fd827-386a-4a03-96b3-703d1c91ca64 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b774b20640b8413eac15565a7f624108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2966ce3ee7fe4d49ae177c6a3a415421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:51:32.087586 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-c24fd827-386a-4a03-96b3-703d1c91ca64 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] 10.222.0.58 "GET /compute/v2.1/servers/aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1" status: 200 len: 1504 microversion: 2.1 time: 0.167169 Aug 10 23:51:32.088458 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3323/6437] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:51:31 2022] GET /compute/v2.1/servers/aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1 => generated 1504 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:51:32.117175 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-fed222f1-ecba-40d2-b3d3-fd7ce9f1ec25 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:51:32.119654 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-fed222f1-ecba-40d2-b3d3-fd7ce9f1ec25 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] [instance: aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:51:32.126867 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fed222f1-ecba-40d2-b3d3-fd7ce9f1ec25 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:51:32.127356 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fed222f1-ecba-40d2-b3d3-fd7ce9f1ec25 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:51:32.127935 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fed222f1-ecba-40d2-b3d3-fd7ce9f1ec25 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:51:32.128645 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fed222f1-ecba-40d2-b3d3-fd7ce9f1ec25 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:51:32.129094 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fed222f1-ecba-40d2-b3d3-fd7ce9f1ec25 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:51:32.129515 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fed222f1-ecba-40d2-b3d3-fd7ce9f1ec25 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:51:32.158417 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-fed222f1-ecba-40d2-b3d3-fd7ce9f1ec25 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'b774b20640b8413eac15565a7f624108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2966ce3ee7fe4d49ae177c6a3a415421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:51:32.164530 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-fed222f1-ecba-40d2-b3d3-fd7ce9f1ec25 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] [instance: aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1] Old instance type m1.heat2, new instance type m1.heat {{(pid=122632) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 10 23:51:32.172031 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-fed222f1-ecba-40d2-b3d3-fd7ce9f1ec25 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Flavor limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:51:32.172452 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-fed222f1-ecba-40d2-b3d3-fd7ce9f1ec25 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Image limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:51:32.172922 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-fed222f1-ecba-40d2-b3d3-fd7ce9f1ec25 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Flavor pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:51:32.173335 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-fed222f1-ecba-40d2-b3d3-fd7ce9f1ec25 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Image pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:51:32.173746 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-fed222f1-ecba-40d2-b3d3-fd7ce9f1ec25 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:51:32.240398 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-fed222f1-ecba-40d2-b3d3-fd7ce9f1ec25 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] 10.222.0.58 "POST /compute/v2.1/servers/aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1/action" status: 202 len: 0 microversion: 2.1 time: 0.127208 Aug 10 23:51:32.241402 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3115/6438] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:51:32 2022] POST /compute/v2.1/servers/aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:51:32.250454 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-ad14fa4e-abe2-4c89-9956-8cc2f45c4d1d tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:51:32.251356 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-ad14fa4e-abe2-4c89-9956-8cc2f45c4d1d tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] [instance: aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:51:32.258367 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ad14fa4e-abe2-4c89-9956-8cc2f45c4d1d tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:51:32.259501 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ad14fa4e-abe2-4c89-9956-8cc2f45c4d1d tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:51:32.260168 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ad14fa4e-abe2-4c89-9956-8cc2f45c4d1d tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:51:32.261145 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ad14fa4e-abe2-4c89-9956-8cc2f45c4d1d tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:51:32.261696 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ad14fa4e-abe2-4c89-9956-8cc2f45c4d1d tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:51:32.262214 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ad14fa4e-abe2-4c89-9956-8cc2f45c4d1d tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:51:32.447030 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-ad14fa4e-abe2-4c89-9956-8cc2f45c4d1d tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b774b20640b8413eac15565a7f624108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2966ce3ee7fe4d49ae177c6a3a415421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:51:32.460936 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-ad14fa4e-abe2-4c89-9956-8cc2f45c4d1d tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] 10.222.0.58 "GET /compute/v2.1/servers/aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1" status: 200 len: 1515 microversion: 2.1 time: 0.213951 Aug 10 23:51:32.475326 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3324/6439] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:51:32 2022] GET /compute/v2.1/servers/aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1 => generated 1515 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:51:33.492148 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-d93d37f9-55f7-4be6-bab4-c6f4f886ff56 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:51:33.492762 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-d93d37f9-55f7-4be6-bab4-c6f4f886ff56 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] [instance: aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:51:33.499914 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d93d37f9-55f7-4be6-bab4-c6f4f886ff56 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:51:33.500398 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d93d37f9-55f7-4be6-bab4-c6f4f886ff56 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:51:33.500840 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d93d37f9-55f7-4be6-bab4-c6f4f886ff56 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:51:33.501537 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d93d37f9-55f7-4be6-bab4-c6f4f886ff56 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:51:33.501988 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d93d37f9-55f7-4be6-bab4-c6f4f886ff56 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:51:33.502410 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d93d37f9-55f7-4be6-bab4-c6f4f886ff56 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:51:33.636191 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-d93d37f9-55f7-4be6-bab4-c6f4f886ff56 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b774b20640b8413eac15565a7f624108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2966ce3ee7fe4d49ae177c6a3a415421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:51:33.644693 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-d93d37f9-55f7-4be6-bab4-c6f4f886ff56 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] 10.222.0.58 "GET /compute/v2.1/servers/aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1" status: 200 len: 1515 microversion: 2.1 time: 0.156613 Aug 10 23:51:33.645312 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3116/6440] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:51:33 2022] GET /compute/v2.1/servers/aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1 => generated 1515 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:51:34.667137 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-fd113b07-00f8-4d29-b3eb-033b26512abd tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:51:34.667765 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-fd113b07-00f8-4d29-b3eb-033b26512abd tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] [instance: aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:51:34.671315 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:51:34.676584 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fd113b07-00f8-4d29-b3eb-033b26512abd tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:51:34.677081 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fd113b07-00f8-4d29-b3eb-033b26512abd tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:51:34.677543 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fd113b07-00f8-4d29-b3eb-033b26512abd tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:51:34.678253 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fd113b07-00f8-4d29-b3eb-033b26512abd tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:51:34.678729 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fd113b07-00f8-4d29-b3eb-033b26512abd tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:51:34.679197 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fd113b07-00f8-4d29-b3eb-033b26512abd tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:51:34.811451 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-fd113b07-00f8-4d29-b3eb-033b26512abd tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b774b20640b8413eac15565a7f624108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2966ce3ee7fe4d49ae177c6a3a415421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:51:34.818994 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-fd113b07-00f8-4d29-b3eb-033b26512abd tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] 10.222.0.58 "GET /compute/v2.1/servers/aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1" status: 200 len: 1520 microversion: 2.1 time: 0.155725 Aug 10 23:51:34.819571 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3325/6441] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:51:34 2022] GET /compute/v2.1/servers/aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:51:35.840898 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-402ae35c-f8cd-4c71-bc1b-1dba29d7fc14 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:51:35.842253 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-402ae35c-f8cd-4c71-bc1b-1dba29d7fc14 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] [instance: aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:51:35.849220 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-402ae35c-f8cd-4c71-bc1b-1dba29d7fc14 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:51:35.849701 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-402ae35c-f8cd-4c71-bc1b-1dba29d7fc14 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:51:35.850136 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-402ae35c-f8cd-4c71-bc1b-1dba29d7fc14 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:51:35.850848 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-402ae35c-f8cd-4c71-bc1b-1dba29d7fc14 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:51:35.851303 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-402ae35c-f8cd-4c71-bc1b-1dba29d7fc14 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:51:35.851726 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-402ae35c-f8cd-4c71-bc1b-1dba29d7fc14 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:51:35.990244 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-402ae35c-f8cd-4c71-bc1b-1dba29d7fc14 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b774b20640b8413eac15565a7f624108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2966ce3ee7fe4d49ae177c6a3a415421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:51:35.998239 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-402ae35c-f8cd-4c71-bc1b-1dba29d7fc14 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] 10.222.0.58 "GET /compute/v2.1/servers/aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1" status: 200 len: 1520 microversion: 2.1 time: 0.161211 Aug 10 23:51:35.998834 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3117/6442] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:51:35 2022] GET /compute/v2.1/servers/aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1 => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:51:37.019590 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-4e2bab62-379e-49f1-8bef-28d76179c333 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:51:37.020217 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-4e2bab62-379e-49f1-8bef-28d76179c333 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] [instance: aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:51:37.027546 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4e2bab62-379e-49f1-8bef-28d76179c333 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:51:37.028035 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4e2bab62-379e-49f1-8bef-28d76179c333 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:51:37.028492 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4e2bab62-379e-49f1-8bef-28d76179c333 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:51:37.029693 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4e2bab62-379e-49f1-8bef-28d76179c333 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:51:37.030164 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4e2bab62-379e-49f1-8bef-28d76179c333 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:51:37.030603 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4e2bab62-379e-49f1-8bef-28d76179c333 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:51:37.166563 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-4e2bab62-379e-49f1-8bef-28d76179c333 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b774b20640b8413eac15565a7f624108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2966ce3ee7fe4d49ae177c6a3a415421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:51:37.174716 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-4e2bab62-379e-49f1-8bef-28d76179c333 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] 10.222.0.58 "GET /compute/v2.1/servers/aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1" status: 200 len: 1520 microversion: 2.1 time: 0.159037 Aug 10 23:51:37.175331 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3326/6443] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:51:37 2022] GET /compute/v2.1/servers/aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1 => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:51:38.195884 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-85c05201-f992-4f20-911a-0afdab803df6 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:51:38.196494 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-85c05201-f992-4f20-911a-0afdab803df6 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] [instance: aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:51:38.203951 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-85c05201-f992-4f20-911a-0afdab803df6 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:51:38.204438 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-85c05201-f992-4f20-911a-0afdab803df6 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:51:38.204872 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-85c05201-f992-4f20-911a-0afdab803df6 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:51:38.205559 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-85c05201-f992-4f20-911a-0afdab803df6 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:51:38.206009 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-85c05201-f992-4f20-911a-0afdab803df6 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:51:38.206432 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-85c05201-f992-4f20-911a-0afdab803df6 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:51:38.337983 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-85c05201-f992-4f20-911a-0afdab803df6 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b774b20640b8413eac15565a7f624108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2966ce3ee7fe4d49ae177c6a3a415421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:51:38.346532 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-85c05201-f992-4f20-911a-0afdab803df6 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] 10.222.0.58 "GET /compute/v2.1/servers/aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1" status: 200 len: 1520 microversion: 2.1 time: 0.154426 Aug 10 23:51:38.347088 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3118/6444] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:51:38 2022] GET /compute/v2.1/servers/aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:51:39.367849 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-df769c1b-c1f4-4a92-a7b9-5d2928233fdb tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:51:39.368472 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-df769c1b-c1f4-4a92-a7b9-5d2928233fdb tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] [instance: aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:51:39.376140 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-df769c1b-c1f4-4a92-a7b9-5d2928233fdb tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:51:39.376633 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-df769c1b-c1f4-4a92-a7b9-5d2928233fdb tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:51:39.377082 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-df769c1b-c1f4-4a92-a7b9-5d2928233fdb tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:51:39.377784 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-df769c1b-c1f4-4a92-a7b9-5d2928233fdb tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:51:39.378246 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-df769c1b-c1f4-4a92-a7b9-5d2928233fdb tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:51:39.378680 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-df769c1b-c1f4-4a92-a7b9-5d2928233fdb tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:51:39.510144 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-df769c1b-c1f4-4a92-a7b9-5d2928233fdb tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b774b20640b8413eac15565a7f624108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2966ce3ee7fe4d49ae177c6a3a415421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:51:39.518312 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-df769c1b-c1f4-4a92-a7b9-5d2928233fdb tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] 10.222.0.58 "GET /compute/v2.1/servers/aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1" status: 200 len: 1520 microversion: 2.1 time: 0.154231 Aug 10 23:51:39.518989 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3327/6445] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:51:39 2022] GET /compute/v2.1/servers/aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:51:40.538591 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-6013b97e-a36a-4a73-aa36-4b1be43047bb tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:51:40.539255 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-6013b97e-a36a-4a73-aa36-4b1be43047bb tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] [instance: aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:51:40.546475 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6013b97e-a36a-4a73-aa36-4b1be43047bb tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:51:40.547001 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6013b97e-a36a-4a73-aa36-4b1be43047bb tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:51:40.547443 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6013b97e-a36a-4a73-aa36-4b1be43047bb tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:51:40.548137 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6013b97e-a36a-4a73-aa36-4b1be43047bb tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:51:40.548595 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6013b97e-a36a-4a73-aa36-4b1be43047bb tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:51:40.549024 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6013b97e-a36a-4a73-aa36-4b1be43047bb tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:51:40.677586 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-6013b97e-a36a-4a73-aa36-4b1be43047bb tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b774b20640b8413eac15565a7f624108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2966ce3ee7fe4d49ae177c6a3a415421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:51:40.685751 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-6013b97e-a36a-4a73-aa36-4b1be43047bb tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] 10.222.0.58 "GET /compute/v2.1/servers/aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1" status: 200 len: 1520 microversion: 2.1 time: 0.150485 Aug 10 23:51:40.686971 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3119/6446] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:51:40 2022] GET /compute/v2.1/servers/aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:51:41.708194 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-5d20e006-eeff-4d0f-b659-22c1e6661dc9 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:51:41.708783 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-5d20e006-eeff-4d0f-b659-22c1e6661dc9 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] [instance: aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:51:41.715760 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5d20e006-eeff-4d0f-b659-22c1e6661dc9 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:51:41.716255 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5d20e006-eeff-4d0f-b659-22c1e6661dc9 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:51:41.716707 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5d20e006-eeff-4d0f-b659-22c1e6661dc9 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:51:41.717415 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5d20e006-eeff-4d0f-b659-22c1e6661dc9 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:51:41.717883 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5d20e006-eeff-4d0f-b659-22c1e6661dc9 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:51:41.718326 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5d20e006-eeff-4d0f-b659-22c1e6661dc9 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:51:41.857395 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-5d20e006-eeff-4d0f-b659-22c1e6661dc9 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b774b20640b8413eac15565a7f624108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2966ce3ee7fe4d49ae177c6a3a415421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:51:41.866722 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-5d20e006-eeff-4d0f-b659-22c1e6661dc9 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] 10.222.0.58 "GET /compute/v2.1/servers/aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1" status: 200 len: 1520 microversion: 2.1 time: 0.162459 Aug 10 23:51:41.867346 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3328/6447] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:51:41 2022] GET /compute/v2.1/servers/aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1 => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:51:42.888101 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-ab3f1aab-ee97-4e5b-9469-5a5fda89bdb0 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:51:42.888710 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-ab3f1aab-ee97-4e5b-9469-5a5fda89bdb0 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] [instance: aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:51:42.896145 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ab3f1aab-ee97-4e5b-9469-5a5fda89bdb0 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:51:42.896643 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ab3f1aab-ee97-4e5b-9469-5a5fda89bdb0 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:51:42.897082 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ab3f1aab-ee97-4e5b-9469-5a5fda89bdb0 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:51:42.897777 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ab3f1aab-ee97-4e5b-9469-5a5fda89bdb0 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:51:42.898235 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ab3f1aab-ee97-4e5b-9469-5a5fda89bdb0 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:51:42.898658 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ab3f1aab-ee97-4e5b-9469-5a5fda89bdb0 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:51:43.035838 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-ab3f1aab-ee97-4e5b-9469-5a5fda89bdb0 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b774b20640b8413eac15565a7f624108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2966ce3ee7fe4d49ae177c6a3a415421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:51:43.044371 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-ab3f1aab-ee97-4e5b-9469-5a5fda89bdb0 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] 10.222.0.58 "GET /compute/v2.1/servers/aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1" status: 200 len: 1520 microversion: 2.1 time: 0.160116 Aug 10 23:51:43.044990 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3120/6448] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:51:42 2022] GET /compute/v2.1/servers/aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1 => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:51:44.066614 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-87a431f6-0438-4052-9734-4d97c5389fec tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:51:44.067292 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-87a431f6-0438-4052-9734-4d97c5389fec tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] [instance: aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:51:44.074585 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-87a431f6-0438-4052-9734-4d97c5389fec tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:51:44.075109 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-87a431f6-0438-4052-9734-4d97c5389fec tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:51:44.075554 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-87a431f6-0438-4052-9734-4d97c5389fec tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:51:44.076248 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-87a431f6-0438-4052-9734-4d97c5389fec tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:51:44.076704 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-87a431f6-0438-4052-9734-4d97c5389fec tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:51:44.077141 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-87a431f6-0438-4052-9734-4d97c5389fec tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:51:44.210415 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-87a431f6-0438-4052-9734-4d97c5389fec tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b774b20640b8413eac15565a7f624108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2966ce3ee7fe4d49ae177c6a3a415421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:51:44.218029 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-87a431f6-0438-4052-9734-4d97c5389fec tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] 10.222.0.58 "GET /compute/v2.1/servers/aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1" status: 200 len: 1520 microversion: 2.1 time: 0.156409 Aug 10 23:51:44.218592 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3329/6449] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:51:44 2022] GET /compute/v2.1/servers/aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:51:45.239353 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-9585b649-006b-4d30-b8a9-275247abe76c tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:51:45.239961 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-9585b649-006b-4d30-b8a9-275247abe76c tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] [instance: aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:51:45.247186 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9585b649-006b-4d30-b8a9-275247abe76c tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:51:45.247668 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9585b649-006b-4d30-b8a9-275247abe76c tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:51:45.248103 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9585b649-006b-4d30-b8a9-275247abe76c tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:51:45.248786 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9585b649-006b-4d30-b8a9-275247abe76c tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:51:45.249239 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9585b649-006b-4d30-b8a9-275247abe76c tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:51:45.249661 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9585b649-006b-4d30-b8a9-275247abe76c tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:51:45.381144 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-9585b649-006b-4d30-b8a9-275247abe76c tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b774b20640b8413eac15565a7f624108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2966ce3ee7fe4d49ae177c6a3a415421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:51:45.388731 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-9585b649-006b-4d30-b8a9-275247abe76c tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] 10.222.0.58 "GET /compute/v2.1/servers/aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1" status: 200 len: 1520 microversion: 2.1 time: 0.153368 Aug 10 23:51:45.389299 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3121/6450] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:51:45 2022] GET /compute/v2.1/servers/aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:51:46.410176 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-46e3e367-9c8d-47c2-ad2f-a4d7875c3a22 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:51:46.410813 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-46e3e367-9c8d-47c2-ad2f-a4d7875c3a22 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] [instance: aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:51:46.417646 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-46e3e367-9c8d-47c2-ad2f-a4d7875c3a22 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:51:46.418143 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-46e3e367-9c8d-47c2-ad2f-a4d7875c3a22 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:51:46.418592 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-46e3e367-9c8d-47c2-ad2f-a4d7875c3a22 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:51:46.419333 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-46e3e367-9c8d-47c2-ad2f-a4d7875c3a22 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:51:46.419800 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-46e3e367-9c8d-47c2-ad2f-a4d7875c3a22 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:51:46.420232 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-46e3e367-9c8d-47c2-ad2f-a4d7875c3a22 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:51:46.562860 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-46e3e367-9c8d-47c2-ad2f-a4d7875c3a22 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b774b20640b8413eac15565a7f624108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2966ce3ee7fe4d49ae177c6a3a415421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:51:46.570766 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-46e3e367-9c8d-47c2-ad2f-a4d7875c3a22 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] 10.222.0.58 "GET /compute/v2.1/servers/aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1" status: 200 len: 1520 microversion: 2.1 time: 0.165121 Aug 10 23:51:46.571382 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3330/6451] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:51:46 2022] GET /compute/v2.1/servers/aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1 => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:51:47.592490 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-e90079bc-2164-4d76-bc3a-9f830cb59cad tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:51:47.593106 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-e90079bc-2164-4d76-bc3a-9f830cb59cad tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] [instance: aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:51:47.600162 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e90079bc-2164-4d76-bc3a-9f830cb59cad tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:51:47.600592 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e90079bc-2164-4d76-bc3a-9f830cb59cad tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:51:47.601035 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e90079bc-2164-4d76-bc3a-9f830cb59cad tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:51:47.601743 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e90079bc-2164-4d76-bc3a-9f830cb59cad tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:51:47.602196 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e90079bc-2164-4d76-bc3a-9f830cb59cad tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:51:47.602620 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e90079bc-2164-4d76-bc3a-9f830cb59cad tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:51:47.739481 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-e90079bc-2164-4d76-bc3a-9f830cb59cad tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b774b20640b8413eac15565a7f624108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2966ce3ee7fe4d49ae177c6a3a415421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:51:47.747284 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-e90079bc-2164-4d76-bc3a-9f830cb59cad tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] 10.222.0.58 "GET /compute/v2.1/servers/aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1" status: 200 len: 1520 microversion: 2.1 time: 0.158524 Aug 10 23:51:47.747862 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3122/6452] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:51:47 2022] GET /compute/v2.1/servers/aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1 => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:51:48.769324 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-738bf1c8-3c24-45e5-937a-03cfcfc41914 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:51:48.769948 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-738bf1c8-3c24-45e5-937a-03cfcfc41914 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] [instance: aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:51:48.776752 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-738bf1c8-3c24-45e5-937a-03cfcfc41914 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:51:48.777246 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-738bf1c8-3c24-45e5-937a-03cfcfc41914 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:51:48.777696 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-738bf1c8-3c24-45e5-937a-03cfcfc41914 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:51:48.778408 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-738bf1c8-3c24-45e5-937a-03cfcfc41914 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:51:48.778905 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-738bf1c8-3c24-45e5-937a-03cfcfc41914 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:51:48.779375 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-738bf1c8-3c24-45e5-937a-03cfcfc41914 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:51:48.911493 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-738bf1c8-3c24-45e5-937a-03cfcfc41914 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b774b20640b8413eac15565a7f624108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2966ce3ee7fe4d49ae177c6a3a415421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:51:48.919094 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-738bf1c8-3c24-45e5-937a-03cfcfc41914 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] 10.222.0.58 "GET /compute/v2.1/servers/aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1" status: 200 len: 1520 microversion: 2.1 time: 0.154446 Aug 10 23:51:48.919671 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3331/6453] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:51:48 2022] GET /compute/v2.1/servers/aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:51:49.941172 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c3f8ca12-477b-485c-85d9-6cfc55bfe888 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:51:49.941786 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-c3f8ca12-477b-485c-85d9-6cfc55bfe888 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] [instance: aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:51:49.948383 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c3f8ca12-477b-485c-85d9-6cfc55bfe888 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:51:49.948865 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c3f8ca12-477b-485c-85d9-6cfc55bfe888 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:51:49.949304 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c3f8ca12-477b-485c-85d9-6cfc55bfe888 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:51:49.949995 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c3f8ca12-477b-485c-85d9-6cfc55bfe888 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:51:49.950442 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c3f8ca12-477b-485c-85d9-6cfc55bfe888 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:51:49.950922 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c3f8ca12-477b-485c-85d9-6cfc55bfe888 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:51:50.085139 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-c3f8ca12-477b-485c-85d9-6cfc55bfe888 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b774b20640b8413eac15565a7f624108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2966ce3ee7fe4d49ae177c6a3a415421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:51:50.092616 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-c3f8ca12-477b-485c-85d9-6cfc55bfe888 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] 10.222.0.58 "GET /compute/v2.1/servers/aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1" status: 200 len: 1520 microversion: 2.1 time: 0.156406 Aug 10 23:51:50.093186 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3123/6454] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:51:49 2022] GET /compute/v2.1/servers/aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:51:51.114639 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-dac497d7-a11d-4e38-9213-f0c6b08a4d89 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:51:51.115298 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-dac497d7-a11d-4e38-9213-f0c6b08a4d89 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] [instance: aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:51:51.122294 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dac497d7-a11d-4e38-9213-f0c6b08a4d89 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:51:51.122800 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dac497d7-a11d-4e38-9213-f0c6b08a4d89 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:51:51.123242 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dac497d7-a11d-4e38-9213-f0c6b08a4d89 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:51:51.123933 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dac497d7-a11d-4e38-9213-f0c6b08a4d89 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:51:51.124394 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dac497d7-a11d-4e38-9213-f0c6b08a4d89 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:51:51.124825 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dac497d7-a11d-4e38-9213-f0c6b08a4d89 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:51:51.257878 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-dac497d7-a11d-4e38-9213-f0c6b08a4d89 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b774b20640b8413eac15565a7f624108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2966ce3ee7fe4d49ae177c6a3a415421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:51:51.265391 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-dac497d7-a11d-4e38-9213-f0c6b08a4d89 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] 10.222.0.58 "GET /compute/v2.1/servers/aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1" status: 200 len: 1520 microversion: 2.1 time: 0.155122 Aug 10 23:51:51.265979 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3332/6455] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:51:51 2022] GET /compute/v2.1/servers/aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:51:52.287658 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-4f5cb472-b87f-4978-ad57-6d0a36875684 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:51:52.288277 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-4f5cb472-b87f-4978-ad57-6d0a36875684 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] [instance: aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:51:52.295130 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4f5cb472-b87f-4978-ad57-6d0a36875684 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:51:52.295615 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4f5cb472-b87f-4978-ad57-6d0a36875684 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:51:52.296055 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4f5cb472-b87f-4978-ad57-6d0a36875684 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:51:52.296751 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4f5cb472-b87f-4978-ad57-6d0a36875684 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:51:52.297206 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4f5cb472-b87f-4978-ad57-6d0a36875684 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:51:52.297632 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4f5cb472-b87f-4978-ad57-6d0a36875684 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:51:52.430629 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-4f5cb472-b87f-4978-ad57-6d0a36875684 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b774b20640b8413eac15565a7f624108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2966ce3ee7fe4d49ae177c6a3a415421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:51:52.438158 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-4f5cb472-b87f-4978-ad57-6d0a36875684 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] 10.222.0.58 "GET /compute/v2.1/servers/aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1" status: 200 len: 1520 microversion: 2.1 time: 0.154390 Aug 10 23:51:52.438741 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3124/6456] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:51:52 2022] GET /compute/v2.1/servers/aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:51:53.459742 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-da3f142a-3c3d-42d1-9066-8ab3d6ea229f tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:51:53.460356 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-da3f142a-3c3d-42d1-9066-8ab3d6ea229f tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] [instance: aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:51:53.467495 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-da3f142a-3c3d-42d1-9066-8ab3d6ea229f tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:51:53.467981 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-da3f142a-3c3d-42d1-9066-8ab3d6ea229f tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:51:53.468423 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-da3f142a-3c3d-42d1-9066-8ab3d6ea229f tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:51:53.469120 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-da3f142a-3c3d-42d1-9066-8ab3d6ea229f tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:51:53.469577 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-da3f142a-3c3d-42d1-9066-8ab3d6ea229f tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:51:53.470008 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-da3f142a-3c3d-42d1-9066-8ab3d6ea229f tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:51:53.489271 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:51:53.607761 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-da3f142a-3c3d-42d1-9066-8ab3d6ea229f tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b774b20640b8413eac15565a7f624108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2966ce3ee7fe4d49ae177c6a3a415421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:51:53.616001 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-da3f142a-3c3d-42d1-9066-8ab3d6ea229f tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] 10.222.0.58 "GET /compute/v2.1/servers/aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1" status: 200 len: 1520 microversion: 2.1 time: 0.160073 Aug 10 23:51:53.616581 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3333/6457] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:51:53 2022] GET /compute/v2.1/servers/aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1 => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:51:54.637456 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-22114cec-cff8-469a-ad7c-c1a546460914 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:51:54.638069 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-22114cec-cff8-469a-ad7c-c1a546460914 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] [instance: aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:51:54.646125 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-22114cec-cff8-469a-ad7c-c1a546460914 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:51:54.646642 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-22114cec-cff8-469a-ad7c-c1a546460914 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:51:54.647110 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-22114cec-cff8-469a-ad7c-c1a546460914 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:51:54.647807 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-22114cec-cff8-469a-ad7c-c1a546460914 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:51:54.648901 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-22114cec-cff8-469a-ad7c-c1a546460914 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:51:54.648901 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-22114cec-cff8-469a-ad7c-c1a546460914 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:51:54.783708 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-22114cec-cff8-469a-ad7c-c1a546460914 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b774b20640b8413eac15565a7f624108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2966ce3ee7fe4d49ae177c6a3a415421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:51:54.791315 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-22114cec-cff8-469a-ad7c-c1a546460914 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] 10.222.0.58 "GET /compute/v2.1/servers/aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1" status: 200 len: 1520 microversion: 2.1 time: 0.157753 Aug 10 23:51:54.791896 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3125/6458] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:51:54 2022] GET /compute/v2.1/servers/aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:51:55.812998 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-a239e5e2-e6c3-4742-9bdf-9e7f6cfc54fa tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:51:55.813620 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-a239e5e2-e6c3-4742-9bdf-9e7f6cfc54fa tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] [instance: aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:51:55.820682 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a239e5e2-e6c3-4742-9bdf-9e7f6cfc54fa tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:51:55.821161 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a239e5e2-e6c3-4742-9bdf-9e7f6cfc54fa tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:51:55.821611 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a239e5e2-e6c3-4742-9bdf-9e7f6cfc54fa tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:51:55.822312 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a239e5e2-e6c3-4742-9bdf-9e7f6cfc54fa tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:51:55.822802 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a239e5e2-e6c3-4742-9bdf-9e7f6cfc54fa tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:51:55.823238 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a239e5e2-e6c3-4742-9bdf-9e7f6cfc54fa tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:51:55.952826 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-a239e5e2-e6c3-4742-9bdf-9e7f6cfc54fa tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b774b20640b8413eac15565a7f624108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2966ce3ee7fe4d49ae177c6a3a415421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:51:55.961596 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-a239e5e2-e6c3-4742-9bdf-9e7f6cfc54fa tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] 10.222.0.58 "GET /compute/v2.1/servers/aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1" status: 200 len: 1520 microversion: 2.1 time: 0.152506 Aug 10 23:51:55.962176 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3334/6459] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:51:55 2022] GET /compute/v2.1/servers/aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:51:56.983100 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-516bb194-eeaf-4c82-a6d3-43a971989f79 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:51:56.983765 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-516bb194-eeaf-4c82-a6d3-43a971989f79 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] [instance: aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:51:56.991280 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-516bb194-eeaf-4c82-a6d3-43a971989f79 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:51:56.991768 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-516bb194-eeaf-4c82-a6d3-43a971989f79 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:51:56.992209 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-516bb194-eeaf-4c82-a6d3-43a971989f79 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:51:56.992900 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-516bb194-eeaf-4c82-a6d3-43a971989f79 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:51:56.993357 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-516bb194-eeaf-4c82-a6d3-43a971989f79 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:51:56.993803 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-516bb194-eeaf-4c82-a6d3-43a971989f79 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:51:57.125851 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-516bb194-eeaf-4c82-a6d3-43a971989f79 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b774b20640b8413eac15565a7f624108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2966ce3ee7fe4d49ae177c6a3a415421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:51:57.133734 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-516bb194-eeaf-4c82-a6d3-43a971989f79 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] 10.222.0.58 "GET /compute/v2.1/servers/aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1" status: 200 len: 1520 microversion: 2.1 time: 0.154571 Aug 10 23:51:57.134310 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3126/6460] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:51:56 2022] GET /compute/v2.1/servers/aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:51:58.155659 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-654d5025-8d8e-4127-bd70-140eabe3b89d tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:51:58.156274 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-654d5025-8d8e-4127-bd70-140eabe3b89d tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] [instance: aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:51:58.164247 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-654d5025-8d8e-4127-bd70-140eabe3b89d tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:51:58.164731 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-654d5025-8d8e-4127-bd70-140eabe3b89d tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:51:58.165172 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-654d5025-8d8e-4127-bd70-140eabe3b89d tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:51:58.165861 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-654d5025-8d8e-4127-bd70-140eabe3b89d tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:51:58.166317 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-654d5025-8d8e-4127-bd70-140eabe3b89d tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:51:58.166742 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-654d5025-8d8e-4127-bd70-140eabe3b89d tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:51:58.300694 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-654d5025-8d8e-4127-bd70-140eabe3b89d tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b774b20640b8413eac15565a7f624108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2966ce3ee7fe4d49ae177c6a3a415421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:51:58.308398 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-654d5025-8d8e-4127-bd70-140eabe3b89d tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] 10.222.0.58 "GET /compute/v2.1/servers/aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1" status: 200 len: 1520 microversion: 2.1 time: 0.156711 Aug 10 23:51:58.308969 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3335/6461] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:51:58 2022] GET /compute/v2.1/servers/aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:51:59.329830 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-0651e0e4-15be-4034-8a2d-3446fef06c7d tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:51:59.330718 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-0651e0e4-15be-4034-8a2d-3446fef06c7d tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] [instance: aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:51:59.337809 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0651e0e4-15be-4034-8a2d-3446fef06c7d tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:51:59.338298 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0651e0e4-15be-4034-8a2d-3446fef06c7d tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:51:59.338736 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0651e0e4-15be-4034-8a2d-3446fef06c7d tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:51:59.339473 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0651e0e4-15be-4034-8a2d-3446fef06c7d tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:51:59.339924 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0651e0e4-15be-4034-8a2d-3446fef06c7d tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:51:59.340346 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0651e0e4-15be-4034-8a2d-3446fef06c7d tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:51:59.483146 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-0651e0e4-15be-4034-8a2d-3446fef06c7d tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b774b20640b8413eac15565a7f624108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2966ce3ee7fe4d49ae177c6a3a415421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:51:59.491364 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-0651e0e4-15be-4034-8a2d-3446fef06c7d tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] 10.222.0.58 "GET /compute/v2.1/servers/aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1" status: 200 len: 1520 microversion: 2.1 time: 0.165613 Aug 10 23:51:59.491941 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3127/6462] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:51:59 2022] GET /compute/v2.1/servers/aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1 => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:52:00.513301 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-b1a1bdf0-77ac-42d4-92e9-fa2c53c1105a tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:52:00.513837 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-b1a1bdf0-77ac-42d4-92e9-fa2c53c1105a tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] [instance: aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:52:00.521565 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b1a1bdf0-77ac-42d4-92e9-fa2c53c1105a tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:52:00.522068 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b1a1bdf0-77ac-42d4-92e9-fa2c53c1105a tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:52:00.522518 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b1a1bdf0-77ac-42d4-92e9-fa2c53c1105a tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:52:00.523265 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b1a1bdf0-77ac-42d4-92e9-fa2c53c1105a tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:52:00.523732 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b1a1bdf0-77ac-42d4-92e9-fa2c53c1105a tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:52:00.524175 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b1a1bdf0-77ac-42d4-92e9-fa2c53c1105a tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:52:00.655619 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-b1a1bdf0-77ac-42d4-92e9-fa2c53c1105a tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b774b20640b8413eac15565a7f624108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2966ce3ee7fe4d49ae177c6a3a415421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:52:00.663462 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-b1a1bdf0-77ac-42d4-92e9-fa2c53c1105a tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] 10.222.0.58 "GET /compute/v2.1/servers/aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1" status: 200 len: 1520 microversion: 2.1 time: 0.154284 Aug 10 23:52:00.664045 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3336/6463] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:52:00 2022] GET /compute/v2.1/servers/aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:52:01.570115 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-d085be5f-8284-4170-84eb-756c044bcab0 req-187341ca-6a6f-4bb7-b204-bae4eaf0522e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1", "name": "network-vif-unplugged", "status": "completed", "tag": "c3181422-1f74-4128-82b8-2e27adadef4c"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:52:01.580734 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-d085be5f-8284-4170-84eb-756c044bcab0 req-187341ca-6a6f-4bb7-b204-bae4eaf0522e service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:52:01.581384 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-d085be5f-8284-4170-84eb-756c044bcab0 req-187341ca-6a6f-4bb7-b204-bae4eaf0522e service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:52:01.581882 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-d085be5f-8284-4170-84eb-756c044bcab0 req-187341ca-6a6f-4bb7-b204-bae4eaf0522e service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:52:01.594478 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-d085be5f-8284-4170-84eb-756c044bcab0 req-187341ca-6a6f-4bb7-b204-bae4eaf0522e service nova] Creating event network-vif-unplugged:c3181422-1f74-4128-82b8-2e27adadef4c for instance aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1 on n-h2-850468-14 Aug 10 23:52:01.600725 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [req-d085be5f-8284-4170-84eb-756c044bcab0 req-187341ca-6a6f-4bb7-b204-bae4eaf0522e service nova] Instance aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-850468-14', 'n-h2-850468-14'} {{(pid=122632) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5901}} Aug 10 23:52:01.613551 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-d085be5f-8284-4170-84eb-756c044bcab0 req-187341ca-6a6f-4bb7-b204-bae4eaf0522e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047155 Aug 10 23:52:01.614404 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3128/6464] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:52:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:52:01.685408 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c160d0e7-d0b4-453c-868b-632051e77534 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:52:01.686710 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-c160d0e7-d0b4-453c-868b-632051e77534 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] [instance: aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:52:01.695500 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c160d0e7-d0b4-453c-868b-632051e77534 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:52:01.696635 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c160d0e7-d0b4-453c-868b-632051e77534 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:52:01.697135 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c160d0e7-d0b4-453c-868b-632051e77534 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:52:01.697969 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c160d0e7-d0b4-453c-868b-632051e77534 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:52:01.698446 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c160d0e7-d0b4-453c-868b-632051e77534 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:52:01.698925 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c160d0e7-d0b4-453c-868b-632051e77534 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:52:01.957562 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-c160d0e7-d0b4-453c-868b-632051e77534 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b774b20640b8413eac15565a7f624108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2966ce3ee7fe4d49ae177c6a3a415421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:52:01.965293 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-c160d0e7-d0b4-453c-868b-632051e77534 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] 10.222.0.58 "GET /compute/v2.1/servers/aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1" status: 200 len: 1519 microversion: 2.1 time: 0.284151 Aug 10 23:52:01.965889 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3337/6465] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:52:01 2022] GET /compute/v2.1/servers/aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1 => generated 1519 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:52:02.990182 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-ff515078-d6f9-427e-be0c-2022a1413031 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:52:02.990893 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-ff515078-d6f9-427e-be0c-2022a1413031 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] [instance: aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:52:02.992807 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_api:SELECT=34 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:52:02.998556 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ff515078-d6f9-427e-be0c-2022a1413031 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:52:02.999062 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ff515078-d6f9-427e-be0c-2022a1413031 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:52:02.999500 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ff515078-d6f9-427e-be0c-2022a1413031 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:52:03.000183 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ff515078-d6f9-427e-be0c-2022a1413031 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:52:03.000627 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ff515078-d6f9-427e-be0c-2022a1413031 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:52:03.001044 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ff515078-d6f9-427e-be0c-2022a1413031 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:52:03.003934 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:52:03.135301 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-ff515078-d6f9-427e-be0c-2022a1413031 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b774b20640b8413eac15565a7f624108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2966ce3ee7fe4d49ae177c6a3a415421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:52:03.143318 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-ff515078-d6f9-427e-be0c-2022a1413031 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] 10.222.0.58 "GET /compute/v2.1/servers/aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1" status: 200 len: 1517 microversion: 2.1 time: 0.159210 Aug 10 23:52:03.143900 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3129/6466] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:52:02 2022] GET /compute/v2.1/servers/aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1 => generated 1517 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:52:03.630970 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-85554ca8-31a5-4597-a66d-99b4578f7d9d req-30be4d95-ffea-4150-8cb5-d853974d8693 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1", "tag": "c3181422-1f74-4128-82b8-2e27adadef4c"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:52:03.641235 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-85554ca8-31a5-4597-a66d-99b4578f7d9d req-30be4d95-ffea-4150-8cb5-d853974d8693 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:52:03.641761 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-85554ca8-31a5-4597-a66d-99b4578f7d9d req-30be4d95-ffea-4150-8cb5-d853974d8693 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:52:03.642208 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-85554ca8-31a5-4597-a66d-99b4578f7d9d req-30be4d95-ffea-4150-8cb5-d853974d8693 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:52:03.655040 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-85554ca8-31a5-4597-a66d-99b4578f7d9d req-30be4d95-ffea-4150-8cb5-d853974d8693 service nova] Creating event network-changed:c3181422-1f74-4128-82b8-2e27adadef4c for instance aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1 on n-h2-850468-14 Aug 10 23:52:03.660322 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [req-85554ca8-31a5-4597-a66d-99b4578f7d9d req-30be4d95-ffea-4150-8cb5-d853974d8693 service nova] Instance aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-850468-14', 'n-h2-850468-14'} {{(pid=122633) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5901}} Aug 10 23:52:03.671089 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-85554ca8-31a5-4597-a66d-99b4578f7d9d req-30be4d95-ffea-4150-8cb5-d853974d8693 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044477 Aug 10 23:52:03.671637 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3338/6467] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:52:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:52:04.165667 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-5f385c15-e264-42cf-9a52-9c58107113ea tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:52:04.166506 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-5f385c15-e264-42cf-9a52-9c58107113ea tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] [instance: aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:52:04.174874 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5f385c15-e264-42cf-9a52-9c58107113ea tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:52:04.175737 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5f385c15-e264-42cf-9a52-9c58107113ea tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:52:04.176402 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5f385c15-e264-42cf-9a52-9c58107113ea tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:52:04.177343 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5f385c15-e264-42cf-9a52-9c58107113ea tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:52:04.178002 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5f385c15-e264-42cf-9a52-9c58107113ea tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:52:04.178626 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5f385c15-e264-42cf-9a52-9c58107113ea tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:52:04.335247 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-5f385c15-e264-42cf-9a52-9c58107113ea tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b774b20640b8413eac15565a7f624108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2966ce3ee7fe4d49ae177c6a3a415421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:52:04.342869 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-5f385c15-e264-42cf-9a52-9c58107113ea tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] 10.222.0.58 "GET /compute/v2.1/servers/aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1" status: 200 len: 1517 microversion: 2.1 time: 0.181248 Aug 10 23:52:04.343677 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3130/6468] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:52:04 2022] GET /compute/v2.1/servers/aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1 => generated 1517 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:52:05.366398 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-b6a53645-740c-4095-9415-70543ab194a0 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:52:05.367137 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-b6a53645-740c-4095-9415-70543ab194a0 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] [instance: aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:52:05.369091 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_api:SELECT=28 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:52:05.375457 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b6a53645-740c-4095-9415-70543ab194a0 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:52:05.375957 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b6a53645-740c-4095-9415-70543ab194a0 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:52:05.376411 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b6a53645-740c-4095-9415-70543ab194a0 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:52:05.377769 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b6a53645-740c-4095-9415-70543ab194a0 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:52:05.378233 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b6a53645-740c-4095-9415-70543ab194a0 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:52:05.378675 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b6a53645-740c-4095-9415-70543ab194a0 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:52:05.511694 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-b6a53645-740c-4095-9415-70543ab194a0 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b774b20640b8413eac15565a7f624108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2966ce3ee7fe4d49ae177c6a3a415421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:52:05.519564 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-b6a53645-740c-4095-9415-70543ab194a0 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] 10.222.0.58 "GET /compute/v2.1/servers/aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1" status: 200 len: 1514 microversion: 2.1 time: 0.158732 Aug 10 23:52:05.520195 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3339/6469] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:52:05 2022] GET /compute/v2.1/servers/aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1 => generated 1514 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:52:05.540643 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-deea888a-f589-45c4-8f67-15d0c31e157f tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:52:05.541183 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-deea888a-f589-45c4-8f67-15d0c31e157f tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] [instance: aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:52:05.548128 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-deea888a-f589-45c4-8f67-15d0c31e157f tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:52:05.549132 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-deea888a-f589-45c4-8f67-15d0c31e157f tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:52:05.549573 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-deea888a-f589-45c4-8f67-15d0c31e157f tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:52:05.550414 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-deea888a-f589-45c4-8f67-15d0c31e157f tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:52:05.550889 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-deea888a-f589-45c4-8f67-15d0c31e157f tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:52:05.551311 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-deea888a-f589-45c4-8f67-15d0c31e157f tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:52:05.611466 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-deea888a-f589-45c4-8f67-15d0c31e157f tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] 10.222.0.58 "POST /compute/v2.1/servers/aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1/action" status: 204 len: 0 microversion: 2.1 time: 0.074036 Aug 10 23:52:05.612646 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3131/6470] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:52:05 2022] POST /compute/v2.1/servers/aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1/action => generated 0 bytes in 77 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:52:05.620934 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-7eb379d1-81ab-426b-927e-39106ddb5294 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:52:05.621491 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-7eb379d1-81ab-426b-927e-39106ddb5294 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] [instance: aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:52:05.628703 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7eb379d1-81ab-426b-927e-39106ddb5294 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:52:05.629205 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7eb379d1-81ab-426b-927e-39106ddb5294 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:52:05.629707 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7eb379d1-81ab-426b-927e-39106ddb5294 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:52:05.630499 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7eb379d1-81ab-426b-927e-39106ddb5294 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:52:05.631017 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7eb379d1-81ab-426b-927e-39106ddb5294 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:52:05.631525 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7eb379d1-81ab-426b-927e-39106ddb5294 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:52:05.770255 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-7eb379d1-81ab-426b-927e-39106ddb5294 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b774b20640b8413eac15565a7f624108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2966ce3ee7fe4d49ae177c6a3a415421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:52:05.778183 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-7eb379d1-81ab-426b-927e-39106ddb5294 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] 10.222.0.58 "GET /compute/v2.1/servers/aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1" status: 200 len: 1514 microversion: 2.1 time: 0.161152 Aug 10 23:52:05.778769 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3340/6471] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:52:05 2022] GET /compute/v2.1/servers/aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1 => generated 1514 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:52:06.430210 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-e6f04e98-b5b3-4920-a324-12dfa4191711 req-7ee6d255-202c-454b-aa3c-603f525818df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1", "name": "network-vif-plugged", "status": "completed", "tag": "c3181422-1f74-4128-82b8-2e27adadef4c"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:52:06.441402 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-e6f04e98-b5b3-4920-a324-12dfa4191711 req-7ee6d255-202c-454b-aa3c-603f525818df service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:52:06.441892 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-e6f04e98-b5b3-4920-a324-12dfa4191711 req-7ee6d255-202c-454b-aa3c-603f525818df service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:52:06.442328 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-e6f04e98-b5b3-4920-a324-12dfa4191711 req-7ee6d255-202c-454b-aa3c-603f525818df service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:52:06.454143 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-e6f04e98-b5b3-4920-a324-12dfa4191711 req-7ee6d255-202c-454b-aa3c-603f525818df service nova] Creating event network-vif-plugged:c3181422-1f74-4128-82b8-2e27adadef4c for instance aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1 on n-h2-850468-14 Aug 10 23:52:06.460469 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [req-e6f04e98-b5b3-4920-a324-12dfa4191711 req-7ee6d255-202c-454b-aa3c-603f525818df service nova] Instance aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-850468-14', 'n-h2-850468-14'} {{(pid=122632) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5901}} Aug 10 23:52:06.471732 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-e6f04e98-b5b3-4920-a324-12dfa4191711 req-7ee6d255-202c-454b-aa3c-603f525818df service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044837 Aug 10 23:52:06.472461 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3132/6472] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:52:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:52:06.800540 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-8b4a5e7b-dcfb-439d-b741-de2966522473 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:52:06.801158 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-8b4a5e7b-dcfb-439d-b741-de2966522473 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] [instance: aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:52:06.808185 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8b4a5e7b-dcfb-439d-b741-de2966522473 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:52:06.808683 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8b4a5e7b-dcfb-439d-b741-de2966522473 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:52:06.809135 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8b4a5e7b-dcfb-439d-b741-de2966522473 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:52:06.809840 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8b4a5e7b-dcfb-439d-b741-de2966522473 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:52:06.810308 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8b4a5e7b-dcfb-439d-b741-de2966522473 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:52:06.810752 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8b4a5e7b-dcfb-439d-b741-de2966522473 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:52:06.945846 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-8b4a5e7b-dcfb-439d-b741-de2966522473 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b774b20640b8413eac15565a7f624108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2966ce3ee7fe4d49ae177c6a3a415421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:52:06.953601 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-8b4a5e7b-dcfb-439d-b741-de2966522473 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] 10.222.0.58 "GET /compute/v2.1/servers/aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1" status: 200 len: 1506 microversion: 2.1 time: 0.157933 Aug 10 23:52:06.954184 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3341/6473] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:52:06 2022] GET /compute/v2.1/servers/aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1 => generated 1506 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:52:06.975536 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-0754fb4b-4ae7-4cd1-a03d-52082525638a tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:52:06.976203 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-0754fb4b-4ae7-4cd1-a03d-52082525638a tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] [instance: aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:52:06.982369 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0754fb4b-4ae7-4cd1-a03d-52082525638a tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:52:06.982887 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0754fb4b-4ae7-4cd1-a03d-52082525638a tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:52:06.983330 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0754fb4b-4ae7-4cd1-a03d-52082525638a tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:52:06.984021 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0754fb4b-4ae7-4cd1-a03d-52082525638a tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:52:06.984474 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0754fb4b-4ae7-4cd1-a03d-52082525638a tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:52:06.984899 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0754fb4b-4ae7-4cd1-a03d-52082525638a tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:52:07.120756 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-0754fb4b-4ae7-4cd1-a03d-52082525638a tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b774b20640b8413eac15565a7f624108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2966ce3ee7fe4d49ae177c6a3a415421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:52:07.129171 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-0754fb4b-4ae7-4cd1-a03d-52082525638a tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] 10.222.0.58 "GET /compute/v2.1/servers/aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1" status: 200 len: 1506 microversion: 2.1 time: 0.158935 Aug 10 23:52:07.129746 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3133/6474] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:52:06 2022] GET /compute/v2.1/servers/aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1 => generated 1506 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:52:07.152604 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-b4c9d9a0-80b4-4273-aa64-e456e69fbbc4 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Action: 'create', calling method: .version_select at 0x7f847c14b430>, body: {"keypair": {"name": "tempest-keypair-1840999950", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGwT676BdeK14fDjRcYMJuXEqBFttrZiENe1XfNIVeZTxYWOk0XSUDe4e2hvDv/z02+QDsRw0AA/D9lwGTSJYpq8Qwga3Rs9YovK1eRB/8tmySAY/4F1aIoavroCvEw7bQ=="}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:52:07.168882 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-b4c9d9a0-80b4-4273-aa64-e456e69fbbc4 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Getting quotas for project 2966ce3ee7fe4d49ae177c6a3a415421. Resources: {'key_pairs'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:52:07.174735 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-b4c9d9a0-80b4-4273-aa64-e456e69fbbc4 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Getting quotas for user b774b20640b8413eac15565a7f624108 and project 2966ce3ee7fe4d49ae177c6a3a415421. Resources: {'key_pairs'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:52:07.187898 n-d-850468-14 devstack@n-api.service[122633]: ERROR oslo.messaging._drivers.impl_rabbit [None req-b4c9d9a0-80b4-4273-aa64-e456e69fbbc4 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] [e2f225cb-bf19-4d7b-8a8a-277b90e5ad43] AMQP server on 10.222.0.58:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 10 23:52:08.195844 n-d-850468-14 devstack@n-api.service[122633]: INFO oslo.messaging._drivers.impl_rabbit [None req-b4c9d9a0-80b4-4273-aa64-e456e69fbbc4 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] [e2f225cb-bf19-4d7b-8a8a-277b90e5ad43] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 37234. Aug 10 23:52:08.212443 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-b4c9d9a0-80b4-4273-aa64-e456e69fbbc4 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.063877 Aug 10 23:52:08.213054 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3342/6475] 10.222.0.58 () {60 vars in 1159 bytes} [Wed Aug 10 23:52:07 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:52:09.270496 n-d-850468-14 devstack@n-api.service[122632]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 23:52:09.271028 n-d-850468-14 devstack@n-api.service[122632]: Wed Aug 10 23:52:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 23:52:09.402339 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-0fca4045-6fff-42eb-b898-cd51ce170045 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:52:09.402991 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-0fca4045-6fff-42eb-b898-cd51ce170045 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] [instance: aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:52:09.410663 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0fca4045-6fff-42eb-b898-cd51ce170045 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:52:09.411209 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0fca4045-6fff-42eb-b898-cd51ce170045 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:52:09.411642 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0fca4045-6fff-42eb-b898-cd51ce170045 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:52:09.412336 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0fca4045-6fff-42eb-b898-cd51ce170045 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:52:09.412786 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0fca4045-6fff-42eb-b898-cd51ce170045 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:52:09.413214 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0fca4045-6fff-42eb-b898-cd51ce170045 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:52:09.543668 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-0fca4045-6fff-42eb-b898-cd51ce170045 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b774b20640b8413eac15565a7f624108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2966ce3ee7fe4d49ae177c6a3a415421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:52:09.551455 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-0fca4045-6fff-42eb-b898-cd51ce170045 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] 10.222.0.58 "GET /compute/v2.1/servers/aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1" status: 200 len: 1506 microversion: 2.1 time: 0.152928 Aug 10 23:52:09.552037 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3134/6476] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:52:09 2022] GET /compute/v2.1/servers/aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1 => generated 1506 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:52:09.572077 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-527958ab-8d2e-402b-8b8c-0fd35e68084c tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:52:09.572583 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-527958ab-8d2e-402b-8b8c-0fd35e68084c tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] [instance: aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:52:09.580781 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-527958ab-8d2e-402b-8b8c-0fd35e68084c tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:52:09.581291 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-527958ab-8d2e-402b-8b8c-0fd35e68084c tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:52:09.581741 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-527958ab-8d2e-402b-8b8c-0fd35e68084c tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:52:09.582454 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-527958ab-8d2e-402b-8b8c-0fd35e68084c tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:52:09.582954 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-527958ab-8d2e-402b-8b8c-0fd35e68084c tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:52:09.583397 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-527958ab-8d2e-402b-8b8c-0fd35e68084c tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:52:09.607459 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-527958ab-8d2e-402b-8b8c-0fd35e68084c tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] [instance: aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1] Going to try to terminate instance {{(pid=122633) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:52:09.684189 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-527958ab-8d2e-402b-8b8c-0fd35e68084c tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] 10.222.0.58 "DELETE /compute/v2.1/servers/aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1" status: 204 len: 0 microversion: 2.1 time: 0.115659 Aug 10 23:52:09.684737 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3343/6477] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:52:09 2022] DELETE /compute/v2.1/servers/aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:52:09.741933 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-e1d42c71-c6c8-4e04-9a60-3f457053a7f2 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1646823709", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452", "networks": [{"uuid": "12af9db6-9d9f-40b6-b86e-76dfd2f6f325"}]}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:52:09.797052 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.network.neutron [None req-e1d42c71-c6c8-4e04-9a60-3f457053a7f2 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] validate_networks() for [('12af9db6-9d9f-40b6-b86e-76dfd2f6f325', None, None, None, None, None)] {{(pid=122632) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 23:52:10.170586 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-e1d42c71-c6c8-4e04-9a60-3f457053a7f2 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Flavor limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:52:10.171036 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-e1d42c71-c6c8-4e04-9a60-3f457053a7f2 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Image limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:52:10.171510 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-e1d42c71-c6c8-4e04-9a60-3f457053a7f2 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Flavor pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:52:10.171918 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-e1d42c71-c6c8-4e04-9a60-3f457053a7f2 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Image pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:52:10.172327 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-e1d42c71-c6c8-4e04-9a60-3f457053a7f2 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:52:10.181601 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e1d42c71-c6c8-4e04-9a60-3f457053a7f2 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:52:10.182085 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e1d42c71-c6c8-4e04-9a60-3f457053a7f2 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:52:10.182542 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e1d42c71-c6c8-4e04-9a60-3f457053a7f2 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:52:10.183305 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e1d42c71-c6c8-4e04-9a60-3f457053a7f2 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:52:10.183760 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e1d42c71-c6c8-4e04-9a60-3f457053a7f2 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:52:10.184185 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e1d42c71-c6c8-4e04-9a60-3f457053a7f2 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:52:10.201453 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-e1d42c71-c6c8-4e04-9a60-3f457053a7f2 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Getting quotas for project 2966ce3ee7fe4d49ae177c6a3a415421. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:52:10.207553 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-e1d42c71-c6c8-4e04-9a60-3f457053a7f2 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Getting quotas for user b774b20640b8413eac15565a7f624108 and project 2966ce3ee7fe4d49ae177c6a3a415421. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:52:10.219794 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-e1d42c71-c6c8-4e04-9a60-3f457053a7f2 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Going to run 1 instances... {{(pid=122632) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 23:52:10.222243 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-e1d42c71-c6c8-4e04-9a60-3f457053a7f2 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] [instance: b554bb32-6837-4279-8872-d6a2959ec552] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78ad8905-f66f-4733-8be9-2b260f1fabed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122632) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 23:52:10.266177 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-e1d42c71-c6c8-4e04-9a60-3f457053a7f2 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.528155 Aug 10 23:52:10.266850 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3135/6478] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 23:52:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 529 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 23:52:10.280631 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-b4cda20d-2a7d-4481-ae07-a97b5e87d250 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:52:10.281451 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-b4cda20d-2a7d-4481-ae07-a97b5e87d250 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] [instance: b554bb32-6837-4279-8872-d6a2959ec552] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:52:10.341667 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-b4cda20d-2a7d-4481-ae07-a97b5e87d250 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b774b20640b8413eac15565a7f624108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2966ce3ee7fe4d49ae177c6a3a415421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:52:10.348572 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-b4cda20d-2a7d-4481-ae07-a97b5e87d250 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] 10.222.0.58 "GET /compute/v2.1/servers/b554bb32-6837-4279-8872-d6a2959ec552" status: 200 len: 1218 microversion: 2.1 time: 0.073423 Aug 10 23:52:10.349150 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3344/6479] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:52:10 2022] GET /compute/v2.1/servers/b554bb32-6837-4279-8872-d6a2959ec552 => generated 1218 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:52:11.370443 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-1a9e6582-801d-425f-8d19-5b38dc165446 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:52:11.371091 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-1a9e6582-801d-425f-8d19-5b38dc165446 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] [instance: b554bb32-6837-4279-8872-d6a2959ec552] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:52:11.378378 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1a9e6582-801d-425f-8d19-5b38dc165446 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:52:11.378898 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1a9e6582-801d-425f-8d19-5b38dc165446 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:52:11.379340 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1a9e6582-801d-425f-8d19-5b38dc165446 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:52:11.380077 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1a9e6582-801d-425f-8d19-5b38dc165446 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:52:11.380532 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1a9e6582-801d-425f-8d19-5b38dc165446 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:52:11.380962 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1a9e6582-801d-425f-8d19-5b38dc165446 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:52:11.447647 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-1a9e6582-801d-425f-8d19-5b38dc165446 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b774b20640b8413eac15565a7f624108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2966ce3ee7fe4d49ae177c6a3a415421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:52:11.456636 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-1a9e6582-801d-425f-8d19-5b38dc165446 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] 10.222.0.58 "GET /compute/v2.1/servers/b554bb32-6837-4279-8872-d6a2959ec552" status: 200 len: 1270 microversion: 2.1 time: 0.090919 Aug 10 23:52:11.457217 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3136/6480] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:52:11 2022] GET /compute/v2.1/servers/b554bb32-6837-4279-8872-d6a2959ec552 => generated 1270 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:52:11.838724 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-033d5332-dea2-4326-9418-0a14d72ec0db req-8b31c53a-3f14-48d5-9e1e-bb69d63083c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1", "name": "network-vif-deleted", "tag": "c3181422-1f74-4128-82b8-2e27adadef4c"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:52:11.851187 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-033d5332-dea2-4326-9418-0a14d72ec0db req-8b31c53a-3f14-48d5-9e1e-bb69d63083c2 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:52:11.851922 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-033d5332-dea2-4326-9418-0a14d72ec0db req-8b31c53a-3f14-48d5-9e1e-bb69d63083c2 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:52:11.852529 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-033d5332-dea2-4326-9418-0a14d72ec0db req-8b31c53a-3f14-48d5-9e1e-bb69d63083c2 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:52:11.865369 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-033d5332-dea2-4326-9418-0a14d72ec0db req-8b31c53a-3f14-48d5-9e1e-bb69d63083c2 service nova] Creating event network-vif-deleted:c3181422-1f74-4128-82b8-2e27adadef4c for instance aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1 on n-h2-850468-14 Aug 10 23:52:11.870581 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-033d5332-dea2-4326-9418-0a14d72ec0db req-8b31c53a-3f14-48d5-9e1e-bb69d63083c2 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035651 Aug 10 23:52:11.871486 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3345/6481] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:52:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:52:12.478853 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-a190064b-6ba9-43ff-ae34-c5a46eb814a7 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:52:12.479612 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-a190064b-6ba9-43ff-ae34-c5a46eb814a7 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] [instance: b554bb32-6837-4279-8872-d6a2959ec552] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:52:12.487401 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a190064b-6ba9-43ff-ae34-c5a46eb814a7 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:52:12.487895 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a190064b-6ba9-43ff-ae34-c5a46eb814a7 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:52:12.488337 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a190064b-6ba9-43ff-ae34-c5a46eb814a7 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:52:12.489117 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a190064b-6ba9-43ff-ae34-c5a46eb814a7 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:52:12.489572 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a190064b-6ba9-43ff-ae34-c5a46eb814a7 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:52:12.490028 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a190064b-6ba9-43ff-ae34-c5a46eb814a7 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:52:12.702286 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-a190064b-6ba9-43ff-ae34-c5a46eb814a7 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b774b20640b8413eac15565a7f624108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2966ce3ee7fe4d49ae177c6a3a415421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:52:12.712644 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-a190064b-6ba9-43ff-ae34-c5a46eb814a7 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] 10.222.0.58 "GET /compute/v2.1/servers/b554bb32-6837-4279-8872-d6a2959ec552" status: 200 len: 1318 microversion: 2.1 time: 0.237919 Aug 10 23:52:12.713319 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3137/6482] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:52:12 2022] GET /compute/v2.1/servers/b554bb32-6837-4279-8872-d6a2959ec552 => generated 1318 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:52:12.920718 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-f53287e7-51a1-42fa-9851-f9d7d5b2f86f req-88b4e9bc-19ac-4f1b-9a1c-3ae02cd2c174 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b554bb32-6837-4279-8872-d6a2959ec552", "tag": "9a1bb0e9-b8ac-4be3-bdb5-a596118d59aa"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:52:12.932422 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-f53287e7-51a1-42fa-9851-f9d7d5b2f86f req-88b4e9bc-19ac-4f1b-9a1c-3ae02cd2c174 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:52:12.932913 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-f53287e7-51a1-42fa-9851-f9d7d5b2f86f req-88b4e9bc-19ac-4f1b-9a1c-3ae02cd2c174 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:52:12.933365 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-f53287e7-51a1-42fa-9851-f9d7d5b2f86f req-88b4e9bc-19ac-4f1b-9a1c-3ae02cd2c174 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:52:12.945488 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-f53287e7-51a1-42fa-9851-f9d7d5b2f86f req-88b4e9bc-19ac-4f1b-9a1c-3ae02cd2c174 service nova] Creating event network-changed:9a1bb0e9-b8ac-4be3-bdb5-a596118d59aa for instance b554bb32-6837-4279-8872-d6a2959ec552 on n-h2-850468-14 Aug 10 23:52:12.950239 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-f53287e7-51a1-42fa-9851-f9d7d5b2f86f req-88b4e9bc-19ac-4f1b-9a1c-3ae02cd2c174 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033553 Aug 10 23:52:12.950882 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3346/6483] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:52:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:52:13.733763 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-cba7c6b9-5c07-4c38-8821-21ca1291096a tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:52:13.734398 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-cba7c6b9-5c07-4c38-8821-21ca1291096a tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] [instance: b554bb32-6837-4279-8872-d6a2959ec552] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:52:13.741638 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cba7c6b9-5c07-4c38-8821-21ca1291096a tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:52:13.741876 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cba7c6b9-5c07-4c38-8821-21ca1291096a tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:52:13.742706 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cba7c6b9-5c07-4c38-8821-21ca1291096a tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:52:13.743944 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cba7c6b9-5c07-4c38-8821-21ca1291096a tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:52:13.744351 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cba7c6b9-5c07-4c38-8821-21ca1291096a tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:52:13.745090 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cba7c6b9-5c07-4c38-8821-21ca1291096a tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:52:13.882184 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-cba7c6b9-5c07-4c38-8821-21ca1291096a tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b774b20640b8413eac15565a7f624108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2966ce3ee7fe4d49ae177c6a3a415421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:52:13.889786 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-cba7c6b9-5c07-4c38-8821-21ca1291096a tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] 10.222.0.58 "GET /compute/v2.1/servers/b554bb32-6837-4279-8872-d6a2959ec552" status: 200 len: 1318 microversion: 2.1 time: 0.159944 Aug 10 23:52:13.890369 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3138/6484] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:52:13 2022] GET /compute/v2.1/servers/b554bb32-6837-4279-8872-d6a2959ec552 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:52:14.913442 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-8a20bc53-c58f-4d93-9eca-0a4b1811d447 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:52:14.914187 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-8a20bc53-c58f-4d93-9eca-0a4b1811d447 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] [instance: b554bb32-6837-4279-8872-d6a2959ec552] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:52:14.920380 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8a20bc53-c58f-4d93-9eca-0a4b1811d447 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:52:14.920885 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8a20bc53-c58f-4d93-9eca-0a4b1811d447 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:52:14.921346 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8a20bc53-c58f-4d93-9eca-0a4b1811d447 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:52:14.922067 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8a20bc53-c58f-4d93-9eca-0a4b1811d447 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:52:14.922537 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8a20bc53-c58f-4d93-9eca-0a4b1811d447 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:52:14.923017 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8a20bc53-c58f-4d93-9eca-0a4b1811d447 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:52:15.068695 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-8a20bc53-c58f-4d93-9eca-0a4b1811d447 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b774b20640b8413eac15565a7f624108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2966ce3ee7fe4d49ae177c6a3a415421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:52:15.076364 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-8a20bc53-c58f-4d93-9eca-0a4b1811d447 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] 10.222.0.58 "GET /compute/v2.1/servers/b554bb32-6837-4279-8872-d6a2959ec552" status: 200 len: 1318 microversion: 2.1 time: 0.168607 Aug 10 23:52:15.076947 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3347/6485] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:52:14 2022] GET /compute/v2.1/servers/b554bb32-6837-4279-8872-d6a2959ec552 => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:52:16.098293 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-81500404-e311-4d46-9a85-95dfd4fb1d5c tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:52:16.098922 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-81500404-e311-4d46-9a85-95dfd4fb1d5c tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] [instance: b554bb32-6837-4279-8872-d6a2959ec552] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:52:16.105755 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-81500404-e311-4d46-9a85-95dfd4fb1d5c tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:52:16.106235 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-81500404-e311-4d46-9a85-95dfd4fb1d5c tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:52:16.106661 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-81500404-e311-4d46-9a85-95dfd4fb1d5c tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:52:16.107389 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-81500404-e311-4d46-9a85-95dfd4fb1d5c tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:52:16.107838 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-81500404-e311-4d46-9a85-95dfd4fb1d5c tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:52:16.108254 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-81500404-e311-4d46-9a85-95dfd4fb1d5c tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:52:16.244967 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-81500404-e311-4d46-9a85-95dfd4fb1d5c tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b774b20640b8413eac15565a7f624108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2966ce3ee7fe4d49ae177c6a3a415421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:52:16.252764 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-81500404-e311-4d46-9a85-95dfd4fb1d5c tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] 10.222.0.58 "GET /compute/v2.1/servers/b554bb32-6837-4279-8872-d6a2959ec552" status: 200 len: 1318 microversion: 2.1 time: 0.158803 Aug 10 23:52:16.253335 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3139/6486] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:52:16 2022] GET /compute/v2.1/servers/b554bb32-6837-4279-8872-d6a2959ec552 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:52:17.274041 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c3c38873-e3a9-430b-877f-30290de35e30 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:52:17.274696 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-c3c38873-e3a9-430b-877f-30290de35e30 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] [instance: b554bb32-6837-4279-8872-d6a2959ec552] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:52:17.281681 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c3c38873-e3a9-430b-877f-30290de35e30 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:52:17.282171 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c3c38873-e3a9-430b-877f-30290de35e30 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:52:17.282623 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c3c38873-e3a9-430b-877f-30290de35e30 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:52:17.283526 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c3c38873-e3a9-430b-877f-30290de35e30 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:52:17.284025 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c3c38873-e3a9-430b-877f-30290de35e30 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:52:17.284463 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c3c38873-e3a9-430b-877f-30290de35e30 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:52:17.508561 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-c3c38873-e3a9-430b-877f-30290de35e30 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b774b20640b8413eac15565a7f624108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2966ce3ee7fe4d49ae177c6a3a415421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:52:17.516442 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-c3c38873-e3a9-430b-877f-30290de35e30 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] 10.222.0.58 "GET /compute/v2.1/servers/b554bb32-6837-4279-8872-d6a2959ec552" status: 200 len: 1318 microversion: 2.1 time: 0.246310 Aug 10 23:52:17.517375 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3348/6487] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:52:17 2022] GET /compute/v2.1/servers/b554bb32-6837-4279-8872-d6a2959ec552 => generated 1318 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:52:18.486173 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-d79cfe89-7560-4ab7-90eb-fc5fe3bb648f req-02d99c38-1160-47a7-8938-7ea833bd316a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b554bb32-6837-4279-8872-d6a2959ec552", "name": "network-vif-plugged", "status": "completed", "tag": "9a1bb0e9-b8ac-4be3-bdb5-a596118d59aa"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:52:18.497081 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-d79cfe89-7560-4ab7-90eb-fc5fe3bb648f req-02d99c38-1160-47a7-8938-7ea833bd316a service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:52:18.497888 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-d79cfe89-7560-4ab7-90eb-fc5fe3bb648f req-02d99c38-1160-47a7-8938-7ea833bd316a service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:52:18.498327 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-d79cfe89-7560-4ab7-90eb-fc5fe3bb648f req-02d99c38-1160-47a7-8938-7ea833bd316a service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:52:18.510025 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-d79cfe89-7560-4ab7-90eb-fc5fe3bb648f req-02d99c38-1160-47a7-8938-7ea833bd316a service nova] Creating event network-vif-plugged:9a1bb0e9-b8ac-4be3-bdb5-a596118d59aa for instance b554bb32-6837-4279-8872-d6a2959ec552 on n-h2-850468-14 Aug 10 23:52:18.519293 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-d79cfe89-7560-4ab7-90eb-fc5fe3bb648f req-02d99c38-1160-47a7-8938-7ea833bd316a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036590 Aug 10 23:52:18.520248 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3140/6488] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:52:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:52:18.538179 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-a02daebf-8314-4312-876c-2d748a21591c tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:52:18.538696 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-a02daebf-8314-4312-876c-2d748a21591c tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] [instance: b554bb32-6837-4279-8872-d6a2959ec552] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:52:18.547284 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a02daebf-8314-4312-876c-2d748a21591c tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:52:18.547792 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a02daebf-8314-4312-876c-2d748a21591c tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:52:18.548456 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a02daebf-8314-4312-876c-2d748a21591c tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:52:18.554658 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a02daebf-8314-4312-876c-2d748a21591c tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:52:18.555068 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a02daebf-8314-4312-876c-2d748a21591c tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:52:18.555715 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a02daebf-8314-4312-876c-2d748a21591c tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:52:18.690102 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-a02daebf-8314-4312-876c-2d748a21591c tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b774b20640b8413eac15565a7f624108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2966ce3ee7fe4d49ae177c6a3a415421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:52:18.699124 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-a02daebf-8314-4312-876c-2d748a21591c tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] 10.222.0.58 "GET /compute/v2.1/servers/b554bb32-6837-4279-8872-d6a2959ec552" status: 200 len: 1318 microversion: 2.1 time: 0.165286 Aug 10 23:52:18.699748 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3349/6489] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:52:18 2022] GET /compute/v2.1/servers/b554bb32-6837-4279-8872-d6a2959ec552 => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:52:19.723347 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-0bd39ef7-dbd8-4b1c-9d10-3a24d797f801 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:52:19.724119 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-0bd39ef7-dbd8-4b1c-9d10-3a24d797f801 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] [instance: b554bb32-6837-4279-8872-d6a2959ec552] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:52:19.730354 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0bd39ef7-dbd8-4b1c-9d10-3a24d797f801 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:52:19.730877 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0bd39ef7-dbd8-4b1c-9d10-3a24d797f801 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:52:19.731320 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0bd39ef7-dbd8-4b1c-9d10-3a24d797f801 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:52:19.732024 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0bd39ef7-dbd8-4b1c-9d10-3a24d797f801 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:52:19.732486 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0bd39ef7-dbd8-4b1c-9d10-3a24d797f801 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:52:19.732916 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0bd39ef7-dbd8-4b1c-9d10-3a24d797f801 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:52:19.929057 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-0bd39ef7-dbd8-4b1c-9d10-3a24d797f801 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b774b20640b8413eac15565a7f624108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2966ce3ee7fe4d49ae177c6a3a415421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:52:19.936701 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-0bd39ef7-dbd8-4b1c-9d10-3a24d797f801 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] 10.222.0.58 "GET /compute/v2.1/servers/b554bb32-6837-4279-8872-d6a2959ec552" status: 200 len: 1318 microversion: 2.1 time: 0.219547 Aug 10 23:52:19.937278 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3141/6490] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:52:19 2022] GET /compute/v2.1/servers/b554bb32-6837-4279-8872-d6a2959ec552 => generated 1318 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:52:20.959130 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-5d1ef16a-6d55-4ab4-993d-004d989d0d22 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:52:20.959673 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-5d1ef16a-6d55-4ab4-993d-004d989d0d22 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] [instance: b554bb32-6837-4279-8872-d6a2959ec552] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:52:20.962527 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=6 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:52:20.967821 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5d1ef16a-6d55-4ab4-993d-004d989d0d22 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:52:20.968312 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5d1ef16a-6d55-4ab4-993d-004d989d0d22 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:52:20.968756 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5d1ef16a-6d55-4ab4-993d-004d989d0d22 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:52:20.969463 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5d1ef16a-6d55-4ab4-993d-004d989d0d22 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:52:20.969921 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5d1ef16a-6d55-4ab4-993d-004d989d0d22 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:52:20.970353 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5d1ef16a-6d55-4ab4-993d-004d989d0d22 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:52:21.103889 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-5d1ef16a-6d55-4ab4-993d-004d989d0d22 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b774b20640b8413eac15565a7f624108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2966ce3ee7fe4d49ae177c6a3a415421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:52:21.112307 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-5d1ef16a-6d55-4ab4-993d-004d989d0d22 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] 10.222.0.58 "GET /compute/v2.1/servers/b554bb32-6837-4279-8872-d6a2959ec552" status: 200 len: 1506 microversion: 2.1 time: 0.157311 Aug 10 23:52:21.112654 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3350/6491] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:52:20 2022] GET /compute/v2.1/servers/b554bb32-6837-4279-8872-d6a2959ec552 => generated 1506 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:52:21.133309 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-560c3f63-ebbd-44e5-badf-b8b67fbeb4a0 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:52:21.133922 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-560c3f63-ebbd-44e5-badf-b8b67fbeb4a0 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] [instance: b554bb32-6837-4279-8872-d6a2959ec552] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:52:21.135896 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=2 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:52:21.136557 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=6 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:52:21.143055 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-560c3f63-ebbd-44e5-badf-b8b67fbeb4a0 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:52:21.143547 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-560c3f63-ebbd-44e5-badf-b8b67fbeb4a0 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:52:21.143987 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-560c3f63-ebbd-44e5-badf-b8b67fbeb4a0 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:52:21.144687 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-560c3f63-ebbd-44e5-badf-b8b67fbeb4a0 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:52:21.145169 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-560c3f63-ebbd-44e5-badf-b8b67fbeb4a0 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:52:21.145592 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-560c3f63-ebbd-44e5-badf-b8b67fbeb4a0 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:52:21.276019 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-560c3f63-ebbd-44e5-badf-b8b67fbeb4a0 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b774b20640b8413eac15565a7f624108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2966ce3ee7fe4d49ae177c6a3a415421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:52:21.283787 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-560c3f63-ebbd-44e5-badf-b8b67fbeb4a0 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] 10.222.0.58 "GET /compute/v2.1/servers/b554bb32-6837-4279-8872-d6a2959ec552" status: 200 len: 1506 microversion: 2.1 time: 0.154162 Aug 10 23:52:21.284351 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3142/6492] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:52:21 2022] GET /compute/v2.1/servers/b554bb32-6837-4279-8872-d6a2959ec552 => generated 1506 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:52:21.304548 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-b5d01534-1588-4853-bb5e-d677dc3e9154 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:52:21.306797 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-b5d01534-1588-4853-bb5e-d677dc3e9154 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] [instance: b554bb32-6837-4279-8872-d6a2959ec552] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:52:21.312820 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b5d01534-1588-4853-bb5e-d677dc3e9154 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:52:21.313311 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b5d01534-1588-4853-bb5e-d677dc3e9154 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:52:21.313762 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b5d01534-1588-4853-bb5e-d677dc3e9154 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:52:21.315525 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b5d01534-1588-4853-bb5e-d677dc3e9154 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:52:21.316001 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b5d01534-1588-4853-bb5e-d677dc3e9154 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:52:21.316439 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b5d01534-1588-4853-bb5e-d677dc3e9154 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:52:21.344036 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-b5d01534-1588-4853-bb5e-d677dc3e9154 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'b774b20640b8413eac15565a7f624108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2966ce3ee7fe4d49ae177c6a3a415421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:52:21.350510 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-b5d01534-1588-4853-bb5e-d677dc3e9154 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] [instance: b554bb32-6837-4279-8872-d6a2959ec552] Old instance type m1.heat2, new instance type m1.heat {{(pid=122633) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 10 23:52:21.357835 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-b5d01534-1588-4853-bb5e-d677dc3e9154 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Flavor limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:52:21.358268 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-b5d01534-1588-4853-bb5e-d677dc3e9154 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Image limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:52:21.358745 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-b5d01534-1588-4853-bb5e-d677dc3e9154 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Flavor pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:52:21.359185 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-b5d01534-1588-4853-bb5e-d677dc3e9154 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Image pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:52:21.359627 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-b5d01534-1588-4853-bb5e-d677dc3e9154 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:52:21.376555 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:52:21.432082 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-b5d01534-1588-4853-bb5e-d677dc3e9154 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] 10.222.0.58 "POST /compute/v2.1/servers/b554bb32-6837-4279-8872-d6a2959ec552/action" status: 202 len: 0 microversion: 2.1 time: 0.131367 Aug 10 23:52:21.432697 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3351/6493] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:52:21 2022] POST /compute/v2.1/servers/b554bb32-6837-4279-8872-d6a2959ec552/action => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:52:21.440979 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-825f2bdc-7ec1-4bae-817e-42f298a30b95 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:52:21.441597 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-825f2bdc-7ec1-4bae-817e-42f298a30b95 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] [instance: b554bb32-6837-4279-8872-d6a2959ec552] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:52:21.447716 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-825f2bdc-7ec1-4bae-817e-42f298a30b95 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:52:21.448606 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-825f2bdc-7ec1-4bae-817e-42f298a30b95 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:52:21.448733 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-825f2bdc-7ec1-4bae-817e-42f298a30b95 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:52:21.449329 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-825f2bdc-7ec1-4bae-817e-42f298a30b95 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:52:21.449823 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-825f2bdc-7ec1-4bae-817e-42f298a30b95 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:52:21.450252 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-825f2bdc-7ec1-4bae-817e-42f298a30b95 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:52:21.586917 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-825f2bdc-7ec1-4bae-817e-42f298a30b95 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b774b20640b8413eac15565a7f624108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2966ce3ee7fe4d49ae177c6a3a415421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:52:21.594807 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-825f2bdc-7ec1-4bae-817e-42f298a30b95 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] 10.222.0.58 "GET /compute/v2.1/servers/b554bb32-6837-4279-8872-d6a2959ec552" status: 200 len: 1513 microversion: 2.1 time: 0.157595 Aug 10 23:52:21.595149 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3143/6494] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:52:21 2022] GET /compute/v2.1/servers/b554bb32-6837-4279-8872-d6a2959ec552 => generated 1513 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:52:22.615955 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-04f683a2-b8fd-4ab3-9acc-17f0a970efc6 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:52:22.617043 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-04f683a2-b8fd-4ab3-9acc-17f0a970efc6 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] [instance: b554bb32-6837-4279-8872-d6a2959ec552] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:52:22.624966 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-04f683a2-b8fd-4ab3-9acc-17f0a970efc6 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:52:22.625896 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-04f683a2-b8fd-4ab3-9acc-17f0a970efc6 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:52:22.625896 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-04f683a2-b8fd-4ab3-9acc-17f0a970efc6 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:52:22.626628 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-04f683a2-b8fd-4ab3-9acc-17f0a970efc6 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:52:22.627135 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-04f683a2-b8fd-4ab3-9acc-17f0a970efc6 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:52:22.627579 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-04f683a2-b8fd-4ab3-9acc-17f0a970efc6 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:52:22.766339 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-04f683a2-b8fd-4ab3-9acc-17f0a970efc6 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b774b20640b8413eac15565a7f624108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2966ce3ee7fe4d49ae177c6a3a415421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:52:22.775946 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-04f683a2-b8fd-4ab3-9acc-17f0a970efc6 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] 10.222.0.58 "GET /compute/v2.1/servers/b554bb32-6837-4279-8872-d6a2959ec552" status: 200 len: 1513 microversion: 2.1 time: 0.163945 Aug 10 23:52:22.776458 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3352/6495] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:52:22 2022] GET /compute/v2.1/servers/b554bb32-6837-4279-8872-d6a2959ec552 => generated 1513 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:52:23.797672 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-0d55f6ec-4874-435d-98de-c60da48220e7 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:52:23.798274 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-0d55f6ec-4874-435d-98de-c60da48220e7 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] [instance: b554bb32-6837-4279-8872-d6a2959ec552] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:52:23.806089 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0d55f6ec-4874-435d-98de-c60da48220e7 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:52:23.806571 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0d55f6ec-4874-435d-98de-c60da48220e7 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:52:23.807034 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0d55f6ec-4874-435d-98de-c60da48220e7 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:52:23.807718 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0d55f6ec-4874-435d-98de-c60da48220e7 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:52:23.808164 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0d55f6ec-4874-435d-98de-c60da48220e7 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:52:23.808584 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0d55f6ec-4874-435d-98de-c60da48220e7 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:52:23.944980 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-0d55f6ec-4874-435d-98de-c60da48220e7 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b774b20640b8413eac15565a7f624108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2966ce3ee7fe4d49ae177c6a3a415421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:52:23.952559 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-0d55f6ec-4874-435d-98de-c60da48220e7 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] 10.222.0.58 "GET /compute/v2.1/servers/b554bb32-6837-4279-8872-d6a2959ec552" status: 200 len: 1518 microversion: 2.1 time: 0.158763 Aug 10 23:52:23.953126 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3144/6496] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:52:23 2022] GET /compute/v2.1/servers/b554bb32-6837-4279-8872-d6a2959ec552 => generated 1518 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:52:24.973740 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-f3c672f9-4bd6-426d-b8d6-5022c7c8f356 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:52:24.974365 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-f3c672f9-4bd6-426d-b8d6-5022c7c8f356 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] [instance: b554bb32-6837-4279-8872-d6a2959ec552] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:52:24.981201 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f3c672f9-4bd6-426d-b8d6-5022c7c8f356 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:52:24.981700 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f3c672f9-4bd6-426d-b8d6-5022c7c8f356 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:52:24.982152 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f3c672f9-4bd6-426d-b8d6-5022c7c8f356 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:52:24.982886 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f3c672f9-4bd6-426d-b8d6-5022c7c8f356 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:52:24.983359 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f3c672f9-4bd6-426d-b8d6-5022c7c8f356 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:52:24.983800 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f3c672f9-4bd6-426d-b8d6-5022c7c8f356 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:52:25.367708 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-f3c672f9-4bd6-426d-b8d6-5022c7c8f356 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b774b20640b8413eac15565a7f624108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2966ce3ee7fe4d49ae177c6a3a415421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:52:25.375588 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-f3c672f9-4bd6-426d-b8d6-5022c7c8f356 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] 10.222.0.58 "GET /compute/v2.1/servers/b554bb32-6837-4279-8872-d6a2959ec552" status: 200 len: 1518 microversion: 2.1 time: 0.405936 Aug 10 23:52:25.376191 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3353/6497] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:52:24 2022] GET /compute/v2.1/servers/b554bb32-6837-4279-8872-d6a2959ec552 => generated 1518 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:52:26.396408 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-b4fc768b-4ae3-41a8-a33a-bb60aab2b1ae tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:52:26.397017 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-b4fc768b-4ae3-41a8-a33a-bb60aab2b1ae tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] [instance: b554bb32-6837-4279-8872-d6a2959ec552] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:52:26.403916 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b4fc768b-4ae3-41a8-a33a-bb60aab2b1ae tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:52:26.404400 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b4fc768b-4ae3-41a8-a33a-bb60aab2b1ae tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:52:26.404835 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b4fc768b-4ae3-41a8-a33a-bb60aab2b1ae tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:52:26.405521 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b4fc768b-4ae3-41a8-a33a-bb60aab2b1ae tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:52:26.405970 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b4fc768b-4ae3-41a8-a33a-bb60aab2b1ae tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:52:26.406390 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b4fc768b-4ae3-41a8-a33a-bb60aab2b1ae tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:52:26.543517 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-b4fc768b-4ae3-41a8-a33a-bb60aab2b1ae tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b774b20640b8413eac15565a7f624108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2966ce3ee7fe4d49ae177c6a3a415421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:52:26.551656 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-b4fc768b-4ae3-41a8-a33a-bb60aab2b1ae tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] 10.222.0.58 "GET /compute/v2.1/servers/b554bb32-6837-4279-8872-d6a2959ec552" status: 200 len: 1518 microversion: 2.1 time: 0.159163 Aug 10 23:52:26.552239 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3145/6498] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:52:26 2022] GET /compute/v2.1/servers/b554bb32-6837-4279-8872-d6a2959ec552 => generated 1518 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:52:27.573619 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-52fd375f-b8ff-4fa2-afce-7e06022bb73d tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:52:27.574236 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-52fd375f-b8ff-4fa2-afce-7e06022bb73d tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] [instance: b554bb32-6837-4279-8872-d6a2959ec552] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:52:27.582289 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-52fd375f-b8ff-4fa2-afce-7e06022bb73d tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:52:27.582864 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-52fd375f-b8ff-4fa2-afce-7e06022bb73d tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:52:27.583251 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-52fd375f-b8ff-4fa2-afce-7e06022bb73d tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:52:27.583960 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-52fd375f-b8ff-4fa2-afce-7e06022bb73d tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:52:27.584425 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-52fd375f-b8ff-4fa2-afce-7e06022bb73d tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:52:27.584863 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-52fd375f-b8ff-4fa2-afce-7e06022bb73d tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:52:27.714542 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-52fd375f-b8ff-4fa2-afce-7e06022bb73d tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b774b20640b8413eac15565a7f624108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2966ce3ee7fe4d49ae177c6a3a415421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:52:27.722511 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-52fd375f-b8ff-4fa2-afce-7e06022bb73d tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] 10.222.0.58 "GET /compute/v2.1/servers/b554bb32-6837-4279-8872-d6a2959ec552" status: 200 len: 1518 microversion: 2.1 time: 0.152787 Aug 10 23:52:27.723125 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3354/6499] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:52:27 2022] GET /compute/v2.1/servers/b554bb32-6837-4279-8872-d6a2959ec552 => generated 1518 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:52:28.743609 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-f7ec2c61-c31f-471c-a9bc-774e8b3eb638 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:52:28.744126 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-f7ec2c61-c31f-471c-a9bc-774e8b3eb638 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] [instance: b554bb32-6837-4279-8872-d6a2959ec552] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:52:28.751651 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f7ec2c61-c31f-471c-a9bc-774e8b3eb638 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:52:28.752130 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f7ec2c61-c31f-471c-a9bc-774e8b3eb638 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:52:28.752564 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f7ec2c61-c31f-471c-a9bc-774e8b3eb638 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:52:28.753256 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f7ec2c61-c31f-471c-a9bc-774e8b3eb638 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:52:28.753708 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f7ec2c61-c31f-471c-a9bc-774e8b3eb638 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:52:28.754128 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f7ec2c61-c31f-471c-a9bc-774e8b3eb638 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:52:28.758117 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:52:28.896406 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-f7ec2c61-c31f-471c-a9bc-774e8b3eb638 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b774b20640b8413eac15565a7f624108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2966ce3ee7fe4d49ae177c6a3a415421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:52:28.904048 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-f7ec2c61-c31f-471c-a9bc-774e8b3eb638 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] 10.222.0.58 "GET /compute/v2.1/servers/b554bb32-6837-4279-8872-d6a2959ec552" status: 200 len: 1518 microversion: 2.1 time: 0.164433 Aug 10 23:52:28.904626 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3146/6500] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:52:28 2022] GET /compute/v2.1/servers/b554bb32-6837-4279-8872-d6a2959ec552 => generated 1518 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:52:29.926348 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-5825d332-f6b7-4b56-ab4f-fe43003efd1a tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:52:29.927018 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-5825d332-f6b7-4b56-ab4f-fe43003efd1a tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] [instance: b554bb32-6837-4279-8872-d6a2959ec552] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:52:29.933978 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5825d332-f6b7-4b56-ab4f-fe43003efd1a tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:52:29.934477 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5825d332-f6b7-4b56-ab4f-fe43003efd1a tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:52:29.934975 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5825d332-f6b7-4b56-ab4f-fe43003efd1a tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:52:29.935685 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5825d332-f6b7-4b56-ab4f-fe43003efd1a tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:52:29.936171 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5825d332-f6b7-4b56-ab4f-fe43003efd1a tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:52:29.936593 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5825d332-f6b7-4b56-ab4f-fe43003efd1a tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:52:30.069529 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-5825d332-f6b7-4b56-ab4f-fe43003efd1a tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b774b20640b8413eac15565a7f624108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2966ce3ee7fe4d49ae177c6a3a415421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:52:30.077026 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-5825d332-f6b7-4b56-ab4f-fe43003efd1a tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] 10.222.0.58 "GET /compute/v2.1/servers/b554bb32-6837-4279-8872-d6a2959ec552" status: 200 len: 1518 microversion: 2.1 time: 0.155290 Aug 10 23:52:30.077584 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3355/6501] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:52:29 2022] GET /compute/v2.1/servers/b554bb32-6837-4279-8872-d6a2959ec552 => generated 1518 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:52:31.099206 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-6844cfe4-bb35-451f-9d80-9b81044a0f5c tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:52:31.099813 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-6844cfe4-bb35-451f-9d80-9b81044a0f5c tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] [instance: b554bb32-6837-4279-8872-d6a2959ec552] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:52:31.106999 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6844cfe4-bb35-451f-9d80-9b81044a0f5c tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:52:31.107487 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6844cfe4-bb35-451f-9d80-9b81044a0f5c tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:52:31.107923 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6844cfe4-bb35-451f-9d80-9b81044a0f5c tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:52:31.108627 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6844cfe4-bb35-451f-9d80-9b81044a0f5c tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:52:31.109078 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6844cfe4-bb35-451f-9d80-9b81044a0f5c tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:52:31.109502 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6844cfe4-bb35-451f-9d80-9b81044a0f5c tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:52:31.246150 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-6844cfe4-bb35-451f-9d80-9b81044a0f5c tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b774b20640b8413eac15565a7f624108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2966ce3ee7fe4d49ae177c6a3a415421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:52:31.254628 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-6844cfe4-bb35-451f-9d80-9b81044a0f5c tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] 10.222.0.58 "GET /compute/v2.1/servers/b554bb32-6837-4279-8872-d6a2959ec552" status: 200 len: 1518 microversion: 2.1 time: 0.159290 Aug 10 23:52:31.255249 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3147/6502] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:52:31 2022] GET /compute/v2.1/servers/b554bb32-6837-4279-8872-d6a2959ec552 => generated 1518 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:52:32.276718 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-e62101e7-683c-4f1e-b55a-266fb4685535 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:52:32.277248 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-e62101e7-683c-4f1e-b55a-266fb4685535 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] [instance: b554bb32-6837-4279-8872-d6a2959ec552] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:52:32.283671 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e62101e7-683c-4f1e-b55a-266fb4685535 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:52:32.284195 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e62101e7-683c-4f1e-b55a-266fb4685535 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:52:32.284653 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e62101e7-683c-4f1e-b55a-266fb4685535 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:52:32.285360 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e62101e7-683c-4f1e-b55a-266fb4685535 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:52:32.285830 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e62101e7-683c-4f1e-b55a-266fb4685535 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:52:32.286270 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e62101e7-683c-4f1e-b55a-266fb4685535 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:52:32.423255 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-e62101e7-683c-4f1e-b55a-266fb4685535 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b774b20640b8413eac15565a7f624108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2966ce3ee7fe4d49ae177c6a3a415421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:52:32.431562 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-e62101e7-683c-4f1e-b55a-266fb4685535 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] 10.222.0.58 "GET /compute/v2.1/servers/b554bb32-6837-4279-8872-d6a2959ec552" status: 200 len: 1518 microversion: 2.1 time: 0.159216 Aug 10 23:52:32.432139 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3356/6503] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:52:32 2022] GET /compute/v2.1/servers/b554bb32-6837-4279-8872-d6a2959ec552 => generated 1518 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:52:33.453718 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-35750afb-01e5-4bcf-9710-2850986515d8 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:52:33.454332 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-35750afb-01e5-4bcf-9710-2850986515d8 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] [instance: b554bb32-6837-4279-8872-d6a2959ec552] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:52:33.457040 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:52:33.462429 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-35750afb-01e5-4bcf-9710-2850986515d8 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:52:33.462950 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-35750afb-01e5-4bcf-9710-2850986515d8 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:52:33.463387 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-35750afb-01e5-4bcf-9710-2850986515d8 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:52:33.464092 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-35750afb-01e5-4bcf-9710-2850986515d8 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:52:33.464547 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-35750afb-01e5-4bcf-9710-2850986515d8 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:52:33.464975 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-35750afb-01e5-4bcf-9710-2850986515d8 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:52:33.601136 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-35750afb-01e5-4bcf-9710-2850986515d8 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b774b20640b8413eac15565a7f624108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2966ce3ee7fe4d49ae177c6a3a415421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:52:33.608773 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-35750afb-01e5-4bcf-9710-2850986515d8 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] 10.222.0.58 "GET /compute/v2.1/servers/b554bb32-6837-4279-8872-d6a2959ec552" status: 200 len: 1518 microversion: 2.1 time: 0.159157 Aug 10 23:52:33.609364 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3148/6504] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:52:33 2022] GET /compute/v2.1/servers/b554bb32-6837-4279-8872-d6a2959ec552 => generated 1518 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:52:34.631621 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-d1b94081-ac53-46da-90f9-39a3d915a55c tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:52:34.632320 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-d1b94081-ac53-46da-90f9-39a3d915a55c tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] [instance: b554bb32-6837-4279-8872-d6a2959ec552] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:52:34.639288 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d1b94081-ac53-46da-90f9-39a3d915a55c tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:52:34.639789 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d1b94081-ac53-46da-90f9-39a3d915a55c tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:52:34.640238 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d1b94081-ac53-46da-90f9-39a3d915a55c tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:52:34.640956 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d1b94081-ac53-46da-90f9-39a3d915a55c tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:52:34.641424 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d1b94081-ac53-46da-90f9-39a3d915a55c tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:52:34.641865 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d1b94081-ac53-46da-90f9-39a3d915a55c tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:52:34.781637 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-d1b94081-ac53-46da-90f9-39a3d915a55c tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b774b20640b8413eac15565a7f624108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2966ce3ee7fe4d49ae177c6a3a415421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:52:34.789455 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-d1b94081-ac53-46da-90f9-39a3d915a55c tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] 10.222.0.58 "GET /compute/v2.1/servers/b554bb32-6837-4279-8872-d6a2959ec552" status: 200 len: 1518 microversion: 2.1 time: 0.162416 Aug 10 23:52:34.790029 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3357/6505] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:52:34 2022] GET /compute/v2.1/servers/b554bb32-6837-4279-8872-d6a2959ec552 => generated 1518 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:52:35.811340 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-4647b852-503d-410f-8b9c-556650d4e9bb tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:52:35.811989 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-4647b852-503d-410f-8b9c-556650d4e9bb tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] [instance: b554bb32-6837-4279-8872-d6a2959ec552] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:52:35.819396 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4647b852-503d-410f-8b9c-556650d4e9bb tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:52:35.819883 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4647b852-503d-410f-8b9c-556650d4e9bb tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:52:35.820328 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4647b852-503d-410f-8b9c-556650d4e9bb tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:52:35.821027 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4647b852-503d-410f-8b9c-556650d4e9bb tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:52:35.821486 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4647b852-503d-410f-8b9c-556650d4e9bb tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:52:35.821918 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4647b852-503d-410f-8b9c-556650d4e9bb tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:52:35.957147 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-4647b852-503d-410f-8b9c-556650d4e9bb tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b774b20640b8413eac15565a7f624108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2966ce3ee7fe4d49ae177c6a3a415421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:52:35.964675 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-4647b852-503d-410f-8b9c-556650d4e9bb tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] 10.222.0.58 "GET /compute/v2.1/servers/b554bb32-6837-4279-8872-d6a2959ec552" status: 200 len: 1518 microversion: 2.1 time: 0.157270 Aug 10 23:52:35.965248 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3149/6506] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:52:35 2022] GET /compute/v2.1/servers/b554bb32-6837-4279-8872-d6a2959ec552 => generated 1518 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:52:36.985595 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-1eccd686-5325-4f25-bb70-9a029c42fae9 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:52:36.986229 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-1eccd686-5325-4f25-bb70-9a029c42fae9 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] [instance: b554bb32-6837-4279-8872-d6a2959ec552] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:52:36.989003 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:52:36.994584 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1eccd686-5325-4f25-bb70-9a029c42fae9 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:52:36.995123 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1eccd686-5325-4f25-bb70-9a029c42fae9 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:52:36.995576 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1eccd686-5325-4f25-bb70-9a029c42fae9 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:52:36.996301 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1eccd686-5325-4f25-bb70-9a029c42fae9 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:52:36.996774 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1eccd686-5325-4f25-bb70-9a029c42fae9 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:52:36.997221 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1eccd686-5325-4f25-bb70-9a029c42fae9 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:52:37.129209 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-1eccd686-5325-4f25-bb70-9a029c42fae9 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b774b20640b8413eac15565a7f624108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2966ce3ee7fe4d49ae177c6a3a415421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:52:37.136843 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-1eccd686-5325-4f25-bb70-9a029c42fae9 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] 10.222.0.58 "GET /compute/v2.1/servers/b554bb32-6837-4279-8872-d6a2959ec552" status: 200 len: 1518 microversion: 2.1 time: 0.155221 Aug 10 23:52:37.137426 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3358/6507] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:52:36 2022] GET /compute/v2.1/servers/b554bb32-6837-4279-8872-d6a2959ec552 => generated 1518 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:52:38.159175 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-04dc23cb-5dea-4fe8-b7c0-f3e8c27244c3 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:52:38.160103 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-04dc23cb-5dea-4fe8-b7c0-f3e8c27244c3 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] [instance: b554bb32-6837-4279-8872-d6a2959ec552] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:52:38.166864 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-04dc23cb-5dea-4fe8-b7c0-f3e8c27244c3 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:52:38.167339 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-04dc23cb-5dea-4fe8-b7c0-f3e8c27244c3 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:52:38.167770 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-04dc23cb-5dea-4fe8-b7c0-f3e8c27244c3 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:52:38.168479 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-04dc23cb-5dea-4fe8-b7c0-f3e8c27244c3 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:52:38.168949 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-04dc23cb-5dea-4fe8-b7c0-f3e8c27244c3 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:52:38.169381 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-04dc23cb-5dea-4fe8-b7c0-f3e8c27244c3 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:52:38.299924 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-04dc23cb-5dea-4fe8-b7c0-f3e8c27244c3 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b774b20640b8413eac15565a7f624108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2966ce3ee7fe4d49ae177c6a3a415421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:52:38.307392 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-04dc23cb-5dea-4fe8-b7c0-f3e8c27244c3 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] 10.222.0.58 "GET /compute/v2.1/servers/b554bb32-6837-4279-8872-d6a2959ec552" status: 200 len: 1518 microversion: 2.1 time: 0.152651 Aug 10 23:52:38.307964 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3150/6508] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:52:38 2022] GET /compute/v2.1/servers/b554bb32-6837-4279-8872-d6a2959ec552 => generated 1518 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:52:39.328774 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-d115e776-42f4-48d5-8cc4-97239234542a tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:52:39.329400 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-d115e776-42f4-48d5-8cc4-97239234542a tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] [instance: b554bb32-6837-4279-8872-d6a2959ec552] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:52:39.336698 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d115e776-42f4-48d5-8cc4-97239234542a tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:52:39.337196 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d115e776-42f4-48d5-8cc4-97239234542a tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:52:39.337651 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d115e776-42f4-48d5-8cc4-97239234542a tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:52:39.338375 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d115e776-42f4-48d5-8cc4-97239234542a tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:52:39.338868 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d115e776-42f4-48d5-8cc4-97239234542a tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:52:39.339312 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d115e776-42f4-48d5-8cc4-97239234542a tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:52:39.476226 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-d115e776-42f4-48d5-8cc4-97239234542a tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b774b20640b8413eac15565a7f624108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2966ce3ee7fe4d49ae177c6a3a415421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:52:39.483882 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-d115e776-42f4-48d5-8cc4-97239234542a tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] 10.222.0.58 "GET /compute/v2.1/servers/b554bb32-6837-4279-8872-d6a2959ec552" status: 200 len: 1518 microversion: 2.1 time: 0.159090 Aug 10 23:52:39.484459 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3359/6509] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:52:39 2022] GET /compute/v2.1/servers/b554bb32-6837-4279-8872-d6a2959ec552 => generated 1518 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:52:40.506921 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-a7e09853-9927-4380-92dc-99cedcb3e830 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:52:40.507526 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-a7e09853-9927-4380-92dc-99cedcb3e830 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] [instance: b554bb32-6837-4279-8872-d6a2959ec552] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:52:40.514448 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a7e09853-9927-4380-92dc-99cedcb3e830 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:52:40.514964 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a7e09853-9927-4380-92dc-99cedcb3e830 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:52:40.515400 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a7e09853-9927-4380-92dc-99cedcb3e830 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:52:40.516103 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a7e09853-9927-4380-92dc-99cedcb3e830 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:52:40.516540 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a7e09853-9927-4380-92dc-99cedcb3e830 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:52:40.516992 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a7e09853-9927-4380-92dc-99cedcb3e830 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:52:40.653003 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-a7e09853-9927-4380-92dc-99cedcb3e830 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b774b20640b8413eac15565a7f624108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2966ce3ee7fe4d49ae177c6a3a415421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:52:40.661333 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-a7e09853-9927-4380-92dc-99cedcb3e830 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] 10.222.0.58 "GET /compute/v2.1/servers/b554bb32-6837-4279-8872-d6a2959ec552" status: 200 len: 1518 microversion: 2.1 time: 0.159299 Aug 10 23:52:40.661905 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3151/6510] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:52:40 2022] GET /compute/v2.1/servers/b554bb32-6837-4279-8872-d6a2959ec552 => generated 1518 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:52:41.681667 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-86fecbea-6af1-49e2-9435-5f1ef7f9e59b tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:52:41.682214 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-86fecbea-6af1-49e2-9435-5f1ef7f9e59b tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] [instance: b554bb32-6837-4279-8872-d6a2959ec552] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:52:41.689106 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-86fecbea-6af1-49e2-9435-5f1ef7f9e59b tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:52:41.689607 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-86fecbea-6af1-49e2-9435-5f1ef7f9e59b tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:52:41.690099 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-86fecbea-6af1-49e2-9435-5f1ef7f9e59b tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:52:41.690839 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-86fecbea-6af1-49e2-9435-5f1ef7f9e59b tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:52:41.691821 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-86fecbea-6af1-49e2-9435-5f1ef7f9e59b tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:52:41.692265 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-86fecbea-6af1-49e2-9435-5f1ef7f9e59b tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:52:41.823299 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-86fecbea-6af1-49e2-9435-5f1ef7f9e59b tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b774b20640b8413eac15565a7f624108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2966ce3ee7fe4d49ae177c6a3a415421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:52:41.830813 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-86fecbea-6af1-49e2-9435-5f1ef7f9e59b tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] 10.222.0.58 "GET /compute/v2.1/servers/b554bb32-6837-4279-8872-d6a2959ec552" status: 200 len: 1518 microversion: 2.1 time: 0.153119 Aug 10 23:52:41.831375 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3360/6511] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:52:41 2022] GET /compute/v2.1/servers/b554bb32-6837-4279-8872-d6a2959ec552 => generated 1518 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:52:42.853032 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-960ab96e-edf9-4300-a49e-bef128aafe93 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:52:42.853628 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-960ab96e-edf9-4300-a49e-bef128aafe93 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] [instance: b554bb32-6837-4279-8872-d6a2959ec552] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:52:42.860581 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-960ab96e-edf9-4300-a49e-bef128aafe93 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:52:42.861056 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-960ab96e-edf9-4300-a49e-bef128aafe93 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:52:42.861486 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-960ab96e-edf9-4300-a49e-bef128aafe93 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:52:42.862165 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-960ab96e-edf9-4300-a49e-bef128aafe93 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:52:42.862610 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-960ab96e-edf9-4300-a49e-bef128aafe93 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:52:42.863908 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-960ab96e-edf9-4300-a49e-bef128aafe93 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:52:42.997462 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-960ab96e-edf9-4300-a49e-bef128aafe93 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b774b20640b8413eac15565a7f624108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2966ce3ee7fe4d49ae177c6a3a415421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:52:43.006490 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-960ab96e-edf9-4300-a49e-bef128aafe93 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] 10.222.0.58 "GET /compute/v2.1/servers/b554bb32-6837-4279-8872-d6a2959ec552" status: 200 len: 1518 microversion: 2.1 time: 0.157384 Aug 10 23:52:43.007172 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3152/6512] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:52:42 2022] GET /compute/v2.1/servers/b554bb32-6837-4279-8872-d6a2959ec552 => generated 1518 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:52:44.028379 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-a6386ebd-5c47-40bf-bad4-503e0bd345c7 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:52:44.029039 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-a6386ebd-5c47-40bf-bad4-503e0bd345c7 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] [instance: b554bb32-6837-4279-8872-d6a2959ec552] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:52:44.036353 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a6386ebd-5c47-40bf-bad4-503e0bd345c7 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:52:44.036850 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a6386ebd-5c47-40bf-bad4-503e0bd345c7 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:52:44.037302 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a6386ebd-5c47-40bf-bad4-503e0bd345c7 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:52:44.038016 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a6386ebd-5c47-40bf-bad4-503e0bd345c7 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:52:44.038485 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a6386ebd-5c47-40bf-bad4-503e0bd345c7 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:52:44.038953 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a6386ebd-5c47-40bf-bad4-503e0bd345c7 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:52:44.168117 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-a6386ebd-5c47-40bf-bad4-503e0bd345c7 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b774b20640b8413eac15565a7f624108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2966ce3ee7fe4d49ae177c6a3a415421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:52:44.175987 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-a6386ebd-5c47-40bf-bad4-503e0bd345c7 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] 10.222.0.58 "GET /compute/v2.1/servers/b554bb32-6837-4279-8872-d6a2959ec552" status: 200 len: 1518 microversion: 2.1 time: 0.151229 Aug 10 23:52:44.176322 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3361/6513] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:52:44 2022] GET /compute/v2.1/servers/b554bb32-6837-4279-8872-d6a2959ec552 => generated 1518 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:52:45.197072 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c2afcfdf-7e68-49af-85a2-67498c786f25 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:52:45.197683 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-c2afcfdf-7e68-49af-85a2-67498c786f25 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] [instance: b554bb32-6837-4279-8872-d6a2959ec552] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:52:45.204562 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c2afcfdf-7e68-49af-85a2-67498c786f25 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:52:45.205044 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c2afcfdf-7e68-49af-85a2-67498c786f25 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:52:45.205486 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c2afcfdf-7e68-49af-85a2-67498c786f25 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:52:45.206177 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c2afcfdf-7e68-49af-85a2-67498c786f25 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:52:45.207135 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c2afcfdf-7e68-49af-85a2-67498c786f25 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:52:45.207606 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c2afcfdf-7e68-49af-85a2-67498c786f25 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:52:45.341834 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-c2afcfdf-7e68-49af-85a2-67498c786f25 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b774b20640b8413eac15565a7f624108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2966ce3ee7fe4d49ae177c6a3a415421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:52:45.351453 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-c2afcfdf-7e68-49af-85a2-67498c786f25 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] 10.222.0.58 "GET /compute/v2.1/servers/b554bb32-6837-4279-8872-d6a2959ec552" status: 200 len: 1518 microversion: 2.1 time: 0.157669 Aug 10 23:52:45.352031 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3153/6514] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:52:45 2022] GET /compute/v2.1/servers/b554bb32-6837-4279-8872-d6a2959ec552 => generated 1518 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:52:46.373617 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-ea7a8865-bb4a-40c2-a50d-087fe9612b34 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:52:46.374128 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-ea7a8865-bb4a-40c2-a50d-087fe9612b34 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] [instance: b554bb32-6837-4279-8872-d6a2959ec552] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:52:46.381765 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ea7a8865-bb4a-40c2-a50d-087fe9612b34 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:52:46.382255 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ea7a8865-bb4a-40c2-a50d-087fe9612b34 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:52:46.382703 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ea7a8865-bb4a-40c2-a50d-087fe9612b34 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:52:46.383438 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ea7a8865-bb4a-40c2-a50d-087fe9612b34 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:52:46.383905 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ea7a8865-bb4a-40c2-a50d-087fe9612b34 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:52:46.384339 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ea7a8865-bb4a-40c2-a50d-087fe9612b34 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:52:46.520970 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-ea7a8865-bb4a-40c2-a50d-087fe9612b34 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b774b20640b8413eac15565a7f624108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2966ce3ee7fe4d49ae177c6a3a415421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:52:46.529004 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-ea7a8865-bb4a-40c2-a50d-087fe9612b34 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] 10.222.0.58 "GET /compute/v2.1/servers/b554bb32-6837-4279-8872-d6a2959ec552" status: 200 len: 1518 microversion: 2.1 time: 0.159620 Aug 10 23:52:46.529586 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3362/6515] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:52:46 2022] GET /compute/v2.1/servers/b554bb32-6837-4279-8872-d6a2959ec552 => generated 1518 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:52:47.551756 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-8a458fa5-b65f-4ab0-b526-233e9512b7fc tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:52:47.552404 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-8a458fa5-b65f-4ab0-b526-233e9512b7fc tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] [instance: b554bb32-6837-4279-8872-d6a2959ec552] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:52:47.559253 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8a458fa5-b65f-4ab0-b526-233e9512b7fc tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:52:47.559740 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8a458fa5-b65f-4ab0-b526-233e9512b7fc tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:52:47.560180 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8a458fa5-b65f-4ab0-b526-233e9512b7fc tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:52:47.560874 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8a458fa5-b65f-4ab0-b526-233e9512b7fc tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:52:47.561329 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8a458fa5-b65f-4ab0-b526-233e9512b7fc tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:52:47.561755 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8a458fa5-b65f-4ab0-b526-233e9512b7fc tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:52:47.696967 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-8a458fa5-b65f-4ab0-b526-233e9512b7fc tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b774b20640b8413eac15565a7f624108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2966ce3ee7fe4d49ae177c6a3a415421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:52:47.704454 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-8a458fa5-b65f-4ab0-b526-233e9512b7fc tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] 10.222.0.58 "GET /compute/v2.1/servers/b554bb32-6837-4279-8872-d6a2959ec552" status: 200 len: 1518 microversion: 2.1 time: 0.157172 Aug 10 23:52:47.705023 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3154/6516] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:52:47 2022] GET /compute/v2.1/servers/b554bb32-6837-4279-8872-d6a2959ec552 => generated 1518 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:52:48.726423 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-ebc1475a-6578-4f6d-9639-23d93a9523bc tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:52:48.727174 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-ebc1475a-6578-4f6d-9639-23d93a9523bc tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] [instance: b554bb32-6837-4279-8872-d6a2959ec552] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:52:48.734139 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ebc1475a-6578-4f6d-9639-23d93a9523bc tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:52:48.734645 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ebc1475a-6578-4f6d-9639-23d93a9523bc tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:52:48.735138 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ebc1475a-6578-4f6d-9639-23d93a9523bc tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:52:48.735859 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ebc1475a-6578-4f6d-9639-23d93a9523bc tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:52:48.736339 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ebc1475a-6578-4f6d-9639-23d93a9523bc tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:52:48.736786 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ebc1475a-6578-4f6d-9639-23d93a9523bc tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:52:48.868217 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-ebc1475a-6578-4f6d-9639-23d93a9523bc tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b774b20640b8413eac15565a7f624108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2966ce3ee7fe4d49ae177c6a3a415421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:52:48.876169 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-ebc1475a-6578-4f6d-9639-23d93a9523bc tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] 10.222.0.58 "GET /compute/v2.1/servers/b554bb32-6837-4279-8872-d6a2959ec552" status: 200 len: 1518 microversion: 2.1 time: 0.153896 Aug 10 23:52:48.877061 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3363/6517] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:52:48 2022] GET /compute/v2.1/servers/b554bb32-6837-4279-8872-d6a2959ec552 => generated 1518 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:52:49.898017 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-e4ea1235-09e5-42bd-8019-36f9c26ae111 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:52:49.898583 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-e4ea1235-09e5-42bd-8019-36f9c26ae111 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] [instance: b554bb32-6837-4279-8872-d6a2959ec552] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:52:49.905315 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e4ea1235-09e5-42bd-8019-36f9c26ae111 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:52:49.905792 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e4ea1235-09e5-42bd-8019-36f9c26ae111 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:52:49.906226 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e4ea1235-09e5-42bd-8019-36f9c26ae111 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:52:49.906956 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e4ea1235-09e5-42bd-8019-36f9c26ae111 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:52:49.907417 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e4ea1235-09e5-42bd-8019-36f9c26ae111 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:52:49.907840 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e4ea1235-09e5-42bd-8019-36f9c26ae111 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:52:50.040027 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-e4ea1235-09e5-42bd-8019-36f9c26ae111 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b774b20640b8413eac15565a7f624108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2966ce3ee7fe4d49ae177c6a3a415421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:52:50.047682 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-e4ea1235-09e5-42bd-8019-36f9c26ae111 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] 10.222.0.58 "GET /compute/v2.1/servers/b554bb32-6837-4279-8872-d6a2959ec552" status: 200 len: 1518 microversion: 2.1 time: 0.153932 Aug 10 23:52:50.048299 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3155/6518] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:52:49 2022] GET /compute/v2.1/servers/b554bb32-6837-4279-8872-d6a2959ec552 => generated 1518 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:52:51.063806 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-3804db1f-6dd3-4e2e-b4f1-f70c5e691ee7 req-fe9b0839-10f2-4722-a22c-f68f4e2e5b50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b554bb32-6837-4279-8872-d6a2959ec552", "name": "network-vif-unplugged", "status": "completed", "tag": "9a1bb0e9-b8ac-4be3-bdb5-a596118d59aa"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:52:51.069891 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-f56fbe72-f1dd-4b2f-ab07-77eece957f0c tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:52:51.070533 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-f56fbe72-f1dd-4b2f-ab07-77eece957f0c tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] [instance: b554bb32-6837-4279-8872-d6a2959ec552] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:52:51.074564 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-3804db1f-6dd3-4e2e-b4f1-f70c5e691ee7 req-fe9b0839-10f2-4722-a22c-f68f4e2e5b50 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:52:51.075100 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-3804db1f-6dd3-4e2e-b4f1-f70c5e691ee7 req-fe9b0839-10f2-4722-a22c-f68f4e2e5b50 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:52:51.075729 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-3804db1f-6dd3-4e2e-b4f1-f70c5e691ee7 req-fe9b0839-10f2-4722-a22c-f68f4e2e5b50 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:52:51.077787 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f56fbe72-f1dd-4b2f-ab07-77eece957f0c tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:52:51.078268 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f56fbe72-f1dd-4b2f-ab07-77eece957f0c tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:52:51.078703 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f56fbe72-f1dd-4b2f-ab07-77eece957f0c tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:52:51.079414 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f56fbe72-f1dd-4b2f-ab07-77eece957f0c tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:52:51.080186 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f56fbe72-f1dd-4b2f-ab07-77eece957f0c tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:52:51.080682 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f56fbe72-f1dd-4b2f-ab07-77eece957f0c tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:52:51.090305 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-3804db1f-6dd3-4e2e-b4f1-f70c5e691ee7 req-fe9b0839-10f2-4722-a22c-f68f4e2e5b50 service nova] Creating event network-vif-unplugged:9a1bb0e9-b8ac-4be3-bdb5-a596118d59aa for instance b554bb32-6837-4279-8872-d6a2959ec552 on n-h1-850468-14 Aug 10 23:52:51.096424 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [req-3804db1f-6dd3-4e2e-b4f1-f70c5e691ee7 req-fe9b0839-10f2-4722-a22c-f68f4e2e5b50 service nova] Instance b554bb32-6837-4279-8872-d6a2959ec552 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-850468-14', 'n-h2-850468-14'} {{(pid=122633) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5901}} Aug 10 23:52:51.109712 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-3804db1f-6dd3-4e2e-b4f1-f70c5e691ee7 req-fe9b0839-10f2-4722-a22c-f68f4e2e5b50 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.122722 Aug 10 23:52:51.110970 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3364/6519] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:52:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:52:51.287778 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-f56fbe72-f1dd-4b2f-ab07-77eece957f0c tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b774b20640b8413eac15565a7f624108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2966ce3ee7fe4d49ae177c6a3a415421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:52:51.295865 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-f56fbe72-f1dd-4b2f-ab07-77eece957f0c tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] 10.222.0.58 "GET /compute/v2.1/servers/b554bb32-6837-4279-8872-d6a2959ec552" status: 200 len: 1517 microversion: 2.1 time: 0.230119 Aug 10 23:52:51.296451 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3156/6520] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:52:51 2022] GET /compute/v2.1/servers/b554bb32-6837-4279-8872-d6a2959ec552 => generated 1517 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:52:52.320080 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-eae613fb-38c2-4d5c-9c8a-60eee89a18ba tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:52:52.320787 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-eae613fb-38c2-4d5c-9c8a-60eee89a18ba tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] [instance: b554bb32-6837-4279-8872-d6a2959ec552] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:52:52.327003 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-eae613fb-38c2-4d5c-9c8a-60eee89a18ba tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:52:52.327526 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-eae613fb-38c2-4d5c-9c8a-60eee89a18ba tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:52:52.327975 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-eae613fb-38c2-4d5c-9c8a-60eee89a18ba tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:52:52.328684 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-eae613fb-38c2-4d5c-9c8a-60eee89a18ba tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:52:52.329148 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-eae613fb-38c2-4d5c-9c8a-60eee89a18ba tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:52:52.329584 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-eae613fb-38c2-4d5c-9c8a-60eee89a18ba tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:52:52.334599 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:52:52.468725 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-eae613fb-38c2-4d5c-9c8a-60eee89a18ba tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b774b20640b8413eac15565a7f624108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2966ce3ee7fe4d49ae177c6a3a415421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:52:52.476485 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-eae613fb-38c2-4d5c-9c8a-60eee89a18ba tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] 10.222.0.58 "GET /compute/v2.1/servers/b554bb32-6837-4279-8872-d6a2959ec552" status: 200 len: 1515 microversion: 2.1 time: 0.162538 Aug 10 23:52:52.477063 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3365/6521] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:52:52 2022] GET /compute/v2.1/servers/b554bb32-6837-4279-8872-d6a2959ec552 => generated 1515 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:52:53.136590 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-d0363363-316f-4103-b8c6-31b143e0c593 req-34ef3448-0ee0-4009-928c-fd5b5731e529 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b554bb32-6837-4279-8872-d6a2959ec552", "tag": "9a1bb0e9-b8ac-4be3-bdb5-a596118d59aa"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:52:53.147247 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-d0363363-316f-4103-b8c6-31b143e0c593 req-34ef3448-0ee0-4009-928c-fd5b5731e529 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:52:53.147715 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-d0363363-316f-4103-b8c6-31b143e0c593 req-34ef3448-0ee0-4009-928c-fd5b5731e529 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:52:53.148138 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-d0363363-316f-4103-b8c6-31b143e0c593 req-34ef3448-0ee0-4009-928c-fd5b5731e529 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:52:53.163066 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-d0363363-316f-4103-b8c6-31b143e0c593 req-34ef3448-0ee0-4009-928c-fd5b5731e529 service nova] Creating event network-changed:9a1bb0e9-b8ac-4be3-bdb5-a596118d59aa for instance b554bb32-6837-4279-8872-d6a2959ec552 on n-h1-850468-14 Aug 10 23:52:53.168249 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [req-d0363363-316f-4103-b8c6-31b143e0c593 req-34ef3448-0ee0-4009-928c-fd5b5731e529 service nova] Instance b554bb32-6837-4279-8872-d6a2959ec552 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-850468-14', 'n-h2-850468-14'} {{(pid=122632) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5901}} Aug 10 23:52:53.179637 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-d0363363-316f-4103-b8c6-31b143e0c593 req-34ef3448-0ee0-4009-928c-fd5b5731e529 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046795 Aug 10 23:52:53.180216 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3157/6522] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:52:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:52:53.497802 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c834f96d-670a-4a3e-869d-b0f912c598b9 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:52:53.498680 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-c834f96d-670a-4a3e-869d-b0f912c598b9 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] [instance: b554bb32-6837-4279-8872-d6a2959ec552] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:52:53.506195 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c834f96d-670a-4a3e-869d-b0f912c598b9 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:52:53.506695 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c834f96d-670a-4a3e-869d-b0f912c598b9 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:52:53.507171 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c834f96d-670a-4a3e-869d-b0f912c598b9 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:52:53.507960 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c834f96d-670a-4a3e-869d-b0f912c598b9 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:52:53.508427 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c834f96d-670a-4a3e-869d-b0f912c598b9 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:52:53.508865 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c834f96d-670a-4a3e-869d-b0f912c598b9 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:52:53.648063 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-c834f96d-670a-4a3e-869d-b0f912c598b9 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b774b20640b8413eac15565a7f624108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2966ce3ee7fe4d49ae177c6a3a415421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:52:53.656085 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-c834f96d-670a-4a3e-869d-b0f912c598b9 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] 10.222.0.58 "GET /compute/v2.1/servers/b554bb32-6837-4279-8872-d6a2959ec552" status: 200 len: 1512 microversion: 2.1 time: 0.162210 Aug 10 23:52:53.656942 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3366/6523] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:52:53 2022] GET /compute/v2.1/servers/b554bb32-6837-4279-8872-d6a2959ec552 => generated 1512 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:52:53.677704 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-55b176a9-a45a-4279-bb61-1ba9712fda04 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:52:53.678329 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-55b176a9-a45a-4279-bb61-1ba9712fda04 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] [instance: b554bb32-6837-4279-8872-d6a2959ec552] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:52:53.684724 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-55b176a9-a45a-4279-bb61-1ba9712fda04 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:52:53.685246 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-55b176a9-a45a-4279-bb61-1ba9712fda04 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:52:53.685692 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-55b176a9-a45a-4279-bb61-1ba9712fda04 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:52:53.686400 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-55b176a9-a45a-4279-bb61-1ba9712fda04 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:52:53.686881 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-55b176a9-a45a-4279-bb61-1ba9712fda04 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:52:53.687310 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-55b176a9-a45a-4279-bb61-1ba9712fda04 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:52:53.748565 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-55b176a9-a45a-4279-bb61-1ba9712fda04 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] 10.222.0.58 "POST /compute/v2.1/servers/b554bb32-6837-4279-8872-d6a2959ec552/action" status: 204 len: 0 microversion: 2.1 time: 0.074777 Aug 10 23:52:53.750936 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3158/6524] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:52:53 2022] POST /compute/v2.1/servers/b554bb32-6837-4279-8872-d6a2959ec552/action => generated 0 bytes in 77 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:52:53.764797 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-33fb6184-31f0-4c39-bc5d-1cb1aaaf057d tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:52:53.765685 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-33fb6184-31f0-4c39-bc5d-1cb1aaaf057d tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] [instance: b554bb32-6837-4279-8872-d6a2959ec552] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:52:53.774422 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-33fb6184-31f0-4c39-bc5d-1cb1aaaf057d tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:52:53.775227 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-33fb6184-31f0-4c39-bc5d-1cb1aaaf057d tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:52:53.775801 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-33fb6184-31f0-4c39-bc5d-1cb1aaaf057d tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:52:53.776551 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-33fb6184-31f0-4c39-bc5d-1cb1aaaf057d tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:52:53.777046 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-33fb6184-31f0-4c39-bc5d-1cb1aaaf057d tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:52:53.777484 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-33fb6184-31f0-4c39-bc5d-1cb1aaaf057d tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:52:54.036486 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-33fb6184-31f0-4c39-bc5d-1cb1aaaf057d tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b774b20640b8413eac15565a7f624108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2966ce3ee7fe4d49ae177c6a3a415421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:52:54.049062 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-33fb6184-31f0-4c39-bc5d-1cb1aaaf057d tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] 10.222.0.58 "GET /compute/v2.1/servers/b554bb32-6837-4279-8872-d6a2959ec552" status: 200 len: 1512 microversion: 2.1 time: 0.290800 Aug 10 23:52:54.063844 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3367/6525] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:52:53 2022] GET /compute/v2.1/servers/b554bb32-6837-4279-8872-d6a2959ec552 => generated 1512 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:52:55.074313 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-4f510b8b-cbfb-4bc4-8813-e517941811f8 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:52:55.074956 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-4f510b8b-cbfb-4bc4-8813-e517941811f8 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] [instance: b554bb32-6837-4279-8872-d6a2959ec552] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:52:55.082459 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4f510b8b-cbfb-4bc4-8813-e517941811f8 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:52:55.083268 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4f510b8b-cbfb-4bc4-8813-e517941811f8 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:52:55.083758 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4f510b8b-cbfb-4bc4-8813-e517941811f8 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:52:55.084433 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4f510b8b-cbfb-4bc4-8813-e517941811f8 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:52:55.084886 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4f510b8b-cbfb-4bc4-8813-e517941811f8 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:52:55.085313 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4f510b8b-cbfb-4bc4-8813-e517941811f8 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:52:55.215599 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-4f510b8b-cbfb-4bc4-8813-e517941811f8 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b774b20640b8413eac15565a7f624108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2966ce3ee7fe4d49ae177c6a3a415421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:52:55.223548 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-4f510b8b-cbfb-4bc4-8813-e517941811f8 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] 10.222.0.58 "GET /compute/v2.1/servers/b554bb32-6837-4279-8872-d6a2959ec552" status: 200 len: 1512 microversion: 2.1 time: 0.153746 Aug 10 23:52:55.224117 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3159/6526] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:52:55 2022] GET /compute/v2.1/servers/b554bb32-6837-4279-8872-d6a2959ec552 => generated 1512 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:52:55.979487 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-35f48398-140d-485b-8e02-7b0094fd55ee req-e38250d4-4be9-49bb-bc4d-4e1f05f662ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b554bb32-6837-4279-8872-d6a2959ec552", "name": "network-vif-plugged", "status": "completed", "tag": "9a1bb0e9-b8ac-4be3-bdb5-a596118d59aa"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:52:55.992084 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-35f48398-140d-485b-8e02-7b0094fd55ee req-e38250d4-4be9-49bb-bc4d-4e1f05f662ba service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:52:55.993309 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-35f48398-140d-485b-8e02-7b0094fd55ee req-e38250d4-4be9-49bb-bc4d-4e1f05f662ba service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:52:55.993779 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-35f48398-140d-485b-8e02-7b0094fd55ee req-e38250d4-4be9-49bb-bc4d-4e1f05f662ba service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:52:56.005783 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-35f48398-140d-485b-8e02-7b0094fd55ee req-e38250d4-4be9-49bb-bc4d-4e1f05f662ba service nova] Creating event network-vif-plugged:9a1bb0e9-b8ac-4be3-bdb5-a596118d59aa for instance b554bb32-6837-4279-8872-d6a2959ec552 on n-h1-850468-14 Aug 10 23:52:56.010951 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-35f48398-140d-485b-8e02-7b0094fd55ee req-e38250d4-4be9-49bb-bc4d-4e1f05f662ba service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035611 Aug 10 23:52:56.011778 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3368/6527] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:52:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:52:56.245157 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-7fbca3a5-a015-46c0-9498-f4e3980224a3 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:52:56.245713 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-7fbca3a5-a015-46c0-9498-f4e3980224a3 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] [instance: b554bb32-6837-4279-8872-d6a2959ec552] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:52:56.252894 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7fbca3a5-a015-46c0-9498-f4e3980224a3 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:52:56.253381 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7fbca3a5-a015-46c0-9498-f4e3980224a3 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:52:56.253873 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7fbca3a5-a015-46c0-9498-f4e3980224a3 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:52:56.254813 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7fbca3a5-a015-46c0-9498-f4e3980224a3 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:52:56.255284 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7fbca3a5-a015-46c0-9498-f4e3980224a3 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:52:56.255716 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7fbca3a5-a015-46c0-9498-f4e3980224a3 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:52:56.387154 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-7fbca3a5-a015-46c0-9498-f4e3980224a3 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b774b20640b8413eac15565a7f624108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2966ce3ee7fe4d49ae177c6a3a415421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:52:56.395266 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-7fbca3a5-a015-46c0-9498-f4e3980224a3 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] 10.222.0.58 "GET /compute/v2.1/servers/b554bb32-6837-4279-8872-d6a2959ec552" status: 200 len: 1504 microversion: 2.1 time: 0.154031 Aug 10 23:52:56.395857 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3160/6528] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:52:56 2022] GET /compute/v2.1/servers/b554bb32-6837-4279-8872-d6a2959ec552 => generated 1504 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:52:56.416830 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-208d7fed-6af4-4a6b-a906-6260e8c96a04 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:52:56.417546 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-208d7fed-6af4-4a6b-a906-6260e8c96a04 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] [instance: b554bb32-6837-4279-8872-d6a2959ec552] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:52:56.423817 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-208d7fed-6af4-4a6b-a906-6260e8c96a04 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:52:56.424320 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-208d7fed-6af4-4a6b-a906-6260e8c96a04 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:52:56.424775 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-208d7fed-6af4-4a6b-a906-6260e8c96a04 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:52:56.425690 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-208d7fed-6af4-4a6b-a906-6260e8c96a04 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:52:56.426114 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-208d7fed-6af4-4a6b-a906-6260e8c96a04 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:52:56.426555 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-208d7fed-6af4-4a6b-a906-6260e8c96a04 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:52:56.565558 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-208d7fed-6af4-4a6b-a906-6260e8c96a04 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b774b20640b8413eac15565a7f624108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2966ce3ee7fe4d49ae177c6a3a415421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:52:56.573490 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-208d7fed-6af4-4a6b-a906-6260e8c96a04 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] 10.222.0.58 "GET /compute/v2.1/servers/b554bb32-6837-4279-8872-d6a2959ec552" status: 200 len: 1504 microversion: 2.1 time: 0.160943 Aug 10 23:52:56.574083 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3369/6529] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:52:56 2022] GET /compute/v2.1/servers/b554bb32-6837-4279-8872-d6a2959ec552 => generated 1504 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:52:56.594013 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-f98e28b6-2eaf-4fb1-8954-38041298ee17 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:52:56.594619 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-f98e28b6-2eaf-4fb1-8954-38041298ee17 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] [instance: b554bb32-6837-4279-8872-d6a2959ec552] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:52:56.601913 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f98e28b6-2eaf-4fb1-8954-38041298ee17 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:52:56.602502 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f98e28b6-2eaf-4fb1-8954-38041298ee17 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:52:56.603050 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f98e28b6-2eaf-4fb1-8954-38041298ee17 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:52:56.603878 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f98e28b6-2eaf-4fb1-8954-38041298ee17 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:52:56.604399 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f98e28b6-2eaf-4fb1-8954-38041298ee17 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:52:56.604898 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f98e28b6-2eaf-4fb1-8954-38041298ee17 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:52:56.741216 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-f98e28b6-2eaf-4fb1-8954-38041298ee17 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b774b20640b8413eac15565a7f624108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2966ce3ee7fe4d49ae177c6a3a415421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:52:56.749155 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-f98e28b6-2eaf-4fb1-8954-38041298ee17 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] 10.222.0.58 "GET /compute/v2.1/servers/b554bb32-6837-4279-8872-d6a2959ec552" status: 200 len: 1504 microversion: 2.1 time: 0.158954 Aug 10 23:52:56.749808 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3161/6530] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:52:56 2022] GET /compute/v2.1/servers/b554bb32-6837-4279-8872-d6a2959ec552 => generated 1504 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:52:56.770100 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-251eb38a-9a1a-491d-b0e2-9451852bd943 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:52:56.770550 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-251eb38a-9a1a-491d-b0e2-9451852bd943 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] [instance: b554bb32-6837-4279-8872-d6a2959ec552] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:52:56.777193 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-251eb38a-9a1a-491d-b0e2-9451852bd943 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:52:56.777697 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-251eb38a-9a1a-491d-b0e2-9451852bd943 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:52:56.778152 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-251eb38a-9a1a-491d-b0e2-9451852bd943 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:52:56.778899 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-251eb38a-9a1a-491d-b0e2-9451852bd943 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:52:56.779376 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-251eb38a-9a1a-491d-b0e2-9451852bd943 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:52:56.779819 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-251eb38a-9a1a-491d-b0e2-9451852bd943 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:52:56.805841 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-251eb38a-9a1a-491d-b0e2-9451852bd943 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] [instance: b554bb32-6837-4279-8872-d6a2959ec552] Going to try to terminate instance {{(pid=122633) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:52:56.880756 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-251eb38a-9a1a-491d-b0e2-9451852bd943 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] 10.222.0.58 "DELETE /compute/v2.1/servers/b554bb32-6837-4279-8872-d6a2959ec552" status: 204 len: 0 microversion: 2.1 time: 0.114581 Aug 10 23:52:56.881536 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3370/6531] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:52:56 2022] DELETE /compute/v2.1/servers/b554bb32-6837-4279-8872-d6a2959ec552 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:52:56.898794 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-bb327127-5ca2-4bee-ad79-659d95805e3d tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:52:56.899313 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-bb327127-5ca2-4bee-ad79-659d95805e3d tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] [instance: b554bb32-6837-4279-8872-d6a2959ec552] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:52:56.905363 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bb327127-5ca2-4bee-ad79-659d95805e3d tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:52:56.905843 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bb327127-5ca2-4bee-ad79-659d95805e3d tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:52:56.906282 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bb327127-5ca2-4bee-ad79-659d95805e3d tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:52:56.906999 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bb327127-5ca2-4bee-ad79-659d95805e3d tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:52:56.907455 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bb327127-5ca2-4bee-ad79-659d95805e3d tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:52:56.907880 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bb327127-5ca2-4bee-ad79-659d95805e3d tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:52:56.911091 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:52:56.936722 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-bb327127-5ca2-4bee-ad79-659d95805e3d tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] [instance: b554bb32-6837-4279-8872-d6a2959ec552] Going to try to terminate instance {{(pid=122632) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:52:56.981838 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.compute.api [None req-bb327127-5ca2-4bee-ad79-659d95805e3d tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] [instance: b554bb32-6837-4279-8872-d6a2959ec552] Instance is already in deleting state, ignoring this request Aug 10 23:52:56.982650 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-bb327127-5ca2-4bee-ad79-659d95805e3d tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] 10.222.0.58 "DELETE /compute/v2.1/servers/b554bb32-6837-4279-8872-d6a2959ec552" status: 204 len: 0 microversion: 2.1 time: 0.087949 Aug 10 23:52:56.983252 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3162/6532] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:52:56 2022] DELETE /compute/v2.1/servers/b554bb32-6837-4279-8872-d6a2959ec552 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:52:56.992008 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-8576d524-a208-4d98-91c6-297ff70f01b1 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:52:56.992728 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-8576d524-a208-4d98-91c6-297ff70f01b1 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] [instance: b554bb32-6837-4279-8872-d6a2959ec552] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:52:57.000222 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8576d524-a208-4d98-91c6-297ff70f01b1 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:52:57.000721 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8576d524-a208-4d98-91c6-297ff70f01b1 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:52:57.001178 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8576d524-a208-4d98-91c6-297ff70f01b1 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:52:57.001890 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8576d524-a208-4d98-91c6-297ff70f01b1 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:52:57.002356 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8576d524-a208-4d98-91c6-297ff70f01b1 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:52:57.002814 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8576d524-a208-4d98-91c6-297ff70f01b1 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:52:57.134293 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-8576d524-a208-4d98-91c6-297ff70f01b1 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b774b20640b8413eac15565a7f624108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2966ce3ee7fe4d49ae177c6a3a415421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:52:57.142327 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-8576d524-a208-4d98-91c6-297ff70f01b1 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] 10.222.0.58 "GET /compute/v2.1/servers/b554bb32-6837-4279-8872-d6a2959ec552" status: 200 len: 1510 microversion: 2.1 time: 0.154586 Aug 10 23:52:57.142965 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3371/6533] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:52:56 2022] GET /compute/v2.1/servers/b554bb32-6837-4279-8872-d6a2959ec552 => generated 1510 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:52:58.164650 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-d8250c63-40ea-433a-a7c8-5eb2bfbcce2c tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:52:58.165271 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-d8250c63-40ea-433a-a7c8-5eb2bfbcce2c tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] [instance: b554bb32-6837-4279-8872-d6a2959ec552] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:52:58.172271 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d8250c63-40ea-433a-a7c8-5eb2bfbcce2c tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:52:58.172764 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d8250c63-40ea-433a-a7c8-5eb2bfbcce2c tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:52:58.173202 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d8250c63-40ea-433a-a7c8-5eb2bfbcce2c tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:52:58.173907 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d8250c63-40ea-433a-a7c8-5eb2bfbcce2c tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:52:58.174364 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d8250c63-40ea-433a-a7c8-5eb2bfbcce2c tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:52:58.174812 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d8250c63-40ea-433a-a7c8-5eb2bfbcce2c tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:52:58.408698 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-d8250c63-40ea-433a-a7c8-5eb2bfbcce2c tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b774b20640b8413eac15565a7f624108', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2966ce3ee7fe4d49ae177c6a3a415421', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:52:58.416999 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-d8250c63-40ea-433a-a7c8-5eb2bfbcce2c tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] 10.222.0.58 "GET /compute/v2.1/servers/b554bb32-6837-4279-8872-d6a2959ec552" status: 200 len: 1510 microversion: 2.1 time: 0.256196 Aug 10 23:52:58.417506 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3163/6534] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:52:58 2022] GET /compute/v2.1/servers/b554bb32-6837-4279-8872-d6a2959ec552 => generated 1510 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:52:58.697641 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-888685fc-e0a0-4ba6-8cf7-1ee35de8f75a req-27b6a259-2cae-4719-97f8-c5fe3769f9f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b554bb32-6837-4279-8872-d6a2959ec552", "name": "network-vif-deleted", "tag": "9a1bb0e9-b8ac-4be3-bdb5-a596118d59aa"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:52:58.714835 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-888685fc-e0a0-4ba6-8cf7-1ee35de8f75a req-27b6a259-2cae-4719-97f8-c5fe3769f9f2 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:52:58.715648 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-888685fc-e0a0-4ba6-8cf7-1ee35de8f75a req-27b6a259-2cae-4719-97f8-c5fe3769f9f2 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:52:58.716274 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-888685fc-e0a0-4ba6-8cf7-1ee35de8f75a req-27b6a259-2cae-4719-97f8-c5fe3769f9f2 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:52:58.728769 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-888685fc-e0a0-4ba6-8cf7-1ee35de8f75a req-27b6a259-2cae-4719-97f8-c5fe3769f9f2 service nova] Creating event network-vif-deleted:9a1bb0e9-b8ac-4be3-bdb5-a596118d59aa for instance b554bb32-6837-4279-8872-d6a2959ec552 on n-h1-850468-14 Aug 10 23:52:58.733464 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-888685fc-e0a0-4ba6-8cf7-1ee35de8f75a req-27b6a259-2cae-4719-97f8-c5fe3769f9f2 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039832 Aug 10 23:52:58.734087 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3372/6535] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:52:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 23:52:59.437632 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-3cf8b51e-10ad-4b85-a005-70383dcb7610 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:52:59.438245 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-3cf8b51e-10ad-4b85-a005-70383dcb7610 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] [instance: b554bb32-6837-4279-8872-d6a2959ec552] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:52:59.445547 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3cf8b51e-10ad-4b85-a005-70383dcb7610 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:52:59.446043 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3cf8b51e-10ad-4b85-a005-70383dcb7610 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:52:59.446481 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3cf8b51e-10ad-4b85-a005-70383dcb7610 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:52:59.447208 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3cf8b51e-10ad-4b85-a005-70383dcb7610 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:52:59.447696 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3cf8b51e-10ad-4b85-a005-70383dcb7610 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:52:59.448134 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3cf8b51e-10ad-4b85-a005-70383dcb7610 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:52:59.464682 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-3cf8b51e-10ad-4b85-a005-70383dcb7610 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] HTTP exception thrown: Instance b554bb32-6837-4279-8872-d6a2959ec552 could not be found. Aug 10 23:52:59.466342 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-3cf8b51e-10ad-4b85-a005-70383dcb7610 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Request method failure captured: Aug 10 23:52:59.466342 n-d-850468-14 devstack@n-api.service[122632]: request: GET /compute/v2.1/servers/b554bb32-6837-4279-8872-d6a2959ec552 HTTP/1.1 Aug 10 23:52:59.466342 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:52:59.466342 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:52:59.466342 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:52:59.466342 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 23:52:59.466342 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:52:59.466342 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:52:59.466342 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:52:59.466342 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:52:59.466342 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9ER5jy-BokhOJzT8ixS3n2BggXyBjR45j2YgyDgTUbTauU2HHdzlhsyLiya_dOzOU5aADzDgGO9D-fBQsq0lY1_sL2uXeUnojlBeweKU_rIY12Dcw6xVZbWlZkUZwqg3mvCks--NxvE5uqckKvFwFiKQJ62xgAHjbIS97PZufZY9rT0 Aug 10 23:52:59.466342 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:52:59.466342 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:52:59.466342 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:52:59.466342 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:52:59.466342 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:52:59.466342 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:52:59.466342 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 2966ce3ee7fe4d49ae177c6a3a415421 Aug 10 23:52:59.466342 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1091222409 Aug 10 23:52:59.466342 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:52:59.466342 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:52:59.466342 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2966ce3ee7fe4d49ae177c6a3a415421"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2966ce3ee7fe4d49ae177c6a3a415421"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2966ce3ee7fe4d49ae177c6a3a415421"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2966ce3ee7fe4d49ae177c6a3a415421", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:52:59.466342 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-ServerDiskConfigTestJSON-1091222409 Aug 10 23:52:59.466342 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 2966ce3ee7fe4d49ae177c6a3a415421 Aug 10 23:52:59.466342 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1091222409 Aug 10 23:52:59.466342 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-ServerDiskConfigTestJSON-1091222409-project Aug 10 23:52:59.466342 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:52:59.466342 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:52:59.466342 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: b774b20640b8413eac15565a7f624108 Aug 10 23:52:59.466342 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-ServerDiskConfigTestJSON-1091222409-project Aug 10 23:52:59.466342 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:52:59.466342 n-d-850468-14 devstack@n-api.service[122632]: exception: Instance b554bb32-6837-4279-8872-d6a2959ec552 could not be found. Aug 10 23:52:59.466342 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': 'b554bb32-6837-4279-8872-d6a2959ec552'} Aug 10 23:52:59.466342 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:52:59.466342 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:52:59.466342 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:52:59.466342 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:52:59.466342 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:52:59.466342 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:52:59.466342 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:52:59.466342 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:52:59.466342 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:52:59.466342 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:52:59.466342 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b554bb32-6837-4279-8872-d6a2959ec552 could not be found. Aug 10 23:52:59.466342 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:52:59.466342 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:52:59.466342 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:52:59.466342 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:52:59.466342 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:52:59.466342 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:52:59.466342 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:52:59.466342 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:52:59.466342 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:52:59.466342 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:52:59.466342 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:52:59.466342 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:52:59.466342 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:52:59.466342 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:52:59.466342 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:52:59.466342 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:52:59.466342 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b554bb32-6837-4279-8872-d6a2959ec552 could not be found. Aug 10 23:52:59.466342 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:52:59.466342 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:52:59.466342 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:52:59.470704 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:52:59.470704 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:52:59.470704 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:52:59.470704 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:52:59.470704 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:52:59.470704 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b554bb32-6837-4279-8872-d6a2959ec552 could not be found. Aug 10 23:52:59.470704 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:52:59.470704 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-3cf8b51e-10ad-4b85-a005-70383dcb7610 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Returning 404 to user: Instance b554bb32-6837-4279-8872-d6a2959ec552 could not be found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:52:59.470704 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-3cf8b51e-10ad-4b85-a005-70383dcb7610 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] 10.222.0.58 "GET /compute/v2.1/servers/b554bb32-6837-4279-8872-d6a2959ec552" status: 404 len: 111 microversion: 2.1 time: 0.034028 Aug 10 23:52:59.470704 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3164/6536] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:52:59 2022] GET /compute/v2.1/servers/b554bb32-6837-4279-8872-d6a2959ec552 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:52:59.478090 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-5f58e9d8-a54a-4db8-a07b-5870da442b13 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Calling method '.version_select at 0x7f847c01c0d0>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:52:59.499556 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-5f58e9d8-a54a-4db8-a07b-5870da442b13 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1840999950" status: 202 len: 0 microversion: 2.1 time: 0.025689 Aug 10 23:52:59.500183 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3373/6537] 10.222.0.58 () {58 vars in 1221 bytes} [Wed Aug 10 23:52:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1840999950 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 10 23:53:00.118375 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-576bc3b6-ae61-4804-9b0a-75415f9774ed tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:53:00.118906 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-576bc3b6-ae61-4804-9b0a-75415f9774ed tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] [instance: aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:53:00.125123 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-576bc3b6-ae61-4804-9b0a-75415f9774ed tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:53:00.125603 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-576bc3b6-ae61-4804-9b0a-75415f9774ed tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:53:00.126038 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-576bc3b6-ae61-4804-9b0a-75415f9774ed tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:53:00.126723 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-576bc3b6-ae61-4804-9b0a-75415f9774ed tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:53:00.127202 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-576bc3b6-ae61-4804-9b0a-75415f9774ed tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:53:00.127626 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-576bc3b6-ae61-4804-9b0a-75415f9774ed tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:53:00.140968 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-576bc3b6-ae61-4804-9b0a-75415f9774ed tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] HTTP exception thrown: Instance aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1 could not be found. Aug 10 23:53:00.142505 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-576bc3b6-ae61-4804-9b0a-75415f9774ed tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Request method failure captured: Aug 10 23:53:00.142505 n-d-850468-14 devstack@n-api.service[122632]: request: DELETE /compute/v2.1/servers/aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1 HTTP/1.1 Aug 10 23:53:00.142505 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:53:00.142505 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:53:00.142505 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:53:00.142505 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 23:53:00.142505 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:53:00.142505 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:53:00.142505 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:53:00.142505 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:53:00.142505 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9ER5jy-BokhOJzT8ixS3n2BggXyBjR45j2YgyDgTUbTauU2HHdzlhsyLiya_dOzOU5aADzDgGO9D-fBQsq0lY1_sL2uXeUnojlBeweKU_rIY12Dcw6xVZbWlZkUZwqg3mvCks--NxvE5uqckKvFwFiKQJ62xgAHjbIS97PZufZY9rT0 Aug 10 23:53:00.142505 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:53:00.142505 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:53:00.142505 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:53:00.142505 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:53:00.142505 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:53:00.142505 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:53:00.142505 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 2966ce3ee7fe4d49ae177c6a3a415421 Aug 10 23:53:00.142505 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1091222409 Aug 10 23:53:00.142505 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:53:00.142505 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:53:00.142505 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2966ce3ee7fe4d49ae177c6a3a415421"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2966ce3ee7fe4d49ae177c6a3a415421"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2966ce3ee7fe4d49ae177c6a3a415421"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2966ce3ee7fe4d49ae177c6a3a415421", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:53:00.142505 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-ServerDiskConfigTestJSON-1091222409 Aug 10 23:53:00.142505 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 2966ce3ee7fe4d49ae177c6a3a415421 Aug 10 23:53:00.142505 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1091222409 Aug 10 23:53:00.142505 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-ServerDiskConfigTestJSON-1091222409-project Aug 10 23:53:00.142505 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:53:00.142505 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:53:00.142505 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: b774b20640b8413eac15565a7f624108 Aug 10 23:53:00.142505 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-ServerDiskConfigTestJSON-1091222409-project Aug 10 23:53:00.142505 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:53:00.142505 n-d-850468-14 devstack@n-api.service[122632]: exception: Instance aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1 could not be found. Aug 10 23:53:00.142505 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': 'aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1'} Aug 10 23:53:00.142505 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:53:00.142505 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:53:00.142505 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:53:00.142505 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:53:00.142505 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:53:00.142505 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:53:00.142505 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:53:00.142505 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:53:00.142505 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:53:00.142505 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:53:00.142505 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1 could not be found. Aug 10 23:53:00.142505 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:53:00.142505 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:53:00.142505 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:53:00.142505 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:53:00.142505 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:53:00.142505 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:53:00.142505 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:53:00.142505 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:53:00.142505 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:53:00.142505 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:53:00.142505 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 23:53:00.142505 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 23:53:00.142505 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 23:53:00.142505 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 23:53:00.142505 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:53:00.142505 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:53:00.142505 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:53:00.142505 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:53:00.146651 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1 could not be found. Aug 10 23:53:00.146651 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:53:00.146651 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:53:00.146651 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:53:00.146651 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:53:00.146651 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:53:00.146651 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:53:00.146651 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:53:00.146651 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:53:00.146651 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1 could not be found. Aug 10 23:53:00.146651 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:53:00.146651 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-576bc3b6-ae61-4804-9b0a-75415f9774ed tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Returning 404 to user: Instance aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1 could not be found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:53:00.146651 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-576bc3b6-ae61-4804-9b0a-75415f9774ed tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] 10.222.0.58 "DELETE /compute/v2.1/servers/aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1" status: 404 len: 111 microversion: 2.1 time: 0.029485 Aug 10 23:53:00.146651 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3165/6538] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:53:00 2022] DELETE /compute/v2.1/servers/aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 10 23:53:00.154450 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-ac291239-189b-4cb7-8e1a-9957ee1e8c85 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:53:00.155229 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-ac291239-189b-4cb7-8e1a-9957ee1e8c85 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] [instance: aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:53:00.165536 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ac291239-189b-4cb7-8e1a-9957ee1e8c85 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:53:00.166036 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ac291239-189b-4cb7-8e1a-9957ee1e8c85 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:53:00.166486 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ac291239-189b-4cb7-8e1a-9957ee1e8c85 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:53:00.167225 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ac291239-189b-4cb7-8e1a-9957ee1e8c85 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:53:00.167697 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ac291239-189b-4cb7-8e1a-9957ee1e8c85 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:53:00.168133 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ac291239-189b-4cb7-8e1a-9957ee1e8c85 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:53:00.181899 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-ac291239-189b-4cb7-8e1a-9957ee1e8c85 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] HTTP exception thrown: Instance aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1 could not be found. Aug 10 23:53:00.183593 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-ac291239-189b-4cb7-8e1a-9957ee1e8c85 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Request method failure captured: Aug 10 23:53:00.183593 n-d-850468-14 devstack@n-api.service[122633]: request: GET /compute/v2.1/servers/aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1 HTTP/1.1 Aug 10 23:53:00.183593 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:53:00.183593 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:53:00.183593 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:53:00.183593 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:53:00.183593 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:53:00.183593 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:53:00.183593 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:53:00.183593 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:53:00.183593 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9ER5jy-BokhOJzT8ixS3n2BggXyBjR45j2YgyDgTUbTauU2HHdzlhsyLiya_dOzOU5aADzDgGO9D-fBQsq0lY1_sL2uXeUnojlBeweKU_rIY12Dcw6xVZbWlZkUZwqg3mvCks--NxvE5uqckKvFwFiKQJ62xgAHjbIS97PZufZY9rT0 Aug 10 23:53:00.183593 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:53:00.183593 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:53:00.183593 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:53:00.183593 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:53:00.183593 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:53:00.183593 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:53:00.183593 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 2966ce3ee7fe4d49ae177c6a3a415421 Aug 10 23:53:00.183593 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1091222409 Aug 10 23:53:00.183593 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:53:00.183593 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:53:00.183593 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2966ce3ee7fe4d49ae177c6a3a415421"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/2966ce3ee7fe4d49ae177c6a3a415421"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/2966ce3ee7fe4d49ae177c6a3a415421"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_2966ce3ee7fe4d49ae177c6a3a415421", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:53:00.183593 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-ServerDiskConfigTestJSON-1091222409 Aug 10 23:53:00.183593 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 2966ce3ee7fe4d49ae177c6a3a415421 Aug 10 23:53:00.183593 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1091222409 Aug 10 23:53:00.183593 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-ServerDiskConfigTestJSON-1091222409-project Aug 10 23:53:00.183593 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:53:00.183593 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:53:00.183593 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: b774b20640b8413eac15565a7f624108 Aug 10 23:53:00.183593 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-ServerDiskConfigTestJSON-1091222409-project Aug 10 23:53:00.183593 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:53:00.183593 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1 could not be found. Aug 10 23:53:00.183593 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': 'aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1'} Aug 10 23:53:00.183593 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:53:00.183593 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:53:00.183593 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:53:00.183593 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:53:00.183593 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:53:00.183593 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:53:00.183593 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:53:00.183593 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:53:00.183593 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:53:00.183593 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:53:00.183593 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1 could not be found. Aug 10 23:53:00.183593 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:53:00.183593 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:53:00.183593 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:53:00.183593 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:53:00.183593 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:53:00.183593 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:53:00.183593 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:53:00.183593 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:53:00.183593 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:53:00.183593 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:53:00.183593 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:53:00.183593 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:53:00.183593 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:53:00.183593 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:53:00.183593 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:53:00.183593 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:53:00.183593 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1 could not be found. Aug 10 23:53:00.183593 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:53:00.183593 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:53:00.183593 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:53:00.187131 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:53:00.187131 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:53:00.187131 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:53:00.187131 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:53:00.187131 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:53:00.187131 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1 could not be found. Aug 10 23:53:00.187131 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:53:00.187131 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-ac291239-189b-4cb7-8e1a-9957ee1e8c85 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] Returning 404 to user: Instance aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1 could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:53:00.187131 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-ac291239-189b-4cb7-8e1a-9957ee1e8c85 tempest-ServerDiskConfigTestJSON-1091222409 tempest-ServerDiskConfigTestJSON-1091222409-project] 10.222.0.58 "GET /compute/v2.1/servers/aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1" status: 404 len: 111 microversion: 2.1 time: 0.035307 Aug 10 23:53:00.187131 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3374/6539] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:53:00 2022] GET /compute/v2.1/servers/aa3ff2bd-0ea0-4fb7-aa79-d1afb963f5c1 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 10 23:53:08.737184 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-753bfac1-f561-4894-a73b-4ad8759c641d tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Action: 'create', calling method: .version_select at 0x7f846fb770d0>, body: {"keypair": {"name": "tempest-keypair-1767049833", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMEUzzTKlx9esWKuMQmB8gdramVQfgNpuEBCnUf002cHUmT0xcDUOxRz7LOFxwAJ5EtCX+idbDaVEN6/HPu+4GHgdTmWOupV7N//LHBIP3fp24wQaJBGz/ZP6jPFx0lSTw=="}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:53:08.743450 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_api:SELECT=36 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:53:08.755936 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-753bfac1-f561-4894-a73b-4ad8759c641d tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Getting quotas for project 49e20a407dbc425ea488dee2995ebbe3. Resources: {'key_pairs'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:53:08.761680 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-753bfac1-f561-4894-a73b-4ad8759c641d tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Getting quotas for user 1412a4116dbb4412ba8ea10f72e2d95e and project 49e20a407dbc425ea488dee2995ebbe3. Resources: {'key_pairs'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:53:08.792240 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-753bfac1-f561-4894-a73b-4ad8759c641d tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.182988 Aug 10 23:53:08.792848 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3166/6540] 10.222.0.58 () {60 vars in 1159 bytes} [Wed Aug 10 23:53:08 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:53:10.371694 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-419cc01d-d409-4265-bd75-f709f0d7f660 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1968133734", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bbbbeb6b-4410-487d-bc67-956aff866a4e"}], "security_groups": [{"name": "tempest-securitygroup--1954233211"}], "key_name": "tempest-keypair-1767049833", "user_data": "}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:53:10.381010 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:53:10.381695 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:53:10.498372 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.network.neutron [None req-419cc01d-d409-4265-bd75-f709f0d7f660 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] validate_networks() for [('bbbbeb6b-4410-487d-bc67-956aff866a4e', None, None, None, None, None)] {{(pid=122633) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 23:53:10.898119 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-419cc01d-d409-4265-bd75-f709f0d7f660 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Flavor limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:53:10.898868 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-419cc01d-d409-4265-bd75-f709f0d7f660 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Image limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:53:10.899090 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-419cc01d-d409-4265-bd75-f709f0d7f660 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Flavor pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:53:10.899513 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-419cc01d-d409-4265-bd75-f709f0d7f660 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Image pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:53:10.899936 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-419cc01d-d409-4265-bd75-f709f0d7f660 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:53:10.910145 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-419cc01d-d409-4265-bd75-f709f0d7f660 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:53:10.910702 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-419cc01d-d409-4265-bd75-f709f0d7f660 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:53:10.911205 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-419cc01d-d409-4265-bd75-f709f0d7f660 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:53:10.911966 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-419cc01d-d409-4265-bd75-f709f0d7f660 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:53:10.912441 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-419cc01d-d409-4265-bd75-f709f0d7f660 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:53:10.912887 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-419cc01d-d409-4265-bd75-f709f0d7f660 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:53:10.931679 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-419cc01d-d409-4265-bd75-f709f0d7f660 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Getting quotas for project 49e20a407dbc425ea488dee2995ebbe3. Resources: {'instances', 'cores', 'ram'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:53:10.937016 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-419cc01d-d409-4265-bd75-f709f0d7f660 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Getting quotas for user 1412a4116dbb4412ba8ea10f72e2d95e and project 49e20a407dbc425ea488dee2995ebbe3. Resources: {'instances', 'cores', 'ram'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:53:10.951275 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-419cc01d-d409-4265-bd75-f709f0d7f660 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Going to run 1 instances... {{(pid=122633) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 23:53:10.953554 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-419cc01d-d409-4265-bd75-f709f0d7f660 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: 24f01a8a-885a-47c7-9e6b-6798ff1f0e4a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78ad8905-f66f-4733-8be9-2b260f1fabed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122633) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 23:53:11.003304 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-419cc01d-d409-4265-bd75-f709f0d7f660 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.636188 Aug 10 23:53:11.005289 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3375/6541] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 23:53:10 2022] POST /compute/v2.1/servers => generated 409 bytes in 639 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 23:53:11.016295 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-390a7efc-1b0b-4ff9-b5c9-c417d63ebae6 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:53:11.017498 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-390a7efc-1b0b-4ff9-b5c9-c417d63ebae6 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: 24f01a8a-885a-47c7-9e6b-6798ff1f0e4a] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:53:11.021035 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:53:11.077934 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-390a7efc-1b0b-4ff9-b5c9-c417d63ebae6 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:53:11.086289 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-390a7efc-1b0b-4ff9-b5c9-c417d63ebae6 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/24f01a8a-885a-47c7-9e6b-6798ff1f0e4a" status: 200 len: 1239 microversion: 2.1 time: 0.073819 Aug 10 23:53:11.095179 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3167/6542] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:53:11 2022] GET /compute/v2.1/servers/24f01a8a-885a-47c7-9e6b-6798ff1f0e4a => generated 1239 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:53:12.109279 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-d8816186-a94f-4824-be5a-2963715b9613 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:53:12.111489 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-d8816186-a94f-4824-be5a-2963715b9613 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: 24f01a8a-885a-47c7-9e6b-6798ff1f0e4a] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:53:12.124700 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d8816186-a94f-4824-be5a-2963715b9613 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:53:12.125209 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d8816186-a94f-4824-be5a-2963715b9613 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:53:12.125661 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d8816186-a94f-4824-be5a-2963715b9613 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:53:12.126383 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d8816186-a94f-4824-be5a-2963715b9613 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:53:12.126869 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d8816186-a94f-4824-be5a-2963715b9613 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:53:12.127314 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d8816186-a94f-4824-be5a-2963715b9613 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:53:12.205314 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-d8816186-a94f-4824-be5a-2963715b9613 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:53:12.215893 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-d8816186-a94f-4824-be5a-2963715b9613 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/24f01a8a-885a-47c7-9e6b-6798ff1f0e4a" status: 200 len: 1291 microversion: 2.1 time: 0.112051 Aug 10 23:53:12.216730 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3376/6543] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:53:12 2022] GET /compute/v2.1/servers/24f01a8a-885a-47c7-9e6b-6798ff1f0e4a => generated 1291 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:53:13.237595 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-cc0bcaad-95c4-4165-8914-ec43cb079547 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:53:13.238503 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-cc0bcaad-95c4-4165-8914-ec43cb079547 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: 24f01a8a-885a-47c7-9e6b-6798ff1f0e4a] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:53:13.245733 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cc0bcaad-95c4-4165-8914-ec43cb079547 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:53:13.246299 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cc0bcaad-95c4-4165-8914-ec43cb079547 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:53:13.246912 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cc0bcaad-95c4-4165-8914-ec43cb079547 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:53:13.247676 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cc0bcaad-95c4-4165-8914-ec43cb079547 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:53:13.248193 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cc0bcaad-95c4-4165-8914-ec43cb079547 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:53:13.248940 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cc0bcaad-95c4-4165-8914-ec43cb079547 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:53:13.463712 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-cc0bcaad-95c4-4165-8914-ec43cb079547 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:53:13.473190 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-cc0bcaad-95c4-4165-8914-ec43cb079547 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/24f01a8a-885a-47c7-9e6b-6798ff1f0e4a" status: 200 len: 1365 microversion: 2.1 time: 0.239326 Aug 10 23:53:13.473992 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3168/6544] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:53:13 2022] GET /compute/v2.1/servers/24f01a8a-885a-47c7-9e6b-6798ff1f0e4a => generated 1365 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:53:13.715895 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-d4da38e4-5b26-4853-9dcc-88d98b7de00e req-e4e96aa7-5e81-4380-aa6b-1273aaa357eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24f01a8a-885a-47c7-9e6b-6798ff1f0e4a", "tag": "31691385-ab03-45c8-b4b0-b413c246c902"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:53:13.727721 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-d4da38e4-5b26-4853-9dcc-88d98b7de00e req-e4e96aa7-5e81-4380-aa6b-1273aaa357eb service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:53:13.728352 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-d4da38e4-5b26-4853-9dcc-88d98b7de00e req-e4e96aa7-5e81-4380-aa6b-1273aaa357eb service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:53:13.729023 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-d4da38e4-5b26-4853-9dcc-88d98b7de00e req-e4e96aa7-5e81-4380-aa6b-1273aaa357eb service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:53:13.742037 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-d4da38e4-5b26-4853-9dcc-88d98b7de00e req-e4e96aa7-5e81-4380-aa6b-1273aaa357eb service nova] Creating event network-changed:31691385-ab03-45c8-b4b0-b413c246c902 for instance 24f01a8a-885a-47c7-9e6b-6798ff1f0e4a on n-h1-850468-14 Aug 10 23:53:13.747334 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-d4da38e4-5b26-4853-9dcc-88d98b7de00e req-e4e96aa7-5e81-4380-aa6b-1273aaa357eb service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035482 Aug 10 23:53:13.747946 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3377/6545] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:53:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:53:14.494932 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-ec78652d-c394-438d-917c-b72c49170d2b tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:53:14.495462 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-ec78652d-c394-438d-917c-b72c49170d2b tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: 24f01a8a-885a-47c7-9e6b-6798ff1f0e4a] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:53:14.502674 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ec78652d-c394-438d-917c-b72c49170d2b tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:53:14.503192 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ec78652d-c394-438d-917c-b72c49170d2b tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:53:14.504323 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ec78652d-c394-438d-917c-b72c49170d2b tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:53:14.505092 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ec78652d-c394-438d-917c-b72c49170d2b tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:53:14.505835 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ec78652d-c394-438d-917c-b72c49170d2b tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:53:14.506272 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ec78652d-c394-438d-917c-b72c49170d2b tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:53:14.641712 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-ec78652d-c394-438d-917c-b72c49170d2b tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:53:14.649255 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-ec78652d-c394-438d-917c-b72c49170d2b tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/24f01a8a-885a-47c7-9e6b-6798ff1f0e4a" status: 200 len: 1365 microversion: 2.1 time: 0.158379 Aug 10 23:53:14.649824 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3169/6546] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:53:14 2022] GET /compute/v2.1/servers/24f01a8a-885a-47c7-9e6b-6798ff1f0e4a => generated 1365 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:53:15.672365 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-f7d60767-a9be-4ec8-9d90-895feab28964 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:53:15.673083 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-f7d60767-a9be-4ec8-9d90-895feab28964 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: 24f01a8a-885a-47c7-9e6b-6798ff1f0e4a] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:53:15.680735 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f7d60767-a9be-4ec8-9d90-895feab28964 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:53:15.681240 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f7d60767-a9be-4ec8-9d90-895feab28964 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:53:15.681689 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f7d60767-a9be-4ec8-9d90-895feab28964 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:53:15.682408 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f7d60767-a9be-4ec8-9d90-895feab28964 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:53:15.682910 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f7d60767-a9be-4ec8-9d90-895feab28964 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:53:15.683353 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f7d60767-a9be-4ec8-9d90-895feab28964 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:53:15.816945 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-f7d60767-a9be-4ec8-9d90-895feab28964 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:53:15.824580 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-f7d60767-a9be-4ec8-9d90-895feab28964 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/24f01a8a-885a-47c7-9e6b-6798ff1f0e4a" status: 200 len: 1365 microversion: 2.1 time: 0.157392 Aug 10 23:53:15.825151 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3378/6547] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:53:15 2022] GET /compute/v2.1/servers/24f01a8a-885a-47c7-9e6b-6798ff1f0e4a => generated 1365 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:53:16.845810 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-ca5a19a7-e3f1-4781-a3ee-db35be4bdaf2 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:53:16.846426 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-ca5a19a7-e3f1-4781-a3ee-db35be4bdaf2 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: 24f01a8a-885a-47c7-9e6b-6798ff1f0e4a] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:53:16.854070 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ca5a19a7-e3f1-4781-a3ee-db35be4bdaf2 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:53:16.854558 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ca5a19a7-e3f1-4781-a3ee-db35be4bdaf2 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:53:16.855030 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ca5a19a7-e3f1-4781-a3ee-db35be4bdaf2 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:53:16.855728 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ca5a19a7-e3f1-4781-a3ee-db35be4bdaf2 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:53:16.856183 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ca5a19a7-e3f1-4781-a3ee-db35be4bdaf2 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:53:16.856611 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ca5a19a7-e3f1-4781-a3ee-db35be4bdaf2 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:53:16.998475 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-ca5a19a7-e3f1-4781-a3ee-db35be4bdaf2 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:53:17.006391 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-ca5a19a7-e3f1-4781-a3ee-db35be4bdaf2 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/24f01a8a-885a-47c7-9e6b-6798ff1f0e4a" status: 200 len: 1365 microversion: 2.1 time: 0.164510 Aug 10 23:53:17.007136 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3170/6548] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:53:16 2022] GET /compute/v2.1/servers/24f01a8a-885a-47c7-9e6b-6798ff1f0e4a => generated 1365 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:53:18.027772 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-4793bd92-8b15-435a-82f5-4561f9624389 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:53:18.028457 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-4793bd92-8b15-435a-82f5-4561f9624389 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: 24f01a8a-885a-47c7-9e6b-6798ff1f0e4a] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:53:18.036361 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4793bd92-8b15-435a-82f5-4561f9624389 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:53:18.036871 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4793bd92-8b15-435a-82f5-4561f9624389 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:53:18.037492 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4793bd92-8b15-435a-82f5-4561f9624389 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:53:18.038260 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4793bd92-8b15-435a-82f5-4561f9624389 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:53:18.038869 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4793bd92-8b15-435a-82f5-4561f9624389 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:53:18.039324 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4793bd92-8b15-435a-82f5-4561f9624389 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:53:18.151996 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-5cb00e2b-35e1-4bae-bd35-9f3aa1f41f83 req-c621cd65-a4d7-4495-8883-0b10e59a6c92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24f01a8a-885a-47c7-9e6b-6798ff1f0e4a", "name": "network-vif-plugged", "status": "completed", "tag": "31691385-ab03-45c8-b4b0-b413c246c902"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:53:18.163875 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-5cb00e2b-35e1-4bae-bd35-9f3aa1f41f83 req-c621cd65-a4d7-4495-8883-0b10e59a6c92 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:53:18.164601 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-5cb00e2b-35e1-4bae-bd35-9f3aa1f41f83 req-c621cd65-a4d7-4495-8883-0b10e59a6c92 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:53:18.165038 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-5cb00e2b-35e1-4bae-bd35-9f3aa1f41f83 req-c621cd65-a4d7-4495-8883-0b10e59a6c92 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:53:18.177464 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-5cb00e2b-35e1-4bae-bd35-9f3aa1f41f83 req-c621cd65-a4d7-4495-8883-0b10e59a6c92 service nova] Creating event network-vif-plugged:31691385-ab03-45c8-b4b0-b413c246c902 for instance 24f01a8a-885a-47c7-9e6b-6798ff1f0e4a on n-h1-850468-14 Aug 10 23:53:18.183180 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-5cb00e2b-35e1-4bae-bd35-9f3aa1f41f83 req-c621cd65-a4d7-4495-8883-0b10e59a6c92 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035792 Aug 10 23:53:18.183830 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3171/6549] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:53:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 23:53:18.186346 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-4793bd92-8b15-435a-82f5-4561f9624389 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:53:18.195166 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-4793bd92-8b15-435a-82f5-4561f9624389 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/24f01a8a-885a-47c7-9e6b-6798ff1f0e4a" status: 200 len: 1365 microversion: 2.1 time: 0.171637 Aug 10 23:53:18.196038 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3379/6550] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:53:18 2022] GET /compute/v2.1/servers/24f01a8a-885a-47c7-9e6b-6798ff1f0e4a => generated 1365 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:53:19.218168 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-d94e1f0c-370c-4229-a3d8-9952abfa1e5d tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:53:19.218927 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-d94e1f0c-370c-4229-a3d8-9952abfa1e5d tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: 24f01a8a-885a-47c7-9e6b-6798ff1f0e4a] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:53:19.226297 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d94e1f0c-370c-4229-a3d8-9952abfa1e5d tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:53:19.226776 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d94e1f0c-370c-4229-a3d8-9952abfa1e5d tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:53:19.227238 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d94e1f0c-370c-4229-a3d8-9952abfa1e5d tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:53:19.227918 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d94e1f0c-370c-4229-a3d8-9952abfa1e5d tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:53:19.228363 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d94e1f0c-370c-4229-a3d8-9952abfa1e5d tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:53:19.228781 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d94e1f0c-370c-4229-a3d8-9952abfa1e5d tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:53:19.370641 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-d94e1f0c-370c-4229-a3d8-9952abfa1e5d tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:53:19.378377 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-d94e1f0c-370c-4229-a3d8-9952abfa1e5d tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/24f01a8a-885a-47c7-9e6b-6798ff1f0e4a" status: 200 len: 1365 microversion: 2.1 time: 0.165395 Aug 10 23:53:19.379071 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3172/6551] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:53:19 2022] GET /compute/v2.1/servers/24f01a8a-885a-47c7-9e6b-6798ff1f0e4a => generated 1365 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:53:20.399333 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-e13dd0cb-42c3-4cda-9b0a-97a78418021e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:53:20.399964 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-e13dd0cb-42c3-4cda-9b0a-97a78418021e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: 24f01a8a-885a-47c7-9e6b-6798ff1f0e4a] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:53:20.406999 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e13dd0cb-42c3-4cda-9b0a-97a78418021e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:53:20.407507 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e13dd0cb-42c3-4cda-9b0a-97a78418021e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:53:20.407970 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e13dd0cb-42c3-4cda-9b0a-97a78418021e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:53:20.408691 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e13dd0cb-42c3-4cda-9b0a-97a78418021e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:53:20.409164 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e13dd0cb-42c3-4cda-9b0a-97a78418021e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:53:20.409666 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e13dd0cb-42c3-4cda-9b0a-97a78418021e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:53:20.546863 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-e13dd0cb-42c3-4cda-9b0a-97a78418021e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:53:20.555502 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-e13dd0cb-42c3-4cda-9b0a-97a78418021e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/24f01a8a-885a-47c7-9e6b-6798ff1f0e4a" status: 200 len: 1552 microversion: 2.1 time: 0.160124 Aug 10 23:53:20.556089 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3380/6552] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:53:20 2022] GET /compute/v2.1/servers/24f01a8a-885a-47c7-9e6b-6798ff1f0e4a => generated 1552 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:53:20.577124 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-9d49ac7a-ba3c-45c4-ba02-e5ea15053eee tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:53:20.577672 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-9d49ac7a-ba3c-45c4-ba02-e5ea15053eee tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: 24f01a8a-885a-47c7-9e6b-6798ff1f0e4a] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:53:20.584714 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9d49ac7a-ba3c-45c4-ba02-e5ea15053eee tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:53:20.585198 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9d49ac7a-ba3c-45c4-ba02-e5ea15053eee tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:53:20.585635 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9d49ac7a-ba3c-45c4-ba02-e5ea15053eee tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:53:20.586321 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9d49ac7a-ba3c-45c4-ba02-e5ea15053eee tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:53:20.586772 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9d49ac7a-ba3c-45c4-ba02-e5ea15053eee tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:53:20.587216 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9d49ac7a-ba3c-45c4-ba02-e5ea15053eee tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:53:20.667088 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-9d49ac7a-ba3c-45c4-ba02-e5ea15053eee tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/24f01a8a-885a-47c7-9e6b-6798ff1f0e4a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093823 Aug 10 23:53:20.667708 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3173/6553] 10.222.0.58 () {58 vars in 1275 bytes} [Wed Aug 10 23:53:20 2022] GET /compute/v2.1/servers/24f01a8a-885a-47c7-9e6b-6798ff1f0e4a/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:53:21.625578 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-fded9732-5d7b-46d3-83a0-6cfc20dfd91e req-ebdd39c0-6733-4168-a119-b65cfa58b06e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24f01a8a-885a-47c7-9e6b-6798ff1f0e4a", "tag": "31691385-ab03-45c8-b4b0-b413c246c902"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:53:21.630692 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=2 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:53:21.631423 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=6 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:53:21.638719 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-fded9732-5d7b-46d3-83a0-6cfc20dfd91e req-ebdd39c0-6733-4168-a119-b65cfa58b06e service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:53:21.639246 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-fded9732-5d7b-46d3-83a0-6cfc20dfd91e req-ebdd39c0-6733-4168-a119-b65cfa58b06e service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:53:21.639700 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-fded9732-5d7b-46d3-83a0-6cfc20dfd91e req-ebdd39c0-6733-4168-a119-b65cfa58b06e service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:53:21.653632 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-fded9732-5d7b-46d3-83a0-6cfc20dfd91e req-ebdd39c0-6733-4168-a119-b65cfa58b06e service nova] Creating event network-changed:31691385-ab03-45c8-b4b0-b413c246c902 for instance 24f01a8a-885a-47c7-9e6b-6798ff1f0e4a on n-h1-850468-14 Aug 10 23:53:21.658807 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-fded9732-5d7b-46d3-83a0-6cfc20dfd91e req-ebdd39c0-6733-4168-a119-b65cfa58b06e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037127 Aug 10 23:53:21.659448 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3381/6554] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:53:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:53:56.551019 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=6 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:53:56.553085 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=1 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:53:56.553772 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=30 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:53:56.558678 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-77395cfa-88b4-4851-b71b-48e8b794eab5 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:53:56.559312 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-77395cfa-88b4-4851-b71b-48e8b794eab5 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: 24f01a8a-885a-47c7-9e6b-6798ff1f0e4a] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:53:56.567109 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-77395cfa-88b4-4851-b71b-48e8b794eab5 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:53:56.567590 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-77395cfa-88b4-4851-b71b-48e8b794eab5 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:53:56.568027 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-77395cfa-88b4-4851-b71b-48e8b794eab5 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:53:56.568718 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-77395cfa-88b4-4851-b71b-48e8b794eab5 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:53:56.569170 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-77395cfa-88b4-4851-b71b-48e8b794eab5 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:53:56.569594 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-77395cfa-88b4-4851-b71b-48e8b794eab5 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:53:56.847113 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-77395cfa-88b4-4851-b71b-48e8b794eab5 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:53:56.854776 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-77395cfa-88b4-4851-b71b-48e8b794eab5 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/24f01a8a-885a-47c7-9e6b-6798ff1f0e4a" status: 200 len: 1671 microversion: 2.1 time: 0.304668 Aug 10 23:53:56.855372 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3174/6555] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:53:56 2022] GET /compute/v2.1/servers/24f01a8a-885a-47c7-9e6b-6798ff1f0e4a => generated 1671 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:53:56.875069 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:53:56.875934 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=30 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:53:56.880235 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-f41ebf36-a283-46f6-8cc7-7fdb509cf993 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:53:56.880946 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-f41ebf36-a283-46f6-8cc7-7fdb509cf993 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: 24f01a8a-885a-47c7-9e6b-6798ff1f0e4a] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:53:56.889555 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f41ebf36-a283-46f6-8cc7-7fdb509cf993 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:53:56.890056 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f41ebf36-a283-46f6-8cc7-7fdb509cf993 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:53:56.890505 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f41ebf36-a283-46f6-8cc7-7fdb509cf993 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:53:56.891244 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f41ebf36-a283-46f6-8cc7-7fdb509cf993 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:53:56.891745 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f41ebf36-a283-46f6-8cc7-7fdb509cf993 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:53:56.892188 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f41ebf36-a283-46f6-8cc7-7fdb509cf993 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:53:57.144633 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-f41ebf36-a283-46f6-8cc7-7fdb509cf993 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:53:57.152278 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-f41ebf36-a283-46f6-8cc7-7fdb509cf993 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/24f01a8a-885a-47c7-9e6b-6798ff1f0e4a" status: 200 len: 1671 microversion: 2.1 time: 0.279521 Aug 10 23:53:57.152849 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3382/6556] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:53:56 2022] GET /compute/v2.1/servers/24f01a8a-885a-47c7-9e6b-6798ff1f0e4a => generated 1671 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:53:57.172466 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-e0d4fc82-daf8-4ccf-a678-ef3eb017ea18 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:53:57.173066 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-e0d4fc82-daf8-4ccf-a678-ef3eb017ea18 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: 24f01a8a-885a-47c7-9e6b-6798ff1f0e4a] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:53:57.179003 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e0d4fc82-daf8-4ccf-a678-ef3eb017ea18 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:53:57.179477 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e0d4fc82-daf8-4ccf-a678-ef3eb017ea18 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:53:57.180876 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e0d4fc82-daf8-4ccf-a678-ef3eb017ea18 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:53:57.181565 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e0d4fc82-daf8-4ccf-a678-ef3eb017ea18 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:53:57.182014 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e0d4fc82-daf8-4ccf-a678-ef3eb017ea18 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:53:57.182435 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e0d4fc82-daf8-4ccf-a678-ef3eb017ea18 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:53:57.316075 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-e0d4fc82-daf8-4ccf-a678-ef3eb017ea18 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:53:57.323752 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-e0d4fc82-daf8-4ccf-a678-ef3eb017ea18 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/24f01a8a-885a-47c7-9e6b-6798ff1f0e4a" status: 200 len: 1671 microversion: 2.1 time: 0.155097 Aug 10 23:53:57.324328 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3175/6557] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:53:57 2022] GET /compute/v2.1/servers/24f01a8a-885a-47c7-9e6b-6798ff1f0e4a => generated 1671 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:53:57.343942 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-77dcbce2-ba50-411b-b68f-f759580574ca tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:53:57.346126 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-77dcbce2-ba50-411b-b68f-f759580574ca tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: 24f01a8a-885a-47c7-9e6b-6798ff1f0e4a] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:53:57.352648 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-77dcbce2-ba50-411b-b68f-f759580574ca tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:53:57.353143 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-77dcbce2-ba50-411b-b68f-f759580574ca tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:53:57.353594 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-77dcbce2-ba50-411b-b68f-f759580574ca tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:53:57.354303 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-77dcbce2-ba50-411b-b68f-f759580574ca tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:53:57.354773 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-77dcbce2-ba50-411b-b68f-f759580574ca tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:53:57.355241 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-77dcbce2-ba50-411b-b68f-f759580574ca tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:53:57.383292 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-77dcbce2-ba50-411b-b68f-f759580574ca tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:53:57.389020 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-77dcbce2-ba50-411b-b68f-f759580574ca tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: 24f01a8a-885a-47c7-9e6b-6798ff1f0e4a] Old instance type m1.heat2, new instance type m1.heat {{(pid=122633) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 10 23:53:57.395835 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-77dcbce2-ba50-411b-b68f-f759580574ca tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Flavor limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:53:57.395835 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-77dcbce2-ba50-411b-b68f-f759580574ca tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Image limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:53:57.396236 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-77dcbce2-ba50-411b-b68f-f759580574ca tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Flavor pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:53:57.396686 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-77dcbce2-ba50-411b-b68f-f759580574ca tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Image pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:53:57.397089 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-77dcbce2-ba50-411b-b68f-f759580574ca tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:53:57.462491 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-77dcbce2-ba50-411b-b68f-f759580574ca tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "POST /compute/v2.1/servers/24f01a8a-885a-47c7-9e6b-6798ff1f0e4a/action" status: 202 len: 0 microversion: 2.1 time: 0.122428 Aug 10 23:53:57.463158 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3383/6558] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:53:57 2022] POST /compute/v2.1/servers/24f01a8a-885a-47c7-9e6b-6798ff1f0e4a/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:53:57.471224 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-78f09348-f5db-4021-b2d3-3fb22711ca94 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:53:57.471842 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-78f09348-f5db-4021-b2d3-3fb22711ca94 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: 24f01a8a-885a-47c7-9e6b-6798ff1f0e4a] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:53:57.478617 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-78f09348-f5db-4021-b2d3-3fb22711ca94 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:53:57.479136 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-78f09348-f5db-4021-b2d3-3fb22711ca94 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:53:57.479581 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-78f09348-f5db-4021-b2d3-3fb22711ca94 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:53:57.480292 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-78f09348-f5db-4021-b2d3-3fb22711ca94 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:53:57.480745 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-78f09348-f5db-4021-b2d3-3fb22711ca94 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:53:57.481172 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-78f09348-f5db-4021-b2d3-3fb22711ca94 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:53:57.626230 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-78f09348-f5db-4021-b2d3-3fb22711ca94 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:53:57.634359 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-78f09348-f5db-4021-b2d3-3fb22711ca94 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/24f01a8a-885a-47c7-9e6b-6798ff1f0e4a" status: 200 len: 1680 microversion: 2.1 time: 0.166623 Aug 10 23:53:57.634993 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3176/6559] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:53:57 2022] GET /compute/v2.1/servers/24f01a8a-885a-47c7-9e6b-6798ff1f0e4a => generated 1680 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:53:58.656679 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-aa504bfb-1cd6-4eed-94a6-d2c5410b7ff7 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:53:58.657301 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-aa504bfb-1cd6-4eed-94a6-d2c5410b7ff7 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: 24f01a8a-885a-47c7-9e6b-6798ff1f0e4a] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:53:58.663876 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-aa504bfb-1cd6-4eed-94a6-d2c5410b7ff7 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:53:58.665182 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-aa504bfb-1cd6-4eed-94a6-d2c5410b7ff7 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:53:58.665591 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-aa504bfb-1cd6-4eed-94a6-d2c5410b7ff7 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:53:58.666354 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-aa504bfb-1cd6-4eed-94a6-d2c5410b7ff7 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:53:58.666852 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-aa504bfb-1cd6-4eed-94a6-d2c5410b7ff7 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:53:58.667301 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-aa504bfb-1cd6-4eed-94a6-d2c5410b7ff7 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:53:58.806265 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-aa504bfb-1cd6-4eed-94a6-d2c5410b7ff7 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:53:58.814148 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-aa504bfb-1cd6-4eed-94a6-d2c5410b7ff7 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/24f01a8a-885a-47c7-9e6b-6798ff1f0e4a" status: 200 len: 1680 microversion: 2.1 time: 0.162282 Aug 10 23:53:58.814703 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3384/6560] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:53:58 2022] GET /compute/v2.1/servers/24f01a8a-885a-47c7-9e6b-6798ff1f0e4a => generated 1680 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:53:59.837204 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-ad10a3c2-b117-4c09-9848-46cd50ebb84f tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:53:59.838056 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-ad10a3c2-b117-4c09-9848-46cd50ebb84f tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: 24f01a8a-885a-47c7-9e6b-6798ff1f0e4a] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:53:59.844857 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ad10a3c2-b117-4c09-9848-46cd50ebb84f tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:53:59.845335 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ad10a3c2-b117-4c09-9848-46cd50ebb84f tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:53:59.845766 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ad10a3c2-b117-4c09-9848-46cd50ebb84f tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:53:59.846451 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ad10a3c2-b117-4c09-9848-46cd50ebb84f tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:53:59.846921 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ad10a3c2-b117-4c09-9848-46cd50ebb84f tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:53:59.847341 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ad10a3c2-b117-4c09-9848-46cd50ebb84f tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:53:59.976594 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-ad10a3c2-b117-4c09-9848-46cd50ebb84f tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:53:59.984657 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-ad10a3c2-b117-4c09-9848-46cd50ebb84f tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/24f01a8a-885a-47c7-9e6b-6798ff1f0e4a" status: 200 len: 1685 microversion: 2.1 time: 0.152043 Aug 10 23:53:59.985231 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3177/6561] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:53:59 2022] GET /compute/v2.1/servers/24f01a8a-885a-47c7-9e6b-6798ff1f0e4a => generated 1685 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:54:01.006014 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-b1133e30-bc39-4b12-aae3-016dfd0fcf2c tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:54:01.006642 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-b1133e30-bc39-4b12-aae3-016dfd0fcf2c tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: 24f01a8a-885a-47c7-9e6b-6798ff1f0e4a] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:54:01.013236 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b1133e30-bc39-4b12-aae3-016dfd0fcf2c tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:54:01.013746 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b1133e30-bc39-4b12-aae3-016dfd0fcf2c tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:54:01.014203 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b1133e30-bc39-4b12-aae3-016dfd0fcf2c tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:54:01.014960 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b1133e30-bc39-4b12-aae3-016dfd0fcf2c tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:54:01.015438 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b1133e30-bc39-4b12-aae3-016dfd0fcf2c tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:54:01.015883 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b1133e30-bc39-4b12-aae3-016dfd0fcf2c tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:54:01.148251 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-b1133e30-bc39-4b12-aae3-016dfd0fcf2c tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:54:01.155956 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-b1133e30-bc39-4b12-aae3-016dfd0fcf2c tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/24f01a8a-885a-47c7-9e6b-6798ff1f0e4a" status: 200 len: 1685 microversion: 2.1 time: 0.153999 Aug 10 23:54:01.156537 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3385/6562] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:54:01 2022] GET /compute/v2.1/servers/24f01a8a-885a-47c7-9e6b-6798ff1f0e4a => generated 1685 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:54:02.179147 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-9404cb94-b502-4d8d-a7d8-203d81df4b75 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:54:02.179753 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-9404cb94-b502-4d8d-a7d8-203d81df4b75 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: 24f01a8a-885a-47c7-9e6b-6798ff1f0e4a] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:54:02.187585 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9404cb94-b502-4d8d-a7d8-203d81df4b75 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:54:02.188062 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9404cb94-b502-4d8d-a7d8-203d81df4b75 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:54:02.188492 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9404cb94-b502-4d8d-a7d8-203d81df4b75 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:54:02.189179 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9404cb94-b502-4d8d-a7d8-203d81df4b75 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:54:02.189622 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9404cb94-b502-4d8d-a7d8-203d81df4b75 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:54:02.190064 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9404cb94-b502-4d8d-a7d8-203d81df4b75 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:54:02.324375 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-9404cb94-b502-4d8d-a7d8-203d81df4b75 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:54:02.331882 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-9404cb94-b502-4d8d-a7d8-203d81df4b75 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/24f01a8a-885a-47c7-9e6b-6798ff1f0e4a" status: 200 len: 1685 microversion: 2.1 time: 0.156845 Aug 10 23:54:02.332452 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3178/6563] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:54:02 2022] GET /compute/v2.1/servers/24f01a8a-885a-47c7-9e6b-6798ff1f0e4a => generated 1685 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:54:03.353613 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-1b21dd99-b6f8-4fdf-8926-6d06068a2f35 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:54:03.354354 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-1b21dd99-b6f8-4fdf-8926-6d06068a2f35 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: 24f01a8a-885a-47c7-9e6b-6798ff1f0e4a] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:54:03.361206 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1b21dd99-b6f8-4fdf-8926-6d06068a2f35 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:54:03.361707 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1b21dd99-b6f8-4fdf-8926-6d06068a2f35 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:54:03.362153 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1b21dd99-b6f8-4fdf-8926-6d06068a2f35 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:54:03.362882 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1b21dd99-b6f8-4fdf-8926-6d06068a2f35 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:54:03.363357 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1b21dd99-b6f8-4fdf-8926-6d06068a2f35 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:54:03.363790 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1b21dd99-b6f8-4fdf-8926-6d06068a2f35 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:54:03.494669 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-1b21dd99-b6f8-4fdf-8926-6d06068a2f35 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:54:03.502571 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-1b21dd99-b6f8-4fdf-8926-6d06068a2f35 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/24f01a8a-885a-47c7-9e6b-6798ff1f0e4a" status: 200 len: 1685 microversion: 2.1 time: 0.153106 Aug 10 23:54:03.503183 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3386/6564] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:54:03 2022] GET /compute/v2.1/servers/24f01a8a-885a-47c7-9e6b-6798ff1f0e4a => generated 1685 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:54:04.525969 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-e6091afa-30ce-4527-999a-c37a8cd898b4 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:54:04.526943 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-e6091afa-30ce-4527-999a-c37a8cd898b4 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: 24f01a8a-885a-47c7-9e6b-6798ff1f0e4a] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:54:04.534229 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e6091afa-30ce-4527-999a-c37a8cd898b4 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:54:04.534717 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e6091afa-30ce-4527-999a-c37a8cd898b4 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:54:04.535191 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e6091afa-30ce-4527-999a-c37a8cd898b4 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:54:04.535896 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e6091afa-30ce-4527-999a-c37a8cd898b4 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:54:04.536357 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e6091afa-30ce-4527-999a-c37a8cd898b4 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:54:04.536786 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e6091afa-30ce-4527-999a-c37a8cd898b4 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:54:04.668109 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-e6091afa-30ce-4527-999a-c37a8cd898b4 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:54:04.675595 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-e6091afa-30ce-4527-999a-c37a8cd898b4 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/24f01a8a-885a-47c7-9e6b-6798ff1f0e4a" status: 200 len: 1685 microversion: 2.1 time: 0.155453 Aug 10 23:54:04.676164 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3179/6565] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:54:04 2022] GET /compute/v2.1/servers/24f01a8a-885a-47c7-9e6b-6798ff1f0e4a => generated 1685 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:54:05.697612 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-bc1db921-0f51-400e-a535-4341e3e63af2 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:54:05.698277 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-bc1db921-0f51-400e-a535-4341e3e63af2 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: 24f01a8a-885a-47c7-9e6b-6798ff1f0e4a] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:54:05.705416 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bc1db921-0f51-400e-a535-4341e3e63af2 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:54:05.705921 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bc1db921-0f51-400e-a535-4341e3e63af2 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:54:05.706378 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bc1db921-0f51-400e-a535-4341e3e63af2 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:54:05.707128 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bc1db921-0f51-400e-a535-4341e3e63af2 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:54:05.707609 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bc1db921-0f51-400e-a535-4341e3e63af2 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:54:05.708053 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bc1db921-0f51-400e-a535-4341e3e63af2 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:54:05.847393 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-bc1db921-0f51-400e-a535-4341e3e63af2 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:54:05.855441 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-bc1db921-0f51-400e-a535-4341e3e63af2 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/24f01a8a-885a-47c7-9e6b-6798ff1f0e4a" status: 200 len: 1685 microversion: 2.1 time: 0.162458 Aug 10 23:54:05.856055 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3387/6566] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:54:05 2022] GET /compute/v2.1/servers/24f01a8a-885a-47c7-9e6b-6798ff1f0e4a => generated 1685 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:54:06.878722 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-62e9bedf-aa71-4ccc-ad08-db32458033a0 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:54:06.879426 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-62e9bedf-aa71-4ccc-ad08-db32458033a0 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: 24f01a8a-885a-47c7-9e6b-6798ff1f0e4a] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:54:06.887688 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-62e9bedf-aa71-4ccc-ad08-db32458033a0 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:54:06.888176 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-62e9bedf-aa71-4ccc-ad08-db32458033a0 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:54:06.888618 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-62e9bedf-aa71-4ccc-ad08-db32458033a0 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:54:06.889317 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-62e9bedf-aa71-4ccc-ad08-db32458033a0 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:54:06.889774 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-62e9bedf-aa71-4ccc-ad08-db32458033a0 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:54:06.890202 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-62e9bedf-aa71-4ccc-ad08-db32458033a0 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:54:07.022774 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-62e9bedf-aa71-4ccc-ad08-db32458033a0 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:54:07.030738 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-62e9bedf-aa71-4ccc-ad08-db32458033a0 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/24f01a8a-885a-47c7-9e6b-6798ff1f0e4a" status: 200 len: 1685 microversion: 2.1 time: 0.156333 Aug 10 23:54:07.031403 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3180/6567] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:54:06 2022] GET /compute/v2.1/servers/24f01a8a-885a-47c7-9e6b-6798ff1f0e4a => generated 1685 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:54:08.052829 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-66b68be8-c88f-4d92-b4d4-86883c12a4f8 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:54:08.053459 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-66b68be8-c88f-4d92-b4d4-86883c12a4f8 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: 24f01a8a-885a-47c7-9e6b-6798ff1f0e4a] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:54:08.061122 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-66b68be8-c88f-4d92-b4d4-86883c12a4f8 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:54:08.061627 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-66b68be8-c88f-4d92-b4d4-86883c12a4f8 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:54:08.062084 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-66b68be8-c88f-4d92-b4d4-86883c12a4f8 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:54:08.062882 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-66b68be8-c88f-4d92-b4d4-86883c12a4f8 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:54:08.063358 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-66b68be8-c88f-4d92-b4d4-86883c12a4f8 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:54:08.063756 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-66b68be8-c88f-4d92-b4d4-86883c12a4f8 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:54:08.203684 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-66b68be8-c88f-4d92-b4d4-86883c12a4f8 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:54:08.211251 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-66b68be8-c88f-4d92-b4d4-86883c12a4f8 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/24f01a8a-885a-47c7-9e6b-6798ff1f0e4a" status: 200 len: 1685 microversion: 2.1 time: 0.162316 Aug 10 23:54:08.211819 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3388/6568] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:54:08 2022] GET /compute/v2.1/servers/24f01a8a-885a-47c7-9e6b-6798ff1f0e4a => generated 1685 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:54:09.232514 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-153bc382-3de3-47da-ae91-98b430ec84ac tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:54:09.233064 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-153bc382-3de3-47da-ae91-98b430ec84ac tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: 24f01a8a-885a-47c7-9e6b-6798ff1f0e4a] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:54:09.239881 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-153bc382-3de3-47da-ae91-98b430ec84ac tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:54:09.240369 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-153bc382-3de3-47da-ae91-98b430ec84ac tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:54:09.240806 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-153bc382-3de3-47da-ae91-98b430ec84ac tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:54:09.241497 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-153bc382-3de3-47da-ae91-98b430ec84ac tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:54:09.241951 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-153bc382-3de3-47da-ae91-98b430ec84ac tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:54:09.242380 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-153bc382-3de3-47da-ae91-98b430ec84ac tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:54:09.376246 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-153bc382-3de3-47da-ae91-98b430ec84ac tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:54:09.384147 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-153bc382-3de3-47da-ae91-98b430ec84ac tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/24f01a8a-885a-47c7-9e6b-6798ff1f0e4a" status: 200 len: 1685 microversion: 2.1 time: 0.155574 Aug 10 23:54:09.385418 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3181/6569] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:54:09 2022] GET /compute/v2.1/servers/24f01a8a-885a-47c7-9e6b-6798ff1f0e4a => generated 1685 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:54:10.406396 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c7b1951f-3903-4ad3-9593-ea297bc72dcd tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:54:10.407040 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-c7b1951f-3903-4ad3-9593-ea297bc72dcd tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: 24f01a8a-885a-47c7-9e6b-6798ff1f0e4a] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:54:10.413818 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c7b1951f-3903-4ad3-9593-ea297bc72dcd tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:54:10.414310 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c7b1951f-3903-4ad3-9593-ea297bc72dcd tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:54:10.414755 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c7b1951f-3903-4ad3-9593-ea297bc72dcd tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:54:10.415497 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c7b1951f-3903-4ad3-9593-ea297bc72dcd tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:54:10.416235 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c7b1951f-3903-4ad3-9593-ea297bc72dcd tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:54:10.416750 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c7b1951f-3903-4ad3-9593-ea297bc72dcd tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:54:10.549113 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-c7b1951f-3903-4ad3-9593-ea297bc72dcd tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:54:10.557810 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-c7b1951f-3903-4ad3-9593-ea297bc72dcd tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/24f01a8a-885a-47c7-9e6b-6798ff1f0e4a" status: 200 len: 1685 microversion: 2.1 time: 0.155120 Aug 10 23:54:10.558390 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3389/6570] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:54:10 2022] GET /compute/v2.1/servers/24f01a8a-885a-47c7-9e6b-6798ff1f0e4a => generated 1685 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:54:11.580470 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-9f8675bb-eedf-43a6-9975-010ea5b773bc tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:54:11.581081 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-9f8675bb-eedf-43a6-9975-010ea5b773bc tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: 24f01a8a-885a-47c7-9e6b-6798ff1f0e4a] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:54:11.587951 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9f8675bb-eedf-43a6-9975-010ea5b773bc tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:54:11.588439 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9f8675bb-eedf-43a6-9975-010ea5b773bc tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:54:11.589602 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9f8675bb-eedf-43a6-9975-010ea5b773bc tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:54:11.590452 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9f8675bb-eedf-43a6-9975-010ea5b773bc tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:54:11.590939 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9f8675bb-eedf-43a6-9975-010ea5b773bc tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:54:11.591365 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9f8675bb-eedf-43a6-9975-010ea5b773bc tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:54:11.722190 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-9f8675bb-eedf-43a6-9975-010ea5b773bc tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:54:11.729930 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-9f8675bb-eedf-43a6-9975-010ea5b773bc tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/24f01a8a-885a-47c7-9e6b-6798ff1f0e4a" status: 200 len: 1685 microversion: 2.1 time: 0.153567 Aug 10 23:54:11.730444 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3182/6571] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:54:11 2022] GET /compute/v2.1/servers/24f01a8a-885a-47c7-9e6b-6798ff1f0e4a => generated 1685 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:54:12.752067 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-7ba0c23b-9022-4f85-a1e6-3d822cfb404a tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:54:12.752688 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-7ba0c23b-9022-4f85-a1e6-3d822cfb404a tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: 24f01a8a-885a-47c7-9e6b-6798ff1f0e4a] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:54:12.759612 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7ba0c23b-9022-4f85-a1e6-3d822cfb404a tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:54:12.760137 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7ba0c23b-9022-4f85-a1e6-3d822cfb404a tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:54:12.760625 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7ba0c23b-9022-4f85-a1e6-3d822cfb404a tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:54:12.761428 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7ba0c23b-9022-4f85-a1e6-3d822cfb404a tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:54:12.761907 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7ba0c23b-9022-4f85-a1e6-3d822cfb404a tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:54:12.762344 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7ba0c23b-9022-4f85-a1e6-3d822cfb404a tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:54:12.899174 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-7ba0c23b-9022-4f85-a1e6-3d822cfb404a tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:54:12.907492 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-7ba0c23b-9022-4f85-a1e6-3d822cfb404a tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/24f01a8a-885a-47c7-9e6b-6798ff1f0e4a" status: 200 len: 1685 microversion: 2.1 time: 0.159683 Aug 10 23:54:12.908077 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3390/6572] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:54:12 2022] GET /compute/v2.1/servers/24f01a8a-885a-47c7-9e6b-6798ff1f0e4a => generated 1685 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:54:13.928927 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-72c0d07c-9e9d-4e85-8006-6e94a9ecbc9b tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:54:13.929699 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-72c0d07c-9e9d-4e85-8006-6e94a9ecbc9b tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: 24f01a8a-885a-47c7-9e6b-6798ff1f0e4a] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:54:13.940617 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-72c0d07c-9e9d-4e85-8006-6e94a9ecbc9b tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:54:13.941104 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-72c0d07c-9e9d-4e85-8006-6e94a9ecbc9b tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:54:13.941534 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-72c0d07c-9e9d-4e85-8006-6e94a9ecbc9b tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:54:13.942234 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-72c0d07c-9e9d-4e85-8006-6e94a9ecbc9b tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:54:13.942734 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-72c0d07c-9e9d-4e85-8006-6e94a9ecbc9b tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:54:13.943356 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-72c0d07c-9e9d-4e85-8006-6e94a9ecbc9b tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:54:14.081350 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-72c0d07c-9e9d-4e85-8006-6e94a9ecbc9b tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:54:14.088804 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-72c0d07c-9e9d-4e85-8006-6e94a9ecbc9b tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/24f01a8a-885a-47c7-9e6b-6798ff1f0e4a" status: 200 len: 1685 microversion: 2.1 time: 0.163770 Aug 10 23:54:14.089382 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3183/6573] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:54:13 2022] GET /compute/v2.1/servers/24f01a8a-885a-47c7-9e6b-6798ff1f0e4a => generated 1685 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:54:15.111216 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-02044e83-8eaa-4f6b-a550-128639f0c757 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:54:15.111761 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-02044e83-8eaa-4f6b-a550-128639f0c757 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: 24f01a8a-885a-47c7-9e6b-6798ff1f0e4a] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:54:15.118527 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-02044e83-8eaa-4f6b-a550-128639f0c757 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:54:15.119049 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-02044e83-8eaa-4f6b-a550-128639f0c757 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:54:15.119499 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-02044e83-8eaa-4f6b-a550-128639f0c757 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:54:15.120202 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-02044e83-8eaa-4f6b-a550-128639f0c757 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:54:15.120666 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-02044e83-8eaa-4f6b-a550-128639f0c757 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:54:15.121671 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-02044e83-8eaa-4f6b-a550-128639f0c757 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:54:15.252537 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-02044e83-8eaa-4f6b-a550-128639f0c757 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:54:15.260214 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-02044e83-8eaa-4f6b-a550-128639f0c757 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/24f01a8a-885a-47c7-9e6b-6798ff1f0e4a" status: 200 len: 1685 microversion: 2.1 time: 0.152998 Aug 10 23:54:15.260793 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3391/6574] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:54:15 2022] GET /compute/v2.1/servers/24f01a8a-885a-47c7-9e6b-6798ff1f0e4a => generated 1685 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:54:16.281283 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-b2e3b436-7ff8-4e1e-b13b-d4dcffdc5ada tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:54:16.281976 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-b2e3b436-7ff8-4e1e-b13b-d4dcffdc5ada tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: 24f01a8a-885a-47c7-9e6b-6798ff1f0e4a] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:54:16.288736 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b2e3b436-7ff8-4e1e-b13b-d4dcffdc5ada tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:54:16.289221 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b2e3b436-7ff8-4e1e-b13b-d4dcffdc5ada tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:54:16.289659 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b2e3b436-7ff8-4e1e-b13b-d4dcffdc5ada tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:54:16.290355 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b2e3b436-7ff8-4e1e-b13b-d4dcffdc5ada tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:54:16.290829 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b2e3b436-7ff8-4e1e-b13b-d4dcffdc5ada tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:54:16.291256 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b2e3b436-7ff8-4e1e-b13b-d4dcffdc5ada tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:54:16.800501 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-b2e3b436-7ff8-4e1e-b13b-d4dcffdc5ada tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:54:16.808498 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-b2e3b436-7ff8-4e1e-b13b-d4dcffdc5ada tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/24f01a8a-885a-47c7-9e6b-6798ff1f0e4a" status: 200 len: 1684 microversion: 2.1 time: 0.531228 Aug 10 23:54:16.809658 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3184/6575] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:54:16 2022] GET /compute/v2.1/servers/24f01a8a-885a-47c7-9e6b-6798ff1f0e4a => generated 1684 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:54:17.274442 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-233bf7ea-c1a9-47a6-83d1-9b4ceb4e7f27 req-af356688-0811-498d-85b1-4d433d1e914a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24f01a8a-885a-47c7-9e6b-6798ff1f0e4a", "name": "network-vif-unplugged", "status": "completed", "tag": "31691385-ab03-45c8-b4b0-b413c246c902"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:54:17.284751 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-233bf7ea-c1a9-47a6-83d1-9b4ceb4e7f27 req-af356688-0811-498d-85b1-4d433d1e914a service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:54:17.285247 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-233bf7ea-c1a9-47a6-83d1-9b4ceb4e7f27 req-af356688-0811-498d-85b1-4d433d1e914a service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:54:17.286510 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-233bf7ea-c1a9-47a6-83d1-9b4ceb4e7f27 req-af356688-0811-498d-85b1-4d433d1e914a service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:54:17.300442 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-233bf7ea-c1a9-47a6-83d1-9b4ceb4e7f27 req-af356688-0811-498d-85b1-4d433d1e914a service nova] Creating event network-vif-unplugged:31691385-ab03-45c8-b4b0-b413c246c902 for instance 24f01a8a-885a-47c7-9e6b-6798ff1f0e4a on n-h2-850468-14 Aug 10 23:54:17.306627 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [req-233bf7ea-c1a9-47a6-83d1-9b4ceb4e7f27 req-af356688-0811-498d-85b1-4d433d1e914a service nova] Instance 24f01a8a-885a-47c7-9e6b-6798ff1f0e4a is migrating within the same cell, copying events to all relevant hosts: {'n-h1-850468-14', 'n-h2-850468-14'} {{(pid=122633) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5901}} Aug 10 23:54:17.317953 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-233bf7ea-c1a9-47a6-83d1-9b4ceb4e7f27 req-af356688-0811-498d-85b1-4d433d1e914a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.100401 Aug 10 23:54:17.318769 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3392/6576] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:54:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:54:17.832480 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-2aa35f5b-26c8-4e37-8092-1c7e5f337f08 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:54:17.832985 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-2aa35f5b-26c8-4e37-8092-1c7e5f337f08 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: 24f01a8a-885a-47c7-9e6b-6798ff1f0e4a] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:54:17.840003 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2aa35f5b-26c8-4e37-8092-1c7e5f337f08 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:54:17.841124 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2aa35f5b-26c8-4e37-8092-1c7e5f337f08 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:54:17.841566 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2aa35f5b-26c8-4e37-8092-1c7e5f337f08 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:54:17.842269 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2aa35f5b-26c8-4e37-8092-1c7e5f337f08 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:54:17.842719 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2aa35f5b-26c8-4e37-8092-1c7e5f337f08 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:54:17.843164 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2aa35f5b-26c8-4e37-8092-1c7e5f337f08 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:54:18.072340 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-2aa35f5b-26c8-4e37-8092-1c7e5f337f08 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:54:18.080687 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-2aa35f5b-26c8-4e37-8092-1c7e5f337f08 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/24f01a8a-885a-47c7-9e6b-6798ff1f0e4a" status: 200 len: 1684 microversion: 2.1 time: 0.252517 Aug 10 23:54:18.081277 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3185/6577] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:54:17 2022] GET /compute/v2.1/servers/24f01a8a-885a-47c7-9e6b-6798ff1f0e4a => generated 1684 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:54:19.103164 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-f1681017-4b50-40e3-a9fb-826fe4abc9d2 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:54:19.103874 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-f1681017-4b50-40e3-a9fb-826fe4abc9d2 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: 24f01a8a-885a-47c7-9e6b-6798ff1f0e4a] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:54:19.111903 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f1681017-4b50-40e3-a9fb-826fe4abc9d2 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:54:19.112404 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f1681017-4b50-40e3-a9fb-826fe4abc9d2 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:54:19.112854 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f1681017-4b50-40e3-a9fb-826fe4abc9d2 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:54:19.113570 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f1681017-4b50-40e3-a9fb-826fe4abc9d2 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:54:19.114044 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f1681017-4b50-40e3-a9fb-826fe4abc9d2 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:54:19.114485 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f1681017-4b50-40e3-a9fb-826fe4abc9d2 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:54:19.249483 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-f1681017-4b50-40e3-a9fb-826fe4abc9d2 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:54:19.257396 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-f1681017-4b50-40e3-a9fb-826fe4abc9d2 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/24f01a8a-885a-47c7-9e6b-6798ff1f0e4a" status: 200 len: 1682 microversion: 2.1 time: 0.158571 Aug 10 23:54:19.257984 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3393/6578] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:54:19 2022] GET /compute/v2.1/servers/24f01a8a-885a-47c7-9e6b-6798ff1f0e4a => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:54:19.350932 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-d54d4b7b-3ad0-4b13-947e-3ee17da7e4e3 req-b1534372-c119-454f-94ec-b0ab8b5d59ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24f01a8a-885a-47c7-9e6b-6798ff1f0e4a", "tag": "31691385-ab03-45c8-b4b0-b413c246c902"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:54:19.361600 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-d54d4b7b-3ad0-4b13-947e-3ee17da7e4e3 req-b1534372-c119-454f-94ec-b0ab8b5d59ab service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:54:19.362074 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-d54d4b7b-3ad0-4b13-947e-3ee17da7e4e3 req-b1534372-c119-454f-94ec-b0ab8b5d59ab service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:54:19.362495 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-d54d4b7b-3ad0-4b13-947e-3ee17da7e4e3 req-b1534372-c119-454f-94ec-b0ab8b5d59ab service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:54:19.373765 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-d54d4b7b-3ad0-4b13-947e-3ee17da7e4e3 req-b1534372-c119-454f-94ec-b0ab8b5d59ab service nova] Creating event network-changed:31691385-ab03-45c8-b4b0-b413c246c902 for instance 24f01a8a-885a-47c7-9e6b-6798ff1f0e4a on n-h2-850468-14 Aug 10 23:54:19.379301 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [req-d54d4b7b-3ad0-4b13-947e-3ee17da7e4e3 req-b1534372-c119-454f-94ec-b0ab8b5d59ab service nova] Instance 24f01a8a-885a-47c7-9e6b-6798ff1f0e4a is migrating within the same cell, copying events to all relevant hosts: {'n-h1-850468-14', 'n-h2-850468-14'} {{(pid=122632) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5901}} Aug 10 23:54:19.390466 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-d54d4b7b-3ad0-4b13-947e-3ee17da7e4e3 req-b1534372-c119-454f-94ec-b0ab8b5d59ab service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043259 Aug 10 23:54:19.391195 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3186/6579] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:54:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:54:20.280961 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-815af39c-b08e-4805-9ec7-bddcc7d675f7 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:54:20.281873 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-815af39c-b08e-4805-9ec7-bddcc7d675f7 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: 24f01a8a-885a-47c7-9e6b-6798ff1f0e4a] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:54:20.289624 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-815af39c-b08e-4805-9ec7-bddcc7d675f7 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:54:20.290288 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-815af39c-b08e-4805-9ec7-bddcc7d675f7 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:54:20.290771 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-815af39c-b08e-4805-9ec7-bddcc7d675f7 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:54:20.291752 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-815af39c-b08e-4805-9ec7-bddcc7d675f7 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:54:20.292319 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-815af39c-b08e-4805-9ec7-bddcc7d675f7 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:54:20.292741 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-815af39c-b08e-4805-9ec7-bddcc7d675f7 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:54:20.460017 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-815af39c-b08e-4805-9ec7-bddcc7d675f7 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:54:20.468140 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-815af39c-b08e-4805-9ec7-bddcc7d675f7 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/24f01a8a-885a-47c7-9e6b-6798ff1f0e4a" status: 200 len: 1679 microversion: 2.1 time: 0.191410 Aug 10 23:54:20.468739 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3394/6580] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:54:20 2022] GET /compute/v2.1/servers/24f01a8a-885a-47c7-9e6b-6798ff1f0e4a => generated 1679 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:54:20.491061 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-4d0d05c2-6afc-4f5f-959a-5d4c2aba219f tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:54:20.491789 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-4d0d05c2-6afc-4f5f-959a-5d4c2aba219f tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: 24f01a8a-885a-47c7-9e6b-6798ff1f0e4a] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:54:20.499134 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4d0d05c2-6afc-4f5f-959a-5d4c2aba219f tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:54:20.499693 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4d0d05c2-6afc-4f5f-959a-5d4c2aba219f tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:54:20.500444 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4d0d05c2-6afc-4f5f-959a-5d4c2aba219f tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:54:20.501326 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4d0d05c2-6afc-4f5f-959a-5d4c2aba219f tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:54:20.501815 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4d0d05c2-6afc-4f5f-959a-5d4c2aba219f tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:54:20.502241 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4d0d05c2-6afc-4f5f-959a-5d4c2aba219f tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:54:20.568707 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-4d0d05c2-6afc-4f5f-959a-5d4c2aba219f tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "POST /compute/v2.1/servers/24f01a8a-885a-47c7-9e6b-6798ff1f0e4a/action" status: 204 len: 0 microversion: 2.1 time: 0.082714 Aug 10 23:54:20.569370 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3187/6581] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:54:20 2022] POST /compute/v2.1/servers/24f01a8a-885a-47c7-9e6b-6798ff1f0e4a/action => generated 0 bytes in 84 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:54:20.578087 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-22877fd1-8b35-4480-a256-8bddc9f6ffee tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:54:20.579028 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-22877fd1-8b35-4480-a256-8bddc9f6ffee tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: 24f01a8a-885a-47c7-9e6b-6798ff1f0e4a] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:54:20.585741 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-22877fd1-8b35-4480-a256-8bddc9f6ffee tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:54:20.586118 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-22877fd1-8b35-4480-a256-8bddc9f6ffee tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:54:20.586587 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-22877fd1-8b35-4480-a256-8bddc9f6ffee tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:54:20.587377 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-22877fd1-8b35-4480-a256-8bddc9f6ffee tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:54:20.587842 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-22877fd1-8b35-4480-a256-8bddc9f6ffee tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:54:20.588273 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-22877fd1-8b35-4480-a256-8bddc9f6ffee tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:54:20.727002 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-22877fd1-8b35-4480-a256-8bddc9f6ffee tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:54:20.735502 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-22877fd1-8b35-4480-a256-8bddc9f6ffee tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/24f01a8a-885a-47c7-9e6b-6798ff1f0e4a" status: 200 len: 1679 microversion: 2.1 time: 0.161815 Aug 10 23:54:20.736095 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3395/6582] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:54:20 2022] GET /compute/v2.1/servers/24f01a8a-885a-47c7-9e6b-6798ff1f0e4a => generated 1679 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:54:21.758907 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-99d3454f-bce8-4159-afb2-c693addebc09 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:54:21.759611 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-99d3454f-bce8-4159-afb2-c693addebc09 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: 24f01a8a-885a-47c7-9e6b-6798ff1f0e4a] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:54:21.765904 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-99d3454f-bce8-4159-afb2-c693addebc09 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:54:21.766390 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-99d3454f-bce8-4159-afb2-c693addebc09 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:54:21.766857 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-99d3454f-bce8-4159-afb2-c693addebc09 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:54:21.767583 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-99d3454f-bce8-4159-afb2-c693addebc09 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:54:21.768036 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-99d3454f-bce8-4159-afb2-c693addebc09 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:54:21.768466 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-99d3454f-bce8-4159-afb2-c693addebc09 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:54:21.912397 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-99d3454f-bce8-4159-afb2-c693addebc09 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:54:21.920026 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-99d3454f-bce8-4159-afb2-c693addebc09 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/24f01a8a-885a-47c7-9e6b-6798ff1f0e4a" status: 200 len: 1671 microversion: 2.1 time: 0.166327 Aug 10 23:54:21.920604 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3188/6583] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:54:21 2022] GET /compute/v2.1/servers/24f01a8a-885a-47c7-9e6b-6798ff1f0e4a => generated 1671 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:54:21.940369 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-d4093d4d-81c9-4972-a7b0-0f6c420420da tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:54:21.941063 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-d4093d4d-81c9-4972-a7b0-0f6c420420da tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: 24f01a8a-885a-47c7-9e6b-6798ff1f0e4a] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:54:21.947908 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d4093d4d-81c9-4972-a7b0-0f6c420420da tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:54:21.948400 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d4093d4d-81c9-4972-a7b0-0f6c420420da tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:54:21.948843 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d4093d4d-81c9-4972-a7b0-0f6c420420da tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:54:21.949588 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d4093d4d-81c9-4972-a7b0-0f6c420420da tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:54:21.951233 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d4093d4d-81c9-4972-a7b0-0f6c420420da tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:54:21.951651 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d4093d4d-81c9-4972-a7b0-0f6c420420da tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:54:22.084676 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-d4093d4d-81c9-4972-a7b0-0f6c420420da tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:54:22.093408 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-d4093d4d-81c9-4972-a7b0-0f6c420420da tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/24f01a8a-885a-47c7-9e6b-6798ff1f0e4a" status: 200 len: 1671 microversion: 2.1 time: 0.156941 Aug 10 23:54:22.093994 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3396/6584] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:54:21 2022] GET /compute/v2.1/servers/24f01a8a-885a-47c7-9e6b-6798ff1f0e4a => generated 1671 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:54:22.113645 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-4cbf48d4-795e-46b9-b098-56f85c5ae2b5 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:54:22.114251 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-4cbf48d4-795e-46b9-b098-56f85c5ae2b5 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: 24f01a8a-885a-47c7-9e6b-6798ff1f0e4a] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:54:22.120257 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4cbf48d4-795e-46b9-b098-56f85c5ae2b5 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:54:22.120744 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4cbf48d4-795e-46b9-b098-56f85c5ae2b5 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:54:22.121175 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4cbf48d4-795e-46b9-b098-56f85c5ae2b5 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:54:22.122118 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4cbf48d4-795e-46b9-b098-56f85c5ae2b5 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:54:22.122845 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4cbf48d4-795e-46b9-b098-56f85c5ae2b5 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:54:22.123277 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4cbf48d4-795e-46b9-b098-56f85c5ae2b5 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:54:22.255987 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-4cbf48d4-795e-46b9-b098-56f85c5ae2b5 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:54:22.258210 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:54:22.265884 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-4cbf48d4-795e-46b9-b098-56f85c5ae2b5 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/24f01a8a-885a-47c7-9e6b-6798ff1f0e4a" status: 200 len: 1671 microversion: 2.1 time: 0.156142 Aug 10 23:54:22.266473 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3189/6585] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:54:22 2022] GET /compute/v2.1/servers/24f01a8a-885a-47c7-9e6b-6798ff1f0e4a => generated 1671 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:54:22.286776 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c847ba97-e83e-4c7f-a399-b32221f270c0 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:54:22.287429 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-c847ba97-e83e-4c7f-a399-b32221f270c0 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: 24f01a8a-885a-47c7-9e6b-6798ff1f0e4a] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:54:22.293476 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c847ba97-e83e-4c7f-a399-b32221f270c0 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:54:22.294547 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c847ba97-e83e-4c7f-a399-b32221f270c0 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:54:22.295228 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c847ba97-e83e-4c7f-a399-b32221f270c0 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:54:22.295944 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c847ba97-e83e-4c7f-a399-b32221f270c0 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:54:22.296424 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c847ba97-e83e-4c7f-a399-b32221f270c0 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:54:22.296873 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c847ba97-e83e-4c7f-a399-b32221f270c0 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:54:22.314884 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:54:22.323453 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-c847ba97-e83e-4c7f-a399-b32221f270c0 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: 24f01a8a-885a-47c7-9e6b-6798ff1f0e4a] Going to try to terminate instance {{(pid=122633) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:54:22.399868 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-c847ba97-e83e-4c7f-a399-b32221f270c0 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "DELETE /compute/v2.1/servers/24f01a8a-885a-47c7-9e6b-6798ff1f0e4a" status: 204 len: 0 microversion: 2.1 time: 0.116737 Aug 10 23:54:22.400472 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3397/6586] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:54:22 2022] DELETE /compute/v2.1/servers/24f01a8a-885a-47c7-9e6b-6798ff1f0e4a => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:54:22.409526 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-84fd4941-f42b-4a59-bd63-3cd74516d94c tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:54:22.410224 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-84fd4941-f42b-4a59-bd63-3cd74516d94c tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: 24f01a8a-885a-47c7-9e6b-6798ff1f0e4a] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:54:22.417407 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-84fd4941-f42b-4a59-bd63-3cd74516d94c tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:54:22.417891 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-84fd4941-f42b-4a59-bd63-3cd74516d94c tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:54:22.418331 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-84fd4941-f42b-4a59-bd63-3cd74516d94c tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:54:22.419762 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-84fd4941-f42b-4a59-bd63-3cd74516d94c tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:54:22.420212 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-84fd4941-f42b-4a59-bd63-3cd74516d94c tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:54:22.420635 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-84fd4941-f42b-4a59-bd63-3cd74516d94c tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:54:22.557910 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-84fd4941-f42b-4a59-bd63-3cd74516d94c tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:54:22.566329 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-84fd4941-f42b-4a59-bd63-3cd74516d94c tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/24f01a8a-885a-47c7-9e6b-6798ff1f0e4a" status: 200 len: 1677 microversion: 2.1 time: 0.160844 Aug 10 23:54:22.566943 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3190/6587] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:54:22 2022] GET /compute/v2.1/servers/24f01a8a-885a-47c7-9e6b-6798ff1f0e4a => generated 1677 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:54:23.281425 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-ba640e20-894b-44b8-b44d-e2469c0370e6 req-65a154a4-f163-4d94-bf1b-6dccb5ab8ad7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24f01a8a-885a-47c7-9e6b-6798ff1f0e4a", "name": "network-vif-plugged", "status": "completed", "tag": "31691385-ab03-45c8-b4b0-b413c246c902"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:54:23.291678 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-ba640e20-894b-44b8-b44d-e2469c0370e6 req-65a154a4-f163-4d94-bf1b-6dccb5ab8ad7 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:54:23.292169 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-ba640e20-894b-44b8-b44d-e2469c0370e6 req-65a154a4-f163-4d94-bf1b-6dccb5ab8ad7 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:54:23.292608 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-ba640e20-894b-44b8-b44d-e2469c0370e6 req-65a154a4-f163-4d94-bf1b-6dccb5ab8ad7 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:54:23.303169 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-ba640e20-894b-44b8-b44d-e2469c0370e6 req-65a154a4-f163-4d94-bf1b-6dccb5ab8ad7 service nova] Creating event network-vif-plugged:31691385-ab03-45c8-b4b0-b413c246c902 for instance 24f01a8a-885a-47c7-9e6b-6798ff1f0e4a on n-h2-850468-14 Aug 10 23:54:23.307987 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-ba640e20-894b-44b8-b44d-e2469c0370e6 req-65a154a4-f163-4d94-bf1b-6dccb5ab8ad7 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081011 Aug 10 23:54:23.308562 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3398/6588] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:54:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:54:23.588431 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-e44f2d9b-93f4-4c20-962b-25632af376ce tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:54:23.589042 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-e44f2d9b-93f4-4c20-962b-25632af376ce tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: 24f01a8a-885a-47c7-9e6b-6798ff1f0e4a] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:54:23.596139 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e44f2d9b-93f4-4c20-962b-25632af376ce tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:54:23.596631 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e44f2d9b-93f4-4c20-962b-25632af376ce tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:54:23.597069 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e44f2d9b-93f4-4c20-962b-25632af376ce tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:54:23.597774 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e44f2d9b-93f4-4c20-962b-25632af376ce tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:54:23.598227 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e44f2d9b-93f4-4c20-962b-25632af376ce tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:54:23.598654 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e44f2d9b-93f4-4c20-962b-25632af376ce tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:54:23.733365 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-e44f2d9b-93f4-4c20-962b-25632af376ce tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:54:23.740865 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-e44f2d9b-93f4-4c20-962b-25632af376ce tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/24f01a8a-885a-47c7-9e6b-6798ff1f0e4a" status: 200 len: 1677 microversion: 2.1 time: 0.156351 Aug 10 23:54:23.741440 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3191/6589] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:54:23 2022] GET /compute/v2.1/servers/24f01a8a-885a-47c7-9e6b-6798ff1f0e4a => generated 1677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:54:24.725399 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-9d2a3da9-a6a7-4f78-a26b-bd41a003c614 req-de1dfbeb-bf67-47ac-aee1-a8e6d100dbbb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24f01a8a-885a-47c7-9e6b-6798ff1f0e4a", "name": "network-vif-deleted", "tag": "31691385-ab03-45c8-b4b0-b413c246c902"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:54:24.736342 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-9d2a3da9-a6a7-4f78-a26b-bd41a003c614 req-de1dfbeb-bf67-47ac-aee1-a8e6d100dbbb service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:54:24.736831 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-9d2a3da9-a6a7-4f78-a26b-bd41a003c614 req-de1dfbeb-bf67-47ac-aee1-a8e6d100dbbb service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:54:24.737276 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-9d2a3da9-a6a7-4f78-a26b-bd41a003c614 req-de1dfbeb-bf67-47ac-aee1-a8e6d100dbbb service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:54:24.749716 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-9d2a3da9-a6a7-4f78-a26b-bd41a003c614 req-de1dfbeb-bf67-47ac-aee1-a8e6d100dbbb service nova] Creating event network-vif-deleted:31691385-ab03-45c8-b4b0-b413c246c902 for instance 24f01a8a-885a-47c7-9e6b-6798ff1f0e4a on n-h2-850468-14 Aug 10 23:54:24.757573 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-9d2a3da9-a6a7-4f78-a26b-bd41a003c614 req-de1dfbeb-bf67-47ac-aee1-a8e6d100dbbb service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034964 Aug 10 23:54:24.759048 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3399/6590] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:54:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:54:24.764280 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-72c5cdad-6b6a-4a6b-bd5a-32cdc2a73642 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:54:24.765600 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-72c5cdad-6b6a-4a6b-bd5a-32cdc2a73642 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: 24f01a8a-885a-47c7-9e6b-6798ff1f0e4a] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:54:24.773079 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-72c5cdad-6b6a-4a6b-bd5a-32cdc2a73642 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:54:24.773829 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-72c5cdad-6b6a-4a6b-bd5a-32cdc2a73642 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:54:24.774475 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-72c5cdad-6b6a-4a6b-bd5a-32cdc2a73642 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:54:24.775432 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-72c5cdad-6b6a-4a6b-bd5a-32cdc2a73642 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:54:24.776140 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-72c5cdad-6b6a-4a6b-bd5a-32cdc2a73642 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:54:24.776763 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-72c5cdad-6b6a-4a6b-bd5a-32cdc2a73642 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:54:24.851019 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-72c5cdad-6b6a-4a6b-bd5a-32cdc2a73642 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:54:24.859337 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-72c5cdad-6b6a-4a6b-bd5a-32cdc2a73642 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/24f01a8a-885a-47c7-9e6b-6798ff1f0e4a" status: 200 len: 1324 microversion: 2.1 time: 0.099777 Aug 10 23:54:24.861879 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3192/6591] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:54:24 2022] GET /compute/v2.1/servers/24f01a8a-885a-47c7-9e6b-6798ff1f0e4a => generated 1324 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:54:25.883280 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-9a3d7ba5-2efb-43a0-8547-83701b04ed25 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:54:25.884035 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-9a3d7ba5-2efb-43a0-8547-83701b04ed25 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: 24f01a8a-885a-47c7-9e6b-6798ff1f0e4a] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:54:25.890909 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9a3d7ba5-2efb-43a0-8547-83701b04ed25 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:54:25.891415 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9a3d7ba5-2efb-43a0-8547-83701b04ed25 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:54:25.891873 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9a3d7ba5-2efb-43a0-8547-83701b04ed25 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:54:25.892588 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9a3d7ba5-2efb-43a0-8547-83701b04ed25 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:54:25.893062 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9a3d7ba5-2efb-43a0-8547-83701b04ed25 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:54:25.893505 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9a3d7ba5-2efb-43a0-8547-83701b04ed25 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:54:25.910169 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-9a3d7ba5-2efb-43a0-8547-83701b04ed25 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] HTTP exception thrown: Instance 24f01a8a-885a-47c7-9e6b-6798ff1f0e4a could not be found. Aug 10 23:54:25.911865 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-9a3d7ba5-2efb-43a0-8547-83701b04ed25 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Request method failure captured: Aug 10 23:54:25.911865 n-d-850468-14 devstack@n-api.service[122633]: request: GET /compute/v2.1/servers/24f01a8a-885a-47c7-9e6b-6798ff1f0e4a HTTP/1.1 Aug 10 23:54:25.911865 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:54:25.911865 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:54:25.911865 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:54:25.911865 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:54:25.911865 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:54:25.911865 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:54:25.911865 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:54:25.911865 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:54:25.911865 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9ETka_MLrOzNLl9fMo23yiaBVbwRsDIGTKuSE2U_QdPMsSc8GHIwU4exY0o7VQcTlL32LUR0TzTXBFYguNbPnJvl-Oq37igm94dUqjDcjI8p0o_T8FFxkqM-af8dhqzR4fbIp2j_qc7pazKLEDLMGgsyywPyJGsRgPDIuxnwDfxMZ8k Aug 10 23:54:25.911865 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:54:25.911865 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:54:25.911865 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:54:25.911865 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:54:25.911865 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:54:25.911865 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:54:25.911865 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 49e20a407dbc425ea488dee2995ebbe3 Aug 10 23:54:25.911865 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-ServerActionsTestJSON-1613214326 Aug 10 23:54:25.911865 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:54:25.911865 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:54:25.911865 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/49e20a407dbc425ea488dee2995ebbe3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/49e20a407dbc425ea488dee2995ebbe3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/49e20a407dbc425ea488dee2995ebbe3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_49e20a407dbc425ea488dee2995ebbe3", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:54:25.911865 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-ServerActionsTestJSON-1613214326 Aug 10 23:54:25.911865 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 49e20a407dbc425ea488dee2995ebbe3 Aug 10 23:54:25.911865 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-ServerActionsTestJSON-1613214326 Aug 10 23:54:25.911865 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-ServerActionsTestJSON-1613214326-project Aug 10 23:54:25.911865 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:54:25.911865 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:54:25.911865 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 1412a4116dbb4412ba8ea10f72e2d95e Aug 10 23:54:25.911865 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-ServerActionsTestJSON-1613214326-project Aug 10 23:54:25.911865 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:54:25.911865 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance 24f01a8a-885a-47c7-9e6b-6798ff1f0e4a could not be found. Aug 10 23:54:25.911865 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': '24f01a8a-885a-47c7-9e6b-6798ff1f0e4a'} Aug 10 23:54:25.911865 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:54:25.911865 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:54:25.911865 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:54:25.911865 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:54:25.911865 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:54:25.911865 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:54:25.911865 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:54:25.911865 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:54:25.911865 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:54:25.911865 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:54:25.911865 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24f01a8a-885a-47c7-9e6b-6798ff1f0e4a could not be found. Aug 10 23:54:25.911865 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:54:25.911865 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:54:25.911865 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:54:25.911865 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:54:25.911865 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:54:25.911865 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:54:25.911865 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:54:25.911865 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:54:25.911865 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:54:25.911865 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:54:25.911865 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:54:25.911865 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:54:25.911865 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:54:25.911865 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:54:25.911865 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:54:25.911865 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:54:25.911865 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24f01a8a-885a-47c7-9e6b-6798ff1f0e4a could not be found. Aug 10 23:54:25.911865 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:54:25.911865 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:54:25.911865 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:54:25.915796 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:54:25.915796 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:54:25.915796 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:54:25.915796 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:54:25.915796 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:54:25.915796 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24f01a8a-885a-47c7-9e6b-6798ff1f0e4a could not be found. Aug 10 23:54:25.915796 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:54:25.915796 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-9a3d7ba5-2efb-43a0-8547-83701b04ed25 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Returning 404 to user: Instance 24f01a8a-885a-47c7-9e6b-6798ff1f0e4a could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:54:25.915796 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-9a3d7ba5-2efb-43a0-8547-83701b04ed25 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/24f01a8a-885a-47c7-9e6b-6798ff1f0e4a" status: 404 len: 111 microversion: 2.1 time: 0.035231 Aug 10 23:54:25.915796 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3400/6592] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:54:25 2022] GET /compute/v2.1/servers/24f01a8a-885a-47c7-9e6b-6798ff1f0e4a => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:54:25.926902 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-ac61c571-3bc3-41bd-83c3-f8a29f725235 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:54:25.927515 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-ac61c571-3bc3-41bd-83c3-f8a29f725235 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: 24f01a8a-885a-47c7-9e6b-6798ff1f0e4a] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:54:25.934258 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ac61c571-3bc3-41bd-83c3-f8a29f725235 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:54:25.934995 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ac61c571-3bc3-41bd-83c3-f8a29f725235 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:54:25.935265 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ac61c571-3bc3-41bd-83c3-f8a29f725235 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:54:25.935963 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ac61c571-3bc3-41bd-83c3-f8a29f725235 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:54:25.936417 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ac61c571-3bc3-41bd-83c3-f8a29f725235 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:54:25.936841 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ac61c571-3bc3-41bd-83c3-f8a29f725235 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:54:25.950699 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-ac61c571-3bc3-41bd-83c3-f8a29f725235 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] HTTP exception thrown: Instance 24f01a8a-885a-47c7-9e6b-6798ff1f0e4a could not be found. Aug 10 23:54:25.952188 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-ac61c571-3bc3-41bd-83c3-f8a29f725235 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Request method failure captured: Aug 10 23:54:25.952188 n-d-850468-14 devstack@n-api.service[122632]: request: GET /compute/v2.1/servers/24f01a8a-885a-47c7-9e6b-6798ff1f0e4a HTTP/1.1 Aug 10 23:54:25.952188 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:54:25.952188 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:54:25.952188 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:54:25.952188 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 23:54:25.952188 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:54:25.952188 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:54:25.952188 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:54:25.952188 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:54:25.952188 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9ETka_MLrOzNLl9fMo23yiaBVbwRsDIGTKuSE2U_QdPMsSc8GHIwU4exY0o7VQcTlL32LUR0TzTXBFYguNbPnJvl-Oq37igm94dUqjDcjI8p0o_T8FFxkqM-af8dhqzR4fbIp2j_qc7pazKLEDLMGgsyywPyJGsRgPDIuxnwDfxMZ8k Aug 10 23:54:25.952188 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:54:25.952188 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:54:25.952188 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:54:25.952188 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:54:25.952188 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:54:25.952188 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:54:25.952188 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 49e20a407dbc425ea488dee2995ebbe3 Aug 10 23:54:25.952188 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-ServerActionsTestJSON-1613214326 Aug 10 23:54:25.952188 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:54:25.952188 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:54:25.952188 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/49e20a407dbc425ea488dee2995ebbe3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/49e20a407dbc425ea488dee2995ebbe3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/49e20a407dbc425ea488dee2995ebbe3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_49e20a407dbc425ea488dee2995ebbe3", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:54:25.952188 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-ServerActionsTestJSON-1613214326 Aug 10 23:54:25.952188 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 49e20a407dbc425ea488dee2995ebbe3 Aug 10 23:54:25.952188 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-ServerActionsTestJSON-1613214326 Aug 10 23:54:25.952188 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-ServerActionsTestJSON-1613214326-project Aug 10 23:54:25.952188 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:54:25.952188 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:54:25.952188 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: 1412a4116dbb4412ba8ea10f72e2d95e Aug 10 23:54:25.952188 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-ServerActionsTestJSON-1613214326-project Aug 10 23:54:25.952188 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:54:25.952188 n-d-850468-14 devstack@n-api.service[122632]: exception: Instance 24f01a8a-885a-47c7-9e6b-6798ff1f0e4a could not be found. Aug 10 23:54:25.952188 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': '24f01a8a-885a-47c7-9e6b-6798ff1f0e4a'} Aug 10 23:54:25.952188 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:54:25.952188 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:54:25.952188 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:54:25.952188 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:54:25.952188 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:54:25.952188 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:54:25.952188 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:54:25.952188 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:54:25.952188 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:54:25.952188 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:54:25.952188 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24f01a8a-885a-47c7-9e6b-6798ff1f0e4a could not be found. Aug 10 23:54:25.952188 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:54:25.952188 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:54:25.952188 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:54:25.952188 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:54:25.952188 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:54:25.952188 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:54:25.952188 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:54:25.952188 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:54:25.952188 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:54:25.952188 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:54:25.952188 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:54:25.952188 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:54:25.952188 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:54:25.952188 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:54:25.952188 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:54:25.952188 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:54:25.952188 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24f01a8a-885a-47c7-9e6b-6798ff1f0e4a could not be found. Aug 10 23:54:25.952188 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:54:25.952188 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:54:25.952188 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:54:25.956167 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:54:25.956167 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:54:25.956167 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:54:25.956167 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:54:25.956167 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:54:25.956167 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24f01a8a-885a-47c7-9e6b-6798ff1f0e4a could not be found. Aug 10 23:54:25.956167 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:54:25.956167 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-ac61c571-3bc3-41bd-83c3-f8a29f725235 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Returning 404 to user: Instance 24f01a8a-885a-47c7-9e6b-6798ff1f0e4a could not be found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:54:25.956167 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-ac61c571-3bc3-41bd-83c3-f8a29f725235 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/24f01a8a-885a-47c7-9e6b-6798ff1f0e4a" status: 404 len: 111 microversion: 2.1 time: 0.030568 Aug 10 23:54:25.956167 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3193/6593] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:54:25 2022] GET /compute/v2.1/servers/24f01a8a-885a-47c7-9e6b-6798ff1f0e4a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:54:26.004402 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c98dede3-cd0f-43fa-81bd-eb3745e3dd9f tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-2085320151", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452", "networks": [{"uuid": "bbbbeb6b-4410-487d-bc67-956aff866a4e"}], "security_groups": [{"name": "tempest-securitygroup--1954233211"}], "key_name": "tempest-keypair-1767049833", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:54:26.108549 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.network.neutron [None req-c98dede3-cd0f-43fa-81bd-eb3745e3dd9f tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] validate_networks() for [('bbbbeb6b-4410-487d-bc67-956aff866a4e', None, None, None, None, None)] {{(pid=122633) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 23:54:26.557472 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-c98dede3-cd0f-43fa-81bd-eb3745e3dd9f tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Flavor limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:54:26.557903 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-c98dede3-cd0f-43fa-81bd-eb3745e3dd9f tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Image limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:54:26.558416 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-c98dede3-cd0f-43fa-81bd-eb3745e3dd9f tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Flavor pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:54:26.558936 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-c98dede3-cd0f-43fa-81bd-eb3745e3dd9f tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Image pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:54:26.560053 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-c98dede3-cd0f-43fa-81bd-eb3745e3dd9f tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:54:26.569968 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c98dede3-cd0f-43fa-81bd-eb3745e3dd9f tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:54:26.570490 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c98dede3-cd0f-43fa-81bd-eb3745e3dd9f tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:54:26.570979 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c98dede3-cd0f-43fa-81bd-eb3745e3dd9f tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:54:26.571714 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c98dede3-cd0f-43fa-81bd-eb3745e3dd9f tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:54:26.572180 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c98dede3-cd0f-43fa-81bd-eb3745e3dd9f tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:54:26.572615 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c98dede3-cd0f-43fa-81bd-eb3745e3dd9f tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:54:26.590166 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-c98dede3-cd0f-43fa-81bd-eb3745e3dd9f tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Getting quotas for project 49e20a407dbc425ea488dee2995ebbe3. Resources: {'instances', 'cores', 'ram'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:54:26.596039 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-c98dede3-cd0f-43fa-81bd-eb3745e3dd9f tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Getting quotas for user 1412a4116dbb4412ba8ea10f72e2d95e and project 49e20a407dbc425ea488dee2995ebbe3. Resources: {'instances', 'cores', 'ram'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:54:26.609234 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-c98dede3-cd0f-43fa-81bd-eb3745e3dd9f tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Going to run 1 instances... {{(pid=122633) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 23:54:26.611542 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-c98dede3-cd0f-43fa-81bd-eb3745e3dd9f tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: 3bb88b55-aac8-4559-8729-6dbeab0b4f45] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78ad8905-f66f-4733-8be9-2b260f1fabed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122633) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 23:54:26.656806 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-c98dede3-cd0f-43fa-81bd-eb3745e3dd9f tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.656595 Aug 10 23:54:26.657499 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3401/6594] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 23:54:25 2022] POST /compute/v2.1/servers => generated 406 bytes in 658 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 23:54:26.669307 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-6fe7a3ca-e3ae-40e5-a021-6313aaed0fe5 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:54:26.670089 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-6fe7a3ca-e3ae-40e5-a021-6313aaed0fe5 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: 3bb88b55-aac8-4559-8729-6dbeab0b4f45] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:54:26.672004 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_api:SELECT=41 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:54:26.725890 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-6fe7a3ca-e3ae-40e5-a021-6313aaed0fe5 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:54:26.733486 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-6fe7a3ca-e3ae-40e5-a021-6313aaed0fe5 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/3bb88b55-aac8-4559-8729-6dbeab0b4f45" status: 200 len: 1239 microversion: 2.1 time: 0.068669 Aug 10 23:54:26.734380 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3194/6595] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:54:26 2022] GET /compute/v2.1/servers/3bb88b55-aac8-4559-8729-6dbeab0b4f45 => generated 1239 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:54:27.757262 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-53729ca9-efc7-4cf8-9a7e-88652f764052 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:54:27.757785 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-53729ca9-efc7-4cf8-9a7e-88652f764052 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: 3bb88b55-aac8-4559-8729-6dbeab0b4f45] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:54:27.760032 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:54:27.767608 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-53729ca9-efc7-4cf8-9a7e-88652f764052 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:54:27.768115 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-53729ca9-efc7-4cf8-9a7e-88652f764052 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:54:27.768567 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-53729ca9-efc7-4cf8-9a7e-88652f764052 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:54:27.769342 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-53729ca9-efc7-4cf8-9a7e-88652f764052 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:54:27.769783 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-53729ca9-efc7-4cf8-9a7e-88652f764052 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:54:27.770215 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-53729ca9-efc7-4cf8-9a7e-88652f764052 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:54:27.838111 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-53729ca9-efc7-4cf8-9a7e-88652f764052 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:54:27.846194 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-53729ca9-efc7-4cf8-9a7e-88652f764052 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/3bb88b55-aac8-4559-8729-6dbeab0b4f45" status: 200 len: 1309 microversion: 2.1 time: 0.093936 Aug 10 23:54:27.846791 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3402/6596] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:54:27 2022] GET /compute/v2.1/servers/3bb88b55-aac8-4559-8729-6dbeab0b4f45 => generated 1309 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:54:28.867876 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-5a32702e-e750-4b97-87fc-8ddfb870f730 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:54:28.868493 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-5a32702e-e750-4b97-87fc-8ddfb870f730 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: 3bb88b55-aac8-4559-8729-6dbeab0b4f45] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:54:28.877199 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5a32702e-e750-4b97-87fc-8ddfb870f730 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:54:28.877693 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5a32702e-e750-4b97-87fc-8ddfb870f730 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:54:28.878135 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5a32702e-e750-4b97-87fc-8ddfb870f730 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:54:28.878872 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5a32702e-e750-4b97-87fc-8ddfb870f730 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:54:28.879329 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5a32702e-e750-4b97-87fc-8ddfb870f730 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:54:28.879757 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5a32702e-e750-4b97-87fc-8ddfb870f730 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:54:29.083344 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-5a32702e-e750-4b97-87fc-8ddfb870f730 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:54:29.092146 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-5a32702e-e750-4b97-87fc-8ddfb870f730 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/3bb88b55-aac8-4559-8729-6dbeab0b4f45" status: 200 len: 1365 microversion: 2.1 time: 0.228189 Aug 10 23:54:29.092915 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3195/6597] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:54:28 2022] GET /compute/v2.1/servers/3bb88b55-aac8-4559-8729-6dbeab0b4f45 => generated 1365 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:54:29.405827 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-1ae59db2-7025-43a8-86bb-108c9f072950 req-2e603d24-5763-4571-b8c9-94cfe66b7c79 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3bb88b55-aac8-4559-8729-6dbeab0b4f45", "tag": "f7b62669-172e-466c-9435-fd1c6e642e7c"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:54:29.416397 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-1ae59db2-7025-43a8-86bb-108c9f072950 req-2e603d24-5763-4571-b8c9-94cfe66b7c79 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:54:29.417110 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-1ae59db2-7025-43a8-86bb-108c9f072950 req-2e603d24-5763-4571-b8c9-94cfe66b7c79 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:54:29.417567 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-1ae59db2-7025-43a8-86bb-108c9f072950 req-2e603d24-5763-4571-b8c9-94cfe66b7c79 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:54:29.429153 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-1ae59db2-7025-43a8-86bb-108c9f072950 req-2e603d24-5763-4571-b8c9-94cfe66b7c79 service nova] Creating event network-changed:f7b62669-172e-466c-9435-fd1c6e642e7c for instance 3bb88b55-aac8-4559-8729-6dbeab0b4f45 on n-h2-850468-14 Aug 10 23:54:29.433945 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-1ae59db2-7025-43a8-86bb-108c9f072950 req-2e603d24-5763-4571-b8c9-94cfe66b7c79 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032710 Aug 10 23:54:29.434711 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3403/6598] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:54:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:54:30.113840 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-67e5811a-5b40-47d5-b574-2202a1840c6d tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:54:30.114451 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-67e5811a-5b40-47d5-b574-2202a1840c6d tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: 3bb88b55-aac8-4559-8729-6dbeab0b4f45] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:54:30.121394 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-67e5811a-5b40-47d5-b574-2202a1840c6d tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:54:30.121940 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-67e5811a-5b40-47d5-b574-2202a1840c6d tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:54:30.123024 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-67e5811a-5b40-47d5-b574-2202a1840c6d tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:54:30.123729 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-67e5811a-5b40-47d5-b574-2202a1840c6d tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:54:30.124181 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-67e5811a-5b40-47d5-b574-2202a1840c6d tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:54:30.124605 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-67e5811a-5b40-47d5-b574-2202a1840c6d tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:54:30.262879 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-67e5811a-5b40-47d5-b574-2202a1840c6d tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:54:30.270413 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-67e5811a-5b40-47d5-b574-2202a1840c6d tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/3bb88b55-aac8-4559-8729-6dbeab0b4f45" status: 200 len: 1365 microversion: 2.1 time: 0.160442 Aug 10 23:54:30.271033 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3196/6599] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:54:30 2022] GET /compute/v2.1/servers/3bb88b55-aac8-4559-8729-6dbeab0b4f45 => generated 1365 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:54:31.292847 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-4f518479-55da-4f4a-93ba-b4fde80545ec tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:54:31.293807 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-4f518479-55da-4f4a-93ba-b4fde80545ec tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: 3bb88b55-aac8-4559-8729-6dbeab0b4f45] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:54:31.300185 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4f518479-55da-4f4a-93ba-b4fde80545ec tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:54:31.300681 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4f518479-55da-4f4a-93ba-b4fde80545ec tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:54:31.301139 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4f518479-55da-4f4a-93ba-b4fde80545ec tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:54:31.301844 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4f518479-55da-4f4a-93ba-b4fde80545ec tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:54:31.302319 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4f518479-55da-4f4a-93ba-b4fde80545ec tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:54:31.302765 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4f518479-55da-4f4a-93ba-b4fde80545ec tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:54:31.451456 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-4f518479-55da-4f4a-93ba-b4fde80545ec tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:54:31.459805 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-4f518479-55da-4f4a-93ba-b4fde80545ec tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/3bb88b55-aac8-4559-8729-6dbeab0b4f45" status: 200 len: 1365 microversion: 2.1 time: 0.171950 Aug 10 23:54:31.468082 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3404/6600] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:54:31 2022] GET /compute/v2.1/servers/3bb88b55-aac8-4559-8729-6dbeab0b4f45 => generated 1365 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:54:32.482529 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c560c496-de29-4fb9-8e0c-d076850c3847 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:54:32.483176 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-c560c496-de29-4fb9-8e0c-d076850c3847 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: 3bb88b55-aac8-4559-8729-6dbeab0b4f45] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:54:32.491382 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c560c496-de29-4fb9-8e0c-d076850c3847 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:54:32.492061 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c560c496-de29-4fb9-8e0c-d076850c3847 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:54:32.492578 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c560c496-de29-4fb9-8e0c-d076850c3847 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:54:32.493438 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c560c496-de29-4fb9-8e0c-d076850c3847 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:54:32.494002 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c560c496-de29-4fb9-8e0c-d076850c3847 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:54:32.494764 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c560c496-de29-4fb9-8e0c-d076850c3847 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:54:32.637273 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-c560c496-de29-4fb9-8e0c-d076850c3847 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:54:32.645138 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-c560c496-de29-4fb9-8e0c-d076850c3847 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/3bb88b55-aac8-4559-8729-6dbeab0b4f45" status: 200 len: 1365 microversion: 2.1 time: 0.167305 Aug 10 23:54:32.645663 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3197/6601] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:54:32 2022] GET /compute/v2.1/servers/3bb88b55-aac8-4559-8729-6dbeab0b4f45 => generated 1365 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:54:33.112842 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-f01c46a3-b929-4560-b196-539a0172c9ae req-1b859358-319b-44b0-81fc-bd1c35ae7bbe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bb88b55-aac8-4559-8729-6dbeab0b4f45", "name": "network-vif-plugged", "status": "completed", "tag": "f7b62669-172e-466c-9435-fd1c6e642e7c"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:54:33.124489 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-f01c46a3-b929-4560-b196-539a0172c9ae req-1b859358-319b-44b0-81fc-bd1c35ae7bbe service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:54:33.125108 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-f01c46a3-b929-4560-b196-539a0172c9ae req-1b859358-319b-44b0-81fc-bd1c35ae7bbe service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:54:33.126168 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-f01c46a3-b929-4560-b196-539a0172c9ae req-1b859358-319b-44b0-81fc-bd1c35ae7bbe service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:54:33.139306 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-f01c46a3-b929-4560-b196-539a0172c9ae req-1b859358-319b-44b0-81fc-bd1c35ae7bbe service nova] Creating event network-vif-plugged:f7b62669-172e-466c-9435-fd1c6e642e7c for instance 3bb88b55-aac8-4559-8729-6dbeab0b4f45 on n-h2-850468-14 Aug 10 23:54:33.144388 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-f01c46a3-b929-4560-b196-539a0172c9ae req-1b859358-319b-44b0-81fc-bd1c35ae7bbe service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035357 Aug 10 23:54:33.145188 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3405/6602] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:54:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:54:33.665738 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-9153731c-d74a-401b-8b22-6e364ea21a6e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:54:33.666412 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-9153731c-d74a-401b-8b22-6e364ea21a6e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: 3bb88b55-aac8-4559-8729-6dbeab0b4f45] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:54:33.673377 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9153731c-d74a-401b-8b22-6e364ea21a6e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:54:33.673863 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9153731c-d74a-401b-8b22-6e364ea21a6e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:54:33.674306 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9153731c-d74a-401b-8b22-6e364ea21a6e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:54:33.675041 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9153731c-d74a-401b-8b22-6e364ea21a6e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:54:33.675530 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9153731c-d74a-401b-8b22-6e364ea21a6e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:54:33.675953 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9153731c-d74a-401b-8b22-6e364ea21a6e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:54:33.824413 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-9153731c-d74a-401b-8b22-6e364ea21a6e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:54:33.832892 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-9153731c-d74a-401b-8b22-6e364ea21a6e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/3bb88b55-aac8-4559-8729-6dbeab0b4f45" status: 200 len: 1365 microversion: 2.1 time: 0.171118 Aug 10 23:54:33.833486 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3198/6603] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:54:33 2022] GET /compute/v2.1/servers/3bb88b55-aac8-4559-8729-6dbeab0b4f45 => generated 1365 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:54:34.855319 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-9b45037f-60ee-46d6-abae-f12e6d1f1f2b tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:54:34.856598 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-9b45037f-60ee-46d6-abae-f12e6d1f1f2b tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: 3bb88b55-aac8-4559-8729-6dbeab0b4f45] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:54:34.862770 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9b45037f-60ee-46d6-abae-f12e6d1f1f2b tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:54:34.863333 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9b45037f-60ee-46d6-abae-f12e6d1f1f2b tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:54:34.863780 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9b45037f-60ee-46d6-abae-f12e6d1f1f2b tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:54:34.864510 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9b45037f-60ee-46d6-abae-f12e6d1f1f2b tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:54:34.864948 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9b45037f-60ee-46d6-abae-f12e6d1f1f2b tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:54:34.865385 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9b45037f-60ee-46d6-abae-f12e6d1f1f2b tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:54:34.998419 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-9b45037f-60ee-46d6-abae-f12e6d1f1f2b tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:54:35.006307 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-9b45037f-60ee-46d6-abae-f12e6d1f1f2b tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/3bb88b55-aac8-4559-8729-6dbeab0b4f45" status: 200 len: 1552 microversion: 2.1 time: 0.156162 Aug 10 23:54:35.006920 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3406/6604] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:54:34 2022] GET /compute/v2.1/servers/3bb88b55-aac8-4559-8729-6dbeab0b4f45 => generated 1552 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:54:35.027456 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-f943f8cd-c87f-46f6-b285-7ba6f9c6670c tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:54:35.028989 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-f943f8cd-c87f-46f6-b285-7ba6f9c6670c tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: 3bb88b55-aac8-4559-8729-6dbeab0b4f45] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:54:35.035830 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f943f8cd-c87f-46f6-b285-7ba6f9c6670c tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:54:35.036308 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f943f8cd-c87f-46f6-b285-7ba6f9c6670c tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:54:35.036739 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f943f8cd-c87f-46f6-b285-7ba6f9c6670c tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:54:35.037423 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f943f8cd-c87f-46f6-b285-7ba6f9c6670c tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:54:35.037872 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f943f8cd-c87f-46f6-b285-7ba6f9c6670c tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:54:35.038291 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f943f8cd-c87f-46f6-b285-7ba6f9c6670c tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:54:35.116190 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-f943f8cd-c87f-46f6-b285-7ba6f9c6670c tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/3bb88b55-aac8-4559-8729-6dbeab0b4f45/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092585 Aug 10 23:54:35.116833 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3199/6605] 10.222.0.58 () {58 vars in 1275 bytes} [Wed Aug 10 23:54:35 2022] GET /compute/v2.1/servers/3bb88b55-aac8-4559-8729-6dbeab0b4f45/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:54:36.064646 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-dc9d8a20-15f6-40fd-a438-99e90d7dbb5f req-70301cbc-5d0a-4f74-80d4-f6533ed5bfa0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3bb88b55-aac8-4559-8729-6dbeab0b4f45", "tag": "f7b62669-172e-466c-9435-fd1c6e642e7c"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:54:36.075685 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-dc9d8a20-15f6-40fd-a438-99e90d7dbb5f req-70301cbc-5d0a-4f74-80d4-f6533ed5bfa0 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:54:36.076181 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-dc9d8a20-15f6-40fd-a438-99e90d7dbb5f req-70301cbc-5d0a-4f74-80d4-f6533ed5bfa0 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:54:36.076637 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-dc9d8a20-15f6-40fd-a438-99e90d7dbb5f req-70301cbc-5d0a-4f74-80d4-f6533ed5bfa0 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:54:36.087925 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-dc9d8a20-15f6-40fd-a438-99e90d7dbb5f req-70301cbc-5d0a-4f74-80d4-f6533ed5bfa0 service nova] Creating event network-changed:f7b62669-172e-466c-9435-fd1c6e642e7c for instance 3bb88b55-aac8-4559-8729-6dbeab0b4f45 on n-h2-850468-14 Aug 10 23:54:36.092898 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-dc9d8a20-15f6-40fd-a438-99e90d7dbb5f req-70301cbc-5d0a-4f74-80d4-f6533ed5bfa0 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032108 Aug 10 23:54:36.093508 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3407/6606] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:54:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:55:16.961476 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=2 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:55:16.962399 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_api:SELECT=13 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:55:16.963045 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=49 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:55:16.967827 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-f1dd4c6e-c754-474f-b7c3-473cb62faf1e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:55:16.975290 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f1dd4c6e-c754-474f-b7c3-473cb62faf1e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:55:16.975776 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f1dd4c6e-c754-474f-b7c3-473cb62faf1e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:55:16.976210 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f1dd4c6e-c754-474f-b7c3-473cb62faf1e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:55:17.002328 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-f1dd4c6e-c754-474f-b7c3-473cb62faf1e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: 3bb88b55-aac8-4559-8729-6dbeab0b4f45] Going to try to stop instance {{(pid=122632) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 10 23:55:17.045219 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-f1dd4c6e-c754-474f-b7c3-473cb62faf1e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "POST /compute/v2.1/servers/3bb88b55-aac8-4559-8729-6dbeab0b4f45/action" status: 202 len: 0 microversion: 2.1 time: 0.085909 Aug 10 23:55:17.046556 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3200/6607] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:55:16 2022] POST /compute/v2.1/servers/3bb88b55-aac8-4559-8729-6dbeab0b4f45/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:55:17.052318 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=2 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:55:17.053115 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=6 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:55:17.055310 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_api:SELECT=11 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:55:17.056029 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:55:17.060677 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-346fa6ad-86f4-4fd9-869c-c4052d8892d4 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:55:17.061431 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-346fa6ad-86f4-4fd9-869c-c4052d8892d4 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: 3bb88b55-aac8-4559-8729-6dbeab0b4f45] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:55:17.073534 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-346fa6ad-86f4-4fd9-869c-c4052d8892d4 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:55:17.074052 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-346fa6ad-86f4-4fd9-869c-c4052d8892d4 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:55:17.074511 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-346fa6ad-86f4-4fd9-869c-c4052d8892d4 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:55:17.075269 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-346fa6ad-86f4-4fd9-869c-c4052d8892d4 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:55:17.075744 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-346fa6ad-86f4-4fd9-869c-c4052d8892d4 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:55:17.076189 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-346fa6ad-86f4-4fd9-869c-c4052d8892d4 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:55:17.216898 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-346fa6ad-86f4-4fd9-869c-c4052d8892d4 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:55:17.226126 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-346fa6ad-86f4-4fd9-869c-c4052d8892d4 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/3bb88b55-aac8-4559-8729-6dbeab0b4f45" status: 200 len: 1681 microversion: 2.1 time: 0.174811 Aug 10 23:55:17.226718 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3408/6608] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:55:17 2022] GET /compute/v2.1/servers/3bb88b55-aac8-4559-8729-6dbeab0b4f45 => generated 1681 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:55:18.250188 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-5118da34-b53e-4ae9-8218-8ff8484635ad tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:55:18.250916 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-5118da34-b53e-4ae9-8218-8ff8484635ad tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: 3bb88b55-aac8-4559-8729-6dbeab0b4f45] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:55:18.259262 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5118da34-b53e-4ae9-8218-8ff8484635ad tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:55:18.259741 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5118da34-b53e-4ae9-8218-8ff8484635ad tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:55:18.260175 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5118da34-b53e-4ae9-8218-8ff8484635ad tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:55:18.260855 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5118da34-b53e-4ae9-8218-8ff8484635ad tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:55:18.261314 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5118da34-b53e-4ae9-8218-8ff8484635ad tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:55:18.261715 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5118da34-b53e-4ae9-8218-8ff8484635ad tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:55:18.394672 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-5118da34-b53e-4ae9-8218-8ff8484635ad tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:55:18.402280 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-5118da34-b53e-4ae9-8218-8ff8484635ad tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/3bb88b55-aac8-4559-8729-6dbeab0b4f45" status: 200 len: 1681 microversion: 2.1 time: 0.158030 Aug 10 23:55:18.402878 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3201/6609] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:55:18 2022] GET /compute/v2.1/servers/3bb88b55-aac8-4559-8729-6dbeab0b4f45 => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:55:19.425582 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-f3f10b58-a0c6-4281-9eb0-ca37820c500c tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:55:19.426205 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-f3f10b58-a0c6-4281-9eb0-ca37820c500c tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: 3bb88b55-aac8-4559-8729-6dbeab0b4f45] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:55:19.433498 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f3f10b58-a0c6-4281-9eb0-ca37820c500c tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:55:19.433994 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f3f10b58-a0c6-4281-9eb0-ca37820c500c tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:55:19.434446 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f3f10b58-a0c6-4281-9eb0-ca37820c500c tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:55:19.435215 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f3f10b58-a0c6-4281-9eb0-ca37820c500c tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:55:19.435686 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f3f10b58-a0c6-4281-9eb0-ca37820c500c tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:55:19.436348 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f3f10b58-a0c6-4281-9eb0-ca37820c500c tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:55:19.566828 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-f3f10b58-a0c6-4281-9eb0-ca37820c500c tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:55:19.574555 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-f3f10b58-a0c6-4281-9eb0-ca37820c500c tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/3bb88b55-aac8-4559-8729-6dbeab0b4f45" status: 200 len: 1681 microversion: 2.1 time: 0.154162 Aug 10 23:55:19.575161 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3409/6610] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:55:19 2022] GET /compute/v2.1/servers/3bb88b55-aac8-4559-8729-6dbeab0b4f45 => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:55:20.596894 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-37441efe-c917-489d-8418-cb0b0b9afe51 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:55:20.597508 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-37441efe-c917-489d-8418-cb0b0b9afe51 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: 3bb88b55-aac8-4559-8729-6dbeab0b4f45] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:55:20.604210 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-37441efe-c917-489d-8418-cb0b0b9afe51 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:55:20.604702 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-37441efe-c917-489d-8418-cb0b0b9afe51 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:55:20.605141 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-37441efe-c917-489d-8418-cb0b0b9afe51 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:55:20.605839 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-37441efe-c917-489d-8418-cb0b0b9afe51 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:55:20.606294 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-37441efe-c917-489d-8418-cb0b0b9afe51 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:55:20.606720 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-37441efe-c917-489d-8418-cb0b0b9afe51 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:55:20.749011 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-37441efe-c917-489d-8418-cb0b0b9afe51 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:55:20.756775 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-37441efe-c917-489d-8418-cb0b0b9afe51 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/3bb88b55-aac8-4559-8729-6dbeab0b4f45" status: 200 len: 1681 microversion: 2.1 time: 0.163826 Aug 10 23:55:20.757353 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3202/6611] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:55:20 2022] GET /compute/v2.1/servers/3bb88b55-aac8-4559-8729-6dbeab0b4f45 => generated 1681 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:55:21.777763 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-ae6fdf09-bb11-4585-a794-b758738408ad tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:55:21.778385 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-ae6fdf09-bb11-4585-a794-b758738408ad tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: 3bb88b55-aac8-4559-8729-6dbeab0b4f45] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:55:21.786716 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ae6fdf09-bb11-4585-a794-b758738408ad tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:55:21.787244 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ae6fdf09-bb11-4585-a794-b758738408ad tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:55:21.787694 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ae6fdf09-bb11-4585-a794-b758738408ad tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:55:21.788407 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ae6fdf09-bb11-4585-a794-b758738408ad tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:55:21.788926 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ae6fdf09-bb11-4585-a794-b758738408ad tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:55:21.789358 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ae6fdf09-bb11-4585-a794-b758738408ad tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:55:21.918830 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-ae6fdf09-bb11-4585-a794-b758738408ad tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:55:21.926546 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-ae6fdf09-bb11-4585-a794-b758738408ad tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/3bb88b55-aac8-4559-8729-6dbeab0b4f45" status: 200 len: 1681 microversion: 2.1 time: 0.152790 Aug 10 23:55:21.927210 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3410/6612] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:55:21 2022] GET /compute/v2.1/servers/3bb88b55-aac8-4559-8729-6dbeab0b4f45 => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:55:22.947736 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-eaae6078-8c32-4926-b864-5c1997e1234e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:55:22.948336 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-eaae6078-8c32-4926-b864-5c1997e1234e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: 3bb88b55-aac8-4559-8729-6dbeab0b4f45] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:55:22.955713 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-eaae6078-8c32-4926-b864-5c1997e1234e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:55:22.956184 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-eaae6078-8c32-4926-b864-5c1997e1234e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:55:22.956614 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-eaae6078-8c32-4926-b864-5c1997e1234e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:55:22.957297 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-eaae6078-8c32-4926-b864-5c1997e1234e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:55:22.957749 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-eaae6078-8c32-4926-b864-5c1997e1234e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:55:22.958167 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-eaae6078-8c32-4926-b864-5c1997e1234e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:55:23.090936 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-eaae6078-8c32-4926-b864-5c1997e1234e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:55:23.099226 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-eaae6078-8c32-4926-b864-5c1997e1234e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/3bb88b55-aac8-4559-8729-6dbeab0b4f45" status: 200 len: 1681 microversion: 2.1 time: 0.155282 Aug 10 23:55:23.099797 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3203/6613] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:55:22 2022] GET /compute/v2.1/servers/3bb88b55-aac8-4559-8729-6dbeab0b4f45 => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:55:24.121822 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-dfdd2c8f-1375-42ed-8a7f-68fe5f847afb tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:55:24.122444 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-dfdd2c8f-1375-42ed-8a7f-68fe5f847afb tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: 3bb88b55-aac8-4559-8729-6dbeab0b4f45] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:55:24.129746 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dfdd2c8f-1375-42ed-8a7f-68fe5f847afb tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:55:24.130250 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dfdd2c8f-1375-42ed-8a7f-68fe5f847afb tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:55:24.130705 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dfdd2c8f-1375-42ed-8a7f-68fe5f847afb tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:55:24.131442 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dfdd2c8f-1375-42ed-8a7f-68fe5f847afb tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:55:24.131911 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dfdd2c8f-1375-42ed-8a7f-68fe5f847afb tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:55:24.132349 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-dfdd2c8f-1375-42ed-8a7f-68fe5f847afb tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:55:24.267258 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-dfdd2c8f-1375-42ed-8a7f-68fe5f847afb tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:55:24.274835 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-dfdd2c8f-1375-42ed-8a7f-68fe5f847afb tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/3bb88b55-aac8-4559-8729-6dbeab0b4f45" status: 200 len: 1681 microversion: 2.1 time: 0.156933 Aug 10 23:55:24.275420 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3411/6614] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:55:24 2022] GET /compute/v2.1/servers/3bb88b55-aac8-4559-8729-6dbeab0b4f45 => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:55:25.297177 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-8dc0cbcf-d4b9-45cc-99e0-90ea453a8822 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:55:25.297813 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-8dc0cbcf-d4b9-45cc-99e0-90ea453a8822 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: 3bb88b55-aac8-4559-8729-6dbeab0b4f45] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:55:25.304698 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8dc0cbcf-d4b9-45cc-99e0-90ea453a8822 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:55:25.305178 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8dc0cbcf-d4b9-45cc-99e0-90ea453a8822 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:55:25.305612 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8dc0cbcf-d4b9-45cc-99e0-90ea453a8822 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:55:25.306303 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8dc0cbcf-d4b9-45cc-99e0-90ea453a8822 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:55:25.306756 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8dc0cbcf-d4b9-45cc-99e0-90ea453a8822 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:55:25.307202 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8dc0cbcf-d4b9-45cc-99e0-90ea453a8822 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:55:25.437766 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-8dc0cbcf-d4b9-45cc-99e0-90ea453a8822 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:55:25.445458 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-8dc0cbcf-d4b9-45cc-99e0-90ea453a8822 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/3bb88b55-aac8-4559-8729-6dbeab0b4f45" status: 200 len: 1681 microversion: 2.1 time: 0.153010 Aug 10 23:55:25.446002 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3204/6615] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:55:25 2022] GET /compute/v2.1/servers/3bb88b55-aac8-4559-8729-6dbeab0b4f45 => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:55:26.466791 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-a0a9593f-0f3a-4e36-a4ba-d56f2c65d107 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:55:26.467478 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-a0a9593f-0f3a-4e36-a4ba-d56f2c65d107 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: 3bb88b55-aac8-4559-8729-6dbeab0b4f45] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:55:26.474280 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a0a9593f-0f3a-4e36-a4ba-d56f2c65d107 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:55:26.474798 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a0a9593f-0f3a-4e36-a4ba-d56f2c65d107 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:55:26.475275 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a0a9593f-0f3a-4e36-a4ba-d56f2c65d107 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:55:26.475995 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a0a9593f-0f3a-4e36-a4ba-d56f2c65d107 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:55:26.476472 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a0a9593f-0f3a-4e36-a4ba-d56f2c65d107 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:55:26.476917 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a0a9593f-0f3a-4e36-a4ba-d56f2c65d107 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:55:26.605036 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-a0a9593f-0f3a-4e36-a4ba-d56f2c65d107 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:55:26.613560 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-a0a9593f-0f3a-4e36-a4ba-d56f2c65d107 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/3bb88b55-aac8-4559-8729-6dbeab0b4f45" status: 200 len: 1681 microversion: 2.1 time: 0.150760 Aug 10 23:55:26.614153 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3412/6616] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:55:26 2022] GET /compute/v2.1/servers/3bb88b55-aac8-4559-8729-6dbeab0b4f45 => generated 1681 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:55:27.636517 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-f50bfe3c-6062-4914-a2a0-bb015d644c86 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:55:27.637157 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-f50bfe3c-6062-4914-a2a0-bb015d644c86 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: 3bb88b55-aac8-4559-8729-6dbeab0b4f45] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:55:27.643566 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f50bfe3c-6062-4914-a2a0-bb015d644c86 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:55:27.644059 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f50bfe3c-6062-4914-a2a0-bb015d644c86 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:55:27.644502 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f50bfe3c-6062-4914-a2a0-bb015d644c86 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:55:27.645209 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f50bfe3c-6062-4914-a2a0-bb015d644c86 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:55:27.645665 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f50bfe3c-6062-4914-a2a0-bb015d644c86 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:55:27.646089 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f50bfe3c-6062-4914-a2a0-bb015d644c86 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:55:27.856610 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-f50bfe3c-6062-4914-a2a0-bb015d644c86 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:55:27.864416 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-f50bfe3c-6062-4914-a2a0-bb015d644c86 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/3bb88b55-aac8-4559-8729-6dbeab0b4f45" status: 200 len: 1681 microversion: 2.1 time: 0.233098 Aug 10 23:55:27.864996 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3205/6617] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:55:27 2022] GET /compute/v2.1/servers/3bb88b55-aac8-4559-8729-6dbeab0b4f45 => generated 1681 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:55:28.587454 n-d-850468-14 devstack@n-api.service[122633]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 23:55:28.587983 n-d-850468-14 devstack@n-api.service[122633]: Wed Aug 10 23:55:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 23:55:28.886119 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-8ae5a10f-5f43-4a08-898a-f0915ec3fa3b tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:55:28.886671 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-8ae5a10f-5f43-4a08-898a-f0915ec3fa3b tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: 3bb88b55-aac8-4559-8729-6dbeab0b4f45] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:55:28.896345 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8ae5a10f-5f43-4a08-898a-f0915ec3fa3b tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:55:28.896851 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8ae5a10f-5f43-4a08-898a-f0915ec3fa3b tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:55:28.897311 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8ae5a10f-5f43-4a08-898a-f0915ec3fa3b tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:55:28.898034 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8ae5a10f-5f43-4a08-898a-f0915ec3fa3b tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:55:28.898511 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8ae5a10f-5f43-4a08-898a-f0915ec3fa3b tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:55:28.898990 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8ae5a10f-5f43-4a08-898a-f0915ec3fa3b tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:55:29.036704 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-8ae5a10f-5f43-4a08-898a-f0915ec3fa3b tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:55:29.044434 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-8ae5a10f-5f43-4a08-898a-f0915ec3fa3b tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/3bb88b55-aac8-4559-8729-6dbeab0b4f45" status: 200 len: 1681 microversion: 2.1 time: 0.162382 Aug 10 23:55:29.045003 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3413/6618] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:55:28 2022] GET /compute/v2.1/servers/3bb88b55-aac8-4559-8729-6dbeab0b4f45 => generated 1681 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:55:29.279606 n-d-850468-14 devstack@n-api.service[122632]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 23:55:29.280370 n-d-850468-14 devstack@n-api.service[122632]: Wed Aug 10 23:55:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 23:55:29.389922 n-d-850468-14 devstack@n-api.service[122632]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 23:55:29.390166 n-d-850468-14 devstack@n-api.service[122632]: Wed Aug 10 23:55:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 23:55:30.067519 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-2187a850-063f-478a-85c3-34b62436a557 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:55:30.068174 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-2187a850-063f-478a-85c3-34b62436a557 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: 3bb88b55-aac8-4559-8729-6dbeab0b4f45] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:55:30.078421 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2187a850-063f-478a-85c3-34b62436a557 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:55:30.079126 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2187a850-063f-478a-85c3-34b62436a557 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:55:30.079606 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2187a850-063f-478a-85c3-34b62436a557 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:55:30.080483 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2187a850-063f-478a-85c3-34b62436a557 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:55:30.080739 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2187a850-063f-478a-85c3-34b62436a557 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:55:30.081167 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2187a850-063f-478a-85c3-34b62436a557 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:55:30.215864 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-2187a850-063f-478a-85c3-34b62436a557 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:55:30.224602 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-2187a850-063f-478a-85c3-34b62436a557 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/3bb88b55-aac8-4559-8729-6dbeab0b4f45" status: 200 len: 1681 microversion: 2.1 time: 0.161085 Aug 10 23:55:30.225174 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3206/6619] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:55:30 2022] GET /compute/v2.1/servers/3bb88b55-aac8-4559-8729-6dbeab0b4f45 => generated 1681 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:55:31.246503 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-00a95a86-5296-41aa-be8d-ee3c75008a5f tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:55:31.247163 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-00a95a86-5296-41aa-be8d-ee3c75008a5f tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: 3bb88b55-aac8-4559-8729-6dbeab0b4f45] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:55:31.254207 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-00a95a86-5296-41aa-be8d-ee3c75008a5f tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:55:31.254718 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-00a95a86-5296-41aa-be8d-ee3c75008a5f tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:55:31.255214 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-00a95a86-5296-41aa-be8d-ee3c75008a5f tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:55:31.255948 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-00a95a86-5296-41aa-be8d-ee3c75008a5f tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:55:31.256420 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-00a95a86-5296-41aa-be8d-ee3c75008a5f tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:55:31.256867 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-00a95a86-5296-41aa-be8d-ee3c75008a5f tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:55:31.392772 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-00a95a86-5296-41aa-be8d-ee3c75008a5f tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:55:31.400457 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-00a95a86-5296-41aa-be8d-ee3c75008a5f tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/3bb88b55-aac8-4559-8729-6dbeab0b4f45" status: 200 len: 1681 microversion: 2.1 time: 0.157948 Aug 10 23:55:31.401028 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3414/6620] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:55:31 2022] GET /compute/v2.1/servers/3bb88b55-aac8-4559-8729-6dbeab0b4f45 => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:55:32.422299 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-901739dc-bdf1-4dd2-9cfd-3a2093272a41 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:55:32.423335 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-901739dc-bdf1-4dd2-9cfd-3a2093272a41 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: 3bb88b55-aac8-4559-8729-6dbeab0b4f45] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:55:32.429857 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-901739dc-bdf1-4dd2-9cfd-3a2093272a41 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:55:32.430342 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-901739dc-bdf1-4dd2-9cfd-3a2093272a41 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:55:32.430789 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-901739dc-bdf1-4dd2-9cfd-3a2093272a41 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:55:32.431499 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-901739dc-bdf1-4dd2-9cfd-3a2093272a41 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:55:32.431950 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-901739dc-bdf1-4dd2-9cfd-3a2093272a41 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:55:32.432372 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-901739dc-bdf1-4dd2-9cfd-3a2093272a41 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:55:32.899817 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-901739dc-bdf1-4dd2-9cfd-3a2093272a41 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:55:32.908200 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-901739dc-bdf1-4dd2-9cfd-3a2093272a41 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/3bb88b55-aac8-4559-8729-6dbeab0b4f45" status: 200 len: 1658 microversion: 2.1 time: 0.490526 Aug 10 23:55:32.908769 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3207/6621] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:55:32 2022] GET /compute/v2.1/servers/3bb88b55-aac8-4559-8729-6dbeab0b4f45 => generated 1658 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:55:32.929723 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c0881fd5-97ab-48fc-bdb4-5a58533508cc tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:55:32.931974 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-c0881fd5-97ab-48fc-bdb4-5a58533508cc tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: 3bb88b55-aac8-4559-8729-6dbeab0b4f45] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:55:32.939466 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c0881fd5-97ab-48fc-bdb4-5a58533508cc tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:55:32.939960 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c0881fd5-97ab-48fc-bdb4-5a58533508cc tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:55:32.940405 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c0881fd5-97ab-48fc-bdb4-5a58533508cc tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:55:32.941266 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c0881fd5-97ab-48fc-bdb4-5a58533508cc tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:55:32.941578 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c0881fd5-97ab-48fc-bdb4-5a58533508cc tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:55:32.942017 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c0881fd5-97ab-48fc-bdb4-5a58533508cc tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:55:32.972047 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-c0881fd5-97ab-48fc-bdb4-5a58533508cc tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:55:32.978068 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-c0881fd5-97ab-48fc-bdb4-5a58533508cc tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: 3bb88b55-aac8-4559-8729-6dbeab0b4f45] Old instance type m1.heat2, new instance type m1.heat {{(pid=122633) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 10 23:55:32.985564 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-c0881fd5-97ab-48fc-bdb4-5a58533508cc tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Flavor limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:55:32.985999 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-c0881fd5-97ab-48fc-bdb4-5a58533508cc tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Image limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:55:32.986488 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-c0881fd5-97ab-48fc-bdb4-5a58533508cc tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Flavor pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:55:32.986933 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-c0881fd5-97ab-48fc-bdb4-5a58533508cc tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Image pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:55:32.987359 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-c0881fd5-97ab-48fc-bdb4-5a58533508cc tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:55:33.054201 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-c0881fd5-97ab-48fc-bdb4-5a58533508cc tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "POST /compute/v2.1/servers/3bb88b55-aac8-4559-8729-6dbeab0b4f45/action" status: 202 len: 0 microversion: 2.1 time: 0.128318 Aug 10 23:55:33.055137 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3415/6622] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:55:32 2022] POST /compute/v2.1/servers/3bb88b55-aac8-4559-8729-6dbeab0b4f45/action => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 10 23:55:33.063164 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-8d521a8e-8e6a-4947-b784-c3828eaeb014 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:55:33.063775 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-8d521a8e-8e6a-4947-b784-c3828eaeb014 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: 3bb88b55-aac8-4559-8729-6dbeab0b4f45] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:55:33.070002 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8d521a8e-8e6a-4947-b784-c3828eaeb014 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:55:33.070491 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8d521a8e-8e6a-4947-b784-c3828eaeb014 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:55:33.070953 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8d521a8e-8e6a-4947-b784-c3828eaeb014 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:55:33.071657 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8d521a8e-8e6a-4947-b784-c3828eaeb014 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:55:33.072130 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8d521a8e-8e6a-4947-b784-c3828eaeb014 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:55:33.072556 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8d521a8e-8e6a-4947-b784-c3828eaeb014 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:55:33.212931 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-8d521a8e-8e6a-4947-b784-c3828eaeb014 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:55:33.221741 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-8d521a8e-8e6a-4947-b784-c3828eaeb014 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/3bb88b55-aac8-4559-8729-6dbeab0b4f45" status: 200 len: 1681 microversion: 2.1 time: 0.162611 Aug 10 23:55:33.222374 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3208/6623] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:55:33 2022] GET /compute/v2.1/servers/3bb88b55-aac8-4559-8729-6dbeab0b4f45 => generated 1681 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:55:34.245781 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-b3bc8748-cf8a-463e-b9ae-8d12ac0107b6 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:55:34.246395 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-b3bc8748-cf8a-463e-b9ae-8d12ac0107b6 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: 3bb88b55-aac8-4559-8729-6dbeab0b4f45] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:55:34.253614 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b3bc8748-cf8a-463e-b9ae-8d12ac0107b6 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:55:34.254120 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b3bc8748-cf8a-463e-b9ae-8d12ac0107b6 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:55:34.254660 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b3bc8748-cf8a-463e-b9ae-8d12ac0107b6 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:55:34.255530 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b3bc8748-cf8a-463e-b9ae-8d12ac0107b6 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:55:34.256077 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b3bc8748-cf8a-463e-b9ae-8d12ac0107b6 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:55:34.256596 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b3bc8748-cf8a-463e-b9ae-8d12ac0107b6 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:55:34.396234 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-b3bc8748-cf8a-463e-b9ae-8d12ac0107b6 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:55:34.404175 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-b3bc8748-cf8a-463e-b9ae-8d12ac0107b6 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/3bb88b55-aac8-4559-8729-6dbeab0b4f45" status: 200 len: 1681 microversion: 2.1 time: 0.164668 Aug 10 23:55:34.404748 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3416/6624] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:55:34 2022] GET /compute/v2.1/servers/3bb88b55-aac8-4559-8729-6dbeab0b4f45 => generated 1681 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:55:35.425850 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-cf8c6480-e7cd-482d-910d-716bd5bc0a17 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:55:35.426495 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-cf8c6480-e7cd-482d-910d-716bd5bc0a17 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: 3bb88b55-aac8-4559-8729-6dbeab0b4f45] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:55:35.433386 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cf8c6480-e7cd-482d-910d-716bd5bc0a17 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:55:35.433875 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cf8c6480-e7cd-482d-910d-716bd5bc0a17 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:55:35.434314 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cf8c6480-e7cd-482d-910d-716bd5bc0a17 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:55:35.435042 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cf8c6480-e7cd-482d-910d-716bd5bc0a17 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:55:35.435496 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cf8c6480-e7cd-482d-910d-716bd5bc0a17 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:55:35.435920 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cf8c6480-e7cd-482d-910d-716bd5bc0a17 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:55:35.573333 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-cf8c6480-e7cd-482d-910d-716bd5bc0a17 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:55:35.581653 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-cf8c6480-e7cd-482d-910d-716bd5bc0a17 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/3bb88b55-aac8-4559-8729-6dbeab0b4f45" status: 200 len: 1686 microversion: 2.1 time: 0.159994 Aug 10 23:55:35.582222 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3209/6625] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:55:35 2022] GET /compute/v2.1/servers/3bb88b55-aac8-4559-8729-6dbeab0b4f45 => generated 1686 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:55:36.604329 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-3a5bb525-680a-4ad0-9112-2f17f52bebd5 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:55:36.604954 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-3a5bb525-680a-4ad0-9112-2f17f52bebd5 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: 3bb88b55-aac8-4559-8729-6dbeab0b4f45] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:55:36.612513 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3a5bb525-680a-4ad0-9112-2f17f52bebd5 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:55:36.613012 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3a5bb525-680a-4ad0-9112-2f17f52bebd5 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:55:36.613460 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3a5bb525-680a-4ad0-9112-2f17f52bebd5 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:55:36.614869 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3a5bb525-680a-4ad0-9112-2f17f52bebd5 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:55:36.615120 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3a5bb525-680a-4ad0-9112-2f17f52bebd5 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:55:36.615559 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3a5bb525-680a-4ad0-9112-2f17f52bebd5 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:55:36.749159 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-3a5bb525-680a-4ad0-9112-2f17f52bebd5 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:55:36.757263 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-3a5bb525-680a-4ad0-9112-2f17f52bebd5 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/3bb88b55-aac8-4559-8729-6dbeab0b4f45" status: 200 len: 1686 microversion: 2.1 time: 0.156960 Aug 10 23:55:36.757776 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3417/6626] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:55:36 2022] GET /compute/v2.1/servers/3bb88b55-aac8-4559-8729-6dbeab0b4f45 => generated 1686 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:55:37.746020 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-0d03f72c-3bca-4131-a2c8-c64a1b5e2d71 req-cede623e-bd51-4781-9ccf-f4e4e8c64f8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bb88b55-aac8-4559-8729-6dbeab0b4f45", "name": "network-vif-unplugged", "status": "completed", "tag": "f7b62669-172e-466c-9435-fd1c6e642e7c"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:55:37.757527 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-0d03f72c-3bca-4131-a2c8-c64a1b5e2d71 req-cede623e-bd51-4781-9ccf-f4e4e8c64f8c service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:55:37.758010 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-0d03f72c-3bca-4131-a2c8-c64a1b5e2d71 req-cede623e-bd51-4781-9ccf-f4e4e8c64f8c service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:55:37.758450 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-0d03f72c-3bca-4131-a2c8-c64a1b5e2d71 req-cede623e-bd51-4781-9ccf-f4e4e8c64f8c service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:55:37.771176 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-0d03f72c-3bca-4131-a2c8-c64a1b5e2d71 req-cede623e-bd51-4781-9ccf-f4e4e8c64f8c service nova] Creating event network-vif-unplugged:f7b62669-172e-466c-9435-fd1c6e642e7c for instance 3bb88b55-aac8-4559-8729-6dbeab0b4f45 on n-h1-850468-14 Aug 10 23:55:37.777039 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [req-0d03f72c-3bca-4131-a2c8-c64a1b5e2d71 req-cede623e-bd51-4781-9ccf-f4e4e8c64f8c service nova] Instance 3bb88b55-aac8-4559-8729-6dbeab0b4f45 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-850468-14', 'n-h2-850468-14'} {{(pid=122632) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5901}} Aug 10 23:55:37.779741 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-cc0a37d3-e2e6-4f2a-998a-1a166f11da5c tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:55:37.780496 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-cc0a37d3-e2e6-4f2a-998a-1a166f11da5c tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: 3bb88b55-aac8-4559-8729-6dbeab0b4f45] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:55:37.789228 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cc0a37d3-e2e6-4f2a-998a-1a166f11da5c tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:55:37.789639 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-0d03f72c-3bca-4131-a2c8-c64a1b5e2d71 req-cede623e-bd51-4781-9ccf-f4e4e8c64f8c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047781 Aug 10 23:55:37.789754 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cc0a37d3-e2e6-4f2a-998a-1a166f11da5c tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:55:37.790362 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cc0a37d3-e2e6-4f2a-998a-1a166f11da5c tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:55:37.790573 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3210/6627] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:55:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:55:37.791254 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cc0a37d3-e2e6-4f2a-998a-1a166f11da5c tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:55:37.791904 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cc0a37d3-e2e6-4f2a-998a-1a166f11da5c tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:55:37.792383 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cc0a37d3-e2e6-4f2a-998a-1a166f11da5c tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:55:37.933314 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-cc0a37d3-e2e6-4f2a-998a-1a166f11da5c tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:55:37.941830 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-cc0a37d3-e2e6-4f2a-998a-1a166f11da5c tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/3bb88b55-aac8-4559-8729-6dbeab0b4f45" status: 200 len: 1685 microversion: 2.1 time: 0.166616 Aug 10 23:55:37.942612 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3418/6628] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:55:37 2022] GET /compute/v2.1/servers/3bb88b55-aac8-4559-8729-6dbeab0b4f45 => generated 1685 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:55:38.965616 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-4b4684db-3233-4f01-8cbb-bc5c76ec37be tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:55:38.966537 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-4b4684db-3233-4f01-8cbb-bc5c76ec37be tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: 3bb88b55-aac8-4559-8729-6dbeab0b4f45] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:55:38.973852 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4b4684db-3233-4f01-8cbb-bc5c76ec37be tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:55:38.974346 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4b4684db-3233-4f01-8cbb-bc5c76ec37be tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:55:38.974828 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4b4684db-3233-4f01-8cbb-bc5c76ec37be tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:55:38.975563 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4b4684db-3233-4f01-8cbb-bc5c76ec37be tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:55:38.976019 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4b4684db-3233-4f01-8cbb-bc5c76ec37be tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:55:38.976439 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4b4684db-3233-4f01-8cbb-bc5c76ec37be tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:55:39.107970 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-4b4684db-3233-4f01-8cbb-bc5c76ec37be tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:55:39.115942 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-4b4684db-3233-4f01-8cbb-bc5c76ec37be tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/3bb88b55-aac8-4559-8729-6dbeab0b4f45" status: 200 len: 1683 microversion: 2.1 time: 0.155459 Aug 10 23:55:39.116521 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3211/6629] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:55:38 2022] GET /compute/v2.1/servers/3bb88b55-aac8-4559-8729-6dbeab0b4f45 => generated 1683 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:55:39.807476 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-eb230bda-685a-47d0-bf33-672a15d12645 req-f6d61125-2da5-4b50-8aad-486af0e31e6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3bb88b55-aac8-4559-8729-6dbeab0b4f45", "tag": "f7b62669-172e-466c-9435-fd1c6e642e7c"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:55:39.822796 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-eb230bda-685a-47d0-bf33-672a15d12645 req-f6d61125-2da5-4b50-8aad-486af0e31e6c service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:55:39.823313 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-eb230bda-685a-47d0-bf33-672a15d12645 req-f6d61125-2da5-4b50-8aad-486af0e31e6c service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:55:39.823766 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-eb230bda-685a-47d0-bf33-672a15d12645 req-f6d61125-2da5-4b50-8aad-486af0e31e6c service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:55:39.836786 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-eb230bda-685a-47d0-bf33-672a15d12645 req-f6d61125-2da5-4b50-8aad-486af0e31e6c service nova] Creating event network-changed:f7b62669-172e-466c-9435-fd1c6e642e7c for instance 3bb88b55-aac8-4559-8729-6dbeab0b4f45 on n-h1-850468-14 Aug 10 23:55:39.842370 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [req-eb230bda-685a-47d0-bf33-672a15d12645 req-f6d61125-2da5-4b50-8aad-486af0e31e6c service nova] Instance 3bb88b55-aac8-4559-8729-6dbeab0b4f45 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-850468-14', 'n-h2-850468-14'} {{(pid=122633) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5901}} Aug 10 23:55:39.854845 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-eb230bda-685a-47d0-bf33-672a15d12645 req-f6d61125-2da5-4b50-8aad-486af0e31e6c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050889 Aug 10 23:55:39.855491 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3419/6630] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:55:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:55:40.137849 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-d7ac5055-6130-4231-844a-82f9efca751f tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:55:40.138234 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-d7ac5055-6130-4231-844a-82f9efca751f tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: 3bb88b55-aac8-4559-8729-6dbeab0b4f45] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:55:40.145482 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d7ac5055-6130-4231-844a-82f9efca751f tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:55:40.145976 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d7ac5055-6130-4231-844a-82f9efca751f tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:55:40.146408 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d7ac5055-6130-4231-844a-82f9efca751f tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:55:40.147384 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d7ac5055-6130-4231-844a-82f9efca751f tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:55:40.148150 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d7ac5055-6130-4231-844a-82f9efca751f tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:55:40.148715 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d7ac5055-6130-4231-844a-82f9efca751f tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:55:40.452909 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-d7ac5055-6130-4231-844a-82f9efca751f tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:55:40.461615 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-d7ac5055-6130-4231-844a-82f9efca751f tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/3bb88b55-aac8-4559-8729-6dbeab0b4f45" status: 200 len: 1679 microversion: 2.1 time: 0.327954 Aug 10 23:55:40.462205 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3212/6631] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:55:40 2022] GET /compute/v2.1/servers/3bb88b55-aac8-4559-8729-6dbeab0b4f45 => generated 1679 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:55:40.483621 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-8fe551d8-2538-4d7b-b465-6d3621f2450e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:55:40.484287 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-8fe551d8-2538-4d7b-b465-6d3621f2450e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: 3bb88b55-aac8-4559-8729-6dbeab0b4f45] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:55:40.491187 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8fe551d8-2538-4d7b-b465-6d3621f2450e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:55:40.491689 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8fe551d8-2538-4d7b-b465-6d3621f2450e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:55:40.492140 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8fe551d8-2538-4d7b-b465-6d3621f2450e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:55:40.492849 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8fe551d8-2538-4d7b-b465-6d3621f2450e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:55:40.493312 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8fe551d8-2538-4d7b-b465-6d3621f2450e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:55:40.493749 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8fe551d8-2538-4d7b-b465-6d3621f2450e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:55:40.558097 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-8fe551d8-2538-4d7b-b465-6d3621f2450e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "POST /compute/v2.1/servers/3bb88b55-aac8-4559-8729-6dbeab0b4f45/action" status: 204 len: 0 microversion: 2.1 time: 0.078530 Aug 10 23:55:40.558867 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3420/6632] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:55:40 2022] POST /compute/v2.1/servers/3bb88b55-aac8-4559-8729-6dbeab0b4f45/action => generated 0 bytes in 80 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:55:40.569314 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-bffdfb6b-c1c6-48bd-834c-5c7b0b7e145e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:55:40.570157 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-bffdfb6b-c1c6-48bd-834c-5c7b0b7e145e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: 3bb88b55-aac8-4559-8729-6dbeab0b4f45] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:55:40.576337 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bffdfb6b-c1c6-48bd-834c-5c7b0b7e145e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:55:40.576826 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bffdfb6b-c1c6-48bd-834c-5c7b0b7e145e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:55:40.577260 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bffdfb6b-c1c6-48bd-834c-5c7b0b7e145e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:55:40.578141 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bffdfb6b-c1c6-48bd-834c-5c7b0b7e145e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:55:40.579762 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bffdfb6b-c1c6-48bd-834c-5c7b0b7e145e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:55:40.580198 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bffdfb6b-c1c6-48bd-834c-5c7b0b7e145e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:55:40.915243 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-bffdfb6b-c1c6-48bd-834c-5c7b0b7e145e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:55:40.922880 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-bffdfb6b-c1c6-48bd-834c-5c7b0b7e145e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/3bb88b55-aac8-4559-8729-6dbeab0b4f45" status: 200 len: 1679 microversion: 2.1 time: 0.357738 Aug 10 23:55:40.923466 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3213/6633] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:55:40 2022] GET /compute/v2.1/servers/3bb88b55-aac8-4559-8729-6dbeab0b4f45 => generated 1679 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:55:41.946404 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-951bebd3-2f57-4745-9a39-40cf0bd20684 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:55:41.947177 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-951bebd3-2f57-4745-9a39-40cf0bd20684 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: 3bb88b55-aac8-4559-8729-6dbeab0b4f45] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:55:41.954372 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-951bebd3-2f57-4745-9a39-40cf0bd20684 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:55:41.954866 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-951bebd3-2f57-4745-9a39-40cf0bd20684 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:55:41.955232 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-951bebd3-2f57-4745-9a39-40cf0bd20684 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:55:41.956013 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-951bebd3-2f57-4745-9a39-40cf0bd20684 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:55:41.956545 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-951bebd3-2f57-4745-9a39-40cf0bd20684 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:55:41.956947 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-951bebd3-2f57-4745-9a39-40cf0bd20684 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:55:42.097441 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-951bebd3-2f57-4745-9a39-40cf0bd20684 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:55:42.105341 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-951bebd3-2f57-4745-9a39-40cf0bd20684 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/3bb88b55-aac8-4559-8729-6dbeab0b4f45" status: 200 len: 1679 microversion: 2.1 time: 0.164073 Aug 10 23:55:42.105908 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3421/6634] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:55:41 2022] GET /compute/v2.1/servers/3bb88b55-aac8-4559-8729-6dbeab0b4f45 => generated 1679 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:55:43.129736 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-5f529154-86da-4e25-b609-d5e94cf2a261 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:55:43.130597 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-5f529154-86da-4e25-b609-d5e94cf2a261 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: 3bb88b55-aac8-4559-8729-6dbeab0b4f45] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:55:43.137228 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5f529154-86da-4e25-b609-d5e94cf2a261 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:55:43.137815 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5f529154-86da-4e25-b609-d5e94cf2a261 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:55:43.138257 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5f529154-86da-4e25-b609-d5e94cf2a261 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:55:43.139038 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5f529154-86da-4e25-b609-d5e94cf2a261 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:55:43.139527 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5f529154-86da-4e25-b609-d5e94cf2a261 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:55:43.139954 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5f529154-86da-4e25-b609-d5e94cf2a261 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:55:43.270589 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-5f529154-86da-4e25-b609-d5e94cf2a261 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:55:43.278077 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-5f529154-86da-4e25-b609-d5e94cf2a261 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/3bb88b55-aac8-4559-8729-6dbeab0b4f45" status: 200 len: 1658 microversion: 2.1 time: 0.154950 Aug 10 23:55:43.278647 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3214/6635] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:55:43 2022] GET /compute/v2.1/servers/3bb88b55-aac8-4559-8729-6dbeab0b4f45 => generated 1658 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:55:43.300468 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-d2b5a326-c00d-45f2-ad98-0f609f0f02a2 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:55:43.301046 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-d2b5a326-c00d-45f2-ad98-0f609f0f02a2 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: 3bb88b55-aac8-4559-8729-6dbeab0b4f45] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:55:43.307999 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d2b5a326-c00d-45f2-ad98-0f609f0f02a2 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:55:43.308503 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d2b5a326-c00d-45f2-ad98-0f609f0f02a2 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:55:43.308963 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d2b5a326-c00d-45f2-ad98-0f609f0f02a2 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:55:43.309681 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d2b5a326-c00d-45f2-ad98-0f609f0f02a2 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:55:43.310153 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d2b5a326-c00d-45f2-ad98-0f609f0f02a2 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:55:43.310625 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d2b5a326-c00d-45f2-ad98-0f609f0f02a2 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:55:43.325906 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:55:43.443519 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-d2b5a326-c00d-45f2-ad98-0f609f0f02a2 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:55:43.451425 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-d2b5a326-c00d-45f2-ad98-0f609f0f02a2 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/3bb88b55-aac8-4559-8729-6dbeab0b4f45" status: 200 len: 1658 microversion: 2.1 time: 0.155669 Aug 10 23:55:43.451994 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3422/6636] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:55:43 2022] GET /compute/v2.1/servers/3bb88b55-aac8-4559-8729-6dbeab0b4f45 => generated 1658 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:55:43.472025 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-dfc2b0dc-bf0f-4263-bb8a-4cd51c5d3667 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:55:43.477934 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dfc2b0dc-bf0f-4263-bb8a-4cd51c5d3667 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:55:43.478414 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dfc2b0dc-bf0f-4263-bb8a-4cd51c5d3667 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:55:43.478886 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dfc2b0dc-bf0f-4263-bb8a-4cd51c5d3667 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:55:43.504340 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-dfc2b0dc-bf0f-4263-bb8a-4cd51c5d3667 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: 3bb88b55-aac8-4559-8729-6dbeab0b4f45] Going to try to start instance {{(pid=122632) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 10 23:55:43.508644 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:55:43.545180 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-dfc2b0dc-bf0f-4263-bb8a-4cd51c5d3667 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "POST /compute/v2.1/servers/3bb88b55-aac8-4559-8729-6dbeab0b4f45/action" status: 202 len: 0 microversion: 2.1 time: 0.076973 Aug 10 23:55:43.545786 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3215/6637] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:55:43 2022] POST /compute/v2.1/servers/3bb88b55-aac8-4559-8729-6dbeab0b4f45/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:55:43.555339 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-6031d80a-3fd7-41a0-b116-71319aa15ea2 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:55:43.556220 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-6031d80a-3fd7-41a0-b116-71319aa15ea2 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: 3bb88b55-aac8-4559-8729-6dbeab0b4f45] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:55:43.563961 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6031d80a-3fd7-41a0-b116-71319aa15ea2 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:55:43.564577 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6031d80a-3fd7-41a0-b116-71319aa15ea2 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:55:43.565056 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6031d80a-3fd7-41a0-b116-71319aa15ea2 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:55:43.565788 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6031d80a-3fd7-41a0-b116-71319aa15ea2 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:55:43.566434 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6031d80a-3fd7-41a0-b116-71319aa15ea2 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:55:43.566920 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6031d80a-3fd7-41a0-b116-71319aa15ea2 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:55:43.704051 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-6031d80a-3fd7-41a0-b116-71319aa15ea2 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:55:43.711880 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-6031d80a-3fd7-41a0-b116-71319aa15ea2 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/3bb88b55-aac8-4559-8729-6dbeab0b4f45" status: 200 len: 1667 microversion: 2.1 time: 0.160558 Aug 10 23:55:43.712467 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3423/6638] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:55:43 2022] GET /compute/v2.1/servers/3bb88b55-aac8-4559-8729-6dbeab0b4f45 => generated 1667 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:55:44.735096 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-b07b8a1e-1616-4e3a-ab35-dc14578648bc tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:55:44.735810 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-b07b8a1e-1616-4e3a-ab35-dc14578648bc tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: 3bb88b55-aac8-4559-8729-6dbeab0b4f45] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:55:44.741925 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b07b8a1e-1616-4e3a-ab35-dc14578648bc tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:55:44.742410 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b07b8a1e-1616-4e3a-ab35-dc14578648bc tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:55:44.742878 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b07b8a1e-1616-4e3a-ab35-dc14578648bc tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:55:44.743578 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b07b8a1e-1616-4e3a-ab35-dc14578648bc tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:55:44.744038 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b07b8a1e-1616-4e3a-ab35-dc14578648bc tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:55:44.744484 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b07b8a1e-1616-4e3a-ab35-dc14578648bc tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:55:44.808861 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-a120f792-dd8b-45ac-98aa-8ca3a7fb79d3 req-e2b211ec-0351-490e-a531-4f2963004e0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bb88b55-aac8-4559-8729-6dbeab0b4f45", "name": "network-vif-plugged", "status": "completed", "tag": "f7b62669-172e-466c-9435-fd1c6e642e7c"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:55:44.820824 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-a120f792-dd8b-45ac-98aa-8ca3a7fb79d3 req-e2b211ec-0351-490e-a531-4f2963004e0f service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:55:44.821409 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-a120f792-dd8b-45ac-98aa-8ca3a7fb79d3 req-e2b211ec-0351-490e-a531-4f2963004e0f service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:55:44.822008 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-a120f792-dd8b-45ac-98aa-8ca3a7fb79d3 req-e2b211ec-0351-490e-a531-4f2963004e0f service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:55:44.836655 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-a120f792-dd8b-45ac-98aa-8ca3a7fb79d3 req-e2b211ec-0351-490e-a531-4f2963004e0f service nova] Creating event network-vif-plugged:f7b62669-172e-466c-9435-fd1c6e642e7c for instance 3bb88b55-aac8-4559-8729-6dbeab0b4f45 on n-h1-850468-14 Aug 10 23:55:44.842088 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-a120f792-dd8b-45ac-98aa-8ca3a7fb79d3 req-e2b211ec-0351-490e-a531-4f2963004e0f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037224 Aug 10 23:55:44.842707 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3424/6639] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:55:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 23:55:44.890599 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-b07b8a1e-1616-4e3a-ab35-dc14578648bc tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:55:44.899266 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-b07b8a1e-1616-4e3a-ab35-dc14578648bc tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/3bb88b55-aac8-4559-8729-6dbeab0b4f45" status: 200 len: 1671 microversion: 2.1 time: 0.169497 Aug 10 23:55:44.899835 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3216/6640] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:55:44 2022] GET /compute/v2.1/servers/3bb88b55-aac8-4559-8729-6dbeab0b4f45 => generated 1671 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:55:44.921800 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-ff8aca52-1b92-4bd1-81b1-0cc9a6ebf7ac tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:55:44.922610 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-ff8aca52-1b92-4bd1-81b1-0cc9a6ebf7ac tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: 3bb88b55-aac8-4559-8729-6dbeab0b4f45] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:55:44.928828 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ff8aca52-1b92-4bd1-81b1-0cc9a6ebf7ac tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:55:44.929327 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ff8aca52-1b92-4bd1-81b1-0cc9a6ebf7ac tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:55:44.929780 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ff8aca52-1b92-4bd1-81b1-0cc9a6ebf7ac tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:55:44.930487 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ff8aca52-1b92-4bd1-81b1-0cc9a6ebf7ac tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:55:44.930986 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ff8aca52-1b92-4bd1-81b1-0cc9a6ebf7ac tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:55:44.931431 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ff8aca52-1b92-4bd1-81b1-0cc9a6ebf7ac tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:55:44.957292 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-ff8aca52-1b92-4bd1-81b1-0cc9a6ebf7ac tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: 3bb88b55-aac8-4559-8729-6dbeab0b4f45] Going to try to terminate instance {{(pid=122633) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:55:45.034248 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-ff8aca52-1b92-4bd1-81b1-0cc9a6ebf7ac tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "DELETE /compute/v2.1/servers/3bb88b55-aac8-4559-8729-6dbeab0b4f45" status: 204 len: 0 microversion: 2.1 time: 0.116499 Aug 10 23:55:45.034775 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3425/6641] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:55:44 2022] DELETE /compute/v2.1/servers/3bb88b55-aac8-4559-8729-6dbeab0b4f45 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:55:45.043222 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-5d5f5cf9-7158-4698-b595-6620af5f811a tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:55:45.043870 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-5d5f5cf9-7158-4698-b595-6620af5f811a tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: 3bb88b55-aac8-4559-8729-6dbeab0b4f45] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:55:45.052255 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5d5f5cf9-7158-4698-b595-6620af5f811a tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:55:45.052255 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5d5f5cf9-7158-4698-b595-6620af5f811a tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:55:45.052621 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5d5f5cf9-7158-4698-b595-6620af5f811a tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:55:45.053064 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5d5f5cf9-7158-4698-b595-6620af5f811a tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:55:45.053531 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5d5f5cf9-7158-4698-b595-6620af5f811a tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:55:45.053952 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5d5f5cf9-7158-4698-b595-6620af5f811a tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:55:45.184370 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-5d5f5cf9-7158-4698-b595-6620af5f811a tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:55:45.196485 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-5d5f5cf9-7158-4698-b595-6620af5f811a tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/3bb88b55-aac8-4559-8729-6dbeab0b4f45" status: 200 len: 1677 microversion: 2.1 time: 0.157206 Aug 10 23:55:45.197102 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3217/6642] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:55:45 2022] GET /compute/v2.1/servers/3bb88b55-aac8-4559-8729-6dbeab0b4f45 => generated 1677 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:55:46.218493 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-1e51644d-3838-4ae6-b5a1-7871ae08d34e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:55:46.219444 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-1e51644d-3838-4ae6-b5a1-7871ae08d34e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: 3bb88b55-aac8-4559-8729-6dbeab0b4f45] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:55:46.226759 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1e51644d-3838-4ae6-b5a1-7871ae08d34e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:55:46.227293 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1e51644d-3838-4ae6-b5a1-7871ae08d34e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:55:46.227748 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1e51644d-3838-4ae6-b5a1-7871ae08d34e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:55:46.228466 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1e51644d-3838-4ae6-b5a1-7871ae08d34e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:55:46.228936 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1e51644d-3838-4ae6-b5a1-7871ae08d34e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:55:46.229377 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1e51644d-3838-4ae6-b5a1-7871ae08d34e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:55:46.362723 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-1e51644d-3838-4ae6-b5a1-7871ae08d34e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:55:46.371471 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-1e51644d-3838-4ae6-b5a1-7871ae08d34e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/3bb88b55-aac8-4559-8729-6dbeab0b4f45" status: 200 len: 1677 microversion: 2.1 time: 0.157263 Aug 10 23:55:46.372068 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3426/6643] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:55:46 2022] GET /compute/v2.1/servers/3bb88b55-aac8-4559-8729-6dbeab0b4f45 => generated 1677 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:55:47.394367 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-06dc485d-e167-4cc2-9246-0dd441a16998 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:55:47.395034 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-06dc485d-e167-4cc2-9246-0dd441a16998 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: 3bb88b55-aac8-4559-8729-6dbeab0b4f45] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:55:47.398180 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_api:SELECT=37 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:55:47.403542 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-06dc485d-e167-4cc2-9246-0dd441a16998 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:55:47.404034 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-06dc485d-e167-4cc2-9246-0dd441a16998 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:55:47.404479 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-06dc485d-e167-4cc2-9246-0dd441a16998 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:55:47.405389 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-06dc485d-e167-4cc2-9246-0dd441a16998 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:55:47.405868 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-06dc485d-e167-4cc2-9246-0dd441a16998 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:55:47.406857 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-06dc485d-e167-4cc2-9246-0dd441a16998 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:55:47.486344 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-06dc485d-e167-4cc2-9246-0dd441a16998 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:55:47.488218 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-35786c72-fa8f-46fb-a2d0-25f44ea14cbd req-f68a39fb-d06d-4c97-9fdb-c5378f0b91db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bb88b55-aac8-4559-8729-6dbeab0b4f45", "name": "network-vif-deleted", "tag": "f7b62669-172e-466c-9435-fd1c6e642e7c"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:55:47.497144 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-06dc485d-e167-4cc2-9246-0dd441a16998 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/3bb88b55-aac8-4559-8729-6dbeab0b4f45" status: 200 len: 1609 microversion: 2.1 time: 0.107293 Aug 10 23:55:47.497958 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3218/6644] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:55:47 2022] GET /compute/v2.1/servers/3bb88b55-aac8-4559-8729-6dbeab0b4f45 => generated 1609 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:55:47.499122 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:55:47.506184 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-35786c72-fa8f-46fb-a2d0-25f44ea14cbd req-f68a39fb-d06d-4c97-9fdb-c5378f0b91db service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:55:47.507265 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-35786c72-fa8f-46fb-a2d0-25f44ea14cbd req-f68a39fb-d06d-4c97-9fdb-c5378f0b91db service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:55:47.507814 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-35786c72-fa8f-46fb-a2d0-25f44ea14cbd req-f68a39fb-d06d-4c97-9fdb-c5378f0b91db service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:55:47.539496 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-35786c72-fa8f-46fb-a2d0-25f44ea14cbd req-f68a39fb-d06d-4c97-9fdb-c5378f0b91db service nova] Creating event network-vif-deleted:f7b62669-172e-466c-9435-fd1c6e642e7c for instance 3bb88b55-aac8-4559-8729-6dbeab0b4f45 on n-h1-850468-14 Aug 10 23:55:47.545446 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-35786c72-fa8f-46fb-a2d0-25f44ea14cbd req-f68a39fb-d06d-4c97-9fdb-c5378f0b91db service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063516 Aug 10 23:55:47.546385 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3427/6645] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:55:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 23:55:48.519777 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c5691702-3d7e-4812-bdcb-bc3ae792654e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:55:48.520386 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-c5691702-3d7e-4812-bdcb-bc3ae792654e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: 3bb88b55-aac8-4559-8729-6dbeab0b4f45] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:55:48.528372 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c5691702-3d7e-4812-bdcb-bc3ae792654e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:55:48.528860 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c5691702-3d7e-4812-bdcb-bc3ae792654e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:55:48.529295 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c5691702-3d7e-4812-bdcb-bc3ae792654e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:55:48.529997 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c5691702-3d7e-4812-bdcb-bc3ae792654e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:55:48.530446 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c5691702-3d7e-4812-bdcb-bc3ae792654e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:55:48.530888 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c5691702-3d7e-4812-bdcb-bc3ae792654e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:55:48.546275 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-c5691702-3d7e-4812-bdcb-bc3ae792654e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] HTTP exception thrown: Instance 3bb88b55-aac8-4559-8729-6dbeab0b4f45 could not be found. Aug 10 23:55:48.548981 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c5691702-3d7e-4812-bdcb-bc3ae792654e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Request method failure captured: Aug 10 23:55:48.548981 n-d-850468-14 devstack@n-api.service[122632]: request: GET /compute/v2.1/servers/3bb88b55-aac8-4559-8729-6dbeab0b4f45 HTTP/1.1 Aug 10 23:55:48.548981 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:55:48.548981 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:55:48.548981 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:55:48.548981 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 23:55:48.548981 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:55:48.548981 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:55:48.548981 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:55:48.548981 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:55:48.548981 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9ETka_MLrOzNLl9fMo23yiaBVbwRsDIGTKuSE2U_QdPMsSc8GHIwU4exY0o7VQcTlL32LUR0TzTXBFYguNbPnJvl-Oq37igm94dUqjDcjI8p0o_T8FFxkqM-af8dhqzR4fbIp2j_qc7pazKLEDLMGgsyywPyJGsRgPDIuxnwDfxMZ8k Aug 10 23:55:48.548981 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:55:48.548981 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:55:48.548981 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:55:48.548981 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:55:48.548981 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:55:48.548981 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:55:48.548981 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 49e20a407dbc425ea488dee2995ebbe3 Aug 10 23:55:48.548981 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-ServerActionsTestJSON-1613214326 Aug 10 23:55:48.548981 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:55:48.548981 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:55:48.548981 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/49e20a407dbc425ea488dee2995ebbe3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/49e20a407dbc425ea488dee2995ebbe3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/49e20a407dbc425ea488dee2995ebbe3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_49e20a407dbc425ea488dee2995ebbe3", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:55:48.548981 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-ServerActionsTestJSON-1613214326 Aug 10 23:55:48.548981 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 49e20a407dbc425ea488dee2995ebbe3 Aug 10 23:55:48.548981 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-ServerActionsTestJSON-1613214326 Aug 10 23:55:48.548981 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-ServerActionsTestJSON-1613214326-project Aug 10 23:55:48.548981 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:55:48.548981 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:55:48.548981 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: 1412a4116dbb4412ba8ea10f72e2d95e Aug 10 23:55:48.548981 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-ServerActionsTestJSON-1613214326-project Aug 10 23:55:48.548981 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:55:48.548981 n-d-850468-14 devstack@n-api.service[122632]: exception: Instance 3bb88b55-aac8-4559-8729-6dbeab0b4f45 could not be found. Aug 10 23:55:48.548981 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': '3bb88b55-aac8-4559-8729-6dbeab0b4f45'} Aug 10 23:55:48.548981 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:55:48.548981 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:55:48.548981 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:55:48.548981 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:55:48.548981 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:55:48.548981 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:55:48.548981 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:55:48.548981 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:55:48.548981 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:55:48.548981 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:55:48.548981 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3bb88b55-aac8-4559-8729-6dbeab0b4f45 could not be found. Aug 10 23:55:48.548981 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:55:48.548981 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:55:48.548981 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:55:48.548981 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:55:48.548981 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:55:48.548981 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:55:48.548981 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:55:48.548981 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:55:48.548981 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:55:48.548981 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:55:48.548981 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:55:48.548981 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:55:48.548981 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:55:48.548981 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:55:48.548981 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:55:48.548981 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:55:48.548981 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3bb88b55-aac8-4559-8729-6dbeab0b4f45 could not be found. Aug 10 23:55:48.548981 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:55:48.548981 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:55:48.548981 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:55:48.553192 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:55:48.553192 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:55:48.553192 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:55:48.553192 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:55:48.553192 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:55:48.553192 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3bb88b55-aac8-4559-8729-6dbeab0b4f45 could not be found. Aug 10 23:55:48.553192 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:55:48.553192 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c5691702-3d7e-4812-bdcb-bc3ae792654e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Returning 404 to user: Instance 3bb88b55-aac8-4559-8729-6dbeab0b4f45 could not be found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:55:48.553192 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-c5691702-3d7e-4812-bdcb-bc3ae792654e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/3bb88b55-aac8-4559-8729-6dbeab0b4f45" status: 404 len: 111 microversion: 2.1 time: 0.035054 Aug 10 23:55:48.553192 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3219/6646] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:55:48 2022] GET /compute/v2.1/servers/3bb88b55-aac8-4559-8729-6dbeab0b4f45 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:55:48.565778 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-33775ac1-dbbe-4fcc-b97c-9241f9a9e22a tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:55:48.566491 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-33775ac1-dbbe-4fcc-b97c-9241f9a9e22a tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: 3bb88b55-aac8-4559-8729-6dbeab0b4f45] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:55:48.573753 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-33775ac1-dbbe-4fcc-b97c-9241f9a9e22a tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:55:48.574258 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-33775ac1-dbbe-4fcc-b97c-9241f9a9e22a tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:55:48.574712 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-33775ac1-dbbe-4fcc-b97c-9241f9a9e22a tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:55:48.575464 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-33775ac1-dbbe-4fcc-b97c-9241f9a9e22a tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:55:48.576106 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-33775ac1-dbbe-4fcc-b97c-9241f9a9e22a tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:55:48.576548 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-33775ac1-dbbe-4fcc-b97c-9241f9a9e22a tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:55:48.590751 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-33775ac1-dbbe-4fcc-b97c-9241f9a9e22a tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] HTTP exception thrown: Instance 3bb88b55-aac8-4559-8729-6dbeab0b4f45 could not be found. Aug 10 23:55:48.592497 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-33775ac1-dbbe-4fcc-b97c-9241f9a9e22a tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Request method failure captured: Aug 10 23:55:48.592497 n-d-850468-14 devstack@n-api.service[122633]: request: GET /compute/v2.1/servers/3bb88b55-aac8-4559-8729-6dbeab0b4f45 HTTP/1.1 Aug 10 23:55:48.592497 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:55:48.592497 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:55:48.592497 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:55:48.592497 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:55:48.592497 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:55:48.592497 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:55:48.592497 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:55:48.592497 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:55:48.592497 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9ETka_MLrOzNLl9fMo23yiaBVbwRsDIGTKuSE2U_QdPMsSc8GHIwU4exY0o7VQcTlL32LUR0TzTXBFYguNbPnJvl-Oq37igm94dUqjDcjI8p0o_T8FFxkqM-af8dhqzR4fbIp2j_qc7pazKLEDLMGgsyywPyJGsRgPDIuxnwDfxMZ8k Aug 10 23:55:48.592497 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:55:48.592497 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:55:48.592497 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:55:48.592497 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:55:48.592497 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:55:48.592497 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:55:48.592497 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 49e20a407dbc425ea488dee2995ebbe3 Aug 10 23:55:48.592497 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-ServerActionsTestJSON-1613214326 Aug 10 23:55:48.592497 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:55:48.592497 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:55:48.592497 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/49e20a407dbc425ea488dee2995ebbe3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/49e20a407dbc425ea488dee2995ebbe3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/49e20a407dbc425ea488dee2995ebbe3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_49e20a407dbc425ea488dee2995ebbe3", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:55:48.592497 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-ServerActionsTestJSON-1613214326 Aug 10 23:55:48.592497 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 49e20a407dbc425ea488dee2995ebbe3 Aug 10 23:55:48.592497 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-ServerActionsTestJSON-1613214326 Aug 10 23:55:48.592497 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-ServerActionsTestJSON-1613214326-project Aug 10 23:55:48.592497 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:55:48.592497 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:55:48.592497 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 1412a4116dbb4412ba8ea10f72e2d95e Aug 10 23:55:48.592497 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-ServerActionsTestJSON-1613214326-project Aug 10 23:55:48.592497 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:55:48.592497 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance 3bb88b55-aac8-4559-8729-6dbeab0b4f45 could not be found. Aug 10 23:55:48.592497 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': '3bb88b55-aac8-4559-8729-6dbeab0b4f45'} Aug 10 23:55:48.592497 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:55:48.592497 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:55:48.592497 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:55:48.592497 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:55:48.592497 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:55:48.592497 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:55:48.592497 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:55:48.592497 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:55:48.592497 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:55:48.592497 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:55:48.592497 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3bb88b55-aac8-4559-8729-6dbeab0b4f45 could not be found. Aug 10 23:55:48.592497 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:55:48.592497 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:55:48.592497 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:55:48.592497 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:55:48.592497 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:55:48.592497 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:55:48.592497 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:55:48.592497 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:55:48.592497 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:55:48.592497 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:55:48.592497 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:55:48.592497 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:55:48.592497 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:55:48.592497 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:55:48.592497 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:55:48.592497 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:55:48.592497 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3bb88b55-aac8-4559-8729-6dbeab0b4f45 could not be found. Aug 10 23:55:48.592497 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:55:48.592497 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:55:48.592497 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:55:48.598917 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:55:48.598917 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:55:48.598917 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:55:48.598917 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:55:48.598917 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:55:48.598917 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3bb88b55-aac8-4559-8729-6dbeab0b4f45 could not be found. Aug 10 23:55:48.598917 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:55:48.598917 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-33775ac1-dbbe-4fcc-b97c-9241f9a9e22a tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Returning 404 to user: Instance 3bb88b55-aac8-4559-8729-6dbeab0b4f45 could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:55:48.598917 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-33775ac1-dbbe-4fcc-b97c-9241f9a9e22a tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/3bb88b55-aac8-4559-8729-6dbeab0b4f45" status: 404 len: 111 microversion: 2.1 time: 0.033103 Aug 10 23:55:48.598917 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3428/6647] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:55:48 2022] GET /compute/v2.1/servers/3bb88b55-aac8-4559-8729-6dbeab0b4f45 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:55:48.647859 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-5d1b0600-bc0d-4a0b-9d16-59f3ceef76f5 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-102177534", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452", "networks": [{"uuid": "bbbbeb6b-4410-487d-bc67-956aff866a4e"}], "security_groups": [{"name": "tempest-securitygroup--1954233211"}], "key_name": "tempest-keypair-1767049833", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:55:48.753768 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.network.neutron [None req-5d1b0600-bc0d-4a0b-9d16-59f3ceef76f5 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] validate_networks() for [('bbbbeb6b-4410-487d-bc67-956aff866a4e', None, None, None, None, None)] {{(pid=122632) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 23:55:49.232179 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-5d1b0600-bc0d-4a0b-9d16-59f3ceef76f5 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Flavor limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:55:49.232601 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-5d1b0600-bc0d-4a0b-9d16-59f3ceef76f5 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Image limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:55:49.233077 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-5d1b0600-bc0d-4a0b-9d16-59f3ceef76f5 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Flavor pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:55:49.233491 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-5d1b0600-bc0d-4a0b-9d16-59f3ceef76f5 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Image pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:55:49.233934 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-5d1b0600-bc0d-4a0b-9d16-59f3ceef76f5 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:55:49.247048 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5d1b0600-bc0d-4a0b-9d16-59f3ceef76f5 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:55:49.247530 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5d1b0600-bc0d-4a0b-9d16-59f3ceef76f5 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:55:49.247968 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5d1b0600-bc0d-4a0b-9d16-59f3ceef76f5 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:55:49.248696 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5d1b0600-bc0d-4a0b-9d16-59f3ceef76f5 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:55:49.249150 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5d1b0600-bc0d-4a0b-9d16-59f3ceef76f5 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:55:49.250343 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5d1b0600-bc0d-4a0b-9d16-59f3ceef76f5 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:55:49.270047 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-5d1b0600-bc0d-4a0b-9d16-59f3ceef76f5 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Getting quotas for project 49e20a407dbc425ea488dee2995ebbe3. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:55:49.275299 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-5d1b0600-bc0d-4a0b-9d16-59f3ceef76f5 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Getting quotas for user 1412a4116dbb4412ba8ea10f72e2d95e and project 49e20a407dbc425ea488dee2995ebbe3. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:55:49.290454 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-5d1b0600-bc0d-4a0b-9d16-59f3ceef76f5 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Going to run 1 instances... {{(pid=122632) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 23:55:49.294092 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-5d1b0600-bc0d-4a0b-9d16-59f3ceef76f5 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78ad8905-f66f-4733-8be9-2b260f1fabed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122632) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 23:55:49.354278 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-5d1b0600-bc0d-4a0b-9d16-59f3ceef76f5 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.710725 Aug 10 23:55:49.354952 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3220/6648] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 23:55:48 2022] POST /compute/v2.1/servers => generated 406 bytes in 712 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 23:55:49.367031 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c51dc036-7f9e-4e7e-8840-3ddd71fcf45e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:55:49.367696 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-c51dc036-7f9e-4e7e-8840-3ddd71fcf45e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:55:49.421743 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-c51dc036-7f9e-4e7e-8840-3ddd71fcf45e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:55:49.431859 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-c51dc036-7f9e-4e7e-8840-3ddd71fcf45e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0" status: 200 len: 1238 microversion: 2.1 time: 0.068778 Aug 10 23:55:49.432443 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3429/6649] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:55:49 2022] GET /compute/v2.1/servers/e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0 => generated 1238 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:55:50.455318 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-3db5e71a-53db-4429-b14c-03071dbd5343 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:55:50.455941 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-3db5e71a-53db-4429-b14c-03071dbd5343 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:55:50.463463 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3db5e71a-53db-4429-b14c-03071dbd5343 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:55:50.464034 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3db5e71a-53db-4429-b14c-03071dbd5343 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:55:50.464527 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3db5e71a-53db-4429-b14c-03071dbd5343 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:55:50.465242 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3db5e71a-53db-4429-b14c-03071dbd5343 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:55:50.465733 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3db5e71a-53db-4429-b14c-03071dbd5343 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:55:50.466159 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3db5e71a-53db-4429-b14c-03071dbd5343 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:55:50.543534 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-3db5e71a-53db-4429-b14c-03071dbd5343 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:55:50.551300 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-3db5e71a-53db-4429-b14c-03071dbd5343 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0" status: 200 len: 1308 microversion: 2.1 time: 0.101373 Aug 10 23:55:50.551882 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3221/6650] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:55:50 2022] GET /compute/v2.1/servers/e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0 => generated 1308 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:55:51.573990 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-1e8b45ec-bc7f-418c-87c9-3804d421d679 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:55:51.574901 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-1e8b45ec-bc7f-418c-87c9-3804d421d679 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:55:51.584866 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1e8b45ec-bc7f-418c-87c9-3804d421d679 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:55:51.585446 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1e8b45ec-bc7f-418c-87c9-3804d421d679 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:55:51.585979 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1e8b45ec-bc7f-418c-87c9-3804d421d679 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:55:51.586766 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1e8b45ec-bc7f-418c-87c9-3804d421d679 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:55:51.587330 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1e8b45ec-bc7f-418c-87c9-3804d421d679 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:55:51.587839 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1e8b45ec-bc7f-418c-87c9-3804d421d679 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:55:51.728036 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-1e8b45ec-bc7f-418c-87c9-3804d421d679 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:55:51.736603 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-1e8b45ec-bc7f-418c-87c9-3804d421d679 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0" status: 200 len: 1364 microversion: 2.1 time: 0.166703 Aug 10 23:55:51.739116 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3430/6651] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:55:51 2022] GET /compute/v2.1/servers/e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0 => generated 1364 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:55:51.752664 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-e5984df8-4545-4b51-a693-1f341052650f req-1e75f17a-0d91-459a-8c6a-2471aee4c2ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0", "tag": "f0b44c54-7ca7-49db-b2bf-9634e7e3c34b"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:55:51.768376 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-e5984df8-4545-4b51-a693-1f341052650f req-1e75f17a-0d91-459a-8c6a-2471aee4c2ac service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:55:51.768869 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-e5984df8-4545-4b51-a693-1f341052650f req-1e75f17a-0d91-459a-8c6a-2471aee4c2ac service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:55:51.769458 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-e5984df8-4545-4b51-a693-1f341052650f req-1e75f17a-0d91-459a-8c6a-2471aee4c2ac service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:55:51.783736 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-e5984df8-4545-4b51-a693-1f341052650f req-1e75f17a-0d91-459a-8c6a-2471aee4c2ac service nova] Creating event network-changed:f0b44c54-7ca7-49db-b2bf-9634e7e3c34b for instance e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0 on n-h2-850468-14 Aug 10 23:55:51.791332 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-e5984df8-4545-4b51-a693-1f341052650f req-1e75f17a-0d91-459a-8c6a-2471aee4c2ac service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043693 Aug 10 23:55:51.791958 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3222/6652] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:55:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 23:55:52.759198 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-6af359f5-28d2-4072-8209-df3eafd7d8bf tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:55:52.759816 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-6af359f5-28d2-4072-8209-df3eafd7d8bf tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:55:52.767392 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6af359f5-28d2-4072-8209-df3eafd7d8bf tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:55:52.767936 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6af359f5-28d2-4072-8209-df3eafd7d8bf tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:55:52.768330 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6af359f5-28d2-4072-8209-df3eafd7d8bf tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:55:52.769039 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6af359f5-28d2-4072-8209-df3eafd7d8bf tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:55:52.769765 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6af359f5-28d2-4072-8209-df3eafd7d8bf tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:55:52.769939 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6af359f5-28d2-4072-8209-df3eafd7d8bf tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:55:52.900839 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-6af359f5-28d2-4072-8209-df3eafd7d8bf tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:55:52.908905 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-6af359f5-28d2-4072-8209-df3eafd7d8bf tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0" status: 200 len: 1364 microversion: 2.1 time: 0.153590 Aug 10 23:55:52.909485 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3431/6653] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:55:52 2022] GET /compute/v2.1/servers/e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0 => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:55:53.932388 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-1bcd4cf5-5361-47cf-89cb-7c634db35a3b tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:55:53.933086 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-1bcd4cf5-5361-47cf-89cb-7c634db35a3b tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:55:53.939689 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1bcd4cf5-5361-47cf-89cb-7c634db35a3b tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:55:53.940176 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1bcd4cf5-5361-47cf-89cb-7c634db35a3b tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:55:53.940611 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1bcd4cf5-5361-47cf-89cb-7c634db35a3b tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:55:53.941302 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1bcd4cf5-5361-47cf-89cb-7c634db35a3b tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:55:53.941749 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1bcd4cf5-5361-47cf-89cb-7c634db35a3b tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:55:53.942169 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1bcd4cf5-5361-47cf-89cb-7c634db35a3b tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:55:54.081567 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-1bcd4cf5-5361-47cf-89cb-7c634db35a3b tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:55:54.089159 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-1bcd4cf5-5361-47cf-89cb-7c634db35a3b tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0" status: 200 len: 1364 microversion: 2.1 time: 0.161954 Aug 10 23:55:54.089737 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3223/6654] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:55:53 2022] GET /compute/v2.1/servers/e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0 => generated 1364 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:55:55.112147 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-2657e622-245c-46ef-8681-d3c7ffd69444 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:55:55.112779 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-2657e622-245c-46ef-8681-d3c7ffd69444 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:55:55.119785 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2657e622-245c-46ef-8681-d3c7ffd69444 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:55:55.120295 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2657e622-245c-46ef-8681-d3c7ffd69444 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:55:55.120755 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2657e622-245c-46ef-8681-d3c7ffd69444 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:55:55.121471 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2657e622-245c-46ef-8681-d3c7ffd69444 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:55:55.121945 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2657e622-245c-46ef-8681-d3c7ffd69444 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:55:55.122393 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2657e622-245c-46ef-8681-d3c7ffd69444 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:55:55.252416 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-2657e622-245c-46ef-8681-d3c7ffd69444 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:55:55.260008 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-2657e622-245c-46ef-8681-d3c7ffd69444 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0" status: 200 len: 1364 microversion: 2.1 time: 0.152430 Aug 10 23:55:55.260591 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3432/6655] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:55:55 2022] GET /compute/v2.1/servers/e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0 => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:55:56.281788 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-a03b1391-9985-428b-831b-386c5b4b2c10 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:55:56.282363 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-a03b1391-9985-428b-831b-386c5b4b2c10 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:55:56.291040 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a03b1391-9985-428b-831b-386c5b4b2c10 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:55:56.291534 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a03b1391-9985-428b-831b-386c5b4b2c10 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:55:56.291975 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a03b1391-9985-428b-831b-386c5b4b2c10 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:55:56.292685 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a03b1391-9985-428b-831b-386c5b4b2c10 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:55:56.293142 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a03b1391-9985-428b-831b-386c5b4b2c10 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:55:56.293571 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a03b1391-9985-428b-831b-386c5b4b2c10 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:55:56.433557 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-a03b1391-9985-428b-831b-386c5b4b2c10 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:55:56.442308 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-a03b1391-9985-428b-831b-386c5b4b2c10 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0" status: 200 len: 1364 microversion: 2.1 time: 0.164562 Aug 10 23:55:56.442924 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3224/6656] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:55:56 2022] GET /compute/v2.1/servers/e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0 => generated 1364 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:55:57.464404 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-b3b8ea3b-d0df-46e0-8311-dffa2d888974 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:55:57.465033 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-b3b8ea3b-d0df-46e0-8311-dffa2d888974 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:55:57.473159 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b3b8ea3b-d0df-46e0-8311-dffa2d888974 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:55:57.473671 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b3b8ea3b-d0df-46e0-8311-dffa2d888974 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:55:57.474132 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b3b8ea3b-d0df-46e0-8311-dffa2d888974 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:55:57.475038 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b3b8ea3b-d0df-46e0-8311-dffa2d888974 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:55:57.475514 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b3b8ea3b-d0df-46e0-8311-dffa2d888974 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:55:57.476159 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b3b8ea3b-d0df-46e0-8311-dffa2d888974 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:55:57.520033 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-ed881d95-a920-48c7-a4c8-2b402997e8a1 req-e20abe59-8028-44cd-986c-d6f48fb28a0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0", "name": "network-vif-plugged", "status": "completed", "tag": "f0b44c54-7ca7-49db-b2bf-9634e7e3c34b"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:55:57.549986 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-ed881d95-a920-48c7-a4c8-2b402997e8a1 req-e20abe59-8028-44cd-986c-d6f48fb28a0d service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:55:57.551021 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-ed881d95-a920-48c7-a4c8-2b402997e8a1 req-e20abe59-8028-44cd-986c-d6f48fb28a0d service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:55:57.551415 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-ed881d95-a920-48c7-a4c8-2b402997e8a1 req-e20abe59-8028-44cd-986c-d6f48fb28a0d service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:55:57.564331 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-ed881d95-a920-48c7-a4c8-2b402997e8a1 req-e20abe59-8028-44cd-986c-d6f48fb28a0d service nova] Creating event network-vif-plugged:f0b44c54-7ca7-49db-b2bf-9634e7e3c34b for instance e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0 on n-h2-850468-14 Aug 10 23:55:57.570596 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-ed881d95-a920-48c7-a4c8-2b402997e8a1 req-e20abe59-8028-44cd-986c-d6f48fb28a0d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055031 Aug 10 23:55:57.571587 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3225/6657] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:55:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:55:57.634283 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-b3b8ea3b-d0df-46e0-8311-dffa2d888974 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:55:57.642776 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-b3b8ea3b-d0df-46e0-8311-dffa2d888974 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0" status: 200 len: 1364 microversion: 2.1 time: 0.182293 Aug 10 23:55:57.643475 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3433/6658] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:55:57 2022] GET /compute/v2.1/servers/e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0 => generated 1364 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:55:58.666135 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-05a62744-a38b-4511-add6-69c30591f6b2 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:55:58.666892 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-05a62744-a38b-4511-add6-69c30591f6b2 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:55:58.674473 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-05a62744-a38b-4511-add6-69c30591f6b2 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:55:58.674982 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-05a62744-a38b-4511-add6-69c30591f6b2 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:55:58.675426 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-05a62744-a38b-4511-add6-69c30591f6b2 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:55:58.676129 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-05a62744-a38b-4511-add6-69c30591f6b2 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:55:58.676599 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-05a62744-a38b-4511-add6-69c30591f6b2 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:55:58.677012 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-05a62744-a38b-4511-add6-69c30591f6b2 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:55:58.813263 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-05a62744-a38b-4511-add6-69c30591f6b2 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:55:58.821564 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-05a62744-a38b-4511-add6-69c30591f6b2 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0" status: 200 len: 1364 microversion: 2.1 time: 0.159631 Aug 10 23:55:58.822343 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3226/6659] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:55:58 2022] GET /compute/v2.1/servers/e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0 => generated 1364 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:55:59.845161 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-b7f61df7-9381-470a-8c8b-d375da31a314 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:55:59.846043 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-b7f61df7-9381-470a-8c8b-d375da31a314 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:55:59.848945 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=2 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:55:59.854765 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b7f61df7-9381-470a-8c8b-d375da31a314 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:55:59.855307 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b7f61df7-9381-470a-8c8b-d375da31a314 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:55:59.855773 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b7f61df7-9381-470a-8c8b-d375da31a314 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:55:59.856522 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b7f61df7-9381-470a-8c8b-d375da31a314 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:55:59.857002 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b7f61df7-9381-470a-8c8b-d375da31a314 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:55:59.857454 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b7f61df7-9381-470a-8c8b-d375da31a314 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:55:59.996364 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-b7f61df7-9381-470a-8c8b-d375da31a314 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:56:00.004344 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-b7f61df7-9381-470a-8c8b-d375da31a314 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0" status: 200 len: 1551 microversion: 2.1 time: 0.163784 Aug 10 23:56:00.005162 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3434/6660] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:55:59 2022] GET /compute/v2.1/servers/e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0 => generated 1551 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:56:00.026032 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-b131e55d-42bf-4f27-a16c-fe0a27edce68 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:56:00.026604 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-b131e55d-42bf-4f27-a16c-fe0a27edce68 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:56:00.028703 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=2 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:56:00.029534 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=6 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:56:00.036948 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b131e55d-42bf-4f27-a16c-fe0a27edce68 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:56:00.037438 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b131e55d-42bf-4f27-a16c-fe0a27edce68 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:56:00.037878 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b131e55d-42bf-4f27-a16c-fe0a27edce68 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:56:00.038582 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b131e55d-42bf-4f27-a16c-fe0a27edce68 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:56:00.039062 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b131e55d-42bf-4f27-a16c-fe0a27edce68 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:56:00.039495 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b131e55d-42bf-4f27-a16c-fe0a27edce68 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:56:00.117840 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-b131e55d-42bf-4f27-a16c-fe0a27edce68 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095738 Aug 10 23:56:00.118446 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3227/6661] 10.222.0.58 () {58 vars in 1275 bytes} [Wed Aug 10 23:56:00 2022] GET /compute/v2.1/servers/e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:56:01.076742 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-f94ee67c-7d64-4ffb-a707-97cfb8dceb13 req-4a366cb3-738b-4bd9-91bd-48faab613fd5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0", "tag": "f0b44c54-7ca7-49db-b2bf-9634e7e3c34b"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:56:01.086857 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-f94ee67c-7d64-4ffb-a707-97cfb8dceb13 req-4a366cb3-738b-4bd9-91bd-48faab613fd5 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:56:01.087366 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-f94ee67c-7d64-4ffb-a707-97cfb8dceb13 req-4a366cb3-738b-4bd9-91bd-48faab613fd5 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:56:01.087827 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-f94ee67c-7d64-4ffb-a707-97cfb8dceb13 req-4a366cb3-738b-4bd9-91bd-48faab613fd5 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:56:01.103642 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-f94ee67c-7d64-4ffb-a707-97cfb8dceb13 req-4a366cb3-738b-4bd9-91bd-48faab613fd5 service nova] Creating event network-changed:f0b44c54-7ca7-49db-b2bf-9634e7e3c34b for instance e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0 on n-h2-850468-14 Aug 10 23:56:01.108834 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-f94ee67c-7d64-4ffb-a707-97cfb8dceb13 req-4a366cb3-738b-4bd9-91bd-48faab613fd5 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036353 Aug 10 23:56:01.110515 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3435/6662] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:56:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:56:41.845532 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=3 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:56:41.846381 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:56:41.850761 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-ff6e0e2e-3e04-4dae-b729-9129078e44e4 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:56:41.853000 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-ff6e0e2e-3e04-4dae-b729-9129078e44e4 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:56:41.862191 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ff6e0e2e-3e04-4dae-b729-9129078e44e4 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:56:41.862678 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ff6e0e2e-3e04-4dae-b729-9129078e44e4 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:56:41.863146 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ff6e0e2e-3e04-4dae-b729-9129078e44e4 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:56:41.863840 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ff6e0e2e-3e04-4dae-b729-9129078e44e4 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:56:41.864299 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ff6e0e2e-3e04-4dae-b729-9129078e44e4 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:56:41.864728 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ff6e0e2e-3e04-4dae-b729-9129078e44e4 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:56:41.893447 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-ff6e0e2e-3e04-4dae-b729-9129078e44e4 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:56:41.899405 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-ff6e0e2e-3e04-4dae-b729-9129078e44e4 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0] Old instance type m1.heat2, new instance type m1.heat {{(pid=122632) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 10 23:56:41.905650 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-ff6e0e2e-3e04-4dae-b729-9129078e44e4 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Flavor limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:56:41.906075 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-ff6e0e2e-3e04-4dae-b729-9129078e44e4 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Image limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:56:41.907248 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-ff6e0e2e-3e04-4dae-b729-9129078e44e4 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Flavor pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:56:41.907664 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-ff6e0e2e-3e04-4dae-b729-9129078e44e4 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Image pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:56:41.908079 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-ff6e0e2e-3e04-4dae-b729-9129078e44e4 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:56:41.974447 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-ff6e0e2e-3e04-4dae-b729-9129078e44e4 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "POST /compute/v2.1/servers/e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0/action" status: 202 len: 0 microversion: 2.1 time: 0.131485 Aug 10 23:56:41.975135 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3228/6663] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:56:41 2022] POST /compute/v2.1/servers/e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0/action => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:56:41.982230 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_api:SELECT=19 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:56:41.983512 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:56:41.989291 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-4d8d8e26-1038-4bca-9d1f-d8e63cfb2443 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:56:41.990007 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-4d8d8e26-1038-4bca-9d1f-d8e63cfb2443 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:56:41.997963 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4d8d8e26-1038-4bca-9d1f-d8e63cfb2443 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:56:41.998500 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4d8d8e26-1038-4bca-9d1f-d8e63cfb2443 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:56:41.998987 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4d8d8e26-1038-4bca-9d1f-d8e63cfb2443 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:56:42.000138 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4d8d8e26-1038-4bca-9d1f-d8e63cfb2443 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:56:42.001366 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4d8d8e26-1038-4bca-9d1f-d8e63cfb2443 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:56:42.001839 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4d8d8e26-1038-4bca-9d1f-d8e63cfb2443 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:56:42.463605 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-4d8d8e26-1038-4bca-9d1f-d8e63cfb2443 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:56:42.471852 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-4d8d8e26-1038-4bca-9d1f-d8e63cfb2443 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0" status: 200 len: 1679 microversion: 2.1 time: 0.492003 Aug 10 23:56:42.472428 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3436/6664] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:56:41 2022] GET /compute/v2.1/servers/e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0 => generated 1679 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:56:43.494483 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-00cd5a8f-5512-477a-8ca5-6d5cbea36f60 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:56:43.495037 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-00cd5a8f-5512-477a-8ca5-6d5cbea36f60 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:56:43.502770 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-00cd5a8f-5512-477a-8ca5-6d5cbea36f60 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:56:43.503283 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-00cd5a8f-5512-477a-8ca5-6d5cbea36f60 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:56:43.503720 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-00cd5a8f-5512-477a-8ca5-6d5cbea36f60 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:56:43.504414 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-00cd5a8f-5512-477a-8ca5-6d5cbea36f60 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:56:43.504866 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-00cd5a8f-5512-477a-8ca5-6d5cbea36f60 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:56:43.505316 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-00cd5a8f-5512-477a-8ca5-6d5cbea36f60 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:56:43.640390 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-00cd5a8f-5512-477a-8ca5-6d5cbea36f60 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:56:43.648400 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-00cd5a8f-5512-477a-8ca5-6d5cbea36f60 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0" status: 200 len: 1679 microversion: 2.1 time: 0.158747 Aug 10 23:56:43.648978 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3229/6665] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:56:43 2022] GET /compute/v2.1/servers/e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0 => generated 1679 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:56:44.671522 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-0a6533c8-d9c1-4f08-a25d-6ea85cbc4cb6 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:56:44.672279 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-0a6533c8-d9c1-4f08-a25d-6ea85cbc4cb6 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:56:44.679682 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0a6533c8-d9c1-4f08-a25d-6ea85cbc4cb6 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:56:44.680180 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0a6533c8-d9c1-4f08-a25d-6ea85cbc4cb6 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:56:44.680623 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0a6533c8-d9c1-4f08-a25d-6ea85cbc4cb6 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:56:44.681332 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0a6533c8-d9c1-4f08-a25d-6ea85cbc4cb6 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:56:44.681794 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0a6533c8-d9c1-4f08-a25d-6ea85cbc4cb6 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:56:44.682227 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0a6533c8-d9c1-4f08-a25d-6ea85cbc4cb6 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:56:44.819814 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-0a6533c8-d9c1-4f08-a25d-6ea85cbc4cb6 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:56:44.827510 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-0a6533c8-d9c1-4f08-a25d-6ea85cbc4cb6 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0" status: 200 len: 1684 microversion: 2.1 time: 0.159986 Aug 10 23:56:44.828082 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3437/6666] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:56:44 2022] GET /compute/v2.1/servers/e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0 => generated 1684 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:56:45.848348 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-3cf2b36d-1276-4ca3-9424-b2d99309a1bc tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:56:45.848956 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-3cf2b36d-1276-4ca3-9424-b2d99309a1bc tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:56:45.855773 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3cf2b36d-1276-4ca3-9424-b2d99309a1bc tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:56:45.856253 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3cf2b36d-1276-4ca3-9424-b2d99309a1bc tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:56:45.856688 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3cf2b36d-1276-4ca3-9424-b2d99309a1bc tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:56:45.857374 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3cf2b36d-1276-4ca3-9424-b2d99309a1bc tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:56:45.857827 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3cf2b36d-1276-4ca3-9424-b2d99309a1bc tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:56:45.858257 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3cf2b36d-1276-4ca3-9424-b2d99309a1bc tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:56:45.992593 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-3cf2b36d-1276-4ca3-9424-b2d99309a1bc tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:56:46.001143 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-3cf2b36d-1276-4ca3-9424-b2d99309a1bc tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0" status: 200 len: 1684 microversion: 2.1 time: 0.156656 Aug 10 23:56:46.001718 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3230/6667] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:56:45 2022] GET /compute/v2.1/servers/e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0 => generated 1684 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:56:47.022289 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-e0beef83-1092-4dfb-8b50-0617da135352 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:56:47.022951 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-e0beef83-1092-4dfb-8b50-0617da135352 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:56:47.029926 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e0beef83-1092-4dfb-8b50-0617da135352 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:56:47.030421 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e0beef83-1092-4dfb-8b50-0617da135352 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:56:47.030920 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e0beef83-1092-4dfb-8b50-0617da135352 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:56:47.031637 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e0beef83-1092-4dfb-8b50-0617da135352 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:56:47.032110 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e0beef83-1092-4dfb-8b50-0617da135352 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:56:47.032562 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e0beef83-1092-4dfb-8b50-0617da135352 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:56:47.162241 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-e0beef83-1092-4dfb-8b50-0617da135352 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:56:47.169843 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-e0beef83-1092-4dfb-8b50-0617da135352 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0" status: 200 len: 1684 microversion: 2.1 time: 0.151537 Aug 10 23:56:47.170422 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3438/6668] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:56:47 2022] GET /compute/v2.1/servers/e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0 => generated 1684 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:56:48.191185 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-de156c7e-e724-4319-9861-ac5d28c6952e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:56:48.191797 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-de156c7e-e724-4319-9861-ac5d28c6952e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:56:48.198497 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-de156c7e-e724-4319-9861-ac5d28c6952e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:56:48.199009 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-de156c7e-e724-4319-9861-ac5d28c6952e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:56:48.199450 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-de156c7e-e724-4319-9861-ac5d28c6952e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:56:48.200142 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-de156c7e-e724-4319-9861-ac5d28c6952e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:56:48.200595 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-de156c7e-e724-4319-9861-ac5d28c6952e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:56:48.201019 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-de156c7e-e724-4319-9861-ac5d28c6952e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:56:48.332629 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-de156c7e-e724-4319-9861-ac5d28c6952e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:56:48.340059 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-de156c7e-e724-4319-9861-ac5d28c6952e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0" status: 200 len: 1684 microversion: 2.1 time: 0.152961 Aug 10 23:56:48.340633 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3231/6669] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:56:48 2022] GET /compute/v2.1/servers/e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0 => generated 1684 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:56:49.362311 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-d09a60ac-35e4-4e28-a7b4-02b09d10f865 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:56:49.362969 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-d09a60ac-35e4-4e28-a7b4-02b09d10f865 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:56:49.369792 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d09a60ac-35e4-4e28-a7b4-02b09d10f865 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:56:49.370295 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d09a60ac-35e4-4e28-a7b4-02b09d10f865 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:56:49.370744 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d09a60ac-35e4-4e28-a7b4-02b09d10f865 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:56:49.371480 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d09a60ac-35e4-4e28-a7b4-02b09d10f865 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:56:49.371957 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d09a60ac-35e4-4e28-a7b4-02b09d10f865 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:56:49.372398 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d09a60ac-35e4-4e28-a7b4-02b09d10f865 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:56:49.504404 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-d09a60ac-35e4-4e28-a7b4-02b09d10f865 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:56:49.512245 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-d09a60ac-35e4-4e28-a7b4-02b09d10f865 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0" status: 200 len: 1684 microversion: 2.1 time: 0.154459 Aug 10 23:56:49.512874 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3439/6670] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:56:49 2022] GET /compute/v2.1/servers/e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0 => generated 1684 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:56:50.534480 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-4d8c90bd-9233-4e38-bdf4-23ffcc5a2c60 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:56:50.535168 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-4d8c90bd-9233-4e38-bdf4-23ffcc5a2c60 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:56:50.542249 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4d8c90bd-9233-4e38-bdf4-23ffcc5a2c60 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:56:50.542739 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4d8c90bd-9233-4e38-bdf4-23ffcc5a2c60 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:56:50.543211 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4d8c90bd-9233-4e38-bdf4-23ffcc5a2c60 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:56:50.543911 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4d8c90bd-9233-4e38-bdf4-23ffcc5a2c60 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:56:50.544368 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4d8c90bd-9233-4e38-bdf4-23ffcc5a2c60 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:56:50.544796 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4d8c90bd-9233-4e38-bdf4-23ffcc5a2c60 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:56:50.678386 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-4d8c90bd-9233-4e38-bdf4-23ffcc5a2c60 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:56:50.685856 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-4d8c90bd-9233-4e38-bdf4-23ffcc5a2c60 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0" status: 200 len: 1684 microversion: 2.1 time: 0.156262 Aug 10 23:56:50.686430 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3232/6671] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:56:50 2022] GET /compute/v2.1/servers/e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0 => generated 1684 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:56:51.707967 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-00bdac6a-0618-4892-a0e4-300e39a5d99c tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:56:51.708597 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-00bdac6a-0618-4892-a0e4-300e39a5d99c tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:56:51.715875 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-00bdac6a-0618-4892-a0e4-300e39a5d99c tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:56:51.716400 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-00bdac6a-0618-4892-a0e4-300e39a5d99c tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:56:51.716834 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-00bdac6a-0618-4892-a0e4-300e39a5d99c tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:56:51.717560 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-00bdac6a-0618-4892-a0e4-300e39a5d99c tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:56:51.718023 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-00bdac6a-0618-4892-a0e4-300e39a5d99c tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:56:51.718497 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-00bdac6a-0618-4892-a0e4-300e39a5d99c tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:56:51.850241 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-00bdac6a-0618-4892-a0e4-300e39a5d99c tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:56:51.857734 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-00bdac6a-0618-4892-a0e4-300e39a5d99c tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0" status: 200 len: 1684 microversion: 2.1 time: 0.153766 Aug 10 23:56:51.858303 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3440/6672] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:56:51 2022] GET /compute/v2.1/servers/e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0 => generated 1684 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:56:52.880490 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-d5a14718-7d09-4170-b945-516100130f6e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:56:52.881135 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-d5a14718-7d09-4170-b945-516100130f6e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:56:52.888027 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d5a14718-7d09-4170-b945-516100130f6e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:56:52.888524 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d5a14718-7d09-4170-b945-516100130f6e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:56:52.888964 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d5a14718-7d09-4170-b945-516100130f6e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:56:52.889658 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d5a14718-7d09-4170-b945-516100130f6e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:56:52.890115 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d5a14718-7d09-4170-b945-516100130f6e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:56:52.891178 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d5a14718-7d09-4170-b945-516100130f6e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:56:53.020979 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-d5a14718-7d09-4170-b945-516100130f6e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:56:53.028572 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-d5a14718-7d09-4170-b945-516100130f6e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0" status: 200 len: 1684 microversion: 2.1 time: 0.152028 Aug 10 23:56:53.029186 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3233/6673] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:56:52 2022] GET /compute/v2.1/servers/e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0 => generated 1684 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:56:54.052045 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-2394f871-2f2e-4810-9e83-46494f2b222c tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:56:54.052680 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-2394f871-2f2e-4810-9e83-46494f2b222c tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:56:54.059749 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2394f871-2f2e-4810-9e83-46494f2b222c tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:56:54.060251 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2394f871-2f2e-4810-9e83-46494f2b222c tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:56:54.060709 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2394f871-2f2e-4810-9e83-46494f2b222c tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:56:54.061423 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2394f871-2f2e-4810-9e83-46494f2b222c tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:56:54.061896 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2394f871-2f2e-4810-9e83-46494f2b222c tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:56:54.063045 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2394f871-2f2e-4810-9e83-46494f2b222c tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:56:54.198425 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-2394f871-2f2e-4810-9e83-46494f2b222c tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:56:54.206145 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-2394f871-2f2e-4810-9e83-46494f2b222c tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0" status: 200 len: 1684 microversion: 2.1 time: 0.158102 Aug 10 23:56:54.206744 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3441/6674] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:56:54 2022] GET /compute/v2.1/servers/e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0 => generated 1684 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:56:55.226761 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-ad0da2c2-1c4d-45b2-af8b-41eaad225a3e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:56:55.227319 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-ad0da2c2-1c4d-45b2-af8b-41eaad225a3e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:56:55.234048 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ad0da2c2-1c4d-45b2-af8b-41eaad225a3e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:56:55.234531 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ad0da2c2-1c4d-45b2-af8b-41eaad225a3e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:56:55.235086 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ad0da2c2-1c4d-45b2-af8b-41eaad225a3e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:56:55.235781 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ad0da2c2-1c4d-45b2-af8b-41eaad225a3e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:56:55.236236 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ad0da2c2-1c4d-45b2-af8b-41eaad225a3e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:56:55.236666 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ad0da2c2-1c4d-45b2-af8b-41eaad225a3e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:56:55.365138 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-ad0da2c2-1c4d-45b2-af8b-41eaad225a3e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:56:55.372662 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-ad0da2c2-1c4d-45b2-af8b-41eaad225a3e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0" status: 200 len: 1684 microversion: 2.1 time: 0.149917 Aug 10 23:56:55.373243 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3234/6675] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:56:55 2022] GET /compute/v2.1/servers/e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0 => generated 1684 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:56:56.394906 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-5380704c-d7e6-48ed-83f2-83756fd7c005 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:56:56.395590 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-5380704c-d7e6-48ed-83f2-83756fd7c005 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:56:56.402864 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5380704c-d7e6-48ed-83f2-83756fd7c005 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:56:56.403384 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5380704c-d7e6-48ed-83f2-83756fd7c005 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:56:56.404261 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5380704c-d7e6-48ed-83f2-83756fd7c005 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:56:56.404814 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5380704c-d7e6-48ed-83f2-83756fd7c005 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:56:56.405394 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5380704c-d7e6-48ed-83f2-83756fd7c005 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:56:56.405909 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5380704c-d7e6-48ed-83f2-83756fd7c005 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:56:56.554465 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-5380704c-d7e6-48ed-83f2-83756fd7c005 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:56:56.564167 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-5380704c-d7e6-48ed-83f2-83756fd7c005 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0" status: 200 len: 1684 microversion: 2.1 time: 0.173188 Aug 10 23:56:56.565111 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3442/6676] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:56:56 2022] GET /compute/v2.1/servers/e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0 => generated 1684 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:56:56.989767 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-1d2dcdd3-8f13-428b-949e-e2ee57396fd7 req-bc1502e1-9a0c-4603-9aca-17d80cfafe5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0", "name": "network-vif-unplugged", "status": "completed", "tag": "f0b44c54-7ca7-49db-b2bf-9634e7e3c34b"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:56:57.001029 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-1d2dcdd3-8f13-428b-949e-e2ee57396fd7 req-bc1502e1-9a0c-4603-9aca-17d80cfafe5e service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:56:57.001520 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-1d2dcdd3-8f13-428b-949e-e2ee57396fd7 req-bc1502e1-9a0c-4603-9aca-17d80cfafe5e service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:56:57.002017 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-1d2dcdd3-8f13-428b-949e-e2ee57396fd7 req-bc1502e1-9a0c-4603-9aca-17d80cfafe5e service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:56:57.014309 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-1d2dcdd3-8f13-428b-949e-e2ee57396fd7 req-bc1502e1-9a0c-4603-9aca-17d80cfafe5e service nova] Creating event network-vif-unplugged:f0b44c54-7ca7-49db-b2bf-9634e7e3c34b for instance e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0 on n-h1-850468-14 Aug 10 23:56:57.020743 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [req-1d2dcdd3-8f13-428b-949e-e2ee57396fd7 req-bc1502e1-9a0c-4603-9aca-17d80cfafe5e service nova] Instance e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-850468-14', 'n-h2-850468-14'} {{(pid=122632) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5901}} Aug 10 23:56:57.032652 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-1d2dcdd3-8f13-428b-949e-e2ee57396fd7 req-bc1502e1-9a0c-4603-9aca-17d80cfafe5e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046781 Aug 10 23:56:57.033580 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3235/6677] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:56:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:56:57.585619 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-411a5fd7-d0a2-4f3e-b2aa-6b68afe46b83 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:56:57.586247 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-411a5fd7-d0a2-4f3e-b2aa-6b68afe46b83 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:56:57.593261 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-411a5fd7-d0a2-4f3e-b2aa-6b68afe46b83 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:56:57.593798 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-411a5fd7-d0a2-4f3e-b2aa-6b68afe46b83 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:56:57.594703 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-411a5fd7-d0a2-4f3e-b2aa-6b68afe46b83 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:56:57.595071 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-411a5fd7-d0a2-4f3e-b2aa-6b68afe46b83 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:56:57.595549 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-411a5fd7-d0a2-4f3e-b2aa-6b68afe46b83 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:56:57.595992 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-411a5fd7-d0a2-4f3e-b2aa-6b68afe46b83 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:56:57.728950 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-411a5fd7-d0a2-4f3e-b2aa-6b68afe46b83 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:56:57.737243 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-411a5fd7-d0a2-4f3e-b2aa-6b68afe46b83 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0" status: 200 len: 1683 microversion: 2.1 time: 0.155564 Aug 10 23:56:57.737823 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3443/6678] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:56:57 2022] GET /compute/v2.1/servers/e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0 => generated 1683 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:56:58.761394 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-9f07b2a6-a9c8-42eb-b29d-34d5b28158e3 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:56:58.762026 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-9f07b2a6-a9c8-42eb-b29d-34d5b28158e3 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:56:58.769099 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9f07b2a6-a9c8-42eb-b29d-34d5b28158e3 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:56:58.769584 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9f07b2a6-a9c8-42eb-b29d-34d5b28158e3 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:56:58.770023 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9f07b2a6-a9c8-42eb-b29d-34d5b28158e3 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:56:58.770715 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9f07b2a6-a9c8-42eb-b29d-34d5b28158e3 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:56:58.771205 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9f07b2a6-a9c8-42eb-b29d-34d5b28158e3 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:56:58.771633 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9f07b2a6-a9c8-42eb-b29d-34d5b28158e3 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:56:58.908696 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-9f07b2a6-a9c8-42eb-b29d-34d5b28158e3 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:56:58.916383 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-9f07b2a6-a9c8-42eb-b29d-34d5b28158e3 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0" status: 200 len: 1681 microversion: 2.1 time: 0.160134 Aug 10 23:56:58.916976 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3236/6679] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:56:58 2022] GET /compute/v2.1/servers/e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0 => generated 1681 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:56:59.049135 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-fd0524aa-6956-4d62-8217-8535459ef890 req-ff02662d-863f-4e91-8bc2-3f5804fc2b68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0", "tag": "f0b44c54-7ca7-49db-b2bf-9634e7e3c34b"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:56:59.059380 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-fd0524aa-6956-4d62-8217-8535459ef890 req-ff02662d-863f-4e91-8bc2-3f5804fc2b68 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:56:59.059875 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-fd0524aa-6956-4d62-8217-8535459ef890 req-ff02662d-863f-4e91-8bc2-3f5804fc2b68 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:56:59.060326 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-fd0524aa-6956-4d62-8217-8535459ef890 req-ff02662d-863f-4e91-8bc2-3f5804fc2b68 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:56:59.072745 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-fd0524aa-6956-4d62-8217-8535459ef890 req-ff02662d-863f-4e91-8bc2-3f5804fc2b68 service nova] Creating event network-changed:f0b44c54-7ca7-49db-b2bf-9634e7e3c34b for instance e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0 on n-h1-850468-14 Aug 10 23:56:59.078616 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [req-fd0524aa-6956-4d62-8217-8535459ef890 req-ff02662d-863f-4e91-8bc2-3f5804fc2b68 service nova] Instance e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-850468-14', 'n-h2-850468-14'} {{(pid=122633) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5901}} Aug 10 23:56:59.089650 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-fd0524aa-6956-4d62-8217-8535459ef890 req-ff02662d-863f-4e91-8bc2-3f5804fc2b68 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045085 Aug 10 23:56:59.090250 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3444/6680] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:56:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:56:59.938126 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-e1772b0e-36fa-494e-8f80-4c0f4157ca1c tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:56:59.938648 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-e1772b0e-36fa-494e-8f80-4c0f4157ca1c tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:56:59.945452 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e1772b0e-36fa-494e-8f80-4c0f4157ca1c tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:56:59.945937 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e1772b0e-36fa-494e-8f80-4c0f4157ca1c tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:56:59.946375 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e1772b0e-36fa-494e-8f80-4c0f4157ca1c tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:56:59.947108 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e1772b0e-36fa-494e-8f80-4c0f4157ca1c tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:56:59.947731 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e1772b0e-36fa-494e-8f80-4c0f4157ca1c tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:56:59.948163 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e1772b0e-36fa-494e-8f80-4c0f4157ca1c tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:57:00.085292 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-e1772b0e-36fa-494e-8f80-4c0f4157ca1c tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:57:00.094012 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-e1772b0e-36fa-494e-8f80-4c0f4157ca1c tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0" status: 200 len: 1678 microversion: 2.1 time: 0.159430 Aug 10 23:57:00.094622 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3237/6681] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:56:59 2022] GET /compute/v2.1/servers/e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0 => generated 1678 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:57:00.116024 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-b16b6727-ab39-4db0-935b-5090f377d583 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:57:00.116672 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-b16b6727-ab39-4db0-935b-5090f377d583 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:57:00.122954 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b16b6727-ab39-4db0-935b-5090f377d583 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:57:00.123467 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b16b6727-ab39-4db0-935b-5090f377d583 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:57:00.123924 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b16b6727-ab39-4db0-935b-5090f377d583 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:57:00.125124 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b16b6727-ab39-4db0-935b-5090f377d583 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:57:00.125608 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b16b6727-ab39-4db0-935b-5090f377d583 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:57:00.126055 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b16b6727-ab39-4db0-935b-5090f377d583 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:57:00.164545 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b16b6727-ab39-4db0-935b-5090f377d583 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:57:00.165051 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b16b6727-ab39-4db0-935b-5090f377d583 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:57:00.165590 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b16b6727-ab39-4db0-935b-5090f377d583 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:57:00.166447 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b16b6727-ab39-4db0-935b-5090f377d583 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:57:00.167077 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b16b6727-ab39-4db0-935b-5090f377d583 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:57:00.167538 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b16b6727-ab39-4db0-935b-5090f377d583 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:57:00.191715 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-b16b6727-ab39-4db0-935b-5090f377d583 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Getting quotas for project 49e20a407dbc425ea488dee2995ebbe3. Resources: {'cores', 'ram'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:57:00.196902 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-b16b6727-ab39-4db0-935b-5090f377d583 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Getting quotas for user 1412a4116dbb4412ba8ea10f72e2d95e and project 49e20a407dbc425ea488dee2995ebbe3. Resources: {'cores', 'ram'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:57:00.299263 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-b16b6727-ab39-4db0-935b-5090f377d583 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "POST /compute/v2.1/servers/e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0/action" status: 202 len: 0 microversion: 2.1 time: 0.188218 Aug 10 23:57:00.299863 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3445/6682] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:57:00 2022] POST /compute/v2.1/servers/e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0/action => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:57:00.308116 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-e1cff96f-599b-4038-8225-a448cc9d0eb0 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:57:00.308852 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-e1cff96f-599b-4038-8225-a448cc9d0eb0 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:57:00.316397 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e1cff96f-599b-4038-8225-a448cc9d0eb0 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:57:00.316397 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e1cff96f-599b-4038-8225-a448cc9d0eb0 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:57:00.316794 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e1cff96f-599b-4038-8225-a448cc9d0eb0 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:57:00.317678 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e1cff96f-599b-4038-8225-a448cc9d0eb0 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:57:00.318325 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e1cff96f-599b-4038-8225-a448cc9d0eb0 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:57:00.318844 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e1cff96f-599b-4038-8225-a448cc9d0eb0 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:57:00.521599 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-e1cff96f-599b-4038-8225-a448cc9d0eb0 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:57:00.529643 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-e1cff96f-599b-4038-8225-a448cc9d0eb0 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0" status: 200 len: 1677 microversion: 2.1 time: 0.225478 Aug 10 23:57:00.530226 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3238/6683] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:57:00 2022] GET /compute/v2.1/servers/e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0 => generated 1677 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:57:01.553446 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-2d7182c3-f43b-4db5-b7fe-059f693dcecf tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:57:01.554157 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-2d7182c3-f43b-4db5-b7fe-059f693dcecf tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:57:01.561519 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2d7182c3-f43b-4db5-b7fe-059f693dcecf tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:57:01.561829 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2d7182c3-f43b-4db5-b7fe-059f693dcecf tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:57:01.562967 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2d7182c3-f43b-4db5-b7fe-059f693dcecf tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:57:01.564105 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2d7182c3-f43b-4db5-b7fe-059f693dcecf tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:57:01.564578 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2d7182c3-f43b-4db5-b7fe-059f693dcecf tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:57:01.565195 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2d7182c3-f43b-4db5-b7fe-059f693dcecf tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:57:01.701525 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-2d7182c3-f43b-4db5-b7fe-059f693dcecf tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:57:01.709414 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-2d7182c3-f43b-4db5-b7fe-059f693dcecf tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0" status: 200 len: 1677 microversion: 2.1 time: 0.161310 Aug 10 23:57:01.710000 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3446/6684] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:57:01 2022] GET /compute/v2.1/servers/e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0 => generated 1677 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:57:02.731132 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-af7824ab-24a3-43b4-8492-c3773b864a75 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:57:02.731739 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-af7824ab-24a3-43b4-8492-c3773b864a75 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:57:02.739242 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-af7824ab-24a3-43b4-8492-c3773b864a75 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:57:02.739723 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-af7824ab-24a3-43b4-8492-c3773b864a75 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:57:02.740155 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-af7824ab-24a3-43b4-8492-c3773b864a75 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:57:02.740843 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-af7824ab-24a3-43b4-8492-c3773b864a75 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:57:02.741289 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-af7824ab-24a3-43b4-8492-c3773b864a75 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:57:02.741706 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-af7824ab-24a3-43b4-8492-c3773b864a75 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:57:02.870494 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-af7824ab-24a3-43b4-8492-c3773b864a75 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:57:02.878962 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-af7824ab-24a3-43b4-8492-c3773b864a75 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0" status: 200 len: 1677 microversion: 2.1 time: 0.151712 Aug 10 23:57:02.879539 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3239/6685] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:57:02 2022] GET /compute/v2.1/servers/e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0 => generated 1677 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:57:03.294247 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-fd3cd520-a662-4d73-b577-c93687108c0b req-bb5c5926-2139-4e2a-909e-1595c156ad70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0", "name": "network-vif-plugged", "status": "completed", "tag": "f0b44c54-7ca7-49db-b2bf-9634e7e3c34b"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:57:03.308836 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-fd3cd520-a662-4d73-b577-c93687108c0b req-bb5c5926-2139-4e2a-909e-1595c156ad70 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:57:03.309509 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-fd3cd520-a662-4d73-b577-c93687108c0b req-bb5c5926-2139-4e2a-909e-1595c156ad70 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:57:03.309965 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-fd3cd520-a662-4d73-b577-c93687108c0b req-bb5c5926-2139-4e2a-909e-1595c156ad70 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:57:03.323810 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-fd3cd520-a662-4d73-b577-c93687108c0b req-bb5c5926-2139-4e2a-909e-1595c156ad70 service nova] Creating event network-vif-plugged:f0b44c54-7ca7-49db-b2bf-9634e7e3c34b for instance e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0 on n-h2-850468-14 Aug 10 23:57:03.329210 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [req-fd3cd520-a662-4d73-b577-c93687108c0b req-bb5c5926-2139-4e2a-909e-1595c156ad70 service nova] Instance e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-850468-14', 'n-h2-850468-14'} {{(pid=122633) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5901}} Aug 10 23:57:03.342657 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-fd3cd520-a662-4d73-b577-c93687108c0b req-bb5c5926-2139-4e2a-909e-1595c156ad70 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051920 Aug 10 23:57:03.344054 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3447/6686] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:57:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:57:03.797096 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-5f3386b9-7bc6-45a9-af7f-5fec26baa010 req-e805e1ec-d6d9-41d2-a372-427498c4f30e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0", "name": "network-vif-unplugged", "status": "completed", "tag": "f0b44c54-7ca7-49db-b2bf-9634e7e3c34b"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:57:03.808801 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-5f3386b9-7bc6-45a9-af7f-5fec26baa010 req-e805e1ec-d6d9-41d2-a372-427498c4f30e service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:57:03.809293 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-5f3386b9-7bc6-45a9-af7f-5fec26baa010 req-e805e1ec-d6d9-41d2-a372-427498c4f30e service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:57:03.809704 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-5f3386b9-7bc6-45a9-af7f-5fec26baa010 req-e805e1ec-d6d9-41d2-a372-427498c4f30e service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:57:03.825877 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-5f3386b9-7bc6-45a9-af7f-5fec26baa010 req-e805e1ec-d6d9-41d2-a372-427498c4f30e service nova] Creating event network-vif-unplugged:f0b44c54-7ca7-49db-b2bf-9634e7e3c34b for instance e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0 on n-h2-850468-14 Aug 10 23:57:03.833507 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [req-5f3386b9-7bc6-45a9-af7f-5fec26baa010 req-e805e1ec-d6d9-41d2-a372-427498c4f30e service nova] Instance e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-850468-14', 'n-h2-850468-14'} {{(pid=122632) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5901}} Aug 10 23:57:03.844600 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-5f3386b9-7bc6-45a9-af7f-5fec26baa010 req-e805e1ec-d6d9-41d2-a372-427498c4f30e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051784 Aug 10 23:57:03.845203 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3240/6687] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:57:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:57:03.901648 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-56984300-3e61-4f38-9ce2-9276aa8177c3 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:57:03.908823 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-56984300-3e61-4f38-9ce2-9276aa8177c3 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:57:03.915641 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-56984300-3e61-4f38-9ce2-9276aa8177c3 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:57:03.916392 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-56984300-3e61-4f38-9ce2-9276aa8177c3 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:57:03.916851 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-56984300-3e61-4f38-9ce2-9276aa8177c3 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:57:03.917589 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-56984300-3e61-4f38-9ce2-9276aa8177c3 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:57:03.918067 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-56984300-3e61-4f38-9ce2-9276aa8177c3 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:57:03.918512 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-56984300-3e61-4f38-9ce2-9276aa8177c3 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:57:04.066043 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-56984300-3e61-4f38-9ce2-9276aa8177c3 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:57:04.073708 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-56984300-3e61-4f38-9ce2-9276aa8177c3 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0" status: 200 len: 1677 microversion: 2.1 time: 0.176524 Aug 10 23:57:04.083282 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3448/6688] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:57:03 2022] GET /compute/v2.1/servers/e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0 => generated 1677 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:57:05.098179 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-b959e103-f41a-442a-947e-bf9ad4e99dd1 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:57:05.098925 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-b959e103-f41a-442a-947e-bf9ad4e99dd1 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:57:05.105071 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b959e103-f41a-442a-947e-bf9ad4e99dd1 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:57:05.105564 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b959e103-f41a-442a-947e-bf9ad4e99dd1 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:57:05.105995 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b959e103-f41a-442a-947e-bf9ad4e99dd1 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:57:05.107042 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b959e103-f41a-442a-947e-bf9ad4e99dd1 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:57:05.107503 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b959e103-f41a-442a-947e-bf9ad4e99dd1 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:57:05.107929 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b959e103-f41a-442a-947e-bf9ad4e99dd1 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:57:05.242160 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-b959e103-f41a-442a-947e-bf9ad4e99dd1 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:57:05.250183 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-b959e103-f41a-442a-947e-bf9ad4e99dd1 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0" status: 200 len: 1677 microversion: 2.1 time: 0.157595 Aug 10 23:57:05.250765 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3241/6689] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:57:05 2022] GET /compute/v2.1/servers/e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0 => generated 1677 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:57:05.880459 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-25b811ff-9c8e-4d41-867b-96f90d4abe75 req-0b261157-59f0-4f8a-ae10-41f488677cfb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0", "tag": "f0b44c54-7ca7-49db-b2bf-9634e7e3c34b"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:57:05.891827 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-25b811ff-9c8e-4d41-867b-96f90d4abe75 req-0b261157-59f0-4f8a-ae10-41f488677cfb service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:57:05.892313 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-25b811ff-9c8e-4d41-867b-96f90d4abe75 req-0b261157-59f0-4f8a-ae10-41f488677cfb service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:57:05.892758 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-25b811ff-9c8e-4d41-867b-96f90d4abe75 req-0b261157-59f0-4f8a-ae10-41f488677cfb service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:57:05.904625 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-25b811ff-9c8e-4d41-867b-96f90d4abe75 req-0b261157-59f0-4f8a-ae10-41f488677cfb service nova] Creating event network-changed:f0b44c54-7ca7-49db-b2bf-9634e7e3c34b for instance e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0 on n-h2-850468-14 Aug 10 23:57:05.910261 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [req-25b811ff-9c8e-4d41-867b-96f90d4abe75 req-0b261157-59f0-4f8a-ae10-41f488677cfb service nova] Instance e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-850468-14', 'n-h2-850468-14'} {{(pid=122633) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5901}} Aug 10 23:57:05.920585 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-25b811ff-9c8e-4d41-867b-96f90d4abe75 req-0b261157-59f0-4f8a-ae10-41f488677cfb service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043821 Aug 10 23:57:05.921167 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3449/6690] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:57:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 23:57:06.271732 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-a167ece3-ab7a-4af0-9e7d-34afa16e946c tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:57:06.272368 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-a167ece3-ab7a-4af0-9e7d-34afa16e946c tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:57:06.280113 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a167ece3-ab7a-4af0-9e7d-34afa16e946c tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:57:06.281763 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a167ece3-ab7a-4af0-9e7d-34afa16e946c tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:57:06.282447 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a167ece3-ab7a-4af0-9e7d-34afa16e946c tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:57:06.283574 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a167ece3-ab7a-4af0-9e7d-34afa16e946c tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:57:06.284222 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a167ece3-ab7a-4af0-9e7d-34afa16e946c tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:57:06.284864 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a167ece3-ab7a-4af0-9e7d-34afa16e946c tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:57:06.620886 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-a167ece3-ab7a-4af0-9e7d-34afa16e946c tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:57:06.629898 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-a167ece3-ab7a-4af0-9e7d-34afa16e946c tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0" status: 200 len: 1677 microversion: 2.1 time: 0.362781 Aug 10 23:57:06.631397 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3242/6691] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:57:06 2022] GET /compute/v2.1/servers/e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0 => generated 1677 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:57:07.653815 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-f83d0694-63b5-47c5-b332-b8868aaed396 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:57:07.654548 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-f83d0694-63b5-47c5-b332-b8868aaed396 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:57:07.661170 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f83d0694-63b5-47c5-b332-b8868aaed396 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:57:07.661683 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f83d0694-63b5-47c5-b332-b8868aaed396 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:57:07.662146 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f83d0694-63b5-47c5-b332-b8868aaed396 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:57:07.662909 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f83d0694-63b5-47c5-b332-b8868aaed396 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:57:07.663390 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f83d0694-63b5-47c5-b332-b8868aaed396 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:57:07.663836 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f83d0694-63b5-47c5-b332-b8868aaed396 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:57:07.684766 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:57:07.811450 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-f83d0694-63b5-47c5-b332-b8868aaed396 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:57:07.820363 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-f83d0694-63b5-47c5-b332-b8868aaed396 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0" status: 200 len: 1670 microversion: 2.1 time: 0.171765 Aug 10 23:57:07.820952 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3450/6692] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:57:07 2022] GET /compute/v2.1/servers/e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0 => generated 1670 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:57:07.841167 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-42c16b68-ceee-4074-a887-74a88bde65f2 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:57:07.841781 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-42c16b68-ceee-4074-a887-74a88bde65f2 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:57:07.849246 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-42c16b68-ceee-4074-a887-74a88bde65f2 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:57:07.849739 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-42c16b68-ceee-4074-a887-74a88bde65f2 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:57:07.850164 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-42c16b68-ceee-4074-a887-74a88bde65f2 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:57:07.850909 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-42c16b68-ceee-4074-a887-74a88bde65f2 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:57:07.851361 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-42c16b68-ceee-4074-a887-74a88bde65f2 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:57:07.851785 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-42c16b68-ceee-4074-a887-74a88bde65f2 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:57:08.261204 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-42c16b68-ceee-4074-a887-74a88bde65f2 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:57:08.264749 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:57:08.270496 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-42c16b68-ceee-4074-a887-74a88bde65f2 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0" status: 200 len: 1670 microversion: 2.1 time: 0.433281 Aug 10 23:57:08.271093 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3243/6693] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:57:07 2022] GET /compute/v2.1/servers/e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0 => generated 1670 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:57:08.291405 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-1cc4d609-5bbe-47e2-889c-684f523731c3 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:57:08.292033 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-1cc4d609-5bbe-47e2-889c-684f523731c3 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:57:08.298246 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1cc4d609-5bbe-47e2-889c-684f523731c3 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:57:08.298751 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1cc4d609-5bbe-47e2-889c-684f523731c3 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:57:08.299244 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1cc4d609-5bbe-47e2-889c-684f523731c3 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:57:08.299953 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1cc4d609-5bbe-47e2-889c-684f523731c3 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:57:08.300432 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1cc4d609-5bbe-47e2-889c-684f523731c3 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:57:08.300877 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1cc4d609-5bbe-47e2-889c-684f523731c3 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:57:08.432479 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-1cc4d609-5bbe-47e2-889c-684f523731c3 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:57:08.440816 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-1cc4d609-5bbe-47e2-889c-684f523731c3 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0" status: 200 len: 1670 microversion: 2.1 time: 0.153003 Aug 10 23:57:08.441389 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3451/6694] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:57:08 2022] GET /compute/v2.1/servers/e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0 => generated 1670 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:57:08.462549 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-49d22fd3-7d5e-40b6-9f60-ba233b701cb2 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:57:08.463098 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-49d22fd3-7d5e-40b6-9f60-ba233b701cb2 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:57:08.471038 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-49d22fd3-7d5e-40b6-9f60-ba233b701cb2 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:57:08.471519 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-49d22fd3-7d5e-40b6-9f60-ba233b701cb2 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:57:08.471953 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-49d22fd3-7d5e-40b6-9f60-ba233b701cb2 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:57:08.472632 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-49d22fd3-7d5e-40b6-9f60-ba233b701cb2 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:57:08.473081 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-49d22fd3-7d5e-40b6-9f60-ba233b701cb2 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:57:08.473500 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-49d22fd3-7d5e-40b6-9f60-ba233b701cb2 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:57:08.498940 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-49d22fd3-7d5e-40b6-9f60-ba233b701cb2 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0] Going to try to terminate instance {{(pid=122632) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:57:08.578536 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-49d22fd3-7d5e-40b6-9f60-ba233b701cb2 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "DELETE /compute/v2.1/servers/e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0" status: 204 len: 0 microversion: 2.1 time: 0.120327 Aug 10 23:57:08.580004 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3244/6695] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:57:08 2022] DELETE /compute/v2.1/servers/e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:57:08.591295 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-e200a0d4-957b-4b1f-be26-fae65a31464c tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:57:08.591916 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-e200a0d4-957b-4b1f-be26-fae65a31464c tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:57:08.598731 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e200a0d4-957b-4b1f-be26-fae65a31464c tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:57:08.599274 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e200a0d4-957b-4b1f-be26-fae65a31464c tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:57:08.599721 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e200a0d4-957b-4b1f-be26-fae65a31464c tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:57:08.600436 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e200a0d4-957b-4b1f-be26-fae65a31464c tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:57:08.600900 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e200a0d4-957b-4b1f-be26-fae65a31464c tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:57:08.601337 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e200a0d4-957b-4b1f-be26-fae65a31464c tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:57:08.732379 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-e200a0d4-957b-4b1f-be26-fae65a31464c tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:57:08.740619 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-e200a0d4-957b-4b1f-be26-fae65a31464c tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0" status: 200 len: 1676 microversion: 2.1 time: 0.154789 Aug 10 23:57:08.741213 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3452/6696] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:57:08 2022] GET /compute/v2.1/servers/e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0 => generated 1676 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:57:09.721906 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-3c2a0534-722a-49c7-9cc4-db94689f9153 req-eae202a5-2940-4787-bba3-5fb0c5d08e03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0", "name": "network-vif-plugged", "status": "completed", "tag": "f0b44c54-7ca7-49db-b2bf-9634e7e3c34b"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:57:09.733319 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-3c2a0534-722a-49c7-9cc4-db94689f9153 req-eae202a5-2940-4787-bba3-5fb0c5d08e03 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:57:09.734611 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-3c2a0534-722a-49c7-9cc4-db94689f9153 req-eae202a5-2940-4787-bba3-5fb0c5d08e03 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:57:09.735346 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-3c2a0534-722a-49c7-9cc4-db94689f9153 req-eae202a5-2940-4787-bba3-5fb0c5d08e03 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:57:09.746032 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-3c2a0534-722a-49c7-9cc4-db94689f9153 req-eae202a5-2940-4787-bba3-5fb0c5d08e03 service nova] Creating event network-vif-plugged:f0b44c54-7ca7-49db-b2bf-9634e7e3c34b for instance e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0 on n-h2-850468-14 Aug 10 23:57:09.752076 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-3c2a0534-722a-49c7-9cc4-db94689f9153 req-eae202a5-2940-4787-bba3-5fb0c5d08e03 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034703 Aug 10 23:57:09.752672 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3245/6697] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:57:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:57:09.763425 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-36e98dbc-fbf5-48c0-9887-b01c1671f32e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:57:09.764188 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-36e98dbc-fbf5-48c0-9887-b01c1671f32e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:57:09.771367 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-36e98dbc-fbf5-48c0-9887-b01c1671f32e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:57:09.771803 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-36e98dbc-fbf5-48c0-9887-b01c1671f32e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:57:09.772259 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-36e98dbc-fbf5-48c0-9887-b01c1671f32e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:57:09.772981 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-36e98dbc-fbf5-48c0-9887-b01c1671f32e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:57:09.773457 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-36e98dbc-fbf5-48c0-9887-b01c1671f32e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:57:09.773902 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-36e98dbc-fbf5-48c0-9887-b01c1671f32e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:57:09.910413 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-36e98dbc-fbf5-48c0-9887-b01c1671f32e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:57:09.917994 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-36e98dbc-fbf5-48c0-9887-b01c1671f32e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0" status: 200 len: 1676 microversion: 2.1 time: 0.158612 Aug 10 23:57:09.918569 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3453/6698] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:57:09 2022] GET /compute/v2.1/servers/e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0 => generated 1676 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:57:10.815049 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-1b8c5a21-2f6a-4dd2-8385-bd220c184465 req-c7d45c5c-5e13-43f4-8b5d-aa1d6ea5a81e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0", "name": "network-vif-deleted", "tag": "f0b44c54-7ca7-49db-b2bf-9634e7e3c34b"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:57:10.824494 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-1b8c5a21-2f6a-4dd2-8385-bd220c184465 req-c7d45c5c-5e13-43f4-8b5d-aa1d6ea5a81e service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:57:10.825039 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-1b8c5a21-2f6a-4dd2-8385-bd220c184465 req-c7d45c5c-5e13-43f4-8b5d-aa1d6ea5a81e service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:57:10.825820 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-1b8c5a21-2f6a-4dd2-8385-bd220c184465 req-c7d45c5c-5e13-43f4-8b5d-aa1d6ea5a81e service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:57:10.836972 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-1b8c5a21-2f6a-4dd2-8385-bd220c184465 req-c7d45c5c-5e13-43f4-8b5d-aa1d6ea5a81e service nova] Creating event network-vif-deleted:f0b44c54-7ca7-49db-b2bf-9634e7e3c34b for instance e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0 on n-h2-850468-14 Aug 10 23:57:10.842332 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-1b8c5a21-2f6a-4dd2-8385-bd220c184465 req-c7d45c5c-5e13-43f4-8b5d-aa1d6ea5a81e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032811 Aug 10 23:57:10.842962 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3246/6699] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:57:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:57:10.939712 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-a4f59eac-c9d3-4165-9758-785ca33d196c tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:57:10.940316 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-a4f59eac-c9d3-4165-9758-785ca33d196c tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:57:10.943509 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=3 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:57:10.949544 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a4f59eac-c9d3-4165-9758-785ca33d196c tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:57:10.950091 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a4f59eac-c9d3-4165-9758-785ca33d196c tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:57:10.950581 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a4f59eac-c9d3-4165-9758-785ca33d196c tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:57:10.951336 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a4f59eac-c9d3-4165-9758-785ca33d196c tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:57:10.951810 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a4f59eac-c9d3-4165-9758-785ca33d196c tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:57:10.952255 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a4f59eac-c9d3-4165-9758-785ca33d196c tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:57:10.984476 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a4f59eac-c9d3-4165-9758-785ca33d196c tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:57:10.984966 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a4f59eac-c9d3-4165-9758-785ca33d196c tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:57:10.985410 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a4f59eac-c9d3-4165-9758-785ca33d196c tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:57:10.985876 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.objects.instance [None req-a4f59eac-c9d3-4165-9758-785ca33d196c tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lazy-loading 'fault' on Instance uuid e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0 {{(pid=122633) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:57:11.027244 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-a4f59eac-c9d3-4165-9758-785ca33d196c tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:57:11.035587 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-a4f59eac-c9d3-4165-9758-785ca33d196c tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0" status: 200 len: 1328 microversion: 2.1 time: 0.100055 Aug 10 23:57:11.036177 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3454/6700] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:57:10 2022] GET /compute/v2.1/servers/e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0 => generated 1328 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:57:12.059603 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-41dee24b-c9ef-43f9-ba46-1d4938f57fbb tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:57:12.060336 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-41dee24b-c9ef-43f9-ba46-1d4938f57fbb tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:57:12.062951 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:57:12.068403 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-41dee24b-c9ef-43f9-ba46-1d4938f57fbb tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:57:12.068891 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-41dee24b-c9ef-43f9-ba46-1d4938f57fbb tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:57:12.069332 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-41dee24b-c9ef-43f9-ba46-1d4938f57fbb tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:57:12.070060 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-41dee24b-c9ef-43f9-ba46-1d4938f57fbb tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:57:12.070512 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-41dee24b-c9ef-43f9-ba46-1d4938f57fbb tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:57:12.070970 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-41dee24b-c9ef-43f9-ba46-1d4938f57fbb tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:57:12.084971 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-41dee24b-c9ef-43f9-ba46-1d4938f57fbb tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] HTTP exception thrown: Instance e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0 could not be found. Aug 10 23:57:12.086587 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-41dee24b-c9ef-43f9-ba46-1d4938f57fbb tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Request method failure captured: Aug 10 23:57:12.086587 n-d-850468-14 devstack@n-api.service[122632]: request: GET /compute/v2.1/servers/e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0 HTTP/1.1 Aug 10 23:57:12.086587 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:57:12.086587 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:57:12.086587 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:57:12.086587 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 23:57:12.086587 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:57:12.086587 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:57:12.086587 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:57:12.086587 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:57:12.086587 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9ETka_MLrOzNLl9fMo23yiaBVbwRsDIGTKuSE2U_QdPMsSc8GHIwU4exY0o7VQcTlL32LUR0TzTXBFYguNbPnJvl-Oq37igm94dUqjDcjI8p0o_T8FFxkqM-af8dhqzR4fbIp2j_qc7pazKLEDLMGgsyywPyJGsRgPDIuxnwDfxMZ8k Aug 10 23:57:12.086587 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:57:12.086587 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:57:12.086587 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:57:12.086587 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:57:12.086587 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:57:12.086587 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:57:12.086587 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 49e20a407dbc425ea488dee2995ebbe3 Aug 10 23:57:12.086587 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-ServerActionsTestJSON-1613214326 Aug 10 23:57:12.086587 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:57:12.086587 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:57:12.086587 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/49e20a407dbc425ea488dee2995ebbe3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/49e20a407dbc425ea488dee2995ebbe3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/49e20a407dbc425ea488dee2995ebbe3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_49e20a407dbc425ea488dee2995ebbe3", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:57:12.086587 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-ServerActionsTestJSON-1613214326 Aug 10 23:57:12.086587 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 49e20a407dbc425ea488dee2995ebbe3 Aug 10 23:57:12.086587 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-ServerActionsTestJSON-1613214326 Aug 10 23:57:12.086587 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-ServerActionsTestJSON-1613214326-project Aug 10 23:57:12.086587 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:57:12.086587 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:57:12.086587 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: 1412a4116dbb4412ba8ea10f72e2d95e Aug 10 23:57:12.086587 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-ServerActionsTestJSON-1613214326-project Aug 10 23:57:12.086587 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:57:12.086587 n-d-850468-14 devstack@n-api.service[122632]: exception: Instance e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0 could not be found. Aug 10 23:57:12.086587 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': 'e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0'} Aug 10 23:57:12.086587 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:57:12.086587 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:57:12.086587 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:57:12.086587 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:57:12.086587 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:57:12.086587 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:57:12.086587 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:57:12.086587 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:57:12.086587 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:57:12.086587 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:57:12.086587 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0 could not be found. Aug 10 23:57:12.086587 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:57:12.086587 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:57:12.086587 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:57:12.086587 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:57:12.086587 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:57:12.086587 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:57:12.086587 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:57:12.086587 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:57:12.086587 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:57:12.086587 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:57:12.086587 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:57:12.086587 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:57:12.086587 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:57:12.086587 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:57:12.086587 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:57:12.086587 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:57:12.086587 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0 could not be found. Aug 10 23:57:12.086587 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:57:12.086587 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:57:12.086587 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:57:12.090297 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:57:12.090297 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:57:12.090297 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:57:12.090297 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:57:12.090297 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:57:12.090297 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0 could not be found. Aug 10 23:57:12.090297 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:57:12.090297 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-41dee24b-c9ef-43f9-ba46-1d4938f57fbb tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Returning 404 to user: Instance e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0 could not be found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:57:12.090297 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-41dee24b-c9ef-43f9-ba46-1d4938f57fbb tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0" status: 404 len: 111 microversion: 2.1 time: 0.033498 Aug 10 23:57:12.090297 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3247/6701] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:57:12 2022] GET /compute/v2.1/servers/e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:57:12.103354 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-326d99dd-e9e1-4187-9b3d-0f6a141c7eab tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:57:12.104047 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-326d99dd-e9e1-4187-9b3d-0f6a141c7eab tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:57:12.106874 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:57:12.113241 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-326d99dd-e9e1-4187-9b3d-0f6a141c7eab tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:57:12.113745 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-326d99dd-e9e1-4187-9b3d-0f6a141c7eab tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:57:12.114203 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-326d99dd-e9e1-4187-9b3d-0f6a141c7eab tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:57:12.114965 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-326d99dd-e9e1-4187-9b3d-0f6a141c7eab tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:57:12.115444 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-326d99dd-e9e1-4187-9b3d-0f6a141c7eab tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:57:12.115892 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-326d99dd-e9e1-4187-9b3d-0f6a141c7eab tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:57:12.134074 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-326d99dd-e9e1-4187-9b3d-0f6a141c7eab tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] HTTP exception thrown: Instance e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0 could not be found. Aug 10 23:57:12.135793 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-326d99dd-e9e1-4187-9b3d-0f6a141c7eab tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Request method failure captured: Aug 10 23:57:12.135793 n-d-850468-14 devstack@n-api.service[122633]: request: GET /compute/v2.1/servers/e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0 HTTP/1.1 Aug 10 23:57:12.135793 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:57:12.135793 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:57:12.135793 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:57:12.135793 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:57:12.135793 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:57:12.135793 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:57:12.135793 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:57:12.135793 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:57:12.135793 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9ETka_MLrOzNLl9fMo23yiaBVbwRsDIGTKuSE2U_QdPMsSc8GHIwU4exY0o7VQcTlL32LUR0TzTXBFYguNbPnJvl-Oq37igm94dUqjDcjI8p0o_T8FFxkqM-af8dhqzR4fbIp2j_qc7pazKLEDLMGgsyywPyJGsRgPDIuxnwDfxMZ8k Aug 10 23:57:12.135793 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:57:12.135793 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:57:12.135793 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:57:12.135793 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:57:12.135793 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:57:12.135793 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:57:12.135793 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 49e20a407dbc425ea488dee2995ebbe3 Aug 10 23:57:12.135793 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-ServerActionsTestJSON-1613214326 Aug 10 23:57:12.135793 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:57:12.135793 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:57:12.135793 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/49e20a407dbc425ea488dee2995ebbe3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/49e20a407dbc425ea488dee2995ebbe3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/49e20a407dbc425ea488dee2995ebbe3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_49e20a407dbc425ea488dee2995ebbe3", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:57:12.135793 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-ServerActionsTestJSON-1613214326 Aug 10 23:57:12.135793 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 49e20a407dbc425ea488dee2995ebbe3 Aug 10 23:57:12.135793 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-ServerActionsTestJSON-1613214326 Aug 10 23:57:12.135793 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-ServerActionsTestJSON-1613214326-project Aug 10 23:57:12.135793 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:57:12.135793 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:57:12.135793 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 1412a4116dbb4412ba8ea10f72e2d95e Aug 10 23:57:12.135793 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-ServerActionsTestJSON-1613214326-project Aug 10 23:57:12.135793 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:57:12.135793 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0 could not be found. Aug 10 23:57:12.135793 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': 'e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0'} Aug 10 23:57:12.135793 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:57:12.135793 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:57:12.135793 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:57:12.135793 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:57:12.135793 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:57:12.135793 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:57:12.135793 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:57:12.135793 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:57:12.135793 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:57:12.135793 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:57:12.135793 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0 could not be found. Aug 10 23:57:12.135793 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:57:12.135793 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:57:12.135793 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:57:12.135793 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:57:12.135793 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:57:12.135793 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:57:12.135793 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:57:12.135793 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:57:12.135793 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:57:12.135793 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:57:12.135793 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:57:12.135793 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:57:12.135793 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:57:12.135793 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:57:12.135793 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:57:12.135793 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:57:12.135793 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0 could not be found. Aug 10 23:57:12.135793 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:57:12.135793 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:57:12.135793 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:57:12.139861 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:57:12.139861 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:57:12.139861 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:57:12.139861 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:57:12.139861 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:57:12.139861 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0 could not be found. Aug 10 23:57:12.139861 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:57:12.139861 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-326d99dd-e9e1-4187-9b3d-0f6a141c7eab tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Returning 404 to user: Instance e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0 could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:57:12.139861 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-326d99dd-e9e1-4187-9b3d-0f6a141c7eab tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0" status: 404 len: 111 microversion: 2.1 time: 0.037865 Aug 10 23:57:12.139861 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3455/6702] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:57:12 2022] GET /compute/v2.1/servers/e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:57:12.194674 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-0ae4bc64-b0eb-40e1-b439-1503f0c61be2 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1291008688", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452", "networks": [{"uuid": "bbbbeb6b-4410-487d-bc67-956aff866a4e"}], "security_groups": [{"name": "tempest-securitygroup--1954233211"}], "key_name": "tempest-keypair-1767049833", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:57:12.300669 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.network.neutron [None req-0ae4bc64-b0eb-40e1-b439-1503f0c61be2 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] validate_networks() for [('bbbbeb6b-4410-487d-bc67-956aff866a4e', None, None, None, None, None)] {{(pid=122632) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 23:57:12.679237 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-0ae4bc64-b0eb-40e1-b439-1503f0c61be2 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Flavor limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:57:12.679670 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-0ae4bc64-b0eb-40e1-b439-1503f0c61be2 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Image limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:57:12.680157 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-0ae4bc64-b0eb-40e1-b439-1503f0c61be2 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Flavor pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:57:12.680603 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-0ae4bc64-b0eb-40e1-b439-1503f0c61be2 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Image pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:57:12.681074 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-0ae4bc64-b0eb-40e1-b439-1503f0c61be2 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:57:12.690345 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0ae4bc64-b0eb-40e1-b439-1503f0c61be2 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:57:12.690862 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0ae4bc64-b0eb-40e1-b439-1503f0c61be2 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:57:12.691307 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0ae4bc64-b0eb-40e1-b439-1503f0c61be2 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:57:12.692042 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0ae4bc64-b0eb-40e1-b439-1503f0c61be2 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:57:12.692503 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0ae4bc64-b0eb-40e1-b439-1503f0c61be2 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:57:12.692936 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0ae4bc64-b0eb-40e1-b439-1503f0c61be2 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:57:12.710165 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-0ae4bc64-b0eb-40e1-b439-1503f0c61be2 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Getting quotas for project 49e20a407dbc425ea488dee2995ebbe3. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:57:12.715496 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-0ae4bc64-b0eb-40e1-b439-1503f0c61be2 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Getting quotas for user 1412a4116dbb4412ba8ea10f72e2d95e and project 49e20a407dbc425ea488dee2995ebbe3. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:57:12.728377 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-0ae4bc64-b0eb-40e1-b439-1503f0c61be2 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Going to run 1 instances... {{(pid=122632) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 23:57:12.730646 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-0ae4bc64-b0eb-40e1-b439-1503f0c61be2 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: e5805281-9889-4ebd-95e4-4d41d79fabaa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78ad8905-f66f-4733-8be9-2b260f1fabed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122632) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 23:57:12.777579 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-0ae4bc64-b0eb-40e1-b439-1503f0c61be2 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.586799 Aug 10 23:57:12.778229 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3248/6703] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 23:57:12 2022] POST /compute/v2.1/servers => generated 406 bytes in 588 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 23:57:12.790215 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-f9d7023f-3b87-4da7-b5c6-bfe0a0ea8002 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:57:12.790894 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-f9d7023f-3b87-4da7-b5c6-bfe0a0ea8002 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: e5805281-9889-4ebd-95e4-4d41d79fabaa] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:57:12.852271 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-f9d7023f-3b87-4da7-b5c6-bfe0a0ea8002 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:57:12.862807 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-f9d7023f-3b87-4da7-b5c6-bfe0a0ea8002 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/e5805281-9889-4ebd-95e4-4d41d79fabaa" status: 200 len: 1239 microversion: 2.1 time: 0.076455 Aug 10 23:57:12.863482 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3456/6704] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:57:12 2022] GET /compute/v2.1/servers/e5805281-9889-4ebd-95e4-4d41d79fabaa => generated 1239 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:57:13.886323 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-5714c7ae-b3e0-40cf-aee2-3b68a8aabd65 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:57:13.887054 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-5714c7ae-b3e0-40cf-aee2-3b68a8aabd65 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: e5805281-9889-4ebd-95e4-4d41d79fabaa] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:57:13.894225 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5714c7ae-b3e0-40cf-aee2-3b68a8aabd65 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:57:13.895029 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5714c7ae-b3e0-40cf-aee2-3b68a8aabd65 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:57:13.895631 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5714c7ae-b3e0-40cf-aee2-3b68a8aabd65 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:57:13.896354 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5714c7ae-b3e0-40cf-aee2-3b68a8aabd65 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:57:13.896834 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5714c7ae-b3e0-40cf-aee2-3b68a8aabd65 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:57:13.897266 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5714c7ae-b3e0-40cf-aee2-3b68a8aabd65 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:57:13.969476 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-5714c7ae-b3e0-40cf-aee2-3b68a8aabd65 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:57:13.977052 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-5714c7ae-b3e0-40cf-aee2-3b68a8aabd65 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/e5805281-9889-4ebd-95e4-4d41d79fabaa" status: 200 len: 1297 microversion: 2.1 time: 0.095635 Aug 10 23:57:13.977823 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3249/6705] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:57:13 2022] GET /compute/v2.1/servers/e5805281-9889-4ebd-95e4-4d41d79fabaa => generated 1297 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:57:14.999686 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-d4e04b75-4f02-45a3-8f7e-6cb65d2f4497 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:57:15.000270 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-d4e04b75-4f02-45a3-8f7e-6cb65d2f4497 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: e5805281-9889-4ebd-95e4-4d41d79fabaa] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:57:15.008196 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d4e04b75-4f02-45a3-8f7e-6cb65d2f4497 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:57:15.008704 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d4e04b75-4f02-45a3-8f7e-6cb65d2f4497 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:57:15.009166 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d4e04b75-4f02-45a3-8f7e-6cb65d2f4497 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:57:15.009891 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d4e04b75-4f02-45a3-8f7e-6cb65d2f4497 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:57:15.010365 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d4e04b75-4f02-45a3-8f7e-6cb65d2f4497 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:57:15.010838 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d4e04b75-4f02-45a3-8f7e-6cb65d2f4497 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:57:15.146702 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-d4e04b75-4f02-45a3-8f7e-6cb65d2f4497 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:57:15.154427 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-d4e04b75-4f02-45a3-8f7e-6cb65d2f4497 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/e5805281-9889-4ebd-95e4-4d41d79fabaa" status: 200 len: 1365 microversion: 2.1 time: 0.159218 Aug 10 23:57:15.155117 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3457/6706] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:57:14 2022] GET /compute/v2.1/servers/e5805281-9889-4ebd-95e4-4d41d79fabaa => generated 1365 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:57:15.367766 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-ef00dd5d-4737-4ed5-9e6c-8be82a45b7bb req-01351f1a-d1b1-44b9-8171-2518c2f6bd40 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5805281-9889-4ebd-95e4-4d41d79fabaa", "tag": "90f240db-9fe1-4512-a9ef-32887891cfde"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:57:15.382302 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-ef00dd5d-4737-4ed5-9e6c-8be82a45b7bb req-01351f1a-d1b1-44b9-8171-2518c2f6bd40 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:57:15.382808 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-ef00dd5d-4737-4ed5-9e6c-8be82a45b7bb req-01351f1a-d1b1-44b9-8171-2518c2f6bd40 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:57:15.383238 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-ef00dd5d-4737-4ed5-9e6c-8be82a45b7bb req-01351f1a-d1b1-44b9-8171-2518c2f6bd40 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:57:15.396737 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-ef00dd5d-4737-4ed5-9e6c-8be82a45b7bb req-01351f1a-d1b1-44b9-8171-2518c2f6bd40 service nova] Creating event network-changed:90f240db-9fe1-4512-a9ef-32887891cfde for instance e5805281-9889-4ebd-95e4-4d41d79fabaa on n-h1-850468-14 Aug 10 23:57:15.401715 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-ef00dd5d-4737-4ed5-9e6c-8be82a45b7bb req-01351f1a-d1b1-44b9-8171-2518c2f6bd40 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038350 Aug 10 23:57:15.402685 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3250/6707] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:57:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:57:16.177519 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-700a958c-06f4-4669-83a3-5809024934c6 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:57:16.178143 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-700a958c-06f4-4669-83a3-5809024934c6 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: e5805281-9889-4ebd-95e4-4d41d79fabaa] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:57:16.185021 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-700a958c-06f4-4669-83a3-5809024934c6 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:57:16.185514 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-700a958c-06f4-4669-83a3-5809024934c6 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:57:16.185960 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-700a958c-06f4-4669-83a3-5809024934c6 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:57:16.186714 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-700a958c-06f4-4669-83a3-5809024934c6 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:57:16.187379 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-700a958c-06f4-4669-83a3-5809024934c6 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:57:16.188919 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-700a958c-06f4-4669-83a3-5809024934c6 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:57:16.318419 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-700a958c-06f4-4669-83a3-5809024934c6 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:57:16.326107 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-700a958c-06f4-4669-83a3-5809024934c6 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/e5805281-9889-4ebd-95e4-4d41d79fabaa" status: 200 len: 1365 microversion: 2.1 time: 0.152562 Aug 10 23:57:16.326670 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3458/6708] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:57:16 2022] GET /compute/v2.1/servers/e5805281-9889-4ebd-95e4-4d41d79fabaa => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:57:17.348161 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-4bd5fdbc-d72c-4de4-a073-9a605c842abf tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:57:17.348864 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-4bd5fdbc-d72c-4de4-a073-9a605c842abf tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: e5805281-9889-4ebd-95e4-4d41d79fabaa] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:57:17.355859 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4bd5fdbc-d72c-4de4-a073-9a605c842abf tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:57:17.356347 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4bd5fdbc-d72c-4de4-a073-9a605c842abf tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:57:17.356785 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4bd5fdbc-d72c-4de4-a073-9a605c842abf tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:57:17.357479 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4bd5fdbc-d72c-4de4-a073-9a605c842abf tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:57:17.357934 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4bd5fdbc-d72c-4de4-a073-9a605c842abf tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:57:17.358362 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4bd5fdbc-d72c-4de4-a073-9a605c842abf tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:57:17.491731 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-4bd5fdbc-d72c-4de4-a073-9a605c842abf tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:57:17.500589 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-4bd5fdbc-d72c-4de4-a073-9a605c842abf tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/e5805281-9889-4ebd-95e4-4d41d79fabaa" status: 200 len: 1365 microversion: 2.1 time: 0.155892 Aug 10 23:57:17.501263 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3251/6709] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:57:17 2022] GET /compute/v2.1/servers/e5805281-9889-4ebd-95e4-4d41d79fabaa => generated 1365 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:57:18.522329 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-9f5e7bf5-93e6-4de1-a021-7857019bdb6c tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:57:18.522992 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-9f5e7bf5-93e6-4de1-a021-7857019bdb6c tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: e5805281-9889-4ebd-95e4-4d41d79fabaa] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:57:18.530092 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9f5e7bf5-93e6-4de1-a021-7857019bdb6c tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:57:18.530679 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9f5e7bf5-93e6-4de1-a021-7857019bdb6c tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:57:18.531201 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9f5e7bf5-93e6-4de1-a021-7857019bdb6c tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:57:18.531923 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9f5e7bf5-93e6-4de1-a021-7857019bdb6c tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:57:18.532400 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9f5e7bf5-93e6-4de1-a021-7857019bdb6c tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:57:18.532846 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9f5e7bf5-93e6-4de1-a021-7857019bdb6c tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:57:18.671502 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-9f5e7bf5-93e6-4de1-a021-7857019bdb6c tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:57:18.679338 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-9f5e7bf5-93e6-4de1-a021-7857019bdb6c tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/e5805281-9889-4ebd-95e4-4d41d79fabaa" status: 200 len: 1365 microversion: 2.1 time: 0.160960 Aug 10 23:57:18.679920 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3459/6710] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:57:18 2022] GET /compute/v2.1/servers/e5805281-9889-4ebd-95e4-4d41d79fabaa => generated 1365 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:57:19.701497 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-d62852c5-5d22-46a9-8c8d-99de35e35a2d tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:57:19.702609 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-d62852c5-5d22-46a9-8c8d-99de35e35a2d tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: e5805281-9889-4ebd-95e4-4d41d79fabaa] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:57:19.709474 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d62852c5-5d22-46a9-8c8d-99de35e35a2d tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:57:19.709950 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d62852c5-5d22-46a9-8c8d-99de35e35a2d tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:57:19.710411 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d62852c5-5d22-46a9-8c8d-99de35e35a2d tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:57:19.711123 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d62852c5-5d22-46a9-8c8d-99de35e35a2d tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:57:19.711571 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d62852c5-5d22-46a9-8c8d-99de35e35a2d tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:57:19.711987 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d62852c5-5d22-46a9-8c8d-99de35e35a2d tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:57:19.848608 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-d62852c5-5d22-46a9-8c8d-99de35e35a2d tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:57:19.856032 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-d62852c5-5d22-46a9-8c8d-99de35e35a2d tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/e5805281-9889-4ebd-95e4-4d41d79fabaa" status: 200 len: 1365 microversion: 2.1 time: 0.158619 Aug 10 23:57:19.856595 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3252/6711] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:57:19 2022] GET /compute/v2.1/servers/e5805281-9889-4ebd-95e4-4d41d79fabaa => generated 1365 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:57:20.878100 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-9e0d0a79-ca62-42f2-8658-d3b51dba53dd tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:57:20.878730 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-9e0d0a79-ca62-42f2-8658-d3b51dba53dd tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: e5805281-9889-4ebd-95e4-4d41d79fabaa] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:57:20.885677 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9e0d0a79-ca62-42f2-8658-d3b51dba53dd tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:57:20.886181 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9e0d0a79-ca62-42f2-8658-d3b51dba53dd tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:57:20.886637 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9e0d0a79-ca62-42f2-8658-d3b51dba53dd tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:57:20.887383 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9e0d0a79-ca62-42f2-8658-d3b51dba53dd tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:57:20.887855 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9e0d0a79-ca62-42f2-8658-d3b51dba53dd tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:57:20.888301 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9e0d0a79-ca62-42f2-8658-d3b51dba53dd tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:57:21.019518 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-9e0d0a79-ca62-42f2-8658-d3b51dba53dd tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:57:21.027225 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-9e0d0a79-ca62-42f2-8658-d3b51dba53dd tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/e5805281-9889-4ebd-95e4-4d41d79fabaa" status: 200 len: 1365 microversion: 2.1 time: 0.153576 Aug 10 23:57:21.027785 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3460/6712] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:57:20 2022] GET /compute/v2.1/servers/e5805281-9889-4ebd-95e4-4d41d79fabaa => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:57:21.354610 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-b3e1d926-6d7d-407a-ba91-fa0d857aeffc req-8bbabdfb-de9a-4425-9ee0-9650af13628b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5805281-9889-4ebd-95e4-4d41d79fabaa", "name": "network-vif-plugged", "status": "completed", "tag": "90f240db-9fe1-4512-a9ef-32887891cfde"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:57:21.365371 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-b3e1d926-6d7d-407a-ba91-fa0d857aeffc req-8bbabdfb-de9a-4425-9ee0-9650af13628b service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:57:21.365854 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-b3e1d926-6d7d-407a-ba91-fa0d857aeffc req-8bbabdfb-de9a-4425-9ee0-9650af13628b service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:57:21.366288 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-b3e1d926-6d7d-407a-ba91-fa0d857aeffc req-8bbabdfb-de9a-4425-9ee0-9650af13628b service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:57:21.379160 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-b3e1d926-6d7d-407a-ba91-fa0d857aeffc req-8bbabdfb-de9a-4425-9ee0-9650af13628b service nova] Creating event network-vif-plugged:90f240db-9fe1-4512-a9ef-32887891cfde for instance e5805281-9889-4ebd-95e4-4d41d79fabaa on n-h1-850468-14 Aug 10 23:57:21.383967 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-b3e1d926-6d7d-407a-ba91-fa0d857aeffc req-8bbabdfb-de9a-4425-9ee0-9650af13628b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033036 Aug 10 23:57:21.384572 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3253/6713] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:57:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:57:22.050509 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-644854eb-e403-4b0d-b8c2-b2a0df8a3b3a tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:57:22.051169 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-644854eb-e403-4b0d-b8c2-b2a0df8a3b3a tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: e5805281-9889-4ebd-95e4-4d41d79fabaa] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:57:22.057965 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-644854eb-e403-4b0d-b8c2-b2a0df8a3b3a tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:57:22.058467 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-644854eb-e403-4b0d-b8c2-b2a0df8a3b3a tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:57:22.058966 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-644854eb-e403-4b0d-b8c2-b2a0df8a3b3a tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:57:22.059676 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-644854eb-e403-4b0d-b8c2-b2a0df8a3b3a tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:57:22.060156 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-644854eb-e403-4b0d-b8c2-b2a0df8a3b3a tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:57:22.060599 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-644854eb-e403-4b0d-b8c2-b2a0df8a3b3a tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:57:22.192108 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-644854eb-e403-4b0d-b8c2-b2a0df8a3b3a tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:57:22.199649 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-644854eb-e403-4b0d-b8c2-b2a0df8a3b3a tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/e5805281-9889-4ebd-95e4-4d41d79fabaa" status: 200 len: 1365 microversion: 2.1 time: 0.153997 Aug 10 23:57:22.200217 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3461/6714] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:57:22 2022] GET /compute/v2.1/servers/e5805281-9889-4ebd-95e4-4d41d79fabaa => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:57:23.220480 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=2 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:57:23.221264 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=6 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:57:23.225434 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-a86cce2d-f655-4f3e-a584-ebd8eacc1796 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:57:23.226148 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-a86cce2d-f655-4f3e-a584-ebd8eacc1796 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: e5805281-9889-4ebd-95e4-4d41d79fabaa] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:57:23.233039 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a86cce2d-f655-4f3e-a584-ebd8eacc1796 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:57:23.233750 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a86cce2d-f655-4f3e-a584-ebd8eacc1796 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:57:23.234539 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a86cce2d-f655-4f3e-a584-ebd8eacc1796 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:57:23.235400 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a86cce2d-f655-4f3e-a584-ebd8eacc1796 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:57:23.235856 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a86cce2d-f655-4f3e-a584-ebd8eacc1796 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:57:23.236278 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a86cce2d-f655-4f3e-a584-ebd8eacc1796 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:57:23.366868 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-a86cce2d-f655-4f3e-a584-ebd8eacc1796 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:57:23.375988 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-a86cce2d-f655-4f3e-a584-ebd8eacc1796 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/e5805281-9889-4ebd-95e4-4d41d79fabaa" status: 200 len: 1552 microversion: 2.1 time: 0.157635 Aug 10 23:57:23.376566 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3254/6715] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:57:23 2022] GET /compute/v2.1/servers/e5805281-9889-4ebd-95e4-4d41d79fabaa => generated 1552 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:57:23.397567 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-00707cd5-65b6-44a5-9747-d4c789e9717a tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:57:23.398071 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-00707cd5-65b6-44a5-9747-d4c789e9717a tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: e5805281-9889-4ebd-95e4-4d41d79fabaa] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:57:23.400006 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=2 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:57:23.406333 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-00707cd5-65b6-44a5-9747-d4c789e9717a tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:57:23.406856 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-00707cd5-65b6-44a5-9747-d4c789e9717a tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:57:23.407319 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-00707cd5-65b6-44a5-9747-d4c789e9717a tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:57:23.408037 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-00707cd5-65b6-44a5-9747-d4c789e9717a tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:57:23.408506 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-00707cd5-65b6-44a5-9747-d4c789e9717a tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:57:23.408948 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-00707cd5-65b6-44a5-9747-d4c789e9717a tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:57:23.494694 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-00707cd5-65b6-44a5-9747-d4c789e9717a tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/e5805281-9889-4ebd-95e4-4d41d79fabaa/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.101136 Aug 10 23:57:23.495389 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3462/6716] 10.222.0.58 () {58 vars in 1275 bytes} [Wed Aug 10 23:57:23 2022] GET /compute/v2.1/servers/e5805281-9889-4ebd-95e4-4d41d79fabaa/os-interface => generated 284 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:57:24.537399 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-c8df9174-da11-4f71-b3d3-e8427531c355 req-295764a8-8eac-460b-b5e3-0f5bcf84af7c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5805281-9889-4ebd-95e4-4d41d79fabaa", "tag": "90f240db-9fe1-4512-a9ef-32887891cfde"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:57:24.547043 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-c8df9174-da11-4f71-b3d3-e8427531c355 req-295764a8-8eac-460b-b5e3-0f5bcf84af7c service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:57:24.547523 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-c8df9174-da11-4f71-b3d3-e8427531c355 req-295764a8-8eac-460b-b5e3-0f5bcf84af7c service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:57:24.547957 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-c8df9174-da11-4f71-b3d3-e8427531c355 req-295764a8-8eac-460b-b5e3-0f5bcf84af7c service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:57:24.559026 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-c8df9174-da11-4f71-b3d3-e8427531c355 req-295764a8-8eac-460b-b5e3-0f5bcf84af7c service nova] Creating event network-changed:90f240db-9fe1-4512-a9ef-32887891cfde for instance e5805281-9889-4ebd-95e4-4d41d79fabaa on n-h1-850468-14 Aug 10 23:57:24.567794 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-c8df9174-da11-4f71-b3d3-e8427531c355 req-295764a8-8eac-460b-b5e3-0f5bcf84af7c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085196 Aug 10 23:57:24.568426 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3255/6717] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:57:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:57:56.247395 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_api:SELECT=17 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:57:56.248258 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=64 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:57:56.253125 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-9cefd84b-e4bd-4a6b-98b9-99ba6bff7ee9 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:57:56.253697 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-9cefd84b-e4bd-4a6b-98b9-99ba6bff7ee9 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: e5805281-9889-4ebd-95e4-4d41d79fabaa] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:57:56.260445 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9cefd84b-e4bd-4a6b-98b9-99ba6bff7ee9 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:57:56.260937 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9cefd84b-e4bd-4a6b-98b9-99ba6bff7ee9 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:57:56.261383 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9cefd84b-e4bd-4a6b-98b9-99ba6bff7ee9 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:57:56.262079 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9cefd84b-e4bd-4a6b-98b9-99ba6bff7ee9 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:57:56.262544 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9cefd84b-e4bd-4a6b-98b9-99ba6bff7ee9 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:57:56.263013 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9cefd84b-e4bd-4a6b-98b9-99ba6bff7ee9 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:57:56.398028 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-9cefd84b-e4bd-4a6b-98b9-99ba6bff7ee9 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:57:56.407084 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-9cefd84b-e4bd-4a6b-98b9-99ba6bff7ee9 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/e5805281-9889-4ebd-95e4-4d41d79fabaa" status: 200 len: 1671 microversion: 2.1 time: 0.160476 Aug 10 23:57:56.407671 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3463/6718] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:57:56 2022] GET /compute/v2.1/servers/e5805281-9889-4ebd-95e4-4d41d79fabaa => generated 1671 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:57:56.428232 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-155e1707-57a3-42b4-9046-c3171ccb7a3a tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e0584738-1937-47ae-b247-f6741bea32fb"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:57:56.430609 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-155e1707-57a3-42b4-9046-c3171ccb7a3a tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: e5805281-9889-4ebd-95e4-4d41d79fabaa] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:57:56.433046 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:57:56.433692 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:57:56.441133 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-155e1707-57a3-42b4-9046-c3171ccb7a3a tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:57:56.441682 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-155e1707-57a3-42b4-9046-c3171ccb7a3a tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:57:56.442162 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-155e1707-57a3-42b4-9046-c3171ccb7a3a tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:57:56.442974 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-155e1707-57a3-42b4-9046-c3171ccb7a3a tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:57:56.443458 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-155e1707-57a3-42b4-9046-c3171ccb7a3a tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:57:56.443878 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-155e1707-57a3-42b4-9046-c3171ccb7a3a tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:57:56.689550 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-155e1707-57a3-42b4-9046-c3171ccb7a3a tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "POST /compute/v2.1/servers/e5805281-9889-4ebd-95e4-4d41d79fabaa/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.265416 Aug 10 23:57:56.690165 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3256/6719] 10.222.0.58 () {60 vars in 1323 bytes} [Wed Aug 10 23:57:56 2022] POST /compute/v2.1/servers/e5805281-9889-4ebd-95e4-4d41d79fabaa/os-volume_attachments => generated 194 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:58:07.404315 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-3ce16296-da38-4270-950c-16093b5261b8 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:58:07.407268 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-3ce16296-da38-4270-950c-16093b5261b8 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: e5805281-9889-4ebd-95e4-4d41d79fabaa] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:58:07.409445 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_api:SELECT=2 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:58:07.410123 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=6 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:58:07.415704 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3ce16296-da38-4270-950c-16093b5261b8 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:58:07.416214 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3ce16296-da38-4270-950c-16093b5261b8 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:58:07.416672 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3ce16296-da38-4270-950c-16093b5261b8 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:58:07.417390 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3ce16296-da38-4270-950c-16093b5261b8 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:58:07.417871 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3ce16296-da38-4270-950c-16093b5261b8 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:58:07.418316 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3ce16296-da38-4270-950c-16093b5261b8 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:58:07.447096 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-3ce16296-da38-4270-950c-16093b5261b8 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:58:07.453815 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-3ce16296-da38-4270-950c-16093b5261b8 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: e5805281-9889-4ebd-95e4-4d41d79fabaa] Old instance type m1.heat2, new instance type m1.heat {{(pid=122633) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 10 23:58:07.460668 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-3ce16296-da38-4270-950c-16093b5261b8 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Flavor limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:58:07.461112 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-3ce16296-da38-4270-950c-16093b5261b8 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Image limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:58:07.461600 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-3ce16296-da38-4270-950c-16093b5261b8 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Flavor pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:58:07.462026 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-3ce16296-da38-4270-950c-16093b5261b8 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Image pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:58:07.462453 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-3ce16296-da38-4270-950c-16093b5261b8 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:58:07.528323 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-3ce16296-da38-4270-950c-16093b5261b8 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "POST /compute/v2.1/servers/e5805281-9889-4ebd-95e4-4d41d79fabaa/action" status: 202 len: 0 microversion: 2.1 time: 0.128003 Aug 10 23:58:07.528951 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3464/6720] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:58:07 2022] POST /compute/v2.1/servers/e5805281-9889-4ebd-95e4-4d41d79fabaa/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:58:07.536431 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_api:SELECT=2 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:58:07.537631 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:58:07.543221 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-2d851b6b-1c58-4e6a-ae93-263a36f67609 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:58:07.543904 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-2d851b6b-1c58-4e6a-ae93-263a36f67609 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: e5805281-9889-4ebd-95e4-4d41d79fabaa] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:58:07.552015 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2d851b6b-1c58-4e6a-ae93-263a36f67609 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:58:07.552549 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2d851b6b-1c58-4e6a-ae93-263a36f67609 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:58:07.553106 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2d851b6b-1c58-4e6a-ae93-263a36f67609 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:58:07.553961 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2d851b6b-1c58-4e6a-ae93-263a36f67609 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:58:07.554577 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2d851b6b-1c58-4e6a-ae93-263a36f67609 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:58:07.555149 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2d851b6b-1c58-4e6a-ae93-263a36f67609 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:58:07.704678 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-2d851b6b-1c58-4e6a-ae93-263a36f67609 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:58:07.712970 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-2d851b6b-1c58-4e6a-ae93-263a36f67609 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/e5805281-9889-4ebd-95e4-4d41d79fabaa" status: 200 len: 1726 microversion: 2.1 time: 0.179274 Aug 10 23:58:07.713766 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3257/6721] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:58:07 2022] GET /compute/v2.1/servers/e5805281-9889-4ebd-95e4-4d41d79fabaa => generated 1726 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:58:08.783674 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-66f74046-2dfb-4ab3-9ae8-dfc74e6b91d7 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:58:08.784172 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-66f74046-2dfb-4ab3-9ae8-dfc74e6b91d7 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: e5805281-9889-4ebd-95e4-4d41d79fabaa] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:58:08.791267 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-66f74046-2dfb-4ab3-9ae8-dfc74e6b91d7 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:58:08.791780 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-66f74046-2dfb-4ab3-9ae8-dfc74e6b91d7 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:58:08.792237 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-66f74046-2dfb-4ab3-9ae8-dfc74e6b91d7 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:58:08.792961 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-66f74046-2dfb-4ab3-9ae8-dfc74e6b91d7 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:58:08.793438 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-66f74046-2dfb-4ab3-9ae8-dfc74e6b91d7 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:58:08.793891 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-66f74046-2dfb-4ab3-9ae8-dfc74e6b91d7 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:58:08.942543 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-66f74046-2dfb-4ab3-9ae8-dfc74e6b91d7 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:58:08.951918 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-66f74046-2dfb-4ab3-9ae8-dfc74e6b91d7 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/e5805281-9889-4ebd-95e4-4d41d79fabaa" status: 200 len: 1726 microversion: 2.1 time: 0.220833 Aug 10 23:58:08.952842 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3465/6722] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:58:08 2022] GET /compute/v2.1/servers/e5805281-9889-4ebd-95e4-4d41d79fabaa => generated 1726 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:58:09.973784 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-f8f962e5-19b4-469b-8a8b-c83bce6b49b3 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:58:09.974381 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-f8f962e5-19b4-469b-8a8b-c83bce6b49b3 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: e5805281-9889-4ebd-95e4-4d41d79fabaa] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:58:09.981321 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f8f962e5-19b4-469b-8a8b-c83bce6b49b3 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:58:09.981811 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f8f962e5-19b4-469b-8a8b-c83bce6b49b3 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:58:09.982252 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f8f962e5-19b4-469b-8a8b-c83bce6b49b3 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:58:09.983044 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f8f962e5-19b4-469b-8a8b-c83bce6b49b3 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:58:09.983511 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f8f962e5-19b4-469b-8a8b-c83bce6b49b3 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:58:09.983959 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f8f962e5-19b4-469b-8a8b-c83bce6b49b3 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:58:10.115793 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-f8f962e5-19b4-469b-8a8b-c83bce6b49b3 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:58:10.123713 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-f8f962e5-19b4-469b-8a8b-c83bce6b49b3 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/e5805281-9889-4ebd-95e4-4d41d79fabaa" status: 200 len: 1731 microversion: 2.1 time: 0.153878 Aug 10 23:58:10.125425 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3258/6723] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:58:09 2022] GET /compute/v2.1/servers/e5805281-9889-4ebd-95e4-4d41d79fabaa => generated 1731 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:58:11.147171 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-2933bab2-7eca-4968-90fa-87747d35fe67 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:58:11.147800 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-2933bab2-7eca-4968-90fa-87747d35fe67 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: e5805281-9889-4ebd-95e4-4d41d79fabaa] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:58:11.155275 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2933bab2-7eca-4968-90fa-87747d35fe67 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:58:11.157015 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2933bab2-7eca-4968-90fa-87747d35fe67 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:58:11.157550 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2933bab2-7eca-4968-90fa-87747d35fe67 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:58:11.158289 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2933bab2-7eca-4968-90fa-87747d35fe67 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:58:11.158769 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2933bab2-7eca-4968-90fa-87747d35fe67 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:58:11.159235 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2933bab2-7eca-4968-90fa-87747d35fe67 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:58:11.289893 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-2933bab2-7eca-4968-90fa-87747d35fe67 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:58:11.298239 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-2933bab2-7eca-4968-90fa-87747d35fe67 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/e5805281-9889-4ebd-95e4-4d41d79fabaa" status: 200 len: 1731 microversion: 2.1 time: 0.155058 Aug 10 23:58:11.298853 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3466/6724] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:58:11 2022] GET /compute/v2.1/servers/e5805281-9889-4ebd-95e4-4d41d79fabaa => generated 1731 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:58:12.320271 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-cbc064e6-51c7-4a0a-a3ae-f52445a7fabb tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:58:12.320879 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-cbc064e6-51c7-4a0a-a3ae-f52445a7fabb tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: e5805281-9889-4ebd-95e4-4d41d79fabaa] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:58:12.328374 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cbc064e6-51c7-4a0a-a3ae-f52445a7fabb tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:58:12.328944 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cbc064e6-51c7-4a0a-a3ae-f52445a7fabb tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:58:12.329388 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cbc064e6-51c7-4a0a-a3ae-f52445a7fabb tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:58:12.330087 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cbc064e6-51c7-4a0a-a3ae-f52445a7fabb tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:58:12.330552 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cbc064e6-51c7-4a0a-a3ae-f52445a7fabb tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:58:12.331008 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cbc064e6-51c7-4a0a-a3ae-f52445a7fabb tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:58:12.460625 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-cbc064e6-51c7-4a0a-a3ae-f52445a7fabb tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:58:12.468819 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-cbc064e6-51c7-4a0a-a3ae-f52445a7fabb tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/e5805281-9889-4ebd-95e4-4d41d79fabaa" status: 200 len: 1731 microversion: 2.1 time: 0.152464 Aug 10 23:58:12.469395 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3259/6725] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:58:12 2022] GET /compute/v2.1/servers/e5805281-9889-4ebd-95e4-4d41d79fabaa => generated 1731 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:58:13.490324 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-f5cb6d64-44f0-405f-bf8c-03dbd3490898 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:58:13.490982 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-f5cb6d64-44f0-405f-bf8c-03dbd3490898 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: e5805281-9889-4ebd-95e4-4d41d79fabaa] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:58:13.497858 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f5cb6d64-44f0-405f-bf8c-03dbd3490898 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:58:13.498358 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f5cb6d64-44f0-405f-bf8c-03dbd3490898 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:58:13.499352 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f5cb6d64-44f0-405f-bf8c-03dbd3490898 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:58:13.500275 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f5cb6d64-44f0-405f-bf8c-03dbd3490898 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:58:13.500759 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f5cb6d64-44f0-405f-bf8c-03dbd3490898 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:58:13.501203 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f5cb6d64-44f0-405f-bf8c-03dbd3490898 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:58:13.643652 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-f5cb6d64-44f0-405f-bf8c-03dbd3490898 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:58:13.652100 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-f5cb6d64-44f0-405f-bf8c-03dbd3490898 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/e5805281-9889-4ebd-95e4-4d41d79fabaa" status: 200 len: 1731 microversion: 2.1 time: 0.165715 Aug 10 23:58:13.652683 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3467/6726] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:58:13 2022] GET /compute/v2.1/servers/e5805281-9889-4ebd-95e4-4d41d79fabaa => generated 1731 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:58:14.674202 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-bb208e19-5837-4046-860e-e6a26bc64d51 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:58:14.674874 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-bb208e19-5837-4046-860e-e6a26bc64d51 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: e5805281-9889-4ebd-95e4-4d41d79fabaa] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:58:14.683137 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bb208e19-5837-4046-860e-e6a26bc64d51 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:58:14.683890 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bb208e19-5837-4046-860e-e6a26bc64d51 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:58:14.684285 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bb208e19-5837-4046-860e-e6a26bc64d51 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:58:14.684999 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bb208e19-5837-4046-860e-e6a26bc64d51 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:58:14.685464 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bb208e19-5837-4046-860e-e6a26bc64d51 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:58:14.685894 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bb208e19-5837-4046-860e-e6a26bc64d51 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:58:14.825206 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-bb208e19-5837-4046-860e-e6a26bc64d51 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:58:14.833478 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-bb208e19-5837-4046-860e-e6a26bc64d51 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/e5805281-9889-4ebd-95e4-4d41d79fabaa" status: 200 len: 1731 microversion: 2.1 time: 0.163839 Aug 10 23:58:14.834057 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3260/6727] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:58:14 2022] GET /compute/v2.1/servers/e5805281-9889-4ebd-95e4-4d41d79fabaa => generated 1731 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:58:15.855244 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-03806f90-f61c-43f1-b1b2-d529402594cc tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:58:15.855878 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-03806f90-f61c-43f1-b1b2-d529402594cc tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: e5805281-9889-4ebd-95e4-4d41d79fabaa] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:58:15.864030 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-03806f90-f61c-43f1-b1b2-d529402594cc tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:58:15.864566 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-03806f90-f61c-43f1-b1b2-d529402594cc tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:58:15.865025 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-03806f90-f61c-43f1-b1b2-d529402594cc tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:58:15.865797 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-03806f90-f61c-43f1-b1b2-d529402594cc tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:58:15.866272 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-03806f90-f61c-43f1-b1b2-d529402594cc tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:58:15.866716 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-03806f90-f61c-43f1-b1b2-d529402594cc tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:58:16.006001 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-03806f90-f61c-43f1-b1b2-d529402594cc tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:58:16.014119 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-03806f90-f61c-43f1-b1b2-d529402594cc tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/e5805281-9889-4ebd-95e4-4d41d79fabaa" status: 200 len: 1731 microversion: 2.1 time: 0.162906 Aug 10 23:58:16.014799 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3468/6728] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:58:15 2022] GET /compute/v2.1/servers/e5805281-9889-4ebd-95e4-4d41d79fabaa => generated 1731 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:58:17.035062 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-21f5827a-0793-49a2-9753-9bcc257e5d2e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:58:17.036321 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-21f5827a-0793-49a2-9753-9bcc257e5d2e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: e5805281-9889-4ebd-95e4-4d41d79fabaa] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:58:17.043177 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-21f5827a-0793-49a2-9753-9bcc257e5d2e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:58:17.043656 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-21f5827a-0793-49a2-9753-9bcc257e5d2e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:58:17.044091 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-21f5827a-0793-49a2-9753-9bcc257e5d2e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:58:17.044782 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-21f5827a-0793-49a2-9753-9bcc257e5d2e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:58:17.045231 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-21f5827a-0793-49a2-9753-9bcc257e5d2e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:58:17.046157 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-21f5827a-0793-49a2-9753-9bcc257e5d2e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:58:17.176978 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-21f5827a-0793-49a2-9753-9bcc257e5d2e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:58:17.184987 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-21f5827a-0793-49a2-9753-9bcc257e5d2e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/e5805281-9889-4ebd-95e4-4d41d79fabaa" status: 200 len: 1731 microversion: 2.1 time: 0.153930 Aug 10 23:58:17.185571 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3261/6729] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:58:17 2022] GET /compute/v2.1/servers/e5805281-9889-4ebd-95e4-4d41d79fabaa => generated 1731 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:58:18.208534 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-ee7a9b56-e05e-4d4c-b331-c9e7e837cd0f tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:58:18.209167 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-ee7a9b56-e05e-4d4c-b331-c9e7e837cd0f tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: e5805281-9889-4ebd-95e4-4d41d79fabaa] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:58:18.216627 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ee7a9b56-e05e-4d4c-b331-c9e7e837cd0f tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:58:18.217133 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ee7a9b56-e05e-4d4c-b331-c9e7e837cd0f tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:58:18.217953 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ee7a9b56-e05e-4d4c-b331-c9e7e837cd0f tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:58:18.218364 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ee7a9b56-e05e-4d4c-b331-c9e7e837cd0f tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:58:18.218860 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ee7a9b56-e05e-4d4c-b331-c9e7e837cd0f tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:58:18.219311 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ee7a9b56-e05e-4d4c-b331-c9e7e837cd0f tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:58:18.353782 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-ee7a9b56-e05e-4d4c-b331-c9e7e837cd0f tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:58:18.362531 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-ee7a9b56-e05e-4d4c-b331-c9e7e837cd0f tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/e5805281-9889-4ebd-95e4-4d41d79fabaa" status: 200 len: 1731 microversion: 2.1 time: 0.158490 Aug 10 23:58:18.363156 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3469/6730] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:58:18 2022] GET /compute/v2.1/servers/e5805281-9889-4ebd-95e4-4d41d79fabaa => generated 1731 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:58:19.386381 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-eb839323-a843-4e7b-b583-4dcbb6b4ec65 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:58:19.387037 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-eb839323-a843-4e7b-b583-4dcbb6b4ec65 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: e5805281-9889-4ebd-95e4-4d41d79fabaa] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:58:19.394576 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-eb839323-a843-4e7b-b583-4dcbb6b4ec65 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:58:19.395096 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-eb839323-a843-4e7b-b583-4dcbb6b4ec65 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:58:19.395542 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-eb839323-a843-4e7b-b583-4dcbb6b4ec65 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:58:19.396247 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-eb839323-a843-4e7b-b583-4dcbb6b4ec65 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:58:19.396708 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-eb839323-a843-4e7b-b583-4dcbb6b4ec65 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:58:19.397138 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-eb839323-a843-4e7b-b583-4dcbb6b4ec65 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:58:19.532877 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-eb839323-a843-4e7b-b583-4dcbb6b4ec65 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:58:19.541018 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-eb839323-a843-4e7b-b583-4dcbb6b4ec65 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/e5805281-9889-4ebd-95e4-4d41d79fabaa" status: 200 len: 1731 microversion: 2.1 time: 0.158623 Aug 10 23:58:19.541593 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3262/6731] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:58:19 2022] GET /compute/v2.1/servers/e5805281-9889-4ebd-95e4-4d41d79fabaa => generated 1731 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:58:20.562604 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-542c9efc-1025-4d55-b0f8-fe29a1bbadda tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:58:20.563534 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-542c9efc-1025-4d55-b0f8-fe29a1bbadda tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: e5805281-9889-4ebd-95e4-4d41d79fabaa] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:58:20.570404 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-542c9efc-1025-4d55-b0f8-fe29a1bbadda tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:58:20.570928 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-542c9efc-1025-4d55-b0f8-fe29a1bbadda tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:58:20.571381 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-542c9efc-1025-4d55-b0f8-fe29a1bbadda tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:58:20.572090 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-542c9efc-1025-4d55-b0f8-fe29a1bbadda tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:58:20.572555 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-542c9efc-1025-4d55-b0f8-fe29a1bbadda tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:58:20.572989 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-542c9efc-1025-4d55-b0f8-fe29a1bbadda tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:58:20.706455 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-542c9efc-1025-4d55-b0f8-fe29a1bbadda tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:58:20.714565 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-542c9efc-1025-4d55-b0f8-fe29a1bbadda tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/e5805281-9889-4ebd-95e4-4d41d79fabaa" status: 200 len: 1731 microversion: 2.1 time: 0.156435 Aug 10 23:58:20.715189 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3470/6732] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:58:20 2022] GET /compute/v2.1/servers/e5805281-9889-4ebd-95e4-4d41d79fabaa => generated 1731 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:58:21.736047 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c2b628ab-0134-4004-8f16-36823f136e77 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:58:21.736696 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-c2b628ab-0134-4004-8f16-36823f136e77 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: e5805281-9889-4ebd-95e4-4d41d79fabaa] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:58:21.743584 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c2b628ab-0134-4004-8f16-36823f136e77 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:58:21.744078 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c2b628ab-0134-4004-8f16-36823f136e77 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:58:21.744522 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c2b628ab-0134-4004-8f16-36823f136e77 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:58:21.745223 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c2b628ab-0134-4004-8f16-36823f136e77 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:58:21.745684 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c2b628ab-0134-4004-8f16-36823f136e77 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:58:21.746115 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c2b628ab-0134-4004-8f16-36823f136e77 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:58:21.882309 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-c2b628ab-0134-4004-8f16-36823f136e77 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:58:21.890407 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-c2b628ab-0134-4004-8f16-36823f136e77 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/e5805281-9889-4ebd-95e4-4d41d79fabaa" status: 200 len: 1731 microversion: 2.1 time: 0.158297 Aug 10 23:58:21.891031 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3263/6733] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:58:21 2022] GET /compute/v2.1/servers/e5805281-9889-4ebd-95e4-4d41d79fabaa => generated 1731 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:58:22.913070 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c8ee1ef1-bc08-45b3-9dbc-9f1a5d7e38b7 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:58:22.913703 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-c8ee1ef1-bc08-45b3-9dbc-9f1a5d7e38b7 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: e5805281-9889-4ebd-95e4-4d41d79fabaa] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:58:22.920568 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c8ee1ef1-bc08-45b3-9dbc-9f1a5d7e38b7 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:58:22.921063 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c8ee1ef1-bc08-45b3-9dbc-9f1a5d7e38b7 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:58:22.921516 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c8ee1ef1-bc08-45b3-9dbc-9f1a5d7e38b7 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:58:22.922223 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c8ee1ef1-bc08-45b3-9dbc-9f1a5d7e38b7 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:58:22.922699 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c8ee1ef1-bc08-45b3-9dbc-9f1a5d7e38b7 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:58:22.923166 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c8ee1ef1-bc08-45b3-9dbc-9f1a5d7e38b7 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:58:23.056368 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-c8ee1ef1-bc08-45b3-9dbc-9f1a5d7e38b7 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:58:23.064481 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-c8ee1ef1-bc08-45b3-9dbc-9f1a5d7e38b7 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/e5805281-9889-4ebd-95e4-4d41d79fabaa" status: 200 len: 1731 microversion: 2.1 time: 0.155377 Aug 10 23:58:23.065064 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3471/6734] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:58:22 2022] GET /compute/v2.1/servers/e5805281-9889-4ebd-95e4-4d41d79fabaa => generated 1731 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:58:24.085803 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-2253f102-0534-45bd-a701-3055c9d68268 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:58:24.086416 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-2253f102-0534-45bd-a701-3055c9d68268 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: e5805281-9889-4ebd-95e4-4d41d79fabaa] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:58:24.093246 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2253f102-0534-45bd-a701-3055c9d68268 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:58:24.093731 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2253f102-0534-45bd-a701-3055c9d68268 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:58:24.094168 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2253f102-0534-45bd-a701-3055c9d68268 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:58:24.095454 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2253f102-0534-45bd-a701-3055c9d68268 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:58:24.095941 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2253f102-0534-45bd-a701-3055c9d68268 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:58:24.096365 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2253f102-0534-45bd-a701-3055c9d68268 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:58:24.227218 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-2253f102-0534-45bd-a701-3055c9d68268 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:58:24.235197 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-2253f102-0534-45bd-a701-3055c9d68268 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/e5805281-9889-4ebd-95e4-4d41d79fabaa" status: 200 len: 1731 microversion: 2.1 time: 0.153316 Aug 10 23:58:24.236983 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3264/6735] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:58:24 2022] GET /compute/v2.1/servers/e5805281-9889-4ebd-95e4-4d41d79fabaa => generated 1731 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:58:25.258001 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-ee03166d-e08a-441d-99e0-86c3bc4bad91 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:58:25.258814 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-ee03166d-e08a-441d-99e0-86c3bc4bad91 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: e5805281-9889-4ebd-95e4-4d41d79fabaa] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:58:25.266245 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ee03166d-e08a-441d-99e0-86c3bc4bad91 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:58:25.266900 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ee03166d-e08a-441d-99e0-86c3bc4bad91 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:58:25.267368 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ee03166d-e08a-441d-99e0-86c3bc4bad91 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:58:25.268166 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ee03166d-e08a-441d-99e0-86c3bc4bad91 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:58:25.268674 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ee03166d-e08a-441d-99e0-86c3bc4bad91 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:58:25.269123 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ee03166d-e08a-441d-99e0-86c3bc4bad91 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:58:25.402061 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-ee03166d-e08a-441d-99e0-86c3bc4bad91 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:58:25.411165 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-ee03166d-e08a-441d-99e0-86c3bc4bad91 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/e5805281-9889-4ebd-95e4-4d41d79fabaa" status: 200 len: 1731 microversion: 2.1 time: 0.157081 Aug 10 23:58:25.411751 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3472/6736] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:58:25 2022] GET /compute/v2.1/servers/e5805281-9889-4ebd-95e4-4d41d79fabaa => generated 1731 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:58:26.433444 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-7f609e21-612b-4527-a759-2e3fdf51fad7 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:58:26.434079 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-7f609e21-612b-4527-a759-2e3fdf51fad7 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: e5805281-9889-4ebd-95e4-4d41d79fabaa] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:58:26.441693 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7f609e21-612b-4527-a759-2e3fdf51fad7 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:58:26.442181 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7f609e21-612b-4527-a759-2e3fdf51fad7 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:58:26.442620 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7f609e21-612b-4527-a759-2e3fdf51fad7 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:58:26.443349 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7f609e21-612b-4527-a759-2e3fdf51fad7 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:58:26.443806 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7f609e21-612b-4527-a759-2e3fdf51fad7 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:58:26.444233 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7f609e21-612b-4527-a759-2e3fdf51fad7 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:58:26.583977 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-7f609e21-612b-4527-a759-2e3fdf51fad7 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:58:26.592579 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-7f609e21-612b-4527-a759-2e3fdf51fad7 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/e5805281-9889-4ebd-95e4-4d41d79fabaa" status: 200 len: 1731 microversion: 2.1 time: 0.162968 Aug 10 23:58:26.593139 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3265/6737] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:58:26 2022] GET /compute/v2.1/servers/e5805281-9889-4ebd-95e4-4d41d79fabaa => generated 1731 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:58:27.614625 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-acc62cb5-a422-4de5-a6de-62574b579a5b tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:58:27.615275 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-acc62cb5-a422-4de5-a6de-62574b579a5b tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: e5805281-9889-4ebd-95e4-4d41d79fabaa] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:58:27.622283 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-acc62cb5-a422-4de5-a6de-62574b579a5b tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:58:27.622818 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-acc62cb5-a422-4de5-a6de-62574b579a5b tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:58:27.623279 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-acc62cb5-a422-4de5-a6de-62574b579a5b tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:58:27.624281 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-acc62cb5-a422-4de5-a6de-62574b579a5b tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:58:27.624753 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-acc62cb5-a422-4de5-a6de-62574b579a5b tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:58:27.625202 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-acc62cb5-a422-4de5-a6de-62574b579a5b tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:58:27.760282 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-acc62cb5-a422-4de5-a6de-62574b579a5b tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:58:27.768614 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-acc62cb5-a422-4de5-a6de-62574b579a5b tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/e5805281-9889-4ebd-95e4-4d41d79fabaa" status: 200 len: 1731 microversion: 2.1 time: 0.158699 Aug 10 23:58:27.769200 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3473/6738] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:58:27 2022] GET /compute/v2.1/servers/e5805281-9889-4ebd-95e4-4d41d79fabaa => generated 1731 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:58:28.791564 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-e76371e8-5cea-424d-904c-075c725604b3 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:58:28.792308 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-e76371e8-5cea-424d-904c-075c725604b3 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: e5805281-9889-4ebd-95e4-4d41d79fabaa] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:58:28.799405 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e76371e8-5cea-424d-904c-075c725604b3 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:58:28.799870 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e76371e8-5cea-424d-904c-075c725604b3 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:58:28.800300 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e76371e8-5cea-424d-904c-075c725604b3 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:58:28.801161 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e76371e8-5cea-424d-904c-075c725604b3 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:58:28.801608 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e76371e8-5cea-424d-904c-075c725604b3 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:58:28.802039 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e76371e8-5cea-424d-904c-075c725604b3 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:58:29.024137 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-e76371e8-5cea-424d-904c-075c725604b3 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:58:29.033520 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-e76371e8-5cea-424d-904c-075c725604b3 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/e5805281-9889-4ebd-95e4-4d41d79fabaa" status: 200 len: 1730 microversion: 2.1 time: 0.245089 Aug 10 23:58:29.034301 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3266/6739] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:58:28 2022] GET /compute/v2.1/servers/e5805281-9889-4ebd-95e4-4d41d79fabaa => generated 1730 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:58:29.084963 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-edd762af-727f-4074-b91c-fe811b258442 req-25447150-cc1d-46d2-b11d-8bd9358cfc62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5805281-9889-4ebd-95e4-4d41d79fabaa", "name": "network-vif-unplugged", "status": "completed", "tag": "90f240db-9fe1-4512-a9ef-32887891cfde"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:58:29.096520 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-edd762af-727f-4074-b91c-fe811b258442 req-25447150-cc1d-46d2-b11d-8bd9358cfc62 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:58:29.097022 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-edd762af-727f-4074-b91c-fe811b258442 req-25447150-cc1d-46d2-b11d-8bd9358cfc62 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:58:29.097471 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-edd762af-727f-4074-b91c-fe811b258442 req-25447150-cc1d-46d2-b11d-8bd9358cfc62 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:58:29.109464 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-edd762af-727f-4074-b91c-fe811b258442 req-25447150-cc1d-46d2-b11d-8bd9358cfc62 service nova] Creating event network-vif-unplugged:90f240db-9fe1-4512-a9ef-32887891cfde for instance e5805281-9889-4ebd-95e4-4d41d79fabaa on n-h2-850468-14 Aug 10 23:58:29.115314 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [req-edd762af-727f-4074-b91c-fe811b258442 req-25447150-cc1d-46d2-b11d-8bd9358cfc62 service nova] Instance e5805281-9889-4ebd-95e4-4d41d79fabaa is migrating within the same cell, copying events to all relevant hosts: {'n-h1-850468-14', 'n-h2-850468-14'} {{(pid=122633) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5901}} Aug 10 23:58:29.127534 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-edd762af-727f-4074-b91c-fe811b258442 req-25447150-cc1d-46d2-b11d-8bd9358cfc62 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046269 Aug 10 23:58:29.128146 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3474/6740] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:58:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:58:30.055979 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-ec690546-d4e9-42dc-982f-bf01814d196e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:58:30.056699 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-ec690546-d4e9-42dc-982f-bf01814d196e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: e5805281-9889-4ebd-95e4-4d41d79fabaa] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:58:30.063957 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ec690546-d4e9-42dc-982f-bf01814d196e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:58:30.064466 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ec690546-d4e9-42dc-982f-bf01814d196e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:58:30.064893 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ec690546-d4e9-42dc-982f-bf01814d196e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:58:30.065595 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ec690546-d4e9-42dc-982f-bf01814d196e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:58:30.066075 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ec690546-d4e9-42dc-982f-bf01814d196e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:58:30.066502 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ec690546-d4e9-42dc-982f-bf01814d196e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:58:30.206424 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-ec690546-d4e9-42dc-982f-bf01814d196e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:58:30.214441 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-ec690546-d4e9-42dc-982f-bf01814d196e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/e5805281-9889-4ebd-95e4-4d41d79fabaa" status: 200 len: 1730 microversion: 2.1 time: 0.162638 Aug 10 23:58:30.215048 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3267/6741] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:58:30 2022] GET /compute/v2.1/servers/e5805281-9889-4ebd-95e4-4d41d79fabaa => generated 1730 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:58:31.171012 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-378cbc3e-0575-4ff5-90a7-c20d46eeb3e6 req-00598412-964c-4ab1-bdcd-90fe14ebc3c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5805281-9889-4ebd-95e4-4d41d79fabaa", "tag": "90f240db-9fe1-4512-a9ef-32887891cfde"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:58:31.182198 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-378cbc3e-0575-4ff5-90a7-c20d46eeb3e6 req-00598412-964c-4ab1-bdcd-90fe14ebc3c5 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:58:31.182704 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-378cbc3e-0575-4ff5-90a7-c20d46eeb3e6 req-00598412-964c-4ab1-bdcd-90fe14ebc3c5 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:58:31.183183 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-378cbc3e-0575-4ff5-90a7-c20d46eeb3e6 req-00598412-964c-4ab1-bdcd-90fe14ebc3c5 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:58:31.198733 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-378cbc3e-0575-4ff5-90a7-c20d46eeb3e6 req-00598412-964c-4ab1-bdcd-90fe14ebc3c5 service nova] Creating event network-changed:90f240db-9fe1-4512-a9ef-32887891cfde for instance e5805281-9889-4ebd-95e4-4d41d79fabaa on n-h2-850468-14 Aug 10 23:58:31.204510 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [req-378cbc3e-0575-4ff5-90a7-c20d46eeb3e6 req-00598412-964c-4ab1-bdcd-90fe14ebc3c5 service nova] Instance e5805281-9889-4ebd-95e4-4d41d79fabaa is migrating within the same cell, copying events to all relevant hosts: {'n-h1-850468-14', 'n-h2-850468-14'} {{(pid=122633) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5901}} Aug 10 23:58:31.216484 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-378cbc3e-0575-4ff5-90a7-c20d46eeb3e6 req-00598412-964c-4ab1-bdcd-90fe14ebc3c5 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050593 Aug 10 23:58:31.217106 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3475/6742] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:58:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:58:31.237503 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-8b108655-9b15-4ecd-8a41-bf43c8e512db tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:58:31.238127 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-8b108655-9b15-4ecd-8a41-bf43c8e512db tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: e5805281-9889-4ebd-95e4-4d41d79fabaa] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:58:31.257161 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8b108655-9b15-4ecd-8a41-bf43c8e512db tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:58:31.257946 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8b108655-9b15-4ecd-8a41-bf43c8e512db tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:58:31.258564 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8b108655-9b15-4ecd-8a41-bf43c8e512db tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:58:31.259477 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8b108655-9b15-4ecd-8a41-bf43c8e512db tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:58:31.259950 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8b108655-9b15-4ecd-8a41-bf43c8e512db tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:58:31.260689 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8b108655-9b15-4ecd-8a41-bf43c8e512db tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:58:31.973291 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-8b108655-9b15-4ecd-8a41-bf43c8e512db tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:58:31.982574 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-8b108655-9b15-4ecd-8a41-bf43c8e512db tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/e5805281-9889-4ebd-95e4-4d41d79fabaa" status: 200 len: 1728 microversion: 2.1 time: 0.749455 Aug 10 23:58:31.983280 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3268/6743] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:58:31 2022] GET /compute/v2.1/servers/e5805281-9889-4ebd-95e4-4d41d79fabaa => generated 1728 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:58:33.006842 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-ff799913-ff11-4a3c-b4b3-938e1cba2d00 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:58:33.008272 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-ff799913-ff11-4a3c-b4b3-938e1cba2d00 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: e5805281-9889-4ebd-95e4-4d41d79fabaa] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:58:33.015707 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ff799913-ff11-4a3c-b4b3-938e1cba2d00 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:58:33.017593 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ff799913-ff11-4a3c-b4b3-938e1cba2d00 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:58:33.018133 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ff799913-ff11-4a3c-b4b3-938e1cba2d00 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:58:33.019165 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ff799913-ff11-4a3c-b4b3-938e1cba2d00 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:58:33.019853 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ff799913-ff11-4a3c-b4b3-938e1cba2d00 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:58:33.020362 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ff799913-ff11-4a3c-b4b3-938e1cba2d00 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:58:33.168930 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-ff799913-ff11-4a3c-b4b3-938e1cba2d00 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:58:33.179991 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-ff799913-ff11-4a3c-b4b3-938e1cba2d00 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/e5805281-9889-4ebd-95e4-4d41d79fabaa" status: 200 len: 1728 microversion: 2.1 time: 0.177349 Aug 10 23:58:33.195969 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3476/6744] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:58:33 2022] GET /compute/v2.1/servers/e5805281-9889-4ebd-95e4-4d41d79fabaa => generated 1728 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:58:34.202984 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-ebcf8ecf-f4cf-43b2-b5f4-8d39a2a91294 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:58:34.203651 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-ebcf8ecf-f4cf-43b2-b5f4-8d39a2a91294 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: e5805281-9889-4ebd-95e4-4d41d79fabaa] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:58:34.210873 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ebcf8ecf-f4cf-43b2-b5f4-8d39a2a91294 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:58:34.211375 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ebcf8ecf-f4cf-43b2-b5f4-8d39a2a91294 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:58:34.211791 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ebcf8ecf-f4cf-43b2-b5f4-8d39a2a91294 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:58:34.212482 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ebcf8ecf-f4cf-43b2-b5f4-8d39a2a91294 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:58:34.212948 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ebcf8ecf-f4cf-43b2-b5f4-8d39a2a91294 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:58:34.213355 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ebcf8ecf-f4cf-43b2-b5f4-8d39a2a91294 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:58:34.362034 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-ebcf8ecf-f4cf-43b2-b5f4-8d39a2a91294 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:58:34.370297 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-ebcf8ecf-f4cf-43b2-b5f4-8d39a2a91294 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/e5805281-9889-4ebd-95e4-4d41d79fabaa" status: 200 len: 1728 microversion: 2.1 time: 0.171262 Aug 10 23:58:34.370997 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3269/6745] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:58:34 2022] GET /compute/v2.1/servers/e5805281-9889-4ebd-95e4-4d41d79fabaa => generated 1728 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:58:35.393296 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-7f24eeb8-3c78-45b6-9555-477fe30ecd56 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:58:35.393924 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-7f24eeb8-3c78-45b6-9555-477fe30ecd56 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: e5805281-9889-4ebd-95e4-4d41d79fabaa] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:58:35.400772 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7f24eeb8-3c78-45b6-9555-477fe30ecd56 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:58:35.401267 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7f24eeb8-3c78-45b6-9555-477fe30ecd56 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:58:35.401721 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7f24eeb8-3c78-45b6-9555-477fe30ecd56 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:58:35.402436 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7f24eeb8-3c78-45b6-9555-477fe30ecd56 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:58:35.402944 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7f24eeb8-3c78-45b6-9555-477fe30ecd56 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:58:35.403389 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7f24eeb8-3c78-45b6-9555-477fe30ecd56 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:58:35.550173 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-7f24eeb8-3c78-45b6-9555-477fe30ecd56 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:58:35.558467 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-7f24eeb8-3c78-45b6-9555-477fe30ecd56 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/e5805281-9889-4ebd-95e4-4d41d79fabaa" status: 200 len: 1728 microversion: 2.1 time: 0.169530 Aug 10 23:58:35.559088 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3477/6746] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:58:35 2022] GET /compute/v2.1/servers/e5805281-9889-4ebd-95e4-4d41d79fabaa => generated 1728 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:58:36.581510 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-857f6b64-d54d-48fd-b68f-554ddde97eff tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:58:36.582113 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-857f6b64-d54d-48fd-b68f-554ddde97eff tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: e5805281-9889-4ebd-95e4-4d41d79fabaa] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:58:36.588876 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-857f6b64-d54d-48fd-b68f-554ddde97eff tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:58:36.589352 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-857f6b64-d54d-48fd-b68f-554ddde97eff tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:58:36.589782 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-857f6b64-d54d-48fd-b68f-554ddde97eff tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:58:36.590469 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-857f6b64-d54d-48fd-b68f-554ddde97eff tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:58:36.590939 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-857f6b64-d54d-48fd-b68f-554ddde97eff tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:58:36.591363 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-857f6b64-d54d-48fd-b68f-554ddde97eff tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:58:36.723905 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-857f6b64-d54d-48fd-b68f-554ddde97eff tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:58:36.732348 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-857f6b64-d54d-48fd-b68f-554ddde97eff tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/e5805281-9889-4ebd-95e4-4d41d79fabaa" status: 200 len: 1728 microversion: 2.1 time: 0.155826 Aug 10 23:58:36.732928 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3270/6747] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:58:36 2022] GET /compute/v2.1/servers/e5805281-9889-4ebd-95e4-4d41d79fabaa => generated 1728 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:58:37.754087 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-9fe1a9c7-da9b-49a6-b43a-edc63e03406b tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:58:37.754712 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-9fe1a9c7-da9b-49a6-b43a-edc63e03406b tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: e5805281-9889-4ebd-95e4-4d41d79fabaa] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:58:37.757647 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_api:SELECT=33 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:58:37.763116 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9fe1a9c7-da9b-49a6-b43a-edc63e03406b tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:58:37.763616 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9fe1a9c7-da9b-49a6-b43a-edc63e03406b tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:58:37.764070 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9fe1a9c7-da9b-49a6-b43a-edc63e03406b tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:58:37.764785 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9fe1a9c7-da9b-49a6-b43a-edc63e03406b tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:58:37.765257 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9fe1a9c7-da9b-49a6-b43a-edc63e03406b tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:58:37.765698 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9fe1a9c7-da9b-49a6-b43a-edc63e03406b tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:58:37.769124 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:58:37.900450 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-9fe1a9c7-da9b-49a6-b43a-edc63e03406b tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:58:37.909573 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-9fe1a9c7-da9b-49a6-b43a-edc63e03406b tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/e5805281-9889-4ebd-95e4-4d41d79fabaa" status: 200 len: 1728 microversion: 2.1 time: 0.159623 Aug 10 23:58:37.910163 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3478/6748] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:58:37 2022] GET /compute/v2.1/servers/e5805281-9889-4ebd-95e4-4d41d79fabaa => generated 1728 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:58:38.932129 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-9cf63d53-bdca-4d23-be1d-3503050aca6e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:58:38.932726 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-9cf63d53-bdca-4d23-be1d-3503050aca6e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: e5805281-9889-4ebd-95e4-4d41d79fabaa] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:58:38.935456 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_api:SELECT=29 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:58:38.940834 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9cf63d53-bdca-4d23-be1d-3503050aca6e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:58:38.941317 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9cf63d53-bdca-4d23-be1d-3503050aca6e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:58:38.941752 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9cf63d53-bdca-4d23-be1d-3503050aca6e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:58:38.942441 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9cf63d53-bdca-4d23-be1d-3503050aca6e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:58:38.942945 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9cf63d53-bdca-4d23-be1d-3503050aca6e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:58:38.943372 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9cf63d53-bdca-4d23-be1d-3503050aca6e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:58:38.946127 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=85 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:58:39.081235 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-9cf63d53-bdca-4d23-be1d-3503050aca6e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:58:39.089257 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-9cf63d53-bdca-4d23-be1d-3503050aca6e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/e5805281-9889-4ebd-95e4-4d41d79fabaa" status: 200 len: 1728 microversion: 2.1 time: 0.161062 Aug 10 23:58:39.089833 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3271/6749] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:58:38 2022] GET /compute/v2.1/servers/e5805281-9889-4ebd-95e4-4d41d79fabaa => generated 1728 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:58:40.112170 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-7fe1c6d4-cd98-4061-96e7-5af6b03adcc2 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:58:40.112819 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-7fe1c6d4-cd98-4061-96e7-5af6b03adcc2 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: e5805281-9889-4ebd-95e4-4d41d79fabaa] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:58:40.119781 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7fe1c6d4-cd98-4061-96e7-5af6b03adcc2 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:58:40.120281 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7fe1c6d4-cd98-4061-96e7-5af6b03adcc2 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:58:40.120741 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7fe1c6d4-cd98-4061-96e7-5af6b03adcc2 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:58:40.121453 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7fe1c6d4-cd98-4061-96e7-5af6b03adcc2 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:58:40.121929 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7fe1c6d4-cd98-4061-96e7-5af6b03adcc2 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:58:40.122372 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7fe1c6d4-cd98-4061-96e7-5af6b03adcc2 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:58:40.259309 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-7fe1c6d4-cd98-4061-96e7-5af6b03adcc2 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:58:40.267417 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-7fe1c6d4-cd98-4061-96e7-5af6b03adcc2 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/e5805281-9889-4ebd-95e4-4d41d79fabaa" status: 200 len: 1728 microversion: 2.1 time: 0.159868 Aug 10 23:58:40.268001 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3479/6750] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:58:40 2022] GET /compute/v2.1/servers/e5805281-9889-4ebd-95e4-4d41d79fabaa => generated 1728 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:58:41.289135 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-a884985a-36d6-41ae-9e1d-204c36b5fb6d tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:58:41.289776 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-a884985a-36d6-41ae-9e1d-204c36b5fb6d tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: e5805281-9889-4ebd-95e4-4d41d79fabaa] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:58:41.297167 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a884985a-36d6-41ae-9e1d-204c36b5fb6d tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:58:41.297682 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a884985a-36d6-41ae-9e1d-204c36b5fb6d tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:58:41.298127 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a884985a-36d6-41ae-9e1d-204c36b5fb6d tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:58:41.298839 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a884985a-36d6-41ae-9e1d-204c36b5fb6d tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:58:41.299323 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a884985a-36d6-41ae-9e1d-204c36b5fb6d tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:58:41.299749 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a884985a-36d6-41ae-9e1d-204c36b5fb6d tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:58:41.430950 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-a884985a-36d6-41ae-9e1d-204c36b5fb6d tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:58:41.439582 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-a884985a-36d6-41ae-9e1d-204c36b5fb6d tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/e5805281-9889-4ebd-95e4-4d41d79fabaa" status: 200 len: 1728 microversion: 2.1 time: 0.154325 Aug 10 23:58:41.440188 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3272/6751] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:58:41 2022] GET /compute/v2.1/servers/e5805281-9889-4ebd-95e4-4d41d79fabaa => generated 1728 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:58:42.461725 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-4ed97025-51fd-4f39-9c70-90ec2106dd31 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:58:42.462260 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-4ed97025-51fd-4f39-9c70-90ec2106dd31 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: e5805281-9889-4ebd-95e4-4d41d79fabaa] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:58:42.469177 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4ed97025-51fd-4f39-9c70-90ec2106dd31 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:58:42.470394 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4ed97025-51fd-4f39-9c70-90ec2106dd31 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:58:42.470911 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4ed97025-51fd-4f39-9c70-90ec2106dd31 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:58:42.471636 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4ed97025-51fd-4f39-9c70-90ec2106dd31 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:58:42.472114 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4ed97025-51fd-4f39-9c70-90ec2106dd31 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:58:42.472557 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4ed97025-51fd-4f39-9c70-90ec2106dd31 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:58:42.604350 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-4ed97025-51fd-4f39-9c70-90ec2106dd31 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:58:42.612609 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-4ed97025-51fd-4f39-9c70-90ec2106dd31 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/e5805281-9889-4ebd-95e4-4d41d79fabaa" status: 200 len: 1725 microversion: 2.1 time: 0.155003 Aug 10 23:58:42.613202 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3480/6752] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:58:42 2022] GET /compute/v2.1/servers/e5805281-9889-4ebd-95e4-4d41d79fabaa => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:58:42.634533 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-8f610891-0b13-4f9c-a7ec-b086b474ba62 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:58:42.635111 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-8f610891-0b13-4f9c-a7ec-b086b474ba62 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: e5805281-9889-4ebd-95e4-4d41d79fabaa] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:58:42.642836 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8f610891-0b13-4f9c-a7ec-b086b474ba62 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:58:42.643301 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8f610891-0b13-4f9c-a7ec-b086b474ba62 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:58:42.643743 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8f610891-0b13-4f9c-a7ec-b086b474ba62 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:58:42.644442 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8f610891-0b13-4f9c-a7ec-b086b474ba62 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:58:42.644902 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8f610891-0b13-4f9c-a7ec-b086b474ba62 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:58:42.645327 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8f610891-0b13-4f9c-a7ec-b086b474ba62 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:58:42.681886 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8f610891-0b13-4f9c-a7ec-b086b474ba62 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:58:42.682366 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8f610891-0b13-4f9c-a7ec-b086b474ba62 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:58:42.682822 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8f610891-0b13-4f9c-a7ec-b086b474ba62 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:58:42.683543 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8f610891-0b13-4f9c-a7ec-b086b474ba62 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:58:42.683996 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8f610891-0b13-4f9c-a7ec-b086b474ba62 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:58:42.684423 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8f610891-0b13-4f9c-a7ec-b086b474ba62 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:58:42.706182 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-8f610891-0b13-4f9c-a7ec-b086b474ba62 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Getting quotas for project 49e20a407dbc425ea488dee2995ebbe3. Resources: {'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:58:42.711323 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-8f610891-0b13-4f9c-a7ec-b086b474ba62 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Getting quotas for user 1412a4116dbb4412ba8ea10f72e2d95e and project 49e20a407dbc425ea488dee2995ebbe3. Resources: {'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:58:42.811184 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-8f610891-0b13-4f9c-a7ec-b086b474ba62 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "POST /compute/v2.1/servers/e5805281-9889-4ebd-95e4-4d41d79fabaa/action" status: 202 len: 0 microversion: 2.1 time: 0.180378 Aug 10 23:58:42.812055 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3273/6753] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:58:42 2022] POST /compute/v2.1/servers/e5805281-9889-4ebd-95e4-4d41d79fabaa/action => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 10 23:58:42.820856 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-65c9a1af-8d01-411c-9285-5000c68e8089 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:58:42.821489 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-65c9a1af-8d01-411c-9285-5000c68e8089 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: e5805281-9889-4ebd-95e4-4d41d79fabaa] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:58:42.827780 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-65c9a1af-8d01-411c-9285-5000c68e8089 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:58:42.828275 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-65c9a1af-8d01-411c-9285-5000c68e8089 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:58:42.828764 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-65c9a1af-8d01-411c-9285-5000c68e8089 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:58:42.830191 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-65c9a1af-8d01-411c-9285-5000c68e8089 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:58:42.830689 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-65c9a1af-8d01-411c-9285-5000c68e8089 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:58:42.831156 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-65c9a1af-8d01-411c-9285-5000c68e8089 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:58:42.971771 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-65c9a1af-8d01-411c-9285-5000c68e8089 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:58:42.979997 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-65c9a1af-8d01-411c-9285-5000c68e8089 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/e5805281-9889-4ebd-95e4-4d41d79fabaa" status: 200 len: 1724 microversion: 2.1 time: 0.163168 Aug 10 23:58:42.980583 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3481/6754] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:58:42 2022] GET /compute/v2.1/servers/e5805281-9889-4ebd-95e4-4d41d79fabaa => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:58:44.003745 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-7466d71c-e2a8-4c5d-9c55-d7509baa4a19 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:58:44.004453 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-7466d71c-e2a8-4c5d-9c55-d7509baa4a19 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: e5805281-9889-4ebd-95e4-4d41d79fabaa] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:58:44.011479 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7466d71c-e2a8-4c5d-9c55-d7509baa4a19 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:58:44.011962 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7466d71c-e2a8-4c5d-9c55-d7509baa4a19 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:58:44.012394 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7466d71c-e2a8-4c5d-9c55-d7509baa4a19 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:58:44.013084 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7466d71c-e2a8-4c5d-9c55-d7509baa4a19 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:58:44.013530 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7466d71c-e2a8-4c5d-9c55-d7509baa4a19 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:58:44.013954 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7466d71c-e2a8-4c5d-9c55-d7509baa4a19 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:58:44.146434 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-7466d71c-e2a8-4c5d-9c55-d7509baa4a19 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:58:44.154716 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-7466d71c-e2a8-4c5d-9c55-d7509baa4a19 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/e5805281-9889-4ebd-95e4-4d41d79fabaa" status: 200 len: 1724 microversion: 2.1 time: 0.156418 Aug 10 23:58:44.155489 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3274/6755] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:58:43 2022] GET /compute/v2.1/servers/e5805281-9889-4ebd-95e4-4d41d79fabaa => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:58:45.177161 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-361afce6-399b-477a-b558-5a89277ce56c tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:58:45.177792 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-361afce6-399b-477a-b558-5a89277ce56c tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: e5805281-9889-4ebd-95e4-4d41d79fabaa] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:58:45.184787 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-361afce6-399b-477a-b558-5a89277ce56c tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:58:45.185289 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-361afce6-399b-477a-b558-5a89277ce56c tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:58:45.185897 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-361afce6-399b-477a-b558-5a89277ce56c tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:58:45.186628 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-361afce6-399b-477a-b558-5a89277ce56c tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:58:45.187138 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-361afce6-399b-477a-b558-5a89277ce56c tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:58:45.187584 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-361afce6-399b-477a-b558-5a89277ce56c tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:58:45.329658 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-361afce6-399b-477a-b558-5a89277ce56c tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:58:45.338753 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-361afce6-399b-477a-b558-5a89277ce56c tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/e5805281-9889-4ebd-95e4-4d41d79fabaa" status: 200 len: 1724 microversion: 2.1 time: 0.166105 Aug 10 23:58:45.339772 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3482/6756] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:58:45 2022] GET /compute/v2.1/servers/e5805281-9889-4ebd-95e4-4d41d79fabaa => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:58:46.362803 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-cb1a253e-6631-42a8-ab17-991772c6ca5e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:58:46.363397 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-cb1a253e-6631-42a8-ab17-991772c6ca5e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: e5805281-9889-4ebd-95e4-4d41d79fabaa] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:58:46.370492 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cb1a253e-6631-42a8-ab17-991772c6ca5e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:58:46.371019 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cb1a253e-6631-42a8-ab17-991772c6ca5e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:58:46.371453 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cb1a253e-6631-42a8-ab17-991772c6ca5e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:58:46.372142 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cb1a253e-6631-42a8-ab17-991772c6ca5e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:58:46.372591 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cb1a253e-6631-42a8-ab17-991772c6ca5e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:58:46.373216 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cb1a253e-6631-42a8-ab17-991772c6ca5e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:58:46.516232 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-cb1a253e-6631-42a8-ab17-991772c6ca5e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:58:46.525434 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-cb1a253e-6631-42a8-ab17-991772c6ca5e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/e5805281-9889-4ebd-95e4-4d41d79fabaa" status: 200 len: 1724 microversion: 2.1 time: 0.167788 Aug 10 23:58:46.526163 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3275/6757] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:58:46 2022] GET /compute/v2.1/servers/e5805281-9889-4ebd-95e4-4d41d79fabaa => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:58:47.549793 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c6629bdf-bc53-4e67-a9a3-035b4afc1c92 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:58:47.550540 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-c6629bdf-bc53-4e67-a9a3-035b4afc1c92 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: e5805281-9889-4ebd-95e4-4d41d79fabaa] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:58:47.557473 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c6629bdf-bc53-4e67-a9a3-035b4afc1c92 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:58:47.557990 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c6629bdf-bc53-4e67-a9a3-035b4afc1c92 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:58:47.558435 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c6629bdf-bc53-4e67-a9a3-035b4afc1c92 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:58:47.559184 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c6629bdf-bc53-4e67-a9a3-035b4afc1c92 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:58:47.559659 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c6629bdf-bc53-4e67-a9a3-035b4afc1c92 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:58:47.560101 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c6629bdf-bc53-4e67-a9a3-035b4afc1c92 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:58:47.699633 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-c6629bdf-bc53-4e67-a9a3-035b4afc1c92 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:58:47.708881 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-c6629bdf-bc53-4e67-a9a3-035b4afc1c92 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/e5805281-9889-4ebd-95e4-4d41d79fabaa" status: 200 len: 1724 microversion: 2.1 time: 0.164694 Aug 10 23:58:47.709476 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3483/6758] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:58:47 2022] GET /compute/v2.1/servers/e5805281-9889-4ebd-95e4-4d41d79fabaa => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:58:48.520088 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-5aea9c49-925e-4b8e-ab35-17c735eb33e4 req-dd814380-d1e8-4a22-a1a1-cfbfae4819e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5805281-9889-4ebd-95e4-4d41d79fabaa", "tag": "90f240db-9fe1-4512-a9ef-32887891cfde"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:58:48.530702 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-5aea9c49-925e-4b8e-ab35-17c735eb33e4 req-dd814380-d1e8-4a22-a1a1-cfbfae4819e3 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:58:48.531218 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-5aea9c49-925e-4b8e-ab35-17c735eb33e4 req-dd814380-d1e8-4a22-a1a1-cfbfae4819e3 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:58:48.531660 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-5aea9c49-925e-4b8e-ab35-17c735eb33e4 req-dd814380-d1e8-4a22-a1a1-cfbfae4819e3 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:58:48.545254 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-5aea9c49-925e-4b8e-ab35-17c735eb33e4 req-dd814380-d1e8-4a22-a1a1-cfbfae4819e3 service nova] Creating event network-changed:90f240db-9fe1-4512-a9ef-32887891cfde for instance e5805281-9889-4ebd-95e4-4d41d79fabaa on n-h1-850468-14 Aug 10 23:58:48.551252 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [req-5aea9c49-925e-4b8e-ab35-17c735eb33e4 req-dd814380-d1e8-4a22-a1a1-cfbfae4819e3 service nova] Instance e5805281-9889-4ebd-95e4-4d41d79fabaa is migrating within the same cell, copying events to all relevant hosts: {'n-h1-850468-14', 'n-h2-850468-14'} {{(pid=122632) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5901}} Aug 10 23:58:48.562425 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-5aea9c49-925e-4b8e-ab35-17c735eb33e4 req-dd814380-d1e8-4a22-a1a1-cfbfae4819e3 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046749 Aug 10 23:58:48.563079 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3276/6759] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:58:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:58:48.598170 n-d-850468-14 devstack@n-api.service[122633]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 23:58:48.598672 n-d-850468-14 devstack@n-api.service[122633]: Wed Aug 10 23:58:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 23:58:48.730991 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-449d3c6b-1533-40c0-9576-12fe7a29f750 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:58:48.731710 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-449d3c6b-1533-40c0-9576-12fe7a29f750 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: e5805281-9889-4ebd-95e4-4d41d79fabaa] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:58:48.739057 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-449d3c6b-1533-40c0-9576-12fe7a29f750 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:58:48.739557 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-449d3c6b-1533-40c0-9576-12fe7a29f750 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:58:48.740009 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-449d3c6b-1533-40c0-9576-12fe7a29f750 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:58:48.740729 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-449d3c6b-1533-40c0-9576-12fe7a29f750 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:58:48.741195 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-449d3c6b-1533-40c0-9576-12fe7a29f750 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:58:48.741631 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-449d3c6b-1533-40c0-9576-12fe7a29f750 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:58:48.881659 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-449d3c6b-1533-40c0-9576-12fe7a29f750 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:58:48.890086 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-449d3c6b-1533-40c0-9576-12fe7a29f750 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/e5805281-9889-4ebd-95e4-4d41d79fabaa" status: 200 len: 1724 microversion: 2.1 time: 0.163067 Aug 10 23:58:48.890680 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3484/6760] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:58:48 2022] GET /compute/v2.1/servers/e5805281-9889-4ebd-95e4-4d41d79fabaa => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:58:49.288210 n-d-850468-14 devstack@n-api.service[122632]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 10 23:58:49.288414 n-d-850468-14 devstack@n-api.service[122632]: Wed Aug 10 23:58:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 10 23:58:49.914396 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-16357b92-45f6-4fd3-a2d2-3f776332e4b8 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:58:49.916597 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-16357b92-45f6-4fd3-a2d2-3f776332e4b8 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: e5805281-9889-4ebd-95e4-4d41d79fabaa] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:58:49.921234 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-16357b92-45f6-4fd3-a2d2-3f776332e4b8 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:58:49.921729 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-16357b92-45f6-4fd3-a2d2-3f776332e4b8 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:58:49.922174 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-16357b92-45f6-4fd3-a2d2-3f776332e4b8 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:58:49.922909 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-16357b92-45f6-4fd3-a2d2-3f776332e4b8 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:58:49.923379 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-16357b92-45f6-4fd3-a2d2-3f776332e4b8 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:58:49.924026 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-16357b92-45f6-4fd3-a2d2-3f776332e4b8 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:58:50.144319 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-16357b92-45f6-4fd3-a2d2-3f776332e4b8 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:58:50.153005 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-16357b92-45f6-4fd3-a2d2-3f776332e4b8 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/e5805281-9889-4ebd-95e4-4d41d79fabaa" status: 200 len: 1724 microversion: 2.1 time: 0.243564 Aug 10 23:58:50.153436 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3277/6761] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:58:49 2022] GET /compute/v2.1/servers/e5805281-9889-4ebd-95e4-4d41d79fabaa => generated 1724 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:58:51.175960 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-8450a4ff-e93c-4d82-b755-d47c0826a13e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:58:51.176531 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-8450a4ff-e93c-4d82-b755-d47c0826a13e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: e5805281-9889-4ebd-95e4-4d41d79fabaa] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:58:51.183581 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8450a4ff-e93c-4d82-b755-d47c0826a13e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:58:51.184086 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8450a4ff-e93c-4d82-b755-d47c0826a13e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:58:51.184544 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8450a4ff-e93c-4d82-b755-d47c0826a13e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:58:51.185264 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8450a4ff-e93c-4d82-b755-d47c0826a13e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:58:51.186174 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8450a4ff-e93c-4d82-b755-d47c0826a13e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:58:51.186174 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8450a4ff-e93c-4d82-b755-d47c0826a13e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:58:51.319916 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-8450a4ff-e93c-4d82-b755-d47c0826a13e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:58:51.328283 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-8450a4ff-e93c-4d82-b755-d47c0826a13e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/e5805281-9889-4ebd-95e4-4d41d79fabaa" status: 200 len: 1724 microversion: 2.1 time: 0.157150 Aug 10 23:58:51.329079 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3485/6762] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:58:51 2022] GET /compute/v2.1/servers/e5805281-9889-4ebd-95e4-4d41d79fabaa => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:58:52.350733 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-52baafdf-28ed-4dcc-a6da-a7c2d0e38f9f tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:58:52.351498 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-52baafdf-28ed-4dcc-a6da-a7c2d0e38f9f tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: e5805281-9889-4ebd-95e4-4d41d79fabaa] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:58:52.358348 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-52baafdf-28ed-4dcc-a6da-a7c2d0e38f9f tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:58:52.358863 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-52baafdf-28ed-4dcc-a6da-a7c2d0e38f9f tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:58:52.359298 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-52baafdf-28ed-4dcc-a6da-a7c2d0e38f9f tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:58:52.360014 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-52baafdf-28ed-4dcc-a6da-a7c2d0e38f9f tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:58:52.360461 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-52baafdf-28ed-4dcc-a6da-a7c2d0e38f9f tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:58:52.361620 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-52baafdf-28ed-4dcc-a6da-a7c2d0e38f9f tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:58:52.505581 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-52baafdf-28ed-4dcc-a6da-a7c2d0e38f9f tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:58:52.514259 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-52baafdf-28ed-4dcc-a6da-a7c2d0e38f9f tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/e5805281-9889-4ebd-95e4-4d41d79fabaa" status: 200 len: 1724 microversion: 2.1 time: 0.167744 Aug 10 23:58:52.527227 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3278/6763] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:58:52 2022] GET /compute/v2.1/servers/e5805281-9889-4ebd-95e4-4d41d79fabaa => generated 1724 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:58:53.536629 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-9f20f631-5206-46ca-b8a1-f77520f22598 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:58:53.537379 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-9f20f631-5206-46ca-b8a1-f77520f22598 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: e5805281-9889-4ebd-95e4-4d41d79fabaa] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:58:53.544581 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9f20f631-5206-46ca-b8a1-f77520f22598 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:58:53.545085 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9f20f631-5206-46ca-b8a1-f77520f22598 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:58:53.545544 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9f20f631-5206-46ca-b8a1-f77520f22598 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:58:53.546268 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9f20f631-5206-46ca-b8a1-f77520f22598 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:58:53.546774 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9f20f631-5206-46ca-b8a1-f77520f22598 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:58:53.547255 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9f20f631-5206-46ca-b8a1-f77520f22598 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:58:53.684216 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-9f20f631-5206-46ca-b8a1-f77520f22598 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:58:53.692535 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-9f20f631-5206-46ca-b8a1-f77520f22598 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/e5805281-9889-4ebd-95e4-4d41d79fabaa" status: 200 len: 1724 microversion: 2.1 time: 0.160545 Aug 10 23:58:53.693122 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3486/6764] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:58:53 2022] GET /compute/v2.1/servers/e5805281-9889-4ebd-95e4-4d41d79fabaa => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:58:54.714430 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-12f1e0b6-6645-41ec-8355-fcd36cde968b tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:58:54.715084 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-12f1e0b6-6645-41ec-8355-fcd36cde968b tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: e5805281-9889-4ebd-95e4-4d41d79fabaa] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:58:54.717029 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=3 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:58:54.723421 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-12f1e0b6-6645-41ec-8355-fcd36cde968b tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:58:54.723906 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-12f1e0b6-6645-41ec-8355-fcd36cde968b tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:58:54.724342 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-12f1e0b6-6645-41ec-8355-fcd36cde968b tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:58:54.725035 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-12f1e0b6-6645-41ec-8355-fcd36cde968b tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:58:54.725489 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-12f1e0b6-6645-41ec-8355-fcd36cde968b tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:58:54.725910 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-12f1e0b6-6645-41ec-8355-fcd36cde968b tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:58:54.863582 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-12f1e0b6-6645-41ec-8355-fcd36cde968b tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:58:54.871659 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-12f1e0b6-6645-41ec-8355-fcd36cde968b tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/e5805281-9889-4ebd-95e4-4d41d79fabaa" status: 200 len: 1724 microversion: 2.1 time: 0.161186 Aug 10 23:58:54.872227 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3279/6765] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:58:54 2022] GET /compute/v2.1/servers/e5805281-9889-4ebd-95e4-4d41d79fabaa => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:58:55.893590 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-3d8416e1-ac58-4559-a659-32c1bd814dab tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:58:55.894319 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-3d8416e1-ac58-4559-a659-32c1bd814dab tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: e5805281-9889-4ebd-95e4-4d41d79fabaa] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:58:55.901421 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3d8416e1-ac58-4559-a659-32c1bd814dab tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:58:55.901926 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3d8416e1-ac58-4559-a659-32c1bd814dab tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:58:55.902384 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3d8416e1-ac58-4559-a659-32c1bd814dab tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:58:55.903137 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3d8416e1-ac58-4559-a659-32c1bd814dab tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:58:55.903613 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3d8416e1-ac58-4559-a659-32c1bd814dab tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:58:55.904063 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3d8416e1-ac58-4559-a659-32c1bd814dab tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:58:56.046962 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-3d8416e1-ac58-4559-a659-32c1bd814dab tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:58:56.056076 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-3d8416e1-ac58-4559-a659-32c1bd814dab tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/e5805281-9889-4ebd-95e4-4d41d79fabaa" status: 200 len: 1724 microversion: 2.1 time: 0.166616 Aug 10 23:58:56.056675 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3487/6766] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:58:55 2022] GET /compute/v2.1/servers/e5805281-9889-4ebd-95e4-4d41d79fabaa => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:58:57.079080 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-f4c0bf85-201c-4815-896a-81a2b3285351 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:58:57.079695 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-f4c0bf85-201c-4815-896a-81a2b3285351 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: e5805281-9889-4ebd-95e4-4d41d79fabaa] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:58:57.086733 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f4c0bf85-201c-4815-896a-81a2b3285351 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:58:57.087249 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f4c0bf85-201c-4815-896a-81a2b3285351 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:58:57.087688 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f4c0bf85-201c-4815-896a-81a2b3285351 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:58:57.088380 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f4c0bf85-201c-4815-896a-81a2b3285351 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:58:57.088835 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f4c0bf85-201c-4815-896a-81a2b3285351 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:58:57.089263 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f4c0bf85-201c-4815-896a-81a2b3285351 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:58:57.264149 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-f4c0bf85-201c-4815-896a-81a2b3285351 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:58:57.272983 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-f4c0bf85-201c-4815-896a-81a2b3285351 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/e5805281-9889-4ebd-95e4-4d41d79fabaa" status: 200 len: 1724 microversion: 2.1 time: 0.197922 Aug 10 23:58:57.273553 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3280/6767] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:58:57 2022] GET /compute/v2.1/servers/e5805281-9889-4ebd-95e4-4d41d79fabaa => generated 1724 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:58:58.294190 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-bd1ee643-da60-4ed1-925a-768962cf0f08 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:58:58.294834 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-bd1ee643-da60-4ed1-925a-768962cf0f08 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: e5805281-9889-4ebd-95e4-4d41d79fabaa] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:58:58.302519 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bd1ee643-da60-4ed1-925a-768962cf0f08 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:58:58.303035 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bd1ee643-da60-4ed1-925a-768962cf0f08 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:58:58.303490 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bd1ee643-da60-4ed1-925a-768962cf0f08 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:58:58.304203 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bd1ee643-da60-4ed1-925a-768962cf0f08 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:58:58.304674 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bd1ee643-da60-4ed1-925a-768962cf0f08 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:58:58.305115 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bd1ee643-da60-4ed1-925a-768962cf0f08 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:58:58.480893 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-bd1ee643-da60-4ed1-925a-768962cf0f08 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:58:58.489656 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-bd1ee643-da60-4ed1-925a-768962cf0f08 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/e5805281-9889-4ebd-95e4-4d41d79fabaa" status: 200 len: 1724 microversion: 2.1 time: 0.199466 Aug 10 23:58:58.490243 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3488/6768] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:58:58 2022] GET /compute/v2.1/servers/e5805281-9889-4ebd-95e4-4d41d79fabaa => generated 1724 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:58:59.511412 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-6d10090c-25b5-4cee-ac2d-fd6c15950d4e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:58:59.512059 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-6d10090c-25b5-4cee-ac2d-fd6c15950d4e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: e5805281-9889-4ebd-95e4-4d41d79fabaa] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:58:59.519271 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6d10090c-25b5-4cee-ac2d-fd6c15950d4e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:58:59.519764 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6d10090c-25b5-4cee-ac2d-fd6c15950d4e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:58:59.520206 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6d10090c-25b5-4cee-ac2d-fd6c15950d4e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:58:59.520914 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6d10090c-25b5-4cee-ac2d-fd6c15950d4e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:58:59.521368 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6d10090c-25b5-4cee-ac2d-fd6c15950d4e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:58:59.521803 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6d10090c-25b5-4cee-ac2d-fd6c15950d4e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:58:59.659202 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-6d10090c-25b5-4cee-ac2d-fd6c15950d4e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:58:59.667433 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-6d10090c-25b5-4cee-ac2d-fd6c15950d4e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/e5805281-9889-4ebd-95e4-4d41d79fabaa" status: 200 len: 1724 microversion: 2.1 time: 0.159945 Aug 10 23:58:59.668009 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3281/6769] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:58:59 2022] GET /compute/v2.1/servers/e5805281-9889-4ebd-95e4-4d41d79fabaa => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:59:00.691084 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-4dfe8d37-eaa4-47b1-a09c-419cfe9d7409 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:59:00.692032 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-4dfe8d37-eaa4-47b1-a09c-419cfe9d7409 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: e5805281-9889-4ebd-95e4-4d41d79fabaa] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:59:00.699018 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4dfe8d37-eaa4-47b1-a09c-419cfe9d7409 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:59:00.699724 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4dfe8d37-eaa4-47b1-a09c-419cfe9d7409 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:59:00.700344 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4dfe8d37-eaa4-47b1-a09c-419cfe9d7409 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:59:00.701424 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4dfe8d37-eaa4-47b1-a09c-419cfe9d7409 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:59:00.702052 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4dfe8d37-eaa4-47b1-a09c-419cfe9d7409 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:59:00.702498 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4dfe8d37-eaa4-47b1-a09c-419cfe9d7409 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:59:00.844775 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-4dfe8d37-eaa4-47b1-a09c-419cfe9d7409 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:59:00.856447 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-4dfe8d37-eaa4-47b1-a09c-419cfe9d7409 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/e5805281-9889-4ebd-95e4-4d41d79fabaa" status: 200 len: 1724 microversion: 2.1 time: 0.170765 Aug 10 23:59:00.857501 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3489/6770] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:59:00 2022] GET /compute/v2.1/servers/e5805281-9889-4ebd-95e4-4d41d79fabaa => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:59:01.879780 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-5d0a0334-a881-4101-b372-bf5d84f10cd1 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:59:01.880430 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-5d0a0334-a881-4101-b372-bf5d84f10cd1 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: e5805281-9889-4ebd-95e4-4d41d79fabaa] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:59:01.887677 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5d0a0334-a881-4101-b372-bf5d84f10cd1 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:59:01.888291 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5d0a0334-a881-4101-b372-bf5d84f10cd1 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:59:01.888770 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5d0a0334-a881-4101-b372-bf5d84f10cd1 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:59:01.889478 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5d0a0334-a881-4101-b372-bf5d84f10cd1 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:59:01.889938 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5d0a0334-a881-4101-b372-bf5d84f10cd1 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:59:01.890370 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5d0a0334-a881-4101-b372-bf5d84f10cd1 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:59:02.021606 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-5d0a0334-a881-4101-b372-bf5d84f10cd1 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:59:02.029624 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-5d0a0334-a881-4101-b372-bf5d84f10cd1 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/e5805281-9889-4ebd-95e4-4d41d79fabaa" status: 200 len: 1717 microversion: 2.1 time: 0.154072 Aug 10 23:59:02.030191 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3282/6771] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:59:01 2022] GET /compute/v2.1/servers/e5805281-9889-4ebd-95e4-4d41d79fabaa => generated 1717 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:59:02.050553 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-3e5c579d-d7a1-4431-b7fd-97460ba0f83a tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:59:02.051303 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-3e5c579d-d7a1-4431-b7fd-97460ba0f83a tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: e5805281-9889-4ebd-95e4-4d41d79fabaa] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:59:02.058351 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3e5c579d-d7a1-4431-b7fd-97460ba0f83a tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:59:02.058888 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3e5c579d-d7a1-4431-b7fd-97460ba0f83a tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:59:02.059352 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3e5c579d-d7a1-4431-b7fd-97460ba0f83a tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:59:02.060232 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3e5c579d-d7a1-4431-b7fd-97460ba0f83a tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:59:02.060688 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3e5c579d-d7a1-4431-b7fd-97460ba0f83a tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:59:02.061137 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3e5c579d-d7a1-4431-b7fd-97460ba0f83a tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:59:02.192921 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-3e5c579d-d7a1-4431-b7fd-97460ba0f83a tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:59:02.200976 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-3e5c579d-d7a1-4431-b7fd-97460ba0f83a tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/e5805281-9889-4ebd-95e4-4d41d79fabaa" status: 200 len: 1717 microversion: 2.1 time: 0.154369 Aug 10 23:59:02.201565 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3490/6772] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:59:02 2022] GET /compute/v2.1/servers/e5805281-9889-4ebd-95e4-4d41d79fabaa => generated 1717 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:59:02.221653 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-93a0cce1-d788-4c05-8f9f-048ec603b216 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:59:02.222270 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-93a0cce1-d788-4c05-8f9f-048ec603b216 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: e5805281-9889-4ebd-95e4-4d41d79fabaa] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:59:02.228170 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-93a0cce1-d788-4c05-8f9f-048ec603b216 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:59:02.228649 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-93a0cce1-d788-4c05-8f9f-048ec603b216 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:59:02.229089 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-93a0cce1-d788-4c05-8f9f-048ec603b216 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:59:02.229810 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-93a0cce1-d788-4c05-8f9f-048ec603b216 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:59:02.230261 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-93a0cce1-d788-4c05-8f9f-048ec603b216 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:59:02.230686 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-93a0cce1-d788-4c05-8f9f-048ec603b216 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:59:02.363404 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-93a0cce1-d788-4c05-8f9f-048ec603b216 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:59:02.371615 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-93a0cce1-d788-4c05-8f9f-048ec603b216 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/e5805281-9889-4ebd-95e4-4d41d79fabaa" status: 200 len: 1717 microversion: 2.1 time: 0.153784 Aug 10 23:59:02.372196 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3283/6773] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:59:02 2022] GET /compute/v2.1/servers/e5805281-9889-4ebd-95e4-4d41d79fabaa => generated 1717 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:59:02.392968 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-4fc40725-eee4-49c9-9316-e5d5af957b95 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:59:02.393413 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-4fc40725-eee4-49c9-9316-e5d5af957b95 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: e5805281-9889-4ebd-95e4-4d41d79fabaa] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:59:02.399976 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4fc40725-eee4-49c9-9316-e5d5af957b95 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:59:02.400471 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4fc40725-eee4-49c9-9316-e5d5af957b95 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:59:02.400918 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4fc40725-eee4-49c9-9316-e5d5af957b95 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:59:02.401629 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4fc40725-eee4-49c9-9316-e5d5af957b95 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:59:02.402095 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4fc40725-eee4-49c9-9316-e5d5af957b95 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:59:02.402534 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4fc40725-eee4-49c9-9316-e5d5af957b95 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:59:02.429832 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-4fc40725-eee4-49c9-9316-e5d5af957b95 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: e5805281-9889-4ebd-95e4-4d41d79fabaa] Going to try to terminate instance {{(pid=122633) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:59:02.509116 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-4fc40725-eee4-49c9-9316-e5d5af957b95 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "DELETE /compute/v2.1/servers/e5805281-9889-4ebd-95e4-4d41d79fabaa" status: 204 len: 0 microversion: 2.1 time: 0.119790 Aug 10 23:59:02.509756 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3491/6774] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:59:02 2022] DELETE /compute/v2.1/servers/e5805281-9889-4ebd-95e4-4d41d79fabaa => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:59:02.519261 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-6e2a36e5-17f7-471d-8827-83743443cc44 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:59:02.520092 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-6e2a36e5-17f7-471d-8827-83743443cc44 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: e5805281-9889-4ebd-95e4-4d41d79fabaa] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:59:02.526315 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6e2a36e5-17f7-471d-8827-83743443cc44 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:59:02.526833 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6e2a36e5-17f7-471d-8827-83743443cc44 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:59:02.527283 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6e2a36e5-17f7-471d-8827-83743443cc44 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:59:02.527989 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6e2a36e5-17f7-471d-8827-83743443cc44 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:59:02.528449 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6e2a36e5-17f7-471d-8827-83743443cc44 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:59:02.528925 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6e2a36e5-17f7-471d-8827-83743443cc44 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:59:02.664771 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-6e2a36e5-17f7-471d-8827-83743443cc44 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:59:02.672985 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-6e2a36e5-17f7-471d-8827-83743443cc44 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/e5805281-9889-4ebd-95e4-4d41d79fabaa" status: 200 len: 1723 microversion: 2.1 time: 0.158811 Aug 10 23:59:02.673556 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3284/6775] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:59:02 2022] GET /compute/v2.1/servers/e5805281-9889-4ebd-95e4-4d41d79fabaa => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:59:03.696905 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-7c91742c-3343-42fa-a855-10721a095068 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:59:03.697616 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-7c91742c-3343-42fa-a855-10721a095068 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: e5805281-9889-4ebd-95e4-4d41d79fabaa] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:59:03.704716 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7c91742c-3343-42fa-a855-10721a095068 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:59:03.705480 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7c91742c-3343-42fa-a855-10721a095068 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:59:03.705659 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7c91742c-3343-42fa-a855-10721a095068 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:59:03.706373 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7c91742c-3343-42fa-a855-10721a095068 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:59:03.706898 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7c91742c-3343-42fa-a855-10721a095068 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:59:03.708237 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7c91742c-3343-42fa-a855-10721a095068 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:59:03.854229 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-7c91742c-3343-42fa-a855-10721a095068 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:59:03.863150 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-7c91742c-3343-42fa-a855-10721a095068 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/e5805281-9889-4ebd-95e4-4d41d79fabaa" status: 200 len: 1723 microversion: 2.1 time: 0.170691 Aug 10 23:59:03.863919 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3492/6776] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:59:03 2022] GET /compute/v2.1/servers/e5805281-9889-4ebd-95e4-4d41d79fabaa => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:59:04.845830 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-6eff58b9-03e4-4d23-a878-bc60d6e4e8c2 req-b4ac4a27-1a05-499c-a1d2-40881da38263 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5805281-9889-4ebd-95e4-4d41d79fabaa", "name": "network-vif-deleted", "tag": "90f240db-9fe1-4512-a9ef-32887891cfde"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:59:04.857718 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-6eff58b9-03e4-4d23-a878-bc60d6e4e8c2 req-b4ac4a27-1a05-499c-a1d2-40881da38263 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:59:04.858211 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-6eff58b9-03e4-4d23-a878-bc60d6e4e8c2 req-b4ac4a27-1a05-499c-a1d2-40881da38263 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:59:04.858627 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-6eff58b9-03e4-4d23-a878-bc60d6e4e8c2 req-b4ac4a27-1a05-499c-a1d2-40881da38263 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:59:04.869827 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:59:04.873111 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-6eff58b9-03e4-4d23-a878-bc60d6e4e8c2 req-b4ac4a27-1a05-499c-a1d2-40881da38263 service nova] Creating event network-vif-deleted:90f240db-9fe1-4512-a9ef-32887891cfde for instance e5805281-9889-4ebd-95e4-4d41d79fabaa on n-h1-850468-14 Aug 10 23:59:04.879276 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-6eff58b9-03e4-4d23-a878-bc60d6e4e8c2 req-b4ac4a27-1a05-499c-a1d2-40881da38263 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036911 Aug 10 23:59:04.880136 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3285/6777] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:59:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 23:59:04.887240 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-b309a2c5-761d-4d83-b1f4-04c3a9bc1358 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:59:04.888510 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-b309a2c5-761d-4d83-b1f4-04c3a9bc1358 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: e5805281-9889-4ebd-95e4-4d41d79fabaa] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:59:04.899623 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b309a2c5-761d-4d83-b1f4-04c3a9bc1358 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:59:04.900223 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b309a2c5-761d-4d83-b1f4-04c3a9bc1358 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:59:04.900766 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b309a2c5-761d-4d83-b1f4-04c3a9bc1358 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:59:04.901776 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b309a2c5-761d-4d83-b1f4-04c3a9bc1358 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:59:04.902252 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b309a2c5-761d-4d83-b1f4-04c3a9bc1358 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:59:04.902694 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b309a2c5-761d-4d83-b1f4-04c3a9bc1358 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:59:04.919568 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:59:04.975294 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-b309a2c5-761d-4d83-b1f4-04c3a9bc1358 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:59:04.983903 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-b309a2c5-761d-4d83-b1f4-04c3a9bc1358 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/e5805281-9889-4ebd-95e4-4d41d79fabaa" status: 200 len: 1370 microversion: 2.1 time: 0.101849 Aug 10 23:59:04.984484 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3493/6778] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:59:04 2022] GET /compute/v2.1/servers/e5805281-9889-4ebd-95e4-4d41d79fabaa => generated 1370 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:59:06.006402 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-9c5f82fe-60da-4f9b-affb-b1c9596c3bdb tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:59:06.007251 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-9c5f82fe-60da-4f9b-affb-b1c9596c3bdb tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: e5805281-9889-4ebd-95e4-4d41d79fabaa] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:59:06.014619 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9c5f82fe-60da-4f9b-affb-b1c9596c3bdb tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:59:06.015134 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9c5f82fe-60da-4f9b-affb-b1c9596c3bdb tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:59:06.015577 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9c5f82fe-60da-4f9b-affb-b1c9596c3bdb tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:59:06.016277 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9c5f82fe-60da-4f9b-affb-b1c9596c3bdb tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:59:06.016758 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9c5f82fe-60da-4f9b-affb-b1c9596c3bdb tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:59:06.017187 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9c5f82fe-60da-4f9b-affb-b1c9596c3bdb tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:59:06.086458 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-9c5f82fe-60da-4f9b-affb-b1c9596c3bdb tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:59:06.094650 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-9c5f82fe-60da-4f9b-affb-b1c9596c3bdb tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/e5805281-9889-4ebd-95e4-4d41d79fabaa" status: 200 len: 1370 microversion: 2.1 time: 0.093471 Aug 10 23:59:06.095253 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3286/6779] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:59:05 2022] GET /compute/v2.1/servers/e5805281-9889-4ebd-95e4-4d41d79fabaa => generated 1370 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:59:07.117152 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-d9e9dc62-b02a-428d-9b26-d8ad4078a431 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:59:07.117779 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-d9e9dc62-b02a-428d-9b26-d8ad4078a431 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: e5805281-9889-4ebd-95e4-4d41d79fabaa] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:59:07.125106 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d9e9dc62-b02a-428d-9b26-d8ad4078a431 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:59:07.125608 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d9e9dc62-b02a-428d-9b26-d8ad4078a431 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:59:07.126062 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d9e9dc62-b02a-428d-9b26-d8ad4078a431 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:59:07.126798 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d9e9dc62-b02a-428d-9b26-d8ad4078a431 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:59:07.127273 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d9e9dc62-b02a-428d-9b26-d8ad4078a431 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:59:07.127716 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d9e9dc62-b02a-428d-9b26-d8ad4078a431 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:59:07.193555 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-d9e9dc62-b02a-428d-9b26-d8ad4078a431 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:59:07.203393 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-d9e9dc62-b02a-428d-9b26-d8ad4078a431 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/e5805281-9889-4ebd-95e4-4d41d79fabaa" status: 200 len: 1370 microversion: 2.1 time: 0.090381 Aug 10 23:59:07.203994 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3494/6780] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:59:07 2022] GET /compute/v2.1/servers/e5805281-9889-4ebd-95e4-4d41d79fabaa => generated 1370 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:59:08.225395 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-8c63f15b-f3cf-453f-a327-d9551dff4e9f tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:59:08.226015 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-8c63f15b-f3cf-453f-a327-d9551dff4e9f tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: e5805281-9889-4ebd-95e4-4d41d79fabaa] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:59:08.232861 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8c63f15b-f3cf-453f-a327-d9551dff4e9f tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:59:08.233349 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8c63f15b-f3cf-453f-a327-d9551dff4e9f tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:59:08.233790 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8c63f15b-f3cf-453f-a327-d9551dff4e9f tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:59:08.234487 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8c63f15b-f3cf-453f-a327-d9551dff4e9f tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:59:08.234974 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8c63f15b-f3cf-453f-a327-d9551dff4e9f tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:59:08.235402 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8c63f15b-f3cf-453f-a327-d9551dff4e9f tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:59:08.299540 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-8c63f15b-f3cf-453f-a327-d9551dff4e9f tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:59:08.307697 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-8c63f15b-f3cf-453f-a327-d9551dff4e9f tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/e5805281-9889-4ebd-95e4-4d41d79fabaa" status: 200 len: 1370 microversion: 2.1 time: 0.086367 Aug 10 23:59:08.308275 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3287/6781] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:59:08 2022] GET /compute/v2.1/servers/e5805281-9889-4ebd-95e4-4d41d79fabaa => generated 1370 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:59:09.329737 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-ff62b260-f355-42d6-902b-dc005b08c9cd tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:59:09.330569 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-ff62b260-f355-42d6-902b-dc005b08c9cd tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: e5805281-9889-4ebd-95e4-4d41d79fabaa] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:59:09.334310 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:59:09.340957 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ff62b260-f355-42d6-902b-dc005b08c9cd tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:59:09.341475 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ff62b260-f355-42d6-902b-dc005b08c9cd tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:59:09.341943 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ff62b260-f355-42d6-902b-dc005b08c9cd tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:59:09.342713 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ff62b260-f355-42d6-902b-dc005b08c9cd tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:59:09.343296 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ff62b260-f355-42d6-902b-dc005b08c9cd tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:59:09.343771 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ff62b260-f355-42d6-902b-dc005b08c9cd tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:59:09.380562 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ff62b260-f355-42d6-902b-dc005b08c9cd tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:59:09.381064 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ff62b260-f355-42d6-902b-dc005b08c9cd tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:59:09.381528 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ff62b260-f355-42d6-902b-dc005b08c9cd tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:59:09.382054 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.objects.instance [None req-ff62b260-f355-42d6-902b-dc005b08c9cd tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lazy-loading 'fault' on Instance uuid e5805281-9889-4ebd-95e4-4d41d79fabaa {{(pid=122633) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:59:09.428228 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-ff62b260-f355-42d6-902b-dc005b08c9cd tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1412a4116dbb4412ba8ea10f72e2d95e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49e20a407dbc425ea488dee2995ebbe3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:59:09.435545 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-ff62b260-f355-42d6-902b-dc005b08c9cd tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/e5805281-9889-4ebd-95e4-4d41d79fabaa" status: 200 len: 1329 microversion: 2.1 time: 0.109730 Aug 10 23:59:09.444713 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3495/6782] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:59:09 2022] GET /compute/v2.1/servers/e5805281-9889-4ebd-95e4-4d41d79fabaa => generated 1329 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:59:10.466287 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-9d1f25fe-e1dc-4464-9abc-36a4ca8731d3 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:59:10.466849 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-9d1f25fe-e1dc-4464-9abc-36a4ca8731d3 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: e5805281-9889-4ebd-95e4-4d41d79fabaa] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:59:10.469835 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:59:10.475994 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9d1f25fe-e1dc-4464-9abc-36a4ca8731d3 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:59:10.476481 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9d1f25fe-e1dc-4464-9abc-36a4ca8731d3 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:59:10.476921 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9d1f25fe-e1dc-4464-9abc-36a4ca8731d3 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:59:10.477626 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9d1f25fe-e1dc-4464-9abc-36a4ca8731d3 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:59:10.478083 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9d1f25fe-e1dc-4464-9abc-36a4ca8731d3 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:59:10.478515 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9d1f25fe-e1dc-4464-9abc-36a4ca8731d3 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:59:10.494084 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-9d1f25fe-e1dc-4464-9abc-36a4ca8731d3 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] HTTP exception thrown: Instance e5805281-9889-4ebd-95e4-4d41d79fabaa could not be found. Aug 10 23:59:10.495760 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-9d1f25fe-e1dc-4464-9abc-36a4ca8731d3 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Request method failure captured: Aug 10 23:59:10.495760 n-d-850468-14 devstack@n-api.service[122632]: request: GET /compute/v2.1/servers/e5805281-9889-4ebd-95e4-4d41d79fabaa HTTP/1.1 Aug 10 23:59:10.495760 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:59:10.495760 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:59:10.495760 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:59:10.495760 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 23:59:10.495760 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:59:10.495760 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:59:10.495760 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:59:10.495760 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:59:10.495760 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9ETka_MLrOzNLl9fMo23yiaBVbwRsDIGTKuSE2U_QdPMsSc8GHIwU4exY0o7VQcTlL32LUR0TzTXBFYguNbPnJvl-Oq37igm94dUqjDcjI8p0o_T8FFxkqM-af8dhqzR4fbIp2j_qc7pazKLEDLMGgsyywPyJGsRgPDIuxnwDfxMZ8k Aug 10 23:59:10.495760 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:59:10.495760 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:59:10.495760 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:59:10.495760 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:59:10.495760 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:59:10.495760 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:59:10.495760 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 49e20a407dbc425ea488dee2995ebbe3 Aug 10 23:59:10.495760 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-ServerActionsTestJSON-1613214326 Aug 10 23:59:10.495760 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:59:10.495760 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:59:10.495760 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/49e20a407dbc425ea488dee2995ebbe3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/49e20a407dbc425ea488dee2995ebbe3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/49e20a407dbc425ea488dee2995ebbe3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_49e20a407dbc425ea488dee2995ebbe3", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:59:10.495760 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-ServerActionsTestJSON-1613214326 Aug 10 23:59:10.495760 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 49e20a407dbc425ea488dee2995ebbe3 Aug 10 23:59:10.495760 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-ServerActionsTestJSON-1613214326 Aug 10 23:59:10.495760 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-ServerActionsTestJSON-1613214326-project Aug 10 23:59:10.495760 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:59:10.495760 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:59:10.495760 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: 1412a4116dbb4412ba8ea10f72e2d95e Aug 10 23:59:10.495760 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-ServerActionsTestJSON-1613214326-project Aug 10 23:59:10.495760 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:59:10.495760 n-d-850468-14 devstack@n-api.service[122632]: exception: Instance e5805281-9889-4ebd-95e4-4d41d79fabaa could not be found. Aug 10 23:59:10.495760 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': 'e5805281-9889-4ebd-95e4-4d41d79fabaa'} Aug 10 23:59:10.495760 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:59:10.495760 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:59:10.495760 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:59:10.495760 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:59:10.495760 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:59:10.495760 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:59:10.495760 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:59:10.495760 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:59:10.495760 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:59:10.495760 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:59:10.495760 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5805281-9889-4ebd-95e4-4d41d79fabaa could not be found. Aug 10 23:59:10.495760 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:59:10.495760 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:59:10.495760 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:59:10.495760 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:59:10.495760 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:59:10.495760 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:59:10.495760 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:59:10.495760 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:59:10.495760 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:59:10.495760 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:59:10.495760 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:59:10.495760 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:59:10.495760 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:59:10.495760 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:59:10.495760 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:59:10.495760 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:59:10.495760 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5805281-9889-4ebd-95e4-4d41d79fabaa could not be found. Aug 10 23:59:10.495760 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:59:10.495760 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:59:10.495760 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:59:10.500449 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:59:10.500449 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:59:10.500449 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:59:10.500449 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:59:10.500449 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:59:10.500449 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5805281-9889-4ebd-95e4-4d41d79fabaa could not be found. Aug 10 23:59:10.500449 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:59:10.500449 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-9d1f25fe-e1dc-4464-9abc-36a4ca8731d3 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Returning 404 to user: Instance e5805281-9889-4ebd-95e4-4d41d79fabaa could not be found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:59:10.500449 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-9d1f25fe-e1dc-4464-9abc-36a4ca8731d3 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/e5805281-9889-4ebd-95e4-4d41d79fabaa" status: 404 len: 111 microversion: 2.1 time: 0.035014 Aug 10 23:59:10.500449 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3288/6783] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:59:10 2022] GET /compute/v2.1/servers/e5805281-9889-4ebd-95e4-4d41d79fabaa => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:59:10.558980 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-1fe8b8ee-6d29-440e-a5be-b6a8fa904927 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:59:10.561222 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-1fe8b8ee-6d29-440e-a5be-b6a8fa904927 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: e5805281-9889-4ebd-95e4-4d41d79fabaa] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:59:10.568201 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1fe8b8ee-6d29-440e-a5be-b6a8fa904927 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:59:10.568790 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1fe8b8ee-6d29-440e-a5be-b6a8fa904927 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:59:10.569249 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1fe8b8ee-6d29-440e-a5be-b6a8fa904927 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:59:10.569960 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1fe8b8ee-6d29-440e-a5be-b6a8fa904927 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:59:10.570428 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1fe8b8ee-6d29-440e-a5be-b6a8fa904927 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:59:10.570948 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1fe8b8ee-6d29-440e-a5be-b6a8fa904927 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:59:10.584214 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-1fe8b8ee-6d29-440e-a5be-b6a8fa904927 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] HTTP exception thrown: Instance e5805281-9889-4ebd-95e4-4d41d79fabaa could not be found. Aug 10 23:59:10.585919 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-1fe8b8ee-6d29-440e-a5be-b6a8fa904927 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Request method failure captured: Aug 10 23:59:10.585919 n-d-850468-14 devstack@n-api.service[122633]: request: GET /compute/v2.1/servers/e5805281-9889-4ebd-95e4-4d41d79fabaa/os-volume_attachments HTTP/1.1 Aug 10 23:59:10.585919 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:59:10.585919 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:59:10.585919 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:59:10.585919 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:59:10.585919 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:59:10.585919 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:59:10.585919 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:59:10.585919 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:59:10.585919 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9ETka_MLrOzNLl9fMo23yiaBVbwRsDIGTKuSE2U_QdPMsSc8GHIwU4exY0o7VQcTlL32LUR0TzTXBFYguNbPnJvl-Oq37igm94dUqjDcjI8p0o_T8FFxkqM-af8dhqzR4fbIp2j_qc7pazKLEDLMGgsyywPyJGsRgPDIuxnwDfxMZ8k Aug 10 23:59:10.585919 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:59:10.585919 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:59:10.585919 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:59:10.585919 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:59:10.585919 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:59:10.585919 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:59:10.585919 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 49e20a407dbc425ea488dee2995ebbe3 Aug 10 23:59:10.585919 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-ServerActionsTestJSON-1613214326 Aug 10 23:59:10.585919 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:59:10.585919 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:59:10.585919 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/49e20a407dbc425ea488dee2995ebbe3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/49e20a407dbc425ea488dee2995ebbe3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/49e20a407dbc425ea488dee2995ebbe3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_49e20a407dbc425ea488dee2995ebbe3", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:59:10.585919 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-ServerActionsTestJSON-1613214326 Aug 10 23:59:10.585919 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 49e20a407dbc425ea488dee2995ebbe3 Aug 10 23:59:10.585919 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-ServerActionsTestJSON-1613214326 Aug 10 23:59:10.585919 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-ServerActionsTestJSON-1613214326-project Aug 10 23:59:10.585919 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:59:10.585919 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:59:10.585919 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 1412a4116dbb4412ba8ea10f72e2d95e Aug 10 23:59:10.585919 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-ServerActionsTestJSON-1613214326-project Aug 10 23:59:10.585919 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:59:10.585919 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance e5805281-9889-4ebd-95e4-4d41d79fabaa could not be found. Aug 10 23:59:10.585919 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'server_id': 'e5805281-9889-4ebd-95e4-4d41d79fabaa'} Aug 10 23:59:10.585919 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:59:10.585919 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:59:10.585919 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:59:10.585919 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:59:10.585919 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:59:10.585919 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:59:10.585919 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:59:10.585919 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:59:10.585919 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:59:10.585919 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:59:10.585919 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5805281-9889-4ebd-95e4-4d41d79fabaa could not be found. Aug 10 23:59:10.585919 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:59:10.585919 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:59:10.585919 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:59:10.585919 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:59:10.585919 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:59:10.585919 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:59:10.585919 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:59:10.585919 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:59:10.585919 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:59:10.585919 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:59:10.585919 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 10 23:59:10.585919 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 23:59:10.585919 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 10 23:59:10.585919 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 23:59:10.585919 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 10 23:59:10.585919 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 10 23:59:10.585919 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:59:10.585919 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:59:10.590087 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5805281-9889-4ebd-95e4-4d41d79fabaa could not be found. Aug 10 23:59:10.590087 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:59:10.590087 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:59:10.590087 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:59:10.590087 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:59:10.590087 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:59:10.590087 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:59:10.590087 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:59:10.590087 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:59:10.590087 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5805281-9889-4ebd-95e4-4d41d79fabaa could not be found. Aug 10 23:59:10.590087 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:59:10.590087 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-1fe8b8ee-6d29-440e-a5be-b6a8fa904927 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Returning 404 to user: Instance e5805281-9889-4ebd-95e4-4d41d79fabaa could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:59:10.590087 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-1fe8b8ee-6d29-440e-a5be-b6a8fa904927 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/e5805281-9889-4ebd-95e4-4d41d79fabaa/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.032602 Aug 10 23:59:10.590087 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3496/6784] 10.222.0.58 () {58 vars in 1302 bytes} [Wed Aug 10 23:59:10 2022] GET /compute/v2.1/servers/e5805281-9889-4ebd-95e4-4d41d79fabaa/os-volume_attachments => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:59:13.911519 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-d57eb47e-2690-4f10-a26e-38260f7bf88f tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:59:13.912131 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-d57eb47e-2690-4f10-a26e-38260f7bf88f tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: e5805281-9889-4ebd-95e4-4d41d79fabaa] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:59:13.919134 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d57eb47e-2690-4f10-a26e-38260f7bf88f tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:59:13.919623 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d57eb47e-2690-4f10-a26e-38260f7bf88f tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:59:13.920060 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d57eb47e-2690-4f10-a26e-38260f7bf88f tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:59:13.920763 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d57eb47e-2690-4f10-a26e-38260f7bf88f tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:59:13.921222 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d57eb47e-2690-4f10-a26e-38260f7bf88f tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:59:13.921652 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d57eb47e-2690-4f10-a26e-38260f7bf88f tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:59:13.935767 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-d57eb47e-2690-4f10-a26e-38260f7bf88f tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] HTTP exception thrown: Instance e5805281-9889-4ebd-95e4-4d41d79fabaa could not be found. Aug 10 23:59:13.937364 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-d57eb47e-2690-4f10-a26e-38260f7bf88f tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Request method failure captured: Aug 10 23:59:13.937364 n-d-850468-14 devstack@n-api.service[122632]: request: DELETE /compute/v2.1/servers/e5805281-9889-4ebd-95e4-4d41d79fabaa HTTP/1.1 Aug 10 23:59:13.937364 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:59:13.937364 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:59:13.937364 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:59:13.937364 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 23:59:13.937364 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:59:13.937364 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:59:13.937364 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:59:13.937364 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:59:13.937364 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9ETka_MLrOzNLl9fMo23yiaBVbwRsDIGTKuSE2U_QdPMsSc8GHIwU4exY0o7VQcTlL32LUR0TzTXBFYguNbPnJvl-Oq37igm94dUqjDcjI8p0o_T8FFxkqM-af8dhqzR4fbIp2j_qc7pazKLEDLMGgsyywPyJGsRgPDIuxnwDfxMZ8k Aug 10 23:59:13.937364 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:59:13.937364 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:59:13.937364 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:59:13.937364 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:59:13.937364 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:59:13.937364 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:59:13.937364 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 49e20a407dbc425ea488dee2995ebbe3 Aug 10 23:59:13.937364 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-ServerActionsTestJSON-1613214326 Aug 10 23:59:13.937364 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:59:13.937364 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:59:13.937364 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/49e20a407dbc425ea488dee2995ebbe3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/49e20a407dbc425ea488dee2995ebbe3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/49e20a407dbc425ea488dee2995ebbe3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_49e20a407dbc425ea488dee2995ebbe3", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:59:13.937364 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-ServerActionsTestJSON-1613214326 Aug 10 23:59:13.937364 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 49e20a407dbc425ea488dee2995ebbe3 Aug 10 23:59:13.937364 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-ServerActionsTestJSON-1613214326 Aug 10 23:59:13.937364 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-ServerActionsTestJSON-1613214326-project Aug 10 23:59:13.937364 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:59:13.937364 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:59:13.937364 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: 1412a4116dbb4412ba8ea10f72e2d95e Aug 10 23:59:13.937364 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-ServerActionsTestJSON-1613214326-project Aug 10 23:59:13.937364 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:59:13.937364 n-d-850468-14 devstack@n-api.service[122632]: exception: Instance e5805281-9889-4ebd-95e4-4d41d79fabaa could not be found. Aug 10 23:59:13.937364 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': 'e5805281-9889-4ebd-95e4-4d41d79fabaa'} Aug 10 23:59:13.937364 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:59:13.937364 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:59:13.937364 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:59:13.937364 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:59:13.937364 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:59:13.937364 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:59:13.937364 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:59:13.937364 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:59:13.937364 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:59:13.937364 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:59:13.937364 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5805281-9889-4ebd-95e4-4d41d79fabaa could not be found. Aug 10 23:59:13.937364 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:59:13.937364 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:59:13.937364 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:59:13.937364 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:59:13.937364 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:59:13.937364 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:59:13.937364 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:59:13.937364 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:59:13.937364 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:59:13.937364 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:59:13.937364 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 23:59:13.937364 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 23:59:13.937364 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 23:59:13.937364 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 23:59:13.937364 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:59:13.937364 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:59:13.937364 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:59:13.937364 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:59:13.941161 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5805281-9889-4ebd-95e4-4d41d79fabaa could not be found. Aug 10 23:59:13.941161 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:59:13.941161 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:59:13.941161 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:59:13.941161 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:59:13.941161 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:59:13.941161 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:59:13.941161 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:59:13.941161 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:59:13.941161 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5805281-9889-4ebd-95e4-4d41d79fabaa could not be found. Aug 10 23:59:13.941161 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:59:13.941161 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-d57eb47e-2690-4f10-a26e-38260f7bf88f tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Returning 404 to user: Instance e5805281-9889-4ebd-95e4-4d41d79fabaa could not be found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:59:13.941161 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-d57eb47e-2690-4f10-a26e-38260f7bf88f tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "DELETE /compute/v2.1/servers/e5805281-9889-4ebd-95e4-4d41d79fabaa" status: 404 len: 111 microversion: 2.1 time: 0.031846 Aug 10 23:59:13.942699 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3289/6785] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:59:13 2022] DELETE /compute/v2.1/servers/e5805281-9889-4ebd-95e4-4d41d79fabaa => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:59:13.947817 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-3cd1ffbb-7de0-46ef-a1ea-1e3185674e7e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:59:13.948442 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-3cd1ffbb-7de0-46ef-a1ea-1e3185674e7e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: e5805281-9889-4ebd-95e4-4d41d79fabaa] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:59:13.955642 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3cd1ffbb-7de0-46ef-a1ea-1e3185674e7e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:59:13.956139 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3cd1ffbb-7de0-46ef-a1ea-1e3185674e7e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:59:13.957087 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3cd1ffbb-7de0-46ef-a1ea-1e3185674e7e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:59:13.958439 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3cd1ffbb-7de0-46ef-a1ea-1e3185674e7e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:59:13.958959 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3cd1ffbb-7de0-46ef-a1ea-1e3185674e7e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:59:13.959401 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3cd1ffbb-7de0-46ef-a1ea-1e3185674e7e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:59:13.974136 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-3cd1ffbb-7de0-46ef-a1ea-1e3185674e7e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] HTTP exception thrown: Instance e5805281-9889-4ebd-95e4-4d41d79fabaa could not be found. Aug 10 23:59:13.975761 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-3cd1ffbb-7de0-46ef-a1ea-1e3185674e7e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Request method failure captured: Aug 10 23:59:13.975761 n-d-850468-14 devstack@n-api.service[122633]: request: GET /compute/v2.1/servers/e5805281-9889-4ebd-95e4-4d41d79fabaa HTTP/1.1 Aug 10 23:59:13.975761 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:59:13.975761 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:59:13.975761 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:59:13.975761 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:59:13.975761 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:59:13.975761 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:59:13.975761 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:59:13.975761 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:59:13.975761 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9ETka_MLrOzNLl9fMo23yiaBVbwRsDIGTKuSE2U_QdPMsSc8GHIwU4exY0o7VQcTlL32LUR0TzTXBFYguNbPnJvl-Oq37igm94dUqjDcjI8p0o_T8FFxkqM-af8dhqzR4fbIp2j_qc7pazKLEDLMGgsyywPyJGsRgPDIuxnwDfxMZ8k Aug 10 23:59:13.975761 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:59:13.975761 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:59:13.975761 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:59:13.975761 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:59:13.975761 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:59:13.975761 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:59:13.975761 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 49e20a407dbc425ea488dee2995ebbe3 Aug 10 23:59:13.975761 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-ServerActionsTestJSON-1613214326 Aug 10 23:59:13.975761 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:59:13.975761 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:59:13.975761 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/49e20a407dbc425ea488dee2995ebbe3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/49e20a407dbc425ea488dee2995ebbe3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/49e20a407dbc425ea488dee2995ebbe3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_49e20a407dbc425ea488dee2995ebbe3", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:59:13.975761 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-ServerActionsTestJSON-1613214326 Aug 10 23:59:13.975761 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 49e20a407dbc425ea488dee2995ebbe3 Aug 10 23:59:13.975761 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-ServerActionsTestJSON-1613214326 Aug 10 23:59:13.975761 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-ServerActionsTestJSON-1613214326-project Aug 10 23:59:13.975761 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:59:13.975761 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:59:13.975761 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 1412a4116dbb4412ba8ea10f72e2d95e Aug 10 23:59:13.975761 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-ServerActionsTestJSON-1613214326-project Aug 10 23:59:13.975761 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:59:13.975761 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance e5805281-9889-4ebd-95e4-4d41d79fabaa could not be found. Aug 10 23:59:13.975761 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': 'e5805281-9889-4ebd-95e4-4d41d79fabaa'} Aug 10 23:59:13.975761 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:59:13.975761 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:59:13.975761 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:59:13.975761 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:59:13.975761 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:59:13.975761 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:59:13.975761 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:59:13.975761 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:59:13.975761 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:59:13.975761 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:59:13.975761 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5805281-9889-4ebd-95e4-4d41d79fabaa could not be found. Aug 10 23:59:13.975761 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:59:13.975761 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:59:13.975761 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:59:13.975761 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:59:13.975761 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:59:13.975761 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:59:13.975761 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:59:13.975761 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:59:13.975761 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:59:13.975761 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:59:13.975761 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:59:13.975761 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:59:13.975761 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:59:13.975761 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:59:13.975761 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:59:13.975761 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:59:13.975761 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5805281-9889-4ebd-95e4-4d41d79fabaa could not be found. Aug 10 23:59:13.975761 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:59:13.975761 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:59:13.975761 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:59:13.979269 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:59:13.979269 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:59:13.979269 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:59:13.979269 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:59:13.979269 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:59:13.979269 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5805281-9889-4ebd-95e4-4d41d79fabaa could not be found. Aug 10 23:59:13.979269 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:59:13.979269 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-3cd1ffbb-7de0-46ef-a1ea-1e3185674e7e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Returning 404 to user: Instance e5805281-9889-4ebd-95e4-4d41d79fabaa could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:59:13.979269 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-3cd1ffbb-7de0-46ef-a1ea-1e3185674e7e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/e5805281-9889-4ebd-95e4-4d41d79fabaa" status: 404 len: 111 microversion: 2.1 time: 0.033383 Aug 10 23:59:13.979269 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3497/6786] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:59:13 2022] GET /compute/v2.1/servers/e5805281-9889-4ebd-95e4-4d41d79fabaa => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:59:13.985929 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-193a5514-58a7-4a00-8ba0-59c7fd7386fa tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:59:13.986466 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-193a5514-58a7-4a00-8ba0-59c7fd7386fa tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:59:13.992764 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-193a5514-58a7-4a00-8ba0-59c7fd7386fa tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:59:13.993255 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-193a5514-58a7-4a00-8ba0-59c7fd7386fa tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:59:13.993701 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-193a5514-58a7-4a00-8ba0-59c7fd7386fa tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:59:13.994402 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-193a5514-58a7-4a00-8ba0-59c7fd7386fa tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:59:13.994887 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-193a5514-58a7-4a00-8ba0-59c7fd7386fa tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:59:13.995319 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-193a5514-58a7-4a00-8ba0-59c7fd7386fa tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:59:14.011559 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-193a5514-58a7-4a00-8ba0-59c7fd7386fa tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] HTTP exception thrown: Instance e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0 could not be found. Aug 10 23:59:14.013122 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-193a5514-58a7-4a00-8ba0-59c7fd7386fa tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Request method failure captured: Aug 10 23:59:14.013122 n-d-850468-14 devstack@n-api.service[122632]: request: DELETE /compute/v2.1/servers/e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0 HTTP/1.1 Aug 10 23:59:14.013122 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:59:14.013122 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:59:14.013122 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:59:14.013122 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 23:59:14.013122 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:59:14.013122 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:59:14.013122 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:59:14.013122 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:59:14.013122 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9ETka_MLrOzNLl9fMo23yiaBVbwRsDIGTKuSE2U_QdPMsSc8GHIwU4exY0o7VQcTlL32LUR0TzTXBFYguNbPnJvl-Oq37igm94dUqjDcjI8p0o_T8FFxkqM-af8dhqzR4fbIp2j_qc7pazKLEDLMGgsyywPyJGsRgPDIuxnwDfxMZ8k Aug 10 23:59:14.013122 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:59:14.013122 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:59:14.013122 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:59:14.013122 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:59:14.013122 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:59:14.013122 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:59:14.013122 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 49e20a407dbc425ea488dee2995ebbe3 Aug 10 23:59:14.013122 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-ServerActionsTestJSON-1613214326 Aug 10 23:59:14.013122 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:59:14.013122 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:59:14.013122 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/49e20a407dbc425ea488dee2995ebbe3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/49e20a407dbc425ea488dee2995ebbe3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/49e20a407dbc425ea488dee2995ebbe3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_49e20a407dbc425ea488dee2995ebbe3", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:59:14.013122 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-ServerActionsTestJSON-1613214326 Aug 10 23:59:14.013122 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 49e20a407dbc425ea488dee2995ebbe3 Aug 10 23:59:14.013122 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-ServerActionsTestJSON-1613214326 Aug 10 23:59:14.013122 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-ServerActionsTestJSON-1613214326-project Aug 10 23:59:14.013122 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:59:14.013122 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:59:14.013122 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: 1412a4116dbb4412ba8ea10f72e2d95e Aug 10 23:59:14.013122 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-ServerActionsTestJSON-1613214326-project Aug 10 23:59:14.013122 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:59:14.013122 n-d-850468-14 devstack@n-api.service[122632]: exception: Instance e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0 could not be found. Aug 10 23:59:14.013122 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': 'e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0'} Aug 10 23:59:14.013122 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:59:14.013122 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:59:14.013122 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:59:14.013122 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:59:14.013122 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:59:14.013122 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:59:14.013122 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:59:14.013122 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:59:14.013122 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:59:14.013122 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:59:14.013122 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0 could not be found. Aug 10 23:59:14.013122 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:59:14.013122 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:59:14.013122 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:59:14.013122 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:59:14.013122 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:59:14.013122 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:59:14.013122 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:59:14.013122 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:59:14.013122 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:59:14.013122 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:59:14.013122 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 23:59:14.013122 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 23:59:14.013122 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 23:59:14.013122 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 23:59:14.013122 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:59:14.013122 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:59:14.013122 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:59:14.013122 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:59:14.017403 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0 could not be found. Aug 10 23:59:14.017403 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:59:14.017403 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:59:14.017403 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:59:14.017403 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:59:14.017403 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:59:14.017403 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:59:14.017403 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:59:14.017403 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:59:14.017403 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0 could not be found. Aug 10 23:59:14.017403 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:59:14.017403 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-193a5514-58a7-4a00-8ba0-59c7fd7386fa tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Returning 404 to user: Instance e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0 could not be found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:59:14.017403 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-193a5514-58a7-4a00-8ba0-59c7fd7386fa tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "DELETE /compute/v2.1/servers/e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0" status: 404 len: 111 microversion: 2.1 time: 0.032545 Aug 10 23:59:14.017403 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3290/6787] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:59:13 2022] DELETE /compute/v2.1/servers/e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:59:14.024791 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-22af66fc-bcb3-4946-a3a4-6f69a4f9b278 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:59:14.025428 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-22af66fc-bcb3-4946-a3a4-6f69a4f9b278 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:59:14.031653 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-22af66fc-bcb3-4946-a3a4-6f69a4f9b278 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:59:14.032166 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-22af66fc-bcb3-4946-a3a4-6f69a4f9b278 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:59:14.032629 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-22af66fc-bcb3-4946-a3a4-6f69a4f9b278 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:59:14.033370 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-22af66fc-bcb3-4946-a3a4-6f69a4f9b278 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:59:14.033847 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-22af66fc-bcb3-4946-a3a4-6f69a4f9b278 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:59:14.034295 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-22af66fc-bcb3-4946-a3a4-6f69a4f9b278 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:59:14.050144 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-22af66fc-bcb3-4946-a3a4-6f69a4f9b278 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] HTTP exception thrown: Instance e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0 could not be found. Aug 10 23:59:14.052109 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-22af66fc-bcb3-4946-a3a4-6f69a4f9b278 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Request method failure captured: Aug 10 23:59:14.052109 n-d-850468-14 devstack@n-api.service[122633]: request: GET /compute/v2.1/servers/e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0 HTTP/1.1 Aug 10 23:59:14.052109 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:59:14.052109 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:59:14.052109 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:59:14.052109 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:59:14.052109 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:59:14.052109 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:59:14.052109 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:59:14.052109 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:59:14.052109 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9ETka_MLrOzNLl9fMo23yiaBVbwRsDIGTKuSE2U_QdPMsSc8GHIwU4exY0o7VQcTlL32LUR0TzTXBFYguNbPnJvl-Oq37igm94dUqjDcjI8p0o_T8FFxkqM-af8dhqzR4fbIp2j_qc7pazKLEDLMGgsyywPyJGsRgPDIuxnwDfxMZ8k Aug 10 23:59:14.052109 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:59:14.052109 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:59:14.052109 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:59:14.052109 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:59:14.052109 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:59:14.052109 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:59:14.052109 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 49e20a407dbc425ea488dee2995ebbe3 Aug 10 23:59:14.052109 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-ServerActionsTestJSON-1613214326 Aug 10 23:59:14.052109 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:59:14.052109 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:59:14.052109 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/49e20a407dbc425ea488dee2995ebbe3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/49e20a407dbc425ea488dee2995ebbe3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/49e20a407dbc425ea488dee2995ebbe3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_49e20a407dbc425ea488dee2995ebbe3", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:59:14.052109 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-ServerActionsTestJSON-1613214326 Aug 10 23:59:14.052109 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 49e20a407dbc425ea488dee2995ebbe3 Aug 10 23:59:14.052109 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-ServerActionsTestJSON-1613214326 Aug 10 23:59:14.052109 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-ServerActionsTestJSON-1613214326-project Aug 10 23:59:14.052109 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:59:14.052109 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:59:14.052109 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 1412a4116dbb4412ba8ea10f72e2d95e Aug 10 23:59:14.052109 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-ServerActionsTestJSON-1613214326-project Aug 10 23:59:14.052109 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:59:14.052109 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0 could not be found. Aug 10 23:59:14.052109 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': 'e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0'} Aug 10 23:59:14.052109 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:59:14.052109 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:59:14.052109 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:59:14.052109 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:59:14.052109 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:59:14.052109 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:59:14.052109 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:59:14.052109 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:59:14.052109 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:59:14.052109 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:59:14.052109 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0 could not be found. Aug 10 23:59:14.052109 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:59:14.052109 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:59:14.052109 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:59:14.052109 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:59:14.052109 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:59:14.052109 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:59:14.052109 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:59:14.052109 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:59:14.052109 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:59:14.052109 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:59:14.052109 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:59:14.052109 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:59:14.052109 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:59:14.052109 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:59:14.052109 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:59:14.052109 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:59:14.052109 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0 could not be found. Aug 10 23:59:14.052109 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:59:14.052109 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:59:14.052109 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:59:14.055679 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:59:14.055679 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:59:14.055679 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:59:14.055679 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:59:14.055679 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:59:14.055679 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0 could not be found. Aug 10 23:59:14.055679 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:59:14.055679 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-22af66fc-bcb3-4946-a3a4-6f69a4f9b278 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Returning 404 to user: Instance e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0 could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:59:14.055679 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-22af66fc-bcb3-4946-a3a4-6f69a4f9b278 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0" status: 404 len: 111 microversion: 2.1 time: 0.032734 Aug 10 23:59:14.055679 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3498/6788] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:59:14 2022] GET /compute/v2.1/servers/e078e7b1-14f3-4bd3-ae6a-a61c3123c8d0 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:59:14.062815 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-94ed4f62-e74c-4e1d-9c80-3849a7f6803e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:59:14.063323 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-94ed4f62-e74c-4e1d-9c80-3849a7f6803e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: 3bb88b55-aac8-4559-8729-6dbeab0b4f45] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:59:14.070722 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-94ed4f62-e74c-4e1d-9c80-3849a7f6803e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:59:14.071182 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-94ed4f62-e74c-4e1d-9c80-3849a7f6803e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:59:14.071630 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-94ed4f62-e74c-4e1d-9c80-3849a7f6803e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:59:14.072347 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-94ed4f62-e74c-4e1d-9c80-3849a7f6803e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:59:14.072810 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-94ed4f62-e74c-4e1d-9c80-3849a7f6803e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:59:14.073241 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-94ed4f62-e74c-4e1d-9c80-3849a7f6803e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:59:14.089230 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-94ed4f62-e74c-4e1d-9c80-3849a7f6803e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] HTTP exception thrown: Instance 3bb88b55-aac8-4559-8729-6dbeab0b4f45 could not be found. Aug 10 23:59:14.090854 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-94ed4f62-e74c-4e1d-9c80-3849a7f6803e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Request method failure captured: Aug 10 23:59:14.090854 n-d-850468-14 devstack@n-api.service[122632]: request: DELETE /compute/v2.1/servers/3bb88b55-aac8-4559-8729-6dbeab0b4f45 HTTP/1.1 Aug 10 23:59:14.090854 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:59:14.090854 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:59:14.090854 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:59:14.090854 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 23:59:14.090854 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:59:14.090854 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:59:14.090854 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:59:14.090854 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:59:14.090854 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9ETka_MLrOzNLl9fMo23yiaBVbwRsDIGTKuSE2U_QdPMsSc8GHIwU4exY0o7VQcTlL32LUR0TzTXBFYguNbPnJvl-Oq37igm94dUqjDcjI8p0o_T8FFxkqM-af8dhqzR4fbIp2j_qc7pazKLEDLMGgsyywPyJGsRgPDIuxnwDfxMZ8k Aug 10 23:59:14.090854 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:59:14.090854 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:59:14.090854 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:59:14.090854 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:59:14.090854 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:59:14.090854 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:59:14.090854 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 49e20a407dbc425ea488dee2995ebbe3 Aug 10 23:59:14.090854 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-ServerActionsTestJSON-1613214326 Aug 10 23:59:14.090854 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:59:14.090854 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:59:14.090854 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/49e20a407dbc425ea488dee2995ebbe3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/49e20a407dbc425ea488dee2995ebbe3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/49e20a407dbc425ea488dee2995ebbe3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_49e20a407dbc425ea488dee2995ebbe3", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:59:14.090854 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-ServerActionsTestJSON-1613214326 Aug 10 23:59:14.090854 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 49e20a407dbc425ea488dee2995ebbe3 Aug 10 23:59:14.090854 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-ServerActionsTestJSON-1613214326 Aug 10 23:59:14.090854 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-ServerActionsTestJSON-1613214326-project Aug 10 23:59:14.090854 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:59:14.090854 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:59:14.090854 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: 1412a4116dbb4412ba8ea10f72e2d95e Aug 10 23:59:14.090854 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-ServerActionsTestJSON-1613214326-project Aug 10 23:59:14.090854 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:59:14.090854 n-d-850468-14 devstack@n-api.service[122632]: exception: Instance 3bb88b55-aac8-4559-8729-6dbeab0b4f45 could not be found. Aug 10 23:59:14.090854 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': '3bb88b55-aac8-4559-8729-6dbeab0b4f45'} Aug 10 23:59:14.090854 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:59:14.090854 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:59:14.090854 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:59:14.090854 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:59:14.090854 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:59:14.090854 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:59:14.090854 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:59:14.090854 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:59:14.090854 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:59:14.090854 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:59:14.090854 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3bb88b55-aac8-4559-8729-6dbeab0b4f45 could not be found. Aug 10 23:59:14.090854 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:59:14.090854 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:59:14.090854 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:59:14.090854 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:59:14.090854 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:59:14.090854 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:59:14.090854 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:59:14.090854 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:59:14.090854 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:59:14.090854 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:59:14.090854 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 23:59:14.090854 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 23:59:14.090854 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 23:59:14.090854 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 23:59:14.090854 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:59:14.090854 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:59:14.090854 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:59:14.090854 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:59:14.094777 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3bb88b55-aac8-4559-8729-6dbeab0b4f45 could not be found. Aug 10 23:59:14.094777 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:59:14.094777 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:59:14.094777 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:59:14.094777 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:59:14.094777 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:59:14.094777 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:59:14.094777 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:59:14.094777 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:59:14.094777 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3bb88b55-aac8-4559-8729-6dbeab0b4f45 could not be found. Aug 10 23:59:14.094777 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:59:14.094777 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-94ed4f62-e74c-4e1d-9c80-3849a7f6803e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Returning 404 to user: Instance 3bb88b55-aac8-4559-8729-6dbeab0b4f45 could not be found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:59:14.094777 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-94ed4f62-e74c-4e1d-9c80-3849a7f6803e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "DELETE /compute/v2.1/servers/3bb88b55-aac8-4559-8729-6dbeab0b4f45" status: 404 len: 111 microversion: 2.1 time: 0.033660 Aug 10 23:59:14.094777 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3291/6789] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:59:14 2022] DELETE /compute/v2.1/servers/3bb88b55-aac8-4559-8729-6dbeab0b4f45 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:59:14.101015 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-fc021496-86e7-4d00-9180-2c27553aae6c tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:59:14.101742 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-fc021496-86e7-4d00-9180-2c27553aae6c tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: 3bb88b55-aac8-4559-8729-6dbeab0b4f45] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:59:14.108208 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fc021496-86e7-4d00-9180-2c27553aae6c tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:59:14.108798 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fc021496-86e7-4d00-9180-2c27553aae6c tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:59:14.109341 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fc021496-86e7-4d00-9180-2c27553aae6c tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:59:14.110057 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fc021496-86e7-4d00-9180-2c27553aae6c tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:59:14.110525 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fc021496-86e7-4d00-9180-2c27553aae6c tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:59:14.111011 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fc021496-86e7-4d00-9180-2c27553aae6c tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:59:14.125515 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-fc021496-86e7-4d00-9180-2c27553aae6c tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] HTTP exception thrown: Instance 3bb88b55-aac8-4559-8729-6dbeab0b4f45 could not be found. Aug 10 23:59:14.127123 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-fc021496-86e7-4d00-9180-2c27553aae6c tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Request method failure captured: Aug 10 23:59:14.127123 n-d-850468-14 devstack@n-api.service[122633]: request: GET /compute/v2.1/servers/3bb88b55-aac8-4559-8729-6dbeab0b4f45 HTTP/1.1 Aug 10 23:59:14.127123 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:59:14.127123 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:59:14.127123 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:59:14.127123 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:59:14.127123 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:59:14.127123 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:59:14.127123 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:59:14.127123 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:59:14.127123 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9ETka_MLrOzNLl9fMo23yiaBVbwRsDIGTKuSE2U_QdPMsSc8GHIwU4exY0o7VQcTlL32LUR0TzTXBFYguNbPnJvl-Oq37igm94dUqjDcjI8p0o_T8FFxkqM-af8dhqzR4fbIp2j_qc7pazKLEDLMGgsyywPyJGsRgPDIuxnwDfxMZ8k Aug 10 23:59:14.127123 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:59:14.127123 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:59:14.127123 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:59:14.127123 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:59:14.127123 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:59:14.127123 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:59:14.127123 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 49e20a407dbc425ea488dee2995ebbe3 Aug 10 23:59:14.127123 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-ServerActionsTestJSON-1613214326 Aug 10 23:59:14.127123 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:59:14.127123 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:59:14.127123 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/49e20a407dbc425ea488dee2995ebbe3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/49e20a407dbc425ea488dee2995ebbe3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/49e20a407dbc425ea488dee2995ebbe3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_49e20a407dbc425ea488dee2995ebbe3", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:59:14.127123 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-ServerActionsTestJSON-1613214326 Aug 10 23:59:14.127123 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 49e20a407dbc425ea488dee2995ebbe3 Aug 10 23:59:14.127123 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-ServerActionsTestJSON-1613214326 Aug 10 23:59:14.127123 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-ServerActionsTestJSON-1613214326-project Aug 10 23:59:14.127123 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:59:14.127123 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:59:14.127123 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 1412a4116dbb4412ba8ea10f72e2d95e Aug 10 23:59:14.127123 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-ServerActionsTestJSON-1613214326-project Aug 10 23:59:14.127123 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:59:14.127123 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance 3bb88b55-aac8-4559-8729-6dbeab0b4f45 could not be found. Aug 10 23:59:14.127123 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': '3bb88b55-aac8-4559-8729-6dbeab0b4f45'} Aug 10 23:59:14.127123 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:59:14.127123 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:59:14.127123 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:59:14.127123 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:59:14.127123 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:59:14.127123 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:59:14.127123 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:59:14.127123 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:59:14.127123 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:59:14.127123 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:59:14.127123 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3bb88b55-aac8-4559-8729-6dbeab0b4f45 could not be found. Aug 10 23:59:14.127123 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:59:14.127123 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:59:14.127123 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:59:14.127123 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:59:14.127123 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:59:14.127123 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:59:14.127123 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:59:14.127123 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:59:14.127123 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:59:14.127123 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:59:14.127123 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:59:14.127123 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:59:14.127123 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:59:14.127123 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:59:14.127123 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:59:14.127123 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:59:14.127123 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3bb88b55-aac8-4559-8729-6dbeab0b4f45 could not be found. Aug 10 23:59:14.127123 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:59:14.127123 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:59:14.127123 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:59:14.131750 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:59:14.131750 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:59:14.131750 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:59:14.131750 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:59:14.131750 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:59:14.131750 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3bb88b55-aac8-4559-8729-6dbeab0b4f45 could not be found. Aug 10 23:59:14.131750 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:59:14.131750 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-fc021496-86e7-4d00-9180-2c27553aae6c tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Returning 404 to user: Instance 3bb88b55-aac8-4559-8729-6dbeab0b4f45 could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:59:14.131750 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-fc021496-86e7-4d00-9180-2c27553aae6c tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/3bb88b55-aac8-4559-8729-6dbeab0b4f45" status: 404 len: 111 microversion: 2.1 time: 0.031528 Aug 10 23:59:14.131750 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3499/6790] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:59:14 2022] GET /compute/v2.1/servers/3bb88b55-aac8-4559-8729-6dbeab0b4f45 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:59:14.137741 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-7e95de84-0b3c-4424-8603-481e289adb9b tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:59:14.138374 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-7e95de84-0b3c-4424-8603-481e289adb9b tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: 24f01a8a-885a-47c7-9e6b-6798ff1f0e4a] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:59:14.145149 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7e95de84-0b3c-4424-8603-481e289adb9b tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:59:14.145635 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7e95de84-0b3c-4424-8603-481e289adb9b tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:59:14.146074 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7e95de84-0b3c-4424-8603-481e289adb9b tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:59:14.146777 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7e95de84-0b3c-4424-8603-481e289adb9b tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:59:14.147261 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7e95de84-0b3c-4424-8603-481e289adb9b tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:59:14.147686 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7e95de84-0b3c-4424-8603-481e289adb9b tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:59:14.161506 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-7e95de84-0b3c-4424-8603-481e289adb9b tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] HTTP exception thrown: Instance 24f01a8a-885a-47c7-9e6b-6798ff1f0e4a could not be found. Aug 10 23:59:14.163105 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-7e95de84-0b3c-4424-8603-481e289adb9b tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Request method failure captured: Aug 10 23:59:14.163105 n-d-850468-14 devstack@n-api.service[122632]: request: DELETE /compute/v2.1/servers/24f01a8a-885a-47c7-9e6b-6798ff1f0e4a HTTP/1.1 Aug 10 23:59:14.163105 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:59:14.163105 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:59:14.163105 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:59:14.163105 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 23:59:14.163105 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:59:14.163105 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:59:14.163105 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:59:14.163105 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:59:14.163105 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9ETka_MLrOzNLl9fMo23yiaBVbwRsDIGTKuSE2U_QdPMsSc8GHIwU4exY0o7VQcTlL32LUR0TzTXBFYguNbPnJvl-Oq37igm94dUqjDcjI8p0o_T8FFxkqM-af8dhqzR4fbIp2j_qc7pazKLEDLMGgsyywPyJGsRgPDIuxnwDfxMZ8k Aug 10 23:59:14.163105 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:59:14.163105 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:59:14.163105 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:59:14.163105 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:59:14.163105 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:59:14.163105 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:59:14.163105 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 49e20a407dbc425ea488dee2995ebbe3 Aug 10 23:59:14.163105 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-ServerActionsTestJSON-1613214326 Aug 10 23:59:14.163105 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:59:14.163105 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:59:14.163105 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/49e20a407dbc425ea488dee2995ebbe3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/49e20a407dbc425ea488dee2995ebbe3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/49e20a407dbc425ea488dee2995ebbe3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_49e20a407dbc425ea488dee2995ebbe3", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:59:14.163105 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-ServerActionsTestJSON-1613214326 Aug 10 23:59:14.163105 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 49e20a407dbc425ea488dee2995ebbe3 Aug 10 23:59:14.163105 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-ServerActionsTestJSON-1613214326 Aug 10 23:59:14.163105 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-ServerActionsTestJSON-1613214326-project Aug 10 23:59:14.163105 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:59:14.163105 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:59:14.163105 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: 1412a4116dbb4412ba8ea10f72e2d95e Aug 10 23:59:14.163105 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-ServerActionsTestJSON-1613214326-project Aug 10 23:59:14.163105 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:59:14.163105 n-d-850468-14 devstack@n-api.service[122632]: exception: Instance 24f01a8a-885a-47c7-9e6b-6798ff1f0e4a could not be found. Aug 10 23:59:14.163105 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': '24f01a8a-885a-47c7-9e6b-6798ff1f0e4a'} Aug 10 23:59:14.163105 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:59:14.163105 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:59:14.163105 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:59:14.163105 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:59:14.163105 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:59:14.163105 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:59:14.163105 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:59:14.163105 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:59:14.163105 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:59:14.163105 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:59:14.163105 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24f01a8a-885a-47c7-9e6b-6798ff1f0e4a could not be found. Aug 10 23:59:14.163105 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:59:14.163105 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:59:14.163105 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:59:14.163105 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:59:14.163105 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:59:14.163105 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:59:14.163105 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:59:14.163105 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:59:14.163105 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:59:14.163105 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:59:14.163105 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 23:59:14.163105 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 23:59:14.163105 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 23:59:14.163105 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 23:59:14.163105 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:59:14.163105 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:59:14.163105 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:59:14.163105 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:59:14.166666 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24f01a8a-885a-47c7-9e6b-6798ff1f0e4a could not be found. Aug 10 23:59:14.166666 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:59:14.166666 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:59:14.166666 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:59:14.166666 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:59:14.166666 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:59:14.166666 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:59:14.166666 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:59:14.166666 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:59:14.166666 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24f01a8a-885a-47c7-9e6b-6798ff1f0e4a could not be found. Aug 10 23:59:14.166666 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:59:14.166666 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-7e95de84-0b3c-4424-8603-481e289adb9b tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Returning 404 to user: Instance 24f01a8a-885a-47c7-9e6b-6798ff1f0e4a could not be found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:59:14.166666 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-7e95de84-0b3c-4424-8603-481e289adb9b tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "DELETE /compute/v2.1/servers/24f01a8a-885a-47c7-9e6b-6798ff1f0e4a" status: 404 len: 111 microversion: 2.1 time: 0.030705 Aug 10 23:59:14.166666 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3292/6791] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:59:14 2022] DELETE /compute/v2.1/servers/24f01a8a-885a-47c7-9e6b-6798ff1f0e4a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:59:14.173169 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-87249ea3-bdbe-4b35-9495-de4896b47096 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:59:14.174136 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-87249ea3-bdbe-4b35-9495-de4896b47096 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] [instance: 24f01a8a-885a-47c7-9e6b-6798ff1f0e4a] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:59:14.180472 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-87249ea3-bdbe-4b35-9495-de4896b47096 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:59:14.180969 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-87249ea3-bdbe-4b35-9495-de4896b47096 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:59:14.181420 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-87249ea3-bdbe-4b35-9495-de4896b47096 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:59:14.182193 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-87249ea3-bdbe-4b35-9495-de4896b47096 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:59:14.182662 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-87249ea3-bdbe-4b35-9495-de4896b47096 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:59:14.183128 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-87249ea3-bdbe-4b35-9495-de4896b47096 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:59:14.198020 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-87249ea3-bdbe-4b35-9495-de4896b47096 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] HTTP exception thrown: Instance 24f01a8a-885a-47c7-9e6b-6798ff1f0e4a could not be found. Aug 10 23:59:14.199597 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-87249ea3-bdbe-4b35-9495-de4896b47096 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Request method failure captured: Aug 10 23:59:14.199597 n-d-850468-14 devstack@n-api.service[122633]: request: GET /compute/v2.1/servers/24f01a8a-885a-47c7-9e6b-6798ff1f0e4a HTTP/1.1 Aug 10 23:59:14.199597 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:59:14.199597 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:59:14.199597 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:59:14.199597 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:59:14.199597 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:59:14.199597 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:59:14.199597 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:59:14.199597 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:59:14.199597 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9ETka_MLrOzNLl9fMo23yiaBVbwRsDIGTKuSE2U_QdPMsSc8GHIwU4exY0o7VQcTlL32LUR0TzTXBFYguNbPnJvl-Oq37igm94dUqjDcjI8p0o_T8FFxkqM-af8dhqzR4fbIp2j_qc7pazKLEDLMGgsyywPyJGsRgPDIuxnwDfxMZ8k Aug 10 23:59:14.199597 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:59:14.199597 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:59:14.199597 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:59:14.199597 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:59:14.199597 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:59:14.199597 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:59:14.199597 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 49e20a407dbc425ea488dee2995ebbe3 Aug 10 23:59:14.199597 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-ServerActionsTestJSON-1613214326 Aug 10 23:59:14.199597 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:59:14.199597 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:59:14.199597 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/49e20a407dbc425ea488dee2995ebbe3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/49e20a407dbc425ea488dee2995ebbe3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/49e20a407dbc425ea488dee2995ebbe3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_49e20a407dbc425ea488dee2995ebbe3", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:59:14.199597 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-ServerActionsTestJSON-1613214326 Aug 10 23:59:14.199597 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 49e20a407dbc425ea488dee2995ebbe3 Aug 10 23:59:14.199597 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-ServerActionsTestJSON-1613214326 Aug 10 23:59:14.199597 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-ServerActionsTestJSON-1613214326-project Aug 10 23:59:14.199597 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:59:14.199597 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:59:14.199597 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 1412a4116dbb4412ba8ea10f72e2d95e Aug 10 23:59:14.199597 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-ServerActionsTestJSON-1613214326-project Aug 10 23:59:14.199597 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:59:14.199597 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance 24f01a8a-885a-47c7-9e6b-6798ff1f0e4a could not be found. Aug 10 23:59:14.199597 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': '24f01a8a-885a-47c7-9e6b-6798ff1f0e4a'} Aug 10 23:59:14.199597 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:59:14.199597 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:59:14.199597 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:59:14.199597 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:59:14.199597 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:59:14.199597 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:59:14.199597 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:59:14.199597 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:59:14.199597 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:59:14.199597 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:59:14.199597 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24f01a8a-885a-47c7-9e6b-6798ff1f0e4a could not be found. Aug 10 23:59:14.199597 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:59:14.199597 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:59:14.199597 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:59:14.199597 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:59:14.199597 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:59:14.199597 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:59:14.199597 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:59:14.199597 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:59:14.199597 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:59:14.199597 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:59:14.199597 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:59:14.199597 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:59:14.199597 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:59:14.199597 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:59:14.199597 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:59:14.199597 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:59:14.199597 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24f01a8a-885a-47c7-9e6b-6798ff1f0e4a could not be found. Aug 10 23:59:14.199597 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:59:14.199597 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:59:14.199597 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:59:14.203055 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:59:14.203055 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:59:14.203055 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:59:14.203055 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:59:14.203055 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:59:14.203055 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24f01a8a-885a-47c7-9e6b-6798ff1f0e4a could not be found. Aug 10 23:59:14.203055 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:59:14.203055 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-87249ea3-bdbe-4b35-9495-de4896b47096 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Returning 404 to user: Instance 24f01a8a-885a-47c7-9e6b-6798ff1f0e4a could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:59:14.203055 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-87249ea3-bdbe-4b35-9495-de4896b47096 tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "GET /compute/v2.1/servers/24f01a8a-885a-47c7-9e6b-6798ff1f0e4a" status: 404 len: 111 microversion: 2.1 time: 0.031908 Aug 10 23:59:14.203055 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3500/6792] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:59:14 2022] GET /compute/v2.1/servers/24f01a8a-885a-47c7-9e6b-6798ff1f0e4a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:59:14.210598 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c3eba0eb-4c9d-4681-b508-9d7c082bb21e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] Calling method '.version_select at 0x7f847c9aa5e0>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:59:14.234177 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-c3eba0eb-4c9d-4681-b508-9d7c082bb21e tempest-ServerActionsTestJSON-1613214326 tempest-ServerActionsTestJSON-1613214326-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1767049833" status: 202 len: 0 microversion: 2.1 time: 0.027994 Aug 10 23:59:14.235096 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3293/6793] 10.222.0.58 () {58 vars in 1221 bytes} [Wed Aug 10 23:59:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1767049833 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 10 23:59:23.845995 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-f5b71cac-e050-4826-a688-7a84c7f510b4 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-903103919", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452", "networks": [{"uuid": "597f75fe-6410-4fe4-bd2b-078a0092e73e"}]}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:59:23.907640 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.network.neutron [None req-f5b71cac-e050-4826-a688-7a84c7f510b4 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] validate_networks() for [('597f75fe-6410-4fe4-bd2b-078a0092e73e', None, None, None, None, None)] {{(pid=122633) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 23:59:24.188067 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=29 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:59:24.313247 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-f5b71cac-e050-4826-a688-7a84c7f510b4 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Flavor limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:59:24.313683 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-f5b71cac-e050-4826-a688-7a84c7f510b4 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Image limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:59:24.314170 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-f5b71cac-e050-4826-a688-7a84c7f510b4 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Flavor pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:59:24.314595 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-f5b71cac-e050-4826-a688-7a84c7f510b4 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Image pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:59:24.315047 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-f5b71cac-e050-4826-a688-7a84c7f510b4 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:59:24.325430 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f5b71cac-e050-4826-a688-7a84c7f510b4 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:59:24.325921 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f5b71cac-e050-4826-a688-7a84c7f510b4 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:59:24.326370 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f5b71cac-e050-4826-a688-7a84c7f510b4 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:59:24.327185 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f5b71cac-e050-4826-a688-7a84c7f510b4 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:59:24.327656 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f5b71cac-e050-4826-a688-7a84c7f510b4 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:59:24.328085 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f5b71cac-e050-4826-a688-7a84c7f510b4 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:59:24.345948 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-f5b71cac-e050-4826-a688-7a84c7f510b4 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Getting quotas for project 33e06f19039c44ac9a5c62d63d981864. Resources: {'instances', 'cores', 'ram'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:59:24.351945 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-f5b71cac-e050-4826-a688-7a84c7f510b4 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Getting quotas for user 51eb0ebf6fe74ef59a3665423ccf3e11 and project 33e06f19039c44ac9a5c62d63d981864. Resources: {'instances', 'cores', 'ram'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:59:24.365944 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-f5b71cac-e050-4826-a688-7a84c7f510b4 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Going to run 1 instances... {{(pid=122633) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 23:59:24.368501 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-f5b71cac-e050-4826-a688-7a84c7f510b4 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] [instance: bb4d1c69-d34b-497c-9f02-cc89204860b8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78ad8905-f66f-4733-8be9-2b260f1fabed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122633) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 23:59:24.414954 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-f5b71cac-e050-4826-a688-7a84c7f510b4 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.744666 Aug 10 23:59:24.415538 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3501/6794] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 23:59:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 746 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 23:59:24.425898 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=23 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:59:24.426624 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_api:SELECT=12,nova_api:DELETE=1 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:59:24.431198 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-7aad9cae-c9a4-4883-8f5a-4b4efc4e314f tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:59:24.433197 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-7aad9cae-c9a4-4883-8f5a-4b4efc4e314f tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] [instance: bb4d1c69-d34b-497c-9f02-cc89204860b8] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:59:24.494214 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-7aad9cae-c9a4-4883-8f5a-4b4efc4e314f tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51eb0ebf6fe74ef59a3665423ccf3e11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e06f19039c44ac9a5c62d63d981864', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:59:24.502014 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-7aad9cae-c9a4-4883-8f5a-4b4efc4e314f tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] 10.222.0.58 "GET /compute/v2.1/servers/bb4d1c69-d34b-497c-9f02-cc89204860b8" status: 200 len: 1216 microversion: 2.1 time: 0.078729 Aug 10 23:59:24.502710 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3294/6795] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:59:24 2022] GET /compute/v2.1/servers/bb4d1c69-d34b-497c-9f02-cc89204860b8 => generated 1216 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:59:25.525760 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-4a4f13d9-a1f2-49e1-afbc-6d1d6cd80376 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:59:25.526938 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-4a4f13d9-a1f2-49e1-afbc-6d1d6cd80376 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] [instance: bb4d1c69-d34b-497c-9f02-cc89204860b8] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:59:25.536415 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4a4f13d9-a1f2-49e1-afbc-6d1d6cd80376 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:59:25.537924 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4a4f13d9-a1f2-49e1-afbc-6d1d6cd80376 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:59:25.538544 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4a4f13d9-a1f2-49e1-afbc-6d1d6cd80376 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:59:25.539575 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4a4f13d9-a1f2-49e1-afbc-6d1d6cd80376 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:59:25.540201 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4a4f13d9-a1f2-49e1-afbc-6d1d6cd80376 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:59:25.540930 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4a4f13d9-a1f2-49e1-afbc-6d1d6cd80376 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:59:25.620056 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-4a4f13d9-a1f2-49e1-afbc-6d1d6cd80376 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51eb0ebf6fe74ef59a3665423ccf3e11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e06f19039c44ac9a5c62d63d981864', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:59:25.628595 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-4a4f13d9-a1f2-49e1-afbc-6d1d6cd80376 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] 10.222.0.58 "GET /compute/v2.1/servers/bb4d1c69-d34b-497c-9f02-cc89204860b8" status: 200 len: 1276 microversion: 2.1 time: 0.106694 Aug 10 23:59:25.629763 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3502/6796] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:59:25 2022] GET /compute/v2.1/servers/bb4d1c69-d34b-497c-9f02-cc89204860b8 => generated 1276 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:59:26.650098 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-ab8dc9c3-4f44-4c99-97f4-61f517fc90cd tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:59:26.651445 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-ab8dc9c3-4f44-4c99-97f4-61f517fc90cd tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] [instance: bb4d1c69-d34b-497c-9f02-cc89204860b8] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:59:26.660379 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ab8dc9c3-4f44-4c99-97f4-61f517fc90cd tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:59:26.660891 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ab8dc9c3-4f44-4c99-97f4-61f517fc90cd tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:59:26.661337 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ab8dc9c3-4f44-4c99-97f4-61f517fc90cd tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:59:26.662054 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ab8dc9c3-4f44-4c99-97f4-61f517fc90cd tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:59:26.662508 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ab8dc9c3-4f44-4c99-97f4-61f517fc90cd tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:59:26.663145 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ab8dc9c3-4f44-4c99-97f4-61f517fc90cd tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:59:26.916787 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-ab8dc9c3-4f44-4c99-97f4-61f517fc90cd tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51eb0ebf6fe74ef59a3665423ccf3e11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e06f19039c44ac9a5c62d63d981864', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:59:26.924825 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-ab8dc9c3-4f44-4c99-97f4-61f517fc90cd tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] 10.222.0.58 "GET /compute/v2.1/servers/bb4d1c69-d34b-497c-9f02-cc89204860b8" status: 200 len: 1316 microversion: 2.1 time: 0.279037 Aug 10 23:59:26.926621 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3295/6797] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:59:26 2022] GET /compute/v2.1/servers/bb4d1c69-d34b-497c-9f02-cc89204860b8 => generated 1316 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:59:27.095013 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-7c403e13-e56e-4c2b-accf-040dfc9af87c req-57e69e82-559f-4180-bf7a-4952a551ab25 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb4d1c69-d34b-497c-9f02-cc89204860b8", "tag": "8eb4bbaf-9021-4860-ae69-4c26c0b61406"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:59:27.105425 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-7c403e13-e56e-4c2b-accf-040dfc9af87c req-57e69e82-559f-4180-bf7a-4952a551ab25 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:59:27.106217 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-7c403e13-e56e-4c2b-accf-040dfc9af87c req-57e69e82-559f-4180-bf7a-4952a551ab25 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:59:27.106921 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-7c403e13-e56e-4c2b-accf-040dfc9af87c req-57e69e82-559f-4180-bf7a-4952a551ab25 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:59:27.120767 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-7c403e13-e56e-4c2b-accf-040dfc9af87c req-57e69e82-559f-4180-bf7a-4952a551ab25 service nova] Creating event network-changed:8eb4bbaf-9021-4860-ae69-4c26c0b61406 for instance bb4d1c69-d34b-497c-9f02-cc89204860b8 on n-h1-850468-14 Aug 10 23:59:27.126277 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-7c403e13-e56e-4c2b-accf-040dfc9af87c req-57e69e82-559f-4180-bf7a-4952a551ab25 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106728 Aug 10 23:59:27.127444 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3503/6798] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:59:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:59:27.947472 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-8a2f70cf-672c-43c4-8103-b02488ddebcb tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:59:27.948239 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-8a2f70cf-672c-43c4-8103-b02488ddebcb tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] [instance: bb4d1c69-d34b-497c-9f02-cc89204860b8] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:59:27.955338 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8a2f70cf-672c-43c4-8103-b02488ddebcb tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:59:27.955624 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8a2f70cf-672c-43c4-8103-b02488ddebcb tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:59:27.956127 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8a2f70cf-672c-43c4-8103-b02488ddebcb tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:59:27.957977 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8a2f70cf-672c-43c4-8103-b02488ddebcb tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:59:27.958433 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8a2f70cf-672c-43c4-8103-b02488ddebcb tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:59:27.958877 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8a2f70cf-672c-43c4-8103-b02488ddebcb tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:59:28.099836 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-8a2f70cf-672c-43c4-8103-b02488ddebcb tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51eb0ebf6fe74ef59a3665423ccf3e11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e06f19039c44ac9a5c62d63d981864', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:59:28.107409 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-8a2f70cf-672c-43c4-8103-b02488ddebcb tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] 10.222.0.58 "GET /compute/v2.1/servers/bb4d1c69-d34b-497c-9f02-cc89204860b8" status: 200 len: 1316 microversion: 2.1 time: 0.163926 Aug 10 23:59:28.107988 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3296/6799] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:59:27 2022] GET /compute/v2.1/servers/bb4d1c69-d34b-497c-9f02-cc89204860b8 => generated 1316 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:59:29.130667 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-165befbd-c576-4576-bd6b-c975049bd3a4 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:59:29.131419 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-165befbd-c576-4576-bd6b-c975049bd3a4 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] [instance: bb4d1c69-d34b-497c-9f02-cc89204860b8] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:59:29.137675 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-165befbd-c576-4576-bd6b-c975049bd3a4 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:59:29.138175 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-165befbd-c576-4576-bd6b-c975049bd3a4 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:59:29.138633 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-165befbd-c576-4576-bd6b-c975049bd3a4 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:59:29.139418 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-165befbd-c576-4576-bd6b-c975049bd3a4 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:59:29.139892 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-165befbd-c576-4576-bd6b-c975049bd3a4 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:59:29.140335 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-165befbd-c576-4576-bd6b-c975049bd3a4 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:59:29.276607 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-165befbd-c576-4576-bd6b-c975049bd3a4 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51eb0ebf6fe74ef59a3665423ccf3e11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e06f19039c44ac9a5c62d63d981864', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:59:29.284885 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-165befbd-c576-4576-bd6b-c975049bd3a4 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] 10.222.0.58 "GET /compute/v2.1/servers/bb4d1c69-d34b-497c-9f02-cc89204860b8" status: 200 len: 1316 microversion: 2.1 time: 0.158803 Aug 10 23:59:29.285569 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3504/6800] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:59:29 2022] GET /compute/v2.1/servers/bb4d1c69-d34b-497c-9f02-cc89204860b8 => generated 1316 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:59:30.306165 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-7045e6d5-1022-4c8d-a429-905b8bf49f14 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:59:30.309104 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-7045e6d5-1022-4c8d-a429-905b8bf49f14 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] [instance: bb4d1c69-d34b-497c-9f02-cc89204860b8] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:59:30.313979 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7045e6d5-1022-4c8d-a429-905b8bf49f14 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:59:30.314446 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7045e6d5-1022-4c8d-a429-905b8bf49f14 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:59:30.314921 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7045e6d5-1022-4c8d-a429-905b8bf49f14 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:59:30.315634 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7045e6d5-1022-4c8d-a429-905b8bf49f14 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:59:30.316094 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7045e6d5-1022-4c8d-a429-905b8bf49f14 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:59:30.316536 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7045e6d5-1022-4c8d-a429-905b8bf49f14 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:59:30.458236 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-7045e6d5-1022-4c8d-a429-905b8bf49f14 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51eb0ebf6fe74ef59a3665423ccf3e11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e06f19039c44ac9a5c62d63d981864', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:59:30.465782 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-7045e6d5-1022-4c8d-a429-905b8bf49f14 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] 10.222.0.58 "GET /compute/v2.1/servers/bb4d1c69-d34b-497c-9f02-cc89204860b8" status: 200 len: 1316 microversion: 2.1 time: 0.163908 Aug 10 23:59:30.466354 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3297/6801] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:59:30 2022] GET /compute/v2.1/servers/bb4d1c69-d34b-497c-9f02-cc89204860b8 => generated 1316 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:59:31.488399 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-8abaa910-983a-4a04-bbe4-833c64d90b9c tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:59:31.489099 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-8abaa910-983a-4a04-bbe4-833c64d90b9c tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] [instance: bb4d1c69-d34b-497c-9f02-cc89204860b8] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:59:31.495744 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8abaa910-983a-4a04-bbe4-833c64d90b9c tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:59:31.496250 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8abaa910-983a-4a04-bbe4-833c64d90b9c tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:59:31.496709 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8abaa910-983a-4a04-bbe4-833c64d90b9c tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:59:31.497442 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8abaa910-983a-4a04-bbe4-833c64d90b9c tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:59:31.497914 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8abaa910-983a-4a04-bbe4-833c64d90b9c tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:59:31.498358 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8abaa910-983a-4a04-bbe4-833c64d90b9c tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:59:31.632319 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-8abaa910-983a-4a04-bbe4-833c64d90b9c tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51eb0ebf6fe74ef59a3665423ccf3e11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e06f19039c44ac9a5c62d63d981864', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:59:31.640065 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-8abaa910-983a-4a04-bbe4-833c64d90b9c tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] 10.222.0.58 "GET /compute/v2.1/servers/bb4d1c69-d34b-497c-9f02-cc89204860b8" status: 200 len: 1316 microversion: 2.1 time: 0.156345 Aug 10 23:59:31.640640 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3505/6802] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:59:31 2022] GET /compute/v2.1/servers/bb4d1c69-d34b-497c-9f02-cc89204860b8 => generated 1316 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:59:32.662042 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-9991a8a4-44ae-46bd-b8f1-d65a283bd67d tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:59:32.662767 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-9991a8a4-44ae-46bd-b8f1-d65a283bd67d tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] [instance: bb4d1c69-d34b-497c-9f02-cc89204860b8] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:59:32.670050 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9991a8a4-44ae-46bd-b8f1-d65a283bd67d tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:59:32.670544 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9991a8a4-44ae-46bd-b8f1-d65a283bd67d tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:59:32.671051 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9991a8a4-44ae-46bd-b8f1-d65a283bd67d tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:59:32.671752 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9991a8a4-44ae-46bd-b8f1-d65a283bd67d tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:59:32.672199 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9991a8a4-44ae-46bd-b8f1-d65a283bd67d tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:59:32.672621 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9991a8a4-44ae-46bd-b8f1-d65a283bd67d tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:59:32.812705 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-9991a8a4-44ae-46bd-b8f1-d65a283bd67d tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51eb0ebf6fe74ef59a3665423ccf3e11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e06f19039c44ac9a5c62d63d981864', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:59:32.820529 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-9991a8a4-44ae-46bd-b8f1-d65a283bd67d tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] 10.222.0.58 "GET /compute/v2.1/servers/bb4d1c69-d34b-497c-9f02-cc89204860b8" status: 200 len: 1316 microversion: 2.1 time: 0.163008 Aug 10 23:59:32.821121 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3298/6803] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:59:32 2022] GET /compute/v2.1/servers/bb4d1c69-d34b-497c-9f02-cc89204860b8 => generated 1316 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:59:33.840756 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-7855538c-1ac2-41d3-8c1c-f8b09dd40adc tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:59:33.841398 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-7855538c-1ac2-41d3-8c1c-f8b09dd40adc tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] [instance: bb4d1c69-d34b-497c-9f02-cc89204860b8] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:59:33.848989 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7855538c-1ac2-41d3-8c1c-f8b09dd40adc tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:59:33.849492 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7855538c-1ac2-41d3-8c1c-f8b09dd40adc tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:59:33.849951 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7855538c-1ac2-41d3-8c1c-f8b09dd40adc tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:59:33.850673 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7855538c-1ac2-41d3-8c1c-f8b09dd40adc tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:59:33.851178 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7855538c-1ac2-41d3-8c1c-f8b09dd40adc tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:59:33.851626 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7855538c-1ac2-41d3-8c1c-f8b09dd40adc tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:59:33.995417 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-7855538c-1ac2-41d3-8c1c-f8b09dd40adc tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51eb0ebf6fe74ef59a3665423ccf3e11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e06f19039c44ac9a5c62d63d981864', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:59:34.004316 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-7855538c-1ac2-41d3-8c1c-f8b09dd40adc tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] 10.222.0.58 "GET /compute/v2.1/servers/bb4d1c69-d34b-497c-9f02-cc89204860b8" status: 200 len: 1316 microversion: 2.1 time: 0.167650 Aug 10 23:59:34.005212 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3506/6804] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:59:33 2022] GET /compute/v2.1/servers/bb4d1c69-d34b-497c-9f02-cc89204860b8 => generated 1316 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:59:34.152565 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-e93f98e0-aee5-4b1f-ba2b-0173efcb2fb0 req-6b4a240f-ea12-49c5-90e5-a38df5fcdfc9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb4d1c69-d34b-497c-9f02-cc89204860b8", "name": "network-vif-plugged", "status": "completed", "tag": "8eb4bbaf-9021-4860-ae69-4c26c0b61406"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:59:34.163227 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-e93f98e0-aee5-4b1f-ba2b-0173efcb2fb0 req-6b4a240f-ea12-49c5-90e5-a38df5fcdfc9 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:59:34.163704 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-e93f98e0-aee5-4b1f-ba2b-0173efcb2fb0 req-6b4a240f-ea12-49c5-90e5-a38df5fcdfc9 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:59:34.164137 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-e93f98e0-aee5-4b1f-ba2b-0173efcb2fb0 req-6b4a240f-ea12-49c5-90e5-a38df5fcdfc9 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:59:34.177428 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-e93f98e0-aee5-4b1f-ba2b-0173efcb2fb0 req-6b4a240f-ea12-49c5-90e5-a38df5fcdfc9 service nova] Creating event network-vif-plugged:8eb4bbaf-9021-4860-ae69-4c26c0b61406 for instance bb4d1c69-d34b-497c-9f02-cc89204860b8 on n-h1-850468-14 Aug 10 23:59:34.182634 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-e93f98e0-aee5-4b1f-ba2b-0173efcb2fb0 req-6b4a240f-ea12-49c5-90e5-a38df5fcdfc9 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103634 Aug 10 23:59:34.183286 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3299/6805] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:59:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 10 23:59:35.025193 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-b8d0cbe9-c0e3-468a-a97e-54bedcb1ea75 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:59:35.025838 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-b8d0cbe9-c0e3-468a-a97e-54bedcb1ea75 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] [instance: bb4d1c69-d34b-497c-9f02-cc89204860b8] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:59:35.027872 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=2 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:59:35.028705 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=6 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:59:35.036738 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b8d0cbe9-c0e3-468a-a97e-54bedcb1ea75 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:59:35.037245 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b8d0cbe9-c0e3-468a-a97e-54bedcb1ea75 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:59:35.037736 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b8d0cbe9-c0e3-468a-a97e-54bedcb1ea75 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:59:35.038469 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b8d0cbe9-c0e3-468a-a97e-54bedcb1ea75 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:59:35.039048 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b8d0cbe9-c0e3-468a-a97e-54bedcb1ea75 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:59:35.039494 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b8d0cbe9-c0e3-468a-a97e-54bedcb1ea75 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:59:35.170050 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-b8d0cbe9-c0e3-468a-a97e-54bedcb1ea75 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51eb0ebf6fe74ef59a3665423ccf3e11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e06f19039c44ac9a5c62d63d981864', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:59:35.178763 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-b8d0cbe9-c0e3-468a-a97e-54bedcb1ea75 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] 10.222.0.58 "GET /compute/v2.1/servers/bb4d1c69-d34b-497c-9f02-cc89204860b8" status: 200 len: 1316 microversion: 2.1 time: 0.157498 Aug 10 23:59:35.179366 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3507/6806] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:59:35 2022] GET /compute/v2.1/servers/bb4d1c69-d34b-497c-9f02-cc89204860b8 => generated 1316 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:59:36.197055 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=2 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:59:36.202348 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-9d97c335-1256-477f-8961-56bf6917af9f tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:59:36.203079 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-9d97c335-1256-477f-8961-56bf6917af9f tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] [instance: bb4d1c69-d34b-497c-9f02-cc89204860b8] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:59:36.209757 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9d97c335-1256-477f-8961-56bf6917af9f tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:59:36.210241 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9d97c335-1256-477f-8961-56bf6917af9f tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:59:36.210682 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9d97c335-1256-477f-8961-56bf6917af9f tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:59:36.211458 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9d97c335-1256-477f-8961-56bf6917af9f tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:59:36.211917 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9d97c335-1256-477f-8961-56bf6917af9f tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:59:36.212348 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9d97c335-1256-477f-8961-56bf6917af9f tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:59:36.345189 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-9d97c335-1256-477f-8961-56bf6917af9f tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51eb0ebf6fe74ef59a3665423ccf3e11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e06f19039c44ac9a5c62d63d981864', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:59:36.352895 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-9d97c335-1256-477f-8961-56bf6917af9f tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] 10.222.0.58 "GET /compute/v2.1/servers/bb4d1c69-d34b-497c-9f02-cc89204860b8" status: 200 len: 1505 microversion: 2.1 time: 0.156944 Aug 10 23:59:36.353470 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3300/6807] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:59:36 2022] GET /compute/v2.1/servers/bb4d1c69-d34b-497c-9f02-cc89204860b8 => generated 1505 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:59:36.414523 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-2e919864-60e3-4d20-a21e-3bcb54759eb9 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1165502500", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452", "networks": [{"uuid": "597f75fe-6410-4fe4-bd2b-078a0092e73e"}]}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:59:36.469313 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.network.neutron [None req-2e919864-60e3-4d20-a21e-3bcb54759eb9 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] validate_networks() for [('597f75fe-6410-4fe4-bd2b-078a0092e73e', None, None, None, None, None)] {{(pid=122633) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 10 23:59:36.897467 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-2e919864-60e3-4d20-a21e-3bcb54759eb9 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Flavor limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 10 23:59:36.897905 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-2e919864-60e3-4d20-a21e-3bcb54759eb9 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Image limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 10 23:59:36.898466 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-2e919864-60e3-4d20-a21e-3bcb54759eb9 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Flavor pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 10 23:59:36.898932 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-2e919864-60e3-4d20-a21e-3bcb54759eb9 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Image pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 10 23:59:36.899418 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-2e919864-60e3-4d20-a21e-3bcb54759eb9 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 10 23:59:36.908368 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2e919864-60e3-4d20-a21e-3bcb54759eb9 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:59:36.908866 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2e919864-60e3-4d20-a21e-3bcb54759eb9 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:59:36.909850 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2e919864-60e3-4d20-a21e-3bcb54759eb9 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:59:36.910595 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2e919864-60e3-4d20-a21e-3bcb54759eb9 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:59:36.911090 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2e919864-60e3-4d20-a21e-3bcb54759eb9 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:59:36.911536 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2e919864-60e3-4d20-a21e-3bcb54759eb9 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:59:36.929233 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-2e919864-60e3-4d20-a21e-3bcb54759eb9 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Getting quotas for project 33e06f19039c44ac9a5c62d63d981864. Resources: {'instances', 'cores', 'ram'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 10 23:59:36.934510 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-2e919864-60e3-4d20-a21e-3bcb54759eb9 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Getting quotas for user 51eb0ebf6fe74ef59a3665423ccf3e11 and project 33e06f19039c44ac9a5c62d63d981864. Resources: {'instances', 'cores', 'ram'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 10 23:59:36.946979 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-2e919864-60e3-4d20-a21e-3bcb54759eb9 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Going to run 1 instances... {{(pid=122633) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 10 23:59:36.949233 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-2e919864-60e3-4d20-a21e-3bcb54759eb9 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] [instance: ea828e76-3d4b-4465-937b-ccd57b0435a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78ad8905-f66f-4733-8be9-2b260f1fabed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122633) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 10 23:59:36.996559 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-2e919864-60e3-4d20-a21e-3bcb54759eb9 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.585802 Aug 10 23:59:36.997129 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3508/6808] 10.222.0.58 () {60 vars in 1147 bytes} [Wed Aug 10 23:59:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 587 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 10 23:59:37.008494 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-4923b0d2-bd23-45d2-8899-0a141ab7945d tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:59:37.009240 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-4923b0d2-bd23-45d2-8899-0a141ab7945d tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] [instance: ea828e76-3d4b-4465-937b-ccd57b0435a7] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:59:37.065178 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-4923b0d2-bd23-45d2-8899-0a141ab7945d tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51eb0ebf6fe74ef59a3665423ccf3e11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e06f19039c44ac9a5c62d63d981864', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:59:37.072861 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-4923b0d2-bd23-45d2-8899-0a141ab7945d tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] 10.222.0.58 "GET /compute/v2.1/servers/ea828e76-3d4b-4465-937b-ccd57b0435a7" status: 200 len: 1217 microversion: 2.1 time: 0.068397 Aug 10 23:59:37.073645 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3301/6809] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:59:37 2022] GET /compute/v2.1/servers/ea828e76-3d4b-4465-937b-ccd57b0435a7 => generated 1217 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:59:38.096239 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-a1419fd1-a662-431f-bdd4-41b55c8cad91 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:59:38.097505 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-a1419fd1-a662-431f-bdd4-41b55c8cad91 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] [instance: ea828e76-3d4b-4465-937b-ccd57b0435a7] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:59:38.103892 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a1419fd1-a662-431f-bdd4-41b55c8cad91 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:59:38.104406 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a1419fd1-a662-431f-bdd4-41b55c8cad91 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:59:38.104867 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a1419fd1-a662-431f-bdd4-41b55c8cad91 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:59:38.105597 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a1419fd1-a662-431f-bdd4-41b55c8cad91 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:59:38.106148 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a1419fd1-a662-431f-bdd4-41b55c8cad91 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:59:38.106845 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a1419fd1-a662-431f-bdd4-41b55c8cad91 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:59:38.184333 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-a1419fd1-a662-431f-bdd4-41b55c8cad91 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51eb0ebf6fe74ef59a3665423ccf3e11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e06f19039c44ac9a5c62d63d981864', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:59:38.192873 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-a1419fd1-a662-431f-bdd4-41b55c8cad91 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] 10.222.0.58 "GET /compute/v2.1/servers/ea828e76-3d4b-4465-937b-ccd57b0435a7" status: 200 len: 1275 microversion: 2.1 time: 0.101627 Aug 10 23:59:38.193092 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3509/6810] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:59:38 2022] GET /compute/v2.1/servers/ea828e76-3d4b-4465-937b-ccd57b0435a7 => generated 1275 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:59:39.213615 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-3626e10e-53d1-4f63-8fa6-ea9d4760ef01 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:59:39.214217 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-3626e10e-53d1-4f63-8fa6-ea9d4760ef01 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] [instance: ea828e76-3d4b-4465-937b-ccd57b0435a7] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:59:39.223676 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3626e10e-53d1-4f63-8fa6-ea9d4760ef01 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:59:39.224188 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3626e10e-53d1-4f63-8fa6-ea9d4760ef01 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:59:39.224638 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3626e10e-53d1-4f63-8fa6-ea9d4760ef01 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:59:39.225359 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3626e10e-53d1-4f63-8fa6-ea9d4760ef01 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:59:39.225988 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3626e10e-53d1-4f63-8fa6-ea9d4760ef01 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:59:39.226427 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3626e10e-53d1-4f63-8fa6-ea9d4760ef01 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:59:39.428662 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-3626e10e-53d1-4f63-8fa6-ea9d4760ef01 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51eb0ebf6fe74ef59a3665423ccf3e11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e06f19039c44ac9a5c62d63d981864', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:59:39.436611 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-f24ec3db-4325-4e1e-9b7f-286953ce4d64 req-8c3a9c04-d2ad-460a-a285-d0880846df09 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea828e76-3d4b-4465-937b-ccd57b0435a7", "tag": "4bc76a41-970a-4c30-9d29-36e9f6856d17"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:59:39.443939 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=6 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:59:39.444134 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-3626e10e-53d1-4f63-8fa6-ea9d4760ef01 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] 10.222.0.58 "GET /compute/v2.1/servers/ea828e76-3d4b-4465-937b-ccd57b0435a7" status: 200 len: 1317 microversion: 2.1 time: 0.234171 Aug 10 23:59:39.445363 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3302/6811] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:59:39 2022] GET /compute/v2.1/servers/ea828e76-3d4b-4465-937b-ccd57b0435a7 => generated 1317 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 10 23:59:39.457875 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-f24ec3db-4325-4e1e-9b7f-286953ce4d64 req-8c3a9c04-d2ad-460a-a285-d0880846df09 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:59:39.458537 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-f24ec3db-4325-4e1e-9b7f-286953ce4d64 req-8c3a9c04-d2ad-460a-a285-d0880846df09 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:59:39.459157 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-f24ec3db-4325-4e1e-9b7f-286953ce4d64 req-8c3a9c04-d2ad-460a-a285-d0880846df09 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:59:39.472568 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-f24ec3db-4325-4e1e-9b7f-286953ce4d64 req-8c3a9c04-d2ad-460a-a285-d0880846df09 service nova] Creating event network-changed:4bc76a41-970a-4c30-9d29-36e9f6856d17 for instance ea828e76-3d4b-4465-937b-ccd57b0435a7 on n-h2-850468-14 Aug 10 23:59:39.477755 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-f24ec3db-4325-4e1e-9b7f-286953ce4d64 req-8c3a9c04-d2ad-460a-a285-d0880846df09 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044892 Aug 10 23:59:39.478493 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3510/6812] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:59:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:59:40.466812 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-12bbe5ad-e9f5-4c62-9000-15dd39a39cf9 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:59:40.467348 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-12bbe5ad-e9f5-4c62-9000-15dd39a39cf9 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] [instance: ea828e76-3d4b-4465-937b-ccd57b0435a7] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:59:40.475175 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-12bbe5ad-e9f5-4c62-9000-15dd39a39cf9 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:59:40.475662 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-12bbe5ad-e9f5-4c62-9000-15dd39a39cf9 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:59:40.476103 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-12bbe5ad-e9f5-4c62-9000-15dd39a39cf9 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:59:40.476799 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-12bbe5ad-e9f5-4c62-9000-15dd39a39cf9 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:59:40.477255 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-12bbe5ad-e9f5-4c62-9000-15dd39a39cf9 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:59:40.477685 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-12bbe5ad-e9f5-4c62-9000-15dd39a39cf9 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:59:40.608550 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-12bbe5ad-e9f5-4c62-9000-15dd39a39cf9 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51eb0ebf6fe74ef59a3665423ccf3e11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e06f19039c44ac9a5c62d63d981864', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:59:40.616915 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-12bbe5ad-e9f5-4c62-9000-15dd39a39cf9 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] 10.222.0.58 "GET /compute/v2.1/servers/ea828e76-3d4b-4465-937b-ccd57b0435a7" status: 200 len: 1317 microversion: 2.1 time: 0.154152 Aug 10 23:59:40.617498 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3303/6813] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:59:40 2022] GET /compute/v2.1/servers/ea828e76-3d4b-4465-937b-ccd57b0435a7 => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:59:41.639145 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-230c1496-1948-47a5-90e8-d08b87123054 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:59:41.639860 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-230c1496-1948-47a5-90e8-d08b87123054 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] [instance: ea828e76-3d4b-4465-937b-ccd57b0435a7] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:59:41.646676 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-230c1496-1948-47a5-90e8-d08b87123054 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:59:41.647199 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-230c1496-1948-47a5-90e8-d08b87123054 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:59:41.647657 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-230c1496-1948-47a5-90e8-d08b87123054 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:59:41.648612 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-230c1496-1948-47a5-90e8-d08b87123054 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:59:41.648828 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-230c1496-1948-47a5-90e8-d08b87123054 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:59:41.649280 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-230c1496-1948-47a5-90e8-d08b87123054 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:59:41.786031 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-230c1496-1948-47a5-90e8-d08b87123054 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51eb0ebf6fe74ef59a3665423ccf3e11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e06f19039c44ac9a5c62d63d981864', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:59:41.793595 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-230c1496-1948-47a5-90e8-d08b87123054 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] 10.222.0.58 "GET /compute/v2.1/servers/ea828e76-3d4b-4465-937b-ccd57b0435a7" status: 200 len: 1317 microversion: 2.1 time: 0.159537 Aug 10 23:59:41.794189 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3511/6814] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:59:41 2022] GET /compute/v2.1/servers/ea828e76-3d4b-4465-937b-ccd57b0435a7 => generated 1317 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:59:42.817691 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-79aae9d5-be20-4aec-a4bd-a94fff8f0428 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:59:42.818303 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-79aae9d5-be20-4aec-a4bd-a94fff8f0428 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] [instance: ea828e76-3d4b-4465-937b-ccd57b0435a7] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:59:42.825233 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-79aae9d5-be20-4aec-a4bd-a94fff8f0428 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:59:42.825711 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-79aae9d5-be20-4aec-a4bd-a94fff8f0428 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:59:42.826148 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-79aae9d5-be20-4aec-a4bd-a94fff8f0428 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:59:42.826863 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-79aae9d5-be20-4aec-a4bd-a94fff8f0428 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:59:42.827316 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-79aae9d5-be20-4aec-a4bd-a94fff8f0428 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:59:42.827738 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-79aae9d5-be20-4aec-a4bd-a94fff8f0428 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:59:42.965867 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-79aae9d5-be20-4aec-a4bd-a94fff8f0428 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51eb0ebf6fe74ef59a3665423ccf3e11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e06f19039c44ac9a5c62d63d981864', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:59:42.974092 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-79aae9d5-be20-4aec-a4bd-a94fff8f0428 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] 10.222.0.58 "GET /compute/v2.1/servers/ea828e76-3d4b-4465-937b-ccd57b0435a7" status: 200 len: 1317 microversion: 2.1 time: 0.160640 Aug 10 23:59:42.974684 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3304/6815] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:59:42 2022] GET /compute/v2.1/servers/ea828e76-3d4b-4465-937b-ccd57b0435a7 => generated 1317 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:59:43.994889 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-0d2eb953-9bf9-43a8-8898-9f137a488c01 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:59:43.995695 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-0d2eb953-9bf9-43a8-8898-9f137a488c01 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] [instance: ea828e76-3d4b-4465-937b-ccd57b0435a7] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:59:44.004447 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0d2eb953-9bf9-43a8-8898-9f137a488c01 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:59:44.004966 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0d2eb953-9bf9-43a8-8898-9f137a488c01 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:59:44.005440 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0d2eb953-9bf9-43a8-8898-9f137a488c01 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:59:44.006174 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0d2eb953-9bf9-43a8-8898-9f137a488c01 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:59:44.006650 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0d2eb953-9bf9-43a8-8898-9f137a488c01 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:59:44.007120 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0d2eb953-9bf9-43a8-8898-9f137a488c01 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:59:44.140607 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-0d2eb953-9bf9-43a8-8898-9f137a488c01 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51eb0ebf6fe74ef59a3665423ccf3e11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e06f19039c44ac9a5c62d63d981864', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:59:44.148306 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-0d2eb953-9bf9-43a8-8898-9f137a488c01 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] 10.222.0.58 "GET /compute/v2.1/servers/ea828e76-3d4b-4465-937b-ccd57b0435a7" status: 200 len: 1317 microversion: 2.1 time: 0.157380 Aug 10 23:59:44.148879 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3512/6816] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:59:43 2022] GET /compute/v2.1/servers/ea828e76-3d4b-4465-937b-ccd57b0435a7 => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:59:44.594100 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-accee167-ed85-493e-876d-8576e0f2fda9 req-e4485d0d-0190-42f9-8ec8-f0324010cfb4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea828e76-3d4b-4465-937b-ccd57b0435a7", "name": "network-vif-plugged", "status": "completed", "tag": "4bc76a41-970a-4c30-9d29-36e9f6856d17"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:59:44.607168 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-accee167-ed85-493e-876d-8576e0f2fda9 req-e4485d0d-0190-42f9-8ec8-f0324010cfb4 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:59:44.607647 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-accee167-ed85-493e-876d-8576e0f2fda9 req-e4485d0d-0190-42f9-8ec8-f0324010cfb4 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:59:44.608076 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-accee167-ed85-493e-876d-8576e0f2fda9 req-e4485d0d-0190-42f9-8ec8-f0324010cfb4 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:59:44.619739 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-accee167-ed85-493e-876d-8576e0f2fda9 req-e4485d0d-0190-42f9-8ec8-f0324010cfb4 service nova] Creating event network-vif-plugged:4bc76a41-970a-4c30-9d29-36e9f6856d17 for instance ea828e76-3d4b-4465-937b-ccd57b0435a7 on n-h2-850468-14 Aug 10 23:59:44.624904 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-accee167-ed85-493e-876d-8576e0f2fda9 req-e4485d0d-0190-42f9-8ec8-f0324010cfb4 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034647 Aug 10 23:59:44.625502 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3305/6817] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:59:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:59:45.168772 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-49d0c6ec-3ff6-406b-b811-4194b1da883f tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:59:45.169412 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-49d0c6ec-3ff6-406b-b811-4194b1da883f tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] [instance: ea828e76-3d4b-4465-937b-ccd57b0435a7] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:59:45.177184 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-49d0c6ec-3ff6-406b-b811-4194b1da883f tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:59:45.177692 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-49d0c6ec-3ff6-406b-b811-4194b1da883f tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:59:45.178151 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-49d0c6ec-3ff6-406b-b811-4194b1da883f tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:59:45.178907 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-49d0c6ec-3ff6-406b-b811-4194b1da883f tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:59:45.179379 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-49d0c6ec-3ff6-406b-b811-4194b1da883f tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:59:45.179826 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-49d0c6ec-3ff6-406b-b811-4194b1da883f tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:59:45.322579 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-49d0c6ec-3ff6-406b-b811-4194b1da883f tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51eb0ebf6fe74ef59a3665423ccf3e11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e06f19039c44ac9a5c62d63d981864', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:59:45.330285 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-49d0c6ec-3ff6-406b-b811-4194b1da883f tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] 10.222.0.58 "GET /compute/v2.1/servers/ea828e76-3d4b-4465-937b-ccd57b0435a7" status: 200 len: 1317 microversion: 2.1 time: 0.165446 Aug 10 23:59:45.330974 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3513/6818] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:59:45 2022] GET /compute/v2.1/servers/ea828e76-3d4b-4465-937b-ccd57b0435a7 => generated 1317 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:59:46.354472 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-d16d60ec-891f-4271-a4ec-968bb97ab5c0 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:59:46.355479 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-d16d60ec-891f-4271-a4ec-968bb97ab5c0 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] [instance: ea828e76-3d4b-4465-937b-ccd57b0435a7] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:59:46.361628 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d16d60ec-891f-4271-a4ec-968bb97ab5c0 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:59:46.362111 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d16d60ec-891f-4271-a4ec-968bb97ab5c0 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:59:46.362906 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d16d60ec-891f-4271-a4ec-968bb97ab5c0 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:59:46.363687 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d16d60ec-891f-4271-a4ec-968bb97ab5c0 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:59:46.364141 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d16d60ec-891f-4271-a4ec-968bb97ab5c0 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:59:46.364566 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d16d60ec-891f-4271-a4ec-968bb97ab5c0 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:59:46.495399 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-d16d60ec-891f-4271-a4ec-968bb97ab5c0 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51eb0ebf6fe74ef59a3665423ccf3e11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e06f19039c44ac9a5c62d63d981864', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:59:46.504131 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-d16d60ec-891f-4271-a4ec-968bb97ab5c0 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] 10.222.0.58 "GET /compute/v2.1/servers/ea828e76-3d4b-4465-937b-ccd57b0435a7" status: 200 len: 1506 microversion: 2.1 time: 0.154992 Aug 10 23:59:46.504709 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3306/6819] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:59:46 2022] GET /compute/v2.1/servers/ea828e76-3d4b-4465-937b-ccd57b0435a7 => generated 1506 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:59:46.525343 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-a04e2e8f-28f8-4f8f-b98c-140cd3e0d063 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:59:46.525865 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-a04e2e8f-28f8-4f8f-b98c-140cd3e0d063 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] [instance: ea828e76-3d4b-4465-937b-ccd57b0435a7] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:59:46.532851 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a04e2e8f-28f8-4f8f-b98c-140cd3e0d063 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:59:46.533350 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a04e2e8f-28f8-4f8f-b98c-140cd3e0d063 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:59:46.533808 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a04e2e8f-28f8-4f8f-b98c-140cd3e0d063 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:59:46.534556 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a04e2e8f-28f8-4f8f-b98c-140cd3e0d063 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:59:46.535058 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a04e2e8f-28f8-4f8f-b98c-140cd3e0d063 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:59:46.535502 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a04e2e8f-28f8-4f8f-b98c-140cd3e0d063 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:59:46.560547 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-a04e2e8f-28f8-4f8f-b98c-140cd3e0d063 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] [instance: ea828e76-3d4b-4465-937b-ccd57b0435a7] Going to try to terminate instance {{(pid=122633) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:59:46.637868 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-a04e2e8f-28f8-4f8f-b98c-140cd3e0d063 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] 10.222.0.58 "DELETE /compute/v2.1/servers/ea828e76-3d4b-4465-937b-ccd57b0435a7" status: 204 len: 0 microversion: 2.1 time: 0.116000 Aug 10 23:59:46.638405 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3514/6820] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:59:46 2022] DELETE /compute/v2.1/servers/ea828e76-3d4b-4465-937b-ccd57b0435a7 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 10 23:59:46.648003 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-fd8150e8-8931-4117-8837-a46693d8db54 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:59:46.648622 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-fd8150e8-8931-4117-8837-a46693d8db54 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] [instance: ea828e76-3d4b-4465-937b-ccd57b0435a7] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:59:46.654841 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fd8150e8-8931-4117-8837-a46693d8db54 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:59:46.655333 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fd8150e8-8931-4117-8837-a46693d8db54 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:59:46.655780 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fd8150e8-8931-4117-8837-a46693d8db54 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:59:46.656484 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fd8150e8-8931-4117-8837-a46693d8db54 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:59:46.656943 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fd8150e8-8931-4117-8837-a46693d8db54 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:59:46.657373 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fd8150e8-8931-4117-8837-a46693d8db54 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:59:46.796725 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-fd8150e8-8931-4117-8837-a46693d8db54 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51eb0ebf6fe74ef59a3665423ccf3e11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e06f19039c44ac9a5c62d63d981864', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:59:46.804981 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-fd8150e8-8931-4117-8837-a46693d8db54 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] 10.222.0.58 "GET /compute/v2.1/servers/ea828e76-3d4b-4465-937b-ccd57b0435a7" status: 200 len: 1512 microversion: 2.1 time: 0.161640 Aug 10 23:59:46.805612 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3307/6821] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:59:46 2022] GET /compute/v2.1/servers/ea828e76-3d4b-4465-937b-ccd57b0435a7 => generated 1512 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:59:47.827998 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-b4e63fd8-5f2e-4109-b42d-1c6e2a5adfb2 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:59:47.828713 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-b4e63fd8-5f2e-4109-b42d-1c6e2a5adfb2 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] [instance: ea828e76-3d4b-4465-937b-ccd57b0435a7] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:59:47.830651 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=2 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:59:47.832569 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=6 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:59:47.840447 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b4e63fd8-5f2e-4109-b42d-1c6e2a5adfb2 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:59:47.840947 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b4e63fd8-5f2e-4109-b42d-1c6e2a5adfb2 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:59:47.841394 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b4e63fd8-5f2e-4109-b42d-1c6e2a5adfb2 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:59:47.842104 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b4e63fd8-5f2e-4109-b42d-1c6e2a5adfb2 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:59:47.842567 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b4e63fd8-5f2e-4109-b42d-1c6e2a5adfb2 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:59:47.843036 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b4e63fd8-5f2e-4109-b42d-1c6e2a5adfb2 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:59:47.979708 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-b4e63fd8-5f2e-4109-b42d-1c6e2a5adfb2 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51eb0ebf6fe74ef59a3665423ccf3e11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e06f19039c44ac9a5c62d63d981864', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:59:47.987512 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-b4e63fd8-5f2e-4109-b42d-1c6e2a5adfb2 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] 10.222.0.58 "GET /compute/v2.1/servers/ea828e76-3d4b-4465-937b-ccd57b0435a7" status: 200 len: 1512 microversion: 2.1 time: 0.163781 Aug 10 23:59:47.988190 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3515/6822] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:59:47 2022] GET /compute/v2.1/servers/ea828e76-3d4b-4465-937b-ccd57b0435a7 => generated 1512 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:59:48.510886 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-a5f0679e-74ba-4bad-9195-31eaebfc42f7 req-11ab2fef-9d14-478b-850b-193c43214b13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea828e76-3d4b-4465-937b-ccd57b0435a7", "name": "network-vif-deleted", "tag": "4bc76a41-970a-4c30-9d29-36e9f6856d17"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:59:48.517587 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=2 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:59:48.525461 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-a5f0679e-74ba-4bad-9195-31eaebfc42f7 req-11ab2fef-9d14-478b-850b-193c43214b13 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:59:48.531815 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-a5f0679e-74ba-4bad-9195-31eaebfc42f7 req-11ab2fef-9d14-478b-850b-193c43214b13 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:59:48.532268 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-a5f0679e-74ba-4bad-9195-31eaebfc42f7 req-11ab2fef-9d14-478b-850b-193c43214b13 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:59:48.549380 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-a5f0679e-74ba-4bad-9195-31eaebfc42f7 req-11ab2fef-9d14-478b-850b-193c43214b13 service nova] Creating event network-vif-deleted:4bc76a41-970a-4c30-9d29-36e9f6856d17 for instance ea828e76-3d4b-4465-937b-ccd57b0435a7 on n-h2-850468-14 Aug 10 23:59:48.555375 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-a5f0679e-74ba-4bad-9195-31eaebfc42f7 req-11ab2fef-9d14-478b-850b-193c43214b13 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048449 Aug 10 23:59:48.556205 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3308/6823] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:59:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:59:49.009995 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-456f493f-f443-4867-9f8a-e639e0ecded9 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:59:49.011062 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-456f493f-f443-4867-9f8a-e639e0ecded9 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] [instance: ea828e76-3d4b-4465-937b-ccd57b0435a7] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:59:49.020552 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-456f493f-f443-4867-9f8a-e639e0ecded9 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:59:49.021267 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-456f493f-f443-4867-9f8a-e639e0ecded9 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:59:49.022042 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-456f493f-f443-4867-9f8a-e639e0ecded9 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:59:49.023308 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-456f493f-f443-4867-9f8a-e639e0ecded9 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:59:49.023984 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-456f493f-f443-4867-9f8a-e639e0ecded9 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:59:49.024580 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-456f493f-f443-4867-9f8a-e639e0ecded9 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:59:49.067289 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-456f493f-f443-4867-9f8a-e639e0ecded9 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:59:49.067787 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-456f493f-f443-4867-9f8a-e639e0ecded9 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:59:49.068249 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-456f493f-f443-4867-9f8a-e639e0ecded9 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:59:49.068715 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.objects.instance [None req-456f493f-f443-4867-9f8a-e639e0ecded9 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Lazy-loading 'fault' on Instance uuid ea828e76-3d4b-4465-937b-ccd57b0435a7 {{(pid=122633) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 10 23:59:49.112649 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-456f493f-f443-4867-9f8a-e639e0ecded9 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51eb0ebf6fe74ef59a3665423ccf3e11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e06f19039c44ac9a5c62d63d981864', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:59:49.120111 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-456f493f-f443-4867-9f8a-e639e0ecded9 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] 10.222.0.58 "GET /compute/v2.1/servers/ea828e76-3d4b-4465-937b-ccd57b0435a7" status: 200 len: 1307 microversion: 2.1 time: 0.114517 Aug 10 23:59:49.120690 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3516/6824] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:59:49 2022] GET /compute/v2.1/servers/ea828e76-3d4b-4465-937b-ccd57b0435a7 => generated 1307 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:59:50.143562 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-94e44087-ed0a-4c26-a9d7-913ef7793e4a tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:59:50.144782 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-94e44087-ed0a-4c26-a9d7-913ef7793e4a tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] [instance: ea828e76-3d4b-4465-937b-ccd57b0435a7] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:59:50.151203 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-94e44087-ed0a-4c26-a9d7-913ef7793e4a tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:59:50.151691 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-94e44087-ed0a-4c26-a9d7-913ef7793e4a tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:59:50.152134 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-94e44087-ed0a-4c26-a9d7-913ef7793e4a tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:59:50.152832 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-94e44087-ed0a-4c26-a9d7-913ef7793e4a tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:59:50.153289 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-94e44087-ed0a-4c26-a9d7-913ef7793e4a tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:59:50.153719 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-94e44087-ed0a-4c26-a9d7-913ef7793e4a tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:59:50.167795 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-94e44087-ed0a-4c26-a9d7-913ef7793e4a tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] HTTP exception thrown: Instance ea828e76-3d4b-4465-937b-ccd57b0435a7 could not be found. Aug 10 23:59:50.169418 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-94e44087-ed0a-4c26-a9d7-913ef7793e4a tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Request method failure captured: Aug 10 23:59:50.169418 n-d-850468-14 devstack@n-api.service[122632]: request: GET /compute/v2.1/servers/ea828e76-3d4b-4465-937b-ccd57b0435a7 HTTP/1.1 Aug 10 23:59:50.169418 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:59:50.169418 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:59:50.169418 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:59:50.169418 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 23:59:50.169418 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:59:50.169418 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:59:50.169418 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:59:50.169418 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:59:50.169418 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9EZb4WgtLstLSkb-Dh2t6WroCD0SawfTNRavs0vzhW25quPFNY4mLVNEpnQuWVy1p-A4wkg3APSeUXSslVoWHJKn8I0nXuZ3k0JLvWC0gAbkiTwX4O-rVwimwzrkApEOPRlkwFDqnSmR7ttAPcj9I11vw0yeQZhV2ReerXu8GK3dbbY Aug 10 23:59:50.169418 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:59:50.169418 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:59:50.169418 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:59:50.169418 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:59:50.169418 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:59:50.169418 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:59:50.169418 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 33e06f19039c44ac9a5c62d63d981864 Aug 10 23:59:50.169418 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-ServersNegativeTestJSON-1414466587 Aug 10 23:59:50.169418 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:59:50.169418 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:59:50.169418 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/33e06f19039c44ac9a5c62d63d981864"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/33e06f19039c44ac9a5c62d63d981864"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/33e06f19039c44ac9a5c62d63d981864"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_33e06f19039c44ac9a5c62d63d981864", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:59:50.169418 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-ServersNegativeTestJSON-1414466587 Aug 10 23:59:50.169418 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 33e06f19039c44ac9a5c62d63d981864 Aug 10 23:59:50.169418 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1414466587 Aug 10 23:59:50.169418 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-ServersNegativeTestJSON-1414466587-project Aug 10 23:59:50.169418 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:59:50.169418 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:59:50.169418 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: 51eb0ebf6fe74ef59a3665423ccf3e11 Aug 10 23:59:50.169418 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-ServersNegativeTestJSON-1414466587-project Aug 10 23:59:50.169418 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:59:50.169418 n-d-850468-14 devstack@n-api.service[122632]: exception: Instance ea828e76-3d4b-4465-937b-ccd57b0435a7 could not be found. Aug 10 23:59:50.169418 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': 'ea828e76-3d4b-4465-937b-ccd57b0435a7'} Aug 10 23:59:50.169418 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:59:50.169418 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:59:50.169418 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:59:50.169418 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:59:50.169418 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:59:50.169418 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:59:50.169418 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:59:50.169418 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:59:50.169418 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:59:50.169418 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:59:50.169418 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea828e76-3d4b-4465-937b-ccd57b0435a7 could not be found. Aug 10 23:59:50.169418 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:59:50.169418 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:59:50.169418 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:59:50.169418 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:59:50.169418 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:59:50.169418 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:59:50.169418 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:59:50.169418 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:59:50.169418 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:59:50.169418 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:59:50.169418 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:59:50.169418 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:59:50.169418 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:59:50.169418 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:59:50.169418 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:59:50.169418 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:59:50.169418 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea828e76-3d4b-4465-937b-ccd57b0435a7 could not be found. Aug 10 23:59:50.169418 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:59:50.169418 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:59:50.169418 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:59:50.173652 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:59:50.173652 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:59:50.173652 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:59:50.173652 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:59:50.173652 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:59:50.173652 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea828e76-3d4b-4465-937b-ccd57b0435a7 could not be found. Aug 10 23:59:50.173652 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:59:50.173652 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-94e44087-ed0a-4c26-a9d7-913ef7793e4a tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Returning 404 to user: Instance ea828e76-3d4b-4465-937b-ccd57b0435a7 could not be found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:59:50.173652 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-94e44087-ed0a-4c26-a9d7-913ef7793e4a tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] 10.222.0.58 "GET /compute/v2.1/servers/ea828e76-3d4b-4465-937b-ccd57b0435a7" status: 404 len: 111 microversion: 2.1 time: 0.032562 Aug 10 23:59:50.173652 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3309/6825] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:59:50 2022] GET /compute/v2.1/servers/ea828e76-3d4b-4465-937b-ccd57b0435a7 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:59:50.180125 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-19542b37-1c10-43c7-8f53-77d3223afb34 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:59:50.180755 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-19542b37-1c10-43c7-8f53-77d3223afb34 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] [instance: bb4d1c69-d34b-497c-9f02-cc89204860b8] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:59:50.187625 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-19542b37-1c10-43c7-8f53-77d3223afb34 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:59:50.188122 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-19542b37-1c10-43c7-8f53-77d3223afb34 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:59:50.188578 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-19542b37-1c10-43c7-8f53-77d3223afb34 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:59:50.189288 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-19542b37-1c10-43c7-8f53-77d3223afb34 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:59:50.189764 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-19542b37-1c10-43c7-8f53-77d3223afb34 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:59:50.190207 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-19542b37-1c10-43c7-8f53-77d3223afb34 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:59:50.618220 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-19542b37-1c10-43c7-8f53-77d3223afb34 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51eb0ebf6fe74ef59a3665423ccf3e11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e06f19039c44ac9a5c62d63d981864', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:59:50.626273 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-19542b37-1c10-43c7-8f53-77d3223afb34 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] 10.222.0.58 "GET /compute/v2.1/servers/bb4d1c69-d34b-497c-9f02-cc89204860b8" status: 200 len: 1505 microversion: 2.1 time: 0.450078 Aug 10 23:59:50.626869 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3517/6826] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:59:50 2022] GET /compute/v2.1/servers/bb4d1c69-d34b-497c-9f02-cc89204860b8 => generated 1505 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:59:50.646574 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-2eb670d9-3223-4525-bf9b-4bab7f250a7f tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:59:50.648881 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-2eb670d9-3223-4525-bf9b-4bab7f250a7f tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] [instance: fcbd4e29-2120-4147-9503-bf8011cded40] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:59:50.654672 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-2eb670d9-3223-4525-bf9b-4bab7f250a7f tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] HTTP exception thrown: Instance fcbd4e29-2120-4147-9503-bf8011cded40 could not be found. Aug 10 23:59:50.656917 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-2eb670d9-3223-4525-bf9b-4bab7f250a7f tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Request method failure captured: Aug 10 23:59:50.656917 n-d-850468-14 devstack@n-api.service[122632]: request: POST /compute/v2.1/servers/fcbd4e29-2120-4147-9503-bf8011cded40/action HTTP/1.1 Aug 10 23:59:50.656917 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:59:50.656917 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:59:50.656917 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:59:50.656917 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 32 Aug 10 23:59:50.656917 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:59:50.656917 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:59:50.656917 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:59:50.656917 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:59:50.656917 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9EZb4WgtLstLSkb-Dh2t6WroCD0SawfTNRavs0vzhW25quPFNY4mLVNEpnQuWVy1p-A4wkg3APSeUXSslVoWHJKn8I0nXuZ3k0JLvWC0gAbkiTwX4O-rVwimwzrkApEOPRlkwFDqnSmR7ttAPcj9I11vw0yeQZhV2ReerXu8GK3dbbY Aug 10 23:59:50.656917 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:59:50.656917 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:59:50.656917 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:59:50.656917 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:59:50.656917 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:59:50.656917 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:59:50.656917 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 33e06f19039c44ac9a5c62d63d981864 Aug 10 23:59:50.656917 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-ServersNegativeTestJSON-1414466587 Aug 10 23:59:50.656917 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:59:50.656917 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:59:50.656917 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/33e06f19039c44ac9a5c62d63d981864"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/33e06f19039c44ac9a5c62d63d981864"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/33e06f19039c44ac9a5c62d63d981864"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_33e06f19039c44ac9a5c62d63d981864", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:59:50.656917 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-ServersNegativeTestJSON-1414466587 Aug 10 23:59:50.656917 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 33e06f19039c44ac9a5c62d63d981864 Aug 10 23:59:50.656917 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1414466587 Aug 10 23:59:50.656917 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-ServersNegativeTestJSON-1414466587-project Aug 10 23:59:50.656917 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:59:50.656917 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:59:50.656917 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: 51eb0ebf6fe74ef59a3665423ccf3e11 Aug 10 23:59:50.656917 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-ServersNegativeTestJSON-1414466587-project Aug 10 23:59:50.656917 n-d-850468-14 devstack@n-api.service[122632]: Aug 10 23:59:50.656917 n-d-850468-14 devstack@n-api.service[122632]: {"resize": {"flavorRef": "452"}} Aug 10 23:59:50.656917 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:59:50.656917 n-d-850468-14 devstack@n-api.service[122632]: exception: Instance fcbd4e29-2120-4147-9503-bf8011cded40 could not be found. Aug 10 23:59:50.656917 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': 'fcbd4e29-2120-4147-9503-bf8011cded40', 'body': {'resize': {'flavorRef': '452'}}} Aug 10 23:59:50.656917 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:59:50.656917 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:59:50.656917 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:59:50.656917 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:59:50.656917 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:59:50.656917 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:59:50.656917 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2900, in _get_instance Aug 10 23:59:50.656917 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 10 23:59:50.656917 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fcbd4e29-2120-4147-9503-bf8011cded40 could not be found. Aug 10 23:59:50.656917 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:59:50.656917 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:59:50.656917 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:59:50.656917 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:59:50.656917 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:59:50.656917 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:59:50.656917 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:59:50.656917 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:59:50.656917 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:59:50.656917 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:59:50.656917 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 23:59:50.656917 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 23:59:50.656917 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Aug 10 23:59:50.656917 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 10 23:59:50.656917 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1046, in _resize Aug 10 23:59:50.656917 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, Aug 10 23:59:50.656917 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:59:50.656917 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:59:50.656917 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:59:50.656917 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:59:50.661799 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fcbd4e29-2120-4147-9503-bf8011cded40 could not be found. Aug 10 23:59:50.661799 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:59:50.661799 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:59:50.661799 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:59:50.661799 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:59:50.661799 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:59:50.661799 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:59:50.661799 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:59:50.661799 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:59:50.661799 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fcbd4e29-2120-4147-9503-bf8011cded40 could not be found. Aug 10 23:59:50.661799 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:59:50.661799 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-2eb670d9-3223-4525-bf9b-4bab7f250a7f tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Returning 404 to user: Instance fcbd4e29-2120-4147-9503-bf8011cded40 could not be found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:59:50.661799 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-2eb670d9-3223-4525-bf9b-4bab7f250a7f tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] 10.222.0.58 "POST /compute/v2.1/servers/fcbd4e29-2120-4147-9503-bf8011cded40/action" status: 404 len: 111 microversion: 2.1 time: 0.015725 Aug 10 23:59:50.661799 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3310/6827] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:59:50 2022] POST /compute/v2.1/servers/fcbd4e29-2120-4147-9503-bf8011cded40/action => generated 111 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:59:50.667764 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-713fac1c-76bb-4e13-8899-87107a635312 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:59:50.668395 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-713fac1c-76bb-4e13-8899-87107a635312 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] [instance: bb4d1c69-d34b-497c-9f02-cc89204860b8] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:59:50.674446 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-713fac1c-76bb-4e13-8899-87107a635312 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:59:50.674984 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-713fac1c-76bb-4e13-8899-87107a635312 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:59:50.676089 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-713fac1c-76bb-4e13-8899-87107a635312 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:59:50.676804 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-713fac1c-76bb-4e13-8899-87107a635312 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:59:50.677271 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-713fac1c-76bb-4e13-8899-87107a635312 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:59:50.677710 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-713fac1c-76bb-4e13-8899-87107a635312 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:59:50.681762 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:59:50.811889 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-713fac1c-76bb-4e13-8899-87107a635312 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51eb0ebf6fe74ef59a3665423ccf3e11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e06f19039c44ac9a5c62d63d981864', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:59:50.819655 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-713fac1c-76bb-4e13-8899-87107a635312 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] 10.222.0.58 "GET /compute/v2.1/servers/bb4d1c69-d34b-497c-9f02-cc89204860b8" status: 200 len: 1505 microversion: 2.1 time: 0.155849 Aug 10 23:59:50.820235 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3518/6828] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:59:50 2022] GET /compute/v2.1/servers/bb4d1c69-d34b-497c-9f02-cc89204860b8 => generated 1505 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:59:50.841108 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c9a3c5f0-d690-48f5-806e-7d65389eeca5 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:59:50.841715 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-c9a3c5f0-d690-48f5-806e-7d65389eeca5 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] [instance: bb4d1c69-d34b-497c-9f02-cc89204860b8] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:59:50.849466 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c9a3c5f0-d690-48f5-806e-7d65389eeca5 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:59:50.849949 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c9a3c5f0-d690-48f5-806e-7d65389eeca5 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:59:50.850390 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c9a3c5f0-d690-48f5-806e-7d65389eeca5 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:59:50.851123 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c9a3c5f0-d690-48f5-806e-7d65389eeca5 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:59:50.851579 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c9a3c5f0-d690-48f5-806e-7d65389eeca5 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:59:50.852003 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c9a3c5f0-d690-48f5-806e-7d65389eeca5 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:59:50.986727 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-c9a3c5f0-d690-48f5-806e-7d65389eeca5 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51eb0ebf6fe74ef59a3665423ccf3e11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e06f19039c44ac9a5c62d63d981864', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:59:50.994463 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-c9a3c5f0-d690-48f5-806e-7d65389eeca5 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] 10.222.0.58 "GET /compute/v2.1/servers/bb4d1c69-d34b-497c-9f02-cc89204860b8" status: 200 len: 1505 microversion: 2.1 time: 0.157241 Aug 10 23:59:50.995083 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3311/6829] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:59:50 2022] GET /compute/v2.1/servers/bb4d1c69-d34b-497c-9f02-cc89204860b8 => generated 1505 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:59:51.014891 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-332a1977-3cb8-4c69-a452-b047afc4b520 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "ed156ef4-2a0e-4ad6-b7a3-e25292a88ab5"}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:59:51.017259 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-332a1977-3cb8-4c69-a452-b047afc4b520 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] [instance: bb4d1c69-d34b-497c-9f02-cc89204860b8] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:59:51.024028 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-332a1977-3cb8-4c69-a452-b047afc4b520 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:59:51.024528 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-332a1977-3cb8-4c69-a452-b047afc4b520 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:59:51.024981 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-332a1977-3cb8-4c69-a452-b047afc4b520 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:59:51.025698 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-332a1977-3cb8-4c69-a452-b047afc4b520 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:59:51.026170 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-332a1977-3cb8-4c69-a452-b047afc4b520 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:59:51.026612 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-332a1977-3cb8-4c69-a452-b047afc4b520 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:59:51.055366 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-332a1977-3cb8-4c69-a452-b047afc4b520 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '51eb0ebf6fe74ef59a3665423ccf3e11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e06f19039c44ac9a5c62d63d981864', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:59:51.060715 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-332a1977-3cb8-4c69-a452-b047afc4b520 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] HTTP exception thrown: Flavor ed156ef4-2a0e-4ad6-b7a3-e25292a88ab5 could not be found. Aug 10 23:59:51.062612 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-332a1977-3cb8-4c69-a452-b047afc4b520 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Request method failure captured: Aug 10 23:59:51.062612 n-d-850468-14 devstack@n-api.service[122633]: request: POST /compute/v2.1/servers/bb4d1c69-d34b-497c-9f02-cc89204860b8/action HTTP/1.1 Aug 10 23:59:51.062612 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:59:51.062612 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:59:51.062612 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:59:51.062612 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 65 Aug 10 23:59:51.062612 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:59:51.062612 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:59:51.062612 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:59:51.062612 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:59:51.062612 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9EZb4WgtLstLSkb-Dh2t6WroCD0SawfTNRavs0vzhW25quPFNY4mLVNEpnQuWVy1p-A4wkg3APSeUXSslVoWHJKn8I0nXuZ3k0JLvWC0gAbkiTwX4O-rVwimwzrkApEOPRlkwFDqnSmR7ttAPcj9I11vw0yeQZhV2ReerXu8GK3dbbY Aug 10 23:59:51.062612 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:59:51.062612 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:59:51.062612 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:59:51.062612 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:59:51.062612 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:59:51.062612 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:59:51.062612 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 33e06f19039c44ac9a5c62d63d981864 Aug 10 23:59:51.062612 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-ServersNegativeTestJSON-1414466587 Aug 10 23:59:51.062612 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:59:51.062612 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:59:51.062612 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/33e06f19039c44ac9a5c62d63d981864"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/33e06f19039c44ac9a5c62d63d981864"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/33e06f19039c44ac9a5c62d63d981864"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_33e06f19039c44ac9a5c62d63d981864", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:59:51.062612 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-ServersNegativeTestJSON-1414466587 Aug 10 23:59:51.062612 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 33e06f19039c44ac9a5c62d63d981864 Aug 10 23:59:51.062612 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1414466587 Aug 10 23:59:51.062612 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-ServersNegativeTestJSON-1414466587-project Aug 10 23:59:51.062612 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:59:51.062612 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:59:51.062612 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 51eb0ebf6fe74ef59a3665423ccf3e11 Aug 10 23:59:51.062612 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-ServersNegativeTestJSON-1414466587-project Aug 10 23:59:51.062612 n-d-850468-14 devstack@n-api.service[122633]: Aug 10 23:59:51.062612 n-d-850468-14 devstack@n-api.service[122633]: {"resize": {"flavorRef": "ed156ef4-2a0e-4ad6-b7a3-e25292a88ab5"}} Aug 10 23:59:51.062612 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:59:51.062612 n-d-850468-14 devstack@n-api.service[122633]: exception: Flavor ed156ef4-2a0e-4ad6-b7a3-e25292a88ab5 could not be found. Aug 10 23:59:51.062612 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': 'bb4d1c69-d34b-497c-9f02-cc89204860b8', 'body': {'resize': {'flavorRef': 'ed156ef4-2a0e-4ad6-b7a3-e25292a88ab5'}}} Aug 10 23:59:51.062612 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:59:51.062612 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:59:51.062612 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Aug 10 23:59:51.062612 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Aug 10 23:59:51.062612 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Aug 10 23:59:51.062612 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 10 23:59:51.062612 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Aug 10 23:59:51.062612 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 10 23:59:51.062612 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Aug 10 23:59:51.062612 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 10 23:59:51.062612 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Aug 10 23:59:51.062612 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 10 23:59:51.062612 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 10 23:59:51.062612 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 10 23:59:51.062612 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 10 23:59:51.062612 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 10 23:59:51.062612 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 10 23:59:51.062612 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 10 23:59:51.062612 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4148, in resize Aug 10 23:59:51.062612 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( Aug 10 23:59:51.062612 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 10 23:59:51.062612 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 10 23:59:51.062612 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 10 23:59:51.062612 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 10 23:59:51.062612 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 10 23:59:51.062612 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 10 23:59:51.062612 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 10 23:59:51.066867 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:59:51.066867 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 10 23:59:51.066867 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 10 23:59:51.066867 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor ed156ef4-2a0e-4ad6-b7a3-e25292a88ab5 could not be found. Aug 10 23:59:51.066867 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:59:51.066867 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:59:51.066867 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:59:51.066867 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:59:51.066867 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:59:51.066867 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:59:51.066867 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:59:51.066867 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:59:51.066867 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:59:51.066867 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:59:51.066867 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 10 23:59:51.066867 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 10 23:59:51.066867 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Aug 10 23:59:51.066867 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 10 23:59:51.066867 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1083, in _resize Aug 10 23:59:51.066867 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 10 23:59:51.066867 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor ed156ef4-2a0e-4ad6-b7a3-e25292a88ab5 could not be found. Aug 10 23:59:51.066867 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:59:51.066867 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:59:51.066867 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:59:51.066867 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:59:51.066867 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:59:51.066867 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:59:51.066867 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:59:51.066867 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:59:51.066867 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor ed156ef4-2a0e-4ad6-b7a3-e25292a88ab5 could not be found. Aug 10 23:59:51.066867 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:59:51.066867 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-332a1977-3cb8-4c69-a452-b047afc4b520 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Returning 400 to user: Flavor ed156ef4-2a0e-4ad6-b7a3-e25292a88ab5 could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:59:51.066867 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-332a1977-3cb8-4c69-a452-b047afc4b520 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] 10.222.0.58 "POST /compute/v2.1/servers/bb4d1c69-d34b-497c-9f02-cc89204860b8/action" status: 400 len: 107 microversion: 2.1 time: 0.053301 Aug 10 23:59:51.066867 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3519/6830] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:59:51 2022] POST /compute/v2.1/servers/bb4d1c69-d34b-497c-9f02-cc89204860b8/action => generated 107 bytes in 54 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 10 23:59:51.073182 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-9c7abd56-f6a3-412b-9e75-5d2f1cfdaf67 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:59:51.073794 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-9c7abd56-f6a3-412b-9e75-5d2f1cfdaf67 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] [instance: bb4d1c69-d34b-497c-9f02-cc89204860b8] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:59:51.079735 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9c7abd56-f6a3-412b-9e75-5d2f1cfdaf67 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:59:51.080218 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9c7abd56-f6a3-412b-9e75-5d2f1cfdaf67 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:59:51.080654 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9c7abd56-f6a3-412b-9e75-5d2f1cfdaf67 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:59:51.081940 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9c7abd56-f6a3-412b-9e75-5d2f1cfdaf67 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:59:51.082394 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9c7abd56-f6a3-412b-9e75-5d2f1cfdaf67 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:59:51.082846 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9c7abd56-f6a3-412b-9e75-5d2f1cfdaf67 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:59:51.212677 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-9c7abd56-f6a3-412b-9e75-5d2f1cfdaf67 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51eb0ebf6fe74ef59a3665423ccf3e11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e06f19039c44ac9a5c62d63d981864', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:59:51.220270 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-9c7abd56-f6a3-412b-9e75-5d2f1cfdaf67 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] 10.222.0.58 "GET /compute/v2.1/servers/bb4d1c69-d34b-497c-9f02-cc89204860b8" status: 200 len: 1505 microversion: 2.1 time: 0.150957 Aug 10 23:59:51.220857 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3312/6831] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:59:51 2022] GET /compute/v2.1/servers/bb4d1c69-d34b-497c-9f02-cc89204860b8 => generated 1505 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:59:51.241994 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-28513e59-52b8-40c7-aa6b-98f3c1408ba4 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:59:51.242639 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-28513e59-52b8-40c7-aa6b-98f3c1408ba4 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] [instance: bb4d1c69-d34b-497c-9f02-cc89204860b8] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:59:51.249619 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-28513e59-52b8-40c7-aa6b-98f3c1408ba4 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:59:51.250110 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-28513e59-52b8-40c7-aa6b-98f3c1408ba4 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:59:51.250555 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-28513e59-52b8-40c7-aa6b-98f3c1408ba4 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:59:51.251278 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-28513e59-52b8-40c7-aa6b-98f3c1408ba4 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:59:51.251742 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-28513e59-52b8-40c7-aa6b-98f3c1408ba4 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:59:51.252177 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-28513e59-52b8-40c7-aa6b-98f3c1408ba4 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:59:51.389353 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-28513e59-52b8-40c7-aa6b-98f3c1408ba4 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51eb0ebf6fe74ef59a3665423ccf3e11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e06f19039c44ac9a5c62d63d981864', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:59:51.397697 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-28513e59-52b8-40c7-aa6b-98f3c1408ba4 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] 10.222.0.58 "GET /compute/v2.1/servers/bb4d1c69-d34b-497c-9f02-cc89204860b8" status: 200 len: 1505 microversion: 2.1 time: 0.160158 Aug 10 23:59:51.398275 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3520/6832] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:59:51 2022] GET /compute/v2.1/servers/bb4d1c69-d34b-497c-9f02-cc89204860b8 => generated 1505 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:59:51.417784 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-151fcfcb-5915-4ac9-a9e6-995430efb970 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:59:51.421370 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-151fcfcb-5915-4ac9-a9e6-995430efb970 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Request method failure captured: Aug 10 23:59:51.421370 n-d-850468-14 devstack@n-api.service[122632]: request: POST /compute/v2.1/servers/bb4d1c69-d34b-497c-9f02-cc89204860b8/action HTTP/1.1 Aug 10 23:59:51.421370 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:59:51.421370 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:59:51.421370 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:59:51.421370 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 29 Aug 10 23:59:51.421370 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:59:51.421370 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:59:51.421370 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:59:51.421370 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:59:51.421370 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9EZb4WgtLstLSkb-Dh2t6WroCD0SawfTNRavs0vzhW25quPFNY4mLVNEpnQuWVy1p-A4wkg3APSeUXSslVoWHJKn8I0nXuZ3k0JLvWC0gAbkiTwX4O-rVwimwzrkApEOPRlkwFDqnSmR7ttAPcj9I11vw0yeQZhV2ReerXu8GK3dbbY Aug 10 23:59:51.421370 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:59:51.421370 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:59:51.421370 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:59:51.421370 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:59:51.421370 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:59:51.421370 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:59:51.421370 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 33e06f19039c44ac9a5c62d63d981864 Aug 10 23:59:51.421370 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-ServersNegativeTestJSON-1414466587 Aug 10 23:59:51.421370 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:59:51.421370 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:59:51.421370 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/33e06f19039c44ac9a5c62d63d981864"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/33e06f19039c44ac9a5c62d63d981864"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/33e06f19039c44ac9a5c62d63d981864"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_33e06f19039c44ac9a5c62d63d981864", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:59:51.421370 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-ServersNegativeTestJSON-1414466587 Aug 10 23:59:51.421370 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 33e06f19039c44ac9a5c62d63d981864 Aug 10 23:59:51.421370 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1414466587 Aug 10 23:59:51.421370 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-ServersNegativeTestJSON-1414466587-project Aug 10 23:59:51.421370 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:59:51.421370 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:59:51.421370 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: 51eb0ebf6fe74ef59a3665423ccf3e11 Aug 10 23:59:51.421370 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-ServersNegativeTestJSON-1414466587-project Aug 10 23:59:51.421370 n-d-850468-14 devstack@n-api.service[122632]: Aug 10 23:59:51.421370 n-d-850468-14 devstack@n-api.service[122632]: {"resize": {"flavorRef": ""}} Aug 10 23:59:51.421370 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:59:51.421370 n-d-850468-14 devstack@n-api.service[122632]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short Aug 10 23:59:51.421370 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': 'bb4d1c69-d34b-497c-9f02-cc89204860b8', 'body': {'resize': {'flavorRef': ''}}} Aug 10 23:59:51.421370 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:59:51.421370 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:59:51.421370 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 10 23:59:51.421370 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 10 23:59:51.421370 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 10 23:59:51.421370 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise error Aug 10 23:59:51.421370 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 10 23:59:51.421370 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:59:51.421370 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: Aug 10 23:59:51.421370 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} Aug 10 23:59:51.421370 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:59:51.421370 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi On instance['resize']: Aug 10 23:59:51.421370 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi '' Aug 10 23:59:51.421370 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:59:51.421370 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:59:51.421370 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:59:51.421370 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:59:51.421370 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:59:51.421370 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:59:51.421370 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:59:51.421370 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:59:51.421370 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:59:51.421370 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:59:51.421370 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 10 23:59:51.421370 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 10 23:59:51.421370 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 10 23:59:51.421370 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 10 23:59:51.421370 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 10 23:59:51.421370 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 10 23:59:51.421370 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short Aug 10 23:59:51.421370 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:59:51.421370 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:59:51.425426 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:59:51.425426 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:59:51.425426 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:59:51.425426 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:59:51.425426 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 10 23:59:51.425426 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 10 23:59:51.425426 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short Aug 10 23:59:51.425426 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:59:51.425426 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-151fcfcb-5915-4ac9-a9e6-995430efb970 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:59:51.425426 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-151fcfcb-5915-4ac9-a9e6-995430efb970 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] 10.222.0.58 "POST /compute/v2.1/servers/bb4d1c69-d34b-497c-9f02-cc89204860b8/action" status: 400 len: 113 microversion: 2.1 time: 0.008926 Aug 10 23:59:51.425426 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3313/6833] 10.222.0.58 () {60 vars in 1278 bytes} [Wed Aug 10 23:59:51 2022] POST /compute/v2.1/servers/bb4d1c69-d34b-497c-9f02-cc89204860b8/action => generated 113 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 10 23:59:51.431477 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-60e4d082-d1cf-4b61-bab4-16d97e49c38b tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:59:51.432103 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-60e4d082-d1cf-4b61-bab4-16d97e49c38b tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] [instance: bb4d1c69-d34b-497c-9f02-cc89204860b8] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:59:51.438109 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-60e4d082-d1cf-4b61-bab4-16d97e49c38b tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:59:51.438609 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-60e4d082-d1cf-4b61-bab4-16d97e49c38b tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:59:51.439111 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-60e4d082-d1cf-4b61-bab4-16d97e49c38b tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:59:51.439823 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-60e4d082-d1cf-4b61-bab4-16d97e49c38b tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:59:51.440294 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-60e4d082-d1cf-4b61-bab4-16d97e49c38b tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:59:51.441365 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-60e4d082-d1cf-4b61-bab4-16d97e49c38b tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:59:51.580426 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-60e4d082-d1cf-4b61-bab4-16d97e49c38b tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51eb0ebf6fe74ef59a3665423ccf3e11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e06f19039c44ac9a5c62d63d981864', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:59:51.588232 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-60e4d082-d1cf-4b61-bab4-16d97e49c38b tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] 10.222.0.58 "GET /compute/v2.1/servers/bb4d1c69-d34b-497c-9f02-cc89204860b8" status: 200 len: 1505 microversion: 2.1 time: 0.160533 Aug 10 23:59:51.588733 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3521/6834] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:59:51 2022] GET /compute/v2.1/servers/bb4d1c69-d34b-497c-9f02-cc89204860b8 => generated 1505 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:59:51.612463 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-f2e153ef-12de-4fcf-851a-28adef68ef30 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:59:51.613691 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-f2e153ef-12de-4fcf-851a-28adef68ef30 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] [instance: ea828e76-3d4b-4465-937b-ccd57b0435a7] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:59:51.621179 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f2e153ef-12de-4fcf-851a-28adef68ef30 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:59:51.621651 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f2e153ef-12de-4fcf-851a-28adef68ef30 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:59:51.622080 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f2e153ef-12de-4fcf-851a-28adef68ef30 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:59:51.622769 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f2e153ef-12de-4fcf-851a-28adef68ef30 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:59:51.623248 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f2e153ef-12de-4fcf-851a-28adef68ef30 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:59:51.623669 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f2e153ef-12de-4fcf-851a-28adef68ef30 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:59:51.638144 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-f2e153ef-12de-4fcf-851a-28adef68ef30 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] HTTP exception thrown: Instance ea828e76-3d4b-4465-937b-ccd57b0435a7 could not be found. Aug 10 23:59:51.639771 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-f2e153ef-12de-4fcf-851a-28adef68ef30 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Request method failure captured: Aug 10 23:59:51.639771 n-d-850468-14 devstack@n-api.service[122632]: request: DELETE /compute/v2.1/servers/ea828e76-3d4b-4465-937b-ccd57b0435a7 HTTP/1.1 Aug 10 23:59:51.639771 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:59:51.639771 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:59:51.639771 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:59:51.639771 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 23:59:51.639771 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:59:51.639771 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:59:51.639771 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:59:51.639771 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:59:51.639771 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9EZb4WgtLstLSkb-Dh2t6WroCD0SawfTNRavs0vzhW25quPFNY4mLVNEpnQuWVy1p-A4wkg3APSeUXSslVoWHJKn8I0nXuZ3k0JLvWC0gAbkiTwX4O-rVwimwzrkApEOPRlkwFDqnSmR7ttAPcj9I11vw0yeQZhV2ReerXu8GK3dbbY Aug 10 23:59:51.639771 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:59:51.639771 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:59:51.639771 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:59:51.639771 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:59:51.639771 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:59:51.639771 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:59:51.639771 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 33e06f19039c44ac9a5c62d63d981864 Aug 10 23:59:51.639771 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-ServersNegativeTestJSON-1414466587 Aug 10 23:59:51.639771 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:59:51.639771 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:59:51.639771 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/33e06f19039c44ac9a5c62d63d981864"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/33e06f19039c44ac9a5c62d63d981864"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/33e06f19039c44ac9a5c62d63d981864"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_33e06f19039c44ac9a5c62d63d981864", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:59:51.639771 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-ServersNegativeTestJSON-1414466587 Aug 10 23:59:51.639771 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 33e06f19039c44ac9a5c62d63d981864 Aug 10 23:59:51.639771 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1414466587 Aug 10 23:59:51.639771 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-ServersNegativeTestJSON-1414466587-project Aug 10 23:59:51.639771 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:59:51.639771 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:59:51.639771 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: 51eb0ebf6fe74ef59a3665423ccf3e11 Aug 10 23:59:51.639771 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-ServersNegativeTestJSON-1414466587-project Aug 10 23:59:51.639771 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:59:51.639771 n-d-850468-14 devstack@n-api.service[122632]: exception: Instance ea828e76-3d4b-4465-937b-ccd57b0435a7 could not be found. Aug 10 23:59:51.639771 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': 'ea828e76-3d4b-4465-937b-ccd57b0435a7'} Aug 10 23:59:51.639771 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:59:51.639771 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:59:51.639771 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:59:51.639771 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:59:51.639771 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:59:51.639771 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:59:51.639771 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:59:51.639771 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:59:51.639771 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:59:51.639771 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:59:51.639771 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea828e76-3d4b-4465-937b-ccd57b0435a7 could not be found. Aug 10 23:59:51.639771 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:59:51.639771 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:59:51.639771 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:59:51.639771 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:59:51.639771 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:59:51.639771 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:59:51.639771 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:59:51.639771 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:59:51.639771 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:59:51.639771 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:59:51.639771 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 10 23:59:51.639771 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 10 23:59:51.639771 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 10 23:59:51.639771 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 10 23:59:51.639771 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:59:51.639771 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:59:51.639771 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:59:51.639771 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:59:51.643540 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea828e76-3d4b-4465-937b-ccd57b0435a7 could not be found. Aug 10 23:59:51.643540 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:59:51.643540 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:59:51.643540 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:59:51.643540 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:59:51.643540 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:59:51.643540 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:59:51.643540 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:59:51.643540 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:59:51.643540 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea828e76-3d4b-4465-937b-ccd57b0435a7 could not be found. Aug 10 23:59:51.643540 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:59:51.643540 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-f2e153ef-12de-4fcf-851a-28adef68ef30 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Returning 404 to user: Instance ea828e76-3d4b-4465-937b-ccd57b0435a7 could not be found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:59:51.643540 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-f2e153ef-12de-4fcf-851a-28adef68ef30 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] 10.222.0.58 "DELETE /compute/v2.1/servers/ea828e76-3d4b-4465-937b-ccd57b0435a7" status: 404 len: 111 microversion: 2.1 time: 0.033284 Aug 10 23:59:51.643540 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3314/6835] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:59:51 2022] DELETE /compute/v2.1/servers/ea828e76-3d4b-4465-937b-ccd57b0435a7 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:59:51.649873 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-6d841043-41c7-401c-a6f8-6bf4c250a4f2 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:59:51.650503 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-6d841043-41c7-401c-a6f8-6bf4c250a4f2 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] [instance: ea828e76-3d4b-4465-937b-ccd57b0435a7] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:59:51.656811 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6d841043-41c7-401c-a6f8-6bf4c250a4f2 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:59:51.657207 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6d841043-41c7-401c-a6f8-6bf4c250a4f2 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:59:51.657667 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6d841043-41c7-401c-a6f8-6bf4c250a4f2 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:59:51.658381 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6d841043-41c7-401c-a6f8-6bf4c250a4f2 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:59:51.658880 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6d841043-41c7-401c-a6f8-6bf4c250a4f2 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:59:51.659326 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6d841043-41c7-401c-a6f8-6bf4c250a4f2 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:59:51.672959 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-6d841043-41c7-401c-a6f8-6bf4c250a4f2 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] HTTP exception thrown: Instance ea828e76-3d4b-4465-937b-ccd57b0435a7 could not be found. Aug 10 23:59:51.674577 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-6d841043-41c7-401c-a6f8-6bf4c250a4f2 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Request method failure captured: Aug 10 23:59:51.674577 n-d-850468-14 devstack@n-api.service[122633]: request: GET /compute/v2.1/servers/ea828e76-3d4b-4465-937b-ccd57b0435a7 HTTP/1.1 Aug 10 23:59:51.674577 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 10 23:59:51.674577 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 10 23:59:51.674577 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 10 23:59:51.674577 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 10 23:59:51.674577 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 10 23:59:51.674577 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 10 23:59:51.674577 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 10 23:59:51.674577 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 10 23:59:51.674577 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9EZb4WgtLstLSkb-Dh2t6WroCD0SawfTNRavs0vzhW25quPFNY4mLVNEpnQuWVy1p-A4wkg3APSeUXSslVoWHJKn8I0nXuZ3k0JLvWC0gAbkiTwX4O-rVwimwzrkApEOPRlkwFDqnSmR7ttAPcj9I11vw0yeQZhV2ReerXu8GK3dbbY Aug 10 23:59:51.674577 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 10 23:59:51.674577 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 10 23:59:51.674577 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 10 23:59:51.674577 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 10 23:59:51.674577 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 10 23:59:51.674577 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 10 23:59:51.674577 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 33e06f19039c44ac9a5c62d63d981864 Aug 10 23:59:51.674577 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-ServersNegativeTestJSON-1414466587 Aug 10 23:59:51.674577 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 10 23:59:51.674577 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 10 23:59:51.674577 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/33e06f19039c44ac9a5c62d63d981864"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/33e06f19039c44ac9a5c62d63d981864"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/33e06f19039c44ac9a5c62d63d981864"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_33e06f19039c44ac9a5c62d63d981864", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:59:51.674577 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-ServersNegativeTestJSON-1414466587 Aug 10 23:59:51.674577 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 33e06f19039c44ac9a5c62d63d981864 Aug 10 23:59:51.674577 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1414466587 Aug 10 23:59:51.674577 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-ServersNegativeTestJSON-1414466587-project Aug 10 23:59:51.674577 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 10 23:59:51.674577 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 10 23:59:51.674577 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 51eb0ebf6fe74ef59a3665423ccf3e11 Aug 10 23:59:51.674577 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-ServersNegativeTestJSON-1414466587-project Aug 10 23:59:51.674577 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 10 23:59:51.674577 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance ea828e76-3d4b-4465-937b-ccd57b0435a7 could not be found. Aug 10 23:59:51.674577 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': 'ea828e76-3d4b-4465-937b-ccd57b0435a7'} Aug 10 23:59:51.674577 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:59:51.674577 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:59:51.674577 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:59:51.674577 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:59:51.674577 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:59:51.674577 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:59:51.674577 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:59:51.674577 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:59:51.674577 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:59:51.674577 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:59:51.674577 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea828e76-3d4b-4465-937b-ccd57b0435a7 could not be found. Aug 10 23:59:51.674577 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:59:51.674577 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:59:51.674577 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:59:51.674577 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:59:51.674577 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:59:51.674577 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:59:51.674577 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:59:51.674577 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:59:51.674577 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:59:51.674577 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:59:51.674577 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:59:51.674577 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:59:51.674577 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:59:51.674577 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:59:51.674577 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:59:51.674577 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:59:51.674577 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea828e76-3d4b-4465-937b-ccd57b0435a7 could not be found. Aug 10 23:59:51.674577 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:59:51.674577 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:59:51.674577 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:59:51.679676 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:59:51.679676 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:59:51.679676 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:59:51.679676 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:59:51.679676 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:59:51.679676 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea828e76-3d4b-4465-937b-ccd57b0435a7 could not be found. Aug 10 23:59:51.679676 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 10 23:59:51.679676 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-6d841043-41c7-401c-a6f8-6bf4c250a4f2 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Returning 404 to user: Instance ea828e76-3d4b-4465-937b-ccd57b0435a7 could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:59:51.679676 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-6d841043-41c7-401c-a6f8-6bf4c250a4f2 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] 10.222.0.58 "GET /compute/v2.1/servers/ea828e76-3d4b-4465-937b-ccd57b0435a7" status: 404 len: 111 microversion: 2.1 time: 0.030743 Aug 10 23:59:51.679676 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3522/6836] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:59:51 2022] GET /compute/v2.1/servers/ea828e76-3d4b-4465-937b-ccd57b0435a7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 10 23:59:51.685343 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-39310997-cfa5-49ab-a6f5-4d848ce9de33 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:59:51.685849 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-39310997-cfa5-49ab-a6f5-4d848ce9de33 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] [instance: bb4d1c69-d34b-497c-9f02-cc89204860b8] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:59:51.692785 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-39310997-cfa5-49ab-a6f5-4d848ce9de33 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:59:51.693270 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-39310997-cfa5-49ab-a6f5-4d848ce9de33 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:59:51.693716 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-39310997-cfa5-49ab-a6f5-4d848ce9de33 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:59:51.694421 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-39310997-cfa5-49ab-a6f5-4d848ce9de33 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:59:51.694906 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-39310997-cfa5-49ab-a6f5-4d848ce9de33 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:59:51.695336 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-39310997-cfa5-49ab-a6f5-4d848ce9de33 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:59:51.720267 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-39310997-cfa5-49ab-a6f5-4d848ce9de33 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] [instance: bb4d1c69-d34b-497c-9f02-cc89204860b8] Going to try to terminate instance {{(pid=122632) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 10 23:59:51.799858 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-39310997-cfa5-49ab-a6f5-4d848ce9de33 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] 10.222.0.58 "DELETE /compute/v2.1/servers/bb4d1c69-d34b-497c-9f02-cc89204860b8" status: 204 len: 0 microversion: 2.1 time: 0.117921 Aug 10 23:59:51.801082 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3315/6837] 10.222.0.58 () {58 vars in 1239 bytes} [Wed Aug 10 23:59:51 2022] DELETE /compute/v2.1/servers/bb4d1c69-d34b-497c-9f02-cc89204860b8 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 10 23:59:51.809914 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-8a95bcf9-aec7-404d-a2fa-d670e33d9a0b tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:59:51.810541 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-8a95bcf9-aec7-404d-a2fa-d670e33d9a0b tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] [instance: bb4d1c69-d34b-497c-9f02-cc89204860b8] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:59:51.817316 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8a95bcf9-aec7-404d-a2fa-d670e33d9a0b tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:59:51.817835 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8a95bcf9-aec7-404d-a2fa-d670e33d9a0b tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:59:51.818280 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8a95bcf9-aec7-404d-a2fa-d670e33d9a0b tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:59:51.819062 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8a95bcf9-aec7-404d-a2fa-d670e33d9a0b tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:59:51.819539 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8a95bcf9-aec7-404d-a2fa-d670e33d9a0b tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:59:51.819985 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8a95bcf9-aec7-404d-a2fa-d670e33d9a0b tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:59:51.952240 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-8a95bcf9-aec7-404d-a2fa-d670e33d9a0b tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51eb0ebf6fe74ef59a3665423ccf3e11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e06f19039c44ac9a5c62d63d981864', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:59:51.960185 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-8a95bcf9-aec7-404d-a2fa-d670e33d9a0b tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] 10.222.0.58 "GET /compute/v2.1/servers/bb4d1c69-d34b-497c-9f02-cc89204860b8" status: 200 len: 1511 microversion: 2.1 time: 0.154558 Aug 10 23:59:51.960759 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3523/6838] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:59:51 2022] GET /compute/v2.1/servers/bb4d1c69-d34b-497c-9f02-cc89204860b8 => generated 1511 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:59:52.982430 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-3b89de5a-4519-4773-91f6-15ea35e5391c tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:59:52.983166 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-3b89de5a-4519-4773-91f6-15ea35e5391c tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] [instance: bb4d1c69-d34b-497c-9f02-cc89204860b8] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:59:52.990159 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3b89de5a-4519-4773-91f6-15ea35e5391c tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:59:52.990644 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3b89de5a-4519-4773-91f6-15ea35e5391c tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:59:52.991115 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3b89de5a-4519-4773-91f6-15ea35e5391c tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:59:52.991809 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3b89de5a-4519-4773-91f6-15ea35e5391c tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:59:52.992261 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3b89de5a-4519-4773-91f6-15ea35e5391c tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:59:52.992684 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3b89de5a-4519-4773-91f6-15ea35e5391c tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:59:52.997556 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:59:53.493213 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-3b89de5a-4519-4773-91f6-15ea35e5391c tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '51eb0ebf6fe74ef59a3665423ccf3e11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33e06f19039c44ac9a5c62d63d981864', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 10 23:59:53.501290 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-3b89de5a-4519-4773-91f6-15ea35e5391c tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] 10.222.0.58 "GET /compute/v2.1/servers/bb4d1c69-d34b-497c-9f02-cc89204860b8" status: 200 len: 1511 microversion: 2.1 time: 0.523156 Aug 10 23:59:53.501869 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3316/6839] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:59:52 2022] GET /compute/v2.1/servers/bb4d1c69-d34b-497c-9f02-cc89204860b8 => generated 1511 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 10 23:59:53.914162 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-4bc81d4a-ef2f-4694-a9a7-4736cc02aeb7 req-de05d779-d9f2-42fa-9b6d-9fc96b417db1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb4d1c69-d34b-497c-9f02-cc89204860b8", "name": "network-vif-deleted", "tag": "8eb4bbaf-9021-4860-ae69-4c26c0b61406"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 10 23:59:53.936164 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-4bc81d4a-ef2f-4694-a9a7-4736cc02aeb7 req-de05d779-d9f2-42fa-9b6d-9fc96b417db1 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:59:53.936685 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-4bc81d4a-ef2f-4694-a9a7-4736cc02aeb7 req-de05d779-d9f2-42fa-9b6d-9fc96b417db1 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:59:53.937143 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-4bc81d4a-ef2f-4694-a9a7-4736cc02aeb7 req-de05d779-d9f2-42fa-9b6d-9fc96b417db1 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:59:53.951021 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-4bc81d4a-ef2f-4694-a9a7-4736cc02aeb7 req-de05d779-d9f2-42fa-9b6d-9fc96b417db1 service nova] Creating event network-vif-deleted:8eb4bbaf-9021-4860-ae69-4c26c0b61406 for instance bb4d1c69-d34b-497c-9f02-cc89204860b8 on n-h1-850468-14 Aug 10 23:59:53.956751 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-4bc81d4a-ef2f-4694-a9a7-4736cc02aeb7 req-de05d779-d9f2-42fa-9b6d-9fc96b417db1 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047681 Aug 10 23:59:53.957702 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3524/6840] 10.222.0.58 () {64 vars in 1317 bytes} [Wed Aug 10 23:59:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 10 23:59:54.522500 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-f0a78112-1e00-42ee-b02b-7a0628d8b294 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 10 23:59:54.523144 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-f0a78112-1e00-42ee-b02b-7a0628d8b294 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] [instance: bb4d1c69-d34b-497c-9f02-cc89204860b8] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 10 23:59:54.525844 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 10 23:59:54.531276 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f0a78112-1e00-42ee-b02b-7a0628d8b294 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:59:54.531771 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f0a78112-1e00-42ee-b02b-7a0628d8b294 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:59:54.532215 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f0a78112-1e00-42ee-b02b-7a0628d8b294 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:59:54.532920 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f0a78112-1e00-42ee-b02b-7a0628d8b294 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 10 23:59:54.533375 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f0a78112-1e00-42ee-b02b-7a0628d8b294 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 10 23:59:54.533805 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f0a78112-1e00-42ee-b02b-7a0628d8b294 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 10 23:59:54.548779 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-f0a78112-1e00-42ee-b02b-7a0628d8b294 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] HTTP exception thrown: Instance bb4d1c69-d34b-497c-9f02-cc89204860b8 could not be found. Aug 10 23:59:54.551133 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-f0a78112-1e00-42ee-b02b-7a0628d8b294 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Request method failure captured: Aug 10 23:59:54.551133 n-d-850468-14 devstack@n-api.service[122632]: request: GET /compute/v2.1/servers/bb4d1c69-d34b-497c-9f02-cc89204860b8 HTTP/1.1 Aug 10 23:59:54.551133 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 10 23:59:54.551133 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 10 23:59:54.551133 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 10 23:59:54.551133 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 10 23:59:54.551133 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 10 23:59:54.551133 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 10 23:59:54.551133 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 10 23:59:54.551133 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 10 23:59:54.551133 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9EZb4WgtLstLSkb-Dh2t6WroCD0SawfTNRavs0vzhW25quPFNY4mLVNEpnQuWVy1p-A4wkg3APSeUXSslVoWHJKn8I0nXuZ3k0JLvWC0gAbkiTwX4O-rVwimwzrkApEOPRlkwFDqnSmR7ttAPcj9I11vw0yeQZhV2ReerXu8GK3dbbY Aug 10 23:59:54.551133 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 10 23:59:54.551133 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 10 23:59:54.551133 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 10 23:59:54.551133 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 10 23:59:54.551133 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 10 23:59:54.551133 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 10 23:59:54.551133 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 33e06f19039c44ac9a5c62d63d981864 Aug 10 23:59:54.551133 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-ServersNegativeTestJSON-1414466587 Aug 10 23:59:54.551133 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 10 23:59:54.551133 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 10 23:59:54.551133 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/33e06f19039c44ac9a5c62d63d981864"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/33e06f19039c44ac9a5c62d63d981864"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/33e06f19039c44ac9a5c62d63d981864"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_33e06f19039c44ac9a5c62d63d981864", "adminURL": "http://10.222.0.58:8080"}]}] Aug 10 23:59:54.551133 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-ServersNegativeTestJSON-1414466587 Aug 10 23:59:54.551133 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 33e06f19039c44ac9a5c62d63d981864 Aug 10 23:59:54.551133 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1414466587 Aug 10 23:59:54.551133 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-ServersNegativeTestJSON-1414466587-project Aug 10 23:59:54.551133 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 10 23:59:54.551133 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 10 23:59:54.551133 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: 51eb0ebf6fe74ef59a3665423ccf3e11 Aug 10 23:59:54.551133 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-ServersNegativeTestJSON-1414466587-project Aug 10 23:59:54.551133 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 10 23:59:54.551133 n-d-850468-14 devstack@n-api.service[122632]: exception: Instance bb4d1c69-d34b-497c-9f02-cc89204860b8 could not be found. Aug 10 23:59:54.551133 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': 'bb4d1c69-d34b-497c-9f02-cc89204860b8'} Aug 10 23:59:54.551133 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 10 23:59:54.551133 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:59:54.551133 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 10 23:59:54.551133 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 10 23:59:54.551133 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 10 23:59:54.551133 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 10 23:59:54.551133 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 10 23:59:54.551133 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 10 23:59:54.551133 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 10 23:59:54.551133 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 10 23:59:54.551133 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb4d1c69-d34b-497c-9f02-cc89204860b8 could not be found. Aug 10 23:59:54.551133 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:59:54.551133 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:59:54.551133 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:59:54.551133 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:59:54.551133 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:59:54.551133 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:59:54.551133 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 10 23:59:54.551133 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 10 23:59:54.551133 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 10 23:59:54.551133 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 10 23:59:54.551133 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 10 23:59:54.551133 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 10 23:59:54.551133 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 10 23:59:54.551133 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 10 23:59:54.551133 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 10 23:59:54.551133 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 10 23:59:54.551133 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb4d1c69-d34b-497c-9f02-cc89204860b8 could not be found. Aug 10 23:59:54.551133 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:59:54.551133 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 10 23:59:54.551133 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:59:54.554870 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 10 23:59:54.554870 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 10 23:59:54.554870 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 10 23:59:54.554870 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 10 23:59:54.554870 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 10 23:59:54.554870 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb4d1c69-d34b-497c-9f02-cc89204860b8 could not be found. Aug 10 23:59:54.554870 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 10 23:59:54.554870 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-f0a78112-1e00-42ee-b02b-7a0628d8b294 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] Returning 404 to user: Instance bb4d1c69-d34b-497c-9f02-cc89204860b8 could not be found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 10 23:59:54.554870 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-f0a78112-1e00-42ee-b02b-7a0628d8b294 tempest-ServersNegativeTestJSON-1414466587 tempest-ServersNegativeTestJSON-1414466587-project] 10.222.0.58 "GET /compute/v2.1/servers/bb4d1c69-d34b-497c-9f02-cc89204860b8" status: 404 len: 111 microversion: 2.1 time: 0.034914 Aug 10 23:59:54.554870 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3317/6841] 10.222.0.58 () {58 vars in 1236 bytes} [Wed Aug 10 23:59:54 2022] GET /compute/v2.1/servers/bb4d1c69-d34b-497c-9f02-cc89204860b8 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 11 00:00:27.149160 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:00:27.150575 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=30 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:00:27.343363 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-9f85f3e4-4dde-4a7f-bb63-a54a5159b3c1 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Action: 'create', calling method: .version_select at 0x7f84823e3790>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-799024316", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFx1xMR6h6d/LYxK37aUMtEpK6oTpZXe9m1O5UYVHpNVTl/gjdYDpCY25qzsGOt32WypQNYJcyfM9e/6gTtqQPd+6RJ8p8IsBInFa0FD8rFrDDaLZxVkapg32upHpxUxcQ=="}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 00:00:27.360819 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-9f85f3e4-4dde-4a7f-bb63-a54a5159b3c1 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Getting quotas for project f35c8636641c43b58b675c29bb52f2e2. Resources: {'key_pairs'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 11 00:00:27.366839 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-9f85f3e4-4dde-4a7f-bb63-a54a5159b3c1 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Getting quotas for user bd92285090ba411194760a83315122d8 and project f35c8636641c43b58b675c29bb52f2e2. Resources: {'key_pairs'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 11 00:00:27.400902 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-9f85f3e4-4dde-4a7f-bb63-a54a5159b3c1 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.254699 Aug 11 00:00:27.401531 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3525/6842] 10.222.0.58 () {60 vars in 1159 bytes} [Thu Aug 11 00:00:27 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 00:00:27.453320 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-0d0aa6ee-db03-4ec9-a45c-ab27b908d3ec tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-625451436", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-799024316", "networks": [{"uuid": "bcefe6cb-4375-4aa9-9183-b8af9f0e6a44"}]}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 00:00:27.462777 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=6 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:00:27.463433 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_api:SELECT=1 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:00:27.509160 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.network.neutron [None req-0d0aa6ee-db03-4ec9-a45c-ab27b908d3ec tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] validate_networks() for [('bcefe6cb-4375-4aa9-9183-b8af9f0e6a44', None, None, None, None, None)] {{(pid=122632) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 11 00:00:27.915788 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-0d0aa6ee-db03-4ec9-a45c-ab27b908d3ec tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Flavor limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 11 00:00:27.916213 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-0d0aa6ee-db03-4ec9-a45c-ab27b908d3ec tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Image limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 11 00:00:27.916692 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-0d0aa6ee-db03-4ec9-a45c-ab27b908d3ec tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Flavor pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 11 00:00:27.917109 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-0d0aa6ee-db03-4ec9-a45c-ab27b908d3ec tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Image pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 11 00:00:27.917649 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-0d0aa6ee-db03-4ec9-a45c-ab27b908d3ec tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 11 00:00:27.929300 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0d0aa6ee-db03-4ec9-a45c-ab27b908d3ec tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:00:27.929813 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0d0aa6ee-db03-4ec9-a45c-ab27b908d3ec tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:00:27.930258 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0d0aa6ee-db03-4ec9-a45c-ab27b908d3ec tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:00:27.931062 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0d0aa6ee-db03-4ec9-a45c-ab27b908d3ec tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:00:27.931545 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0d0aa6ee-db03-4ec9-a45c-ab27b908d3ec tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:00:27.931978 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0d0aa6ee-db03-4ec9-a45c-ab27b908d3ec tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:00:27.951245 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-0d0aa6ee-db03-4ec9-a45c-ab27b908d3ec tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Getting quotas for project f35c8636641c43b58b675c29bb52f2e2. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 11 00:00:27.956947 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-0d0aa6ee-db03-4ec9-a45c-ab27b908d3ec tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Getting quotas for user bd92285090ba411194760a83315122d8 and project f35c8636641c43b58b675c29bb52f2e2. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 11 00:00:27.969347 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-0d0aa6ee-db03-4ec9-a45c-ab27b908d3ec tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Going to run 1 instances... {{(pid=122632) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 11 00:00:27.972571 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-0d0aa6ee-db03-4ec9-a45c-ab27b908d3ec tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] [instance: ffc6f5b1-5da4-4f41-98aa-813ea366ca86] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78ad8905-f66f-4733-8be9-2b260f1fabed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122632) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 11 00:00:28.018531 n-d-850468-14 devstack@n-api.service[122632]: ERROR oslo.messaging._drivers.impl_rabbit [None req-0d0aa6ee-db03-4ec9-a45c-ab27b908d3ec tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] [329ab1ee-3736-4e07-a1dd-a75ba01cbc3b] AMQP server on 10.222.0.58:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 11 00:00:29.028888 n-d-850468-14 devstack@n-api.service[122632]: INFO oslo.messaging._drivers.impl_rabbit [None req-0d0aa6ee-db03-4ec9-a45c-ab27b908d3ec tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] [329ab1ee-3736-4e07-a1dd-a75ba01cbc3b] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 38930. Aug 11 00:00:29.034138 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-0d0aa6ee-db03-4ec9-a45c-ab27b908d3ec tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.584662 Aug 11 00:00:29.034969 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3318/6843] 10.222.0.58 () {60 vars in 1147 bytes} [Thu Aug 11 00:00:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 1586 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 11 00:00:29.047106 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-8102c5cc-1bc7-475a-bd67-f407045cbaff tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:00:29.048361 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-8102c5cc-1bc7-475a-bd67-f407045cbaff tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] [instance: ffc6f5b1-5da4-4f41-98aa-813ea366ca86] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:00:29.138370 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-8102c5cc-1bc7-475a-bd67-f407045cbaff tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd92285090ba411194760a83315122d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35c8636641c43b58b675c29bb52f2e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:00:29.146475 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-8102c5cc-1bc7-475a-bd67-f407045cbaff tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] 10.222.0.58 "GET /compute/v2.1/servers/ffc6f5b1-5da4-4f41-98aa-813ea366ca86" status: 200 len: 1261 microversion: 2.1 time: 0.104490 Aug 11 00:00:29.147096 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3526/6844] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:00:29 2022] GET /compute/v2.1/servers/ffc6f5b1-5da4-4f41-98aa-813ea366ca86 => generated 1261 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:00:30.169117 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-a4cb3c68-64fb-4821-b7a3-06c44e257625 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:00:30.169650 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-a4cb3c68-64fb-4821-b7a3-06c44e257625 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] [instance: ffc6f5b1-5da4-4f41-98aa-813ea366ca86] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:00:30.178806 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a4cb3c68-64fb-4821-b7a3-06c44e257625 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:00:30.179406 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a4cb3c68-64fb-4821-b7a3-06c44e257625 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:00:30.179982 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a4cb3c68-64fb-4821-b7a3-06c44e257625 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:00:30.180703 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a4cb3c68-64fb-4821-b7a3-06c44e257625 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:00:30.181311 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a4cb3c68-64fb-4821-b7a3-06c44e257625 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:00:30.181747 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a4cb3c68-64fb-4821-b7a3-06c44e257625 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:00:30.264203 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-a4cb3c68-64fb-4821-b7a3-06c44e257625 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd92285090ba411194760a83315122d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35c8636641c43b58b675c29bb52f2e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:00:30.273481 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-a4cb3c68-64fb-4821-b7a3-06c44e257625 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] 10.222.0.58 "GET /compute/v2.1/servers/ffc6f5b1-5da4-4f41-98aa-813ea366ca86" status: 200 len: 1319 microversion: 2.1 time: 0.109608 Aug 11 00:00:30.287043 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3319/6845] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:00:30 2022] GET /compute/v2.1/servers/ffc6f5b1-5da4-4f41-98aa-813ea366ca86 => generated 1319 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:00:31.296998 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-20bc901b-a3fe-493e-838f-70faf3723368 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:00:31.298334 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-20bc901b-a3fe-493e-838f-70faf3723368 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] [instance: ffc6f5b1-5da4-4f41-98aa-813ea366ca86] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:00:31.305603 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-20bc901b-a3fe-493e-838f-70faf3723368 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:00:31.306114 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-20bc901b-a3fe-493e-838f-70faf3723368 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:00:31.306575 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-20bc901b-a3fe-493e-838f-70faf3723368 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:00:31.307339 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-20bc901b-a3fe-493e-838f-70faf3723368 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:00:31.307815 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-20bc901b-a3fe-493e-838f-70faf3723368 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:00:31.308262 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-20bc901b-a3fe-493e-838f-70faf3723368 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:00:31.443520 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-20bc901b-a3fe-493e-838f-70faf3723368 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd92285090ba411194760a83315122d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35c8636641c43b58b675c29bb52f2e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:00:31.451205 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-20bc901b-a3fe-493e-838f-70faf3723368 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] 10.222.0.58 "GET /compute/v2.1/servers/ffc6f5b1-5da4-4f41-98aa-813ea366ca86" status: 200 len: 1361 microversion: 2.1 time: 0.159492 Aug 11 00:00:31.451889 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3527/6846] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:00:31 2022] GET /compute/v2.1/servers/ffc6f5b1-5da4-4f41-98aa-813ea366ca86 => generated 1361 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:00:31.707898 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-c004b727-4ef2-4e49-8dfb-d1cb52ef02f6 req-8ca65f86-757c-454c-a1e4-612d645b73ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ffc6f5b1-5da4-4f41-98aa-813ea366ca86", "tag": "bbfbedd7-6cf8-45c2-9de2-b95553dd115b"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 00:00:31.744755 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-c004b727-4ef2-4e49-8dfb-d1cb52ef02f6 req-8ca65f86-757c-454c-a1e4-612d645b73ad service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:00:31.745566 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-c004b727-4ef2-4e49-8dfb-d1cb52ef02f6 req-8ca65f86-757c-454c-a1e4-612d645b73ad service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:00:31.746003 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-c004b727-4ef2-4e49-8dfb-d1cb52ef02f6 req-8ca65f86-757c-454c-a1e4-612d645b73ad service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:00:31.759003 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-c004b727-4ef2-4e49-8dfb-d1cb52ef02f6 req-8ca65f86-757c-454c-a1e4-612d645b73ad service nova] Creating event network-changed:bbfbedd7-6cf8-45c2-9de2-b95553dd115b for instance ffc6f5b1-5da4-4f41-98aa-813ea366ca86 on n-h1-850468-14 Aug 11 00:00:31.765106 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-c004b727-4ef2-4e49-8dfb-d1cb52ef02f6 req-8ca65f86-757c-454c-a1e4-612d645b73ad service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067261 Aug 11 00:00:31.765830 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3320/6847] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 11 00:00:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 00:00:32.472896 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-a2eb0ac5-0b7f-4e85-b2ac-0e0ae7d208ea tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:00:32.473454 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-a2eb0ac5-0b7f-4e85-b2ac-0e0ae7d208ea tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] [instance: ffc6f5b1-5da4-4f41-98aa-813ea366ca86] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:00:32.480511 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a2eb0ac5-0b7f-4e85-b2ac-0e0ae7d208ea tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:00:32.481013 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a2eb0ac5-0b7f-4e85-b2ac-0e0ae7d208ea tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:00:32.481494 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a2eb0ac5-0b7f-4e85-b2ac-0e0ae7d208ea tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:00:32.482214 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a2eb0ac5-0b7f-4e85-b2ac-0e0ae7d208ea tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:00:32.482683 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a2eb0ac5-0b7f-4e85-b2ac-0e0ae7d208ea tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:00:32.483155 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a2eb0ac5-0b7f-4e85-b2ac-0e0ae7d208ea tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:00:32.634590 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-a2eb0ac5-0b7f-4e85-b2ac-0e0ae7d208ea tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd92285090ba411194760a83315122d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35c8636641c43b58b675c29bb52f2e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:00:32.644090 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-a2eb0ac5-0b7f-4e85-b2ac-0e0ae7d208ea tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] 10.222.0.58 "GET /compute/v2.1/servers/ffc6f5b1-5da4-4f41-98aa-813ea366ca86" status: 200 len: 1361 microversion: 2.1 time: 0.174150 Aug 11 00:00:32.644685 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3528/6848] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:00:32 2022] GET /compute/v2.1/servers/ffc6f5b1-5da4-4f41-98aa-813ea366ca86 => generated 1361 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:00:33.667141 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c5651618-339c-463f-b2ec-9647acf3dc24 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:00:33.667836 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-c5651618-339c-463f-b2ec-9647acf3dc24 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] [instance: ffc6f5b1-5da4-4f41-98aa-813ea366ca86] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:00:33.674174 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c5651618-339c-463f-b2ec-9647acf3dc24 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:00:33.674836 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c5651618-339c-463f-b2ec-9647acf3dc24 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:00:33.675297 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c5651618-339c-463f-b2ec-9647acf3dc24 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:00:33.676028 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c5651618-339c-463f-b2ec-9647acf3dc24 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:00:33.676485 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c5651618-339c-463f-b2ec-9647acf3dc24 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:00:33.676913 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c5651618-339c-463f-b2ec-9647acf3dc24 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:00:33.816584 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-c5651618-339c-463f-b2ec-9647acf3dc24 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd92285090ba411194760a83315122d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35c8636641c43b58b675c29bb52f2e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:00:33.826300 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-c5651618-339c-463f-b2ec-9647acf3dc24 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] 10.222.0.58 "GET /compute/v2.1/servers/ffc6f5b1-5da4-4f41-98aa-813ea366ca86" status: 200 len: 1361 microversion: 2.1 time: 0.164304 Aug 11 00:00:33.827114 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3321/6849] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:00:33 2022] GET /compute/v2.1/servers/ffc6f5b1-5da4-4f41-98aa-813ea366ca86 => generated 1361 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:00:34.848816 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-f27e6dd3-ad7d-43d7-b5f5-6e712b696e41 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:00:34.849582 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-f27e6dd3-ad7d-43d7-b5f5-6e712b696e41 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] [instance: ffc6f5b1-5da4-4f41-98aa-813ea366ca86] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:00:34.856613 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f27e6dd3-ad7d-43d7-b5f5-6e712b696e41 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:00:34.857112 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f27e6dd3-ad7d-43d7-b5f5-6e712b696e41 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:00:34.857568 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f27e6dd3-ad7d-43d7-b5f5-6e712b696e41 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:00:34.858291 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f27e6dd3-ad7d-43d7-b5f5-6e712b696e41 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:00:34.858757 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f27e6dd3-ad7d-43d7-b5f5-6e712b696e41 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:00:34.859225 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f27e6dd3-ad7d-43d7-b5f5-6e712b696e41 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:00:34.990653 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-f27e6dd3-ad7d-43d7-b5f5-6e712b696e41 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd92285090ba411194760a83315122d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35c8636641c43b58b675c29bb52f2e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:00:34.998189 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-f27e6dd3-ad7d-43d7-b5f5-6e712b696e41 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] 10.222.0.58 "GET /compute/v2.1/servers/ffc6f5b1-5da4-4f41-98aa-813ea366ca86" status: 200 len: 1361 microversion: 2.1 time: 0.154195 Aug 11 00:00:34.998774 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3529/6850] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:00:34 2022] GET /compute/v2.1/servers/ffc6f5b1-5da4-4f41-98aa-813ea366ca86 => generated 1361 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:00:36.020510 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-4c015bb9-c608-4dcb-b715-bfe1908c8f2d tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:00:36.021121 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-4c015bb9-c608-4dcb-b715-bfe1908c8f2d tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] [instance: ffc6f5b1-5da4-4f41-98aa-813ea366ca86] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:00:36.027897 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4c015bb9-c608-4dcb-b715-bfe1908c8f2d tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:00:36.028377 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4c015bb9-c608-4dcb-b715-bfe1908c8f2d tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:00:36.028809 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4c015bb9-c608-4dcb-b715-bfe1908c8f2d tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:00:36.029496 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4c015bb9-c608-4dcb-b715-bfe1908c8f2d tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:00:36.029946 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4c015bb9-c608-4dcb-b715-bfe1908c8f2d tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:00:36.030367 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4c015bb9-c608-4dcb-b715-bfe1908c8f2d tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:00:36.161353 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-4c015bb9-c608-4dcb-b715-bfe1908c8f2d tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd92285090ba411194760a83315122d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35c8636641c43b58b675c29bb52f2e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:00:36.169038 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-4c015bb9-c608-4dcb-b715-bfe1908c8f2d tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] 10.222.0.58 "GET /compute/v2.1/servers/ffc6f5b1-5da4-4f41-98aa-813ea366ca86" status: 200 len: 1361 microversion: 2.1 time: 0.152921 Aug 11 00:00:36.169826 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3322/6851] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:00:36 2022] GET /compute/v2.1/servers/ffc6f5b1-5da4-4f41-98aa-813ea366ca86 => generated 1361 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:00:37.189572 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-6092f502-aa8a-4e2e-82e4-17507af1bc37 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:00:37.190756 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-6092f502-aa8a-4e2e-82e4-17507af1bc37 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] [instance: ffc6f5b1-5da4-4f41-98aa-813ea366ca86] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:00:37.198157 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6092f502-aa8a-4e2e-82e4-17507af1bc37 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:00:37.198654 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6092f502-aa8a-4e2e-82e4-17507af1bc37 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:00:37.199141 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6092f502-aa8a-4e2e-82e4-17507af1bc37 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:00:37.199860 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6092f502-aa8a-4e2e-82e4-17507af1bc37 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:00:37.200334 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6092f502-aa8a-4e2e-82e4-17507af1bc37 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:00:37.200780 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6092f502-aa8a-4e2e-82e4-17507af1bc37 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:00:37.347584 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-6092f502-aa8a-4e2e-82e4-17507af1bc37 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd92285090ba411194760a83315122d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35c8636641c43b58b675c29bb52f2e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:00:37.355176 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-6092f502-aa8a-4e2e-82e4-17507af1bc37 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] 10.222.0.58 "GET /compute/v2.1/servers/ffc6f5b1-5da4-4f41-98aa-813ea366ca86" status: 200 len: 1361 microversion: 2.1 time: 0.169490 Aug 11 00:00:37.355758 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3530/6852] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:00:37 2022] GET /compute/v2.1/servers/ffc6f5b1-5da4-4f41-98aa-813ea366ca86 => generated 1361 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:00:38.330077 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-c32e90c4-ccd5-41c5-870b-82bcff775595 req-77d84d3d-f785-42ef-b7b9-9d254f9accd1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffc6f5b1-5da4-4f41-98aa-813ea366ca86", "name": "network-vif-plugged", "status": "completed", "tag": "bbfbedd7-6cf8-45c2-9de2-b95553dd115b"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 00:00:38.337718 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=2 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:00:38.338490 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=6 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:00:38.349641 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-c32e90c4-ccd5-41c5-870b-82bcff775595 req-77d84d3d-f785-42ef-b7b9-9d254f9accd1 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:00:38.350130 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-c32e90c4-ccd5-41c5-870b-82bcff775595 req-77d84d3d-f785-42ef-b7b9-9d254f9accd1 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:00:38.350567 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-c32e90c4-ccd5-41c5-870b-82bcff775595 req-77d84d3d-f785-42ef-b7b9-9d254f9accd1 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:00:38.362193 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-c32e90c4-ccd5-41c5-870b-82bcff775595 req-77d84d3d-f785-42ef-b7b9-9d254f9accd1 service nova] Creating event network-vif-plugged:bbfbedd7-6cf8-45c2-9de2-b95553dd115b for instance ffc6f5b1-5da4-4f41-98aa-813ea366ca86 on n-h1-850468-14 Aug 11 00:00:38.367506 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-c32e90c4-ccd5-41c5-870b-82bcff775595 req-77d84d3d-f785-42ef-b7b9-9d254f9accd1 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041372 Aug 11 00:00:38.368134 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3323/6853] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 11 00:00:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 00:00:38.377110 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-b5a01776-8182-4ffe-b223-9e0cccdaf6f5 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:00:38.377840 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-b5a01776-8182-4ffe-b223-9e0cccdaf6f5 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] [instance: ffc6f5b1-5da4-4f41-98aa-813ea366ca86] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:00:38.385520 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b5a01776-8182-4ffe-b223-9e0cccdaf6f5 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:00:38.386332 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b5a01776-8182-4ffe-b223-9e0cccdaf6f5 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:00:38.386899 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b5a01776-8182-4ffe-b223-9e0cccdaf6f5 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:00:38.387823 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b5a01776-8182-4ffe-b223-9e0cccdaf6f5 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:00:38.388300 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b5a01776-8182-4ffe-b223-9e0cccdaf6f5 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:00:38.388747 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b5a01776-8182-4ffe-b223-9e0cccdaf6f5 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:00:38.537683 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-b5a01776-8182-4ffe-b223-9e0cccdaf6f5 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd92285090ba411194760a83315122d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35c8636641c43b58b675c29bb52f2e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:00:38.545350 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-b5a01776-8182-4ffe-b223-9e0cccdaf6f5 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] 10.222.0.58 "GET /compute/v2.1/servers/ffc6f5b1-5da4-4f41-98aa-813ea366ca86" status: 200 len: 1361 microversion: 2.1 time: 0.172414 Aug 11 00:00:38.545939 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3531/6854] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:00:38 2022] GET /compute/v2.1/servers/ffc6f5b1-5da4-4f41-98aa-813ea366ca86 => generated 1361 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:00:39.567280 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-80386ef4-2a9f-465f-88d6-3d1e983fa9be tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:00:39.567987 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-80386ef4-2a9f-465f-88d6-3d1e983fa9be tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] [instance: ffc6f5b1-5da4-4f41-98aa-813ea366ca86] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:00:39.575608 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-80386ef4-2a9f-465f-88d6-3d1e983fa9be tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:00:39.576110 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-80386ef4-2a9f-465f-88d6-3d1e983fa9be tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:00:39.576518 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-80386ef4-2a9f-465f-88d6-3d1e983fa9be tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:00:39.577228 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-80386ef4-2a9f-465f-88d6-3d1e983fa9be tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:00:39.577672 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-80386ef4-2a9f-465f-88d6-3d1e983fa9be tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:00:39.578101 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-80386ef4-2a9f-465f-88d6-3d1e983fa9be tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:00:39.725517 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-80386ef4-2a9f-465f-88d6-3d1e983fa9be tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd92285090ba411194760a83315122d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35c8636641c43b58b675c29bb52f2e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:00:39.733155 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-80386ef4-2a9f-465f-88d6-3d1e983fa9be tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] 10.222.0.58 "GET /compute/v2.1/servers/ffc6f5b1-5da4-4f41-98aa-813ea366ca86" status: 200 len: 1552 microversion: 2.1 time: 0.170134 Aug 11 00:00:39.733745 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3324/6855] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:00:39 2022] GET /compute/v2.1/servers/ffc6f5b1-5da4-4f41-98aa-813ea366ca86 => generated 1552 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:00:39.753980 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c53bbe82-5af9-4428-a09f-9e33738cdbbf tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:00:39.754640 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-c53bbe82-5af9-4428-a09f-9e33738cdbbf tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] [instance: ffc6f5b1-5da4-4f41-98aa-813ea366ca86] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:00:39.756558 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=6 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:00:39.762702 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c53bbe82-5af9-4428-a09f-9e33738cdbbf tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:00:39.763229 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c53bbe82-5af9-4428-a09f-9e33738cdbbf tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:00:39.763686 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c53bbe82-5af9-4428-a09f-9e33738cdbbf tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:00:39.764402 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c53bbe82-5af9-4428-a09f-9e33738cdbbf tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:00:39.764871 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c53bbe82-5af9-4428-a09f-9e33738cdbbf tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:00:39.765310 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c53bbe82-5af9-4428-a09f-9e33738cdbbf tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:00:39.894686 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-c53bbe82-5af9-4428-a09f-9e33738cdbbf tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd92285090ba411194760a83315122d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35c8636641c43b58b675c29bb52f2e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:00:39.902328 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-c53bbe82-5af9-4428-a09f-9e33738cdbbf tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] 10.222.0.58 "GET /compute/v2.1/servers/ffc6f5b1-5da4-4f41-98aa-813ea366ca86" status: 200 len: 1552 microversion: 2.1 time: 0.152736 Aug 11 00:00:39.902941 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3532/6856] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:00:39 2022] GET /compute/v2.1/servers/ffc6f5b1-5da4-4f41-98aa-813ea366ca86 => generated 1552 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:00:41.749534 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c78f0a33-1690-4e05-9772-3693521c6561 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8f011349-4288-4bb7-afdd-71184c3188fa"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 00:00:41.751907 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-c78f0a33-1690-4e05-9772-3693521c6561 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] [instance: ffc6f5b1-5da4-4f41-98aa-813ea366ca86] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:00:41.759731 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c78f0a33-1690-4e05-9772-3693521c6561 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:00:41.760210 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c78f0a33-1690-4e05-9772-3693521c6561 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:00:41.760642 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c78f0a33-1690-4e05-9772-3693521c6561 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:00:41.761326 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c78f0a33-1690-4e05-9772-3693521c6561 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:00:41.761770 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c78f0a33-1690-4e05-9772-3693521c6561 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:00:41.762188 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c78f0a33-1690-4e05-9772-3693521c6561 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:00:42.002578 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-c78f0a33-1690-4e05-9772-3693521c6561 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] 10.222.0.58 "POST /compute/v2.1/servers/ffc6f5b1-5da4-4f41-98aa-813ea366ca86/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.257151 Aug 11 00:00:42.003300 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3325/6857] 10.222.0.58 () {60 vars in 1323 bytes} [Thu Aug 11 00:00:41 2022] POST /compute/v2.1/servers/ffc6f5b1-5da4-4f41-98aa-813ea366ca86/os-volume_attachments => generated 194 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 00:00:52.706374 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-2f8d966e-3fc7-401d-a113-8b13b572fa38 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:00:52.707012 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-2f8d966e-3fc7-401d-a113-8b13b572fa38 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] [instance: ffc6f5b1-5da4-4f41-98aa-813ea366ca86] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:00:52.710392 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:00:52.711147 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=36 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:00:52.718261 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2f8d966e-3fc7-401d-a113-8b13b572fa38 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:00:52.718759 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2f8d966e-3fc7-401d-a113-8b13b572fa38 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:00:52.719230 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2f8d966e-3fc7-401d-a113-8b13b572fa38 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:00:52.719939 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2f8d966e-3fc7-401d-a113-8b13b572fa38 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:00:52.720502 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2f8d966e-3fc7-401d-a113-8b13b572fa38 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:00:52.720940 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2f8d966e-3fc7-401d-a113-8b13b572fa38 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:00:52.805340 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.objects.instance [None req-2f8d966e-3fc7-401d-a113-8b13b572fa38 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lazy-loading 'services' on Instance uuid ffc6f5b1-5da4-4f41-98aa-813ea366ca86 {{(pid=122633) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 11 00:00:52.879211 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-2f8d966e-3fc7-401d-a113-8b13b572fa38 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] 10.222.0.58 "DELETE /compute/v2.1/servers/ffc6f5b1-5da4-4f41-98aa-813ea366ca86/os-volume_attachments/8f011349-4288-4bb7-afdd-71184c3188fa" status: 202 len: 0 microversion: 2.1 time: 0.176518 Aug 11 00:00:52.879925 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3533/6858] 10.222.0.58 () {58 vars in 1416 bytes} [Thu Aug 11 00:00:52 2022] DELETE /compute/v2.1/servers/ffc6f5b1-5da4-4f41-98aa-813ea366ca86/os-volume_attachments/8f011349-4288-4bb7-afdd-71184c3188fa => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 11 00:00:52.887351 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:00:52.888835 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:00:52.893629 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-f75d674b-6db0-4ea1-b6ad-efedc0482cbd tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:00:52.896648 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-f75d674b-6db0-4ea1-b6ad-efedc0482cbd tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] [instance: ffc6f5b1-5da4-4f41-98aa-813ea366ca86] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:00:52.905229 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f75d674b-6db0-4ea1-b6ad-efedc0482cbd tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:00:52.905739 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f75d674b-6db0-4ea1-b6ad-efedc0482cbd tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:00:52.906227 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f75d674b-6db0-4ea1-b6ad-efedc0482cbd tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:00:52.906951 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f75d674b-6db0-4ea1-b6ad-efedc0482cbd tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:00:52.907402 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f75d674b-6db0-4ea1-b6ad-efedc0482cbd tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:00:52.907826 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f75d674b-6db0-4ea1-b6ad-efedc0482cbd tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:00:52.941590 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-f75d674b-6db0-4ea1-b6ad-efedc0482cbd tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] 10.222.0.58 "GET /compute/v2.1/servers/ffc6f5b1-5da4-4f41-98aa-813ea366ca86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056331 Aug 11 00:00:52.942887 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3326/6859] 10.222.0.58 () {58 vars in 1302 bytes} [Thu Aug 11 00:00:52 2022] GET /compute/v2.1/servers/ffc6f5b1-5da4-4f41-98aa-813ea366ca86/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 11 00:00:53.955347 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-3b00aaaa-1f97-4d8f-87c8-09ec42351bb1 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:00:53.957866 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-3b00aaaa-1f97-4d8f-87c8-09ec42351bb1 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] [instance: ffc6f5b1-5da4-4f41-98aa-813ea366ca86] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:00:53.964394 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3b00aaaa-1f97-4d8f-87c8-09ec42351bb1 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:00:53.964917 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3b00aaaa-1f97-4d8f-87c8-09ec42351bb1 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:00:53.965372 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3b00aaaa-1f97-4d8f-87c8-09ec42351bb1 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:00:53.966087 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3b00aaaa-1f97-4d8f-87c8-09ec42351bb1 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:00:53.966559 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3b00aaaa-1f97-4d8f-87c8-09ec42351bb1 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:00:53.967030 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3b00aaaa-1f97-4d8f-87c8-09ec42351bb1 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:00:53.998530 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-3b00aaaa-1f97-4d8f-87c8-09ec42351bb1 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] 10.222.0.58 "GET /compute/v2.1/servers/ffc6f5b1-5da4-4f41-98aa-813ea366ca86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048502 Aug 11 00:00:53.999168 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3534/6860] 10.222.0.58 () {58 vars in 1302 bytes} [Thu Aug 11 00:00:53 2022] GET /compute/v2.1/servers/ffc6f5b1-5da4-4f41-98aa-813ea366ca86/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 00:00:55.011180 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-3ee81c3a-246c-481e-ad43-e08fd4bb7795 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:00:55.013922 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-3ee81c3a-246c-481e-ad43-e08fd4bb7795 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] [instance: ffc6f5b1-5da4-4f41-98aa-813ea366ca86] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:00:55.020824 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3ee81c3a-246c-481e-ad43-e08fd4bb7795 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:00:55.021310 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3ee81c3a-246c-481e-ad43-e08fd4bb7795 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:00:55.021752 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3ee81c3a-246c-481e-ad43-e08fd4bb7795 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:00:55.022449 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3ee81c3a-246c-481e-ad43-e08fd4bb7795 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:00:55.022937 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3ee81c3a-246c-481e-ad43-e08fd4bb7795 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:00:55.023372 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3ee81c3a-246c-481e-ad43-e08fd4bb7795 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:00:55.054212 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-3ee81c3a-246c-481e-ad43-e08fd4bb7795 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] 10.222.0.58 "GET /compute/v2.1/servers/ffc6f5b1-5da4-4f41-98aa-813ea366ca86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047106 Aug 11 00:00:55.054807 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3327/6861] 10.222.0.58 () {58 vars in 1302 bytes} [Thu Aug 11 00:00:55 2022] GET /compute/v2.1/servers/ffc6f5b1-5da4-4f41-98aa-813ea366ca86/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 00:00:56.067858 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-2b207a75-38d2-4c96-8233-31d170c5d9a0 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:00:56.070153 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-2b207a75-38d2-4c96-8233-31d170c5d9a0 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] [instance: ffc6f5b1-5da4-4f41-98aa-813ea366ca86] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:00:56.077269 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2b207a75-38d2-4c96-8233-31d170c5d9a0 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:00:56.077779 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2b207a75-38d2-4c96-8233-31d170c5d9a0 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:00:56.078241 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2b207a75-38d2-4c96-8233-31d170c5d9a0 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:00:56.079010 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2b207a75-38d2-4c96-8233-31d170c5d9a0 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:00:56.079487 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2b207a75-38d2-4c96-8233-31d170c5d9a0 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:00:56.079938 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2b207a75-38d2-4c96-8233-31d170c5d9a0 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:00:56.111248 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-2b207a75-38d2-4c96-8233-31d170c5d9a0 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] 10.222.0.58 "GET /compute/v2.1/servers/ffc6f5b1-5da4-4f41-98aa-813ea366ca86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047441 Aug 11 00:00:56.111820 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3535/6862] 10.222.0.58 () {58 vars in 1302 bytes} [Thu Aug 11 00:00:56 2022] GET /compute/v2.1/servers/ffc6f5b1-5da4-4f41-98aa-813ea366ca86/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 00:00:57.123559 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-bdcd2c25-edff-4876-9f8c-77ce86554d18 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:00:57.126007 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-bdcd2c25-edff-4876-9f8c-77ce86554d18 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] [instance: ffc6f5b1-5da4-4f41-98aa-813ea366ca86] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:00:57.133821 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bdcd2c25-edff-4876-9f8c-77ce86554d18 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:00:57.134300 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bdcd2c25-edff-4876-9f8c-77ce86554d18 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:00:57.134733 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bdcd2c25-edff-4876-9f8c-77ce86554d18 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:00:57.135457 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bdcd2c25-edff-4876-9f8c-77ce86554d18 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:00:57.135904 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bdcd2c25-edff-4876-9f8c-77ce86554d18 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:00:57.136324 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bdcd2c25-edff-4876-9f8c-77ce86554d18 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:00:57.167360 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-bdcd2c25-edff-4876-9f8c-77ce86554d18 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] 10.222.0.58 "GET /compute/v2.1/servers/ffc6f5b1-5da4-4f41-98aa-813ea366ca86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047720 Aug 11 00:00:57.167930 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3328/6863] 10.222.0.58 () {58 vars in 1302 bytes} [Thu Aug 11 00:00:57 2022] GET /compute/v2.1/servers/ffc6f5b1-5da4-4f41-98aa-813ea366ca86/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 00:00:58.179716 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-399874f2-5b9e-433a-83e8-4887ff15072c tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:00:58.181918 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-399874f2-5b9e-433a-83e8-4887ff15072c tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] [instance: ffc6f5b1-5da4-4f41-98aa-813ea366ca86] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:00:58.188840 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-399874f2-5b9e-433a-83e8-4887ff15072c tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:00:58.189343 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-399874f2-5b9e-433a-83e8-4887ff15072c tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:00:58.189801 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-399874f2-5b9e-433a-83e8-4887ff15072c tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:00:58.190517 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-399874f2-5b9e-433a-83e8-4887ff15072c tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:00:58.191026 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-399874f2-5b9e-433a-83e8-4887ff15072c tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:00:58.191514 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-399874f2-5b9e-433a-83e8-4887ff15072c tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:00:58.223372 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-399874f2-5b9e-433a-83e8-4887ff15072c tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] 10.222.0.58 "GET /compute/v2.1/servers/ffc6f5b1-5da4-4f41-98aa-813ea366ca86/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047886 Aug 11 00:00:58.223984 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3536/6864] 10.222.0.58 () {58 vars in 1302 bytes} [Thu Aug 11 00:00:58 2022] GET /compute/v2.1/servers/ffc6f5b1-5da4-4f41-98aa-813ea366ca86/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 11 00:00:58.235280 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-311d24d6-655e-4433-a407-93af59203245 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:00:58.235772 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-311d24d6-655e-4433-a407-93af59203245 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] [instance: ffc6f5b1-5da4-4f41-98aa-813ea366ca86] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:00:58.243863 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-311d24d6-655e-4433-a407-93af59203245 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:00:58.244342 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-311d24d6-655e-4433-a407-93af59203245 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:00:58.244782 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-311d24d6-655e-4433-a407-93af59203245 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:00:58.245480 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-311d24d6-655e-4433-a407-93af59203245 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:00:58.245933 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-311d24d6-655e-4433-a407-93af59203245 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:00:58.246354 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-311d24d6-655e-4433-a407-93af59203245 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:00:58.322835 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-311d24d6-655e-4433-a407-93af59203245 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] HTTP exception thrown: Instance ffc6f5b1-5da4-4f41-98aa-813ea366ca86 is not attached to volume 8f011349-4288-4bb7-afdd-71184c3188fa Aug 11 00:00:58.338208 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-311d24d6-655e-4433-a407-93af59203245 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Request method failure captured: Aug 11 00:00:58.338208 n-d-850468-14 devstack@n-api.service[122632]: request: DELETE /compute/v2.1/servers/ffc6f5b1-5da4-4f41-98aa-813ea366ca86/os-volume_attachments/8f011349-4288-4bb7-afdd-71184c3188fa HTTP/1.1 Aug 11 00:00:58.338208 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 11 00:00:58.338208 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 11 00:00:58.338208 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 11 00:00:58.338208 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 11 00:00:58.338208 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 11 00:00:58.338208 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 11 00:00:58.338208 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 11 00:00:58.338208 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 11 00:00:58.338208 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9EaV9bsjtz-1LnPxReI4dDptUKweJRIYYhpWctcLPNBQLB_goGOAjkfyOUkAYZnBbQqTlcQWus65vS_YQ_7b_lOgqtjQuFWg-o59-t-AyX1t5GrxdEYPJvOnlCXCBpLAh_7XmsLATODbvtQff_LQn50jvuDKJFpUc0zx1uPEoT6rwnA Aug 11 00:00:58.338208 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 11 00:00:58.338208 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 11 00:00:58.338208 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 11 00:00:58.338208 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 11 00:00:58.338208 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 11 00:00:58.338208 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 11 00:00:58.338208 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: f35c8636641c43b58b675c29bb52f2e2 Aug 11 00:00:58.338208 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1279764035 Aug 11 00:00:58.338208 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 11 00:00:58.338208 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 11 00:00:58.338208 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f35c8636641c43b58b675c29bb52f2e2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f35c8636641c43b58b675c29bb52f2e2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/f35c8636641c43b58b675c29bb52f2e2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_f35c8636641c43b58b675c29bb52f2e2", "adminURL": "http://10.222.0.58:8080"}]}] Aug 11 00:00:58.338208 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-TestEncryptedCinderVolumes-1279764035 Aug 11 00:00:58.338208 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: f35c8636641c43b58b675c29bb52f2e2 Aug 11 00:00:58.338208 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1279764035 Aug 11 00:00:58.338208 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-TestEncryptedCinderVolumes-1279764035-project Aug 11 00:00:58.338208 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 11 00:00:58.338208 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 11 00:00:58.338208 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: bd92285090ba411194760a83315122d8 Aug 11 00:00:58.338208 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-TestEncryptedCinderVolumes-1279764035-project Aug 11 00:00:58.338208 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 11 00:00:58.338208 n-d-850468-14 devstack@n-api.service[122632]: exception: Instance ffc6f5b1-5da4-4f41-98aa-813ea366ca86 is not attached to volume 8f011349-4288-4bb7-afdd-71184c3188fa Aug 11 00:00:58.338208 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'server_id': 'ffc6f5b1-5da4-4f41-98aa-813ea366ca86', 'id': '8f011349-4288-4bb7-afdd-71184c3188fa'} Aug 11 00:00:58.338208 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 00:00:58.338208 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 00:00:58.338208 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 11 00:00:58.338208 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 11 00:00:58.338208 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 11 00:00:58.338208 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 11 00:00:58.338208 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Aug 11 00:00:58.338208 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 11 00:00:58.338208 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 8f011349-4288-4bb7-afdd-71184c3188fa. Aug 11 00:00:58.338208 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 11 00:00:58.338208 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 00:00:58.338208 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 11 00:00:58.338208 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 00:00:58.338208 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 00:00:58.338208 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 00:00:58.338208 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 00:00:58.338208 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 00:00:58.338208 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 00:00:58.338208 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 00:00:58.338208 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 11 00:00:58.338208 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 11 00:00:58.338208 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ffc6f5b1-5da4-4f41-98aa-813ea366ca86 is not attached to volume 8f011349-4288-4bb7-afdd-71184c3188fa Aug 11 00:00:58.338208 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 11 00:00:58.338208 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 00:00:58.338208 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 11 00:00:58.338208 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 00:00:58.338208 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 00:00:58.338208 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 00:00:58.342691 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 00:00:58.342691 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 00:00:58.342691 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ffc6f5b1-5da4-4f41-98aa-813ea366ca86 is not attached to volume 8f011349-4288-4bb7-afdd-71184c3188fa Aug 11 00:00:58.342691 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 11 00:00:58.342691 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-311d24d6-655e-4433-a407-93af59203245 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Returning 404 to user: Instance ffc6f5b1-5da4-4f41-98aa-813ea366ca86 is not attached to volume 8f011349-4288-4bb7-afdd-71184c3188fa {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 00:00:58.342691 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-311d24d6-655e-4433-a407-93af59203245 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] 10.222.0.58 "DELETE /compute/v2.1/servers/ffc6f5b1-5da4-4f41-98aa-813ea366ca86/os-volume_attachments/8f011349-4288-4bb7-afdd-71184c3188fa" status: 404 len: 154 microversion: 2.1 time: 0.108470 Aug 11 00:00:58.342691 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3329/6865] 10.222.0.58 () {58 vars in 1416 bytes} [Thu Aug 11 00:00:58 2022] DELETE /compute/v2.1/servers/ffc6f5b1-5da4-4f41-98aa-813ea366ca86/os-volume_attachments/8f011349-4288-4bb7-afdd-71184c3188fa => generated 154 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 11 00:01:01.684471 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-d6d58bf0-21fd-42a6-874b-95abc9898e98 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:01:01.684991 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-d6d58bf0-21fd-42a6-874b-95abc9898e98 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] [instance: ffc6f5b1-5da4-4f41-98aa-813ea366ca86] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:01:01.691050 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d6d58bf0-21fd-42a6-874b-95abc9898e98 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:01:01.691580 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d6d58bf0-21fd-42a6-874b-95abc9898e98 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:01:01.692129 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d6d58bf0-21fd-42a6-874b-95abc9898e98 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:01:01.692849 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d6d58bf0-21fd-42a6-874b-95abc9898e98 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:01:01.693324 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d6d58bf0-21fd-42a6-874b-95abc9898e98 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:01:01.693770 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d6d58bf0-21fd-42a6-874b-95abc9898e98 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:01:01.720487 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-d6d58bf0-21fd-42a6-874b-95abc9898e98 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] [instance: ffc6f5b1-5da4-4f41-98aa-813ea366ca86] Going to try to terminate instance {{(pid=122633) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 11 00:01:01.807902 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-d6d58bf0-21fd-42a6-874b-95abc9898e98 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] 10.222.0.58 "DELETE /compute/v2.1/servers/ffc6f5b1-5da4-4f41-98aa-813ea366ca86" status: 204 len: 0 microversion: 2.1 time: 0.127054 Aug 11 00:01:01.808824 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3537/6866] 10.222.0.58 () {58 vars in 1239 bytes} [Thu Aug 11 00:01:01 2022] DELETE /compute/v2.1/servers/ffc6f5b1-5da4-4f41-98aa-813ea366ca86 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 11 00:01:01.817413 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-a4bb2f11-61c8-46d8-901e-9e8833e3abff tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:01:01.818309 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-a4bb2f11-61c8-46d8-901e-9e8833e3abff tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] [instance: ffc6f5b1-5da4-4f41-98aa-813ea366ca86] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:01:01.828739 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a4bb2f11-61c8-46d8-901e-9e8833e3abff tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:01:01.829318 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a4bb2f11-61c8-46d8-901e-9e8833e3abff tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:01:01.829863 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a4bb2f11-61c8-46d8-901e-9e8833e3abff tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:01:01.830645 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a4bb2f11-61c8-46d8-901e-9e8833e3abff tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:01:01.831203 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a4bb2f11-61c8-46d8-901e-9e8833e3abff tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:01:01.831751 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a4bb2f11-61c8-46d8-901e-9e8833e3abff tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:01:01.965579 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-a4bb2f11-61c8-46d8-901e-9e8833e3abff tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd92285090ba411194760a83315122d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35c8636641c43b58b675c29bb52f2e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:01:01.973770 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-a4bb2f11-61c8-46d8-901e-9e8833e3abff tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] 10.222.0.58 "GET /compute/v2.1/servers/ffc6f5b1-5da4-4f41-98aa-813ea366ca86" status: 200 len: 1558 microversion: 2.1 time: 0.160676 Aug 11 00:01:01.974350 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3330/6867] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:01:01 2022] GET /compute/v2.1/servers/ffc6f5b1-5da4-4f41-98aa-813ea366ca86 => generated 1558 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 00:01:02.995825 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-9ff7ff5b-3235-4f3d-b333-4919a481234b tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:01:02.996534 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-9ff7ff5b-3235-4f3d-b333-4919a481234b tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] [instance: ffc6f5b1-5da4-4f41-98aa-813ea366ca86] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:01:03.004411 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9ff7ff5b-3235-4f3d-b333-4919a481234b tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:01:03.004949 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9ff7ff5b-3235-4f3d-b333-4919a481234b tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:01:03.005422 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9ff7ff5b-3235-4f3d-b333-4919a481234b tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:01:03.006149 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9ff7ff5b-3235-4f3d-b333-4919a481234b tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:01:03.006644 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9ff7ff5b-3235-4f3d-b333-4919a481234b tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:01:03.007185 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9ff7ff5b-3235-4f3d-b333-4919a481234b tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:01:03.145973 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-9ff7ff5b-3235-4f3d-b333-4919a481234b tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd92285090ba411194760a83315122d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35c8636641c43b58b675c29bb52f2e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:01:03.154058 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-9ff7ff5b-3235-4f3d-b333-4919a481234b tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] 10.222.0.58 "GET /compute/v2.1/servers/ffc6f5b1-5da4-4f41-98aa-813ea366ca86" status: 200 len: 1558 microversion: 2.1 time: 0.162485 Aug 11 00:01:03.154643 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3538/6868] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:01:02 2022] GET /compute/v2.1/servers/ffc6f5b1-5da4-4f41-98aa-813ea366ca86 => generated 1558 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:01:03.799314 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-50a405e9-8c05-448c-9569-7b6dd3725f67 req-5c64dc78-bada-4a53-acf0-3887bb7523a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ffc6f5b1-5da4-4f41-98aa-813ea366ca86", "name": "network-vif-deleted", "tag": "bbfbedd7-6cf8-45c2-9de2-b95553dd115b"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 00:01:03.811337 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-50a405e9-8c05-448c-9569-7b6dd3725f67 req-5c64dc78-bada-4a53-acf0-3887bb7523a2 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:01:03.811943 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-50a405e9-8c05-448c-9569-7b6dd3725f67 req-5c64dc78-bada-4a53-acf0-3887bb7523a2 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:01:03.812476 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-50a405e9-8c05-448c-9569-7b6dd3725f67 req-5c64dc78-bada-4a53-acf0-3887bb7523a2 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:01:03.828751 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-50a405e9-8c05-448c-9569-7b6dd3725f67 req-5c64dc78-bada-4a53-acf0-3887bb7523a2 service nova] Creating event network-vif-deleted:bbfbedd7-6cf8-45c2-9de2-b95553dd115b for instance ffc6f5b1-5da4-4f41-98aa-813ea366ca86 on n-h1-850468-14 Aug 11 00:01:03.834713 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-50a405e9-8c05-448c-9569-7b6dd3725f67 req-5c64dc78-bada-4a53-acf0-3887bb7523a2 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039294 Aug 11 00:01:03.835545 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3331/6869] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 11 00:01:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 00:01:04.180326 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-760173b0-bd1f-42e7-bde7-5b5b355d94f7 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:01:04.180970 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-760173b0-bd1f-42e7-bde7-5b5b355d94f7 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] [instance: ffc6f5b1-5da4-4f41-98aa-813ea366ca86] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:01:04.189129 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-760173b0-bd1f-42e7-bde7-5b5b355d94f7 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:01:04.189631 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-760173b0-bd1f-42e7-bde7-5b5b355d94f7 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:01:04.190092 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-760173b0-bd1f-42e7-bde7-5b5b355d94f7 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:01:04.190839 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-760173b0-bd1f-42e7-bde7-5b5b355d94f7 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:01:04.192532 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-760173b0-bd1f-42e7-bde7-5b5b355d94f7 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:01:04.192988 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-760173b0-bd1f-42e7-bde7-5b5b355d94f7 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:01:04.226761 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-760173b0-bd1f-42e7-bde7-5b5b355d94f7 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:01:04.227293 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-760173b0-bd1f-42e7-bde7-5b5b355d94f7 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:01:04.227754 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-760173b0-bd1f-42e7-bde7-5b5b355d94f7 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:01:04.228219 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.objects.instance [None req-760173b0-bd1f-42e7-bde7-5b5b355d94f7 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lazy-loading 'fault' on Instance uuid ffc6f5b1-5da4-4f41-98aa-813ea366ca86 {{(pid=122633) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 11 00:01:04.271785 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-760173b0-bd1f-42e7-bde7-5b5b355d94f7 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd92285090ba411194760a83315122d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35c8636641c43b58b675c29bb52f2e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:01:04.278970 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-760173b0-bd1f-42e7-bde7-5b5b355d94f7 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] 10.222.0.58 "GET /compute/v2.1/servers/ffc6f5b1-5da4-4f41-98aa-813ea366ca86" status: 200 len: 1351 microversion: 2.1 time: 0.103336 Aug 11 00:01:04.279775 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3539/6870] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:01:04 2022] GET /compute/v2.1/servers/ffc6f5b1-5da4-4f41-98aa-813ea366ca86 => generated 1351 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:01:05.301900 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-7f63be9f-7c94-4306-9a8f-927223320307 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:01:05.302602 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-7f63be9f-7c94-4306-9a8f-927223320307 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] [instance: ffc6f5b1-5da4-4f41-98aa-813ea366ca86] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:01:05.308856 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7f63be9f-7c94-4306-9a8f-927223320307 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:01:05.309346 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7f63be9f-7c94-4306-9a8f-927223320307 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:01:05.309790 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7f63be9f-7c94-4306-9a8f-927223320307 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:01:05.310486 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7f63be9f-7c94-4306-9a8f-927223320307 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:01:05.310990 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7f63be9f-7c94-4306-9a8f-927223320307 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:01:05.311421 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7f63be9f-7c94-4306-9a8f-927223320307 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:01:05.324749 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-7f63be9f-7c94-4306-9a8f-927223320307 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] HTTP exception thrown: Instance ffc6f5b1-5da4-4f41-98aa-813ea366ca86 could not be found. Aug 11 00:01:05.326401 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-7f63be9f-7c94-4306-9a8f-927223320307 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Request method failure captured: Aug 11 00:01:05.326401 n-d-850468-14 devstack@n-api.service[122632]: request: GET /compute/v2.1/servers/ffc6f5b1-5da4-4f41-98aa-813ea366ca86 HTTP/1.1 Aug 11 00:01:05.326401 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 11 00:01:05.326401 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 11 00:01:05.326401 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 11 00:01:05.326401 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 11 00:01:05.326401 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 11 00:01:05.326401 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 11 00:01:05.326401 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 11 00:01:05.326401 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 11 00:01:05.326401 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9EaV9bsjtz-1LnPxReI4dDptUKweJRIYYhpWctcLPNBQLB_goGOAjkfyOUkAYZnBbQqTlcQWus65vS_YQ_7b_lOgqtjQuFWg-o59-t-AyX1t5GrxdEYPJvOnlCXCBpLAh_7XmsLATODbvtQff_LQn50jvuDKJFpUc0zx1uPEoT6rwnA Aug 11 00:01:05.326401 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 11 00:01:05.326401 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 11 00:01:05.326401 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 11 00:01:05.326401 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 11 00:01:05.326401 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 11 00:01:05.326401 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 11 00:01:05.326401 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: f35c8636641c43b58b675c29bb52f2e2 Aug 11 00:01:05.326401 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1279764035 Aug 11 00:01:05.326401 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 11 00:01:05.326401 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 11 00:01:05.326401 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f35c8636641c43b58b675c29bb52f2e2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f35c8636641c43b58b675c29bb52f2e2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/f35c8636641c43b58b675c29bb52f2e2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_f35c8636641c43b58b675c29bb52f2e2", "adminURL": "http://10.222.0.58:8080"}]}] Aug 11 00:01:05.326401 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-TestEncryptedCinderVolumes-1279764035 Aug 11 00:01:05.326401 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: f35c8636641c43b58b675c29bb52f2e2 Aug 11 00:01:05.326401 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1279764035 Aug 11 00:01:05.326401 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-TestEncryptedCinderVolumes-1279764035-project Aug 11 00:01:05.326401 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 11 00:01:05.326401 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 11 00:01:05.326401 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: bd92285090ba411194760a83315122d8 Aug 11 00:01:05.326401 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-TestEncryptedCinderVolumes-1279764035-project Aug 11 00:01:05.326401 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 11 00:01:05.326401 n-d-850468-14 devstack@n-api.service[122632]: exception: Instance ffc6f5b1-5da4-4f41-98aa-813ea366ca86 could not be found. Aug 11 00:01:05.326401 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': 'ffc6f5b1-5da4-4f41-98aa-813ea366ca86'} Aug 11 00:01:05.326401 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 00:01:05.326401 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 00:01:05.326401 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 11 00:01:05.326401 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 11 00:01:05.326401 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 11 00:01:05.326401 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 11 00:01:05.326401 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 11 00:01:05.326401 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 11 00:01:05.326401 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 11 00:01:05.326401 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 11 00:01:05.326401 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ffc6f5b1-5da4-4f41-98aa-813ea366ca86 could not be found. Aug 11 00:01:05.326401 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 11 00:01:05.326401 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 00:01:05.326401 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 11 00:01:05.326401 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 00:01:05.326401 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 00:01:05.326401 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 00:01:05.326401 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 00:01:05.326401 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 00:01:05.326401 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 00:01:05.326401 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 00:01:05.326401 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 11 00:01:05.326401 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 11 00:01:05.326401 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 11 00:01:05.326401 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 11 00:01:05.326401 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 11 00:01:05.326401 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 11 00:01:05.326401 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ffc6f5b1-5da4-4f41-98aa-813ea366ca86 could not be found. Aug 11 00:01:05.326401 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 11 00:01:05.326401 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 00:01:05.329973 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 11 00:01:05.329973 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 00:01:05.329973 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 00:01:05.329973 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 00:01:05.329973 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 00:01:05.329973 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 00:01:05.329973 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ffc6f5b1-5da4-4f41-98aa-813ea366ca86 could not be found. Aug 11 00:01:05.329973 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 11 00:01:05.329973 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-7f63be9f-7c94-4306-9a8f-927223320307 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Returning 404 to user: Instance ffc6f5b1-5da4-4f41-98aa-813ea366ca86 could not be found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 00:01:05.329973 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-7f63be9f-7c94-4306-9a8f-927223320307 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] 10.222.0.58 "GET /compute/v2.1/servers/ffc6f5b1-5da4-4f41-98aa-813ea366ca86" status: 404 len: 111 microversion: 2.1 time: 0.031266 Aug 11 00:01:05.329973 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3332/6871] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:01:05 2022] GET /compute/v2.1/servers/ffc6f5b1-5da4-4f41-98aa-813ea366ca86 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 11 00:01:05.337461 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-1c39640a-0b09-4d0d-a4a7-4b5a98fde372 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Calling method '.version_select at 0x7f84823cbf70>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:01:05.358459 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-1c39640a-0b09-4d0d-a4a7-4b5a98fde372 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-799024316" status: 202 len: 0 microversion: 2.1 time: 0.024839 Aug 11 00:01:05.359092 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3540/6872] 10.222.0.58 () {58 vars in 1275 bytes} [Thu Aug 11 00:01:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-799024316 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 11 00:01:05.376101 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-80057f7f-5e15-4c14-b4fe-6a659c578b34 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Action: 'create', calling method: .version_select at 0x7f846fa378b0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-31868000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHVUgMJIG7HDoH7eiKaQnhHCsoFEMgskCSG4NPLTKLh0nr1vvOJpc7GuepKxwnmrnBpJA6L4RkgCClgHVX+eWgaLAF+Yb1ZdaZNZOgd6DjYsaUYqP24lj6x1XqtqTQ7B6A=="}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 00:01:05.394026 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-80057f7f-5e15-4c14-b4fe-6a659c578b34 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Getting quotas for project f35c8636641c43b58b675c29bb52f2e2. Resources: {'key_pairs'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 11 00:01:05.400089 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-80057f7f-5e15-4c14-b4fe-6a659c578b34 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Getting quotas for user bd92285090ba411194760a83315122d8 and project f35c8636641c43b58b675c29bb52f2e2. Resources: {'key_pairs'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 11 00:01:05.423148 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-80057f7f-5e15-4c14-b4fe-6a659c578b34 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.051276 Aug 11 00:01:05.423744 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3333/6873] 10.222.0.58 () {60 vars in 1159 bytes} [Thu Aug 11 00:01:05 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 11 00:01:05.474537 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-80e8cffa-edad-4048-ab0c-88c7e4b4bce5 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-2020215199", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-31868000", "networks": [{"uuid": "bcefe6cb-4375-4aa9-9183-b8af9f0e6a44"}]}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 00:01:05.529331 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.network.neutron [None req-80e8cffa-edad-4048-ab0c-88c7e4b4bce5 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] validate_networks() for [('bcefe6cb-4375-4aa9-9183-b8af9f0e6a44', None, None, None, None, None)] {{(pid=122633) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 11 00:01:05.901479 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-80e8cffa-edad-4048-ab0c-88c7e4b4bce5 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Flavor limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 11 00:01:05.901917 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-80e8cffa-edad-4048-ab0c-88c7e4b4bce5 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Image limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 11 00:01:05.902423 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-80e8cffa-edad-4048-ab0c-88c7e4b4bce5 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Flavor pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 11 00:01:05.902876 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-80e8cffa-edad-4048-ab0c-88c7e4b4bce5 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Image pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 11 00:01:05.903302 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-80e8cffa-edad-4048-ab0c-88c7e4b4bce5 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 11 00:01:05.912553 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-80e8cffa-edad-4048-ab0c-88c7e4b4bce5 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:01:05.913042 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-80e8cffa-edad-4048-ab0c-88c7e4b4bce5 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:01:05.913490 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-80e8cffa-edad-4048-ab0c-88c7e4b4bce5 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:01:05.914222 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-80e8cffa-edad-4048-ab0c-88c7e4b4bce5 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:01:05.914686 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-80e8cffa-edad-4048-ab0c-88c7e4b4bce5 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:01:05.915151 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-80e8cffa-edad-4048-ab0c-88c7e4b4bce5 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:01:05.932838 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-80e8cffa-edad-4048-ab0c-88c7e4b4bce5 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Getting quotas for project f35c8636641c43b58b675c29bb52f2e2. Resources: {'instances', 'cores', 'ram'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 11 00:01:05.938040 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-80e8cffa-edad-4048-ab0c-88c7e4b4bce5 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Getting quotas for user bd92285090ba411194760a83315122d8 and project f35c8636641c43b58b675c29bb52f2e2. Resources: {'instances', 'cores', 'ram'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 11 00:01:05.951578 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-80e8cffa-edad-4048-ab0c-88c7e4b4bce5 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Going to run 1 instances... {{(pid=122633) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 11 00:01:05.953873 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-80e8cffa-edad-4048-ab0c-88c7e4b4bce5 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] [instance: 08569c5b-b1fd-43b7-988b-adb7435ec748] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78ad8905-f66f-4733-8be9-2b260f1fabed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122633) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 11 00:01:06.000842 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-80e8cffa-edad-4048-ab0c-88c7e4b4bce5 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.530497 Aug 11 00:01:06.001500 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3541/6874] 10.222.0.58 () {60 vars in 1147 bytes} [Thu Aug 11 00:01:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 532 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 11 00:01:06.012969 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-3b26838f-88bb-45d0-a2e0-b0db40bdcce7 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:01:06.013713 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-3b26838f-88bb-45d0-a2e0-b0db40bdcce7 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] [instance: 08569c5b-b1fd-43b7-988b-adb7435ec748] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:01:06.070551 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-3b26838f-88bb-45d0-a2e0-b0db40bdcce7 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd92285090ba411194760a83315122d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35c8636641c43b58b675c29bb52f2e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:01:06.079251 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-3b26838f-88bb-45d0-a2e0-b0db40bdcce7 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] 10.222.0.58 "GET /compute/v2.1/servers/08569c5b-b1fd-43b7-988b-adb7435ec748" status: 200 len: 1261 microversion: 2.1 time: 0.070258 Aug 11 00:01:06.079823 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3334/6875] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:01:06 2022] GET /compute/v2.1/servers/08569c5b-b1fd-43b7-988b-adb7435ec748 => generated 1261 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 00:01:07.101251 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-7253d779-2da3-475b-adac-ddc90ac23bd8 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:01:07.102620 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-7253d779-2da3-475b-adac-ddc90ac23bd8 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] [instance: 08569c5b-b1fd-43b7-988b-adb7435ec748] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:01:07.108964 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7253d779-2da3-475b-adac-ddc90ac23bd8 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:01:07.109470 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7253d779-2da3-475b-adac-ddc90ac23bd8 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:01:07.109931 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7253d779-2da3-475b-adac-ddc90ac23bd8 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:01:07.110773 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7253d779-2da3-475b-adac-ddc90ac23bd8 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:01:07.111271 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7253d779-2da3-475b-adac-ddc90ac23bd8 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:01:07.111802 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7253d779-2da3-475b-adac-ddc90ac23bd8 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:01:07.195467 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-7253d779-2da3-475b-adac-ddc90ac23bd8 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd92285090ba411194760a83315122d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35c8636641c43b58b675c29bb52f2e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:01:07.203548 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-7253d779-2da3-475b-adac-ddc90ac23bd8 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] 10.222.0.58 "GET /compute/v2.1/servers/08569c5b-b1fd-43b7-988b-adb7435ec748" status: 200 len: 1319 microversion: 2.1 time: 0.107676 Aug 11 00:01:07.204167 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3542/6876] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:01:07 2022] GET /compute/v2.1/servers/08569c5b-b1fd-43b7-988b-adb7435ec748 => generated 1319 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:01:08.226721 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-91f86194-85eb-4c8a-9bc0-e5faeec7bab4 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:01:08.228137 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-91f86194-85eb-4c8a-9bc0-e5faeec7bab4 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] [instance: 08569c5b-b1fd-43b7-988b-adb7435ec748] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:01:08.229119 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-3c7780ec-903c-42c0-a412-f683370b04ea req-34066b77-b1cc-4fd2-9702-7851b18bfa39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08569c5b-b1fd-43b7-988b-adb7435ec748", "tag": "97be6071-9266-4b57-929f-305cb719a2d1"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 00:01:08.237189 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-91f86194-85eb-4c8a-9bc0-e5faeec7bab4 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:01:08.237906 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-91f86194-85eb-4c8a-9bc0-e5faeec7bab4 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:01:08.238817 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-91f86194-85eb-4c8a-9bc0-e5faeec7bab4 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:01:08.239863 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-91f86194-85eb-4c8a-9bc0-e5faeec7bab4 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:01:08.240535 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-91f86194-85eb-4c8a-9bc0-e5faeec7bab4 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:01:08.240966 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-91f86194-85eb-4c8a-9bc0-e5faeec7bab4 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:01:08.241093 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-3c7780ec-903c-42c0-a412-f683370b04ea req-34066b77-b1cc-4fd2-9702-7851b18bfa39 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:01:08.241603 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-3c7780ec-903c-42c0-a412-f683370b04ea req-34066b77-b1cc-4fd2-9702-7851b18bfa39 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:01:08.242053 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-3c7780ec-903c-42c0-a412-f683370b04ea req-34066b77-b1cc-4fd2-9702-7851b18bfa39 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:01:08.255157 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-3c7780ec-903c-42c0-a412-f683370b04ea req-34066b77-b1cc-4fd2-9702-7851b18bfa39 service nova] Creating event network-changed:97be6071-9266-4b57-929f-305cb719a2d1 for instance 08569c5b-b1fd-43b7-988b-adb7435ec748 on n-h1-850468-14 Aug 11 00:01:08.261783 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-3c7780ec-903c-42c0-a412-f683370b04ea req-34066b77-b1cc-4fd2-9702-7851b18bfa39 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037263 Aug 11 00:01:08.263068 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3543/6877] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 11 00:01:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 00:01:08.459438 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-91f86194-85eb-4c8a-9bc0-e5faeec7bab4 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd92285090ba411194760a83315122d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35c8636641c43b58b675c29bb52f2e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:01:08.467316 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-91f86194-85eb-4c8a-9bc0-e5faeec7bab4 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] 10.222.0.58 "GET /compute/v2.1/servers/08569c5b-b1fd-43b7-988b-adb7435ec748" status: 200 len: 1361 microversion: 2.1 time: 0.245791 Aug 11 00:01:08.467899 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3335/6878] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:01:08 2022] GET /compute/v2.1/servers/08569c5b-b1fd-43b7-988b-adb7435ec748 => generated 1361 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:01:09.490004 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-2874dd20-84ce-4f72-99ca-99bd77b412e7 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:01:09.490719 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-2874dd20-84ce-4f72-99ca-99bd77b412e7 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] [instance: 08569c5b-b1fd-43b7-988b-adb7435ec748] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:01:09.497964 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2874dd20-84ce-4f72-99ca-99bd77b412e7 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:01:09.498462 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2874dd20-84ce-4f72-99ca-99bd77b412e7 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:01:09.498946 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2874dd20-84ce-4f72-99ca-99bd77b412e7 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:01:09.499966 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2874dd20-84ce-4f72-99ca-99bd77b412e7 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:01:09.500434 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2874dd20-84ce-4f72-99ca-99bd77b412e7 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:01:09.500871 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2874dd20-84ce-4f72-99ca-99bd77b412e7 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:01:09.641940 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-2874dd20-84ce-4f72-99ca-99bd77b412e7 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd92285090ba411194760a83315122d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35c8636641c43b58b675c29bb52f2e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:01:09.650831 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-2874dd20-84ce-4f72-99ca-99bd77b412e7 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] 10.222.0.58 "GET /compute/v2.1/servers/08569c5b-b1fd-43b7-988b-adb7435ec748" status: 200 len: 1361 microversion: 2.1 time: 0.165737 Aug 11 00:01:09.651431 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3544/6879] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:01:09 2022] GET /compute/v2.1/servers/08569c5b-b1fd-43b7-988b-adb7435ec748 => generated 1361 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:01:10.673256 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-ad0820fc-5228-4e2d-80ea-f6336dc59e15 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:01:10.673857 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-ad0820fc-5228-4e2d-80ea-f6336dc59e15 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] [instance: 08569c5b-b1fd-43b7-988b-adb7435ec748] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:01:10.681003 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ad0820fc-5228-4e2d-80ea-f6336dc59e15 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:01:10.681491 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ad0820fc-5228-4e2d-80ea-f6336dc59e15 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:01:10.681941 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ad0820fc-5228-4e2d-80ea-f6336dc59e15 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:01:10.682685 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ad0820fc-5228-4e2d-80ea-f6336dc59e15 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:01:10.683159 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ad0820fc-5228-4e2d-80ea-f6336dc59e15 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:01:10.683586 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ad0820fc-5228-4e2d-80ea-f6336dc59e15 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:01:10.818339 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-ad0820fc-5228-4e2d-80ea-f6336dc59e15 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd92285090ba411194760a83315122d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35c8636641c43b58b675c29bb52f2e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:01:10.826478 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-ad0820fc-5228-4e2d-80ea-f6336dc59e15 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] 10.222.0.58 "GET /compute/v2.1/servers/08569c5b-b1fd-43b7-988b-adb7435ec748" status: 200 len: 1361 microversion: 2.1 time: 0.157191 Aug 11 00:01:10.827090 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3336/6880] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:01:10 2022] GET /compute/v2.1/servers/08569c5b-b1fd-43b7-988b-adb7435ec748 => generated 1361 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:01:11.849223 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-b0a0b930-11fb-49a8-82dd-f1ba71544e32 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:01:11.849856 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-b0a0b930-11fb-49a8-82dd-f1ba71544e32 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] [instance: 08569c5b-b1fd-43b7-988b-adb7435ec748] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:01:11.856798 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b0a0b930-11fb-49a8-82dd-f1ba71544e32 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:01:11.857294 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b0a0b930-11fb-49a8-82dd-f1ba71544e32 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:01:11.857744 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b0a0b930-11fb-49a8-82dd-f1ba71544e32 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:01:11.858449 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b0a0b930-11fb-49a8-82dd-f1ba71544e32 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:01:11.858943 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b0a0b930-11fb-49a8-82dd-f1ba71544e32 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:01:11.859386 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b0a0b930-11fb-49a8-82dd-f1ba71544e32 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:01:11.988089 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-b0a0b930-11fb-49a8-82dd-f1ba71544e32 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd92285090ba411194760a83315122d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35c8636641c43b58b675c29bb52f2e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:01:11.995656 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-b0a0b930-11fb-49a8-82dd-f1ba71544e32 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] 10.222.0.58 "GET /compute/v2.1/servers/08569c5b-b1fd-43b7-988b-adb7435ec748" status: 200 len: 1361 microversion: 2.1 time: 0.151087 Aug 11 00:01:11.996234 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3545/6881] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:01:11 2022] GET /compute/v2.1/servers/08569c5b-b1fd-43b7-988b-adb7435ec748 => generated 1361 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:01:13.016925 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-8c2267ac-8f01-4851-88b3-93f58a4d9f04 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:01:13.017455 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-8c2267ac-8f01-4851-88b3-93f58a4d9f04 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] [instance: 08569c5b-b1fd-43b7-988b-adb7435ec748] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:01:13.024845 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8c2267ac-8f01-4851-88b3-93f58a4d9f04 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:01:13.025353 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8c2267ac-8f01-4851-88b3-93f58a4d9f04 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:01:13.025787 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8c2267ac-8f01-4851-88b3-93f58a4d9f04 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:01:13.026477 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8c2267ac-8f01-4851-88b3-93f58a4d9f04 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:01:13.026967 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8c2267ac-8f01-4851-88b3-93f58a4d9f04 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:01:13.027421 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8c2267ac-8f01-4851-88b3-93f58a4d9f04 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:01:13.154503 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-8c2267ac-8f01-4851-88b3-93f58a4d9f04 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd92285090ba411194760a83315122d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35c8636641c43b58b675c29bb52f2e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:01:13.163307 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-8c2267ac-8f01-4851-88b3-93f58a4d9f04 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] 10.222.0.58 "GET /compute/v2.1/servers/08569c5b-b1fd-43b7-988b-adb7435ec748" status: 200 len: 1361 microversion: 2.1 time: 0.150328 Aug 11 00:01:13.163883 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3337/6882] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:01:13 2022] GET /compute/v2.1/servers/08569c5b-b1fd-43b7-988b-adb7435ec748 => generated 1361 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:01:14.184988 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-9d26ce93-0a93-47e3-9a9c-bc897d5ded30 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:01:14.185612 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-9d26ce93-0a93-47e3-9a9c-bc897d5ded30 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] [instance: 08569c5b-b1fd-43b7-988b-adb7435ec748] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:01:14.193338 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9d26ce93-0a93-47e3-9a9c-bc897d5ded30 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:01:14.193850 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9d26ce93-0a93-47e3-9a9c-bc897d5ded30 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:01:14.194308 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9d26ce93-0a93-47e3-9a9c-bc897d5ded30 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:01:14.195054 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9d26ce93-0a93-47e3-9a9c-bc897d5ded30 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:01:14.195528 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9d26ce93-0a93-47e3-9a9c-bc897d5ded30 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:01:14.195970 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9d26ce93-0a93-47e3-9a9c-bc897d5ded30 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:01:14.328076 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-9d26ce93-0a93-47e3-9a9c-bc897d5ded30 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd92285090ba411194760a83315122d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35c8636641c43b58b675c29bb52f2e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:01:14.336268 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-9d26ce93-0a93-47e3-9a9c-bc897d5ded30 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] 10.222.0.58 "GET /compute/v2.1/servers/08569c5b-b1fd-43b7-988b-adb7435ec748" status: 200 len: 1361 microversion: 2.1 time: 0.155225 Aug 11 00:01:14.336856 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3546/6883] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:01:14 2022] GET /compute/v2.1/servers/08569c5b-b1fd-43b7-988b-adb7435ec748 => generated 1361 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:01:14.524839 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-3d24863d-f6b5-4d83-aff8-2fea972dcdaa req-0bf1a499-f6b0-4134-ba81-db73c0b55c5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08569c5b-b1fd-43b7-988b-adb7435ec748", "name": "network-vif-plugged", "status": "completed", "tag": "97be6071-9266-4b57-929f-305cb719a2d1"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 00:01:14.537150 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-3d24863d-f6b5-4d83-aff8-2fea972dcdaa req-0bf1a499-f6b0-4134-ba81-db73c0b55c5f service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:01:14.538238 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-3d24863d-f6b5-4d83-aff8-2fea972dcdaa req-0bf1a499-f6b0-4134-ba81-db73c0b55c5f service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:01:14.538685 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-3d24863d-f6b5-4d83-aff8-2fea972dcdaa req-0bf1a499-f6b0-4134-ba81-db73c0b55c5f service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:01:14.558923 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-3d24863d-f6b5-4d83-aff8-2fea972dcdaa req-0bf1a499-f6b0-4134-ba81-db73c0b55c5f service nova] Creating event network-vif-plugged:97be6071-9266-4b57-929f-305cb719a2d1 for instance 08569c5b-b1fd-43b7-988b-adb7435ec748 on n-h1-850468-14 Aug 11 00:01:14.564889 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-3d24863d-f6b5-4d83-aff8-2fea972dcdaa req-0bf1a499-f6b0-4134-ba81-db73c0b55c5f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043937 Aug 11 00:01:14.565697 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3338/6884] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 11 00:01:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 00:01:15.357631 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-0adb7814-3c5f-4ee8-af36-b6a6dbcf9c93 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:01:15.358345 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-0adb7814-3c5f-4ee8-af36-b6a6dbcf9c93 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] [instance: 08569c5b-b1fd-43b7-988b-adb7435ec748] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:01:15.366080 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0adb7814-3c5f-4ee8-af36-b6a6dbcf9c93 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:01:15.366590 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0adb7814-3c5f-4ee8-af36-b6a6dbcf9c93 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:01:15.367079 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0adb7814-3c5f-4ee8-af36-b6a6dbcf9c93 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:01:15.367796 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0adb7814-3c5f-4ee8-af36-b6a6dbcf9c93 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:01:15.368267 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0adb7814-3c5f-4ee8-af36-b6a6dbcf9c93 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:01:15.368710 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0adb7814-3c5f-4ee8-af36-b6a6dbcf9c93 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:01:15.500222 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-0adb7814-3c5f-4ee8-af36-b6a6dbcf9c93 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd92285090ba411194760a83315122d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35c8636641c43b58b675c29bb52f2e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:01:15.508019 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-0adb7814-3c5f-4ee8-af36-b6a6dbcf9c93 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] 10.222.0.58 "GET /compute/v2.1/servers/08569c5b-b1fd-43b7-988b-adb7435ec748" status: 200 len: 1361 microversion: 2.1 time: 0.154330 Aug 11 00:01:15.508605 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3547/6885] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:01:15 2022] GET /compute/v2.1/servers/08569c5b-b1fd-43b7-988b-adb7435ec748 => generated 1361 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:01:16.527664 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=6 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:01:16.532305 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-cdd85be2-efd5-451a-bc6a-c5ffdf037420 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:01:16.533017 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-cdd85be2-efd5-451a-bc6a-c5ffdf037420 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] [instance: 08569c5b-b1fd-43b7-988b-adb7435ec748] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:01:16.540346 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cdd85be2-efd5-451a-bc6a-c5ffdf037420 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:01:16.540839 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cdd85be2-efd5-451a-bc6a-c5ffdf037420 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:01:16.541282 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cdd85be2-efd5-451a-bc6a-c5ffdf037420 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:01:16.541999 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cdd85be2-efd5-451a-bc6a-c5ffdf037420 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:01:16.542462 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cdd85be2-efd5-451a-bc6a-c5ffdf037420 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:01:16.542990 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cdd85be2-efd5-451a-bc6a-c5ffdf037420 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:01:16.743922 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-cdd85be2-efd5-451a-bc6a-c5ffdf037420 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd92285090ba411194760a83315122d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35c8636641c43b58b675c29bb52f2e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:01:16.751812 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-cdd85be2-efd5-451a-bc6a-c5ffdf037420 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] 10.222.0.58 "GET /compute/v2.1/servers/08569c5b-b1fd-43b7-988b-adb7435ec748" status: 200 len: 1552 microversion: 2.1 time: 0.225989 Aug 11 00:01:16.752403 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3339/6886] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:01:16 2022] GET /compute/v2.1/servers/08569c5b-b1fd-43b7-988b-adb7435ec748 => generated 1552 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:01:16.773806 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-38f11b2f-49c9-44e7-89ef-89f76b340b69 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:01:16.775207 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-38f11b2f-49c9-44e7-89ef-89f76b340b69 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] [instance: 08569c5b-b1fd-43b7-988b-adb7435ec748] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:01:16.780982 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=2 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:01:16.781794 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=6 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:01:16.784359 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-38f11b2f-49c9-44e7-89ef-89f76b340b69 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:01:16.785684 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-38f11b2f-49c9-44e7-89ef-89f76b340b69 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:01:16.786372 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-38f11b2f-49c9-44e7-89ef-89f76b340b69 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:01:16.787695 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-38f11b2f-49c9-44e7-89ef-89f76b340b69 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:01:16.787835 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-38f11b2f-49c9-44e7-89ef-89f76b340b69 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:01:16.788557 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-38f11b2f-49c9-44e7-89ef-89f76b340b69 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:01:16.926204 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-38f11b2f-49c9-44e7-89ef-89f76b340b69 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd92285090ba411194760a83315122d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35c8636641c43b58b675c29bb52f2e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:01:16.933932 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-38f11b2f-49c9-44e7-89ef-89f76b340b69 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] 10.222.0.58 "GET /compute/v2.1/servers/08569c5b-b1fd-43b7-988b-adb7435ec748" status: 200 len: 1552 microversion: 2.1 time: 0.164738 Aug 11 00:01:16.934872 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3548/6887] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:01:16 2022] GET /compute/v2.1/servers/08569c5b-b1fd-43b7-988b-adb7435ec748 => generated 1552 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:01:18.621274 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-fd6d4e64-c035-4922-839e-6bffd6ae1200 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5c60b4e1-7b93-4bc1-ae88-e1f08a2f0d9a"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 00:01:18.623684 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-fd6d4e64-c035-4922-839e-6bffd6ae1200 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] [instance: 08569c5b-b1fd-43b7-988b-adb7435ec748] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:01:18.631993 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fd6d4e64-c035-4922-839e-6bffd6ae1200 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:01:18.632513 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fd6d4e64-c035-4922-839e-6bffd6ae1200 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:01:18.632902 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fd6d4e64-c035-4922-839e-6bffd6ae1200 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:01:18.633592 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fd6d4e64-c035-4922-839e-6bffd6ae1200 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:01:18.634041 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fd6d4e64-c035-4922-839e-6bffd6ae1200 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:01:18.634461 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fd6d4e64-c035-4922-839e-6bffd6ae1200 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:01:18.883886 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-fd6d4e64-c035-4922-839e-6bffd6ae1200 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] 10.222.0.58 "POST /compute/v2.1/servers/08569c5b-b1fd-43b7-988b-adb7435ec748/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.266391 Aug 11 00:01:18.884574 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3340/6888] 10.222.0.58 () {60 vars in 1323 bytes} [Thu Aug 11 00:01:18 2022] POST /compute/v2.1/servers/08569c5b-b1fd-43b7-988b-adb7435ec748/os-volume_attachments => generated 194 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 00:01:29.594928 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-435da620-11cb-4317-a7f4-f94dab1975b1 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:01:29.595438 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-435da620-11cb-4317-a7f4-f94dab1975b1 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] [instance: 08569c5b-b1fd-43b7-988b-adb7435ec748] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:01:29.599488 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:01:29.600274 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:01:29.606140 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-435da620-11cb-4317-a7f4-f94dab1975b1 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:01:29.606995 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-435da620-11cb-4317-a7f4-f94dab1975b1 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:01:29.607757 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-435da620-11cb-4317-a7f4-f94dab1975b1 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:01:29.608908 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-435da620-11cb-4317-a7f4-f94dab1975b1 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:01:29.609649 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-435da620-11cb-4317-a7f4-f94dab1975b1 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:01:29.610329 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-435da620-11cb-4317-a7f4-f94dab1975b1 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:01:29.709958 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.objects.instance [None req-435da620-11cb-4317-a7f4-f94dab1975b1 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lazy-loading 'services' on Instance uuid 08569c5b-b1fd-43b7-988b-adb7435ec748 {{(pid=122633) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 11 00:01:29.782081 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-435da620-11cb-4317-a7f4-f94dab1975b1 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] 10.222.0.58 "DELETE /compute/v2.1/servers/08569c5b-b1fd-43b7-988b-adb7435ec748/os-volume_attachments/5c60b4e1-7b93-4bc1-ae88-e1f08a2f0d9a" status: 202 len: 0 microversion: 2.1 time: 0.191005 Aug 11 00:01:29.782734 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3549/6889] 10.222.0.58 () {58 vars in 1416 bytes} [Thu Aug 11 00:01:29 2022] DELETE /compute/v2.1/servers/08569c5b-b1fd-43b7-988b-adb7435ec748/os-volume_attachments/5c60b4e1-7b93-4bc1-ae88-e1f08a2f0d9a => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 11 00:01:29.789275 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:01:29.790047 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:01:29.795416 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-1f2465cd-6660-471e-9d1f-2725c575d415 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:01:29.797983 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-1f2465cd-6660-471e-9d1f-2725c575d415 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] [instance: 08569c5b-b1fd-43b7-988b-adb7435ec748] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:01:29.807373 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1f2465cd-6660-471e-9d1f-2725c575d415 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:01:29.807853 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1f2465cd-6660-471e-9d1f-2725c575d415 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:01:29.808283 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1f2465cd-6660-471e-9d1f-2725c575d415 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:01:29.808986 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1f2465cd-6660-471e-9d1f-2725c575d415 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:01:29.809437 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1f2465cd-6660-471e-9d1f-2725c575d415 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:01:29.809853 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1f2465cd-6660-471e-9d1f-2725c575d415 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:01:29.843267 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-1f2465cd-6660-471e-9d1f-2725c575d415 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] 10.222.0.58 "GET /compute/v2.1/servers/08569c5b-b1fd-43b7-988b-adb7435ec748/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055195 Aug 11 00:01:29.843469 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3341/6890] 10.222.0.58 () {58 vars in 1302 bytes} [Thu Aug 11 00:01:29 2022] GET /compute/v2.1/servers/08569c5b-b1fd-43b7-988b-adb7435ec748/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 00:01:30.856436 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-65339f90-8215-466a-bc20-540102caea11 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:01:30.858883 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-65339f90-8215-466a-bc20-540102caea11 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] [instance: 08569c5b-b1fd-43b7-988b-adb7435ec748] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:01:30.865617 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-65339f90-8215-466a-bc20-540102caea11 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:01:30.866116 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-65339f90-8215-466a-bc20-540102caea11 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:01:30.866571 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-65339f90-8215-466a-bc20-540102caea11 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:01:30.867322 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-65339f90-8215-466a-bc20-540102caea11 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:01:30.867792 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-65339f90-8215-466a-bc20-540102caea11 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:01:30.868237 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-65339f90-8215-466a-bc20-540102caea11 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:01:30.902510 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-65339f90-8215-466a-bc20-540102caea11 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] 10.222.0.58 "GET /compute/v2.1/servers/08569c5b-b1fd-43b7-988b-adb7435ec748/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051446 Aug 11 00:01:30.903125 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3550/6891] 10.222.0.58 () {58 vars in 1302 bytes} [Thu Aug 11 00:01:30 2022] GET /compute/v2.1/servers/08569c5b-b1fd-43b7-988b-adb7435ec748/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 00:01:31.915289 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-ebf4fb8a-5426-42f0-a4c6-c213a5c13a7d tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:01:31.917556 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-ebf4fb8a-5426-42f0-a4c6-c213a5c13a7d tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] [instance: 08569c5b-b1fd-43b7-988b-adb7435ec748] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:01:31.924737 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ebf4fb8a-5426-42f0-a4c6-c213a5c13a7d tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:01:31.925225 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ebf4fb8a-5426-42f0-a4c6-c213a5c13a7d tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:01:31.925897 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ebf4fb8a-5426-42f0-a4c6-c213a5c13a7d tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:01:31.926614 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ebf4fb8a-5426-42f0-a4c6-c213a5c13a7d tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:01:31.927100 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ebf4fb8a-5426-42f0-a4c6-c213a5c13a7d tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:01:31.927528 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ebf4fb8a-5426-42f0-a4c6-c213a5c13a7d tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:01:31.959714 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-ebf4fb8a-5426-42f0-a4c6-c213a5c13a7d tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] 10.222.0.58 "GET /compute/v2.1/servers/08569c5b-b1fd-43b7-988b-adb7435ec748/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048438 Aug 11 00:01:31.960287 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3342/6892] 10.222.0.58 () {58 vars in 1302 bytes} [Thu Aug 11 00:01:31 2022] GET /compute/v2.1/servers/08569c5b-b1fd-43b7-988b-adb7435ec748/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 00:01:32.972667 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-9592e3d4-52e2-4b68-972f-bb013138d503 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:01:32.975067 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-9592e3d4-52e2-4b68-972f-bb013138d503 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] [instance: 08569c5b-b1fd-43b7-988b-adb7435ec748] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:01:32.982107 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9592e3d4-52e2-4b68-972f-bb013138d503 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:01:32.982613 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9592e3d4-52e2-4b68-972f-bb013138d503 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:01:32.983105 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9592e3d4-52e2-4b68-972f-bb013138d503 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:01:32.983834 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9592e3d4-52e2-4b68-972f-bb013138d503 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:01:32.984305 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9592e3d4-52e2-4b68-972f-bb013138d503 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:01:32.984747 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9592e3d4-52e2-4b68-972f-bb013138d503 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:01:33.017202 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-9592e3d4-52e2-4b68-972f-bb013138d503 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] 10.222.0.58 "GET /compute/v2.1/servers/08569c5b-b1fd-43b7-988b-adb7435ec748/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048996 Aug 11 00:01:33.022244 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3551/6893] 10.222.0.58 () {58 vars in 1302 bytes} [Thu Aug 11 00:01:32 2022] GET /compute/v2.1/servers/08569c5b-b1fd-43b7-988b-adb7435ec748/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 00:01:34.030062 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-1a625a07-729f-488f-8078-a762496f18cc tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:01:34.032614 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-1a625a07-729f-488f-8078-a762496f18cc tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] [instance: 08569c5b-b1fd-43b7-988b-adb7435ec748] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:01:34.039329 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1a625a07-729f-488f-8078-a762496f18cc tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:01:34.039829 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1a625a07-729f-488f-8078-a762496f18cc tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:01:34.040273 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1a625a07-729f-488f-8078-a762496f18cc tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:01:34.040980 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1a625a07-729f-488f-8078-a762496f18cc tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:01:34.041441 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1a625a07-729f-488f-8078-a762496f18cc tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:01:34.041870 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1a625a07-729f-488f-8078-a762496f18cc tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:01:34.072226 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-1a625a07-729f-488f-8078-a762496f18cc tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] 10.222.0.58 "GET /compute/v2.1/servers/08569c5b-b1fd-43b7-988b-adb7435ec748/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046302 Aug 11 00:01:34.072806 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3343/6894] 10.222.0.58 () {58 vars in 1302 bytes} [Thu Aug 11 00:01:34 2022] GET /compute/v2.1/servers/08569c5b-b1fd-43b7-988b-adb7435ec748/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 11 00:01:35.085329 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-e6370c55-e947-4aaf-9ca2-16ffcaf00e35 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:01:35.087536 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-e6370c55-e947-4aaf-9ca2-16ffcaf00e35 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] [instance: 08569c5b-b1fd-43b7-988b-adb7435ec748] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:01:35.094409 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e6370c55-e947-4aaf-9ca2-16ffcaf00e35 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:01:35.094947 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e6370c55-e947-4aaf-9ca2-16ffcaf00e35 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:01:35.095404 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e6370c55-e947-4aaf-9ca2-16ffcaf00e35 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:01:35.096117 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e6370c55-e947-4aaf-9ca2-16ffcaf00e35 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:01:35.096589 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e6370c55-e947-4aaf-9ca2-16ffcaf00e35 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:01:35.097069 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e6370c55-e947-4aaf-9ca2-16ffcaf00e35 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:01:35.126583 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-e6370c55-e947-4aaf-9ca2-16ffcaf00e35 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] 10.222.0.58 "GET /compute/v2.1/servers/08569c5b-b1fd-43b7-988b-adb7435ec748/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045891 Aug 11 00:01:35.127182 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3552/6895] 10.222.0.58 () {58 vars in 1302 bytes} [Thu Aug 11 00:01:35 2022] GET /compute/v2.1/servers/08569c5b-b1fd-43b7-988b-adb7435ec748/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 11 00:01:35.138886 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-b993b735-1062-470b-bebe-73d05e31019a tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:01:35.139414 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-b993b735-1062-470b-bebe-73d05e31019a tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] [instance: 08569c5b-b1fd-43b7-988b-adb7435ec748] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:01:35.147126 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b993b735-1062-470b-bebe-73d05e31019a tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:01:35.147615 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b993b735-1062-470b-bebe-73d05e31019a tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:01:35.148066 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b993b735-1062-470b-bebe-73d05e31019a tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:01:35.148765 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b993b735-1062-470b-bebe-73d05e31019a tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:01:35.149221 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b993b735-1062-470b-bebe-73d05e31019a tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:01:35.149651 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b993b735-1062-470b-bebe-73d05e31019a tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:01:35.226520 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-b993b735-1062-470b-bebe-73d05e31019a tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] HTTP exception thrown: Instance 08569c5b-b1fd-43b7-988b-adb7435ec748 is not attached to volume 5c60b4e1-7b93-4bc1-ae88-e1f08a2f0d9a Aug 11 00:01:35.228175 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-b993b735-1062-470b-bebe-73d05e31019a tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Request method failure captured: Aug 11 00:01:35.228175 n-d-850468-14 devstack@n-api.service[122632]: request: DELETE /compute/v2.1/servers/08569c5b-b1fd-43b7-988b-adb7435ec748/os-volume_attachments/5c60b4e1-7b93-4bc1-ae88-e1f08a2f0d9a HTTP/1.1 Aug 11 00:01:35.228175 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 11 00:01:35.228175 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 11 00:01:35.228175 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 11 00:01:35.228175 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 11 00:01:35.228175 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 11 00:01:35.228175 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 11 00:01:35.228175 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 11 00:01:35.228175 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 11 00:01:35.228175 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9EaV9bsjtz-1LnPxReI4dDptUKweJRIYYhpWctcLPNBQLB_goGOAjkfyOUkAYZnBbQqTlcQWus65vS_YQ_7b_lOgqtjQuFWg-o59-t-AyX1t5GrxdEYPJvOnlCXCBpLAh_7XmsLATODbvtQff_LQn50jvuDKJFpUc0zx1uPEoT6rwnA Aug 11 00:01:35.228175 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 11 00:01:35.228175 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 11 00:01:35.228175 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 11 00:01:35.228175 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 11 00:01:35.228175 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 11 00:01:35.228175 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 11 00:01:35.228175 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: f35c8636641c43b58b675c29bb52f2e2 Aug 11 00:01:35.228175 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1279764035 Aug 11 00:01:35.228175 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 11 00:01:35.228175 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 11 00:01:35.228175 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f35c8636641c43b58b675c29bb52f2e2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f35c8636641c43b58b675c29bb52f2e2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/f35c8636641c43b58b675c29bb52f2e2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_f35c8636641c43b58b675c29bb52f2e2", "adminURL": "http://10.222.0.58:8080"}]}] Aug 11 00:01:35.228175 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-TestEncryptedCinderVolumes-1279764035 Aug 11 00:01:35.228175 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: f35c8636641c43b58b675c29bb52f2e2 Aug 11 00:01:35.228175 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1279764035 Aug 11 00:01:35.228175 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-TestEncryptedCinderVolumes-1279764035-project Aug 11 00:01:35.228175 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 11 00:01:35.228175 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 11 00:01:35.228175 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: bd92285090ba411194760a83315122d8 Aug 11 00:01:35.228175 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-TestEncryptedCinderVolumes-1279764035-project Aug 11 00:01:35.228175 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 11 00:01:35.228175 n-d-850468-14 devstack@n-api.service[122632]: exception: Instance 08569c5b-b1fd-43b7-988b-adb7435ec748 is not attached to volume 5c60b4e1-7b93-4bc1-ae88-e1f08a2f0d9a Aug 11 00:01:35.228175 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'server_id': '08569c5b-b1fd-43b7-988b-adb7435ec748', 'id': '5c60b4e1-7b93-4bc1-ae88-e1f08a2f0d9a'} Aug 11 00:01:35.228175 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 00:01:35.228175 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 00:01:35.228175 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 11 00:01:35.228175 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 11 00:01:35.228175 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 11 00:01:35.228175 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 11 00:01:35.228175 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Aug 11 00:01:35.228175 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 11 00:01:35.228175 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 5c60b4e1-7b93-4bc1-ae88-e1f08a2f0d9a. Aug 11 00:01:35.228175 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 11 00:01:35.228175 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 00:01:35.228175 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 11 00:01:35.228175 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 00:01:35.228175 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 00:01:35.228175 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 00:01:35.228175 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 00:01:35.228175 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 00:01:35.228175 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 00:01:35.228175 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 00:01:35.228175 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 11 00:01:35.228175 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 11 00:01:35.228175 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08569c5b-b1fd-43b7-988b-adb7435ec748 is not attached to volume 5c60b4e1-7b93-4bc1-ae88-e1f08a2f0d9a Aug 11 00:01:35.228175 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 11 00:01:35.228175 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 00:01:35.228175 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 11 00:01:35.228175 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 00:01:35.228175 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 00:01:35.228175 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 00:01:35.232532 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 00:01:35.232532 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 00:01:35.232532 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08569c5b-b1fd-43b7-988b-adb7435ec748 is not attached to volume 5c60b4e1-7b93-4bc1-ae88-e1f08a2f0d9a Aug 11 00:01:35.232532 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 11 00:01:35.232532 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-b993b735-1062-470b-bebe-73d05e31019a tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Returning 404 to user: Instance 08569c5b-b1fd-43b7-988b-adb7435ec748 is not attached to volume 5c60b4e1-7b93-4bc1-ae88-e1f08a2f0d9a {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 00:01:35.232532 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-b993b735-1062-470b-bebe-73d05e31019a tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] 10.222.0.58 "DELETE /compute/v2.1/servers/08569c5b-b1fd-43b7-988b-adb7435ec748/os-volume_attachments/5c60b4e1-7b93-4bc1-ae88-e1f08a2f0d9a" status: 404 len: 154 microversion: 2.1 time: 0.095744 Aug 11 00:01:35.232532 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3344/6896] 10.222.0.58 () {58 vars in 1416 bytes} [Thu Aug 11 00:01:35 2022] DELETE /compute/v2.1/servers/08569c5b-b1fd-43b7-988b-adb7435ec748/os-volume_attachments/5c60b4e1-7b93-4bc1-ae88-e1f08a2f0d9a => generated 154 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 11 00:01:38.580584 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-4e3a8f1c-d2d8-46c5-a61a-48fe46e5873d tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:01:38.581189 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-4e3a8f1c-d2d8-46c5-a61a-48fe46e5873d tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] [instance: 08569c5b-b1fd-43b7-988b-adb7435ec748] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:01:38.590736 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4e3a8f1c-d2d8-46c5-a61a-48fe46e5873d tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:01:38.593707 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4e3a8f1c-d2d8-46c5-a61a-48fe46e5873d tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:01:38.594257 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4e3a8f1c-d2d8-46c5-a61a-48fe46e5873d tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:01:38.596193 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4e3a8f1c-d2d8-46c5-a61a-48fe46e5873d tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:01:38.597703 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4e3a8f1c-d2d8-46c5-a61a-48fe46e5873d tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:01:38.598238 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4e3a8f1c-d2d8-46c5-a61a-48fe46e5873d tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:01:38.632522 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-4e3a8f1c-d2d8-46c5-a61a-48fe46e5873d tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] [instance: 08569c5b-b1fd-43b7-988b-adb7435ec748] Going to try to terminate instance {{(pid=122633) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 11 00:01:38.725642 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-4e3a8f1c-d2d8-46c5-a61a-48fe46e5873d tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] 10.222.0.58 "DELETE /compute/v2.1/servers/08569c5b-b1fd-43b7-988b-adb7435ec748" status: 204 len: 0 microversion: 2.1 time: 0.150566 Aug 11 00:01:38.729839 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3553/6897] 10.222.0.58 () {58 vars in 1239 bytes} [Thu Aug 11 00:01:38 2022] DELETE /compute/v2.1/servers/08569c5b-b1fd-43b7-988b-adb7435ec748 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 11 00:01:38.740572 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-fda76778-ce76-4e80-9186-3026decd60d1 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:01:38.741201 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-fda76778-ce76-4e80-9186-3026decd60d1 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] [instance: 08569c5b-b1fd-43b7-988b-adb7435ec748] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:01:38.755686 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fda76778-ce76-4e80-9186-3026decd60d1 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:01:38.756424 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fda76778-ce76-4e80-9186-3026decd60d1 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:01:38.756871 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fda76778-ce76-4e80-9186-3026decd60d1 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:01:38.757590 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fda76778-ce76-4e80-9186-3026decd60d1 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:01:38.758051 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fda76778-ce76-4e80-9186-3026decd60d1 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:01:38.758484 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fda76778-ce76-4e80-9186-3026decd60d1 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:01:39.261304 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-fda76778-ce76-4e80-9186-3026decd60d1 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd92285090ba411194760a83315122d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35c8636641c43b58b675c29bb52f2e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:01:39.269501 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-fda76778-ce76-4e80-9186-3026decd60d1 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] 10.222.0.58 "GET /compute/v2.1/servers/08569c5b-b1fd-43b7-988b-adb7435ec748" status: 200 len: 1558 microversion: 2.1 time: 0.538183 Aug 11 00:01:39.270241 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3345/6898] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:01:38 2022] GET /compute/v2.1/servers/08569c5b-b1fd-43b7-988b-adb7435ec748 => generated 1558 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:01:40.293558 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-b828de5d-e1bf-44f3-85aa-ab51c9c031a8 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:01:40.294334 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-b828de5d-e1bf-44f3-85aa-ab51c9c031a8 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] [instance: 08569c5b-b1fd-43b7-988b-adb7435ec748] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:01:40.302100 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b828de5d-e1bf-44f3-85aa-ab51c9c031a8 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:01:40.302601 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b828de5d-e1bf-44f3-85aa-ab51c9c031a8 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:01:40.303095 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b828de5d-e1bf-44f3-85aa-ab51c9c031a8 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:01:40.303844 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b828de5d-e1bf-44f3-85aa-ab51c9c031a8 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:01:40.304317 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b828de5d-e1bf-44f3-85aa-ab51c9c031a8 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:01:40.304761 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b828de5d-e1bf-44f3-85aa-ab51c9c031a8 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:01:40.442754 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-b828de5d-e1bf-44f3-85aa-ab51c9c031a8 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd92285090ba411194760a83315122d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35c8636641c43b58b675c29bb52f2e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:01:40.450431 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-b828de5d-e1bf-44f3-85aa-ab51c9c031a8 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] 10.222.0.58 "GET /compute/v2.1/servers/08569c5b-b1fd-43b7-988b-adb7435ec748" status: 200 len: 1558 microversion: 2.1 time: 0.161441 Aug 11 00:01:40.451047 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3554/6899] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:01:40 2022] GET /compute/v2.1/servers/08569c5b-b1fd-43b7-988b-adb7435ec748 => generated 1558 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:01:40.725057 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-9530849a-5179-4bc8-bb15-2d20aff58166 req-1cdf455c-c0b3-4e93-b178-8eceaa3694c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08569c5b-b1fd-43b7-988b-adb7435ec748", "name": "network-vif-deleted", "tag": "97be6071-9266-4b57-929f-305cb719a2d1"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 00:01:40.740354 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-9530849a-5179-4bc8-bb15-2d20aff58166 req-1cdf455c-c0b3-4e93-b178-8eceaa3694c5 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:01:40.740838 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-9530849a-5179-4bc8-bb15-2d20aff58166 req-1cdf455c-c0b3-4e93-b178-8eceaa3694c5 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:01:40.741271 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-9530849a-5179-4bc8-bb15-2d20aff58166 req-1cdf455c-c0b3-4e93-b178-8eceaa3694c5 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:01:40.754608 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-9530849a-5179-4bc8-bb15-2d20aff58166 req-1cdf455c-c0b3-4e93-b178-8eceaa3694c5 service nova] Creating event network-vif-deleted:97be6071-9266-4b57-929f-305cb719a2d1 for instance 08569c5b-b1fd-43b7-988b-adb7435ec748 on n-h1-850468-14 Aug 11 00:01:40.760484 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-9530849a-5179-4bc8-bb15-2d20aff58166 req-1cdf455c-c0b3-4e93-b178-8eceaa3694c5 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039730 Aug 11 00:01:40.761103 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3346/6900] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 11 00:01:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 00:01:41.472996 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-3617f01c-4ac3-4b0e-a153-6d5927cea815 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:01:41.473549 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-3617f01c-4ac3-4b0e-a153-6d5927cea815 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] [instance: 08569c5b-b1fd-43b7-988b-adb7435ec748] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:01:41.480467 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3617f01c-4ac3-4b0e-a153-6d5927cea815 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:01:41.480965 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3617f01c-4ac3-4b0e-a153-6d5927cea815 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:01:41.481418 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3617f01c-4ac3-4b0e-a153-6d5927cea815 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:01:41.482131 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3617f01c-4ac3-4b0e-a153-6d5927cea815 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:01:41.482604 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3617f01c-4ac3-4b0e-a153-6d5927cea815 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:01:41.483072 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3617f01c-4ac3-4b0e-a153-6d5927cea815 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:01:41.496368 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-3617f01c-4ac3-4b0e-a153-6d5927cea815 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] HTTP exception thrown: Instance 08569c5b-b1fd-43b7-988b-adb7435ec748 could not be found. Aug 11 00:01:41.498035 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-3617f01c-4ac3-4b0e-a153-6d5927cea815 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Request method failure captured: Aug 11 00:01:41.498035 n-d-850468-14 devstack@n-api.service[122633]: request: GET /compute/v2.1/servers/08569c5b-b1fd-43b7-988b-adb7435ec748 HTTP/1.1 Aug 11 00:01:41.498035 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 11 00:01:41.498035 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 11 00:01:41.498035 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 11 00:01:41.498035 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 11 00:01:41.498035 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 11 00:01:41.498035 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 11 00:01:41.498035 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 11 00:01:41.498035 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 11 00:01:41.498035 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9EaV9bsjtz-1LnPxReI4dDptUKweJRIYYhpWctcLPNBQLB_goGOAjkfyOUkAYZnBbQqTlcQWus65vS_YQ_7b_lOgqtjQuFWg-o59-t-AyX1t5GrxdEYPJvOnlCXCBpLAh_7XmsLATODbvtQff_LQn50jvuDKJFpUc0zx1uPEoT6rwnA Aug 11 00:01:41.498035 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 11 00:01:41.498035 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 11 00:01:41.498035 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 11 00:01:41.498035 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 11 00:01:41.498035 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 11 00:01:41.498035 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 11 00:01:41.498035 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: f35c8636641c43b58b675c29bb52f2e2 Aug 11 00:01:41.498035 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1279764035 Aug 11 00:01:41.498035 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 11 00:01:41.498035 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 11 00:01:41.498035 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f35c8636641c43b58b675c29bb52f2e2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f35c8636641c43b58b675c29bb52f2e2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/f35c8636641c43b58b675c29bb52f2e2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_f35c8636641c43b58b675c29bb52f2e2", "adminURL": "http://10.222.0.58:8080"}]}] Aug 11 00:01:41.498035 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-TestEncryptedCinderVolumes-1279764035 Aug 11 00:01:41.498035 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: f35c8636641c43b58b675c29bb52f2e2 Aug 11 00:01:41.498035 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1279764035 Aug 11 00:01:41.498035 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-TestEncryptedCinderVolumes-1279764035-project Aug 11 00:01:41.498035 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 11 00:01:41.498035 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 11 00:01:41.498035 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: bd92285090ba411194760a83315122d8 Aug 11 00:01:41.498035 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-TestEncryptedCinderVolumes-1279764035-project Aug 11 00:01:41.498035 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 11 00:01:41.498035 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance 08569c5b-b1fd-43b7-988b-adb7435ec748 could not be found. Aug 11 00:01:41.498035 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': '08569c5b-b1fd-43b7-988b-adb7435ec748'} Aug 11 00:01:41.498035 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 00:01:41.498035 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 00:01:41.498035 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 11 00:01:41.498035 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 11 00:01:41.498035 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 11 00:01:41.498035 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 11 00:01:41.498035 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 11 00:01:41.498035 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 11 00:01:41.498035 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 11 00:01:41.498035 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 11 00:01:41.498035 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08569c5b-b1fd-43b7-988b-adb7435ec748 could not be found. Aug 11 00:01:41.498035 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 11 00:01:41.498035 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 00:01:41.498035 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 11 00:01:41.498035 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 00:01:41.498035 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 00:01:41.498035 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 00:01:41.498035 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 00:01:41.498035 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 00:01:41.498035 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 00:01:41.498035 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 00:01:41.498035 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 11 00:01:41.498035 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 11 00:01:41.498035 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 11 00:01:41.498035 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 11 00:01:41.498035 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 11 00:01:41.498035 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 11 00:01:41.498035 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08569c5b-b1fd-43b7-988b-adb7435ec748 could not be found. Aug 11 00:01:41.498035 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 11 00:01:41.498035 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 00:01:41.502481 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 11 00:01:41.502481 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 00:01:41.502481 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 00:01:41.502481 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 00:01:41.502481 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 00:01:41.502481 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 00:01:41.502481 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08569c5b-b1fd-43b7-988b-adb7435ec748 could not be found. Aug 11 00:01:41.502481 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 11 00:01:41.502481 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-3617f01c-4ac3-4b0e-a153-6d5927cea815 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Returning 404 to user: Instance 08569c5b-b1fd-43b7-988b-adb7435ec748 could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 00:01:41.502481 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-3617f01c-4ac3-4b0e-a153-6d5927cea815 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] 10.222.0.58 "GET /compute/v2.1/servers/08569c5b-b1fd-43b7-988b-adb7435ec748" status: 404 len: 111 microversion: 2.1 time: 0.030956 Aug 11 00:01:41.502481 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3555/6901] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:01:41 2022] GET /compute/v2.1/servers/08569c5b-b1fd-43b7-988b-adb7435ec748 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 11 00:01:41.509768 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-cf9e4987-ed79-43d1-87b8-fedc3aa39f59 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Calling method '.version_select at 0x7f846fc32b80>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:01:41.534040 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-cf9e4987-ed79-43d1-87b8-fedc3aa39f59 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-31868000" status: 202 len: 0 microversion: 2.1 time: 0.028440 Aug 11 00:01:41.534651 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3347/6902] 10.222.0.58 () {58 vars in 1272 bytes} [Thu Aug 11 00:01:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-31868000 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 11 00:01:41.552596 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-bfd04f01-f20e-403a-9268-19bf29f15c3f tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Action: 'create', calling method: .version_select at 0x7f847d2924c0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-706893294", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNx8rMS+1BZjwQnnE4hAW+M00Rbyx1tsC8X17bl5MJ8dBm/GiRfO79e9Ac+x0Mt1ttaARPP/GUoaYyuJffFIJLtrTAZ4iQWsk9jRzGdtEcJXX4aoCLVx42cROtUkSwrCrw=="}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 00:01:41.568710 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-bfd04f01-f20e-403a-9268-19bf29f15c3f tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Getting quotas for project f35c8636641c43b58b675c29bb52f2e2. Resources: {'key_pairs'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 11 00:01:41.574648 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-bfd04f01-f20e-403a-9268-19bf29f15c3f tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Getting quotas for user bd92285090ba411194760a83315122d8 and project f35c8636641c43b58b675c29bb52f2e2. Resources: {'key_pairs'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 11 00:01:41.599330 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-bfd04f01-f20e-403a-9268-19bf29f15c3f tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.051151 Aug 11 00:01:41.599928 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3556/6903] 10.222.0.58 () {60 vars in 1159 bytes} [Thu Aug 11 00:01:41 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 00:01:41.652179 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-10b586b5-99b2-4c63-b7d8-81f34570004f tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-909655834", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-706893294", "networks": [{"uuid": "bcefe6cb-4375-4aa9-9183-b8af9f0e6a44"}]}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 00:01:41.705615 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.network.neutron [None req-10b586b5-99b2-4c63-b7d8-81f34570004f tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] validate_networks() for [('bcefe6cb-4375-4aa9-9183-b8af9f0e6a44', None, None, None, None, None)] {{(pid=122632) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 11 00:01:42.171966 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-10b586b5-99b2-4c63-b7d8-81f34570004f tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Flavor limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 11 00:01:42.172543 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-10b586b5-99b2-4c63-b7d8-81f34570004f tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Image limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 11 00:01:42.172985 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-10b586b5-99b2-4c63-b7d8-81f34570004f tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Flavor pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 11 00:01:42.173403 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-10b586b5-99b2-4c63-b7d8-81f34570004f tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Image pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 11 00:01:42.173815 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-10b586b5-99b2-4c63-b7d8-81f34570004f tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 11 00:01:42.183581 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-10b586b5-99b2-4c63-b7d8-81f34570004f tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:01:42.184060 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-10b586b5-99b2-4c63-b7d8-81f34570004f tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:01:42.184499 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-10b586b5-99b2-4c63-b7d8-81f34570004f tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:01:42.185224 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-10b586b5-99b2-4c63-b7d8-81f34570004f tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:01:42.185680 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-10b586b5-99b2-4c63-b7d8-81f34570004f tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:01:42.186110 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-10b586b5-99b2-4c63-b7d8-81f34570004f tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:01:42.203193 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-10b586b5-99b2-4c63-b7d8-81f34570004f tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Getting quotas for project f35c8636641c43b58b675c29bb52f2e2. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 11 00:01:42.208503 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-10b586b5-99b2-4c63-b7d8-81f34570004f tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Getting quotas for user bd92285090ba411194760a83315122d8 and project f35c8636641c43b58b675c29bb52f2e2. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 11 00:01:42.220668 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-10b586b5-99b2-4c63-b7d8-81f34570004f tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Going to run 1 instances... {{(pid=122632) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 11 00:01:42.223666 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-10b586b5-99b2-4c63-b7d8-81f34570004f tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] [instance: dde85fd5-c0f1-464b-9e40-2efb8875610b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78ad8905-f66f-4733-8be9-2b260f1fabed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122632) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 11 00:01:42.268876 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-10b586b5-99b2-4c63-b7d8-81f34570004f tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.620492 Aug 11 00:01:42.269552 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3348/6904] 10.222.0.58 () {60 vars in 1147 bytes} [Thu Aug 11 00:01:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 622 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 11 00:01:42.280452 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-9cf919f4-dd33-4e08-94c1-123b31f31f53 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:01:42.281090 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-9cf919f4-dd33-4e08-94c1-123b31f31f53 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] [instance: dde85fd5-c0f1-464b-9e40-2efb8875610b] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:01:42.337075 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-9cf919f4-dd33-4e08-94c1-123b31f31f53 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd92285090ba411194760a83315122d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35c8636641c43b58b675c29bb52f2e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:01:42.345253 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-9cf919f4-dd33-4e08-94c1-123b31f31f53 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] 10.222.0.58 "GET /compute/v2.1/servers/dde85fd5-c0f1-464b-9e40-2efb8875610b" status: 200 len: 1261 microversion: 2.1 time: 0.068670 Aug 11 00:01:42.346556 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3557/6905] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:01:42 2022] GET /compute/v2.1/servers/dde85fd5-c0f1-464b-9e40-2efb8875610b => generated 1261 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:01:43.370181 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-cfde61af-34e3-4234-8dc4-430000d67897 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:01:43.371545 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-cfde61af-34e3-4234-8dc4-430000d67897 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] [instance: dde85fd5-c0f1-464b-9e40-2efb8875610b] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:01:43.382224 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cfde61af-34e3-4234-8dc4-430000d67897 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:01:43.382866 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cfde61af-34e3-4234-8dc4-430000d67897 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:01:43.383374 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cfde61af-34e3-4234-8dc4-430000d67897 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:01:43.384149 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cfde61af-34e3-4234-8dc4-430000d67897 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:01:43.384673 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cfde61af-34e3-4234-8dc4-430000d67897 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:01:43.385161 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cfde61af-34e3-4234-8dc4-430000d67897 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:01:43.491623 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-cfde61af-34e3-4234-8dc4-430000d67897 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd92285090ba411194760a83315122d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35c8636641c43b58b675c29bb52f2e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:01:43.499203 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-cfde61af-34e3-4234-8dc4-430000d67897 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] 10.222.0.58 "GET /compute/v2.1/servers/dde85fd5-c0f1-464b-9e40-2efb8875610b" status: 200 len: 1331 microversion: 2.1 time: 0.133952 Aug 11 00:01:43.500140 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3349/6906] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:01:43 2022] GET /compute/v2.1/servers/dde85fd5-c0f1-464b-9e40-2efb8875610b => generated 1331 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:01:44.527611 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-d662980c-1350-4c4a-9bdf-e8c1234954e0 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:01:44.528337 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-d662980c-1350-4c4a-9bdf-e8c1234954e0 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] [instance: dde85fd5-c0f1-464b-9e40-2efb8875610b] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:01:44.536421 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d662980c-1350-4c4a-9bdf-e8c1234954e0 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:01:44.537190 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d662980c-1350-4c4a-9bdf-e8c1234954e0 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:01:44.537823 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d662980c-1350-4c4a-9bdf-e8c1234954e0 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:01:44.538896 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d662980c-1350-4c4a-9bdf-e8c1234954e0 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:01:44.539566 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d662980c-1350-4c4a-9bdf-e8c1234954e0 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:01:44.540158 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d662980c-1350-4c4a-9bdf-e8c1234954e0 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:01:44.616839 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-756f1865-1644-419b-9a02-134eb30ff457 req-af8d36cc-529f-4ae6-a046-f05515b46a32 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dde85fd5-c0f1-464b-9e40-2efb8875610b", "tag": "87afb9f3-af9b-4847-91f5-0543730d6f41"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 00:01:44.631165 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-756f1865-1644-419b-9a02-134eb30ff457 req-af8d36cc-529f-4ae6-a046-f05515b46a32 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:01:44.631997 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-756f1865-1644-419b-9a02-134eb30ff457 req-af8d36cc-529f-4ae6-a046-f05515b46a32 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:01:44.632679 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-756f1865-1644-419b-9a02-134eb30ff457 req-af8d36cc-529f-4ae6-a046-f05515b46a32 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:01:44.649933 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-756f1865-1644-419b-9a02-134eb30ff457 req-af8d36cc-529f-4ae6-a046-f05515b46a32 service nova] Creating event network-changed:87afb9f3-af9b-4847-91f5-0543730d6f41 for instance dde85fd5-c0f1-464b-9e40-2efb8875610b on n-h1-850468-14 Aug 11 00:01:44.657691 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-756f1865-1644-419b-9a02-134eb30ff457 req-af8d36cc-529f-4ae6-a046-f05515b46a32 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045882 Aug 11 00:01:44.659117 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3350/6907] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 11 00:01:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 00:01:44.727861 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-d662980c-1350-4c4a-9bdf-e8c1234954e0 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd92285090ba411194760a83315122d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35c8636641c43b58b675c29bb52f2e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:01:44.735702 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-d662980c-1350-4c4a-9bdf-e8c1234954e0 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] 10.222.0.58 "GET /compute/v2.1/servers/dde85fd5-c0f1-464b-9e40-2efb8875610b" status: 200 len: 1361 microversion: 2.1 time: 0.218904 Aug 11 00:01:44.736561 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3558/6908] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:01:44 2022] GET /compute/v2.1/servers/dde85fd5-c0f1-464b-9e40-2efb8875610b => generated 1361 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:01:45.758962 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-3b70bc09-4fc7-45b5-9b41-d0fc2ef9b8b7 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:01:45.759667 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-3b70bc09-4fc7-45b5-9b41-d0fc2ef9b8b7 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] [instance: dde85fd5-c0f1-464b-9e40-2efb8875610b] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:01:45.765940 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3b70bc09-4fc7-45b5-9b41-d0fc2ef9b8b7 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:01:45.766485 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3b70bc09-4fc7-45b5-9b41-d0fc2ef9b8b7 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:01:45.766898 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3b70bc09-4fc7-45b5-9b41-d0fc2ef9b8b7 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:01:45.767596 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3b70bc09-4fc7-45b5-9b41-d0fc2ef9b8b7 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:01:45.768098 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3b70bc09-4fc7-45b5-9b41-d0fc2ef9b8b7 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:01:45.768480 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3b70bc09-4fc7-45b5-9b41-d0fc2ef9b8b7 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:01:45.951571 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-3b70bc09-4fc7-45b5-9b41-d0fc2ef9b8b7 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd92285090ba411194760a83315122d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35c8636641c43b58b675c29bb52f2e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:01:45.959846 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-3b70bc09-4fc7-45b5-9b41-d0fc2ef9b8b7 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] 10.222.0.58 "GET /compute/v2.1/servers/dde85fd5-c0f1-464b-9e40-2efb8875610b" status: 200 len: 1361 microversion: 2.1 time: 0.206041 Aug 11 00:01:45.960436 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3351/6909] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:01:45 2022] GET /compute/v2.1/servers/dde85fd5-c0f1-464b-9e40-2efb8875610b => generated 1361 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:01:46.980861 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-4dae3f5b-f6fd-4f7a-aee0-faa62f345f3a tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:01:46.981489 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-4dae3f5b-f6fd-4f7a-aee0-faa62f345f3a tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] [instance: dde85fd5-c0f1-464b-9e40-2efb8875610b] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:01:46.988751 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4dae3f5b-f6fd-4f7a-aee0-faa62f345f3a tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:01:46.989256 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4dae3f5b-f6fd-4f7a-aee0-faa62f345f3a tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:01:46.989712 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4dae3f5b-f6fd-4f7a-aee0-faa62f345f3a tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:01:46.990429 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4dae3f5b-f6fd-4f7a-aee0-faa62f345f3a tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:01:46.990924 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4dae3f5b-f6fd-4f7a-aee0-faa62f345f3a tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:01:46.991371 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4dae3f5b-f6fd-4f7a-aee0-faa62f345f3a tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:01:47.131469 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-4dae3f5b-f6fd-4f7a-aee0-faa62f345f3a tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd92285090ba411194760a83315122d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35c8636641c43b58b675c29bb52f2e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:01:47.138964 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-4dae3f5b-f6fd-4f7a-aee0-faa62f345f3a tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] 10.222.0.58 "GET /compute/v2.1/servers/dde85fd5-c0f1-464b-9e40-2efb8875610b" status: 200 len: 1361 microversion: 2.1 time: 0.162074 Aug 11 00:01:47.139547 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3559/6910] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:01:46 2022] GET /compute/v2.1/servers/dde85fd5-c0f1-464b-9e40-2efb8875610b => generated 1361 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:01:48.161636 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-28118260-1be9-4e7b-b168-433d62b7a296 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:01:48.162244 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-28118260-1be9-4e7b-b168-433d62b7a296 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] [instance: dde85fd5-c0f1-464b-9e40-2efb8875610b] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:01:48.169737 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-28118260-1be9-4e7b-b168-433d62b7a296 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:01:48.170341 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-28118260-1be9-4e7b-b168-433d62b7a296 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:01:48.170934 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-28118260-1be9-4e7b-b168-433d62b7a296 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:01:48.171812 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-28118260-1be9-4e7b-b168-433d62b7a296 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:01:48.172375 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-28118260-1be9-4e7b-b168-433d62b7a296 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:01:48.172961 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-28118260-1be9-4e7b-b168-433d62b7a296 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:01:48.308388 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-28118260-1be9-4e7b-b168-433d62b7a296 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd92285090ba411194760a83315122d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35c8636641c43b58b675c29bb52f2e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:01:48.316099 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-28118260-1be9-4e7b-b168-433d62b7a296 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] 10.222.0.58 "GET /compute/v2.1/servers/dde85fd5-c0f1-464b-9e40-2efb8875610b" status: 200 len: 1361 microversion: 2.1 time: 0.159374 Aug 11 00:01:48.316707 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3352/6911] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:01:48 2022] GET /compute/v2.1/servers/dde85fd5-c0f1-464b-9e40-2efb8875610b => generated 1361 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:01:49.337626 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c35d0914-c42a-459d-a895-a066825c1b6f tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:01:49.338251 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-c35d0914-c42a-459d-a895-a066825c1b6f tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] [instance: dde85fd5-c0f1-464b-9e40-2efb8875610b] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:01:49.345713 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c35d0914-c42a-459d-a895-a066825c1b6f tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:01:49.346218 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c35d0914-c42a-459d-a895-a066825c1b6f tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:01:49.346672 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c35d0914-c42a-459d-a895-a066825c1b6f tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:01:49.348241 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c35d0914-c42a-459d-a895-a066825c1b6f tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:01:49.348751 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c35d0914-c42a-459d-a895-a066825c1b6f tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:01:49.349194 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c35d0914-c42a-459d-a895-a066825c1b6f tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:01:49.480279 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-c35d0914-c42a-459d-a895-a066825c1b6f tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd92285090ba411194760a83315122d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35c8636641c43b58b675c29bb52f2e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:01:49.488063 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-c35d0914-c42a-459d-a895-a066825c1b6f tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] 10.222.0.58 "GET /compute/v2.1/servers/dde85fd5-c0f1-464b-9e40-2efb8875610b" status: 200 len: 1361 microversion: 2.1 time: 0.154298 Aug 11 00:01:49.488650 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3560/6912] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:01:49 2022] GET /compute/v2.1/servers/dde85fd5-c0f1-464b-9e40-2efb8875610b => generated 1361 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:01:50.508881 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-fd785df7-e24d-4d1f-b1e9-7ed0ebbf64df tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:01:50.509502 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-fd785df7-e24d-4d1f-b1e9-7ed0ebbf64df tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] [instance: dde85fd5-c0f1-464b-9e40-2efb8875610b] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:01:50.516173 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fd785df7-e24d-4d1f-b1e9-7ed0ebbf64df tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:01:50.516665 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fd785df7-e24d-4d1f-b1e9-7ed0ebbf64df tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:01:50.517144 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fd785df7-e24d-4d1f-b1e9-7ed0ebbf64df tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:01:50.518085 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fd785df7-e24d-4d1f-b1e9-7ed0ebbf64df tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:01:50.518312 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fd785df7-e24d-4d1f-b1e9-7ed0ebbf64df tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:01:50.518742 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fd785df7-e24d-4d1f-b1e9-7ed0ebbf64df tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:01:50.652552 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-fd785df7-e24d-4d1f-b1e9-7ed0ebbf64df tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd92285090ba411194760a83315122d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35c8636641c43b58b675c29bb52f2e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:01:50.660979 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-fd785df7-e24d-4d1f-b1e9-7ed0ebbf64df tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] 10.222.0.58 "GET /compute/v2.1/servers/dde85fd5-c0f1-464b-9e40-2efb8875610b" status: 200 len: 1361 microversion: 2.1 time: 0.156044 Aug 11 00:01:50.661580 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3353/6913] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:01:50 2022] GET /compute/v2.1/servers/dde85fd5-c0f1-464b-9e40-2efb8875610b => generated 1361 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:01:50.763013 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-72da71a9-57fd-443b-8bbf-bbea09ce3b00 req-d425806f-39cb-4c40-b698-a00b3d814206 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dde85fd5-c0f1-464b-9e40-2efb8875610b", "name": "network-vif-plugged", "status": "completed", "tag": "87afb9f3-af9b-4847-91f5-0543730d6f41"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 00:01:50.774347 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-72da71a9-57fd-443b-8bbf-bbea09ce3b00 req-d425806f-39cb-4c40-b698-a00b3d814206 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:01:50.774880 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-72da71a9-57fd-443b-8bbf-bbea09ce3b00 req-d425806f-39cb-4c40-b698-a00b3d814206 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:01:50.775333 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-72da71a9-57fd-443b-8bbf-bbea09ce3b00 req-d425806f-39cb-4c40-b698-a00b3d814206 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:01:50.787613 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-72da71a9-57fd-443b-8bbf-bbea09ce3b00 req-d425806f-39cb-4c40-b698-a00b3d814206 service nova] Creating event network-vif-plugged:87afb9f3-af9b-4847-91f5-0543730d6f41 for instance dde85fd5-c0f1-464b-9e40-2efb8875610b on n-h1-850468-14 Aug 11 00:01:50.792646 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-72da71a9-57fd-443b-8bbf-bbea09ce3b00 req-d425806f-39cb-4c40-b698-a00b3d814206 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033524 Aug 11 00:01:50.793248 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3561/6914] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 11 00:01:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 00:01:51.682554 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-b496e15b-1e50-41f8-99a9-7003ddb0e260 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:01:51.683200 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-b496e15b-1e50-41f8-99a9-7003ddb0e260 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] [instance: dde85fd5-c0f1-464b-9e40-2efb8875610b] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:01:51.690170 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b496e15b-1e50-41f8-99a9-7003ddb0e260 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:01:51.690689 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b496e15b-1e50-41f8-99a9-7003ddb0e260 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:01:51.691760 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b496e15b-1e50-41f8-99a9-7003ddb0e260 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:01:51.692492 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b496e15b-1e50-41f8-99a9-7003ddb0e260 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:01:51.692938 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b496e15b-1e50-41f8-99a9-7003ddb0e260 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:01:51.693361 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b496e15b-1e50-41f8-99a9-7003ddb0e260 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:01:51.827569 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-b496e15b-1e50-41f8-99a9-7003ddb0e260 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd92285090ba411194760a83315122d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35c8636641c43b58b675c29bb52f2e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:01:51.835430 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-b496e15b-1e50-41f8-99a9-7003ddb0e260 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] 10.222.0.58 "GET /compute/v2.1/servers/dde85fd5-c0f1-464b-9e40-2efb8875610b" status: 200 len: 1361 microversion: 2.1 time: 0.156783 Aug 11 00:01:51.836028 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3354/6915] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:01:51 2022] GET /compute/v2.1/servers/dde85fd5-c0f1-464b-9e40-2efb8875610b => generated 1361 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:01:52.855388 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=6 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:01:52.859626 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-3a9fd016-0da2-4eef-afb9-9eaef0ab610f tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:01:52.860331 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-3a9fd016-0da2-4eef-afb9-9eaef0ab610f tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] [instance: dde85fd5-c0f1-464b-9e40-2efb8875610b] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:01:52.867671 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3a9fd016-0da2-4eef-afb9-9eaef0ab610f tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:01:52.868171 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3a9fd016-0da2-4eef-afb9-9eaef0ab610f tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:01:52.868619 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3a9fd016-0da2-4eef-afb9-9eaef0ab610f tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:01:52.869332 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3a9fd016-0da2-4eef-afb9-9eaef0ab610f tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:01:52.869796 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3a9fd016-0da2-4eef-afb9-9eaef0ab610f tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:01:52.870232 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3a9fd016-0da2-4eef-afb9-9eaef0ab610f tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:01:53.006915 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-3a9fd016-0da2-4eef-afb9-9eaef0ab610f tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd92285090ba411194760a83315122d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35c8636641c43b58b675c29bb52f2e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:01:53.014495 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-3a9fd016-0da2-4eef-afb9-9eaef0ab610f tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] 10.222.0.58 "GET /compute/v2.1/servers/dde85fd5-c0f1-464b-9e40-2efb8875610b" status: 200 len: 1552 microversion: 2.1 time: 0.160959 Aug 11 00:01:53.015124 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3562/6916] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:01:52 2022] GET /compute/v2.1/servers/dde85fd5-c0f1-464b-9e40-2efb8875610b => generated 1552 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 00:01:53.035590 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-13e617fa-919c-48d7-b8a6-f739f964920a tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:01:53.036383 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-13e617fa-919c-48d7-b8a6-f739f964920a tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] [instance: dde85fd5-c0f1-464b-9e40-2efb8875610b] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:01:53.038462 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=2 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:01:53.039164 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=6 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:01:53.046254 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-13e617fa-919c-48d7-b8a6-f739f964920a tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:01:53.046745 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-13e617fa-919c-48d7-b8a6-f739f964920a tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:01:53.047212 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-13e617fa-919c-48d7-b8a6-f739f964920a tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:01:53.047920 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-13e617fa-919c-48d7-b8a6-f739f964920a tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:01:53.048374 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-13e617fa-919c-48d7-b8a6-f739f964920a tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:01:53.048804 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-13e617fa-919c-48d7-b8a6-f739f964920a tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:01:53.182088 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-13e617fa-919c-48d7-b8a6-f739f964920a tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd92285090ba411194760a83315122d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35c8636641c43b58b675c29bb52f2e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:01:53.189892 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-13e617fa-919c-48d7-b8a6-f739f964920a tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] 10.222.0.58 "GET /compute/v2.1/servers/dde85fd5-c0f1-464b-9e40-2efb8875610b" status: 200 len: 1552 microversion: 2.1 time: 0.158861 Aug 11 00:01:53.190477 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3355/6917] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:01:53 2022] GET /compute/v2.1/servers/dde85fd5-c0f1-464b-9e40-2efb8875610b => generated 1552 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:01:54.680459 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-2bdba214-756a-4a65-a0d1-3e0edbf78b1f tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "66ba0434-0d5f-4285-8f8f-70f3c1401c57"}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 00:01:54.682749 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-2bdba214-756a-4a65-a0d1-3e0edbf78b1f tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] [instance: dde85fd5-c0f1-464b-9e40-2efb8875610b] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:01:54.689690 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2bdba214-756a-4a65-a0d1-3e0edbf78b1f tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:01:54.690185 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2bdba214-756a-4a65-a0d1-3e0edbf78b1f tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:01:54.690636 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2bdba214-756a-4a65-a0d1-3e0edbf78b1f tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:01:54.691526 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2bdba214-756a-4a65-a0d1-3e0edbf78b1f tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:01:54.692002 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2bdba214-756a-4a65-a0d1-3e0edbf78b1f tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:01:54.692446 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2bdba214-756a-4a65-a0d1-3e0edbf78b1f tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:01:54.931983 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-2bdba214-756a-4a65-a0d1-3e0edbf78b1f tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] 10.222.0.58 "POST /compute/v2.1/servers/dde85fd5-c0f1-464b-9e40-2efb8875610b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.255361 Aug 11 00:01:54.932589 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3563/6918] 10.222.0.58 () {60 vars in 1323 bytes} [Thu Aug 11 00:01:54 2022] POST /compute/v2.1/servers/dde85fd5-c0f1-464b-9e40-2efb8875610b/os-volume_attachments => generated 194 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 00:02:05.647443 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c13d3a6d-238e-47d0-a981-25bf07508ef3 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:02:05.647980 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-c13d3a6d-238e-47d0-a981-25bf07508ef3 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] [instance: dde85fd5-c0f1-464b-9e40-2efb8875610b] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:02:05.650387 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_api:SELECT=44,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:02:05.651209 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=72 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:02:05.662543 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c13d3a6d-238e-47d0-a981-25bf07508ef3 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:02:05.663072 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c13d3a6d-238e-47d0-a981-25bf07508ef3 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:02:05.663516 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c13d3a6d-238e-47d0-a981-25bf07508ef3 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:02:05.664234 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c13d3a6d-238e-47d0-a981-25bf07508ef3 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:02:05.664689 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c13d3a6d-238e-47d0-a981-25bf07508ef3 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:02:05.665116 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c13d3a6d-238e-47d0-a981-25bf07508ef3 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:02:05.748970 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.objects.instance [None req-c13d3a6d-238e-47d0-a981-25bf07508ef3 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lazy-loading 'services' on Instance uuid dde85fd5-c0f1-464b-9e40-2efb8875610b {{(pid=122632) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 11 00:02:05.821281 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-c13d3a6d-238e-47d0-a981-25bf07508ef3 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] 10.222.0.58 "DELETE /compute/v2.1/servers/dde85fd5-c0f1-464b-9e40-2efb8875610b/os-volume_attachments/66ba0434-0d5f-4285-8f8f-70f3c1401c57" status: 202 len: 0 microversion: 2.1 time: 0.178821 Aug 11 00:02:05.821885 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3356/6919] 10.222.0.58 () {58 vars in 1416 bytes} [Thu Aug 11 00:02:05 2022] DELETE /compute/v2.1/servers/dde85fd5-c0f1-464b-9e40-2efb8875610b/os-volume_attachments/66ba0434-0d5f-4285-8f8f-70f3c1401c57 => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 11 00:02:05.830747 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-5f2fda63-1b35-4253-a392-c4caa19c405d tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:02:05.834038 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-5f2fda63-1b35-4253-a392-c4caa19c405d tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] [instance: dde85fd5-c0f1-464b-9e40-2efb8875610b] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:02:05.837280 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:02:05.838024 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=86,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:02:05.843955 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5f2fda63-1b35-4253-a392-c4caa19c405d tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:02:05.844460 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5f2fda63-1b35-4253-a392-c4caa19c405d tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:02:05.844936 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5f2fda63-1b35-4253-a392-c4caa19c405d tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:02:05.845659 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5f2fda63-1b35-4253-a392-c4caa19c405d tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:02:05.846125 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5f2fda63-1b35-4253-a392-c4caa19c405d tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:02:05.846560 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5f2fda63-1b35-4253-a392-c4caa19c405d tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:02:05.884533 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-5f2fda63-1b35-4253-a392-c4caa19c405d tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] 10.222.0.58 "GET /compute/v2.1/servers/dde85fd5-c0f1-464b-9e40-2efb8875610b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058004 Aug 11 00:02:05.885119 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3564/6920] 10.222.0.58 () {58 vars in 1302 bytes} [Thu Aug 11 00:02:05 2022] GET /compute/v2.1/servers/dde85fd5-c0f1-464b-9e40-2efb8875610b/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 00:02:06.898412 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-e1d03f83-ef66-4347-b633-655fddd10409 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:02:06.900954 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-e1d03f83-ef66-4347-b633-655fddd10409 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] [instance: dde85fd5-c0f1-464b-9e40-2efb8875610b] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:02:06.907329 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e1d03f83-ef66-4347-b633-655fddd10409 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:02:06.907810 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e1d03f83-ef66-4347-b633-655fddd10409 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:02:06.908246 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e1d03f83-ef66-4347-b633-655fddd10409 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:02:06.908972 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e1d03f83-ef66-4347-b633-655fddd10409 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:02:06.909419 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e1d03f83-ef66-4347-b633-655fddd10409 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:02:06.909835 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e1d03f83-ef66-4347-b633-655fddd10409 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:02:06.941367 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-e1d03f83-ef66-4347-b633-655fddd10409 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] 10.222.0.58 "GET /compute/v2.1/servers/dde85fd5-c0f1-464b-9e40-2efb8875610b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048205 Aug 11 00:02:06.941957 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3357/6921] 10.222.0.58 () {58 vars in 1302 bytes} [Thu Aug 11 00:02:06 2022] GET /compute/v2.1/servers/dde85fd5-c0f1-464b-9e40-2efb8875610b/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 00:02:07.953818 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-7406d696-8885-464f-ba06-0855c7ec3938 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:02:07.956050 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-7406d696-8885-464f-ba06-0855c7ec3938 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] [instance: dde85fd5-c0f1-464b-9e40-2efb8875610b] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:02:07.963207 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7406d696-8885-464f-ba06-0855c7ec3938 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:02:07.963710 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7406d696-8885-464f-ba06-0855c7ec3938 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:02:07.964169 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7406d696-8885-464f-ba06-0855c7ec3938 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:02:07.964890 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7406d696-8885-464f-ba06-0855c7ec3938 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:02:07.965362 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7406d696-8885-464f-ba06-0855c7ec3938 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:02:07.965808 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7406d696-8885-464f-ba06-0855c7ec3938 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:02:07.997745 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-7406d696-8885-464f-ba06-0855c7ec3938 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] 10.222.0.58 "GET /compute/v2.1/servers/dde85fd5-c0f1-464b-9e40-2efb8875610b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047945 Aug 11 00:02:07.998321 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3565/6922] 10.222.0.58 () {58 vars in 1302 bytes} [Thu Aug 11 00:02:07 2022] GET /compute/v2.1/servers/dde85fd5-c0f1-464b-9e40-2efb8875610b/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 00:02:09.010401 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-ad4371ea-788e-4611-9434-958c91a3fd31 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:02:09.012586 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-ad4371ea-788e-4611-9434-958c91a3fd31 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] [instance: dde85fd5-c0f1-464b-9e40-2efb8875610b] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:02:09.020659 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ad4371ea-788e-4611-9434-958c91a3fd31 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:02:09.021444 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ad4371ea-788e-4611-9434-958c91a3fd31 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:02:09.022173 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ad4371ea-788e-4611-9434-958c91a3fd31 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:02:09.023020 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ad4371ea-788e-4611-9434-958c91a3fd31 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:02:09.023635 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ad4371ea-788e-4611-9434-958c91a3fd31 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:02:09.024073 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ad4371ea-788e-4611-9434-958c91a3fd31 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:02:09.055128 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-ad4371ea-788e-4611-9434-958c91a3fd31 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] 10.222.0.58 "GET /compute/v2.1/servers/dde85fd5-c0f1-464b-9e40-2efb8875610b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048834 Aug 11 00:02:09.055707 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3358/6923] 10.222.0.58 () {58 vars in 1302 bytes} [Thu Aug 11 00:02:09 2022] GET /compute/v2.1/servers/dde85fd5-c0f1-464b-9e40-2efb8875610b/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 00:02:10.067809 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-7c1c8a0f-00f7-4e6b-b795-9e53b73019e5 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:02:10.070023 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-7c1c8a0f-00f7-4e6b-b795-9e53b73019e5 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] [instance: dde85fd5-c0f1-464b-9e40-2efb8875610b] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:02:10.077160 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7c1c8a0f-00f7-4e6b-b795-9e53b73019e5 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:02:10.077667 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7c1c8a0f-00f7-4e6b-b795-9e53b73019e5 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:02:10.078127 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7c1c8a0f-00f7-4e6b-b795-9e53b73019e5 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:02:10.078918 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7c1c8a0f-00f7-4e6b-b795-9e53b73019e5 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:02:10.079379 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7c1c8a0f-00f7-4e6b-b795-9e53b73019e5 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:02:10.079851 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7c1c8a0f-00f7-4e6b-b795-9e53b73019e5 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:02:10.111058 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-7c1c8a0f-00f7-4e6b-b795-9e53b73019e5 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] 10.222.0.58 "GET /compute/v2.1/servers/dde85fd5-c0f1-464b-9e40-2efb8875610b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047455 Aug 11 00:02:10.111641 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3566/6924] 10.222.0.58 () {58 vars in 1302 bytes} [Thu Aug 11 00:02:10 2022] GET /compute/v2.1/servers/dde85fd5-c0f1-464b-9e40-2efb8875610b/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 00:02:11.122646 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-5693aa6f-a824-4731-818c-4c23ac5fb3d7 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:02:11.125117 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-5693aa6f-a824-4731-818c-4c23ac5fb3d7 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] [instance: dde85fd5-c0f1-464b-9e40-2efb8875610b] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:02:11.132850 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5693aa6f-a824-4731-818c-4c23ac5fb3d7 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:02:11.133337 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5693aa6f-a824-4731-818c-4c23ac5fb3d7 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:02:11.133777 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5693aa6f-a824-4731-818c-4c23ac5fb3d7 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:02:11.134472 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5693aa6f-a824-4731-818c-4c23ac5fb3d7 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:02:11.135033 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5693aa6f-a824-4731-818c-4c23ac5fb3d7 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:02:11.135462 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5693aa6f-a824-4731-818c-4c23ac5fb3d7 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:02:11.166896 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-5693aa6f-a824-4731-818c-4c23ac5fb3d7 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] 10.222.0.58 "GET /compute/v2.1/servers/dde85fd5-c0f1-464b-9e40-2efb8875610b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048309 Aug 11 00:02:11.167463 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3359/6925] 10.222.0.58 () {58 vars in 1302 bytes} [Thu Aug 11 00:02:11 2022] GET /compute/v2.1/servers/dde85fd5-c0f1-464b-9e40-2efb8875610b/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 11 00:02:11.178887 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-21fb70c8-536e-425d-b50d-3a396f5ce815 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:02:11.179411 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-21fb70c8-536e-425d-b50d-3a396f5ce815 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] [instance: dde85fd5-c0f1-464b-9e40-2efb8875610b] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:02:11.186250 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-21fb70c8-536e-425d-b50d-3a396f5ce815 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:02:11.186747 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-21fb70c8-536e-425d-b50d-3a396f5ce815 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:02:11.187242 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-21fb70c8-536e-425d-b50d-3a396f5ce815 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:02:11.187959 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-21fb70c8-536e-425d-b50d-3a396f5ce815 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:02:11.188432 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-21fb70c8-536e-425d-b50d-3a396f5ce815 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:02:11.188877 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-21fb70c8-536e-425d-b50d-3a396f5ce815 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:02:11.266430 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-21fb70c8-536e-425d-b50d-3a396f5ce815 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] HTTP exception thrown: Instance dde85fd5-c0f1-464b-9e40-2efb8875610b is not attached to volume 66ba0434-0d5f-4285-8f8f-70f3c1401c57 Aug 11 00:02:11.268417 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-21fb70c8-536e-425d-b50d-3a396f5ce815 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Request method failure captured: Aug 11 00:02:11.268417 n-d-850468-14 devstack@n-api.service[122633]: request: DELETE /compute/v2.1/servers/dde85fd5-c0f1-464b-9e40-2efb8875610b/os-volume_attachments/66ba0434-0d5f-4285-8f8f-70f3c1401c57 HTTP/1.1 Aug 11 00:02:11.268417 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 11 00:02:11.268417 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 11 00:02:11.268417 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 11 00:02:11.268417 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 11 00:02:11.268417 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 11 00:02:11.268417 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 11 00:02:11.268417 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 11 00:02:11.268417 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 11 00:02:11.268417 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9EaV9bsjtz-1LnPxReI4dDptUKweJRIYYhpWctcLPNBQLB_goGOAjkfyOUkAYZnBbQqTlcQWus65vS_YQ_7b_lOgqtjQuFWg-o59-t-AyX1t5GrxdEYPJvOnlCXCBpLAh_7XmsLATODbvtQff_LQn50jvuDKJFpUc0zx1uPEoT6rwnA Aug 11 00:02:11.268417 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 11 00:02:11.268417 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 11 00:02:11.268417 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 11 00:02:11.268417 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 11 00:02:11.268417 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 11 00:02:11.268417 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 11 00:02:11.268417 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: f35c8636641c43b58b675c29bb52f2e2 Aug 11 00:02:11.268417 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1279764035 Aug 11 00:02:11.268417 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 11 00:02:11.268417 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 11 00:02:11.268417 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f35c8636641c43b58b675c29bb52f2e2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f35c8636641c43b58b675c29bb52f2e2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/f35c8636641c43b58b675c29bb52f2e2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_f35c8636641c43b58b675c29bb52f2e2", "adminURL": "http://10.222.0.58:8080"}]}] Aug 11 00:02:11.268417 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-TestEncryptedCinderVolumes-1279764035 Aug 11 00:02:11.268417 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: f35c8636641c43b58b675c29bb52f2e2 Aug 11 00:02:11.268417 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1279764035 Aug 11 00:02:11.268417 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-TestEncryptedCinderVolumes-1279764035-project Aug 11 00:02:11.268417 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 11 00:02:11.268417 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 11 00:02:11.268417 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: bd92285090ba411194760a83315122d8 Aug 11 00:02:11.268417 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-TestEncryptedCinderVolumes-1279764035-project Aug 11 00:02:11.268417 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 11 00:02:11.268417 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance dde85fd5-c0f1-464b-9e40-2efb8875610b is not attached to volume 66ba0434-0d5f-4285-8f8f-70f3c1401c57 Aug 11 00:02:11.268417 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'server_id': 'dde85fd5-c0f1-464b-9e40-2efb8875610b', 'id': '66ba0434-0d5f-4285-8f8f-70f3c1401c57'} Aug 11 00:02:11.268417 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 00:02:11.268417 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 00:02:11.268417 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 11 00:02:11.268417 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 11 00:02:11.268417 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 11 00:02:11.268417 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 11 00:02:11.268417 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Aug 11 00:02:11.268417 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 11 00:02:11.268417 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 66ba0434-0d5f-4285-8f8f-70f3c1401c57. Aug 11 00:02:11.268417 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 11 00:02:11.268417 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 00:02:11.268417 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 11 00:02:11.268417 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 00:02:11.268417 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 00:02:11.268417 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 00:02:11.268417 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 00:02:11.268417 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 00:02:11.268417 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 00:02:11.268417 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 00:02:11.268417 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 11 00:02:11.268417 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 11 00:02:11.268417 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dde85fd5-c0f1-464b-9e40-2efb8875610b is not attached to volume 66ba0434-0d5f-4285-8f8f-70f3c1401c57 Aug 11 00:02:11.268417 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 11 00:02:11.268417 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 00:02:11.268417 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 11 00:02:11.268417 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 00:02:11.268417 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 00:02:11.268417 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 00:02:11.272256 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 00:02:11.272256 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 00:02:11.272256 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dde85fd5-c0f1-464b-9e40-2efb8875610b is not attached to volume 66ba0434-0d5f-4285-8f8f-70f3c1401c57 Aug 11 00:02:11.272256 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 11 00:02:11.272256 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-21fb70c8-536e-425d-b50d-3a396f5ce815 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Returning 404 to user: Instance dde85fd5-c0f1-464b-9e40-2efb8875610b is not attached to volume 66ba0434-0d5f-4285-8f8f-70f3c1401c57 {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 00:02:11.272256 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-21fb70c8-536e-425d-b50d-3a396f5ce815 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] 10.222.0.58 "DELETE /compute/v2.1/servers/dde85fd5-c0f1-464b-9e40-2efb8875610b/os-volume_attachments/66ba0434-0d5f-4285-8f8f-70f3c1401c57" status: 404 len: 154 microversion: 2.1 time: 0.096006 Aug 11 00:02:11.272256 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3567/6926] 10.222.0.58 () {58 vars in 1416 bytes} [Thu Aug 11 00:02:11 2022] DELETE /compute/v2.1/servers/dde85fd5-c0f1-464b-9e40-2efb8875610b/os-volume_attachments/66ba0434-0d5f-4285-8f8f-70f3c1401c57 => generated 154 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 11 00:02:14.617972 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-70d5538f-ba6a-4054-917e-abb1a8b944fb tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:02:14.618529 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-70d5538f-ba6a-4054-917e-abb1a8b944fb tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] [instance: dde85fd5-c0f1-464b-9e40-2efb8875610b] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:02:14.626353 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-70d5538f-ba6a-4054-917e-abb1a8b944fb tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:02:14.626878 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-70d5538f-ba6a-4054-917e-abb1a8b944fb tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:02:14.627389 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-70d5538f-ba6a-4054-917e-abb1a8b944fb tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:02:14.628137 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-70d5538f-ba6a-4054-917e-abb1a8b944fb tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:02:14.628630 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-70d5538f-ba6a-4054-917e-abb1a8b944fb tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:02:14.629668 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-70d5538f-ba6a-4054-917e-abb1a8b944fb tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:02:14.658057 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-70d5538f-ba6a-4054-917e-abb1a8b944fb tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] [instance: dde85fd5-c0f1-464b-9e40-2efb8875610b] Going to try to terminate instance {{(pid=122632) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 11 00:02:14.742070 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-70d5538f-ba6a-4054-917e-abb1a8b944fb tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] 10.222.0.58 "DELETE /compute/v2.1/servers/dde85fd5-c0f1-464b-9e40-2efb8875610b" status: 204 len: 0 microversion: 2.1 time: 0.127981 Aug 11 00:02:14.742755 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3360/6927] 10.222.0.58 () {58 vars in 1239 bytes} [Thu Aug 11 00:02:14 2022] DELETE /compute/v2.1/servers/dde85fd5-c0f1-464b-9e40-2efb8875610b => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 11 00:02:14.752196 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-4950db56-f3ba-4791-9241-31688737023d tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:02:14.753377 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-4950db56-f3ba-4791-9241-31688737023d tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] [instance: dde85fd5-c0f1-464b-9e40-2efb8875610b] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:02:14.761170 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4950db56-f3ba-4791-9241-31688737023d tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:02:14.761669 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4950db56-f3ba-4791-9241-31688737023d tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:02:14.762125 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4950db56-f3ba-4791-9241-31688737023d tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:02:14.762860 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4950db56-f3ba-4791-9241-31688737023d tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:02:14.763325 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4950db56-f3ba-4791-9241-31688737023d tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:02:14.763762 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4950db56-f3ba-4791-9241-31688737023d tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:02:14.899797 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-4950db56-f3ba-4791-9241-31688737023d tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd92285090ba411194760a83315122d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35c8636641c43b58b675c29bb52f2e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:02:14.907607 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-4950db56-f3ba-4791-9241-31688737023d tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] 10.222.0.58 "GET /compute/v2.1/servers/dde85fd5-c0f1-464b-9e40-2efb8875610b" status: 200 len: 1558 microversion: 2.1 time: 0.160054 Aug 11 00:02:14.908192 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3568/6928] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:02:14 2022] GET /compute/v2.1/servers/dde85fd5-c0f1-464b-9e40-2efb8875610b => generated 1558 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:02:15.929902 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-eff93d39-cde0-4c2e-9831-9ba878ee5ed1 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:02:15.930610 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-eff93d39-cde0-4c2e-9831-9ba878ee5ed1 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] [instance: dde85fd5-c0f1-464b-9e40-2efb8875610b] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:02:15.937633 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-eff93d39-cde0-4c2e-9831-9ba878ee5ed1 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:02:15.938120 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-eff93d39-cde0-4c2e-9831-9ba878ee5ed1 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:02:15.938565 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-eff93d39-cde0-4c2e-9831-9ba878ee5ed1 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:02:15.939365 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-eff93d39-cde0-4c2e-9831-9ba878ee5ed1 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:02:15.939815 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-eff93d39-cde0-4c2e-9831-9ba878ee5ed1 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:02:15.940239 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-eff93d39-cde0-4c2e-9831-9ba878ee5ed1 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:02:16.079627 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-eff93d39-cde0-4c2e-9831-9ba878ee5ed1 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd92285090ba411194760a83315122d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35c8636641c43b58b675c29bb52f2e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:02:16.087507 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-eff93d39-cde0-4c2e-9831-9ba878ee5ed1 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] 10.222.0.58 "GET /compute/v2.1/servers/dde85fd5-c0f1-464b-9e40-2efb8875610b" status: 200 len: 1558 microversion: 2.1 time: 0.162694 Aug 11 00:02:16.088083 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3361/6929] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:02:15 2022] GET /compute/v2.1/servers/dde85fd5-c0f1-464b-9e40-2efb8875610b => generated 1558 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:02:17.042574 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-46675c95-3612-4412-965d-15e15a7f2c0b req-fde44ac1-9625-4deb-8f2d-5704991c01cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dde85fd5-c0f1-464b-9e40-2efb8875610b", "name": "network-vif-deleted", "tag": "87afb9f3-af9b-4847-91f5-0543730d6f41"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 00:02:17.056548 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-46675c95-3612-4412-965d-15e15a7f2c0b req-fde44ac1-9625-4deb-8f2d-5704991c01cc service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:02:17.057132 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-46675c95-3612-4412-965d-15e15a7f2c0b req-fde44ac1-9625-4deb-8f2d-5704991c01cc service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:02:17.057665 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-46675c95-3612-4412-965d-15e15a7f2c0b req-fde44ac1-9625-4deb-8f2d-5704991c01cc service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:02:17.072288 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-46675c95-3612-4412-965d-15e15a7f2c0b req-fde44ac1-9625-4deb-8f2d-5704991c01cc service nova] Creating event network-vif-deleted:87afb9f3-af9b-4847-91f5-0543730d6f41 for instance dde85fd5-c0f1-464b-9e40-2efb8875610b on n-h1-850468-14 Aug 11 00:02:17.078594 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-46675c95-3612-4412-965d-15e15a7f2c0b req-fde44ac1-9625-4deb-8f2d-5704991c01cc service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040134 Aug 11 00:02:17.079746 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3569/6930] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 11 00:02:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 11 00:02:17.109256 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-03ecc978-3f9a-4857-bff5-3e054b33c612 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:02:17.109882 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-03ecc978-3f9a-4857-bff5-3e054b33c612 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] [instance: dde85fd5-c0f1-464b-9e40-2efb8875610b] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:02:17.117505 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-03ecc978-3f9a-4857-bff5-3e054b33c612 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:02:17.117997 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-03ecc978-3f9a-4857-bff5-3e054b33c612 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:02:17.118670 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-03ecc978-3f9a-4857-bff5-3e054b33c612 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:02:17.119798 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-03ecc978-3f9a-4857-bff5-3e054b33c612 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:02:17.120398 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-03ecc978-3f9a-4857-bff5-3e054b33c612 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:02:17.120960 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-03ecc978-3f9a-4857-bff5-3e054b33c612 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:02:17.156383 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-03ecc978-3f9a-4857-bff5-3e054b33c612 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:02:17.156869 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-03ecc978-3f9a-4857-bff5-3e054b33c612 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:02:17.157304 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-03ecc978-3f9a-4857-bff5-3e054b33c612 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:02:17.157756 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.objects.instance [None req-03ecc978-3f9a-4857-bff5-3e054b33c612 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lazy-loading 'fault' on Instance uuid dde85fd5-c0f1-464b-9e40-2efb8875610b {{(pid=122632) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 11 00:02:17.208050 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-03ecc978-3f9a-4857-bff5-3e054b33c612 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd92285090ba411194760a83315122d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f35c8636641c43b58b675c29bb52f2e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:02:17.215675 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-03ecc978-3f9a-4857-bff5-3e054b33c612 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] 10.222.0.58 "GET /compute/v2.1/servers/dde85fd5-c0f1-464b-9e40-2efb8875610b" status: 200 len: 1351 microversion: 2.1 time: 0.110585 Aug 11 00:02:17.216229 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3362/6931] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:02:17 2022] GET /compute/v2.1/servers/dde85fd5-c0f1-464b-9e40-2efb8875610b => generated 1351 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:02:18.238253 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-7e9d0fc4-c942-4c08-9b1f-c8b93b33eba0 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:02:18.239018 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-7e9d0fc4-c942-4c08-9b1f-c8b93b33eba0 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] [instance: dde85fd5-c0f1-464b-9e40-2efb8875610b] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:02:18.246149 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7e9d0fc4-c942-4c08-9b1f-c8b93b33eba0 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:02:18.246655 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7e9d0fc4-c942-4c08-9b1f-c8b93b33eba0 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:02:18.247144 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7e9d0fc4-c942-4c08-9b1f-c8b93b33eba0 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:02:18.247869 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7e9d0fc4-c942-4c08-9b1f-c8b93b33eba0 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:02:18.248346 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7e9d0fc4-c942-4c08-9b1f-c8b93b33eba0 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:02:18.248796 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7e9d0fc4-c942-4c08-9b1f-c8b93b33eba0 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:02:18.262423 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-7e9d0fc4-c942-4c08-9b1f-c8b93b33eba0 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] HTTP exception thrown: Instance dde85fd5-c0f1-464b-9e40-2efb8875610b could not be found. Aug 11 00:02:18.264163 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-7e9d0fc4-c942-4c08-9b1f-c8b93b33eba0 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Request method failure captured: Aug 11 00:02:18.264163 n-d-850468-14 devstack@n-api.service[122633]: request: GET /compute/v2.1/servers/dde85fd5-c0f1-464b-9e40-2efb8875610b HTTP/1.1 Aug 11 00:02:18.264163 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 11 00:02:18.264163 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 11 00:02:18.264163 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 11 00:02:18.264163 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 11 00:02:18.264163 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 11 00:02:18.264163 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 11 00:02:18.264163 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 11 00:02:18.264163 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 11 00:02:18.264163 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9EaV9bsjtz-1LnPxReI4dDptUKweJRIYYhpWctcLPNBQLB_goGOAjkfyOUkAYZnBbQqTlcQWus65vS_YQ_7b_lOgqtjQuFWg-o59-t-AyX1t5GrxdEYPJvOnlCXCBpLAh_7XmsLATODbvtQff_LQn50jvuDKJFpUc0zx1uPEoT6rwnA Aug 11 00:02:18.264163 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 11 00:02:18.264163 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 11 00:02:18.264163 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 11 00:02:18.264163 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 11 00:02:18.264163 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 11 00:02:18.264163 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 11 00:02:18.264163 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: f35c8636641c43b58b675c29bb52f2e2 Aug 11 00:02:18.264163 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1279764035 Aug 11 00:02:18.264163 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 11 00:02:18.264163 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 11 00:02:18.264163 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f35c8636641c43b58b675c29bb52f2e2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/f35c8636641c43b58b675c29bb52f2e2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/f35c8636641c43b58b675c29bb52f2e2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_f35c8636641c43b58b675c29bb52f2e2", "adminURL": "http://10.222.0.58:8080"}]}] Aug 11 00:02:18.264163 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-TestEncryptedCinderVolumes-1279764035 Aug 11 00:02:18.264163 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: f35c8636641c43b58b675c29bb52f2e2 Aug 11 00:02:18.264163 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1279764035 Aug 11 00:02:18.264163 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-TestEncryptedCinderVolumes-1279764035-project Aug 11 00:02:18.264163 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 11 00:02:18.264163 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 11 00:02:18.264163 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: bd92285090ba411194760a83315122d8 Aug 11 00:02:18.264163 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-TestEncryptedCinderVolumes-1279764035-project Aug 11 00:02:18.264163 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 11 00:02:18.264163 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance dde85fd5-c0f1-464b-9e40-2efb8875610b could not be found. Aug 11 00:02:18.264163 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': 'dde85fd5-c0f1-464b-9e40-2efb8875610b'} Aug 11 00:02:18.264163 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 00:02:18.264163 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 00:02:18.264163 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 11 00:02:18.264163 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 11 00:02:18.264163 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 11 00:02:18.264163 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 11 00:02:18.264163 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 11 00:02:18.264163 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 11 00:02:18.264163 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 11 00:02:18.264163 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 11 00:02:18.264163 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dde85fd5-c0f1-464b-9e40-2efb8875610b could not be found. Aug 11 00:02:18.264163 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 11 00:02:18.264163 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 00:02:18.264163 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 11 00:02:18.264163 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 00:02:18.264163 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 00:02:18.264163 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 00:02:18.264163 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 00:02:18.264163 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 00:02:18.264163 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 00:02:18.264163 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 00:02:18.264163 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 11 00:02:18.264163 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 11 00:02:18.264163 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 11 00:02:18.264163 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 11 00:02:18.264163 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 11 00:02:18.264163 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 11 00:02:18.264163 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dde85fd5-c0f1-464b-9e40-2efb8875610b could not be found. Aug 11 00:02:18.264163 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 11 00:02:18.264163 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 00:02:18.268108 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 11 00:02:18.268108 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 00:02:18.268108 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 00:02:18.268108 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 00:02:18.268108 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 00:02:18.268108 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 00:02:18.268108 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dde85fd5-c0f1-464b-9e40-2efb8875610b could not be found. Aug 11 00:02:18.268108 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 11 00:02:18.268108 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-7e9d0fc4-c942-4c08-9b1f-c8b93b33eba0 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Returning 404 to user: Instance dde85fd5-c0f1-464b-9e40-2efb8875610b could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 00:02:18.268108 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-7e9d0fc4-c942-4c08-9b1f-c8b93b33eba0 tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] 10.222.0.58 "GET /compute/v2.1/servers/dde85fd5-c0f1-464b-9e40-2efb8875610b" status: 404 len: 111 microversion: 2.1 time: 0.031766 Aug 11 00:02:18.268108 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3570/6932] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:02:18 2022] GET /compute/v2.1/servers/dde85fd5-c0f1-464b-9e40-2efb8875610b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 11 00:02:18.275685 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-3928d2e0-2847-490a-adc6-3882d4f7848e tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] Calling method '.version_select at 0x7f847dc87e50>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:02:18.296401 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-3928d2e0-2847-490a-adc6-3882d4f7848e tempest-TestEncryptedCinderVolumes-1279764035 tempest-TestEncryptedCinderVolumes-1279764035-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-706893294" status: 202 len: 0 microversion: 2.1 time: 0.024536 Aug 11 00:02:18.296983 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3363/6933] 10.222.0.58 () {58 vars in 1275 bytes} [Thu Aug 11 00:02:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-706893294 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 11 00:02:45.888394 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-9659b1f3-829b-4a7f-b7fd-e36c953b6f12 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Action: 'create', calling method: .version_select at 0x7f847c4f3430>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-617855963", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKdN4ZGfTtqHw0eLoyuhvb7uyFz0DVPtBNdjYy/MNNA0NRgP62Uf00Nka8ieA6sTucdD2zw6M5HtBtdsCJeAfzQbJ71mw8jynl7Y6YVBpbtAKMHz7r8xvidtmT2JRqe0Uw=="}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 00:02:45.894126 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_api:SELECT=14 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:02:45.894806 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=34 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:02:45.907443 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-9659b1f3-829b-4a7f-b7fd-e36c953b6f12 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Getting quotas for project 051455ee483443618e113df12aa9387a. Resources: {'key_pairs'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 11 00:02:45.913377 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-9659b1f3-829b-4a7f-b7fd-e36c953b6f12 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Getting quotas for user dba07c55f73147909e8fe2b56d64791e and project 051455ee483443618e113df12aa9387a. Resources: {'key_pairs'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 11 00:02:45.936718 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-9659b1f3-829b-4a7f-b7fd-e36c953b6f12 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.052464 Aug 11 00:02:45.937244 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3571/6934] 10.222.0.58 () {60 vars in 1159 bytes} [Thu Aug 11 00:02:45 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 00:02:45.986645 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:02:45.987479 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:02:45.994184 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-a07d3855-b609-45a0-8cf1-867649d7c0ed tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1055075018", "imageRef": "75535b11-7fef-4dd9-8c54-00b087f4982f", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-617855963", "networks": [{"uuid": "805c51ba-babd-4e01-ab2f-6df1c73cf27e"}]}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 00:02:46.050922 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.network.neutron [None req-a07d3855-b609-45a0-8cf1-867649d7c0ed tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] validate_networks() for [('805c51ba-babd-4e01-ab2f-6df1c73cf27e', None, None, None, None, None)] {{(pid=122632) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 11 00:02:46.428661 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-a07d3855-b609-45a0-8cf1-867649d7c0ed tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Flavor limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 11 00:02:46.429079 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-a07d3855-b609-45a0-8cf1-867649d7c0ed tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Image limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 11 00:02:46.429579 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-a07d3855-b609-45a0-8cf1-867649d7c0ed tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Flavor pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 11 00:02:46.429986 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-a07d3855-b609-45a0-8cf1-867649d7c0ed tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Image pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 11 00:02:46.430400 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-a07d3855-b609-45a0-8cf1-867649d7c0ed tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 11 00:02:46.439355 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a07d3855-b609-45a0-8cf1-867649d7c0ed tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:02:46.439857 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a07d3855-b609-45a0-8cf1-867649d7c0ed tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:02:46.440291 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a07d3855-b609-45a0-8cf1-867649d7c0ed tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:02:46.441007 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a07d3855-b609-45a0-8cf1-867649d7c0ed tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:02:46.441564 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a07d3855-b609-45a0-8cf1-867649d7c0ed tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:02:46.441995 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a07d3855-b609-45a0-8cf1-867649d7c0ed tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:02:46.461345 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-a07d3855-b609-45a0-8cf1-867649d7c0ed tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Getting quotas for project 051455ee483443618e113df12aa9387a. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 11 00:02:46.466588 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-a07d3855-b609-45a0-8cf1-867649d7c0ed tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Getting quotas for user dba07c55f73147909e8fe2b56d64791e and project 051455ee483443618e113df12aa9387a. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 11 00:02:46.480439 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-a07d3855-b609-45a0-8cf1-867649d7c0ed tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Going to run 1 instances... {{(pid=122632) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 11 00:02:46.482560 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-a07d3855-b609-45a0-8cf1-867649d7c0ed tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] [instance: 99a1b87a-1664-43b4-be05-d2fa7ce8e3ec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='75535b11-7fef-4dd9-8c54-00b087f4982f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122632) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 11 00:02:46.529991 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-a07d3855-b609-45a0-8cf1-867649d7c0ed tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.545450 Aug 11 00:02:46.530837 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3364/6935] 10.222.0.58 () {60 vars in 1147 bytes} [Thu Aug 11 00:02:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 547 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 11 00:02:46.541929 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-f0dd7d74-21d7-400f-b150-bf0196b21266 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:02:46.542618 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-f0dd7d74-21d7-400f-b150-bf0196b21266 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] [instance: 99a1b87a-1664-43b4-be05-d2fa7ce8e3ec] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:02:46.601068 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-f0dd7d74-21d7-400f-b150-bf0196b21266 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba07c55f73147909e8fe2b56d64791e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051455ee483443618e113df12aa9387a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:02:46.607921 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-f0dd7d74-21d7-400f-b150-bf0196b21266 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] 10.222.0.58 "GET /compute/v2.1/servers/99a1b87a-1664-43b4-be05-d2fa7ce8e3ec" status: 200 len: 1258 microversion: 2.1 time: 0.069922 Aug 11 00:02:46.608499 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3572/6936] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:02:46 2022] GET /compute/v2.1/servers/99a1b87a-1664-43b4-be05-d2fa7ce8e3ec => generated 1258 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:02:47.631292 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-9b28259a-ef25-4f2d-adf8-e386b7656899 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:02:47.632700 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-9b28259a-ef25-4f2d-adf8-e386b7656899 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] [instance: 99a1b87a-1664-43b4-be05-d2fa7ce8e3ec] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:02:47.641021 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9b28259a-ef25-4f2d-adf8-e386b7656899 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:02:47.641515 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9b28259a-ef25-4f2d-adf8-e386b7656899 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:02:47.641960 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9b28259a-ef25-4f2d-adf8-e386b7656899 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:02:47.642988 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9b28259a-ef25-4f2d-adf8-e386b7656899 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:02:47.643645 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9b28259a-ef25-4f2d-adf8-e386b7656899 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:02:47.644224 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9b28259a-ef25-4f2d-adf8-e386b7656899 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:02:47.728765 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-9b28259a-ef25-4f2d-adf8-e386b7656899 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba07c55f73147909e8fe2b56d64791e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051455ee483443618e113df12aa9387a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:02:47.737723 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-9b28259a-ef25-4f2d-adf8-e386b7656899 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] 10.222.0.58 "GET /compute/v2.1/servers/99a1b87a-1664-43b4-be05-d2fa7ce8e3ec" status: 200 len: 1318 microversion: 2.1 time: 0.111757 Aug 11 00:02:47.738535 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3365/6937] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:02:47 2022] GET /compute/v2.1/servers/99a1b87a-1664-43b4-be05-d2fa7ce8e3ec => generated 1318 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 00:02:48.762696 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-5a6ad4dc-9fa5-4796-8804-aca61f801bd3 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:02:48.764075 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-5a6ad4dc-9fa5-4796-8804-aca61f801bd3 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] [instance: 99a1b87a-1664-43b4-be05-d2fa7ce8e3ec] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:02:48.772682 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5a6ad4dc-9fa5-4796-8804-aca61f801bd3 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:02:48.773759 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5a6ad4dc-9fa5-4796-8804-aca61f801bd3 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:02:48.774695 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5a6ad4dc-9fa5-4796-8804-aca61f801bd3 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:02:48.775668 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5a6ad4dc-9fa5-4796-8804-aca61f801bd3 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:02:48.776344 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5a6ad4dc-9fa5-4796-8804-aca61f801bd3 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:02:48.776992 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5a6ad4dc-9fa5-4796-8804-aca61f801bd3 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:02:48.937001 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-5a6ad4dc-9fa5-4796-8804-aca61f801bd3 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba07c55f73147909e8fe2b56d64791e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051455ee483443618e113df12aa9387a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:02:48.945823 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-5a6ad4dc-9fa5-4796-8804-aca61f801bd3 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] 10.222.0.58 "GET /compute/v2.1/servers/99a1b87a-1664-43b4-be05-d2fa7ce8e3ec" status: 200 len: 1358 microversion: 2.1 time: 0.188759 Aug 11 00:02:48.946440 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3573/6938] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:02:48 2022] GET /compute/v2.1/servers/99a1b87a-1664-43b4-be05-d2fa7ce8e3ec => generated 1358 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:02:49.967671 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-e5906358-a213-4208-8401-aaf0688f90ce tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:02:49.968463 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-e5906358-a213-4208-8401-aaf0688f90ce tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] [instance: 99a1b87a-1664-43b4-be05-d2fa7ce8e3ec] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:02:49.975563 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e5906358-a213-4208-8401-aaf0688f90ce tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:02:49.976368 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e5906358-a213-4208-8401-aaf0688f90ce tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:02:49.976801 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e5906358-a213-4208-8401-aaf0688f90ce tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:02:49.977562 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e5906358-a213-4208-8401-aaf0688f90ce tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:02:49.977954 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e5906358-a213-4208-8401-aaf0688f90ce tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:02:49.978377 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e5906358-a213-4208-8401-aaf0688f90ce tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:02:50.138886 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-e5906358-a213-4208-8401-aaf0688f90ce tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba07c55f73147909e8fe2b56d64791e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051455ee483443618e113df12aa9387a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:02:50.147130 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-e5906358-a213-4208-8401-aaf0688f90ce tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] 10.222.0.58 "GET /compute/v2.1/servers/99a1b87a-1664-43b4-be05-d2fa7ce8e3ec" status: 200 len: 1358 microversion: 2.1 time: 0.184410 Aug 11 00:02:50.147720 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3366/6939] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:02:49 2022] GET /compute/v2.1/servers/99a1b87a-1664-43b4-be05-d2fa7ce8e3ec => generated 1358 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:02:51.169672 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-f8402b5a-7fe9-4cb9-9512-0ef64c5be476 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:02:51.170328 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-f8402b5a-7fe9-4cb9-9512-0ef64c5be476 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] [instance: 99a1b87a-1664-43b4-be05-d2fa7ce8e3ec] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:02:51.178036 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f8402b5a-7fe9-4cb9-9512-0ef64c5be476 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:02:51.178669 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f8402b5a-7fe9-4cb9-9512-0ef64c5be476 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:02:51.179173 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f8402b5a-7fe9-4cb9-9512-0ef64c5be476 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:02:51.179910 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f8402b5a-7fe9-4cb9-9512-0ef64c5be476 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:02:51.180394 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f8402b5a-7fe9-4cb9-9512-0ef64c5be476 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:02:51.180844 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f8402b5a-7fe9-4cb9-9512-0ef64c5be476 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:02:51.325719 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-f8402b5a-7fe9-4cb9-9512-0ef64c5be476 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba07c55f73147909e8fe2b56d64791e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051455ee483443618e113df12aa9387a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:02:51.334418 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-f8402b5a-7fe9-4cb9-9512-0ef64c5be476 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] 10.222.0.58 "GET /compute/v2.1/servers/99a1b87a-1664-43b4-be05-d2fa7ce8e3ec" status: 200 len: 1358 microversion: 2.1 time: 0.169564 Aug 11 00:02:51.335014 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3574/6940] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:02:51 2022] GET /compute/v2.1/servers/99a1b87a-1664-43b4-be05-d2fa7ce8e3ec => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:02:52.356519 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-ead1c5d3-00f5-41de-b9a8-cd1bfd712135 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:02:52.357157 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-ead1c5d3-00f5-41de-b9a8-cd1bfd712135 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] [instance: 99a1b87a-1664-43b4-be05-d2fa7ce8e3ec] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:02:52.365814 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ead1c5d3-00f5-41de-b9a8-cd1bfd712135 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:02:52.366309 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ead1c5d3-00f5-41de-b9a8-cd1bfd712135 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:02:52.366753 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ead1c5d3-00f5-41de-b9a8-cd1bfd712135 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:02:52.367501 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ead1c5d3-00f5-41de-b9a8-cd1bfd712135 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:02:52.367997 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ead1c5d3-00f5-41de-b9a8-cd1bfd712135 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:02:52.368431 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ead1c5d3-00f5-41de-b9a8-cd1bfd712135 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:02:52.532400 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-ead1c5d3-00f5-41de-b9a8-cd1bfd712135 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba07c55f73147909e8fe2b56d64791e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051455ee483443618e113df12aa9387a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:02:52.540653 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-ead1c5d3-00f5-41de-b9a8-cd1bfd712135 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] 10.222.0.58 "GET /compute/v2.1/servers/99a1b87a-1664-43b4-be05-d2fa7ce8e3ec" status: 200 len: 1358 microversion: 2.1 time: 0.188144 Aug 11 00:02:52.541504 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3367/6941] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:02:52 2022] GET /compute/v2.1/servers/99a1b87a-1664-43b4-be05-d2fa7ce8e3ec => generated 1358 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:02:53.562151 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-84f19e32-3083-45e0-8ae6-394741b9d920 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:02:53.562776 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-84f19e32-3083-45e0-8ae6-394741b9d920 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] [instance: 99a1b87a-1664-43b4-be05-d2fa7ce8e3ec] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:02:53.571173 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-84f19e32-3083-45e0-8ae6-394741b9d920 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:02:53.571684 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-84f19e32-3083-45e0-8ae6-394741b9d920 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:02:53.572141 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-84f19e32-3083-45e0-8ae6-394741b9d920 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:02:53.572870 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-84f19e32-3083-45e0-8ae6-394741b9d920 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:02:53.573341 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-84f19e32-3083-45e0-8ae6-394741b9d920 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:02:53.573781 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-84f19e32-3083-45e0-8ae6-394741b9d920 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:02:53.721561 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-84f19e32-3083-45e0-8ae6-394741b9d920 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba07c55f73147909e8fe2b56d64791e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051455ee483443618e113df12aa9387a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:02:53.730128 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-84f19e32-3083-45e0-8ae6-394741b9d920 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] 10.222.0.58 "GET /compute/v2.1/servers/99a1b87a-1664-43b4-be05-d2fa7ce8e3ec" status: 200 len: 1358 microversion: 2.1 time: 0.172308 Aug 11 00:02:53.731103 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3575/6942] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:02:53 2022] GET /compute/v2.1/servers/99a1b87a-1664-43b4-be05-d2fa7ce8e3ec => generated 1358 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:02:54.752141 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c5a4efa4-3c88-4177-969b-0aeac3ebd582 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:02:54.752782 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-c5a4efa4-3c88-4177-969b-0aeac3ebd582 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] [instance: 99a1b87a-1664-43b4-be05-d2fa7ce8e3ec] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:02:54.760668 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c5a4efa4-3c88-4177-969b-0aeac3ebd582 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:02:54.761167 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c5a4efa4-3c88-4177-969b-0aeac3ebd582 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:02:54.761613 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c5a4efa4-3c88-4177-969b-0aeac3ebd582 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:02:54.762338 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c5a4efa4-3c88-4177-969b-0aeac3ebd582 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:02:54.762824 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c5a4efa4-3c88-4177-969b-0aeac3ebd582 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:02:54.763260 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c5a4efa4-3c88-4177-969b-0aeac3ebd582 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:02:54.908047 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-c5a4efa4-3c88-4177-969b-0aeac3ebd582 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba07c55f73147909e8fe2b56d64791e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051455ee483443618e113df12aa9387a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:02:54.915690 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-c5a4efa4-3c88-4177-969b-0aeac3ebd582 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] 10.222.0.58 "GET /compute/v2.1/servers/99a1b87a-1664-43b4-be05-d2fa7ce8e3ec" status: 200 len: 1358 microversion: 2.1 time: 0.167775 Aug 11 00:02:54.916280 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3368/6943] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:02:54 2022] GET /compute/v2.1/servers/99a1b87a-1664-43b4-be05-d2fa7ce8e3ec => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:02:55.938246 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-2a711510-681d-4658-b287-0f1e4a5cc91a tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:02:55.939477 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-2a711510-681d-4658-b287-0f1e4a5cc91a tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] [instance: 99a1b87a-1664-43b4-be05-d2fa7ce8e3ec] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:02:55.946548 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2a711510-681d-4658-b287-0f1e4a5cc91a tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:02:55.947077 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2a711510-681d-4658-b287-0f1e4a5cc91a tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:02:55.947526 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2a711510-681d-4658-b287-0f1e4a5cc91a tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:02:55.948705 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2a711510-681d-4658-b287-0f1e4a5cc91a tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:02:55.948705 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2a711510-681d-4658-b287-0f1e4a5cc91a tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:02:55.949154 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2a711510-681d-4658-b287-0f1e4a5cc91a tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:02:56.085100 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-2a711510-681d-4658-b287-0f1e4a5cc91a tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba07c55f73147909e8fe2b56d64791e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051455ee483443618e113df12aa9387a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:02:56.092894 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-2a711510-681d-4658-b287-0f1e4a5cc91a tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] 10.222.0.58 "GET /compute/v2.1/servers/99a1b87a-1664-43b4-be05-d2fa7ce8e3ec" status: 200 len: 1358 microversion: 2.1 time: 0.158701 Aug 11 00:02:56.093487 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3576/6944] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:02:55 2022] GET /compute/v2.1/servers/99a1b87a-1664-43b4-be05-d2fa7ce8e3ec => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:02:56.176458 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-13be9186-170d-4616-b372-a228c490e30c req-b3cc1f09-86d4-4e89-8693-67f08354923c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99a1b87a-1664-43b4-be05-d2fa7ce8e3ec", "tag": "b4124988-9fd1-4b35-8657-69aea463b181"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 00:02:56.186889 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-13be9186-170d-4616-b372-a228c490e30c req-b3cc1f09-86d4-4e89-8693-67f08354923c service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:02:56.187370 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-13be9186-170d-4616-b372-a228c490e30c req-b3cc1f09-86d4-4e89-8693-67f08354923c service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:02:56.187797 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-13be9186-170d-4616-b372-a228c490e30c req-b3cc1f09-86d4-4e89-8693-67f08354923c service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:02:56.200053 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-13be9186-170d-4616-b372-a228c490e30c req-b3cc1f09-86d4-4e89-8693-67f08354923c service nova] Creating event network-changed:b4124988-9fd1-4b35-8657-69aea463b181 for instance 99a1b87a-1664-43b4-be05-d2fa7ce8e3ec on n-h1-850468-14 Aug 11 00:02:56.205182 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-13be9186-170d-4616-b372-a228c490e30c req-b3cc1f09-86d4-4e89-8693-67f08354923c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032532 Aug 11 00:02:56.205856 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3369/6945] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 11 00:02:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 00:02:57.113926 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-39d7c9e1-e17a-4be5-a9cc-b329afea8e4d tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:02:57.114706 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-39d7c9e1-e17a-4be5-a9cc-b329afea8e4d tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] [instance: 99a1b87a-1664-43b4-be05-d2fa7ce8e3ec] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:02:57.117078 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=6 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:02:57.123595 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-39d7c9e1-e17a-4be5-a9cc-b329afea8e4d tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:02:57.124101 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-39d7c9e1-e17a-4be5-a9cc-b329afea8e4d tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:02:57.124689 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-39d7c9e1-e17a-4be5-a9cc-b329afea8e4d tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:02:57.125672 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-39d7c9e1-e17a-4be5-a9cc-b329afea8e4d tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:02:57.126166 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-39d7c9e1-e17a-4be5-a9cc-b329afea8e4d tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:02:57.126622 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-39d7c9e1-e17a-4be5-a9cc-b329afea8e4d tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:02:57.262242 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-39d7c9e1-e17a-4be5-a9cc-b329afea8e4d tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba07c55f73147909e8fe2b56d64791e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051455ee483443618e113df12aa9387a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:02:57.269878 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-39d7c9e1-e17a-4be5-a9cc-b329afea8e4d tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] 10.222.0.58 "GET /compute/v2.1/servers/99a1b87a-1664-43b4-be05-d2fa7ce8e3ec" status: 200 len: 1358 microversion: 2.1 time: 0.159999 Aug 11 00:02:57.270460 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3577/6946] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:02:57 2022] GET /compute/v2.1/servers/99a1b87a-1664-43b4-be05-d2fa7ce8e3ec => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:02:58.289396 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=2 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:02:58.290173 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=6 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:02:58.295400 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-37260803-7279-40d0-9f06-7ba70783b150 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:02:58.296100 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-37260803-7279-40d0-9f06-7ba70783b150 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] [instance: 99a1b87a-1664-43b4-be05-d2fa7ce8e3ec] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:02:58.304160 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-37260803-7279-40d0-9f06-7ba70783b150 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:02:58.304649 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-37260803-7279-40d0-9f06-7ba70783b150 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:02:58.305091 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-37260803-7279-40d0-9f06-7ba70783b150 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:02:58.305768 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-37260803-7279-40d0-9f06-7ba70783b150 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:02:58.306214 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-37260803-7279-40d0-9f06-7ba70783b150 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:02:58.306637 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-37260803-7279-40d0-9f06-7ba70783b150 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:02:58.438261 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-37260803-7279-40d0-9f06-7ba70783b150 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba07c55f73147909e8fe2b56d64791e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051455ee483443618e113df12aa9387a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:02:58.445800 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-37260803-7279-40d0-9f06-7ba70783b150 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] 10.222.0.58 "GET /compute/v2.1/servers/99a1b87a-1664-43b4-be05-d2fa7ce8e3ec" status: 200 len: 1358 microversion: 2.1 time: 0.157383 Aug 11 00:02:58.446375 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3370/6947] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:02:58 2022] GET /compute/v2.1/servers/99a1b87a-1664-43b4-be05-d2fa7ce8e3ec => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:02:59.466894 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-ee954cf7-ab43-468b-918f-ff202b112f17 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:02:59.467538 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-ee954cf7-ab43-468b-918f-ff202b112f17 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] [instance: 99a1b87a-1664-43b4-be05-d2fa7ce8e3ec] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:02:59.475415 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ee954cf7-ab43-468b-918f-ff202b112f17 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:02:59.475415 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ee954cf7-ab43-468b-918f-ff202b112f17 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:02:59.475750 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ee954cf7-ab43-468b-918f-ff202b112f17 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:02:59.476476 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ee954cf7-ab43-468b-918f-ff202b112f17 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:02:59.476953 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ee954cf7-ab43-468b-918f-ff202b112f17 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:02:59.477393 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ee954cf7-ab43-468b-918f-ff202b112f17 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:02:59.611466 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-ee954cf7-ab43-468b-918f-ff202b112f17 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba07c55f73147909e8fe2b56d64791e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051455ee483443618e113df12aa9387a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:02:59.620399 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-ee954cf7-ab43-468b-918f-ff202b112f17 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] 10.222.0.58 "GET /compute/v2.1/servers/99a1b87a-1664-43b4-be05-d2fa7ce8e3ec" status: 200 len: 1358 microversion: 2.1 time: 0.157520 Aug 11 00:02:59.620984 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3578/6948] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:02:59 2022] GET /compute/v2.1/servers/99a1b87a-1664-43b4-be05-d2fa7ce8e3ec => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:03:00.641426 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-006ba1db-71d5-4699-be04-6f2804059ae5 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:03:00.642037 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-006ba1db-71d5-4699-be04-6f2804059ae5 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] [instance: 99a1b87a-1664-43b4-be05-d2fa7ce8e3ec] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:03:00.649580 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-006ba1db-71d5-4699-be04-6f2804059ae5 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:03:00.650068 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-006ba1db-71d5-4699-be04-6f2804059ae5 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:03:00.650507 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-006ba1db-71d5-4699-be04-6f2804059ae5 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:03:00.651236 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-006ba1db-71d5-4699-be04-6f2804059ae5 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:03:00.651711 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-006ba1db-71d5-4699-be04-6f2804059ae5 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:03:00.652137 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-006ba1db-71d5-4699-be04-6f2804059ae5 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:03:00.793300 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-006ba1db-71d5-4699-be04-6f2804059ae5 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba07c55f73147909e8fe2b56d64791e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051455ee483443618e113df12aa9387a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:03:00.801570 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-006ba1db-71d5-4699-be04-6f2804059ae5 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] 10.222.0.58 "GET /compute/v2.1/servers/99a1b87a-1664-43b4-be05-d2fa7ce8e3ec" status: 200 len: 1358 microversion: 2.1 time: 0.163441 Aug 11 00:03:00.801570 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3371/6949] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:03:00 2022] GET /compute/v2.1/servers/99a1b87a-1664-43b4-be05-d2fa7ce8e3ec => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:03:01.074168 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-19f44034-a946-4207-84ce-afef669fafc7 req-992aeb87-b0ef-4848-b655-b64551bd5c48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99a1b87a-1664-43b4-be05-d2fa7ce8e3ec", "name": "network-vif-plugged", "status": "completed", "tag": "b4124988-9fd1-4b35-8657-69aea463b181"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 00:03:01.084102 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-19f44034-a946-4207-84ce-afef669fafc7 req-992aeb87-b0ef-4848-b655-b64551bd5c48 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:03:01.084903 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-19f44034-a946-4207-84ce-afef669fafc7 req-992aeb87-b0ef-4848-b655-b64551bd5c48 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:03:01.085161 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-19f44034-a946-4207-84ce-afef669fafc7 req-992aeb87-b0ef-4848-b655-b64551bd5c48 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:03:01.099734 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-19f44034-a946-4207-84ce-afef669fafc7 req-992aeb87-b0ef-4848-b655-b64551bd5c48 service nova] Creating event network-vif-plugged:b4124988-9fd1-4b35-8657-69aea463b181 for instance 99a1b87a-1664-43b4-be05-d2fa7ce8e3ec on n-h1-850468-14 Aug 11 00:03:01.104826 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-19f44034-a946-4207-84ce-afef669fafc7 req-992aeb87-b0ef-4848-b655-b64551bd5c48 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034550 Aug 11 00:03:01.105398 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3579/6950] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 11 00:03:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 00:03:01.822008 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-46c9a5b0-1a25-49bc-908f-beed5bdf07f4 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:03:01.822662 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-46c9a5b0-1a25-49bc-908f-beed5bdf07f4 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] [instance: 99a1b87a-1664-43b4-be05-d2fa7ce8e3ec] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:03:01.829792 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-46c9a5b0-1a25-49bc-908f-beed5bdf07f4 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:03:01.830280 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-46c9a5b0-1a25-49bc-908f-beed5bdf07f4 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:03:01.830725 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-46c9a5b0-1a25-49bc-908f-beed5bdf07f4 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:03:01.831465 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-46c9a5b0-1a25-49bc-908f-beed5bdf07f4 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:03:01.831922 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-46c9a5b0-1a25-49bc-908f-beed5bdf07f4 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:03:01.832352 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-46c9a5b0-1a25-49bc-908f-beed5bdf07f4 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:03:01.962827 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-46c9a5b0-1a25-49bc-908f-beed5bdf07f4 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba07c55f73147909e8fe2b56d64791e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051455ee483443618e113df12aa9387a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:03:01.970355 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-46c9a5b0-1a25-49bc-908f-beed5bdf07f4 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] 10.222.0.58 "GET /compute/v2.1/servers/99a1b87a-1664-43b4-be05-d2fa7ce8e3ec" status: 200 len: 1358 microversion: 2.1 time: 0.152293 Aug 11 00:03:01.970958 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3372/6951] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:03:01 2022] GET /compute/v2.1/servers/99a1b87a-1664-43b4-be05-d2fa7ce8e3ec => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:03:02.994026 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-ebcb7281-cc9d-4c22-b400-3a1ecd86dafd tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:03:02.994742 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-ebcb7281-cc9d-4c22-b400-3a1ecd86dafd tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] [instance: 99a1b87a-1664-43b4-be05-d2fa7ce8e3ec] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:03:03.001298 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ebcb7281-cc9d-4c22-b400-3a1ecd86dafd tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:03:03.001795 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ebcb7281-cc9d-4c22-b400-3a1ecd86dafd tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:03:03.002250 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ebcb7281-cc9d-4c22-b400-3a1ecd86dafd tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:03:03.003003 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ebcb7281-cc9d-4c22-b400-3a1ecd86dafd tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:03:03.003478 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ebcb7281-cc9d-4c22-b400-3a1ecd86dafd tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:03:03.003923 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ebcb7281-cc9d-4c22-b400-3a1ecd86dafd tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:03:03.137483 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-ebcb7281-cc9d-4c22-b400-3a1ecd86dafd tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba07c55f73147909e8fe2b56d64791e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051455ee483443618e113df12aa9387a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:03:03.145113 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-ebcb7281-cc9d-4c22-b400-3a1ecd86dafd tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] 10.222.0.58 "GET /compute/v2.1/servers/99a1b87a-1664-43b4-be05-d2fa7ce8e3ec" status: 200 len: 1549 microversion: 2.1 time: 0.156953 Aug 11 00:03:03.145698 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3580/6952] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:03:02 2022] GET /compute/v2.1/servers/99a1b87a-1664-43b4-be05-d2fa7ce8e3ec => generated 1549 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:03:03.167177 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-7983f3cd-9b3e-4b40-8040-10f86cd8056a tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:03:03.167859 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-7983f3cd-9b3e-4b40-8040-10f86cd8056a tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] [instance: 99a1b87a-1664-43b4-be05-d2fa7ce8e3ec] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:03:03.174391 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7983f3cd-9b3e-4b40-8040-10f86cd8056a tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:03:03.174902 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7983f3cd-9b3e-4b40-8040-10f86cd8056a tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:03:03.175345 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7983f3cd-9b3e-4b40-8040-10f86cd8056a tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:03:03.176041 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7983f3cd-9b3e-4b40-8040-10f86cd8056a tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:03:03.176541 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7983f3cd-9b3e-4b40-8040-10f86cd8056a tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:03:03.177011 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7983f3cd-9b3e-4b40-8040-10f86cd8056a tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:03:03.315930 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-7983f3cd-9b3e-4b40-8040-10f86cd8056a tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba07c55f73147909e8fe2b56d64791e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051455ee483443618e113df12aa9387a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:03:03.323696 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-7983f3cd-9b3e-4b40-8040-10f86cd8056a tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] 10.222.0.58 "GET /compute/v2.1/servers/99a1b87a-1664-43b4-be05-d2fa7ce8e3ec" status: 200 len: 1549 microversion: 2.1 time: 0.161288 Aug 11 00:03:03.324296 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3373/6953] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:03:03 2022] GET /compute/v2.1/servers/99a1b87a-1664-43b4-be05-d2fa7ce8e3ec => generated 1549 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:03:03.344186 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-29cbce39-eace-4974-9185-6f1b84f72656 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:03:03.348803 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-29cbce39-eace-4974-9185-6f1b84f72656 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'dba07c55f73147909e8fe2b56d64791e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051455ee483443618e113df12aa9387a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:03:03.350293 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-29cbce39-eace-4974-9185-6f1b84f72656 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Searching by: {'deleted': False, 'project_id': '051455ee483443618e113df12aa9387a'} {{(pid=122633) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 11 00:03:03.356052 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-29cbce39-eace-4974-9185-6f1b84f72656 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:03:03.356550 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-29cbce39-eace-4974-9185-6f1b84f72656 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:03:03.357008 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-29cbce39-eace-4974-9185-6f1b84f72656 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:03:03.357752 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-29cbce39-eace-4974-9185-6f1b84f72656 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:03:03.358222 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-29cbce39-eace-4974-9185-6f1b84f72656 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:03:03.358671 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-29cbce39-eace-4974-9185-6f1b84f72656 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:03:03.383278 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.multi_cell_list [None req-29cbce39-eace-4974-9185-6f1b84f72656 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122633) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 11 00:03:03.410179 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-29cbce39-eace-4974-9185-6f1b84f72656 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] 10.222.0.58 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.069849 Aug 11 00:03:03.410767 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3581/6954] 10.222.0.58 () {58 vars in 1125 bytes} [Thu Aug 11 00:03:03 2022] GET /compute/v2.1/servers => generated 343 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 00:03:03.422441 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-280e2df7-cde4-44aa-ae1d-775ae77161b7 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:03:03.423087 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-280e2df7-cde4-44aa-ae1d-775ae77161b7 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] [instance: 99a1b87a-1664-43b4-be05-d2fa7ce8e3ec] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:03:03.429298 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-280e2df7-cde4-44aa-ae1d-775ae77161b7 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:03:03.429815 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-280e2df7-cde4-44aa-ae1d-775ae77161b7 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:03:03.430260 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-280e2df7-cde4-44aa-ae1d-775ae77161b7 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:03:03.430996 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-280e2df7-cde4-44aa-ae1d-775ae77161b7 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:03:03.431459 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-280e2df7-cde4-44aa-ae1d-775ae77161b7 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:03:03.431885 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-280e2df7-cde4-44aa-ae1d-775ae77161b7 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:03:03.571101 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-280e2df7-cde4-44aa-ae1d-775ae77161b7 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba07c55f73147909e8fe2b56d64791e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051455ee483443618e113df12aa9387a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:03:03.578646 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-280e2df7-cde4-44aa-ae1d-775ae77161b7 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] 10.222.0.58 "GET /compute/v2.1/servers/99a1b87a-1664-43b4-be05-d2fa7ce8e3ec" status: 200 len: 1549 microversion: 2.1 time: 0.160015 Aug 11 00:03:03.579248 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3374/6955] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:03:03 2022] GET /compute/v2.1/servers/99a1b87a-1664-43b4-be05-d2fa7ce8e3ec => generated 1549 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:03:05.143419 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-48f67adb-ae38-4d50-bc13-4028e1c64a6d tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "595a9a5e-1a47-435d-9524-c152ce062172"}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 00:03:05.145810 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-48f67adb-ae38-4d50-bc13-4028e1c64a6d tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] [instance: 99a1b87a-1664-43b4-be05-d2fa7ce8e3ec] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:03:05.152805 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-48f67adb-ae38-4d50-bc13-4028e1c64a6d tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:03:05.153309 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-48f67adb-ae38-4d50-bc13-4028e1c64a6d tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:03:05.153768 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-48f67adb-ae38-4d50-bc13-4028e1c64a6d tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:03:05.154486 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-48f67adb-ae38-4d50-bc13-4028e1c64a6d tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:03:05.154995 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-48f67adb-ae38-4d50-bc13-4028e1c64a6d tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:03:05.155445 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-48f67adb-ae38-4d50-bc13-4028e1c64a6d tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:03:05.392878 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-48f67adb-ae38-4d50-bc13-4028e1c64a6d tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] 10.222.0.58 "POST /compute/v2.1/servers/99a1b87a-1664-43b4-be05-d2fa7ce8e3ec/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.253191 Aug 11 00:03:05.393542 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3582/6956] 10.222.0.58 () {60 vars in 1323 bytes} [Thu Aug 11 00:03:05 2022] POST /compute/v2.1/servers/99a1b87a-1664-43b4-be05-d2fa7ce8e3ec/os-volume_attachments => generated 194 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 00:03:18.469222 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-41c3eb57-62d3-48e6-88df-59f372c55ad6 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:03:18.469856 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-41c3eb57-62d3-48e6-88df-59f372c55ad6 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] [instance: 99a1b87a-1664-43b4-be05-d2fa7ce8e3ec] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:03:18.472798 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:03:18.473469 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=58 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:03:18.480814 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-41c3eb57-62d3-48e6-88df-59f372c55ad6 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:03:18.481306 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-41c3eb57-62d3-48e6-88df-59f372c55ad6 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:03:18.481749 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-41c3eb57-62d3-48e6-88df-59f372c55ad6 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:03:18.482456 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-41c3eb57-62d3-48e6-88df-59f372c55ad6 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:03:18.482944 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-41c3eb57-62d3-48e6-88df-59f372c55ad6 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:03:18.483378 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-41c3eb57-62d3-48e6-88df-59f372c55ad6 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:03:18.621182 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-41c3eb57-62d3-48e6-88df-59f372c55ad6 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba07c55f73147909e8fe2b56d64791e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051455ee483443618e113df12aa9387a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:03:18.629623 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-41c3eb57-62d3-48e6-88df-59f372c55ad6 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] 10.222.0.58 "GET /compute/v2.1/servers/99a1b87a-1664-43b4-be05-d2fa7ce8e3ec" status: 200 len: 1595 microversion: 2.1 time: 0.164375 Aug 11 00:03:18.630206 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3375/6957] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:03:18 2022] GET /compute/v2.1/servers/99a1b87a-1664-43b4-be05-d2fa7ce8e3ec => generated 1595 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:03:20.667669 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=2 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:03:20.668456 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=1 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:03:20.669128 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:03:20.673234 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-3257a8c2-0645-4f73-8829-764755687198 req-d5ac8941-8097-4057-a73d-8b2e5cbe1154 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99a1b87a-1664-43b4-be05-d2fa7ce8e3ec", "tag": "b4124988-9fd1-4b35-8657-69aea463b181"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 00:03:20.690500 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-3257a8c2-0645-4f73-8829-764755687198 req-d5ac8941-8097-4057-a73d-8b2e5cbe1154 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:03:20.691007 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-3257a8c2-0645-4f73-8829-764755687198 req-d5ac8941-8097-4057-a73d-8b2e5cbe1154 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:03:20.691464 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-3257a8c2-0645-4f73-8829-764755687198 req-d5ac8941-8097-4057-a73d-8b2e5cbe1154 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:03:20.705000 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-3257a8c2-0645-4f73-8829-764755687198 req-d5ac8941-8097-4057-a73d-8b2e5cbe1154 service nova] Creating event network-changed:b4124988-9fd1-4b35-8657-69aea463b181 for instance 99a1b87a-1664-43b4-be05-d2fa7ce8e3ec on n-h1-850468-14 Aug 11 00:03:20.710910 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-3257a8c2-0645-4f73-8829-764755687198 req-d5ac8941-8097-4057-a73d-8b2e5cbe1154 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044374 Aug 11 00:03:20.711974 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3583/6958] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 11 00:03:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 00:03:21.776033 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-7d0c4fa1-09be-4fa6-976c-485a56100b20 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-958099942"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 00:03:21.776568 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-7d0c4fa1-09be-4fa6-976c-485a56100b20 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] [instance: 99a1b87a-1664-43b4-be05-d2fa7ce8e3ec] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:03:21.783010 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7d0c4fa1-09be-4fa6-976c-485a56100b20 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:03:21.783499 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7d0c4fa1-09be-4fa6-976c-485a56100b20 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:03:21.783940 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7d0c4fa1-09be-4fa6-976c-485a56100b20 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:03:21.784640 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7d0c4fa1-09be-4fa6-976c-485a56100b20 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:03:21.785095 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7d0c4fa1-09be-4fa6-976c-485a56100b20 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:03:21.785524 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7d0c4fa1-09be-4fa6-976c-485a56100b20 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:03:21.924399 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.network.security_group_api [None req-7d0c4fa1-09be-4fa6-976c-485a56100b20 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Adding security group 59eff977-3bc7-4e2a-8523-c1d9b35195e8 to port b4124988-9fd1-4b35-8657-69aea463b181 Aug 11 00:03:22.244941 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-7d0c4fa1-09be-4fa6-976c-485a56100b20 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] 10.222.0.58 "POST /compute/v2.1/servers/99a1b87a-1664-43b4-be05-d2fa7ce8e3ec/action" status: 202 len: 0 microversion: 2.1 time: 0.473037 Aug 11 00:03:22.245932 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3376/6959] 10.222.0.58 () {60 vars in 1278 bytes} [Thu Aug 11 00:03:21 2022] POST /compute/v2.1/servers/99a1b87a-1664-43b4-be05-d2fa7ce8e3ec/action => generated 0 bytes in 475 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 11 00:03:22.256049 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-76883af8-3237-40fb-96f2-699bb95d21a8 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:03:22.257887 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-76883af8-3237-40fb-96f2-699bb95d21a8 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] [instance: 99a1b87a-1664-43b4-be05-d2fa7ce8e3ec] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:03:22.265454 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-76883af8-3237-40fb-96f2-699bb95d21a8 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:03:22.265969 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-76883af8-3237-40fb-96f2-699bb95d21a8 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:03:22.266946 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-76883af8-3237-40fb-96f2-699bb95d21a8 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:03:22.267893 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-76883af8-3237-40fb-96f2-699bb95d21a8 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:03:22.268393 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-76883af8-3237-40fb-96f2-699bb95d21a8 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:03:22.270027 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-76883af8-3237-40fb-96f2-699bb95d21a8 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:03:22.433034 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-76883af8-3237-40fb-96f2-699bb95d21a8 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba07c55f73147909e8fe2b56d64791e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051455ee483443618e113df12aa9387a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:03:22.446124 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-76883af8-3237-40fb-96f2-699bb95d21a8 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] 10.222.0.58 "GET /compute/v2.1/servers/99a1b87a-1664-43b4-be05-d2fa7ce8e3ec" status: 200 len: 1759 microversion: 2.1 time: 0.195524 Aug 11 00:03:22.446840 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3584/6960] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:03:22 2022] GET /compute/v2.1/servers/99a1b87a-1664-43b4-be05-d2fa7ce8e3ec => generated 1759 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:03:22.727433 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-45d5a87a-6241-429c-9d7f-3bea1e1e5b51 req-23f8c884-c75a-48b3-abad-dcf92f1ca5af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99a1b87a-1664-43b4-be05-d2fa7ce8e3ec", "tag": "b4124988-9fd1-4b35-8657-69aea463b181"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 00:03:22.737270 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-45d5a87a-6241-429c-9d7f-3bea1e1e5b51 req-23f8c884-c75a-48b3-abad-dcf92f1ca5af service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:03:22.737752 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-45d5a87a-6241-429c-9d7f-3bea1e1e5b51 req-23f8c884-c75a-48b3-abad-dcf92f1ca5af service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:03:22.738217 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-45d5a87a-6241-429c-9d7f-3bea1e1e5b51 req-23f8c884-c75a-48b3-abad-dcf92f1ca5af service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:03:22.752090 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-45d5a87a-6241-429c-9d7f-3bea1e1e5b51 req-23f8c884-c75a-48b3-abad-dcf92f1ca5af service nova] Creating event network-changed:b4124988-9fd1-4b35-8657-69aea463b181 for instance 99a1b87a-1664-43b4-be05-d2fa7ce8e3ec on n-h1-850468-14 Aug 11 00:03:22.757842 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-45d5a87a-6241-429c-9d7f-3bea1e1e5b51 req-23f8c884-c75a-48b3-abad-dcf92f1ca5af service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035200 Aug 11 00:03:22.758481 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3377/6961] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 11 00:03:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 00:03:48.603960 n-d-850468-14 devstack@n-api.service[122633]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 11 00:03:48.604476 n-d-850468-14 devstack@n-api.service[122633]: Thu Aug 11 00:03:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 11 00:05:00.620308 n-d-850468-14 devstack@n-api.service[122633]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e2bb3e2a-85f2-4c49-98ff-2d6066099266] AMQP server on 10.222.0.58:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 11 00:05:00.621271 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_api:SELECT=4 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:05:00.622020 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=8 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:05:00.627594 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-b4b21712-175e-47b8-ae30-b7f8dfe95c19 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 00:05:00.629905 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-b4b21712-175e-47b8-ae30-b7f8dfe95c19 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] [instance: 99a1b87a-1664-43b4-be05-d2fa7ce8e3ec] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:05:00.636853 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b4b21712-175e-47b8-ae30-b7f8dfe95c19 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:05:00.637384 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b4b21712-175e-47b8-ae30-b7f8dfe95c19 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:05:00.637833 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b4b21712-175e-47b8-ae30-b7f8dfe95c19 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:05:00.638585 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b4b21712-175e-47b8-ae30-b7f8dfe95c19 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:05:00.639090 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b4b21712-175e-47b8-ae30-b7f8dfe95c19 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:05:00.639531 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b4b21712-175e-47b8-ae30-b7f8dfe95c19 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:05:00.716877 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-b4b21712-175e-47b8-ae30-b7f8dfe95c19 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] 10.222.0.58 "POST /compute/v2.1/servers/99a1b87a-1664-43b4-be05-d2fa7ce8e3ec/action" status: 202 len: 0 microversion: 2.1 time: 0.097553 Aug 11 00:05:00.717740 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3585/6962] 10.222.0.58 () {60 vars in 1278 bytes} [Thu Aug 11 00:05:00 2022] POST /compute/v2.1/servers/99a1b87a-1664-43b4-be05-d2fa7ce8e3ec/action => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 11 00:05:00.725009 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_api:SELECT=6 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:05:00.726131 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=12 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:05:00.730331 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-404b1a7f-c38b-4b32-962c-4ea3a47bfb42 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:05:00.731049 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-404b1a7f-c38b-4b32-962c-4ea3a47bfb42 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] [instance: 99a1b87a-1664-43b4-be05-d2fa7ce8e3ec] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:05:00.739053 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-404b1a7f-c38b-4b32-962c-4ea3a47bfb42 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:05:00.739530 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-404b1a7f-c38b-4b32-962c-4ea3a47bfb42 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:05:00.739969 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-404b1a7f-c38b-4b32-962c-4ea3a47bfb42 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:05:00.740677 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-404b1a7f-c38b-4b32-962c-4ea3a47bfb42 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:05:00.741135 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-404b1a7f-c38b-4b32-962c-4ea3a47bfb42 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:05:00.741564 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-404b1a7f-c38b-4b32-962c-4ea3a47bfb42 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:05:01.117743 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-404b1a7f-c38b-4b32-962c-4ea3a47bfb42 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba07c55f73147909e8fe2b56d64791e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051455ee483443618e113df12aa9387a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:05:01.126022 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-404b1a7f-c38b-4b32-962c-4ea3a47bfb42 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] 10.222.0.58 "GET /compute/v2.1/servers/99a1b87a-1664-43b4-be05-d2fa7ce8e3ec" status: 200 len: 1761 microversion: 2.1 time: 0.403722 Aug 11 00:05:01.126885 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3378/6963] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:05:00 2022] GET /compute/v2.1/servers/99a1b87a-1664-43b4-be05-d2fa7ce8e3ec => generated 1761 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:05:02.151051 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-1dc3d75d-9668-4190-97af-5d465881500d tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:05:02.151787 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-1dc3d75d-9668-4190-97af-5d465881500d tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] [instance: 99a1b87a-1664-43b4-be05-d2fa7ce8e3ec] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:05:02.160851 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1dc3d75d-9668-4190-97af-5d465881500d tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:05:02.161362 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1dc3d75d-9668-4190-97af-5d465881500d tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:05:02.161819 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1dc3d75d-9668-4190-97af-5d465881500d tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:05:02.162545 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1dc3d75d-9668-4190-97af-5d465881500d tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:05:02.163046 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1dc3d75d-9668-4190-97af-5d465881500d tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:05:02.163497 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1dc3d75d-9668-4190-97af-5d465881500d tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:05:02.169188 n-d-850468-14 devstack@n-api.service[122633]: INFO oslo.messaging._drivers.impl_rabbit [-] [e2bb3e2a-85f2-4c49-98ff-2d6066099266] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 39736. Aug 11 00:05:02.375497 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-1dc3d75d-9668-4190-97af-5d465881500d tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba07c55f73147909e8fe2b56d64791e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051455ee483443618e113df12aa9387a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:05:02.384198 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-1dc3d75d-9668-4190-97af-5d465881500d tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] 10.222.0.58 "GET /compute/v2.1/servers/99a1b87a-1664-43b4-be05-d2fa7ce8e3ec" status: 200 len: 1759 microversion: 2.1 time: 0.239739 Aug 11 00:05:02.384795 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3586/6964] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:05:02 2022] GET /compute/v2.1/servers/99a1b87a-1664-43b4-be05-d2fa7ce8e3ec => generated 1759 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:05:28.609572 n-d-850468-14 devstack@n-api.service[122633]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 11 00:05:28.610149 n-d-850468-14 devstack@n-api.service[122633]: Thu Aug 11 00:05:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 11 00:05:29.299973 n-d-850468-14 devstack@n-api.service[122632]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 11 00:05:29.300600 n-d-850468-14 devstack@n-api.service[122632]: Thu Aug 11 00:05:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 11 00:05:29.406068 n-d-850468-14 devstack@n-api.service[122632]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 11 00:05:29.406247 n-d-850468-14 devstack@n-api.service[122632]: Thu Aug 11 00:05:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 11 00:06:15.267755 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_api:SELECT=2 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:06:15.268526 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=6 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:06:15.273080 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-61fc46e3-8c4a-4e6c-bf3c-e7e950e889a4 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-958099942"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 00:06:15.273618 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-61fc46e3-8c4a-4e6c-bf3c-e7e950e889a4 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] [instance: 99a1b87a-1664-43b4-be05-d2fa7ce8e3ec] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:06:15.280458 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-61fc46e3-8c4a-4e6c-bf3c-e7e950e889a4 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:06:15.280943 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-61fc46e3-8c4a-4e6c-bf3c-e7e950e889a4 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:06:15.281381 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-61fc46e3-8c4a-4e6c-bf3c-e7e950e889a4 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:06:15.282068 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-61fc46e3-8c4a-4e6c-bf3c-e7e950e889a4 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:06:15.282522 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-61fc46e3-8c4a-4e6c-bf3c-e7e950e889a4 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:06:15.283655 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-61fc46e3-8c4a-4e6c-bf3c-e7e950e889a4 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:06:15.417842 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.network.security_group_api [None req-61fc46e3-8c4a-4e6c-bf3c-e7e950e889a4 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Removing security group 59eff977-3bc7-4e2a-8523-c1d9b35195e8 from port b4124988-9fd1-4b35-8657-69aea463b181 Aug 11 00:06:15.756615 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-61fc46e3-8c4a-4e6c-bf3c-e7e950e889a4 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] 10.222.0.58 "POST /compute/v2.1/servers/99a1b87a-1664-43b4-be05-d2fa7ce8e3ec/action" status: 202 len: 0 microversion: 2.1 time: 0.491232 Aug 11 00:06:15.758314 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3379/6965] 10.222.0.58 () {60 vars in 1278 bytes} [Thu Aug 11 00:06:15 2022] POST /compute/v2.1/servers/99a1b87a-1664-43b4-be05-d2fa7ce8e3ec/action => generated 0 bytes in 493 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 11 00:06:15.767083 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_api:SELECT=4 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:06:15.768580 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:06:15.950983 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-87b4a405-3536-43e1-8364-dec3918a044d req-ec759f80-a92e-4619-bec0-beb3113f3290 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99a1b87a-1664-43b4-be05-d2fa7ce8e3ec", "tag": "b4124988-9fd1-4b35-8657-69aea463b181"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 00:06:15.962798 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-87b4a405-3536-43e1-8364-dec3918a044d req-ec759f80-a92e-4619-bec0-beb3113f3290 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:06:15.963413 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-87b4a405-3536-43e1-8364-dec3918a044d req-ec759f80-a92e-4619-bec0-beb3113f3290 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:06:15.966998 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-87b4a405-3536-43e1-8364-dec3918a044d req-ec759f80-a92e-4619-bec0-beb3113f3290 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:06:15.985120 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-87b4a405-3536-43e1-8364-dec3918a044d req-ec759f80-a92e-4619-bec0-beb3113f3290 service nova] Creating event network-changed:b4124988-9fd1-4b35-8657-69aea463b181 for instance 99a1b87a-1664-43b4-be05-d2fa7ce8e3ec on n-h1-850468-14 Aug 11 00:06:15.995922 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-87b4a405-3536-43e1-8364-dec3918a044d req-ec759f80-a92e-4619-bec0-beb3113f3290 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.230900 Aug 11 00:06:15.997419 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3587/6966] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 11 00:06:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 00:06:17.615208 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-697f9b9c-4759-4f3e-a561-edf5814aca41 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:06:17.615760 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-697f9b9c-4759-4f3e-a561-edf5814aca41 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] [instance: 99a1b87a-1664-43b4-be05-d2fa7ce8e3ec] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:06:17.622479 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-697f9b9c-4759-4f3e-a561-edf5814aca41 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:06:17.623017 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-697f9b9c-4759-4f3e-a561-edf5814aca41 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:06:17.623593 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-697f9b9c-4759-4f3e-a561-edf5814aca41 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:06:17.624309 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-697f9b9c-4759-4f3e-a561-edf5814aca41 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:06:17.624761 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-697f9b9c-4759-4f3e-a561-edf5814aca41 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:06:17.625193 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-697f9b9c-4759-4f3e-a561-edf5814aca41 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:06:17.714466 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.objects.instance [None req-697f9b9c-4759-4f3e-a561-edf5814aca41 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lazy-loading 'services' on Instance uuid 99a1b87a-1664-43b4-be05-d2fa7ce8e3ec {{(pid=122632) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 11 00:06:17.788357 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-697f9b9c-4759-4f3e-a561-edf5814aca41 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] 10.222.0.58 "DELETE /compute/v2.1/servers/99a1b87a-1664-43b4-be05-d2fa7ce8e3ec/os-volume_attachments/595a9a5e-1a47-435d-9524-c152ce062172" status: 202 len: 0 microversion: 2.1 time: 0.177977 Aug 11 00:06:17.789088 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3380/6967] 10.222.0.58 () {58 vars in 1416 bytes} [Thu Aug 11 00:06:17 2022] DELETE /compute/v2.1/servers/99a1b87a-1664-43b4-be05-d2fa7ce8e3ec/os-volume_attachments/595a9a5e-1a47-435d-9524-c152ce062172 => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 11 00:06:17.798825 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-80e8df53-e5b4-4f05-af5b-5b2c636e07de tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:06:17.801862 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-80e8df53-e5b4-4f05-af5b-5b2c636e07de tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] [instance: 99a1b87a-1664-43b4-be05-d2fa7ce8e3ec] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:06:17.811659 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-80e8df53-e5b4-4f05-af5b-5b2c636e07de tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:06:17.822106 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-80e8df53-e5b4-4f05-af5b-5b2c636e07de tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:06:17.822773 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-80e8df53-e5b4-4f05-af5b-5b2c636e07de tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:06:17.823603 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-80e8df53-e5b4-4f05-af5b-5b2c636e07de tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:06:17.824889 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-80e8df53-e5b4-4f05-af5b-5b2c636e07de tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:06:17.825351 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-80e8df53-e5b4-4f05-af5b-5b2c636e07de tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:06:17.858476 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-80e8df53-e5b4-4f05-af5b-5b2c636e07de tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] 10.222.0.58 "GET /compute/v2.1/servers/99a1b87a-1664-43b4-be05-d2fa7ce8e3ec/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064190 Aug 11 00:06:17.859319 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3588/6968] 10.222.0.58 () {58 vars in 1302 bytes} [Thu Aug 11 00:06:17 2022] GET /compute/v2.1/servers/99a1b87a-1664-43b4-be05-d2fa7ce8e3ec/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 00:06:18.022959 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-783f296a-ba2f-4be3-a411-24e3506639b2 req-5825db71-b88d-4e95-a166-c659f969d1fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99a1b87a-1664-43b4-be05-d2fa7ce8e3ec", "tag": "b4124988-9fd1-4b35-8657-69aea463b181"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 00:06:18.033001 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-783f296a-ba2f-4be3-a411-24e3506639b2 req-5825db71-b88d-4e95-a166-c659f969d1fd service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:06:18.033489 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-783f296a-ba2f-4be3-a411-24e3506639b2 req-5825db71-b88d-4e95-a166-c659f969d1fd service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:06:18.033929 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-783f296a-ba2f-4be3-a411-24e3506639b2 req-5825db71-b88d-4e95-a166-c659f969d1fd service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:06:18.045239 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-783f296a-ba2f-4be3-a411-24e3506639b2 req-5825db71-b88d-4e95-a166-c659f969d1fd service nova] Creating event network-changed:b4124988-9fd1-4b35-8657-69aea463b181 for instance 99a1b87a-1664-43b4-be05-d2fa7ce8e3ec on n-h1-850468-14 Aug 11 00:06:18.050159 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-783f296a-ba2f-4be3-a411-24e3506639b2 req-5825db71-b88d-4e95-a166-c659f969d1fd service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032068 Aug 11 00:06:18.050761 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3381/6969] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 11 00:06:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 00:06:18.871111 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-f303e5d2-a619-4752-8c36-b6e30f04418d tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:06:18.873449 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-f303e5d2-a619-4752-8c36-b6e30f04418d tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] [instance: 99a1b87a-1664-43b4-be05-d2fa7ce8e3ec] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:06:18.881837 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f303e5d2-a619-4752-8c36-b6e30f04418d tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:06:18.882344 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f303e5d2-a619-4752-8c36-b6e30f04418d tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:06:18.882875 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f303e5d2-a619-4752-8c36-b6e30f04418d tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:06:18.883535 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f303e5d2-a619-4752-8c36-b6e30f04418d tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:06:18.884004 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f303e5d2-a619-4752-8c36-b6e30f04418d tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:06:18.884446 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f303e5d2-a619-4752-8c36-b6e30f04418d tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:06:18.915103 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-f303e5d2-a619-4752-8c36-b6e30f04418d tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] 10.222.0.58 "GET /compute/v2.1/servers/99a1b87a-1664-43b4-be05-d2fa7ce8e3ec/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047979 Aug 11 00:06:18.915677 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3589/6970] 10.222.0.58 () {58 vars in 1302 bytes} [Thu Aug 11 00:06:18 2022] GET /compute/v2.1/servers/99a1b87a-1664-43b4-be05-d2fa7ce8e3ec/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 00:06:19.929252 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-e9ce7eb8-638d-4bd4-94c8-487de738b582 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:06:19.931812 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-e9ce7eb8-638d-4bd4-94c8-487de738b582 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] [instance: 99a1b87a-1664-43b4-be05-d2fa7ce8e3ec] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:06:19.938019 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e9ce7eb8-638d-4bd4-94c8-487de738b582 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:06:19.938494 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e9ce7eb8-638d-4bd4-94c8-487de738b582 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:06:19.938965 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e9ce7eb8-638d-4bd4-94c8-487de738b582 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:06:19.940051 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e9ce7eb8-638d-4bd4-94c8-487de738b582 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:06:19.940512 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e9ce7eb8-638d-4bd4-94c8-487de738b582 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:06:19.940965 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e9ce7eb8-638d-4bd4-94c8-487de738b582 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:06:19.977084 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-e9ce7eb8-638d-4bd4-94c8-487de738b582 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] 10.222.0.58 "GET /compute/v2.1/servers/99a1b87a-1664-43b4-be05-d2fa7ce8e3ec/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053257 Aug 11 00:06:19.977676 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3382/6971] 10.222.0.58 () {58 vars in 1302 bytes} [Thu Aug 11 00:06:19 2022] GET /compute/v2.1/servers/99a1b87a-1664-43b4-be05-d2fa7ce8e3ec/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 00:06:20.993298 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-4b2cd658-89db-4c08-adb8-9ca699ad8600 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:06:20.996391 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-4b2cd658-89db-4c08-adb8-9ca699ad8600 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] [instance: 99a1b87a-1664-43b4-be05-d2fa7ce8e3ec] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:06:21.004423 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4b2cd658-89db-4c08-adb8-9ca699ad8600 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:06:21.005386 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4b2cd658-89db-4c08-adb8-9ca699ad8600 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:06:21.006072 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4b2cd658-89db-4c08-adb8-9ca699ad8600 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:06:21.006924 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4b2cd658-89db-4c08-adb8-9ca699ad8600 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:06:21.007491 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4b2cd658-89db-4c08-adb8-9ca699ad8600 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:06:21.008026 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4b2cd658-89db-4c08-adb8-9ca699ad8600 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:06:21.041404 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-4b2cd658-89db-4c08-adb8-9ca699ad8600 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] 10.222.0.58 "GET /compute/v2.1/servers/99a1b87a-1664-43b4-be05-d2fa7ce8e3ec/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055229 Aug 11 00:06:21.042275 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3590/6972] 10.222.0.58 () {58 vars in 1302 bytes} [Thu Aug 11 00:06:20 2022] GET /compute/v2.1/servers/99a1b87a-1664-43b4-be05-d2fa7ce8e3ec/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 00:06:22.054439 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-0b723f42-663b-4d8f-8e44-4a51cd9a30d0 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:06:22.056732 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-0b723f42-663b-4d8f-8e44-4a51cd9a30d0 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] [instance: 99a1b87a-1664-43b4-be05-d2fa7ce8e3ec] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:06:22.063825 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0b723f42-663b-4d8f-8e44-4a51cd9a30d0 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:06:22.064915 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0b723f42-663b-4d8f-8e44-4a51cd9a30d0 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:06:22.065364 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0b723f42-663b-4d8f-8e44-4a51cd9a30d0 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:06:22.066076 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0b723f42-663b-4d8f-8e44-4a51cd9a30d0 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:06:22.066536 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0b723f42-663b-4d8f-8e44-4a51cd9a30d0 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:06:22.067002 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0b723f42-663b-4d8f-8e44-4a51cd9a30d0 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:06:22.096829 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-0b723f42-663b-4d8f-8e44-4a51cd9a30d0 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] 10.222.0.58 "GET /compute/v2.1/servers/99a1b87a-1664-43b4-be05-d2fa7ce8e3ec/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046470 Aug 11 00:06:22.097409 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3383/6973] 10.222.0.58 () {58 vars in 1302 bytes} [Thu Aug 11 00:06:22 2022] GET /compute/v2.1/servers/99a1b87a-1664-43b4-be05-d2fa7ce8e3ec/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 00:06:23.109158 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-d01fbea1-6f17-4f96-be18-dff220e3ceeb tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:06:23.112006 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-d01fbea1-6f17-4f96-be18-dff220e3ceeb tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] [instance: 99a1b87a-1664-43b4-be05-d2fa7ce8e3ec] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:06:23.119140 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d01fbea1-6f17-4f96-be18-dff220e3ceeb tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:06:23.119650 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d01fbea1-6f17-4f96-be18-dff220e3ceeb tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:06:23.120113 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d01fbea1-6f17-4f96-be18-dff220e3ceeb tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:06:23.120869 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d01fbea1-6f17-4f96-be18-dff220e3ceeb tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:06:23.121344 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d01fbea1-6f17-4f96-be18-dff220e3ceeb tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:06:23.121790 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d01fbea1-6f17-4f96-be18-dff220e3ceeb tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:06:23.151665 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-d01fbea1-6f17-4f96-be18-dff220e3ceeb tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] 10.222.0.58 "GET /compute/v2.1/servers/99a1b87a-1664-43b4-be05-d2fa7ce8e3ec/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046501 Aug 11 00:06:23.152262 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3591/6974] 10.222.0.58 () {58 vars in 1302 bytes} [Thu Aug 11 00:06:23 2022] GET /compute/v2.1/servers/99a1b87a-1664-43b4-be05-d2fa7ce8e3ec/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 11 00:06:23.163550 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-8a2a7f8b-66c3-4070-9b89-5b51b6f66b03 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:06:23.164062 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-8a2a7f8b-66c3-4070-9b89-5b51b6f66b03 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] [instance: 99a1b87a-1664-43b4-be05-d2fa7ce8e3ec] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:06:23.170994 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8a2a7f8b-66c3-4070-9b89-5b51b6f66b03 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:06:23.171478 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8a2a7f8b-66c3-4070-9b89-5b51b6f66b03 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:06:23.171917 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8a2a7f8b-66c3-4070-9b89-5b51b6f66b03 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:06:23.172613 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8a2a7f8b-66c3-4070-9b89-5b51b6f66b03 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:06:23.173064 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8a2a7f8b-66c3-4070-9b89-5b51b6f66b03 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:06:23.174221 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8a2a7f8b-66c3-4070-9b89-5b51b6f66b03 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:06:23.254168 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-8a2a7f8b-66c3-4070-9b89-5b51b6f66b03 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] HTTP exception thrown: Instance 99a1b87a-1664-43b4-be05-d2fa7ce8e3ec is not attached to volume 595a9a5e-1a47-435d-9524-c152ce062172 Aug 11 00:06:23.255853 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-8a2a7f8b-66c3-4070-9b89-5b51b6f66b03 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Request method failure captured: Aug 11 00:06:23.255853 n-d-850468-14 devstack@n-api.service[122632]: request: DELETE /compute/v2.1/servers/99a1b87a-1664-43b4-be05-d2fa7ce8e3ec/os-volume_attachments/595a9a5e-1a47-435d-9524-c152ce062172 HTTP/1.1 Aug 11 00:06:23.255853 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 11 00:06:23.255853 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 11 00:06:23.255853 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 11 00:06:23.255853 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 11 00:06:23.255853 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 11 00:06:23.255853 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 11 00:06:23.255853 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 11 00:06:23.255853 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 11 00:06:23.255853 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9EcWVqWoT3qxArkqZsE2UepIFLOgupcCKOe9-fvQUyzhecvkT1SzmfBOo00EHKyCHOfVvj-OAHdleCVvZsfq-Fcz6jBFwpX5FNf6SSh6PLdwY9J8G3N-fNbER2J4CUFR2Hj1cHja5h3oETDA8G74KkeeowLpNVFrBRI27EmtPRpcaDI Aug 11 00:06:23.255853 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 11 00:06:23.255853 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 11 00:06:23.255853 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 11 00:06:23.255853 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 11 00:06:23.255853 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 11 00:06:23.255853 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 11 00:06:23.255853 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 051455ee483443618e113df12aa9387a Aug 11 00:06:23.255853 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-TestMinimumBasicScenario-1967007737 Aug 11 00:06:23.255853 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 11 00:06:23.255853 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 11 00:06:23.255853 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/051455ee483443618e113df12aa9387a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/051455ee483443618e113df12aa9387a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/051455ee483443618e113df12aa9387a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_051455ee483443618e113df12aa9387a", "adminURL": "http://10.222.0.58:8080"}]}] Aug 11 00:06:23.255853 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-TestMinimumBasicScenario-1967007737 Aug 11 00:06:23.255853 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 051455ee483443618e113df12aa9387a Aug 11 00:06:23.255853 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1967007737 Aug 11 00:06:23.255853 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-TestMinimumBasicScenario-1967007737-project Aug 11 00:06:23.255853 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 11 00:06:23.255853 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 11 00:06:23.255853 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: dba07c55f73147909e8fe2b56d64791e Aug 11 00:06:23.255853 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-TestMinimumBasicScenario-1967007737-project Aug 11 00:06:23.255853 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 11 00:06:23.255853 n-d-850468-14 devstack@n-api.service[122632]: exception: Instance 99a1b87a-1664-43b4-be05-d2fa7ce8e3ec is not attached to volume 595a9a5e-1a47-435d-9524-c152ce062172 Aug 11 00:06:23.255853 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'server_id': '99a1b87a-1664-43b4-be05-d2fa7ce8e3ec', 'id': '595a9a5e-1a47-435d-9524-c152ce062172'} Aug 11 00:06:23.255853 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 00:06:23.255853 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 00:06:23.255853 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 11 00:06:23.255853 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 11 00:06:23.255853 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 11 00:06:23.255853 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 11 00:06:23.255853 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Aug 11 00:06:23.255853 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 11 00:06:23.255853 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 595a9a5e-1a47-435d-9524-c152ce062172. Aug 11 00:06:23.255853 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 11 00:06:23.255853 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 00:06:23.255853 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 11 00:06:23.255853 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 00:06:23.255853 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 00:06:23.255853 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 00:06:23.255853 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 00:06:23.255853 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 00:06:23.255853 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 00:06:23.255853 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 00:06:23.255853 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 11 00:06:23.255853 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 11 00:06:23.255853 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99a1b87a-1664-43b4-be05-d2fa7ce8e3ec is not attached to volume 595a9a5e-1a47-435d-9524-c152ce062172 Aug 11 00:06:23.255853 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 11 00:06:23.255853 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 00:06:23.255853 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 11 00:06:23.255853 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 00:06:23.255853 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 00:06:23.255853 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 00:06:23.259872 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 00:06:23.259872 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 00:06:23.259872 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99a1b87a-1664-43b4-be05-d2fa7ce8e3ec is not attached to volume 595a9a5e-1a47-435d-9524-c152ce062172 Aug 11 00:06:23.259872 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 11 00:06:23.259872 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-8a2a7f8b-66c3-4070-9b89-5b51b6f66b03 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Returning 404 to user: Instance 99a1b87a-1664-43b4-be05-d2fa7ce8e3ec is not attached to volume 595a9a5e-1a47-435d-9524-c152ce062172 {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 00:06:23.259872 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-8a2a7f8b-66c3-4070-9b89-5b51b6f66b03 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] 10.222.0.58 "DELETE /compute/v2.1/servers/99a1b87a-1664-43b4-be05-d2fa7ce8e3ec/os-volume_attachments/595a9a5e-1a47-435d-9524-c152ce062172" status: 404 len: 154 microversion: 2.1 time: 0.098153 Aug 11 00:06:23.259872 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3384/6975] 10.222.0.58 () {58 vars in 1416 bytes} [Thu Aug 11 00:06:23 2022] DELETE /compute/v2.1/servers/99a1b87a-1664-43b4-be05-d2fa7ce8e3ec/os-volume_attachments/595a9a5e-1a47-435d-9524-c152ce062172 => generated 154 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 11 00:06:26.514988 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-a3966e31-b7f6-43dc-b57f-f324f52d4eb1 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:06:26.515521 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-a3966e31-b7f6-43dc-b57f-f324f52d4eb1 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] [instance: 99a1b87a-1664-43b4-be05-d2fa7ce8e3ec] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:06:26.523087 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a3966e31-b7f6-43dc-b57f-f324f52d4eb1 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:06:26.523596 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a3966e31-b7f6-43dc-b57f-f324f52d4eb1 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:06:26.524054 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a3966e31-b7f6-43dc-b57f-f324f52d4eb1 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:06:26.524790 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a3966e31-b7f6-43dc-b57f-f324f52d4eb1 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:06:26.525262 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a3966e31-b7f6-43dc-b57f-f324f52d4eb1 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:06:26.525711 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a3966e31-b7f6-43dc-b57f-f324f52d4eb1 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:06:26.554890 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-a3966e31-b7f6-43dc-b57f-f324f52d4eb1 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] [instance: 99a1b87a-1664-43b4-be05-d2fa7ce8e3ec] Going to try to terminate instance {{(pid=122633) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 11 00:06:26.634239 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-a3966e31-b7f6-43dc-b57f-f324f52d4eb1 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] 10.222.0.58 "DELETE /compute/v2.1/servers/99a1b87a-1664-43b4-be05-d2fa7ce8e3ec" status: 204 len: 0 microversion: 2.1 time: 0.122762 Aug 11 00:06:26.635128 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3592/6976] 10.222.0.58 () {58 vars in 1239 bytes} [Thu Aug 11 00:06:26 2022] DELETE /compute/v2.1/servers/99a1b87a-1664-43b4-be05-d2fa7ce8e3ec => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 11 00:06:26.643909 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-0f1a55f4-5db0-42fe-8223-911c1ee0e703 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:06:26.644519 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-0f1a55f4-5db0-42fe-8223-911c1ee0e703 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] [instance: 99a1b87a-1664-43b4-be05-d2fa7ce8e3ec] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:06:26.652078 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0f1a55f4-5db0-42fe-8223-911c1ee0e703 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:06:26.652558 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0f1a55f4-5db0-42fe-8223-911c1ee0e703 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:06:26.652997 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0f1a55f4-5db0-42fe-8223-911c1ee0e703 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:06:26.653721 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0f1a55f4-5db0-42fe-8223-911c1ee0e703 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:06:26.654167 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0f1a55f4-5db0-42fe-8223-911c1ee0e703 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:06:26.654588 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0f1a55f4-5db0-42fe-8223-911c1ee0e703 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:06:26.796186 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-0f1a55f4-5db0-42fe-8223-911c1ee0e703 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba07c55f73147909e8fe2b56d64791e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051455ee483443618e113df12aa9387a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:06:26.806116 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-0f1a55f4-5db0-42fe-8223-911c1ee0e703 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] 10.222.0.58 "GET /compute/v2.1/servers/99a1b87a-1664-43b4-be05-d2fa7ce8e3ec" status: 200 len: 1555 microversion: 2.1 time: 0.166707 Aug 11 00:06:26.807641 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3385/6977] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:06:26 2022] GET /compute/v2.1/servers/99a1b87a-1664-43b4-be05-d2fa7ce8e3ec => generated 1555 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:06:27.829398 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-459b5792-bea4-44ad-babd-832b387a7832 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:06:27.831241 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-459b5792-bea4-44ad-babd-832b387a7832 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] [instance: 99a1b87a-1664-43b4-be05-d2fa7ce8e3ec] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:06:27.838064 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-459b5792-bea4-44ad-babd-832b387a7832 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:06:27.838554 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-459b5792-bea4-44ad-babd-832b387a7832 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:06:27.839109 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-459b5792-bea4-44ad-babd-832b387a7832 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:06:27.839825 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-459b5792-bea4-44ad-babd-832b387a7832 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:06:27.840292 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-459b5792-bea4-44ad-babd-832b387a7832 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:06:27.840731 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-459b5792-bea4-44ad-babd-832b387a7832 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:06:27.975996 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-459b5792-bea4-44ad-babd-832b387a7832 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba07c55f73147909e8fe2b56d64791e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051455ee483443618e113df12aa9387a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:06:27.983774 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-459b5792-bea4-44ad-babd-832b387a7832 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] 10.222.0.58 "GET /compute/v2.1/servers/99a1b87a-1664-43b4-be05-d2fa7ce8e3ec" status: 200 len: 1555 microversion: 2.1 time: 0.158707 Aug 11 00:06:27.984342 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3593/6978] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:06:27 2022] GET /compute/v2.1/servers/99a1b87a-1664-43b4-be05-d2fa7ce8e3ec => generated 1555 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:06:28.670110 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-2831f420-242c-4a4b-9629-25aa01f5f187 req-81ce4a35-53c8-4705-b35a-39ba535def94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99a1b87a-1664-43b4-be05-d2fa7ce8e3ec", "name": "network-vif-deleted", "tag": "b4124988-9fd1-4b35-8657-69aea463b181"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 00:06:28.681842 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-2831f420-242c-4a4b-9629-25aa01f5f187 req-81ce4a35-53c8-4705-b35a-39ba535def94 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:06:28.682294 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-2831f420-242c-4a4b-9629-25aa01f5f187 req-81ce4a35-53c8-4705-b35a-39ba535def94 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:06:28.682987 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-2831f420-242c-4a4b-9629-25aa01f5f187 req-81ce4a35-53c8-4705-b35a-39ba535def94 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:06:28.694874 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-2831f420-242c-4a4b-9629-25aa01f5f187 req-81ce4a35-53c8-4705-b35a-39ba535def94 service nova] Creating event network-vif-deleted:b4124988-9fd1-4b35-8657-69aea463b181 for instance 99a1b87a-1664-43b4-be05-d2fa7ce8e3ec on n-h1-850468-14 Aug 11 00:06:28.699933 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-2831f420-242c-4a4b-9629-25aa01f5f187 req-81ce4a35-53c8-4705-b35a-39ba535def94 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033548 Aug 11 00:06:28.700533 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3386/6979] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 11 00:06:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 00:06:29.007090 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-88d27aa4-1a4e-4ce5-87a0-f15c63d03eba tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:06:29.008541 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-88d27aa4-1a4e-4ce5-87a0-f15c63d03eba tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] [instance: 99a1b87a-1664-43b4-be05-d2fa7ce8e3ec] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:06:29.017441 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-88d27aa4-1a4e-4ce5-87a0-f15c63d03eba tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:06:29.018660 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-88d27aa4-1a4e-4ce5-87a0-f15c63d03eba tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:06:29.019249 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-88d27aa4-1a4e-4ce5-87a0-f15c63d03eba tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:06:29.020049 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-88d27aa4-1a4e-4ce5-87a0-f15c63d03eba tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:06:29.020529 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-88d27aa4-1a4e-4ce5-87a0-f15c63d03eba tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:06:29.020967 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-88d27aa4-1a4e-4ce5-87a0-f15c63d03eba tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:06:29.061656 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-88d27aa4-1a4e-4ce5-87a0-f15c63d03eba tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:06:29.062434 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-88d27aa4-1a4e-4ce5-87a0-f15c63d03eba tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:06:29.062893 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-88d27aa4-1a4e-4ce5-87a0-f15c63d03eba tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:06:29.063366 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.objects.instance [None req-88d27aa4-1a4e-4ce5-87a0-f15c63d03eba tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lazy-loading 'fault' on Instance uuid 99a1b87a-1664-43b4-be05-d2fa7ce8e3ec {{(pid=122633) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 11 00:06:29.115036 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-88d27aa4-1a4e-4ce5-87a0-f15c63d03eba tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba07c55f73147909e8fe2b56d64791e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051455ee483443618e113df12aa9387a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:06:29.123624 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-88d27aa4-1a4e-4ce5-87a0-f15c63d03eba tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] 10.222.0.58 "GET /compute/v2.1/servers/99a1b87a-1664-43b4-be05-d2fa7ce8e3ec" status: 200 len: 1348 microversion: 2.1 time: 0.121388 Aug 11 00:06:29.124219 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3594/6980] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:06:29 2022] GET /compute/v2.1/servers/99a1b87a-1664-43b4-be05-d2fa7ce8e3ec => generated 1348 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:06:30.148514 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-edcc114f-b7d4-4509-801f-5586ce7e7139 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:06:30.149134 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-edcc114f-b7d4-4509-801f-5586ce7e7139 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] [instance: 99a1b87a-1664-43b4-be05-d2fa7ce8e3ec] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:06:30.155472 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-edcc114f-b7d4-4509-801f-5586ce7e7139 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:06:30.155958 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-edcc114f-b7d4-4509-801f-5586ce7e7139 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:06:30.156398 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-edcc114f-b7d4-4509-801f-5586ce7e7139 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:06:30.157096 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-edcc114f-b7d4-4509-801f-5586ce7e7139 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:06:30.158081 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-edcc114f-b7d4-4509-801f-5586ce7e7139 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:06:30.158514 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-edcc114f-b7d4-4509-801f-5586ce7e7139 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:06:30.171972 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-edcc114f-b7d4-4509-801f-5586ce7e7139 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] HTTP exception thrown: Instance 99a1b87a-1664-43b4-be05-d2fa7ce8e3ec could not be found. Aug 11 00:06:30.174306 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-edcc114f-b7d4-4509-801f-5586ce7e7139 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Request method failure captured: Aug 11 00:06:30.174306 n-d-850468-14 devstack@n-api.service[122632]: request: GET /compute/v2.1/servers/99a1b87a-1664-43b4-be05-d2fa7ce8e3ec HTTP/1.1 Aug 11 00:06:30.174306 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 11 00:06:30.174306 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 11 00:06:30.174306 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 11 00:06:30.174306 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 11 00:06:30.174306 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 11 00:06:30.174306 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 11 00:06:30.174306 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 11 00:06:30.174306 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 11 00:06:30.174306 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9EcWVqWoT3qxArkqZsE2UepIFLOgupcCKOe9-fvQUyzhecvkT1SzmfBOo00EHKyCHOfVvj-OAHdleCVvZsfq-Fcz6jBFwpX5FNf6SSh6PLdwY9J8G3N-fNbER2J4CUFR2Hj1cHja5h3oETDA8G74KkeeowLpNVFrBRI27EmtPRpcaDI Aug 11 00:06:30.174306 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 11 00:06:30.174306 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 11 00:06:30.174306 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 11 00:06:30.174306 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 11 00:06:30.174306 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 11 00:06:30.174306 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 11 00:06:30.174306 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 051455ee483443618e113df12aa9387a Aug 11 00:06:30.174306 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-TestMinimumBasicScenario-1967007737 Aug 11 00:06:30.174306 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 11 00:06:30.174306 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 11 00:06:30.174306 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/051455ee483443618e113df12aa9387a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/051455ee483443618e113df12aa9387a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/051455ee483443618e113df12aa9387a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_051455ee483443618e113df12aa9387a", "adminURL": "http://10.222.0.58:8080"}]}] Aug 11 00:06:30.174306 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-TestMinimumBasicScenario-1967007737 Aug 11 00:06:30.174306 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 051455ee483443618e113df12aa9387a Aug 11 00:06:30.174306 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1967007737 Aug 11 00:06:30.174306 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-TestMinimumBasicScenario-1967007737-project Aug 11 00:06:30.174306 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 11 00:06:30.174306 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 11 00:06:30.174306 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: dba07c55f73147909e8fe2b56d64791e Aug 11 00:06:30.174306 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-TestMinimumBasicScenario-1967007737-project Aug 11 00:06:30.174306 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 11 00:06:30.174306 n-d-850468-14 devstack@n-api.service[122632]: exception: Instance 99a1b87a-1664-43b4-be05-d2fa7ce8e3ec could not be found. Aug 11 00:06:30.174306 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': '99a1b87a-1664-43b4-be05-d2fa7ce8e3ec'} Aug 11 00:06:30.174306 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 00:06:30.174306 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 00:06:30.174306 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 11 00:06:30.174306 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 11 00:06:30.174306 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 11 00:06:30.174306 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 11 00:06:30.174306 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 11 00:06:30.174306 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 11 00:06:30.174306 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 11 00:06:30.174306 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 11 00:06:30.174306 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99a1b87a-1664-43b4-be05-d2fa7ce8e3ec could not be found. Aug 11 00:06:30.174306 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 11 00:06:30.174306 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 00:06:30.174306 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 11 00:06:30.174306 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 00:06:30.174306 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 00:06:30.174306 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 00:06:30.174306 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 00:06:30.174306 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 00:06:30.174306 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 00:06:30.174306 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 00:06:30.174306 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 11 00:06:30.174306 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 11 00:06:30.174306 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 11 00:06:30.174306 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 11 00:06:30.174306 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 11 00:06:30.174306 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 11 00:06:30.174306 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99a1b87a-1664-43b4-be05-d2fa7ce8e3ec could not be found. Aug 11 00:06:30.174306 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 11 00:06:30.174306 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 00:06:30.174306 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 11 00:06:30.179054 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 00:06:30.179054 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 00:06:30.179054 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 00:06:30.179054 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 00:06:30.179054 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 00:06:30.179054 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99a1b87a-1664-43b4-be05-d2fa7ce8e3ec could not be found. Aug 11 00:06:30.179054 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 11 00:06:30.179054 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-edcc114f-b7d4-4509-801f-5586ce7e7139 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Returning 404 to user: Instance 99a1b87a-1664-43b4-be05-d2fa7ce8e3ec could not be found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 00:06:30.179054 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-edcc114f-b7d4-4509-801f-5586ce7e7139 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] 10.222.0.58 "GET /compute/v2.1/servers/99a1b87a-1664-43b4-be05-d2fa7ce8e3ec" status: 404 len: 111 microversion: 2.1 time: 0.032937 Aug 11 00:06:30.179054 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3387/6981] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:06:30 2022] GET /compute/v2.1/servers/99a1b87a-1664-43b4-be05-d2fa7ce8e3ec => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 11 00:06:30.184631 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-1e03ae4d-1aab-4fff-853f-12543f5517ee tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Calling method '.version_select at 0x7f847cf38310>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:06:30.210669 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-1e03ae4d-1aab-4fff-853f-12543f5517ee tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-617855963" status: 202 len: 0 microversion: 2.1 time: 0.029873 Aug 11 00:06:30.211297 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3595/6982] 10.222.0.58 () {58 vars in 1269 bytes} [Thu Aug 11 00:06:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-617855963 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 11 00:06:39.259395 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-9d546eab-2705-47b3-87b0-0cf43d5d381a tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Action: 'create', calling method: .version_select at 0x7f847d387f70>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1057962522", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEAJxJp8amJHzJ8R0TCdrc5szuZOy+AaOBKy0ALJyhae2I8V4T+rPCl/aG6qmaRCiVn62zppbDC0jlfloVJ2GyAiZfl12achDV04mXZNsvD6Fu6vD7MYELeD79DLjM3tQQ=="}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 00:06:39.275677 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-9d546eab-2705-47b3-87b0-0cf43d5d381a tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Getting quotas for project 051455ee483443618e113df12aa9387a. Resources: {'key_pairs'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 11 00:06:39.281764 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-9d546eab-2705-47b3-87b0-0cf43d5d381a tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Getting quotas for user dba07c55f73147909e8fe2b56d64791e and project 051455ee483443618e113df12aa9387a. Resources: {'key_pairs'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 11 00:06:39.309060 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-9d546eab-2705-47b3-87b0-0cf43d5d381a tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.054069 Aug 11 00:06:39.309664 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3388/6983] 10.222.0.58 () {60 vars in 1159 bytes} [Thu Aug 11 00:06:39 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 00:06:39.359317 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:06:39.364202 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-fa6bda59-9041-4dde-abc6-e52707863c47 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1230734881", "imageRef": "3ff9a2e2-28d3-4ea1-86c1-761c7f87df0a", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1057962522", "networks": [{"uuid": "805c51ba-babd-4e01-ab2f-6df1c73cf27e"}]}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 00:06:39.417763 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.network.neutron [None req-fa6bda59-9041-4dde-abc6-e52707863c47 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] validate_networks() for [('805c51ba-babd-4e01-ab2f-6df1c73cf27e', None, None, None, None, None)] {{(pid=122633) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 11 00:06:39.875736 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-fa6bda59-9041-4dde-abc6-e52707863c47 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Flavor limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 11 00:06:39.876738 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-fa6bda59-9041-4dde-abc6-e52707863c47 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Image limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 11 00:06:39.877245 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-fa6bda59-9041-4dde-abc6-e52707863c47 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Flavor pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 11 00:06:39.877940 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-fa6bda59-9041-4dde-abc6-e52707863c47 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Image pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 11 00:06:39.878365 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-fa6bda59-9041-4dde-abc6-e52707863c47 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 11 00:06:39.887422 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fa6bda59-9041-4dde-abc6-e52707863c47 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:06:39.887926 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fa6bda59-9041-4dde-abc6-e52707863c47 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:06:39.888385 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fa6bda59-9041-4dde-abc6-e52707863c47 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:06:39.889135 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fa6bda59-9041-4dde-abc6-e52707863c47 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:06:39.889611 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fa6bda59-9041-4dde-abc6-e52707863c47 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:06:39.890056 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fa6bda59-9041-4dde-abc6-e52707863c47 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:06:39.907602 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-fa6bda59-9041-4dde-abc6-e52707863c47 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Getting quotas for project 051455ee483443618e113df12aa9387a. Resources: {'instances', 'cores', 'ram'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 11 00:06:39.913158 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-fa6bda59-9041-4dde-abc6-e52707863c47 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Getting quotas for user dba07c55f73147909e8fe2b56d64791e and project 051455ee483443618e113df12aa9387a. Resources: {'instances', 'cores', 'ram'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 11 00:06:39.927315 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-fa6bda59-9041-4dde-abc6-e52707863c47 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Going to run 1 instances... {{(pid=122633) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 11 00:06:39.929608 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-fa6bda59-9041-4dde-abc6-e52707863c47 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] [instance: 44e4df88-af81-4594-9f04-5aad9f9562a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='3ff9a2e2-28d3-4ea1-86c1-761c7f87df0a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122633) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 11 00:06:39.977397 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-fa6bda59-9041-4dde-abc6-e52707863c47 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.619916 Aug 11 00:06:39.978083 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3596/6984] 10.222.0.58 () {60 vars in 1147 bytes} [Thu Aug 11 00:06:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 621 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 11 00:06:39.989298 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-868f341a-4fa0-44f8-892b-8b778a2eb84f tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:06:39.989918 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-868f341a-4fa0-44f8-892b-8b778a2eb84f tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] [instance: 44e4df88-af81-4594-9f04-5aad9f9562a7] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:06:40.044174 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-868f341a-4fa0-44f8-892b-8b778a2eb84f tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba07c55f73147909e8fe2b56d64791e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051455ee483443618e113df12aa9387a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:06:40.051738 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-868f341a-4fa0-44f8-892b-8b778a2eb84f tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] 10.222.0.58 "GET /compute/v2.1/servers/44e4df88-af81-4594-9f04-5aad9f9562a7" status: 200 len: 1259 microversion: 2.1 time: 0.066860 Aug 11 00:06:40.052320 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3389/6985] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:06:39 2022] GET /compute/v2.1/servers/44e4df88-af81-4594-9f04-5aad9f9562a7 => generated 1259 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:06:41.073598 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-6977e5af-8fd6-48b5-add5-ac7318062e1e tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:06:41.074420 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-6977e5af-8fd6-48b5-add5-ac7318062e1e tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] [instance: 44e4df88-af81-4594-9f04-5aad9f9562a7] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:06:41.133350 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-6977e5af-8fd6-48b5-add5-ac7318062e1e tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba07c55f73147909e8fe2b56d64791e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051455ee483443618e113df12aa9387a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:06:41.140110 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-6977e5af-8fd6-48b5-add5-ac7318062e1e tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] 10.222.0.58 "GET /compute/v2.1/servers/44e4df88-af81-4594-9f04-5aad9f9562a7" status: 200 len: 1259 microversion: 2.1 time: 0.070477 Aug 11 00:06:41.140692 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3597/6986] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:06:41 2022] GET /compute/v2.1/servers/44e4df88-af81-4594-9f04-5aad9f9562a7 => generated 1259 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:06:42.162908 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-7b220bc4-3315-4c1a-9d34-537f2aa4da05 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:06:42.163527 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-7b220bc4-3315-4c1a-9d34-537f2aa4da05 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] [instance: 44e4df88-af81-4594-9f04-5aad9f9562a7] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:06:42.165539 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=43,nova_cell1:INSERT=1 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:06:42.220571 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-7b220bc4-3315-4c1a-9d34-537f2aa4da05 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba07c55f73147909e8fe2b56d64791e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051455ee483443618e113df12aa9387a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:06:42.227618 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-7b220bc4-3315-4c1a-9d34-537f2aa4da05 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] 10.222.0.58 "GET /compute/v2.1/servers/44e4df88-af81-4594-9f04-5aad9f9562a7" status: 200 len: 1259 microversion: 2.1 time: 0.070082 Aug 11 00:06:42.228259 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3390/6987] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:06:42 2022] GET /compute/v2.1/servers/44e4df88-af81-4594-9f04-5aad9f9562a7 => generated 1259 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:06:43.248727 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-944e966e-18fd-44d0-a14d-e8f78a8a61bd tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:06:43.249385 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-944e966e-18fd-44d0-a14d-e8f78a8a61bd tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] [instance: 44e4df88-af81-4594-9f04-5aad9f9562a7] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:06:43.307049 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-944e966e-18fd-44d0-a14d-e8f78a8a61bd tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba07c55f73147909e8fe2b56d64791e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051455ee483443618e113df12aa9387a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:06:43.314829 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-944e966e-18fd-44d0-a14d-e8f78a8a61bd tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] 10.222.0.58 "GET /compute/v2.1/servers/44e4df88-af81-4594-9f04-5aad9f9562a7" status: 200 len: 1259 microversion: 2.1 time: 0.069315 Aug 11 00:06:43.315507 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3598/6988] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:06:43 2022] GET /compute/v2.1/servers/44e4df88-af81-4594-9f04-5aad9f9562a7 => generated 1259 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:06:44.341409 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-e80893c1-5092-4873-821c-d9b4f13bf2d0 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:06:44.342058 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-e80893c1-5092-4873-821c-d9b4f13bf2d0 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] [instance: 44e4df88-af81-4594-9f04-5aad9f9562a7] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:06:44.349047 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e80893c1-5092-4873-821c-d9b4f13bf2d0 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:06:44.349532 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e80893c1-5092-4873-821c-d9b4f13bf2d0 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:06:44.349971 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e80893c1-5092-4873-821c-d9b4f13bf2d0 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:06:44.350670 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e80893c1-5092-4873-821c-d9b4f13bf2d0 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:06:44.351156 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e80893c1-5092-4873-821c-d9b4f13bf2d0 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:06:44.351580 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e80893c1-5092-4873-821c-d9b4f13bf2d0 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:06:44.418988 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-e80893c1-5092-4873-821c-d9b4f13bf2d0 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba07c55f73147909e8fe2b56d64791e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051455ee483443618e113df12aa9387a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:06:44.427100 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-e80893c1-5092-4873-821c-d9b4f13bf2d0 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] 10.222.0.58 "GET /compute/v2.1/servers/44e4df88-af81-4594-9f04-5aad9f9562a7" status: 200 len: 1263 microversion: 2.1 time: 0.089613 Aug 11 00:06:44.427694 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3391/6989] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:06:44 2022] GET /compute/v2.1/servers/44e4df88-af81-4594-9f04-5aad9f9562a7 => generated 1263 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:06:45.449629 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-3dad8923-6503-4563-b59e-ea747c579978 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:06:45.450501 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-3dad8923-6503-4563-b59e-ea747c579978 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] [instance: 44e4df88-af81-4594-9f04-5aad9f9562a7] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:06:45.459380 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3dad8923-6503-4563-b59e-ea747c579978 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:06:45.459380 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3dad8923-6503-4563-b59e-ea747c579978 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:06:45.459965 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3dad8923-6503-4563-b59e-ea747c579978 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:06:45.460805 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3dad8923-6503-4563-b59e-ea747c579978 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:06:45.461684 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3dad8923-6503-4563-b59e-ea747c579978 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:06:45.462092 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3dad8923-6503-4563-b59e-ea747c579978 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:06:45.588497 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-3dad8923-6503-4563-b59e-ea747c579978 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba07c55f73147909e8fe2b56d64791e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051455ee483443618e113df12aa9387a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:06:45.605833 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-3dad8923-6503-4563-b59e-ea747c579978 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] 10.222.0.58 "GET /compute/v2.1/servers/44e4df88-af81-4594-9f04-5aad9f9562a7" status: 200 len: 1317 microversion: 2.1 time: 0.160630 Aug 11 00:06:45.609751 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3599/6990] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:06:45 2022] GET /compute/v2.1/servers/44e4df88-af81-4594-9f04-5aad9f9562a7 => generated 1317 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:06:46.646083 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-5138e39e-a2b0-4400-97bc-2a66ff39950e tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:06:46.646687 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-5138e39e-a2b0-4400-97bc-2a66ff39950e tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] [instance: 44e4df88-af81-4594-9f04-5aad9f9562a7] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:06:46.649434 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=1 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:06:46.654602 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5138e39e-a2b0-4400-97bc-2a66ff39950e tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:06:46.655341 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5138e39e-a2b0-4400-97bc-2a66ff39950e tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:06:46.655949 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5138e39e-a2b0-4400-97bc-2a66ff39950e tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:06:46.656805 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5138e39e-a2b0-4400-97bc-2a66ff39950e tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:06:46.657404 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5138e39e-a2b0-4400-97bc-2a66ff39950e tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:06:46.658653 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5138e39e-a2b0-4400-97bc-2a66ff39950e tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:06:46.809282 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-5138e39e-a2b0-4400-97bc-2a66ff39950e tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba07c55f73147909e8fe2b56d64791e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051455ee483443618e113df12aa9387a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:06:46.823069 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-5138e39e-a2b0-4400-97bc-2a66ff39950e tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] 10.222.0.58 "GET /compute/v2.1/servers/44e4df88-af81-4594-9f04-5aad9f9562a7" status: 200 len: 1359 microversion: 2.1 time: 0.181775 Aug 11 00:06:46.827362 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3392/6991] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:06:46 2022] GET /compute/v2.1/servers/44e4df88-af81-4594-9f04-5aad9f9562a7 => generated 1359 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:06:47.850409 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-51db7f3f-b568-4c36-b07c-43dc9e536cad tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:06:47.851177 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-51db7f3f-b568-4c36-b07c-43dc9e536cad tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] [instance: 44e4df88-af81-4594-9f04-5aad9f9562a7] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:06:47.853116 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:06:47.859655 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-51db7f3f-b568-4c36-b07c-43dc9e536cad tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:06:47.860188 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-51db7f3f-b568-4c36-b07c-43dc9e536cad tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:06:47.860647 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-51db7f3f-b568-4c36-b07c-43dc9e536cad tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:06:47.861415 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-51db7f3f-b568-4c36-b07c-43dc9e536cad tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:06:47.862515 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-51db7f3f-b568-4c36-b07c-43dc9e536cad tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:06:47.863300 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-51db7f3f-b568-4c36-b07c-43dc9e536cad tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:06:48.026987 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-51db7f3f-b568-4c36-b07c-43dc9e536cad tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba07c55f73147909e8fe2b56d64791e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051455ee483443618e113df12aa9387a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:06:48.036701 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-51db7f3f-b568-4c36-b07c-43dc9e536cad tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] 10.222.0.58 "GET /compute/v2.1/servers/44e4df88-af81-4594-9f04-5aad9f9562a7" status: 200 len: 1359 microversion: 2.1 time: 0.191062 Aug 11 00:06:48.037409 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3600/6992] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:06:47 2022] GET /compute/v2.1/servers/44e4df88-af81-4594-9f04-5aad9f9562a7 => generated 1359 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:06:49.062012 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c7b4b94e-9834-423a-bec1-9986eb20254d tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:06:49.063269 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-c7b4b94e-9834-423a-bec1-9986eb20254d tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] [instance: 44e4df88-af81-4594-9f04-5aad9f9562a7] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:06:49.070583 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c7b4b94e-9834-423a-bec1-9986eb20254d tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:06:49.071124 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c7b4b94e-9834-423a-bec1-9986eb20254d tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:06:49.071588 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c7b4b94e-9834-423a-bec1-9986eb20254d tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:06:49.072287 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c7b4b94e-9834-423a-bec1-9986eb20254d tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:06:49.072743 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c7b4b94e-9834-423a-bec1-9986eb20254d tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:06:49.073173 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c7b4b94e-9834-423a-bec1-9986eb20254d tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:06:49.229109 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-c7b4b94e-9834-423a-bec1-9986eb20254d tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba07c55f73147909e8fe2b56d64791e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051455ee483443618e113df12aa9387a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:06:49.237434 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-c7b4b94e-9834-423a-bec1-9986eb20254d tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] 10.222.0.58 "GET /compute/v2.1/servers/44e4df88-af81-4594-9f04-5aad9f9562a7" status: 200 len: 1359 microversion: 2.1 time: 0.180218 Aug 11 00:06:49.238274 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3393/6993] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:06:49 2022] GET /compute/v2.1/servers/44e4df88-af81-4594-9f04-5aad9f9562a7 => generated 1359 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:06:50.261448 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-537ee67b-f754-43ad-a074-b3edf1c14458 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:06:50.262145 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-537ee67b-f754-43ad-a074-b3edf1c14458 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] [instance: 44e4df88-af81-4594-9f04-5aad9f9562a7] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:06:50.264977 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=2 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:06:50.271283 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-537ee67b-f754-43ad-a074-b3edf1c14458 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:06:50.271795 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-537ee67b-f754-43ad-a074-b3edf1c14458 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:06:50.272272 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-537ee67b-f754-43ad-a074-b3edf1c14458 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:06:50.273004 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-537ee67b-f754-43ad-a074-b3edf1c14458 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:06:50.273462 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-537ee67b-f754-43ad-a074-b3edf1c14458 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:06:50.274033 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-537ee67b-f754-43ad-a074-b3edf1c14458 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:06:50.420994 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-537ee67b-f754-43ad-a074-b3edf1c14458 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba07c55f73147909e8fe2b56d64791e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051455ee483443618e113df12aa9387a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:06:50.429494 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-537ee67b-f754-43ad-a074-b3edf1c14458 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] 10.222.0.58 "GET /compute/v2.1/servers/44e4df88-af81-4594-9f04-5aad9f9562a7" status: 200 len: 1359 microversion: 2.1 time: 0.171971 Aug 11 00:06:50.430093 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3601/6994] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:06:50 2022] GET /compute/v2.1/servers/44e4df88-af81-4594-9f04-5aad9f9562a7 => generated 1359 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:06:51.452901 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-1907a9dc-1aaf-42b8-880a-bedcbeda9a5e tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:06:51.453581 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-1907a9dc-1aaf-42b8-880a-bedcbeda9a5e tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] [instance: 44e4df88-af81-4594-9f04-5aad9f9562a7] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:06:51.461517 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1907a9dc-1aaf-42b8-880a-bedcbeda9a5e tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:06:51.462007 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1907a9dc-1aaf-42b8-880a-bedcbeda9a5e tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:06:51.462448 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1907a9dc-1aaf-42b8-880a-bedcbeda9a5e tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:06:51.463199 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1907a9dc-1aaf-42b8-880a-bedcbeda9a5e tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:06:51.463661 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1907a9dc-1aaf-42b8-880a-bedcbeda9a5e tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:06:51.464092 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1907a9dc-1aaf-42b8-880a-bedcbeda9a5e tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:06:51.611673 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-1907a9dc-1aaf-42b8-880a-bedcbeda9a5e tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba07c55f73147909e8fe2b56d64791e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051455ee483443618e113df12aa9387a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:06:51.622281 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-1907a9dc-1aaf-42b8-880a-bedcbeda9a5e tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] 10.222.0.58 "GET /compute/v2.1/servers/44e4df88-af81-4594-9f04-5aad9f9562a7" status: 200 len: 1359 microversion: 2.1 time: 0.171180 Aug 11 00:06:51.623145 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3394/6995] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:06:51 2022] GET /compute/v2.1/servers/44e4df88-af81-4594-9f04-5aad9f9562a7 => generated 1359 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:06:52.642569 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-707f7e80-dd39-45e5-b19f-ee1e1f66efb0 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:06:52.643208 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-707f7e80-dd39-45e5-b19f-ee1e1f66efb0 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] [instance: 44e4df88-af81-4594-9f04-5aad9f9562a7] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:06:52.650079 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-707f7e80-dd39-45e5-b19f-ee1e1f66efb0 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:06:52.650585 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-707f7e80-dd39-45e5-b19f-ee1e1f66efb0 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:06:52.651075 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-707f7e80-dd39-45e5-b19f-ee1e1f66efb0 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:06:52.651792 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-707f7e80-dd39-45e5-b19f-ee1e1f66efb0 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:06:52.652267 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-707f7e80-dd39-45e5-b19f-ee1e1f66efb0 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:06:52.652710 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-707f7e80-dd39-45e5-b19f-ee1e1f66efb0 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:06:52.781266 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-707f7e80-dd39-45e5-b19f-ee1e1f66efb0 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba07c55f73147909e8fe2b56d64791e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051455ee483443618e113df12aa9387a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:06:52.789447 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-707f7e80-dd39-45e5-b19f-ee1e1f66efb0 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] 10.222.0.58 "GET /compute/v2.1/servers/44e4df88-af81-4594-9f04-5aad9f9562a7" status: 200 len: 1359 microversion: 2.1 time: 0.151287 Aug 11 00:06:52.790028 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3602/6996] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:06:52 2022] GET /compute/v2.1/servers/44e4df88-af81-4594-9f04-5aad9f9562a7 => generated 1359 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:06:53.619455 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-de74b3cc-5a32-4be2-926d-47da4a90da77 req-83fa0462-d33e-4e9d-ba65-65c945181a2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44e4df88-af81-4594-9f04-5aad9f9562a7", "tag": "24014d0d-750e-4192-b535-eb4f8117471a"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 00:06:53.626379 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=8 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:06:53.633249 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-de74b3cc-5a32-4be2-926d-47da4a90da77 req-83fa0462-d33e-4e9d-ba65-65c945181a2b service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:06:53.633733 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-de74b3cc-5a32-4be2-926d-47da4a90da77 req-83fa0462-d33e-4e9d-ba65-65c945181a2b service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:06:53.634170 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-de74b3cc-5a32-4be2-926d-47da4a90da77 req-83fa0462-d33e-4e9d-ba65-65c945181a2b service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:06:53.645706 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-de74b3cc-5a32-4be2-926d-47da4a90da77 req-83fa0462-d33e-4e9d-ba65-65c945181a2b service nova] Creating event network-changed:24014d0d-750e-4192-b535-eb4f8117471a for instance 44e4df88-af81-4594-9f04-5aad9f9562a7 on n-h2-850468-14 Aug 11 00:06:53.650840 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-de74b3cc-5a32-4be2-926d-47da4a90da77 req-83fa0462-d33e-4e9d-ba65-65c945181a2b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035243 Aug 11 00:06:53.651462 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3395/6997] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 11 00:06:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 00:06:53.809605 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-6914e286-c510-49fb-80ed-1fe8746e2bfa tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:06:53.810256 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-6914e286-c510-49fb-80ed-1fe8746e2bfa tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] [instance: 44e4df88-af81-4594-9f04-5aad9f9562a7] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:06:53.812242 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=10 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:06:53.819146 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6914e286-c510-49fb-80ed-1fe8746e2bfa tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:06:53.819648 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6914e286-c510-49fb-80ed-1fe8746e2bfa tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:06:53.820102 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6914e286-c510-49fb-80ed-1fe8746e2bfa tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:06:53.820818 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6914e286-c510-49fb-80ed-1fe8746e2bfa tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:06:53.821287 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6914e286-c510-49fb-80ed-1fe8746e2bfa tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:06:53.821728 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6914e286-c510-49fb-80ed-1fe8746e2bfa tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:06:53.961693 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-6914e286-c510-49fb-80ed-1fe8746e2bfa tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba07c55f73147909e8fe2b56d64791e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051455ee483443618e113df12aa9387a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:06:53.969437 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-6914e286-c510-49fb-80ed-1fe8746e2bfa tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] 10.222.0.58 "GET /compute/v2.1/servers/44e4df88-af81-4594-9f04-5aad9f9562a7" status: 200 len: 1359 microversion: 2.1 time: 0.163834 Aug 11 00:06:53.970014 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3603/6998] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:06:53 2022] GET /compute/v2.1/servers/44e4df88-af81-4594-9f04-5aad9f9562a7 => generated 1359 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:06:54.997786 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-e07ffc95-260a-4eb9-84af-8387a575e698 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:06:54.998493 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-e07ffc95-260a-4eb9-84af-8387a575e698 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] [instance: 44e4df88-af81-4594-9f04-5aad9f9562a7] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:06:55.005124 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e07ffc95-260a-4eb9-84af-8387a575e698 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:06:55.005610 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e07ffc95-260a-4eb9-84af-8387a575e698 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:06:55.006055 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e07ffc95-260a-4eb9-84af-8387a575e698 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:06:55.006764 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e07ffc95-260a-4eb9-84af-8387a575e698 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:06:55.007239 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e07ffc95-260a-4eb9-84af-8387a575e698 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:06:55.007666 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e07ffc95-260a-4eb9-84af-8387a575e698 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:06:55.221397 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-e07ffc95-260a-4eb9-84af-8387a575e698 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba07c55f73147909e8fe2b56d64791e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051455ee483443618e113df12aa9387a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:06:55.229075 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-e07ffc95-260a-4eb9-84af-8387a575e698 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] 10.222.0.58 "GET /compute/v2.1/servers/44e4df88-af81-4594-9f04-5aad9f9562a7" status: 200 len: 1359 microversion: 2.1 time: 0.236508 Aug 11 00:06:55.229653 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3396/6999] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:06:54 2022] GET /compute/v2.1/servers/44e4df88-af81-4594-9f04-5aad9f9562a7 => generated 1359 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:06:56.250254 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-ad1e3785-d1de-4e36-bc17-e0912a70a188 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:06:56.250812 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-ad1e3785-d1de-4e36-bc17-e0912a70a188 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] [instance: 44e4df88-af81-4594-9f04-5aad9f9562a7] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:06:56.258550 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ad1e3785-d1de-4e36-bc17-e0912a70a188 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:06:56.259080 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ad1e3785-d1de-4e36-bc17-e0912a70a188 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:06:56.259535 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ad1e3785-d1de-4e36-bc17-e0912a70a188 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:06:56.260272 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ad1e3785-d1de-4e36-bc17-e0912a70a188 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:06:56.260741 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ad1e3785-d1de-4e36-bc17-e0912a70a188 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:06:56.261179 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ad1e3785-d1de-4e36-bc17-e0912a70a188 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:06:56.427987 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-ad1e3785-d1de-4e36-bc17-e0912a70a188 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba07c55f73147909e8fe2b56d64791e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051455ee483443618e113df12aa9387a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:06:56.435802 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-ad1e3785-d1de-4e36-bc17-e0912a70a188 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] 10.222.0.58 "GET /compute/v2.1/servers/44e4df88-af81-4594-9f04-5aad9f9562a7" status: 200 len: 1359 microversion: 2.1 time: 0.189411 Aug 11 00:06:56.436311 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3604/7000] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:06:56 2022] GET /compute/v2.1/servers/44e4df88-af81-4594-9f04-5aad9f9562a7 => generated 1359 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:06:57.459570 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-57e996b6-0813-44c7-a5de-51a560982f27 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:06:57.460178 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-57e996b6-0813-44c7-a5de-51a560982f27 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] [instance: 44e4df88-af81-4594-9f04-5aad9f9562a7] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:06:57.467147 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-57e996b6-0813-44c7-a5de-51a560982f27 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:06:57.467642 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-57e996b6-0813-44c7-a5de-51a560982f27 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:06:57.468087 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-57e996b6-0813-44c7-a5de-51a560982f27 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:06:57.468784 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-57e996b6-0813-44c7-a5de-51a560982f27 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:06:57.469244 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-57e996b6-0813-44c7-a5de-51a560982f27 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:06:57.469673 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-57e996b6-0813-44c7-a5de-51a560982f27 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:06:57.599969 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-57e996b6-0813-44c7-a5de-51a560982f27 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba07c55f73147909e8fe2b56d64791e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051455ee483443618e113df12aa9387a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:06:57.607562 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-57e996b6-0813-44c7-a5de-51a560982f27 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] 10.222.0.58 "GET /compute/v2.1/servers/44e4df88-af81-4594-9f04-5aad9f9562a7" status: 200 len: 1359 microversion: 2.1 time: 0.151942 Aug 11 00:06:57.608140 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3397/7001] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:06:57 2022] GET /compute/v2.1/servers/44e4df88-af81-4594-9f04-5aad9f9562a7 => generated 1359 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:06:58.630155 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-843a475b-0249-470e-b1b1-a480ad98e8c5 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:06:58.630806 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-843a475b-0249-470e-b1b1-a480ad98e8c5 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] [instance: 44e4df88-af81-4594-9f04-5aad9f9562a7] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:06:58.637760 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-843a475b-0249-470e-b1b1-a480ad98e8c5 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:06:58.638262 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-843a475b-0249-470e-b1b1-a480ad98e8c5 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:06:58.638720 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-843a475b-0249-470e-b1b1-a480ad98e8c5 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:06:58.639466 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-843a475b-0249-470e-b1b1-a480ad98e8c5 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:06:58.639937 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-843a475b-0249-470e-b1b1-a480ad98e8c5 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:06:58.640378 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-843a475b-0249-470e-b1b1-a480ad98e8c5 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:06:58.780959 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-843a475b-0249-470e-b1b1-a480ad98e8c5 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba07c55f73147909e8fe2b56d64791e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051455ee483443618e113df12aa9387a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:06:58.790072 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-843a475b-0249-470e-b1b1-a480ad98e8c5 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] 10.222.0.58 "GET /compute/v2.1/servers/44e4df88-af81-4594-9f04-5aad9f9562a7" status: 200 len: 1359 microversion: 2.1 time: 0.164212 Aug 11 00:06:58.790675 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3605/7002] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:06:58 2022] GET /compute/v2.1/servers/44e4df88-af81-4594-9f04-5aad9f9562a7 => generated 1359 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:06:58.902438 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-cfb53462-b63e-4372-bc02-184945981ca0 req-4e5df919-0d3b-4ffb-9b9a-403ded9a3afb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44e4df88-af81-4594-9f04-5aad9f9562a7", "name": "network-vif-plugged", "status": "completed", "tag": "24014d0d-750e-4192-b535-eb4f8117471a"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 00:06:58.912250 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-cfb53462-b63e-4372-bc02-184945981ca0 req-4e5df919-0d3b-4ffb-9b9a-403ded9a3afb service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:06:58.912731 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-cfb53462-b63e-4372-bc02-184945981ca0 req-4e5df919-0d3b-4ffb-9b9a-403ded9a3afb service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:06:58.913165 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-cfb53462-b63e-4372-bc02-184945981ca0 req-4e5df919-0d3b-4ffb-9b9a-403ded9a3afb service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:06:58.927826 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-cfb53462-b63e-4372-bc02-184945981ca0 req-4e5df919-0d3b-4ffb-9b9a-403ded9a3afb service nova] Creating event network-vif-plugged:24014d0d-750e-4192-b535-eb4f8117471a for instance 44e4df88-af81-4594-9f04-5aad9f9562a7 on n-h2-850468-14 Aug 11 00:06:58.932929 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-cfb53462-b63e-4372-bc02-184945981ca0 req-4e5df919-0d3b-4ffb-9b9a-403ded9a3afb service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098279 Aug 11 00:06:58.933536 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3398/7003] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 11 00:06:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 00:06:59.812033 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-ac67fe65-697d-40c6-a654-ddfae38015a7 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:06:59.812668 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-ac67fe65-697d-40c6-a654-ddfae38015a7 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] [instance: 44e4df88-af81-4594-9f04-5aad9f9562a7] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:06:59.819330 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ac67fe65-697d-40c6-a654-ddfae38015a7 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:06:59.819830 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ac67fe65-697d-40c6-a654-ddfae38015a7 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:06:59.820285 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ac67fe65-697d-40c6-a654-ddfae38015a7 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:06:59.821007 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ac67fe65-697d-40c6-a654-ddfae38015a7 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:06:59.821477 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ac67fe65-697d-40c6-a654-ddfae38015a7 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:06:59.821920 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ac67fe65-697d-40c6-a654-ddfae38015a7 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:06:59.956768 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-ac67fe65-697d-40c6-a654-ddfae38015a7 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba07c55f73147909e8fe2b56d64791e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051455ee483443618e113df12aa9387a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:06:59.964704 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-ac67fe65-697d-40c6-a654-ddfae38015a7 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] 10.222.0.58 "GET /compute/v2.1/servers/44e4df88-af81-4594-9f04-5aad9f9562a7" status: 200 len: 1359 microversion: 2.1 time: 0.156604 Aug 11 00:06:59.965337 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3606/7004] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:06:59 2022] GET /compute/v2.1/servers/44e4df88-af81-4594-9f04-5aad9f9562a7 => generated 1359 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:07:00.987400 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-85091fd2-654f-4707-a0c7-9cf922a946f5 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:07:00.988109 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-85091fd2-654f-4707-a0c7-9cf922a946f5 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] [instance: 44e4df88-af81-4594-9f04-5aad9f9562a7] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:07:00.994322 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-85091fd2-654f-4707-a0c7-9cf922a946f5 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:07:00.994849 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-85091fd2-654f-4707-a0c7-9cf922a946f5 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:07:00.995296 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-85091fd2-654f-4707-a0c7-9cf922a946f5 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:07:00.996002 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-85091fd2-654f-4707-a0c7-9cf922a946f5 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:07:00.996456 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-85091fd2-654f-4707-a0c7-9cf922a946f5 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:07:00.996910 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-85091fd2-654f-4707-a0c7-9cf922a946f5 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:07:01.134670 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-85091fd2-654f-4707-a0c7-9cf922a946f5 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba07c55f73147909e8fe2b56d64791e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051455ee483443618e113df12aa9387a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:07:01.142831 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-85091fd2-654f-4707-a0c7-9cf922a946f5 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] 10.222.0.58 "GET /compute/v2.1/servers/44e4df88-af81-4594-9f04-5aad9f9562a7" status: 200 len: 1549 microversion: 2.1 time: 0.160470 Aug 11 00:07:01.143523 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3399/7005] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:07:00 2022] GET /compute/v2.1/servers/44e4df88-af81-4594-9f04-5aad9f9562a7 => generated 1549 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:07:01.164294 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-7de17d21-9b01-436e-935b-ce4f77784d6b tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:07:01.164930 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-7de17d21-9b01-436e-935b-ce4f77784d6b tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] [instance: 44e4df88-af81-4594-9f04-5aad9f9562a7] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:07:01.171575 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7de17d21-9b01-436e-935b-ce4f77784d6b tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:07:01.172081 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7de17d21-9b01-436e-935b-ce4f77784d6b tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:07:01.172541 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7de17d21-9b01-436e-935b-ce4f77784d6b tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:07:01.173290 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7de17d21-9b01-436e-935b-ce4f77784d6b tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:07:01.173801 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7de17d21-9b01-436e-935b-ce4f77784d6b tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:07:01.174293 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7de17d21-9b01-436e-935b-ce4f77784d6b tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:07:01.307765 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-7de17d21-9b01-436e-935b-ce4f77784d6b tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba07c55f73147909e8fe2b56d64791e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051455ee483443618e113df12aa9387a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:07:01.316007 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-7de17d21-9b01-436e-935b-ce4f77784d6b tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] 10.222.0.58 "GET /compute/v2.1/servers/44e4df88-af81-4594-9f04-5aad9f9562a7" status: 200 len: 1549 microversion: 2.1 time: 0.155781 Aug 11 00:07:01.316582 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3607/7006] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:07:01 2022] GET /compute/v2.1/servers/44e4df88-af81-4594-9f04-5aad9f9562a7 => generated 1549 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:07:01.336676 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-5c41aecc-7c2e-4c90-a03b-72269611a4b0 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:07:01.341330 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-5c41aecc-7c2e-4c90-a03b-72269611a4b0 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'dba07c55f73147909e8fe2b56d64791e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051455ee483443618e113df12aa9387a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:07:01.342099 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-5c41aecc-7c2e-4c90-a03b-72269611a4b0 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Searching by: {'deleted': False, 'project_id': '051455ee483443618e113df12aa9387a'} {{(pid=122632) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 11 00:07:01.348041 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5c41aecc-7c2e-4c90-a03b-72269611a4b0 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:07:01.348520 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5c41aecc-7c2e-4c90-a03b-72269611a4b0 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:07:01.348958 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5c41aecc-7c2e-4c90-a03b-72269611a4b0 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:07:01.349682 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5c41aecc-7c2e-4c90-a03b-72269611a4b0 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:07:01.350131 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5c41aecc-7c2e-4c90-a03b-72269611a4b0 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:07:01.350553 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5c41aecc-7c2e-4c90-a03b-72269611a4b0 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:07:01.374632 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.multi_cell_list [None req-5c41aecc-7c2e-4c90-a03b-72269611a4b0 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=122632) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 11 00:07:01.403367 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-5c41aecc-7c2e-4c90-a03b-72269611a4b0 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] 10.222.0.58 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.070543 Aug 11 00:07:01.403958 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3400/7007] 10.222.0.58 () {58 vars in 1125 bytes} [Thu Aug 11 00:07:01 2022] GET /compute/v2.1/servers => generated 343 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 00:07:01.415384 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-b0f90299-4196-4c16-a9fd-5789dec25a19 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:07:01.416017 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-b0f90299-4196-4c16-a9fd-5789dec25a19 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] [instance: 44e4df88-af81-4594-9f04-5aad9f9562a7] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:07:01.422079 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b0f90299-4196-4c16-a9fd-5789dec25a19 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:07:01.422575 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b0f90299-4196-4c16-a9fd-5789dec25a19 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:07:01.423061 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b0f90299-4196-4c16-a9fd-5789dec25a19 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:07:01.423812 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b0f90299-4196-4c16-a9fd-5789dec25a19 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:07:01.424254 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b0f90299-4196-4c16-a9fd-5789dec25a19 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:07:01.424697 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b0f90299-4196-4c16-a9fd-5789dec25a19 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:07:01.556550 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-b0f90299-4196-4c16-a9fd-5789dec25a19 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba07c55f73147909e8fe2b56d64791e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051455ee483443618e113df12aa9387a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:07:01.565074 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-b0f90299-4196-4c16-a9fd-5789dec25a19 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] 10.222.0.58 "GET /compute/v2.1/servers/44e4df88-af81-4594-9f04-5aad9f9562a7" status: 200 len: 1549 microversion: 2.1 time: 0.153490 Aug 11 00:07:01.565661 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3608/7008] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:07:01 2022] GET /compute/v2.1/servers/44e4df88-af81-4594-9f04-5aad9f9562a7 => generated 1549 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:07:03.087011 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-3ce5abed-a023-4faa-ae14-212461c07c15 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8cc5de14-3f2b-43ec-951d-2a2aae759cc6"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 00:07:03.089407 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-3ce5abed-a023-4faa-ae14-212461c07c15 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] [instance: 44e4df88-af81-4594-9f04-5aad9f9562a7] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:07:03.096658 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3ce5abed-a023-4faa-ae14-212461c07c15 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:07:03.097150 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3ce5abed-a023-4faa-ae14-212461c07c15 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:07:03.097595 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3ce5abed-a023-4faa-ae14-212461c07c15 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:07:03.098309 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3ce5abed-a023-4faa-ae14-212461c07c15 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:07:03.098765 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3ce5abed-a023-4faa-ae14-212461c07c15 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:07:03.099223 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3ce5abed-a023-4faa-ae14-212461c07c15 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:07:03.338246 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-3ce5abed-a023-4faa-ae14-212461c07c15 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] 10.222.0.58 "POST /compute/v2.1/servers/44e4df88-af81-4594-9f04-5aad9f9562a7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.255170 Aug 11 00:07:03.338950 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3401/7009] 10.222.0.58 () {60 vars in 1323 bytes} [Thu Aug 11 00:07:03 2022] POST /compute/v2.1/servers/44e4df88-af81-4594-9f04-5aad9f9562a7/os-volume_attachments => generated 194 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 00:07:14.107677 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-87b63ce7-3935-4fdc-83ea-342f571003e2 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:07:14.108303 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-87b63ce7-3935-4fdc-83ea-342f571003e2 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] [instance: 44e4df88-af81-4594-9f04-5aad9f9562a7] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:07:14.111413 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_api:SELECT=17 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:07:14.112213 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=62 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:07:14.118040 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-87b63ce7-3935-4fdc-83ea-342f571003e2 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:07:14.118537 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-87b63ce7-3935-4fdc-83ea-342f571003e2 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:07:14.119096 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-87b63ce7-3935-4fdc-83ea-342f571003e2 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:07:14.119808 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-87b63ce7-3935-4fdc-83ea-342f571003e2 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:07:14.120272 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-87b63ce7-3935-4fdc-83ea-342f571003e2 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:07:14.120792 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-87b63ce7-3935-4fdc-83ea-342f571003e2 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:07:14.257334 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-87b63ce7-3935-4fdc-83ea-342f571003e2 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba07c55f73147909e8fe2b56d64791e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051455ee483443618e113df12aa9387a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:07:14.266880 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-87b63ce7-3935-4fdc-83ea-342f571003e2 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] 10.222.0.58 "GET /compute/v2.1/servers/44e4df88-af81-4594-9f04-5aad9f9562a7" status: 200 len: 1595 microversion: 2.1 time: 0.162335 Aug 11 00:07:14.266880 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3609/7010] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:07:14 2022] GET /compute/v2.1/servers/44e4df88-af81-4594-9f04-5aad9f9562a7 => generated 1595 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:07:15.900715 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=2 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:07:15.902446 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_api:SELECT=19 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:07:15.903119 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:07:15.907646 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-1ffd91f9-edac-4ad0-9799-6ee1e163dcaa req-dc1332b3-1547-4db8-9f4d-de51b1f30844 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44e4df88-af81-4594-9f04-5aad9f9562a7", "tag": "24014d0d-750e-4192-b535-eb4f8117471a"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 00:07:15.919914 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-1ffd91f9-edac-4ad0-9799-6ee1e163dcaa req-dc1332b3-1547-4db8-9f4d-de51b1f30844 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:07:15.920498 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-1ffd91f9-edac-4ad0-9799-6ee1e163dcaa req-dc1332b3-1547-4db8-9f4d-de51b1f30844 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:07:15.921003 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-1ffd91f9-edac-4ad0-9799-6ee1e163dcaa req-dc1332b3-1547-4db8-9f4d-de51b1f30844 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:07:15.935048 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-1ffd91f9-edac-4ad0-9799-6ee1e163dcaa req-dc1332b3-1547-4db8-9f4d-de51b1f30844 service nova] Creating event network-changed:24014d0d-750e-4192-b535-eb4f8117471a for instance 44e4df88-af81-4594-9f04-5aad9f9562a7 on n-h2-850468-14 Aug 11 00:07:15.941709 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-1ffd91f9-edac-4ad0-9799-6ee1e163dcaa req-dc1332b3-1547-4db8-9f4d-de51b1f30844 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042720 Aug 11 00:07:15.942829 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3402/7011] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 11 00:07:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 00:07:17.066503 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-18b41b48-3ae1-45ed-a210-e7db178fdd5c tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1308462311"}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 00:07:17.067130 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-18b41b48-3ae1-45ed-a210-e7db178fdd5c tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] [instance: 44e4df88-af81-4594-9f04-5aad9f9562a7] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:07:17.073981 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-18b41b48-3ae1-45ed-a210-e7db178fdd5c tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:07:17.074486 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-18b41b48-3ae1-45ed-a210-e7db178fdd5c tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:07:17.074969 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-18b41b48-3ae1-45ed-a210-e7db178fdd5c tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:07:17.075684 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-18b41b48-3ae1-45ed-a210-e7db178fdd5c tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:07:17.076151 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-18b41b48-3ae1-45ed-a210-e7db178fdd5c tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:07:17.076590 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-18b41b48-3ae1-45ed-a210-e7db178fdd5c tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:07:17.208681 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.network.security_group_api [None req-18b41b48-3ae1-45ed-a210-e7db178fdd5c tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Adding security group b2f0b4b6-c642-420f-9532-920fe1614780 to port 24014d0d-750e-4192-b535-eb4f8117471a Aug 11 00:07:17.523359 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-18b41b48-3ae1-45ed-a210-e7db178fdd5c tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] 10.222.0.58 "POST /compute/v2.1/servers/44e4df88-af81-4594-9f04-5aad9f9562a7/action" status: 202 len: 0 microversion: 2.1 time: 0.460586 Aug 11 00:07:17.526265 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3610/7012] 10.222.0.58 () {60 vars in 1278 bytes} [Thu Aug 11 00:07:17 2022] POST /compute/v2.1/servers/44e4df88-af81-4594-9f04-5aad9f9562a7/action => generated 0 bytes in 464 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 11 00:07:17.539553 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-517871a3-a232-4cfa-9694-5258041a2a8a tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:07:17.540457 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-517871a3-a232-4cfa-9694-5258041a2a8a tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] [instance: 44e4df88-af81-4594-9f04-5aad9f9562a7] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:07:17.547096 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-517871a3-a232-4cfa-9694-5258041a2a8a tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:07:17.547914 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-517871a3-a232-4cfa-9694-5258041a2a8a tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:07:17.548745 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-517871a3-a232-4cfa-9694-5258041a2a8a tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:07:17.549729 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-517871a3-a232-4cfa-9694-5258041a2a8a tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:07:17.550441 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-517871a3-a232-4cfa-9694-5258041a2a8a tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:07:17.551118 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-517871a3-a232-4cfa-9694-5258041a2a8a tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:07:17.621569 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-cbe73e83-f474-4e83-bbfe-0d28e525ffa8 req-1300454f-9291-4259-9fdb-c14b10d19ae8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44e4df88-af81-4594-9f04-5aad9f9562a7", "tag": "24014d0d-750e-4192-b535-eb4f8117471a"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 00:07:17.638748 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-cbe73e83-f474-4e83-bbfe-0d28e525ffa8 req-1300454f-9291-4259-9fdb-c14b10d19ae8 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:07:17.639204 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-cbe73e83-f474-4e83-bbfe-0d28e525ffa8 req-1300454f-9291-4259-9fdb-c14b10d19ae8 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:07:17.639836 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-cbe73e83-f474-4e83-bbfe-0d28e525ffa8 req-1300454f-9291-4259-9fdb-c14b10d19ae8 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:07:17.655042 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-cbe73e83-f474-4e83-bbfe-0d28e525ffa8 req-1300454f-9291-4259-9fdb-c14b10d19ae8 service nova] Creating event network-changed:24014d0d-750e-4192-b535-eb4f8117471a for instance 44e4df88-af81-4594-9f04-5aad9f9562a7 on n-h2-850468-14 Aug 11 00:07:17.661013 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-cbe73e83-f474-4e83-bbfe-0d28e525ffa8 req-1300454f-9291-4259-9fdb-c14b10d19ae8 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.135624 Aug 11 00:07:17.661634 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3403/7013] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 11 00:07:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 11 00:07:17.740581 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-517871a3-a232-4cfa-9694-5258041a2a8a tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba07c55f73147909e8fe2b56d64791e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051455ee483443618e113df12aa9387a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:07:17.748672 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-517871a3-a232-4cfa-9694-5258041a2a8a tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] 10.222.0.58 "GET /compute/v2.1/servers/44e4df88-af81-4594-9f04-5aad9f9562a7" status: 200 len: 1761 microversion: 2.1 time: 0.213117 Aug 11 00:07:17.749508 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3611/7014] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:07:17 2022] GET /compute/v2.1/servers/44e4df88-af81-4594-9f04-5aad9f9562a7 => generated 1761 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:07:40.074837 n-d-850468-14 devstack@n-api.service[122632]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cd3f72be-c5dc-40c0-bc95-e9b4d1b700e4] AMQP server on 10.222.0.58:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 11 00:07:40.075441 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_api:SELECT=4 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:07:40.076272 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=4 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:07:40.127289 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-8d21e879-e47a-49a8-8043-5f320c3bf660 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 00:07:40.129870 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-8d21e879-e47a-49a8-8043-5f320c3bf660 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] [instance: 44e4df88-af81-4594-9f04-5aad9f9562a7] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:07:40.136648 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8d21e879-e47a-49a8-8043-5f320c3bf660 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:07:40.137137 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8d21e879-e47a-49a8-8043-5f320c3bf660 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:07:40.137581 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8d21e879-e47a-49a8-8043-5f320c3bf660 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:07:40.138309 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8d21e879-e47a-49a8-8043-5f320c3bf660 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:07:40.138770 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8d21e879-e47a-49a8-8043-5f320c3bf660 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:07:40.139222 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8d21e879-e47a-49a8-8043-5f320c3bf660 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:07:40.212077 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-8d21e879-e47a-49a8-8043-5f320c3bf660 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] 10.222.0.58 "POST /compute/v2.1/servers/44e4df88-af81-4594-9f04-5aad9f9562a7/action" status: 202 len: 0 microversion: 2.1 time: 0.138656 Aug 11 00:07:40.212806 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3404/7015] 10.222.0.58 () {60 vars in 1278 bytes} [Thu Aug 11 00:07:40 2022] POST /compute/v2.1/servers/44e4df88-af81-4594-9f04-5aad9f9562a7/action => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 11 00:07:40.223536 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-7b508377-0112-4627-900c-1fe95e6f44f9 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:07:40.224275 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-7b508377-0112-4627-900c-1fe95e6f44f9 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] [instance: 44e4df88-af81-4594-9f04-5aad9f9562a7] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:07:40.226262 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_api:SELECT=6 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:07:40.227039 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=16 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:07:40.233199 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7b508377-0112-4627-900c-1fe95e6f44f9 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:07:40.233695 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7b508377-0112-4627-900c-1fe95e6f44f9 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:07:40.235176 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7b508377-0112-4627-900c-1fe95e6f44f9 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:07:40.236120 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7b508377-0112-4627-900c-1fe95e6f44f9 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:07:40.236935 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7b508377-0112-4627-900c-1fe95e6f44f9 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:07:40.237382 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7b508377-0112-4627-900c-1fe95e6f44f9 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:07:40.387480 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-7b508377-0112-4627-900c-1fe95e6f44f9 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba07c55f73147909e8fe2b56d64791e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051455ee483443618e113df12aa9387a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:07:40.396557 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-7b508377-0112-4627-900c-1fe95e6f44f9 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] 10.222.0.58 "GET /compute/v2.1/servers/44e4df88-af81-4594-9f04-5aad9f9562a7" status: 200 len: 1753 microversion: 2.1 time: 0.178373 Aug 11 00:07:40.397142 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3612/7016] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:07:40 2022] GET /compute/v2.1/servers/44e4df88-af81-4594-9f04-5aad9f9562a7 => generated 1753 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:07:41.420105 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-84dff4fb-8663-4900-9444-c20ee86ff44d tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:07:41.420801 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-84dff4fb-8663-4900-9444-c20ee86ff44d tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] [instance: 44e4df88-af81-4594-9f04-5aad9f9562a7] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:07:41.428026 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-84dff4fb-8663-4900-9444-c20ee86ff44d tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:07:41.428510 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-84dff4fb-8663-4900-9444-c20ee86ff44d tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:07:41.428944 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-84dff4fb-8663-4900-9444-c20ee86ff44d tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:07:41.429645 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-84dff4fb-8663-4900-9444-c20ee86ff44d tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:07:41.430095 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-84dff4fb-8663-4900-9444-c20ee86ff44d tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:07:41.430513 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-84dff4fb-8663-4900-9444-c20ee86ff44d tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:07:41.440082 n-d-850468-14 devstack@n-api.service[122632]: INFO oslo.messaging._drivers.impl_rabbit [-] [cd3f72be-c5dc-40c0-bc95-e9b4d1b700e4] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 40138. Aug 11 00:07:41.580405 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-84dff4fb-8663-4900-9444-c20ee86ff44d tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba07c55f73147909e8fe2b56d64791e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051455ee483443618e113df12aa9387a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:07:41.588587 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-84dff4fb-8663-4900-9444-c20ee86ff44d tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] 10.222.0.58 "GET /compute/v2.1/servers/44e4df88-af81-4594-9f04-5aad9f9562a7" status: 200 len: 1758 microversion: 2.1 time: 0.174171 Aug 11 00:07:41.589168 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3405/7017] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:07:41 2022] GET /compute/v2.1/servers/44e4df88-af81-4594-9f04-5aad9f9562a7 => generated 1758 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:07:42.609697 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-9d121989-2ea5-4f19-a275-a88218fba9b3 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:07:42.610981 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-9d121989-2ea5-4f19-a275-a88218fba9b3 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] [instance: 44e4df88-af81-4594-9f04-5aad9f9562a7] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:07:42.618016 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9d121989-2ea5-4f19-a275-a88218fba9b3 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:07:42.618510 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9d121989-2ea5-4f19-a275-a88218fba9b3 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:07:42.618992 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9d121989-2ea5-4f19-a275-a88218fba9b3 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:07:42.619696 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9d121989-2ea5-4f19-a275-a88218fba9b3 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:07:42.620159 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9d121989-2ea5-4f19-a275-a88218fba9b3 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:07:42.620591 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9d121989-2ea5-4f19-a275-a88218fba9b3 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:07:42.767711 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-9d121989-2ea5-4f19-a275-a88218fba9b3 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba07c55f73147909e8fe2b56d64791e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051455ee483443618e113df12aa9387a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:07:42.775799 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-9d121989-2ea5-4f19-a275-a88218fba9b3 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] 10.222.0.58 "GET /compute/v2.1/servers/44e4df88-af81-4594-9f04-5aad9f9562a7" status: 200 len: 1758 microversion: 2.1 time: 0.170068 Aug 11 00:07:42.776317 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3613/7018] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:07:42 2022] GET /compute/v2.1/servers/44e4df88-af81-4594-9f04-5aad9f9562a7 => generated 1758 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:07:43.797438 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-7024fb26-5e34-45d2-a96e-f2d2cc46c3a5 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:07:43.799029 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-7024fb26-5e34-45d2-a96e-f2d2cc46c3a5 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] [instance: 44e4df88-af81-4594-9f04-5aad9f9562a7] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:07:43.806014 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7024fb26-5e34-45d2-a96e-f2d2cc46c3a5 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:07:43.806495 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7024fb26-5e34-45d2-a96e-f2d2cc46c3a5 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:07:43.806962 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7024fb26-5e34-45d2-a96e-f2d2cc46c3a5 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:07:43.807653 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7024fb26-5e34-45d2-a96e-f2d2cc46c3a5 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:07:43.808100 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7024fb26-5e34-45d2-a96e-f2d2cc46c3a5 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:07:43.808520 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7024fb26-5e34-45d2-a96e-f2d2cc46c3a5 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:07:43.956106 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-7024fb26-5e34-45d2-a96e-f2d2cc46c3a5 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba07c55f73147909e8fe2b56d64791e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051455ee483443618e113df12aa9387a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:07:43.964309 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-7024fb26-5e34-45d2-a96e-f2d2cc46c3a5 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] 10.222.0.58 "GET /compute/v2.1/servers/44e4df88-af81-4594-9f04-5aad9f9562a7" status: 200 len: 1758 microversion: 2.1 time: 0.170790 Aug 11 00:07:43.964883 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3406/7019] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:07:43 2022] GET /compute/v2.1/servers/44e4df88-af81-4594-9f04-5aad9f9562a7 => generated 1758 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:07:44.987122 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-3f8a8687-5612-4650-ae67-082ee1113fce tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:07:44.987755 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-3f8a8687-5612-4650-ae67-082ee1113fce tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] [instance: 44e4df88-af81-4594-9f04-5aad9f9562a7] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:07:44.994690 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3f8a8687-5612-4650-ae67-082ee1113fce tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:07:44.995228 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3f8a8687-5612-4650-ae67-082ee1113fce tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:07:44.995684 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3f8a8687-5612-4650-ae67-082ee1113fce tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:07:44.996399 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3f8a8687-5612-4650-ae67-082ee1113fce tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:07:44.996870 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3f8a8687-5612-4650-ae67-082ee1113fce tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:07:44.997314 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3f8a8687-5612-4650-ae67-082ee1113fce tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:07:45.143211 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-3f8a8687-5612-4650-ae67-082ee1113fce tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba07c55f73147909e8fe2b56d64791e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051455ee483443618e113df12aa9387a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:07:45.151940 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-3f8a8687-5612-4650-ae67-082ee1113fce tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] 10.222.0.58 "GET /compute/v2.1/servers/44e4df88-af81-4594-9f04-5aad9f9562a7" status: 200 len: 1758 microversion: 2.1 time: 0.169416 Aug 11 00:07:45.152551 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3614/7020] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:07:44 2022] GET /compute/v2.1/servers/44e4df88-af81-4594-9f04-5aad9f9562a7 => generated 1758 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:07:46.174254 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-1d86a0ae-f460-44a9-a25b-e3f322cc5489 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:07:46.175120 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-1d86a0ae-f460-44a9-a25b-e3f322cc5489 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] [instance: 44e4df88-af81-4594-9f04-5aad9f9562a7] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:07:46.181704 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1d86a0ae-f460-44a9-a25b-e3f322cc5489 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:07:46.182187 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1d86a0ae-f460-44a9-a25b-e3f322cc5489 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:07:46.182625 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1d86a0ae-f460-44a9-a25b-e3f322cc5489 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:07:46.183345 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1d86a0ae-f460-44a9-a25b-e3f322cc5489 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:07:46.183797 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1d86a0ae-f460-44a9-a25b-e3f322cc5489 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:07:46.184223 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1d86a0ae-f460-44a9-a25b-e3f322cc5489 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:07:46.330430 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-1d86a0ae-f460-44a9-a25b-e3f322cc5489 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba07c55f73147909e8fe2b56d64791e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051455ee483443618e113df12aa9387a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:07:46.338597 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-1d86a0ae-f460-44a9-a25b-e3f322cc5489 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] 10.222.0.58 "GET /compute/v2.1/servers/44e4df88-af81-4594-9f04-5aad9f9562a7" status: 200 len: 1758 microversion: 2.1 time: 0.168264 Aug 11 00:07:46.339203 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3407/7021] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:07:46 2022] GET /compute/v2.1/servers/44e4df88-af81-4594-9f04-5aad9f9562a7 => generated 1758 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:07:47.359428 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-3be5099b-41b9-4ee2-b7e1-e9bdabb3c6e6 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:07:47.360058 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-3be5099b-41b9-4ee2-b7e1-e9bdabb3c6e6 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] [instance: 44e4df88-af81-4594-9f04-5aad9f9562a7] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:07:47.367374 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3be5099b-41b9-4ee2-b7e1-e9bdabb3c6e6 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:07:47.367881 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3be5099b-41b9-4ee2-b7e1-e9bdabb3c6e6 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:07:47.368345 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3be5099b-41b9-4ee2-b7e1-e9bdabb3c6e6 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:07:47.369062 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3be5099b-41b9-4ee2-b7e1-e9bdabb3c6e6 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:07:47.369568 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3be5099b-41b9-4ee2-b7e1-e9bdabb3c6e6 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:07:47.370013 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3be5099b-41b9-4ee2-b7e1-e9bdabb3c6e6 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:07:47.521228 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-3be5099b-41b9-4ee2-b7e1-e9bdabb3c6e6 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba07c55f73147909e8fe2b56d64791e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051455ee483443618e113df12aa9387a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:07:47.529412 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-3be5099b-41b9-4ee2-b7e1-e9bdabb3c6e6 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] 10.222.0.58 "GET /compute/v2.1/servers/44e4df88-af81-4594-9f04-5aad9f9562a7" status: 200 len: 1758 microversion: 2.1 time: 0.174039 Aug 11 00:07:47.529992 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3615/7022] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:07:47 2022] GET /compute/v2.1/servers/44e4df88-af81-4594-9f04-5aad9f9562a7 => generated 1758 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:07:48.551468 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-6289ff3e-cf66-4f4a-ba46-940cc3138043 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:07:48.552115 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-6289ff3e-cf66-4f4a-ba46-940cc3138043 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] [instance: 44e4df88-af81-4594-9f04-5aad9f9562a7] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:07:48.559098 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6289ff3e-cf66-4f4a-ba46-940cc3138043 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:07:48.559583 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6289ff3e-cf66-4f4a-ba46-940cc3138043 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:07:48.560020 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6289ff3e-cf66-4f4a-ba46-940cc3138043 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:07:48.560749 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6289ff3e-cf66-4f4a-ba46-940cc3138043 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:07:48.561203 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6289ff3e-cf66-4f4a-ba46-940cc3138043 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:07:48.561631 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6289ff3e-cf66-4f4a-ba46-940cc3138043 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:07:48.702814 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-6289ff3e-cf66-4f4a-ba46-940cc3138043 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba07c55f73147909e8fe2b56d64791e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051455ee483443618e113df12aa9387a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:07:48.711600 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-6289ff3e-cf66-4f4a-ba46-940cc3138043 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] 10.222.0.58 "GET /compute/v2.1/servers/44e4df88-af81-4594-9f04-5aad9f9562a7" status: 200 len: 1758 microversion: 2.1 time: 0.164101 Aug 11 00:07:48.712181 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3408/7023] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:07:48 2022] GET /compute/v2.1/servers/44e4df88-af81-4594-9f04-5aad9f9562a7 => generated 1758 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:07:49.733944 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-a95b948d-fa63-4312-a782-293a4f080dd1 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:07:49.734576 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-a95b948d-fa63-4312-a782-293a4f080dd1 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] [instance: 44e4df88-af81-4594-9f04-5aad9f9562a7] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:07:49.742531 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a95b948d-fa63-4312-a782-293a4f080dd1 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:07:49.743109 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a95b948d-fa63-4312-a782-293a4f080dd1 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:07:49.743584 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a95b948d-fa63-4312-a782-293a4f080dd1 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:07:49.744296 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a95b948d-fa63-4312-a782-293a4f080dd1 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:07:49.744776 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a95b948d-fa63-4312-a782-293a4f080dd1 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:07:49.745217 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a95b948d-fa63-4312-a782-293a4f080dd1 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:07:49.891059 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-a95b948d-fa63-4312-a782-293a4f080dd1 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba07c55f73147909e8fe2b56d64791e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051455ee483443618e113df12aa9387a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:07:49.899998 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-a95b948d-fa63-4312-a782-293a4f080dd1 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] 10.222.0.58 "GET /compute/v2.1/servers/44e4df88-af81-4594-9f04-5aad9f9562a7" status: 200 len: 1758 microversion: 2.1 time: 0.169982 Aug 11 00:07:49.900582 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3616/7024] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:07:49 2022] GET /compute/v2.1/servers/44e4df88-af81-4594-9f04-5aad9f9562a7 => generated 1758 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:07:50.921774 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-0f7b15fb-7555-4221-9dca-76ece9c3a319 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:07:50.922407 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-0f7b15fb-7555-4221-9dca-76ece9c3a319 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] [instance: 44e4df88-af81-4594-9f04-5aad9f9562a7] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:07:50.929497 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0f7b15fb-7555-4221-9dca-76ece9c3a319 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:07:50.929990 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0f7b15fb-7555-4221-9dca-76ece9c3a319 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:07:50.930461 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0f7b15fb-7555-4221-9dca-76ece9c3a319 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:07:50.931187 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0f7b15fb-7555-4221-9dca-76ece9c3a319 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:07:50.931645 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0f7b15fb-7555-4221-9dca-76ece9c3a319 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:07:50.932077 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0f7b15fb-7555-4221-9dca-76ece9c3a319 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:07:51.389789 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-0f7b15fb-7555-4221-9dca-76ece9c3a319 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba07c55f73147909e8fe2b56d64791e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051455ee483443618e113df12aa9387a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:07:51.398023 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-0f7b15fb-7555-4221-9dca-76ece9c3a319 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] 10.222.0.58 "GET /compute/v2.1/servers/44e4df88-af81-4594-9f04-5aad9f9562a7" status: 200 len: 1758 microversion: 2.1 time: 0.480389 Aug 11 00:07:51.398606 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3409/7025] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:07:50 2022] GET /compute/v2.1/servers/44e4df88-af81-4594-9f04-5aad9f9562a7 => generated 1758 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:07:52.420592 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-eb5a5217-17f4-4e3a-80ff-af171712a27c tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:07:52.421225 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-eb5a5217-17f4-4e3a-80ff-af171712a27c tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] [instance: 44e4df88-af81-4594-9f04-5aad9f9562a7] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:07:52.429006 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-eb5a5217-17f4-4e3a-80ff-af171712a27c tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:07:52.429508 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-eb5a5217-17f4-4e3a-80ff-af171712a27c tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:07:52.429967 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-eb5a5217-17f4-4e3a-80ff-af171712a27c tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:07:52.430690 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-eb5a5217-17f4-4e3a-80ff-af171712a27c tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:07:52.431193 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-eb5a5217-17f4-4e3a-80ff-af171712a27c tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:07:52.431641 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-eb5a5217-17f4-4e3a-80ff-af171712a27c tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:07:52.575526 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-eb5a5217-17f4-4e3a-80ff-af171712a27c tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba07c55f73147909e8fe2b56d64791e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051455ee483443618e113df12aa9387a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:07:52.583721 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-eb5a5217-17f4-4e3a-80ff-af171712a27c tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] 10.222.0.58 "GET /compute/v2.1/servers/44e4df88-af81-4594-9f04-5aad9f9562a7" status: 200 len: 1758 microversion: 2.1 time: 0.167129 Aug 11 00:07:52.584308 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3617/7026] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:07:52 2022] GET /compute/v2.1/servers/44e4df88-af81-4594-9f04-5aad9f9562a7 => generated 1758 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:07:53.605403 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-af608b2d-a768-4fab-8d9f-37cbfce00768 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:07:53.606009 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-af608b2d-a768-4fab-8d9f-37cbfce00768 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] [instance: 44e4df88-af81-4594-9f04-5aad9f9562a7] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:07:53.613432 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-af608b2d-a768-4fab-8d9f-37cbfce00768 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:07:53.613917 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-af608b2d-a768-4fab-8d9f-37cbfce00768 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:07:53.614357 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-af608b2d-a768-4fab-8d9f-37cbfce00768 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:07:53.615119 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-af608b2d-a768-4fab-8d9f-37cbfce00768 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:07:53.615577 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-af608b2d-a768-4fab-8d9f-37cbfce00768 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:07:53.616002 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-af608b2d-a768-4fab-8d9f-37cbfce00768 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:07:53.762928 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-af608b2d-a768-4fab-8d9f-37cbfce00768 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba07c55f73147909e8fe2b56d64791e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051455ee483443618e113df12aa9387a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:07:53.772303 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-af608b2d-a768-4fab-8d9f-37cbfce00768 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] 10.222.0.58 "GET /compute/v2.1/servers/44e4df88-af81-4594-9f04-5aad9f9562a7" status: 200 len: 1758 microversion: 2.1 time: 0.170859 Aug 11 00:07:53.772815 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3410/7027] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:07:53 2022] GET /compute/v2.1/servers/44e4df88-af81-4594-9f04-5aad9f9562a7 => generated 1758 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:07:54.793902 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-5bcc6f4b-130f-41a3-8fed-50d3657e79c2 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:07:54.794539 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-5bcc6f4b-130f-41a3-8fed-50d3657e79c2 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] [instance: 44e4df88-af81-4594-9f04-5aad9f9562a7] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:07:54.801709 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5bcc6f4b-130f-41a3-8fed-50d3657e79c2 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:07:54.802266 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5bcc6f4b-130f-41a3-8fed-50d3657e79c2 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:07:54.802754 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5bcc6f4b-130f-41a3-8fed-50d3657e79c2 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:07:54.803519 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5bcc6f4b-130f-41a3-8fed-50d3657e79c2 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:07:54.803996 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5bcc6f4b-130f-41a3-8fed-50d3657e79c2 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:07:54.804444 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5bcc6f4b-130f-41a3-8fed-50d3657e79c2 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:07:54.951621 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-5bcc6f4b-130f-41a3-8fed-50d3657e79c2 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba07c55f73147909e8fe2b56d64791e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051455ee483443618e113df12aa9387a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:07:54.960394 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-5bcc6f4b-130f-41a3-8fed-50d3657e79c2 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] 10.222.0.58 "GET /compute/v2.1/servers/44e4df88-af81-4594-9f04-5aad9f9562a7" status: 200 len: 1758 microversion: 2.1 time: 0.170419 Aug 11 00:07:54.960983 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3618/7028] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:07:54 2022] GET /compute/v2.1/servers/44e4df88-af81-4594-9f04-5aad9f9562a7 => generated 1758 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:07:55.982745 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-ec621000-68a1-458f-96ef-f17685a0ba51 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:07:55.983392 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-ec621000-68a1-458f-96ef-f17685a0ba51 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] [instance: 44e4df88-af81-4594-9f04-5aad9f9562a7] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:07:55.990906 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ec621000-68a1-458f-96ef-f17685a0ba51 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:07:55.991391 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ec621000-68a1-458f-96ef-f17685a0ba51 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:07:55.991831 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ec621000-68a1-458f-96ef-f17685a0ba51 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:07:55.992529 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ec621000-68a1-458f-96ef-f17685a0ba51 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:07:55.992987 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ec621000-68a1-458f-96ef-f17685a0ba51 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:07:55.993418 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ec621000-68a1-458f-96ef-f17685a0ba51 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:07:56.144387 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-ec621000-68a1-458f-96ef-f17685a0ba51 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba07c55f73147909e8fe2b56d64791e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051455ee483443618e113df12aa9387a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:07:56.152702 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-ec621000-68a1-458f-96ef-f17685a0ba51 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] 10.222.0.58 "GET /compute/v2.1/servers/44e4df88-af81-4594-9f04-5aad9f9562a7" status: 200 len: 1758 microversion: 2.1 time: 0.173949 Aug 11 00:07:56.153300 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3411/7029] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:07:55 2022] GET /compute/v2.1/servers/44e4df88-af81-4594-9f04-5aad9f9562a7 => generated 1758 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:07:57.174157 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-bbe413d3-aa27-4549-8086-c74836ee1f63 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:07:57.174776 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-bbe413d3-aa27-4549-8086-c74836ee1f63 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] [instance: 44e4df88-af81-4594-9f04-5aad9f9562a7] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:07:57.194882 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bbe413d3-aa27-4549-8086-c74836ee1f63 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:07:57.195387 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bbe413d3-aa27-4549-8086-c74836ee1f63 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:07:57.195837 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bbe413d3-aa27-4549-8086-c74836ee1f63 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:07:57.196554 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bbe413d3-aa27-4549-8086-c74836ee1f63 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:07:57.197020 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bbe413d3-aa27-4549-8086-c74836ee1f63 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:07:57.197456 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bbe413d3-aa27-4549-8086-c74836ee1f63 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:07:57.341342 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-bbe413d3-aa27-4549-8086-c74836ee1f63 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba07c55f73147909e8fe2b56d64791e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051455ee483443618e113df12aa9387a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:07:57.349665 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-bbe413d3-aa27-4549-8086-c74836ee1f63 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] 10.222.0.58 "GET /compute/v2.1/servers/44e4df88-af81-4594-9f04-5aad9f9562a7" status: 200 len: 1758 microversion: 2.1 time: 0.179558 Aug 11 00:07:57.350242 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3619/7030] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:07:57 2022] GET /compute/v2.1/servers/44e4df88-af81-4594-9f04-5aad9f9562a7 => generated 1758 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:07:58.371598 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-31e29503-579a-4d26-89aa-d700e359cbcd tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:07:58.372208 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-31e29503-579a-4d26-89aa-d700e359cbcd tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] [instance: 44e4df88-af81-4594-9f04-5aad9f9562a7] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:07:58.379306 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-31e29503-579a-4d26-89aa-d700e359cbcd tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:07:58.380364 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-31e29503-579a-4d26-89aa-d700e359cbcd tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:07:58.381008 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-31e29503-579a-4d26-89aa-d700e359cbcd tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:07:58.381720 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-31e29503-579a-4d26-89aa-d700e359cbcd tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:07:58.382221 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-31e29503-579a-4d26-89aa-d700e359cbcd tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:07:58.382608 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-31e29503-579a-4d26-89aa-d700e359cbcd tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:07:58.525884 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-31e29503-579a-4d26-89aa-d700e359cbcd tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba07c55f73147909e8fe2b56d64791e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051455ee483443618e113df12aa9387a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:07:58.534279 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-31e29503-579a-4d26-89aa-d700e359cbcd tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] 10.222.0.58 "GET /compute/v2.1/servers/44e4df88-af81-4594-9f04-5aad9f9562a7" status: 200 len: 1758 microversion: 2.1 time: 0.166529 Aug 11 00:07:58.534893 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3412/7031] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:07:58 2022] GET /compute/v2.1/servers/44e4df88-af81-4594-9f04-5aad9f9562a7 => generated 1758 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:07:59.556602 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-663c025d-3949-4546-a17b-8a57cb060d7e tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:07:59.557247 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-663c025d-3949-4546-a17b-8a57cb060d7e tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] [instance: 44e4df88-af81-4594-9f04-5aad9f9562a7] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:07:59.564214 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-663c025d-3949-4546-a17b-8a57cb060d7e tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:07:59.564708 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-663c025d-3949-4546-a17b-8a57cb060d7e tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:07:59.565159 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-663c025d-3949-4546-a17b-8a57cb060d7e tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:07:59.565873 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-663c025d-3949-4546-a17b-8a57cb060d7e tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:07:59.566340 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-663c025d-3949-4546-a17b-8a57cb060d7e tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:07:59.567445 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-663c025d-3949-4546-a17b-8a57cb060d7e tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:07:59.718844 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-663c025d-3949-4546-a17b-8a57cb060d7e tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba07c55f73147909e8fe2b56d64791e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051455ee483443618e113df12aa9387a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:07:59.727124 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-663c025d-3949-4546-a17b-8a57cb060d7e tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] 10.222.0.58 "GET /compute/v2.1/servers/44e4df88-af81-4594-9f04-5aad9f9562a7" status: 200 len: 1758 microversion: 2.1 time: 0.174644 Aug 11 00:07:59.727716 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3620/7032] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:07:59 2022] GET /compute/v2.1/servers/44e4df88-af81-4594-9f04-5aad9f9562a7 => generated 1758 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:08:00.748975 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-72af675f-c457-4c29-8f7e-9597524c115b tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:08:00.749556 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-72af675f-c457-4c29-8f7e-9597524c115b tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] [instance: 44e4df88-af81-4594-9f04-5aad9f9562a7] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:08:00.756784 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-72af675f-c457-4c29-8f7e-9597524c115b tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:08:00.757266 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-72af675f-c457-4c29-8f7e-9597524c115b tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:08:00.757709 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-72af675f-c457-4c29-8f7e-9597524c115b tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:08:00.758407 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-72af675f-c457-4c29-8f7e-9597524c115b tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:08:00.758890 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-72af675f-c457-4c29-8f7e-9597524c115b tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:08:00.759324 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-72af675f-c457-4c29-8f7e-9597524c115b tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:08:00.908524 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-72af675f-c457-4c29-8f7e-9597524c115b tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba07c55f73147909e8fe2b56d64791e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051455ee483443618e113df12aa9387a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:08:00.916912 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-72af675f-c457-4c29-8f7e-9597524c115b tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] 10.222.0.58 "GET /compute/v2.1/servers/44e4df88-af81-4594-9f04-5aad9f9562a7" status: 200 len: 1758 microversion: 2.1 time: 0.171957 Aug 11 00:08:00.917491 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3413/7033] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:08:00 2022] GET /compute/v2.1/servers/44e4df88-af81-4594-9f04-5aad9f9562a7 => generated 1758 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:08:01.939231 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-5f0a297e-729b-421b-af1c-ce16cd4e5a78 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:08:01.939859 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-5f0a297e-729b-421b-af1c-ce16cd4e5a78 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] [instance: 44e4df88-af81-4594-9f04-5aad9f9562a7] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:08:01.946891 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5f0a297e-729b-421b-af1c-ce16cd4e5a78 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:08:01.947392 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5f0a297e-729b-421b-af1c-ce16cd4e5a78 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:08:01.947853 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5f0a297e-729b-421b-af1c-ce16cd4e5a78 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:08:01.948565 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5f0a297e-729b-421b-af1c-ce16cd4e5a78 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:08:01.949040 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5f0a297e-729b-421b-af1c-ce16cd4e5a78 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:08:01.949485 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5f0a297e-729b-421b-af1c-ce16cd4e5a78 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:08:02.095311 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-5f0a297e-729b-421b-af1c-ce16cd4e5a78 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba07c55f73147909e8fe2b56d64791e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051455ee483443618e113df12aa9387a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:08:02.104516 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-5f0a297e-729b-421b-af1c-ce16cd4e5a78 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] 10.222.0.58 "GET /compute/v2.1/servers/44e4df88-af81-4594-9f04-5aad9f9562a7" status: 200 len: 1761 microversion: 2.1 time: 0.169779 Aug 11 00:08:02.105093 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3621/7034] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:08:01 2022] GET /compute/v2.1/servers/44e4df88-af81-4594-9f04-5aad9f9562a7 => generated 1761 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:08:37.350688 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-53f252bf-f56a-4cb9-a597-bd3f014e8217 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1308462311"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 00:08:37.351350 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-53f252bf-f56a-4cb9-a597-bd3f014e8217 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] [instance: 44e4df88-af81-4594-9f04-5aad9f9562a7] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:08:37.353349 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_api:SELECT=20 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:08:37.354038 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:08:37.359758 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-53f252bf-f56a-4cb9-a597-bd3f014e8217 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:08:37.360250 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-53f252bf-f56a-4cb9-a597-bd3f014e8217 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:08:37.360694 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-53f252bf-f56a-4cb9-a597-bd3f014e8217 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:08:37.361439 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-53f252bf-f56a-4cb9-a597-bd3f014e8217 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:08:37.361898 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-53f252bf-f56a-4cb9-a597-bd3f014e8217 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:08:37.362329 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-53f252bf-f56a-4cb9-a597-bd3f014e8217 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:08:37.489876 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.network.security_group_api [None req-53f252bf-f56a-4cb9-a597-bd3f014e8217 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Removing security group b2f0b4b6-c642-420f-9532-920fe1614780 from port 24014d0d-750e-4192-b535-eb4f8117471a Aug 11 00:08:37.797788 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-53f252bf-f56a-4cb9-a597-bd3f014e8217 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] 10.222.0.58 "POST /compute/v2.1/servers/44e4df88-af81-4594-9f04-5aad9f9562a7/action" status: 202 len: 0 microversion: 2.1 time: 0.452028 Aug 11 00:08:37.798743 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3414/7035] 10.222.0.58 () {60 vars in 1278 bytes} [Thu Aug 11 00:08:37 2022] POST /compute/v2.1/servers/44e4df88-af81-4594-9f04-5aad9f9562a7/action => generated 0 bytes in 454 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 11 00:08:37.807277 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-0d830a00-4274-4c41-8bdc-b222b18d084e req-58dc0e7e-8f61-45b6-8498-dbd0e38c03d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44e4df88-af81-4594-9f04-5aad9f9562a7", "tag": "24014d0d-750e-4192-b535-eb4f8117471a"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 00:08:37.817252 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_api:SELECT=20 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:08:37.819294 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=60 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:08:37.821031 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-0d830a00-4274-4c41-8bdc-b222b18d084e req-58dc0e7e-8f61-45b6-8498-dbd0e38c03d2 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:08:37.821572 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-0d830a00-4274-4c41-8bdc-b222b18d084e req-58dc0e7e-8f61-45b6-8498-dbd0e38c03d2 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:08:37.822123 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-0d830a00-4274-4c41-8bdc-b222b18d084e req-58dc0e7e-8f61-45b6-8498-dbd0e38c03d2 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:08:37.837124 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-0d830a00-4274-4c41-8bdc-b222b18d084e req-58dc0e7e-8f61-45b6-8498-dbd0e38c03d2 service nova] Creating event network-changed:24014d0d-750e-4192-b535-eb4f8117471a for instance 44e4df88-af81-4594-9f04-5aad9f9562a7 on n-h2-850468-14 Aug 11 00:08:37.843302 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-0d830a00-4274-4c41-8bdc-b222b18d084e req-58dc0e7e-8f61-45b6-8498-dbd0e38c03d2 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040135 Aug 11 00:08:37.844233 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3622/7036] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 11 00:08:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 00:08:39.425981 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-0f45a2b9-0927-4a39-8560-6a0cd76036ef tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:08:39.426605 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-0f45a2b9-0927-4a39-8560-6a0cd76036ef tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] [instance: 44e4df88-af81-4594-9f04-5aad9f9562a7] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:08:39.433339 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0f45a2b9-0927-4a39-8560-6a0cd76036ef tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:08:39.433833 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0f45a2b9-0927-4a39-8560-6a0cd76036ef tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:08:39.434272 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0f45a2b9-0927-4a39-8560-6a0cd76036ef tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:08:39.435048 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0f45a2b9-0927-4a39-8560-6a0cd76036ef tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:08:39.435913 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0f45a2b9-0927-4a39-8560-6a0cd76036ef tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:08:39.435913 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0f45a2b9-0927-4a39-8560-6a0cd76036ef tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:08:39.536641 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.objects.instance [None req-0f45a2b9-0927-4a39-8560-6a0cd76036ef tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lazy-loading 'services' on Instance uuid 44e4df88-af81-4594-9f04-5aad9f9562a7 {{(pid=122632) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 11 00:08:39.616319 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-0f45a2b9-0927-4a39-8560-6a0cd76036ef tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] 10.222.0.58 "DELETE /compute/v2.1/servers/44e4df88-af81-4594-9f04-5aad9f9562a7/os-volume_attachments/8cc5de14-3f2b-43ec-951d-2a2aae759cc6" status: 202 len: 0 microversion: 2.1 time: 0.195016 Aug 11 00:08:39.616917 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3415/7037] 10.222.0.58 () {58 vars in 1416 bytes} [Thu Aug 11 00:08:39 2022] DELETE /compute/v2.1/servers/44e4df88-af81-4594-9f04-5aad9f9562a7/os-volume_attachments/8cc5de14-3f2b-43ec-951d-2a2aae759cc6 => generated 0 bytes in 197 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 11 00:08:39.626883 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-3315b0b8-fbfd-4f28-bbb6-4b8dcebf13b7 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:08:39.629542 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-3315b0b8-fbfd-4f28-bbb6-4b8dcebf13b7 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] [instance: 44e4df88-af81-4594-9f04-5aad9f9562a7] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:08:39.637041 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3315b0b8-fbfd-4f28-bbb6-4b8dcebf13b7 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:08:39.637542 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3315b0b8-fbfd-4f28-bbb6-4b8dcebf13b7 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:08:39.637989 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3315b0b8-fbfd-4f28-bbb6-4b8dcebf13b7 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:08:39.640025 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3315b0b8-fbfd-4f28-bbb6-4b8dcebf13b7 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:08:39.640729 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3315b0b8-fbfd-4f28-bbb6-4b8dcebf13b7 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:08:39.641392 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3315b0b8-fbfd-4f28-bbb6-4b8dcebf13b7 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:08:39.675225 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-3315b0b8-fbfd-4f28-bbb6-4b8dcebf13b7 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] 10.222.0.58 "GET /compute/v2.1/servers/44e4df88-af81-4594-9f04-5aad9f9562a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053589 Aug 11 00:08:39.675823 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3623/7038] 10.222.0.58 () {58 vars in 1302 bytes} [Thu Aug 11 00:08:39 2022] GET /compute/v2.1/servers/44e4df88-af81-4594-9f04-5aad9f9562a7/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 00:08:39.860901 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-ec27cce6-8743-452b-9e96-592bb663b23a req-86a93d99-e585-4710-b97f-40f6293ccde8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44e4df88-af81-4594-9f04-5aad9f9562a7", "tag": "24014d0d-750e-4192-b535-eb4f8117471a"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 00:08:39.871034 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-ec27cce6-8743-452b-9e96-592bb663b23a req-86a93d99-e585-4710-b97f-40f6293ccde8 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:08:39.871492 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-ec27cce6-8743-452b-9e96-592bb663b23a req-86a93d99-e585-4710-b97f-40f6293ccde8 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:08:39.872168 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-ec27cce6-8743-452b-9e96-592bb663b23a req-86a93d99-e585-4710-b97f-40f6293ccde8 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:08:39.884300 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-ec27cce6-8743-452b-9e96-592bb663b23a req-86a93d99-e585-4710-b97f-40f6293ccde8 service nova] Creating event network-changed:24014d0d-750e-4192-b535-eb4f8117471a for instance 44e4df88-af81-4594-9f04-5aad9f9562a7 on n-h2-850468-14 Aug 11 00:08:39.889113 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-ec27cce6-8743-452b-9e96-592bb663b23a req-86a93d99-e585-4710-b97f-40f6293ccde8 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032548 Aug 11 00:08:39.889948 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3416/7039] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 11 00:08:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 00:08:40.687948 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-9eb01ef9-9744-460b-8947-d0dced0adad0 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:08:40.690169 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-9eb01ef9-9744-460b-8947-d0dced0adad0 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] [instance: 44e4df88-af81-4594-9f04-5aad9f9562a7] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:08:40.697474 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9eb01ef9-9744-460b-8947-d0dced0adad0 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:08:40.697978 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9eb01ef9-9744-460b-8947-d0dced0adad0 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:08:40.698436 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9eb01ef9-9744-460b-8947-d0dced0adad0 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:08:40.699185 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9eb01ef9-9744-460b-8947-d0dced0adad0 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:08:40.699657 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9eb01ef9-9744-460b-8947-d0dced0adad0 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:08:40.700103 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9eb01ef9-9744-460b-8947-d0dced0adad0 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:08:40.731038 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-9eb01ef9-9744-460b-8947-d0dced0adad0 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] 10.222.0.58 "GET /compute/v2.1/servers/44e4df88-af81-4594-9f04-5aad9f9562a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046996 Aug 11 00:08:40.731832 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3624/7040] 10.222.0.58 () {58 vars in 1302 bytes} [Thu Aug 11 00:08:40 2022] GET /compute/v2.1/servers/44e4df88-af81-4594-9f04-5aad9f9562a7/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 00:08:41.746414 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-ab8e4f78-2d32-43d9-a643-ad6662d2c7ab tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:08:41.748815 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-ab8e4f78-2d32-43d9-a643-ad6662d2c7ab tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] [instance: 44e4df88-af81-4594-9f04-5aad9f9562a7] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:08:41.755582 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ab8e4f78-2d32-43d9-a643-ad6662d2c7ab tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:08:41.756070 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ab8e4f78-2d32-43d9-a643-ad6662d2c7ab tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:08:41.756511 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ab8e4f78-2d32-43d9-a643-ad6662d2c7ab tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:08:41.757219 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ab8e4f78-2d32-43d9-a643-ad6662d2c7ab tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:08:41.757677 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ab8e4f78-2d32-43d9-a643-ad6662d2c7ab tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:08:41.758178 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ab8e4f78-2d32-43d9-a643-ad6662d2c7ab tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:08:41.791522 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-ab8e4f78-2d32-43d9-a643-ad6662d2c7ab tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] 10.222.0.58 "GET /compute/v2.1/servers/44e4df88-af81-4594-9f04-5aad9f9562a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050675 Aug 11 00:08:41.792908 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3417/7041] 10.222.0.58 () {58 vars in 1302 bytes} [Thu Aug 11 00:08:41 2022] GET /compute/v2.1/servers/44e4df88-af81-4594-9f04-5aad9f9562a7/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 00:08:42.804724 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-def49f4d-85f4-4f7a-8de8-bf21ac226a2e tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:08:42.806967 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-def49f4d-85f4-4f7a-8de8-bf21ac226a2e tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] [instance: 44e4df88-af81-4594-9f04-5aad9f9562a7] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:08:42.813815 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-def49f4d-85f4-4f7a-8de8-bf21ac226a2e tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:08:42.814315 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-def49f4d-85f4-4f7a-8de8-bf21ac226a2e tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:08:42.814768 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-def49f4d-85f4-4f7a-8de8-bf21ac226a2e tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:08:42.815529 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-def49f4d-85f4-4f7a-8de8-bf21ac226a2e tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:08:42.815999 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-def49f4d-85f4-4f7a-8de8-bf21ac226a2e tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:08:42.816438 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-def49f4d-85f4-4f7a-8de8-bf21ac226a2e tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:08:42.846333 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-def49f4d-85f4-4f7a-8de8-bf21ac226a2e tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] 10.222.0.58 "GET /compute/v2.1/servers/44e4df88-af81-4594-9f04-5aad9f9562a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046163 Aug 11 00:08:42.846938 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3625/7042] 10.222.0.58 () {58 vars in 1302 bytes} [Thu Aug 11 00:08:42 2022] GET /compute/v2.1/servers/44e4df88-af81-4594-9f04-5aad9f9562a7/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 00:08:43.860044 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-f976212f-33e6-436f-8bb7-1e912e6a7be9 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:08:43.862217 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-f976212f-33e6-436f-8bb7-1e912e6a7be9 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] [instance: 44e4df88-af81-4594-9f04-5aad9f9562a7] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:08:43.869238 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f976212f-33e6-436f-8bb7-1e912e6a7be9 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:08:43.869725 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f976212f-33e6-436f-8bb7-1e912e6a7be9 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:08:43.870160 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f976212f-33e6-436f-8bb7-1e912e6a7be9 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:08:43.870896 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f976212f-33e6-436f-8bb7-1e912e6a7be9 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:08:43.871388 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f976212f-33e6-436f-8bb7-1e912e6a7be9 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:08:43.871778 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f976212f-33e6-436f-8bb7-1e912e6a7be9 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:08:43.910251 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-f976212f-33e6-436f-8bb7-1e912e6a7be9 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] 10.222.0.58 "GET /compute/v2.1/servers/44e4df88-af81-4594-9f04-5aad9f9562a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054159 Aug 11 00:08:43.910866 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3418/7043] 10.222.0.58 () {58 vars in 1302 bytes} [Thu Aug 11 00:08:43 2022] GET /compute/v2.1/servers/44e4df88-af81-4594-9f04-5aad9f9562a7/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 11 00:08:44.923524 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-497b22bf-b7a7-432b-9470-d8d12da27323 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:08:44.925713 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-497b22bf-b7a7-432b-9470-d8d12da27323 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] [instance: 44e4df88-af81-4594-9f04-5aad9f9562a7] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:08:44.932956 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-497b22bf-b7a7-432b-9470-d8d12da27323 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:08:44.933462 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-497b22bf-b7a7-432b-9470-d8d12da27323 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:08:44.933921 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-497b22bf-b7a7-432b-9470-d8d12da27323 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:08:44.934634 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-497b22bf-b7a7-432b-9470-d8d12da27323 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:08:44.935132 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-497b22bf-b7a7-432b-9470-d8d12da27323 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:08:44.935577 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-497b22bf-b7a7-432b-9470-d8d12da27323 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:08:44.965084 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-497b22bf-b7a7-432b-9470-d8d12da27323 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] 10.222.0.58 "GET /compute/v2.1/servers/44e4df88-af81-4594-9f04-5aad9f9562a7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045534 Aug 11 00:08:44.965654 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3626/7044] 10.222.0.58 () {58 vars in 1302 bytes} [Thu Aug 11 00:08:44 2022] GET /compute/v2.1/servers/44e4df88-af81-4594-9f04-5aad9f9562a7/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 11 00:08:44.977094 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-ed45d137-aa96-4835-9db8-f0afe8b0cbf2 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:08:44.977603 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-ed45d137-aa96-4835-9db8-f0afe8b0cbf2 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] [instance: 44e4df88-af81-4594-9f04-5aad9f9562a7] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:08:44.984658 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ed45d137-aa96-4835-9db8-f0afe8b0cbf2 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:08:44.985170 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ed45d137-aa96-4835-9db8-f0afe8b0cbf2 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:08:44.985619 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ed45d137-aa96-4835-9db8-f0afe8b0cbf2 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:08:44.986323 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ed45d137-aa96-4835-9db8-f0afe8b0cbf2 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:08:44.986799 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ed45d137-aa96-4835-9db8-f0afe8b0cbf2 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:08:44.987244 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ed45d137-aa96-4835-9db8-f0afe8b0cbf2 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:08:45.062306 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-ed45d137-aa96-4835-9db8-f0afe8b0cbf2 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] HTTP exception thrown: Instance 44e4df88-af81-4594-9f04-5aad9f9562a7 is not attached to volume 8cc5de14-3f2b-43ec-951d-2a2aae759cc6 Aug 11 00:08:45.063928 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-ed45d137-aa96-4835-9db8-f0afe8b0cbf2 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Request method failure captured: Aug 11 00:08:45.063928 n-d-850468-14 devstack@n-api.service[122632]: request: DELETE /compute/v2.1/servers/44e4df88-af81-4594-9f04-5aad9f9562a7/os-volume_attachments/8cc5de14-3f2b-43ec-951d-2a2aae759cc6 HTTP/1.1 Aug 11 00:08:45.063928 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 11 00:08:45.063928 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 11 00:08:45.063928 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 11 00:08:45.063928 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 11 00:08:45.063928 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 11 00:08:45.063928 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 11 00:08:45.063928 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 11 00:08:45.063928 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 11 00:08:45.063928 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9EcWVqWoT3qxArkqZsE2UepIFLOgupcCKOe9-fvQUyzhecvkT1SzmfBOo00EHKyCHOfVvj-OAHdleCVvZsfq-Fcz6jBFwpX5FNf6SSh6PLdwY9J8G3N-fNbER2J4CUFR2Hj1cHja5h3oETDA8G74KkeeowLpNVFrBRI27EmtPRpcaDI Aug 11 00:08:45.063928 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 11 00:08:45.063928 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 11 00:08:45.063928 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 11 00:08:45.063928 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 11 00:08:45.063928 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 11 00:08:45.063928 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 11 00:08:45.063928 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 051455ee483443618e113df12aa9387a Aug 11 00:08:45.063928 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-TestMinimumBasicScenario-1967007737 Aug 11 00:08:45.063928 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 11 00:08:45.063928 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 11 00:08:45.063928 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/051455ee483443618e113df12aa9387a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/051455ee483443618e113df12aa9387a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/051455ee483443618e113df12aa9387a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_051455ee483443618e113df12aa9387a", "adminURL": "http://10.222.0.58:8080"}]}] Aug 11 00:08:45.063928 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-TestMinimumBasicScenario-1967007737 Aug 11 00:08:45.063928 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 051455ee483443618e113df12aa9387a Aug 11 00:08:45.063928 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1967007737 Aug 11 00:08:45.063928 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-TestMinimumBasicScenario-1967007737-project Aug 11 00:08:45.063928 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 11 00:08:45.063928 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 11 00:08:45.063928 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: dba07c55f73147909e8fe2b56d64791e Aug 11 00:08:45.063928 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-TestMinimumBasicScenario-1967007737-project Aug 11 00:08:45.063928 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 11 00:08:45.063928 n-d-850468-14 devstack@n-api.service[122632]: exception: Instance 44e4df88-af81-4594-9f04-5aad9f9562a7 is not attached to volume 8cc5de14-3f2b-43ec-951d-2a2aae759cc6 Aug 11 00:08:45.063928 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'server_id': '44e4df88-af81-4594-9f04-5aad9f9562a7', 'id': '8cc5de14-3f2b-43ec-951d-2a2aae759cc6'} Aug 11 00:08:45.063928 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 00:08:45.063928 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 00:08:45.063928 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 11 00:08:45.063928 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 11 00:08:45.063928 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 11 00:08:45.063928 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 11 00:08:45.063928 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Aug 11 00:08:45.063928 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 11 00:08:45.063928 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 8cc5de14-3f2b-43ec-951d-2a2aae759cc6. Aug 11 00:08:45.063928 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 11 00:08:45.063928 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 00:08:45.063928 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 11 00:08:45.063928 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 00:08:45.063928 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 00:08:45.063928 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 00:08:45.063928 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 00:08:45.063928 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 00:08:45.063928 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 00:08:45.063928 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 00:08:45.063928 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 11 00:08:45.063928 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 11 00:08:45.063928 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44e4df88-af81-4594-9f04-5aad9f9562a7 is not attached to volume 8cc5de14-3f2b-43ec-951d-2a2aae759cc6 Aug 11 00:08:45.063928 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 11 00:08:45.063928 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 00:08:45.063928 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 11 00:08:45.063928 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 00:08:45.063928 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 00:08:45.063928 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 00:08:45.068882 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 00:08:45.068882 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 00:08:45.068882 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44e4df88-af81-4594-9f04-5aad9f9562a7 is not attached to volume 8cc5de14-3f2b-43ec-951d-2a2aae759cc6 Aug 11 00:08:45.068882 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 11 00:08:45.068882 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-ed45d137-aa96-4835-9db8-f0afe8b0cbf2 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Returning 404 to user: Instance 44e4df88-af81-4594-9f04-5aad9f9562a7 is not attached to volume 8cc5de14-3f2b-43ec-951d-2a2aae759cc6 {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 00:08:45.068882 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-ed45d137-aa96-4835-9db8-f0afe8b0cbf2 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] 10.222.0.58 "DELETE /compute/v2.1/servers/44e4df88-af81-4594-9f04-5aad9f9562a7/os-volume_attachments/8cc5de14-3f2b-43ec-951d-2a2aae759cc6" status: 404 len: 154 microversion: 2.1 time: 0.093160 Aug 11 00:08:45.068882 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3419/7045] 10.222.0.58 () {58 vars in 1416 bytes} [Thu Aug 11 00:08:44 2022] DELETE /compute/v2.1/servers/44e4df88-af81-4594-9f04-5aad9f9562a7/os-volume_attachments/8cc5de14-3f2b-43ec-951d-2a2aae759cc6 => generated 154 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 11 00:08:48.322798 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-3fec861f-3fd1-4370-a60b-12653b947e69 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:08:48.323318 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-3fec861f-3fd1-4370-a60b-12653b947e69 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] [instance: 44e4df88-af81-4594-9f04-5aad9f9562a7] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:08:48.331568 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3fec861f-3fd1-4370-a60b-12653b947e69 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:08:48.332061 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3fec861f-3fd1-4370-a60b-12653b947e69 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:08:48.332735 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3fec861f-3fd1-4370-a60b-12653b947e69 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:08:48.333217 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3fec861f-3fd1-4370-a60b-12653b947e69 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:08:48.333735 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3fec861f-3fd1-4370-a60b-12653b947e69 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:08:48.335203 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3fec861f-3fd1-4370-a60b-12653b947e69 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:08:48.361520 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-3fec861f-3fd1-4370-a60b-12653b947e69 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] [instance: 44e4df88-af81-4594-9f04-5aad9f9562a7] Going to try to terminate instance {{(pid=122633) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 11 00:08:48.441795 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-3fec861f-3fd1-4370-a60b-12653b947e69 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] 10.222.0.58 "DELETE /compute/v2.1/servers/44e4df88-af81-4594-9f04-5aad9f9562a7" status: 204 len: 0 microversion: 2.1 time: 0.123328 Aug 11 00:08:48.442362 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3627/7046] 10.222.0.58 () {58 vars in 1239 bytes} [Thu Aug 11 00:08:48 2022] DELETE /compute/v2.1/servers/44e4df88-af81-4594-9f04-5aad9f9562a7 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 11 00:08:48.452180 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-3808ccb1-3438-4659-b7aa-d57f45b48325 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:08:48.452826 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-3808ccb1-3438-4659-b7aa-d57f45b48325 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] [instance: 44e4df88-af81-4594-9f04-5aad9f9562a7] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:08:48.460888 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3808ccb1-3438-4659-b7aa-d57f45b48325 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:08:48.461469 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3808ccb1-3438-4659-b7aa-d57f45b48325 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:08:48.461935 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3808ccb1-3438-4659-b7aa-d57f45b48325 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:08:48.462663 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3808ccb1-3438-4659-b7aa-d57f45b48325 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:08:48.463147 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3808ccb1-3438-4659-b7aa-d57f45b48325 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:08:48.463570 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3808ccb1-3438-4659-b7aa-d57f45b48325 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:08:48.609766 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-3808ccb1-3438-4659-b7aa-d57f45b48325 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba07c55f73147909e8fe2b56d64791e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051455ee483443618e113df12aa9387a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:08:48.614364 n-d-850468-14 devstack@n-api.service[122633]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 11 00:08:48.615548 n-d-850468-14 devstack@n-api.service[122633]: Thu Aug 11 00:08:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 11 00:08:48.625816 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-3808ccb1-3438-4659-b7aa-d57f45b48325 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] 10.222.0.58 "GET /compute/v2.1/servers/44e4df88-af81-4594-9f04-5aad9f9562a7" status: 200 len: 1555 microversion: 2.1 time: 0.177884 Aug 11 00:08:48.626414 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3420/7047] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:08:48 2022] GET /compute/v2.1/servers/44e4df88-af81-4594-9f04-5aad9f9562a7 => generated 1555 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:08:49.415192 n-d-850468-14 devstack@n-api.service[122632]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 11 00:08:49.415389 n-d-850468-14 devstack@n-api.service[122632]: Thu Aug 11 00:08:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 11 00:08:49.648984 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-fdc2e54e-4e42-44bb-9e66-de6fc7e9adbe tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:08:49.649705 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-fdc2e54e-4e42-44bb-9e66-de6fc7e9adbe tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] [instance: 44e4df88-af81-4594-9f04-5aad9f9562a7] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:08:49.660273 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fdc2e54e-4e42-44bb-9e66-de6fc7e9adbe tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:08:49.660782 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fdc2e54e-4e42-44bb-9e66-de6fc7e9adbe tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:08:49.661240 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fdc2e54e-4e42-44bb-9e66-de6fc7e9adbe tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:08:49.662126 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fdc2e54e-4e42-44bb-9e66-de6fc7e9adbe tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:08:49.662608 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fdc2e54e-4e42-44bb-9e66-de6fc7e9adbe tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:08:49.663159 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fdc2e54e-4e42-44bb-9e66-de6fc7e9adbe tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:08:49.796726 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-fdc2e54e-4e42-44bb-9e66-de6fc7e9adbe tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba07c55f73147909e8fe2b56d64791e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051455ee483443618e113df12aa9387a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:08:49.804348 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-fdc2e54e-4e42-44bb-9e66-de6fc7e9adbe tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] 10.222.0.58 "GET /compute/v2.1/servers/44e4df88-af81-4594-9f04-5aad9f9562a7" status: 200 len: 1555 microversion: 2.1 time: 0.160495 Aug 11 00:08:49.804940 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3628/7048] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:08:49 2022] GET /compute/v2.1/servers/44e4df88-af81-4594-9f04-5aad9f9562a7 => generated 1555 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:08:50.826384 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-6d692e6f-001c-4da8-a992-444bd0c87891 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:08:50.827148 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-6d692e6f-001c-4da8-a992-444bd0c87891 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] [instance: 44e4df88-af81-4594-9f04-5aad9f9562a7] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:08:50.835153 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6d692e6f-001c-4da8-a992-444bd0c87891 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:08:50.835644 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6d692e6f-001c-4da8-a992-444bd0c87891 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:08:50.836089 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6d692e6f-001c-4da8-a992-444bd0c87891 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:08:50.836811 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6d692e6f-001c-4da8-a992-444bd0c87891 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:08:50.837265 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6d692e6f-001c-4da8-a992-444bd0c87891 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:08:50.838355 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6d692e6f-001c-4da8-a992-444bd0c87891 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:08:50.877740 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-104045a1-68a0-420c-aae0-74626b1e03e5 req-b08a9ec9-3c2a-4c6a-ba96-70735901bb43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44e4df88-af81-4594-9f04-5aad9f9562a7", "name": "network-vif-deleted", "tag": "24014d0d-750e-4192-b535-eb4f8117471a"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 00:08:50.889277 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-104045a1-68a0-420c-aae0-74626b1e03e5 req-b08a9ec9-3c2a-4c6a-ba96-70735901bb43 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:08:50.889780 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-104045a1-68a0-420c-aae0-74626b1e03e5 req-b08a9ec9-3c2a-4c6a-ba96-70735901bb43 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:08:50.890224 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-104045a1-68a0-420c-aae0-74626b1e03e5 req-b08a9ec9-3c2a-4c6a-ba96-70735901bb43 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:08:50.903512 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-104045a1-68a0-420c-aae0-74626b1e03e5 req-b08a9ec9-3c2a-4c6a-ba96-70735901bb43 service nova] Creating event network-vif-deleted:24014d0d-750e-4192-b535-eb4f8117471a for instance 44e4df88-af81-4594-9f04-5aad9f9562a7 on n-h2-850468-14 Aug 11 00:08:50.907375 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-6d692e6f-001c-4da8-a992-444bd0c87891 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dba07c55f73147909e8fe2b56d64791e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '051455ee483443618e113df12aa9387a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:08:50.913503 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-104045a1-68a0-420c-aae0-74626b1e03e5 req-b08a9ec9-3c2a-4c6a-ba96-70735901bb43 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039306 Aug 11 00:08:50.914931 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3629/7049] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 11 00:08:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 11 00:08:50.916584 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-6d692e6f-001c-4da8-a992-444bd0c87891 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] 10.222.0.58 "GET /compute/v2.1/servers/44e4df88-af81-4594-9f04-5aad9f9562a7" status: 200 len: 1513 microversion: 2.1 time: 0.094233 Aug 11 00:08:50.917129 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3421/7050] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:08:50 2022] GET /compute/v2.1/servers/44e4df88-af81-4594-9f04-5aad9f9562a7 => generated 1513 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:08:51.939046 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-2c02b6dd-fede-4c33-83ad-4f9edde398f3 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:08:51.939810 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-2c02b6dd-fede-4c33-83ad-4f9edde398f3 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] [instance: 44e4df88-af81-4594-9f04-5aad9f9562a7] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:08:51.946730 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2c02b6dd-fede-4c33-83ad-4f9edde398f3 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:08:51.947250 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2c02b6dd-fede-4c33-83ad-4f9edde398f3 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:08:51.947700 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2c02b6dd-fede-4c33-83ad-4f9edde398f3 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:08:51.948411 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2c02b6dd-fede-4c33-83ad-4f9edde398f3 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:08:51.948878 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2c02b6dd-fede-4c33-83ad-4f9edde398f3 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:08:51.949319 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2c02b6dd-fede-4c33-83ad-4f9edde398f3 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:08:51.963407 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-2c02b6dd-fede-4c33-83ad-4f9edde398f3 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] HTTP exception thrown: Instance 44e4df88-af81-4594-9f04-5aad9f9562a7 could not be found. Aug 11 00:08:51.965084 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-2c02b6dd-fede-4c33-83ad-4f9edde398f3 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Request method failure captured: Aug 11 00:08:51.965084 n-d-850468-14 devstack@n-api.service[122633]: request: GET /compute/v2.1/servers/44e4df88-af81-4594-9f04-5aad9f9562a7 HTTP/1.1 Aug 11 00:08:51.965084 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 11 00:08:51.965084 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 11 00:08:51.965084 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 11 00:08:51.965084 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 11 00:08:51.965084 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 11 00:08:51.965084 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 11 00:08:51.965084 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 11 00:08:51.965084 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 11 00:08:51.965084 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9EcWVqWoT3qxArkqZsE2UepIFLOgupcCKOe9-fvQUyzhecvkT1SzmfBOo00EHKyCHOfVvj-OAHdleCVvZsfq-Fcz6jBFwpX5FNf6SSh6PLdwY9J8G3N-fNbER2J4CUFR2Hj1cHja5h3oETDA8G74KkeeowLpNVFrBRI27EmtPRpcaDI Aug 11 00:08:51.965084 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 11 00:08:51.965084 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 11 00:08:51.965084 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 11 00:08:51.965084 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 11 00:08:51.965084 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 11 00:08:51.965084 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 11 00:08:51.965084 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 051455ee483443618e113df12aa9387a Aug 11 00:08:51.965084 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-TestMinimumBasicScenario-1967007737 Aug 11 00:08:51.965084 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 11 00:08:51.965084 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 11 00:08:51.965084 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/051455ee483443618e113df12aa9387a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/051455ee483443618e113df12aa9387a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/051455ee483443618e113df12aa9387a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_051455ee483443618e113df12aa9387a", "adminURL": "http://10.222.0.58:8080"}]}] Aug 11 00:08:51.965084 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-TestMinimumBasicScenario-1967007737 Aug 11 00:08:51.965084 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 051455ee483443618e113df12aa9387a Aug 11 00:08:51.965084 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1967007737 Aug 11 00:08:51.965084 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-TestMinimumBasicScenario-1967007737-project Aug 11 00:08:51.965084 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 11 00:08:51.965084 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 11 00:08:51.965084 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: dba07c55f73147909e8fe2b56d64791e Aug 11 00:08:51.965084 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-TestMinimumBasicScenario-1967007737-project Aug 11 00:08:51.965084 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 11 00:08:51.965084 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance 44e4df88-af81-4594-9f04-5aad9f9562a7 could not be found. Aug 11 00:08:51.965084 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': '44e4df88-af81-4594-9f04-5aad9f9562a7'} Aug 11 00:08:51.965084 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 00:08:51.965084 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 00:08:51.965084 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 11 00:08:51.965084 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 11 00:08:51.965084 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 11 00:08:51.965084 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 11 00:08:51.965084 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 11 00:08:51.965084 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 11 00:08:51.965084 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 11 00:08:51.965084 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 11 00:08:51.965084 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44e4df88-af81-4594-9f04-5aad9f9562a7 could not be found. Aug 11 00:08:51.965084 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 11 00:08:51.965084 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 00:08:51.965084 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 11 00:08:51.965084 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 00:08:51.965084 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 00:08:51.965084 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 00:08:51.965084 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 00:08:51.965084 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 00:08:51.965084 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 00:08:51.965084 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 00:08:51.965084 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 11 00:08:51.965084 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 11 00:08:51.965084 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 11 00:08:51.965084 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 11 00:08:51.965084 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 11 00:08:51.965084 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 11 00:08:51.965084 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44e4df88-af81-4594-9f04-5aad9f9562a7 could not be found. Aug 11 00:08:51.965084 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 11 00:08:51.965084 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 00:08:51.965084 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 11 00:08:51.972322 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 00:08:51.972322 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 00:08:51.972322 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 00:08:51.972322 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 00:08:51.972322 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 00:08:51.972322 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44e4df88-af81-4594-9f04-5aad9f9562a7 could not be found. Aug 11 00:08:51.972322 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 11 00:08:51.972322 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-2c02b6dd-fede-4c33-83ad-4f9edde398f3 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Returning 404 to user: Instance 44e4df88-af81-4594-9f04-5aad9f9562a7 could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 00:08:51.972322 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-2c02b6dd-fede-4c33-83ad-4f9edde398f3 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] 10.222.0.58 "GET /compute/v2.1/servers/44e4df88-af81-4594-9f04-5aad9f9562a7" status: 404 len: 111 microversion: 2.1 time: 0.032694 Aug 11 00:08:51.972322 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3630/7051] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:08:51 2022] GET /compute/v2.1/servers/44e4df88-af81-4594-9f04-5aad9f9562a7 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 11 00:08:51.975486 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-7fc5733a-da8a-4ec7-89bf-c0d66045d7d4 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] Calling method '.version_select at 0x7f847d24b0d0>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:08:51.996876 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-7fc5733a-da8a-4ec7-89bf-c0d66045d7d4 tempest-TestMinimumBasicScenario-1967007737 tempest-TestMinimumBasicScenario-1967007737-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1057962522" status: 202 len: 0 microversion: 2.1 time: 0.025280 Aug 11 00:08:51.997476 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3422/7052] 10.222.0.58 () {58 vars in 1272 bytes} [Thu Aug 11 00:08:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1057962522 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 11 00:09:01.417848 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-2b8b6719-0e47-4d3c-8e8c-1c6a723cc130 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Action: 'create', calling method: .version_select at 0x7f847d0e8280>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-12104298", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMW6EaDrEJIfjHh1B47B1wuwIgCNI2XnnFs90NXCHUD8mSPiOabB2sOm6kp1+YhtrBpjdvRum7XwIkehSazaIN6JllJWaFy7qusmsO9UUfTe+MGrReTc7AaCA9JE+H9lRA=="}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 00:09:01.434159 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-2b8b6719-0e47-4d3c-8e8c-1c6a723cc130 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Getting quotas for project 26799bad802a44c18dfee33c758cbb60. Resources: {'key_pairs'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 11 00:09:01.439385 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-2b8b6719-0e47-4d3c-8e8c-1c6a723cc130 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Getting quotas for user 8e98a27e99564f0ca672fbc06423d9ea and project 26799bad802a44c18dfee33c758cbb60. Resources: {'key_pairs'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 11 00:09:01.464309 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-2b8b6719-0e47-4d3c-8e8c-1c6a723cc130 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.213106 Aug 11 00:09:01.464915 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3631/7053] 10.222.0.58 () {60 vars in 1159 bytes} [Thu Aug 11 00:09:01 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 00:09:07.819589 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-595cf03c-2696-4278-b98c-8b9b3bddc7fb tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-2027597813", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452", "networks": [{"uuid": "07e6a76a-fdf4-4135-a910-a277c2c7245f"}], "key_name": "tempest-TestNetworkAdvancedServerOps-12104298", "security_groups": [{"name": "tempest-secgroup-smoke-125080478"}]}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 00:09:07.834584 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=45,nova_cell1:INSERT=1 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:09:07.835824 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_api:SELECT=19,nova_api:DELETE=1 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:09:07.952399 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.network.neutron [None req-595cf03c-2696-4278-b98c-8b9b3bddc7fb tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] validate_networks() for [('07e6a76a-fdf4-4135-a910-a277c2c7245f', None, None, None, None, None)] {{(pid=122632) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 11 00:09:08.412553 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-595cf03c-2696-4278-b98c-8b9b3bddc7fb tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Flavor limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 11 00:09:08.413008 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-595cf03c-2696-4278-b98c-8b9b3bddc7fb tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Image limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 11 00:09:08.413830 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-595cf03c-2696-4278-b98c-8b9b3bddc7fb tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Flavor pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 11 00:09:08.414660 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-595cf03c-2696-4278-b98c-8b9b3bddc7fb tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Image pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 11 00:09:08.415430 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-595cf03c-2696-4278-b98c-8b9b3bddc7fb tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 11 00:09:08.424867 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-595cf03c-2696-4278-b98c-8b9b3bddc7fb tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:09:08.425361 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-595cf03c-2696-4278-b98c-8b9b3bddc7fb tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:09:08.425819 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-595cf03c-2696-4278-b98c-8b9b3bddc7fb tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:09:08.426533 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-595cf03c-2696-4278-b98c-8b9b3bddc7fb tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:09:08.427023 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-595cf03c-2696-4278-b98c-8b9b3bddc7fb tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:09:08.427459 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-595cf03c-2696-4278-b98c-8b9b3bddc7fb tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:09:08.445968 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-595cf03c-2696-4278-b98c-8b9b3bddc7fb tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Getting quotas for project 26799bad802a44c18dfee33c758cbb60. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 11 00:09:08.452295 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-595cf03c-2696-4278-b98c-8b9b3bddc7fb tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Getting quotas for user 8e98a27e99564f0ca672fbc06423d9ea and project 26799bad802a44c18dfee33c758cbb60. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 11 00:09:08.466196 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-595cf03c-2696-4278-b98c-8b9b3bddc7fb tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Going to run 1 instances... {{(pid=122632) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 11 00:09:08.468619 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-595cf03c-2696-4278-b98c-8b9b3bddc7fb tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] [instance: 36a76587-6f6e-4b50-bdf5-dd44b52905dc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78ad8905-f66f-4733-8be9-2b260f1fabed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122632) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 11 00:09:08.519328 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-595cf03c-2696-4278-b98c-8b9b3bddc7fb tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.704450 Aug 11 00:09:08.520836 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3423/7054] 10.222.0.58 () {60 vars in 1147 bytes} [Thu Aug 11 00:09:07 2022] POST /compute/v2.1/servers => generated 405 bytes in 707 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 11 00:09:08.529756 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:09:08.538806 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-a4ca940e-2e97-40e3-8695-403ab06705c8 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:09:08.539766 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-a4ca940e-2e97-40e3-8695-403ab06705c8 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] [instance: 36a76587-6f6e-4b50-bdf5-dd44b52905dc] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:09:08.605839 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-a4ca940e-2e97-40e3-8695-403ab06705c8 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98a27e99564f0ca672fbc06423d9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26799bad802a44c18dfee33c758cbb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:09:08.615184 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-a4ca940e-2e97-40e3-8695-403ab06705c8 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "GET /compute/v2.1/servers/36a76587-6f6e-4b50-bdf5-dd44b52905dc" status: 200 len: 1265 microversion: 2.1 time: 0.086000 Aug 11 00:09:08.615788 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3632/7055] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:09:08 2022] GET /compute/v2.1/servers/36a76587-6f6e-4b50-bdf5-dd44b52905dc => generated 1265 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:09:09.639009 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-aead5e6d-6fb1-42af-b1f5-083bf353c0bf tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:09:09.639630 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-aead5e6d-6fb1-42af-b1f5-083bf353c0bf tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] [instance: 36a76587-6f6e-4b50-bdf5-dd44b52905dc] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:09:09.646643 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-aead5e6d-6fb1-42af-b1f5-083bf353c0bf tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:09:09.647162 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-aead5e6d-6fb1-42af-b1f5-083bf353c0bf tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:09:09.647621 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-aead5e6d-6fb1-42af-b1f5-083bf353c0bf tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:09:09.648325 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-aead5e6d-6fb1-42af-b1f5-083bf353c0bf tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:09:09.648954 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-aead5e6d-6fb1-42af-b1f5-083bf353c0bf tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:09:09.649385 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-aead5e6d-6fb1-42af-b1f5-083bf353c0bf tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:09:09.758461 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-aead5e6d-6fb1-42af-b1f5-083bf353c0bf tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98a27e99564f0ca672fbc06423d9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26799bad802a44c18dfee33c758cbb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:09:09.766516 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-aead5e6d-6fb1-42af-b1f5-083bf353c0bf tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "GET /compute/v2.1/servers/36a76587-6f6e-4b50-bdf5-dd44b52905dc" status: 200 len: 1325 microversion: 2.1 time: 0.132786 Aug 11 00:09:09.767741 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3424/7056] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:09:09 2022] GET /compute/v2.1/servers/36a76587-6f6e-4b50-bdf5-dd44b52905dc => generated 1325 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:09:10.795515 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-27919c8e-3e6b-49ab-85a5-3547f2b8e8e1 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:09:10.796805 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-27919c8e-3e6b-49ab-85a5-3547f2b8e8e1 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] [instance: 36a76587-6f6e-4b50-bdf5-dd44b52905dc] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:09:10.799626 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:09:10.806900 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-27919c8e-3e6b-49ab-85a5-3547f2b8e8e1 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:09:10.807409 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-27919c8e-3e6b-49ab-85a5-3547f2b8e8e1 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:09:10.807861 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-27919c8e-3e6b-49ab-85a5-3547f2b8e8e1 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:09:10.808575 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-27919c8e-3e6b-49ab-85a5-3547f2b8e8e1 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:09:10.809227 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-27919c8e-3e6b-49ab-85a5-3547f2b8e8e1 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:09:10.809667 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-27919c8e-3e6b-49ab-85a5-3547f2b8e8e1 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:09:10.958143 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-27919c8e-3e6b-49ab-85a5-3547f2b8e8e1 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98a27e99564f0ca672fbc06423d9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26799bad802a44c18dfee33c758cbb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:09:10.967616 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-27919c8e-3e6b-49ab-85a5-3547f2b8e8e1 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "GET /compute/v2.1/servers/36a76587-6f6e-4b50-bdf5-dd44b52905dc" status: 200 len: 1390 microversion: 2.1 time: 0.175960 Aug 11 00:09:10.968207 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3633/7057] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:09:10 2022] GET /compute/v2.1/servers/36a76587-6f6e-4b50-bdf5-dd44b52905dc => generated 1390 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:09:11.146637 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-9570e86f-6b2c-43bd-8266-e0520cb71993 req-aefc7fc7-a332-424c-8791-b81b80da6f22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36a76587-6f6e-4b50-bdf5-dd44b52905dc", "tag": "2a4641ea-9f52-43a5-99bc-74a4814c8573"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 00:09:11.158424 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-9570e86f-6b2c-43bd-8266-e0520cb71993 req-aefc7fc7-a332-424c-8791-b81b80da6f22 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:09:11.159027 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-9570e86f-6b2c-43bd-8266-e0520cb71993 req-aefc7fc7-a332-424c-8791-b81b80da6f22 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:09:11.159529 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-9570e86f-6b2c-43bd-8266-e0520cb71993 req-aefc7fc7-a332-424c-8791-b81b80da6f22 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:09:11.177065 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-9570e86f-6b2c-43bd-8266-e0520cb71993 req-aefc7fc7-a332-424c-8791-b81b80da6f22 service nova] Creating event network-changed:2a4641ea-9f52-43a5-99bc-74a4814c8573 for instance 36a76587-6f6e-4b50-bdf5-dd44b52905dc on n-h1-850468-14 Aug 11 00:09:11.185473 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-9570e86f-6b2c-43bd-8266-e0520cb71993 req-aefc7fc7-a332-424c-8791-b81b80da6f22 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042213 Aug 11 00:09:11.186564 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3425/7058] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 11 00:09:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 00:09:11.989569 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-92715275-dffb-4fa9-986b-9fb212de1dd4 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:09:11.990193 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-92715275-dffb-4fa9-986b-9fb212de1dd4 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] [instance: 36a76587-6f6e-4b50-bdf5-dd44b52905dc] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:09:11.998766 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-92715275-dffb-4fa9-986b-9fb212de1dd4 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:09:11.999391 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-92715275-dffb-4fa9-986b-9fb212de1dd4 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:09:11.999848 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-92715275-dffb-4fa9-986b-9fb212de1dd4 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:09:12.000578 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-92715275-dffb-4fa9-986b-9fb212de1dd4 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:09:12.001058 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-92715275-dffb-4fa9-986b-9fb212de1dd4 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:09:12.001671 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-92715275-dffb-4fa9-986b-9fb212de1dd4 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:09:12.148173 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-92715275-dffb-4fa9-986b-9fb212de1dd4 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98a27e99564f0ca672fbc06423d9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26799bad802a44c18dfee33c758cbb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:09:12.156504 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-92715275-dffb-4fa9-986b-9fb212de1dd4 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "GET /compute/v2.1/servers/36a76587-6f6e-4b50-bdf5-dd44b52905dc" status: 200 len: 1390 microversion: 2.1 time: 0.170750 Aug 11 00:09:12.157107 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3634/7059] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:09:11 2022] GET /compute/v2.1/servers/36a76587-6f6e-4b50-bdf5-dd44b52905dc => generated 1390 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:09:13.179269 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c8a28f08-ed5d-42da-a285-89b6d7486cbc tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:09:13.179978 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-c8a28f08-ed5d-42da-a285-89b6d7486cbc tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] [instance: 36a76587-6f6e-4b50-bdf5-dd44b52905dc] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:09:13.186098 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c8a28f08-ed5d-42da-a285-89b6d7486cbc tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:09:13.186584 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c8a28f08-ed5d-42da-a285-89b6d7486cbc tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:09:13.187082 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c8a28f08-ed5d-42da-a285-89b6d7486cbc tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:09:13.187802 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c8a28f08-ed5d-42da-a285-89b6d7486cbc tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:09:13.188257 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c8a28f08-ed5d-42da-a285-89b6d7486cbc tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:09:13.188684 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c8a28f08-ed5d-42da-a285-89b6d7486cbc tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:09:13.333767 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-c8a28f08-ed5d-42da-a285-89b6d7486cbc tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98a27e99564f0ca672fbc06423d9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26799bad802a44c18dfee33c758cbb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:09:13.341866 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-c8a28f08-ed5d-42da-a285-89b6d7486cbc tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "GET /compute/v2.1/servers/36a76587-6f6e-4b50-bdf5-dd44b52905dc" status: 200 len: 1390 microversion: 2.1 time: 0.168055 Aug 11 00:09:13.342440 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3426/7060] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:09:13 2022] GET /compute/v2.1/servers/36a76587-6f6e-4b50-bdf5-dd44b52905dc => generated 1390 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:09:14.364304 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-ff213cff-3c28-4a05-8954-e6566014d941 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:09:14.364935 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-ff213cff-3c28-4a05-8954-e6566014d941 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] [instance: 36a76587-6f6e-4b50-bdf5-dd44b52905dc] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:09:14.372226 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ff213cff-3c28-4a05-8954-e6566014d941 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:09:14.372731 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ff213cff-3c28-4a05-8954-e6566014d941 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:09:14.373191 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ff213cff-3c28-4a05-8954-e6566014d941 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:09:14.373907 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ff213cff-3c28-4a05-8954-e6566014d941 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:09:14.374383 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ff213cff-3c28-4a05-8954-e6566014d941 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:09:14.374850 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ff213cff-3c28-4a05-8954-e6566014d941 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:09:14.520665 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-ff213cff-3c28-4a05-8954-e6566014d941 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98a27e99564f0ca672fbc06423d9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26799bad802a44c18dfee33c758cbb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:09:14.529682 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-ff213cff-3c28-4a05-8954-e6566014d941 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "GET /compute/v2.1/servers/36a76587-6f6e-4b50-bdf5-dd44b52905dc" status: 200 len: 1390 microversion: 2.1 time: 0.169649 Aug 11 00:09:14.530266 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3635/7061] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:09:14 2022] GET /compute/v2.1/servers/36a76587-6f6e-4b50-bdf5-dd44b52905dc => generated 1390 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:09:15.551692 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-e0037640-0689-4fc4-a7f4-7bbc9499b8d8 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:09:15.552400 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-e0037640-0689-4fc4-a7f4-7bbc9499b8d8 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] [instance: 36a76587-6f6e-4b50-bdf5-dd44b52905dc] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:09:15.559709 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e0037640-0689-4fc4-a7f4-7bbc9499b8d8 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:09:15.560198 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e0037640-0689-4fc4-a7f4-7bbc9499b8d8 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:09:15.560635 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e0037640-0689-4fc4-a7f4-7bbc9499b8d8 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:09:15.561334 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e0037640-0689-4fc4-a7f4-7bbc9499b8d8 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:09:15.561789 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e0037640-0689-4fc4-a7f4-7bbc9499b8d8 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:09:15.562215 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e0037640-0689-4fc4-a7f4-7bbc9499b8d8 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:09:15.696279 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-e0037640-0689-4fc4-a7f4-7bbc9499b8d8 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98a27e99564f0ca672fbc06423d9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26799bad802a44c18dfee33c758cbb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:09:15.704178 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-e0037640-0689-4fc4-a7f4-7bbc9499b8d8 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "GET /compute/v2.1/servers/36a76587-6f6e-4b50-bdf5-dd44b52905dc" status: 200 len: 1390 microversion: 2.1 time: 0.156749 Aug 11 00:09:15.704757 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3427/7062] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:09:15 2022] GET /compute/v2.1/servers/36a76587-6f6e-4b50-bdf5-dd44b52905dc => generated 1390 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:09:16.726396 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-aabff8d1-a16c-4a8f-87ee-ee998471af61 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:09:16.727071 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-aabff8d1-a16c-4a8f-87ee-ee998471af61 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] [instance: 36a76587-6f6e-4b50-bdf5-dd44b52905dc] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:09:16.734400 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-aabff8d1-a16c-4a8f-87ee-ee998471af61 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:09:16.735010 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-aabff8d1-a16c-4a8f-87ee-ee998471af61 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:09:16.735471 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-aabff8d1-a16c-4a8f-87ee-ee998471af61 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:09:16.736183 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-aabff8d1-a16c-4a8f-87ee-ee998471af61 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:09:16.736687 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-aabff8d1-a16c-4a8f-87ee-ee998471af61 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:09:16.737127 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-aabff8d1-a16c-4a8f-87ee-ee998471af61 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:09:16.881204 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-aabff8d1-a16c-4a8f-87ee-ee998471af61 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98a27e99564f0ca672fbc06423d9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26799bad802a44c18dfee33c758cbb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:09:16.889268 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-aabff8d1-a16c-4a8f-87ee-ee998471af61 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "GET /compute/v2.1/servers/36a76587-6f6e-4b50-bdf5-dd44b52905dc" status: 200 len: 1390 microversion: 2.1 time: 0.167321 Aug 11 00:09:16.890066 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3636/7063] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:09:16 2022] GET /compute/v2.1/servers/36a76587-6f6e-4b50-bdf5-dd44b52905dc => generated 1390 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:09:17.018799 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-77edf4df-5290-40b0-b347-84cc7271ed4c req-19f03bca-ba83-4bfb-8cad-d75fd83f5987 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36a76587-6f6e-4b50-bdf5-dd44b52905dc", "name": "network-vif-plugged", "status": "completed", "tag": "2a4641ea-9f52-43a5-99bc-74a4814c8573"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 00:09:17.029804 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-77edf4df-5290-40b0-b347-84cc7271ed4c req-19f03bca-ba83-4bfb-8cad-d75fd83f5987 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:09:17.030286 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-77edf4df-5290-40b0-b347-84cc7271ed4c req-19f03bca-ba83-4bfb-8cad-d75fd83f5987 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:09:17.030722 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-77edf4df-5290-40b0-b347-84cc7271ed4c req-19f03bca-ba83-4bfb-8cad-d75fd83f5987 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:09:17.042164 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-77edf4df-5290-40b0-b347-84cc7271ed4c req-19f03bca-ba83-4bfb-8cad-d75fd83f5987 service nova] Creating event network-vif-plugged:2a4641ea-9f52-43a5-99bc-74a4814c8573 for instance 36a76587-6f6e-4b50-bdf5-dd44b52905dc on n-h1-850468-14 Aug 11 00:09:17.047315 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-77edf4df-5290-40b0-b347-84cc7271ed4c req-19f03bca-ba83-4bfb-8cad-d75fd83f5987 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032779 Aug 11 00:09:17.047887 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3428/7064] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 11 00:09:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 00:09:17.910985 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-51c7abe3-2eef-4876-81f6-f697d2b02a21 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:09:17.911600 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-51c7abe3-2eef-4876-81f6-f697d2b02a21 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] [instance: 36a76587-6f6e-4b50-bdf5-dd44b52905dc] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:09:17.919317 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-51c7abe3-2eef-4876-81f6-f697d2b02a21 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:09:17.919943 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-51c7abe3-2eef-4876-81f6-f697d2b02a21 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:09:17.920418 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-51c7abe3-2eef-4876-81f6-f697d2b02a21 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:09:17.921159 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-51c7abe3-2eef-4876-81f6-f697d2b02a21 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:09:17.921665 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-51c7abe3-2eef-4876-81f6-f697d2b02a21 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:09:17.922078 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-51c7abe3-2eef-4876-81f6-f697d2b02a21 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:09:18.060866 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-51c7abe3-2eef-4876-81f6-f697d2b02a21 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98a27e99564f0ca672fbc06423d9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26799bad802a44c18dfee33c758cbb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:09:18.068973 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-51c7abe3-2eef-4876-81f6-f697d2b02a21 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "GET /compute/v2.1/servers/36a76587-6f6e-4b50-bdf5-dd44b52905dc" status: 200 len: 1390 microversion: 2.1 time: 0.161932 Aug 11 00:09:18.070118 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3637/7065] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:09:17 2022] GET /compute/v2.1/servers/36a76587-6f6e-4b50-bdf5-dd44b52905dc => generated 1390 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:09:19.088994 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=2 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:09:19.089962 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=6 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:09:19.095257 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-2635106f-b79b-4446-98c1-bb1b807b22f0 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:09:19.096020 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-2635106f-b79b-4446-98c1-bb1b807b22f0 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] [instance: 36a76587-6f6e-4b50-bdf5-dd44b52905dc] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:09:19.104741 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2635106f-b79b-4446-98c1-bb1b807b22f0 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:09:19.105269 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2635106f-b79b-4446-98c1-bb1b807b22f0 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:09:19.105743 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2635106f-b79b-4446-98c1-bb1b807b22f0 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:09:19.106438 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2635106f-b79b-4446-98c1-bb1b807b22f0 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:09:19.106926 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2635106f-b79b-4446-98c1-bb1b807b22f0 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:09:19.107361 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2635106f-b79b-4446-98c1-bb1b807b22f0 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:09:19.246571 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-2635106f-b79b-4446-98c1-bb1b807b22f0 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98a27e99564f0ca672fbc06423d9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26799bad802a44c18dfee33c758cbb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:09:19.254095 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-2635106f-b79b-4446-98c1-bb1b807b22f0 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "GET /compute/v2.1/servers/36a76587-6f6e-4b50-bdf5-dd44b52905dc" status: 200 len: 1562 microversion: 2.1 time: 0.167132 Aug 11 00:09:19.254993 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3429/7066] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:09:19 2022] GET /compute/v2.1/servers/36a76587-6f6e-4b50-bdf5-dd44b52905dc => generated 1562 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:09:19.275241 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-6567696c-6199-4a53-9b63-b0290f26457f tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:09:19.275927 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-6567696c-6199-4a53-9b63-b0290f26457f tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] [instance: 36a76587-6f6e-4b50-bdf5-dd44b52905dc] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:09:19.278162 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=6 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:09:19.284449 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6567696c-6199-4a53-9b63-b0290f26457f tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:09:19.284957 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6567696c-6199-4a53-9b63-b0290f26457f tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:09:19.285416 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6567696c-6199-4a53-9b63-b0290f26457f tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:09:19.286136 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6567696c-6199-4a53-9b63-b0290f26457f tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:09:19.286611 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6567696c-6199-4a53-9b63-b0290f26457f tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:09:19.287118 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6567696c-6199-4a53-9b63-b0290f26457f tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:09:19.425076 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-6567696c-6199-4a53-9b63-b0290f26457f tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98a27e99564f0ca672fbc06423d9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26799bad802a44c18dfee33c758cbb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:09:19.433038 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-6567696c-6199-4a53-9b63-b0290f26457f tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "GET /compute/v2.1/servers/36a76587-6f6e-4b50-bdf5-dd44b52905dc" status: 200 len: 1562 microversion: 2.1 time: 0.162250 Aug 11 00:09:19.433617 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3638/7067] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:09:19 2022] GET /compute/v2.1/servers/36a76587-6f6e-4b50-bdf5-dd44b52905dc => generated 1562 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:09:21.056886 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-1d573cb0-9f38-4220-aee2-cb8ef0fb07dc tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:09:21.057554 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-1d573cb0-9f38-4220-aee2-cb8ef0fb07dc tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] [instance: 36a76587-6f6e-4b50-bdf5-dd44b52905dc] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:09:21.066045 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-948f1561-7b47-4a94-9007-7859ad309535 req-d3e8fb5c-e2e3-49e3-acb5-283499f1e6c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36a76587-6f6e-4b50-bdf5-dd44b52905dc", "tag": "2a4641ea-9f52-43a5-99bc-74a4814c8573"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 00:09:21.075424 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1d573cb0-9f38-4220-aee2-cb8ef0fb07dc tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:09:21.076019 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1d573cb0-9f38-4220-aee2-cb8ef0fb07dc tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:09:21.076511 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1d573cb0-9f38-4220-aee2-cb8ef0fb07dc tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:09:21.077182 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-948f1561-7b47-4a94-9007-7859ad309535 req-d3e8fb5c-e2e3-49e3-acb5-283499f1e6c8 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:09:21.077309 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1d573cb0-9f38-4220-aee2-cb8ef0fb07dc tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:09:21.077676 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-948f1561-7b47-4a94-9007-7859ad309535 req-d3e8fb5c-e2e3-49e3-acb5-283499f1e6c8 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:09:21.077790 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1d573cb0-9f38-4220-aee2-cb8ef0fb07dc tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:09:21.078106 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1d573cb0-9f38-4220-aee2-cb8ef0fb07dc tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:09:21.078229 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-948f1561-7b47-4a94-9007-7859ad309535 req-d3e8fb5c-e2e3-49e3-acb5-283499f1e6c8 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:09:21.096522 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-948f1561-7b47-4a94-9007-7859ad309535 req-d3e8fb5c-e2e3-49e3-acb5-283499f1e6c8 service nova] Creating event network-changed:2a4641ea-9f52-43a5-99bc-74a4814c8573 for instance 36a76587-6f6e-4b50-bdf5-dd44b52905dc on n-h1-850468-14 Aug 11 00:09:21.103164 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-948f1561-7b47-4a94-9007-7859ad309535 req-d3e8fb5c-e2e3-49e3-acb5-283499f1e6c8 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040231 Aug 11 00:09:21.103976 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3639/7068] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 11 00:09:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 00:09:21.321635 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-1d573cb0-9f38-4220-aee2-cb8ef0fb07dc tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98a27e99564f0ca672fbc06423d9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26799bad802a44c18dfee33c758cbb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:09:21.331163 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-1d573cb0-9f38-4220-aee2-cb8ef0fb07dc tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "GET /compute/v2.1/servers/36a76587-6f6e-4b50-bdf5-dd44b52905dc" status: 200 len: 1562 microversion: 2.1 time: 0.278817 Aug 11 00:09:21.332110 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3430/7069] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:09:21 2022] GET /compute/v2.1/servers/36a76587-6f6e-4b50-bdf5-dd44b52905dc => generated 1562 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:09:44.589407 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-6b716e81-dba0-4ab8-b4d7-e4f1df97da39 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 00:09:44.591757 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-6b716e81-dba0-4ab8-b4d7-e4f1df97da39 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] [instance: 36a76587-6f6e-4b50-bdf5-dd44b52905dc] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:09:44.594170 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_api:SELECT=13 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:09:44.594882 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=38 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:09:44.601643 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6b716e81-dba0-4ab8-b4d7-e4f1df97da39 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:09:44.602148 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6b716e81-dba0-4ab8-b4d7-e4f1df97da39 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:09:44.602606 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6b716e81-dba0-4ab8-b4d7-e4f1df97da39 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:09:44.603360 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6b716e81-dba0-4ab8-b4d7-e4f1df97da39 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:09:44.603831 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6b716e81-dba0-4ab8-b4d7-e4f1df97da39 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:09:44.604274 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6b716e81-dba0-4ab8-b4d7-e4f1df97da39 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:09:44.657639 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-6b716e81-dba0-4ab8-b4d7-e4f1df97da39 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "POST /compute/v2.1/servers/36a76587-6f6e-4b50-bdf5-dd44b52905dc/action" status: 200 len: 24569 microversion: 2.1 time: 0.073416 Aug 11 00:09:44.658387 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3640/7070] 10.222.0.58 () {60 vars in 1278 bytes} [Thu Aug 11 00:09:44 2022] POST /compute/v2.1/servers/36a76587-6f6e-4b50-bdf5-dd44b52905dc/action => generated 24569 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 00:09:55.722593 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-af535223-6807-42e6-87a4-2ce297afb8dc tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 00:09:55.723197 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-af535223-6807-42e6-87a4-2ce297afb8dc tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] [instance: 36a76587-6f6e-4b50-bdf5-dd44b52905dc] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:09:55.725239 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:09:55.725902 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=36 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:09:55.732103 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-af535223-6807-42e6-87a4-2ce297afb8dc tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:09:55.732588 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-af535223-6807-42e6-87a4-2ce297afb8dc tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:09:55.733028 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-af535223-6807-42e6-87a4-2ce297afb8dc tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:09:55.733726 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-af535223-6807-42e6-87a4-2ce297afb8dc tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:09:55.734181 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-af535223-6807-42e6-87a4-2ce297afb8dc tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:09:55.734608 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-af535223-6807-42e6-87a4-2ce297afb8dc tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:09:55.802198 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-af535223-6807-42e6-87a4-2ce297afb8dc tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "POST /compute/v2.1/servers/36a76587-6f6e-4b50-bdf5-dd44b52905dc/action" status: 202 len: 0 microversion: 2.1 time: 0.083677 Aug 11 00:09:55.802865 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3431/7071] 10.222.0.58 () {60 vars in 1278 bytes} [Thu Aug 11 00:09:55 2022] POST /compute/v2.1/servers/36a76587-6f6e-4b50-bdf5-dd44b52905dc/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 11 00:09:55.812460 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-22d25b55-1634-4acc-8f55-282f97cde915 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:09:55.813187 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-22d25b55-1634-4acc-8f55-282f97cde915 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] [instance: 36a76587-6f6e-4b50-bdf5-dd44b52905dc] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:09:55.816320 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_api:SELECT=2 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:09:55.817114 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=4 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:09:55.824829 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-22d25b55-1634-4acc-8f55-282f97cde915 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:09:55.825335 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-22d25b55-1634-4acc-8f55-282f97cde915 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:09:55.825806 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-22d25b55-1634-4acc-8f55-282f97cde915 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:09:55.826578 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-22d25b55-1634-4acc-8f55-282f97cde915 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:09:55.827088 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-22d25b55-1634-4acc-8f55-282f97cde915 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:09:55.827534 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-22d25b55-1634-4acc-8f55-282f97cde915 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:09:55.973586 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-22d25b55-1634-4acc-8f55-282f97cde915 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98a27e99564f0ca672fbc06423d9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26799bad802a44c18dfee33c758cbb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:09:55.982324 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-22d25b55-1634-4acc-8f55-282f97cde915 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "GET /compute/v2.1/servers/36a76587-6f6e-4b50-bdf5-dd44b52905dc" status: 200 len: 1685 microversion: 2.1 time: 0.174080 Aug 11 00:09:55.982954 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3641/7072] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:09:55 2022] GET /compute/v2.1/servers/36a76587-6f6e-4b50-bdf5-dd44b52905dc => generated 1685 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:09:57.006213 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-d8555815-37f5-4e66-bb98-ee50d3edc8d4 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:09:57.006956 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-d8555815-37f5-4e66-bb98-ee50d3edc8d4 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] [instance: 36a76587-6f6e-4b50-bdf5-dd44b52905dc] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:09:57.013239 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d8555815-37f5-4e66-bb98-ee50d3edc8d4 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:09:57.013722 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d8555815-37f5-4e66-bb98-ee50d3edc8d4 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:09:57.014159 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d8555815-37f5-4e66-bb98-ee50d3edc8d4 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:09:57.014875 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d8555815-37f5-4e66-bb98-ee50d3edc8d4 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:09:57.015331 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d8555815-37f5-4e66-bb98-ee50d3edc8d4 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:09:57.015758 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d8555815-37f5-4e66-bb98-ee50d3edc8d4 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:09:57.153572 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-d8555815-37f5-4e66-bb98-ee50d3edc8d4 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98a27e99564f0ca672fbc06423d9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26799bad802a44c18dfee33c758cbb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:09:57.161122 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-d8555815-37f5-4e66-bb98-ee50d3edc8d4 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "GET /compute/v2.1/servers/36a76587-6f6e-4b50-bdf5-dd44b52905dc" status: 200 len: 1665 microversion: 2.1 time: 0.160445 Aug 11 00:09:57.162107 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3432/7073] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:09:56 2022] GET /compute/v2.1/servers/36a76587-6f6e-4b50-bdf5-dd44b52905dc => generated 1665 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:09:58.258935 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-7fae7b91-67fb-4b41-9dcf-c812341e6dbb tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 00:09:58.261196 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-7fae7b91-67fb-4b41-9dcf-c812341e6dbb tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] [instance: 36a76587-6f6e-4b50-bdf5-dd44b52905dc] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:09:58.268999 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7fae7b91-67fb-4b41-9dcf-c812341e6dbb tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:09:58.269503 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7fae7b91-67fb-4b41-9dcf-c812341e6dbb tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:09:58.269962 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7fae7b91-67fb-4b41-9dcf-c812341e6dbb tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:09:58.270681 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7fae7b91-67fb-4b41-9dcf-c812341e6dbb tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:09:58.271180 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7fae7b91-67fb-4b41-9dcf-c812341e6dbb tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:09:58.271628 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7fae7b91-67fb-4b41-9dcf-c812341e6dbb tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:09:58.325664 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-7fae7b91-67fb-4b41-9dcf-c812341e6dbb tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "POST /compute/v2.1/servers/36a76587-6f6e-4b50-bdf5-dd44b52905dc/action" status: 200 len: 32639 microversion: 2.1 time: 0.071065 Aug 11 00:09:58.326563 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3642/7074] 10.222.0.58 () {60 vars in 1278 bytes} [Thu Aug 11 00:09:58 2022] POST /compute/v2.1/servers/36a76587-6f6e-4b50-bdf5-dd44b52905dc/action => generated 32639 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 00:09:58.337924 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-4b2f00f6-3274-4b6b-9ac2-f9d25b4c3495 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 00:09:58.338460 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-4b2f00f6-3274-4b6b-9ac2-f9d25b4c3495 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] [instance: 36a76587-6f6e-4b50-bdf5-dd44b52905dc] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:09:58.345309 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4b2f00f6-3274-4b6b-9ac2-f9d25b4c3495 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:09:58.345794 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4b2f00f6-3274-4b6b-9ac2-f9d25b4c3495 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:09:58.346236 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4b2f00f6-3274-4b6b-9ac2-f9d25b4c3495 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:09:58.346967 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4b2f00f6-3274-4b6b-9ac2-f9d25b4c3495 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:09:58.347424 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4b2f00f6-3274-4b6b-9ac2-f9d25b4c3495 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:09:58.347851 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4b2f00f6-3274-4b6b-9ac2-f9d25b4c3495 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:09:58.416152 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-4b2f00f6-3274-4b6b-9ac2-f9d25b4c3495 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "POST /compute/v2.1/servers/36a76587-6f6e-4b50-bdf5-dd44b52905dc/action" status: 202 len: 0 microversion: 2.1 time: 0.081924 Aug 11 00:09:58.416958 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3433/7075] 10.222.0.58 () {60 vars in 1278 bytes} [Thu Aug 11 00:09:58 2022] POST /compute/v2.1/servers/36a76587-6f6e-4b50-bdf5-dd44b52905dc/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 11 00:09:58.425843 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-041b4d32-fcbb-4b7b-abb6-38e0adf6115e tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:09:58.426557 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-041b4d32-fcbb-4b7b-abb6-38e0adf6115e tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] [instance: 36a76587-6f6e-4b50-bdf5-dd44b52905dc] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:09:58.435247 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-041b4d32-fcbb-4b7b-abb6-38e0adf6115e tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:09:58.435872 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-041b4d32-fcbb-4b7b-abb6-38e0adf6115e tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:09:58.436435 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-041b4d32-fcbb-4b7b-abb6-38e0adf6115e tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:09:58.437777 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-041b4d32-fcbb-4b7b-abb6-38e0adf6115e tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:09:58.438259 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-041b4d32-fcbb-4b7b-abb6-38e0adf6115e tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:09:58.438894 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-041b4d32-fcbb-4b7b-abb6-38e0adf6115e tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:09:58.586080 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-041b4d32-fcbb-4b7b-abb6-38e0adf6115e tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98a27e99564f0ca672fbc06423d9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26799bad802a44c18dfee33c758cbb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:09:58.594593 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-041b4d32-fcbb-4b7b-abb6-38e0adf6115e tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "GET /compute/v2.1/servers/36a76587-6f6e-4b50-bdf5-dd44b52905dc" status: 200 len: 1672 microversion: 2.1 time: 0.172869 Aug 11 00:09:58.595388 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3643/7076] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:09:58 2022] GET /compute/v2.1/servers/36a76587-6f6e-4b50-bdf5-dd44b52905dc => generated 1672 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:09:59.618062 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-9b16028d-9fec-4163-a3ba-baab61cb59a5 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:09:59.619711 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-9b16028d-9fec-4163-a3ba-baab61cb59a5 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] [instance: 36a76587-6f6e-4b50-bdf5-dd44b52905dc] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:09:59.626546 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9b16028d-9fec-4163-a3ba-baab61cb59a5 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:09:59.627068 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9b16028d-9fec-4163-a3ba-baab61cb59a5 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:09:59.627514 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9b16028d-9fec-4163-a3ba-baab61cb59a5 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:09:59.628211 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9b16028d-9fec-4163-a3ba-baab61cb59a5 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:09:59.628667 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9b16028d-9fec-4163-a3ba-baab61cb59a5 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:09:59.629097 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9b16028d-9fec-4163-a3ba-baab61cb59a5 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:09:59.763222 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-9b16028d-9fec-4163-a3ba-baab61cb59a5 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98a27e99564f0ca672fbc06423d9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26799bad802a44c18dfee33c758cbb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:09:59.770862 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-9b16028d-9fec-4163-a3ba-baab61cb59a5 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "GET /compute/v2.1/servers/36a76587-6f6e-4b50-bdf5-dd44b52905dc" status: 200 len: 1680 microversion: 2.1 time: 0.156922 Aug 11 00:09:59.771330 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3434/7077] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:09:59 2022] GET /compute/v2.1/servers/36a76587-6f6e-4b50-bdf5-dd44b52905dc => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:09:59.869146 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-d0d60f98-97ae-4914-9122-ee9a9afabd96 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 00:09:59.871400 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-d0d60f98-97ae-4914-9122-ee9a9afabd96 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] [instance: 36a76587-6f6e-4b50-bdf5-dd44b52905dc] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:09:59.880273 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d0d60f98-97ae-4914-9122-ee9a9afabd96 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:09:59.880864 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d0d60f98-97ae-4914-9122-ee9a9afabd96 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:09:59.881476 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d0d60f98-97ae-4914-9122-ee9a9afabd96 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:09:59.882406 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d0d60f98-97ae-4914-9122-ee9a9afabd96 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:09:59.883097 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d0d60f98-97ae-4914-9122-ee9a9afabd96 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:09:59.883548 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d0d60f98-97ae-4914-9122-ee9a9afabd96 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:09:59.936791 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-d0d60f98-97ae-4914-9122-ee9a9afabd96 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "POST /compute/v2.1/servers/36a76587-6f6e-4b50-bdf5-dd44b52905dc/action" status: 200 len: 38396 microversion: 2.1 time: 0.072160 Aug 11 00:09:59.937617 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3644/7078] 10.222.0.58 () {60 vars in 1278 bytes} [Thu Aug 11 00:09:59 2022] POST /compute/v2.1/servers/36a76587-6f6e-4b50-bdf5-dd44b52905dc/action => generated 38396 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 00:10:00.930018 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-6c54093d-1d5a-47c1-8179-e8fa6e2d40e0 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:10:00.930597 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-6c54093d-1d5a-47c1-8179-e8fa6e2d40e0 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] [instance: 36a76587-6f6e-4b50-bdf5-dd44b52905dc] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:10:00.932319 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-7dd28471-3a8c-4494-917e-257ccea6e002 req-dbb5f86e-d008-40ff-8442-0de519a7b285 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36a76587-6f6e-4b50-bdf5-dd44b52905dc", "tag": "2a4641ea-9f52-43a5-99bc-74a4814c8573"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 00:10:00.938292 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6c54093d-1d5a-47c1-8179-e8fa6e2d40e0 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:10:00.939491 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6c54093d-1d5a-47c1-8179-e8fa6e2d40e0 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:10:00.940148 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6c54093d-1d5a-47c1-8179-e8fa6e2d40e0 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:10:00.940920 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6c54093d-1d5a-47c1-8179-e8fa6e2d40e0 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:10:00.941391 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6c54093d-1d5a-47c1-8179-e8fa6e2d40e0 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:10:00.941826 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6c54093d-1d5a-47c1-8179-e8fa6e2d40e0 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:10:00.944314 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-7dd28471-3a8c-4494-917e-257ccea6e002 req-dbb5f86e-d008-40ff-8442-0de519a7b285 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:10:00.944931 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-7dd28471-3a8c-4494-917e-257ccea6e002 req-dbb5f86e-d008-40ff-8442-0de519a7b285 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:10:00.945690 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-7dd28471-3a8c-4494-917e-257ccea6e002 req-dbb5f86e-d008-40ff-8442-0de519a7b285 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:10:00.957459 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-7dd28471-3a8c-4494-917e-257ccea6e002 req-dbb5f86e-d008-40ff-8442-0de519a7b285 service nova] Creating event network-changed:2a4641ea-9f52-43a5-99bc-74a4814c8573 for instance 36a76587-6f6e-4b50-bdf5-dd44b52905dc on n-h1-850468-14 Aug 11 00:10:00.964061 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-7dd28471-3a8c-4494-917e-257ccea6e002 req-dbb5f86e-d008-40ff-8442-0de519a7b285 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036057 Aug 11 00:10:00.964777 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3645/7079] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 11 00:10:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 11 00:10:00.971026 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-6c54093d-1d5a-47c1-8179-e8fa6e2d40e0 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] [instance: 36a76587-6f6e-4b50-bdf5-dd44b52905dc] Going to try to terminate instance {{(pid=122632) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 11 00:10:01.069091 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-6c54093d-1d5a-47c1-8179-e8fa6e2d40e0 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "DELETE /compute/v2.1/servers/36a76587-6f6e-4b50-bdf5-dd44b52905dc" status: 204 len: 0 microversion: 2.1 time: 0.143220 Aug 11 00:10:01.070023 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3435/7080] 10.222.0.58 () {58 vars in 1239 bytes} [Thu Aug 11 00:10:00 2022] DELETE /compute/v2.1/servers/36a76587-6f6e-4b50-bdf5-dd44b52905dc => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 11 00:10:01.080793 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-bd803f71-42f3-44fe-8426-11b18468acef tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:10:01.082182 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-bd803f71-42f3-44fe-8426-11b18468acef tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] [instance: 36a76587-6f6e-4b50-bdf5-dd44b52905dc] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:10:01.092239 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bd803f71-42f3-44fe-8426-11b18468acef tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:10:01.092684 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bd803f71-42f3-44fe-8426-11b18468acef tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:10:01.093609 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bd803f71-42f3-44fe-8426-11b18468acef tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:10:01.095393 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bd803f71-42f3-44fe-8426-11b18468acef tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:10:01.095393 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bd803f71-42f3-44fe-8426-11b18468acef tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:10:01.095393 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bd803f71-42f3-44fe-8426-11b18468acef tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:10:01.238274 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-bd803f71-42f3-44fe-8426-11b18468acef tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98a27e99564f0ca672fbc06423d9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26799bad802a44c18dfee33c758cbb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:10:01.246319 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-bd803f71-42f3-44fe-8426-11b18468acef tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "GET /compute/v2.1/servers/36a76587-6f6e-4b50-bdf5-dd44b52905dc" status: 200 len: 1686 microversion: 2.1 time: 0.170225 Aug 11 00:10:01.246925 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3646/7081] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:10:01 2022] GET /compute/v2.1/servers/36a76587-6f6e-4b50-bdf5-dd44b52905dc => generated 1686 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:10:02.269625 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-54801b1b-32ac-4dfa-ab74-1e9cf8ba512f tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:10:02.270252 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-54801b1b-32ac-4dfa-ab74-1e9cf8ba512f tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] [instance: 36a76587-6f6e-4b50-bdf5-dd44b52905dc] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:10:02.277829 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-54801b1b-32ac-4dfa-ab74-1e9cf8ba512f tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:10:02.278318 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-54801b1b-32ac-4dfa-ab74-1e9cf8ba512f tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:10:02.278767 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-54801b1b-32ac-4dfa-ab74-1e9cf8ba512f tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:10:02.279494 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-54801b1b-32ac-4dfa-ab74-1e9cf8ba512f tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:10:02.279955 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-54801b1b-32ac-4dfa-ab74-1e9cf8ba512f tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:10:02.280385 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-54801b1b-32ac-4dfa-ab74-1e9cf8ba512f tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:10:02.571235 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-54801b1b-32ac-4dfa-ab74-1e9cf8ba512f tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98a27e99564f0ca672fbc06423d9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26799bad802a44c18dfee33c758cbb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:10:02.579187 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-54801b1b-32ac-4dfa-ab74-1e9cf8ba512f tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "GET /compute/v2.1/servers/36a76587-6f6e-4b50-bdf5-dd44b52905dc" status: 200 len: 1686 microversion: 2.1 time: 0.314010 Aug 11 00:10:02.579775 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3436/7082] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:10:02 2022] GET /compute/v2.1/servers/36a76587-6f6e-4b50-bdf5-dd44b52905dc => generated 1686 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:10:03.087075 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-af5b3c65-aa43-4a51-bda9-f120b8bfffba req-a242826c-f296-4d83-810a-768f80c70906 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36a76587-6f6e-4b50-bdf5-dd44b52905dc", "name": "network-vif-deleted", "tag": "2a4641ea-9f52-43a5-99bc-74a4814c8573"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 00:10:03.100344 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-af5b3c65-aa43-4a51-bda9-f120b8bfffba req-a242826c-f296-4d83-810a-768f80c70906 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:10:03.100842 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-af5b3c65-aa43-4a51-bda9-f120b8bfffba req-a242826c-f296-4d83-810a-768f80c70906 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:10:03.101295 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-af5b3c65-aa43-4a51-bda9-f120b8bfffba req-a242826c-f296-4d83-810a-768f80c70906 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:10:03.114154 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-af5b3c65-aa43-4a51-bda9-f120b8bfffba req-a242826c-f296-4d83-810a-768f80c70906 service nova] Creating event network-vif-deleted:2a4641ea-9f52-43a5-99bc-74a4814c8573 for instance 36a76587-6f6e-4b50-bdf5-dd44b52905dc on n-h1-850468-14 Aug 11 00:10:03.120486 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-af5b3c65-aa43-4a51-bda9-f120b8bfffba req-a242826c-f296-4d83-810a-768f80c70906 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037252 Aug 11 00:10:03.121431 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3647/7083] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 11 00:10:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 00:10:03.601359 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-56b0c33c-27f5-422a-a184-43717ec614cd tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:10:03.601898 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-56b0c33c-27f5-422a-a184-43717ec614cd tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] [instance: 36a76587-6f6e-4b50-bdf5-dd44b52905dc] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:10:03.609189 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-56b0c33c-27f5-422a-a184-43717ec614cd tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:10:03.609673 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-56b0c33c-27f5-422a-a184-43717ec614cd tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:10:03.610107 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-56b0c33c-27f5-422a-a184-43717ec614cd tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:10:03.610818 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-56b0c33c-27f5-422a-a184-43717ec614cd tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:10:03.611277 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-56b0c33c-27f5-422a-a184-43717ec614cd tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:10:03.611696 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-56b0c33c-27f5-422a-a184-43717ec614cd tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:10:03.625453 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-56b0c33c-27f5-422a-a184-43717ec614cd tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] HTTP exception thrown: Instance 36a76587-6f6e-4b50-bdf5-dd44b52905dc could not be found. Aug 11 00:10:03.627145 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-56b0c33c-27f5-422a-a184-43717ec614cd tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Request method failure captured: Aug 11 00:10:03.627145 n-d-850468-14 devstack@n-api.service[122632]: request: GET /compute/v2.1/servers/36a76587-6f6e-4b50-bdf5-dd44b52905dc HTTP/1.1 Aug 11 00:10:03.627145 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 11 00:10:03.627145 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 11 00:10:03.627145 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 11 00:10:03.627145 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 11 00:10:03.627145 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 11 00:10:03.627145 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 11 00:10:03.627145 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 11 00:10:03.627145 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 11 00:10:03.627145 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9Eicgn9rrdRuvAzeJtJZ7G3bC_nDgFR3SCpmMvM-oSUDIishF0KIrgIe24vn-zIDWQFTlnHZqZzmBW04xZWO5xjxS0bhWpiqJFEiDbQjnCF5CEqW_Qy1Z8Dx6EdfjYFAs6IHw9dtZURRdVWG0taseoTltbZtc3U4Z0kNtdabyg0lDPw Aug 11 00:10:03.627145 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 11 00:10:03.627145 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 11 00:10:03.627145 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 11 00:10:03.627145 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 11 00:10:03.627145 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 11 00:10:03.627145 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 11 00:10:03.627145 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 26799bad802a44c18dfee33c758cbb60 Aug 11 00:10:03.627145 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-458446174 Aug 11 00:10:03.627145 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 11 00:10:03.627145 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 11 00:10:03.627145 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/26799bad802a44c18dfee33c758cbb60"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/26799bad802a44c18dfee33c758cbb60"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/26799bad802a44c18dfee33c758cbb60"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_26799bad802a44c18dfee33c758cbb60", "adminURL": "http://10.222.0.58:8080"}]}] Aug 11 00:10:03.627145 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-TestNetworkAdvancedServerOps-458446174 Aug 11 00:10:03.627145 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 26799bad802a44c18dfee33c758cbb60 Aug 11 00:10:03.627145 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-458446174 Aug 11 00:10:03.627145 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-TestNetworkAdvancedServerOps-458446174-project Aug 11 00:10:03.627145 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 11 00:10:03.627145 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 11 00:10:03.627145 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: 8e98a27e99564f0ca672fbc06423d9ea Aug 11 00:10:03.627145 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-TestNetworkAdvancedServerOps-458446174-project Aug 11 00:10:03.627145 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 11 00:10:03.627145 n-d-850468-14 devstack@n-api.service[122632]: exception: Instance 36a76587-6f6e-4b50-bdf5-dd44b52905dc could not be found. Aug 11 00:10:03.627145 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': '36a76587-6f6e-4b50-bdf5-dd44b52905dc'} Aug 11 00:10:03.627145 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 00:10:03.627145 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 00:10:03.627145 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 11 00:10:03.627145 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 11 00:10:03.627145 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 11 00:10:03.627145 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 11 00:10:03.627145 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 11 00:10:03.627145 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 11 00:10:03.627145 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 11 00:10:03.627145 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 11 00:10:03.627145 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36a76587-6f6e-4b50-bdf5-dd44b52905dc could not be found. Aug 11 00:10:03.627145 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 11 00:10:03.627145 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 00:10:03.627145 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 11 00:10:03.627145 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 00:10:03.627145 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 00:10:03.627145 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 00:10:03.627145 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 00:10:03.627145 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 00:10:03.627145 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 00:10:03.627145 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 00:10:03.627145 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 11 00:10:03.627145 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 11 00:10:03.627145 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 11 00:10:03.627145 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 11 00:10:03.627145 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 11 00:10:03.627145 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 11 00:10:03.627145 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36a76587-6f6e-4b50-bdf5-dd44b52905dc could not be found. Aug 11 00:10:03.627145 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 11 00:10:03.627145 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 00:10:03.632226 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 11 00:10:03.632226 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 00:10:03.632226 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 00:10:03.632226 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 00:10:03.632226 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 00:10:03.632226 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 00:10:03.632226 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36a76587-6f6e-4b50-bdf5-dd44b52905dc could not be found. Aug 11 00:10:03.632226 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 11 00:10:03.632226 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-56b0c33c-27f5-422a-a184-43717ec614cd tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Returning 404 to user: Instance 36a76587-6f6e-4b50-bdf5-dd44b52905dc could not be found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 00:10:03.632226 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-56b0c33c-27f5-422a-a184-43717ec614cd tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "GET /compute/v2.1/servers/36a76587-6f6e-4b50-bdf5-dd44b52905dc" status: 404 len: 111 microversion: 2.1 time: 0.031264 Aug 11 00:10:03.632226 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3437/7084] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:10:03 2022] GET /compute/v2.1/servers/36a76587-6f6e-4b50-bdf5-dd44b52905dc => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 11 00:10:07.122259 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-ebfc1fb2-cca0-4e44-865e-17eb07baeca8 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Calling method '.version_select at 0x7f847d3869d0>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:10:07.145407 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-ebfc1fb2-cca0-4e44-865e-17eb07baeca8 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-12104298" status: 202 len: 0 microversion: 2.1 time: 0.028403 Aug 11 00:10:07.146545 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3648/7085] 10.222.0.58 () {58 vars in 1278 bytes} [Thu Aug 11 00:10:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-12104298 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 11 00:10:07.175684 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-1f83bd4b-46b1-4448-81c2-cad3e045d68a tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Action: 'create', calling method: .version_select at 0x7f847d67c280>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1731526343", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMai80l+uBzeZvRIbichtl3hVsSwfdT1P/8/sHnZtq/6AND+nNr8YEWgw2N6R9GB9yVwXl9xYN0HyCgIqK9M7Us2tZc/5tTYsHYNB60p+faDsBNRppBhkFZe8cjm2p3y7Q=="}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 00:10:07.194754 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-1f83bd4b-46b1-4448-81c2-cad3e045d68a tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Getting quotas for project 26799bad802a44c18dfee33c758cbb60. Resources: {'key_pairs'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 11 00:10:07.200402 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-1f83bd4b-46b1-4448-81c2-cad3e045d68a tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Getting quotas for user 8e98a27e99564f0ca672fbc06423d9ea and project 26799bad802a44c18dfee33c758cbb60. Resources: {'key_pairs'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 11 00:10:07.227130 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-1f83bd4b-46b1-4448-81c2-cad3e045d68a tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.055936 Aug 11 00:10:07.228457 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3438/7086] 10.222.0.58 () {60 vars in 1159 bytes} [Thu Aug 11 00:10:07 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 00:10:12.924189 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-954d7758-083d-4cff-b7e8-19b9a6396abb tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-966510266", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452", "networks": [{"uuid": "243e8f5d-c88a-4191-b086-d711bd8b3471"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1731526343", "security_groups": [{"name": "tempest-secgroup-smoke-1767008465"}]}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 00:10:13.106317 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=30 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:10:13.157765 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.network.neutron [None req-954d7758-083d-4cff-b7e8-19b9a6396abb tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] validate_networks() for [('243e8f5d-c88a-4191-b086-d711bd8b3471', None, None, None, None, None)] {{(pid=122633) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 11 00:10:13.608928 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-954d7758-083d-4cff-b7e8-19b9a6396abb tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Flavor limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 11 00:10:13.609926 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-954d7758-083d-4cff-b7e8-19b9a6396abb tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Image limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 11 00:10:13.611143 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-954d7758-083d-4cff-b7e8-19b9a6396abb tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Flavor pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 11 00:10:13.613106 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-954d7758-083d-4cff-b7e8-19b9a6396abb tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Image pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 11 00:10:13.614899 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-954d7758-083d-4cff-b7e8-19b9a6396abb tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 11 00:10:13.626381 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-954d7758-083d-4cff-b7e8-19b9a6396abb tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:10:13.627431 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-954d7758-083d-4cff-b7e8-19b9a6396abb tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:10:13.628053 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-954d7758-083d-4cff-b7e8-19b9a6396abb tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:10:13.629016 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-954d7758-083d-4cff-b7e8-19b9a6396abb tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:10:13.629487 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-954d7758-083d-4cff-b7e8-19b9a6396abb tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:10:13.629931 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-954d7758-083d-4cff-b7e8-19b9a6396abb tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:10:13.654041 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-954d7758-083d-4cff-b7e8-19b9a6396abb tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Getting quotas for project 26799bad802a44c18dfee33c758cbb60. Resources: {'instances', 'cores', 'ram'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 11 00:10:13.662861 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-954d7758-083d-4cff-b7e8-19b9a6396abb tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Getting quotas for user 8e98a27e99564f0ca672fbc06423d9ea and project 26799bad802a44c18dfee33c758cbb60. Resources: {'instances', 'cores', 'ram'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 11 00:10:13.678490 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-954d7758-083d-4cff-b7e8-19b9a6396abb tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Going to run 1 instances... {{(pid=122633) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 11 00:10:13.681851 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-954d7758-083d-4cff-b7e8-19b9a6396abb tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] [instance: e4bde2fb-897f-4e91-bd2f-a3f036b4ef2b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78ad8905-f66f-4733-8be9-2b260f1fabed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122633) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 11 00:10:13.733303 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-954d7758-083d-4cff-b7e8-19b9a6396abb tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.813231 Aug 11 00:10:13.733969 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3649/7087] 10.222.0.58 () {60 vars in 1147 bytes} [Thu Aug 11 00:10:12 2022] POST /compute/v2.1/servers => generated 406 bytes in 815 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 11 00:10:13.746393 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-a2f743b4-2f6b-470a-a204-8930d4575f80 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:10:13.747246 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-a2f743b4-2f6b-470a-a204-8930d4575f80 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] [instance: e4bde2fb-897f-4e91-bd2f-a3f036b4ef2b] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:10:13.750280 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:10:13.836284 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-a2f743b4-2f6b-470a-a204-8930d4575f80 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98a27e99564f0ca672fbc06423d9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26799bad802a44c18dfee33c758cbb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:10:13.844624 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-a2f743b4-2f6b-470a-a204-8930d4575f80 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "GET /compute/v2.1/servers/e4bde2fb-897f-4e91-bd2f-a3f036b4ef2b" status: 200 len: 1266 microversion: 2.1 time: 0.102899 Aug 11 00:10:13.859288 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3439/7088] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:10:13 2022] GET /compute/v2.1/servers/e4bde2fb-897f-4e91-bd2f-a3f036b4ef2b => generated 1266 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:10:14.869568 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-0301c381-b81d-4294-bc46-091f0ff03167 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:10:14.870852 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-0301c381-b81d-4294-bc46-091f0ff03167 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] [instance: e4bde2fb-897f-4e91-bd2f-a3f036b4ef2b] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:10:14.878184 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0301c381-b81d-4294-bc46-091f0ff03167 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:10:14.879042 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0301c381-b81d-4294-bc46-091f0ff03167 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:10:14.879629 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0301c381-b81d-4294-bc46-091f0ff03167 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:10:14.882191 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0301c381-b81d-4294-bc46-091f0ff03167 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:10:14.882854 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0301c381-b81d-4294-bc46-091f0ff03167 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:10:14.884732 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0301c381-b81d-4294-bc46-091f0ff03167 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:10:14.974507 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-0301c381-b81d-4294-bc46-091f0ff03167 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98a27e99564f0ca672fbc06423d9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26799bad802a44c18dfee33c758cbb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:10:14.984715 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-0301c381-b81d-4294-bc46-091f0ff03167 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "GET /compute/v2.1/servers/e4bde2fb-897f-4e91-bd2f-a3f036b4ef2b" status: 200 len: 1318 microversion: 2.1 time: 0.121776 Aug 11 00:10:14.985885 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3650/7089] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:10:14 2022] GET /compute/v2.1/servers/e4bde2fb-897f-4e91-bd2f-a3f036b4ef2b => generated 1318 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:10:16.007312 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c048edcb-1241-4cb7-a4dd-a7af6eb72f88 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:10:16.011262 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-c048edcb-1241-4cb7-a4dd-a7af6eb72f88 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] [instance: e4bde2fb-897f-4e91-bd2f-a3f036b4ef2b] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:10:16.024077 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c048edcb-1241-4cb7-a4dd-a7af6eb72f88 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:10:16.024857 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c048edcb-1241-4cb7-a4dd-a7af6eb72f88 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:10:16.025316 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c048edcb-1241-4cb7-a4dd-a7af6eb72f88 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:10:16.026053 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c048edcb-1241-4cb7-a4dd-a7af6eb72f88 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:10:16.026518 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c048edcb-1241-4cb7-a4dd-a7af6eb72f88 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:10:16.026985 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c048edcb-1241-4cb7-a4dd-a7af6eb72f88 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:10:16.648253 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-c048edcb-1241-4cb7-a4dd-a7af6eb72f88 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98a27e99564f0ca672fbc06423d9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26799bad802a44c18dfee33c758cbb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:10:16.659153 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-c048edcb-1241-4cb7-a4dd-a7af6eb72f88 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "GET /compute/v2.1/servers/e4bde2fb-897f-4e91-bd2f-a3f036b4ef2b" status: 200 len: 1392 microversion: 2.1 time: 0.655973 Aug 11 00:10:16.662750 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3440/7090] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:10:16 2022] GET /compute/v2.1/servers/e4bde2fb-897f-4e91-bd2f-a3f036b4ef2b => generated 1392 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:10:16.983777 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-a309dc04-566b-4340-b475-03a92475e5c8 req-174b67da-e249-42bd-a104-912fef4f3912 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4bde2fb-897f-4e91-bd2f-a3f036b4ef2b", "tag": "02b89fca-2f4b-4793-8985-22654af96a35"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 00:10:16.995893 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-a309dc04-566b-4340-b475-03a92475e5c8 req-174b67da-e249-42bd-a104-912fef4f3912 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:10:16.996726 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-a309dc04-566b-4340-b475-03a92475e5c8 req-174b67da-e249-42bd-a104-912fef4f3912 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:10:16.997343 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-a309dc04-566b-4340-b475-03a92475e5c8 req-174b67da-e249-42bd-a104-912fef4f3912 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:10:17.012931 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-a309dc04-566b-4340-b475-03a92475e5c8 req-174b67da-e249-42bd-a104-912fef4f3912 service nova] Creating event network-changed:02b89fca-2f4b-4793-8985-22654af96a35 for instance e4bde2fb-897f-4e91-bd2f-a3f036b4ef2b on n-h2-850468-14 Aug 11 00:10:17.019016 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-a309dc04-566b-4340-b475-03a92475e5c8 req-174b67da-e249-42bd-a104-912fef4f3912 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039405 Aug 11 00:10:17.020632 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3651/7091] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 11 00:10:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 00:10:17.685068 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-85cc3ea5-c4c6-4b89-9316-cd73d2cc7102 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:10:17.686393 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-85cc3ea5-c4c6-4b89-9316-cd73d2cc7102 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] [instance: e4bde2fb-897f-4e91-bd2f-a3f036b4ef2b] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:10:17.693036 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-85cc3ea5-c4c6-4b89-9316-cd73d2cc7102 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:10:17.693530 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-85cc3ea5-c4c6-4b89-9316-cd73d2cc7102 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:10:17.693971 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-85cc3ea5-c4c6-4b89-9316-cd73d2cc7102 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:10:17.694709 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-85cc3ea5-c4c6-4b89-9316-cd73d2cc7102 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:10:17.695274 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-85cc3ea5-c4c6-4b89-9316-cd73d2cc7102 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:10:17.695707 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-85cc3ea5-c4c6-4b89-9316-cd73d2cc7102 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:10:17.835057 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-85cc3ea5-c4c6-4b89-9316-cd73d2cc7102 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98a27e99564f0ca672fbc06423d9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26799bad802a44c18dfee33c758cbb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:10:17.840793 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-85cc3ea5-c4c6-4b89-9316-cd73d2cc7102 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "GET /compute/v2.1/servers/e4bde2fb-897f-4e91-bd2f-a3f036b4ef2b" status: 200 len: 1392 microversion: 2.1 time: 0.161389 Aug 11 00:10:17.841369 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3441/7092] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:10:17 2022] GET /compute/v2.1/servers/e4bde2fb-897f-4e91-bd2f-a3f036b4ef2b => generated 1392 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:10:18.862970 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-65a5e59c-a815-4552-88bb-e43c37fd62ed tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:10:18.863850 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-65a5e59c-a815-4552-88bb-e43c37fd62ed tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] [instance: e4bde2fb-897f-4e91-bd2f-a3f036b4ef2b] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:10:18.870259 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-65a5e59c-a815-4552-88bb-e43c37fd62ed tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:10:18.870758 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-65a5e59c-a815-4552-88bb-e43c37fd62ed tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:10:18.871246 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-65a5e59c-a815-4552-88bb-e43c37fd62ed tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:10:18.871966 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-65a5e59c-a815-4552-88bb-e43c37fd62ed tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:10:18.872438 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-65a5e59c-a815-4552-88bb-e43c37fd62ed tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:10:18.872884 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-65a5e59c-a815-4552-88bb-e43c37fd62ed tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:10:19.018950 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-65a5e59c-a815-4552-88bb-e43c37fd62ed tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98a27e99564f0ca672fbc06423d9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26799bad802a44c18dfee33c758cbb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:10:19.027169 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-65a5e59c-a815-4552-88bb-e43c37fd62ed tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "GET /compute/v2.1/servers/e4bde2fb-897f-4e91-bd2f-a3f036b4ef2b" status: 200 len: 1392 microversion: 2.1 time: 0.169331 Aug 11 00:10:19.027761 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3652/7093] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:10:18 2022] GET /compute/v2.1/servers/e4bde2fb-897f-4e91-bd2f-a3f036b4ef2b => generated 1392 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:10:20.049393 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-ee1b6c8d-1ba0-4234-b81c-b4c7f3cc6001 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:10:20.050040 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-ee1b6c8d-1ba0-4234-b81c-b4c7f3cc6001 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] [instance: e4bde2fb-897f-4e91-bd2f-a3f036b4ef2b] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:10:20.057700 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ee1b6c8d-1ba0-4234-b81c-b4c7f3cc6001 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:10:20.058191 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ee1b6c8d-1ba0-4234-b81c-b4c7f3cc6001 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:10:20.058640 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ee1b6c8d-1ba0-4234-b81c-b4c7f3cc6001 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:10:20.059423 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ee1b6c8d-1ba0-4234-b81c-b4c7f3cc6001 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:10:20.059831 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ee1b6c8d-1ba0-4234-b81c-b4c7f3cc6001 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:10:20.060258 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ee1b6c8d-1ba0-4234-b81c-b4c7f3cc6001 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:10:20.204088 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-ee1b6c8d-1ba0-4234-b81c-b4c7f3cc6001 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98a27e99564f0ca672fbc06423d9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26799bad802a44c18dfee33c758cbb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:10:20.214198 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-ee1b6c8d-1ba0-4234-b81c-b4c7f3cc6001 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "GET /compute/v2.1/servers/e4bde2fb-897f-4e91-bd2f-a3f036b4ef2b" status: 200 len: 1392 microversion: 2.1 time: 0.168848 Aug 11 00:10:20.214953 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3442/7094] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:10:20 2022] GET /compute/v2.1/servers/e4bde2fb-897f-4e91-bd2f-a3f036b4ef2b => generated 1392 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:10:21.236336 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-44ce2011-6f7c-474f-95da-bd4fdc53a046 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:10:21.236872 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-44ce2011-6f7c-474f-95da-bd4fdc53a046 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] [instance: e4bde2fb-897f-4e91-bd2f-a3f036b4ef2b] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:10:21.244718 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-44ce2011-6f7c-474f-95da-bd4fdc53a046 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:10:21.245214 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-44ce2011-6f7c-474f-95da-bd4fdc53a046 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:10:21.245661 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-44ce2011-6f7c-474f-95da-bd4fdc53a046 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:10:21.246363 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-44ce2011-6f7c-474f-95da-bd4fdc53a046 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:10:21.246848 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-44ce2011-6f7c-474f-95da-bd4fdc53a046 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:10:21.247282 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-44ce2011-6f7c-474f-95da-bd4fdc53a046 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:10:21.384900 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-44ce2011-6f7c-474f-95da-bd4fdc53a046 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98a27e99564f0ca672fbc06423d9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26799bad802a44c18dfee33c758cbb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:10:21.393146 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-44ce2011-6f7c-474f-95da-bd4fdc53a046 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "GET /compute/v2.1/servers/e4bde2fb-897f-4e91-bd2f-a3f036b4ef2b" status: 200 len: 1392 microversion: 2.1 time: 0.160794 Aug 11 00:10:21.393728 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3653/7095] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:10:21 2022] GET /compute/v2.1/servers/e4bde2fb-897f-4e91-bd2f-a3f036b4ef2b => generated 1392 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:10:21.831784 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-7b4613e8-0edf-47f0-bfe0-903929f8caf3 req-b6479af1-6f86-450b-8976-9f049c99a196 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4bde2fb-897f-4e91-bd2f-a3f036b4ef2b", "name": "network-vif-plugged", "status": "completed", "tag": "02b89fca-2f4b-4793-8985-22654af96a35"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 00:10:21.844028 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-7b4613e8-0edf-47f0-bfe0-903929f8caf3 req-b6479af1-6f86-450b-8976-9f049c99a196 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:10:21.844526 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-7b4613e8-0edf-47f0-bfe0-903929f8caf3 req-b6479af1-6f86-450b-8976-9f049c99a196 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:10:21.844964 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-7b4613e8-0edf-47f0-bfe0-903929f8caf3 req-b6479af1-6f86-450b-8976-9f049c99a196 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:10:21.856834 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-7b4613e8-0edf-47f0-bfe0-903929f8caf3 req-b6479af1-6f86-450b-8976-9f049c99a196 service nova] Creating event network-vif-plugged:02b89fca-2f4b-4793-8985-22654af96a35 for instance e4bde2fb-897f-4e91-bd2f-a3f036b4ef2b on n-h2-850468-14 Aug 11 00:10:21.862340 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-7b4613e8-0edf-47f0-bfe0-903929f8caf3 req-b6479af1-6f86-450b-8976-9f049c99a196 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034481 Aug 11 00:10:21.862977 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3443/7096] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 11 00:10:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 11 00:10:22.413488 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-62fa6f9e-70c9-4230-8f57-e8d89b8ae84d tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:10:22.414152 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-62fa6f9e-70c9-4230-8f57-e8d89b8ae84d tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] [instance: e4bde2fb-897f-4e91-bd2f-a3f036b4ef2b] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:10:22.421281 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-62fa6f9e-70c9-4230-8f57-e8d89b8ae84d tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:10:22.421723 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-62fa6f9e-70c9-4230-8f57-e8d89b8ae84d tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:10:22.422180 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-62fa6f9e-70c9-4230-8f57-e8d89b8ae84d tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:10:22.422930 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-62fa6f9e-70c9-4230-8f57-e8d89b8ae84d tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:10:22.423402 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-62fa6f9e-70c9-4230-8f57-e8d89b8ae84d tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:10:22.423844 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-62fa6f9e-70c9-4230-8f57-e8d89b8ae84d tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:10:22.561977 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-62fa6f9e-70c9-4230-8f57-e8d89b8ae84d tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98a27e99564f0ca672fbc06423d9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26799bad802a44c18dfee33c758cbb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:10:22.569558 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-62fa6f9e-70c9-4230-8f57-e8d89b8ae84d tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "GET /compute/v2.1/servers/e4bde2fb-897f-4e91-bd2f-a3f036b4ef2b" status: 200 len: 1392 microversion: 2.1 time: 0.159962 Aug 11 00:10:22.570143 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3654/7097] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:10:22 2022] GET /compute/v2.1/servers/e4bde2fb-897f-4e91-bd2f-a3f036b4ef2b => generated 1392 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:10:23.592780 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-48f474f3-8acc-4bce-84a4-57943ded5858 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:10:23.593484 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-48f474f3-8acc-4bce-84a4-57943ded5858 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] [instance: e4bde2fb-897f-4e91-bd2f-a3f036b4ef2b] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:10:23.600556 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-48f474f3-8acc-4bce-84a4-57943ded5858 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:10:23.601037 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-48f474f3-8acc-4bce-84a4-57943ded5858 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:10:23.601481 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-48f474f3-8acc-4bce-84a4-57943ded5858 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:10:23.602178 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-48f474f3-8acc-4bce-84a4-57943ded5858 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:10:23.603268 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-48f474f3-8acc-4bce-84a4-57943ded5858 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:10:23.603701 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-48f474f3-8acc-4bce-84a4-57943ded5858 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:10:23.740787 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-48f474f3-8acc-4bce-84a4-57943ded5858 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98a27e99564f0ca672fbc06423d9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26799bad802a44c18dfee33c758cbb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:10:23.748689 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-48f474f3-8acc-4bce-84a4-57943ded5858 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "GET /compute/v2.1/servers/e4bde2fb-897f-4e91-bd2f-a3f036b4ef2b" status: 200 len: 1564 microversion: 2.1 time: 0.160176 Aug 11 00:10:23.749279 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3444/7098] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:10:23 2022] GET /compute/v2.1/servers/e4bde2fb-897f-4e91-bd2f-a3f036b4ef2b => generated 1564 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:10:23.770638 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-29b72a8d-6b70-457e-b42d-b6b1bd9fd473 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:10:23.771246 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-29b72a8d-6b70-457e-b42d-b6b1bd9fd473 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] [instance: e4bde2fb-897f-4e91-bd2f-a3f036b4ef2b] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:10:23.774118 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=2 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:10:23.775478 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=6 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:10:23.781598 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-29b72a8d-6b70-457e-b42d-b6b1bd9fd473 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:10:23.782108 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-29b72a8d-6b70-457e-b42d-b6b1bd9fd473 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:10:23.782566 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-29b72a8d-6b70-457e-b42d-b6b1bd9fd473 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:10:23.783333 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-29b72a8d-6b70-457e-b42d-b6b1bd9fd473 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:10:23.783814 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-29b72a8d-6b70-457e-b42d-b6b1bd9fd473 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:10:23.784261 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-29b72a8d-6b70-457e-b42d-b6b1bd9fd473 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:10:23.921530 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-29b72a8d-6b70-457e-b42d-b6b1bd9fd473 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98a27e99564f0ca672fbc06423d9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26799bad802a44c18dfee33c758cbb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:10:23.930078 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-29b72a8d-6b70-457e-b42d-b6b1bd9fd473 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "GET /compute/v2.1/servers/e4bde2fb-897f-4e91-bd2f-a3f036b4ef2b" status: 200 len: 1564 microversion: 2.1 time: 0.163485 Aug 11 00:10:23.930678 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3655/7099] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:10:23 2022] GET /compute/v2.1/servers/e4bde2fb-897f-4e91-bd2f-a3f036b4ef2b => generated 1564 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:10:25.538816 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-3025930b-7b2b-4852-9359-689c11b88507 req-30ba9d3a-7c39-4557-aa25-0f04b45b32a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4bde2fb-897f-4e91-bd2f-a3f036b4ef2b", "tag": "02b89fca-2f4b-4793-8985-22654af96a35"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 00:10:25.541267 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=6 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:10:25.547039 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-5ccc707b-bc47-4f9c-a7ee-cd8c9435a0e5 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:10:25.547725 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-5ccc707b-bc47-4f9c-a7ee-cd8c9435a0e5 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] [instance: e4bde2fb-897f-4e91-bd2f-a3f036b4ef2b] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:10:25.550870 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-3025930b-7b2b-4852-9359-689c11b88507 req-30ba9d3a-7c39-4557-aa25-0f04b45b32a8 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:10:25.551625 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-3025930b-7b2b-4852-9359-689c11b88507 req-30ba9d3a-7c39-4557-aa25-0f04b45b32a8 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:10:25.552140 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-3025930b-7b2b-4852-9359-689c11b88507 req-30ba9d3a-7c39-4557-aa25-0f04b45b32a8 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:10:25.554337 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5ccc707b-bc47-4f9c-a7ee-cd8c9435a0e5 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:10:25.554857 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5ccc707b-bc47-4f9c-a7ee-cd8c9435a0e5 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:10:25.555552 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5ccc707b-bc47-4f9c-a7ee-cd8c9435a0e5 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:10:25.556263 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5ccc707b-bc47-4f9c-a7ee-cd8c9435a0e5 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:10:25.556728 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5ccc707b-bc47-4f9c-a7ee-cd8c9435a0e5 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:10:25.557298 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5ccc707b-bc47-4f9c-a7ee-cd8c9435a0e5 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:10:25.564667 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-3025930b-7b2b-4852-9359-689c11b88507 req-30ba9d3a-7c39-4557-aa25-0f04b45b32a8 service nova] Creating event network-changed:02b89fca-2f4b-4793-8985-22654af96a35 for instance e4bde2fb-897f-4e91-bd2f-a3f036b4ef2b on n-h2-850468-14 Aug 11 00:10:25.570024 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-3025930b-7b2b-4852-9359-689c11b88507 req-30ba9d3a-7c39-4557-aa25-0f04b45b32a8 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035020 Aug 11 00:10:25.571476 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3656/7100] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 11 00:10:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 00:10:25.815790 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-5ccc707b-bc47-4f9c-a7ee-cd8c9435a0e5 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98a27e99564f0ca672fbc06423d9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26799bad802a44c18dfee33c758cbb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:10:25.825672 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-5ccc707b-bc47-4f9c-a7ee-cd8c9435a0e5 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "GET /compute/v2.1/servers/e4bde2fb-897f-4e91-bd2f-a3f036b4ef2b" status: 200 len: 1564 microversion: 2.1 time: 0.293243 Aug 11 00:10:25.826258 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3445/7101] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:10:25 2022] GET /compute/v2.1/servers/e4bde2fb-897f-4e91-bd2f-a3f036b4ef2b => generated 1564 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 00:10:51.093772 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-8b71fbd8-eaed-432e-8f47-a0359640b908 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 00:10:51.096215 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-8b71fbd8-eaed-432e-8f47-a0359640b908 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] [instance: e4bde2fb-897f-4e91-bd2f-a3f036b4ef2b] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:10:51.098724 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_api:SELECT=46,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:10:51.099430 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=36 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:10:51.105505 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8b71fbd8-eaed-432e-8f47-a0359640b908 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:10:51.106006 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8b71fbd8-eaed-432e-8f47-a0359640b908 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:10:51.106460 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8b71fbd8-eaed-432e-8f47-a0359640b908 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:10:51.107208 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8b71fbd8-eaed-432e-8f47-a0359640b908 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:10:51.107679 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8b71fbd8-eaed-432e-8f47-a0359640b908 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:10:51.108120 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8b71fbd8-eaed-432e-8f47-a0359640b908 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:10:51.161437 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-8b71fbd8-eaed-432e-8f47-a0359640b908 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "POST /compute/v2.1/servers/e4bde2fb-897f-4e91-bd2f-a3f036b4ef2b/action" status: 200 len: 24558 microversion: 2.1 time: 0.071784 Aug 11 00:10:51.162106 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3657/7102] 10.222.0.58 () {60 vars in 1278 bytes} [Thu Aug 11 00:10:51 2022] POST /compute/v2.1/servers/e4bde2fb-897f-4e91-bd2f-a3f036b4ef2b/action => generated 24558 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 00:11:02.157812 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-866dccf6-fb31-4e85-a077-bb7f1ee35b01 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 00:11:02.160123 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-866dccf6-fb31-4e85-a077-bb7f1ee35b01 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] [instance: e4bde2fb-897f-4e91-bd2f-a3f036b4ef2b] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:11:02.163242 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:11:02.163933 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=32 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:11:02.170393 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-866dccf6-fb31-4e85-a077-bb7f1ee35b01 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:11:02.170909 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-866dccf6-fb31-4e85-a077-bb7f1ee35b01 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:11:02.171341 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-866dccf6-fb31-4e85-a077-bb7f1ee35b01 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:11:02.172033 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-866dccf6-fb31-4e85-a077-bb7f1ee35b01 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:11:02.172487 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-866dccf6-fb31-4e85-a077-bb7f1ee35b01 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:11:02.172906 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-866dccf6-fb31-4e85-a077-bb7f1ee35b01 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:11:02.251310 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-866dccf6-fb31-4e85-a077-bb7f1ee35b01 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "POST /compute/v2.1/servers/e4bde2fb-897f-4e91-bd2f-a3f036b4ef2b/action" status: 202 len: 0 microversion: 2.1 time: 0.097281 Aug 11 00:11:02.251937 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3446/7103] 10.222.0.58 () {60 vars in 1278 bytes} [Thu Aug 11 00:11:02 2022] POST /compute/v2.1/servers/e4bde2fb-897f-4e91-bd2f-a3f036b4ef2b/action => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 11 00:11:02.261741 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-728f5d4e-92b1-477f-a4a3-efc619c6752d tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:11:02.262462 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-728f5d4e-92b1-477f-a4a3-efc619c6752d tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] [instance: e4bde2fb-897f-4e91-bd2f-a3f036b4ef2b] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:11:02.265228 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=4 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:11:02.265890 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_api:SELECT=2 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:11:02.273350 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-728f5d4e-92b1-477f-a4a3-efc619c6752d tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:11:02.273884 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-728f5d4e-92b1-477f-a4a3-efc619c6752d tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:11:02.274477 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-728f5d4e-92b1-477f-a4a3-efc619c6752d tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:11:02.275332 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-728f5d4e-92b1-477f-a4a3-efc619c6752d tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:11:02.275806 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-728f5d4e-92b1-477f-a4a3-efc619c6752d tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:11:02.276251 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-728f5d4e-92b1-477f-a4a3-efc619c6752d tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:11:02.418130 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-728f5d4e-92b1-477f-a4a3-efc619c6752d tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98a27e99564f0ca672fbc06423d9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26799bad802a44c18dfee33c758cbb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:11:02.426509 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-728f5d4e-92b1-477f-a4a3-efc619c6752d tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "GET /compute/v2.1/servers/e4bde2fb-897f-4e91-bd2f-a3f036b4ef2b" status: 200 len: 1675 microversion: 2.1 time: 0.169097 Aug 11 00:11:02.434700 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3658/7104] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:11:02 2022] GET /compute/v2.1/servers/e4bde2fb-897f-4e91-bd2f-a3f036b4ef2b => generated 1675 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:11:03.449804 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-952ae384-d06c-4bb3-af2e-9214af8d1f43 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:11:03.450498 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-952ae384-d06c-4bb3-af2e-9214af8d1f43 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] [instance: e4bde2fb-897f-4e91-bd2f-a3f036b4ef2b] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:11:03.458030 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-952ae384-d06c-4bb3-af2e-9214af8d1f43 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:11:03.458508 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-952ae384-d06c-4bb3-af2e-9214af8d1f43 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:11:03.458976 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-952ae384-d06c-4bb3-af2e-9214af8d1f43 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:11:03.459665 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-952ae384-d06c-4bb3-af2e-9214af8d1f43 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:11:03.460144 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-952ae384-d06c-4bb3-af2e-9214af8d1f43 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:11:03.460566 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-952ae384-d06c-4bb3-af2e-9214af8d1f43 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:11:03.604996 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-952ae384-d06c-4bb3-af2e-9214af8d1f43 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98a27e99564f0ca672fbc06423d9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26799bad802a44c18dfee33c758cbb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:11:03.612937 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-952ae384-d06c-4bb3-af2e-9214af8d1f43 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "GET /compute/v2.1/servers/e4bde2fb-897f-4e91-bd2f-a3f036b4ef2b" status: 200 len: 1680 microversion: 2.1 time: 0.168199 Aug 11 00:11:03.613543 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3447/7105] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:11:03 2022] GET /compute/v2.1/servers/e4bde2fb-897f-4e91-bd2f-a3f036b4ef2b => generated 1680 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:11:04.635266 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-3003c1bb-4a22-4762-b3f9-cdfc8f15943c tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:11:04.635898 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-3003c1bb-4a22-4762-b3f9-cdfc8f15943c tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] [instance: e4bde2fb-897f-4e91-bd2f-a3f036b4ef2b] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:11:04.643739 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3003c1bb-4a22-4762-b3f9-cdfc8f15943c tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:11:04.644265 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3003c1bb-4a22-4762-b3f9-cdfc8f15943c tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:11:04.644784 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3003c1bb-4a22-4762-b3f9-cdfc8f15943c tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:11:04.645473 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3003c1bb-4a22-4762-b3f9-cdfc8f15943c tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:11:04.645948 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3003c1bb-4a22-4762-b3f9-cdfc8f15943c tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:11:04.646392 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3003c1bb-4a22-4762-b3f9-cdfc8f15943c tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:11:04.783337 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-3003c1bb-4a22-4762-b3f9-cdfc8f15943c tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98a27e99564f0ca672fbc06423d9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26799bad802a44c18dfee33c758cbb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:11:04.792020 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-3003c1bb-4a22-4762-b3f9-cdfc8f15943c tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "GET /compute/v2.1/servers/e4bde2fb-897f-4e91-bd2f-a3f036b4ef2b" status: 200 len: 1680 microversion: 2.1 time: 0.161090 Aug 11 00:11:04.792587 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3659/7106] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:11:04 2022] GET /compute/v2.1/servers/e4bde2fb-897f-4e91-bd2f-a3f036b4ef2b => generated 1680 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:11:05.814633 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-e56ce589-e964-43f1-b736-b138448cf769 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:11:05.815287 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-e56ce589-e964-43f1-b736-b138448cf769 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] [instance: e4bde2fb-897f-4e91-bd2f-a3f036b4ef2b] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:11:05.822989 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e56ce589-e964-43f1-b736-b138448cf769 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:11:05.823475 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e56ce589-e964-43f1-b736-b138448cf769 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:11:05.823912 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e56ce589-e964-43f1-b736-b138448cf769 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:11:05.824607 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e56ce589-e964-43f1-b736-b138448cf769 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:11:05.825059 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e56ce589-e964-43f1-b736-b138448cf769 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:11:05.825482 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e56ce589-e964-43f1-b736-b138448cf769 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:11:05.958056 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-e56ce589-e964-43f1-b736-b138448cf769 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98a27e99564f0ca672fbc06423d9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26799bad802a44c18dfee33c758cbb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:11:05.965669 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-e56ce589-e964-43f1-b736-b138448cf769 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "GET /compute/v2.1/servers/e4bde2fb-897f-4e91-bd2f-a3f036b4ef2b" status: 200 len: 1680 microversion: 2.1 time: 0.154984 Aug 11 00:11:05.966245 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3448/7107] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:11:05 2022] GET /compute/v2.1/servers/e4bde2fb-897f-4e91-bd2f-a3f036b4ef2b => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:11:06.989057 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-4e975d5e-f72d-44c7-aebf-12a207bc7293 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:11:06.989916 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-4e975d5e-f72d-44c7-aebf-12a207bc7293 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] [instance: e4bde2fb-897f-4e91-bd2f-a3f036b4ef2b] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:11:06.996800 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4e975d5e-f72d-44c7-aebf-12a207bc7293 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:11:06.997289 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4e975d5e-f72d-44c7-aebf-12a207bc7293 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:11:06.997734 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4e975d5e-f72d-44c7-aebf-12a207bc7293 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:11:06.998437 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4e975d5e-f72d-44c7-aebf-12a207bc7293 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:11:06.998939 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4e975d5e-f72d-44c7-aebf-12a207bc7293 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:11:06.999366 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4e975d5e-f72d-44c7-aebf-12a207bc7293 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:11:07.134649 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-4e975d5e-f72d-44c7-aebf-12a207bc7293 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98a27e99564f0ca672fbc06423d9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26799bad802a44c18dfee33c758cbb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:11:07.142333 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-4e975d5e-f72d-44c7-aebf-12a207bc7293 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "GET /compute/v2.1/servers/e4bde2fb-897f-4e91-bd2f-a3f036b4ef2b" status: 200 len: 1680 microversion: 2.1 time: 0.158256 Aug 11 00:11:07.142916 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3660/7108] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:11:06 2022] GET /compute/v2.1/servers/e4bde2fb-897f-4e91-bd2f-a3f036b4ef2b => generated 1680 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:11:08.163978 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-2f51a4d6-af46-4ac4-b3cd-787d275ad68c tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:11:08.164618 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-2f51a4d6-af46-4ac4-b3cd-787d275ad68c tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] [instance: e4bde2fb-897f-4e91-bd2f-a3f036b4ef2b] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:11:08.171480 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2f51a4d6-af46-4ac4-b3cd-787d275ad68c tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:11:08.171959 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2f51a4d6-af46-4ac4-b3cd-787d275ad68c tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:11:08.172399 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2f51a4d6-af46-4ac4-b3cd-787d275ad68c tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:11:08.173093 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2f51a4d6-af46-4ac4-b3cd-787d275ad68c tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:11:08.173546 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2f51a4d6-af46-4ac4-b3cd-787d275ad68c tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:11:08.173971 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2f51a4d6-af46-4ac4-b3cd-787d275ad68c tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:11:08.305923 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-2f51a4d6-af46-4ac4-b3cd-787d275ad68c tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98a27e99564f0ca672fbc06423d9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26799bad802a44c18dfee33c758cbb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:11:08.313562 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-2f51a4d6-af46-4ac4-b3cd-787d275ad68c tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "GET /compute/v2.1/servers/e4bde2fb-897f-4e91-bd2f-a3f036b4ef2b" status: 200 len: 1680 microversion: 2.1 time: 0.153688 Aug 11 00:11:08.314092 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3449/7109] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:11:08 2022] GET /compute/v2.1/servers/e4bde2fb-897f-4e91-bd2f-a3f036b4ef2b => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:11:09.336484 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-55cccc0a-3900-4df8-b25e-d19931cababe tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:11:09.337107 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-55cccc0a-3900-4df8-b25e-d19931cababe tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] [instance: e4bde2fb-897f-4e91-bd2f-a3f036b4ef2b] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:11:09.344022 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-55cccc0a-3900-4df8-b25e-d19931cababe tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:11:09.344470 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-55cccc0a-3900-4df8-b25e-d19931cababe tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:11:09.344926 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-55cccc0a-3900-4df8-b25e-d19931cababe tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:11:09.345634 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-55cccc0a-3900-4df8-b25e-d19931cababe tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:11:09.346105 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-55cccc0a-3900-4df8-b25e-d19931cababe tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:11:09.346548 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-55cccc0a-3900-4df8-b25e-d19931cababe tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:11:09.485422 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-55cccc0a-3900-4df8-b25e-d19931cababe tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98a27e99564f0ca672fbc06423d9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26799bad802a44c18dfee33c758cbb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:11:09.493011 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-55cccc0a-3900-4df8-b25e-d19931cababe tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "GET /compute/v2.1/servers/e4bde2fb-897f-4e91-bd2f-a3f036b4ef2b" status: 200 len: 1680 microversion: 2.1 time: 0.161131 Aug 11 00:11:09.493588 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3661/7110] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:11:09 2022] GET /compute/v2.1/servers/e4bde2fb-897f-4e91-bd2f-a3f036b4ef2b => generated 1680 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:11:10.514929 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-cb1b71a9-98b5-4703-b83d-a13e47b85ce9 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:11:10.515546 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-cb1b71a9-98b5-4703-b83d-a13e47b85ce9 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] [instance: e4bde2fb-897f-4e91-bd2f-a3f036b4ef2b] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:11:10.522959 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cb1b71a9-98b5-4703-b83d-a13e47b85ce9 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:11:10.523454 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cb1b71a9-98b5-4703-b83d-a13e47b85ce9 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:11:10.523899 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cb1b71a9-98b5-4703-b83d-a13e47b85ce9 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:11:10.524619 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cb1b71a9-98b5-4703-b83d-a13e47b85ce9 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:11:10.525074 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cb1b71a9-98b5-4703-b83d-a13e47b85ce9 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:11:10.525503 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cb1b71a9-98b5-4703-b83d-a13e47b85ce9 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:11:10.659975 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-cb1b71a9-98b5-4703-b83d-a13e47b85ce9 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98a27e99564f0ca672fbc06423d9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26799bad802a44c18dfee33c758cbb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:11:10.668542 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-cb1b71a9-98b5-4703-b83d-a13e47b85ce9 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "GET /compute/v2.1/servers/e4bde2fb-897f-4e91-bd2f-a3f036b4ef2b" status: 200 len: 1680 microversion: 2.1 time: 0.157485 Aug 11 00:11:10.669061 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3450/7111] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:11:10 2022] GET /compute/v2.1/servers/e4bde2fb-897f-4e91-bd2f-a3f036b4ef2b => generated 1680 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:11:11.689744 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-b41e3fcc-8a54-4b99-a949-65c737eb9ade tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:11:11.690374 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-b41e3fcc-8a54-4b99-a949-65c737eb9ade tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] [instance: e4bde2fb-897f-4e91-bd2f-a3f036b4ef2b] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:11:11.698728 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b41e3fcc-8a54-4b99-a949-65c737eb9ade tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:11:11.699287 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b41e3fcc-8a54-4b99-a949-65c737eb9ade tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:11:11.699758 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b41e3fcc-8a54-4b99-a949-65c737eb9ade tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:11:11.700486 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b41e3fcc-8a54-4b99-a949-65c737eb9ade tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:11:11.700991 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b41e3fcc-8a54-4b99-a949-65c737eb9ade tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:11:11.701439 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b41e3fcc-8a54-4b99-a949-65c737eb9ade tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:11:11.841254 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-b41e3fcc-8a54-4b99-a949-65c737eb9ade tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98a27e99564f0ca672fbc06423d9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26799bad802a44c18dfee33c758cbb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:11:11.849672 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-b41e3fcc-8a54-4b99-a949-65c737eb9ade tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "GET /compute/v2.1/servers/e4bde2fb-897f-4e91-bd2f-a3f036b4ef2b" status: 200 len: 1680 microversion: 2.1 time: 0.163093 Aug 11 00:11:11.850503 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3662/7112] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:11:11 2022] GET /compute/v2.1/servers/e4bde2fb-897f-4e91-bd2f-a3f036b4ef2b => generated 1680 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:11:12.871429 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-69d29170-b16b-48b6-9ba4-78c032b25c71 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:11:12.872049 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-69d29170-b16b-48b6-9ba4-78c032b25c71 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] [instance: e4bde2fb-897f-4e91-bd2f-a3f036b4ef2b] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:11:12.878695 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-69d29170-b16b-48b6-9ba4-78c032b25c71 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:11:12.879213 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-69d29170-b16b-48b6-9ba4-78c032b25c71 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:11:12.879654 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-69d29170-b16b-48b6-9ba4-78c032b25c71 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:11:12.880841 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-69d29170-b16b-48b6-9ba4-78c032b25c71 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:11:12.881553 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-69d29170-b16b-48b6-9ba4-78c032b25c71 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:11:12.881976 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-69d29170-b16b-48b6-9ba4-78c032b25c71 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:11:13.013395 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-69d29170-b16b-48b6-9ba4-78c032b25c71 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98a27e99564f0ca672fbc06423d9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26799bad802a44c18dfee33c758cbb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:11:13.021508 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-69d29170-b16b-48b6-9ba4-78c032b25c71 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "GET /compute/v2.1/servers/e4bde2fb-897f-4e91-bd2f-a3f036b4ef2b" status: 200 len: 1680 microversion: 2.1 time: 0.154027 Aug 11 00:11:13.022088 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3451/7113] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:11:12 2022] GET /compute/v2.1/servers/e4bde2fb-897f-4e91-bd2f-a3f036b4ef2b => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:11:14.044727 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-9fa0d036-85d0-44f3-9fec-37035082089a tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:11:14.045388 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-9fa0d036-85d0-44f3-9fec-37035082089a tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] [instance: e4bde2fb-897f-4e91-bd2f-a3f036b4ef2b] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:11:14.052493 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9fa0d036-85d0-44f3-9fec-37035082089a tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:11:14.052990 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9fa0d036-85d0-44f3-9fec-37035082089a tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:11:14.053449 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9fa0d036-85d0-44f3-9fec-37035082089a tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:11:14.054163 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9fa0d036-85d0-44f3-9fec-37035082089a tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:11:14.054635 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9fa0d036-85d0-44f3-9fec-37035082089a tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:11:14.055111 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9fa0d036-85d0-44f3-9fec-37035082089a tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:11:14.188430 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-9fa0d036-85d0-44f3-9fec-37035082089a tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98a27e99564f0ca672fbc06423d9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26799bad802a44c18dfee33c758cbb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:11:14.196832 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-9fa0d036-85d0-44f3-9fec-37035082089a tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "GET /compute/v2.1/servers/e4bde2fb-897f-4e91-bd2f-a3f036b4ef2b" status: 200 len: 1683 microversion: 2.1 time: 0.156008 Aug 11 00:11:14.197418 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3663/7114] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:11:14 2022] GET /compute/v2.1/servers/e4bde2fb-897f-4e91-bd2f-a3f036b4ef2b => generated 1683 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:11:40.407766 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-d4c86839-1644-45d6-aee8-fbcc08a275bc tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 00:11:40.409868 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-d4c86839-1644-45d6-aee8-fbcc08a275bc tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] [instance: e4bde2fb-897f-4e91-bd2f-a3f036b4ef2b] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:11:40.412549 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_api:SELECT=12 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:11:40.413218 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:11:40.419738 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d4c86839-1644-45d6-aee8-fbcc08a275bc tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:11:40.420227 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d4c86839-1644-45d6-aee8-fbcc08a275bc tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:11:40.420669 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d4c86839-1644-45d6-aee8-fbcc08a275bc tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:11:40.421370 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d4c86839-1644-45d6-aee8-fbcc08a275bc tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:11:40.421828 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d4c86839-1644-45d6-aee8-fbcc08a275bc tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:11:40.422256 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d4c86839-1644-45d6-aee8-fbcc08a275bc tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:11:40.493399 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-d4c86839-1644-45d6-aee8-fbcc08a275bc tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "POST /compute/v2.1/servers/e4bde2fb-897f-4e91-bd2f-a3f036b4ef2b/action" status: 200 len: 69092 microversion: 2.1 time: 0.089688 Aug 11 00:11:40.494099 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3452/7115] 10.222.0.58 () {60 vars in 1278 bytes} [Thu Aug 11 00:11:40 2022] POST /compute/v2.1/servers/e4bde2fb-897f-4e91-bd2f-a3f036b4ef2b/action => generated 69092 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 11 00:11:47.759945 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-82814b25-c32e-45ba-8add-6b63af146f61 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:11:47.761122 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-82814b25-c32e-45ba-8add-6b63af146f61 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] [instance: e4bde2fb-897f-4e91-bd2f-a3f036b4ef2b] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:11:47.763934 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_api:SELECT=12 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:11:47.764751 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=36 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:11:47.771494 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-82814b25-c32e-45ba-8add-6b63af146f61 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:11:47.772008 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-82814b25-c32e-45ba-8add-6b63af146f61 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:11:47.772463 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-82814b25-c32e-45ba-8add-6b63af146f61 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:11:47.773439 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-82814b25-c32e-45ba-8add-6b63af146f61 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:11:47.773686 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-82814b25-c32e-45ba-8add-6b63af146f61 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:11:47.774121 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-82814b25-c32e-45ba-8add-6b63af146f61 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:11:47.804293 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-82814b25-c32e-45ba-8add-6b63af146f61 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] [instance: e4bde2fb-897f-4e91-bd2f-a3f036b4ef2b] Going to try to terminate instance {{(pid=122633) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 11 00:11:47.830598 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-c614d0ed-8530-4549-9594-6f2b64a084af req-44e492b8-3deb-434a-8a71-acaef6957136 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4bde2fb-897f-4e91-bd2f-a3f036b4ef2b", "tag": "02b89fca-2f4b-4793-8985-22654af96a35"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 00:11:47.842828 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-c614d0ed-8530-4549-9594-6f2b64a084af req-44e492b8-3deb-434a-8a71-acaef6957136 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:11:47.843689 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-c614d0ed-8530-4549-9594-6f2b64a084af req-44e492b8-3deb-434a-8a71-acaef6957136 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:11:47.844085 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-c614d0ed-8530-4549-9594-6f2b64a084af req-44e492b8-3deb-434a-8a71-acaef6957136 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:11:47.855999 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-c614d0ed-8530-4549-9594-6f2b64a084af req-44e492b8-3deb-434a-8a71-acaef6957136 service nova] Creating event network-changed:02b89fca-2f4b-4793-8985-22654af96a35 for instance e4bde2fb-897f-4e91-bd2f-a3f036b4ef2b on n-h2-850468-14 Aug 11 00:11:47.861429 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-c614d0ed-8530-4549-9594-6f2b64a084af req-44e492b8-3deb-434a-8a71-acaef6957136 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103470 Aug 11 00:11:47.862065 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3453/7116] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 11 00:11:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 00:11:47.892642 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-82814b25-c32e-45ba-8add-6b63af146f61 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "DELETE /compute/v2.1/servers/e4bde2fb-897f-4e91-bd2f-a3f036b4ef2b" status: 204 len: 0 microversion: 2.1 time: 0.136322 Aug 11 00:11:47.893673 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3664/7117] 10.222.0.58 () {58 vars in 1239 bytes} [Thu Aug 11 00:11:47 2022] DELETE /compute/v2.1/servers/e4bde2fb-897f-4e91-bd2f-a3f036b4ef2b => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 11 00:11:47.902846 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-b6fae8c2-1545-4106-b8aa-87b701d23016 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:11:47.903827 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-b6fae8c2-1545-4106-b8aa-87b701d23016 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] [instance: e4bde2fb-897f-4e91-bd2f-a3f036b4ef2b] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:11:47.910609 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b6fae8c2-1545-4106-b8aa-87b701d23016 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:11:47.917012 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b6fae8c2-1545-4106-b8aa-87b701d23016 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:11:47.917473 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b6fae8c2-1545-4106-b8aa-87b701d23016 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:11:47.918204 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b6fae8c2-1545-4106-b8aa-87b701d23016 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:11:47.918664 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b6fae8c2-1545-4106-b8aa-87b701d23016 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:11:47.919115 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b6fae8c2-1545-4106-b8aa-87b701d23016 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:11:48.061672 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-b6fae8c2-1545-4106-b8aa-87b701d23016 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98a27e99564f0ca672fbc06423d9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26799bad802a44c18dfee33c758cbb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:11:48.069787 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-b6fae8c2-1545-4106-b8aa-87b701d23016 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "GET /compute/v2.1/servers/e4bde2fb-897f-4e91-bd2f-a3f036b4ef2b" status: 200 len: 1689 microversion: 2.1 time: 0.171500 Aug 11 00:11:48.070379 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3454/7118] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:11:47 2022] GET /compute/v2.1/servers/e4bde2fb-897f-4e91-bd2f-a3f036b4ef2b => generated 1689 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 00:11:49.093164 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-9d4a8e6a-f952-4bc6-ad5e-ceea3ecf21c9 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:11:49.093881 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-9d4a8e6a-f952-4bc6-ad5e-ceea3ecf21c9 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] [instance: e4bde2fb-897f-4e91-bd2f-a3f036b4ef2b] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:11:49.101256 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9d4a8e6a-f952-4bc6-ad5e-ceea3ecf21c9 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:11:49.101939 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9d4a8e6a-f952-4bc6-ad5e-ceea3ecf21c9 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:11:49.102404 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9d4a8e6a-f952-4bc6-ad5e-ceea3ecf21c9 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:11:49.103166 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9d4a8e6a-f952-4bc6-ad5e-ceea3ecf21c9 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:11:49.104573 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9d4a8e6a-f952-4bc6-ad5e-ceea3ecf21c9 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:11:49.105143 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9d4a8e6a-f952-4bc6-ad5e-ceea3ecf21c9 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:11:49.244832 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-9d4a8e6a-f952-4bc6-ad5e-ceea3ecf21c9 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98a27e99564f0ca672fbc06423d9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26799bad802a44c18dfee33c758cbb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:11:49.252676 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-9d4a8e6a-f952-4bc6-ad5e-ceea3ecf21c9 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "GET /compute/v2.1/servers/e4bde2fb-897f-4e91-bd2f-a3f036b4ef2b" status: 200 len: 1689 microversion: 2.1 time: 0.164423 Aug 11 00:11:49.253268 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3665/7119] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:11:49 2022] GET /compute/v2.1/servers/e4bde2fb-897f-4e91-bd2f-a3f036b4ef2b => generated 1689 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:11:50.100197 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-0c5890d0-675e-4fb8-a576-dc99e668e45a req-f7baa35f-0848-4a3c-92a9-f1530d3f9edf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4bde2fb-897f-4e91-bd2f-a3f036b4ef2b", "name": "network-vif-deleted", "tag": "02b89fca-2f4b-4793-8985-22654af96a35"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 00:11:50.111283 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-0c5890d0-675e-4fb8-a576-dc99e668e45a req-f7baa35f-0848-4a3c-92a9-f1530d3f9edf service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:11:50.111764 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-0c5890d0-675e-4fb8-a576-dc99e668e45a req-f7baa35f-0848-4a3c-92a9-f1530d3f9edf service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:11:50.112213 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-0c5890d0-675e-4fb8-a576-dc99e668e45a req-f7baa35f-0848-4a3c-92a9-f1530d3f9edf service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:11:50.124288 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-0c5890d0-675e-4fb8-a576-dc99e668e45a req-f7baa35f-0848-4a3c-92a9-f1530d3f9edf service nova] Creating event network-vif-deleted:02b89fca-2f4b-4793-8985-22654af96a35 for instance e4bde2fb-897f-4e91-bd2f-a3f036b4ef2b on n-h2-850468-14 Aug 11 00:11:50.129317 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-0c5890d0-675e-4fb8-a576-dc99e668e45a req-f7baa35f-0848-4a3c-92a9-f1530d3f9edf service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032834 Aug 11 00:11:50.129933 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3455/7120] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 11 00:11:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 00:11:50.276892 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-da733b6c-92e5-4cc6-a993-0e6c97044efd tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:11:50.277782 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-da733b6c-92e5-4cc6-a993-0e6c97044efd tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] [instance: e4bde2fb-897f-4e91-bd2f-a3f036b4ef2b] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:11:50.284686 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-da733b6c-92e5-4cc6-a993-0e6c97044efd tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:11:50.285187 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-da733b6c-92e5-4cc6-a993-0e6c97044efd tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:11:50.285640 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-da733b6c-92e5-4cc6-a993-0e6c97044efd tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:11:50.286352 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-da733b6c-92e5-4cc6-a993-0e6c97044efd tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:11:50.286853 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-da733b6c-92e5-4cc6-a993-0e6c97044efd tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:11:50.287301 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-da733b6c-92e5-4cc6-a993-0e6c97044efd tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:11:50.318547 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-da733b6c-92e5-4cc6-a993-0e6c97044efd tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:11:50.319007 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-da733b6c-92e5-4cc6-a993-0e6c97044efd tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:11:50.319464 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-da733b6c-92e5-4cc6-a993-0e6c97044efd tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:11:50.319925 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.objects.instance [None req-da733b6c-92e5-4cc6-a993-0e6c97044efd tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lazy-loading 'fault' on Instance uuid e4bde2fb-897f-4e91-bd2f-a3f036b4ef2b {{(pid=122633) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 11 00:11:50.365641 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-da733b6c-92e5-4cc6-a993-0e6c97044efd tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98a27e99564f0ca672fbc06423d9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26799bad802a44c18dfee33c758cbb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:11:50.373768 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-da733b6c-92e5-4cc6-a993-0e6c97044efd tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "GET /compute/v2.1/servers/e4bde2fb-897f-4e91-bd2f-a3f036b4ef2b" status: 200 len: 1356 microversion: 2.1 time: 0.101446 Aug 11 00:11:50.374423 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3666/7121] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:11:50 2022] GET /compute/v2.1/servers/e4bde2fb-897f-4e91-bd2f-a3f036b4ef2b => generated 1356 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:11:51.397475 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-1176c53c-487a-450b-b4ed-732f4893a83b tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:11:51.398188 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-1176c53c-487a-450b-b4ed-732f4893a83b tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] [instance: e4bde2fb-897f-4e91-bd2f-a3f036b4ef2b] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:11:51.404987 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1176c53c-487a-450b-b4ed-732f4893a83b tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:11:51.405478 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1176c53c-487a-450b-b4ed-732f4893a83b tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:11:51.405927 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1176c53c-487a-450b-b4ed-732f4893a83b tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:11:51.406631 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1176c53c-487a-450b-b4ed-732f4893a83b tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:11:51.407123 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1176c53c-487a-450b-b4ed-732f4893a83b tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:11:51.407558 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1176c53c-487a-450b-b4ed-732f4893a83b tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:11:51.421857 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-1176c53c-487a-450b-b4ed-732f4893a83b tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] HTTP exception thrown: Instance e4bde2fb-897f-4e91-bd2f-a3f036b4ef2b could not be found. Aug 11 00:11:51.423544 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-1176c53c-487a-450b-b4ed-732f4893a83b tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Request method failure captured: Aug 11 00:11:51.423544 n-d-850468-14 devstack@n-api.service[122632]: request: GET /compute/v2.1/servers/e4bde2fb-897f-4e91-bd2f-a3f036b4ef2b HTTP/1.1 Aug 11 00:11:51.423544 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 11 00:11:51.423544 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 11 00:11:51.423544 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 11 00:11:51.423544 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 11 00:11:51.423544 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 11 00:11:51.423544 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 11 00:11:51.423544 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 11 00:11:51.423544 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 11 00:11:51.423544 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9Eicgn9rrdRuvAzeJtJZ7G3bC_nDgFR3SCpmMvM-oSUDIishF0KIrgIe24vn-zIDWQFTlnHZqZzmBW04xZWO5xjxS0bhWpiqJFEiDbQjnCF5CEqW_Qy1Z8Dx6EdfjYFAs6IHw9dtZURRdVWG0taseoTltbZtc3U4Z0kNtdabyg0lDPw Aug 11 00:11:51.423544 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 11 00:11:51.423544 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 11 00:11:51.423544 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 11 00:11:51.423544 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 11 00:11:51.423544 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 11 00:11:51.423544 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 11 00:11:51.423544 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 26799bad802a44c18dfee33c758cbb60 Aug 11 00:11:51.423544 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-458446174 Aug 11 00:11:51.423544 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 11 00:11:51.423544 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 11 00:11:51.423544 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/26799bad802a44c18dfee33c758cbb60"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/26799bad802a44c18dfee33c758cbb60"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/26799bad802a44c18dfee33c758cbb60"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_26799bad802a44c18dfee33c758cbb60", "adminURL": "http://10.222.0.58:8080"}]}] Aug 11 00:11:51.423544 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-TestNetworkAdvancedServerOps-458446174 Aug 11 00:11:51.423544 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 26799bad802a44c18dfee33c758cbb60 Aug 11 00:11:51.423544 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-458446174 Aug 11 00:11:51.423544 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-TestNetworkAdvancedServerOps-458446174-project Aug 11 00:11:51.423544 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 11 00:11:51.423544 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 11 00:11:51.423544 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: 8e98a27e99564f0ca672fbc06423d9ea Aug 11 00:11:51.423544 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-TestNetworkAdvancedServerOps-458446174-project Aug 11 00:11:51.423544 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 11 00:11:51.423544 n-d-850468-14 devstack@n-api.service[122632]: exception: Instance e4bde2fb-897f-4e91-bd2f-a3f036b4ef2b could not be found. Aug 11 00:11:51.423544 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': 'e4bde2fb-897f-4e91-bd2f-a3f036b4ef2b'} Aug 11 00:11:51.423544 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 00:11:51.423544 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 00:11:51.423544 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 11 00:11:51.423544 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 11 00:11:51.423544 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 11 00:11:51.423544 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 11 00:11:51.423544 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 11 00:11:51.423544 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 11 00:11:51.423544 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 11 00:11:51.423544 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 11 00:11:51.423544 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4bde2fb-897f-4e91-bd2f-a3f036b4ef2b could not be found. Aug 11 00:11:51.423544 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 11 00:11:51.423544 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 00:11:51.423544 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 11 00:11:51.423544 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 00:11:51.423544 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 00:11:51.423544 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 00:11:51.423544 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 00:11:51.423544 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 00:11:51.423544 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 00:11:51.423544 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 00:11:51.423544 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 11 00:11:51.423544 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 11 00:11:51.423544 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 11 00:11:51.423544 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 11 00:11:51.423544 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 11 00:11:51.423544 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 11 00:11:51.423544 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4bde2fb-897f-4e91-bd2f-a3f036b4ef2b could not be found. Aug 11 00:11:51.423544 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 11 00:11:51.423544 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 00:11:51.427897 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 11 00:11:51.427897 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 00:11:51.427897 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 00:11:51.427897 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 00:11:51.427897 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 00:11:51.427897 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 00:11:51.427897 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4bde2fb-897f-4e91-bd2f-a3f036b4ef2b could not be found. Aug 11 00:11:51.427897 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 11 00:11:51.427897 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-1176c53c-487a-450b-b4ed-732f4893a83b tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Returning 404 to user: Instance e4bde2fb-897f-4e91-bd2f-a3f036b4ef2b could not be found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 00:11:51.427897 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-1176c53c-487a-450b-b4ed-732f4893a83b tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "GET /compute/v2.1/servers/e4bde2fb-897f-4e91-bd2f-a3f036b4ef2b" status: 404 len: 111 microversion: 2.1 time: 0.032801 Aug 11 00:11:51.427897 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3456/7122] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:11:51 2022] GET /compute/v2.1/servers/e4bde2fb-897f-4e91-bd2f-a3f036b4ef2b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 11 00:11:54.889196 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-b2f2db5b-9021-464f-894c-8db52a2edfd0 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Calling method '.version_select at 0x7f847d3e71f0>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:11:54.916750 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-b2f2db5b-9021-464f-894c-8db52a2edfd0 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1731526343" status: 202 len: 0 microversion: 2.1 time: 0.032154 Aug 11 00:11:54.917773 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3667/7123] 10.222.0.58 () {58 vars in 1284 bytes} [Thu Aug 11 00:11:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1731526343 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 11 00:11:54.943091 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-37264200-33c4-4873-932a-22bda4ee7d27 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Action: 'create', calling method: .version_select at 0x7f847c60ab80>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-662691380", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGGZJnz8bDTuUkpOSF+MpuC084CrbEo2t4SrtY1rjgHK7ZEpR2bVQtSZdDVGq8GM9/lQupcIkOLaizXWnJprF7rC344Kb+j451CXcuq2gRsShuAe7dagsR3/1IjfKhMAqg=="}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 00:11:54.960628 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-37264200-33c4-4873-932a-22bda4ee7d27 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Getting quotas for project 26799bad802a44c18dfee33c758cbb60. Resources: {'key_pairs'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 11 00:11:54.966657 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-37264200-33c4-4873-932a-22bda4ee7d27 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Getting quotas for user 8e98a27e99564f0ca672fbc06423d9ea and project 26799bad802a44c18dfee33c758cbb60. Resources: {'key_pairs'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 11 00:11:54.990693 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-37264200-33c4-4873-932a-22bda4ee7d27 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.052067 Aug 11 00:11:54.991355 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3457/7124] 10.222.0.58 () {60 vars in 1159 bytes} [Thu Aug 11 00:11:54 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 00:12:00.631424 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:12:00.639448 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-e41dc5cc-0f46-43ce-9955-7e1cd64c152f tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1609061285", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452", "networks": [{"uuid": "6ca27c0c-f010-4446-aa69-d5df03ec80e2"}], "key_name": "tempest-TestNetworkAdvancedServerOps-662691380", "security_groups": [{"name": "tempest-secgroup-smoke-1336832141"}]}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 00:12:00.788091 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.network.neutron [None req-e41dc5cc-0f46-43ce-9955-7e1cd64c152f tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] validate_networks() for [('6ca27c0c-f010-4446-aa69-d5df03ec80e2', None, None, None, None, None)] {{(pid=122633) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 11 00:12:01.547266 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-e41dc5cc-0f46-43ce-9955-7e1cd64c152f tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Flavor limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 11 00:12:01.547714 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-e41dc5cc-0f46-43ce-9955-7e1cd64c152f tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Image limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 11 00:12:01.548241 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-e41dc5cc-0f46-43ce-9955-7e1cd64c152f tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Flavor pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 11 00:12:01.548706 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-e41dc5cc-0f46-43ce-9955-7e1cd64c152f tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Image pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 11 00:12:01.549139 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-e41dc5cc-0f46-43ce-9955-7e1cd64c152f tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 11 00:12:01.559505 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e41dc5cc-0f46-43ce-9955-7e1cd64c152f tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:12:01.560072 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e41dc5cc-0f46-43ce-9955-7e1cd64c152f tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:12:01.560544 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e41dc5cc-0f46-43ce-9955-7e1cd64c152f tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:12:01.561297 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e41dc5cc-0f46-43ce-9955-7e1cd64c152f tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:12:01.561767 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e41dc5cc-0f46-43ce-9955-7e1cd64c152f tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:12:01.562213 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e41dc5cc-0f46-43ce-9955-7e1cd64c152f tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:12:01.581457 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-e41dc5cc-0f46-43ce-9955-7e1cd64c152f tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Getting quotas for project 26799bad802a44c18dfee33c758cbb60. Resources: {'instances', 'cores', 'ram'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 11 00:12:01.589019 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-e41dc5cc-0f46-43ce-9955-7e1cd64c152f tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Getting quotas for user 8e98a27e99564f0ca672fbc06423d9ea and project 26799bad802a44c18dfee33c758cbb60. Resources: {'instances', 'cores', 'ram'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 11 00:12:01.603030 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-e41dc5cc-0f46-43ce-9955-7e1cd64c152f tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Going to run 1 instances... {{(pid=122633) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 11 00:12:01.605979 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-e41dc5cc-0f46-43ce-9955-7e1cd64c152f tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] [instance: 5debc9f2-4321-47d3-9215-8f2c02fe817d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78ad8905-f66f-4733-8be9-2b260f1fabed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122633) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 11 00:12:01.654899 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-e41dc5cc-0f46-43ce-9955-7e1cd64c152f tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.025338 Aug 11 00:12:01.662543 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3668/7125] 10.222.0.58 () {60 vars in 1147 bytes} [Thu Aug 11 00:12:00 2022] POST /compute/v2.1/servers => generated 406 bytes in 1034 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 11 00:12:01.665359 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=16 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:12:01.671628 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-36db4830-3280-41f4-9f49-bcbd8216b5ab tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:12:01.685172 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-36db4830-3280-41f4-9f49-bcbd8216b5ab tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] [instance: 5debc9f2-4321-47d3-9215-8f2c02fe817d] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:12:01.750938 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-36db4830-3280-41f4-9f49-bcbd8216b5ab tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98a27e99564f0ca672fbc06423d9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26799bad802a44c18dfee33c758cbb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:12:01.758207 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-36db4830-3280-41f4-9f49-bcbd8216b5ab tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "GET /compute/v2.1/servers/5debc9f2-4321-47d3-9215-8f2c02fe817d" status: 200 len: 1266 microversion: 2.1 time: 0.094626 Aug 11 00:12:01.758977 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3458/7126] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:12:01 2022] GET /compute/v2.1/servers/5debc9f2-4321-47d3-9215-8f2c02fe817d => generated 1266 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:12:02.788233 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-8098848e-500e-4cc3-ad31-ec11478bc933 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:12:02.788879 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-8098848e-500e-4cc3-ad31-ec11478bc933 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] [instance: 5debc9f2-4321-47d3-9215-8f2c02fe817d] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:12:02.797920 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8098848e-500e-4cc3-ad31-ec11478bc933 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:12:02.798439 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8098848e-500e-4cc3-ad31-ec11478bc933 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:12:02.798933 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8098848e-500e-4cc3-ad31-ec11478bc933 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:12:02.799674 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8098848e-500e-4cc3-ad31-ec11478bc933 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:12:02.800144 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8098848e-500e-4cc3-ad31-ec11478bc933 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:12:02.800592 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8098848e-500e-4cc3-ad31-ec11478bc933 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:12:02.874820 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-8098848e-500e-4cc3-ad31-ec11478bc933 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98a27e99564f0ca672fbc06423d9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26799bad802a44c18dfee33c758cbb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:12:02.882448 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-8098848e-500e-4cc3-ad31-ec11478bc933 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "GET /compute/v2.1/servers/5debc9f2-4321-47d3-9215-8f2c02fe817d" status: 200 len: 1324 microversion: 2.1 time: 0.100581 Aug 11 00:12:02.883593 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3669/7127] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:12:02 2022] GET /compute/v2.1/servers/5debc9f2-4321-47d3-9215-8f2c02fe817d => generated 1324 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:12:03.907189 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-9d16b8a6-1654-4e72-9bf7-15f943518dfd tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:12:03.907988 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-9d16b8a6-1654-4e72-9bf7-15f943518dfd tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] [instance: 5debc9f2-4321-47d3-9215-8f2c02fe817d] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:12:03.915716 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9d16b8a6-1654-4e72-9bf7-15f943518dfd tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:12:03.916835 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9d16b8a6-1654-4e72-9bf7-15f943518dfd tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:12:03.917277 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9d16b8a6-1654-4e72-9bf7-15f943518dfd tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:12:03.917989 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9d16b8a6-1654-4e72-9bf7-15f943518dfd tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:12:03.918445 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9d16b8a6-1654-4e72-9bf7-15f943518dfd tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:12:03.918897 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9d16b8a6-1654-4e72-9bf7-15f943518dfd tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:12:04.060123 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-9d16b8a6-1654-4e72-9bf7-15f943518dfd tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98a27e99564f0ca672fbc06423d9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26799bad802a44c18dfee33c758cbb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:12:04.067834 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-9d16b8a6-1654-4e72-9bf7-15f943518dfd tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "GET /compute/v2.1/servers/5debc9f2-4321-47d3-9215-8f2c02fe817d" status: 200 len: 1392 microversion: 2.1 time: 0.165459 Aug 11 00:12:04.068420 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3459/7128] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:12:03 2022] GET /compute/v2.1/servers/5debc9f2-4321-47d3-9215-8f2c02fe817d => generated 1392 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:12:04.111630 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-8008c77d-4f0f-4141-aaee-c31b6adf434c req-1a5c8c7a-394e-4d03-a520-d5cdbfb350a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5debc9f2-4321-47d3-9215-8f2c02fe817d", "tag": "114be6dc-3b5a-425e-b67b-ef5a236c9b0c"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 00:12:04.123696 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-8008c77d-4f0f-4141-aaee-c31b6adf434c req-1a5c8c7a-394e-4d03-a520-d5cdbfb350a4 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:12:04.124281 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-8008c77d-4f0f-4141-aaee-c31b6adf434c req-1a5c8c7a-394e-4d03-a520-d5cdbfb350a4 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:12:04.124805 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-8008c77d-4f0f-4141-aaee-c31b6adf434c req-1a5c8c7a-394e-4d03-a520-d5cdbfb350a4 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:12:04.137693 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-8008c77d-4f0f-4141-aaee-c31b6adf434c req-1a5c8c7a-394e-4d03-a520-d5cdbfb350a4 service nova] Creating event network-changed:114be6dc-3b5a-425e-b67b-ef5a236c9b0c for instance 5debc9f2-4321-47d3-9215-8f2c02fe817d on n-h1-850468-14 Aug 11 00:12:04.142757 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-8008c77d-4f0f-4141-aaee-c31b6adf434c req-1a5c8c7a-394e-4d03-a520-d5cdbfb350a4 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046495 Aug 11 00:12:04.143922 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3670/7129] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 11 00:12:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 00:12:05.090435 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-4aa34e77-beaa-4532-91d0-d21801136e20 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:12:05.091067 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-4aa34e77-beaa-4532-91d0-d21801136e20 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] [instance: 5debc9f2-4321-47d3-9215-8f2c02fe817d] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:12:05.097914 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4aa34e77-beaa-4532-91d0-d21801136e20 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:12:05.098398 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4aa34e77-beaa-4532-91d0-d21801136e20 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:12:05.098856 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4aa34e77-beaa-4532-91d0-d21801136e20 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:12:05.099551 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4aa34e77-beaa-4532-91d0-d21801136e20 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:12:05.100003 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4aa34e77-beaa-4532-91d0-d21801136e20 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:12:05.100420 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4aa34e77-beaa-4532-91d0-d21801136e20 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:12:05.235066 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-4aa34e77-beaa-4532-91d0-d21801136e20 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98a27e99564f0ca672fbc06423d9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26799bad802a44c18dfee33c758cbb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:12:05.242571 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-4aa34e77-beaa-4532-91d0-d21801136e20 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "GET /compute/v2.1/servers/5debc9f2-4321-47d3-9215-8f2c02fe817d" status: 200 len: 1392 microversion: 2.1 time: 0.156946 Aug 11 00:12:05.243195 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3460/7130] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:12:05 2022] GET /compute/v2.1/servers/5debc9f2-4321-47d3-9215-8f2c02fe817d => generated 1392 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:12:06.264948 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-ba9f634f-f651-413b-b9d7-dd0e22604856 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:12:06.265693 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-ba9f634f-f651-413b-b9d7-dd0e22604856 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] [instance: 5debc9f2-4321-47d3-9215-8f2c02fe817d] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:12:06.272282 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ba9f634f-f651-413b-b9d7-dd0e22604856 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:12:06.272873 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ba9f634f-f651-413b-b9d7-dd0e22604856 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:12:06.273226 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ba9f634f-f651-413b-b9d7-dd0e22604856 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:12:06.273945 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ba9f634f-f651-413b-b9d7-dd0e22604856 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:12:06.274415 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ba9f634f-f651-413b-b9d7-dd0e22604856 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:12:06.274881 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ba9f634f-f651-413b-b9d7-dd0e22604856 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:12:06.411595 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-ba9f634f-f651-413b-b9d7-dd0e22604856 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98a27e99564f0ca672fbc06423d9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26799bad802a44c18dfee33c758cbb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:12:06.419988 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-ba9f634f-f651-413b-b9d7-dd0e22604856 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "GET /compute/v2.1/servers/5debc9f2-4321-47d3-9215-8f2c02fe817d" status: 200 len: 1392 microversion: 2.1 time: 0.160373 Aug 11 00:12:06.420635 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3671/7131] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:12:06 2022] GET /compute/v2.1/servers/5debc9f2-4321-47d3-9215-8f2c02fe817d => generated 1392 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:12:07.440560 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-e4860d82-c968-4e90-9821-d5ac9da65ab8 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:12:07.441283 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-e4860d82-c968-4e90-9821-d5ac9da65ab8 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] [instance: 5debc9f2-4321-47d3-9215-8f2c02fe817d] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:12:07.449511 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e4860d82-c968-4e90-9821-d5ac9da65ab8 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:12:07.450230 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e4860d82-c968-4e90-9821-d5ac9da65ab8 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:12:07.450671 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e4860d82-c968-4e90-9821-d5ac9da65ab8 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:12:07.451430 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e4860d82-c968-4e90-9821-d5ac9da65ab8 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:12:07.451879 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e4860d82-c968-4e90-9821-d5ac9da65ab8 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:12:07.452300 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e4860d82-c968-4e90-9821-d5ac9da65ab8 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:12:07.591083 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-e4860d82-c968-4e90-9821-d5ac9da65ab8 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98a27e99564f0ca672fbc06423d9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26799bad802a44c18dfee33c758cbb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:12:07.598801 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-e4860d82-c968-4e90-9821-d5ac9da65ab8 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "GET /compute/v2.1/servers/5debc9f2-4321-47d3-9215-8f2c02fe817d" status: 200 len: 1392 microversion: 2.1 time: 0.162135 Aug 11 00:12:07.599437 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3461/7132] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:12:07 2022] GET /compute/v2.1/servers/5debc9f2-4321-47d3-9215-8f2c02fe817d => generated 1392 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:12:08.620422 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-0498ecd2-a1bd-49ae-92cc-9274fd77005d tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:12:08.621047 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-0498ecd2-a1bd-49ae-92cc-9274fd77005d tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] [instance: 5debc9f2-4321-47d3-9215-8f2c02fe817d] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:12:08.629480 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0498ecd2-a1bd-49ae-92cc-9274fd77005d tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:12:08.629970 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0498ecd2-a1bd-49ae-92cc-9274fd77005d tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:12:08.630425 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0498ecd2-a1bd-49ae-92cc-9274fd77005d tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:12:08.631178 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0498ecd2-a1bd-49ae-92cc-9274fd77005d tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:12:08.631651 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0498ecd2-a1bd-49ae-92cc-9274fd77005d tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:12:08.632349 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0498ecd2-a1bd-49ae-92cc-9274fd77005d tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:12:08.771189 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-0498ecd2-a1bd-49ae-92cc-9274fd77005d tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98a27e99564f0ca672fbc06423d9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26799bad802a44c18dfee33c758cbb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:12:08.779004 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-0498ecd2-a1bd-49ae-92cc-9274fd77005d tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "GET /compute/v2.1/servers/5debc9f2-4321-47d3-9215-8f2c02fe817d" status: 200 len: 1392 microversion: 2.1 time: 0.162410 Aug 11 00:12:08.779592 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3672/7133] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:12:08 2022] GET /compute/v2.1/servers/5debc9f2-4321-47d3-9215-8f2c02fe817d => generated 1392 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:12:09.423004 n-d-850468-14 devstack@n-api.service[122632]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 11 00:12:09.423605 n-d-850468-14 devstack@n-api.service[122632]: Thu Aug 11 00:12:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 11 00:12:09.800190 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-9d6dc4f1-07b7-4216-b579-c1693e30ce28 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:12:09.800811 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-9d6dc4f1-07b7-4216-b579-c1693e30ce28 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] [instance: 5debc9f2-4321-47d3-9215-8f2c02fe817d] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:12:09.808469 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9d6dc4f1-07b7-4216-b579-c1693e30ce28 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:12:09.809064 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9d6dc4f1-07b7-4216-b579-c1693e30ce28 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:12:09.809502 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9d6dc4f1-07b7-4216-b579-c1693e30ce28 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:12:09.810617 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9d6dc4f1-07b7-4216-b579-c1693e30ce28 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:12:09.810993 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9d6dc4f1-07b7-4216-b579-c1693e30ce28 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:12:09.811426 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9d6dc4f1-07b7-4216-b579-c1693e30ce28 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:12:09.854372 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-c140d543-13ca-474f-aff5-5b307295028a req-b0881cde-3e77-49f9-a0f1-7b102a8dab18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5debc9f2-4321-47d3-9215-8f2c02fe817d", "name": "network-vif-plugged", "status": "completed", "tag": "114be6dc-3b5a-425e-b67b-ef5a236c9b0c"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 00:12:09.867090 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-c140d543-13ca-474f-aff5-5b307295028a req-b0881cde-3e77-49f9-a0f1-7b102a8dab18 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:12:09.867828 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-c140d543-13ca-474f-aff5-5b307295028a req-b0881cde-3e77-49f9-a0f1-7b102a8dab18 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:12:09.868478 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-c140d543-13ca-474f-aff5-5b307295028a req-b0881cde-3e77-49f9-a0f1-7b102a8dab18 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:12:09.879946 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-c140d543-13ca-474f-aff5-5b307295028a req-b0881cde-3e77-49f9-a0f1-7b102a8dab18 service nova] Creating event network-vif-plugged:114be6dc-3b5a-425e-b67b-ef5a236c9b0c for instance 5debc9f2-4321-47d3-9215-8f2c02fe817d on n-h1-850468-14 Aug 11 00:12:09.885196 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-c140d543-13ca-474f-aff5-5b307295028a req-b0881cde-3e77-49f9-a0f1-7b102a8dab18 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096100 Aug 11 00:12:09.885810 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3462/7134] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 11 00:12:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 00:12:09.950316 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-9d6dc4f1-07b7-4216-b579-c1693e30ce28 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98a27e99564f0ca672fbc06423d9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26799bad802a44c18dfee33c758cbb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:12:09.958978 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-9d6dc4f1-07b7-4216-b579-c1693e30ce28 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "GET /compute/v2.1/servers/5debc9f2-4321-47d3-9215-8f2c02fe817d" status: 200 len: 1392 microversion: 2.1 time: 0.162885 Aug 11 00:12:09.959673 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3673/7135] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:12:09 2022] GET /compute/v2.1/servers/5debc9f2-4321-47d3-9215-8f2c02fe817d => generated 1392 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:12:10.983361 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-ed980536-3991-44ba-a06b-6b8bdb477d9b tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:12:10.984188 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-ed980536-3991-44ba-a06b-6b8bdb477d9b tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] [instance: 5debc9f2-4321-47d3-9215-8f2c02fe817d] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:12:10.986258 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:12:10.991552 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ed980536-3991-44ba-a06b-6b8bdb477d9b tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:12:10.992314 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ed980536-3991-44ba-a06b-6b8bdb477d9b tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:12:10.992462 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ed980536-3991-44ba-a06b-6b8bdb477d9b tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:12:10.993365 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ed980536-3991-44ba-a06b-6b8bdb477d9b tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:12:10.993831 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ed980536-3991-44ba-a06b-6b8bdb477d9b tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:12:10.994259 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ed980536-3991-44ba-a06b-6b8bdb477d9b tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:12:11.148637 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-ed980536-3991-44ba-a06b-6b8bdb477d9b tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98a27e99564f0ca672fbc06423d9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26799bad802a44c18dfee33c758cbb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:12:11.156799 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-ed980536-3991-44ba-a06b-6b8bdb477d9b tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "GET /compute/v2.1/servers/5debc9f2-4321-47d3-9215-8f2c02fe817d" status: 200 len: 1392 microversion: 2.1 time: 0.179244 Aug 11 00:12:11.157377 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3463/7136] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:12:10 2022] GET /compute/v2.1/servers/5debc9f2-4321-47d3-9215-8f2c02fe817d => generated 1392 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:12:12.179187 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-0c9bc858-a2be-45a4-aa94-7a7e26f4f31b tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:12:12.179818 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-0c9bc858-a2be-45a4-aa94-7a7e26f4f31b tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] [instance: 5debc9f2-4321-47d3-9215-8f2c02fe817d] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:12:12.182638 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=2 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:12:12.183419 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=6 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:12:12.190361 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0c9bc858-a2be-45a4-aa94-7a7e26f4f31b tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:12:12.190889 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0c9bc858-a2be-45a4-aa94-7a7e26f4f31b tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:12:12.191348 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0c9bc858-a2be-45a4-aa94-7a7e26f4f31b tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:12:12.192068 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0c9bc858-a2be-45a4-aa94-7a7e26f4f31b tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:12:12.192540 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0c9bc858-a2be-45a4-aa94-7a7e26f4f31b tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:12:12.192982 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0c9bc858-a2be-45a4-aa94-7a7e26f4f31b tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:12:12.326494 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-0c9bc858-a2be-45a4-aa94-7a7e26f4f31b tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98a27e99564f0ca672fbc06423d9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26799bad802a44c18dfee33c758cbb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:12:12.334275 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-0c9bc858-a2be-45a4-aa94-7a7e26f4f31b tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "GET /compute/v2.1/servers/5debc9f2-4321-47d3-9215-8f2c02fe817d" status: 200 len: 1563 microversion: 2.1 time: 0.159064 Aug 11 00:12:12.334906 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3674/7137] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:12:12 2022] GET /compute/v2.1/servers/5debc9f2-4321-47d3-9215-8f2c02fe817d => generated 1563 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 00:12:12.355118 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-5f2b4759-7637-4501-92db-e45dc83f058c tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:12:12.355729 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-5f2b4759-7637-4501-92db-e45dc83f058c tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] [instance: 5debc9f2-4321-47d3-9215-8f2c02fe817d] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:12:12.358105 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=6 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:12:12.363879 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5f2b4759-7637-4501-92db-e45dc83f058c tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:12:12.364361 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5f2b4759-7637-4501-92db-e45dc83f058c tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:12:12.364797 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5f2b4759-7637-4501-92db-e45dc83f058c tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:12:12.365484 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5f2b4759-7637-4501-92db-e45dc83f058c tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:12:12.365933 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5f2b4759-7637-4501-92db-e45dc83f058c tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:12:12.366352 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5f2b4759-7637-4501-92db-e45dc83f058c tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:12:12.509300 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-5f2b4759-7637-4501-92db-e45dc83f058c tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98a27e99564f0ca672fbc06423d9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26799bad802a44c18dfee33c758cbb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:12:12.517720 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-5f2b4759-7637-4501-92db-e45dc83f058c tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "GET /compute/v2.1/servers/5debc9f2-4321-47d3-9215-8f2c02fe817d" status: 200 len: 1563 microversion: 2.1 time: 0.166477 Aug 11 00:12:12.522076 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3464/7138] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:12:12 2022] GET /compute/v2.1/servers/5debc9f2-4321-47d3-9215-8f2c02fe817d => generated 1563 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:12:14.140227 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-f26dea4c-2adf-4ffd-baed-ee3bff92062c tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:12:14.141667 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-3b1d9053-78ee-4fdc-849f-df5e14b489ef req-c6ee84de-0ee1-4bce-bd80-862cbbd69a95 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5debc9f2-4321-47d3-9215-8f2c02fe817d", "tag": "114be6dc-3b5a-425e-b67b-ef5a236c9b0c"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 00:12:14.142465 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-f26dea4c-2adf-4ffd-baed-ee3bff92062c tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] [instance: 5debc9f2-4321-47d3-9215-8f2c02fe817d] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:12:14.150232 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f26dea4c-2adf-4ffd-baed-ee3bff92062c tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:12:14.150738 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f26dea4c-2adf-4ffd-baed-ee3bff92062c tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:12:14.151257 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f26dea4c-2adf-4ffd-baed-ee3bff92062c tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:12:14.152472 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f26dea4c-2adf-4ffd-baed-ee3bff92062c tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:12:14.152997 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f26dea4c-2adf-4ffd-baed-ee3bff92062c tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:12:14.153799 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f26dea4c-2adf-4ffd-baed-ee3bff92062c tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:12:14.155917 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-3b1d9053-78ee-4fdc-849f-df5e14b489ef req-c6ee84de-0ee1-4bce-bd80-862cbbd69a95 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:12:14.156398 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-3b1d9053-78ee-4fdc-849f-df5e14b489ef req-c6ee84de-0ee1-4bce-bd80-862cbbd69a95 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:12:14.157062 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-3b1d9053-78ee-4fdc-849f-df5e14b489ef req-c6ee84de-0ee1-4bce-bd80-862cbbd69a95 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:12:14.170437 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-3b1d9053-78ee-4fdc-849f-df5e14b489ef req-c6ee84de-0ee1-4bce-bd80-862cbbd69a95 service nova] Creating event network-changed:114be6dc-3b5a-425e-b67b-ef5a236c9b0c for instance 5debc9f2-4321-47d3-9215-8f2c02fe817d on n-h1-850468-14 Aug 11 00:12:14.177073 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-3b1d9053-78ee-4fdc-849f-df5e14b489ef req-c6ee84de-0ee1-4bce-bd80-862cbbd69a95 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039640 Aug 11 00:12:14.178537 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3465/7139] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 11 00:12:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 00:12:14.380018 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-f26dea4c-2adf-4ffd-baed-ee3bff92062c tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98a27e99564f0ca672fbc06423d9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26799bad802a44c18dfee33c758cbb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:12:14.388408 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-f26dea4c-2adf-4ffd-baed-ee3bff92062c tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "GET /compute/v2.1/servers/5debc9f2-4321-47d3-9215-8f2c02fe817d" status: 200 len: 1563 microversion: 2.1 time: 0.253646 Aug 11 00:12:14.403300 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3675/7140] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:12:14 2022] GET /compute/v2.1/servers/5debc9f2-4321-47d3-9215-8f2c02fe817d => generated 1563 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:12:35.637722 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-aada2942-321d-4088-a879-21cbe8161386 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 00:12:35.640041 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-aada2942-321d-4088-a879-21cbe8161386 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] [instance: 5debc9f2-4321-47d3-9215-8f2c02fe817d] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:12:35.644005 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_api:SELECT=5 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:12:35.644650 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=34 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:12:35.649190 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-aada2942-321d-4088-a879-21cbe8161386 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:12:35.649686 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-aada2942-321d-4088-a879-21cbe8161386 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:12:35.650122 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-aada2942-321d-4088-a879-21cbe8161386 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:12:35.650867 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-aada2942-321d-4088-a879-21cbe8161386 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:12:35.651334 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-aada2942-321d-4088-a879-21cbe8161386 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:12:35.651765 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-aada2942-321d-4088-a879-21cbe8161386 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:12:35.713868 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-aada2942-321d-4088-a879-21cbe8161386 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "POST /compute/v2.1/servers/5debc9f2-4321-47d3-9215-8f2c02fe817d/action" status: 200 len: 24571 microversion: 2.1 time: 0.080187 Aug 11 00:12:35.714573 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3466/7141] 10.222.0.58 () {60 vars in 1278 bytes} [Thu Aug 11 00:12:35 2022] POST /compute/v2.1/servers/5debc9f2-4321-47d3-9215-8f2c02fe817d/action => generated 24571 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 00:12:46.831895 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-3fc6db34-a371-47e9-94e7-3ba45041f01b tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 00:12:46.834240 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-3fc6db34-a371-47e9-94e7-3ba45041f01b tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] [instance: 5debc9f2-4321-47d3-9215-8f2c02fe817d] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:12:46.836731 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:12:46.837413 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=40 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:12:46.844402 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3fc6db34-a371-47e9-94e7-3ba45041f01b tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:12:46.844901 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3fc6db34-a371-47e9-94e7-3ba45041f01b tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:12:46.845361 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3fc6db34-a371-47e9-94e7-3ba45041f01b tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:12:46.846070 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3fc6db34-a371-47e9-94e7-3ba45041f01b tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:12:46.846539 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3fc6db34-a371-47e9-94e7-3ba45041f01b tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:12:46.847598 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3fc6db34-a371-47e9-94e7-3ba45041f01b tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:12:46.889397 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-3fc6db34-a371-47e9-94e7-3ba45041f01b tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '8e98a27e99564f0ca672fbc06423d9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26799bad802a44c18dfee33c758cbb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:12:46.897292 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-3fc6db34-a371-47e9-94e7-3ba45041f01b tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] [instance: 5debc9f2-4321-47d3-9215-8f2c02fe817d] Old instance type m1.heat2, new instance type m1.heat {{(pid=122633) resize /opt/stack/nova/nova/compute/api.py:4168}} Aug 11 00:12:46.905363 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-3fc6db34-a371-47e9-94e7-3ba45041f01b tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Flavor limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 11 00:12:46.905882 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-3fc6db34-a371-47e9-94e7-3ba45041f01b tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Image limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 11 00:12:46.906386 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-3fc6db34-a371-47e9-94e7-3ba45041f01b tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Flavor pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 11 00:12:46.906983 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-3fc6db34-a371-47e9-94e7-3ba45041f01b tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Image pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 11 00:12:46.907418 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-3fc6db34-a371-47e9-94e7-3ba45041f01b tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 11 00:12:46.970941 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-3fc6db34-a371-47e9-94e7-3ba45041f01b tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "POST /compute/v2.1/servers/5debc9f2-4321-47d3-9215-8f2c02fe817d/action" status: 202 len: 0 microversion: 2.1 time: 0.143043 Aug 11 00:12:46.971563 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3676/7142] 10.222.0.58 () {60 vars in 1278 bytes} [Thu Aug 11 00:12:46 2022] POST /compute/v2.1/servers/5debc9f2-4321-47d3-9215-8f2c02fe817d/action => generated 0 bytes in 144 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 11 00:12:46.980938 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-71287b0d-64ad-402d-bd48-1f33da01dff9 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:12:46.981762 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-71287b0d-64ad-402d-bd48-1f33da01dff9 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] [instance: 5debc9f2-4321-47d3-9215-8f2c02fe817d] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:12:46.984829 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_api:SELECT=2 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:12:46.985404 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=4 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:12:46.993460 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-71287b0d-64ad-402d-bd48-1f33da01dff9 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:12:46.994078 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-71287b0d-64ad-402d-bd48-1f33da01dff9 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:12:46.994698 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-71287b0d-64ad-402d-bd48-1f33da01dff9 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:12:46.995712 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-71287b0d-64ad-402d-bd48-1f33da01dff9 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:12:46.996198 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-71287b0d-64ad-402d-bd48-1f33da01dff9 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:12:46.996631 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-71287b0d-64ad-402d-bd48-1f33da01dff9 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:12:47.137835 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-71287b0d-64ad-402d-bd48-1f33da01dff9 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98a27e99564f0ca672fbc06423d9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26799bad802a44c18dfee33c758cbb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:12:47.146763 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-71287b0d-64ad-402d-bd48-1f33da01dff9 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "GET /compute/v2.1/servers/5debc9f2-4321-47d3-9215-8f2c02fe817d" status: 200 len: 1691 microversion: 2.1 time: 0.170061 Aug 11 00:12:47.147376 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3467/7143] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:12:46 2022] GET /compute/v2.1/servers/5debc9f2-4321-47d3-9215-8f2c02fe817d => generated 1691 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:12:48.171044 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-fabaafbc-da93-41fc-9950-725757cba672 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:12:48.171669 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-fabaafbc-da93-41fc-9950-725757cba672 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] [instance: 5debc9f2-4321-47d3-9215-8f2c02fe817d] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:12:48.182525 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fabaafbc-da93-41fc-9950-725757cba672 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:12:48.183051 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fabaafbc-da93-41fc-9950-725757cba672 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:12:48.183654 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fabaafbc-da93-41fc-9950-725757cba672 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:12:48.184378 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fabaafbc-da93-41fc-9950-725757cba672 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:12:48.184851 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fabaafbc-da93-41fc-9950-725757cba672 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:12:48.185298 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fabaafbc-da93-41fc-9950-725757cba672 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:12:48.333680 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-fabaafbc-da93-41fc-9950-725757cba672 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98a27e99564f0ca672fbc06423d9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26799bad802a44c18dfee33c758cbb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:12:48.341362 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-fabaafbc-da93-41fc-9950-725757cba672 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "GET /compute/v2.1/servers/5debc9f2-4321-47d3-9215-8f2c02fe817d" status: 200 len: 1691 microversion: 2.1 time: 0.175107 Aug 11 00:12:48.341945 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3677/7144] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:12:48 2022] GET /compute/v2.1/servers/5debc9f2-4321-47d3-9215-8f2c02fe817d => generated 1691 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:12:49.363676 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-26d2eca6-edc1-48bb-ae09-5beaceb86410 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:12:49.364221 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-26d2eca6-edc1-48bb-ae09-5beaceb86410 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] [instance: 5debc9f2-4321-47d3-9215-8f2c02fe817d] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:12:49.371899 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-26d2eca6-edc1-48bb-ae09-5beaceb86410 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:12:49.372388 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-26d2eca6-edc1-48bb-ae09-5beaceb86410 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:12:49.372828 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-26d2eca6-edc1-48bb-ae09-5beaceb86410 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:12:49.373521 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-26d2eca6-edc1-48bb-ae09-5beaceb86410 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:12:49.373977 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-26d2eca6-edc1-48bb-ae09-5beaceb86410 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:12:49.374406 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-26d2eca6-edc1-48bb-ae09-5beaceb86410 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:12:49.510274 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-26d2eca6-edc1-48bb-ae09-5beaceb86410 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98a27e99564f0ca672fbc06423d9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26799bad802a44c18dfee33c758cbb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:12:49.518265 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-26d2eca6-edc1-48bb-ae09-5beaceb86410 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "GET /compute/v2.1/servers/5debc9f2-4321-47d3-9215-8f2c02fe817d" status: 200 len: 1696 microversion: 2.1 time: 0.158480 Aug 11 00:12:49.519905 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3468/7145] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:12:49 2022] GET /compute/v2.1/servers/5debc9f2-4321-47d3-9215-8f2c02fe817d => generated 1696 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:12:50.540747 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-71a980f2-80f2-41a5-b59a-3c32e4066b92 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:12:50.541395 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-71a980f2-80f2-41a5-b59a-3c32e4066b92 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] [instance: 5debc9f2-4321-47d3-9215-8f2c02fe817d] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:12:50.548457 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-71a980f2-80f2-41a5-b59a-3c32e4066b92 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:12:50.548977 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-71a980f2-80f2-41a5-b59a-3c32e4066b92 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:12:50.549429 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-71a980f2-80f2-41a5-b59a-3c32e4066b92 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:12:50.550230 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-71a980f2-80f2-41a5-b59a-3c32e4066b92 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:12:50.550707 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-71a980f2-80f2-41a5-b59a-3c32e4066b92 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:12:50.551172 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-71a980f2-80f2-41a5-b59a-3c32e4066b92 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:12:50.683079 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-71a980f2-80f2-41a5-b59a-3c32e4066b92 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98a27e99564f0ca672fbc06423d9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26799bad802a44c18dfee33c758cbb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:12:50.691395 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-71a980f2-80f2-41a5-b59a-3c32e4066b92 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "GET /compute/v2.1/servers/5debc9f2-4321-47d3-9215-8f2c02fe817d" status: 200 len: 1696 microversion: 2.1 time: 0.153799 Aug 11 00:12:50.691810 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3678/7146] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:12:50 2022] GET /compute/v2.1/servers/5debc9f2-4321-47d3-9215-8f2c02fe817d => generated 1696 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:12:51.713766 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-5b9323c5-5394-48cd-a455-8385a9bf09b9 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:12:51.714422 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-5b9323c5-5394-48cd-a455-8385a9bf09b9 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] [instance: 5debc9f2-4321-47d3-9215-8f2c02fe817d] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:12:51.721416 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5b9323c5-5394-48cd-a455-8385a9bf09b9 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:12:51.722478 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5b9323c5-5394-48cd-a455-8385a9bf09b9 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:12:51.722983 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5b9323c5-5394-48cd-a455-8385a9bf09b9 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:12:51.723697 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5b9323c5-5394-48cd-a455-8385a9bf09b9 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:12:51.724151 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5b9323c5-5394-48cd-a455-8385a9bf09b9 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:12:51.724570 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5b9323c5-5394-48cd-a455-8385a9bf09b9 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:12:51.876057 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-5b9323c5-5394-48cd-a455-8385a9bf09b9 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98a27e99564f0ca672fbc06423d9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26799bad802a44c18dfee33c758cbb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:12:51.885713 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-5b9323c5-5394-48cd-a455-8385a9bf09b9 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "GET /compute/v2.1/servers/5debc9f2-4321-47d3-9215-8f2c02fe817d" status: 200 len: 1696 microversion: 2.1 time: 0.176914 Aug 11 00:12:51.886292 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3469/7147] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:12:51 2022] GET /compute/v2.1/servers/5debc9f2-4321-47d3-9215-8f2c02fe817d => generated 1696 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:12:52.909990 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-4f03192a-bc4e-4e4a-9d97-dbb415bc98b3 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:12:52.910623 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-4f03192a-bc4e-4e4a-9d97-dbb415bc98b3 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] [instance: 5debc9f2-4321-47d3-9215-8f2c02fe817d] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:12:52.917567 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4f03192a-bc4e-4e4a-9d97-dbb415bc98b3 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:12:52.918067 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4f03192a-bc4e-4e4a-9d97-dbb415bc98b3 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:12:52.918523 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4f03192a-bc4e-4e4a-9d97-dbb415bc98b3 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:12:52.919305 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4f03192a-bc4e-4e4a-9d97-dbb415bc98b3 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:12:52.919774 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4f03192a-bc4e-4e4a-9d97-dbb415bc98b3 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:12:52.920220 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4f03192a-bc4e-4e4a-9d97-dbb415bc98b3 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:12:53.055705 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-4f03192a-bc4e-4e4a-9d97-dbb415bc98b3 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98a27e99564f0ca672fbc06423d9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26799bad802a44c18dfee33c758cbb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:12:53.063236 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-4f03192a-bc4e-4e4a-9d97-dbb415bc98b3 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "GET /compute/v2.1/servers/5debc9f2-4321-47d3-9215-8f2c02fe817d" status: 200 len: 1696 microversion: 2.1 time: 0.157564 Aug 11 00:12:53.063811 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3679/7148] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:12:52 2022] GET /compute/v2.1/servers/5debc9f2-4321-47d3-9215-8f2c02fe817d => generated 1696 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:12:54.085721 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-2a51be73-f6fd-4ed8-acf3-2633a2d7830e tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:12:54.086355 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-2a51be73-f6fd-4ed8-acf3-2633a2d7830e tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] [instance: 5debc9f2-4321-47d3-9215-8f2c02fe817d] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:12:54.093331 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2a51be73-f6fd-4ed8-acf3-2633a2d7830e tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:12:54.093820 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2a51be73-f6fd-4ed8-acf3-2633a2d7830e tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:12:54.094266 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2a51be73-f6fd-4ed8-acf3-2633a2d7830e tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:12:54.095010 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2a51be73-f6fd-4ed8-acf3-2633a2d7830e tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:12:54.095474 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2a51be73-f6fd-4ed8-acf3-2633a2d7830e tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:12:54.095912 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2a51be73-f6fd-4ed8-acf3-2633a2d7830e tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:12:54.230154 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-2a51be73-f6fd-4ed8-acf3-2633a2d7830e tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98a27e99564f0ca672fbc06423d9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26799bad802a44c18dfee33c758cbb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:12:54.237957 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-2a51be73-f6fd-4ed8-acf3-2633a2d7830e tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "GET /compute/v2.1/servers/5debc9f2-4321-47d3-9215-8f2c02fe817d" status: 200 len: 1696 microversion: 2.1 time: 0.156545 Aug 11 00:12:54.238534 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3470/7149] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:12:54 2022] GET /compute/v2.1/servers/5debc9f2-4321-47d3-9215-8f2c02fe817d => generated 1696 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:12:55.260039 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-efe11272-dc88-49a2-9224-7e6a405a8fce tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:12:55.260582 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-efe11272-dc88-49a2-9224-7e6a405a8fce tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] [instance: 5debc9f2-4321-47d3-9215-8f2c02fe817d] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:12:55.267504 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-efe11272-dc88-49a2-9224-7e6a405a8fce tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:12:55.268003 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-efe11272-dc88-49a2-9224-7e6a405a8fce tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:12:55.268463 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-efe11272-dc88-49a2-9224-7e6a405a8fce tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:12:55.269175 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-efe11272-dc88-49a2-9224-7e6a405a8fce tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:12:55.269808 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-efe11272-dc88-49a2-9224-7e6a405a8fce tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:12:55.270256 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-efe11272-dc88-49a2-9224-7e6a405a8fce tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:12:55.400474 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-efe11272-dc88-49a2-9224-7e6a405a8fce tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98a27e99564f0ca672fbc06423d9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26799bad802a44c18dfee33c758cbb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:12:55.407942 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-efe11272-dc88-49a2-9224-7e6a405a8fce tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "GET /compute/v2.1/servers/5debc9f2-4321-47d3-9215-8f2c02fe817d" status: 200 len: 1696 microversion: 2.1 time: 0.152261 Aug 11 00:12:55.408515 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3680/7150] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:12:55 2022] GET /compute/v2.1/servers/5debc9f2-4321-47d3-9215-8f2c02fe817d => generated 1696 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:12:56.430943 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-3805abbb-3ea0-4a08-bd27-dbba884ef87f tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:12:56.431488 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-3805abbb-3ea0-4a08-bd27-dbba884ef87f tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] [instance: 5debc9f2-4321-47d3-9215-8f2c02fe817d] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:12:56.438628 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3805abbb-3ea0-4a08-bd27-dbba884ef87f tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:12:56.439161 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3805abbb-3ea0-4a08-bd27-dbba884ef87f tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:12:56.439603 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3805abbb-3ea0-4a08-bd27-dbba884ef87f tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:12:56.440315 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3805abbb-3ea0-4a08-bd27-dbba884ef87f tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:12:56.441463 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3805abbb-3ea0-4a08-bd27-dbba884ef87f tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:12:56.441899 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3805abbb-3ea0-4a08-bd27-dbba884ef87f tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:12:56.585537 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-3805abbb-3ea0-4a08-bd27-dbba884ef87f tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98a27e99564f0ca672fbc06423d9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26799bad802a44c18dfee33c758cbb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:12:56.600150 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-3805abbb-3ea0-4a08-bd27-dbba884ef87f tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "GET /compute/v2.1/servers/5debc9f2-4321-47d3-9215-8f2c02fe817d" status: 200 len: 1696 microversion: 2.1 time: 0.172910 Aug 11 00:12:56.601235 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3471/7151] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:12:56 2022] GET /compute/v2.1/servers/5debc9f2-4321-47d3-9215-8f2c02fe817d => generated 1696 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:12:57.623423 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-bb0b4d58-fc0e-4e83-8f2b-79c5e9cc04d9 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:12:57.624052 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-bb0b4d58-fc0e-4e83-8f2b-79c5e9cc04d9 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] [instance: 5debc9f2-4321-47d3-9215-8f2c02fe817d] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:12:57.631773 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bb0b4d58-fc0e-4e83-8f2b-79c5e9cc04d9 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:12:57.632274 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bb0b4d58-fc0e-4e83-8f2b-79c5e9cc04d9 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:12:57.632729 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bb0b4d58-fc0e-4e83-8f2b-79c5e9cc04d9 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:12:57.633710 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bb0b4d58-fc0e-4e83-8f2b-79c5e9cc04d9 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:12:57.634181 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bb0b4d58-fc0e-4e83-8f2b-79c5e9cc04d9 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:12:57.634624 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-bb0b4d58-fc0e-4e83-8f2b-79c5e9cc04d9 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:12:57.774943 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-bb0b4d58-fc0e-4e83-8f2b-79c5e9cc04d9 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98a27e99564f0ca672fbc06423d9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26799bad802a44c18dfee33c758cbb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:12:57.783503 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-bb0b4d58-fc0e-4e83-8f2b-79c5e9cc04d9 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "GET /compute/v2.1/servers/5debc9f2-4321-47d3-9215-8f2c02fe817d" status: 200 len: 1696 microversion: 2.1 time: 0.163861 Aug 11 00:12:57.784110 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3681/7152] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:12:57 2022] GET /compute/v2.1/servers/5debc9f2-4321-47d3-9215-8f2c02fe817d => generated 1696 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:12:58.805302 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-2e078d3a-b797-496c-a5b3-3d5395a5f6e9 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:12:58.805914 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-2e078d3a-b797-496c-a5b3-3d5395a5f6e9 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] [instance: 5debc9f2-4321-47d3-9215-8f2c02fe817d] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:12:58.813068 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2e078d3a-b797-496c-a5b3-3d5395a5f6e9 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:12:58.813555 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2e078d3a-b797-496c-a5b3-3d5395a5f6e9 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:12:58.813991 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2e078d3a-b797-496c-a5b3-3d5395a5f6e9 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:12:58.814687 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2e078d3a-b797-496c-a5b3-3d5395a5f6e9 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:12:58.815173 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2e078d3a-b797-496c-a5b3-3d5395a5f6e9 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:12:58.815600 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2e078d3a-b797-496c-a5b3-3d5395a5f6e9 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:12:58.949558 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-2e078d3a-b797-496c-a5b3-3d5395a5f6e9 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98a27e99564f0ca672fbc06423d9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26799bad802a44c18dfee33c758cbb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:12:58.957196 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-2e078d3a-b797-496c-a5b3-3d5395a5f6e9 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "GET /compute/v2.1/servers/5debc9f2-4321-47d3-9215-8f2c02fe817d" status: 200 len: 1696 microversion: 2.1 time: 0.155882 Aug 11 00:12:58.957784 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3472/7153] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:12:58 2022] GET /compute/v2.1/servers/5debc9f2-4321-47d3-9215-8f2c02fe817d => generated 1696 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:12:59.979813 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-794a7df0-560e-42d8-98c5-614e29651788 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:12:59.980433 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-794a7df0-560e-42d8-98c5-614e29651788 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] [instance: 5debc9f2-4321-47d3-9215-8f2c02fe817d] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:12:59.987294 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-794a7df0-560e-42d8-98c5-614e29651788 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:12:59.987786 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-794a7df0-560e-42d8-98c5-614e29651788 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:12:59.988236 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-794a7df0-560e-42d8-98c5-614e29651788 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:12:59.988937 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-794a7df0-560e-42d8-98c5-614e29651788 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:12:59.989470 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-794a7df0-560e-42d8-98c5-614e29651788 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:12:59.990003 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-794a7df0-560e-42d8-98c5-614e29651788 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:13:00.124506 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-794a7df0-560e-42d8-98c5-614e29651788 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98a27e99564f0ca672fbc06423d9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26799bad802a44c18dfee33c758cbb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:13:00.132737 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-794a7df0-560e-42d8-98c5-614e29651788 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "GET /compute/v2.1/servers/5debc9f2-4321-47d3-9215-8f2c02fe817d" status: 200 len: 1696 microversion: 2.1 time: 0.156538 Aug 11 00:13:00.133943 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3682/7154] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:12:59 2022] GET /compute/v2.1/servers/5debc9f2-4321-47d3-9215-8f2c02fe817d => generated 1696 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:13:01.163635 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-92e03c2c-f105-4a0b-8d4d-13d8e240eee5 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:13:01.164484 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-92e03c2c-f105-4a0b-8d4d-13d8e240eee5 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] [instance: 5debc9f2-4321-47d3-9215-8f2c02fe817d] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:13:01.171549 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-92e03c2c-f105-4a0b-8d4d-13d8e240eee5 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:13:01.172035 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-92e03c2c-f105-4a0b-8d4d-13d8e240eee5 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:13:01.172474 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-92e03c2c-f105-4a0b-8d4d-13d8e240eee5 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:13:01.173181 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-92e03c2c-f105-4a0b-8d4d-13d8e240eee5 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:13:01.173631 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-92e03c2c-f105-4a0b-8d4d-13d8e240eee5 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:13:01.174056 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-92e03c2c-f105-4a0b-8d4d-13d8e240eee5 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:13:01.311550 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-92e03c2c-f105-4a0b-8d4d-13d8e240eee5 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98a27e99564f0ca672fbc06423d9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26799bad802a44c18dfee33c758cbb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:13:01.319188 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-92e03c2c-f105-4a0b-8d4d-13d8e240eee5 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "GET /compute/v2.1/servers/5debc9f2-4321-47d3-9215-8f2c02fe817d" status: 200 len: 1696 microversion: 2.1 time: 0.160345 Aug 11 00:13:01.319776 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3473/7155] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:13:01 2022] GET /compute/v2.1/servers/5debc9f2-4321-47d3-9215-8f2c02fe817d => generated 1696 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 00:13:02.340756 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-b5f1dfc6-4dd7-4d60-a2f1-00ae7751039d tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:13:02.341410 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-b5f1dfc6-4dd7-4d60-a2f1-00ae7751039d tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] [instance: 5debc9f2-4321-47d3-9215-8f2c02fe817d] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:13:02.347638 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b5f1dfc6-4dd7-4d60-a2f1-00ae7751039d tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:13:02.348130 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b5f1dfc6-4dd7-4d60-a2f1-00ae7751039d tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:13:02.348580 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b5f1dfc6-4dd7-4d60-a2f1-00ae7751039d tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:13:02.349436 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b5f1dfc6-4dd7-4d60-a2f1-00ae7751039d tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:13:02.349937 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b5f1dfc6-4dd7-4d60-a2f1-00ae7751039d tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:13:02.350378 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b5f1dfc6-4dd7-4d60-a2f1-00ae7751039d tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:13:02.483918 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-b5f1dfc6-4dd7-4d60-a2f1-00ae7751039d tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98a27e99564f0ca672fbc06423d9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26799bad802a44c18dfee33c758cbb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:13:02.492516 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-b5f1dfc6-4dd7-4d60-a2f1-00ae7751039d tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "GET /compute/v2.1/servers/5debc9f2-4321-47d3-9215-8f2c02fe817d" status: 200 len: 1696 microversion: 2.1 time: 0.155807 Aug 11 00:13:02.493113 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3683/7156] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:13:02 2022] GET /compute/v2.1/servers/5debc9f2-4321-47d3-9215-8f2c02fe817d => generated 1696 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:13:03.515161 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-0327c18c-ce94-4324-ab4e-7008cd6694c1 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:13:03.515759 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-0327c18c-ce94-4324-ab4e-7008cd6694c1 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] [instance: 5debc9f2-4321-47d3-9215-8f2c02fe817d] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:13:03.523860 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0327c18c-ce94-4324-ab4e-7008cd6694c1 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:13:03.524353 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0327c18c-ce94-4324-ab4e-7008cd6694c1 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:13:03.524791 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0327c18c-ce94-4324-ab4e-7008cd6694c1 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:13:03.525499 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0327c18c-ce94-4324-ab4e-7008cd6694c1 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:13:03.525957 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0327c18c-ce94-4324-ab4e-7008cd6694c1 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:13:03.526384 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0327c18c-ce94-4324-ab4e-7008cd6694c1 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:13:03.668821 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-0327c18c-ce94-4324-ab4e-7008cd6694c1 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98a27e99564f0ca672fbc06423d9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26799bad802a44c18dfee33c758cbb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:13:03.676424 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-0327c18c-ce94-4324-ab4e-7008cd6694c1 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "GET /compute/v2.1/servers/5debc9f2-4321-47d3-9215-8f2c02fe817d" status: 200 len: 1696 microversion: 2.1 time: 0.165285 Aug 11 00:13:03.677529 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3474/7157] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:13:03 2022] GET /compute/v2.1/servers/5debc9f2-4321-47d3-9215-8f2c02fe817d => generated 1696 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:13:04.699403 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-16aeede6-33da-40af-ae59-da9a1dc3b0cb tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:13:04.700021 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-16aeede6-33da-40af-ae59-da9a1dc3b0cb tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] [instance: 5debc9f2-4321-47d3-9215-8f2c02fe817d] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:13:04.707078 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-16aeede6-33da-40af-ae59-da9a1dc3b0cb tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:13:04.707572 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-16aeede6-33da-40af-ae59-da9a1dc3b0cb tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:13:04.708017 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-16aeede6-33da-40af-ae59-da9a1dc3b0cb tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:13:04.709945 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-16aeede6-33da-40af-ae59-da9a1dc3b0cb tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:13:04.710412 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-16aeede6-33da-40af-ae59-da9a1dc3b0cb tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:13:04.710907 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-16aeede6-33da-40af-ae59-da9a1dc3b0cb tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:13:04.849732 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-16aeede6-33da-40af-ae59-da9a1dc3b0cb tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98a27e99564f0ca672fbc06423d9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26799bad802a44c18dfee33c758cbb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:13:04.857694 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-16aeede6-33da-40af-ae59-da9a1dc3b0cb tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "GET /compute/v2.1/servers/5debc9f2-4321-47d3-9215-8f2c02fe817d" status: 200 len: 1696 microversion: 2.1 time: 0.162177 Aug 11 00:13:04.858279 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3684/7158] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:13:04 2022] GET /compute/v2.1/servers/5debc9f2-4321-47d3-9215-8f2c02fe817d => generated 1696 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:13:05.879036 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-3293b7b1-4965-439f-8dd5-fd25797c9284 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:13:05.879674 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-3293b7b1-4965-439f-8dd5-fd25797c9284 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] [instance: 5debc9f2-4321-47d3-9215-8f2c02fe817d] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:13:05.887282 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3293b7b1-4965-439f-8dd5-fd25797c9284 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:13:05.887769 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3293b7b1-4965-439f-8dd5-fd25797c9284 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:13:05.888208 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3293b7b1-4965-439f-8dd5-fd25797c9284 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:13:05.888911 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3293b7b1-4965-439f-8dd5-fd25797c9284 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:13:05.889363 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3293b7b1-4965-439f-8dd5-fd25797c9284 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:13:05.889789 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3293b7b1-4965-439f-8dd5-fd25797c9284 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:13:06.029322 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-3293b7b1-4965-439f-8dd5-fd25797c9284 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98a27e99564f0ca672fbc06423d9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26799bad802a44c18dfee33c758cbb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:13:06.038040 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-3293b7b1-4965-439f-8dd5-fd25797c9284 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "GET /compute/v2.1/servers/5debc9f2-4321-47d3-9215-8f2c02fe817d" status: 200 len: 1696 microversion: 2.1 time: 0.162743 Aug 11 00:13:06.038712 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3475/7159] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:13:05 2022] GET /compute/v2.1/servers/5debc9f2-4321-47d3-9215-8f2c02fe817d => generated 1696 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:13:06.674617 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-c09d2f93-1e2c-4579-97f2-eb7df36faa71 req-988acd11-c2a4-46d4-9636-2f0324f22b05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5debc9f2-4321-47d3-9215-8f2c02fe817d", "name": "network-vif-unplugged", "status": "completed", "tag": "114be6dc-3b5a-425e-b67b-ef5a236c9b0c"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 00:13:06.685086 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-c09d2f93-1e2c-4579-97f2-eb7df36faa71 req-988acd11-c2a4-46d4-9636-2f0324f22b05 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:13:06.685586 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-c09d2f93-1e2c-4579-97f2-eb7df36faa71 req-988acd11-c2a4-46d4-9636-2f0324f22b05 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:13:06.686038 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-c09d2f93-1e2c-4579-97f2-eb7df36faa71 req-988acd11-c2a4-46d4-9636-2f0324f22b05 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:13:06.698668 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-c09d2f93-1e2c-4579-97f2-eb7df36faa71 req-988acd11-c2a4-46d4-9636-2f0324f22b05 service nova] Creating event network-vif-unplugged:114be6dc-3b5a-425e-b67b-ef5a236c9b0c for instance 5debc9f2-4321-47d3-9215-8f2c02fe817d on n-h2-850468-14 Aug 11 00:13:06.704190 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [req-c09d2f93-1e2c-4579-97f2-eb7df36faa71 req-988acd11-c2a4-46d4-9636-2f0324f22b05 service nova] Instance 5debc9f2-4321-47d3-9215-8f2c02fe817d is migrating within the same cell, copying events to all relevant hosts: {'n-h1-850468-14', 'n-h2-850468-14'} {{(pid=122633) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5901}} Aug 11 00:13:06.716033 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-c09d2f93-1e2c-4579-97f2-eb7df36faa71 req-988acd11-c2a4-46d4-9636-2f0324f22b05 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.104662 Aug 11 00:13:06.716664 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3685/7160] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 11 00:13:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 00:13:07.061411 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-e7101d40-9a24-4c8e-8a24-edc9ceb81fb0 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:13:07.062139 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-e7101d40-9a24-4c8e-8a24-edc9ceb81fb0 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] [instance: 5debc9f2-4321-47d3-9215-8f2c02fe817d] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:13:07.070212 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e7101d40-9a24-4c8e-8a24-edc9ceb81fb0 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:13:07.070711 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e7101d40-9a24-4c8e-8a24-edc9ceb81fb0 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:13:07.071184 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e7101d40-9a24-4c8e-8a24-edc9ceb81fb0 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:13:07.072058 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e7101d40-9a24-4c8e-8a24-edc9ceb81fb0 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:13:07.072513 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e7101d40-9a24-4c8e-8a24-edc9ceb81fb0 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:13:07.072936 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e7101d40-9a24-4c8e-8a24-edc9ceb81fb0 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:13:07.216291 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-e7101d40-9a24-4c8e-8a24-edc9ceb81fb0 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98a27e99564f0ca672fbc06423d9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26799bad802a44c18dfee33c758cbb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:13:07.224515 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-e7101d40-9a24-4c8e-8a24-edc9ceb81fb0 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "GET /compute/v2.1/servers/5debc9f2-4321-47d3-9215-8f2c02fe817d" status: 200 len: 1695 microversion: 2.1 time: 0.166601 Aug 11 00:13:07.225105 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3476/7161] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:13:07 2022] GET /compute/v2.1/servers/5debc9f2-4321-47d3-9215-8f2c02fe817d => generated 1695 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:13:08.253685 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-d10e2dee-c0b7-4e80-a7c6-daad874a85bf tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:13:08.255911 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-d10e2dee-c0b7-4e80-a7c6-daad874a85bf tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] [instance: 5debc9f2-4321-47d3-9215-8f2c02fe817d] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:13:08.263579 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d10e2dee-c0b7-4e80-a7c6-daad874a85bf tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:13:08.264076 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d10e2dee-c0b7-4e80-a7c6-daad874a85bf tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:13:08.264527 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d10e2dee-c0b7-4e80-a7c6-daad874a85bf tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:13:08.265335 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d10e2dee-c0b7-4e80-a7c6-daad874a85bf tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:13:08.266738 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d10e2dee-c0b7-4e80-a7c6-daad874a85bf tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:13:08.266738 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d10e2dee-c0b7-4e80-a7c6-daad874a85bf tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:13:08.402873 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-d10e2dee-c0b7-4e80-a7c6-daad874a85bf tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98a27e99564f0ca672fbc06423d9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26799bad802a44c18dfee33c758cbb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:13:08.410405 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-d10e2dee-c0b7-4e80-a7c6-daad874a85bf tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "GET /compute/v2.1/servers/5debc9f2-4321-47d3-9215-8f2c02fe817d" status: 200 len: 1693 microversion: 2.1 time: 0.166535 Aug 11 00:13:08.411024 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3686/7162] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:13:08 2022] GET /compute/v2.1/servers/5debc9f2-4321-47d3-9215-8f2c02fe817d => generated 1693 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:13:08.732301 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-361ef05b-f278-4cc8-83ae-e4f716bcb413 req-75bcc5d3-00db-47de-aca6-9a65359797f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5debc9f2-4321-47d3-9215-8f2c02fe817d", "tag": "114be6dc-3b5a-425e-b67b-ef5a236c9b0c"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 00:13:08.743258 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-361ef05b-f278-4cc8-83ae-e4f716bcb413 req-75bcc5d3-00db-47de-aca6-9a65359797f2 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:13:08.743745 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-361ef05b-f278-4cc8-83ae-e4f716bcb413 req-75bcc5d3-00db-47de-aca6-9a65359797f2 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:13:08.744176 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-361ef05b-f278-4cc8-83ae-e4f716bcb413 req-75bcc5d3-00db-47de-aca6-9a65359797f2 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:13:08.755862 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-361ef05b-f278-4cc8-83ae-e4f716bcb413 req-75bcc5d3-00db-47de-aca6-9a65359797f2 service nova] Creating event network-changed:114be6dc-3b5a-425e-b67b-ef5a236c9b0c for instance 5debc9f2-4321-47d3-9215-8f2c02fe817d on n-h2-850468-14 Aug 11 00:13:08.761396 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [req-361ef05b-f278-4cc8-83ae-e4f716bcb413 req-75bcc5d3-00db-47de-aca6-9a65359797f2 service nova] Instance 5debc9f2-4321-47d3-9215-8f2c02fe817d is migrating within the same cell, copying events to all relevant hosts: {'n-h1-850468-14', 'n-h2-850468-14'} {{(pid=122632) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5901}} Aug 11 00:13:08.772879 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-361ef05b-f278-4cc8-83ae-e4f716bcb413 req-75bcc5d3-00db-47de-aca6-9a65359797f2 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044279 Aug 11 00:13:08.773407 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3477/7163] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 11 00:13:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 00:13:09.433671 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-cf3b9352-85c8-4a56-b00d-8c60da972538 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:13:09.434336 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-cf3b9352-85c8-4a56-b00d-8c60da972538 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] [instance: 5debc9f2-4321-47d3-9215-8f2c02fe817d] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:13:09.441358 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cf3b9352-85c8-4a56-b00d-8c60da972538 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:13:09.441845 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cf3b9352-85c8-4a56-b00d-8c60da972538 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:13:09.442303 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cf3b9352-85c8-4a56-b00d-8c60da972538 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:13:09.443662 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cf3b9352-85c8-4a56-b00d-8c60da972538 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:13:09.444223 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cf3b9352-85c8-4a56-b00d-8c60da972538 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:13:09.444641 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cf3b9352-85c8-4a56-b00d-8c60da972538 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:13:09.651039 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-cf3b9352-85c8-4a56-b00d-8c60da972538 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98a27e99564f0ca672fbc06423d9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26799bad802a44c18dfee33c758cbb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:13:09.658636 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-cf3b9352-85c8-4a56-b00d-8c60da972538 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "GET /compute/v2.1/servers/5debc9f2-4321-47d3-9215-8f2c02fe817d" status: 200 len: 1693 microversion: 2.1 time: 0.228871 Aug 11 00:13:09.659177 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3687/7164] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:13:09 2022] GET /compute/v2.1/servers/5debc9f2-4321-47d3-9215-8f2c02fe817d => generated 1693 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:13:10.683184 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-4704e220-6103-47d6-819f-de34b3775295 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:13:10.683884 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-4704e220-6103-47d6-819f-de34b3775295 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] [instance: 5debc9f2-4321-47d3-9215-8f2c02fe817d] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:13:10.691909 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4704e220-6103-47d6-819f-de34b3775295 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:13:10.692394 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4704e220-6103-47d6-819f-de34b3775295 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:13:10.693467 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4704e220-6103-47d6-819f-de34b3775295 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:13:10.694191 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4704e220-6103-47d6-819f-de34b3775295 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:13:10.694650 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4704e220-6103-47d6-819f-de34b3775295 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:13:10.695114 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4704e220-6103-47d6-819f-de34b3775295 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:13:10.832536 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-4704e220-6103-47d6-819f-de34b3775295 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98a27e99564f0ca672fbc06423d9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26799bad802a44c18dfee33c758cbb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:13:10.840992 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-4704e220-6103-47d6-819f-de34b3775295 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "GET /compute/v2.1/servers/5debc9f2-4321-47d3-9215-8f2c02fe817d" status: 200 len: 1690 microversion: 2.1 time: 0.164024 Aug 11 00:13:10.841590 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3478/7165] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:13:10 2022] GET /compute/v2.1/servers/5debc9f2-4321-47d3-9215-8f2c02fe817d => generated 1690 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:13:10.862816 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-18fcaa4f-6eb3-43ab-94ca-569b1f3f745a tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 00:13:10.863377 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-18fcaa4f-6eb3-43ab-94ca-569b1f3f745a tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] [instance: 5debc9f2-4321-47d3-9215-8f2c02fe817d] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:13:10.871432 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-18fcaa4f-6eb3-43ab-94ca-569b1f3f745a tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:13:10.872037 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-18fcaa4f-6eb3-43ab-94ca-569b1f3f745a tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:13:10.872579 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-18fcaa4f-6eb3-43ab-94ca-569b1f3f745a tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:13:10.873315 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-18fcaa4f-6eb3-43ab-94ca-569b1f3f745a tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:13:10.873941 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-18fcaa4f-6eb3-43ab-94ca-569b1f3f745a tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:13:10.874420 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-18fcaa4f-6eb3-43ab-94ca-569b1f3f745a tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:13:10.935985 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-18fcaa4f-6eb3-43ab-94ca-569b1f3f745a tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "POST /compute/v2.1/servers/5debc9f2-4321-47d3-9215-8f2c02fe817d/action" status: 204 len: 0 microversion: 2.1 time: 0.076973 Aug 11 00:13:10.936745 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3688/7166] 10.222.0.58 () {60 vars in 1278 bytes} [Thu Aug 11 00:13:10 2022] POST /compute/v2.1/servers/5debc9f2-4321-47d3-9215-8f2c02fe817d/action => generated 0 bytes in 79 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 11 00:13:10.946643 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-72a868b6-219a-4452-b80f-8390977e4fac tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:13:10.947310 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-72a868b6-219a-4452-b80f-8390977e4fac tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] [instance: 5debc9f2-4321-47d3-9215-8f2c02fe817d] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:13:10.953804 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-72a868b6-219a-4452-b80f-8390977e4fac tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:13:10.954404 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-72a868b6-219a-4452-b80f-8390977e4fac tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:13:10.955442 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-72a868b6-219a-4452-b80f-8390977e4fac tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:13:10.956414 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-72a868b6-219a-4452-b80f-8390977e4fac tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:13:10.956946 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-72a868b6-219a-4452-b80f-8390977e4fac tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:13:10.957380 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-72a868b6-219a-4452-b80f-8390977e4fac tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:13:11.102080 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-72a868b6-219a-4452-b80f-8390977e4fac tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98a27e99564f0ca672fbc06423d9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26799bad802a44c18dfee33c758cbb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:13:11.110017 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-72a868b6-219a-4452-b80f-8390977e4fac tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "GET /compute/v2.1/servers/5debc9f2-4321-47d3-9215-8f2c02fe817d" status: 200 len: 1690 microversion: 2.1 time: 0.168762 Aug 11 00:13:11.110607 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3479/7167] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:13:10 2022] GET /compute/v2.1/servers/5debc9f2-4321-47d3-9215-8f2c02fe817d => generated 1690 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:13:11.132376 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c7ae0f84-240d-4fe3-addc-19d5a81bfbed tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:13:11.133340 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-c7ae0f84-240d-4fe3-addc-19d5a81bfbed tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] [instance: 5debc9f2-4321-47d3-9215-8f2c02fe817d] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:13:11.139627 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c7ae0f84-240d-4fe3-addc-19d5a81bfbed tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:13:11.140120 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c7ae0f84-240d-4fe3-addc-19d5a81bfbed tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:13:11.140568 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c7ae0f84-240d-4fe3-addc-19d5a81bfbed tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:13:11.141278 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c7ae0f84-240d-4fe3-addc-19d5a81bfbed tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:13:11.141740 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c7ae0f84-240d-4fe3-addc-19d5a81bfbed tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:13:11.142223 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c7ae0f84-240d-4fe3-addc-19d5a81bfbed tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:13:11.377605 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-c7ae0f84-240d-4fe3-addc-19d5a81bfbed tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98a27e99564f0ca672fbc06423d9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26799bad802a44c18dfee33c758cbb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:13:11.385924 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-c7ae0f84-240d-4fe3-addc-19d5a81bfbed tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "GET /compute/v2.1/servers/5debc9f2-4321-47d3-9215-8f2c02fe817d" status: 200 len: 1690 microversion: 2.1 time: 0.258852 Aug 11 00:13:11.386545 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3689/7168] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:13:11 2022] GET /compute/v2.1/servers/5debc9f2-4321-47d3-9215-8f2c02fe817d => generated 1690 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:13:12.409222 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-17253340-9b07-452f-accc-3e4907015590 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:13:12.409865 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-17253340-9b07-452f-accc-3e4907015590 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] [instance: 5debc9f2-4321-47d3-9215-8f2c02fe817d] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:13:12.416594 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-17253340-9b07-452f-accc-3e4907015590 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:13:12.417085 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-17253340-9b07-452f-accc-3e4907015590 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:13:12.417532 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-17253340-9b07-452f-accc-3e4907015590 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:13:12.418238 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-17253340-9b07-452f-accc-3e4907015590 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:13:12.418752 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-17253340-9b07-452f-accc-3e4907015590 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:13:12.419515 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-17253340-9b07-452f-accc-3e4907015590 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:13:12.482640 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-c8ac849f-2fc6-4133-ba05-0c4dcff6aa3d req-220898b2-0578-4943-afd7-7d966bafb5b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5debc9f2-4321-47d3-9215-8f2c02fe817d", "name": "network-vif-plugged", "status": "completed", "tag": "114be6dc-3b5a-425e-b67b-ef5a236c9b0c"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 00:13:12.493985 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-c8ac849f-2fc6-4133-ba05-0c4dcff6aa3d req-220898b2-0578-4943-afd7-7d966bafb5b9 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:13:12.494806 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-c8ac849f-2fc6-4133-ba05-0c4dcff6aa3d req-220898b2-0578-4943-afd7-7d966bafb5b9 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:13:12.495453 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-c8ac849f-2fc6-4133-ba05-0c4dcff6aa3d req-220898b2-0578-4943-afd7-7d966bafb5b9 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:13:12.510708 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-c8ac849f-2fc6-4133-ba05-0c4dcff6aa3d req-220898b2-0578-4943-afd7-7d966bafb5b9 service nova] Creating event network-vif-plugged:114be6dc-3b5a-425e-b67b-ef5a236c9b0c for instance 5debc9f2-4321-47d3-9215-8f2c02fe817d on n-h2-850468-14 Aug 11 00:13:12.520541 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-c8ac849f-2fc6-4133-ba05-0c4dcff6aa3d req-220898b2-0578-4943-afd7-7d966bafb5b9 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041643 Aug 11 00:13:12.522396 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3690/7169] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 11 00:13:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 11 00:13:12.566566 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-17253340-9b07-452f-accc-3e4907015590 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98a27e99564f0ca672fbc06423d9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26799bad802a44c18dfee33c758cbb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:13:12.574549 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-17253340-9b07-452f-accc-3e4907015590 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "GET /compute/v2.1/servers/5debc9f2-4321-47d3-9215-8f2c02fe817d" status: 200 len: 1682 microversion: 2.1 time: 0.170062 Aug 11 00:13:12.575160 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3480/7170] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:13:12 2022] GET /compute/v2.1/servers/5debc9f2-4321-47d3-9215-8f2c02fe817d => generated 1682 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:13:36.765714 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_api:SELECT=34 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:13:36.766487 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:13:36.771001 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-d1116ad3-d29e-40b9-bb07-14fb43a441d0 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 00:13:36.773852 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-d1116ad3-d29e-40b9-bb07-14fb43a441d0 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] [instance: 5debc9f2-4321-47d3-9215-8f2c02fe817d] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:13:36.781340 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d1116ad3-d29e-40b9-bb07-14fb43a441d0 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:13:36.781801 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d1116ad3-d29e-40b9-bb07-14fb43a441d0 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:13:36.782253 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d1116ad3-d29e-40b9-bb07-14fb43a441d0 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:13:36.783000 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d1116ad3-d29e-40b9-bb07-14fb43a441d0 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:13:36.783470 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d1116ad3-d29e-40b9-bb07-14fb43a441d0 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:13:36.783909 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d1116ad3-d29e-40b9-bb07-14fb43a441d0 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:13:36.838145 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-d1116ad3-d29e-40b9-bb07-14fb43a441d0 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "POST /compute/v2.1/servers/5debc9f2-4321-47d3-9215-8f2c02fe817d/action" status: 200 len: 24576 microversion: 2.1 time: 0.074242 Aug 11 00:13:36.838988 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3691/7171] 10.222.0.58 () {60 vars in 1278 bytes} [Thu Aug 11 00:13:36 2022] POST /compute/v2.1/servers/5debc9f2-4321-47d3-9215-8f2c02fe817d/action => generated 24576 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 00:13:48.843450 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-229da87b-45b9-413a-aeec-ac8d85508ffa tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:13:48.843964 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-229da87b-45b9-413a-aeec-ac8d85508ffa tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] [instance: 5debc9f2-4321-47d3-9215-8f2c02fe817d] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:13:48.846135 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_api:SELECT=28 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:13:48.846808 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=82 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:13:48.852504 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-57a90f3d-41d0-44e3-b4d7-bb5fe90ecaa5 req-cbe16c5b-69a9-4156-b930-6ae307e0839c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5debc9f2-4321-47d3-9215-8f2c02fe817d", "tag": "114be6dc-3b5a-425e-b67b-ef5a236c9b0c"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 00:13:48.858353 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_api:SELECT=2 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:13:48.859219 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=4 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:13:48.868961 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-229da87b-45b9-413a-aeec-ac8d85508ffa tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:13:48.869829 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-229da87b-45b9-413a-aeec-ac8d85508ffa tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:13:48.871069 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-229da87b-45b9-413a-aeec-ac8d85508ffa tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:13:48.872290 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-57a90f3d-41d0-44e3-b4d7-bb5fe90ecaa5 req-cbe16c5b-69a9-4156-b930-6ae307e0839c service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:13:48.872444 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-229da87b-45b9-413a-aeec-ac8d85508ffa tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:13:48.872843 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-57a90f3d-41d0-44e3-b4d7-bb5fe90ecaa5 req-cbe16c5b-69a9-4156-b930-6ae307e0839c service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:13:48.872977 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-229da87b-45b9-413a-aeec-ac8d85508ffa tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:13:48.873289 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-57a90f3d-41d0-44e3-b4d7-bb5fe90ecaa5 req-cbe16c5b-69a9-4156-b930-6ae307e0839c service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:13:48.873428 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-229da87b-45b9-413a-aeec-ac8d85508ffa tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:13:48.886816 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-57a90f3d-41d0-44e3-b4d7-bb5fe90ecaa5 req-cbe16c5b-69a9-4156-b930-6ae307e0839c service nova] Creating event network-changed:114be6dc-3b5a-425e-b67b-ef5a236c9b0c for instance 5debc9f2-4321-47d3-9215-8f2c02fe817d on n-h2-850468-14 Aug 11 00:13:48.892165 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-57a90f3d-41d0-44e3-b4d7-bb5fe90ecaa5 req-cbe16c5b-69a9-4156-b930-6ae307e0839c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043640 Aug 11 00:13:48.893094 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3692/7172] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 11 00:13:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 00:13:48.906497 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-229da87b-45b9-413a-aeec-ac8d85508ffa tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] [instance: 5debc9f2-4321-47d3-9215-8f2c02fe817d] Going to try to terminate instance {{(pid=122632) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 11 00:13:49.001048 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-229da87b-45b9-413a-aeec-ac8d85508ffa tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "DELETE /compute/v2.1/servers/5debc9f2-4321-47d3-9215-8f2c02fe817d" status: 204 len: 0 microversion: 2.1 time: 0.161659 Aug 11 00:13:49.002367 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3481/7173] 10.222.0.58 () {58 vars in 1239 bytes} [Thu Aug 11 00:13:48 2022] DELETE /compute/v2.1/servers/5debc9f2-4321-47d3-9215-8f2c02fe817d => generated 0 bytes in 164 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 11 00:13:49.013218 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-0269c841-3475-4efb-8408-7a1da0382082 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:13:49.014251 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-0269c841-3475-4efb-8408-7a1da0382082 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] [instance: 5debc9f2-4321-47d3-9215-8f2c02fe817d] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:13:49.021396 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0269c841-3475-4efb-8408-7a1da0382082 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:13:49.022316 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0269c841-3475-4efb-8408-7a1da0382082 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:13:49.022430 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0269c841-3475-4efb-8408-7a1da0382082 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:13:49.023110 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0269c841-3475-4efb-8408-7a1da0382082 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:13:49.023775 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0269c841-3475-4efb-8408-7a1da0382082 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:13:49.024380 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0269c841-3475-4efb-8408-7a1da0382082 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:13:49.187406 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-0269c841-3475-4efb-8408-7a1da0382082 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98a27e99564f0ca672fbc06423d9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26799bad802a44c18dfee33c758cbb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:13:49.195855 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-0269c841-3475-4efb-8408-7a1da0382082 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "GET /compute/v2.1/servers/5debc9f2-4321-47d3-9215-8f2c02fe817d" status: 200 len: 1688 microversion: 2.1 time: 0.188405 Aug 11 00:13:49.196712 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3693/7174] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:13:49 2022] GET /compute/v2.1/servers/5debc9f2-4321-47d3-9215-8f2c02fe817d => generated 1688 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:13:50.217639 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-6bef94b7-23b8-4142-b9e8-e5f1186e2088 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:13:50.218334 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-6bef94b7-23b8-4142-b9e8-e5f1186e2088 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] [instance: 5debc9f2-4321-47d3-9215-8f2c02fe817d] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:13:50.225719 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6bef94b7-23b8-4142-b9e8-e5f1186e2088 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:13:50.226215 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6bef94b7-23b8-4142-b9e8-e5f1186e2088 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:13:50.226660 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6bef94b7-23b8-4142-b9e8-e5f1186e2088 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:13:50.227471 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6bef94b7-23b8-4142-b9e8-e5f1186e2088 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:13:50.228034 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6bef94b7-23b8-4142-b9e8-e5f1186e2088 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:13:50.228341 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6bef94b7-23b8-4142-b9e8-e5f1186e2088 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:13:50.368839 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-6bef94b7-23b8-4142-b9e8-e5f1186e2088 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98a27e99564f0ca672fbc06423d9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26799bad802a44c18dfee33c758cbb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:13:50.376562 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-6bef94b7-23b8-4142-b9e8-e5f1186e2088 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "GET /compute/v2.1/servers/5debc9f2-4321-47d3-9215-8f2c02fe817d" status: 200 len: 1688 microversion: 2.1 time: 0.163215 Aug 11 00:13:50.377138 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3482/7175] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:13:50 2022] GET /compute/v2.1/servers/5debc9f2-4321-47d3-9215-8f2c02fe817d => generated 1688 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:13:50.953439 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-ff7eab12-7ede-4763-b55d-b9978132b478 req-8b395c58-50a9-49a3-a10e-d1702d901dc3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5debc9f2-4321-47d3-9215-8f2c02fe817d", "name": "network-vif-deleted", "tag": "114be6dc-3b5a-425e-b67b-ef5a236c9b0c"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 00:13:50.965024 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-ff7eab12-7ede-4763-b55d-b9978132b478 req-8b395c58-50a9-49a3-a10e-d1702d901dc3 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:13:50.965454 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-ff7eab12-7ede-4763-b55d-b9978132b478 req-8b395c58-50a9-49a3-a10e-d1702d901dc3 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:13:50.965914 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-ff7eab12-7ede-4763-b55d-b9978132b478 req-8b395c58-50a9-49a3-a10e-d1702d901dc3 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:13:50.978395 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-ff7eab12-7ede-4763-b55d-b9978132b478 req-8b395c58-50a9-49a3-a10e-d1702d901dc3 service nova] Creating event network-vif-deleted:114be6dc-3b5a-425e-b67b-ef5a236c9b0c for instance 5debc9f2-4321-47d3-9215-8f2c02fe817d on n-h2-850468-14 Aug 11 00:13:50.983498 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-ff7eab12-7ede-4763-b55d-b9978132b478 req-8b395c58-50a9-49a3-a10e-d1702d901dc3 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033801 Aug 11 00:13:50.984106 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3694/7176] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 11 00:13:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 00:13:51.400362 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-51f85c7a-e81c-41e4-a511-29973a601ea7 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:13:51.400975 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-51f85c7a-e81c-41e4-a511-29973a601ea7 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] [instance: 5debc9f2-4321-47d3-9215-8f2c02fe817d] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:13:51.408143 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-51f85c7a-e81c-41e4-a511-29973a601ea7 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:13:51.408637 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-51f85c7a-e81c-41e4-a511-29973a601ea7 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:13:51.409079 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-51f85c7a-e81c-41e4-a511-29973a601ea7 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:13:51.409787 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-51f85c7a-e81c-41e4-a511-29973a601ea7 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:13:51.410243 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-51f85c7a-e81c-41e4-a511-29973a601ea7 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:13:51.410667 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-51f85c7a-e81c-41e4-a511-29973a601ea7 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:13:51.442762 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-51f85c7a-e81c-41e4-a511-29973a601ea7 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:13:51.443942 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-51f85c7a-e81c-41e4-a511-29973a601ea7 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:13:51.444590 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-51f85c7a-e81c-41e4-a511-29973a601ea7 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:13:51.445264 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.objects.instance [None req-51f85c7a-e81c-41e4-a511-29973a601ea7 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lazy-loading 'fault' on Instance uuid 5debc9f2-4321-47d3-9215-8f2c02fe817d {{(pid=122632) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 11 00:13:51.490608 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-51f85c7a-e81c-41e4-a511-29973a601ea7 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98a27e99564f0ca672fbc06423d9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26799bad802a44c18dfee33c758cbb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:13:51.501130 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-51f85c7a-e81c-41e4-a511-29973a601ea7 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "GET /compute/v2.1/servers/5debc9f2-4321-47d3-9215-8f2c02fe817d" status: 200 len: 1356 microversion: 2.1 time: 0.105188 Aug 11 00:13:51.501724 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3483/7177] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:13:51 2022] GET /compute/v2.1/servers/5debc9f2-4321-47d3-9215-8f2c02fe817d => generated 1356 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:13:52.525892 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-667ee880-e759-43ac-840d-440ef950e494 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:13:52.526614 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-667ee880-e759-43ac-840d-440ef950e494 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] [instance: 5debc9f2-4321-47d3-9215-8f2c02fe817d] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:13:52.532963 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-667ee880-e759-43ac-840d-440ef950e494 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:13:52.533464 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-667ee880-e759-43ac-840d-440ef950e494 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:13:52.533924 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-667ee880-e759-43ac-840d-440ef950e494 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:13:52.534649 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-667ee880-e759-43ac-840d-440ef950e494 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:13:52.535151 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-667ee880-e759-43ac-840d-440ef950e494 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:13:52.535627 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-667ee880-e759-43ac-840d-440ef950e494 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:13:52.549611 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-667ee880-e759-43ac-840d-440ef950e494 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] HTTP exception thrown: Instance 5debc9f2-4321-47d3-9215-8f2c02fe817d could not be found. Aug 11 00:13:52.551278 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-667ee880-e759-43ac-840d-440ef950e494 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Request method failure captured: Aug 11 00:13:52.551278 n-d-850468-14 devstack@n-api.service[122633]: request: GET /compute/v2.1/servers/5debc9f2-4321-47d3-9215-8f2c02fe817d HTTP/1.1 Aug 11 00:13:52.551278 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 11 00:13:52.551278 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 11 00:13:52.551278 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 11 00:13:52.551278 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 11 00:13:52.551278 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 11 00:13:52.551278 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 11 00:13:52.551278 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 11 00:13:52.551278 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 11 00:13:52.551278 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9Eicgn9rrdRuvAzeJtJZ7G3bC_nDgFR3SCpmMvM-oSUDIishF0KIrgIe24vn-zIDWQFTlnHZqZzmBW04xZWO5xjxS0bhWpiqJFEiDbQjnCF5CEqW_Qy1Z8Dx6EdfjYFAs6IHw9dtZURRdVWG0taseoTltbZtc3U4Z0kNtdabyg0lDPw Aug 11 00:13:52.551278 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 11 00:13:52.551278 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 11 00:13:52.551278 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 11 00:13:52.551278 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 11 00:13:52.551278 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 11 00:13:52.551278 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 11 00:13:52.551278 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 26799bad802a44c18dfee33c758cbb60 Aug 11 00:13:52.551278 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-458446174 Aug 11 00:13:52.551278 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 11 00:13:52.551278 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 11 00:13:52.551278 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/26799bad802a44c18dfee33c758cbb60"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/26799bad802a44c18dfee33c758cbb60"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/26799bad802a44c18dfee33c758cbb60"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_26799bad802a44c18dfee33c758cbb60", "adminURL": "http://10.222.0.58:8080"}]}] Aug 11 00:13:52.551278 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-TestNetworkAdvancedServerOps-458446174 Aug 11 00:13:52.551278 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 26799bad802a44c18dfee33c758cbb60 Aug 11 00:13:52.551278 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-458446174 Aug 11 00:13:52.551278 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-TestNetworkAdvancedServerOps-458446174-project Aug 11 00:13:52.551278 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 11 00:13:52.551278 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 11 00:13:52.551278 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 8e98a27e99564f0ca672fbc06423d9ea Aug 11 00:13:52.551278 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-TestNetworkAdvancedServerOps-458446174-project Aug 11 00:13:52.551278 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 11 00:13:52.551278 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance 5debc9f2-4321-47d3-9215-8f2c02fe817d could not be found. Aug 11 00:13:52.551278 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': '5debc9f2-4321-47d3-9215-8f2c02fe817d'} Aug 11 00:13:52.551278 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 00:13:52.551278 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 00:13:52.551278 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 11 00:13:52.551278 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 11 00:13:52.551278 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 11 00:13:52.551278 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 11 00:13:52.551278 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 11 00:13:52.551278 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 11 00:13:52.551278 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 11 00:13:52.551278 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 11 00:13:52.551278 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5debc9f2-4321-47d3-9215-8f2c02fe817d could not be found. Aug 11 00:13:52.551278 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 11 00:13:52.551278 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 00:13:52.551278 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 11 00:13:52.551278 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 00:13:52.551278 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 00:13:52.551278 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 00:13:52.551278 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 00:13:52.551278 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 00:13:52.551278 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 00:13:52.551278 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 00:13:52.551278 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 11 00:13:52.551278 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 11 00:13:52.551278 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 11 00:13:52.551278 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 11 00:13:52.551278 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 11 00:13:52.551278 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 11 00:13:52.551278 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5debc9f2-4321-47d3-9215-8f2c02fe817d could not be found. Aug 11 00:13:52.551278 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 11 00:13:52.551278 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 00:13:52.556198 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 11 00:13:52.556198 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 00:13:52.556198 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 00:13:52.556198 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 00:13:52.556198 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 00:13:52.556198 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 00:13:52.556198 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5debc9f2-4321-47d3-9215-8f2c02fe817d could not be found. Aug 11 00:13:52.556198 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 11 00:13:52.556198 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-667ee880-e759-43ac-840d-440ef950e494 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Returning 404 to user: Instance 5debc9f2-4321-47d3-9215-8f2c02fe817d could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 00:13:52.556198 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-667ee880-e759-43ac-840d-440ef950e494 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "GET /compute/v2.1/servers/5debc9f2-4321-47d3-9215-8f2c02fe817d" status: 404 len: 111 microversion: 2.1 time: 0.032900 Aug 11 00:13:52.556198 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3695/7178] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:13:52 2022] GET /compute/v2.1/servers/5debc9f2-4321-47d3-9215-8f2c02fe817d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 11 00:13:55.905927 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-99f79aca-9beb-4c0f-ab86-b8cae3a27cc4 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Calling method '.version_select at 0x7f847c4893a0>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:13:55.930508 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-99f79aca-9beb-4c0f-ab86-b8cae3a27cc4 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-662691380" status: 202 len: 0 microversion: 2.1 time: 0.028611 Aug 11 00:13:55.931368 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3484/7179] 10.222.0.58 () {58 vars in 1281 bytes} [Thu Aug 11 00:13:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-662691380 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 11 00:13:55.963623 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-cde93039-8b37-4884-ba34-9b3d58b03239 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Action: 'create', calling method: .version_select at 0x7f847c514550>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-573238571", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEeRasATyxllKLc5GHCAgqhq5WolwXsnWAAcs9t3nSmzLubt7bXPMu8FgXnzlhvJ5ZTRyM+e9+/U6CpbHjoUfNv8s3i572zrZX+OlUHTbqVSBH+BAsxRc7G7Z7f+D7ySkA=="}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 00:13:55.981394 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-cde93039-8b37-4884-ba34-9b3d58b03239 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Getting quotas for project 26799bad802a44c18dfee33c758cbb60. Resources: {'key_pairs'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 11 00:13:55.987173 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-cde93039-8b37-4884-ba34-9b3d58b03239 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Getting quotas for user 8e98a27e99564f0ca672fbc06423d9ea and project 26799bad802a44c18dfee33c758cbb60. Resources: {'key_pairs'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 11 00:13:56.015207 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-cde93039-8b37-4884-ba34-9b3d58b03239 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.056522 Aug 11 00:13:56.015901 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3696/7180] 10.222.0.58 () {60 vars in 1159 bytes} [Thu Aug 11 00:13:55 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 00:14:01.998953 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:14:02.074842 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-2fc85295-bf7a-4e82-ae85-2f16877300f1 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-130976518", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452", "networks": [{"uuid": "d237cf18-c77a-4c0d-adec-3a1245bede4f"}], "key_name": "tempest-TestNetworkAdvancedServerOps-573238571", "security_groups": [{"name": "tempest-secgroup-smoke-1756846856"}]}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 00:14:02.197813 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.network.neutron [None req-2fc85295-bf7a-4e82-ae85-2f16877300f1 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] validate_networks() for [('d237cf18-c77a-4c0d-adec-3a1245bede4f', None, None, None, None, None)] {{(pid=122632) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 11 00:14:02.723810 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-2fc85295-bf7a-4e82-ae85-2f16877300f1 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Flavor limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 11 00:14:02.724998 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-2fc85295-bf7a-4e82-ae85-2f16877300f1 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Image limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 11 00:14:02.725489 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-2fc85295-bf7a-4e82-ae85-2f16877300f1 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Flavor pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 11 00:14:02.725905 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-2fc85295-bf7a-4e82-ae85-2f16877300f1 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Image pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 11 00:14:02.726323 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-2fc85295-bf7a-4e82-ae85-2f16877300f1 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 11 00:14:02.736175 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2fc85295-bf7a-4e82-ae85-2f16877300f1 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:14:02.736910 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2fc85295-bf7a-4e82-ae85-2f16877300f1 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:14:02.737526 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2fc85295-bf7a-4e82-ae85-2f16877300f1 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:14:02.738256 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2fc85295-bf7a-4e82-ae85-2f16877300f1 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:14:02.738714 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2fc85295-bf7a-4e82-ae85-2f16877300f1 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:14:02.739602 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2fc85295-bf7a-4e82-ae85-2f16877300f1 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:14:02.760132 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-2fc85295-bf7a-4e82-ae85-2f16877300f1 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Getting quotas for project 26799bad802a44c18dfee33c758cbb60. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 11 00:14:02.766469 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-2fc85295-bf7a-4e82-ae85-2f16877300f1 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Getting quotas for user 8e98a27e99564f0ca672fbc06423d9ea and project 26799bad802a44c18dfee33c758cbb60. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 11 00:14:02.780849 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-2fc85295-bf7a-4e82-ae85-2f16877300f1 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Going to run 1 instances... {{(pid=122632) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 11 00:14:02.783204 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-2fc85295-bf7a-4e82-ae85-2f16877300f1 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] [instance: df0b8857-e218-49f7-92c0-da41236aab32] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78ad8905-f66f-4733-8be9-2b260f1fabed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122632) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 11 00:14:02.832467 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-2fc85295-bf7a-4e82-ae85-2f16877300f1 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.838964 Aug 11 00:14:02.833969 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3485/7181] 10.222.0.58 () {60 vars in 1147 bytes} [Thu Aug 11 00:14:01 2022] POST /compute/v2.1/servers => generated 406 bytes in 841 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 11 00:14:02.842908 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=12 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:14:02.847368 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c8fe9e1d-0c66-4bcb-b4d8-3f750866933b tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:14:02.848003 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-c8fe9e1d-0c66-4bcb-b4d8-3f750866933b tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] [instance: df0b8857-e218-49f7-92c0-da41236aab32] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:14:02.922187 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-c8fe9e1d-0c66-4bcb-b4d8-3f750866933b tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98a27e99564f0ca672fbc06423d9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26799bad802a44c18dfee33c758cbb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:14:02.930517 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-c8fe9e1d-0c66-4bcb-b4d8-3f750866933b tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "GET /compute/v2.1/servers/df0b8857-e218-49f7-92c0-da41236aab32" status: 200 len: 1265 microversion: 2.1 time: 0.089374 Aug 11 00:14:02.931208 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3697/7182] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:14:02 2022] GET /compute/v2.1/servers/df0b8857-e218-49f7-92c0-da41236aab32 => generated 1265 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:14:03.954662 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-a9da1ea6-9999-40b4-b85f-7601197884f1 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:14:03.955991 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-a9da1ea6-9999-40b4-b85f-7601197884f1 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] [instance: df0b8857-e218-49f7-92c0-da41236aab32] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:14:03.968443 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a9da1ea6-9999-40b4-b85f-7601197884f1 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:14:03.969291 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a9da1ea6-9999-40b4-b85f-7601197884f1 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:14:03.969739 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a9da1ea6-9999-40b4-b85f-7601197884f1 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:14:03.971223 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a9da1ea6-9999-40b4-b85f-7601197884f1 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:14:03.971878 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a9da1ea6-9999-40b4-b85f-7601197884f1 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:14:03.972578 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-a9da1ea6-9999-40b4-b85f-7601197884f1 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:14:04.045304 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-a9da1ea6-9999-40b4-b85f-7601197884f1 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98a27e99564f0ca672fbc06423d9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26799bad802a44c18dfee33c758cbb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:14:04.054426 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-a9da1ea6-9999-40b4-b85f-7601197884f1 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "GET /compute/v2.1/servers/df0b8857-e218-49f7-92c0-da41236aab32" status: 200 len: 1323 microversion: 2.1 time: 0.105595 Aug 11 00:14:04.055277 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3486/7183] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:14:03 2022] GET /compute/v2.1/servers/df0b8857-e218-49f7-92c0-da41236aab32 => generated 1323 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:14:05.076343 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c665e261-cb6d-4bb1-8951-e9a472f44b16 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:14:05.076980 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-c665e261-cb6d-4bb1-8951-e9a472f44b16 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] [instance: df0b8857-e218-49f7-92c0-da41236aab32] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:14:05.085507 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c665e261-cb6d-4bb1-8951-e9a472f44b16 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:14:05.086060 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c665e261-cb6d-4bb1-8951-e9a472f44b16 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:14:05.086525 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c665e261-cb6d-4bb1-8951-e9a472f44b16 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:14:05.087287 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c665e261-cb6d-4bb1-8951-e9a472f44b16 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:14:05.087762 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c665e261-cb6d-4bb1-8951-e9a472f44b16 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:14:05.088251 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c665e261-cb6d-4bb1-8951-e9a472f44b16 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:14:05.310712 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-c665e261-cb6d-4bb1-8951-e9a472f44b16 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98a27e99564f0ca672fbc06423d9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26799bad802a44c18dfee33c758cbb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:14:05.318388 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-c665e261-cb6d-4bb1-8951-e9a472f44b16 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "GET /compute/v2.1/servers/df0b8857-e218-49f7-92c0-da41236aab32" status: 200 len: 1391 microversion: 2.1 time: 0.245972 Aug 11 00:14:05.319081 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3698/7184] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:14:05 2022] GET /compute/v2.1/servers/df0b8857-e218-49f7-92c0-da41236aab32 => generated 1391 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:14:05.366275 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-2d677f8f-fc1e-4b03-9cff-cbb589333da7 req-88478b3b-470d-4774-8e04-6c7d04eb4d37 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df0b8857-e218-49f7-92c0-da41236aab32", "tag": "26819870-bebc-49f2-9060-86a2bacdcfa8"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 00:14:05.376722 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-2d677f8f-fc1e-4b03-9cff-cbb589333da7 req-88478b3b-470d-4774-8e04-6c7d04eb4d37 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:14:05.377205 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-2d677f8f-fc1e-4b03-9cff-cbb589333da7 req-88478b3b-470d-4774-8e04-6c7d04eb4d37 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:14:05.377635 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-2d677f8f-fc1e-4b03-9cff-cbb589333da7 req-88478b3b-470d-4774-8e04-6c7d04eb4d37 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:14:05.390096 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-2d677f8f-fc1e-4b03-9cff-cbb589333da7 req-88478b3b-470d-4774-8e04-6c7d04eb4d37 service nova] Creating event network-changed:26819870-bebc-49f2-9060-86a2bacdcfa8 for instance df0b8857-e218-49f7-92c0-da41236aab32 on n-h1-850468-14 Aug 11 00:14:05.395006 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-2d677f8f-fc1e-4b03-9cff-cbb589333da7 req-88478b3b-470d-4774-8e04-6c7d04eb4d37 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032359 Aug 11 00:14:05.395550 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3487/7185] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 11 00:14:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 00:14:06.339283 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-d51875ed-98f2-4dd0-a58e-acc8555a67e0 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:14:06.339915 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-d51875ed-98f2-4dd0-a58e-acc8555a67e0 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] [instance: df0b8857-e218-49f7-92c0-da41236aab32] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:14:06.346777 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d51875ed-98f2-4dd0-a58e-acc8555a67e0 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:14:06.347310 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d51875ed-98f2-4dd0-a58e-acc8555a67e0 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:14:06.347764 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d51875ed-98f2-4dd0-a58e-acc8555a67e0 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:14:06.348475 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d51875ed-98f2-4dd0-a58e-acc8555a67e0 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:14:06.348944 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d51875ed-98f2-4dd0-a58e-acc8555a67e0 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:14:06.349954 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d51875ed-98f2-4dd0-a58e-acc8555a67e0 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:14:06.488051 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-d51875ed-98f2-4dd0-a58e-acc8555a67e0 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98a27e99564f0ca672fbc06423d9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26799bad802a44c18dfee33c758cbb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:14:06.496229 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-d51875ed-98f2-4dd0-a58e-acc8555a67e0 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "GET /compute/v2.1/servers/df0b8857-e218-49f7-92c0-da41236aab32" status: 200 len: 1391 microversion: 2.1 time: 0.160825 Aug 11 00:14:06.496802 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3699/7186] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:14:06 2022] GET /compute/v2.1/servers/df0b8857-e218-49f7-92c0-da41236aab32 => generated 1391 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:14:07.518918 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-5ba21a35-a073-4b9a-96ce-ca394233da71 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:14:07.519620 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-5ba21a35-a073-4b9a-96ce-ca394233da71 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] [instance: df0b8857-e218-49f7-92c0-da41236aab32] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:14:07.526365 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5ba21a35-a073-4b9a-96ce-ca394233da71 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:14:07.526886 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5ba21a35-a073-4b9a-96ce-ca394233da71 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:14:07.527318 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5ba21a35-a073-4b9a-96ce-ca394233da71 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:14:07.528009 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5ba21a35-a073-4b9a-96ce-ca394233da71 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:14:07.528456 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5ba21a35-a073-4b9a-96ce-ca394233da71 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:14:07.528875 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5ba21a35-a073-4b9a-96ce-ca394233da71 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:14:07.668969 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-5ba21a35-a073-4b9a-96ce-ca394233da71 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98a27e99564f0ca672fbc06423d9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26799bad802a44c18dfee33c758cbb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:14:07.676622 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-5ba21a35-a073-4b9a-96ce-ca394233da71 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "GET /compute/v2.1/servers/df0b8857-e218-49f7-92c0-da41236aab32" status: 200 len: 1391 microversion: 2.1 time: 0.162810 Aug 11 00:14:07.677851 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3488/7187] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:14:07 2022] GET /compute/v2.1/servers/df0b8857-e218-49f7-92c0-da41236aab32 => generated 1391 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:14:08.698697 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-2c900fe6-8d65-4e57-b9c0-3a636e5c1d4c tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:14:08.699295 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-2c900fe6-8d65-4e57-b9c0-3a636e5c1d4c tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] [instance: df0b8857-e218-49f7-92c0-da41236aab32] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:14:08.706355 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2c900fe6-8d65-4e57-b9c0-3a636e5c1d4c tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:14:08.706890 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2c900fe6-8d65-4e57-b9c0-3a636e5c1d4c tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:14:08.707356 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2c900fe6-8d65-4e57-b9c0-3a636e5c1d4c tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:14:08.708111 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2c900fe6-8d65-4e57-b9c0-3a636e5c1d4c tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:14:08.709538 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2c900fe6-8d65-4e57-b9c0-3a636e5c1d4c tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:14:08.710295 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2c900fe6-8d65-4e57-b9c0-3a636e5c1d4c tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:14:08.847152 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-2c900fe6-8d65-4e57-b9c0-3a636e5c1d4c tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98a27e99564f0ca672fbc06423d9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26799bad802a44c18dfee33c758cbb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:14:08.854806 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-2c900fe6-8d65-4e57-b9c0-3a636e5c1d4c tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "GET /compute/v2.1/servers/df0b8857-e218-49f7-92c0-da41236aab32" status: 200 len: 1391 microversion: 2.1 time: 0.160127 Aug 11 00:14:08.855420 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3700/7188] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:14:08 2022] GET /compute/v2.1/servers/df0b8857-e218-49f7-92c0-da41236aab32 => generated 1391 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:14:09.877038 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-542778f6-e879-407e-a732-2274cf6dd64e tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:14:09.877649 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-542778f6-e879-407e-a732-2274cf6dd64e tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] [instance: df0b8857-e218-49f7-92c0-da41236aab32] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:14:09.885605 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-542778f6-e879-407e-a732-2274cf6dd64e tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:14:09.886087 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-542778f6-e879-407e-a732-2274cf6dd64e tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:14:09.886524 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-542778f6-e879-407e-a732-2274cf6dd64e tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:14:09.887258 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-542778f6-e879-407e-a732-2274cf6dd64e tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:14:09.887707 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-542778f6-e879-407e-a732-2274cf6dd64e tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:14:09.888130 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-542778f6-e879-407e-a732-2274cf6dd64e tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:14:10.018772 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-542778f6-e879-407e-a732-2274cf6dd64e tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98a27e99564f0ca672fbc06423d9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26799bad802a44c18dfee33c758cbb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:14:10.026466 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-542778f6-e879-407e-a732-2274cf6dd64e tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "GET /compute/v2.1/servers/df0b8857-e218-49f7-92c0-da41236aab32" status: 200 len: 1391 microversion: 2.1 time: 0.153403 Aug 11 00:14:10.027067 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3489/7189] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:14:09 2022] GET /compute/v2.1/servers/df0b8857-e218-49f7-92c0-da41236aab32 => generated 1391 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 00:14:10.288903 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-ee858ad5-3bd2-4822-8734-11baf405f47e req-99638d48-f786-4f73-9621-6a1bd4149652 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df0b8857-e218-49f7-92c0-da41236aab32", "name": "network-vif-plugged", "status": "completed", "tag": "26819870-bebc-49f2-9060-86a2bacdcfa8"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 00:14:10.300400 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-ee858ad5-3bd2-4822-8734-11baf405f47e req-99638d48-f786-4f73-9621-6a1bd4149652 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:14:10.300902 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-ee858ad5-3bd2-4822-8734-11baf405f47e req-99638d48-f786-4f73-9621-6a1bd4149652 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:14:10.301376 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-ee858ad5-3bd2-4822-8734-11baf405f47e req-99638d48-f786-4f73-9621-6a1bd4149652 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:14:10.313051 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-ee858ad5-3bd2-4822-8734-11baf405f47e req-99638d48-f786-4f73-9621-6a1bd4149652 service nova] Creating event network-vif-plugged:26819870-bebc-49f2-9060-86a2bacdcfa8 for instance df0b8857-e218-49f7-92c0-da41236aab32 on n-h1-850468-14 Aug 11 00:14:10.318702 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-ee858ad5-3bd2-4822-8734-11baf405f47e req-99638d48-f786-4f73-9621-6a1bd4149652 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033832 Aug 11 00:14:10.319603 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3701/7190] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 11 00:14:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 00:14:11.048301 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-10d6762e-0f5f-4dd7-acde-c5133961b47f tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:14:11.048915 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-10d6762e-0f5f-4dd7-acde-c5133961b47f tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] [instance: df0b8857-e218-49f7-92c0-da41236aab32] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:14:11.056645 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-10d6762e-0f5f-4dd7-acde-c5133961b47f tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:14:11.057134 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-10d6762e-0f5f-4dd7-acde-c5133961b47f tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:14:11.057577 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-10d6762e-0f5f-4dd7-acde-c5133961b47f tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:14:11.058278 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-10d6762e-0f5f-4dd7-acde-c5133961b47f tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:14:11.058950 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-10d6762e-0f5f-4dd7-acde-c5133961b47f tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:14:11.059385 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-10d6762e-0f5f-4dd7-acde-c5133961b47f tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:14:11.196648 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-10d6762e-0f5f-4dd7-acde-c5133961b47f tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98a27e99564f0ca672fbc06423d9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26799bad802a44c18dfee33c758cbb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:14:11.204420 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-10d6762e-0f5f-4dd7-acde-c5133961b47f tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "GET /compute/v2.1/servers/df0b8857-e218-49f7-92c0-da41236aab32" status: 200 len: 1391 microversion: 2.1 time: 0.160232 Aug 11 00:14:11.205012 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3490/7191] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:14:11 2022] GET /compute/v2.1/servers/df0b8857-e218-49f7-92c0-da41236aab32 => generated 1391 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:14:12.227301 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-7dfd993c-8c9c-4b79-b901-f4f051267601 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:14:12.227975 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-7dfd993c-8c9c-4b79-b901-f4f051267601 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] [instance: df0b8857-e218-49f7-92c0-da41236aab32] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:14:12.234286 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7dfd993c-8c9c-4b79-b901-f4f051267601 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:14:12.234802 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7dfd993c-8c9c-4b79-b901-f4f051267601 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:14:12.235281 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7dfd993c-8c9c-4b79-b901-f4f051267601 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:14:12.236003 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7dfd993c-8c9c-4b79-b901-f4f051267601 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:14:12.236473 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7dfd993c-8c9c-4b79-b901-f4f051267601 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:14:12.236913 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7dfd993c-8c9c-4b79-b901-f4f051267601 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:14:12.378210 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-7dfd993c-8c9c-4b79-b901-f4f051267601 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98a27e99564f0ca672fbc06423d9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26799bad802a44c18dfee33c758cbb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:14:12.387338 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-7dfd993c-8c9c-4b79-b901-f4f051267601 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "GET /compute/v2.1/servers/df0b8857-e218-49f7-92c0-da41236aab32" status: 200 len: 1563 microversion: 2.1 time: 0.165305 Aug 11 00:14:12.387923 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3702/7192] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:14:12 2022] GET /compute/v2.1/servers/df0b8857-e218-49f7-92c0-da41236aab32 => generated 1563 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:14:12.409045 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-2696f6a9-e5f4-4ff9-aba7-37b8be3f5c03 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:14:12.409652 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-2696f6a9-e5f4-4ff9-aba7-37b8be3f5c03 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] [instance: df0b8857-e218-49f7-92c0-da41236aab32] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:14:12.416700 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2696f6a9-e5f4-4ff9-aba7-37b8be3f5c03 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:14:12.417182 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2696f6a9-e5f4-4ff9-aba7-37b8be3f5c03 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:14:12.417617 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2696f6a9-e5f4-4ff9-aba7-37b8be3f5c03 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:14:12.418301 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2696f6a9-e5f4-4ff9-aba7-37b8be3f5c03 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:14:12.418750 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2696f6a9-e5f4-4ff9-aba7-37b8be3f5c03 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:14:12.419220 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2696f6a9-e5f4-4ff9-aba7-37b8be3f5c03 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:14:12.553820 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-2696f6a9-e5f4-4ff9-aba7-37b8be3f5c03 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98a27e99564f0ca672fbc06423d9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26799bad802a44c18dfee33c758cbb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:14:12.561493 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-2696f6a9-e5f4-4ff9-aba7-37b8be3f5c03 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "GET /compute/v2.1/servers/df0b8857-e218-49f7-92c0-da41236aab32" status: 200 len: 1563 microversion: 2.1 time: 0.156406 Aug 11 00:14:12.562076 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3491/7193] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:14:12 2022] GET /compute/v2.1/servers/df0b8857-e218-49f7-92c0-da41236aab32 => generated 1563 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:14:14.516582 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-27f9abe5-91d9-4bfa-a135-b44330c9a91b tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:14:14.517220 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-27f9abe5-91d9-4bfa-a135-b44330c9a91b tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] [instance: df0b8857-e218-49f7-92c0-da41236aab32] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:14:14.519117 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-2fc87094-16a1-44ec-b194-d08146c6808a req-b5f15051-685a-4e47-b7b2-7f78fe9c50fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df0b8857-e218-49f7-92c0-da41236aab32", "tag": "26819870-bebc-49f2-9060-86a2bacdcfa8"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 00:14:14.519564 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=6 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:14:14.525018 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=2 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:14:14.525697 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=6 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:14:14.532595 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-27f9abe5-91d9-4bfa-a135-b44330c9a91b tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:14:14.533118 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-27f9abe5-91d9-4bfa-a135-b44330c9a91b tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:14:14.533267 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-2fc87094-16a1-44ec-b194-d08146c6808a req-b5f15051-685a-4e47-b7b2-7f78fe9c50fd service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:14:14.533577 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-27f9abe5-91d9-4bfa-a135-b44330c9a91b tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:14:14.533726 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-2fc87094-16a1-44ec-b194-d08146c6808a req-b5f15051-685a-4e47-b7b2-7f78fe9c50fd service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:14:14.534129 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-2fc87094-16a1-44ec-b194-d08146c6808a req-b5f15051-685a-4e47-b7b2-7f78fe9c50fd service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:14:14.534304 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-27f9abe5-91d9-4bfa-a135-b44330c9a91b tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:14:14.534992 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-27f9abe5-91d9-4bfa-a135-b44330c9a91b tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:14:14.535444 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-27f9abe5-91d9-4bfa-a135-b44330c9a91b tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:14:14.546072 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-2fc87094-16a1-44ec-b194-d08146c6808a req-b5f15051-685a-4e47-b7b2-7f78fe9c50fd service nova] Creating event network-changed:26819870-bebc-49f2-9060-86a2bacdcfa8 for instance df0b8857-e218-49f7-92c0-da41236aab32 on n-h1-850468-14 Aug 11 00:14:14.551303 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-2fc87094-16a1-44ec-b194-d08146c6808a req-b5f15051-685a-4e47-b7b2-7f78fe9c50fd service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035746 Aug 11 00:14:14.551993 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3492/7194] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 11 00:14:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 11 00:14:14.759586 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-27f9abe5-91d9-4bfa-a135-b44330c9a91b tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98a27e99564f0ca672fbc06423d9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26799bad802a44c18dfee33c758cbb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:14:14.767379 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-27f9abe5-91d9-4bfa-a135-b44330c9a91b tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "GET /compute/v2.1/servers/df0b8857-e218-49f7-92c0-da41236aab32" status: 200 len: 1563 microversion: 2.1 time: 0.254702 Aug 11 00:14:14.768147 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3703/7195] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:14:14 2022] GET /compute/v2.1/servers/df0b8857-e218-49f7-92c0-da41236aab32 => generated 1563 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:14:36.068742 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:14:36.070219 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=36 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:14:36.074563 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c7112bdc-0f88-4f03-98da-fb4de1a7acbe tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 00:14:36.076949 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-c7112bdc-0f88-4f03-98da-fb4de1a7acbe tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] [instance: df0b8857-e218-49f7-92c0-da41236aab32] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:14:36.084856 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c7112bdc-0f88-4f03-98da-fb4de1a7acbe tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:14:36.085535 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c7112bdc-0f88-4f03-98da-fb4de1a7acbe tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:14:36.085982 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c7112bdc-0f88-4f03-98da-fb4de1a7acbe tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:14:36.086696 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c7112bdc-0f88-4f03-98da-fb4de1a7acbe tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:14:36.087184 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c7112bdc-0f88-4f03-98da-fb4de1a7acbe tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:14:36.087611 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c7112bdc-0f88-4f03-98da-fb4de1a7acbe tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:14:36.139947 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-c7112bdc-0f88-4f03-98da-fb4de1a7acbe tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "POST /compute/v2.1/servers/df0b8857-e218-49f7-92c0-da41236aab32/action" status: 200 len: 24569 microversion: 2.1 time: 0.072890 Aug 11 00:14:36.140599 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3493/7196] 10.222.0.58 () {60 vars in 1278 bytes} [Thu Aug 11 00:14:36 2022] POST /compute/v2.1/servers/df0b8857-e218-49f7-92c0-da41236aab32/action => generated 24569 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 00:14:47.180983 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-70b36cfd-cea7-4424-9e09-7ce97357a132 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 00:14:47.183077 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=1 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:14:47.183815 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=32 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:14:47.189782 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-70b36cfd-cea7-4424-9e09-7ce97357a132 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:14:47.190283 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-70b36cfd-cea7-4424-9e09-7ce97357a132 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:14:47.190736 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-70b36cfd-cea7-4424-9e09-7ce97357a132 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:14:47.214039 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-70b36cfd-cea7-4424-9e09-7ce97357a132 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] [instance: df0b8857-e218-49f7-92c0-da41236aab32] Going to try to stop instance {{(pid=122633) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 11 00:14:47.256828 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-70b36cfd-cea7-4424-9e09-7ce97357a132 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "POST /compute/v2.1/servers/df0b8857-e218-49f7-92c0-da41236aab32/action" status: 202 len: 0 microversion: 2.1 time: 0.079870 Aug 11 00:14:47.257460 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3704/7197] 10.222.0.58 () {60 vars in 1278 bytes} [Thu Aug 11 00:14:47 2022] POST /compute/v2.1/servers/df0b8857-e218-49f7-92c0-da41236aab32/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 11 00:14:47.266844 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-831eb95c-a655-43aa-962f-178e2ec95411 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:14:47.267556 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-831eb95c-a655-43aa-962f-178e2ec95411 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] [instance: df0b8857-e218-49f7-92c0-da41236aab32] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:14:47.270213 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_api:SELECT=2 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:14:47.270884 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=4 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:14:47.277239 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-831eb95c-a655-43aa-962f-178e2ec95411 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:14:47.277818 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-831eb95c-a655-43aa-962f-178e2ec95411 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:14:47.278255 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-831eb95c-a655-43aa-962f-178e2ec95411 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:14:47.278999 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-831eb95c-a655-43aa-962f-178e2ec95411 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:14:47.279458 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-831eb95c-a655-43aa-962f-178e2ec95411 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:14:47.279882 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-831eb95c-a655-43aa-962f-178e2ec95411 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:14:47.433190 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-831eb95c-a655-43aa-962f-178e2ec95411 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98a27e99564f0ca672fbc06423d9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26799bad802a44c18dfee33c758cbb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:14:47.440954 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-831eb95c-a655-43aa-962f-178e2ec95411 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "GET /compute/v2.1/servers/df0b8857-e218-49f7-92c0-da41236aab32" status: 200 len: 1692 microversion: 2.1 time: 0.178444 Aug 11 00:14:47.441523 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3494/7198] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:14:47 2022] GET /compute/v2.1/servers/df0b8857-e218-49f7-92c0-da41236aab32 => generated 1692 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:14:48.465547 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-8ab6868a-d9fd-4bc6-ada7-10c57afe611a tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:14:48.466172 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-8ab6868a-d9fd-4bc6-ada7-10c57afe611a tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] [instance: df0b8857-e218-49f7-92c0-da41236aab32] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:14:48.472574 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8ab6868a-d9fd-4bc6-ada7-10c57afe611a tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:14:48.473074 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8ab6868a-d9fd-4bc6-ada7-10c57afe611a tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:14:48.473532 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8ab6868a-d9fd-4bc6-ada7-10c57afe611a tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:14:48.474240 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8ab6868a-d9fd-4bc6-ada7-10c57afe611a tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:14:48.474711 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8ab6868a-d9fd-4bc6-ada7-10c57afe611a tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:14:48.475179 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8ab6868a-d9fd-4bc6-ada7-10c57afe611a tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:14:48.608876 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-8ab6868a-d9fd-4bc6-ada7-10c57afe611a tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98a27e99564f0ca672fbc06423d9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26799bad802a44c18dfee33c758cbb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:14:48.616534 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-8ab6868a-d9fd-4bc6-ada7-10c57afe611a tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "GET /compute/v2.1/servers/df0b8857-e218-49f7-92c0-da41236aab32" status: 200 len: 1692 microversion: 2.1 time: 0.156567 Aug 11 00:14:48.617109 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3705/7199] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:14:48 2022] GET /compute/v2.1/servers/df0b8857-e218-49f7-92c0-da41236aab32 => generated 1692 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:14:49.639309 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-2f9ef19e-0911-4650-9c48-61029527147f tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:14:49.639920 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-2f9ef19e-0911-4650-9c48-61029527147f tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] [instance: df0b8857-e218-49f7-92c0-da41236aab32] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:14:49.651040 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2f9ef19e-0911-4650-9c48-61029527147f tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:14:49.651531 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2f9ef19e-0911-4650-9c48-61029527147f tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:14:49.652016 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2f9ef19e-0911-4650-9c48-61029527147f tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:14:49.652684 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2f9ef19e-0911-4650-9c48-61029527147f tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:14:49.653138 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2f9ef19e-0911-4650-9c48-61029527147f tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:14:49.653563 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2f9ef19e-0911-4650-9c48-61029527147f tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:14:49.786742 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-2f9ef19e-0911-4650-9c48-61029527147f tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98a27e99564f0ca672fbc06423d9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26799bad802a44c18dfee33c758cbb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:14:49.795128 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-2f9ef19e-0911-4650-9c48-61029527147f tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "GET /compute/v2.1/servers/df0b8857-e218-49f7-92c0-da41236aab32" status: 200 len: 1692 microversion: 2.1 time: 0.159676 Aug 11 00:14:49.795725 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3495/7200] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:14:49 2022] GET /compute/v2.1/servers/df0b8857-e218-49f7-92c0-da41236aab32 => generated 1692 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:14:50.817039 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-03f22249-b792-43ae-a3fa-070ecef61f23 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:14:50.817655 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-03f22249-b792-43ae-a3fa-070ecef61f23 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] [instance: df0b8857-e218-49f7-92c0-da41236aab32] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:14:50.825253 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-03f22249-b792-43ae-a3fa-070ecef61f23 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:14:50.825741 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-03f22249-b792-43ae-a3fa-070ecef61f23 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:14:50.826187 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-03f22249-b792-43ae-a3fa-070ecef61f23 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:14:50.826917 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-03f22249-b792-43ae-a3fa-070ecef61f23 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:14:50.827379 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-03f22249-b792-43ae-a3fa-070ecef61f23 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:14:50.827810 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-03f22249-b792-43ae-a3fa-070ecef61f23 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:14:50.968825 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-03f22249-b792-43ae-a3fa-070ecef61f23 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98a27e99564f0ca672fbc06423d9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26799bad802a44c18dfee33c758cbb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:14:50.976422 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-03f22249-b792-43ae-a3fa-070ecef61f23 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "GET /compute/v2.1/servers/df0b8857-e218-49f7-92c0-da41236aab32" status: 200 len: 1692 microversion: 2.1 time: 0.163318 Aug 11 00:14:50.976998 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3706/7201] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:14:50 2022] GET /compute/v2.1/servers/df0b8857-e218-49f7-92c0-da41236aab32 => generated 1692 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:14:51.999355 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-dfafdc4b-d8e0-435b-b34d-4275031e7afc tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:14:51.999991 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-dfafdc4b-d8e0-435b-b34d-4275031e7afc tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] [instance: df0b8857-e218-49f7-92c0-da41236aab32] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:14:52.009041 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dfafdc4b-d8e0-435b-b34d-4275031e7afc tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:14:52.009537 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dfafdc4b-d8e0-435b-b34d-4275031e7afc tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:14:52.010226 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dfafdc4b-d8e0-435b-b34d-4275031e7afc tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:14:52.011039 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dfafdc4b-d8e0-435b-b34d-4275031e7afc tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:14:52.011745 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dfafdc4b-d8e0-435b-b34d-4275031e7afc tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:14:52.012191 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-dfafdc4b-d8e0-435b-b34d-4275031e7afc tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:14:52.161118 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-dfafdc4b-d8e0-435b-b34d-4275031e7afc tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98a27e99564f0ca672fbc06423d9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26799bad802a44c18dfee33c758cbb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:14:52.169428 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-dfafdc4b-d8e0-435b-b34d-4275031e7afc tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "GET /compute/v2.1/servers/df0b8857-e218-49f7-92c0-da41236aab32" status: 200 len: 1692 microversion: 2.1 time: 0.173995 Aug 11 00:14:52.170008 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3496/7202] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:14:51 2022] GET /compute/v2.1/servers/df0b8857-e218-49f7-92c0-da41236aab32 => generated 1692 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:14:53.191175 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-681a396c-6719-4d7b-af75-31fe784b7d19 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:14:53.191792 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-681a396c-6719-4d7b-af75-31fe784b7d19 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] [instance: df0b8857-e218-49f7-92c0-da41236aab32] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:14:53.198847 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-681a396c-6719-4d7b-af75-31fe784b7d19 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:14:53.199340 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-681a396c-6719-4d7b-af75-31fe784b7d19 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:14:53.199790 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-681a396c-6719-4d7b-af75-31fe784b7d19 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:14:53.200492 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-681a396c-6719-4d7b-af75-31fe784b7d19 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:14:53.200953 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-681a396c-6719-4d7b-af75-31fe784b7d19 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:14:53.201384 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-681a396c-6719-4d7b-af75-31fe784b7d19 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:14:53.336062 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-681a396c-6719-4d7b-af75-31fe784b7d19 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98a27e99564f0ca672fbc06423d9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26799bad802a44c18dfee33c758cbb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:14:53.344604 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-681a396c-6719-4d7b-af75-31fe784b7d19 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "GET /compute/v2.1/servers/df0b8857-e218-49f7-92c0-da41236aab32" status: 200 len: 1692 microversion: 2.1 time: 0.157313 Aug 11 00:14:53.345180 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3707/7203] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:14:53 2022] GET /compute/v2.1/servers/df0b8857-e218-49f7-92c0-da41236aab32 => generated 1692 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:14:54.366791 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-e84603de-b0d0-4258-adc7-b11667338e77 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:14:54.367453 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-e84603de-b0d0-4258-adc7-b11667338e77 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] [instance: df0b8857-e218-49f7-92c0-da41236aab32] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:14:54.374559 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e84603de-b0d0-4258-adc7-b11667338e77 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:14:54.375113 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e84603de-b0d0-4258-adc7-b11667338e77 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:14:54.375560 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e84603de-b0d0-4258-adc7-b11667338e77 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:14:54.376294 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e84603de-b0d0-4258-adc7-b11667338e77 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:14:54.376754 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e84603de-b0d0-4258-adc7-b11667338e77 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:14:54.377189 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e84603de-b0d0-4258-adc7-b11667338e77 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:14:54.520451 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-e84603de-b0d0-4258-adc7-b11667338e77 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98a27e99564f0ca672fbc06423d9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26799bad802a44c18dfee33c758cbb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:14:54.529755 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-e84603de-b0d0-4258-adc7-b11667338e77 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "GET /compute/v2.1/servers/df0b8857-e218-49f7-92c0-da41236aab32" status: 200 len: 1692 microversion: 2.1 time: 0.166890 Aug 11 00:14:54.530343 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3497/7204] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:14:54 2022] GET /compute/v2.1/servers/df0b8857-e218-49f7-92c0-da41236aab32 => generated 1692 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:14:55.552265 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-8b34c409-4436-4008-8fac-ace6ea26d3a9 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:14:55.552882 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-8b34c409-4436-4008-8fac-ace6ea26d3a9 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] [instance: df0b8857-e218-49f7-92c0-da41236aab32] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:14:55.560813 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8b34c409-4436-4008-8fac-ace6ea26d3a9 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:14:55.561306 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8b34c409-4436-4008-8fac-ace6ea26d3a9 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:14:55.561754 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8b34c409-4436-4008-8fac-ace6ea26d3a9 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:14:55.562457 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8b34c409-4436-4008-8fac-ace6ea26d3a9 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:14:55.562949 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8b34c409-4436-4008-8fac-ace6ea26d3a9 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:14:55.563385 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8b34c409-4436-4008-8fac-ace6ea26d3a9 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:14:55.700515 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-8b34c409-4436-4008-8fac-ace6ea26d3a9 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98a27e99564f0ca672fbc06423d9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26799bad802a44c18dfee33c758cbb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:14:55.708063 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-8b34c409-4436-4008-8fac-ace6ea26d3a9 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "GET /compute/v2.1/servers/df0b8857-e218-49f7-92c0-da41236aab32" status: 200 len: 1692 microversion: 2.1 time: 0.159990 Aug 11 00:14:55.708637 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3708/7205] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:14:55 2022] GET /compute/v2.1/servers/df0b8857-e218-49f7-92c0-da41236aab32 => generated 1692 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:14:56.731908 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-557a2609-7430-456b-aea1-9d2b5b48d641 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:14:56.732523 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-557a2609-7430-456b-aea1-9d2b5b48d641 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] [instance: df0b8857-e218-49f7-92c0-da41236aab32] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:14:56.739413 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-557a2609-7430-456b-aea1-9d2b5b48d641 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:14:56.739899 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-557a2609-7430-456b-aea1-9d2b5b48d641 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:14:56.740344 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-557a2609-7430-456b-aea1-9d2b5b48d641 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:14:56.741044 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-557a2609-7430-456b-aea1-9d2b5b48d641 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:14:56.741834 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-557a2609-7430-456b-aea1-9d2b5b48d641 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:14:56.742275 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-557a2609-7430-456b-aea1-9d2b5b48d641 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:14:56.873729 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-557a2609-7430-456b-aea1-9d2b5b48d641 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98a27e99564f0ca672fbc06423d9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26799bad802a44c18dfee33c758cbb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:14:56.882012 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-557a2609-7430-456b-aea1-9d2b5b48d641 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "GET /compute/v2.1/servers/df0b8857-e218-49f7-92c0-da41236aab32" status: 200 len: 1692 microversion: 2.1 time: 0.154984 Aug 11 00:14:56.882597 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3498/7206] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:14:56 2022] GET /compute/v2.1/servers/df0b8857-e218-49f7-92c0-da41236aab32 => generated 1692 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:14:57.904619 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-9ed1b38c-7777-4f59-936f-03840147724d tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:14:57.905372 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-9ed1b38c-7777-4f59-936f-03840147724d tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] [instance: df0b8857-e218-49f7-92c0-da41236aab32] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:14:57.912865 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9ed1b38c-7777-4f59-936f-03840147724d tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:14:57.913360 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9ed1b38c-7777-4f59-936f-03840147724d tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:14:57.913818 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9ed1b38c-7777-4f59-936f-03840147724d tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:14:57.914532 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9ed1b38c-7777-4f59-936f-03840147724d tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:14:57.915030 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9ed1b38c-7777-4f59-936f-03840147724d tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:14:57.915492 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9ed1b38c-7777-4f59-936f-03840147724d tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:14:58.045121 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-9ed1b38c-7777-4f59-936f-03840147724d tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98a27e99564f0ca672fbc06423d9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26799bad802a44c18dfee33c758cbb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:14:58.052648 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-9ed1b38c-7777-4f59-936f-03840147724d tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "GET /compute/v2.1/servers/df0b8857-e218-49f7-92c0-da41236aab32" status: 200 len: 1669 microversion: 2.1 time: 0.152557 Aug 11 00:14:58.053236 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3709/7207] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:14:57 2022] GET /compute/v2.1/servers/df0b8857-e218-49f7-92c0-da41236aab32 => generated 1669 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:14:59.151890 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-90720bb1-cbb2-4aa1-8e3a-bc7986cd5170 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 00:14:59.154117 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-90720bb1-cbb2-4aa1-8e3a-bc7986cd5170 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] [instance: df0b8857-e218-49f7-92c0-da41236aab32] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:14:59.161093 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-90720bb1-cbb2-4aa1-8e3a-bc7986cd5170 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:14:59.161584 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-90720bb1-cbb2-4aa1-8e3a-bc7986cd5170 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:14:59.162029 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-90720bb1-cbb2-4aa1-8e3a-bc7986cd5170 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:14:59.162729 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-90720bb1-cbb2-4aa1-8e3a-bc7986cd5170 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:14:59.163234 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-90720bb1-cbb2-4aa1-8e3a-bc7986cd5170 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:14:59.163652 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-90720bb1-cbb2-4aa1-8e3a-bc7986cd5170 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:14:59.219975 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-90720bb1-cbb2-4aa1-8e3a-bc7986cd5170 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "POST /compute/v2.1/servers/df0b8857-e218-49f7-92c0-da41236aab32/action" status: 200 len: 38435 microversion: 2.1 time: 0.072522 Aug 11 00:14:59.220629 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3499/7208] 10.222.0.58 () {60 vars in 1278 bytes} [Thu Aug 11 00:14:59 2022] POST /compute/v2.1/servers/df0b8857-e218-49f7-92c0-da41236aab32/action => generated 38435 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 00:14:59.233201 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-7e2ddcb8-a7d6-45d3-9bf6-ba21ee8b6726 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 00:14:59.240131 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7e2ddcb8-a7d6-45d3-9bf6-ba21ee8b6726 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:14:59.240636 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7e2ddcb8-a7d6-45d3-9bf6-ba21ee8b6726 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:14:59.241090 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7e2ddcb8-a7d6-45d3-9bf6-ba21ee8b6726 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:14:59.263343 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-7e2ddcb8-a7d6-45d3-9bf6-ba21ee8b6726 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] [instance: df0b8857-e218-49f7-92c0-da41236aab32] Going to try to start instance {{(pid=122633) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 11 00:14:59.304837 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-7e2ddcb8-a7d6-45d3-9bf6-ba21ee8b6726 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "POST /compute/v2.1/servers/df0b8857-e218-49f7-92c0-da41236aab32/action" status: 202 len: 0 microversion: 2.1 time: 0.075757 Aug 11 00:14:59.305445 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3710/7209] 10.222.0.58 () {60 vars in 1278 bytes} [Thu Aug 11 00:14:59 2022] POST /compute/v2.1/servers/df0b8857-e218-49f7-92c0-da41236aab32/action => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 11 00:14:59.315044 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-4940238e-6661-49fd-9b35-bb61481c285a tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:14:59.315845 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-4940238e-6661-49fd-9b35-bb61481c285a tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] [instance: df0b8857-e218-49f7-92c0-da41236aab32] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:14:59.324047 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4940238e-6661-49fd-9b35-bb61481c285a tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:14:59.324633 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4940238e-6661-49fd-9b35-bb61481c285a tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:14:59.325086 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4940238e-6661-49fd-9b35-bb61481c285a tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:14:59.325801 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4940238e-6661-49fd-9b35-bb61481c285a tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:14:59.326257 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4940238e-6661-49fd-9b35-bb61481c285a tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:14:59.326685 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4940238e-6661-49fd-9b35-bb61481c285a tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:14:59.463229 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-4940238e-6661-49fd-9b35-bb61481c285a tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98a27e99564f0ca672fbc06423d9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26799bad802a44c18dfee33c758cbb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:14:59.471093 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-4940238e-6661-49fd-9b35-bb61481c285a tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "GET /compute/v2.1/servers/df0b8857-e218-49f7-92c0-da41236aab32" status: 200 len: 1678 microversion: 2.1 time: 0.160253 Aug 11 00:14:59.471683 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3500/7210] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:14:59 2022] GET /compute/v2.1/servers/df0b8857-e218-49f7-92c0-da41236aab32 => generated 1678 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:15:00.496373 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c3dbe56a-af13-4606-9b61-5f1510764310 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:15:00.497003 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-c3dbe56a-af13-4606-9b61-5f1510764310 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] [instance: df0b8857-e218-49f7-92c0-da41236aab32] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:15:00.504959 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c3dbe56a-af13-4606-9b61-5f1510764310 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:15:00.505459 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c3dbe56a-af13-4606-9b61-5f1510764310 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:15:00.505910 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c3dbe56a-af13-4606-9b61-5f1510764310 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:15:00.506627 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c3dbe56a-af13-4606-9b61-5f1510764310 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:15:00.507128 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c3dbe56a-af13-4606-9b61-5f1510764310 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:15:00.507572 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c3dbe56a-af13-4606-9b61-5f1510764310 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:15:00.645439 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-c3dbe56a-af13-4606-9b61-5f1510764310 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98a27e99564f0ca672fbc06423d9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26799bad802a44c18dfee33c758cbb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:15:00.653191 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-c3dbe56a-af13-4606-9b61-5f1510764310 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "GET /compute/v2.1/servers/df0b8857-e218-49f7-92c0-da41236aab32" status: 200 len: 1682 microversion: 2.1 time: 0.162792 Aug 11 00:15:00.653768 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3711/7211] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:15:00 2022] GET /compute/v2.1/servers/df0b8857-e218-49f7-92c0-da41236aab32 => generated 1682 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:15:26.850158 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-074a7cbd-184e-4bf8-a683-002f1ecc76ac tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 00:15:26.852483 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-074a7cbd-184e-4bf8-a683-002f1ecc76ac tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] [instance: df0b8857-e218-49f7-92c0-da41236aab32] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:15:26.855342 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_api:SELECT=14 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:15:26.856248 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=40 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:15:26.865930 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-074a7cbd-184e-4bf8-a683-002f1ecc76ac tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:15:26.866416 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-074a7cbd-184e-4bf8-a683-002f1ecc76ac tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:15:26.866881 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-074a7cbd-184e-4bf8-a683-002f1ecc76ac tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:15:26.867582 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-074a7cbd-184e-4bf8-a683-002f1ecc76ac tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:15:26.868034 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-074a7cbd-184e-4bf8-a683-002f1ecc76ac tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:15:26.868459 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-074a7cbd-184e-4bf8-a683-002f1ecc76ac tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:15:26.928751 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-074a7cbd-184e-4bf8-a683-002f1ecc76ac tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "POST /compute/v2.1/servers/df0b8857-e218-49f7-92c0-da41236aab32/action" status: 200 len: 62987 microversion: 2.1 time: 0.082292 Aug 11 00:15:26.929744 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3501/7212] 10.222.0.58 () {60 vars in 1278 bytes} [Thu Aug 11 00:15:26 2022] POST /compute/v2.1/servers/df0b8857-e218-49f7-92c0-da41236aab32/action => generated 62987 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 00:15:28.630468 n-d-850468-14 devstack@n-api.service[122633]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 11 00:15:28.631034 n-d-850468-14 devstack@n-api.service[122633]: Thu Aug 11 00:15:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 11 00:15:34.618718 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-065baec9-993c-4b9a-9794-cb1184f9fc20 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:15:34.619403 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-065baec9-993c-4b9a-9794-cb1184f9fc20 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] [instance: df0b8857-e218-49f7-92c0-da41236aab32] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:15:34.620058 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-d1614744-0d48-46fb-92b6-81c28e302201 req-7d86e500-dac6-483c-8378-edb4f0fc0e63 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df0b8857-e218-49f7-92c0-da41236aab32", "tag": "26819870-bebc-49f2-9060-86a2bacdcfa8"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 00:15:34.622023 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_api:SELECT=16 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:15:34.622963 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:15:34.629038 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-065baec9-993c-4b9a-9794-cb1184f9fc20 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:15:34.629548 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-065baec9-993c-4b9a-9794-cb1184f9fc20 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:15:34.630251 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-065baec9-993c-4b9a-9794-cb1184f9fc20 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:15:34.631016 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-065baec9-993c-4b9a-9794-cb1184f9fc20 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:15:34.631484 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-065baec9-993c-4b9a-9794-cb1184f9fc20 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:15:34.631658 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-d1614744-0d48-46fb-92b6-81c28e302201 req-7d86e500-dac6-483c-8378-edb4f0fc0e63 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:15:34.632133 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-d1614744-0d48-46fb-92b6-81c28e302201 req-7d86e500-dac6-483c-8378-edb4f0fc0e63 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:15:34.632269 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-065baec9-993c-4b9a-9794-cb1184f9fc20 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:15:34.632703 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-d1614744-0d48-46fb-92b6-81c28e302201 req-7d86e500-dac6-483c-8378-edb4f0fc0e63 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:15:34.645727 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-d1614744-0d48-46fb-92b6-81c28e302201 req-7d86e500-dac6-483c-8378-edb4f0fc0e63 service nova] Creating event network-changed:26819870-bebc-49f2-9060-86a2bacdcfa8 for instance df0b8857-e218-49f7-92c0-da41236aab32 on n-h1-850468-14 Aug 11 00:15:34.653202 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-d1614744-0d48-46fb-92b6-81c28e302201 req-7d86e500-dac6-483c-8378-edb4f0fc0e63 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036624 Aug 11 00:15:34.657935 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3502/7213] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 11 00:15:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 00:15:34.666948 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-065baec9-993c-4b9a-9794-cb1184f9fc20 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] [instance: df0b8857-e218-49f7-92c0-da41236aab32] Going to try to terminate instance {{(pid=122633) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 11 00:15:34.755575 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-065baec9-993c-4b9a-9794-cb1184f9fc20 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "DELETE /compute/v2.1/servers/df0b8857-e218-49f7-92c0-da41236aab32" status: 204 len: 0 microversion: 2.1 time: 0.140701 Aug 11 00:15:34.756352 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3712/7214] 10.222.0.58 () {58 vars in 1239 bytes} [Thu Aug 11 00:15:34 2022] DELETE /compute/v2.1/servers/df0b8857-e218-49f7-92c0-da41236aab32 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 11 00:15:34.766961 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-d0a4e666-2167-419f-b629-f9ff30905ef7 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:15:34.767820 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-d0a4e666-2167-419f-b629-f9ff30905ef7 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] [instance: df0b8857-e218-49f7-92c0-da41236aab32] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:15:34.775335 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d0a4e666-2167-419f-b629-f9ff30905ef7 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:15:34.776078 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d0a4e666-2167-419f-b629-f9ff30905ef7 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:15:34.776737 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d0a4e666-2167-419f-b629-f9ff30905ef7 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:15:34.778327 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d0a4e666-2167-419f-b629-f9ff30905ef7 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:15:34.779717 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d0a4e666-2167-419f-b629-f9ff30905ef7 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:15:34.780370 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d0a4e666-2167-419f-b629-f9ff30905ef7 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:15:34.987415 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-d0a4e666-2167-419f-b629-f9ff30905ef7 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98a27e99564f0ca672fbc06423d9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26799bad802a44c18dfee33c758cbb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:15:34.995280 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-d0a4e666-2167-419f-b629-f9ff30905ef7 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "GET /compute/v2.1/servers/df0b8857-e218-49f7-92c0-da41236aab32" status: 200 len: 1688 microversion: 2.1 time: 0.233236 Aug 11 00:15:34.995860 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3503/7215] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:15:34 2022] GET /compute/v2.1/servers/df0b8857-e218-49f7-92c0-da41236aab32 => generated 1688 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:15:36.018047 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-e076e8f8-10d1-4286-951e-a472095c5f8c tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:15:36.018769 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-e076e8f8-10d1-4286-951e-a472095c5f8c tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] [instance: df0b8857-e218-49f7-92c0-da41236aab32] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:15:36.025591 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e076e8f8-10d1-4286-951e-a472095c5f8c tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:15:36.026094 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e076e8f8-10d1-4286-951e-a472095c5f8c tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:15:36.026550 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e076e8f8-10d1-4286-951e-a472095c5f8c tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:15:36.027829 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e076e8f8-10d1-4286-951e-a472095c5f8c tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:15:36.028439 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e076e8f8-10d1-4286-951e-a472095c5f8c tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:15:36.028894 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e076e8f8-10d1-4286-951e-a472095c5f8c tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:15:36.288036 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-e076e8f8-10d1-4286-951e-a472095c5f8c tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98a27e99564f0ca672fbc06423d9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26799bad802a44c18dfee33c758cbb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:15:36.299534 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-e076e8f8-10d1-4286-951e-a472095c5f8c tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "GET /compute/v2.1/servers/df0b8857-e218-49f7-92c0-da41236aab32" status: 200 len: 1688 microversion: 2.1 time: 0.285647 Aug 11 00:15:36.300551 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3713/7216] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:15:36 2022] GET /compute/v2.1/servers/df0b8857-e218-49f7-92c0-da41236aab32 => generated 1688 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:15:36.690959 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-e422f9b0-b763-429d-aa22-db0a3b902084 req-bcdce025-2505-4635-a965-bb4f7fcfcc4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df0b8857-e218-49f7-92c0-da41236aab32", "name": "network-vif-deleted", "tag": "26819870-bebc-49f2-9060-86a2bacdcfa8"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 00:15:36.701305 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-e422f9b0-b763-429d-aa22-db0a3b902084 req-bcdce025-2505-4635-a965-bb4f7fcfcc4b service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:15:36.701835 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-e422f9b0-b763-429d-aa22-db0a3b902084 req-bcdce025-2505-4635-a965-bb4f7fcfcc4b service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:15:36.702220 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-e422f9b0-b763-429d-aa22-db0a3b902084 req-bcdce025-2505-4635-a965-bb4f7fcfcc4b service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:15:36.713805 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-e422f9b0-b763-429d-aa22-db0a3b902084 req-bcdce025-2505-4635-a965-bb4f7fcfcc4b service nova] Creating event network-vif-deleted:26819870-bebc-49f2-9060-86a2bacdcfa8 for instance df0b8857-e218-49f7-92c0-da41236aab32 on n-h1-850468-14 Aug 11 00:15:36.719041 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-e422f9b0-b763-429d-aa22-db0a3b902084 req-bcdce025-2505-4635-a965-bb4f7fcfcc4b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031812 Aug 11 00:15:36.719635 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3504/7217] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 11 00:15:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 00:15:37.321926 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-615fbfeb-75f1-4a82-9bf2-8584122dead1 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:15:37.322548 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-615fbfeb-75f1-4a82-9bf2-8584122dead1 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] [instance: df0b8857-e218-49f7-92c0-da41236aab32] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:15:37.329739 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-615fbfeb-75f1-4a82-9bf2-8584122dead1 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:15:37.330238 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-615fbfeb-75f1-4a82-9bf2-8584122dead1 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:15:37.330689 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-615fbfeb-75f1-4a82-9bf2-8584122dead1 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:15:37.331435 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-615fbfeb-75f1-4a82-9bf2-8584122dead1 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:15:37.331903 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-615fbfeb-75f1-4a82-9bf2-8584122dead1 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:15:37.332345 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-615fbfeb-75f1-4a82-9bf2-8584122dead1 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:15:37.345703 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-615fbfeb-75f1-4a82-9bf2-8584122dead1 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] HTTP exception thrown: Instance df0b8857-e218-49f7-92c0-da41236aab32 could not be found. Aug 11 00:15:37.347392 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-615fbfeb-75f1-4a82-9bf2-8584122dead1 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Request method failure captured: Aug 11 00:15:37.347392 n-d-850468-14 devstack@n-api.service[122633]: request: GET /compute/v2.1/servers/df0b8857-e218-49f7-92c0-da41236aab32 HTTP/1.1 Aug 11 00:15:37.347392 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 11 00:15:37.347392 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 11 00:15:37.347392 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 11 00:15:37.347392 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 11 00:15:37.347392 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 11 00:15:37.347392 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 11 00:15:37.347392 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 11 00:15:37.347392 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 11 00:15:37.347392 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9Eicgn9rrdRuvAzeJtJZ7G3bC_nDgFR3SCpmMvM-oSUDIishF0KIrgIe24vn-zIDWQFTlnHZqZzmBW04xZWO5xjxS0bhWpiqJFEiDbQjnCF5CEqW_Qy1Z8Dx6EdfjYFAs6IHw9dtZURRdVWG0taseoTltbZtc3U4Z0kNtdabyg0lDPw Aug 11 00:15:37.347392 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 11 00:15:37.347392 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 11 00:15:37.347392 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 11 00:15:37.347392 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 11 00:15:37.347392 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 11 00:15:37.347392 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 11 00:15:37.347392 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 26799bad802a44c18dfee33c758cbb60 Aug 11 00:15:37.347392 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-458446174 Aug 11 00:15:37.347392 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 11 00:15:37.347392 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 11 00:15:37.347392 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/26799bad802a44c18dfee33c758cbb60"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/26799bad802a44c18dfee33c758cbb60"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/26799bad802a44c18dfee33c758cbb60"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_26799bad802a44c18dfee33c758cbb60", "adminURL": "http://10.222.0.58:8080"}]}] Aug 11 00:15:37.347392 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-TestNetworkAdvancedServerOps-458446174 Aug 11 00:15:37.347392 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 26799bad802a44c18dfee33c758cbb60 Aug 11 00:15:37.347392 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-458446174 Aug 11 00:15:37.347392 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-TestNetworkAdvancedServerOps-458446174-project Aug 11 00:15:37.347392 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 11 00:15:37.347392 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 11 00:15:37.347392 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 8e98a27e99564f0ca672fbc06423d9ea Aug 11 00:15:37.347392 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-TestNetworkAdvancedServerOps-458446174-project Aug 11 00:15:37.347392 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 11 00:15:37.347392 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance df0b8857-e218-49f7-92c0-da41236aab32 could not be found. Aug 11 00:15:37.347392 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': 'df0b8857-e218-49f7-92c0-da41236aab32'} Aug 11 00:15:37.347392 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 00:15:37.347392 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 00:15:37.347392 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 11 00:15:37.347392 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 11 00:15:37.347392 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 11 00:15:37.347392 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 11 00:15:37.347392 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 11 00:15:37.347392 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 11 00:15:37.347392 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 11 00:15:37.347392 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 11 00:15:37.347392 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df0b8857-e218-49f7-92c0-da41236aab32 could not be found. Aug 11 00:15:37.347392 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 11 00:15:37.347392 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 00:15:37.347392 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 11 00:15:37.347392 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 00:15:37.347392 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 00:15:37.347392 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 00:15:37.347392 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 00:15:37.347392 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 00:15:37.347392 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 00:15:37.347392 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 00:15:37.347392 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 11 00:15:37.347392 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 11 00:15:37.347392 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 11 00:15:37.347392 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 11 00:15:37.347392 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 11 00:15:37.347392 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 11 00:15:37.347392 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df0b8857-e218-49f7-92c0-da41236aab32 could not be found. Aug 11 00:15:37.347392 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 11 00:15:37.347392 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 00:15:37.352031 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 11 00:15:37.352031 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 00:15:37.352031 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 00:15:37.352031 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 00:15:37.352031 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 00:15:37.352031 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 00:15:37.352031 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df0b8857-e218-49f7-92c0-da41236aab32 could not be found. Aug 11 00:15:37.352031 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 11 00:15:37.352031 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-615fbfeb-75f1-4a82-9bf2-8584122dead1 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Returning 404 to user: Instance df0b8857-e218-49f7-92c0-da41236aab32 could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 00:15:37.352031 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-615fbfeb-75f1-4a82-9bf2-8584122dead1 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "GET /compute/v2.1/servers/df0b8857-e218-49f7-92c0-da41236aab32" status: 404 len: 111 microversion: 2.1 time: 0.030916 Aug 11 00:15:37.352031 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3714/7218] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:15:37 2022] GET /compute/v2.1/servers/df0b8857-e218-49f7-92c0-da41236aab32 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 11 00:15:40.387174 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-9b0632b8-27b1-4467-9e50-e73191055c1d tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Calling method '.version_select at 0x7f847c5b5790>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:15:40.411620 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-9b0632b8-27b1-4467-9e50-e73191055c1d tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-573238571" status: 202 len: 0 microversion: 2.1 time: 0.031494 Aug 11 00:15:40.412198 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3505/7219] 10.222.0.58 () {58 vars in 1281 bytes} [Thu Aug 11 00:15:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-573238571 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 11 00:15:40.444008 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-616b6c62-2f14-4c0f-81bd-63e73180760d tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Action: 'create', calling method: .version_select at 0x7f847c098040>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1672970326", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEaeNU3V82gaXEf5C5vsla2oqIRJBst/D12Kgxc84HkqK6xqunfJr0WRt7Y6stdXScLDp5JHs4WrdwV0bPS0yPTQW+9XqREFBoRUBUBI1zgCNUZVd/osNRJ8UOU0cTQdKw=="}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 00:15:40.460843 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-616b6c62-2f14-4c0f-81bd-63e73180760d tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Getting quotas for project 26799bad802a44c18dfee33c758cbb60. Resources: {'key_pairs'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 11 00:15:40.467547 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-616b6c62-2f14-4c0f-81bd-63e73180760d tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Getting quotas for user 8e98a27e99564f0ca672fbc06423d9ea and project 26799bad802a44c18dfee33c758cbb60. Resources: {'key_pairs'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 11 00:15:40.493542 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-616b6c62-2f14-4c0f-81bd-63e73180760d tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.053333 Aug 11 00:15:40.494048 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3715/7220] 10.222.0.58 () {60 vars in 1159 bytes} [Thu Aug 11 00:15:40 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 00:15:46.471614 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-54272ef9-e98e-4aae-b2ed-3a4fdd0a42ec tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1627938461", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452", "networks": [{"uuid": "1b02cb41-92a1-419d-957c-194580194a1d"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1672970326", "security_groups": [{"name": "tempest-secgroup-smoke-157240419"}]}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 00:15:46.619979 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.network.neutron [None req-54272ef9-e98e-4aae-b2ed-3a4fdd0a42ec tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] validate_networks() for [('1b02cb41-92a1-419d-957c-194580194a1d', None, None, None, None, None)] {{(pid=122632) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 11 00:15:46.707660 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=14 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:15:47.061881 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-54272ef9-e98e-4aae-b2ed-3a4fdd0a42ec tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Flavor limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 11 00:15:47.062379 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-54272ef9-e98e-4aae-b2ed-3a4fdd0a42ec tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Image limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 11 00:15:47.062962 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-54272ef9-e98e-4aae-b2ed-3a4fdd0a42ec tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Flavor pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 11 00:15:47.063442 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-54272ef9-e98e-4aae-b2ed-3a4fdd0a42ec tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Image pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 11 00:15:47.063859 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-54272ef9-e98e-4aae-b2ed-3a4fdd0a42ec tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 11 00:15:47.075579 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-54272ef9-e98e-4aae-b2ed-3a4fdd0a42ec tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:15:47.076267 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-54272ef9-e98e-4aae-b2ed-3a4fdd0a42ec tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:15:47.076966 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-54272ef9-e98e-4aae-b2ed-3a4fdd0a42ec tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:15:47.077724 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-54272ef9-e98e-4aae-b2ed-3a4fdd0a42ec tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:15:47.078185 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-54272ef9-e98e-4aae-b2ed-3a4fdd0a42ec tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:15:47.078622 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-54272ef9-e98e-4aae-b2ed-3a4fdd0a42ec tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:15:47.096905 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-54272ef9-e98e-4aae-b2ed-3a4fdd0a42ec tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Getting quotas for project 26799bad802a44c18dfee33c758cbb60. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 11 00:15:47.102210 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-54272ef9-e98e-4aae-b2ed-3a4fdd0a42ec tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Getting quotas for user 8e98a27e99564f0ca672fbc06423d9ea and project 26799bad802a44c18dfee33c758cbb60. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 11 00:15:47.115392 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-54272ef9-e98e-4aae-b2ed-3a4fdd0a42ec tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Going to run 1 instances... {{(pid=122632) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 11 00:15:47.117761 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-54272ef9-e98e-4aae-b2ed-3a4fdd0a42ec tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] [instance: 67a99a65-d2be-46ba-8132-b5d777f18ef6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78ad8905-f66f-4733-8be9-2b260f1fabed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122632) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 11 00:15:47.163986 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-54272ef9-e98e-4aae-b2ed-3a4fdd0a42ec tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.701671 Aug 11 00:15:47.164995 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3506/7221] 10.222.0.58 () {60 vars in 1147 bytes} [Thu Aug 11 00:15:46 2022] POST /compute/v2.1/servers => generated 405 bytes in 703 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 11 00:15:47.178143 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-a7391013-162f-4997-9f83-888252159cf5 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:15:47.178804 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-a7391013-162f-4997-9f83-888252159cf5 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] [instance: 67a99a65-d2be-46ba-8132-b5d777f18ef6] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:15:47.236846 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-a7391013-162f-4997-9f83-888252159cf5 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98a27e99564f0ca672fbc06423d9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26799bad802a44c18dfee33c758cbb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:15:47.243778 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-a7391013-162f-4997-9f83-888252159cf5 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "GET /compute/v2.1/servers/67a99a65-d2be-46ba-8132-b5d777f18ef6" status: 200 len: 1267 microversion: 2.1 time: 0.071106 Aug 11 00:15:47.244798 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3716/7222] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:15:47 2022] GET /compute/v2.1/servers/67a99a65-d2be-46ba-8132-b5d777f18ef6 => generated 1267 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:15:48.286748 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-fc3b15ab-29ab-4dc0-8d93-a5ecb7a8a583 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:15:48.289082 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-fc3b15ab-29ab-4dc0-8d93-a5ecb7a8a583 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] [instance: 67a99a65-d2be-46ba-8132-b5d777f18ef6] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:15:48.299866 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fc3b15ab-29ab-4dc0-8d93-a5ecb7a8a583 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:15:48.300823 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fc3b15ab-29ab-4dc0-8d93-a5ecb7a8a583 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:15:48.301431 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fc3b15ab-29ab-4dc0-8d93-a5ecb7a8a583 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:15:48.302549 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fc3b15ab-29ab-4dc0-8d93-a5ecb7a8a583 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:15:48.303682 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fc3b15ab-29ab-4dc0-8d93-a5ecb7a8a583 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:15:48.307913 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fc3b15ab-29ab-4dc0-8d93-a5ecb7a8a583 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:15:48.446410 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-fc3b15ab-29ab-4dc0-8d93-a5ecb7a8a583 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98a27e99564f0ca672fbc06423d9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26799bad802a44c18dfee33c758cbb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:15:48.465092 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-fc3b15ab-29ab-4dc0-8d93-a5ecb7a8a583 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "GET /compute/v2.1/servers/67a99a65-d2be-46ba-8132-b5d777f18ef6" status: 200 len: 1327 microversion: 2.1 time: 0.203879 Aug 11 00:15:48.471953 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3507/7223] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:15:48 2022] GET /compute/v2.1/servers/67a99a65-d2be-46ba-8132-b5d777f18ef6 => generated 1327 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:15:49.493897 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-098d1d1b-83f1-46c8-b53e-6f69dd337088 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:15:49.494539 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-098d1d1b-83f1-46c8-b53e-6f69dd337088 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] [instance: 67a99a65-d2be-46ba-8132-b5d777f18ef6] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:15:49.497394 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:15:49.505492 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-098d1d1b-83f1-46c8-b53e-6f69dd337088 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:15:49.506006 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-098d1d1b-83f1-46c8-b53e-6f69dd337088 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:15:49.506461 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-098d1d1b-83f1-46c8-b53e-6f69dd337088 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:15:49.507230 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-098d1d1b-83f1-46c8-b53e-6f69dd337088 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:15:49.507732 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-098d1d1b-83f1-46c8-b53e-6f69dd337088 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:15:49.508176 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-098d1d1b-83f1-46c8-b53e-6f69dd337088 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:15:49.664301 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-098d1d1b-83f1-46c8-b53e-6f69dd337088 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98a27e99564f0ca672fbc06423d9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26799bad802a44c18dfee33c758cbb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:15:49.672692 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-098d1d1b-83f1-46c8-b53e-6f69dd337088 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "GET /compute/v2.1/servers/67a99a65-d2be-46ba-8132-b5d777f18ef6" status: 200 len: 1392 microversion: 2.1 time: 0.182952 Aug 11 00:15:49.673429 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3717/7224] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:15:49 2022] GET /compute/v2.1/servers/67a99a65-d2be-46ba-8132-b5d777f18ef6 => generated 1392 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:15:49.775721 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-be5e359f-c8d6-43a4-bec5-5bca137fe7df req-42574965-2649-4793-a787-63c550759c18 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67a99a65-d2be-46ba-8132-b5d777f18ef6", "tag": "d758cbb4-b10e-4561-87d7-1d8e4fe4bd7f"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 00:15:49.788017 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-be5e359f-c8d6-43a4-bec5-5bca137fe7df req-42574965-2649-4793-a787-63c550759c18 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:15:49.788598 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-be5e359f-c8d6-43a4-bec5-5bca137fe7df req-42574965-2649-4793-a787-63c550759c18 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:15:49.789162 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-be5e359f-c8d6-43a4-bec5-5bca137fe7df req-42574965-2649-4793-a787-63c550759c18 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:15:49.802036 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-be5e359f-c8d6-43a4-bec5-5bca137fe7df req-42574965-2649-4793-a787-63c550759c18 service nova] Creating event network-changed:d758cbb4-b10e-4561-87d7-1d8e4fe4bd7f for instance 67a99a65-d2be-46ba-8132-b5d777f18ef6 on n-h2-850468-14 Aug 11 00:15:49.806953 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-be5e359f-c8d6-43a4-bec5-5bca137fe7df req-42574965-2649-4793-a787-63c550759c18 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035057 Aug 11 00:15:49.807558 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3508/7225] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 11 00:15:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 00:15:50.695378 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-5538001f-87fd-4e26-93b9-99898736fa9a tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:15:50.696005 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-5538001f-87fd-4e26-93b9-99898736fa9a tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] [instance: 67a99a65-d2be-46ba-8132-b5d777f18ef6] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:15:50.704010 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5538001f-87fd-4e26-93b9-99898736fa9a tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:15:50.704514 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5538001f-87fd-4e26-93b9-99898736fa9a tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:15:50.704971 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5538001f-87fd-4e26-93b9-99898736fa9a tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:15:50.705696 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5538001f-87fd-4e26-93b9-99898736fa9a tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:15:50.706164 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5538001f-87fd-4e26-93b9-99898736fa9a tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:15:50.706608 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5538001f-87fd-4e26-93b9-99898736fa9a tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:15:50.846472 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-5538001f-87fd-4e26-93b9-99898736fa9a tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98a27e99564f0ca672fbc06423d9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26799bad802a44c18dfee33c758cbb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:15:50.854269 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-5538001f-87fd-4e26-93b9-99898736fa9a tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "GET /compute/v2.1/servers/67a99a65-d2be-46ba-8132-b5d777f18ef6" status: 200 len: 1392 microversion: 2.1 time: 0.162903 Aug 11 00:15:50.854881 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3718/7226] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:15:50 2022] GET /compute/v2.1/servers/67a99a65-d2be-46ba-8132-b5d777f18ef6 => generated 1392 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:15:51.877919 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c3884576-f4e1-457b-9842-0eb4a813409f tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:15:51.878619 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-c3884576-f4e1-457b-9842-0eb4a813409f tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] [instance: 67a99a65-d2be-46ba-8132-b5d777f18ef6] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:15:51.884777 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c3884576-f4e1-457b-9842-0eb4a813409f tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:15:51.885253 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c3884576-f4e1-457b-9842-0eb4a813409f tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:15:51.885941 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c3884576-f4e1-457b-9842-0eb4a813409f tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:15:51.887301 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c3884576-f4e1-457b-9842-0eb4a813409f tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:15:51.887922 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c3884576-f4e1-457b-9842-0eb4a813409f tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:15:51.888343 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c3884576-f4e1-457b-9842-0eb4a813409f tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:15:52.026406 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-c3884576-f4e1-457b-9842-0eb4a813409f tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98a27e99564f0ca672fbc06423d9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26799bad802a44c18dfee33c758cbb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:15:52.034325 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-c3884576-f4e1-457b-9842-0eb4a813409f tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "GET /compute/v2.1/servers/67a99a65-d2be-46ba-8132-b5d777f18ef6" status: 200 len: 1392 microversion: 2.1 time: 0.161453 Aug 11 00:15:52.034999 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3509/7227] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:15:51 2022] GET /compute/v2.1/servers/67a99a65-d2be-46ba-8132-b5d777f18ef6 => generated 1392 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:15:53.055824 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-b3ac1b8c-1800-44c7-841f-aca8f4e2940b tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:15:53.056452 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-b3ac1b8c-1800-44c7-841f-aca8f4e2940b tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] [instance: 67a99a65-d2be-46ba-8132-b5d777f18ef6] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:15:53.063560 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b3ac1b8c-1800-44c7-841f-aca8f4e2940b tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:15:53.064063 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b3ac1b8c-1800-44c7-841f-aca8f4e2940b tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:15:53.064523 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b3ac1b8c-1800-44c7-841f-aca8f4e2940b tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:15:53.065279 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b3ac1b8c-1800-44c7-841f-aca8f4e2940b tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:15:53.065798 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b3ac1b8c-1800-44c7-841f-aca8f4e2940b tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:15:53.066266 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b3ac1b8c-1800-44c7-841f-aca8f4e2940b tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:15:53.197556 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-b3ac1b8c-1800-44c7-841f-aca8f4e2940b tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98a27e99564f0ca672fbc06423d9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26799bad802a44c18dfee33c758cbb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:15:53.205618 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-b3ac1b8c-1800-44c7-841f-aca8f4e2940b tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "GET /compute/v2.1/servers/67a99a65-d2be-46ba-8132-b5d777f18ef6" status: 200 len: 1392 microversion: 2.1 time: 0.153940 Aug 11 00:15:53.206199 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3719/7228] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:15:53 2022] GET /compute/v2.1/servers/67a99a65-d2be-46ba-8132-b5d777f18ef6 => generated 1392 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:15:54.227081 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-6b1b995f-33e9-4db1-a62f-de2ebc1be308 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:15:54.227698 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-6b1b995f-33e9-4db1-a62f-de2ebc1be308 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] [instance: 67a99a65-d2be-46ba-8132-b5d777f18ef6] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:15:54.235307 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6b1b995f-33e9-4db1-a62f-de2ebc1be308 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:15:54.235795 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6b1b995f-33e9-4db1-a62f-de2ebc1be308 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:15:54.236234 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6b1b995f-33e9-4db1-a62f-de2ebc1be308 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:15:54.237046 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6b1b995f-33e9-4db1-a62f-de2ebc1be308 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:15:54.237506 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6b1b995f-33e9-4db1-a62f-de2ebc1be308 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:15:54.237937 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6b1b995f-33e9-4db1-a62f-de2ebc1be308 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:15:54.374053 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-6b1b995f-33e9-4db1-a62f-de2ebc1be308 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98a27e99564f0ca672fbc06423d9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26799bad802a44c18dfee33c758cbb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:15:54.381629 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-6b1b995f-33e9-4db1-a62f-de2ebc1be308 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "GET /compute/v2.1/servers/67a99a65-d2be-46ba-8132-b5d777f18ef6" status: 200 len: 1392 microversion: 2.1 time: 0.158542 Aug 11 00:15:54.382212 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3510/7229] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:15:54 2022] GET /compute/v2.1/servers/67a99a65-d2be-46ba-8132-b5d777f18ef6 => generated 1392 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:15:55.403884 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-d464c926-b6e5-41a1-a9ee-8d3b533e78e4 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:15:55.404585 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-d464c926-b6e5-41a1-a9ee-8d3b533e78e4 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] [instance: 67a99a65-d2be-46ba-8132-b5d777f18ef6] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:15:55.412526 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d464c926-b6e5-41a1-a9ee-8d3b533e78e4 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:15:55.413024 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d464c926-b6e5-41a1-a9ee-8d3b533e78e4 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:15:55.413481 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d464c926-b6e5-41a1-a9ee-8d3b533e78e4 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:15:55.414197 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d464c926-b6e5-41a1-a9ee-8d3b533e78e4 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:15:55.414662 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d464c926-b6e5-41a1-a9ee-8d3b533e78e4 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:15:55.415143 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d464c926-b6e5-41a1-a9ee-8d3b533e78e4 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:15:55.453893 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-da25fafa-c5f4-48b5-995b-b8eb2491eaea req-05cf103e-98c2-40c2-9c75-c25c9f3636c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67a99a65-d2be-46ba-8132-b5d777f18ef6", "name": "network-vif-plugged", "status": "completed", "tag": "d758cbb4-b10e-4561-87d7-1d8e4fe4bd7f"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 00:15:55.467022 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-da25fafa-c5f4-48b5-995b-b8eb2491eaea req-05cf103e-98c2-40c2-9c75-c25c9f3636c2 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:15:55.467576 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-da25fafa-c5f4-48b5-995b-b8eb2491eaea req-05cf103e-98c2-40c2-9c75-c25c9f3636c2 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:15:55.468346 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-da25fafa-c5f4-48b5-995b-b8eb2491eaea req-05cf103e-98c2-40c2-9c75-c25c9f3636c2 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:15:55.480207 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-da25fafa-c5f4-48b5-995b-b8eb2491eaea req-05cf103e-98c2-40c2-9c75-c25c9f3636c2 service nova] Creating event network-vif-plugged:d758cbb4-b10e-4561-87d7-1d8e4fe4bd7f for instance 67a99a65-d2be-46ba-8132-b5d777f18ef6 on n-h2-850468-14 Aug 11 00:15:55.485659 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-da25fafa-c5f4-48b5-995b-b8eb2491eaea req-05cf103e-98c2-40c2-9c75-c25c9f3636c2 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035463 Aug 11 00:15:55.486334 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3511/7230] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 11 00:15:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 11 00:15:55.611494 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-d464c926-b6e5-41a1-a9ee-8d3b533e78e4 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98a27e99564f0ca672fbc06423d9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26799bad802a44c18dfee33c758cbb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:15:55.619930 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-d464c926-b6e5-41a1-a9ee-8d3b533e78e4 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "GET /compute/v2.1/servers/67a99a65-d2be-46ba-8132-b5d777f18ef6" status: 200 len: 1392 microversion: 2.1 time: 0.219906 Aug 11 00:15:55.620534 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3720/7231] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:15:55 2022] GET /compute/v2.1/servers/67a99a65-d2be-46ba-8132-b5d777f18ef6 => generated 1392 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:15:56.642703 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-fab1746d-3023-413e-9883-16e9f2b89c06 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:15:56.643423 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-fab1746d-3023-413e-9883-16e9f2b89c06 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] [instance: 67a99a65-d2be-46ba-8132-b5d777f18ef6] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:15:56.650463 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fab1746d-3023-413e-9883-16e9f2b89c06 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:15:56.650982 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fab1746d-3023-413e-9883-16e9f2b89c06 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:15:56.651425 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fab1746d-3023-413e-9883-16e9f2b89c06 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:15:56.652172 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fab1746d-3023-413e-9883-16e9f2b89c06 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:15:56.653185 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fab1746d-3023-413e-9883-16e9f2b89c06 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:15:56.653609 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fab1746d-3023-413e-9883-16e9f2b89c06 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:15:56.791992 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-fab1746d-3023-413e-9883-16e9f2b89c06 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98a27e99564f0ca672fbc06423d9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26799bad802a44c18dfee33c758cbb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:15:56.800226 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-fab1746d-3023-413e-9883-16e9f2b89c06 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "GET /compute/v2.1/servers/67a99a65-d2be-46ba-8132-b5d777f18ef6" status: 200 len: 1392 microversion: 2.1 time: 0.161761 Aug 11 00:15:56.800815 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3512/7232] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:15:56 2022] GET /compute/v2.1/servers/67a99a65-d2be-46ba-8132-b5d777f18ef6 => generated 1392 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 00:15:57.823390 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-92b07848-c554-4a37-bf4d-8e69db7d16cb tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:15:57.824170 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-92b07848-c554-4a37-bf4d-8e69db7d16cb tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] [instance: 67a99a65-d2be-46ba-8132-b5d777f18ef6] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:15:57.826809 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=6 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:15:57.832382 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-92b07848-c554-4a37-bf4d-8e69db7d16cb tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:15:57.832888 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-92b07848-c554-4a37-bf4d-8e69db7d16cb tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:15:57.833346 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-92b07848-c554-4a37-bf4d-8e69db7d16cb tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:15:57.834060 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-92b07848-c554-4a37-bf4d-8e69db7d16cb tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:15:57.834536 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-92b07848-c554-4a37-bf4d-8e69db7d16cb tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:15:57.835018 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-92b07848-c554-4a37-bf4d-8e69db7d16cb tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:15:57.977018 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-92b07848-c554-4a37-bf4d-8e69db7d16cb tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98a27e99564f0ca672fbc06423d9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26799bad802a44c18dfee33c758cbb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:15:57.985537 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-92b07848-c554-4a37-bf4d-8e69db7d16cb tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "GET /compute/v2.1/servers/67a99a65-d2be-46ba-8132-b5d777f18ef6" status: 200 len: 1564 microversion: 2.1 time: 0.166131 Aug 11 00:15:57.986132 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3721/7233] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:15:57 2022] GET /compute/v2.1/servers/67a99a65-d2be-46ba-8132-b5d777f18ef6 => generated 1564 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:15:58.006257 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-f90bf282-8935-4953-8d72-3e81da2acc04 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:15:58.006900 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-f90bf282-8935-4953-8d72-3e81da2acc04 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] [instance: 67a99a65-d2be-46ba-8132-b5d777f18ef6] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:15:58.008884 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=2 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:15:58.009786 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=6 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:15:58.011463 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_api:SELECT=39,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:15:58.020213 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f90bf282-8935-4953-8d72-3e81da2acc04 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:15:58.020709 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f90bf282-8935-4953-8d72-3e81da2acc04 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:15:58.021150 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f90bf282-8935-4953-8d72-3e81da2acc04 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:15:58.021865 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f90bf282-8935-4953-8d72-3e81da2acc04 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:15:58.022323 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f90bf282-8935-4953-8d72-3e81da2acc04 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:15:58.022755 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f90bf282-8935-4953-8d72-3e81da2acc04 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:15:58.164252 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-f90bf282-8935-4953-8d72-3e81da2acc04 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98a27e99564f0ca672fbc06423d9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26799bad802a44c18dfee33c758cbb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:15:58.172330 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-f90bf282-8935-4953-8d72-3e81da2acc04 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "GET /compute/v2.1/servers/67a99a65-d2be-46ba-8132-b5d777f18ef6" status: 200 len: 1564 microversion: 2.1 time: 0.169946 Aug 11 00:15:58.172903 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3513/7234] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:15:58 2022] GET /compute/v2.1/servers/67a99a65-d2be-46ba-8132-b5d777f18ef6 => generated 1564 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:16:00.127962 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-6e010511-75fd-417e-9b07-9cd2efb52a67 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:16:00.128732 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-2132c16c-da98-47bf-b5bd-389cdb0f71ce req-3083b09e-1921-4ada-bcec-df56bc08e59d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67a99a65-d2be-46ba-8132-b5d777f18ef6", "tag": "d758cbb4-b10e-4561-87d7-1d8e4fe4bd7f"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 00:16:00.129306 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-6e010511-75fd-417e-9b07-9cd2efb52a67 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] [instance: 67a99a65-d2be-46ba-8132-b5d777f18ef6] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:16:00.137643 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6e010511-75fd-417e-9b07-9cd2efb52a67 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:16:00.138424 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6e010511-75fd-417e-9b07-9cd2efb52a67 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:16:00.138899 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6e010511-75fd-417e-9b07-9cd2efb52a67 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:16:00.139772 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6e010511-75fd-417e-9b07-9cd2efb52a67 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:16:00.140397 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6e010511-75fd-417e-9b07-9cd2efb52a67 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:16:00.140835 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6e010511-75fd-417e-9b07-9cd2efb52a67 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:16:00.141832 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-2132c16c-da98-47bf-b5bd-389cdb0f71ce req-3083b09e-1921-4ada-bcec-df56bc08e59d service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:16:00.142314 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-2132c16c-da98-47bf-b5bd-389cdb0f71ce req-3083b09e-1921-4ada-bcec-df56bc08e59d service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:16:00.142908 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-2132c16c-da98-47bf-b5bd-389cdb0f71ce req-3083b09e-1921-4ada-bcec-df56bc08e59d service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:16:00.155214 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-2132c16c-da98-47bf-b5bd-389cdb0f71ce req-3083b09e-1921-4ada-bcec-df56bc08e59d service nova] Creating event network-changed:d758cbb4-b10e-4561-87d7-1d8e4fe4bd7f for instance 67a99a65-d2be-46ba-8132-b5d777f18ef6 on n-h2-850468-14 Aug 11 00:16:00.160807 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-2132c16c-da98-47bf-b5bd-389cdb0f71ce req-3083b09e-1921-4ada-bcec-df56bc08e59d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035932 Aug 11 00:16:00.161954 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3514/7235] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 11 00:16:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 11 00:16:00.288278 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-6e010511-75fd-417e-9b07-9cd2efb52a67 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98a27e99564f0ca672fbc06423d9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26799bad802a44c18dfee33c758cbb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:16:00.297549 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-6e010511-75fd-417e-9b07-9cd2efb52a67 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "GET /compute/v2.1/servers/67a99a65-d2be-46ba-8132-b5d777f18ef6" status: 200 len: 1564 microversion: 2.1 time: 0.174473 Aug 11 00:16:00.298146 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3722/7236] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:16:00 2022] GET /compute/v2.1/servers/67a99a65-d2be-46ba-8132-b5d777f18ef6 => generated 1564 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:16:23.596234 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-1dd38f2e-68b9-4693-9209-b4f761e469bd tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 00:16:23.598485 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-1dd38f2e-68b9-4693-9209-b4f761e469bd tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] [instance: 67a99a65-d2be-46ba-8132-b5d777f18ef6] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:16:23.600822 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_api:SELECT=3 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:16:23.601472 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=38 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:16:23.608609 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1dd38f2e-68b9-4693-9209-b4f761e469bd tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:16:23.609100 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1dd38f2e-68b9-4693-9209-b4f761e469bd tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:16:23.609544 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1dd38f2e-68b9-4693-9209-b4f761e469bd tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:16:23.610256 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1dd38f2e-68b9-4693-9209-b4f761e469bd tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:16:23.610711 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1dd38f2e-68b9-4693-9209-b4f761e469bd tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:16:23.611184 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1dd38f2e-68b9-4693-9209-b4f761e469bd tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:16:23.664583 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-1dd38f2e-68b9-4693-9209-b4f761e469bd tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "POST /compute/v2.1/servers/67a99a65-d2be-46ba-8132-b5d777f18ef6/action" status: 200 len: 24561 microversion: 2.1 time: 0.072588 Aug 11 00:16:23.665263 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3515/7237] 10.222.0.58 () {60 vars in 1278 bytes} [Thu Aug 11 00:16:23 2022] POST /compute/v2.1/servers/67a99a65-d2be-46ba-8132-b5d777f18ef6/action => generated 24561 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 00:16:34.611214 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c0f05402-2ed9-4dfc-b747-13e1e79876d9 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 00:16:34.611772 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-c0f05402-2ed9-4dfc-b747-13e1e79876d9 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] [instance: 67a99a65-d2be-46ba-8132-b5d777f18ef6] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:16:34.614072 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:16:34.614746 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=36 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:16:34.621200 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c0f05402-2ed9-4dfc-b747-13e1e79876d9 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:16:34.621699 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c0f05402-2ed9-4dfc-b747-13e1e79876d9 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:16:34.622154 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c0f05402-2ed9-4dfc-b747-13e1e79876d9 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:16:34.623053 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c0f05402-2ed9-4dfc-b747-13e1e79876d9 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:16:34.623559 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c0f05402-2ed9-4dfc-b747-13e1e79876d9 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:16:34.624002 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c0f05402-2ed9-4dfc-b747-13e1e79876d9 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:16:34.647753 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.objects.instance [None req-c0f05402-2ed9-4dfc-b747-13e1e79876d9 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lazy-loading 'flavor' on Instance uuid 67a99a65-d2be-46ba-8132-b5d777f18ef6 {{(pid=122633) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 11 00:16:34.717185 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-c0f05402-2ed9-4dfc-b747-13e1e79876d9 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "POST /compute/v2.1/servers/67a99a65-d2be-46ba-8132-b5d777f18ef6/action" status: 202 len: 0 microversion: 2.1 time: 0.109993 Aug 11 00:16:34.717832 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3723/7238] 10.222.0.58 () {60 vars in 1278 bytes} [Thu Aug 11 00:16:34 2022] POST /compute/v2.1/servers/67a99a65-d2be-46ba-8132-b5d777f18ef6/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 11 00:16:34.726566 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-e2f9315b-6bd6-477f-aebd-895b23f69adf tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:16:34.727368 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-e2f9315b-6bd6-477f-aebd-895b23f69adf tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] [instance: 67a99a65-d2be-46ba-8132-b5d777f18ef6] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:16:34.730430 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_api:SELECT=2 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:16:34.731181 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=4 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:16:34.738617 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e2f9315b-6bd6-477f-aebd-895b23f69adf tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:16:34.739238 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e2f9315b-6bd6-477f-aebd-895b23f69adf tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:16:34.739744 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e2f9315b-6bd6-477f-aebd-895b23f69adf tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:16:34.740448 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e2f9315b-6bd6-477f-aebd-895b23f69adf tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:16:34.740919 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e2f9315b-6bd6-477f-aebd-895b23f69adf tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:16:34.741336 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e2f9315b-6bd6-477f-aebd-895b23f69adf tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:16:34.876074 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-e2f9315b-6bd6-477f-aebd-895b23f69adf tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98a27e99564f0ca672fbc06423d9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26799bad802a44c18dfee33c758cbb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:16:34.883610 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-e2f9315b-6bd6-477f-aebd-895b23f69adf tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "GET /compute/v2.1/servers/67a99a65-d2be-46ba-8132-b5d777f18ef6" status: 200 len: 1691 microversion: 2.1 time: 0.161285 Aug 11 00:16:34.884189 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3516/7239] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:16:34 2022] GET /compute/v2.1/servers/67a99a65-d2be-46ba-8132-b5d777f18ef6 => generated 1691 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:16:35.908234 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-b64e1a05-b754-4dda-9aa9-35d243540413 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:16:35.908941 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-b64e1a05-b754-4dda-9aa9-35d243540413 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] [instance: 67a99a65-d2be-46ba-8132-b5d777f18ef6] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:16:35.915433 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b64e1a05-b754-4dda-9aa9-35d243540413 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:16:35.915927 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b64e1a05-b754-4dda-9aa9-35d243540413 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:16:35.916377 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b64e1a05-b754-4dda-9aa9-35d243540413 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:16:35.917074 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b64e1a05-b754-4dda-9aa9-35d243540413 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:16:35.917537 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b64e1a05-b754-4dda-9aa9-35d243540413 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:16:35.917986 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-b64e1a05-b754-4dda-9aa9-35d243540413 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:16:36.053909 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-b64e1a05-b754-4dda-9aa9-35d243540413 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98a27e99564f0ca672fbc06423d9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26799bad802a44c18dfee33c758cbb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:16:36.061546 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-b64e1a05-b754-4dda-9aa9-35d243540413 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "GET /compute/v2.1/servers/67a99a65-d2be-46ba-8132-b5d777f18ef6" status: 200 len: 1674 microversion: 2.1 time: 0.158945 Aug 11 00:16:36.062124 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3724/7240] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:16:35 2022] GET /compute/v2.1/servers/67a99a65-d2be-46ba-8132-b5d777f18ef6 => generated 1674 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:16:37.159480 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-799c967a-31b5-44a0-b5c4-35dfeedf4574 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 00:16:37.161636 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-799c967a-31b5-44a0-b5c4-35dfeedf4574 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] [instance: 67a99a65-d2be-46ba-8132-b5d777f18ef6] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:16:37.172763 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-799c967a-31b5-44a0-b5c4-35dfeedf4574 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:16:37.173249 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-799c967a-31b5-44a0-b5c4-35dfeedf4574 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:16:37.173688 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-799c967a-31b5-44a0-b5c4-35dfeedf4574 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:16:37.174393 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-799c967a-31b5-44a0-b5c4-35dfeedf4574 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:16:37.174877 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-799c967a-31b5-44a0-b5c4-35dfeedf4574 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:16:37.175309 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-799c967a-31b5-44a0-b5c4-35dfeedf4574 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:16:37.236793 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-799c967a-31b5-44a0-b5c4-35dfeedf4574 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "POST /compute/v2.1/servers/67a99a65-d2be-46ba-8132-b5d777f18ef6/action" status: 200 len: 37112 microversion: 2.1 time: 0.081092 Aug 11 00:16:37.237486 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3517/7241] 10.222.0.58 () {60 vars in 1278 bytes} [Thu Aug 11 00:16:37 2022] POST /compute/v2.1/servers/67a99a65-d2be-46ba-8132-b5d777f18ef6/action => generated 37112 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 00:16:37.250188 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-5d61596a-487d-456a-9658-97a8ffd69299 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 00:16:37.250750 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-5d61596a-487d-456a-9658-97a8ffd69299 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] [instance: 67a99a65-d2be-46ba-8132-b5d777f18ef6] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:16:37.257617 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5d61596a-487d-456a-9658-97a8ffd69299 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:16:37.258121 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5d61596a-487d-456a-9658-97a8ffd69299 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:16:37.258576 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5d61596a-487d-456a-9658-97a8ffd69299 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:16:37.259320 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5d61596a-487d-456a-9658-97a8ffd69299 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:16:37.259888 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5d61596a-487d-456a-9658-97a8ffd69299 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:16:37.260362 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5d61596a-487d-456a-9658-97a8ffd69299 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:16:37.331779 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-5d61596a-487d-456a-9658-97a8ffd69299 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "POST /compute/v2.1/servers/67a99a65-d2be-46ba-8132-b5d777f18ef6/action" status: 202 len: 0 microversion: 2.1 time: 0.086146 Aug 11 00:16:37.335532 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3725/7242] 10.222.0.58 () {60 vars in 1278 bytes} [Thu Aug 11 00:16:37 2022] POST /compute/v2.1/servers/67a99a65-d2be-46ba-8132-b5d777f18ef6/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 11 00:16:37.341350 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-46564148-b610-4e5c-99ea-942cb205a4d1 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:16:37.342149 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-46564148-b610-4e5c-99ea-942cb205a4d1 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] [instance: 67a99a65-d2be-46ba-8132-b5d777f18ef6] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:16:37.349249 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-46564148-b610-4e5c-99ea-942cb205a4d1 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:16:37.349741 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-46564148-b610-4e5c-99ea-942cb205a4d1 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:16:37.350179 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-46564148-b610-4e5c-99ea-942cb205a4d1 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:16:37.350989 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-46564148-b610-4e5c-99ea-942cb205a4d1 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:16:37.351451 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-46564148-b610-4e5c-99ea-942cb205a4d1 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:16:37.351884 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-46564148-b610-4e5c-99ea-942cb205a4d1 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:16:37.574588 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-46564148-b610-4e5c-99ea-942cb205a4d1 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98a27e99564f0ca672fbc06423d9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26799bad802a44c18dfee33c758cbb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:16:37.582697 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-46564148-b610-4e5c-99ea-942cb205a4d1 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "GET /compute/v2.1/servers/67a99a65-d2be-46ba-8132-b5d777f18ef6" status: 200 len: 1680 microversion: 2.1 time: 0.245607 Aug 11 00:16:37.583326 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3518/7243] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:16:37 2022] GET /compute/v2.1/servers/67a99a65-d2be-46ba-8132-b5d777f18ef6 => generated 1680 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:16:38.607975 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-8be2f9f9-4b05-48b1-8aa9-dbda0898258c tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:16:38.608693 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-8be2f9f9-4b05-48b1-8aa9-dbda0898258c tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] [instance: 67a99a65-d2be-46ba-8132-b5d777f18ef6] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:16:38.614973 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8be2f9f9-4b05-48b1-8aa9-dbda0898258c tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:16:38.615467 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8be2f9f9-4b05-48b1-8aa9-dbda0898258c tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:16:38.615914 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8be2f9f9-4b05-48b1-8aa9-dbda0898258c tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:16:38.616611 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8be2f9f9-4b05-48b1-8aa9-dbda0898258c tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:16:38.617076 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8be2f9f9-4b05-48b1-8aa9-dbda0898258c tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:16:38.617509 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8be2f9f9-4b05-48b1-8aa9-dbda0898258c tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:16:38.754907 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-8be2f9f9-4b05-48b1-8aa9-dbda0898258c tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98a27e99564f0ca672fbc06423d9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26799bad802a44c18dfee33c758cbb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:16:38.764907 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-8be2f9f9-4b05-48b1-8aa9-dbda0898258c tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "GET /compute/v2.1/servers/67a99a65-d2be-46ba-8132-b5d777f18ef6" status: 200 len: 1680 microversion: 2.1 time: 0.162987 Aug 11 00:16:38.765582 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3726/7244] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:16:38 2022] GET /compute/v2.1/servers/67a99a65-d2be-46ba-8132-b5d777f18ef6 => generated 1680 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:16:39.786546 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-e4e0c4b1-51e3-4e61-9556-f31f80241e73 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:16:39.787156 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-e4e0c4b1-51e3-4e61-9556-f31f80241e73 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] [instance: 67a99a65-d2be-46ba-8132-b5d777f18ef6] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:16:39.794005 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e4e0c4b1-51e3-4e61-9556-f31f80241e73 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:16:39.794627 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e4e0c4b1-51e3-4e61-9556-f31f80241e73 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:16:39.795262 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e4e0c4b1-51e3-4e61-9556-f31f80241e73 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:16:39.795976 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e4e0c4b1-51e3-4e61-9556-f31f80241e73 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:16:39.796442 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e4e0c4b1-51e3-4e61-9556-f31f80241e73 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:16:39.796881 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e4e0c4b1-51e3-4e61-9556-f31f80241e73 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:16:39.941522 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-e4e0c4b1-51e3-4e61-9556-f31f80241e73 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98a27e99564f0ca672fbc06423d9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26799bad802a44c18dfee33c758cbb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:16:39.949048 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-e4e0c4b1-51e3-4e61-9556-f31f80241e73 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "GET /compute/v2.1/servers/67a99a65-d2be-46ba-8132-b5d777f18ef6" status: 200 len: 1683 microversion: 2.1 time: 0.166469 Aug 11 00:16:39.949620 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3519/7245] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:16:39 2022] GET /compute/v2.1/servers/67a99a65-d2be-46ba-8132-b5d777f18ef6 => generated 1683 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:16:40.065126 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-90ec2ba7-a5db-4f54-af43-d6091848169a tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 00:16:40.069545 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-90ec2ba7-a5db-4f54-af43-d6091848169a tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] [instance: 67a99a65-d2be-46ba-8132-b5d777f18ef6] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:16:40.076840 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-90ec2ba7-a5db-4f54-af43-d6091848169a tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:16:40.077356 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-90ec2ba7-a5db-4f54-af43-d6091848169a tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:16:40.077805 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-90ec2ba7-a5db-4f54-af43-d6091848169a tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:16:40.078541 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-90ec2ba7-a5db-4f54-af43-d6091848169a tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:16:40.079046 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-90ec2ba7-a5db-4f54-af43-d6091848169a tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:16:40.079479 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-90ec2ba7-a5db-4f54-af43-d6091848169a tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:16:40.121804 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-90ec2ba7-a5db-4f54-af43-d6091848169a tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "POST /compute/v2.1/servers/67a99a65-d2be-46ba-8132-b5d777f18ef6/action" status: 200 len: 37112 microversion: 2.1 time: 0.064533 Aug 11 00:16:40.123108 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3727/7246] 10.222.0.58 () {60 vars in 1278 bytes} [Thu Aug 11 00:16:40 2022] POST /compute/v2.1/servers/67a99a65-d2be-46ba-8132-b5d777f18ef6/action => generated 37112 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 11 00:16:41.172904 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-52e9929e-f9ea-4893-b6bf-1309c48c842c tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:16:41.173410 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-52e9929e-f9ea-4893-b6bf-1309c48c842c tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] [instance: 67a99a65-d2be-46ba-8132-b5d777f18ef6] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:16:41.175893 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-93b2b2dd-7931-4797-8d67-1f851bd79dd7 req-2e06806b-4dd1-437a-a69b-55f334084e96 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67a99a65-d2be-46ba-8132-b5d777f18ef6", "tag": "d758cbb4-b10e-4561-87d7-1d8e4fe4bd7f"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 00:16:41.180368 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-52e9929e-f9ea-4893-b6bf-1309c48c842c tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:16:41.180857 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-52e9929e-f9ea-4893-b6bf-1309c48c842c tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:16:41.181299 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-52e9929e-f9ea-4893-b6bf-1309c48c842c tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:16:41.182006 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-52e9929e-f9ea-4893-b6bf-1309c48c842c tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:16:41.182463 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-52e9929e-f9ea-4893-b6bf-1309c48c842c tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:16:41.182986 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-52e9929e-f9ea-4893-b6bf-1309c48c842c tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:16:41.187653 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-93b2b2dd-7931-4797-8d67-1f851bd79dd7 req-2e06806b-4dd1-437a-a69b-55f334084e96 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:16:41.188150 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-93b2b2dd-7931-4797-8d67-1f851bd79dd7 req-2e06806b-4dd1-437a-a69b-55f334084e96 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:16:41.188595 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-93b2b2dd-7931-4797-8d67-1f851bd79dd7 req-2e06806b-4dd1-437a-a69b-55f334084e96 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:16:41.199957 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-93b2b2dd-7931-4797-8d67-1f851bd79dd7 req-2e06806b-4dd1-437a-a69b-55f334084e96 service nova] Creating event network-changed:d758cbb4-b10e-4561-87d7-1d8e4fe4bd7f for instance 67a99a65-d2be-46ba-8132-b5d777f18ef6 on n-h2-850468-14 Aug 11 00:16:41.205916 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-93b2b2dd-7931-4797-8d67-1f851bd79dd7 req-2e06806b-4dd1-437a-a69b-55f334084e96 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033933 Aug 11 00:16:41.206534 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3728/7247] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 11 00:16:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 11 00:16:41.214172 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-52e9929e-f9ea-4893-b6bf-1309c48c842c tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] [instance: 67a99a65-d2be-46ba-8132-b5d777f18ef6] Going to try to terminate instance {{(pid=122632) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 11 00:16:41.299973 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-52e9929e-f9ea-4893-b6bf-1309c48c842c tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "DELETE /compute/v2.1/servers/67a99a65-d2be-46ba-8132-b5d777f18ef6" status: 204 len: 0 microversion: 2.1 time: 0.130620 Aug 11 00:16:41.300927 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3520/7248] 10.222.0.58 () {58 vars in 1239 bytes} [Thu Aug 11 00:16:41 2022] DELETE /compute/v2.1/servers/67a99a65-d2be-46ba-8132-b5d777f18ef6 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 11 00:16:41.311990 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-002d90e3-2311-4111-9ad6-6d82a3dd3c18 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:16:41.313344 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-002d90e3-2311-4111-9ad6-6d82a3dd3c18 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] [instance: 67a99a65-d2be-46ba-8132-b5d777f18ef6] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:16:41.320761 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-002d90e3-2311-4111-9ad6-6d82a3dd3c18 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:16:41.321264 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-002d90e3-2311-4111-9ad6-6d82a3dd3c18 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:16:41.321956 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-002d90e3-2311-4111-9ad6-6d82a3dd3c18 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:16:41.322838 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-002d90e3-2311-4111-9ad6-6d82a3dd3c18 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:16:41.323487 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-002d90e3-2311-4111-9ad6-6d82a3dd3c18 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:16:41.324102 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-002d90e3-2311-4111-9ad6-6d82a3dd3c18 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:16:41.471051 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-002d90e3-2311-4111-9ad6-6d82a3dd3c18 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98a27e99564f0ca672fbc06423d9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26799bad802a44c18dfee33c758cbb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:16:41.478698 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-002d90e3-2311-4111-9ad6-6d82a3dd3c18 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "GET /compute/v2.1/servers/67a99a65-d2be-46ba-8132-b5d777f18ef6" status: 200 len: 1689 microversion: 2.1 time: 0.172254 Aug 11 00:16:41.479315 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3729/7249] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:16:41 2022] GET /compute/v2.1/servers/67a99a65-d2be-46ba-8132-b5d777f18ef6 => generated 1689 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:16:42.501399 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-75fb0f08-8a18-4335-a927-df3ebc5326f5 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:16:42.502056 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-75fb0f08-8a18-4335-a927-df3ebc5326f5 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] [instance: 67a99a65-d2be-46ba-8132-b5d777f18ef6] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:16:42.508676 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-75fb0f08-8a18-4335-a927-df3ebc5326f5 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:16:42.509168 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-75fb0f08-8a18-4335-a927-df3ebc5326f5 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:16:42.509610 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-75fb0f08-8a18-4335-a927-df3ebc5326f5 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:16:42.510308 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-75fb0f08-8a18-4335-a927-df3ebc5326f5 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:16:42.510797 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-75fb0f08-8a18-4335-a927-df3ebc5326f5 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:16:42.511220 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-75fb0f08-8a18-4335-a927-df3ebc5326f5 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:16:42.648087 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-75fb0f08-8a18-4335-a927-df3ebc5326f5 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98a27e99564f0ca672fbc06423d9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26799bad802a44c18dfee33c758cbb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:16:42.656397 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-75fb0f08-8a18-4335-a927-df3ebc5326f5 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "GET /compute/v2.1/servers/67a99a65-d2be-46ba-8132-b5d777f18ef6" status: 200 len: 1689 microversion: 2.1 time: 0.159348 Aug 11 00:16:42.656978 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3521/7250] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:16:42 2022] GET /compute/v2.1/servers/67a99a65-d2be-46ba-8132-b5d777f18ef6 => generated 1689 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:16:43.561176 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-4fdcca74-3fcf-4e9a-8a15-d860363cfa9c req-8cf109c9-c30a-44b6-ba1e-fbe6011a7b33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67a99a65-d2be-46ba-8132-b5d777f18ef6", "name": "network-vif-deleted", "tag": "d758cbb4-b10e-4561-87d7-1d8e4fe4bd7f"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 00:16:43.573709 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-4fdcca74-3fcf-4e9a-8a15-d860363cfa9c req-8cf109c9-c30a-44b6-ba1e-fbe6011a7b33 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:16:43.574204 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-4fdcca74-3fcf-4e9a-8a15-d860363cfa9c req-8cf109c9-c30a-44b6-ba1e-fbe6011a7b33 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:16:43.574649 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-4fdcca74-3fcf-4e9a-8a15-d860363cfa9c req-8cf109c9-c30a-44b6-ba1e-fbe6011a7b33 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:16:43.586366 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-4fdcca74-3fcf-4e9a-8a15-d860363cfa9c req-8cf109c9-c30a-44b6-ba1e-fbe6011a7b33 service nova] Creating event network-vif-deleted:d758cbb4-b10e-4561-87d7-1d8e4fe4bd7f for instance 67a99a65-d2be-46ba-8132-b5d777f18ef6 on n-h2-850468-14 Aug 11 00:16:43.591979 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-4fdcca74-3fcf-4e9a-8a15-d860363cfa9c req-8cf109c9-c30a-44b6-ba1e-fbe6011a7b33 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034472 Aug 11 00:16:43.592592 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3730/7251] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 11 00:16:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 00:16:43.678491 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-6e6aa869-1be5-41c0-853b-25b0368f1261 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:16:43.679235 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-6e6aa869-1be5-41c0-853b-25b0368f1261 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] [instance: 67a99a65-d2be-46ba-8132-b5d777f18ef6] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:16:43.686888 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6e6aa869-1be5-41c0-853b-25b0368f1261 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:16:43.687384 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6e6aa869-1be5-41c0-853b-25b0368f1261 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:16:43.687824 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6e6aa869-1be5-41c0-853b-25b0368f1261 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:16:43.688533 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6e6aa869-1be5-41c0-853b-25b0368f1261 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:16:43.688985 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6e6aa869-1be5-41c0-853b-25b0368f1261 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:16:43.689408 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6e6aa869-1be5-41c0-853b-25b0368f1261 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:16:43.726033 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6e6aa869-1be5-41c0-853b-25b0368f1261 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:16:43.726439 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6e6aa869-1be5-41c0-853b-25b0368f1261 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:16:43.726906 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6e6aa869-1be5-41c0-853b-25b0368f1261 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:16:43.727362 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.objects.instance [None req-6e6aa869-1be5-41c0-853b-25b0368f1261 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lazy-loading 'fault' on Instance uuid 67a99a65-d2be-46ba-8132-b5d777f18ef6 {{(pid=122632) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 11 00:16:43.772384 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-6e6aa869-1be5-41c0-853b-25b0368f1261 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8e98a27e99564f0ca672fbc06423d9ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26799bad802a44c18dfee33c758cbb60', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:16:43.780508 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-6e6aa869-1be5-41c0-853b-25b0368f1261 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "GET /compute/v2.1/servers/67a99a65-d2be-46ba-8132-b5d777f18ef6" status: 200 len: 1357 microversion: 2.1 time: 0.106336 Aug 11 00:16:43.781087 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3522/7252] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:16:43 2022] GET /compute/v2.1/servers/67a99a65-d2be-46ba-8132-b5d777f18ef6 => generated 1357 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:16:44.804783 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-733f088b-2318-4723-875e-c58791f3a095 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:16:44.805502 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-733f088b-2318-4723-875e-c58791f3a095 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] [instance: 67a99a65-d2be-46ba-8132-b5d777f18ef6] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:16:44.811909 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-733f088b-2318-4723-875e-c58791f3a095 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:16:44.812418 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-733f088b-2318-4723-875e-c58791f3a095 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:16:44.812869 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-733f088b-2318-4723-875e-c58791f3a095 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:16:44.813587 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-733f088b-2318-4723-875e-c58791f3a095 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:16:44.814059 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-733f088b-2318-4723-875e-c58791f3a095 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:16:44.814505 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-733f088b-2318-4723-875e-c58791f3a095 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:16:44.828311 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-733f088b-2318-4723-875e-c58791f3a095 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] HTTP exception thrown: Instance 67a99a65-d2be-46ba-8132-b5d777f18ef6 could not be found. Aug 11 00:16:44.829938 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-733f088b-2318-4723-875e-c58791f3a095 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Request method failure captured: Aug 11 00:16:44.829938 n-d-850468-14 devstack@n-api.service[122633]: request: GET /compute/v2.1/servers/67a99a65-d2be-46ba-8132-b5d777f18ef6 HTTP/1.1 Aug 11 00:16:44.829938 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 11 00:16:44.829938 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 11 00:16:44.829938 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 11 00:16:44.829938 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 11 00:16:44.829938 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 11 00:16:44.829938 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 11 00:16:44.829938 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 11 00:16:44.829938 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 11 00:16:44.829938 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9Eicgn9rrdRuvAzeJtJZ7G3bC_nDgFR3SCpmMvM-oSUDIishF0KIrgIe24vn-zIDWQFTlnHZqZzmBW04xZWO5xjxS0bhWpiqJFEiDbQjnCF5CEqW_Qy1Z8Dx6EdfjYFAs6IHw9dtZURRdVWG0taseoTltbZtc3U4Z0kNtdabyg0lDPw Aug 11 00:16:44.829938 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 11 00:16:44.829938 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 11 00:16:44.829938 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 11 00:16:44.829938 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 11 00:16:44.829938 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 11 00:16:44.829938 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 11 00:16:44.829938 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 26799bad802a44c18dfee33c758cbb60 Aug 11 00:16:44.829938 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-458446174 Aug 11 00:16:44.829938 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 11 00:16:44.829938 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 11 00:16:44.829938 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/26799bad802a44c18dfee33c758cbb60"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/26799bad802a44c18dfee33c758cbb60"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/26799bad802a44c18dfee33c758cbb60"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_26799bad802a44c18dfee33c758cbb60", "adminURL": "http://10.222.0.58:8080"}]}] Aug 11 00:16:44.829938 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-TestNetworkAdvancedServerOps-458446174 Aug 11 00:16:44.829938 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 26799bad802a44c18dfee33c758cbb60 Aug 11 00:16:44.829938 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-458446174 Aug 11 00:16:44.829938 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-TestNetworkAdvancedServerOps-458446174-project Aug 11 00:16:44.829938 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 11 00:16:44.829938 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 11 00:16:44.829938 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 8e98a27e99564f0ca672fbc06423d9ea Aug 11 00:16:44.829938 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-TestNetworkAdvancedServerOps-458446174-project Aug 11 00:16:44.829938 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 11 00:16:44.829938 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance 67a99a65-d2be-46ba-8132-b5d777f18ef6 could not be found. Aug 11 00:16:44.829938 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': '67a99a65-d2be-46ba-8132-b5d777f18ef6'} Aug 11 00:16:44.829938 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 00:16:44.829938 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 00:16:44.829938 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 11 00:16:44.829938 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 11 00:16:44.829938 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 11 00:16:44.829938 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 11 00:16:44.829938 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 11 00:16:44.829938 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 11 00:16:44.829938 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 11 00:16:44.829938 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 11 00:16:44.829938 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67a99a65-d2be-46ba-8132-b5d777f18ef6 could not be found. Aug 11 00:16:44.829938 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 11 00:16:44.829938 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 00:16:44.829938 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 11 00:16:44.829938 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 00:16:44.829938 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 00:16:44.829938 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 00:16:44.829938 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 00:16:44.829938 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 00:16:44.829938 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 00:16:44.829938 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 00:16:44.829938 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 11 00:16:44.829938 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 11 00:16:44.829938 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 11 00:16:44.829938 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 11 00:16:44.829938 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 11 00:16:44.829938 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 11 00:16:44.829938 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67a99a65-d2be-46ba-8132-b5d777f18ef6 could not be found. Aug 11 00:16:44.829938 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 11 00:16:44.829938 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 00:16:44.834239 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 11 00:16:44.834239 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 00:16:44.834239 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 00:16:44.834239 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 00:16:44.834239 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 00:16:44.834239 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 00:16:44.834239 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67a99a65-d2be-46ba-8132-b5d777f18ef6 could not be found. Aug 11 00:16:44.834239 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 11 00:16:44.834239 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-733f088b-2318-4723-875e-c58791f3a095 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Returning 404 to user: Instance 67a99a65-d2be-46ba-8132-b5d777f18ef6 could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 00:16:44.834239 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-733f088b-2318-4723-875e-c58791f3a095 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "GET /compute/v2.1/servers/67a99a65-d2be-46ba-8132-b5d777f18ef6" status: 404 len: 111 microversion: 2.1 time: 0.031948 Aug 11 00:16:44.834239 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3731/7253] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:16:44 2022] GET /compute/v2.1/servers/67a99a65-d2be-46ba-8132-b5d777f18ef6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 11 00:16:47.863894 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-6e2666aa-73d0-4e7c-9a94-71f20d89bad8 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] Calling method '.version_select at 0x7f847c5b0550>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:16:47.886262 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-6e2666aa-73d0-4e7c-9a94-71f20d89bad8 tempest-TestNetworkAdvancedServerOps-458446174 tempest-TestNetworkAdvancedServerOps-458446174-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1672970326" status: 202 len: 0 microversion: 2.1 time: 0.026216 Aug 11 00:16:47.887210 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3523/7254] 10.222.0.58 () {58 vars in 1284 bytes} [Thu Aug 11 00:16:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1672970326 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 11 00:16:59.357040 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_api:SELECT=18 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:16:59.358189 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:16:59.567582 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-728864a6-684a-4e78-8d13-6e8efa069c59 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Action: 'create', calling method: .version_select at 0x7f846c6daca0>, body: {"keypair": {"name": "tempest-TestShelveInstance-832978363", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEnlFMQtunrfcKwpRIGHO2F6Esq1QCrR3fCjrIcyicZ/bkGflMTFrU2iDemwg2bJY/0g2Aw0aZHB0wHVwdKAKzjAcbphcpMD+wfAfhc5d17h0TVFLF8dq7ehXilO+DlBHA=="}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 00:16:59.601378 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-728864a6-684a-4e78-8d13-6e8efa069c59 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Getting quotas for project 7afd506533304073a9f9d246eb7a4434. Resources: {'key_pairs'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 11 00:16:59.608077 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-728864a6-684a-4e78-8d13-6e8efa069c59 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Getting quotas for user 1a07aed22e5242308216005a51ee6e8b and project 7afd506533304073a9f9d246eb7a4434. Resources: {'key_pairs'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 11 00:16:59.639071 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-728864a6-684a-4e78-8d13-6e8efa069c59 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.287705 Aug 11 00:16:59.639679 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3732/7255] 10.222.0.58 () {60 vars in 1159 bytes} [Thu Aug 11 00:16:59 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 00:17:00.728686 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:17:00.729809 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:17:00.734221 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-7e0187ac-7bba-4678-b343-8a5b7cfa2e80 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-935471734", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-832978363", "security_groups": [{"name": "tempest-secgroup-smoke-978903676"}], "networks": [{"uuid": "0b47858f-ce64-4d13-b7ee-dd5e4a737f34"}]}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 00:17:00.854661 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.network.neutron [None req-7e0187ac-7bba-4678-b343-8a5b7cfa2e80 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] validate_networks() for [('0b47858f-ce64-4d13-b7ee-dd5e4a737f34', None, None, None, None, None)] {{(pid=122632) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 11 00:17:01.240619 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-7e0187ac-7bba-4678-b343-8a5b7cfa2e80 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Flavor limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 11 00:17:01.241041 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-7e0187ac-7bba-4678-b343-8a5b7cfa2e80 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Image limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 11 00:17:01.241633 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-7e0187ac-7bba-4678-b343-8a5b7cfa2e80 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Flavor pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 11 00:17:01.242070 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-7e0187ac-7bba-4678-b343-8a5b7cfa2e80 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Image pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 11 00:17:01.242602 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-7e0187ac-7bba-4678-b343-8a5b7cfa2e80 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 11 00:17:01.252043 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7e0187ac-7bba-4678-b343-8a5b7cfa2e80 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:17:01.252543 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7e0187ac-7bba-4678-b343-8a5b7cfa2e80 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:17:01.252972 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7e0187ac-7bba-4678-b343-8a5b7cfa2e80 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:17:01.253685 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7e0187ac-7bba-4678-b343-8a5b7cfa2e80 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:17:01.254130 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7e0187ac-7bba-4678-b343-8a5b7cfa2e80 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:17:01.254552 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7e0187ac-7bba-4678-b343-8a5b7cfa2e80 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:17:01.272283 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-7e0187ac-7bba-4678-b343-8a5b7cfa2e80 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Getting quotas for project 7afd506533304073a9f9d246eb7a4434. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 11 00:17:01.277409 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-7e0187ac-7bba-4678-b343-8a5b7cfa2e80 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Getting quotas for user 1a07aed22e5242308216005a51ee6e8b and project 7afd506533304073a9f9d246eb7a4434. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 11 00:17:01.291013 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-7e0187ac-7bba-4678-b343-8a5b7cfa2e80 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Going to run 1 instances... {{(pid=122632) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 11 00:17:01.293197 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-7e0187ac-7bba-4678-b343-8a5b7cfa2e80 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] [instance: 5a8c0a8d-c872-4696-a060-3b5d2b6fe460] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78ad8905-f66f-4733-8be9-2b260f1fabed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122632) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 11 00:17:01.339809 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-7e0187ac-7bba-4678-b343-8a5b7cfa2e80 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.613102 Aug 11 00:17:01.340787 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3524/7256] 10.222.0.58 () {60 vars in 1147 bytes} [Thu Aug 11 00:17:00 2022] POST /compute/v2.1/servers => generated 405 bytes in 615 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 11 00:17:01.352779 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-04b9f830-4c97-4fc1-9d17-e0bebf2d78c1 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:17:01.353407 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-04b9f830-4c97-4fc1-9d17-e0bebf2d78c1 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] [instance: 5a8c0a8d-c872-4696-a060-3b5d2b6fe460] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:17:01.421108 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-04b9f830-4c97-4fc1-9d17-e0bebf2d78c1 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a07aed22e5242308216005a51ee6e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afd506533304073a9f9d246eb7a4434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:17:01.429195 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-04b9f830-4c97-4fc1-9d17-e0bebf2d78c1 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] 10.222.0.58 "GET /compute/v2.1/servers/5a8c0a8d-c872-4696-a060-3b5d2b6fe460" status: 200 len: 1245 microversion: 2.1 time: 0.081111 Aug 11 00:17:01.429913 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3733/7257] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:17:01 2022] GET /compute/v2.1/servers/5a8c0a8d-c872-4696-a060-3b5d2b6fe460 => generated 1245 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:17:02.452138 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-4d28649f-a322-4fec-931b-e576196b087c tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:17:02.453536 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-4d28649f-a322-4fec-931b-e576196b087c tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] [instance: 5a8c0a8d-c872-4696-a060-3b5d2b6fe460] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:17:02.463240 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4d28649f-a322-4fec-931b-e576196b087c tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:17:02.468063 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4d28649f-a322-4fec-931b-e576196b087c tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:17:02.469935 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4d28649f-a322-4fec-931b-e576196b087c tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:17:02.470916 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4d28649f-a322-4fec-931b-e576196b087c tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:17:02.474902 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4d28649f-a322-4fec-931b-e576196b087c tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:17:02.475558 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4d28649f-a322-4fec-931b-e576196b087c tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:17:02.935505 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-4d28649f-a322-4fec-931b-e576196b087c tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a07aed22e5242308216005a51ee6e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afd506533304073a9f9d246eb7a4434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:17:02.943858 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-4d28649f-a322-4fec-931b-e576196b087c tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] 10.222.0.58 "GET /compute/v2.1/servers/5a8c0a8d-c872-4696-a060-3b5d2b6fe460" status: 200 len: 1305 microversion: 2.1 time: 0.497491 Aug 11 00:17:02.944626 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3525/7258] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:17:02 2022] GET /compute/v2.1/servers/5a8c0a8d-c872-4696-a060-3b5d2b6fe460 => generated 1305 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:17:03.966411 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-5570f57c-6b9a-45c3-ae21-7d4fec2b7034 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:17:03.968326 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-5570f57c-6b9a-45c3-ae21-7d4fec2b7034 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] [instance: 5a8c0a8d-c872-4696-a060-3b5d2b6fe460] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:17:03.975711 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5570f57c-6b9a-45c3-ae21-7d4fec2b7034 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:17:03.976315 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5570f57c-6b9a-45c3-ae21-7d4fec2b7034 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:17:03.976866 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5570f57c-6b9a-45c3-ae21-7d4fec2b7034 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:17:03.977702 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5570f57c-6b9a-45c3-ae21-7d4fec2b7034 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:17:03.978293 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5570f57c-6b9a-45c3-ae21-7d4fec2b7034 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:17:03.978827 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5570f57c-6b9a-45c3-ae21-7d4fec2b7034 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:17:04.133959 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-5570f57c-6b9a-45c3-ae21-7d4fec2b7034 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a07aed22e5242308216005a51ee6e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afd506533304073a9f9d246eb7a4434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:17:04.143070 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-5570f57c-6b9a-45c3-ae21-7d4fec2b7034 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] 10.222.0.58 "GET /compute/v2.1/servers/5a8c0a8d-c872-4696-a060-3b5d2b6fe460" status: 200 len: 1370 microversion: 2.1 time: 0.181304 Aug 11 00:17:04.143671 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3734/7259] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:17:03 2022] GET /compute/v2.1/servers/5a8c0a8d-c872-4696-a060-3b5d2b6fe460 => generated 1370 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:17:04.310677 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-566d8f74-557b-45d2-8cbf-f0a8ae125ec3 req-2d28760a-cf36-4388-845f-d6570279006b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a8c0a8d-c872-4696-a060-3b5d2b6fe460", "tag": "545bd480-5089-42ab-a9d8-8cf924136c0a"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 00:17:04.326179 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-566d8f74-557b-45d2-8cbf-f0a8ae125ec3 req-2d28760a-cf36-4388-845f-d6570279006b service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:17:04.327026 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-566d8f74-557b-45d2-8cbf-f0a8ae125ec3 req-2d28760a-cf36-4388-845f-d6570279006b service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:17:04.327380 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-566d8f74-557b-45d2-8cbf-f0a8ae125ec3 req-2d28760a-cf36-4388-845f-d6570279006b service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:17:04.350354 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-566d8f74-557b-45d2-8cbf-f0a8ae125ec3 req-2d28760a-cf36-4388-845f-d6570279006b service nova] Creating event network-changed:545bd480-5089-42ab-a9d8-8cf924136c0a for instance 5a8c0a8d-c872-4696-a060-3b5d2b6fe460 on n-h1-850468-14 Aug 11 00:17:04.357784 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-566d8f74-557b-45d2-8cbf-f0a8ae125ec3 req-2d28760a-cf36-4388-845f-d6570279006b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.136618 Aug 11 00:17:04.358656 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3526/7260] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 11 00:17:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 00:17:05.165163 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-53819d8f-a834-4a4d-a874-4d1bbaddeec9 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:17:05.165812 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-53819d8f-a834-4a4d-a874-4d1bbaddeec9 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] [instance: 5a8c0a8d-c872-4696-a060-3b5d2b6fe460] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:17:05.173708 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-53819d8f-a834-4a4d-a874-4d1bbaddeec9 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:17:05.174206 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-53819d8f-a834-4a4d-a874-4d1bbaddeec9 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:17:05.174657 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-53819d8f-a834-4a4d-a874-4d1bbaddeec9 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:17:05.175393 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-53819d8f-a834-4a4d-a874-4d1bbaddeec9 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:17:05.175859 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-53819d8f-a834-4a4d-a874-4d1bbaddeec9 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:17:05.176300 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-53819d8f-a834-4a4d-a874-4d1bbaddeec9 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:17:05.308386 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-53819d8f-a834-4a4d-a874-4d1bbaddeec9 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a07aed22e5242308216005a51ee6e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afd506533304073a9f9d246eb7a4434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:17:05.316040 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-53819d8f-a834-4a4d-a874-4d1bbaddeec9 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] 10.222.0.58 "GET /compute/v2.1/servers/5a8c0a8d-c872-4696-a060-3b5d2b6fe460" status: 200 len: 1370 microversion: 2.1 time: 0.154868 Aug 11 00:17:05.316622 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3735/7261] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:17:05 2022] GET /compute/v2.1/servers/5a8c0a8d-c872-4696-a060-3b5d2b6fe460 => generated 1370 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:17:06.338687 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-5648fb86-1dae-4e83-8bed-bd4fe062c4a4 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:17:06.339565 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-5648fb86-1dae-4e83-8bed-bd4fe062c4a4 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] [instance: 5a8c0a8d-c872-4696-a060-3b5d2b6fe460] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:17:06.346015 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5648fb86-1dae-4e83-8bed-bd4fe062c4a4 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:17:06.350362 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5648fb86-1dae-4e83-8bed-bd4fe062c4a4 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:17:06.351048 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5648fb86-1dae-4e83-8bed-bd4fe062c4a4 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:17:06.351788 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5648fb86-1dae-4e83-8bed-bd4fe062c4a4 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:17:06.352255 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5648fb86-1dae-4e83-8bed-bd4fe062c4a4 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:17:06.352687 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5648fb86-1dae-4e83-8bed-bd4fe062c4a4 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:17:06.493302 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-5648fb86-1dae-4e83-8bed-bd4fe062c4a4 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a07aed22e5242308216005a51ee6e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afd506533304073a9f9d246eb7a4434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:17:06.502064 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-5648fb86-1dae-4e83-8bed-bd4fe062c4a4 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] 10.222.0.58 "GET /compute/v2.1/servers/5a8c0a8d-c872-4696-a060-3b5d2b6fe460" status: 200 len: 1370 microversion: 2.1 time: 0.168749 Aug 11 00:17:06.502649 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3527/7262] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:17:06 2022] GET /compute/v2.1/servers/5a8c0a8d-c872-4696-a060-3b5d2b6fe460 => generated 1370 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:17:07.522891 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-07680d6e-2414-4782-bdb1-432aa9cf7b35 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:17:07.523956 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-07680d6e-2414-4782-bdb1-432aa9cf7b35 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] [instance: 5a8c0a8d-c872-4696-a060-3b5d2b6fe460] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:17:07.531007 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-07680d6e-2414-4782-bdb1-432aa9cf7b35 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:17:07.531520 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-07680d6e-2414-4782-bdb1-432aa9cf7b35 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:17:07.531973 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-07680d6e-2414-4782-bdb1-432aa9cf7b35 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:17:07.532703 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-07680d6e-2414-4782-bdb1-432aa9cf7b35 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:17:07.533176 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-07680d6e-2414-4782-bdb1-432aa9cf7b35 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:17:07.533619 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-07680d6e-2414-4782-bdb1-432aa9cf7b35 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:17:07.683566 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-07680d6e-2414-4782-bdb1-432aa9cf7b35 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a07aed22e5242308216005a51ee6e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afd506533304073a9f9d246eb7a4434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:17:07.691754 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-07680d6e-2414-4782-bdb1-432aa9cf7b35 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] 10.222.0.58 "GET /compute/v2.1/servers/5a8c0a8d-c872-4696-a060-3b5d2b6fe460" status: 200 len: 1370 microversion: 2.1 time: 0.172873 Aug 11 00:17:07.692675 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3736/7263] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:17:07 2022] GET /compute/v2.1/servers/5a8c0a8d-c872-4696-a060-3b5d2b6fe460 => generated 1370 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:17:08.713551 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-55845101-9a65-4fbf-85ca-de19f0dc76f5 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:17:08.714103 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-55845101-9a65-4fbf-85ca-de19f0dc76f5 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] [instance: 5a8c0a8d-c872-4696-a060-3b5d2b6fe460] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:17:08.722070 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-55845101-9a65-4fbf-85ca-de19f0dc76f5 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:17:08.722660 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-55845101-9a65-4fbf-85ca-de19f0dc76f5 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:17:08.723126 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-55845101-9a65-4fbf-85ca-de19f0dc76f5 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:17:08.723815 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-55845101-9a65-4fbf-85ca-de19f0dc76f5 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:17:08.724265 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-55845101-9a65-4fbf-85ca-de19f0dc76f5 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:17:08.724686 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-55845101-9a65-4fbf-85ca-de19f0dc76f5 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:17:08.858589 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-55845101-9a65-4fbf-85ca-de19f0dc76f5 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a07aed22e5242308216005a51ee6e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afd506533304073a9f9d246eb7a4434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:17:08.866122 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-55845101-9a65-4fbf-85ca-de19f0dc76f5 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] 10.222.0.58 "GET /compute/v2.1/servers/5a8c0a8d-c872-4696-a060-3b5d2b6fe460" status: 200 len: 1370 microversion: 2.1 time: 0.156559 Aug 11 00:17:08.866704 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3528/7264] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:17:08 2022] GET /compute/v2.1/servers/5a8c0a8d-c872-4696-a060-3b5d2b6fe460 => generated 1370 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:17:09.299460 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-626d179e-86ac-4775-8775-ce221f749353 req-a6ba69cd-8f72-4b29-8aa6-f0ad1b031780 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a8c0a8d-c872-4696-a060-3b5d2b6fe460", "name": "network-vif-plugged", "status": "completed", "tag": "545bd480-5089-42ab-a9d8-8cf924136c0a"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 00:17:09.308916 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-626d179e-86ac-4775-8775-ce221f749353 req-a6ba69cd-8f72-4b29-8aa6-f0ad1b031780 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:17:09.309536 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-626d179e-86ac-4775-8775-ce221f749353 req-a6ba69cd-8f72-4b29-8aa6-f0ad1b031780 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:17:09.310522 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-626d179e-86ac-4775-8775-ce221f749353 req-a6ba69cd-8f72-4b29-8aa6-f0ad1b031780 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:17:09.321734 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-626d179e-86ac-4775-8775-ce221f749353 req-a6ba69cd-8f72-4b29-8aa6-f0ad1b031780 service nova] Creating event network-vif-plugged:545bd480-5089-42ab-a9d8-8cf924136c0a for instance 5a8c0a8d-c872-4696-a060-3b5d2b6fe460 on n-h1-850468-14 Aug 11 00:17:09.326914 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-626d179e-86ac-4775-8775-ce221f749353 req-a6ba69cd-8f72-4b29-8aa6-f0ad1b031780 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106490 Aug 11 00:17:09.327509 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3737/7265] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 11 00:17:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 00:17:09.887710 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-45892b4c-a0a4-428f-ad31-fb6ce3b0cda8 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:17:09.888320 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-45892b4c-a0a4-428f-ad31-fb6ce3b0cda8 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] [instance: 5a8c0a8d-c872-4696-a060-3b5d2b6fe460] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:17:09.895120 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-45892b4c-a0a4-428f-ad31-fb6ce3b0cda8 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:17:09.895599 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-45892b4c-a0a4-428f-ad31-fb6ce3b0cda8 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:17:09.896027 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-45892b4c-a0a4-428f-ad31-fb6ce3b0cda8 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:17:09.896705 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-45892b4c-a0a4-428f-ad31-fb6ce3b0cda8 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:17:09.897155 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-45892b4c-a0a4-428f-ad31-fb6ce3b0cda8 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:17:09.897572 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-45892b4c-a0a4-428f-ad31-fb6ce3b0cda8 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:17:10.032575 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-45892b4c-a0a4-428f-ad31-fb6ce3b0cda8 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a07aed22e5242308216005a51ee6e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afd506533304073a9f9d246eb7a4434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:17:10.040070 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-45892b4c-a0a4-428f-ad31-fb6ce3b0cda8 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] 10.222.0.58 "GET /compute/v2.1/servers/5a8c0a8d-c872-4696-a060-3b5d2b6fe460" status: 200 len: 1370 microversion: 2.1 time: 0.156641 Aug 11 00:17:10.040642 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3529/7266] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:17:09 2022] GET /compute/v2.1/servers/5a8c0a8d-c872-4696-a060-3b5d2b6fe460 => generated 1370 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:17:11.063507 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-eb8ca09c-d267-4625-89ab-e105f373e38f tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:17:11.064219 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-eb8ca09c-d267-4625-89ab-e105f373e38f tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] [instance: 5a8c0a8d-c872-4696-a060-3b5d2b6fe460] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:17:11.070409 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-eb8ca09c-d267-4625-89ab-e105f373e38f tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:17:11.070935 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-eb8ca09c-d267-4625-89ab-e105f373e38f tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:17:11.071383 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-eb8ca09c-d267-4625-89ab-e105f373e38f tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:17:11.072086 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-eb8ca09c-d267-4625-89ab-e105f373e38f tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:17:11.072552 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-eb8ca09c-d267-4625-89ab-e105f373e38f tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:17:11.072986 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-eb8ca09c-d267-4625-89ab-e105f373e38f tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:17:11.206744 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-eb8ca09c-d267-4625-89ab-e105f373e38f tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a07aed22e5242308216005a51ee6e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afd506533304073a9f9d246eb7a4434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:17:11.214348 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-eb8ca09c-d267-4625-89ab-e105f373e38f tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] 10.222.0.58 "GET /compute/v2.1/servers/5a8c0a8d-c872-4696-a060-3b5d2b6fe460" status: 200 len: 1554 microversion: 2.1 time: 0.156612 Aug 11 00:17:11.214954 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3738/7267] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:17:11 2022] GET /compute/v2.1/servers/5a8c0a8d-c872-4696-a060-3b5d2b6fe460 => generated 1554 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 00:17:11.235112 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-2c7ffe13-6b58-4910-a6cd-4c58a5791ca5 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:17:11.235724 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-2c7ffe13-6b58-4910-a6cd-4c58a5791ca5 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] [instance: 5a8c0a8d-c872-4696-a060-3b5d2b6fe460] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:17:11.242698 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2c7ffe13-6b58-4910-a6cd-4c58a5791ca5 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:17:11.243209 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2c7ffe13-6b58-4910-a6cd-4c58a5791ca5 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:17:11.243680 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2c7ffe13-6b58-4910-a6cd-4c58a5791ca5 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:17:11.244380 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2c7ffe13-6b58-4910-a6cd-4c58a5791ca5 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:17:11.244829 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2c7ffe13-6b58-4910-a6cd-4c58a5791ca5 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:17:11.245254 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2c7ffe13-6b58-4910-a6cd-4c58a5791ca5 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:17:11.262593 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=2 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:17:11.285341 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=6 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:17:11.386142 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-2c7ffe13-6b58-4910-a6cd-4c58a5791ca5 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a07aed22e5242308216005a51ee6e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afd506533304073a9f9d246eb7a4434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:17:11.395206 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-2c7ffe13-6b58-4910-a6cd-4c58a5791ca5 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] 10.222.0.58 "GET /compute/v2.1/servers/5a8c0a8d-c872-4696-a060-3b5d2b6fe460" status: 200 len: 1554 microversion: 2.1 time: 0.164113 Aug 11 00:17:11.395809 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3530/7268] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:17:11 2022] GET /compute/v2.1/servers/5a8c0a8d-c872-4696-a060-3b5d2b6fe460 => generated 1554 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:17:13.392353 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-ccbf62ae-9e9d-4b19-82ea-d7e06c242d29 req-bc49901f-fb30-4519-a998-7772e03b5082 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a8c0a8d-c872-4696-a060-3b5d2b6fe460", "tag": "545bd480-5089-42ab-a9d8-8cf924136c0a"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 00:17:13.398276 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=6 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:17:13.404700 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-ccbf62ae-9e9d-4b19-82ea-d7e06c242d29 req-bc49901f-fb30-4519-a998-7772e03b5082 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:17:13.405208 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-ccbf62ae-9e9d-4b19-82ea-d7e06c242d29 req-bc49901f-fb30-4519-a998-7772e03b5082 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:17:13.405664 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-ccbf62ae-9e9d-4b19-82ea-d7e06c242d29 req-bc49901f-fb30-4519-a998-7772e03b5082 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:17:13.416974 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-ccbf62ae-9e9d-4b19-82ea-d7e06c242d29 req-bc49901f-fb30-4519-a998-7772e03b5082 service nova] Creating event network-changed:545bd480-5089-42ab-a9d8-8cf924136c0a for instance 5a8c0a8d-c872-4696-a060-3b5d2b6fe460 on n-h1-850468-14 Aug 11 00:17:13.423286 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-ccbf62ae-9e9d-4b19-82ea-d7e06c242d29 req-bc49901f-fb30-4519-a998-7772e03b5082 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035125 Aug 11 00:17:13.423880 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3739/7269] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 11 00:17:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 00:18:48.640672 n-d-850468-14 devstack@n-api.service[122633]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 11 00:18:48.641342 n-d-850468-14 devstack@n-api.service[122633]: Thu Aug 11 00:18:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 11 00:19:08.423020 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:19:08.423908 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=34 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:19:08.428414 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-4e18bfeb-4a6f-41ee-9c32-07521517c198 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 00:19:08.429557 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-4e18bfeb-4a6f-41ee-9c32-07521517c198 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] [instance: 5a8c0a8d-c872-4696-a060-3b5d2b6fe460] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:19:08.436749 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4e18bfeb-4a6f-41ee-9c32-07521517c198 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:19:08.437236 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4e18bfeb-4a6f-41ee-9c32-07521517c198 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:19:08.437674 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4e18bfeb-4a6f-41ee-9c32-07521517c198 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:19:08.438369 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4e18bfeb-4a6f-41ee-9c32-07521517c198 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:19:08.438839 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4e18bfeb-4a6f-41ee-9c32-07521517c198 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:19:08.439269 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4e18bfeb-4a6f-41ee-9c32-07521517c198 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:19:08.463323 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.objects.instance [None req-4e18bfeb-4a6f-41ee-9c32-07521517c198 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lazy-loading 'flavor' on Instance uuid 5a8c0a8d-c872-4696-a060-3b5d2b6fe460 {{(pid=122632) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 11 00:19:08.647345 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-4e18bfeb-4a6f-41ee-9c32-07521517c198 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] 10.222.0.58 "POST /compute/v2.1/servers/5a8c0a8d-c872-4696-a060-3b5d2b6fe460/action" status: 202 len: 0 microversion: 2.1 time: 0.226116 Aug 11 00:19:08.648224 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3531/7270] 10.222.0.58 () {60 vars in 1278 bytes} [Thu Aug 11 00:19:08 2022] POST /compute/v2.1/servers/5a8c0a8d-c872-4696-a060-3b5d2b6fe460/action => generated 0 bytes in 228 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 11 00:19:08.654914 n-d-850468-14 devstack@n-api.service[122633]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e2bb3e2a-85f2-4c49-98ff-2d6066099266] AMQP server on 10.222.0.58:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 11 00:19:08.655782 n-d-850468-14 devstack@n-api.service[122633]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5e7530cb-e34a-4714-9391-5480d11af743] AMQP server on 10.222.0.58:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 11 00:19:08.656349 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:19:08.657118 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=28 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:19:08.661847 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-241afe71-3b16-4c73-84e1-5677ed77de25 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:19:08.662753 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-241afe71-3b16-4c73-84e1-5677ed77de25 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] [instance: 5a8c0a8d-c872-4696-a060-3b5d2b6fe460] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:19:08.671732 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-241afe71-3b16-4c73-84e1-5677ed77de25 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:19:08.672249 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-241afe71-3b16-4c73-84e1-5677ed77de25 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:19:08.672699 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-241afe71-3b16-4c73-84e1-5677ed77de25 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:19:08.673414 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-241afe71-3b16-4c73-84e1-5677ed77de25 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:19:08.673882 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-241afe71-3b16-4c73-84e1-5677ed77de25 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:19:08.674319 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-241afe71-3b16-4c73-84e1-5677ed77de25 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:19:08.818379 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-241afe71-3b16-4c73-84e1-5677ed77de25 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a07aed22e5242308216005a51ee6e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afd506533304073a9f9d246eb7a4434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:19:08.826191 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-241afe71-3b16-4c73-84e1-5677ed77de25 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] 10.222.0.58 "GET /compute/v2.1/servers/5a8c0a8d-c872-4696-a060-3b5d2b6fe460" status: 200 len: 1678 microversion: 2.1 time: 0.173245 Aug 11 00:19:08.826765 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3740/7271] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:19:08 2022] GET /compute/v2.1/servers/5a8c0a8d-c872-4696-a060-3b5d2b6fe460 => generated 1678 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:19:09.851531 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-3658f489-e3e6-41a4-8d4f-50c5f1b7370d tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:19:09.852233 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-3658f489-e3e6-41a4-8d4f-50c5f1b7370d tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] [instance: 5a8c0a8d-c872-4696-a060-3b5d2b6fe460] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:19:09.859440 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3658f489-e3e6-41a4-8d4f-50c5f1b7370d tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:19:09.859949 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3658f489-e3e6-41a4-8d4f-50c5f1b7370d tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:19:09.860395 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3658f489-e3e6-41a4-8d4f-50c5f1b7370d tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:19:09.861085 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3658f489-e3e6-41a4-8d4f-50c5f1b7370d tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:19:09.861538 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3658f489-e3e6-41a4-8d4f-50c5f1b7370d tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:19:09.861962 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-3658f489-e3e6-41a4-8d4f-50c5f1b7370d tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:19:09.999809 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-3658f489-e3e6-41a4-8d4f-50c5f1b7370d tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a07aed22e5242308216005a51ee6e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afd506533304073a9f9d246eb7a4434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:19:10.008035 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-3658f489-e3e6-41a4-8d4f-50c5f1b7370d tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] 10.222.0.58 "GET /compute/v2.1/servers/5a8c0a8d-c872-4696-a060-3b5d2b6fe460" status: 200 len: 1678 microversion: 2.1 time: 0.161271 Aug 11 00:19:10.008610 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3532/7272] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:19:09 2022] GET /compute/v2.1/servers/5a8c0a8d-c872-4696-a060-3b5d2b6fe460 => generated 1678 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:19:11.030147 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-15f30f5f-64b5-491d-8cc1-d371f4bbe4ef tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:19:11.030818 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-15f30f5f-64b5-491d-8cc1-d371f4bbe4ef tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] [instance: 5a8c0a8d-c872-4696-a060-3b5d2b6fe460] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:19:11.039378 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-15f30f5f-64b5-491d-8cc1-d371f4bbe4ef tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:19:11.039884 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-15f30f5f-64b5-491d-8cc1-d371f4bbe4ef tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:19:11.040332 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-15f30f5f-64b5-491d-8cc1-d371f4bbe4ef tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:19:11.041054 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-15f30f5f-64b5-491d-8cc1-d371f4bbe4ef tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:19:11.041523 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-15f30f5f-64b5-491d-8cc1-d371f4bbe4ef tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:19:11.041966 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-15f30f5f-64b5-491d-8cc1-d371f4bbe4ef tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:19:11.049703 n-d-850468-14 devstack@n-api.service[122633]: INFO oslo.messaging._drivers.impl_rabbit [-] [5e7530cb-e34a-4714-9391-5480d11af743] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 41550. Aug 11 00:19:11.050448 n-d-850468-14 devstack@n-api.service[122633]: INFO oslo.messaging._drivers.impl_rabbit [-] [e2bb3e2a-85f2-4c49-98ff-2d6066099266] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 41548. Aug 11 00:19:11.184156 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-15f30f5f-64b5-491d-8cc1-d371f4bbe4ef tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a07aed22e5242308216005a51ee6e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afd506533304073a9f9d246eb7a4434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:19:11.191640 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-15f30f5f-64b5-491d-8cc1-d371f4bbe4ef tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] 10.222.0.58 "GET /compute/v2.1/servers/5a8c0a8d-c872-4696-a060-3b5d2b6fe460" status: 200 len: 1678 microversion: 2.1 time: 0.165465 Aug 11 00:19:11.192226 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3741/7273] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:19:11 2022] GET /compute/v2.1/servers/5a8c0a8d-c872-4696-a060-3b5d2b6fe460 => generated 1678 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:19:12.214247 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-4aabfe86-b1b8-431f-9d99-40de9224442c tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:19:12.214957 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-4aabfe86-b1b8-431f-9d99-40de9224442c tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] [instance: 5a8c0a8d-c872-4696-a060-3b5d2b6fe460] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:19:12.221614 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4aabfe86-b1b8-431f-9d99-40de9224442c tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:19:12.222108 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4aabfe86-b1b8-431f-9d99-40de9224442c tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:19:12.222551 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4aabfe86-b1b8-431f-9d99-40de9224442c tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:19:12.223279 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4aabfe86-b1b8-431f-9d99-40de9224442c tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:19:12.223738 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4aabfe86-b1b8-431f-9d99-40de9224442c tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:19:12.224173 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4aabfe86-b1b8-431f-9d99-40de9224442c tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:19:12.357292 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-4aabfe86-b1b8-431f-9d99-40de9224442c tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a07aed22e5242308216005a51ee6e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afd506533304073a9f9d246eb7a4434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:19:12.364957 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-4aabfe86-b1b8-431f-9d99-40de9224442c tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] 10.222.0.58 "GET /compute/v2.1/servers/5a8c0a8d-c872-4696-a060-3b5d2b6fe460" status: 200 len: 1678 microversion: 2.1 time: 0.155345 Aug 11 00:19:12.365536 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3533/7274] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:19:12 2022] GET /compute/v2.1/servers/5a8c0a8d-c872-4696-a060-3b5d2b6fe460 => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:19:13.386894 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-0358b8bc-9bde-40e9-86fe-8b5fca018288 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:19:13.387511 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-0358b8bc-9bde-40e9-86fe-8b5fca018288 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] [instance: 5a8c0a8d-c872-4696-a060-3b5d2b6fe460] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:19:13.394734 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0358b8bc-9bde-40e9-86fe-8b5fca018288 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:19:13.395254 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0358b8bc-9bde-40e9-86fe-8b5fca018288 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:19:13.395702 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0358b8bc-9bde-40e9-86fe-8b5fca018288 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:19:13.396401 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0358b8bc-9bde-40e9-86fe-8b5fca018288 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:19:13.396861 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0358b8bc-9bde-40e9-86fe-8b5fca018288 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:19:13.397292 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0358b8bc-9bde-40e9-86fe-8b5fca018288 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:19:13.531869 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-0358b8bc-9bde-40e9-86fe-8b5fca018288 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a07aed22e5242308216005a51ee6e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afd506533304073a9f9d246eb7a4434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:19:13.540195 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-0358b8bc-9bde-40e9-86fe-8b5fca018288 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] 10.222.0.58 "GET /compute/v2.1/servers/5a8c0a8d-c872-4696-a060-3b5d2b6fe460" status: 200 len: 1678 microversion: 2.1 time: 0.157652 Aug 11 00:19:13.540769 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3742/7275] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:19:13 2022] GET /compute/v2.1/servers/5a8c0a8d-c872-4696-a060-3b5d2b6fe460 => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:19:14.561603 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-448f098a-b410-4186-b33b-7101b96547d5 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:19:14.562146 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-448f098a-b410-4186-b33b-7101b96547d5 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] [instance: 5a8c0a8d-c872-4696-a060-3b5d2b6fe460] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:19:14.568975 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-448f098a-b410-4186-b33b-7101b96547d5 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:19:14.569462 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-448f098a-b410-4186-b33b-7101b96547d5 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:19:14.569955 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-448f098a-b410-4186-b33b-7101b96547d5 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:19:14.570680 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-448f098a-b410-4186-b33b-7101b96547d5 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:19:14.571162 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-448f098a-b410-4186-b33b-7101b96547d5 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:19:14.571583 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-448f098a-b410-4186-b33b-7101b96547d5 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:19:14.707078 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-448f098a-b410-4186-b33b-7101b96547d5 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a07aed22e5242308216005a51ee6e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afd506533304073a9f9d246eb7a4434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:19:14.715491 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-448f098a-b410-4186-b33b-7101b96547d5 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] 10.222.0.58 "GET /compute/v2.1/servers/5a8c0a8d-c872-4696-a060-3b5d2b6fe460" status: 200 len: 1678 microversion: 2.1 time: 0.157987 Aug 11 00:19:14.716070 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3534/7276] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:19:14 2022] GET /compute/v2.1/servers/5a8c0a8d-c872-4696-a060-3b5d2b6fe460 => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:19:15.736923 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-9a1a781a-7d82-42f3-909a-720966229fc1 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:19:15.737540 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-9a1a781a-7d82-42f3-909a-720966229fc1 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] [instance: 5a8c0a8d-c872-4696-a060-3b5d2b6fe460] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:19:15.744917 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9a1a781a-7d82-42f3-909a-720966229fc1 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:19:15.745408 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9a1a781a-7d82-42f3-909a-720966229fc1 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:19:15.745855 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9a1a781a-7d82-42f3-909a-720966229fc1 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:19:15.746557 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9a1a781a-7d82-42f3-909a-720966229fc1 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:19:15.747055 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9a1a781a-7d82-42f3-909a-720966229fc1 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:19:15.747490 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9a1a781a-7d82-42f3-909a-720966229fc1 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:19:15.884434 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-9a1a781a-7d82-42f3-909a-720966229fc1 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a07aed22e5242308216005a51ee6e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afd506533304073a9f9d246eb7a4434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:19:15.892292 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-9a1a781a-7d82-42f3-909a-720966229fc1 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] 10.222.0.58 "GET /compute/v2.1/servers/5a8c0a8d-c872-4696-a060-3b5d2b6fe460" status: 200 len: 1678 microversion: 2.1 time: 0.159250 Aug 11 00:19:15.892868 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3743/7277] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:19:15 2022] GET /compute/v2.1/servers/5a8c0a8d-c872-4696-a060-3b5d2b6fe460 => generated 1678 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:19:16.914566 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-8de605c4-d8a9-4420-935c-2e82320e12db tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:19:16.915244 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-8de605c4-d8a9-4420-935c-2e82320e12db tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] [instance: 5a8c0a8d-c872-4696-a060-3b5d2b6fe460] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:19:16.922867 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8de605c4-d8a9-4420-935c-2e82320e12db tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:19:16.923452 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8de605c4-d8a9-4420-935c-2e82320e12db tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:19:16.923984 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8de605c4-d8a9-4420-935c-2e82320e12db tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:19:16.924888 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8de605c4-d8a9-4420-935c-2e82320e12db tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:19:16.925349 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8de605c4-d8a9-4420-935c-2e82320e12db tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:19:16.925784 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8de605c4-d8a9-4420-935c-2e82320e12db tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:19:17.058484 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-8de605c4-d8a9-4420-935c-2e82320e12db tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a07aed22e5242308216005a51ee6e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afd506533304073a9f9d246eb7a4434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:19:17.066215 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-8de605c4-d8a9-4420-935c-2e82320e12db tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] 10.222.0.58 "GET /compute/v2.1/servers/5a8c0a8d-c872-4696-a060-3b5d2b6fe460" status: 200 len: 1678 microversion: 2.1 time: 0.156301 Aug 11 00:19:17.066808 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3535/7278] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:19:16 2022] GET /compute/v2.1/servers/5a8c0a8d-c872-4696-a060-3b5d2b6fe460 => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:19:18.088363 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-e9fe6a3e-cf2c-4350-abfa-4907c42ff012 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:19:18.088998 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-e9fe6a3e-cf2c-4350-abfa-4907c42ff012 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] [instance: 5a8c0a8d-c872-4696-a060-3b5d2b6fe460] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:19:18.095963 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e9fe6a3e-cf2c-4350-abfa-4907c42ff012 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:19:18.096468 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e9fe6a3e-cf2c-4350-abfa-4907c42ff012 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:19:18.096958 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e9fe6a3e-cf2c-4350-abfa-4907c42ff012 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:19:18.097680 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e9fe6a3e-cf2c-4350-abfa-4907c42ff012 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:19:18.098152 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e9fe6a3e-cf2c-4350-abfa-4907c42ff012 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:19:18.098594 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e9fe6a3e-cf2c-4350-abfa-4907c42ff012 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:19:18.234217 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-e9fe6a3e-cf2c-4350-abfa-4907c42ff012 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a07aed22e5242308216005a51ee6e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afd506533304073a9f9d246eb7a4434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:19:18.242568 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-e9fe6a3e-cf2c-4350-abfa-4907c42ff012 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] 10.222.0.58 "GET /compute/v2.1/servers/5a8c0a8d-c872-4696-a060-3b5d2b6fe460" status: 200 len: 1678 microversion: 2.1 time: 0.157532 Aug 11 00:19:18.243195 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3744/7279] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:19:18 2022] GET /compute/v2.1/servers/5a8c0a8d-c872-4696-a060-3b5d2b6fe460 => generated 1678 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:19:19.266230 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-6e8e8c0a-b4d8-425d-8f17-9969329acd39 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:19:19.266831 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-6e8e8c0a-b4d8-425d-8f17-9969329acd39 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] [instance: 5a8c0a8d-c872-4696-a060-3b5d2b6fe460] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:19:19.274336 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6e8e8c0a-b4d8-425d-8f17-9969329acd39 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:19:19.274841 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6e8e8c0a-b4d8-425d-8f17-9969329acd39 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:19:19.275282 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6e8e8c0a-b4d8-425d-8f17-9969329acd39 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:19:19.275977 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6e8e8c0a-b4d8-425d-8f17-9969329acd39 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:19:19.276430 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6e8e8c0a-b4d8-425d-8f17-9969329acd39 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:19:19.276853 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6e8e8c0a-b4d8-425d-8f17-9969329acd39 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:19:19.414440 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-6e8e8c0a-b4d8-425d-8f17-9969329acd39 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a07aed22e5242308216005a51ee6e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afd506533304073a9f9d246eb7a4434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:19:19.422071 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-6e8e8c0a-b4d8-425d-8f17-9969329acd39 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] 10.222.0.58 "GET /compute/v2.1/servers/5a8c0a8d-c872-4696-a060-3b5d2b6fe460" status: 200 len: 1699 microversion: 2.1 time: 0.160310 Aug 11 00:19:19.422645 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3536/7280] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:19:19 2022] GET /compute/v2.1/servers/5a8c0a8d-c872-4696-a060-3b5d2b6fe460 => generated 1699 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:19:20.443894 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c2176210-5f20-4fc4-93b1-6bdfeadc57d0 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:19:20.444520 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-c2176210-5f20-4fc4-93b1-6bdfeadc57d0 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] [instance: 5a8c0a8d-c872-4696-a060-3b5d2b6fe460] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:19:20.451708 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c2176210-5f20-4fc4-93b1-6bdfeadc57d0 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:19:20.452208 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c2176210-5f20-4fc4-93b1-6bdfeadc57d0 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:19:20.452658 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c2176210-5f20-4fc4-93b1-6bdfeadc57d0 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:19:20.453374 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c2176210-5f20-4fc4-93b1-6bdfeadc57d0 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:19:20.453842 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c2176210-5f20-4fc4-93b1-6bdfeadc57d0 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:19:20.454281 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c2176210-5f20-4fc4-93b1-6bdfeadc57d0 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:19:20.591592 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-c2176210-5f20-4fc4-93b1-6bdfeadc57d0 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a07aed22e5242308216005a51ee6e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afd506533304073a9f9d246eb7a4434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:19:20.599728 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-c2176210-5f20-4fc4-93b1-6bdfeadc57d0 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] 10.222.0.58 "GET /compute/v2.1/servers/5a8c0a8d-c872-4696-a060-3b5d2b6fe460" status: 200 len: 1699 microversion: 2.1 time: 0.159539 Aug 11 00:19:20.600635 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3745/7281] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:19:20 2022] GET /compute/v2.1/servers/5a8c0a8d-c872-4696-a060-3b5d2b6fe460 => generated 1699 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:19:21.622480 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-2e940763-611c-4a3b-bd8e-c8aa6da4c5ab tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:19:21.623270 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-2e940763-611c-4a3b-bd8e-c8aa6da4c5ab tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] [instance: 5a8c0a8d-c872-4696-a060-3b5d2b6fe460] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:19:21.630525 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2e940763-611c-4a3b-bd8e-c8aa6da4c5ab tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:19:21.633152 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2e940763-611c-4a3b-bd8e-c8aa6da4c5ab tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:19:21.634012 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2e940763-611c-4a3b-bd8e-c8aa6da4c5ab tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:19:21.634866 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2e940763-611c-4a3b-bd8e-c8aa6da4c5ab tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:19:21.635420 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2e940763-611c-4a3b-bd8e-c8aa6da4c5ab tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:19:21.635907 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2e940763-611c-4a3b-bd8e-c8aa6da4c5ab tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:19:21.796078 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-2e940763-611c-4a3b-bd8e-c8aa6da4c5ab tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a07aed22e5242308216005a51ee6e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afd506533304073a9f9d246eb7a4434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:19:21.804555 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-2e940763-611c-4a3b-bd8e-c8aa6da4c5ab tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] 10.222.0.58 "GET /compute/v2.1/servers/5a8c0a8d-c872-4696-a060-3b5d2b6fe460" status: 200 len: 1694 microversion: 2.1 time: 0.185405 Aug 11 00:19:21.805662 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3537/7282] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:19:21 2022] GET /compute/v2.1/servers/5a8c0a8d-c872-4696-a060-3b5d2b6fe460 => generated 1694 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:19:22.008630 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-4a77e6d8-f07a-4e42-a9fe-a68e77e1f28b req-baa023f3-0b15-46a3-9991-0352a3b137f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a8c0a8d-c872-4696-a060-3b5d2b6fe460", "name": "network-vif-plugged", "status": "completed", "tag": "545bd480-5089-42ab-a9d8-8cf924136c0a"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 00:19:22.027483 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-4a77e6d8-f07a-4e42-a9fe-a68e77e1f28b req-baa023f3-0b15-46a3-9991-0352a3b137f3 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:19:22.028287 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-4a77e6d8-f07a-4e42-a9fe-a68e77e1f28b req-baa023f3-0b15-46a3-9991-0352a3b137f3 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:19:22.028785 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-4a77e6d8-f07a-4e42-a9fe-a68e77e1f28b req-baa023f3-0b15-46a3-9991-0352a3b137f3 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:19:22.042839 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-4a77e6d8-f07a-4e42-a9fe-a68e77e1f28b req-baa023f3-0b15-46a3-9991-0352a3b137f3 service nova] Creating event network-vif-plugged:545bd480-5089-42ab-a9d8-8cf924136c0a for instance 5a8c0a8d-c872-4696-a060-3b5d2b6fe460 on n-h1-850468-14 Aug 11 00:19:22.046968 n-d-850468-14 devstack@n-api.service[122633]: ERROR oslo.messaging._drivers.impl_rabbit [req-4a77e6d8-f07a-4e42-a9fe-a68e77e1f28b req-baa023f3-0b15-46a3-9991-0352a3b137f3 service nova] [46e9f281-7003-4fed-bf96-811b3bce3464] AMQP server on 10.222.0.58:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 11 00:19:22.827665 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-207972c9-aaaa-402e-adec-b167ee28af83 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:19:22.828285 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-207972c9-aaaa-402e-adec-b167ee28af83 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] [instance: 5a8c0a8d-c872-4696-a060-3b5d2b6fe460] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:19:22.836258 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-207972c9-aaaa-402e-adec-b167ee28af83 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:19:22.837114 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-207972c9-aaaa-402e-adec-b167ee28af83 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:19:22.837686 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-207972c9-aaaa-402e-adec-b167ee28af83 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:19:22.838502 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-207972c9-aaaa-402e-adec-b167ee28af83 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:19:22.839132 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-207972c9-aaaa-402e-adec-b167ee28af83 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:19:22.839652 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-207972c9-aaaa-402e-adec-b167ee28af83 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:19:22.992062 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-207972c9-aaaa-402e-adec-b167ee28af83 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a07aed22e5242308216005a51ee6e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afd506533304073a9f9d246eb7a4434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:19:23.001742 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-207972c9-aaaa-402e-adec-b167ee28af83 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] 10.222.0.58 "GET /compute/v2.1/servers/5a8c0a8d-c872-4696-a060-3b5d2b6fe460" status: 200 len: 1694 microversion: 2.1 time: 0.177916 Aug 11 00:19:23.002813 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3538/7283] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:19:22 2022] GET /compute/v2.1/servers/5a8c0a8d-c872-4696-a060-3b5d2b6fe460 => generated 1694 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:19:23.053879 n-d-850468-14 devstack@n-api.service[122633]: INFO oslo.messaging._drivers.impl_rabbit [req-4a77e6d8-f07a-4e42-a9fe-a68e77e1f28b req-baa023f3-0b15-46a3-9991-0352a3b137f3 service nova] [46e9f281-7003-4fed-bf96-811b3bce3464] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 41602. Aug 11 00:19:23.058664 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-4a77e6d8-f07a-4e42-a9fe-a68e77e1f28b req-baa023f3-0b15-46a3-9991-0352a3b137f3 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.054537 Aug 11 00:19:23.059399 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3746/7284] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 11 00:19:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 00:19:24.025866 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-9a4f9a33-d917-4655-957a-96eb5aa23c99 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:19:24.026496 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-9a4f9a33-d917-4655-957a-96eb5aa23c99 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] [instance: 5a8c0a8d-c872-4696-a060-3b5d2b6fe460] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:19:24.034664 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9a4f9a33-d917-4655-957a-96eb5aa23c99 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:19:24.035203 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9a4f9a33-d917-4655-957a-96eb5aa23c99 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:19:24.035647 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9a4f9a33-d917-4655-957a-96eb5aa23c99 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:19:24.036376 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9a4f9a33-d917-4655-957a-96eb5aa23c99 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:19:24.036833 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9a4f9a33-d917-4655-957a-96eb5aa23c99 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:19:24.037287 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9a4f9a33-d917-4655-957a-96eb5aa23c99 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:19:24.202161 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-9a4f9a33-d917-4655-957a-96eb5aa23c99 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a07aed22e5242308216005a51ee6e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afd506533304073a9f9d246eb7a4434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:19:24.211729 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-9a4f9a33-d917-4655-957a-96eb5aa23c99 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] 10.222.0.58 "GET /compute/v2.1/servers/5a8c0a8d-c872-4696-a060-3b5d2b6fe460" status: 200 len: 1694 microversion: 2.1 time: 0.191272 Aug 11 00:19:24.212337 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3539/7285] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:19:24 2022] GET /compute/v2.1/servers/5a8c0a8d-c872-4696-a060-3b5d2b6fe460 => generated 1694 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 00:19:25.234350 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-1e04cea4-ab87-4ca1-ac24-c378dca54476 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:19:25.235892 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-1e04cea4-ab87-4ca1-ac24-c378dca54476 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] [instance: 5a8c0a8d-c872-4696-a060-3b5d2b6fe460] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:19:25.242849 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1e04cea4-ab87-4ca1-ac24-c378dca54476 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:19:25.243358 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1e04cea4-ab87-4ca1-ac24-c378dca54476 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:19:25.243811 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1e04cea4-ab87-4ca1-ac24-c378dca54476 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:19:25.244703 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1e04cea4-ab87-4ca1-ac24-c378dca54476 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:19:25.245180 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1e04cea4-ab87-4ca1-ac24-c378dca54476 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:19:25.245620 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1e04cea4-ab87-4ca1-ac24-c378dca54476 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:19:25.404130 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-1e04cea4-ab87-4ca1-ac24-c378dca54476 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a07aed22e5242308216005a51ee6e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afd506533304073a9f9d246eb7a4434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:19:25.412908 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-1e04cea4-ab87-4ca1-ac24-c378dca54476 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] 10.222.0.58 "GET /compute/v2.1/servers/5a8c0a8d-c872-4696-a060-3b5d2b6fe460" status: 200 len: 1694 microversion: 2.1 time: 0.182735 Aug 11 00:19:25.420532 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3747/7286] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:19:25 2022] GET /compute/v2.1/servers/5a8c0a8d-c872-4696-a060-3b5d2b6fe460 => generated 1694 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:19:26.436742 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-bf7c153b-e844-4129-9d7d-ee241803c05b tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:19:26.437370 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-bf7c153b-e844-4129-9d7d-ee241803c05b tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] [instance: 5a8c0a8d-c872-4696-a060-3b5d2b6fe460] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:19:26.445630 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bf7c153b-e844-4129-9d7d-ee241803c05b tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:19:26.446173 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bf7c153b-e844-4129-9d7d-ee241803c05b tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:19:26.446621 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bf7c153b-e844-4129-9d7d-ee241803c05b tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:19:26.447383 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bf7c153b-e844-4129-9d7d-ee241803c05b tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:19:26.447889 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bf7c153b-e844-4129-9d7d-ee241803c05b tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:19:26.448296 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bf7c153b-e844-4129-9d7d-ee241803c05b tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:19:26.595705 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-bf7c153b-e844-4129-9d7d-ee241803c05b tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a07aed22e5242308216005a51ee6e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afd506533304073a9f9d246eb7a4434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:19:26.608819 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-bf7c153b-e844-4129-9d7d-ee241803c05b tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] 10.222.0.58 "GET /compute/v2.1/servers/5a8c0a8d-c872-4696-a060-3b5d2b6fe460" status: 200 len: 1694 microversion: 2.1 time: 0.176081 Aug 11 00:19:26.609457 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3540/7287] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:19:26 2022] GET /compute/v2.1/servers/5a8c0a8d-c872-4696-a060-3b5d2b6fe460 => generated 1694 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:19:27.633613 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-02ea9393-60b5-4307-ad26-f8c8510e440f tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:19:27.635511 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-02ea9393-60b5-4307-ad26-f8c8510e440f tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] [instance: 5a8c0a8d-c872-4696-a060-3b5d2b6fe460] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:19:27.643166 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-02ea9393-60b5-4307-ad26-f8c8510e440f tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:19:27.643991 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-02ea9393-60b5-4307-ad26-f8c8510e440f tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:19:27.644649 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-02ea9393-60b5-4307-ad26-f8c8510e440f tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:19:27.645583 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-02ea9393-60b5-4307-ad26-f8c8510e440f tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:19:27.646056 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-02ea9393-60b5-4307-ad26-f8c8510e440f tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:19:27.646496 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-02ea9393-60b5-4307-ad26-f8c8510e440f tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:19:27.813070 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-02ea9393-60b5-4307-ad26-f8c8510e440f tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a07aed22e5242308216005a51ee6e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afd506533304073a9f9d246eb7a4434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:19:27.821473 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-02ea9393-60b5-4307-ad26-f8c8510e440f tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] 10.222.0.58 "GET /compute/v2.1/servers/5a8c0a8d-c872-4696-a060-3b5d2b6fe460" status: 200 len: 1694 microversion: 2.1 time: 0.192531 Aug 11 00:19:27.826103 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3748/7288] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:19:27 2022] GET /compute/v2.1/servers/5a8c0a8d-c872-4696-a060-3b5d2b6fe460 => generated 1694 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:19:28.848986 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-73c06265-9a3e-4bc3-bc9f-040c2561b814 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:19:28.849529 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-73c06265-9a3e-4bc3-bc9f-040c2561b814 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] [instance: 5a8c0a8d-c872-4696-a060-3b5d2b6fe460] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:19:28.857567 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-73c06265-9a3e-4bc3-bc9f-040c2561b814 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:19:28.858275 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-73c06265-9a3e-4bc3-bc9f-040c2561b814 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:19:28.858749 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-73c06265-9a3e-4bc3-bc9f-040c2561b814 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:19:28.859492 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-73c06265-9a3e-4bc3-bc9f-040c2561b814 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:19:28.859975 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-73c06265-9a3e-4bc3-bc9f-040c2561b814 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:19:28.860404 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-73c06265-9a3e-4bc3-bc9f-040c2561b814 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:19:29.025870 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-73c06265-9a3e-4bc3-bc9f-040c2561b814 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a07aed22e5242308216005a51ee6e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afd506533304073a9f9d246eb7a4434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:19:29.033981 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-73c06265-9a3e-4bc3-bc9f-040c2561b814 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] 10.222.0.58 "GET /compute/v2.1/servers/5a8c0a8d-c872-4696-a060-3b5d2b6fe460" status: 200 len: 1694 microversion: 2.1 time: 0.189468 Aug 11 00:19:29.036661 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3541/7289] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:19:28 2022] GET /compute/v2.1/servers/5a8c0a8d-c872-4696-a060-3b5d2b6fe460 => generated 1694 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:19:30.059782 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-da1df443-41c4-43e3-bf69-ab0090548198 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:19:30.060333 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-da1df443-41c4-43e3-bf69-ab0090548198 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] [instance: 5a8c0a8d-c872-4696-a060-3b5d2b6fe460] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:19:30.067599 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-da1df443-41c4-43e3-bf69-ab0090548198 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:19:30.068116 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-da1df443-41c4-43e3-bf69-ab0090548198 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:19:30.068575 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-da1df443-41c4-43e3-bf69-ab0090548198 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:19:30.069307 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-da1df443-41c4-43e3-bf69-ab0090548198 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:19:30.071025 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-da1df443-41c4-43e3-bf69-ab0090548198 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:19:30.071220 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-da1df443-41c4-43e3-bf69-ab0090548198 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:19:30.218390 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-da1df443-41c4-43e3-bf69-ab0090548198 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a07aed22e5242308216005a51ee6e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afd506533304073a9f9d246eb7a4434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:19:30.226727 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-da1df443-41c4-43e3-bf69-ab0090548198 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] 10.222.0.58 "GET /compute/v2.1/servers/5a8c0a8d-c872-4696-a060-3b5d2b6fe460" status: 200 len: 1694 microversion: 2.1 time: 0.170915 Aug 11 00:19:30.227350 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3749/7290] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:19:30 2022] GET /compute/v2.1/servers/5a8c0a8d-c872-4696-a060-3b5d2b6fe460 => generated 1694 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:19:31.248458 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-fc5787f5-15dd-489c-a3a4-fcf1936bf709 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:19:31.249078 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-fc5787f5-15dd-489c-a3a4-fcf1936bf709 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] [instance: 5a8c0a8d-c872-4696-a060-3b5d2b6fe460] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:19:31.256085 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fc5787f5-15dd-489c-a3a4-fcf1936bf709 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:19:31.256568 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fc5787f5-15dd-489c-a3a4-fcf1936bf709 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:19:31.257637 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fc5787f5-15dd-489c-a3a4-fcf1936bf709 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:19:31.258346 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fc5787f5-15dd-489c-a3a4-fcf1936bf709 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:19:31.258818 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fc5787f5-15dd-489c-a3a4-fcf1936bf709 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:19:31.259252 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fc5787f5-15dd-489c-a3a4-fcf1936bf709 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:19:31.395910 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-fc5787f5-15dd-489c-a3a4-fcf1936bf709 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a07aed22e5242308216005a51ee6e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afd506533304073a9f9d246eb7a4434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:19:31.405036 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-fc5787f5-15dd-489c-a3a4-fcf1936bf709 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] 10.222.0.58 "GET /compute/v2.1/servers/5a8c0a8d-c872-4696-a060-3b5d2b6fe460" status: 200 len: 1676 microversion: 2.1 time: 0.160785 Aug 11 00:19:31.405640 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3542/7291] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:19:31 2022] GET /compute/v2.1/servers/5a8c0a8d-c872-4696-a060-3b5d2b6fe460 => generated 1676 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:19:32.427165 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-aeffffeb-4a18-4921-ba53-4fd4e86d7613 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:19:32.427711 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-aeffffeb-4a18-4921-ba53-4fd4e86d7613 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] [instance: 5a8c0a8d-c872-4696-a060-3b5d2b6fe460] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:19:32.435289 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-aeffffeb-4a18-4921-ba53-4fd4e86d7613 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:19:32.435786 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-aeffffeb-4a18-4921-ba53-4fd4e86d7613 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:19:32.436237 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-aeffffeb-4a18-4921-ba53-4fd4e86d7613 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:19:32.436950 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-aeffffeb-4a18-4921-ba53-4fd4e86d7613 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:19:32.437416 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-aeffffeb-4a18-4921-ba53-4fd4e86d7613 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:19:32.437852 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-aeffffeb-4a18-4921-ba53-4fd4e86d7613 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:19:32.584670 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-aeffffeb-4a18-4921-ba53-4fd4e86d7613 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a07aed22e5242308216005a51ee6e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afd506533304073a9f9d246eb7a4434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:19:32.593471 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-aeffffeb-4a18-4921-ba53-4fd4e86d7613 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] 10.222.0.58 "GET /compute/v2.1/servers/5a8c0a8d-c872-4696-a060-3b5d2b6fe460" status: 200 len: 1676 microversion: 2.1 time: 0.170423 Aug 11 00:19:32.594073 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3750/7292] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:19:32 2022] GET /compute/v2.1/servers/5a8c0a8d-c872-4696-a060-3b5d2b6fe460 => generated 1676 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:19:33.615469 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-df2fbbc3-64a5-4c3e-831a-b2df03748dd8 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:19:33.615998 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-df2fbbc3-64a5-4c3e-831a-b2df03748dd8 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] [instance: 5a8c0a8d-c872-4696-a060-3b5d2b6fe460] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:19:33.623929 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-df2fbbc3-64a5-4c3e-831a-b2df03748dd8 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:19:33.624422 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-df2fbbc3-64a5-4c3e-831a-b2df03748dd8 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:19:33.624860 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-df2fbbc3-64a5-4c3e-831a-b2df03748dd8 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:19:33.625588 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-df2fbbc3-64a5-4c3e-831a-b2df03748dd8 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:19:33.626039 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-df2fbbc3-64a5-4c3e-831a-b2df03748dd8 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:19:33.626463 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-df2fbbc3-64a5-4c3e-831a-b2df03748dd8 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:19:33.762309 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-df2fbbc3-64a5-4c3e-831a-b2df03748dd8 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a07aed22e5242308216005a51ee6e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afd506533304073a9f9d246eb7a4434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:19:33.770148 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-df2fbbc3-64a5-4c3e-831a-b2df03748dd8 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] 10.222.0.58 "GET /compute/v2.1/servers/5a8c0a8d-c872-4696-a060-3b5d2b6fe460" status: 200 len: 1619 microversion: 2.1 time: 0.158669 Aug 11 00:19:33.770676 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3543/7293] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:19:33 2022] GET /compute/v2.1/servers/5a8c0a8d-c872-4696-a060-3b5d2b6fe460 => generated 1619 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:19:33.791795 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-311ef6ad-c506-42c3-8ede-778a134e8bc8 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 00:19:33.792411 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-311ef6ad-c506-42c3-8ede-778a134e8bc8 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] [instance: 5a8c0a8d-c872-4696-a060-3b5d2b6fe460] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:19:33.799306 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-311ef6ad-c506-42c3-8ede-778a134e8bc8 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:19:33.799804 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-311ef6ad-c506-42c3-8ede-778a134e8bc8 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:19:33.800254 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-311ef6ad-c506-42c3-8ede-778a134e8bc8 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:19:33.800961 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-311ef6ad-c506-42c3-8ede-778a134e8bc8 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:19:33.801428 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-311ef6ad-c506-42c3-8ede-778a134e8bc8 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:19:33.801866 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-311ef6ad-c506-42c3-8ede-778a134e8bc8 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:19:33.893632 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-311ef6ad-c506-42c3-8ede-778a134e8bc8 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] [instance: 5a8c0a8d-c872-4696-a060-3b5d2b6fe460] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=122633) unshelve /opt/stack/nova/nova/compute/api.py:4544}} Aug 11 00:19:33.963675 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-311ef6ad-c506-42c3-8ede-778a134e8bc8 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] 10.222.0.58 "POST /compute/v2.1/servers/5a8c0a8d-c872-4696-a060-3b5d2b6fe460/action" status: 202 len: 0 microversion: 2.1 time: 0.176339 Aug 11 00:19:33.964519 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3751/7294] 10.222.0.58 () {60 vars in 1278 bytes} [Thu Aug 11 00:19:33 2022] POST /compute/v2.1/servers/5a8c0a8d-c872-4696-a060-3b5d2b6fe460/action => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 11 00:19:33.972647 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-0f0a4db2-e55d-4812-a10d-0b2cc96ba589 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:19:33.973265 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-0f0a4db2-e55d-4812-a10d-0b2cc96ba589 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] [instance: 5a8c0a8d-c872-4696-a060-3b5d2b6fe460] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:19:33.979708 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0f0a4db2-e55d-4812-a10d-0b2cc96ba589 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:19:33.980206 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0f0a4db2-e55d-4812-a10d-0b2cc96ba589 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:19:33.980847 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0f0a4db2-e55d-4812-a10d-0b2cc96ba589 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:19:33.981554 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0f0a4db2-e55d-4812-a10d-0b2cc96ba589 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:19:33.982172 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0f0a4db2-e55d-4812-a10d-0b2cc96ba589 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:19:33.982597 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0f0a4db2-e55d-4812-a10d-0b2cc96ba589 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:19:34.073554 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-5beb3ffd-a1a8-48a9-9d06-1e6a31012282 req-9acd5667-7c79-4455-8161-81854439e0de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a8c0a8d-c872-4696-a060-3b5d2b6fe460", "name": "network-vif-unplugged", "status": "completed", "tag": "545bd480-5089-42ab-a9d8-8cf924136c0a"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 00:19:34.094572 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-5beb3ffd-a1a8-48a9-9d06-1e6a31012282 req-9acd5667-7c79-4455-8161-81854439e0de service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:19:34.095976 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-5beb3ffd-a1a8-48a9-9d06-1e6a31012282 req-9acd5667-7c79-4455-8161-81854439e0de service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:19:34.096619 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-5beb3ffd-a1a8-48a9-9d06-1e6a31012282 req-9acd5667-7c79-4455-8161-81854439e0de service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:19:34.114564 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.compute.server_external_events [req-5beb3ffd-a1a8-48a9-9d06-1e6a31012282 req-9acd5667-7c79-4455-8161-81854439e0de service nova] Unable to find a host for instance 5a8c0a8d-c872-4696-a060-3b5d2b6fe460. Dropping event network-vif-unplugged {{(pid=122633) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 11 00:19:34.115530 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-5beb3ffd-a1a8-48a9-9d06-1e6a31012282 req-9acd5667-7c79-4455-8161-81854439e0de service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.047096 Aug 11 00:19:34.117692 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3752/7295] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 11 00:19:34 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 50 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 11 00:19:34.160647 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-0f0a4db2-e55d-4812-a10d-0b2cc96ba589 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a07aed22e5242308216005a51ee6e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afd506533304073a9f9d246eb7a4434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:19:34.169993 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-0f0a4db2-e55d-4812-a10d-0b2cc96ba589 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] 10.222.0.58 "GET /compute/v2.1/servers/5a8c0a8d-c872-4696-a060-3b5d2b6fe460" status: 200 len: 1627 microversion: 2.1 time: 0.201211 Aug 11 00:19:34.170714 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3544/7296] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:19:33 2022] GET /compute/v2.1/servers/5a8c0a8d-c872-4696-a060-3b5d2b6fe460 => generated 1627 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:19:35.192336 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-62f71b26-8969-4675-acc4-be34081ac174 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:19:35.192873 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-62f71b26-8969-4675-acc4-be34081ac174 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] [instance: 5a8c0a8d-c872-4696-a060-3b5d2b6fe460] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:19:35.199776 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-62f71b26-8969-4675-acc4-be34081ac174 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:19:35.200268 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-62f71b26-8969-4675-acc4-be34081ac174 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:19:35.200720 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-62f71b26-8969-4675-acc4-be34081ac174 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:19:35.201426 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-62f71b26-8969-4675-acc4-be34081ac174 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:19:35.201886 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-62f71b26-8969-4675-acc4-be34081ac174 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:19:35.202319 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-62f71b26-8969-4675-acc4-be34081ac174 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:19:35.345288 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-62f71b26-8969-4675-acc4-be34081ac174 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a07aed22e5242308216005a51ee6e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afd506533304073a9f9d246eb7a4434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:19:35.353700 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-62f71b26-8969-4675-acc4-be34081ac174 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] 10.222.0.58 "GET /compute/v2.1/servers/5a8c0a8d-c872-4696-a060-3b5d2b6fe460" status: 200 len: 1685 microversion: 2.1 time: 0.165345 Aug 11 00:19:35.354292 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3753/7297] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:19:35 2022] GET /compute/v2.1/servers/5a8c0a8d-c872-4696-a060-3b5d2b6fe460 => generated 1685 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:19:36.247562 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-5ac890bd-408b-4db0-88cb-a04c363ff9c1 req-c6e2296d-5d42-4153-9f04-f5634f01f4af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a8c0a8d-c872-4696-a060-3b5d2b6fe460", "tag": "545bd480-5089-42ab-a9d8-8cf924136c0a"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 00:19:36.257048 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-5ac890bd-408b-4db0-88cb-a04c363ff9c1 req-c6e2296d-5d42-4153-9f04-f5634f01f4af service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:19:36.258085 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-5ac890bd-408b-4db0-88cb-a04c363ff9c1 req-c6e2296d-5d42-4153-9f04-f5634f01f4af service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:19:36.258863 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-5ac890bd-408b-4db0-88cb-a04c363ff9c1 req-c6e2296d-5d42-4153-9f04-f5634f01f4af service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:19:36.270607 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-5ac890bd-408b-4db0-88cb-a04c363ff9c1 req-c6e2296d-5d42-4153-9f04-f5634f01f4af service nova] Creating event network-changed:545bd480-5089-42ab-a9d8-8cf924136c0a for instance 5a8c0a8d-c872-4696-a060-3b5d2b6fe460 on n-h2-850468-14 Aug 11 00:19:36.275989 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-5ac890bd-408b-4db0-88cb-a04c363ff9c1 req-c6e2296d-5d42-4153-9f04-f5634f01f4af service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091898 Aug 11 00:19:36.276618 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3545/7298] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 11 00:19:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 00:19:36.376053 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-8a5a3f45-aec6-435f-88fc-39222a35db06 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:19:36.376677 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-8a5a3f45-aec6-435f-88fc-39222a35db06 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] [instance: 5a8c0a8d-c872-4696-a060-3b5d2b6fe460] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:19:36.384703 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8a5a3f45-aec6-435f-88fc-39222a35db06 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:19:36.385203 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8a5a3f45-aec6-435f-88fc-39222a35db06 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:19:36.385657 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8a5a3f45-aec6-435f-88fc-39222a35db06 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:19:36.386372 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8a5a3f45-aec6-435f-88fc-39222a35db06 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:19:36.386878 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8a5a3f45-aec6-435f-88fc-39222a35db06 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:19:36.387315 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8a5a3f45-aec6-435f-88fc-39222a35db06 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:19:36.581928 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-8a5a3f45-aec6-435f-88fc-39222a35db06 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a07aed22e5242308216005a51ee6e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afd506533304073a9f9d246eb7a4434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:19:36.590481 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-8a5a3f45-aec6-435f-88fc-39222a35db06 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] 10.222.0.58 "GET /compute/v2.1/servers/5a8c0a8d-c872-4696-a060-3b5d2b6fe460" status: 200 len: 1685 microversion: 2.1 time: 0.218342 Aug 11 00:19:36.591098 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3754/7299] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:19:36 2022] GET /compute/v2.1/servers/5a8c0a8d-c872-4696-a060-3b5d2b6fe460 => generated 1685 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:19:37.614406 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-5b921bc1-01bb-4f07-971c-c07374f6c38e tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:19:37.615127 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-5b921bc1-01bb-4f07-971c-c07374f6c38e tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] [instance: 5a8c0a8d-c872-4696-a060-3b5d2b6fe460] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:19:37.622834 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5b921bc1-01bb-4f07-971c-c07374f6c38e tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:19:37.623319 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5b921bc1-01bb-4f07-971c-c07374f6c38e tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:19:37.623759 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5b921bc1-01bb-4f07-971c-c07374f6c38e tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:19:37.624459 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5b921bc1-01bb-4f07-971c-c07374f6c38e tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:19:37.625550 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5b921bc1-01bb-4f07-971c-c07374f6c38e tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:19:37.625981 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-5b921bc1-01bb-4f07-971c-c07374f6c38e tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:19:37.630471 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:19:37.772344 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-5b921bc1-01bb-4f07-971c-c07374f6c38e tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a07aed22e5242308216005a51ee6e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afd506533304073a9f9d246eb7a4434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:19:37.781222 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-5b921bc1-01bb-4f07-971c-c07374f6c38e tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] 10.222.0.58 "GET /compute/v2.1/servers/5a8c0a8d-c872-4696-a060-3b5d2b6fe460" status: 200 len: 1685 microversion: 2.1 time: 0.171836 Aug 11 00:19:37.781814 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3546/7300] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:19:37 2022] GET /compute/v2.1/servers/5a8c0a8d-c872-4696-a060-3b5d2b6fe460 => generated 1685 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:19:38.803632 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-ce12f9a7-2255-451f-9e69-2f706466fa35 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:19:38.804592 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-ce12f9a7-2255-451f-9e69-2f706466fa35 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] [instance: 5a8c0a8d-c872-4696-a060-3b5d2b6fe460] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:19:38.807439 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:19:38.813946 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ce12f9a7-2255-451f-9e69-2f706466fa35 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:19:38.814540 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ce12f9a7-2255-451f-9e69-2f706466fa35 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:19:38.815454 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ce12f9a7-2255-451f-9e69-2f706466fa35 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:19:38.816388 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ce12f9a7-2255-451f-9e69-2f706466fa35 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:19:38.817057 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ce12f9a7-2255-451f-9e69-2f706466fa35 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:19:38.817700 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ce12f9a7-2255-451f-9e69-2f706466fa35 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:19:38.822245 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:19:38.967227 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-ce12f9a7-2255-451f-9e69-2f706466fa35 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a07aed22e5242308216005a51ee6e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afd506533304073a9f9d246eb7a4434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:19:38.981312 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-ce12f9a7-2255-451f-9e69-2f706466fa35 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] 10.222.0.58 "GET /compute/v2.1/servers/5a8c0a8d-c872-4696-a060-3b5d2b6fe460" status: 200 len: 1685 microversion: 2.1 time: 0.181485 Aug 11 00:19:38.982219 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3755/7301] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:19:38 2022] GET /compute/v2.1/servers/5a8c0a8d-c872-4696-a060-3b5d2b6fe460 => generated 1685 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:19:40.004513 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-11df4113-4603-418c-9195-89af883d9041 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:19:40.005157 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-11df4113-4603-418c-9195-89af883d9041 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] [instance: 5a8c0a8d-c872-4696-a060-3b5d2b6fe460] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:19:40.008999 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_api:SELECT=33 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:19:40.013751 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-11df4113-4603-418c-9195-89af883d9041 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:19:40.014241 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-11df4113-4603-418c-9195-89af883d9041 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:19:40.015283 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-11df4113-4603-418c-9195-89af883d9041 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:19:40.016146 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-11df4113-4603-418c-9195-89af883d9041 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:19:40.016681 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-11df4113-4603-418c-9195-89af883d9041 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:19:40.017162 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-11df4113-4603-418c-9195-89af883d9041 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:19:40.165886 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-11df4113-4603-418c-9195-89af883d9041 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a07aed22e5242308216005a51ee6e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afd506533304073a9f9d246eb7a4434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:19:40.174750 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-11df4113-4603-418c-9195-89af883d9041 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] 10.222.0.58 "GET /compute/v2.1/servers/5a8c0a8d-c872-4696-a060-3b5d2b6fe460" status: 200 len: 1685 microversion: 2.1 time: 0.174302 Aug 11 00:19:40.190393 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3547/7302] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:19:39 2022] GET /compute/v2.1/servers/5a8c0a8d-c872-4696-a060-3b5d2b6fe460 => generated 1685 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:19:41.198747 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-0f3ed095-7d92-4492-9e17-10bd1ebfe5ab tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:19:41.199518 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-0f3ed095-7d92-4492-9e17-10bd1ebfe5ab tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] [instance: 5a8c0a8d-c872-4696-a060-3b5d2b6fe460] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:19:41.208293 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0f3ed095-7d92-4492-9e17-10bd1ebfe5ab tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:19:41.208888 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0f3ed095-7d92-4492-9e17-10bd1ebfe5ab tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:19:41.209416 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0f3ed095-7d92-4492-9e17-10bd1ebfe5ab tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:19:41.210234 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0f3ed095-7d92-4492-9e17-10bd1ebfe5ab tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:19:41.211021 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0f3ed095-7d92-4492-9e17-10bd1ebfe5ab tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:19:41.211562 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-0f3ed095-7d92-4492-9e17-10bd1ebfe5ab tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:19:41.359734 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-0f3ed095-7d92-4492-9e17-10bd1ebfe5ab tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a07aed22e5242308216005a51ee6e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afd506533304073a9f9d246eb7a4434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:19:41.367968 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-0f3ed095-7d92-4492-9e17-10bd1ebfe5ab tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] 10.222.0.58 "GET /compute/v2.1/servers/5a8c0a8d-c872-4696-a060-3b5d2b6fe460" status: 200 len: 1685 microversion: 2.1 time: 0.175220 Aug 11 00:19:41.369043 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3756/7303] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:19:41 2022] GET /compute/v2.1/servers/5a8c0a8d-c872-4696-a060-3b5d2b6fe460 => generated 1685 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:19:42.403074 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-8a0d20d7-e791-4bb6-9831-b3c7cd5cf7d7 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:19:42.407183 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-8a0d20d7-e791-4bb6-9831-b3c7cd5cf7d7 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] [instance: 5a8c0a8d-c872-4696-a060-3b5d2b6fe460] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:19:42.425827 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8a0d20d7-e791-4bb6-9831-b3c7cd5cf7d7 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:19:42.426409 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8a0d20d7-e791-4bb6-9831-b3c7cd5cf7d7 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:19:42.427336 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8a0d20d7-e791-4bb6-9831-b3c7cd5cf7d7 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:19:42.428463 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8a0d20d7-e791-4bb6-9831-b3c7cd5cf7d7 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:19:42.429522 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8a0d20d7-e791-4bb6-9831-b3c7cd5cf7d7 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:19:42.430162 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8a0d20d7-e791-4bb6-9831-b3c7cd5cf7d7 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:19:42.584981 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-8a0d20d7-e791-4bb6-9831-b3c7cd5cf7d7 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a07aed22e5242308216005a51ee6e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afd506533304073a9f9d246eb7a4434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:19:42.593641 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-8a0d20d7-e791-4bb6-9831-b3c7cd5cf7d7 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] 10.222.0.58 "GET /compute/v2.1/servers/5a8c0a8d-c872-4696-a060-3b5d2b6fe460" status: 200 len: 1685 microversion: 2.1 time: 0.204123 Aug 11 00:19:42.596067 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3548/7304] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:19:42 2022] GET /compute/v2.1/servers/5a8c0a8d-c872-4696-a060-3b5d2b6fe460 => generated 1685 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:19:43.617855 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-f957e089-723a-47c0-84d3-c4ea89c53dbc tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:19:43.618667 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-f957e089-723a-47c0-84d3-c4ea89c53dbc tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] [instance: 5a8c0a8d-c872-4696-a060-3b5d2b6fe460] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:19:43.626169 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f957e089-723a-47c0-84d3-c4ea89c53dbc tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:19:43.626862 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f957e089-723a-47c0-84d3-c4ea89c53dbc tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:19:43.627439 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f957e089-723a-47c0-84d3-c4ea89c53dbc tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:19:43.628252 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f957e089-723a-47c0-84d3-c4ea89c53dbc tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:19:43.628754 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f957e089-723a-47c0-84d3-c4ea89c53dbc tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:19:43.629237 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f957e089-723a-47c0-84d3-c4ea89c53dbc tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:19:43.778828 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-f957e089-723a-47c0-84d3-c4ea89c53dbc tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a07aed22e5242308216005a51ee6e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afd506533304073a9f9d246eb7a4434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:19:43.786545 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-f957e089-723a-47c0-84d3-c4ea89c53dbc tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] 10.222.0.58 "GET /compute/v2.1/servers/5a8c0a8d-c872-4696-a060-3b5d2b6fe460" status: 200 len: 1685 microversion: 2.1 time: 0.173682 Aug 11 00:19:43.787227 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3757/7305] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:19:43 2022] GET /compute/v2.1/servers/5a8c0a8d-c872-4696-a060-3b5d2b6fe460 => generated 1685 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:19:44.809952 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-745bfae9-6e57-4b8c-a877-afce6070df7b tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:19:44.811362 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-745bfae9-6e57-4b8c-a877-afce6070df7b tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] [instance: 5a8c0a8d-c872-4696-a060-3b5d2b6fe460] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:19:44.821703 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-745bfae9-6e57-4b8c-a877-afce6070df7b tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:19:44.823468 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-745bfae9-6e57-4b8c-a877-afce6070df7b tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:19:44.824085 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-745bfae9-6e57-4b8c-a877-afce6070df7b tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:19:44.824970 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-745bfae9-6e57-4b8c-a877-afce6070df7b tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:19:44.825636 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-745bfae9-6e57-4b8c-a877-afce6070df7b tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:19:44.826064 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-745bfae9-6e57-4b8c-a877-afce6070df7b tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:19:44.980050 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-745bfae9-6e57-4b8c-a877-afce6070df7b tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a07aed22e5242308216005a51ee6e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afd506533304073a9f9d246eb7a4434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:19:44.987910 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-745bfae9-6e57-4b8c-a877-afce6070df7b tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] 10.222.0.58 "GET /compute/v2.1/servers/5a8c0a8d-c872-4696-a060-3b5d2b6fe460" status: 200 len: 1685 microversion: 2.1 time: 0.183220 Aug 11 00:19:44.988612 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3549/7306] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:19:44 2022] GET /compute/v2.1/servers/5a8c0a8d-c872-4696-a060-3b5d2b6fe460 => generated 1685 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:19:46.011233 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-3ebff540-1a75-4b34-9bec-2fc5a7a81111 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:19:46.012067 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-3ebff540-1a75-4b34-9bec-2fc5a7a81111 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] [instance: 5a8c0a8d-c872-4696-a060-3b5d2b6fe460] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:19:46.019661 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3ebff540-1a75-4b34-9bec-2fc5a7a81111 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:19:46.020165 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3ebff540-1a75-4b34-9bec-2fc5a7a81111 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:19:46.020619 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3ebff540-1a75-4b34-9bec-2fc5a7a81111 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:19:46.021377 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3ebff540-1a75-4b34-9bec-2fc5a7a81111 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:19:46.021813 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3ebff540-1a75-4b34-9bec-2fc5a7a81111 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:19:46.022275 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-3ebff540-1a75-4b34-9bec-2fc5a7a81111 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:19:46.158276 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-3ebff540-1a75-4b34-9bec-2fc5a7a81111 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a07aed22e5242308216005a51ee6e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afd506533304073a9f9d246eb7a4434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:19:46.166554 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-3ebff540-1a75-4b34-9bec-2fc5a7a81111 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] 10.222.0.58 "GET /compute/v2.1/servers/5a8c0a8d-c872-4696-a060-3b5d2b6fe460" status: 200 len: 1685 microversion: 2.1 time: 0.159329 Aug 11 00:19:46.167296 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3758/7307] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:19:46 2022] GET /compute/v2.1/servers/5a8c0a8d-c872-4696-a060-3b5d2b6fe460 => generated 1685 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:19:47.189282 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c66e9096-37d2-471e-8fa1-5c647639cd0b tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:19:47.189834 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-c66e9096-37d2-471e-8fa1-5c647639cd0b tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] [instance: 5a8c0a8d-c872-4696-a060-3b5d2b6fe460] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:19:47.196637 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c66e9096-37d2-471e-8fa1-5c647639cd0b tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:19:47.197123 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c66e9096-37d2-471e-8fa1-5c647639cd0b tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:19:47.198345 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c66e9096-37d2-471e-8fa1-5c647639cd0b tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:19:47.199004 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c66e9096-37d2-471e-8fa1-5c647639cd0b tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:19:47.199462 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c66e9096-37d2-471e-8fa1-5c647639cd0b tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:19:47.199888 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c66e9096-37d2-471e-8fa1-5c647639cd0b tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:19:47.332545 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-c66e9096-37d2-471e-8fa1-5c647639cd0b tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a07aed22e5242308216005a51ee6e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afd506533304073a9f9d246eb7a4434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:19:47.340448 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-c66e9096-37d2-471e-8fa1-5c647639cd0b tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] 10.222.0.58 "GET /compute/v2.1/servers/5a8c0a8d-c872-4696-a060-3b5d2b6fe460" status: 200 len: 1685 microversion: 2.1 time: 0.155164 Aug 11 00:19:47.341036 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3550/7308] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:19:47 2022] GET /compute/v2.1/servers/5a8c0a8d-c872-4696-a060-3b5d2b6fe460 => generated 1685 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:19:48.362137 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-52c7fc55-ebdb-4a01-a404-541aaa977fe1 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:19:48.362764 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-52c7fc55-ebdb-4a01-a404-541aaa977fe1 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] [instance: 5a8c0a8d-c872-4696-a060-3b5d2b6fe460] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:19:48.369801 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-52c7fc55-ebdb-4a01-a404-541aaa977fe1 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:19:48.370315 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-52c7fc55-ebdb-4a01-a404-541aaa977fe1 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:19:48.370771 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-52c7fc55-ebdb-4a01-a404-541aaa977fe1 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:19:48.371517 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-52c7fc55-ebdb-4a01-a404-541aaa977fe1 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:19:48.371983 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-52c7fc55-ebdb-4a01-a404-541aaa977fe1 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:19:48.372421 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-52c7fc55-ebdb-4a01-a404-541aaa977fe1 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:19:48.509346 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-52c7fc55-ebdb-4a01-a404-541aaa977fe1 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a07aed22e5242308216005a51ee6e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afd506533304073a9f9d246eb7a4434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:19:48.521320 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-52c7fc55-ebdb-4a01-a404-541aaa977fe1 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] 10.222.0.58 "GET /compute/v2.1/servers/5a8c0a8d-c872-4696-a060-3b5d2b6fe460" status: 200 len: 1685 microversion: 2.1 time: 0.162963 Aug 11 00:19:48.522114 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3759/7309] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:19:48 2022] GET /compute/v2.1/servers/5a8c0a8d-c872-4696-a060-3b5d2b6fe460 => generated 1685 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:19:49.543427 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-4b9be9be-8a00-4344-8143-314dfc21f6f6 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:19:49.544052 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-4b9be9be-8a00-4344-8143-314dfc21f6f6 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] [instance: 5a8c0a8d-c872-4696-a060-3b5d2b6fe460] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:19:49.550903 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4b9be9be-8a00-4344-8143-314dfc21f6f6 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:19:49.551389 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4b9be9be-8a00-4344-8143-314dfc21f6f6 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:19:49.551826 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4b9be9be-8a00-4344-8143-314dfc21f6f6 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:19:49.552531 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4b9be9be-8a00-4344-8143-314dfc21f6f6 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:19:49.552979 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4b9be9be-8a00-4344-8143-314dfc21f6f6 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:19:49.553404 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4b9be9be-8a00-4344-8143-314dfc21f6f6 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:19:49.695252 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-4b9be9be-8a00-4344-8143-314dfc21f6f6 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a07aed22e5242308216005a51ee6e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afd506533304073a9f9d246eb7a4434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:19:49.704336 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-4b9be9be-8a00-4344-8143-314dfc21f6f6 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] 10.222.0.58 "GET /compute/v2.1/servers/5a8c0a8d-c872-4696-a060-3b5d2b6fe460" status: 200 len: 1685 microversion: 2.1 time: 0.165487 Aug 11 00:19:49.708906 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3551/7310] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:19:49 2022] GET /compute/v2.1/servers/5a8c0a8d-c872-4696-a060-3b5d2b6fe460 => generated 1685 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:19:50.580561 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-f70d74f6-019d-4bc0-8a2f-727b4684d327 req-41d3151f-51ee-4fa3-841c-8c64f7f3e768 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a8c0a8d-c872-4696-a060-3b5d2b6fe460", "name": "network-vif-plugged", "status": "completed", "tag": "545bd480-5089-42ab-a9d8-8cf924136c0a"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 00:19:50.591700 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-f70d74f6-019d-4bc0-8a2f-727b4684d327 req-41d3151f-51ee-4fa3-841c-8c64f7f3e768 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:19:50.592206 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-f70d74f6-019d-4bc0-8a2f-727b4684d327 req-41d3151f-51ee-4fa3-841c-8c64f7f3e768 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:19:50.592655 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-f70d74f6-019d-4bc0-8a2f-727b4684d327 req-41d3151f-51ee-4fa3-841c-8c64f7f3e768 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:19:50.607280 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-f70d74f6-019d-4bc0-8a2f-727b4684d327 req-41d3151f-51ee-4fa3-841c-8c64f7f3e768 service nova] Creating event network-vif-plugged:545bd480-5089-42ab-a9d8-8cf924136c0a for instance 5a8c0a8d-c872-4696-a060-3b5d2b6fe460 on n-h2-850468-14 Aug 11 00:19:50.612659 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-f70d74f6-019d-4bc0-8a2f-727b4684d327 req-41d3151f-51ee-4fa3-841c-8c64f7f3e768 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035791 Aug 11 00:19:50.613274 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3760/7311] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 11 00:19:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 00:19:50.725810 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-1a0282f2-02b0-455b-aa65-05db61aa70d7 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:19:50.726418 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-1a0282f2-02b0-455b-aa65-05db61aa70d7 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] [instance: 5a8c0a8d-c872-4696-a060-3b5d2b6fe460] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:19:50.733867 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1a0282f2-02b0-455b-aa65-05db61aa70d7 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:19:50.734347 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1a0282f2-02b0-455b-aa65-05db61aa70d7 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:19:50.734793 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1a0282f2-02b0-455b-aa65-05db61aa70d7 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:19:50.735499 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1a0282f2-02b0-455b-aa65-05db61aa70d7 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:19:50.735949 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1a0282f2-02b0-455b-aa65-05db61aa70d7 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:19:50.736503 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-1a0282f2-02b0-455b-aa65-05db61aa70d7 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:19:50.873316 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-1a0282f2-02b0-455b-aa65-05db61aa70d7 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a07aed22e5242308216005a51ee6e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afd506533304073a9f9d246eb7a4434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:19:50.880897 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-1a0282f2-02b0-455b-aa65-05db61aa70d7 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] 10.222.0.58 "GET /compute/v2.1/servers/5a8c0a8d-c872-4696-a060-3b5d2b6fe460" status: 200 len: 1685 microversion: 2.1 time: 0.159217 Aug 11 00:19:50.881480 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3552/7312] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:19:50 2022] GET /compute/v2.1/servers/5a8c0a8d-c872-4696-a060-3b5d2b6fe460 => generated 1685 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:19:51.904906 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-d7405ea6-5175-4886-9d5f-2a288dc2e65e tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:19:51.905737 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-d7405ea6-5175-4886-9d5f-2a288dc2e65e tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] [instance: 5a8c0a8d-c872-4696-a060-3b5d2b6fe460] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:19:51.912622 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d7405ea6-5175-4886-9d5f-2a288dc2e65e tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:19:51.913118 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d7405ea6-5175-4886-9d5f-2a288dc2e65e tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:19:51.913602 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d7405ea6-5175-4886-9d5f-2a288dc2e65e tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:19:51.914317 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d7405ea6-5175-4886-9d5f-2a288dc2e65e tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:19:51.914811 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d7405ea6-5175-4886-9d5f-2a288dc2e65e tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:19:51.915256 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d7405ea6-5175-4886-9d5f-2a288dc2e65e tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:19:52.054811 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-d7405ea6-5175-4886-9d5f-2a288dc2e65e tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a07aed22e5242308216005a51ee6e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afd506533304073a9f9d246eb7a4434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:19:52.064584 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-d7405ea6-5175-4886-9d5f-2a288dc2e65e tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] 10.222.0.58 "GET /compute/v2.1/servers/5a8c0a8d-c872-4696-a060-3b5d2b6fe460" status: 200 len: 1685 microversion: 2.1 time: 0.164824 Aug 11 00:19:52.065174 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3761/7313] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:19:51 2022] GET /compute/v2.1/servers/5a8c0a8d-c872-4696-a060-3b5d2b6fe460 => generated 1685 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:19:53.086212 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-402536d6-8a40-4229-9227-d11045b6f0a0 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:19:53.086834 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-402536d6-8a40-4229-9227-d11045b6f0a0 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] [instance: 5a8c0a8d-c872-4696-a060-3b5d2b6fe460] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:19:53.094632 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-402536d6-8a40-4229-9227-d11045b6f0a0 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:19:53.095149 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-402536d6-8a40-4229-9227-d11045b6f0a0 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:19:53.095587 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-402536d6-8a40-4229-9227-d11045b6f0a0 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:19:53.096279 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-402536d6-8a40-4229-9227-d11045b6f0a0 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:19:53.096734 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-402536d6-8a40-4229-9227-d11045b6f0a0 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:19:53.097158 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-402536d6-8a40-4229-9227-d11045b6f0a0 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:19:53.227818 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-402536d6-8a40-4229-9227-d11045b6f0a0 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a07aed22e5242308216005a51ee6e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afd506533304073a9f9d246eb7a4434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:19:53.235645 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-402536d6-8a40-4229-9227-d11045b6f0a0 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] 10.222.0.58 "GET /compute/v2.1/servers/5a8c0a8d-c872-4696-a060-3b5d2b6fe460" status: 200 len: 1672 microversion: 2.1 time: 0.153376 Aug 11 00:19:53.236223 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3553/7314] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:19:53 2022] GET /compute/v2.1/servers/5a8c0a8d-c872-4696-a060-3b5d2b6fe460 => generated 1672 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:21:08.077847 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_api:SELECT=13 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:21:08.078544 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c0d74548-0d77-47e0-8144-035a2e7cf976 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:21:08.079051 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-c0d74548-0d77-47e0-8144-035a2e7cf976 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] [instance: 5a8c0a8d-c872-4696-a060-3b5d2b6fe460] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:21:08.079946 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=46 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:21:08.082195 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_api:SELECT=13 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:21:08.082893 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=37 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:21:08.084572 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-df2fe2e1-0306-48e5-9a52-576b4b2b0f53 req-091d1e6b-9e80-4936-87a0-4315cca6c17c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a8c0a8d-c872-4696-a060-3b5d2b6fe460", "tag": "545bd480-5089-42ab-a9d8-8cf924136c0a"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 00:21:08.088838 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c0d74548-0d77-47e0-8144-035a2e7cf976 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:21:08.089371 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c0d74548-0d77-47e0-8144-035a2e7cf976 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:21:08.089832 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c0d74548-0d77-47e0-8144-035a2e7cf976 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:21:08.091216 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c0d74548-0d77-47e0-8144-035a2e7cf976 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:21:08.091216 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c0d74548-0d77-47e0-8144-035a2e7cf976 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:21:08.091635 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c0d74548-0d77-47e0-8144-035a2e7cf976 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:21:08.096229 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-df2fe2e1-0306-48e5-9a52-576b4b2b0f53 req-091d1e6b-9e80-4936-87a0-4315cca6c17c service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:21:08.096720 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-df2fe2e1-0306-48e5-9a52-576b4b2b0f53 req-091d1e6b-9e80-4936-87a0-4315cca6c17c service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:21:08.098326 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-df2fe2e1-0306-48e5-9a52-576b4b2b0f53 req-091d1e6b-9e80-4936-87a0-4315cca6c17c service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:21:08.109188 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-df2fe2e1-0306-48e5-9a52-576b4b2b0f53 req-091d1e6b-9e80-4936-87a0-4315cca6c17c service nova] Creating event network-changed:545bd480-5089-42ab-a9d8-8cf924136c0a for instance 5a8c0a8d-c872-4696-a060-3b5d2b6fe460 on n-h2-850468-14 Aug 11 00:21:08.114600 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-df2fe2e1-0306-48e5-9a52-576b4b2b0f53 req-091d1e6b-9e80-4936-87a0-4315cca6c17c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039116 Aug 11 00:21:08.115447 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3554/7315] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 11 00:21:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 00:21:08.121300 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-c0d74548-0d77-47e0-8144-035a2e7cf976 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] [instance: 5a8c0a8d-c872-4696-a060-3b5d2b6fe460] Going to try to terminate instance {{(pid=122633) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 11 00:21:08.208840 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-c0d74548-0d77-47e0-8144-035a2e7cf976 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] 10.222.0.58 "DELETE /compute/v2.1/servers/5a8c0a8d-c872-4696-a060-3b5d2b6fe460" status: 204 len: 0 microversion: 2.1 time: 0.135180 Aug 11 00:21:08.209669 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3762/7316] 10.222.0.58 () {58 vars in 1239 bytes} [Thu Aug 11 00:21:08 2022] DELETE /compute/v2.1/servers/5a8c0a8d-c872-4696-a060-3b5d2b6fe460 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 11 00:21:08.219433 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-d13ed11f-d35e-4c08-9a6d-48ff6b5d5c40 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:21:08.220143 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-d13ed11f-d35e-4c08-9a6d-48ff6b5d5c40 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] [instance: 5a8c0a8d-c872-4696-a060-3b5d2b6fe460] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:21:08.226427 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d13ed11f-d35e-4c08-9a6d-48ff6b5d5c40 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:21:08.227476 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d13ed11f-d35e-4c08-9a6d-48ff6b5d5c40 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:21:08.227922 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d13ed11f-d35e-4c08-9a6d-48ff6b5d5c40 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:21:08.228641 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d13ed11f-d35e-4c08-9a6d-48ff6b5d5c40 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:21:08.229101 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d13ed11f-d35e-4c08-9a6d-48ff6b5d5c40 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:21:08.229530 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d13ed11f-d35e-4c08-9a6d-48ff6b5d5c40 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:21:08.434576 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-d13ed11f-d35e-4c08-9a6d-48ff6b5d5c40 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a07aed22e5242308216005a51ee6e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afd506533304073a9f9d246eb7a4434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:21:08.443628 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-d13ed11f-d35e-4c08-9a6d-48ff6b5d5c40 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] 10.222.0.58 "GET /compute/v2.1/servers/5a8c0a8d-c872-4696-a060-3b5d2b6fe460" status: 200 len: 1678 microversion: 2.1 time: 0.229308 Aug 11 00:21:08.444218 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3555/7317] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:21:08 2022] GET /compute/v2.1/servers/5a8c0a8d-c872-4696-a060-3b5d2b6fe460 => generated 1678 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 00:21:09.466480 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-d3570518-10e9-4e33-a54b-d1ed0f1a4c3d tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:21:09.467140 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-d3570518-10e9-4e33-a54b-d1ed0f1a4c3d tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] [instance: 5a8c0a8d-c872-4696-a060-3b5d2b6fe460] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:21:09.474350 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d3570518-10e9-4e33-a54b-d1ed0f1a4c3d tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:21:09.474882 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d3570518-10e9-4e33-a54b-d1ed0f1a4c3d tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:21:09.475374 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d3570518-10e9-4e33-a54b-d1ed0f1a4c3d tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:21:09.476095 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d3570518-10e9-4e33-a54b-d1ed0f1a4c3d tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:21:09.476568 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d3570518-10e9-4e33-a54b-d1ed0f1a4c3d tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:21:09.477013 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d3570518-10e9-4e33-a54b-d1ed0f1a4c3d tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:21:09.707932 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-d3570518-10e9-4e33-a54b-d1ed0f1a4c3d tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a07aed22e5242308216005a51ee6e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afd506533304073a9f9d246eb7a4434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:21:09.715678 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-d3570518-10e9-4e33-a54b-d1ed0f1a4c3d tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] 10.222.0.58 "GET /compute/v2.1/servers/5a8c0a8d-c872-4696-a060-3b5d2b6fe460" status: 200 len: 1678 microversion: 2.1 time: 0.253553 Aug 11 00:21:09.716262 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3763/7318] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:21:09 2022] GET /compute/v2.1/servers/5a8c0a8d-c872-4696-a060-3b5d2b6fe460 => generated 1678 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:21:10.199578 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-0d23c771-6f32-4876-8c79-3f016e4f3011 req-509e3581-bda4-4a0c-a1fa-e4416d7c8326 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a8c0a8d-c872-4696-a060-3b5d2b6fe460", "name": "network-vif-deleted", "tag": "545bd480-5089-42ab-a9d8-8cf924136c0a"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 00:21:10.212857 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-0d23c771-6f32-4876-8c79-3f016e4f3011 req-509e3581-bda4-4a0c-a1fa-e4416d7c8326 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:21:10.213344 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-0d23c771-6f32-4876-8c79-3f016e4f3011 req-509e3581-bda4-4a0c-a1fa-e4416d7c8326 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:21:10.213781 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-0d23c771-6f32-4876-8c79-3f016e4f3011 req-509e3581-bda4-4a0c-a1fa-e4416d7c8326 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:21:10.226251 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-0d23c771-6f32-4876-8c79-3f016e4f3011 req-509e3581-bda4-4a0c-a1fa-e4416d7c8326 service nova] Creating event network-vif-deleted:545bd480-5089-42ab-a9d8-8cf924136c0a for instance 5a8c0a8d-c872-4696-a060-3b5d2b6fe460 on n-h2-850468-14 Aug 11 00:21:10.231306 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-0d23c771-6f32-4876-8c79-3f016e4f3011 req-509e3581-bda4-4a0c-a1fa-e4416d7c8326 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035443 Aug 11 00:21:10.231913 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3556/7319] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 11 00:21:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 00:21:10.738274 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-59c22670-95db-435c-9b16-b48b01481bae tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:21:10.738864 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-59c22670-95db-435c-9b16-b48b01481bae tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] [instance: 5a8c0a8d-c872-4696-a060-3b5d2b6fe460] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:21:10.745557 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-59c22670-95db-435c-9b16-b48b01481bae tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:21:10.745962 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-59c22670-95db-435c-9b16-b48b01481bae tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:21:10.746961 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-59c22670-95db-435c-9b16-b48b01481bae tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:21:10.747971 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-59c22670-95db-435c-9b16-b48b01481bae tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:21:10.748666 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-59c22670-95db-435c-9b16-b48b01481bae tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:21:10.750177 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-59c22670-95db-435c-9b16-b48b01481bae tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:21:10.766848 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-59c22670-95db-435c-9b16-b48b01481bae tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] HTTP exception thrown: Instance 5a8c0a8d-c872-4696-a060-3b5d2b6fe460 could not be found. Aug 11 00:21:10.768515 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-59c22670-95db-435c-9b16-b48b01481bae tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Request method failure captured: Aug 11 00:21:10.768515 n-d-850468-14 devstack@n-api.service[122633]: request: GET /compute/v2.1/servers/5a8c0a8d-c872-4696-a060-3b5d2b6fe460 HTTP/1.1 Aug 11 00:21:10.768515 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 11 00:21:10.768515 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 11 00:21:10.768515 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 11 00:21:10.768515 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 11 00:21:10.768515 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 11 00:21:10.768515 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 11 00:21:10.768515 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 11 00:21:10.768515 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 11 00:21:10.768515 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9Ep2i-MnPdId4aaozRGou-ZKLfdCVEV7UMbPvLI743C1v2ZYSZjJ-wbtHC5kRJyMx5405ujgXPeGeqnYQm4bL8lU_AELXyOWEgm2tv41esiq__kqn4GwBgDuqOju8RV1GNbrWF9agyXy3IlAxm7NLGDoCP69cst8CrKBtWSFhLxZh24 Aug 11 00:21:10.768515 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 11 00:21:10.768515 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 11 00:21:10.768515 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 11 00:21:10.768515 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 11 00:21:10.768515 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 11 00:21:10.768515 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 11 00:21:10.768515 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 7afd506533304073a9f9d246eb7a4434 Aug 11 00:21:10.768515 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-TestShelveInstance-668600046 Aug 11 00:21:10.768515 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 11 00:21:10.768515 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 11 00:21:10.768515 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7afd506533304073a9f9d246eb7a4434"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7afd506533304073a9f9d246eb7a4434"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7afd506533304073a9f9d246eb7a4434"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7afd506533304073a9f9d246eb7a4434", "adminURL": "http://10.222.0.58:8080"}]}] Aug 11 00:21:10.768515 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-TestShelveInstance-668600046 Aug 11 00:21:10.768515 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 7afd506533304073a9f9d246eb7a4434 Aug 11 00:21:10.768515 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-TestShelveInstance-668600046 Aug 11 00:21:10.768515 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-TestShelveInstance-668600046-project Aug 11 00:21:10.768515 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 11 00:21:10.768515 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 11 00:21:10.768515 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 1a07aed22e5242308216005a51ee6e8b Aug 11 00:21:10.768515 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-TestShelveInstance-668600046-project Aug 11 00:21:10.768515 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 11 00:21:10.768515 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance 5a8c0a8d-c872-4696-a060-3b5d2b6fe460 could not be found. Aug 11 00:21:10.768515 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': '5a8c0a8d-c872-4696-a060-3b5d2b6fe460'} Aug 11 00:21:10.768515 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 00:21:10.768515 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 00:21:10.768515 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 11 00:21:10.768515 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 11 00:21:10.768515 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 11 00:21:10.768515 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 11 00:21:10.768515 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 11 00:21:10.768515 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 11 00:21:10.768515 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 11 00:21:10.768515 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 11 00:21:10.768515 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a8c0a8d-c872-4696-a060-3b5d2b6fe460 could not be found. Aug 11 00:21:10.768515 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 11 00:21:10.768515 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 00:21:10.768515 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 11 00:21:10.768515 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 00:21:10.768515 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 00:21:10.768515 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 00:21:10.768515 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 00:21:10.768515 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 00:21:10.768515 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 00:21:10.768515 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 00:21:10.768515 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 11 00:21:10.768515 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 11 00:21:10.768515 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 11 00:21:10.768515 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 11 00:21:10.768515 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 11 00:21:10.768515 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 11 00:21:10.768515 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a8c0a8d-c872-4696-a060-3b5d2b6fe460 could not be found. Aug 11 00:21:10.768515 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 11 00:21:10.768515 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 00:21:10.768515 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 11 00:21:10.773894 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 00:21:10.773894 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 00:21:10.773894 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 00:21:10.773894 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 00:21:10.773894 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 00:21:10.773894 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a8c0a8d-c872-4696-a060-3b5d2b6fe460 could not be found. Aug 11 00:21:10.773894 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 11 00:21:10.773894 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-59c22670-95db-435c-9b16-b48b01481bae tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Returning 404 to user: Instance 5a8c0a8d-c872-4696-a060-3b5d2b6fe460 could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 00:21:10.773894 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-59c22670-95db-435c-9b16-b48b01481bae tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] 10.222.0.58 "GET /compute/v2.1/servers/5a8c0a8d-c872-4696-a060-3b5d2b6fe460" status: 404 len: 111 microversion: 2.1 time: 0.036852 Aug 11 00:21:10.773894 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3764/7320] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:21:10 2022] GET /compute/v2.1/servers/5a8c0a8d-c872-4696-a060-3b5d2b6fe460 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 11 00:21:10.932679 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c4c483c3-6850-49d1-844c-17d266f64fa8 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Calling method '.version_select at 0x7f846faad160>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:21:10.955540 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-c4c483c3-6850-49d1-844c-17d266f64fa8 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-832978363" status: 202 len: 0 microversion: 2.1 time: 0.026967 Aug 11 00:21:10.956330 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3557/7321] 10.222.0.58 () {58 vars in 1251 bytes} [Thu Aug 11 00:21:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-832978363 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 11 00:21:10.979165 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-40fd6256-f504-4cb8-823d-05f76b378c5c tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Action: 'create', calling method: .version_select at 0x7f846c5c2670>, body: {"keypair": {"name": "tempest-TestShelveInstance-324195895", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIvr5Gx7GtPlGOn5R52fMnYbxLAzmF6pYO7uhpInIMdkdQJeEDHH6XLZc8WiT6X/rl6sdG2guZeWyM0cda1j+/JzMvzpIofjl/SWP5H8Ixpujc/6FQbo0SUBS3Vvczt4fg=="}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 00:21:10.994875 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-40fd6256-f504-4cb8-823d-05f76b378c5c tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Getting quotas for project 7afd506533304073a9f9d246eb7a4434. Resources: {'key_pairs'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 11 00:21:11.001554 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-40fd6256-f504-4cb8-823d-05f76b378c5c tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Getting quotas for user 1a07aed22e5242308216005a51ee6e8b and project 7afd506533304073a9f9d246eb7a4434. Resources: {'key_pairs'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 11 00:21:11.025775 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-40fd6256-f504-4cb8-823d-05f76b378c5c tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.050632 Aug 11 00:21:11.026382 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3765/7322] 10.222.0.58 () {60 vars in 1159 bytes} [Thu Aug 11 00:21:10 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 00:21:27.534773 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=10 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:21:27.535553 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:21:27.539776 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-fc6c7e0d-83e6-4bd4-937a-bdf576c61537 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1581567455", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-324195895", "security_groups": [{"name": "tempest-secgroup-smoke-271067085"}], "networks": [{"uuid": "0b47858f-ce64-4d13-b7ee-dd5e4a737f34"}], "block_device_mapping_v2": [{"uuid": "bbacfcaf-5857-4afd-9482-59dbe0fecf4e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 00:21:27.658314 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.network.neutron [None req-fc6c7e0d-83e6-4bd4-937a-bdf576c61537 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] validate_networks() for [('0b47858f-ce64-4d13-b7ee-dd5e4a737f34', None, None, None, None, None)] {{(pid=122632) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 11 00:21:28.070194 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-fc6c7e0d-83e6-4bd4-937a-bdf576c61537 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Flavor limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 11 00:21:28.070614 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-fc6c7e0d-83e6-4bd4-937a-bdf576c61537 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Image limits 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 11 00:21:28.071121 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-fc6c7e0d-83e6-4bd4-937a-bdf576c61537 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Flavor pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 11 00:21:28.071534 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-fc6c7e0d-83e6-4bd4-937a-bdf576c61537 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Image pref 0:0:0 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 11 00:21:28.071976 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.virt.hardware [None req-fc6c7e0d-83e6-4bd4-937a-bdf576c61537 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122632) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 11 00:21:28.081768 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fc6c7e0d-83e6-4bd4-937a-bdf576c61537 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:21:28.082251 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fc6c7e0d-83e6-4bd4-937a-bdf576c61537 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:21:28.082701 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fc6c7e0d-83e6-4bd4-937a-bdf576c61537 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:21:28.083469 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fc6c7e0d-83e6-4bd4-937a-bdf576c61537 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:21:28.083924 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fc6c7e0d-83e6-4bd4-937a-bdf576c61537 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:21:28.084355 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fc6c7e0d-83e6-4bd4-937a-bdf576c61537 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:21:28.101233 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-fc6c7e0d-83e6-4bd4-937a-bdf576c61537 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Getting quotas for project 7afd506533304073a9f9d246eb7a4434. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 11 00:21:28.106477 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-fc6c7e0d-83e6-4bd4-937a-bdf576c61537 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Getting quotas for user 1a07aed22e5242308216005a51ee6e8b and project 7afd506533304073a9f9d246eb7a4434. Resources: {'instances', 'cores', 'ram'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 11 00:21:28.165649 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-fc6c7e0d-83e6-4bd4-937a-bdf576c61537 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Going to run 1 instances... {{(pid=122632) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 11 00:21:28.167930 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-fc6c7e0d-83e6-4bd4-937a-bdf576c61537 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] [instance: 5d02b648-04d3-46cc-b51f-29c17f2d78ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='bbacfcaf-5857-4afd-9482-59dbe0fecf4e',volume_size=None,volume_type=None)] {{(pid=122632) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 11 00:21:28.299595 n-d-850468-14 devstack@n-api.service[122632]: ERROR oslo.messaging._drivers.impl_rabbit [None req-fc6c7e0d-83e6-4bd4-937a-bdf576c61537 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] [329ab1ee-3736-4e07-a1dd-a75ba01cbc3b] AMQP server on 10.222.0.58:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 11 00:21:29.307401 n-d-850468-14 devstack@n-api.service[122632]: INFO oslo.messaging._drivers.impl_rabbit [None req-fc6c7e0d-83e6-4bd4-937a-bdf576c61537 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] [329ab1ee-3736-4e07-a1dd-a75ba01cbc3b] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 41972. Aug 11 00:21:29.311735 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-fc6c7e0d-83e6-4bd4-937a-bdf576c61537 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.778900 Aug 11 00:21:29.312397 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3558/7323] 10.222.0.58 () {60 vars in 1147 bytes} [Thu Aug 11 00:21:27 2022] POST /compute/v2.1/servers => generated 405 bytes in 1781 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 11 00:21:29.321737 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:21:29.322523 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=4 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:21:29.323332 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:21:29.329452 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-217548ff-f66c-4541-81c2-354cf163cab1 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:21:29.331524 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-217548ff-f66c-4541-81c2-354cf163cab1 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] [instance: 5d02b648-04d3-46cc-b51f-29c17f2d78ef] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:21:29.392793 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-217548ff-f66c-4541-81c2-354cf163cab1 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a07aed22e5242308216005a51ee6e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afd506533304073a9f9d246eb7a4434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:21:29.399675 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-217548ff-f66c-4541-81c2-354cf163cab1 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] 10.222.0.58 "GET /compute/v2.1/servers/5d02b648-04d3-46cc-b51f-29c17f2d78ef" status: 200 len: 1088 microversion: 2.1 time: 0.080094 Aug 11 00:21:29.400252 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3766/7324] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:21:29 2022] GET /compute/v2.1/servers/5d02b648-04d3-46cc-b51f-29c17f2d78ef => generated 1088 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:21:30.422560 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-659157c5-6634-4340-b74b-23fa06036735 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:21:30.423699 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-659157c5-6634-4340-b74b-23fa06036735 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] [instance: 5d02b648-04d3-46cc-b51f-29c17f2d78ef] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:21:30.432010 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-659157c5-6634-4340-b74b-23fa06036735 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:21:30.433226 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-659157c5-6634-4340-b74b-23fa06036735 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:21:30.433690 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-659157c5-6634-4340-b74b-23fa06036735 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:21:30.434691 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-659157c5-6634-4340-b74b-23fa06036735 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:21:30.435184 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-659157c5-6634-4340-b74b-23fa06036735 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:21:30.435622 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-659157c5-6634-4340-b74b-23fa06036735 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:21:30.545793 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-659157c5-6634-4340-b74b-23fa06036735 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a07aed22e5242308216005a51ee6e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afd506533304073a9f9d246eb7a4434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:21:30.555604 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-659157c5-6634-4340-b74b-23fa06036735 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] 10.222.0.58 "GET /compute/v2.1/servers/5d02b648-04d3-46cc-b51f-29c17f2d78ef" status: 200 len: 1204 microversion: 2.1 time: 0.136924 Aug 11 00:21:30.566999 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3559/7325] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:21:30 2022] GET /compute/v2.1/servers/5d02b648-04d3-46cc-b51f-29c17f2d78ef => generated 1204 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 00:21:31.584617 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-d184b676-08e6-4d8c-8ab1-889179edc99c tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:21:31.585424 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-d184b676-08e6-4d8c-8ab1-889179edc99c tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] [instance: 5d02b648-04d3-46cc-b51f-29c17f2d78ef] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:21:31.593516 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d184b676-08e6-4d8c-8ab1-889179edc99c tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:21:31.594440 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d184b676-08e6-4d8c-8ab1-889179edc99c tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:21:31.594906 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d184b676-08e6-4d8c-8ab1-889179edc99c tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:21:31.596027 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d184b676-08e6-4d8c-8ab1-889179edc99c tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:21:31.596653 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d184b676-08e6-4d8c-8ab1-889179edc99c tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:21:31.597265 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d184b676-08e6-4d8c-8ab1-889179edc99c tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:21:31.747975 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-d184b676-08e6-4d8c-8ab1-889179edc99c tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a07aed22e5242308216005a51ee6e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afd506533304073a9f9d246eb7a4434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:21:31.756992 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-005db9f4-e480-41c3-b958-f57eaee1ab9d req-fff585f7-038c-4c70-a74f-89fa5eabd862 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d02b648-04d3-46cc-b51f-29c17f2d78ef", "tag": "8a646732-28ad-4f68-bcd9-d4be9c313732"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 00:21:31.776211 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-d184b676-08e6-4d8c-8ab1-889179edc99c tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] 10.222.0.58 "GET /compute/v2.1/servers/5d02b648-04d3-46cc-b51f-29c17f2d78ef" status: 200 len: 1271 microversion: 2.1 time: 0.197541 Aug 11 00:21:31.776811 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3767/7326] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:21:31 2022] GET /compute/v2.1/servers/5d02b648-04d3-46cc-b51f-29c17f2d78ef => generated 1271 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:21:31.777522 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-005db9f4-e480-41c3-b958-f57eaee1ab9d req-fff585f7-038c-4c70-a74f-89fa5eabd862 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:21:31.778249 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-005db9f4-e480-41c3-b958-f57eaee1ab9d req-fff585f7-038c-4c70-a74f-89fa5eabd862 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:21:31.778938 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-005db9f4-e480-41c3-b958-f57eaee1ab9d req-fff585f7-038c-4c70-a74f-89fa5eabd862 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:21:31.793189 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-005db9f4-e480-41c3-b958-f57eaee1ab9d req-fff585f7-038c-4c70-a74f-89fa5eabd862 service nova] Creating event network-changed:8a646732-28ad-4f68-bcd9-d4be9c313732 for instance 5d02b648-04d3-46cc-b51f-29c17f2d78ef on n-h1-850468-14 Aug 11 00:21:31.800351 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-005db9f4-e480-41c3-b958-f57eaee1ab9d req-fff585f7-038c-4c70-a74f-89fa5eabd862 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049002 Aug 11 00:21:31.801279 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3560/7327] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 11 00:21:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 00:21:32.798720 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-63188a21-95fe-4f4a-96e9-4e49300e11d1 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:21:32.800206 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-63188a21-95fe-4f4a-96e9-4e49300e11d1 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] [instance: 5d02b648-04d3-46cc-b51f-29c17f2d78ef] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:21:32.807889 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-63188a21-95fe-4f4a-96e9-4e49300e11d1 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:21:32.808401 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-63188a21-95fe-4f4a-96e9-4e49300e11d1 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:21:32.808862 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-63188a21-95fe-4f4a-96e9-4e49300e11d1 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:21:32.809617 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-63188a21-95fe-4f4a-96e9-4e49300e11d1 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:21:32.810096 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-63188a21-95fe-4f4a-96e9-4e49300e11d1 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:21:32.810545 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-63188a21-95fe-4f4a-96e9-4e49300e11d1 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:21:32.960508 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-63188a21-95fe-4f4a-96e9-4e49300e11d1 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a07aed22e5242308216005a51ee6e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afd506533304073a9f9d246eb7a4434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:21:32.969048 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-63188a21-95fe-4f4a-96e9-4e49300e11d1 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] 10.222.0.58 "GET /compute/v2.1/servers/5d02b648-04d3-46cc-b51f-29c17f2d78ef" status: 200 len: 1271 microversion: 2.1 time: 0.175217 Aug 11 00:21:32.970418 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3768/7328] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:21:32 2022] GET /compute/v2.1/servers/5d02b648-04d3-46cc-b51f-29c17f2d78ef => generated 1271 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:21:33.992836 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-7a056925-e510-4fd4-b782-21552807b55a tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:21:33.993565 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-7a056925-e510-4fd4-b782-21552807b55a tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] [instance: 5d02b648-04d3-46cc-b51f-29c17f2d78ef] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:21:34.000373 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7a056925-e510-4fd4-b782-21552807b55a tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:21:34.000856 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7a056925-e510-4fd4-b782-21552807b55a tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:21:34.001299 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7a056925-e510-4fd4-b782-21552807b55a tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:21:34.001987 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7a056925-e510-4fd4-b782-21552807b55a tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:21:34.002437 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7a056925-e510-4fd4-b782-21552807b55a tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:21:34.002886 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-7a056925-e510-4fd4-b782-21552807b55a tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:21:34.153799 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-7a056925-e510-4fd4-b782-21552807b55a tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a07aed22e5242308216005a51ee6e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afd506533304073a9f9d246eb7a4434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:21:34.162757 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-7a056925-e510-4fd4-b782-21552807b55a tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] 10.222.0.58 "GET /compute/v2.1/servers/5d02b648-04d3-46cc-b51f-29c17f2d78ef" status: 200 len: 1271 microversion: 2.1 time: 0.175023 Aug 11 00:21:34.163359 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3561/7329] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:21:33 2022] GET /compute/v2.1/servers/5d02b648-04d3-46cc-b51f-29c17f2d78ef => generated 1271 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:21:35.184911 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-829d8c74-515a-49b6-8f2b-ff44012dd471 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:21:35.185441 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-829d8c74-515a-49b6-8f2b-ff44012dd471 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] [instance: 5d02b648-04d3-46cc-b51f-29c17f2d78ef] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:21:35.193682 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-829d8c74-515a-49b6-8f2b-ff44012dd471 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:21:35.194188 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-829d8c74-515a-49b6-8f2b-ff44012dd471 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:21:35.194654 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-829d8c74-515a-49b6-8f2b-ff44012dd471 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:21:35.195398 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-829d8c74-515a-49b6-8f2b-ff44012dd471 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:21:35.195868 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-829d8c74-515a-49b6-8f2b-ff44012dd471 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:21:35.196336 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-829d8c74-515a-49b6-8f2b-ff44012dd471 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:21:35.344511 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-829d8c74-515a-49b6-8f2b-ff44012dd471 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a07aed22e5242308216005a51ee6e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afd506533304073a9f9d246eb7a4434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:21:35.352574 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-829d8c74-515a-49b6-8f2b-ff44012dd471 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] 10.222.0.58 "GET /compute/v2.1/servers/5d02b648-04d3-46cc-b51f-29c17f2d78ef" status: 200 len: 1271 microversion: 2.1 time: 0.171676 Aug 11 00:21:35.353164 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3769/7330] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:21:35 2022] GET /compute/v2.1/servers/5d02b648-04d3-46cc-b51f-29c17f2d78ef => generated 1271 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:21:36.375728 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-e63190c2-b03b-4221-9382-9e3e21437d3d tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:21:36.376432 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-e63190c2-b03b-4221-9382-9e3e21437d3d tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] [instance: 5d02b648-04d3-46cc-b51f-29c17f2d78ef] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:21:36.383312 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e63190c2-b03b-4221-9382-9e3e21437d3d tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:21:36.383803 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e63190c2-b03b-4221-9382-9e3e21437d3d tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:21:36.384248 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e63190c2-b03b-4221-9382-9e3e21437d3d tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:21:36.385022 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e63190c2-b03b-4221-9382-9e3e21437d3d tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:21:36.385478 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e63190c2-b03b-4221-9382-9e3e21437d3d tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:21:36.385908 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e63190c2-b03b-4221-9382-9e3e21437d3d tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:21:36.526029 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-e63190c2-b03b-4221-9382-9e3e21437d3d tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a07aed22e5242308216005a51ee6e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afd506533304073a9f9d246eb7a4434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:21:36.533629 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-e63190c2-b03b-4221-9382-9e3e21437d3d tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] 10.222.0.58 "GET /compute/v2.1/servers/5d02b648-04d3-46cc-b51f-29c17f2d78ef" status: 200 len: 1259 microversion: 2.1 time: 0.162320 Aug 11 00:21:36.534206 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3562/7331] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:21:36 2022] GET /compute/v2.1/servers/5d02b648-04d3-46cc-b51f-29c17f2d78ef => generated 1259 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:21:37.555197 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-285e52cf-ba58-453a-9074-9b012bf91c78 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:21:37.555831 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-285e52cf-ba58-453a-9074-9b012bf91c78 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] [instance: 5d02b648-04d3-46cc-b51f-29c17f2d78ef] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:21:37.562750 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-285e52cf-ba58-453a-9074-9b012bf91c78 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:21:37.563941 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-285e52cf-ba58-453a-9074-9b012bf91c78 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:21:37.564434 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-285e52cf-ba58-453a-9074-9b012bf91c78 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:21:37.565155 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-285e52cf-ba58-453a-9074-9b012bf91c78 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:21:37.565631 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-285e52cf-ba58-453a-9074-9b012bf91c78 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:21:37.566077 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-285e52cf-ba58-453a-9074-9b012bf91c78 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:21:37.702492 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-285e52cf-ba58-453a-9074-9b012bf91c78 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a07aed22e5242308216005a51ee6e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afd506533304073a9f9d246eb7a4434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:21:37.710193 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-285e52cf-ba58-453a-9074-9b012bf91c78 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] 10.222.0.58 "GET /compute/v2.1/servers/5d02b648-04d3-46cc-b51f-29c17f2d78ef" status: 200 len: 1259 microversion: 2.1 time: 0.158953 Aug 11 00:21:37.710773 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3770/7332] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:21:37 2022] GET /compute/v2.1/servers/5d02b648-04d3-46cc-b51f-29c17f2d78ef => generated 1259 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:21:38.731988 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-cefe076f-d631-4bc3-885f-abddc745bdc2 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:21:38.732540 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-cefe076f-d631-4bc3-885f-abddc745bdc2 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] [instance: 5d02b648-04d3-46cc-b51f-29c17f2d78ef] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:21:38.736263 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=2 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:21:38.736936 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=6 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:21:38.742626 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cefe076f-d631-4bc3-885f-abddc745bdc2 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:21:38.743137 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cefe076f-d631-4bc3-885f-abddc745bdc2 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:21:38.743579 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cefe076f-d631-4bc3-885f-abddc745bdc2 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:21:38.744268 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cefe076f-d631-4bc3-885f-abddc745bdc2 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:21:38.744718 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cefe076f-d631-4bc3-885f-abddc745bdc2 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:21:38.745140 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-cefe076f-d631-4bc3-885f-abddc745bdc2 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:21:38.879815 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-cefe076f-d631-4bc3-885f-abddc745bdc2 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a07aed22e5242308216005a51ee6e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afd506533304073a9f9d246eb7a4434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:21:38.887351 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-cefe076f-d631-4bc3-885f-abddc745bdc2 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] 10.222.0.58 "GET /compute/v2.1/servers/5d02b648-04d3-46cc-b51f-29c17f2d78ef" status: 200 len: 1259 microversion: 2.1 time: 0.159389 Aug 11 00:21:38.887941 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3563/7333] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:21:38 2022] GET /compute/v2.1/servers/5d02b648-04d3-46cc-b51f-29c17f2d78ef => generated 1259 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:21:39.908797 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-ebb713ab-504e-47ea-a688-7815e7cc7582 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:21:39.909422 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-ebb713ab-504e-47ea-a688-7815e7cc7582 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] [instance: 5d02b648-04d3-46cc-b51f-29c17f2d78ef] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:21:39.912194 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=2 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:21:39.917683 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ebb713ab-504e-47ea-a688-7815e7cc7582 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:21:39.918179 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ebb713ab-504e-47ea-a688-7815e7cc7582 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:21:39.918629 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ebb713ab-504e-47ea-a688-7815e7cc7582 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:21:39.919361 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ebb713ab-504e-47ea-a688-7815e7cc7582 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:21:39.919829 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ebb713ab-504e-47ea-a688-7815e7cc7582 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:21:39.920269 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ebb713ab-504e-47ea-a688-7815e7cc7582 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:21:40.057446 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-ebb713ab-504e-47ea-a688-7815e7cc7582 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a07aed22e5242308216005a51ee6e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afd506533304073a9f9d246eb7a4434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:21:40.065969 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-ebb713ab-504e-47ea-a688-7815e7cc7582 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] 10.222.0.58 "GET /compute/v2.1/servers/5d02b648-04d3-46cc-b51f-29c17f2d78ef" status: 200 len: 1259 microversion: 2.1 time: 0.161323 Aug 11 00:21:40.066872 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3771/7334] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:21:39 2022] GET /compute/v2.1/servers/5d02b648-04d3-46cc-b51f-29c17f2d78ef => generated 1259 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:21:41.087722 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-2458364c-adcc-40eb-9ba4-8d8eb5dc980b tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:21:41.088337 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-2458364c-adcc-40eb-9ba4-8d8eb5dc980b tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] [instance: 5d02b648-04d3-46cc-b51f-29c17f2d78ef] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:21:41.095597 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2458364c-adcc-40eb-9ba4-8d8eb5dc980b tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:21:41.096085 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2458364c-adcc-40eb-9ba4-8d8eb5dc980b tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:21:41.096525 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2458364c-adcc-40eb-9ba4-8d8eb5dc980b tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:21:41.097223 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2458364c-adcc-40eb-9ba4-8d8eb5dc980b tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:21:41.097679 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2458364c-adcc-40eb-9ba4-8d8eb5dc980b tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:21:41.098108 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-2458364c-adcc-40eb-9ba4-8d8eb5dc980b tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:21:41.233816 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-2458364c-adcc-40eb-9ba4-8d8eb5dc980b tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a07aed22e5242308216005a51ee6e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afd506533304073a9f9d246eb7a4434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:21:41.242022 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-2458364c-adcc-40eb-9ba4-8d8eb5dc980b tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] 10.222.0.58 "GET /compute/v2.1/servers/5d02b648-04d3-46cc-b51f-29c17f2d78ef" status: 200 len: 1259 microversion: 2.1 time: 0.158540 Aug 11 00:21:41.242599 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3564/7335] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:21:41 2022] GET /compute/v2.1/servers/5d02b648-04d3-46cc-b51f-29c17f2d78ef => generated 1259 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 00:21:42.263956 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-50796442-7196-4915-a609-24bc20c6ef2d tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:21:42.264581 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-50796442-7196-4915-a609-24bc20c6ef2d tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] [instance: 5d02b648-04d3-46cc-b51f-29c17f2d78ef] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:21:42.271249 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-50796442-7196-4915-a609-24bc20c6ef2d tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:21:42.271744 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-50796442-7196-4915-a609-24bc20c6ef2d tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:21:42.272195 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-50796442-7196-4915-a609-24bc20c6ef2d tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:21:42.272902 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-50796442-7196-4915-a609-24bc20c6ef2d tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:21:42.273372 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-50796442-7196-4915-a609-24bc20c6ef2d tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:21:42.273809 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-50796442-7196-4915-a609-24bc20c6ef2d tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:21:42.407879 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-50796442-7196-4915-a609-24bc20c6ef2d tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a07aed22e5242308216005a51ee6e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afd506533304073a9f9d246eb7a4434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:21:42.415505 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-50796442-7196-4915-a609-24bc20c6ef2d tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] 10.222.0.58 "GET /compute/v2.1/servers/5d02b648-04d3-46cc-b51f-29c17f2d78ef" status: 200 len: 1259 microversion: 2.1 time: 0.155763 Aug 11 00:21:42.416088 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3772/7336] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:21:42 2022] GET /compute/v2.1/servers/5d02b648-04d3-46cc-b51f-29c17f2d78ef => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:21:43.437146 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-0d83d821-fa6f-4cec-8491-a6f78af1e108 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:21:43.438560 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-0d83d821-fa6f-4cec-8491-a6f78af1e108 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] [instance: 5d02b648-04d3-46cc-b51f-29c17f2d78ef] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:21:43.445639 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0d83d821-fa6f-4cec-8491-a6f78af1e108 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:21:43.446129 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0d83d821-fa6f-4cec-8491-a6f78af1e108 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:21:43.446575 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0d83d821-fa6f-4cec-8491-a6f78af1e108 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:21:43.447303 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0d83d821-fa6f-4cec-8491-a6f78af1e108 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:21:43.447763 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0d83d821-fa6f-4cec-8491-a6f78af1e108 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:21:43.448189 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0d83d821-fa6f-4cec-8491-a6f78af1e108 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:21:43.583891 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-0d83d821-fa6f-4cec-8491-a6f78af1e108 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a07aed22e5242308216005a51ee6e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afd506533304073a9f9d246eb7a4434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:21:43.591728 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-0d83d821-fa6f-4cec-8491-a6f78af1e108 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] 10.222.0.58 "GET /compute/v2.1/servers/5d02b648-04d3-46cc-b51f-29c17f2d78ef" status: 200 len: 1259 microversion: 2.1 time: 0.158555 Aug 11 00:21:43.592295 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3565/7337] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:21:43 2022] GET /compute/v2.1/servers/5d02b648-04d3-46cc-b51f-29c17f2d78ef => generated 1259 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:21:44.613548 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-49fc0da0-3103-4e2c-b373-c1c18a7a96ad tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:21:44.614168 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-49fc0da0-3103-4e2c-b373-c1c18a7a96ad tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] [instance: 5d02b648-04d3-46cc-b51f-29c17f2d78ef] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:21:44.620972 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-49fc0da0-3103-4e2c-b373-c1c18a7a96ad tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:21:44.621458 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-49fc0da0-3103-4e2c-b373-c1c18a7a96ad tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:21:44.621903 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-49fc0da0-3103-4e2c-b373-c1c18a7a96ad tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:21:44.622598 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-49fc0da0-3103-4e2c-b373-c1c18a7a96ad tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:21:44.623084 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-49fc0da0-3103-4e2c-b373-c1c18a7a96ad tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:21:44.623516 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-49fc0da0-3103-4e2c-b373-c1c18a7a96ad tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:21:44.769165 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-49fc0da0-3103-4e2c-b373-c1c18a7a96ad tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a07aed22e5242308216005a51ee6e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afd506533304073a9f9d246eb7a4434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:21:44.782220 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-49fc0da0-3103-4e2c-b373-c1c18a7a96ad tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] 10.222.0.58 "GET /compute/v2.1/servers/5d02b648-04d3-46cc-b51f-29c17f2d78ef" status: 200 len: 1259 microversion: 2.1 time: 0.172948 Aug 11 00:21:44.782846 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3773/7338] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:21:44 2022] GET /compute/v2.1/servers/5d02b648-04d3-46cc-b51f-29c17f2d78ef => generated 1259 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:21:45.803395 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-b594d1a5-b71c-467d-bcf3-42cab5e1fad4 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:21:45.804003 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-b594d1a5-b71c-467d-bcf3-42cab5e1fad4 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] [instance: 5d02b648-04d3-46cc-b51f-29c17f2d78ef] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:21:45.810889 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b594d1a5-b71c-467d-bcf3-42cab5e1fad4 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:21:45.811395 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b594d1a5-b71c-467d-bcf3-42cab5e1fad4 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:21:45.811829 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b594d1a5-b71c-467d-bcf3-42cab5e1fad4 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:21:45.812514 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b594d1a5-b71c-467d-bcf3-42cab5e1fad4 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:21:45.813649 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b594d1a5-b71c-467d-bcf3-42cab5e1fad4 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:21:45.814078 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b594d1a5-b71c-467d-bcf3-42cab5e1fad4 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:21:45.950116 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-b594d1a5-b71c-467d-bcf3-42cab5e1fad4 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a07aed22e5242308216005a51ee6e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afd506533304073a9f9d246eb7a4434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:21:45.958920 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-b594d1a5-b71c-467d-bcf3-42cab5e1fad4 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] 10.222.0.58 "GET /compute/v2.1/servers/5d02b648-04d3-46cc-b51f-29c17f2d78ef" status: 200 len: 1259 microversion: 2.1 time: 0.159411 Aug 11 00:21:45.959509 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3566/7339] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:21:45 2022] GET /compute/v2.1/servers/5d02b648-04d3-46cc-b51f-29c17f2d78ef => generated 1259 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:21:46.808910 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-9629f7ce-4fe5-4e6e-965c-17a87e7992a0 req-5336cd89-9684-40bb-91cf-3366cddd10e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d02b648-04d3-46cc-b51f-29c17f2d78ef", "name": "network-vif-plugged", "status": "completed", "tag": "8a646732-28ad-4f68-bcd9-d4be9c313732"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 00:21:46.819981 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-9629f7ce-4fe5-4e6e-965c-17a87e7992a0 req-5336cd89-9684-40bb-91cf-3366cddd10e7 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:21:46.820547 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-9629f7ce-4fe5-4e6e-965c-17a87e7992a0 req-5336cd89-9684-40bb-91cf-3366cddd10e7 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:21:46.820999 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-9629f7ce-4fe5-4e6e-965c-17a87e7992a0 req-5336cd89-9684-40bb-91cf-3366cddd10e7 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:21:46.833230 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-9629f7ce-4fe5-4e6e-965c-17a87e7992a0 req-5336cd89-9684-40bb-91cf-3366cddd10e7 service nova] Creating event network-vif-plugged:8a646732-28ad-4f68-bcd9-d4be9c313732 for instance 5d02b648-04d3-46cc-b51f-29c17f2d78ef on n-h1-850468-14 Aug 11 00:21:46.838248 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-9629f7ce-4fe5-4e6e-965c-17a87e7992a0 req-5336cd89-9684-40bb-91cf-3366cddd10e7 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033140 Aug 11 00:21:46.838932 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3774/7340] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 11 00:21:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 00:21:46.979878 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-efa54ccc-642b-410f-91cd-9b68e7260af1 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:21:46.980627 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-efa54ccc-642b-410f-91cd-9b68e7260af1 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] [instance: 5d02b648-04d3-46cc-b51f-29c17f2d78ef] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:21:46.988567 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-efa54ccc-642b-410f-91cd-9b68e7260af1 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:21:46.989060 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-efa54ccc-642b-410f-91cd-9b68e7260af1 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:21:46.989505 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-efa54ccc-642b-410f-91cd-9b68e7260af1 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:21:46.990213 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-efa54ccc-642b-410f-91cd-9b68e7260af1 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:21:46.990667 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-efa54ccc-642b-410f-91cd-9b68e7260af1 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:21:46.991140 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-efa54ccc-642b-410f-91cd-9b68e7260af1 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:21:47.123922 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-efa54ccc-642b-410f-91cd-9b68e7260af1 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a07aed22e5242308216005a51ee6e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afd506533304073a9f9d246eb7a4434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:21:47.132369 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-efa54ccc-642b-410f-91cd-9b68e7260af1 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] 10.222.0.58 "GET /compute/v2.1/servers/5d02b648-04d3-46cc-b51f-29c17f2d78ef" status: 200 len: 1259 microversion: 2.1 time: 0.156317 Aug 11 00:21:47.132949 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3567/7341] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:21:46 2022] GET /compute/v2.1/servers/5d02b648-04d3-46cc-b51f-29c17f2d78ef => generated 1259 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:21:48.155515 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-6e0f5d09-ae53-4cf2-b133-9d9f86c5b117 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:21:48.156230 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-6e0f5d09-ae53-4cf2-b133-9d9f86c5b117 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] [instance: 5d02b648-04d3-46cc-b51f-29c17f2d78ef] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:21:48.163752 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6e0f5d09-ae53-4cf2-b133-9d9f86c5b117 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:21:48.164192 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6e0f5d09-ae53-4cf2-b133-9d9f86c5b117 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:21:48.164644 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6e0f5d09-ae53-4cf2-b133-9d9f86c5b117 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:21:48.165373 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6e0f5d09-ae53-4cf2-b133-9d9f86c5b117 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:21:48.165830 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6e0f5d09-ae53-4cf2-b133-9d9f86c5b117 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:21:48.166268 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-6e0f5d09-ae53-4cf2-b133-9d9f86c5b117 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:21:48.303135 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-6e0f5d09-ae53-4cf2-b133-9d9f86c5b117 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a07aed22e5242308216005a51ee6e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afd506533304073a9f9d246eb7a4434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:21:48.310821 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-6e0f5d09-ae53-4cf2-b133-9d9f86c5b117 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] 10.222.0.58 "GET /compute/v2.1/servers/5d02b648-04d3-46cc-b51f-29c17f2d78ef" status: 200 len: 1443 microversion: 2.1 time: 0.160786 Aug 11 00:21:48.311402 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3775/7342] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:21:48 2022] GET /compute/v2.1/servers/5d02b648-04d3-46cc-b51f-29c17f2d78ef => generated 1443 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:21:48.332712 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c58075ff-712a-41e7-a12a-0edc7c46c124 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:21:48.333331 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-c58075ff-712a-41e7-a12a-0edc7c46c124 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] [instance: 5d02b648-04d3-46cc-b51f-29c17f2d78ef] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:21:48.340223 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c58075ff-712a-41e7-a12a-0edc7c46c124 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:21:48.340712 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c58075ff-712a-41e7-a12a-0edc7c46c124 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:21:48.341153 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c58075ff-712a-41e7-a12a-0edc7c46c124 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:21:48.341852 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c58075ff-712a-41e7-a12a-0edc7c46c124 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:21:48.342308 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c58075ff-712a-41e7-a12a-0edc7c46c124 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:21:48.342733 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c58075ff-712a-41e7-a12a-0edc7c46c124 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:21:48.478556 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-c58075ff-712a-41e7-a12a-0edc7c46c124 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a07aed22e5242308216005a51ee6e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afd506533304073a9f9d246eb7a4434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:21:48.486748 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-c58075ff-712a-41e7-a12a-0edc7c46c124 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] 10.222.0.58 "GET /compute/v2.1/servers/5d02b648-04d3-46cc-b51f-29c17f2d78ef" status: 200 len: 1443 microversion: 2.1 time: 0.158729 Aug 11 00:21:48.487357 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3568/7343] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:21:48 2022] GET /compute/v2.1/servers/5d02b648-04d3-46cc-b51f-29c17f2d78ef => generated 1443 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 00:21:50.447508 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-6c278fbe-5df8-4dcd-87d1-3e48146546ef req-0fb1114a-3444-42bf-a2b6-71dce52d22e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d02b648-04d3-46cc-b51f-29c17f2d78ef", "tag": "8a646732-28ad-4f68-bcd9-d4be9c313732"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 00:21:50.458742 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-6c278fbe-5df8-4dcd-87d1-3e48146546ef req-0fb1114a-3444-42bf-a2b6-71dce52d22e8 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:21:50.459272 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-6c278fbe-5df8-4dcd-87d1-3e48146546ef req-0fb1114a-3444-42bf-a2b6-71dce52d22e8 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:21:50.459722 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-6c278fbe-5df8-4dcd-87d1-3e48146546ef req-0fb1114a-3444-42bf-a2b6-71dce52d22e8 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:21:50.471154 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-6c278fbe-5df8-4dcd-87d1-3e48146546ef req-0fb1114a-3444-42bf-a2b6-71dce52d22e8 service nova] Creating event network-changed:8a646732-28ad-4f68-bcd9-d4be9c313732 for instance 5d02b648-04d3-46cc-b51f-29c17f2d78ef on n-h1-850468-14 Aug 11 00:21:50.476370 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-6c278fbe-5df8-4dcd-87d1-3e48146546ef req-0fb1114a-3444-42bf-a2b6-71dce52d22e8 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032562 Aug 11 00:21:50.477182 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3776/7344] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 11 00:21:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 00:22:08.650434 n-d-850468-14 devstack@n-api.service[122633]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 11 00:22:08.651139 n-d-850468-14 devstack@n-api.service[122633]: Thu Aug 11 00:22:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 11 00:23:46.744686 n-d-850468-14 devstack@n-api.service[122632]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cd3f72be-c5dc-40c0-bc95-e9b4d1b700e4] AMQP server on 10.222.0.58:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 11 00:23:46.745541 n-d-850468-14 devstack@n-api.service[122632]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6aef4e7e-e576-4aec-8e05-1d4d3b8b22c0] AMQP server on 10.222.0.58:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 11 00:23:46.746141 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:23:46.746934 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=58 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:23:46.798763 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-11999dbb-4275-44aa-9882-44deb28316b0 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 00:23:46.799481 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-11999dbb-4275-44aa-9882-44deb28316b0 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] [instance: 5d02b648-04d3-46cc-b51f-29c17f2d78ef] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:23:46.805881 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-11999dbb-4275-44aa-9882-44deb28316b0 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:23:46.806371 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-11999dbb-4275-44aa-9882-44deb28316b0 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:23:46.806833 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-11999dbb-4275-44aa-9882-44deb28316b0 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:23:46.807665 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-11999dbb-4275-44aa-9882-44deb28316b0 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:23:46.808236 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-11999dbb-4275-44aa-9882-44deb28316b0 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:23:46.808674 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-11999dbb-4275-44aa-9882-44deb28316b0 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:23:46.832609 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.objects.instance [None req-11999dbb-4275-44aa-9882-44deb28316b0 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lazy-loading 'flavor' on Instance uuid 5d02b648-04d3-46cc-b51f-29c17f2d78ef {{(pid=122632) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 11 00:23:46.910122 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-11999dbb-4275-44aa-9882-44deb28316b0 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] 10.222.0.58 "POST /compute/v2.1/servers/5d02b648-04d3-46cc-b51f-29c17f2d78ef/action" status: 202 len: 0 microversion: 2.1 time: 0.167284 Aug 11 00:23:46.910752 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3569/7345] 10.222.0.58 () {60 vars in 1278 bytes} [Thu Aug 11 00:23:46 2022] POST /compute/v2.1/servers/5d02b648-04d3-46cc-b51f-29c17f2d78ef/action => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 11 00:23:46.917403 n-d-850468-14 devstack@n-api.service[122633]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5e7530cb-e34a-4714-9391-5480d11af743] AMQP server on 10.222.0.58:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 11 00:23:46.918946 n-d-850468-14 devstack@n-api.service[122633]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e2bb3e2a-85f2-4c49-98ff-2d6066099266] AMQP server on 10.222.0.58:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 11 00:23:46.925256 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-91f9d11b-3543-461d-84e0-e296ad33134d tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:23:46.926120 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-91f9d11b-3543-461d-84e0-e296ad33134d tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] [instance: 5d02b648-04d3-46cc-b51f-29c17f2d78ef] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:23:46.928685 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_api:SELECT=24 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:23:46.929433 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=52 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:23:46.935339 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-91f9d11b-3543-461d-84e0-e296ad33134d tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:23:46.935950 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-91f9d11b-3543-461d-84e0-e296ad33134d tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:23:46.936662 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-91f9d11b-3543-461d-84e0-e296ad33134d tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:23:46.937539 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-91f9d11b-3543-461d-84e0-e296ad33134d tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:23:46.938017 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-91f9d11b-3543-461d-84e0-e296ad33134d tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:23:46.938461 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-91f9d11b-3543-461d-84e0-e296ad33134d tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:23:47.081655 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-91f9d11b-3543-461d-84e0-e296ad33134d tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a07aed22e5242308216005a51ee6e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afd506533304073a9f9d246eb7a4434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:23:47.089411 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-91f9d11b-3543-461d-84e0-e296ad33134d tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] 10.222.0.58 "GET /compute/v2.1/servers/5d02b648-04d3-46cc-b51f-29c17f2d78ef" status: 200 len: 1568 microversion: 2.1 time: 0.174078 Aug 11 00:23:47.089989 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3777/7346] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:23:46 2022] GET /compute/v2.1/servers/5d02b648-04d3-46cc-b51f-29c17f2d78ef => generated 1568 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:23:48.113168 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-796f602c-3b89-415f-8391-7ad8c7008b74 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:23:48.113901 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-796f602c-3b89-415f-8391-7ad8c7008b74 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] [instance: 5d02b648-04d3-46cc-b51f-29c17f2d78ef] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:23:48.122291 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-796f602c-3b89-415f-8391-7ad8c7008b74 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:23:48.122771 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-796f602c-3b89-415f-8391-7ad8c7008b74 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:23:48.123229 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-796f602c-3b89-415f-8391-7ad8c7008b74 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:23:48.123917 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-796f602c-3b89-415f-8391-7ad8c7008b74 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:23:48.124398 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-796f602c-3b89-415f-8391-7ad8c7008b74 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:23:48.124825 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-796f602c-3b89-415f-8391-7ad8c7008b74 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:23:48.128851 n-d-850468-14 devstack@n-api.service[122632]: INFO oslo.messaging._drivers.impl_rabbit [-] [cd3f72be-c5dc-40c0-bc95-e9b4d1b700e4] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 42086. Aug 11 00:23:48.129626 n-d-850468-14 devstack@n-api.service[122632]: INFO oslo.messaging._drivers.impl_rabbit [-] [6aef4e7e-e576-4aec-8e05-1d4d3b8b22c0] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 42088. Aug 11 00:23:48.262594 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-796f602c-3b89-415f-8391-7ad8c7008b74 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a07aed22e5242308216005a51ee6e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afd506533304073a9f9d246eb7a4434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:23:48.271297 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-796f602c-3b89-415f-8391-7ad8c7008b74 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] 10.222.0.58 "GET /compute/v2.1/servers/5d02b648-04d3-46cc-b51f-29c17f2d78ef" status: 200 len: 1568 microversion: 2.1 time: 0.164440 Aug 11 00:23:48.271905 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3570/7347] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:23:48 2022] GET /compute/v2.1/servers/5d02b648-04d3-46cc-b51f-29c17f2d78ef => generated 1568 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:23:48.638728 n-d-850468-14 devstack@n-api.service[122633]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 11 00:23:48.639331 n-d-850468-14 devstack@n-api.service[122633]: Thu Aug 11 00:23:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 11 00:23:49.293653 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-a95df5be-527b-4df7-9d55-7be38baf7fb6 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:23:49.294346 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-a95df5be-527b-4df7-9d55-7be38baf7fb6 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] [instance: 5d02b648-04d3-46cc-b51f-29c17f2d78ef] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:23:49.304131 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a95df5be-527b-4df7-9d55-7be38baf7fb6 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:23:49.304627 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a95df5be-527b-4df7-9d55-7be38baf7fb6 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:23:49.305068 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a95df5be-527b-4df7-9d55-7be38baf7fb6 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:23:49.305771 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a95df5be-527b-4df7-9d55-7be38baf7fb6 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:23:49.306234 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a95df5be-527b-4df7-9d55-7be38baf7fb6 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:23:49.306666 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-a95df5be-527b-4df7-9d55-7be38baf7fb6 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:23:49.314650 n-d-850468-14 devstack@n-api.service[122633]: INFO oslo.messaging._drivers.impl_rabbit [-] [e2bb3e2a-85f2-4c49-98ff-2d6066099266] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 42096. Aug 11 00:23:49.315375 n-d-850468-14 devstack@n-api.service[122633]: INFO oslo.messaging._drivers.impl_rabbit [-] [5e7530cb-e34a-4714-9391-5480d11af743] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 42094. Aug 11 00:23:49.323802 n-d-850468-14 devstack@n-api.service[122632]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 11 00:23:49.324283 n-d-850468-14 devstack@n-api.service[122632]: Thu Aug 11 00:23:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 11 00:23:49.443961 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-a95df5be-527b-4df7-9d55-7be38baf7fb6 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a07aed22e5242308216005a51ee6e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afd506533304073a9f9d246eb7a4434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:23:49.451590 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-a95df5be-527b-4df7-9d55-7be38baf7fb6 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] 10.222.0.58 "GET /compute/v2.1/servers/5d02b648-04d3-46cc-b51f-29c17f2d78ef" status: 200 len: 1568 microversion: 2.1 time: 0.161945 Aug 11 00:23:49.452158 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3778/7348] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:23:49 2022] GET /compute/v2.1/servers/5d02b648-04d3-46cc-b51f-29c17f2d78ef => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:23:50.472429 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-e12b1659-fd9d-477b-b35a-e052c69aade0 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:23:50.473037 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-e12b1659-fd9d-477b-b35a-e052c69aade0 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] [instance: 5d02b648-04d3-46cc-b51f-29c17f2d78ef] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:23:50.479978 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e12b1659-fd9d-477b-b35a-e052c69aade0 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:23:50.480479 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e12b1659-fd9d-477b-b35a-e052c69aade0 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:23:50.480940 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e12b1659-fd9d-477b-b35a-e052c69aade0 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:23:50.481646 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e12b1659-fd9d-477b-b35a-e052c69aade0 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:23:50.482098 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e12b1659-fd9d-477b-b35a-e052c69aade0 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:23:50.482515 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-e12b1659-fd9d-477b-b35a-e052c69aade0 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:23:50.626240 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-e12b1659-fd9d-477b-b35a-e052c69aade0 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a07aed22e5242308216005a51ee6e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afd506533304073a9f9d246eb7a4434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:23:50.634153 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-e12b1659-fd9d-477b-b35a-e052c69aade0 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] 10.222.0.58 "GET /compute/v2.1/servers/5d02b648-04d3-46cc-b51f-29c17f2d78ef" status: 200 len: 1568 microversion: 2.1 time: 0.165962 Aug 11 00:23:50.634954 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3571/7349] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:23:50 2022] GET /compute/v2.1/servers/5d02b648-04d3-46cc-b51f-29c17f2d78ef => generated 1568 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:23:51.656721 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-22c4d41e-d497-4b9b-909d-35dc3ef8fa00 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:23:51.657345 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-22c4d41e-d497-4b9b-909d-35dc3ef8fa00 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] [instance: 5d02b648-04d3-46cc-b51f-29c17f2d78ef] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:23:51.664211 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-22c4d41e-d497-4b9b-909d-35dc3ef8fa00 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:23:51.664712 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-22c4d41e-d497-4b9b-909d-35dc3ef8fa00 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:23:51.665166 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-22c4d41e-d497-4b9b-909d-35dc3ef8fa00 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:23:51.665875 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-22c4d41e-d497-4b9b-909d-35dc3ef8fa00 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:23:51.666348 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-22c4d41e-d497-4b9b-909d-35dc3ef8fa00 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:23:51.666812 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-22c4d41e-d497-4b9b-909d-35dc3ef8fa00 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:23:51.804924 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-22c4d41e-d497-4b9b-909d-35dc3ef8fa00 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a07aed22e5242308216005a51ee6e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afd506533304073a9f9d246eb7a4434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:23:51.813291 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-22c4d41e-d497-4b9b-909d-35dc3ef8fa00 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] 10.222.0.58 "GET /compute/v2.1/servers/5d02b648-04d3-46cc-b51f-29c17f2d78ef" status: 200 len: 1568 microversion: 2.1 time: 0.160469 Aug 11 00:23:51.813867 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3779/7350] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:23:51 2022] GET /compute/v2.1/servers/5d02b648-04d3-46cc-b51f-29c17f2d78ef => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:23:52.834630 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-8f6581fe-dd5a-433f-8a97-23c0993fc60c tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:23:52.835576 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-8f6581fe-dd5a-433f-8a97-23c0993fc60c tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] [instance: 5d02b648-04d3-46cc-b51f-29c17f2d78ef] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:23:52.842747 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8f6581fe-dd5a-433f-8a97-23c0993fc60c tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:23:52.843262 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8f6581fe-dd5a-433f-8a97-23c0993fc60c tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:23:52.843743 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8f6581fe-dd5a-433f-8a97-23c0993fc60c tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:23:52.844426 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8f6581fe-dd5a-433f-8a97-23c0993fc60c tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:23:52.844876 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8f6581fe-dd5a-433f-8a97-23c0993fc60c tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:23:52.845294 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-8f6581fe-dd5a-433f-8a97-23c0993fc60c tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:23:52.976567 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-8f6581fe-dd5a-433f-8a97-23c0993fc60c tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a07aed22e5242308216005a51ee6e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afd506533304073a9f9d246eb7a4434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:23:52.984204 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-8f6581fe-dd5a-433f-8a97-23c0993fc60c tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] 10.222.0.58 "GET /compute/v2.1/servers/5d02b648-04d3-46cc-b51f-29c17f2d78ef" status: 200 len: 1568 microversion: 2.1 time: 0.153893 Aug 11 00:23:52.985284 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3572/7351] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:23:52 2022] GET /compute/v2.1/servers/5d02b648-04d3-46cc-b51f-29c17f2d78ef => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:23:54.006021 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-4c990631-0342-4103-afde-914386b17ed3 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:23:54.006632 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-4c990631-0342-4103-afde-914386b17ed3 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] [instance: 5d02b648-04d3-46cc-b51f-29c17f2d78ef] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:23:54.013490 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4c990631-0342-4103-afde-914386b17ed3 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:23:54.013983 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4c990631-0342-4103-afde-914386b17ed3 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:23:54.014428 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4c990631-0342-4103-afde-914386b17ed3 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:23:54.015148 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4c990631-0342-4103-afde-914386b17ed3 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:23:54.016709 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4c990631-0342-4103-afde-914386b17ed3 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:23:54.017150 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4c990631-0342-4103-afde-914386b17ed3 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:23:54.151402 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-4c990631-0342-4103-afde-914386b17ed3 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a07aed22e5242308216005a51ee6e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afd506533304073a9f9d246eb7a4434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:23:54.160125 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-4c990631-0342-4103-afde-914386b17ed3 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] 10.222.0.58 "GET /compute/v2.1/servers/5d02b648-04d3-46cc-b51f-29c17f2d78ef" status: 200 len: 1568 microversion: 2.1 time: 0.158298 Aug 11 00:23:54.160696 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3780/7352] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:23:54 2022] GET /compute/v2.1/servers/5d02b648-04d3-46cc-b51f-29c17f2d78ef => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:23:55.180676 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-f4e11f02-317d-4514-ae49-864abaa342ae tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:23:55.181275 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-f4e11f02-317d-4514-ae49-864abaa342ae tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] [instance: 5d02b648-04d3-46cc-b51f-29c17f2d78ef] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:23:55.188545 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f4e11f02-317d-4514-ae49-864abaa342ae tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:23:55.189064 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f4e11f02-317d-4514-ae49-864abaa342ae tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:23:55.189512 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f4e11f02-317d-4514-ae49-864abaa342ae tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:23:55.190221 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f4e11f02-317d-4514-ae49-864abaa342ae tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:23:55.190675 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f4e11f02-317d-4514-ae49-864abaa342ae tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:23:55.191128 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-f4e11f02-317d-4514-ae49-864abaa342ae tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:23:55.326731 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-f4e11f02-317d-4514-ae49-864abaa342ae tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a07aed22e5242308216005a51ee6e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afd506533304073a9f9d246eb7a4434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:23:55.334904 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-f4e11f02-317d-4514-ae49-864abaa342ae tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] 10.222.0.58 "GET /compute/v2.1/servers/5d02b648-04d3-46cc-b51f-29c17f2d78ef" status: 200 len: 1568 microversion: 2.1 time: 0.158239 Aug 11 00:23:55.335479 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3573/7353] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:23:55 2022] GET /compute/v2.1/servers/5d02b648-04d3-46cc-b51f-29c17f2d78ef => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:23:56.357693 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-1d4f1b21-74d4-47db-8a2a-160c8a508be5 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:23:56.358303 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-1d4f1b21-74d4-47db-8a2a-160c8a508be5 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] [instance: 5d02b648-04d3-46cc-b51f-29c17f2d78ef] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:23:56.365767 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1d4f1b21-74d4-47db-8a2a-160c8a508be5 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:23:56.366268 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1d4f1b21-74d4-47db-8a2a-160c8a508be5 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:23:56.366721 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1d4f1b21-74d4-47db-8a2a-160c8a508be5 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:23:56.367461 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1d4f1b21-74d4-47db-8a2a-160c8a508be5 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:23:56.367934 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1d4f1b21-74d4-47db-8a2a-160c8a508be5 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:23:56.368379 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1d4f1b21-74d4-47db-8a2a-160c8a508be5 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:23:56.501100 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-1d4f1b21-74d4-47db-8a2a-160c8a508be5 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a07aed22e5242308216005a51ee6e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afd506533304073a9f9d246eb7a4434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:23:56.508992 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-1d4f1b21-74d4-47db-8a2a-160c8a508be5 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] 10.222.0.58 "GET /compute/v2.1/servers/5d02b648-04d3-46cc-b51f-29c17f2d78ef" status: 200 len: 1568 microversion: 2.1 time: 0.155241 Aug 11 00:23:56.509564 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3781/7354] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:23:56 2022] GET /compute/v2.1/servers/5d02b648-04d3-46cc-b51f-29c17f2d78ef => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:23:57.531085 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-b63bf416-181c-4921-99d2-e2ca5bf1d8b8 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:23:57.531812 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-b63bf416-181c-4921-99d2-e2ca5bf1d8b8 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] [instance: 5d02b648-04d3-46cc-b51f-29c17f2d78ef] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:23:57.539002 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b63bf416-181c-4921-99d2-e2ca5bf1d8b8 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:23:57.539589 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b63bf416-181c-4921-99d2-e2ca5bf1d8b8 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:23:57.540093 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b63bf416-181c-4921-99d2-e2ca5bf1d8b8 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:23:57.540859 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b63bf416-181c-4921-99d2-e2ca5bf1d8b8 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:23:57.541404 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b63bf416-181c-4921-99d2-e2ca5bf1d8b8 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:23:57.541896 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b63bf416-181c-4921-99d2-e2ca5bf1d8b8 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:23:57.701144 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-b63bf416-181c-4921-99d2-e2ca5bf1d8b8 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a07aed22e5242308216005a51ee6e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afd506533304073a9f9d246eb7a4434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:23:57.709852 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-b63bf416-181c-4921-99d2-e2ca5bf1d8b8 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] 10.222.0.58 "GET /compute/v2.1/servers/5d02b648-04d3-46cc-b51f-29c17f2d78ef" status: 200 len: 1568 microversion: 2.1 time: 0.182834 Aug 11 00:23:57.710424 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3574/7355] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:23:57 2022] GET /compute/v2.1/servers/5d02b648-04d3-46cc-b51f-29c17f2d78ef => generated 1568 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:23:58.731264 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-ce14c792-6d9d-4b6f-aaac-fcd8540461bb tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:23:58.731909 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-ce14c792-6d9d-4b6f-aaac-fcd8540461bb tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] [instance: 5d02b648-04d3-46cc-b51f-29c17f2d78ef] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:23:58.739823 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ce14c792-6d9d-4b6f-aaac-fcd8540461bb tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:23:58.740317 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ce14c792-6d9d-4b6f-aaac-fcd8540461bb tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:23:58.740762 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ce14c792-6d9d-4b6f-aaac-fcd8540461bb tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:23:58.741465 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ce14c792-6d9d-4b6f-aaac-fcd8540461bb tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:23:58.741922 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ce14c792-6d9d-4b6f-aaac-fcd8540461bb tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:23:58.742353 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ce14c792-6d9d-4b6f-aaac-fcd8540461bb tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:23:58.881523 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-ce14c792-6d9d-4b6f-aaac-fcd8540461bb tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a07aed22e5242308216005a51ee6e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afd506533304073a9f9d246eb7a4434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:23:58.889131 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-ce14c792-6d9d-4b6f-aaac-fcd8540461bb tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] 10.222.0.58 "GET /compute/v2.1/servers/5d02b648-04d3-46cc-b51f-29c17f2d78ef" status: 200 len: 1568 microversion: 2.1 time: 0.161821 Aug 11 00:23:58.889708 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3782/7356] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:23:58 2022] GET /compute/v2.1/servers/5d02b648-04d3-46cc-b51f-29c17f2d78ef => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:23:59.910901 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-39015017-2af3-4628-8d15-1722538cacb6 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:23:59.911523 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-39015017-2af3-4628-8d15-1722538cacb6 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] [instance: 5d02b648-04d3-46cc-b51f-29c17f2d78ef] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:23:59.918773 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-39015017-2af3-4628-8d15-1722538cacb6 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:23:59.919267 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-39015017-2af3-4628-8d15-1722538cacb6 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:23:59.919702 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-39015017-2af3-4628-8d15-1722538cacb6 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:23:59.920404 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-39015017-2af3-4628-8d15-1722538cacb6 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:23:59.920857 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-39015017-2af3-4628-8d15-1722538cacb6 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:23:59.921284 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-39015017-2af3-4628-8d15-1722538cacb6 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:24:00.083460 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-39015017-2af3-4628-8d15-1722538cacb6 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a07aed22e5242308216005a51ee6e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afd506533304073a9f9d246eb7a4434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:24:00.091371 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-39015017-2af3-4628-8d15-1722538cacb6 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] 10.222.0.58 "GET /compute/v2.1/servers/5d02b648-04d3-46cc-b51f-29c17f2d78ef" status: 200 len: 1568 microversion: 2.1 time: 0.184536 Aug 11 00:24:00.092050 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3575/7357] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:23:59 2022] GET /compute/v2.1/servers/5d02b648-04d3-46cc-b51f-29c17f2d78ef => generated 1568 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:24:01.114653 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-e5f90f84-a3b4-47b7-8302-7cdfa0a0d271 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:24:01.115245 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-e5f90f84-a3b4-47b7-8302-7cdfa0a0d271 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] [instance: 5d02b648-04d3-46cc-b51f-29c17f2d78ef] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:24:01.122638 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e5f90f84-a3b4-47b7-8302-7cdfa0a0d271 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:24:01.123147 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e5f90f84-a3b4-47b7-8302-7cdfa0a0d271 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:24:01.123594 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e5f90f84-a3b4-47b7-8302-7cdfa0a0d271 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:24:01.124294 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e5f90f84-a3b4-47b7-8302-7cdfa0a0d271 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:24:01.124947 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e5f90f84-a3b4-47b7-8302-7cdfa0a0d271 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:24:01.125684 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e5f90f84-a3b4-47b7-8302-7cdfa0a0d271 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:24:01.259092 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-e5f90f84-a3b4-47b7-8302-7cdfa0a0d271 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a07aed22e5242308216005a51ee6e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afd506533304073a9f9d246eb7a4434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:24:01.267076 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-e5f90f84-a3b4-47b7-8302-7cdfa0a0d271 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] 10.222.0.58 "GET /compute/v2.1/servers/5d02b648-04d3-46cc-b51f-29c17f2d78ef" status: 200 len: 1569 microversion: 2.1 time: 0.156605 Aug 11 00:24:01.267661 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3783/7358] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:24:01 2022] GET /compute/v2.1/servers/5d02b648-04d3-46cc-b51f-29c17f2d78ef => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:24:01.289281 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-4bd5f2b8-b836-4101-8536-ad1a1345fb7e tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 00:24:01.289881 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-4bd5f2b8-b836-4101-8536-ad1a1345fb7e tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] [instance: 5d02b648-04d3-46cc-b51f-29c17f2d78ef] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:24:01.298206 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4bd5f2b8-b836-4101-8536-ad1a1345fb7e tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:24:01.298696 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4bd5f2b8-b836-4101-8536-ad1a1345fb7e tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:24:01.299155 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4bd5f2b8-b836-4101-8536-ad1a1345fb7e tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:24:01.299963 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4bd5f2b8-b836-4101-8536-ad1a1345fb7e tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:24:01.300589 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4bd5f2b8-b836-4101-8536-ad1a1345fb7e tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:24:01.301022 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-4bd5f2b8-b836-4101-8536-ad1a1345fb7e tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:24:01.344631 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-4bd5f2b8-b836-4101-8536-ad1a1345fb7e tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] [instance: 5d02b648-04d3-46cc-b51f-29c17f2d78ef] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=122632) unshelve /opt/stack/nova/nova/compute/api.py:4544}} Aug 11 00:24:01.410694 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-4bd5f2b8-b836-4101-8536-ad1a1345fb7e tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] 10.222.0.58 "POST /compute/v2.1/servers/5d02b648-04d3-46cc-b51f-29c17f2d78ef/action" status: 202 len: 0 microversion: 2.1 time: 0.125317 Aug 11 00:24:01.414468 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3576/7359] 10.222.0.58 () {60 vars in 1278 bytes} [Thu Aug 11 00:24:01 2022] POST /compute/v2.1/servers/5d02b648-04d3-46cc-b51f-29c17f2d78ef/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 11 00:24:01.419596 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-50632598-8c8d-4cfd-8bc5-729d2f9c3807 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:24:01.420216 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-50632598-8c8d-4cfd-8bc5-729d2f9c3807 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] [instance: 5d02b648-04d3-46cc-b51f-29c17f2d78ef] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:24:01.426686 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-50632598-8c8d-4cfd-8bc5-729d2f9c3807 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:24:01.427210 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-50632598-8c8d-4cfd-8bc5-729d2f9c3807 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:24:01.427658 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-50632598-8c8d-4cfd-8bc5-729d2f9c3807 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:24:01.428361 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-50632598-8c8d-4cfd-8bc5-729d2f9c3807 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:24:01.428816 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-50632598-8c8d-4cfd-8bc5-729d2f9c3807 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:24:01.429251 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-50632598-8c8d-4cfd-8bc5-729d2f9c3807 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:24:01.630607 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-50632598-8c8d-4cfd-8bc5-729d2f9c3807 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a07aed22e5242308216005a51ee6e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afd506533304073a9f9d246eb7a4434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:24:01.638698 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-50632598-8c8d-4cfd-8bc5-729d2f9c3807 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] 10.222.0.58 "GET /compute/v2.1/servers/5d02b648-04d3-46cc-b51f-29c17f2d78ef" status: 200 len: 1517 microversion: 2.1 time: 0.223084 Aug 11 00:24:01.639299 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3784/7360] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:24:01 2022] GET /compute/v2.1/servers/5d02b648-04d3-46cc-b51f-29c17f2d78ef => generated 1517 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:24:02.675274 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-45e06469-fdf5-464f-adec-77cae7476cfb tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:24:02.675892 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-45e06469-fdf5-464f-adec-77cae7476cfb tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] [instance: 5d02b648-04d3-46cc-b51f-29c17f2d78ef] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:24:02.681960 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-45e06469-fdf5-464f-adec-77cae7476cfb tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:24:02.682480 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-45e06469-fdf5-464f-adec-77cae7476cfb tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:24:02.682963 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-45e06469-fdf5-464f-adec-77cae7476cfb tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:24:02.683661 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-45e06469-fdf5-464f-adec-77cae7476cfb tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:24:02.684119 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-45e06469-fdf5-464f-adec-77cae7476cfb tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:24:02.684546 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-45e06469-fdf5-464f-adec-77cae7476cfb tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:24:02.828237 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-45e06469-fdf5-464f-adec-77cae7476cfb tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a07aed22e5242308216005a51ee6e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afd506533304073a9f9d246eb7a4434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:24:02.836705 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-45e06469-fdf5-464f-adec-77cae7476cfb tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] 10.222.0.58 "GET /compute/v2.1/servers/5d02b648-04d3-46cc-b51f-29c17f2d78ef" status: 200 len: 1519 microversion: 2.1 time: 0.167005 Aug 11 00:24:02.837281 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3577/7361] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:24:02 2022] GET /compute/v2.1/servers/5d02b648-04d3-46cc-b51f-29c17f2d78ef => generated 1519 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:24:03.530056 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-ceab9f90-6796-4364-b8a9-093a11bfc23f req-7938d498-3692-453e-9703-1ddbc1050884 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d02b648-04d3-46cc-b51f-29c17f2d78ef", "name": "network-vif-unplugged", "status": "completed", "tag": "8a646732-28ad-4f68-bcd9-d4be9c313732"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 00:24:03.542250 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-ceab9f90-6796-4364-b8a9-093a11bfc23f req-7938d498-3692-453e-9703-1ddbc1050884 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:24:03.542766 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-ceab9f90-6796-4364-b8a9-093a11bfc23f req-7938d498-3692-453e-9703-1ddbc1050884 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:24:03.543294 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-ceab9f90-6796-4364-b8a9-093a11bfc23f req-7938d498-3692-453e-9703-1ddbc1050884 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:24:03.557925 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.compute.server_external_events [req-ceab9f90-6796-4364-b8a9-093a11bfc23f req-7938d498-3692-453e-9703-1ddbc1050884 service nova] Unable to find a host for instance 5d02b648-04d3-46cc-b51f-29c17f2d78ef. Dropping event network-vif-unplugged {{(pid=122633) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 11 00:24:03.558903 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-ceab9f90-6796-4364-b8a9-093a11bfc23f req-7938d498-3692-453e-9703-1ddbc1050884 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.092263 Aug 11 00:24:03.559868 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3785/7362] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 11 00:24:03 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 94 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 11 00:24:03.859919 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-653ba54a-fd47-40f7-a006-ba23e6856920 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:24:03.860452 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-653ba54a-fd47-40f7-a006-ba23e6856920 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] [instance: 5d02b648-04d3-46cc-b51f-29c17f2d78ef] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:24:03.867427 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-653ba54a-fd47-40f7-a006-ba23e6856920 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:24:03.867916 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-653ba54a-fd47-40f7-a006-ba23e6856920 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:24:03.868356 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-653ba54a-fd47-40f7-a006-ba23e6856920 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:24:03.869060 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-653ba54a-fd47-40f7-a006-ba23e6856920 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:24:03.869517 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-653ba54a-fd47-40f7-a006-ba23e6856920 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:24:03.869944 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-653ba54a-fd47-40f7-a006-ba23e6856920 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:24:04.016410 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-653ba54a-fd47-40f7-a006-ba23e6856920 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a07aed22e5242308216005a51ee6e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afd506533304073a9f9d246eb7a4434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:24:04.024718 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-653ba54a-fd47-40f7-a006-ba23e6856920 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] 10.222.0.58 "GET /compute/v2.1/servers/5d02b648-04d3-46cc-b51f-29c17f2d78ef" status: 200 len: 1519 microversion: 2.1 time: 0.168785 Aug 11 00:24:04.025400 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3578/7363] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:24:03 2022] GET /compute/v2.1/servers/5d02b648-04d3-46cc-b51f-29c17f2d78ef => generated 1519 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:24:05.046186 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-f7909b31-c4a3-4862-9736-7e9c92c960b4 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:24:05.047443 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-f7909b31-c4a3-4862-9736-7e9c92c960b4 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] [instance: 5d02b648-04d3-46cc-b51f-29c17f2d78ef] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:24:05.054878 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f7909b31-c4a3-4862-9736-7e9c92c960b4 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:24:05.055376 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f7909b31-c4a3-4862-9736-7e9c92c960b4 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:24:05.055822 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f7909b31-c4a3-4862-9736-7e9c92c960b4 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:24:05.056534 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f7909b31-c4a3-4862-9736-7e9c92c960b4 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:24:05.057004 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f7909b31-c4a3-4862-9736-7e9c92c960b4 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:24:05.057463 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f7909b31-c4a3-4862-9736-7e9c92c960b4 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:24:05.202377 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-f7909b31-c4a3-4862-9736-7e9c92c960b4 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a07aed22e5242308216005a51ee6e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afd506533304073a9f9d246eb7a4434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:24:05.210569 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-f7909b31-c4a3-4862-9736-7e9c92c960b4 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] 10.222.0.58 "GET /compute/v2.1/servers/5d02b648-04d3-46cc-b51f-29c17f2d78ef" status: 200 len: 1519 microversion: 2.1 time: 0.168245 Aug 11 00:24:05.211198 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3786/7364] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:24:05 2022] GET /compute/v2.1/servers/5d02b648-04d3-46cc-b51f-29c17f2d78ef => generated 1519 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:24:06.232845 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-59dca240-171b-45b0-965c-0fbdb32a37ca tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:24:06.233393 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-59dca240-171b-45b0-965c-0fbdb32a37ca tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] [instance: 5d02b648-04d3-46cc-b51f-29c17f2d78ef] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:24:06.240790 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-59dca240-171b-45b0-965c-0fbdb32a37ca tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:24:06.241282 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-59dca240-171b-45b0-965c-0fbdb32a37ca tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:24:06.241719 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-59dca240-171b-45b0-965c-0fbdb32a37ca tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:24:06.242424 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-59dca240-171b-45b0-965c-0fbdb32a37ca tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:24:06.242915 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-59dca240-171b-45b0-965c-0fbdb32a37ca tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:24:06.243347 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-59dca240-171b-45b0-965c-0fbdb32a37ca tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:24:06.379925 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-59dca240-171b-45b0-965c-0fbdb32a37ca tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a07aed22e5242308216005a51ee6e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afd506533304073a9f9d246eb7a4434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:24:06.387679 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-59dca240-171b-45b0-965c-0fbdb32a37ca tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] 10.222.0.58 "GET /compute/v2.1/servers/5d02b648-04d3-46cc-b51f-29c17f2d78ef" status: 200 len: 1519 microversion: 2.1 time: 0.158862 Aug 11 00:24:06.388252 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3579/7365] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:24:06 2022] GET /compute/v2.1/servers/5d02b648-04d3-46cc-b51f-29c17f2d78ef => generated 1519 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:24:07.410253 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-93f97abb-6cef-44e5-a2bc-31f415e8679e tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:24:07.411075 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-93f97abb-6cef-44e5-a2bc-31f415e8679e tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] [instance: 5d02b648-04d3-46cc-b51f-29c17f2d78ef] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:24:07.418071 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-93f97abb-6cef-44e5-a2bc-31f415e8679e tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:24:07.418580 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-93f97abb-6cef-44e5-a2bc-31f415e8679e tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:24:07.419066 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-93f97abb-6cef-44e5-a2bc-31f415e8679e tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:24:07.419781 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-93f97abb-6cef-44e5-a2bc-31f415e8679e tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:24:07.420253 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-93f97abb-6cef-44e5-a2bc-31f415e8679e tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:24:07.420695 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-93f97abb-6cef-44e5-a2bc-31f415e8679e tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:24:07.557446 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-93f97abb-6cef-44e5-a2bc-31f415e8679e tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a07aed22e5242308216005a51ee6e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afd506533304073a9f9d246eb7a4434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:24:07.565917 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-93f97abb-6cef-44e5-a2bc-31f415e8679e tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] 10.222.0.58 "GET /compute/v2.1/servers/5d02b648-04d3-46cc-b51f-29c17f2d78ef" status: 200 len: 1575 microversion: 2.1 time: 0.160148 Aug 11 00:24:07.566512 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3787/7366] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:24:07 2022] GET /compute/v2.1/servers/5d02b648-04d3-46cc-b51f-29c17f2d78ef => generated 1575 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:24:08.252375 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-23ab8a67-e4b4-488f-b344-8924d73b1d95 req-75cefa23-46d0-4265-9fc9-80e1aabb5ac0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d02b648-04d3-46cc-b51f-29c17f2d78ef", "tag": "8a646732-28ad-4f68-bcd9-d4be9c313732"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 00:24:08.261888 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-23ab8a67-e4b4-488f-b344-8924d73b1d95 req-75cefa23-46d0-4265-9fc9-80e1aabb5ac0 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:24:08.262446 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-23ab8a67-e4b4-488f-b344-8924d73b1d95 req-75cefa23-46d0-4265-9fc9-80e1aabb5ac0 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:24:08.262982 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-23ab8a67-e4b4-488f-b344-8924d73b1d95 req-75cefa23-46d0-4265-9fc9-80e1aabb5ac0 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:24:08.274555 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-23ab8a67-e4b4-488f-b344-8924d73b1d95 req-75cefa23-46d0-4265-9fc9-80e1aabb5ac0 service nova] Creating event network-changed:8a646732-28ad-4f68-bcd9-d4be9c313732 for instance 5d02b648-04d3-46cc-b51f-29c17f2d78ef on n-h2-850468-14 Aug 11 00:24:08.280652 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-23ab8a67-e4b4-488f-b344-8924d73b1d95 req-75cefa23-46d0-4265-9fc9-80e1aabb5ac0 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084413 Aug 11 00:24:08.281683 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3580/7367] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 11 00:24:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 00:24:08.588259 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-41f55d53-0132-4122-bf21-3fcf9b0f1d79 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:24:08.589095 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-41f55d53-0132-4122-bf21-3fcf9b0f1d79 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] [instance: 5d02b648-04d3-46cc-b51f-29c17f2d78ef] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:24:08.596420 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-41f55d53-0132-4122-bf21-3fcf9b0f1d79 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:24:08.596920 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-41f55d53-0132-4122-bf21-3fcf9b0f1d79 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:24:08.597368 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-41f55d53-0132-4122-bf21-3fcf9b0f1d79 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:24:08.598081 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-41f55d53-0132-4122-bf21-3fcf9b0f1d79 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:24:08.598546 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-41f55d53-0132-4122-bf21-3fcf9b0f1d79 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:24:08.599020 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-41f55d53-0132-4122-bf21-3fcf9b0f1d79 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:24:08.738499 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-41f55d53-0132-4122-bf21-3fcf9b0f1d79 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a07aed22e5242308216005a51ee6e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afd506533304073a9f9d246eb7a4434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:24:08.746155 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-41f55d53-0132-4122-bf21-3fcf9b0f1d79 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] 10.222.0.58 "GET /compute/v2.1/servers/5d02b648-04d3-46cc-b51f-29c17f2d78ef" status: 200 len: 1575 microversion: 2.1 time: 0.161708 Aug 11 00:24:08.746737 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3788/7368] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:24:08 2022] GET /compute/v2.1/servers/5d02b648-04d3-46cc-b51f-29c17f2d78ef => generated 1575 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:24:09.769607 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-23af6f4b-a65d-4545-820d-dda63d5b881a tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:24:09.770566 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-23af6f4b-a65d-4545-820d-dda63d5b881a tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] [instance: 5d02b648-04d3-46cc-b51f-29c17f2d78ef] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:24:09.777611 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-23af6f4b-a65d-4545-820d-dda63d5b881a tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:24:09.778548 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-23af6f4b-a65d-4545-820d-dda63d5b881a tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:24:09.778548 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-23af6f4b-a65d-4545-820d-dda63d5b881a tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:24:09.779248 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-23af6f4b-a65d-4545-820d-dda63d5b881a tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:24:09.779703 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-23af6f4b-a65d-4545-820d-dda63d5b881a tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:24:09.780127 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-23af6f4b-a65d-4545-820d-dda63d5b881a tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:24:09.913813 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-23af6f4b-a65d-4545-820d-dda63d5b881a tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a07aed22e5242308216005a51ee6e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afd506533304073a9f9d246eb7a4434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:24:09.922648 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-23af6f4b-a65d-4545-820d-dda63d5b881a tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] 10.222.0.58 "GET /compute/v2.1/servers/5d02b648-04d3-46cc-b51f-29c17f2d78ef" status: 200 len: 1575 microversion: 2.1 time: 0.157618 Aug 11 00:24:09.923401 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3581/7369] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:24:09 2022] GET /compute/v2.1/servers/5d02b648-04d3-46cc-b51f-29c17f2d78ef => generated 1575 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:24:10.944067 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-4311332b-6330-41b5-b3cc-cd5581352b96 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:24:10.944662 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-4311332b-6330-41b5-b3cc-cd5581352b96 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] [instance: 5d02b648-04d3-46cc-b51f-29c17f2d78ef] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:24:10.952884 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4311332b-6330-41b5-b3cc-cd5581352b96 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:24:10.953404 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4311332b-6330-41b5-b3cc-cd5581352b96 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:24:10.953855 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4311332b-6330-41b5-b3cc-cd5581352b96 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:24:10.954552 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4311332b-6330-41b5-b3cc-cd5581352b96 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:24:10.955036 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4311332b-6330-41b5-b3cc-cd5581352b96 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:24:10.955469 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4311332b-6330-41b5-b3cc-cd5581352b96 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:24:11.096480 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-4311332b-6330-41b5-b3cc-cd5581352b96 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a07aed22e5242308216005a51ee6e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afd506533304073a9f9d246eb7a4434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:24:11.104170 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-4311332b-6330-41b5-b3cc-cd5581352b96 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] 10.222.0.58 "GET /compute/v2.1/servers/5d02b648-04d3-46cc-b51f-29c17f2d78ef" status: 200 len: 1575 microversion: 2.1 time: 0.164029 Aug 11 00:24:11.104749 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3789/7370] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:24:10 2022] GET /compute/v2.1/servers/5d02b648-04d3-46cc-b51f-29c17f2d78ef => generated 1575 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:24:12.126838 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-fedad16c-fadb-4443-8863-299123aed42a tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:24:12.127387 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-fedad16c-fadb-4443-8863-299123aed42a tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] [instance: 5d02b648-04d3-46cc-b51f-29c17f2d78ef] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:24:12.134298 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fedad16c-fadb-4443-8863-299123aed42a tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:24:12.134800 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fedad16c-fadb-4443-8863-299123aed42a tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:24:12.135239 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fedad16c-fadb-4443-8863-299123aed42a tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:24:12.135938 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fedad16c-fadb-4443-8863-299123aed42a tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:24:12.136389 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fedad16c-fadb-4443-8863-299123aed42a tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:24:12.136831 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-fedad16c-fadb-4443-8863-299123aed42a tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:24:12.270444 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-fedad16c-fadb-4443-8863-299123aed42a tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a07aed22e5242308216005a51ee6e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afd506533304073a9f9d246eb7a4434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:24:12.278037 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-fedad16c-fadb-4443-8863-299123aed42a tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] 10.222.0.58 "GET /compute/v2.1/servers/5d02b648-04d3-46cc-b51f-29c17f2d78ef" status: 200 len: 1575 microversion: 2.1 time: 0.156189 Aug 11 00:24:12.278624 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3582/7371] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:24:12 2022] GET /compute/v2.1/servers/5d02b648-04d3-46cc-b51f-29c17f2d78ef => generated 1575 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:24:13.300728 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-4006a7d0-001d-470a-864d-d7ba9ddb53eb tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:24:13.301361 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-4006a7d0-001d-470a-864d-d7ba9ddb53eb tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] [instance: 5d02b648-04d3-46cc-b51f-29c17f2d78ef] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:24:13.308284 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4006a7d0-001d-470a-864d-d7ba9ddb53eb tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:24:13.308784 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4006a7d0-001d-470a-864d-d7ba9ddb53eb tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:24:13.309239 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4006a7d0-001d-470a-864d-d7ba9ddb53eb tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:24:13.309985 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4006a7d0-001d-470a-864d-d7ba9ddb53eb tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:24:13.310453 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4006a7d0-001d-470a-864d-d7ba9ddb53eb tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:24:13.310918 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-4006a7d0-001d-470a-864d-d7ba9ddb53eb tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:24:13.446655 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-4006a7d0-001d-470a-864d-d7ba9ddb53eb tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a07aed22e5242308216005a51ee6e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afd506533304073a9f9d246eb7a4434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:24:13.454486 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-4006a7d0-001d-470a-864d-d7ba9ddb53eb tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] 10.222.0.58 "GET /compute/v2.1/servers/5d02b648-04d3-46cc-b51f-29c17f2d78ef" status: 200 len: 1575 microversion: 2.1 time: 0.158257 Aug 11 00:24:13.455092 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3790/7372] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:24:13 2022] GET /compute/v2.1/servers/5d02b648-04d3-46cc-b51f-29c17f2d78ef => generated 1575 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:24:14.476296 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-333c5fe6-606d-41da-8f47-76f176f608ed tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:24:14.476837 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-333c5fe6-606d-41da-8f47-76f176f608ed tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] [instance: 5d02b648-04d3-46cc-b51f-29c17f2d78ef] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:24:14.483772 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-333c5fe6-606d-41da-8f47-76f176f608ed tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:24:14.484250 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-333c5fe6-606d-41da-8f47-76f176f608ed tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:24:14.484829 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-333c5fe6-606d-41da-8f47-76f176f608ed tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:24:14.485586 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-333c5fe6-606d-41da-8f47-76f176f608ed tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:24:14.486039 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-333c5fe6-606d-41da-8f47-76f176f608ed tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:24:14.486462 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-333c5fe6-606d-41da-8f47-76f176f608ed tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:24:14.490601 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:24:14.623190 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-333c5fe6-606d-41da-8f47-76f176f608ed tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a07aed22e5242308216005a51ee6e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afd506533304073a9f9d246eb7a4434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:24:14.631658 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-333c5fe6-606d-41da-8f47-76f176f608ed tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] 10.222.0.58 "GET /compute/v2.1/servers/5d02b648-04d3-46cc-b51f-29c17f2d78ef" status: 200 len: 1575 microversion: 2.1 time: 0.159332 Aug 11 00:24:14.632236 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3583/7373] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:24:14 2022] GET /compute/v2.1/servers/5d02b648-04d3-46cc-b51f-29c17f2d78ef => generated 1575 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:24:15.653648 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-15da0b42-cc55-43bd-a636-5fcc2c0ebffd tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:24:15.654277 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-15da0b42-cc55-43bd-a636-5fcc2c0ebffd tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] [instance: 5d02b648-04d3-46cc-b51f-29c17f2d78ef] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:24:15.661736 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-15da0b42-cc55-43bd-a636-5fcc2c0ebffd tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:24:15.662238 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-15da0b42-cc55-43bd-a636-5fcc2c0ebffd tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:24:15.662693 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-15da0b42-cc55-43bd-a636-5fcc2c0ebffd tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:24:15.663464 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-15da0b42-cc55-43bd-a636-5fcc2c0ebffd tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:24:15.663936 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-15da0b42-cc55-43bd-a636-5fcc2c0ebffd tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:24:15.664379 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-15da0b42-cc55-43bd-a636-5fcc2c0ebffd tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:24:15.805238 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-15da0b42-cc55-43bd-a636-5fcc2c0ebffd tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a07aed22e5242308216005a51ee6e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afd506533304073a9f9d246eb7a4434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:24:15.813761 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-15da0b42-cc55-43bd-a636-5fcc2c0ebffd tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] 10.222.0.58 "GET /compute/v2.1/servers/5d02b648-04d3-46cc-b51f-29c17f2d78ef" status: 200 len: 1575 microversion: 2.1 time: 0.163810 Aug 11 00:24:15.814358 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3791/7374] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:24:15 2022] GET /compute/v2.1/servers/5d02b648-04d3-46cc-b51f-29c17f2d78ef => generated 1575 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:24:16.835012 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-d69b60a5-e9cf-4445-98c1-680f0c438184 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:24:16.835621 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-d69b60a5-e9cf-4445-98c1-680f0c438184 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] [instance: 5d02b648-04d3-46cc-b51f-29c17f2d78ef] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:24:16.838299 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:24:16.843508 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d69b60a5-e9cf-4445-98c1-680f0c438184 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:24:16.844046 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d69b60a5-e9cf-4445-98c1-680f0c438184 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:24:16.845075 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d69b60a5-e9cf-4445-98c1-680f0c438184 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:24:16.845769 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d69b60a5-e9cf-4445-98c1-680f0c438184 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:24:16.846216 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d69b60a5-e9cf-4445-98c1-680f0c438184 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:24:16.846633 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-d69b60a5-e9cf-4445-98c1-680f0c438184 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:24:16.981552 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-d69b60a5-e9cf-4445-98c1-680f0c438184 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a07aed22e5242308216005a51ee6e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afd506533304073a9f9d246eb7a4434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:24:16.989968 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-d69b60a5-e9cf-4445-98c1-680f0c438184 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] 10.222.0.58 "GET /compute/v2.1/servers/5d02b648-04d3-46cc-b51f-29c17f2d78ef" status: 200 len: 1575 microversion: 2.1 time: 0.158835 Aug 11 00:24:16.990557 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3584/7375] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:24:16 2022] GET /compute/v2.1/servers/5d02b648-04d3-46cc-b51f-29c17f2d78ef => generated 1575 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:24:17.953366 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-3b168de0-4fb9-449f-a0ea-d82aa7af8622 req-89b066ef-4f56-4004-8c75-3b96e28f1a32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d02b648-04d3-46cc-b51f-29c17f2d78ef", "name": "network-vif-plugged", "status": "completed", "tag": "8a646732-28ad-4f68-bcd9-d4be9c313732"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 00:24:17.959434 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_api:SELECT=31 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:24:17.967691 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-3b168de0-4fb9-449f-a0ea-d82aa7af8622 req-89b066ef-4f56-4004-8c75-3b96e28f1a32 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:24:17.968199 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-3b168de0-4fb9-449f-a0ea-d82aa7af8622 req-89b066ef-4f56-4004-8c75-3b96e28f1a32 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:24:17.968652 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-3b168de0-4fb9-449f-a0ea-d82aa7af8622 req-89b066ef-4f56-4004-8c75-3b96e28f1a32 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:24:17.973189 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=87 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:24:17.982685 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-3b168de0-4fb9-449f-a0ea-d82aa7af8622 req-89b066ef-4f56-4004-8c75-3b96e28f1a32 service nova] Creating event network-vif-plugged:8a646732-28ad-4f68-bcd9-d4be9c313732 for instance 5d02b648-04d3-46cc-b51f-29c17f2d78ef on n-h2-850468-14 Aug 11 00:24:17.990304 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-3b168de0-4fb9-449f-a0ea-d82aa7af8622 req-89b066ef-4f56-4004-8c75-3b96e28f1a32 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040620 Aug 11 00:24:17.991105 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3792/7376] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 11 00:24:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 00:24:18.013474 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-ad3fac0e-f26d-4eb7-8cac-7d534f504181 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:24:18.014074 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-ad3fac0e-f26d-4eb7-8cac-7d534f504181 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] [instance: 5d02b648-04d3-46cc-b51f-29c17f2d78ef] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:24:18.021416 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ad3fac0e-f26d-4eb7-8cac-7d534f504181 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:24:18.021906 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ad3fac0e-f26d-4eb7-8cac-7d534f504181 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:24:18.022515 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ad3fac0e-f26d-4eb7-8cac-7d534f504181 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:24:18.023250 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ad3fac0e-f26d-4eb7-8cac-7d534f504181 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:24:18.023701 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ad3fac0e-f26d-4eb7-8cac-7d534f504181 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:24:18.024122 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-ad3fac0e-f26d-4eb7-8cac-7d534f504181 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:24:18.208191 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-ad3fac0e-f26d-4eb7-8cac-7d534f504181 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a07aed22e5242308216005a51ee6e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afd506533304073a9f9d246eb7a4434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:24:18.215943 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-ad3fac0e-f26d-4eb7-8cac-7d534f504181 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] 10.222.0.58 "GET /compute/v2.1/servers/5d02b648-04d3-46cc-b51f-29c17f2d78ef" status: 200 len: 1575 microversion: 2.1 time: 0.207071 Aug 11 00:24:18.216564 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3585/7377] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:24:18 2022] GET /compute/v2.1/servers/5d02b648-04d3-46cc-b51f-29c17f2d78ef => generated 1575 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:24:19.238816 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-9f20b0dc-03c1-43c6-a767-f2db5c7955dc tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:24:19.239535 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-9f20b0dc-03c1-43c6-a767-f2db5c7955dc tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] [instance: 5d02b648-04d3-46cc-b51f-29c17f2d78ef] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:24:19.246563 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9f20b0dc-03c1-43c6-a767-f2db5c7955dc tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:24:19.247092 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9f20b0dc-03c1-43c6-a767-f2db5c7955dc tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:24:19.247545 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9f20b0dc-03c1-43c6-a767-f2db5c7955dc tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:24:19.248248 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9f20b0dc-03c1-43c6-a767-f2db5c7955dc tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:24:19.248716 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9f20b0dc-03c1-43c6-a767-f2db5c7955dc tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:24:19.249156 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-9f20b0dc-03c1-43c6-a767-f2db5c7955dc tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:24:19.389776 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-9f20b0dc-03c1-43c6-a767-f2db5c7955dc tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a07aed22e5242308216005a51ee6e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afd506533304073a9f9d246eb7a4434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:24:19.399593 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-9f20b0dc-03c1-43c6-a767-f2db5c7955dc tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] 10.222.0.58 "GET /compute/v2.1/servers/5d02b648-04d3-46cc-b51f-29c17f2d78ef" status: 200 len: 1575 microversion: 2.1 time: 0.165469 Aug 11 00:24:19.400591 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3793/7378] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:24:19 2022] GET /compute/v2.1/servers/5d02b648-04d3-46cc-b51f-29c17f2d78ef => generated 1575 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:24:20.422411 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-803a568c-1b16-4ef6-b0c4-e4595fe13818 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:24:20.423029 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-803a568c-1b16-4ef6-b0c4-e4595fe13818 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] [instance: 5d02b648-04d3-46cc-b51f-29c17f2d78ef] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:24:20.429817 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-803a568c-1b16-4ef6-b0c4-e4595fe13818 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:24:20.430296 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-803a568c-1b16-4ef6-b0c4-e4595fe13818 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:24:20.430735 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-803a568c-1b16-4ef6-b0c4-e4595fe13818 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:24:20.431452 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-803a568c-1b16-4ef6-b0c4-e4595fe13818 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:24:20.431906 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-803a568c-1b16-4ef6-b0c4-e4595fe13818 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:24:20.432333 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-803a568c-1b16-4ef6-b0c4-e4595fe13818 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:24:20.565889 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-803a568c-1b16-4ef6-b0c4-e4595fe13818 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a07aed22e5242308216005a51ee6e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afd506533304073a9f9d246eb7a4434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:24:20.573438 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-803a568c-1b16-4ef6-b0c4-e4595fe13818 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] 10.222.0.58 "GET /compute/v2.1/servers/5d02b648-04d3-46cc-b51f-29c17f2d78ef" status: 200 len: 1562 microversion: 2.1 time: 0.154914 Aug 11 00:24:20.574017 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3586/7379] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:24:20 2022] GET /compute/v2.1/servers/5d02b648-04d3-46cc-b51f-29c17f2d78ef => generated 1562 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:25:28.658851 n-d-850468-14 devstack@n-api.service[122633]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 11 00:25:28.659382 n-d-850468-14 devstack@n-api.service[122633]: Thu Aug 11 00:25:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 11 00:25:34.827690 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_api:SELECT=3 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:25:34.829192 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=7 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:25:34.830271 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_api:SELECT=5 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:25:34.831677 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=22 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:25:34.833909 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-58c61fc9-e460-4653-9021-23333d785fa5 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:25:34.834413 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-58c61fc9-e460-4653-9021-23333d785fa5 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] [instance: 5d02b648-04d3-46cc-b51f-29c17f2d78ef] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:25:34.836803 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-975fd15d-75e7-48ae-925d-5322ee4fa64e req-15688929-5882-4445-9052-e68059e840da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d02b648-04d3-46cc-b51f-29c17f2d78ef", "tag": "8a646732-28ad-4f68-bcd9-d4be9c313732"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 00:25:34.841774 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-58c61fc9-e460-4653-9021-23333d785fa5 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:25:34.842266 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-58c61fc9-e460-4653-9021-23333d785fa5 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:25:34.843587 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-58c61fc9-e460-4653-9021-23333d785fa5 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:25:34.844426 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-58c61fc9-e460-4653-9021-23333d785fa5 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:25:34.844899 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-58c61fc9-e460-4653-9021-23333d785fa5 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:25:34.845343 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-58c61fc9-e460-4653-9021-23333d785fa5 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:25:34.850688 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-975fd15d-75e7-48ae-925d-5322ee4fa64e req-15688929-5882-4445-9052-e68059e840da service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:25:34.851553 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-975fd15d-75e7-48ae-925d-5322ee4fa64e req-15688929-5882-4445-9052-e68059e840da service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:25:34.852057 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-975fd15d-75e7-48ae-925d-5322ee4fa64e req-15688929-5882-4445-9052-e68059e840da service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:25:34.867985 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-975fd15d-75e7-48ae-925d-5322ee4fa64e req-15688929-5882-4445-9052-e68059e840da service nova] Creating event network-changed:8a646732-28ad-4f68-bcd9-d4be9c313732 for instance 5d02b648-04d3-46cc-b51f-29c17f2d78ef on n-h2-850468-14 Aug 11 00:25:34.873305 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-975fd15d-75e7-48ae-925d-5322ee4fa64e req-15688929-5882-4445-9052-e68059e840da service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045547 Aug 11 00:25:34.874145 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3587/7380] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 11 00:25:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 00:25:34.882347 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-58c61fc9-e460-4653-9021-23333d785fa5 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] [instance: 5d02b648-04d3-46cc-b51f-29c17f2d78ef] Going to try to terminate instance {{(pid=122633) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 11 00:25:34.969593 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-58c61fc9-e460-4653-9021-23333d785fa5 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] 10.222.0.58 "DELETE /compute/v2.1/servers/5d02b648-04d3-46cc-b51f-29c17f2d78ef" status: 204 len: 0 microversion: 2.1 time: 0.143752 Aug 11 00:25:34.970440 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3794/7381] 10.222.0.58 () {58 vars in 1239 bytes} [Thu Aug 11 00:25:34 2022] DELETE /compute/v2.1/servers/5d02b648-04d3-46cc-b51f-29c17f2d78ef => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 11 00:25:34.980933 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-9c023bcd-b203-40b7-a847-b1846db2a17b tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:25:34.981677 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-9c023bcd-b203-40b7-a847-b1846db2a17b tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] [instance: 5d02b648-04d3-46cc-b51f-29c17f2d78ef] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:25:34.989825 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9c023bcd-b203-40b7-a847-b1846db2a17b tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:25:34.990326 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9c023bcd-b203-40b7-a847-b1846db2a17b tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:25:34.990756 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9c023bcd-b203-40b7-a847-b1846db2a17b tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:25:34.991584 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9c023bcd-b203-40b7-a847-b1846db2a17b tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:25:34.992045 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9c023bcd-b203-40b7-a847-b1846db2a17b tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:25:34.992486 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9c023bcd-b203-40b7-a847-b1846db2a17b tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:25:35.165421 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-9c023bcd-b203-40b7-a847-b1846db2a17b tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a07aed22e5242308216005a51ee6e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afd506533304073a9f9d246eb7a4434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:25:35.173192 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-9c023bcd-b203-40b7-a847-b1846db2a17b tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] 10.222.0.58 "GET /compute/v2.1/servers/5d02b648-04d3-46cc-b51f-29c17f2d78ef" status: 200 len: 1568 microversion: 2.1 time: 0.197762 Aug 11 00:25:35.173777 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3588/7382] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:25:34 2022] GET /compute/v2.1/servers/5d02b648-04d3-46cc-b51f-29c17f2d78ef => generated 1568 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:25:36.195966 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-84366276-65ea-4516-a4bb-a745f668bb7d tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:25:36.196930 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-84366276-65ea-4516-a4bb-a745f668bb7d tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] [instance: 5d02b648-04d3-46cc-b51f-29c17f2d78ef] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:25:36.205087 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-84366276-65ea-4516-a4bb-a745f668bb7d tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:25:36.205595 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-84366276-65ea-4516-a4bb-a745f668bb7d tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:25:36.206049 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-84366276-65ea-4516-a4bb-a745f668bb7d tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:25:36.206813 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-84366276-65ea-4516-a4bb-a745f668bb7d tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:25:36.207289 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-84366276-65ea-4516-a4bb-a745f668bb7d tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:25:36.207794 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-84366276-65ea-4516-a4bb-a745f668bb7d tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:25:36.356321 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-84366276-65ea-4516-a4bb-a745f668bb7d tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a07aed22e5242308216005a51ee6e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afd506533304073a9f9d246eb7a4434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:25:36.364663 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-84366276-65ea-4516-a4bb-a745f668bb7d tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] 10.222.0.58 "GET /compute/v2.1/servers/5d02b648-04d3-46cc-b51f-29c17f2d78ef" status: 200 len: 1568 microversion: 2.1 time: 0.173034 Aug 11 00:25:36.365244 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3795/7383] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:25:36 2022] GET /compute/v2.1/servers/5d02b648-04d3-46cc-b51f-29c17f2d78ef => generated 1568 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:25:37.267106 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-7d14feaf-57e0-4f82-92e5-1a8a85e39fb3 req-902ffd6c-9291-4e1c-bf15-35e8a3de2040 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d02b648-04d3-46cc-b51f-29c17f2d78ef", "name": "network-vif-deleted", "tag": "8a646732-28ad-4f68-bcd9-d4be9c313732"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 00:25:37.277587 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-7d14feaf-57e0-4f82-92e5-1a8a85e39fb3 req-902ffd6c-9291-4e1c-bf15-35e8a3de2040 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:25:37.278257 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-7d14feaf-57e0-4f82-92e5-1a8a85e39fb3 req-902ffd6c-9291-4e1c-bf15-35e8a3de2040 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:25:37.278766 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-7d14feaf-57e0-4f82-92e5-1a8a85e39fb3 req-902ffd6c-9291-4e1c-bf15-35e8a3de2040 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:25:37.290986 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-7d14feaf-57e0-4f82-92e5-1a8a85e39fb3 req-902ffd6c-9291-4e1c-bf15-35e8a3de2040 service nova] Creating event network-vif-deleted:8a646732-28ad-4f68-bcd9-d4be9c313732 for instance 5d02b648-04d3-46cc-b51f-29c17f2d78ef on n-h2-850468-14 Aug 11 00:25:37.295778 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-7d14feaf-57e0-4f82-92e5-1a8a85e39fb3 req-902ffd6c-9291-4e1c-bf15-35e8a3de2040 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097064 Aug 11 00:25:37.297132 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3589/7384] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 11 00:25:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 00:25:37.386173 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-e7ba50a8-3d3a-42af-9795-d941b8d4a281 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:25:37.386726 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-e7ba50a8-3d3a-42af-9795-d941b8d4a281 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] [instance: 5d02b648-04d3-46cc-b51f-29c17f2d78ef] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:25:37.394676 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e7ba50a8-3d3a-42af-9795-d941b8d4a281 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:25:37.395233 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e7ba50a8-3d3a-42af-9795-d941b8d4a281 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:25:37.395685 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e7ba50a8-3d3a-42af-9795-d941b8d4a281 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:25:37.396655 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e7ba50a8-3d3a-42af-9795-d941b8d4a281 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:25:37.397125 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e7ba50a8-3d3a-42af-9795-d941b8d4a281 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:25:37.397562 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-e7ba50a8-3d3a-42af-9795-d941b8d4a281 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:25:37.466181 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-e7ba50a8-3d3a-42af-9795-d941b8d4a281 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a07aed22e5242308216005a51ee6e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afd506533304073a9f9d246eb7a4434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:25:37.474650 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-e7ba50a8-3d3a-42af-9795-d941b8d4a281 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] 10.222.0.58 "GET /compute/v2.1/servers/5d02b648-04d3-46cc-b51f-29c17f2d78ef" status: 200 len: 1219 microversion: 2.1 time: 0.092537 Aug 11 00:25:37.475271 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3796/7385] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:25:37 2022] GET /compute/v2.1/servers/5d02b648-04d3-46cc-b51f-29c17f2d78ef => generated 1219 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:25:38.497895 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-6cb56908-a4d7-4944-a38b-57508a20e9f2 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:25:38.498522 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-6cb56908-a4d7-4944-a38b-57508a20e9f2 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] [instance: 5d02b648-04d3-46cc-b51f-29c17f2d78ef] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:25:38.504953 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6cb56908-a4d7-4944-a38b-57508a20e9f2 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:25:38.505443 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6cb56908-a4d7-4944-a38b-57508a20e9f2 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:25:38.505886 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6cb56908-a4d7-4944-a38b-57508a20e9f2 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:25:38.506589 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6cb56908-a4d7-4944-a38b-57508a20e9f2 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:25:38.507083 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6cb56908-a4d7-4944-a38b-57508a20e9f2 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:25:38.507518 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6cb56908-a4d7-4944-a38b-57508a20e9f2 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:25:38.578540 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-6cb56908-a4d7-4944-a38b-57508a20e9f2 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a07aed22e5242308216005a51ee6e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afd506533304073a9f9d246eb7a4434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:25:38.586347 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-6cb56908-a4d7-4944-a38b-57508a20e9f2 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] 10.222.0.58 "GET /compute/v2.1/servers/5d02b648-04d3-46cc-b51f-29c17f2d78ef" status: 200 len: 1219 microversion: 2.1 time: 0.093774 Aug 11 00:25:38.586949 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3590/7386] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:25:38 2022] GET /compute/v2.1/servers/5d02b648-04d3-46cc-b51f-29c17f2d78ef => generated 1219 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:25:39.608115 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-eae004d3-90c4-4d61-9b6f-2200dd664545 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:25:39.609764 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-eae004d3-90c4-4d61-9b6f-2200dd664545 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] [instance: 5d02b648-04d3-46cc-b51f-29c17f2d78ef] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:25:39.616492 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-eae004d3-90c4-4d61-9b6f-2200dd664545 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:25:39.616997 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-eae004d3-90c4-4d61-9b6f-2200dd664545 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:25:39.617452 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-eae004d3-90c4-4d61-9b6f-2200dd664545 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:25:39.618182 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-eae004d3-90c4-4d61-9b6f-2200dd664545 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:25:39.618654 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-eae004d3-90c4-4d61-9b6f-2200dd664545 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:25:39.619132 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-eae004d3-90c4-4d61-9b6f-2200dd664545 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:25:39.684726 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-eae004d3-90c4-4d61-9b6f-2200dd664545 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a07aed22e5242308216005a51ee6e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afd506533304073a9f9d246eb7a4434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:25:39.693417 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-eae004d3-90c4-4d61-9b6f-2200dd664545 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] 10.222.0.58 "GET /compute/v2.1/servers/5d02b648-04d3-46cc-b51f-29c17f2d78ef" status: 200 len: 1219 microversion: 2.1 time: 0.089216 Aug 11 00:25:39.694867 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3797/7387] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:25:39 2022] GET /compute/v2.1/servers/5d02b648-04d3-46cc-b51f-29c17f2d78ef => generated 1219 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:25:40.713682 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-6beae378-c218-4231-9be0-21c4e4c9d1ef tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:25:40.714327 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-6beae378-c218-4231-9be0-21c4e4c9d1ef tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] [instance: 5d02b648-04d3-46cc-b51f-29c17f2d78ef] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:25:40.721666 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6beae378-c218-4231-9be0-21c4e4c9d1ef tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:25:40.721978 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6beae378-c218-4231-9be0-21c4e4c9d1ef tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:25:40.722587 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6beae378-c218-4231-9be0-21c4e4c9d1ef tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:25:40.723379 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6beae378-c218-4231-9be0-21c4e4c9d1ef tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:25:40.723955 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6beae378-c218-4231-9be0-21c4e4c9d1ef tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:25:40.724381 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6beae378-c218-4231-9be0-21c4e4c9d1ef tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:25:40.798063 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-6beae378-c218-4231-9be0-21c4e4c9d1ef tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a07aed22e5242308216005a51ee6e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afd506533304073a9f9d246eb7a4434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:25:40.824831 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-6beae378-c218-4231-9be0-21c4e4c9d1ef tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] 10.222.0.58 "GET /compute/v2.1/servers/5d02b648-04d3-46cc-b51f-29c17f2d78ef" status: 200 len: 1219 microversion: 2.1 time: 0.114948 Aug 11 00:25:40.825427 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3591/7388] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:25:40 2022] GET /compute/v2.1/servers/5d02b648-04d3-46cc-b51f-29c17f2d78ef => generated 1219 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:25:41.846844 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-457b7c44-106d-439b-b3b8-0488cf41b476 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:25:41.847590 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-457b7c44-106d-439b-b3b8-0488cf41b476 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] [instance: 5d02b648-04d3-46cc-b51f-29c17f2d78ef] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:25:41.854545 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-457b7c44-106d-439b-b3b8-0488cf41b476 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:25:41.855154 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-457b7c44-106d-439b-b3b8-0488cf41b476 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:25:41.855710 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-457b7c44-106d-439b-b3b8-0488cf41b476 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:25:41.856487 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-457b7c44-106d-439b-b3b8-0488cf41b476 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:25:41.857268 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-457b7c44-106d-439b-b3b8-0488cf41b476 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:25:41.857826 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-457b7c44-106d-439b-b3b8-0488cf41b476 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:25:41.891748 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-457b7c44-106d-439b-b3b8-0488cf41b476 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:25:41.892250 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-457b7c44-106d-439b-b3b8-0488cf41b476 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:25:41.892799 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-457b7c44-106d-439b-b3b8-0488cf41b476 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:25:41.893262 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.objects.instance [None req-457b7c44-106d-439b-b3b8-0488cf41b476 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lazy-loading 'fault' on Instance uuid 5d02b648-04d3-46cc-b51f-29c17f2d78ef {{(pid=122633) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 11 00:25:41.944742 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-457b7c44-106d-439b-b3b8-0488cf41b476 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a07aed22e5242308216005a51ee6e8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7afd506533304073a9f9d246eb7a4434', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:25:41.955006 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-457b7c44-106d-439b-b3b8-0488cf41b476 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] 10.222.0.58 "GET /compute/v2.1/servers/5d02b648-04d3-46cc-b51f-29c17f2d78ef" status: 200 len: 1224 microversion: 2.1 time: 0.112303 Aug 11 00:25:41.955684 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3798/7389] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:25:41 2022] GET /compute/v2.1/servers/5d02b648-04d3-46cc-b51f-29c17f2d78ef => generated 1224 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:25:42.977306 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-800274f8-ef6c-48fb-b3db-b91e6332c314 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:25:42.978097 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-800274f8-ef6c-48fb-b3db-b91e6332c314 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] [instance: 5d02b648-04d3-46cc-b51f-29c17f2d78ef] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:25:42.985244 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-800274f8-ef6c-48fb-b3db-b91e6332c314 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:25:42.985733 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-800274f8-ef6c-48fb-b3db-b91e6332c314 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:25:42.986176 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-800274f8-ef6c-48fb-b3db-b91e6332c314 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:25:42.986908 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-800274f8-ef6c-48fb-b3db-b91e6332c314 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:25:42.987369 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-800274f8-ef6c-48fb-b3db-b91e6332c314 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:25:42.987797 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-800274f8-ef6c-48fb-b3db-b91e6332c314 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:25:43.002097 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-800274f8-ef6c-48fb-b3db-b91e6332c314 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] HTTP exception thrown: Instance 5d02b648-04d3-46cc-b51f-29c17f2d78ef could not be found. Aug 11 00:25:43.003832 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-800274f8-ef6c-48fb-b3db-b91e6332c314 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Request method failure captured: Aug 11 00:25:43.003832 n-d-850468-14 devstack@n-api.service[122632]: request: GET /compute/v2.1/servers/5d02b648-04d3-46cc-b51f-29c17f2d78ef HTTP/1.1 Aug 11 00:25:43.003832 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 11 00:25:43.003832 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 11 00:25:43.003832 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 11 00:25:43.003832 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 11 00:25:43.003832 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 11 00:25:43.003832 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 11 00:25:43.003832 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 11 00:25:43.003832 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 11 00:25:43.003832 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9Ep2i-MnPdId4aaozRGou-ZKLfdCVEV7UMbPvLI743C1v2ZYSZjJ-wbtHC5kRJyMx5405ujgXPeGeqnYQm4bL8lU_AELXyOWEgm2tv41esiq__kqn4GwBgDuqOju8RV1GNbrWF9agyXy3IlAxm7NLGDoCP69cst8CrKBtWSFhLxZh24 Aug 11 00:25:43.003832 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 11 00:25:43.003832 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 11 00:25:43.003832 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 11 00:25:43.003832 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 11 00:25:43.003832 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 11 00:25:43.003832 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 11 00:25:43.003832 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 7afd506533304073a9f9d246eb7a4434 Aug 11 00:25:43.003832 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-TestShelveInstance-668600046 Aug 11 00:25:43.003832 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 11 00:25:43.003832 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 11 00:25:43.003832 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7afd506533304073a9f9d246eb7a4434"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/7afd506533304073a9f9d246eb7a4434"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/7afd506533304073a9f9d246eb7a4434"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_7afd506533304073a9f9d246eb7a4434", "adminURL": "http://10.222.0.58:8080"}]}] Aug 11 00:25:43.003832 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-TestShelveInstance-668600046 Aug 11 00:25:43.003832 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 7afd506533304073a9f9d246eb7a4434 Aug 11 00:25:43.003832 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-TestShelveInstance-668600046 Aug 11 00:25:43.003832 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-TestShelveInstance-668600046-project Aug 11 00:25:43.003832 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 11 00:25:43.003832 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 11 00:25:43.003832 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: 1a07aed22e5242308216005a51ee6e8b Aug 11 00:25:43.003832 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-TestShelveInstance-668600046-project Aug 11 00:25:43.003832 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 11 00:25:43.003832 n-d-850468-14 devstack@n-api.service[122632]: exception: Instance 5d02b648-04d3-46cc-b51f-29c17f2d78ef could not be found. Aug 11 00:25:43.003832 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': '5d02b648-04d3-46cc-b51f-29c17f2d78ef'} Aug 11 00:25:43.003832 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 00:25:43.003832 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 00:25:43.003832 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 11 00:25:43.003832 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 11 00:25:43.003832 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 11 00:25:43.003832 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 11 00:25:43.003832 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 11 00:25:43.003832 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 11 00:25:43.003832 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 11 00:25:43.003832 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 11 00:25:43.003832 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d02b648-04d3-46cc-b51f-29c17f2d78ef could not be found. Aug 11 00:25:43.003832 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 11 00:25:43.003832 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 00:25:43.003832 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 11 00:25:43.003832 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 00:25:43.003832 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 00:25:43.003832 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 00:25:43.003832 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 00:25:43.003832 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 00:25:43.003832 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 00:25:43.003832 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 00:25:43.003832 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 11 00:25:43.003832 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 11 00:25:43.003832 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 11 00:25:43.003832 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 11 00:25:43.003832 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 11 00:25:43.003832 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 11 00:25:43.003832 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d02b648-04d3-46cc-b51f-29c17f2d78ef could not be found. Aug 11 00:25:43.003832 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 11 00:25:43.003832 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 00:25:43.003832 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 11 00:25:43.008870 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 00:25:43.008870 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 00:25:43.008870 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 00:25:43.008870 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 00:25:43.008870 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 00:25:43.008870 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d02b648-04d3-46cc-b51f-29c17f2d78ef could not be found. Aug 11 00:25:43.008870 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 11 00:25:43.008870 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-800274f8-ef6c-48fb-b3db-b91e6332c314 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Returning 404 to user: Instance 5d02b648-04d3-46cc-b51f-29c17f2d78ef could not be found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 00:25:43.008870 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-800274f8-ef6c-48fb-b3db-b91e6332c314 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] 10.222.0.58 "GET /compute/v2.1/servers/5d02b648-04d3-46cc-b51f-29c17f2d78ef" status: 404 len: 111 microversion: 2.1 time: 0.032127 Aug 11 00:25:43.009569 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3592/7390] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:25:42 2022] GET /compute/v2.1/servers/5d02b648-04d3-46cc-b51f-29c17f2d78ef => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 11 00:25:43.179264 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-99c31bd8-2f38-45c7-8d72-c100ba3277a6 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] Calling method '.version_select at 0x7f846c53daf0>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:25:43.221316 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-99c31bd8-2f38-45c7-8d72-c100ba3277a6 tempest-TestShelveInstance-668600046 tempest-TestShelveInstance-668600046-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-324195895" status: 202 len: 0 microversion: 2.1 time: 0.048131 Aug 11 00:25:43.221910 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3799/7391] 10.222.0.58 () {58 vars in 1251 bytes} [Thu Aug 11 00:25:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-324195895 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 11 00:26:00.714589 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_api:SELECT=12 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:26:00.716290 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=24 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:26:00.945878 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-44822b95-213b-4414-b5d1-1050a1aab418 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Action: 'create', calling method: .version_select at 0x7f847c5fc790>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-1716436383", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDRYSu+rTgvPQ6E44dpUt8cwrjb2SJsS1XAjyAjrrq2DWLpzAKGuZlqoPblXi99/zTldjdiI4LZqUjMYRcUlclx9YVYSMgGYYshe2DdkOKn1UlvEyd1EIVXNEcm0DJUNOw=="}} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 00:26:00.970029 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-44822b95-213b-4414-b5d1-1050a1aab418 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Getting quotas for project 81cc48c29b8943bca4d0721c78ac5f5a. Resources: {'key_pairs'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 11 00:26:00.977330 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.quota [None req-44822b95-213b-4414-b5d1-1050a1aab418 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Getting quotas for user 57829b774c384f4789844df1330c7d0d and project 81cc48c29b8943bca4d0721c78ac5f5a. Resources: {'key_pairs'} {{(pid=122632) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 11 00:26:01.013672 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-44822b95-213b-4414-b5d1-1050a1aab418 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.305568 Aug 11 00:26:01.014593 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3593/7392] 10.222.0.58 () {60 vars in 1159 bytes} [Thu Aug 11 00:26:00 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 00:26:02.031695 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:26:02.032583 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:26:02.037729 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-826dce85-6cef-4ead-a300-597623f5bc91 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-824593924", "imageRef": "78ad8905-f66f-4733-8be9-2b260f1fabed", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1716436383", "security_groups": [{"name": "tempest-secgroup-smoke-1724494583"}], "networks": [{"uuid": "70fbb278-f35c-49f3-bc13-c1942cc48b73"}]}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 00:26:02.165392 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.network.neutron [None req-826dce85-6cef-4ead-a300-597623f5bc91 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] validate_networks() for [('70fbb278-f35c-49f3-bc13-c1942cc48b73', None, None, None, None, None)] {{(pid=122633) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 11 00:26:02.719562 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-826dce85-6cef-4ead-a300-597623f5bc91 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Flavor limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 11 00:26:02.719840 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-826dce85-6cef-4ead-a300-597623f5bc91 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Image limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 11 00:26:02.720483 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-826dce85-6cef-4ead-a300-597623f5bc91 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Flavor pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 11 00:26:02.721197 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-826dce85-6cef-4ead-a300-597623f5bc91 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Image pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 11 00:26:02.721940 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-826dce85-6cef-4ead-a300-597623f5bc91 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 11 00:26:02.741238 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-826dce85-6cef-4ead-a300-597623f5bc91 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:26:02.741740 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-826dce85-6cef-4ead-a300-597623f5bc91 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:26:02.742184 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-826dce85-6cef-4ead-a300-597623f5bc91 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:26:02.743131 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-826dce85-6cef-4ead-a300-597623f5bc91 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:26:02.743784 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-826dce85-6cef-4ead-a300-597623f5bc91 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:26:02.744800 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-826dce85-6cef-4ead-a300-597623f5bc91 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:26:02.764711 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-826dce85-6cef-4ead-a300-597623f5bc91 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Getting quotas for project 81cc48c29b8943bca4d0721c78ac5f5a. Resources: {'instances', 'cores', 'ram'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 11 00:26:02.772060 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-826dce85-6cef-4ead-a300-597623f5bc91 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Getting quotas for user 57829b774c384f4789844df1330c7d0d and project 81cc48c29b8943bca4d0721c78ac5f5a. Resources: {'instances', 'cores', 'ram'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 11 00:26:02.786508 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-826dce85-6cef-4ead-a300-597623f5bc91 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Going to run 1 instances... {{(pid=122633) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 11 00:26:02.788822 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-826dce85-6cef-4ead-a300-597623f5bc91 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] [instance: 3bc9b543-fa83-4013-9191-766e5aa8a844] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='78ad8905-f66f-4733-8be9-2b260f1fabed',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122633) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 11 00:26:02.838923 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-826dce85-6cef-4ead-a300-597623f5bc91 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.809729 Aug 11 00:26:02.839750 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3800/7393] 10.222.0.58 () {60 vars in 1147 bytes} [Thu Aug 11 00:26:02 2022] POST /compute/v2.1/servers => generated 406 bytes in 811 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 11 00:26:02.852293 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-2fc49d5f-5b38-4bb5-9fc6-3c51750797b1 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:26:02.852974 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-2fc49d5f-5b38-4bb5-9fc6-3c51750797b1 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] [instance: 3bc9b543-fa83-4013-9191-766e5aa8a844] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:26:02.924223 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-2fc49d5f-5b38-4bb5-9fc6-3c51750797b1 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57829b774c384f4789844df1330c7d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81cc48c29b8943bca4d0721c78ac5f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:26:02.934492 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-2fc49d5f-5b38-4bb5-9fc6-3c51750797b1 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] 10.222.0.58 "GET /compute/v2.1/servers/3bc9b543-fa83-4013-9191-766e5aa8a844" status: 200 len: 1248 microversion: 2.1 time: 0.083461 Aug 11 00:26:02.935397 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3594/7394] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:26:02 2022] GET /compute/v2.1/servers/3bc9b543-fa83-4013-9191-766e5aa8a844 => generated 1248 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:26:03.960323 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-1d0f22f7-f9e5-41ef-881a-4a0cfb40e997 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:26:03.961692 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-1d0f22f7-f9e5-41ef-881a-4a0cfb40e997 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] [instance: 3bc9b543-fa83-4013-9191-766e5aa8a844] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:26:03.969925 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1d0f22f7-f9e5-41ef-881a-4a0cfb40e997 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:26:03.970618 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1d0f22f7-f9e5-41ef-881a-4a0cfb40e997 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:26:03.971287 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1d0f22f7-f9e5-41ef-881a-4a0cfb40e997 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:26:03.972220 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1d0f22f7-f9e5-41ef-881a-4a0cfb40e997 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:26:03.972691 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1d0f22f7-f9e5-41ef-881a-4a0cfb40e997 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:26:03.973115 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1d0f22f7-f9e5-41ef-881a-4a0cfb40e997 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:26:04.054960 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-1d0f22f7-f9e5-41ef-881a-4a0cfb40e997 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57829b774c384f4789844df1330c7d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81cc48c29b8943bca4d0721c78ac5f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:26:04.069059 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-1d0f22f7-f9e5-41ef-881a-4a0cfb40e997 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] 10.222.0.58 "GET /compute/v2.1/servers/3bc9b543-fa83-4013-9191-766e5aa8a844" status: 200 len: 1300 microversion: 2.1 time: 0.113548 Aug 11 00:26:04.086727 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3801/7395] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:26:03 2022] GET /compute/v2.1/servers/3bc9b543-fa83-4013-9191-766e5aa8a844 => generated 1300 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:26:05.093087 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-667567ff-2274-4f98-824b-52c2aa17ea59 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:26:05.094582 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-667567ff-2274-4f98-824b-52c2aa17ea59 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] [instance: 3bc9b543-fa83-4013-9191-766e5aa8a844] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:26:05.102599 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-667567ff-2274-4f98-824b-52c2aa17ea59 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:26:05.103450 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-667567ff-2274-4f98-824b-52c2aa17ea59 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:26:05.104001 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-667567ff-2274-4f98-824b-52c2aa17ea59 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:26:05.104791 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-667567ff-2274-4f98-824b-52c2aa17ea59 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:26:05.105342 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-667567ff-2274-4f98-824b-52c2aa17ea59 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:26:05.105841 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-667567ff-2274-4f98-824b-52c2aa17ea59 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:26:05.372430 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-667567ff-2274-4f98-824b-52c2aa17ea59 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57829b774c384f4789844df1330c7d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81cc48c29b8943bca4d0721c78ac5f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:26:05.382388 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-667567ff-2274-4f98-824b-52c2aa17ea59 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] 10.222.0.58 "GET /compute/v2.1/servers/3bc9b543-fa83-4013-9191-766e5aa8a844" status: 200 len: 1374 microversion: 2.1 time: 0.293185 Aug 11 00:26:05.383091 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3595/7396] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:26:05 2022] GET /compute/v2.1/servers/3bc9b543-fa83-4013-9191-766e5aa8a844 => generated 1374 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:26:05.976569 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-e19c5028-d161-4da7-8eef-cf0ac89a7498 req-14a68a8f-010a-4e37-9a2f-a5a9f4a61069 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3bc9b543-fa83-4013-9191-766e5aa8a844", "tag": "5b1189c2-4066-46a8-a492-5253d2c30bc0"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 00:26:05.988238 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-e19c5028-d161-4da7-8eef-cf0ac89a7498 req-14a68a8f-010a-4e37-9a2f-a5a9f4a61069 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:26:05.988880 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-e19c5028-d161-4da7-8eef-cf0ac89a7498 req-14a68a8f-010a-4e37-9a2f-a5a9f4a61069 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:26:05.989432 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-e19c5028-d161-4da7-8eef-cf0ac89a7498 req-14a68a8f-010a-4e37-9a2f-a5a9f4a61069 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:26:06.005503 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-e19c5028-d161-4da7-8eef-cf0ac89a7498 req-14a68a8f-010a-4e37-9a2f-a5a9f4a61069 service nova] Creating event network-changed:5b1189c2-4066-46a8-a492-5253d2c30bc0 for instance 3bc9b543-fa83-4013-9191-766e5aa8a844 on n-h1-850468-14 Aug 11 00:26:06.011453 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-e19c5028-d161-4da7-8eef-cf0ac89a7498 req-14a68a8f-010a-4e37-9a2f-a5a9f4a61069 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038869 Aug 11 00:26:06.012234 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3802/7397] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 11 00:26:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 00:26:06.404368 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-9239be4f-33d5-450e-bdc9-665fa3271714 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:26:06.404963 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-9239be4f-33d5-450e-bdc9-665fa3271714 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] [instance: 3bc9b543-fa83-4013-9191-766e5aa8a844] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:26:06.413947 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9239be4f-33d5-450e-bdc9-665fa3271714 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:26:06.414440 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9239be4f-33d5-450e-bdc9-665fa3271714 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:26:06.414909 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9239be4f-33d5-450e-bdc9-665fa3271714 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:26:06.415858 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9239be4f-33d5-450e-bdc9-665fa3271714 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:26:06.416501 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9239be4f-33d5-450e-bdc9-665fa3271714 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:26:06.417135 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9239be4f-33d5-450e-bdc9-665fa3271714 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:26:06.573796 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-9239be4f-33d5-450e-bdc9-665fa3271714 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57829b774c384f4789844df1330c7d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81cc48c29b8943bca4d0721c78ac5f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:26:06.583581 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-9239be4f-33d5-450e-bdc9-665fa3271714 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] 10.222.0.58 "GET /compute/v2.1/servers/3bc9b543-fa83-4013-9191-766e5aa8a844" status: 200 len: 1374 microversion: 2.1 time: 0.183161 Aug 11 00:26:06.584200 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3596/7398] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:26:06 2022] GET /compute/v2.1/servers/3bc9b543-fa83-4013-9191-766e5aa8a844 => generated 1374 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:26:07.606257 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-5c28caa5-8950-4996-8faa-f22c028416ba tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:26:07.607036 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-5c28caa5-8950-4996-8faa-f22c028416ba tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] [instance: 3bc9b543-fa83-4013-9191-766e5aa8a844] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:26:07.615152 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5c28caa5-8950-4996-8faa-f22c028416ba tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:26:07.615803 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5c28caa5-8950-4996-8faa-f22c028416ba tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:26:07.616274 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5c28caa5-8950-4996-8faa-f22c028416ba tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:26:07.617028 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5c28caa5-8950-4996-8faa-f22c028416ba tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:26:07.617501 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5c28caa5-8950-4996-8faa-f22c028416ba tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:26:07.617941 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-5c28caa5-8950-4996-8faa-f22c028416ba tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:26:07.764573 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-5c28caa5-8950-4996-8faa-f22c028416ba tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57829b774c384f4789844df1330c7d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81cc48c29b8943bca4d0721c78ac5f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:26:07.772489 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-5c28caa5-8950-4996-8faa-f22c028416ba tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] 10.222.0.58 "GET /compute/v2.1/servers/3bc9b543-fa83-4013-9191-766e5aa8a844" status: 200 len: 1374 microversion: 2.1 time: 0.171095 Aug 11 00:26:07.773073 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3803/7399] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:26:07 2022] GET /compute/v2.1/servers/3bc9b543-fa83-4013-9191-766e5aa8a844 => generated 1374 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:26:08.793585 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-b951b1cf-ee7f-4af1-98e7-a2b1d71c6d9e tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:26:08.794190 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-b951b1cf-ee7f-4af1-98e7-a2b1d71c6d9e tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] [instance: 3bc9b543-fa83-4013-9191-766e5aa8a844] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:26:08.802132 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b951b1cf-ee7f-4af1-98e7-a2b1d71c6d9e tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:26:08.802612 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b951b1cf-ee7f-4af1-98e7-a2b1d71c6d9e tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:26:08.803083 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b951b1cf-ee7f-4af1-98e7-a2b1d71c6d9e tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:26:08.803773 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b951b1cf-ee7f-4af1-98e7-a2b1d71c6d9e tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:26:08.804217 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b951b1cf-ee7f-4af1-98e7-a2b1d71c6d9e tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:26:08.804633 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b951b1cf-ee7f-4af1-98e7-a2b1d71c6d9e tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:26:08.993328 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-b951b1cf-ee7f-4af1-98e7-a2b1d71c6d9e tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57829b774c384f4789844df1330c7d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81cc48c29b8943bca4d0721c78ac5f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:26:09.001908 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-b951b1cf-ee7f-4af1-98e7-a2b1d71c6d9e tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] 10.222.0.58 "GET /compute/v2.1/servers/3bc9b543-fa83-4013-9191-766e5aa8a844" status: 200 len: 1374 microversion: 2.1 time: 0.212249 Aug 11 00:26:09.002496 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3597/7400] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:26:08 2022] GET /compute/v2.1/servers/3bc9b543-fa83-4013-9191-766e5aa8a844 => generated 1374 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:26:10.022836 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c1caecc3-ea1a-4cc9-a4fd-81780e7bab13 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:26:10.023463 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-c1caecc3-ea1a-4cc9-a4fd-81780e7bab13 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] [instance: 3bc9b543-fa83-4013-9191-766e5aa8a844] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:26:10.030168 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c1caecc3-ea1a-4cc9-a4fd-81780e7bab13 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:26:10.030743 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c1caecc3-ea1a-4cc9-a4fd-81780e7bab13 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:26:10.031846 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c1caecc3-ea1a-4cc9-a4fd-81780e7bab13 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:26:10.032576 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c1caecc3-ea1a-4cc9-a4fd-81780e7bab13 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:26:10.033041 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c1caecc3-ea1a-4cc9-a4fd-81780e7bab13 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:26:10.033477 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c1caecc3-ea1a-4cc9-a4fd-81780e7bab13 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:26:10.056754 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-7b90cdb6-3674-4d30-bea4-31a9164e787a req-6ea97144-3992-4462-a1c3-9896c60346ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bc9b543-fa83-4013-9191-766e5aa8a844", "name": "network-vif-plugged", "status": "completed", "tag": "5b1189c2-4066-46a8-a492-5253d2c30bc0"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 00:26:10.070042 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-7b90cdb6-3674-4d30-bea4-31a9164e787a req-6ea97144-3992-4462-a1c3-9896c60346ce service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:26:10.070589 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-7b90cdb6-3674-4d30-bea4-31a9164e787a req-6ea97144-3992-4462-a1c3-9896c60346ce service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:26:10.071052 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-7b90cdb6-3674-4d30-bea4-31a9164e787a req-6ea97144-3992-4462-a1c3-9896c60346ce service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:26:10.085066 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-7b90cdb6-3674-4d30-bea4-31a9164e787a req-6ea97144-3992-4462-a1c3-9896c60346ce service nova] Creating event network-vif-plugged:5b1189c2-4066-46a8-a492-5253d2c30bc0 for instance 3bc9b543-fa83-4013-9191-766e5aa8a844 on n-h1-850468-14 Aug 11 00:26:10.090193 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-7b90cdb6-3674-4d30-bea4-31a9164e787a req-6ea97144-3992-4462-a1c3-9896c60346ce service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037507 Aug 11 00:26:10.090813 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3598/7401] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 11 00:26:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 11 00:26:10.238777 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-c1caecc3-ea1a-4cc9-a4fd-81780e7bab13 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57829b774c384f4789844df1330c7d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81cc48c29b8943bca4d0721c78ac5f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:26:10.246513 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-c1caecc3-ea1a-4cc9-a4fd-81780e7bab13 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] 10.222.0.58 "GET /compute/v2.1/servers/3bc9b543-fa83-4013-9191-766e5aa8a844" status: 200 len: 1374 microversion: 2.1 time: 0.227756 Aug 11 00:26:10.247274 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3804/7402] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:26:10 2022] GET /compute/v2.1/servers/3bc9b543-fa83-4013-9191-766e5aa8a844 => generated 1374 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:26:11.269423 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-20a842ec-7007-4df3-bb51-e7e7befa0096 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:26:11.270133 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-20a842ec-7007-4df3-bb51-e7e7befa0096 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] [instance: 3bc9b543-fa83-4013-9191-766e5aa8a844] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:26:11.277055 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-20a842ec-7007-4df3-bb51-e7e7befa0096 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:26:11.277555 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-20a842ec-7007-4df3-bb51-e7e7befa0096 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:26:11.278008 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-20a842ec-7007-4df3-bb51-e7e7befa0096 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:26:11.278724 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-20a842ec-7007-4df3-bb51-e7e7befa0096 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:26:11.279215 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-20a842ec-7007-4df3-bb51-e7e7befa0096 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:26:11.279644 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-20a842ec-7007-4df3-bb51-e7e7befa0096 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:26:11.430141 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-20a842ec-7007-4df3-bb51-e7e7befa0096 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57829b774c384f4789844df1330c7d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81cc48c29b8943bca4d0721c78ac5f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:26:11.439199 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-20a842ec-7007-4df3-bb51-e7e7befa0096 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] 10.222.0.58 "GET /compute/v2.1/servers/3bc9b543-fa83-4013-9191-766e5aa8a844" status: 200 len: 1558 microversion: 2.1 time: 0.174816 Aug 11 00:26:11.440018 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3599/7403] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:26:11 2022] GET /compute/v2.1/servers/3bc9b543-fa83-4013-9191-766e5aa8a844 => generated 1558 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:26:11.461859 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-06f1c99a-17f5-4dcd-9012-620a3915acd8 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:26:11.462769 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-06f1c99a-17f5-4dcd-9012-620a3915acd8 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] [instance: 3bc9b543-fa83-4013-9191-766e5aa8a844] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:26:11.471575 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-06f1c99a-17f5-4dcd-9012-620a3915acd8 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:26:11.472084 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-06f1c99a-17f5-4dcd-9012-620a3915acd8 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:26:11.472590 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-06f1c99a-17f5-4dcd-9012-620a3915acd8 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:26:11.473291 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-06f1c99a-17f5-4dcd-9012-620a3915acd8 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:26:11.473763 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-06f1c99a-17f5-4dcd-9012-620a3915acd8 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:26:11.474206 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-06f1c99a-17f5-4dcd-9012-620a3915acd8 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:26:11.622726 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-06f1c99a-17f5-4dcd-9012-620a3915acd8 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57829b774c384f4789844df1330c7d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81cc48c29b8943bca4d0721c78ac5f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:26:11.630768 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-06f1c99a-17f5-4dcd-9012-620a3915acd8 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] 10.222.0.58 "GET /compute/v2.1/servers/3bc9b543-fa83-4013-9191-766e5aa8a844" status: 200 len: 1558 microversion: 2.1 time: 0.173826 Aug 11 00:26:11.631388 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3805/7404] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:26:11 2022] GET /compute/v2.1/servers/3bc9b543-fa83-4013-9191-766e5aa8a844 => generated 1558 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:26:13.367816 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-4c5de952-4eea-41f1-a832-55fd8aafa775 req-e990266f-3523-4ca1-89d1-1c7ce7051eb2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3bc9b543-fa83-4013-9191-766e5aa8a844", "tag": "5b1189c2-4066-46a8-a492-5253d2c30bc0"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 00:26:13.373432 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=6 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:26:13.380646 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-4c5de952-4eea-41f1-a832-55fd8aafa775 req-e990266f-3523-4ca1-89d1-1c7ce7051eb2 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:26:13.381119 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-4c5de952-4eea-41f1-a832-55fd8aafa775 req-e990266f-3523-4ca1-89d1-1c7ce7051eb2 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:26:13.381547 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-4c5de952-4eea-41f1-a832-55fd8aafa775 req-e990266f-3523-4ca1-89d1-1c7ce7051eb2 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:26:13.394334 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-4c5de952-4eea-41f1-a832-55fd8aafa775 req-e990266f-3523-4ca1-89d1-1c7ce7051eb2 service nova] Creating event network-changed:5b1189c2-4066-46a8-a492-5253d2c30bc0 for instance 3bc9b543-fa83-4013-9191-766e5aa8a844 on n-h1-850468-14 Aug 11 00:26:13.400417 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-4c5de952-4eea-41f1-a832-55fd8aafa775 req-e990266f-3523-4ca1-89d1-1c7ce7051eb2 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036181 Aug 11 00:26:13.401178 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3600/7405] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 11 00:26:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 00:27:09.443389 n-d-850468-14 devstack@n-api.service[122632]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 11 00:27:09.444107 n-d-850468-14 devstack@n-api.service[122632]: Thu Aug 11 00:27:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 11 00:28:09.556226 n-d-850468-14 devstack@n-api.service[122633]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5e7530cb-e34a-4714-9391-5480d11af743] AMQP server on 10.222.0.58:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 11 00:28:09.557153 n-d-850468-14 devstack@n-api.service[122633]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e2bb3e2a-85f2-4c49-98ff-2d6066099266] AMQP server on 10.222.0.58:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 11 00:28:09.557546 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=2 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:28:09.558316 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=6 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:28:09.559101 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_api:SELECT=25,nova_api:INSERT=3 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:28:09.559932 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=28 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:28:09.564418 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-aab28bd5-384b-48bb-a8dd-486e2a5df63e tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-854885119"}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 00:28:09.566900 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-aab28bd5-384b-48bb-a8dd-486e2a5df63e tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] [instance: 3bc9b543-fa83-4013-9191-766e5aa8a844] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:28:09.576086 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-aab28bd5-384b-48bb-a8dd-486e2a5df63e tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:28:09.576588 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-aab28bd5-384b-48bb-a8dd-486e2a5df63e tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:28:09.577045 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-aab28bd5-384b-48bb-a8dd-486e2a5df63e tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:28:09.577755 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-aab28bd5-384b-48bb-a8dd-486e2a5df63e tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:28:09.578223 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-aab28bd5-384b-48bb-a8dd-486e2a5df63e tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:28:09.578692 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-aab28bd5-384b-48bb-a8dd-486e2a5df63e tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:28:09.768725 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-aab28bd5-384b-48bb-a8dd-486e2a5df63e tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] 10.222.0.58 "POST /compute/v2.1/servers/3bc9b543-fa83-4013-9191-766e5aa8a844/action" status: 202 len: 0 microversion: 2.1 time: 0.214345 Aug 11 00:28:09.769276 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3806/7406] 10.222.0.58 () {60 vars in 1278 bytes} [Thu Aug 11 00:28:09 2022] POST /compute/v2.1/servers/3bc9b543-fa83-4013-9191-766e5aa8a844/action => generated 0 bytes in 216 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 11 00:28:14.828137 n-d-850468-14 devstack@n-api.service[122632]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cd3f72be-c5dc-40c0-bc95-e9b4d1b700e4] AMQP server on 10.222.0.58:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 11 00:28:14.829470 n-d-850468-14 devstack@n-api.service[122632]: ERROR oslo.messaging._drivers.impl_rabbit [-] [6aef4e7e-e576-4aec-8e05-1d4d3b8b22c0] AMQP server on 10.222.0.58:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 11 00:28:14.830155 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=1 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:28:14.831261 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=28 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:28:14.836083 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-4d9c8658-12d4-45ec-b8cc-5585d6755a9b req-e4d5662f-56ec-484f-932d-4690394c4e3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bc9b543-fa83-4013-9191-766e5aa8a844", "name": "network-vif-plugged", "status": "completed", "tag": "5b1189c2-4066-46a8-a492-5253d2c30bc0"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 00:28:14.861209 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-4d9c8658-12d4-45ec-b8cc-5585d6755a9b req-e4d5662f-56ec-484f-932d-4690394c4e3e service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:28:14.861696 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-4d9c8658-12d4-45ec-b8cc-5585d6755a9b req-e4d5662f-56ec-484f-932d-4690394c4e3e service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:28:14.862136 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-4d9c8658-12d4-45ec-b8cc-5585d6755a9b req-e4d5662f-56ec-484f-932d-4690394c4e3e service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:28:14.879481 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-4d9c8658-12d4-45ec-b8cc-5585d6755a9b req-e4d5662f-56ec-484f-932d-4690394c4e3e service nova] Creating event network-vif-plugged:5b1189c2-4066-46a8-a492-5253d2c30bc0 for instance 3bc9b543-fa83-4013-9191-766e5aa8a844 on n-h1-850468-14 Aug 11 00:28:14.885209 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-4d9c8658-12d4-45ec-b8cc-5585d6755a9b req-e4d5662f-56ec-484f-932d-4690394c4e3e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058350 Aug 11 00:28:14.886128 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3601/7407] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 11 00:28:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 00:28:23.324573 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-21173e44-47b8-4441-b2b0-cc4f71bd15cd tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1835557811", "imageRef": "9dfbeb7a-1355-4695-9e65-abb33ab21903", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1716436383", "security_groups": [{"name": "tempest-secgroup-smoke-1724494583"}], "networks": [{"uuid": "70fbb278-f35c-49f3-bc13-c1942cc48b73"}]}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 00:28:23.336040 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_api:SELECT=2 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:28:23.336868 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:28:23.358634 n-d-850468-14 devstack@n-api.service[122633]: INFO oslo.messaging._drivers.impl_rabbit [-] [e2bb3e2a-85f2-4c49-98ff-2d6066099266] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 42602. Aug 11 00:28:23.359554 n-d-850468-14 devstack@n-api.service[122633]: INFO oslo.messaging._drivers.impl_rabbit [-] [5e7530cb-e34a-4714-9391-5480d11af743] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 42600. Aug 11 00:28:23.448863 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.network.neutron [None req-21173e44-47b8-4441-b2b0-cc4f71bd15cd tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] validate_networks() for [('70fbb278-f35c-49f3-bc13-c1942cc48b73', None, None, None, None, None)] {{(pid=122633) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 11 00:28:23.827842 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-21173e44-47b8-4441-b2b0-cc4f71bd15cd tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Flavor limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 11 00:28:23.828285 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-21173e44-47b8-4441-b2b0-cc4f71bd15cd tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Image limits 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 11 00:28:23.828776 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-21173e44-47b8-4441-b2b0-cc4f71bd15cd tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Flavor pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 11 00:28:23.829233 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-21173e44-47b8-4441-b2b0-cc4f71bd15cd tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Image pref 0:0:0 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 11 00:28:23.829665 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.virt.hardware [None req-21173e44-47b8-4441-b2b0-cc4f71bd15cd tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=122633) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 11 00:28:23.838871 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-21173e44-47b8-4441-b2b0-cc4f71bd15cd tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:28:23.839304 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-21173e44-47b8-4441-b2b0-cc4f71bd15cd tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:28:23.839757 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-21173e44-47b8-4441-b2b0-cc4f71bd15cd tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:28:23.840509 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-21173e44-47b8-4441-b2b0-cc4f71bd15cd tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:28:23.840981 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-21173e44-47b8-4441-b2b0-cc4f71bd15cd tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:28:23.841424 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-21173e44-47b8-4441-b2b0-cc4f71bd15cd tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:28:23.858706 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-21173e44-47b8-4441-b2b0-cc4f71bd15cd tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Getting quotas for project 81cc48c29b8943bca4d0721c78ac5f5a. Resources: {'instances', 'cores', 'ram'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 11 00:28:23.864052 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.quota [None req-21173e44-47b8-4441-b2b0-cc4f71bd15cd tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Getting quotas for user 57829b774c384f4789844df1330c7d0d and project 81cc48c29b8943bca4d0721c78ac5f5a. Resources: {'instances', 'cores', 'ram'} {{(pid=122633) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 11 00:28:23.877159 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-21173e44-47b8-4441-b2b0-cc4f71bd15cd tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Going to run 1 instances... {{(pid=122633) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 11 00:28:23.879674 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-21173e44-47b8-4441-b2b0-cc4f71bd15cd tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] [instance: a91a990a-37f8-467e-ae17-b605a37f52b0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='9dfbeb7a-1355-4695-9e65-abb33ab21903',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=122633) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 11 00:28:23.926319 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-21173e44-47b8-4441-b2b0-cc4f71bd15cd tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.607135 Aug 11 00:28:23.926919 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3807/7408] 10.222.0.58 () {60 vars in 1147 bytes} [Thu Aug 11 00:28:23 2022] POST /compute/v2.1/servers => generated 406 bytes in 609 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 11 00:28:23.943544 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-89829d9b-85b6-4e00-8701-86e315e590fe tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:28:23.945108 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-89829d9b-85b6-4e00-8701-86e315e590fe tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] [instance: a91a990a-37f8-467e-ae17-b605a37f52b0] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:28:23.959712 n-d-850468-14 devstack@n-api.service[122632]: INFO oslo.messaging._drivers.impl_rabbit [-] [cd3f72be-c5dc-40c0-bc95-e9b4d1b700e4] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 42616. Aug 11 00:28:23.960568 n-d-850468-14 devstack@n-api.service[122632]: INFO oslo.messaging._drivers.impl_rabbit [-] [6aef4e7e-e576-4aec-8e05-1d4d3b8b22c0] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 42618. Aug 11 00:28:24.007937 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-89829d9b-85b6-4e00-8701-86e315e590fe tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57829b774c384f4789844df1330c7d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81cc48c29b8943bca4d0721c78ac5f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:28:24.015710 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-89829d9b-85b6-4e00-8701-86e315e590fe tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] 10.222.0.58 "GET /compute/v2.1/servers/a91a990a-37f8-467e-ae17-b605a37f52b0" status: 200 len: 1249 microversion: 2.1 time: 0.081173 Aug 11 00:28:24.016483 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3602/7409] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:28:23 2022] GET /compute/v2.1/servers/a91a990a-37f8-467e-ae17-b605a37f52b0 => generated 1249 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:28:25.038111 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-2a405edc-8ae9-4576-8dae-e76bfd1e3bcb tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:28:25.038744 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-2a405edc-8ae9-4576-8dae-e76bfd1e3bcb tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] [instance: a91a990a-37f8-467e-ae17-b605a37f52b0] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:28:25.046254 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2a405edc-8ae9-4576-8dae-e76bfd1e3bcb tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:28:25.046759 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2a405edc-8ae9-4576-8dae-e76bfd1e3bcb tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:28:25.047223 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2a405edc-8ae9-4576-8dae-e76bfd1e3bcb tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:28:25.047928 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2a405edc-8ae9-4576-8dae-e76bfd1e3bcb tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:28:25.048389 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2a405edc-8ae9-4576-8dae-e76bfd1e3bcb tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:28:25.048826 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2a405edc-8ae9-4576-8dae-e76bfd1e3bcb tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:28:25.126423 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-2a405edc-8ae9-4576-8dae-e76bfd1e3bcb tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57829b774c384f4789844df1330c7d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81cc48c29b8943bca4d0721c78ac5f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:28:25.134149 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-2a405edc-8ae9-4576-8dae-e76bfd1e3bcb tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] 10.222.0.58 "GET /compute/v2.1/servers/a91a990a-37f8-467e-ae17-b605a37f52b0" status: 200 len: 1309 microversion: 2.1 time: 0.101102 Aug 11 00:28:25.135127 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3808/7410] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:28:25 2022] GET /compute/v2.1/servers/a91a990a-37f8-467e-ae17-b605a37f52b0 => generated 1309 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:28:26.157368 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-0a59f5ed-c5f8-465d-aecf-170c58411488 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:28:26.159244 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-0a59f5ed-c5f8-465d-aecf-170c58411488 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] [instance: a91a990a-37f8-467e-ae17-b605a37f52b0] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:28:26.179793 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=2 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:28:26.185108 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0a59f5ed-c5f8-465d-aecf-170c58411488 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:28:26.185748 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0a59f5ed-c5f8-465d-aecf-170c58411488 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:28:26.186293 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0a59f5ed-c5f8-465d-aecf-170c58411488 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:28:26.187219 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0a59f5ed-c5f8-465d-aecf-170c58411488 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:28:26.188182 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0a59f5ed-c5f8-465d-aecf-170c58411488 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:28:26.188708 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0a59f5ed-c5f8-465d-aecf-170c58411488 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:28:26.362618 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-0a59f5ed-c5f8-465d-aecf-170c58411488 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57829b774c384f4789844df1330c7d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81cc48c29b8943bca4d0721c78ac5f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:28:26.375392 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-0a59f5ed-c5f8-465d-aecf-170c58411488 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] 10.222.0.58 "GET /compute/v2.1/servers/a91a990a-37f8-467e-ae17-b605a37f52b0" status: 200 len: 1375 microversion: 2.1 time: 0.222077 Aug 11 00:28:26.376420 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3603/7411] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:28:26 2022] GET /compute/v2.1/servers/a91a990a-37f8-467e-ae17-b605a37f52b0 => generated 1375 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:28:26.690380 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-66f47286-0fec-4b93-8997-e622cca5cc66 req-f30e53e4-d1a0-4439-8db7-be5c907c9cab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bc9b543-fa83-4013-9191-766e5aa8a844", "name": "network-vif-unplugged", "status": "completed", "tag": "5b1189c2-4066-46a8-a492-5253d2c30bc0"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 00:28:26.707546 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-66f47286-0fec-4b93-8997-e622cca5cc66 req-f30e53e4-d1a0-4439-8db7-be5c907c9cab service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:28:26.708431 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-66f47286-0fec-4b93-8997-e622cca5cc66 req-f30e53e4-d1a0-4439-8db7-be5c907c9cab service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:28:26.708912 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-66f47286-0fec-4b93-8997-e622cca5cc66 req-f30e53e4-d1a0-4439-8db7-be5c907c9cab service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:28:26.722515 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-66f47286-0fec-4b93-8997-e622cca5cc66 req-f30e53e4-d1a0-4439-8db7-be5c907c9cab service nova] Creating event network-vif-unplugged:5b1189c2-4066-46a8-a492-5253d2c30bc0 for instance 3bc9b543-fa83-4013-9191-766e5aa8a844 on n-h1-850468-14 Aug 11 00:28:26.734497 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-66f47286-0fec-4b93-8997-e622cca5cc66 req-f30e53e4-d1a0-4439-8db7-be5c907c9cab service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047826 Aug 11 00:28:26.735732 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3809/7412] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 11 00:28:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 11 00:28:27.403807 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-b99ed005-cfc7-4de0-91b7-f5b88eba9d3e tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:28:27.404486 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-b99ed005-cfc7-4de0-91b7-f5b88eba9d3e tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] [instance: a91a990a-37f8-467e-ae17-b605a37f52b0] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:28:27.411531 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b99ed005-cfc7-4de0-91b7-f5b88eba9d3e tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:28:27.412101 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b99ed005-cfc7-4de0-91b7-f5b88eba9d3e tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:28:27.412540 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b99ed005-cfc7-4de0-91b7-f5b88eba9d3e tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:28:27.413350 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b99ed005-cfc7-4de0-91b7-f5b88eba9d3e tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:28:27.413815 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b99ed005-cfc7-4de0-91b7-f5b88eba9d3e tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:28:27.414306 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b99ed005-cfc7-4de0-91b7-f5b88eba9d3e tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:28:27.554283 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-b99ed005-cfc7-4de0-91b7-f5b88eba9d3e tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57829b774c384f4789844df1330c7d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81cc48c29b8943bca4d0721c78ac5f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:28:27.563103 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-b99ed005-cfc7-4de0-91b7-f5b88eba9d3e tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] 10.222.0.58 "GET /compute/v2.1/servers/a91a990a-37f8-467e-ae17-b605a37f52b0" status: 200 len: 1375 microversion: 2.1 time: 0.163644 Aug 11 00:28:27.564042 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3604/7413] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:28:27 2022] GET /compute/v2.1/servers/a91a990a-37f8-467e-ae17-b605a37f52b0 => generated 1375 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:28:28.586590 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-8f9a160f-dd60-45e6-99f4-b852e9d27941 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:28:28.587509 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-8f9a160f-dd60-45e6-99f4-b852e9d27941 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] [instance: a91a990a-37f8-467e-ae17-b605a37f52b0] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:28:28.594978 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8f9a160f-dd60-45e6-99f4-b852e9d27941 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:28:28.595507 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8f9a160f-dd60-45e6-99f4-b852e9d27941 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:28:28.595963 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8f9a160f-dd60-45e6-99f4-b852e9d27941 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:28:28.596692 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8f9a160f-dd60-45e6-99f4-b852e9d27941 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:28:28.597157 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8f9a160f-dd60-45e6-99f4-b852e9d27941 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:28:28.597600 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-8f9a160f-dd60-45e6-99f4-b852e9d27941 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:28:28.757079 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-8f9a160f-dd60-45e6-99f4-b852e9d27941 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57829b774c384f4789844df1330c7d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81cc48c29b8943bca4d0721c78ac5f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:28:28.766390 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-8f9a160f-dd60-45e6-99f4-b852e9d27941 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] 10.222.0.58 "GET /compute/v2.1/servers/a91a990a-37f8-467e-ae17-b605a37f52b0" status: 200 len: 1375 microversion: 2.1 time: 0.185292 Aug 11 00:28:28.767382 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3810/7414] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:28:28 2022] GET /compute/v2.1/servers/a91a990a-37f8-467e-ae17-b605a37f52b0 => generated 1375 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:28:29.788319 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-18c5167e-857b-4e67-9c4a-f7c3c6188271 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:28:29.789686 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-18c5167e-857b-4e67-9c4a-f7c3c6188271 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] [instance: a91a990a-37f8-467e-ae17-b605a37f52b0] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:28:29.798223 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-18c5167e-857b-4e67-9c4a-f7c3c6188271 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:28:29.799239 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-18c5167e-857b-4e67-9c4a-f7c3c6188271 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:28:29.799929 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-18c5167e-857b-4e67-9c4a-f7c3c6188271 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:28:29.801037 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-18c5167e-857b-4e67-9c4a-f7c3c6188271 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:28:29.801717 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-18c5167e-857b-4e67-9c4a-f7c3c6188271 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:28:29.802367 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-18c5167e-857b-4e67-9c4a-f7c3c6188271 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:28:29.952283 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-18c5167e-857b-4e67-9c4a-f7c3c6188271 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57829b774c384f4789844df1330c7d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81cc48c29b8943bca4d0721c78ac5f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:28:29.961015 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-18c5167e-857b-4e67-9c4a-f7c3c6188271 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] 10.222.0.58 "GET /compute/v2.1/servers/a91a990a-37f8-467e-ae17-b605a37f52b0" status: 200 len: 1375 microversion: 2.1 time: 0.176500 Aug 11 00:28:29.961594 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3605/7415] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:28:29 2022] GET /compute/v2.1/servers/a91a990a-37f8-467e-ae17-b605a37f52b0 => generated 1375 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:28:30.981921 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-ccb377c7-bbdd-4e3e-a276-92949828be9e tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:28:30.982549 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-ccb377c7-bbdd-4e3e-a276-92949828be9e tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] [instance: a91a990a-37f8-467e-ae17-b605a37f52b0] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:28:30.989997 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ccb377c7-bbdd-4e3e-a276-92949828be9e tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:28:30.990362 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ccb377c7-bbdd-4e3e-a276-92949828be9e tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:28:30.991004 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ccb377c7-bbdd-4e3e-a276-92949828be9e tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:28:30.991631 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ccb377c7-bbdd-4e3e-a276-92949828be9e tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:28:30.992185 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ccb377c7-bbdd-4e3e-a276-92949828be9e tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:28:30.992840 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ccb377c7-bbdd-4e3e-a276-92949828be9e tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:28:31.141499 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-ccb377c7-bbdd-4e3e-a276-92949828be9e tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57829b774c384f4789844df1330c7d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81cc48c29b8943bca4d0721c78ac5f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:28:31.151121 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-ccb377c7-bbdd-4e3e-a276-92949828be9e tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] 10.222.0.58 "GET /compute/v2.1/servers/a91a990a-37f8-467e-ae17-b605a37f52b0" status: 200 len: 1375 microversion: 2.1 time: 0.173144 Aug 11 00:28:31.151731 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3811/7416] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:28:30 2022] GET /compute/v2.1/servers/a91a990a-37f8-467e-ae17-b605a37f52b0 => generated 1375 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:28:32.173113 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-c7a6cc57-e939-43f4-8d98-5aaad01d317f tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:28:32.173726 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-c7a6cc57-e939-43f4-8d98-5aaad01d317f tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] [instance: a91a990a-37f8-467e-ae17-b605a37f52b0] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:28:32.180595 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c7a6cc57-e939-43f4-8d98-5aaad01d317f tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:28:32.181088 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c7a6cc57-e939-43f4-8d98-5aaad01d317f tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:28:32.181674 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c7a6cc57-e939-43f4-8d98-5aaad01d317f tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:28:32.182953 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c7a6cc57-e939-43f4-8d98-5aaad01d317f tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:28:32.183337 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c7a6cc57-e939-43f4-8d98-5aaad01d317f tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:28:32.183766 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-c7a6cc57-e939-43f4-8d98-5aaad01d317f tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:28:32.363695 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-c7a6cc57-e939-43f4-8d98-5aaad01d317f tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57829b774c384f4789844df1330c7d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81cc48c29b8943bca4d0721c78ac5f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:28:32.373872 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-c7a6cc57-e939-43f4-8d98-5aaad01d317f tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] 10.222.0.58 "GET /compute/v2.1/servers/a91a990a-37f8-467e-ae17-b605a37f52b0" status: 200 len: 1375 microversion: 2.1 time: 0.204429 Aug 11 00:28:32.375449 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3606/7417] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:28:32 2022] GET /compute/v2.1/servers/a91a990a-37f8-467e-ae17-b605a37f52b0 => generated 1375 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:28:33.395110 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-d4729041-7418-48a5-b560-2be2791a39c2 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:28:33.395721 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-d4729041-7418-48a5-b560-2be2791a39c2 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] [instance: a91a990a-37f8-467e-ae17-b605a37f52b0] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:28:33.403080 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d4729041-7418-48a5-b560-2be2791a39c2 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:28:33.403587 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d4729041-7418-48a5-b560-2be2791a39c2 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:28:33.404038 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d4729041-7418-48a5-b560-2be2791a39c2 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:28:33.404747 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d4729041-7418-48a5-b560-2be2791a39c2 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:28:33.405216 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d4729041-7418-48a5-b560-2be2791a39c2 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:28:33.405656 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-d4729041-7418-48a5-b560-2be2791a39c2 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:28:33.550162 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-d4729041-7418-48a5-b560-2be2791a39c2 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57829b774c384f4789844df1330c7d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81cc48c29b8943bca4d0721c78ac5f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:28:33.561255 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-d4729041-7418-48a5-b560-2be2791a39c2 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] 10.222.0.58 "GET /compute/v2.1/servers/a91a990a-37f8-467e-ae17-b605a37f52b0" status: 200 len: 1375 microversion: 2.1 time: 0.170375 Aug 11 00:28:33.562019 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3812/7418] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:28:33 2022] GET /compute/v2.1/servers/a91a990a-37f8-467e-ae17-b605a37f52b0 => generated 1375 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:28:34.454913 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-7e681a3f-5981-4892-84ce-328a39711739 req-aee84a4e-52f8-4e47-bcb1-8ea9ead8e48d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a91a990a-37f8-467e-ae17-b605a37f52b0", "tag": "7fd118bf-5c29-4084-a14b-6170edee21d4"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 00:28:34.465982 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell0:SELECT=2 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:28:34.468572 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-7e681a3f-5981-4892-84ce-328a39711739 req-aee84a4e-52f8-4e47-bcb1-8ea9ead8e48d service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:28:34.469059 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-7e681a3f-5981-4892-84ce-328a39711739 req-aee84a4e-52f8-4e47-bcb1-8ea9ead8e48d service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:28:34.469580 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-7e681a3f-5981-4892-84ce-328a39711739 req-aee84a4e-52f8-4e47-bcb1-8ea9ead8e48d service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:28:34.482032 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-7e681a3f-5981-4892-84ce-328a39711739 req-aee84a4e-52f8-4e47-bcb1-8ea9ead8e48d service nova] Creating event network-changed:7fd118bf-5c29-4084-a14b-6170edee21d4 for instance a91a990a-37f8-467e-ae17-b605a37f52b0 on n-h2-850468-14 Aug 11 00:28:34.486902 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-7e681a3f-5981-4892-84ce-328a39711739 req-aee84a4e-52f8-4e47-bcb1-8ea9ead8e48d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035765 Aug 11 00:28:34.487508 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3607/7419] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 11 00:28:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 11 00:28:34.582311 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-c809e24a-c9bb-4254-a0de-502ace0b6437 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:28:34.583151 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-c809e24a-c9bb-4254-a0de-502ace0b6437 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] [instance: a91a990a-37f8-467e-ae17-b605a37f52b0] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:28:34.585258 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=2 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:28:34.586034 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell0:SELECT=6 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:28:34.593836 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c809e24a-c9bb-4254-a0de-502ace0b6437 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:28:34.594341 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c809e24a-c9bb-4254-a0de-502ace0b6437 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:28:34.594817 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c809e24a-c9bb-4254-a0de-502ace0b6437 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:28:34.595548 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c809e24a-c9bb-4254-a0de-502ace0b6437 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:28:34.596017 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c809e24a-c9bb-4254-a0de-502ace0b6437 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:28:34.596457 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-c809e24a-c9bb-4254-a0de-502ace0b6437 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:28:34.787472 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-c809e24a-c9bb-4254-a0de-502ace0b6437 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57829b774c384f4789844df1330c7d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81cc48c29b8943bca4d0721c78ac5f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:28:34.795673 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-c809e24a-c9bb-4254-a0de-502ace0b6437 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] 10.222.0.58 "GET /compute/v2.1/servers/a91a990a-37f8-467e-ae17-b605a37f52b0" status: 200 len: 1375 microversion: 2.1 time: 0.217214 Aug 11 00:28:34.796475 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3813/7420] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:28:34 2022] GET /compute/v2.1/servers/a91a990a-37f8-467e-ae17-b605a37f52b0 => generated 1375 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:28:35.817726 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-9c6e42fc-3e75-40e1-a4df-0cc8826aa203 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:28:35.818459 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-9c6e42fc-3e75-40e1-a4df-0cc8826aa203 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] [instance: a91a990a-37f8-467e-ae17-b605a37f52b0] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:28:35.825651 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9c6e42fc-3e75-40e1-a4df-0cc8826aa203 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:28:35.826159 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9c6e42fc-3e75-40e1-a4df-0cc8826aa203 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:28:35.826595 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9c6e42fc-3e75-40e1-a4df-0cc8826aa203 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:28:35.827326 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9c6e42fc-3e75-40e1-a4df-0cc8826aa203 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:28:35.827778 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9c6e42fc-3e75-40e1-a4df-0cc8826aa203 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:28:35.828225 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-9c6e42fc-3e75-40e1-a4df-0cc8826aa203 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:28:35.960899 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-9c6e42fc-3e75-40e1-a4df-0cc8826aa203 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57829b774c384f4789844df1330c7d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81cc48c29b8943bca4d0721c78ac5f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:28:35.969447 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-9c6e42fc-3e75-40e1-a4df-0cc8826aa203 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] 10.222.0.58 "GET /compute/v2.1/servers/a91a990a-37f8-467e-ae17-b605a37f52b0" status: 200 len: 1375 microversion: 2.1 time: 0.156709 Aug 11 00:28:35.970258 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3608/7421] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:28:35 2022] GET /compute/v2.1/servers/a91a990a-37f8-467e-ae17-b605a37f52b0 => generated 1375 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:28:36.989579 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-f4ff7289-961b-45a5-a9b4-049c77b47e67 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:28:36.990202 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-f4ff7289-961b-45a5-a9b4-049c77b47e67 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] [instance: a91a990a-37f8-467e-ae17-b605a37f52b0] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:28:36.997123 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f4ff7289-961b-45a5-a9b4-049c77b47e67 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:28:36.997623 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f4ff7289-961b-45a5-a9b4-049c77b47e67 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:28:36.998090 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f4ff7289-961b-45a5-a9b4-049c77b47e67 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:28:36.998839 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f4ff7289-961b-45a5-a9b4-049c77b47e67 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:28:36.999312 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f4ff7289-961b-45a5-a9b4-049c77b47e67 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:28:36.999788 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-f4ff7289-961b-45a5-a9b4-049c77b47e67 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:28:37.141516 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-f4ff7289-961b-45a5-a9b4-049c77b47e67 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57829b774c384f4789844df1330c7d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81cc48c29b8943bca4d0721c78ac5f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:28:37.149147 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-f4ff7289-961b-45a5-a9b4-049c77b47e67 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] 10.222.0.58 "GET /compute/v2.1/servers/a91a990a-37f8-467e-ae17-b605a37f52b0" status: 200 len: 1375 microversion: 2.1 time: 0.163484 Aug 11 00:28:37.150192 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3814/7422] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:28:36 2022] GET /compute/v2.1/servers/a91a990a-37f8-467e-ae17-b605a37f52b0 => generated 1375 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:28:38.172008 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-805e8960-1149-46c1-acc5-fefe5c5db7d0 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:28:38.172619 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-805e8960-1149-46c1-acc5-fefe5c5db7d0 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] [instance: a91a990a-37f8-467e-ae17-b605a37f52b0] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:28:38.179957 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-805e8960-1149-46c1-acc5-fefe5c5db7d0 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:28:38.180438 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-805e8960-1149-46c1-acc5-fefe5c5db7d0 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:28:38.180875 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-805e8960-1149-46c1-acc5-fefe5c5db7d0 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:28:38.181563 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-805e8960-1149-46c1-acc5-fefe5c5db7d0 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:28:38.182015 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-805e8960-1149-46c1-acc5-fefe5c5db7d0 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:28:38.182554 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-805e8960-1149-46c1-acc5-fefe5c5db7d0 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:28:38.319001 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-805e8960-1149-46c1-acc5-fefe5c5db7d0 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57829b774c384f4789844df1330c7d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81cc48c29b8943bca4d0721c78ac5f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:28:38.326534 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-805e8960-1149-46c1-acc5-fefe5c5db7d0 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] 10.222.0.58 "GET /compute/v2.1/servers/a91a990a-37f8-467e-ae17-b605a37f52b0" status: 200 len: 1375 microversion: 2.1 time: 0.159544 Aug 11 00:28:38.331791 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3609/7423] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:28:38 2022] GET /compute/v2.1/servers/a91a990a-37f8-467e-ae17-b605a37f52b0 => generated 1375 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:28:39.222273 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [req-b9c47fb6-498f-43bd-bf30-920bca40f32b req-68c59788-6a1a-492e-9f5e-26487d817db2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a91a990a-37f8-467e-ae17-b605a37f52b0", "name": "network-vif-plugged", "status": "completed", "tag": "7fd118bf-5c29-4084-a14b-6170edee21d4"}]} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 00:28:39.239013 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-b9c47fb6-498f-43bd-bf30-920bca40f32b req-68c59788-6a1a-492e-9f5e-26487d817db2 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:28:39.239834 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-b9c47fb6-498f-43bd-bf30-920bca40f32b req-68c59788-6a1a-492e-9f5e-26487d817db2 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:28:39.240522 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [req-b9c47fb6-498f-43bd-bf30-920bca40f32b req-68c59788-6a1a-492e-9f5e-26487d817db2 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:28:39.254209 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.compute.server_external_events [req-b9c47fb6-498f-43bd-bf30-920bca40f32b req-68c59788-6a1a-492e-9f5e-26487d817db2 service nova] Creating event network-vif-plugged:7fd118bf-5c29-4084-a14b-6170edee21d4 for instance a91a990a-37f8-467e-ae17-b605a37f52b0 on n-h2-850468-14 Aug 11 00:28:39.259472 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [req-b9c47fb6-498f-43bd-bf30-920bca40f32b req-68c59788-6a1a-492e-9f5e-26487d817db2 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041016 Aug 11 00:28:39.260079 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3815/7424] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 11 00:28:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 00:28:39.348423 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-bcffe971-fad3-4417-803e-b8af12ad723f tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:28:39.348972 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-bcffe971-fad3-4417-803e-b8af12ad723f tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] [instance: a91a990a-37f8-467e-ae17-b605a37f52b0] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:28:39.356480 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bcffe971-fad3-4417-803e-b8af12ad723f tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:28:39.356974 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bcffe971-fad3-4417-803e-b8af12ad723f tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:28:39.357417 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bcffe971-fad3-4417-803e-b8af12ad723f tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:28:39.358123 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bcffe971-fad3-4417-803e-b8af12ad723f tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:28:39.358584 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bcffe971-fad3-4417-803e-b8af12ad723f tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:28:39.359126 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-bcffe971-fad3-4417-803e-b8af12ad723f tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:28:39.492997 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-bcffe971-fad3-4417-803e-b8af12ad723f tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57829b774c384f4789844df1330c7d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81cc48c29b8943bca4d0721c78ac5f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:28:39.501620 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-bcffe971-fad3-4417-803e-b8af12ad723f tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] 10.222.0.58 "GET /compute/v2.1/servers/a91a990a-37f8-467e-ae17-b605a37f52b0" status: 200 len: 1375 microversion: 2.1 time: 0.157161 Aug 11 00:28:39.502203 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3610/7425] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:28:39 2022] GET /compute/v2.1/servers/a91a990a-37f8-467e-ae17-b605a37f52b0 => generated 1375 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:28:40.525696 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-1e3e2470-61b8-4c88-aa44-acbe3b9ede40 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:28:40.526412 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-1e3e2470-61b8-4c88-aa44-acbe3b9ede40 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] [instance: a91a990a-37f8-467e-ae17-b605a37f52b0] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:28:40.533454 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1e3e2470-61b8-4c88-aa44-acbe3b9ede40 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:28:40.533951 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1e3e2470-61b8-4c88-aa44-acbe3b9ede40 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:28:40.534413 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1e3e2470-61b8-4c88-aa44-acbe3b9ede40 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:28:40.535159 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1e3e2470-61b8-4c88-aa44-acbe3b9ede40 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:28:40.535634 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1e3e2470-61b8-4c88-aa44-acbe3b9ede40 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:28:40.536075 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-1e3e2470-61b8-4c88-aa44-acbe3b9ede40 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:28:40.676972 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-1e3e2470-61b8-4c88-aa44-acbe3b9ede40 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57829b774c384f4789844df1330c7d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81cc48c29b8943bca4d0721c78ac5f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:28:40.685890 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-1e3e2470-61b8-4c88-aa44-acbe3b9ede40 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] 10.222.0.58 "GET /compute/v2.1/servers/a91a990a-37f8-467e-ae17-b605a37f52b0" status: 200 len: 1375 microversion: 2.1 time: 0.164823 Aug 11 00:28:40.691176 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3816/7426] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:28:40 2022] GET /compute/v2.1/servers/a91a990a-37f8-467e-ae17-b605a37f52b0 => generated 1375 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:28:41.708767 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-b81964c0-520a-43d1-beb8-83227fb95983 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:28:41.709400 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-b81964c0-520a-43d1-beb8-83227fb95983 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] [instance: a91a990a-37f8-467e-ae17-b605a37f52b0] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:28:41.718554 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b81964c0-520a-43d1-beb8-83227fb95983 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:28:41.719077 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b81964c0-520a-43d1-beb8-83227fb95983 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:28:41.719520 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b81964c0-520a-43d1-beb8-83227fb95983 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:28:41.720603 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b81964c0-520a-43d1-beb8-83227fb95983 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:28:41.720730 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b81964c0-520a-43d1-beb8-83227fb95983 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:28:41.721134 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-b81964c0-520a-43d1-beb8-83227fb95983 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:28:41.866219 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-b81964c0-520a-43d1-beb8-83227fb95983 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57829b774c384f4789844df1330c7d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81cc48c29b8943bca4d0721c78ac5f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:28:41.874434 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-b81964c0-520a-43d1-beb8-83227fb95983 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] 10.222.0.58 "GET /compute/v2.1/servers/a91a990a-37f8-467e-ae17-b605a37f52b0" status: 200 len: 1560 microversion: 2.1 time: 0.169696 Aug 11 00:28:41.875053 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3611/7427] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:28:41 2022] GET /compute/v2.1/servers/a91a990a-37f8-467e-ae17-b605a37f52b0 => generated 1560 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:28:41.897864 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-ff808064-dbc7-4abc-98aa-c0c92b2b2bab tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:28:41.898812 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-ff808064-dbc7-4abc-98aa-c0c92b2b2bab tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] [instance: a91a990a-37f8-467e-ae17-b605a37f52b0] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:28:41.909108 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ff808064-dbc7-4abc-98aa-c0c92b2b2bab tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:28:41.909851 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ff808064-dbc7-4abc-98aa-c0c92b2b2bab tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:28:41.910528 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ff808064-dbc7-4abc-98aa-c0c92b2b2bab tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:28:41.911608 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ff808064-dbc7-4abc-98aa-c0c92b2b2bab tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:28:41.912307 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ff808064-dbc7-4abc-98aa-c0c92b2b2bab tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:28:41.912959 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-ff808064-dbc7-4abc-98aa-c0c92b2b2bab tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:28:42.050361 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-ff808064-dbc7-4abc-98aa-c0c92b2b2bab tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57829b774c384f4789844df1330c7d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81cc48c29b8943bca4d0721c78ac5f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:28:42.058449 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-ff808064-dbc7-4abc-98aa-c0c92b2b2bab tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] 10.222.0.58 "GET /compute/v2.1/servers/a91a990a-37f8-467e-ae17-b605a37f52b0" status: 200 len: 1560 microversion: 2.1 time: 0.166747 Aug 11 00:28:42.059046 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3817/7428] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:28:41 2022] GET /compute/v2.1/servers/a91a990a-37f8-467e-ae17-b605a37f52b0 => generated 1560 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 11 00:28:43.655695 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-8fe59190-c1ca-4fcc-84a5-54f148143369 req-41c14a44-a7f3-4c70-b94e-3e422d8a57db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a91a990a-37f8-467e-ae17-b605a37f52b0", "tag": "7fd118bf-5c29-4084-a14b-6170edee21d4"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 00:28:43.666195 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-8fe59190-c1ca-4fcc-84a5-54f148143369 req-41c14a44-a7f3-4c70-b94e-3e422d8a57db service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:28:43.666705 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-8fe59190-c1ca-4fcc-84a5-54f148143369 req-41c14a44-a7f3-4c70-b94e-3e422d8a57db service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:28:43.667165 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-8fe59190-c1ca-4fcc-84a5-54f148143369 req-41c14a44-a7f3-4c70-b94e-3e422d8a57db service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:28:43.678104 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-8fe59190-c1ca-4fcc-84a5-54f148143369 req-41c14a44-a7f3-4c70-b94e-3e422d8a57db service nova] Creating event network-changed:7fd118bf-5c29-4084-a14b-6170edee21d4 for instance a91a990a-37f8-467e-ae17-b605a37f52b0 on n-h2-850468-14 Aug 11 00:28:43.684688 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-8fe59190-c1ca-4fcc-84a5-54f148143369 req-41c14a44-a7f3-4c70-b94e-3e422d8a57db service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032289 Aug 11 00:28:43.685291 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3612/7429] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 11 00:28:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 00:28:48.650083 n-d-850468-14 devstack@n-api.service[122633]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 11 00:28:48.651586 n-d-850468-14 devstack@n-api.service[122633]: Thu Aug 11 00:28:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 11 00:28:49.336224 n-d-850468-14 devstack@n-api.service[122632]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 11 00:28:49.336832 n-d-850468-14 devstack@n-api.service[122632]: Thu Aug 11 00:28:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 11 00:30:10.951733 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:30:10.952500 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=54 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:30:10.956519 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-7b3eeff9-02ca-4017-a8ca-542a21ba4005 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-107314830"}} {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 00:30:10.958807 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-7b3eeff9-02ca-4017-a8ca-542a21ba4005 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] [instance: a91a990a-37f8-467e-ae17-b605a37f52b0] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:30:10.967005 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7b3eeff9-02ca-4017-a8ca-542a21ba4005 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:30:10.967495 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7b3eeff9-02ca-4017-a8ca-542a21ba4005 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:30:10.967939 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7b3eeff9-02ca-4017-a8ca-542a21ba4005 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:30:10.968639 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7b3eeff9-02ca-4017-a8ca-542a21ba4005 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:30:10.969120 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7b3eeff9-02ca-4017-a8ca-542a21ba4005 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:30:10.969555 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-7b3eeff9-02ca-4017-a8ca-542a21ba4005 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:30:11.164846 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-7b3eeff9-02ca-4017-a8ca-542a21ba4005 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] 10.222.0.58 "POST /compute/v2.1/servers/a91a990a-37f8-467e-ae17-b605a37f52b0/action" status: 202 len: 0 microversion: 2.1 time: 0.214843 Aug 11 00:30:11.165485 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3818/7430] 10.222.0.58 () {60 vars in 1278 bytes} [Thu Aug 11 00:30:10 2022] POST /compute/v2.1/servers/a91a990a-37f8-467e-ae17-b605a37f52b0/action => generated 0 bytes in 216 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 11 00:30:15.720809 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_api:SELECT=26 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:30:15.725951 n-d-850468-14 devstack@n-api.service[122632]: DEBUG dbcounter [-] [122632] Writing DB stats nova_cell1:SELECT=52 {{(pid=122632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:30:15.825600 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-cb21127f-2720-4fb2-b3d4-93d2cd00b06d req-34b42920-7cc2-4afb-832a-9f018d77cb25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a91a990a-37f8-467e-ae17-b605a37f52b0", "name": "network-vif-plugged", "status": "completed", "tag": "7fd118bf-5c29-4084-a14b-6170edee21d4"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 00:30:15.836689 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-cb21127f-2720-4fb2-b3d4-93d2cd00b06d req-34b42920-7cc2-4afb-832a-9f018d77cb25 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:30:15.838088 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-cb21127f-2720-4fb2-b3d4-93d2cd00b06d req-34b42920-7cc2-4afb-832a-9f018d77cb25 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:30:15.838617 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-cb21127f-2720-4fb2-b3d4-93d2cd00b06d req-34b42920-7cc2-4afb-832a-9f018d77cb25 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:30:15.850964 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-cb21127f-2720-4fb2-b3d4-93d2cd00b06d req-34b42920-7cc2-4afb-832a-9f018d77cb25 service nova] Creating event network-vif-plugged:7fd118bf-5c29-4084-a14b-6170edee21d4 for instance a91a990a-37f8-467e-ae17-b605a37f52b0 on n-h2-850468-14 Aug 11 00:30:15.858001 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-cb21127f-2720-4fb2-b3d4-93d2cd00b06d req-34b42920-7cc2-4afb-832a-9f018d77cb25 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140739 Aug 11 00:30:15.862263 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3613/7431] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 11 00:30:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 00:30:25.160562 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-1592f957-ddaf-4dda-bed2-3ae55b433e1e req-bdf787bc-b2a8-4f3b-8d12-595b99690d83 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a91a990a-37f8-467e-ae17-b605a37f52b0", "tag": "7fd118bf-5c29-4084-a14b-6170edee21d4"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 00:30:25.161472 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-2ae00eeb-d26e-4549-8406-9cb152d8934c tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:30:25.162942 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-2ae00eeb-d26e-4549-8406-9cb152d8934c tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] [instance: a91a990a-37f8-467e-ae17-b605a37f52b0] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:30:25.172704 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-1592f957-ddaf-4dda-bed2-3ae55b433e1e req-bdf787bc-b2a8-4f3b-8d12-595b99690d83 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:30:25.173145 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_api:SELECT=2 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:30:25.173317 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-1592f957-ddaf-4dda-bed2-3ae55b433e1e req-bdf787bc-b2a8-4f3b-8d12-595b99690d83 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:30:25.173615 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-1592f957-ddaf-4dda-bed2-3ae55b433e1e req-bdf787bc-b2a8-4f3b-8d12-595b99690d83 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:30:25.174456 n-d-850468-14 devstack@n-api.service[122633]: DEBUG dbcounter [-] [122633] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=122633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 11 00:30:25.177195 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2ae00eeb-d26e-4549-8406-9cb152d8934c tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:30:25.177920 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2ae00eeb-d26e-4549-8406-9cb152d8934c tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:30:25.178549 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2ae00eeb-d26e-4549-8406-9cb152d8934c tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:30:25.180157 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2ae00eeb-d26e-4549-8406-9cb152d8934c tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:30:25.180639 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2ae00eeb-d26e-4549-8406-9cb152d8934c tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:30:25.181082 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-2ae00eeb-d26e-4549-8406-9cb152d8934c tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:30:25.188090 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-1592f957-ddaf-4dda-bed2-3ae55b433e1e req-bdf787bc-b2a8-4f3b-8d12-595b99690d83 service nova] Creating event network-changed:7fd118bf-5c29-4084-a14b-6170edee21d4 for instance a91a990a-37f8-467e-ae17-b605a37f52b0 on n-h2-850468-14 Aug 11 00:30:25.194481 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-1592f957-ddaf-4dda-bed2-3ae55b433e1e req-bdf787bc-b2a8-4f3b-8d12-595b99690d83 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038038 Aug 11 00:30:25.195682 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3614/7432] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 11 00:30:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 00:30:25.211576 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-2ae00eeb-d26e-4549-8406-9cb152d8934c tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] [instance: a91a990a-37f8-467e-ae17-b605a37f52b0] Going to try to terminate instance {{(pid=122633) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 11 00:30:25.299147 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-2ae00eeb-d26e-4549-8406-9cb152d8934c tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] 10.222.0.58 "DELETE /compute/v2.1/servers/a91a990a-37f8-467e-ae17-b605a37f52b0" status: 204 len: 0 microversion: 2.1 time: 0.144173 Aug 11 00:30:25.303349 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3819/7433] 10.222.0.58 () {58 vars in 1239 bytes} [Thu Aug 11 00:30:25 2022] DELETE /compute/v2.1/servers/a91a990a-37f8-467e-ae17-b605a37f52b0 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 11 00:30:25.313382 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-209e215d-44dd-48bb-8363-6e5238e78b07 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:30:25.314426 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-209e215d-44dd-48bb-8363-6e5238e78b07 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] [instance: a91a990a-37f8-467e-ae17-b605a37f52b0] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:30:25.323250 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-209e215d-44dd-48bb-8363-6e5238e78b07 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:30:25.323753 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-209e215d-44dd-48bb-8363-6e5238e78b07 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:30:25.324399 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-209e215d-44dd-48bb-8363-6e5238e78b07 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:30:25.325303 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-209e215d-44dd-48bb-8363-6e5238e78b07 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:30:25.325947 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-209e215d-44dd-48bb-8363-6e5238e78b07 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:30:25.326584 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-209e215d-44dd-48bb-8363-6e5238e78b07 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:30:25.474776 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-209e215d-44dd-48bb-8363-6e5238e78b07 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57829b774c384f4789844df1330c7d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81cc48c29b8943bca4d0721c78ac5f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:30:25.484310 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-209e215d-44dd-48bb-8363-6e5238e78b07 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] 10.222.0.58 "GET /compute/v2.1/servers/a91a990a-37f8-467e-ae17-b605a37f52b0" status: 200 len: 1685 microversion: 2.1 time: 0.178788 Aug 11 00:30:25.484936 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3615/7434] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:30:25 2022] GET /compute/v2.1/servers/a91a990a-37f8-467e-ae17-b605a37f52b0 => generated 1685 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:30:26.506588 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-fa73ff38-3aac-42df-a8f0-91517920fb90 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:30:26.507240 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-fa73ff38-3aac-42df-a8f0-91517920fb90 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] [instance: a91a990a-37f8-467e-ae17-b605a37f52b0] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:30:26.515369 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fa73ff38-3aac-42df-a8f0-91517920fb90 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:30:26.515861 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fa73ff38-3aac-42df-a8f0-91517920fb90 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:30:26.516310 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fa73ff38-3aac-42df-a8f0-91517920fb90 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:30:26.517020 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fa73ff38-3aac-42df-a8f0-91517920fb90 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:30:26.517486 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fa73ff38-3aac-42df-a8f0-91517920fb90 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:30:26.517938 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-fa73ff38-3aac-42df-a8f0-91517920fb90 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:30:26.983303 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-fa73ff38-3aac-42df-a8f0-91517920fb90 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57829b774c384f4789844df1330c7d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81cc48c29b8943bca4d0721c78ac5f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:30:26.991052 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-fa73ff38-3aac-42df-a8f0-91517920fb90 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] 10.222.0.58 "GET /compute/v2.1/servers/a91a990a-37f8-467e-ae17-b605a37f52b0" status: 200 len: 1685 microversion: 2.1 time: 0.488726 Aug 11 00:30:26.991853 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3820/7435] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:30:26 2022] GET /compute/v2.1/servers/a91a990a-37f8-467e-ae17-b605a37f52b0 => generated 1685 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:30:27.651896 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-cd188db4-6bbf-48d4-8c91-26328c5c0f25 req-497e8cb7-d7fe-4d78-a7f5-7b02f5c57a9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a91a990a-37f8-467e-ae17-b605a37f52b0", "name": "network-vif-deleted", "tag": "7fd118bf-5c29-4084-a14b-6170edee21d4"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 00:30:27.661645 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-cd188db4-6bbf-48d4-8c91-26328c5c0f25 req-497e8cb7-d7fe-4d78-a7f5-7b02f5c57a9e service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:30:27.662122 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-cd188db4-6bbf-48d4-8c91-26328c5c0f25 req-497e8cb7-d7fe-4d78-a7f5-7b02f5c57a9e service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:30:27.662555 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-cd188db4-6bbf-48d4-8c91-26328c5c0f25 req-497e8cb7-d7fe-4d78-a7f5-7b02f5c57a9e service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:30:27.673634 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-cd188db4-6bbf-48d4-8c91-26328c5c0f25 req-497e8cb7-d7fe-4d78-a7f5-7b02f5c57a9e service nova] Creating event network-vif-deleted:7fd118bf-5c29-4084-a14b-6170edee21d4 for instance a91a990a-37f8-467e-ae17-b605a37f52b0 on n-h2-850468-14 Aug 11 00:30:27.678471 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-cd188db4-6bbf-48d4-8c91-26328c5c0f25 req-497e8cb7-d7fe-4d78-a7f5-7b02f5c57a9e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096590 Aug 11 00:30:27.679099 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3616/7436] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 11 00:30:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 11 00:30:28.014283 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-63e4c1ea-26b3-4867-af0f-96681197168d tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:30:28.015453 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-63e4c1ea-26b3-4867-af0f-96681197168d tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] [instance: a91a990a-37f8-467e-ae17-b605a37f52b0] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:30:28.022485 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-63e4c1ea-26b3-4867-af0f-96681197168d tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:30:28.023021 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-63e4c1ea-26b3-4867-af0f-96681197168d tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:30:28.023477 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-63e4c1ea-26b3-4867-af0f-96681197168d tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:30:28.024282 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-63e4c1ea-26b3-4867-af0f-96681197168d tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:30:28.024782 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-63e4c1ea-26b3-4867-af0f-96681197168d tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:30:28.025422 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-63e4c1ea-26b3-4867-af0f-96681197168d tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:30:28.059048 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-63e4c1ea-26b3-4867-af0f-96681197168d tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:30:28.059556 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-63e4c1ea-26b3-4867-af0f-96681197168d tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:30:28.060012 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-63e4c1ea-26b3-4867-af0f-96681197168d tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:30:28.060654 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.objects.instance [None req-63e4c1ea-26b3-4867-af0f-96681197168d tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Lazy-loading 'fault' on Instance uuid a91a990a-37f8-467e-ae17-b605a37f52b0 {{(pid=122633) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 11 00:30:28.104587 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-63e4c1ea-26b3-4867-af0f-96681197168d tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57829b774c384f4789844df1330c7d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81cc48c29b8943bca4d0721c78ac5f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:30:28.111804 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-63e4c1ea-26b3-4867-af0f-96681197168d tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] 10.222.0.58 "GET /compute/v2.1/servers/a91a990a-37f8-467e-ae17-b605a37f52b0" status: 200 len: 1339 microversion: 2.1 time: 0.101473 Aug 11 00:30:28.112375 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3821/7437] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:30:28 2022] GET /compute/v2.1/servers/a91a990a-37f8-467e-ae17-b605a37f52b0 => generated 1339 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:30:28.668904 n-d-850468-14 devstack@n-api.service[122633]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 11 00:30:28.669152 n-d-850468-14 devstack@n-api.service[122633]: Thu Aug 11 00:30:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 11 00:30:29.135000 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-6d496eb1-351a-400c-84bd-ec4f7c13ba2b tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:30:29.135705 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-6d496eb1-351a-400c-84bd-ec4f7c13ba2b tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] [instance: a91a990a-37f8-467e-ae17-b605a37f52b0] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:30:29.141906 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6d496eb1-351a-400c-84bd-ec4f7c13ba2b tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:30:29.142392 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6d496eb1-351a-400c-84bd-ec4f7c13ba2b tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:30:29.142869 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6d496eb1-351a-400c-84bd-ec4f7c13ba2b tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:30:29.143569 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6d496eb1-351a-400c-84bd-ec4f7c13ba2b tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:30:29.144026 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6d496eb1-351a-400c-84bd-ec4f7c13ba2b tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:30:29.144452 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-6d496eb1-351a-400c-84bd-ec4f7c13ba2b tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:30:29.158540 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.wsgi [None req-6d496eb1-351a-400c-84bd-ec4f7c13ba2b tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] HTTP exception thrown: Instance a91a990a-37f8-467e-ae17-b605a37f52b0 could not be found. Aug 11 00:30:29.160194 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-6d496eb1-351a-400c-84bd-ec4f7c13ba2b tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Request method failure captured: Aug 11 00:30:29.160194 n-d-850468-14 devstack@n-api.service[122632]: request: GET /compute/v2.1/servers/a91a990a-37f8-467e-ae17-b605a37f52b0 HTTP/1.1 Aug 11 00:30:29.160194 n-d-850468-14 devstack@n-api.service[122632]: Accept: application/json Aug 11 00:30:29.160194 n-d-850468-14 devstack@n-api.service[122632]: Accept-Encoding: identity Aug 11 00:30:29.160194 n-d-850468-14 devstack@n-api.service[122632]: Connection: close Aug 11 00:30:29.160194 n-d-850468-14 devstack@n-api.service[122632]: Content-Length: 0 Aug 11 00:30:29.160194 n-d-850468-14 devstack@n-api.service[122632]: Content-Type: application/json Aug 11 00:30:29.160194 n-d-850468-14 devstack@n-api.service[122632]: Host: 10.222.0.58 Aug 11 00:30:29.160194 n-d-850468-14 devstack@n-api.service[122632]: Openstack-System-Scope: None Aug 11 00:30:29.160194 n-d-850468-14 devstack@n-api.service[122632]: User-Agent: python-urllib3/1.26.11 Aug 11 00:30:29.160194 n-d-850468-14 devstack@n-api.service[122632]: X-Auth-Token: gAAAAABi9EyTQzvqUP1m1_Oud2OF60adNjkqQGn0D54bASjxbfeIBLHEU6jG7YHTQvDkAiqUFBzv4WImhdtaikk2S3FH0VfBPMIjq4CfkPbAZmSST095moUAxeFM4hPlMT7veZ0CmSW-hntGjRcR0C393zitv1JaEEWSIiTH-kWYvDnR71lJRn8 Aug 11 00:30:29.160194 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Id: None Aug 11 00:30:29.160194 n-d-850468-14 devstack@n-api.service[122632]: X-Domain-Name: None Aug 11 00:30:29.160194 n-d-850468-14 devstack@n-api.service[122632]: X-Identity-Status: Confirmed Aug 11 00:30:29.160194 n-d-850468-14 devstack@n-api.service[122632]: X-Is-Admin-Project: True Aug 11 00:30:29.160194 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Id: default Aug 11 00:30:29.160194 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Domain-Name: Default Aug 11 00:30:29.160194 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Id: 81cc48c29b8943bca4d0721c78ac5f5a Aug 11 00:30:29.160194 n-d-850468-14 devstack@n-api.service[122632]: X-Project-Name: tempest-TestSnapshotPattern-1517192071 Aug 11 00:30:29.160194 n-d-850468-14 devstack@n-api.service[122632]: X-Role: member,reader Aug 11 00:30:29.160194 n-d-850468-14 devstack@n-api.service[122632]: X-Roles: member,reader Aug 11 00:30:29.160194 n-d-850468-14 devstack@n-api.service[122632]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/81cc48c29b8943bca4d0721c78ac5f5a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/81cc48c29b8943bca4d0721c78ac5f5a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/81cc48c29b8943bca4d0721c78ac5f5a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_81cc48c29b8943bca4d0721c78ac5f5a", "adminURL": "http://10.222.0.58:8080"}]}] Aug 11 00:30:29.160194 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant: tempest-TestSnapshotPattern-1517192071 Aug 11 00:30:29.160194 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Id: 81cc48c29b8943bca4d0721c78ac5f5a Aug 11 00:30:29.160194 n-d-850468-14 devstack@n-api.service[122632]: X-Tenant-Name: tempest-TestSnapshotPattern-1517192071 Aug 11 00:30:29.160194 n-d-850468-14 devstack@n-api.service[122632]: X-User: tempest-TestSnapshotPattern-1517192071-project Aug 11 00:30:29.160194 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Id: default Aug 11 00:30:29.160194 n-d-850468-14 devstack@n-api.service[122632]: X-User-Domain-Name: Default Aug 11 00:30:29.160194 n-d-850468-14 devstack@n-api.service[122632]: X-User-Id: 57829b774c384f4789844df1330c7d0d Aug 11 00:30:29.160194 n-d-850468-14 devstack@n-api.service[122632]: X-User-Name: tempest-TestSnapshotPattern-1517192071-project Aug 11 00:30:29.160194 n-d-850468-14 devstack@n-api.service[122632]: method: > Aug 11 00:30:29.160194 n-d-850468-14 devstack@n-api.service[122632]: exception: Instance a91a990a-37f8-467e-ae17-b605a37f52b0 could not be found. Aug 11 00:30:29.160194 n-d-850468-14 devstack@n-api.service[122632]: action_args: {'id': 'a91a990a-37f8-467e-ae17-b605a37f52b0'} Aug 11 00:30:29.160194 n-d-850468-14 devstack@n-api.service[122632]: {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 00:30:29.160194 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 00:30:29.160194 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 11 00:30:29.160194 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 11 00:30:29.160194 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 11 00:30:29.160194 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 11 00:30:29.160194 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 11 00:30:29.160194 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 11 00:30:29.160194 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 11 00:30:29.160194 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 11 00:30:29.160194 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a91a990a-37f8-467e-ae17-b605a37f52b0 could not be found. Aug 11 00:30:29.160194 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 11 00:30:29.160194 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 00:30:29.160194 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 11 00:30:29.160194 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 00:30:29.160194 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 00:30:29.160194 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 00:30:29.160194 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 00:30:29.160194 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 00:30:29.160194 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 00:30:29.160194 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 00:30:29.160194 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 11 00:30:29.160194 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 11 00:30:29.160194 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 11 00:30:29.160194 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 11 00:30:29.160194 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 11 00:30:29.160194 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 11 00:30:29.160194 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a91a990a-37f8-467e-ae17-b605a37f52b0 could not be found. Aug 11 00:30:29.160194 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 11 00:30:29.160194 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 00:30:29.160194 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 11 00:30:29.165261 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 00:30:29.165261 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 00:30:29.165261 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 00:30:29.165261 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 00:30:29.165261 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 00:30:29.165261 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a91a990a-37f8-467e-ae17-b605a37f52b0 could not be found. Aug 11 00:30:29.165261 n-d-850468-14 devstack@n-api.service[122632]: ERROR nova.api.openstack.wsgi Aug 11 00:30:29.165261 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-6d496eb1-351a-400c-84bd-ec4f7c13ba2b tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Returning 404 to user: Instance a91a990a-37f8-467e-ae17-b605a37f52b0 could not be found. {{(pid=122632) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 00:30:29.165261 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-6d496eb1-351a-400c-84bd-ec4f7c13ba2b tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] 10.222.0.58 "GET /compute/v2.1/servers/a91a990a-37f8-467e-ae17-b605a37f52b0" status: 404 len: 111 microversion: 2.1 time: 0.031841 Aug 11 00:30:29.165261 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3617/7438] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:30:29 2022] GET /compute/v2.1/servers/a91a990a-37f8-467e-ae17-b605a37f52b0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 11 00:30:29.451049 n-d-850468-14 devstack@n-api.service[122632]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 11 00:30:29.451238 n-d-850468-14 devstack@n-api.service[122632]: Thu Aug 11 00:30:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 11 00:30:30.851208 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-374001c6-9383-4047-909a-f58df13e0841 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:30:30.851724 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-374001c6-9383-4047-909a-f58df13e0841 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] [instance: 3bc9b543-fa83-4013-9191-766e5aa8a844] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:30:30.855274 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-315c9cfd-f277-45ef-8993-beac10e97917 req-be2c219e-84b7-4a68-93e8-555fac06654c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3bc9b543-fa83-4013-9191-766e5aa8a844", "tag": "5b1189c2-4066-46a8-a492-5253d2c30bc0"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 00:30:30.859903 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-374001c6-9383-4047-909a-f58df13e0841 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:30:30.860699 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-374001c6-9383-4047-909a-f58df13e0841 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:30:30.861158 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-374001c6-9383-4047-909a-f58df13e0841 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:30:30.861881 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-374001c6-9383-4047-909a-f58df13e0841 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:30:30.862416 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-374001c6-9383-4047-909a-f58df13e0841 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:30:30.863065 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-374001c6-9383-4047-909a-f58df13e0841 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:30:30.866910 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-315c9cfd-f277-45ef-8993-beac10e97917 req-be2c219e-84b7-4a68-93e8-555fac06654c service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:30:30.867402 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-315c9cfd-f277-45ef-8993-beac10e97917 req-be2c219e-84b7-4a68-93e8-555fac06654c service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:30:30.867833 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-315c9cfd-f277-45ef-8993-beac10e97917 req-be2c219e-84b7-4a68-93e8-555fac06654c service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:30:30.879180 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-315c9cfd-f277-45ef-8993-beac10e97917 req-be2c219e-84b7-4a68-93e8-555fac06654c service nova] Creating event network-changed:5b1189c2-4066-46a8-a492-5253d2c30bc0 for instance 3bc9b543-fa83-4013-9191-766e5aa8a844 on n-h1-850468-14 Aug 11 00:30:30.884939 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-315c9cfd-f277-45ef-8993-beac10e97917 req-be2c219e-84b7-4a68-93e8-555fac06654c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034380 Aug 11 00:30:30.885322 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3618/7439] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 11 00:30:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 00:30:30.892264 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-374001c6-9383-4047-909a-f58df13e0841 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] [instance: 3bc9b543-fa83-4013-9191-766e5aa8a844] Going to try to terminate instance {{(pid=122633) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 11 00:30:30.993649 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-374001c6-9383-4047-909a-f58df13e0841 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] 10.222.0.58 "DELETE /compute/v2.1/servers/3bc9b543-fa83-4013-9191-766e5aa8a844" status: 204 len: 0 microversion: 2.1 time: 0.145879 Aug 11 00:30:31.002881 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3822/7440] 10.222.0.58 () {58 vars in 1239 bytes} [Thu Aug 11 00:30:30 2022] DELETE /compute/v2.1/servers/3bc9b543-fa83-4013-9191-766e5aa8a844 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 11 00:30:31.003704 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-0b5dd29a-8f66-46c1-b58b-7abf4eee3ab6 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Calling method '>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:30:31.004424 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.compute.api [None req-0b5dd29a-8f66-46c1-b58b-7abf4eee3ab6 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] [instance: 3bc9b543-fa83-4013-9191-766e5aa8a844] Fetching instance by UUID {{(pid=122632) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:30:31.011432 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0b5dd29a-8f66-46c1-b58b-7abf4eee3ab6 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:30:31.011928 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0b5dd29a-8f66-46c1-b58b-7abf4eee3ab6 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:30:31.012375 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0b5dd29a-8f66-46c1-b58b-7abf4eee3ab6 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:30:31.013085 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0b5dd29a-8f66-46c1-b58b-7abf4eee3ab6 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:30:31.013545 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0b5dd29a-8f66-46c1-b58b-7abf4eee3ab6 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:30:31.013976 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [None req-0b5dd29a-8f66-46c1-b58b-7abf4eee3ab6 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:30:31.188194 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.policy [None req-0b5dd29a-8f66-46c1-b58b-7abf4eee3ab6 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57829b774c384f4789844df1330c7d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81cc48c29b8943bca4d0721c78ac5f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122632) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:30:31.196138 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-0b5dd29a-8f66-46c1-b58b-7abf4eee3ab6 tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] 10.222.0.58 "GET /compute/v2.1/servers/3bc9b543-fa83-4013-9191-766e5aa8a844" status: 200 len: 1683 microversion: 2.1 time: 0.196815 Aug 11 00:30:31.196753 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3619/7441] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:30:30 2022] GET /compute/v2.1/servers/3bc9b543-fa83-4013-9191-766e5aa8a844 => generated 1683 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:30:32.219333 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-31094f2e-09b6-4db6-9462-a10d13291b7f tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:30:32.220419 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-31094f2e-09b6-4db6-9462-a10d13291b7f tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] [instance: 3bc9b543-fa83-4013-9191-766e5aa8a844] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:30:32.230401 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-31094f2e-09b6-4db6-9462-a10d13291b7f tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:30:32.230696 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-31094f2e-09b6-4db6-9462-a10d13291b7f tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:30:32.231428 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-31094f2e-09b6-4db6-9462-a10d13291b7f tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:30:32.232291 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-31094f2e-09b6-4db6-9462-a10d13291b7f tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:30:32.232860 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-31094f2e-09b6-4db6-9462-a10d13291b7f tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:30:32.233407 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-31094f2e-09b6-4db6-9462-a10d13291b7f tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:30:32.402828 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.policy [None req-31094f2e-09b6-4db6-9462-a10d13291b7f tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57829b774c384f4789844df1330c7d0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81cc48c29b8943bca4d0721c78ac5f5a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=122633) authorize /opt/stack/nova/nova/policy.py:199}} Aug 11 00:30:32.410928 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-31094f2e-09b6-4db6-9462-a10d13291b7f tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] 10.222.0.58 "GET /compute/v2.1/servers/3bc9b543-fa83-4013-9191-766e5aa8a844" status: 200 len: 1683 microversion: 2.1 time: 0.195852 Aug 11 00:30:32.411512 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3823/7442] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:30:32 2022] GET /compute/v2.1/servers/3bc9b543-fa83-4013-9191-766e5aa8a844 => generated 1683 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 11 00:30:33.012254 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [req-55cb359f-b221-448b-a897-a6a898230e60 req-5ba590d6-0ad1-4aa3-be3d-59ed465f3123 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3bc9b543-fa83-4013-9191-766e5aa8a844", "name": "network-vif-deleted", "tag": "5b1189c2-4066-46a8-a492-5253d2c30bc0"}]} {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 11 00:30:33.027621 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-55cb359f-b221-448b-a897-a6a898230e60 req-5ba590d6-0ad1-4aa3-be3d-59ed465f3123 service nova] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:30:33.028157 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-55cb359f-b221-448b-a897-a6a898230e60 req-5ba590d6-0ad1-4aa3-be3d-59ed465f3123 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:30:33.028589 n-d-850468-14 devstack@n-api.service[122632]: DEBUG oslo_concurrency.lockutils [req-55cb359f-b221-448b-a897-a6a898230e60 req-5ba590d6-0ad1-4aa3-be3d-59ed465f3123 service nova] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=122632) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:30:33.043063 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.compute.server_external_events [req-55cb359f-b221-448b-a897-a6a898230e60 req-5ba590d6-0ad1-4aa3-be3d-59ed465f3123 service nova] Creating event network-vif-deleted:5b1189c2-4066-46a8-a492-5253d2c30bc0 for instance 3bc9b543-fa83-4013-9191-766e5aa8a844 on n-h1-850468-14 Aug 11 00:30:33.048321 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [req-55cb359f-b221-448b-a897-a6a898230e60 req-5ba590d6-0ad1-4aa3-be3d-59ed465f3123 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039779 Aug 11 00:30:33.049099 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3620/7443] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Aug 11 00:30:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 11 00:30:33.435662 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-cc53a124-4ba6-4ed3-8564-8ce0e4564a5c tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Calling method '>' {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:30:33.437198 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.compute.api [None req-cc53a124-4ba6-4ed3-8564-8ce0e4564a5c tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] [instance: 3bc9b543-fa83-4013-9191-766e5aa8a844] Fetching instance by UUID {{(pid=122633) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 11 00:30:33.445695 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cc53a124-4ba6-4ed3-8564-8ce0e4564a5c tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:30:33.446663 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cc53a124-4ba6-4ed3-8564-8ce0e4564a5c tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:30:33.448270 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cc53a124-4ba6-4ed3-8564-8ce0e4564a5c tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:30:33.450100 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cc53a124-4ba6-4ed3-8564-8ce0e4564a5c tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Acquiring lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 11 00:30:33.451039 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cc53a124-4ba6-4ed3-8564-8ce0e4564a5c tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 11 00:30:33.451612 n-d-850468-14 devstack@n-api.service[122633]: DEBUG oslo_concurrency.lockutils [None req-cc53a124-4ba6-4ed3-8564-8ce0e4564a5c tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Lock "c9127db4-59f9-48ac-9ab2-b5d6690bb85f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=122633) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 11 00:30:33.469525 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.wsgi [None req-cc53a124-4ba6-4ed3-8564-8ce0e4564a5c tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] HTTP exception thrown: Instance 3bc9b543-fa83-4013-9191-766e5aa8a844 could not be found. Aug 11 00:30:33.471584 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-cc53a124-4ba6-4ed3-8564-8ce0e4564a5c tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Request method failure captured: Aug 11 00:30:33.471584 n-d-850468-14 devstack@n-api.service[122633]: request: GET /compute/v2.1/servers/3bc9b543-fa83-4013-9191-766e5aa8a844 HTTP/1.1 Aug 11 00:30:33.471584 n-d-850468-14 devstack@n-api.service[122633]: Accept: application/json Aug 11 00:30:33.471584 n-d-850468-14 devstack@n-api.service[122633]: Accept-Encoding: identity Aug 11 00:30:33.471584 n-d-850468-14 devstack@n-api.service[122633]: Connection: close Aug 11 00:30:33.471584 n-d-850468-14 devstack@n-api.service[122633]: Content-Length: 0 Aug 11 00:30:33.471584 n-d-850468-14 devstack@n-api.service[122633]: Content-Type: application/json Aug 11 00:30:33.471584 n-d-850468-14 devstack@n-api.service[122633]: Host: 10.222.0.58 Aug 11 00:30:33.471584 n-d-850468-14 devstack@n-api.service[122633]: Openstack-System-Scope: None Aug 11 00:30:33.471584 n-d-850468-14 devstack@n-api.service[122633]: User-Agent: python-urllib3/1.26.11 Aug 11 00:30:33.471584 n-d-850468-14 devstack@n-api.service[122633]: X-Auth-Token: gAAAAABi9EyTQzvqUP1m1_Oud2OF60adNjkqQGn0D54bASjxbfeIBLHEU6jG7YHTQvDkAiqUFBzv4WImhdtaikk2S3FH0VfBPMIjq4CfkPbAZmSST095moUAxeFM4hPlMT7veZ0CmSW-hntGjRcR0C393zitv1JaEEWSIiTH-kWYvDnR71lJRn8 Aug 11 00:30:33.471584 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Id: None Aug 11 00:30:33.471584 n-d-850468-14 devstack@n-api.service[122633]: X-Domain-Name: None Aug 11 00:30:33.471584 n-d-850468-14 devstack@n-api.service[122633]: X-Identity-Status: Confirmed Aug 11 00:30:33.471584 n-d-850468-14 devstack@n-api.service[122633]: X-Is-Admin-Project: True Aug 11 00:30:33.471584 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Id: default Aug 11 00:30:33.471584 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Domain-Name: Default Aug 11 00:30:33.471584 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Id: 81cc48c29b8943bca4d0721c78ac5f5a Aug 11 00:30:33.471584 n-d-850468-14 devstack@n-api.service[122633]: X-Project-Name: tempest-TestSnapshotPattern-1517192071 Aug 11 00:30:33.471584 n-d-850468-14 devstack@n-api.service[122633]: X-Role: member,reader Aug 11 00:30:33.471584 n-d-850468-14 devstack@n-api.service[122633]: X-Roles: member,reader Aug 11 00:30:33.471584 n-d-850468-14 devstack@n-api.service[122633]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/81cc48c29b8943bca4d0721c78ac5f5a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/volume/v3/81cc48c29b8943bca4d0721c78ac5f5a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2/81cc48c29b8943bca4d0721c78ac5f5a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.58:8080/v1/AUTH_81cc48c29b8943bca4d0721c78ac5f5a", "adminURL": "http://10.222.0.58:8080"}]}] Aug 11 00:30:33.471584 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant: tempest-TestSnapshotPattern-1517192071 Aug 11 00:30:33.471584 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Id: 81cc48c29b8943bca4d0721c78ac5f5a Aug 11 00:30:33.471584 n-d-850468-14 devstack@n-api.service[122633]: X-Tenant-Name: tempest-TestSnapshotPattern-1517192071 Aug 11 00:30:33.471584 n-d-850468-14 devstack@n-api.service[122633]: X-User: tempest-TestSnapshotPattern-1517192071-project Aug 11 00:30:33.471584 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Id: default Aug 11 00:30:33.471584 n-d-850468-14 devstack@n-api.service[122633]: X-User-Domain-Name: Default Aug 11 00:30:33.471584 n-d-850468-14 devstack@n-api.service[122633]: X-User-Id: 57829b774c384f4789844df1330c7d0d Aug 11 00:30:33.471584 n-d-850468-14 devstack@n-api.service[122633]: X-User-Name: tempest-TestSnapshotPattern-1517192071-project Aug 11 00:30:33.471584 n-d-850468-14 devstack@n-api.service[122633]: method: > Aug 11 00:30:33.471584 n-d-850468-14 devstack@n-api.service[122633]: exception: Instance 3bc9b543-fa83-4013-9191-766e5aa8a844 could not be found. Aug 11 00:30:33.471584 n-d-850468-14 devstack@n-api.service[122633]: action_args: {'id': '3bc9b543-fa83-4013-9191-766e5aa8a844'} Aug 11 00:30:33.471584 n-d-850468-14 devstack@n-api.service[122633]: {{(pid=122633) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 11 00:30:33.471584 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 00:30:33.471584 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 11 00:30:33.471584 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 11 00:30:33.471584 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 11 00:30:33.471584 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 11 00:30:33.471584 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 11 00:30:33.471584 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 11 00:30:33.471584 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 11 00:30:33.471584 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 11 00:30:33.471584 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3bc9b543-fa83-4013-9191-766e5aa8a844 could not be found. Aug 11 00:30:33.471584 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 11 00:30:33.471584 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 00:30:33.471584 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 11 00:30:33.471584 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 00:30:33.471584 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 00:30:33.471584 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 00:30:33.471584 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 11 00:30:33.471584 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 11 00:30:33.471584 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 11 00:30:33.471584 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 11 00:30:33.471584 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 11 00:30:33.471584 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 11 00:30:33.471584 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 11 00:30:33.471584 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 11 00:30:33.471584 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 11 00:30:33.471584 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 11 00:30:33.471584 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3bc9b543-fa83-4013-9191-766e5aa8a844 could not be found. Aug 11 00:30:33.471584 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 11 00:30:33.471584 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 11 00:30:33.471584 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 11 00:30:33.476269 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 11 00:30:33.476269 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 11 00:30:33.476269 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 11 00:30:33.476269 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 11 00:30:33.476269 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 11 00:30:33.476269 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3bc9b543-fa83-4013-9191-766e5aa8a844 could not be found. Aug 11 00:30:33.476269 n-d-850468-14 devstack@n-api.service[122633]: ERROR nova.api.openstack.wsgi Aug 11 00:30:33.477785 n-d-850468-14 devstack@n-api.service[122633]: DEBUG nova.api.openstack.wsgi [None req-cc53a124-4ba6-4ed3-8564-8ce0e4564a5c tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Returning 404 to user: Instance 3bc9b543-fa83-4013-9191-766e5aa8a844 could not be found. {{(pid=122633) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 11 00:30:33.479893 n-d-850468-14 devstack@n-api.service[122633]: INFO nova.api.openstack.requestlog [None req-cc53a124-4ba6-4ed3-8564-8ce0e4564a5c tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] 10.222.0.58 "GET /compute/v2.1/servers/3bc9b543-fa83-4013-9191-766e5aa8a844" status: 404 len: 111 microversion: 2.1 time: 0.050349 Aug 11 00:30:33.481823 n-d-850468-14 devstack@n-api.service[122633]: [pid: 122633|app: 0|req: 3824/7444] 10.222.0.58 () {58 vars in 1236 bytes} [Thu Aug 11 00:30:33 2022] GET /compute/v2.1/servers/3bc9b543-fa83-4013-9191-766e5aa8a844 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 11 00:30:33.652270 n-d-850468-14 devstack@n-api.service[122632]: DEBUG nova.api.openstack.wsgi [None req-8ce0f4d3-570d-4001-92db-44fe4be7965e tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] Calling method '.version_select at 0x7f846faf9700>' {{(pid=122632) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 11 00:30:33.676354 n-d-850468-14 devstack@n-api.service[122632]: INFO nova.api.openstack.requestlog [None req-8ce0f4d3-570d-4001-92db-44fe4be7965e tempest-TestSnapshotPattern-1517192071 tempest-TestSnapshotPattern-1517192071-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1716436383" status: 202 len: 0 microversion: 2.1 time: 0.029416 Aug 11 00:30:33.677240 n-d-850468-14 devstack@n-api.service[122632]: [pid: 122632|app: 0|req: 3621/7445] 10.222.0.58 () {58 vars in 1257 bytes} [Thu Aug 11 00:30:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1716436383 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 11 00:32:08.659116 n-d-850468-14 devstack@n-api.service[122633]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 11 00:32:08.659720 n-d-850468-14 devstack@n-api.service[122633]: Thu Aug 11 00:32:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 11 00:33:48.677204 n-d-850468-14 devstack@n-api.service[122633]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 11 00:33:48.677950 n-d-850468-14 devstack@n-api.service[122633]: Thu Aug 11 00:33:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 11 00:33:49.346907 n-d-850468-14 devstack@n-api.service[122632]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 11 00:33:49.347471 n-d-850468-14 devstack@n-api.service[122632]: Thu Aug 11 00:33:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 11 00:33:49.461213 n-d-850468-14 devstack@n-api.service[122632]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 11 00:33:49.461431 n-d-850468-14 devstack@n-api.service[122632]: Thu Aug 11 00:33:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 11 00:35:28.669868 n-d-850468-14 devstack@n-api.service[122633]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 11 00:35:28.670591 n-d-850468-14 devstack@n-api.service[122633]: Thu Aug 11 00:35:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 11 00:35:48.851505 n-d-850468-14 devstack@n-api.service[122632]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 11 00:35:48.852007 n-d-850468-14 devstack@n-api.service[122632]: Thu Aug 11 00:35:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 11 00:36:17.667403 n-d-850468-14 devstack@n-api.service[122633]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 11 00:36:17.668028 n-d-850468-14 devstack@n-api.service[122633]: Thu Aug 11 00:36:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 11 00:37:08.685081 n-d-850468-14 devstack@n-api.service[122633]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 11 00:37:08.685930 n-d-850468-14 devstack@n-api.service[122633]: Thu Aug 11 00:37:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 11 00:37:09.354800 n-d-850468-14 devstack@n-api.service[122632]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 11 00:37:09.355386 n-d-850468-14 devstack@n-api.service[122632]: Thu Aug 11 00:37:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 11 00:37:09.469230 n-d-850468-14 devstack@n-api.service[122632]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 11 00:37:09.469432 n-d-850468-14 devstack@n-api.service[122632]: Thu Aug 11 00:37:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 11 00:38:48.678759 n-d-850468-14 devstack@n-api.service[122633]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 11 00:38:48.679360 n-d-850468-14 devstack@n-api.service[122633]: Thu Aug 11 00:38:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 11 00:39:08.862484 n-d-850468-14 devstack@n-api.service[122632]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 11 00:39:08.863114 n-d-850468-14 devstack@n-api.service[122632]: Thu Aug 11 00:39:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!